Skip to content
Enterprise Integrator Documentation
About this Release
7.1.0
Show all
Streaming Integrator
The latest Streaming Integrator is now released with WSO2 API Manager. See the
latest documentation
.
Type to start searching
Get Started
Learn
Setup and Install
Develop
Observability
Connectors
References
Report Issues
WSO2 Enterprise Integrator Documentation
wso2/docs-ei
Home
Get Started
Get Started
Introduction
Quick Start Guide
Creating Your First Siddhi Application
Creating Your First Siddhi Application
Streaming Integration Overview
Step 1: Download and Install Streaming Integrator
Step 2: Create the Siddhi Application
Step 3: Deploy the Siddhi Application
Step 4: Run the Siddhi Application
Step 5: Update the Siddhi Application
Step 6: Handle Errors
Step 7: Monitor Statistics
Architecture
Key Concepts
Learn
Learn
Use Cases
Use Cases
Use Cases Overview
Extracting Data from Static Sources in Real Time
Receiving Data in Transit
Loading and Writing Data
Publishing Data
Stream Processing
Stream Processing
Stream Processing Overview
Cleansing Data
Transforming Data
Enriching Data
Summarizing Data
Correlating Data
Handling Errors
Performing ETL Operations
Tutorials
Tutorials
Tutorials Overview
Performing Real-time ETL with MySQL
Performing Real-time ETL with Files
Creating an ETL Application via SI Tooling
Working with Kafka
Working with Business Rules
Integrating Data Stores in Streaming Integration
Exposing Processed Data as API
Error Handling with Data Streams
Triggering Integrations via MI
Running SI with Docker and Kubernetes
Examples
Examples
Consuming Data
Consuming Data
Receiving JSON Events via TCP
Publishing Events to a Google Pub/Sub Topic
Publishing and Receiving CSV Events via Files
Capturing MySQL Inserts via CDC
Receiving Messages from a Google Pub/Sub Topic
Receiving XML events via MQTT
Receiving Binary Events via TCP
Receiving Binary Events via Kafka
Receiving XML Events via HTTP
Working with an influxDB Store
Capturing MySQL Inserts and Updates via CDC Polling Mode
Publishing HTTP Events to an OAuth-protected Endpoint while Using a Refresh Token Grant Type
Publishing HTTP Events via an OAuth-protected Endpoint
Receiving Events via Simulator and Persisting in SOLR Store
Receiving Events via HTTP Transport
Receiving Events via File
Receiving XML Events via Email
Receiving JSON Events via RabbitMQ
Receive Events via Simulator and Persist in Cassandra Store
Transforming Data
Transforming Data
Publishing HTTP Events to to an OAuth-protected Endpoint
Publishing HTTP Events to to an OAuth-protected Endpoint without an Access Token
Receiving ER7 Events via HL7
Preprocessing Data Received via TCP
Publishing ER7 Events via HL7
Receiving Data via TCP and Preprocessing
Receiving and Publishing Events in Custom CSV Format
Sending Custom JSON Events via HTTP
Publishing Text Events via Email
Receiving Custom Text Events via Kafka
Using Javascript Functions in Siddhi Applications
Publishing Custom Avro Events via Kafka
Receiving Custom XML Messages via HL7
Receiving Custom Text Events via TCP
Identifying Sub-sequences in Input Sequences
Publishing XML messages via HL7
Publishing JSON Events via Kafka
Publishing JSON Events to Files
Receiving Custom XML Events via HTTP
Publishing XML Events via RabbitMQ
Rounding up Amounts via the Math Function
Receiving Text Events via TCP
Publishing Emails in XML Format
Converting String Values to Lowercase
Text Mapping with In-memory Transport
Receiving JSON Events via HTTP
Consuming Events from a Kafka Topic and Publishing to Another Kafka Topic
Publishing Custom XML Events via HTTP
Sending Custom Keyvalue Events via SNMP
Publishing JSON Events via TCP
Publishing HTTP Events to an OAuth-protected Endpoint
Inserting and Accessing Data in a Map
Publishing XML Events via JMS
Receiving JSON Events via JMS
Receiving Custom JSON Events via HTTP
Enriching Data
Enriching Data
Counting the Frequency of Values with BottomK
Extracting Values from a String
Joining Streaming Data with Stored Data in RDBMS
Using Javascript Functions in Siddhi Applications
Receiving Events via Simulator and Persisting in a Store
Publishing HTTP Requests, Receiving Responses, and Processing Them
Converting Units
Processing Geo Data
Performing Streaming Learning Using a Clustree Model
Receiving XML Events via Websocket
Aggregating Data
Aggregating Data
Preprocessing Data Received via TCP
Receiving Data via TCP and Preprocessing
Publishing Text Events via Email
Calculating Aggregations Over Time
Receiving Events via HTTP Transport
Aggregating Data Incrementally
Receiving Events and Persisting Them in Redis Store
Receiving Events and Persisting in MongoDB Store
Correlating Data
Correlating Data
Making Predictions via PMML Model
Making Predictions via a Regressor Model
Extracting Values from a String
Performing Regression Tasks via an Imported Tensorflow Model
Publishing XML Events via MQTT
Identifying Event Patterns Based On Order of Event Arrival
Using StreamingML Kmeans for Clustering
Receiving Prometheus Metrics
Making Predictions via Hoeffding Classifier Model
Receiving Custom Key Value Events via SNMP
Receiving Key Value Events via JMS
Consuming Messages from IBM Message Queues
Receiving Email Alerts
Making Predictions via a Streaming Perceptron Model
Calculating the Distance Between Two Locations
Publishing Data
Publishing Data
Publishing Text Events via TCP
Receiving ER7 Events via HL7
Publishing Events to a Google Pub/Sub Topic
Publishing Binary Events via TCP
Publishing XML Events via WebSocket
Publishing Consumed Events to Prometheus Metrics and Exposing then via HTTP
Working with an influxDB Store
Publishing Binary Events via Kafka
Publishing Key-value events via JMS
Publishing XML Events via HTTP
Publishing HTTP Events to an OAuth-protected Endpoint while Using a Refresh Token Grant Type
Publishing HTTP Events via an OAuth-protected Endpoint
Receiving Events via Simulator and Persisting in SOLR Store
Publishing JSON Events via HTTP
Receiving Events via Simulator and Persisting in RDBMS Store
Receive Events via Simulator and Persist in Cassandra Store
Publishing Avro Events via Kafka
Publishing Aggregated Events to the Amazon AWS S3 Bucket
Publishing Events to a GCS Bucket
Setup and Install
Setup and Install
Install
Install
Installing the Streaming Integrator
Installing the Streaming Integrator
Installing via the Installer
Installing via the Binary
Installing as a Windows Service
Installing as a Linux Service
Installing Siddhi Extensions
Running the Streaming Integrator in Containers
Running the Streaming Integrator in Containers
Installing in Docker
Installing in Kubernetes
Migrate
Migrate
Upgrading WSO2 Enterprise Integrator
Deploy
Deploy
Single Deployment
Minimum HA Cluster
Active-Active Cluster
Scalable Cluster
Minimum HA Cluster in AWS ECS
Set-up
Set-up
Production Checklist
Configuring Datasources
Configuring Business Rules Deployment
General Data Protection Regulations
Working with Keystores
Supporting Different Transports
User Management
Configuring State Persistence
Configuring Cluster Coordination
Protecting Sensitive Data via the Secure Vault
Adding Third Party Non OSGi Library
Configuring Default Ports
Changing the Host Name and Context Path of Web UI Applications
Enabling Logs for Received Event Count
Develop
Develop
Developing Streaming Integrator Solutions
Streaming Integrator Tooling
Streaming Integrator Tooling
Streaming Integrator Tooling Overview
Working with the Design View
Creating Siddhi Applications
Installing Siddhi Extensions
Testing Siddhi Applications
Deploying Siddhi Applications
Exporting Siddhi Applications
Observability
Observability
Monitoring SI via Dashboards
Monitoring SI via Dashboards
Configuring Dashboards
Managing Dashboards
Monitoring WSO2 SI
Monitoring WSO2 SI
Overview
Viewing Overall Statistics
Viewing Server Statistics
Viewing Stream Statistics
Viewing Source Statistics
Viewing Query Statistics
Viewing Window Statistics
Viewing Trigger Statistics
Viewing Table Statistics
Viewing Aggregation Statistics
Viewing On Demand Query Statistics
Monitoring ETL Flows
Connectors
Connectors
Streaming Integrator Connectors Overview
Downloading and Installing Siddhi Connectors
Writing Custom Siddhi Extensions
Configuring System Parameters for Siddhi Extensions
References
References
Environment Compatibility
Streaming Integration REST API Guide
Streaming Integration REST API Guide
REST API Guide Overview
Siddhi Application Management APIs
Permission APIs
Business Rules APIs
Store APIs
Healthcheck APIs
HTTP Status Codes
Performance Analysis Results
About this Release
¶
WSO2 EI 7.0.0 is the successor of WSO2 EI 6.5.0.
Top