Streaming Integration Overview¶
This section helps you to understand streaming integration and how to perform it with WSO2 Streaming Integrator in less than 30 minutes
First, let's understand the concept of streaming integration. For this, let's consider an example where the temperature of multiple rooms are being monitored via sensors.
Each reading that reports the room ID, the device and the temperature of the room that is read by the device represents an event.
Many such events form a stream.
In Streaming typically involves handling data received/published via streams in high speed and high volume. In this example, a single device may do multiple temperature readings per second, and the stream reports the readings by multiple devices in a given second.
WSO2 Streaming Integrator allows data to be received from multiple sources such as files, databases, cloud-based applications, and streaming messaging systems (such as Kafka) in a streaming manner. It uses the Siddhi Query Language, to process this data, and then publishes the results in a streaming manner to multiples destinations such as files, databases, cloud-based applications, and streaming messaging systems in a streaming manner.
Streaming Integration involves processing streaming data and incorporating them into integration flows so that action can be taken based on the output derived. In this example, you may want to calculate the average temperature for every three readings to get a better idea of whether the temperature is on a rising trend or not.
To understand how Streaming Integration is performed via the WSO2 Streaming Integrator, follow the sections below.
Step 1: Download and Install Streaming Integrator
Step 2: Create a Siddhi Application
Step 3: Test the Siddhi Application
Step 4: Deploy the Siddhi Application
Extend Streaming Integrator