Skip to content

Using the Load Balance Endpoint

Session Affinity Load Balancing between Three Endpoints

This sample demonstrates how the Micro Integrator can handle load balancing with session affinity using simple client sessions. Here the session type is specified as simpleClientSession . This is a client initiated session, which means that the client generates the session identifier and sends it with each request. In this sample session type, the client adds a SOAP header named ClientID containing the identifier of the client. The MI binds this ID with a server on the first request and sends all successive requests containing that ID to the same server.

Synapse configuration

Following is a sample REST API configuration that we can used to implement this scenario.

<proxy name="LoadBalanceProxy" startOnLoad="true" transports="http https" xmlns="">
            <header name="Action" value="urn:placeOrder"/>
                    <!-- specify the session as the simple client session provided by Synapse for
                    testing purpose -->
                    <session type="simpleClientSession"/>

                            <address uri="http://localhost:9001/services/SimpleStockQuoteService">
                            <address uri="http://localhost:9002/services/SimpleStockQuoteService">
                            <address uri="http://localhost:9003/services/SimpleStockQuoteService">
            <sequence key="errorHandler"/>
<sequence name="errorHandler"> 
    <makefault version="soap11">
        <code value="soap11Env:VersionMismatch" xmlns:soap11Env=""/>
        <reason value="COULDN'T SEND THE MESSAGE TO THE SERVER."/>

    <header name="To" action="remove"/>
    <property name="RESPONSE" value="true"/>

Build and run

Create the artifacts:

  1. Set up WSO2 Integration Studio.
  2. Create an ESB Solution project.
  3. Create the Proxy and the Sequence with the configurations given above.
  4. Deploy the artifacts in your Micro Integrator.

Set up the back-end service:

  1. Download the stockquote_service.jar.
  2. Open a terminal, navigate to the location of the downloaded service, and run it using the following command:

    java -jar stockquote_service.jar
    3. Open the tcpmon application, which is in MI_TOOLING_HOME/Contents/Eclipse/runtime/microesb/bin/ (in MacOS) or MI_TOOLING_HOME/runtime/microesb/bin (in Windows/Linux) directory. 4. Configure tcpmon to listen to ports 9001, 9002, and 9003 and set the target hostname to localhost and target port to 9000 in each instance.

Send the following request 3 or more times. Be sure to include a simpleClientSession to the header.

POST http://localhost:8290/services/LoadBalanceProxy HTTP/1.1
Content-Type: text/xml;charset=UTF-8
simpleClientSession: 123

<soapenv:Envelope xmlns:soapenv="">
   <m0:placeOrder xmlns:m0="http://services.samples">

Analyzing the output:

When inspecting tcpmon, you will see that each listener has received a request. This is because, when multiple requests are sent with the same session Id, they are distributed across the three endpoints in a round robin manner.