How to use SSIS BDD Transform for parallel processing (Balanced Data Distributor - Split Rows in Multiple Threads)

ZappySys offers Multi-Threading capability in many SSIS components (i.e. Web API Destination, Salesforce Destination).  However there will be a time when you like to use component which doesn't offer parallel processing options (i.e. MongoDB Destination, AWS CSV Destination) or you like to implement batching your own way.

For this purpose you can use BDD Transform (Balanced Data Distributor). This is offered by Microsoft for FREE.

How to download

You can download this component for FREE from official Microsoft Site here.

Video Tutorial

• Balanced Data Distributor (SQL Server Video)
  Leverage the Balanced Data Distributor component to reduce the execution time of an SSIS package. Increase the throughput of the package Data Flow transformations by paralleling the Data Flow buffers to multiple outputs. (10:29)
  Download: WMV | MP4 

Reference Site: https://docs.microsoft.com/en-us/previous-versions/dn912438(v=msdn.10)?redirectedfrom=MSDN

Example Use Case: 

In below example see how we have split workload into multiple threads (using 3 destinations). Just drag BDD Transform and attach blue arrow to each destination. All destinations are configured same way. Input rows are divided into 3 batches (around 10K in each batch - It may vary little bit in row count because Buffers might split at different data size but concept is to balance load as much as we can)