Standard SSIS data flows rely on static, design-time metadata: column names, data types, and mappings are established when you design the package. Variables and expressions can change which table or file a component accesses, but the data flow still expects the configured column structure. Processing entities with different schemas or accommodating schema changes can therefore require manual updates to the package.
COZYROC SSIS+ addresses this limitation with metadata-driven pipelines (a.k.a dynamic data flows), powered by Data Flow Task Plus. DFT+ discovers column metadata and builds mappings at runtime, allowing the same ETL logic to process different files, tables, or application entities within the configured source and destination connections. Reuse one data flow across multiple entities and adapt to changing schemas with less manual rework.
Reuse Your Data Flows
Configure the source and destination connection.
Reuse the logic for any table/entity.
Use variables and expressions to select source and destination tables, file paths, sheet names, or application entities. Data Flow Task Plus discovers their column metadata and builds the mappings when the flow runs.
Run the package for one source–destination pair, or place DFT+ inside a loop to process multiple pairs in sequence. Loops can even be run in parallel with Parallel Loop Task
From CSV and Excel files to SQL Server tables and SaaS applications such as Dynamics 365, Salesforce and many more.
Build once. Reuse across entities.
Reuse your ETL logic, including transformations and column mappings, across multiple tables, files, or application entities. DFT+ resolves metadata at runtime, so you can maintain the process in one place instead of duplicating data flows for each entity.
Examples of reusable data flows
Bulk processing
Export multiple database tables to separate files, load a series of incoming files, or repeat an integration across application entities. A loop selects each pair; DFT+ refreshes its metadata and mappings on every iteration.
Cloud migration
Reuse a metadata-driven pipeline to move entities from an on-premises application to its cloud counterpart, such as Dynamics CRM to Dynamics 365. Process entities in dependency order so prerequisite records are in place.
Adapt to Schema Drift
Handle schema changes with less maintenance effort.
When a source or destination schema evolves, manually updating column metadata and mappings can become a recurring task. DFT+ refreshes that information at execution time, reducing the need to redesign and redeploy packages for supported schema changes.
What is schema drift?
Schema drift is when the structure of data changes over time, such as columns being added, removed, renamed, or having their data types changed. It can break data pipelines that expect the data to follow a fixed schema.
Current metadata. Runtime mappings. Less manual maintenance.
Work with the current schema
Read column metadata when the package runs, so the flow can respond to changes in the configured sources and destinations.
Reduce repetitive updates
Spend less time maintaining column definitions and rebuilding mappings as data structures evolve.
Keep your ETL logic reusable
Let runtime metadata handling support the integration you have already designed.
Knowledge Base
COZYROC SSIS+ Components Suite is free for testing in your development environment.
A licensed version can be deployed on-premises, on Azure-SSIS IR and on COZYROC Cloud.
