Delayed Durability for High Throughput Biml Migrations
When parallel SSIS packages from a Biml framework saturate the log writer with WRITELOG waits, enabling delayed durability on staging databases can cut total runtime in half.
When parallel SSIS packages from a Biml framework saturate the log writer with WRITELOG waits, enabling delayed durability on staging databases can cut total runtime in half.
Preserve existing indexes on staging tables when generating drop and create DDL by importing the live target indexes back into the Biml table definition.
Extend the topology aware load pattern so independent branches run in parallel while still respecting foreign key dependencies.
Use a T-SQL bin packing routine and a BimlScript template to assign tables to balanced parallel containers and generate the matching SSIS package.
Compare the Biml definition of a table against the live database before recreating it so unchanged objects keep their data and indexes.
Why the OLE DB Destination in fast load mode silently truncates oversized values, what row by row mode does instead, and how to plan for it in a Biml driven project.
Use LINQ OrderBy, Skip, and Take inside BimlScript to chunk a large set of source tables into evenly sized groups, each loaded by its own SSIS package.