Automate SSIS From SAP to SQL With Biml and Theobald XtractIS
Drive an SSIS staging load from SAP using a metadata repository, the Theobald XtractIS source, and BimlScript that reads the SAP DD03L data dictionary.
Drive an SSIS staging load from SAP using a metadata repository, the Theobald XtractIS source, and BimlScript that reads the SAP DD03L data dictionary.
Use the BimlExpress preview pane to see expanded Biml output without writing it to a file, including SQL output produced through code that uses GetDropAndCreateDdl.
Build SSIS Change Data Capture initial load and incremental load packages in Biml using the SQL Server CDC components as custom tasks.
Generate an SSIS package that drops every table in a target database by looping over INFORMATION_SCHEMA until no tables remain.
Generate CREATE TABLE statements for an entire staging environment by reading INFORMATION_SCHEMA from the source database and emitting an ExecuteSQL task per table.
Define tables in Biml, then use BimlScript to generate an SSIS package that runs the CREATE TABLE statements against the target database.
When parallel SSIS packages from a Biml framework saturate the log writer with WRITELOG waits, enabling delayed durability on staging databases can cut total runtime in half.
Use ImportDB to materialize a SQL Server metadata schema as a DataSet inside BimlExpress, then drive connections, tables, and load packages from it.
Read a SQL Server meta schema with ImportDB, then emit a matching MetadataModel and MetadataInstance using the Biml Metadata feature in BimlStudio.
Generate a Biml file that extracts every base table in a SQL Server database to its own raw file by querying INFORMATION_SCHEMA with FOR XML PATH.
Use a Biml RawFileFormat plus a RawFileDestination paired with a FileConnection to extract a SQL Server table to an SSIS raw file.
Build SELECT statements from source metadata using the Biml GetColumnList method, including aliases, predicates, and delimiter overrides.
Use BimlScript to generate T-SQL scripts from source metadata, including SELECT statements and CREATE VIEW definitions across hundreds of tables.
Use GetQuerySchema to import column metadata from a SELECT query, view, table valued function, or stored procedure.
Use GetDatabaseSchema to pull schema, table, and view metadata from a source database into Biml so generated packages and SQL stay in step with the source.
Use the TheobaldXtractSapConnection and TheobaldXtractSapSource elements to copy a single SAP table into SQL Server with one Biml file.
Use a topology sort extension method to walk foreign key dependencies and generate SSIS packages that recreate and load tables in the right order.
Reduce mixed XML and C# complexity in Biml files by splitting into includes, using CallBimlScript, and pushing string assembly into T-SQL stored procedures.
Redirect failed inserts on an ADO.NET destination to a separate error table using Biml error handling configuration.
Configure the OLEDB Command data flow transformation in Biml to execute a parameterized SQL statement for each input row.
Call a stored procedure with output parameters from an OLEDB Command transformation and append the return values onto the data flow buffer.
Use a T-SQL bin packing routine and a BimlScript template to assign tables to balanced parallel containers and generate the matching SSIS package.
Use BimlScript and ImportDB to reverse engineer table metadata out of an existing staging database into a metadata model that drives future Biml generation.
Alternative methods to automate Biml code generation using Excel, SQL, PowerShell, and .NET
Define ODBC destinations in Biml using auto mapping, explicit column mapping, and per-column overrides.
Use BimlScript to write one .sql file per table in RootNode.Tables containing the DROP and CREATE DDL for that table.