14 docs tagged with "file-handling"

Automating the Staged Delimited Flat File Pattern

Use BimlScript to generate one staging package per delimited flat file by reading file metadata from a SQL table.

Export Data to Flat Files with Biml

Use BimlScript to loop over every table in a source database, generate matching flat file formats and connections, and build a single package that exports each table to a CSV file in parallel.

Export to Split Flat Files with Biml

Generate SSIS packages that split a large source table into multiple flat files using OFFSET FETCH and a Biml script that calls another Biml script.

Extracting a Database Table to a Text File

Generate an SSIS package in Biml that copies a SQL Server table to a delimited flat file using OleDbConnection, FlatFileFormat, and FlatFileDestination.

Extracting All Tables to Raw Files

Generate a Biml file that extracts every base table in a SQL Server database to its own raw file by querying INFORMATION_SCHEMA with FOR XML PATH.

Extracting Database Tables to Raw Files

Use a Biml RawFileFormat plus a RawFileDestination paired with a FileConnection to extract a SQL Server table to an SSIS raw file.

Flat File Delimiters and Text Qualifiers in Biml

Three ways to specify delimiters and text qualifiers on flat file definitions in Biml: the named enum, hex codes, and the literal character with proper encoding or escaping.

For Each Loops with Biml over Flat Files

Generate an SSIS package that loops over every CSV file in a directory, imports each into a single SQL Server target table, and stores the file name with each row.

Importing a Text File with Biml

Define the FlatFileConnection, FlatFileFormat, and FlatFileSource needed to read a delimited text file in an SSIS data flow generated from Biml.

Importing Data From Excel With Biml

Call GetDatabaseSchema on an ExcelConnection to materialize each worksheet as a Biml table and generate the matching staging DDL.

Iterating Through Excel Worksheets with Biml

Use BimlScript to read worksheet names from an Excel workbook and emit one SSIS data flow per worksheet, all loading into the same target table.

Loading Flat Files with XML Format Definitions

Generate Biml flat file formats, connections, and matching staging tables from bcp generated XML format files using a small set of extension methods.

Metadata Design Patterns in Biml

Build SSIS staging packages from a flat file using Biml, then convert hardcoded values into a metadata driven generator that reads file format and column details from a database.

Schema Definitions from an ODBC Text Source

Use an ODBC text driver to expose a folder of flat files as tables, then read schema metadata to drive ETL generation.