Skip to main content

Sample Metadata

BimlFlex provides several sets of sample metadata and configurations.

These samples support various common use-cases and scenarios and are intended to assist adopting specific features for certain architectures and technical environments. The full list of available samples is available in the samples documentation.

For example, samples cover how to load files using SQL Server Integration Services (SSIS), how to implement delete detection to load data into Azure, or how to deliver a Data Vault model on Snowflake.

In the BimlFlex Application, use the Load Sample Metadata button in the Getting Started pane on the Dashboard to load sample metadata to the current active Customer.

Import Sample Metadata

tip

The Varigence YouTube channel contains various introduction videos about using BimlFlex and BimlStudio. This video provides an overview of how to load sample metadata into BimlFlex.

Available Metadata Samples

Starting Point Samples

SampleDescription
00.01 - MSSQL SSIS Starting PointSample connections, batches and projects for a SSIS Microsoft SQL Server Data Warehouse. Use this starting point to import metadata from AdventureWorksLT to build the Data Warehouse.
00.02 - MSSQL ADF Starting PointSample connections, batches and projects for a ADF Microsoft SQL Server Data Warehouse. Use this starting point to import metadata from AdventureWorksLT to build the Data Warehouse.
00.03 - Synapse SSIS Starting PointSample connections, batches and projects for a SSIS Azure Synapse Data Warehouse. Use this starting point to import metadata from AdventureWorksLT to build the Data Warehouse.
00.04 - Synapse ADF Starting PointSample connections, batches and projects for a ADF Azure Synapse Data Warehouse. Use this starting point to import metadata from AdventureWorksLT to build the Data Warehouse.
00.05 - Azure SQLDB ADF Starting PointSample connections, batches and projects for a ADF Azure SQL Database Data Warehouse. Use this starting point to import metadata from AdventureWorksLT to build the Data Warehouse.
00.10 - Snowflake SSIS Starting PointSample connections, batches and projects for a SSIS Snowflake Data Warehouse. Use this starting point to import metadata from AdventureWorksLT to build the Data Warehouse.
00.11 - Snowflake ADF Starting PointSample connections, batches and projects for a ADF Snowflake Data Warehouse. Use this starting point to import metadata from AdventureWorksLT to build the Data Warehouse.
00.15 - Databricks ADF Starting PointSample connections, batches and projects for a ADF Databricks Data Warehouse. Use this starting point to import metadata from AdventureWorksLT to build the Data Warehouse.

Microsoft SQL Server Samples

SampleDescription
01 - MSSQL Starting PointSample connections, batches and projects for a Microsoft SQL Server-based Data Warehouse. Use this starting point to import metadata from AdventureWorksLT to build the Data Warehouse.
02 - MSSQL After ImportAfter Import before Data Vault Modeling for MSSQL. Includes imported metadata from the AdventureWorksLT source.
03 - MSSQL DataMart ETL SSIS SolutionUsing a SQL Server Database (On-Prem), the final metadata for a complete Data Mart Project (STG, PSA, DM) using SQL Server Integration Services for transformations and SQL Server Integration Services for orchestration.
04 - MSSQL DataVault ETL SSIS SolutionUsing a SQL Server Database (On-Prem), the final metadata for a complete Data Vault Project (STG, PSA, DV, DM) using SQL Server Integration Services for transformations and SQL Server Integration Services for orchestration.
05 - MSSQL DataVault ELT SSIS SolutionUsing a SQL Server Database (On-Prem), the final metadata for a complete Data Vault Project (STG, PSA, DV, DM) using ELT stored procedures for transformations and Azure Data Factory for orchestration.
06 - MSSQL DataMart SSIS SolutionUsing a SQL Server Database (On-Prem), the final metadata for a complete Data Mart Project (STG, PSA, DM) using ELT stored procedures for transformations and SQL Server Integration Services for orchestration.
07 - MSSQL DataVault ADF SolutionUsing a SQL Server Database (On-Prem), the final metadata for a complete Data Vault Project (STG, PSA, DV, DM) using ELT stored procedures for transformations and Azure Data Factory for orchestration.
08 - MSSQL DataMart ADF SolutionUsing a SQL Server Database (On-Prem), the final metadata for a complete Data Mart Project (STG, PSA, DM) using ELT stored procedures for transformations and Azure Data Factory for orchestration.
09 - MSSQL Business Central ADF SolutionUsing a SQL Server Database (On-Prem), the final metadata for a complete Persistent Staging Project (STG, PSA) using ELT stored procedures for transformations and Azure Data Factory for orchestration.
10 - MSSQL Change Tracking ELT SSIS TemporalUsing a SQL Server Database (On-Prem), the final metadata for Change Tracking using ELT stored procedures for transformations and SQL Server Integration Services for orchestration with Temporal PSA Tables.
11 - MSSQL Change Tracking ADF TemporalUsing a SQL Server Database (On-Prem), the final metadata for Change Tracking using ELT stored procedures for transformations and Azure Data Factory for orchestration with Temporal PSA Tables.
12 - MSSQL Change Data Capture SSIS SolutionUsing a SQL Server Database (On-Prem), the final metadata for Change Data Capture using ELT stored procedures for transformations and SQL Server Integration Services for orchestration with Temporal PSA Tables.

Azure Synapse Samples

SampleDescription
15 - Synapse DataVault SSIS SolutionUsing a Azure Synapse Database, the final metadata for a complete Data Vault Project (STG, PSA, DV, DM) using ELT stored procedures for transformations and SQL Server Integration Services for orchestration.
16 - Synapse DataMart SSIS SolutionUsing a Azure Synapse Database, the final metadata for a complete Data Mart Project (STG, PSA, DM) using ELT stored procedures for transformations and SQL Server Integration Services for orchestration.
17 - Synapse DataVault ADF SolutionUsing a Azure Synapse Database, the final metadata for a complete Data Vault Project (STG, PSA, DV, DM) using ELT stored procedures for transformations and Azure Data Factory for orchestration.
18 - Synapse DataMart ADF SolutionUsing a Azure Synapse Database, the final metadata for a complete Data Mart Project (STG, PSA, DM) using ELT stored procedures for transformations and Azure Data Factory for orchestration.
19 - Synapse Change Tracking ADF SolutionUsing a Azure Synapse Database, the final metadata for Change Tracking using ELT stored procedures for transformations and Azure Data Factory for orchestration.
70 - Synapse Persistent Staging SSIS SolutionThis sample outlines a solution that initially stages data using one project, and then loads it into an Operational Data Store (ODS) with a second project. The ODS is configured as such (i.e. not as a PSA) by disabling Persist History for most Objects.

Microsoft Fabric Samples

SampleDescription
20 - Fabric DataVault SolutionUsing a Microsoft Fabric Lakehouse and Warehouse, the final metadata for a complete Data Vault Project (STG, PSA, DV, DM) using ELT stored procedures for transformations and Microsoft Fabric Data Factory for orchestration.
21 - Fabric DataMart SolutionUsing a Microsoft Fabric Lakehouse and Warehouse, the final metadata for a complete Data Mart Project (STG, PSA, DM) using ELT stored procedures for transformations and Microsoft Fabric Data Factory for orchestration.

Snowflake Samples

SampleDescription
25 - Snowflake DataVault SSIS SolutionUsing a Snowflake Database, the final metadata for a complete Data Vault Project (STG, PSA, DV, DM) using ELT stored procedures for transformations and SQL Server Integration Services for orchestration.
26 - Snowflake DataMart SSIS SolutionUsing a Snowflake Database, the final metadata for a complete Data Mart Project (STG, PSA, DM) using ELT stored procedures for transformations and SQL Server Integration Services for orchestration.
27 - Snowflake DataVault ADF SolutionUsing a Snowflake Database, the final metadata for a complete Data Vault Project (STG, PSA, DV, DM) using ELT stored procedures for transformations and Azure Data Factory for orchestration.
28 - Snowflake DataMart ADF SolutionUsing a Snowflake Database, the final metadata for a complete Data Mart Project (STG, PSA, DM) using ELT stored procedures for transformations and Azure Data Factory for orchestration.

Azure SQL Managed Instance Samples

SampleDescription
35 - SQLMI DataVault ADF SolutionUsing an Azure SQL Managed Instance Database, the final metadata for a complete Data Vault Project (STG, PSA, DV, DM) using ELT stored procedures for transformations and Azure Data Factory for orchestration.
36 - SQLMI DataMart ADF SolutionUsing an Azure SQL Managed Instance Database, the final metadata for a complete Data Mart Project (STG, PSA, DM) using ELT stored procedures for transformations and Azure Data Factory for orchestration.

Azure SQL Database Samples

SampleDescription
37 - SQLDB DataVault ADF SolutionUsing a Azure SQL Database, the final metadata for a complete Data Vault Project (STG, PSA, DV, DM) using ELT stored procedures for transformations and Azure Data Factory for orchestration.
38 - SQLDB DataMart ADF SolutionUsing a Azure SQL Database, the final metadata for a complete Data Mart Project (STG, PSA, DM) using ELT stored procedures for transformations and Azure Data Factory for orchestration.
39 - SQLDB Change Data Capture ADF SolutionUsing a Azure SQL Database, the final metadata for Change Data Capture using ELT stored procedures for transformations and Azure Data Factory for orchestration with Temporal PSA Tables.

Third-Party Source Samples

SampleDescription
41 - Synapse Dynamics ADF SolutionUsing a Dynamics CRM 365 Rest API connection to a Azure Synapse Database Target with ELT stored procedures for transformations and Azure Data Factory for orchestration.
42 - Synapse Salesforce ADF SolutionUsing a Salesforce Rest API connection to a Azure Synapse Database Target with ELT stored procedures for transformations and Azure Data Factory for orchestration.
43 - Synapse Salesforce SSIS SolutionUsing a Salesforce Rest API connection to a Azure Synapse Database Target with ELT stored procedures for transformations and SQL Server Integration Services for orchestration.

File Source Samples

SampleDescription
51 - File MSSQL DataVault ELT SSIS SolutionUsing Flat Files to an SQL Server Database (On-Prem) connection, the final metadata for a complete Data Vault Project (STG, PSA, DV, DM) using SQL Server Integration Services for transformations and SQL Server Integration Services for orchestration.
52 - File Synapse DataVault ELT SSIS SolutionUsing Flat Files to an Synapse Database connection, the final metadata for a complete Data Vault Project (STG, PSA, DV, DM) using SQL Server Integration Services for transformations and SQL Server Integration Services for orchestration.
53 - File Snowflake DataVault ELT SSIS SolutionUsing Flat Files to an Snowflake Database connection, the final metadata for a complete Data Vault Project (STG, PSA, DV, DM) using SQL Server Integration Services for transformations and SQL Server Integration Services for orchestration.
54 - File MSSQL DataVault ELT ADF SolutionUsing Flat Files to an SQL Server Database (On-Prem) connection, the final metadata for a complete Data Vault Project (STG, PSA, DV, DM) using ELT stored procedures for transformations and Azure Data Factory for orchestration.
55 - File Synapse DataVault ELT ADF SolutionUsing Flat Files to an Synapse Database connection, the final metadata for a complete Data Vault Project (STG, PSA, DV, DM) using ELT stored procedures for transformations and Azure Data Factory for orchestration.
56 - File Snowflake DataVault ELT ADF SolutionUsing Flat Files to an Snowflake Database connection, the final metadata for a complete Data Vault Project (STG, PSA, DV, DM) using ELT stored procedures for transformations and Azure Data Factory for orchestration.
57 - File SQLDB DataVault ELT ADF SolutionUsing Flat Files to an Azure SQL Database connection, the final metadata for a complete Data Vault Project (STG, PSA, DV, DM) using ELT stored procedures for transformations and Azure Data Factory for orchestration.

Databricks Samples

SampleDescription
65 - Databricks Persistent Staging SolutionUsing Flat Files and Azure SQL Database connection, the final metadata for a complete Data Lake Landing Project (STG, PSA) using Azure Databricks for transformations and Azure Data Factory for orchestration.
66 - Databricks Pushdown SolutionUsing Flat Files and Azure SQL Database connection, the final metadata for a complete Hash Key Data Vault Project (STG, PSA, DV, DM) using Azure Databricks with Unity Catalog Tables for transformations and Databricks Pushdown Processing for orchestration.
67 - Databricks SolutionUsing Flat Files and Azure SQL Database connection, the final metadata for a complete Hash Key Data Vault Project (STG, PSA, DV, DM) using Azure Databricks with Unity Catalog Tables for transformations and Azure Data Factory for orchestration.
68 - Databricks SQL SolutionUsing Flat Files and Azure SQL Database connection, the final metadata for a complete Hash Key Data Vault Project (STG, PSA, DV, DM) using Azure Databricks with Unity Catalog Tables for transformations and Databricks SQL Scripting Pushdown Processing for orchestration.
69 - Databricks Lakeflow SolutionUsing Flat Files and Azure SQL Database connection, the final metadata for a complete Lakeflow and Auto Loader using Azure Databricks with Unity Catalog Tables for transformations and Databricks SQL Scripting Pushdown Processing for orchestration.

Business Model Samples

SampleDescription
90 - Business Model Starting PointThis sample provides the starting point involved in creating a comprehensive business model. It is tailored for those looking to understand the foundational elements of a successful business modelling strategy.
91 - Business Model Concepts AddedThis sample provides the starting point with the Business Concepts added for creating a comprehensive business model. It is tailored for those looking to understand the foundational elements of a successful business modelling strategy.
92 - Business Model AcceleratorThis sample provides the starting point for Data Vault Acceleration with the Business Concepts added for creating a comprehensive business model. It is tailored for those looking to understand the foundational elements of a successful business modelling strategy.
93 - Business Model AcceleratedThis sample provides the Accelerated Data Vault with the Business Concepts added for creating a comprehensive business model. It is tailored for those looking to understand the foundational elements of a successful business modelling strategy.