• PRODUCTS
  • SUPPORT
  • DOCS
  • PARTNERS
  • COMPANY
  • QUOTE
  • ACCOUNT
  • STORE
QUOTE

Documentation

Support Forums
What can we help you with?
Topics

Adf Dataflow Defined Dataset Source Element

API Type:
Varigence.Languages.Biml.DataFactory.AstAdfDataflowDefinedDatasetSourceNode
X-Ref:
  • Ast Adf Dataflow Defined Dataset Source Node
  • Ast Adf Dataflow Dataset Source Base Node
  • Ast Adf Dataflow Dataset Base Node
  • Ast Adf Dataflow Component Base Node
  • Ast Scope Boundary Node

Attributes

AttributeAPI TypeDefaultDescription
DatasetNameAstAdfDatasetBaseNode 
Specifies a reference to the dataset used in the dataflow. This is a required reference to an existing definiton.
NameString 
Specifies the name of the object. This name can be used to reference this object from anywhere else in the program. This is a required property
AllowSchemaDriftString 
Select true if your source columns are likely to change during the dataflow. If marked true, all columns pass through the dataflow to the sink.
InferDriftedColumnTypesString 
Allow the auto-detection of the data type of drifted columns
PartitionOptionAdfDataflowPartitionOptionCurrentPartitioning
Specifies how the user would like to handle partitioning inside of dataflow components.
RowsLimitString"-1"
Limit of number of rows to be imported.
ValidateSchemaString 
Dataflow will fail if any column in the dataflow is not found in the source.

Singleton Children

ChildAPI TypeDescription
<DocumentSettings />AstAdfDataflowDocumentSourceSettingsNodeAstAdfDataflowDocumentSourceSettingsNode objects correspond directly to source settings for avro, excel, orc, and parquet file formats in dataflows. This is a required property
<DelimitedSettings />AstAdfDataflowDelimitedSourceSettingsNodeAstAdfDataflowDelimitedSourceSettingsNode objects correspond directly to source settings for delimited file formats in dataflows. This is a required property
<JsonSettings />AstAdfDataflowJsonSourceSettingsNodeAstAdfDataflowJsonSourceSettingsNode objects correspond directly to source settings for JSON file formats in dataflows. This is a required property
<XmlSettings />AstAdfDataflowXmlSourceSettingsNodeAstAdfDataflowXmlSourceSettingsNode objects correspond directly to source settings for XML file formats in dataflows. This is a required property
<QuerySettings />AstAdfDataflowQuerySourceSettingsNodeAstAdfDataflowQuerySourceSettingsNode objects correspond directly to source settings that use a query. This is a required property
<TableSettings />AstAdfDataflowTableSourceSettingsNodeAstAdfDataflowTableSourceSettingsNode objects correspond directly to source settings that use a table. This is a required property
<StoredProcSettings />AstAdfDataflowStoredProcSourceSettingsNodeAstAdfDataflowStoredProcSourceSettingsNode objects correspond directly to source settings for StoredProc compatible database datasets in dataflows. This is a required property
<SnowflakeSettings />AstAdfDataflowSnowflakeSourceSettingsNodeAstAdfDataflowSnowflakeSourceSettingsNode objects correspond directly to source settings for Snowflake datasets in Azure Data Factory Dataflows. This is a required property
<CosmosDbSettings />AstAdfDataflowCosmosDbSourceSettingsNodeAstAdfDataflowCosmosDbSourceSettingsNode objects correspond directly to source settings for CosmosDB datasets in Azure Data Factory Dataflows. This is a required property
<RoundRobin />AstAdfRoundRobinPartitionSettingsNodeSettings node for Round Robin partitioning in dataflow components.
<Hash />AstAdfHashPartitionSettingsNodeSettings node for Hash partitioning in dataflow components.
<DynamicRange />AstAdfDynamicRangePartitionSettingsNodeSettings node for Dynamic Range partitioning in dataflow components.
<FixedRange />AstAdfFixedRangePartitionSettingsNodeSettings node for Fixed Range partitioning in dataflow components.
<Key />AstAdfKeyPartitionSettingsNodeSettings node for Key partitioning in dataflow components.

Collection Children

ChildAPI TypeDescription
<Annotations>
    <Annotation />
</Annotations>
AstAnnotationNode
This is a collection of annotation items that can be used to specify documentation, tags, or other information. Annotations are particularly useful for storing information about nodes that can be used by BimlScript code.
<Columns>
    <Column />
</Columns>
AstAdfDataflowDatasetColumnNode
Specifies an optional list of columns to be used as an output from a source or input for a sink.
<Parameters>
    <Parameter />
</Parameters>
AstAdfDatasetReferenceParameterNode
Specifies an optional list of parameters to be passed in with the dataset.

© Varigence