Adf Dataflow Defined Dataset Source Element
X-Ref:
- Ast Adf Dataflow Defined Dataset Source Node
- Ast Adf Dataflow Dataset Source Base Node
- Ast Adf Dataflow Dataset Base Node
- Ast Adf Dataflow Component Base Node
- Ast Scope Boundary Node
Attributes
Attribute | API Type | Default | Description |
---|---|---|---|
DatasetName | AstAdfDatasetBaseNode | Specifies a reference to the dataset used in the dataflow. This is a required reference to an existing definiton. | |
Name | String | Specifies the name of the object. This name can be used to reference this object from anywhere else in the program. This is a required property | |
AllowSchemaDrift | String | Select true if your source columns are likely to change during the dataflow. If marked true, all columns pass through the dataflow to the sink. | |
InferDriftedColumnTypes | String | Allow the auto-detection of the data type of drifted columns | |
PartitionOption | AdfDataflowPartitionOption | CurrentPartitioning | Specifies how the user would like to handle partitioning inside of dataflow components. |
RowsLimit | String | "-1" | Limit of number of rows to be imported. |
ValidateSchema | String | Dataflow will fail if any column in the dataflow is not found in the source. |
Singleton Children
Child | API Type | Description |
---|---|---|
<DocumentSettings /> | AstAdfDataflowDocumentSourceSettingsNode | AstAdfDataflowDocumentSourceSettingsNode objects correspond directly to source settings for avro, excel, orc, and parquet file formats in dataflows. This is a required property |
<DelimitedSettings /> | AstAdfDataflowDelimitedSourceSettingsNode | AstAdfDataflowDelimitedSourceSettingsNode objects correspond directly to source settings for delimited file formats in dataflows. This is a required property |
<JsonSettings /> | AstAdfDataflowJsonSourceSettingsNode | AstAdfDataflowJsonSourceSettingsNode objects correspond directly to source settings for JSON file formats in dataflows. This is a required property |
<XmlSettings /> | AstAdfDataflowXmlSourceSettingsNode | AstAdfDataflowXmlSourceSettingsNode objects correspond directly to source settings for XML file formats in dataflows. This is a required property |
<QuerySettings /> | AstAdfDataflowQuerySourceSettingsNode | AstAdfDataflowQuerySourceSettingsNode objects correspond directly to source settings that use a query. This is a required property |
<TableSettings /> | AstAdfDataflowTableSourceSettingsNode | AstAdfDataflowTableSourceSettingsNode objects correspond directly to source settings that use a table. This is a required property |
<StoredProcSettings /> | AstAdfDataflowStoredProcSourceSettingsNode | AstAdfDataflowStoredProcSourceSettingsNode objects correspond directly to source settings for StoredProc compatible database datasets in dataflows. This is a required property |
<SnowflakeSettings /> | AstAdfDataflowSnowflakeSourceSettingsNode | AstAdfDataflowSnowflakeSourceSettingsNode objects correspond directly to source settings for Snowflake datasets in Azure Data Factory Dataflows. This is a required property |
<CosmosDbSettings /> | AstAdfDataflowCosmosDbSourceSettingsNode | AstAdfDataflowCosmosDbSourceSettingsNode objects correspond directly to source settings for CosmosDB datasets in Azure Data Factory Dataflows. This is a required property |
<RoundRobin /> | AstAdfRoundRobinPartitionSettingsNode | Settings node for Round Robin partitioning in dataflow components. |
<Hash /> | AstAdfHashPartitionSettingsNode | Settings node for Hash partitioning in dataflow components. |
<DynamicRange /> | AstAdfDynamicRangePartitionSettingsNode | Settings node for Dynamic Range partitioning in dataflow components. |
<FixedRange /> | AstAdfFixedRangePartitionSettingsNode | Settings node for Fixed Range partitioning in dataflow components. |
<Key /> | AstAdfKeyPartitionSettingsNode | Settings node for Key partitioning in dataflow components. |
Collection Children
Child | API Type | Description |
---|---|---|
<Annotations> <Annotation /> </Annotations> | AstAnnotationNode | This is a collection of annotation items that can be used to specify documentation, tags, or other information. Annotations are particularly useful for storing information about nodes that can be used by BimlScript code. |
<Columns> <Column /> </Columns> | AstAdfDataflowDatasetColumnNode | Specifies an optional list of columns to be used as an output from a source or input for a sink. |
<Parameters> <Parameter /> </Parameters> | AstAdfDatasetReferenceParameterNode | Specifies an optional list of parameters to be passed in with the dataset. |