Hdfs File Source Element
X-Ref:
- Ast Hdfs File Source Node
- Ast Cloud Source Base Node
- Ast Source Transformation Node
- Ast Transformation Node
- Ast Scope Boundary Node
Attributes
| Attribute | API Type | Default | Description |
|---|---|---|---|
| ConnectionName | AstHadoopConnectionNode | Specifies the HadoopConnection that should be used to connect to the Hadoop cluster. This is a required reference to an existing definiton. | |
| FilePath | String | This value represents the name of the blob container to be used. This is a required property | |
| Name | String | Specifies the name of the object. This name can be used to reference this object from anywhere else in the program. This is a required property | |
| LocaleId | Language | Inherited | This value specifies which locale is used by the dataflow task. |
| ValidateExternalMetadata | Boolean | true | This value specifies whether the data flow transformation is validated against columns that originated in external data sources. When server assets such as tables and stored procedures are created during processing, ValidateExternalMetadata is normally set to False, which prevents validation from completing at compile time. |
Singleton Children
| Child | API Type | Description |
|---|---|---|
| <ErrorHandling /> | AstComponentErrorHandlingNode | Specifies the error handling defaults to apply to an entire component |
| <AvroFormat /> | AstAdfAvroFormatNode | AstAdfAvroFormatNode objects correspond directly to Azure Data Factory AvroFormat objects. |
| <TextFormat /> | AstAdfDelimitedTextFormatNode | AstAdfDelimitedTextFormatNode objects correspond directly to Azure Data Factory DelimitedText Format dataset objects. |
Collection Children
| Child | API Type | Description |
|---|---|---|
| <Annotations> <Annotation /> </Annotations> | AstAnnotationNode | This is a collection of annotation items that can be used to specify documentation, tags, or other information. Annotations are particularly useful for storing information about nodes that can be used by BimlScript code. |
| <Columns> <Column /> </Columns> | AstDataflowColumnMappingNode | This value specifies how the component should map columns in the data flow to columns in the Source. Columns that are not explicitly listed in this collection are automatically mapped based on name. |
| <DataflowOverrides> Multiple Choices... </DataflowOverrides> | AstDataflowOverrideNode | Provides a collection of objects to override properties of the component, its input paths, its output paths, and its consituent dataflow columns. |