Adf Dataflow Inline Delta Sink Element

API Type:

Varigence.Languages.Biml.DataFactory.AstAdfDataflowInlineDeltaSinkNode

X-Ref:

• Ast Adf Dataflow Inline Delta Sink Node
• Ast Adf Dataflow Dataset Sink Base Node
• Ast Adf Dataflow Dataset Base Node
• Ast Adf Dataflow Component Base Node
• Ast Scope Boundary Node

Attributes

Attribute	API Type	Default	Description
InputStreamName	AstAdfDataflowOutputStreamNode		A reference to a previous component's output stream. This is a required reference to an existing definiton.
LinkedServiceName	AstAdfLinkedServiceBaseNode		Specifies a reference to the linked service that will be used for this inline dataset. This is a required reference to an existing definiton.
Name	String		Specifies the name of the object. This name can be used to reference this object from anywhere else in the program. This is a required property
SkipDuplicateInputColumns	String		If the same input column is used in more than one mapping, then any instance after the first will be skipped. This is a required property
SkipDuplicateOutputColumns	String		If a mapping will produce an output column that matches another column, then each instance after the first will be skipped. This is a required property
AllowSchemaDrift	String		Select true if your source columns are likely to change during the dataflow. If marked true, all columns pass through the dataflow to the sink.
AutoCompact	String		After an individual write, checks if files can further be compacted, and runs a quick OPTIMIZE job (with 128 MB file sizes instead of 1GB) to further compact files for partitions that have the most number of small files.
CompressionLevel	AdfFileCompressionLevel	None	Specifies the compression level (fastest or optimal).
CompressionType	AdfDelimitedTextCompressionCodec	None	Specifies the type of compression used.
Container	String		Specifies the target blob container name.
FileSystem	String		Specifies the target FileSystem for ADLS linked services.
Folder	String		Specifies the target folder name.
MergeSchema	String		All columns that are present in the previous stream but not in the Delta table are added to the end of the schema
OptimizeWrite	String		Dynamically optimize partition sizes based on the actual data by attempting to write out 128 MB files for each table partition. This is an approximate size and can vary depending on dataset characteristics.
PartitionOption	AdfDataflowPartitionOption	CurrentPartitioning	Specifies how the user would like to handle partitioning inside of dataflow components.
Vacuum	String		Remove files no longer referenced by a Delta table and are older than this retention threshold in hours. Retention threshold will be 30 days if leaving this value as empty or 0.
ValidateSchema	String		Dataflow will fail if any column in the dataflow is not found in the source.

Singleton Children

Child	API Type	Description
<DatabaseSinkSettings />	AstAdfDataflowSnowflakeSinkSettingsNode	AstAdfDataflowSnowflakeSinkSettingsNode objects correspond directly to the class for all Snowflake related sink settings in Azure Data Factory Dataflows.
<RoundRobin />	AstAdfRoundRobinPartitionSettingsNode	Settings node for Round Robin partitioning in dataflow components.
<Hash />	AstAdfHashPartitionSettingsNode	Settings node for Hash partitioning in dataflow components.
<DynamicRange />	AstAdfDynamicRangePartitionSettingsNode	Settings node for Dynamic Range partitioning in dataflow components.
<FixedRange />	AstAdfFixedRangePartitionSettingsNode	Settings node for Fixed Range partitioning in dataflow components.
<Key />	AstAdfKeyPartitionSettingsNode	Settings node for Key partitioning in dataflow components.

Collection Children

Child	API Type	Description
<Annotations>     <Annotation /> </Annotations>	AstAnnotationNode	This is a collection of annotation items that can be used to specify documentation, tags, or other information. Annotations are particularly useful for storing information about nodes that can be used by BimlScript code.
<ColumnMappings>     Multiple Choices... </ColumnMappings>	AstAdfDataflowComponentColumnBaseNode	This is a collection of column mappings that are used to map the columns to the sink.
<Columns>     <Column /> </Columns>	AstAdfDataflowDatasetColumnNode	Specifies an optional list of columns to be used as an output from a source or input for a sink.
<Parameters>     <Parameter /> </Parameters>	AstAdfDatasetReferenceParameterNode	Specifies an optional list of parameters to be passed in with the dataset.