Adf Hd Insight Streaming Activity Element

API Type:

Varigence.Languages.Biml.DataFactory.AstAdfHdInsightStreamingActivityNode

X-Ref:

• Ast Adf Hd Insight Streaming Activity Node
• Ast Adf Hd Insight Activity Base Node
• Ast Adf Execution Activity Base Node
• Ast Adf Activity Base Node
• Ast Scope Boundary Node

Attributes

Attribute	API Type	Default	Description
Input	String		This is a WASB path to the input file to be provided to the mapper. This is a required property
LinkedServiceName	AstAdfHdInsightBaseLinkedServiceNode		Specifies a reference to the linked service for the HDInsight cluster that will be used for this activity. This is a required reference to an existing definiton.
Mapper	String		File name for mapper executable This is a required property
Name	String		Specifies the name of the object. This name can be used to reference this object from anywhere else in the program. This is a required property
Output	String		This is a WASB path to the output file to be provided to the reducer. This is a required property
Reducer	String		File name for Reducer executable This is a required property
Combiner	String		File name for Combiner executable
FileLinkedServiceName	AstAdfAzureStorageLinkedServiceBaseNode		Reference to a Azure Storage linked service used to store the mapper, combiner, and reducer programs. If unspecified, the Azure Storage account associated with the HDInsight cluster specified in the LinkedService property will be used. This references an existing definiton.
GetDebugInfo	AdfDebugInfoCopyCondition	None	Specifies the condition for this activity's log files to be copied to the Azure Storage account associated with the HDInsight cluster specified in the LinkedService property.
Retry	Int32	-1	Number of retry attempts.
RetryInterval	Int32	30	Specifies the time in seconds between retry attempts. Range between 30 and 86400 with 30 being the default.
SecureInput	Boolean	False	Specify whether the input from the activity is sensitive and should not be logged to monitoring.
SecureOutput	Boolean	False	Specify whether the input from the activity is sensitive and should not be logged to monitoring
Timeout	String	"7"	Timeout for the activity to run. Defaults to 7 days.

Singleton Children

Child	API Type	Description
<Description />	String	String is the .NET Framework String class. More information can be found at http://msdn.microsoft.com/en-us/library/system.string.aspx.
<Scheduler />	AstAdfActivityScheduleNode	AstAdfActivityScheduleNode objects correspond directly to scheduler specifications for activities in Azure Data Factory.

Collection Children

Child	API Type	Description
<FilePaths>     <FilePath /> </FilePaths>	String	Array of case-sensitive strings that represent the filepaths for the mapper, combiner, and reducer within the FileLinkedService. This is a required property
<Annotations>     <Annotation /> </Annotations>	AstAnnotationNode	This is a collection of annotation items that can be used to specify documentation, tags, or other information. Annotations are particularly useful for storing information about nodes that can be used by BimlScript code.
<Arguments>     <Argument /> </Arguments>	String	An array of command line parameters to be passed in.
<CommandEnvironments>     <CommandEnvironment /> </CommandEnvironments>	String	Array of flags and variables to be passed as the command environment. Ex: "CmdEnvVarName=CmdEnvVarValue"
<Definitions>     <Definition /> </Definitions>	AstAdfHDInsightDefinitionNode	Specifies Key/Value pairs for referencing within the script.
<Dependencies>     <Dependency /> </Dependencies>	AstAdfActivityDependencyNode	This is the collection of activity dependencies that will control the execution of this Azure Data Factory activity.
<PipelineParameters>     <Parameter /> </PipelineParameters>	AstAdfPipelineParameterNode	This is the collection of parameters that will be available to expressions in this Azure Data Factory activity. These parameters will be promoted automatically to the parent pipeline.
<UserProperties>     <UserProperty /> </UserProperties>	AstAdfActivityUserPropertyNode	This is the collection of user properties that the user can monitor in the Adf monitor window.