Adf Hd Insight Spark Activity Element

API Type:

Varigence.Languages.Biml.DataFactory.AstAdfHdInsightSparkActivityNode

X-Ref:

• Ast Adf Hd Insight Spark Activity Node
• Ast Adf Hd Insight Activity Base Node
• Ast Adf Execution Activity Base Node
• Ast Adf Activity Base Node
• Ast Scope Boundary Node

Attributes

Attribute	API Type	Default	Description
EntryFilePath	String		Relative path to the root that houses the Spark code. This is a required property
LinkedServiceName	AstAdfHdInsightBaseLinkedServiceNode		Specifies a reference to the linked service for Azure Spark activities. This is a required reference to an existing definiton.
Name	String		Specifies the name of the object. This name can be used to reference this object from anywhere else in the program. This is a required property
RootPath	String		This is the path that signifies which Azure blob container and folder the Spark file resides in. This is a required property
Class	String		Name of the primary class of the Application's Java or Spark code.
GetDebugInfo	AdfDebugInfoCopyCondition	None	Specifies the condition for this activity's log files to be copied to the Azure Storage account associated with the HDInsight cluster specified in the LinkedService property.
ProxyUser	String		The name of the user account to be impersonated in order to run the Spark program.
Retry	Int32	-1	Number of retry attempts.
RetryInterval	Int32	30	Specifies the time in seconds between retry attempts. Range between 30 and 86400 with 30 being the default.
SecureInput	Boolean	False	Specify whether the input from the activity is sensitive and should not be logged to monitoring.
SecureOutput	Boolean	False	Specify whether the input from the activity is sensitive and should not be logged to monitoring
SparkJobLinkedServiceName	AstAdfAzureStorageLinkedServiceBaseNode		Specifies a reference to the linked service that contains the Spark Job file, as well as the Spark Job's dependencies and logs. If unspecified, the Azure Storage account associated with the HDInsight cluster specified in the LinkedService property will be used. This references an existing definiton.
Timeout	String	"7"	Timeout for the activity to run. Defaults to 7 days.

Singleton Children

Child	API Type	Description
<Description />	String	String is the .NET Framework String class. More information can be found at http://msdn.microsoft.com/en-us/library/system.string.aspx.
<Scheduler />	AstAdfActivityScheduleNode	AstAdfActivityScheduleNode objects correspond directly to scheduler specifications for activities in Azure Data Factory.

Collection Children

Child	API Type	Description
<Annotations>     <Annotation /> </Annotations>	AstAnnotationNode	This is a collection of annotation items that can be used to specify documentation, tags, or other information. Annotations are particularly useful for storing information about nodes that can be used by BimlScript code.
<Arguments>     <Argument /> </Arguments>	String	An array of command line parameters to be passed in.
<Definitions>     <Definition /> </Definitions>	AstAdfHDInsightDefinitionNode	Specifies Key/Value pairs for referencing within the script.
<Dependencies>     <Dependency /> </Dependencies>	AstAdfActivityDependencyNode	This is the collection of activity dependencies that will control the execution of this Azure Data Factory activity.
<PipelineParameters>     <Parameter /> </PipelineParameters>	AstAdfPipelineParameterNode	This is the collection of parameters that will be available to expressions in this Azure Data Factory activity. These parameters will be promoted automatically to the parent pipeline.
<SparkConfigurations>     <SparkConfiguration /> </SparkConfigurations>	AstAdfHDInsightAdvancedPropertyNode	Spark configuation property values for the Spark program environment. Key/Value format.
<UserProperties>     <UserProperty /> </UserProperties>	AstAdfActivityUserPropertyNode	This is the collection of user properties that the user can monitor in the Adf monitor window.