Ast Adf Azure Databricks Linked Service Element
X-Ref:
- Ast Adf Azure Databricks Linked Service Node
- Ast Adf Linked Service Base Node
- Ast Adf Root Object Node
- Ast Scope Boundary Node
Attributes
Attribute | API Type | Default | Description |
---|---|---|---|
AccessToken | String | This is required in order to authenticate Azure Databricks access. They need to be generated from the databricks workspace. This is a required property | |
Domain | String | Databricks URL with the Azure Region specified appropriately. For example: https://westeurope.azuredatabricks.net This is a required property | |
Name | String | Specifies the name of the object. This name can be used to reference this object from anywhere else in the program. This is a required property | |
EncryptedCredential | String | Specifies the encrypted credential that will be used to authenticate the linked service. | |
ExistingClusterId | String | This is the Cluster ID of an an already created Interactive Cluster. In the event that the cluster stops responding, you may need to restart it. Databricks recommends using new clusters for increased reliability. | |
InstancePoolId | String | The id of an existing instance pool that will be used for all runs of this activity. | |
LogicalDisplayFolder | String | Specifies a path that should be used for organizing the tree display of this object in the Logical View in BimlStudio. | |
NewClusterDriverNodeType | String | New cluster's driver node. | |
NewClusterEnableElasticDisk | Boolean | False | Specify if the elastic disk is enabled on the new cluster. |
NewClusterNodeType | String | This property encodes the resources available to each of the Spark nodes present in the cluster. This is required for new clusters. | |
NewClusterNumOfWorker | String | The intended number of worker nodes for a cluster. Either specify a string formatted Int32 for a percise number, or specify two Int32s, sperated by a colon, in order to specify auto-scale range. For example "1:10", where 1 is the min and 10 is the max. | |
NewClusterVersion | String | This is the cluster's version of Spark. |
Singleton Children
Child | API Type | Description |
---|---|---|
<ConnectVia /> | AstAdfLinkedServiceConnectViaNode | Specifies the integration runtime that should be used to connect to the selected linked service. |
Collection Children
Child | API Type | Description |
---|---|---|
<AdfAnnotations> <AdfAnnotation /> </AdfAnnotations> | String | This is the collection of annotations that will be emitted in the json. |
<Annotations> <Annotation /> </Annotations> | AstAnnotationNode | This is a collection of annotation items that can be used to specify documentation, tags, or other information. Annotations are particularly useful for storing information about nodes that can be used by BimlScript code. |
<NewClusterCustomTags> <NewClusterCustomTag /> </NewClusterCustomTags> | AstAdfDatabricksBaseParameterNode | Custom tags for your Databricks linked service. |
<NewClusterInitScripts> <NewClusterInitScript /> </NewClusterInitScripts> | Int32 | Array of minutes past the hour that the trigger should run. |
<NewClusterSparkEnvVars> <NewClusterSparkEnvVar /> </NewClusterSparkEnvVars> | AstAdfDatabricksBaseParameterNode | Spark configuation property values for the Spark program environment. Key/Value format. |
<SparkConfigurations> <SparkConfiguration /> </SparkConfigurations> | AstAdfDatabricksBaseParameterNode | Spark configuation property values for the Spark program environment. Key/Value format. |