Adf Hd Insight on Demand Linked Service Element
X-Ref:
- Ast Adf Hd Insight On Demand Linked Service Node
- Ast Adf Hd Insight Base Linked Service Node
- Ast Adf Linked Service Base Node
- Ast Adf Root Object Node
- Ast Scope Boundary Node
Attributes
| Attribute | API Type | Default | Description |
|---|---|---|---|
| ClusterResourceGroup | String | This is the resource group where the HDInsight cluster is created. This is a required property | |
| ClusterSize | Int32 | 0 | The number of a cluster's worker or data nodes. This is a required property |
| HostSubscriptionId | String | This is azure suibscription credential used to create the HDInsight cluster. This is a required property | |
| LinkedServiceName | AstAdfAzureStorageLinkedServiceBaseNode | Specifies a reference to the linked service that refers to the blob storage that is used by the HDInsight cluster. As of now, Data Lake Store linked services are not supported This is a required reference to an existing definiton. | |
| Name | String | Specifies the name of the object. This name can be used to reference this object from anywhere else in the program. This is a required property | |
| Tenant | String | Domain or tenant ID that houses the application. This is a required property | |
| TimeToLive | String | This is the amount of idle time permitted for the on-demand HDInsight cluster. This delineates the length of time that the cluster stays alive after the completion of an activity run, with no other active jobs remaining. This is a required property | |
| Version | String | This is the version of the HDInsight cluster in use. Default matches the current defined default version. This is a required property | |
| ClusterNamePrefix | String | The prefix of the HDInsight cluster name. | |
| ClusterPassword | String | Cluster's password credential. | |
| ClusterSshPassword | String | Password credential to SSH remotely into cluster node. | |
| ClusterSshUserName | String | Username to SSH remotely into a cluster node. | |
| ClusterType | AdfHDInsightClusterType | Hadoop | Specifies the type of cluster (either Hadoop or Spark) to be created. Default value is Hadoop. |
| ClusterUserName | String | Cluster's username credential. | |
| DataNodeSize | Int32 | 0 | Size of the data node of the HDInsight cluster. |
| EncryptedCredential | String | Specifies the encrypted credential that will be used to authenticate the linked service. | |
| HCatalogLinkedServiceName | AstAdfAzureSqlDatabaseLinkedServiceNode | Azure Sql linked service that refernces the HCatalog database. This references an existing definiton. | |
| HeadNodeSize | Int32 | 0 | Node size of the head of the HDInsight cluster. |
| LogicalDisplayFolder | String | Specifies a path that should be used for organizing the tree display of this object in the Logical View in BimlStudio. | |
| OsType | AdfHDInsightOsType | Linux | Specifies which operating system is being used. Default is Linux. Windows is only available for HDInsight version 3.3. |
| ServicePrincipalId | String | Client ID credential for application. | |
| ServicePrincipalKey | String | Application's key. | |
| SparkVersion | String | If the selected cluster type is "Spark" then this is the specific version of spark that is used. | |
| Subnet | String | The resource ID of the subnet within the virtual network. This is required if the VirtualNetwork is specified. | |
| VirtualNetworkId | String | The resource ID for the virutal network to which the created cluster will join. | |
| ZookeeperNodeSize | Int32 | 0 | Size of the Zoo Keeper node of the HDInsight cluster. |
Singleton Children
| Child | API Type | Description |
|---|---|---|
| <ConnectVia /> | AstAdfLinkedServiceConnectViaNode | Specifies the integration runtime that should be used to connect to the selected linked service. |
Collection Children
| Child | API Type | Description |
|---|---|---|
| <AdditionalLinkedServices> <LinkedService /> </AdditionalLinkedServices> | AstAdfLinkedServiceReferenceNode | Specifies any supplemental Linked Services so that the Data Factory service can register them. It is necessary that these storage linked services are in the same region as the HDInsight cluster, which must also be in the same region as the storage account specified in LinkedServiceName |
| <AdfAnnotations> <AdfAnnotation /> </AdfAnnotations> | String | This is the collection of annotations that will be emitted in the json. |
| <Annotations> <Annotation /> </Annotations> | AstAnnotationNode | This is a collection of annotation items that can be used to specify documentation, tags, or other information. Annotations are particularly useful for storing information about nodes that can be used by BimlScript code. |
| <CoreConfigurations> <CoreConfiguration /> </CoreConfigurations> | AstAdfHDInsightAdvancedPropertyNode | Core configuration parameters (as in core-site.xml). |
| <HBaseConfigurations> <HBaseConfiguration /> </HBaseConfigurations> | AstAdfHDInsightAdvancedPropertyNode | HBase configuration parameters (hbase-site.xml). |
| <HdfsConfigurations> <HdfsConfiguration /> </HdfsConfigurations> | AstAdfHDInsightAdvancedPropertyNode | HDFS configuration parameters (hdfs-site.xml). |
| <HiveConfigurations> <HiveConfiguration /> </HiveConfigurations> | AstAdfHDInsightAdvancedPropertyNode | Hive configuration parameters (hive-site.xml). |
| <MapReduceConfigurations> <MapReduceConfiguration /> </MapReduceConfigurations> | AstAdfHDInsightAdvancedPropertyNode | MapReduce configuration parameters (mapred-site.xml). |
| <OozieConfigurations> <OozieConfiguration /> </OozieConfigurations> | AstAdfHDInsightAdvancedPropertyNode | Oozie configuration parameters (oozie-site.xml). |
| <ScriptActions> <ScriptAction /> </ScriptActions> | AstAdfHdInsightScriptActionNode | Custom script action for the HDInsight cluster to run once available. |
| <StormConfigurations> <StormConfiguration /> </StormConfigurations> | AstAdfHDInsightAdvancedPropertyNode | Storm configuration parameters (storm-site.xml). |
| <YarnConfigurations> <YarnConfiguration /> </YarnConfigurations> | AstAdfHDInsightAdvancedPropertyNode | Yarn configuration parameters (yarn-site.xml). |