Configuring an ADF Linked Service Connection for Google Cloud Storage
For information on how to enable a connection for use with linked services, see Configuring a Linked Service Connection.
Field labels in this walkthrough follow the underlying Azure Data Factory property names, with the connection column that carries each value named alongside. The exact labels shown in the BimlFlex Connection Editor may differ.
After selecting Google Cloud Storage from the Linked Service Type dropdown, the form required for creating a Google Cloud Storage Linked Service will appear.
File Format Connections
Google Cloud Storage is selected as the Linked Service Type of a connection whose System Type is one of the file formats Delimited Format, Avro Format, Binary Format, JSON Format, ORC Format, Parquet Format, XML Format or Delta Lake.
The Google Cloud Storage option appears in the Linked Service Type dropdown when the connection's Connection Type is Amazon S3.
Choosing an Authentication Method
| Method | Credentials | Additional Settings |
|---|---|---|
| Access Key | Access Key ID and Secret Access Key | None |
Recommendation: Store the Secret Access Key in Azure Key Vault rather than entering it as plaintext.
Complete Example: Access Key with Azure Key Vault
| Field | Example Value |
|---|---|
| Connect via Integration Runtime | AutoResolveIntegrationRuntime |
| Access Key ID | <access-key-id> |
| Service URL | https://storage.googleapis.com |
| Azure Key Vault Linked Service | bfx-kv |
| Secret Name (for Secret Access Key) | BFX-LND-GoogleCloudStorageSecret |
Required Fields
Common Required Fields
A Google Cloud Storage Linked Service connection uses a single Authentication Type, so the same fields are required on every connection.
These common required fields are:
Connect via Integration Runtime
Connect via Integration Runtime names the integration runtime for a Google Cloud Storage Linked Service connection.
The default value is AutoResolveIntegrationRuntime.
To use another runtime, select it from the dropdown or choose + New to add one.
When a custom value is saved in the linked service form, it will be added to the custom integration runtimes.
The custom values that appear in this dropdown can be maintained in Settings under Azure - AzureIntegrationRuntime.
The runtime is stored in the connection's LS_ConnectVia_IntegrationRuntime column. Any value other than AutoResolveIntegrationRuntime is written to the linked service as the runtime it connects through.
Authentication Type
The Google Cloud Storage Linked Service connection signs in with an access key: the Access Key ID and the Secret Access Key.
Access Key ID
The Access Key ID identifies the access key the connector signs in with.
It is stored in the connection's LS_AccessKeyId column and maps to the ADF accessKeyId property.
Secret Access Key
The Secret Access Key field accepts the secret access key as plaintext in the LS_SecretAccessKey column, or an Azure Key Vault reference held in the LS_SecretAccessKeyKVS_ fields that resolves to the key at runtime.
It maps to the ADF secretAccessKey property.
It is suggested that Azure Key Vault be used in place of manually entering the Secret Access Key.
Service URL
The Service URL is the Google Cloud Storage endpoint. Set it to https://storage.googleapis.com.
It is stored in the connection's LS_ServiceUrl column and maps to the ADF serviceUrl property.
Azure Data Factory Linked Service Additional Information
For additional information on ADF Google Cloud Storage Linked Service and its connection requirements see the Azure Data Factory Google Cloud Storage Connector documentation.