Connect to your Google Cloud Storage buckets.

GoogleCloudStorageReader Properties

  • bucketName (Env First): The bucket name for Google Cloud Storage
  • credential (Env First): The Google credential with permissions to the Google service.
Example with Environment Credentials
-
    name: myConnectorName
    type: GoogleCloudStorageReader
    format: myDataFormatter
    properties:
    #schemaRef: schemaName # optional from "schemas:"
Example with Inline Credentials
-
    name: myConnectorName
    type: GoogleCloudStorageReader
    format: myDataFormatter
    properties:
      bucketName: myBucket 
      credential: jsonValue 
    #schemaRef: schemaName # optional from "schemas:"

GoogleCloudStorageWriter Properties

  • bucketName (Env First): The bucket name for Google Cloud Storage
  • credential (Env First): The Google credential with permissions to the Google service.
  • writeLevel (Inline Only): The writer level (row or table) for the data from a temp table. This enable individual files per record versus a single file.
Example with Environment Credentials
-
    name: myConnectorName
    type: GoogleCloudStorageWriter
    format: myDataFormatter
    properties:
      writeLevel:  dict.recordId  # optional 

Example with Inline Credentials
-
    name: myConnectorName
    type: GoogleCloudStorageWriter
    format: myDataFormatter
    properties:
      bucketName:  myBucket 
      credential:  jsonValue 
      writeLevel:  dict.recordId  # optional