Contents x
GCP Installation Overview
  • Dark
    Light
Contents

GCP Installation Overview

  • Dark
    Light

Overview

Setting up CDC agents is an involved process that requires access to the cloud platform and services as well as a degree of familiarity with that platform. The exact method of installation is up to the user. We highly recommend going through this process with your cloud platform administrator. Equally, we recommend using the method of installation you are most familiar with.

Note that Google Cloud resources may come with their own pricing independent of any billing you receive from Matillion.

Recommendations

  • Create new resources specifically for CDC use rather than attempt to use existing cloud resources.
  • Set up a resource group for your new resources for better organization and billing ease.
  • Consult your cloud/network administrator for advice on GCP permissions, roles, access and other considerations such as GCP regions.
  • Keep resources in the same Google Cloud region. Note that all resources and services may not be available in all regions; it is recommended you research your desired region in advance.

Installation process

The installation process is highly dependent on the chosen installation methods and environment.

Below is a checklist of resources required and full guides to setting up each can be found in the below links. A non-templated installation would require all of these steps be completed manually.

  1. Create a new agent in Data Loader
  2. Create the following resources in Google Cloud Services:
  3. Google Project and Service Account
  4. Google Service account with administrative permissions:
  • roles/container.admin
  • roles/iam.serviceAccountAdmin
  1. Google Cloud Storage bucket.
  2. Google Secret Manager.
  • Platform Key (Secret Manager), Secret value (Platform Key is generated on the first agent creation. All subsequent agents will use the same key).
  • Database password (Secret Manager) Secret name.
  1. IAM Policies/Permissions.
  2. Workload Identity enabled (GKE)

Templated installations

If using a template to aid installation, users should be cognizant of the resources that template is creating and take care to only manually set up the additional resources they require.

See the individual template articles below to understand which resources they include and require.

GCE templates

GKE (Kubernetes) templates

What's Next

Cookie consent

We use our own and third-party cookies to understand how you interact with our knowledge base. This helps us show you more relevant content based on your browsing and navigation history.