Shared Jobs

Overview Note These shared jobs do not work with the Manage Change Data Capture feature in Matillion ETL. Change Data Capture (CDC) and processing data from your chosen sources, using a CDC agent to load data to your chosen cloud s...

Overview Process CDC data for all source tables, and then keep matching target tables in sync with the source tables. Properties Snowflake Properties Property Description Cloud Storage URL The URL of the loc...

Overview Process CDC data for a single source table, and then keep a target table in sync with the source table. Properties Snowflake Properties Property Description Data Source The CDC pipeline data source....

This shared job is specific to the following platform - Snowflake. Overview This shared job maintains two external tables, used by the Sync Single Table shared job. The first table, named '<External Table>' contains all the change ...

Overview This page captures what data types will be used when the CDC Sync Single Table shared job loads CDC data into Snowflake, Redshift, and Delta Lake on Databricks. Snowflake data types Primitive data types Avro schema...

Overview The ETL process creates some transient staging tables during a pipeline run that are deleted after a run, regardless of success. Tables are also created permanently to support the pipeline process, including the target table that cont...