2022 - May 10th
  • Dark

2022 - May 10th

  • Dark

New features and improvements

Billing Integration

Matillion Data Loader adds several new capabilities:

  • Billing integration has been added for Batch and CDC data processing. Users will be charged through the Matillion Hub based on their usage. For more information, visit our pricing page.

Unified CDC & Batch Pipelines

  • Users can now create and manage Change Data Capture (CDC) pipelines in the same user interface as Batch pipelines.

CDC Pipelines

  • CDC is available for Oracle, PostgreSQL, and MS SQL sources. CDC data is stored in Amazon S3 or Azure Blob Storage.
  • Matillion ETL Shared Jobs are available to ingest CDC data from Amazon S3 or Azure Blob Storage, transform the data, and load the data into Snowflake, Amazon Redshift, or Delta Lake on Databricks as final destinations. These configurable jobs can be scheduled to run in sync with your CDC agent process once you have set up your CDC pipelines.
  • CDC pipelines can handle schema drift as change events in your source.

CDC Agent

CDC Agent version v2.15.28 support:

  • We now support CDC Agent version v2.15.28. The agent upgrade can be done via rotating, restarting or updating your containers. For more information, please visit our agent update page.

Batch Pipelines

What's Next