Matillion Data Loader integrates with a dozens of databases and applications so you can replicate data from these to your preferred destination system.
Matillion Data Loader offers two methods to load data:
- Batch Data Replication
- Change Data Capture (CDC)
A Batch pipeline extracts data from a data source and loads it into a target destination according to a schedule. Matillion Data Loader will collect metrics based on these scheduled runs so users can easily monitor how their Pipelines are performing. All data sources are available to Batch pipelines, though some additional security measures, such as login credentials and OAuth validation, may be required. The full instructions to create a Batch pipeline are detailed in each pipeline source topic.
A CDC pipeline uses the Matillion CDC Agent to extract data as it changes in real time and load it into a destination. CDC has access to fewer data sources and destinations compared to Batch, and will require additional configuration of the data source and destination you wish to use. After you have installed the agent in your local architecture, you are able to connect Matillion Data Loader to the data source. Refer to CDC Sources Overview for more information.