This page describes how to configure a Salesforce data source. With Matillion Data Loader, you can replicate and load your source data into your target destination.
Schema Drift Support: Yes. Read Schema Drift to learn more.
Return to any page of this wizard by clicking Previous.
Click X in the upper-right of the UI and then click Yes, discard to close the pipeline creation wizard.
- Please refer to the Whitelisted IP Addresses topic before you begin. You may not be able to connect to certain data sources without first whitelisting the Batch IP addresses. In these circumstances, connection tests will always fail and you will not be able to complete the pipeline.
- You need an active Salesforce production account or a Salesforce sandbox account.
- In Matillion Data Loader, click Add pipeline.
- Choose Salesforce from the grid of data sources.
- Choose Batch Loading.
Connect to Salesforce
Configure the Salesforce database connection settings, specifying the following:
|Salesforce OAuth||Select an OAuth entry from the dropdown menu or click Add OAuth if one doesn't exist.|
|OAuth label||Provide a descriptive name for the OAuth entry and then click Authorize. A new browser tab will open, where Salesforce will ask you to confirm authorization using valid credentials.|
|Advanced settings||Additional JDBC parameters or connection settings. Click Advanced settings and then choose a parameter from the dropdown menu and enter a value for the parameter. Click Add parameter for each extra parameter you want to add.|
Choose any tables you wish to include in the pipeline. Use the arrow buttons to move tables to the Tables to extract and load listbox and then reorder any tables with click-and-drag. Additionally, select multiple tables using the
The Sync deleted records setting will automatically remove records from the target table if they have been deleted from Salesforce within the last 30 days. This option is enabled by default.
Click Continue with X tables to move forward.
Review your data set
Choose the columns from each table to include in the pipeline. By default, Matillion Data Loader selects all columns from a table.
Click Configure on a table to open Select columns. Use the arrow buttons to move columns out of the Columns to extract and load listbox. Order columns with click-and-drag. Select multiple columns using
Click Done to continue.
Click Continue once you have configured each table.
- Choose an existing destination or click Add a new destination.
- Select a destination from Snowflake, Amazon Redshift, or Google BigQuery.
|Pipeline name||A descriptive label for your pipeline. This is how the pipeline appears on the pipeline dashboard and how Matillion Data Loader refers to the pipeline.|
|Sync every||The frequency at which the pipeline should sync. Day values include 1—7. Hour values include 1—23. Minute values include 5—59. The input is also the length of delay before the first sync.|
Currently, you can't specify a start time.
Once you are happy with your pipeline configuration, click Create pipeline to complete the process and add the pipeline to your dashboard.
Block list tables
The following tables can't be extracted using Matillion Data Loader Batch due to source restrictions (such as requiring a filter):