.png){kind=logo}
Twitter Tweets
-
DarkLight
Twitter Tweets
-
DarkLight
Overview
This page describes how to configure a Twitter Tweets data source. With Matillion Data Loader, you can replicate and load your source data into your target destination.
Schema Drift Support: Yes. Read Schema Drift to learn more.
Return to any page of this wizard by clicking Previous.
Click X in the upper-right of the UI and then click Yes, discard to close the pipeline creation wizard.
Prerequisites
Note
This connector queries system tables to find metadata for your data sources, and might result in more API calls than expected. It's advised to keep the frequency of these jobs as low as possible. Contact your Twitter administrator to gauge your API usage.
Create pipeline
- In Matillion Data Loader, click Add pipeline.
- Choose Twitter Tweets from the grid of data sources.
- Choose Batch Loading.
Connect to Twitter Tweets
Configure the Twitter Tweets connection settings, specifying the following:
| Property | Description |
|---|---|
| Twitter OAuth | Select an OAuth entry from the dropdown menu or click Add OAuth if one doesn't exist. Give the OAuth entry a descriptive label. |
| Advanced settings | Additional JDBC parameters or connection settings. Click Advanced settings and then choose a parameter from the dropdown menu and enter a value for the parameter. Click Add parameter for each extra parameter you want to add. |
Click Test and Continue to test your settings and move forward. You can't continue if the test fails for any reason.
Filter out search results
| Property | Description |
|---|---|
| Search terms | Search terms to match against tweets. The maximum number of terms is 10. Read Search Tweets: Standard v1.1 to learn more about searching tweets. |
Choose properties
Choose the properties to include in the pipeline. By default, Matillion Data Loader selects all properties.
Use the arrow buttons to move properties out of the Properties to extract and load listbox. Order properties with click-and-drag. Select multiple properties using SHIFT.
Click Continue with X properties to continue.
Choose destination
- Choose an existing destination or click Add a new destination.
- Select a destination from Snowflake, Amazon Redshift, or Google BigQuery.
Set frequency
| Property | Description |
|---|---|
| Pipeline name | A descriptive label for your pipeline. This is how the pipeline appears on the pipeline dashboard and how Matillion Data Loader refers to the pipeline. |
| Sync every | The frequency at which the pipeline should sync. Day values include 1—7. Hour values include 1—23. Minute values include 5—59. The input is also the length of delay before the first sync. |
Currently, you can't specify a start time.
Once you are happy with your pipeline configuration, click Create pipeline to complete the process and add the pipeline to your dashboard.