.png){kind=logo}
PubSub
-
DarkLight
PubSub
-
DarkLight
This article is specific to the following platforms - BigQuery - Delta Lake.
Cloud Pub/Sub
The Cloud Pub/Sub component allows messages to be published to a topic on Google Cloud Platform (GCP). Other applications can subscribe to these topics to receive such messages. The end result is fast, reliable, and secure communication between GCP services applications.
To publish messages from Matillion ETL, you must first ensure that topics are available to publish to (and ideally, that relevant applications are subscribed to these topics). To view, edit, and create topics, visit the Topics GCP page while logged into your GCP account and project.
Official help for getting starting with Cloud Pub/Sub can be found here.
Properties
| Property | Setting | Description |
|---|---|---|
| Name | String | A human-readable name for the component. |
| Project | Select | Select the name of the GCP project to use. The chosen project must be affiliated with the GCP account connected to Matillion ETL. |
| Topic | Select | The name of the topic to publish to. Matillion ETL will automatically gather topics available to your project. To view and create topics, navigate to Pub/Sub→Topics from the main upper-left menu on the GCP dashboard or follow this link. |
| Message | String | Input the contents of the message. |
| Attributes | Key-value Pairs | Assign key-value pairs to be included with the message to be used by the subscribed application. These may commonly be data regarding the message itself. |