-
DarkLight
Create Project (Snowflake)
-
DarkLight
Important Information
These instructions assume you have already successfully launched a Matillion ETL instance.
- If you need to create new Snowflake resources to connect to, please consult the Snowflake Configuration documentation.
- For help connecting to your instance, read:
- Accessing the Matillion ETL Client (AWS)
- Accessing the Matillion ETL Client (Azure)
- Accessing the Matillion ETL Client (Google Cloud Platform).
- For help adding credentials, read Manage Credentials.
Overview
A Matillion ETL project is a logical grouping of configuration settings and resources—such as jobs—required to use Matillion ETL. When users first log in to their Matillion ETL instance, they will be required to click Confirm in the Product Improvement Metrics dialog, and then they must create a project when no existing projects are available to select.
To create a new project, there are two routes:
- The first route is situated in the Join Project dialog, which will appear automatically upon first loading an instance.
- The second route can be accessed by clicking Project, then clicking Switch Project, and then (for both methods) clicking Create Project.
Access the Project menu.
Please Note
There are no practical limits to the number of projects you can create. However, only one project is used by the client session at a time, and each project must have a unique name.
Create a Snowflake project on AWS
The following section describes how to create a Project in Matillion ETL for Snowflake on AWS instances.
1. Project Details
- Project Group: Use the drop-down menu to specify an existing name for the project group. Projects are logically arranged in project groups.
- Project Name: Enter a suitable name for your new project.
- Project Description: Describe your project. This setting is optional.
- Include Samples: Untick this box if you do not want to include sample jobs in this project.
Project Details.
2. AWS Connection
- Environment Name: Enter a name for your new Matillion ETL environment.
- AWS Credentials: Use the drop-down menu to choose credentials for the AWS cloud platform. 'Instance Credentials' is selected by default. Click Manage to add a new set of credentials. See Manage Credentials for more information.
Please Note
Ensure your Instance Credentials are correctly configured for the required cloud platform. For example, the Azure Blob Storage Load component relies on credentials with access to Blob Storage.
AWS Connection.
3. Snowflake Connection
- Account: Enter your Snowflake account name and region (part of the URL you use to log into Snowflake). Do not include "snowflakecomputing.com".
- Uses the format <AccountName>.<region_id>
- Username: Enter your Snowflake account username. Make sure your Snowflake account has the above roles and privileges attached.
- Password Type: Use the drop-down menu to select your password type. Choose between Password and Private Key.
- Password: Enter your Snowflake account password.
- Private Key & Passphrase: If you selected Private Key in the Password Type drop-down menu earlier, Snowflake supports using key pair authentication, if you want to use this rather than a password authentication. For more information, read Snowflake Key Pair Authentication.
_3.1.png)
Snowflake Connection.
- Advanced Connection Settings: Optionally, you can add additional connection options to your Snowflake connection. Click Manage to open the JDBC Connection Attributes pop-up dialog. Use to add connection attributes, and enter Parameter and Value information in the fields provided. For more information, read Configuring the JDBC Driver
Adding connection attributes.
4. Snowflake Defaults
- Default Role: Use the drop-down menu to specify the default Snowflake Role this project assumes. This field can be left empty if no changes are needed to the user's role.
- Default Warehouse: Use the drop-down menu to specify, by default, the name of the Warehouse on your Snowflake account.
- Default Database: Use the drop-down menu to specify the name of the Database on your Snowflake account to use by default.
- Default Schema: Use the drop-down menu to specify the schema you would like to use. This is set as 'public' by default, but if you have configured multiple schemas within your database, specify your preferred schema.
- Concurrent Connections: Specify the number of configured, concurrent connections for existing jobs you want to use, that run in the Snowflake environment. For more information, read Multiple Environment Connections.
Please Note
To test the connection you must ensure all fields are populated with information in the Snowflake Connection and Snowflake Defaults dialogs. Click Test when you are ready.
Click Finish to create your project and environment.
Snowflake Defaults.
Create a Snowflake project on Azure
The following section describes how to create a Project in Matillion ETL for Snowflake on Azure instances.
1. Project Details
- Project Group: Use the drop-down menu to specify an existing name for the project group. Projects are logically arranged in project groups.
- Project Name: Enter a suitable name for your new project.
- Project Description: Describe your project. This setting is optional.
- Private Project: Check this box to make this new project private. Only users granted access can view and work in this project.
- Include Samples: Untick this box if you do not waht to include sample jobs in this project.
_5.1.png)
Project Details.
2. Cloud Connection
- Environment Name: Enter a name for your new Matillion ETL environment.
- Azure Credentials: Use the drop-down menu to choose credentials for the Azure cloud platform. 'Instance Credentials' is selected by default. Click Manage to add a new set of credentials. See Manage Credentials for more information.
Please Note
Ensure your Instance Credentials are correctly configured for the required cloud platform. For example, the Azure Blob Storage Load component relies on credentials with access to Blob Storage.
Cloud Connection.
3. Snowflake Connection
- Account: Enter your Snowflake account name and region (part of the URL you use to log in to Snowflake, minus the "snowflakecomputing.com").
- Uses the format <AccountName>.<region_id>
- Azure users must include the ".azure" part of the URL.
- Username: Enter your Snowflake account username that has the above described roles and privileges attached.
- Password Type: Use the drop-down menu to select which Password Type you want to use. Choose between Password and Private Key.
- Password: Enter your Snowflake account password, if you selected Password as your desired Password Type previously.
Please Note
If you select Private Key as the Password Type, you will be required to enter a Private Key and Passphrase, respectively.
Snowflake Connection.
- Advanced Connection Settings: Optionally, you can add additional connection options to your Snowflake connection. Click Manage to open the JDBC Connection Attributes pop-up dialog. Use to add connection attributes, and enter Parameter and Value information in the fields provided. For more information, read Configuring the JDBC Driver.
Adding connection attributes.
4. Snowflake Defaults
- Default Role: Use the drop-down menu to specify the default Snowflake Role this project assumes. This field can be left empty if no changes are needed to the user's role.
- Default Warehouse: Use the drop-down menu to specify, by default, the name of the warehouse on your Snowflake account.
- Default Database: Use the drop-down menu to specify the name of the database on your Snowflake account to use by default.
- Default Schema: Use the drop-down menu to specify the schema you would like to use. This is set as 'public' by default, but if you have configured multiple schemas within your Snowflake database, specify the schema you would like to use here.
- Concurrent Connections: Specify the number of configured, concurrent connections for existing jobs you want to use, that run in the Snowflake environment. For more information, read Multiple Environment Connections.
Please Note
To test the connection you must ensure all fields are populated with information in the Snowflake Connection and Snowflake Defaults dialogs. Click Test when you are ready.
Click Finish to create your project and environment.
Snowflake Defaults
Create a Snowflake project on GCP
1. Project Details
The following section explains how to create a Project in Matillion ETL for Snowflake on GCP instances.
- Project Group: Use the drop-down menu to specify an existing name for the project group. Projects are logically arranged in project groups.
- Project Name: Enter a suitable name for the new project.
- Project Description: Describe your project. This setting is optional.
- Private Project: Check this box to make this new project private. Only users granted access can view and work in this project.
- Include Samples: Untick this box if you do not want to include sample jobs in this project.
Project Details.
2. GCP Connection
- Environment Name: Enter a name for your new Matillion ETL environment.
- GCP Credentials: Use the drop-down menu to choose credentials for the GCP cloud platform. 'Instance Credentials' is selected by default. Click Manage to add a new set of credentials. See Manage Credentials for more information.
Please Note
Ensure your Instance Credentials are correctly configured for the required cloud platform. For example, the Azure Blob Storage Load component relies on credentials with access to Blob Storage.
GCP Connection.
3. Snowflake Connection
- Account: Enter your Snowflake account name and region (part of the URL used to log in to Snowflake, minus the "snowflakecomputing.com").
- Uses the format <AccountName>.<region_id>
- GCP users must include the ".gcp" part of the URL string.
- Username: Enter your Snowflake account username. Make sure your Snowflake account has the above roles and privileges attached.
- Password Type: Use the drop-down menu to select which Password Type you want to use. Choose between Password and Private Key.
Please Note
If you select Private Key as the Password Type, you will be required to enter a Private Key and Passphrase, respectively.
Snowflake Connection.
- Advanced Connection Settings: Optionally, you can add additional connection options to your Snowflake connection. Click Manage to open the JDBC Connection Attributes pop-up dialog. Use to add connection attributes, and enter Parameter and Value information in the fields provided. For more information, read Configuring the JDBC Driver
Adding connection attributes.
4. Snowflake Defaults
- Default Role: Use the drop-down menu to specify the default Snowflake Role this project assumes. This field can be left empty if no changes are needed to the user's role.
- Default Warehouse: Use the drop-down menu to specify, by default, the name of the warehouse on your Snowflake account.
- Default Database: Use the drop-down menu to specify the name of the database on your Snowflake account to use by default.
- Default Schema: Use the drop-down menu to specify the schema you would like to use. This is set as 'public' by default, but if you have configured multiple schemas within your Snowflake database, specify the schema you would like to use here.
- Concurrent Connections: Specify the number of configured, concurrent connections for existing jobs you want to use, that run in the Snowflake environment. For more information, read Multiple Environment Connections.
Please Note
To test the connection you must ensure all fields are populated with information in the Snowflake Connection and Snowflake Defaults dialogs. Click Test when you are ready.
Click Finish to create your project and environment.
Snowflake Defaults.
Useful Links
- When you first login to Matillion ETL, we recommend you replace your default username and password with your own secure login credentials. For more information about changing these credentials, read User Configuration in the Admin Menu.
- If you are new to Matillion ETL, we recommend reading the documentation target="blank">UI and Basic Functions.
- For more information about connecting to your instance, read:
- Accessing the Matillion ETL Client (AWS)
- Accessing the Matillion ETL Client (Azure)
- Accessing the Matillion ETL Client (Google Cloud Platform).
- For more information about adding credentials, read Manage Credentials.