Create Project (Redshift)
These instructions assume you have already successfully launched a Matillion ETL instance.
A Matillion ETL project is a logical grouping of configuration settings and resources—such as jobs—required to use Matillion ETL. When users first log in to their Matillion ETL instance, they will be required to click Confirm in the Product Improvement Metrics dialog, and then they must create a project when no existing projects are available to select.
To create a new project, there are two routes:
- The first route is situated in the Join Project dialog, which will appear automatically upon first loading an instance.
- The second route can be accessed by clicking Project, then clicking Switch Project, and then (for both methods) clicking Create Project.
There are no practical limits to the number of projects you can create. However, only one project is used by the client session at a time, and each project must have a unique name.
Creating a Redshift project on AWS
The following section describes how to create a Project in Matillion ETL for Redshift on AWS instances.
1. Project Details
- Project Group: Use the drop-down menu to specify an existing name for the project group. Projects are logically arranged in project groups.
- Project Name: Enter a suitable name for your new project.
- Project Description: Describe your project. This setting is optional.
- Private Project: Check this box to make this new project private. Only users granted access can view and work in this project.
- Include Samples: Untick this box if you do not want to include sample jobs in this project.
2. AWS Connection
- Environment Name: Enter a name for your new Matillion ETL environment.
- AWS Credentials: Use the drop-down menu to choose credentials for the AWS cloud platform. 'Instance Credentials' is selected by default. Click Manage to add a new set of credentials. Read Manage Credentials for more information.
Ensure your Instance Credentials are correctly configured for the required cloud platform. For example, the Azure Blob Storage Load component relies on credentials with access to Blob Storage.
3. Redshift Connection
- Redshift Cluster: Use the drop-down menu to select either Custom or an existing Redshift cluster. If you select Custom, you will be required to enter information manually into all of the fields situated on this page of the wizard, all of which are described below. However, if you have created an IAM Role, this drop-down menu will list your role-specific Redshift clusters in the same region as your Matilion ETL instance, and the Endpoint, Port, and Username fields will be automatically populated with your Redshift cluster settings.
- Endpoint: Enter a connection endpoint. This will be the database name or I.P. address.
- Port: Enter the database port number, this is typically 5439 or 5432. This setting is optional.
- Username: Enter your username for the environment connection.
- Password: Enter your password for the environment connection.
- Enable SSL: Unticked by default, tick this checkbox if you want to encrypt communications between Matillion and AWS Redshift. Some Redshift clusters may be configured to require this.
- Advanced Connection Settings: Optionally, you can add additional connection options to your Redshift connection. Click Manage to open the JDBC Connection Attributes pop-up dialog. Use to add connection attributes, and enter Parameter and Value information in the fields provided. For more information, read Configuring connections in Amazon Redshift.
4. Redshift Defaults
- Database: This will be automatically populated if you have selected your Redshift cluster details in the Redshift Cluster drop-down menu earlier. Alternatively, enter the database name manually.
- Default Schema: This is set to 'public' by default, but if you have configured multiple schemas within your Redshift database, enter the schema you want to use.
- Default Bucket: Use the drop-down menu to select an S3 bucket where project data will be staged.
- Concurrent Connections: Specify the number of configured, concurrent connections for existing jobs you want to use, that run in the Redshift environment. For more information, read Multiple Environment Connections.
To test the connection you must ensure all fields are populated with information in the Redshift Connection, Redshift Defaults and the JDBC Connection Attributes dialogs. Click Test when you are ready.
Click Finish to create your project and environment.
When you first login to Matillion ETL, we recommend you replace your default username and password with your own secure login credentials. For more information about changing these credentials, read User Configuration in the Admin Menu.