Launching Matillion ETL from AWS Marketplace - Existing Customers
This article is specifically for customers who have an existing Matillion ETL installation launched via the AWS Marketplace and wish to launch another of the same kind. If you have not subscribed to Matillion ETL on AWS in the past, the listings given here will not be accessible.
New customers are advised to launch Matillion ETL through the Matillion Hub.
To begin launching Matillion ETL, you must browse to the AWS Marketplace listing for the product of your choice as below:
The above listings will not work if you have not previously subscribed to Matillion ETL on AWS. New customers should launch Matillion ETL via the Matillion Hub
In the below guides, we use Matillion ETL for Snowflake as the working example, but the method is identical for launching Matillion ETL for Redshift.
Launching Matillion ETL from the AWS Marketplace
Note it is also possible for existing customers to locate the Matillion ETL listing via the EC2 Console. Once on the EC2 Console, navigate to "AMIs" then set the filter to "Private"
To launch and configure Matillion ETL, you should select it from the AWS Marketplace and start the launch/setup procedure. To do this, use the following steps:
1. Locate your Matillion ETL product on the AWS Marketplace.
2. From the Matillion ETL product page on the AWS Marketplace, press the Continue to Subscribe button on the top right of the Subscribe to this software page.
If you're not already logged in to the AWS Marketplace, you will be prompted for your AWS account credentials.
Depending on your current setup, you may also need to click Continue to Configuration on the new page.
3. On the Configure this software page, select Amazon Machine Image with a 64-bit Amazon Machine Image (AMI) as your Fulfillment Option and then, click Continue to Launch.
Where possible, select the most up-to-date product version available.
Launching Matillion ETL at this stage will not launch your instance and will not charge your account.
Launch this software
4. You will be redirected to the Launch this software page. To launch the software from the website, simply select Launch through EC2 using the dropdown. Then click Launch.
Choosing the Instance Type
5. The browser will redirect you to the Choose an instance type page. Choose one of the supported Instance Types and click Next: Configure Instance Details.
Each instance type is appropriately sized to support a given number of users. Your Matillion ETL instance will automatically scale its capabilities according to your chosen instance size.
The instance type you select affects the number of users that can use Matillion ETL concurrently. For more information, read Changing EC2 Instance Size.
- t3.medium: For teams of 1-2 data professionals using Matillion ETL concurrently.
- m5.large: For teams of 3-5 data professionals using Matillion ETL concurrently.
- r5 type instance: For the production instances that run jobs but need few users.
You can read more about instance types and pricing here.
Configure Instance Details
6. This is a manual setup instead of a 1-click setup. There are some settings you can specify on this screen that are unavailable through 1-click that improve the functionality of your Matillion Instance. Please follow the configurations as shown below:
- Number of instances: leave as default (unless you want multiple instances).
- Purchasing options: leave as default i.e. unchecked.
- Network: Choose a VPC. The zone in which this VPC is located should ideally be the same as your Snowflake account (European Snowflake accounts should be paired with an EU-based AWS region, for example).
- Subnet: Choose a subnet. Each subnet resides in one availability zone.
- Auto-assign public IP: This depends very much on the setup. By default, a new VPC will not have VPN connections or NAT Gateways available, so for Matillion ETL to connect to the internet and for you to access Matillion ETL, this will normally need to be set to Enable.
- IAM Role: IAM Roles are used to allow your instances to use the Amazon APIs securely without manual management of security keys. To use all the features of Matillion ETL, you should configure an IAM Role for your instance to use. This procedure assumes you do not already have an appropriate IAM role setup (if you do, select it). For detailed information on creating IAM roles, you can visit the Additional Information section of this guide.
- Choose below settings for Shutdown behavior: Enable termination protection, Monitoring, and Tenancy.
- Shutdown behavior: leave as default i.e. Stop.
- Enable termination protection: we suggest setting it to, Enabled.
- Monitoring: we suggest setting it to, Enabled.
- Tenancy: run a shared hardware instance.
7. Once you have completed all the details, click Next - Add Storage.
8. On the Add Storage page, you can choose the default root volume size and click Next - Tag Instance.
You can attach additional EBS volumes and instance store volumes to your instance, or edit the settings of the root volume. You can also attach additional EBS volumes after launching an instance, but not instance store volumes. We recommend increasing volume by the factor of 5.
9. Next, at the Add Tags page, add any instance tags you require. For example, you could define a tag with key = Name and value = Webserver. A copy of a tag can be applied to volumes, instances, or both. Then, click Next - Configure Security Group.
10. On the Configure Security Group page, a default security group will be created with the minimum set of ports. If required, name and adjust as to your security requirements. Next, click Review and Launch.
The default recommended security group uses SSH (port 22) and HTTP(S) (port 80 and 443) access to the instance. The range of allowed IPs should be tailored to your needs.
11. Finally, you need to review all the settings and configuration details for Matillion ETL via the Review and Launch page and then click Launch.
Once the AMI has initialized, which normally takes a few minutes, you can access Matillion ETL by entering the hostname of the instance into a web browser.
Log in to your copy of Matillion ETL with ec2-user as the username and the instance ID i-xxxxxxxx (e.g. i-88ed92c6) as the password. We recommend changing your password as soon as possible. Read Change My Password to learn how.
This section will guide you through creating a new IAM role while configuring instance details in the AWS Console.
1. Once you are on the Configure Instance Details page, click Create New IAM Role to create a new IAM Role.
2. The browser will redirect you to the AWS Console → Identity and Access Management (IAM) → Roles. Click Create Role.
3. Select the type of trusted entity on the next page (Preferred is: AWS Service), and choose a common use case from the available list (Preferred is: EC2). Once done, click Next: Permission.
4. Next, you need to attach a Permission Policy. You can choose from the existing policy or you can create a new policy if needed. Then, click Next: Tags. From the list, select:
For more information on the policies see Managing Credentials.
6. Add IAM Tags. IAM tags are key-value pairs you can add to your role. Tags can include user information—such as an email address—or can be descriptive, such as a job title. Click Next: Review.
7. On the Review page, provide the required information and review this role before you create it, and then click Create Role.
8. Finally, the IAM role has been created and you will find the newly created role in the list.
- Learn how to Access your Matillion ETL instance.
- Learn how to Configure Snowflake.
- Learn how to Configure Redshift.
We also recommend the following pages: