Enterprise Mode Launching
This support page describes how to launch and connect to Matillion ETL from the AWS Marketplace using the Enterprise Contract link you should have received from your sales representative. If you have not received a link, please contact firstname.lastname@example.org. Launching an instance in this manner will take credits from your Matillion Account.
Step 1: Finding the Correct Product to Set UpTo launch and configure Matillion ETL, you should select it from the AWS Marketplace and start the launch/setup procedure. To do this, use the following steps:
Follow the link received to find the Matillion ETL listing for Enteprise Contracts on the AWS Marketplace.
From the Matillion ETL product page on the AWS Marketplace, click Continue to Subscribe.
From the Subscription page, click Continue to Configuration.
On the Configure this software page, select 64-bit (x86) Amazon Machine Image (AMI) as the Fulfillment Option.
It is highly recommended that users always select the most up-to-date product version available and in a region which they (or their current AWS services) reside in. Click Continue to Launch to continue the setup.
In spite of the name, clicking this will not yet launch your instance or charge your account.
On the Launch from software screen, simply select Launch through EC2 on the Choose Action dropdown and then click Launch.
Again note that this simply continues with the launch setup and will not yet launch the instance or charge your account.
Step 2: Choose an Instance Type
Choose one of the supported Instance Types. Each Instance Type is appropriately sized to support a given number of users and the software itself recognises the Instance Type it is running on and restricts maximum concurrent users on this basis.
The table below lists information for each instance size, including an explanantion of the different types and an their use cases:
|Type||Instance Type||vCPU Count||RAM (GB)||Max Users||Max Environments||Credits|
- Development: A team of people creating Matillion ETL workflows. This type is not suited for running ETL jobs and thus has no scheduler.
- Multi-Purpose: A balanced instance that can be used for developing workflows and running ETL jobs with trade-offs in performance in both areas.
- Production: A specialised instance for running ETL jobs that does not need many users working inside the client at once.
If you are unsure which instance type best suits your needs, contact your sales representative or email@example.com to ensure you get the correct product. The instance type can then be chosen as part of the AWS instance setup.
Do not click Review and Launch yet, as there are options you will want to configure on later screens.
Step 3: Configure Instance Details
This screen contains many options that can improve the functionality of your Matillion ETL Instance. We advise you configure this screen as follows:
- Number of instances: leave as default (unless you want multiple instances)
- Purchasing option: leave as default i.e. unchecked
- Network: Choose a VPC in the same Availability Zone (or closest geographical location) as your other AWS resources. It is recommended to have Matillion ETL running as close as possible to your target database.
- Subnet: Select (or create) a subnet for this instance to be created in (or "No preference" if available). For more information about subnets, please consult the AWS Subnet and VPCs documentation.
- Auto-assign public IP: This depends very much on the setup, by default a new VPC will not have VPN connections or NAT Gateways available, so in order for Matillion ETL to connect to the internet and for you to access Matillion this will normally need to be set to Enable.
- IAM Role: See the section below.
- Shutdown behaviour: Select Stop (default).
- Enable termination protection: We suggest setting to, ‘Enabled’.
- Monitoring: We suggest setting to, ‘Enabled’.
- Tenancy: Run a shared hardware instance.
Do not continue with the launch until a new IAM Role is created and selected for the instance. See the below section on completing this.
Setting up a new IAM Role
An IAM Role is used to allow your Instances to use the Amazon API"s securely without manual management of security keys. To use all the features of Matillion ETL, you should configure an IAM Role for your instance to use. This procedure assumes you do not already have an appropriate IAM role setup (if you do, simply select it).
Click Create new IAM role.
Click Create new role.
Click AWS Service, then select EC2 from the list of role types.
This should bring up additional options below. Select EC2 as the use case. Then, click Next: Permissions to continue.
From th Permissions page, policies will need to be added to the role. Please refer to Managing Credentials for more details on policies.
From the list select the following:
- AmazonRedshiftReadOnlyAccess (if planning to use Redshift)
Click Next: Review, then provide details for the following fields:
- Role name: provide a name for the new role
- Role description: provide a description of the new role (optional), then click Create role
The browser will return to the Step 3 screen of the launch process. Seletc the newly-created role from the IAM Role dropdown menu (may require a page refresh to display the new role). This should complete the Instance Details. Thereafter, click Next: Add Storage.
Step 4: Add Storage
You can choose the default root volume size here however for production implementations, it is recommend increasing this by a factor of 5. Then, click Next: Add Tags.
Step 5: Add Tags
Add any instance tags required, then click Next: Configure Security Group.
Step 6: Configure Security Groups
A security group should be created with the minimum set of ports. If required, name and adjust as to your security requirements.
The default recommended security group uses SSH (port 22) and HTTP(S) (port 80 and 443) access to the instance. The range of allowed IPs should be tailored to your needs. Then click Review and Launch.
You can make connectivity to Redshift easier if you use the same security group for Matillion ETL.
Step 7: Review Instance Launch
You are now ready to launch your Matillion ETL AMI. Click Launch at the bottom right of the window.
Once the AMI has initialised, which normally takes a few minutes, you can access Matillion ETL by entering the hostname or IP of the instance into a web browser.
Log in to the copy of Matillion ETL with ec2-user and the instance ID i-xxxxxxxx (e.g. i-88ed92c6).