Enterprise Mode Launching - AWS SF

Enterprise Mode Launching - AWS SF


Overview

This support page describes how to launch and connect to Matillion ETL from the AWS Marketplace using the Enterprise Contract link you should have received from your sales representative. If you have not received a link, please contact sales@matillion.com.

Launching an instance in this manner will take credits from your Matillion Account



Step 1: Finding the correct product to set up.

To launch and configure Matillion ETL, you should select it from the AWS Marketplace and start the launch/setup procedure. To do this, use the following steps:
  • Follow the link you received to find the Matillion ETL listing for Enteprise Contracts on the AWS Marketplace.
  • From the Matillion ETL product page on the AWS Marketplace, press the Continue to Subscribe button.
  • From the Subscription page press the Continue to Configuration button.



Choosing Version and Location

On the Configure this software page, select Amazon Machine Image with a 64-bit Amazon Machine Image (AMI) as your Fulfillment Option.

It is highly recommended that users always select the most up-to-date product version available and in a region which they (or their current AWS services) reside in.

Click Continue to Launch to continue the setup. Note that in spite of the name, clicking this will not yet launch your instance or charge your account.



Launch this software

On the Launch from software screen, simply select Launch through EC2 on the Choose Action dropdown and then click Launch.

Again note that this simply continues with the launch setup and will not yet launch the instance or charge your account.



Step 2: Choose an Instance Type

Choose one of the supported Instance Types. Each Instance Type is appropriately sized to support a given number of users and the software itself recognises the Instance Type it is running on and restricts maximum concurrent users on this basis.

The table below lists information for each instance size. The different types and their use-cases are explained briefly underneath.

Type Instance Type vCPU Count RAM (GB) Max Users Max Environments Credits
Development
(No Scheduler)
t3.xlarge 4 16 10 30 6
Multi-Purpose m5.large 2 8 5 15 4
m5.xlarge 4 16 12 50 8
m5.2xlarge 8 32 25 200 16
Production r5.large 2 16 2 15 4
r5.xlarge 4 32 2 50 8
r5.2xlarge 8 64 2 200 16
  • Development: A team of people creating Matillion ETL workflows. This type is not suited for running ETL jobs and thus has no scheduler.
  • Multi-Purpose: A balanced instance that can be used for developing workflows and running ETL jobs with trade-offs in performance in both areas.
  • Production: A specialised instance for running ETL jobs that does not need many users working inside the client at once.
If you are unsure which instance type best suits your needs, contact your sales representative or sales@matillion.com to ensure you get the correct product. The instance type can then be chosen as part of the AWS instance setup.

Important: DO NOT click the blue “Review and Launch” button yet, as there are options you will want to configure on later screens.



Step 3: Configure Instance Details

This screen contains many options that can improve the functionality of your Matillion ETL Instance. We advise you configure this screen as follows:

  • Number of instances: leave as default (unless you want multiple instances)
  • Purchasing option: leave as default i.e. unchecked
  • Network: Choose a VPC in the same Availability Zone (or closest geographical location) as your other AWS resources. It is recommended to have Matillion ETL running as close as possible to your target database.
  • Subnet: Select (or create) a subnet for this instance to be created in (or 'No preference' if available). For more information about subnets, please consult the AWS Subnet and VPCs documentation
  • Auto-assign public IP:  This depends very much on the setup, by default a new VPC will not have VPN connections or NAT Gateways available, so in order for Matillion ETL to connect to the internet and for you to access Matillion this will normally need to be set to Enable.
  • IAM Role: See the section below.
  • Shutdown behaviour: Select Stop (default).
  • Enable termination protection: We suggest setting to, ‘Enabled’.
  • Monitoring: We suggest setting to, ‘Enabled’.
  • Tenancy: Run a shared hardware instance.

Warning: Do not continue with the launch until a new IAM Role is created and selected for the instance. See the below section on completing this.



Setting up a new IAM Role.


An IAM Role is used to allow your Instances to use the Amazon API's securely without manual management of security keys. To use all the features of Matillion ETL, you should configure an IAM Role for your instance to use. This procedure assumes you do not already have an appropriate IAM role setup (if you do, simply select it).

  • Click Create New IAM Role
  • Click the blue Create New Role button
  • Choose AWS Service and then EC2 as the role type.
  • This should bring up additional options below. Select EC2 as the Use Case.
  • Click Next: Permissions to continue. From this new page we will need to add policies to the role. For more information on the policies see Managing Credentials.
  • From the list select
    • AmazonRedshiftReadOnlyAccess    (if planning to use Redshift)
    • AmazonSNSFullAccess
    • AmazonSQSFullAccess
    • CloudwatchFullAccess
    • AmazonRDSReadOnlyAccess
    • AmazonS3FullAccess
  • Click Next: Review
  • Give your new role a name and, optionally, a description.
  • Finally click the Create Role to complete.
Back on the Step 3 screen of the launch process  (Configure Instance Details), select your newly-made role from the IAM Role dropdown menu (may require a page refresh to display your new role). This should complete your Instance Details. Click Next: Add Storage.



Step 4: Add Storage

  • You can choose the default root volume size here however for production implementations we would recommend increasing this by a factor of 5.
  • Click Next: Add Tags.



Step 5 Add Tags

  • Add any instance tags your require.
  • Click Next: Configure Security Group.



Step 6: Configure Security Groups

  • A security group should be created with the minimum set of ports. If required, name and adjust as to your security requirements.
  • The default recommended security group uses SSH (port 22) and HTTP(S) (port 80 and 443) access to the instance. The range of allowed IPs should be tailored to your needs.
  • Click Review and Launch.



Step 7: Review Instance Launch

You are now ready to launch your Matillion ETL AMI. Hit the blue Launch button at the bottom-right.

Once the AMI has initialised, which normally takes a few minutes, you can access Matillion ETL by entering the hostname or IP of the instance into a web browser.  

Log in to your copy of Matillion ETL with ec2-user and the instance ID i-xxxxxxxx (e.g. i-88ed92c6)



Next Steps

We highly recommend new admins familiarising themselves some core concepts:

See here for more help in accessing your Matillion ETL Client

If you are having issues read the common Troubleshooting guide or otherwise do not hesitate to Raise a Support Ticket.