Matillion ETL for Synapse Release Notes

Matillion ETL for Synapse Release Notes


We highly recommend reading the Updating Matillion ETL article for the safest way to update your instance.




Matillion ETL for Synapse v1.47.6

  • Fixed an issue where the Matillion ETL client would get stuck loading projects.
  • Fixed an issue with the Postgres driver: "The SSLSocketFactory class provided org.postgresql.ssl.DefaultJavaFactory could not be instantiated".
  • Fixed an issue where the JDBC properties file could not longer be edited in 1.47.



Matillion ETL for Synapse v1.47

Note: Due to some technical issues with this release, we do not recommend customers manually update to this version. We highly recommend users on 1.47 to update to 1.47.6 immediately.

New Features

  • New Detect Changes transformation component allows comparison of two similar tables to yield a new column that details whether rows have been inserted, deleted or changed.
  • New Pivot transformation component can pivot data from a selected column into multiple columns, partitioned by user-defined criteria.
  • New Generate Sequence transformation component allows users to create rows whose data are increments of a user-defined numerical sequence.
  • New Multi-table input transformation component reads data from multiple tables according to their names matching a user-defined pattern.
  • Azure Blob Load Generator helps generate compatible "Create Table" and "S3 Load" components by sampling delimited data files on Azure Blob Storage and guessing the layout.
  • OpenID Connect support for third party login providers:
    • You can now configure Matillion ETL to authenticate with any Open ID Connect provider.
    • Default support for Google, Microsoft and Okta plus a “Generic” option.

Improvements

  • Assert components now auto-populate their properties when connected to another component. For example: Connecting Assert Table to an S3 Load component will automatically configure it to use the same table as the S3 Load component.
  • Rewrite Table now allows Partitioning of data by a field.
  • The Environment Panel now has right-click context menu for related options


Matillion ETL for Synapse v1.46.8

  • Added support for Azure Blob Storage when running Azure Government Cloud
  • Fixed an issue in the Matillion ETL v1 API where the flag "onConflict=OVERWRITE" during job import was not working.
  • Fixed an issue where running a Transformation job more than once concurrently can cause it to interfere with itself.
  • Multiple bug fixes for "Assert" Components
    • Multi-line data types now supported
    • Fixed an issue where mismatched value types pass validation
    • No longer validates on size and precision fields where not relevant
    • Multiple fixes to error messages
    • Fixed an error when asserting values on a view containing a datetime column

Matillion ETL for Azure Synapse v1.46

New Components

  • New Zendesk Talk Query component allows users to bring their Zendesk Talk data into a table.
  • New Python Script component allows users to write custom Python scripts that are executed on the instance to perform a wide variety of tasks .
  • New “Assert” components can be used to test an existing object (Table, External Table, Scalar Variable or View) against user-defined criteria. This allows users to prevent jobs continuing if resources are not in their expected state.
  • New “Rank” Transformation component allows users to find the numerical rank of values in a column and output these ranks to a new column.
  • New “First/Last” Transformation component allows users to create groups of data and return only the first or last rows from that group.
  • New “Lead/Lag” Transformation component allows users to determine values of a new column based on data preceding or following that source row with a given offset.

New Features

  • New Recycle Bin feature gives users the opportunity to recover any deleted jobs before committing to delete them completely.

Improvements

  • Reworked Component panel organization gives an alphabetized list of all connector components.
  • Connectors that only import data into external tables have been renamed as “Extract” components.
  • New functions have been added to the Window Calculation component:
    • First/Last
    • Lead/Lag
    • Rank