Table Metadata To Grid
-
DarkLight
Table Metadata To Grid
-
DarkLight

Table Metadata To Grid
This component will take the metadata from a table and use this data to populate a grid variable with data.
Properties
Snowflake Properties | ||
---|---|---|
Property | Setting | Description |
Name | String | A human-readable name for the component. |
Database | Select | Select the database in which to find the table to take metadata from. A database is a logical grouping of schemas. Each database belongs to a single Snowflake account. |
Schema | Select | Select the schema in which to find the table to take metadata from. A schema is a logical grouping of database "objects" (tables, views, etc.). Each schema belongs to a single database. The special value, [Environment Default], will use the schema defined in the environment. For more information on using multiple schemas, see this article. |
Target Table | Select | Select the table from which metadata will be taken. |
Grid Variable | Select | Select the grid variable to be loaded with data. To learn more about grid variables, read our Grid Variables documentation. |
Grid Variable Mapping | Multiple Selection | Map each column in the grid to a particular "type" of metadata by selecting from the available dropdown menus. Columns include: Name: Column name. Type: Column data type (as used in Matillion ETL). Database Type: Column type (as reported by the database). Size: Allowable size (in characters) of the data in the column. Precision: The precision of the data in the column. Will be 0 (zero) for non-applicable types. Default Value: The default value in this column. Not Null: Whether or not the column allows null values (Yes/No). Unique: Whether or not the column is a unique key (Yes/No). |
Redshift Properties | ||
---|---|---|
Property | Setting | Description |
Name | String | A human-readable name for the component. |
Schema | Select | Select the table schema. The special value, [Environment Default], will use the schema defined in the environment. For more information on using multiple schemas, see this article. |
Table Name | Select | Select the table from which metadata will be taken. |
Grid Variable | Select | Select the grid variable to be loaded with data. To learn more about grid variables, read our Grid Variables documentation. |
Grid Variable Mapping | Multiple Selection | Map each column in the grid to a particular "type" of metadata by selecting from the available dropdown menus. Columns include: Name: Column name. Type: Column data type (as used in Matillion ETL). Database Type: Column type (as reported by the database). Size: Allowable size (in characters) of the data in the column. Precision: The precision of the data in the column. Will be 0 (zero) for non-applicable types. Encoding: The name of the encoding type used on this column. |
Schema | Select | Select the schema in which to find the table to take metadata from. A schema is a logical grouping of database "objects" (tables, views, etc.). Each schema belongs to a single database. The special value, [Environment Default], will use the schema defined in the environment. For more information on using multiple schemas, see this article. |
BigQuery Properties | ||
---|---|---|
Property | Setting | Description |
Name | String | A human-readable name for the component. |
Project | Select | Select the Google Bigquery project. The special value, [Environment Default], will use the project defined in the environment. For more information, refer to the BigQuery documentation. |
Dataset | Select | Select the Google Bigquery dataset the source table exists on. The special value, [Environment Default], will use the dataset defined in the environment. For more information, refer to the BigQuery documentation. |
Table | Select | Select the table from which metadata will be taken. |
Grid Variable | Select | Select the grid variable to be loaded with data. To learn more about grid variables, read our Grid Variables documentation. |
Grid Variable Mapping | Multiple Selection | Map each column in the grid to a particular "type" of metadata by selecting from the available dropdown menus. Columns include: Name: Column name. Type: Column data type (as used in Matillion ETL). Mode: Field mode. Can be NULLABLE, REQUIRED, or REPEATED (columns in BigQuery are NULLABLE by default). |
Synapse Properties | ||
---|---|---|
Property | Setting | Description |
Name | String | A human-readable name for the component. |
Schema | Select | Select the table schema. The special value, [Environment Default], will use the schema defined in the environment. For more information on schemas, please see the Azure Synapse documentation. |
Table | Select | Select the table from which metadata will be taken. |
Grid Variable | Select | Select the grid variable to be loaded with data. To learn more about grid variables, read our Grid Variables documentation. |
Grid Variable Mapping | Multiple Selection | Map each column in the grid to a particular "type" of metadata by selecting from the available dropdown menus. Columns include: Name: Column name. Type: Column data type (as used in Matillion ETL). Database Type: Column type (as reported by the database). Size: Allowable size of the data in the column. For T-SQL, this is denoted as Precision. More... Scale: Allowable scale (digits to the right of the decimal point) of the data in the column. For T-SQL, this is denoted as Scale. More... Allow Nullable: Select whether the column will allow null values. |
Delta Lake Properties | ||
---|---|---|
Property | Setting | Description |
Name | String | A human-readable name for the component. |
Catalog | Select | Select a Databricks Unity Catalog. The special value, [Environment Default], will use the catalog specified in the Matillion ETL environment setup. Selecting a catalog will determine which databases are available in the next parameter. |
Database | Select | Select the Delta Lake database. The special value, [Environment Default], will use the database specified in the Matillion ETL environment setup. |
Table | Select | Select the table from which metadata will be taken and used to populate a grid variable. The available tables depends on the selected database. |
Grid Variable | Select | Select an existing grid variable onto which the metadata from the table will be loaded. To learn more about grid variables, including their usage and how to create one, read Grid Variables. |
Grid Variable Mapping | Multiple Selection | Map each column in the grid to a particular "type" of metadata by selecting from the available dropdown menus. Columns include: Name: Column name. Type: Column data type (as used in Matillion ETL). Size: Allowable size of the data in the column. Scale: Allowable scale (digits to the right of the decimal point) of the data in the column. Comments: Meta comments about the table. |