Assert Table Component

Assert Table Component



Assert Table Component

The Assert Table component assures that the target table has been created with the correct metadata. This component asserts the row count using various methods such as "Equal to", "Greater than", "Less than", and "Range", options which allow the user to set the upper and lower values of the row counts.



Redshift Properties

Property Setting Description
Name String Input the descriptive name for the component.
Schema Select Select the table schema. The special value, [Environment Default], will use the schema defined in the environment. For more information on using multiple schemas, see Schema Support.
Table Name Select Select the table to assert.
Exists Select This property assures that the table exists within the database.
Table Metadata Column Name The name of the new column.
Data Type Text: This type can hold any type of data, subject to a maximum size. More...
Integer: This type is suitable for whole-number types (no decimals). More...
Real: This type is suitable for data of a single precision floating-point number. More...
Double Precision: This type is suitable for data of a double precision floating-point number. More...
Numeric: This type is suitable for numeric types, without or with decimals. More...
Boolean: This type is suitable for data that is either "True" or "False".More...
Date: This type is suitable for dates without times. More...
DateTime: This type is suitable for dates, times, or timestamps (both date and time). More...
Size For Text types, this is the maximum length. This is a limit on the number of bytes, not characters. For Redshift, since all data is stored using UTF-8, any non-ASCII character will count as 2 or more bytes.
For Numeric types, this is the total number of digits allowed, whether before or after the decimal point.
Decimal Places Relevant only for "Numeric" data, it is the maximum number of digits that may appear to the right of the decimal point.
Row Count Comparison Type Select This property determines the possible comparison for the Row Count Values.
Possible comparators include: "Equal to", "Greater than or equal to", "Less than or equal to", "Range".
Equal To:Value in the Input Column must be equal to that specified in the Value Column. It is the default condition type.
Greater than or equal to: Value in the Input Column must be greater than or equal to that specified in the Value Column.
Less than or equal to: Value in the Input Column must be less than or equal to that specified in the Value Column.
Range: This allows users to specify the range for the value of the row counts.
Selecting "Range" makes the Upper Value and Lower Value properties available.
Note: Not all data sources support all comparators, thus, it is likely that only a subset of the above comparators will be available to choose from.
Upper Value Numeric Set the Upper Value of the row within the group of row counts.
Note: This is only available if you select "Range" from the Row Count Comparison Type property.
Lower Value Numeric Set the Lower Value of the row within the group of row counts.
Note: This is only available if you select "Range" from the Row Count Comparison Type property.
Row Count Value Numeric Set the value of the row within the group of row counts.

Snowflake Properties

Property Setting Description
Name String Input the descriptive name for the component.
Database Select Choose a database.
Schema Select Select the table schema. The special value, [Environment Default], will use the schema defined in the environment. For more information on using multiple schemas, see this article.
Table Name Select Select the table to assert.
Exists Select This property assures that the table exists within the database.
Table Metadata Column Name The name of the new column.
Data Type Varchar: This type is suitable for numbers and letters. A varchar or Variable Character Field is a set of character data of indeterminate length. More...
Number: This type is suitable for numeric types, without or with decimals. More...
Float: This type of values are approximate numeric values with fractional components. More...
Boolean: This type is suitable for data that is either "true" or "false". More...
Date: This type is suitable for dates without times. More...
Time: This type is suitable for time, independent of a specific date and timezone. More...
Timestamp: This type is a timestamp left unformatted (exists as Unix/Epoch Time). More...
Variant: Variant is a tagged universal type that can hold up to 16 MB of any data type supported by Snowflake. More...
Size For Text types, this is the maximum length. This is a limit on the number of bytes, not characters.
For Numeric types, this is the total number of digits allowed, whether before or after the decimal point.
Precision The precision of the data in the column. Will be 0 (zero) for non-applicable types.
Row Count Comparison Type Select This property determines the possible comparison for the Row Count Values.
Possible comparators include: "Equal to", "Greater than or equal to", "Less than or equal to", "Range".
Equal To:Value in the Input Column must be equal to that specified in the Value Column. It is the default condition type.
Greater than or equal to: Value in the Input Column must be greater than or equal to that specified in the Value Column.
Less than or equal to: Value in the Input Column must be less than or equal to that specified in the Value Column.
Range: This allows users to specify the range for the value of the row counts.
Selecting "Range" makes the Upper Value and Lower Value properties available.
Note: Not all data sources support all comparators, thus, it is likely that only a subset of the above comparators will be available to choose from.
Upper Value Numeric Set the Upper Value of the row within the group of row counts.
Note: This is only available if you select "Range" from the Row Count Comparison Type property.
Lower Value Numeric Set the Lower Value of the row within the group of row counts.
Note: This is only available if you select "Range" from the Row Count Comparison Type property.
Row Count Value Numeric Set the value of the row within the group of row counts.

BigQuery Properties

Property Setting Description
Name String Input the descriptive name for the component.
Project Select The target BigQuery project to load data into.
Dataset Select The target BigQuery dataset to load data into.
Table Name Select Select the table to assert.
Exists Select This property assures that the table exists within the database.
Table Metadata Field Name The name of the new field.
Data Type String: This type can hold any kind of data, subject to a maximum size.
Integer: This type is suitable for whole-number types (no decimals). More...
Float: This type of values are approximate numeric values with fractional components. More...
Numeric: This type is suitable for numeric types, without or with decimals. More...
Boolean: This type is suitable for data that is either "true" or "false". More...
Date: This type is suitable for dates without times. More...
Time: This type is suitable for time, independent of a specific date and timezone. More...
DateTime: This type is suitable for dates, times, or timestamps (both date and time). More...
Timestamp: This type is a timestamp left unformatted (exists as Unix/Epoch Time). More...
Mode Nullable: Indicates that NULL values are permissible.
Required: Field does not accept null values.
Repeated: Field can accept multiple values.
Row Count Comparison Type Select This property determines the possible comparison for the Row Count Values.
Possible comparators include: "Equal to", "Greater than or equal to", "Less than or equal to", "Range".
Equal To:Value in the Input Column must be equal to that specified in the Value Column. It is the default condition type.
Greater than or equal to: Value in the Input Column must be greater than or equal to that specified in the Value Column.
Less than or equal to: Value in the Input Column must be less than or equal to that specified in the Value Column.
Range: This allows users to specify the range for the value of the row counts.
Selecting "Range" makes the Upper Value and Lower Value properties available.
Note: Not all data sources support all comparators, thus, it is likely that only a subset of the above comparators will be available to choose from.
Upper Value Numeric Set the Upper Value of the row within the group of row counts.
Note: This is only available if you select "Range" from the Row Count Comparison Type property.
Lower Value Numeric Set the Lower Value of the row within the group of row counts.
Note: This is only available if you select "Range" from the Row Count Comparison Type property.
Row Count Value Numeric Set the value of the row within the group of row counts.

Synapse Properties

Property Setting Description
Name String Input the descriptive name for the component.
Schema Select Select the table schema. The special value, [Environment Default], will use the schema defined in the environment.
For more information on schemas, please see the Azure Synapse documentation.
Table Name Select Select the table to assert.
Exists Select This property assures that the table exists within the database.
Metadata Column Name Input the name of the column.
Data Type Select the data type. The available data types are:
DATE: this data type is suitable for dates without times. More...
DATETIME: this data type is suitable for timestamps. More...
TIME: this data type is suitable for times only. More...
INTEGER: this data type is suitable for whole number types (no decimals). More...
NUMERIC: this data type is suitable for numeric types, with or without decimals. More...
TEXT: this data type is suitable for text types. More...
FLOAT: this data type is suitable for approximate number data types for use with floating point numeric data. More...
BOOLEAN: this data type is suitable for data whether values are either "true" or "false". More...
Size Define the size. For T-SQL, this is denoted as Precision. More...
Precision Define the precision. For T-SQL, this is denoted as Scale. More...
Row Count Comparison Type Select This property determines the possible comparison for the Row Count Values.
Possible comparators include: "Equal to", "Greater than or equal to", "Less than or equal to", "Range".
Equal To:Value in the Input Column must be equal to that specified in the Value Column. It is the default condition type.
Greater than or equal to: Value in the Input Column must be greater than or equal to that specified in the Value Column.
Less than or equal to: Value in the Input Column must be less than or equal to that specified in the Value Column.
Range: This allows users to specify the range for the value of the row counts.
Selecting "Range" makes the Upper Value and Lower Value properties available.
Note: Not all data sources support all comparators, thus, it is likely that only a subset of the above comparators will be available to choose from.
Row Count Value Numeric Set the value of the row within the group of row counts.