Extract Nested Data

Extract Nested Data


This article is specific to the following platforms - Snowflake - BigQuery.

Overview

The Extracted Nested Data component flattens nested data into rows. This is generally done by taking nested data in the form of key:value pairs (such as a JSON dictionary) and using those keys as column names.

The flow into this component should include a single variant-type column that is to be unpacked.



Snowflake Properties

Property Setting Description
Name String Input the descriptive name for the component.
Include Input Columns Select Choose whether or not to include input columns.
Data Structure Tree Structure Define the variant's structure here. Unique endpoints in this structure will be unpacked into columns. The variant from the input can usually be automatically detected, and its structure determined, using the Autofill button. Elements of the structure can be manually edited by right-clicking them on the tree and selecting "Delete" or "Edit" as appropriate.
Outer Join True/False If False, any input rows that cannot be expanded, either because they cannot be accessed in the path or because they have zero fields or entries, are completely omitted from the output. If True, a single row is generated for expansions with zero rows.
Input Alias String If two properties have identical names, one will be given this prefix to differentiate them. More than two identically named properties will result in an error. This does not need changing in the vast majority of use cases.
Array Prefix String If two array structures have identical names, one will be given this prefix to differentiate them. More than two identically named structures will result in an error. This does not need changing in the vast majority of use cases.

BigQuery Properties

Property Setting Description
Name String Input the descriptive name for the component.
Columns Select Select the columns to be written to the table.
Column Aliases String Give an alternative name for the column(s) you select.
Include Input Columns Select Choose whether or not to include input columns.
Input Column Prefix String Give a prefix name for the input columns.