-
DarkLight
Add Partition
-
DarkLight
Add Partition
Allows users to define the S3 directory structure for partitioned external table data. This works by attributing values to each partition on the table. On S3, a single folder is created for each partition value and is named according to the corresponding partition key and value.
For example, the partition value for the key 'Salesdate' might be '2016-01-07'. A directory would then be created on S3 named 'Salesdate=2017-04-31' containing this partition's data.
It is important to note that this component only adds physical partitions on S3—the table itself must already have partitions defined in the Create External Table component.
Properties
Redshift Properties | ||
---|---|---|
Property | Setting | Description |
Name | String | A human-readable name for the component. |
Schema | Select | Select the table schema. The special value, [Environment Default], will use the schema defined in the environment. For more information on using multiple schemas, read Schemas. |
Table | Select | The name of the table to add partitions to. This should be an external table that already has partitions defined through the Create External Table component. |
Partition Values | Value | Specify the values for each partition. |
Location | S3 Bucket URL | The URL of the S3 bucket to load the partition data into. |
Skip Existing | Select | Select Yes or No to skip existing rows when adding the partition. |