Add Partition
  • Dark
    Light

Add Partition

  • Dark
    Light

This article is specific to the following platforms - Redshift.


Add Partition

Allows users to define the S3 directory structure for partitioned external table data. This works by attributing values to each partition on the table. On S3, a single folder is created for each partition value and is named according to the corresponding partition key and value.

For example, the partition value for the key 'Salesdate' might be '2016-01-07'. A directory would then be created on S3 named 'Salesdate=2017-04-31' containing this partition's data.

It is important to note that this component only adds physical partitions on S3—the table itself must already have partitions defined in the Create External Table component.

Properties

Redshift Properties

Property Setting Description
Name String A human-readable name for the component.
Schema Select Select the table schema. The special value, [Environment Default], will use the schema defined in the environment. For more information on using multiple schemas, read Schemas.
Table Select The name of the table to add partitions to. This should be an external table that already has partitions defined through the Create External Table component.
Partition Values Value Specify the values for each partition.
Location S3 Bucket URL The URL of the S3 bucket to load the partition data into.
Skip Existing Select Select Yes or No to skip existing rows when adding the partition.