Facebook Query Component

Facebook Query Component


This article is specific to the following platforms - Synapse.

Azure Blob Storage Load

The Azure Blob Storage Load component lets users load data into an existing table from objects stored in Azure Blob Storage.



Properties

The table below cites the Azure Blob Storage Load's setup properties and any actions required of the user.

Note: When performing a COPY command to load files with a Unix-style line ending via this component, users must specify the line ending as 0x0a in the Record Delimiter property. \r\n is not supported by the Synapse COPY command.

Example characters are provided inside [] for readability.

Property Setting Description
Name String Input the descriptive name of the component.
Is Public Container Select Specify whether the data is being loaded from a publicly accessible Azure storage bucket.
Azure Storage Location Azure Blob Filepath Select the Azure storage location (including filepath) for any data to be loaded.
Schema Name Select Select the table schema. The special value, [Environment Default], will use the schema defined in the environment. For more information on using multiple schema, see this article.
Table Name Select Select the table into which data will be loaded.
Column List Target Column Value Select the target column.
Default Value Specify the default value.
Field Number Set the field number for the column value.
File Format Select Select a file format from the dropdown menu.
File Type Select Select a file type. Available file types include CSV, ORC, PARQUET.
Field Delimiter Delimiting Character (CSV only) Specify a delimiter to separate columns. The default is a comma [,].
A [TAB] character can be specified as "\t".
Field Quote Delimiting Character (CSV only) Specify a single character to be used as a quote character. The default character is a double quotation mark ["]. Extended ASCII characters are not supported with UTF-8 for this property.
This property applies to CSV files only. Note: field quote characters are escaped in string columns where there is a presence of a double field quote delimiter.
Record Delmiter Delimiting Character (CSV only) Set a delimiter to be used to separate records (rows) in the file.
Note: When performing a COPY command to load files with a Unix-style line ending via this component, users must specify the line ending as 0x0a in the Record Delimiter property. \r\n is not supported by the Synapse COPY command.
Date Format Select (CSV only)Specify the date format of the date mapping to SQL server date formats. To learn more about Transact-SQL date and time data types and functions, please read Microsoft's documentation.
First Row Integer (CSV only) Specify the first row that is read in all files for the COPY command. The default value is 1.
Error File Location String (CSV only) Specify the directory where the rejected rows and the corresponding error file should be written. Users can specify the full path from the storage account, or the path relative to the container. If the specified container does not exist, one is created on the user's behalf. A child directory is created with the name "rejectedrows". For more information, please refer to Microsoft's documentation.
Encoding Type Select (CSV only) Select the encoding type. The default is UTF-8. This setting specifies the data encoding standard for the files load by the COPY command.
Compress Select Specify the data compression method for the external data. The default setting is None.
Max Errors Integer Specify the maximum number of rejected rows allowed in the load before the COPY operation is cancelled. Each row that the COPY operation cannot import is ignored and counted as one error. The default value for this property is 0.
Identity Insert Select Specify whether the identity value or values in the imported data file are used for the identity column. The default setting is Off. When off, the identity values for a given column are verified, but not imported. Unique values will be assigned based on the seed and increment values specified during table creation.
For more information, please refer to Microsoft's documentation.