Export data from Snowflake

You can export data from Snowflake in either of two ways:

• Retrieve data with a SQL command: This method allows you to use SQL queries to retrieve data from the Snowflake platform and export it into integrator.io
• Extract data via the COPY API into Amazon S3: You can use an Amazon S3 bucket to store extracted Snowflake data and then retrieve the copied file from Amazon S3 for use in a flow

Use SQL to query data

You can use Snowflake SQL queries, or you can export data from Snowflake via SQL queries that access semi-structured data using special operators and functions. The following example describes how to retrieve JSON data from Snowflake:

1. In Flow Builder, click Add source.

2. Select Snowflake as your source application, and choose the Snowflake connection you want to use to export data.
3. Click Next. The Create export panel opens.

4. Enter a name and optional description for the export.
5. In the What would you like to export? section, enter your SQL query in the Query field. For more information on constructing queries, see the Snowflake query documentation.

Example query

select
value:first_name::string as "first name",
value:last_name::string as "last name",
value:city::string as "city",
value:zip::string as "zip"
from shopify_customer,
    lateral flatten(input => properties:addresses);

Example result

{
  "page_of_records": [
    {
      "record": {
         "first name": "Test",
         "last name": "Smith",
         "city": "Springfield",
         "zip": "55555"
       }
     ]
   }
}

Extract data via the COPY API into Amazon S3

If you already use S3 buckets for storing and managing your data files, you can use your existing buckets and folder paths when unloading data from Snowflake tables, and then retrieve that data with your Amazon S3 connection for use in a flow.

Note: If you have not yet configured Snowflake to Amazon S3 storage integration, see the Snowflake documentation on S3 external storage. For information about unloading Snowflake data to Amazon S3, see the Snowflake user guide.

If you have configured your Snowflake account to use Amazon S3 storage, enter the following command in the Query field to automatically copy Snowflake data to Amazon S3:

COPY INTO @my_ext_unload_stage/dl_file_prefix 
from Shopify_customer 
OVERWRITE = TRUE 
file_format = (format_name ='mycsvformat' compression='NONE');

Group export records

The Grouping option allows you to manage your flow’s files by grouping records by field. This feature allows you to aggregate your data based on your chosen field(s).