To be used for posts related to Snowflake tasks: https://docs.snowflake.com/en/user-guide/tasks-intro.html
Questions tagged [snowflake-task]
125 questions
0
votes
1 answer
Snowflake Not Accepting File Format In Bulk Load
I am creating some new ETL tasks for our data pipeline. We have currently have several hundred loading data from various S3 buckets.
So it would go like this:
create or replace stage ETL_STAGE url='s3://bucketname/'
file_format = csv_etl;
create…
Randy B.
- 453
- 4
- 20
0
votes
1 answer
Snowflake pass dynamic value binding and constant value
I have to pass the dynamic value as my column name to my table from the loop and the constant value . My code snippet something looks like below:
While(res.next()){
var columnname= res.getColumnValue(1);
var stmt= insert into…
user12206796
- 73
- 1
- 1
- 10
0
votes
0 answers
Is it possible to load and index genomic data (Sequence Reads / VCF output etc.,) on Snowflake?
I am looking for possibilities to load sequence data and VCF output data on Snowflake. The Snowflake website does indicate that it is possible to transform VCF format to semi-structured format like JSON or CSV before loading them but does not give…
0
votes
0 answers
Snowflake query for the getting Info of last accessed time stamp for a table?
I want a particular table's last accessed time in the snowflake.
0
votes
1 answer
How to load .jsonl into a snowflake table variant?
How to load .jsonl into a table variant as json of snowflake
create or replace table sampleColors (v variant);
insert into
sampleColors
select
parse_json(column1) as v
from
values
( '{r:255,g:12,b:0} {r:0,g:255,b:0}…
Arun Mandalapu
- 1
- 2
0
votes
1 answer
Adding a Column from Another Table in Snowflake
This is my second day working with snowflake, and I understand the documentation in https://docs.snowflake.net/manuals/sql-reference/sql/alter-table-column.html may cover some of what I'm trying to do, but I'm lost on the terminology.
Basics: I…
David Neiderauer
- 21
- 3
0
votes
1 answer
How can we handle Data validations in snowpipe in Snowflake
My Scenario is I have data in AWS S3 flat files.
I am using SNS to trigger the Snow-pipe when new file arrives in S3.
To load the data from flat files in S3 to Snowflake table I am using Snow-pipe.
So While loading data from flat files to snowflake…
Rajesh Atikela
- 11
- 3
0
votes
1 answer
Snowflake stage creation with relative path
I'm trying to use the "test" folder name as dynamic folder path for Snowflake stage creation, which comes after the s3 url.
Copy command runs but returns zero records.
create or replace stage MYSQL_S3 url='s3://myproject/product/BackEnd/'
…
Sundar
- 95
- 1
- 13
0
votes
0 answers
Stream snowflake table updates
There is a huge ETL process on snowflake side that updates a table. I need to stream the changes made to it to other consumers-processors outside of snowflake. Not querying the table for updates but streaming (push pattern, not pull).
I see there is…
Andrey Borisko
- 4,511
- 2
- 22
- 31
0
votes
1 answer
Unable to create a role when using ACCOUNTADMIN or SYSADMIN in Snowflake
I am getting the error "SQL access control error: Insufficient privileges to operate on account 'XXXXXX'" when I try to create a role in Snowflake in order to get it connected to Segment.
I am following the Segment documentation here:…
quantumofnolace
- 125
- 7
0
votes
1 answer
snowflake data transfer and formatting
We are in the process of creating a DataWarehouse in Snowflake, basically what our developers have done is by using stitch they have transferred all existing data to a Database in Snowflake and then are updating this further daily.
Now I am in the…
0
votes
2 answers
How to resolve Invalid URI issue in C# while connecting to Snowflake?
I am trying to connect to Snowflake via azure function app. Following is the code snippet (ref: https://github.com/snowflakedb/snowflake-connector-net#create-a-connection ) I am using:
using (IDbConnection conn = new SnowflakeDbConnection())
{
…
shary.sharath
- 649
- 2
- 14
- 29
0
votes
1 answer
Snowpipe is not triggering when new file has been uploaded in S3
I have created SNS topic, event in S3 and Snowpipe creation has been done successfully. But when I upload any new file in AWS S3, my snowpipe is not triggering automatically. I guess my SNS is not handing event triggring. Is there any dependency to…
Rajesh Atikela
- 11
- 3
0
votes
2 answers
Snowflake user/role management
I have different users with role "sysadmin".
When user "AAA" which is a sysadmin, is creating a table, everything is working but then when user "BBB", wants to drop/create or replace the table that user "AAA" created, we receive an error that…
Aynaz
- 11
- 2
0
votes
2 answers
Snowflake - execution history of tasks with predecessors
I have two tasks T1 and T2. T1 runs every day at 7:00 hours and it is the predecessor of T2.
I am able to use the task execution history for T1. However, the history of T2 doesn't show up in the results.
Is there a way I can track whether the second…
Vijay Prakash
- 101
- 5