Stack Overflow
Stack Overflow

Questions tagged [snowflake-task]

To be used for posts related to Snowflake tasks: https://docs.snowflake.com/en/user-guide/tasks-intro.html

125 questions
1
vote
1 answer

How do we stream a data pipeline for data transfer from snowflake to kafka?

I want to get the transformed data from snowflake to my postgres database. To achieve this I want to move the data from snowflake to kafka and then from kafka to postgres. Not able to figure out how to move data from snowflake to kafka.
Vipul Singhal
  • 11
  • 1
1
vote
5 answers

Execute Multiple SQL Insert Statements in parallel in Snowflake

I have a question about how it works when several SQL statements are executed in parallel in Snowflake. For example, if I execute 10 insert statements on 10 different tables with the same base table - will the tables be loaded in parallel?
Maiwand
  • 127
  • 1
  • 14
1
vote
1 answer

Regular Expression not working as expected in Snoflake python connector

I have written a query which will filter out all the phone_no that is not of pattern (nnn)-nnn-nnnnn. select * from employee where not RLIKE(phone_no,'^\\(\\d{3}\\)-\\d{3}-\\d{4}$'); It is giving the result as expected when I am query directly in…
Atif
  • 1,012
  • 1
  • 9
  • 23
1
vote
0 answers

In Snowflake task do we have something like child task will wait until dependency are met other then parent task condition

I have 4 stream. A_STREAM, B_STREAM, C_STREAM, D_ STREAM I have chain of task where A_TASK is parent and it has 3 child task (B_TASK, C_TASK, D_TASK). CREATE TASK A_TASK WAREHOUSE = XYZ SECHDULE = '15 MINUTE' WHEN…
rjain550
  • 105
  • 2
  • 8
1
vote
1 answer

Snowflake task with CRON not scheduled

I have created a Snowflake task like the one below, CREATE or replace TASK staging.task_name WAREHOUSE = 'staging_warehouse' SCHEDULE = 'USING CRON 0 1 * * * UTC' AS delete from staging.... but I dont the see task scheduled or executed…
Somasundaram Sekar
  • 5,244
  • 6
  • 43
  • 85
1
vote
0 answers

In Snowflake warehouse_load_history table what exactly AVG_RUNNING column means?

In warehouse_load_history table the column AVG_RUNNING. Does it calculate both the metadata queries and normal queries? I want to know whether this column is calculating the running avg queries of CREDITS_USED_CLOUD_SERVICES or CREDITS_USED_COMPUTE…
Shyam Maharana
  • 36
  • 2
1
vote
0 answers

How to build a Snowflake query to get these results

The below table (TMP_RN_TC) in query is a temp table which would be used to load the data into the final table. This table has to get the data from stage-table and the output of temp-table data needs to be stored in final table. Stage table will get…
Shashank Shekhar
  • 47
  • 1
  • 6
1
vote
3 answers

How to use Snowflake as ETL / ELT option if you cannot fire multiple SQL statements?

we are currently running our first analytics prototype on Snowflake. The objective is to create a comprehensive analysis result table that can be used for reporting based on ~60 structured raw data tables. We created all the necessary SQL scripts…
Stifter
  • 31
  • 1
  • 6
1
vote
1 answer

How to get snowflake host and port number to create connection in SAP Analytics Cloud?

The SAP Analytics Cloud's Snowflake Connector needs these details for setting up a Snowflake connection [ How can I get these details from Snowflake? I'm trying to follow this guide
Prasad P
  • 41
  • 1
  • 2
1
vote
1 answer

Stream/Task can be used as ETL in warehouse solution or not

I want to replicate the the ETL solution is snowflake. I have achieved that using streams and tasks. I am using stored procedure on the stream table where there are merge queries that replicate the logic in any other ETL tool like Informatica and…
Abhirup
  • 27
  • 1
  • 5
1
vote
1 answer

How to check pricing tier for credits and storage for the current account in Snowflake?

I want to write a SQL query that gives me any sort of information related to the current pricing for credits and storage of my current account. Any alternate solution is also acceptable.
Vedant Kumar
  • 41
  • 4
1
vote
1 answer

Snowflake PUT Command status in Python

I am using snowflake PUT command from Python to move files from local system to snowflake staging. I have 400 (40 MB each) files so I am using command like -> put file:///Path/file_name* It is working and loading all the files but its taking around…
PythonDeveloper
  • 289
  • 1
  • 4
  • 24
1
vote
1 answer

Using schedule tasks in snowflake to clone DB's with dynamic names

I want to use snowflake Task scheduler to clone one or all of the DB's with dynamic clone DB name something like below,Is it possible to do it without creating Stored procedure.As I have multiple DB under my account I would prefer to clone all of…
goodbadboys9
  • 11
  • 2
1
vote
0 answers

CLI Client(SnowSQL) Not available for Download in Help —> Downloads

Where is the CLI Client(snowSQL) option to download SnowSQL CLI in help—>Download in Snowflake WebUI? Screen Shot attached Screen Shot Help —> Downloads
vigneshwarans
  • 11
  • 1
1
vote
2 answers

End of week of current week in Snowflakes

I have a date column called Close_Date. How do i get the Close_date to only give me date for end of the current week? Thanks
Lawrence
  • 11
  • 2
1 2
3
…
8 9