Stack Overflow
Stack Overflow

Questions tagged [snowflake-task]

To be used for posts related to Snowflake tasks: https://docs.snowflake.com/en/user-guide/tasks-intro.html

125 questions
0
votes
2 answers

Merge/Load same files in multiple folders in S3 into Snowflake

Need help on how to achieve in loading the same file available in multiple folders into the snowflake table. Is it possible to achieve using Snowflake Copy Command? Say in a bucket I have .. All the files of a.csv which are only under the current…
Kar
  • 790
  • 13
  • 36
0
votes
1 answer

Need help parsing this in snowflake

[ { "legs": [ { "points": [ { "latitude": 29.76524, "longitude": -95.35406 }, { "latitude": 30.74438, "longitude": -101.71203 }, { "latitude": 30.74421, "longitude": -101.71247 }, { "latitude": 30.74404, "longitude": -101.71289 }, { "latitude":…
Og101010
  • 1
0
votes
2 answers

Can we grant select or insert to a user on table with out creating a role in snowflake?

Can we grant direct select or insert access( with out creating a role ) to a user on a table ?
chandra babu
  • 1
  • 1
0
votes
1 answer

Concatenation issues with in-built functions

Can someone please explain me why it returns only two records instead of three? I want the same result when I hard-code the delimiter as well as use the in-built SQL function(s). SELECT 'HASH(IFNULL(COST_CENTER, '''') || IFNULL(MATCH_DATE,…
Julaayi
  • 403
  • 2
  • 8
  • 23
0
votes
2 answers

How to querying in Snowflake using Python (SSO Authentication)?

I tried to connect snowflake(SSO Authentication) and get data from table. But, When i run the code, i can login with my credentials in the pop-up browser window and it connect Snowflake, no response after that(the program neither terminate nor…
Guruprakash
  • 13
  • 1
  • 5
0
votes
1 answer

Changed Data Capture (CDC) - periodically Sync datasets between S3 Staging File & Snowflake Tables

For ex: Source : S3 Scheduled update: 2 times/Day Target : Snowflake Table Streaming : NO On Day-0, I have a customer table created & loaded in Snowflake DB. S3 Files are updated 2 times a day and they need to reflected in Snowflake table as…
osr
  • 21
  • 1
  • 3
0
votes
1 answer

How to load 533 columns of data into snowflake table?

We have a table with 533 columns with a lot of LOB columns that have to be moved to snowflake. Since our source transformation system having an issue to manage 533 columns in one job. We have split ted the columns into 2 jobs. The first job will…
Kumaresan Natarajan
  • 47
  • 5
0
votes
1 answer

What are the best tools to schedule Snowflake tasks or python scripts in Ec2 to load data into snowflake?

Please share your experiences wrt orchestrating jobs run through various tools and programmatic interfaces to load data to Snowflake- python scripts in Ec2 instances. currently scheduled using crontab. tasks in snowflake Alteryx workflows Are…
sim
  • 41
  • 3
0
votes
1 answer

Standard load (ingestion) process for snowflake DW?

For on-prem -> S3 -> Snowflake ETL Solution Currently I use tools: snowSQL snowflake UI Currently I follow this load process Create warehouse Create indexes (DDL) Create tables (DDL) Copy files into User S3 Stage. Copy S3 stage files into…
osr
  • 21
  • 1
  • 3
0
votes
1 answer

SnowFlake-Kafka connector -> Landing Table -> Destination table. How to cleanup Landing Table

I'm investigating taking data from Kafka -> SnowFlake/Kafka connector -> SnowFlake. Unfortunately, the connector seems to use just two columns (and put the entire JSON payload into a single column). So I created a stream/task to periodically copy…
Surendar Chandra
  • 47
  • 1
  • 5
0
votes
1 answer

Variable in Snowflake Task

I tried to use variable in snowflake task, but I received an error. I read that task can contain only one statement and I think it can be a reason of failure - after variable setting the must be ';' - wchich means that there are at least two…
Cezary Ziemkowski
  • 1
  • 1
0
votes
1 answer

How to calculate the AVG time stamp for last one week

I am trying to calculate the AVG timestamp for last 7 days in Snowflake database. Data type is VARCHAR and below is the sample data. LOAD_TIME VARCHAR(10) - Sample Data: LOAD_TIME (HHMM) 1017 0927 0713 0645 1753 2104 1253
Naga Krishna Mahesh Pulikonda
  • 1
  • 1
0
votes
1 answer

Snowflake to S3 with Header

Does anyone know of a way to export your data from Snowflake to an S3 file with a header? For example, I have this table: Table Example: +----+-------+ | id | group | +----+-------+ | 1 | bob | | 2 | bob | | 3 | bob | | 4 | tim | | 5 |…
ehlJay
  • 71
  • 4
0
votes
2 answers

Snowflake event based TASK Scheduling instead of Time Based task scheduling

I'm in need of examples of Snowflake event based TASK Scheduling instead of Time Based task scheduling. I could not find those examples in snowflake document. thanks in advance
Sundar
  • 95
  • 1
  • 13
0
votes
1 answer

Bulk Load Timestamp Formatting

We have a database that produces this timestamp: YYYY-MM-DD HH24:MI:SS In order to load the csvs with this timestamp, is there a way to reliably do this? I have tried a number of formatting options hoping it just adds .00.00 to it and meets the…
Randy B.
  • 453
  • 4
  • 20
1 2 3
…
8 9