Questions tagged [snowflake-task]

To be used for posts related to Snowflake tasks: https://docs.snowflake.com/en/user-guide/tasks-intro.html

125 questions
0
votes
1 answer

Snowflake object_construct unloading Key Order should be preserved as same. how to maintain the order not by alphabetical?

I use copy command of snowflake which is below returns a file with content json copy into @elasticsearch/product/sf_index from (select object_construct('id',id, alpha,'alpha')from table limit 1) file_format = (type = json, COMPRESSION=NONE),…
0
votes
2 answers

Activating warehouse in Snowflake using Java and spark

I am trying to connect to snowflake DB and activate a particular warehouse.I have used warehouse in both JDBC connection jdbc:snowflake://xy12345.eu-central-1.snowflakecomputing.com/?warehouse=mywh as well as in the…
0
votes
1 answer

Can we have task start condition dependent on Sucess condition of PIPE in SNOWFLAKE

I have a requirement where 3 different file will be loaded to a single table with 3 different PIPE. I want target my target process to be triggered only once all 3 file has been loaded to my stage. I don't want to run my target process multiple…
0
votes
1 answer

STREAM not consumed from a task created by a stored procedure

TLDR: I have stream that gets consumed when I or a task I directly created issue a DML on it. But when it is a task created by a Stored Procedure, the stream does not get consumed. I have a stream which behaves as expected and I can see it has data…
0
votes
1 answer

Facing classnotfound exception while reading a snowflake table using spark

I am trying to read a snowflake table from spark-shell. To do that, I did the following. pyspark --jars spark-snowflake_2.11-2.8.0-spark_2.4.jar,jackson-dataformat-xml-2.10.3.jar Using Python version 2.7.5 (default, Feb 20 2018…
0
votes
1 answer

How to pass a range of date in where clause in snowflake while writing a query

How to pass a range of date in where clause in snowflake while writing a query and avoiding duplicates also for the next run. I have below query and i have to fetch 15-days of data each day till previous day. The data would be passed to my final…
0
votes
0 answers

How to get a list of IDataRecord from IDataReader returned by Snowflake .net client?

If we use Microsoft SQL Database, then we get SQLDataReader object when ExecuteReader() function is executed. So we have a function for converting SQLDataReader object into List of IDataRecord which can be used later on when the connection is…
0
votes
1 answer

Number of managed accounts allowed exceeded the limit. Please contact Snowflake support

Number of managed accounts allowed exceeded the limit. Please contact Snowflake support. I've created a reader account with my ID as Admin then dropped the reader account, then while creating a new reader account it is giving me exceeded the limit,…
0
votes
2 answers

How to bulk load files from external stage Amazon s3 to snowflake table using COPY into for disordered columns using Column?

I am facing issue while I am trying to do a copy into from S3 stage (with column headers but in different order than that of target snowflake table) to snowflake db using this copy into command COPY INTO db.schema.table FROM @stage/file.csv…
0
votes
1 answer

SQL select records as at past date

I want to compare the total number of hotel rooms that are available (for all future dates) as at now versus what was available at historic dates. The below query will retrieve the number of rooms available as at today SELECT date,…
0
votes
1 answer

Successfully created a task in Snowflake, but it does not show up when running "show tasks"

I am new to Snowflake and am trying to create my first task. CREATE TASK task_update_table WAREHOUSE = "TEST" SCHEDULE = 'USING CRON 0 5 * * * America/Los_Angeles' AS INSERT INTO "TEST"."WEB"."SOME_TABLE" (ID,VALUE1,VALUE2,VALUE3) WITH CTE…
0
votes
1 answer

Snowflake Java Script User Defined Table Function

How do I return a table with multiple columns from Snowflake Javascript UDF / UDTF?
0
votes
0 answers

Get list of files loaded to Snowflake Internal Staging via PUT command

I am moving files from local to Snowflake Internal Staging using PUT command in Python put file:///Path/file_name* I want to get list of all the files which were moved by this command. I tried using Query id, but when I go to snowflake History and…
PythonDeveloper
  • 289
  • 1
  • 4
  • 24
0
votes
1 answer

Snowflake - Failure using stage area. Cause: [The AWS Access Key Id you provided is not valid.]

I'm trying to connect to my personal S3 bucket using Snowflake. First of all, i used the url, aws key id and secret key to create the stage (Success). But when i tried to list the s3 bucket, i got the following error - Failure using stage area.…
0
votes
2 answers

Clone Schemas in Snowflake

Is it possible to clone schemas selectively in Snowflake? For e.g. Original: DB_OG --schema1 --schema2 --schema3 Clone: DB_Clone --schema1 --schema3
1 2 3
8 9