Questions tagged [snowflake-pipe]
41 questions
0
votes
1 answer
Snowflake Java Script User Defined Table Function
How do I return a table with multiple columns from Snowflake Javascript UDF / UDTF?
AravindR
- 677
- 4
- 11
0
votes
1 answer
Snowflake - Failure using stage area. Cause: [The AWS Access Key Id you provided is not valid.]
I'm trying to connect to my personal S3 bucket using Snowflake. First of all, i used the url, aws key id and secret key to create the stage (Success). But when i tried to list the s3 bucket, i got the following error -
Failure using stage area.…
Gu Longfei
- 21
- 1
- 1
0
votes
1 answer
Load from before snowpipe continous data load setup
I have setup snowpipe to continuously load data in tables from an S3 bucket. This has been running about a month now (i.e. > 14 days). There is data in the bucket from before snowpipe was setup and we need to load those files into snowflake also.…
Vish
- 827
- 11
- 21
0
votes
2 answers
Merge/Load same files in multiple folders in S3 into Snowflake
Need help on how to achieve in loading the same file available in multiple folders into the snowflake table. Is it possible to achieve using Snowflake Copy Command?
Say in a bucket I have .. All the files of a.csv which are only under the current…
Kar
- 790
- 13
- 36
0
votes
1 answer
SnowSql no response
I am using SnowSql 1.2.5 and I receive no response, no error, absolutely nothing from it.
It does not matter which command I type, even if type just "SnowSql.exe" and hit confirm, I get no response.
This is happening in an specific machine, in…
Destro
- 41
- 1
- 3
0
votes
1 answer
Changed Data Capture (CDC) - periodically Sync datasets between S3 Staging File & Snowflake Tables
For ex:
Source : S3
Scheduled update: 2 times/Day
Target : Snowflake Table
Streaming : NO
On Day-0, I have a customer table created & loaded in Snowflake DB. S3 Files are updated 2 times a day and they need to reflected in Snowflake table as…
osr
- 21
- 1
- 3
0
votes
1 answer
How to load 533 columns of data into snowflake table?
We have a table with 533 columns with a lot of LOB columns that have to be moved to snowflake. Since our source transformation system having an issue to manage 533 columns in one job. We have split ted the columns into 2 jobs. The first job will…
Kumaresan Natarajan
- 47
- 5
0
votes
1 answer
Snowflake integration with Jumpcloud throws http 400 error
I have enabled AWS private link to access snowflake and there is no Issue with the Link, when Integrating with SSO using Jumpcloud, after login it just throws 400 Error
For Troubleshhot I have tried but they didn't work…
anish
- 6,884
- 13
- 74
- 140
0
votes
1 answer
SnowFlake-Kafka connector -> Landing Table -> Destination table. How to cleanup Landing Table
I'm investigating taking data from Kafka -> SnowFlake/Kafka connector -> SnowFlake. Unfortunately, the connector seems to use just two columns (and put the entire JSON payload into a single column). So I created a stream/task to periodically copy…
Surendar Chandra
- 47
- 1
- 5
0
votes
1 answer
Snowflake pass dynamic value binding and constant value
I have to pass the dynamic value as my column name to my table from the loop and the constant value . My code snippet something looks like below:
While(res.next()){
var columnname= res.getColumnValue(1);
var stmt= insert into…
user12206796
- 73
- 1
- 1
- 10
-1
votes
1 answer
Can Snowflake stage Standalone without the help of any cloud or lock machine?
For staging in Snowflake, we need S3 AWS layer or Azure or Local machine. Instead of this, can we FTP a file from a source team directly to Snowflake internal storage, so that, from there the Snowpipe can the file and load to our Snowflake table.
If…
