Questions tagged [dremio]
64 questions
0
votes
0 answers
arrow flight sql in dremio odbc/jdbc driver
I am implementing Nodejs client to connect to Dremio data source using Dremio odbc driver. Is arrow flight sql connector used in the implementation of ODBC Dremio driver? can someone help me understand
Manju
- 11
- 3
0
votes
1 answer
how to use Like any, like all in spark
I was trying to use like any and like all in this query in Spark/ Dremio SQL
SELECT * FROM table_name where col_name LIKE ANY (CONCAT('%', 10, '%'), CONCAT('%', 20, '%'), CONCAT('%', 12, '%'))
SELECT * FROM table_name where col_name LIKE ALL…
Shivi Singla
- 13
- 3
0
votes
1 answer
pandas to convert sqs message to csv
I'm new to Dremio, and I was following this SQS + S3 + Dremiotutorial to learn more about Dremio. In one of the code snippets, it is mentioned that get_messages_from_queue will create a CSV file and which is later used in the upload_file method to…
change198
- 1,647
- 3
- 21
- 60
0
votes
1 answer
dremio list user API
I'm trying to query dremio using the documented API to get list of users.
Dremio version:
Build
20.2.2-202203241726030461-f7eea3e0
Edition
Enterprise Edition
API:
https://docs.dremio.com/software/rest-api/user/list-users/
sample query:
curl -X GET…
Jin Ma
- 169
- 2
- 12
0
votes
1 answer
How to format a Dremio table programmatically?
Our system produces a lot of Delta files that we would like to query in Dremio. The files might be updated with new schema.
Is there any way for us to programmatically clear format of a delta table and then reformat it in Dremio?
DreamingFighter
- 41
- 5
0
votes
1 answer
Can not find some dependencies while building dremio-oss
https://github.com/dremio/dremio-oss/blob/master/pom.xml
After I clone the project,I try to build the project, but some dependencies are not found .How to find these dependencies,such as
the project accquire…
kachuan
- 21
- 1
0
votes
1 answer
Resource Error when connecting dremio to Alteryx
I've data that is on Dremio and I'm looking to connect it with Alteryx.
It was working fine until once I had cancelled the Alteryx workflow in the middle of the execution. After that that instance - it is always giving the below error which I'm not…
Mishal
- 450
- 9
- 27
0
votes
1 answer
How to set variables in Dremio
How do you set a variable in dremio?
In sql, normally you can do something like:
SET @ID = (SELECT id FROM table LIMIT 1)
or
SELECT @ID = (SELECT id FROM table LIMIT 1)
This does not seem to work for Dremio query. Anybody know how variables work…
user1179317
- 2,693
- 3
- 34
- 62
0
votes
1 answer
Apache Arrow flight C# implementation code to connect to Dremio
We are trying to connect to dremio service using Apache Arrow Flight C# client. We couldn't find any working code sample in the following…
Gandhi
- 11,875
- 4
- 39
- 63
0
votes
1 answer
Getting error while setting up DSN with Dremio odbc driver on Debian 10
I got into a fresh debian 10 environment with following command
docker run -it --entrypoint /bin/bash debian:10
Inside the container I am installing various utilities and tools with:
apt-get update
apt-get install -y odbcinst1debian2 libodbc1…
COBHC
- 67
- 1
- 8
0
votes
1 answer
Not able to connect to Azure SQL Server via Dremio
We were not able add Azure SQL Server as external data source in Dremio. We have disabled the firewall to allow all access (at the Azure SQL Server end) to connect to Azure SQL Server, but it was still throwing an error and it was not able to…
Sunil
- 1
- 1
0
votes
1 answer
Join two tables on consecutive segments
I want to join two tables, where the first table has more entries than the second, such that rows from each are joined in order. Maybe a little example would be helpful:
Table T:
| tid | sid | ron | val | seqno |
| --- | --- | --- | --- | --- |
|…
Nikola Knezevic
- 789
- 5
- 20
0
votes
1 answer
Imitate behaviour of "generate_series" with SQL
I am trying to imitate the behaviour of "generate_series".
My table contains various fields. One of these is "count". I want to output each row as often as "count" because each row is going to serve as an independent object.
Dremio, however, does…
Muffex
- 55
- 1
- 12
0
votes
1 answer
Query non-partitioned column on Entire Hive external Table
I have hive external table (s3 files stored in parquet format) created with spark about 30 GB in size and with few hundreds of partitions. However I need to query the data on a non partition column (say SUPPLIER_ID) to see complete transaction…
vall
- 1
- 1
0
votes
0 answers
Arrrow Flight to send RecordBatch Stream Bytpe Array as batch over python Rest Api Response
I have a result set as a stream of Arrow record batches,i have used reader.read_chunk() to get the batchs ,i have pushed the batches to batch array and convert it to bytearray as response .for that here is the code
def…
vikashsingh9
- 41
- 7