Questions tagged [dremio]

64 questions
1
vote
2 answers

How to filter only a subset of data while maintain existing records as is in a table?

[SQL Novice] I have a table that looks like this: id date 1 2019-01-01 1 2019-01-02 2 2019-03-01 2 2019-05-01 I want to only filter the id column on 2 where date is between 2019-04-01…
RustyShackleford
  • 3,462
  • 9
  • 40
  • 81
1
vote
2 answers

How to only edit certain strings in column?

I have table in a sql table that looks like this: column 1 2 welcome from henry welcome from beth welcome 3 4 How do I only edit the values that have 'Welcome from' to become only 'Welcome'? New column: 1 2 welcome welcome welcome 3 4 I can not…
RustyShackleford
  • 3,462
  • 9
  • 40
  • 81
1
vote
1 answer

Is there any Dremio or Drill connection string for C# or .NET program user

I am using dremio to query a large amount of data and it is working very fine. It has rest API to fetch data but the only constraint is that it can give 500 records as a result. In java, Dremio community has given jdbc connection string but our…
0
votes
0 answers

Add a data source to Dremio

I tried to add a data source to Dremio which is a PostgreSQL database. the data base called "university-session1", and this is the message it displays: "Could not connect to university-session1, check your JDBC connection information and…
yuam
  • 1
0
votes
0 answers

How to fix a data fetching function in python using sql query?

I have developed a function which uses parametrized sql based on user input to fetch records. However, I am facing a type mismatch problem in the where clause of the query. please help me fix it. Start_Date and End_Date are string stype whereas…
0
votes
2 answers

Querying a SQL Table with over 10million rows

I have a table with over 10 million rows in Dremio. I have connected to it from Python PYODBC. I want to run a simple query like shown below: SELECT REPORTDATE, TRANSDATE FROM TABLE WHERE TRANSDATE = '2020-01-05' The issue is that it takes…
ravindu93
  • 1
  • 3
0
votes
0 answers

Dremio Rest API in Python - Connection Abort Error

I'm using Dremio Rest API in python, below is part of my code which is running fine for me. In the print data statement, I'm able to see my userid, email etc which indicates that code is running fine upto this point. import json import…
0
votes
0 answers

Spark3.2 write parquet files in spark2.3.1 format

Hello All I am experiencing new issue due to third party reader. I have written parquet files thru spark 3.2 but these parquet files can't be read by Dremio 20.4 version. I want to know do we have any flag or any way in spark 3.2 version , we can…
Prem S
  • 217
  • 3
  • 8
0
votes
1 answer

Dremio connection in snowflake

I'm new to Dremio. Could anyone help me with how to build dremio connection in snowflake. CREATE STAGE URL = 'http://:9047' CREDENTIALS = (USERNAME='' PASSWORD='') DATA_FORMAT = 'PARQUET' FILE_FORMAT = (TYPE = 'PARQUET') I…
0
votes
0 answers

Kubernetes - Helm install dremio - unexpected "\\" in operand

EDIT It looks like my error happenned because I was on powershell, should use a linux shell terminal to use helm I am testing Helm (version 3.1) for the first time with the official Dremio chart. So this…
0
votes
1 answer

SQL Query with Recursive Nature

Suppose I have a table with 2 columns: PURCHASE_DATE and…
0
votes
0 answers

How to normalize or flatten data string in Dremio?

I have a big dataset where each row is slightly different than the other. I’m trying to normalize those rows into a table using Dremio SQL. What is the best way or normalize the data? Example below Col A “!!” Hello World:hello hi:I’m…
0
votes
1 answer

Apache Arrow flight SQL from C# client

I am trying to develop a c# client code to query data using Apache Arrow Flight using basic auth, but not successful so far. I would appreciate if anyone can share a working sample. Thanks Manoj George
MKG
  • 23
  • 5
0
votes
1 answer

Can't connect superset to dremio

I am running apache-superset using docker-compose by following the instructions here (https://superset.apache.org/docs/installation/installing-superset-using-docker-compose/) using docker-compose-non-dev.yml. I have also added sqlalchemy-dremio to…
Max test
  • 11
  • 1
0
votes
1 answer

How to close pyarrow connection to Dremio?

I am using pyarrow to connect to the Dremio cloud and query the datasets. Documentation - https://docs.dremio.com/cloud/client-applications/python/ My question is how can I close the connection to Dremio after I finish the job?
idkman
  • 169
  • 1
  • 15