Questions tagged [dremio]
64 questions
0
votes
2 answers
Kubernetes copying jars into a pod and restart
I have a Kubernetes problem where I need to copy 2 jars (each jar > 1Mb) into a pod after it is deployed. So ideally the solution is we cannot use configMap (> 1Mb) but we need to use "wget" in "initcontainer" and download the jars.
so below is my…

Gururaj Nayak
- 636
- 1
- 9
- 18
0
votes
1 answer
Add reflection using a script in dremio
I'm trying to create, update and delete a reflection (Raw/Aggregate) using a script on dremio data lake. Is it possible to do it in the community edition?

Rusiru Kanchane
- 77
- 1
- 6
0
votes
1 answer
how to create a temp table in Dremio
I would like to create a temporary table as below in dremio
Select ABC into #temp_table
any advise?

user2251216
- 13
- 1
- 5
0
votes
0 answers
Sql alchemy driver with spaces not parsing
I'm using the driver 'Dremio ODBC Driver 64-bit' however when I run:
engine = create_engine("""{}+pyodbc://{}:{}@{}/""".format(driver,uid,pwd,host))
with driver = 'Dremio ODBC Driver 64-bit' I get the following error (I changed it to uid:pwd for…

Maximilian Powers
- 25
- 5
0
votes
2 answers
How to save a query in Dremio?
Dremio provides a really nice GUI to download and save data generated after your query run.
However, I want to save my query (instead of query result) in dremio so that I can anytime (in future) refer the query that I wrote. Is there a way to…

Sarvesh Pandey
- 322
- 7
- 17
0
votes
0 answers
ExecutionSetupException: One or more nodes lost connectivity during query
While running a query on Dremio 4.6.1 installed on Kubernetes, we are getting the following error message from Dremio UI:
ExecutionSetupException: One or more nodes lost connectivity during query. Identified nodes were…

Abba
- 519
- 6
- 17
0
votes
2 answers
Dremio ODBC with Python
Getting below error while running this code in Python, If anyone could advise me on this that would be appreciated. Thanks
dataframe = pandas.read_sql(sql,cnxn)
DatabaseError: Execution failed on sql 'SELECT * FROM train_data': ('HY000', "[HY000]…

Jemima Jeyakumar
- 89
- 11
0
votes
1 answer
Python class declare by passing variables
I try to create an object by passing the variables, but it seems not work.
I put a simple example below to show what I want. Please help me to deal with this issue.
Successfully
temp = catalog.TEST
temp = catalog.PROD
Not works, it pass string "i"…

carterlin
- 15
- 6
0
votes
3 answers
How to calculate last day of month per row in dremio?
I have a properly casted date column that I want to create a new column from that is that date of the last day of the month.
Example:
current_datefield end_of_month_date
2019-03-01 2019-03-31
2020-01-29 …

RustyShackleford
- 3,462
- 9
- 40
- 81
0
votes
1 answer
Dremio character set 'ISO-8859-1'
While running this simple query in Dremio:
SELECT 'NBC Universal – NBC News' Data
We got the following error message
Failed to encode 'NBC Universal – NBC News' in character set 'ISO-8859-1'
We tried setting saffron settings for character set with…

Abba
- 519
- 6
- 17
0
votes
1 answer
Number of splits in dataset exceeds dataset split limit ,Dremio+Hive+Spark
We have a stack consisting of Hadoop+Hive+Spark+Dremio , since Spark writes many HDFS files for a single Hive partition (depending on workers) Dremio is failing when querying the table because the number of HDFS files limit is exceeded , is there…

Luis Leal
- 3,388
- 5
- 26
- 49
0
votes
1 answer
How to query 'empty text' field in dremio?
I have certain rows in columns that have the phrase 'empty text' in the cell of a table in dremio.
When I try queries like:
select col1 from table1 where col1 is null
I get no results back for rows that have the text 'empty text' in them.
How do…

RustyShackleford
- 3,462
- 9
- 40
- 81
0
votes
1 answer
How to convert raw vector from sqlQuery to a single string in dataframe?
In my workplace, R is integrated with Dremio and I can access the tables in Dremio using RODBC::sqlQuery() function. Tables are having around hundred thousand entries. I am creating data-frame of SQL tables using this function but some rows are…

hemant A
- 185
- 14
0
votes
1 answer
How to back fill data from a sql join only where count of field is equal to 1 while maintaning records from previous joins?
I have two tables I am able to join like so:
select * from
(select * from table1 t1
left join table2 t2 on t1.id = t2.id )
I want to add a third table where I group by email, to back fill data in the join above but I only want to backfill the data…

RustyShackleford
- 3,462
- 9
- 40
- 81
0
votes
0 answers
What is the meaning of regexp_split in dremio?
I have following code which I wrote in dremio.
Could you please tell me what is the meaning of this syntax? I tried to find, but I couldn't. I followed the tutorial in dremio, but I need to know what are the other sql functions we can use in dremio,…

user
- 145
- 1
- 2
- 12