Questions tagged [dremio]

64 questions
0
votes
2 answers

Kubernetes copying jars into a pod and restart

I have a Kubernetes problem where I need to copy 2 jars (each jar > 1Mb) into a pod after it is deployed. So ideally the solution is we cannot use configMap (> 1Mb) but we need to use "wget" in "initcontainer" and download the jars. so below is my…
Gururaj Nayak
  • 636
  • 1
  • 9
  • 18
0
votes
1 answer

Add reflection using a script in dremio

I'm trying to create, update and delete a reflection (Raw/Aggregate) using a script on dremio data lake. Is it possible to do it in the community edition?
0
votes
1 answer

how to create a temp table in Dremio

I would like to create a temporary table as below in dremio Select ABC into #temp_table any advise?
user2251216
  • 13
  • 1
  • 5
0
votes
0 answers

Sql alchemy driver with spaces not parsing

I'm using the driver 'Dremio ODBC Driver 64-bit' however when I run: engine = create_engine("""{}+pyodbc://{}:{}@{}/""".format(driver,uid,pwd,host)) with driver = 'Dremio ODBC Driver 64-bit' I get the following error (I changed it to uid:pwd for…
0
votes
2 answers

How to save a query in Dremio?

Dremio provides a really nice GUI to download and save data generated after your query run. However, I want to save my query (instead of query result) in dremio so that I can anytime (in future) refer the query that I wrote. Is there a way to…
Sarvesh Pandey
  • 322
  • 7
  • 17
0
votes
0 answers

ExecutionSetupException: One or more nodes lost connectivity during query

While running a query on Dremio 4.6.1 installed on Kubernetes, we are getting the following error message from Dremio UI: ExecutionSetupException: One or more nodes lost connectivity during query. Identified nodes were…
Abba
  • 519
  • 6
  • 17
0
votes
2 answers

Dremio ODBC with Python

Getting below error while running this code in Python, If anyone could advise me on this that would be appreciated. Thanks dataframe = pandas.read_sql(sql,cnxn) DatabaseError: Execution failed on sql 'SELECT * FROM train_data': ('HY000', "[HY000]…
0
votes
1 answer

Python class declare by passing variables

I try to create an object by passing the variables, but it seems not work. I put a simple example below to show what I want. Please help me to deal with this issue. Successfully temp = catalog.TEST temp = catalog.PROD Not works, it pass string "i"…
carterlin
  • 15
  • 6
0
votes
3 answers

How to calculate last day of month per row in dremio?

I have a properly casted date column that I want to create a new column from that is that date of the last day of the month. Example: current_datefield end_of_month_date 2019-03-01 2019-03-31 2020-01-29 …
RustyShackleford
  • 3,462
  • 9
  • 40
  • 81
0
votes
1 answer

Dremio character set 'ISO-8859-1'

While running this simple query in Dremio: SELECT 'NBC Universal – NBC News' Data We got the following error message Failed to encode 'NBC Universal – NBC News' in character set 'ISO-8859-1' We tried setting saffron settings for character set with…
Abba
  • 519
  • 6
  • 17
0
votes
1 answer

Number of splits in dataset exceeds dataset split limit ,Dremio+Hive+Spark

We have a stack consisting of Hadoop+Hive+Spark+Dremio , since Spark writes many HDFS files for a single Hive partition (depending on workers) Dremio is failing when querying the table because the number of HDFS files limit is exceeded , is there…
Luis Leal
  • 3,388
  • 5
  • 26
  • 49
0
votes
1 answer

How to query 'empty text' field in dremio?

I have certain rows in columns that have the phrase 'empty text' in the cell of a table in dremio. When I try queries like: select col1 from table1 where col1 is null I get no results back for rows that have the text 'empty text' in them. How do…
RustyShackleford
  • 3,462
  • 9
  • 40
  • 81
0
votes
1 answer

How to convert raw vector from sqlQuery to a single string in dataframe?

In my workplace, R is integrated with Dremio and I can access the tables in Dremio using RODBC::sqlQuery() function. Tables are having around hundred thousand entries. I am creating data-frame of SQL tables using this function but some rows are…
hemant A
  • 185
  • 14
0
votes
1 answer

How to back fill data from a sql join only where count of field is equal to 1 while maintaning records from previous joins?

I have two tables I am able to join like so: select * from (select * from table1 t1 left join table2 t2 on t1.id = t2.id ) I want to add a third table where I group by email, to back fill data in the join above but I only want to backfill the data…
RustyShackleford
  • 3,462
  • 9
  • 40
  • 81
0
votes
0 answers

What is the meaning of regexp_split in dremio?

I have following code which I wrote in dremio. Could you please tell me what is the meaning of this syntax? I tried to find, but I couldn't. I followed the tutorial in dremio, but I need to know what are the other sql functions we can use in dremio,…
user
  • 145
  • 1
  • 2
  • 12