1

In the latest version of drill, the dir columns are coming by default when giving a 'select *' on a parquet file. Is there a way we can disable them?

The query: 'Select * from dfs.`C:\Sample.parquet` where EmpID <>'null''

The result for the above query is coming as:

dir0 | dir1 | dir2 | dir3 | EmpID

I just need the EmpID column. But the dir columns are coming by default. Tested in drill 1.20.1 and 1.20.2 as well. Same resultset.

OneCricketeer
  • 179,855
  • 19
  • 132
  • 245
Rik
  • 81
  • 1
  • 15
  • If you only want one column, then don't use `Select *`. What happens when you run `Select EmpID`? – OneCricketeer Sep 23 '22 at 13:55
  • Thanks for the response @OneCricketeer. That was just for sample. The column would be dynamic in that parquet file. I need to use '*' to get the entire column set. – Rik Sep 26 '22 at 05:13

1 Answers1

3

the issue is fixed. If I changed the '\' to '/', then the result set is coming without any additional columns. Turns out '\' is an escape character in drill, which gives an unexpected result set. Not sure why it was not happening in earlier drill versions. Hope this helps. :)

Rik
  • 81
  • 1
  • 15