Questions tagged [apache-hive]

Apache Hive supports analysis of large datasets stored in Hadoop's HDFS and compatible file systems such as Amazon S3 filesystem. It provides an SQL-like language called HiveQL with schema on read and transparently converts queries to map/reduce, Apache Tez[7] and Spark jobs. All three execution engines can run in Hadoop YARN. To accelerate queries, it provides indexes, including bitmap indexes.

Few features:-

1.Indexing to provide acceleration, index type including compaction and Bitmap index as of 0.10, more index types are planned. 2.Different storage types such as plain text, RCFile, HBase, ORC, and others. 3.Metadata storage in an RDBMS, significantly reducing the time to perform semantic checks during query execution. 4.Operating on compressed data stored into the Hadoop ecosystem using algorithms including DEFLATE, BWT, snappy, etc. 5.Built-in user defined functions (UDFs) to manipulate dates, strings, and other data-mining tools. Hive supports extending the UDF set to handle use-cases not supported by built-in functions. 6.SQL-like queries (HiveQL), which are implicitly converted into MapReduce or Tez, or Spark jobs.

96 questions
2
votes
2 answers

Hive / SQL - Left join with fallback

In Apache Hive I have to tables I would like to left-join keeping all the data from the left data and adding data where possible from the right table. For this I use two joins, because the join is based on two fields (a material_id and a…
alpcoder
  • 61
  • 1
  • 6
2
votes
1 answer

Average count of elements in a set in hive?

I have two columns id and segment. Segment is comma separated set of strings. I need to find average number of segments in all the table. One way to do it is by using two separate queries - A - select count(*) from table_name; B - select count(*)…
BlitzKrieg
  • 791
  • 8
  • 15
2
votes
0 answers

hive-site.xml doesn't override default properties

I'm trying to override hive default properties by setting them in hive-site.xml but it's not taking any effect. Few things that might be helpful in debugging the problem: Environment…
2
votes
1 answer

CREATE TABLE command is not working in Hive query language

When I try to create a table in hive getting the following error message. Any idea why this is happening? hive> create table a (x int); FAILED: Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.DDLTask. MetaException(message:For…
Naveenan
  • 345
  • 1
  • 4
  • 16
2
votes
1 answer

Apache Hive getting error while using Python UDF

I am using Python user defined function in Apache hive to change characters from lower case character to upper case. I am getting error as "Hive Runtime Error while closing operators". Below are the query I tried: describe table1; OK item …
Green
  • 111
  • 1
  • 2
  • 7
2
votes
2 answers

Apache Hive client throw NoSuchFieldError: HIVE_CLI_SERVICE_PROTOCOL_V8

I need to connect Hive2 and retrive information from it. I am using apache HiveServer2 client to connect to Hive, in POM: org.apache.hive hive-jdbc
user3006967
  • 3,291
  • 10
  • 47
  • 72
2
votes
1 answer

how to drop partition metadata from hive, when partition is drop by using alter drop command

I have dropped the all the partitions in the hive table by using the alter command alter table emp drop partition (hiredate>'0'); After droping partitions still I can see the partitions metadata.How to delete this partition metadata? Can I use the…
marjun
  • 696
  • 5
  • 17
  • 30
1
vote
2 answers

Exception when starting Hive in Ambari in HDP 2.6

Error message: Caught an exception while executing custom service command: : [Errno 13] Permission denied: '/var/lib/ambari-agent/cred/conf/hive/hive-site.jceks'; [Errno 13] Permission denied:…
Stefan Papp
  • 2,199
  • 1
  • 28
  • 54
1
vote
0 answers

Connecting to Qlik Sense to Apache Hive

I would like to know , is there any other configuration that I can do to connect to Apache Hive from QlikSense, I am new to this, I would definitely appreciate if someone can help me to configure this. Thank you.
Hippie-pina
  • 81
  • 2
  • 12
1
vote
1 answer

Can not contact a hive table partition, after delete hdfs file related to partition

My Hadoop Cluster works batch job for every data at 11:00. The job creates hive table partition(ex. p_date=201702,p_domain=0) and import rdbms data to the hive table partition like ETL....(hive table is not external table) but the job has failed,…
Lee. YunSu
  • 416
  • 6
  • 21
1
vote
2 answers

Adding Local Files in Beeline (Hive)

I'm trying to add local files via the Beeline client, however I keep running into an issue where it tells me the file does not exist. [test@test-001 tmp]$ touch /tmp/m.py [test@test-001 tmp]$ stat /tmp/m.py File: ‘/tmp/m.py’ Size: 0 …
J.Fratzke
  • 1,415
  • 15
  • 23
1
vote
1 answer

Configure Apache Hive for LLAP without using slider

There's a new feature in hive called LLAP. During the investigation I've found out that it's quite difficult to configure LLAP so there's a component called Apache Slider that will configure it. Still I couldn't find any documentation for manual…
Vlad Gudikov
  • 103
  • 1
  • 7
1
vote
1 answer

How to rename all partition columns in hive

When I am trying to rename all partition columns in an existing table for date range of one year which are partitioned - this is what I am getting. hive> ALTER TABLE test.usage PARTITION ('date') RENAME TO PARTITION (partition_date); FAILED:…
hadoop
  • 45
  • 2
  • 5
1
vote
0 answers

Hiveserver Beeline Logging 2.0.1

I didnt get any log while connecting the Hiveserver with beeline and getting exception as ERROR StatusLogger No log4j2 configuration file found. Using default configurati on: logging only errors to the console. Because of that i cant able to Get…
karthik
  • 551
  • 7
  • 21
1
vote
1 answer

Spark with custom hive bindings

How can I build spark with current (hive 2.1) bindings instead of 1.2? http://spark.apache.org/docs/latest/building-spark.html#building-with-hive-and-jdbc-support Does not mention how this works. Does spark work well with hive 2.x?
Georg Heiler
  • 16,916
  • 36
  • 162
  • 292