Stack Overflow
Stack Overflow

Questions tagged [apache-tez]

The Apache Tez project is aimed at building an application framework which allows for a complex directed-acyclic-graph of tasks for processing data.

The Apache Tez project is aimed at building an application framework which allows for a complex directed-acyclic-graph of tasks for processing data. It is currently built atop Apache Hadoop YARN

See Hive-on-Tez configuration properties.

192 questions
0
votes
0 answers

Hive CLI with Tez failed due to localization of Resources

when launching Hive CLI it failed with below Log 2023-07-08 10:00:46,822 INFO [main] tez.DagUtils (DagUtils.java:localizeResource(1159)) - Localizing resource because it does not exist: file:/home/hadoop/tez/tez.0.10 to dest:…
Kaher
  • 3
  • 1
0
votes
1 answer

Hive with TEZ failed to start Hive CLI

Dears, Apache Hive 3.1.2 with Hadoop 3.1.1 was working fine with until i configured Hive with Tez based on this doc :[ https://github.com/NitinKumar94/Installing-Apache-Tez] it always gives this error, i tried many solutions with no luck …
Kaher
  • 3
  • 1
0
votes
0 answers

Reduce number tez mappers during runtime

In map reduce engine, we can control the number of mappers using the following config: mapred.tasktracker.map.tasks.maximum How to achieve the same using tez? My goal is to load csv data into a table at the same time keeping the order of data. As…
Anonymous Duck
  • 2,942
  • 1
  • 12
  • 35
0
votes
1 answer

Vertex issue occuring while executing query

Receiving vertex issue while executing a query. Error: Error while compiling statement: FAILED: Execution Error, return code 2 from org.apache.hadoop.hive.ql.exec.tez.TezTask. Vertex failed, vertexName=Map 3,…
Ahmad Hussain
  • 1
0
votes
0 answers

In which scenario, disable Hadoop vectorized execution better than enabling it

Vectorization in Hive is a feature (available from Hive 0.13.0) that when enabled rather than reading one row at a time reads a block on 1024 rows. This improves the CPU Usage for operations like, scan, filter, join, and aggregations. It's only…
The Anh Nguyen
  • 748
  • 2
  • 11
  • 27
0
votes
2 answers

Why does the tez engine also add a reduce phase to the simplest insert statement, and how to remove it through configuration?

This is the hive-sql: insert into my_orc_table_25 select * from my_orc_table limit 5; And these are the schemas: CREATE TABLE my_orc_table ( id INT, name STRING ) STORED AS ORC; CREATE TABLE my_orc_table_25 as select id,name from…
user21579832
  • 1
  • 1
0
votes
0 answers

Why does a Hive MAP JOIN operator run on a Reducer?

I have: set hive.exec.dynamic.partition.mode=nonstrict; set hive.tez.container.size=8192; set tez.runtime.io.sort.mb=3276; set tez.runtime.unordered.output.buffer.size-mb=819; set hive.auto.convert.join=true; set…
dz902
  • 4,782
  • 38
  • 41
0
votes
1 answer

Error running tez in hive. Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.tez.TezTask

Hadoop 3.3.5 Hive 3.1.3 Tez 0.10.2 I follow the instruction in this link to build tez 0.10.2 for hadoop 3.3.5: https://tez.apache.org/install.html The db is stored on s3 bucket and I am able to run 'select count(*) from m1.t1' using…
user21214141
  • 1
  • 1
0
votes
0 answers

Hive query using tez stucks at Launching Job 1 out of 1

I have set up hadoop single node and tested hive query on 10gb using tez engine, which was working fine. After loading 6 tb data, query stuck at Launching Job 1 out of 1. And hive log says Tez system stage…
user2894607
  • 165
  • 4
  • 14
0
votes
0 answers

How to increase vcores per container in tez task?

I am trying to configure vcores per container for tez task. I have edited the property tez.task.resource.cpu.vcores but tez is not taking the value, it always allocates one vcore per requested container. How to increase vcores per container in tez?
asukhwal9
  • 9
0
votes
0 answers

How to set up tez ui with remote timeline server url in config.js?

Currently i am trying to configure tez-ui. I have put the tez ui web server on tomcat and running it as a service. When i am editing the timeline url with ip:8188 instead of localhost in /opt/tomcat/webapps/tez-ui/config/config.js file, it is…
asukhwal9
  • 9
0
votes
0 answers

what different edge color in tez-ui's DAG means？gray，yellow。

In the above pic, you can see two different edge color, yellow(map11 to reduce4) and gray(map9 to gray reduce4), what the difference betweent these two.
jiazhen Liu
  • 11
  • 1
0
votes
1 answer

How can i run multiple queries in parallel on hive with tez execution engine?

We want to run hive with tez for querying data in hdfs as multiple users will query hive so we need to configure hive in such a way so that the queries get executed in parallel As tez uses yarn for assigning resources to multiple nodes, we are…
asukhwal9
  • 9
0
votes
1 answer

hive start tez who fails to connect to yarn

I have installed an hadoop cluster with one master and 3 nodes. hadoop v 3.2.1, hive 3.1.2 and tez 0.10.0 I verified conf files and I can't find why tez is trying to connect to yarn throw localhost:18032 yarn is configured to be on…
Jeannot77680
  • 49
  • 6
0
votes
0 answers

FAILED: Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.tez.TezTask

There is some empty table. I can make select queries on it, but when I try to insert some rows I get this error FAILED: Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.tez.TezTask I tried different values for…
PrintScreenSys
  • 53
  • 6
1 2 3
…
12 13