Instead of using a DAG plan generated by TEZ in Hive, I want to use custom DAG plan created by me. Is it Possible? If Yes, can anyone explain?
Asked
Active
Viewed 59 times
1 Answers
0
If you are using Hive for running queries then you cannot use custom DAG. If you do low level programming Tez application using API, you can. See High level docs here: https://hortonworks.com/blog/expressing-data-processing-in-apache-tez/
Something like this:
//Define DAG
DAG dag = new DAG();
Vertex map1 = new Vertex(MapProcessor.class)
and so on...
See apache project examples: https://git-wip-us.apache.org/repos/asf?p=tez.git;a=blob;f=tez-examples/src/main/java/org/apache/tez/examples/HashJoinExample.java

leftjoin
- 36,950
- 8
- 57
- 116