0

Instead of using a DAG plan generated by TEZ in Hive, I want to use custom DAG plan created by me. Is it Possible? If Yes, can anyone explain?

Ramprakash
  • 151
  • 1
  • 8

1 Answers1

0

If you are using Hive for running queries then you cannot use custom DAG. If you do low level programming Tez application using API, you can. See High level docs here: https://hortonworks.com/blog/expressing-data-processing-in-apache-tez/

Something like this:

//Define DAG
DAG dag = new DAG();
Vertex map1 = new Vertex(MapProcessor.class) 
and so on...

See apache project examples: https://git-wip-us.apache.org/repos/asf?p=tez.git;a=blob;f=tez-examples/src/main/java/org/apache/tez/examples/HashJoinExample.java

leftjoin
  • 36,950
  • 8
  • 57
  • 116