Questions tagged [totalorderpartitioner]
3 questions
1
vote
1 answer
MapReduce TotalOrderPartitioning writes output to only to one file?
I am running a mapreduce job which read the input and sorts it using multiple reduces.
I am able to get the output sorted with the number of reducers to be 5. However, the output is written to only 1 file and have 4 empty files along with it.
I am…
Ankita Sambhare
- 11
- 1
1
vote
1 answer
Unable to use TotalOrderPartitioner with Hive: Can't read partitions file
We are trying to use generate HBase Hfiles for bulk loading from Hive. Our main problem is that when using the
org.apache.hadoop.mapred.lib.TotalOrderPartitioner;
it cannot find the custom partitioner file:
java.lang.IllegalArgumentException:…
kentt
- 543
- 5
- 12
1
vote
1 answer
TotalOrderPartitioner and mrjob
How does one specify the TotalOrderPartitioner when using mrjob? Is this the default, or must it be specified explicitly? I've seen inconsistent behavior on different data sets.
vy32
- 28,461
- 37
- 122
- 246