org.apache.hadoop.hive.ql.exec.spark

Class SortByShuffler

java.lang.Object

org.apache.hadoop.hive.ql.exec.spark.SortByShuffler

All Implemented Interfaces:

SparkShuffler<org.apache.hadoop.io.BytesWritable>

public class SortByShuffler
extends Object
implements SparkShuffler<org.apache.hadoop.io.BytesWritable>

Constructor Summary

Constructors

Constructor and Description
SortByShuffler(boolean totalOrder, SparkPlan sparkPlan)

Method Summary

Modifier and Type	Method and Description
String	getName()
org.apache.spark.api.java.JavaPairRDD<HiveKey,org.apache.hadoop.io.BytesWritable>	shuffle(org.apache.spark.api.java.JavaPairRDD<HiveKey,org.apache.hadoop.io.BytesWritable> input, int numPartitions)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

SortByShuffler

public SortByShuffler(boolean totalOrder,
                      SparkPlan sparkPlan)

Parameters:

totalOrder - whether this shuffler provides total order shuffle.

Method Detail

shuffle

public org.apache.spark.api.java.JavaPairRDD<HiveKey,org.apache.hadoop.io.BytesWritable> shuffle(org.apache.spark.api.java.JavaPairRDD<HiveKey,org.apache.hadoop.io.BytesWritable> input,
                                                                                                 int numPartitions)

Specified by:

shuffle in interface SparkShuffler<org.apache.hadoop.io.BytesWritable>

getName

public String getName()

Specified by:

getName in interface SparkShuffler<org.apache.hadoop.io.BytesWritable>