org.apache.hadoop.hive.ql.exec.spark

Class HiveReduceFunctionResultList<V>

java.lang.Object

org.apache.hadoop.hive.ql.exec.spark.HiveBaseFunctionResultList<scala.Tuple2<HiveKey,V>>

org.apache.hadoop.hive.ql.exec.spark.HiveReduceFunctionResultList<V>

All Implemented Interfaces:

Serializable, Iterator, org.apache.hadoop.mapred.OutputCollector<HiveKey,org.apache.hadoop.io.BytesWritable>

public class HiveReduceFunctionResultList<V>
extends HiveBaseFunctionResultList<scala.Tuple2<HiveKey,V>>

See Also:

Serialized Form

Constructor Summary

Constructors

Constructor and Description
HiveReduceFunctionResultList(Iterator<scala.Tuple2<HiveKey,V>> inputIterator, SparkReduceRecordHandler reducer) Instantiate result set Iterable for Reduce function output.

Method Summary

Modifier and Type	Method and Description
protected void	closeRecordProcessor() Close the record processor.
protected boolean	processingDone()
protected void	processNextRecord(scala.Tuple2<HiveKey,V> inputRecord) Process the given record.

Methods inherited from class org.apache.hadoop.hive.ql.exec.spark.HiveBaseFunctionResultList

collect, hasNext, next, remove

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface java.util.Iterator

forEachRemaining

Constructor Detail

HiveReduceFunctionResultList

public HiveReduceFunctionResultList(Iterator<scala.Tuple2<HiveKey,V>> inputIterator,
                                    SparkReduceRecordHandler reducer)

Instantiate result set Iterable for Reduce function output.

Parameters:

inputIterator - Input record iterator.

reducer - Initialized ExecReducer instance.

Method Detail

processNextRecord

protected void processNextRecord(scala.Tuple2<HiveKey,V> inputRecord)
                          throws IOException

Description copied from class: HiveBaseFunctionResultList

Process the given record.

Specified by:

processNextRecord in class HiveBaseFunctionResultList<scala.Tuple2<HiveKey,V>>

Throws:

IOException

processingDone

protected boolean processingDone()

Specified by:

processingDone in class HiveBaseFunctionResultList<scala.Tuple2<HiveKey,V>>

Returns:

true if current state of the record processor is done.

closeRecordProcessor

protected void closeRecordProcessor()

Description copied from class: HiveBaseFunctionResultList

Close the record processor.

Specified by:

closeRecordProcessor in class HiveBaseFunctionResultList<scala.Tuple2<HiveKey,V>>