org.apache.hadoop.hive.ql.exec.spark

Class HiveMapFunctionResultList

java.lang.Object

org.apache.hadoop.hive.ql.exec.spark.HiveBaseFunctionResultList<scala.Tuple2<org.apache.hadoop.io.BytesWritable,org.apache.hadoop.io.BytesWritable>>

org.apache.hadoop.hive.ql.exec.spark.HiveMapFunctionResultList

All Implemented Interfaces:

Serializable, Iterator, org.apache.hadoop.mapred.OutputCollector<HiveKey,org.apache.hadoop.io.BytesWritable>

public class HiveMapFunctionResultList
extends HiveBaseFunctionResultList<scala.Tuple2<org.apache.hadoop.io.BytesWritable,org.apache.hadoop.io.BytesWritable>>

See Also:

Serialized Form

Constructor Summary

Constructors

Constructor and Description
HiveMapFunctionResultList(Iterator<scala.Tuple2<org.apache.hadoop.io.BytesWritable,org.apache.hadoop.io.BytesWritable>> inputIterator, SparkRecordHandler handler) Instantiate result set Iterable for Map function output.

Method Summary

Modifier and Type	Method and Description
protected void	closeRecordProcessor() Close the record processor.
protected boolean	processingDone()
protected void	processNextRecord(scala.Tuple2<org.apache.hadoop.io.BytesWritable,org.apache.hadoop.io.BytesWritable> inputRecord) Process the given record.

Methods inherited from class org.apache.hadoop.hive.ql.exec.spark.HiveBaseFunctionResultList

collect, hasNext, next, remove

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface java.util.Iterator

forEachRemaining

Constructor Detail

HiveMapFunctionResultList

public HiveMapFunctionResultList(Iterator<scala.Tuple2<org.apache.hadoop.io.BytesWritable,org.apache.hadoop.io.BytesWritable>> inputIterator,
                                 SparkRecordHandler handler)

Instantiate result set Iterable for Map function output.

Parameters:

inputIterator - Input record iterator.

handler - Initialized SparkMapRecordHandler instance.

Method Detail

processNextRecord

protected void processNextRecord(scala.Tuple2<org.apache.hadoop.io.BytesWritable,org.apache.hadoop.io.BytesWritable> inputRecord)
                          throws IOException

Description copied from class: HiveBaseFunctionResultList

Process the given record.

Specified by:

processNextRecord in class HiveBaseFunctionResultList<scala.Tuple2<org.apache.hadoop.io.BytesWritable,org.apache.hadoop.io.BytesWritable>>

Throws:

IOException

processingDone

protected boolean processingDone()

Specified by:

processingDone in class HiveBaseFunctionResultList<scala.Tuple2<org.apache.hadoop.io.BytesWritable,org.apache.hadoop.io.BytesWritable>>

Returns:

true if current state of the record processor is done.

closeRecordProcessor

protected void closeRecordProcessor()

Description copied from class: HiveBaseFunctionResultList

Close the record processor.

Specified by:

closeRecordProcessor in class HiveBaseFunctionResultList<scala.Tuple2<org.apache.hadoop.io.BytesWritable,org.apache.hadoop.io.BytesWritable>>