org.apache.hadoop.hive.ql.exec.spark

Class HiveBaseFunctionResultList<T>

java.lang.Object

org.apache.hadoop.hive.ql.exec.spark.HiveBaseFunctionResultList<T>

All Implemented Interfaces:

Serializable, Iterator, org.apache.hadoop.mapred.OutputCollector<HiveKey,org.apache.hadoop.io.BytesWritable>

Direct Known Subclasses:

HiveMapFunctionResultList, HiveReduceFunctionResultList

public abstract class HiveBaseFunctionResultList<T>
extends Object
implements Iterator, org.apache.hadoop.mapred.OutputCollector<HiveKey,org.apache.hadoop.io.BytesWritable>, Serializable

Base class for - collecting Map/Reduce function output and - providing an Iterable interface for fetching output records. Input records are processed in lazy fashion i.e when output records are requested through Iterator interface.

See Also:

Serialized Form

Constructor Summary

Constructors

Constructor and Description
HiveBaseFunctionResultList(Iterator<T> inputIterator)

Method Summary

Modifier and Type	Method and Description
protected abstract void	closeRecordProcessor() Close the record processor.
void	collect(HiveKey key, org.apache.hadoop.io.BytesWritable value)
boolean	hasNext()
scala.Tuple2<HiveKey,org.apache.hadoop.io.BytesWritable>	next()
protected abstract boolean	processingDone()
protected abstract void	processNextRecord(T inputRecord) Process the given record.
void	remove()

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface java.util.Iterator

forEachRemaining

Constructor Detail

HiveBaseFunctionResultList

public HiveBaseFunctionResultList(Iterator<T> inputIterator)

Method Detail

collect

public void collect(HiveKey key,
                    org.apache.hadoop.io.BytesWritable value)
             throws IOException

Specified by:

collect in interface org.apache.hadoop.mapred.OutputCollector<HiveKey,org.apache.hadoop.io.BytesWritable>

Throws:

IOException

processNextRecord

protected abstract void processNextRecord(T inputRecord)
                                   throws IOException

Process the given record.

Throws:

IOException

processingDone

protected abstract boolean processingDone()

Returns:

true if current state of the record processor is done.

closeRecordProcessor

protected abstract void closeRecordProcessor()

Close the record processor.

hasNext

public boolean hasNext()

Specified by:

hasNext in interface Iterator

next

public scala.Tuple2<HiveKey,org.apache.hadoop.io.BytesWritable> next()

Specified by:

next in interface Iterator

remove

public void remove()

Specified by:

remove in interface Iterator