org.apache.hadoop.hive.ql.exec.spark

Class SparkMergeFileRecordHandler

java.lang.Object

org.apache.hadoop.hive.ql.exec.spark.SparkRecordHandler

org.apache.hadoop.hive.ql.exec.spark.SparkMergeFileRecordHandler

public class SparkMergeFileRecordHandler
extends SparkRecordHandler

Copied from MergeFileMapper. As MergeFileMapper is very similar to ExecMapper, this class is very similar to SparkMapRecordHandler

Field Summary

Fields inherited from class org.apache.hadoop.hive.ql.exec.spark.SparkRecordHandler

abort, anyRow, CLASS_NAME, jc, memoryMXBean, oc, perfLogger, rp

Constructor Summary

Constructors

Constructor and Description
SparkMergeFileRecordHandler()

Method Summary

Modifier and Type	Method and Description
void	close()
boolean	getDone()
<K,V> void	init(org.apache.hadoop.mapred.JobConf job, org.apache.hadoop.mapred.OutputCollector<K,V> output, org.apache.hadoop.mapred.Reporter reporter)
<E> void	processRow(Object key, Iterator<E> values) Process row with key and value collection.
void	processRow(Object key, Object value) Process row with key and single value.

Methods inherited from class org.apache.hadoop.hive.ql.exec.spark.SparkRecordHandler

isAbort, logCloseInfo, logMemoryInfo, setAbort

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

SparkMergeFileRecordHandler

public SparkMergeFileRecordHandler()

Method Detail

init

public <K,V> void init(org.apache.hadoop.mapred.JobConf job,
                       org.apache.hadoop.mapred.OutputCollector<K,V> output,
                       org.apache.hadoop.mapred.Reporter reporter)
                throws Exception

Overrides:

init in class SparkRecordHandler

Throws:

Exception

processRow

public void processRow(Object key,
                       Object value)
                throws IOException

Description copied from class: SparkRecordHandler

Process row with key and single value.

Specified by:

processRow in class SparkRecordHandler

Throws:

IOException

processRow

public <E> void processRow(Object key,
                           Iterator<E> values)
                    throws IOException

Description copied from class: SparkRecordHandler

Process row with key and value collection.

Specified by:

processRow in class SparkRecordHandler

Throws:

IOException

close

public void close()

Specified by:

close in class SparkRecordHandler

getDone

public boolean getDone()

Specified by:

getDone in class SparkRecordHandler