org.apache.hadoop.hive.ql.exec.spark

Class HiveMapFunction

java.lang.Object

org.apache.hadoop.hive.ql.exec.spark.HivePairFlatMapFunction<Iterator<scala.Tuple2<org.apache.hadoop.io.BytesWritable,org.apache.hadoop.io.BytesWritable>>,HiveKey,org.apache.hadoop.io.BytesWritable>

org.apache.hadoop.hive.ql.exec.spark.HiveMapFunction

All Implemented Interfaces:

Serializable, org.apache.spark.api.java.function.PairFlatMapFunction<Iterator<scala.Tuple2<org.apache.hadoop.io.BytesWritable,org.apache.hadoop.io.BytesWritable>>,HiveKey,org.apache.hadoop.io.BytesWritable>

public class HiveMapFunction
extends HivePairFlatMapFunction<Iterator<scala.Tuple2<org.apache.hadoop.io.BytesWritable,org.apache.hadoop.io.BytesWritable>>,HiveKey,org.apache.hadoop.io.BytesWritable>

See Also:

Serialized Form

Field Summary

Fields inherited from class org.apache.hadoop.hive.ql.exec.spark.HivePairFlatMapFunction

jobConf, sparkReporter

Constructor Summary

Constructors

Constructor and Description
HiveMapFunction(byte[] jobConfBuffer, SparkReporter sparkReporter)

Method Summary

Modifier and Type	Method and Description
Iterator<scala.Tuple2<HiveKey,org.apache.hadoop.io.BytesWritable>>	call(Iterator<scala.Tuple2<org.apache.hadoop.io.BytesWritable,org.apache.hadoop.io.BytesWritable>> it)
protected boolean	isMap()

Methods inherited from class org.apache.hadoop.hive.ql.exec.spark.HivePairFlatMapFunction

initJobConf

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

HiveMapFunction

public HiveMapFunction(byte[] jobConfBuffer,
                       SparkReporter sparkReporter)

Method Detail

call

public Iterator<scala.Tuple2<HiveKey,org.apache.hadoop.io.BytesWritable>> call(Iterator<scala.Tuple2<org.apache.hadoop.io.BytesWritable,org.apache.hadoop.io.BytesWritable>> it)
                                                                        throws Exception

Throws:

Exception

isMap

protected boolean isMap()

Specified by:

isMap in class HivePairFlatMapFunction<Iterator<scala.Tuple2<org.apache.hadoop.io.BytesWritable,org.apache.hadoop.io.BytesWritable>>,HiveKey,org.apache.hadoop.io.BytesWritable>