org.apache.hadoop.hive.ql.exec.vector

Class VectorSparkPartitionPruningSinkOperator

java.lang.Object

org.apache.hadoop.hive.ql.exec.Operator<SparkPartitionPruningSinkDesc>

org.apache.hadoop.hive.ql.parse.spark.SparkPartitionPruningSinkOperator

org.apache.hadoop.hive.ql.exec.vector.VectorSparkPartitionPruningSinkOperator

All Implemented Interfaces:

Serializable, Cloneable, VectorizationOperator, Node

public class VectorSparkPartitionPruningSinkOperator
extends SparkPartitionPruningSinkOperator
implements VectorizationOperator

Vectorized version for SparkPartitionPruningSinkOperator. Forked from VectorAppMasterEventOperator.

See Also:

Serialized Form

Nested Class Summary

Nested classes/interfaces inherited from class org.apache.hadoop.hive.ql.exec.Operator

Operator.Counter, Operator.OperatorFunc, Operator.State

Field Summary

Fields

Modifier and Type	Field and Description
protected boolean	firstBatch
protected Object[]	singleRow
protected VectorExtractRow	vectorExtractRow

Fields inherited from class org.apache.hadoop.hive.ql.parse.spark.SparkPartitionPruningSinkOperator

buffer, LOG, serializer

Fields inherited from class org.apache.hadoop.hive.ql.exec.Operator

abortOp, alias, asyncInitOperations, bucketingVersion, cContext, childOperators, childOperatorsArray, childOperatorsTag, conf, CONTEXT_NAME_KEY, done, groupKeyObject, HIVE_COUNTER_CREATED_DYNAMIC_PARTITIONS, HIVE_COUNTER_CREATED_FILES, HIVE_COUNTER_FATAL, id, indexForTezUnion, inputObjInspectors, numRows, operatorId, out, outputObjInspector, parentOperators, reporter, runTimeNumRows, state, statsMap

Constructor Summary

Constructors

Constructor and Description
VectorSparkPartitionPruningSinkOperator() Kryo ctor.
VectorSparkPartitionPruningSinkOperator(CompilationOpContext ctx)
VectorSparkPartitionPruningSinkOperator(CompilationOpContext ctx, OperatorDesc conf, VectorizationContext context, VectorDesc vectorDesc)

Method Summary

Modifier and Type	Method and Description
VectorizationContext	getInputVectorizationContext()
VectorDesc	getVectorDesc()
void	initializeOp(org.apache.hadoop.conf.Configuration hconf) Operator specific initialization.
void	process(Object data, int tag) Process the row.

Methods inherited from class org.apache.hadoop.hive.ql.parse.spark.SparkPartitionPruningSinkOperator

addAsSourceEvent, closeOp, getBranchingOp, getName, getOperatorName, getType, getUniqueId, isWithMapjoin, removeFromSourceEvent, setUniqueId

Methods inherited from class org.apache.hadoop.hive.ql.exec.Operator

abort, acceptLimitPushdown, allInitializedParentsAreClosed, areAllParentsInitialized, augmentPlan, cleanUpInputFileChanged, cleanUpInputFileChangedOp, clone, cloneOp, cloneRecursiveChildren, close, columnNamesRowResolvedCanBeObtained, completeInitializationOp, createDummy, defaultEndGroup, defaultStartGroup, dump, dump, endGroup, flush, flushRecursive, forward, forward, forward, getAdditionalCounters, getBucketingVersion, getChildOperators, getChildren, getColumnExprMap, getCompilationOpContext, getConf, getConfiguration, getCounterName, getDone, getExecContext, getGroupKeyObject, getIdentifier, getIndexForTezUnion, getInputObjInspectors, getIsReduceSink, getMarker, getNextCntr, getNumChild, getNumParent, getOperatorId, getOpTraits, getOutputObjInspector, getParentOperators, getReduceOutputName, getSchema, getStatistics, getStats, initEvaluators, initEvaluators, initEvaluatorsAndReturnStruct, initialize, initialize, initializeChildren, initializeLocalWork, initOperatorId, isUseBucketizedHiveInputFormat, jobClose, jobCloseOp, logicalEquals, logicalEqualsTree, logStats, opAllowedAfterMapJoin, opAllowedBeforeMapJoin, opAllowedBeforeSortMergeJoin, opAllowedConvertMapJoin, passExecContext, preorderMap, processGroup, removeChild, removeChildAndAdoptItsChildren, removeParent, removeParents, replaceChild, replaceParent, reset, setAlias, setBucketingVersion, setChildOperators, setColumnExprMap, setCompilationOpContext, setConf, setDone, setExecContext, setGroupKeyObject, setIndexForTezUnion, setInputContext, setInputObjInspectors, setMarker, setNextVectorBatchGroupStatus, setOpTraits, setOutputCollector, setParentOperators, setReporter, setSchema, setStatistics, setUseBucketizedHiveInputFormat, startGroup, supportAutomaticSortMergeJoin, supportSkewJoinOptimization, supportUnionRemoveOptimization, toString, toString

Methods inherited from class java.lang.Object

equals, finalize, getClass, hashCode, notify, notifyAll, wait, wait, wait

Field Detail

firstBatch

protected transient boolean firstBatch

vectorExtractRow

protected transient VectorExtractRow vectorExtractRow

singleRow

protected transient Object[] singleRow

Constructor Detail

VectorSparkPartitionPruningSinkOperator

public VectorSparkPartitionPruningSinkOperator(CompilationOpContext ctx,
                                               OperatorDesc conf,
                                               VectorizationContext context,
                                               VectorDesc vectorDesc)

VectorSparkPartitionPruningSinkOperator

public VectorSparkPartitionPruningSinkOperator()

Kryo ctor.

VectorSparkPartitionPruningSinkOperator

public VectorSparkPartitionPruningSinkOperator(CompilationOpContext ctx)

Method Detail

getInputVectorizationContext

public VectorizationContext getInputVectorizationContext()

Specified by:

getInputVectorizationContext in interface VectorizationOperator

initializeOp

public void initializeOp(org.apache.hadoop.conf.Configuration hconf)
                  throws HiveException

Description copied from class: Operator

Operator specific initialization.

Overrides:

initializeOp in class SparkPartitionPruningSinkOperator

Throws:

HiveException

process

public void process(Object data,
                    int tag)
             throws HiveException

Description copied from class: Operator

Process the row.

Overrides:

process in class SparkPartitionPruningSinkOperator

Parameters:

data - The object representing the row.

tag - The tag of the row usually means which parent this row comes from. Rows with the same tag should have exactly the same rowInspector all the time.

Throws:

HiveException

getVectorDesc

public VectorDesc getVectorDesc()

Specified by:

getVectorDesc in interface VectorizationOperator