org.apache.hadoop.hive.ql.exec.vector

Class VectorSMBMapJoinOperator

java.lang.Object

org.apache.hadoop.hive.ql.exec.Operator<T>

org.apache.hadoop.hive.ql.exec.CommonJoinOperator<T>

org.apache.hadoop.hive.ql.exec.AbstractMapJoinOperator<SMBJoinDesc>

org.apache.hadoop.hive.ql.exec.SMBMapJoinOperator

org.apache.hadoop.hive.ql.exec.vector.VectorSMBMapJoinOperator

All Implemented Interfaces:

Serializable, Cloneable, VectorizationContextRegion, VectorizationOperator, Node

public class VectorSMBMapJoinOperator
extends SMBMapJoinOperator
implements VectorizationOperator, VectorizationContextRegion

VectorSMBJoinOperator. Implements the vectorized SMB join operator. The implementation relies on the row-mode SMB join operator. It accepts a vectorized batch input from the big table and iterates over the batch, calling the parent row-mode implementation for each row in the batch.

See Also:

Serialized Form

Nested Class Summary

Nested classes/interfaces inherited from class org.apache.hadoop.hive.ql.exec.Operator

Operator.Counter, Operator.OperatorFunc, Operator.State

Field Summary

Fields inherited from class org.apache.hadoop.hive.ql.exec.AbstractMapJoinOperator

emptyList, joinKeys, joinKeysObjectInspectors, posBigTable

Fields inherited from class org.apache.hadoop.hive.ql.exec.CommonJoinOperator

alias, aliasFilterTags, condn, countAfterReport, dummyObj, dummyObjVectors, filterMaps, filterTags, forwardCache, hconf, heartbeatInterval, intermediate, joinFilterObjectInspectors, joinFilters, joinValues, joinValuesObjectInspectors, joinValuesStandardObjectInspectors, needsPostEvaluation, noOuterJoin, NOTSKIPBIGTABLE, nullsafes, numAliases, offsets, order, residualJoinFilters, residualJoinFiltersOIs, rowContainerPostFilteredOuterJoin, rowContainerStandardObjectInspectors, skipVectors, spillTableDesc, totalSz

Fields inherited from class org.apache.hadoop.hive.ql.exec.Operator

abortOp, asyncInitOperations, bucketingVersion, cContext, childOperators, childOperatorsArray, childOperatorsTag, conf, CONTEXT_NAME_KEY, done, groupKeyObject, HIVE_COUNTER_CREATED_DYNAMIC_PARTITIONS, HIVE_COUNTER_CREATED_FILES, HIVE_COUNTER_FATAL, id, indexForTezUnion, inputObjInspectors, numRows, operatorId, out, outputObjInspector, parentOperators, reporter, runTimeNumRows, state, statsMap

Constructor Summary

Constructors

Constructor and Description
VectorSMBMapJoinOperator() Kryo ctor.
VectorSMBMapJoinOperator(CompilationOpContext ctx)
VectorSMBMapJoinOperator(CompilationOpContext ctx, OperatorDesc conf, VectorizationContext vContext, VectorDesc vectorDesc)

Method Summary

Modifier and Type	Method and Description
void	closeOp(boolean aborted) All done.
VectorizationContext	getInputVectorizationContext()
VectorizationContext	getOutputVectorizationContext()
VectorDesc	getVectorDesc()
protected void	initializeOp(org.apache.hadoop.conf.Configuration hconf) Operator specific initialization.
protected void	internalForward(Object row, ObjectInspector outputOI)
void	process(Object row, int tag) Process the row.
protected List<Object>	smbJoinComputeKeys(Object row, byte alias)

Methods inherited from class org.apache.hadoop.hive.ql.exec.SMBMapJoinOperator

allInitializedParentsAreClosed, cleanUpInputFileChangedOp, getName, getOperatorName, getType, initializeLocalWork, initializeMapredLocalWork, isConvertedAutomaticallySMBJoin, opAllowedConvertMapJoin, setConvertedAutomaticallySMBJoin

Methods inherited from class org.apache.hadoop.hive.ql.exec.AbstractMapJoinOperator

getValueObjectInspectors

Methods inherited from class org.apache.hadoop.hive.ql.exec.CommonJoinOperator

checkAndGenObject, endGroup, getFilteredValue, getFilterTag, getNextSize, getPosToAliasMap, hasFilter, opAllowedAfterMapJoin, opAllowedBeforeMapJoin, reportProgress, setPosToAliasMap, startGroup

Methods inherited from class org.apache.hadoop.hive.ql.exec.Operator

abort, acceptLimitPushdown, areAllParentsInitialized, augmentPlan, cleanUpInputFileChanged, clone, cloneOp, cloneRecursiveChildren, close, columnNamesRowResolvedCanBeObtained, completeInitializationOp, createDummy, defaultEndGroup, defaultStartGroup, dump, dump, flush, flushRecursive, forward, forward, forward, getAdditionalCounters, getBucketingVersion, getChildOperators, getChildren, getColumnExprMap, getCompilationOpContext, getConf, getConfiguration, getCounterName, getDone, getExecContext, getGroupKeyObject, getIdentifier, getIndexForTezUnion, getInputObjInspectors, getIsReduceSink, getMarker, getNextCntr, getNumChild, getNumParent, getOperatorId, getOpTraits, getOutputObjInspector, getParentOperators, getReduceOutputName, getSchema, getStatistics, getStats, initEvaluators, initEvaluators, initEvaluatorsAndReturnStruct, initialize, initialize, initializeChildren, initOperatorId, isUseBucketizedHiveInputFormat, jobClose, jobCloseOp, logicalEquals, logicalEqualsTree, logStats, opAllowedBeforeSortMergeJoin, passExecContext, preorderMap, processGroup, removeChild, removeChildAndAdoptItsChildren, removeParent, removeParents, replaceChild, replaceParent, reset, setAlias, setBucketingVersion, setChildOperators, setColumnExprMap, setCompilationOpContext, setConf, setDone, setExecContext, setGroupKeyObject, setIndexForTezUnion, setInputContext, setInputObjInspectors, setMarker, setNextVectorBatchGroupStatus, setOpTraits, setOutputCollector, setParentOperators, setReporter, setSchema, setStatistics, setUseBucketizedHiveInputFormat, supportAutomaticSortMergeJoin, supportSkewJoinOptimization, supportUnionRemoveOptimization, toString, toString

Methods inherited from class java.lang.Object

equals, finalize, getClass, hashCode, notify, notifyAll, wait, wait, wait

Constructor Detail

VectorSMBMapJoinOperator

public VectorSMBMapJoinOperator()

Kryo ctor.

VectorSMBMapJoinOperator

public VectorSMBMapJoinOperator(CompilationOpContext ctx)

VectorSMBMapJoinOperator

public VectorSMBMapJoinOperator(CompilationOpContext ctx,
                                OperatorDesc conf,
                                VectorizationContext vContext,
                                VectorDesc vectorDesc)
                         throws HiveException

Throws:

HiveException

Method Detail

getInputVectorizationContext

public VectorizationContext getInputVectorizationContext()

Specified by:

getInputVectorizationContext in interface VectorizationOperator

smbJoinComputeKeys

protected List<Object> smbJoinComputeKeys(Object row,
                                          byte alias)
                                   throws HiveException

Overrides:

smbJoinComputeKeys in class SMBMapJoinOperator

Throws:

HiveException

initializeOp

protected void initializeOp(org.apache.hadoop.conf.Configuration hconf)
                     throws HiveException

Description copied from class: Operator

Operator specific initialization.

Overrides:

initializeOp in class SMBMapJoinOperator

Throws:

HiveException

process

public void process(Object row,
                    int tag)
             throws HiveException

Description copied from class: Operator

Process the row.

Overrides:

process in class SMBMapJoinOperator

Parameters:

row - The object representing the row.

tag - The tag of the row usually means which parent this row comes from. Rows with the same tag should have exactly the same rowInspector all the time.

Throws:

HiveException

closeOp

public void closeOp(boolean aborted)
             throws HiveException

Description copied from class: CommonJoinOperator

All done.

Overrides:

closeOp in class SMBMapJoinOperator

Throws:

HiveException

internalForward

protected void internalForward(Object row,
                               ObjectInspector outputOI)
                        throws HiveException

Overrides:

internalForward in class CommonJoinOperator<SMBJoinDesc>

Throws:

HiveException

getOutputVectorizationContext

public VectorizationContext getOutputVectorizationContext()

Specified by:

getOutputVectorizationContext in interface VectorizationContextRegion

getVectorDesc

public VectorDesc getVectorDesc()

Specified by:

getVectorDesc in interface VectorizationOperator