org.apache.hadoop.hive.ql.exec.vector

Class VectorMapJoinOperator

java.lang.Object

org.apache.hadoop.hive.ql.exec.Operator<T>

org.apache.hadoop.hive.ql.exec.CommonJoinOperator<T>

org.apache.hadoop.hive.ql.exec.AbstractMapJoinOperator<MapJoinDesc>

org.apache.hadoop.hive.ql.exec.MapJoinOperator

org.apache.hadoop.hive.ql.exec.vector.VectorMapJoinBaseOperator

org.apache.hadoop.hive.ql.exec.vector.VectorMapJoinOperator

All Implemented Interfaces:

Serializable, Cloneable, VectorizationContextRegion, VectorizationOperator, Node

public class VectorMapJoinOperator
extends VectorMapJoinBaseOperator

The vectorized version of the MapJoinOperator.

See Also:

Serialized Form

Nested Class Summary

Nested classes/interfaces inherited from class org.apache.hadoop.hive.ql.exec.Operator

Operator.Counter, Operator.OperatorFunc, Operator.State

Field Summary

Fields

Modifier and Type	Field and Description
protected VectorExpression[]	bigTableFilterExpressions
protected VectorExpression[]	bigTableValueExpressions
protected VectorExpression[]	keyExpressions
protected Object[]	singleRow

Fields inherited from class org.apache.hadoop.hive.ql.exec.vector.VectorMapJoinBaseOperator

outputBatch, outputVectorAssignRowMap, scratchBatch, tag, vContext, vectorDesc, vOutContext, vrbCtx

Fields inherited from class org.apache.hadoop.hive.ql.exec.MapJoinOperator

firstSmallTable, hashMapRowGetters, isTestingNoHashTableLoad, loader, mapJoinTables, spilledMapJoinTables

Fields inherited from class org.apache.hadoop.hive.ql.exec.AbstractMapJoinOperator

emptyList, joinKeys, joinKeysObjectInspectors, posBigTable

Fields inherited from class org.apache.hadoop.hive.ql.exec.CommonJoinOperator

alias, aliasFilterTags, condn, countAfterReport, dummyObj, dummyObjVectors, filterMaps, filterTags, forwardCache, heartbeatInterval, intermediate, joinFilterObjectInspectors, joinFilters, joinValues, joinValuesObjectInspectors, joinValuesStandardObjectInspectors, needsPostEvaluation, noOuterJoin, NOTSKIPBIGTABLE, nullsafes, numAliases, offsets, order, residualJoinFilters, residualJoinFiltersOIs, rowContainerPostFilteredOuterJoin, rowContainerStandardObjectInspectors, skipVectors, spillTableDesc, totalSz

Fields inherited from class org.apache.hadoop.hive.ql.exec.Operator

abortOp, asyncInitOperations, bucketingVersion, cContext, childOperators, childOperatorsArray, childOperatorsTag, conf, CONTEXT_NAME_KEY, done, groupKeyObject, HIVE_COUNTER_CREATED_DYNAMIC_PARTITIONS, HIVE_COUNTER_CREATED_FILES, HIVE_COUNTER_FATAL, id, indexForTezUnion, inputObjInspectors, numRows, operatorId, out, outputObjInspector, parentOperators, reporter, runTimeNumRows, state, statsMap

Constructor Summary

Constructors

Constructor and Description
VectorMapJoinOperator() Kryo ctor.
VectorMapJoinOperator(CompilationOpContext ctx)
VectorMapJoinOperator(CompilationOpContext ctx, OperatorDesc conf, VectorizationContext vContext, VectorDesc vectorDesc)

Method Summary

Modifier and Type	Method and Description
void	initializeOp(org.apache.hadoop.conf.Configuration hconf) Operator specific initialization.
void	process(Object row, int tag) Process the row.
protected JoinUtil.JoinResult	setMapJoinKey(MapJoinTableContainer.ReusableGetAdaptor dest, Object row, byte alias)
protected void	spillBigTableRow(MapJoinTableContainer hybridHtContainer, Object row) Postpone processing the big table row temporarily by spilling it to a row container

Methods inherited from class org.apache.hadoop.hive.ql.exec.vector.VectorMapJoinBaseOperator

closeOp, getInputVectorizationContext, getOutputTypeInfos, getOutputVectorizationContext, getVectorDesc, internalForward, reProcessBigTable

Methods inherited from class org.apache.hadoop.hive.ql.exec.MapJoinOperator

canSkipJoinProcessing, canSkipReload, cleanUpInputFileChangedOp, completeInitializationOp, endGroup, generateMapMetaData, getCacheKey, getHashTableLoader, getName, getOperatorName, getRefKey, getType, getValueObjectInspectors, isInputFileChangeSensitive, loadHashTable, reloadHashTable, setTestMapJoinTableContainer, startGroup

Methods inherited from class org.apache.hadoop.hive.ql.exec.CommonJoinOperator

checkAndGenObject, getFilteredValue, getFilterTag, getNextSize, getPosToAliasMap, hasFilter, opAllowedAfterMapJoin, opAllowedBeforeMapJoin, reportProgress, setPosToAliasMap

Methods inherited from class org.apache.hadoop.hive.ql.exec.Operator

abort, acceptLimitPushdown, allInitializedParentsAreClosed, areAllParentsInitialized, augmentPlan, cleanUpInputFileChanged, clone, cloneOp, cloneRecursiveChildren, close, columnNamesRowResolvedCanBeObtained, createDummy, defaultEndGroup, defaultStartGroup, dump, dump, flush, flushRecursive, forward, forward, forward, getAdditionalCounters, getBucketingVersion, getChildOperators, getChildren, getColumnExprMap, getCompilationOpContext, getConf, getConfiguration, getCounterName, getDone, getExecContext, getGroupKeyObject, getIdentifier, getIndexForTezUnion, getInputObjInspectors, getIsReduceSink, getMarker, getNextCntr, getNumChild, getNumParent, getOperatorId, getOpTraits, getOutputObjInspector, getParentOperators, getReduceOutputName, getSchema, getStatistics, getStats, initEvaluators, initEvaluators, initEvaluatorsAndReturnStruct, initialize, initialize, initializeChildren, initializeLocalWork, initOperatorId, isUseBucketizedHiveInputFormat, jobClose, jobCloseOp, logicalEquals, logicalEqualsTree, logStats, opAllowedBeforeSortMergeJoin, opAllowedConvertMapJoin, passExecContext, preorderMap, processGroup, removeChild, removeChildAndAdoptItsChildren, removeParent, removeParents, replaceChild, replaceParent, reset, setAlias, setBucketingVersion, setChildOperators, setColumnExprMap, setCompilationOpContext, setConf, setDone, setExecContext, setGroupKeyObject, setIndexForTezUnion, setInputContext, setInputObjInspectors, setMarker, setNextVectorBatchGroupStatus, setOpTraits, setOutputCollector, setParentOperators, setReporter, setSchema, setStatistics, setUseBucketizedHiveInputFormat, supportAutomaticSortMergeJoin, supportSkewJoinOptimization, supportUnionRemoveOptimization, toString, toString

Methods inherited from class java.lang.Object

equals, finalize, getClass, hashCode, notify, notifyAll, wait, wait, wait

Field Detail

keyExpressions

protected VectorExpression[] keyExpressions

bigTableFilterExpressions

protected VectorExpression[] bigTableFilterExpressions

bigTableValueExpressions

protected VectorExpression[] bigTableValueExpressions

singleRow

protected transient Object[] singleRow

Constructor Detail

VectorMapJoinOperator

public VectorMapJoinOperator()

Kryo ctor.

VectorMapJoinOperator

public VectorMapJoinOperator(CompilationOpContext ctx)

VectorMapJoinOperator

public VectorMapJoinOperator(CompilationOpContext ctx,
                             OperatorDesc conf,
                             VectorizationContext vContext,
                             VectorDesc vectorDesc)
                      throws HiveException

Throws:

HiveException

Method Detail

initializeOp

public void initializeOp(org.apache.hadoop.conf.Configuration hconf)
                  throws HiveException

Description copied from class: Operator

Operator specific initialization.

Overrides:

initializeOp in class VectorMapJoinBaseOperator

Throws:

HiveException

setMapJoinKey

protected JoinUtil.JoinResult setMapJoinKey(MapJoinTableContainer.ReusableGetAdaptor dest,
                                            Object row,
                                            byte alias)
                                     throws HiveException

Overrides:

setMapJoinKey in class MapJoinOperator

Throws:

HiveException

process

public void process(Object row,
                    int tag)
             throws HiveException

Description copied from class: Operator

Process the row.

Overrides:

process in class MapJoinOperator

Parameters:

row - The object representing the row.

tag - The tag of the row usually means which parent this row comes from. Rows with the same tag should have exactly the same rowInspector all the time.

Throws:

HiveException

spillBigTableRow

protected void spillBigTableRow(MapJoinTableContainer hybridHtContainer,
                                Object row)
                         throws HiveException

Description copied from class: MapJoinOperator

Postpone processing the big table row temporarily by spilling it to a row container

Overrides:

spillBigTableRow in class MapJoinOperator

Parameters:

hybridHtContainer - Hybrid hashtable container

row - big table row

Throws:

HiveException