org.apache.hadoop.hive.ql.exec.vector

Class VectorGroupByOperator

java.lang.Object

org.apache.hadoop.hive.ql.exec.Operator<GroupByDesc>

org.apache.hadoop.hive.ql.exec.vector.VectorGroupByOperator

All Implemented Interfaces:

Serializable, Cloneable, IConfigureJobConf, VectorizationContextRegion, VectorizationOperator, Node

public class VectorGroupByOperator
extends Operator<GroupByDesc>
implements VectorizationOperator, VectorizationContextRegion, IConfigureJobConf

Vectorized GROUP BY operator implementation. Consumes the vectorized input and stores the aggregate operators' intermediate states. Emits row mode output.

See Also:

Serialized Form

Nested Class Summary

Nested classes/interfaces inherited from class org.apache.hadoop.hive.ql.exec.Operator

Operator.Counter, Operator.OperatorFunc, Operator.State

Field Summary

Fields inherited from class org.apache.hadoop.hive.ql.exec.Operator

abortOp, alias, asyncInitOperations, bucketingVersion, cContext, childOperators, childOperatorsArray, childOperatorsTag, conf, CONTEXT_NAME_KEY, done, groupKeyObject, HIVE_COUNTER_CREATED_DYNAMIC_PARTITIONS, HIVE_COUNTER_CREATED_FILES, HIVE_COUNTER_FATAL, id, indexForTezUnion, inputObjInspectors, numRows, operatorId, out, outputObjInspector, parentOperators, reporter, runTimeNumRows, state, statsMap

Constructor Summary

Constructors

Constructor and Description
VectorGroupByOperator() Kryo ctor.
VectorGroupByOperator(CompilationOpContext ctx)
VectorGroupByOperator(CompilationOpContext ctx, OperatorDesc conf, VectorizationContext vContext, VectorDesc vectorDesc)

Method Summary

Modifier and Type	Method and Description
void	closeOp(boolean aborted) Operator specific close routine.
void	configureJobConf(org.apache.hadoop.mapred.JobConf job)
void	endGroup()
VectorAggregateExpression[]	getAggregators()
VectorizationContext	getInputVectorizationContext()
VectorExpression[]	getKeyExpressions()
String	getName() Gets the name of the node.
static String	getOperatorName()
VectorizationContext	getOutputVectorizationContext()
org.apache.hadoop.hive.ql.plan.api.OperatorType	getType() Return the type of the specific operator among the types in OperatorType.
VectorDesc	getVectorDesc()
protected void	initializeOp(org.apache.hadoop.conf.Configuration hconf) Operator specific initialization.
void	process(Object row, int tag) Process the row.
void	setAggregators(VectorAggregateExpression[] aggregators)
void	setKeyExpressions(VectorExpression[] keyExpressions)
void	setNextVectorBatchGroupStatus(boolean isLastGroupBatch)
void	startGroup()

Methods inherited from class org.apache.hadoop.hive.ql.exec.Operator

abort, acceptLimitPushdown, allInitializedParentsAreClosed, areAllParentsInitialized, augmentPlan, cleanUpInputFileChanged, cleanUpInputFileChangedOp, clone, cloneOp, cloneRecursiveChildren, close, columnNamesRowResolvedCanBeObtained, completeInitializationOp, createDummy, defaultEndGroup, defaultStartGroup, dump, dump, flush, flushRecursive, forward, forward, forward, getAdditionalCounters, getBucketingVersion, getChildOperators, getChildren, getColumnExprMap, getCompilationOpContext, getConf, getConfiguration, getCounterName, getDone, getExecContext, getGroupKeyObject, getIdentifier, getIndexForTezUnion, getInputObjInspectors, getIsReduceSink, getMarker, getNextCntr, getNumChild, getNumParent, getOperatorId, getOpTraits, getOutputObjInspector, getParentOperators, getReduceOutputName, getSchema, getStatistics, getStats, initEvaluators, initEvaluators, initEvaluatorsAndReturnStruct, initialize, initialize, initializeChildren, initializeLocalWork, initOperatorId, isUseBucketizedHiveInputFormat, jobClose, jobCloseOp, logicalEquals, logicalEqualsTree, logStats, opAllowedAfterMapJoin, opAllowedBeforeMapJoin, opAllowedBeforeSortMergeJoin, opAllowedConvertMapJoin, passExecContext, preorderMap, processGroup, removeChild, removeChildAndAdoptItsChildren, removeParent, removeParents, replaceChild, replaceParent, reset, setAlias, setBucketingVersion, setChildOperators, setColumnExprMap, setCompilationOpContext, setConf, setDone, setExecContext, setGroupKeyObject, setIndexForTezUnion, setInputContext, setInputObjInspectors, setMarker, setOpTraits, setOutputCollector, setParentOperators, setReporter, setSchema, setStatistics, setUseBucketizedHiveInputFormat, supportAutomaticSortMergeJoin, supportSkewJoinOptimization, supportUnionRemoveOptimization, toString, toString

Methods inherited from class java.lang.Object

equals, finalize, getClass, hashCode, notify, notifyAll, wait, wait, wait

Constructor Detail

VectorGroupByOperator

public VectorGroupByOperator(CompilationOpContext ctx,
                             OperatorDesc conf,
                             VectorizationContext vContext,
                             VectorDesc vectorDesc)
                      throws HiveException

Throws:

HiveException

VectorGroupByOperator

public VectorGroupByOperator()

Kryo ctor.

VectorGroupByOperator

public VectorGroupByOperator(CompilationOpContext ctx)

Method Detail

getInputVectorizationContext

public VectorizationContext getInputVectorizationContext()

Specified by:

getInputVectorizationContext in interface VectorizationOperator

initializeOp

protected void initializeOp(org.apache.hadoop.conf.Configuration hconf)
                     throws HiveException

Description copied from class: Operator

Operator specific initialization.

Overrides:

initializeOp in class Operator<GroupByDesc>

Throws:

HiveException

setNextVectorBatchGroupStatus

public void setNextVectorBatchGroupStatus(boolean isLastGroupBatch)
                                   throws HiveException

Overrides:

setNextVectorBatchGroupStatus in class Operator<GroupByDesc>

Throws:

HiveException

startGroup

public void startGroup()
                throws HiveException

Overrides:

startGroup in class Operator<GroupByDesc>

Throws:

HiveException

endGroup

public void endGroup()
              throws HiveException

Overrides:

endGroup in class Operator<GroupByDesc>

Throws:

HiveException

process

public void process(Object row,
                    int tag)
             throws HiveException

Description copied from class: Operator

Process the row.

Specified by:

process in class Operator<GroupByDesc>

Parameters:

row - The object representing the row.

tag - The tag of the row usually means which parent this row comes from. Rows with the same tag should have exactly the same rowInspector all the time.

Throws:

HiveException

closeOp

public void closeOp(boolean aborted)
             throws HiveException

Description copied from class: Operator

Operator specific close routine. Operators which inherents this class should overwrite this funtion for their specific cleanup routine.

Overrides:

closeOp in class Operator<GroupByDesc>

Throws:

HiveException

getKeyExpressions

public VectorExpression[] getKeyExpressions()

setKeyExpressions

public void setKeyExpressions(VectorExpression[] keyExpressions)

getAggregators

public VectorAggregateExpression[] getAggregators()

setAggregators

public void setAggregators(VectorAggregateExpression[] aggregators)

getOutputVectorizationContext

public VectorizationContext getOutputVectorizationContext()

Specified by:

getOutputVectorizationContext in interface VectorizationContextRegion

getType

public org.apache.hadoop.hive.ql.plan.api.OperatorType getType()

Description copied from class: Operator

Return the type of the specific operator among the types in OperatorType.

Specified by:

getType in class Operator<GroupByDesc>

Returns:

OperatorType.*

getName

public String getName()

Description copied from interface: Node

Gets the name of the node. This is used in the rule dispatchers.

Specified by:

getName in interface Node

Specified by:

getName in class Operator<GroupByDesc>

Returns:

String

getOperatorName

public static String getOperatorName()

getVectorDesc

public VectorDesc getVectorDesc()

Specified by:

getVectorDesc in interface VectorizationOperator

configureJobConf

public void configureJobConf(org.apache.hadoop.mapred.JobConf job)

Specified by:

configureJobConf in interface IConfigureJobConf