org.apache.hadoop.hive.ql.exec

Class UnionOperator

java.lang.Object

org.apache.hadoop.hive.ql.exec.Operator<UnionDesc>

org.apache.hadoop.hive.ql.exec.UnionOperator

All Implemented Interfaces:

Serializable, Cloneable, Node

public class UnionOperator
extends Operator<UnionDesc>
implements Serializable

Union Operator Just forwards. Doesn't do anything itself.

See Also:

Serialized Form

Nested Class Summary

Nested classes/interfaces inherited from class org.apache.hadoop.hive.ql.exec.Operator

Operator.Counter, Operator.OperatorFunc, Operator.State

Field Summary

Fields inherited from class org.apache.hadoop.hive.ql.exec.Operator

abortOp, alias, asyncInitOperations, bucketingVersion, cContext, childOperators, childOperatorsArray, childOperatorsTag, conf, CONTEXT_NAME_KEY, done, groupKeyObject, HIVE_COUNTER_CREATED_DYNAMIC_PARTITIONS, HIVE_COUNTER_CREATED_FILES, HIVE_COUNTER_FATAL, id, indexForTezUnion, inputObjInspectors, LOG, numRows, operatorId, out, outputObjInspector, parentOperators, reporter, runTimeNumRows, state, statsMap

Constructor Summary

Constructors

Modifier	Constructor and Description
protected	UnionOperator() Kryo ctor.
	UnionOperator(CompilationOpContext ctx)

Method Summary

Modifier and Type	Method and Description
String	getName() Gets the name of the node.
static String	getOperatorName()
org.apache.hadoop.hive.ql.plan.api.OperatorType	getType() Return the type of the specific operator among the types in OperatorType.
protected void	initializeOp(org.apache.hadoop.conf.Configuration hconf) UnionOperator will transform the input rows if the inputObjInspectors from different parents are different.
boolean	logicalEquals(Operator other) Decides whether two operators are logically the same.
boolean	opAllowedAfterMapJoin()
boolean	opAllowedBeforeMapJoin() Union operators are not allowed either before or after a explicit mapjoin hint.
boolean	opAllowedBeforeSortMergeJoin()
void	process(Object row, int tag) Process the row.

Methods inherited from class org.apache.hadoop.hive.ql.exec.Operator

abort, acceptLimitPushdown, allInitializedParentsAreClosed, areAllParentsInitialized, augmentPlan, cleanUpInputFileChanged, cleanUpInputFileChangedOp, clone, cloneOp, cloneRecursiveChildren, close, closeOp, columnNamesRowResolvedCanBeObtained, completeInitializationOp, createDummy, defaultEndGroup, defaultStartGroup, dump, dump, endGroup, flush, flushRecursive, forward, forward, forward, getAdditionalCounters, getBucketingVersion, getChildOperators, getChildren, getColumnExprMap, getCompilationOpContext, getConf, getConfiguration, getCounterName, getDone, getExecContext, getGroupKeyObject, getIdentifier, getIndexForTezUnion, getInputObjInspectors, getIsReduceSink, getMarker, getNextCntr, getNumChild, getNumParent, getOperatorId, getOpTraits, getOutputObjInspector, getParentOperators, getReduceOutputName, getSchema, getStatistics, getStats, initEvaluators, initEvaluators, initEvaluatorsAndReturnStruct, initialize, initialize, initializeChildren, initializeLocalWork, initOperatorId, isUseBucketizedHiveInputFormat, jobClose, jobCloseOp, logicalEqualsTree, logStats, opAllowedConvertMapJoin, passExecContext, preorderMap, processGroup, removeChild, removeChildAndAdoptItsChildren, removeParent, removeParents, replaceChild, replaceParent, reset, setAlias, setBucketingVersion, setChildOperators, setColumnExprMap, setCompilationOpContext, setConf, setDone, setExecContext, setGroupKeyObject, setIndexForTezUnion, setInputContext, setInputObjInspectors, setMarker, setNextVectorBatchGroupStatus, setOpTraits, setOutputCollector, setParentOperators, setReporter, setSchema, setStatistics, setUseBucketizedHiveInputFormat, startGroup, supportAutomaticSortMergeJoin, supportSkewJoinOptimization, supportUnionRemoveOptimization, toString, toString

Methods inherited from class java.lang.Object

equals, finalize, getClass, hashCode, notify, notifyAll, wait, wait, wait

Constructor Detail

UnionOperator

protected UnionOperator()

Kryo ctor.

UnionOperator

public UnionOperator(CompilationOpContext ctx)

Method Detail

initializeOp

protected void initializeOp(org.apache.hadoop.conf.Configuration hconf)
                     throws HiveException

UnionOperator will transform the input rows if the inputObjInspectors from different parents are different. If one parent has exactly the same ObjectInspector as the output ObjectInspector, then we don't need to do transformation for that parent. This information is recorded in needsTransform[].

Overrides:

initializeOp in class Operator<UnionDesc>

Throws:

HiveException

process

public void process(Object row,
                    int tag)
             throws HiveException

Description copied from class: Operator

Process the row.

Specified by:

process in class Operator<UnionDesc>

Parameters:

row - The object representing the row.

tag - The tag of the row usually means which parent this row comes from. Rows with the same tag should have exactly the same rowInspector all the time.

Throws:

HiveException

getName

public String getName()

Description copied from interface: Node

Gets the name of the node. This is used in the rule dispatchers.

Specified by:

getName in interface Node

Specified by:

getName in class Operator<UnionDesc>

Returns:

the name of the operator

getOperatorName

public static String getOperatorName()

getType

public org.apache.hadoop.hive.ql.plan.api.OperatorType getType()

Description copied from class: Operator

Return the type of the specific operator among the types in OperatorType.

Specified by:

getType in class Operator<UnionDesc>

Returns:

OperatorType.*

opAllowedBeforeMapJoin

public boolean opAllowedBeforeMapJoin()

Union operators are not allowed either before or after a explicit mapjoin hint. Note that, the same query would just work without the mapjoin hint (by setting hive.auto.convert.join to true).

Overrides:

opAllowedBeforeMapJoin in class Operator<UnionDesc>

opAllowedAfterMapJoin

public boolean opAllowedAfterMapJoin()

Overrides:

opAllowedAfterMapJoin in class Operator<UnionDesc>

opAllowedBeforeSortMergeJoin

public boolean opAllowedBeforeSortMergeJoin()

Overrides:

opAllowedBeforeSortMergeJoin in class Operator<UnionDesc>

logicalEquals

public boolean logicalEquals(Operator other)

Description copied from class: Operator

Decides whether two operators are logically the same. This can be used to merge same operators and avoid repeated computation.

Overrides:

logicalEquals in class Operator<UnionDesc>