org.apache.hadoop.hive.ql.exec

Class HashTableSinkOperator

java.lang.Object

org.apache.hadoop.hive.ql.exec.Operator<T>

org.apache.hadoop.hive.ql.exec.TerminalOperator<HashTableSinkDesc>

org.apache.hadoop.hive.ql.exec.HashTableSinkOperator

All Implemented Interfaces:

Serializable, Cloneable, Node

Direct Known Subclasses:

TemporaryHashSinkOperator

public class HashTableSinkOperator
extends TerminalOperator<HashTableSinkDesc>
implements Serializable

See Also:

Serialized Form

Nested Class Summary

Nested classes/interfaces inherited from class org.apache.hadoop.hive.ql.exec.Operator

Operator.Counter, Operator.OperatorFunc, Operator.State

Field Summary

Fields

Modifier and Type	Field and Description
protected SessionState.LogHelper	console
protected org.apache.hadoop.conf.Configuration	hconf
protected static org.slf4j.Logger	LOG
protected MapJoinPersistableTableContainer[]	mapJoinTables
protected MapJoinTableContainerSerDe[]	mapJoinTableSerdes

Fields inherited from class org.apache.hadoop.hive.ql.exec.Operator

abortOp, alias, asyncInitOperations, bucketingVersion, cContext, childOperators, childOperatorsArray, childOperatorsTag, conf, CONTEXT_NAME_KEY, done, groupKeyObject, HIVE_COUNTER_CREATED_DYNAMIC_PARTITIONS, HIVE_COUNTER_CREATED_FILES, HIVE_COUNTER_FATAL, id, indexForTezUnion, inputObjInspectors, numRows, operatorId, out, outputObjInspector, parentOperators, reporter, runTimeNumRows, state, statsMap

Constructor Summary

Constructors

Modifier	Constructor and Description
protected	HashTableSinkOperator() Kryo ctor.
	HashTableSinkOperator(CompilationOpContext ctx)
	HashTableSinkOperator(CompilationOpContext ctx, MapJoinOperator mjop)

Method Summary

Modifier and Type	Method and Description
void	closeOp(boolean abort) Operator specific close routine.
protected void	flushToFile()
MapJoinTableContainer[]	getMapJoinTables()
String	getName() Implements the getName function for the Node Interface.
static String	getOperatorName()
org.apache.hadoop.hive.ql.plan.api.OperatorType	getType() Return the type of the specific operator among the types in OperatorType.
protected void	initializeOp(org.apache.hadoop.conf.Configuration hconf) Operator specific initialization.
void	process(Object row, int tag) Process the row.

Methods inherited from class org.apache.hadoop.hive.ql.exec.Operator

abort, acceptLimitPushdown, allInitializedParentsAreClosed, areAllParentsInitialized, augmentPlan, cleanUpInputFileChanged, cleanUpInputFileChangedOp, clone, cloneOp, cloneRecursiveChildren, close, columnNamesRowResolvedCanBeObtained, completeInitializationOp, createDummy, defaultEndGroup, defaultStartGroup, dump, dump, endGroup, flush, flushRecursive, forward, forward, forward, getAdditionalCounters, getBucketingVersion, getChildOperators, getChildren, getColumnExprMap, getCompilationOpContext, getConf, getConfiguration, getCounterName, getDone, getExecContext, getGroupKeyObject, getIdentifier, getIndexForTezUnion, getInputObjInspectors, getIsReduceSink, getMarker, getNextCntr, getNumChild, getNumParent, getOperatorId, getOpTraits, getOutputObjInspector, getParentOperators, getReduceOutputName, getSchema, getStatistics, getStats, initEvaluators, initEvaluators, initEvaluatorsAndReturnStruct, initialize, initialize, initializeChildren, initializeLocalWork, initOperatorId, isUseBucketizedHiveInputFormat, jobClose, jobCloseOp, logicalEquals, logicalEqualsTree, logStats, opAllowedAfterMapJoin, opAllowedBeforeMapJoin, opAllowedBeforeSortMergeJoin, opAllowedConvertMapJoin, passExecContext, preorderMap, processGroup, removeChild, removeChildAndAdoptItsChildren, removeParent, removeParents, replaceChild, replaceParent, reset, setAlias, setBucketingVersion, setChildOperators, setColumnExprMap, setCompilationOpContext, setConf, setDone, setExecContext, setGroupKeyObject, setIndexForTezUnion, setInputContext, setInputObjInspectors, setMarker, setNextVectorBatchGroupStatus, setOpTraits, setOutputCollector, setParentOperators, setReporter, setSchema, setStatistics, setUseBucketizedHiveInputFormat, startGroup, supportAutomaticSortMergeJoin, supportSkewJoinOptimization, supportUnionRemoveOptimization, toString, toString

Methods inherited from class java.lang.Object

equals, finalize, getClass, hashCode, notify, notifyAll, wait, wait, wait

Field Detail

LOG

protected static final org.slf4j.Logger LOG

hconf

protected org.apache.hadoop.conf.Configuration hconf

mapJoinTables

protected transient MapJoinPersistableTableContainer[] mapJoinTables

mapJoinTableSerdes

protected transient MapJoinTableContainerSerDe[] mapJoinTableSerdes

console

protected transient SessionState.LogHelper console

Constructor Detail

HashTableSinkOperator

protected HashTableSinkOperator()

Kryo ctor.

HashTableSinkOperator

public HashTableSinkOperator(CompilationOpContext ctx)

HashTableSinkOperator

public HashTableSinkOperator(CompilationOpContext ctx,
                             MapJoinOperator mjop)

Method Detail

initializeOp

protected void initializeOp(org.apache.hadoop.conf.Configuration hconf)
                     throws HiveException

Description copied from class: Operator

Operator specific initialization.

Overrides:

initializeOp in class Operator<HashTableSinkDesc>

Throws:

HiveException

getMapJoinTables

public MapJoinTableContainer[] getMapJoinTables()

process

public void process(Object row,
                    int tag)
             throws HiveException

Description copied from class: Operator

Process the row.

Specified by:

process in class Operator<HashTableSinkDesc>

Parameters:

row - The object representing the row.

tag - The tag of the row usually means which parent this row comes from. Rows with the same tag should have exactly the same rowInspector all the time.

Throws:

HiveException

closeOp

public void closeOp(boolean abort)
             throws HiveException

Description copied from class: Operator

Operator specific close routine. Operators which inherents this class should overwrite this funtion for their specific cleanup routine.

Overrides:

closeOp in class Operator<HashTableSinkDesc>

Throws:

HiveException

flushToFile

protected void flushToFile()
                    throws IOException,
                           HiveException

Throws:

IOException

HiveException

getName

public String getName()

Implements the getName function for the Node Interface.

Specified by:

getName in interface Node

Overrides:

getName in class TerminalOperator<HashTableSinkDesc>

Returns:

the name of the operator

getOperatorName

public static String getOperatorName()

getType

public org.apache.hadoop.hive.ql.plan.api.OperatorType getType()

Description copied from class: Operator

Return the type of the specific operator among the types in OperatorType.

Specified by:

getType in class Operator<HashTableSinkDesc>

Returns:

OperatorType.*