org.apache.hadoop.hive.ql.exec

Class PTFOperator

java.lang.Object

org.apache.hadoop.hive.ql.exec.Operator<PTFDesc>

org.apache.hadoop.hive.ql.exec.PTFOperator

All Implemented Interfaces:

Serializable, Cloneable, Node

public class PTFOperator
extends Operator<PTFDesc>
implements Serializable

See Also:

Serialized Form

Nested Class Summary

Nested classes/interfaces inherited from class org.apache.hadoop.hive.ql.exec.Operator

Operator.OperatorFunc, Operator.State

Field Summary

Fields

Modifier and Type	Field and Description
protected KeyWrapper	currentKeys
protected KeyWrapper	newKeys

Fields inherited from class org.apache.hadoop.hive.ql.exec.Operator

alias, childOperators, childOperatorsArray, childOperatorsTag, colExprMap, conf, CONTEXT_NAME_KEY, done, groupKeyObject, HIVECOUNTERCREATEDFILES, HIVECOUNTERFATAL, id, inputObjInspectors, isLogDebugEnabled, isLogInfoEnabled, isLogTraceEnabled, LOG, operatorId, out, outputObjInspector, parentOperators, PLOG, reporter, state, statsMap

Constructor Summary

Constructors

Constructor and Description
PTFOperator()

Method Summary

Methods

Modifier and Type	Method and Description
protected void	closeOp(boolean abort) Operator specific close routine.
static void	connectLeadLagFunctionsToPartition(PTFDesc ptfDesc, PTFPartition.PTFPartitionIterator<Object> pItr)
String	getName() Implements the getName function for the Node Interface.
static String	getOperatorName()
OperatorType	getType() Return the type of the specific operator among the types in OperatorType.
protected Collection<Future<?>>	initializeOp(org.apache.hadoop.conf.Configuration jobConf) Operator specific initialization.
void	process(Object row, int tag) Process the row.
protected void	reconstructQueryDef(org.apache.hadoop.conf.Configuration hiveConf) Initialize the visitor to use the QueryDefDeserializer Use the order defined in QueryDefWalker to visit the QueryDef
protected void	setupKeysWrapper(ObjectInspector inputOI)

Methods inherited from class org.apache.hadoop.hive.ql.exec.Operator

acceptLimitPushdown, allInitializedParentsAreClosed, areAllParentsInitialized, augmentPlan, cleanUpInputFileChanged, cleanUpInputFileChangedOp, clone, cloneOp, cloneRecursiveChildren, close, columnNamesRowResolvedCanBeObtained, completeInitializationOp, createDummy, defaultEndGroup, defaultStartGroup, dump, dump, endGroup, flush, forward, getAdditionalCounters, getChildOperators, getChildren, getColumnExprMap, getConf, getConfiguration, getDone, getExecContext, getGroupKeyObject, getIdentifier, getInputObjInspectors, getNextCntr, getNumChild, getNumParent, getOperatorId, getOpTraits, getOutputObjInspector, getParentOperators, getSchema, getStatistics, getStats, initEvaluators, initEvaluators, initEvaluatorsAndReturnStruct, initialize, initialize, initializeChildren, initializeLocalWork, initOperatorId, isUseBucketizedHiveInputFormat, jobClose, jobCloseOp, logStats, opAllowedAfterMapJoin, opAllowedBeforeMapJoin, opAllowedBeforeSortMergeJoin, opAllowedConvertMapJoin, passExecContext, preorderMap, processGroup, removeChild, removeChildAndAdoptItsChildren, removeChildren, removeParent, replaceChild, replaceParent, reset, resetId, resetStats, setAlias, setChildOperators, setColumnExprMap, setConf, setDone, setExecContext, setGroupKeyObject, setId, setInputContext, setInputObjInspectors, setOperatorId, setOpTraits, setOutputCollector, setParentOperators, setReporter, setSchema, setStatistics, setUseBucketizedHiveInputFormat, startGroup, supportAutomaticSortMergeJoin, supportSkewJoinOptimization, supportUnionRemoveOptimization, toString, toString

Methods inherited from class java.lang.Object

equals, finalize, getClass, hashCode, notify, notifyAll, wait, wait, wait

Field Detail

currentKeys

protected transient KeyWrapper currentKeys

newKeys

protected transient KeyWrapper newKeys

Constructor Detail

PTFOperator

public PTFOperator()

Method Detail

initializeOp

protected Collection<Future<?>> initializeOp(org.apache.hadoop.conf.Configuration jobConf)
                                      throws HiveException

Description copied from class: Operator

Operator specific initialization.

Overrides:

initializeOp in class Operator<PTFDesc>

Throws:

HiveException

closeOp

protected void closeOp(boolean abort)
                throws HiveException

Description copied from class: Operator

Operator specific close routine. Operators which inherents this class should overwrite this funtion for their specific cleanup routine.

Overrides:

closeOp in class Operator<PTFDesc>

Throws:

HiveException

process

public void process(Object row,
           int tag)
             throws HiveException

Description copied from class: Operator

Process the row.

Specified by:

process in class Operator<PTFDesc>

Parameters:

row - The object representing the row.

tag - The tag of the row usually means which parent this row comes from. Rows with the same tag should have exactly the same rowInspector all the time.

Throws:

HiveException

reconstructQueryDef

protected void reconstructQueryDef(org.apache.hadoop.conf.Configuration hiveConf)
                            throws HiveException

Initialize the visitor to use the QueryDefDeserializer Use the order defined in QueryDefWalker to visit the QueryDef

Parameters:

hiveConf -

Throws:

HiveException

setupKeysWrapper

protected void setupKeysWrapper(ObjectInspector inputOI)
                         throws HiveException

Throws:

HiveException

getName

public String getName()

Description copied from class: Operator

Implements the getName function for the Node Interface.

Specified by:

getName in interface Node

Overrides:

getName in class Operator<PTFDesc>

Returns:

the name of the operator

getOperatorName

public static String getOperatorName()

getType

public OperatorType getType()

Description copied from class: Operator

Return the type of the specific operator among the types in OperatorType.

Specified by:

getType in class Operator<PTFDesc>

Returns:

OperatorType.*

connectLeadLagFunctionsToPartition

public static void connectLeadLagFunctionsToPartition(PTFDesc ptfDesc,
                                      PTFPartition.PTFPartitionIterator<Object> pItr)
                                               throws HiveException

Throws:

HiveException