org.apache.hadoop.hive.ql.exec.vector

Class VectorMapOperator

java.lang.Object

org.apache.hadoop.hive.ql.exec.Operator<MapWork>

org.apache.hadoop.hive.ql.exec.AbstractMapOperator

org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator

All Implemented Interfaces:

Serializable, Cloneable, Node

public class VectorMapOperator
extends AbstractMapOperator

See Also:

Serialized Form

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
protected class	VectorMapOperator.RowDeserializePartitionContext
protected class	VectorMapOperator.VectorDeserializePartitionContext
protected class	VectorMapOperator.VectorizedInputFileFormatPartitionContext
protected class	VectorMapOperator.VectorPartitionContext

Nested classes/interfaces inherited from class org.apache.hadoop.hive.ql.exec.AbstractMapOperator

AbstractMapOperator.Counter

Nested classes/interfaces inherited from class org.apache.hadoop.hive.ql.exec.Operator

Operator.OperatorFunc, Operator.State

Field Summary

Fields inherited from class org.apache.hadoop.hive.ql.exec.AbstractMapOperator

deserialize_error_count, numRows, recordCounter

Fields inherited from class org.apache.hadoop.hive.ql.exec.Operator

abortOp, alias, asyncInitOperations, bucketingVersion, cContext, childOperators, childOperatorsArray, childOperatorsTag, conf, CONTEXT_NAME_KEY, done, groupKeyObject, HIVE_COUNTER_CREATED_DYNAMIC_PARTITIONS, HIVE_COUNTER_CREATED_FILES, HIVE_COUNTER_FATAL, id, indexForTezUnion, inputObjInspectors, LOG, operatorId, out, outputObjInspector, parentOperators, reporter, runTimeNumRows, state, statsMap

Constructor Summary

Constructors

Constructor and Description
VectorMapOperator() Kryo ctor.
VectorMapOperator(CompilationOpContext ctx)

Method Summary

Modifier and Type	Method and Description
void	cleanUpInputFileChangedOp()
void	closeOp(boolean abort) Operator specific close routine.
VectorMapOperator.VectorPartitionContext	createAndInitPartitionContext(PartitionDesc partDesc, org.apache.hadoop.conf.Configuration hconf)
Deserializer	getCurrentDeserializer()
String	getName() Gets the name of the node.
static String	getOperatorName()
org.apache.hadoop.hive.ql.plan.api.OperatorType	getType() Return the type of the specific operator among the types in OperatorType.
void	initEmptyInputChildren(List<Operator<?>> children, org.apache.hadoop.conf.Configuration hconf)
void	initializeContexts()
void	initializeMapOperator(org.apache.hadoop.conf.Configuration hconf)
void	process(Object row, int tag) Process the row.
void	process(org.apache.hadoop.io.Writable value)
void	setChildren(org.apache.hadoop.conf.Configuration hconf)

Methods inherited from class org.apache.hadoop.hive.ql.exec.AbstractMapOperator

clearConnectedOperators, getConnectedOperators, getNominalPath, setConnectedOperators

Methods inherited from class org.apache.hadoop.hive.ql.exec.Operator

abort, acceptLimitPushdown, allInitializedParentsAreClosed, areAllParentsInitialized, augmentPlan, cleanUpInputFileChanged, clone, cloneOp, cloneRecursiveChildren, close, columnNamesRowResolvedCanBeObtained, completeInitializationOp, createDummy, defaultEndGroup, defaultStartGroup, dump, dump, endGroup, flush, flushRecursive, forward, forward, forward, getAdditionalCounters, getBucketingVersion, getChildOperators, getChildren, getColumnExprMap, getCompilationOpContext, getConf, getConfiguration, getCounterName, getDone, getExecContext, getGroupKeyObject, getIdentifier, getIndexForTezUnion, getInputObjInspectors, getIsReduceSink, getMarker, getNextCntr, getNumChild, getNumParent, getOperatorId, getOpTraits, getOutputObjInspector, getParentOperators, getReduceOutputName, getSchema, getStatistics, getStats, initEvaluators, initEvaluators, initEvaluatorsAndReturnStruct, initialize, initialize, initializeChildren, initializeLocalWork, initializeOp, initOperatorId, isUseBucketizedHiveInputFormat, jobClose, jobCloseOp, logicalEquals, logicalEqualsTree, logStats, opAllowedAfterMapJoin, opAllowedBeforeMapJoin, opAllowedBeforeSortMergeJoin, opAllowedConvertMapJoin, passExecContext, preorderMap, processGroup, removeChild, removeChildAndAdoptItsChildren, removeParent, removeParents, replaceChild, replaceParent, reset, setAlias, setBucketingVersion, setChildOperators, setColumnExprMap, setCompilationOpContext, setConf, setDone, setExecContext, setGroupKeyObject, setIndexForTezUnion, setInputContext, setInputObjInspectors, setMarker, setNextVectorBatchGroupStatus, setOpTraits, setOutputCollector, setParentOperators, setReporter, setSchema, setStatistics, setUseBucketizedHiveInputFormat, startGroup, supportAutomaticSortMergeJoin, supportSkewJoinOptimization, supportUnionRemoveOptimization, toString, toString

Methods inherited from class java.lang.Object

equals, finalize, getClass, hashCode, notify, notifyAll, wait, wait, wait

Constructor Detail

VectorMapOperator

public VectorMapOperator()

Kryo ctor.

VectorMapOperator

public VectorMapOperator(CompilationOpContext ctx)

Method Detail

createAndInitPartitionContext

public VectorMapOperator.VectorPartitionContext createAndInitPartitionContext(PartitionDesc partDesc,
                                                                              org.apache.hadoop.conf.Configuration hconf)
                                                                       throws SerDeException,
                                                                              Exception

Throws:

SerDeException

Exception

initEmptyInputChildren

public void initEmptyInputChildren(List<Operator<?>> children,
                                   org.apache.hadoop.conf.Configuration hconf)
                            throws SerDeException,
                                   Exception

Specified by:

initEmptyInputChildren in class AbstractMapOperator

Throws:

SerDeException

Exception

setChildren

public void setChildren(org.apache.hadoop.conf.Configuration hconf)
                 throws Exception

Specified by:

setChildren in class AbstractMapOperator

Throws:

Exception

initializeMapOperator

public void initializeMapOperator(org.apache.hadoop.conf.Configuration hconf)
                           throws HiveException

Overrides:

initializeMapOperator in class AbstractMapOperator

Throws:

HiveException

initializeContexts

public void initializeContexts()
                        throws HiveException

Specified by:

initializeContexts in class AbstractMapOperator

Throws:

HiveException

cleanUpInputFileChangedOp

public void cleanUpInputFileChangedOp()
                               throws HiveException

Overrides:

cleanUpInputFileChangedOp in class Operator<MapWork>

Throws:

HiveException

getCurrentDeserializer

public Deserializer getCurrentDeserializer()

Specified by:

getCurrentDeserializer in class AbstractMapOperator

process

public void process(org.apache.hadoop.io.Writable value)
             throws HiveException

Specified by:

process in class AbstractMapOperator

Throws:

HiveException

process

public void process(Object row,
                    int tag)
             throws HiveException

Description copied from class: Operator

Process the row.

Specified by:

process in class Operator<MapWork>

Parameters:

row - The object representing the row.

tag - The tag of the row usually means which parent this row comes from. Rows with the same tag should have exactly the same rowInspector all the time.

Throws:

HiveException

closeOp

public void closeOp(boolean abort)
             throws HiveException

Description copied from class: Operator

Operator specific close routine. Operators which inherents this class should overwrite this funtion for their specific cleanup routine.

Overrides:

closeOp in class AbstractMapOperator

Throws:

HiveException

getName

public String getName()

Description copied from interface: Node

Gets the name of the node. This is used in the rule dispatchers.

Specified by:

getName in interface Node

Specified by:

getName in class Operator<MapWork>

Returns:

String

getOperatorName

public static String getOperatorName()

getType

public org.apache.hadoop.hive.ql.plan.api.OperatorType getType()

Description copied from class: Operator

Return the type of the specific operator among the types in OperatorType.

Specified by:

getType in class Operator<MapWork>

Returns:

OperatorType.*