org.apache.hadoop.hive.ql.exec

Class AbstractMapOperator

java.lang.Object

org.apache.hadoop.hive.ql.exec.Operator<MapWork>

org.apache.hadoop.hive.ql.exec.AbstractMapOperator

All Implemented Interfaces:

Serializable, Cloneable, Node

Direct Known Subclasses:

MapOperator, VectorMapOperator

public abstract class AbstractMapOperator
extends Operator<MapWork>
implements Serializable, Cloneable

Abstract Map operator. Common code of MapOperator and VectorMapOperator.

See Also:

Serialized Form

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
static class	AbstractMapOperator.Counter Counter.

Nested classes/interfaces inherited from class org.apache.hadoop.hive.ql.exec.Operator

Operator.OperatorFunc, Operator.State

Field Summary

Fields

Modifier and Type	Field and Description
protected org.apache.hadoop.io.LongWritable	deserialize_error_count
protected long	numRows
protected org.apache.hadoop.io.LongWritable	recordCounter

Fields inherited from class org.apache.hadoop.hive.ql.exec.Operator

abortOp, alias, asyncInitOperations, bucketingVersion, cContext, childOperators, childOperatorsArray, childOperatorsTag, conf, CONTEXT_NAME_KEY, done, groupKeyObject, HIVE_COUNTER_CREATED_DYNAMIC_PARTITIONS, HIVE_COUNTER_CREATED_FILES, HIVE_COUNTER_FATAL, id, indexForTezUnion, inputObjInspectors, LOG, operatorId, out, outputObjInspector, parentOperators, reporter, runTimeNumRows, state, statsMap

Constructor Summary

Constructors

Modifier	Constructor and Description
protected	AbstractMapOperator() Kryo ctor.
	AbstractMapOperator(CompilationOpContext ctx)

Method Summary

Modifier and Type	Method and Description
void	clearConnectedOperators()
void	closeOp(boolean abort) Operator specific close routine.
Map<Integer,DummyStoreOperator>	getConnectedOperators()
abstract Deserializer	getCurrentDeserializer()
protected String	getNominalPath(org.apache.hadoop.fs.Path fpath)
abstract void	initEmptyInputChildren(List<Operator<?>> children, org.apache.hadoop.conf.Configuration hconf)
abstract void	initializeContexts()
void	initializeMapOperator(org.apache.hadoop.conf.Configuration hconf)
abstract void	process(org.apache.hadoop.io.Writable value)
abstract void	setChildren(org.apache.hadoop.conf.Configuration hconf)
void	setConnectedOperators(int tag, DummyStoreOperator dummyOp)

Methods inherited from class org.apache.hadoop.hive.ql.exec.Operator

abort, acceptLimitPushdown, allInitializedParentsAreClosed, areAllParentsInitialized, augmentPlan, cleanUpInputFileChanged, cleanUpInputFileChangedOp, clone, cloneOp, cloneRecursiveChildren, close, columnNamesRowResolvedCanBeObtained, completeInitializationOp, createDummy, defaultEndGroup, defaultStartGroup, dump, dump, endGroup, flush, flushRecursive, forward, forward, forward, getAdditionalCounters, getBucketingVersion, getChildOperators, getChildren, getColumnExprMap, getCompilationOpContext, getConf, getConfiguration, getCounterName, getDone, getExecContext, getGroupKeyObject, getIdentifier, getIndexForTezUnion, getInputObjInspectors, getIsReduceSink, getMarker, getName, getNextCntr, getNumChild, getNumParent, getOperatorId, getOperatorName, getOpTraits, getOutputObjInspector, getParentOperators, getReduceOutputName, getSchema, getStatistics, getStats, getType, initEvaluators, initEvaluators, initEvaluatorsAndReturnStruct, initialize, initialize, initializeChildren, initializeLocalWork, initializeOp, initOperatorId, isUseBucketizedHiveInputFormat, jobClose, jobCloseOp, logicalEquals, logicalEqualsTree, logStats, opAllowedAfterMapJoin, opAllowedBeforeMapJoin, opAllowedBeforeSortMergeJoin, opAllowedConvertMapJoin, passExecContext, preorderMap, process, processGroup, removeChild, removeChildAndAdoptItsChildren, removeParent, removeParents, replaceChild, replaceParent, reset, setAlias, setBucketingVersion, setChildOperators, setColumnExprMap, setCompilationOpContext, setConf, setDone, setExecContext, setGroupKeyObject, setIndexForTezUnion, setInputContext, setInputObjInspectors, setMarker, setNextVectorBatchGroupStatus, setOpTraits, setOutputCollector, setParentOperators, setReporter, setSchema, setStatistics, setUseBucketizedHiveInputFormat, startGroup, supportAutomaticSortMergeJoin, supportSkewJoinOptimization, supportUnionRemoveOptimization, toString, toString

Methods inherited from class java.lang.Object

equals, finalize, getClass, hashCode, notify, notifyAll, wait, wait, wait

Field Detail

deserialize_error_count

protected final transient org.apache.hadoop.io.LongWritable deserialize_error_count

recordCounter

protected final transient org.apache.hadoop.io.LongWritable recordCounter

numRows

protected transient long numRows

Constructor Detail

AbstractMapOperator

protected AbstractMapOperator()

Kryo ctor.

AbstractMapOperator

public AbstractMapOperator(CompilationOpContext ctx)

Method Detail

getNominalPath

protected String getNominalPath(org.apache.hadoop.fs.Path fpath)

initEmptyInputChildren

public abstract void initEmptyInputChildren(List<Operator<?>> children,
                                            org.apache.hadoop.conf.Configuration hconf)
                                     throws SerDeException,
                                            Exception

Throws:

SerDeException

Exception

setChildren

public abstract void setChildren(org.apache.hadoop.conf.Configuration hconf)
                          throws Exception

Throws:

Exception

initializeMapOperator

public void initializeMapOperator(org.apache.hadoop.conf.Configuration hconf)
                           throws HiveException

Throws:

HiveException

initializeContexts

public abstract void initializeContexts()
                                 throws HiveException

Throws:

HiveException

getCurrentDeserializer

public abstract Deserializer getCurrentDeserializer()

process

public abstract void process(org.apache.hadoop.io.Writable value)
                      throws HiveException

Throws:

HiveException

closeOp

public void closeOp(boolean abort)
             throws HiveException

Description copied from class: Operator

Operator specific close routine. Operators which inherents this class should overwrite this funtion for their specific cleanup routine.

Overrides:

closeOp in class Operator<MapWork>

Throws:

HiveException

clearConnectedOperators

public void clearConnectedOperators()

setConnectedOperators

public void setConnectedOperators(int tag,
                                  DummyStoreOperator dummyOp)

getConnectedOperators

public Map<Integer,DummyStoreOperator> getConnectedOperators()