org.apache.hadoop.hive.ql.exec.mr

Class MapredLocalTask

java.lang.Object

org.apache.hadoop.hive.ql.exec.Task<MapredLocalWork>

org.apache.hadoop.hive.ql.exec.mr.MapredLocalTask

All Implemented Interfaces:

Serializable, Node

public class MapredLocalTask
extends Task<MapredLocalWork>
implements Serializable

MapredLocalTask represents any local work (i.e.: client side work) that hive needs to execute. E.g.: This is used for generating Hashtables for Mapjoins on the client before the Join is executed on the cluster. MapRedLocalTask does not actually execute the work in process, but rather generates a command using ExecDriver. ExecDriver is what will finally drive processing the records.

See Also:

Serialized Form

Nested Class Summary

Nested classes/interfaces inherited from class org.apache.hadoop.hive.ql.exec.Task

Task.FeedType, Task.TaskState

Field Summary

Fields

Modifier and Type	Field and Description
protected HadoopJobExecHelper	jobExecHelper
static org.slf4j.Logger	l4j
static MemoryMXBean	memoryMXBean

Fields inherited from class org.apache.hadoop.hive.ql.exec.Task

BACKUP_COMMON_JOIN, backupChildrenTasks, backupTask, childTasks, clonedConf, COMMON_JOIN, conf, console, CONVERTED_MAPJOIN, CONVERTED_MAPJOIN_LOCAL, CONVERTED_SORTMERGEJOIN, driverContext, feedSubscribers, HINTED_MAPJOIN, HINTED_MAPJOIN_LOCAL, id, jobID, MAPJOIN_ONLY_NOBACKUP, NO_TAG, parentTasks, queryDisplay, queryPlan, queryState, rootTask, taskCounters, taskHandle, taskTag, work

Constructor Summary

Constructors

Constructor and Description
MapredLocalTask()
MapredLocalTask(MapredLocalWork plan, org.apache.hadoop.mapred.JobConf job, boolean isSilent)

Method Summary

Modifier and Type	Method and Description
int	execute(DriverContext driverContext) This method is overridden in each Task.
int	executeInChildVM(DriverContext driverContext)
int	executeInProcess(DriverContext driverContext)
String	getName() Gets the name of the node.
Collection<Operator<? extends OperatorDesc>>	getTopOperators()
org.apache.hadoop.hive.ql.plan.api.StageType	getType() Should be overridden to return the type of the specific task among the types in StageType.
void	initialize(QueryState queryState, QueryPlan queryPlan, DriverContext driverContext, CompilationOpContext opContext)
boolean	isMapRedLocalTask()
static String	now()
boolean	requireLock()
void	setExecContext(ExecMapperContext execContext)
void	shutdown()
void	startForward(String bigTableBucket)
void	updateTaskMetrics(Metrics metrics) Provide metrics on the type and number of tasks executed by the HiveServer

Methods inherited from class org.apache.hadoop.hive.ql.exec.Task

addDependentTask, canExecuteInParallel, cloneConf, done, equals, executeTask, findLeafs, getAndInitBackupTask, getBackupChildrenTasks, getBackupTask, getChildren, getChildTasks, getCounters, getDependentTasks, getDiagnosticsMessage, getDriverContext, getExternalHandle, getFeedSubscribers, getHive, getId, getInitialized, getJobID, getMapWork, getNumChild, getNumParent, getParentTasks, getQueryPlan, getQueryState, getQueued, getReducer, getStatusMessage, getTaskHandle, getTaskState, getTaskTag, getTxnMgr, getWork, hashCode, hasReduce, isFetchSource, isLocalMode, isMapRedTask, isNotInitialized, isRootTask, isRunnable, pushFeed, receiveFeed, removeDependentTask, removeFromChildrenTasks, setBackupChildrenTasks, setBackupTask, setChildTasks, setConf, setConsole, setDiagnosticMessage, setDone, setDriverContext, setException, setFeedSubscribers, setFetchSource, setId, setInitialized, setLocalMode, setParentTasks, setQueryDisplay, setQueryPlan, setQueued, setRootTask, setStarted, setState, setStatusMessage, setTaskTag, setWork, started, subscribeFeed, toString, updateStatusInQueryDisplay

Methods inherited from class java.lang.Object

clone, finalize, getClass, notify, notifyAll, wait, wait, wait

Field Detail

jobExecHelper

protected HadoopJobExecHelper jobExecHelper

l4j

public static final transient org.slf4j.Logger l4j

memoryMXBean

public static MemoryMXBean memoryMXBean

Constructor Detail

MapredLocalTask

public MapredLocalTask()

MapredLocalTask

public MapredLocalTask(MapredLocalWork plan,
                       org.apache.hadoop.mapred.JobConf job,
                       boolean isSilent)
                throws HiveException

Throws:

HiveException

Method Detail

setExecContext

public void setExecContext(ExecMapperContext execContext)

updateTaskMetrics

public void updateTaskMetrics(Metrics metrics)

Description copied from class: Task

Provide metrics on the type and number of tasks executed by the HiveServer

Overrides:

updateTaskMetrics in class Task<MapredLocalWork>

initialize

public void initialize(QueryState queryState,
                       QueryPlan queryPlan,
                       DriverContext driverContext,
                       CompilationOpContext opContext)

Overrides:

initialize in class Task<MapredLocalWork>

now

public static String now()

requireLock

public boolean requireLock()

Overrides:

requireLock in class Task<MapredLocalWork>

execute

public int execute(DriverContext driverContext)

Description copied from class: Task

This method is overridden in each Task. TODO execute should return a TaskHandle.

Specified by:

execute in class Task<MapredLocalWork>

Returns:

status of executing the task

executeInChildVM

public int executeInChildVM(DriverContext driverContext)

executeInProcess

public int executeInProcess(DriverContext driverContext)

startForward

public void startForward(String bigTableBucket)
                  throws Exception

Throws:

Exception

isMapRedLocalTask

public boolean isMapRedLocalTask()

Overrides:

isMapRedLocalTask in class Task<MapredLocalWork>

getTopOperators

public Collection<Operator<? extends OperatorDesc>> getTopOperators()

Overrides:

getTopOperators in class Task<MapredLocalWork>

getName

public String getName()

Description copied from interface: Node

Gets the name of the node. This is used in the rule dispatchers.

Specified by:

getName in interface Node

Returns:

String

getType

public org.apache.hadoop.hive.ql.plan.api.StageType getType()

Description copied from class: Task

Should be overridden to return the type of the specific task among the types in StageType.

Specified by:

getType in class Task<MapredLocalWork>

Returns:

StageType.* or null if not overridden

shutdown

public void shutdown()

Overrides:

shutdown in class Task<MapredLocalWork>