org.apache.hadoop.hive.ql.exec.tez

Class TezTask

java.lang.Object

org.apache.hadoop.hive.ql.exec.Task<TezWork>

org.apache.hadoop.hive.ql.exec.tez.TezTask

All Implemented Interfaces:

Serializable, Node

public class TezTask
extends Task<TezWork>

TezTask handles the execution of TezWork. Currently it executes a graph of map and reduce work using the Tez APIs directly.

See Also:

Serialized Form

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
class	TezTask.SyncDagClient DAG client that does dumb global sync on all the method calls; Tez DAG client is not thread safe and getting the 2nd one is not recommended.

Nested classes/interfaces inherited from class org.apache.hadoop.hive.ql.exec.Task

Task.FeedType, Task.TaskState

Field Summary

Fields inherited from class org.apache.hadoop.hive.ql.exec.Task

BACKUP_COMMON_JOIN, backupChildrenTasks, backupTask, childTasks, clonedConf, COMMON_JOIN, conf, console, CONVERTED_MAPJOIN, CONVERTED_MAPJOIN_LOCAL, CONVERTED_SORTMERGEJOIN, driverContext, feedSubscribers, HINTED_MAPJOIN, HINTED_MAPJOIN_LOCAL, id, jobID, LOG, MAPJOIN_ONLY_NOBACKUP, NO_TAG, parentTasks, queryDisplay, queryPlan, queryState, rootTask, taskCounters, taskHandle, taskTag, work

Constructor Summary

Constructors

Constructor and Description
TezTask()
TezTask(DagUtils utils)

Method Summary

Modifier and Type	Method and Description
int	execute(DriverContext driverContext) This method is overridden in each Task.
Collection<MapWork>	getMapWork()
String	getName() Gets the name of the node.
Operator<? extends OperatorDesc>	getReducer(MapWork mapWork)
org.apache.tez.common.counters.TezCounters	getTezCounters()
org.apache.hadoop.hive.ql.plan.api.StageType	getType() Should be overridden to return the type of the specific task among the types in StageType.
boolean	isMapRedTask()
void	shutdown()
void	updateTaskMetrics(Metrics metrics) Provide metrics on the type and number of tasks executed by the HiveServer

Methods inherited from class org.apache.hadoop.hive.ql.exec.Task

addDependentTask, canExecuteInParallel, cloneConf, done, equals, executeTask, findLeafs, getAndInitBackupTask, getBackupChildrenTasks, getBackupTask, getChildren, getChildTasks, getCounters, getDependentTasks, getDiagnosticsMessage, getDriverContext, getExternalHandle, getFeedSubscribers, getHive, getId, getInitialized, getJobID, getNumChild, getNumParent, getParentTasks, getQueryPlan, getQueryState, getQueued, getStatusMessage, getTaskHandle, getTaskState, getTaskTag, getTopOperators, getTxnMgr, getWork, hashCode, hasReduce, initialize, isFetchSource, isLocalMode, isMapRedLocalTask, isNotInitialized, isRootTask, isRunnable, pushFeed, receiveFeed, removeDependentTask, removeFromChildrenTasks, requireLock, setBackupChildrenTasks, setBackupTask, setChildTasks, setConf, setConsole, setDiagnosticMessage, setDone, setDriverContext, setException, setFeedSubscribers, setFetchSource, setId, setInitialized, setLocalMode, setParentTasks, setQueryDisplay, setQueryPlan, setQueued, setRootTask, setStarted, setState, setStatusMessage, setTaskTag, setWork, started, subscribeFeed, toString, updateStatusInQueryDisplay

Methods inherited from class java.lang.Object

clone, finalize, getClass, notify, notifyAll, wait, wait, wait

Constructor Detail

TezTask

public TezTask()

TezTask

public TezTask(DagUtils utils)

Method Detail

getTezCounters

public org.apache.tez.common.counters.TezCounters getTezCounters()

execute

public int execute(DriverContext driverContext)

Description copied from class: Task

This method is overridden in each Task. TODO execute should return a TaskHandle.

Specified by:

execute in class Task<TezWork>

Returns:

status of executing the task

updateTaskMetrics

public void updateTaskMetrics(Metrics metrics)

Description copied from class: Task

Provide metrics on the type and number of tasks executed by the HiveServer

Overrides:

updateTaskMetrics in class Task<TezWork>

isMapRedTask

public boolean isMapRedTask()

Overrides:

isMapRedTask in class Task<TezWork>

getType

public org.apache.hadoop.hive.ql.plan.api.StageType getType()

Description copied from class: Task

Should be overridden to return the type of the specific task among the types in StageType.

Specified by:

getType in class Task<TezWork>

Returns:

StageType.* or null if not overridden

getName

public String getName()

Description copied from interface: Node

Gets the name of the node. This is used in the rule dispatchers.

Returns:

String

getMapWork

public Collection<MapWork> getMapWork()

Overrides:

getMapWork in class Task<TezWork>

getReducer

public Operator<? extends OperatorDesc> getReducer(MapWork mapWork)

Overrides:

getReducer in class Task<TezWork>

shutdown

public void shutdown()

Overrides:

shutdown in class Task<TezWork>