org.apache.hadoop.hive.ql.exec.tez

Class TezProcessor

java.lang.Object

org.apache.tez.runtime.api.AbstractLogicalIOProcessor

org.apache.hadoop.hive.ql.exec.tez.TezProcessor

All Implemented Interfaces:

org.apache.tez.runtime.api.LogicalIOProcessor, org.apache.tez.runtime.api.LogicalIOProcessorFrameworkInterface, org.apache.tez.runtime.api.Processor, org.apache.tez.runtime.api.ProcessorFrameworkInterface

Direct Known Subclasses:

MapTezProcessor, MergeFileTezProcessor, ReduceTezProcessor

public class TezProcessor
extends org.apache.tez.runtime.api.AbstractLogicalIOProcessor

Hive processor for Tez that forms the vertices in Tez and processes the data. Does what ExecMapper and ExecReducer does for hive in MR framework.

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
static interface	TezProcessor.Hook This provides the ability to pass things into TezProcessor, which is normally impossible because of how Tez APIs are structured.

Field Summary

Fields

Modifier and Type	Field and Description
protected boolean	isMap
protected org.apache.hadoop.mapred.JobConf	jobConf
protected static NumberFormat	jobIdFormat
protected org.apache.tez.runtime.api.ProcessorContext	processorContext
protected RecordProcessor	rproc
protected static NumberFormat	taskIdFormat

Constructor Summary

Constructors

Constructor and Description
TezProcessor(org.apache.tez.runtime.api.ProcessorContext context)

Method Summary

Modifier and Type	Method and Description
void	abort()
void	close()
org.apache.hadoop.mapred.JobConf	getConf()
void	handleEvents(List<org.apache.tez.runtime.api.Event> arg0)
void	initialize()
protected void	initializeAndRunProcessor(Map<String,org.apache.tez.runtime.api.LogicalInput> inputs, Map<String,org.apache.tez.runtime.api.LogicalOutput> outputs)
void	run(Map<String,org.apache.tez.runtime.api.LogicalInput> inputs, Map<String,org.apache.tez.runtime.api.LogicalOutput> outputs)

Methods inherited from class org.apache.tez.runtime.api.AbstractLogicalIOProcessor

getContext

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

isMap

protected boolean isMap

rproc

protected RecordProcessor rproc

jobConf

protected org.apache.hadoop.mapred.JobConf jobConf

processorContext

protected org.apache.tez.runtime.api.ProcessorContext processorContext

taskIdFormat

protected static final NumberFormat taskIdFormat

jobIdFormat

protected static final NumberFormat jobIdFormat

Constructor Detail

TezProcessor

public TezProcessor(org.apache.tez.runtime.api.ProcessorContext context)

Method Detail

close

public void close()
           throws IOException

Throws:

IOException

handleEvents

public void handleEvents(List<org.apache.tez.runtime.api.Event> arg0)

initialize

public void initialize()
                throws IOException

Specified by:

initialize in interface org.apache.tez.runtime.api.ProcessorFrameworkInterface

Specified by:

initialize in class org.apache.tez.runtime.api.AbstractLogicalIOProcessor

Throws:

IOException

run

public void run(Map<String,org.apache.tez.runtime.api.LogicalInput> inputs,
                Map<String,org.apache.tez.runtime.api.LogicalOutput> outputs)
         throws Exception

Throws:

Exception

initializeAndRunProcessor

protected void initializeAndRunProcessor(Map<String,org.apache.tez.runtime.api.LogicalInput> inputs,
                                         Map<String,org.apache.tez.runtime.api.LogicalOutput> outputs)
                                  throws Exception

Throws:

Exception

abort

public void abort()

Specified by:

abort in interface org.apache.tez.runtime.api.ProcessorFrameworkInterface

Overrides:

abort in class org.apache.tez.runtime.api.AbstractLogicalIOProcessor

getConf

public org.apache.hadoop.mapred.JobConf getConf()