org.apache.hadoop.hive.ql.exec.tez

Class HiveSplitGenerator

java.lang.Object

org.apache.tez.runtime.api.InputInitializer

org.apache.hadoop.hive.ql.exec.tez.HiveSplitGenerator

public class HiveSplitGenerator
extends org.apache.tez.runtime.api.InputInitializer

This class is used to generate splits inside the AM on the cluster. It optionally groups together splits based on available head room as well as making sure that splits from different partitions are only grouped if they are of the same schema, format and serde

Constructor Summary

Constructors

Constructor and Description
HiveSplitGenerator(org.apache.hadoop.conf.Configuration conf, MapWork work, boolean generateSingleSplit)
HiveSplitGenerator(org.apache.tez.runtime.api.InputInitializerContext initializerContext)

Method Summary

Modifier and Type	Method and Description
void	handleInputInitializerEvent(List<org.apache.tez.runtime.api.events.InputInitializerEvent> events)
List<org.apache.tez.runtime.api.Event>	initialize()
void	onVertexStateUpdated(org.apache.tez.dag.api.event.VertexStateUpdate stateUpdate)

Methods inherited from class org.apache.tez.runtime.api.InputInitializer

getContext

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

HiveSplitGenerator

public HiveSplitGenerator(org.apache.hadoop.conf.Configuration conf,
                          MapWork work,
                          boolean generateSingleSplit)
                   throws IOException

Throws:

IOException

HiveSplitGenerator

public HiveSplitGenerator(org.apache.tez.runtime.api.InputInitializerContext initializerContext)
                   throws IOException,
                          SerDeException

Throws:

IOException

SerDeException

Method Detail

initialize

public List<org.apache.tez.runtime.api.Event> initialize()
                                                  throws Exception

Specified by:

initialize in class org.apache.tez.runtime.api.InputInitializer

Throws:

Exception

onVertexStateUpdated

public void onVertexStateUpdated(org.apache.tez.dag.api.event.VertexStateUpdate stateUpdate)

Overrides:

onVertexStateUpdated in class org.apache.tez.runtime.api.InputInitializer

handleInputInitializerEvent

public void handleInputInitializerEvent(List<org.apache.tez.runtime.api.events.InputInitializerEvent> events)
                                 throws Exception

Specified by:

handleInputInitializerEvent in class org.apache.tez.runtime.api.InputInitializer

Throws:

Exception