org.apache.hadoop.hive.ql.exec.tez.tools

Class KeyValuesInputMerger

java.lang.Object

org.apache.tez.runtime.api.Reader

org.apache.tez.runtime.library.api.KeyValuesReader

org.apache.hadoop.hive.ql.exec.tez.tools.KeyValuesInputMerger

public class KeyValuesInputMerger
extends org.apache.tez.runtime.library.api.KeyValuesReader

A KeyValuesReader implementation that returns a sorted stream of key-values by doing a sorted merge of the key-value in LogicalInputs. Tags are in the last byte of the key, so no special handling for tags is required. Uses a priority queue to pick the KeyValuesReader of the input that is next in sort order.

Field Summary

Fields

Modifier and Type	Field and Description
static org.slf4j.Logger	l4j

Fields inherited from class org.apache.tez.runtime.library.api.KeyValuesReader

completedProcessing

Constructor Summary

Constructors

Constructor and Description
KeyValuesInputMerger(List<? extends org.apache.tez.runtime.api.Input> shuffleInputs)

Method Summary

Modifier and Type	Method and Description
Object	getCurrentKey()
Iterable<Object>	getCurrentValues()
boolean	next()

Methods inherited from class org.apache.tez.runtime.library.api.KeyValuesReader

hasCompletedProcessing

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

l4j

public static final org.slf4j.Logger l4j

Constructor Detail

KeyValuesInputMerger

public KeyValuesInputMerger(List<? extends org.apache.tez.runtime.api.Input> shuffleInputs)
                     throws Exception

Throws:

Exception

Method Detail

next

public boolean next()
             throws IOException

Specified by:

next in class org.apache.tez.runtime.library.api.KeyValuesReader

Returns:

true if there are more key-values and advances to next key-values

Throws:

IOException

getCurrentKey

public Object getCurrentKey()
                     throws IOException

Specified by:

getCurrentKey in class org.apache.tez.runtime.library.api.KeyValuesReader

Throws:

IOException

getCurrentValues

public Iterable<Object> getCurrentValues()
                                  throws IOException

Specified by:

getCurrentValues in class org.apache.tez.runtime.library.api.KeyValuesReader

Throws:

IOException