org.apache.hadoop.hive.llap.io.decode

Class EncodedDataConsumer<BatchKey,BatchType extends org.apache.hadoop.hive.common.io.encoded.EncodedColumnBatch<BatchKey>>

java.lang.Object

org.apache.hadoop.hive.llap.io.decode.EncodedDataConsumer<BatchKey,BatchType>

All Implemented Interfaces:

ConsumerFeedback<ColumnVectorBatch>, ReadPipeline, Consumer<BatchType>

Direct Known Subclasses:

OrcEncodedDataConsumer

public abstract class EncodedDataConsumer<BatchKey,BatchType extends org.apache.hadoop.hive.common.io.encoded.EncodedColumnBatch<BatchKey>>
extends Object
implements Consumer<BatchType>, ReadPipeline

Field Summary

Fields

Modifier and Type	Field and Description
protected FixedSizedObjectPool<ColumnVectorBatch>	cvbPool

Constructor Summary

Constructors

Constructor and Description
EncodedDataConsumer(Consumer<ColumnVectorBatch> consumer, int colCount, LlapDaemonIOMetrics ioMetrics)

Method Summary

Modifier and Type	Method and Description
void	consumeData(BatchType data) Some data has been produced.
protected abstract void	decodeBatch(BatchType batch, Consumer<ColumnVectorBatch> downstreamConsumer)
Callable<Void>	getReadCallable()
void	init(ConsumerFeedback<BatchType> upstreamFeedback, Callable<Void> readCallable)
void	pause() Pause data production.
void	returnData(ColumnVectorBatch data) Returns processed data back to producer; necessary if e.g.
void	setDone() No more data will be produced; done.
void	setError(Throwable t) No more data will be produced; error during production.
void	stop() Stop data production, the external operation has been cancelled.
void	unpause() Unpause data production.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface org.apache.hadoop.hive.llap.io.decode.ReadPipeline

getSchemaEvolution

Field Detail

cvbPool

protected final FixedSizedObjectPool<ColumnVectorBatch> cvbPool

Constructor Detail

EncodedDataConsumer

public EncodedDataConsumer(Consumer<ColumnVectorBatch> consumer,
                           int colCount,
                           LlapDaemonIOMetrics ioMetrics)

Method Detail

init

public void init(ConsumerFeedback<BatchType> upstreamFeedback,
                 Callable<Void> readCallable)

getReadCallable

public Callable<Void> getReadCallable()

Specified by:

getReadCallable in interface ReadPipeline

consumeData

public void consumeData(BatchType data)
                 throws InterruptedException

Description copied from interface: Consumer

Some data has been produced.

Specified by:

consumeData in interface Consumer<BatchType extends org.apache.hadoop.hive.common.io.encoded.EncodedColumnBatch<BatchKey>>

Throws:

InterruptedException

decodeBatch

protected abstract void decodeBatch(BatchType batch,
                                    Consumer<ColumnVectorBatch> downstreamConsumer)
                             throws InterruptedException

Throws:

InterruptedException

setDone

public void setDone()
             throws InterruptedException

Description copied from interface: Consumer

No more data will be produced; done.

Specified by:

setDone in interface Consumer<BatchType extends org.apache.hadoop.hive.common.io.encoded.EncodedColumnBatch<BatchKey>>

Throws:

InterruptedException

setError

public void setError(Throwable t)
              throws InterruptedException

Description copied from interface: Consumer

No more data will be produced; error during production.

Specified by:

setError in interface Consumer<BatchType extends org.apache.hadoop.hive.common.io.encoded.EncodedColumnBatch<BatchKey>>

Throws:

InterruptedException

returnData

public void returnData(ColumnVectorBatch data)

Description copied from interface: ConsumerFeedback

Returns processed data back to producer; necessary if e.g. data is locked in cache.

Specified by:

returnData in interface ConsumerFeedback<ColumnVectorBatch>

stop

public void stop()

Description copied from interface: ConsumerFeedback

Stop data production, the external operation has been cancelled.

Specified by:

stop in interface ConsumerFeedback<ColumnVectorBatch>

pause

public void pause()

Description copied from interface: ConsumerFeedback

Pause data production.

Specified by:

pause in interface ConsumerFeedback<ColumnVectorBatch>

unpause

public void unpause()

Description copied from interface: ConsumerFeedback

Unpause data production.

Specified by:

unpause in interface ConsumerFeedback<ColumnVectorBatch>