org.apache.hadoop.hive.llap

Class LlapArrowRecordWriter<K extends org.apache.hadoop.io.Writable,V extends org.apache.hadoop.io.Writable>

java.lang.Object

org.apache.hadoop.hive.llap.LlapArrowRecordWriter<K,V>

All Implemented Interfaces:

org.apache.hadoop.mapred.RecordWriter<K,V>

public class LlapArrowRecordWriter<K extends org.apache.hadoop.io.Writable,V extends org.apache.hadoop.io.Writable>
extends Object
implements org.apache.hadoop.mapred.RecordWriter<K,V>

Writes Arrow batches to an ArrowStreamWriter. The byte stream will be formatted according to the Arrow Streaming format. Because ArrowStreamWriter is bound to a VectorSchemaRoot when it is created, calls to the write(Writable, Writable) method only serve as a signal that a new batch has been loaded to the associated VectorSchemaRoot. Payload data for writing is indirectly made available by reference: ArrowStreamWriter -> VectorSchemaRoot -> List i.e. both they key and value are ignored once a reference to the VectorSchemaRoot is obtained.

Field Summary

Fields

Modifier and Type	Field and Description
static org.slf4j.Logger	LOG

Constructor Summary

Constructors

Constructor and Description
LlapArrowRecordWriter(WritableByteChannel out)

Method Summary

Modifier and Type	Method and Description
void	close(org.apache.hadoop.mapred.Reporter reporter)
void	write(K key, V value)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

LOG

public static final org.slf4j.Logger LOG

Constructor Detail

LlapArrowRecordWriter

public LlapArrowRecordWriter(WritableByteChannel out)

Method Detail

close

public void close(org.apache.hadoop.mapred.Reporter reporter)
           throws IOException

Specified by:

close in interface org.apache.hadoop.mapred.RecordWriter<K extends org.apache.hadoop.io.Writable,V extends org.apache.hadoop.io.Writable>

Throws:

IOException

write

public void write(K key,
                  V value)
           throws IOException

Specified by:

write in interface org.apache.hadoop.mapred.RecordWriter<K extends org.apache.hadoop.io.Writable,V extends org.apache.hadoop.io.Writable>

Throws:

IOException