org.apache.hadoop.hive.ql.io.orc

Class WriterImpl

java.lang.Object

org.apache.orc.impl.WriterImpl

org.apache.hadoop.hive.ql.io.orc.WriterImpl

All Implemented Interfaces:

Closeable, AutoCloseable, org.apache.orc.impl.WriterInternal, org.apache.orc.MemoryManager.Callback, org.apache.orc.Writer

public class WriterImpl
extends org.apache.orc.impl.WriterImpl
implements Writer

An ORC file writer. The file is divided into stripes, which is the natural unit of work when reading. Each stripe is buffered in memory until the memory reaches the stripe size and then it is written out broken down by columns. Each column is written by a TreeWriter that is specific to that type of column. TreeWriters may have children TreeWriters that handle the sub-types. Each of the TreeWriters writes the column's data as a set of streams. This class is unsynchronized like most Stream objects, so from the creation of an OrcFile and all access to a single instance has to be from a single thread. There are no known cases where these happen between different threads today. Caveat: the MemoryManager is created during WriterOptions create, that has to be confined to a single thread as well.

Method Summary

Modifier and Type	Method and Description
void	addRow(Object row) Add a row to the end of the ORC file.
void	addRowBatch(org.apache.hadoop.hive.ql.exec.vector.VectorizedRowBatch batch)
void	close()
long	writeIntermediateFooter()

Methods inherited from class org.apache.orc.impl.WriterImpl

addUserMetadata, appendStripe, appendUserMetadata, checkMemory, createCodec, getCompressionCodec, getEstimatedBufferSize, getNumberOfRows, getRawDataSize, getSchema, getStatistics, increaseCompressionSize

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface org.apache.orc.Writer

addUserMetadata, appendStripe, appendUserMetadata, getNumberOfRows, getRawDataSize, getSchema, getStatistics

Method Detail

addRow

public void addRow(Object row)
            throws IOException

Description copied from interface: Writer

Add a row to the end of the ORC file.

Parameters:

row - the row to add

Throws:

IOException

writeIntermediateFooter

public long writeIntermediateFooter()
                             throws IOException

Specified by:

writeIntermediateFooter in interface org.apache.orc.Writer

Overrides:

writeIntermediateFooter in class org.apache.orc.impl.WriterImpl

Throws:

IOException

addRowBatch

public void addRowBatch(org.apache.hadoop.hive.ql.exec.vector.VectorizedRowBatch batch)
                 throws IOException

Specified by:

addRowBatch in interface org.apache.orc.Writer

Overrides:

addRowBatch in class org.apache.orc.impl.WriterImpl

Throws:

IOException

close

public void close()
           throws IOException

Specified by:

close in interface Closeable

Specified by:

close in interface AutoCloseable

Specified by:

close in interface org.apache.orc.Writer

Overrides:

close in class org.apache.orc.impl.WriterImpl

Throws:

IOException