org.apache.hive.streaming

Interface RecordWriter

All Known Implementing Classes:

AbstractRecordWriter, StrictDelimitedInputWriter, StrictJsonWriter, StrictRegexWriter

public interface RecordWriter

Method Summary

Modifier and Type	Method and Description
void	close() Close the RecordUpdater.
void	flush() Flush records from buffer.
Set<String>	getPartitions() Get the set of partitions that were added by the record writer.
void	init(StreamingConnection connection, long minWriteId, long maxWriteID) Initialize record writer.
void	write(long writeId, byte[] record) Writes using a hive RecordUpdater.
void	write(long writeId, InputStream inputStream) Writes using a hive RecordUpdater.

Method Detail

init

void init(StreamingConnection connection,
          long minWriteId,
          long maxWriteID)
   throws StreamingException

Initialize record writer.

Parameters:

connection - - streaming connection

minWriteId - - min write id

maxWriteID - - max write id

Throws:

StreamingException - - thrown when initialization failed

write

void write(long writeId,
           byte[] record)
    throws StreamingException

Writes using a hive RecordUpdater.

Parameters:

writeId - - the write ID of the table mapping to Txn in which the write occurs

record - - the record to be written

Throws:

StreamingException - - thrown when write fails

write

void write(long writeId,
           InputStream inputStream)
    throws StreamingException

Writes using a hive RecordUpdater. The specified input stream will be automatically closed by the API after reading all the records out of it.

Parameters:

writeId - - the write ID of the table mapping to Txn in which the write occurs

inputStream - - the record to be written

Throws:

StreamingException - - thrown when write fails

flush

void flush()
    throws StreamingException

Flush records from buffer. Invoked by TransactionBatch.commitTransaction()

Throws:

StreamingException - - thrown when flush fails

close

void close()
    throws StreamingException

Close the RecordUpdater. Invoked by TransactionBatch.close()

Throws:

StreamingException - - thrown when record writer cannot be closed.

getPartitions

Set<String> getPartitions()

Get the set of partitions that were added by the record writer.

Returns:

- set of partitions