org.apache.hive.streaming

Class StrictJsonWriter

java.lang.Object

org.apache.hive.streaming.AbstractRecordWriter

org.apache.hive.streaming.StrictJsonWriter

All Implemented Interfaces:

RecordWriter

public class StrictJsonWriter
extends AbstractRecordWriter

Streaming Writer handles utf8 encoded Json (Strict syntax). Uses org.apache.hadoop.hive.serde2.JsonSerDe to process Json input NOTE: This record writer is NOT thread-safe. Use one record writer per streaming connection.

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
static class	StrictJsonWriter.Builder

Nested classes/interfaces inherited from class org.apache.hive.streaming.AbstractRecordWriter

AbstractRecordWriter.OrcMemoryPressureMonitor

Field Summary

Fields inherited from class org.apache.hive.streaming.AbstractRecordWriter

acidOutputFormat, addedPartitions, autoFlush, bucketFieldData, bucketIds, bucketObjInspectors, bucketStructFields, conf, conn, curBatchMaxWriteId, curBatchMinWriteId, defaultPartitionName, fs, fullyQualifiedTableName, heapMemoryMonitor, ingestSizeBytes, ingestSizeThreshold, inputColumns, inputRowObjectInspector, inputTypes, isBucketed, lineDelimiter, lowMemoryCanary, memoryUsageThreshold, outputRowObjectInspector, partitionColumns, partitionFieldData, partitionObjInspectors, partitionPaths, partitionStructFields, table, totalBuckets, updaters

Constructor Summary

Constructors

Constructor and Description
StrictJsonWriter(StrictJsonWriter.Builder builder)

Method Summary

Modifier and Type	Method and Description
JsonSerDe	createSerde() Creates JsonSerDe
Object	encode(byte[] utf8StrRecord) Encode a record as an Object that Hive can read with the ObjectInspector associated with the serde returned by AbstractRecordWriter.createSerde().
static StrictJsonWriter.Builder	newBuilder()

Methods inherited from class org.apache.hive.streaming.AbstractRecordWriter

checkAutoFlush, close, createRecordUpdater, flush, getBucket, getBucketColIDs, getBucketFields, getObjectInspectorsForBucketedCols, getPartitionFields, getPartitions, getPartitionValues, getRecordUpdater, getWatermark, init, initializeBuckets, logStats, prepareBucketingFields, preparePartitioningFields, setupMemoryMonitoring, write, write

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

StrictJsonWriter

public StrictJsonWriter(StrictJsonWriter.Builder builder)

Method Detail

newBuilder

public static StrictJsonWriter.Builder newBuilder()

createSerde

public JsonSerDe createSerde()
                      throws SerializationError

Creates JsonSerDe

Specified by:

createSerde in class AbstractRecordWriter

Returns:

- serde

Throws:

SerializationError - if serde could not be initialized

encode

public Object encode(byte[] utf8StrRecord)
              throws SerializationError

Description copied from class: AbstractRecordWriter

Encode a record as an Object that Hive can read with the ObjectInspector associated with the serde returned by AbstractRecordWriter.createSerde(). This is public so that test frameworks can use it.

Specified by:

encode in class AbstractRecordWriter

Parameters:

utf8StrRecord - record to be deserialized

Returns:

deserialized record as an Object

Throws:

SerializationError - - any error during serialization or deserialization of record