org.apache.hive.streaming

Class StrictRegexWriter

java.lang.Object

org.apache.hive.streaming.AbstractRecordWriter

org.apache.hive.streaming.StrictRegexWriter

All Implemented Interfaces:

RecordWriter

public class StrictRegexWriter
extends AbstractRecordWriter

Streaming Writer handles text input data with regex. Uses org.apache.hadoop.hive.serde2.RegexSerDe NOTE: This record writer is NOT thread-safe. Use one record writer per streaming connection.

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
static class	StrictRegexWriter.Builder

Nested classes/interfaces inherited from class org.apache.hive.streaming.AbstractRecordWriter

AbstractRecordWriter.OrcMemoryPressureMonitor

Field Summary

Fields inherited from class org.apache.hive.streaming.AbstractRecordWriter

acidOutputFormat, addedPartitions, autoFlush, bucketFieldData, bucketIds, bucketObjInspectors, bucketStructFields, conf, conn, curBatchMaxWriteId, curBatchMinWriteId, defaultPartitionName, fs, fullyQualifiedTableName, heapMemoryMonitor, ingestSizeBytes, ingestSizeThreshold, inputColumns, inputRowObjectInspector, inputTypes, isBucketed, lineDelimiter, lowMemoryCanary, memoryUsageThreshold, outputRowObjectInspector, partitionColumns, partitionFieldData, partitionObjInspectors, partitionPaths, partitionStructFields, table, totalBuckets, updaters

Method Summary

Modifier and Type	Method and Description
RegexSerDe	createSerde() Creates RegexSerDe
Object	encode(byte[] utf8StrRecord) Encode Utf8 encoded string bytes using RegexSerDe
static StrictRegexWriter.Builder	newBuilder()

Methods inherited from class org.apache.hive.streaming.AbstractRecordWriter

checkAutoFlush, close, createRecordUpdater, flush, getBucket, getBucketColIDs, getBucketFields, getObjectInspectorsForBucketedCols, getPartitionFields, getPartitions, getPartitionValues, getRecordUpdater, getWatermark, init, initializeBuckets, logStats, prepareBucketingFields, preparePartitioningFields, setupMemoryMonitoring, write, write

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Method Detail

newBuilder

public static StrictRegexWriter.Builder newBuilder()

createSerde

public RegexSerDe createSerde()
                       throws SerializationError

Creates RegexSerDe

Specified by:

createSerde in class AbstractRecordWriter

Returns:

- serde

Throws:

SerializationError - if serde could not be initialized

encode

public Object encode(byte[] utf8StrRecord)
              throws SerializationError

Encode Utf8 encoded string bytes using RegexSerDe

Specified by:

encode in class AbstractRecordWriter

Parameters:

utf8StrRecord - - serialized record

Returns:

The encoded object

Throws:

SerializationError - - in case of any deserialization error