org.apache.hadoop.hive.contrib.serde2

Class MultiDelimitSerDe

java.lang.Object

org.apache.hadoop.hive.serde2.AbstractSerDe

org.apache.hadoop.hive.serde2.AbstractEncodingAwareSerDe

org.apache.hadoop.hive.contrib.serde2.MultiDelimitSerDe

All Implemented Interfaces:

Deserializer, Serializer

public class MultiDelimitSerDe
extends AbstractEncodingAwareSerDe

This SerDe allows user to use multiple characters as the field delimiter for a table. To use this SerDe, user has to specify field.delim in SERDEPROPERTIES. If the table contains a column which is a collection or map, user can optionally specify collection.delim or mapkey.delim as well. Currently field.delim can be multiple character while collection.delim and mapkey.delim should be just single character.

Field Summary

Fields inherited from class org.apache.hadoop.hive.serde2.AbstractEncodingAwareSerDe

charset

Fields inherited from class org.apache.hadoop.hive.serde2.AbstractSerDe

configErrors

Constructor Summary

Constructors

Constructor and Description
MultiDelimitSerDe()

Method Summary

Modifier and Type	Method and Description
Object	doDeserialize(org.apache.hadoop.io.Writable blob)
org.apache.hadoop.io.Writable	doSerialize(Object obj, ObjectInspector objInspector)
ObjectInspector	getObjectInspector() Get the object inspector that can be used to navigate through the internal structure of the Object returned from deserialize(...).
SerDeStats	getSerDeStats() Returns statistics collected when serializing
Class<? extends org.apache.hadoop.io.Writable>	getSerializedClass() Returns the Writable class that would be returned by the serialize method.
void	initialize(org.apache.hadoop.conf.Configuration conf, Properties tbl) Initialize the HiveSerializer.
protected org.apache.hadoop.io.Text	transformFromUTF8(org.apache.hadoop.io.Writable blob) transform Writable data from UTF-8 to charset before serialize.
protected org.apache.hadoop.io.Text	transformToUTF8(org.apache.hadoop.io.Writable blob) transform Writable data from charset to UTF-8 before doDeserialize.

Methods inherited from class org.apache.hadoop.hive.serde2.AbstractEncodingAwareSerDe

deserialize, serialize

Methods inherited from class org.apache.hadoop.hive.serde2.AbstractSerDe

getConfigurationErrors, initialize, shouldStoreFieldsInMetastore

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

MultiDelimitSerDe

public MultiDelimitSerDe()

Method Detail

initialize

public void initialize(org.apache.hadoop.conf.Configuration conf,
                       Properties tbl)
                throws SerDeException

Description copied from class: AbstractSerDe

Initialize the HiveSerializer.

Specified by:

initialize in interface Deserializer

Specified by:

initialize in interface Serializer

Overrides:

initialize in class AbstractEncodingAwareSerDe

Parameters:

conf - System properties. Can be null in compile time

tbl - table properties

Throws:

SerDeException

getObjectInspector

public ObjectInspector getObjectInspector()
                                   throws SerDeException

Description copied from class: AbstractSerDe

Get the object inspector that can be used to navigate through the internal structure of the Object returned from deserialize(...).

Specified by:

getObjectInspector in interface Deserializer

Specified by:

getObjectInspector in class AbstractSerDe

Throws:

SerDeException

getSerializedClass

public Class<? extends org.apache.hadoop.io.Writable> getSerializedClass()

Description copied from class: AbstractSerDe

Returns the Writable class that would be returned by the serialize method. This is used to initialize SequenceFile header.

Specified by:

getSerializedClass in interface Serializer

Specified by:

getSerializedClass in class AbstractSerDe

doDeserialize

public Object doDeserialize(org.apache.hadoop.io.Writable blob)
                     throws SerDeException

Specified by:

doDeserialize in class AbstractEncodingAwareSerDe

Throws:

SerDeException

doSerialize

public org.apache.hadoop.io.Writable doSerialize(Object obj,
                                                 ObjectInspector objInspector)
                                          throws SerDeException

Specified by:

doSerialize in class AbstractEncodingAwareSerDe

Throws:

SerDeException

transformFromUTF8

protected org.apache.hadoop.io.Text transformFromUTF8(org.apache.hadoop.io.Writable blob)

Description copied from class: AbstractEncodingAwareSerDe

transform Writable data from UTF-8 to charset before serialize.

Specified by:

transformFromUTF8 in class AbstractEncodingAwareSerDe

Returns:

transformToUTF8

protected org.apache.hadoop.io.Text transformToUTF8(org.apache.hadoop.io.Writable blob)

Description copied from class: AbstractEncodingAwareSerDe

transform Writable data from charset to UTF-8 before doDeserialize.

Specified by:

transformToUTF8 in class AbstractEncodingAwareSerDe

Returns:

getSerDeStats

public SerDeStats getSerDeStats()

Description copied from class: AbstractSerDe

Returns statistics collected when serializing

Specified by:

getSerDeStats in interface Deserializer

Specified by:

getSerDeStats in interface Serializer

Specified by:

getSerDeStats in class AbstractSerDe