org.apache.hadoop.hive.metastore

Class HiveMetaStoreUtils

java.lang.Object

org.apache.hadoop.hive.metastore.HiveMetaStoreUtils

public class HiveMetaStoreUtils
extends Object

Field Summary

Fields

Modifier and Type	Field and Description
protected static org.slf4j.Logger	LOG

Constructor Summary

Constructors

Constructor and Description
HiveMetaStoreUtils()

Method Summary

Modifier and Type	Method and Description
static Deserializer	getDeserializer(org.apache.hadoop.conf.Configuration conf, org.apache.hadoop.hive.metastore.api.Partition part, org.apache.hadoop.hive.metastore.api.Table table) getDeserializer Get the Deserializer for a partition.
static Deserializer	getDeserializer(org.apache.hadoop.conf.Configuration conf, org.apache.hadoop.hive.metastore.api.Table table, boolean skipConfError) getDeserializer Get the Deserializer for a table.
static Deserializer	getDeserializer(org.apache.hadoop.conf.Configuration conf, org.apache.hadoop.hive.metastore.api.Table table, boolean skipConfError, String lib)
static Class<? extends Deserializer>	getDeserializerClass(org.apache.hadoop.conf.Configuration conf, org.apache.hadoop.hive.metastore.api.Table table)
static org.apache.hadoop.hive.metastore.api.FieldSchema	getFieldSchemaFromTypeInfo(String fieldName, TypeInfo typeInfo) Convert TypeInfo to FieldSchema.
static List<org.apache.hadoop.hive.metastore.api.FieldSchema>	getFieldsFromDeserializer(String tableName, Deserializer deserializer)
static IMetaStoreClient	getHiveMetastoreClient(HiveConf hiveConf) Get or create a hive client depending on whether it exits in cache or not

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

LOG

protected static final org.slf4j.Logger LOG

Constructor Detail

HiveMetaStoreUtils

public HiveMetaStoreUtils()

Method Detail

getDeserializer

public static Deserializer getDeserializer(org.apache.hadoop.conf.Configuration conf,
                                           org.apache.hadoop.hive.metastore.api.Table table,
                                           boolean skipConfError)
                                    throws org.apache.hadoop.hive.metastore.api.MetaException

getDeserializer Get the Deserializer for a table.

Parameters:

conf - - hadoop config

table - the table

Returns:

Returns instantiated deserializer by looking up class name of deserializer stored in storage descriptor of passed in table. Also, initializes the deserializer with schema of table.

Throws:

org.apache.hadoop.hive.metastore.api.MetaException - if any problems instantiating the Deserializer todo - this should move somewhere into serde.jar

getDeserializer

public static Deserializer getDeserializer(org.apache.hadoop.conf.Configuration conf,
                                           org.apache.hadoop.hive.metastore.api.Table table,
                                           boolean skipConfError,
                                           String lib)
                                    throws org.apache.hadoop.hive.metastore.api.MetaException

Throws:

org.apache.hadoop.hive.metastore.api.MetaException

getDeserializerClass

public static Class<? extends Deserializer> getDeserializerClass(org.apache.hadoop.conf.Configuration conf,
                                                                 org.apache.hadoop.hive.metastore.api.Table table)
                                                          throws Exception

Throws:

Exception

getDeserializer

public static Deserializer getDeserializer(org.apache.hadoop.conf.Configuration conf,
                                           org.apache.hadoop.hive.metastore.api.Partition part,
                                           org.apache.hadoop.hive.metastore.api.Table table)
                                    throws org.apache.hadoop.hive.metastore.api.MetaException

getDeserializer Get the Deserializer for a partition.

Parameters:

conf - - hadoop config

part - the partition

table - the table

Returns:

Returns instantiated deserializer by looking up class name of deserializer stored in storage descriptor of passed in partition. Also, initializes the deserializer with schema of partition.

Throws:

org.apache.hadoop.hive.metastore.api.MetaException - if any problems instantiating the Deserializer

getFieldsFromDeserializer

public static List<org.apache.hadoop.hive.metastore.api.FieldSchema> getFieldsFromDeserializer(String tableName,
                                                                                               Deserializer deserializer)
                                                                                        throws SerDeException,
                                                                                               org.apache.hadoop.hive.metastore.api.MetaException

Parameters:

tableName - name of the table

deserializer - deserializer to use

Returns:

the list of fields

Throws:

SerDeException - if the serde throws an exception

org.apache.hadoop.hive.metastore.api.MetaException - if one of the fields or types in the table is invalid

getFieldSchemaFromTypeInfo

public static org.apache.hadoop.hive.metastore.api.FieldSchema getFieldSchemaFromTypeInfo(String fieldName,
                                                                                          TypeInfo typeInfo)

Convert TypeInfo to FieldSchema.

getHiveMetastoreClient

public static IMetaStoreClient getHiveMetastoreClient(HiveConf hiveConf)
                                               throws org.apache.hadoop.hive.metastore.api.MetaException,
                                                      IOException

Get or create a hive client depending on whether it exits in cache or not

Parameters:

hiveConf - The hive configuration

Returns:

the client

Throws:

org.apache.hadoop.hive.metastore.api.MetaException - When HiveMetaStoreClient couldn't be created

IOException