org.apache.hadoop.hive.metastore.messaging.json

Class JSONMessageFactory

java.lang.Object

org.apache.hadoop.hive.metastore.messaging.MessageFactory

org.apache.hadoop.hive.metastore.messaging.json.JSONMessageFactory

public class JSONMessageFactory
extends MessageFactory

The JSON implementation of the MessageFactory. Constructs JSON implementations of each message-type.

Field Summary

Fields inherited from class org.apache.hadoop.hive.metastore.messaging.MessageFactory

ABORT_TXN_EVENT, ADD_FOREIGNKEY_EVENT, ADD_NOTNULLCONSTRAINT_EVENT, ADD_PARTITION_EVENT, ADD_PRIMARYKEY_EVENT, ADD_SCHEMA_VERSION_EVENT, ADD_UNIQUECONSTRAINT_EVENT, ALLOC_WRITE_ID_EVENT, ALTER_CATALOG_EVENT, ALTER_DATABASE_EVENT, ALTER_ISCHEMA_EVENT, ALTER_PARTITION_EVENT, ALTER_SCHEMA_VERSION_EVENT, ALTER_TABLE_EVENT, COMMIT_TXN_EVENT, conf, CREATE_CATALOG_EVENT, CREATE_DATABASE_EVENT, CREATE_FUNCTION_EVENT, CREATE_ISCHEMA_EVENT, CREATE_TABLE_EVENT, DROP_CATALOG_EVENT, DROP_CONSTRAINT_EVENT, DROP_DATABASE_EVENT, DROP_FUNCTION_EVENT, DROP_ISCHEMA_EVENT, DROP_PARTITION_EVENT, DROP_SCHEMA_VERSION_EVENT, DROP_TABLE_EVENT, INSERT_EVENT, MS_SERVER_URL, MS_SERVICE_PRINCIPAL, OPEN_TXN_EVENT

Constructor Summary

Constructors

Constructor and Description
JSONMessageFactory()

Method Summary

Modifier and Type	Method and Description
AbortTxnMessage	buildAbortTxnMessage(Long txnId) Factory method for building abort txn message
AddForeignKeyMessage	buildAddForeignKeyMessage(List<org.apache.hadoop.hive.metastore.api.SQLForeignKey> fks) Factory method for building add foreign key message
AddNotNullConstraintMessage	buildAddNotNullConstraintMessage(List<org.apache.hadoop.hive.metastore.api.SQLNotNullConstraint> nns) Factory method for building add not null constraint message
AddPartitionMessage	buildAddPartitionMessage(org.apache.hadoop.hive.metastore.api.Table table, Iterator<org.apache.hadoop.hive.metastore.api.Partition> partitionsIterator, Iterator<PartitionFiles> partitionFileIter) Factory method for AddPartitionMessage.
AddPrimaryKeyMessage	buildAddPrimaryKeyMessage(List<org.apache.hadoop.hive.metastore.api.SQLPrimaryKey> pks) Factory method for building add primary key message
AddUniqueConstraintMessage	buildAddUniqueConstraintMessage(List<org.apache.hadoop.hive.metastore.api.SQLUniqueConstraint> uks) Factory method for building add unique constraint message
AllocWriteIdMessage	buildAllocWriteIdMessage(List<org.apache.hadoop.hive.metastore.api.TxnToWriteId> txnToWriteIdList, String dbName, String tableName) Factory method for building alloc write id message
AlterCatalogMessage	buildAlterCatalogMessage(org.apache.hadoop.hive.metastore.api.Catalog beforeCat, org.apache.hadoop.hive.metastore.api.Catalog afterCat)
AlterDatabaseMessage	buildAlterDatabaseMessage(org.apache.hadoop.hive.metastore.api.Database beforeDb, org.apache.hadoop.hive.metastore.api.Database afterDb) Factory method for AlterDatabaseMessage.
AlterPartitionMessage	buildAlterPartitionMessage(org.apache.hadoop.hive.metastore.api.Table table, org.apache.hadoop.hive.metastore.api.Partition before, org.apache.hadoop.hive.metastore.api.Partition after, boolean isTruncateOp) Factory method for building AlterPartitionMessage
AlterTableMessage	buildAlterTableMessage(org.apache.hadoop.hive.metastore.api.Table before, org.apache.hadoop.hive.metastore.api.Table after, boolean isTruncateOp) Factory method for AlterTableMessage.
CommitTxnMessage	buildCommitTxnMessage(Long txnId) Factory method for building commit txn message
CreateCatalogMessage	buildCreateCatalogMessage(org.apache.hadoop.hive.metastore.api.Catalog catalog)
CreateDatabaseMessage	buildCreateDatabaseMessage(org.apache.hadoop.hive.metastore.api.Database db) Factory method for CreateDatabaseMessage.
CreateFunctionMessage	buildCreateFunctionMessage(org.apache.hadoop.hive.metastore.api.Function fn) Factory method for CreateFunctionMessage.
CreateTableMessage	buildCreateTableMessage(org.apache.hadoop.hive.metastore.api.Table table, Iterator<String> fileIter) Factory method for CreateTableMessage.
DropCatalogMessage	buildDropCatalogMessage(org.apache.hadoop.hive.metastore.api.Catalog catalog)
DropConstraintMessage	buildDropConstraintMessage(String dbName, String tableName, String constraintName) Factory method for building drop constraint message
DropDatabaseMessage	buildDropDatabaseMessage(org.apache.hadoop.hive.metastore.api.Database db) Factory method for DropDatabaseMessage.
DropFunctionMessage	buildDropFunctionMessage(org.apache.hadoop.hive.metastore.api.Function fn) Factory method for DropFunctionMessage.
DropPartitionMessage	buildDropPartitionMessage(org.apache.hadoop.hive.metastore.api.Table table, Iterator<org.apache.hadoop.hive.metastore.api.Partition> partitionsIterator) Factory method for DropPartitionMessage.
DropTableMessage	buildDropTableMessage(org.apache.hadoop.hive.metastore.api.Table table) Factory method for DropTableMessage.
InsertMessage	buildInsertMessage(org.apache.hadoop.hive.metastore.api.Table tableObj, org.apache.hadoop.hive.metastore.api.Partition partObj, boolean replace, Iterator<String> fileIter) Factory method for building insert message
OpenTxnMessage	buildOpenTxnMessage(Long fromTxnId, Long toTxnId) Factory method for building open txn message using start and end transaction range
MessageDeserializer	getDeserializer()
static org.codehaus.jackson.node.ObjectNode	getJsonTree(org.apache.hadoop.hive.metastore.api.NotificationEvent event)
static org.codehaus.jackson.node.ObjectNode	getJsonTree(String eventMessage)
String	getMessageFormat() Getter for message-format.
static org.apache.hadoop.hive.metastore.api.Table	getTableObj(org.codehaus.jackson.node.ObjectNode jsonTree)
static org.apache.thrift.TBase	getTObj(String tSerialized, Class<? extends org.apache.thrift.TBase> objClass)
static Iterable<? extends org.apache.thrift.TBase>	getTObjs(Iterable<String> objRefStrs, Class<? extends org.apache.thrift.TBase> objClass)
static Iterable<? extends org.apache.thrift.TBase>	getTObjs(org.codehaus.jackson.node.ObjectNode jsonTree, String objRefListName, Class<? extends org.apache.thrift.TBase> objClass)

Methods inherited from class org.apache.hadoop.hive.metastore.messaging.MessageFactory

getDeserializer, getInstance

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

JSONMessageFactory

public JSONMessageFactory()

Method Detail

getDeserializer

public MessageDeserializer getDeserializer()

Specified by:

getDeserializer in class MessageFactory

getMessageFormat

public String getMessageFormat()

Description copied from class: MessageFactory

Getter for message-format.

Specified by:

getMessageFormat in class MessageFactory

buildCreateDatabaseMessage

public CreateDatabaseMessage buildCreateDatabaseMessage(org.apache.hadoop.hive.metastore.api.Database db)

Description copied from class: MessageFactory

Factory method for CreateDatabaseMessage.

Specified by:

buildCreateDatabaseMessage in class MessageFactory

Parameters:

db - The Database being added.

Returns:

CreateDatabaseMessage instance.

buildAlterDatabaseMessage

public AlterDatabaseMessage buildAlterDatabaseMessage(org.apache.hadoop.hive.metastore.api.Database beforeDb,
                                                      org.apache.hadoop.hive.metastore.api.Database afterDb)

Description copied from class: MessageFactory

Factory method for AlterDatabaseMessage.

Specified by:

buildAlterDatabaseMessage in class MessageFactory

Parameters:

beforeDb - The Database before alter.

afterDb - The Database after alter.

Returns:

AlterDatabaseMessage instance.

buildDropDatabaseMessage

public DropDatabaseMessage buildDropDatabaseMessage(org.apache.hadoop.hive.metastore.api.Database db)

Description copied from class: MessageFactory

Factory method for DropDatabaseMessage.

Specified by:

buildDropDatabaseMessage in class MessageFactory

Parameters:

db - The Database being dropped.

Returns:

DropDatabaseMessage instance.

buildCreateTableMessage

public CreateTableMessage buildCreateTableMessage(org.apache.hadoop.hive.metastore.api.Table table,
                                                  Iterator<String> fileIter)

Description copied from class: MessageFactory

Factory method for CreateTableMessage.

Specified by:

buildCreateTableMessage in class MessageFactory

Parameters:

table - The Table being created.

fileIter - Iterator of files

Returns:

CreateTableMessage instance.

buildAlterTableMessage

public AlterTableMessage buildAlterTableMessage(org.apache.hadoop.hive.metastore.api.Table before,
                                                org.apache.hadoop.hive.metastore.api.Table after,
                                                boolean isTruncateOp)

Description copied from class: MessageFactory

Factory method for AlterTableMessage. Unlike most of these calls, this one can return null, which means no message should be sent. This is because there are many flavors of alter table (add column, add partition, etc.). Some are covered elsewhere (like add partition) and some are not yet supported.

Specified by:

buildAlterTableMessage in class MessageFactory

Parameters:

before - The table before the alter

after - The table after the alter

isTruncateOp - Flag to denote truncate table

Returns:

buildDropTableMessage

public DropTableMessage buildDropTableMessage(org.apache.hadoop.hive.metastore.api.Table table)

Description copied from class: MessageFactory

Factory method for DropTableMessage.

Specified by:

buildDropTableMessage in class MessageFactory

Parameters:

table - The Table being dropped.

Returns:

DropTableMessage instance.

buildAddPartitionMessage

public AddPartitionMessage buildAddPartitionMessage(org.apache.hadoop.hive.metastore.api.Table table,
                                                    Iterator<org.apache.hadoop.hive.metastore.api.Partition> partitionsIterator,
                                                    Iterator<PartitionFiles> partitionFileIter)

Description copied from class: MessageFactory

Factory method for AddPartitionMessage.

Specified by:

buildAddPartitionMessage in class MessageFactory

Parameters:

table - The Table to which the partitions are added.

partitionsIterator - The iterator to set of Partitions being added.

partitionFileIter - The iterator of partition files

Returns:

AddPartitionMessage instance.

buildAlterPartitionMessage

public AlterPartitionMessage buildAlterPartitionMessage(org.apache.hadoop.hive.metastore.api.Table table,
                                                        org.apache.hadoop.hive.metastore.api.Partition before,
                                                        org.apache.hadoop.hive.metastore.api.Partition after,
                                                        boolean isTruncateOp)

Description copied from class: MessageFactory

Factory method for building AlterPartitionMessage

Specified by:

buildAlterPartitionMessage in class MessageFactory

Parameters:

table - The table in which the partition is being altered

before - The partition before it was altered

after - The partition after it was altered

isTruncateOp - Flag to denote truncate partition

Returns:

a new AlterPartitionMessage

buildDropPartitionMessage

public DropPartitionMessage buildDropPartitionMessage(org.apache.hadoop.hive.metastore.api.Table table,
                                                      Iterator<org.apache.hadoop.hive.metastore.api.Partition> partitionsIterator)

Description copied from class: MessageFactory

Factory method for DropPartitionMessage.

Specified by:

buildDropPartitionMessage in class MessageFactory

Parameters:

table - The Table from which the partition is dropped.

partitionsIterator - The set of partitions being dropped.

Returns:

DropPartitionMessage instance.

buildCreateFunctionMessage

public CreateFunctionMessage buildCreateFunctionMessage(org.apache.hadoop.hive.metastore.api.Function fn)

Description copied from class: MessageFactory

Factory method for CreateFunctionMessage.

Specified by:

buildCreateFunctionMessage in class MessageFactory

Parameters:

fn - The Function being added.

Returns:

CreateFunctionMessage instance.

buildDropFunctionMessage

public DropFunctionMessage buildDropFunctionMessage(org.apache.hadoop.hive.metastore.api.Function fn)

Description copied from class: MessageFactory

Factory method for DropFunctionMessage.

Specified by:

buildDropFunctionMessage in class MessageFactory

Parameters:

fn - The Function being dropped.

Returns:

DropFunctionMessage instance.

buildInsertMessage

public InsertMessage buildInsertMessage(org.apache.hadoop.hive.metastore.api.Table tableObj,
                                        org.apache.hadoop.hive.metastore.api.Partition partObj,
                                        boolean replace,
                                        Iterator<String> fileIter)

Description copied from class: MessageFactory

Factory method for building insert message

Specified by:

buildInsertMessage in class MessageFactory

Parameters:

tableObj - Table object where the insert occurred in

partObj - Partition object where the insert occurred in, may be null if the insert was done into a non-partitioned table

replace - Flag to represent if INSERT OVERWRITE or INSERT INTO

fileIter - Iterator of file created

Returns:

instance of InsertMessage

buildAddPrimaryKeyMessage

public AddPrimaryKeyMessage buildAddPrimaryKeyMessage(List<org.apache.hadoop.hive.metastore.api.SQLPrimaryKey> pks)

Description copied from class: MessageFactory

Factory method for building add primary key message

Specified by:

buildAddPrimaryKeyMessage in class MessageFactory

Parameters:

pks - list of primary keys

Returns:

instance of AddPrimaryKeyMessage

buildAddForeignKeyMessage

public AddForeignKeyMessage buildAddForeignKeyMessage(List<org.apache.hadoop.hive.metastore.api.SQLForeignKey> fks)

Description copied from class: MessageFactory

Factory method for building add foreign key message

Specified by:

buildAddForeignKeyMessage in class MessageFactory

Parameters:

fks - list of foreign keys

Returns:

instance of AddForeignKeyMessage

buildAddUniqueConstraintMessage

public AddUniqueConstraintMessage buildAddUniqueConstraintMessage(List<org.apache.hadoop.hive.metastore.api.SQLUniqueConstraint> uks)

Description copied from class: MessageFactory

Factory method for building add unique constraint message

Specified by:

buildAddUniqueConstraintMessage in class MessageFactory

Parameters:

uks - list of unique constraints

Returns:

instance of SQLUniqueConstraint

buildAddNotNullConstraintMessage

public AddNotNullConstraintMessage buildAddNotNullConstraintMessage(List<org.apache.hadoop.hive.metastore.api.SQLNotNullConstraint> nns)

Description copied from class: MessageFactory

Factory method for building add not null constraint message

Specified by:

buildAddNotNullConstraintMessage in class MessageFactory

Parameters:

nns - list of not null constraints

Returns:

instance of SQLNotNullConstraint

buildDropConstraintMessage

public DropConstraintMessage buildDropConstraintMessage(String dbName,
                                                        String tableName,
                                                        String constraintName)

Description copied from class: MessageFactory

Factory method for building drop constraint message

Specified by:

buildDropConstraintMessage in class MessageFactory

Returns:

buildCreateCatalogMessage

public CreateCatalogMessage buildCreateCatalogMessage(org.apache.hadoop.hive.metastore.api.Catalog catalog)

Specified by:

buildCreateCatalogMessage in class MessageFactory

buildAlterCatalogMessage

public AlterCatalogMessage buildAlterCatalogMessage(org.apache.hadoop.hive.metastore.api.Catalog beforeCat,
                                                    org.apache.hadoop.hive.metastore.api.Catalog afterCat)

Specified by:

buildAlterCatalogMessage in class MessageFactory

buildDropCatalogMessage

public DropCatalogMessage buildDropCatalogMessage(org.apache.hadoop.hive.metastore.api.Catalog catalog)

Specified by:

buildDropCatalogMessage in class MessageFactory

buildOpenTxnMessage

public OpenTxnMessage buildOpenTxnMessage(Long fromTxnId,
                                          Long toTxnId)

Description copied from class: MessageFactory

Factory method for building open txn message using start and end transaction range

Specified by:

buildOpenTxnMessage in class MessageFactory

Parameters:

fromTxnId - start transaction id (inclusive)

toTxnId - end transaction id (inclusive)

Returns:

instance of OpenTxnMessage

buildCommitTxnMessage

public CommitTxnMessage buildCommitTxnMessage(Long txnId)

Description copied from class: MessageFactory

Factory method for building commit txn message

Specified by:

buildCommitTxnMessage in class MessageFactory

Parameters:

txnId - Id of the transaction to be committed

Returns:

instance of CommitTxnMessage

buildAbortTxnMessage

public AbortTxnMessage buildAbortTxnMessage(Long txnId)

Description copied from class: MessageFactory

Factory method for building abort txn message

Specified by:

buildAbortTxnMessage in class MessageFactory

Parameters:

txnId - Id of the transaction to be aborted

Returns:

instance of AbortTxnMessage

buildAllocWriteIdMessage

public AllocWriteIdMessage buildAllocWriteIdMessage(List<org.apache.hadoop.hive.metastore.api.TxnToWriteId> txnToWriteIdList,
                                                    String dbName,
                                                    String tableName)

Description copied from class: MessageFactory

Factory method for building alloc write id message

Specified by:

buildAllocWriteIdMessage in class MessageFactory

Parameters:

txnToWriteIdList - List of Txn Ids and write id map

dbName - db for which write ids to be allocated

tableName - table for which write ids to be allocated

Returns:

instance of AllocWriteIdMessage

getJsonTree

public static org.codehaus.jackson.node.ObjectNode getJsonTree(org.apache.hadoop.hive.metastore.api.NotificationEvent event)
                                                        throws Exception

Throws:

Exception

getJsonTree

public static org.codehaus.jackson.node.ObjectNode getJsonTree(String eventMessage)
                                                        throws Exception

Throws:

Exception

getTableObj

public static org.apache.hadoop.hive.metastore.api.Table getTableObj(org.codehaus.jackson.node.ObjectNode jsonTree)
                                                              throws Exception

Throws:

Exception

getTObj

public static org.apache.thrift.TBase getTObj(String tSerialized,
                                              Class<? extends org.apache.thrift.TBase> objClass)
                                       throws Exception

Throws:

Exception

getTObjs

public static Iterable<? extends org.apache.thrift.TBase> getTObjs(Iterable<String> objRefStrs,
                                                                   Class<? extends org.apache.thrift.TBase> objClass)
                                                            throws Exception

Throws:

Exception

getTObjs

public static Iterable<? extends org.apache.thrift.TBase> getTObjs(org.codehaus.jackson.node.ObjectNode jsonTree,
                                                                   String objRefListName,
                                                                   Class<? extends org.apache.thrift.TBase> objClass)
                                                            throws Exception

Throws:

Exception