org.apache.hive.hcatalog.templeton.tool

Interface TempletonStorage

All Known Implementing Classes:

HDFSStorage, ZooKeeperStorage

public interface TempletonStorage

An interface to handle different Templeton storage methods, including ZooKeeper and HDFS. Any storage scheme must be able to handle being run in an HDFS environment, where specific file systems and virtual machines may not be available. Storage is done individually in a hierarchy: type (the data type, as listed below), then the id (a given jobid, jobtrackingid, etc.), then the key/value pairs. So an entry might look like: JOB jobid00035 user -> rachel datecreated -> 2/5/12 etc. Each field must be available to be fetched/changed individually.

Nested Class Summary

Nested Classes

Modifier and Type	Interface and Description
static class	TempletonStorage.Type

Field Summary

Fields

Modifier and Type	Field and Description
static String	STORAGE_CLASS
static String	STORAGE_ROOT

Method Summary

Modifier and Type	Method and Description
void	closeStorage() For storage methods that require a connection, this is a hint that it's time to close the connection.
boolean	delete(TempletonStorage.Type type, String id) Delete a data grouping (all data for a jobid, all tracking data for a job, etc.).
List<String>	getAllForType(TempletonStorage.Type type) Get the id of each data grouping of a given type in the storage system.
String	getField(TempletonStorage.Type type, String id, String key) Get the value of one field for a given data type.
void	openStorage(org.apache.hadoop.conf.Configuration config) For storage methods that require a connection, this is a hint that it's time to open a connection.
void	saveField(TempletonStorage.Type type, String id, String key, String val) Save a single key/value pair for a specific job id.
void	startCleanup(org.apache.hadoop.conf.Configuration config) Start the cleanup process for this storage type.

Field Detail

STORAGE_CLASS

static final String STORAGE_CLASS

See Also:

Constant Field Values

STORAGE_ROOT

static final String STORAGE_ROOT

See Also:

Constant Field Values

Method Detail

startCleanup

void startCleanup(org.apache.hadoop.conf.Configuration config)

Start the cleanup process for this storage type.

Parameters:

config -

saveField

void saveField(TempletonStorage.Type type,
               String id,
               String key,
               String val)
        throws NotFoundException

Save a single key/value pair for a specific job id.

Parameters:

type - The data type (as listed above)

id - The String id of this data grouping (jobid, etc.)

key - The name of the field to save

val - The value of the field to save

Throws:

NotFoundException

getField

String getField(TempletonStorage.Type type,
                String id,
                String key)

Get the value of one field for a given data type. If the type is UNKNOWN, search for the id in all types.

Parameters:

type - The data type (as listed above)

id - The String id of this data grouping (jobid, etc.)

key - The name of the field to retrieve

Returns:

The value of the field requested, or null if not found.

delete

boolean delete(TempletonStorage.Type type,
               String id)
        throws NotFoundException

Delete a data grouping (all data for a jobid, all tracking data for a job, etc.). If the type is UNKNOWN, search for the id in all types.

Parameters:

type - The data type (as listed above)

id - The String id of this data grouping (jobid, etc.)

Returns:

True if successful, false if not, throws NotFoundException if the id wasn't found.

Throws:

NotFoundException

getAllForType

List<String> getAllForType(TempletonStorage.Type type)

Get the id of each data grouping of a given type in the storage system.

Parameters:

type - The data type (as listed above)

Returns:

A list of ids.

openStorage

void openStorage(org.apache.hadoop.conf.Configuration config)
          throws IOException

For storage methods that require a connection, this is a hint that it's time to open a connection.

Throws:

IOException

closeStorage

void closeStorage()
           throws IOException

For storage methods that require a connection, this is a hint that it's time to close the connection.

Throws:

IOException