org.apache.hadoop.hive.metastore

Interface FileFormatProxy

All Known Implementing Classes:

OrcFileFormatProxy

public interface FileFormatProxy

Same as PartitionExpressionProxy, but for file format specific methods for metadata cache.

Method Summary

Modifier and Type	Method and Description
org.apache.hadoop.hive.metastore.Metastore.SplitInfos	applySargToMetadata(org.apache.hadoop.hive.ql.io.sarg.SearchArgument sarg, ByteBuffer fileMetadata) Applies SARG to file metadata, and produces some result for this file.
ByteBuffer[]	getAddedColumnsToCache()
ByteBuffer[][]	getAddedValuesToCache(List<ByteBuffer> metadata)
ByteBuffer	getMetadataToCache(org.apache.hadoop.fs.FileSystem fs, org.apache.hadoop.fs.Path path, ByteBuffer[] addedVals)

Method Detail

applySargToMetadata

org.apache.hadoop.hive.metastore.Metastore.SplitInfos applySargToMetadata(org.apache.hadoop.hive.ql.io.sarg.SearchArgument sarg,
                                                                          ByteBuffer fileMetadata)
                                                                   throws IOException

Applies SARG to file metadata, and produces some result for this file.

Parameters:

sarg - SARG

fileMetadata - File metadata from metastore cache.

Returns:

The result to return to client for this file, or null if file is eliminated.

Throws:

IOException

getMetadataToCache

ByteBuffer getMetadataToCache(org.apache.hadoop.fs.FileSystem fs,
                              org.apache.hadoop.fs.Path path,
                              ByteBuffer[] addedVals)
                       throws IOException

Parameters:

fs - The filesystem of the file.

path - The file path.

addedVals - Output parameter; additional column values for columns returned by getAddedColumnsToCache to cache in MS.

Returns:

The ORC file metadata for a given file.

Throws:

IOException

getAddedColumnsToCache

ByteBuffer[] getAddedColumnsToCache()

Returns:

Additional column names to cache in MS for this format.

getAddedValuesToCache

ByteBuffer[][] getAddedValuesToCache(List<ByteBuffer> metadata)

Parameters:

metadata - File metadatas.

Returns:

Additional values for columns returned by getAddedColumnsToCache to cache in MS for respective metadatas.