org.apache.hadoop.hive.ql.io

Class AcidUtils.DirectoryImpl

java.lang.Object

org.apache.hadoop.hive.ql.io.AcidUtils.DirectoryImpl

All Implemented Interfaces:

AcidUtils.Directory

Enclosing class:

AcidUtils

public static final class AcidUtils.DirectoryImpl
extends Object
implements AcidUtils.Directory

Constructor Summary

Constructors

Constructor and Description
DirectoryImpl(List<org.apache.hadoop.fs.FileStatus> abortedDirectories, boolean isBaseInRawFormat, List<HadoopShims.HdfsFileStatusWithId> original, List<org.apache.hadoop.fs.FileStatus> obsolete, List<AcidUtils.ParsedDelta> deltas, org.apache.hadoop.fs.Path base)

Method Summary

Modifier and Type	Method and Description
List<org.apache.hadoop.fs.FileStatus>	getAbortedDirectories() Get the list of directories that has nothing but aborted transactions.
org.apache.hadoop.fs.Path	getBaseDirectory() Get the base directory.
List<AcidUtils.ParsedDelta>	getCurrentDirectories() Get the list of base and delta directories that are valid and not obsolete.
List<org.apache.hadoop.fs.FileStatus>	getObsolete() Get the list of obsolete directories.
List<HadoopShims.HdfsFileStatusWithId>	getOriginalFiles() Get the list of original files.
boolean	isBaseInRawFormat()

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

DirectoryImpl

public DirectoryImpl(List<org.apache.hadoop.fs.FileStatus> abortedDirectories,
                     boolean isBaseInRawFormat,
                     List<HadoopShims.HdfsFileStatusWithId> original,
                     List<org.apache.hadoop.fs.FileStatus> obsolete,
                     List<AcidUtils.ParsedDelta> deltas,
                     org.apache.hadoop.fs.Path base)

Method Detail

getBaseDirectory

public org.apache.hadoop.fs.Path getBaseDirectory()

Description copied from interface: AcidUtils.Directory

Get the base directory.

Specified by:

getBaseDirectory in interface AcidUtils.Directory

Returns:

the base directory to read

isBaseInRawFormat

public boolean isBaseInRawFormat()

Specified by:

isBaseInRawFormat in interface AcidUtils.Directory

getOriginalFiles

public List<HadoopShims.HdfsFileStatusWithId> getOriginalFiles()

Description copied from interface: AcidUtils.Directory

Get the list of original files. Not null. Must be sorted.

Specified by:

getOriginalFiles in interface AcidUtils.Directory

Returns:

the list of original files (eg. 000000_0)

getCurrentDirectories

public List<AcidUtils.ParsedDelta> getCurrentDirectories()

Description copied from interface: AcidUtils.Directory

Get the list of base and delta directories that are valid and not obsolete. Not null. List must be sorted in a specific way. See AcidUtils.ParsedDelta.compareTo(org.apache.hadoop.hive.ql.io.AcidUtils.ParsedDelta) for details.

Specified by:

getCurrentDirectories in interface AcidUtils.Directory

Returns:

the minimal list of current directories

getObsolete

public List<org.apache.hadoop.fs.FileStatus> getObsolete()

Description copied from interface: AcidUtils.Directory

Get the list of obsolete directories. After filtering out bases and deltas that are not selected by the valid transaction/write ids list, return the list of original files, bases, and deltas that have been replaced by more up to date ones. Not null.

Specified by:

getObsolete in interface AcidUtils.Directory

getAbortedDirectories

public List<org.apache.hadoop.fs.FileStatus> getAbortedDirectories()

Description copied from interface: AcidUtils.Directory

Get the list of directories that has nothing but aborted transactions.

Specified by:

getAbortedDirectories in interface AcidUtils.Directory

Returns:

the list of aborted directories