org.apache.hadoop.hdfs

类 ChecksumDistributedFileSystem

java.lang.Object

org.apache.hadoop.conf.Configured

org.apache.hadoop.fs.FileSystem

org.apache.hadoop.fs.FilterFileSystem

org.apache.hadoop.fs.ChecksumFileSystem

org.apache.hadoop.hdfs.ChecksumDistributedFileSystem

所有已实现的接口:

Closeable, AutoCloseable, Configurable

public class ChecksumDistributedFileSystem
extends ChecksumFileSystem

An implementation of ChecksumFileSystem over DistributedFileSystem. Note that as of now (May 07), DistributedFileSystem natively checksums all of its data. Using this class is not be necessary in most cases. Currently provided mainly for backward compatibility and testing.

嵌套类概要

从类继承的嵌套类/接口 org.apache.hadoop.fs.FileSystem

FileSystem.Statistics

字段概要

从类继承的字段 org.apache.hadoop.fs.FilterFileSystem

fs

从类继承的字段 org.apache.hadoop.fs.FileSystem

FS_DEFAULT_NAME_KEY, LOG, statistics

构造器概要

构造器

构造器和说明
ChecksumDistributedFileSystem()
ChecksumDistributedFileSystem(InetSocketAddress namenode, Configuration conf) 已过时。

方法概要

方法

限定符和类型	方法和说明
UpgradeStatusReport	distributedUpgradeProgress(FSConstants.UpgradeAction action)
void	finalizeUpgrade() Finalize previously upgraded files system state.
DatanodeInfo[]	getDataNodeStats() Return statistics for each datanode.
FileStatus	getFileStatus(Path f) Returns the stat information about the file.
long	getRawCapacity() Return the total raw capacity of the filesystem, disregarding replication .
long	getRawUsed() Return the total raw used space in the filesystem, disregarding replication .
void	metaSave(String pathname)
void	refreshNodes()
boolean	reportChecksumFailure(Path f, FSDataInputStream in, long inPos, FSDataInputStream sums, long sumsPos) We need to find the blocks that didn't match.
boolean	setSafeMode(FSConstants.SafeModeAction action) Enter, leave or get safe mode.

从类继承的方法 org.apache.hadoop.fs.ChecksumFileSystem

append, completeLocalOutput, copyFromLocalFile, copyToLocalFile, copyToLocalFile, create, createNonRecursive, delete, getApproxChkSumLength, getBytesPerSum, getChecksumFile, getChecksumFileLength, getChecksumLength, getRawFileSystem, isChecksumFile, listStatus, mkdirs, open, rename, setConf, setReplication, setVerifyChecksum, startLocalOutput

从类继承的方法 org.apache.hadoop.fs.FilterFileSystem

checkPath, close, concat, delete, getCanonicalServiceName, getConf, getDefaultBlockSize, getDefaultReplication, getFileBlockLocations, getFileChecksum, getHomeDirectory, getName, getUri, getWorkingDirectory, initialize, makeQualified, mkdirs, setOwner, setPermission, setWorkingDirectory

从类继承的方法 org.apache.hadoop.fs.FileSystem

addFileSystemForTesting, append, append, clearStatistics, closeAll, closeAllForUGI, copyFromLocalFile, copyFromLocalFile, copyFromLocalFile, copyToLocalFile, create, create, create, create, create, create, create, create, create, create, createNewFile, createNonRecursive, deleteOnExit, exists, get, get, get, getAllStatistics, getBlockSize, getCacheSize, getCanonicalUri, getContentSummary, getDefaultBlockSize, getDefaultPort, getDefaultReplication, getDefaultUri, getDelegationToken, getLength, getLocal, getNamed, getReplication, getStatistics, getStatistics, getUsed, globStatus, globStatus, isDirectory, isFile, listStatus, listStatus, listStatus, mkdirs, moveFromLocalFile, moveFromLocalFile, moveToLocalFile, open, printStatistics, processDeleteOnExit, setDefaultUri, setDefaultUri, setTimes

从类继承的方法 java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

构造器详细资料

ChecksumDistributedFileSystem

public ChecksumDistributedFileSystem()

ChecksumDistributedFileSystem

public ChecksumDistributedFileSystem(InetSocketAddress namenode,
                             Configuration conf)
                              throws IOException

已过时。

抛出:

IOException

方法详细资料

getRawCapacity

public long getRawCapacity()
                    throws IOException

Return the total raw capacity of the filesystem, disregarding replication .

抛出:

IOException

getRawUsed

public long getRawUsed()
                throws IOException

Return the total raw used space in the filesystem, disregarding replication .

抛出:

IOException

getDataNodeStats

public DatanodeInfo[] getDataNodeStats()
                                throws IOException

Return statistics for each datanode.

抛出:

IOException

setSafeMode

public boolean setSafeMode(FSConstants.SafeModeAction action)
                    throws IOException

Enter, leave or get safe mode.

抛出:

IOException

另请参阅:

ClientProtocol.setSafeMode(FSConstants.SafeModeAction)

refreshNodes

public void refreshNodes()
                  throws IOException

抛出:

IOException

finalizeUpgrade

public void finalizeUpgrade()
                     throws IOException

Finalize previously upgraded files system state.

抛出:

IOException

distributedUpgradeProgress

public UpgradeStatusReport distributedUpgradeProgress(FSConstants.UpgradeAction action)
                                               throws IOException

抛出:

IOException

metaSave

public void metaSave(String pathname)
              throws IOException

抛出:

IOException

reportChecksumFailure

public boolean reportChecksumFailure(Path f,
                            FSDataInputStream in,
                            long inPos,
                            FSDataInputStream sums,
                            long sumsPos)

We need to find the blocks that didn't match. Likely only one is corrupt but we will report both to the namenode. In the future, we can consider figuring out exactly which block is corrupt.

覆盖:

reportChecksumFailure 在类中 ChecksumFileSystem

参数:

f - the file name containing the error

in - the stream open on the file

inPos - the position of the beginning of the bad data in the file

sums - the stream open on the checksum file

sumsPos - the position of the beginning of the bad data in the checksum file

返回:

if retry is neccessary

getFileStatus

public FileStatus getFileStatus(Path f)
                         throws IOException

Returns the stat information about the file.

覆盖:

getFileStatus 在类中 FilterFileSystem

参数:

f - The path we want information from

返回:

a FileStatus object

抛出:

FileNotFoundException - when the path does not exist; IOException see specific implementation

IOException