org.apache.hadoop.hive.metastore.utils

Class HdfsUtils

java.lang.Object

org.apache.hadoop.hive.metastore.utils.HdfsUtils

public class HdfsUtils
extends Object

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
static class	HdfsUtils.HadoopFileStatus

Constructor Summary

Constructors

Constructor and Description
HdfsUtils()

Method Summary

Modifier and Type	Method and Description
static void	checkFileAccess(org.apache.hadoop.fs.FileSystem fs, org.apache.hadoop.fs.FileStatus stat, org.apache.hadoop.fs.permission.FsAction action) Check the permissions on a file.
static long	getFileId(org.apache.hadoop.fs.FileSystem fs, String path)
static org.apache.hadoop.fs.Path	getFileIdPath(org.apache.hadoop.fs.FileSystem fileSystem, org.apache.hadoop.fs.Path path, long fileId)
static boolean	isPathEncrypted(org.apache.hadoop.conf.Configuration conf, URI fsUri, org.apache.hadoop.fs.Path path)
static boolean	runDistCp(List<org.apache.hadoop.fs.Path> srcPaths, org.apache.hadoop.fs.Path dst, org.apache.hadoop.conf.Configuration conf)
static boolean	runDistCpAs(List<org.apache.hadoop.fs.Path> srcPaths, org.apache.hadoop.fs.Path dst, org.apache.hadoop.conf.Configuration conf, String doAsUser)
static void	setFullFileStatus(org.apache.hadoop.conf.Configuration conf, HdfsUtils.HadoopFileStatus sourceStatus, String targetGroup, org.apache.hadoop.fs.FileSystem fs, org.apache.hadoop.fs.Path target, boolean recursion) Copy the permissions, group, and ACLs from a source HdfsUtils.HadoopFileStatus to a target Path.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

HdfsUtils

public HdfsUtils()

Method Detail

checkFileAccess

public static void checkFileAccess(org.apache.hadoop.fs.FileSystem fs,
                                   org.apache.hadoop.fs.FileStatus stat,
                                   org.apache.hadoop.fs.permission.FsAction action)
                            throws IOException,
                                   LoginException

Check the permissions on a file.

Parameters:

fs - Filesystem the file is contained in

stat - Stat info for the file

action - action to be performed

Throws:

IOException - If thrown by Hadoop

org.apache.hadoop.security.AccessControlException - if the file cannot be accessed

LoginException

isPathEncrypted

public static boolean isPathEncrypted(org.apache.hadoop.conf.Configuration conf,
                                      URI fsUri,
                                      org.apache.hadoop.fs.Path path)
                               throws IOException

Throws:

IOException

runDistCpAs

public static boolean runDistCpAs(List<org.apache.hadoop.fs.Path> srcPaths,
                                  org.apache.hadoop.fs.Path dst,
                                  org.apache.hadoop.conf.Configuration conf,
                                  String doAsUser)
                           throws IOException

Throws:

IOException

runDistCp

public static boolean runDistCp(List<org.apache.hadoop.fs.Path> srcPaths,
                                org.apache.hadoop.fs.Path dst,
                                org.apache.hadoop.conf.Configuration conf)
                         throws IOException

Throws:

IOException

getFileIdPath

public static org.apache.hadoop.fs.Path getFileIdPath(org.apache.hadoop.fs.FileSystem fileSystem,
                                                      org.apache.hadoop.fs.Path path,
                                                      long fileId)

getFileId

public static long getFileId(org.apache.hadoop.fs.FileSystem fs,
                             String path)
                      throws IOException

Throws:

IOException

setFullFileStatus

public static void setFullFileStatus(org.apache.hadoop.conf.Configuration conf,
                                     HdfsUtils.HadoopFileStatus sourceStatus,
                                     String targetGroup,
                                     org.apache.hadoop.fs.FileSystem fs,
                                     org.apache.hadoop.fs.Path target,
                                     boolean recursion)

Copy the permissions, group, and ACLs from a source HdfsUtils.HadoopFileStatus to a target Path. This method will only log a warning if permissions cannot be set, no exception will be thrown.

Parameters:

conf - the Configuration used when setting permissions and ACLs

sourceStatus - the source HdfsUtils.HadoopFileStatus to copy permissions and ACLs from

targetGroup - the group of the target Path, if this is set and it is equal to the source group, an extra set group operation is avoided

fs - the FileSystem that contains the target Path

target - the Path to copy permissions, group, and ACLs to

recursion - recursively set permissions and ACLs on the target Path