org.apache.hadoop.hive.common

Class HiveStatsUtils

java.lang.Object

org.apache.hadoop.hive.common.HiveStatsUtils

public class HiveStatsUtils
extends Object

HiveStatsUtils. A collection of utilities used for hive statistics. Used by classes in both metastore and ql package

Constructor Summary

Constructors

Constructor and Description
HiveStatsUtils()

Method Summary

Modifier and Type	Method and Description
static List<org.apache.hadoop.fs.FileStatus>	getFileStatusRecurse(org.apache.hadoop.fs.Path path, int level, org.apache.hadoop.fs.FileSystem fs) Get all file status from a root path and recursively go deep into certain levels.
static List<org.apache.hadoop.fs.FileStatus>	getFileStatusRecurse(org.apache.hadoop.fs.Path path, int level, org.apache.hadoop.fs.FileSystem fs, org.apache.hadoop.fs.PathFilter filter)
static List<org.apache.hadoop.fs.FileStatus>	getFileStatusRecurse(org.apache.hadoop.fs.Path path, int level, org.apache.hadoop.fs.FileSystem fs, org.apache.hadoop.fs.PathFilter filter, boolean allLevelsBelow)
static int	getNumBitVectorsForNDVEstimation(org.apache.hadoop.conf.Configuration conf)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

HiveStatsUtils

public HiveStatsUtils()

Method Detail

getFileStatusRecurse

public static List<org.apache.hadoop.fs.FileStatus> getFileStatusRecurse(org.apache.hadoop.fs.Path path,
                                                                         int level,
                                                                         org.apache.hadoop.fs.FileSystem fs)
                                                                  throws IOException

Get all file status from a root path and recursively go deep into certain levels.

Parameters:

path - the root path

level - the depth of directory to explore

fs - the file system

Returns:

array of FileStatus

Throws:

IOException

getFileStatusRecurse

public static List<org.apache.hadoop.fs.FileStatus> getFileStatusRecurse(org.apache.hadoop.fs.Path path,
                                                                         int level,
                                                                         org.apache.hadoop.fs.FileSystem fs,
                                                                         org.apache.hadoop.fs.PathFilter filter)
                                                                  throws IOException

Throws:

IOException

getFileStatusRecurse

public static List<org.apache.hadoop.fs.FileStatus> getFileStatusRecurse(org.apache.hadoop.fs.Path path,
                                                                         int level,
                                                                         org.apache.hadoop.fs.FileSystem fs,
                                                                         org.apache.hadoop.fs.PathFilter filter,
                                                                         boolean allLevelsBelow)
                                                                  throws IOException

Throws:

IOException

getNumBitVectorsForNDVEstimation

public static int getNumBitVectorsForNDVEstimation(org.apache.hadoop.conf.Configuration conf)
                                            throws Exception

Throws:

Exception