org.apache.hadoop.hive.ql.optimizer.ppr

Class PartitionPruner

java.lang.Object

org.apache.hadoop.hive.ql.optimizer.Transform

org.apache.hadoop.hive.ql.optimizer.ppr.PartitionPruner

public class PartitionPruner
extends Transform

The transformation step that does partition pruning.

Field Summary

Fields

Modifier and Type	Field and Description
static String	CLASS_NAME
static org.slf4j.Logger	LOG

Constructor Summary

Constructors

Constructor and Description
PartitionPruner()

Method Summary

Modifier and Type	Method and Description
static boolean	hasColumnExpr(ExprNodeDesc desc) Whether the expression contains a column node or not.
static boolean	onlyContainsPartnCols(Table tab, ExprNodeDesc expr) Find out whether the condition only contains partitioned columns.
static PrunedPartitionList	prune(Table tab, ExprNodeDesc prunerExpr, HiveConf conf, String alias, Map<String,PrunedPartitionList> prunedPartitionsMap) Get the partition list for the table that satisfies the partition pruner condition.
static PrunedPartitionList	prune(TableScanOperator ts, ParseContext parseCtx, String alias) Get the partition list for the TS operator that satisfies the partition pruner condition.
static boolean	prunePartitionNames(List<String> partColumnNames, List<PrimitiveTypeInfo> partColumnTypeInfos, ExprNodeGenericFuncDesc prunerExpr, String defaultPartitionName, List<String> partNames) Prunes partition names to see if they match the prune expression.
ParseContext	transform(ParseContext pctx) All transformation steps implement this interface.

Methods inherited from class org.apache.hadoop.hive.ql.optimizer.Transform

beginPerfLogging, endPerfLogging, endPerfLogging

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

CLASS_NAME

public static final String CLASS_NAME

LOG

public static final org.slf4j.Logger LOG

Constructor Detail

PartitionPruner

public PartitionPruner()

Method Detail

transform

public ParseContext transform(ParseContext pctx)
                       throws SemanticException

Description copied from class: Transform

All transformation steps implement this interface.

Specified by:

transform in class Transform

Parameters:

pctx - input parse context

Returns:

ParseContext

Throws:

SemanticException

onlyContainsPartnCols

public static boolean onlyContainsPartnCols(Table tab,
                                            ExprNodeDesc expr)

Find out whether the condition only contains partitioned columns. Note that if the table is not partitioned, the function always returns true. condition.

Parameters:

tab - the table object

expr - the pruner expression for the table

prune

public static PrunedPartitionList prune(TableScanOperator ts,
                                        ParseContext parseCtx,
                                        String alias)
                                 throws SemanticException

Get the partition list for the TS operator that satisfies the partition pruner condition.

Throws:

SemanticException

prune

public static PrunedPartitionList prune(Table tab,
                                        ExprNodeDesc prunerExpr,
                                        HiveConf conf,
                                        String alias,
                                        Map<String,PrunedPartitionList> prunedPartitionsMap)
                                 throws SemanticException

Get the partition list for the table that satisfies the partition pruner condition.

Parameters:

tab - the table object for the alias

prunerExpr - the pruner expression for the alias

conf - for checking whether "strict" mode is on.

alias - for generating error message only.

prunedPartitionsMap - cached result for the table

Returns:

the partition list for the table that satisfies the partition pruner condition.

Throws:

SemanticException

prunePartitionNames

public static boolean prunePartitionNames(List<String> partColumnNames,
                                          List<PrimitiveTypeInfo> partColumnTypeInfos,
                                          ExprNodeGenericFuncDesc prunerExpr,
                                          String defaultPartitionName,
                                          List<String> partNames)
                                   throws HiveException,
                                          org.apache.hadoop.hive.metastore.api.MetaException

Prunes partition names to see if they match the prune expression.

Parameters:

partColumnNames - name of partition columns

partColumnTypeInfos - types of partition columns

prunerExpr - The expression to match.

defaultPartitionName - name of default partition

partNames - Partition names to filter. The list is modified in place.

Returns:

Whether the list has any partitions for which the expression may or may not match.

Throws:

HiveException

org.apache.hadoop.hive.metastore.api.MetaException

hasColumnExpr

public static boolean hasColumnExpr(ExprNodeDesc desc)

Whether the expression contains a column node or not.