org.apache.hadoop.hive.accumulo.predicate

Class AccumuloPredicateHandler

java.lang.Object

org.apache.hadoop.hive.accumulo.predicate.AccumuloPredicateHandler

public class AccumuloPredicateHandler
extends Object

Supporting operations dealing with Hive Predicate pushdown to iterators and ranges. See PrimitiveComparisonFilter

Method Summary

Modifier and Type	Method and Description
Set<String>	cOpKeyset()
HiveStoragePredicateHandler.DecomposedPredicate	decompose(org.apache.hadoop.conf.Configuration conf, ExprNodeDesc desc)
protected Object	generateRanges(org.apache.hadoop.conf.Configuration conf, ColumnMapper columnMapper, String hiveRowIdColumnName, ExprNodeDesc root) Encapsulates the traversal over some ExprNodeDesc tree for the generation of Accumuluo.
CompareOp	getCompareOp(String udfType, IndexSearchCondition sc)
Class<? extends CompareOp>	getCompareOpClass(String udfType)
ExprNodeDesc	getExpression(org.apache.hadoop.conf.Configuration conf)
static AccumuloPredicateHandler	getInstance()
List<org.apache.accumulo.core.client.IteratorSetting>	getIterators(org.apache.hadoop.conf.Configuration conf, ColumnMapper columnMapper) Loop through search conditions and build iterator settings for predicates involving columns other than rowID, if any.
PrimitiveComparison	getPrimitiveComparison(String type, IndexSearchCondition sc)
Class<? extends PrimitiveComparison>	getPrimitiveComparisonClass(String type)
List<org.apache.accumulo.core.data.Range>	getRanges(org.apache.hadoop.conf.Configuration conf, ColumnMapper columnMapper) Loop through search conditions and build ranges for predicates involving rowID column, if any.
List<IndexSearchCondition>	getSearchConditions(org.apache.hadoop.conf.Configuration conf)
Set<String>	pComparisonKeyset()
org.apache.accumulo.core.client.IteratorSetting	toSetting(HiveAccumuloColumnMapping accumuloColumnMapping, IndexSearchCondition sc, boolean binaryEncodedValues) Create an IteratorSetting for the right qualifier, constant, CompareOpt, and PrimitiveCompare type.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Method Detail

getInstance

public static AccumuloPredicateHandler getInstance()

cOpKeyset

public Set<String> cOpKeyset()

Returns:

set of all UDF class names with matching CompareOpt implementations.

pComparisonKeyset

public Set<String> pComparisonKeyset()

Returns:

set of all hive data types with matching PrimitiveCompare implementations.

getCompareOpClass

public Class<? extends CompareOp> getCompareOpClass(String udfType)
                                             throws NoSuchCompareOpException

Parameters:

udfType - GenericUDF classname to lookup matching CompareOpt

Returns:

Class

Throws:

NoSuchCompareOpException

getCompareOp

public CompareOp getCompareOp(String udfType,
                              IndexSearchCondition sc)
                       throws NoSuchCompareOpException,
                              SerDeException

Throws:

NoSuchCompareOpException

SerDeException

getPrimitiveComparisonClass

public Class<? extends PrimitiveComparison> getPrimitiveComparisonClass(String type)
                                                                 throws NoSuchPrimitiveComparisonException

Parameters:

type - String hive column lookup matching PrimitiveCompare

Returns:

Class

Throws:

NoSuchPrimitiveComparisonException

getPrimitiveComparison

public PrimitiveComparison getPrimitiveComparison(String type,
                                                  IndexSearchCondition sc)
                                           throws NoSuchPrimitiveComparisonException,
                                                  SerDeException

Throws:

NoSuchPrimitiveComparisonException

SerDeException

getRanges

public List<org.apache.accumulo.core.data.Range> getRanges(org.apache.hadoop.conf.Configuration conf,
                                                           ColumnMapper columnMapper)
                                                    throws SerDeException

Loop through search conditions and build ranges for predicates involving rowID column, if any.

Throws:

SerDeException

generateRanges

protected Object generateRanges(org.apache.hadoop.conf.Configuration conf,
                                ColumnMapper columnMapper,
                                String hiveRowIdColumnName,
                                ExprNodeDesc root)

Encapsulates the traversal over some ExprNodeDesc tree for the generation of Accumuluo. Ranges using expressions involving the Accumulo rowid-mapped Hive column.

Parameters:

conf - Hadoop configuration

columnMapper - Mapping of Hive to Accumulo columns for the query

hiveRowIdColumnName - Name of the hive column mapped to the Accumulo rowid

root - Root of some ExprNodeDesc tree to traverse, the WHERE clause

Returns:

An object representing the result from the ExprNodeDesc tree traversal using the AccumuloRangeGenerator

getIterators

public List<org.apache.accumulo.core.client.IteratorSetting> getIterators(org.apache.hadoop.conf.Configuration conf,
                                                                          ColumnMapper columnMapper)
                                                                   throws SerDeException

Loop through search conditions and build iterator settings for predicates involving columns other than rowID, if any.

Parameters:

conf - Configuration

Throws:

SerDeException

toSetting

public org.apache.accumulo.core.client.IteratorSetting toSetting(HiveAccumuloColumnMapping accumuloColumnMapping,
                                                                 IndexSearchCondition sc,
                                                                 boolean binaryEncodedValues)
                                                          throws SerDeException

Create an IteratorSetting for the right qualifier, constant, CompareOpt, and PrimitiveCompare type.

Parameters:

accumuloColumnMapping - ColumnMapping to filter

sc - IndexSearchCondition

binaryEncodedValues - flag for binary encodedValues

Returns:

IteratorSetting

Throws:

SerDeException

getExpression

public ExprNodeDesc getExpression(org.apache.hadoop.conf.Configuration conf)

getSearchConditions

public List<IndexSearchCondition> getSearchConditions(org.apache.hadoop.conf.Configuration conf)

Parameters:

conf - Configuration

Returns:

list of IndexSearchConditions from the filter expression.

decompose

public HiveStoragePredicateHandler.DecomposedPredicate decompose(org.apache.hadoop.conf.Configuration conf,
                                                                 ExprNodeDesc desc)

Parameters:

conf - Configuration

desc - predicate expression node.

Returns:

DecomposedPredicate containing translated search conditions the analyzer can support.