org.apache.hadoop.hive.ql.exec.vector.keyseries

Class VectorKeySeriesSerializedImpl<T extends SerializeWrite>

java.lang.Object

org.apache.hadoop.hive.ql.exec.vector.keyseries.VectorKeySeriesImpl

org.apache.hadoop.hive.ql.exec.vector.keyseries.VectorKeySeriesSingleImpl

org.apache.hadoop.hive.ql.exec.vector.keyseries.VectorKeySeriesSerializedImpl<T>

All Implemented Interfaces:

VectorKeySeries, VectorKeySeriesSerialized

Direct Known Subclasses:

VectorKeySeriesBytesSerialized, VectorKeySeriesLongSerialized, VectorKeySeriesMultiSerialized

public abstract class VectorKeySeriesSerializedImpl<T extends SerializeWrite>
extends VectorKeySeriesSingleImpl
implements VectorKeySeriesSerialized

Implementation of base serialization interface.

Field Summary

Fields

Modifier and Type	Field and Description
protected int	bufferOffset
protected ByteStream.Output	output
byte[]	serializedBytes
protected int[]	serializedKeyLengths
int	serializedLength
int	serializedStart
protected T	serializeWrite

Fields inherited from class org.apache.hadoop.hive.ql.exec.vector.keyseries.VectorKeySeriesSingleImpl

currentBatchSize, duplicateCounts, hashCodes, nonNullKeyCount, nonNullKeyPosition, seriesCount, seriesIsAllNull, seriesPosition

Fields inherited from class org.apache.hadoop.hive.ql.exec.vector.keyseries.VectorKeySeriesImpl

currentDuplicateCount, currentHasAnyNulls, currentHashCode, currentIsAllNull, currentLogical

Constructor Summary

Constructors

Constructor and Description
VectorKeySeriesSerializedImpl(T serializeWrite)

Method Summary

Modifier and Type	Method and Description
protected void	computeSerializedHashCodes() Batch compute the hash codes for all the serialized keys.
byte[]	getSerializedBytes()
int	getSerializedLength()
int	getSerializedStart()
void	positionToFirst() Position to the beginning of the key series.
void	setNextNonNullKey(int nonNullKeyPosition)
boolean	validate()

Methods inherited from class org.apache.hadoop.hive.ql.exec.vector.keyseries.VectorKeySeriesSingleImpl

advance, next

Methods inherited from class org.apache.hadoop.hive.ql.exec.vector.keyseries.VectorKeySeriesImpl

getCurrentDuplicateCount, getCurrentHasAnyNulls, getCurrentHashCode, getCurrentIsAllNull, getCurrentLogical

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface org.apache.hadoop.hive.ql.exec.vector.keyseries.VectorKeySeries

getCurrentDuplicateCount, getCurrentHasAnyNulls, getCurrentHashCode, getCurrentIsAllNull, getCurrentLogical, next, processBatch

Field Detail

serializeWrite

protected T extends SerializeWrite serializeWrite

bufferOffset

protected int bufferOffset

serializedStart

public int serializedStart

serializedLength

public int serializedLength

serializedBytes

public byte[] serializedBytes

output

protected final ByteStream.Output output

serializedKeyLengths

protected final int[] serializedKeyLengths

Constructor Detail

VectorKeySeriesSerializedImpl

public VectorKeySeriesSerializedImpl(T serializeWrite)

Method Detail

validate

public boolean validate()

Overrides:

validate in class VectorKeySeriesSingleImpl

getSerializedBytes

public byte[] getSerializedBytes()

Specified by:

getSerializedBytes in interface VectorKeySeriesSerialized

Returns:

the serialized bytes (including optional key tag), start offset of the key in the bytes, and key byte length.

getSerializedStart

public int getSerializedStart()

Specified by:

getSerializedStart in interface VectorKeySeriesSerialized

getSerializedLength

public int getSerializedLength()

Specified by:

getSerializedLength in interface VectorKeySeriesSerialized

computeSerializedHashCodes

protected void computeSerializedHashCodes()

Batch compute the hash codes for all the serialized keys. NOTE: MAJOR MAJOR ASSUMPTION: We assume that HashCodeUtil.murmurHash produces the same result as MurmurHash.hash with seed = 0 (the method used by ReduceSinkOperator for UNIFORM distribution).

positionToFirst

public void positionToFirst()

Description copied from interface: VectorKeySeries

Position to the beginning of the key series.

Specified by:

positionToFirst in interface VectorKeySeries

Overrides:

positionToFirst in class VectorKeySeriesSingleImpl

setNextNonNullKey

public void setNextNonNullKey(int nonNullKeyPosition)

Specified by:

setNextNonNullKey in class VectorKeySeriesSingleImpl