org.apache.pig.data
Class SelfSpillBag

java.lang.Object
  org.apache.pig.data.DefaultAbstractBag
      org.apache.pig.data.SelfSpillBag

All Implemented Interfaces:

Serializable, Comparable, Iterable<Tuple>, org.apache.hadoop.io.Writable, org.apache.hadoop.io.WritableComparable, DataBag, Spillable

Direct Known Subclasses:

InternalCachedBag, SortedSpillBag

@InterfaceAudience.Private
@InterfaceStability.Evolving
public abstract class SelfSpillBag
extends DefaultAbstractBag

Class to hold code common to self spilling bags such as InternalCachedBag

See Also:

Serialized Form

Nested Class Summary

static class

SelfSpillBag.MemoryLimits This class helps to compute the number of entries that should be held in memory so that memory consumption is limited.

Nested classes/interfaces inherited from class org.apache.pig.data.DefaultAbstractBag

DefaultAbstractBag.BagDelimiterTuple, DefaultAbstractBag.EndBag, DefaultAbstractBag.StartBag

Field Summary

protected SelfSpillBag.MemoryLimits

memLimit

Fields inherited from class org.apache.pig.data.DefaultAbstractBag

endBag, MAX_SPILL_FILES, mContents, mSize, mSpillFiles, startBag

Constructor Summary

SelfSpillBag(int bagCount)

SelfSpillBag(int bagCount, float percent)

Method Summary

Methods inherited from class org.apache.pig.data.DefaultAbstractBag

add, addAll, addAll, addAll, clear, compareTo, equals, getMemorySize, getSpillFile, hashCode, incSpillCount, incSpillCount, markSpillableIfNecessary, markStale, readFields, reportProgress, sampleContents, size, toString, warn, write

Methods inherited from class java.lang.Object

clone, finalize, getClass, notify, notifyAll, wait, wait, wait

Methods inherited from interface org.apache.pig.data.DataBag

isDistinct, isSorted, iterator

Methods inherited from interface org.apache.pig.impl.util.Spillable

spill

Field Detail

memLimit

protected SelfSpillBag.MemoryLimits memLimit

Constructor Detail

SelfSpillBag

public SelfSpillBag(int bagCount)

SelfSpillBag

public SelfSpillBag(int bagCount,
                    float percent)