org.apache.pig.backend.hadoop.executionengine.mapReduceLayer
Class SampleOptimizer
java.lang.Object
org.apache.pig.impl.plan.PlanVisitor<MapReduceOper,MROperPlan>
org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.plans.MROpPlanVisitor
org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.SampleOptimizer
public class SampleOptimizer
- extends MROpPlanVisitor
A visitor to optimize plans that have a sample job that immediately follows a
load/store only MR job. These kinds of plans are generated for order bys, and
will soon be generated for joins that need to sample their data first. These
can be changed so that the RandomSampleLoader subsumes the loader used in the
first job and then removes the first job.
Methods inherited from class java.lang.Object |
clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait |
SampleOptimizer
public SampleOptimizer(MROperPlan plan,
PigContext pigContext)
visit
public void visit()
throws VisitorException
- Description copied from class:
PlanVisitor
- Entry point for visiting the plan.
- Overrides:
visit
in class PlanVisitor<MapReduceOper,MROperPlan>
- Throws:
VisitorException
- if an error is encountered while visiting.
visitMROp
public void visitMROp(MapReduceOper mr)
throws VisitorException
- Overrides:
visitMROp
in class MROpPlanVisitor
- Throws:
VisitorException
Copyright © 2007-2012 The Apache Software Foundation