| Class | Description |
|---|---|
| GenSparkProcContext |
GenSparkProcContext maintains information about the tasks and operators
as we walk the operator tree to break them into SparkTasks.
|
| GenSparkUtils |
GenSparkUtils is a collection of shared helper methods to produce SparkWork
Cloned from GenTezUtils.
|
| GenSparkWork |
GenSparkWork separates the operator tree into spark tasks.
|
| GenSparkWorkWalker |
Walks the operator tree in DFS fashion.
|
| OptimizeSparkProcContext |
OptimizeSparkProcContext.
|
| SparkCompiler |
SparkCompiler translates the operator plan into SparkTasks.
|
| SparkFileSinkProcessor |
FileSinkProcessor handles addition of merge, move and stats tasks for filesinks.
|
| SparkPartitionPruningSinkOperator |
This operator gets partition info from the upstream operators, and write them
to HDFS.
|
| SparkProcessAnalyzeTable |
ProcessAnalyzeTable sets up work for the several variants of analyze table
(normal, no scan) The plan at this point will be a single
table scan operator.
|
| SparkSMBMapJoinInfo |
Data structure to keep track of SMBMapJoin operators during query compilation for Spark.
|
| SplitOpTreeForDPP |
This processor triggers on SparkPartitionPruningSinkOperator.
|
Copyright © 2019 The Apache Software Foundation. All Rights Reserved.