org.apache.hadoop.hive.ql.hooks

Class LineageLogger

java.lang.Object

org.apache.hadoop.hive.ql.hooks.LineageLogger

All Implemented Interfaces:

ExecuteWithHookContext, Hook

public class LineageLogger
extends Object
implements ExecuteWithHookContext

Implementation of a post execute hook that logs lineage info to a log file.

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
static class	LineageLogger.Edge An edge in lineage.
static class	LineageLogger.Vertex A vertex in lineage.

Constructor Summary

Constructors

Constructor and Description
LineageLogger()

Method Summary

Modifier and Type	Method and Description
static List<LineageLogger.Edge>	getEdges(QueryPlan plan, LineageCtx.Index index) Based on the final select operator, find out all the target columns.
static Set<LineageLogger.Vertex>	getVertices(List<LineageLogger.Edge> edges) Get all the vertices of all edges.
void	run(HookContext hookContext)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

LineageLogger

public LineageLogger()

Method Detail

run

public void run(HookContext hookContext)

Specified by:

run in interface ExecuteWithHookContext

Parameters:

hookContext - The hook context passed to each hooks.

getEdges

public static List<LineageLogger.Edge> getEdges(QueryPlan plan,
                                                LineageCtx.Index index)

Based on the final select operator, find out all the target columns. For each target column, find out its sources based on the dependency index.

getVertices

public static Set<LineageLogger.Vertex> getVertices(List<LineageLogger.Edge> edges)

Get all the vertices of all edges. Targets at first, then sources. Assign id to each vertex.