org.apache.hadoop.hive.llap.daemon.impl

Class LlapDaemon

java.lang.Object

org.apache.hadoop.service.AbstractService

org.apache.hadoop.service.CompositeService

org.apache.hadoop.hive.llap.daemon.impl.LlapDaemon

All Implemented Interfaces:

Closeable, AutoCloseable, ContainerRunner, LlapDaemonMXBean, org.apache.hadoop.service.Service

public class LlapDaemon
extends org.apache.hadoop.service.CompositeService
implements ContainerRunner, LlapDaemonMXBean

Nested Class Summary

Nested classes/interfaces inherited from class org.apache.hadoop.service.CompositeService

org.apache.hadoop.service.CompositeService.CompositeServiceShutdownHook

Nested classes/interfaces inherited from interface org.apache.hadoop.service.Service

org.apache.hadoop.service.Service.STATE

Field Summary

Fields inherited from class org.apache.hadoop.service.CompositeService

STOP_ONLY_STARTED_SERVICES

Constructor Summary

Constructors

Constructor and Description
LlapDaemon(org.apache.hadoop.conf.Configuration daemonConf, int numExecutors, long executorMemoryBytes, boolean ioEnabled, boolean isDirectCache, long ioMemoryBytes, String[] localDirs, int srvPort, int mngPort, int shufflePort, int webPort, String appName)

Method Summary

Modifier and Type	Method and Description
long	getExecutorMemoryPerInstance() Gets llap daemon configured executor memory per instance.
Set<String>	getExecutorsStatus() Executor states.
long	getIoMemoryPerInstance() Gets llap daemon configured io memory per instance.
InetSocketAddress	getListenerAddress()
String	getLocalDirs() CSV list of local directories
long	getMaxJvmMemory() Gets max available jvm memory.
int	getNumActive() Gets the number of active executors.
int	getNumExecutors() Gets the number of executors.
long	getNumSubmissions()
int	getRpcPort() Gets the rpc port.
int	getShufflePort() Gets the shuffle port.
static long	getTotalHeapSize()
boolean	isIoEnabled() Checks if Llap IO is enabled
static void	main(String[] args)
org.apache.hadoop.hive.llap.daemon.rpc.LlapDaemonProtocolProtos.QueryCompleteResponseProto	queryComplete(org.apache.hadoop.hive.llap.daemon.rpc.LlapDaemonProtocolProtos.QueryCompleteRequestProto request)
void	serviceInit(org.apache.hadoop.conf.Configuration conf)
void	serviceStart()
void	serviceStop()
void	shutdown()
org.apache.hadoop.hive.llap.daemon.rpc.LlapDaemonProtocolProtos.SourceStateUpdatedResponseProto	sourceStateUpdated(org.apache.hadoop.hive.llap.daemon.rpc.LlapDaemonProtocolProtos.SourceStateUpdatedRequestProto request)
org.apache.hadoop.hive.llap.daemon.rpc.LlapDaemonProtocolProtos.SubmitWorkResponseProto	submitWork(org.apache.hadoop.hive.llap.daemon.rpc.LlapDaemonProtocolProtos.SubmitWorkRequestProto request)
org.apache.hadoop.hive.llap.daemon.rpc.LlapDaemonProtocolProtos.TerminateFragmentResponseProto	terminateFragment(org.apache.hadoop.hive.llap.daemon.rpc.LlapDaemonProtocolProtos.TerminateFragmentRequestProto request)
org.apache.hadoop.hive.llap.daemon.rpc.LlapDaemonProtocolProtos.UpdateFragmentResponseProto	updateFragment(org.apache.hadoop.hive.llap.daemon.rpc.LlapDaemonProtocolProtos.UpdateFragmentRequestProto request)

Methods inherited from class org.apache.hadoop.service.CompositeService

addIfService, addService, getServices, removeService

Methods inherited from class org.apache.hadoop.service.AbstractService

close, getBlockers, getConfig, getFailureCause, getFailureState, getLifecycleHistory, getName, getServiceState, getStartTime, init, isInState, noteFailure, putBlocker, registerGlobalListener, registerServiceListener, removeBlocker, setConfig, start, stop, toString, unregisterGlobalListener, unregisterServiceListener, waitForServiceToStop

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, wait, wait, wait

Constructor Detail

LlapDaemon

public LlapDaemon(org.apache.hadoop.conf.Configuration daemonConf,
                  int numExecutors,
                  long executorMemoryBytes,
                  boolean ioEnabled,
                  boolean isDirectCache,
                  long ioMemoryBytes,
                  String[] localDirs,
                  int srvPort,
                  int mngPort,
                  int shufflePort,
                  int webPort,
                  String appName)

Method Detail

getTotalHeapSize

public static long getTotalHeapSize()

serviceInit

public void serviceInit(org.apache.hadoop.conf.Configuration conf)
                 throws Exception

Overrides:

serviceInit in class org.apache.hadoop.service.CompositeService

Throws:

Exception

serviceStart

public void serviceStart()
                  throws Exception

Overrides:

serviceStart in class org.apache.hadoop.service.CompositeService

Throws:

Exception

serviceStop

public void serviceStop()
                 throws Exception

Overrides:

serviceStop in class org.apache.hadoop.service.CompositeService

Throws:

Exception

shutdown

public void shutdown()

main

public static void main(String[] args)
                 throws Exception

Throws:

Exception

submitWork

public org.apache.hadoop.hive.llap.daemon.rpc.LlapDaemonProtocolProtos.SubmitWorkResponseProto submitWork(org.apache.hadoop.hive.llap.daemon.rpc.LlapDaemonProtocolProtos.SubmitWorkRequestProto request)
                                                                                                   throws IOException

Specified by:

submitWork in interface ContainerRunner

Throws:

IOException

sourceStateUpdated

public org.apache.hadoop.hive.llap.daemon.rpc.LlapDaemonProtocolProtos.SourceStateUpdatedResponseProto sourceStateUpdated(org.apache.hadoop.hive.llap.daemon.rpc.LlapDaemonProtocolProtos.SourceStateUpdatedRequestProto request)
                                                                                                                   throws IOException

Specified by:

sourceStateUpdated in interface ContainerRunner

Throws:

IOException

queryComplete

public org.apache.hadoop.hive.llap.daemon.rpc.LlapDaemonProtocolProtos.QueryCompleteResponseProto queryComplete(org.apache.hadoop.hive.llap.daemon.rpc.LlapDaemonProtocolProtos.QueryCompleteRequestProto request)
                                                                                                         throws IOException

Specified by:

queryComplete in interface ContainerRunner

Throws:

IOException

terminateFragment

public org.apache.hadoop.hive.llap.daemon.rpc.LlapDaemonProtocolProtos.TerminateFragmentResponseProto terminateFragment(org.apache.hadoop.hive.llap.daemon.rpc.LlapDaemonProtocolProtos.TerminateFragmentRequestProto request)
                                                                                                                 throws IOException

Specified by:

terminateFragment in interface ContainerRunner

Throws:

IOException

updateFragment

public org.apache.hadoop.hive.llap.daemon.rpc.LlapDaemonProtocolProtos.UpdateFragmentResponseProto updateFragment(org.apache.hadoop.hive.llap.daemon.rpc.LlapDaemonProtocolProtos.UpdateFragmentRequestProto request)
                                                                                                           throws IOException

Specified by:

updateFragment in interface ContainerRunner

Throws:

IOException

getNumSubmissions

public long getNumSubmissions()

getListenerAddress

public InetSocketAddress getListenerAddress()

getRpcPort

public int getRpcPort()

Description copied from interface: LlapDaemonMXBean

Gets the rpc port.

Specified by:

getRpcPort in interface LlapDaemonMXBean

Returns:

the rpc port

getNumExecutors

public int getNumExecutors()

Description copied from interface: LlapDaemonMXBean

Gets the number of executors.

Specified by:

getNumExecutors in interface LlapDaemonMXBean

Returns:

number of executors

getShufflePort

public int getShufflePort()

Description copied from interface: LlapDaemonMXBean

Gets the shuffle port.

Specified by:

getShufflePort in interface LlapDaemonMXBean

Returns:

the shuffle port

getLocalDirs

public String getLocalDirs()

Description copied from interface: LlapDaemonMXBean

CSV list of local directories

Specified by:

getLocalDirs in interface LlapDaemonMXBean

Returns:

local dirs

getExecutorsStatus

public Set<String> getExecutorsStatus()

Description copied from interface: LlapDaemonMXBean

Executor states.

Specified by:

getExecutorsStatus in interface LlapDaemonMXBean

Returns:

Executor states.

getNumActive

public int getNumActive()

Description copied from interface: LlapDaemonMXBean

Gets the number of active executors.

Specified by:

getNumActive in interface LlapDaemonMXBean

Returns:

number of active executors

getExecutorMemoryPerInstance

public long getExecutorMemoryPerInstance()

Description copied from interface: LlapDaemonMXBean

Gets llap daemon configured executor memory per instance.

Specified by:

getExecutorMemoryPerInstance in interface LlapDaemonMXBean

Returns:

memory per instance

getIoMemoryPerInstance

public long getIoMemoryPerInstance()

Description copied from interface: LlapDaemonMXBean

Gets llap daemon configured io memory per instance.

Specified by:

getIoMemoryPerInstance in interface LlapDaemonMXBean

Returns:

memory per instance

isIoEnabled

public boolean isIoEnabled()

Description copied from interface: LlapDaemonMXBean

Checks if Llap IO is enabled

Specified by:

isIoEnabled in interface LlapDaemonMXBean

Returns:

true if enabled, false if not

getMaxJvmMemory

public long getMaxJvmMemory()

Description copied from interface: LlapDaemonMXBean

Gets max available jvm memory.

Specified by:

getMaxJvmMemory in interface LlapDaemonMXBean

Returns:

max jvm memory