com.github.sakserv.minicluster.yarn

Class InJvmContainerExecutor

java.lang.Object

org.apache.hadoop.yarn.server.nodemanager.ContainerExecutor

org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor

com.github.sakserv.minicluster.yarn.InJvmContainerExecutor

All Implemented Interfaces:

org.apache.hadoop.conf.Configurable

public class InJvmContainerExecutor
extends org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor

!!!!! FOR TESTING WITH MINI CLUSTER ONLY !!!!! Container executor which will launch Java containers in the same JVM. In order to use it you must override 'yarn.nodemanager.container-executor.class' property in the server configuration (e.g., mini cluster) and set it to the fully qualified name of this class

Author:

Oleg Zhurakousky

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
static class	InJvmContainerExecutor.SystemExitAllowSecurityManager An implementation of the SecurityManager which can be used to intercept System.exit.

Nested classes/interfaces inherited from class org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor

org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.LocalWrapperScriptBuilder

Nested classes/interfaces inherited from class org.apache.hadoop.yarn.server.nodemanager.ContainerExecutor

org.apache.hadoop.yarn.server.nodemanager.ContainerExecutor.DelayedProcessKiller, org.apache.hadoop.yarn.server.nodemanager.ContainerExecutor.ExitCode, org.apache.hadoop.yarn.server.nodemanager.ContainerExecutor.Signal

Field Summary

Fields inherited from class org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor

lfs

Fields inherited from class org.apache.hadoop.yarn.server.nodemanager.ContainerExecutor

TASK_LAUNCH_SCRIPT_PERMISSION

Constructor Summary

Constructors

Constructor and Description
InJvmContainerExecutor() Will construct the instance of this ContainerExecutor and will install a SystemExitDisallowingSecurityManager which will help with managing the life-cycle of the containers that contain System.exit calls.

Method Summary

Methods

Modifier and Type	Method and Description
protected boolean	isContainerActive(org.apache.hadoop.yarn.api.records.ContainerId containerId) This is to ensure that call to super.launchContainer(..) doesn't actually execute anything other then prep work (e.g., sets up directories etc.)
int	launchContainer(org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container container, org.apache.hadoop.fs.Path nmPrivateContainerScriptPath, org.apache.hadoop.fs.Path nmPrivateTokensPath, String userName, String appId, org.apache.hadoop.fs.Path containerWorkDir, List<String> localDirs, List<String> logDirs) Overrides the parent method while still invoking it.

Methods inherited from class org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor

buildCommandExecutor, containerIsAlive, copyFile, createDir, deleteAsUser, getLocalWrapperScriptBuilder, getWorkingDir, init, isContainerProcessAlive, killContainer, setScriptExecutable, signalContainer, startLocalizer

Methods inherited from class org.apache.hadoop.yarn.server.nodemanager.ContainerExecutor

activateContainer, deactivateContainer, getConf, getPidFilePath, getProcessId, getRunCommand, localizeClasspathJar, logOutput, reacquireContainer, setConf, writeLaunchEnv

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

InJvmContainerExecutor

public InJvmContainerExecutor()

Will construct the instance of this ContainerExecutor and will install a SystemExitDisallowingSecurityManager which will help with managing the life-cycle of the containers that contain System.exit calls.

Method Detail

launchContainer

public int launchContainer(org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container container,
                  org.apache.hadoop.fs.Path nmPrivateContainerScriptPath,
                  org.apache.hadoop.fs.Path nmPrivateTokensPath,
                  String userName,
                  String appId,
                  org.apache.hadoop.fs.Path containerWorkDir,
                  List<String> localDirs,
                  List<String> logDirs)
                    throws IOException

Overrides the parent method while still invoking it. Since isContainerActive(ContainerId) method is also overridden here and always returns 'false' the super.launchContainer(..) will only go through the prep routine (e.g., creating temp dirs etc.) while never launching the actual container via the launch script. This will ensure that all the expectations of the container to be launched (e.g., symlinks etc.) are satisfied. The actual launch will be performed by invoking doLaunch(Container, Path) method.

Overrides:

launchContainer in class org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor

Throws:

IOException

isContainerActive

protected boolean isContainerActive(org.apache.hadoop.yarn.api.records.ContainerId containerId)

This is to ensure that call to super.launchContainer(..) doesn't actually execute anything other then prep work (e.g., sets up directories etc.)

Overrides:

isContainerActive in class org.apache.hadoop.yarn.server.nodemanager.ContainerExecutor