org.apache.hadoop.yarn.server.nodemanager

Class LinuxContainerExecutor

java.lang.Object

org.apache.hadoop.yarn.server.nodemanager.ContainerExecutor

org.apache.hadoop.yarn.server.nodemanager.LinuxContainerExecutor

All Implemented Interfaces:

org.apache.hadoop.conf.Configurable

public class LinuxContainerExecutor
extends ContainerExecutor

Container execution for Linux. Provides linux-specific localization mechanisms, resource management via cgroups and can switch between multiple container runtimes - e.g Standard "Process Tree", Docker etc

Nested Class Summary

Nested classes/interfaces inherited from class org.apache.hadoop.yarn.server.nodemanager.ContainerExecutor

ContainerExecutor.DelayedProcessKiller, ContainerExecutor.ExitCode, ContainerExecutor.Signal

Field Summary

Fields inherited from class org.apache.hadoop.yarn.server.nodemanager.ContainerExecutor

DIRECTORY_CONTENTS, TASK_LAUNCH_SCRIPT_PERMISSION

Constructor Summary

Constructors

Constructor and Description
LinuxContainerExecutor()
LinuxContainerExecutor(LinuxContainerRuntime linuxContainerRuntime)

Method Summary

Methods

Modifier and Type	Method and Description
protected void	addSchedPriorityCommand(List<String> command)
void	buildMainArgs(List<String> command, String user, String appId, String locId, InetSocketAddress nmAddr, List<String> localDirs)
void	deleteAsUser(DeletionAsUserContext ctx) Delete specified directories as a given user.
protected String	getContainerExecutorExecutablePath(org.apache.hadoop.conf.Configuration conf)
protected PrivilegedOperationExecutor	getPrivilegedOperationExecutor()
void	init() Run the executor initialization steps.
boolean	isContainerAlive(ContainerLivenessContext ctx) Check if a container is alive.
int	launchContainer(ContainerStartContext ctx) Launch the container on the node.
void	mountCgroups(List<String> cgroupKVs, String hierarchy)
int	reacquireContainer(ContainerReacquisitionContext ctx) Recover an already existing container.
void	setConf(org.apache.hadoop.conf.Configuration conf)
boolean	signalContainer(ContainerSignalContext ctx) Signal container with the specified signal.
void	startLocalizer(LocalizerStartContext ctx) Prepare the environment for containers in this application to execute.

Methods inherited from class org.apache.hadoop.yarn.server.nodemanager.ContainerExecutor

activateContainer, deactivateContainer, getConf, getPidFilePath, getProcessId, getRunCommand, getRunCommand, isContainerActive, localizeClasspathJar, logOutput, writeLaunchEnv, writeLaunchEnv

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

LinuxContainerExecutor

public LinuxContainerExecutor()

LinuxContainerExecutor

public LinuxContainerExecutor(LinuxContainerRuntime linuxContainerRuntime)

Method Detail

setConf

public void setConf(org.apache.hadoop.conf.Configuration conf)

Specified by:

setConf in interface org.apache.hadoop.conf.Configurable

Overrides:

setConf in class ContainerExecutor

getContainerExecutorExecutablePath

protected String getContainerExecutorExecutablePath(org.apache.hadoop.conf.Configuration conf)

addSchedPriorityCommand

protected void addSchedPriorityCommand(List<String> command)

getPrivilegedOperationExecutor

protected PrivilegedOperationExecutor getPrivilegedOperationExecutor()

init

public void init()
          throws IOException

Description copied from class: ContainerExecutor

Run the executor initialization steps. Verify that the necessary configs, permissions are in place.

Specified by:

init in class ContainerExecutor

Throws:

IOException

startLocalizer

public void startLocalizer(LocalizerStartContext ctx)
                    throws IOException,
                           InterruptedException

Description copied from class: ContainerExecutor

Prepare the environment for containers in this application to execute.

 For $x in local.dirs
   create $x/$user/$appId
 Copy $nmLocal/appTokens -> $N/$user/$appId
 For $rsrc in private resources
   Copy $rsrc -> $N/$user/filecache/[idef]
 For $rsrc in job resources
   Copy $rsrc -> $N/$user/$appId/filecache/idef
 

Specified by:

startLocalizer in class ContainerExecutor

Parameters:

ctx - LocalizerStartContext that encapsulates necessary information for starting a localizer.

Throws:

IOException - For most application init failures

InterruptedException - If application init thread is halted by NM

buildMainArgs

public void buildMainArgs(List<String> command,
                 String user,
                 String appId,
                 String locId,
                 InetSocketAddress nmAddr,
                 List<String> localDirs)

launchContainer

public int launchContainer(ContainerStartContext ctx)
                    throws IOException

Description copied from class: ContainerExecutor

Launch the container on the node. This is a blocking call and returns only when the container exits.

Specified by:

launchContainer in class ContainerExecutor

Parameters:

ctx - Encapsulates information necessary for launching containers.

Returns:

the return status of the launch

Throws:

IOException

reacquireContainer

public int reacquireContainer(ContainerReacquisitionContext ctx)
                       throws IOException,
                              InterruptedException

Description copied from class: ContainerExecutor

Recover an already existing container. This is a blocking call and returns only when the container exits. Note that the container must have been activated prior to this call.

Overrides:

reacquireContainer in class ContainerExecutor

Parameters:

ctx - encapsulates information necessary to reacquire container

Returns:

The exit code of the pre-existing container

Throws:

IOException

InterruptedException

signalContainer

public boolean signalContainer(ContainerSignalContext ctx)
                        throws IOException

Description copied from class: ContainerExecutor

Signal container with the specified signal.

Specified by:

signalContainer in class ContainerExecutor

Parameters:

ctx - Encapsulates information necessary for signaling containers.

Returns:

returns true if the operation succeeded

Throws:

IOException

deleteAsUser

public void deleteAsUser(DeletionAsUserContext ctx)

Description copied from class: ContainerExecutor

Delete specified directories as a given user.

Specified by:

deleteAsUser in class ContainerExecutor

Parameters:

ctx - Encapsulates information necessary for deletion.

isContainerAlive

public boolean isContainerAlive(ContainerLivenessContext ctx)
                         throws IOException

Description copied from class: ContainerExecutor

Check if a container is alive.

Specified by:

isContainerAlive in class ContainerExecutor

Parameters:

ctx - Encapsulates information necessary for container liveness check.

Returns:

true if container is still alive

Throws:

IOException

mountCgroups

public void mountCgroups(List<String> cgroupKVs,
                String hierarchy)
                  throws IOException

Throws:

IOException