Yarn commands are invoked by the bin/yarn script. Running the yarn script without any arguments prints the description for all commands.
Usage: yarn [--config confdir] COMMAND
Yarn has an option parsing framework that employs parsing generic options as well as running classes.
COMMAND_OPTIONS | Description |
---|---|
--config confdir | Overwrites the default Configuration directory. Default is ${HADOOP_PREFIX}/conf. |
COMMAND COMMAND_OPTIONS | Various commands with their options are described in the following sections. The commands have been grouped into User Commands and Administration Commands. |
Commands useful for users of a Hadoop cluster.
Runs a jar file. Users can bundle their Yarn code in a jar file and execute it using this command.
Usage: yarn jar <jar> [mainClass] args...
Prints application(s) report/kill application
Usage: yarn application <options>
COMMAND_OPTIONS | Description |
---|---|
-list | Lists applications from the RM. Supports optional use of -appTypes to filter applications based on application type, and -appStates to filter applications based on application state. |
-appStates States | Works with -list to filter applications based on input comma-separated list of application states. The valid application state can be one of the following: ALL, NEW, NEW_SAVING, SUBMITTED, ACCEPTED, RUNNING, FINISHED, FAILED, KILLED |
-appTypes Types | Works with -list to filter applications based on input comma-separated list of application types. |
-status ApplicationId | Prints the status of the application. |
-kill ApplicationId | Kills the application. |
Prints node report(s)
Usage: yarn node <options>
COMMAND_OPTIONS | Description |
---|---|
-list | Lists all running nodes. Supports optional use of -states to filter nodes based on node state, and -all to list all nodes. |
-states States | Works with -list to filter nodes based on input comma-separated list of node states. |
-all | Works with -list to list all nodes. |
-status NodeId | Prints the status report of the node. |
Dump the container logs
Usage: yarn logs -applicationId <application ID> <options>
COMMAND_OPTIONS | Description |
---|---|
-applicationId <application ID> | Specifies an application id |
-appOwner AppOwner | AppOwner (assumed to be current user if not specified) |
-containerId ContainerId | ContainerId (must be specified if node address is specified) |
-nodeAddress NodeAddress | NodeAddress in the format nodename:port (must be specified if container id is specified) |
Commands useful for administrators of a Hadoop cluster.
Start the ResourceManager
Usage: yarn resourcemanager [-format-state-store]
COMMAND_OPTIONS | Description |
---|---|
-format-state-store | Formats the RMStateStore. This will clear the RMStateStore and is useful if past applications are no longer needed. This should be run only when the ResourceManager is not running. |
Runs ResourceManager admin client
Usage: yarn rmadmin [-refreshQueues] [-refreshNodes] [-refreshUserToGroupsMapping] [-refreshSuperUserGroupsConfiguration] [-refreshAdminAcls] [-refreshServiceAcl] [-getGroups [username]] [-help [cmd]] [-transitionToActive <serviceId>] [-transitionToStandby <serviceId>] [-getServiceState <serviceId>] [-checkHealth <serviceId>]
COMMAND_OPTIONS | Description |
---|---|
-refreshQueues | Reload the queues' acls, states and scheduler specific properties. ResourceManager will reload the mapred-queues configuration file. |
-refreshNodes | Refresh the hosts information at the ResourceManager. |
-refreshUserToGroupsMappings | Refresh user-to-groups mappings. |
-refreshSuperUserGroupsConfiguration | Refresh superuser proxy groups mappings. |
-refreshAdminAcls | Refresh acls for administration of ResourceManager |
-refreshServiceAcl | Reload the service-level authorization policy file ResourceManager will reload the authorization policy file. |
-getGroups [username] | Get groups the specified user belongs to. |
-help [cmd] | Displays help for the given command or all commands if none is specified. |
-transitionToActive <serviceId> | Transitions the service into Active state. |
-transitionToStandby <serviceId> | Transitions the service into Standby state. |
-getServiceState <serviceId> | Returns the state of the service. |
-checkHealth <serviceId> | Requests that the service perform a health check. The RMAdmin tool will exit with a non-zero exit code if the check fails. |
Get/Set the log level for each daemon.
Usage: yarn daemonlog -getlevel <host:port> <name> Usage: yarn daemonlog -setlevel <host:port> <name> <level>
COMMAND_OPTIONS | Description |
---|---|
-getlevel <host:port> <name> | Prints the log level of the daemon running at <host:port>. This command internally connects to http://<host:port>/logLevel?log=<name> |
-setlevel <host:port> <name> <level> | Sets the log level of the daemon running at <host:port>. This command internally connects to http://<host:port>/logLevel?log=<name> |