public class LocalDirsHandlerService
extends org.apache.hadoop.service.AbstractService
Constructor and Description |
---|
LocalDirsHandlerService() |
LocalDirsHandlerService(NodeManagerMetrics nodeManagerMetrics) |
Modifier and Type | Method and Description |
---|---|
boolean |
areDisksHealthy()
The minimum fraction of number of disks needed to be healthy for a node to
be considered healthy in terms of disks is configured using
YarnConfiguration.NM_MIN_HEALTHY_DISKS_FRACTION , with a default
value of YarnConfiguration.DEFAULT_NM_MIN_HEALTHY_DISKS_FRACTION . |
void |
deregisterLocalDirsChangeListener(DirectoryCollection.DirsChangeListener listener) |
void |
deregisterLogDirsChangeListener(DirectoryCollection.DirsChangeListener listener) |
List<String> |
getDiskFullLocalDirs() |
List<String> |
getDiskFullLogDirs() |
String |
getDisksHealthReport(boolean listGoodDirs)
Function to generate a report on the state of the disks.
|
long |
getLastDisksCheckTime() |
List<String> |
getLocalDirs() |
List<String> |
getLocalDirsForCleanup()
Function to get the local dirs which should be considered when cleaning up
resources.
|
List<String> |
getLocalDirsForRead()
Function to get the local dirs which should be considered for reading
existing files on disk.
|
org.apache.hadoop.fs.Path |
getLocalPathForRead(String pathStr) |
org.apache.hadoop.fs.Path |
getLocalPathForWrite(String pathStr) |
org.apache.hadoop.fs.Path |
getLocalPathForWrite(String pathStr,
long size,
boolean checkWrite) |
List<String> |
getLogDirs() |
List<String> |
getLogDirsForCleanup()
Function to get the log dirs which should be considered when cleaning up
resources.
|
List<String> |
getLogDirsForRead()
Function to get the log dirs which should be considered for reading
existing files on disk.
|
org.apache.hadoop.fs.Path |
getLogPathForWrite(String pathStr,
boolean checkWrite) |
org.apache.hadoop.fs.Path |
getLogPathToRead(String pathStr) |
boolean |
isGoodLocalDir(String path) |
boolean |
isGoodLogDir(String path) |
void |
registerLocalDirsChangeListener(DirectoryCollection.DirsChangeListener listener) |
void |
registerLogDirsChangeListener(DirectoryCollection.DirsChangeListener listener) |
protected void |
serviceInit(org.apache.hadoop.conf.Configuration config)
Method which initializes the timertask and its interval time.
|
protected void |
serviceStart()
Method used to start the disk health monitoring, if enabled.
|
protected void |
serviceStop()
Method used to terminate the disk health monitoring service.
|
protected void |
updateMetrics() |
static String[] |
validatePaths(String[] paths) |
close, getBlockers, getConfig, getFailureCause, getFailureState, getLifecycleHistory, getName, getServiceState, getStartTime, init, isInState, noteFailure, putBlocker, registerGlobalListener, registerServiceListener, removeBlocker, setConfig, start, stop, toString, unregisterGlobalListener, unregisterServiceListener, waitForServiceToStop
public LocalDirsHandlerService()
public LocalDirsHandlerService(NodeManagerMetrics nodeManagerMetrics)
protected void serviceInit(org.apache.hadoop.conf.Configuration config) throws Exception
serviceInit
in class org.apache.hadoop.service.AbstractService
Exception
protected void serviceStart() throws Exception
serviceStart
in class org.apache.hadoop.service.AbstractService
Exception
protected void serviceStop() throws Exception
serviceStop
in class org.apache.hadoop.service.AbstractService
Exception
public void registerLocalDirsChangeListener(DirectoryCollection.DirsChangeListener listener)
public void registerLogDirsChangeListener(DirectoryCollection.DirsChangeListener listener)
public void deregisterLocalDirsChangeListener(DirectoryCollection.DirsChangeListener listener)
public void deregisterLogDirsChangeListener(DirectoryCollection.DirsChangeListener listener)
public List<String> getLocalDirs()
public List<String> getLogDirs()
public List<String> getDiskFullLocalDirs()
public List<String> getDiskFullLogDirs()
public List<String> getLocalDirsForRead()
public List<String> getLocalDirsForCleanup()
public List<String> getLogDirsForRead()
public List<String> getLogDirsForCleanup()
public String getDisksHealthReport(boolean listGoodDirs)
listGoodDirs
- flag to determine whether the report should report the state of
good dirs or failed dirspublic boolean areDisksHealthy()
YarnConfiguration.NM_MIN_HEALTHY_DISKS_FRACTION
, with a default
value of YarnConfiguration.DEFAULT_NM_MIN_HEALTHY_DISKS_FRACTION
.public long getLastDisksCheckTime()
public boolean isGoodLocalDir(String path)
public boolean isGoodLogDir(String path)
public org.apache.hadoop.fs.Path getLocalPathForWrite(String pathStr) throws IOException
IOException
public org.apache.hadoop.fs.Path getLocalPathForWrite(String pathStr, long size, boolean checkWrite) throws IOException
IOException
public org.apache.hadoop.fs.Path getLocalPathForRead(String pathStr) throws IOException
IOException
public org.apache.hadoop.fs.Path getLogPathForWrite(String pathStr, boolean checkWrite) throws IOException
IOException
public org.apache.hadoop.fs.Path getLogPathToRead(String pathStr) throws IOException
IOException
protected void updateMetrics()
Copyright © 2018 Apache Software Foundation. All Rights Reserved.