Index
All Classes and Interfaces|All Packages|Constant Field Values
A
- acceptedUploads - Variable in class org.apache.hadoop.yarn.server.sharedcachemanager.webapp.SCMMetricsInfo
- addResource(String, String) - Method in class org.apache.hadoop.yarn.server.sharedcachemanager.store.InMemorySCMStore
-
Adds the given resource to the store under the key and the filename.
- addResource(String, String) - Method in class org.apache.hadoop.yarn.server.sharedcachemanager.store.SCMStore
-
Add a resource to the shared cache and it's associated filename.
- addResourceReference(String, SharedCacheResourceReference) - Method in class org.apache.hadoop.yarn.server.sharedcachemanager.store.InMemorySCMStore
-
Adds the provided resource reference to the cache resource under the key, and updates the access time.
- addResourceReference(String, SharedCacheResourceReference) - Method in class org.apache.hadoop.yarn.server.sharedcachemanager.store.SCMStore
-
Add a
SharedCacheResourceReferenceto a resource and update the resource access time. - appChecker - Variable in class org.apache.hadoop.yarn.server.sharedcachemanager.store.SCMStore
- AppChecker - Class in org.apache.hadoop.yarn.server.sharedcachemanager
-
An interface for checking whether an app is running so that the cleaner service may determine if it can safely remove a cached entry.
- AppChecker() - Constructor for class org.apache.hadoop.yarn.server.sharedcachemanager.AppChecker
- AppChecker(String) - Constructor for class org.apache.hadoop.yarn.server.sharedcachemanager.AppChecker
C
- cacheHits - Variable in class org.apache.hadoop.yarn.server.sharedcachemanager.webapp.SCMMetricsInfo
- cacheMisses - Variable in class org.apache.hadoop.yarn.server.sharedcachemanager.webapp.SCMMetricsInfo
- cacheReleases - Variable in class org.apache.hadoop.yarn.server.sharedcachemanager.webapp.SCMMetricsInfo
- canUpload(SCMUploaderCanUploadRequest) - Method in class org.apache.hadoop.yarn.server.sharedcachemanager.SharedCacheUploaderService
- CleanerMetrics - Class in org.apache.hadoop.yarn.server.sharedcachemanager.metrics
-
This class is for maintaining the various Cleaner activity statistics and publishing them through the metrics interfaces.
- CleanerService - Class in org.apache.hadoop.yarn.server.sharedcachemanager
-
The cleaner service that maintains the shared cache area, and cleans up stale entries on a regular basis.
- CleanerService(SCMStore) - Constructor for class org.apache.hadoop.yarn.server.sharedcachemanager.CleanerService
- cleanResourceReferences(String) - Method in class org.apache.hadoop.yarn.server.sharedcachemanager.store.InMemorySCMStore
-
Provides atomicity for the method.
- cleanResourceReferences(String) - Method in class org.apache.hadoop.yarn.server.sharedcachemanager.store.SCMStore
-
Clean all resource references to a cache resource that contain application ids pointing to finished applications.
- ClientProtocolService - Class in org.apache.hadoop.yarn.server.sharedcachemanager
-
This service handles all rpc calls from the client to the shared cache manager.
- ClientProtocolService(SCMStore) - Constructor for class org.apache.hadoop.yarn.server.sharedcachemanager.ClientProtocolService
- ClientSCMMetrics - Class in org.apache.hadoop.yarn.server.sharedcachemanager.metrics
-
This class is for maintaining client requests metrics and publishing them through the metrics interfaces.
- content() - Method in class org.apache.hadoop.yarn.server.sharedcachemanager.webapp.SCMOverviewPage
- createAppCheckerService(Configuration) - Static method in class org.apache.hadoop.yarn.server.sharedcachemanager.store.SCMStore
-
Create an instance of the AppChecker service via reflection based on the
YarnConfiguration.SCM_APP_CHECKER_CLASSparameter.
E
- equals(Object) - Method in class org.apache.hadoop.yarn.server.sharedcachemanager.store.SharedCacheResourceReference
G
- getAcceptedUploads() - Method in class org.apache.hadoop.yarn.server.sharedcachemanager.metrics.SharedCacheUploaderMetrics
- getAcceptedUploads() - Method in class org.apache.hadoop.yarn.server.sharedcachemanager.webapp.SCMMetricsInfo
- getActiveApplications() - Method in class org.apache.hadoop.yarn.server.sharedcachemanager.AppChecker
-
Returns the list of all active apps at the given time.
- getActiveApplications() - Method in class org.apache.hadoop.yarn.server.sharedcachemanager.RemoteAppChecker
- getAppId() - Method in class org.apache.hadoop.yarn.server.sharedcachemanager.store.SharedCacheResourceReference
- getCacheHits() - Method in class org.apache.hadoop.yarn.server.sharedcachemanager.metrics.ClientSCMMetrics
- getCacheHits() - Method in class org.apache.hadoop.yarn.server.sharedcachemanager.webapp.SCMMetricsInfo
- getCacheMisses() - Method in class org.apache.hadoop.yarn.server.sharedcachemanager.metrics.ClientSCMMetrics
- getCacheMisses() - Method in class org.apache.hadoop.yarn.server.sharedcachemanager.webapp.SCMMetricsInfo
- getCacheReleases() - Method in class org.apache.hadoop.yarn.server.sharedcachemanager.metrics.ClientSCMMetrics
- getCacheReleases() - Method in class org.apache.hadoop.yarn.server.sharedcachemanager.webapp.SCMMetricsInfo
- getDeletedFiles() - Method in class org.apache.hadoop.yarn.server.sharedcachemanager.metrics.CleanerMetrics
- getFileErrors() - Method in class org.apache.hadoop.yarn.server.sharedcachemanager.metrics.CleanerMetrics
- getInstance() - Static method in class org.apache.hadoop.yarn.server.sharedcachemanager.metrics.CleanerMetrics
- getInstance() - Static method in class org.apache.hadoop.yarn.server.sharedcachemanager.metrics.ClientSCMMetrics
- getInstance() - Static method in class org.apache.hadoop.yarn.server.sharedcachemanager.metrics.SharedCacheUploaderMetrics
- getProcessedFiles() - Method in class org.apache.hadoop.yarn.server.sharedcachemanager.metrics.CleanerMetrics
- getRejectUploads() - Method in class org.apache.hadoop.yarn.server.sharedcachemanager.metrics.SharedCacheUploaderMetrics
- getRejectUploads() - Method in class org.apache.hadoop.yarn.server.sharedcachemanager.webapp.SCMMetricsInfo
- getResourceReferences(String) - Method in class org.apache.hadoop.yarn.server.sharedcachemanager.store.InMemorySCMStore
-
Returns the list of resource references currently registered under the cache entry.
- getResourceReferences(String) - Method in class org.apache.hadoop.yarn.server.sharedcachemanager.store.SCMStore
-
Get the
SharedCacheResourceReference(s) associated with the resource. - getShortUserName() - Method in class org.apache.hadoop.yarn.server.sharedcachemanager.store.SharedCacheResourceReference
- getTotalDeletedFiles() - Method in class org.apache.hadoop.yarn.server.sharedcachemanager.metrics.CleanerMetrics
- getTotalDeletedFiles() - Method in class org.apache.hadoop.yarn.server.sharedcachemanager.webapp.SCMMetricsInfo
- getTotalFileErrors() - Method in class org.apache.hadoop.yarn.server.sharedcachemanager.metrics.CleanerMetrics
- getTotalProcessedFiles() - Method in class org.apache.hadoop.yarn.server.sharedcachemanager.metrics.CleanerMetrics
- getTotalProcessedFiles() - Method in class org.apache.hadoop.yarn.server.sharedcachemanager.webapp.SCMMetricsInfo
- GLOBAL_CLEANER_PID - Static variable in class org.apache.hadoop.yarn.server.sharedcachemanager.CleanerService
-
The name of the global cleaner lock that the cleaner creates to indicate that a cleaning process is in progress.
H
- hashCode() - Method in class org.apache.hadoop.yarn.server.sharedcachemanager.store.SharedCacheResourceReference
I
- incAcceptedUploads() - Method in class org.apache.hadoop.yarn.server.sharedcachemanager.metrics.SharedCacheUploaderMetrics
-
One accepted upload event
- incCacheHitCount() - Method in class org.apache.hadoop.yarn.server.sharedcachemanager.metrics.ClientSCMMetrics
-
One cache hit event
- incCacheMissCount() - Method in class org.apache.hadoop.yarn.server.sharedcachemanager.metrics.ClientSCMMetrics
-
One cache miss event
- incCacheRelease() - Method in class org.apache.hadoop.yarn.server.sharedcachemanager.metrics.ClientSCMMetrics
-
One cache release event
- incRejectedUploads() - Method in class org.apache.hadoop.yarn.server.sharedcachemanager.metrics.SharedCacheUploaderMetrics
-
One rejected upload event
- index() - Method in class org.apache.hadoop.yarn.server.sharedcachemanager.webapp.SCMController
- InMemorySCMStore - Class in org.apache.hadoop.yarn.server.sharedcachemanager.store
-
A thread safe version of an in-memory SCM store.
- InMemorySCMStore() - Constructor for class org.apache.hadoop.yarn.server.sharedcachemanager.store.InMemorySCMStore
- InMemorySCMStore(AppChecker) - Constructor for class org.apache.hadoop.yarn.server.sharedcachemanager.store.InMemorySCMStore
- isApplicationActive(ApplicationId) - Method in class org.apache.hadoop.yarn.server.sharedcachemanager.AppChecker
-
Returns whether the app is in an active state.
- isApplicationActive(ApplicationId) - Method in class org.apache.hadoop.yarn.server.sharedcachemanager.RemoteAppChecker
- isResourceEvictable(String, FileStatus) - Method in class org.apache.hadoop.yarn.server.sharedcachemanager.store.InMemorySCMStore
- isResourceEvictable(String, FileStatus) - Method in class org.apache.hadoop.yarn.server.sharedcachemanager.store.SCMStore
-
Check if a specific resource is evictable according to the store's enabled cache eviction policies.
L
- LOG - Static variable in class org.apache.hadoop.yarn.server.sharedcachemanager.metrics.CleanerMetrics
M
- main(String[]) - Static method in class org.apache.hadoop.yarn.server.sharedcachemanager.SharedCacheManager
N
- nav() - Method in class org.apache.hadoop.yarn.server.sharedcachemanager.webapp.SCMOverviewPage
- notify(SCMUploaderNotifyRequest) - Method in class org.apache.hadoop.yarn.server.sharedcachemanager.SharedCacheUploaderService
O
- org.apache.hadoop.yarn.server.sharedcachemanager - package org.apache.hadoop.yarn.server.sharedcachemanager
- org.apache.hadoop.yarn.server.sharedcachemanager.metrics - package org.apache.hadoop.yarn.server.sharedcachemanager.metrics
- org.apache.hadoop.yarn.server.sharedcachemanager.store - package org.apache.hadoop.yarn.server.sharedcachemanager.store
- org.apache.hadoop.yarn.server.sharedcachemanager.webapp - package org.apache.hadoop.yarn.server.sharedcachemanager.webapp
- overview() - Method in class org.apache.hadoop.yarn.server.sharedcachemanager.webapp.SCMController
-
It is referenced in SCMWebServer.SCMWebApp.setup()
P
- preHead(Hamlet.HTML<HtmlPage.__>) - Method in class org.apache.hadoop.yarn.server.sharedcachemanager.webapp.SCMOverviewPage
R
- rejectedUploads - Variable in class org.apache.hadoop.yarn.server.sharedcachemanager.webapp.SCMMetricsInfo
- release(ReleaseSharedCacheResourceRequest) - Method in class org.apache.hadoop.yarn.server.sharedcachemanager.ClientProtocolService
- RemoteAppChecker - Class in org.apache.hadoop.yarn.server.sharedcachemanager
-
An implementation of AppChecker that queries the resource manager remotely to determine whether the app is running.
- RemoteAppChecker() - Constructor for class org.apache.hadoop.yarn.server.sharedcachemanager.RemoteAppChecker
- removeResource(String) - Method in class org.apache.hadoop.yarn.server.sharedcachemanager.store.InMemorySCMStore
-
Removes the given resource from the store.
- removeResource(String) - Method in class org.apache.hadoop.yarn.server.sharedcachemanager.store.SCMStore
-
Remove a resource from the shared cache.
- removeResourceReference(String, SharedCacheResourceReference, boolean) - Method in class org.apache.hadoop.yarn.server.sharedcachemanager.store.InMemorySCMStore
-
Removes the provided resource reference from the resource.
- removeResourceReference(String, SharedCacheResourceReference, boolean) - Method in class org.apache.hadoop.yarn.server.sharedcachemanager.store.SCMStore
-
Remove a
SharedCacheResourceReferencefrom a resource. - removeResourceReferences(String, Collection<SharedCacheResourceReference>, boolean) - Method in class org.apache.hadoop.yarn.server.sharedcachemanager.store.InMemorySCMStore
-
Removes the provided collection of resource references from the resource.
- removeResourceReferences(String, Collection<SharedCacheResourceReference>, boolean) - Method in class org.apache.hadoop.yarn.server.sharedcachemanager.store.SCMStore
-
Remove a collection of
SharedCacheResourceReferencesfrom a resource. - reportAFileDelete() - Method in class org.apache.hadoop.yarn.server.sharedcachemanager.metrics.CleanerMetrics
-
Report a delete operation at the current system time
- reportAFileError() - Method in class org.apache.hadoop.yarn.server.sharedcachemanager.metrics.CleanerMetrics
-
Report a process operation error at the current system time
- reportAFileProcess() - Method in class org.apache.hadoop.yarn.server.sharedcachemanager.metrics.CleanerMetrics
-
Report a process operation at the current system time
- reportCleaningStart() - Method in class org.apache.hadoop.yarn.server.sharedcachemanager.metrics.CleanerMetrics
-
Report the start a new run of the cleaner.
- runCleanerTask() - Method in class org.apache.hadoop.yarn.server.sharedcachemanager.CleanerService
-
Execute an on-demand cleaner task.
- runCleanerTask(RunSharedCacheCleanerTaskRequest) - Method in class org.apache.hadoop.yarn.server.sharedcachemanager.SCMAdminProtocolService
S
- SCMAdminProtocolService - Class in org.apache.hadoop.yarn.server.sharedcachemanager
-
This service handles all SCMAdminProtocol rpc calls from administrators to the shared cache manager.
- SCMAdminProtocolService(CleanerService) - Constructor for class org.apache.hadoop.yarn.server.sharedcachemanager.SCMAdminProtocolService
- SCMController - Class in org.apache.hadoop.yarn.server.sharedcachemanager.webapp
-
The controller class for the shared cache manager web app.
- SCMController() - Constructor for class org.apache.hadoop.yarn.server.sharedcachemanager.webapp.SCMController
- SCMMetricsInfo - Class in org.apache.hadoop.yarn.server.sharedcachemanager.webapp
-
This class is used to summarize useful shared cache manager metrics for the webUI display.
- SCMMetricsInfo() - Constructor for class org.apache.hadoop.yarn.server.sharedcachemanager.webapp.SCMMetricsInfo
- SCMMetricsInfo(CleanerMetrics, ClientSCMMetrics, SharedCacheUploaderMetrics) - Constructor for class org.apache.hadoop.yarn.server.sharedcachemanager.webapp.SCMMetricsInfo
- SCMOverviewPage - Class in org.apache.hadoop.yarn.server.sharedcachemanager.webapp
-
This class is to render the shared cache manager web ui overview page.
- SCMOverviewPage() - Constructor for class org.apache.hadoop.yarn.server.sharedcachemanager.webapp.SCMOverviewPage
- SCMStore - Class in org.apache.hadoop.yarn.server.sharedcachemanager.store
-
An abstract class for the data store used by the shared cache manager service.
- SCMStore(String) - Constructor for class org.apache.hadoop.yarn.server.sharedcachemanager.store.SCMStore
- SCMWebServer - Class in org.apache.hadoop.yarn.server.sharedcachemanager.webapp
-
A very simple web interface for the metrics reported by
SharedCacheManagerTODO: Security for web ui (See YARN-2774) - SCMWebServer(SharedCacheManager) - Constructor for class org.apache.hadoop.yarn.server.sharedcachemanager.webapp.SCMWebServer
- serviceInit(Configuration) - Method in class org.apache.hadoop.yarn.server.sharedcachemanager.CleanerService
- serviceInit(Configuration) - Method in class org.apache.hadoop.yarn.server.sharedcachemanager.ClientProtocolService
- serviceInit(Configuration) - Method in class org.apache.hadoop.yarn.server.sharedcachemanager.RemoteAppChecker
- serviceInit(Configuration) - Method in class org.apache.hadoop.yarn.server.sharedcachemanager.SCMAdminProtocolService
- serviceInit(Configuration) - Method in class org.apache.hadoop.yarn.server.sharedcachemanager.SharedCacheManager
- serviceInit(Configuration) - Method in class org.apache.hadoop.yarn.server.sharedcachemanager.SharedCacheUploaderService
- serviceInit(Configuration) - Method in class org.apache.hadoop.yarn.server.sharedcachemanager.store.InMemorySCMStore
-
The in-memory store bootstraps itself from the shared cache entries that exist in HDFS.
- serviceInit(Configuration) - Method in class org.apache.hadoop.yarn.server.sharedcachemanager.store.SCMStore
- serviceInit(Configuration) - Method in class org.apache.hadoop.yarn.server.sharedcachemanager.webapp.SCMWebServer
- serviceStart() - Method in class org.apache.hadoop.yarn.server.sharedcachemanager.CleanerService
- serviceStart() - Method in class org.apache.hadoop.yarn.server.sharedcachemanager.ClientProtocolService
- serviceStart() - Method in class org.apache.hadoop.yarn.server.sharedcachemanager.SCMAdminProtocolService
- serviceStart() - Method in class org.apache.hadoop.yarn.server.sharedcachemanager.SharedCacheUploaderService
- serviceStart() - Method in class org.apache.hadoop.yarn.server.sharedcachemanager.store.InMemorySCMStore
- serviceStart() - Method in class org.apache.hadoop.yarn.server.sharedcachemanager.webapp.SCMWebServer
- serviceStop() - Method in class org.apache.hadoop.yarn.server.sharedcachemanager.CleanerService
- serviceStop() - Method in class org.apache.hadoop.yarn.server.sharedcachemanager.ClientProtocolService
- serviceStop() - Method in class org.apache.hadoop.yarn.server.sharedcachemanager.SCMAdminProtocolService
- serviceStop() - Method in class org.apache.hadoop.yarn.server.sharedcachemanager.SharedCacheManager
- serviceStop() - Method in class org.apache.hadoop.yarn.server.sharedcachemanager.SharedCacheUploaderService
- serviceStop() - Method in class org.apache.hadoop.yarn.server.sharedcachemanager.store.InMemorySCMStore
- serviceStop() - Method in class org.apache.hadoop.yarn.server.sharedcachemanager.webapp.SCMWebServer
- SharedCacheManager - Class in org.apache.hadoop.yarn.server.sharedcachemanager
-
This service maintains the shared cache meta data.
- SharedCacheManager() - Constructor for class org.apache.hadoop.yarn.server.sharedcachemanager.SharedCacheManager
- SharedCacheResourceReference - Class in org.apache.hadoop.yarn.server.sharedcachemanager.store
-
This is an object that represents a reference to a shared cache resource.
- SharedCacheResourceReference(ApplicationId, String) - Constructor for class org.apache.hadoop.yarn.server.sharedcachemanager.store.SharedCacheResourceReference
-
Create a resource reference.
- SharedCacheUploaderMetrics - Class in org.apache.hadoop.yarn.server.sharedcachemanager.metrics
-
This class is for maintaining shared cache uploader requests metrics and publishing them through the metrics interfaces.
- SharedCacheUploaderService - Class in org.apache.hadoop.yarn.server.sharedcachemanager
-
This service handles all rpc calls from the NodeManager uploader to the shared cache manager.
- SharedCacheUploaderService(SCMStore) - Constructor for class org.apache.hadoop.yarn.server.sharedcachemanager.SharedCacheUploaderService
- SHUTDOWN_HOOK_PRIORITY - Static variable in class org.apache.hadoop.yarn.server.sharedcachemanager.SharedCacheManager
-
Priority of the SharedCacheManager shutdown hook.
T
- totalDeletedFiles - Variable in class org.apache.hadoop.yarn.server.sharedcachemanager.webapp.SCMMetricsInfo
- totalProcessedFiles - Variable in class org.apache.hadoop.yarn.server.sharedcachemanager.webapp.SCMMetricsInfo
U
- use(UseSharedCacheResourceRequest) - Method in class org.apache.hadoop.yarn.server.sharedcachemanager.ClientProtocolService
All Classes and Interfaces|All Packages|Constant Field Values