org.apache.hadoop.yarn.util

Class FSDownload

java.lang.Object

org.apache.hadoop.yarn.util.FSDownload

All Implemented Interfaces:

Callable<org.apache.hadoop.fs.Path>

@InterfaceAudience.LimitedPrivate(value={"YARN","MapReduce"})
public class FSDownload
extends Object
implements Callable<org.apache.hadoop.fs.Path>

Download a single URL to the local disk.

Constructor Summary

Constructors

Constructor and Description
FSDownload(org.apache.hadoop.fs.FileContext files, org.apache.hadoop.security.UserGroupInformation ugi, org.apache.hadoop.conf.Configuration conf, org.apache.hadoop.fs.Path destDirPath, org.apache.hadoop.yarn.api.records.LocalResource resource)
FSDownload(org.apache.hadoop.fs.FileContext files, org.apache.hadoop.security.UserGroupInformation ugi, org.apache.hadoop.conf.Configuration conf, org.apache.hadoop.fs.Path destDirPath, org.apache.hadoop.yarn.api.records.LocalResource resource, com.google.common.cache.LoadingCache<org.apache.hadoop.fs.Path,Future<org.apache.hadoop.fs.FileStatus>> statCache)

Method Summary

Modifier and Type	Method and Description
org.apache.hadoop.fs.Path	call()
static com.google.common.cache.CacheLoader<org.apache.hadoop.fs.Path,Future<org.apache.hadoop.fs.FileStatus>>	createStatusCacheLoader(org.apache.hadoop.conf.Configuration conf) Creates the cache loader for the status loading cache.
static boolean	isPublic(org.apache.hadoop.fs.FileSystem fs, org.apache.hadoop.fs.Path current, org.apache.hadoop.fs.FileStatus sStat, com.google.common.cache.LoadingCache<org.apache.hadoop.fs.Path,Future<org.apache.hadoop.fs.FileStatus>> statCache) Returns a boolean to denote whether a cache file is visible to all (public) or not

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

FSDownload

public FSDownload(org.apache.hadoop.fs.FileContext files,
                  org.apache.hadoop.security.UserGroupInformation ugi,
                  org.apache.hadoop.conf.Configuration conf,
                  org.apache.hadoop.fs.Path destDirPath,
                  org.apache.hadoop.yarn.api.records.LocalResource resource)

FSDownload

public FSDownload(org.apache.hadoop.fs.FileContext files,
                  org.apache.hadoop.security.UserGroupInformation ugi,
                  org.apache.hadoop.conf.Configuration conf,
                  org.apache.hadoop.fs.Path destDirPath,
                  org.apache.hadoop.yarn.api.records.LocalResource resource,
                  com.google.common.cache.LoadingCache<org.apache.hadoop.fs.Path,Future<org.apache.hadoop.fs.FileStatus>> statCache)

Method Detail

createStatusCacheLoader

public static com.google.common.cache.CacheLoader<org.apache.hadoop.fs.Path,Future<org.apache.hadoop.fs.FileStatus>> createStatusCacheLoader(org.apache.hadoop.conf.Configuration conf)

Creates the cache loader for the status loading cache. This should be used to create an instance of the status cache that is passed into the FSDownload constructor.

isPublic

@InterfaceAudience.Private
public static boolean isPublic(org.apache.hadoop.fs.FileSystem fs,
                                                          org.apache.hadoop.fs.Path current,
                                                          org.apache.hadoop.fs.FileStatus sStat,
                                                          com.google.common.cache.LoadingCache<org.apache.hadoop.fs.Path,Future<org.apache.hadoop.fs.FileStatus>> statCache)
                                                   throws IOException

Returns a boolean to denote whether a cache file is visible to all (public) or not

Returns:

true if the path in the current path is visible to all, false otherwise

Throws:

IOException

call

public org.apache.hadoop.fs.Path call()
                               throws Exception

Specified by:

call in interface Callable<org.apache.hadoop.fs.Path>

Throws:

Exception