|
||||||||||
PREV NEXT | FRAMES NO FRAMES |
Packages that use Path | |
---|---|
org.apache.hadoop.conf | Configuration of system parameters. |
org.apache.hadoop.fs | An abstract file system API. |
org.apache.hadoop.fs.ftp | |
org.apache.hadoop.fs.s3 | A distributed, block-based implementation of FileSystem that uses Amazon S3
as a backing store. |
org.apache.hadoop.fs.s3native |
A distributed implementation of FileSystem for reading and writing files on
Amazon S3. |
org.apache.hadoop.fs.viewfs | |
org.apache.hadoop.io | Generic i/o code for use when reading and writing data to the network, to databases, and to files. |
org.apache.hadoop.io.compress | |
org.apache.hadoop.mapred | |
org.apache.hadoop.mapred.join | |
org.apache.hadoop.mapred.lib | |
org.apache.hadoop.mapreduce | |
org.apache.hadoop.mapreduce.lib.input | |
org.apache.hadoop.mapreduce.lib.join | |
org.apache.hadoop.mapreduce.lib.output | |
org.apache.hadoop.mapreduce.lib.partition | |
org.apache.hadoop.mapreduce.security | |
org.apache.hadoop.mapreduce.v2.hs | |
org.apache.hadoop.yarn.logaggregation |
Uses of Path in org.apache.hadoop.conf |
---|
Methods in org.apache.hadoop.conf that return Path | |
---|---|
Path |
Configuration.getLocalPath(String dirsProp,
String path)
Get a local file under a directory named by dirsProp with the given path. |
Methods in org.apache.hadoop.conf with parameters of type Path | |
---|---|
void |
Configuration.addResource(Path file)
Add a configuration resource. |
Uses of Path in org.apache.hadoop.fs |
---|
Fields in org.apache.hadoop.fs declared as Path | |
---|---|
protected Path |
TrashPolicy.trash
|
Methods in org.apache.hadoop.fs that return Path | |
---|---|
Path |
FileSystem.createSnapshot(Path path)
Create a snapshot with a default name. |
Path |
FilterFileSystem.createSnapshot(Path path,
String snapshotName)
|
Path |
FileSystem.createSnapshot(Path path,
String snapshotName)
Create a snapshot |
protected Path |
FileSystem.fixRelativePart(Path p)
See FileContext.fixRelativePart(org.apache.hadoop.fs.Path) |
Path |
ChecksumFileSystem.getChecksumFile(Path file)
Return the name of the checksum file associated with a file. |
abstract Path |
TrashPolicy.getCurrentTrashDir()
Get the current working directory of the Trash Policy |
Path |
RawLocalFileSystem.getHomeDirectory()
|
Path |
FilterFileSystem.getHomeDirectory()
|
Path |
FileContext.getHomeDirectory()
Return the current user's home directory in this file system. |
Path |
AbstractFileSystem.getHomeDirectory()
Return the current user's home directory in this file system. |
Path |
FileSystem.getHomeDirectory()
Return the current user's home directory in this filesystem. |
protected Path |
RawLocalFileSystem.getInitialWorkingDirectory()
|
protected Path |
FilterFileSystem.getInitialWorkingDirectory()
|
Path |
AbstractFileSystem.getInitialWorkingDirectory()
Some file systems like LocalFileSystem have an initial workingDir that is used as the starting workingDir. |
protected Path |
FileSystem.getInitialWorkingDirectory()
Note: with the new FilesContext class, getWorkingDirectory() will be removed. |
Path |
RawLocalFileSystem.getLinkTarget(Path f)
|
Path |
FilterFileSystem.getLinkTarget(Path f)
|
Path |
FileContext.getLinkTarget(Path f)
Returns the target of the given symbolic link as it was specified when the link was created. |
Path |
AbstractFileSystem.getLinkTarget(Path f)
Partially resolves the path. |
Path |
LocalFileSystem.getLinkTarget(Path f)
|
Path |
FileSystem.getLinkTarget(Path f)
See FileContext.getLinkTarget(Path) |
Path |
Path.getParent()
Returns the parent of a path or null if at root. |
Path |
FileStatus.getPath()
|
static Path |
Path.getPathWithoutSchemeAndAuthority(Path path)
|
Path |
FileStatus.getSymlink()
|
Path |
RawLocalFileSystem.getWorkingDirectory()
|
Path |
FilterFileSystem.getWorkingDirectory()
Get the current working directory for the given file system |
Path |
FileContext.getWorkingDirectory()
Gets the working directory for wd-relative names (such a "foo/bar"). |
abstract Path |
FileSystem.getWorkingDirectory()
Get the current working directory for the given file system |
Path |
Path.makeQualified(FileSystem fs)
Deprecated. |
Path |
FilterFileSystem.makeQualified(Path path)
Make sure that a path specifies a FileSystem. |
Path |
FileContext.makeQualified(Path path)
Make the path fully qualified if it is isn't. |
Path |
AbstractFileSystem.makeQualified(Path path)
Make the path fully qualified to this file system |
Path |
FileSystem.makeQualified(Path path)
Make sure that a path specifies a FileSystem. |
Path |
Path.makeQualified(URI defaultUri,
Path workingDir)
Returns a qualified path object. |
static Path |
Path.mergePaths(Path path1,
Path path2)
Merge 2 paths such that the second path is appended relative to the first. |
protected Path |
FileContext.resolve(Path f)
Resolves all symbolic links in the specified path. |
protected Path |
FileContext.resolveIntermediate(Path f)
Resolves all symbolic links in the specified path leading up to, but not including the final path component. |
protected Path |
FilterFileSystem.resolveLink(Path f)
|
protected Path |
FileSystem.resolveLink(Path f)
See AbstractFileSystem.getLinkTarget(Path) |
Path |
FilterFileSystem.resolvePath(Path p)
|
Path |
FileContext.resolvePath(Path f)
Resolve the path following any symlinks or mount points |
Path |
AbstractFileSystem.resolvePath(Path p)
Return the fully-qualified path of path f resolving the path through any internal symlinks or mount point |
Path |
FileSystem.resolvePath(Path p)
Return the fully-qualified path of path f resolving the path through any symlinks or mount point |
Path |
RawLocalFileSystem.startLocalOutput(Path fsOutputFile,
Path tmpLocalFile)
|
Path |
FilterFileSystem.startLocalOutput(Path fsOutputFile,
Path tmpLocalFile)
Returns a local File that the user can write output to. |
Path |
ChecksumFileSystem.startLocalOutput(Path fsOutputFile,
Path tmpLocalFile)
|
Path |
FileSystem.startLocalOutput(Path fsOutputFile,
Path tmpLocalFile)
Returns a local File that the user can write output to. |
static Path[] |
FileUtil.stat2Paths(FileStatus[] stats)
convert an array of FileStatus to an array of Path |
static Path[] |
FileUtil.stat2Paths(FileStatus[] stats,
Path path)
convert an array of FileStatus to an array of Path. |
Path |
Path.suffix(String suffix)
Adds a suffix to the final name in the path. |
Methods in org.apache.hadoop.fs that return types with arguments of type Path | |
---|---|
org.apache.hadoop.fs.RemoteIterator<Path> |
FilterFileSystem.listCorruptFileBlocks(Path path)
|
org.apache.hadoop.fs.RemoteIterator<Path> |
FileContext.listCorruptFileBlocks(Path path)
|
org.apache.hadoop.fs.RemoteIterator<Path> |
AbstractFileSystem.listCorruptFileBlocks(Path path)
|
org.apache.hadoop.fs.RemoteIterator<Path> |
FileSystem.listCorruptFileBlocks(Path path)
|
Methods in org.apache.hadoop.fs with parameters of type Path | |
---|---|
boolean |
GlobFilter.accept(Path path)
|
boolean |
PathFilter.accept(Path path)
Tests whether or not the specified abstract pathname should be included in a pathname list. |
FSDataOutputStream |
FileSystem.append(Path f)
Append to an existing file (optional operation). |
FSDataOutputStream |
FileSystem.append(Path f,
int bufferSize)
Append to an existing file (optional operation). |
FSDataOutputStream |
RawLocalFileSystem.append(Path f,
int bufferSize,
Progressable progress)
|
FSDataOutputStream |
FilterFileSystem.append(Path f,
int bufferSize,
Progressable progress)
|
FSDataOutputStream |
ChecksumFileSystem.append(Path f,
int bufferSize,
Progressable progress)
|
abstract FSDataOutputStream |
FileSystem.append(Path f,
int bufferSize,
Progressable progress)
Append to an existing file (optional operation). |
boolean |
FileSystem.cancelDeleteOnExit(Path f)
Cancel the deletion of the path when the FileSystem is closed |
protected void |
FilterFileSystem.checkPath(Path path)
Check that a Path belongs to this FileSystem. |
void |
AbstractFileSystem.checkPath(Path path)
Check that a Path belongs to this FileSystem. |
protected void |
FileSystem.checkPath(Path path)
Check that a Path belongs to this FileSystem. |
void |
RawLocalFileSystem.completeLocalOutput(Path fsWorkingFile,
Path tmpLocalFile)
|
void |
FilterFileSystem.completeLocalOutput(Path fsOutputFile,
Path tmpLocalFile)
Called when we're all done writing to the target. |
void |
ChecksumFileSystem.completeLocalOutput(Path fsOutputFile,
Path tmpLocalFile)
|
void |
FileSystem.completeLocalOutput(Path fsOutputFile,
Path tmpLocalFile)
Called when we're all done writing to the target. |
void |
FilterFileSystem.concat(Path f,
Path[] psrcs)
|
void |
FilterFileSystem.concat(Path f,
Path[] psrcs)
|
void |
FileSystem.concat(Path trg,
Path[] psrcs)
Concat existing files together. |
void |
FileSystem.concat(Path trg,
Path[] psrcs)
Concat existing files together. |
static boolean |
FileUtil.copy(File src,
FileSystem dstFS,
Path dst,
boolean deleteSource,
Configuration conf)
Copy local files to a FileSystem. |
static boolean |
FileUtil.copy(FileSystem srcFS,
FileStatus srcStatus,
FileSystem dstFS,
Path dst,
boolean deleteSource,
boolean overwrite,
Configuration conf)
Copy files between FileSystems. |
static boolean |
FileUtil.copy(FileSystem srcFS,
Path[] srcs,
FileSystem dstFS,
Path dst,
boolean deleteSource,
boolean overwrite,
Configuration conf)
|
static boolean |
FileUtil.copy(FileSystem srcFS,
Path[] srcs,
FileSystem dstFS,
Path dst,
boolean deleteSource,
boolean overwrite,
Configuration conf)
|
static boolean |
FileUtil.copy(FileSystem srcFS,
Path src,
File dst,
boolean deleteSource,
Configuration conf)
Copy FileSystem files to local files. |
static boolean |
FileUtil.copy(FileSystem srcFS,
Path src,
FileSystem dstFS,
Path dst,
boolean deleteSource,
boolean overwrite,
Configuration conf)
Copy files between FileSystems. |
static boolean |
FileUtil.copy(FileSystem srcFS,
Path src,
FileSystem dstFS,
Path dst,
boolean deleteSource,
Configuration conf)
Copy files between FileSystems. |
void |
FilterFileSystem.copyFromLocalFile(boolean delSrc,
boolean overwrite,
Path[] srcs,
Path dst)
The src files are on the local disk. |
void |
FilterFileSystem.copyFromLocalFile(boolean delSrc,
boolean overwrite,
Path[] srcs,
Path dst)
The src files are on the local disk. |
void |
FileSystem.copyFromLocalFile(boolean delSrc,
boolean overwrite,
Path[] srcs,
Path dst)
The src files are on the local disk. |
void |
FileSystem.copyFromLocalFile(boolean delSrc,
boolean overwrite,
Path[] srcs,
Path dst)
The src files are on the local disk. |
void |
FilterFileSystem.copyFromLocalFile(boolean delSrc,
boolean overwrite,
Path src,
Path dst)
The src file is on the local disk. |
void |
FileSystem.copyFromLocalFile(boolean delSrc,
boolean overwrite,
Path src,
Path dst)
The src file is on the local disk. |
void |
FilterFileSystem.copyFromLocalFile(boolean delSrc,
Path src,
Path dst)
The src file is on the local disk. |
void |
ChecksumFileSystem.copyFromLocalFile(boolean delSrc,
Path src,
Path dst)
|
void |
LocalFileSystem.copyFromLocalFile(boolean delSrc,
Path src,
Path dst)
|
void |
FileSystem.copyFromLocalFile(boolean delSrc,
Path src,
Path dst)
The src file is on the local disk. |
void |
FileSystem.copyFromLocalFile(Path src,
Path dst)
The src file is on the local disk. |
static boolean |
FileUtil.copyMerge(FileSystem srcFS,
Path srcDir,
FileSystem dstFS,
Path dstFile,
boolean deleteSource,
Configuration conf,
String addString)
Copy all files in a directory to one output file (merge). |
void |
FilterFileSystem.copyToLocalFile(boolean delSrc,
Path src,
Path dst)
The src file is under FS, and the dst is on the local disk. |
void |
ChecksumFileSystem.copyToLocalFile(boolean delSrc,
Path src,
Path dst)
The src file is under FS, and the dst is on the local disk. |
void |
LocalFileSystem.copyToLocalFile(boolean delSrc,
Path src,
Path dst)
|
void |
FileSystem.copyToLocalFile(boolean delSrc,
Path src,
Path dst)
The src file is under FS, and the dst is on the local disk. |
void |
FileSystem.copyToLocalFile(boolean delSrc,
Path src,
Path dst,
boolean useRawLocalFileSystem)
The src file is under FS, and the dst is on the local disk. |
void |
FileSystem.copyToLocalFile(Path src,
Path dst)
The src file is under FS, and the dst is on the local disk. |
void |
ChecksumFileSystem.copyToLocalFile(Path src,
Path dst,
boolean copyCrc)
The src file is under FS, and the dst is on the local disk. |
static FSDataOutputStream |
FileSystem.create(FileSystem fs,
Path file,
FsPermission permission)
create a file with the provided permission The permission of the file is set to be the provided permission as in setPermission, not permission&~umask It is implemented using two RPCs. |
FSDataOutputStream |
FileSystem.create(Path f)
Create an FSDataOutputStream at the indicated Path. |
FSDataOutputStream |
FileSystem.create(Path f,
boolean overwrite)
Create an FSDataOutputStream at the indicated Path. |
FSDataOutputStream |
FileSystem.create(Path f,
boolean overwrite,
int bufferSize)
Create an FSDataOutputStream at the indicated Path. |
FSDataOutputStream |
FileSystem.create(Path f,
boolean overwrite,
int bufferSize,
Progressable progress)
Create an FSDataOutputStream at the indicated Path with write-progress reporting. |
FSDataOutputStream |
FileSystem.create(Path f,
boolean overwrite,
int bufferSize,
short replication,
long blockSize)
Create an FSDataOutputStream at the indicated Path. |
FSDataOutputStream |
RawLocalFileSystem.create(Path f,
boolean overwrite,
int bufferSize,
short replication,
long blockSize,
Progressable progress)
|
FSDataOutputStream |
FileSystem.create(Path f,
boolean overwrite,
int bufferSize,
short replication,
long blockSize,
Progressable progress)
Create an FSDataOutputStream at the indicated Path with write-progress reporting. |
FSDataOutputStream |
FileContext.create(Path f,
EnumSet<CreateFlag> createFlag,
org.apache.hadoop.fs.Options.CreateOpts... opts)
Create or overwrite file on indicated path and returns an output stream for writing into the file. |
FSDataOutputStream |
AbstractFileSystem.create(Path f,
EnumSet<CreateFlag> createFlag,
org.apache.hadoop.fs.Options.CreateOpts... opts)
The specification of this method matches that of FileContext.create(Path, EnumSet, Options.CreateOpts...) except
that the Path f must be fully qualified and the permission is absolute
(i.e. |
FSDataOutputStream |
RawLocalFileSystem.create(Path f,
FsPermission permission,
boolean overwrite,
int bufferSize,
short replication,
long blockSize,
Progressable progress)
|
FSDataOutputStream |
FilterFileSystem.create(Path f,
FsPermission permission,
boolean overwrite,
int bufferSize,
short replication,
long blockSize,
Progressable progress)
|
FSDataOutputStream |
ChecksumFileSystem.create(Path f,
FsPermission permission,
boolean overwrite,
int bufferSize,
short replication,
long blockSize,
Progressable progress)
|
abstract FSDataOutputStream |
FileSystem.create(Path f,
FsPermission permission,
boolean overwrite,
int bufferSize,
short replication,
long blockSize,
Progressable progress)
Create an FSDataOutputStream at the indicated Path with write-progress reporting. |
FSDataOutputStream |
FileSystem.create(Path f,
FsPermission permission,
EnumSet<CreateFlag> flags,
int bufferSize,
short replication,
long blockSize,
Progressable progress)
Create an FSDataOutputStream at the indicated Path with write-progress reporting. |
FSDataOutputStream |
FileSystem.create(Path f,
FsPermission permission,
EnumSet<CreateFlag> flags,
int bufferSize,
short replication,
long blockSize,
Progressable progress,
org.apache.hadoop.fs.Options.ChecksumOpt checksumOpt)
Create an FSDataOutputStream at the indicated Path with a custom checksum option |
FSDataOutputStream |
FileSystem.create(Path f,
Progressable progress)
Create an FSDataOutputStream at the indicated Path with write-progress reporting. |
FSDataOutputStream |
FileSystem.create(Path f,
short replication)
Create an FSDataOutputStream at the indicated Path. |
FSDataOutputStream |
FileSystem.create(Path f,
short replication,
Progressable progress)
Create an FSDataOutputStream at the indicated Path with write-progress reporting. |
abstract FSDataOutputStream |
AbstractFileSystem.createInternal(Path f,
EnumSet<CreateFlag> flag,
FsPermission absolutePermission,
int bufferSize,
short replication,
long blockSize,
Progressable progress,
org.apache.hadoop.fs.Options.ChecksumOpt checksumOpt,
boolean createParent)
The specification of this method matches that of AbstractFileSystem.create(Path, EnumSet, Options.CreateOpts...) except that the opts
have been declared explicitly. |
static String |
FileUtil.createJarWithClassPath(String inputClassPath,
Path pwd,
Map<String,String> callerEnv)
Create a jar file at the given path, containing a manifest with a classpath that references all specified entries. |
boolean |
FileSystem.createNewFile(Path f)
Creates the given Path as a brand-new zero-length file. |
FSDataOutputStream |
FileSystem.createNonRecursive(Path f,
boolean overwrite,
int bufferSize,
short replication,
long blockSize,
Progressable progress)
Deprecated. API only for 0.20-append |
FSDataOutputStream |
RawLocalFileSystem.createNonRecursive(Path f,
FsPermission permission,
boolean overwrite,
int bufferSize,
short replication,
long blockSize,
Progressable progress)
|
FSDataOutputStream |
ChecksumFileSystem.createNonRecursive(Path f,
FsPermission permission,
boolean overwrite,
int bufferSize,
short replication,
long blockSize,
Progressable progress)
|
FSDataOutputStream |
FileSystem.createNonRecursive(Path f,
FsPermission permission,
boolean overwrite,
int bufferSize,
short replication,
long blockSize,
Progressable progress)
Deprecated. API only for 0.20-append |
FSDataOutputStream |
RawLocalFileSystem.createNonRecursive(Path f,
FsPermission permission,
EnumSet<CreateFlag> flags,
int bufferSize,
short replication,
long blockSize,
Progressable progress)
Deprecated. |
FSDataOutputStream |
FilterFileSystem.createNonRecursive(Path f,
FsPermission permission,
EnumSet<CreateFlag> flags,
int bufferSize,
short replication,
long blockSize,
Progressable progress)
Deprecated. |
FSDataOutputStream |
FileSystem.createNonRecursive(Path f,
FsPermission permission,
EnumSet<CreateFlag> flags,
int bufferSize,
short replication,
long blockSize,
Progressable progress)
Deprecated. API only for 0.20-append |
Path |
FileSystem.createSnapshot(Path path)
Create a snapshot with a default name. |
Path |
FilterFileSystem.createSnapshot(Path path,
String snapshotName)
|
Path |
FileSystem.createSnapshot(Path path,
String snapshotName)
Create a snapshot |
void |
RawLocalFileSystem.createSymlink(Path target,
Path link,
boolean createParent)
|
void |
FilterFileSystem.createSymlink(Path target,
Path link,
boolean createParent)
|
void |
FileContext.createSymlink(Path target,
Path link,
boolean createParent)
Creates a symbolic link to an existing file. |
void |
AbstractFileSystem.createSymlink(Path target,
Path link,
boolean createParent)
The specification of this method matches that of FileContext.createSymlink(Path, Path, boolean) ; |
void |
LocalFileSystem.createSymlink(Path target,
Path link,
boolean createParent)
|
void |
FileSystem.createSymlink(Path target,
Path link,
boolean createParent)
See FileContext.createSymlink(Path, Path, boolean) |
boolean |
FileSystem.delete(Path f)
Deprecated. Use FileSystem.delete(Path, boolean) instead. |
boolean |
RawLocalFileSystem.delete(Path p,
boolean recursive)
Delete the given path to a file or directory. |
boolean |
FilterFileSystem.delete(Path f,
boolean recursive)
Delete a file |
boolean |
FileContext.delete(Path f,
boolean recursive)
Delete a file. |
boolean |
ChecksumFileSystem.delete(Path f,
boolean recursive)
Implement the delete(Path, boolean) in checksum file system. |
abstract boolean |
AbstractFileSystem.delete(Path f,
boolean recursive)
The specification of this method matches that of FileContext.delete(Path, boolean) except that Path f must be for
this file system. |
abstract boolean |
FileSystem.delete(Path f,
boolean recursive)
Delete a file. |
boolean |
FileContext.deleteOnExit(Path f)
Mark a path to be deleted on JVM shutdown. |
boolean |
FileSystem.deleteOnExit(Path f)
Mark a path to be deleted when FileSystem is closed. |
void |
FilterFileSystem.deleteSnapshot(Path path,
String snapshotName)
|
void |
FileSystem.deleteSnapshot(Path path,
String snapshotName)
Delete a snapshot of a directory |
boolean |
FileSystem.exists(Path f)
Check if exists. |
protected Path |
FileSystem.fixRelativePart(Path p)
See FileContext.fixRelativePart(org.apache.hadoop.fs.Path) |
static void |
FileUtil.fullyDelete(FileSystem fs,
Path dir)
Deprecated. Use FileSystem.delete(Path, boolean) |
AclStatus |
FilterFileSystem.getAclStatus(Path path)
|
AclStatus |
FileContext.getAclStatus(Path path)
Gets the ACLs of files and directories. |
AclStatus |
AbstractFileSystem.getAclStatus(Path path)
Gets the ACLs of files and directories. |
AclStatus |
FileSystem.getAclStatus(Path path)
Gets the ACL of a file or directory. |
long |
FileSystem.getBlockSize(Path f)
Deprecated. Use getFileStatus() instead |
Path |
ChecksumFileSystem.getChecksumFile(Path file)
Return the name of the checksum file associated with a file. |
long |
ChecksumFileSystem.getChecksumFileLength(Path file,
long fileSize)
Return the length of the checksum file given the size of the actual file. |
ContentSummary |
FileSystem.getContentSummary(Path f)
Return the ContentSummary of a given Path . |
long |
FilterFileSystem.getDefaultBlockSize(Path f)
|
long |
FileSystem.getDefaultBlockSize(Path f)
Return the number of bytes that large input files should be optimally be split into to minimize i/o time. |
short |
FilterFileSystem.getDefaultReplication(Path f)
|
short |
FileSystem.getDefaultReplication(Path path)
Get the default replication for a path. |
List<org.apache.hadoop.security.token.Token<?>> |
FileContext.getDelegationTokens(Path p,
String renewer)
Get delegation tokens for the file systems accessed for a given path. |
BlockLocation[] |
FileContext.getFileBlockLocations(Path f,
long start,
long len)
Return blockLocation of the given file for the given offset and len. |
abstract BlockLocation[] |
AbstractFileSystem.getFileBlockLocations(Path f,
long start,
long len)
The specification of this method matches that of FileContext.getFileBlockLocations(Path, long, long) except that
Path f must be for this file system. |
BlockLocation[] |
FileSystem.getFileBlockLocations(Path p,
long start,
long len)
Return an array containing hostnames, offset and size of portions of the given file. |
FileChecksum |
FilterFileSystem.getFileChecksum(Path f)
|
FileChecksum |
FileContext.getFileChecksum(Path f)
Get the checksum of a file. |
abstract FileChecksum |
AbstractFileSystem.getFileChecksum(Path f)
The specification of this method matches that of FileContext.getFileChecksum(Path) except that Path f must be for
this file system. |
FileChecksum |
FileSystem.getFileChecksum(Path f)
Get the checksum of a file. |
FileChecksum |
FilterFileSystem.getFileChecksum(Path f,
long length)
|
FileChecksum |
FileSystem.getFileChecksum(Path f,
long length)
Get the checksum of a file, from the beginning of the file till the specific length. |
FileStatus |
RawLocalFileSystem.getFileLinkStatus(Path f)
Return a FileStatus representing the given path. |
FileStatus |
FilterFileSystem.getFileLinkStatus(Path f)
|
FileStatus |
FileContext.getFileLinkStatus(Path f)
Return a file status object that represents the path. |
FileStatus |
AbstractFileSystem.getFileLinkStatus(Path f)
The specification of this method matches that of FileContext.getFileLinkStatus(Path)
except that an UnresolvedLinkException may be thrown if a symlink is
encountered in the path leading up to the final path component. |
FileStatus |
LocalFileSystem.getFileLinkStatus(Path f)
|
FileStatus |
FileSystem.getFileLinkStatus(Path f)
See FileContext.getFileLinkStatus(Path) |
FileStatus |
RawLocalFileSystem.getFileStatus(Path f)
|
FileStatus |
FilterFileSystem.getFileStatus(Path f)
Get file status. |
FileStatus |
FileContext.getFileStatus(Path f)
Return a file status object that represents the path. |
abstract FileStatus |
AbstractFileSystem.getFileStatus(Path f)
The specification of this method matches that of FileContext.getFileStatus(Path)
except that an UnresolvedLinkException may be thrown if a symlink is
encountered in the path. |
abstract FileStatus |
FileSystem.getFileStatus(Path f)
Return a file status object that represents the path. |
protected AbstractFileSystem |
FileContext.getFSofPath(Path absOrFqPath)
Get the file system of supplied path. |
protected static FileSystem |
FileSystem.getFSofPath(Path absOrFqPath,
Configuration conf)
|
FsStatus |
FileContext.getFsStatus(Path f)
Returns a status object describing the use and capacity of the file system denoted by the Parh argument p. |
FsStatus |
AbstractFileSystem.getFsStatus(Path f)
The specification of this method matches that of FileContext.getFsStatus(Path) except that Path f must be for this
file system. |
static TrashPolicy |
TrashPolicy.getInstance(Configuration conf,
FileSystem fs,
Path home)
Get an instance of the configured TrashPolicy based on the value of the configuration parameter fs.trash.classname. |
long |
FileSystem.getLength(Path f)
Deprecated. Use getFileStatus() instead |
Path |
RawLocalFileSystem.getLinkTarget(Path f)
|
Path |
FilterFileSystem.getLinkTarget(Path f)
|
Path |
FileContext.getLinkTarget(Path f)
Returns the target of the given symbolic link as it was specified when the link was created. |
Path |
AbstractFileSystem.getLinkTarget(Path f)
Partially resolves the path. |
Path |
LocalFileSystem.getLinkTarget(Path f)
|
Path |
FileSystem.getLinkTarget(Path f)
See FileContext.getLinkTarget(Path) |
static Path |
Path.getPathWithoutSchemeAndAuthority(Path path)
|
short |
FileSystem.getReplication(Path src)
Deprecated. Use getFileStatus() instead |
FsServerDefaults |
FilterFileSystem.getServerDefaults(Path f)
|
FsServerDefaults |
FileSystem.getServerDefaults(Path p)
Return a set of server default configuration values |
FsStatus |
RawLocalFileSystem.getStatus(Path p)
|
FsStatus |
FilterFileSystem.getStatus(Path p)
|
FsStatus |
FileSystem.getStatus(Path p)
Returns a status object describing the use and capacity of the file system. |
String |
AbstractFileSystem.getUriPath(Path p)
Get the path-part of a pathname. |
byte[] |
FilterFileSystem.getXAttr(Path path,
String name)
|
byte[] |
FileContext.getXAttr(Path path,
String name)
Get an xattr for a file or directory. |
byte[] |
AbstractFileSystem.getXAttr(Path path,
String name)
Get an xattr for a file or directory. |
byte[] |
FileSystem.getXAttr(Path path,
String name)
Get an xattr name and value for a file or directory. |
Map<String,byte[]> |
FilterFileSystem.getXAttrs(Path path)
|
Map<String,byte[]> |
FileContext.getXAttrs(Path path)
Get all of the xattrs for a file or directory. |
Map<String,byte[]> |
AbstractFileSystem.getXAttrs(Path path)
Get all of the xattrs for a file or directory. |
Map<String,byte[]> |
FileSystem.getXAttrs(Path path)
Get all of the xattr name/value pairs for a file or directory. |
Map<String,byte[]> |
FilterFileSystem.getXAttrs(Path path,
List<String> names)
|
Map<String,byte[]> |
FileContext.getXAttrs(Path path,
List<String> names)
Get all of the xattrs for a file or directory. |
Map<String,byte[]> |
AbstractFileSystem.getXAttrs(Path path,
List<String> names)
Get all of the xattrs for a file or directory. |
Map<String,byte[]> |
FileSystem.getXAttrs(Path path,
List<String> names)
Get all of the xattrs name/value pairs for a file or directory. |
FileStatus[] |
FileSystem.globStatus(Path pathPattern)
Return all the files that match filePattern and are not checksum files. |
FileStatus[] |
FileSystem.globStatus(Path pathPattern,
PathFilter filter)
Return an array of FileStatus objects whose path names match pathPattern and is accepted by the user-supplied path filter. |
abstract void |
TrashPolicy.initialize(Configuration conf,
FileSystem fs,
Path home)
Used to setup the trash policy. |
static boolean |
ChecksumFileSystem.isChecksumFile(Path file)
Return true iff file is a checksum file name. |
boolean |
FileSystem.isDirectory(Path f)
True iff the named path is a directory. |
boolean |
FileSystem.isFile(Path f)
True iff the named path is a regular file. |
org.apache.hadoop.fs.RemoteIterator<Path> |
FilterFileSystem.listCorruptFileBlocks(Path path)
|
org.apache.hadoop.fs.RemoteIterator<Path> |
FileContext.listCorruptFileBlocks(Path path)
|
org.apache.hadoop.fs.RemoteIterator<Path> |
AbstractFileSystem.listCorruptFileBlocks(Path path)
|
org.apache.hadoop.fs.RemoteIterator<Path> |
FileSystem.listCorruptFileBlocks(Path path)
|
org.apache.hadoop.fs.RemoteIterator<LocatedFileStatus> |
FileSystem.listFiles(Path f,
boolean recursive)
List the statuses and block locations of the files in the given path. |
org.apache.hadoop.fs.RemoteIterator<LocatedFileStatus> |
FilterFileSystem.listLocatedStatus(Path f)
List files and its block locations in a directory. |
org.apache.hadoop.fs.RemoteIterator<LocatedFileStatus> |
FileContext.listLocatedStatus(Path f)
List the statuses of the files/directories in the given path if the path is a directory. |
org.apache.hadoop.fs.RemoteIterator<LocatedFileStatus> |
ChecksumFileSystem.listLocatedStatus(Path f)
List the statuses of the files/directories in the given path if the path is a directory. |
org.apache.hadoop.fs.RemoteIterator<LocatedFileStatus> |
AbstractFileSystem.listLocatedStatus(Path f)
The specification of this method matches that of FileContext.listLocatedStatus(Path) except that Path f
must be for this file system. |
org.apache.hadoop.fs.RemoteIterator<LocatedFileStatus> |
FileSystem.listLocatedStatus(Path f)
List the statuses of the files/directories in the given path if the path is a directory. |
protected org.apache.hadoop.fs.RemoteIterator<LocatedFileStatus> |
FileSystem.listLocatedStatus(Path f,
PathFilter filter)
Listing a directory The returned results include its block location if it is a file The results are filtered by the given path filter |
FileStatus[] |
RawLocalFileSystem.listStatus(Path f)
|
FileStatus[] |
FilterFileSystem.listStatus(Path f)
List files in a directory. |
org.apache.hadoop.fs.RemoteIterator<FileStatus> |
FileContext.listStatus(Path f)
List the statuses of the files/directories in the given path if the path is a directory. |
FileStatus[] |
ChecksumFileSystem.listStatus(Path f)
List the statuses of the files/directories in the given path if the path is a directory. |
abstract FileStatus[] |
AbstractFileSystem.listStatus(Path f)
The specification of this method matches that of FileContext.Util.listStatus(Path) except that Path f must be
for this file system. |
abstract FileStatus[] |
FileSystem.listStatus(Path f)
List the statuses of the files/directories in the given path if the path is a directory. |
FileStatus[] |
FileSystem.listStatus(Path[] files)
Filter files/directories in the given list of paths using default path filter. |
FileStatus[] |
FileSystem.listStatus(Path[] files,
PathFilter filter)
Filter files/directories in the given list of paths using user-supplied path filter. |
FileStatus[] |
FileSystem.listStatus(Path f,
PathFilter filter)
Filter files/directories in the given path using the user-supplied path filter. |
org.apache.hadoop.fs.RemoteIterator<FileStatus> |
AbstractFileSystem.listStatusIterator(Path f)
The specification of this method matches that of FileContext.listStatus(Path) except that Path f must be for this
file system. |
List<String> |
FilterFileSystem.listXAttrs(Path path)
|
List<String> |
AbstractFileSystem.listXAttrs(Path path)
Get all of the xattr names for a file or directory. |
List<String> |
FileSystem.listXAttrs(Path path)
Get all of the xattr names for a file or directory. |
Path |
FilterFileSystem.makeQualified(Path path)
Make sure that a path specifies a FileSystem. |
Path |
FileContext.makeQualified(Path path)
Make the path fully qualified if it is isn't. |
Path |
AbstractFileSystem.makeQualified(Path path)
Make the path fully qualified to this file system |
Path |
FileSystem.makeQualified(Path path)
Make sure that a path specifies a FileSystem. |
Path |
Path.makeQualified(URI defaultUri,
Path workingDir)
Returns a qualified path object. |
static Path |
Path.mergePaths(Path path1,
Path path2)
Merge 2 paths such that the second path is appended relative to the first. |
void |
FileContext.mkdir(Path dir,
FsPermission permission,
boolean createParent)
Make(create) a directory and all the non-existent parents. |
abstract void |
AbstractFileSystem.mkdir(Path dir,
FsPermission permission,
boolean createParent)
The specification of this method matches that of FileContext.mkdir(Path, FsPermission, boolean) except that the Path
f must be fully qualified and the permission is absolute (i.e. |
static boolean |
FileSystem.mkdirs(FileSystem fs,
Path dir,
FsPermission permission)
create a directory with the provided permission The permission of the directory is set to be the provided permission as in setPermission, not permission&~umask |
boolean |
RawLocalFileSystem.mkdirs(Path f)
Creates the specified directory hierarchy. |
boolean |
ChecksumFileSystem.mkdirs(Path f)
|
boolean |
FileSystem.mkdirs(Path f)
Call FileSystem.mkdirs(Path, FsPermission) with default permission. |
boolean |
RawLocalFileSystem.mkdirs(Path f,
FsPermission permission)
|
boolean |
FilterFileSystem.mkdirs(Path f,
FsPermission permission)
|
abstract boolean |
FileSystem.mkdirs(Path f,
FsPermission permission)
Make the given file and all non-existent parents into directories. |
void |
FilterFileSystem.modifyAclEntries(Path path,
List<AclEntry> aclSpec)
|
void |
FileContext.modifyAclEntries(Path path,
List<AclEntry> aclSpec)
Modifies ACL entries of files and directories. |
void |
AbstractFileSystem.modifyAclEntries(Path path,
List<AclEntry> aclSpec)
Modifies ACL entries of files and directories. |
void |
FileSystem.modifyAclEntries(Path path,
List<AclEntry> aclSpec)
Modifies ACL entries of files and directories. |
void |
FileSystem.moveFromLocalFile(Path[] srcs,
Path dst)
The src files is on the local disk. |
void |
FileSystem.moveFromLocalFile(Path[] srcs,
Path dst)
The src files is on the local disk. |
void |
RawLocalFileSystem.moveFromLocalFile(Path src,
Path dst)
|
void |
FileSystem.moveFromLocalFile(Path src,
Path dst)
The src file is on the local disk. |
static boolean |
Trash.moveToAppropriateTrash(FileSystem fs,
Path p,
Configuration conf)
In case of the symlinks or mount points, one has to move the appropriate trashbin in the actual volume of the path p being deleted. |
void |
FileSystem.moveToLocalFile(Path src,
Path dst)
The src file is under FS, and the dst is on the local disk. |
boolean |
Trash.moveToTrash(Path path)
Move a file or directory to the current trash directory. |
abstract boolean |
TrashPolicy.moveToTrash(Path path)
Move a file or directory to the current trash directory. |
FSDataInputStream |
FileContext.open(Path f)
Opens an FSDataInputStream at the indicated Path using default buffersize. |
FSDataInputStream |
AbstractFileSystem.open(Path f)
The specification of this method matches that of FileContext.open(Path) except that Path f must be for this
file system. |
FSDataInputStream |
FileSystem.open(Path f)
Opens an FSDataInputStream at the indicated Path. |
FSDataInputStream |
RawLocalFileSystem.open(Path f,
int bufferSize)
|
FSDataInputStream |
FilterFileSystem.open(Path f,
int bufferSize)
Opens an FSDataInputStream at the indicated Path. |
FSDataInputStream |
FileContext.open(Path f,
int bufferSize)
Opens an FSDataInputStream at the indicated Path. |
FSDataInputStream |
ChecksumFileSystem.open(Path f,
int bufferSize)
Opens an FSDataInputStream at the indicated Path. |
abstract FSDataInputStream |
AbstractFileSystem.open(Path f,
int bufferSize)
The specification of this method matches that of FileContext.open(Path, int) except that Path f must be for this
file system. |
abstract FSDataInputStream |
FileSystem.open(Path f,
int bufferSize)
Opens an FSDataInputStream at the indicated Path. |
File |
RawLocalFileSystem.pathToFile(Path path)
Convert a path to a File. |
File |
LocalFileSystem.pathToFile(Path path)
Convert a path to a File. |
protected FSDataOutputStream |
FilterFileSystem.primitiveCreate(Path f,
FsPermission absolutePermission,
EnumSet<CreateFlag> flag,
int bufferSize,
short replication,
long blockSize,
Progressable progress,
org.apache.hadoop.fs.Options.ChecksumOpt checksumOpt)
|
protected FSDataOutputStream |
FileSystem.primitiveCreate(Path f,
FsPermission absolutePermission,
EnumSet<CreateFlag> flag,
int bufferSize,
short replication,
long blockSize,
Progressable progress,
org.apache.hadoop.fs.Options.ChecksumOpt checksumOpt)
Deprecated. |
protected boolean |
RawLocalFileSystem.primitiveMkdir(Path f,
FsPermission absolutePermission)
|
protected boolean |
FilterFileSystem.primitiveMkdir(Path f,
FsPermission abdolutePermission)
|
protected boolean |
FileSystem.primitiveMkdir(Path f,
FsPermission absolutePermission)
Deprecated. |
protected void |
FileSystem.primitiveMkdir(Path f,
FsPermission absolutePermission,
boolean createParent)
Deprecated. |
void |
FilterFileSystem.removeAcl(Path path)
|
void |
FileContext.removeAcl(Path path)
Removes all but the base ACL entries of files and directories. |
void |
AbstractFileSystem.removeAcl(Path path)
Removes all but the base ACL entries of files and directories. |
void |
FileSystem.removeAcl(Path path)
Removes all but the base ACL entries of files and directories. |
void |
FilterFileSystem.removeAclEntries(Path path,
List<AclEntry> aclSpec)
|
void |
FileContext.removeAclEntries(Path path,
List<AclEntry> aclSpec)
Removes ACL entries from files and directories. |
void |
AbstractFileSystem.removeAclEntries(Path path,
List<AclEntry> aclSpec)
Removes ACL entries from files and directories. |
void |
FileSystem.removeAclEntries(Path path,
List<AclEntry> aclSpec)
Removes ACL entries from files and directories. |
void |
FilterFileSystem.removeDefaultAcl(Path path)
|
void |
FileContext.removeDefaultAcl(Path path)
Removes all default ACL entries from files and directories. |
void |
AbstractFileSystem.removeDefaultAcl(Path path)
Removes all default ACL entries from files and directories. |
void |
FileSystem.removeDefaultAcl(Path path)
Removes all default ACL entries from files and directories. |
void |
FilterFileSystem.removeXAttr(Path path,
String name)
|
void |
FileContext.removeXAttr(Path path,
String name)
Remove an xattr of a file or directory. |
void |
AbstractFileSystem.removeXAttr(Path path,
String name)
Remove an xattr of a file or directory. |
void |
FileSystem.removeXAttr(Path path,
String name)
Remove an xattr of a file or directory. |
boolean |
RawLocalFileSystem.rename(Path src,
Path dst)
|
boolean |
FilterFileSystem.rename(Path src,
Path dst)
Renames Path src to Path dst. |
boolean |
ChecksumFileSystem.rename(Path src,
Path dst)
Rename files/dirs |
abstract boolean |
FileSystem.rename(Path src,
Path dst)
Renames Path src to Path dst. |
void |
FileContext.rename(Path src,
Path dst,
org.apache.hadoop.fs.Options.Rename... options)
Renames Path src to Path dst |
void |
AbstractFileSystem.rename(Path src,
Path dst,
org.apache.hadoop.fs.Options.Rename... options)
The specification of this method matches that of FileContext.rename(Path, Path, Options.Rename...) except that Path
f must be for this file system. |
protected void |
FileSystem.rename(Path src,
Path dst,
org.apache.hadoop.fs.Options.Rename... options)
Deprecated. |
abstract void |
AbstractFileSystem.renameInternal(Path src,
Path dst)
The specification of this method matches that of FileContext.rename(Path, Path, Options.Rename...) except that Path
f must be for this file system and NO OVERWRITE is performed. |
void |
AbstractFileSystem.renameInternal(Path src,
Path dst,
boolean overwrite)
The specification of this method matches that of FileContext.rename(Path, Path, Options.Rename...) except that Path
f must be for this file system. |
void |
FilterFileSystem.renameSnapshot(Path path,
String snapshotOldName,
String snapshotNewName)
|
void |
FileSystem.renameSnapshot(Path path,
String snapshotOldName,
String snapshotNewName)
Rename a snapshot |
boolean |
ChecksumFileSystem.reportChecksumFailure(Path f,
FSDataInputStream in,
long inPos,
FSDataInputStream sums,
long sumsPos)
Report a checksum error to the file system. |
boolean |
LocalFileSystem.reportChecksumFailure(Path p,
FSDataInputStream in,
long inPos,
FSDataInputStream sums,
long sumsPos)
Moves files to a bad file directory on the same device, so that their storage will not be reused. |
protected Path |
FileContext.resolve(Path f)
Resolves all symbolic links in the specified path. |
protected Path |
FileContext.resolveIntermediate(Path f)
Resolves all symbolic links in the specified path leading up to, but not including the final path component. |
protected Path |
FilterFileSystem.resolveLink(Path f)
|
protected Path |
FileSystem.resolveLink(Path f)
See AbstractFileSystem.getLinkTarget(Path) |
Path |
FilterFileSystem.resolvePath(Path p)
|
Path |
FileContext.resolvePath(Path f)
Resolve the path following any symlinks or mount points |
Path |
AbstractFileSystem.resolvePath(Path p)
Return the fully-qualified path of path f resolving the path through any internal symlinks or mount point |
Path |
FileSystem.resolvePath(Path p)
Return the fully-qualified path of path f resolving the path through any symlinks or mount point |
void |
FilterFileSystem.setAcl(Path path,
List<AclEntry> aclSpec)
|
void |
FileContext.setAcl(Path path,
List<AclEntry> aclSpec)
Fully replaces ACL of files and directories, discarding all existing entries. |
void |
AbstractFileSystem.setAcl(Path path,
List<AclEntry> aclSpec)
Fully replaces ACL of files and directories, discarding all existing entries. |
void |
FileSystem.setAcl(Path path,
List<AclEntry> aclSpec)
Fully replaces ACL of files and directories, discarding all existing entries. |
void |
RawLocalFileSystem.setOwner(Path p,
String username,
String groupname)
Use the command chown to set owner. |
void |
FilterFileSystem.setOwner(Path p,
String username,
String groupname)
|
void |
FileContext.setOwner(Path f,
String username,
String groupname)
Set owner of a path (i.e. |
abstract void |
AbstractFileSystem.setOwner(Path f,
String username,
String groupname)
The specification of this method matches that of FileContext.setOwner(Path, String, String) except that Path f must
be for this file system. |
void |
FileSystem.setOwner(Path p,
String username,
String groupname)
Set owner of a path (i.e. |
void |
FileStatus.setPath(Path p)
|
void |
RawLocalFileSystem.setPermission(Path p,
FsPermission permission)
Use the command chmod to set permission. |
void |
FilterFileSystem.setPermission(Path p,
FsPermission permission)
|
void |
FileContext.setPermission(Path f,
FsPermission permission)
Set permission of a path. |
abstract void |
AbstractFileSystem.setPermission(Path f,
FsPermission permission)
The specification of this method matches that of FileContext.setPermission(Path, FsPermission) except that Path f
must be for this file system. |
void |
FileSystem.setPermission(Path p,
FsPermission permission)
Set permission of a path. |
boolean |
FilterFileSystem.setReplication(Path src,
short replication)
Set replication for an existing file. |
boolean |
FileContext.setReplication(Path f,
short replication)
Set replication for an existing file. |
boolean |
ChecksumFileSystem.setReplication(Path src,
short replication)
Set replication for an existing file. |
abstract boolean |
AbstractFileSystem.setReplication(Path f,
short replication)
The specification of this method matches that of FileContext.setReplication(Path, short) except that Path f must be
for this file system. |
boolean |
FileSystem.setReplication(Path src,
short replication)
Set replication for an existing file. |
void |
FileStatus.setSymlink(Path p)
|
void |
RawLocalFileSystem.setTimes(Path p,
long mtime,
long atime)
Sets the Path 's last modified time only to the given
valid time. |
void |
FilterFileSystem.setTimes(Path p,
long mtime,
long atime)
|
void |
FileContext.setTimes(Path f,
long mtime,
long atime)
Set access time of a file. |
abstract void |
AbstractFileSystem.setTimes(Path f,
long mtime,
long atime)
The specification of this method matches that of FileContext.setTimes(Path, long, long) except that Path f must be
for this file system. |
void |
FileSystem.setTimes(Path p,
long mtime,
long atime)
Set access time of a file |
void |
FileContext.setVerifyChecksum(boolean verifyChecksum,
Path f)
Set the verify checksum flag for the file system denoted by the path. |
void |
RawLocalFileSystem.setWorkingDirectory(Path newDir)
Set the working directory to the given directory. |
void |
FilterFileSystem.setWorkingDirectory(Path newDir)
Set the current working directory for the given file system. |
void |
FileContext.setWorkingDirectory(Path newWDir)
Set the working directory for wd-relative names (such a "foo/bar"). |
abstract void |
FileSystem.setWorkingDirectory(Path new_dir)
Set the current working directory for the given file system. |
void |
FilterFileSystem.setXAttr(Path path,
String name,
byte[] value)
|
void |
FileContext.setXAttr(Path path,
String name,
byte[] value)
Set an xattr of a file or directory. |
void |
AbstractFileSystem.setXAttr(Path path,
String name,
byte[] value)
Set an xattr of a file or directory. |
void |
FileSystem.setXAttr(Path path,
String name,
byte[] value)
Set an xattr of a file or directory. |
void |
FilterFileSystem.setXAttr(Path path,
String name,
byte[] value,
EnumSet<XAttrSetFlag> flag)
|
void |
FileContext.setXAttr(Path path,
String name,
byte[] value,
EnumSet<XAttrSetFlag> flag)
Set an xattr of a file or directory. |
void |
AbstractFileSystem.setXAttr(Path path,
String name,
byte[] value,
EnumSet<XAttrSetFlag> flag)
Set an xattr of a file or directory. |
void |
FileSystem.setXAttr(Path path,
String name,
byte[] value,
EnumSet<XAttrSetFlag> flag)
Set an xattr of a file or directory. |
Path |
RawLocalFileSystem.startLocalOutput(Path fsOutputFile,
Path tmpLocalFile)
|
Path |
FilterFileSystem.startLocalOutput(Path fsOutputFile,
Path tmpLocalFile)
Returns a local File that the user can write output to. |
Path |
ChecksumFileSystem.startLocalOutput(Path fsOutputFile,
Path tmpLocalFile)
|
Path |
FileSystem.startLocalOutput(Path fsOutputFile,
Path tmpLocalFile)
Returns a local File that the user can write output to. |
static Path[] |
FileUtil.stat2Paths(FileStatus[] stats,
Path path)
convert an array of FileStatus to an array of Path. |
Constructors in org.apache.hadoop.fs with parameters of type Path | |
---|---|
AvroFSInput(FileContext fc,
Path p)
Construct given a FileContext and a Path . |
|
FileStatus(long length,
boolean isdir,
int block_replication,
long blocksize,
long modification_time,
long access_time,
FsPermission permission,
String owner,
String group,
Path path)
Constructor for file systems on which symbolic links are not supported |
|
FileStatus(long length,
boolean isdir,
int block_replication,
long blocksize,
long modification_time,
long access_time,
FsPermission permission,
String owner,
String group,
Path symlink,
Path path)
|
|
FileStatus(long length,
boolean isdir,
int block_replication,
long blocksize,
long modification_time,
Path path)
|
|
LocatedFileStatus(long length,
boolean isdir,
int block_replication,
long blocksize,
long modification_time,
long access_time,
FsPermission permission,
String owner,
String group,
Path symlink,
Path path,
BlockLocation[] locations)
Constructor |
|
Path(Path parent,
Path child)
Resolve a child path against a parent path. |
|
Path(Path parent,
String child)
Resolve a child path against a parent path. |
|
Path(String parent,
Path child)
Resolve a child path against a parent path. |
Uses of Path in org.apache.hadoop.fs.ftp |
---|
Methods in org.apache.hadoop.fs.ftp that return Path | |
---|---|
Path |
FTPFileSystem.getHomeDirectory()
|
Path |
FTPFileSystem.getWorkingDirectory()
|
Methods in org.apache.hadoop.fs.ftp with parameters of type Path | |
---|---|
FSDataOutputStream |
FTPFileSystem.append(Path f,
int bufferSize,
Progressable progress)
This optional operation is not yet supported. |
FSDataOutputStream |
FTPFileSystem.create(Path file,
FsPermission permission,
boolean overwrite,
int bufferSize,
short replication,
long blockSize,
Progressable progress)
A stream obtained via this call must be closed before using other APIs of this class or else the invocation will block. |
boolean |
FTPFileSystem.delete(Path file,
boolean recursive)
|
FileStatus |
FTPFileSystem.getFileStatus(Path file)
|
FileStatus[] |
FTPFileSystem.listStatus(Path file)
|
boolean |
FTPFileSystem.mkdirs(Path file,
FsPermission permission)
|
FSDataInputStream |
FTPFileSystem.open(Path file,
int bufferSize)
|
boolean |
FTPFileSystem.rename(Path src,
Path dst)
|
void |
FTPFileSystem.setWorkingDirectory(Path newDir)
|
Uses of Path in org.apache.hadoop.fs.s3 |
---|
Methods in org.apache.hadoop.fs.s3 that return Path | |
---|---|
Path |
S3FileSystem.getWorkingDirectory()
|
Methods in org.apache.hadoop.fs.s3 with parameters of type Path | |
---|---|
FSDataOutputStream |
S3FileSystem.append(Path f,
int bufferSize,
Progressable progress)
This optional operation is not yet supported. |
FSDataOutputStream |
S3FileSystem.create(Path file,
FsPermission permission,
boolean overwrite,
int bufferSize,
short replication,
long blockSize,
Progressable progress)
|
boolean |
S3FileSystem.delete(Path path,
boolean recursive)
|
FileStatus |
S3FileSystem.getFileStatus(Path f)
FileStatus for S3 file systems. |
boolean |
S3FileSystem.isFile(Path path)
|
FileStatus[] |
S3FileSystem.listStatus(Path f)
|
boolean |
S3FileSystem.mkdirs(Path path,
FsPermission permission)
|
FSDataInputStream |
S3FileSystem.open(Path path,
int bufferSize)
|
boolean |
S3FileSystem.rename(Path src,
Path dst)
|
void |
S3FileSystem.setWorkingDirectory(Path dir)
|
Uses of Path in org.apache.hadoop.fs.s3native |
---|
Methods in org.apache.hadoop.fs.s3native that return Path | |
---|---|
Path |
NativeS3FileSystem.getWorkingDirectory()
|
Methods in org.apache.hadoop.fs.s3native with parameters of type Path | |
---|---|
FSDataOutputStream |
NativeS3FileSystem.append(Path f,
int bufferSize,
Progressable progress)
This optional operation is not yet supported. |
FSDataOutputStream |
NativeS3FileSystem.create(Path f,
FsPermission permission,
boolean overwrite,
int bufferSize,
short replication,
long blockSize,
Progressable progress)
|
boolean |
NativeS3FileSystem.delete(Path f,
boolean recurse)
|
FileStatus |
NativeS3FileSystem.getFileStatus(Path f)
|
FileStatus[] |
NativeS3FileSystem.listStatus(Path f)
If f is a file, this method will make a single call to S3. |
boolean |
NativeS3FileSystem.mkdirs(Path f,
FsPermission permission)
|
FSDataInputStream |
NativeS3FileSystem.open(Path f,
int bufferSize)
|
boolean |
NativeS3FileSystem.rename(Path src,
Path dst)
|
void |
NativeS3FileSystem.setWorkingDirectory(Path newDir)
Set the working directory to the given directory. |
Uses of Path in org.apache.hadoop.fs.viewfs |
---|
Methods in org.apache.hadoop.fs.viewfs that return Path | |
---|---|
Path |
ViewFileSystem.getHomeDirectory()
|
Path |
ViewFs.getHomeDirectory()
|
Path |
ViewFs.getLinkTarget(Path f)
|
Path |
ViewFileSystem.getTrashCanLocation(Path f)
|
Path |
ViewFileSystem.getWorkingDirectory()
|
Path |
ViewFileSystem.resolvePath(Path f)
|
Path |
ViewFs.resolvePath(Path f)
|
Methods in org.apache.hadoop.fs.viewfs with parameters of type Path | |
---|---|
FSDataOutputStream |
ViewFileSystem.append(Path f,
int bufferSize,
Progressable progress)
|
FSDataOutputStream |
ViewFileSystem.create(Path f,
FsPermission permission,
boolean overwrite,
int bufferSize,
short replication,
long blockSize,
Progressable progress)
|
FSDataOutputStream |
ViewFs.createInternal(Path f,
EnumSet<CreateFlag> flag,
FsPermission absolutePermission,
int bufferSize,
short replication,
long blockSize,
Progressable progress,
org.apache.hadoop.fs.Options.ChecksumOpt checksumOpt,
boolean createParent)
|
FSDataOutputStream |
ViewFileSystem.createNonRecursive(Path f,
FsPermission permission,
EnumSet<CreateFlag> flags,
int bufferSize,
short replication,
long blockSize,
Progressable progress)
|
void |
ViewFs.createSymlink(Path target,
Path link,
boolean createParent)
|
boolean |
ViewFileSystem.delete(Path f)
|
boolean |
ViewFileSystem.delete(Path f,
boolean recursive)
|
boolean |
ViewFs.delete(Path f,
boolean recursive)
|
AclStatus |
ViewFileSystem.getAclStatus(Path path)
|
ContentSummary |
ViewFileSystem.getContentSummary(Path f)
|
long |
ViewFileSystem.getDefaultBlockSize(Path f)
|
short |
ViewFileSystem.getDefaultReplication(Path f)
|
BlockLocation[] |
ViewFs.getFileBlockLocations(Path f,
long start,
long len)
|
FileChecksum |
ViewFileSystem.getFileChecksum(Path f)
|
FileChecksum |
ViewFs.getFileChecksum(Path f)
|
FileStatus |
ViewFs.getFileLinkStatus(Path f)
|
FileStatus |
ViewFileSystem.getFileStatus(Path f)
|
FileStatus |
ViewFs.getFileStatus(Path f)
|
Path |
ViewFs.getLinkTarget(Path f)
|
FsServerDefaults |
ViewFileSystem.getServerDefaults(Path f)
|
Path |
ViewFileSystem.getTrashCanLocation(Path f)
|
byte[] |
ViewFileSystem.getXAttr(Path path,
String name)
|
Map<String,byte[]> |
ViewFileSystem.getXAttrs(Path path)
|
Map<String,byte[]> |
ViewFileSystem.getXAttrs(Path path,
List<String> names)
|
FileStatus[] |
ViewFileSystem.listStatus(Path f)
|
FileStatus[] |
ViewFs.listStatus(Path f)
|
org.apache.hadoop.fs.RemoteIterator<FileStatus> |
ViewFs.listStatusIterator(Path f)
|
List<String> |
ViewFileSystem.listXAttrs(Path path)
|
void |
ViewFs.mkdir(Path dir,
FsPermission permission,
boolean createParent)
|
boolean |
ViewFileSystem.mkdirs(Path dir,
FsPermission permission)
|
void |
ViewFileSystem.modifyAclEntries(Path path,
List<AclEntry> aclSpec)
|
FSDataInputStream |
ViewFileSystem.open(Path f,
int bufferSize)
|
FSDataInputStream |
ViewFs.open(Path f,
int bufferSize)
|
void |
ViewFileSystem.removeAcl(Path path)
|
void |
ViewFileSystem.removeAclEntries(Path path,
List<AclEntry> aclSpec)
|
void |
ViewFileSystem.removeDefaultAcl(Path path)
|
void |
ViewFileSystem.removeXAttr(Path path,
String name)
|
boolean |
ViewFileSystem.rename(Path src,
Path dst)
|
void |
ViewFs.renameInternal(Path src,
Path dst)
|
void |
ViewFs.renameInternal(Path src,
Path dst,
boolean overwrite)
|
Path |
ViewFileSystem.resolvePath(Path f)
|
Path |
ViewFs.resolvePath(Path f)
|
void |
ViewFileSystem.setAcl(Path path,
List<AclEntry> aclSpec)
|
void |
ViewFileSystem.setOwner(Path f,
String username,
String groupname)
|
void |
ViewFs.setOwner(Path f,
String username,
String groupname)
|
void |
ViewFileSystem.setPermission(Path f,
FsPermission permission)
|
void |
ViewFs.setPermission(Path f,
FsPermission permission)
|
boolean |
ViewFileSystem.setReplication(Path f,
short replication)
|
boolean |
ViewFs.setReplication(Path f,
short replication)
|
void |
ViewFileSystem.setTimes(Path f,
long mtime,
long atime)
|
void |
ViewFs.setTimes(Path f,
long mtime,
long atime)
|
void |
ViewFileSystem.setWorkingDirectory(Path new_dir)
|
void |
ViewFileSystem.setXAttr(Path path,
String name,
byte[] value,
EnumSet<XAttrSetFlag> flag)
|
Constructors in org.apache.hadoop.fs.viewfs with parameters of type Path | |
---|---|
NotInMountpointException(Path path,
String operation)
|
Uses of Path in org.apache.hadoop.io |
---|
Methods in org.apache.hadoop.io with parameters of type Path | |
---|---|
static org.apache.hadoop.io.SequenceFile.Writer |
SequenceFile.createWriter(FileContext fc,
Configuration conf,
Path name,
Class keyClass,
Class valClass,
org.apache.hadoop.io.SequenceFile.CompressionType compressionType,
CompressionCodec codec,
org.apache.hadoop.io.SequenceFile.Metadata metadata,
EnumSet<CreateFlag> createFlag,
org.apache.hadoop.fs.Options.CreateOpts... opts)
Construct the preferred type of SequenceFile Writer. |
static org.apache.hadoop.io.SequenceFile.Writer |
SequenceFile.createWriter(FileSystem fs,
Configuration conf,
Path name,
Class keyClass,
Class valClass)
Deprecated. Use SequenceFile.createWriter(Configuration, Writer.Option...)
instead. |
static org.apache.hadoop.io.SequenceFile.Writer |
SequenceFile.createWriter(FileSystem fs,
Configuration conf,
Path name,
Class keyClass,
Class valClass,
int bufferSize,
short replication,
long blockSize,
boolean createParent,
org.apache.hadoop.io.SequenceFile.CompressionType compressionType,
CompressionCodec codec,
org.apache.hadoop.io.SequenceFile.Metadata metadata)
Deprecated. |
static org.apache.hadoop.io.SequenceFile.Writer |
SequenceFile.createWriter(FileSystem fs,
Configuration conf,
Path name,
Class keyClass,
Class valClass,
int bufferSize,
short replication,
long blockSize,
org.apache.hadoop.io.SequenceFile.CompressionType compressionType,
CompressionCodec codec,
Progressable progress,
org.apache.hadoop.io.SequenceFile.Metadata metadata)
Deprecated. Use SequenceFile.createWriter(Configuration, Writer.Option...)
instead. |
static org.apache.hadoop.io.SequenceFile.Writer |
SequenceFile.createWriter(FileSystem fs,
Configuration conf,
Path name,
Class keyClass,
Class valClass,
org.apache.hadoop.io.SequenceFile.CompressionType compressionType)
Deprecated. Use SequenceFile.createWriter(Configuration, Writer.Option...)
instead. |
static org.apache.hadoop.io.SequenceFile.Writer |
SequenceFile.createWriter(FileSystem fs,
Configuration conf,
Path name,
Class keyClass,
Class valClass,
org.apache.hadoop.io.SequenceFile.CompressionType compressionType,
CompressionCodec codec)
Deprecated. Use SequenceFile.createWriter(Configuration, Writer.Option...)
instead. |
static org.apache.hadoop.io.SequenceFile.Writer |
SequenceFile.createWriter(FileSystem fs,
Configuration conf,
Path name,
Class keyClass,
Class valClass,
org.apache.hadoop.io.SequenceFile.CompressionType compressionType,
CompressionCodec codec,
Progressable progress)
Deprecated. Use SequenceFile.createWriter(Configuration, Writer.Option...)
instead. |
static org.apache.hadoop.io.SequenceFile.Writer |
SequenceFile.createWriter(FileSystem fs,
Configuration conf,
Path name,
Class keyClass,
Class valClass,
org.apache.hadoop.io.SequenceFile.CompressionType compressionType,
CompressionCodec codec,
Progressable progress,
org.apache.hadoop.io.SequenceFile.Metadata metadata)
Deprecated. Use SequenceFile.createWriter(Configuration, Writer.Option...)
instead. |
static org.apache.hadoop.io.SequenceFile.Writer |
SequenceFile.createWriter(FileSystem fs,
Configuration conf,
Path name,
Class keyClass,
Class valClass,
org.apache.hadoop.io.SequenceFile.CompressionType compressionType,
Progressable progress)
Deprecated. Use SequenceFile.createWriter(Configuration, Writer.Option...)
instead. |
static long |
MapFile.fix(FileSystem fs,
Path dir,
Class<? extends Writable> keyClass,
Class<? extends Writable> valueClass,
boolean dryrun,
Configuration conf)
This method attempts to fix a corrupt MapFile by re-creating its index. |
Uses of Path in org.apache.hadoop.io.compress |
---|
Methods in org.apache.hadoop.io.compress with parameters of type Path | |
---|---|
CompressionCodec |
CompressionCodecFactory.getCodec(Path file)
Find the relevant compression codec for the given file based on its filename suffix. |
Uses of Path in org.apache.hadoop.mapred |
---|
Methods in org.apache.hadoop.mapred that return Path | |
---|---|
static Path[] |
FileInputFormat.getInputPaths(JobConf conf)
Get the list of input Path s for the map-reduce job. |
Path |
JobConf.getLocalPath(String pathString)
Constructs a local file name. |
static Path |
FileOutputFormat.getOutputPath(JobConf conf)
Get the Path to the output directory for the map-reduce job. |
Path |
FileSplit.getPath()
The file containing this split's data. |
static Path |
FileOutputFormat.getPathForCustomFile(JobConf conf,
String name)
Helper function to generate a Path for a file that is unique for
the task within the job output directory. |
static Path |
SkipBadRecords.getSkipOutputPath(Configuration conf)
Get the directory to which skipped records are written. |
Path |
JobClient.getStagingAreaDir()
Fetch the staging area directory for the application |
Path |
JobClient.getSystemDir()
Grab the jobtracker system directory path where job-specific files are to be placed. |
Path |
FileOutputCommitter.getTaskAttemptPath(TaskAttemptContext context)
|
static Path |
FileOutputFormat.getTaskOutputPath(JobConf conf,
String name)
Helper function to create the task's temporary output directory and return the path to the task's output file. |
Path |
JobConf.getWorkingDirectory()
Get the current working directory for the default file system. |
static Path |
FileOutputFormat.getWorkOutputPath(JobConf conf)
Get the Path to the task's temporary output directory
for the map-reduce job
Tasks' Side-Effect Files |
Path |
FileOutputCommitter.getWorkPath(TaskAttemptContext context,
Path outputPath)
|
Methods in org.apache.hadoop.mapred with parameters of type Path | |
---|---|
boolean |
OutputLogFilter.accept(Path path)
|
static void |
FileInputFormat.addInputPath(JobConf conf,
Path path)
Add a Path to the list of inputs for the map-reduce job. |
protected void |
FileInputFormat.addInputPathRecursively(List<FileStatus> result,
FileSystem fs,
Path path,
PathFilter inputFilter)
Add files in the input path recursively into the results. |
static org.apache.hadoop.io.SequenceFile.Reader[] |
SequenceFileOutputFormat.getReaders(Configuration conf,
Path dir)
Open the output generated by this format. |
static org.apache.hadoop.io.MapFile.Reader[] |
MapFileOutputFormat.getReaders(FileSystem ignored,
Path dir,
Configuration conf)
Open the output generated by this format. |
Path |
FileOutputCommitter.getWorkPath(TaskAttemptContext context,
Path outputPath)
|
static boolean |
JobClient.isJobDirValid(Path jobDirPath,
FileSystem fs)
Checks if the job directory is clean and has all the required components for (re) starting the job |
protected boolean |
TextInputFormat.isSplitable(FileSystem fs,
Path file)
|
protected boolean |
FileInputFormat.isSplitable(FileSystem fs,
Path filename)
Is the given filename splitable? Usually, true, but if the file is stream compressed, it will not be. |
protected boolean |
KeyValueTextInputFormat.isSplitable(FileSystem fs,
Path file)
|
protected boolean |
FixedLengthInputFormat.isSplitable(FileSystem fs,
Path file)
|
protected FileSplit |
FileInputFormat.makeSplit(Path file,
long start,
long length,
String[] hosts)
A factory that makes the split for this class. |
protected FileSplit |
FileInputFormat.makeSplit(Path file,
long start,
long length,
String[] hosts,
String[] inMemoryHosts)
A factory that makes the split for this class. |
static void |
FileInputFormat.setInputPaths(JobConf conf,
Path... inputPaths)
Set the array of Path s as the list of inputs
for the map-reduce job. |
static void |
FileOutputFormat.setOutputPath(JobConf conf,
Path outputDir)
Set the Path of the output directory for the map-reduce job. |
static void |
SkipBadRecords.setSkipOutputPath(JobConf conf,
Path path)
Set the directory to which skipped records are written. |
void |
JobConf.setWorkingDirectory(Path dir)
Set the current working directory for the default file system. |
static void |
FileOutputFormat.setWorkOutputPath(JobConf conf,
Path outputDir)
Set the Path of the task's temporary output directory
for the map-reduce job. |
Constructors in org.apache.hadoop.mapred with parameters of type Path | |
---|---|
FileSplit(Path file,
long start,
long length,
JobConf conf)
Deprecated. |
|
FileSplit(Path file,
long start,
long length,
String[] hosts)
Constructs a split with host information |
|
FileSplit(Path file,
long start,
long length,
String[] hosts,
String[] inMemoryHosts)
Constructs a split with host information |
|
JobConf(Path config)
Construct a map/reduce configuration. |
|
MultiFileSplit(JobConf job,
Path[] files,
long[] lengths)
|
Uses of Path in org.apache.hadoop.mapred.join |
---|
Methods in org.apache.hadoop.mapred.join with parameters of type Path | |
---|---|
static String |
CompositeInputFormat.compose(String op,
Class<? extends InputFormat> inf,
Path... path)
Convenience method for constructing composite formats. |
Uses of Path in org.apache.hadoop.mapred.lib |
---|
Methods in org.apache.hadoop.mapred.lib with parameters of type Path | |
---|---|
static void |
MultipleInputs.addInputPath(JobConf conf,
Path path,
Class<? extends InputFormat> inputFormatClass)
Add a Path with a custom InputFormat to the list of
inputs for the map-reduce job. |
static void |
MultipleInputs.addInputPath(JobConf conf,
Path path,
Class<? extends InputFormat> inputFormatClass,
Class<? extends Mapper> mapperClass)
Add a Path with a custom InputFormat and
Mapper to the list of inputs for the map-reduce job. |
protected static FileSplit |
NLineInputFormat.createFileSplit(Path fileName,
long begin,
long length)
NLineInputFormat uses LineRecordReader, which always reads (and consumes) at least one character out of its upper split boundary. |
protected boolean |
CombineFileInputFormat.isSplitable(FileSystem fs,
Path file)
|
protected boolean |
CombineFileInputFormat.isSplitable(JobContext context,
Path file)
Subclasses should avoid overriding this method and should instead only override CombineFileInputFormat.isSplitable(FileSystem, Path) . |
static void |
TotalOrderPartitioner.setPartitionFile(JobConf job,
Path p)
Deprecated. Use TotalOrderPartitioner.setPartitionFile(Configuration, Path)
instead |
Constructors in org.apache.hadoop.mapred.lib with parameters of type Path | |
---|---|
CombineFileSplit(JobConf job,
Path[] files,
long[] lengths)
|
|
CombineFileSplit(JobConf job,
Path[] files,
long[] start,
long[] lengths,
String[] locations)
|
Uses of Path in org.apache.hadoop.mapreduce |
---|
Methods in org.apache.hadoop.mapreduce that return Path | |
---|---|
Path[] |
JobContext.getArchiveClassPaths()
Get the archive entries in classpath as an array of Path |
Path[] |
JobContext.getFileClassPaths()
Get the file entries in classpath as an array of Path |
Path[] |
JobContext.getLocalCacheArchives()
Deprecated. the array returned only includes the items the were downloaded. There is no way to map this to what is returned by JobContext.getCacheArchives() . |
Path[] |
JobContext.getLocalCacheFiles()
Deprecated. the array returned only includes the items the were downloaded. There is no way to map this to what is returned by JobContext.getCacheFiles() . |
Path |
Cluster.getStagingAreaDir()
Grab the jobtracker's view of the staging directory path where job-specific files will be placed. |
Path |
Cluster.getSystemDir()
Grab the jobtracker system directory path where job-specific files will be placed. |
Path |
JobContext.getWorkingDirectory()
Get the current working directory for the default file system. |
Methods in org.apache.hadoop.mapreduce with parameters of type Path | |
---|---|
void |
Job.addArchiveToClassPath(Path archive)
Add an archive path to the current set of classpath entries. |
void |
Job.addFileToClassPath(Path file)
Add an file path to the current set of classpath entries It adds the file to cache as well. |
void |
Job.setWorkingDirectory(Path dir)
Set the current working directory for the default file system. |
Uses of Path in org.apache.hadoop.mapreduce.lib.input |
---|
Methods in org.apache.hadoop.mapreduce.lib.input that return Path | |
---|---|
static Path[] |
FileInputFormat.getInputPaths(JobContext context)
Get the list of input Path s for the map-reduce job. |
Path |
FileSplit.getPath()
The file containing this split's data. |
Path |
CombineFileSplit.getPath(int i)
Returns the ith Path |
Path[] |
CombineFileSplit.getPaths()
Returns all the Paths in the split |
Methods in org.apache.hadoop.mapreduce.lib.input with parameters of type Path | |
---|---|
static void |
FileInputFormat.addInputPath(Job job,
Path path)
Add a Path to the list of inputs for the map-reduce job. |
static void |
MultipleInputs.addInputPath(Job job,
Path path,
Class<? extends InputFormat> inputFormatClass)
Add a Path with a custom InputFormat to the list of
inputs for the map-reduce job. |
static void |
MultipleInputs.addInputPath(Job job,
Path path,
Class<? extends InputFormat> inputFormatClass,
Class<? extends Mapper> mapperClass)
Add a Path with a custom InputFormat and
Mapper to the list of inputs for the map-reduce job. |
protected void |
FileInputFormat.addInputPathRecursively(List<FileStatus> result,
FileSystem fs,
Path path,
PathFilter inputFilter)
Add files in the input path recursively into the results. |
protected static FileSplit |
NLineInputFormat.createFileSplit(Path fileName,
long begin,
long length)
NLineInputFormat uses LineRecordReader, which always reads (and consumes) at least one character out of its upper split boundary. |
protected boolean |
TextInputFormat.isSplitable(JobContext context,
Path file)
|
protected boolean |
FileInputFormat.isSplitable(JobContext context,
Path filename)
Is the given filename splitable? Usually, true, but if the file is stream compressed, it will not be. |
protected boolean |
CombineFileInputFormat.isSplitable(JobContext context,
Path file)
|
protected boolean |
KeyValueTextInputFormat.isSplitable(JobContext context,
Path file)
|
protected boolean |
FixedLengthInputFormat.isSplitable(JobContext context,
Path file)
|
protected FileSplit |
FileInputFormat.makeSplit(Path file,
long start,
long length,
String[] hosts)
A factory that makes the split for this class. |
protected FileSplit |
FileInputFormat.makeSplit(Path file,
long start,
long length,
String[] hosts,
String[] inMemoryHosts)
A factory that makes the split for this class. |
static void |
FileInputFormat.setInputPaths(Job job,
Path... inputPaths)
Set the array of Path s as the list of inputs
for the map-reduce job. |
Constructors in org.apache.hadoop.mapreduce.lib.input with parameters of type Path | |
---|---|
CombineFileSplit(Path[] files,
long[] lengths)
|
|
CombineFileSplit(Path[] files,
long[] start,
long[] lengths,
String[] locations)
|
|
FileSplit(Path file,
long start,
long length,
String[] hosts)
Constructs a split with host information |
|
FileSplit(Path file,
long start,
long length,
String[] hosts,
String[] inMemoryHosts)
Constructs a split with host and cached-blocks information |
Uses of Path in org.apache.hadoop.mapreduce.lib.join |
---|
Methods in org.apache.hadoop.mapreduce.lib.join with parameters of type Path | |
---|---|
static String |
CompositeInputFormat.compose(String op,
Class<? extends InputFormat> inf,
Path... path)
Convenience method for constructing composite formats. |
Uses of Path in org.apache.hadoop.mapreduce.lib.output |
---|
Methods in org.apache.hadoop.mapreduce.lib.output that return Path | |
---|---|
Path |
PartialFileOutputCommitter.getCommittedTaskPath(int appAttemptId,
TaskAttemptContext context)
|
protected Path |
FileOutputCommitter.getCommittedTaskPath(int appAttemptId,
TaskAttemptContext context)
Compute the path where the output of a committed task is stored until the entire job is committed for a specific application attempt. |
Path |
FileOutputCommitter.getCommittedTaskPath(TaskAttemptContext context)
Compute the path where the output of a committed task is stored until the entire job is committed. |
static Path |
FileOutputCommitter.getCommittedTaskPath(TaskAttemptContext context,
Path out)
|
Path |
FileOutputFormat.getDefaultWorkFile(TaskAttemptContext context,
String extension)
Get the default path and filename for the output format. |
protected Path |
FileOutputCommitter.getJobAttemptPath(int appAttemptId)
Compute the path where the output of a given job attempt will be placed. |
Path |
FileOutputCommitter.getJobAttemptPath(JobContext context)
Compute the path where the output of a given job attempt will be placed. |
static Path |
FileOutputCommitter.getJobAttemptPath(JobContext context,
Path out)
Compute the path where the output of a given job attempt will be placed. |
static Path |
FileOutputFormat.getOutputPath(JobContext job)
Get the Path to the output directory for the map-reduce job. |
static Path |
FileOutputFormat.getPathForWorkFile(TaskInputOutputContext<?,?,?,?> context,
String name,
String extension)
Helper function to generate a Path for a file that is unique for
the task within the job output directory. |
Path |
FileOutputCommitter.getTaskAttemptPath(TaskAttemptContext context)
Compute the path where the output of a task attempt is stored until that task is committed. |
static Path |
FileOutputCommitter.getTaskAttemptPath(TaskAttemptContext context,
Path out)
Compute the path where the output of a task attempt is stored until that task is committed. |
static Path |
FileOutputFormat.getWorkOutputPath(TaskInputOutputContext<?,?,?,?> context)
Get the Path to the task's temporary output directory
for the map-reduce job
Tasks' Side-Effect Files |
Path |
FileOutputCommitter.getWorkPath()
Get the directory that the task should write results into. |
Methods in org.apache.hadoop.mapreduce.lib.output with parameters of type Path | |
---|---|
void |
FileOutputCommitter.abortTask(TaskAttemptContext context,
Path taskAttemptPath)
|
void |
FileOutputCommitter.commitTask(TaskAttemptContext context,
Path taskAttemptPath)
|
static Path |
FileOutputCommitter.getCommittedTaskPath(TaskAttemptContext context,
Path out)
|
static Path |
FileOutputCommitter.getJobAttemptPath(JobContext context,
Path out)
Compute the path where the output of a given job attempt will be placed. |
static org.apache.hadoop.io.MapFile.Reader[] |
MapFileOutputFormat.getReaders(Path dir,
Configuration conf)
Open the output generated by this format. |
static Path |
FileOutputCommitter.getTaskAttemptPath(TaskAttemptContext context,
Path out)
Compute the path where the output of a task attempt is stored until that task is committed. |
boolean |
FileOutputCommitter.needsTaskCommit(TaskAttemptContext context,
Path taskAttemptPath)
|
static void |
FileOutputFormat.setOutputPath(Job job,
Path outputDir)
Set the Path of the output directory for the map-reduce job. |
Constructors in org.apache.hadoop.mapreduce.lib.output with parameters of type Path | |
---|---|
FileOutputCommitter(Path outputPath,
JobContext context)
Create a file output committer |
|
FileOutputCommitter(Path outputPath,
TaskAttemptContext context)
Create a file output committer |
|
PartialFileOutputCommitter(Path outputPath,
JobContext context)
|
|
PartialFileOutputCommitter(Path outputPath,
TaskAttemptContext context)
|
Uses of Path in org.apache.hadoop.mapreduce.lib.partition |
---|
Methods in org.apache.hadoop.mapreduce.lib.partition with parameters of type Path | |
---|---|
static void |
TotalOrderPartitioner.setPartitionFile(Configuration conf,
Path p)
Set the path to the SequenceFile storing the sorted partition keyset. |
Uses of Path in org.apache.hadoop.mapreduce.security |
---|
Methods in org.apache.hadoop.mapreduce.security with parameters of type Path | |
---|---|
static void |
TokenCache.obtainTokensForNamenodes(org.apache.hadoop.security.Credentials credentials,
Path[] ps,
Configuration conf)
Convenience method to obtain delegation tokens from namenodes corresponding to the paths passed. |
Uses of Path in org.apache.hadoop.mapreduce.v2.hs |
---|
Methods in org.apache.hadoop.mapreduce.v2.hs with parameters of type Path | |
---|---|
protected List<FileStatus> |
HistoryFileManager.scanDirectoryForHistoryFiles(Path path,
FileContext fc)
|
Uses of Path in org.apache.hadoop.yarn.logaggregation |
---|
Constructors in org.apache.hadoop.yarn.logaggregation with parameters of type Path | |
---|---|
AggregatedLogFormat.LogReader(Configuration conf,
Path remoteAppLogFile)
|
|
||||||||||
PREV NEXT | FRAMES NO FRAMES |