| Package | Description |
|---|---|
| org.apache.hadoop.conf |
Configuration of system parameters.
|
| org.apache.hadoop.fs |
An abstract file system API.
|
| org.apache.hadoop.fs.ftp | |
| org.apache.hadoop.fs.s3 |
A distributed, block-based implementation of
FileSystem that uses Amazon S3
as a backing store. |
| org.apache.hadoop.fs.s3native |
A distributed implementation of
FileSystem for reading and writing files on
Amazon S3. |
| org.apache.hadoop.fs.viewfs | |
| org.apache.hadoop.io |
Generic i/o code for use when reading and writing data to the network,
to databases, and to files.
|
| org.apache.hadoop.io.compress | |
| org.apache.hadoop.mapred | |
| org.apache.hadoop.mapred.join | |
| org.apache.hadoop.mapred.lib | |
| org.apache.hadoop.mapreduce | |
| org.apache.hadoop.mapreduce.lib.input | |
| org.apache.hadoop.mapreduce.lib.join | |
| org.apache.hadoop.mapreduce.lib.output | |
| org.apache.hadoop.mapreduce.lib.partition | |
| org.apache.hadoop.mapreduce.security | |
| org.apache.hadoop.mapreduce.v2.hs | |
| org.apache.hadoop.yarn.logaggregation |
| Modifier and Type | Method and Description |
|---|---|
Path |
Configuration.getLocalPath(String dirsProp,
String path)
Get a local file under a directory named by dirsProp with
the given path.
|
| Modifier and Type | Method and Description |
|---|---|
void |
Configuration.addResource(Path file)
Add a configuration resource.
|
| Modifier and Type | Field and Description |
|---|---|
protected Path |
TrashPolicy.trash |
| Modifier and Type | Method and Description |
|---|---|
Path |
FileSystem.createSnapshot(Path path)
Create a snapshot with a default name.
|
Path |
FileSystem.createSnapshot(Path path,
String snapshotName)
Create a snapshot
|
Path |
FilterFileSystem.createSnapshot(Path path,
String snapshotName) |
protected Path |
FileSystem.fixRelativePart(Path p)
|
Path |
ChecksumFileSystem.getChecksumFile(Path file)
Return the name of the checksum file associated with a file.
|
abstract Path |
TrashPolicy.getCurrentTrashDir()
Get the current working directory of the Trash Policy
|
Path |
RawLocalFileSystem.getHomeDirectory() |
Path |
FileSystem.getHomeDirectory()
Return the current user's home directory in this filesystem.
|
Path |
FileContext.getHomeDirectory()
Return the current user's home directory in this file system.
|
Path |
FilterFileSystem.getHomeDirectory() |
Path |
AbstractFileSystem.getHomeDirectory()
Return the current user's home directory in this file system.
|
protected Path |
RawLocalFileSystem.getInitialWorkingDirectory() |
protected Path |
FileSystem.getInitialWorkingDirectory()
Note: with the new FilesContext class, getWorkingDirectory()
will be removed.
|
protected Path |
FilterFileSystem.getInitialWorkingDirectory() |
Path |
AbstractFileSystem.getInitialWorkingDirectory()
Some file systems like LocalFileSystem have an initial workingDir
that is used as the starting workingDir.
|
Path |
RawLocalFileSystem.getLinkTarget(Path f) |
Path |
LocalFileSystem.getLinkTarget(Path f) |
Path |
FileSystem.getLinkTarget(Path f)
|
Path |
FileContext.getLinkTarget(Path f)
Returns the target of the given symbolic link as it was specified
when the link was created.
|
Path |
FilterFileSystem.getLinkTarget(Path f) |
Path |
AbstractFileSystem.getLinkTarget(Path f)
Partially resolves the path.
|
Path |
Path.getParent()
Returns the parent of a path or null if at root.
|
Path |
FileStatus.getPath() |
static Path |
Path.getPathWithoutSchemeAndAuthority(Path path) |
Path |
FileStatus.getSymlink() |
Path |
RawLocalFileSystem.getWorkingDirectory() |
abstract Path |
FileSystem.getWorkingDirectory()
Get the current working directory for the given file system
|
Path |
FileContext.getWorkingDirectory()
Gets the working directory for wd-relative names (such a "foo/bar").
|
Path |
FilterFileSystem.getWorkingDirectory()
Get the current working directory for the given file system
|
Path |
Path.makeQualified(FileSystem fs)
Deprecated.
|
Path |
FileSystem.makeQualified(Path path)
Make sure that a path specifies a FileSystem.
|
Path |
FileContext.makeQualified(Path path)
Make the path fully qualified if it is isn't.
|
Path |
FilterFileSystem.makeQualified(Path path)
Make sure that a path specifies a FileSystem.
|
Path |
AbstractFileSystem.makeQualified(Path path)
Make the path fully qualified to this file system
|
Path |
Path.makeQualified(URI defaultUri,
Path workingDir)
Returns a qualified path object.
|
static Path |
Path.mergePaths(Path path1,
Path path2)
Merge 2 paths such that the second path is appended relative to the first.
|
protected Path |
FileContext.resolve(Path f)
Resolves all symbolic links in the specified path.
|
protected Path |
FileContext.resolveIntermediate(Path f)
Resolves all symbolic links in the specified path leading up
to, but not including the final path component.
|
protected Path |
FileSystem.resolveLink(Path f)
|
protected Path |
FilterFileSystem.resolveLink(Path f) |
Path |
FileSystem.resolvePath(Path p)
Return the fully-qualified path of path f resolving the path
through any symlinks or mount point
|
Path |
FileContext.resolvePath(Path f)
Resolve the path following any symlinks or mount points
|
Path |
FilterFileSystem.resolvePath(Path p) |
Path |
AbstractFileSystem.resolvePath(Path p)
Return the fully-qualified path of path f resolving the path
through any internal symlinks or mount point
|
Path |
RawLocalFileSystem.startLocalOutput(Path fsOutputFile,
Path tmpLocalFile) |
Path |
FileSystem.startLocalOutput(Path fsOutputFile,
Path tmpLocalFile)
Returns a local File that the user can write output to.
|
Path |
ChecksumFileSystem.startLocalOutput(Path fsOutputFile,
Path tmpLocalFile) |
Path |
FilterFileSystem.startLocalOutput(Path fsOutputFile,
Path tmpLocalFile)
Returns a local File that the user can write output to.
|
static Path[] |
FileUtil.stat2Paths(FileStatus[] stats)
convert an array of FileStatus to an array of Path
|
static Path[] |
FileUtil.stat2Paths(FileStatus[] stats,
Path path)
convert an array of FileStatus to an array of Path.
|
Path |
Path.suffix(String suffix)
Adds a suffix to the final name in the path.
|
| Modifier and Type | Method and Description |
|---|---|
org.apache.hadoop.fs.RemoteIterator<Path> |
FileSystem.listCorruptFileBlocks(Path path) |
org.apache.hadoop.fs.RemoteIterator<Path> |
FileContext.listCorruptFileBlocks(Path path) |
org.apache.hadoop.fs.RemoteIterator<Path> |
FilterFileSystem.listCorruptFileBlocks(Path path) |
org.apache.hadoop.fs.RemoteIterator<Path> |
AbstractFileSystem.listCorruptFileBlocks(Path path) |
| Modifier and Type | Method and Description |
|---|---|
boolean |
GlobFilter.accept(Path path) |
boolean |
PathFilter.accept(Path path)
Tests whether or not the specified abstract pathname should be
included in a pathname list.
|
void |
FileSystem.access(Path path,
FsAction mode)
Checks if the user can access a path.
|
void |
FileContext.access(Path path,
FsAction mode)
Checks if the user can access a path.
|
void |
FilterFileSystem.access(Path path,
FsAction mode) |
void |
AbstractFileSystem.access(Path path,
FsAction mode)
The specification of this method matches that of
FileContext.access(Path, FsAction)
except that an UnresolvedLinkException may be thrown if a symlink is
encountered in the path. |
FSDataOutputStream |
FileSystem.append(Path f)
Append to an existing file (optional operation).
|
FSDataOutputStream |
FileSystem.append(Path f,
int bufferSize)
Append to an existing file (optional operation).
|
FSDataOutputStream |
RawLocalFileSystem.append(Path f,
int bufferSize,
Progressable progress) |
abstract FSDataOutputStream |
FileSystem.append(Path f,
int bufferSize,
Progressable progress)
Append to an existing file (optional operation).
|
FSDataOutputStream |
ChecksumFileSystem.append(Path f,
int bufferSize,
Progressable progress) |
FSDataOutputStream |
FilterFileSystem.append(Path f,
int bufferSize,
Progressable progress) |
boolean |
FileSystem.cancelDeleteOnExit(Path f)
Cancel the deletion of the path when the FileSystem is closed
|
protected void |
FileSystem.checkPath(Path path)
Check that a Path belongs to this FileSystem.
|
protected void |
FilterFileSystem.checkPath(Path path)
Check that a Path belongs to this FileSystem.
|
void |
AbstractFileSystem.checkPath(Path path)
Check that a Path belongs to this FileSystem.
|
void |
RawLocalFileSystem.completeLocalOutput(Path fsWorkingFile,
Path tmpLocalFile) |
void |
FileSystem.completeLocalOutput(Path fsOutputFile,
Path tmpLocalFile)
Called when we're all done writing to the target.
|
void |
ChecksumFileSystem.completeLocalOutput(Path fsOutputFile,
Path tmpLocalFile) |
void |
FilterFileSystem.completeLocalOutput(Path fsOutputFile,
Path tmpLocalFile)
Called when we're all done writing to the target.
|
void |
FileSystem.concat(Path trg,
Path[] psrcs)
Concat existing files together.
|
void |
FileSystem.concat(Path trg,
Path[] psrcs)
Concat existing files together.
|
void |
FilterFileSystem.concat(Path f,
Path[] psrcs) |
void |
FilterFileSystem.concat(Path f,
Path[] psrcs) |
static boolean |
FileUtil.copy(File src,
FileSystem dstFS,
Path dst,
boolean deleteSource,
Configuration conf)
Copy local files to a FileSystem.
|
static boolean |
FileUtil.copy(FileSystem srcFS,
FileStatus srcStatus,
FileSystem dstFS,
Path dst,
boolean deleteSource,
boolean overwrite,
Configuration conf)
Copy files between FileSystems.
|
static boolean |
FileUtil.copy(FileSystem srcFS,
Path[] srcs,
FileSystem dstFS,
Path dst,
boolean deleteSource,
boolean overwrite,
Configuration conf) |
static boolean |
FileUtil.copy(FileSystem srcFS,
Path[] srcs,
FileSystem dstFS,
Path dst,
boolean deleteSource,
boolean overwrite,
Configuration conf) |
static boolean |
FileUtil.copy(FileSystem srcFS,
Path src,
File dst,
boolean deleteSource,
Configuration conf)
Copy FileSystem files to local files.
|
static boolean |
FileUtil.copy(FileSystem srcFS,
Path src,
FileSystem dstFS,
Path dst,
boolean deleteSource,
boolean overwrite,
Configuration conf)
Copy files between FileSystems.
|
static boolean |
FileUtil.copy(FileSystem srcFS,
Path src,
FileSystem dstFS,
Path dst,
boolean deleteSource,
Configuration conf)
Copy files between FileSystems.
|
void |
FileSystem.copyFromLocalFile(boolean delSrc,
boolean overwrite,
Path[] srcs,
Path dst)
The src files are on the local disk.
|
void |
FileSystem.copyFromLocalFile(boolean delSrc,
boolean overwrite,
Path[] srcs,
Path dst)
The src files are on the local disk.
|
void |
FilterFileSystem.copyFromLocalFile(boolean delSrc,
boolean overwrite,
Path[] srcs,
Path dst)
The src files are on the local disk.
|
void |
FilterFileSystem.copyFromLocalFile(boolean delSrc,
boolean overwrite,
Path[] srcs,
Path dst)
The src files are on the local disk.
|
void |
FileSystem.copyFromLocalFile(boolean delSrc,
boolean overwrite,
Path src,
Path dst)
The src file is on the local disk.
|
void |
FilterFileSystem.copyFromLocalFile(boolean delSrc,
boolean overwrite,
Path src,
Path dst)
The src file is on the local disk.
|
void |
LocalFileSystem.copyFromLocalFile(boolean delSrc,
Path src,
Path dst) |
void |
FileSystem.copyFromLocalFile(boolean delSrc,
Path src,
Path dst)
The src file is on the local disk.
|
void |
ChecksumFileSystem.copyFromLocalFile(boolean delSrc,
Path src,
Path dst) |
void |
FilterFileSystem.copyFromLocalFile(boolean delSrc,
Path src,
Path dst)
The src file is on the local disk.
|
void |
FileSystem.copyFromLocalFile(Path src,
Path dst)
The src file is on the local disk.
|
static boolean |
FileUtil.copyMerge(FileSystem srcFS,
Path srcDir,
FileSystem dstFS,
Path dstFile,
boolean deleteSource,
Configuration conf,
String addString)
Copy all files in a directory to one output file (merge).
|
void |
LocalFileSystem.copyToLocalFile(boolean delSrc,
Path src,
Path dst) |
void |
FileSystem.copyToLocalFile(boolean delSrc,
Path src,
Path dst)
The src file is under FS, and the dst is on the local disk.
|
void |
ChecksumFileSystem.copyToLocalFile(boolean delSrc,
Path src,
Path dst)
The src file is under FS, and the dst is on the local disk.
|
void |
FilterFileSystem.copyToLocalFile(boolean delSrc,
Path src,
Path dst)
The src file is under FS, and the dst is on the local disk.
|
void |
FileSystem.copyToLocalFile(boolean delSrc,
Path src,
Path dst,
boolean useRawLocalFileSystem)
The src file is under FS, and the dst is on the local disk.
|
void |
FileSystem.copyToLocalFile(Path src,
Path dst)
The src file is under FS, and the dst is on the local disk.
|
void |
ChecksumFileSystem.copyToLocalFile(Path src,
Path dst,
boolean copyCrc)
The src file is under FS, and the dst is on the local disk.
|
static FSDataOutputStream |
FileSystem.create(FileSystem fs,
Path file,
FsPermission permission)
create a file with the provided permission
The permission of the file is set to be the provided permission as in
setPermission, not permission&~umask
It is implemented using two RPCs.
|
FSDataOutputStream |
FileSystem.create(Path f)
Create an FSDataOutputStream at the indicated Path.
|
FSDataOutputStream |
FileSystem.create(Path f,
boolean overwrite)
Create an FSDataOutputStream at the indicated Path.
|
FSDataOutputStream |
FileSystem.create(Path f,
boolean overwrite,
int bufferSize)
Create an FSDataOutputStream at the indicated Path.
|
FSDataOutputStream |
FileSystem.create(Path f,
boolean overwrite,
int bufferSize,
Progressable progress)
Create an FSDataOutputStream at the indicated Path with write-progress
reporting.
|
FSDataOutputStream |
FileSystem.create(Path f,
boolean overwrite,
int bufferSize,
short replication,
long blockSize)
Create an FSDataOutputStream at the indicated Path.
|
FSDataOutputStream |
RawLocalFileSystem.create(Path f,
boolean overwrite,
int bufferSize,
short replication,
long blockSize,
Progressable progress) |
FSDataOutputStream |
FileSystem.create(Path f,
boolean overwrite,
int bufferSize,
short replication,
long blockSize,
Progressable progress)
Create an FSDataOutputStream at the indicated Path with write-progress
reporting.
|
FSDataOutputStream |
FileContext.create(Path f,
EnumSet<CreateFlag> createFlag,
org.apache.hadoop.fs.Options.CreateOpts... opts)
Create or overwrite file on indicated path and returns an output stream for
writing into the file.
|
FSDataOutputStream |
AbstractFileSystem.create(Path f,
EnumSet<CreateFlag> createFlag,
org.apache.hadoop.fs.Options.CreateOpts... opts)
The specification of this method matches that of
FileContext.create(Path, EnumSet, Options.CreateOpts...) except
that the Path f must be fully qualified and the permission is absolute
(i.e. |
FSDataOutputStream |
RawLocalFileSystem.create(Path f,
FsPermission permission,
boolean overwrite,
int bufferSize,
short replication,
long blockSize,
Progressable progress) |
abstract FSDataOutputStream |
FileSystem.create(Path f,
FsPermission permission,
boolean overwrite,
int bufferSize,
short replication,
long blockSize,
Progressable progress)
Create an FSDataOutputStream at the indicated Path with write-progress
reporting.
|
FSDataOutputStream |
ChecksumFileSystem.create(Path f,
FsPermission permission,
boolean overwrite,
int bufferSize,
short replication,
long blockSize,
Progressable progress) |
FSDataOutputStream |
FilterFileSystem.create(Path f,
FsPermission permission,
boolean overwrite,
int bufferSize,
short replication,
long blockSize,
Progressable progress) |
FSDataOutputStream |
FileSystem.create(Path f,
FsPermission permission,
EnumSet<CreateFlag> flags,
int bufferSize,
short replication,
long blockSize,
Progressable progress)
Create an FSDataOutputStream at the indicated Path with write-progress
reporting.
|
FSDataOutputStream |
FileSystem.create(Path f,
FsPermission permission,
EnumSet<CreateFlag> flags,
int bufferSize,
short replication,
long blockSize,
Progressable progress,
org.apache.hadoop.fs.Options.ChecksumOpt checksumOpt)
Create an FSDataOutputStream at the indicated Path with a custom
checksum option
|
FSDataOutputStream |
FilterFileSystem.create(Path f,
FsPermission permission,
EnumSet<CreateFlag> flags,
int bufferSize,
short replication,
long blockSize,
Progressable progress,
org.apache.hadoop.fs.Options.ChecksumOpt checksumOpt) |
FSDataOutputStream |
FileSystem.create(Path f,
Progressable progress)
Create an FSDataOutputStream at the indicated Path with write-progress
reporting.
|
FSDataOutputStream |
FileSystem.create(Path f,
short replication)
Create an FSDataOutputStream at the indicated Path.
|
FSDataOutputStream |
FileSystem.create(Path f,
short replication,
Progressable progress)
Create an FSDataOutputStream at the indicated Path with write-progress
reporting.
|
abstract FSDataOutputStream |
AbstractFileSystem.createInternal(Path f,
EnumSet<CreateFlag> flag,
FsPermission absolutePermission,
int bufferSize,
short replication,
long blockSize,
Progressable progress,
org.apache.hadoop.fs.Options.ChecksumOpt checksumOpt,
boolean createParent)
The specification of this method matches that of
AbstractFileSystem.create(Path, EnumSet, Options.CreateOpts...) except that the opts
have been declared explicitly. |
static String[] |
FileUtil.createJarWithClassPath(String inputClassPath,
Path pwd,
Map<String,String> callerEnv) |
static String[] |
FileUtil.createJarWithClassPath(String inputClassPath,
Path pwd,
Path targetDir,
Map<String,String> callerEnv)
Create a jar file at the given path, containing a manifest with a classpath
that references all specified entries.
|
boolean |
FileSystem.createNewFile(Path f)
Creates the given Path as a brand-new zero-length file.
|
FSDataOutputStream |
FileSystem.createNonRecursive(Path f,
boolean overwrite,
int bufferSize,
short replication,
long blockSize,
Progressable progress)
Deprecated.
API only for 0.20-append
|
FSDataOutputStream |
RawLocalFileSystem.createNonRecursive(Path f,
FsPermission permission,
boolean overwrite,
int bufferSize,
short replication,
long blockSize,
Progressable progress) |
FSDataOutputStream |
FileSystem.createNonRecursive(Path f,
FsPermission permission,
boolean overwrite,
int bufferSize,
short replication,
long blockSize,
Progressable progress)
Deprecated.
API only for 0.20-append
|
FSDataOutputStream |
ChecksumFileSystem.createNonRecursive(Path f,
FsPermission permission,
boolean overwrite,
int bufferSize,
short replication,
long blockSize,
Progressable progress) |
FSDataOutputStream |
RawLocalFileSystem.createNonRecursive(Path f,
FsPermission permission,
EnumSet<CreateFlag> flags,
int bufferSize,
short replication,
long blockSize,
Progressable progress)
Deprecated.
|
FSDataOutputStream |
FileSystem.createNonRecursive(Path f,
FsPermission permission,
EnumSet<CreateFlag> flags,
int bufferSize,
short replication,
long blockSize,
Progressable progress)
Deprecated.
API only for 0.20-append
|
FSDataOutputStream |
FilterFileSystem.createNonRecursive(Path f,
FsPermission permission,
EnumSet<CreateFlag> flags,
int bufferSize,
short replication,
long blockSize,
Progressable progress)
Deprecated.
|
protected OutputStream |
RawLocalFileSystem.createOutputStream(Path f,
boolean append) |
Path |
FileSystem.createSnapshot(Path path)
Create a snapshot with a default name.
|
Path |
FileSystem.createSnapshot(Path path,
String snapshotName)
Create a snapshot
|
Path |
FilterFileSystem.createSnapshot(Path path,
String snapshotName) |
void |
RawLocalFileSystem.createSymlink(Path target,
Path link,
boolean createParent) |
void |
LocalFileSystem.createSymlink(Path target,
Path link,
boolean createParent) |
void |
FileSystem.createSymlink(Path target,
Path link,
boolean createParent)
|
void |
FileContext.createSymlink(Path target,
Path link,
boolean createParent)
Creates a symbolic link to an existing file.
|
void |
FilterFileSystem.createSymlink(Path target,
Path link,
boolean createParent) |
void |
AbstractFileSystem.createSymlink(Path target,
Path link,
boolean createParent)
The specification of this method matches that of
FileContext.createSymlink(Path, Path, boolean); |
boolean |
FileSystem.delete(Path f)
Deprecated.
Use
FileSystem.delete(Path, boolean) instead. |
boolean |
RawLocalFileSystem.delete(Path p,
boolean recursive)
Delete the given path to a file or directory.
|
abstract boolean |
FileSystem.delete(Path f,
boolean recursive)
Delete a file.
|
boolean |
ChecksumFileSystem.delete(Path f,
boolean recursive)
Implement the delete(Path, boolean) in checksum
file system.
|
boolean |
FileContext.delete(Path f,
boolean recursive)
Delete a file.
|
boolean |
FilterFileSystem.delete(Path f,
boolean recursive)
Delete a file
|
abstract boolean |
AbstractFileSystem.delete(Path f,
boolean recursive)
The specification of this method matches that of
FileContext.delete(Path, boolean) except that Path f must be for
this file system. |
boolean |
FileSystem.deleteOnExit(Path f)
Mark a path to be deleted when FileSystem is closed.
|
boolean |
FileContext.deleteOnExit(Path f)
Mark a path to be deleted on JVM shutdown.
|
void |
FileSystem.deleteSnapshot(Path path,
String snapshotName)
Delete a snapshot of a directory
|
void |
FilterFileSystem.deleteSnapshot(Path path,
String snapshotName) |
boolean |
FileSystem.exists(Path f)
Check if exists.
|
protected Path |
FileSystem.fixRelativePart(Path p)
|
static void |
FileUtil.fullyDelete(FileSystem fs,
Path dir)
Deprecated.
|
AclStatus |
FileSystem.getAclStatus(Path path)
Gets the ACL of a file or directory.
|
AclStatus |
FileContext.getAclStatus(Path path)
Gets the ACLs of files and directories.
|
AclStatus |
FilterFileSystem.getAclStatus(Path path) |
AclStatus |
AbstractFileSystem.getAclStatus(Path path)
Gets the ACLs of files and directories.
|
long |
FileSystem.getBlockSize(Path f)
Deprecated.
Use getFileStatus() instead
|
Path |
ChecksumFileSystem.getChecksumFile(Path file)
Return the name of the checksum file associated with a file.
|
long |
ChecksumFileSystem.getChecksumFileLength(Path file,
long fileSize)
Return the length of the checksum file given the size of the
actual file.
|
ContentSummary |
FileSystem.getContentSummary(Path f)
Return the
ContentSummary of a given Path. |
long |
FileSystem.getDefaultBlockSize(Path f)
Return the number of bytes that large input files should be optimally
be split into to minimize i/o time.
|
long |
FilterFileSystem.getDefaultBlockSize(Path f) |
short |
FileSystem.getDefaultReplication(Path path)
Get the default replication for a path.
|
short |
FilterFileSystem.getDefaultReplication(Path f) |
List<org.apache.hadoop.security.token.Token<?>> |
FileContext.getDelegationTokens(Path p,
String renewer)
Get delegation tokens for the file systems accessed for a given
path.
|
BlockLocation[] |
FileSystem.getFileBlockLocations(Path p,
long start,
long len)
Return an array containing hostnames, offset and size of
portions of the given file.
|
BlockLocation[] |
FileContext.getFileBlockLocations(Path f,
long start,
long len)
Return blockLocation of the given file for the given offset and len.
|
abstract BlockLocation[] |
AbstractFileSystem.getFileBlockLocations(Path f,
long start,
long len)
The specification of this method matches that of
FileContext.getFileBlockLocations(Path, long, long) except that
Path f must be for this file system. |
FileChecksum |
FileSystem.getFileChecksum(Path f)
Get the checksum of a file.
|
FileChecksum |
FileContext.getFileChecksum(Path f)
Get the checksum of a file.
|
FileChecksum |
FilterFileSystem.getFileChecksum(Path f) |
abstract FileChecksum |
AbstractFileSystem.getFileChecksum(Path f)
The specification of this method matches that of
FileContext.getFileChecksum(Path) except that Path f must be for
this file system. |
FileChecksum |
FileSystem.getFileChecksum(Path f,
long length)
Get the checksum of a file, from the beginning of the file till the
specific length.
|
FileChecksum |
FilterFileSystem.getFileChecksum(Path f,
long length) |
FileStatus |
RawLocalFileSystem.getFileLinkStatus(Path f)
Return a FileStatus representing the given path.
|
FileStatus |
LocalFileSystem.getFileLinkStatus(Path f) |
FileStatus |
FileSystem.getFileLinkStatus(Path f)
|
FileStatus |
FileContext.getFileLinkStatus(Path f)
Return a file status object that represents the path.
|
FileStatus |
FilterFileSystem.getFileLinkStatus(Path f) |
FileStatus |
AbstractFileSystem.getFileLinkStatus(Path f)
The specification of this method matches that of
FileContext.getFileLinkStatus(Path)
except that an UnresolvedLinkException may be thrown if a symlink is
encountered in the path leading up to the final path component. |
FileStatus |
RawLocalFileSystem.getFileStatus(Path f) |
abstract FileStatus |
FileSystem.getFileStatus(Path f)
Return a file status object that represents the path.
|
FileStatus |
FileContext.getFileStatus(Path f)
Return a file status object that represents the path.
|
FileStatus |
FilterFileSystem.getFileStatus(Path f)
Get file status.
|
abstract FileStatus |
AbstractFileSystem.getFileStatus(Path f)
The specification of this method matches that of
FileContext.getFileStatus(Path)
except that an UnresolvedLinkException may be thrown if a symlink is
encountered in the path. |
protected AbstractFileSystem |
FileContext.getFSofPath(Path absOrFqPath)
Get the file system of supplied path.
|
protected static FileSystem |
FileSystem.getFSofPath(Path absOrFqPath,
Configuration conf) |
FsStatus |
FileContext.getFsStatus(Path f)
Returns a status object describing the use and capacity of the
file system denoted by the Parh argument p.
|
FsStatus |
AbstractFileSystem.getFsStatus(Path f)
The specification of this method matches that of
FileContext.getFsStatus(Path) except that Path f must be for this
file system. |
static TrashPolicy |
TrashPolicy.getInstance(Configuration conf,
FileSystem fs,
Path home)
Get an instance of the configured TrashPolicy based on the value
of the configuration parameter fs.trash.classname.
|
long |
FileSystem.getLength(Path f)
Deprecated.
Use getFileStatus() instead
|
Path |
RawLocalFileSystem.getLinkTarget(Path f) |
Path |
LocalFileSystem.getLinkTarget(Path f) |
Path |
FileSystem.getLinkTarget(Path f)
|
Path |
FileContext.getLinkTarget(Path f)
Returns the target of the given symbolic link as it was specified
when the link was created.
|
Path |
FilterFileSystem.getLinkTarget(Path f) |
Path |
AbstractFileSystem.getLinkTarget(Path f)
Partially resolves the path.
|
static Path |
Path.getPathWithoutSchemeAndAuthority(Path path) |
short |
FileSystem.getReplication(Path src)
Deprecated.
Use getFileStatus() instead
|
FsServerDefaults |
FileSystem.getServerDefaults(Path p)
Return a set of server default configuration values
|
FsServerDefaults |
FilterFileSystem.getServerDefaults(Path f) |
FsStatus |
RawLocalFileSystem.getStatus(Path p) |
FsStatus |
FileSystem.getStatus(Path p)
Returns a status object describing the use and capacity of the
file system.
|
FsStatus |
FilterFileSystem.getStatus(Path p) |
String |
AbstractFileSystem.getUriPath(Path p)
Get the path-part of a pathname.
|
byte[] |
FileSystem.getXAttr(Path path,
String name)
Get an xattr name and value for a file or directory.
|
byte[] |
FileContext.getXAttr(Path path,
String name)
Get an xattr for a file or directory.
|
byte[] |
FilterFileSystem.getXAttr(Path path,
String name) |
byte[] |
AbstractFileSystem.getXAttr(Path path,
String name)
Get an xattr for a file or directory.
|
Map<String,byte[]> |
FileSystem.getXAttrs(Path path)
Get all of the xattr name/value pairs for a file or directory.
|
Map<String,byte[]> |
FileContext.getXAttrs(Path path)
Get all of the xattrs for a file or directory.
|
Map<String,byte[]> |
FilterFileSystem.getXAttrs(Path path) |
Map<String,byte[]> |
AbstractFileSystem.getXAttrs(Path path)
Get all of the xattrs for a file or directory.
|
Map<String,byte[]> |
FileSystem.getXAttrs(Path path,
List<String> names)
Get all of the xattrs name/value pairs for a file or directory.
|
Map<String,byte[]> |
FileContext.getXAttrs(Path path,
List<String> names)
Get all of the xattrs for a file or directory.
|
Map<String,byte[]> |
FilterFileSystem.getXAttrs(Path path,
List<String> names) |
Map<String,byte[]> |
AbstractFileSystem.getXAttrs(Path path,
List<String> names)
Get all of the xattrs for a file or directory.
|
FileStatus[] |
FileSystem.globStatus(Path pathPattern)
Return all the files that match filePattern and are not checksum
files.
|
FileStatus[] |
FileSystem.globStatus(Path pathPattern,
PathFilter filter)
Return an array of FileStatus objects whose path names match pathPattern
and is accepted by the user-supplied path filter.
|
abstract void |
TrashPolicy.initialize(Configuration conf,
FileSystem fs,
Path home)
Used to setup the trash policy.
|
static boolean |
ChecksumFileSystem.isChecksumFile(Path file)
Return true iff file is a checksum file name.
|
boolean |
FileSystem.isDirectory(Path f)
True iff the named path is a directory.
|
boolean |
FileSystem.isFile(Path f)
True iff the named path is a regular file.
|
org.apache.hadoop.fs.RemoteIterator<Path> |
FileSystem.listCorruptFileBlocks(Path path) |
org.apache.hadoop.fs.RemoteIterator<Path> |
FileContext.listCorruptFileBlocks(Path path) |
org.apache.hadoop.fs.RemoteIterator<Path> |
FilterFileSystem.listCorruptFileBlocks(Path path) |
org.apache.hadoop.fs.RemoteIterator<Path> |
AbstractFileSystem.listCorruptFileBlocks(Path path) |
org.apache.hadoop.fs.RemoteIterator<LocatedFileStatus> |
FileSystem.listFiles(Path f,
boolean recursive)
List the statuses and block locations of the files in the given path.
|
org.apache.hadoop.fs.RemoteIterator<LocatedFileStatus> |
FileSystem.listLocatedStatus(Path f)
List the statuses of the files/directories in the given path if the path is
a directory.
|
org.apache.hadoop.fs.RemoteIterator<LocatedFileStatus> |
ChecksumFileSystem.listLocatedStatus(Path f)
List the statuses of the files/directories in the given path if the path is
a directory.
|
org.apache.hadoop.fs.RemoteIterator<LocatedFileStatus> |
FileContext.listLocatedStatus(Path f)
List the statuses of the files/directories in the given path if the path is
a directory.
|
org.apache.hadoop.fs.RemoteIterator<LocatedFileStatus> |
FilterFileSystem.listLocatedStatus(Path f)
List files and its block locations in a directory.
|
org.apache.hadoop.fs.RemoteIterator<LocatedFileStatus> |
AbstractFileSystem.listLocatedStatus(Path f)
The specification of this method matches that of
FileContext.listLocatedStatus(Path) except that Path f
must be for this file system. |
protected org.apache.hadoop.fs.RemoteIterator<LocatedFileStatus> |
FileSystem.listLocatedStatus(Path f,
PathFilter filter)
Listing a directory
The returned results include its block location if it is a file
The results are filtered by the given path filter
|
FileStatus[] |
RawLocalFileSystem.listStatus(Path f) |
abstract FileStatus[] |
FileSystem.listStatus(Path f)
List the statuses of the files/directories in the given path if the path is
a directory.
|
FileStatus[] |
ChecksumFileSystem.listStatus(Path f)
List the statuses of the files/directories in the given path if the path is
a directory.
|
org.apache.hadoop.fs.RemoteIterator<FileStatus> |
FileContext.listStatus(Path f)
List the statuses of the files/directories in the given path if the path is
a directory.
|
FileStatus[] |
FilterFileSystem.listStatus(Path f)
List files in a directory.
|
abstract FileStatus[] |
AbstractFileSystem.listStatus(Path f)
The specification of this method matches that of
FileContext.Util.listStatus(Path) except that Path f must be
for this file system. |
FileStatus[] |
FileSystem.listStatus(Path[] files)
Filter files/directories in the given list of paths using default
path filter.
|
FileStatus[] |
FileSystem.listStatus(Path[] files,
PathFilter filter)
Filter files/directories in the given list of paths using user-supplied
path filter.
|
FileStatus[] |
FileSystem.listStatus(Path f,
PathFilter filter)
Filter files/directories in the given path using the user-supplied path
filter.
|
org.apache.hadoop.fs.RemoteIterator<FileStatus> |
AbstractFileSystem.listStatusIterator(Path f)
The specification of this method matches that of
FileContext.listStatus(Path) except that Path f must be for this
file system. |
List<String> |
FileSystem.listXAttrs(Path path)
Get all of the xattr names for a file or directory.
|
List<String> |
FileContext.listXAttrs(Path path)
Get all of the xattr names for a file or directory.
|
List<String> |
FilterFileSystem.listXAttrs(Path path) |
List<String> |
AbstractFileSystem.listXAttrs(Path path)
Get all of the xattr names for a file or directory.
|
Path |
FileSystem.makeQualified(Path path)
Make sure that a path specifies a FileSystem.
|
Path |
FileContext.makeQualified(Path path)
Make the path fully qualified if it is isn't.
|
Path |
FilterFileSystem.makeQualified(Path path)
Make sure that a path specifies a FileSystem.
|
Path |
AbstractFileSystem.makeQualified(Path path)
Make the path fully qualified to this file system
|
Path |
Path.makeQualified(URI defaultUri,
Path workingDir)
Returns a qualified path object.
|
static Path |
Path.mergePaths(Path path1,
Path path2)
Merge 2 paths such that the second path is appended relative to the first.
|
void |
FileContext.mkdir(Path dir,
FsPermission permission,
boolean createParent)
Make(create) a directory and all the non-existent parents.
|
abstract void |
AbstractFileSystem.mkdir(Path dir,
FsPermission permission,
boolean createParent)
The specification of this method matches that of
FileContext.mkdir(Path, FsPermission, boolean) except that the Path
f must be fully qualified and the permission is absolute (i.e. |
static boolean |
FileSystem.mkdirs(FileSystem fs,
Path dir,
FsPermission permission)
create a directory with the provided permission
The permission of the directory is set to be the provided permission as in
setPermission, not permission&~umask
|
boolean |
RawLocalFileSystem.mkdirs(Path f)
Creates the specified directory hierarchy.
|
boolean |
FileSystem.mkdirs(Path f)
Call
FileSystem.mkdirs(Path, FsPermission) with default permission. |
boolean |
ChecksumFileSystem.mkdirs(Path f) |
boolean |
RawLocalFileSystem.mkdirs(Path f,
FsPermission permission) |
abstract boolean |
FileSystem.mkdirs(Path f,
FsPermission permission)
Make the given file and all non-existent parents into
directories.
|
boolean |
FilterFileSystem.mkdirs(Path f,
FsPermission permission) |
void |
FileSystem.modifyAclEntries(Path path,
List<AclEntry> aclSpec)
Modifies ACL entries of files and directories.
|
void |
FileContext.modifyAclEntries(Path path,
List<AclEntry> aclSpec)
Modifies ACL entries of files and directories.
|
void |
FilterFileSystem.modifyAclEntries(Path path,
List<AclEntry> aclSpec) |
void |
AbstractFileSystem.modifyAclEntries(Path path,
List<AclEntry> aclSpec)
Modifies ACL entries of files and directories.
|
void |
FileSystem.moveFromLocalFile(Path[] srcs,
Path dst)
The src files is on the local disk.
|
void |
FileSystem.moveFromLocalFile(Path[] srcs,
Path dst)
The src files is on the local disk.
|
void |
RawLocalFileSystem.moveFromLocalFile(Path src,
Path dst) |
void |
FileSystem.moveFromLocalFile(Path src,
Path dst)
The src file is on the local disk.
|
static boolean |
Trash.moveToAppropriateTrash(FileSystem fs,
Path p,
Configuration conf)
In case of the symlinks or mount points, one has to move the appropriate
trashbin in the actual volume of the path p being deleted.
|
void |
FileSystem.moveToLocalFile(Path src,
Path dst)
The src file is under FS, and the dst is on the local disk.
|
boolean |
Trash.moveToTrash(Path path)
Move a file or directory to the current trash directory.
|
abstract boolean |
TrashPolicy.moveToTrash(Path path)
Move a file or directory to the current trash directory.
|
FSDataInputStream |
FileSystem.open(Path f)
Opens an FSDataInputStream at the indicated Path.
|
FSDataInputStream |
FileContext.open(Path f)
Opens an FSDataInputStream at the indicated Path using
default buffersize.
|
FSDataInputStream |
AbstractFileSystem.open(Path f)
The specification of this method matches that of
FileContext.open(Path) except that Path f must be for this
file system. |
FSDataInputStream |
RawLocalFileSystem.open(Path f,
int bufferSize) |
abstract FSDataInputStream |
FileSystem.open(Path f,
int bufferSize)
Opens an FSDataInputStream at the indicated Path.
|
FSDataInputStream |
ChecksumFileSystem.open(Path f,
int bufferSize)
Opens an FSDataInputStream at the indicated Path.
|
FSDataInputStream |
FileContext.open(Path f,
int bufferSize)
Opens an FSDataInputStream at the indicated Path.
|
FSDataInputStream |
FilterFileSystem.open(Path f,
int bufferSize)
Opens an FSDataInputStream at the indicated Path.
|
abstract FSDataInputStream |
AbstractFileSystem.open(Path f,
int bufferSize)
The specification of this method matches that of
FileContext.open(Path, int) except that Path f must be for this
file system. |
File |
RawLocalFileSystem.pathToFile(Path path)
Convert a path to a File.
|
File |
LocalFileSystem.pathToFile(Path path)
Convert a path to a File.
|
protected FSDataOutputStream |
FileSystem.primitiveCreate(Path f,
FsPermission absolutePermission,
EnumSet<CreateFlag> flag,
int bufferSize,
short replication,
long blockSize,
Progressable progress,
org.apache.hadoop.fs.Options.ChecksumOpt checksumOpt)
Deprecated.
|
protected FSDataOutputStream |
FilterFileSystem.primitiveCreate(Path f,
FsPermission absolutePermission,
EnumSet<CreateFlag> flag,
int bufferSize,
short replication,
long blockSize,
Progressable progress,
org.apache.hadoop.fs.Options.ChecksumOpt checksumOpt) |
protected boolean |
RawLocalFileSystem.primitiveMkdir(Path f,
FsPermission absolutePermission) |
protected boolean |
FileSystem.primitiveMkdir(Path f,
FsPermission absolutePermission)
Deprecated.
|
protected boolean |
FilterFileSystem.primitiveMkdir(Path f,
FsPermission abdolutePermission) |
protected void |
FileSystem.primitiveMkdir(Path f,
FsPermission absolutePermission,
boolean createParent)
Deprecated.
|
void |
FileSystem.removeAcl(Path path)
Removes all but the base ACL entries of files and directories.
|
void |
FileContext.removeAcl(Path path)
Removes all but the base ACL entries of files and directories.
|
void |
FilterFileSystem.removeAcl(Path path) |
void |
AbstractFileSystem.removeAcl(Path path)
Removes all but the base ACL entries of files and directories.
|
void |
FileSystem.removeAclEntries(Path path,
List<AclEntry> aclSpec)
Removes ACL entries from files and directories.
|
void |
FileContext.removeAclEntries(Path path,
List<AclEntry> aclSpec)
Removes ACL entries from files and directories.
|
void |
FilterFileSystem.removeAclEntries(Path path,
List<AclEntry> aclSpec) |
void |
AbstractFileSystem.removeAclEntries(Path path,
List<AclEntry> aclSpec)
Removes ACL entries from files and directories.
|
void |
FileSystem.removeDefaultAcl(Path path)
Removes all default ACL entries from files and directories.
|
void |
FileContext.removeDefaultAcl(Path path)
Removes all default ACL entries from files and directories.
|
void |
FilterFileSystem.removeDefaultAcl(Path path) |
void |
AbstractFileSystem.removeDefaultAcl(Path path)
Removes all default ACL entries from files and directories.
|
void |
FileSystem.removeXAttr(Path path,
String name)
Remove an xattr of a file or directory.
|
void |
FileContext.removeXAttr(Path path,
String name)
Remove an xattr of a file or directory.
|
void |
FilterFileSystem.removeXAttr(Path path,
String name) |
void |
AbstractFileSystem.removeXAttr(Path path,
String name)
Remove an xattr of a file or directory.
|
boolean |
RawLocalFileSystem.rename(Path src,
Path dst) |
abstract boolean |
FileSystem.rename(Path src,
Path dst)
Renames Path src to Path dst.
|
boolean |
ChecksumFileSystem.rename(Path src,
Path dst)
Rename files/dirs
|
boolean |
FilterFileSystem.rename(Path src,
Path dst)
Renames Path src to Path dst.
|
protected void |
FileSystem.rename(Path src,
Path dst,
org.apache.hadoop.fs.Options.Rename... options)
Deprecated.
|
void |
FileContext.rename(Path src,
Path dst,
org.apache.hadoop.fs.Options.Rename... options)
Renames Path src to Path dst
|
void |
AbstractFileSystem.rename(Path src,
Path dst,
org.apache.hadoop.fs.Options.Rename... options)
The specification of this method matches that of
FileContext.rename(Path, Path, Options.Rename...) except that Path
f must be for this file system. |
abstract void |
AbstractFileSystem.renameInternal(Path src,
Path dst)
The specification of this method matches that of
FileContext.rename(Path, Path, Options.Rename...) except that Path
f must be for this file system and NO OVERWRITE is performed. |
void |
AbstractFileSystem.renameInternal(Path src,
Path dst,
boolean overwrite)
The specification of this method matches that of
FileContext.rename(Path, Path, Options.Rename...) except that Path
f must be for this file system. |
void |
FileSystem.renameSnapshot(Path path,
String snapshotOldName,
String snapshotNewName)
Rename a snapshot
|
void |
FilterFileSystem.renameSnapshot(Path path,
String snapshotOldName,
String snapshotNewName) |
boolean |
LocalFileSystem.reportChecksumFailure(Path p,
FSDataInputStream in,
long inPos,
FSDataInputStream sums,
long sumsPos)
Moves files to a bad file directory on the same device, so that their
storage will not be reused.
|
boolean |
ChecksumFileSystem.reportChecksumFailure(Path f,
FSDataInputStream in,
long inPos,
FSDataInputStream sums,
long sumsPos)
Report a checksum error to the file system.
|
protected Path |
FileContext.resolve(Path f)
Resolves all symbolic links in the specified path.
|
protected Path |
FileContext.resolveIntermediate(Path f)
Resolves all symbolic links in the specified path leading up
to, but not including the final path component.
|
protected Path |
FileSystem.resolveLink(Path f)
|
protected Path |
FilterFileSystem.resolveLink(Path f) |
Path |
FileSystem.resolvePath(Path p)
Return the fully-qualified path of path f resolving the path
through any symlinks or mount point
|
Path |
FileContext.resolvePath(Path f)
Resolve the path following any symlinks or mount points
|
Path |
FilterFileSystem.resolvePath(Path p) |
Path |
AbstractFileSystem.resolvePath(Path p)
Return the fully-qualified path of path f resolving the path
through any internal symlinks or mount point
|
void |
FileSystem.setAcl(Path path,
List<AclEntry> aclSpec)
Fully replaces ACL of files and directories, discarding all existing
entries.
|
void |
FileContext.setAcl(Path path,
List<AclEntry> aclSpec)
Fully replaces ACL of files and directories, discarding all existing
entries.
|
void |
FilterFileSystem.setAcl(Path path,
List<AclEntry> aclSpec) |
void |
AbstractFileSystem.setAcl(Path path,
List<AclEntry> aclSpec)
Fully replaces ACL of files and directories, discarding all existing
entries.
|
void |
RawLocalFileSystem.setOwner(Path p,
String username,
String groupname)
Use the command chown to set owner.
|
void |
FileSystem.setOwner(Path p,
String username,
String groupname)
Set owner of a path (i.e.
|
void |
FileContext.setOwner(Path f,
String username,
String groupname)
Set owner of a path (i.e.
|
void |
FilterFileSystem.setOwner(Path p,
String username,
String groupname) |
abstract void |
AbstractFileSystem.setOwner(Path f,
String username,
String groupname)
The specification of this method matches that of
FileContext.setOwner(Path, String, String) except that Path f must
be for this file system. |
void |
FileStatus.setPath(Path p) |
void |
RawLocalFileSystem.setPermission(Path p,
FsPermission permission)
Use the command chmod to set permission.
|
void |
FileSystem.setPermission(Path p,
FsPermission permission)
Set permission of a path.
|
void |
FileContext.setPermission(Path f,
FsPermission permission)
Set permission of a path.
|
void |
FilterFileSystem.setPermission(Path p,
FsPermission permission) |
abstract void |
AbstractFileSystem.setPermission(Path f,
FsPermission permission)
The specification of this method matches that of
FileContext.setPermission(Path, FsPermission) except that Path f
must be for this file system. |
boolean |
FileSystem.setReplication(Path src,
short replication)
Set replication for an existing file.
|
boolean |
ChecksumFileSystem.setReplication(Path src,
short replication)
Set replication for an existing file.
|
boolean |
FileContext.setReplication(Path f,
short replication)
Set replication for an existing file.
|
boolean |
FilterFileSystem.setReplication(Path src,
short replication)
Set replication for an existing file.
|
abstract boolean |
AbstractFileSystem.setReplication(Path f,
short replication)
The specification of this method matches that of
FileContext.setReplication(Path, short) except that Path f must be
for this file system. |
void |
FileStatus.setSymlink(Path p) |
void |
RawLocalFileSystem.setTimes(Path p,
long mtime,
long atime)
Sets the
Path's last modified time only to the given
valid time. |
void |
FileSystem.setTimes(Path p,
long mtime,
long atime)
Set access time of a file
|
void |
FileContext.setTimes(Path f,
long mtime,
long atime)
Set access time of a file.
|
void |
FilterFileSystem.setTimes(Path p,
long mtime,
long atime) |
abstract void |
AbstractFileSystem.setTimes(Path f,
long mtime,
long atime)
The specification of this method matches that of
FileContext.setTimes(Path, long, long) except that Path f must be
for this file system. |
void |
FileContext.setVerifyChecksum(boolean verifyChecksum,
Path f)
Set the verify checksum flag for the file system denoted by the path.
|
void |
RawLocalFileSystem.setWorkingDirectory(Path newDir)
Set the working directory to the given directory.
|
abstract void |
FileSystem.setWorkingDirectory(Path new_dir)
Set the current working directory for the given file system.
|
void |
FileContext.setWorkingDirectory(Path newWDir)
Set the working directory for wd-relative names (such a "foo/bar").
|
void |
FilterFileSystem.setWorkingDirectory(Path newDir)
Set the current working directory for the given file system.
|
void |
FileSystem.setXAttr(Path path,
String name,
byte[] value)
Set an xattr of a file or directory.
|
void |
FileContext.setXAttr(Path path,
String name,
byte[] value)
Set an xattr of a file or directory.
|
void |
FilterFileSystem.setXAttr(Path path,
String name,
byte[] value) |
void |
AbstractFileSystem.setXAttr(Path path,
String name,
byte[] value)
Set an xattr of a file or directory.
|
void |
FileSystem.setXAttr(Path path,
String name,
byte[] value,
EnumSet<XAttrSetFlag> flag)
Set an xattr of a file or directory.
|
void |
FileContext.setXAttr(Path path,
String name,
byte[] value,
EnumSet<XAttrSetFlag> flag)
Set an xattr of a file or directory.
|
void |
FilterFileSystem.setXAttr(Path path,
String name,
byte[] value,
EnumSet<XAttrSetFlag> flag) |
void |
AbstractFileSystem.setXAttr(Path path,
String name,
byte[] value,
EnumSet<XAttrSetFlag> flag)
Set an xattr of a file or directory.
|
Path |
RawLocalFileSystem.startLocalOutput(Path fsOutputFile,
Path tmpLocalFile) |
Path |
FileSystem.startLocalOutput(Path fsOutputFile,
Path tmpLocalFile)
Returns a local File that the user can write output to.
|
Path |
ChecksumFileSystem.startLocalOutput(Path fsOutputFile,
Path tmpLocalFile) |
Path |
FilterFileSystem.startLocalOutput(Path fsOutputFile,
Path tmpLocalFile)
Returns a local File that the user can write output to.
|
static Path[] |
FileUtil.stat2Paths(FileStatus[] stats,
Path path)
convert an array of FileStatus to an array of Path.
|
| Constructor and Description |
|---|
AvroFSInput(FileContext fc,
Path p)
Construct given a
FileContext and a Path. |
FileStatus(long length,
boolean isdir,
int block_replication,
long blocksize,
long modification_time,
long access_time,
FsPermission permission,
String owner,
String group,
Path path)
Constructor for file systems on which symbolic links are not supported
|
FileStatus(long length,
boolean isdir,
int block_replication,
long blocksize,
long modification_time,
long access_time,
FsPermission permission,
String owner,
String group,
Path symlink,
Path path) |
FileStatus(long length,
boolean isdir,
int block_replication,
long blocksize,
long modification_time,
Path path) |
LocatedFileStatus(long length,
boolean isdir,
int block_replication,
long blocksize,
long modification_time,
long access_time,
FsPermission permission,
String owner,
String group,
Path symlink,
Path path,
BlockLocation[] locations)
Constructor
|
Path(Path parent,
Path child)
Resolve a child path against a parent path.
|
Path(Path parent,
String child)
Resolve a child path against a parent path.
|
Path(String parent,
Path child)
Resolve a child path against a parent path.
|
| Modifier and Type | Method and Description |
|---|---|
Path |
FTPFileSystem.getHomeDirectory() |
Path |
FTPFileSystem.getWorkingDirectory() |
| Modifier and Type | Method and Description |
|---|---|
FSDataOutputStream |
FTPFileSystem.append(Path f,
int bufferSize,
Progressable progress)
This optional operation is not yet supported.
|
FSDataOutputStream |
FTPFileSystem.create(Path file,
FsPermission permission,
boolean overwrite,
int bufferSize,
short replication,
long blockSize,
Progressable progress)
A stream obtained via this call must be closed before using other APIs of
this class or else the invocation will block.
|
boolean |
FTPFileSystem.delete(Path file,
boolean recursive) |
FileStatus |
FTPFileSystem.getFileStatus(Path file) |
FileStatus[] |
FTPFileSystem.listStatus(Path file) |
boolean |
FTPFileSystem.mkdirs(Path file,
FsPermission permission) |
FSDataInputStream |
FTPFileSystem.open(Path file,
int bufferSize) |
boolean |
FTPFileSystem.rename(Path src,
Path dst) |
void |
FTPFileSystem.setWorkingDirectory(Path newDir) |
| Modifier and Type | Method and Description |
|---|---|
Path |
S3FileSystem.getWorkingDirectory() |
| Modifier and Type | Method and Description |
|---|---|
FSDataOutputStream |
S3FileSystem.append(Path f,
int bufferSize,
Progressable progress)
This optional operation is not yet supported.
|
FSDataOutputStream |
S3FileSystem.create(Path file,
FsPermission permission,
boolean overwrite,
int bufferSize,
short replication,
long blockSize,
Progressable progress) |
boolean |
S3FileSystem.delete(Path path,
boolean recursive) |
FileStatus |
S3FileSystem.getFileStatus(Path f)
FileStatus for S3 file systems.
|
boolean |
S3FileSystem.isFile(Path path) |
FileStatus[] |
S3FileSystem.listStatus(Path f) |
boolean |
S3FileSystem.mkdirs(Path path,
FsPermission permission) |
FSDataInputStream |
S3FileSystem.open(Path path,
int bufferSize) |
boolean |
S3FileSystem.rename(Path src,
Path dst) |
void |
S3FileSystem.setWorkingDirectory(Path dir) |
| Modifier and Type | Method and Description |
|---|---|
Path |
NativeS3FileSystem.getWorkingDirectory() |
| Modifier and Type | Method and Description |
|---|---|
FSDataOutputStream |
NativeS3FileSystem.append(Path f,
int bufferSize,
Progressable progress)
This optional operation is not yet supported.
|
FSDataOutputStream |
NativeS3FileSystem.create(Path f,
FsPermission permission,
boolean overwrite,
int bufferSize,
short replication,
long blockSize,
Progressable progress) |
boolean |
NativeS3FileSystem.delete(Path f,
boolean recurse) |
FileStatus |
NativeS3FileSystem.getFileStatus(Path f) |
FileStatus[] |
NativeS3FileSystem.listStatus(Path f)
If
f is a file, this method will make a single call to S3. |
boolean |
NativeS3FileSystem.mkdirs(Path f,
FsPermission permission) |
FSDataInputStream |
NativeS3FileSystem.open(Path f,
int bufferSize) |
boolean |
NativeS3FileSystem.rename(Path src,
Path dst) |
void |
NativeS3FileSystem.setWorkingDirectory(Path newDir)
Set the working directory to the given directory.
|
| Modifier and Type | Method and Description |
|---|---|
Path |
ViewFileSystem.getHomeDirectory() |
Path |
ViewFs.getHomeDirectory() |
Path |
ViewFs.getLinkTarget(Path f) |
Path |
ViewFileSystem.getTrashCanLocation(Path f) |
Path |
ViewFileSystem.getWorkingDirectory() |
Path |
ViewFileSystem.resolvePath(Path f) |
Path |
ViewFs.resolvePath(Path f) |
| Modifier and Type | Method and Description |
|---|---|
void |
ViewFileSystem.access(Path path,
FsAction mode) |
void |
ViewFs.access(Path path,
FsAction mode) |
FSDataOutputStream |
ViewFileSystem.append(Path f,
int bufferSize,
Progressable progress) |
FSDataOutputStream |
ViewFileSystem.create(Path f,
FsPermission permission,
boolean overwrite,
int bufferSize,
short replication,
long blockSize,
Progressable progress) |
FSDataOutputStream |
ViewFs.createInternal(Path f,
EnumSet<CreateFlag> flag,
FsPermission absolutePermission,
int bufferSize,
short replication,
long blockSize,
Progressable progress,
org.apache.hadoop.fs.Options.ChecksumOpt checksumOpt,
boolean createParent) |
FSDataOutputStream |
ViewFileSystem.createNonRecursive(Path f,
FsPermission permission,
EnumSet<CreateFlag> flags,
int bufferSize,
short replication,
long blockSize,
Progressable progress) |
void |
ViewFs.createSymlink(Path target,
Path link,
boolean createParent) |
boolean |
ViewFileSystem.delete(Path f) |
boolean |
ViewFileSystem.delete(Path f,
boolean recursive) |
boolean |
ViewFs.delete(Path f,
boolean recursive) |
AclStatus |
ViewFileSystem.getAclStatus(Path path) |
AclStatus |
ViewFs.getAclStatus(Path path) |
ContentSummary |
ViewFileSystem.getContentSummary(Path f) |
long |
ViewFileSystem.getDefaultBlockSize(Path f) |
short |
ViewFileSystem.getDefaultReplication(Path f) |
BlockLocation[] |
ViewFs.getFileBlockLocations(Path f,
long start,
long len) |
FileChecksum |
ViewFileSystem.getFileChecksum(Path f) |
FileChecksum |
ViewFs.getFileChecksum(Path f) |
FileStatus |
ViewFs.getFileLinkStatus(Path f) |
FileStatus |
ViewFileSystem.getFileStatus(Path f) |
FileStatus |
ViewFs.getFileStatus(Path f) |
Path |
ViewFs.getLinkTarget(Path f) |
FsServerDefaults |
ViewFileSystem.getServerDefaults(Path f) |
Path |
ViewFileSystem.getTrashCanLocation(Path f) |
byte[] |
ViewFileSystem.getXAttr(Path path,
String name) |
byte[] |
ViewFs.getXAttr(Path path,
String name) |
Map<String,byte[]> |
ViewFileSystem.getXAttrs(Path path) |
Map<String,byte[]> |
ViewFs.getXAttrs(Path path) |
Map<String,byte[]> |
ViewFileSystem.getXAttrs(Path path,
List<String> names) |
Map<String,byte[]> |
ViewFs.getXAttrs(Path path,
List<String> names) |
org.apache.hadoop.fs.RemoteIterator<LocatedFileStatus> |
ViewFileSystem.listLocatedStatus(Path f,
PathFilter filter) |
FileStatus[] |
ViewFileSystem.listStatus(Path f) |
FileStatus[] |
ViewFs.listStatus(Path f) |
org.apache.hadoop.fs.RemoteIterator<FileStatus> |
ViewFs.listStatusIterator(Path f) |
List<String> |
ViewFileSystem.listXAttrs(Path path) |
List<String> |
ViewFs.listXAttrs(Path path) |
void |
ViewFs.mkdir(Path dir,
FsPermission permission,
boolean createParent) |
boolean |
ViewFileSystem.mkdirs(Path dir,
FsPermission permission) |
void |
ViewFileSystem.modifyAclEntries(Path path,
List<AclEntry> aclSpec) |
void |
ViewFs.modifyAclEntries(Path path,
List<AclEntry> aclSpec) |
FSDataInputStream |
ViewFileSystem.open(Path f,
int bufferSize) |
FSDataInputStream |
ViewFs.open(Path f,
int bufferSize) |
void |
ViewFileSystem.removeAcl(Path path) |
void |
ViewFs.removeAcl(Path path) |
void |
ViewFileSystem.removeAclEntries(Path path,
List<AclEntry> aclSpec) |
void |
ViewFs.removeAclEntries(Path path,
List<AclEntry> aclSpec) |
void |
ViewFileSystem.removeDefaultAcl(Path path) |
void |
ViewFs.removeDefaultAcl(Path path) |
void |
ViewFileSystem.removeXAttr(Path path,
String name) |
void |
ViewFs.removeXAttr(Path path,
String name) |
boolean |
ViewFileSystem.rename(Path src,
Path dst) |
void |
ViewFs.renameInternal(Path src,
Path dst) |
void |
ViewFs.renameInternal(Path src,
Path dst,
boolean overwrite) |
Path |
ViewFileSystem.resolvePath(Path f) |
Path |
ViewFs.resolvePath(Path f) |
void |
ViewFileSystem.setAcl(Path path,
List<AclEntry> aclSpec) |
void |
ViewFs.setAcl(Path path,
List<AclEntry> aclSpec) |
void |
ViewFileSystem.setOwner(Path f,
String username,
String groupname) |
void |
ViewFs.setOwner(Path f,
String username,
String groupname) |
void |
ViewFileSystem.setPermission(Path f,
FsPermission permission) |
void |
ViewFs.setPermission(Path f,
FsPermission permission) |
boolean |
ViewFileSystem.setReplication(Path f,
short replication) |
boolean |
ViewFs.setReplication(Path f,
short replication) |
void |
ViewFileSystem.setTimes(Path f,
long mtime,
long atime) |
void |
ViewFs.setTimes(Path f,
long mtime,
long atime) |
void |
ViewFileSystem.setWorkingDirectory(Path new_dir) |
void |
ViewFileSystem.setXAttr(Path path,
String name,
byte[] value,
EnumSet<XAttrSetFlag> flag) |
void |
ViewFs.setXAttr(Path path,
String name,
byte[] value,
EnumSet<XAttrSetFlag> flag) |
| Constructor and Description |
|---|
NotInMountpointException(Path path,
String operation) |
| Modifier and Type | Method and Description |
|---|---|
static org.apache.hadoop.io.SequenceFile.Writer |
SequenceFile.createWriter(FileContext fc,
Configuration conf,
Path name,
Class keyClass,
Class valClass,
org.apache.hadoop.io.SequenceFile.CompressionType compressionType,
CompressionCodec codec,
org.apache.hadoop.io.SequenceFile.Metadata metadata,
EnumSet<CreateFlag> createFlag,
org.apache.hadoop.fs.Options.CreateOpts... opts)
Construct the preferred type of SequenceFile Writer.
|
static org.apache.hadoop.io.SequenceFile.Writer |
SequenceFile.createWriter(FileSystem fs,
Configuration conf,
Path name,
Class keyClass,
Class valClass)
Deprecated.
|
static org.apache.hadoop.io.SequenceFile.Writer |
SequenceFile.createWriter(FileSystem fs,
Configuration conf,
Path name,
Class keyClass,
Class valClass,
int bufferSize,
short replication,
long blockSize,
boolean createParent,
org.apache.hadoop.io.SequenceFile.CompressionType compressionType,
CompressionCodec codec,
org.apache.hadoop.io.SequenceFile.Metadata metadata)
Deprecated.
|
static org.apache.hadoop.io.SequenceFile.Writer |
SequenceFile.createWriter(FileSystem fs,
Configuration conf,
Path name,
Class keyClass,
Class valClass,
int bufferSize,
short replication,
long blockSize,
org.apache.hadoop.io.SequenceFile.CompressionType compressionType,
CompressionCodec codec,
Progressable progress,
org.apache.hadoop.io.SequenceFile.Metadata metadata)
Deprecated.
|
static org.apache.hadoop.io.SequenceFile.Writer |
SequenceFile.createWriter(FileSystem fs,
Configuration conf,
Path name,
Class keyClass,
Class valClass,
org.apache.hadoop.io.SequenceFile.CompressionType compressionType)
Deprecated.
|
static org.apache.hadoop.io.SequenceFile.Writer |
SequenceFile.createWriter(FileSystem fs,
Configuration conf,
Path name,
Class keyClass,
Class valClass,
org.apache.hadoop.io.SequenceFile.CompressionType compressionType,
CompressionCodec codec)
Deprecated.
|
static org.apache.hadoop.io.SequenceFile.Writer |
SequenceFile.createWriter(FileSystem fs,
Configuration conf,
Path name,
Class keyClass,
Class valClass,
org.apache.hadoop.io.SequenceFile.CompressionType compressionType,
CompressionCodec codec,
Progressable progress)
Deprecated.
|
static org.apache.hadoop.io.SequenceFile.Writer |
SequenceFile.createWriter(FileSystem fs,
Configuration conf,
Path name,
Class keyClass,
Class valClass,
org.apache.hadoop.io.SequenceFile.CompressionType compressionType,
CompressionCodec codec,
Progressable progress,
org.apache.hadoop.io.SequenceFile.Metadata metadata)
Deprecated.
|
static org.apache.hadoop.io.SequenceFile.Writer |
SequenceFile.createWriter(FileSystem fs,
Configuration conf,
Path name,
Class keyClass,
Class valClass,
org.apache.hadoop.io.SequenceFile.CompressionType compressionType,
Progressable progress)
Deprecated.
|
static long |
MapFile.fix(FileSystem fs,
Path dir,
Class<? extends Writable> keyClass,
Class<? extends Writable> valueClass,
boolean dryrun,
Configuration conf)
This method attempts to fix a corrupt MapFile by re-creating its index.
|
| Modifier and Type | Method and Description |
|---|---|
CompressionCodec |
CompressionCodecFactory.getCodec(Path file)
Find the relevant compression codec for the given file based on its
filename suffix.
|
| Modifier and Type | Method and Description |
|---|---|
static Path[] |
FileInputFormat.getInputPaths(JobConf conf)
Get the list of input
Paths for the map-reduce job. |
Path |
JobConf.getLocalPath(String pathString)
Constructs a local file name.
|
static Path |
FileOutputFormat.getOutputPath(JobConf conf)
Get the
Path to the output directory for the map-reduce job. |
Path |
FileSplit.getPath()
The file containing this split's data.
|
static Path |
FileOutputFormat.getPathForCustomFile(JobConf conf,
String name)
Helper function to generate a
Path for a file that is unique for
the task within the job output directory. |
static Path |
SkipBadRecords.getSkipOutputPath(Configuration conf)
Get the directory to which skipped records are written.
|
Path |
JobClient.getStagingAreaDir()
Fetch the staging area directory for the application
|
Path |
JobClient.getSystemDir()
Grab the jobtracker system directory path where job-specific files are to be placed.
|
Path |
FileOutputCommitter.getTaskAttemptPath(TaskAttemptContext context) |
static Path |
FileOutputFormat.getTaskOutputPath(JobConf conf,
String name)
Helper function to create the task's temporary output directory and
return the path to the task's output file.
|
Path |
JobConf.getWorkingDirectory()
Get the current working directory for the default file system.
|
static Path |
FileOutputFormat.getWorkOutputPath(JobConf conf)
Get the
Path to the task's temporary output directory
for the map-reduce job
Tasks' Side-Effect Files |
Path |
FileOutputCommitter.getWorkPath(TaskAttemptContext context,
Path outputPath) |
| Modifier and Type | Method and Description |
|---|---|
boolean |
OutputLogFilter.accept(Path path) |
static void |
FileInputFormat.addInputPath(JobConf conf,
Path path)
Add a
Path to the list of inputs for the map-reduce job. |
protected void |
FileInputFormat.addInputPathRecursively(List<FileStatus> result,
FileSystem fs,
Path path,
PathFilter inputFilter)
Add files in the input path recursively into the results.
|
static org.apache.hadoop.io.SequenceFile.Reader[] |
SequenceFileOutputFormat.getReaders(Configuration conf,
Path dir)
Open the output generated by this format.
|
static org.apache.hadoop.io.MapFile.Reader[] |
MapFileOutputFormat.getReaders(FileSystem ignored,
Path dir,
Configuration conf)
Open the output generated by this format.
|
Path |
FileOutputCommitter.getWorkPath(TaskAttemptContext context,
Path outputPath) |
static boolean |
JobClient.isJobDirValid(Path jobDirPath,
FileSystem fs)
Checks if the job directory is clean and has all the required components
for (re) starting the job
|
protected boolean |
FixedLengthInputFormat.isSplitable(FileSystem fs,
Path file) |
protected boolean |
TextInputFormat.isSplitable(FileSystem fs,
Path file) |
protected boolean |
KeyValueTextInputFormat.isSplitable(FileSystem fs,
Path file) |
protected boolean |
FileInputFormat.isSplitable(FileSystem fs,
Path filename)
Is the given filename splitable? Usually, true, but if the file is
stream compressed, it will not be.
|
protected FileSplit |
FileInputFormat.makeSplit(Path file,
long start,
long length,
String[] hosts)
A factory that makes the split for this class.
|
protected FileSplit |
FileInputFormat.makeSplit(Path file,
long start,
long length,
String[] hosts,
String[] inMemoryHosts)
A factory that makes the split for this class.
|
static void |
FileInputFormat.setInputPaths(JobConf conf,
Path... inputPaths)
Set the array of
Paths as the list of inputs
for the map-reduce job. |
static void |
FileOutputFormat.setOutputPath(JobConf conf,
Path outputDir)
Set the
Path of the output directory for the map-reduce job. |
static void |
SkipBadRecords.setSkipOutputPath(JobConf conf,
Path path)
Set the directory to which skipped records are written.
|
void |
JobConf.setWorkingDirectory(Path dir)
Set the current working directory for the default file system.
|
static void |
FileOutputFormat.setWorkOutputPath(JobConf conf,
Path outputDir)
Set the
Path of the task's temporary output directory
for the map-reduce job. |
| Constructor and Description |
|---|
FileSplit(Path file,
long start,
long length,
JobConf conf)
Deprecated.
|
FileSplit(Path file,
long start,
long length,
String[] hosts)
Constructs a split with host information
|
FileSplit(Path file,
long start,
long length,
String[] hosts,
String[] inMemoryHosts)
Constructs a split with host information
|
JobConf(Path config)
Construct a map/reduce configuration.
|
MultiFileSplit(JobConf job,
Path[] files,
long[] lengths) |
| Modifier and Type | Method and Description |
|---|---|
static String |
CompositeInputFormat.compose(String op,
Class<? extends InputFormat> inf,
Path... path)
Convenience method for constructing composite formats.
|
| Modifier and Type | Method and Description |
|---|---|
static void |
MultipleInputs.addInputPath(JobConf conf,
Path path,
Class<? extends InputFormat> inputFormatClass)
Add a
Path with a custom InputFormat to the list of
inputs for the map-reduce job. |
static void |
MultipleInputs.addInputPath(JobConf conf,
Path path,
Class<? extends InputFormat> inputFormatClass,
Class<? extends Mapper> mapperClass)
|
protected static FileSplit |
NLineInputFormat.createFileSplit(Path fileName,
long begin,
long length)
NLineInputFormat uses LineRecordReader, which always reads
(and consumes) at least one character out of its upper split
boundary.
|
protected boolean |
CombineFileInputFormat.isSplitable(FileSystem fs,
Path file) |
protected boolean |
CombineFileInputFormat.isSplitable(JobContext context,
Path file)
Subclasses should avoid overriding this method and should instead only
override
CombineFileInputFormat.isSplitable(FileSystem, Path). |
static void |
TotalOrderPartitioner.setPartitionFile(JobConf job,
Path p)
Deprecated.
|
| Constructor and Description |
|---|
CombineFileSplit(JobConf job,
Path[] files,
long[] lengths) |
CombineFileSplit(JobConf job,
Path[] files,
long[] start,
long[] lengths,
String[] locations) |
| Modifier and Type | Method and Description |
|---|---|
Path[] |
JobContext.getArchiveClassPaths()
Get the archive entries in classpath as an array of Path
|
Path[] |
JobContext.getFileClassPaths()
Get the file entries in classpath as an array of Path
|
Path[] |
JobContext.getLocalCacheArchives()
Deprecated.
the array returned only includes the items the were
downloaded. There is no way to map this to what is returned by
JobContext.getCacheArchives(). |
Path[] |
JobContext.getLocalCacheFiles()
Deprecated.
the array returned only includes the items the were
downloaded. There is no way to map this to what is returned by
JobContext.getCacheFiles(). |
Path |
Cluster.getStagingAreaDir()
Grab the jobtracker's view of the staging directory path where
job-specific files will be placed.
|
Path |
Cluster.getSystemDir()
Grab the jobtracker system directory path where
job-specific files will be placed.
|
Path |
JobContext.getWorkingDirectory()
Get the current working directory for the default file system.
|
| Modifier and Type | Method and Description |
|---|---|
void |
Job.addArchiveToClassPath(Path archive)
Add an archive path to the current set of classpath entries.
|
void |
Job.addFileToClassPath(Path file)
Add an file path to the current set of classpath entries It adds the file
to cache as well.
|
void |
Job.setWorkingDirectory(Path dir)
Set the current working directory for the default file system.
|
| Modifier and Type | Method and Description |
|---|---|
static Path[] |
FileInputFormat.getInputPaths(JobContext context)
Get the list of input
Paths for the map-reduce job. |
Path |
FileSplit.getPath()
The file containing this split's data.
|
Path |
CombineFileSplit.getPath(int i)
Returns the ith Path
|
Path[] |
CombineFileSplit.getPaths()
Returns all the Paths in the split
|
| Modifier and Type | Method and Description |
|---|---|
static void |
FileInputFormat.addInputPath(Job job,
Path path)
Add a
Path to the list of inputs for the map-reduce job. |
static void |
MultipleInputs.addInputPath(Job job,
Path path,
Class<? extends InputFormat> inputFormatClass)
Add a
Path with a custom InputFormat to the list of
inputs for the map-reduce job. |
static void |
MultipleInputs.addInputPath(Job job,
Path path,
Class<? extends InputFormat> inputFormatClass,
Class<? extends Mapper> mapperClass)
|
protected void |
FileInputFormat.addInputPathRecursively(List<FileStatus> result,
FileSystem fs,
Path path,
PathFilter inputFilter)
Add files in the input path recursively into the results.
|
protected static FileSplit |
NLineInputFormat.createFileSplit(Path fileName,
long begin,
long length)
NLineInputFormat uses LineRecordReader, which always reads
(and consumes) at least one character out of its upper split
boundary.
|
protected boolean |
FixedLengthInputFormat.isSplitable(JobContext context,
Path file) |
protected boolean |
CombineFileInputFormat.isSplitable(JobContext context,
Path file) |
protected boolean |
TextInputFormat.isSplitable(JobContext context,
Path file) |
protected boolean |
KeyValueTextInputFormat.isSplitable(JobContext context,
Path file) |
protected boolean |
FileInputFormat.isSplitable(JobContext context,
Path filename)
Is the given filename splitable? Usually, true, but if the file is
stream compressed, it will not be.
|
protected FileSplit |
FileInputFormat.makeSplit(Path file,
long start,
long length,
String[] hosts)
A factory that makes the split for this class.
|
protected FileSplit |
FileInputFormat.makeSplit(Path file,
long start,
long length,
String[] hosts,
String[] inMemoryHosts)
A factory that makes the split for this class.
|
static void |
FileInputFormat.setInputPaths(Job job,
Path... inputPaths)
Set the array of
Paths as the list of inputs
for the map-reduce job. |
| Constructor and Description |
|---|
CombineFileSplit(Path[] files,
long[] lengths) |
CombineFileSplit(Path[] files,
long[] start,
long[] lengths,
String[] locations) |
FileSplit(Path file,
long start,
long length,
String[] hosts)
Constructs a split with host information
|
FileSplit(Path file,
long start,
long length,
String[] hosts,
String[] inMemoryHosts)
Constructs a split with host and cached-blocks information
|
| Modifier and Type | Method and Description |
|---|---|
static String |
CompositeInputFormat.compose(String op,
Class<? extends InputFormat> inf,
Path... path)
Convenience method for constructing composite formats.
|
| Modifier and Type | Method and Description |
|---|---|
Path |
PartialFileOutputCommitter.getCommittedTaskPath(int appAttemptId,
TaskAttemptContext context) |
protected Path |
FileOutputCommitter.getCommittedTaskPath(int appAttemptId,
TaskAttemptContext context)
Compute the path where the output of a committed task is stored until the
entire job is committed for a specific application attempt.
|
Path |
FileOutputCommitter.getCommittedTaskPath(TaskAttemptContext context)
Compute the path where the output of a committed task is stored until
the entire job is committed.
|
static Path |
FileOutputCommitter.getCommittedTaskPath(TaskAttemptContext context,
Path out) |
Path |
FileOutputFormat.getDefaultWorkFile(TaskAttemptContext context,
String extension)
Get the default path and filename for the output format.
|
protected Path |
FileOutputCommitter.getJobAttemptPath(int appAttemptId)
Compute the path where the output of a given job attempt will be placed.
|
Path |
FileOutputCommitter.getJobAttemptPath(JobContext context)
Compute the path where the output of a given job attempt will be placed.
|
static Path |
FileOutputCommitter.getJobAttemptPath(JobContext context,
Path out)
Compute the path where the output of a given job attempt will be placed.
|
static Path |
FileOutputFormat.getOutputPath(JobContext job)
Get the
Path to the output directory for the map-reduce job. |
static Path |
FileOutputFormat.getPathForWorkFile(TaskInputOutputContext<?,?,?,?> context,
String name,
String extension)
Helper function to generate a
Path for a file that is unique for
the task within the job output directory. |
Path |
FileOutputCommitter.getTaskAttemptPath(TaskAttemptContext context)
Compute the path where the output of a task attempt is stored until
that task is committed.
|
static Path |
FileOutputCommitter.getTaskAttemptPath(TaskAttemptContext context,
Path out)
Compute the path where the output of a task attempt is stored until
that task is committed.
|
static Path |
FileOutputFormat.getWorkOutputPath(TaskInputOutputContext<?,?,?,?> context)
Get the
Path to the task's temporary output directory
for the map-reduce job
Tasks' Side-Effect Files |
Path |
FileOutputCommitter.getWorkPath()
Get the directory that the task should write results into.
|
| Modifier and Type | Method and Description |
|---|---|
void |
FileOutputCommitter.abortTask(TaskAttemptContext context,
Path taskAttemptPath) |
void |
FileOutputCommitter.commitTask(TaskAttemptContext context,
Path taskAttemptPath) |
static Path |
FileOutputCommitter.getCommittedTaskPath(TaskAttemptContext context,
Path out) |
static Path |
FileOutputCommitter.getJobAttemptPath(JobContext context,
Path out)
Compute the path where the output of a given job attempt will be placed.
|
static org.apache.hadoop.io.MapFile.Reader[] |
MapFileOutputFormat.getReaders(Path dir,
Configuration conf)
Open the output generated by this format.
|
static Path |
FileOutputCommitter.getTaskAttemptPath(TaskAttemptContext context,
Path out)
Compute the path where the output of a task attempt is stored until
that task is committed.
|
boolean |
FileOutputCommitter.needsTaskCommit(TaskAttemptContext context,
Path taskAttemptPath) |
static void |
FileOutputFormat.setOutputPath(Job job,
Path outputDir)
Set the
Path of the output directory for the map-reduce job. |
| Constructor and Description |
|---|
FileOutputCommitter(Path outputPath,
JobContext context)
Create a file output committer
|
FileOutputCommitter(Path outputPath,
TaskAttemptContext context)
Create a file output committer
|
PartialFileOutputCommitter(Path outputPath,
JobContext context) |
PartialFileOutputCommitter(Path outputPath,
TaskAttemptContext context) |
| Modifier and Type | Method and Description |
|---|---|
static void |
TotalOrderPartitioner.setPartitionFile(Configuration conf,
Path p)
Set the path to the SequenceFile storing the sorted partition keyset.
|
| Modifier and Type | Method and Description |
|---|---|
static void |
TokenCache.obtainTokensForNamenodes(org.apache.hadoop.security.Credentials credentials,
Path[] ps,
Configuration conf)
Convenience method to obtain delegation tokens from namenodes
corresponding to the paths passed.
|
| Modifier and Type | Method and Description |
|---|---|
protected List<FileStatus> |
HistoryFileManager.scanDirectoryForHistoryFiles(Path path,
FileContext fc) |
| Constructor and Description |
|---|
AggregatedLogFormat.LogReader(Configuration conf,
Path remoteAppLogFile) |
Copyright © 2015 Apache Software Foundation. All Rights Reserved.