| Modifier and Type | Method and Description |
|---|---|
Path |
Configuration.getLocalPath(String dirsProp,
String path)
Get a local file under a directory named by dirsProp with
the given path.
|
| Modifier and Type | Method and Description |
|---|---|
void |
Configuration.addResource(Path file)
Add a configuration resource.
|
void |
Configuration.addResource(Path file,
boolean restrictedParser) |
| Modifier and Type | Field and Description |
|---|---|
protected Path |
TrashPolicy.trash |
| Modifier and Type | Method and Description |
|---|---|
Path |
FileSystem.createSnapshot(Path path)
Create a snapshot with a default name.
|
Path |
FileContext.createSnapshot(Path path)
Create a snapshot with a default name.
|
Path |
FileSystem.createSnapshot(Path path,
String snapshotName)
Create a snapshot.
|
Path |
FileContext.createSnapshot(Path path,
String snapshotName)
Create a snapshot.
|
Path |
FilterFileSystem.createSnapshot(Path path,
String snapshotName) |
Path |
AbstractFileSystem.createSnapshot(Path path,
String snapshotName)
The specification of this method matches that of
FileContext.createSnapshot(Path, String). |
protected Path |
FileSystem.fixRelativePart(Path p)
|
Path |
ChecksumFileSystem.getChecksumFile(Path file)
Return the name of the checksum file associated with a file.
|
abstract Path |
TrashPolicy.getCurrentTrashDir()
Get the current working directory of the Trash Policy
This API does not work with files deleted from encryption zone when HDFS
data encryption at rest feature is enabled as rename file between
encryption zones or encryption zone and non-encryption zone is not allowed.
|
Path |
Trash.getCurrentTrashDir(Path path) |
Path |
TrashPolicy.getCurrentTrashDir(Path path)
Get the current trash directory for path specified based on the Trash
Policy
|
Path |
FileSystem.getHomeDirectory()
Return the current user's home directory in this FileSystem.
|
Path |
FileContext.getHomeDirectory()
Return the current user's home directory in this file system.
|
Path |
RawLocalFileSystem.getHomeDirectory() |
Path |
FilterFileSystem.getHomeDirectory() |
Path |
AbstractFileSystem.getHomeDirectory()
Return the current user's home directory in this file system.
|
protected Path |
FileSystem.getInitialWorkingDirectory()
Note: with the new FileContext class, getWorkingDirectory()
will be removed.
|
protected Path |
RawLocalFileSystem.getInitialWorkingDirectory() |
protected Path |
FilterFileSystem.getInitialWorkingDirectory() |
Path |
AbstractFileSystem.getInitialWorkingDirectory()
Some file systems like LocalFileSystem have an initial workingDir
that is used as the starting workingDir.
|
Path |
FileSystem.getLinkTarget(Path f)
|
Path |
FileContext.getLinkTarget(Path f)
Returns the target of the given symbolic link as it was specified
when the link was created.
|
Path |
RawLocalFileSystem.getLinkTarget(Path f) |
Path |
FilterFileSystem.getLinkTarget(Path f) |
Path |
LocalFileSystem.getLinkTarget(Path f) |
Path |
AbstractFileSystem.getLinkTarget(Path f)
Partially resolves the path.
|
Path |
PartialListing.getListedPath()
Path being listed.
|
Path |
Path.getParent()
Returns the parent of a path or null if at root.
|
Path |
FileStatus.getPath() |
static Path |
Path.getPathWithoutSchemeAndAuthority(Path path)
Return a version of the given Path without the scheme information.
|
Path |
FileStatus.getSymlink() |
Path |
FileSystem.getTrashRoot(Path path)
Get the root directory of Trash for current user when the path specified
is deleted.
|
Path |
FilterFileSystem.getTrashRoot(Path path) |
abstract Path |
FileSystem.getWorkingDirectory()
Get the current working directory for the given FileSystem
|
Path |
FileContext.getWorkingDirectory()
Gets the working directory for wd-relative names (such a "foo/bar").
|
Path |
RawLocalFileSystem.getWorkingDirectory() |
Path |
FilterFileSystem.getWorkingDirectory()
Get the current working directory for the given file system
|
Path |
Path.makeQualified(FileSystem fs)
Deprecated.
|
Path |
FileSystem.makeQualified(Path path)
Qualify a path to one which uses this FileSystem and, if relative,
made absolute.
|
Path |
FileContext.makeQualified(Path path)
Make the path fully qualified if it is isn't.
|
Path |
FilterFileSystem.makeQualified(Path path)
Make sure that a path specifies a FileSystem.
|
Path |
AbstractFileSystem.makeQualified(Path path)
Make the path fully qualified to this file system
|
static Path |
Path.mergePaths(Path path1,
Path path2)
Merge 2 paths such that the second path is appended relative to the first.
|
protected Path |
FileContext.resolve(Path f)
Resolves all symbolic links in the specified path.
|
protected Path |
FileContext.resolveIntermediate(Path f)
Resolves all symbolic links in the specified path leading up
to, but not including the final path component.
|
protected Path |
FileSystem.resolveLink(Path f)
|
protected Path |
FilterFileSystem.resolveLink(Path f) |
Path |
FileSystem.resolvePath(Path p)
Return the fully-qualified path of path, resolving the path
through any symlinks or mount point.
|
Path |
FileContext.resolvePath(Path f)
Resolve the path following any symlinks or mount points
|
Path |
FilterFileSystem.resolvePath(Path p) |
Path |
AbstractFileSystem.resolvePath(Path p)
Return the fully-qualified path of path f resolving the path
through any internal symlinks or mount point
|
Path |
FileSystem.startLocalOutput(Path fsOutputFile,
Path tmpLocalFile)
Returns a local file that the user can write output to.
|
Path |
RawLocalFileSystem.startLocalOutput(Path fsOutputFile,
Path tmpLocalFile) |
Path |
FilterFileSystem.startLocalOutput(Path fsOutputFile,
Path tmpLocalFile)
Returns a local File that the user can write output to.
|
Path |
ChecksumFileSystem.startLocalOutput(Path fsOutputFile,
Path tmpLocalFile) |
static Path[] |
FileUtil.stat2Paths(FileStatus[] stats)
convert an array of FileStatus to an array of Path
|
static Path[] |
FileUtil.stat2Paths(FileStatus[] stats,
Path path)
convert an array of FileStatus to an array of Path.
|
Path |
Path.suffix(String suffix)
Adds a suffix to the final name in the path.
|
| Modifier and Type | Method and Description |
|---|---|
static List<Path> |
FileUtil.getJarsInDirectory(String path)
Returns all jars that are in the directory.
|
static List<Path> |
FileUtil.getJarsInDirectory(String path,
boolean useLocal)
Returns all jars that are in the directory.
|
org.apache.hadoop.fs.RemoteIterator<Path> |
FileSystem.listCorruptFileBlocks(Path path)
List corrupted file blocks.
|
org.apache.hadoop.fs.RemoteIterator<Path> |
FileContext.listCorruptFileBlocks(Path path) |
org.apache.hadoop.fs.RemoteIterator<Path> |
FilterFileSystem.listCorruptFileBlocks(Path path) |
org.apache.hadoop.fs.RemoteIterator<Path> |
AbstractFileSystem.listCorruptFileBlocks(Path path) |
| Modifier and Type | Method and Description |
|---|---|
boolean |
PathFilter.accept(Path path)
Tests whether or not the specified abstract pathname should be
included in a pathname list.
|
boolean |
GlobFilter.accept(Path path) |
void |
FilterFileSystem.access(Path path,
FsAction mode) |
FSDataOutputStream |
FileSystem.append(Path f)
Append to an existing file (optional operation).
|
FSDataOutputStream |
FileSystem.append(Path f,
int bufferSize)
Append to an existing file (optional operation).
|
abstract FSDataOutputStream |
FileSystem.append(Path f,
int bufferSize,
Progressable progress)
Append to an existing file (optional operation).
|
FSDataOutputStream |
RawLocalFileSystem.append(Path f,
int bufferSize,
Progressable progress) |
FSDataOutputStream |
FilterFileSystem.append(Path f,
int bufferSize,
Progressable progress) |
FSDataOutputStream |
ChecksumFileSystem.append(Path f,
int bufferSize,
Progressable progress) |
FSDataOutputStreamBuilder |
FileSystem.appendFile(Path path)
Create a Builder to append a file.
|
FSDataOutputStreamBuilder |
FilterFileSystem.appendFile(Path path) |
FSDataOutputStreamBuilder |
ChecksumFileSystem.appendFile(Path path)
This is overridden to ensure that this class's create() method is
ultimately called.
|
boolean |
FileSystem.cancelDeleteOnExit(Path f)
Cancel the scheduled deletion of the path when the FileSystem is closed.
|
protected void |
FileSystem.checkPath(Path path)
Check that a Path belongs to this FileSystem.
|
protected void |
FilterFileSystem.checkPath(Path path)
Check that a Path belongs to this FileSystem.
|
void |
AbstractFileSystem.checkPath(Path path)
Check that a Path belongs to this FileSystem.
|
int |
Path.compareTo(Path o) |
void |
FileSystem.completeLocalOutput(Path fsOutputFile,
Path tmpLocalFile)
Called when we're all done writing to the target.
|
void |
RawLocalFileSystem.completeLocalOutput(Path fsWorkingFile,
Path tmpLocalFile) |
void |
FilterFileSystem.completeLocalOutput(Path fsOutputFile,
Path tmpLocalFile)
Called when we're all done writing to the target.
|
void |
ChecksumFileSystem.completeLocalOutput(Path fsOutputFile,
Path tmpLocalFile) |
void |
FileSystem.concat(Path trg,
Path[] psrcs)
Concat existing files together.
|
void |
FileSystem.concat(Path trg,
Path[] psrcs)
Concat existing files together.
|
void |
RawLocalFileSystem.concat(Path trg,
Path[] psrcs) |
void |
RawLocalFileSystem.concat(Path trg,
Path[] psrcs) |
void |
FilterFileSystem.concat(Path f,
Path[] psrcs) |
void |
FilterFileSystem.concat(Path f,
Path[] psrcs) |
void |
ChecksumFileSystem.concat(Path f,
Path[] psrcs) |
void |
ChecksumFileSystem.concat(Path f,
Path[] psrcs) |
static boolean |
FileUtil.copy(File src,
FileSystem dstFS,
Path dst,
boolean deleteSource,
Configuration conf)
Copy local files to a FileSystem.
|
static boolean |
FileUtil.copy(FileSystem srcFS,
FileStatus srcStatus,
FileSystem dstFS,
Path dst,
boolean deleteSource,
boolean overwrite,
Configuration conf)
Copy files between FileSystems.
|
static boolean |
FileUtil.copy(FileSystem srcFS,
Path[] srcs,
FileSystem dstFS,
Path dst,
boolean deleteSource,
boolean overwrite,
Configuration conf) |
static boolean |
FileUtil.copy(FileSystem srcFS,
Path[] srcs,
FileSystem dstFS,
Path dst,
boolean deleteSource,
boolean overwrite,
Configuration conf) |
static boolean |
FileUtil.copy(FileSystem srcFS,
Path src,
File dst,
boolean deleteSource,
Configuration conf)
Copy FileSystem files to local files.
|
static boolean |
FileUtil.copy(FileSystem srcFS,
Path src,
FileSystem dstFS,
Path dst,
boolean deleteSource,
boolean overwrite,
Configuration conf)
Copy files between FileSystems.
|
static boolean |
FileUtil.copy(FileSystem srcFS,
Path src,
FileSystem dstFS,
Path dst,
boolean deleteSource,
Configuration conf)
Copy files between FileSystems.
|
void |
FileSystem.copyFromLocalFile(boolean delSrc,
boolean overwrite,
Path[] srcs,
Path dst)
The src files are on the local disk.
|
void |
FileSystem.copyFromLocalFile(boolean delSrc,
boolean overwrite,
Path[] srcs,
Path dst)
The src files are on the local disk.
|
void |
FilterFileSystem.copyFromLocalFile(boolean delSrc,
boolean overwrite,
Path[] srcs,
Path dst)
The src files are on the local disk.
|
void |
FilterFileSystem.copyFromLocalFile(boolean delSrc,
boolean overwrite,
Path[] srcs,
Path dst)
The src files are on the local disk.
|
void |
FileSystem.copyFromLocalFile(boolean delSrc,
boolean overwrite,
Path src,
Path dst)
The src file is on the local disk.
|
void |
FilterFileSystem.copyFromLocalFile(boolean delSrc,
boolean overwrite,
Path src,
Path dst)
The src file is on the local disk.
|
void |
FileSystem.copyFromLocalFile(boolean delSrc,
Path src,
Path dst)
The src file is on the local disk.
|
void |
FilterFileSystem.copyFromLocalFile(boolean delSrc,
Path src,
Path dst)
The src file is on the local disk.
|
void |
LocalFileSystem.copyFromLocalFile(boolean delSrc,
Path src,
Path dst) |
void |
ChecksumFileSystem.copyFromLocalFile(boolean delSrc,
Path src,
Path dst) |
void |
FileSystem.copyFromLocalFile(Path src,
Path dst)
The src file is on the local disk.
|
void |
FileSystem.copyToLocalFile(boolean delSrc,
Path src,
Path dst)
Copy it a file from a remote filesystem to the local one.
|
void |
FilterFileSystem.copyToLocalFile(boolean delSrc,
Path src,
Path dst)
The src file is under FS, and the dst is on the local disk.
|
void |
LocalFileSystem.copyToLocalFile(boolean delSrc,
Path src,
Path dst) |
void |
ChecksumFileSystem.copyToLocalFile(boolean delSrc,
Path src,
Path dst)
The src file is under FS, and the dst is on the local disk.
|
void |
FileSystem.copyToLocalFile(boolean delSrc,
Path src,
Path dst,
boolean useRawLocalFileSystem)
The src file is under this filesystem, and the dst is on the local disk.
|
void |
FileSystem.copyToLocalFile(Path src,
Path dst)
Copy it a file from the remote filesystem to the local one.
|
void |
ChecksumFileSystem.copyToLocalFile(Path src,
Path dst,
boolean copyCrc)
The src file is under FS, and the dst is on the local disk.
|
static FSDataOutputStream |
FileSystem.create(FileSystem fs,
Path file,
FsPermission permission)
Create a file with the provided permission.
|
FSDataOutputStream |
FileSystem.create(Path f)
Create an FSDataOutputStream at the indicated Path.
|
FSDataOutputStreamBuilder<FSDataOutputStream,?> |
FileContext.create(Path f)
Create a
FSDataOutputStreamBuilder for creating or overwriting
a file on indicated path. |
FSDataOutputStream |
FileSystem.create(Path f,
boolean overwrite)
Create an FSDataOutputStream at the indicated Path.
|
FSDataOutputStream |
FileSystem.create(Path f,
boolean overwrite,
int bufferSize)
Create an FSDataOutputStream at the indicated Path.
|
FSDataOutputStream |
FileSystem.create(Path f,
boolean overwrite,
int bufferSize,
Progressable progress)
Create an
FSDataOutputStream at the indicated Path
with write-progress reporting. |
FSDataOutputStream |
FileSystem.create(Path f,
boolean overwrite,
int bufferSize,
short replication,
long blockSize)
Create an FSDataOutputStream at the indicated Path.
|
FSDataOutputStream |
FileSystem.create(Path f,
boolean overwrite,
int bufferSize,
short replication,
long blockSize,
Progressable progress)
Create an FSDataOutputStream at the indicated Path with write-progress
reporting.
|
FSDataOutputStream |
RawLocalFileSystem.create(Path f,
boolean overwrite,
int bufferSize,
short replication,
long blockSize,
Progressable progress) |
FSDataOutputStream |
FileContext.create(Path f,
EnumSet<CreateFlag> createFlag,
org.apache.hadoop.fs.Options.CreateOpts... opts)
Create or overwrite file on indicated path and returns an output stream for
writing into the file.
|
FSDataOutputStream |
AbstractFileSystem.create(Path f,
EnumSet<CreateFlag> createFlag,
org.apache.hadoop.fs.Options.CreateOpts... opts)
The specification of this method matches that of
FileContext.create(Path, EnumSet, Options.CreateOpts...) except
that the Path f must be fully qualified and the permission is absolute
(i.e. |
abstract FSDataOutputStream |
FileSystem.create(Path f,
FsPermission permission,
boolean overwrite,
int bufferSize,
short replication,
long blockSize,
Progressable progress)
Create an FSDataOutputStream at the indicated Path with write-progress
reporting.
|
FSDataOutputStream |
RawLocalFileSystem.create(Path f,
FsPermission permission,
boolean overwrite,
int bufferSize,
short replication,
long blockSize,
Progressable progress) |
FSDataOutputStream |
FilterFileSystem.create(Path f,
FsPermission permission,
boolean overwrite,
int bufferSize,
short replication,
long blockSize,
Progressable progress) |
FSDataOutputStream |
ChecksumFileSystem.create(Path f,
FsPermission permission,
boolean overwrite,
int bufferSize,
short replication,
long blockSize,
Progressable progress) |
FSDataOutputStream |
FileSystem.create(Path f,
FsPermission permission,
EnumSet<CreateFlag> flags,
int bufferSize,
short replication,
long blockSize,
Progressable progress)
Create an FSDataOutputStream at the indicated Path with write-progress
reporting.
|
FSDataOutputStream |
FileSystem.create(Path f,
FsPermission permission,
EnumSet<CreateFlag> flags,
int bufferSize,
short replication,
long blockSize,
Progressable progress,
org.apache.hadoop.fs.Options.ChecksumOpt checksumOpt)
Create an FSDataOutputStream at the indicated Path with a custom
checksum option.
|
FSDataOutputStream |
FilterFileSystem.create(Path f,
FsPermission permission,
EnumSet<CreateFlag> flags,
int bufferSize,
short replication,
long blockSize,
Progressable progress,
org.apache.hadoop.fs.Options.ChecksumOpt checksumOpt) |
FSDataOutputStream |
ChecksumFileSystem.create(Path f,
FsPermission permission,
EnumSet<CreateFlag> flags,
int bufferSize,
short replication,
long blockSize,
Progressable progress,
org.apache.hadoop.fs.Options.ChecksumOpt checksumOpt) |
FSDataOutputStream |
FileSystem.create(Path f,
Progressable progress)
Create an FSDataOutputStream at the indicated Path with write-progress
reporting.
|
FSDataOutputStream |
FileSystem.create(Path f,
short replication)
Create an FSDataOutputStream at the indicated Path.
|
FSDataOutputStream |
FileSystem.create(Path f,
short replication,
Progressable progress)
Create an FSDataOutputStream at the indicated Path with write-progress
reporting.
|
protected static FSDataOutputStreamBuilder |
FileSystem.createDataOutputStreamBuilder(FileSystem fileSystem,
Path path)
Create instance of the standard FSDataOutputStreamBuilder for the
given filesystem and path.
|
FSDataOutputStreamBuilder |
FileSystem.createFile(Path path)
Create a new FSDataOutputStreamBuilder for the file with path.
|
FSDataOutputStreamBuilder |
FilterFileSystem.createFile(Path path) |
FSDataOutputStreamBuilder |
ChecksumFileSystem.createFile(Path path)
This is overridden to ensure that this class's create() method is
ultimately called.
|
abstract FSDataOutputStream |
AbstractFileSystem.createInternal(Path f,
EnumSet<CreateFlag> flag,
FsPermission absolutePermission,
int bufferSize,
short replication,
long blockSize,
Progressable progress,
org.apache.hadoop.fs.Options.ChecksumOpt checksumOpt,
boolean createParent)
The specification of this method matches that of
AbstractFileSystem.create(Path, EnumSet, Options.CreateOpts...) except that the opts
have been declared explicitly. |
static String[] |
FileUtil.createJarWithClassPath(String inputClassPath,
Path pwd,
Map<String,String> callerEnv) |
static String[] |
FileUtil.createJarWithClassPath(String inputClassPath,
Path pwd,
Path targetDir,
Map<String,String> callerEnv)
Create a jar file at the given path, containing a manifest with a classpath
that references all specified entries.
|
boolean |
FileSystem.createNewFile(Path f)
Creates the given Path as a brand-new zero-length file.
|
FSDataOutputStream |
FileSystem.createNonRecursive(Path f,
boolean overwrite,
int bufferSize,
short replication,
long blockSize,
Progressable progress)
Opens an FSDataOutputStream at the indicated Path with write-progress
reporting.
|
FSDataOutputStream |
FileSystem.createNonRecursive(Path f,
FsPermission permission,
boolean overwrite,
int bufferSize,
short replication,
long blockSize,
Progressable progress)
Opens an FSDataOutputStream at the indicated Path with write-progress
reporting.
|
FSDataOutputStream |
RawLocalFileSystem.createNonRecursive(Path f,
FsPermission permission,
boolean overwrite,
int bufferSize,
short replication,
long blockSize,
Progressable progress) |
FSDataOutputStream |
ChecksumFileSystem.createNonRecursive(Path f,
FsPermission permission,
boolean overwrite,
int bufferSize,
short replication,
long blockSize,
Progressable progress) |
FSDataOutputStream |
FileSystem.createNonRecursive(Path f,
FsPermission permission,
EnumSet<CreateFlag> flags,
int bufferSize,
short replication,
long blockSize,
Progressable progress)
Opens an FSDataOutputStream at the indicated Path with write-progress
reporting.
|
FSDataOutputStream |
RawLocalFileSystem.createNonRecursive(Path f,
FsPermission permission,
EnumSet<CreateFlag> flags,
int bufferSize,
short replication,
long blockSize,
Progressable progress) |
FSDataOutputStream |
FilterFileSystem.createNonRecursive(Path f,
FsPermission permission,
EnumSet<CreateFlag> flags,
int bufferSize,
short replication,
long blockSize,
Progressable progress) |
FSDataOutputStream |
ChecksumFileSystem.createNonRecursive(Path f,
FsPermission permission,
EnumSet<CreateFlag> flags,
int bufferSize,
short replication,
long blockSize,
Progressable progress) |
protected OutputStream |
RawLocalFileSystem.createOutputStream(Path f,
boolean append) |
protected OutputStream |
RawLocalFileSystem.createOutputStreamWithMode(Path f,
boolean append,
FsPermission permission) |
Path |
FileSystem.createSnapshot(Path path)
Create a snapshot with a default name.
|
Path |
FileContext.createSnapshot(Path path)
Create a snapshot with a default name.
|
Path |
FileSystem.createSnapshot(Path path,
String snapshotName)
Create a snapshot.
|
Path |
FileContext.createSnapshot(Path path,
String snapshotName)
Create a snapshot.
|
Path |
FilterFileSystem.createSnapshot(Path path,
String snapshotName) |
Path |
AbstractFileSystem.createSnapshot(Path path,
String snapshotName)
The specification of this method matches that of
FileContext.createSnapshot(Path, String). |
void |
FileSystem.createSymlink(Path target,
Path link,
boolean createParent)
|
void |
FileContext.createSymlink(Path target,
Path link,
boolean createParent)
Creates a symbolic link to an existing file.
|
void |
RawLocalFileSystem.createSymlink(Path target,
Path link,
boolean createParent) |
void |
FilterFileSystem.createSymlink(Path target,
Path link,
boolean createParent) |
void |
LocalFileSystem.createSymlink(Path target,
Path link,
boolean createParent) |
void |
AbstractFileSystem.createSymlink(Path target,
Path link,
boolean createParent)
The specification of this method matches that of
FileContext.createSymlink(Path, Path, boolean); |
boolean |
FileSystem.delete(Path f)
Deprecated.
Use
FileSystem.delete(Path, boolean) instead. |
abstract boolean |
FileSystem.delete(Path f,
boolean recursive)
Delete a file.
|
boolean |
FileContext.delete(Path f,
boolean recursive)
Delete a file.
|
boolean |
RawLocalFileSystem.delete(Path p,
boolean recursive)
Delete the given path to a file or directory.
|
boolean |
FilterFileSystem.delete(Path f,
boolean recursive)
Delete a file
|
boolean |
ChecksumFileSystem.delete(Path f,
boolean recursive)
Implement the delete(Path, boolean) in checksum
file system.
|
abstract boolean |
AbstractFileSystem.delete(Path f,
boolean recursive)
The specification of this method matches that of
FileContext.delete(Path, boolean) except that Path f must be for
this file system. |
boolean |
FileSystem.deleteOnExit(Path f)
Mark a path to be deleted when its FileSystem is closed.
|
boolean |
FileContext.deleteOnExit(Path f)
Mark a path to be deleted on JVM shutdown.
|
void |
FileSystem.deleteSnapshot(Path path,
String snapshotName)
Delete a snapshot of a directory.
|
void |
FileContext.deleteSnapshot(Path path,
String snapshotName)
Delete a snapshot of a directory.
|
void |
FilterFileSystem.deleteSnapshot(Path path,
String snapshotName) |
void |
AbstractFileSystem.deleteSnapshot(Path snapshotDir,
String snapshotName)
The specification of this method matches that of
FileContext.deleteSnapshot(Path, String). |
boolean |
FileSystem.exists(Path f)
Check if a path exists.
|
protected Path |
FileSystem.fixRelativePart(Path p)
|
static void |
FileUtil.fullyDelete(FileSystem fs,
Path dir)
Deprecated.
|
AclStatus |
FileSystem.getAclStatus(Path path)
Gets the ACL of a file or directory.
|
AclStatus |
FileContext.getAclStatus(Path path)
Gets the ACLs of files and directories.
|
AclStatus |
FilterFileSystem.getAclStatus(Path path) |
AclStatus |
AbstractFileSystem.getAclStatus(Path path)
Gets the ACLs of files and directories.
|
long |
FileSystem.getBlockSize(Path f)
Deprecated.
Use
FileSystem.getFileStatus(Path) instead |
Path |
ChecksumFileSystem.getChecksumFile(Path file)
Return the name of the checksum file associated with a file.
|
long |
ChecksumFileSystem.getChecksumFileLength(Path file,
long fileSize)
Return the length of the checksum file given the size of the
actual file.
|
ContentSummary |
FileSystem.getContentSummary(Path f)
Return the
ContentSummary of a given Path. |
Path |
Trash.getCurrentTrashDir(Path path) |
Path |
TrashPolicy.getCurrentTrashDir(Path path)
Get the current trash directory for path specified based on the Trash
Policy
|
long |
FileSystem.getDefaultBlockSize(Path f)
Return the number of bytes that large input files should be optimally
be split into to minimize I/O time.
|
long |
FilterFileSystem.getDefaultBlockSize(Path f) |
short |
FileSystem.getDefaultReplication(Path path)
Get the default replication for a path.
|
short |
FilterFileSystem.getDefaultReplication(Path f) |
BlockLocation[] |
FileSystem.getFileBlockLocations(Path p,
long start,
long len)
Return an array containing hostnames, offset and size of
portions of the given file.
|
abstract BlockLocation[] |
AbstractFileSystem.getFileBlockLocations(Path f,
long start,
long len)
The specification of this method matches that of
FileContext.getFileBlockLocations(Path, long, long) except that
Path f must be for this file system. |
FileChecksum |
FileSystem.getFileChecksum(Path f)
Get the checksum of a file, if the FS supports checksums.
|
FileChecksum |
FileContext.getFileChecksum(Path f)
Get the checksum of a file.
|
FileChecksum |
FilterFileSystem.getFileChecksum(Path f) |
abstract FileChecksum |
AbstractFileSystem.getFileChecksum(Path f)
The specification of this method matches that of
FileContext.getFileChecksum(Path) except that Path f must be for
this file system. |
FileChecksum |
FileSystem.getFileChecksum(Path f,
long length)
Get the checksum of a file, from the beginning of the file till the
specific length.
|
FileChecksum |
FilterFileSystem.getFileChecksum(Path f,
long length) |
FileStatus |
FileSystem.getFileLinkStatus(Path f)
|
FileStatus |
FileContext.getFileLinkStatus(Path f)
Return a file status object that represents the path.
|
FileStatus |
RawLocalFileSystem.getFileLinkStatus(Path f)
Return a FileStatus representing the given path.
|
FileStatus |
FilterFileSystem.getFileLinkStatus(Path f) |
FileStatus |
LocalFileSystem.getFileLinkStatus(Path f) |
FileStatus |
AbstractFileSystem.getFileLinkStatus(Path f)
The specification of this method matches that of
FileContext.getFileLinkStatus(Path)
except that an UnresolvedLinkException may be thrown if a symlink is
encountered in the path leading up to the final path component. |
abstract FileStatus |
FileSystem.getFileStatus(Path f)
Return a file status object that represents the path.
|
FileStatus |
FileContext.getFileStatus(Path f)
Return a file status object that represents the path.
|
FileStatus |
RawLocalFileSystem.getFileStatus(Path f) |
FileStatus |
FilterFileSystem.getFileStatus(Path f)
Get file status.
|
abstract FileStatus |
AbstractFileSystem.getFileStatus(Path f)
The specification of this method matches that of
FileContext.getFileStatus(Path)
except that an UnresolvedLinkException may be thrown if a symlink is
encountered in the path. |
protected AbstractFileSystem |
FileContext.getFSofPath(Path absOrFqPath)
Get the file system of supplied path.
|
protected static FileSystem |
FileSystem.getFSofPath(Path absOrFqPath,
Configuration conf) |
FsStatus |
FileContext.getFsStatus(Path f)
Returns a status object describing the use and capacity of the
file system denoted by the Parh argument p.
|
FsStatus |
AbstractFileSystem.getFsStatus(Path f)
The specification of this method matches that of
FileContext.getFsStatus(Path) except that Path f must be for this
file system. |
static TrashPolicy |
TrashPolicy.getInstance(Configuration conf,
FileSystem fs,
Path home)
Deprecated.
Use
TrashPolicy.getInstance(Configuration, FileSystem) instead. |
long |
FileSystem.getLength(Path f)
Deprecated.
Use
FileSystem.getFileStatus(Path) instead. |
Path |
FileSystem.getLinkTarget(Path f)
|
Path |
FileContext.getLinkTarget(Path f)
Returns the target of the given symbolic link as it was specified
when the link was created.
|
Path |
RawLocalFileSystem.getLinkTarget(Path f) |
Path |
FilterFileSystem.getLinkTarget(Path f) |
Path |
LocalFileSystem.getLinkTarget(Path f) |
Path |
AbstractFileSystem.getLinkTarget(Path f)
Partially resolves the path.
|
static Path |
Path.getPathWithoutSchemeAndAuthority(Path path)
Return a version of the given Path without the scheme information.
|
QuotaUsage |
FileSystem.getQuotaUsage(Path f)
Return the
QuotaUsage of a given Path. |
short |
FileSystem.getReplication(Path src)
Deprecated.
Use
FileSystem.getFileStatus(Path) instead |
FsServerDefaults |
FileSystem.getServerDefaults(Path p)
Return a set of server default configuration values.
|
FsServerDefaults |
FilterFileSystem.getServerDefaults(Path f) |
FsServerDefaults |
AbstractFileSystem.getServerDefaults(Path f)
Return a set of server default configuration values based on path.
|
FsStatus |
FileSystem.getStatus(Path p)
Returns a status object describing the use and capacity of the
filesystem.
|
FsStatus |
RawLocalFileSystem.getStatus(Path p) |
FsStatus |
FilterFileSystem.getStatus(Path p) |
BlockStoragePolicySpi |
FileSystem.getStoragePolicy(Path src)
Query the effective storage policy ID for the given file or directory.
|
BlockStoragePolicySpi |
FileContext.getStoragePolicy(Path path)
Query the effective storage policy ID for the given file or directory.
|
BlockStoragePolicySpi |
FilterFileSystem.getStoragePolicy(Path src) |
BlockStoragePolicySpi |
AbstractFileSystem.getStoragePolicy(Path src)
Retrieve the storage policy for a given file or directory.
|
Path |
FileSystem.getTrashRoot(Path path)
Get the root directory of Trash for current user when the path specified
is deleted.
|
Path |
FilterFileSystem.getTrashRoot(Path path) |
String |
AbstractFileSystem.getUriPath(Path p)
Get the path-part of a pathname.
|
long |
FileSystem.getUsed(Path path)
Return the total size of all files from a specified path.
|
long |
FilterFileSystem.getUsed(Path path)
Return the total size of all files from a specified path.
|
byte[] |
FileSystem.getXAttr(Path path,
String name)
Get an xattr name and value for a file or directory.
|
byte[] |
FileContext.getXAttr(Path path,
String name)
Get an xattr for a file or directory.
|
byte[] |
FilterFileSystem.getXAttr(Path path,
String name) |
byte[] |
AbstractFileSystem.getXAttr(Path path,
String name)
Get an xattr for a file or directory.
|
Map<String,byte[]> |
FileSystem.getXAttrs(Path path)
Get all of the xattr name/value pairs for a file or directory.
|
Map<String,byte[]> |
FileContext.getXAttrs(Path path)
Get all of the xattrs for a file or directory.
|
Map<String,byte[]> |
FilterFileSystem.getXAttrs(Path path) |
Map<String,byte[]> |
AbstractFileSystem.getXAttrs(Path path)
Get all of the xattrs for a file or directory.
|
Map<String,byte[]> |
FileSystem.getXAttrs(Path path,
List<String> names)
Get all of the xattrs name/value pairs for a file or directory.
|
Map<String,byte[]> |
FileContext.getXAttrs(Path path,
List<String> names)
Get all of the xattrs for a file or directory.
|
Map<String,byte[]> |
FilterFileSystem.getXAttrs(Path path,
List<String> names) |
Map<String,byte[]> |
AbstractFileSystem.getXAttrs(Path path,
List<String> names)
Get all of the xattrs for a file or directory.
|
FileStatus[] |
FileSystem.globStatus(Path pathPattern)
Return all the files that match filePattern and are not checksum
files.
|
FileStatus[] |
FileSystem.globStatus(Path pathPattern,
PathFilter filter)
Return an array of
FileStatus objects whose path names match
pathPattern and is accepted by the user-supplied path filter. |
boolean |
RawLocalFileSystem.handleEmptyDstDirectoryOnWindows(Path src,
File srcFile,
Path dst,
File dstFile) |
boolean |
FileSystem.hasPathCapability(Path path,
String capability)
The base FileSystem implementation generally has no knowledge
of the capabilities of actual implementations.
|
boolean |
FileContext.hasPathCapability(Path path,
String capability)
Return the path capabilities of the bonded
AbstractFileSystem. |
boolean |
RawLocalFileSystem.hasPathCapability(Path path,
String capability) |
boolean |
FilterFileSystem.hasPathCapability(Path path,
String capability) |
boolean |
ChecksumFileSystem.hasPathCapability(Path path,
String capability)
Disable those operations which the checksummed FS blocks.
|
boolean |
AbstractFileSystem.hasPathCapability(Path path,
String capability) |
abstract void |
TrashPolicy.initialize(Configuration conf,
FileSystem fs,
Path home)
Deprecated.
Use
TrashPolicy.initialize(Configuration, FileSystem) instead. |
static boolean |
ChecksumFileSystem.isChecksumFile(Path file)
Return true iff file is a checksum file name.
|
boolean |
FileSystem.isDirectory(Path f)
Deprecated.
Use
FileSystem.getFileStatus(Path) instead |
boolean |
FileSystem.isFile(Path f)
Deprecated.
Use
FileSystem.getFileStatus(Path) instead |
org.apache.hadoop.fs.RemoteIterator<Path> |
FileSystem.listCorruptFileBlocks(Path path)
List corrupted file blocks.
|
org.apache.hadoop.fs.RemoteIterator<Path> |
FileContext.listCorruptFileBlocks(Path path) |
org.apache.hadoop.fs.RemoteIterator<Path> |
FilterFileSystem.listCorruptFileBlocks(Path path) |
org.apache.hadoop.fs.RemoteIterator<Path> |
AbstractFileSystem.listCorruptFileBlocks(Path path) |
org.apache.hadoop.fs.RemoteIterator<LocatedFileStatus> |
FileSystem.listFiles(Path f,
boolean recursive)
List the statuses and block locations of the files in the given path.
|
org.apache.hadoop.fs.RemoteIterator<LocatedFileStatus> |
FileSystem.listLocatedStatus(Path f)
List the statuses of the files/directories in the given path if the path is
a directory.
|
org.apache.hadoop.fs.RemoteIterator<LocatedFileStatus> |
FileContext.listLocatedStatus(Path f)
List the statuses of the files/directories in the given path if the path is
a directory.
|
org.apache.hadoop.fs.RemoteIterator<LocatedFileStatus> |
FilterFileSystem.listLocatedStatus(Path f)
List files and its block locations in a directory.
|
org.apache.hadoop.fs.RemoteIterator<LocatedFileStatus> |
ChecksumFileSystem.listLocatedStatus(Path f)
List the statuses of the files/directories in the given path if the path is
a directory.
|
org.apache.hadoop.fs.RemoteIterator<LocatedFileStatus> |
AbstractFileSystem.listLocatedStatus(Path f)
The specification of this method matches that of
FileContext.listLocatedStatus(Path) except that Path f
must be for this file system. |
protected org.apache.hadoop.fs.RemoteIterator<LocatedFileStatus> |
FileSystem.listLocatedStatus(Path f,
PathFilter filter)
List a directory.
|
protected org.apache.hadoop.fs.RemoteIterator<LocatedFileStatus> |
FilterFileSystem.listLocatedStatus(Path f,
PathFilter filter) |
abstract FileStatus[] |
FileSystem.listStatus(Path f)
List the statuses of the files/directories in the given path if the path is
a directory.
|
org.apache.hadoop.fs.RemoteIterator<FileStatus> |
FileContext.listStatus(Path f)
List the statuses of the files/directories in the given path if the path is
a directory.
|
FileStatus[] |
RawLocalFileSystem.listStatus(Path f)
List the statuses of the files/directories in the given path if the path is
a directory.
|
FileStatus[] |
FilterFileSystem.listStatus(Path f)
List files in a directory.
|
FileStatus[] |
ChecksumFileSystem.listStatus(Path f)
List the statuses of the files/directories in the given path if the path is
a directory.
|
abstract FileStatus[] |
AbstractFileSystem.listStatus(Path f)
The specification of this method matches that of
FileContext.Util.listStatus(Path) except that Path f must be
for this file system. |
FileStatus[] |
FileSystem.listStatus(Path[] files)
Filter files/directories in the given list of paths using default
path filter.
|
FileStatus[] |
FileSystem.listStatus(Path[] files,
PathFilter filter)
Filter files/directories in the given list of paths using user-supplied
path filter.
|
FileStatus[] |
FileSystem.listStatus(Path f,
PathFilter filter)
Filter files/directories in the given path using the user-supplied path
filter.
|
org.apache.hadoop.fs.RemoteIterator<FileStatus> |
FileSystem.listStatusIterator(Path p)
Returns a remote iterator so that followup calls are made on demand
while consuming the entries.
|
org.apache.hadoop.fs.RemoteIterator<FileStatus> |
FilterFileSystem.listStatusIterator(Path f)
Return a remote iterator for listing in a directory
|
org.apache.hadoop.fs.RemoteIterator<FileStatus> |
ChecksumFileSystem.listStatusIterator(Path p) |
org.apache.hadoop.fs.RemoteIterator<FileStatus> |
AbstractFileSystem.listStatusIterator(Path f)
The specification of this method matches that of
FileContext.listStatus(Path) except that Path f must be for this
file system. |
List<String> |
FileSystem.listXAttrs(Path path)
Get all of the xattr names for a file or directory.
|
List<String> |
FileContext.listXAttrs(Path path)
Get all of the xattr names for a file or directory.
|
List<String> |
FilterFileSystem.listXAttrs(Path path) |
List<String> |
AbstractFileSystem.listXAttrs(Path path)
Get all of the xattr names for a file or directory.
|
Path |
FileSystem.makeQualified(Path path)
Qualify a path to one which uses this FileSystem and, if relative,
made absolute.
|
Path |
FileContext.makeQualified(Path path)
Make the path fully qualified if it is isn't.
|
Path |
FilterFileSystem.makeQualified(Path path)
Make sure that a path specifies a FileSystem.
|
Path |
AbstractFileSystem.makeQualified(Path path)
Make the path fully qualified to this file system
|
static Path |
Path.mergePaths(Path path1,
Path path2)
Merge 2 paths such that the second path is appended relative to the first.
|
void |
FileContext.mkdir(Path dir,
FsPermission permission,
boolean createParent)
Make(create) a directory and all the non-existent parents.
|
abstract void |
AbstractFileSystem.mkdir(Path dir,
FsPermission permission,
boolean createParent)
The specification of this method matches that of
FileContext.mkdir(Path, FsPermission, boolean) except that the Path
f must be fully qualified and the permission is absolute (i.e. |
static boolean |
FileSystem.mkdirs(FileSystem fs,
Path dir,
FsPermission permission)
Create a directory with the provided permission.
|
boolean |
FileSystem.mkdirs(Path f)
Call
FileSystem.mkdirs(Path, FsPermission) with default permission. |
boolean |
RawLocalFileSystem.mkdirs(Path f)
Creates the specified directory hierarchy.
|
boolean |
FilterFileSystem.mkdirs(Path f) |
boolean |
ChecksumFileSystem.mkdirs(Path f) |
abstract boolean |
FileSystem.mkdirs(Path f,
FsPermission permission)
Make the given file and all non-existent parents into
directories.
|
boolean |
RawLocalFileSystem.mkdirs(Path f,
FsPermission permission) |
boolean |
FilterFileSystem.mkdirs(Path f,
FsPermission permission) |
protected boolean |
RawLocalFileSystem.mkOneDirWithMode(Path p,
File p2f,
FsPermission permission) |
void |
FileSystem.modifyAclEntries(Path path,
List<AclEntry> aclSpec)
Modifies ACL entries of files and directories.
|
void |
FileContext.modifyAclEntries(Path path,
List<AclEntry> aclSpec)
Modifies ACL entries of files and directories.
|
void |
FilterFileSystem.modifyAclEntries(Path path,
List<AclEntry> aclSpec) |
void |
ChecksumFileSystem.modifyAclEntries(Path src,
List<AclEntry> aclSpec) |
void |
AbstractFileSystem.modifyAclEntries(Path path,
List<AclEntry> aclSpec)
Modifies ACL entries of files and directories.
|
void |
FileSystem.moveFromLocalFile(Path[] srcs,
Path dst)
The src files is on the local disk.
|
void |
FileSystem.moveFromLocalFile(Path[] srcs,
Path dst)
The src files is on the local disk.
|
void |
FileSystem.moveFromLocalFile(Path src,
Path dst)
The src file is on the local disk.
|
void |
RawLocalFileSystem.moveFromLocalFile(Path src,
Path dst) |
static boolean |
Trash.moveToAppropriateTrash(FileSystem fs,
Path p,
Configuration conf)
In case of the symlinks or mount points, one has to move the appropriate
trashbin in the actual volume of the path p being deleted.
|
void |
FileSystem.moveToLocalFile(Path src,
Path dst)
Copy a file to the local filesystem, then delete it from the
remote filesystem (if successfully copied).
|
boolean |
Trash.moveToTrash(Path path)
Move a file or directory to the current trash directory.
|
abstract boolean |
TrashPolicy.moveToTrash(Path path)
Move a file or directory to the current trash directory.
|
FSDataInputStream |
FileSystem.open(Path f)
Opens an FSDataInputStream at the indicated Path.
|
FSDataInputStream |
FileContext.open(Path f)
Opens an FSDataInputStream at the indicated Path using
default buffersize.
|
FSDataInputStream |
AbstractFileSystem.open(Path f)
The specification of this method matches that of
FileContext.open(Path) except that Path f must be for this
file system. |
abstract FSDataInputStream |
FileSystem.open(Path f,
int bufferSize)
Opens an FSDataInputStream at the indicated Path.
|
FSDataInputStream |
FileContext.open(Path f,
int bufferSize)
Opens an FSDataInputStream at the indicated Path.
|
FSDataInputStream |
RawLocalFileSystem.open(Path f,
int bufferSize) |
FSDataInputStream |
FilterFileSystem.open(Path f,
int bufferSize)
Opens an FSDataInputStream at the indicated Path.
|
FSDataInputStream |
ChecksumFileSystem.open(Path f,
int bufferSize)
Opens an FSDataInputStream at the indicated Path.
|
abstract FSDataInputStream |
AbstractFileSystem.open(Path f,
int bufferSize)
The specification of this method matches that of
FileContext.open(Path, int) except that Path f must be for this
file system. |
FutureDataInputStreamBuilder |
FileSystem.openFile(Path path)
Open a file for reading through a builder API.
|
FutureDataInputStreamBuilder |
FileContext.openFile(Path path)
Open a file for reading through a builder API.
|
FutureDataInputStreamBuilder |
FilterFileSystem.openFile(Path path) |
FutureDataInputStreamBuilder |
ChecksumFileSystem.openFile(Path path)
This is overridden to ensure that this class's
ChecksumFileSystem.openFileWithOptions(org.apache.hadoop.fs.Path, org.apache.hadoop.fs.impl.OpenFileParameters)() method is called, and so ultimately
its ChecksumFileSystem.open(Path, int). |
protected CompletableFuture<FSDataInputStream> |
FileSystem.openFileWithOptions(Path path,
org.apache.hadoop.fs.impl.OpenFileParameters parameters)
Execute the actual open file operation.
|
protected CompletableFuture<FSDataInputStream> |
FilterFileSystem.openFileWithOptions(Path path,
org.apache.hadoop.fs.impl.OpenFileParameters parameters) |
protected CompletableFuture<FSDataInputStream> |
ChecksumFileSystem.openFileWithOptions(Path path,
org.apache.hadoop.fs.impl.OpenFileParameters parameters)
Open the file as a blocking call to
ChecksumFileSystem.open(Path, int). |
CompletableFuture<FSDataInputStream> |
AbstractFileSystem.openFileWithOptions(Path path,
org.apache.hadoop.fs.impl.OpenFileParameters parameters)
Open a file with the given set of options.
|
File |
RawLocalFileSystem.pathToFile(Path path)
Convert a path to a File.
|
File |
LocalFileSystem.pathToFile(Path path)
Convert a path to a File.
|
protected FSDataOutputStream |
FileSystem.primitiveCreate(Path f,
FsPermission absolutePermission,
EnumSet<CreateFlag> flag,
int bufferSize,
short replication,
long blockSize,
Progressable progress,
org.apache.hadoop.fs.Options.ChecksumOpt checksumOpt)
Deprecated.
|
protected FSDataOutputStream |
FilterFileSystem.primitiveCreate(Path f,
FsPermission absolutePermission,
EnumSet<CreateFlag> flag,
int bufferSize,
short replication,
long blockSize,
Progressable progress,
org.apache.hadoop.fs.Options.ChecksumOpt checksumOpt) |
protected boolean |
FileSystem.primitiveMkdir(Path f,
FsPermission absolutePermission)
Deprecated.
|
protected boolean |
FilterFileSystem.primitiveMkdir(Path f,
FsPermission abdolutePermission) |
protected void |
FileSystem.primitiveMkdir(Path f,
FsPermission absolutePermission,
boolean createParent)
Deprecated.
|
void |
FileSystem.removeAcl(Path path)
Removes all but the base ACL entries of files and directories.
|
void |
FileContext.removeAcl(Path path)
Removes all but the base ACL entries of files and directories.
|
void |
FilterFileSystem.removeAcl(Path path) |
void |
ChecksumFileSystem.removeAcl(Path src) |
void |
AbstractFileSystem.removeAcl(Path path)
Removes all but the base ACL entries of files and directories.
|
void |
FileSystem.removeAclEntries(Path path,
List<AclEntry> aclSpec)
Removes ACL entries from files and directories.
|
void |
FileContext.removeAclEntries(Path path,
List<AclEntry> aclSpec)
Removes ACL entries from files and directories.
|
void |
FilterFileSystem.removeAclEntries(Path path,
List<AclEntry> aclSpec) |
void |
ChecksumFileSystem.removeAclEntries(Path src,
List<AclEntry> aclSpec) |
void |
AbstractFileSystem.removeAclEntries(Path path,
List<AclEntry> aclSpec)
Removes ACL entries from files and directories.
|
void |
FileSystem.removeDefaultAcl(Path path)
Removes all default ACL entries from files and directories.
|
void |
FileContext.removeDefaultAcl(Path path)
Removes all default ACL entries from files and directories.
|
void |
FilterFileSystem.removeDefaultAcl(Path path) |
void |
ChecksumFileSystem.removeDefaultAcl(Path src) |
void |
AbstractFileSystem.removeDefaultAcl(Path path)
Removes all default ACL entries from files and directories.
|
void |
FileSystem.removeXAttr(Path path,
String name)
Remove an xattr of a file or directory.
|
void |
FileContext.removeXAttr(Path path,
String name)
Remove an xattr of a file or directory.
|
void |
FilterFileSystem.removeXAttr(Path path,
String name) |
void |
AbstractFileSystem.removeXAttr(Path path,
String name)
Remove an xattr of a file or directory.
|
abstract boolean |
FileSystem.rename(Path src,
Path dst)
Renames Path src to Path dst.
|
boolean |
RawLocalFileSystem.rename(Path src,
Path dst) |
boolean |
FilterFileSystem.rename(Path src,
Path dst)
Renames Path src to Path dst.
|
boolean |
ChecksumFileSystem.rename(Path src,
Path dst)
Rename files/dirs
|
protected void |
FileSystem.rename(Path src,
Path dst,
org.apache.hadoop.fs.Options.Rename... options)
Deprecated.
|
void |
FileContext.rename(Path src,
Path dst,
org.apache.hadoop.fs.Options.Rename... options)
Renames Path src to Path dst
Fails if src is a file and dst is a directory.
|
protected void |
FilterFileSystem.rename(Path src,
Path dst,
org.apache.hadoop.fs.Options.Rename... options) |
void |
AbstractFileSystem.rename(Path src,
Path dst,
org.apache.hadoop.fs.Options.Rename... options)
The specification of this method matches that of
FileContext.rename(Path, Path, Options.Rename...) except that Path
f must be for this file system. |
abstract void |
AbstractFileSystem.renameInternal(Path src,
Path dst)
The specification of this method matches that of
FileContext.rename(Path, Path, Options.Rename...) except that Path
f must be for this file system and NO OVERWRITE is performed. |
void |
AbstractFileSystem.renameInternal(Path src,
Path dst,
boolean overwrite)
The specification of this method matches that of
FileContext.rename(Path, Path, Options.Rename...) except that Path
f must be for this file system. |
void |
FileSystem.renameSnapshot(Path path,
String snapshotOldName,
String snapshotNewName)
Rename a snapshot.
|
void |
FileContext.renameSnapshot(Path path,
String snapshotOldName,
String snapshotNewName)
Rename a snapshot.
|
void |
FilterFileSystem.renameSnapshot(Path path,
String snapshotOldName,
String snapshotNewName) |
void |
AbstractFileSystem.renameSnapshot(Path path,
String snapshotOldName,
String snapshotNewName)
The specification of this method matches that of
FileContext.renameSnapshot(Path, String, String). |
boolean |
LocalFileSystem.reportChecksumFailure(Path p,
FSDataInputStream in,
long inPos,
FSDataInputStream sums,
long sumsPos)
Moves files to a bad file directory on the same device, so that their
storage will not be reused.
|
boolean |
ChecksumFileSystem.reportChecksumFailure(Path f,
FSDataInputStream in,
long inPos,
FSDataInputStream sums,
long sumsPos)
Report a checksum error to the file system.
|
protected Path |
FileContext.resolve(Path f)
Resolves all symbolic links in the specified path.
|
protected Path |
FileContext.resolveIntermediate(Path f)
Resolves all symbolic links in the specified path leading up
to, but not including the final path component.
|
protected Path |
FileSystem.resolveLink(Path f)
|
protected Path |
FilterFileSystem.resolveLink(Path f) |
Path |
FileSystem.resolvePath(Path p)
Return the fully-qualified path of path, resolving the path
through any symlinks or mount point.
|
Path |
FileContext.resolvePath(Path f)
Resolve the path following any symlinks or mount points
|
Path |
FilterFileSystem.resolvePath(Path p) |
Path |
AbstractFileSystem.resolvePath(Path p)
Return the fully-qualified path of path f resolving the path
through any internal symlinks or mount point
|
void |
FileSystem.satisfyStoragePolicy(Path path)
Set the source path to satisfy storage policy.
|
void |
FileContext.satisfyStoragePolicy(Path path)
Set the source path to satisfy storage policy.
|
void |
FilterFileSystem.satisfyStoragePolicy(Path src) |
void |
AbstractFileSystem.satisfyStoragePolicy(Path path)
Set the source path to satisfy storage policy.
|
void |
FileSystem.setAcl(Path path,
List<AclEntry> aclSpec)
Fully replaces ACL of files and directories, discarding all existing
entries.
|
void |
FileContext.setAcl(Path path,
List<AclEntry> aclSpec)
Fully replaces ACL of files and directories, discarding all existing
entries.
|
void |
FilterFileSystem.setAcl(Path path,
List<AclEntry> aclSpec) |
void |
ChecksumFileSystem.setAcl(Path src,
List<AclEntry> aclSpec) |
void |
AbstractFileSystem.setAcl(Path path,
List<AclEntry> aclSpec)
Fully replaces ACL of files and directories, discarding all existing
entries.
|
void |
FileSystem.setOwner(Path p,
String username,
String groupname)
Set owner of a path (i.e.
|
void |
FileContext.setOwner(Path f,
String username,
String groupname)
Set owner of a path (i.e.
|
void |
RawLocalFileSystem.setOwner(Path p,
String username,
String groupname)
Use the command chown to set owner.
|
void |
FilterFileSystem.setOwner(Path p,
String username,
String groupname) |
void |
ChecksumFileSystem.setOwner(Path src,
String username,
String groupname) |
abstract void |
AbstractFileSystem.setOwner(Path f,
String username,
String groupname)
The specification of this method matches that of
FileContext.setOwner(Path, String, String) except that Path f must
be for this file system. |
void |
FileStatus.setPath(Path p) |
void |
FileSystem.setPermission(Path p,
FsPermission permission)
Set permission of a path.
|
void |
FileContext.setPermission(Path f,
FsPermission permission)
Set permission of a path.
|
void |
RawLocalFileSystem.setPermission(Path p,
FsPermission permission)
Use the command chmod to set permission.
|
void |
FilterFileSystem.setPermission(Path p,
FsPermission permission) |
void |
ChecksumFileSystem.setPermission(Path src,
FsPermission permission) |
abstract void |
AbstractFileSystem.setPermission(Path f,
FsPermission permission)
The specification of this method matches that of
FileContext.setPermission(Path, FsPermission) except that Path f
must be for this file system. |
void |
FileSystem.setQuota(Path src,
long namespaceQuota,
long storagespaceQuota)
Set quota for the given
Path. |
void |
FileSystem.setQuotaByStorageType(Path src,
StorageType type,
long quota)
Set per storage type quota for the given
Path. |
boolean |
FileSystem.setReplication(Path src,
short replication)
Set the replication for an existing file.
|
boolean |
FileContext.setReplication(Path f,
short replication)
Set replication for an existing file.
|
boolean |
FilterFileSystem.setReplication(Path src,
short replication)
Set replication for an existing file.
|
boolean |
ChecksumFileSystem.setReplication(Path src,
short replication)
Set replication for an existing file.
|
abstract boolean |
AbstractFileSystem.setReplication(Path f,
short replication)
The specification of this method matches that of
FileContext.setReplication(Path, short) except that Path f must be
for this file system. |
void |
FileSystem.setStoragePolicy(Path src,
String policyName)
Set the storage policy for a given file or directory.
|
void |
FileContext.setStoragePolicy(Path path,
String policyName)
Set the storage policy for a given file or directory.
|
void |
FilterFileSystem.setStoragePolicy(Path src,
String policyName) |
void |
AbstractFileSystem.setStoragePolicy(Path path,
String policyName)
Set the storage policy for a given file or directory.
|
void |
FileStatus.setSymlink(Path p) |
void |
FileSystem.setTimes(Path p,
long mtime,
long atime)
Set access time of a file.
|
void |
FileContext.setTimes(Path f,
long mtime,
long atime)
Set access time of a file.
|
void |
RawLocalFileSystem.setTimes(Path p,
long mtime,
long atime)
Sets the
Path's last modified time and last access time to
the given valid times. |
void |
FilterFileSystem.setTimes(Path p,
long mtime,
long atime) |
abstract void |
AbstractFileSystem.setTimes(Path f,
long mtime,
long atime)
The specification of this method matches that of
FileContext.setTimes(Path, long, long) except that Path f must be
for this file system. |
void |
FileContext.setVerifyChecksum(boolean verifyChecksum,
Path f)
Set the verify checksum flag for the file system denoted by the path.
|
abstract void |
FileSystem.setWorkingDirectory(Path new_dir)
Set the current working directory for the given FileSystem.
|
void |
FileContext.setWorkingDirectory(Path newWDir)
Set the working directory for wd-relative names (such a "foo/bar").
|
void |
RawLocalFileSystem.setWorkingDirectory(Path newDir)
Set the working directory to the given directory.
|
void |
FilterFileSystem.setWorkingDirectory(Path newDir)
Set the current working directory for the given file system.
|
void |
FileSystem.setXAttr(Path path,
String name,
byte[] value)
Set an xattr of a file or directory.
|
void |
FileContext.setXAttr(Path path,
String name,
byte[] value)
Set an xattr of a file or directory.
|
void |
FilterFileSystem.setXAttr(Path path,
String name,
byte[] value) |
void |
AbstractFileSystem.setXAttr(Path path,
String name,
byte[] value)
Set an xattr of a file or directory.
|
void |
FileSystem.setXAttr(Path path,
String name,
byte[] value,
EnumSet<XAttrSetFlag> flag)
Set an xattr of a file or directory.
|
void |
FileContext.setXAttr(Path path,
String name,
byte[] value,
EnumSet<XAttrSetFlag> flag)
Set an xattr of a file or directory.
|
void |
FilterFileSystem.setXAttr(Path path,
String name,
byte[] value,
EnumSet<XAttrSetFlag> flag) |
void |
AbstractFileSystem.setXAttr(Path path,
String name,
byte[] value,
EnumSet<XAttrSetFlag> flag)
Set an xattr of a file or directory.
|
Path |
FileSystem.startLocalOutput(Path fsOutputFile,
Path tmpLocalFile)
Returns a local file that the user can write output to.
|
Path |
RawLocalFileSystem.startLocalOutput(Path fsOutputFile,
Path tmpLocalFile) |
Path |
FilterFileSystem.startLocalOutput(Path fsOutputFile,
Path tmpLocalFile)
Returns a local File that the user can write output to.
|
Path |
ChecksumFileSystem.startLocalOutput(Path fsOutputFile,
Path tmpLocalFile) |
static Path[] |
FileUtil.stat2Paths(FileStatus[] stats,
Path path)
convert an array of FileStatus to an array of Path.
|
boolean |
FileSystem.truncate(Path f,
long newLength)
Truncate the file in the indicated path to the indicated size.
|
boolean |
FileContext.truncate(Path f,
long newLength)
Truncate the file in the indicated path to the indicated size.
|
boolean |
RawLocalFileSystem.truncate(Path f,
long newLength) |
boolean |
FilterFileSystem.truncate(Path f,
long newLength) |
boolean |
ChecksumFileSystem.truncate(Path f,
long newLength) |
boolean |
AbstractFileSystem.truncate(Path f,
long newLength)
The specification of this method matches that of
FileContext.truncate(Path, long) except that Path f must be for
this file system. |
void |
FileSystem.unsetStoragePolicy(Path src)
Unset the storage policy set for a given file or directory.
|
void |
FileContext.unsetStoragePolicy(Path src)
Unset the storage policy set for a given file or directory.
|
void |
FilterFileSystem.unsetStoragePolicy(Path src) |
void |
AbstractFileSystem.unsetStoragePolicy(Path src)
Unset the storage policy set for a given file or directory.
|
static FileContext |
FileUtil.write(FileContext fileContext,
Path path,
byte[] bytes)
Writes bytes to a file.
|
static FileContext |
FileUtil.write(FileContext fileContext,
Path path,
CharSequence charseq)
Write a line of text to a file.
|
static FileContext |
FileUtil.write(FileContext fs,
Path path,
CharSequence charseq,
Charset cs)
Write a line of text to a file.
|
static FileContext |
FileUtil.write(FileContext fileContext,
Path path,
Iterable<? extends CharSequence> lines,
Charset cs)
Write lines of text to a file.
|
static FileSystem |
FileUtil.write(FileSystem fs,
Path path,
byte[] bytes)
Writes bytes to a file.
|
static FileSystem |
FileUtil.write(FileSystem fs,
Path path,
CharSequence charseq)
Write a line of text to a file.
|
static FileSystem |
FileUtil.write(FileSystem fs,
Path path,
CharSequence charseq,
Charset cs)
Write a line of text to a file.
|
static FileSystem |
FileUtil.write(FileSystem fs,
Path path,
Iterable<? extends CharSequence> lines,
Charset cs)
Write lines of text to a file.
|
| Modifier and Type | Method and Description |
|---|---|
org.apache.hadoop.fs.RemoteIterator<PartialListing<LocatedFileStatus>> |
BatchListingOperations.batchedListLocatedStatusIterator(List<Path> paths)
Batched listing API that returns
PartialListings for the passed
Paths. |
org.apache.hadoop.fs.RemoteIterator<PartialListing<FileStatus>> |
BatchListingOperations.batchedListStatusIterator(List<Path> paths)
Batched listing API that returns
PartialListings for the
passed Paths. |
| Constructor and Description |
|---|
AvroFSInput(FileContext fc,
Path p)
Construct given a
FileContext and a Path. |
FileStatus(long length,
boolean isdir,
int block_replication,
long blocksize,
long modification_time,
long access_time,
FsPermission permission,
String owner,
String group,
Path path)
Constructor for file systems on which symbolic links are not supported
|
FileStatus(long length,
boolean isdir,
int block_replication,
long blocksize,
long modification_time,
long access_time,
FsPermission permission,
String owner,
String group,
Path symlink,
Path path) |
FileStatus(long length,
boolean isdir,
int block_replication,
long blocksize,
long modification_time,
long access_time,
FsPermission permission,
String owner,
String group,
Path symlink,
Path path,
boolean hasAcl,
boolean isEncrypted,
boolean isErasureCoded) |
FileStatus(long length,
boolean isdir,
int block_replication,
long blocksize,
long modification_time,
long access_time,
FsPermission permission,
String owner,
String group,
Path symlink,
Path path,
Set<org.apache.hadoop.fs.FileStatus.AttrFlags> attr) |
FileStatus(long length,
boolean isdir,
int block_replication,
long blocksize,
long modification_time,
Path path) |
FSDataOutputStreamBuilder(FileSystem fileSystem,
Path p)
Constructor.
|
LocatedFileStatus(long length,
boolean isdir,
int block_replication,
long blocksize,
long modification_time,
long access_time,
FsPermission permission,
String owner,
String group,
Path symlink,
Path path,
BlockLocation[] locations)
Deprecated.
|
LocatedFileStatus(long length,
boolean isdir,
int block_replication,
long blocksize,
long modification_time,
long access_time,
FsPermission permission,
String owner,
String group,
Path symlink,
Path path,
boolean hasAcl,
boolean isEncrypted,
boolean isErasureCoded,
BlockLocation[] locations)
Constructor.
|
LocatedFileStatus(long length,
boolean isdir,
int block_replication,
long blocksize,
long modification_time,
long access_time,
FsPermission permission,
String owner,
String group,
Path symlink,
Path path,
Set<org.apache.hadoop.fs.FileStatus.AttrFlags> attr,
BlockLocation[] locations)
Constructor.
|
PartialListing(Path listedPath,
List<T> partialListing) |
PartialListing(Path listedPath,
org.apache.hadoop.ipc.RemoteException exception) |
Path(Path parent,
Path child)
Create a new Path based on the child path resolved against the parent path.
|
Path(Path parent,
String child)
Create a new Path based on the child path resolved against the parent path.
|
Path(String parent,
Path child)
Create a new Path based on the child path resolved against the parent path.
|
| Modifier and Type | Method and Description |
|---|---|
Path |
AdlFileSystem.getHomeDirectory()
Constructing home directory locally is fine as long as Hadoop
local user name and ADL user name relationship story is not fully baked
yet.
|
Path |
AdlFileSystem.getWorkingDirectory()
Get the current working directory for the given file system.
|
| Modifier and Type | Method and Description |
|---|---|
void |
AdlFileSystem.access(Path path,
FsAction mode)
Checks if the user can access a path.
|
FSDataOutputStream |
AdlFileSystem.append(Path f,
int bufferSize,
Progressable progress)
Append to an existing file (optional operation).
|
void |
AdlFileSystem.concat(Path trg,
Path[] srcs)
Concat existing files together.
|
void |
AdlFileSystem.concat(Path trg,
Path[] srcs)
Concat existing files together.
|
FSDataOutputStream |
AdlFileSystem.create(Path f,
FsPermission permission,
boolean overwrite,
int bufferSize,
short replication,
long blockSize,
Progressable progress)
Create call semantic is handled differently in case of ADL.
|
FSDataOutputStream |
AdlFileSystem.createNonRecursive(Path f,
FsPermission permission,
EnumSet<CreateFlag> flags,
int bufferSize,
short replication,
long blockSize,
Progressable progress)
Deprecated.
API only for 0.20-append
|
boolean |
AdlFileSystem.delete(Path path,
boolean recursive)
Delete a file.
|
AclStatus |
AdlFileSystem.getAclStatus(Path path)
Gets the ACL of a file or directory.
|
long |
AdlFileSystem.getBlockSize(Path f)
Deprecated.
Use getFileStatus() instead
|
ContentSummary |
AdlFileSystem.getContentSummary(Path f)
Return the
ContentSummary of a given Path. |
long |
AdlFileSystem.getDefaultBlockSize(Path f)
Return the number of bytes that large input files should be optimally
be split into to minimize i/o time.
|
FileStatus |
AdlFileSystem.getFileStatus(Path f)
Return a file status object that represents the path.
|
short |
AdlFileSystem.getReplication(Path src)
Deprecated.
Use getFileStatus() instead
|
boolean |
AdlFileSystem.hasPathCapability(Path path,
String capability) |
FileStatus[] |
AdlFileSystem.listStatus(Path f)
List the statuses of the files/directories in the given path if the path is
a directory.
|
boolean |
AdlFileSystem.mkdirs(Path path,
FsPermission permission)
Make the given file and all non-existent parents into
directories.
|
void |
AdlFileSystem.modifyAclEntries(Path path,
List<AclEntry> aclSpec)
Modifies ACL entries of files and directories.
|
FSDataInputStream |
AdlFileSystem.open(Path f,
int buffersize)
Open call semantic is handled differently in case of ADL.
|
void |
AdlFileSystem.removeAcl(Path path)
Removes all but the base ACL entries of files and directories.
|
void |
AdlFileSystem.removeAclEntries(Path path,
List<AclEntry> aclSpec)
Removes ACL entries from files and directories.
|
void |
AdlFileSystem.removeDefaultAcl(Path path)
Removes all default ACL entries from files and directories.
|
boolean |
AdlFileSystem.rename(Path src,
Path dst)
Renames Path src to Path dst.
|
void |
AdlFileSystem.rename(Path src,
Path dst,
org.apache.hadoop.fs.Options.Rename... options)
Deprecated.
|
void |
AdlFileSystem.setAcl(Path path,
List<AclEntry> aclSpec)
Fully replaces ACL of files and directories, discarding all existing
entries.
|
void |
AdlFileSystem.setOwner(Path path,
String owner,
String group)
Set owner of a path (i.e.
|
void |
AdlFileSystem.setPermission(Path path,
FsPermission permission)
Set permission of a path.
|
boolean |
AdlFileSystem.setReplication(Path p,
short replication)
Azure data lake does not support user configuration for data replication
hence not leaving system to query on
azure data lake.
|
void |
AdlFileSystem.setWorkingDirectory(Path dir)
Set the current working directory for the given file system.
|
| Modifier and Type | Method and Description |
|---|---|
Path |
NativeAzureFileSystem.getHomeDirectory() |
Path |
NativeAzureFileSystem.getWorkingDirectory() |
Path |
NativeAzureFileSystem.makeAbsolute(Path path)
Get the absolute version of the path (fully qualified).
|
| Modifier and Type | Method and Description |
|---|---|
void |
NativeAzureFileSystem.access(Path path,
FsAction mode) |
org.apache.hadoop.fs.azure.SelfRenewingLease |
NativeAzureFileSystem.acquireLease(Path path)
Get a self-renewing lease on the specified file.
|
FSDataOutputStream |
NativeAzureFileSystem.append(Path f,
int bufferSize,
Progressable progress)
This optional operation is not yet supported.
|
protected void |
NativeAzureFileSystem.checkPath(Path path) |
FSDataOutputStream |
NativeAzureFileSystem.create(Path f,
FsPermission permission,
boolean overwrite,
int bufferSize,
short replication,
long blockSize,
Progressable progress) |
protected FSDataOutputStream |
NativeAzureFileSystem.createInternal(Path f,
FsPermission permission,
boolean overwrite,
org.apache.hadoop.fs.azure.SelfRenewingLease parentFolderLease)
This is the version of the create call that is meant for internal usage.
|
FSDataOutputStream |
NativeAzureFileSystem.createNonRecursive(Path f,
boolean overwrite,
int bufferSize,
short replication,
long blockSize,
Progressable progress) |
FSDataOutputStream |
NativeAzureFileSystem.createNonRecursive(Path f,
FsPermission permission,
boolean overwrite,
int bufferSize,
short replication,
long blockSize,
Progressable progress) |
FSDataOutputStream |
NativeAzureFileSystem.createNonRecursive(Path f,
FsPermission permission,
EnumSet<CreateFlag> flags,
int bufferSize,
short replication,
long blockSize,
Progressable progress) |
boolean |
NativeAzureFileSystem.delete(Path path)
Deprecated.
|
boolean |
NativeAzureFileSystem.delete(Path f,
boolean recursive) |
boolean |
NativeAzureFileSystem.delete(Path f,
boolean recursive,
boolean skipParentFolderLastModifiedTimeUpdate)
Delete the specified file or folder.
|
void |
NativeAzureFileSystem.deleteFilesWithDanglingTempData(Path root)
Looks under the given root path for any blob that are left "dangling",
meaning that they are place-holder blobs that we created while we upload
the data to a temporary blob, but for some reason we crashed in the middle
of the upload and left them there.
|
protected boolean |
NativeAzureFileSystem.existsInternal(Path f)
Checks if a given path exists in the filesystem.
|
FileStatus |
NativeAzureFileSystem.getFileStatus(Path f) |
String |
NativeAzureFileSystem.getOwnerForPath(Path absolutePath) |
byte[] |
NativeAzureFileSystem.getXAttr(Path path,
String xAttrName)
Get the value of an attribute for a path.
|
boolean |
NativeAzureFileSystem.hasPathCapability(Path path,
String capability) |
FileStatus[] |
NativeAzureFileSystem.listStatus(Path f)
Retrieve the status of a given path if it is a file, or of all the
contained files if it is a directory.
|
Path |
NativeAzureFileSystem.makeAbsolute(Path path)
Get the absolute version of the path (fully qualified).
|
boolean |
NativeAzureFileSystem.mkdirs(Path f,
FsPermission permission) |
boolean |
NativeAzureFileSystem.mkdirs(Path f,
FsPermission permission,
boolean noUmask) |
FSDataInputStream |
NativeAzureFileSystem.open(Path f,
int bufferSize) |
String |
NativeAzureFileSystem.pathToKey(Path path)
Convert the path to a key.
|
void |
NativeAzureFileSystem.recoverFilesWithDanglingTempData(Path root,
Path destination)
Looks under the given root path for any blob that are left "dangling",
meaning that they are place-holder blobs that we created while we upload
the data to a temporary blob, but for some reason we crashed in the middle
of the upload and left them there.
|
boolean |
NativeAzureFileSystem.rename(Path src,
Path dst) |
void |
NativeAzureFileSystem.setOwner(Path p,
String username,
String groupname) |
void |
NativeAzureFileSystem.setPermission(Path p,
FsPermission permission) |
void |
NativeAzureFileSystem.setWorkingDirectory(Path newDir)
Set the working directory to the given directory.
|
void |
NativeAzureFileSystem.setXAttr(Path path,
String xAttrName,
byte[] value,
EnumSet<XAttrSetFlag> flag)
Set the value of an attribute for a path.
|
| Modifier and Type | Method and Description |
|---|---|
void |
AzureBlobFileSystemStore.access(Path path,
FsAction mode) |
void |
AzureBlobFileSystemStore.createDirectory(Path path,
FsPermission permission,
FsPermission umask) |
OutputStream |
AzureBlobFileSystemStore.createFile(Path path,
org.apache.hadoop.fs.FileSystem.Statistics statistics,
boolean overwrite,
FsPermission permission,
FsPermission umask) |
void |
AzureBlobFileSystemStore.delete(Path path,
boolean recursive) |
AclStatus |
AzureBlobFileSystemStore.getAclStatus(Path path) |
FileStatus |
AzureBlobFileSystemStore.getFileStatus(Path path) |
Hashtable<String,String> |
AzureBlobFileSystemStore.getPathStatus(Path path) |
FileStatus[] |
AzureBlobFileSystemStore.listStatus(Path path) |
FileStatus[] |
AzureBlobFileSystemStore.listStatus(Path path,
String startFrom) |
void |
AzureBlobFileSystemStore.modifyAclEntries(Path path,
List<AclEntry> aclSpec) |
org.apache.hadoop.fs.azurebfs.services.AbfsInputStream |
AzureBlobFileSystemStore.openFileForRead(Path path,
org.apache.hadoop.fs.FileSystem.Statistics statistics) |
OutputStream |
AzureBlobFileSystemStore.openFileForWrite(Path path,
org.apache.hadoop.fs.FileSystem.Statistics statistics,
boolean overwrite) |
void |
AzureBlobFileSystemStore.removeAcl(Path path) |
void |
AzureBlobFileSystemStore.removeAclEntries(Path path,
List<AclEntry> aclSpec) |
void |
AzureBlobFileSystemStore.removeDefaultAcl(Path path) |
void |
AzureBlobFileSystemStore.rename(Path source,
Path destination) |
void |
AzureBlobFileSystemStore.setAcl(Path path,
List<AclEntry> aclSpec) |
void |
AzureBlobFileSystemStore.setOwner(Path path,
String owner,
String group) |
void |
AzureBlobFileSystemStore.setPathProperties(Path path,
Hashtable<String,String> properties) |
void |
AzureBlobFileSystemStore.setPermission(Path path,
FsPermission permission) |
| Modifier and Type | Method and Description |
|---|---|
Path |
FTPFileSystem.getHomeDirectory() |
Path |
FTPFileSystem.getWorkingDirectory() |
| Modifier and Type | Method and Description |
|---|---|
FSDataOutputStream |
FTPFileSystem.append(Path f,
int bufferSize,
Progressable progress)
This optional operation is not yet supported.
|
FSDataOutputStream |
FTPFileSystem.create(Path file,
FsPermission permission,
boolean overwrite,
int bufferSize,
short replication,
long blockSize,
Progressable progress)
A stream obtained via this call must be closed before using other APIs of
this class or else the invocation will block.
|
boolean |
FTPFileSystem.delete(Path file,
boolean recursive) |
FileStatus |
FTPFileSystem.getFileStatus(Path file) |
FileStatus[] |
FTPFileSystem.listStatus(Path file) |
boolean |
FTPFileSystem.mkdirs(Path file,
FsPermission permission) |
FSDataInputStream |
FTPFileSystem.open(Path file,
int bufferSize) |
boolean |
FTPFileSystem.rename(Path src,
Path dst) |
void |
FTPFileSystem.setWorkingDirectory(Path newDir) |
| Modifier and Type | Method and Description |
|---|---|
Path |
AbstractFSBuilderImpl.getPath()
Get the path: only valid if constructed with a path.
|
| Modifier and Type | Method and Description |
|---|---|
Optional<Path> |
AbstractFSBuilderImpl.getOptionalPath()
Get the optional path; may be empty.
|
| Constructor and Description |
|---|
AbstractFSBuilderImpl(Path path) |
FutureDataInputStreamBuilderImpl(FileContext fc,
Path path)
Construct from a
FileContext. |
FutureDataInputStreamBuilderImpl(FileSystem fileSystem,
Path path)
Constructor.
|
| Constructor and Description |
|---|
AbstractFSBuilderImpl(Optional<Path> optionalPath,
Optional<PathHandle> optionalPathHandle)
Constructor with both optional path and path handle.
|
| Modifier and Type | Method and Description |
|---|---|
protected Path |
MagicS3GuardCommitter.getBaseTaskAttemptPath(TaskAttemptContext context) |
protected Path |
MagicS3GuardCommitter.getJobAttemptPath(int appAttemptId)
Compute the path where the output of a given job attempt will be placed.
|
Path |
MagicS3GuardCommitter.getTaskAttemptPath(TaskAttemptContext context)
Compute the path where the output of a task attempt is stored until
that task is committed.
|
Path |
MagicS3GuardCommitter.getTempTaskAttemptPath(TaskAttemptContext context)
Get a temporary directory for data.
|
| Constructor and Description |
|---|
MagicS3GuardCommitter(Path outputPath,
TaskAttemptContext context)
Create a task committer.
|
| Modifier and Type | Method and Description |
|---|---|
Path |
NativeS3FileSystem.getWorkingDirectory()
Deprecated.
|
| Modifier and Type | Method and Description |
|---|---|
FSDataOutputStream |
NativeS3FileSystem.append(Path f,
int bufferSize,
Progressable progress)
Deprecated.
|
FSDataOutputStream |
NativeS3FileSystem.create(Path f,
FsPermission permission,
boolean overwrite,
int bufferSize,
short replication,
long blockSize,
Progressable progress)
Deprecated.
|
boolean |
NativeS3FileSystem.delete(Path f,
boolean recursive)
Deprecated.
|
FileStatus |
NativeS3FileSystem.getFileStatus(Path f)
Deprecated.
|
FileStatus[] |
NativeS3FileSystem.listStatus(Path f)
Deprecated.
|
boolean |
NativeS3FileSystem.mkdirs(Path f,
FsPermission permission)
Deprecated.
|
FSDataInputStream |
NativeS3FileSystem.open(Path f,
int bufferSize)
Deprecated.
|
boolean |
NativeS3FileSystem.rename(Path src,
Path dst)
Deprecated.
|
void |
NativeS3FileSystem.setWorkingDirectory(Path new_dir)
Deprecated.
|
| Modifier and Type | Method and Description |
|---|---|
Path |
ViewFileSystem.createSnapshot(Path path,
String snapshotName) |
Path |
ViewFs.createSnapshot(Path path,
String snapshotName) |
Path |
ViewFileSystem.getHomeDirectory() |
Path |
ViewFs.getHomeDirectory() |
Path |
ViewFileSystem.getLinkTarget(Path path) |
Path |
ViewFs.getLinkTarget(Path f) |
Path |
ViewFileSystem.getTrashRoot(Path path)
Get the trash root directory for current user when the path
specified is deleted.
|
Path |
ViewFileSystem.getWorkingDirectory() |
Path |
ViewFileSystem.resolvePath(Path f) |
Path |
ViewFs.resolvePath(Path f) |
| Modifier and Type | Method and Description |
|---|---|
void |
ViewFileSystem.access(Path path,
FsAction mode) |
void |
ViewFs.access(Path path,
FsAction mode) |
FSDataOutputStream |
ViewFileSystem.append(Path f,
int bufferSize,
Progressable progress) |
FSDataOutputStream |
ViewFileSystem.create(Path f,
FsPermission permission,
boolean overwrite,
int bufferSize,
short replication,
long blockSize,
Progressable progress) |
FSDataOutputStream |
ViewFs.createInternal(Path f,
EnumSet<CreateFlag> flag,
FsPermission absolutePermission,
int bufferSize,
short replication,
long blockSize,
Progressable progress,
org.apache.hadoop.fs.Options.ChecksumOpt checksumOpt,
boolean createParent) |
FSDataOutputStream |
ViewFileSystem.createNonRecursive(Path f,
FsPermission permission,
EnumSet<CreateFlag> flags,
int bufferSize,
short replication,
long blockSize,
Progressable progress) |
Path |
ViewFileSystem.createSnapshot(Path path,
String snapshotName) |
Path |
ViewFs.createSnapshot(Path path,
String snapshotName) |
void |
ViewFs.createSymlink(Path target,
Path link,
boolean createParent) |
boolean |
ViewFileSystem.delete(Path f) |
boolean |
ViewFileSystem.delete(Path f,
boolean recursive) |
boolean |
ViewFs.delete(Path f,
boolean recursive) |
void |
ViewFileSystem.deleteSnapshot(Path path,
String snapshotName) |
void |
ViewFs.deleteSnapshot(Path path,
String snapshotName) |
AclStatus |
ViewFileSystem.getAclStatus(Path path) |
AclStatus |
ViewFs.getAclStatus(Path path) |
ContentSummary |
ViewFileSystem.getContentSummary(Path f) |
long |
ViewFileSystem.getDefaultBlockSize(Path f) |
short |
ViewFileSystem.getDefaultReplication(Path f) |
BlockLocation[] |
ViewFs.getFileBlockLocations(Path f,
long start,
long len) |
FileChecksum |
ViewFileSystem.getFileChecksum(Path f) |
FileChecksum |
ViewFs.getFileChecksum(Path f) |
FileChecksum |
ViewFileSystem.getFileChecksum(Path f,
long length) |
FileStatus |
ViewFs.getFileLinkStatus(Path f) |
FileStatus |
ViewFileSystem.getFileStatus(Path f) |
FileStatus |
ViewFs.getFileStatus(Path f) |
Path |
ViewFileSystem.getLinkTarget(Path path) |
Path |
ViewFs.getLinkTarget(Path f) |
QuotaUsage |
ViewFileSystem.getQuotaUsage(Path f) |
FsServerDefaults |
ViewFileSystem.getServerDefaults(Path f) |
FsServerDefaults |
ViewFs.getServerDefaults(Path f) |
static Map<org.apache.hadoop.fs.viewfs.ViewFileSystem.MountPoint,FsStatus> |
ViewFileSystemUtil.getStatus(FileSystem fileSystem,
Path path)
Get FsStatus for all ViewFsMountPoints matching path for the given
ViewFileSystem.
|
FsStatus |
ViewFileSystem.getStatus(Path p) |
BlockStoragePolicySpi |
ViewFileSystem.getStoragePolicy(Path src) |
BlockStoragePolicySpi |
ViewFs.getStoragePolicy(Path src)
Retrieve the storage policy for a given file or directory.
|
Path |
ViewFileSystem.getTrashRoot(Path path)
Get the trash root directory for current user when the path
specified is deleted.
|
byte[] |
ViewFileSystem.getXAttr(Path path,
String name) |
byte[] |
ViewFs.getXAttr(Path path,
String name) |
Map<String,byte[]> |
ViewFileSystem.getXAttrs(Path path) |
Map<String,byte[]> |
ViewFs.getXAttrs(Path path) |
Map<String,byte[]> |
ViewFileSystem.getXAttrs(Path path,
List<String> names) |
Map<String,byte[]> |
ViewFs.getXAttrs(Path path,
List<String> names) |
boolean |
ViewFileSystem.hasPathCapability(Path path,
String capability)
Reject the concat operation; forward the rest to the viewed FS.
|
org.apache.hadoop.fs.RemoteIterator<LocatedFileStatus> |
ViewFs.listLocatedStatus(Path f) |
org.apache.hadoop.fs.RemoteIterator<LocatedFileStatus> |
ViewFileSystem.listLocatedStatus(Path f,
PathFilter filter) |
FileStatus[] |
ViewFileSystem.listStatus(Path f) |
FileStatus[] |
ViewFs.listStatus(Path f) |
org.apache.hadoop.fs.RemoteIterator<FileStatus> |
ViewFs.listStatusIterator(Path f) |
List<String> |
ViewFileSystem.listXAttrs(Path path) |
List<String> |
ViewFs.listXAttrs(Path path) |
void |
ViewFs.mkdir(Path dir,
FsPermission permission,
boolean createParent) |
boolean |
ViewFileSystem.mkdirs(Path dir) |
boolean |
ViewFileSystem.mkdirs(Path dir,
FsPermission permission) |
void |
ViewFileSystem.modifyAclEntries(Path path,
List<AclEntry> aclSpec) |
void |
ViewFs.modifyAclEntries(Path path,
List<AclEntry> aclSpec) |
FSDataInputStream |
ViewFileSystem.open(Path f,
int bufferSize) |
FSDataInputStream |
ViewFs.open(Path f,
int bufferSize) |
void |
ViewFileSystem.removeAcl(Path path) |
void |
ViewFs.removeAcl(Path path) |
void |
ViewFileSystem.removeAclEntries(Path path,
List<AclEntry> aclSpec) |
void |
ViewFs.removeAclEntries(Path path,
List<AclEntry> aclSpec) |
void |
ViewFileSystem.removeDefaultAcl(Path path) |
void |
ViewFs.removeDefaultAcl(Path path) |
void |
ViewFileSystem.removeXAttr(Path path,
String name) |
void |
ViewFs.removeXAttr(Path path,
String name) |
boolean |
ViewFileSystem.rename(Path src,
Path dst) |
void |
ViewFs.renameInternal(Path src,
Path dst) |
void |
ViewFs.renameInternal(Path src,
Path dst,
boolean overwrite) |
void |
ViewFileSystem.renameSnapshot(Path path,
String snapshotOldName,
String snapshotNewName) |
void |
ViewFs.renameSnapshot(Path path,
String snapshotOldName,
String snapshotNewName) |
Path |
ViewFileSystem.resolvePath(Path f) |
Path |
ViewFs.resolvePath(Path f) |
void |
ViewFileSystem.satisfyStoragePolicy(Path src) |
void |
ViewFs.satisfyStoragePolicy(Path path) |
void |
ViewFileSystem.setAcl(Path path,
List<AclEntry> aclSpec) |
void |
ViewFs.setAcl(Path path,
List<AclEntry> aclSpec) |
void |
ViewFileSystem.setOwner(Path f,
String username,
String groupname) |
void |
ViewFs.setOwner(Path f,
String username,
String groupname) |
void |
ViewFileSystem.setPermission(Path f,
FsPermission permission) |
void |
ViewFs.setPermission(Path f,
FsPermission permission) |
boolean |
ViewFileSystem.setReplication(Path f,
short replication) |
boolean |
ViewFs.setReplication(Path f,
short replication) |
void |
ViewFileSystem.setStoragePolicy(Path src,
String policyName) |
void |
ViewFs.setStoragePolicy(Path path,
String policyName) |
void |
ViewFileSystem.setTimes(Path f,
long mtime,
long atime) |
void |
ViewFs.setTimes(Path f,
long mtime,
long atime) |
void |
ViewFileSystem.setWorkingDirectory(Path new_dir) |
void |
ViewFileSystem.setXAttr(Path path,
String name,
byte[] value,
EnumSet<XAttrSetFlag> flag) |
void |
ViewFs.setXAttr(Path path,
String name,
byte[] value,
EnumSet<XAttrSetFlag> flag) |
boolean |
ViewFileSystem.truncate(Path f,
long newLength) |
boolean |
ViewFs.truncate(Path f,
long newLength) |
void |
ViewFileSystem.unsetStoragePolicy(Path src) |
void |
ViewFs.unsetStoragePolicy(Path src) |
| Constructor and Description |
|---|
NotInMountpointException(Path path,
String operation) |
| Modifier and Type | Method and Description |
|---|---|
void |
HdfsAdmin.allowSnapshot(Path path)
Allow snapshot on a directory.
|
void |
HdfsAdmin.clearQuota(Path src)
Clear the namespace quota (count of files, directories and sym links) for a
directory.
|
void |
HdfsAdmin.clearQuotaByStorageType(Path src,
StorageType type)
Clear the space quota by storage type for a directory.
|
void |
HdfsAdmin.clearSpaceQuota(Path src)
Clear the storage space quota (size of files) for a directory.
|
void |
HdfsAdmin.createEncryptionZone(Path path,
String keyName)
Deprecated.
|
void |
HdfsAdmin.createEncryptionZone(Path path,
String keyName,
EnumSet<CreateEncryptionZoneFlag> flags)
Create an encryption zone rooted at an empty existing directory, using the
specified encryption key.
|
void |
HdfsAdmin.disallowSnapshot(Path path)
Disallow snapshot on a directory.
|
EncryptionZone |
HdfsAdmin.getEncryptionZoneForPath(Path path)
Get the path of the encryption zone for a given file or directory.
|
org.apache.hadoop.hdfs.protocol.ErasureCodingPolicy |
HdfsAdmin.getErasureCodingPolicy(Path path)
Get the erasure coding policy information for the specified path
|
org.apache.hadoop.fs.FileEncryptionInfo |
HdfsAdmin.getFileEncryptionInfo(Path path)
Returns the FileEncryptionInfo on the HdfsFileStatus for the given path.
|
BlockStoragePolicySpi |
HdfsAdmin.getStoragePolicy(Path src)
Query the effective storage policy ID for the given file or directory.
|
void |
HdfsAdmin.provisionEncryptionZoneTrash(Path path)
Provision a trash directory for a given encryption zone.
|
void |
HdfsAdmin.reencryptEncryptionZone(Path zone,
org.apache.hadoop.hdfs.protocol.HdfsConstants.ReencryptAction action)
Performs re-encryption action for a given encryption zone.
|
void |
HdfsAdmin.satisfyStoragePolicy(Path path)
Set the source path to the specified storage policy.
|
void |
HdfsAdmin.setErasureCodingPolicy(Path path,
String ecPolicyName)
Set the source path to the specified erasure coding policy.
|
void |
HdfsAdmin.setQuota(Path src,
long quota)
Set the namespace quota (count of files, directories, and sym links) for a
directory.
|
void |
HdfsAdmin.setQuotaByStorageType(Path src,
StorageType type,
long quota)
Set the quota by storage type for a directory.
|
void |
HdfsAdmin.setSpaceQuota(Path src,
long spaceQuota)
Set the storage space quota (size of files) for a directory.
|
void |
HdfsAdmin.setStoragePolicy(Path src,
String policyName)
Set the source path to the specified storage policy.
|
void |
HdfsAdmin.unsetErasureCodingPolicy(Path path)
Unset erasure coding policy from the directory.
|
void |
HdfsAdmin.unsetStoragePolicy(Path src)
Unset the storage policy set for a given file or directory.
|
| Modifier and Type | Method and Description |
|---|---|
Path |
CacheDirectiveInfo.getPath() |
| Constructor and Description |
|---|
FileRegion(long blockId,
Path path,
long offset,
long length) |
FileRegion(long blockId,
Path path,
long offset,
long length,
long genStamp) |
FileRegion(long blockId,
Path path,
long offset,
long length,
long genStamp,
byte[] nonce) |
| Modifier and Type | Method and Description |
|---|---|
static String |
TextFileRegionAliasMap.blockPoolIDFromFileName(Path file) |
| Constructor and Description |
|---|
FSTreeWalk(Path root,
Configuration conf) |
| Modifier and Type | Method and Description |
|---|---|
static org.apache.hadoop.io.SequenceFile.Writer |
SequenceFile.createWriter(FileContext fc,
Configuration conf,
Path name,
Class keyClass,
Class valClass,
org.apache.hadoop.io.SequenceFile.CompressionType compressionType,
CompressionCodec codec,
org.apache.hadoop.io.SequenceFile.Metadata metadata,
EnumSet<CreateFlag> createFlag,
org.apache.hadoop.fs.Options.CreateOpts... opts)
Construct the preferred type of SequenceFile Writer.
|
static org.apache.hadoop.io.SequenceFile.Writer |
SequenceFile.createWriter(FileSystem fs,
Configuration conf,
Path name,
Class keyClass,
Class valClass)
Deprecated.
|
static org.apache.hadoop.io.SequenceFile.Writer |
SequenceFile.createWriter(FileSystem fs,
Configuration conf,
Path name,
Class keyClass,
Class valClass,
int bufferSize,
short replication,
long blockSize,
boolean createParent,
org.apache.hadoop.io.SequenceFile.CompressionType compressionType,
CompressionCodec codec,
org.apache.hadoop.io.SequenceFile.Metadata metadata)
Deprecated.
|
static org.apache.hadoop.io.SequenceFile.Writer |
SequenceFile.createWriter(FileSystem fs,
Configuration conf,
Path name,
Class keyClass,
Class valClass,
int bufferSize,
short replication,
long blockSize,
org.apache.hadoop.io.SequenceFile.CompressionType compressionType,
CompressionCodec codec,
Progressable progress,
org.apache.hadoop.io.SequenceFile.Metadata metadata)
Deprecated.
|
static org.apache.hadoop.io.SequenceFile.Writer |
SequenceFile.createWriter(FileSystem fs,
Configuration conf,
Path name,
Class keyClass,
Class valClass,
org.apache.hadoop.io.SequenceFile.CompressionType compressionType)
Deprecated.
|
static org.apache.hadoop.io.SequenceFile.Writer |
SequenceFile.createWriter(FileSystem fs,
Configuration conf,
Path name,
Class keyClass,
Class valClass,
org.apache.hadoop.io.SequenceFile.CompressionType compressionType,
CompressionCodec codec)
Deprecated.
|
static org.apache.hadoop.io.SequenceFile.Writer |
SequenceFile.createWriter(FileSystem fs,
Configuration conf,
Path name,
Class keyClass,
Class valClass,
org.apache.hadoop.io.SequenceFile.CompressionType compressionType,
CompressionCodec codec,
Progressable progress)
Deprecated.
|
static org.apache.hadoop.io.SequenceFile.Writer |
SequenceFile.createWriter(FileSystem fs,
Configuration conf,
Path name,
Class keyClass,
Class valClass,
org.apache.hadoop.io.SequenceFile.CompressionType compressionType,
CompressionCodec codec,
Progressable progress,
org.apache.hadoop.io.SequenceFile.Metadata metadata)
Deprecated.
|
static org.apache.hadoop.io.SequenceFile.Writer |
SequenceFile.createWriter(FileSystem fs,
Configuration conf,
Path name,
Class keyClass,
Class valClass,
org.apache.hadoop.io.SequenceFile.CompressionType compressionType,
Progressable progress)
Deprecated.
|
static long |
MapFile.fix(FileSystem fs,
Path dir,
Class<? extends Writable> keyClass,
Class<? extends Writable> valueClass,
boolean dryrun,
Configuration conf)
This method attempts to fix a corrupt MapFile by re-creating its index.
|
| Modifier and Type | Method and Description |
|---|---|
CompressionCodec |
CompressionCodecFactory.getCodec(Path file)
Find the relevant compression codec for the given file based on its
filename suffix.
|
| Modifier and Type | Method and Description |
|---|---|
static Path[] |
FileInputFormat.getInputPaths(JobConf conf)
Get the list of input
Paths for the map-reduce job. |
Path |
JobConf.getLocalPath(String pathString)
Constructs a local file name.
|
static Path |
FileOutputFormat.getOutputPath(JobConf conf)
Get the
Path to the output directory for the map-reduce job. |
Path |
FileSplit.getPath()
The file containing this split's data.
|
static Path |
FileOutputFormat.getPathForCustomFile(JobConf conf,
String name)
Helper function to generate a
Path for a file that is unique for
the task within the job output directory. |
static Path |
SkipBadRecords.getSkipOutputPath(Configuration conf)
Get the directory to which skipped records are written.
|
Path |
JobClient.getStagingAreaDir()
Fetch the staging area directory for the application
|
Path |
JobClient.getSystemDir()
Grab the jobtracker system directory path where job-specific files are to be placed.
|
static Path |
FileOutputFormat.getTaskOutputPath(JobConf conf,
String name)
Helper function to create the task's temporary output directory and
return the path to the task's output file.
|
Path |
JobConf.getWorkingDirectory()
Get the current working directory for the default file system.
|
static Path |
FileOutputFormat.getWorkOutputPath(JobConf conf)
Get the
Path to the task's temporary output directory
for the map-reduce job
Tasks' Side-Effect Files |
Path |
FileOutputCommitter.getWorkPath(TaskAttemptContext context,
Path outputPath) |
| Modifier and Type | Method and Description |
|---|---|
boolean |
OutputLogFilter.accept(Path path) |
static void |
FileInputFormat.addInputPath(JobConf conf,
Path path)
Add a
Path to the list of inputs for the map-reduce job. |
protected void |
FileInputFormat.addInputPathRecursively(List<FileStatus> result,
FileSystem fs,
Path path,
PathFilter inputFilter)
Add files in the input path recursively into the results.
|
static org.apache.hadoop.io.SequenceFile.Reader[] |
SequenceFileOutputFormat.getReaders(Configuration conf,
Path dir)
Open the output generated by this format.
|
static org.apache.hadoop.io.MapFile.Reader[] |
MapFileOutputFormat.getReaders(FileSystem ignored,
Path dir,
Configuration conf)
Open the output generated by this format.
|
Path |
FileOutputCommitter.getWorkPath(TaskAttemptContext context,
Path outputPath) |
static boolean |
JobClient.isJobDirValid(Path jobDirPath,
FileSystem fs)
Checks if the job directory is clean and has all the required components
for (re) starting the job
|
protected boolean |
KeyValueTextInputFormat.isSplitable(FileSystem fs,
Path file) |
protected boolean |
FileInputFormat.isSplitable(FileSystem fs,
Path filename)
Is the given filename splittable? Usually, true, but if the file is
stream compressed, it will not be.
|
protected boolean |
TextInputFormat.isSplitable(FileSystem fs,
Path file) |
protected boolean |
FixedLengthInputFormat.isSplitable(FileSystem fs,
Path file) |
protected FileSplit |
FileInputFormat.makeSplit(Path file,
long start,
long length,
String[] hosts)
A factory that makes the split for this class.
|
protected FileSplit |
FileInputFormat.makeSplit(Path file,
long start,
long length,
String[] hosts,
String[] inMemoryHosts)
A factory that makes the split for this class.
|
static void |
FileInputFormat.setInputPaths(JobConf conf,
Path... inputPaths)
Set the array of
Paths as the list of inputs
for the map-reduce job. |
static void |
FileOutputFormat.setOutputPath(JobConf conf,
Path outputDir)
Set the
Path of the output directory for the map-reduce job. |
static void |
SkipBadRecords.setSkipOutputPath(JobConf conf,
Path path)
Set the directory to which skipped records are written.
|
void |
JobConf.setWorkingDirectory(Path dir)
Set the current working directory for the default file system.
|
| Constructor and Description |
|---|
FileSplit(Path file,
long start,
long length,
JobConf conf)
Deprecated.
|
FileSplit(Path file,
long start,
long length,
String[] hosts)
Constructs a split with host information
|
FileSplit(Path file,
long start,
long length,
String[] hosts,
String[] inMemoryHosts)
Constructs a split with host information
|
JobConf(Path config)
Construct a map/reduce configuration.
|
MultiFileSplit(JobConf job,
Path[] files,
long[] lengths) |
| Modifier and Type | Method and Description |
|---|---|
static String |
CompositeInputFormat.compose(String op,
Class<? extends InputFormat> inf,
Path... path)
Convenience method for constructing composite formats.
|
| Modifier and Type | Method and Description |
|---|---|
static void |
MultipleInputs.addInputPath(JobConf conf,
Path path,
Class<? extends InputFormat> inputFormatClass)
Add a
Path with a custom InputFormat to the list of
inputs for the map-reduce job. |
static void |
MultipleInputs.addInputPath(JobConf conf,
Path path,
Class<? extends InputFormat> inputFormatClass,
Class<? extends Mapper> mapperClass)
|
protected static FileSplit |
NLineInputFormat.createFileSplit(Path fileName,
long begin,
long length)
NLineInputFormat uses LineRecordReader, which always reads
(and consumes) at least one character out of its upper split
boundary.
|
protected boolean |
CombineFileInputFormat.isSplitable(FileSystem fs,
Path file) |
static void |
TotalOrderPartitioner.setPartitionFile(JobConf job,
Path p)
Deprecated.
|
| Constructor and Description |
|---|
CombineFileSplit(JobConf job,
Path[] files,
long[] lengths) |
CombineFileSplit(JobConf job,
Path[] files,
long[] start,
long[] lengths,
String[] locations) |
| Modifier and Type | Method and Description |
|---|---|
Path[] |
JobContext.getArchiveClassPaths()
Get the archive entries in classpath as an array of Path
|
Path[] |
JobContext.getFileClassPaths()
Get the file entries in classpath as an array of Path
|
Path[] |
JobContext.getLocalCacheArchives()
Deprecated.
the array returned only includes the items the were
downloaded. There is no way to map this to what is returned by
JobContext.getCacheArchives(). |
Path[] |
JobContext.getLocalCacheFiles()
Deprecated.
the array returned only includes the items the were
downloaded. There is no way to map this to what is returned by
JobContext.getCacheFiles(). |
Path |
Cluster.getStagingAreaDir()
Grab the jobtracker's view of the staging directory path where
job-specific files will be placed.
|
Path |
Cluster.getSystemDir()
Grab the jobtracker system directory path where
job-specific files will be placed.
|
Path |
JobContext.getWorkingDirectory()
Get the current working directory for the default file system.
|
| Modifier and Type | Method and Description |
|---|---|
void |
Job.addArchiveToClassPath(Path archive)
Add an archive path to the current set of classpath entries.
|
void |
Job.addFileToClassPath(Path file)
Add an file path to the current set of classpath entries It adds the file
to cache as well.
|
void |
Job.setWorkingDirectory(Path dir)
Set the current working directory for the default file system.
|
| Modifier and Type | Method and Description |
|---|---|
static Path[] |
FileInputFormat.getInputPaths(JobContext context)
Get the list of input
Paths for the map-reduce job. |
Path |
FileSplit.getPath()
The file containing this split's data.
|
Path |
CombineFileSplit.getPath(int i)
Returns the ith Path
|
Path[] |
CombineFileSplit.getPaths()
Returns all the Paths in the split
|
| Modifier and Type | Method and Description |
|---|---|
static void |
FileInputFormat.addInputPath(Job job,
Path path)
Add a
Path to the list of inputs for the map-reduce job. |
static void |
MultipleInputs.addInputPath(Job job,
Path path,
Class<? extends InputFormat> inputFormatClass)
Add a
Path with a custom InputFormat to the list of
inputs for the map-reduce job. |
static void |
MultipleInputs.addInputPath(Job job,
Path path,
Class<? extends InputFormat> inputFormatClass,
Class<? extends Mapper> mapperClass)
|
protected void |
FileInputFormat.addInputPathRecursively(List<FileStatus> result,
FileSystem fs,
Path path,
PathFilter inputFilter)
Add files in the input path recursively into the results.
|
protected static FileSplit |
NLineInputFormat.createFileSplit(Path fileName,
long begin,
long length)
NLineInputFormat uses LineRecordReader, which always reads
(and consumes) at least one character out of its upper split
boundary.
|
protected boolean |
CombineFileInputFormat.isSplitable(JobContext context,
Path file) |
protected boolean |
KeyValueTextInputFormat.isSplitable(JobContext context,
Path file) |
protected boolean |
FileInputFormat.isSplitable(JobContext context,
Path filename)
Is the given filename splittable? Usually, true, but if the file is
stream compressed, it will not be.
|
protected boolean |
TextInputFormat.isSplitable(JobContext context,
Path file) |
protected boolean |
FixedLengthInputFormat.isSplitable(JobContext context,
Path file) |
protected FileSplit |
FileInputFormat.makeSplit(Path file,
long start,
long length,
String[] hosts)
A factory that makes the split for this class.
|
protected FileSplit |
FileInputFormat.makeSplit(Path file,
long start,
long length,
String[] hosts,
String[] inMemoryHosts)
A factory that makes the split for this class.
|
static void |
FileInputFormat.setInputPaths(Job job,
Path... inputPaths)
Set the array of
Paths as the list of inputs
for the map-reduce job. |
| Constructor and Description |
|---|
CombineFileSplit(Path[] files,
long[] lengths) |
CombineFileSplit(Path[] files,
long[] start,
long[] lengths,
String[] locations) |
FileSplit(Path file,
long start,
long length,
String[] hosts)
Constructs a split with host information
|
FileSplit(Path file,
long start,
long length,
String[] hosts,
String[] inMemoryHosts)
Constructs a split with host and cached-blocks information
|
| Modifier and Type | Method and Description |
|---|---|
static String |
CompositeInputFormat.compose(String op,
Class<? extends InputFormat> inf,
Path... path)
Convenience method for constructing composite formats.
|
| Modifier and Type | Method and Description |
|---|---|
Path |
PartialFileOutputCommitter.getCommittedTaskPath(int appAttemptId,
TaskAttemptContext context) |
protected Path |
FileOutputCommitter.getCommittedTaskPath(int appAttemptId,
TaskAttemptContext context)
Compute the path where the output of a committed task is stored until the
entire job is committed for a specific application attempt.
|
Path |
FileOutputCommitter.getCommittedTaskPath(TaskAttemptContext context)
Compute the path where the output of a committed task is stored until
the entire job is committed.
|
static Path |
FileOutputCommitter.getCommittedTaskPath(TaskAttemptContext context,
Path out) |
Path |
FileOutputFormat.getDefaultWorkFile(TaskAttemptContext context,
String extension)
Get the default path and filename for the output format.
|
protected Path |
FileOutputCommitter.getJobAttemptPath(int appAttemptId)
Compute the path where the output of a given job attempt will be placed.
|
Path |
FileOutputCommitter.getJobAttemptPath(JobContext context)
Compute the path where the output of a given job attempt will be placed.
|
static Path |
FileOutputCommitter.getJobAttemptPath(JobContext context,
Path out)
Compute the path where the output of a given job attempt will be placed.
|
abstract Path |
PathOutputCommitter.getOutputPath()
Get the final directory where work will be placed once the job
is committed.
|
Path |
FileOutputCommitter.getOutputPath() |
Path |
BindingPathOutputCommitter.getOutputPath() |
static Path |
FileOutputFormat.getOutputPath(JobContext job)
Get the
Path to the output directory for the map-reduce job. |
static Path |
FileOutputFormat.getPathForWorkFile(TaskInputOutputContext<?,?,?,?> context,
String name,
String extension)
Helper function to generate a
Path for a file that is unique for
the task within the job output directory. |
Path |
FileOutputCommitter.getTaskAttemptPath(TaskAttemptContext context)
Compute the path where the output of a task attempt is stored until
that task is committed.
|
static Path |
FileOutputCommitter.getTaskAttemptPath(TaskAttemptContext context,
Path out)
Compute the path where the output of a task attempt is stored until
that task is committed.
|
static Path |
FileOutputFormat.getWorkOutputPath(TaskInputOutputContext<?,?,?,?> context)
Get the
Path to the task's temporary output directory
for the map-reduce job
Tasks' Side-Effect Files |
abstract Path |
PathOutputCommitter.getWorkPath()
Get the directory that the task should write results into.
|
Path |
FileOutputCommitter.getWorkPath()
Get the directory that the task should write results into.
|
Path |
BindingPathOutputCommitter.getWorkPath() |
| Modifier and Type | Method and Description |
|---|---|
static Path |
FileOutputCommitter.getCommittedTaskPath(TaskAttemptContext context,
Path out) |
static Path |
FileOutputCommitter.getJobAttemptPath(JobContext context,
Path out)
Compute the path where the output of a given job attempt will be placed.
|
static org.apache.hadoop.io.MapFile.Reader[] |
MapFileOutputFormat.getReaders(Path dir,
Configuration conf)
Open the output generated by this format.
|
static Path |
FileOutputCommitter.getTaskAttemptPath(TaskAttemptContext context,
Path out)
Compute the path where the output of a task attempt is stored until
that task is committed.
|
static void |
FileOutputFormat.setOutputPath(Job job,
Path outputDir)
Set the
Path of the output directory for the map-reduce job. |
| Constructor and Description |
|---|
BindingPathOutputCommitter(Path outputPath,
TaskAttemptContext context)
Instantiate.
|
FileOutputCommitter(Path outputPath,
JobContext context)
Create a file output committer
|
FileOutputCommitter(Path outputPath,
TaskAttemptContext context)
Create a file output committer
|
PartialFileOutputCommitter(Path outputPath,
JobContext context) |
PartialFileOutputCommitter(Path outputPath,
TaskAttemptContext context) |
PathOutputCommitter(Path outputPath,
JobContext context)
Constructor for a job attempt.
|
PathOutputCommitter(Path outputPath,
TaskAttemptContext context)
Constructor for a task attempt.
|
| Modifier and Type | Method and Description |
|---|---|
static void |
TotalOrderPartitioner.setPartitionFile(Configuration conf,
Path p)
Set the path to the SequenceFile storing the sorted partition keyset.
|
| Modifier and Type | Method and Description |
|---|---|
static void |
TokenCache.obtainTokensForNamenodes(Credentials credentials,
Path[] ps,
Configuration conf)
Convenience method to obtain delegation tokens from namenodes
corresponding to the paths passed.
|
| Modifier and Type | Method and Description |
|---|---|
protected org.apache.hadoop.mapreduce.v2.hs.HistoryFileManager.HistoryFileInfo |
HistoryFileManager.createHistoryFileInfo(Path historyFile,
Path confFile,
Path summaryFile,
org.apache.hadoop.mapreduce.v2.jobhistory.JobIndexInfo jobIndexInfo,
boolean isInDone) |
protected static List<FileStatus> |
HistoryFileManager.scanDirectory(Path path,
FileContext fc,
PathFilter pathFilter) |
protected List<FileStatus> |
HistoryFileManager.scanDirectoryForHistoryFiles(Path path,
FileContext fc) |
| Modifier and Type | Field and Description |
|---|---|
protected Path |
RollingFileSystemSink.basePath |
| Modifier and Type | Method and Description |
|---|---|
static Credentials |
Credentials.readTokenStorageFile(Path filename,
Configuration conf)
Convenience method for reading a token storage file and loading its Tokens.
|
void |
Credentials.writeTokenStorageFile(Path filename,
Configuration conf) |
void |
Credentials.writeTokenStorageFile(Path filename,
Configuration conf,
org.apache.hadoop.security.Credentials.SerializedFormat format) |
| Modifier and Type | Method and Description |
|---|---|
protected Path |
DistCp.createInputFileListing(Job job)
Create input listing by invoking an appropriate copy listing
implementation.
|
Path |
DistCpOptions.getAtomicWorkPath() |
protected Path |
DistCp.getFileListingPath()
Get default name of the copy listing file.
|
Path |
DistCpOptions.getLogPath() |
Path |
DistCpOptions.getSourceFileListing() |
Path |
DistCpOptions.getTargetPath() |
Path |
DistCpOptions.getTrackPath() |
| Modifier and Type | Method and Description |
|---|---|
List<Path> |
DistCpOptions.getSourcePaths() |
| Modifier and Type | Method and Description |
|---|---|
Path |
URL.toPath() |
| Modifier and Type | Method and Description |
|---|---|
static URL |
URL.fromPath(Path path) |
| Modifier and Type | Method and Description |
|---|---|
abstract String |
SharedCacheClient.getFileChecksum(Path sourceFile)
A convenience method to calculate the checksum of a specified file.
|
| Constructor and Description |
|---|
LogReader(Configuration conf,
Path remoteAppLogFile) |
| Modifier and Type | Field and Description |
|---|---|
protected Path |
LogAggregationFileController.remoteRootLogDir |
| Modifier and Type | Method and Description |
|---|---|
Path |
LogAggregationFileController.getOlderRemoteAppLogDir(ApplicationId appId,
String appOwner)
Get the older remote application directory for log aggregation.
|
Path |
LogAggregationFileController.getRemoteAppLogDir(ApplicationId appId,
String appOwner)
Get the remote application directory for log aggregation.
|
Path |
LogAggregationFileController.getRemoteNodeLogFileForApp(ApplicationId appId,
String user,
NodeId nodeId)
Get the remote aggregated log path.
|
Path |
LogAggregationFileController.getRemoteRootLogDir()
Get the remote root log directory.
|
| Modifier and Type | Method and Description |
|---|---|
protected boolean |
LogAggregationFileController.checkExists(FileSystem fs,
Path path,
FsPermission fsPerm) |
protected void |
LogAggregationFileController.cleanOldLogs(Path remoteNodeLogFileForApp,
NodeId nodeId,
UserGroupInformation userUgi) |
protected void |
LogAggregationFileController.createDir(FileSystem fs,
Path path,
FsPermission fsPerm) |
abstract Map<ApplicationAccessType,String> |
LogAggregationFileController.getApplicationAcls(Path aggregatedLogPath,
ApplicationId appId)
Returns ACLs for the application.
|
abstract String |
LogAggregationFileController.getApplicationOwner(Path aggregatedLogPath,
ApplicationId appId)
Returns the owner of the application.
|
| Modifier and Type | Method and Description |
|---|---|
protected Path |
ServiceClient.addJarResource(String serviceName,
Map<String,LocalResource> localResources) |
| Modifier and Type | Method and Description |
|---|---|
static Path |
ConverterUtils.getPathFromYarnURL(URL url)
Deprecated.
|
| Modifier and Type | Method and Description |
|---|---|
static URL |
ConverterUtils.getYarnUrlFromPath(Path path)
Deprecated.
|
Copyright © 2020 Apache Software Foundation. All rights reserved.