Package | Description |
---|---|
org.apache.hadoop.fs |
Implementations of
AbstractFileSystem for hdfs
over rpc and hdfs over web. |
org.apache.hadoop.fs.viewfs |
ViewFileSystem and ViewFileSystemOverloadScheme classes.
|
org.apache.hadoop.mapred | |
org.apache.hadoop.mapreduce.lib.input |
Modifier and Type | Method and Description |
---|---|
BlockLocation[] |
LocatedFileStatus.getBlockLocations()
Get the file's block locations
In HDFS, the returned BlockLocation will have different formats for
replicated and erasure coded file.
|
BlockLocation[] |
FileSystem.getFileBlockLocations(FileStatus file,
long start,
long len)
Return an array containing hostnames, offset and size of
portions of the given file.
|
BlockLocation[] |
FilterFileSystem.getFileBlockLocations(FileStatus file,
long start,
long len) |
abstract BlockLocation[] |
AbstractFileSystem.getFileBlockLocations(Path f,
long start,
long len)
The specification of this method matches that of
FileContext.getFileBlockLocations(Path, long, long) except that
Path f must be for this file system. |
BlockLocation[] |
FileSystem.getFileBlockLocations(Path p,
long start,
long len)
Return an array containing hostnames, offset and size of
portions of the given file.
|
Modifier and Type | Method and Description |
---|---|
protected void |
LocatedFileStatus.setBlockLocations(BlockLocation[] locations)
Hook for subclasses to lazily set block locations.
|
Constructor and Description |
---|
BlockLocation(BlockLocation that)
Copy constructor.
|
LocatedFileStatus(FileStatus stat,
BlockLocation[] locations)
Constructor
|
LocatedFileStatus(long length,
boolean isdir,
int block_replication,
long blocksize,
long modification_time,
long access_time,
FsPermission permission,
String owner,
String group,
Path symlink,
Path path,
BlockLocation[] locations)
Deprecated.
|
LocatedFileStatus(long length,
boolean isdir,
int block_replication,
long blocksize,
long modification_time,
long access_time,
FsPermission permission,
String owner,
String group,
Path symlink,
Path path,
boolean hasAcl,
boolean isEncrypted,
boolean isErasureCoded,
BlockLocation[] locations)
Constructor.
|
LocatedFileStatus(long length,
boolean isdir,
int block_replication,
long blocksize,
long modification_time,
long access_time,
FsPermission permission,
String owner,
String group,
Path symlink,
Path path,
Set<org.apache.hadoop.fs.FileStatus.AttrFlags> attr,
BlockLocation[] locations)
Constructor.
|
Modifier and Type | Method and Description |
---|---|
BlockLocation[] |
ViewFileSystem.getFileBlockLocations(FileStatus fs,
long start,
long len) |
BlockLocation[] |
ViewFs.getFileBlockLocations(Path f,
long start,
long len) |
Modifier and Type | Method and Description |
---|---|
protected int |
FileInputFormat.getBlockIndex(BlockLocation[] blkLocations,
long offset) |
protected String[] |
FileInputFormat.getSplitHosts(BlockLocation[] blkLocations,
long offset,
long splitSize,
org.apache.hadoop.net.NetworkTopology clusterMap)
This function identifies and returns the hosts that contribute
most for a given split.
|
Modifier and Type | Method and Description |
---|---|
protected BlockLocation[] |
CombineFileInputFormat.getFileBlockLocations(FileSystem fs,
FileStatus stat) |
Modifier and Type | Method and Description |
---|---|
protected int |
FileInputFormat.getBlockIndex(BlockLocation[] blkLocations,
long offset) |
Copyright © 2023 Apache Software Foundation. All rights reserved.