| Modifier and Type | Class and Description |
|---|---|
class |
Configuration
Provides access to configuration parameters.
|
| Modifier and Type | Class and Description |
|---|---|
class |
ContentSummary
Store the summary of a content (a directory or a file).
|
class |
FileChecksum
An abstract class representing file checksums for files.
|
class |
FileStatus
Interface that represents the client side information for a file.
|
class |
FsServerDefaults
Provides server default configuration values to clients.
|
class |
FsStatus
This class is used to represent the capacity, free and used space on a
FileSystem. |
class |
LocatedFileStatus
This class defines a FileStatus that includes a file's block locations.
|
| Modifier and Type | Class and Description |
|---|---|
class |
FsPermission
A class for file/directory permissions.
|
| Modifier and Type | Interface and Description |
|---|---|
interface |
WritableComparable<T>
A
Writable which is also Comparable. |
| Modifier and Type | Class and Description |
|---|---|
class |
AbstractMapWritable
Abstract base class for MapWritable and SortedMapWritable
Unlike org.apache.nutch.crawl.MapWritable, this class allows creation of
MapWritable<Writable, MapWritable> so the CLASS_TO_ID and ID_TO_CLASS
maps travel with the class instead of being static.
|
class |
ArrayPrimitiveWritable
This is a wrapper class.
|
class |
ArrayWritable
A Writable for arrays containing instances of a class.
|
class |
BooleanWritable
A WritableComparable for booleans.
|
class |
BytesWritable
A byte sequence that is usable as a key or value.
|
class |
ByteWritable
A WritableComparable for a single byte.
|
class |
CompressedWritable
A base-class for Writables which store themselves compressed and lazily
inflate on field access.
|
class |
DoubleWritable
Writable for Double values.
|
class |
EnumSetWritable<E extends Enum<E>>
A Writable wrapper for EnumSet.
|
class |
FloatWritable
A WritableComparable for floats.
|
class |
GenericWritable
A wrapper for Writable instances.
|
class |
IntWritable
A WritableComparable for ints.
|
class |
LongWritable
A WritableComparable for longs.
|
class |
MapWritable
A Writable Map.
|
class |
MD5Hash
A Writable for MD5 hash values.
|
class |
NullWritable
Singleton Writable with no data.
|
class |
ObjectWritable
A polymorphic Writable that writes an instance with it's class name.
|
class |
ShortWritable
A WritableComparable for shorts.
|
class |
SortedMapWritable
A Writable SortedMap.
|
class |
Text
This class stores text using standard UTF8 encoding.
|
class |
TwoDArrayWritable
A Writable for 2D arrays containing a matrix of instances of a class.
|
class |
VersionedWritable
A base class for Writables that provides version checking.
|
class |
VIntWritable
A WritableComparable for integer values stored in variable-length format.
|
class |
VLongWritable
A WritableComparable for longs in a variable-length format.
|
| Modifier and Type | Method and Description |
|---|---|
static <T extends Writable> |
WritableUtils.clone(T orig,
Configuration conf)
Make a copy of a writable object using serialization to a buffer.
|
| Modifier and Type | Method and Description |
|---|---|
Writable[][] |
TwoDArrayWritable.get() |
Writable |
GenericWritable.get()
Return the wrapped instance.
|
Writable[] |
ArrayWritable.get() |
Writable |
SortedMapWritable.get(Object key) |
Writable |
MapWritable.get(Object key) |
Writable |
WritableFactory.newInstance()
Return a new instance.
|
static Writable |
WritableFactories.newInstance(Class<? extends Writable> c)
Create a new instance of a class with a defined factory.
|
static Writable |
WritableFactories.newInstance(Class<? extends Writable> c,
Configuration conf)
Create a new instance of a class with a defined factory.
|
Writable |
SortedMapWritable.put(WritableComparable key,
Writable value) |
Writable |
MapWritable.put(Writable key,
Writable value) |
Writable |
SortedMapWritable.remove(Object key) |
Writable |
MapWritable.remove(Object key) |
| Modifier and Type | Method and Description |
|---|---|
Set<Map.Entry<WritableComparable,Writable>> |
SortedMapWritable.entrySet() |
Set<Map.Entry<Writable,Writable>> |
MapWritable.entrySet() |
Set<Map.Entry<Writable,Writable>> |
MapWritable.entrySet() |
SortedMap<WritableComparable,Writable> |
SortedMapWritable.headMap(WritableComparable toKey) |
Set<Writable> |
MapWritable.keySet() |
SortedMap<WritableComparable,Writable> |
SortedMapWritable.subMap(WritableComparable fromKey,
WritableComparable toKey) |
SortedMap<WritableComparable,Writable> |
SortedMapWritable.tailMap(WritableComparable fromKey) |
Collection<Writable> |
SortedMapWritable.values() |
Collection<Writable> |
MapWritable.values() |
| Modifier and Type | Method and Description |
|---|---|
static void |
WritableUtils.cloneInto(Writable dst,
Writable src)
Deprecated.
use ReflectionUtils.cloneInto instead.
|
protected void |
AbstractMapWritable.copy(Writable other)
Used by child copy constructors.
|
Writable |
SortedMapWritable.put(WritableComparable key,
Writable value) |
Writable |
MapWritable.put(Writable key,
Writable value) |
void |
GenericWritable.set(Writable obj)
Set the instance that is wrapped.
|
void |
ArrayWritable.set(Writable[] values) |
void |
TwoDArrayWritable.set(Writable[][] values) |
static byte[] |
WritableUtils.toByteArray(Writable... writables)
Convert writables to a byte array
|
| Modifier and Type | Method and Description |
|---|---|
static long |
MapFile.fix(FileSystem fs,
Path dir,
Class<? extends Writable> keyClass,
Class<? extends Writable> valueClass,
boolean dryrun,
Configuration conf)
This method attempts to fix a corrupt MapFile by re-creating its index.
|
static long |
MapFile.fix(FileSystem fs,
Path dir,
Class<? extends Writable> keyClass,
Class<? extends Writable> valueClass,
boolean dryrun,
Configuration conf)
This method attempts to fix a corrupt MapFile by re-creating its index.
|
static Writable |
WritableFactories.newInstance(Class<? extends Writable> c)
Create a new instance of a class with a defined factory.
|
static Writable |
WritableFactories.newInstance(Class<? extends Writable> c,
Configuration conf)
Create a new instance of a class with a defined factory.
|
void |
MapWritable.putAll(Map<? extends Writable,? extends Writable> t) |
void |
MapWritable.putAll(Map<? extends Writable,? extends Writable> t) |
void |
SortedMapWritable.putAll(Map<? extends WritableComparable,? extends Writable> t) |
| Constructor and Description |
|---|
ArrayWritable(Class<? extends Writable> valueClass,
Writable[] values) |
TwoDArrayWritable(Class valueClass,
Writable[][] values) |
| Constructor and Description |
|---|
ArrayWritable(Class<? extends Writable> valueClass) |
ArrayWritable(Class<? extends Writable> valueClass,
Writable[] values) |
| Modifier and Type | Method and Description |
|---|---|
static <T extends Writable> |
Client.getAsyncRpcResponse() |
| Modifier and Type | Method and Description |
|---|---|
abstract Writable |
Server.call(org.apache.hadoop.ipc.RPC.RpcKind rpcKind,
String protocol,
Writable param,
long receiveTime)
Called for each call.
|
Writable |
Client.call(org.apache.hadoop.ipc.RPC.RpcKind rpcKind,
Writable rpcRequest,
org.apache.hadoop.ipc.Client.ConnectionId remoteId,
AtomicBoolean fallbackToSimpleAuth)
Make a call, passing
rpcRequest, to the IPC server defined by
remoteId, returning the rpc respond. |
Writable |
Server.call(Writable param,
long receiveTime)
Deprecated.
Use
Server.call(RPC.RpcKind, String, Writable, long)
instead. |
| Modifier and Type | Method and Description |
|---|---|
Class<? extends Writable> |
Server.getRpcRequestWrapper(org.apache.hadoop.ipc.protobuf.RpcHeaderProtos.RpcKindProto rpcKind) |
| Modifier and Type | Method and Description |
|---|---|
abstract Writable |
Server.call(org.apache.hadoop.ipc.RPC.RpcKind rpcKind,
String protocol,
Writable param,
long receiveTime)
Called for each call.
|
Writable |
Client.call(org.apache.hadoop.ipc.RPC.RpcKind rpcKind,
Writable rpcRequest,
org.apache.hadoop.ipc.Client.ConnectionId remoteId,
AtomicBoolean fallbackToSimpleAuth)
Make a call, passing
rpcRequest, to the IPC server defined by
remoteId, returning the rpc respond. |
Writable |
Server.call(Writable param,
long receiveTime)
Deprecated.
Use
Server.call(RPC.RpcKind, String, Writable, long)
instead. |
| Modifier and Type | Method and Description |
|---|---|
static void |
Server.registerProtocolEngine(org.apache.hadoop.ipc.RPC.RpcKind rpcKind,
Class<? extends Writable> rpcRequestWrapperClass,
org.apache.hadoop.ipc.RPC.RpcInvoker rpcInvoker)
Register a RPC kind and the class to deserialize the rpc request.
|
| Constructor and Description |
|---|
Client(Class<? extends Writable> valueClass,
Configuration conf)
Construct an IPC client with the default SocketFactory
|
Client(Class<? extends Writable> valueClass,
Configuration conf,
SocketFactory factory)
Construct an IPC client whose values are of the given
Writable
class. |
Server(String bindAddress,
int port,
Class<? extends Writable> paramClass,
int handlerCount,
Configuration conf) |
Server(String bindAddress,
int port,
Class<? extends Writable> rpcRequestClass,
int handlerCount,
int numReaders,
int queueSizePerHandler,
Configuration conf,
String serverName,
SecretManager<? extends TokenIdentifier> secretManager) |
Server(String bindAddress,
int port,
Class<? extends Writable> rpcRequestClass,
int handlerCount,
int numReaders,
int queueSizePerHandler,
Configuration conf,
String serverName,
SecretManager<? extends TokenIdentifier> secretManager,
String portRangeConfig)
Constructs a server listening on the named port and address.
|
| Modifier and Type | Interface and Description |
|---|---|
interface |
InputSplit
InputSplit represents the data to be processed by an
individual Mapper. |
interface |
InputSplitWithLocationInfo |
| Modifier and Type | Class and Description |
|---|---|
class |
ClusterStatus
Status information on the current state of the Map-Reduce cluster.
|
class |
Counters
A set of named counters.
|
static class |
Counters.Counter
A counter record, comprising its name and value.
|
static class |
Counters.Group
Group of counters, comprising of counters from a particular
counter Enum class. |
class |
FileSplit
A section of an input file.
|
class |
JobConf
A map/reduce job configuration.
|
class |
JobQueueInfo
Class that contains the information regarding the Job Queues which are
maintained by the Hadoop Map/Reduce framework.
|
class |
MultiFileSplit
A sub-collection of input files.
|
| Modifier and Type | Method and Description |
|---|---|
static <K extends WritableComparable,V extends Writable> |
MapFileOutputFormat.getEntry(org.apache.hadoop.io.MapFile.Reader[] readers,
Partitioner<K,V> partitioner,
K key,
V value)
Get an entry from output generated by this class.
|
| Modifier and Type | Method and Description |
|---|---|
static <K extends WritableComparable,V extends Writable> |
MapFileOutputFormat.getEntry(org.apache.hadoop.io.MapFile.Reader[] readers,
Partitioner<K,V> partitioner,
K key,
V value)
Get an entry from output generated by this class.
|
| Modifier and Type | Method and Description |
|---|---|
RecordWriter<WritableComparable,Writable> |
MapFileOutputFormat.getRecordWriter(FileSystem ignored,
JobConf job,
String name,
Progressable progress) |
static Class<? extends Writable> |
SequenceFileAsBinaryOutputFormat.getSequenceFileOutputValueClass(JobConf conf)
Get the value class for the
SequenceFile |
| Modifier and Type | Class and Description |
|---|---|
class |
ArrayListBackedIterator<X extends Writable>
This class provides an implementation of ResetableIterator.
|
interface |
ComposableInputFormat<K extends WritableComparable,V extends Writable>
Refinement of InputFormat requiring implementors to provide
ComposableRecordReader instead of RecordReader.
|
interface |
ComposableRecordReader<K extends WritableComparable,V extends Writable>
Additional operations required of a RecordReader to participate in a join.
|
class |
CompositeRecordReader<K extends WritableComparable,V extends Writable,X extends Writable>
A RecordReader that can effect joins of RecordReaders sharing a common key
type and partitioning.
|
class |
CompositeRecordReader<K extends WritableComparable,V extends Writable,X extends Writable>
A RecordReader that can effect joins of RecordReaders sharing a common key
type and partitioning.
|
class |
MultiFilterRecordReader<K extends WritableComparable,V extends Writable>
Base class for Composite join returning values derived from multiple
sources, but generally not tuples.
|
class |
OverrideRecordReader<K extends WritableComparable,V extends Writable>
Prefer the "rightmost" data source for this key.
|
interface |
ResetableIterator<T extends Writable>
This defines an interface to a stateful Iterator that can replay elements
added to it directly.
|
class |
StreamBackedIterator<X extends Writable>
This class provides an implementation of ResetableIterator.
|
class |
WrappedRecordReader<K extends WritableComparable,U extends Writable>
Proxy class for a RecordReader participating in the join framework.
|
| Modifier and Type | Class and Description |
|---|---|
class |
CompositeInputSplit
This InputSplit contains a set of child InputSplits.
|
| Constructor and Description |
|---|
TupleWritable(Writable[] vals)
Initialize tuple with storage; unknown whether any of them contain
"written" values.
|
| Modifier and Type | Class and Description |
|---|---|
class |
ValueAggregatorCombiner<K1 extends WritableComparable,V1 extends Writable>
This class implements the generic combiner of Aggregate.
|
class |
ValueAggregatorJobBase<K1 extends WritableComparable,V1 extends Writable>
This abstract class implements some common functionalities of the
the generic mapper, reducer and combiner classes of Aggregate.
|
class |
ValueAggregatorMapper<K1 extends WritableComparable,V1 extends Writable>
This class implements the generic mapper of Aggregate.
|
class |
ValueAggregatorReducer<K1 extends WritableComparable,V1 extends Writable>
This class implements the generic reducer of Aggregate.
|
| Modifier and Type | Interface and Description |
|---|---|
interface |
Counter
A named counter that tracks the progress of a map/reduce job.
|
interface |
CounterGroup
A group of
Counters that logically belong together. |
| Modifier and Type | Class and Description |
|---|---|
class |
ClusterMetrics
Status information on the current state of the Map-Reduce cluster.
|
class |
ID
A general identifier, which internally stores the id
as an integer.
|
class |
JobID
JobID represents the immutable and unique identifier for
the job.
|
class |
JobStatus
Describes the current status of a job.
|
class |
QueueAclsInfo
Class to encapsulate Queue ACLs for a particular
user.
|
class |
QueueInfo
Class that contains the information regarding the Job Queues which are
maintained by the Hadoop Map/Reduce framework.
|
class |
TaskAttemptID
TaskAttemptID represents the immutable and unique identifier for
a task attempt.
|
class |
TaskCompletionEvent
This is used to track task completion events on
job tracker.
|
class |
TaskID
TaskID represents the immutable and unique identifier for
a Map or Reduce Task.
|
class |
org.apache.hadoop.mapreduce.TaskReport
A report on the state of a task.
|
class |
TaskTrackerInfo
Information about TaskTracker.
|
| Modifier and Type | Interface and Description |
|---|---|
interface |
CounterGroupBase<T extends Counter>
The common counter group interface.
|
| Modifier and Type | Class and Description |
|---|---|
class |
AbstractCounters<C extends Counter,G extends CounterGroupBase<C>>
An abstract class to provide common implementation for the Counters
container in both mapred and mapreduce packages.
|
| Modifier and Type | Class and Description |
|---|---|
class |
ValueAggregatorCombiner<K1 extends WritableComparable<?>,V1 extends Writable>
This class implements the generic combiner of Aggregate.
|
class |
ValueAggregatorJobBase<K1 extends WritableComparable<?>,V1 extends Writable>
This abstract class implements some common functionalities of the
the generic mapper, reducer and combiner classes of Aggregate.
|
class |
ValueAggregatorMapper<K1 extends WritableComparable<?>,V1 extends Writable>
This class implements the generic mapper of Aggregate.
|
class |
ValueAggregatorReducer<K1 extends WritableComparable<?>,V1 extends Writable>
This class implements the generic reducer of Aggregate.
|
| Modifier and Type | Class and Description |
|---|---|
class |
CombineFileSplit
A sub-collection of input files.
|
| Modifier and Type | Class and Description |
|---|---|
class |
ArrayListBackedIterator<X extends Writable>
This class provides an implementation of ResetableIterator.
|
class |
ComposableInputFormat<K extends WritableComparable<?>,V extends Writable>
Refinement of InputFormat requiring implementors to provide
ComposableRecordReader instead of RecordReader.
|
class |
ComposableRecordReader<K extends WritableComparable<?>,V extends Writable>
Additional operations required of a RecordReader to participate in a join.
|
class |
CompositeRecordReader<K extends WritableComparable<?>,V extends Writable,X extends Writable>
A RecordReader that can effect joins of RecordReaders sharing a common key
type and partitioning.
|
class |
CompositeRecordReader<K extends WritableComparable<?>,V extends Writable,X extends Writable>
A RecordReader that can effect joins of RecordReaders sharing a common key
type and partitioning.
|
class |
MultiFilterRecordReader<K extends WritableComparable<?>,V extends Writable>
Base class for Composite join returning values derived from multiple
sources, but generally not tuples.
|
class |
OverrideRecordReader<K extends WritableComparable<?>,V extends Writable>
Prefer the "rightmost" data source for this key.
|
interface |
ResetableIterator<T extends Writable>
This defines an interface to a stateful Iterator that can replay elements
added to it directly.
|
class |
StreamBackedIterator<X extends Writable>
This class provides an implementation of ResetableIterator.
|
class |
WrappedRecordReader<K extends WritableComparable<?>,U extends Writable>
Proxy class for a RecordReader participating in the join framework.
|
| Modifier and Type | Class and Description |
|---|---|
class |
TupleWritable
Writable type storing multiple
Writables. |
| Modifier and Type | Field and Description |
|---|---|
protected X |
CompositeRecordReader.value |
| Modifier and Type | Method and Description |
|---|---|
Writable |
TupleWritable.get(int i)
Get ith Writable from Tuple.
|
| Modifier and Type | Method and Description |
|---|---|
Iterator<Writable> |
TupleWritable.iterator()
Return an iterator over the elements in this tuple.
|
| Constructor and Description |
|---|
TupleWritable(Writable[] vals)
Initialize tuple with storage; unknown whether any of them contain
"written" values.
|
| Modifier and Type | Method and Description |
|---|---|
static <K extends WritableComparable<?>,V extends Writable> |
MapFileOutputFormat.getEntry(org.apache.hadoop.io.MapFile.Reader[] readers,
Partitioner<K,V> partitioner,
K key,
V value)
Get an entry from output generated by this class.
|
| Modifier and Type | Method and Description |
|---|---|
static <K extends WritableComparable<?>,V extends Writable> |
MapFileOutputFormat.getEntry(org.apache.hadoop.io.MapFile.Reader[] readers,
Partitioner<K,V> partitioner,
K key,
V value)
Get an entry from output generated by this class.
|
| Modifier and Type | Method and Description |
|---|---|
RecordWriter<WritableComparable<?>,Writable> |
MapFileOutputFormat.getRecordWriter(TaskAttemptContext context) |
static Class<? extends Writable> |
SequenceFileAsBinaryOutputFormat.getSequenceFileOutputValueClass(JobContext job)
Get the value class for the
SequenceFile |
| Modifier and Type | Class and Description |
|---|---|
class |
Record
Deprecated.
Replaced by Avro.
|
| Modifier and Type | Class and Description |
|---|---|
class |
RecordTypeInfo
Deprecated.
Replaced by Avro.
|
| Modifier and Type | Class and Description |
|---|---|
class |
Credentials
A class that provides the facilities of reading and writing
secret keys and Tokens.
|
| Modifier and Type | Class and Description |
|---|---|
class |
AccessControlList
Class representing a configured access control list.
|
| Modifier and Type | Class and Description |
|---|---|
class |
Token<T extends TokenIdentifier>
The client-side form of the token.
|
class |
TokenIdentifier
An identifier that identifies a token, may contain public information
about a token, including its kind (or type).
|
| Modifier and Type | Class and Description |
|---|---|
class |
AbstractDelegationTokenIdentifier |
| Modifier and Type | Method and Description |
|---|---|
static void |
ReflectionUtils.cloneWritableInto(Writable dst,
Writable src)
Deprecated.
|
| Modifier and Type | Class and Description |
|---|---|
class |
BloomFilter
Implements a Bloom filter, as defined by Bloom in 1970.
|
class |
CountingBloomFilter
Implements a counting Bloom filter, as defined by Fan et al.
|
class |
DynamicBloomFilter
Implements a dynamic Bloom filter, as defined in the INFOCOM 2006 paper.
|
class |
org.apache.hadoop.util.bloom.Filter
Defines the general behavior of a filter.
|
class |
RetouchedBloomFilter
Implements a retouched Bloom filter, as defined in the CoNEXT 2006 paper.
|
| Modifier and Type | Class and Description |
|---|---|
class |
YarnConfiguration |
| Modifier and Type | Class and Description |
|---|---|
static class |
AggregatedLogFormat.LogKey |
| Modifier and Type | Class and Description |
|---|---|
class |
AMRMTokenIdentifier
AMRMTokenIdentifier is the TokenIdentifier to be used by
ApplicationMasters to authenticate to the ResourceManager.
|
class |
ContainerTokenIdentifier
TokenIdentifier for a container.
|
class |
NMTokenIdentifier |
| Modifier and Type | Class and Description |
|---|---|
class |
ClientToAMTokenIdentifier |
class |
RMDelegationTokenIdentifier
Delegation Token Identifier that identifies the delegation tokens from the
Resource Manager.
|
class |
TimelineDelegationTokenIdentifier |
class |
org.apache.hadoop.yarn.security.client.YARNDelegationTokenIdentifier |
Copyright © 2018 Apache Software Foundation. All rights reserved.