Package org.apache.hadoop.mapred

package org.apache.hadoop.mapred
  • Class
    Description
    org.apache.hadoop.mapred.AMFeedback
    This class is a simple struct to include both the taskFound information and a possible preemption request coming from the AM.
    org.apache.hadoop.mapred.BackupStore<K,V>
    BackupStore is an utility class that is used to support the mark-reset functionality of values iterator
    org.apache.hadoop.mapred.ClientCache
     
    org.apache.hadoop.mapred.ClientServiceDelegate
     
    ClusterStatus
    Status information on the current state of the Map-Reduce cluster.
    org.apache.hadoop.mapred.ClusterStatus.BlackListInfo
    Class which encapsulates information about a blacklisted tasktracker.
    Counters
    A set of named counters.
    Counters.Counter
    A counter record, comprising its name and value.
    org.apache.hadoop.mapred.Counters.CountersExceededException
    Counter exception thrown when the number of counters exceed the limit
    Counters.Group
    Group of counters, comprising of counters from a particular counter Enum class.
    org.apache.hadoop.mapred.FadvisedChunkedFile
     
    org.apache.hadoop.mapred.FadvisedFileRegion
     
    FileAlreadyExistsException
    Used when target file already exists for any operation and is not configured to be overwritten.
    FileInputFormat<K,V>
    A base class for file-based InputFormat.
    FileInputFormat.Counter
    Deprecated.
    FileOutputCommitter
    An OutputCommitter that commits files specified in job output directory i.e.
    FileOutputFormat<K,V>
    A base class for OutputFormat.
    FileOutputFormat.Counter
    Deprecated.
    FileSplit
    A section of an input file.
    FixedLengthInputFormat
    FixedLengthInputFormat is an input format used to read input files which contain fixed length records.
    org.apache.hadoop.mapred.FixedLengthRecordReader
    A reader to read fixed length records from a split.
    ID
    A general identifier, which internally stores the id as an integer.
    org.apache.hadoop.mapred.IFile
    IFile is the simple <key-len, value-len, key, value> format for the intermediate map-outputs in Map-Reduce.
    org.apache.hadoop.mapred.IFile.Reader<K,V>
    IFile.Reader to read intermediate map-outputs.
    org.apache.hadoop.mapred.IFile.Writer<K,V>
    IFile.Writer to write out intermediate map-outputs.
    org.apache.hadoop.mapred.IFileInputStream
    A checksum input stream, used for IFiles.
    org.apache.hadoop.mapred.IFileOutputStream
    A Checksum output stream.
    org.apache.hadoop.mapred.IndexRecord
     
    InputFormat<K,V>
    InputFormat describes the input-specification for a Map-Reduce job.
    InputSplit
    InputSplit represents the data to be processed by an individual Mapper.
    InputSplitWithLocationInfo
     
    InvalidFileTypeException
    Used when file type differs from the desired file type. like getting a file when a directory is expected.
    InvalidInputException
    This class wraps a list of problems with the input, so that the user can get a list of problems together instead of finding and fixing them one by one.
    InvalidJobConfException
    This exception is thrown when jobconf misses some mendatory attributes or value of some attributes is invalid.
    org.apache.hadoop.mapred.JobACLsManager
     
    JobClient
    JobClient is the primary interface for the user-job to interact with the cluster.
    JobClient.TaskStatusFilter
     
    JobConf
    A map/reduce job configuration.
    JobConfigurable
    That what may be configured.
    JobContext
     
    org.apache.hadoop.mapred.JobContextImpl
     
    org.apache.hadoop.mapred.JobEndNotifier
     
    JobID
    JobID represents the immutable and unique identifier for the job.
    org.apache.hadoop.mapred.JobInProgress
     
    JobInProgress.Counter
    Deprecated.
    Provided for compatibility.
    JobPriority
    Used to describe the priority of the running job.
    org.apache.hadoop.mapred.JobProfile
    A JobProfile is a MapReduce primitive.
    JobQueueInfo
    Class that contains the information regarding the Job Queues which are maintained by the Hadoop Map/Reduce framework.
    JobStatus
    Describes the current status of a job.
    org.apache.hadoop.mapred.JobTracker
    JobTracker is no longer used since M/R 2.x.
    JobTracker.State
    State is no longer used since M/R 2.x.
    org.apache.hadoop.mapred.JvmTask
    Task abstraction that can be serialized, implements the writable interface.
    KeyValueLineRecordReader
    This class treats a line in the input as a key/value pair separated by a separator character.
    KeyValueTextInputFormat
    An InputFormat for plain text files.
    org.apache.hadoop.mapred.LineRecordReader
    Treats keys as offset in file and value as line.
    org.apache.hadoop.mapred.LineRecordReader.LineReader
    Deprecated.
    Use LineReader instead.
    org.apache.hadoop.mapred.LocalClientProtocolProvider
     
    org.apache.hadoop.mapred.LocalContainerLauncher
    Runs the container task locally in a thread.
    org.apache.hadoop.mapred.LocalJobRunner
    Implements MapReduce locally, in-process, for debugging.
    org.apache.hadoop.mapred.LocatedFileStatusFetcher
    Utility class to fetch block locations for specified Input paths using a configured number of threads.
    MapFileOutputFormat
    An OutputFormat that writes MapFiles.
    org.apache.hadoop.mapred.MapOutputCollector<K,V>
     
    org.apache.hadoop.mapred.MapOutputCollector.Context
     
    org.apache.hadoop.mapred.MapOutputFile
    Manipulate the working area for the transient store for maps and reduces.
    Mapper<K1,V1,K2,V2>
    Maps input key/value pairs to a set of intermediate key/value pairs.
    MapReduceBase
    Base class for Mapper and Reducer implementations.
    org.apache.hadoop.mapred.MapReduceChildJVM
     
    MapRunnable<K1,V1,K2,V2>
    Expert: Generic interface for Mappers.
    MapRunner<K1,V1,K2,V2>
    Default MapRunnable implementation.
    org.apache.hadoop.mapred.MapTask
    A Map task.
    org.apache.hadoop.mapred.MapTask.MapOutputBuffer<K,V>
     
    org.apache.hadoop.mapred.MapTaskAttemptImpl
     
    org.apache.hadoop.mapred.MapTaskCompletionEventsUpdate
    A class that represents the communication between the tasktracker and child tasks w.r.t the map task completion events.
    org.apache.hadoop.mapred.Master
     
    Master.State
     
    org.apache.hadoop.mapred.Merger
    Merger is an utility class used by the Map and Reduce tasks for merging both their memory and disk segments
    org.apache.hadoop.mapred.Merger.Segment<K,V>
     
    org.apache.hadoop.mapred.MRConstants
    Some handy constants
    org.apache.hadoop.mapred.MROutputFiles
    Manipulate the working area for the transient store for maps and reduces.
    MultiFileInputFormat<K,V>
    An abstract InputFormat that returns MultiFileSplit's in MultiFileInputFormat.getSplits(JobConf, int) method.
    MultiFileSplit
    A sub-collection of input files.
    org.apache.hadoop.mapred.NotRunningJob
     
    org.apache.hadoop.mapred.Operation
    Generic operation that maps to the dependent set of ACLs that drive the authorization of the operation.
    OutputCollector<K,V>
    Collects the <key, value> pairs output by Mappers and Reducers.
    OutputCommitter
    OutputCommitter describes the commit of task output for a Map-Reduce job.
    OutputFormat<K,V>
    OutputFormat describes the output-specification for a Map-Reduce job.
    OutputLogFilter
    This class filters log files from directory given It doesnt accept paths having _logs.
    Partitioner<K2,V2>
    Partitions the key space.
    org.apache.hadoop.mapred.PeriodicStatsAccumulator
    This abstract class that represents a bucketed series of measurements of a quantity being measured in a running task attempt.
    org.apache.hadoop.mapred.ProgressSplitsBlock
     
    org.apache.hadoop.mapred.QueueACL
    Enum representing an AccessControlList that drives set of operations that can be performed on a queue.
    org.apache.hadoop.mapred.QueueManager
    Class that exposes information about queues maintained by the Hadoop Map/Reduce framework.
    org.apache.hadoop.mapred.RawKeyValueIterator
    RawKeyValueIterator is an iterator used to iterate over the raw keys and values during sort/merge of intermediate data.
    RecordReader<K,V>
    RecordReader reads <key, value> pairs from an InputSplit.
    RecordWriter<K,V>
    RecordWriter writes the output <key, value> pairs to an output file.
    Reducer<K2,V2,K3,V3>
    Reduces a set of intermediate values which share a key to a smaller set of values.
    org.apache.hadoop.mapred.ReduceTask
    A Reduce task.
    org.apache.hadoop.mapred.ReduceTaskAttemptImpl
     
    Reporter
    A facility for Map-Reduce applications to report progress and update counters, status information etc.
    org.apache.hadoop.mapred.ResourceMgrDelegate
     
    RunningJob
    RunningJob is the user-interface to query for details on a running Map-Reduce job.
    SequenceFileAsBinaryInputFormat
    InputFormat reading keys, values from SequenceFiles in binary (raw) format.
    org.apache.hadoop.mapred.SequenceFileAsBinaryInputFormat.SequenceFileAsBinaryRecordReader
    Read records from a SequenceFile as binary (raw) bytes.
    SequenceFileAsBinaryOutputFormat
    An OutputFormat that writes keys, values to SequenceFiles in binary(raw) format
    org.apache.hadoop.mapred.SequenceFileAsBinaryOutputFormat.WritableValueBytes
    Inner class used for appendRaw
    SequenceFileAsTextInputFormat
    This class is similar to SequenceFileInputFormat, except it generates SequenceFileAsTextRecordReader which converts the input keys and values to their String forms by calling toString() method.
    SequenceFileAsTextRecordReader
    This class converts the input keys and values to their String forms by calling toString() method.
    SequenceFileInputFilter<K,V>
    A class that allows a map/red job to work on a sample of sequence files.
    org.apache.hadoop.mapred.SequenceFileInputFilter.Filter
    filter interface
    org.apache.hadoop.mapred.SequenceFileInputFilter.FilterBase
    base class for Filters
    org.apache.hadoop.mapred.SequenceFileInputFilter.MD5Filter
    This class returns a set of records by examing the MD5 digest of its key against a filtering frequency f.
    org.apache.hadoop.mapred.SequenceFileInputFilter.PercentFilter
    This class returns a percentage of records The percentage is determined by a filtering frequency f using the criteria record# % f == 0.
    org.apache.hadoop.mapred.SequenceFileInputFilter.RegexFilter
    Records filter by matching key to regex
    SequenceFileInputFormat<K,V>
    An InputFormat for SequenceFiles.
    SequenceFileOutputFormat<K,V>
    An OutputFormat that writes SequenceFiles.
    SequenceFileRecordReader<K,V>
    An RecordReader for SequenceFiles.
    org.apache.hadoop.mapred.ShuffleChannelHandler
    ShuffleChannelHandler verifies the map request then servers the attempts in a http stream.
    org.apache.hadoop.mapred.ShuffleChannelHandler.ReduceContext
    Maintain parameters per messageReceived() Netty context.
    org.apache.hadoop.mapred.ShuffleChannelHandlerContext
     
    org.apache.hadoop.mapred.ShuffleChannelInitializer
     
    org.apache.hadoop.mapred.ShuffleConsumerPlugin<K,V>
    ShuffleConsumerPlugin for serving Reducers.
    org.apache.hadoop.mapred.ShuffleConsumerPlugin.Context<K,V>
     
    org.apache.hadoop.mapred.ShuffleHandler
     
    SkipBadRecords
    Utility class for skip bad records functionality.
    org.apache.hadoop.mapred.SpillRecord
     
    SplitLocationInfo
     
    org.apache.hadoop.mapred.Task
    Base class for tasks.
    org.apache.hadoop.mapred.Task.CombineOutputCollector<K,V>
    OutputCollector for the combiner.
    org.apache.hadoop.mapred.Task.CombinerRunner<K,V>
     
    org.apache.hadoop.mapred.Task.CombineValuesIterator<KEY,VALUE>
    Iterator to return Combined values
    Task.Counter
    Deprecated.
    Provided for compatibility.
    org.apache.hadoop.mapred.Task.NewCombinerRunner<K,V>
     
    org.apache.hadoop.mapred.Task.OldCombinerRunner<K,V>
     
    TaskAttemptContext
     
    org.apache.hadoop.mapred.TaskAttemptContextImpl
     
    TaskAttemptID
    TaskAttemptID represents the immutable and unique identifier for a task attempt.
    org.apache.hadoop.mapred.TaskAttemptListenerImpl
    This class is responsible for talking to the task umblical.
    TaskCompletionEvent
    This is used to track task completion events on job tracker.
    TaskCompletionEvent.Status
     
    TaskID
    TaskID represents the immutable and unique identifier for a Map or Reduce Task.
    org.apache.hadoop.mapred.TaskLog
    A simple logger to handle the task-specific user logs.
    org.apache.hadoop.mapred.TaskLog.LogName
    The filter for userlogs.
    org.apache.hadoop.mapred.TaskLog.Reader
     
    TaskReport
    A report on the state of a task.
    org.apache.hadoop.mapred.TaskStatus
    Describes the current status of a task.
    org.apache.hadoop.mapred.TaskStatus.Phase
     
    org.apache.hadoop.mapred.TaskStatus.State
     
    org.apache.hadoop.mapred.TaskUmbilicalProtocol
    Protocol that task child process uses to contact its parent process.
    TextInputFormat
    An InputFormat for plain text files.
    TextOutputFormat<K,V>
    An OutputFormat that writes plain text files.
    org.apache.hadoop.mapred.TextOutputFormat.LineRecordWriter<K,V>
     
    org.apache.hadoop.mapred.TIPStatus
    The states of a Tasks.
    Utils
    A utility class.
    org.apache.hadoop.mapred.Utils.OutputFileUtils
     
    org.apache.hadoop.mapred.Utils.OutputFileUtils.OutputFilesFilter
    This class filters output(part) files from the given directory It does not accept files with filenames _logs and _SUCCESS.
    org.apache.hadoop.mapred.Utils.OutputFileUtils.OutputLogFilter
    This class filters log files from directory given It doesnt accept paths having _logs.
    org.apache.hadoop.mapred.WrappedJvmID
    A simple wrapper for increasing the visibility.
    org.apache.hadoop.mapred.WrappedPeriodicStatsAccumulator
     
    org.apache.hadoop.mapred.WrappedProgressSplitsBlock
     
    org.apache.hadoop.mapred.YarnClientProtocolProvider
     
    org.apache.hadoop.mapred.YarnOutputFiles
    Manipulate the working area for the transient store for maps and reduces.
    org.apache.hadoop.mapred.YARNRunner
    This class enables the current JobClient (0.22 hadoop) to run on YARN.