|
||||||||||
PREV CLASS NEXT CLASS | FRAMES NO FRAMES | |||||||||
SUMMARY: NESTED | FIELD | CONSTR | METHOD | DETAIL: FIELD | CONSTR | METHOD |
java.lang.Object org.apache.hadoop.mapreduce.InputFormat<K,V> org.apache.hadoop.mapreduce.lib.input.DelegatingInputFormat<K,V>
@InterfaceAudience.Private @InterfaceStability.Unstable public class DelegatingInputFormat<K,V>
An InputFormat
that delegates behavior of paths to multiple other
InputFormats.
MultipleInputs.addInputPath(Job, Path, Class, Class)
Constructor Summary | |
---|---|
DelegatingInputFormat()
|
Method Summary | |
---|---|
RecordReader<K,V> |
createRecordReader(InputSplit split,
TaskAttemptContext context)
Create a record reader for a given split. |
List<InputSplit> |
getSplits(JobContext job)
Logically split the set of input files for the job. |
Methods inherited from class java.lang.Object |
---|
clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait |
Constructor Detail |
---|
public DelegatingInputFormat()
Method Detail |
---|
public List<InputSplit> getSplits(JobContext job) throws IOException, InterruptedException
InputFormat
Each InputSplit
is then assigned to an individual Mapper
for processing.
Note: The split is a logical split of the inputs and the
input files are not physically split into chunks. For e.g. a split could
be <input-file-path, start, offset> tuple. The InputFormat
also creates the RecordReader
to read the InputSplit
.
getSplits
in class InputFormat<K,V>
job
- job configuration.
InputSplit
s for the job.
IOException
InterruptedException
public RecordReader<K,V> createRecordReader(InputSplit split, TaskAttemptContext context) throws IOException, InterruptedException
InputFormat
RecordReader.initialize(InputSplit, TaskAttemptContext)
before
the split is used.
createRecordReader
in class InputFormat<K,V>
split
- the split to be readcontext
- the information about the task
IOException
InterruptedException
|
||||||||||
PREV CLASS NEXT CLASS | FRAMES NO FRAMES | |||||||||
SUMMARY: NESTED | FIELD | CONSTR | METHOD | DETAIL: FIELD | CONSTR | METHOD |