|
||||||||||
PREV CLASS NEXT CLASS | FRAMES NO FRAMES | |||||||||
SUMMARY: NESTED | FIELD | CONSTR | METHOD | DETAIL: FIELD | CONSTR | METHOD |
java.lang.Object org.apache.hadoop.mapred.lib.DelegatingInputFormat<K,V>
public class DelegatingInputFormat<K,V>
An InputFormat
that delegates behaviour of paths to multiple other
InputFormats.
MultipleInputs.addInputPath(JobConf, Path, Class, Class)
Constructor Summary | |
---|---|
DelegatingInputFormat()
|
Method Summary | |
---|---|
RecordReader<K,V> |
getRecordReader(InputSplit split,
JobConf conf,
Reporter reporter)
Get the RecordReader for the given InputSplit . |
InputSplit[] |
getSplits(JobConf conf,
int numSplits)
Logically split the set of input files for the job. |
Methods inherited from class java.lang.Object |
---|
clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait |
Constructor Detail |
---|
public DelegatingInputFormat()
Method Detail |
---|
public InputSplit[] getSplits(JobConf conf, int numSplits) throws IOException
InputFormat
Each InputSplit
is then assigned to an individual Mapper
for processing.
Note: The split is a logical split of the inputs and the input files are not physically split into chunks. For e.g. a split could be <input-file-path, start, offset> tuple.
getSplits
in interface InputFormat<K,V>
conf
- job configuration.numSplits
- the desired number of splits, a hint.
InputSplit
s for the job.
IOException
public RecordReader<K,V> getRecordReader(InputSplit split, JobConf conf, Reporter reporter) throws IOException
InputFormat
RecordReader
for the given InputSplit
.
It is the responsibility of the RecordReader
to respect
record boundaries while processing the logical split to present a
record-oriented view to the individual task.
getRecordReader
in interface InputFormat<K,V>
split
- the InputSplit
conf
- the job that this split belongs to
RecordReader
IOException
|
||||||||||
PREV CLASS NEXT CLASS | FRAMES NO FRAMES | |||||||||
SUMMARY: NESTED | FIELD | CONSTR | METHOD | DETAIL: FIELD | CONSTR | METHOD |