|
||||||||||
PREV NEXT | FRAMES NO FRAMES |
Packages that use InputFormat | |
---|---|
org.apache.hadoop.mapreduce | |
org.apache.hadoop.mapreduce.lib.db | |
org.apache.hadoop.mapreduce.lib.input | |
org.apache.hadoop.mapreduce.lib.partition |
Uses of InputFormat in org.apache.hadoop.mapreduce |
---|
Methods in org.apache.hadoop.mapreduce that return types with arguments of type InputFormat | |
---|---|
Class<? extends InputFormat<?,?>> |
JobContext.getInputFormatClass()
Get the InputFormat class for the job. |
Method parameters in org.apache.hadoop.mapreduce with type arguments of type InputFormat | |
---|---|
void |
Job.setInputFormatClass(Class<? extends InputFormat> cls)
Set the InputFormat for the job. |
Uses of InputFormat in org.apache.hadoop.mapreduce.lib.db |
---|
Subclasses of InputFormat in org.apache.hadoop.mapreduce.lib.db | |
---|---|
class |
DataDrivenDBInputFormat<T extends DBWritable>
A InputFormat that reads input data from an SQL table. |
class |
DBInputFormat<T extends DBWritable>
A InputFormat that reads input data from an SQL table. |
class |
OracleDataDrivenDBInputFormat<T extends DBWritable>
A InputFormat that reads input data from an SQL table in an Oracle db. |
Uses of InputFormat in org.apache.hadoop.mapreduce.lib.input |
---|
Subclasses of InputFormat in org.apache.hadoop.mapreduce.lib.input | |
---|---|
class |
CombineFileInputFormat<K,V>
An abstract InputFormat that returns CombineFileSplit 's in
getSplits(JobContext) method. |
class |
DelegatingInputFormat<K,V>
An InputFormat that delegates behavior of paths to multiple other
InputFormats. |
class |
FileInputFormat<K,V>
A base class for file-based InputFormat s. |
class |
KeyValueTextInputFormat
An InputFormat for plain text files. |
class |
NLineInputFormat
NLineInputFormat which splits N lines of input as one split. |
class |
SequenceFileAsBinaryInputFormat
InputFormat reading keys, values from SequenceFiles in binary (raw) format. |
class |
SequenceFileAsTextInputFormat
This class is similar to SequenceFileInputFormat, except it generates SequenceFileAsTextRecordReader which converts the input keys and values to their String forms by calling toString() method. |
class |
SequenceFileInputFilter<K,V>
A class that allows a map/red job to work on a sample of sequence files. |
class |
SequenceFileInputFormat<K,V>
An InputFormat for SequenceFile s. |
class |
TextInputFormat
An InputFormat for plain text files. |
Method parameters in org.apache.hadoop.mapreduce.lib.input with type arguments of type InputFormat | |
---|---|
static void |
MultipleInputs.addInputPath(Job job,
Path path,
Class<? extends InputFormat> inputFormatClass)
Add a Path with a custom InputFormat to the list of
inputs for the map-reduce job. |
static void |
MultipleInputs.addInputPath(Job job,
Path path,
Class<? extends InputFormat> inputFormatClass,
Class<? extends Mapper> mapperClass)
Add a Path with a custom InputFormat and
Mapper to the list of inputs for the map-reduce job. |
Uses of InputFormat in org.apache.hadoop.mapreduce.lib.partition |
---|
Methods in org.apache.hadoop.mapreduce.lib.partition with parameters of type InputFormat | |
---|---|
K[] |
InputSampler.Sampler.getSample(InputFormat<K,V> inf,
Job job)
For a given job, collect and return a subset of the keys from the input data. |
K[] |
InputSampler.SplitSampler.getSample(InputFormat<K,V> inf,
Job job)
From each split sampled, take the first numSamples / numSplits records. |
K[] |
InputSampler.RandomSampler.getSample(InputFormat<K,V> inf,
Job job)
Randomize the split order, then take the specified number of keys from each split sampled, where each key is selected with the specified probability and possibly replaced by a subsequently selected key when the quota of keys from that split is satisfied. |
K[] |
InputSampler.IntervalSampler.getSample(InputFormat<K,V> inf,
Job job)
For each split sampled, emit when the ratio of the number of records retained to the total record count is less than the specified frequency. |
|
||||||||||
PREV NEXT | FRAMES NO FRAMES |