org.apache.hadoop.mapred

Class SequenceFileInputFilter<K,V>

java.lang.Object

org.apache.hadoop.mapred.FileInputFormat<K,V>

org.apache.hadoop.mapred.SequenceFileInputFormat<K,V>

org.apache.hadoop.mapred.SequenceFileInputFilter<K,V>

All Implemented Interfaces:

InputFormat<K,V>

@InterfaceAudience.Public
 @InterfaceStability.Stable
public class SequenceFileInputFilter<K,V>
extends SequenceFileInputFormat<K,V>

A class that allows a map/red job to work on a sample of sequence files. The sample is decided by the filter class set by the job.

Field Summary

Fields inherited from class org.apache.hadoop.mapred.FileInputFormat

INPUT_DIR_NONRECURSIVE_IGNORE_SUBDIRS, INPUT_DIR_RECURSIVE, LOG, NUM_INPUT_FILES

Constructor Summary

Constructors

Constructor and Description
SequenceFileInputFilter()

Method Summary

Modifier and Type	Method and Description
RecordReader<K,V>	getRecordReader(InputSplit split, JobConf job, Reporter reporter) Create a record reader for the given split
static void	setFilterClass(Configuration conf, Class filterClass) set the filter class

Methods inherited from class org.apache.hadoop.mapred.SequenceFileInputFormat

listStatus

Methods inherited from class org.apache.hadoop.mapred.FileInputFormat

addInputPath, addInputPathRecursively, addInputPaths, computeSplitSize, getBlockIndex, getInputPathFilter, getInputPaths, getSplitHosts, getSplits, isSplitable, makeSplit, makeSplit, setInputPathFilter, setInputPaths, setInputPaths, setMinSplitSize

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

SequenceFileInputFilter

public SequenceFileInputFilter()

Method Detail

getRecordReader

public RecordReader<K,V> getRecordReader(InputSplit split,
                                         JobConf job,
                                         Reporter reporter)
                                  throws IOException

Create a record reader for the given split

Specified by:

getRecordReader in interface InputFormat<K,V>

Overrides:

getRecordReader in class SequenceFileInputFormat<K,V>

Parameters:

split - file split

job - job configuration

reporter - reporter who sends report to task tracker

Returns:

RecordReader

Throws:

IOException

setFilterClass

public static void setFilterClass(Configuration conf,
                                  Class filterClass)

set the filter class

Parameters:

conf - application configuration

filterClass - filter class