org.apache.hadoop.mapred
Class SequenceFileInputFilter<K,V>

java.lang.Object
  extended by org.apache.hadoop.mapred.FileInputFormat<K,V>
      extended by org.apache.hadoop.mapred.SequenceFileInputFormat<K,V>
          extended by org.apache.hadoop.mapred.SequenceFileInputFilter<K,V>
All Implemented Interfaces:
InputFormat<K,V>

@InterfaceAudience.Public
@InterfaceStability.Stable
public class SequenceFileInputFilter<K,V>
extends SequenceFileInputFormat<K,V>

A class that allows a map/red job to work on a sample of sequence files. The sample is decided by the filter class set by the job.


Field Summary
 
Fields inherited from class org.apache.hadoop.mapred.FileInputFormat
INPUT_DIR_RECURSIVE, LOG, NUM_INPUT_FILES
 
Constructor Summary
SequenceFileInputFilter()
           
 
Method Summary
 RecordReader<K,V> getRecordReader(InputSplit split, JobConf job, Reporter reporter)
          Create a record reader for the given split
static void setFilterClass(Configuration conf, Class filterClass)
          set the filter class
 
Methods inherited from class org.apache.hadoop.mapred.SequenceFileInputFormat
listStatus
 
Methods inherited from class org.apache.hadoop.mapred.FileInputFormat
addInputPath, addInputPathRecursively, addInputPaths, computeSplitSize, getBlockIndex, getInputPathFilter, getInputPaths, getSplitHosts, getSplits, isSplitable, makeSplit, setInputPathFilter, setInputPaths, setInputPaths, setMinSplitSize
 
Methods inherited from class java.lang.Object
clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait
 

Constructor Detail

SequenceFileInputFilter

public SequenceFileInputFilter()
Method Detail

getRecordReader

public RecordReader<K,V> getRecordReader(InputSplit split,
                                         JobConf job,
                                         Reporter reporter)
                                  throws IOException
Create a record reader for the given split

Specified by:
getRecordReader in interface InputFormat<K,V>
Overrides:
getRecordReader in class SequenceFileInputFormat<K,V>
Parameters:
split - file split
job - job configuration
reporter - reporter who sends report to task tracker
Returns:
RecordReader
Throws:
IOException

setFilterClass

public static void setFilterClass(Configuration conf,
                                  Class filterClass)
set the filter class

Parameters:
conf - application configuration
filterClass - filter class


Copyright © 2014 Apache Software Foundation. All Rights Reserved.