|
||||||||||
PREV CLASS NEXT CLASS | FRAMES NO FRAMES | |||||||||
SUMMARY: NESTED | FIELD | CONSTR | METHOD | DETAIL: FIELD | CONSTR | METHOD |
java.lang.Object org.apache.hadoop.streaming.StreamBaseRecordReader
public abstract class StreamBaseRecordReader
Shared functionality for hadoopStreaming formats. A custom reader can be defined to be a RecordReader with the constructor below and is selected with the option bin/hadoopStreaming -inputreader ...
StreamXmlRecordReader
Field Summary | |
---|---|
protected static org.apache.commons.logging.Log |
LOG
|
Constructor Summary | |
---|---|
StreamBaseRecordReader(FSDataInputStream in,
FileSplit split,
Reporter reporter,
JobConf job,
FileSystem fs)
|
Method Summary | |
---|---|
void |
close()
Close this to future operations. |
Text |
createKey()
Create an object of the appropriate type to be used as a key. |
Text |
createValue()
Create an object of the appropriate type to be used as a value. |
long |
getPos()
Returns the current position in the input. |
float |
getProgress()
How much of the input has the RecordReader consumed i.e. |
abstract boolean |
next(Text key,
Text value)
Read a record. |
abstract void |
seekNextRecordBoundary()
Implementation should seek forward in_ to the first byte of the next record. |
Methods inherited from class java.lang.Object |
---|
clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait |
Field Detail |
---|
protected static final org.apache.commons.logging.Log LOG
Constructor Detail |
---|
public StreamBaseRecordReader(FSDataInputStream in, FileSplit split, Reporter reporter, JobConf job, FileSystem fs) throws IOException
IOException
Method Detail |
---|
public abstract boolean next(Text key, Text value) throws IOException
next
in interface RecordReader<Text,Text>
key
- the key to read data intovalue
- the value to read data into
IOException
public long getPos() throws IOException
getPos
in interface RecordReader<Text,Text>
IOException
public void close() throws IOException
close
in interface RecordReader<Text,Text>
IOException
public float getProgress() throws IOException
RecordReader
RecordReader
consumed i.e.
has been processed by?
getProgress
in interface RecordReader<Text,Text>
0.0
to 1.0
.
IOException
public Text createKey()
RecordReader
createKey
in interface RecordReader<Text,Text>
public Text createValue()
RecordReader
createValue
in interface RecordReader<Text,Text>
public abstract void seekNextRecordBoundary() throws IOException
IOException
|
||||||||||
PREV CLASS NEXT CLASS | FRAMES NO FRAMES | |||||||||
SUMMARY: NESTED | FIELD | CONSTR | METHOD | DETAIL: FIELD | CONSTR | METHOD |