|
||||||||||
PREV CLASS NEXT CLASS | FRAMES NO FRAMES | |||||||||
SUMMARY: NESTED | FIELD | CONSTR | METHOD | DETAIL: FIELD | CONSTR | METHOD |
java.lang.Object org.apache.hadoop.mapreduce.OutputFormat<K,V> org.apache.hadoop.mapreduce.lib.output.FileOutputFormat<K,V> org.apache.hadoop.mapreduce.lib.output.SequenceFileOutputFormat<BytesWritable,BytesWritable> org.apache.hadoop.mapreduce.lib.output.SequenceFileAsBinaryOutputFormat
@InterfaceAudience.Public @InterfaceStability.Stable public class SequenceFileAsBinaryOutputFormat
An OutputFormat
that writes keys,
values to SequenceFile
s in binary(raw) format
Field Summary | |
---|---|
static String |
KEY_CLASS
|
static String |
VALUE_CLASS
|
Fields inherited from class org.apache.hadoop.mapreduce.lib.output.FileOutputFormat |
---|
BASE_OUTPUT_NAME, COMPRESS, COMPRESS_CODEC, COMPRESS_TYPE, OUTDIR, PART |
Constructor Summary | |
---|---|
SequenceFileAsBinaryOutputFormat()
|
Method Summary | |
---|---|
void |
checkOutputSpecs(JobContext job)
Check for validity of the output-specification for the job. |
RecordWriter<BytesWritable,BytesWritable> |
getRecordWriter(TaskAttemptContext context)
Get the RecordWriter for the given task. |
static Class<? extends WritableComparable> |
getSequenceFileOutputKeyClass(JobContext job)
Get the key class for the SequenceFile |
static Class<? extends Writable> |
getSequenceFileOutputValueClass(JobContext job)
Get the value class for the SequenceFile |
static void |
setSequenceFileOutputKeyClass(Job job,
Class<?> theClass)
Set the key class for the SequenceFile |
static void |
setSequenceFileOutputValueClass(Job job,
Class<?> theClass)
Set the value class for the SequenceFile |
Methods inherited from class org.apache.hadoop.mapreduce.lib.output.SequenceFileOutputFormat |
---|
getOutputCompressionType, getSequenceWriter, setOutputCompressionType |
Methods inherited from class org.apache.hadoop.mapreduce.lib.output.FileOutputFormat |
---|
getCompressOutput, getDefaultWorkFile, getOutputCommitter, getOutputCompressorClass, getOutputName, getOutputPath, getPathForWorkFile, getUniqueFile, getWorkOutputPath, setCompressOutput, setOutputCompressorClass, setOutputName, setOutputPath |
Methods inherited from class java.lang.Object |
---|
clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait |
Field Detail |
---|
public static String KEY_CLASS
public static String VALUE_CLASS
Constructor Detail |
---|
public SequenceFileAsBinaryOutputFormat()
Method Detail |
---|
public static void setSequenceFileOutputKeyClass(Job job, Class<?> theClass)
SequenceFile
This allows the user to specify the key class to be different
from the actual class (BytesWritable
) used for writing
job
- the Job
to modifytheClass
- the SequenceFile output key class.public static void setSequenceFileOutputValueClass(Job job, Class<?> theClass)
SequenceFile
This allows the user to specify the value class to be different
from the actual class (BytesWritable
) used for writing
job
- the Job
to modifytheClass
- the SequenceFile output key class.public static Class<? extends WritableComparable> getSequenceFileOutputKeyClass(JobContext job)
SequenceFile
SequenceFile
public static Class<? extends Writable> getSequenceFileOutputValueClass(JobContext job)
SequenceFile
SequenceFile
public RecordWriter<BytesWritable,BytesWritable> getRecordWriter(TaskAttemptContext context) throws IOException
OutputFormat
RecordWriter
for the given task.
getRecordWriter
in class SequenceFileOutputFormat<BytesWritable,BytesWritable>
context
- the information about the current task.
RecordWriter
to write the output for the job.
IOException
public void checkOutputSpecs(JobContext job) throws IOException
OutputFormat
This is to validate the output specification for the job when it is a job is submitted. Typically checks that it does not already exist, throwing an exception when it already exists, so that output is not overwritten.
checkOutputSpecs
in class FileOutputFormat<BytesWritable,BytesWritable>
job
- information about the job
IOException
- when output should not be attempted
|
||||||||||
PREV CLASS NEXT CLASS | FRAMES NO FRAMES | |||||||||
SUMMARY: NESTED | FIELD | CONSTR | METHOD | DETAIL: FIELD | CONSTR | METHOD |