@InterfaceAudience.Public @InterfaceStability.Stable public class FilterOutputFormat<K,V> extends OutputFormat<K,V>
Modifier and Type | Field and Description |
---|---|
protected OutputFormat<K,V> |
baseOut |
Constructor and Description |
---|
FilterOutputFormat() |
FilterOutputFormat(OutputFormat<K,V> baseOut)
Create a FilterOutputFormat based on the underlying output format.
|
Modifier and Type | Method and Description |
---|---|
void |
checkOutputSpecs(JobContext context)
Check for validity of the output-specification for the job.
|
OutputCommitter |
getOutputCommitter(TaskAttemptContext context)
Get the output committer for this output format.
|
RecordWriter<K,V> |
getRecordWriter(TaskAttemptContext context)
Get the
RecordWriter for the given task. |
protected OutputFormat<K,V> baseOut
public FilterOutputFormat()
public FilterOutputFormat(OutputFormat<K,V> baseOut)
baseOut
- the underlying OutputFormatpublic RecordWriter<K,V> getRecordWriter(TaskAttemptContext context) throws IOException, InterruptedException
OutputFormat
RecordWriter
for the given task.getRecordWriter
in class OutputFormat<K,V>
context
- the information about the current task.RecordWriter
to write the output for the job.IOException
InterruptedException
public void checkOutputSpecs(JobContext context) throws IOException, InterruptedException
OutputFormat
This is to validate the output specification for the job when it is a job is submitted. Typically checks that it does not already exist, throwing an exception when it already exists, so that output is not overwritten.
Implementations which write to filesystems which support delegation tokens usually collect the tokens for the destination path(s) and attach them to the job context's JobConf.checkOutputSpecs
in class OutputFormat<K,V>
context
- information about the jobIOException
- when output should not be attemptedInterruptedException
public OutputCommitter getOutputCommitter(TaskAttemptContext context) throws IOException, InterruptedException
OutputFormat
getOutputCommitter
in class OutputFormat<K,V>
context
- the task contextIOException
InterruptedException
Copyright © 2024 Apache Software Foundation. All rights reserved.