org.apache.hadoop.mapreduce.lib.output
Class PartialFileOutputCommitter
java.lang.Object
org.apache.hadoop.mapreduce.OutputCommitter
org.apache.hadoop.mapreduce.lib.output.FileOutputCommitter
org.apache.hadoop.mapreduce.lib.output.PartialFileOutputCommitter
- All Implemented Interfaces:
- PartialOutputCommitter
@Checkpointable
@InterfaceAudience.Public
@InterfaceStability.Evolving
public class PartialFileOutputCommitter
- extends FileOutputCommitter
- implements PartialOutputCommitter
An OutputCommitter
that commits files specified
in job output directory i.e. ${mapreduce.output.fileoutputformat.outputdir}.
Methods inherited from class org.apache.hadoop.mapreduce.lib.output.FileOutputCommitter |
abortJob, abortTask, cleanupJob, commitJob, commitTask, getCommittedTaskPath, getCommittedTaskPath, getJobAttemptPath, getJobAttemptPath, getJobAttemptPath, getTaskAttemptPath, getTaskAttemptPath, getWorkPath, isRecoverySupported, needsTaskCommit, recoverTask, setupJob, setupTask |
Methods inherited from class java.lang.Object |
clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait |
PartialFileOutputCommitter
public PartialFileOutputCommitter(Path outputPath,
TaskAttemptContext context)
throws IOException
- Throws:
IOException
PartialFileOutputCommitter
public PartialFileOutputCommitter(Path outputPath,
JobContext context)
throws IOException
- Throws:
IOException
getCommittedTaskPath
public Path getCommittedTaskPath(int appAttemptId,
TaskAttemptContext context)
- Description copied from class:
FileOutputCommitter
- Compute the path where the output of a committed task is stored until the
entire job is committed for a specific application attempt.
- Overrides:
getCommittedTaskPath
in class FileOutputCommitter
- Parameters:
appAttemptId
- the id of the application attempt to usecontext
- the context of any task.
- Returns:
- the path where the output of a committed task is stored.
cleanUpPartialOutputForTask
public void cleanUpPartialOutputForTask(TaskAttemptContext context)
throws IOException
- Description copied from interface:
PartialOutputCommitter
- Remove all previously committed outputs from prior executions of this task.
- Specified by:
cleanUpPartialOutputForTask
in interface PartialOutputCommitter
- Parameters:
context
- Context for cleaning up previously promoted output.
- Throws:
IOException
- If cleanup fails, then the state of the task my not be
well defined.
Copyright © 2014 Apache Software Foundation. All Rights Reserved.