Interface PartialOutputCommitter

All Known Implementing Classes:
PartialFileOutputCommitter

@Public @Evolving public interface PartialOutputCommitter
Interface for an OutputCommitter implementing partial commit of task output, as during preemption.
  • Method Summary

    Modifier and Type
    Method
    Description
    void
    Remove all previously committed outputs from prior executions of this task.
  • Method Details

    • cleanUpPartialOutputForTask

      void cleanUpPartialOutputForTask(TaskAttemptContext context) throws IOException
      Remove all previously committed outputs from prior executions of this task.
      Parameters:
      context - Context for cleaning up previously promoted output.
      Throws:
      IOException - If cleanup fails, then the state of the task my not be well defined.