Package org.apache.hadoop.mapreduce.lib.output.committer.manifest.files


@Public @Unstable package org.apache.hadoop.mapreduce.lib.output.committer.manifest.files
Persistence formats. These are the persistence formats used for passing data from tasks to the job committer TaskManifest, and for a _SUCCESS file, which is in ManifestSuccessData. The _SUCCESS file is a copy of the S3A Committer org.apache.hadoop.fs.s3a.commit.files.ManifestSuccessData, the intent being that at the JSON-level they are compatible. This is to aid testing/validation and support calls, with one single format to load. Consult the individual formats for their declarations of access; the _SUCCESS file is one which tests may use.
  • Class
    Description
    org.apache.hadoop.mapreduce.lib.output.committer.manifest.files.AbstractManifestData<T extends org.apache.hadoop.mapreduce.lib.output.committer.manifest.files.AbstractManifestData>
    Class for single/multiple commit data structures.
    Diagnostic keys in the manifests.
    A directory entry in the task manifest.
    org.apache.hadoop.mapreduce.lib.output.committer.manifest.files.EntryStatus
    Status of a file or dir entry, designed to be marshalled as an integer -the ordinal value of the enum is the wire value.
    org.apache.hadoop.mapreduce.lib.output.committer.manifest.files.FileEntry
    A File entry in the task manifest.
    org.apache.hadoop.mapreduce.lib.output.committer.manifest.files.ManifestPrinter
    Tool to print a manifest.
    Summary data saved into a _SUCCESS marker file.
    org.apache.hadoop.mapreduce.lib.output.committer.manifest.files.TaskManifest
    This is the manifest of files which were created by this task attempt.