Uses of Class
org.apache.hadoop.mapreduce.lib.output.PathOutputCommitter
Packages that use PathOutputCommitter
Package
Description
Support for committing the output of analytics jobs directly to S3.
This is the "Magic" committer and support.
Intermediate manifest committer.
-
Uses of PathOutputCommitter in org.apache.hadoop.fs.s3a.commit
Subclasses of PathOutputCommitter in org.apache.hadoop.fs.s3a.commitModifier and TypeClassDescriptionclassorg.apache.hadoop.fs.s3a.commit.AbstractS3ACommitterAbstract base class for S3A committers; allows for any commonality between different architectures. -
Uses of PathOutputCommitter in org.apache.hadoop.fs.s3a.commit.magic
Subclasses of PathOutputCommitter in org.apache.hadoop.fs.s3a.commit.magicModifier and TypeClassDescriptionclassThis is a dedicated committer which requires the "magic" directory feature of the S3A Filesystem to be enabled; it then uses paths for task and job attempts in magic paths, so as to ensure that the final output goes direct to the destination directory. -
Uses of PathOutputCommitter in org.apache.hadoop.mapreduce.lib.output
Subclasses of PathOutputCommitter in org.apache.hadoop.mapreduce.lib.outputModifier and TypeClassDescriptionclassThis is a special committer which creates the factory for the committer and runs off that.classAnOutputCommitterthat commits files specified in job output directory i.e.classAnOutputCommitterthat commits files specified in job output directory i.e.Methods in org.apache.hadoop.mapreduce.lib.output that return PathOutputCommitterModifier and TypeMethodDescriptionstatic PathOutputCommitterPathOutputCommitterFactory.createCommitter(Path outputPath, TaskAttemptContext context) Create the committer factory for a task attempt and destination, then create the committer from it.protected final PathOutputCommitterPathOutputCommitterFactory.createFileOutputCommitter(Path outputPath, TaskAttemptContext context) Create an instance of the default committer, aFileOutputCommitterfor a task.PathOutputCommitterFactory.createOutputCommitter(Path outputPath, TaskAttemptContext context) Create an output committer for a task attempt.BindingPathOutputCommitter.getCommitter()Get the inner committer. -
Uses of PathOutputCommitter in org.apache.hadoop.mapreduce.lib.output.committer.manifest
Subclasses of PathOutputCommitter in org.apache.hadoop.mapreduce.lib.output.committer.manifestModifier and TypeClassDescriptionclassThis is the Intermediate-Manifest committer.