Package | Description |
---|---|
org.apache.hadoop.fs.s3a.commit |
Support for committing the output of analytics jobs directly to S3.
|
org.apache.hadoop.fs.s3a.commit.magic |
This is the "Magic" committer and support.
|
org.apache.hadoop.mapreduce.lib.output | |
org.apache.hadoop.mapreduce.lib.output.committer.manifest |
Intermediate manifest committer.
|
Modifier and Type | Class and Description |
---|---|
class |
org.apache.hadoop.fs.s3a.commit.AbstractS3ACommitter
Abstract base class for S3A committers; allows for any commonality
between different architectures.
|
Modifier and Type | Class and Description |
---|---|
class |
MagicS3GuardCommitter
This is a dedicated committer which requires the "magic" directory feature
of the S3A Filesystem to be enabled; it then uses paths for task and job
attempts in magic paths, so as to ensure that the final output goes direct
to the destination directory.
|
Modifier and Type | Class and Description |
---|---|
class |
BindingPathOutputCommitter
This is a special committer which creates the factory for the committer and
runs off that.
|
class |
FileOutputCommitter
An
OutputCommitter that commits files specified
in job output directory i.e. |
class |
PartialFileOutputCommitter
An
OutputCommitter that commits files specified
in job output directory i.e. |
Modifier and Type | Method and Description |
---|---|
static PathOutputCommitter |
PathOutputCommitterFactory.createCommitter(Path outputPath,
TaskAttemptContext context)
Create the committer factory for a task attempt and destination, then
create the committer from it.
|
protected PathOutputCommitter |
PathOutputCommitterFactory.createFileOutputCommitter(Path outputPath,
TaskAttemptContext context)
Create an instance of the default committer, a
FileOutputCommitter
for a task. |
PathOutputCommitter |
PathOutputCommitterFactory.createOutputCommitter(Path outputPath,
TaskAttemptContext context)
Create an output committer for a task attempt.
|
PathOutputCommitter |
BindingPathOutputCommitter.getCommitter()
Get the inner committer.
|
Modifier and Type | Class and Description |
---|---|
class |
ManifestCommitter
This is the Intermediate-Manifest committer.
|
Copyright © 2023 Apache Software Foundation. All rights reserved.