Package | Description |
---|---|
org.apache.hadoop.fs.s3a.commit |
Support for committing the output of analytics jobs directly to S3.
|
org.apache.hadoop.fs.s3a.commit.magic |
This is the "Magic" committer and support.
|
org.apache.hadoop.mapreduce.lib.output |
Modifier and Type | Class and Description |
---|---|
class |
org.apache.hadoop.fs.s3a.commit.AbstractS3ACommitter
Abstract base class for S3A committers; allows for any commonality
between different architectures.
|
Modifier and Type | Class and Description |
---|---|
class |
MagicS3GuardCommitter
This is a dedicated committer which requires the "magic" directory feature
of the S3A Filesystem to be enabled; it then uses paths for task and job
attempts in magic paths, so as to ensure that the final output goes direct
to the destination directory.
|
Modifier and Type | Class and Description |
---|---|
class |
BindingPathOutputCommitter
This is a special committer which creates the factory for the committer and
runs off that.
|
class |
FileOutputCommitter
An
OutputCommitter that commits files specified
in job output directory i.e. |
class |
PartialFileOutputCommitter
An
OutputCommitter that commits files specified
in job output directory i.e. |
Modifier and Type | Method and Description |
---|---|
PathOutputCommitter |
BindingPathOutputCommitter.getCommitter()
Get the inner committer.
|
Copyright © 2022 Apache Software Foundation. All rights reserved.