Package | Description |
---|---|
org.apache.hadoop.fs.s3a.commit |
Support for committing the output of analytics jobs directly to S3.
|
org.apache.hadoop.fs.s3a.commit.magic |
This is the "Magic" committer and support.
|
org.apache.hadoop.mapred | |
org.apache.hadoop.mapreduce | |
org.apache.hadoop.mapreduce.lib.db | |
org.apache.hadoop.mapreduce.lib.output | |
org.apache.hadoop.mapreduce.lib.output.committer.manifest |
Intermediate manifest committer.
|
Modifier and Type | Class and Description |
---|---|
class |
org.apache.hadoop.fs.s3a.commit.AbstractS3ACommitter
Abstract base class for S3A committers; allows for any commonality
between different architectures.
|
Modifier and Type | Class and Description |
---|---|
class |
MagicS3GuardCommitter
This is a dedicated committer which requires the "magic" directory feature
of the S3A Filesystem to be enabled; it then uses paths for task and job
attempts in magic paths, so as to ensure that the final output goes direct
to the destination directory.
|
Modifier and Type | Class and Description |
---|---|
class |
FileOutputCommitter
An
OutputCommitter that commits files specified
in job output directory i.e. |
class |
OutputCommitter
OutputCommitter describes the commit of task output for a
Map-Reduce job. |
Modifier and Type | Method and Description |
---|---|
OutputCommitter |
TaskInputOutputContext.getOutputCommitter()
Get the
OutputCommitter for the task-attempt. |
abstract OutputCommitter |
OutputFormat.getOutputCommitter(TaskAttemptContext context)
Get the output committer for this output format.
|
Modifier and Type | Method and Description |
---|---|
OutputCommitter |
DBOutputFormat.getOutputCommitter(TaskAttemptContext context) |
Modifier and Type | Class and Description |
---|---|
class |
BindingPathOutputCommitter
This is a special committer which creates the factory for the committer and
runs off that.
|
class |
PartialFileOutputCommitter
An
OutputCommitter that commits files specified
in job output directory i.e. |
class |
PathOutputCommitter
A committer which somehow commits data written to a working directory
to the final directory during the commit process.
|
Modifier and Type | Method and Description |
---|---|
OutputCommitter |
FileOutputFormat.getOutputCommitter(TaskAttemptContext context) |
OutputCommitter |
LazyOutputFormat.getOutputCommitter(TaskAttemptContext context) |
OutputCommitter |
NullOutputFormat.getOutputCommitter(TaskAttemptContext context) |
OutputCommitter |
FilterOutputFormat.getOutputCommitter(TaskAttemptContext context) |
Modifier and Type | Class and Description |
---|---|
class |
ManifestCommitter
This is the Intermediate-Manifest committer.
|
Copyright © 2023 Apache Software Foundation. All rights reserved.