Package org.apache.hadoop.fs.azurebfs.commit

Class AzureManifestCommitterFactory

java.lang.Object

org.apache.hadoop.conf.Configured

org.apache.hadoop.mapreduce.lib.output.PathOutputCommitterFactory

org.apache.hadoop.mapreduce.lib.output.committer.manifest.ManifestCommitterFactory

org.apache.hadoop.fs.azurebfs.commit.AzureManifestCommitterFactory

All Implemented Interfaces:

Configurable

@Public
@Evolving
public class AzureManifestCommitterFactory
extends ManifestCommitterFactory

A Committer for the manifest committer which performs all bindings needed to work best with abfs. This includes, at a minimum, switching to the abfs-specific manifest store operations. This classname is referenced in configurations, so MUST NOT change.

Field Summary

Fields

Modifier and Type	Field	Description
static final String	NAME	Classname, which can be declared in job configurations.

Fields inherited from class org.apache.hadoop.mapreduce.lib.output.PathOutputCommitterFactory

COMMITTER_FACTORY_CLASS, COMMITTER_FACTORY_DEFAULT, COMMITTER_FACTORY_SCHEME, COMMITTER_FACTORY_SCHEME_PATTERN, FILE_COMMITTER_FACTORY, NAMED_COMMITTER_CLASS, NAMED_COMMITTER_FACTORY

Constructor Summary

Constructors

Constructor	Description
AzureManifestCommitterFactory()

Method Summary

Modifier and Type	Method	Description
ManifestCommitter	createOutputCommitter(Path outputPath, TaskAttemptContext context)	Create an output committer for a task attempt.

Methods inherited from class org.apache.hadoop.mapreduce.lib.output.PathOutputCommitterFactory

createCommitter, createFileOutputCommitter, getCommitterFactory

Methods inherited from class org.apache.hadoop.conf.Configured

getConf, setConf

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Details

NAME

public static final String NAME

Classname, which can be declared in job configurations.

Constructor Details

AzureManifestCommitterFactory

public AzureManifestCommitterFactory()

Method Details

createOutputCommitter

public ManifestCommitter createOutputCommitter(Path outputPath,
 TaskAttemptContext context)
                                        throws IOException

Description copied from class: PathOutputCommitterFactory

Create an output committer for a task attempt.

Overrides:

createOutputCommitter in class ManifestCommitterFactory

Parameters:

outputPath - output path. This may be null.

context - context

Returns:

a new committer

Throws:

IOException - problems instantiating the committer