Uses of Class
org.apache.hadoop.conf.Configuration
Packages that use Configuration
Package
Description
Configuration of system parameters.
Licensed to the Apache Software Foundation (ASF) under one
or more contributor license agreements.
Implementations of
AbstractFileSystem for hdfs
over rpc and hdfs over web.Supporting classes for metrics instrumentation.
public interface to expose OAuth2 authentication related features.
Licensed to the Apache Software Foundation (ASF) under one
or more contributor license agreements.
Licensed to the Apache Software Foundation (ASF) under one
or more contributor license agreements.
Google Cloud Storage Filesystem.
This package contains implementation classes for use inside
filesystems.
Package for supporting
HuaweiCloud
Object Storage Service (OBS) as a backend filesystem in Hadoop.
This package provides support for HDFS permission and ACL.
S3A Filesystem.
Authentication and permissions support.
Input and Output stream support.
Classes related to writing objects.
ViewFileSystem and ViewFileSystemOverloadScheme classes.
A distributed implementation of
FileSystem.This package provides the administrative APIs for HDFS.
The state store uses modular data storage classes derived from
StateStoreDriver to handle querying, updating and deleting data records.
Implementations of state store data providers/drivers.
OAuth2-based WebHDFS authentication.
Generic i/o code for use when reading and writing data to the network,
to databases, and to files.
Tools to help define network clients and servers.
Intermediate manifest committer.
Builtin metrics sinks
Network-related classes.
Classes for hadoop security.
Provides the hadoop credential provider API.
Support for service-level authorization.
Filters for HTTP service security.
Support for delegation tokens.
Support for services.
This package contains classes, interfaces and exceptions to launch
YARN services from the command line.
Command-line tools for MapReduce.
Common utilities.
Support for functional programming within the Hadoop APIs.
Licensed to the Apache Software Foundation (ASF) under one
or more contributor license agreements.
Licensed to the Apache Software Foundation (ASF) under one
or more contributor license agreements.
Licensed to the Apache Software Foundation (ASF) under one
or more contributor license agreements.
Licensed to the Apache Software Foundation (ASF) under one
or more contributor license agreements.
Licensed to the Apache Software Foundation (ASF) under one
or more contributor license agreements.
Licensed to the Apache Software Foundation (ASF) under one
or more contributor license agreements.
Licensed to the Apache Software Foundation (ASF) under one
or more contributor license agreements.
Licensed to the Apache Software Foundation (ASF) under one
or more contributor license agreements.
Licensed to the Apache Software Foundation (ASF) under one
or more contributor license agreements.
Package org.apache.hadoop.yarn.service.client contains classes
for YARN Services Client API.
Licensed to the Apache Software Foundation (ASF) under one
or more contributor license agreements.
Licensed to the Apache Software Foundation (ASF) under one
or more contributor license agreements.
-
Uses of Configuration in org.apache.hadoop.conf
Methods in org.apache.hadoop.conf that return ConfigurationModifier and TypeMethodDescriptionConfigurable.getConf()Return the configuration used by this object.Configured.getConf()Methods in org.apache.hadoop.conf with parameters of type ConfigurationModifier and TypeMethodDescriptionvoidConfiguration.addResource(Configuration conf) Add a configuration resource.static voidConfiguration.dumpConfiguration(Configuration config, Writer out) Writes out all properties and their attributes (final and resource) to the givenWriter, the format of the output would be,static voidConfiguration.dumpConfiguration(Configuration config, String propertyName, Writer out) Writes properties and their attributes (final and resource) to the givenWriter.voidConfigurable.setConf(Configuration conf) Set the configuration to be used by this object.voidConfigured.setConf(Configuration conf) voidConfiguration.writeXml(String propertyName, Writer out, Configuration config) Write out the non-default properties in this configuration to the givenWriter.Constructors in org.apache.hadoop.conf with parameters of type ConfigurationModifierConstructorDescriptionConfiguration(Configuration other) A new configuration with the same settings cloned from another.Configured(Configuration conf) Construct a Configured. -
Uses of Configuration in org.apache.hadoop.crypto.key
Methods in org.apache.hadoop.crypto.key that return ConfigurationMethods in org.apache.hadoop.crypto.key with parameters of type ConfigurationModifier and TypeMethodDescriptionabstract KeyProviderKeyProviderFactory.createProvider(URI providerName, Configuration conf) static KeyProviderKeyProviderFactory.get(URI uri, Configuration conf) Create a KeyProvider based on a provided URI.static List<KeyProvider>KeyProviderFactory.getProviders(Configuration conf) static org.apache.hadoop.crypto.key.KeyProvider.OptionsKeyProvider.options(Configuration conf) A helper function to create an options object.Constructors in org.apache.hadoop.crypto.key with parameters of type Configuration -
Uses of Configuration in org.apache.hadoop.filecache
Methods in org.apache.hadoop.filecache with parameters of type ConfigurationModifier and TypeMethodDescriptionstatic voidDistributedCache.addLocalArchives(Configuration conf, String str) Deprecated.static voidDistributedCache.addLocalFiles(Configuration conf, String str) Deprecated.static voidDistributedCache.createAllSymlink(Configuration conf, File jobCacheDir, File workDir) Deprecated.Internal to MapReduce framework.static FileStatusDistributedCache.getFileStatus(Configuration conf, URI cache) Deprecated.static longDistributedCache.getTimestamp(Configuration conf, URI cache) Deprecated.static voidDistributedCache.setArchiveTimestamps(Configuration conf, String timestamps) Deprecated.static voidDistributedCache.setFileTimestamps(Configuration conf, String timestamps) Deprecated.static voidDistributedCache.setLocalArchives(Configuration conf, String str) Deprecated.static voidDistributedCache.setLocalFiles(Configuration conf, String str) Deprecated. -
Uses of Configuration in org.apache.hadoop.fs
Methods in org.apache.hadoop.fs that return ConfigurationMethods in org.apache.hadoop.fs with parameters of type ConfigurationModifier and TypeMethodDescriptionstatic booleanFileUtil.copy(File src, FileSystem dstFS, Path dst, boolean deleteSource, Configuration conf) Copy local files to a FileSystem.static booleanFileUtil.copy(FileSystem srcFS, FileStatus srcStatus, FileSystem dstFS, Path dst, boolean deleteSource, boolean overwrite, Configuration conf) Copy a file/directory tree within/between filesystems.static booleanFileUtil.copy(FileSystem srcFS, Path[] srcs, FileSystem dstFS, Path dst, boolean deleteSource, boolean overwrite, Configuration conf) static booleanFileUtil.copy(FileSystem srcFS, Path src, File dst, boolean deleteSource, Configuration conf) Copy FileSystem files to local files.static booleanFileUtil.copy(FileSystem srcFS, Path src, FileSystem dstFS, Path dst, boolean deleteSource, boolean overwrite, Configuration conf) Copy files between FileSystems.static booleanFileUtil.copy(FileSystem srcFS, Path src, FileSystem dstFS, Path dst, boolean deleteSource, Configuration conf) Copy files between FileSystems.static AbstractFileSystemAbstractFileSystem.createFileSystem(URI uri, Configuration conf) Create a file system instance for the specified uri using the conf.static AbstractFileSystemAbstractFileSystem.get(URI uri, Configuration conf) The main factory method for creating a file system.static FileSystemFileSystem.get(URI uri, Configuration conf) Get a FileSystem for this URI's scheme and authority.static FileSystemFileSystem.get(URI uri, Configuration conf, String user) Get a FileSystem instance based on the uri, the passed in configuration and the user.static FileSystemFileSystem.get(Configuration conf) Returns the configured FileSystem implementation.static StringStorageType.getConf(Configuration conf, StorageType t, String name) Get the configured values for different StorageType.static URIFileSystem.getDefaultUri(Configuration conf) Get the default FileSystem URI from a configuration.static FileContextFileContext.getFileContext(URI defaultFsUri, Configuration aConf) Create a FileContext for specified default URI using the specified config.static FileContextFileContext.getFileContext(Configuration aConf) Create a FileContext using the passed config.static FileContextFileContext.getFileContext(AbstractFileSystem defFS, Configuration aConf) Create a FileContext with specified FS as default using the specified config.Path.getFileSystem(Configuration conf) Return the FileSystem that owns this Path.static Class<? extends FileSystem>FileSystem.getFileSystemClass(String scheme, Configuration conf) Get the FileSystem implementation class of a filesystem.protected static FileSystemFileSystem.getFSofPath(Path absOrFqPath, Configuration conf) static TrashPolicyTrashPolicy.getInstance(Configuration conf, FileSystem fs) Get an instance of the configured TrashPolicy based on the value of the configuration parameter fs.trash.classname.static TrashPolicyTrashPolicy.getInstance(Configuration conf, FileSystem fs, Path home) Deprecated.UseTrashPolicy.getInstance(Configuration, FileSystem)instead.static LocalFileSystemFileSystem.getLocal(Configuration conf) Get the local FileSystem.static FileContextFileContext.getLocalFSFileContext(Configuration aConf) static FileSystemFileSystem.getNamed(String name, Configuration conf) Deprecated.callFileSystem.get(URI, Configuration)instead.voidFileSystem.initialize(URI name, Configuration conf) Initialize a FileSystem.voidFilterFileSystem.initialize(URI name, Configuration conf) Called after a new FileSystem instance is constructed.voidLocalFileSystem.initialize(URI name, Configuration conf) voidRawLocalFileSystem.initialize(URI uri, Configuration conf) voidTrashPolicy.initialize(Configuration conf, FileSystem fs) Used to setup the trash policy.abstract voidTrashPolicy.initialize(Configuration conf, FileSystem fs, Path home) Deprecated.UseTrashPolicy.initialize(Configuration, FileSystem)instead.static booleanTrash.moveToAppropriateTrash(FileSystem fs, Path p, Configuration conf) In case of the symlinks or mount points, one has to move the appropriate trashbin in the actual volume of the path p being deleted.static FileSystemFileSystem.newInstance(URI uri, Configuration config) Returns the FileSystem for this URI's scheme and authority.static FileSystemFileSystem.newInstance(URI uri, Configuration conf, String user) Returns the FileSystem for this URI's scheme and authority and the given user.static FileSystemFileSystem.newInstance(Configuration conf) Returns a unique configured FileSystem implementation for the default filesystem of the supplied configuration.static LocalFileSystemFileSystem.newInstanceLocal(Configuration conf) Get a unique local FileSystem object.voidChecksumFileSystem.setConf(Configuration conf) static voidFileSystem.setDefaultUri(Configuration conf, String uri) Set the default FileSystem URI in a configuration.static voidFileSystem.setDefaultUri(Configuration conf, URI uri) Set the default FileSystem URI in a configuration.Constructors in org.apache.hadoop.fs with parameters of type ConfigurationModifierConstructorDescriptionTrash(Configuration conf) Construct a trash can accessor.Trash(FileSystem fs, Configuration conf) Construct a trash can accessor for the FileSystem provided. -
Uses of Configuration in org.apache.hadoop.fs.adl
Methods in org.apache.hadoop.fs.adl that return ConfigurationModifier and TypeMethodDescriptionstatic ConfigurationAdlFileSystem.propagateAccountOptions(Configuration source, String accountName) Propagates account-specific settings into generic ADL configuration keys.Methods in org.apache.hadoop.fs.adl with parameters of type ConfigurationModifier and TypeMethodDescriptionprotected AzureADTokenProviderAdlFileSystem.getCustomAccessTokenProvider(Configuration conf) This method is provided for convenience for derived classes to define customAzureADTokenProviderinstance.voidAdlFileSystem.initialize(URI storeUri, Configuration originalConf) Called after a new FileSystem instance is constructed.static ConfigurationAdlFileSystem.propagateAccountOptions(Configuration source, String accountName) Propagates account-specific settings into generic ADL configuration keys. -
Uses of Configuration in org.apache.hadoop.fs.adl.oauth2
Methods in org.apache.hadoop.fs.adl.oauth2 with parameters of type ConfigurationModifier and TypeMethodDescriptionabstract voidAzureADTokenProvider.initialize(Configuration configuration) Initialize with supported configuration. -
Uses of Configuration in org.apache.hadoop.fs.azure
Methods in org.apache.hadoop.fs.azure with parameters of type ConfigurationModifier and TypeMethodDescriptionvoidNativeAzureFileSystem.initialize(URI uri, Configuration conf) Deprecated.Fails Any Attempt to use WASB FileSystem Implementation. -
Uses of Configuration in org.apache.hadoop.fs.azurebfs.oauth2
Methods in org.apache.hadoop.fs.azurebfs.oauth2 with parameters of type ConfigurationModifier and TypeMethodDescriptionvoidClientAssertionProvider.initialize(Configuration configuration, String accountName) Initializes the provider with the given configuration. -
Uses of Configuration in org.apache.hadoop.fs.ftp
Methods in org.apache.hadoop.fs.ftp with parameters of type Configuration -
Uses of Configuration in org.apache.hadoop.fs.gs
Constructors in org.apache.hadoop.fs.gs with parameters of type Configuration -
Uses of Configuration in org.apache.hadoop.fs.impl
Methods in org.apache.hadoop.fs.impl that return ConfigurationModifier and TypeMethodDescriptionAbstractFSBuilderImpl.getOptions()Get the mutable option configuration. -
Uses of Configuration in org.apache.hadoop.fs.obs
Constructors in org.apache.hadoop.fs.obs with parameters of type Configuration -
Uses of Configuration in org.apache.hadoop.fs.permission
Methods in org.apache.hadoop.fs.permission with parameters of type ConfigurationModifier and TypeMethodDescriptionstatic FsPermissionFsPermission.getUMask(Configuration conf) Get the user file creation mask (umask)UMASK_LABELconfig param has umask value that is either symbolic or octal.static voidFsPermission.setUMask(Configuration conf, FsPermission umask) Set the user file creation mask (umask) -
Uses of Configuration in org.apache.hadoop.fs.s3a
Methods in org.apache.hadoop.fs.s3a with parameters of type ConfigurationModifier and TypeMethodDescriptionprotected software.amazon.awssdk.auth.credentials.AwsCredentialsTemporaryAWSCredentialsProvider.createCredentials(Configuration config) The credentials here must include a session token, else this operation will raise an exception.Constructors in org.apache.hadoop.fs.s3a with parameters of type ConfigurationModifierConstructorDescriptionS3A(URI theUri, Configuration conf) SimpleAWSCredentialsProvider(URI uri, Configuration conf) Build the credentials from a filesystem URI and configuration.TemporaryAWSCredentialsProvider(URI uri, Configuration conf) Constructor: the URI will be null if the provider is inited unbonded to a filesystem.Construct from just a configuration. -
Uses of Configuration in org.apache.hadoop.fs.s3a.auth
Constructors in org.apache.hadoop.fs.s3a.auth with parameters of type ConfigurationModifierConstructorDescriptionAssumedRoleCredentialProvider(URI fsUri, Configuration conf) Instantiate.ProfileAWSCredentialsProvider(URI uri, Configuration conf) -
Uses of Configuration in org.apache.hadoop.fs.s3a.impl.streams
Methods in org.apache.hadoop.fs.s3a.impl.streams that return types with arguments of type ConfigurationModifier and TypeMethodDescriptionFunction<Configuration,org.apache.hadoop.fs.s3a.impl.streams.ObjectInputStreamFactory> InputStreamType.factory()Factory constructor. -
Uses of Configuration in org.apache.hadoop.fs.s3a.impl.write
Methods in org.apache.hadoop.fs.s3a.impl.write with parameters of type ConfigurationModifier and TypeMethodDescriptionbooleanWriteObjectFlags.isEnabled(Configuration options) does the configuration contain this option as a boolean? -
Uses of Configuration in org.apache.hadoop.fs.viewfs
Methods in org.apache.hadoop.fs.viewfs with parameters of type ConfigurationModifier and TypeMethodDescriptionvoidViewFileSystem.initialize(URI theUri, Configuration conf) Called after a new FileSystem instance is constructed.Constructors in org.apache.hadoop.fs.viewfs with parameters of type ConfigurationModifierConstructorDescriptionViewFileSystem(Configuration conf) Convenience Constructor for apps to call directly.ViewFs(Configuration conf) -
Uses of Configuration in org.apache.hadoop.ha
Methods in org.apache.hadoop.ha with parameters of type ConfigurationModifier and TypeMethodDescriptionHAServiceTarget.getHealthMonitorProxy(Configuration conf, int timeoutMs) Returns a proxy to connect to the target HA service for health monitoring.HAServiceTarget.getHealthMonitorProxy(Configuration conf, int timeoutMs, int retries) HAServiceTarget.getProxy(Configuration conf, int timeoutMs) org.apache.hadoop.ha.ZKFCProtocolHAServiceTarget.getZKFCProxy(Configuration conf, int timeoutMs) -
Uses of Configuration in org.apache.hadoop.hdfs
Methods in org.apache.hadoop.hdfs with parameters of type ConfigurationModifier and TypeMethodDescriptionabstract ReplicaAccessorBuilderReplicaAccessorBuilder.setConfiguration(Configuration conf) Set the configuration to use. -
Uses of Configuration in org.apache.hadoop.hdfs.client
Constructors in org.apache.hadoop.hdfs.client with parameters of type ConfigurationModifierConstructorDescriptionHdfsAdmin(URI uri, Configuration conf) Create a new HdfsAdmin client. -
Uses of Configuration in org.apache.hadoop.hdfs.server.aliasmap
Methods in org.apache.hadoop.hdfs.server.aliasmap that return ConfigurationMethods in org.apache.hadoop.hdfs.server.aliasmap with parameters of type ConfigurationModifier and TypeMethodDescriptionstatic InMemoryAliasMapInMemoryAliasMap.init(Configuration conf, String blockPoolID) voidInMemoryAliasMap.setConf(Configuration conf) static voidInMemoryAliasMap.transferForBootstrap(javax.servlet.http.HttpServletResponse response, Configuration conf, InMemoryAliasMap aliasMap) Transfer this aliasmap for bootstrapping standby Namenodes. -
Uses of Configuration in org.apache.hadoop.hdfs.server.common.blockaliasmap.impl
Methods in org.apache.hadoop.hdfs.server.common.blockaliasmap.impl that return ConfigurationModifier and TypeMethodDescriptionLevelDBFileRegionAliasMap.getConf()TextFileRegionAliasMap.getConf()Methods in org.apache.hadoop.hdfs.server.common.blockaliasmap.impl with parameters of type ConfigurationModifier and TypeMethodDescriptionvoidLevelDBFileRegionAliasMap.setConf(Configuration conf) voidTextFileRegionAliasMap.setConf(Configuration conf) -
Uses of Configuration in org.apache.hadoop.hdfs.server.federation.store.driver
Methods in org.apache.hadoop.hdfs.server.federation.store.driver that return ConfigurationModifier and TypeMethodDescriptionprotected ConfigurationStateStoreDriver.getConf()Get the State Store configuration.Methods in org.apache.hadoop.hdfs.server.federation.store.driver with parameters of type ConfigurationModifier and TypeMethodDescriptionbooleanStateStoreDriver.init(Configuration config, String id, Collection<Class<? extends org.apache.hadoop.hdfs.server.federation.store.records.BaseRecord>> records, org.apache.hadoop.hdfs.server.federation.metrics.StateStoreMetrics stateStoreMetrics) Initialize the state store connection. -
Uses of Configuration in org.apache.hadoop.hdfs.server.federation.store.driver.impl
Methods in org.apache.hadoop.hdfs.server.federation.store.driver.impl with parameters of type ConfigurationModifier and TypeMethodDescriptionbooleanStateStoreSerializableImpl.init(Configuration config, String id, Collection<Class<? extends org.apache.hadoop.hdfs.server.federation.store.records.BaseRecord>> records, org.apache.hadoop.hdfs.server.federation.metrics.StateStoreMetrics metrics) -
Uses of Configuration in org.apache.hadoop.hdfs.server.namenode
Methods in org.apache.hadoop.hdfs.server.namenode that return ConfigurationModifier and TypeMethodDescriptionFileSystemImage.getConf()FixedBlockResolver.getConf()SingleUGIResolver.getConf()Methods in org.apache.hadoop.hdfs.server.namenode with parameters of type ConfigurationModifier and TypeMethodDescriptionvoidAuditLogger.initialize(Configuration conf) Called during initialization of the logger.abstract voidDefaultAuditLogger.initialize(Configuration conf) voidFileSystemImage.setConf(Configuration conf) voidFixedBlockMultiReplicaResolver.setConf(Configuration conf) voidFixedBlockResolver.setConf(Configuration conf) voidSingleUGIResolver.setConf(Configuration conf) Constructors in org.apache.hadoop.hdfs.server.namenode with parameters of type Configuration -
Uses of Configuration in org.apache.hadoop.hdfs.web.oauth2
Methods in org.apache.hadoop.hdfs.web.oauth2 that return ConfigurationMethods in org.apache.hadoop.hdfs.web.oauth2 with parameters of type ConfigurationModifier and TypeMethodDescriptionvoidAccessTokenProvider.setConf(Configuration configuration) Set the conf.voidConfCredentialBasedAccessTokenProvider.setConf(Configuration conf) voidConfRefreshTokenBasedAccessTokenProvider.setConf(Configuration conf) voidCredentialBasedAccessTokenProvider.setConf(Configuration conf) Constructors in org.apache.hadoop.hdfs.web.oauth2 with parameters of type ConfigurationModifierConstructorDescriptionOAuth2ConnectionConfigurator(Configuration conf, org.apache.hadoop.security.authentication.client.ConnectionConfigurator sslConfigurator) -
Uses of Configuration in org.apache.hadoop.io
Methods in org.apache.hadoop.io that return ConfigurationModifier and TypeMethodDescriptionAbstractMapWritable.getConf()EnumSetWritable.getConf()GenericWritable.getConf()ObjectWritable.getConf()WritableComparator.getConf()Methods in org.apache.hadoop.io with parameters of type ConfigurationModifier and TypeMethodDescriptionstatic <T extends Writable>
TWritableUtils.clone(T orig, Configuration conf) Make a copy of a writable object using serialization to a buffer.static voidIOUtils.copyBytes(InputStream in, OutputStream out, Configuration conf) Copies from one stream to another.static voidIOUtils.copyBytes(InputStream in, OutputStream out, Configuration conf, boolean close) Copies from one stream to another.static org.apache.hadoop.io.SequenceFile.WriterSequenceFile.createWriter(Configuration conf, FSDataOutputStream out, Class keyClass, Class valClass, SequenceFile.CompressionType compressionType, CompressionCodec codec) Deprecated.static org.apache.hadoop.io.SequenceFile.WriterSequenceFile.createWriter(Configuration conf, FSDataOutputStream out, Class keyClass, Class valClass, SequenceFile.CompressionType compressionType, CompressionCodec codec, org.apache.hadoop.io.SequenceFile.Metadata metadata) Deprecated.static org.apache.hadoop.io.SequenceFile.WriterSequenceFile.createWriter(Configuration conf, org.apache.hadoop.io.SequenceFile.Writer.Option... opts) Create a new Writer with the given options.static org.apache.hadoop.io.SequenceFile.WriterSequenceFile.createWriter(FileContext fc, Configuration conf, Path name, Class keyClass, Class valClass, SequenceFile.CompressionType compressionType, CompressionCodec codec, org.apache.hadoop.io.SequenceFile.Metadata metadata, EnumSet<CreateFlag> createFlag, org.apache.hadoop.fs.Options.CreateOpts... opts) Construct the preferred type of SequenceFile Writer.static org.apache.hadoop.io.SequenceFile.WriterSequenceFile.createWriter(FileSystem fs, Configuration conf, Path name, Class keyClass, Class valClass) Deprecated.static org.apache.hadoop.io.SequenceFile.WriterSequenceFile.createWriter(FileSystem fs, Configuration conf, Path name, Class keyClass, Class valClass, int bufferSize, short replication, long blockSize, boolean createParent, SequenceFile.CompressionType compressionType, CompressionCodec codec, org.apache.hadoop.io.SequenceFile.Metadata metadata) Deprecated.static org.apache.hadoop.io.SequenceFile.WriterSequenceFile.createWriter(FileSystem fs, Configuration conf, Path name, Class keyClass, Class valClass, int bufferSize, short replication, long blockSize, SequenceFile.CompressionType compressionType, CompressionCodec codec, Progressable progress, org.apache.hadoop.io.SequenceFile.Metadata metadata) Deprecated.static org.apache.hadoop.io.SequenceFile.WriterSequenceFile.createWriter(FileSystem fs, Configuration conf, Path name, Class keyClass, Class valClass, SequenceFile.CompressionType compressionType) Deprecated.static org.apache.hadoop.io.SequenceFile.WriterSequenceFile.createWriter(FileSystem fs, Configuration conf, Path name, Class keyClass, Class valClass, SequenceFile.CompressionType compressionType, CompressionCodec codec) Deprecated.static org.apache.hadoop.io.SequenceFile.WriterSequenceFile.createWriter(FileSystem fs, Configuration conf, Path name, Class keyClass, Class valClass, SequenceFile.CompressionType compressionType, CompressionCodec codec, Progressable progress) Deprecated.static org.apache.hadoop.io.SequenceFile.WriterSequenceFile.createWriter(FileSystem fs, Configuration conf, Path name, Class keyClass, Class valClass, SequenceFile.CompressionType compressionType, CompressionCodec codec, Progressable progress, org.apache.hadoop.io.SequenceFile.Metadata metadata) Deprecated.static org.apache.hadoop.io.SequenceFile.WriterSequenceFile.createWriter(FileSystem fs, Configuration conf, Path name, Class keyClass, Class valClass, SequenceFile.CompressionType compressionType, Progressable progress) Deprecated.static longMapFile.fix(FileSystem fs, Path dir, Class<? extends Writable> keyClass, Class<? extends Writable> valueClass, boolean dryrun, Configuration conf) This method attempts to fix a corrupt MapFile by re-creating its index.static WritableComparatorWritableComparator.get(Class<? extends WritableComparable> c, Configuration conf) Get a comparator for aWritableComparableimplementation.static SequenceFile.CompressionTypeSequenceFile.getDefaultCompressionType(Configuration job) Get the compression type for the reduce outputsstatic <K> KDefaultStringifier.load(Configuration conf, String keyName, Class<K> itemClass) Restores the object from the configuration.static <K> K[]DefaultStringifier.loadArray(Configuration conf, String keyName, Class<K> itemClass) Restores the array of objects from the configuration.static Class<?>ObjectWritable.loadClass(Configuration conf, String className) Find and load the class with given nameclassNameby first finding it in the specifiedconf.static WritableWritableFactories.newInstance(Class<? extends Writable> c, Configuration conf) Create a new instance of a class with a defined factory.static ObjectObjectWritable.readObject(DataInput in, Configuration conf) static ObjectObjectWritable.readObject(DataInput in, ObjectWritable objectWritable, Configuration conf) voidAbstractMapWritable.setConf(Configuration conf) voidEnumSetWritable.setConf(Configuration conf) voidGenericWritable.setConf(Configuration conf) voidObjectWritable.setConf(Configuration conf) voidWritableComparator.setConf(Configuration conf) static voidSequenceFile.setDefaultCompressionType(Configuration job, SequenceFile.CompressionType val) Set the default compression type for sequence files.static <K> voidDefaultStringifier.store(Configuration conf, K item, String keyName) Stores the item in the configuration with the given keyName.static <K> voidDefaultStringifier.storeArray(Configuration conf, K[] items, String keyName) Stores the array of items in the configuration with the given keyName.static voidObjectWritable.writeObject(DataOutput out, Object instance, Class declaredClass, Configuration conf) static voidObjectWritable.writeObject(DataOutput out, Object instance, Class declaredClass, Configuration conf, boolean allowCompactArrays) Constructors in org.apache.hadoop.io with parameters of type ConfigurationModifierConstructorDescriptionDefaultStringifier(Configuration conf, Class<T> c) protectedWritableComparator(Class<? extends WritableComparable> keyClass, Configuration conf, boolean createInstances) -
Uses of Configuration in org.apache.hadoop.io.compress
Methods in org.apache.hadoop.io.compress that return ConfigurationModifier and TypeMethodDescriptionBZip2Codec.getConf()Return the configuration used by this object.DefaultCodec.getConf()PassthroughCodec.getConf()Methods in org.apache.hadoop.io.compress with parameters of type ConfigurationModifier and TypeMethodDescriptionstatic List<Class<? extends CompressionCodec>>CompressionCodecFactory.getCodecClasses(Configuration conf) Get the list of codecs discovered via a Java ServiceLoader, or listed in the configuration.static CompressorCodecPool.getCompressor(CompressionCodec codec, Configuration conf) Get aCompressorfor the givenCompressionCodecfrom the pool or a new one.voidCompressor.reinit(Configuration conf) Prepare the compressor to be used in a new stream with settings defined in the given Configurationstatic voidCompressionCodecFactory.setCodecClasses(Configuration conf, List<Class> classes) Sets a list of codec classes in the configuration.voidBZip2Codec.setConf(Configuration conf) Set the configuration to be used by this object.voidDefaultCodec.setConf(Configuration conf) voidPassthroughCodec.setConf(Configuration conf) Constructors in org.apache.hadoop.io.compress with parameters of type ConfigurationModifierConstructorDescriptionFind the codecs specified in the config value io.compression.codecs and register them. -
Uses of Configuration in org.apache.hadoop.io.file.tfile
Fields in org.apache.hadoop.io.file.tfile declared as Configuration -
Uses of Configuration in org.apache.hadoop.ipc
Methods in org.apache.hadoop.ipc with parameters of type ConfigurationModifier and TypeMethodDescriptionstatic voidServer.bind(ServerSocket socket, InetSocketAddress address, int backlog, Configuration conf, String rangeConf) static final intClient.getPingInterval(Configuration conf) Get the ping interval from configuration; If not set in the configuration, return the default value.static final intClient.getRpcTimeout(Configuration conf) The time after which a RPC will timeout.static final intClient.getTimeout(Configuration conf) Deprecated.useClient.getRpcTimeout(Configuration)insteadvoidServer.refreshCallQueue(Configuration conf) voidServer.refreshServiceAcl(Configuration conf, org.apache.hadoop.security.authorize.PolicyProvider provider) Refresh the service authorization ACL for the service handled by this server.voidServer.refreshServiceAclWithLoadedConfiguration(Configuration conf, org.apache.hadoop.security.authorize.PolicyProvider provider) Refresh the service authorization ACL for the service handled by this server using the specified Configuration.static final voidClient.setConnectTimeout(Configuration conf, int timeout) set the connection timeout value in configurationstatic final voidClient.setPingInterval(Configuration conf, int pingInterval) set the ping interval value in configurationConstructors in org.apache.hadoop.ipc with parameters of type ConfigurationModifierConstructorDescriptionClient(Class<? extends Writable> valueClass, Configuration conf) Construct an IPC client with the default SocketFactory.Client(Class<? extends Writable> valueClass, Configuration conf, SocketFactory factory) Construct an IPC client whose values are of the givenWritableclass.protectedServer(String bindAddress, int port, Class<? extends Writable> rpcRequestClass, int handlerCount, int numReaders, int queueSizePerHandler, Configuration conf, String serverName, SecretManager<? extends TokenIdentifier> secretManager) protectedServer(String bindAddress, int port, Class<? extends Writable> rpcRequestClass, int handlerCount, int numReaders, int queueSizePerHandler, Configuration conf, String serverName, SecretManager<? extends TokenIdentifier> secretManager, String portRangeConfig) Constructs a server listening on the named port and address.protectedServer(String bindAddress, int port, Class<? extends Writable> paramClass, int handlerCount, Configuration conf) -
Uses of Configuration in org.apache.hadoop.mapred
Subclasses of Configuration in org.apache.hadoop.mapredFields in org.apache.hadoop.mapred declared as ConfigurationMethods in org.apache.hadoop.mapred that return ConfigurationModifier and TypeMethodDescriptionRunningJob.getConfiguration()Get the underlying job configurationMethods in org.apache.hadoop.mapred with parameters of type ConfigurationModifier and TypeMethodDescriptionstatic intSkipBadRecords.getAttemptsToStartSkipping(Configuration conf) Get the number of Task attempts AFTER which skip mode will be kicked off.static booleanSkipBadRecords.getAutoIncrMapperProcCount(Configuration conf) Get the flag which if set to true,SkipBadRecords.COUNTER_MAP_PROCESSED_RECORDSis incremented by MapRunner after invoking the map function.static booleanSkipBadRecords.getAutoIncrReducerProcCount(Configuration conf) Get the flag which if set to true,SkipBadRecords.COUNTER_REDUCE_PROCESSED_GROUPSis incremented by framework after invoking the reduce function.static longSkipBadRecords.getMapperMaxSkipRecords(Configuration conf) Get the number of acceptable skip records surrounding the bad record PER bad record in mapper.static org.apache.hadoop.io.MapFile.Reader[]MapFileOutputFormat.getReaders(FileSystem ignored, Path dir, Configuration conf) Open the output generated by this format.static org.apache.hadoop.io.SequenceFile.Reader[]SequenceFileOutputFormat.getReaders(Configuration conf, Path dir) Open the output generated by this format.static intFixedLengthInputFormat.getRecordLength(Configuration conf) Get record length valuestatic longSkipBadRecords.getReducerMaxSkipGroups(Configuration conf) Get the number of acceptable skip groups surrounding the bad group PER bad group in reducer.static PathSkipBadRecords.getSkipOutputPath(Configuration conf) Get the directory to which skipped records are written.static voidSkipBadRecords.setAttemptsToStartSkipping(Configuration conf, int attemptsToStartSkipping) Set the number of Task attempts AFTER which skip mode will be kicked off.static voidSkipBadRecords.setAutoIncrMapperProcCount(Configuration conf, boolean autoIncr) Set the flag which if set to true,SkipBadRecords.COUNTER_MAP_PROCESSED_RECORDSis incremented by MapRunner after invoking the map function.static voidSkipBadRecords.setAutoIncrReducerProcCount(Configuration conf, boolean autoIncr) Set the flag which if set to true,SkipBadRecords.COUNTER_REDUCE_PROCESSED_GROUPSis incremented by framework after invoking the reduce function.static voidSequenceFileInputFilter.setFilterClass(Configuration conf, Class filterClass) set the filter classstatic voidSkipBadRecords.setMapperMaxSkipRecords(Configuration conf, long maxSkipRecs) Set the number of acceptable skip records surrounding the bad record PER bad record in mapper.static voidFixedLengthInputFormat.setRecordLength(Configuration conf, int recordLength) Set the length of each recordstatic voidSkipBadRecords.setReducerMaxSkipGroups(Configuration conf, long maxSkipGrps) Set the number of acceptable skip groups surrounding the bad group PER bad group in reducer.Constructors in org.apache.hadoop.mapred with parameters of type ConfigurationModifierConstructorDescriptionJobClient(InetSocketAddress jobTrackAddr, Configuration conf) Build a job client, connect to the indicated job tracker.JobClient(Configuration conf) Build a job client with the givenConfiguration, and connect to the default clusterJobConf(Configuration conf) Construct a map/reduce job configuration.JobConf(Configuration conf, Class exampleClass) Construct a map/reduce job configuration.KeyValueLineRecordReader(Configuration job, FileSplit split) SequenceFileAsTextRecordReader(Configuration conf, FileSplit split) SequenceFileRecordReader(Configuration conf, FileSplit split) -
Uses of Configuration in org.apache.hadoop.mapred.join
Methods in org.apache.hadoop.mapred.join that return ConfigurationModifier and TypeMethodDescriptionCompositeRecordReader.getConf()Return the configuration used by this object.WrappedRecordReader.getConf()Methods in org.apache.hadoop.mapred.join with parameters of type ConfigurationModifier and TypeMethodDescriptionvoidCompositeRecordReader.setConf(Configuration conf) Set the configuration to be used by this object.voidWrappedRecordReader.setConf(Configuration conf) -
Uses of Configuration in org.apache.hadoop.mapred.lib
Constructors in org.apache.hadoop.mapred.lib with parameters of type ConfigurationModifierConstructorDescriptionprotectedCombineFileRecordReaderWrapper(FileInputFormat<K, V> inputFormat, CombineFileSplit split, Configuration conf, Reporter reporter, Integer idx) -
Uses of Configuration in org.apache.hadoop.mapred.pipes
Constructors in org.apache.hadoop.mapred.pipes with parameters of type Configuration -
Uses of Configuration in org.apache.hadoop.mapreduce
Methods in org.apache.hadoop.mapreduce that return ConfigurationModifier and TypeMethodDescriptionJobContext.getConfiguration()Return the configuration for the job.Methods in org.apache.hadoop.mapreduce with parameters of type ConfigurationModifier and TypeMethodDescriptionstatic voidJob.addArchiveToClassPath(Path archive, Configuration conf, FileSystem fs) Add an archive path to the current set of classpath entries.static booleanJob.addArchiveToSharedCache(URI resource, Configuration conf) Add an archive to job config for shared cache processing.static voidJob.addCacheArchive(URI uri, Configuration conf) Add an archives to be localized to the conf.static voidJob.addCacheFile(URI uri, Configuration conf) Add a file to be localized to the conf.static voidJob.addFileToClassPath(Path file, Configuration conf, FileSystem fs) Add a file path to the current set of classpath entries.static voidJob.addFileToClassPath(Path file, Configuration conf, FileSystem fs, boolean addToCache) Add a file path to the current set of classpath entries.static booleanJob.addFileToSharedCache(URI resource, Configuration conf) Add a file to job config for shared cache processing.static booleanJob.addFileToSharedCacheAndClasspath(URI resource, Configuration conf) Add a file to job config for shared cache processing.This is to get the shared cache upload policies for archives.static intJob.getCompletionPollInterval(Configuration conf) The interval at which waitForCompletion() should check.This is to get the shared cache upload policies for files.static JobJob.getInstance(Configuration conf) static JobJob.getInstance(Configuration conf, String jobName) static JobJob.getInstance(Cluster ignored, Configuration conf) Deprecated.static JobJob.getInstance(Cluster cluster, JobStatus status, Configuration conf) static JobJob.getInstance(JobStatus status, Configuration conf) static intJob.getProgressPollInterval(Configuration conf) The interval at which monitorAndPrintJob() prints statusstatic Job.TaskStatusFilterJob.getTaskOutputFilter(Configuration conf) Get the task output filter.static voidJob.setArchiveSharedCacheUploadPolicies(Configuration conf, Map<String, Boolean> policies) This is to set the shared cache upload policies for archives.static voidJob.setCacheArchives(URI[] archives, Configuration conf) Set the configuration with the given set of archives.static voidJob.setCacheFiles(URI[] files, Configuration conf) Set the configuration with the given set of files.static voidJob.setFileSharedCacheUploadPolicies(Configuration conf, Map<String, Boolean> policies) This is to set the shared cache upload policies for files.static voidJob.setTaskOutputFilter(Configuration conf, Job.TaskStatusFilter newValue) Modify the Configuration to set the task output filter.Constructors in org.apache.hadoop.mapreduce with parameters of type ConfigurationModifierConstructorDescriptionCluster(InetSocketAddress jobTrackAddr, Configuration conf) Cluster(Configuration conf) Job(Configuration conf) Deprecated.Job(Configuration conf, String jobName) Deprecated. -
Uses of Configuration in org.apache.hadoop.mapreduce.lib.aggregate
Methods in org.apache.hadoop.mapreduce.lib.aggregate that return ConfigurationModifier and TypeMethodDescriptionstatic ConfigurationValueAggregatorJob.setAggregatorDescriptors(Class<? extends ValueAggregatorDescriptor>[] descriptors) Methods in org.apache.hadoop.mapreduce.lib.aggregate with parameters of type ConfigurationModifier and TypeMethodDescriptionvoidUserDefinedValueAggregatorDescriptor.configure(Configuration conf) Do nothing.voidValueAggregatorBaseDescriptor.configure(Configuration conf) get the input file name.voidValueAggregatorDescriptor.configure(Configuration conf) Configure the objectstatic JobValueAggregatorJob.createValueAggregatorJob(Configuration conf, String[] args) Create an Aggregate based map/reduce job.protected static ArrayList<ValueAggregatorDescriptor>ValueAggregatorJobBase.getAggregatorDescriptors(Configuration conf) protected static ValueAggregatorDescriptorValueAggregatorJobBase.getValueAggregatorDescriptor(String spec, Configuration conf) static voidValueAggregatorJobBase.setup(Configuration job) Constructors in org.apache.hadoop.mapreduce.lib.aggregate with parameters of type ConfigurationModifierConstructorDescriptionUserDefinedValueAggregatorDescriptor(String className, Configuration conf) -
Uses of Configuration in org.apache.hadoop.mapreduce.lib.chain
Methods in org.apache.hadoop.mapreduce.lib.chain with parameters of type ConfigurationModifier and TypeMethodDescriptionstatic voidChainMapper.addMapper(Job job, Class<? extends Mapper> klass, Class<?> inputKeyClass, Class<?> inputValueClass, Class<?> outputKeyClass, Class<?> outputValueClass, Configuration mapperConf) Adds aMapperclass to the chain mapper.static voidChainReducer.addMapper(Job job, Class<? extends Mapper> klass, Class<?> inputKeyClass, Class<?> inputValueClass, Class<?> outputKeyClass, Class<?> outputValueClass, Configuration mapperConf) Adds aMapperclass to the chain reducer.static voidChainReducer.setReducer(Job job, Class<? extends Reducer> klass, Class<?> inputKeyClass, Class<?> inputValueClass, Class<?> outputKeyClass, Class<?> outputValueClass, Configuration reducerConf) Sets theReducerclass to the chain job. -
Uses of Configuration in org.apache.hadoop.mapreduce.lib.db
Methods in org.apache.hadoop.mapreduce.lib.db that return ConfigurationMethods in org.apache.hadoop.mapreduce.lib.db with parameters of type ConfigurationModifier and TypeMethodDescriptionstatic voidDBConfiguration.configureDB(Configuration job, String driverClass, String dbUrl) Sets the DB access related fields in the JobConf.static voidDBConfiguration.configureDB(Configuration conf, String driverClass, String dbUrl, String userName, String passwd) Sets the DB access related fields in theConfiguration.protected RecordReader<LongWritable,T> DataDrivenDBInputFormat.createDBRecordReader(org.apache.hadoop.mapreduce.lib.db.DBInputFormat.DBInputSplit split, Configuration conf) protected RecordReader<LongWritable,T> DBInputFormat.createDBRecordReader(org.apache.hadoop.mapreduce.lib.db.DBInputFormat.DBInputSplit split, Configuration conf) protected RecordReader<LongWritable,T> OracleDataDrivenDBInputFormat.createDBRecordReader(org.apache.hadoop.mapreduce.lib.db.DBInputFormat.DBInputSplit split, Configuration conf) static voidDataDrivenDBInputFormat.setBoundingQuery(Configuration conf, String query) Set the user-defined bounding query to use with a user-defined query.voidDBInputFormat.setConf(Configuration conf) Set the configuration to be used by this object.static voidOracleDBRecordReader.setSessionTimeZone(Configuration conf, Connection conn) Set session time zoneBigDecimalSplitter.split(Configuration conf, ResultSet results, String colName) BooleanSplitter.split(Configuration conf, ResultSet results, String colName) DateSplitter.split(Configuration conf, ResultSet results, String colName) DBSplitter.split(Configuration conf, ResultSet results, String colName) Given a ResultSet containing one record (and already advanced to that record) with two columns (a low value, and a high value, both of the same type), determine a set of splits that span the given values.FloatSplitter.split(Configuration conf, ResultSet results, String colName) IntegerSplitter.split(Configuration conf, ResultSet results, String colName) TextSplitter.split(Configuration conf, ResultSet results, String colName) This method needs to determine the splits between two user-provided strings.Constructors in org.apache.hadoop.mapreduce.lib.db with parameters of type ConfigurationModifierConstructorDescriptionDataDrivenDBRecordReader(org.apache.hadoop.mapreduce.lib.db.DBInputFormat.DBInputSplit split, Class<T> inputClass, Configuration conf, Connection conn, DBConfiguration dbConfig, String cond, String[] fields, String table, String dbProduct) DBRecordReader(org.apache.hadoop.mapreduce.lib.db.DBInputFormat.DBInputSplit split, Class<T> inputClass, Configuration conf, Connection conn, DBConfiguration dbConfig, String cond, String[] fields, String table) MySQLDataDrivenDBRecordReader(org.apache.hadoop.mapreduce.lib.db.DBInputFormat.DBInputSplit split, Class<T> inputClass, Configuration conf, Connection conn, DBConfiguration dbConfig, String cond, String[] fields, String table) MySQLDBRecordReader(org.apache.hadoop.mapreduce.lib.db.DBInputFormat.DBInputSplit split, Class<T> inputClass, Configuration conf, Connection conn, DBConfiguration dbConfig, String cond, String[] fields, String table) OracleDataDrivenDBRecordReader(org.apache.hadoop.mapreduce.lib.db.DBInputFormat.DBInputSplit split, Class<T> inputClass, Configuration conf, Connection conn, DBConfiguration dbConfig, String cond, String[] fields, String table) OracleDBRecordReader(org.apache.hadoop.mapreduce.lib.db.DBInputFormat.DBInputSplit split, Class<T> inputClass, Configuration conf, Connection conn, DBConfiguration dbConfig, String cond, String[] fields, String table) -
Uses of Configuration in org.apache.hadoop.mapreduce.lib.input
Fields in org.apache.hadoop.mapreduce.lib.input declared as ConfigurationMethods in org.apache.hadoop.mapreduce.lib.input with parameters of type ConfigurationModifier and TypeMethodDescriptionstatic intFixedLengthInputFormat.getRecordLength(Configuration conf) Get record length valueNLineInputFormat.getSplitsForFile(FileStatus status, Configuration conf, int numLinesPerSplit) static voidFixedLengthInputFormat.setRecordLength(Configuration conf, int recordLength) Set the length of each recordConstructors in org.apache.hadoop.mapreduce.lib.input with parameters of type Configuration -
Uses of Configuration in org.apache.hadoop.mapreduce.lib.jobcontrol
Constructors in org.apache.hadoop.mapreduce.lib.jobcontrol with parameters of type Configuration -
Uses of Configuration in org.apache.hadoop.mapreduce.lib.join
Fields in org.apache.hadoop.mapreduce.lib.join declared as ConfigurationMethods in org.apache.hadoop.mapreduce.lib.join that return ConfigurationModifier and TypeMethodDescriptionCompositeRecordReader.getConf()Return the configuration used by this object.Methods in org.apache.hadoop.mapreduce.lib.join with parameters of type ConfigurationModifier and TypeMethodDescriptionvoidCompositeRecordReader.setConf(Configuration conf) Set the configuration to be used by this object.voidCompositeInputFormat.setFormat(Configuration conf) Interpret a given string as a composite expression.Constructors in org.apache.hadoop.mapreduce.lib.join with parameters of type ConfigurationModifierConstructorDescriptionJoinRecordReader(int id, Configuration conf, int capacity, Class<? extends WritableComparator> cmpcl) MultiFilterRecordReader(int id, Configuration conf, int capacity, Class<? extends WritableComparator> cmpcl) -
Uses of Configuration in org.apache.hadoop.mapreduce.lib.output
Methods in org.apache.hadoop.mapreduce.lib.output with parameters of type ConfigurationModifier and TypeMethodDescriptionstatic PathOutputCommitterFactoryPathOutputCommitterFactory.getCommitterFactory(Path outputPath, Configuration conf) Get the committer factory for a configuration.static org.apache.hadoop.io.MapFile.Reader[]MapFileOutputFormat.getReaders(Path dir, Configuration conf) Open the output generated by this format. -
Uses of Configuration in org.apache.hadoop.mapreduce.lib.output.committer.manifest
Methods in org.apache.hadoop.mapreduce.lib.output.committer.manifest that return ConfigurationModifier and TypeMethodDescriptionManifestCommitter.getConf()Get the config of the task attempt this instance was constructed with. -
Uses of Configuration in org.apache.hadoop.mapreduce.lib.partition
Methods in org.apache.hadoop.mapreduce.lib.partition that return ConfigurationModifier and TypeMethodDescriptionBinaryPartitioner.getConf()KeyFieldBasedComparator.getConf()KeyFieldBasedPartitioner.getConf()TotalOrderPartitioner.getConf()Methods in org.apache.hadoop.mapreduce.lib.partition with parameters of type ConfigurationModifier and TypeMethodDescriptionstatic StringTotalOrderPartitioner.getPartitionFile(Configuration conf) Get the path to the SequenceFile storing the sorted partition keyset.voidBinaryPartitioner.setConf(Configuration conf) voidKeyFieldBasedComparator.setConf(Configuration conf) voidKeyFieldBasedPartitioner.setConf(Configuration conf) voidTotalOrderPartitioner.setConf(Configuration conf) Read in the partition file and build indexing data structures.static voidBinaryPartitioner.setLeftOffset(Configuration conf, int offset) Set the subarray to be used for partitioning tobytes[offset:]in Python syntax.static voidBinaryPartitioner.setOffsets(Configuration conf, int left, int right) Set the subarray to be used for partitioning tobytes[left:(right+1)]in Python syntax.static voidTotalOrderPartitioner.setPartitionFile(Configuration conf, Path p) Set the path to the SequenceFile storing the sorted partition keyset.static voidBinaryPartitioner.setRightOffset(Configuration conf, int offset) Set the subarray to be used for partitioning tobytes[:(offset+1)]in Python syntax.Constructors in org.apache.hadoop.mapreduce.lib.partition with parameters of type Configuration -
Uses of Configuration in org.apache.hadoop.mapreduce.security
Methods in org.apache.hadoop.mapreduce.security with parameters of type ConfigurationModifier and TypeMethodDescriptionstatic voidTokenCache.cleanUpTokenReferral(Configuration conf) Remove jobtoken referrals which don't make sense in the context of the task execution.static CredentialsTokenCache.loadTokens(String jobTokenFile, Configuration conf) Deprecated.UseCredentials.readTokenStorageFile(org.apache.hadoop.fs.Path, org.apache.hadoop.conf.Configuration)instead, this method is included for compatibility against Hadoop-1.static voidTokenCache.obtainTokensForNamenodes(Credentials credentials, Path[] ps, Configuration conf) Convenience method to obtain delegation tokens from namenodes corresponding to the paths passed. -
Uses of Configuration in org.apache.hadoop.mapreduce.tools
Constructors in org.apache.hadoop.mapreduce.tools with parameters of type Configuration -
Uses of Configuration in org.apache.hadoop.mapreduce.v2.hs
Methods in org.apache.hadoop.mapreduce.v2.hs with parameters of type ConfigurationModifier and TypeMethodDescriptionprotected voidHistoryFileManager.serviceInit(Configuration conf) -
Uses of Configuration in org.apache.hadoop.metrics2.sink
Fields in org.apache.hadoop.metrics2.sink declared as ConfigurationModifier and TypeFieldDescriptionprotected static ConfigurationRollingFileSystemSink.suppliedConf -
Uses of Configuration in org.apache.hadoop.net
Methods in org.apache.hadoop.net that return ConfigurationModifier and TypeMethodDescriptionAbstractDNSToSwitchMapping.getConf()ScriptBasedMapping.getConf()SocksSocketFactory.getConf()TableMapping.getConf()Methods in org.apache.hadoop.net with parameters of type ConfigurationModifier and TypeMethodDescriptionvoidAbstractDNSToSwitchMapping.setConf(Configuration conf) voidScriptBasedMapping.setConf(Configuration conf) Set the configuration to be used by this object.voidSocksSocketFactory.setConf(Configuration conf) voidTableMapping.setConf(Configuration conf) Constructors in org.apache.hadoop.net with parameters of type ConfigurationModifierConstructorDescriptionprotectedCreate an instance, caching the configuration file.Create an instance from the given configuration -
Uses of Configuration in org.apache.hadoop.security
Methods in org.apache.hadoop.security with parameters of type ConfigurationModifier and TypeMethodDescriptionSecurityUtil.getAuthenticationMethod(Configuration conf) static StringSecurityUtil.getClientPrincipal(Class<?> protocol, Configuration conf) Look up the client principal for a given protocol.static org.apache.hadoop.security.KerberosInfoSecurityUtil.getKerberosInfo(Class<?> protocol, Configuration conf) Look up the KerberosInfo for a given protocol.static TokenInfoSecurityUtil.getTokenInfo(Class<?> protocol, Configuration conf) Look up the TokenInfo for a given protocol.static List<org.apache.hadoop.util.ZKUtil.ZKAuthInfo>SecurityUtil.getZKAuthInfos(Configuration conf, String configKey) Utility method to fetch ZK auth info from the configuration.static voidSecurityUtil.login(Configuration conf, String keytabFileKey, String userNameKey) Login as a principal specified in config.static voidSecurityUtil.login(Configuration conf, String keytabFileKey, String userNameKey, String hostname) Login as a principal specified in config.static CredentialsCredentials.readTokenStorageFile(File filename, Configuration conf) Convenience method for reading a token storage file and loading its Tokens.static CredentialsCredentials.readTokenStorageFile(Path filename, Configuration conf) Convenience method for reading a token storage file and loading its Tokens.static voidSecurityUtil.setAuthenticationMethod(UserGroupInformation.AuthenticationMethod authenticationMethod, Configuration conf) static voidSecurityUtil.setConfiguration(Configuration conf) static voidUserGroupInformation.setConfiguration(Configuration conf) Set the static configuration for UGI.voidCredentials.writeTokenStorageFile(Path filename, Configuration conf) voidCredentials.writeTokenStorageFile(Path filename, Configuration conf, Credentials.SerializedFormat format) -
Uses of Configuration in org.apache.hadoop.security.alias
Methods in org.apache.hadoop.security.alias with parameters of type ConfigurationModifier and TypeMethodDescriptionabstract CredentialProviderCredentialProviderFactory.createProvider(URI providerName, Configuration conf) static List<CredentialProvider>CredentialProviderFactory.getProviders(Configuration conf) -
Uses of Configuration in org.apache.hadoop.security.authorize
Methods in org.apache.hadoop.security.authorize that return ConfigurationMethods in org.apache.hadoop.security.authorize with parameters of type Configuration -
Uses of Configuration in org.apache.hadoop.security.http
Methods in org.apache.hadoop.security.http with parameters of type ConfigurationModifier and TypeMethodDescriptionRestCsrfPreventionFilter.getFilterParams(Configuration conf, String confPrefix) Constructs a mapping of configuration properties to be used for filter initialization.XFrameOptionsFilter.getFilterParams(Configuration conf, String confPrefix) Constructs a mapping of configuration properties to be used for filter initialization. -
Uses of Configuration in org.apache.hadoop.security.token
Methods in org.apache.hadoop.security.token with parameters of type ConfigurationModifier and TypeMethodDescriptionvoidToken.cancel(Configuration conf) Cancel this delegation token.voidToken.TrivialRenewer.cancel(Token<?> token, Configuration conf) abstract voidTokenRenewer.cancel(Token<?> token, Configuration conf) Cancel the given token.longToken.renew(Configuration conf) Renew this delegation token.longToken.TrivialRenewer.renew(Token<?> token, Configuration conf) abstract longTokenRenewer.renew(Token<?> token, Configuration conf) Renew the given token.static voidSecretManager.update(Configuration conf) Updates the selected cryptographic algorithm and key length using the provided HadoopConfiguration. -
Uses of Configuration in org.apache.hadoop.service
Methods in org.apache.hadoop.service that return ConfigurationModifier and TypeMethodDescriptionAbstractService.getConfig()Service.getConfig()Get the configuration of this service.Methods in org.apache.hadoop.service with parameters of type ConfigurationModifier and TypeMethodDescriptionvoidAbstractService.init(Configuration conf) Initialize the service.voidService.init(Configuration config) Initialize the service.protected voidAbstractService.serviceInit(Configuration conf) All initialization code needed by a service.protected voidCompositeService.serviceInit(Configuration conf) protected voidAbstractService.setConfig(Configuration conf) Set the configuration for this service. -
Uses of Configuration in org.apache.hadoop.service.launcher
Methods in org.apache.hadoop.service.launcher that return ConfigurationModifier and TypeMethodDescriptionAbstractLaunchableService.bindArgs(Configuration config, List<String> args) Propagate the command line arguments.LaunchableService.bindArgs(Configuration config, List<String> args) Propagate the command line arguments.Methods in org.apache.hadoop.service.launcher with parameters of type ConfigurationModifier and TypeMethodDescriptionAbstractLaunchableService.bindArgs(Configuration config, List<String> args) Propagate the command line arguments.LaunchableService.bindArgs(Configuration config, List<String> args) Propagate the command line arguments. -
Uses of Configuration in org.apache.hadoop.tools
Methods in org.apache.hadoop.tools with parameters of type ConfigurationModifier and TypeMethodDescriptionstatic voidDistCpOptionSwitch.addToConf(Configuration conf, DistCpOptionSwitch option) Helper function to set an option to hadoop configuration objectstatic voidDistCpOptionSwitch.addToConf(Configuration conf, DistCpOptionSwitch option, String value) Helper function to add an option to hadoop configuration objectvoidDistCpOptions.appendToConf(Configuration conf) Add options to configuration.Constructors in org.apache.hadoop.tools with parameters of type ConfigurationModifierConstructorDescriptionDistCp(Configuration configuration, DistCpOptions inputOptions) Public Constructor. -
Uses of Configuration in org.apache.hadoop.util
Methods in org.apache.hadoop.util with parameters of type ConfigurationModifier and TypeMethodDescriptionstatic <T> TReflectionUtils.copy(Configuration conf, T src, T dst) Make a copy of the writable object using serialization to a buffer.static <T> TReflectionUtils.newInstance(Class<T> theClass, Configuration conf) Create an object for the given class and initialize it from confstatic <T> TReflectionUtils.newInstance(Class<T> theClass, Configuration conf, Class<?>[] argTypes, Object... values) Create an object for the given class and initialize it from confstatic intToolRunner.run(Configuration conf, Tool tool, String[] args) Runs the givenToolbyTool.run(String[]), after parsing with the given generic arguments.static voidReflectionUtils.setConf(Object theObject, Configuration conf) Check and set 'configuration' if necessary. -
Uses of Configuration in org.apache.hadoop.util.functional
Methods in org.apache.hadoop.util.functional with parameters of type ConfigurationModifier and TypeMethodDescriptionstatic voidFutureIO.propagateOptions(FSBuilder<?, ?> builder, Configuration conf, String prefix, boolean mandatory) Propagate options to any builder, converting everything with the prefix to an option where, if there were 2+ dot-separated elements, it is converted to a schema.FutureIO.propagateOptions(FSBuilder<T, U> builder, Configuration conf, String optionalPrefix, String mandatoryPrefix) Propagate options to any builder, converting everything with the prefix to an option where, if there were 2+ dot-separated elements, it is converted to a schema. -
Uses of Configuration in org.apache.hadoop.yarn.api.records
Methods in org.apache.hadoop.yarn.api.records with parameters of type ConfigurationModifier and TypeMethodDescriptionstatic URLURL.fromPath(Path path, Configuration conf) static URLURL.fromURI(URI uri, Configuration conf) -
Uses of Configuration in org.apache.hadoop.yarn.applications.distributedshell
Constructors in org.apache.hadoop.yarn.applications.distributedshell with parameters of type Configuration -
Uses of Configuration in org.apache.hadoop.yarn.client
Methods in org.apache.hadoop.yarn.client with parameters of type ConfigurationModifier and TypeMethodDescriptionstatic <T> TAHSProxy.createAHSProxy(Configuration conf, Class<T> protocol, InetSocketAddress ahsAddress) static <T> TNMProxy.createNMProxy(Configuration conf, Class<T> protocol, UserGroupInformation ugi, org.apache.hadoop.yarn.ipc.YarnRPC rpc, InetSocketAddress serverAddress) protected static <T> TServerProxy.createRetriableProxy(Configuration conf, Class<T> protocol, UserGroupInformation user, org.apache.hadoop.yarn.ipc.YarnRPC rpc, InetSocketAddress serverAddress, org.apache.hadoop.io.retry.RetryPolicy retryPolicy) static org.apache.hadoop.io.retry.RetryPolicyRMProxy.createRetryPolicy(Configuration conf, boolean isHAEnabled) Fetch retry policy from Configuration.protected static org.apache.hadoop.io.retry.RetryPolicyRMProxy.createRetryPolicy(Configuration conf, long retryTime, long retryInterval, boolean isHAEnabled) Fetch retry policy from Configuration and create the retry policy with specified retryTime and retry interval.protected static org.apache.hadoop.io.retry.RetryPolicyServerProxy.createRetryPolicy(Configuration conf, String maxWaitTimeStr, long defMaxWaitTime, String connectRetryIntervalStr, long defRetryInterval) static <T> TClientRMProxy.createRMProxy(Configuration configuration, Class<T> protocol) Create a proxy to the ResourceManager for the specified protocol.protected static <T> TRMProxy.createRMProxy(Configuration configuration, Class<T> protocol, RMProxy<T> instance) Currently, used by Client and AM only Create a proxy for the specified protocol.protected static <T> TRMProxy.createRMProxy(Configuration configuration, Class<T> protocol, RMProxy<T> instance, long retryTime, long retryInterval) Currently, used by NodeManagers only.static <T> TClientRMProxy.createRMProxyFederation(Configuration configuration, Class<T> protocol) Create a proxy to the ResourceManager for the specified protocol.protected static <T> TRMProxy.createRMProxyFederation(Configuration configuration, Class<T> protocol, RMProxy<T> instance) This functionality is only used for NodeManager and only in non-HA mode.static TextClientRMProxy.getAMRMTokenService(Configuration conf) protected static <T> TAHSProxy.getProxy(Configuration conf, Class<T> protocol, InetSocketAddress rmAddress) <T> TRMProxy.getProxy(Configuration conf, Class<T> protocol, InetSocketAddress rmAddress) Get a proxy to the RM at the specified address.static TextClientRMProxy.getRMDelegationTokenService(Configuration conf) Get the token service name to be used for RMDelegationToken.static TextClientRMProxy.getTokenService(Configuration conf, String address, String defaultAddr, int defaultPort) -
Uses of Configuration in org.apache.hadoop.yarn.client.api
Methods in org.apache.hadoop.yarn.client.api with parameters of type ConfigurationModifier and TypeMethodDescriptionstatic AppAdminClientAppAdminClient.createAppAdminClient(String appType, Configuration conf) Create a new instance of AppAdminClient. -
Uses of Configuration in org.apache.hadoop.yarn.client.api.impl
Methods in org.apache.hadoop.yarn.client.api.impl with parameters of type ConfigurationModifier and TypeMethodDescriptionprotected voidTimelineReaderClientImpl.serviceInit(Configuration conf) -
Uses of Configuration in org.apache.hadoop.yarn.client.cli
Methods in org.apache.hadoop.yarn.client.cli with parameters of type ConfigurationModifier and TypeMethodDescriptionprotected List<org.codehaus.jettison.json.JSONObject>LogsCLI.getAMContainerInfoForRMWebService(Configuration conf, String appId) protected javax.ws.rs.core.ResponseLogsCLI.getClientResponseFromTimelineReader(Configuration conf, String appId) javax.ws.rs.core.ResponseLogsCLI.getResponseFromNMWebService(Configuration conf, javax.ws.rs.client.Client webServiceClient, org.apache.hadoop.yarn.logaggregation.ContainerLogsRequest request, String logFile) intLogsCLI.printContainerLogsFromRunningApplication(Configuration conf, org.apache.hadoop.yarn.logaggregation.ContainerLogsRequest request, org.apache.hadoop.yarn.logaggregation.LogCLIHelpers logCliHelper, boolean useRegex, boolean ignoreSizeLimit) -
Uses of Configuration in org.apache.hadoop.yarn.conf
Subclasses of Configuration in org.apache.hadoop.yarn.confMethods in org.apache.hadoop.yarn.conf with parameters of type ConfigurationModifier and TypeMethodDescriptionstatic booleanYarnConfiguration.areNodeLabelsEnabled(Configuration conf) static StringYarnConfiguration.getClusterId(Configuration conf) YarnConfiguration.getExclusiveEnforcedPartitions(Configuration conf) static intYarnConfiguration.getRMDefaultPortNumber(String addressPrefix, Configuration conf) YarnConfiguration.getServiceAddressConfKeys(Configuration conf) static longYarnConfiguration.getSkipNodeInterval(Configuration conf) Returns Timeout to skip node from scheduling if not heartbeated.static floatYarnConfiguration.getTimelineServiceVersion(Configuration conf) Returns the timeline service version.static booleanYarnConfiguration.isAclEnabled(Configuration conf) static booleanYarnConfiguration.isCentralizedNodeLabelConfiguration(Configuration conf) static booleanYarnConfiguration.isDelegatedCentralizedNodeLabelConfiguration(Configuration conf) static booleanYarnConfiguration.isDistributedNodeLabelConfiguration(Configuration conf) static booleanYarnConfiguration.isDistSchedulingEnabled(Configuration conf) static booleanYarnConfiguration.isOpportunisticContainerAllocationEnabled(Configuration conf) static booleanYarnConfiguration.numaAwarenessEnabled(Configuration conf) Returns whether the NUMA awareness is enabled.static booleanYarnConfiguration.shouldRMFailFast(Configuration conf) static booleanYarnConfiguration.systemMetricsPublisherEnabled(Configuration conf) Returns whether the system publisher is enabled.static booleanYarnConfiguration.timelineServiceEnabled(Configuration conf) Returns whether the timeline service is enabled via configuration.static booleanYarnConfiguration.timelineServiceV15Enabled(Configuration conf) Returns whether the timeline service v.1,5 is enabled via configuration.static booleanYarnConfiguration.timelineServiceV1Enabled(Configuration conf) Returns whether the timeline service v.1 is enabled via configuration.static booleanYarnConfiguration.timelineServiceV2Enabled(Configuration conf) Returns whether the timeline service v.2 is enabled via configuration.static booleanYarnConfiguration.useHttps(Configuration conf) Constructors in org.apache.hadoop.yarn.conf with parameters of type Configuration -
Uses of Configuration in org.apache.hadoop.yarn.event
Methods in org.apache.hadoop.yarn.event with parameters of type Configuration -
Uses of Configuration in org.apache.hadoop.yarn.logaggregation
Constructors in org.apache.hadoop.yarn.logaggregation with parameters of type Configuration -
Uses of Configuration in org.apache.hadoop.yarn.logaggregation.filecontroller
Fields in org.apache.hadoop.yarn.logaggregation.filecontroller declared as ConfigurationMethods in org.apache.hadoop.yarn.logaggregation.filecontroller with parameters of type ConfigurationModifier and TypeMethodDescriptionprotected FileSystemLogAggregationFileController.getFileSystem(Configuration conf) voidLogAggregationFileController.initialize(Configuration conf, String controllerName) Initialize the log file controller.protected abstract voidLogAggregationFileController.initInternal(Configuration conf) Derived classes initialize themselves using this method. -
Uses of Configuration in org.apache.hadoop.yarn.security
Methods in org.apache.hadoop.yarn.security with parameters of type ConfigurationModifier and TypeMethodDescriptionorg.apache.hadoop.security.KerberosInfoContainerManagerSecurityInfo.getKerberosInfo(Class<?> protocol, Configuration conf) org.apache.hadoop.security.KerberosInfoSchedulerSecurityInfo.getKerberosInfo(Class<?> protocol, Configuration conf) ContainerManagerSecurityInfo.getTokenInfo(Class<?> protocol, Configuration conf) SchedulerSecurityInfo.getTokenInfo(Class<?> protocol, Configuration conf) -
Uses of Configuration in org.apache.hadoop.yarn.security.admin
Methods in org.apache.hadoop.yarn.security.admin with parameters of type ConfigurationModifier and TypeMethodDescriptionorg.apache.hadoop.security.KerberosInfoAdminSecurityInfo.getKerberosInfo(Class<?> protocol, Configuration conf) AdminSecurityInfo.getTokenInfo(Class<?> protocol, Configuration conf) -
Uses of Configuration in org.apache.hadoop.yarn.security.client
Methods in org.apache.hadoop.yarn.security.client with parameters of type ConfigurationModifier and TypeMethodDescriptionorg.apache.hadoop.security.KerberosInfoClientRMSecurityInfo.getKerberosInfo(Class<?> protocol, Configuration conf) org.apache.hadoop.security.KerberosInfoClientTimelineSecurityInfo.getKerberosInfo(Class<?> protocol, Configuration conf) ClientRMSecurityInfo.getTokenInfo(Class<?> protocol, Configuration conf) ClientTimelineSecurityInfo.getTokenInfo(Class<?> protocol, Configuration conf) -
Uses of Configuration in org.apache.hadoop.yarn.service.client
Methods in org.apache.hadoop.yarn.service.client with parameters of type ConfigurationModifier and TypeMethodDescriptionprotected voidServiceClient.serviceInit(Configuration configuration) -
Uses of Configuration in org.apache.hadoop.yarn.util
Methods in org.apache.hadoop.yarn.util with parameters of type ConfigurationModifier and TypeMethodDescriptionResourceCalculatorProcessTree.getResourceCalculatorProcessTree(String pid, Class<? extends ResourceCalculatorProcessTree> clazz, Configuration conf) Create the ResourceCalculatorProcessTree rooted to specified process from the class name and configure it. -
Uses of Configuration in org.apache.hadoop.yarn.util.timeline
Methods in org.apache.hadoop.yarn.util.timeline with parameters of type ConfigurationModifier and TypeMethodDescriptionstatic TextTimelineUtils.buildTimelineTokenService(Configuration conf) static floatTimelineUtils.getTimelineServiceVersion(Configuration conf) Returns the timeline service version.static InetSocketAddressTimelineUtils.getTimelineTokenServiceAddress(Configuration conf) static StringTimelineUtils.shortenFlowName(String flowName, Configuration conf) Shortens the flow name for the configured size by removing UUID if present.static booleanTimelineUtils.timelineServiceEnabled(Configuration conf) Returns whether the timeline service is enabled via configuration.static booleanTimelineUtils.timelineServiceV1_5Enabled(Configuration conf) Returns whether the timeline service v.1.5 is enabled by default via configuration.