name | value | description |
httpfs.http.port | 14000 |
The HTTP port for HttpFS REST API.
|
httpfs.http.hostname | 0.0.0.0 |
The bind host for HttpFS REST API.
|
httpfs.http.administrators | | ACL for the admins, this configuration is used to control
who can access the default servlets for HttpFS server. The value
should be a comma separated list of users and groups. The user list
comes first and is separated by a space followed by the group list,
e.g. "user1,user2 group1,group2". Both users and groups are optional,
so "user1", " group1", "", "user1 group1", "user1,user2 group1,group2"
are all valid (note the leading space in " group1"). '*' grants access
to all users and groups, e.g. '*', '* ' and ' *' are all valid.
|
httpfs.ssl.enabled | false |
Whether SSL is enabled. Default is false, i.e. disabled.
|
hadoop.http.idle_timeout.ms | 60000 |
Httpfs Server connection timeout in milliseconds.
|
hadoop.http.max.threads | 1000 |
The maxmimum number of threads.
|
hadoop.http.max.request.header.size | 65536 |
The maxmimum HTTP request header size.
|
hadoop.http.max.response.header.size | 65536 |
The maxmimum HTTP response header size.
|
hadoop.http.temp.dir | ${hadoop.tmp.dir}/httpfs |
HttpFS temp directory.
|
httpfs.buffer.size | 4096 |
The buffer size used by a read/write request when streaming data from/to
HDFS.
|
httpfs.services |
org.apache.hadoop.lib.service.instrumentation.InstrumentationService,
org.apache.hadoop.lib.service.scheduler.SchedulerService,
org.apache.hadoop.lib.service.security.GroupsService,
org.apache.hadoop.lib.service.hadoop.FileSystemAccessService
|
Services used by the httpfs server.
|
kerberos.realm | LOCALHOST |
Kerberos realm, used only if Kerberos authentication is used between
the clients and httpfs or between HttpFS and HDFS.
This property is only used to resolve other properties within this
configuration file.
|
httpfs.hostname | ${httpfs.http.hostname} |
Property used to synthetize the HTTP Kerberos principal used by httpfs.
This property is only used to resolve other properties within this
configuration file.
|
hadoop.http.authentication.signature.secret.file | ${httpfs.config.dir}/httpfs-signature.secret |
File containing the secret to sign HttpFS hadoop-auth cookies.
This file should be readable only by the system user running HttpFS service.
If multiple HttpFS servers are used in a load-balancer/round-robin fashion,
they should share the secret file.
If the secret file specified here does not exist or it is empty, a random
secret is generated at startup time.
httpfs.authentication.signature.secret.file is deprecated. Instead use
hadoop.http.authentication.signature.secret.file.
|
hadoop.http.authentication.type | simple |
Defines the authentication mechanism used by httpfs for its HTTP clients.
Valid values are 'simple' or 'kerberos'.
If using 'simple' HTTP clients must specify the username with the
'user.name' query string parameter.
If using 'kerberos' HTTP clients must use HTTP SPNEGO or delegation tokens.
httpfs.authentication.type is deprecated. Instead use
hadoop.http.authentication.type.
|
hadoop.http.authentication.kerberos.principal | HTTP/${httpfs.hostname}@${kerberos.realm} |
The HTTP Kerberos principal used by HttpFS in the HTTP endpoint.
The HTTP Kerberos principal MUST start with 'HTTP/' per Kerberos
HTTP SPNEGO specification.
httpfs.authentication.kerberos.principal is deprecated. Instead use
hadoop.http.authentication.kerberos.principal.
|
hadoop.http.authentication.kerberos.keytab | ${user.home}/httpfs.keytab |
The Kerberos keytab file with the credentials for the
HTTP Kerberos principal used by httpfs in the HTTP endpoint.
httpfs.authentication.kerberos.keytab is deprecated. Instead use
hadoop.http.authentication.kerberos.keytab.
|
httpfs.delegation.token.manager.update.interval | 86400 |
HttpFS delegation token update interval, default 1 day, in seconds.
|
httpfs.delegation.token.manager.max.lifetime | 604800 |
HttpFS delegation token maximum lifetime, default 7 days, in seconds
|
httpfs.delegation.token.manager.renewal.interval | 86400 |
HttpFS delegation token update interval, default 1 day, in seconds.
|
httpfs.hadoop.authentication.type | simple |
Defines the authentication mechanism used by httpfs to connect to
the HDFS Namenode.
Valid values are 'simple' and 'kerberos'.
|
httpfs.hadoop.authentication.kerberos.keytab | ${user.home}/httpfs.keytab |
The Kerberos keytab file with the credentials for the
Kerberos principal used by httpfs to connect to the HDFS Namenode.
|
httpfs.hadoop.authentication.kerberos.principal | ${user.name}/${httpfs.hostname}@${kerberos.realm} |
The Kerberos principal used by httpfs to connect to the HDFS Namenode.
|
httpfs.hadoop.filesystem.cache.purge.frequency | 60 |
Frequency, in seconds, for the idle filesystem purging daemon runs.
|
httpfs.hadoop.filesystem.cache.purge.timeout | 60 |
Timeout, in seconds, for an idle filesystem to be purged.
|
httpfs.access.mode | read-write |
Sets the access mode for HTTPFS. If access is not allowed the FORBIDDED (403) is returned.
Valid access modes are:
read-write Full Access allowed
write-only PUT POST and DELETE full Access. GET only allows GETFILESTATUS and LISTSTATUS
read-only GET Full Access PUT POST and DELETE are FORBIDDEN
|