Configuration Properties

namevaluedescription
httpfs.http.port14000 The HTTP port for HttpFS REST API.
httpfs.http.hostname0.0.0.0 The bind host for HttpFS REST API.
httpfs.http.administratorsACL for the admins, this configuration is used to control who can access the default servlets for HttpFS server. The value should be a comma separated list of users and groups. The user list comes first and is separated by a space followed by the group list, e.g. "user1,user2 group1,group2". Both users and groups are optional, so "user1", " group1", "", "user1 group1", "user1,user2 group1,group2" are all valid (note the leading space in " group1"). '*' grants access to all users and groups, e.g. '*', '* ' and ' *' are all valid.
httpfs.ssl.enabledfalse Whether SSL is enabled. Default is false, i.e. disabled.
hadoop.http.idle_timeout.ms60000 Httpfs Server connection timeout in milliseconds.
hadoop.http.max.threads1000 The maxmimum number of threads.
hadoop.http.max.request.header.size65536 The maxmimum HTTP request header size.
hadoop.http.max.response.header.size65536 The maxmimum HTTP response header size.
hadoop.http.temp.dir${hadoop.tmp.dir}/httpfs HttpFS temp directory.
httpfs.buffer.size4096 The buffer size used by a read/write request when streaming data from/to HDFS.
httpfs.services org.apache.hadoop.lib.service.instrumentation.InstrumentationService, org.apache.hadoop.lib.service.scheduler.SchedulerService, org.apache.hadoop.lib.service.security.GroupsService, org.apache.hadoop.lib.service.hadoop.FileSystemAccessService Services used by the httpfs server.
kerberos.realmLOCALHOST Kerberos realm, used only if Kerberos authentication is used between the clients and httpfs or between HttpFS and HDFS. This property is only used to resolve other properties within this configuration file.
httpfs.hostname${httpfs.http.hostname} Property used to synthetize the HTTP Kerberos principal used by httpfs. This property is only used to resolve other properties within this configuration file.
hadoop.http.authentication.signature.secret.file${httpfs.config.dir}/httpfs-signature.secret File containing the secret to sign HttpFS hadoop-auth cookies. This file should be readable only by the system user running HttpFS service. If multiple HttpFS servers are used in a load-balancer/round-robin fashion, they should share the secret file. If the secret file specified here does not exist or it is empty, a random secret is generated at startup time. httpfs.authentication.signature.secret.file is deprecated. Instead use hadoop.http.authentication.signature.secret.file.
hadoop.http.authentication.typesimple Defines the authentication mechanism used by httpfs for its HTTP clients. Valid values are 'simple' or 'kerberos'. If using 'simple' HTTP clients must specify the username with the 'user.name' query string parameter. If using 'kerberos' HTTP clients must use HTTP SPNEGO or delegation tokens. httpfs.authentication.type is deprecated. Instead use hadoop.http.authentication.type.
hadoop.http.authentication.kerberos.principalHTTP/${httpfs.hostname}@${kerberos.realm} The HTTP Kerberos principal used by HttpFS in the HTTP endpoint. The HTTP Kerberos principal MUST start with 'HTTP/' per Kerberos HTTP SPNEGO specification. httpfs.authentication.kerberos.principal is deprecated. Instead use hadoop.http.authentication.kerberos.principal.
hadoop.http.authentication.kerberos.keytab${user.home}/httpfs.keytab The Kerberos keytab file with the credentials for the HTTP Kerberos principal used by httpfs in the HTTP endpoint. httpfs.authentication.kerberos.keytab is deprecated. Instead use hadoop.http.authentication.kerberos.keytab.
httpfs.delegation.token.manager.update.interval86400 HttpFS delegation token update interval, default 1 day, in seconds.
httpfs.delegation.token.manager.max.lifetime604800 HttpFS delegation token maximum lifetime, default 7 days, in seconds
httpfs.delegation.token.manager.renewal.interval86400 HttpFS delegation token update interval, default 1 day, in seconds.
httpfs.hadoop.authentication.typesimple Defines the authentication mechanism used by httpfs to connect to the HDFS Namenode. Valid values are 'simple' and 'kerberos'.
httpfs.hadoop.authentication.kerberos.keytab${user.home}/httpfs.keytab The Kerberos keytab file with the credentials for the Kerberos principal used by httpfs to connect to the HDFS Namenode.
httpfs.hadoop.authentication.kerberos.principal${user.name}/${httpfs.hostname}@${kerberos.realm} The Kerberos principal used by httpfs to connect to the HDFS Namenode.
httpfs.hadoop.filesystem.cache.purge.frequency60 Frequency, in seconds, for the idle filesystem purging daemon runs.
httpfs.hadoop.filesystem.cache.purge.timeout60 Timeout, in seconds, for an idle filesystem to be purged.
httpfs.access.moderead-write Sets the access mode for HTTPFS. If access is not allowed the FORBIDDED (403) is returned. Valid access modes are: read-write Full Access allowed write-only PUT POST and DELETE full Access. GET only allows GETFILESTATUS and LISTSTATUS read-only GET Full Access PUT POST and DELETE are FORBIDDEN