dfs.federation.router.default.nameserviceId
Nameservice identifier of the default subcluster to monitor.
dfs.federation.router.default.nameservice.enable
true
The default subcluster is enabled to read and write files.
dfs.federation.router.rpc.enable
true
If true, the RPC service to handle client requests in the router is
enabled.
dfs.federation.router.rpc-address
0.0.0.0:8888
RPC address that handles all clients requests.
The value of this property will take the form of router-host1:rpc-port.
dfs.federation.router.rpc-bind-host
The actual address the RPC server will bind to. If this optional address is
set, it overrides only the hostname portion of
dfs.federation.router.rpc-address. This is useful for making the name node
listen on all interfaces by setting it to 0.0.0.0.
dfs.federation.router.handler.count
10
The number of server threads for the router to handle RPC requests from
clients.
dfs.federation.router.handler.queue.size
100
The size of the queue for the number of handlers to handle RPC client requests.
dfs.federation.router.reader.count
1
The number of readers for the router to handle RPC client requests.
dfs.federation.router.reader.queue.size
100
The size of the queue for the number of readers for the router to handle RPC client requests.
dfs.federation.router.connection.creator.queue-size
100
Size of async connection creator queue.
dfs.federation.router.connection.pool-size
1
Size of the pool of connections from the router to namenodes.
dfs.federation.router.connection.clean.ms
10000
Time interval, in milliseconds, to check if the connection pool should
remove unused connections.
dfs.federation.router.connection.pool.clean.ms
60000
Time interval, in milliseconds, to check if the connection manager should
remove unused connection pools.
dfs.federation.router.metrics.enable
true
If the metrics in the router are enabled.
dfs.federation.router.metrics.class
org.apache.hadoop.hdfs.server.federation.metrics.FederationRPCPerformanceMonitor
Class to monitor the RPC system in the router. It must implement the
RouterRpcMonitor interface.
dfs.federation.router.admin.enable
true
If true, the RPC admin service to handle client requests in the router is
enabled.
dfs.federation.router.admin-address
0.0.0.0:8111
RPC address that handles the admin requests.
The value of this property will take the form of router-host1:rpc-port.
dfs.federation.router.admin-bind-host
The actual address the RPC admin server will bind to. If this optional
address is set, it overrides only the hostname portion of
dfs.federation.router.admin-address. This is useful for making the name
node listen on all interfaces by setting it to 0.0.0.0.
dfs.federation.router.admin.handler.count
1
The number of server threads for the router to handle RPC requests from
admin.
dfs.federation.router.http-address
0.0.0.0:50071
HTTP address that handles the web requests to the Router.
The value of this property will take the form of router-host1:http-port.
dfs.federation.router.http-bind-host
The actual address the HTTP server will bind to. If this optional
address is set, it overrides only the hostname portion of
dfs.federation.router.http-address. This is useful for making the name
node listen on all interfaces by setting it to 0.0.0.0.
dfs.federation.router.https-address
0.0.0.0:50072
HTTPS address that handles the web requests to the Router.
The value of this property will take the form of router-host1:https-port.
dfs.federation.router.https-bind-host
The actual address the HTTPS server will bind to. If this optional
address is set, it overrides only the hostname portion of
dfs.federation.router.https-address. This is useful for making the name
node listen on all interfaces by setting it to 0.0.0.0.
dfs.federation.router.http.enable
true
If the HTTP service to handle client requests in the router is enabled.
dfs.federation.router.file.resolver.client.class
org.apache.hadoop.hdfs.server.federation.resolver.MountTableResolver
Class to resolve files to subclusters.
dfs.federation.router.namenode.resolver.client.class
org.apache.hadoop.hdfs.server.federation.resolver.MembershipNamenodeResolver
Class to resolve the namenode for a subcluster.
dfs.federation.router.store.enable
true
If true, the Router connects to the State Store.
dfs.federation.router.store.serializer
org.apache.hadoop.hdfs.server.federation.store.driver.impl.StateStoreSerializerPBImpl
Class to serialize State Store records.
dfs.federation.router.store.driver.class
org.apache.hadoop.hdfs.server.federation.store.driver.impl.StateStoreZooKeeperImpl
Class to implement the State Store. There are three implementation classes currently
being supported:
org.apache.hadoop.hdfs.server.federation.store.driver.impl.StateStoreFileImpl,
org.apache.hadoop.hdfs.server.federation.store.driver.impl.StateStoreFileSystemImpl and
org.apache.hadoop.hdfs.server.federation.store.driver.impl.StateStoreZooKeeperImpl.
These implementation classes use the local file, filesystem and ZooKeeper as a backend respectively.
By default it uses the ZooKeeper as the default State Store.
dfs.federation.router.store.connection.test
60000
How often to check for the connection to the State Store in milliseconds.
dfs.federation.router.cache.ttl
1m
How often to refresh the State Store caches in milliseconds. This setting
supports multiple time unit suffixes as described in
dfs.heartbeat.interval. If no suffix is specified then milliseconds is
assumed.
dfs.federation.router.store.membership.expiration
300000
Expiration time in milliseconds for a membership record.
dfs.federation.router.heartbeat.enable
true
If true, the Router heartbeats into the State Store.
dfs.federation.router.heartbeat.interval
5000
How often the Router should heartbeat into the State Store in milliseconds.
dfs.federation.router.heartbeat-state.interval
5s
How often the Router should heartbeat its state into the State Store in
milliseconds. This setting supports multiple time unit suffixes as
described in dfs.federation.router.quota-cache.update.interval.
dfs.federation.router.store.router.expiration
5m
Expiration time in milliseconds for a router state record. This setting
supports multiple time unit suffixes as described in
dfs.federation.router.quota-cache.update.interval.
dfs.federation.router.safemode.enable
true
dfs.federation.router.safemode.extension
30s
Time after startup that the Router is in safe mode. This setting
supports multiple time unit suffixes as described in
dfs.heartbeat.interval. If no suffix is specified then milliseconds is
assumed.
dfs.federation.router.safemode.expiration
3m
Time without being able to reach the State Store to enter safe mode. This
setting supports multiple time unit suffixes as described in
dfs.heartbeat.interval. If no suffix is specified then milliseconds is
assumed.
dfs.federation.router.monitor.namenode
The identifier of the namenodes to monitor and heartbeat.
dfs.federation.router.monitor.localnamenode.enable
true
If true, the Router should monitor the namenode in the local machine.
dfs.federation.router.mount-table.max-cache-size
10000
Maximum number of mount table cache entries to have.
By default, remove cache entries if we have more than 10k.
dfs.federation.router.mount-table.cache.enable
true
Set to true to enable mount table cache (Path to Remote Location cache).
Disabling the cache is recommended when a large amount of unique paths are queried.
dfs.federation.router.quota.enable
false
Set to true to enable quota system in Router.
dfs.federation.router.quota-cache.update.interval
60s
Interval time for updating quota usage cache in Router.
This property is used only if the value of
dfs.federation.router.quota.enable is true.
This setting supports multiple time unit suffixes as described
in dfs.heartbeat.interval. If no suffix is specified then milliseconds
is assumed.
dfs.federation.router.client.thread-size
32
Max threads size for the RouterClient to execute concurrent
requests.
dfs.federation.router.client.retry.max.attempts
3
Max retry attempts for the RouterClient talking to the Router.
dfs.federation.router.client.reject.overload
false
Set to true to reject client requests when we run out of RPC client
threads.