[ Go Back ]
This page explains how to quickly setup HttpFS with Pseudo authentication against a Hadoop cluster with Pseudo authentication.
Edit the httpfs-0.23.11/conf/httpfs-site.xml file and set the httpfs.fsAccess.conf:fs.default.name property to the HDFS Namenode URI. For example:
httpfs.fsAccess.conf:fs.default.name=hdfs://localhost:8021
Edit Hadoop core-site.xml and defined the Unix user that will run the HttpFS server as a proxyuser. For example:
...
<property>
<name>fsAccess.proxyuser.#HTTPFSUSER#.hosts</name>
<value>httpfs-host.foo.com</value>
</property>
<property>
<name>fsAccess.proxyuser.#HTTPFSUSER#.groups</name>
<value>*</value>
</property>
...IMPORTANT: Replace #HTTPFSUSER# with the Unix user that will start the HttpFS server.
To start/stop HttpFS use HttpFS's bin/httpfs.sh script. For example:
httpfs-0.23.11 $ bin/httpfs.sh start
NOTE: Invoking the script without any parameters list all possible parameters (start, stop, run, etc.). The httpfs.sh script is a wrapper for Tomcat's catalina.sh script that sets the environment variables and Java System properties required to run HttpFS server.
~ $ curl -i "http://<HTTPFSHOSTNAME>:14000?user.name=babu&op=homedir"
HTTP/1.1 200 OK
Content-Type: application/json
Transfer-Encoding: chunked
{"homeDir":"http:\/\/<HTTPFS_HOST>:14000\/user\/babu"}To configure the embedded Tomcat go to the tomcat/conf.
HttpFS preconfigures the HTTP and Admin ports in Tomcat's server.xml to 14000 and 14001.
Tomcat logs are also preconfigured to go to HttpFS's logs/ directory.
The following environment variables (which can be set in HttpFS's conf/httpfs-env.sh script) can be used to alter those values:
HttpFS supports the following configuration properties in the HttpFS's conf/httpfs-site.xml configuration file.
[ Go Back ]