Hadoop Auth, Java HTTP SPNEGO - Server Side Configuration

Server Side Configuration Setup

The AuthenticationFilter filter is Hadoop Auth’s server side component.

This filter must be configured in front of all the web application resources that required authenticated requests. For example:

The Hadoop Auth and dependent JAR files must be in the web application classpath (commonly the WEB-INF/lib directory).

Hadoop Auth uses SLF4J-API for logging. Auth Maven POM dependencies define the SLF4J API dependency but it does not define the dependency on a concrete logging implementation, this must be addded explicitly to the web application. For example, if the web applicationan uses Log4j, the SLF4J-LOG4J12 and LOG4J jar files must be part part of the web application classpath as well as the Log4j configuration file.

Common Configuration parameters

  • config.prefix: If specified, all other configuration parameter names must start with the prefix. The default value is no prefix.

  • [PREFIX.]type: the authentication type keyword (simple or \ kerberos) or a Authentication handler implementation.

  • [PREFIX.]signature.secret: When signer.secret.provider is set to string or not specified, this is the value for the secret used to sign the HTTP cookie.

  • [PREFIX.]token.validity: The validity -in seconds- of the generated authentication token. The default value is 3600 seconds. This is also used for the rollover interval when signer.secret.provider is set to random or zookeeper.

  • [PREFIX.]cookie.domain: domain to use for the HTTP cookie that stores the authentication token.

  • [PREFIX.]cookie.path: path to use for the HTTP cookie that stores the authentication token.

  • signer.secret.provider: indicates the name of the SignerSecretProvider class to use. Possible values are: string, random, zookeeper, or a classname. If not specified, the string implementation will be used; and failing that, the random implementation will be used.

Kerberos Configuration

IMPORTANT: A KDC must be configured and running.

To use Kerberos SPNEGO as the authentication mechanism, the authentication filter must be configured with the following init parameters:

  • [PREFIX.]type: the keyword kerberos.

  • [PREFIX.]kerberos.principal: The web-application Kerberos principal name. The Kerberos principal name must start with HTTP/.... For example: HTTP/localhost@LOCALHOST. There is no default value.

  • [PREFIX.]kerberos.keytab: The path to the keytab file containing the credentials for the kerberos principal. For example: /Users/tucu/tucu.keytab. There is no default value.

Example:

<web-app version="2.5" xmlns="http://java.sun.com/xml/ns/javaee">
    ...

    <filter>
        <filter-name>kerberosFilter</filter-name>
        <filter-class>org.apache.hadoop.security.auth.server.AuthenticationFilter</filter-class>
        <init-param>
            <param-name>type</param-name>
            <param-value>kerberos</param-value>
        </init-param>
        <init-param>
            <param-name>token.validity</param-name>
            <param-value>30</param-value>
        </init-param>
        <init-param>
            <param-name>cookie.domain</param-name>
            <param-value>.foo.com</param-value>
        </init-param>
        <init-param>
            <param-name>cookie.path</param-name>
            <param-value>/</param-value>
        </init-param>
        <init-param>
            <param-name>kerberos.principal</param-name>
            <param-value>HTTP/localhost@LOCALHOST</param-value>
        </init-param>
        <init-param>
            <param-name>kerberos.keytab</param-name>
            <param-value>/tmp/auth.keytab</param-value>
        </init-param>
    </filter>

    <filter-mapping>
        <filter-name>kerberosFilter</filter-name>
        <url-pattern>/kerberos/*</url-pattern>
    </filter-mapping>

    ...
</web-app>

Pseudo/Simple Configuration

To use Pseudo/Simple as the authentication mechanism (trusting the value of the query string parameter ‘user.name’), the authentication filter must be configured with the following init parameters:

  • [PREFIX.]type: the keyword simple.

  • [PREFIX.]simple.anonymous.allowed: is a boolean parameter that indicates if anonymous requests are allowed or not. The default value is false.

Example:

<web-app version="2.5" xmlns="http://java.sun.com/xml/ns/javaee">
    ...

    <filter>
        <filter-name>simpleFilter</filter-name>
        <filter-class>org.apache.hadoop.security.auth.server.AuthenticationFilter</filter-class>
        <init-param>
            <param-name>type</param-name>
            <param-value>simple</param-value>
        </init-param>
        <init-param>
            <param-name>token.validity</param-name>
            <param-value>30</param-value>
        </init-param>
        <init-param>
            <param-name>cookie.domain</param-name>
            <param-value>.foo.com</param-value>
        </init-param>
        <init-param>
            <param-name>cookie.path</param-name>
            <param-value>/</param-value>
        </init-param>
        <init-param>
            <param-name>simple.anonymous.allowed</param-name>
            <param-value>false</param-value>
        </init-param>
    </filter>

    <filter-mapping>
        <filter-name>simpleFilter</filter-name>
        <url-pattern>/simple/*</url-pattern>
    </filter-mapping>

    ...
</web-app>

AltKerberos Configuration

IMPORTANT: A KDC must be configured and running.

The AltKerberos authentication mechanism is a partially implemented derivative of the Kerberos SPNEGO authentication mechanism which allows a “mixed” form of authentication where Kerberos SPNEGO is used by non-browsers while an alternate form of authentication (to be implemented by the user) is used for browsers. To use AltKerberos as the authentication mechanism (besides providing an implementation), the authentication filter must be configured with the following init parameters, in addition to the previously mentioned Kerberos SPNEGO ones:

  • [PREFIX.]type: the full class name of the implementation of AltKerberosAuthenticationHandler to use.

  • [PREFIX.]alt-kerberos.non-browser.user-agents: a comma-separated list of which user-agents should be considered non-browsers.

Example:

<web-app version="2.5" xmlns="http://java.sun.com/xml/ns/javaee">
    ...

    <filter>
        <filter-name>kerberosFilter</filter-name>
        <filter-class>org.apache.hadoop.security.auth.server.AuthenticationFilter</filter-class>
        <init-param>
            <param-name>type</param-name>
            <param-value>org.my.subclass.of.AltKerberosAuthenticationHandler</param-value>
        </init-param>
        <init-param>
            <param-name>alt-kerberos.non-browser.user-agents</param-name>
            <param-value>java,curl,wget,perl</param-value>
        </init-param>
        <init-param>
            <param-name>token.validity</param-name>
            <param-value>30</param-value>
        </init-param>
        <init-param>
            <param-name>cookie.domain</param-name>
            <param-value>.foo.com</param-value>
        </init-param>
        <init-param>
            <param-name>cookie.path</param-name>
            <param-value>/</param-value>
        </init-param>
        <init-param>
            <param-name>kerberos.principal</param-name>
            <param-value>HTTP/localhost@LOCALHOST</param-value>
        </init-param>
        <init-param>
            <param-name>kerberos.keytab</param-name>
            <param-value>/tmp/auth.keytab</param-value>
        </init-param>
    </filter>

    <filter-mapping>
        <filter-name>kerberosFilter</filter-name>
        <url-pattern>/kerberos/*</url-pattern>
    </filter-mapping>

    ...
</web-app>

SignerSecretProvider Configuration

The SignerSecretProvider is used to provide more advanced behaviors for the secret used for signing the HTTP Cookies.

These are the relevant configuration properties:

  • signer.secret.provider: indicates the name of the SignerSecretProvider class to use. Possible values are: “string”, “random”, “zookeeper”, or a classname. If not specified, the “string” implementation will be used; and failing that, the “random” implementation will be used.

  • [PREFIX.]signature.secret: When signer.secret.provider is set to string or not specified, this is the value for the secret used to sign the HTTP cookie.

  • [PREFIX.]token.validity: The validity -in seconds- of the generated authentication token. The default value is 3600 seconds. This is also used for the rollover interval when signer.secret.provider is set to random or zookeeper.

The following configuration properties are specific to the zookeeper implementation:

  • signer.secret.provider.zookeeper.connection.string: Indicates the ZooKeeper connection string to connect with.

  • signer.secret.provider.zookeeper.path: Indicates the ZooKeeper path to use for storing and retrieving the secrets. All servers that need to coordinate their secret should point to the same path

  • signer.secret.provider.zookeeper.auth.type: Indicates the auth type to use. Supported values are none and sasl. The default value is none.

  • signer.secret.provider.zookeeper.kerberos.keytab: Set this to the path with the Kerberos keytab file. This is only required if using Kerberos.

  • signer.secret.provider.zookeeper.kerberos.principal: Set this to the Kerberos principal to use. This only required if using Kerberos.

Example:

<web-app version="2.5" xmlns="http://java.sun.com/xml/ns/javaee">
    ...

    <filter>
        <!-- AuthenticationHandler configs not shown -->
        <init-param>
            <param-name>signer.secret.provider</param-name>
            <param-value>string</param-value>
        </init-param>
        <init-param>
            <param-name>signature.secret</param-name>
            <param-value>my_secret</param-value>
        </init-param>
    </filter>

    ...
</web-app>

Example:

<web-app version="2.5" xmlns="http://java.sun.com/xml/ns/javaee">
    ...

    <filter>
        <!-- AuthenticationHandler configs not shown -->
        <init-param>
            <param-name>signer.secret.provider</param-name>
            <param-value>random</param-value>
        </init-param>
        <init-param>
            <param-name>token.validity</param-name>
            <param-value>30</param-value>
        </init-param>
    </filter>

    ...
</web-app>

Example:

<web-app version="2.5" xmlns="http://java.sun.com/xml/ns/javaee">
    ...

    <filter>
        <!-- AuthenticationHandler configs not shown -->
        <init-param>
            <param-name>signer.secret.provider</param-name>
            <param-value>zookeeper</param-value>
        </init-param>
        <init-param>
            <param-name>token.validity</param-name>
            <param-value>30</param-value>
        </init-param>
        <init-param>
            <param-name>signer.secret.provider.zookeeper.connection.string</param-name>
            <param-value>zoo1:2181,zoo2:2181,zoo3:2181</param-value>
        </init-param>
        <init-param>
            <param-name>signer.secret.provider.zookeeper.path</param-name>
            <param-value>/myapp/secrets</param-value>
        </init-param>
        <init-param>
            <param-name>signer.secret.provider.zookeeper.use.kerberos.acls</param-name>
            <param-value>true</param-value>
        </init-param>
        <init-param>
            <param-name>signer.secret.provider.zookeeper.kerberos.keytab</param-name>
            <param-value>/tmp/auth.keytab</param-value>
        </init-param>
        <init-param>
            <param-name>signer.secret.provider.zookeeper.kerberos.principal</param-name>
            <param-value>HTTP/localhost@LOCALHOST</param-value>
        </init-param>
    </filter>

    ...
</web-app>