Yarn Service framework provides first class support and APIs to host long running services natively in YARN. In a nutshell, it serves as a container orchestration platform for managing containerized services on YARN. It supports both docker container and traditional process based containers in YARN.
The responsibility of this framework includes performing configuration resolutions and mounts, lifecycle management such as stop/start/delete the service, flexing service components up/down, rolling upgrades services on YARN, monitoring services’ healthiness and readiness and more.
The yarn-service framework primarily includes below components:
YARN Service framework makes it easy to bring existing services onto YARN. It hides all the complex low-level details of application management and relieves users from forced into writing new code. Developers of new services do not have to worry about YARN internals and only need to focus on containerization of their service(s).
Further, another huge win of this feature is that now you can enable both traditional batch processing jobs and long running services in a single platform! The benefits of combining these workloads are two-fold:
This feature is in alpha state and so APIs, command lines are subject to change. We will continue to update the documents over time.
QuickStart shows a quick tutorial that walks you through simple steps to deploy a service on YARN.