What is Apache Twill?
Apache Twill is an abstraction over Apache Hadoop® YARN that reduces the complexity of developing distributed applications, allowing developers to focus more on their application logic. Apache Twill allows you to use YARN’s distributed capabilities with a programming model that is similar to running threads.
Why do I need Apache Twill?
Apache Twill dramatically simplifies and reduces development efforts, enabling you to quickly and easily develop and manage distributed applications through its simple abstraction layer on top of YARN. YARN, although originally designed for MapReduce v2, can be used as a generic cluster resource management framework that can run almost any type of applications on a Hadoop® cluster. With its powerful capabilities, YARN can introduce complexities for developers. In contrast, Twill’s abstraction model over YARN closely resembles the Java thread model, with which many developers are familiar. Moreover, Twill provides application lifecycle management, service discovery, distributed process coordination and resiliency to failure, which are required by many distributed applications.
Apache Twill allows you to develop, deploy and manage your distributed applications with a much simpler programming model, with rich build-in features for common distributed applications needs. Whether you are a developer or operating engineer will find Apache Twill helps you greatly reduces the effort in developing and operating your applications on a Hadoop® cluster.