What is Apache Twill?

Apache Twill is an abstraction over Apache Hadoop® YARN that reduces the complexity of developing distributed applications, allowing developers to focus more on their application logic. Apache Twill allows you to use YARN’s distributed capabilities with a programming model that is similar to running threads.

Why do I need Apache Twill?

Apache Twill dramatically simplifies and reduces development efforts, enabling you to quickly and easily develop and manage distributed applications through its simple abstraction layer on top of YARN. YARN, although originally designed for MapReduce v2, can be used as a generic cluster resource management framework that can run almost any type of applications on a Hadoop® cluster. With its powerful capabilities, YARN can introduce complexities for developers. In contrast, Twill’s abstraction model over YARN closely resembles the Java thread model, with which many developers are familiar. Moreover, Twill provides application lifecycle management, service discovery, distributed process coordination and resiliency to failure, which are required by many distributed applications.

Apache Twill allows you to develop, deploy and manage your distributed applications with a much simpler programming model, with rich build-in features for common distributed applications needs. Whether you are a developer or operating engineer will find Apache Twill helps you greatly reduces the effort in developing and operating your applications on a Hadoop® cluster.

Latest Release

The latest release of Apache Twill is 0.8.0. Please go to the release page to find out more.

Is it Building?

Status of CI build at Travis CI: Build Status

Apache Twill Presentation in Apache: Big Data North America 2016

Apache Twill Presentation in ApacheCon 2014

Back to top

Reflow Maven skin by Andrius Velykis.

Apache Twill, Apache, the Apache feather logo, and the Apache Twill project logos are trademarks of The Apache Software Foundation. All other marks mentioned may be trademarks or registered trademarks of their respective owners.