Programming with Apache Twill*, Part II

Jan 21 2014, 10:41 am

Terence Yim is a Software Engineer at Continuuity, responsible for designing and building realtime processing systems on Hadoop/HBase. Prior to Continuuity, Terence spent over a year at LinkedIn Inc. and seven years at Yahoo!, building high performance large scale distributed systems.

In the Programming with Weave (now Apache Twill), Part I blog post, we introduced the basics of writing a distributed application on Hadoop YARN using Twill. In this post, we are going to highlight some of the important features in Twill.

Read More

0 notes

Comments

Twill, formerly Weave, accepted into the Apache Incubator

Nov 14 2013, 10:51 pm

For the past few years, applications have been generating hundreds of petabytes of data. Analyzing this data can create real business value, but until recently businesses had discarded the data because it was either too hard to analyze or too expensive to store using traditional relational databases.

The answer to this problem is a free, open-source technology running on commodity hardware: Apache Hadoop. Hadoop makes it cheap to store Big Data and easy to extract valuable insights using a batch-driven analysis method called MapReduce. It turns every web app into a data-driven app.

Read More

0 notes

Comments

Programming with Weave, Part I

Nov 11 2013, 10:36 am

Read first blog post of the Weave series

In this second blog post of the Weave series, we would like to show you how writing a distributed application can be as simple as writing a standalone Java application using Weave.

Writing applications to run on YARN

Before we dive into the details about Weave, let’s talk briefly about what a developer has to do in order to write a YARN application, other than standard MapReduce. A YARN application always consists of three parts:

Read More

0 notes

Comments

Simplifying YARN - Introducing Weave to the Apache Hadoop Community

Jun 11 2013, 6:21 am

This post is the first in series that introduces Weave, Continuuity’s recent contribution to the Apache Hadoop community.  Through this blog series, we will share our experiences with YARN, the motivation for building Weave, and provide an overview of the Weave architecture along with use cases that show the problems Weave can help you solve. 

Read More

0 notes

Comments
blog comments powered by Disqus