[jira] [Commented] (DRILL-142) Implement YARN application master

["Peter Grman (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/DRILL-142?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14027725#comment-14027725 ] 

Peter Grman commented on DRILL-142:
-----------------------------------

I've managed to create a version of Apache Drill which can run in YARN - I've used Apache Twill (the new project from weave) and you can see the fork here: https://github.com/pgrm/incubator-drill/tree/YARN-support/yarn-integration

For now it's just a basic implementation for my thesis to see if it's possible, but the performance doesn't seem to be too good. Also I had to update the dependencies to Hadoop 2.3.0 since this is what is required by Apache Twill.

> Implement YARN application master
> ---------------------------------
>
>                 Key: DRILL-142
>                 URL: https://issues.apache.org/jira/browse/DRILL-142
>             Project: Apache Drill
>          Issue Type: Bug
>            Reporter: Jacques Nadeau
>             Fix For: Future
>
>
> As YARN adoption grows, Drill needs to support running within YARN.  This requires implementing a new Application Master.  One thing to consider is using Continunity's Weave project to help with this.  http://continuuity.github.io/weave/  As part of this task we need to figure out how resource allocation and reallocation would work. since YARN doesn't natively support expanding allocations.



--
This message was sent by Atlassian JIRA
(v6.2#6252)