You are viewing a plain text version of this content. The canonical link for it is here.

Posted to commits@oodt.apache.org by "Michael Starch (JIRA)" <ji...@apache.org> on 2014/05/29 17:13:03 UTC

[jira] [Created] (OODT-700) Create a Spark Runner for the Wengine

Michael Starch created OODT-700:
-----------------------------------

             Summary: Create a Spark Runner for the Wengine
                 Key: OODT-700
                 URL: https://issues.apache.org/jira/browse/OODT-700
             Project: OODT
          Issue Type: Sub-task
            Reporter: Michael Starch


Spark is a useful technology for processing of streams and running map-reduce within the memory of a cluster.  Thus it is important to fold it into the streaming augmentation of OODT.

Currently, the wengine runner extension point seems to be the best place to put this.  In order for the project to be fully backwards compatible, some processing point in OODT must allow multiplexing of jobs (some are run on mesos via resource manager, some are run in Spark, etc.).





--
This message was sent by Atlassian JIRA
(v6.2#6252)