You are viewing a plain text version of this content. The canonical link for it is here.

Posted to commits@oodt.apache.org by "Michael Starch (JIRA)" <ji...@apache.org> on 2014/05/28 23:31:03 UTC

[jira] [Created] (OODT-698) Adapt OODT Process Streaming Data

Michael Starch created OODT-698:
-----------------------------------

             Summary: Adapt OODT Process Streaming Data
                 Key: OODT-698
                 URL: https://issues.apache.org/jira/browse/OODT-698
             Project: OODT
          Issue Type: Umbrella
          Components: file manager, resource manager, workflow manager
            Reporter: Michael Starch


Currently OODT excels at managing data, however; it is not as capable of processing really large data sets.  The major drawbacks of OODT are: file-based data storage, and filesystem based io.  Both of these drawbacks can be addressed by combining OODT with new stream-processing and cluster management technologies.

This effort is currently focused on combining OODT with the Berkley Data Analysis Stack to achieve these exact results.

Initial designs are captured in the attached slides.  Focus on "Track 2" as this was decided to be the best approach. 



--
This message was sent by Atlassian JIRA
(v6.2#6252)