You are viewing a plain text version of this content. The canonical link for it is here.

Posted to commits@oodt.apache.org by "Michael Starch (JIRA)" <ji...@apache.org> on 2014/05/28 23:35:02 UTC

[jira] [Commented] (OODT-698) Adapt OODT Process Streaming Data

    [ https://issues.apache.org/jira/browse/OODT-698?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14011631#comment-14011631 ] 

Michael Starch commented on OODT-698:
-------------------------------------

Slides will be attached as soon as I clear with our internal release system for documents.

> Adapt OODT Process Streaming Data
> ---------------------------------
>
>                 Key: OODT-698
>                 URL: https://issues.apache.org/jira/browse/OODT-698
>             Project: OODT
>          Issue Type: Umbrella
>          Components: file manager, resource manager, workflow manager
>            Reporter: Michael Starch
>              Labels: streaming
>
> Currently OODT excels at managing data, however; it is not as capable of processing really large data sets.  The major drawbacks of OODT are: file-based data storage, and filesystem based io.  Both of these drawbacks can be addressed by combining OODT with new stream-processing and cluster management technologies.
> This effort is currently focused on combining OODT with the Berkley Data Analysis Stack to achieve these exact results.
> Initial designs are captured in the attached slides.  Focus on "Track 2" as this was decided to be the best approach. 



--
This message was sent by Atlassian JIRA
(v6.2#6252)