You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@streams.apache.org by "Steve Blackmon (JIRA)" <ji...@apache.org> on 2015/09/08 23:31:46 UTC

[jira] [Created] (STREAMS-365) Basic spark runtime

Steve Blackmon created STREAMS-365:
--------------------------------------

             Summary: Basic spark runtime
                 Key: STREAMS-365
                 URL: https://issues.apache.org/jira/browse/STREAMS-365
             Project: Streams
          Issue Type: Improvement
            Reporter: Steve Blackmon
            Assignee: Steve Blackmon


Implement a basic spark runtime that supports integration on streams components and libraries into spark jobs by 
a) reading and writing files from hdfs with support from LineUtils
b) executing object conversions from streams-converters on instances of RDD[Object]
c) executing StreamsProcessor.process in parallel on instances of RDD[StreamsDatum]




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)