You are viewing a plain text version of this content. The canonical link for it is here.

Posted to commits@streams.apache.org by "Steve Blackmon (JIRA)" <ji...@apache.org> on 2017/02/13 23:46:41 UTC

[jira] [Updated] (STREAMS-365) Basic spark runtime

     [ https://issues.apache.org/jira/browse/STREAMS-365?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Steve Blackmon updated STREAMS-365:
-----------------------------------
    Component/s: Runtimes

> Basic spark runtime
> -------------------
>
>                 Key: STREAMS-365
>                 URL: https://issues.apache.org/jira/browse/STREAMS-365
>             Project: Streams
>          Issue Type: Improvement
>          Components: Runtimes
>            Reporter: Steve Blackmon
>            Assignee: Steve Blackmon
>
> Implement a basic spark runtime that supports integration on streams components and libraries into spark jobs by 
> a) reading and writing files from hdfs with support from LineUtils
> b) executing object conversions from streams-converters on instances of RDD[Object]
> c) executing StreamsProcessor.process in parallel on instances of RDD[StreamsDatum]



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)