You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@beam.apache.org by "ASF GitHub Bot (Jira)" <ji...@apache.org> on 2020/08/14 11:50:00 UTC

[jira] [Work logged] (BEAM-7587) Spark portable runner: Streaming mode

     [ https://issues.apache.org/jira/browse/BEAM-7587?focusedWorklogId=470665&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-470665 ]

ASF GitHub Bot logged work on BEAM-7587:
----------------------------------------

                Author: ASF GitHub Bot
            Created on: 14/Aug/20 11:49
            Start Date: 14/Aug/20 11:49
    Worklog Time Spent: 10m 
      Work Description: aromanenko-dev commented on pull request #12157:
URL: https://github.com/apache/beam/pull/12157#issuecomment-674036749


   @annaqin418 Is this PR WIP?


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Issue Time Tracking
-------------------

    Worklog Id:     (was: 470665)
    Time Spent: 1.5h  (was: 1h 20m)

> Spark portable runner: Streaming mode
> -------------------------------------
>
>                 Key: BEAM-7587
>                 URL: https://issues.apache.org/jira/browse/BEAM-7587
>             Project: Beam
>          Issue Type: Wish
>          Components: runner-spark
>            Reporter: Kyle Weaver
>            Assignee: Anna Qin
>            Priority: P2
>              Labels: portability-spark
>          Time Spent: 1.5h
>  Remaining Estimate: 0h
>
> So far all work on the Spark portable runner has been in batch mode. This is intended as an uber-issue for tracking progress on adding support for streaming.
> -It might be advantageous to wait for the structured streaming (non-portable) runner to be completed (to some reasonable extent) before undertaking this, rather than using the DStream API.- Since work on the structured streaming runner is blocked by SPARK-26655, we should implement this using DStreams instead.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)