You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@beam.apache.org by "ASF GitHub Bot (JIRA)" <ji...@apache.org> on 2018/10/15 10:35:00 UTC
[jira] [Work logged] (BEAM-3727) Never shutdown sources in Flink
Streaming execution mode
[ https://issues.apache.org/jira/browse/BEAM-3727?focusedWorklogId=154246&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-154246 ]
ASF GitHub Bot logged work on BEAM-3727:
----------------------------------------
Author: ASF GitHub Bot
Created on: 15/Oct/18 10:34
Start Date: 15/Oct/18 10:34
Worklog Time Spent: 10m
Work Description: mxm opened a new pull request #6690: [BEAM-3727] Add tests for ImpulseSourceFunction
URL: https://github.com/apache/beam/pull/6690
Tests for ImpulseSourceFunction, already reviewed in #6654.
Post-Commit Tests Status (on master branch)
------------------------------------------------------------------------------------------------
Lang | SDK | Apex | Dataflow | Flink | Gearpump | Samza | Spark
--- | --- | --- | --- | --- | --- | --- | ---
Go | [](https://builds.apache.org/job/beam_PostCommit_Go_GradleBuild/lastCompletedBuild/) | --- | --- | --- | --- | --- | ---
Java | [](https://builds.apache.org/job/beam_PostCommit_Java_GradleBuild/lastCompletedBuild/) | [](https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Apex_Gradle/lastCompletedBuild/) | [](https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/lastCompletedBuild/) | [](https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Flink_Gradle/lastCompletedBuild/) | [](https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Gearpump_Gradle/lastCompletedBuild/) | [](https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Samza_Gradle/lastCompletedBuild/) | [](https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Spark_Gradle/lastCompletedBuild/)
Python | [](https://builds.apache.org/job/beam_PostCommit_Python_Verify/lastCompletedBuild/) | --- | [](https://builds.apache.org/job/beam_PostCommit_Py_VR_Dataflow/lastCompletedBuild/) </br> [](https://builds.apache.org/job/beam_PostCommit_Py_ValCont/lastCompletedBuild/) | [](https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/lastCompletedBuild/) | --- | --- | ---
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Issue Time Tracking
-------------------
Worklog Id: (was: 154246)
Time Spent: 10m
Remaining Estimate: 0h
> Never shutdown sources in Flink Streaming execution mode
> --------------------------------------------------------
>
> Key: BEAM-3727
> URL: https://issues.apache.org/jira/browse/BEAM-3727
> Project: Beam
> Issue Type: Bug
> Components: runner-flink
> Reporter: Aljoscha Krettek
> Assignee: Maximilian Michels
> Priority: Major
> Fix For: 2.8.0
>
> Time Spent: 10m
> Remaining Estimate: 0h
>
> Because of FLINK-2491 checkpointing will not work for a streaming pipeline as soon as at least one source has finished. With the move to SDF IOs and the impulse primitive this is very problematic because essentially all jobs running in Flink Streaming mode would run without checkpointing.
> We should, by default, never stop sources in streaming mode but add an option that allows doing so. Some people might want this and we also need it to make sure that the {{@ValidatesRunner}} tests for Flink in streaming mode finish.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)