You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@beam.apache.org by "Reza ardeshir rokni (Jira)" <ji...@apache.org> on 2020/01/29 07:28:00 UTC
[jira] [Updated] (BEAM-6261) Dataflow runner does not refresh
updated side inputs
[ https://issues.apache.org/jira/browse/BEAM-6261?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Reza ardeshir rokni updated BEAM-6261:
--------------------------------------
Fix Version/s: (was: 2.15.0)
> Dataflow runner does not refresh updated side inputs
> ----------------------------------------------------
>
> Key: BEAM-6261
> URL: https://issues.apache.org/jira/browse/BEAM-6261
> Project: Beam
> Issue Type: New Feature
> Components: runner-dataflow
> Reporter: Scott Wegner
> Assignee: Daniel Mills
> Priority: Major
> Fix For: 2.9.0
>
>
> See [this user@ thread|https://lists.apache.org/thread.html/5eed0fc3beeb9f1c1fe4a623cbcad41cb15d0d80490cafb1f27e4577@%3Cuser.beam.apache.org%3E].
> The [Slowly-changing lookup cache|https://cloud.google.com/blog/products/gcp/guide-to-common-cloud-dataflow-use-case-patterns-part-1] pattern described on the GCP blog uses a side input to feed lookup data to join with the main data input. However, the Dataflow runner doesn't update side inputs.
> Example pipeline here: https://github.com/lbordwell/sideinput
--
This message was sent by Atlassian Jira
(v8.3.4#803005)