You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@beam.apache.org by "Kenneth Knowles (JIRA)" <ji...@apache.org> on 2017/05/02 20:24:04 UTC
[jira] [Commented] (BEAM-818) Remove Pipeline.getPipelineOptions
[ https://issues.apache.org/jira/browse/BEAM-818?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15993661#comment-15993661 ]
Kenneth Knowles commented on BEAM-818:
--------------------------------------
Upon exploring this, I think we need to do this another way:
BigQueryIO needs a ValueProvider - runtime only is fine - to have a temp location for its files. This is a reasonable sort of thing for any IO to need, and similar.
So, we don't want it to read the string or validate against it, but we do want a way to get the ValueProvider in there without forcing users to always specify it (that is why it is a global option).
So I propose making runtime-only options that are unavailable even if a value happens to be specified.
> Remove Pipeline.getPipelineOptions
> ----------------------------------
>
> Key: BEAM-818
> URL: https://issues.apache.org/jira/browse/BEAM-818
> Project: Beam
> Issue Type: Improvement
> Components: sdk-java-core
> Reporter: Thomas Groh
> Assignee: Kenneth Knowles
> Labels: backward-incompatible
> Fix For: First stable release
>
>
> This stops transforms from changing their operation based on construction-time options, and instead requires that configuration to be explicit, or to obtain the configuration at runtime.
> https://docs.google.com/document/d/1Wr05cYdqnCfrLLqSk--XmGMGgDwwNwWZaFbxLKvPqEQ/edit#
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)