You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@beam.apache.org by "Kenneth Knowles (JIRA)" <ji...@apache.org> on 2017/05/02 20:24:04 UTC

[jira] [Commented] (BEAM-818) Remove Pipeline.getPipelineOptions

    [ https://issues.apache.org/jira/browse/BEAM-818?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15993661#comment-15993661 ] 

Kenneth Knowles commented on BEAM-818:
--------------------------------------

Upon exploring this, I think we need to do this another way:

BigQueryIO needs a ValueProvider - runtime only is fine - to have a temp location for its files. This is a reasonable sort of thing for any IO to need, and similar.

So, we don't want it to read the string or validate against it, but we do want a way to get the ValueProvider in there without forcing users to always specify it (that is why it is a global option).

So I propose making runtime-only options that are unavailable even if a value happens to be specified.

> Remove Pipeline.getPipelineOptions
> ----------------------------------
>
>                 Key: BEAM-818
>                 URL: https://issues.apache.org/jira/browse/BEAM-818
>             Project: Beam
>          Issue Type: Improvement
>          Components: sdk-java-core
>            Reporter: Thomas Groh
>            Assignee: Kenneth Knowles
>              Labels: backward-incompatible
>             Fix For: First stable release
>
>
> This stops transforms from changing their operation based on construction-time options, and instead requires that configuration to be explicit, or to obtain the configuration at runtime.
> https://docs.google.com/document/d/1Wr05cYdqnCfrLLqSk--XmGMGgDwwNwWZaFbxLKvPqEQ/edit#



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)