[I] Python SDK 2.75 Flex Template: RuntimeValueProvider is being stringified and runtime parameters are treated as unparsed arguments [beam]

["rathin-reddy (via GitHub)" <gi...@apache.org>]

rathin-reddy opened a new issue, #39499:
URL: https://github.com/apache/beam/issues/39499

   After upgrading Apache Beam Python SDK to 2.75.0, runtime parameters passed to a Dataflow Flex Template are not being resolved correctly.
   
   A parameter defined using add_value_provider_argument() is being interpreted as a **string representation of RuntimeValueProvider** instead of the actual runtime value. There are few args passed which seems to have no issues, only difference is that there is no default value set in all the args but a value is passed expect for the one which has the issue not sure if this is the issue. 
   
   Expected behaviour
   
   When a runtime parameter is defined:
   
   `class MyOptions(PipelineOptions):
       @classmethod
       def _add_argparse_args(cls, parser):
           parser.add_value_provider_argument(
               "--vpt_vp_arg",
               dest="vpt_vp_arg"
               required=False,          
           )`
   and accessed inside a DoFn:
   
   `vpt_vp_arg = options.vpt_vp_arg.get()`
   
   I expect:
   None 
   or the configured runtime value.
   
   Actual behaviour
   
   get() returns:
   
   `RuntimeValueProvider(option_name=vpt_vp_arg, value_type=str, default_value=None)`
   
   
   Environment
   Apache Beam Python SDK: 2.75.0
   Runner: Google Cloud Dataflow
   Template type: Flex Template
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

Re: [I] Python SDK 2.75 Flex Template: RuntimeValueProvider is being stringified [beam]

["Abacn (via GitHub)" <gi...@apache.org>]

Abacn commented on issue #39499:
URL: https://github.com/apache/beam/issues/39499#issuecomment-5192704433

   Dataflow client migration happened in #37639, in Beam 2.75.0
   
   ValueProvider is mainly used for Dataflow classic templates. If you're building flex templates, value providers are actually not needed


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

Re: [I] Python SDK 2.75 Flex Template: RuntimeValueProvider is being stringified [beam]

["Abacn (via GitHub)" <gi...@apache.org>]

Abacn closed issue #39499: Python SDK 2.75 Flex Template: RuntimeValueProvider is being stringified
URL: https://github.com/apache/beam/issues/39499


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org