You are viewing a plain text version of this content. The canonical link for it is here.
Posted to github@beam.apache.org by GitBox <gi...@apache.org> on 2022/06/05 01:21:37 UTC
[GitHub] [beam] damccorm opened a new issue, #21700: --dataflowServiceOptions=use_runner_v2 is broken
damccorm opened a new issue, #21700:
URL: https://github.com/apache/beam/issues/21700
Per [https://lists.apache.org/list.html?user@beam.apache.org](https://lists.apache.org/list.html?user@beam.apache.org) passing `–dataflowServiceOptions=use_runner_v2` alone triggers pipeline errors. This is surprising as it should be an alias for experiments, and furthermore no action should be required on the SDK side to produce a runner v2 compatible graph.
Imported from Jira [BEAM-14421](https://issues.apache.org/jira/browse/BEAM-14421). Original Jira may contain additional context.
Reported by: robertwb.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@beam.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [beam] kennknowles commented on issue #21700: --dataflowServiceOptions=use_runner_v2 is broken
Posted by GitBox <gi...@apache.org>.
kennknowles commented on issue #21700:
URL: https://github.com/apache/beam/issues/21700#issuecomment-1271933603
Yes, the expectation of `dataflowServiceOptions` is that the SDK will _never_ do anything based on them. This ensures that everything is handled in the service and can be updated for released SDKs.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@beam.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [beam] kennknowles commented on issue #21700: --dataflowServiceOptions=use_runner_v2 is broken
Posted by "kennknowles (via GitHub)" <gi...@apache.org>.
kennknowles commented on issue #21700:
URL: https://github.com/apache/beam/issues/21700#issuecomment-1428717828
Perhaps this should not be a longstanding P1 if it is not something we intend to change?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@beam.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [beam] TheNeuralBit commented on issue #21700: --dataflowServiceOptions=use_runner_v2 is broken
Posted by GitBox <gi...@apache.org>.
TheNeuralBit commented on issue #21700:
URL: https://github.com/apache/beam/issues/21700#issuecomment-1270475428
CC: @y1chi who posted some context in the jira
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@beam.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [beam] y1chi commented on issue #21700: --dataflowServiceOptions=use_runner_v2 is broken
Posted by GitBox <gi...@apache.org>.
y1chi commented on issue #21700:
URL: https://github.com/apache/beam/issues/21700#issuecomment-1270518105
I think the fix is either turn on the same set of flags of --experiments=use_runner_v2 when seeing --dataflowServiceOptions=use_runner_v2 in SDK so we get proper FNAPI job types or do it on service side. Do it on service has slight advantage of working for released SDKs.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@beam.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [beam] kennknowles commented on issue #21700: --dataflowServiceOptions=use_runner_v2 is broken
Posted by GitBox <gi...@apache.org>.
kennknowles commented on issue #21700:
URL: https://github.com/apache/beam/issues/21700#issuecomment-1341286656
@robertwb any update?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@beam.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [beam] kennknowles commented on issue #21700: --dataflowServiceOptions=use_runner_v2 is broken
Posted by "kennknowles (via GitHub)" <gi...@apache.org>.
kennknowles commented on issue #21700:
URL: https://github.com/apache/beam/issues/21700#issuecomment-1428808717
I interpret that to mean that setting to P2 and unassigning reflects our intentions.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@beam.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [beam] robertwb commented on issue #21700: --dataflowServiceOptions=use_runner_v2 is broken
Posted by "robertwb (via GitHub)" <gi...@apache.org>.
robertwb commented on issue #21700:
URL: https://github.com/apache/beam/issues/21700#issuecomment-1428728671
Long term, we don't care as we plan to change the default.
On Mon, Feb 13, 2023 at 1:32 PM Kenn Knowles ***@***.***>
wrote:
> Perhaps this should not be a longstanding P1 if it is not something we
> intend to change?
>
> —
> Reply to this email directly, view it on GitHub
> <https://github.com/apache/beam/issues/21700#issuecomment-1428717828>, or
> unsubscribe
> <https://github.com/notifications/unsubscribe-auth/AADWVAPQ4CSM5BMOWSEIOCLWXKR5NANCNFSM5X4ILEWQ>
> .
> You are receiving this because you were mentioned.Message ID:
> ***@***.***>
>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@beam.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [beam] kennknowles commented on issue #21700: --dataflowServiceOptions=use_runner_v2 is broken
Posted by GitBox <gi...@apache.org>.
kennknowles commented on issue #21700:
URL: https://github.com/apache/beam/issues/21700#issuecomment-1246028134
@robertwb this is fixed, I hope?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@beam.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [beam] robertwb commented on issue #21700: --dataflowServiceOptions=use_runner_v2 is broken
Posted by GitBox <gi...@apache.org>.
robertwb commented on issue #21700:
URL: https://github.com/apache/beam/issues/21700#issuecomment-1341338924
No updates on this. Despite being GA I think we can continue to recommend experiments for this flag until it is fully rolled out by default. I'm on the fence whether it's a good idea to patch the SDK to fix this for future SDKs only.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@beam.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org