You are viewing a plain text version of this content. The canonical link for it is here.
Posted to github@beam.apache.org by GitBox <gi...@apache.org> on 2022/06/28 14:57:44 UTC
[GitHub] [beam] pranavbhandari24 opened a new issue, #22078: [Bug]: GcsUtil does not propogate error messages
pranavbhandari24 opened a new issue, #22078:
URL: https://github.com/apache/beam/issues/22078
### What happened?
GcsUtil does not propagate error messages. This leads to vague error logs in dataflow which makes them hard to debug.
In [GcsUtil#bucketAccessible](https://github.com/apache/beam/blob/928da54e1a95219bfbfa420fbf9c8fb5514fd683/sdks/java/extensions/google-cloud-platform-core/src/main/java/org/apache/beam/sdk/extensions/gcp/util/GcsUtil.java#L627), if the bucket is not accessible because of permissions or if the bucket does not exist, the error is swallowed.
For example, in [GcsPathValidator#verifyPathIsAccessible](https://github.com/apache/beam/blob/928da54e1a95219bfbfa420fbf9c8fb5514fd683/sdks/java/extensions/google-cloud-platform-core/src/main/java/org/apache/beam/sdk/extensions/gcp/storage/GcsPathValidator.java#L80), if the bucket is not accessible due to permission issues the error message thrown is `Output path does not exist or is not writeable` or `Could not find file`.
### Issue Priority
Priority: 2
### Issue Component
Component: extensions-java-gcp
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@beam.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [beam] pranavbhandari24 commented on issue #22078: [Bug]: GcsUtil does not propogate error messages
Posted by GitBox <gi...@apache.org>.
pranavbhandari24 commented on issue #22078:
URL: https://github.com/apache/beam/issues/22078#issuecomment-1177950191
.close-issue
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@beam.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [beam] github-actions[bot] closed issue #22078: [Bug]: GcsUtil does not propogate error messages
Posted by GitBox <gi...@apache.org>.
github-actions[bot] closed issue #22078: [Bug]: GcsUtil does not propogate error messages
URL: https://github.com/apache/beam/issues/22078
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@beam.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [beam] pranavbhandari24 commented on issue #22078: [Bug]: GcsUtil does not propogate error messages
Posted by GitBox <gi...@apache.org>.
pranavbhandari24 commented on issue #22078:
URL: https://github.com/apache/beam/issues/22078#issuecomment-1168836466
.take-issue
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@beam.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org