You are viewing a plain text version of this content. The canonical link for it is here.

Posted to github@beam.apache.org by GitBox <gi...@apache.org> on 2022/06/03 16:28:16 UTC

[GitHub] [beam] kennknowles opened a new issue, #18168: Jobs that contain FileBasedSources with globs that expand into zero files should fail

kennknowles opened a new issue, #18168:
URL: https://github.com/apache/beam/issues/18168

   Currently we do not fail if a glob that is used to create a FileBasedSource expand into zero files. This can be error prone since a typo when specifying a glob pattern can result in a job that silently pass without producing any output. I believe this should be fixed as follows.
   
   If a glob pattern specified as input to a FileBasedSource expand into zero files.
   (1) If validation of FileBasedSource is enabled, fail the job at pipeline construction.
   (2) If validation is disabled, fail the job at runtime by raising an exception at initial splitting.
   
   Both Java and Python SDKs have to be fixed.
   
   Imported from Jira [BEAM-1167](https://issues.apache.org/jira/browse/BEAM-1167). Original Jira may contain additional context.
   Reported by: chamikara.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org