You are viewing a plain text version of this content. The canonical link for it is here.

Posted to github@beam.apache.org by GitBox <gi...@apache.org> on 2022/06/03 22:10:15 UTC

[GitHub] [beam] kennknowles opened a new issue, #19091: Python LocalFileSystem directory-creation semantics

kennknowles opened a new issue, #19091:
URL: https://github.com/apache/beam/issues/19091

   Coming out of discussion on [BEAM-4742](https://issues.apache.org/jira/browse/BEAM-4742) / [#5903](https://github.com/apache/beam/pull/5903) is a question of whether `LocalFileSystem.&#123;open,create,copy,rename&#125;` should create intermediate (destination) directories, or fail with `IOError`'s (as the stdlib `os` module generally will).
   
   If the semantics of `LocalFileSystem` should mimic those of distributed filesystems (in the spirit of [recent discussion about `DirectRunner` being more like a local simulation of a distributed runner than a production-grade local runner|https://www.mail-archive.com/dev@beam.apache.org/msg08410.html]), then this makes sense, and it sounds like [~lcwik] and [~angoenka] are in favor of this interpretation.
   
   I'll repurpose [#5903](https://github.com/apache/beam/pull/5903) to this end unless I hear otherwise.
   
   Imported from Jira [BEAM-4747](https://issues.apache.org/jira/browse/BEAM-4747). Original Jira may contain additional context.
   Reported by: rdub.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org