You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@arrow.apache.org by "Sam Albers (Jira)" <ji...@apache.org> on 2022/05/19 22:10:00 UTC

[jira] [Created] (ARROW-16622) [R] Detect compression by magic number where possible

Sam Albers created ARROW-16622:
----------------------------------

             Summary: [R] Detect compression by magic number where possible
                 Key: ARROW-16622
                 URL: https://issues.apache.org/jira/browse/ARROW-16622
             Project: Apache Arrow
          Issue Type: Bug
          Components: R
    Affects Versions: 8.0.0
            Reporter: Sam Albers


readr does this like so:
[https://github.com/tidyverse/readr/commit/3e1195762a204fd053ba0d7d88ed3e80a1810510]

I think we could largely take that same approach at least as a first pass at detection perhaps falling back on file extensions. This would be a little safer. 

This would apply to read functions though maybe if not too expensive we could check outputs for a successful write.



--
This message was sent by Atlassian Jira
(v8.20.7#820007)