Re: [I] [R] Platform-dependent hashes of parquet files? [arrow]

["amoeba (via GitHub)" <gi...@apache.org>]

amoeba commented on issue #40202:
URL: https://github.com/apache/arrow/issues/40202#issuecomment-1960526499

   I managed to reproduce getting different checksums for files written using macOS and Linux and am attaching them here in case anyone wants to take a look: [mtcars-parquet.zip](https://github.com/apache/arrow/files/14380370/mtcars-parquet.zip). Both were written with `arrow::write_parquet(mtcars, "mtcars.parquet", compression = "uncompressed")` using arrow R 14.0.0.2.
   
   When I run parquet-tools inspect on each file with --detail, I get two differences in output. The first is some unlabeled number that's either 262658 or 262914 (diff of 256 which is a bit conspicuous) depending on the file and the second difference is in the KeyValue metadata for the `ARROW:schema` key. I wonder if the two differences are related.
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org