You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@iceberg.apache.org by GitBox <gi...@apache.org> on 2022/08/30 04:22:36 UTC

[GitHub] [iceberg] sumeetgajjar commented on pull request #5670: core: snappy as default for parquet compession

sumeetgajjar commented on PR #5670:
URL: https://github.com/apache/iceberg/pull/5670#issuecomment-1231123414

   > org.apache.iceberg.TestSplitScan > test[format = parquet] FAILED
   
   Hi @rbalamohan, the above test is failing due to the change in compression codec, the size of the data file is now ~ 77MB and with a 16MB split size, it results in 5 scan tasks.
   
   https://github.com/apache/iceberg/blob/97c85aa03e3470ab9585519d650e8a989a59495f/data/src/test/java/org/apache/iceberg/TestSplitScan.java#L97
   Reducing the number of records to `2000000` to get the same file size when `gzip` was used resolves the test failure.
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org