[GitHub] [iceberg] wypoon commented on pull request #4588: Spark: Add custom metric for number of deletes applied by a SparkScan

[GitBox <gi...@apache.org>]

wypoon commented on PR #4588:
URL: https://github.com/apache/iceberg/pull/4588#issuecomment-1204339304

   I ran `IcebergSourceParquetPosDeleteBenchmark` and `IcebergSourceParquetEqDeleteBenchmark` on the state of master when I last rebased and on my last change. The results for `readIceberg` and `readIcebergVectorized` are as follows:
   <img width="1395" alt="Screen Shot 2022-08-03 at 11 13 05 AM" src="https://user-images.githubusercontent.com/3925490/182683434-1f1a6583-703f-4b96-a671-9049a1ea46ab.png">
   
   There is hardly any difference for `IcebergSourceParquetPosDeleteBenchmark`.
   For `IcebergSourceParquetEqDeleteBenchmark`, the numbers show greater difference (some worse and some better, comparing after to before), but due to the much greater variances, I think the differences are within the variances.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org