You are viewing a plain text version of this content. The canonical link for it is here.
Posted to github@arrow.apache.org by GitBox <gi...@apache.org> on 2020/12/08 20:10:50 UTC

[GitHub] [arrow] jorgecarleitao edited a comment on pull request #8698: ARROW-10636: [Rust][Parquet] Switch to Rust Stable by removing specialization in parquet

jorgecarleitao edited a comment on pull request #8698:
URL: https://github.com/apache/arrow/pull/8698#issuecomment-740958408


   @alamb benchmarks formatted as a table (from worse to best, statistical insignificant and changes <5% ignored). No judgement, just info:
   
   |  benchmark | variation (%) |
   |-------------- | -------------- | 
   | decompress_snappy::wall_time/fixed | 11458.0 | 
   | compress_snappy::wall_time/fixed | 11265.0 | 
   | compress_gzip::wall_time/int32 | 6472.1 | 
   | compress_brotli::wall_time/int32 | 4928.4 | 
   | decompress_brotli::wall_time/int96 | 4830.6 | 
   | decompress_snappy::wall_time/int96 | 3491.3 | 
   | decompress_gzip::wall_time/int96 | 3269.0 | 
   | decompress_brotli::wall_time/fixed | 2586.1 | 
   | compress_gzip::wall_time/int96 | 2534.1 | 
   | decompress_zstd::wall_time/double | 2414.9 | 
   | compress_snappy::wall_time/int96 | 2146.0 | 
   | compress_zstd::wall_time/int32 | 1895.5 | 
   | decompress_zstd::wall_time/int32 | 1585.4 | 
   | compress_gzip::wall_time/double | 1409.6 | 
   | decompress_snappy::wall_time/double | 1407.4 | 
   | compress_brotli::wall_time/int96 | 1344.0 | 
   | compress_lz4::wall_time/double | 1246.5 | 
   | decompress_gzip::wall_time/double | 1245.3 | 
   | decompress_lz4::wall_time/int96 | 1082.6 | 
   | compress_brotli::wall_time/double | 1051.9 | 
   | compress_snappy::wall_time/int32 | 983.8 | 
   | decompress_lz4::wall_time/double | 965.8 | 
   | compress_snappy::wall_time/double | 856.6 | 
   | decompress_gzip::wall_time/int32 | 739.0 | 
   | decompress_brotli::wall_time/int32 | 611.3 | 
   | decompress_lz4::wall_time/fixed | 593.6 | 
   | decompress_brotli::wall_time/double | 568.2 | 
   | compress_zstd::wall_time/double | 563.5 | 
   | decompress_zstd::wall_time/int96 | 509.0 | 
   | compress_lz4::wall_time/int96 | 490.8 | 
   | compress_lz4::wall_time/int32 | 470.8 | 
   | decompress_gzip::wall_time/fixed | 469.8 | 
   | compress_zstd::wall_time/int96 | 428.8 | 
   | decompress_lz4::wall_time/int32 | 426.8 | 
   | compress_brotli::wall_time/fixed | 377.3 | 
   | compress_gzip::wall_time/fixed | 257.7 | 
   | decompress_brotli::wall_time/float | 199.0 | 
   | decompress_zstd::wall_time/fixed | 196.2 | 
   | compress_brotli::wall_time/float | 126.2 | 
   | decompress_zstd::wall_time/float | 121.9 | 
   | compress_lz4::wall_time/fixed | 108.4 | 
   | compress_lz4::wall_time/binary | 72.6 | 
   | decompress_snappy::wall_time/int32 | 38.5 | 
   | delta_len_byte_arry_decoder_byte_array::wall_time/128 | 38.2 | 
   | delta_byte_arry_decoder_byte_array::wall_time/64 | 37.9 | 
   | delta_byte_arry_decoder_byte_array::wall_time/16 | 37.9 | 
   | delta_byte_arry_decoder_byte_array::wall_time/8 | 37.8 | 
   | delta_len_byte_arry_decoder_byte_array::wall_time/8 | 37.8 | 
   | delta_len_byte_arry_decoder_byte_array::wall_time/32 | 37.7 | 
   | compress_zstd::wall_time/fixed | 37.5 | 
   | delta_len_byte_arry_decoder_byte_array::wall_time/16 | 37.5 | 
   | delta_byte_arry_decoder_byte_array::wall_time/32 | 37.5 | 
   | delta_byte_arry_decoder_byte_array::wall_time/128 | 37.4 | 
   | delta_len_byte_arry_decoder_byte_array::wall_time/64 | 35.3 | 
   | plain_encoder_byte_array::wall_time/64 | 31.8 | 
   | plain_encoder_byte_array::wall_time/128 | 14.4 | 
   | delta_byte_arry_encoder_byte_array::wall_time/8 | 11.5 | 
   | delta_bin_packed_encoder_int64::wall_time/64 | 11.2 | 
   | delta_len_byte_arry_encoder_byte_array::wall_time/8 | 10.5 | 
   | decompress_snappy::wall_time/binary | 10.4 | 
   | compress_zstd::wall_time/binary | 9.3 | 
   | delta_byte_arry_encoder_byte_array::wall_time/32 | 8.4 | 
   | plain_decoder_boolean::wall_time/64 | 8.2 | 
   | plain_decoder_boolean::wall_time/32 | 8.1 | 
   | delta_bin_packed_decoder_int32::wall_time/128 | 7.8 | 
   | delta_bin_packed_decoder_int64::wall_time/32 | 7.8 | 
   | delta_bin_packed_encoder_int64::wall_time/16 | 7.8 | 
   | delta_bin_packed_decoder_int32::wall_time/64 | 7.7 | 
   | delta_bin_packed_decoder_int64::wall_time/8 | 7.7 | 
   | delta_bin_packed_decoder_int64::wall_time/16 | 7.7 | 
   | plain_decoder_boolean::wall_time/8 | 7.7 | 
   | delta_bin_packed_decoder_int32::wall_time/16 | 7.6 | 
   | delta_bin_packed_decoder_int32::wall_time/32 | 7.5 | 
   | delta_bin_packed_decoder_int32::wall_time/8 | 7.5 | 
   | delta_bin_packed_decoder_int64::wall_time/64 | 7.5 | 
   | delta_bin_packed_decoder_int64::wall_time/128 | 7.4 | 
   | plain_decoder_boolean::wall_time/16 | 7.4 | 
   | delta_len_byte_arry_encoder_byte_array::wall_time/16 | 7.4 | 
   | plain_decoder_boolean::wall_time/128 | 7.4 | 
   | delta_byte_arry_encoder_byte_array::wall_time/64 | 6.9 | 
   | delta_byte_arry_encoder_byte_array::wall_time/16 | 6.8 | 
   | plain_decoder_float::wall_time/8 | 6.6 | 
   | decompress_lz4::wall_time/binary | 6.6 | 
   | plain_encoder_byte_array::wall_time/32 | 5.7 | 
   | delta_bin_packed_encoder_int64::wall_time/8 | 5.6 | 
   | delta_bin_packed_encoder_int64::wall_time/32 | 5.4 | 
   | dict_decoder_int64::wall_time/64 | 5.1 | 
   | dict_decoder_int64::wall_time/8 | 5.0 | 
   | plain_encoder_byte_array::wall_time/16 | -5.1 | 
   | dict_encoder_float::wall_time/8 | -5.5 | 
   | dict_encoder_byte_array::wall_time/8 | -6.3 | 
   | dict_encoder_int96::wall_time/64 | -6.4 | 
   | plain_encoder_int64::wall_time/32 | -7.3 | 
   | plain_encoder_byte_array::wall_time/8 | -7.8 | 
   | reader_wall_time/stock-simulated-column | -7.9 | 
   | dict_encoder_double::wall_time/128 | -9.6 | 
   | plain_encoder_int32::wall_time/128 | -10.0 | 
   | plain_encoder_float::wall_time/128 | -10.4 | 
   | plain_encoder_int96::wall_time/128 | -10.7 | 
   | plain_encoder_float::wall_time/64 | -10.7 | 
   | plain_encoder_int32::wall_time/64 | -10.8 | 
   | plain_encoder_int32::wall_time/32 | -11.5 | 
   | compress_gzip::wall_time/binary | -11.6 | 
   | plain_encoder_int96::wall_time/16 | -11.6 | 
   | plain_encoder_float::wall_time/32 | -11.6 | 
   | plain_encoder_double::wall_time/32 | -11.7 | 
   | plain_encoder_int32::wall_time/16 | -11.9 | 
   | decompress_gzip::wall_time/binary | -12.1 | 
   | plain_encoder_float::wall_time/8 | -12.1 | 
   | plain_encoder_float::wall_time/16 | -12.2 | 
   | plain_encoder_int96::wall_time/8 | -12.2 | 
   | plain_encoder_int32::wall_time/8 | -12.3 | 
   | plain_encoder_int96::wall_time/64 | -12.7 | 
   | plain_encoder_double::wall_time/128 | -12.7 | 
   | plain_encoder_int96::wall_time/32 | -12.8 | 
   | plain_encoder_int64::wall_time/16 | -12.9 | 
   | plain_encoder_int64::wall_time/64 | -13.2 | 
   | plain_encoder_double::wall_time/64 | -13.3 | 
   | plain_encoder_double::wall_time/16 | -13.5 | 
   | plain_encoder_double::wall_time/8 | -14.3 | 
   | rle_encoder_boolean::wall_time/8 | -14.7 | 
   | plain_encoder_int64::wall_time/128 | -15.1 | 
   | plain_encoder_boolean::wall_time/8 | -16.4 | 
   | plain_encoder_int64::wall_time/8 | -17.2 | 
   | rle_encoder_boolean::wall_time/16 | -20.5 | 
   | plain_encoder_boolean::wall_time/16 | -24.7 | 
   | rle_encoder_boolean::wall_time/32 | -25.5 | 
   | plain_decoder_float::wall_time/16 | -28.3 | 
   | rle_encoder_boolean::wall_time/64 | -29.5 | 
   | rle_encoder_boolean::wall_time/128 | -33.7 | 
   | plain_encoder_boolean::wall_time/32 | -38.6 | 
   | decompress_gzip::wall_time/float | -40.3 | 
   | compress_gzip::wall_time/float | -42.2 | 
   | rle_decoder_boolean::wall_time/128 | -46.3 | 
   | rle_decoder_boolean::wall_time/64 | -46.3 | 
   | rle_decoder_boolean::wall_time/32 | -46.4 | 
   | rle_decoder_boolean::wall_time/16 | -46.4 | 
   | plain_encoder_boolean::wall_time/64 | -46.6 | 
   | compress_snappy::wall_time/float | -47.2 | 
   | decompress_snappy::wall_time/float | -48.5 | 
   | decompress_lz4::wall_time/float | -48.5 | 
   | rle_decoder_boolean::wall_time/8 | -48.9 | 
   | compress_zstd::wall_time/float | -49.3 | 
   | plain_encoder_boolean::wall_time/128 | -53.6 | 
   | compress_lz4::wall_time/float | -65.1 | 
   | decompress_zstd::wall_time/binary | -74.9 | 
   | compress_lz4::wall_time/boolean | -77.1 | 
   | compress_brotli::wall_time/binary | -77.7 | 
   | compress_zstd::wall_time/boolean | -79.0 | 
   | decompress_brotli::wall_time/binary | -80.7 | 
   | decompress_lz4::wall_time/boolean | -91.0 | 
   | compress_brotli::wall_time/boolean | -93.0 | 
   | compress_snappy::wall_time/boolean | -94.7 | 
   | decompress_zstd::wall_time/boolean | -95.6 | 
   | decompress_gzip::wall_time/boolean | -96.2 | 
   | compress_gzip::wall_time/boolean | -96.6 | 
   | decompress_snappy::wall_time/boolean | -97.2 | 
   | decompress_brotli::wall_time/boolean | -98.4 | 
   | compress_lz4::wall_time/int64 | -98.9 | 
   | compress_zstd::wall_time/int64 | -99.2 | 
   | decompress_zstd::wall_time/int64 | -99.3 | 
   | decompress_lz4::wall_time/int64 | -99.4 | 
   | decompress_gzip::wall_time/int64 | -99.8 | 
   | decompress_brotli::wall_time/int64 | -99.8 | 
   | decompress_snappy::wall_time/int64 | -99.9 | 
   | compress_brotli::wall_time/int64 | -99.9 | 
   | compress_gzip::wall_time/int64 | -99.9 | 
   | compress_snappy::wall_time/int64 | -100.0 | 
   
   (@alamb feel free to delete this comment and add this table to your comment. I did not want to edit your comment)


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org