[GitHub] [incubator-doris] chaoyli opened a new pull request #2448: Fix RLE encoding/decoding bug upon large negative number.

[GitBox <gi...@apache.org>]

chaoyli opened a new pull request #2448: Fix RLE encoding/decoding bug upon large negative number.
URL: https://github.com/apache/incubator-doris/pull/2448
 
 
   Doris have use RLE to encoding/decoding integer.
   Four types are comprised of the RLE encoding/decoding algorithm.
   Short Repeat : used for short repeating integer sequences.
   Direct : used for integer sequences whose values have a relatively constant bit width.
   Patched Base : used for integer sequences whose bit widths varies a lot.
   Delta : used for monotonically increasing or decreasing sequences.
   
   This bug occurs in Patched Base Type for large negative number.
   In patched base, base value is stored 1 to 8 bytes and encoding to 0 ~ 7.
   If the base value is 8 byte, the encoding value for base width should be 7.
   But now will encoding to 8, this is problem.
   It will result in inconsistent data with loaded data because wrong encoding procedure.
   In extreme case, the BE process will be cored dump because illegal address.

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


With regards,
Apache Git Services

---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org