[I] [Bug] Range-bitmap chunk-size option above 2GB silently truncates to a negative int [paimon]

["LuciferYang (via GitHub)" <gi...@apache.org>]

LuciferYang opened a new issue, #9764:
URL: https://github.com/apache/paimon/issues/9764

   ### Bug description
   
   `RangeBitmapFileIndex`'s Writer parses the user-facing `chunk-size` option (per-column: `fileindex.rangebitmap.<col>.chunk-size`) with `(int) MemorySize.parse(...).getBytes()`. Any value above `Integer.MAX_VALUE` — e.g. the legitimate `"2g"` a user might set to effectively disable chunking — silently narrows to a negative int, and the writer then crashes with an unrelated failure deep inside the first chunk creation.
   
   The chunk size becomes an eagerly allocated per-chunk buffer (`FixedLengthChunk` does `ByteBuffer.allocate(limitedSerializedSizeInBytes)`), so values beyond int range can never work in the current design.
   
   ### Expected behavior
   
   A clear validation error naming the option and the offending value, instead of a silent truncation and a deep crash.
   
   ### Steps
   
   `ALTER TABLE ... SET OPTIONS ('fileindex.rangebitmap.<col>.chunk-size'='2g')` then write a data file with the range-bitmap index enabled.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@paimon.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

Re: [I] [Bug] Range-bitmap chunk-size option above 2GB silently truncates to a negative int [paimon]

["JingsongLi (via GitHub)" <gi...@apache.org>]

JingsongLi closed issue #9764: [Bug] Range-bitmap chunk-size option above 2GB silently truncates to a negative int
URL: https://github.com/apache/paimon/issues/9764


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@paimon.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org