[I] Merging deletion vectors across a deletion-vectors.bitmap64 flip crashes with a class-type error [paimon]

["LuciferYang (via GitHub)" <gi...@apache.org>]

LuciferYang opened a new issue, #10281:
URL: https://github.com/apache/paimon/issues/10281

   ### Search before asking
   
   - [X] I searched in the [issues](https://github.com/apache/paimon/issues) and found no similar issues.
   
   ### Paimon version
   
   master (1.5-SNAPSHOT)
   
   ### Compute Engine
   
   Any engine writing an append or bucketed-append table with deletion vectors.
   
   ### Minimal reproduce step
   
   1. Create an append table with deletion vectors and write some deletes, stored as bitmap32 (the default).
   2. `ALTER TABLE t SET ('deletion-vectors.bitmap64' = 'true')`.
   3. Delete more rows on a data file that already has a stored bitmap32 deletion vector.
   
   ### What doesn't meet your expectations?
   
   The delete crashes with `RuntimeException: Only instance with the same class type can be merged.`. `deletion-vectors.bitmap64` is not an immutable option, so it can be flipped on a table that already has deletion vectors. After the flip, a freshly created deletion vector (bitmap64) has to merge with the stored one (bitmap32), and `Bitmap64DeletionVector.merge` / `BitmapDeletionVector.merge` reject a different class. The reverse flip (bitmap64 back to false, stored bitmap64 + fresh bitmap32) crashes the same way. Both the unaware-append and bucketed-append maintainers are affected.
   
   ### Anything else?
   
   Deletion vectors are deserialized by magic number, so bitmap32 and bitmap64 vectors already coexist in one index file; merging across the two formats just needs to promote the narrower one first.
   
   ### Are you willing to submit a PR?
   
   - [X] I'm willing to submit a PR!
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@paimon.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

Re: [I] Merging deletion vectors across a deletion-vectors.bitmap64 flip crashes with a class-type error [paimon]

["JingsongLi (via GitHub)" <gi...@apache.org>]

JingsongLi closed issue #10281: Merging deletion vectors across a deletion-vectors.bitmap64 flip crashes with a class-type error
URL: https://github.com/apache/paimon/issues/10281


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@paimon.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

Re: [I] Merging deletion vectors across a deletion-vectors.bitmap64 flip crashes with a class-type error [paimon]

["JingsongLi (via GitHub)" <gi...@apache.org>]

JingsongLi commented on issue #10281:
URL: https://github.com/apache/paimon/issues/10281#issuecomment-5944121608

   deletion-vectors.bitmap64 is designed for Iceberg compatibility. What is the point of having both 32-bit and 64-bit versions?


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@paimon.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org