Re: [I] Error when reading row group larger than 2GB (total string length per 8k row batch exceeds 2GB) [arrow-rs]

["JigaoLuo (via GitHub)" <gi...@apache.org>]

JigaoLuo commented on issue #7973:
URL: https://github.com/apache/arrow-rs/issues/7973#issuecomment-3410458370

   I see the same error during my parquet rewriting today with `arrow-array-56.1.0`
   
   ```
    thread '<unnamed>' panicked at /home/jluo/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/arrow-array-56.1.0/src/builder/generic_bytes_builder.rs:86:57:
    byte array offset overflow
    note: run with `RUST_BACKTRACE=1` environment variable to display a backtrace
    
    thread '<unnamed>' panicked at /home/jluo/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/arrow-array-56.1.0/src/builder/generic_bytes_builder.rs:86:57:
    byte array offset overflow
    
   ```
   (the same error pattern then repeats)


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org