You are viewing a plain text version of this content. The canonical link for it is here.
Posted to github@arrow.apache.org by "Jefffrey (via GitHub)" <gi...@apache.org> on 2024/01/31 10:17:16 UTC
Re: [I] get_buffer_memory_size() returns an incorrect larger size [arrow-rs]
Jefffrey commented on issue #5352:
URL: https://github.com/apache/arrow-rs/issues/5352#issuecomment-1918802135
I think this PR might help clear up confusion, as it enhances the docstring of `get_buffer_memory_size()`: https://github.com/apache/arrow-rs/pull/5347
```rust
/// Note that this does not always correspond to the exact memory usage of an array,
/// since multiple arrays can share the same buffers or slices thereof.
```
Note that `value_data().len()` gives the len, i.e. how many bytes are used in the buffer, whilst `get_buffer_memory_size()` calculates using the capacity of the buffer (how much memory is allocated to it), which might be larger than the len:
https://github.com/apache/arrow-rs/blob/31cf5ce23febf076104f064358a24fe8af09ee4b/arrow-array/src/array/byte_array.rs#L464-L471
This should help explain the discrepancy.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org