You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@arrow.apache.org by "asfimport (via GitHub)" <gi...@apache.org> on 2025/05/26 22:41:40 UTC
[I] [JS] Incorrect Table concat after serialize [arrow-js]
asfimport opened a new issue, #96:
URL: https://github.com/apache/arrow-js/issues/96
After reading an arrow table from disk and concatenating another arrow table, this concatenated table loses it's last concatenated chunk after serializing to disk.
Steps to reproduce:
```java
// helper that creates a vector to make the below more succinct
function createSomeVectors(){ return [ FloatVector.from(Float32Array.from([1]))] }
// CORRECT
// Create tables T1 + T2. Each contain 1 vector with 1 value
const T1 = Table.new(createSomeVectors(), ['value'])
const T2 = Table.new(createSomeVectors(), ['value'])
// Combine these tables
const combined = T1.concat(T2)
// Serialize and read back this combination (mimic saving and reading from disk)
const combinedAfterSerialization = Table.from([combined.serialize()])
// Print the count (works correctly)
console.log(T1.count(), T2.count(), combined.count(), combinedAfterSerialization.count())
// Result (as expected)= 2, 2, 2, 2
// INCORRECT
// Serialize T1 and read back. (mimic saving and reading from disk)
const T1SerializedAndBack = Table.from([T1.serialize()])
// Combine just read T1SerializedAndBack with T2
const combined2 = T1SerializedAndBack.concat(T2)
// Serialize and read back this combination (mimic saving and reading from disk)
const combinedAfterSerialization2 = Table.from([combined2.serialize()])
// Print the count (works Incorrectly)
console.log(T1SerializedAndBack.count(), T2.count(), combined2.count(), combinedAfterSerialization2.count())
// Result (NOT as expected)= 2, 2, 2, 1 <=!!
```
**Reporter**: [geert-jan brits](https://issues.apache.org/jira/browse/ARROW-15086)
<sub>**Note**: *This issue was originally created as [ARROW-15086](https://issues.apache.org/jira/browse/ARROW-15086). Please see the [migration documentation](https://github.com/apache/arrow/issues/14542) for further details.*</sub>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@arrow.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org