You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@arrow.apache.org by "thoro (via GitHub)" <gi...@apache.org> on 2025/07/28 06:42:12 UTC

[I] slice bounds out of range - panic in writeDenseArrow [arrow]

thoro opened a new issue, #47210:
URL: https://github.com/apache/arrow/issues/47210

   ### Describe the bug, including details regarding any error messages, version, and platform.
   
   I'm getting this error when writing large amounts of strings:
   
   ```
   > panic: runtime error: slice bounds out of range [:-2147360192]
   
     goroutine 186374 [running]:
     github.com/apache/arrow/go/v17/parquet/pqarrow.writeDenseArrow(0xddae04a9b0, {0x20e96a8, 0xc4ccf9ef00}, {0x20e5320, 0xc4d1a6e5f0}, {0x0, 0x0, 0x0},
     {0x0, 0x0, ...}, ...)
         /go/pkg/mod/github.com/apache/arrow/go/v17@v17.0.0/parquet/pqarrow/encode_arrow.go:491 +0x2d2d
     github.com/apache/arrow/go/v17/parquet/pqarrow.WriteArrowToColumn({0x20c7298, 0xdeb4627020}, {0x20e96a8, 0xc4ccf9ef00}, {0x20e5320, 0xc4d1a6e5f0},
     {0x0, 0x0, 0x0}, {0x0, ...}, ...)
         /go/pkg/mod/github.com/apache/arrow/go/v17@v17.0.0/parquet/pqarrow/encode_arrow.go:232 +0x325
     github.com/apache/arrow/go/v17/parquet/pqarrow.(*arrowColumnWriter).Write(0xc4fb951710, {0x20c7298, 0xdeb4627020})
         /go/pkg/mod/github.com/apache/arrow/go/v17@v17.0.0/parquet/pqarrow/encode_arrow.go:193 +0x533
     github.com/apache/arrow/go/v17/parquet/pqarrow.(*FileWriter).WriteColumnChunked(0xdeb4634a10, 0x31b3220?, 0xc4fb9517d8?, 0x1?)
         /go/pkg/mod/github.com/apache/arrow/go/v17@v17.0.0/parquet/pqarrow/file_writer.go:330 +0xe5
     github.com/apache/arrow/go/v17/parquet/pqarrow.(*FileWriter).WriteColumnData(0xdeb4634a10, {0x20e5320, 0xc1c0963360})
         /go/pkg/mod/github.com/apache/arrow/go/v17@v17.0.0/parquet/pqarrow/file_writer.go:339 +0xc5
     github.com/apache/arrow/go/v17/parquet/pqarrow.(*FileWriter).Write(0xdeb4634a10, {0x20e1c20, 0xc4d1a16060})
         /go/pkg/mod/github.com/apache/arrow/go/v17@v17.0.0/parquet/pqarrow/file_writer.go:242 +0x272
   ```
   
   haven't exactly pinpointed what my data looks like at that moment, but this shouldn't happen regardless.
   
   ### Component(s)
   
   Go


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@arrow.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

Re: [I] [Go][Parquet] slice bounds out of range - panic in writeDenseArrow [arrow]

Posted by "qiushido (via GitHub)" <gi...@apache.org>.
qiushido commented on issue #47210:
URL: https://github.com/apache/arrow/issues/47210#issuecomment-3701177613

   我也遇到了这个问题，构建arrow record时使用多个large string 和 binary 类型字段，我分析调试我的程序试了很久，依旧panic，直到我把写入parquet的行数从10000改成了5000，这个panic就消失了


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org