You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@gluten.apache.org by "zjuwangg (via GitHub)" <gi...@apache.org> on 2025/05/19 11:27:22 UTC
[PR] [GLUTEN-9691][VL]Fix driver coredump when broadcast too large UnsafeColumnarBuildSideRelation [incubator-gluten]
zjuwangg opened a new pull request, #9692:
URL: https://github.com/apache/incubator-gluten/pull/9692
## What changes were proposed in this pull request?
(Fixes: \#ISSUE-9691)
The type of `bytesBufferOffset` in UnsafeBytesBufferArray.scala is Array[Int], while when `bytesBufferLengths ` are all large number, will cause the element in `bytesBufferOffset` overflowed the Int.max_value, and finally lead to jvm coredump in other operation like
``` scala
Platform.copyMemory(
bytesBuffer,
Platform.BYTE_ARRAY_OFFSET,
longArray.getBaseObject,
longArray.getBaseOffset + bytesBufferOffset(index),
bytesBufferLengths(index))
```
## How was this patch tested?
Manually test in our production environment
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@gluten.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@gluten.apache.org
For additional commands, e-mail: commits-help@gluten.apache.org
Re: [PR] [GLUTEN-9691][VL]Fix driver coredump when broadcast too large UnsafeColumnarBuildSideRelation [incubator-gluten]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #9692:
URL: https://github.com/apache/incubator-gluten/pull/9692#issuecomment-2890658942
https://github.com/apache/incubator-gluten/issues/9691
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@gluten.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@gluten.apache.org
For additional commands, e-mail: commits-help@gluten.apache.org
Re: [PR] [GLUTEN-9691][VL]Fix driver core dump when broadcast too large when UnsafeColumnarBuildSideRelation enabled [incubator-gluten]
Posted by "zhztheplayer (via GitHub)" <gi...@apache.org>.
zhztheplayer merged PR #9692:
URL: https://github.com/apache/incubator-gluten/pull/9692
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@gluten.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@gluten.apache.org
For additional commands, e-mail: commits-help@gluten.apache.org
Re: [PR] [GLUTEN-9691][VL]Fix driver core dump when broadcast too large when UnsafeColumnarBuildSideRelation enabled [incubator-gluten]
Posted by "zjuwangg (via GitHub)" <gi...@apache.org>.
zjuwangg commented on PR #9692:
URL: https://github.com/apache/incubator-gluten/pull/9692#issuecomment-2890662520
@zhztheplayer Please have a look when you have free time 🙏
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@gluten.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@gluten.apache.org
For additional commands, e-mail: commits-help@gluten.apache.org