You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hudi.apache.org by GitBox <gi...@apache.org> on 2022/09/02 02:34:05 UTC
[GitHub] [hudi] hbgstc123 opened a new pull request, #6571: Fix KryoException when bulk insert into a not bucket index hudi table
hbgstc123 opened a new pull request, #6571:
URL: https://github.com/apache/hudi/pull/6571
Fix KryoException when bulk insert into a not bucket index hudi table
### Change Logs
Provide InternalTypeInfo instead of TypeInformation of RowData to transform method when adding SortOperator to flink pipeline. Because SortOperator now use kryo to serialize BinaryRowData object that it pass to flink collector which will cause KryoException see [https://github.com/apache/hudi/issues/6540](url).
Use InternalTypeInfo will switch to a flink serializer to avoid KryoException.
### Impact
no public API or user-facing feature change
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #6571: Fix KryoException when bulk insert into a not bucket index hudi table
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #6571:
URL: https://github.com/apache/hudi/pull/6571#issuecomment-1235025611
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "81fd90c3d3a9370369a2af7e647f0520859e8b20",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=11104",
"triggerID" : "81fd90c3d3a9370369a2af7e647f0520859e8b20",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 81fd90c3d3a9370369a2af7e647f0520859e8b20 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=11104)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #6571: Fix KryoException when bulk insert into a not bucket index hudi table
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #6571:
URL: https://github.com/apache/hudi/pull/6571#issuecomment-1235022950
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "81fd90c3d3a9370369a2af7e647f0520859e8b20",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "81fd90c3d3a9370369a2af7e647f0520859e8b20",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 81fd90c3d3a9370369a2af7e647f0520859e8b20 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hbgstc123 commented on pull request #6571: Fix KryoException when bulk insert into a not bucket index hudi table
Posted by GitBox <gi...@apache.org>.
hbgstc123 commented on PR #6571:
URL: https://github.com/apache/hudi/pull/6571#issuecomment-1235113800
https://github.com/apache/hudi/issues/6540
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] danny0405 merged pull request #6571: [HUDI-4795] Fix KryoException when bulk insert into a not bucket index hudi table
Posted by GitBox <gi...@apache.org>.
danny0405 merged PR #6571:
URL: https://github.com/apache/hudi/pull/6571
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #6571: Fix KryoException when bulk insert into a not bucket index hudi table
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #6571:
URL: https://github.com/apache/hudi/pull/6571#issuecomment-1235084522
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "81fd90c3d3a9370369a2af7e647f0520859e8b20",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=11104",
"triggerID" : "81fd90c3d3a9370369a2af7e647f0520859e8b20",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 81fd90c3d3a9370369a2af7e647f0520859e8b20 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=11104)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org