You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hudi.apache.org by "cshuo (via GitHub)" <gi...@apache.org> on 2025/11/25 09:15:59 UTC
[PR] fix: Support handling complex data types in convertRowToJsonString fo… [hudi]
cshuo opened a new pull request, #14351:
URL: https://github.com/apache/hudi/pull/14351
…r cdc reading
### Describe the issue this Pull Request addresses
Currently,`InternalRowToJsonStringConverter` do not support convert complex type data in `InternalRow` into java object string, but output spark internal data structure directly, like `ArrayData`, `MapData`, which is not friendly for user.
e.g., for Array[INT], before this pr:
```
"array_int_field":{"baseObject":[3,0,8589934593,3],"baseOffset":16,"sizeInBytes":32}
```
after this pr:
```
"array_int_field":[1,2,3]
```
### Summary and Changelog
Support handling complex data types in convertRowToJsonString.
### Impact
Output readable json string for cdc output when there is complex type fields.
### Risk Level
low.
### Documentation Update
<!-- Describe any necessary documentation update if there is any new feature, config, or user-facing change. If not, put "none".
- The config description must be updated if new configs are added or the default value of the configs are changed.
- Any new feature or user-facing change requires updating the Hudi website. Please follow the
[instruction](https://hudi.apache.org/contribute/developer-setup#website) to make changes to the website. -->
### Contributor's checklist
- [ ] Read through [contributor's guide](https://hudi.apache.org/contribute/how-to-contribute)
- [ ] Enough context is provided in the sections above
- [ ] Adequate tests were added if applicable
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] fix: Support handling complex data types in convertRowToJsonString fo… [hudi]
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #14351:
URL: https://github.com/apache/hudi/pull/14351#issuecomment-3581190930
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "ab31a1e650c86ec6eea85999aab6b0fd17cf83aa",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=9684",
"triggerID" : "ab31a1e650c86ec6eea85999aab6b0fd17cf83aa",
"triggerType" : "PUSH"
}, {
"hash" : "5bdd933581aafce3ddc511b2fab47fea7b76fb6c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=9686",
"triggerID" : "5bdd933581aafce3ddc511b2fab47fea7b76fb6c",
"triggerType" : "PUSH"
}, {
"hash" : "ce1aed19d814d379e9aef446eb6088e36a348e29",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=9718",
"triggerID" : "ce1aed19d814d379e9aef446eb6088e36a348e29",
"triggerType" : "PUSH"
}, {
"hash" : "856960dd2394856a9645c65b4a6e501835b83ea9",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=9721",
"triggerID" : "856960dd2394856a9645c65b4a6e501835b83ea9",
"triggerType" : "PUSH"
}, {
"hash" : "285c42649ad2e3da61f96473b810b3d9548b5ed6",
"status" : "PENDING",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=9722",
"triggerID" : "285c42649ad2e3da61f96473b810b3d9548b5ed6",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 856960dd2394856a9645c65b4a6e501835b83ea9 Azure: [FAILURE](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=9721)
* 285c42649ad2e3da61f96473b810b3d9548b5ed6 Azure: [PENDING](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=9722)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] fix: Support handling complex data types in convertRowToJsonString fo… [hudi]
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #14351:
URL: https://github.com/apache/hudi/pull/14351#issuecomment-3581027070
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "ab31a1e650c86ec6eea85999aab6b0fd17cf83aa",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=9684",
"triggerID" : "ab31a1e650c86ec6eea85999aab6b0fd17cf83aa",
"triggerType" : "PUSH"
}, {
"hash" : "5bdd933581aafce3ddc511b2fab47fea7b76fb6c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=9686",
"triggerID" : "5bdd933581aafce3ddc511b2fab47fea7b76fb6c",
"triggerType" : "PUSH"
}, {
"hash" : "ce1aed19d814d379e9aef446eb6088e36a348e29",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=9718",
"triggerID" : "ce1aed19d814d379e9aef446eb6088e36a348e29",
"triggerType" : "PUSH"
}, {
"hash" : "856960dd2394856a9645c65b4a6e501835b83ea9",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=9721",
"triggerID" : "856960dd2394856a9645c65b4a6e501835b83ea9",
"triggerType" : "PUSH"
}, {
"hash" : "285c42649ad2e3da61f96473b810b3d9548b5ed6",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "285c42649ad2e3da61f96473b810b3d9548b5ed6",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 856960dd2394856a9645c65b4a6e501835b83ea9 Azure: [FAILURE](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=9721)
* 285c42649ad2e3da61f96473b810b3d9548b5ed6 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] fix: Support handling complex data types in convertRowToJsonString fo… [hudi]
Posted by "danny0405 (via GitHub)" <gi...@apache.org>.
danny0405 commented on code in PR #14351:
URL: https://github.com/apache/hudi/pull/14351#discussion_r2563693181
##########
hudi-spark-datasource/hudi-spark-common/src/main/scala/org/apache/hudi/cdc/InternalRowToJsonStringConverter.scala:
##########
@@ -36,15 +37,63 @@ class InternalRowToJsonStringConverter(schema: StructType) {
}
def convert(record: InternalRow): UTF8String = {
- val map = scala.collection.mutable.Map.empty[String, Any]
+ // Use LinkedHashMap to preserve field order
+ val map = scala.collection.mutable.LinkedHashMap.empty[String, Any]
schema.zipWithIndex.foreach {
case (field, idx) =>
- if (field.dataType.isInstanceOf[StringType]) {
- map(field.name) = Option(record.getUTF8String(idx)).map(_.toString).orNull
- } else {
- map(field.name) = record.get(idx, field.dataType)
- }
+ map(field.name) = convertField(record.get(idx, field.dataType), field.dataType)
}
UTF8String.fromString(mapper.writeValueAsString(map))
}
+
+ private def convertField(value: Any, dataType: DataType): Any = {
+ if (value == null) {
+ null
+ } else {
+ dataType match {
+ case StringType => value.toString
Review Comment:
do we already have a test to cover the cdc generation of string fields?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] fix: Support handling complex data types in convertRowToJsonString fo… [hudi]
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #14351:
URL: https://github.com/apache/hudi/pull/14351#issuecomment-3574605900
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "ab31a1e650c86ec6eea85999aab6b0fd17cf83aa",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "ab31a1e650c86ec6eea85999aab6b0fd17cf83aa",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* ab31a1e650c86ec6eea85999aab6b0fd17cf83aa UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] fix: Support handling complex data types in convertRowToJsonString fo… [hudi]
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #14351:
URL: https://github.com/apache/hudi/pull/14351#issuecomment-3574878711
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "ab31a1e650c86ec6eea85999aab6b0fd17cf83aa",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=9684",
"triggerID" : "ab31a1e650c86ec6eea85999aab6b0fd17cf83aa",
"triggerType" : "PUSH"
}, {
"hash" : "5bdd933581aafce3ddc511b2fab47fea7b76fb6c",
"status" : "PENDING",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=9686",
"triggerID" : "5bdd933581aafce3ddc511b2fab47fea7b76fb6c",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* ab31a1e650c86ec6eea85999aab6b0fd17cf83aa Azure: [FAILURE](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=9684)
* 5bdd933581aafce3ddc511b2fab47fea7b76fb6c Azure: [PENDING](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=9686)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] fix: Support handling complex data types in convertRowToJsonString fo… [hudi]
Posted by "danny0405 (via GitHub)" <gi...@apache.org>.
danny0405 commented on code in PR #14351:
URL: https://github.com/apache/hudi/pull/14351#discussion_r2563863925
##########
hudi-spark-datasource/hudi-spark-common/src/main/scala/org/apache/hudi/cdc/InternalRowToJsonStringConverter.scala:
##########
@@ -36,15 +37,63 @@ class InternalRowToJsonStringConverter(schema: StructType) {
}
def convert(record: InternalRow): UTF8String = {
- val map = scala.collection.mutable.Map.empty[String, Any]
+ // Use LinkedHashMap to preserve field order
+ val map = scala.collection.mutable.LinkedHashMap.empty[String, Any]
schema.zipWithIndex.foreach {
case (field, idx) =>
- if (field.dataType.isInstanceOf[StringType]) {
- map(field.name) = Option(record.getUTF8String(idx)).map(_.toString).orNull
- } else {
- map(field.name) = record.get(idx, field.dataType)
- }
+ map(field.name) = convertField(record.get(idx, field.dataType), field.dataType)
}
UTF8String.fromString(mapper.writeValueAsString(map))
}
+
+ private def convertField(value: Any, dataType: DataType): Any = {
+ if (value == null) {
+ null
+ } else {
+ dataType match {
+ case StringType => value.toString
Review Comment:
we better have a UT or e2e of Spark cdc write/read to valite it works.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] fix: Support handling complex data types in convertRowToJsonString fo… [hudi]
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #14351:
URL: https://github.com/apache/hudi/pull/14351#issuecomment-3580589731
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "ab31a1e650c86ec6eea85999aab6b0fd17cf83aa",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=9684",
"triggerID" : "ab31a1e650c86ec6eea85999aab6b0fd17cf83aa",
"triggerType" : "PUSH"
}, {
"hash" : "5bdd933581aafce3ddc511b2fab47fea7b76fb6c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=9686",
"triggerID" : "5bdd933581aafce3ddc511b2fab47fea7b76fb6c",
"triggerType" : "PUSH"
}, {
"hash" : "ce1aed19d814d379e9aef446eb6088e36a348e29",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=9718",
"triggerID" : "ce1aed19d814d379e9aef446eb6088e36a348e29",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* ce1aed19d814d379e9aef446eb6088e36a348e29 Azure: [FAILURE](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=9718)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] fix: Support handling complex data types in convertRowToJsonString fo… [hudi]
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #14351:
URL: https://github.com/apache/hudi/pull/14351#issuecomment-3580568394
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "ab31a1e650c86ec6eea85999aab6b0fd17cf83aa",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=9684",
"triggerID" : "ab31a1e650c86ec6eea85999aab6b0fd17cf83aa",
"triggerType" : "PUSH"
}, {
"hash" : "5bdd933581aafce3ddc511b2fab47fea7b76fb6c",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=9686",
"triggerID" : "5bdd933581aafce3ddc511b2fab47fea7b76fb6c",
"triggerType" : "PUSH"
}, {
"hash" : "ce1aed19d814d379e9aef446eb6088e36a348e29",
"status" : "PENDING",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=9718",
"triggerID" : "ce1aed19d814d379e9aef446eb6088e36a348e29",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 5bdd933581aafce3ddc511b2fab47fea7b76fb6c Azure: [SUCCESS](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=9686)
* ce1aed19d814d379e9aef446eb6088e36a348e29 Azure: [PENDING](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=9718)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] fix: Support handling complex data types in convertRowToJsonString fo… [hudi]
Posted by "cshuo (via GitHub)" <gi...@apache.org>.
cshuo commented on code in PR #14351:
URL: https://github.com/apache/hudi/pull/14351#discussion_r2563730865
##########
hudi-spark-datasource/hudi-spark-common/src/main/scala/org/apache/hudi/cdc/InternalRowToJsonStringConverter.scala:
##########
@@ -36,15 +37,63 @@ class InternalRowToJsonStringConverter(schema: StructType) {
}
def convert(record: InternalRow): UTF8String = {
- val map = scala.collection.mutable.Map.empty[String, Any]
+ // Use LinkedHashMap to preserve field order
+ val map = scala.collection.mutable.LinkedHashMap.empty[String, Any]
schema.zipWithIndex.foreach {
case (field, idx) =>
- if (field.dataType.isInstanceOf[StringType]) {
- map(field.name) = Option(record.getUTF8String(idx)).map(_.toString).orNull
- } else {
- map(field.name) = record.get(idx, field.dataType)
- }
+ map(field.name) = convertField(record.get(idx, field.dataType), field.dataType)
}
UTF8String.fromString(mapper.writeValueAsString(map))
}
+
+ private def convertField(value: Any, dataType: DataType): Any = {
+ if (value == null) {
+ null
+ } else {
+ dataType match {
+ case StringType => value.toString
Review Comment:
I think there is only an unit test `TestInternalRowToJsonStringConverter` convering the converting logic from internalRow to cdc json string.
##########
hudi-spark-datasource/hudi-spark-common/src/main/scala/org/apache/hudi/cdc/InternalRowToJsonStringConverter.scala:
##########
@@ -36,15 +37,63 @@ class InternalRowToJsonStringConverter(schema: StructType) {
}
def convert(record: InternalRow): UTF8String = {
- val map = scala.collection.mutable.Map.empty[String, Any]
+ // Use LinkedHashMap to preserve field order
+ val map = scala.collection.mutable.LinkedHashMap.empty[String, Any]
schema.zipWithIndex.foreach {
case (field, idx) =>
- if (field.dataType.isInstanceOf[StringType]) {
- map(field.name) = Option(record.getUTF8String(idx)).map(_.toString).orNull
- } else {
- map(field.name) = record.get(idx, field.dataType)
- }
+ map(field.name) = convertField(record.get(idx, field.dataType), field.dataType)
}
UTF8String.fromString(mapper.writeValueAsString(map))
}
+
+ private def convertField(value: Any, dataType: DataType): Any = {
+ if (value == null) {
+ null
+ } else {
+ dataType match {
+ case StringType => value.toString
Review Comment:
I think there is only an unit test `TestInternalRowToJsonStringConverter` covering the converting logic from internalRow to cdc json string.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] fix: Support handling complex data types in convertRowToJsonString fo… [hudi]
Posted by "furquan1993 (via GitHub)" <gi...@apache.org>.
furquan1993 commented on PR #14351:
URL: https://github.com/apache/hudi/pull/14351#issuecomment-3579410706
@cshuo - Can we patch this to 1.0.2?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] fix: Support handling complex data types in convertRowToJsonString fo… [hudi]
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #14351:
URL: https://github.com/apache/hudi/pull/14351#issuecomment-3580963650
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "ab31a1e650c86ec6eea85999aab6b0fd17cf83aa",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=9684",
"triggerID" : "ab31a1e650c86ec6eea85999aab6b0fd17cf83aa",
"triggerType" : "PUSH"
}, {
"hash" : "5bdd933581aafce3ddc511b2fab47fea7b76fb6c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=9686",
"triggerID" : "5bdd933581aafce3ddc511b2fab47fea7b76fb6c",
"triggerType" : "PUSH"
}, {
"hash" : "ce1aed19d814d379e9aef446eb6088e36a348e29",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=9718",
"triggerID" : "ce1aed19d814d379e9aef446eb6088e36a348e29",
"triggerType" : "PUSH"
}, {
"hash" : "856960dd2394856a9645c65b4a6e501835b83ea9",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=9721",
"triggerID" : "856960dd2394856a9645c65b4a6e501835b83ea9",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 856960dd2394856a9645c65b4a6e501835b83ea9 Azure: [FAILURE](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=9721)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] fix: Support handling complex data types in convertRowToJsonString fo… [hudi]
Posted by "cshuo (via GitHub)" <gi...@apache.org>.
cshuo commented on code in PR #14351:
URL: https://github.com/apache/hudi/pull/14351#discussion_r2564309167
##########
hudi-spark-datasource/hudi-spark-common/src/main/scala/org/apache/hudi/cdc/InternalRowToJsonStringConverter.scala:
##########
@@ -36,15 +37,63 @@ class InternalRowToJsonStringConverter(schema: StructType) {
}
def convert(record: InternalRow): UTF8String = {
- val map = scala.collection.mutable.Map.empty[String, Any]
+ // Use LinkedHashMap to preserve field order
+ val map = scala.collection.mutable.LinkedHashMap.empty[String, Any]
schema.zipWithIndex.foreach {
case (field, idx) =>
- if (field.dataType.isInstanceOf[StringType]) {
- map(field.name) = Option(record.getUTF8String(idx)).map(_.toString).orNull
- } else {
- map(field.name) = record.get(idx, field.dataType)
- }
+ map(field.name) = convertField(record.get(idx, field.dataType), field.dataType)
}
UTF8String.fromString(mapper.writeValueAsString(map))
}
+
+ private def convertField(value: Any, dataType: DataType): Any = {
+ if (value == null) {
+ null
+ } else {
+ dataType match {
+ case StringType => value.toString
Review Comment:
ok, will add one
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] fix: Support handling complex data types in convertRowToJsonString fo… [hudi]
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #14351:
URL: https://github.com/apache/hudi/pull/14351#issuecomment-3580562568
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "ab31a1e650c86ec6eea85999aab6b0fd17cf83aa",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=9684",
"triggerID" : "ab31a1e650c86ec6eea85999aab6b0fd17cf83aa",
"triggerType" : "PUSH"
}, {
"hash" : "5bdd933581aafce3ddc511b2fab47fea7b76fb6c",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=9686",
"triggerID" : "5bdd933581aafce3ddc511b2fab47fea7b76fb6c",
"triggerType" : "PUSH"
}, {
"hash" : "ce1aed19d814d379e9aef446eb6088e36a348e29",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "ce1aed19d814d379e9aef446eb6088e36a348e29",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 5bdd933581aafce3ddc511b2fab47fea7b76fb6c Azure: [SUCCESS](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=9686)
* ce1aed19d814d379e9aef446eb6088e36a348e29 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] fix: Support handling complex data types in convertRowToJsonString fo… [hudi]
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #14351:
URL: https://github.com/apache/hudi/pull/14351#issuecomment-3580948550
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "ab31a1e650c86ec6eea85999aab6b0fd17cf83aa",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=9684",
"triggerID" : "ab31a1e650c86ec6eea85999aab6b0fd17cf83aa",
"triggerType" : "PUSH"
}, {
"hash" : "5bdd933581aafce3ddc511b2fab47fea7b76fb6c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=9686",
"triggerID" : "5bdd933581aafce3ddc511b2fab47fea7b76fb6c",
"triggerType" : "PUSH"
}, {
"hash" : "ce1aed19d814d379e9aef446eb6088e36a348e29",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=9718",
"triggerID" : "ce1aed19d814d379e9aef446eb6088e36a348e29",
"triggerType" : "PUSH"
}, {
"hash" : "856960dd2394856a9645c65b4a6e501835b83ea9",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "856960dd2394856a9645c65b4a6e501835b83ea9",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* ce1aed19d814d379e9aef446eb6088e36a348e29 Azure: [FAILURE](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=9718)
* 856960dd2394856a9645c65b4a6e501835b83ea9 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] fix: Support handling complex data types in convertRowToJsonString fo… [hudi]
Posted by "cshuo (via GitHub)" <gi...@apache.org>.
cshuo commented on code in PR #14351:
URL: https://github.com/apache/hudi/pull/14351#discussion_r2563702619
##########
hudi-spark-datasource/hudi-spark-common/src/main/scala/org/apache/hudi/cdc/InternalRowToJsonStringConverter.scala:
##########
@@ -36,15 +37,63 @@ class InternalRowToJsonStringConverter(schema: StructType) {
}
def convert(record: InternalRow): UTF8String = {
- val map = scala.collection.mutable.Map.empty[String, Any]
+ // Use LinkedHashMap to preserve field order
+ val map = scala.collection.mutable.LinkedHashMap.empty[String, Any]
schema.zipWithIndex.foreach {
case (field, idx) =>
- if (field.dataType.isInstanceOf[StringType]) {
- map(field.name) = Option(record.getUTF8String(idx)).map(_.toString).orNull
Review Comment:
there is unit test to cover string type in `TestInternalRowToJsonStringConverter`, and I also checked the cdc output in `TestCDCDataFrameSuite`, the result looks as expected.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] fix: Support handling complex data types in convertRowToJsonString fo… [hudi]
Posted by "danny0405 (via GitHub)" <gi...@apache.org>.
danny0405 merged PR #14351:
URL: https://github.com/apache/hudi/pull/14351
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] fix: Support handling complex data types in convertRowToJsonString fo… [hudi]
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #14351:
URL: https://github.com/apache/hudi/pull/14351#issuecomment-3575290403
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "ab31a1e650c86ec6eea85999aab6b0fd17cf83aa",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=9684",
"triggerID" : "ab31a1e650c86ec6eea85999aab6b0fd17cf83aa",
"triggerType" : "PUSH"
}, {
"hash" : "5bdd933581aafce3ddc511b2fab47fea7b76fb6c",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=9686",
"triggerID" : "5bdd933581aafce3ddc511b2fab47fea7b76fb6c",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 5bdd933581aafce3ddc511b2fab47fea7b76fb6c Azure: [SUCCESS](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=9686)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] fix: Support handling complex data types in convertRowToJsonString fo… [hudi]
Posted by "danny0405 (via GitHub)" <gi...@apache.org>.
danny0405 commented on code in PR #14351:
URL: https://github.com/apache/hudi/pull/14351#discussion_r2563622599
##########
hudi-spark-datasource/hudi-spark-common/src/main/scala/org/apache/hudi/cdc/InternalRowToJsonStringConverter.scala:
##########
@@ -36,15 +37,63 @@ class InternalRowToJsonStringConverter(schema: StructType) {
}
def convert(record: InternalRow): UTF8String = {
- val map = scala.collection.mutable.Map.empty[String, Any]
+ // Use LinkedHashMap to preserve field order
+ val map = scala.collection.mutable.LinkedHashMap.empty[String, Any]
schema.zipWithIndex.foreach {
case (field, idx) =>
- if (field.dataType.isInstanceOf[StringType]) {
- map(field.name) = Option(record.getUTF8String(idx)).map(_.toString).orNull
- } else {
- map(field.name) = record.get(idx, field.dataType)
- }
+ map(field.name) = convertField(record.get(idx, field.dataType), field.dataType)
}
UTF8String.fromString(mapper.writeValueAsString(map))
}
+
+ private def convertField(value: Any, dataType: DataType): Any = {
+ if (value == null) {
+ null
+ } else {
+ dataType match {
+ case StringType => value.toString
Review Comment:
I see the original logic contains this step: `record.getUTF8String(idx)`, is it redundant?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] fix: Support handling complex data types in convertRowToJsonString fo… [hudi]
Posted by "yihua (via GitHub)" <gi...@apache.org>.
yihua commented on code in PR #14351:
URL: https://github.com/apache/hudi/pull/14351#discussion_r2563641829
##########
hudi-spark-datasource/hudi-spark-common/src/main/scala/org/apache/hudi/cdc/InternalRowToJsonStringConverter.scala:
##########
@@ -36,15 +37,63 @@ class InternalRowToJsonStringConverter(schema: StructType) {
}
def convert(record: InternalRow): UTF8String = {
- val map = scala.collection.mutable.Map.empty[String, Any]
+ // Use LinkedHashMap to preserve field order
+ val map = scala.collection.mutable.LinkedHashMap.empty[String, Any]
schema.zipWithIndex.foreach {
case (field, idx) =>
- if (field.dataType.isInstanceOf[StringType]) {
- map(field.name) = Option(record.getUTF8String(idx)).map(_.toString).orNull
Review Comment:
Have you run a functional test on Spark with CDC to verify that `StringType` column still works?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] fix: Support handling complex data types in convertRowToJsonString fo… [hudi]
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #14351:
URL: https://github.com/apache/hudi/pull/14351#issuecomment-3574611497
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "ab31a1e650c86ec6eea85999aab6b0fd17cf83aa",
"status" : "PENDING",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=9684",
"triggerID" : "ab31a1e650c86ec6eea85999aab6b0fd17cf83aa",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* ab31a1e650c86ec6eea85999aab6b0fd17cf83aa Azure: [PENDING](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=9684)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] fix: Support handling complex data types in convertRowToJsonString fo… [hudi]
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #14351:
URL: https://github.com/apache/hudi/pull/14351#issuecomment-3580953683
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "ab31a1e650c86ec6eea85999aab6b0fd17cf83aa",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=9684",
"triggerID" : "ab31a1e650c86ec6eea85999aab6b0fd17cf83aa",
"triggerType" : "PUSH"
}, {
"hash" : "5bdd933581aafce3ddc511b2fab47fea7b76fb6c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=9686",
"triggerID" : "5bdd933581aafce3ddc511b2fab47fea7b76fb6c",
"triggerType" : "PUSH"
}, {
"hash" : "ce1aed19d814d379e9aef446eb6088e36a348e29",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=9718",
"triggerID" : "ce1aed19d814d379e9aef446eb6088e36a348e29",
"triggerType" : "PUSH"
}, {
"hash" : "856960dd2394856a9645c65b4a6e501835b83ea9",
"status" : "PENDING",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=9721",
"triggerID" : "856960dd2394856a9645c65b4a6e501835b83ea9",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* ce1aed19d814d379e9aef446eb6088e36a348e29 Azure: [FAILURE](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=9718)
* 856960dd2394856a9645c65b4a6e501835b83ea9 Azure: [PENDING](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=9721)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] fix: Support handling complex data types in convertRowToJsonString fo… [hudi]
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #14351:
URL: https://github.com/apache/hudi/pull/14351#issuecomment-3574623575
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "ab31a1e650c86ec6eea85999aab6b0fd17cf83aa",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=9684",
"triggerID" : "ab31a1e650c86ec6eea85999aab6b0fd17cf83aa",
"triggerType" : "PUSH"
}, {
"hash" : "5bdd933581aafce3ddc511b2fab47fea7b76fb6c",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "5bdd933581aafce3ddc511b2fab47fea7b76fb6c",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* ab31a1e650c86ec6eea85999aab6b0fd17cf83aa Azure: [FAILURE](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=9684)
* 5bdd933581aafce3ddc511b2fab47fea7b76fb6c UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] fix: Support handling complex data types in convertRowToJsonString fo… [hudi]
Posted by "cshuo (via GitHub)" <gi...@apache.org>.
cshuo commented on code in PR #14351:
URL: https://github.com/apache/hudi/pull/14351#discussion_r2563679488
##########
hudi-spark-datasource/hudi-spark-common/src/main/scala/org/apache/hudi/cdc/InternalRowToJsonStringConverter.scala:
##########
@@ -36,15 +37,63 @@ class InternalRowToJsonStringConverter(schema: StructType) {
}
def convert(record: InternalRow): UTF8String = {
- val map = scala.collection.mutable.Map.empty[String, Any]
+ // Use LinkedHashMap to preserve field order
+ val map = scala.collection.mutable.LinkedHashMap.empty[String, Any]
schema.zipWithIndex.foreach {
case (field, idx) =>
- if (field.dataType.isInstanceOf[StringType]) {
- map(field.name) = Option(record.getUTF8String(idx)).map(_.toString).orNull
- } else {
- map(field.name) = record.get(idx, field.dataType)
- }
+ map(field.name) = convertField(record.get(idx, field.dataType), field.dataType)
}
UTF8String.fromString(mapper.writeValueAsString(map))
}
+
+ private def convertField(value: Any, dataType: DataType): Any = {
+ if (value == null) {
+ null
+ } else {
+ dataType match {
+ case StringType => value.toString
Review Comment:
yeah, we can simply use `record.get(idx, field.dataType)`, and result is Utf8String if the field type is STRING.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] fix: Support handling complex data types in convertRowToJsonString fo… [hudi]
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #14351:
URL: https://github.com/apache/hudi/pull/14351#issuecomment-3581621792
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "ab31a1e650c86ec6eea85999aab6b0fd17cf83aa",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=9684",
"triggerID" : "ab31a1e650c86ec6eea85999aab6b0fd17cf83aa",
"triggerType" : "PUSH"
}, {
"hash" : "5bdd933581aafce3ddc511b2fab47fea7b76fb6c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=9686",
"triggerID" : "5bdd933581aafce3ddc511b2fab47fea7b76fb6c",
"triggerType" : "PUSH"
}, {
"hash" : "ce1aed19d814d379e9aef446eb6088e36a348e29",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=9718",
"triggerID" : "ce1aed19d814d379e9aef446eb6088e36a348e29",
"triggerType" : "PUSH"
}, {
"hash" : "856960dd2394856a9645c65b4a6e501835b83ea9",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=9721",
"triggerID" : "856960dd2394856a9645c65b4a6e501835b83ea9",
"triggerType" : "PUSH"
}, {
"hash" : "285c42649ad2e3da61f96473b810b3d9548b5ed6",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=9722",
"triggerID" : "285c42649ad2e3da61f96473b810b3d9548b5ed6",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 285c42649ad2e3da61f96473b810b3d9548b5ed6 Azure: [SUCCESS](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=9722)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org