You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hudi.apache.org by GitBox <gi...@apache.org> on 2022/09/07 00:38:47 UTC
[GitHub] [hudi] modi95 opened a new pull request, #6616: Add Postgres Schema Name to Postgres Debezium Source
modi95 opened a new pull request, #6616:
URL: https://github.com/apache/hudi/pull/6616
### Change Logs
Add the postgres schema name to the output hudi table when using deltastreamer with postgres debezium source.
### Impact
Add the postgres schema name to the output hudi table when using deltastreamer with postgres debezium source. In most cases (when people aren't using multiple schema in pg), this value will be `public`.
**Risk level: none*
_Choose one. If medium or high, explain what verification was done to mitigate the risks._
### Contributor's checklist
- [x] Read through [contributor's guide](https://hudi.apache.org/contribute/how-to-contribute)
- [x] Change Logs and Impact were stated clearly
- [x] Adequate tests were added if applicable
- [ ] CI passed
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] yihua merged pull request #6616: [HUDI-4833] Add Postgres Schema Name to Postgres Debezium Source
Posted by GitBox <gi...@apache.org>.
yihua merged PR #6616:
URL: https://github.com/apache/hudi/pull/6616
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #6616: Add Postgres Schema Name to Postgres Debezium Source
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #6616:
URL: https://github.com/apache/hudi/pull/6616#issuecomment-1240039218
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "8176e809b4f329e0cfbff75484b3595c69970207",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=11202",
"triggerID" : "8176e809b4f329e0cfbff75484b3595c69970207",
"triggerType" : "PUSH"
}, {
"hash" : "25a5a5c619d56e686e69999fb38e20e841ef9a1e",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=11231",
"triggerID" : "25a5a5c619d56e686e69999fb38e20e841ef9a1e",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 8176e809b4f329e0cfbff75484b3595c69970207 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=11202)
* 25a5a5c619d56e686e69999fb38e20e841ef9a1e Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=11231)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #6616: Add Postgres Schema Name to Postgres Debezium Source
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #6616:
URL: https://github.com/apache/hudi/pull/6616#issuecomment-1238797354
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "8176e809b4f329e0cfbff75484b3595c69970207",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=11202",
"triggerID" : "8176e809b4f329e0cfbff75484b3595c69970207",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 8176e809b4f329e0cfbff75484b3595c69970207 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=11202)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #6616: Add Postgres Schema Name to Postgres Debezium Source
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #6616:
URL: https://github.com/apache/hudi/pull/6616#issuecomment-1238934271
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "8176e809b4f329e0cfbff75484b3595c69970207",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=11202",
"triggerID" : "8176e809b4f329e0cfbff75484b3595c69970207",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 8176e809b4f329e0cfbff75484b3595c69970207 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=11202)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] alexeykudinkin commented on pull request #6616: Add Postgres Schema Name to Postgres Debezium Source
Posted by GitBox <gi...@apache.org>.
alexeykudinkin commented on PR #6616:
URL: https://github.com/apache/hudi/pull/6616#issuecomment-1238800247
@modi95 LGTM
@rmahindra123 can you PTAL as well?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #6616: Add Postgres Schema Name to Postgres Debezium Source
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #6616:
URL: https://github.com/apache/hudi/pull/6616#issuecomment-1240215471
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "8176e809b4f329e0cfbff75484b3595c69970207",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=11202",
"triggerID" : "8176e809b4f329e0cfbff75484b3595c69970207",
"triggerType" : "PUSH"
}, {
"hash" : "25a5a5c619d56e686e69999fb38e20e841ef9a1e",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=11231",
"triggerID" : "25a5a5c619d56e686e69999fb38e20e841ef9a1e",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 25a5a5c619d56e686e69999fb38e20e841ef9a1e Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=11231)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #6616: Add Postgres Schema Name to Postgres Debezium Source
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #6616:
URL: https://github.com/apache/hudi/pull/6616#issuecomment-1238794713
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "8176e809b4f329e0cfbff75484b3595c69970207",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "8176e809b4f329e0cfbff75484b3595c69970207",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 8176e809b4f329e0cfbff75484b3595c69970207 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #6616: Add Postgres Schema Name to Postgres Debezium Source
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #6616:
URL: https://github.com/apache/hudi/pull/6616#issuecomment-1240035379
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "8176e809b4f329e0cfbff75484b3595c69970207",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=11202",
"triggerID" : "8176e809b4f329e0cfbff75484b3595c69970207",
"triggerType" : "PUSH"
}, {
"hash" : "25a5a5c619d56e686e69999fb38e20e841ef9a1e",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "25a5a5c619d56e686e69999fb38e20e841ef9a1e",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 8176e809b4f329e0cfbff75484b3595c69970207 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=11202)
* 25a5a5c619d56e686e69999fb38e20e841ef9a1e UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] yihua commented on pull request #6616: [HUDI-4833] Add Postgres Schema Name to Postgres Debezium Source
Posted by GitBox <gi...@apache.org>.
yihua commented on PR #6616:
URL: https://github.com/apache/hudi/pull/6616#issuecomment-1244706482
LGTM. `source.schema` refers to the field inside the `payload`:
```
"payload": {
"before": null,
"after": {
"id": 1,
"first_name": "Anne",
"last_name": "Kretchmar",
"email": "annek@noanswer.org"
},
"source": {
"version": "1.9.5.Final",
"connector": "postgresql",
"name": "PostgreSQL_server",
"ts_ms": 1559033904863,
"snapshot": true,
"db": "postgres",
"sequence": "[\"24023119\",\"24023128\"]"
"schema": "public",
"table": "customers",
"txId": 555,
"lsn": 24023128,
"xmin": null
},
"op": "c",
"ts_ms": 1559033904863
}
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org