You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hudi.apache.org by "zhuanshenbsj1 (via GitHub)" <gi...@apache.org> on 2024/11/18 09:53:19 UTC
[PR] [HUDI-8538] Log wheather there has data files to be read in stream read [hudi]
zhuanshenbsj1 opened a new pull request, #12278:
URL: https://github.com/apache/hudi/pull/12278
### Change Logs
### Impact
_Describe any public API or user-facing feature change or any performance impact._
### Risk level (write none, low medium or high below)
_If medium or high, explain what verification was done to mitigate the risks._
### Documentation Update
_Describe any necessary documentation update if there is any new feature, config, or user-facing change. If not, put "none"._
- _The config description must be updated if new configs are added or the default value of the configs are changed_
- _Any new feature or user-facing change requires updating the Hudi website. Please create a Jira ticket, attach the
ticket number here and follow the [instruction](https://hudi.apache.org/contribute/developer-setup#website) to make
changes to the website._
### Contributor's checklist
- [ ] Read through [contributor's guide](https://hudi.apache.org/contribute/how-to-contribute)
- [ ] Change Logs and Impact were stated clearly
- [ ] Adequate tests were added if applicable
- [ ] CI passed
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] [HUDI-8538] Log wheather there has data files to be read in stream read [hudi]
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #12278:
URL: https://github.com/apache/hudi/pull/12278#issuecomment-2482468253
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "b99a247363969e977c844023b930c2047cb3286c",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "b99a247363969e977c844023b930c2047cb3286c",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* b99a247363969e977c844023b930c2047cb3286c UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] [MINOR] Log wheather there has data files to be read in stream read [hudi]
Posted by "zhuanshenbsj1 (via GitHub)" <gi...@apache.org>.
zhuanshenbsj1 commented on code in PR #12278:
URL: https://github.com/apache/hudi/pull/12278#discussion_r1846519267
##########
hudi-flink-datasource/hudi-flink/src/main/java/org/apache/hudi/source/StreamReadMonitoringFunction.java:
##########
@@ -234,6 +235,9 @@ public void monitorDirAndForwardSplits(SourceContext<MergeOnReadInputSplit> cont
+ "---------- consumed to instant: {}\n"
+ "------------------------------------------------------------",
conf.getString(FlinkOptions.TABLE_NAME), this.issuedInstant);
+ if (result.isEmpty()) {
+ LOG.warn("In the current round-robin stream read, there are no files to be read in these commits.");
Review Comment:
> And this log is redundant with line 221, we should just keep one of them.
https://github.com/apache/hudi/pull/12166 It can be seen as a reminder for this PR. meaning that although there are some commits for current run, actually no data files available to read.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] [MINOR] Log wheather there has data files to be read in stream read [hudi]
Posted by "danny0405 (via GitHub)" <gi...@apache.org>.
danny0405 commented on code in PR #12278:
URL: https://github.com/apache/hudi/pull/12278#discussion_r1847537677
##########
hudi-flink-datasource/hudi-flink/src/main/java/org/apache/hudi/source/StreamReadMonitoringFunction.java:
##########
@@ -234,6 +235,9 @@ public void monitorDirAndForwardSplits(SourceContext<MergeOnReadInputSplit> cont
+ "---------- consumed to instant: {}\n"
+ "------------------------------------------------------------",
conf.getString(FlinkOptions.TABLE_NAME), this.issuedInstant);
+ if (result.isEmpty()) {
+ LOG.warn("In the current round-robin stream read, there are no files to be read in these commits.");
Review Comment:
Then reports `No new files to read for current run.`
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] [MINOR] Log wheather there has data files to be read in stream read [hudi]
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #12278:
URL: https://github.com/apache/hudi/pull/12278#issuecomment-2482729545
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "b99a247363969e977c844023b930c2047cb3286c",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=1718",
"triggerID" : "b99a247363969e977c844023b930c2047cb3286c",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* b99a247363969e977c844023b930c2047cb3286c Azure: [FAILURE](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=1718)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] [MINOR] Log wheather there has data files to be read in stream read [hudi]
Posted by "zhuanshenbsj1 (via GitHub)" <gi...@apache.org>.
zhuanshenbsj1 commented on code in PR #12278:
URL: https://github.com/apache/hudi/pull/12278#discussion_r1846505922
##########
hudi-flink-datasource/hudi-flink/src/main/java/org/apache/hudi/source/StreamReadMonitoringFunction.java:
##########
@@ -234,6 +235,9 @@ public void monitorDirAndForwardSplits(SourceContext<MergeOnReadInputSplit> cont
+ "---------- consumed to instant: {}\n"
+ "------------------------------------------------------------",
conf.getString(FlinkOptions.TABLE_NAME), this.issuedInstant);
+ if (result.isEmpty()) {
+ LOG.warn("In the current round-robin stream read, there are no files to be read in these commits.");
Review Comment:
> And this log is redundant with line 221, we should just keep one of them.
Line 221 means that there are no commits to read for current run.
Here means there has somes commits to read, but there are no readable data files for these commits(maybe empty commits or alter table commits), and a line of prompt information is given to the user.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] [MINOR] Log wheather there has data files to be read in stream read [hudi]
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #12278:
URL: https://github.com/apache/hudi/pull/12278#issuecomment-2483011211
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "b99a247363969e977c844023b930c2047cb3286c",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=1718",
"triggerID" : "b99a247363969e977c844023b930c2047cb3286c",
"triggerType" : "PUSH"
}, {
"hash" : "3487e44824a8d46553b12d09d9c8c579c471f999",
"status" : "PENDING",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=1724",
"triggerID" : "3487e44824a8d46553b12d09d9c8c579c471f999",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* b99a247363969e977c844023b930c2047cb3286c Azure: [FAILURE](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=1718)
* 3487e44824a8d46553b12d09d9c8c579c471f999 Azure: [PENDING](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=1724)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] [MINOR] Log wheather there has data files to be read in stream read [hudi]
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #12278:
URL: https://github.com/apache/hudi/pull/12278#issuecomment-2483231446
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "b99a247363969e977c844023b930c2047cb3286c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=1718",
"triggerID" : "b99a247363969e977c844023b930c2047cb3286c",
"triggerType" : "PUSH"
}, {
"hash" : "3487e44824a8d46553b12d09d9c8c579c471f999",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=1724",
"triggerID" : "3487e44824a8d46553b12d09d9c8c579c471f999",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 3487e44824a8d46553b12d09d9c8c579c471f999 Azure: [FAILURE](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=1724)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] [MINOR] Log wheather there has data files to be read in stream read [hudi]
Posted by "danny0405 (via GitHub)" <gi...@apache.org>.
danny0405 commented on code in PR #12278:
URL: https://github.com/apache/hudi/pull/12278#discussion_r1846474701
##########
hudi-flink-datasource/hudi-flink/src/main/java/org/apache/hudi/source/StreamReadMonitoringFunction.java:
##########
@@ -234,6 +235,9 @@ public void monitorDirAndForwardSplits(SourceContext<MergeOnReadInputSplit> cont
+ "---------- consumed to instant: {}\n"
+ "------------------------------------------------------------",
conf.getString(FlinkOptions.TABLE_NAME), this.issuedInstant);
+ if (result.isEmpty()) {
+ LOG.warn("In the current round-robin stream read, there are no files to be read in these commits.");
Review Comment:
And this log is redundant with line 221, we should just keep one of them.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] [MINOR] Log wheather there has data files to be read in stream read [hudi]
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #12278:
URL: https://github.com/apache/hudi/pull/12278#issuecomment-2499609828
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "b99a247363969e977c844023b930c2047cb3286c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=1718",
"triggerID" : "b99a247363969e977c844023b930c2047cb3286c",
"triggerType" : "PUSH"
}, {
"hash" : "3487e44824a8d46553b12d09d9c8c579c471f999",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=1724",
"triggerID" : "3487e44824a8d46553b12d09d9c8c579c471f999",
"triggerType" : "PUSH"
}, {
"hash" : "589b887cae1e763cc4d531427c30fa646f3ddd8d",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "589b887cae1e763cc4d531427c30fa646f3ddd8d",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 3487e44824a8d46553b12d09d9c8c579c471f999 Azure: [FAILURE](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=1724)
* 589b887cae1e763cc4d531427c30fa646f3ddd8d UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] [MINOR] Log wheather there has data files to be read in stream read [hudi]
Posted by "zhuanshenbsj1 (via GitHub)" <gi...@apache.org>.
zhuanshenbsj1 commented on code in PR #12278:
URL: https://github.com/apache/hudi/pull/12278#discussion_r1857741414
##########
hudi-flink-datasource/hudi-flink/src/main/java/org/apache/hudi/source/StreamReadMonitoringFunction.java:
##########
@@ -234,6 +235,9 @@ public void monitorDirAndForwardSplits(SourceContext<MergeOnReadInputSplit> cont
+ "---------- consumed to instant: {}\n"
+ "------------------------------------------------------------",
conf.getString(FlinkOptions.TABLE_NAME), this.issuedInstant);
+ if (result.isEmpty()) {
+ LOG.warn("In the current round-robin stream read, there are no files to be read in these commits.");
Review Comment:
> Then reports `No new files to read for current run.`
Done
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] [MINOR] Log wheather there has data files to be read in stream read [hudi]
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #12278:
URL: https://github.com/apache/hudi/pull/12278#issuecomment-2537658115
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "b99a247363969e977c844023b930c2047cb3286c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=1718",
"triggerID" : "b99a247363969e977c844023b930c2047cb3286c",
"triggerType" : "PUSH"
}, {
"hash" : "3487e44824a8d46553b12d09d9c8c579c471f999",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=1724",
"triggerID" : "3487e44824a8d46553b12d09d9c8c579c471f999",
"triggerType" : "PUSH"
}, {
"hash" : "589b887cae1e763cc4d531427c30fa646f3ddd8d",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=1956",
"triggerID" : "589b887cae1e763cc4d531427c30fa646f3ddd8d",
"triggerType" : "PUSH"
}, {
"hash" : "4393803e18a2ef24533c5f5e7774c7d9ebbcc359",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "4393803e18a2ef24533c5f5e7774c7d9ebbcc359",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 589b887cae1e763cc4d531427c30fa646f3ddd8d Azure: [SUCCESS](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=1956)
* 4393803e18a2ef24533c5f5e7774c7d9ebbcc359 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] [MINOR] Log wheather there has data files to be read in stream read [hudi]
Posted by "danny0405 (via GitHub)" <gi...@apache.org>.
danny0405 merged PR #12278:
URL: https://github.com/apache/hudi/pull/12278
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] [MINOR] Log wheather there has data files to be read in stream read [hudi]
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #12278:
URL: https://github.com/apache/hudi/pull/12278#issuecomment-2537660397
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "b99a247363969e977c844023b930c2047cb3286c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=1718",
"triggerID" : "b99a247363969e977c844023b930c2047cb3286c",
"triggerType" : "PUSH"
}, {
"hash" : "3487e44824a8d46553b12d09d9c8c579c471f999",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=1724",
"triggerID" : "3487e44824a8d46553b12d09d9c8c579c471f999",
"triggerType" : "PUSH"
}, {
"hash" : "589b887cae1e763cc4d531427c30fa646f3ddd8d",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=1956",
"triggerID" : "589b887cae1e763cc4d531427c30fa646f3ddd8d",
"triggerType" : "PUSH"
}, {
"hash" : "4393803e18a2ef24533c5f5e7774c7d9ebbcc359",
"status" : "PENDING",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=2371",
"triggerID" : "4393803e18a2ef24533c5f5e7774c7d9ebbcc359",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 589b887cae1e763cc4d531427c30fa646f3ddd8d Azure: [SUCCESS](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=1956)
* 4393803e18a2ef24533c5f5e7774c7d9ebbcc359 Azure: [PENDING](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=2371)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] [HUDI-8538] Log wheather there has data files to be read in stream read [hudi]
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #12278:
URL: https://github.com/apache/hudi/pull/12278#issuecomment-2482474483
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "b99a247363969e977c844023b930c2047cb3286c",
"status" : "PENDING",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=1718",
"triggerID" : "b99a247363969e977c844023b930c2047cb3286c",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* b99a247363969e977c844023b930c2047cb3286c Azure: [PENDING](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=1718)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] [MINOR] Log wheather there has data files to be read in stream read [hudi]
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #12278:
URL: https://github.com/apache/hudi/pull/12278#issuecomment-2483006652
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "b99a247363969e977c844023b930c2047cb3286c",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=1718",
"triggerID" : "b99a247363969e977c844023b930c2047cb3286c",
"triggerType" : "PUSH"
}, {
"hash" : "3487e44824a8d46553b12d09d9c8c579c471f999",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "3487e44824a8d46553b12d09d9c8c579c471f999",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* b99a247363969e977c844023b930c2047cb3286c Azure: [FAILURE](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=1718)
* 3487e44824a8d46553b12d09d9c8c579c471f999 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] [MINOR] Log wheather there has data files to be read in stream read [hudi]
Posted by "danny0405 (via GitHub)" <gi...@apache.org>.
danny0405 commented on code in PR #12278:
URL: https://github.com/apache/hudi/pull/12278#discussion_r1846473659
##########
hudi-flink-datasource/hudi-flink/src/main/java/org/apache/hudi/source/StreamReadMonitoringFunction.java:
##########
@@ -234,6 +235,9 @@ public void monitorDirAndForwardSplits(SourceContext<MergeOnReadInputSplit> cont
+ "---------- consumed to instant: {}\n"
+ "------------------------------------------------------------",
conf.getString(FlinkOptions.TABLE_NAME), this.issuedInstant);
+ if (result.isEmpty()) {
+ LOG.warn("In the current round-robin stream read, there are no files to be read in these commits.");
Review Comment:
Maybe just "No new instants to read for current run."
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] [MINOR] Log wheather there has data files to be read in stream read [hudi]
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #12278:
URL: https://github.com/apache/hudi/pull/12278#issuecomment-2537756446
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "b99a247363969e977c844023b930c2047cb3286c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=1718",
"triggerID" : "b99a247363969e977c844023b930c2047cb3286c",
"triggerType" : "PUSH"
}, {
"hash" : "3487e44824a8d46553b12d09d9c8c579c471f999",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=1724",
"triggerID" : "3487e44824a8d46553b12d09d9c8c579c471f999",
"triggerType" : "PUSH"
}, {
"hash" : "589b887cae1e763cc4d531427c30fa646f3ddd8d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=1956",
"triggerID" : "589b887cae1e763cc4d531427c30fa646f3ddd8d",
"triggerType" : "PUSH"
}, {
"hash" : "4393803e18a2ef24533c5f5e7774c7d9ebbcc359",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=2371",
"triggerID" : "4393803e18a2ef24533c5f5e7774c7d9ebbcc359",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 4393803e18a2ef24533c5f5e7774c7d9ebbcc359 Azure: [SUCCESS](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=2371)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] [MINOR] Log wheather there has data files to be read in stream read [hudi]
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #12278:
URL: https://github.com/apache/hudi/pull/12278#issuecomment-2499611045
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "b99a247363969e977c844023b930c2047cb3286c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=1718",
"triggerID" : "b99a247363969e977c844023b930c2047cb3286c",
"triggerType" : "PUSH"
}, {
"hash" : "3487e44824a8d46553b12d09d9c8c579c471f999",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=1724",
"triggerID" : "3487e44824a8d46553b12d09d9c8c579c471f999",
"triggerType" : "PUSH"
}, {
"hash" : "589b887cae1e763cc4d531427c30fa646f3ddd8d",
"status" : "PENDING",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=1956",
"triggerID" : "589b887cae1e763cc4d531427c30fa646f3ddd8d",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 3487e44824a8d46553b12d09d9c8c579c471f999 Azure: [FAILURE](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=1724)
* 589b887cae1e763cc4d531427c30fa646f3ddd8d Azure: [PENDING](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=1956)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] [MINOR] Log wheather there has data files to be read in stream read [hudi]
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #12278:
URL: https://github.com/apache/hudi/pull/12278#issuecomment-2499691333
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "b99a247363969e977c844023b930c2047cb3286c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=1718",
"triggerID" : "b99a247363969e977c844023b930c2047cb3286c",
"triggerType" : "PUSH"
}, {
"hash" : "3487e44824a8d46553b12d09d9c8c579c471f999",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=1724",
"triggerID" : "3487e44824a8d46553b12d09d9c8c579c471f999",
"triggerType" : "PUSH"
}, {
"hash" : "589b887cae1e763cc4d531427c30fa646f3ddd8d",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=1956",
"triggerID" : "589b887cae1e763cc4d531427c30fa646f3ddd8d",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 589b887cae1e763cc4d531427c30fa646f3ddd8d Azure: [SUCCESS](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=1956)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org