You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hudi.apache.org by GitBox <gi...@apache.org> on 2022/01/11 00:26:59 UTC
[GitHub] [hudi] alexeykudinkin opened a new pull request #4556: [HUDI-3191][Stacked on 4531] Removing duplicating file-listing process w/in Hive's MOR `FIleInputFormat`s
alexeykudinkin opened a new pull request #4556:
URL: https://github.com/apache/hudi/pull/4556
## *Tips*
- *Thank you very much for contributing to Apache Hudi.*
- *Please review https://hudi.apache.org/contribute/how-to-contribute before opening a pull request.*
## What is the purpose of the pull request
*(For example: This pull request adds quick-start document.)*
## Brief change log
*(for example:)*
- *Modify AnnotationLocation checkstyle rule in checkstyle.xml*
## Verify this pull request
*(Please pick either of the following options)*
This pull request is a trivial rework / code cleanup without any test coverage.
*(or)*
This pull request is already covered by existing tests, such as *(please describe tests)*.
(or)
This change added tests and can be verified as follows:
*(example:)*
- *Added integration tests for end-to-end.*
- *Added HoodieClientWriteTest to verify the change.*
- *Manually verified the change by running a job locally.*
## Committer checklist
- [ ] Has a corresponding JIRA in PR title & commit
- [ ] Commit message is descriptive of the change
- [ ] CI is green
- [ ] Necessary doc changes done or have another open PR
- [ ] For large changes, please consider breaking it into sub-tasks under an umbrella JIRA.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #4556: [HUDI-3191] Removing duplicating file-listing process w/in Hive's MOR `FIleInputFormat`s
Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #4556:
URL: https://github.com/apache/hudi/pull/4556#issuecomment-1016893925
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "d87786af43a7aeba7549cc3cfcbd97fc312bee0e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5074",
"triggerID" : "d87786af43a7aeba7549cc3cfcbd97fc312bee0e",
"triggerType" : "PUSH"
}, {
"hash" : "4b87ba1474be575ec27109ccbe626e4c2fc9c224",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5077",
"triggerID" : "4b87ba1474be575ec27109ccbe626e4c2fc9c224",
"triggerType" : "PUSH"
}, {
"hash" : "77d11131baabd1c4e3cc2050337daca4df5f6427",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "77d11131baabd1c4e3cc2050337daca4df5f6427",
"triggerType" : "PUSH"
}, {
"hash" : "3d9c2ae28da858d1e8476052c99391015effb7db",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "3d9c2ae28da858d1e8476052c99391015effb7db",
"triggerType" : "PUSH"
}, {
"hash" : "79ac9affcb7f81497e0df755c8200638d35b02b7",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5081",
"triggerID" : "79ac9affcb7f81497e0df755c8200638d35b02b7",
"triggerType" : "PUSH"
}, {
"hash" : "3c14bbe6c6bcf49c4164c45e82f77b473f4de396",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5113",
"triggerID" : "3c14bbe6c6bcf49c4164c45e82f77b473f4de396",
"triggerType" : "PUSH"
}, {
"hash" : "276f13d6efd00b301b232b286d585729c9d1d26e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5116",
"triggerID" : "276f13d6efd00b301b232b286d585729c9d1d26e",
"triggerType" : "PUSH"
}, {
"hash" : "31b0669d7b638bd65a17b22a2ceb772f2627512c",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "31b0669d7b638bd65a17b22a2ceb772f2627512c",
"triggerType" : "PUSH"
}, {
"hash" : "096e26af39a477ffccbee0edd764493e12e15e71",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5124",
"triggerID" : "096e26af39a477ffccbee0edd764493e12e15e71",
"triggerType" : "PUSH"
}, {
"hash" : "97dd5ec7c9246f6d9f467b9076b790dd6017c5b4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5213",
"triggerID" : "97dd5ec7c9246f6d9f467b9076b790dd6017c5b4",
"triggerType" : "PUSH"
}, {
"hash" : "0538475fe488089c4cb3bc0afb63c2f518329969",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5257",
"triggerID" : "0538475fe488089c4cb3bc0afb63c2f518329969",
"triggerType" : "PUSH"
}, {
"hash" : "9f4b334e340fb26004e1b07fc8fbaaa047c76775",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5261",
"triggerID" : "9f4b334e340fb26004e1b07fc8fbaaa047c76775",
"triggerType" : "PUSH"
}, {
"hash" : "368c099820c3cbf57496d0e46d1858aa8eb153ee",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5330",
"triggerID" : "368c099820c3cbf57496d0e46d1858aa8eb153ee",
"triggerType" : "PUSH"
}, {
"hash" : "28a5a4f537544d35dfcd8700a7b97fb7216682ce",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "28a5a4f537544d35dfcd8700a7b97fb7216682ce",
"triggerType" : "PUSH"
}, {
"hash" : "08ffdd8b47d147c9b5c889a5f56e39b9b140612d",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "08ffdd8b47d147c9b5c889a5f56e39b9b140612d",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 77d11131baabd1c4e3cc2050337daca4df5f6427 UNKNOWN
* 3d9c2ae28da858d1e8476052c99391015effb7db UNKNOWN
* 31b0669d7b638bd65a17b22a2ceb772f2627512c UNKNOWN
* 368c099820c3cbf57496d0e46d1858aa8eb153ee Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5330)
* 28a5a4f537544d35dfcd8700a7b97fb7216682ce UNKNOWN
* 08ffdd8b47d147c9b5c889a5f56e39b9b140612d UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #4556: [HUDI-3191][Stacked on 4531] Removing duplicating file-listing process w/in Hive's MOR `FIleInputFormat`s
Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #4556:
URL: https://github.com/apache/hudi/pull/4556#issuecomment-1012681460
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "d87786af43a7aeba7549cc3cfcbd97fc312bee0e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5074",
"triggerID" : "d87786af43a7aeba7549cc3cfcbd97fc312bee0e",
"triggerType" : "PUSH"
}, {
"hash" : "4b87ba1474be575ec27109ccbe626e4c2fc9c224",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5077",
"triggerID" : "4b87ba1474be575ec27109ccbe626e4c2fc9c224",
"triggerType" : "PUSH"
}, {
"hash" : "77d11131baabd1c4e3cc2050337daca4df5f6427",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "77d11131baabd1c4e3cc2050337daca4df5f6427",
"triggerType" : "PUSH"
}, {
"hash" : "3d9c2ae28da858d1e8476052c99391015effb7db",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "3d9c2ae28da858d1e8476052c99391015effb7db",
"triggerType" : "PUSH"
}, {
"hash" : "79ac9affcb7f81497e0df755c8200638d35b02b7",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5081",
"triggerID" : "79ac9affcb7f81497e0df755c8200638d35b02b7",
"triggerType" : "PUSH"
}, {
"hash" : "3c14bbe6c6bcf49c4164c45e82f77b473f4de396",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5113",
"triggerID" : "3c14bbe6c6bcf49c4164c45e82f77b473f4de396",
"triggerType" : "PUSH"
}, {
"hash" : "276f13d6efd00b301b232b286d585729c9d1d26e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5116",
"triggerID" : "276f13d6efd00b301b232b286d585729c9d1d26e",
"triggerType" : "PUSH"
}, {
"hash" : "31b0669d7b638bd65a17b22a2ceb772f2627512c",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "31b0669d7b638bd65a17b22a2ceb772f2627512c",
"triggerType" : "PUSH"
}, {
"hash" : "096e26af39a477ffccbee0edd764493e12e15e71",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5124",
"triggerID" : "096e26af39a477ffccbee0edd764493e12e15e71",
"triggerType" : "PUSH"
}, {
"hash" : "97dd5ec7c9246f6d9f467b9076b790dd6017c5b4",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "97dd5ec7c9246f6d9f467b9076b790dd6017c5b4",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 77d11131baabd1c4e3cc2050337daca4df5f6427 UNKNOWN
* 3d9c2ae28da858d1e8476052c99391015effb7db UNKNOWN
* 31b0669d7b638bd65a17b22a2ceb772f2627512c UNKNOWN
* 096e26af39a477ffccbee0edd764493e12e15e71 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5124)
* 97dd5ec7c9246f6d9f467b9076b790dd6017c5b4 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #4556: [HUDI-3191][Stacked on 4531] Removing duplicating file-listing process w/in Hive's MOR `FIleInputFormat`s
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #4556:
URL: https://github.com/apache/hudi/pull/4556#issuecomment-1013380867
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "d87786af43a7aeba7549cc3cfcbd97fc312bee0e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5074",
"triggerID" : "d87786af43a7aeba7549cc3cfcbd97fc312bee0e",
"triggerType" : "PUSH"
}, {
"hash" : "4b87ba1474be575ec27109ccbe626e4c2fc9c224",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5077",
"triggerID" : "4b87ba1474be575ec27109ccbe626e4c2fc9c224",
"triggerType" : "PUSH"
}, {
"hash" : "77d11131baabd1c4e3cc2050337daca4df5f6427",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "77d11131baabd1c4e3cc2050337daca4df5f6427",
"triggerType" : "PUSH"
}, {
"hash" : "3d9c2ae28da858d1e8476052c99391015effb7db",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "3d9c2ae28da858d1e8476052c99391015effb7db",
"triggerType" : "PUSH"
}, {
"hash" : "79ac9affcb7f81497e0df755c8200638d35b02b7",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5081",
"triggerID" : "79ac9affcb7f81497e0df755c8200638d35b02b7",
"triggerType" : "PUSH"
}, {
"hash" : "3c14bbe6c6bcf49c4164c45e82f77b473f4de396",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5113",
"triggerID" : "3c14bbe6c6bcf49c4164c45e82f77b473f4de396",
"triggerType" : "PUSH"
}, {
"hash" : "276f13d6efd00b301b232b286d585729c9d1d26e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5116",
"triggerID" : "276f13d6efd00b301b232b286d585729c9d1d26e",
"triggerType" : "PUSH"
}, {
"hash" : "31b0669d7b638bd65a17b22a2ceb772f2627512c",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "31b0669d7b638bd65a17b22a2ceb772f2627512c",
"triggerType" : "PUSH"
}, {
"hash" : "096e26af39a477ffccbee0edd764493e12e15e71",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5124",
"triggerID" : "096e26af39a477ffccbee0edd764493e12e15e71",
"triggerType" : "PUSH"
}, {
"hash" : "97dd5ec7c9246f6d9f467b9076b790dd6017c5b4",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5213",
"triggerID" : "97dd5ec7c9246f6d9f467b9076b790dd6017c5b4",
"triggerType" : "PUSH"
}, {
"hash" : "0538475fe488089c4cb3bc0afb63c2f518329969",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5257",
"triggerID" : "0538475fe488089c4cb3bc0afb63c2f518329969",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 77d11131baabd1c4e3cc2050337daca4df5f6427 UNKNOWN
* 3d9c2ae28da858d1e8476052c99391015effb7db UNKNOWN
* 31b0669d7b638bd65a17b22a2ceb772f2627512c UNKNOWN
* 97dd5ec7c9246f6d9f467b9076b790dd6017c5b4 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5213)
* 0538475fe488089c4cb3bc0afb63c2f518329969 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5257)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] yihua commented on a change in pull request #4556: [HUDI-3191] Removing duplicating file-listing process w/in Hive's MOR `FileInputFormat`s
Posted by GitBox <gi...@apache.org>.
yihua commented on a change in pull request #4556:
URL: https://github.com/apache/hudi/pull/4556#discussion_r791316580
##########
File path: hudi-hadoop-mr/src/main/java/org/apache/hudi/hadoop/HoodieFileInputFormatBase.java
##########
@@ -187,13 +286,28 @@ private static FileStatus getFileStatusUnchecked(Option<HoodieBaseFile> baseFile
.map(fileSlice -> {
Option<HoodieBaseFile> baseFileOpt = fileSlice.getBaseFile();
Option<HoodieLogFile> latestLogFileOpt = fileSlice.getLatestLogFile();
- if (baseFileOpt.isPresent()) {
- return getFileStatusUnchecked(baseFileOpt);
- } else if (includeLogFilesForSnapShotView() && latestLogFileOpt.isPresent()) {
- return createRealtimeFileStatusUnchecked(latestLogFileOpt.get(), fileSlice.getLogFiles());
+ Stream<HoodieLogFile> logFiles = fileSlice.getLogFiles();
+
+ Option<HoodieInstant> latestCompletedInstantOpt =
+ fromScala(fileIndex.latestCompletedInstant());
+
+ // Check if we're reading a MOR table
+ if (includeLogFilesForSnapshotView()) {
+ if (baseFileOpt.isPresent()) {
+ return createRealtimeFileStatusUnchecked(baseFileOpt.get(), logFiles, latestCompletedInstantOpt, tableMetaClient);
+ } else if (latestLogFileOpt.isPresent()) {
+ return createRealtimeFileStatusUnchecked(latestLogFileOpt.get(), logFiles, latestCompletedInstantOpt, tableMetaClient);
+ } else {
+ throw new IllegalStateException("Invalid state: either base-file or log-file has to be present");
+ }
} else {
- throw new IllegalStateException("Invalid state: either base-file or log-file should be present");
+ if (baseFileOpt.isPresent()) {
+ return getFileStatusUnchecked(baseFileOpt.get());
+ } else {
+ throw new IllegalStateException("Invalid state: base-file has to be present");
+ }
}
Review comment:
To clarify, for Snapshot query on MOR table, we do need the merging of base file and log files. For Snapshot query on COW table, only base file is needed. I think that is your intention of changes here.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] nsivabalan commented on a change in pull request #4556: [HUDI-3191] Removing duplicating file-listing process w/in Hive's MOR `FileInputFormat`s
Posted by GitBox <gi...@apache.org>.
nsivabalan commented on a change in pull request #4556:
URL: https://github.com/apache/hudi/pull/4556#discussion_r798155468
##########
File path: hudi-hadoop-mr/src/main/java/org/apache/hudi/hadoop/utils/HoodieRealtimeInputFormatUtils.java
##########
@@ -65,11 +65,70 @@
import java.util.stream.Collectors;
import java.util.stream.Stream;
+import static org.apache.hudi.TypeUtils.unsafeCast;
+import static org.apache.hudi.common.util.ValidationUtils.checkState;
+
public class HoodieRealtimeInputFormatUtils extends HoodieInputFormatUtils {
private static final Logger LOG = LogManager.getLogger(HoodieRealtimeInputFormatUtils.class);
- public static InputSplit[] getRealtimeSplits(Configuration conf, Stream<FileSplit> fileSplits) {
+ public static InputSplit[] getRealtimeSplits(Configuration conf, List<FileSplit> fileSplits) throws IOException {
+ if (fileSplits.isEmpty()) {
+ return new InputSplit[0];
+ }
+
+ FileSplit fileSplit = fileSplits.get(0);
+
+ // Pre-process table-config to fetch virtual key info
+ Path partitionPath = fileSplit.getPath().getParent();
+ HoodieTableMetaClient metaClient = getTableMetaClientForBasePathUnchecked(conf, partitionPath);
+
+ Option<HoodieVirtualKeyInfo> hoodieVirtualKeyInfoOpt = getHoodieVirtualKeyInfo(metaClient);
+
+ // NOTE: This timeline is kept in sync w/ {@code HoodieTableFileIndexBase}
+ HoodieInstant latestCommitInstant =
+ metaClient.getActiveTimeline().getCommitsTimeline().filterCompletedInstants().lastInstant().get();
+
+ InputSplit[] finalSplits = fileSplits.stream()
+ .map(split -> {
+ // There are 4 types of splits could we have to handle here
+ // - {@code BootstrapBaseFileSplit}: in case base file does have associated bootstrap file,
+ // but does NOT have any log files appended (convert it to {@code RealtimeBootstrapBaseFileSplit})
+ // - {@code RealtimeBootstrapBaseFileSplit}: in case base file does have associated bootstrap file
+ // and does have log files appended
+ // - {@code BaseFileWithLogsSplit}: in case base file does NOT have associated bootstrap file
+ // and does have log files appended;
+ // - {@code FileSplit}: in case Hive passed down non-Hudi path
+ if (split instanceof RealtimeBootstrapBaseFileSplit) {
+ return split;
+ } else if (split instanceof BootstrapBaseFileSplit) {
+ BootstrapBaseFileSplit bootstrapBaseFileSplit = unsafeCast(split);
+ return createRealtimeBoostrapBaseFileSplit(
+ bootstrapBaseFileSplit,
+ metaClient.getBasePath(),
+ Collections.emptyList(),
+ latestCommitInstant.getTimestamp(),
+ false);
+ } else if (split instanceof BaseFileWithLogsSplit) {
+ BaseFileWithLogsSplit baseFileWithLogsSplit = unsafeCast(split);
Review comment:
does the maxCommitTime in baseFileSplit will be in sync with latestCommitInstant computed at L89. Prior to this patch, use the latestCommitInstant computed here, where as now, we just reuse the same thats comes from BaseFileWithLogsSplit.
Just wanted to confirm as these are new code to me.
##########
File path: hudi-hadoop-mr/src/main/java/org/apache/hudi/hadoop/utils/HoodieRealtimeInputFormatUtils.java
##########
@@ -65,11 +65,70 @@
import java.util.stream.Collectors;
import java.util.stream.Stream;
+import static org.apache.hudi.TypeUtils.unsafeCast;
+import static org.apache.hudi.common.util.ValidationUtils.checkState;
+
public class HoodieRealtimeInputFormatUtils extends HoodieInputFormatUtils {
private static final Logger LOG = LogManager.getLogger(HoodieRealtimeInputFormatUtils.class);
- public static InputSplit[] getRealtimeSplits(Configuration conf, Stream<FileSplit> fileSplits) {
+ public static InputSplit[] getRealtimeSplits(Configuration conf, List<FileSplit> fileSplits) throws IOException {
Review comment:
this refactoring makes total sense assuming each FileSplit will correspond to one FileSlice. and there won't be a case where multiple FileSplits can store info about a single FileSlice.
thanks for doing this.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #4556: [HUDI-3191] Removing duplicating file-listing process w/in Hive's MOR `FileInputFormat`s
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #4556:
URL: https://github.com/apache/hudi/pull/4556#issuecomment-1028513791
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "d87786af43a7aeba7549cc3cfcbd97fc312bee0e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5074",
"triggerID" : "d87786af43a7aeba7549cc3cfcbd97fc312bee0e",
"triggerType" : "PUSH"
}, {
"hash" : "4b87ba1474be575ec27109ccbe626e4c2fc9c224",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5077",
"triggerID" : "4b87ba1474be575ec27109ccbe626e4c2fc9c224",
"triggerType" : "PUSH"
}, {
"hash" : "77d11131baabd1c4e3cc2050337daca4df5f6427",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "77d11131baabd1c4e3cc2050337daca4df5f6427",
"triggerType" : "PUSH"
}, {
"hash" : "3d9c2ae28da858d1e8476052c99391015effb7db",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "3d9c2ae28da858d1e8476052c99391015effb7db",
"triggerType" : "PUSH"
}, {
"hash" : "79ac9affcb7f81497e0df755c8200638d35b02b7",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5081",
"triggerID" : "79ac9affcb7f81497e0df755c8200638d35b02b7",
"triggerType" : "PUSH"
}, {
"hash" : "3c14bbe6c6bcf49c4164c45e82f77b473f4de396",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5113",
"triggerID" : "3c14bbe6c6bcf49c4164c45e82f77b473f4de396",
"triggerType" : "PUSH"
}, {
"hash" : "276f13d6efd00b301b232b286d585729c9d1d26e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5116",
"triggerID" : "276f13d6efd00b301b232b286d585729c9d1d26e",
"triggerType" : "PUSH"
}, {
"hash" : "31b0669d7b638bd65a17b22a2ceb772f2627512c",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "31b0669d7b638bd65a17b22a2ceb772f2627512c",
"triggerType" : "PUSH"
}, {
"hash" : "096e26af39a477ffccbee0edd764493e12e15e71",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5124",
"triggerID" : "096e26af39a477ffccbee0edd764493e12e15e71",
"triggerType" : "PUSH"
}, {
"hash" : "97dd5ec7c9246f6d9f467b9076b790dd6017c5b4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5213",
"triggerID" : "97dd5ec7c9246f6d9f467b9076b790dd6017c5b4",
"triggerType" : "PUSH"
}, {
"hash" : "0538475fe488089c4cb3bc0afb63c2f518329969",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5257",
"triggerID" : "0538475fe488089c4cb3bc0afb63c2f518329969",
"triggerType" : "PUSH"
}, {
"hash" : "9f4b334e340fb26004e1b07fc8fbaaa047c76775",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5261",
"triggerID" : "9f4b334e340fb26004e1b07fc8fbaaa047c76775",
"triggerType" : "PUSH"
}, {
"hash" : "368c099820c3cbf57496d0e46d1858aa8eb153ee",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5330",
"triggerID" : "368c099820c3cbf57496d0e46d1858aa8eb153ee",
"triggerType" : "PUSH"
}, {
"hash" : "28a5a4f537544d35dfcd8700a7b97fb7216682ce",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "28a5a4f537544d35dfcd8700a7b97fb7216682ce",
"triggerType" : "PUSH"
}, {
"hash" : "08ffdd8b47d147c9b5c889a5f56e39b9b140612d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5351",
"triggerID" : "08ffdd8b47d147c9b5c889a5f56e39b9b140612d",
"triggerType" : "PUSH"
}, {
"hash" : "c09e228f7cce78a7dbbc394e93b3cf8c6c3d4d5f",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "c09e228f7cce78a7dbbc394e93b3cf8c6c3d4d5f",
"triggerType" : "PUSH"
}, {
"hash" : "8dadbf672d4d27505592f18bc89422fd7c013669",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5398",
"triggerID" : "8dadbf672d4d27505592f18bc89422fd7c013669",
"triggerType" : "PUSH"
}, {
"hash" : "906607be5bd62ee1cbbda34acb6a89916c1f7aee",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5424",
"triggerID" : "906607be5bd62ee1cbbda34acb6a89916c1f7aee",
"triggerType" : "PUSH"
}, {
"hash" : "dc1b033f40cea9642f71b8fcff74aa82106726b6",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5484",
"triggerID" : "dc1b033f40cea9642f71b8fcff74aa82106726b6",
"triggerType" : "PUSH"
}, {
"hash" : "5b8f5819fff8fec34864eb409fd429b95be17b9b",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "5b8f5819fff8fec34864eb409fd429b95be17b9b",
"triggerType" : "PUSH"
}, {
"hash" : "13702fc2232ebd9300966b0a917a3358d8d0f18c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5590",
"triggerID" : "13702fc2232ebd9300966b0a917a3358d8d0f18c",
"triggerType" : "PUSH"
}, {
"hash" : "13702fc2232ebd9300966b0a917a3358d8d0f18c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5600",
"triggerID" : "1024845655",
"triggerType" : "MANUAL"
}, {
"hash" : "9bdd8a60f95123f82a5f30f5e68929f5b7e1f8da",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5603",
"triggerID" : "9bdd8a60f95123f82a5f30f5e68929f5b7e1f8da",
"triggerType" : "PUSH"
}, {
"hash" : "aebb9df557c4afe3ca88f6b8b28ba2fbfdcbd597",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5631",
"triggerID" : "aebb9df557c4afe3ca88f6b8b28ba2fbfdcbd597",
"triggerType" : "PUSH"
}, {
"hash" : "5d37935bc8bb33260735d782ca560fd59e02f321",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "5d37935bc8bb33260735d782ca560fd59e02f321",
"triggerType" : "PUSH"
}, {
"hash" : "f911d869f50009e5cd9f3fd341c83c732d7531ba",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5634",
"triggerID" : "f911d869f50009e5cd9f3fd341c83c732d7531ba",
"triggerType" : "PUSH"
}, {
"hash" : "f911d869f50009e5cd9f3fd341c83c732d7531ba",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5657",
"triggerID" : "1027051107",
"triggerType" : "MANUAL"
}, {
"hash" : "f911d869f50009e5cd9f3fd341c83c732d7531ba",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5659",
"triggerID" : "1027166086",
"triggerType" : "MANUAL"
}, {
"hash" : "f911d869f50009e5cd9f3fd341c83c732d7531ba",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5665",
"triggerID" : "1027387044",
"triggerType" : "MANUAL"
}, {
"hash" : "34b94b96b03109555201092bfabce21793add437",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5689",
"triggerID" : "34b94b96b03109555201092bfabce21793add437",
"triggerType" : "PUSH"
}, {
"hash" : "7f793744421a5ee304d5dff89d23e1e925bfd1cb",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5692",
"triggerID" : "7f793744421a5ee304d5dff89d23e1e925bfd1cb",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 77d11131baabd1c4e3cc2050337daca4df5f6427 UNKNOWN
* 3d9c2ae28da858d1e8476052c99391015effb7db UNKNOWN
* 31b0669d7b638bd65a17b22a2ceb772f2627512c UNKNOWN
* 28a5a4f537544d35dfcd8700a7b97fb7216682ce UNKNOWN
* c09e228f7cce78a7dbbc394e93b3cf8c6c3d4d5f UNKNOWN
* 5b8f5819fff8fec34864eb409fd429b95be17b9b UNKNOWN
* 5d37935bc8bb33260735d782ca560fd59e02f321 UNKNOWN
* 7f793744421a5ee304d5dff89d23e1e925bfd1cb Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5692)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #4556: [HUDI-3191][Stacked on 4716] Removing duplicating file-listing process w/in Hive's MOR `FileInputFormat`s
Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #4556:
URL: https://github.com/apache/hudi/pull/4556#issuecomment-1024801588
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "d87786af43a7aeba7549cc3cfcbd97fc312bee0e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5074",
"triggerID" : "d87786af43a7aeba7549cc3cfcbd97fc312bee0e",
"triggerType" : "PUSH"
}, {
"hash" : "4b87ba1474be575ec27109ccbe626e4c2fc9c224",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5077",
"triggerID" : "4b87ba1474be575ec27109ccbe626e4c2fc9c224",
"triggerType" : "PUSH"
}, {
"hash" : "77d11131baabd1c4e3cc2050337daca4df5f6427",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "77d11131baabd1c4e3cc2050337daca4df5f6427",
"triggerType" : "PUSH"
}, {
"hash" : "3d9c2ae28da858d1e8476052c99391015effb7db",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "3d9c2ae28da858d1e8476052c99391015effb7db",
"triggerType" : "PUSH"
}, {
"hash" : "79ac9affcb7f81497e0df755c8200638d35b02b7",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5081",
"triggerID" : "79ac9affcb7f81497e0df755c8200638d35b02b7",
"triggerType" : "PUSH"
}, {
"hash" : "3c14bbe6c6bcf49c4164c45e82f77b473f4de396",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5113",
"triggerID" : "3c14bbe6c6bcf49c4164c45e82f77b473f4de396",
"triggerType" : "PUSH"
}, {
"hash" : "276f13d6efd00b301b232b286d585729c9d1d26e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5116",
"triggerID" : "276f13d6efd00b301b232b286d585729c9d1d26e",
"triggerType" : "PUSH"
}, {
"hash" : "31b0669d7b638bd65a17b22a2ceb772f2627512c",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "31b0669d7b638bd65a17b22a2ceb772f2627512c",
"triggerType" : "PUSH"
}, {
"hash" : "096e26af39a477ffccbee0edd764493e12e15e71",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5124",
"triggerID" : "096e26af39a477ffccbee0edd764493e12e15e71",
"triggerType" : "PUSH"
}, {
"hash" : "97dd5ec7c9246f6d9f467b9076b790dd6017c5b4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5213",
"triggerID" : "97dd5ec7c9246f6d9f467b9076b790dd6017c5b4",
"triggerType" : "PUSH"
}, {
"hash" : "0538475fe488089c4cb3bc0afb63c2f518329969",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5257",
"triggerID" : "0538475fe488089c4cb3bc0afb63c2f518329969",
"triggerType" : "PUSH"
}, {
"hash" : "9f4b334e340fb26004e1b07fc8fbaaa047c76775",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5261",
"triggerID" : "9f4b334e340fb26004e1b07fc8fbaaa047c76775",
"triggerType" : "PUSH"
}, {
"hash" : "368c099820c3cbf57496d0e46d1858aa8eb153ee",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5330",
"triggerID" : "368c099820c3cbf57496d0e46d1858aa8eb153ee",
"triggerType" : "PUSH"
}, {
"hash" : "28a5a4f537544d35dfcd8700a7b97fb7216682ce",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "28a5a4f537544d35dfcd8700a7b97fb7216682ce",
"triggerType" : "PUSH"
}, {
"hash" : "08ffdd8b47d147c9b5c889a5f56e39b9b140612d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5351",
"triggerID" : "08ffdd8b47d147c9b5c889a5f56e39b9b140612d",
"triggerType" : "PUSH"
}, {
"hash" : "c09e228f7cce78a7dbbc394e93b3cf8c6c3d4d5f",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "c09e228f7cce78a7dbbc394e93b3cf8c6c3d4d5f",
"triggerType" : "PUSH"
}, {
"hash" : "8dadbf672d4d27505592f18bc89422fd7c013669",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5398",
"triggerID" : "8dadbf672d4d27505592f18bc89422fd7c013669",
"triggerType" : "PUSH"
}, {
"hash" : "906607be5bd62ee1cbbda34acb6a89916c1f7aee",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5424",
"triggerID" : "906607be5bd62ee1cbbda34acb6a89916c1f7aee",
"triggerType" : "PUSH"
}, {
"hash" : "dc1b033f40cea9642f71b8fcff74aa82106726b6",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5484",
"triggerID" : "dc1b033f40cea9642f71b8fcff74aa82106726b6",
"triggerType" : "PUSH"
}, {
"hash" : "5b8f5819fff8fec34864eb409fd429b95be17b9b",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "5b8f5819fff8fec34864eb409fd429b95be17b9b",
"triggerType" : "PUSH"
}, {
"hash" : "13702fc2232ebd9300966b0a917a3358d8d0f18c",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "13702fc2232ebd9300966b0a917a3358d8d0f18c",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 77d11131baabd1c4e3cc2050337daca4df5f6427 UNKNOWN
* 3d9c2ae28da858d1e8476052c99391015effb7db UNKNOWN
* 31b0669d7b638bd65a17b22a2ceb772f2627512c UNKNOWN
* 28a5a4f537544d35dfcd8700a7b97fb7216682ce UNKNOWN
* c09e228f7cce78a7dbbc394e93b3cf8c6c3d4d5f UNKNOWN
* dc1b033f40cea9642f71b8fcff74aa82106726b6 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5484)
* 5b8f5819fff8fec34864eb409fd429b95be17b9b UNKNOWN
* 13702fc2232ebd9300966b0a917a3358d8d0f18c UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #4556: [HUDI-3191][Stacked on 4716] Removing duplicating file-listing process w/in Hive's MOR `FileInputFormat`s
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #4556:
URL: https://github.com/apache/hudi/pull/4556#issuecomment-1024845763
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "d87786af43a7aeba7549cc3cfcbd97fc312bee0e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5074",
"triggerID" : "d87786af43a7aeba7549cc3cfcbd97fc312bee0e",
"triggerType" : "PUSH"
}, {
"hash" : "4b87ba1474be575ec27109ccbe626e4c2fc9c224",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5077",
"triggerID" : "4b87ba1474be575ec27109ccbe626e4c2fc9c224",
"triggerType" : "PUSH"
}, {
"hash" : "77d11131baabd1c4e3cc2050337daca4df5f6427",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "77d11131baabd1c4e3cc2050337daca4df5f6427",
"triggerType" : "PUSH"
}, {
"hash" : "3d9c2ae28da858d1e8476052c99391015effb7db",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "3d9c2ae28da858d1e8476052c99391015effb7db",
"triggerType" : "PUSH"
}, {
"hash" : "79ac9affcb7f81497e0df755c8200638d35b02b7",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5081",
"triggerID" : "79ac9affcb7f81497e0df755c8200638d35b02b7",
"triggerType" : "PUSH"
}, {
"hash" : "3c14bbe6c6bcf49c4164c45e82f77b473f4de396",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5113",
"triggerID" : "3c14bbe6c6bcf49c4164c45e82f77b473f4de396",
"triggerType" : "PUSH"
}, {
"hash" : "276f13d6efd00b301b232b286d585729c9d1d26e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5116",
"triggerID" : "276f13d6efd00b301b232b286d585729c9d1d26e",
"triggerType" : "PUSH"
}, {
"hash" : "31b0669d7b638bd65a17b22a2ceb772f2627512c",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "31b0669d7b638bd65a17b22a2ceb772f2627512c",
"triggerType" : "PUSH"
}, {
"hash" : "096e26af39a477ffccbee0edd764493e12e15e71",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5124",
"triggerID" : "096e26af39a477ffccbee0edd764493e12e15e71",
"triggerType" : "PUSH"
}, {
"hash" : "97dd5ec7c9246f6d9f467b9076b790dd6017c5b4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5213",
"triggerID" : "97dd5ec7c9246f6d9f467b9076b790dd6017c5b4",
"triggerType" : "PUSH"
}, {
"hash" : "0538475fe488089c4cb3bc0afb63c2f518329969",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5257",
"triggerID" : "0538475fe488089c4cb3bc0afb63c2f518329969",
"triggerType" : "PUSH"
}, {
"hash" : "9f4b334e340fb26004e1b07fc8fbaaa047c76775",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5261",
"triggerID" : "9f4b334e340fb26004e1b07fc8fbaaa047c76775",
"triggerType" : "PUSH"
}, {
"hash" : "368c099820c3cbf57496d0e46d1858aa8eb153ee",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5330",
"triggerID" : "368c099820c3cbf57496d0e46d1858aa8eb153ee",
"triggerType" : "PUSH"
}, {
"hash" : "28a5a4f537544d35dfcd8700a7b97fb7216682ce",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "28a5a4f537544d35dfcd8700a7b97fb7216682ce",
"triggerType" : "PUSH"
}, {
"hash" : "08ffdd8b47d147c9b5c889a5f56e39b9b140612d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5351",
"triggerID" : "08ffdd8b47d147c9b5c889a5f56e39b9b140612d",
"triggerType" : "PUSH"
}, {
"hash" : "c09e228f7cce78a7dbbc394e93b3cf8c6c3d4d5f",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "c09e228f7cce78a7dbbc394e93b3cf8c6c3d4d5f",
"triggerType" : "PUSH"
}, {
"hash" : "8dadbf672d4d27505592f18bc89422fd7c013669",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5398",
"triggerID" : "8dadbf672d4d27505592f18bc89422fd7c013669",
"triggerType" : "PUSH"
}, {
"hash" : "906607be5bd62ee1cbbda34acb6a89916c1f7aee",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5424",
"triggerID" : "906607be5bd62ee1cbbda34acb6a89916c1f7aee",
"triggerType" : "PUSH"
}, {
"hash" : "dc1b033f40cea9642f71b8fcff74aa82106726b6",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5484",
"triggerID" : "dc1b033f40cea9642f71b8fcff74aa82106726b6",
"triggerType" : "PUSH"
}, {
"hash" : "5b8f5819fff8fec34864eb409fd429b95be17b9b",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "5b8f5819fff8fec34864eb409fd429b95be17b9b",
"triggerType" : "PUSH"
}, {
"hash" : "13702fc2232ebd9300966b0a917a3358d8d0f18c",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5590",
"triggerID" : "13702fc2232ebd9300966b0a917a3358d8d0f18c",
"triggerType" : "PUSH"
}, {
"hash" : "13702fc2232ebd9300966b0a917a3358d8d0f18c",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5600",
"triggerID" : "1024845655",
"triggerType" : "MANUAL"
} ]
}-->
## CI report:
* 77d11131baabd1c4e3cc2050337daca4df5f6427 UNKNOWN
* 3d9c2ae28da858d1e8476052c99391015effb7db UNKNOWN
* 31b0669d7b638bd65a17b22a2ceb772f2627512c UNKNOWN
* 28a5a4f537544d35dfcd8700a7b97fb7216682ce UNKNOWN
* c09e228f7cce78a7dbbc394e93b3cf8c6c3d4d5f UNKNOWN
* 5b8f5819fff8fec34864eb409fd429b95be17b9b UNKNOWN
* 13702fc2232ebd9300966b0a917a3358d8d0f18c Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5590) Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5600)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #4556: [HUDI-3191][Stacked on 4531] Removing duplicating file-listing process w/in Hive's MOR `FIleInputFormat`s
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #4556:
URL: https://github.com/apache/hudi/pull/4556#issuecomment-1009523225
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "d87786af43a7aeba7549cc3cfcbd97fc312bee0e",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5074",
"triggerID" : "d87786af43a7aeba7549cc3cfcbd97fc312bee0e",
"triggerType" : "PUSH"
}, {
"hash" : "4b87ba1474be575ec27109ccbe626e4c2fc9c224",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "4b87ba1474be575ec27109ccbe626e4c2fc9c224",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* d87786af43a7aeba7549cc3cfcbd97fc312bee0e Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5074)
* 4b87ba1474be575ec27109ccbe626e4c2fc9c224 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #4556: [HUDI-3191][Stacked on 4716] Removing duplicating file-listing process w/in Hive's MOR `FileInputFormat`s
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #4556:
URL: https://github.com/apache/hudi/pull/4556#issuecomment-1024849226
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "d87786af43a7aeba7549cc3cfcbd97fc312bee0e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5074",
"triggerID" : "d87786af43a7aeba7549cc3cfcbd97fc312bee0e",
"triggerType" : "PUSH"
}, {
"hash" : "4b87ba1474be575ec27109ccbe626e4c2fc9c224",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5077",
"triggerID" : "4b87ba1474be575ec27109ccbe626e4c2fc9c224",
"triggerType" : "PUSH"
}, {
"hash" : "77d11131baabd1c4e3cc2050337daca4df5f6427",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "77d11131baabd1c4e3cc2050337daca4df5f6427",
"triggerType" : "PUSH"
}, {
"hash" : "3d9c2ae28da858d1e8476052c99391015effb7db",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "3d9c2ae28da858d1e8476052c99391015effb7db",
"triggerType" : "PUSH"
}, {
"hash" : "79ac9affcb7f81497e0df755c8200638d35b02b7",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5081",
"triggerID" : "79ac9affcb7f81497e0df755c8200638d35b02b7",
"triggerType" : "PUSH"
}, {
"hash" : "3c14bbe6c6bcf49c4164c45e82f77b473f4de396",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5113",
"triggerID" : "3c14bbe6c6bcf49c4164c45e82f77b473f4de396",
"triggerType" : "PUSH"
}, {
"hash" : "276f13d6efd00b301b232b286d585729c9d1d26e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5116",
"triggerID" : "276f13d6efd00b301b232b286d585729c9d1d26e",
"triggerType" : "PUSH"
}, {
"hash" : "31b0669d7b638bd65a17b22a2ceb772f2627512c",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "31b0669d7b638bd65a17b22a2ceb772f2627512c",
"triggerType" : "PUSH"
}, {
"hash" : "096e26af39a477ffccbee0edd764493e12e15e71",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5124",
"triggerID" : "096e26af39a477ffccbee0edd764493e12e15e71",
"triggerType" : "PUSH"
}, {
"hash" : "97dd5ec7c9246f6d9f467b9076b790dd6017c5b4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5213",
"triggerID" : "97dd5ec7c9246f6d9f467b9076b790dd6017c5b4",
"triggerType" : "PUSH"
}, {
"hash" : "0538475fe488089c4cb3bc0afb63c2f518329969",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5257",
"triggerID" : "0538475fe488089c4cb3bc0afb63c2f518329969",
"triggerType" : "PUSH"
}, {
"hash" : "9f4b334e340fb26004e1b07fc8fbaaa047c76775",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5261",
"triggerID" : "9f4b334e340fb26004e1b07fc8fbaaa047c76775",
"triggerType" : "PUSH"
}, {
"hash" : "368c099820c3cbf57496d0e46d1858aa8eb153ee",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5330",
"triggerID" : "368c099820c3cbf57496d0e46d1858aa8eb153ee",
"triggerType" : "PUSH"
}, {
"hash" : "28a5a4f537544d35dfcd8700a7b97fb7216682ce",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "28a5a4f537544d35dfcd8700a7b97fb7216682ce",
"triggerType" : "PUSH"
}, {
"hash" : "08ffdd8b47d147c9b5c889a5f56e39b9b140612d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5351",
"triggerID" : "08ffdd8b47d147c9b5c889a5f56e39b9b140612d",
"triggerType" : "PUSH"
}, {
"hash" : "c09e228f7cce78a7dbbc394e93b3cf8c6c3d4d5f",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "c09e228f7cce78a7dbbc394e93b3cf8c6c3d4d5f",
"triggerType" : "PUSH"
}, {
"hash" : "8dadbf672d4d27505592f18bc89422fd7c013669",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5398",
"triggerID" : "8dadbf672d4d27505592f18bc89422fd7c013669",
"triggerType" : "PUSH"
}, {
"hash" : "906607be5bd62ee1cbbda34acb6a89916c1f7aee",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5424",
"triggerID" : "906607be5bd62ee1cbbda34acb6a89916c1f7aee",
"triggerType" : "PUSH"
}, {
"hash" : "dc1b033f40cea9642f71b8fcff74aa82106726b6",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5484",
"triggerID" : "dc1b033f40cea9642f71b8fcff74aa82106726b6",
"triggerType" : "PUSH"
}, {
"hash" : "5b8f5819fff8fec34864eb409fd429b95be17b9b",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "5b8f5819fff8fec34864eb409fd429b95be17b9b",
"triggerType" : "PUSH"
}, {
"hash" : "13702fc2232ebd9300966b0a917a3358d8d0f18c",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5590",
"triggerID" : "13702fc2232ebd9300966b0a917a3358d8d0f18c",
"triggerType" : "PUSH"
}, {
"hash" : "13702fc2232ebd9300966b0a917a3358d8d0f18c",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5600",
"triggerID" : "1024845655",
"triggerType" : "MANUAL"
}, {
"hash" : "9bdd8a60f95123f82a5f30f5e68929f5b7e1f8da",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "9bdd8a60f95123f82a5f30f5e68929f5b7e1f8da",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 77d11131baabd1c4e3cc2050337daca4df5f6427 UNKNOWN
* 3d9c2ae28da858d1e8476052c99391015effb7db UNKNOWN
* 31b0669d7b638bd65a17b22a2ceb772f2627512c UNKNOWN
* 28a5a4f537544d35dfcd8700a7b97fb7216682ce UNKNOWN
* c09e228f7cce78a7dbbc394e93b3cf8c6c3d4d5f UNKNOWN
* 5b8f5819fff8fec34864eb409fd429b95be17b9b UNKNOWN
* 13702fc2232ebd9300966b0a917a3358d8d0f18c Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5590) Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5600)
* 9bdd8a60f95123f82a5f30f5e68929f5b7e1f8da UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #4556: [HUDI-3191][Stacked on 4716] Removing duplicating file-listing process w/in Hive's MOR `FileInputFormat`s
Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #4556:
URL: https://github.com/apache/hudi/pull/4556#issuecomment-1026277163
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "d87786af43a7aeba7549cc3cfcbd97fc312bee0e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5074",
"triggerID" : "d87786af43a7aeba7549cc3cfcbd97fc312bee0e",
"triggerType" : "PUSH"
}, {
"hash" : "4b87ba1474be575ec27109ccbe626e4c2fc9c224",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5077",
"triggerID" : "4b87ba1474be575ec27109ccbe626e4c2fc9c224",
"triggerType" : "PUSH"
}, {
"hash" : "77d11131baabd1c4e3cc2050337daca4df5f6427",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "77d11131baabd1c4e3cc2050337daca4df5f6427",
"triggerType" : "PUSH"
}, {
"hash" : "3d9c2ae28da858d1e8476052c99391015effb7db",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "3d9c2ae28da858d1e8476052c99391015effb7db",
"triggerType" : "PUSH"
}, {
"hash" : "79ac9affcb7f81497e0df755c8200638d35b02b7",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5081",
"triggerID" : "79ac9affcb7f81497e0df755c8200638d35b02b7",
"triggerType" : "PUSH"
}, {
"hash" : "3c14bbe6c6bcf49c4164c45e82f77b473f4de396",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5113",
"triggerID" : "3c14bbe6c6bcf49c4164c45e82f77b473f4de396",
"triggerType" : "PUSH"
}, {
"hash" : "276f13d6efd00b301b232b286d585729c9d1d26e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5116",
"triggerID" : "276f13d6efd00b301b232b286d585729c9d1d26e",
"triggerType" : "PUSH"
}, {
"hash" : "31b0669d7b638bd65a17b22a2ceb772f2627512c",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "31b0669d7b638bd65a17b22a2ceb772f2627512c",
"triggerType" : "PUSH"
}, {
"hash" : "096e26af39a477ffccbee0edd764493e12e15e71",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5124",
"triggerID" : "096e26af39a477ffccbee0edd764493e12e15e71",
"triggerType" : "PUSH"
}, {
"hash" : "97dd5ec7c9246f6d9f467b9076b790dd6017c5b4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5213",
"triggerID" : "97dd5ec7c9246f6d9f467b9076b790dd6017c5b4",
"triggerType" : "PUSH"
}, {
"hash" : "0538475fe488089c4cb3bc0afb63c2f518329969",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5257",
"triggerID" : "0538475fe488089c4cb3bc0afb63c2f518329969",
"triggerType" : "PUSH"
}, {
"hash" : "9f4b334e340fb26004e1b07fc8fbaaa047c76775",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5261",
"triggerID" : "9f4b334e340fb26004e1b07fc8fbaaa047c76775",
"triggerType" : "PUSH"
}, {
"hash" : "368c099820c3cbf57496d0e46d1858aa8eb153ee",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5330",
"triggerID" : "368c099820c3cbf57496d0e46d1858aa8eb153ee",
"triggerType" : "PUSH"
}, {
"hash" : "28a5a4f537544d35dfcd8700a7b97fb7216682ce",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "28a5a4f537544d35dfcd8700a7b97fb7216682ce",
"triggerType" : "PUSH"
}, {
"hash" : "08ffdd8b47d147c9b5c889a5f56e39b9b140612d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5351",
"triggerID" : "08ffdd8b47d147c9b5c889a5f56e39b9b140612d",
"triggerType" : "PUSH"
}, {
"hash" : "c09e228f7cce78a7dbbc394e93b3cf8c6c3d4d5f",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "c09e228f7cce78a7dbbc394e93b3cf8c6c3d4d5f",
"triggerType" : "PUSH"
}, {
"hash" : "8dadbf672d4d27505592f18bc89422fd7c013669",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5398",
"triggerID" : "8dadbf672d4d27505592f18bc89422fd7c013669",
"triggerType" : "PUSH"
}, {
"hash" : "906607be5bd62ee1cbbda34acb6a89916c1f7aee",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5424",
"triggerID" : "906607be5bd62ee1cbbda34acb6a89916c1f7aee",
"triggerType" : "PUSH"
}, {
"hash" : "dc1b033f40cea9642f71b8fcff74aa82106726b6",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5484",
"triggerID" : "dc1b033f40cea9642f71b8fcff74aa82106726b6",
"triggerType" : "PUSH"
}, {
"hash" : "5b8f5819fff8fec34864eb409fd429b95be17b9b",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "5b8f5819fff8fec34864eb409fd429b95be17b9b",
"triggerType" : "PUSH"
}, {
"hash" : "13702fc2232ebd9300966b0a917a3358d8d0f18c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5590",
"triggerID" : "13702fc2232ebd9300966b0a917a3358d8d0f18c",
"triggerType" : "PUSH"
}, {
"hash" : "13702fc2232ebd9300966b0a917a3358d8d0f18c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5600",
"triggerID" : "1024845655",
"triggerType" : "MANUAL"
}, {
"hash" : "9bdd8a60f95123f82a5f30f5e68929f5b7e1f8da",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5603",
"triggerID" : "9bdd8a60f95123f82a5f30f5e68929f5b7e1f8da",
"triggerType" : "PUSH"
}, {
"hash" : "aebb9df557c4afe3ca88f6b8b28ba2fbfdcbd597",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "aebb9df557c4afe3ca88f6b8b28ba2fbfdcbd597",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 77d11131baabd1c4e3cc2050337daca4df5f6427 UNKNOWN
* 3d9c2ae28da858d1e8476052c99391015effb7db UNKNOWN
* 31b0669d7b638bd65a17b22a2ceb772f2627512c UNKNOWN
* 28a5a4f537544d35dfcd8700a7b97fb7216682ce UNKNOWN
* c09e228f7cce78a7dbbc394e93b3cf8c6c3d4d5f UNKNOWN
* 5b8f5819fff8fec34864eb409fd429b95be17b9b UNKNOWN
* 9bdd8a60f95123f82a5f30f5e68929f5b7e1f8da Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5603)
* aebb9df557c4afe3ca88f6b8b28ba2fbfdcbd597 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #4556: [HUDI-3191][Stacked on 4716] Removing duplicating file-listing process w/in Hive's MOR `FileInputFormat`s
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #4556:
URL: https://github.com/apache/hudi/pull/4556#issuecomment-1026395676
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "d87786af43a7aeba7549cc3cfcbd97fc312bee0e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5074",
"triggerID" : "d87786af43a7aeba7549cc3cfcbd97fc312bee0e",
"triggerType" : "PUSH"
}, {
"hash" : "4b87ba1474be575ec27109ccbe626e4c2fc9c224",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5077",
"triggerID" : "4b87ba1474be575ec27109ccbe626e4c2fc9c224",
"triggerType" : "PUSH"
}, {
"hash" : "77d11131baabd1c4e3cc2050337daca4df5f6427",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "77d11131baabd1c4e3cc2050337daca4df5f6427",
"triggerType" : "PUSH"
}, {
"hash" : "3d9c2ae28da858d1e8476052c99391015effb7db",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "3d9c2ae28da858d1e8476052c99391015effb7db",
"triggerType" : "PUSH"
}, {
"hash" : "79ac9affcb7f81497e0df755c8200638d35b02b7",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5081",
"triggerID" : "79ac9affcb7f81497e0df755c8200638d35b02b7",
"triggerType" : "PUSH"
}, {
"hash" : "3c14bbe6c6bcf49c4164c45e82f77b473f4de396",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5113",
"triggerID" : "3c14bbe6c6bcf49c4164c45e82f77b473f4de396",
"triggerType" : "PUSH"
}, {
"hash" : "276f13d6efd00b301b232b286d585729c9d1d26e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5116",
"triggerID" : "276f13d6efd00b301b232b286d585729c9d1d26e",
"triggerType" : "PUSH"
}, {
"hash" : "31b0669d7b638bd65a17b22a2ceb772f2627512c",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "31b0669d7b638bd65a17b22a2ceb772f2627512c",
"triggerType" : "PUSH"
}, {
"hash" : "096e26af39a477ffccbee0edd764493e12e15e71",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5124",
"triggerID" : "096e26af39a477ffccbee0edd764493e12e15e71",
"triggerType" : "PUSH"
}, {
"hash" : "97dd5ec7c9246f6d9f467b9076b790dd6017c5b4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5213",
"triggerID" : "97dd5ec7c9246f6d9f467b9076b790dd6017c5b4",
"triggerType" : "PUSH"
}, {
"hash" : "0538475fe488089c4cb3bc0afb63c2f518329969",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5257",
"triggerID" : "0538475fe488089c4cb3bc0afb63c2f518329969",
"triggerType" : "PUSH"
}, {
"hash" : "9f4b334e340fb26004e1b07fc8fbaaa047c76775",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5261",
"triggerID" : "9f4b334e340fb26004e1b07fc8fbaaa047c76775",
"triggerType" : "PUSH"
}, {
"hash" : "368c099820c3cbf57496d0e46d1858aa8eb153ee",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5330",
"triggerID" : "368c099820c3cbf57496d0e46d1858aa8eb153ee",
"triggerType" : "PUSH"
}, {
"hash" : "28a5a4f537544d35dfcd8700a7b97fb7216682ce",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "28a5a4f537544d35dfcd8700a7b97fb7216682ce",
"triggerType" : "PUSH"
}, {
"hash" : "08ffdd8b47d147c9b5c889a5f56e39b9b140612d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5351",
"triggerID" : "08ffdd8b47d147c9b5c889a5f56e39b9b140612d",
"triggerType" : "PUSH"
}, {
"hash" : "c09e228f7cce78a7dbbc394e93b3cf8c6c3d4d5f",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "c09e228f7cce78a7dbbc394e93b3cf8c6c3d4d5f",
"triggerType" : "PUSH"
}, {
"hash" : "8dadbf672d4d27505592f18bc89422fd7c013669",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5398",
"triggerID" : "8dadbf672d4d27505592f18bc89422fd7c013669",
"triggerType" : "PUSH"
}, {
"hash" : "906607be5bd62ee1cbbda34acb6a89916c1f7aee",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5424",
"triggerID" : "906607be5bd62ee1cbbda34acb6a89916c1f7aee",
"triggerType" : "PUSH"
}, {
"hash" : "dc1b033f40cea9642f71b8fcff74aa82106726b6",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5484",
"triggerID" : "dc1b033f40cea9642f71b8fcff74aa82106726b6",
"triggerType" : "PUSH"
}, {
"hash" : "5b8f5819fff8fec34864eb409fd429b95be17b9b",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "5b8f5819fff8fec34864eb409fd429b95be17b9b",
"triggerType" : "PUSH"
}, {
"hash" : "13702fc2232ebd9300966b0a917a3358d8d0f18c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5590",
"triggerID" : "13702fc2232ebd9300966b0a917a3358d8d0f18c",
"triggerType" : "PUSH"
}, {
"hash" : "13702fc2232ebd9300966b0a917a3358d8d0f18c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5600",
"triggerID" : "1024845655",
"triggerType" : "MANUAL"
}, {
"hash" : "9bdd8a60f95123f82a5f30f5e68929f5b7e1f8da",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5603",
"triggerID" : "9bdd8a60f95123f82a5f30f5e68929f5b7e1f8da",
"triggerType" : "PUSH"
}, {
"hash" : "aebb9df557c4afe3ca88f6b8b28ba2fbfdcbd597",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5631",
"triggerID" : "aebb9df557c4afe3ca88f6b8b28ba2fbfdcbd597",
"triggerType" : "PUSH"
}, {
"hash" : "5d37935bc8bb33260735d782ca560fd59e02f321",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "5d37935bc8bb33260735d782ca560fd59e02f321",
"triggerType" : "PUSH"
}, {
"hash" : "f911d869f50009e5cd9f3fd341c83c732d7531ba",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5634",
"triggerID" : "f911d869f50009e5cd9f3fd341c83c732d7531ba",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 77d11131baabd1c4e3cc2050337daca4df5f6427 UNKNOWN
* 3d9c2ae28da858d1e8476052c99391015effb7db UNKNOWN
* 31b0669d7b638bd65a17b22a2ceb772f2627512c UNKNOWN
* 28a5a4f537544d35dfcd8700a7b97fb7216682ce UNKNOWN
* c09e228f7cce78a7dbbc394e93b3cf8c6c3d4d5f UNKNOWN
* 5b8f5819fff8fec34864eb409fd429b95be17b9b UNKNOWN
* aebb9df557c4afe3ca88f6b8b28ba2fbfdcbd597 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5631)
* 5d37935bc8bb33260735d782ca560fd59e02f321 UNKNOWN
* f911d869f50009e5cd9f3fd341c83c732d7531ba Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5634)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #4556: [HUDI-3191] Removing duplicating file-listing process w/in Hive's MOR `FileInputFormat`s
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #4556:
URL: https://github.com/apache/hudi/pull/4556#issuecomment-1028522181
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "d87786af43a7aeba7549cc3cfcbd97fc312bee0e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5074",
"triggerID" : "d87786af43a7aeba7549cc3cfcbd97fc312bee0e",
"triggerType" : "PUSH"
}, {
"hash" : "4b87ba1474be575ec27109ccbe626e4c2fc9c224",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5077",
"triggerID" : "4b87ba1474be575ec27109ccbe626e4c2fc9c224",
"triggerType" : "PUSH"
}, {
"hash" : "77d11131baabd1c4e3cc2050337daca4df5f6427",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "77d11131baabd1c4e3cc2050337daca4df5f6427",
"triggerType" : "PUSH"
}, {
"hash" : "3d9c2ae28da858d1e8476052c99391015effb7db",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "3d9c2ae28da858d1e8476052c99391015effb7db",
"triggerType" : "PUSH"
}, {
"hash" : "79ac9affcb7f81497e0df755c8200638d35b02b7",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5081",
"triggerID" : "79ac9affcb7f81497e0df755c8200638d35b02b7",
"triggerType" : "PUSH"
}, {
"hash" : "3c14bbe6c6bcf49c4164c45e82f77b473f4de396",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5113",
"triggerID" : "3c14bbe6c6bcf49c4164c45e82f77b473f4de396",
"triggerType" : "PUSH"
}, {
"hash" : "276f13d6efd00b301b232b286d585729c9d1d26e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5116",
"triggerID" : "276f13d6efd00b301b232b286d585729c9d1d26e",
"triggerType" : "PUSH"
}, {
"hash" : "31b0669d7b638bd65a17b22a2ceb772f2627512c",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "31b0669d7b638bd65a17b22a2ceb772f2627512c",
"triggerType" : "PUSH"
}, {
"hash" : "096e26af39a477ffccbee0edd764493e12e15e71",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5124",
"triggerID" : "096e26af39a477ffccbee0edd764493e12e15e71",
"triggerType" : "PUSH"
}, {
"hash" : "97dd5ec7c9246f6d9f467b9076b790dd6017c5b4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5213",
"triggerID" : "97dd5ec7c9246f6d9f467b9076b790dd6017c5b4",
"triggerType" : "PUSH"
}, {
"hash" : "0538475fe488089c4cb3bc0afb63c2f518329969",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5257",
"triggerID" : "0538475fe488089c4cb3bc0afb63c2f518329969",
"triggerType" : "PUSH"
}, {
"hash" : "9f4b334e340fb26004e1b07fc8fbaaa047c76775",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5261",
"triggerID" : "9f4b334e340fb26004e1b07fc8fbaaa047c76775",
"triggerType" : "PUSH"
}, {
"hash" : "368c099820c3cbf57496d0e46d1858aa8eb153ee",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5330",
"triggerID" : "368c099820c3cbf57496d0e46d1858aa8eb153ee",
"triggerType" : "PUSH"
}, {
"hash" : "28a5a4f537544d35dfcd8700a7b97fb7216682ce",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "28a5a4f537544d35dfcd8700a7b97fb7216682ce",
"triggerType" : "PUSH"
}, {
"hash" : "08ffdd8b47d147c9b5c889a5f56e39b9b140612d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5351",
"triggerID" : "08ffdd8b47d147c9b5c889a5f56e39b9b140612d",
"triggerType" : "PUSH"
}, {
"hash" : "c09e228f7cce78a7dbbc394e93b3cf8c6c3d4d5f",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "c09e228f7cce78a7dbbc394e93b3cf8c6c3d4d5f",
"triggerType" : "PUSH"
}, {
"hash" : "8dadbf672d4d27505592f18bc89422fd7c013669",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5398",
"triggerID" : "8dadbf672d4d27505592f18bc89422fd7c013669",
"triggerType" : "PUSH"
}, {
"hash" : "906607be5bd62ee1cbbda34acb6a89916c1f7aee",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5424",
"triggerID" : "906607be5bd62ee1cbbda34acb6a89916c1f7aee",
"triggerType" : "PUSH"
}, {
"hash" : "dc1b033f40cea9642f71b8fcff74aa82106726b6",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5484",
"triggerID" : "dc1b033f40cea9642f71b8fcff74aa82106726b6",
"triggerType" : "PUSH"
}, {
"hash" : "5b8f5819fff8fec34864eb409fd429b95be17b9b",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "5b8f5819fff8fec34864eb409fd429b95be17b9b",
"triggerType" : "PUSH"
}, {
"hash" : "13702fc2232ebd9300966b0a917a3358d8d0f18c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5590",
"triggerID" : "13702fc2232ebd9300966b0a917a3358d8d0f18c",
"triggerType" : "PUSH"
}, {
"hash" : "13702fc2232ebd9300966b0a917a3358d8d0f18c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5600",
"triggerID" : "1024845655",
"triggerType" : "MANUAL"
}, {
"hash" : "9bdd8a60f95123f82a5f30f5e68929f5b7e1f8da",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5603",
"triggerID" : "9bdd8a60f95123f82a5f30f5e68929f5b7e1f8da",
"triggerType" : "PUSH"
}, {
"hash" : "aebb9df557c4afe3ca88f6b8b28ba2fbfdcbd597",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5631",
"triggerID" : "aebb9df557c4afe3ca88f6b8b28ba2fbfdcbd597",
"triggerType" : "PUSH"
}, {
"hash" : "5d37935bc8bb33260735d782ca560fd59e02f321",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "5d37935bc8bb33260735d782ca560fd59e02f321",
"triggerType" : "PUSH"
}, {
"hash" : "f911d869f50009e5cd9f3fd341c83c732d7531ba",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5634",
"triggerID" : "f911d869f50009e5cd9f3fd341c83c732d7531ba",
"triggerType" : "PUSH"
}, {
"hash" : "f911d869f50009e5cd9f3fd341c83c732d7531ba",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5657",
"triggerID" : "1027051107",
"triggerType" : "MANUAL"
}, {
"hash" : "f911d869f50009e5cd9f3fd341c83c732d7531ba",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5659",
"triggerID" : "1027166086",
"triggerType" : "MANUAL"
}, {
"hash" : "f911d869f50009e5cd9f3fd341c83c732d7531ba",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5665",
"triggerID" : "1027387044",
"triggerType" : "MANUAL"
}, {
"hash" : "34b94b96b03109555201092bfabce21793add437",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5689",
"triggerID" : "34b94b96b03109555201092bfabce21793add437",
"triggerType" : "PUSH"
}, {
"hash" : "7f793744421a5ee304d5dff89d23e1e925bfd1cb",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5692",
"triggerID" : "7f793744421a5ee304d5dff89d23e1e925bfd1cb",
"triggerType" : "PUSH"
}, {
"hash" : "7f793744421a5ee304d5dff89d23e1e925bfd1cb",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5694",
"triggerID" : "1028521365",
"triggerType" : "MANUAL"
} ]
}-->
## CI report:
* 77d11131baabd1c4e3cc2050337daca4df5f6427 UNKNOWN
* 3d9c2ae28da858d1e8476052c99391015effb7db UNKNOWN
* 31b0669d7b638bd65a17b22a2ceb772f2627512c UNKNOWN
* 28a5a4f537544d35dfcd8700a7b97fb7216682ce UNKNOWN
* c09e228f7cce78a7dbbc394e93b3cf8c6c3d4d5f UNKNOWN
* 5b8f5819fff8fec34864eb409fd429b95be17b9b UNKNOWN
* 5d37935bc8bb33260735d782ca560fd59e02f321 UNKNOWN
* 7f793744421a5ee304d5dff89d23e1e925bfd1cb Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5692) Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5694)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #4556: [HUDI-3191] Removing duplicating file-listing process w/in Hive's MOR `FileInputFormat`s
Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #4556:
URL: https://github.com/apache/hudi/pull/4556#issuecomment-1028457463
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "d87786af43a7aeba7549cc3cfcbd97fc312bee0e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5074",
"triggerID" : "d87786af43a7aeba7549cc3cfcbd97fc312bee0e",
"triggerType" : "PUSH"
}, {
"hash" : "4b87ba1474be575ec27109ccbe626e4c2fc9c224",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5077",
"triggerID" : "4b87ba1474be575ec27109ccbe626e4c2fc9c224",
"triggerType" : "PUSH"
}, {
"hash" : "77d11131baabd1c4e3cc2050337daca4df5f6427",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "77d11131baabd1c4e3cc2050337daca4df5f6427",
"triggerType" : "PUSH"
}, {
"hash" : "3d9c2ae28da858d1e8476052c99391015effb7db",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "3d9c2ae28da858d1e8476052c99391015effb7db",
"triggerType" : "PUSH"
}, {
"hash" : "79ac9affcb7f81497e0df755c8200638d35b02b7",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5081",
"triggerID" : "79ac9affcb7f81497e0df755c8200638d35b02b7",
"triggerType" : "PUSH"
}, {
"hash" : "3c14bbe6c6bcf49c4164c45e82f77b473f4de396",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5113",
"triggerID" : "3c14bbe6c6bcf49c4164c45e82f77b473f4de396",
"triggerType" : "PUSH"
}, {
"hash" : "276f13d6efd00b301b232b286d585729c9d1d26e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5116",
"triggerID" : "276f13d6efd00b301b232b286d585729c9d1d26e",
"triggerType" : "PUSH"
}, {
"hash" : "31b0669d7b638bd65a17b22a2ceb772f2627512c",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "31b0669d7b638bd65a17b22a2ceb772f2627512c",
"triggerType" : "PUSH"
}, {
"hash" : "096e26af39a477ffccbee0edd764493e12e15e71",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5124",
"triggerID" : "096e26af39a477ffccbee0edd764493e12e15e71",
"triggerType" : "PUSH"
}, {
"hash" : "97dd5ec7c9246f6d9f467b9076b790dd6017c5b4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5213",
"triggerID" : "97dd5ec7c9246f6d9f467b9076b790dd6017c5b4",
"triggerType" : "PUSH"
}, {
"hash" : "0538475fe488089c4cb3bc0afb63c2f518329969",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5257",
"triggerID" : "0538475fe488089c4cb3bc0afb63c2f518329969",
"triggerType" : "PUSH"
}, {
"hash" : "9f4b334e340fb26004e1b07fc8fbaaa047c76775",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5261",
"triggerID" : "9f4b334e340fb26004e1b07fc8fbaaa047c76775",
"triggerType" : "PUSH"
}, {
"hash" : "368c099820c3cbf57496d0e46d1858aa8eb153ee",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5330",
"triggerID" : "368c099820c3cbf57496d0e46d1858aa8eb153ee",
"triggerType" : "PUSH"
}, {
"hash" : "28a5a4f537544d35dfcd8700a7b97fb7216682ce",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "28a5a4f537544d35dfcd8700a7b97fb7216682ce",
"triggerType" : "PUSH"
}, {
"hash" : "08ffdd8b47d147c9b5c889a5f56e39b9b140612d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5351",
"triggerID" : "08ffdd8b47d147c9b5c889a5f56e39b9b140612d",
"triggerType" : "PUSH"
}, {
"hash" : "c09e228f7cce78a7dbbc394e93b3cf8c6c3d4d5f",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "c09e228f7cce78a7dbbc394e93b3cf8c6c3d4d5f",
"triggerType" : "PUSH"
}, {
"hash" : "8dadbf672d4d27505592f18bc89422fd7c013669",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5398",
"triggerID" : "8dadbf672d4d27505592f18bc89422fd7c013669",
"triggerType" : "PUSH"
}, {
"hash" : "906607be5bd62ee1cbbda34acb6a89916c1f7aee",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5424",
"triggerID" : "906607be5bd62ee1cbbda34acb6a89916c1f7aee",
"triggerType" : "PUSH"
}, {
"hash" : "dc1b033f40cea9642f71b8fcff74aa82106726b6",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5484",
"triggerID" : "dc1b033f40cea9642f71b8fcff74aa82106726b6",
"triggerType" : "PUSH"
}, {
"hash" : "5b8f5819fff8fec34864eb409fd429b95be17b9b",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "5b8f5819fff8fec34864eb409fd429b95be17b9b",
"triggerType" : "PUSH"
}, {
"hash" : "13702fc2232ebd9300966b0a917a3358d8d0f18c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5590",
"triggerID" : "13702fc2232ebd9300966b0a917a3358d8d0f18c",
"triggerType" : "PUSH"
}, {
"hash" : "13702fc2232ebd9300966b0a917a3358d8d0f18c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5600",
"triggerID" : "1024845655",
"triggerType" : "MANUAL"
}, {
"hash" : "9bdd8a60f95123f82a5f30f5e68929f5b7e1f8da",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5603",
"triggerID" : "9bdd8a60f95123f82a5f30f5e68929f5b7e1f8da",
"triggerType" : "PUSH"
}, {
"hash" : "aebb9df557c4afe3ca88f6b8b28ba2fbfdcbd597",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5631",
"triggerID" : "aebb9df557c4afe3ca88f6b8b28ba2fbfdcbd597",
"triggerType" : "PUSH"
}, {
"hash" : "5d37935bc8bb33260735d782ca560fd59e02f321",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "5d37935bc8bb33260735d782ca560fd59e02f321",
"triggerType" : "PUSH"
}, {
"hash" : "f911d869f50009e5cd9f3fd341c83c732d7531ba",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5634",
"triggerID" : "f911d869f50009e5cd9f3fd341c83c732d7531ba",
"triggerType" : "PUSH"
}, {
"hash" : "f911d869f50009e5cd9f3fd341c83c732d7531ba",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5657",
"triggerID" : "1027051107",
"triggerType" : "MANUAL"
}, {
"hash" : "f911d869f50009e5cd9f3fd341c83c732d7531ba",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5659",
"triggerID" : "1027166086",
"triggerType" : "MANUAL"
}, {
"hash" : "f911d869f50009e5cd9f3fd341c83c732d7531ba",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5665",
"triggerID" : "1027387044",
"triggerType" : "MANUAL"
}, {
"hash" : "34b94b96b03109555201092bfabce21793add437",
"status" : "CANCELED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5689",
"triggerID" : "34b94b96b03109555201092bfabce21793add437",
"triggerType" : "PUSH"
}, {
"hash" : "7f793744421a5ee304d5dff89d23e1e925bfd1cb",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "7f793744421a5ee304d5dff89d23e1e925bfd1cb",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 77d11131baabd1c4e3cc2050337daca4df5f6427 UNKNOWN
* 3d9c2ae28da858d1e8476052c99391015effb7db UNKNOWN
* 31b0669d7b638bd65a17b22a2ceb772f2627512c UNKNOWN
* 28a5a4f537544d35dfcd8700a7b97fb7216682ce UNKNOWN
* c09e228f7cce78a7dbbc394e93b3cf8c6c3d4d5f UNKNOWN
* 5b8f5819fff8fec34864eb409fd429b95be17b9b UNKNOWN
* 5d37935bc8bb33260735d782ca560fd59e02f321 UNKNOWN
* 34b94b96b03109555201092bfabce21793add437 Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5689)
* 7f793744421a5ee304d5dff89d23e1e925bfd1cb UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #4556: [HUDI-3191] Removing duplicating file-listing process w/in Hive's MOR `FileInputFormat`s
Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #4556:
URL: https://github.com/apache/hudi/pull/4556#issuecomment-1028382543
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "d87786af43a7aeba7549cc3cfcbd97fc312bee0e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5074",
"triggerID" : "d87786af43a7aeba7549cc3cfcbd97fc312bee0e",
"triggerType" : "PUSH"
}, {
"hash" : "4b87ba1474be575ec27109ccbe626e4c2fc9c224",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5077",
"triggerID" : "4b87ba1474be575ec27109ccbe626e4c2fc9c224",
"triggerType" : "PUSH"
}, {
"hash" : "77d11131baabd1c4e3cc2050337daca4df5f6427",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "77d11131baabd1c4e3cc2050337daca4df5f6427",
"triggerType" : "PUSH"
}, {
"hash" : "3d9c2ae28da858d1e8476052c99391015effb7db",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "3d9c2ae28da858d1e8476052c99391015effb7db",
"triggerType" : "PUSH"
}, {
"hash" : "79ac9affcb7f81497e0df755c8200638d35b02b7",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5081",
"triggerID" : "79ac9affcb7f81497e0df755c8200638d35b02b7",
"triggerType" : "PUSH"
}, {
"hash" : "3c14bbe6c6bcf49c4164c45e82f77b473f4de396",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5113",
"triggerID" : "3c14bbe6c6bcf49c4164c45e82f77b473f4de396",
"triggerType" : "PUSH"
}, {
"hash" : "276f13d6efd00b301b232b286d585729c9d1d26e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5116",
"triggerID" : "276f13d6efd00b301b232b286d585729c9d1d26e",
"triggerType" : "PUSH"
}, {
"hash" : "31b0669d7b638bd65a17b22a2ceb772f2627512c",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "31b0669d7b638bd65a17b22a2ceb772f2627512c",
"triggerType" : "PUSH"
}, {
"hash" : "096e26af39a477ffccbee0edd764493e12e15e71",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5124",
"triggerID" : "096e26af39a477ffccbee0edd764493e12e15e71",
"triggerType" : "PUSH"
}, {
"hash" : "97dd5ec7c9246f6d9f467b9076b790dd6017c5b4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5213",
"triggerID" : "97dd5ec7c9246f6d9f467b9076b790dd6017c5b4",
"triggerType" : "PUSH"
}, {
"hash" : "0538475fe488089c4cb3bc0afb63c2f518329969",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5257",
"triggerID" : "0538475fe488089c4cb3bc0afb63c2f518329969",
"triggerType" : "PUSH"
}, {
"hash" : "9f4b334e340fb26004e1b07fc8fbaaa047c76775",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5261",
"triggerID" : "9f4b334e340fb26004e1b07fc8fbaaa047c76775",
"triggerType" : "PUSH"
}, {
"hash" : "368c099820c3cbf57496d0e46d1858aa8eb153ee",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5330",
"triggerID" : "368c099820c3cbf57496d0e46d1858aa8eb153ee",
"triggerType" : "PUSH"
}, {
"hash" : "28a5a4f537544d35dfcd8700a7b97fb7216682ce",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "28a5a4f537544d35dfcd8700a7b97fb7216682ce",
"triggerType" : "PUSH"
}, {
"hash" : "08ffdd8b47d147c9b5c889a5f56e39b9b140612d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5351",
"triggerID" : "08ffdd8b47d147c9b5c889a5f56e39b9b140612d",
"triggerType" : "PUSH"
}, {
"hash" : "c09e228f7cce78a7dbbc394e93b3cf8c6c3d4d5f",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "c09e228f7cce78a7dbbc394e93b3cf8c6c3d4d5f",
"triggerType" : "PUSH"
}, {
"hash" : "8dadbf672d4d27505592f18bc89422fd7c013669",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5398",
"triggerID" : "8dadbf672d4d27505592f18bc89422fd7c013669",
"triggerType" : "PUSH"
}, {
"hash" : "906607be5bd62ee1cbbda34acb6a89916c1f7aee",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5424",
"triggerID" : "906607be5bd62ee1cbbda34acb6a89916c1f7aee",
"triggerType" : "PUSH"
}, {
"hash" : "dc1b033f40cea9642f71b8fcff74aa82106726b6",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5484",
"triggerID" : "dc1b033f40cea9642f71b8fcff74aa82106726b6",
"triggerType" : "PUSH"
}, {
"hash" : "5b8f5819fff8fec34864eb409fd429b95be17b9b",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "5b8f5819fff8fec34864eb409fd429b95be17b9b",
"triggerType" : "PUSH"
}, {
"hash" : "13702fc2232ebd9300966b0a917a3358d8d0f18c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5590",
"triggerID" : "13702fc2232ebd9300966b0a917a3358d8d0f18c",
"triggerType" : "PUSH"
}, {
"hash" : "13702fc2232ebd9300966b0a917a3358d8d0f18c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5600",
"triggerID" : "1024845655",
"triggerType" : "MANUAL"
}, {
"hash" : "9bdd8a60f95123f82a5f30f5e68929f5b7e1f8da",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5603",
"triggerID" : "9bdd8a60f95123f82a5f30f5e68929f5b7e1f8da",
"triggerType" : "PUSH"
}, {
"hash" : "aebb9df557c4afe3ca88f6b8b28ba2fbfdcbd597",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5631",
"triggerID" : "aebb9df557c4afe3ca88f6b8b28ba2fbfdcbd597",
"triggerType" : "PUSH"
}, {
"hash" : "5d37935bc8bb33260735d782ca560fd59e02f321",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "5d37935bc8bb33260735d782ca560fd59e02f321",
"triggerType" : "PUSH"
}, {
"hash" : "f911d869f50009e5cd9f3fd341c83c732d7531ba",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5634",
"triggerID" : "f911d869f50009e5cd9f3fd341c83c732d7531ba",
"triggerType" : "PUSH"
}, {
"hash" : "f911d869f50009e5cd9f3fd341c83c732d7531ba",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5657",
"triggerID" : "1027051107",
"triggerType" : "MANUAL"
}, {
"hash" : "f911d869f50009e5cd9f3fd341c83c732d7531ba",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5659",
"triggerID" : "1027166086",
"triggerType" : "MANUAL"
}, {
"hash" : "f911d869f50009e5cd9f3fd341c83c732d7531ba",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5665",
"triggerID" : "1027387044",
"triggerType" : "MANUAL"
}, {
"hash" : "34b94b96b03109555201092bfabce21793add437",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5689",
"triggerID" : "34b94b96b03109555201092bfabce21793add437",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 77d11131baabd1c4e3cc2050337daca4df5f6427 UNKNOWN
* 3d9c2ae28da858d1e8476052c99391015effb7db UNKNOWN
* 31b0669d7b638bd65a17b22a2ceb772f2627512c UNKNOWN
* 28a5a4f537544d35dfcd8700a7b97fb7216682ce UNKNOWN
* c09e228f7cce78a7dbbc394e93b3cf8c6c3d4d5f UNKNOWN
* 5b8f5819fff8fec34864eb409fd429b95be17b9b UNKNOWN
* 5d37935bc8bb33260735d782ca560fd59e02f321 UNKNOWN
* f911d869f50009e5cd9f3fd341c83c732d7531ba Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5634) Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5657) Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5659) Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5665)
* 34b94b96b03109555201092bfabce21793add437 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5689)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #4556: [HUDI-3191] Removing duplicating file-listing process w/in Hive's MOR `FileInputFormat`s
Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #4556:
URL: https://github.com/apache/hudi/pull/4556#issuecomment-1028522181
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "d87786af43a7aeba7549cc3cfcbd97fc312bee0e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5074",
"triggerID" : "d87786af43a7aeba7549cc3cfcbd97fc312bee0e",
"triggerType" : "PUSH"
}, {
"hash" : "4b87ba1474be575ec27109ccbe626e4c2fc9c224",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5077",
"triggerID" : "4b87ba1474be575ec27109ccbe626e4c2fc9c224",
"triggerType" : "PUSH"
}, {
"hash" : "77d11131baabd1c4e3cc2050337daca4df5f6427",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "77d11131baabd1c4e3cc2050337daca4df5f6427",
"triggerType" : "PUSH"
}, {
"hash" : "3d9c2ae28da858d1e8476052c99391015effb7db",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "3d9c2ae28da858d1e8476052c99391015effb7db",
"triggerType" : "PUSH"
}, {
"hash" : "79ac9affcb7f81497e0df755c8200638d35b02b7",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5081",
"triggerID" : "79ac9affcb7f81497e0df755c8200638d35b02b7",
"triggerType" : "PUSH"
}, {
"hash" : "3c14bbe6c6bcf49c4164c45e82f77b473f4de396",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5113",
"triggerID" : "3c14bbe6c6bcf49c4164c45e82f77b473f4de396",
"triggerType" : "PUSH"
}, {
"hash" : "276f13d6efd00b301b232b286d585729c9d1d26e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5116",
"triggerID" : "276f13d6efd00b301b232b286d585729c9d1d26e",
"triggerType" : "PUSH"
}, {
"hash" : "31b0669d7b638bd65a17b22a2ceb772f2627512c",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "31b0669d7b638bd65a17b22a2ceb772f2627512c",
"triggerType" : "PUSH"
}, {
"hash" : "096e26af39a477ffccbee0edd764493e12e15e71",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5124",
"triggerID" : "096e26af39a477ffccbee0edd764493e12e15e71",
"triggerType" : "PUSH"
}, {
"hash" : "97dd5ec7c9246f6d9f467b9076b790dd6017c5b4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5213",
"triggerID" : "97dd5ec7c9246f6d9f467b9076b790dd6017c5b4",
"triggerType" : "PUSH"
}, {
"hash" : "0538475fe488089c4cb3bc0afb63c2f518329969",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5257",
"triggerID" : "0538475fe488089c4cb3bc0afb63c2f518329969",
"triggerType" : "PUSH"
}, {
"hash" : "9f4b334e340fb26004e1b07fc8fbaaa047c76775",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5261",
"triggerID" : "9f4b334e340fb26004e1b07fc8fbaaa047c76775",
"triggerType" : "PUSH"
}, {
"hash" : "368c099820c3cbf57496d0e46d1858aa8eb153ee",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5330",
"triggerID" : "368c099820c3cbf57496d0e46d1858aa8eb153ee",
"triggerType" : "PUSH"
}, {
"hash" : "28a5a4f537544d35dfcd8700a7b97fb7216682ce",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "28a5a4f537544d35dfcd8700a7b97fb7216682ce",
"triggerType" : "PUSH"
}, {
"hash" : "08ffdd8b47d147c9b5c889a5f56e39b9b140612d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5351",
"triggerID" : "08ffdd8b47d147c9b5c889a5f56e39b9b140612d",
"triggerType" : "PUSH"
}, {
"hash" : "c09e228f7cce78a7dbbc394e93b3cf8c6c3d4d5f",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "c09e228f7cce78a7dbbc394e93b3cf8c6c3d4d5f",
"triggerType" : "PUSH"
}, {
"hash" : "8dadbf672d4d27505592f18bc89422fd7c013669",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5398",
"triggerID" : "8dadbf672d4d27505592f18bc89422fd7c013669",
"triggerType" : "PUSH"
}, {
"hash" : "906607be5bd62ee1cbbda34acb6a89916c1f7aee",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5424",
"triggerID" : "906607be5bd62ee1cbbda34acb6a89916c1f7aee",
"triggerType" : "PUSH"
}, {
"hash" : "dc1b033f40cea9642f71b8fcff74aa82106726b6",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5484",
"triggerID" : "dc1b033f40cea9642f71b8fcff74aa82106726b6",
"triggerType" : "PUSH"
}, {
"hash" : "5b8f5819fff8fec34864eb409fd429b95be17b9b",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "5b8f5819fff8fec34864eb409fd429b95be17b9b",
"triggerType" : "PUSH"
}, {
"hash" : "13702fc2232ebd9300966b0a917a3358d8d0f18c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5590",
"triggerID" : "13702fc2232ebd9300966b0a917a3358d8d0f18c",
"triggerType" : "PUSH"
}, {
"hash" : "13702fc2232ebd9300966b0a917a3358d8d0f18c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5600",
"triggerID" : "1024845655",
"triggerType" : "MANUAL"
}, {
"hash" : "9bdd8a60f95123f82a5f30f5e68929f5b7e1f8da",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5603",
"triggerID" : "9bdd8a60f95123f82a5f30f5e68929f5b7e1f8da",
"triggerType" : "PUSH"
}, {
"hash" : "aebb9df557c4afe3ca88f6b8b28ba2fbfdcbd597",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5631",
"triggerID" : "aebb9df557c4afe3ca88f6b8b28ba2fbfdcbd597",
"triggerType" : "PUSH"
}, {
"hash" : "5d37935bc8bb33260735d782ca560fd59e02f321",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "5d37935bc8bb33260735d782ca560fd59e02f321",
"triggerType" : "PUSH"
}, {
"hash" : "f911d869f50009e5cd9f3fd341c83c732d7531ba",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5634",
"triggerID" : "f911d869f50009e5cd9f3fd341c83c732d7531ba",
"triggerType" : "PUSH"
}, {
"hash" : "f911d869f50009e5cd9f3fd341c83c732d7531ba",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5657",
"triggerID" : "1027051107",
"triggerType" : "MANUAL"
}, {
"hash" : "f911d869f50009e5cd9f3fd341c83c732d7531ba",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5659",
"triggerID" : "1027166086",
"triggerType" : "MANUAL"
}, {
"hash" : "f911d869f50009e5cd9f3fd341c83c732d7531ba",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5665",
"triggerID" : "1027387044",
"triggerType" : "MANUAL"
}, {
"hash" : "34b94b96b03109555201092bfabce21793add437",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5689",
"triggerID" : "34b94b96b03109555201092bfabce21793add437",
"triggerType" : "PUSH"
}, {
"hash" : "7f793744421a5ee304d5dff89d23e1e925bfd1cb",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5692",
"triggerID" : "7f793744421a5ee304d5dff89d23e1e925bfd1cb",
"triggerType" : "PUSH"
}, {
"hash" : "7f793744421a5ee304d5dff89d23e1e925bfd1cb",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5694",
"triggerID" : "1028521365",
"triggerType" : "MANUAL"
} ]
}-->
## CI report:
* 77d11131baabd1c4e3cc2050337daca4df5f6427 UNKNOWN
* 3d9c2ae28da858d1e8476052c99391015effb7db UNKNOWN
* 31b0669d7b638bd65a17b22a2ceb772f2627512c UNKNOWN
* 28a5a4f537544d35dfcd8700a7b97fb7216682ce UNKNOWN
* c09e228f7cce78a7dbbc394e93b3cf8c6c3d4d5f UNKNOWN
* 5b8f5819fff8fec34864eb409fd429b95be17b9b UNKNOWN
* 5d37935bc8bb33260735d782ca560fd59e02f321 UNKNOWN
* 7f793744421a5ee304d5dff89d23e1e925bfd1cb Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5692) Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5694)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #4556: [HUDI-3191] Removing duplicating file-listing process w/in Hive's MOR `FIleInputFormat`s
Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #4556:
URL: https://github.com/apache/hudi/pull/4556#issuecomment-1016891619
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "d87786af43a7aeba7549cc3cfcbd97fc312bee0e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5074",
"triggerID" : "d87786af43a7aeba7549cc3cfcbd97fc312bee0e",
"triggerType" : "PUSH"
}, {
"hash" : "4b87ba1474be575ec27109ccbe626e4c2fc9c224",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5077",
"triggerID" : "4b87ba1474be575ec27109ccbe626e4c2fc9c224",
"triggerType" : "PUSH"
}, {
"hash" : "77d11131baabd1c4e3cc2050337daca4df5f6427",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "77d11131baabd1c4e3cc2050337daca4df5f6427",
"triggerType" : "PUSH"
}, {
"hash" : "3d9c2ae28da858d1e8476052c99391015effb7db",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "3d9c2ae28da858d1e8476052c99391015effb7db",
"triggerType" : "PUSH"
}, {
"hash" : "79ac9affcb7f81497e0df755c8200638d35b02b7",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5081",
"triggerID" : "79ac9affcb7f81497e0df755c8200638d35b02b7",
"triggerType" : "PUSH"
}, {
"hash" : "3c14bbe6c6bcf49c4164c45e82f77b473f4de396",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5113",
"triggerID" : "3c14bbe6c6bcf49c4164c45e82f77b473f4de396",
"triggerType" : "PUSH"
}, {
"hash" : "276f13d6efd00b301b232b286d585729c9d1d26e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5116",
"triggerID" : "276f13d6efd00b301b232b286d585729c9d1d26e",
"triggerType" : "PUSH"
}, {
"hash" : "31b0669d7b638bd65a17b22a2ceb772f2627512c",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "31b0669d7b638bd65a17b22a2ceb772f2627512c",
"triggerType" : "PUSH"
}, {
"hash" : "096e26af39a477ffccbee0edd764493e12e15e71",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5124",
"triggerID" : "096e26af39a477ffccbee0edd764493e12e15e71",
"triggerType" : "PUSH"
}, {
"hash" : "97dd5ec7c9246f6d9f467b9076b790dd6017c5b4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5213",
"triggerID" : "97dd5ec7c9246f6d9f467b9076b790dd6017c5b4",
"triggerType" : "PUSH"
}, {
"hash" : "0538475fe488089c4cb3bc0afb63c2f518329969",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5257",
"triggerID" : "0538475fe488089c4cb3bc0afb63c2f518329969",
"triggerType" : "PUSH"
}, {
"hash" : "9f4b334e340fb26004e1b07fc8fbaaa047c76775",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5261",
"triggerID" : "9f4b334e340fb26004e1b07fc8fbaaa047c76775",
"triggerType" : "PUSH"
}, {
"hash" : "368c099820c3cbf57496d0e46d1858aa8eb153ee",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5330",
"triggerID" : "368c099820c3cbf57496d0e46d1858aa8eb153ee",
"triggerType" : "PUSH"
}, {
"hash" : "28a5a4f537544d35dfcd8700a7b97fb7216682ce",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "28a5a4f537544d35dfcd8700a7b97fb7216682ce",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 77d11131baabd1c4e3cc2050337daca4df5f6427 UNKNOWN
* 3d9c2ae28da858d1e8476052c99391015effb7db UNKNOWN
* 31b0669d7b638bd65a17b22a2ceb772f2627512c UNKNOWN
* 368c099820c3cbf57496d0e46d1858aa8eb153ee Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5330)
* 28a5a4f537544d35dfcd8700a7b97fb7216682ce UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #4556: [HUDI-3191] Removing duplicating file-listing process w/in Hive's MOR `FIleInputFormat`s
Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #4556:
URL: https://github.com/apache/hudi/pull/4556#issuecomment-1017967886
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "d87786af43a7aeba7549cc3cfcbd97fc312bee0e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5074",
"triggerID" : "d87786af43a7aeba7549cc3cfcbd97fc312bee0e",
"triggerType" : "PUSH"
}, {
"hash" : "4b87ba1474be575ec27109ccbe626e4c2fc9c224",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5077",
"triggerID" : "4b87ba1474be575ec27109ccbe626e4c2fc9c224",
"triggerType" : "PUSH"
}, {
"hash" : "77d11131baabd1c4e3cc2050337daca4df5f6427",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "77d11131baabd1c4e3cc2050337daca4df5f6427",
"triggerType" : "PUSH"
}, {
"hash" : "3d9c2ae28da858d1e8476052c99391015effb7db",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "3d9c2ae28da858d1e8476052c99391015effb7db",
"triggerType" : "PUSH"
}, {
"hash" : "79ac9affcb7f81497e0df755c8200638d35b02b7",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5081",
"triggerID" : "79ac9affcb7f81497e0df755c8200638d35b02b7",
"triggerType" : "PUSH"
}, {
"hash" : "3c14bbe6c6bcf49c4164c45e82f77b473f4de396",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5113",
"triggerID" : "3c14bbe6c6bcf49c4164c45e82f77b473f4de396",
"triggerType" : "PUSH"
}, {
"hash" : "276f13d6efd00b301b232b286d585729c9d1d26e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5116",
"triggerID" : "276f13d6efd00b301b232b286d585729c9d1d26e",
"triggerType" : "PUSH"
}, {
"hash" : "31b0669d7b638bd65a17b22a2ceb772f2627512c",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "31b0669d7b638bd65a17b22a2ceb772f2627512c",
"triggerType" : "PUSH"
}, {
"hash" : "096e26af39a477ffccbee0edd764493e12e15e71",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5124",
"triggerID" : "096e26af39a477ffccbee0edd764493e12e15e71",
"triggerType" : "PUSH"
}, {
"hash" : "97dd5ec7c9246f6d9f467b9076b790dd6017c5b4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5213",
"triggerID" : "97dd5ec7c9246f6d9f467b9076b790dd6017c5b4",
"triggerType" : "PUSH"
}, {
"hash" : "0538475fe488089c4cb3bc0afb63c2f518329969",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5257",
"triggerID" : "0538475fe488089c4cb3bc0afb63c2f518329969",
"triggerType" : "PUSH"
}, {
"hash" : "9f4b334e340fb26004e1b07fc8fbaaa047c76775",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5261",
"triggerID" : "9f4b334e340fb26004e1b07fc8fbaaa047c76775",
"triggerType" : "PUSH"
}, {
"hash" : "368c099820c3cbf57496d0e46d1858aa8eb153ee",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5330",
"triggerID" : "368c099820c3cbf57496d0e46d1858aa8eb153ee",
"triggerType" : "PUSH"
}, {
"hash" : "28a5a4f537544d35dfcd8700a7b97fb7216682ce",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "28a5a4f537544d35dfcd8700a7b97fb7216682ce",
"triggerType" : "PUSH"
}, {
"hash" : "08ffdd8b47d147c9b5c889a5f56e39b9b140612d",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5351",
"triggerID" : "08ffdd8b47d147c9b5c889a5f56e39b9b140612d",
"triggerType" : "PUSH"
}, {
"hash" : "c09e228f7cce78a7dbbc394e93b3cf8c6c3d4d5f",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "c09e228f7cce78a7dbbc394e93b3cf8c6c3d4d5f",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 77d11131baabd1c4e3cc2050337daca4df5f6427 UNKNOWN
* 3d9c2ae28da858d1e8476052c99391015effb7db UNKNOWN
* 31b0669d7b638bd65a17b22a2ceb772f2627512c UNKNOWN
* 28a5a4f537544d35dfcd8700a7b97fb7216682ce UNKNOWN
* 08ffdd8b47d147c9b5c889a5f56e39b9b140612d Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5351)
* c09e228f7cce78a7dbbc394e93b3cf8c6c3d4d5f UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #4556: [HUDI-3191][Stacked on 4531] Removing duplicating file-listing process w/in Hive's MOR `FIleInputFormat`s
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #4556:
URL: https://github.com/apache/hudi/pull/4556#issuecomment-1012681460
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "d87786af43a7aeba7549cc3cfcbd97fc312bee0e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5074",
"triggerID" : "d87786af43a7aeba7549cc3cfcbd97fc312bee0e",
"triggerType" : "PUSH"
}, {
"hash" : "4b87ba1474be575ec27109ccbe626e4c2fc9c224",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5077",
"triggerID" : "4b87ba1474be575ec27109ccbe626e4c2fc9c224",
"triggerType" : "PUSH"
}, {
"hash" : "77d11131baabd1c4e3cc2050337daca4df5f6427",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "77d11131baabd1c4e3cc2050337daca4df5f6427",
"triggerType" : "PUSH"
}, {
"hash" : "3d9c2ae28da858d1e8476052c99391015effb7db",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "3d9c2ae28da858d1e8476052c99391015effb7db",
"triggerType" : "PUSH"
}, {
"hash" : "79ac9affcb7f81497e0df755c8200638d35b02b7",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5081",
"triggerID" : "79ac9affcb7f81497e0df755c8200638d35b02b7",
"triggerType" : "PUSH"
}, {
"hash" : "3c14bbe6c6bcf49c4164c45e82f77b473f4de396",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5113",
"triggerID" : "3c14bbe6c6bcf49c4164c45e82f77b473f4de396",
"triggerType" : "PUSH"
}, {
"hash" : "276f13d6efd00b301b232b286d585729c9d1d26e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5116",
"triggerID" : "276f13d6efd00b301b232b286d585729c9d1d26e",
"triggerType" : "PUSH"
}, {
"hash" : "31b0669d7b638bd65a17b22a2ceb772f2627512c",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "31b0669d7b638bd65a17b22a2ceb772f2627512c",
"triggerType" : "PUSH"
}, {
"hash" : "096e26af39a477ffccbee0edd764493e12e15e71",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5124",
"triggerID" : "096e26af39a477ffccbee0edd764493e12e15e71",
"triggerType" : "PUSH"
}, {
"hash" : "97dd5ec7c9246f6d9f467b9076b790dd6017c5b4",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "97dd5ec7c9246f6d9f467b9076b790dd6017c5b4",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 77d11131baabd1c4e3cc2050337daca4df5f6427 UNKNOWN
* 3d9c2ae28da858d1e8476052c99391015effb7db UNKNOWN
* 31b0669d7b638bd65a17b22a2ceb772f2627512c UNKNOWN
* 096e26af39a477ffccbee0edd764493e12e15e71 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5124)
* 97dd5ec7c9246f6d9f467b9076b790dd6017c5b4 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #4556: [HUDI-3191][Stacked on 4531] Removing duplicating file-listing process w/in Hive's MOR `FIleInputFormat`s
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #4556:
URL: https://github.com/apache/hudi/pull/4556#issuecomment-1013378615
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "d87786af43a7aeba7549cc3cfcbd97fc312bee0e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5074",
"triggerID" : "d87786af43a7aeba7549cc3cfcbd97fc312bee0e",
"triggerType" : "PUSH"
}, {
"hash" : "4b87ba1474be575ec27109ccbe626e4c2fc9c224",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5077",
"triggerID" : "4b87ba1474be575ec27109ccbe626e4c2fc9c224",
"triggerType" : "PUSH"
}, {
"hash" : "77d11131baabd1c4e3cc2050337daca4df5f6427",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "77d11131baabd1c4e3cc2050337daca4df5f6427",
"triggerType" : "PUSH"
}, {
"hash" : "3d9c2ae28da858d1e8476052c99391015effb7db",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "3d9c2ae28da858d1e8476052c99391015effb7db",
"triggerType" : "PUSH"
}, {
"hash" : "79ac9affcb7f81497e0df755c8200638d35b02b7",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5081",
"triggerID" : "79ac9affcb7f81497e0df755c8200638d35b02b7",
"triggerType" : "PUSH"
}, {
"hash" : "3c14bbe6c6bcf49c4164c45e82f77b473f4de396",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5113",
"triggerID" : "3c14bbe6c6bcf49c4164c45e82f77b473f4de396",
"triggerType" : "PUSH"
}, {
"hash" : "276f13d6efd00b301b232b286d585729c9d1d26e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5116",
"triggerID" : "276f13d6efd00b301b232b286d585729c9d1d26e",
"triggerType" : "PUSH"
}, {
"hash" : "31b0669d7b638bd65a17b22a2ceb772f2627512c",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "31b0669d7b638bd65a17b22a2ceb772f2627512c",
"triggerType" : "PUSH"
}, {
"hash" : "096e26af39a477ffccbee0edd764493e12e15e71",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5124",
"triggerID" : "096e26af39a477ffccbee0edd764493e12e15e71",
"triggerType" : "PUSH"
}, {
"hash" : "97dd5ec7c9246f6d9f467b9076b790dd6017c5b4",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5213",
"triggerID" : "97dd5ec7c9246f6d9f467b9076b790dd6017c5b4",
"triggerType" : "PUSH"
}, {
"hash" : "0538475fe488089c4cb3bc0afb63c2f518329969",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "0538475fe488089c4cb3bc0afb63c2f518329969",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 77d11131baabd1c4e3cc2050337daca4df5f6427 UNKNOWN
* 3d9c2ae28da858d1e8476052c99391015effb7db UNKNOWN
* 31b0669d7b638bd65a17b22a2ceb772f2627512c UNKNOWN
* 97dd5ec7c9246f6d9f467b9076b790dd6017c5b4 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5213)
* 0538475fe488089c4cb3bc0afb63c2f518329969 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] alexeykudinkin commented on a change in pull request #4556: [HUDI-3191] Removing duplicating file-listing process w/in Hive's MOR `FileInputFormat`s
Posted by GitBox <gi...@apache.org>.
alexeykudinkin commented on a change in pull request #4556:
URL: https://github.com/apache/hudi/pull/4556#discussion_r791350725
##########
File path: hudi-client/hudi-spark-client/src/test/java/org/apache/hudi/table/functional/TestHoodieSparkMergeOnReadTableRollback.java
##########
@@ -201,8 +206,10 @@ void testRollbackWithDeltaAndCompactionCommit(boolean rollbackUsingMarkers) thro
copyOfRecords = dataGen.generateUpdates(commitTime1, copyOfRecords);
copyOfRecords.addAll(dataGen.generateInserts(commitTime1, 200));
- List<String> dataFiles = tableView.getLatestBaseFiles().map(HoodieBaseFile::getPath).collect(Collectors.toList());
- List<GenericRecord> recordsRead = HoodieMergeOnReadTestUtils.getRecordsUsingInputFormat(hadoopConf(), dataFiles,
+ List<String> inputPaths = tableView.getLatestBaseFiles()
+ .map(baseFile -> new Path(baseFile.getPath()).getParent().toString())
+ .collect(Collectors.toList());
Review comment:
Preserving existing behavior
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #4556: [HUDI-3191] Removing duplicating file-listing process w/in Hive's MOR `FileInputFormat`s
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #4556:
URL: https://github.com/apache/hudi/pull/4556#issuecomment-1018912156
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "d87786af43a7aeba7549cc3cfcbd97fc312bee0e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5074",
"triggerID" : "d87786af43a7aeba7549cc3cfcbd97fc312bee0e",
"triggerType" : "PUSH"
}, {
"hash" : "4b87ba1474be575ec27109ccbe626e4c2fc9c224",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5077",
"triggerID" : "4b87ba1474be575ec27109ccbe626e4c2fc9c224",
"triggerType" : "PUSH"
}, {
"hash" : "77d11131baabd1c4e3cc2050337daca4df5f6427",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "77d11131baabd1c4e3cc2050337daca4df5f6427",
"triggerType" : "PUSH"
}, {
"hash" : "3d9c2ae28da858d1e8476052c99391015effb7db",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "3d9c2ae28da858d1e8476052c99391015effb7db",
"triggerType" : "PUSH"
}, {
"hash" : "79ac9affcb7f81497e0df755c8200638d35b02b7",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5081",
"triggerID" : "79ac9affcb7f81497e0df755c8200638d35b02b7",
"triggerType" : "PUSH"
}, {
"hash" : "3c14bbe6c6bcf49c4164c45e82f77b473f4de396",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5113",
"triggerID" : "3c14bbe6c6bcf49c4164c45e82f77b473f4de396",
"triggerType" : "PUSH"
}, {
"hash" : "276f13d6efd00b301b232b286d585729c9d1d26e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5116",
"triggerID" : "276f13d6efd00b301b232b286d585729c9d1d26e",
"triggerType" : "PUSH"
}, {
"hash" : "31b0669d7b638bd65a17b22a2ceb772f2627512c",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "31b0669d7b638bd65a17b22a2ceb772f2627512c",
"triggerType" : "PUSH"
}, {
"hash" : "096e26af39a477ffccbee0edd764493e12e15e71",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5124",
"triggerID" : "096e26af39a477ffccbee0edd764493e12e15e71",
"triggerType" : "PUSH"
}, {
"hash" : "97dd5ec7c9246f6d9f467b9076b790dd6017c5b4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5213",
"triggerID" : "97dd5ec7c9246f6d9f467b9076b790dd6017c5b4",
"triggerType" : "PUSH"
}, {
"hash" : "0538475fe488089c4cb3bc0afb63c2f518329969",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5257",
"triggerID" : "0538475fe488089c4cb3bc0afb63c2f518329969",
"triggerType" : "PUSH"
}, {
"hash" : "9f4b334e340fb26004e1b07fc8fbaaa047c76775",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5261",
"triggerID" : "9f4b334e340fb26004e1b07fc8fbaaa047c76775",
"triggerType" : "PUSH"
}, {
"hash" : "368c099820c3cbf57496d0e46d1858aa8eb153ee",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5330",
"triggerID" : "368c099820c3cbf57496d0e46d1858aa8eb153ee",
"triggerType" : "PUSH"
}, {
"hash" : "28a5a4f537544d35dfcd8700a7b97fb7216682ce",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "28a5a4f537544d35dfcd8700a7b97fb7216682ce",
"triggerType" : "PUSH"
}, {
"hash" : "08ffdd8b47d147c9b5c889a5f56e39b9b140612d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5351",
"triggerID" : "08ffdd8b47d147c9b5c889a5f56e39b9b140612d",
"triggerType" : "PUSH"
}, {
"hash" : "c09e228f7cce78a7dbbc394e93b3cf8c6c3d4d5f",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "c09e228f7cce78a7dbbc394e93b3cf8c6c3d4d5f",
"triggerType" : "PUSH"
}, {
"hash" : "8dadbf672d4d27505592f18bc89422fd7c013669",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5398",
"triggerID" : "8dadbf672d4d27505592f18bc89422fd7c013669",
"triggerType" : "PUSH"
}, {
"hash" : "906607be5bd62ee1cbbda34acb6a89916c1f7aee",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5424",
"triggerID" : "906607be5bd62ee1cbbda34acb6a89916c1f7aee",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 77d11131baabd1c4e3cc2050337daca4df5f6427 UNKNOWN
* 3d9c2ae28da858d1e8476052c99391015effb7db UNKNOWN
* 31b0669d7b638bd65a17b22a2ceb772f2627512c UNKNOWN
* 28a5a4f537544d35dfcd8700a7b97fb7216682ce UNKNOWN
* c09e228f7cce78a7dbbc394e93b3cf8c6c3d4d5f UNKNOWN
* 906607be5bd62ee1cbbda34acb6a89916c1f7aee Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5424)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] alexeykudinkin commented on a change in pull request #4556: [HUDI-3191] Removing duplicating file-listing process w/in Hive's MOR `FileInputFormat`s
Posted by GitBox <gi...@apache.org>.
alexeykudinkin commented on a change in pull request #4556:
URL: https://github.com/apache/hudi/pull/4556#discussion_r791350112
##########
File path: hudi-client/hudi-spark-client/src/test/java/org/apache/hudi/table/TestHoodieMergeOnReadTable.java
##########
@@ -189,8 +190,10 @@ public void testUpsertPartitioner(boolean populateMetaFields) throws Exception {
assertTrue(fileIdToNewSize.entrySet().stream().anyMatch(entry -> fileIdToSize.get(entry.getKey()) < entry.getValue()));
- List<String> dataFiles = roView.getLatestBaseFiles().map(HoodieBaseFile::getPath).collect(Collectors.toList());
- List<GenericRecord> recordsRead = HoodieMergeOnReadTestUtils.getRecordsUsingInputFormat(hadoopConf(), dataFiles,
+ List<String> inputPaths = roView.getLatestBaseFiles()
+ .map(baseFile -> new Path(baseFile.getPath()).getParent().toString())
+ .collect(Collectors.toList());
Review comment:
Yes, these are correct -- previously they were actually working correctly just b/c we did the double file-listing (w/in `getRealtimeSplits`).
I have to pass _partition paths_, not base-file paths.
##########
File path: hudi-client/hudi-spark-client/src/test/java/org/apache/hudi/table/functional/TestHoodieSparkMergeOnReadTableRollback.java
##########
@@ -166,10 +169,12 @@ void testRollbackWithDeltaAndCompactionCommit(boolean rollbackUsingMarkers) thro
JavaRDD<HoodieRecord> writeRecords = jsc().parallelize(records, 1);
JavaRDD<WriteStatus> writeStatusJavaRDD = client.upsert(writeRecords, newCommitTime);
- client.commit(newCommitTime, writeStatusJavaRDD);
+
List<WriteStatus> statuses = writeStatusJavaRDD.collect();
assertNoWriteErrors(statuses);
+ client.commit(newCommitTime, jsc().parallelize(statuses));
+
Review comment:
These tests are actually written incorrectly -- they're dereferencing RDDs twice w/in `commit` and when the collect w/in the state itself. This leads to same base-files being double-written, which in turn fails assertion that i currently put in place to make sure that legacy flow and the new one yield identical results.
##########
File path: hudi-client/hudi-spark-client/src/test/java/org/apache/hudi/table/functional/TestHoodieSparkMergeOnReadTableRollback.java
##########
@@ -201,8 +206,10 @@ void testRollbackWithDeltaAndCompactionCommit(boolean rollbackUsingMarkers) thro
copyOfRecords = dataGen.generateUpdates(commitTime1, copyOfRecords);
copyOfRecords.addAll(dataGen.generateInserts(commitTime1, 200));
- List<String> dataFiles = tableView.getLatestBaseFiles().map(HoodieBaseFile::getPath).collect(Collectors.toList());
- List<GenericRecord> recordsRead = HoodieMergeOnReadTestUtils.getRecordsUsingInputFormat(hadoopConf(), dataFiles,
+ List<String> inputPaths = tableView.getLatestBaseFiles()
+ .map(baseFile -> new Path(baseFile.getPath()).getParent().toString())
+ .collect(Collectors.toList());
Review comment:
Preserving existing behavior
##########
File path: hudi-client/hudi-spark-client/src/test/java/org/apache/hudi/table/functional/TestHoodieSparkMergeOnReadTableRollback.java
##########
@@ -201,8 +206,10 @@ void testRollbackWithDeltaAndCompactionCommit(boolean rollbackUsingMarkers) thro
copyOfRecords = dataGen.generateUpdates(commitTime1, copyOfRecords);
copyOfRecords.addAll(dataGen.generateInserts(commitTime1, 200));
- List<String> dataFiles = tableView.getLatestBaseFiles().map(HoodieBaseFile::getPath).collect(Collectors.toList());
- List<GenericRecord> recordsRead = HoodieMergeOnReadTestUtils.getRecordsUsingInputFormat(hadoopConf(), dataFiles,
+ List<String> inputPaths = tableView.getLatestBaseFiles()
+ .map(baseFile -> new Path(baseFile.getPath()).getParent().toString())
+ .collect(Collectors.toList());
Review comment:
Preserving existing behavior (hence keeping lists instead of Sets)
##########
File path: hudi-client/hudi-spark-client/src/test/java/org/apache/hudi/table/functional/TestHoodieSparkMergeOnReadTableRollback.java
##########
@@ -268,11 +281,13 @@ void testRollbackWithDeltaAndCompactionCommit(boolean rollbackUsingMarkers) thro
thirdClient.startCommitWithTime(newCommitTime);
writeStatusJavaRDD = thirdClient.upsert(writeRecords, newCommitTime);
+
statuses = writeStatusJavaRDD.collect();
- thirdClient.commit(newCommitTime, writeStatusJavaRDD);
// Verify there are no errors
assertNoWriteErrors(statuses);
+ thirdClient.commit(newCommitTime, jsc().parallelize(statuses));
+
Review comment:
Replied above
##########
File path: hudi-client/hudi-spark-client/src/test/java/org/apache/hudi/table/functional/TestHoodieSparkMergeOnReadTableRollback.java
##########
@@ -361,15 +386,19 @@ void testMultiRollbackWithDeltaAndCompactionCommit() throws Exception {
copyOfRecords = dataGen.generateUpdates(newCommitTime, copyOfRecords);
copyOfRecords.addAll(dataGen.generateInserts(newCommitTime, 200));
- List<String> dataFiles = tableView.getLatestBaseFiles().map(hf -> hf.getPath()).collect(Collectors.toList());
+ List<String> dataFiles = tableView.getLatestBaseFiles()
+ .map(baseFile -> new Path(baseFile.getPath()).getParent().toString())
+ .collect(Collectors.toList());
List<GenericRecord> recordsRead = HoodieMergeOnReadTestUtils.getRecordsUsingInputFormat(hadoopConf(), dataFiles,
basePath());
assertEquals(200, recordsRead.size());
statuses = nClient.upsert(jsc().parallelize(copyOfRecords, 1), newCommitTime).collect();
// Verify there are no errors
assertNoWriteErrors(statuses);
- nClient.commit(newCommitTime, writeStatusJavaRDD);
+
+ nClient.commit(newCommitTime, jsc().parallelize(statuses));
+
Review comment:
These are not cosmetic -- these are real test failures fixes (fixes base-files double-writing)
##########
File path: hudi-common/src/main/scala/org/apache/hudi/HoodieTableFileIndexBase.scala
##########
@@ -87,6 +89,12 @@ abstract class HoodieTableFileIndexBase(engineContext: HoodieEngineContext,
refresh0()
+ /**
+ * Returns latest completed instant as seen by this instance of the file-index
+ */
+ def latestCompletedInstant(): Option[HoodieInstant] =
Review comment:
I think this is the approach we do take in Java, but in Scala this seems to be off (since you don't add braces at the end of the file-name so get-prefix feels off.
##########
File path: hudi-hadoop-mr/src/main/java/org/apache/hudi/hadoop/BootstrapBaseFileSplit.java
##########
@@ -32,10 +32,6 @@
private FileSplit bootstrapFileSplit;
- public BootstrapBaseFileSplit() {
- super();
- }
Review comment:
Yeah, this isn't used outside of our codebase
##########
File path: hudi-hadoop-mr/src/main/java/org/apache/hudi/hadoop/HoodieFileInputFormatBase.java
##########
@@ -143,6 +121,124 @@ private static FileStatus getFileStatusUnchecked(Option<HoodieBaseFile> baseFile
return returns.toArray(new FileStatus[0]);
}
+ private void validate(List<FileStatus> targetFiles, List<FileStatus> legacyFileStatuses) {
Review comment:
Moved methods aren't actually changing in here
##########
File path: hudi-hadoop-mr/src/main/java/org/apache/hudi/hadoop/HoodieFileInputFormatBase.java
##########
@@ -143,6 +121,127 @@ private static FileStatus getFileStatusUnchecked(Option<HoodieBaseFile> baseFile
return returns.toArray(new FileStatus[0]);
}
+ private void validate(List<FileStatus> targetFiles, List<FileStatus> legacyFileStatuses) {
+ List<FileStatus> diff = CollectionUtils.diff(targetFiles, legacyFileStatuses);
+ checkState(diff.isEmpty(), "Should be empty");
+ }
+
+ @Nonnull
+ private static FileStatus getFileStatusUnchecked(HoodieBaseFile baseFile) {
+ try {
+ return HoodieInputFormatUtils.getFileStatus(baseFile);
+ } catch (IOException ioe) {
+ throw new HoodieIOException("Failed to get file-status", ioe);
+ }
+ }
+
+ /**
+ * Abstracts and exposes {@link FileInputFormat#listStatus(JobConf)} operation to subclasses that
+ * lists files (returning an array of {@link FileStatus}) corresponding to the input paths specified
+ * as part of provided {@link JobConf}
+ */
+ protected final FileStatus[] doListStatus(JobConf job) throws IOException {
+ return super.listStatus(job);
+ }
+
+ /**
+ * Achieves listStatus functionality for an incrementally queried table. Instead of listing all
+ * partitions and then filtering based on the commits of interest, this logic first extracts the
+ * partitions touched by the desired commits and then lists only those partitions.
+ */
+ protected List<FileStatus> listStatusForIncrementalMode(JobConf job,
+ HoodieTableMetaClient tableMetaClient,
+ List<Path> inputPaths,
+ String incrementalTable) throws IOException {
+ String tableName = tableMetaClient.getTableConfig().getTableName();
+ Job jobContext = Job.getInstance(job);
+ Option<HoodieTimeline> timeline = HoodieInputFormatUtils.getFilteredCommitsTimeline(jobContext, tableMetaClient);
+ if (!timeline.isPresent()) {
+ return null;
+ }
+ Option<List<HoodieInstant>> commitsToCheck = HoodieInputFormatUtils.getCommitsForIncrementalQuery(jobContext, tableName, timeline.get());
+ if (!commitsToCheck.isPresent()) {
+ return null;
+ }
+ Option<String> incrementalInputPaths = HoodieInputFormatUtils.getAffectedPartitions(commitsToCheck.get(), tableMetaClient, timeline.get(), inputPaths);
+ // Mutate the JobConf to set the input paths to only partitions touched by incremental pull.
+ if (!incrementalInputPaths.isPresent()) {
+ return null;
+ }
+ setInputPaths(job, incrementalInputPaths.get());
+ FileStatus[] fileStatuses = doListStatus(job);
+ return HoodieInputFormatUtils.filterIncrementalFileStatus(jobContext, tableMetaClient, timeline.get(), fileStatuses, commitsToCheck.get());
+ }
+
+ protected abstract boolean includeLogFilesForSnapshotView();
+
+ @Nonnull
+ private static RealtimeFileStatus createRealtimeFileStatusUnchecked(HoodieBaseFile baseFile,
+ Stream<HoodieLogFile> logFiles,
+ Option<HoodieInstant> latestCompletedInstantOpt,
+ HoodieTableMetaClient tableMetaClient) {
+ List<HoodieLogFile> sortedLogFiles = logFiles.sorted(HoodieLogFile.getLogFileComparator()).collect(Collectors.toList());
+ FileStatus baseFileStatus = getFileStatusUnchecked(baseFile);
+ try {
+ RealtimeFileStatus rtFileStatus = new RealtimeFileStatus(baseFileStatus);
+ rtFileStatus.setDeltaLogFiles(sortedLogFiles);
+ rtFileStatus.setBaseFilePath(baseFile.getPath());
+ rtFileStatus.setBasePath(tableMetaClient.getBasePath());
+
+ if (latestCompletedInstantOpt.isPresent()) {
+ HoodieInstant latestCompletedInstant = latestCompletedInstantOpt.get();
+ checkState(latestCompletedInstant.isCompleted());
+
+ rtFileStatus.setMaxCommitTime(latestCompletedInstant.getTimestamp());
+ }
+
+ if (baseFileStatus instanceof LocatedFileStatusWithBootstrapBaseFile || baseFileStatus instanceof FileStatusWithBootstrapBaseFile) {
+ rtFileStatus.setBootStrapFileStatus(baseFileStatus);
+ }
+
+ return rtFileStatus;
+ } catch (IOException e) {
+ throw new HoodieIOException(String.format("Failed to init %s", RealtimeFileStatus.class.getSimpleName()), e);
+ }
+ }
+
+ @Nonnull
+ private List<FileStatus> listStatusForSnapshotModeLegacy(JobConf job, Map<String, HoodieTableMetaClient> tableMetaClientMap, List<Path> snapshotPaths) throws IOException {
+ return HoodieInputFormatUtils.filterFileStatusForSnapshotMode(job, tableMetaClientMap, snapshotPaths, includeLogFilesForSnapshotView());
+ }
+
+ @Nonnull
+ private static RealtimeFileStatus createRealtimeFileStatusUnchecked(HoodieLogFile latestLogFile,
+ Stream<HoodieLogFile> logFiles,
+ Option<HoodieInstant> latestCompletedInstantOpt,
+ HoodieTableMetaClient tableMetaClient) {
+ List<HoodieLogFile> sortedLogFiles = logFiles.sorted(HoodieLogFile.getLogFileComparator()).collect(Collectors.toList());
+ try {
+ RealtimeFileStatus rtFileStatus = new RealtimeFileStatus(latestLogFile.getFileStatus());
+ rtFileStatus.setDeltaLogFiles(sortedLogFiles);
+ rtFileStatus.setBasePath(tableMetaClient.getBasePath());
+
+ if (latestCompletedInstantOpt.isPresent()) {
+ HoodieInstant latestCompletedInstant = latestCompletedInstantOpt.get();
+ checkState(latestCompletedInstant.isCompleted());
Review comment:
I think we should control all assertion centrally (ie being to toggle on/off all of the assertions holistically) and i would prefer to have this assertion (since it's not bringing any performance penalty along)
##########
File path: hudi-hadoop-mr/src/main/java/org/apache/hudi/hadoop/HoodieFileInputFormatBase.java
##########
@@ -143,6 +121,127 @@ private static FileStatus getFileStatusUnchecked(Option<HoodieBaseFile> baseFile
return returns.toArray(new FileStatus[0]);
}
+ private void validate(List<FileStatus> targetFiles, List<FileStatus> legacyFileStatuses) {
+ List<FileStatus> diff = CollectionUtils.diff(targetFiles, legacyFileStatuses);
+ checkState(diff.isEmpty(), "Should be empty");
+ }
+
+ @Nonnull
+ private static FileStatus getFileStatusUnchecked(HoodieBaseFile baseFile) {
+ try {
+ return HoodieInputFormatUtils.getFileStatus(baseFile);
+ } catch (IOException ioe) {
+ throw new HoodieIOException("Failed to get file-status", ioe);
+ }
+ }
+
+ /**
+ * Abstracts and exposes {@link FileInputFormat#listStatus(JobConf)} operation to subclasses that
+ * lists files (returning an array of {@link FileStatus}) corresponding to the input paths specified
+ * as part of provided {@link JobConf}
+ */
+ protected final FileStatus[] doListStatus(JobConf job) throws IOException {
+ return super.listStatus(job);
+ }
+
+ /**
+ * Achieves listStatus functionality for an incrementally queried table. Instead of listing all
+ * partitions and then filtering based on the commits of interest, this logic first extracts the
+ * partitions touched by the desired commits and then lists only those partitions.
+ */
+ protected List<FileStatus> listStatusForIncrementalMode(JobConf job,
+ HoodieTableMetaClient tableMetaClient,
+ List<Path> inputPaths,
+ String incrementalTable) throws IOException {
+ String tableName = tableMetaClient.getTableConfig().getTableName();
+ Job jobContext = Job.getInstance(job);
+ Option<HoodieTimeline> timeline = HoodieInputFormatUtils.getFilteredCommitsTimeline(jobContext, tableMetaClient);
+ if (!timeline.isPresent()) {
+ return null;
+ }
+ Option<List<HoodieInstant>> commitsToCheck = HoodieInputFormatUtils.getCommitsForIncrementalQuery(jobContext, tableName, timeline.get());
+ if (!commitsToCheck.isPresent()) {
+ return null;
+ }
+ Option<String> incrementalInputPaths = HoodieInputFormatUtils.getAffectedPartitions(commitsToCheck.get(), tableMetaClient, timeline.get(), inputPaths);
+ // Mutate the JobConf to set the input paths to only partitions touched by incremental pull.
+ if (!incrementalInputPaths.isPresent()) {
+ return null;
+ }
+ setInputPaths(job, incrementalInputPaths.get());
+ FileStatus[] fileStatuses = doListStatus(job);
+ return HoodieInputFormatUtils.filterIncrementalFileStatus(jobContext, tableMetaClient, timeline.get(), fileStatuses, commitsToCheck.get());
+ }
+
+ protected abstract boolean includeLogFilesForSnapshotView();
+
+ @Nonnull
+ private static RealtimeFileStatus createRealtimeFileStatusUnchecked(HoodieBaseFile baseFile,
Review comment:
These are simple ctor-like methods which are private in scope. What do you like to see as a description for it?
##########
File path: hudi-hadoop-mr/src/main/java/org/apache/hudi/hadoop/PathWithLogFilePath.java
##########
@@ -31,7 +31,7 @@
*/
public class PathWithLogFilePath extends Path {
// a flag to mark this split is produced by incremental query or not.
- private boolean belongToIncrementalPath = false;
+ private boolean belongsToIncrementalPath = false;
Review comment:
Then unfortunately will double number of stacked PRs -- not taking up any major renamings, other than touch a few files at most (this in particular to bring consistency across classes in naming correspondent fields)
##########
File path: hudi-hadoop-mr/src/main/java/org/apache/hudi/hadoop/HoodieFileInputFormatBase.java
##########
@@ -143,6 +121,124 @@ private static FileStatus getFileStatusUnchecked(Option<HoodieBaseFile> baseFile
return returns.toArray(new FileStatus[0]);
}
+ private void validate(List<FileStatus> targetFiles, List<FileStatus> legacyFileStatuses) {
Review comment:
The reason for re-ordering is to maintain the invariant that you order the methods in the order of loose > strict access (static methods are kept in the same order after all non-static methods). This allows for easier analysis of the hierarchy what's present in which part of the hierarchy and make sure they are structured correctly.
Apologies for the jitter in the review.
##########
File path: hudi-hadoop-mr/src/main/java/org/apache/hudi/hadoop/utils/HoodieRealtimeInputFormatUtils.java
##########
@@ -65,11 +65,71 @@
import java.util.stream.Collectors;
import java.util.stream.Stream;
+import static org.apache.hudi.TypeUtils.unsafeCast;
+import static org.apache.hudi.common.util.ValidationUtils.checkState;
+
public class HoodieRealtimeInputFormatUtils extends HoodieInputFormatUtils {
private static final Logger LOG = LogManager.getLogger(HoodieRealtimeInputFormatUtils.class);
- public static InputSplit[] getRealtimeSplits(Configuration conf, Stream<FileSplit> fileSplits) {
+ public static InputSplit[] getRealtimeSplits(Configuration conf, List<FileSplit> fileSplits) throws IOException {
Review comment:
Simply limiting the amount of changes to avoid changing too many things at the same time
##########
File path: hudi-hadoop-mr/src/main/java/org/apache/hudi/hadoop/realtime/RealtimeBootstrapBaseFileSplit.java
##########
@@ -43,17 +43,20 @@
private String basePath;
- public RealtimeBootstrapBaseFileSplit() {
- super();
- }
Review comment:
We should certainly clean up such unnecessary clauses
##########
File path: hudi-hadoop-mr/src/main/java/org/apache/hudi/hadoop/HoodieFileInputFormatBase.java
##########
@@ -187,13 +286,28 @@ private static FileStatus getFileStatusUnchecked(Option<HoodieBaseFile> baseFile
.map(fileSlice -> {
Option<HoodieBaseFile> baseFileOpt = fileSlice.getBaseFile();
Option<HoodieLogFile> latestLogFileOpt = fileSlice.getLatestLogFile();
- if (baseFileOpt.isPresent()) {
- return getFileStatusUnchecked(baseFileOpt);
- } else if (includeLogFilesForSnapShotView() && latestLogFileOpt.isPresent()) {
- return createRealtimeFileStatusUnchecked(latestLogFileOpt.get(), fileSlice.getLogFiles());
+ Stream<HoodieLogFile> logFiles = fileSlice.getLogFiles();
+
+ Option<HoodieInstant> latestCompletedInstantOpt =
+ fromScala(fileIndex.latestCompletedInstant());
+
+ // Check if we're reading a MOR table
+ if (includeLogFilesForSnapshotView()) {
+ if (baseFileOpt.isPresent()) {
+ return createRealtimeFileStatusUnchecked(baseFileOpt.get(), logFiles, latestCompletedInstantOpt, tableMetaClient);
+ } else if (latestLogFileOpt.isPresent()) {
+ return createRealtimeFileStatusUnchecked(latestLogFileOpt.get(), logFiles, latestCompletedInstantOpt, tableMetaClient);
+ } else {
+ throw new IllegalStateException("Invalid state: either base-file or log-file has to be present");
+ }
} else {
- throw new IllegalStateException("Invalid state: either base-file or log-file should be present");
+ if (baseFileOpt.isPresent()) {
+ return getFileStatusUnchecked(baseFileOpt.get());
+ } else {
+ throw new IllegalStateException("Invalid state: base-file has to be present");
+ }
}
Review comment:
`listStatusForSnapshotMode()` is used for both COW/MOR, and whether we're handling COW/MOR is controlled by `includeLogFilesForSnapshotView` (will clean this up in a follow up, cleaning up some assertions after majority of the PRs land)
##########
File path: hudi-hadoop-mr/src/main/java/org/apache/hudi/hadoop/utils/HoodieRealtimeInputFormatUtils.java
##########
@@ -144,28 +204,32 @@
return rtSplits.toArray(new InputSplit[0]);
}
+ /**
+ * @deprecated will be replaced w/ {@link #getRealtimeSplits(Configuration, List)}
+ */
// get IncrementalRealtimeSplits
- public static InputSplit[] getIncrementalRealtimeSplits(Configuration conf, Stream<FileSplit> fileSplits) throws IOException {
+ public static InputSplit[] getIncrementalRealtimeSplits(Configuration conf, List<FileSplit> fileSplits) throws IOException {
+ checkState(fileSplits.stream().allMatch(HoodieRealtimeInputFormatUtils::doesBelongToIncrementalQuery),
+ "All splits have to belong to incremental query");
+
List<InputSplit> rtSplits = new ArrayList<>();
- List<FileSplit> fileSplitList = fileSplits.collect(Collectors.toList());
- Set<Path> partitionSet = fileSplitList.stream().map(f -> f.getPath().getParent()).collect(Collectors.toSet());
+ Set<Path> partitionSet = fileSplits.stream().map(f -> f.getPath().getParent()).collect(Collectors.toSet());
Map<Path, HoodieTableMetaClient> partitionsToMetaClient = getTableMetaClientByPartitionPath(conf, partitionSet);
// Pre process tableConfig from first partition to fetch virtual key info
Option<HoodieVirtualKeyInfo> hoodieVirtualKeyInfo = Option.empty();
if (partitionSet.size() > 0) {
hoodieVirtualKeyInfo = getHoodieVirtualKeyInfo(partitionsToMetaClient.get(partitionSet.iterator().next()));
}
Option<HoodieVirtualKeyInfo> finalHoodieVirtualKeyInfo = hoodieVirtualKeyInfo;
- fileSplitList.stream().forEach(s -> {
+ fileSplits.stream().forEach(s -> {
// deal with incremental query.
try {
if (s instanceof BaseFileWithLogsSplit) {
- BaseFileWithLogsSplit bs = (BaseFileWithLogsSplit)s;
- if (bs.getBelongToIncrementalSplit()) {
- rtSplits.add(new HoodieRealtimeFileSplit(bs, bs.getBasePath(), bs.getDeltaLogFiles(), bs.getMaxCommitTime(), finalHoodieVirtualKeyInfo));
- }
+ BaseFileWithLogsSplit bs = unsafeCast(s);
+ rtSplits.add(new HoodieRealtimeFileSplit(bs, bs.getBasePath(), bs.getDeltaLogFiles(), bs.getMaxCommitTime(), finalHoodieVirtualKeyInfo));
} else if (s instanceof RealtimeBootstrapBaseFileSplit) {
- rtSplits.add(s);
+ RealtimeBootstrapBaseFileSplit bs = unsafeCast(s);
Review comment:
This is Java, sir
:-)
##########
File path: hudi-hadoop-mr/src/main/java/org/apache/hudi/hadoop/utils/HoodieRealtimeInputFormatUtils.java
##########
@@ -65,11 +65,71 @@
import java.util.stream.Collectors;
import java.util.stream.Stream;
+import static org.apache.hudi.TypeUtils.unsafeCast;
+import static org.apache.hudi.common.util.ValidationUtils.checkState;
+
public class HoodieRealtimeInputFormatUtils extends HoodieInputFormatUtils {
private static final Logger LOG = LogManager.getLogger(HoodieRealtimeInputFormatUtils.class);
- public static InputSplit[] getRealtimeSplits(Configuration conf, Stream<FileSplit> fileSplits) {
+ public static InputSplit[] getRealtimeSplits(Configuration conf, List<FileSplit> fileSplits) throws IOException {
+ if (fileSplits.isEmpty()) {
+ return new InputSplit[0];
+ }
+
+ FileSplit fileSplit = fileSplits.get(0);
+
+ // Pre-process table-config to fetch virtual key info
+ Path partitionPath = fileSplit.getPath().getParent();
+ HoodieTableMetaClient metaClient = getTableMetaClientForBasePathUnchecked(conf, partitionPath);
+
+ Option<HoodieVirtualKeyInfo> hoodieVirtualKeyInfoOpt = getHoodieVirtualKeyInfo(metaClient);
+
+ // NOTE: This timeline is kept in sync w/ {@code HoodieTableFileIndexBase}
+ HoodieInstant latestCommitInstant =
+ metaClient.getActiveTimeline().getCommitsTimeline().filterCompletedInstants().lastInstant().get();
+
+ InputSplit[] finalSplits = fileSplits.stream()
+ .map(split -> {
+ // There are 4 types of splits could we have to handle here
+ // - {@code BootstrapBaseFileSplit}: in case base file does have associated bootstrap file,
+ // but does NOT have any log files appended (convert it to {@code RealtimeBootstrapBaseFileSplit})
+ // - {@code RealtimeBootstrapBaseFileSplit}: in case base file does have associated bootstrap file
+ // and does have log files appended
+ // - {@code BaseFileWithLogsSplit}: in case base file does NOT have associated bootstrap file
Review comment:
This will be handled by `else` block
##########
File path: hudi-hadoop-mr/src/main/java/org/apache/hudi/hadoop/realtime/HoodieRealtimeFileSplit.java
##########
@@ -44,9 +44,7 @@
private Option<HoodieVirtualKeyInfo> hoodieVirtualKeyInfo = Option.empty();
- public HoodieRealtimeFileSplit() {
- super();
Review comment:
Superfluous. It's done by default
##########
File path: hudi-hadoop-mr/src/main/java/org/apache/hudi/hadoop/utils/HoodieInputFormatUtils.java
##########
@@ -440,6 +437,9 @@ public static HoodieMetadataConfig buildMetadataConfig(Configuration conf) {
.build();
}
+ /**
+ * @deprecated
+ */
Review comment:
Method will be cleaned up altogether by HUDI-3280
##########
File path: hudi-client/hudi-spark-client/src/test/java/org/apache/hudi/table/functional/TestHoodieSparkMergeOnReadTableRollback.java
##########
@@ -516,8 +556,6 @@ void testMORTableRestore(boolean restoreAfterCompaction) throws Exception {
JavaRDD<HoodieRecord> writeRecords = jsc().parallelize(records, 1);
JavaRDD<WriteStatus> writeStatusJavaRDD = client.upsert(writeRecords, newCommitTime);
client.commit(newCommitTime, writeStatusJavaRDD);
- List<WriteStatus> statuses = writeStatusJavaRDD.collect();
- assertNoWriteErrors(statuses);
Review comment:
We can't actually keep this check, since we can't do double dereference of the RDD
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #4556: [HUDI-3191][Stacked on 4531] Removing duplicating file-listing process w/in Hive's MOR `FIleInputFormat`s
Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #4556:
URL: https://github.com/apache/hudi/pull/4556#issuecomment-1010339059
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "d87786af43a7aeba7549cc3cfcbd97fc312bee0e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5074",
"triggerID" : "d87786af43a7aeba7549cc3cfcbd97fc312bee0e",
"triggerType" : "PUSH"
}, {
"hash" : "4b87ba1474be575ec27109ccbe626e4c2fc9c224",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5077",
"triggerID" : "4b87ba1474be575ec27109ccbe626e4c2fc9c224",
"triggerType" : "PUSH"
}, {
"hash" : "77d11131baabd1c4e3cc2050337daca4df5f6427",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "77d11131baabd1c4e3cc2050337daca4df5f6427",
"triggerType" : "PUSH"
}, {
"hash" : "3d9c2ae28da858d1e8476052c99391015effb7db",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "3d9c2ae28da858d1e8476052c99391015effb7db",
"triggerType" : "PUSH"
}, {
"hash" : "79ac9affcb7f81497e0df755c8200638d35b02b7",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5081",
"triggerID" : "79ac9affcb7f81497e0df755c8200638d35b02b7",
"triggerType" : "PUSH"
}, {
"hash" : "3c14bbe6c6bcf49c4164c45e82f77b473f4de396",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "3c14bbe6c6bcf49c4164c45e82f77b473f4de396",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 77d11131baabd1c4e3cc2050337daca4df5f6427 UNKNOWN
* 3d9c2ae28da858d1e8476052c99391015effb7db UNKNOWN
* 79ac9affcb7f81497e0df755c8200638d35b02b7 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5081)
* 3c14bbe6c6bcf49c4164c45e82f77b473f4de396 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #4556: [HUDI-3191][Stacked on 4531] Removing duplicating file-listing process w/in Hive's MOR `FIleInputFormat`s
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #4556:
URL: https://github.com/apache/hudi/pull/4556#issuecomment-1009525456
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "d87786af43a7aeba7549cc3cfcbd97fc312bee0e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5074",
"triggerID" : "d87786af43a7aeba7549cc3cfcbd97fc312bee0e",
"triggerType" : "PUSH"
}, {
"hash" : "4b87ba1474be575ec27109ccbe626e4c2fc9c224",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5077",
"triggerID" : "4b87ba1474be575ec27109ccbe626e4c2fc9c224",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 4b87ba1474be575ec27109ccbe626e4c2fc9c224 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5077)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #4556: [HUDI-3191][Stacked on 4531] Removing duplicating file-listing process w/in Hive's MOR `FIleInputFormat`s
Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #4556:
URL: https://github.com/apache/hudi/pull/4556#issuecomment-1009523225
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "d87786af43a7aeba7549cc3cfcbd97fc312bee0e",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5074",
"triggerID" : "d87786af43a7aeba7549cc3cfcbd97fc312bee0e",
"triggerType" : "PUSH"
}, {
"hash" : "4b87ba1474be575ec27109ccbe626e4c2fc9c224",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "4b87ba1474be575ec27109ccbe626e4c2fc9c224",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* d87786af43a7aeba7549cc3cfcbd97fc312bee0e Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5074)
* 4b87ba1474be575ec27109ccbe626e4c2fc9c224 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #4556: [HUDI-3191][Stacked on 4531] Removing duplicating file-listing process w/in Hive's MOR `FIleInputFormat`s
Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #4556:
URL: https://github.com/apache/hudi/pull/4556#issuecomment-1009572755
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "d87786af43a7aeba7549cc3cfcbd97fc312bee0e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5074",
"triggerID" : "d87786af43a7aeba7549cc3cfcbd97fc312bee0e",
"triggerType" : "PUSH"
}, {
"hash" : "4b87ba1474be575ec27109ccbe626e4c2fc9c224",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5077",
"triggerID" : "4b87ba1474be575ec27109ccbe626e4c2fc9c224",
"triggerType" : "PUSH"
}, {
"hash" : "77d11131baabd1c4e3cc2050337daca4df5f6427",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "77d11131baabd1c4e3cc2050337daca4df5f6427",
"triggerType" : "PUSH"
}, {
"hash" : "3d9c2ae28da858d1e8476052c99391015effb7db",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "3d9c2ae28da858d1e8476052c99391015effb7db",
"triggerType" : "PUSH"
}, {
"hash" : "79ac9affcb7f81497e0df755c8200638d35b02b7",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5081",
"triggerID" : "79ac9affcb7f81497e0df755c8200638d35b02b7",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 77d11131baabd1c4e3cc2050337daca4df5f6427 UNKNOWN
* 3d9c2ae28da858d1e8476052c99391015effb7db UNKNOWN
* 79ac9affcb7f81497e0df755c8200638d35b02b7 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5081)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #4556: [HUDI-3191][Stacked on 4531] Removing duplicating file-listing process w/in Hive's MOR `FIleInputFormat`s
Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #4556:
URL: https://github.com/apache/hudi/pull/4556#issuecomment-1010552818
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "d87786af43a7aeba7549cc3cfcbd97fc312bee0e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5074",
"triggerID" : "d87786af43a7aeba7549cc3cfcbd97fc312bee0e",
"triggerType" : "PUSH"
}, {
"hash" : "4b87ba1474be575ec27109ccbe626e4c2fc9c224",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5077",
"triggerID" : "4b87ba1474be575ec27109ccbe626e4c2fc9c224",
"triggerType" : "PUSH"
}, {
"hash" : "77d11131baabd1c4e3cc2050337daca4df5f6427",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "77d11131baabd1c4e3cc2050337daca4df5f6427",
"triggerType" : "PUSH"
}, {
"hash" : "3d9c2ae28da858d1e8476052c99391015effb7db",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "3d9c2ae28da858d1e8476052c99391015effb7db",
"triggerType" : "PUSH"
}, {
"hash" : "79ac9affcb7f81497e0df755c8200638d35b02b7",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5081",
"triggerID" : "79ac9affcb7f81497e0df755c8200638d35b02b7",
"triggerType" : "PUSH"
}, {
"hash" : "3c14bbe6c6bcf49c4164c45e82f77b473f4de396",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5113",
"triggerID" : "3c14bbe6c6bcf49c4164c45e82f77b473f4de396",
"triggerType" : "PUSH"
}, {
"hash" : "276f13d6efd00b301b232b286d585729c9d1d26e",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5116",
"triggerID" : "276f13d6efd00b301b232b286d585729c9d1d26e",
"triggerType" : "PUSH"
}, {
"hash" : "31b0669d7b638bd65a17b22a2ceb772f2627512c",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "31b0669d7b638bd65a17b22a2ceb772f2627512c",
"triggerType" : "PUSH"
}, {
"hash" : "096e26af39a477ffccbee0edd764493e12e15e71",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "096e26af39a477ffccbee0edd764493e12e15e71",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 77d11131baabd1c4e3cc2050337daca4df5f6427 UNKNOWN
* 3d9c2ae28da858d1e8476052c99391015effb7db UNKNOWN
* 276f13d6efd00b301b232b286d585729c9d1d26e Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5116)
* 31b0669d7b638bd65a17b22a2ceb772f2627512c UNKNOWN
* 096e26af39a477ffccbee0edd764493e12e15e71 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] alexeykudinkin commented on a change in pull request #4556: [HUDI-3191] Removing duplicating file-listing process w/in Hive's MOR `FileInputFormat`s
Posted by GitBox <gi...@apache.org>.
alexeykudinkin commented on a change in pull request #4556:
URL: https://github.com/apache/hudi/pull/4556#discussion_r791350112
##########
File path: hudi-client/hudi-spark-client/src/test/java/org/apache/hudi/table/TestHoodieMergeOnReadTable.java
##########
@@ -189,8 +190,10 @@ public void testUpsertPartitioner(boolean populateMetaFields) throws Exception {
assertTrue(fileIdToNewSize.entrySet().stream().anyMatch(entry -> fileIdToSize.get(entry.getKey()) < entry.getValue()));
- List<String> dataFiles = roView.getLatestBaseFiles().map(HoodieBaseFile::getPath).collect(Collectors.toList());
- List<GenericRecord> recordsRead = HoodieMergeOnReadTestUtils.getRecordsUsingInputFormat(hadoopConf(), dataFiles,
+ List<String> inputPaths = roView.getLatestBaseFiles()
+ .map(baseFile -> new Path(baseFile.getPath()).getParent().toString())
+ .collect(Collectors.toList());
Review comment:
Yes, these are correct -- previously they were actually working correctly just b/c we did the double file-listing (w/in `getRealtimeSplits`).
I have to pass _partition paths_, not base-file paths.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #4556: [HUDI-3191] Removing duplicating file-listing process w/in Hive's MOR `FileInputFormat`s
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #4556:
URL: https://github.com/apache/hudi/pull/4556#issuecomment-1020724471
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "d87786af43a7aeba7549cc3cfcbd97fc312bee0e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5074",
"triggerID" : "d87786af43a7aeba7549cc3cfcbd97fc312bee0e",
"triggerType" : "PUSH"
}, {
"hash" : "4b87ba1474be575ec27109ccbe626e4c2fc9c224",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5077",
"triggerID" : "4b87ba1474be575ec27109ccbe626e4c2fc9c224",
"triggerType" : "PUSH"
}, {
"hash" : "77d11131baabd1c4e3cc2050337daca4df5f6427",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "77d11131baabd1c4e3cc2050337daca4df5f6427",
"triggerType" : "PUSH"
}, {
"hash" : "3d9c2ae28da858d1e8476052c99391015effb7db",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "3d9c2ae28da858d1e8476052c99391015effb7db",
"triggerType" : "PUSH"
}, {
"hash" : "79ac9affcb7f81497e0df755c8200638d35b02b7",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5081",
"triggerID" : "79ac9affcb7f81497e0df755c8200638d35b02b7",
"triggerType" : "PUSH"
}, {
"hash" : "3c14bbe6c6bcf49c4164c45e82f77b473f4de396",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5113",
"triggerID" : "3c14bbe6c6bcf49c4164c45e82f77b473f4de396",
"triggerType" : "PUSH"
}, {
"hash" : "276f13d6efd00b301b232b286d585729c9d1d26e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5116",
"triggerID" : "276f13d6efd00b301b232b286d585729c9d1d26e",
"triggerType" : "PUSH"
}, {
"hash" : "31b0669d7b638bd65a17b22a2ceb772f2627512c",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "31b0669d7b638bd65a17b22a2ceb772f2627512c",
"triggerType" : "PUSH"
}, {
"hash" : "096e26af39a477ffccbee0edd764493e12e15e71",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5124",
"triggerID" : "096e26af39a477ffccbee0edd764493e12e15e71",
"triggerType" : "PUSH"
}, {
"hash" : "97dd5ec7c9246f6d9f467b9076b790dd6017c5b4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5213",
"triggerID" : "97dd5ec7c9246f6d9f467b9076b790dd6017c5b4",
"triggerType" : "PUSH"
}, {
"hash" : "0538475fe488089c4cb3bc0afb63c2f518329969",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5257",
"triggerID" : "0538475fe488089c4cb3bc0afb63c2f518329969",
"triggerType" : "PUSH"
}, {
"hash" : "9f4b334e340fb26004e1b07fc8fbaaa047c76775",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5261",
"triggerID" : "9f4b334e340fb26004e1b07fc8fbaaa047c76775",
"triggerType" : "PUSH"
}, {
"hash" : "368c099820c3cbf57496d0e46d1858aa8eb153ee",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5330",
"triggerID" : "368c099820c3cbf57496d0e46d1858aa8eb153ee",
"triggerType" : "PUSH"
}, {
"hash" : "28a5a4f537544d35dfcd8700a7b97fb7216682ce",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "28a5a4f537544d35dfcd8700a7b97fb7216682ce",
"triggerType" : "PUSH"
}, {
"hash" : "08ffdd8b47d147c9b5c889a5f56e39b9b140612d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5351",
"triggerID" : "08ffdd8b47d147c9b5c889a5f56e39b9b140612d",
"triggerType" : "PUSH"
}, {
"hash" : "c09e228f7cce78a7dbbc394e93b3cf8c6c3d4d5f",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "c09e228f7cce78a7dbbc394e93b3cf8c6c3d4d5f",
"triggerType" : "PUSH"
}, {
"hash" : "8dadbf672d4d27505592f18bc89422fd7c013669",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5398",
"triggerID" : "8dadbf672d4d27505592f18bc89422fd7c013669",
"triggerType" : "PUSH"
}, {
"hash" : "906607be5bd62ee1cbbda34acb6a89916c1f7aee",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5424",
"triggerID" : "906607be5bd62ee1cbbda34acb6a89916c1f7aee",
"triggerType" : "PUSH"
}, {
"hash" : "dc1b033f40cea9642f71b8fcff74aa82106726b6",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5484",
"triggerID" : "dc1b033f40cea9642f71b8fcff74aa82106726b6",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 77d11131baabd1c4e3cc2050337daca4df5f6427 UNKNOWN
* 3d9c2ae28da858d1e8476052c99391015effb7db UNKNOWN
* 31b0669d7b638bd65a17b22a2ceb772f2627512c UNKNOWN
* 28a5a4f537544d35dfcd8700a7b97fb7216682ce UNKNOWN
* c09e228f7cce78a7dbbc394e93b3cf8c6c3d4d5f UNKNOWN
* dc1b033f40cea9642f71b8fcff74aa82106726b6 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5484)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #4556: [HUDI-3191] Removing duplicating file-listing process w/in Hive's MOR `FileInputFormat`s
Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #4556:
URL: https://github.com/apache/hudi/pull/4556#issuecomment-1018912156
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #4556: [HUDI-3191][Stacked on 4716] Removing duplicating file-listing process w/in Hive's MOR `FileInputFormat`s
Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #4556:
URL: https://github.com/apache/hudi/pull/4556#issuecomment-1026281702
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "d87786af43a7aeba7549cc3cfcbd97fc312bee0e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5074",
"triggerID" : "d87786af43a7aeba7549cc3cfcbd97fc312bee0e",
"triggerType" : "PUSH"
}, {
"hash" : "4b87ba1474be575ec27109ccbe626e4c2fc9c224",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5077",
"triggerID" : "4b87ba1474be575ec27109ccbe626e4c2fc9c224",
"triggerType" : "PUSH"
}, {
"hash" : "77d11131baabd1c4e3cc2050337daca4df5f6427",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "77d11131baabd1c4e3cc2050337daca4df5f6427",
"triggerType" : "PUSH"
}, {
"hash" : "3d9c2ae28da858d1e8476052c99391015effb7db",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "3d9c2ae28da858d1e8476052c99391015effb7db",
"triggerType" : "PUSH"
}, {
"hash" : "79ac9affcb7f81497e0df755c8200638d35b02b7",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5081",
"triggerID" : "79ac9affcb7f81497e0df755c8200638d35b02b7",
"triggerType" : "PUSH"
}, {
"hash" : "3c14bbe6c6bcf49c4164c45e82f77b473f4de396",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5113",
"triggerID" : "3c14bbe6c6bcf49c4164c45e82f77b473f4de396",
"triggerType" : "PUSH"
}, {
"hash" : "276f13d6efd00b301b232b286d585729c9d1d26e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5116",
"triggerID" : "276f13d6efd00b301b232b286d585729c9d1d26e",
"triggerType" : "PUSH"
}, {
"hash" : "31b0669d7b638bd65a17b22a2ceb772f2627512c",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "31b0669d7b638bd65a17b22a2ceb772f2627512c",
"triggerType" : "PUSH"
}, {
"hash" : "096e26af39a477ffccbee0edd764493e12e15e71",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5124",
"triggerID" : "096e26af39a477ffccbee0edd764493e12e15e71",
"triggerType" : "PUSH"
}, {
"hash" : "97dd5ec7c9246f6d9f467b9076b790dd6017c5b4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5213",
"triggerID" : "97dd5ec7c9246f6d9f467b9076b790dd6017c5b4",
"triggerType" : "PUSH"
}, {
"hash" : "0538475fe488089c4cb3bc0afb63c2f518329969",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5257",
"triggerID" : "0538475fe488089c4cb3bc0afb63c2f518329969",
"triggerType" : "PUSH"
}, {
"hash" : "9f4b334e340fb26004e1b07fc8fbaaa047c76775",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5261",
"triggerID" : "9f4b334e340fb26004e1b07fc8fbaaa047c76775",
"triggerType" : "PUSH"
}, {
"hash" : "368c099820c3cbf57496d0e46d1858aa8eb153ee",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5330",
"triggerID" : "368c099820c3cbf57496d0e46d1858aa8eb153ee",
"triggerType" : "PUSH"
}, {
"hash" : "28a5a4f537544d35dfcd8700a7b97fb7216682ce",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "28a5a4f537544d35dfcd8700a7b97fb7216682ce",
"triggerType" : "PUSH"
}, {
"hash" : "08ffdd8b47d147c9b5c889a5f56e39b9b140612d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5351",
"triggerID" : "08ffdd8b47d147c9b5c889a5f56e39b9b140612d",
"triggerType" : "PUSH"
}, {
"hash" : "c09e228f7cce78a7dbbc394e93b3cf8c6c3d4d5f",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "c09e228f7cce78a7dbbc394e93b3cf8c6c3d4d5f",
"triggerType" : "PUSH"
}, {
"hash" : "8dadbf672d4d27505592f18bc89422fd7c013669",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5398",
"triggerID" : "8dadbf672d4d27505592f18bc89422fd7c013669",
"triggerType" : "PUSH"
}, {
"hash" : "906607be5bd62ee1cbbda34acb6a89916c1f7aee",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5424",
"triggerID" : "906607be5bd62ee1cbbda34acb6a89916c1f7aee",
"triggerType" : "PUSH"
}, {
"hash" : "dc1b033f40cea9642f71b8fcff74aa82106726b6",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5484",
"triggerID" : "dc1b033f40cea9642f71b8fcff74aa82106726b6",
"triggerType" : "PUSH"
}, {
"hash" : "5b8f5819fff8fec34864eb409fd429b95be17b9b",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "5b8f5819fff8fec34864eb409fd429b95be17b9b",
"triggerType" : "PUSH"
}, {
"hash" : "13702fc2232ebd9300966b0a917a3358d8d0f18c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5590",
"triggerID" : "13702fc2232ebd9300966b0a917a3358d8d0f18c",
"triggerType" : "PUSH"
}, {
"hash" : "13702fc2232ebd9300966b0a917a3358d8d0f18c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5600",
"triggerID" : "1024845655",
"triggerType" : "MANUAL"
}, {
"hash" : "9bdd8a60f95123f82a5f30f5e68929f5b7e1f8da",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5603",
"triggerID" : "9bdd8a60f95123f82a5f30f5e68929f5b7e1f8da",
"triggerType" : "PUSH"
}, {
"hash" : "aebb9df557c4afe3ca88f6b8b28ba2fbfdcbd597",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5631",
"triggerID" : "aebb9df557c4afe3ca88f6b8b28ba2fbfdcbd597",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 77d11131baabd1c4e3cc2050337daca4df5f6427 UNKNOWN
* 3d9c2ae28da858d1e8476052c99391015effb7db UNKNOWN
* 31b0669d7b638bd65a17b22a2ceb772f2627512c UNKNOWN
* 28a5a4f537544d35dfcd8700a7b97fb7216682ce UNKNOWN
* c09e228f7cce78a7dbbc394e93b3cf8c6c3d4d5f UNKNOWN
* 5b8f5819fff8fec34864eb409fd429b95be17b9b UNKNOWN
* 9bdd8a60f95123f82a5f30f5e68929f5b7e1f8da Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5603)
* aebb9df557c4afe3ca88f6b8b28ba2fbfdcbd597 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5631)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #4556: [HUDI-3191][Stacked on 4716] Removing duplicating file-listing process w/in Hive's MOR `FileInputFormat`s
Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #4556:
URL: https://github.com/apache/hudi/pull/4556#issuecomment-1026391541
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "d87786af43a7aeba7549cc3cfcbd97fc312bee0e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5074",
"triggerID" : "d87786af43a7aeba7549cc3cfcbd97fc312bee0e",
"triggerType" : "PUSH"
}, {
"hash" : "4b87ba1474be575ec27109ccbe626e4c2fc9c224",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5077",
"triggerID" : "4b87ba1474be575ec27109ccbe626e4c2fc9c224",
"triggerType" : "PUSH"
}, {
"hash" : "77d11131baabd1c4e3cc2050337daca4df5f6427",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "77d11131baabd1c4e3cc2050337daca4df5f6427",
"triggerType" : "PUSH"
}, {
"hash" : "3d9c2ae28da858d1e8476052c99391015effb7db",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "3d9c2ae28da858d1e8476052c99391015effb7db",
"triggerType" : "PUSH"
}, {
"hash" : "79ac9affcb7f81497e0df755c8200638d35b02b7",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5081",
"triggerID" : "79ac9affcb7f81497e0df755c8200638d35b02b7",
"triggerType" : "PUSH"
}, {
"hash" : "3c14bbe6c6bcf49c4164c45e82f77b473f4de396",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5113",
"triggerID" : "3c14bbe6c6bcf49c4164c45e82f77b473f4de396",
"triggerType" : "PUSH"
}, {
"hash" : "276f13d6efd00b301b232b286d585729c9d1d26e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5116",
"triggerID" : "276f13d6efd00b301b232b286d585729c9d1d26e",
"triggerType" : "PUSH"
}, {
"hash" : "31b0669d7b638bd65a17b22a2ceb772f2627512c",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "31b0669d7b638bd65a17b22a2ceb772f2627512c",
"triggerType" : "PUSH"
}, {
"hash" : "096e26af39a477ffccbee0edd764493e12e15e71",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5124",
"triggerID" : "096e26af39a477ffccbee0edd764493e12e15e71",
"triggerType" : "PUSH"
}, {
"hash" : "97dd5ec7c9246f6d9f467b9076b790dd6017c5b4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5213",
"triggerID" : "97dd5ec7c9246f6d9f467b9076b790dd6017c5b4",
"triggerType" : "PUSH"
}, {
"hash" : "0538475fe488089c4cb3bc0afb63c2f518329969",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5257",
"triggerID" : "0538475fe488089c4cb3bc0afb63c2f518329969",
"triggerType" : "PUSH"
}, {
"hash" : "9f4b334e340fb26004e1b07fc8fbaaa047c76775",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5261",
"triggerID" : "9f4b334e340fb26004e1b07fc8fbaaa047c76775",
"triggerType" : "PUSH"
}, {
"hash" : "368c099820c3cbf57496d0e46d1858aa8eb153ee",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5330",
"triggerID" : "368c099820c3cbf57496d0e46d1858aa8eb153ee",
"triggerType" : "PUSH"
}, {
"hash" : "28a5a4f537544d35dfcd8700a7b97fb7216682ce",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "28a5a4f537544d35dfcd8700a7b97fb7216682ce",
"triggerType" : "PUSH"
}, {
"hash" : "08ffdd8b47d147c9b5c889a5f56e39b9b140612d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5351",
"triggerID" : "08ffdd8b47d147c9b5c889a5f56e39b9b140612d",
"triggerType" : "PUSH"
}, {
"hash" : "c09e228f7cce78a7dbbc394e93b3cf8c6c3d4d5f",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "c09e228f7cce78a7dbbc394e93b3cf8c6c3d4d5f",
"triggerType" : "PUSH"
}, {
"hash" : "8dadbf672d4d27505592f18bc89422fd7c013669",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5398",
"triggerID" : "8dadbf672d4d27505592f18bc89422fd7c013669",
"triggerType" : "PUSH"
}, {
"hash" : "906607be5bd62ee1cbbda34acb6a89916c1f7aee",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5424",
"triggerID" : "906607be5bd62ee1cbbda34acb6a89916c1f7aee",
"triggerType" : "PUSH"
}, {
"hash" : "dc1b033f40cea9642f71b8fcff74aa82106726b6",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5484",
"triggerID" : "dc1b033f40cea9642f71b8fcff74aa82106726b6",
"triggerType" : "PUSH"
}, {
"hash" : "5b8f5819fff8fec34864eb409fd429b95be17b9b",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "5b8f5819fff8fec34864eb409fd429b95be17b9b",
"triggerType" : "PUSH"
}, {
"hash" : "13702fc2232ebd9300966b0a917a3358d8d0f18c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5590",
"triggerID" : "13702fc2232ebd9300966b0a917a3358d8d0f18c",
"triggerType" : "PUSH"
}, {
"hash" : "13702fc2232ebd9300966b0a917a3358d8d0f18c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5600",
"triggerID" : "1024845655",
"triggerType" : "MANUAL"
}, {
"hash" : "9bdd8a60f95123f82a5f30f5e68929f5b7e1f8da",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5603",
"triggerID" : "9bdd8a60f95123f82a5f30f5e68929f5b7e1f8da",
"triggerType" : "PUSH"
}, {
"hash" : "aebb9df557c4afe3ca88f6b8b28ba2fbfdcbd597",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5631",
"triggerID" : "aebb9df557c4afe3ca88f6b8b28ba2fbfdcbd597",
"triggerType" : "PUSH"
}, {
"hash" : "5d37935bc8bb33260735d782ca560fd59e02f321",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "5d37935bc8bb33260735d782ca560fd59e02f321",
"triggerType" : "PUSH"
}, {
"hash" : "f911d869f50009e5cd9f3fd341c83c732d7531ba",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "f911d869f50009e5cd9f3fd341c83c732d7531ba",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 77d11131baabd1c4e3cc2050337daca4df5f6427 UNKNOWN
* 3d9c2ae28da858d1e8476052c99391015effb7db UNKNOWN
* 31b0669d7b638bd65a17b22a2ceb772f2627512c UNKNOWN
* 28a5a4f537544d35dfcd8700a7b97fb7216682ce UNKNOWN
* c09e228f7cce78a7dbbc394e93b3cf8c6c3d4d5f UNKNOWN
* 5b8f5819fff8fec34864eb409fd429b95be17b9b UNKNOWN
* aebb9df557c4afe3ca88f6b8b28ba2fbfdcbd597 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5631)
* 5d37935bc8bb33260735d782ca560fd59e02f321 UNKNOWN
* f911d869f50009e5cd9f3fd341c83c732d7531ba UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #4556: [HUDI-3191][Stacked on 4716] Removing duplicating file-listing process w/in Hive's MOR `FileInputFormat`s
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #4556:
URL: https://github.com/apache/hudi/pull/4556#issuecomment-1027470496
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "d87786af43a7aeba7549cc3cfcbd97fc312bee0e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5074",
"triggerID" : "d87786af43a7aeba7549cc3cfcbd97fc312bee0e",
"triggerType" : "PUSH"
}, {
"hash" : "4b87ba1474be575ec27109ccbe626e4c2fc9c224",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5077",
"triggerID" : "4b87ba1474be575ec27109ccbe626e4c2fc9c224",
"triggerType" : "PUSH"
}, {
"hash" : "77d11131baabd1c4e3cc2050337daca4df5f6427",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "77d11131baabd1c4e3cc2050337daca4df5f6427",
"triggerType" : "PUSH"
}, {
"hash" : "3d9c2ae28da858d1e8476052c99391015effb7db",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "3d9c2ae28da858d1e8476052c99391015effb7db",
"triggerType" : "PUSH"
}, {
"hash" : "79ac9affcb7f81497e0df755c8200638d35b02b7",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5081",
"triggerID" : "79ac9affcb7f81497e0df755c8200638d35b02b7",
"triggerType" : "PUSH"
}, {
"hash" : "3c14bbe6c6bcf49c4164c45e82f77b473f4de396",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5113",
"triggerID" : "3c14bbe6c6bcf49c4164c45e82f77b473f4de396",
"triggerType" : "PUSH"
}, {
"hash" : "276f13d6efd00b301b232b286d585729c9d1d26e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5116",
"triggerID" : "276f13d6efd00b301b232b286d585729c9d1d26e",
"triggerType" : "PUSH"
}, {
"hash" : "31b0669d7b638bd65a17b22a2ceb772f2627512c",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "31b0669d7b638bd65a17b22a2ceb772f2627512c",
"triggerType" : "PUSH"
}, {
"hash" : "096e26af39a477ffccbee0edd764493e12e15e71",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5124",
"triggerID" : "096e26af39a477ffccbee0edd764493e12e15e71",
"triggerType" : "PUSH"
}, {
"hash" : "97dd5ec7c9246f6d9f467b9076b790dd6017c5b4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5213",
"triggerID" : "97dd5ec7c9246f6d9f467b9076b790dd6017c5b4",
"triggerType" : "PUSH"
}, {
"hash" : "0538475fe488089c4cb3bc0afb63c2f518329969",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5257",
"triggerID" : "0538475fe488089c4cb3bc0afb63c2f518329969",
"triggerType" : "PUSH"
}, {
"hash" : "9f4b334e340fb26004e1b07fc8fbaaa047c76775",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5261",
"triggerID" : "9f4b334e340fb26004e1b07fc8fbaaa047c76775",
"triggerType" : "PUSH"
}, {
"hash" : "368c099820c3cbf57496d0e46d1858aa8eb153ee",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5330",
"triggerID" : "368c099820c3cbf57496d0e46d1858aa8eb153ee",
"triggerType" : "PUSH"
}, {
"hash" : "28a5a4f537544d35dfcd8700a7b97fb7216682ce",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "28a5a4f537544d35dfcd8700a7b97fb7216682ce",
"triggerType" : "PUSH"
}, {
"hash" : "08ffdd8b47d147c9b5c889a5f56e39b9b140612d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5351",
"triggerID" : "08ffdd8b47d147c9b5c889a5f56e39b9b140612d",
"triggerType" : "PUSH"
}, {
"hash" : "c09e228f7cce78a7dbbc394e93b3cf8c6c3d4d5f",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "c09e228f7cce78a7dbbc394e93b3cf8c6c3d4d5f",
"triggerType" : "PUSH"
}, {
"hash" : "8dadbf672d4d27505592f18bc89422fd7c013669",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5398",
"triggerID" : "8dadbf672d4d27505592f18bc89422fd7c013669",
"triggerType" : "PUSH"
}, {
"hash" : "906607be5bd62ee1cbbda34acb6a89916c1f7aee",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5424",
"triggerID" : "906607be5bd62ee1cbbda34acb6a89916c1f7aee",
"triggerType" : "PUSH"
}, {
"hash" : "dc1b033f40cea9642f71b8fcff74aa82106726b6",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5484",
"triggerID" : "dc1b033f40cea9642f71b8fcff74aa82106726b6",
"triggerType" : "PUSH"
}, {
"hash" : "5b8f5819fff8fec34864eb409fd429b95be17b9b",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "5b8f5819fff8fec34864eb409fd429b95be17b9b",
"triggerType" : "PUSH"
}, {
"hash" : "13702fc2232ebd9300966b0a917a3358d8d0f18c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5590",
"triggerID" : "13702fc2232ebd9300966b0a917a3358d8d0f18c",
"triggerType" : "PUSH"
}, {
"hash" : "13702fc2232ebd9300966b0a917a3358d8d0f18c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5600",
"triggerID" : "1024845655",
"triggerType" : "MANUAL"
}, {
"hash" : "9bdd8a60f95123f82a5f30f5e68929f5b7e1f8da",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5603",
"triggerID" : "9bdd8a60f95123f82a5f30f5e68929f5b7e1f8da",
"triggerType" : "PUSH"
}, {
"hash" : "aebb9df557c4afe3ca88f6b8b28ba2fbfdcbd597",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5631",
"triggerID" : "aebb9df557c4afe3ca88f6b8b28ba2fbfdcbd597",
"triggerType" : "PUSH"
}, {
"hash" : "5d37935bc8bb33260735d782ca560fd59e02f321",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "5d37935bc8bb33260735d782ca560fd59e02f321",
"triggerType" : "PUSH"
}, {
"hash" : "f911d869f50009e5cd9f3fd341c83c732d7531ba",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5634",
"triggerID" : "f911d869f50009e5cd9f3fd341c83c732d7531ba",
"triggerType" : "PUSH"
}, {
"hash" : "f911d869f50009e5cd9f3fd341c83c732d7531ba",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5657",
"triggerID" : "1027051107",
"triggerType" : "MANUAL"
}, {
"hash" : "f911d869f50009e5cd9f3fd341c83c732d7531ba",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5659",
"triggerID" : "1027166086",
"triggerType" : "MANUAL"
}, {
"hash" : "f911d869f50009e5cd9f3fd341c83c732d7531ba",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5665",
"triggerID" : "1027387044",
"triggerType" : "MANUAL"
} ]
}-->
## CI report:
* 77d11131baabd1c4e3cc2050337daca4df5f6427 UNKNOWN
* 3d9c2ae28da858d1e8476052c99391015effb7db UNKNOWN
* 31b0669d7b638bd65a17b22a2ceb772f2627512c UNKNOWN
* 28a5a4f537544d35dfcd8700a7b97fb7216682ce UNKNOWN
* c09e228f7cce78a7dbbc394e93b3cf8c6c3d4d5f UNKNOWN
* 5b8f5819fff8fec34864eb409fd429b95be17b9b UNKNOWN
* 5d37935bc8bb33260735d782ca560fd59e02f321 UNKNOWN
* f911d869f50009e5cd9f3fd341c83c732d7531ba Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5634) Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5657) Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5659) Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5665)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] alexeykudinkin commented on pull request #4556: [HUDI-3191][Stacked on 4716] Removing duplicating file-listing process w/in Hive's MOR `FileInputFormat`s
Posted by GitBox <gi...@apache.org>.
alexeykudinkin commented on pull request #4556:
URL: https://github.com/apache/hudi/pull/4556#issuecomment-1027387044
@hudi-bot run azure
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] yihua commented on a change in pull request #4556: [HUDI-3191] Removing duplicating file-listing process w/in Hive's MOR `FileInputFormat`s
Posted by GitBox <gi...@apache.org>.
yihua commented on a change in pull request #4556:
URL: https://github.com/apache/hudi/pull/4556#discussion_r799001688
##########
File path: hudi-hadoop-mr/src/main/java/org/apache/hudi/hadoop/HoodieFileInputFormatBase.java
##########
@@ -143,6 +121,127 @@ private static FileStatus getFileStatusUnchecked(Option<HoodieBaseFile> baseFile
return returns.toArray(new FileStatus[0]);
}
+ private void validate(List<FileStatus> targetFiles, List<FileStatus> legacyFileStatuses) {
+ List<FileStatus> diff = CollectionUtils.diff(targetFiles, legacyFileStatuses);
+ checkState(diff.isEmpty(), "Should be empty");
+ }
+
+ @Nonnull
+ private static FileStatus getFileStatusUnchecked(HoodieBaseFile baseFile) {
+ try {
+ return HoodieInputFormatUtils.getFileStatus(baseFile);
+ } catch (IOException ioe) {
+ throw new HoodieIOException("Failed to get file-status", ioe);
+ }
+ }
+
+ /**
+ * Abstracts and exposes {@link FileInputFormat#listStatus(JobConf)} operation to subclasses that
+ * lists files (returning an array of {@link FileStatus}) corresponding to the input paths specified
+ * as part of provided {@link JobConf}
+ */
+ protected final FileStatus[] doListStatus(JobConf job) throws IOException {
+ return super.listStatus(job);
+ }
+
+ /**
+ * Achieves listStatus functionality for an incrementally queried table. Instead of listing all
+ * partitions and then filtering based on the commits of interest, this logic first extracts the
+ * partitions touched by the desired commits and then lists only those partitions.
+ */
+ protected List<FileStatus> listStatusForIncrementalMode(JobConf job,
+ HoodieTableMetaClient tableMetaClient,
+ List<Path> inputPaths,
+ String incrementalTable) throws IOException {
+ String tableName = tableMetaClient.getTableConfig().getTableName();
+ Job jobContext = Job.getInstance(job);
+ Option<HoodieTimeline> timeline = HoodieInputFormatUtils.getFilteredCommitsTimeline(jobContext, tableMetaClient);
+ if (!timeline.isPresent()) {
+ return null;
+ }
+ Option<List<HoodieInstant>> commitsToCheck = HoodieInputFormatUtils.getCommitsForIncrementalQuery(jobContext, tableName, timeline.get());
+ if (!commitsToCheck.isPresent()) {
+ return null;
+ }
+ Option<String> incrementalInputPaths = HoodieInputFormatUtils.getAffectedPartitions(commitsToCheck.get(), tableMetaClient, timeline.get(), inputPaths);
+ // Mutate the JobConf to set the input paths to only partitions touched by incremental pull.
+ if (!incrementalInputPaths.isPresent()) {
+ return null;
+ }
+ setInputPaths(job, incrementalInputPaths.get());
+ FileStatus[] fileStatuses = doListStatus(job);
+ return HoodieInputFormatUtils.filterIncrementalFileStatus(jobContext, tableMetaClient, timeline.get(), fileStatuses, commitsToCheck.get());
+ }
+
+ protected abstract boolean includeLogFilesForSnapshotView();
+
+ @Nonnull
+ private static RealtimeFileStatus createRealtimeFileStatusUnchecked(HoodieBaseFile baseFile,
+ Stream<HoodieLogFile> logFiles,
+ Option<HoodieInstant> latestCompletedInstantOpt,
+ HoodieTableMetaClient tableMetaClient) {
+ List<HoodieLogFile> sortedLogFiles = logFiles.sorted(HoodieLogFile.getLogFileComparator()).collect(Collectors.toList());
+ FileStatus baseFileStatus = getFileStatusUnchecked(baseFile);
+ try {
+ RealtimeFileStatus rtFileStatus = new RealtimeFileStatus(baseFileStatus);
+ rtFileStatus.setDeltaLogFiles(sortedLogFiles);
+ rtFileStatus.setBaseFilePath(baseFile.getPath());
+ rtFileStatus.setBasePath(tableMetaClient.getBasePath());
+
+ if (latestCompletedInstantOpt.isPresent()) {
+ HoodieInstant latestCompletedInstant = latestCompletedInstantOpt.get();
+ checkState(latestCompletedInstant.isCompleted());
+
+ rtFileStatus.setMaxCommitTime(latestCompletedInstant.getTimestamp());
+ }
+
+ if (baseFileStatus instanceof LocatedFileStatusWithBootstrapBaseFile || baseFileStatus instanceof FileStatusWithBootstrapBaseFile) {
+ rtFileStatus.setBootStrapFileStatus(baseFileStatus);
+ }
+
+ return rtFileStatus;
+ } catch (IOException e) {
+ throw new HoodieIOException(String.format("Failed to init %s", RealtimeFileStatus.class.getSimpleName()), e);
+ }
+ }
+
+ @Nonnull
+ private List<FileStatus> listStatusForSnapshotModeLegacy(JobConf job, Map<String, HoodieTableMetaClient> tableMetaClientMap, List<Path> snapshotPaths) throws IOException {
+ return HoodieInputFormatUtils.filterFileStatusForSnapshotMode(job, tableMetaClientMap, snapshotPaths, includeLogFilesForSnapshotView());
+ }
+
+ @Nonnull
+ private static RealtimeFileStatus createRealtimeFileStatusUnchecked(HoodieLogFile latestLogFile,
Review comment:
Discussed offline. Mentioned above.
##########
File path: hudi-client/hudi-spark-client/src/test/java/org/apache/hudi/table/functional/TestHoodieSparkMergeOnReadTableRollback.java
##########
@@ -516,8 +556,6 @@ void testMORTableRestore(boolean restoreAfterCompaction) throws Exception {
JavaRDD<HoodieRecord> writeRecords = jsc().parallelize(records, 1);
JavaRDD<WriteStatus> writeStatusJavaRDD = client.upsert(writeRecords, newCommitTime);
client.commit(newCommitTime, writeStatusJavaRDD);
- List<WriteStatus> statuses = writeStatusJavaRDD.collect();
- assertNoWriteErrors(statuses);
Review comment:
Makes sense
##########
File path: hudi-hadoop-mr/src/main/java/org/apache/hudi/hadoop/HoodieFileInputFormatBase.java
##########
@@ -143,6 +121,127 @@ private static FileStatus getFileStatusUnchecked(Option<HoodieBaseFile> baseFile
return returns.toArray(new FileStatus[0]);
}
+ private void validate(List<FileStatus> targetFiles, List<FileStatus> legacyFileStatuses) {
+ List<FileStatus> diff = CollectionUtils.diff(targetFiles, legacyFileStatuses);
+ checkState(diff.isEmpty(), "Should be empty");
+ }
+
+ @Nonnull
+ private static FileStatus getFileStatusUnchecked(HoodieBaseFile baseFile) {
+ try {
+ return HoodieInputFormatUtils.getFileStatus(baseFile);
+ } catch (IOException ioe) {
+ throw new HoodieIOException("Failed to get file-status", ioe);
+ }
+ }
+
+ /**
+ * Abstracts and exposes {@link FileInputFormat#listStatus(JobConf)} operation to subclasses that
+ * lists files (returning an array of {@link FileStatus}) corresponding to the input paths specified
+ * as part of provided {@link JobConf}
+ */
+ protected final FileStatus[] doListStatus(JobConf job) throws IOException {
+ return super.listStatus(job);
+ }
+
+ /**
+ * Achieves listStatus functionality for an incrementally queried table. Instead of listing all
+ * partitions and then filtering based on the commits of interest, this logic first extracts the
+ * partitions touched by the desired commits and then lists only those partitions.
+ */
+ protected List<FileStatus> listStatusForIncrementalMode(JobConf job,
+ HoodieTableMetaClient tableMetaClient,
+ List<Path> inputPaths,
+ String incrementalTable) throws IOException {
+ String tableName = tableMetaClient.getTableConfig().getTableName();
+ Job jobContext = Job.getInstance(job);
+ Option<HoodieTimeline> timeline = HoodieInputFormatUtils.getFilteredCommitsTimeline(jobContext, tableMetaClient);
+ if (!timeline.isPresent()) {
+ return null;
+ }
+ Option<List<HoodieInstant>> commitsToCheck = HoodieInputFormatUtils.getCommitsForIncrementalQuery(jobContext, tableName, timeline.get());
+ if (!commitsToCheck.isPresent()) {
+ return null;
+ }
+ Option<String> incrementalInputPaths = HoodieInputFormatUtils.getAffectedPartitions(commitsToCheck.get(), tableMetaClient, timeline.get(), inputPaths);
+ // Mutate the JobConf to set the input paths to only partitions touched by incremental pull.
+ if (!incrementalInputPaths.isPresent()) {
+ return null;
+ }
+ setInputPaths(job, incrementalInputPaths.get());
+ FileStatus[] fileStatuses = doListStatus(job);
+ return HoodieInputFormatUtils.filterIncrementalFileStatus(jobContext, tableMetaClient, timeline.get(), fileStatuses, commitsToCheck.get());
+ }
+
+ protected abstract boolean includeLogFilesForSnapshotView();
+
+ @Nonnull
+ private static RealtimeFileStatus createRealtimeFileStatusUnchecked(HoodieBaseFile baseFile,
Review comment:
As discussed offline, one-line javadocs are going to be added for both methods for clarity in the following PR:
```
/**
* Creates real-time FileStatus for a base file with log files.
*/
@Nonnull
private static RealtimeFileStatus createRealtimeFileStatusUnchecked(HoodieBaseFile baseFile,
Stream<HoodieLogFile> logFiles,
Option<HoodieInstant> latestCompletedInstantOpt,
HoodieTableMetaClient tableMetaClient)
/**
* Creates real-time FileStatus for the log files only.
*/
@Nonnull
private static RealtimeFileStatus createRealtimeFileStatusUnchecked(HoodieLogFile latestLogFile,
Stream<HoodieLogFile> logFiles,
Option<HoodieInstant> latestCompletedInstantOpt,
HoodieTableMetaClient tableMetaClient)
```
##########
File path: hudi-hadoop-mr/src/main/java/org/apache/hudi/hadoop/realtime/HoodieRealtimeFileSplit.java
##########
@@ -44,9 +44,7 @@
private Option<HoodieVirtualKeyInfo> hoodieVirtualKeyInfo = Option.empty();
- public HoodieRealtimeFileSplit() {
- super();
Review comment:
Got it.
##########
File path: hudi-client/hudi-spark-client/src/test/java/org/apache/hudi/table/TestHoodieMergeOnReadTable.java
##########
@@ -189,8 +190,10 @@ public void testUpsertPartitioner(boolean populateMetaFields) throws Exception {
assertTrue(fileIdToNewSize.entrySet().stream().anyMatch(entry -> fileIdToSize.get(entry.getKey()) < entry.getValue()));
- List<String> dataFiles = roView.getLatestBaseFiles().map(HoodieBaseFile::getPath).collect(Collectors.toList());
- List<GenericRecord> recordsRead = HoodieMergeOnReadTestUtils.getRecordsUsingInputFormat(hadoopConf(), dataFiles,
+ List<String> inputPaths = roView.getLatestBaseFiles()
+ .map(baseFile -> new Path(baseFile.getPath()).getParent().toString())
+ .collect(Collectors.toList());
Review comment:
Discussed offline that the inputPaths are going to be kept as is in the tests.
##########
File path: hudi-hadoop-mr/src/main/java/org/apache/hudi/hadoop/utils/HoodieRealtimeInputFormatUtils.java
##########
@@ -65,11 +65,71 @@
import java.util.stream.Collectors;
import java.util.stream.Stream;
+import static org.apache.hudi.TypeUtils.unsafeCast;
+import static org.apache.hudi.common.util.ValidationUtils.checkState;
+
public class HoodieRealtimeInputFormatUtils extends HoodieInputFormatUtils {
private static final Logger LOG = LogManager.getLogger(HoodieRealtimeInputFormatUtils.class);
- public static InputSplit[] getRealtimeSplits(Configuration conf, Stream<FileSplit> fileSplits) {
+ public static InputSplit[] getRealtimeSplits(Configuration conf, List<FileSplit> fileSplits) throws IOException {
+ if (fileSplits.isEmpty()) {
+ return new InputSplit[0];
+ }
+
+ FileSplit fileSplit = fileSplits.get(0);
+
+ // Pre-process table-config to fetch virtual key info
+ Path partitionPath = fileSplit.getPath().getParent();
+ HoodieTableMetaClient metaClient = getTableMetaClientForBasePathUnchecked(conf, partitionPath);
+
+ Option<HoodieVirtualKeyInfo> hoodieVirtualKeyInfoOpt = getHoodieVirtualKeyInfo(metaClient);
+
+ // NOTE: This timeline is kept in sync w/ {@code HoodieTableFileIndexBase}
+ HoodieInstant latestCommitInstant =
+ metaClient.getActiveTimeline().getCommitsTimeline().filterCompletedInstants().lastInstant().get();
+
+ InputSplit[] finalSplits = fileSplits.stream()
+ .map(split -> {
+ // There are 4 types of splits could we have to handle here
+ // - {@code BootstrapBaseFileSplit}: in case base file does have associated bootstrap file,
+ // but does NOT have any log files appended (convert it to {@code RealtimeBootstrapBaseFileSplit})
+ // - {@code RealtimeBootstrapBaseFileSplit}: in case base file does have associated bootstrap file
+ // and does have log files appended
+ // - {@code BaseFileWithLogsSplit}: in case base file does NOT have associated bootstrap file
Review comment:
I see. Yeah then it's fine, no need to update docs.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #4556: [HUDI-3191][Stacked on 4531] Removing duplicating file-listing process w/in Hive's MOR `FIleInputFormat`s
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #4556:
URL: https://github.com/apache/hudi/pull/4556#issuecomment-1013554187
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "d87786af43a7aeba7549cc3cfcbd97fc312bee0e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5074",
"triggerID" : "d87786af43a7aeba7549cc3cfcbd97fc312bee0e",
"triggerType" : "PUSH"
}, {
"hash" : "4b87ba1474be575ec27109ccbe626e4c2fc9c224",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5077",
"triggerID" : "4b87ba1474be575ec27109ccbe626e4c2fc9c224",
"triggerType" : "PUSH"
}, {
"hash" : "77d11131baabd1c4e3cc2050337daca4df5f6427",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "77d11131baabd1c4e3cc2050337daca4df5f6427",
"triggerType" : "PUSH"
}, {
"hash" : "3d9c2ae28da858d1e8476052c99391015effb7db",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "3d9c2ae28da858d1e8476052c99391015effb7db",
"triggerType" : "PUSH"
}, {
"hash" : "79ac9affcb7f81497e0df755c8200638d35b02b7",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5081",
"triggerID" : "79ac9affcb7f81497e0df755c8200638d35b02b7",
"triggerType" : "PUSH"
}, {
"hash" : "3c14bbe6c6bcf49c4164c45e82f77b473f4de396",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5113",
"triggerID" : "3c14bbe6c6bcf49c4164c45e82f77b473f4de396",
"triggerType" : "PUSH"
}, {
"hash" : "276f13d6efd00b301b232b286d585729c9d1d26e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5116",
"triggerID" : "276f13d6efd00b301b232b286d585729c9d1d26e",
"triggerType" : "PUSH"
}, {
"hash" : "31b0669d7b638bd65a17b22a2ceb772f2627512c",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "31b0669d7b638bd65a17b22a2ceb772f2627512c",
"triggerType" : "PUSH"
}, {
"hash" : "096e26af39a477ffccbee0edd764493e12e15e71",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5124",
"triggerID" : "096e26af39a477ffccbee0edd764493e12e15e71",
"triggerType" : "PUSH"
}, {
"hash" : "97dd5ec7c9246f6d9f467b9076b790dd6017c5b4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5213",
"triggerID" : "97dd5ec7c9246f6d9f467b9076b790dd6017c5b4",
"triggerType" : "PUSH"
}, {
"hash" : "0538475fe488089c4cb3bc0afb63c2f518329969",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5257",
"triggerID" : "0538475fe488089c4cb3bc0afb63c2f518329969",
"triggerType" : "PUSH"
}, {
"hash" : "9f4b334e340fb26004e1b07fc8fbaaa047c76775",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5261",
"triggerID" : "9f4b334e340fb26004e1b07fc8fbaaa047c76775",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 77d11131baabd1c4e3cc2050337daca4df5f6427 UNKNOWN
* 3d9c2ae28da858d1e8476052c99391015effb7db UNKNOWN
* 31b0669d7b638bd65a17b22a2ceb772f2627512c UNKNOWN
* 0538475fe488089c4cb3bc0afb63c2f518329969 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5257)
* 9f4b334e340fb26004e1b07fc8fbaaa047c76775 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5261)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #4556: [HUDI-3191][Stacked on 4531] Removing duplicating file-listing process w/in Hive's MOR `FIleInputFormat`s
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #4556:
URL: https://github.com/apache/hudi/pull/4556#issuecomment-1013567395
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "d87786af43a7aeba7549cc3cfcbd97fc312bee0e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5074",
"triggerID" : "d87786af43a7aeba7549cc3cfcbd97fc312bee0e",
"triggerType" : "PUSH"
}, {
"hash" : "4b87ba1474be575ec27109ccbe626e4c2fc9c224",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5077",
"triggerID" : "4b87ba1474be575ec27109ccbe626e4c2fc9c224",
"triggerType" : "PUSH"
}, {
"hash" : "77d11131baabd1c4e3cc2050337daca4df5f6427",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "77d11131baabd1c4e3cc2050337daca4df5f6427",
"triggerType" : "PUSH"
}, {
"hash" : "3d9c2ae28da858d1e8476052c99391015effb7db",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "3d9c2ae28da858d1e8476052c99391015effb7db",
"triggerType" : "PUSH"
}, {
"hash" : "79ac9affcb7f81497e0df755c8200638d35b02b7",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5081",
"triggerID" : "79ac9affcb7f81497e0df755c8200638d35b02b7",
"triggerType" : "PUSH"
}, {
"hash" : "3c14bbe6c6bcf49c4164c45e82f77b473f4de396",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5113",
"triggerID" : "3c14bbe6c6bcf49c4164c45e82f77b473f4de396",
"triggerType" : "PUSH"
}, {
"hash" : "276f13d6efd00b301b232b286d585729c9d1d26e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5116",
"triggerID" : "276f13d6efd00b301b232b286d585729c9d1d26e",
"triggerType" : "PUSH"
}, {
"hash" : "31b0669d7b638bd65a17b22a2ceb772f2627512c",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "31b0669d7b638bd65a17b22a2ceb772f2627512c",
"triggerType" : "PUSH"
}, {
"hash" : "096e26af39a477ffccbee0edd764493e12e15e71",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5124",
"triggerID" : "096e26af39a477ffccbee0edd764493e12e15e71",
"triggerType" : "PUSH"
}, {
"hash" : "97dd5ec7c9246f6d9f467b9076b790dd6017c5b4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5213",
"triggerID" : "97dd5ec7c9246f6d9f467b9076b790dd6017c5b4",
"triggerType" : "PUSH"
}, {
"hash" : "0538475fe488089c4cb3bc0afb63c2f518329969",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5257",
"triggerID" : "0538475fe488089c4cb3bc0afb63c2f518329969",
"triggerType" : "PUSH"
}, {
"hash" : "9f4b334e340fb26004e1b07fc8fbaaa047c76775",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5261",
"triggerID" : "9f4b334e340fb26004e1b07fc8fbaaa047c76775",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 77d11131baabd1c4e3cc2050337daca4df5f6427 UNKNOWN
* 3d9c2ae28da858d1e8476052c99391015effb7db UNKNOWN
* 31b0669d7b638bd65a17b22a2ceb772f2627512c UNKNOWN
* 9f4b334e340fb26004e1b07fc8fbaaa047c76775 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5261)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #4556: [HUDI-3191][Stacked on 4531] Removing duplicating file-listing process w/in Hive's MOR `FIleInputFormat`s
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #4556:
URL: https://github.com/apache/hudi/pull/4556#issuecomment-1009540462
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "d87786af43a7aeba7549cc3cfcbd97fc312bee0e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5074",
"triggerID" : "d87786af43a7aeba7549cc3cfcbd97fc312bee0e",
"triggerType" : "PUSH"
}, {
"hash" : "4b87ba1474be575ec27109ccbe626e4c2fc9c224",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5077",
"triggerID" : "4b87ba1474be575ec27109ccbe626e4c2fc9c224",
"triggerType" : "PUSH"
}, {
"hash" : "77d11131baabd1c4e3cc2050337daca4df5f6427",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "77d11131baabd1c4e3cc2050337daca4df5f6427",
"triggerType" : "PUSH"
}, {
"hash" : "3d9c2ae28da858d1e8476052c99391015effb7db",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "3d9c2ae28da858d1e8476052c99391015effb7db",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 4b87ba1474be575ec27109ccbe626e4c2fc9c224 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5077)
* 77d11131baabd1c4e3cc2050337daca4df5f6427 UNKNOWN
* 3d9c2ae28da858d1e8476052c99391015effb7db UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #4556: [HUDI-3191][Stacked on 4531] Removing duplicating file-listing process w/in Hive's MOR `FIleInputFormat`s
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #4556:
URL: https://github.com/apache/hudi/pull/4556#issuecomment-1010552818
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "d87786af43a7aeba7549cc3cfcbd97fc312bee0e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5074",
"triggerID" : "d87786af43a7aeba7549cc3cfcbd97fc312bee0e",
"triggerType" : "PUSH"
}, {
"hash" : "4b87ba1474be575ec27109ccbe626e4c2fc9c224",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5077",
"triggerID" : "4b87ba1474be575ec27109ccbe626e4c2fc9c224",
"triggerType" : "PUSH"
}, {
"hash" : "77d11131baabd1c4e3cc2050337daca4df5f6427",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "77d11131baabd1c4e3cc2050337daca4df5f6427",
"triggerType" : "PUSH"
}, {
"hash" : "3d9c2ae28da858d1e8476052c99391015effb7db",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "3d9c2ae28da858d1e8476052c99391015effb7db",
"triggerType" : "PUSH"
}, {
"hash" : "79ac9affcb7f81497e0df755c8200638d35b02b7",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5081",
"triggerID" : "79ac9affcb7f81497e0df755c8200638d35b02b7",
"triggerType" : "PUSH"
}, {
"hash" : "3c14bbe6c6bcf49c4164c45e82f77b473f4de396",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5113",
"triggerID" : "3c14bbe6c6bcf49c4164c45e82f77b473f4de396",
"triggerType" : "PUSH"
}, {
"hash" : "276f13d6efd00b301b232b286d585729c9d1d26e",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5116",
"triggerID" : "276f13d6efd00b301b232b286d585729c9d1d26e",
"triggerType" : "PUSH"
}, {
"hash" : "31b0669d7b638bd65a17b22a2ceb772f2627512c",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "31b0669d7b638bd65a17b22a2ceb772f2627512c",
"triggerType" : "PUSH"
}, {
"hash" : "096e26af39a477ffccbee0edd764493e12e15e71",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "096e26af39a477ffccbee0edd764493e12e15e71",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 77d11131baabd1c4e3cc2050337daca4df5f6427 UNKNOWN
* 3d9c2ae28da858d1e8476052c99391015effb7db UNKNOWN
* 276f13d6efd00b301b232b286d585729c9d1d26e Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5116)
* 31b0669d7b638bd65a17b22a2ceb772f2627512c UNKNOWN
* 096e26af39a477ffccbee0edd764493e12e15e71 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #4556: [HUDI-3191][Stacked on 4531] Removing duplicating file-listing process w/in Hive's MOR `FIleInputFormat`s
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #4556:
URL: https://github.com/apache/hudi/pull/4556#issuecomment-1012696524
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "d87786af43a7aeba7549cc3cfcbd97fc312bee0e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5074",
"triggerID" : "d87786af43a7aeba7549cc3cfcbd97fc312bee0e",
"triggerType" : "PUSH"
}, {
"hash" : "4b87ba1474be575ec27109ccbe626e4c2fc9c224",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5077",
"triggerID" : "4b87ba1474be575ec27109ccbe626e4c2fc9c224",
"triggerType" : "PUSH"
}, {
"hash" : "77d11131baabd1c4e3cc2050337daca4df5f6427",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "77d11131baabd1c4e3cc2050337daca4df5f6427",
"triggerType" : "PUSH"
}, {
"hash" : "3d9c2ae28da858d1e8476052c99391015effb7db",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "3d9c2ae28da858d1e8476052c99391015effb7db",
"triggerType" : "PUSH"
}, {
"hash" : "79ac9affcb7f81497e0df755c8200638d35b02b7",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5081",
"triggerID" : "79ac9affcb7f81497e0df755c8200638d35b02b7",
"triggerType" : "PUSH"
}, {
"hash" : "3c14bbe6c6bcf49c4164c45e82f77b473f4de396",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5113",
"triggerID" : "3c14bbe6c6bcf49c4164c45e82f77b473f4de396",
"triggerType" : "PUSH"
}, {
"hash" : "276f13d6efd00b301b232b286d585729c9d1d26e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5116",
"triggerID" : "276f13d6efd00b301b232b286d585729c9d1d26e",
"triggerType" : "PUSH"
}, {
"hash" : "31b0669d7b638bd65a17b22a2ceb772f2627512c",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "31b0669d7b638bd65a17b22a2ceb772f2627512c",
"triggerType" : "PUSH"
}, {
"hash" : "096e26af39a477ffccbee0edd764493e12e15e71",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5124",
"triggerID" : "096e26af39a477ffccbee0edd764493e12e15e71",
"triggerType" : "PUSH"
}, {
"hash" : "97dd5ec7c9246f6d9f467b9076b790dd6017c5b4",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5213",
"triggerID" : "97dd5ec7c9246f6d9f467b9076b790dd6017c5b4",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 77d11131baabd1c4e3cc2050337daca4df5f6427 UNKNOWN
* 3d9c2ae28da858d1e8476052c99391015effb7db UNKNOWN
* 31b0669d7b638bd65a17b22a2ceb772f2627512c UNKNOWN
* 096e26af39a477ffccbee0edd764493e12e15e71 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5124)
* 97dd5ec7c9246f6d9f467b9076b790dd6017c5b4 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5213)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #4556: [HUDI-3191][Stacked on 4531] Removing duplicating file-listing process w/in Hive's MOR `FIleInputFormat`s
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #4556:
URL: https://github.com/apache/hudi/pull/4556#issuecomment-1015768120
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "d87786af43a7aeba7549cc3cfcbd97fc312bee0e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5074",
"triggerID" : "d87786af43a7aeba7549cc3cfcbd97fc312bee0e",
"triggerType" : "PUSH"
}, {
"hash" : "4b87ba1474be575ec27109ccbe626e4c2fc9c224",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5077",
"triggerID" : "4b87ba1474be575ec27109ccbe626e4c2fc9c224",
"triggerType" : "PUSH"
}, {
"hash" : "77d11131baabd1c4e3cc2050337daca4df5f6427",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "77d11131baabd1c4e3cc2050337daca4df5f6427",
"triggerType" : "PUSH"
}, {
"hash" : "3d9c2ae28da858d1e8476052c99391015effb7db",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "3d9c2ae28da858d1e8476052c99391015effb7db",
"triggerType" : "PUSH"
}, {
"hash" : "79ac9affcb7f81497e0df755c8200638d35b02b7",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5081",
"triggerID" : "79ac9affcb7f81497e0df755c8200638d35b02b7",
"triggerType" : "PUSH"
}, {
"hash" : "3c14bbe6c6bcf49c4164c45e82f77b473f4de396",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5113",
"triggerID" : "3c14bbe6c6bcf49c4164c45e82f77b473f4de396",
"triggerType" : "PUSH"
}, {
"hash" : "276f13d6efd00b301b232b286d585729c9d1d26e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5116",
"triggerID" : "276f13d6efd00b301b232b286d585729c9d1d26e",
"triggerType" : "PUSH"
}, {
"hash" : "31b0669d7b638bd65a17b22a2ceb772f2627512c",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "31b0669d7b638bd65a17b22a2ceb772f2627512c",
"triggerType" : "PUSH"
}, {
"hash" : "096e26af39a477ffccbee0edd764493e12e15e71",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5124",
"triggerID" : "096e26af39a477ffccbee0edd764493e12e15e71",
"triggerType" : "PUSH"
}, {
"hash" : "97dd5ec7c9246f6d9f467b9076b790dd6017c5b4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5213",
"triggerID" : "97dd5ec7c9246f6d9f467b9076b790dd6017c5b4",
"triggerType" : "PUSH"
}, {
"hash" : "0538475fe488089c4cb3bc0afb63c2f518329969",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5257",
"triggerID" : "0538475fe488089c4cb3bc0afb63c2f518329969",
"triggerType" : "PUSH"
}, {
"hash" : "9f4b334e340fb26004e1b07fc8fbaaa047c76775",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5261",
"triggerID" : "9f4b334e340fb26004e1b07fc8fbaaa047c76775",
"triggerType" : "PUSH"
}, {
"hash" : "368c099820c3cbf57496d0e46d1858aa8eb153ee",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "368c099820c3cbf57496d0e46d1858aa8eb153ee",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 77d11131baabd1c4e3cc2050337daca4df5f6427 UNKNOWN
* 3d9c2ae28da858d1e8476052c99391015effb7db UNKNOWN
* 31b0669d7b638bd65a17b22a2ceb772f2627512c UNKNOWN
* 9f4b334e340fb26004e1b07fc8fbaaa047c76775 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5261)
* 368c099820c3cbf57496d0e46d1858aa8eb153ee UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #4556: [HUDI-3191][Stacked on 4531] Removing duplicating file-listing process w/in Hive's MOR `FIleInputFormat`s
Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #4556:
URL: https://github.com/apache/hudi/pull/4556#issuecomment-1015768120
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "d87786af43a7aeba7549cc3cfcbd97fc312bee0e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5074",
"triggerID" : "d87786af43a7aeba7549cc3cfcbd97fc312bee0e",
"triggerType" : "PUSH"
}, {
"hash" : "4b87ba1474be575ec27109ccbe626e4c2fc9c224",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5077",
"triggerID" : "4b87ba1474be575ec27109ccbe626e4c2fc9c224",
"triggerType" : "PUSH"
}, {
"hash" : "77d11131baabd1c4e3cc2050337daca4df5f6427",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "77d11131baabd1c4e3cc2050337daca4df5f6427",
"triggerType" : "PUSH"
}, {
"hash" : "3d9c2ae28da858d1e8476052c99391015effb7db",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "3d9c2ae28da858d1e8476052c99391015effb7db",
"triggerType" : "PUSH"
}, {
"hash" : "79ac9affcb7f81497e0df755c8200638d35b02b7",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5081",
"triggerID" : "79ac9affcb7f81497e0df755c8200638d35b02b7",
"triggerType" : "PUSH"
}, {
"hash" : "3c14bbe6c6bcf49c4164c45e82f77b473f4de396",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5113",
"triggerID" : "3c14bbe6c6bcf49c4164c45e82f77b473f4de396",
"triggerType" : "PUSH"
}, {
"hash" : "276f13d6efd00b301b232b286d585729c9d1d26e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5116",
"triggerID" : "276f13d6efd00b301b232b286d585729c9d1d26e",
"triggerType" : "PUSH"
}, {
"hash" : "31b0669d7b638bd65a17b22a2ceb772f2627512c",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "31b0669d7b638bd65a17b22a2ceb772f2627512c",
"triggerType" : "PUSH"
}, {
"hash" : "096e26af39a477ffccbee0edd764493e12e15e71",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5124",
"triggerID" : "096e26af39a477ffccbee0edd764493e12e15e71",
"triggerType" : "PUSH"
}, {
"hash" : "97dd5ec7c9246f6d9f467b9076b790dd6017c5b4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5213",
"triggerID" : "97dd5ec7c9246f6d9f467b9076b790dd6017c5b4",
"triggerType" : "PUSH"
}, {
"hash" : "0538475fe488089c4cb3bc0afb63c2f518329969",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5257",
"triggerID" : "0538475fe488089c4cb3bc0afb63c2f518329969",
"triggerType" : "PUSH"
}, {
"hash" : "9f4b334e340fb26004e1b07fc8fbaaa047c76775",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5261",
"triggerID" : "9f4b334e340fb26004e1b07fc8fbaaa047c76775",
"triggerType" : "PUSH"
}, {
"hash" : "368c099820c3cbf57496d0e46d1858aa8eb153ee",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "368c099820c3cbf57496d0e46d1858aa8eb153ee",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 77d11131baabd1c4e3cc2050337daca4df5f6427 UNKNOWN
* 3d9c2ae28da858d1e8476052c99391015effb7db UNKNOWN
* 31b0669d7b638bd65a17b22a2ceb772f2627512c UNKNOWN
* 9f4b334e340fb26004e1b07fc8fbaaa047c76775 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5261)
* 368c099820c3cbf57496d0e46d1858aa8eb153ee UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #4556: [HUDI-3191] Removing duplicating file-listing process w/in Hive's MOR `FIleInputFormat`s
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #4556:
URL: https://github.com/apache/hudi/pull/4556#issuecomment-1016893925
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "d87786af43a7aeba7549cc3cfcbd97fc312bee0e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5074",
"triggerID" : "d87786af43a7aeba7549cc3cfcbd97fc312bee0e",
"triggerType" : "PUSH"
}, {
"hash" : "4b87ba1474be575ec27109ccbe626e4c2fc9c224",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5077",
"triggerID" : "4b87ba1474be575ec27109ccbe626e4c2fc9c224",
"triggerType" : "PUSH"
}, {
"hash" : "77d11131baabd1c4e3cc2050337daca4df5f6427",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "77d11131baabd1c4e3cc2050337daca4df5f6427",
"triggerType" : "PUSH"
}, {
"hash" : "3d9c2ae28da858d1e8476052c99391015effb7db",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "3d9c2ae28da858d1e8476052c99391015effb7db",
"triggerType" : "PUSH"
}, {
"hash" : "79ac9affcb7f81497e0df755c8200638d35b02b7",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5081",
"triggerID" : "79ac9affcb7f81497e0df755c8200638d35b02b7",
"triggerType" : "PUSH"
}, {
"hash" : "3c14bbe6c6bcf49c4164c45e82f77b473f4de396",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5113",
"triggerID" : "3c14bbe6c6bcf49c4164c45e82f77b473f4de396",
"triggerType" : "PUSH"
}, {
"hash" : "276f13d6efd00b301b232b286d585729c9d1d26e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5116",
"triggerID" : "276f13d6efd00b301b232b286d585729c9d1d26e",
"triggerType" : "PUSH"
}, {
"hash" : "31b0669d7b638bd65a17b22a2ceb772f2627512c",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "31b0669d7b638bd65a17b22a2ceb772f2627512c",
"triggerType" : "PUSH"
}, {
"hash" : "096e26af39a477ffccbee0edd764493e12e15e71",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5124",
"triggerID" : "096e26af39a477ffccbee0edd764493e12e15e71",
"triggerType" : "PUSH"
}, {
"hash" : "97dd5ec7c9246f6d9f467b9076b790dd6017c5b4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5213",
"triggerID" : "97dd5ec7c9246f6d9f467b9076b790dd6017c5b4",
"triggerType" : "PUSH"
}, {
"hash" : "0538475fe488089c4cb3bc0afb63c2f518329969",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5257",
"triggerID" : "0538475fe488089c4cb3bc0afb63c2f518329969",
"triggerType" : "PUSH"
}, {
"hash" : "9f4b334e340fb26004e1b07fc8fbaaa047c76775",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5261",
"triggerID" : "9f4b334e340fb26004e1b07fc8fbaaa047c76775",
"triggerType" : "PUSH"
}, {
"hash" : "368c099820c3cbf57496d0e46d1858aa8eb153ee",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5330",
"triggerID" : "368c099820c3cbf57496d0e46d1858aa8eb153ee",
"triggerType" : "PUSH"
}, {
"hash" : "28a5a4f537544d35dfcd8700a7b97fb7216682ce",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "28a5a4f537544d35dfcd8700a7b97fb7216682ce",
"triggerType" : "PUSH"
}, {
"hash" : "08ffdd8b47d147c9b5c889a5f56e39b9b140612d",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "08ffdd8b47d147c9b5c889a5f56e39b9b140612d",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 77d11131baabd1c4e3cc2050337daca4df5f6427 UNKNOWN
* 3d9c2ae28da858d1e8476052c99391015effb7db UNKNOWN
* 31b0669d7b638bd65a17b22a2ceb772f2627512c UNKNOWN
* 368c099820c3cbf57496d0e46d1858aa8eb153ee Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5330)
* 28a5a4f537544d35dfcd8700a7b97fb7216682ce UNKNOWN
* 08ffdd8b47d147c9b5c889a5f56e39b9b140612d UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #4556: [HUDI-3191] Removing duplicating file-listing process w/in Hive's MOR `FIleInputFormat`s
Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #4556:
URL: https://github.com/apache/hudi/pull/4556#issuecomment-1016914186
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "d87786af43a7aeba7549cc3cfcbd97fc312bee0e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5074",
"triggerID" : "d87786af43a7aeba7549cc3cfcbd97fc312bee0e",
"triggerType" : "PUSH"
}, {
"hash" : "4b87ba1474be575ec27109ccbe626e4c2fc9c224",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5077",
"triggerID" : "4b87ba1474be575ec27109ccbe626e4c2fc9c224",
"triggerType" : "PUSH"
}, {
"hash" : "77d11131baabd1c4e3cc2050337daca4df5f6427",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "77d11131baabd1c4e3cc2050337daca4df5f6427",
"triggerType" : "PUSH"
}, {
"hash" : "3d9c2ae28da858d1e8476052c99391015effb7db",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "3d9c2ae28da858d1e8476052c99391015effb7db",
"triggerType" : "PUSH"
}, {
"hash" : "79ac9affcb7f81497e0df755c8200638d35b02b7",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5081",
"triggerID" : "79ac9affcb7f81497e0df755c8200638d35b02b7",
"triggerType" : "PUSH"
}, {
"hash" : "3c14bbe6c6bcf49c4164c45e82f77b473f4de396",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5113",
"triggerID" : "3c14bbe6c6bcf49c4164c45e82f77b473f4de396",
"triggerType" : "PUSH"
}, {
"hash" : "276f13d6efd00b301b232b286d585729c9d1d26e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5116",
"triggerID" : "276f13d6efd00b301b232b286d585729c9d1d26e",
"triggerType" : "PUSH"
}, {
"hash" : "31b0669d7b638bd65a17b22a2ceb772f2627512c",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "31b0669d7b638bd65a17b22a2ceb772f2627512c",
"triggerType" : "PUSH"
}, {
"hash" : "096e26af39a477ffccbee0edd764493e12e15e71",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5124",
"triggerID" : "096e26af39a477ffccbee0edd764493e12e15e71",
"triggerType" : "PUSH"
}, {
"hash" : "97dd5ec7c9246f6d9f467b9076b790dd6017c5b4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5213",
"triggerID" : "97dd5ec7c9246f6d9f467b9076b790dd6017c5b4",
"triggerType" : "PUSH"
}, {
"hash" : "0538475fe488089c4cb3bc0afb63c2f518329969",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5257",
"triggerID" : "0538475fe488089c4cb3bc0afb63c2f518329969",
"triggerType" : "PUSH"
}, {
"hash" : "9f4b334e340fb26004e1b07fc8fbaaa047c76775",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5261",
"triggerID" : "9f4b334e340fb26004e1b07fc8fbaaa047c76775",
"triggerType" : "PUSH"
}, {
"hash" : "368c099820c3cbf57496d0e46d1858aa8eb153ee",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5330",
"triggerID" : "368c099820c3cbf57496d0e46d1858aa8eb153ee",
"triggerType" : "PUSH"
}, {
"hash" : "28a5a4f537544d35dfcd8700a7b97fb7216682ce",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "28a5a4f537544d35dfcd8700a7b97fb7216682ce",
"triggerType" : "PUSH"
}, {
"hash" : "08ffdd8b47d147c9b5c889a5f56e39b9b140612d",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5351",
"triggerID" : "08ffdd8b47d147c9b5c889a5f56e39b9b140612d",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 77d11131baabd1c4e3cc2050337daca4df5f6427 UNKNOWN
* 3d9c2ae28da858d1e8476052c99391015effb7db UNKNOWN
* 31b0669d7b638bd65a17b22a2ceb772f2627512c UNKNOWN
* 368c099820c3cbf57496d0e46d1858aa8eb153ee Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5330)
* 28a5a4f537544d35dfcd8700a7b97fb7216682ce UNKNOWN
* 08ffdd8b47d147c9b5c889a5f56e39b9b140612d Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5351)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #4556: [HUDI-3191] Removing duplicating file-listing process w/in Hive's MOR `FIleInputFormat`s
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #4556:
URL: https://github.com/apache/hudi/pull/4556#issuecomment-1016950218
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "d87786af43a7aeba7549cc3cfcbd97fc312bee0e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5074",
"triggerID" : "d87786af43a7aeba7549cc3cfcbd97fc312bee0e",
"triggerType" : "PUSH"
}, {
"hash" : "4b87ba1474be575ec27109ccbe626e4c2fc9c224",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5077",
"triggerID" : "4b87ba1474be575ec27109ccbe626e4c2fc9c224",
"triggerType" : "PUSH"
}, {
"hash" : "77d11131baabd1c4e3cc2050337daca4df5f6427",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "77d11131baabd1c4e3cc2050337daca4df5f6427",
"triggerType" : "PUSH"
}, {
"hash" : "3d9c2ae28da858d1e8476052c99391015effb7db",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "3d9c2ae28da858d1e8476052c99391015effb7db",
"triggerType" : "PUSH"
}, {
"hash" : "79ac9affcb7f81497e0df755c8200638d35b02b7",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5081",
"triggerID" : "79ac9affcb7f81497e0df755c8200638d35b02b7",
"triggerType" : "PUSH"
}, {
"hash" : "3c14bbe6c6bcf49c4164c45e82f77b473f4de396",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5113",
"triggerID" : "3c14bbe6c6bcf49c4164c45e82f77b473f4de396",
"triggerType" : "PUSH"
}, {
"hash" : "276f13d6efd00b301b232b286d585729c9d1d26e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5116",
"triggerID" : "276f13d6efd00b301b232b286d585729c9d1d26e",
"triggerType" : "PUSH"
}, {
"hash" : "31b0669d7b638bd65a17b22a2ceb772f2627512c",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "31b0669d7b638bd65a17b22a2ceb772f2627512c",
"triggerType" : "PUSH"
}, {
"hash" : "096e26af39a477ffccbee0edd764493e12e15e71",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5124",
"triggerID" : "096e26af39a477ffccbee0edd764493e12e15e71",
"triggerType" : "PUSH"
}, {
"hash" : "97dd5ec7c9246f6d9f467b9076b790dd6017c5b4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5213",
"triggerID" : "97dd5ec7c9246f6d9f467b9076b790dd6017c5b4",
"triggerType" : "PUSH"
}, {
"hash" : "0538475fe488089c4cb3bc0afb63c2f518329969",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5257",
"triggerID" : "0538475fe488089c4cb3bc0afb63c2f518329969",
"triggerType" : "PUSH"
}, {
"hash" : "9f4b334e340fb26004e1b07fc8fbaaa047c76775",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5261",
"triggerID" : "9f4b334e340fb26004e1b07fc8fbaaa047c76775",
"triggerType" : "PUSH"
}, {
"hash" : "368c099820c3cbf57496d0e46d1858aa8eb153ee",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5330",
"triggerID" : "368c099820c3cbf57496d0e46d1858aa8eb153ee",
"triggerType" : "PUSH"
}, {
"hash" : "28a5a4f537544d35dfcd8700a7b97fb7216682ce",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "28a5a4f537544d35dfcd8700a7b97fb7216682ce",
"triggerType" : "PUSH"
}, {
"hash" : "08ffdd8b47d147c9b5c889a5f56e39b9b140612d",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5351",
"triggerID" : "08ffdd8b47d147c9b5c889a5f56e39b9b140612d",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 77d11131baabd1c4e3cc2050337daca4df5f6427 UNKNOWN
* 3d9c2ae28da858d1e8476052c99391015effb7db UNKNOWN
* 31b0669d7b638bd65a17b22a2ceb772f2627512c UNKNOWN
* 28a5a4f537544d35dfcd8700a7b97fb7216682ce UNKNOWN
* 08ffdd8b47d147c9b5c889a5f56e39b9b140612d Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5351)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #4556: [HUDI-3191] Removing duplicating file-listing process w/in Hive's MOR `FileInputFormat`s
Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #4556:
URL: https://github.com/apache/hudi/pull/4556#issuecomment-1018834442
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "d87786af43a7aeba7549cc3cfcbd97fc312bee0e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5074",
"triggerID" : "d87786af43a7aeba7549cc3cfcbd97fc312bee0e",
"triggerType" : "PUSH"
}, {
"hash" : "4b87ba1474be575ec27109ccbe626e4c2fc9c224",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5077",
"triggerID" : "4b87ba1474be575ec27109ccbe626e4c2fc9c224",
"triggerType" : "PUSH"
}, {
"hash" : "77d11131baabd1c4e3cc2050337daca4df5f6427",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "77d11131baabd1c4e3cc2050337daca4df5f6427",
"triggerType" : "PUSH"
}, {
"hash" : "3d9c2ae28da858d1e8476052c99391015effb7db",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "3d9c2ae28da858d1e8476052c99391015effb7db",
"triggerType" : "PUSH"
}, {
"hash" : "79ac9affcb7f81497e0df755c8200638d35b02b7",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5081",
"triggerID" : "79ac9affcb7f81497e0df755c8200638d35b02b7",
"triggerType" : "PUSH"
}, {
"hash" : "3c14bbe6c6bcf49c4164c45e82f77b473f4de396",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5113",
"triggerID" : "3c14bbe6c6bcf49c4164c45e82f77b473f4de396",
"triggerType" : "PUSH"
}, {
"hash" : "276f13d6efd00b301b232b286d585729c9d1d26e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5116",
"triggerID" : "276f13d6efd00b301b232b286d585729c9d1d26e",
"triggerType" : "PUSH"
}, {
"hash" : "31b0669d7b638bd65a17b22a2ceb772f2627512c",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "31b0669d7b638bd65a17b22a2ceb772f2627512c",
"triggerType" : "PUSH"
}, {
"hash" : "096e26af39a477ffccbee0edd764493e12e15e71",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5124",
"triggerID" : "096e26af39a477ffccbee0edd764493e12e15e71",
"triggerType" : "PUSH"
}, {
"hash" : "97dd5ec7c9246f6d9f467b9076b790dd6017c5b4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5213",
"triggerID" : "97dd5ec7c9246f6d9f467b9076b790dd6017c5b4",
"triggerType" : "PUSH"
}, {
"hash" : "0538475fe488089c4cb3bc0afb63c2f518329969",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5257",
"triggerID" : "0538475fe488089c4cb3bc0afb63c2f518329969",
"triggerType" : "PUSH"
}, {
"hash" : "9f4b334e340fb26004e1b07fc8fbaaa047c76775",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5261",
"triggerID" : "9f4b334e340fb26004e1b07fc8fbaaa047c76775",
"triggerType" : "PUSH"
}, {
"hash" : "368c099820c3cbf57496d0e46d1858aa8eb153ee",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5330",
"triggerID" : "368c099820c3cbf57496d0e46d1858aa8eb153ee",
"triggerType" : "PUSH"
}, {
"hash" : "28a5a4f537544d35dfcd8700a7b97fb7216682ce",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "28a5a4f537544d35dfcd8700a7b97fb7216682ce",
"triggerType" : "PUSH"
}, {
"hash" : "08ffdd8b47d147c9b5c889a5f56e39b9b140612d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5351",
"triggerID" : "08ffdd8b47d147c9b5c889a5f56e39b9b140612d",
"triggerType" : "PUSH"
}, {
"hash" : "c09e228f7cce78a7dbbc394e93b3cf8c6c3d4d5f",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "c09e228f7cce78a7dbbc394e93b3cf8c6c3d4d5f",
"triggerType" : "PUSH"
}, {
"hash" : "8dadbf672d4d27505592f18bc89422fd7c013669",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5398",
"triggerID" : "8dadbf672d4d27505592f18bc89422fd7c013669",
"triggerType" : "PUSH"
}, {
"hash" : "906607be5bd62ee1cbbda34acb6a89916c1f7aee",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "906607be5bd62ee1cbbda34acb6a89916c1f7aee",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 77d11131baabd1c4e3cc2050337daca4df5f6427 UNKNOWN
* 3d9c2ae28da858d1e8476052c99391015effb7db UNKNOWN
* 31b0669d7b638bd65a17b22a2ceb772f2627512c UNKNOWN
* 28a5a4f537544d35dfcd8700a7b97fb7216682ce UNKNOWN
* c09e228f7cce78a7dbbc394e93b3cf8c6c3d4d5f UNKNOWN
* 8dadbf672d4d27505592f18bc89422fd7c013669 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5398)
* 906607be5bd62ee1cbbda34acb6a89916c1f7aee UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] yihua commented on a change in pull request #4556: [HUDI-3191] Removing duplicating file-listing process w/in Hive's MOR `FileInputFormat`s
Posted by GitBox <gi...@apache.org>.
yihua commented on a change in pull request #4556:
URL: https://github.com/apache/hudi/pull/4556#discussion_r794793796
##########
File path: hudi-hadoop-mr/src/main/java/org/apache/hudi/hadoop/utils/HoodieRealtimeInputFormatUtils.java
##########
@@ -65,11 +65,71 @@
import java.util.stream.Collectors;
import java.util.stream.Stream;
+import static org.apache.hudi.TypeUtils.unsafeCast;
+import static org.apache.hudi.common.util.ValidationUtils.checkState;
+
public class HoodieRealtimeInputFormatUtils extends HoodieInputFormatUtils {
private static final Logger LOG = LogManager.getLogger(HoodieRealtimeInputFormatUtils.class);
- public static InputSplit[] getRealtimeSplits(Configuration conf, Stream<FileSplit> fileSplits) {
+ public static InputSplit[] getRealtimeSplits(Configuration conf, List<FileSplit> fileSplits) throws IOException {
+ if (fileSplits.isEmpty()) {
+ return new InputSplit[0];
+ }
+
+ FileSplit fileSplit = fileSplits.get(0);
+
+ // Pre-process table-config to fetch virtual key info
+ Path partitionPath = fileSplit.getPath().getParent();
+ HoodieTableMetaClient metaClient = getTableMetaClientForBasePathUnchecked(conf, partitionPath);
+
+ Option<HoodieVirtualKeyInfo> hoodieVirtualKeyInfoOpt = getHoodieVirtualKeyInfo(metaClient);
+
+ // NOTE: This timeline is kept in sync w/ {@code HoodieTableFileIndexBase}
+ HoodieInstant latestCommitInstant =
+ metaClient.getActiveTimeline().getCommitsTimeline().filterCompletedInstants().lastInstant().get();
+
+ InputSplit[] finalSplits = fileSplits.stream()
+ .map(split -> {
+ // There are 4 types of splits could we have to handle here
+ // - {@code BootstrapBaseFileSplit}: in case base file does have associated bootstrap file,
+ // but does NOT have any log files appended (convert it to {@code RealtimeBootstrapBaseFileSplit})
+ // - {@code RealtimeBootstrapBaseFileSplit}: in case base file does have associated bootstrap file
+ // and does have log files appended
+ // - {@code BaseFileWithLogsSplit}: in case base file does NOT have associated bootstrap file
Review comment:
Got it. Could you update the docs? Originally I thought `else` block only handles non-Hudi path cases.
##########
File path: hudi-hadoop-mr/src/main/java/org/apache/hudi/hadoop/realtime/HoodieRealtimeFileSplit.java
##########
@@ -44,9 +44,7 @@
private Option<HoodieVirtualKeyInfo> hoodieVirtualKeyInfo = Option.empty();
- public HoodieRealtimeFileSplit() {
- super();
Review comment:
In that case, we need to remove the explicit no-arg constructor to have the default behavior? Here it explicitly does nothing.
##########
File path: hudi-hadoop-mr/src/main/java/org/apache/hudi/hadoop/HoodieFileInputFormatBase.java
##########
@@ -143,6 +121,127 @@ private static FileStatus getFileStatusUnchecked(Option<HoodieBaseFile> baseFile
return returns.toArray(new FileStatus[0]);
}
+ private void validate(List<FileStatus> targetFiles, List<FileStatus> legacyFileStatuses) {
+ List<FileStatus> diff = CollectionUtils.diff(targetFiles, legacyFileStatuses);
+ checkState(diff.isEmpty(), "Should be empty");
+ }
+
+ @Nonnull
+ private static FileStatus getFileStatusUnchecked(HoodieBaseFile baseFile) {
+ try {
+ return HoodieInputFormatUtils.getFileStatus(baseFile);
+ } catch (IOException ioe) {
+ throw new HoodieIOException("Failed to get file-status", ioe);
+ }
+ }
+
+ /**
+ * Abstracts and exposes {@link FileInputFormat#listStatus(JobConf)} operation to subclasses that
+ * lists files (returning an array of {@link FileStatus}) corresponding to the input paths specified
+ * as part of provided {@link JobConf}
+ */
+ protected final FileStatus[] doListStatus(JobConf job) throws IOException {
+ return super.listStatus(job);
+ }
+
+ /**
+ * Achieves listStatus functionality for an incrementally queried table. Instead of listing all
+ * partitions and then filtering based on the commits of interest, this logic first extracts the
+ * partitions touched by the desired commits and then lists only those partitions.
+ */
+ protected List<FileStatus> listStatusForIncrementalMode(JobConf job,
+ HoodieTableMetaClient tableMetaClient,
+ List<Path> inputPaths,
+ String incrementalTable) throws IOException {
+ String tableName = tableMetaClient.getTableConfig().getTableName();
+ Job jobContext = Job.getInstance(job);
+ Option<HoodieTimeline> timeline = HoodieInputFormatUtils.getFilteredCommitsTimeline(jobContext, tableMetaClient);
+ if (!timeline.isPresent()) {
+ return null;
+ }
+ Option<List<HoodieInstant>> commitsToCheck = HoodieInputFormatUtils.getCommitsForIncrementalQuery(jobContext, tableName, timeline.get());
+ if (!commitsToCheck.isPresent()) {
+ return null;
+ }
+ Option<String> incrementalInputPaths = HoodieInputFormatUtils.getAffectedPartitions(commitsToCheck.get(), tableMetaClient, timeline.get(), inputPaths);
+ // Mutate the JobConf to set the input paths to only partitions touched by incremental pull.
+ if (!incrementalInputPaths.isPresent()) {
+ return null;
+ }
+ setInputPaths(job, incrementalInputPaths.get());
+ FileStatus[] fileStatuses = doListStatus(job);
+ return HoodieInputFormatUtils.filterIncrementalFileStatus(jobContext, tableMetaClient, timeline.get(), fileStatuses, commitsToCheck.get());
+ }
+
+ protected abstract boolean includeLogFilesForSnapshotView();
+
+ @Nonnull
+ private static RealtimeFileStatus createRealtimeFileStatusUnchecked(HoodieBaseFile baseFile,
Review comment:
Got it. I saw two methods of `createRealtimeFileStatusUnchecked()` with different args so wondering what's the difference. Basically, one for base file + log files, and the other for log files only. Maybe rename them so the method names are more descriptive?
##########
File path: hudi-hadoop-mr/src/main/java/org/apache/hudi/hadoop/HoodieFileInputFormatBase.java
##########
@@ -143,6 +121,124 @@ private static FileStatus getFileStatusUnchecked(Option<HoodieBaseFile> baseFile
return returns.toArray(new FileStatus[0]);
}
+ private void validate(List<FileStatus> targetFiles, List<FileStatus> legacyFileStatuses) {
Review comment:
Got it, makes sense. In the future, you can have a separate PR for just reordering, which makes the review turnaround shorter.
##########
File path: hudi-hadoop-mr/src/main/java/org/apache/hudi/hadoop/utils/HoodieRealtimeInputFormatUtils.java
##########
@@ -144,28 +204,32 @@
return rtSplits.toArray(new InputSplit[0]);
}
+ /**
+ * @deprecated will be replaced w/ {@link #getRealtimeSplits(Configuration, List)}
+ */
// get IncrementalRealtimeSplits
- public static InputSplit[] getIncrementalRealtimeSplits(Configuration conf, Stream<FileSplit> fileSplits) throws IOException {
+ public static InputSplit[] getIncrementalRealtimeSplits(Configuration conf, List<FileSplit> fileSplits) throws IOException {
+ checkState(fileSplits.stream().allMatch(HoodieRealtimeInputFormatUtils::doesBelongToIncrementalQuery),
+ "All splits have to belong to incremental query");
+
List<InputSplit> rtSplits = new ArrayList<>();
- List<FileSplit> fileSplitList = fileSplits.collect(Collectors.toList());
- Set<Path> partitionSet = fileSplitList.stream().map(f -> f.getPath().getParent()).collect(Collectors.toSet());
+ Set<Path> partitionSet = fileSplits.stream().map(f -> f.getPath().getParent()).collect(Collectors.toSet());
Map<Path, HoodieTableMetaClient> partitionsToMetaClient = getTableMetaClientByPartitionPath(conf, partitionSet);
// Pre process tableConfig from first partition to fetch virtual key info
Option<HoodieVirtualKeyInfo> hoodieVirtualKeyInfo = Option.empty();
if (partitionSet.size() > 0) {
hoodieVirtualKeyInfo = getHoodieVirtualKeyInfo(partitionsToMetaClient.get(partitionSet.iterator().next()));
}
Option<HoodieVirtualKeyInfo> finalHoodieVirtualKeyInfo = hoodieVirtualKeyInfo;
- fileSplitList.stream().forEach(s -> {
+ fileSplits.stream().forEach(s -> {
// deal with incremental query.
try {
if (s instanceof BaseFileWithLogsSplit) {
- BaseFileWithLogsSplit bs = (BaseFileWithLogsSplit)s;
- if (bs.getBelongToIncrementalSplit()) {
- rtSplits.add(new HoodieRealtimeFileSplit(bs, bs.getBasePath(), bs.getDeltaLogFiles(), bs.getMaxCommitTime(), finalHoodieVirtualKeyInfo));
- }
+ BaseFileWithLogsSplit bs = unsafeCast(s);
+ rtSplits.add(new HoodieRealtimeFileSplit(bs, bs.getBasePath(), bs.getDeltaLogFiles(), bs.getMaxCommitTime(), finalHoodieVirtualKeyInfo));
} else if (s instanceof RealtimeBootstrapBaseFileSplit) {
- rtSplits.add(s);
+ RealtimeBootstrapBaseFileSplit bs = unsafeCast(s);
Review comment:
Yeah, my point is, you're not calling methods only in `RealtimeBootstrapBaseFileSplit` here. `s` is a instance of `RealtimeBootstrapBaseFileSplit` already and `RealtimeBootstrapBaseFileSplit` is a subclass of `InputSplit`. Directly adding `s` with `rtSplits.add(s);` is not a problem.
##########
File path: hudi-client/hudi-spark-client/src/test/java/org/apache/hudi/table/TestHoodieMergeOnReadTable.java
##########
@@ -189,8 +190,10 @@ public void testUpsertPartitioner(boolean populateMetaFields) throws Exception {
assertTrue(fileIdToNewSize.entrySet().stream().anyMatch(entry -> fileIdToSize.get(entry.getKey()) < entry.getValue()));
- List<String> dataFiles = roView.getLatestBaseFiles().map(HoodieBaseFile::getPath).collect(Collectors.toList());
- List<GenericRecord> recordsRead = HoodieMergeOnReadTestUtils.getRecordsUsingInputFormat(hadoopConf(), dataFiles,
+ List<String> inputPaths = roView.getLatestBaseFiles()
+ .map(baseFile -> new Path(baseFile.getPath()).getParent().toString())
+ .collect(Collectors.toList());
Review comment:
Understood. What you are saying is that input format now takes partition paths instead of base file paths.
Then the question is, there could be base files under the same partition path. `inputPaths` can potentially have duplicated partition paths. Should it be deduped with `Set<String>` and then passed to getRecordsUsingInputFormat() with `new List<>(pathSet)`?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #4556: [HUDI-3191] Removing duplicating file-listing process w/in Hive's MOR `FileInputFormat`s
Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #4556:
URL: https://github.com/apache/hudi/pull/4556#issuecomment-1020724471
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "d87786af43a7aeba7549cc3cfcbd97fc312bee0e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5074",
"triggerID" : "d87786af43a7aeba7549cc3cfcbd97fc312bee0e",
"triggerType" : "PUSH"
}, {
"hash" : "4b87ba1474be575ec27109ccbe626e4c2fc9c224",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5077",
"triggerID" : "4b87ba1474be575ec27109ccbe626e4c2fc9c224",
"triggerType" : "PUSH"
}, {
"hash" : "77d11131baabd1c4e3cc2050337daca4df5f6427",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "77d11131baabd1c4e3cc2050337daca4df5f6427",
"triggerType" : "PUSH"
}, {
"hash" : "3d9c2ae28da858d1e8476052c99391015effb7db",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "3d9c2ae28da858d1e8476052c99391015effb7db",
"triggerType" : "PUSH"
}, {
"hash" : "79ac9affcb7f81497e0df755c8200638d35b02b7",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5081",
"triggerID" : "79ac9affcb7f81497e0df755c8200638d35b02b7",
"triggerType" : "PUSH"
}, {
"hash" : "3c14bbe6c6bcf49c4164c45e82f77b473f4de396",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5113",
"triggerID" : "3c14bbe6c6bcf49c4164c45e82f77b473f4de396",
"triggerType" : "PUSH"
}, {
"hash" : "276f13d6efd00b301b232b286d585729c9d1d26e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5116",
"triggerID" : "276f13d6efd00b301b232b286d585729c9d1d26e",
"triggerType" : "PUSH"
}, {
"hash" : "31b0669d7b638bd65a17b22a2ceb772f2627512c",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "31b0669d7b638bd65a17b22a2ceb772f2627512c",
"triggerType" : "PUSH"
}, {
"hash" : "096e26af39a477ffccbee0edd764493e12e15e71",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5124",
"triggerID" : "096e26af39a477ffccbee0edd764493e12e15e71",
"triggerType" : "PUSH"
}, {
"hash" : "97dd5ec7c9246f6d9f467b9076b790dd6017c5b4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5213",
"triggerID" : "97dd5ec7c9246f6d9f467b9076b790dd6017c5b4",
"triggerType" : "PUSH"
}, {
"hash" : "0538475fe488089c4cb3bc0afb63c2f518329969",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5257",
"triggerID" : "0538475fe488089c4cb3bc0afb63c2f518329969",
"triggerType" : "PUSH"
}, {
"hash" : "9f4b334e340fb26004e1b07fc8fbaaa047c76775",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5261",
"triggerID" : "9f4b334e340fb26004e1b07fc8fbaaa047c76775",
"triggerType" : "PUSH"
}, {
"hash" : "368c099820c3cbf57496d0e46d1858aa8eb153ee",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5330",
"triggerID" : "368c099820c3cbf57496d0e46d1858aa8eb153ee",
"triggerType" : "PUSH"
}, {
"hash" : "28a5a4f537544d35dfcd8700a7b97fb7216682ce",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "28a5a4f537544d35dfcd8700a7b97fb7216682ce",
"triggerType" : "PUSH"
}, {
"hash" : "08ffdd8b47d147c9b5c889a5f56e39b9b140612d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5351",
"triggerID" : "08ffdd8b47d147c9b5c889a5f56e39b9b140612d",
"triggerType" : "PUSH"
}, {
"hash" : "c09e228f7cce78a7dbbc394e93b3cf8c6c3d4d5f",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "c09e228f7cce78a7dbbc394e93b3cf8c6c3d4d5f",
"triggerType" : "PUSH"
}, {
"hash" : "8dadbf672d4d27505592f18bc89422fd7c013669",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5398",
"triggerID" : "8dadbf672d4d27505592f18bc89422fd7c013669",
"triggerType" : "PUSH"
}, {
"hash" : "906607be5bd62ee1cbbda34acb6a89916c1f7aee",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5424",
"triggerID" : "906607be5bd62ee1cbbda34acb6a89916c1f7aee",
"triggerType" : "PUSH"
}, {
"hash" : "dc1b033f40cea9642f71b8fcff74aa82106726b6",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5484",
"triggerID" : "dc1b033f40cea9642f71b8fcff74aa82106726b6",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 77d11131baabd1c4e3cc2050337daca4df5f6427 UNKNOWN
* 3d9c2ae28da858d1e8476052c99391015effb7db UNKNOWN
* 31b0669d7b638bd65a17b22a2ceb772f2627512c UNKNOWN
* 28a5a4f537544d35dfcd8700a7b97fb7216682ce UNKNOWN
* c09e228f7cce78a7dbbc394e93b3cf8c6c3d4d5f UNKNOWN
* dc1b033f40cea9642f71b8fcff74aa82106726b6 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5484)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #4556: [HUDI-3191][Stacked on 4716] Removing duplicating file-listing process w/in Hive's MOR `FileInputFormat`s
Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #4556:
URL: https://github.com/apache/hudi/pull/4556#issuecomment-1024819714
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "d87786af43a7aeba7549cc3cfcbd97fc312bee0e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5074",
"triggerID" : "d87786af43a7aeba7549cc3cfcbd97fc312bee0e",
"triggerType" : "PUSH"
}, {
"hash" : "4b87ba1474be575ec27109ccbe626e4c2fc9c224",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5077",
"triggerID" : "4b87ba1474be575ec27109ccbe626e4c2fc9c224",
"triggerType" : "PUSH"
}, {
"hash" : "77d11131baabd1c4e3cc2050337daca4df5f6427",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "77d11131baabd1c4e3cc2050337daca4df5f6427",
"triggerType" : "PUSH"
}, {
"hash" : "3d9c2ae28da858d1e8476052c99391015effb7db",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "3d9c2ae28da858d1e8476052c99391015effb7db",
"triggerType" : "PUSH"
}, {
"hash" : "79ac9affcb7f81497e0df755c8200638d35b02b7",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5081",
"triggerID" : "79ac9affcb7f81497e0df755c8200638d35b02b7",
"triggerType" : "PUSH"
}, {
"hash" : "3c14bbe6c6bcf49c4164c45e82f77b473f4de396",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5113",
"triggerID" : "3c14bbe6c6bcf49c4164c45e82f77b473f4de396",
"triggerType" : "PUSH"
}, {
"hash" : "276f13d6efd00b301b232b286d585729c9d1d26e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5116",
"triggerID" : "276f13d6efd00b301b232b286d585729c9d1d26e",
"triggerType" : "PUSH"
}, {
"hash" : "31b0669d7b638bd65a17b22a2ceb772f2627512c",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "31b0669d7b638bd65a17b22a2ceb772f2627512c",
"triggerType" : "PUSH"
}, {
"hash" : "096e26af39a477ffccbee0edd764493e12e15e71",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5124",
"triggerID" : "096e26af39a477ffccbee0edd764493e12e15e71",
"triggerType" : "PUSH"
}, {
"hash" : "97dd5ec7c9246f6d9f467b9076b790dd6017c5b4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5213",
"triggerID" : "97dd5ec7c9246f6d9f467b9076b790dd6017c5b4",
"triggerType" : "PUSH"
}, {
"hash" : "0538475fe488089c4cb3bc0afb63c2f518329969",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5257",
"triggerID" : "0538475fe488089c4cb3bc0afb63c2f518329969",
"triggerType" : "PUSH"
}, {
"hash" : "9f4b334e340fb26004e1b07fc8fbaaa047c76775",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5261",
"triggerID" : "9f4b334e340fb26004e1b07fc8fbaaa047c76775",
"triggerType" : "PUSH"
}, {
"hash" : "368c099820c3cbf57496d0e46d1858aa8eb153ee",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5330",
"triggerID" : "368c099820c3cbf57496d0e46d1858aa8eb153ee",
"triggerType" : "PUSH"
}, {
"hash" : "28a5a4f537544d35dfcd8700a7b97fb7216682ce",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "28a5a4f537544d35dfcd8700a7b97fb7216682ce",
"triggerType" : "PUSH"
}, {
"hash" : "08ffdd8b47d147c9b5c889a5f56e39b9b140612d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5351",
"triggerID" : "08ffdd8b47d147c9b5c889a5f56e39b9b140612d",
"triggerType" : "PUSH"
}, {
"hash" : "c09e228f7cce78a7dbbc394e93b3cf8c6c3d4d5f",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "c09e228f7cce78a7dbbc394e93b3cf8c6c3d4d5f",
"triggerType" : "PUSH"
}, {
"hash" : "8dadbf672d4d27505592f18bc89422fd7c013669",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5398",
"triggerID" : "8dadbf672d4d27505592f18bc89422fd7c013669",
"triggerType" : "PUSH"
}, {
"hash" : "906607be5bd62ee1cbbda34acb6a89916c1f7aee",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5424",
"triggerID" : "906607be5bd62ee1cbbda34acb6a89916c1f7aee",
"triggerType" : "PUSH"
}, {
"hash" : "dc1b033f40cea9642f71b8fcff74aa82106726b6",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5484",
"triggerID" : "dc1b033f40cea9642f71b8fcff74aa82106726b6",
"triggerType" : "PUSH"
}, {
"hash" : "5b8f5819fff8fec34864eb409fd429b95be17b9b",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "5b8f5819fff8fec34864eb409fd429b95be17b9b",
"triggerType" : "PUSH"
}, {
"hash" : "13702fc2232ebd9300966b0a917a3358d8d0f18c",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5590",
"triggerID" : "13702fc2232ebd9300966b0a917a3358d8d0f18c",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 77d11131baabd1c4e3cc2050337daca4df5f6427 UNKNOWN
* 3d9c2ae28da858d1e8476052c99391015effb7db UNKNOWN
* 31b0669d7b638bd65a17b22a2ceb772f2627512c UNKNOWN
* 28a5a4f537544d35dfcd8700a7b97fb7216682ce UNKNOWN
* c09e228f7cce78a7dbbc394e93b3cf8c6c3d4d5f UNKNOWN
* 5b8f5819fff8fec34864eb409fd429b95be17b9b UNKNOWN
* 13702fc2232ebd9300966b0a917a3358d8d0f18c Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5590)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #4556: [HUDI-3191][Stacked on 4716] Removing duplicating file-listing process w/in Hive's MOR `FileInputFormat`s
Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #4556:
URL: https://github.com/apache/hudi/pull/4556#issuecomment-1024849640
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "d87786af43a7aeba7549cc3cfcbd97fc312bee0e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5074",
"triggerID" : "d87786af43a7aeba7549cc3cfcbd97fc312bee0e",
"triggerType" : "PUSH"
}, {
"hash" : "4b87ba1474be575ec27109ccbe626e4c2fc9c224",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5077",
"triggerID" : "4b87ba1474be575ec27109ccbe626e4c2fc9c224",
"triggerType" : "PUSH"
}, {
"hash" : "77d11131baabd1c4e3cc2050337daca4df5f6427",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "77d11131baabd1c4e3cc2050337daca4df5f6427",
"triggerType" : "PUSH"
}, {
"hash" : "3d9c2ae28da858d1e8476052c99391015effb7db",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "3d9c2ae28da858d1e8476052c99391015effb7db",
"triggerType" : "PUSH"
}, {
"hash" : "79ac9affcb7f81497e0df755c8200638d35b02b7",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5081",
"triggerID" : "79ac9affcb7f81497e0df755c8200638d35b02b7",
"triggerType" : "PUSH"
}, {
"hash" : "3c14bbe6c6bcf49c4164c45e82f77b473f4de396",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5113",
"triggerID" : "3c14bbe6c6bcf49c4164c45e82f77b473f4de396",
"triggerType" : "PUSH"
}, {
"hash" : "276f13d6efd00b301b232b286d585729c9d1d26e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5116",
"triggerID" : "276f13d6efd00b301b232b286d585729c9d1d26e",
"triggerType" : "PUSH"
}, {
"hash" : "31b0669d7b638bd65a17b22a2ceb772f2627512c",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "31b0669d7b638bd65a17b22a2ceb772f2627512c",
"triggerType" : "PUSH"
}, {
"hash" : "096e26af39a477ffccbee0edd764493e12e15e71",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5124",
"triggerID" : "096e26af39a477ffccbee0edd764493e12e15e71",
"triggerType" : "PUSH"
}, {
"hash" : "97dd5ec7c9246f6d9f467b9076b790dd6017c5b4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5213",
"triggerID" : "97dd5ec7c9246f6d9f467b9076b790dd6017c5b4",
"triggerType" : "PUSH"
}, {
"hash" : "0538475fe488089c4cb3bc0afb63c2f518329969",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5257",
"triggerID" : "0538475fe488089c4cb3bc0afb63c2f518329969",
"triggerType" : "PUSH"
}, {
"hash" : "9f4b334e340fb26004e1b07fc8fbaaa047c76775",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5261",
"triggerID" : "9f4b334e340fb26004e1b07fc8fbaaa047c76775",
"triggerType" : "PUSH"
}, {
"hash" : "368c099820c3cbf57496d0e46d1858aa8eb153ee",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5330",
"triggerID" : "368c099820c3cbf57496d0e46d1858aa8eb153ee",
"triggerType" : "PUSH"
}, {
"hash" : "28a5a4f537544d35dfcd8700a7b97fb7216682ce",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "28a5a4f537544d35dfcd8700a7b97fb7216682ce",
"triggerType" : "PUSH"
}, {
"hash" : "08ffdd8b47d147c9b5c889a5f56e39b9b140612d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5351",
"triggerID" : "08ffdd8b47d147c9b5c889a5f56e39b9b140612d",
"triggerType" : "PUSH"
}, {
"hash" : "c09e228f7cce78a7dbbc394e93b3cf8c6c3d4d5f",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "c09e228f7cce78a7dbbc394e93b3cf8c6c3d4d5f",
"triggerType" : "PUSH"
}, {
"hash" : "8dadbf672d4d27505592f18bc89422fd7c013669",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5398",
"triggerID" : "8dadbf672d4d27505592f18bc89422fd7c013669",
"triggerType" : "PUSH"
}, {
"hash" : "906607be5bd62ee1cbbda34acb6a89916c1f7aee",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5424",
"triggerID" : "906607be5bd62ee1cbbda34acb6a89916c1f7aee",
"triggerType" : "PUSH"
}, {
"hash" : "dc1b033f40cea9642f71b8fcff74aa82106726b6",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5484",
"triggerID" : "dc1b033f40cea9642f71b8fcff74aa82106726b6",
"triggerType" : "PUSH"
}, {
"hash" : "5b8f5819fff8fec34864eb409fd429b95be17b9b",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "5b8f5819fff8fec34864eb409fd429b95be17b9b",
"triggerType" : "PUSH"
}, {
"hash" : "13702fc2232ebd9300966b0a917a3358d8d0f18c",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5590",
"triggerID" : "13702fc2232ebd9300966b0a917a3358d8d0f18c",
"triggerType" : "PUSH"
}, {
"hash" : "13702fc2232ebd9300966b0a917a3358d8d0f18c",
"status" : "CANCELED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5600",
"triggerID" : "1024845655",
"triggerType" : "MANUAL"
}, {
"hash" : "9bdd8a60f95123f82a5f30f5e68929f5b7e1f8da",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "9bdd8a60f95123f82a5f30f5e68929f5b7e1f8da",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 77d11131baabd1c4e3cc2050337daca4df5f6427 UNKNOWN
* 3d9c2ae28da858d1e8476052c99391015effb7db UNKNOWN
* 31b0669d7b638bd65a17b22a2ceb772f2627512c UNKNOWN
* 28a5a4f537544d35dfcd8700a7b97fb7216682ce UNKNOWN
* c09e228f7cce78a7dbbc394e93b3cf8c6c3d4d5f UNKNOWN
* 5b8f5819fff8fec34864eb409fd429b95be17b9b UNKNOWN
* 13702fc2232ebd9300966b0a917a3358d8d0f18c Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5590) Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5600)
* 9bdd8a60f95123f82a5f30f5e68929f5b7e1f8da UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #4556: [HUDI-3191][Stacked on 4716] Removing duplicating file-listing process w/in Hive's MOR `FileInputFormat`s
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #4556:
URL: https://github.com/apache/hudi/pull/4556#issuecomment-1026281702
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "d87786af43a7aeba7549cc3cfcbd97fc312bee0e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5074",
"triggerID" : "d87786af43a7aeba7549cc3cfcbd97fc312bee0e",
"triggerType" : "PUSH"
}, {
"hash" : "4b87ba1474be575ec27109ccbe626e4c2fc9c224",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5077",
"triggerID" : "4b87ba1474be575ec27109ccbe626e4c2fc9c224",
"triggerType" : "PUSH"
}, {
"hash" : "77d11131baabd1c4e3cc2050337daca4df5f6427",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "77d11131baabd1c4e3cc2050337daca4df5f6427",
"triggerType" : "PUSH"
}, {
"hash" : "3d9c2ae28da858d1e8476052c99391015effb7db",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "3d9c2ae28da858d1e8476052c99391015effb7db",
"triggerType" : "PUSH"
}, {
"hash" : "79ac9affcb7f81497e0df755c8200638d35b02b7",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5081",
"triggerID" : "79ac9affcb7f81497e0df755c8200638d35b02b7",
"triggerType" : "PUSH"
}, {
"hash" : "3c14bbe6c6bcf49c4164c45e82f77b473f4de396",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5113",
"triggerID" : "3c14bbe6c6bcf49c4164c45e82f77b473f4de396",
"triggerType" : "PUSH"
}, {
"hash" : "276f13d6efd00b301b232b286d585729c9d1d26e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5116",
"triggerID" : "276f13d6efd00b301b232b286d585729c9d1d26e",
"triggerType" : "PUSH"
}, {
"hash" : "31b0669d7b638bd65a17b22a2ceb772f2627512c",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "31b0669d7b638bd65a17b22a2ceb772f2627512c",
"triggerType" : "PUSH"
}, {
"hash" : "096e26af39a477ffccbee0edd764493e12e15e71",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5124",
"triggerID" : "096e26af39a477ffccbee0edd764493e12e15e71",
"triggerType" : "PUSH"
}, {
"hash" : "97dd5ec7c9246f6d9f467b9076b790dd6017c5b4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5213",
"triggerID" : "97dd5ec7c9246f6d9f467b9076b790dd6017c5b4",
"triggerType" : "PUSH"
}, {
"hash" : "0538475fe488089c4cb3bc0afb63c2f518329969",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5257",
"triggerID" : "0538475fe488089c4cb3bc0afb63c2f518329969",
"triggerType" : "PUSH"
}, {
"hash" : "9f4b334e340fb26004e1b07fc8fbaaa047c76775",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5261",
"triggerID" : "9f4b334e340fb26004e1b07fc8fbaaa047c76775",
"triggerType" : "PUSH"
}, {
"hash" : "368c099820c3cbf57496d0e46d1858aa8eb153ee",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5330",
"triggerID" : "368c099820c3cbf57496d0e46d1858aa8eb153ee",
"triggerType" : "PUSH"
}, {
"hash" : "28a5a4f537544d35dfcd8700a7b97fb7216682ce",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "28a5a4f537544d35dfcd8700a7b97fb7216682ce",
"triggerType" : "PUSH"
}, {
"hash" : "08ffdd8b47d147c9b5c889a5f56e39b9b140612d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5351",
"triggerID" : "08ffdd8b47d147c9b5c889a5f56e39b9b140612d",
"triggerType" : "PUSH"
}, {
"hash" : "c09e228f7cce78a7dbbc394e93b3cf8c6c3d4d5f",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "c09e228f7cce78a7dbbc394e93b3cf8c6c3d4d5f",
"triggerType" : "PUSH"
}, {
"hash" : "8dadbf672d4d27505592f18bc89422fd7c013669",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5398",
"triggerID" : "8dadbf672d4d27505592f18bc89422fd7c013669",
"triggerType" : "PUSH"
}, {
"hash" : "906607be5bd62ee1cbbda34acb6a89916c1f7aee",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5424",
"triggerID" : "906607be5bd62ee1cbbda34acb6a89916c1f7aee",
"triggerType" : "PUSH"
}, {
"hash" : "dc1b033f40cea9642f71b8fcff74aa82106726b6",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5484",
"triggerID" : "dc1b033f40cea9642f71b8fcff74aa82106726b6",
"triggerType" : "PUSH"
}, {
"hash" : "5b8f5819fff8fec34864eb409fd429b95be17b9b",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "5b8f5819fff8fec34864eb409fd429b95be17b9b",
"triggerType" : "PUSH"
}, {
"hash" : "13702fc2232ebd9300966b0a917a3358d8d0f18c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5590",
"triggerID" : "13702fc2232ebd9300966b0a917a3358d8d0f18c",
"triggerType" : "PUSH"
}, {
"hash" : "13702fc2232ebd9300966b0a917a3358d8d0f18c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5600",
"triggerID" : "1024845655",
"triggerType" : "MANUAL"
}, {
"hash" : "9bdd8a60f95123f82a5f30f5e68929f5b7e1f8da",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5603",
"triggerID" : "9bdd8a60f95123f82a5f30f5e68929f5b7e1f8da",
"triggerType" : "PUSH"
}, {
"hash" : "aebb9df557c4afe3ca88f6b8b28ba2fbfdcbd597",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5631",
"triggerID" : "aebb9df557c4afe3ca88f6b8b28ba2fbfdcbd597",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 77d11131baabd1c4e3cc2050337daca4df5f6427 UNKNOWN
* 3d9c2ae28da858d1e8476052c99391015effb7db UNKNOWN
* 31b0669d7b638bd65a17b22a2ceb772f2627512c UNKNOWN
* 28a5a4f537544d35dfcd8700a7b97fb7216682ce UNKNOWN
* c09e228f7cce78a7dbbc394e93b3cf8c6c3d4d5f UNKNOWN
* 5b8f5819fff8fec34864eb409fd429b95be17b9b UNKNOWN
* 9bdd8a60f95123f82a5f30f5e68929f5b7e1f8da Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5603)
* aebb9df557c4afe3ca88f6b8b28ba2fbfdcbd597 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5631)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #4556: [HUDI-3191][Stacked on 4716] Removing duplicating file-listing process w/in Hive's MOR `FileInputFormat`s
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #4556:
URL: https://github.com/apache/hudi/pull/4556#issuecomment-1027389109
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "d87786af43a7aeba7549cc3cfcbd97fc312bee0e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5074",
"triggerID" : "d87786af43a7aeba7549cc3cfcbd97fc312bee0e",
"triggerType" : "PUSH"
}, {
"hash" : "4b87ba1474be575ec27109ccbe626e4c2fc9c224",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5077",
"triggerID" : "4b87ba1474be575ec27109ccbe626e4c2fc9c224",
"triggerType" : "PUSH"
}, {
"hash" : "77d11131baabd1c4e3cc2050337daca4df5f6427",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "77d11131baabd1c4e3cc2050337daca4df5f6427",
"triggerType" : "PUSH"
}, {
"hash" : "3d9c2ae28da858d1e8476052c99391015effb7db",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "3d9c2ae28da858d1e8476052c99391015effb7db",
"triggerType" : "PUSH"
}, {
"hash" : "79ac9affcb7f81497e0df755c8200638d35b02b7",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5081",
"triggerID" : "79ac9affcb7f81497e0df755c8200638d35b02b7",
"triggerType" : "PUSH"
}, {
"hash" : "3c14bbe6c6bcf49c4164c45e82f77b473f4de396",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5113",
"triggerID" : "3c14bbe6c6bcf49c4164c45e82f77b473f4de396",
"triggerType" : "PUSH"
}, {
"hash" : "276f13d6efd00b301b232b286d585729c9d1d26e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5116",
"triggerID" : "276f13d6efd00b301b232b286d585729c9d1d26e",
"triggerType" : "PUSH"
}, {
"hash" : "31b0669d7b638bd65a17b22a2ceb772f2627512c",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "31b0669d7b638bd65a17b22a2ceb772f2627512c",
"triggerType" : "PUSH"
}, {
"hash" : "096e26af39a477ffccbee0edd764493e12e15e71",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5124",
"triggerID" : "096e26af39a477ffccbee0edd764493e12e15e71",
"triggerType" : "PUSH"
}, {
"hash" : "97dd5ec7c9246f6d9f467b9076b790dd6017c5b4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5213",
"triggerID" : "97dd5ec7c9246f6d9f467b9076b790dd6017c5b4",
"triggerType" : "PUSH"
}, {
"hash" : "0538475fe488089c4cb3bc0afb63c2f518329969",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5257",
"triggerID" : "0538475fe488089c4cb3bc0afb63c2f518329969",
"triggerType" : "PUSH"
}, {
"hash" : "9f4b334e340fb26004e1b07fc8fbaaa047c76775",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5261",
"triggerID" : "9f4b334e340fb26004e1b07fc8fbaaa047c76775",
"triggerType" : "PUSH"
}, {
"hash" : "368c099820c3cbf57496d0e46d1858aa8eb153ee",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5330",
"triggerID" : "368c099820c3cbf57496d0e46d1858aa8eb153ee",
"triggerType" : "PUSH"
}, {
"hash" : "28a5a4f537544d35dfcd8700a7b97fb7216682ce",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "28a5a4f537544d35dfcd8700a7b97fb7216682ce",
"triggerType" : "PUSH"
}, {
"hash" : "08ffdd8b47d147c9b5c889a5f56e39b9b140612d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5351",
"triggerID" : "08ffdd8b47d147c9b5c889a5f56e39b9b140612d",
"triggerType" : "PUSH"
}, {
"hash" : "c09e228f7cce78a7dbbc394e93b3cf8c6c3d4d5f",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "c09e228f7cce78a7dbbc394e93b3cf8c6c3d4d5f",
"triggerType" : "PUSH"
}, {
"hash" : "8dadbf672d4d27505592f18bc89422fd7c013669",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5398",
"triggerID" : "8dadbf672d4d27505592f18bc89422fd7c013669",
"triggerType" : "PUSH"
}, {
"hash" : "906607be5bd62ee1cbbda34acb6a89916c1f7aee",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5424",
"triggerID" : "906607be5bd62ee1cbbda34acb6a89916c1f7aee",
"triggerType" : "PUSH"
}, {
"hash" : "dc1b033f40cea9642f71b8fcff74aa82106726b6",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5484",
"triggerID" : "dc1b033f40cea9642f71b8fcff74aa82106726b6",
"triggerType" : "PUSH"
}, {
"hash" : "5b8f5819fff8fec34864eb409fd429b95be17b9b",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "5b8f5819fff8fec34864eb409fd429b95be17b9b",
"triggerType" : "PUSH"
}, {
"hash" : "13702fc2232ebd9300966b0a917a3358d8d0f18c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5590",
"triggerID" : "13702fc2232ebd9300966b0a917a3358d8d0f18c",
"triggerType" : "PUSH"
}, {
"hash" : "13702fc2232ebd9300966b0a917a3358d8d0f18c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5600",
"triggerID" : "1024845655",
"triggerType" : "MANUAL"
}, {
"hash" : "9bdd8a60f95123f82a5f30f5e68929f5b7e1f8da",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5603",
"triggerID" : "9bdd8a60f95123f82a5f30f5e68929f5b7e1f8da",
"triggerType" : "PUSH"
}, {
"hash" : "aebb9df557c4afe3ca88f6b8b28ba2fbfdcbd597",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5631",
"triggerID" : "aebb9df557c4afe3ca88f6b8b28ba2fbfdcbd597",
"triggerType" : "PUSH"
}, {
"hash" : "5d37935bc8bb33260735d782ca560fd59e02f321",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "5d37935bc8bb33260735d782ca560fd59e02f321",
"triggerType" : "PUSH"
}, {
"hash" : "f911d869f50009e5cd9f3fd341c83c732d7531ba",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5634",
"triggerID" : "f911d869f50009e5cd9f3fd341c83c732d7531ba",
"triggerType" : "PUSH"
}, {
"hash" : "f911d869f50009e5cd9f3fd341c83c732d7531ba",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5657",
"triggerID" : "1027051107",
"triggerType" : "MANUAL"
}, {
"hash" : "f911d869f50009e5cd9f3fd341c83c732d7531ba",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5659",
"triggerID" : "1027166086",
"triggerType" : "MANUAL"
}, {
"hash" : "f911d869f50009e5cd9f3fd341c83c732d7531ba",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5665",
"triggerID" : "1027387044",
"triggerType" : "MANUAL"
} ]
}-->
## CI report:
* 77d11131baabd1c4e3cc2050337daca4df5f6427 UNKNOWN
* 3d9c2ae28da858d1e8476052c99391015effb7db UNKNOWN
* 31b0669d7b638bd65a17b22a2ceb772f2627512c UNKNOWN
* 28a5a4f537544d35dfcd8700a7b97fb7216682ce UNKNOWN
* c09e228f7cce78a7dbbc394e93b3cf8c6c3d4d5f UNKNOWN
* 5b8f5819fff8fec34864eb409fd429b95be17b9b UNKNOWN
* 5d37935bc8bb33260735d782ca560fd59e02f321 UNKNOWN
* f911d869f50009e5cd9f3fd341c83c732d7531ba Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5634) Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5657) Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5659) Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5665)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #4556: [HUDI-3191][Stacked on 4716] Removing duplicating file-listing process w/in Hive's MOR `FileInputFormat`s
Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #4556:
URL: https://github.com/apache/hudi/pull/4556#issuecomment-1027244710
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "d87786af43a7aeba7549cc3cfcbd97fc312bee0e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5074",
"triggerID" : "d87786af43a7aeba7549cc3cfcbd97fc312bee0e",
"triggerType" : "PUSH"
}, {
"hash" : "4b87ba1474be575ec27109ccbe626e4c2fc9c224",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5077",
"triggerID" : "4b87ba1474be575ec27109ccbe626e4c2fc9c224",
"triggerType" : "PUSH"
}, {
"hash" : "77d11131baabd1c4e3cc2050337daca4df5f6427",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "77d11131baabd1c4e3cc2050337daca4df5f6427",
"triggerType" : "PUSH"
}, {
"hash" : "3d9c2ae28da858d1e8476052c99391015effb7db",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "3d9c2ae28da858d1e8476052c99391015effb7db",
"triggerType" : "PUSH"
}, {
"hash" : "79ac9affcb7f81497e0df755c8200638d35b02b7",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5081",
"triggerID" : "79ac9affcb7f81497e0df755c8200638d35b02b7",
"triggerType" : "PUSH"
}, {
"hash" : "3c14bbe6c6bcf49c4164c45e82f77b473f4de396",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5113",
"triggerID" : "3c14bbe6c6bcf49c4164c45e82f77b473f4de396",
"triggerType" : "PUSH"
}, {
"hash" : "276f13d6efd00b301b232b286d585729c9d1d26e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5116",
"triggerID" : "276f13d6efd00b301b232b286d585729c9d1d26e",
"triggerType" : "PUSH"
}, {
"hash" : "31b0669d7b638bd65a17b22a2ceb772f2627512c",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "31b0669d7b638bd65a17b22a2ceb772f2627512c",
"triggerType" : "PUSH"
}, {
"hash" : "096e26af39a477ffccbee0edd764493e12e15e71",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5124",
"triggerID" : "096e26af39a477ffccbee0edd764493e12e15e71",
"triggerType" : "PUSH"
}, {
"hash" : "97dd5ec7c9246f6d9f467b9076b790dd6017c5b4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5213",
"triggerID" : "97dd5ec7c9246f6d9f467b9076b790dd6017c5b4",
"triggerType" : "PUSH"
}, {
"hash" : "0538475fe488089c4cb3bc0afb63c2f518329969",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5257",
"triggerID" : "0538475fe488089c4cb3bc0afb63c2f518329969",
"triggerType" : "PUSH"
}, {
"hash" : "9f4b334e340fb26004e1b07fc8fbaaa047c76775",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5261",
"triggerID" : "9f4b334e340fb26004e1b07fc8fbaaa047c76775",
"triggerType" : "PUSH"
}, {
"hash" : "368c099820c3cbf57496d0e46d1858aa8eb153ee",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5330",
"triggerID" : "368c099820c3cbf57496d0e46d1858aa8eb153ee",
"triggerType" : "PUSH"
}, {
"hash" : "28a5a4f537544d35dfcd8700a7b97fb7216682ce",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "28a5a4f537544d35dfcd8700a7b97fb7216682ce",
"triggerType" : "PUSH"
}, {
"hash" : "08ffdd8b47d147c9b5c889a5f56e39b9b140612d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5351",
"triggerID" : "08ffdd8b47d147c9b5c889a5f56e39b9b140612d",
"triggerType" : "PUSH"
}, {
"hash" : "c09e228f7cce78a7dbbc394e93b3cf8c6c3d4d5f",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "c09e228f7cce78a7dbbc394e93b3cf8c6c3d4d5f",
"triggerType" : "PUSH"
}, {
"hash" : "8dadbf672d4d27505592f18bc89422fd7c013669",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5398",
"triggerID" : "8dadbf672d4d27505592f18bc89422fd7c013669",
"triggerType" : "PUSH"
}, {
"hash" : "906607be5bd62ee1cbbda34acb6a89916c1f7aee",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5424",
"triggerID" : "906607be5bd62ee1cbbda34acb6a89916c1f7aee",
"triggerType" : "PUSH"
}, {
"hash" : "dc1b033f40cea9642f71b8fcff74aa82106726b6",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5484",
"triggerID" : "dc1b033f40cea9642f71b8fcff74aa82106726b6",
"triggerType" : "PUSH"
}, {
"hash" : "5b8f5819fff8fec34864eb409fd429b95be17b9b",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "5b8f5819fff8fec34864eb409fd429b95be17b9b",
"triggerType" : "PUSH"
}, {
"hash" : "13702fc2232ebd9300966b0a917a3358d8d0f18c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5590",
"triggerID" : "13702fc2232ebd9300966b0a917a3358d8d0f18c",
"triggerType" : "PUSH"
}, {
"hash" : "13702fc2232ebd9300966b0a917a3358d8d0f18c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5600",
"triggerID" : "1024845655",
"triggerType" : "MANUAL"
}, {
"hash" : "9bdd8a60f95123f82a5f30f5e68929f5b7e1f8da",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5603",
"triggerID" : "9bdd8a60f95123f82a5f30f5e68929f5b7e1f8da",
"triggerType" : "PUSH"
}, {
"hash" : "aebb9df557c4afe3ca88f6b8b28ba2fbfdcbd597",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5631",
"triggerID" : "aebb9df557c4afe3ca88f6b8b28ba2fbfdcbd597",
"triggerType" : "PUSH"
}, {
"hash" : "5d37935bc8bb33260735d782ca560fd59e02f321",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "5d37935bc8bb33260735d782ca560fd59e02f321",
"triggerType" : "PUSH"
}, {
"hash" : "f911d869f50009e5cd9f3fd341c83c732d7531ba",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5634",
"triggerID" : "f911d869f50009e5cd9f3fd341c83c732d7531ba",
"triggerType" : "PUSH"
}, {
"hash" : "f911d869f50009e5cd9f3fd341c83c732d7531ba",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5657",
"triggerID" : "1027051107",
"triggerType" : "MANUAL"
}, {
"hash" : "f911d869f50009e5cd9f3fd341c83c732d7531ba",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5659",
"triggerID" : "1027166086",
"triggerType" : "MANUAL"
} ]
}-->
## CI report:
* 77d11131baabd1c4e3cc2050337daca4df5f6427 UNKNOWN
* 3d9c2ae28da858d1e8476052c99391015effb7db UNKNOWN
* 31b0669d7b638bd65a17b22a2ceb772f2627512c UNKNOWN
* 28a5a4f537544d35dfcd8700a7b97fb7216682ce UNKNOWN
* c09e228f7cce78a7dbbc394e93b3cf8c6c3d4d5f UNKNOWN
* 5b8f5819fff8fec34864eb409fd429b95be17b9b UNKNOWN
* 5d37935bc8bb33260735d782ca560fd59e02f321 UNKNOWN
* f911d869f50009e5cd9f3fd341c83c732d7531ba Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5634) Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5657) Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5659)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #4556: [HUDI-3191] Removing duplicating file-listing process w/in Hive's MOR `FileInputFormat`s
Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #4556:
URL: https://github.com/apache/hudi/pull/4556#issuecomment-1020675804
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "d87786af43a7aeba7549cc3cfcbd97fc312bee0e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5074",
"triggerID" : "d87786af43a7aeba7549cc3cfcbd97fc312bee0e",
"triggerType" : "PUSH"
}, {
"hash" : "4b87ba1474be575ec27109ccbe626e4c2fc9c224",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5077",
"triggerID" : "4b87ba1474be575ec27109ccbe626e4c2fc9c224",
"triggerType" : "PUSH"
}, {
"hash" : "77d11131baabd1c4e3cc2050337daca4df5f6427",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "77d11131baabd1c4e3cc2050337daca4df5f6427",
"triggerType" : "PUSH"
}, {
"hash" : "3d9c2ae28da858d1e8476052c99391015effb7db",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "3d9c2ae28da858d1e8476052c99391015effb7db",
"triggerType" : "PUSH"
}, {
"hash" : "79ac9affcb7f81497e0df755c8200638d35b02b7",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5081",
"triggerID" : "79ac9affcb7f81497e0df755c8200638d35b02b7",
"triggerType" : "PUSH"
}, {
"hash" : "3c14bbe6c6bcf49c4164c45e82f77b473f4de396",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5113",
"triggerID" : "3c14bbe6c6bcf49c4164c45e82f77b473f4de396",
"triggerType" : "PUSH"
}, {
"hash" : "276f13d6efd00b301b232b286d585729c9d1d26e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5116",
"triggerID" : "276f13d6efd00b301b232b286d585729c9d1d26e",
"triggerType" : "PUSH"
}, {
"hash" : "31b0669d7b638bd65a17b22a2ceb772f2627512c",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "31b0669d7b638bd65a17b22a2ceb772f2627512c",
"triggerType" : "PUSH"
}, {
"hash" : "096e26af39a477ffccbee0edd764493e12e15e71",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5124",
"triggerID" : "096e26af39a477ffccbee0edd764493e12e15e71",
"triggerType" : "PUSH"
}, {
"hash" : "97dd5ec7c9246f6d9f467b9076b790dd6017c5b4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5213",
"triggerID" : "97dd5ec7c9246f6d9f467b9076b790dd6017c5b4",
"triggerType" : "PUSH"
}, {
"hash" : "0538475fe488089c4cb3bc0afb63c2f518329969",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5257",
"triggerID" : "0538475fe488089c4cb3bc0afb63c2f518329969",
"triggerType" : "PUSH"
}, {
"hash" : "9f4b334e340fb26004e1b07fc8fbaaa047c76775",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5261",
"triggerID" : "9f4b334e340fb26004e1b07fc8fbaaa047c76775",
"triggerType" : "PUSH"
}, {
"hash" : "368c099820c3cbf57496d0e46d1858aa8eb153ee",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5330",
"triggerID" : "368c099820c3cbf57496d0e46d1858aa8eb153ee",
"triggerType" : "PUSH"
}, {
"hash" : "28a5a4f537544d35dfcd8700a7b97fb7216682ce",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "28a5a4f537544d35dfcd8700a7b97fb7216682ce",
"triggerType" : "PUSH"
}, {
"hash" : "08ffdd8b47d147c9b5c889a5f56e39b9b140612d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5351",
"triggerID" : "08ffdd8b47d147c9b5c889a5f56e39b9b140612d",
"triggerType" : "PUSH"
}, {
"hash" : "c09e228f7cce78a7dbbc394e93b3cf8c6c3d4d5f",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "c09e228f7cce78a7dbbc394e93b3cf8c6c3d4d5f",
"triggerType" : "PUSH"
}, {
"hash" : "8dadbf672d4d27505592f18bc89422fd7c013669",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5398",
"triggerID" : "8dadbf672d4d27505592f18bc89422fd7c013669",
"triggerType" : "PUSH"
}, {
"hash" : "906607be5bd62ee1cbbda34acb6a89916c1f7aee",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5424",
"triggerID" : "906607be5bd62ee1cbbda34acb6a89916c1f7aee",
"triggerType" : "PUSH"
}, {
"hash" : "dc1b033f40cea9642f71b8fcff74aa82106726b6",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "dc1b033f40cea9642f71b8fcff74aa82106726b6",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 77d11131baabd1c4e3cc2050337daca4df5f6427 UNKNOWN
* 3d9c2ae28da858d1e8476052c99391015effb7db UNKNOWN
* 31b0669d7b638bd65a17b22a2ceb772f2627512c UNKNOWN
* 28a5a4f537544d35dfcd8700a7b97fb7216682ce UNKNOWN
* c09e228f7cce78a7dbbc394e93b3cf8c6c3d4d5f UNKNOWN
* 906607be5bd62ee1cbbda34acb6a89916c1f7aee Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5424)
* dc1b033f40cea9642f71b8fcff74aa82106726b6 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] alexeykudinkin commented on a change in pull request #4556: [HUDI-3191] Removing duplicating file-listing process w/in Hive's MOR `FileInputFormat`s
Posted by GitBox <gi...@apache.org>.
alexeykudinkin commented on a change in pull request #4556:
URL: https://github.com/apache/hudi/pull/4556#discussion_r791355209
##########
File path: hudi-hadoop-mr/src/main/java/org/apache/hudi/hadoop/BootstrapBaseFileSplit.java
##########
@@ -32,10 +32,6 @@
private FileSplit bootstrapFileSplit;
- public BootstrapBaseFileSplit() {
- super();
- }
Review comment:
Yeah, this isn't used outside of our codebase
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #4556: [HUDI-3191][Stacked on 4531] Removing duplicating file-listing process w/in Hive's MOR `FIleInputFormat`s
Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #4556:
URL: https://github.com/apache/hudi/pull/4556#issuecomment-1009549954
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "d87786af43a7aeba7549cc3cfcbd97fc312bee0e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5074",
"triggerID" : "d87786af43a7aeba7549cc3cfcbd97fc312bee0e",
"triggerType" : "PUSH"
}, {
"hash" : "4b87ba1474be575ec27109ccbe626e4c2fc9c224",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5077",
"triggerID" : "4b87ba1474be575ec27109ccbe626e4c2fc9c224",
"triggerType" : "PUSH"
}, {
"hash" : "77d11131baabd1c4e3cc2050337daca4df5f6427",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "77d11131baabd1c4e3cc2050337daca4df5f6427",
"triggerType" : "PUSH"
}, {
"hash" : "3d9c2ae28da858d1e8476052c99391015effb7db",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "3d9c2ae28da858d1e8476052c99391015effb7db",
"triggerType" : "PUSH"
}, {
"hash" : "79ac9affcb7f81497e0df755c8200638d35b02b7",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5081",
"triggerID" : "79ac9affcb7f81497e0df755c8200638d35b02b7",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 4b87ba1474be575ec27109ccbe626e4c2fc9c224 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5077)
* 77d11131baabd1c4e3cc2050337daca4df5f6427 UNKNOWN
* 3d9c2ae28da858d1e8476052c99391015effb7db UNKNOWN
* 79ac9affcb7f81497e0df755c8200638d35b02b7 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5081)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #4556: [HUDI-3191][Stacked on 4531] Removing duplicating file-listing process w/in Hive's MOR `FIleInputFormat`s
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #4556:
URL: https://github.com/apache/hudi/pull/4556#issuecomment-1009572755
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "d87786af43a7aeba7549cc3cfcbd97fc312bee0e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5074",
"triggerID" : "d87786af43a7aeba7549cc3cfcbd97fc312bee0e",
"triggerType" : "PUSH"
}, {
"hash" : "4b87ba1474be575ec27109ccbe626e4c2fc9c224",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5077",
"triggerID" : "4b87ba1474be575ec27109ccbe626e4c2fc9c224",
"triggerType" : "PUSH"
}, {
"hash" : "77d11131baabd1c4e3cc2050337daca4df5f6427",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "77d11131baabd1c4e3cc2050337daca4df5f6427",
"triggerType" : "PUSH"
}, {
"hash" : "3d9c2ae28da858d1e8476052c99391015effb7db",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "3d9c2ae28da858d1e8476052c99391015effb7db",
"triggerType" : "PUSH"
}, {
"hash" : "79ac9affcb7f81497e0df755c8200638d35b02b7",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5081",
"triggerID" : "79ac9affcb7f81497e0df755c8200638d35b02b7",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 77d11131baabd1c4e3cc2050337daca4df5f6427 UNKNOWN
* 3d9c2ae28da858d1e8476052c99391015effb7db UNKNOWN
* 79ac9affcb7f81497e0df755c8200638d35b02b7 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5081)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #4556: [HUDI-3191][Stacked on 4531] Removing duplicating file-listing process w/in Hive's MOR `FIleInputFormat`s
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #4556:
URL: https://github.com/apache/hudi/pull/4556#issuecomment-1010339059
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "d87786af43a7aeba7549cc3cfcbd97fc312bee0e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5074",
"triggerID" : "d87786af43a7aeba7549cc3cfcbd97fc312bee0e",
"triggerType" : "PUSH"
}, {
"hash" : "4b87ba1474be575ec27109ccbe626e4c2fc9c224",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5077",
"triggerID" : "4b87ba1474be575ec27109ccbe626e4c2fc9c224",
"triggerType" : "PUSH"
}, {
"hash" : "77d11131baabd1c4e3cc2050337daca4df5f6427",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "77d11131baabd1c4e3cc2050337daca4df5f6427",
"triggerType" : "PUSH"
}, {
"hash" : "3d9c2ae28da858d1e8476052c99391015effb7db",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "3d9c2ae28da858d1e8476052c99391015effb7db",
"triggerType" : "PUSH"
}, {
"hash" : "79ac9affcb7f81497e0df755c8200638d35b02b7",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5081",
"triggerID" : "79ac9affcb7f81497e0df755c8200638d35b02b7",
"triggerType" : "PUSH"
}, {
"hash" : "3c14bbe6c6bcf49c4164c45e82f77b473f4de396",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "3c14bbe6c6bcf49c4164c45e82f77b473f4de396",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 77d11131baabd1c4e3cc2050337daca4df5f6427 UNKNOWN
* 3d9c2ae28da858d1e8476052c99391015effb7db UNKNOWN
* 79ac9affcb7f81497e0df755c8200638d35b02b7 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5081)
* 3c14bbe6c6bcf49c4164c45e82f77b473f4de396 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #4556: [HUDI-3191][Stacked on 4531] Removing duplicating file-listing process w/in Hive's MOR `FIleInputFormat`s
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #4556:
URL: https://github.com/apache/hudi/pull/4556#issuecomment-1010367217
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "d87786af43a7aeba7549cc3cfcbd97fc312bee0e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5074",
"triggerID" : "d87786af43a7aeba7549cc3cfcbd97fc312bee0e",
"triggerType" : "PUSH"
}, {
"hash" : "4b87ba1474be575ec27109ccbe626e4c2fc9c224",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5077",
"triggerID" : "4b87ba1474be575ec27109ccbe626e4c2fc9c224",
"triggerType" : "PUSH"
}, {
"hash" : "77d11131baabd1c4e3cc2050337daca4df5f6427",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "77d11131baabd1c4e3cc2050337daca4df5f6427",
"triggerType" : "PUSH"
}, {
"hash" : "3d9c2ae28da858d1e8476052c99391015effb7db",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "3d9c2ae28da858d1e8476052c99391015effb7db",
"triggerType" : "PUSH"
}, {
"hash" : "79ac9affcb7f81497e0df755c8200638d35b02b7",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5081",
"triggerID" : "79ac9affcb7f81497e0df755c8200638d35b02b7",
"triggerType" : "PUSH"
}, {
"hash" : "3c14bbe6c6bcf49c4164c45e82f77b473f4de396",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5113",
"triggerID" : "3c14bbe6c6bcf49c4164c45e82f77b473f4de396",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 77d11131baabd1c4e3cc2050337daca4df5f6427 UNKNOWN
* 3d9c2ae28da858d1e8476052c99391015effb7db UNKNOWN
* 79ac9affcb7f81497e0df755c8200638d35b02b7 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5081)
* 3c14bbe6c6bcf49c4164c45e82f77b473f4de396 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5113)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #4556: [HUDI-3191][Stacked on 4531] Removing duplicating file-listing process w/in Hive's MOR `FIleInputFormat`s
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #4556:
URL: https://github.com/apache/hudi/pull/4556#issuecomment-1010551217
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "d87786af43a7aeba7549cc3cfcbd97fc312bee0e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5074",
"triggerID" : "d87786af43a7aeba7549cc3cfcbd97fc312bee0e",
"triggerType" : "PUSH"
}, {
"hash" : "4b87ba1474be575ec27109ccbe626e4c2fc9c224",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5077",
"triggerID" : "4b87ba1474be575ec27109ccbe626e4c2fc9c224",
"triggerType" : "PUSH"
}, {
"hash" : "77d11131baabd1c4e3cc2050337daca4df5f6427",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "77d11131baabd1c4e3cc2050337daca4df5f6427",
"triggerType" : "PUSH"
}, {
"hash" : "3d9c2ae28da858d1e8476052c99391015effb7db",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "3d9c2ae28da858d1e8476052c99391015effb7db",
"triggerType" : "PUSH"
}, {
"hash" : "79ac9affcb7f81497e0df755c8200638d35b02b7",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5081",
"triggerID" : "79ac9affcb7f81497e0df755c8200638d35b02b7",
"triggerType" : "PUSH"
}, {
"hash" : "3c14bbe6c6bcf49c4164c45e82f77b473f4de396",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5113",
"triggerID" : "3c14bbe6c6bcf49c4164c45e82f77b473f4de396",
"triggerType" : "PUSH"
}, {
"hash" : "276f13d6efd00b301b232b286d585729c9d1d26e",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5116",
"triggerID" : "276f13d6efd00b301b232b286d585729c9d1d26e",
"triggerType" : "PUSH"
}, {
"hash" : "31b0669d7b638bd65a17b22a2ceb772f2627512c",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "31b0669d7b638bd65a17b22a2ceb772f2627512c",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 77d11131baabd1c4e3cc2050337daca4df5f6427 UNKNOWN
* 3d9c2ae28da858d1e8476052c99391015effb7db UNKNOWN
* 276f13d6efd00b301b232b286d585729c9d1d26e Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5116)
* 31b0669d7b638bd65a17b22a2ceb772f2627512c UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #4556: [HUDI-3191][Stacked on 4531] Removing duplicating file-listing process w/in Hive's MOR `FIleInputFormat`s
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #4556:
URL: https://github.com/apache/hudi/pull/4556#issuecomment-1010613411
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "d87786af43a7aeba7549cc3cfcbd97fc312bee0e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5074",
"triggerID" : "d87786af43a7aeba7549cc3cfcbd97fc312bee0e",
"triggerType" : "PUSH"
}, {
"hash" : "4b87ba1474be575ec27109ccbe626e4c2fc9c224",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5077",
"triggerID" : "4b87ba1474be575ec27109ccbe626e4c2fc9c224",
"triggerType" : "PUSH"
}, {
"hash" : "77d11131baabd1c4e3cc2050337daca4df5f6427",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "77d11131baabd1c4e3cc2050337daca4df5f6427",
"triggerType" : "PUSH"
}, {
"hash" : "3d9c2ae28da858d1e8476052c99391015effb7db",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "3d9c2ae28da858d1e8476052c99391015effb7db",
"triggerType" : "PUSH"
}, {
"hash" : "79ac9affcb7f81497e0df755c8200638d35b02b7",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5081",
"triggerID" : "79ac9affcb7f81497e0df755c8200638d35b02b7",
"triggerType" : "PUSH"
}, {
"hash" : "3c14bbe6c6bcf49c4164c45e82f77b473f4de396",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5113",
"triggerID" : "3c14bbe6c6bcf49c4164c45e82f77b473f4de396",
"triggerType" : "PUSH"
}, {
"hash" : "276f13d6efd00b301b232b286d585729c9d1d26e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5116",
"triggerID" : "276f13d6efd00b301b232b286d585729c9d1d26e",
"triggerType" : "PUSH"
}, {
"hash" : "31b0669d7b638bd65a17b22a2ceb772f2627512c",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "31b0669d7b638bd65a17b22a2ceb772f2627512c",
"triggerType" : "PUSH"
}, {
"hash" : "096e26af39a477ffccbee0edd764493e12e15e71",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5124",
"triggerID" : "096e26af39a477ffccbee0edd764493e12e15e71",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 77d11131baabd1c4e3cc2050337daca4df5f6427 UNKNOWN
* 3d9c2ae28da858d1e8476052c99391015effb7db UNKNOWN
* 31b0669d7b638bd65a17b22a2ceb772f2627512c UNKNOWN
* 096e26af39a477ffccbee0edd764493e12e15e71 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5124)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #4556: [HUDI-3191][Stacked on 4531] Removing duplicating file-listing process w/in Hive's MOR `FIleInputFormat`s
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #4556:
URL: https://github.com/apache/hudi/pull/4556#issuecomment-1010455087
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "d87786af43a7aeba7549cc3cfcbd97fc312bee0e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5074",
"triggerID" : "d87786af43a7aeba7549cc3cfcbd97fc312bee0e",
"triggerType" : "PUSH"
}, {
"hash" : "4b87ba1474be575ec27109ccbe626e4c2fc9c224",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5077",
"triggerID" : "4b87ba1474be575ec27109ccbe626e4c2fc9c224",
"triggerType" : "PUSH"
}, {
"hash" : "77d11131baabd1c4e3cc2050337daca4df5f6427",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "77d11131baabd1c4e3cc2050337daca4df5f6427",
"triggerType" : "PUSH"
}, {
"hash" : "3d9c2ae28da858d1e8476052c99391015effb7db",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "3d9c2ae28da858d1e8476052c99391015effb7db",
"triggerType" : "PUSH"
}, {
"hash" : "79ac9affcb7f81497e0df755c8200638d35b02b7",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5081",
"triggerID" : "79ac9affcb7f81497e0df755c8200638d35b02b7",
"triggerType" : "PUSH"
}, {
"hash" : "3c14bbe6c6bcf49c4164c45e82f77b473f4de396",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5113",
"triggerID" : "3c14bbe6c6bcf49c4164c45e82f77b473f4de396",
"triggerType" : "PUSH"
}, {
"hash" : "276f13d6efd00b301b232b286d585729c9d1d26e",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5116",
"triggerID" : "276f13d6efd00b301b232b286d585729c9d1d26e",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 77d11131baabd1c4e3cc2050337daca4df5f6427 UNKNOWN
* 3d9c2ae28da858d1e8476052c99391015effb7db UNKNOWN
* 276f13d6efd00b301b232b286d585729c9d1d26e Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5116)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #4556: [HUDI-3191][Stacked on 4531] Removing duplicating file-listing process w/in Hive's MOR `FIleInputFormat`s
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #4556:
URL: https://github.com/apache/hudi/pull/4556#issuecomment-1009549954
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "d87786af43a7aeba7549cc3cfcbd97fc312bee0e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5074",
"triggerID" : "d87786af43a7aeba7549cc3cfcbd97fc312bee0e",
"triggerType" : "PUSH"
}, {
"hash" : "4b87ba1474be575ec27109ccbe626e4c2fc9c224",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5077",
"triggerID" : "4b87ba1474be575ec27109ccbe626e4c2fc9c224",
"triggerType" : "PUSH"
}, {
"hash" : "77d11131baabd1c4e3cc2050337daca4df5f6427",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "77d11131baabd1c4e3cc2050337daca4df5f6427",
"triggerType" : "PUSH"
}, {
"hash" : "3d9c2ae28da858d1e8476052c99391015effb7db",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "3d9c2ae28da858d1e8476052c99391015effb7db",
"triggerType" : "PUSH"
}, {
"hash" : "79ac9affcb7f81497e0df755c8200638d35b02b7",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5081",
"triggerID" : "79ac9affcb7f81497e0df755c8200638d35b02b7",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 4b87ba1474be575ec27109ccbe626e4c2fc9c224 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5077)
* 77d11131baabd1c4e3cc2050337daca4df5f6427 UNKNOWN
* 3d9c2ae28da858d1e8476052c99391015effb7db UNKNOWN
* 79ac9affcb7f81497e0df755c8200638d35b02b7 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5081)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #4556: [HUDI-3191][Stacked on 4531] Removing duplicating file-listing process w/in Hive's MOR `FIleInputFormat`s
Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #4556:
URL: https://github.com/apache/hudi/pull/4556#issuecomment-1012735569
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "d87786af43a7aeba7549cc3cfcbd97fc312bee0e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5074",
"triggerID" : "d87786af43a7aeba7549cc3cfcbd97fc312bee0e",
"triggerType" : "PUSH"
}, {
"hash" : "4b87ba1474be575ec27109ccbe626e4c2fc9c224",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5077",
"triggerID" : "4b87ba1474be575ec27109ccbe626e4c2fc9c224",
"triggerType" : "PUSH"
}, {
"hash" : "77d11131baabd1c4e3cc2050337daca4df5f6427",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "77d11131baabd1c4e3cc2050337daca4df5f6427",
"triggerType" : "PUSH"
}, {
"hash" : "3d9c2ae28da858d1e8476052c99391015effb7db",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "3d9c2ae28da858d1e8476052c99391015effb7db",
"triggerType" : "PUSH"
}, {
"hash" : "79ac9affcb7f81497e0df755c8200638d35b02b7",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5081",
"triggerID" : "79ac9affcb7f81497e0df755c8200638d35b02b7",
"triggerType" : "PUSH"
}, {
"hash" : "3c14bbe6c6bcf49c4164c45e82f77b473f4de396",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5113",
"triggerID" : "3c14bbe6c6bcf49c4164c45e82f77b473f4de396",
"triggerType" : "PUSH"
}, {
"hash" : "276f13d6efd00b301b232b286d585729c9d1d26e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5116",
"triggerID" : "276f13d6efd00b301b232b286d585729c9d1d26e",
"triggerType" : "PUSH"
}, {
"hash" : "31b0669d7b638bd65a17b22a2ceb772f2627512c",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "31b0669d7b638bd65a17b22a2ceb772f2627512c",
"triggerType" : "PUSH"
}, {
"hash" : "096e26af39a477ffccbee0edd764493e12e15e71",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5124",
"triggerID" : "096e26af39a477ffccbee0edd764493e12e15e71",
"triggerType" : "PUSH"
}, {
"hash" : "97dd5ec7c9246f6d9f467b9076b790dd6017c5b4",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5213",
"triggerID" : "97dd5ec7c9246f6d9f467b9076b790dd6017c5b4",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 77d11131baabd1c4e3cc2050337daca4df5f6427 UNKNOWN
* 3d9c2ae28da858d1e8476052c99391015effb7db UNKNOWN
* 31b0669d7b638bd65a17b22a2ceb772f2627512c UNKNOWN
* 97dd5ec7c9246f6d9f467b9076b790dd6017c5b4 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5213)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #4556: [HUDI-3191][Stacked on 4531] Removing duplicating file-listing process w/in Hive's MOR `FIleInputFormat`s
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #4556:
URL: https://github.com/apache/hudi/pull/4556#issuecomment-1013537426
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "d87786af43a7aeba7549cc3cfcbd97fc312bee0e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5074",
"triggerID" : "d87786af43a7aeba7549cc3cfcbd97fc312bee0e",
"triggerType" : "PUSH"
}, {
"hash" : "4b87ba1474be575ec27109ccbe626e4c2fc9c224",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5077",
"triggerID" : "4b87ba1474be575ec27109ccbe626e4c2fc9c224",
"triggerType" : "PUSH"
}, {
"hash" : "77d11131baabd1c4e3cc2050337daca4df5f6427",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "77d11131baabd1c4e3cc2050337daca4df5f6427",
"triggerType" : "PUSH"
}, {
"hash" : "3d9c2ae28da858d1e8476052c99391015effb7db",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "3d9c2ae28da858d1e8476052c99391015effb7db",
"triggerType" : "PUSH"
}, {
"hash" : "79ac9affcb7f81497e0df755c8200638d35b02b7",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5081",
"triggerID" : "79ac9affcb7f81497e0df755c8200638d35b02b7",
"triggerType" : "PUSH"
}, {
"hash" : "3c14bbe6c6bcf49c4164c45e82f77b473f4de396",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5113",
"triggerID" : "3c14bbe6c6bcf49c4164c45e82f77b473f4de396",
"triggerType" : "PUSH"
}, {
"hash" : "276f13d6efd00b301b232b286d585729c9d1d26e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5116",
"triggerID" : "276f13d6efd00b301b232b286d585729c9d1d26e",
"triggerType" : "PUSH"
}, {
"hash" : "31b0669d7b638bd65a17b22a2ceb772f2627512c",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "31b0669d7b638bd65a17b22a2ceb772f2627512c",
"triggerType" : "PUSH"
}, {
"hash" : "096e26af39a477ffccbee0edd764493e12e15e71",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5124",
"triggerID" : "096e26af39a477ffccbee0edd764493e12e15e71",
"triggerType" : "PUSH"
}, {
"hash" : "97dd5ec7c9246f6d9f467b9076b790dd6017c5b4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5213",
"triggerID" : "97dd5ec7c9246f6d9f467b9076b790dd6017c5b4",
"triggerType" : "PUSH"
}, {
"hash" : "0538475fe488089c4cb3bc0afb63c2f518329969",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5257",
"triggerID" : "0538475fe488089c4cb3bc0afb63c2f518329969",
"triggerType" : "PUSH"
}, {
"hash" : "9f4b334e340fb26004e1b07fc8fbaaa047c76775",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "9f4b334e340fb26004e1b07fc8fbaaa047c76775",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 77d11131baabd1c4e3cc2050337daca4df5f6427 UNKNOWN
* 3d9c2ae28da858d1e8476052c99391015effb7db UNKNOWN
* 31b0669d7b638bd65a17b22a2ceb772f2627512c UNKNOWN
* 0538475fe488089c4cb3bc0afb63c2f518329969 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5257)
* 9f4b334e340fb26004e1b07fc8fbaaa047c76775 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] alexeykudinkin commented on a change in pull request #4556: [HUDI-3191] Removing duplicating file-listing process w/in Hive's MOR `FileInputFormat`s
Posted by GitBox <gi...@apache.org>.
alexeykudinkin commented on a change in pull request #4556:
URL: https://github.com/apache/hudi/pull/4556#discussion_r791356926
##########
File path: hudi-hadoop-mr/src/main/java/org/apache/hudi/hadoop/HoodieFileInputFormatBase.java
##########
@@ -143,6 +121,124 @@ private static FileStatus getFileStatusUnchecked(Option<HoodieBaseFile> baseFile
return returns.toArray(new FileStatus[0]);
}
+ private void validate(List<FileStatus> targetFiles, List<FileStatus> legacyFileStatuses) {
Review comment:
Moved methods aren't actually changing in here
##########
File path: hudi-hadoop-mr/src/main/java/org/apache/hudi/hadoop/HoodieFileInputFormatBase.java
##########
@@ -143,6 +121,127 @@ private static FileStatus getFileStatusUnchecked(Option<HoodieBaseFile> baseFile
return returns.toArray(new FileStatus[0]);
}
+ private void validate(List<FileStatus> targetFiles, List<FileStatus> legacyFileStatuses) {
+ List<FileStatus> diff = CollectionUtils.diff(targetFiles, legacyFileStatuses);
+ checkState(diff.isEmpty(), "Should be empty");
+ }
+
+ @Nonnull
+ private static FileStatus getFileStatusUnchecked(HoodieBaseFile baseFile) {
+ try {
+ return HoodieInputFormatUtils.getFileStatus(baseFile);
+ } catch (IOException ioe) {
+ throw new HoodieIOException("Failed to get file-status", ioe);
+ }
+ }
+
+ /**
+ * Abstracts and exposes {@link FileInputFormat#listStatus(JobConf)} operation to subclasses that
+ * lists files (returning an array of {@link FileStatus}) corresponding to the input paths specified
+ * as part of provided {@link JobConf}
+ */
+ protected final FileStatus[] doListStatus(JobConf job) throws IOException {
+ return super.listStatus(job);
+ }
+
+ /**
+ * Achieves listStatus functionality for an incrementally queried table. Instead of listing all
+ * partitions and then filtering based on the commits of interest, this logic first extracts the
+ * partitions touched by the desired commits and then lists only those partitions.
+ */
+ protected List<FileStatus> listStatusForIncrementalMode(JobConf job,
+ HoodieTableMetaClient tableMetaClient,
+ List<Path> inputPaths,
+ String incrementalTable) throws IOException {
+ String tableName = tableMetaClient.getTableConfig().getTableName();
+ Job jobContext = Job.getInstance(job);
+ Option<HoodieTimeline> timeline = HoodieInputFormatUtils.getFilteredCommitsTimeline(jobContext, tableMetaClient);
+ if (!timeline.isPresent()) {
+ return null;
+ }
+ Option<List<HoodieInstant>> commitsToCheck = HoodieInputFormatUtils.getCommitsForIncrementalQuery(jobContext, tableName, timeline.get());
+ if (!commitsToCheck.isPresent()) {
+ return null;
+ }
+ Option<String> incrementalInputPaths = HoodieInputFormatUtils.getAffectedPartitions(commitsToCheck.get(), tableMetaClient, timeline.get(), inputPaths);
+ // Mutate the JobConf to set the input paths to only partitions touched by incremental pull.
+ if (!incrementalInputPaths.isPresent()) {
+ return null;
+ }
+ setInputPaths(job, incrementalInputPaths.get());
+ FileStatus[] fileStatuses = doListStatus(job);
+ return HoodieInputFormatUtils.filterIncrementalFileStatus(jobContext, tableMetaClient, timeline.get(), fileStatuses, commitsToCheck.get());
+ }
+
+ protected abstract boolean includeLogFilesForSnapshotView();
+
+ @Nonnull
+ private static RealtimeFileStatus createRealtimeFileStatusUnchecked(HoodieBaseFile baseFile,
+ Stream<HoodieLogFile> logFiles,
+ Option<HoodieInstant> latestCompletedInstantOpt,
+ HoodieTableMetaClient tableMetaClient) {
+ List<HoodieLogFile> sortedLogFiles = logFiles.sorted(HoodieLogFile.getLogFileComparator()).collect(Collectors.toList());
+ FileStatus baseFileStatus = getFileStatusUnchecked(baseFile);
+ try {
+ RealtimeFileStatus rtFileStatus = new RealtimeFileStatus(baseFileStatus);
+ rtFileStatus.setDeltaLogFiles(sortedLogFiles);
+ rtFileStatus.setBaseFilePath(baseFile.getPath());
+ rtFileStatus.setBasePath(tableMetaClient.getBasePath());
+
+ if (latestCompletedInstantOpt.isPresent()) {
+ HoodieInstant latestCompletedInstant = latestCompletedInstantOpt.get();
+ checkState(latestCompletedInstant.isCompleted());
+
+ rtFileStatus.setMaxCommitTime(latestCompletedInstant.getTimestamp());
+ }
+
+ if (baseFileStatus instanceof LocatedFileStatusWithBootstrapBaseFile || baseFileStatus instanceof FileStatusWithBootstrapBaseFile) {
+ rtFileStatus.setBootStrapFileStatus(baseFileStatus);
+ }
+
+ return rtFileStatus;
+ } catch (IOException e) {
+ throw new HoodieIOException(String.format("Failed to init %s", RealtimeFileStatus.class.getSimpleName()), e);
+ }
+ }
+
+ @Nonnull
+ private List<FileStatus> listStatusForSnapshotModeLegacy(JobConf job, Map<String, HoodieTableMetaClient> tableMetaClientMap, List<Path> snapshotPaths) throws IOException {
+ return HoodieInputFormatUtils.filterFileStatusForSnapshotMode(job, tableMetaClientMap, snapshotPaths, includeLogFilesForSnapshotView());
+ }
+
+ @Nonnull
+ private static RealtimeFileStatus createRealtimeFileStatusUnchecked(HoodieLogFile latestLogFile,
+ Stream<HoodieLogFile> logFiles,
+ Option<HoodieInstant> latestCompletedInstantOpt,
+ HoodieTableMetaClient tableMetaClient) {
+ List<HoodieLogFile> sortedLogFiles = logFiles.sorted(HoodieLogFile.getLogFileComparator()).collect(Collectors.toList());
+ try {
+ RealtimeFileStatus rtFileStatus = new RealtimeFileStatus(latestLogFile.getFileStatus());
+ rtFileStatus.setDeltaLogFiles(sortedLogFiles);
+ rtFileStatus.setBasePath(tableMetaClient.getBasePath());
+
+ if (latestCompletedInstantOpt.isPresent()) {
+ HoodieInstant latestCompletedInstant = latestCompletedInstantOpt.get();
+ checkState(latestCompletedInstant.isCompleted());
Review comment:
I think we should control all assertion centrally (ie being to toggle on/off all of the assertions holistically) and i would prefer to have this assertion (since it's not bringing any performance penalty along)
##########
File path: hudi-hadoop-mr/src/main/java/org/apache/hudi/hadoop/HoodieFileInputFormatBase.java
##########
@@ -143,6 +121,127 @@ private static FileStatus getFileStatusUnchecked(Option<HoodieBaseFile> baseFile
return returns.toArray(new FileStatus[0]);
}
+ private void validate(List<FileStatus> targetFiles, List<FileStatus> legacyFileStatuses) {
+ List<FileStatus> diff = CollectionUtils.diff(targetFiles, legacyFileStatuses);
+ checkState(diff.isEmpty(), "Should be empty");
+ }
+
+ @Nonnull
+ private static FileStatus getFileStatusUnchecked(HoodieBaseFile baseFile) {
+ try {
+ return HoodieInputFormatUtils.getFileStatus(baseFile);
+ } catch (IOException ioe) {
+ throw new HoodieIOException("Failed to get file-status", ioe);
+ }
+ }
+
+ /**
+ * Abstracts and exposes {@link FileInputFormat#listStatus(JobConf)} operation to subclasses that
+ * lists files (returning an array of {@link FileStatus}) corresponding to the input paths specified
+ * as part of provided {@link JobConf}
+ */
+ protected final FileStatus[] doListStatus(JobConf job) throws IOException {
+ return super.listStatus(job);
+ }
+
+ /**
+ * Achieves listStatus functionality for an incrementally queried table. Instead of listing all
+ * partitions and then filtering based on the commits of interest, this logic first extracts the
+ * partitions touched by the desired commits and then lists only those partitions.
+ */
+ protected List<FileStatus> listStatusForIncrementalMode(JobConf job,
+ HoodieTableMetaClient tableMetaClient,
+ List<Path> inputPaths,
+ String incrementalTable) throws IOException {
+ String tableName = tableMetaClient.getTableConfig().getTableName();
+ Job jobContext = Job.getInstance(job);
+ Option<HoodieTimeline> timeline = HoodieInputFormatUtils.getFilteredCommitsTimeline(jobContext, tableMetaClient);
+ if (!timeline.isPresent()) {
+ return null;
+ }
+ Option<List<HoodieInstant>> commitsToCheck = HoodieInputFormatUtils.getCommitsForIncrementalQuery(jobContext, tableName, timeline.get());
+ if (!commitsToCheck.isPresent()) {
+ return null;
+ }
+ Option<String> incrementalInputPaths = HoodieInputFormatUtils.getAffectedPartitions(commitsToCheck.get(), tableMetaClient, timeline.get(), inputPaths);
+ // Mutate the JobConf to set the input paths to only partitions touched by incremental pull.
+ if (!incrementalInputPaths.isPresent()) {
+ return null;
+ }
+ setInputPaths(job, incrementalInputPaths.get());
+ FileStatus[] fileStatuses = doListStatus(job);
+ return HoodieInputFormatUtils.filterIncrementalFileStatus(jobContext, tableMetaClient, timeline.get(), fileStatuses, commitsToCheck.get());
+ }
+
+ protected abstract boolean includeLogFilesForSnapshotView();
+
+ @Nonnull
+ private static RealtimeFileStatus createRealtimeFileStatusUnchecked(HoodieBaseFile baseFile,
Review comment:
These are simple ctor-like methods which are private in scope. What do you like to see as a description for it?
##########
File path: hudi-hadoop-mr/src/main/java/org/apache/hudi/hadoop/PathWithLogFilePath.java
##########
@@ -31,7 +31,7 @@
*/
public class PathWithLogFilePath extends Path {
// a flag to mark this split is produced by incremental query or not.
- private boolean belongToIncrementalPath = false;
+ private boolean belongsToIncrementalPath = false;
Review comment:
Then unfortunately will double number of stacked PRs -- not taking up any major renamings, other than touch a few files at most (this in particular to bring consistency across classes in naming correspondent fields)
##########
File path: hudi-hadoop-mr/src/main/java/org/apache/hudi/hadoop/HoodieFileInputFormatBase.java
##########
@@ -143,6 +121,124 @@ private static FileStatus getFileStatusUnchecked(Option<HoodieBaseFile> baseFile
return returns.toArray(new FileStatus[0]);
}
+ private void validate(List<FileStatus> targetFiles, List<FileStatus> legacyFileStatuses) {
Review comment:
The reason for re-ordering is to maintain the invariant that you order the methods in the order of loose > strict access (static methods are kept in the same order after all non-static methods). This allows for easier analysis of the hierarchy what's present in which part of the hierarchy and make sure they are structured correctly.
Apologies for the jitter in the review.
##########
File path: hudi-hadoop-mr/src/main/java/org/apache/hudi/hadoop/utils/HoodieRealtimeInputFormatUtils.java
##########
@@ -65,11 +65,71 @@
import java.util.stream.Collectors;
import java.util.stream.Stream;
+import static org.apache.hudi.TypeUtils.unsafeCast;
+import static org.apache.hudi.common.util.ValidationUtils.checkState;
+
public class HoodieRealtimeInputFormatUtils extends HoodieInputFormatUtils {
private static final Logger LOG = LogManager.getLogger(HoodieRealtimeInputFormatUtils.class);
- public static InputSplit[] getRealtimeSplits(Configuration conf, Stream<FileSplit> fileSplits) {
+ public static InputSplit[] getRealtimeSplits(Configuration conf, List<FileSplit> fileSplits) throws IOException {
Review comment:
Simply limiting the amount of changes to avoid changing too many things at the same time
##########
File path: hudi-hadoop-mr/src/main/java/org/apache/hudi/hadoop/realtime/RealtimeBootstrapBaseFileSplit.java
##########
@@ -43,17 +43,20 @@
private String basePath;
- public RealtimeBootstrapBaseFileSplit() {
- super();
- }
Review comment:
We should certainly clean up such unnecessary clauses
##########
File path: hudi-hadoop-mr/src/main/java/org/apache/hudi/hadoop/HoodieFileInputFormatBase.java
##########
@@ -187,13 +286,28 @@ private static FileStatus getFileStatusUnchecked(Option<HoodieBaseFile> baseFile
.map(fileSlice -> {
Option<HoodieBaseFile> baseFileOpt = fileSlice.getBaseFile();
Option<HoodieLogFile> latestLogFileOpt = fileSlice.getLatestLogFile();
- if (baseFileOpt.isPresent()) {
- return getFileStatusUnchecked(baseFileOpt);
- } else if (includeLogFilesForSnapShotView() && latestLogFileOpt.isPresent()) {
- return createRealtimeFileStatusUnchecked(latestLogFileOpt.get(), fileSlice.getLogFiles());
+ Stream<HoodieLogFile> logFiles = fileSlice.getLogFiles();
+
+ Option<HoodieInstant> latestCompletedInstantOpt =
+ fromScala(fileIndex.latestCompletedInstant());
+
+ // Check if we're reading a MOR table
+ if (includeLogFilesForSnapshotView()) {
+ if (baseFileOpt.isPresent()) {
+ return createRealtimeFileStatusUnchecked(baseFileOpt.get(), logFiles, latestCompletedInstantOpt, tableMetaClient);
+ } else if (latestLogFileOpt.isPresent()) {
+ return createRealtimeFileStatusUnchecked(latestLogFileOpt.get(), logFiles, latestCompletedInstantOpt, tableMetaClient);
+ } else {
+ throw new IllegalStateException("Invalid state: either base-file or log-file has to be present");
+ }
} else {
- throw new IllegalStateException("Invalid state: either base-file or log-file should be present");
+ if (baseFileOpt.isPresent()) {
+ return getFileStatusUnchecked(baseFileOpt.get());
+ } else {
+ throw new IllegalStateException("Invalid state: base-file has to be present");
+ }
}
Review comment:
`listStatusForSnapshotMode()` is used for both COW/MOR, and whether we're handling COW/MOR is controlled by `includeLogFilesForSnapshotView` (will clean this up in a follow up, cleaning up some assertions after majority of the PRs land)
##########
File path: hudi-hadoop-mr/src/main/java/org/apache/hudi/hadoop/utils/HoodieRealtimeInputFormatUtils.java
##########
@@ -144,28 +204,32 @@
return rtSplits.toArray(new InputSplit[0]);
}
+ /**
+ * @deprecated will be replaced w/ {@link #getRealtimeSplits(Configuration, List)}
+ */
// get IncrementalRealtimeSplits
- public static InputSplit[] getIncrementalRealtimeSplits(Configuration conf, Stream<FileSplit> fileSplits) throws IOException {
+ public static InputSplit[] getIncrementalRealtimeSplits(Configuration conf, List<FileSplit> fileSplits) throws IOException {
+ checkState(fileSplits.stream().allMatch(HoodieRealtimeInputFormatUtils::doesBelongToIncrementalQuery),
+ "All splits have to belong to incremental query");
+
List<InputSplit> rtSplits = new ArrayList<>();
- List<FileSplit> fileSplitList = fileSplits.collect(Collectors.toList());
- Set<Path> partitionSet = fileSplitList.stream().map(f -> f.getPath().getParent()).collect(Collectors.toSet());
+ Set<Path> partitionSet = fileSplits.stream().map(f -> f.getPath().getParent()).collect(Collectors.toSet());
Map<Path, HoodieTableMetaClient> partitionsToMetaClient = getTableMetaClientByPartitionPath(conf, partitionSet);
// Pre process tableConfig from first partition to fetch virtual key info
Option<HoodieVirtualKeyInfo> hoodieVirtualKeyInfo = Option.empty();
if (partitionSet.size() > 0) {
hoodieVirtualKeyInfo = getHoodieVirtualKeyInfo(partitionsToMetaClient.get(partitionSet.iterator().next()));
}
Option<HoodieVirtualKeyInfo> finalHoodieVirtualKeyInfo = hoodieVirtualKeyInfo;
- fileSplitList.stream().forEach(s -> {
+ fileSplits.stream().forEach(s -> {
// deal with incremental query.
try {
if (s instanceof BaseFileWithLogsSplit) {
- BaseFileWithLogsSplit bs = (BaseFileWithLogsSplit)s;
- if (bs.getBelongToIncrementalSplit()) {
- rtSplits.add(new HoodieRealtimeFileSplit(bs, bs.getBasePath(), bs.getDeltaLogFiles(), bs.getMaxCommitTime(), finalHoodieVirtualKeyInfo));
- }
+ BaseFileWithLogsSplit bs = unsafeCast(s);
+ rtSplits.add(new HoodieRealtimeFileSplit(bs, bs.getBasePath(), bs.getDeltaLogFiles(), bs.getMaxCommitTime(), finalHoodieVirtualKeyInfo));
} else if (s instanceof RealtimeBootstrapBaseFileSplit) {
- rtSplits.add(s);
+ RealtimeBootstrapBaseFileSplit bs = unsafeCast(s);
Review comment:
This is Java, sir
:-)
##########
File path: hudi-hadoop-mr/src/main/java/org/apache/hudi/hadoop/utils/HoodieRealtimeInputFormatUtils.java
##########
@@ -65,11 +65,71 @@
import java.util.stream.Collectors;
import java.util.stream.Stream;
+import static org.apache.hudi.TypeUtils.unsafeCast;
+import static org.apache.hudi.common.util.ValidationUtils.checkState;
+
public class HoodieRealtimeInputFormatUtils extends HoodieInputFormatUtils {
private static final Logger LOG = LogManager.getLogger(HoodieRealtimeInputFormatUtils.class);
- public static InputSplit[] getRealtimeSplits(Configuration conf, Stream<FileSplit> fileSplits) {
+ public static InputSplit[] getRealtimeSplits(Configuration conf, List<FileSplit> fileSplits) throws IOException {
+ if (fileSplits.isEmpty()) {
+ return new InputSplit[0];
+ }
+
+ FileSplit fileSplit = fileSplits.get(0);
+
+ // Pre-process table-config to fetch virtual key info
+ Path partitionPath = fileSplit.getPath().getParent();
+ HoodieTableMetaClient metaClient = getTableMetaClientForBasePathUnchecked(conf, partitionPath);
+
+ Option<HoodieVirtualKeyInfo> hoodieVirtualKeyInfoOpt = getHoodieVirtualKeyInfo(metaClient);
+
+ // NOTE: This timeline is kept in sync w/ {@code HoodieTableFileIndexBase}
+ HoodieInstant latestCommitInstant =
+ metaClient.getActiveTimeline().getCommitsTimeline().filterCompletedInstants().lastInstant().get();
+
+ InputSplit[] finalSplits = fileSplits.stream()
+ .map(split -> {
+ // There are 4 types of splits could we have to handle here
+ // - {@code BootstrapBaseFileSplit}: in case base file does have associated bootstrap file,
+ // but does NOT have any log files appended (convert it to {@code RealtimeBootstrapBaseFileSplit})
+ // - {@code RealtimeBootstrapBaseFileSplit}: in case base file does have associated bootstrap file
+ // and does have log files appended
+ // - {@code BaseFileWithLogsSplit}: in case base file does NOT have associated bootstrap file
Review comment:
This will be handled by `else` block
##########
File path: hudi-hadoop-mr/src/main/java/org/apache/hudi/hadoop/realtime/HoodieRealtimeFileSplit.java
##########
@@ -44,9 +44,7 @@
private Option<HoodieVirtualKeyInfo> hoodieVirtualKeyInfo = Option.empty();
- public HoodieRealtimeFileSplit() {
- super();
Review comment:
Superfluous. It's done by default
##########
File path: hudi-hadoop-mr/src/main/java/org/apache/hudi/hadoop/utils/HoodieInputFormatUtils.java
##########
@@ -440,6 +437,9 @@ public static HoodieMetadataConfig buildMetadataConfig(Configuration conf) {
.build();
}
+ /**
+ * @deprecated
+ */
Review comment:
Method will be cleaned up altogether by HUDI-3280
##########
File path: hudi-client/hudi-spark-client/src/test/java/org/apache/hudi/table/functional/TestHoodieSparkMergeOnReadTableRollback.java
##########
@@ -516,8 +556,6 @@ void testMORTableRestore(boolean restoreAfterCompaction) throws Exception {
JavaRDD<HoodieRecord> writeRecords = jsc().parallelize(records, 1);
JavaRDD<WriteStatus> writeStatusJavaRDD = client.upsert(writeRecords, newCommitTime);
client.commit(newCommitTime, writeStatusJavaRDD);
- List<WriteStatus> statuses = writeStatusJavaRDD.collect();
- assertNoWriteErrors(statuses);
Review comment:
We can't actually keep this check, since we can't do double dereference of the RDD
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] alexeykudinkin commented on a change in pull request #4556: [HUDI-3191] Removing duplicating file-listing process w/in Hive's MOR `FileInputFormat`s
Posted by GitBox <gi...@apache.org>.
alexeykudinkin commented on a change in pull request #4556:
URL: https://github.com/apache/hudi/pull/4556#discussion_r791354846
##########
File path: hudi-common/src/main/scala/org/apache/hudi/HoodieTableFileIndexBase.scala
##########
@@ -87,6 +89,12 @@ abstract class HoodieTableFileIndexBase(engineContext: HoodieEngineContext,
refresh0()
+ /**
+ * Returns latest completed instant as seen by this instance of the file-index
+ */
+ def latestCompletedInstant(): Option[HoodieInstant] =
Review comment:
I think this is the approach we do take in Java, but in Scala this seems to be off (since you don't add braces at the end of the file-name so get-prefix feels off.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #4556: [HUDI-3191] Removing duplicating file-listing process w/in Hive's MOR `FileInputFormat`s
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #4556:
URL: https://github.com/apache/hudi/pull/4556#issuecomment-1028365326
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "d87786af43a7aeba7549cc3cfcbd97fc312bee0e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5074",
"triggerID" : "d87786af43a7aeba7549cc3cfcbd97fc312bee0e",
"triggerType" : "PUSH"
}, {
"hash" : "4b87ba1474be575ec27109ccbe626e4c2fc9c224",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5077",
"triggerID" : "4b87ba1474be575ec27109ccbe626e4c2fc9c224",
"triggerType" : "PUSH"
}, {
"hash" : "77d11131baabd1c4e3cc2050337daca4df5f6427",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "77d11131baabd1c4e3cc2050337daca4df5f6427",
"triggerType" : "PUSH"
}, {
"hash" : "3d9c2ae28da858d1e8476052c99391015effb7db",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "3d9c2ae28da858d1e8476052c99391015effb7db",
"triggerType" : "PUSH"
}, {
"hash" : "79ac9affcb7f81497e0df755c8200638d35b02b7",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5081",
"triggerID" : "79ac9affcb7f81497e0df755c8200638d35b02b7",
"triggerType" : "PUSH"
}, {
"hash" : "3c14bbe6c6bcf49c4164c45e82f77b473f4de396",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5113",
"triggerID" : "3c14bbe6c6bcf49c4164c45e82f77b473f4de396",
"triggerType" : "PUSH"
}, {
"hash" : "276f13d6efd00b301b232b286d585729c9d1d26e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5116",
"triggerID" : "276f13d6efd00b301b232b286d585729c9d1d26e",
"triggerType" : "PUSH"
}, {
"hash" : "31b0669d7b638bd65a17b22a2ceb772f2627512c",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "31b0669d7b638bd65a17b22a2ceb772f2627512c",
"triggerType" : "PUSH"
}, {
"hash" : "096e26af39a477ffccbee0edd764493e12e15e71",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5124",
"triggerID" : "096e26af39a477ffccbee0edd764493e12e15e71",
"triggerType" : "PUSH"
}, {
"hash" : "97dd5ec7c9246f6d9f467b9076b790dd6017c5b4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5213",
"triggerID" : "97dd5ec7c9246f6d9f467b9076b790dd6017c5b4",
"triggerType" : "PUSH"
}, {
"hash" : "0538475fe488089c4cb3bc0afb63c2f518329969",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5257",
"triggerID" : "0538475fe488089c4cb3bc0afb63c2f518329969",
"triggerType" : "PUSH"
}, {
"hash" : "9f4b334e340fb26004e1b07fc8fbaaa047c76775",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5261",
"triggerID" : "9f4b334e340fb26004e1b07fc8fbaaa047c76775",
"triggerType" : "PUSH"
}, {
"hash" : "368c099820c3cbf57496d0e46d1858aa8eb153ee",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5330",
"triggerID" : "368c099820c3cbf57496d0e46d1858aa8eb153ee",
"triggerType" : "PUSH"
}, {
"hash" : "28a5a4f537544d35dfcd8700a7b97fb7216682ce",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "28a5a4f537544d35dfcd8700a7b97fb7216682ce",
"triggerType" : "PUSH"
}, {
"hash" : "08ffdd8b47d147c9b5c889a5f56e39b9b140612d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5351",
"triggerID" : "08ffdd8b47d147c9b5c889a5f56e39b9b140612d",
"triggerType" : "PUSH"
}, {
"hash" : "c09e228f7cce78a7dbbc394e93b3cf8c6c3d4d5f",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "c09e228f7cce78a7dbbc394e93b3cf8c6c3d4d5f",
"triggerType" : "PUSH"
}, {
"hash" : "8dadbf672d4d27505592f18bc89422fd7c013669",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5398",
"triggerID" : "8dadbf672d4d27505592f18bc89422fd7c013669",
"triggerType" : "PUSH"
}, {
"hash" : "906607be5bd62ee1cbbda34acb6a89916c1f7aee",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5424",
"triggerID" : "906607be5bd62ee1cbbda34acb6a89916c1f7aee",
"triggerType" : "PUSH"
}, {
"hash" : "dc1b033f40cea9642f71b8fcff74aa82106726b6",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5484",
"triggerID" : "dc1b033f40cea9642f71b8fcff74aa82106726b6",
"triggerType" : "PUSH"
}, {
"hash" : "5b8f5819fff8fec34864eb409fd429b95be17b9b",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "5b8f5819fff8fec34864eb409fd429b95be17b9b",
"triggerType" : "PUSH"
}, {
"hash" : "13702fc2232ebd9300966b0a917a3358d8d0f18c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5590",
"triggerID" : "13702fc2232ebd9300966b0a917a3358d8d0f18c",
"triggerType" : "PUSH"
}, {
"hash" : "13702fc2232ebd9300966b0a917a3358d8d0f18c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5600",
"triggerID" : "1024845655",
"triggerType" : "MANUAL"
}, {
"hash" : "9bdd8a60f95123f82a5f30f5e68929f5b7e1f8da",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5603",
"triggerID" : "9bdd8a60f95123f82a5f30f5e68929f5b7e1f8da",
"triggerType" : "PUSH"
}, {
"hash" : "aebb9df557c4afe3ca88f6b8b28ba2fbfdcbd597",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5631",
"triggerID" : "aebb9df557c4afe3ca88f6b8b28ba2fbfdcbd597",
"triggerType" : "PUSH"
}, {
"hash" : "5d37935bc8bb33260735d782ca560fd59e02f321",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "5d37935bc8bb33260735d782ca560fd59e02f321",
"triggerType" : "PUSH"
}, {
"hash" : "f911d869f50009e5cd9f3fd341c83c732d7531ba",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5634",
"triggerID" : "f911d869f50009e5cd9f3fd341c83c732d7531ba",
"triggerType" : "PUSH"
}, {
"hash" : "f911d869f50009e5cd9f3fd341c83c732d7531ba",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5657",
"triggerID" : "1027051107",
"triggerType" : "MANUAL"
}, {
"hash" : "f911d869f50009e5cd9f3fd341c83c732d7531ba",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5659",
"triggerID" : "1027166086",
"triggerType" : "MANUAL"
}, {
"hash" : "f911d869f50009e5cd9f3fd341c83c732d7531ba",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5665",
"triggerID" : "1027387044",
"triggerType" : "MANUAL"
}, {
"hash" : "34b94b96b03109555201092bfabce21793add437",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "34b94b96b03109555201092bfabce21793add437",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 77d11131baabd1c4e3cc2050337daca4df5f6427 UNKNOWN
* 3d9c2ae28da858d1e8476052c99391015effb7db UNKNOWN
* 31b0669d7b638bd65a17b22a2ceb772f2627512c UNKNOWN
* 28a5a4f537544d35dfcd8700a7b97fb7216682ce UNKNOWN
* c09e228f7cce78a7dbbc394e93b3cf8c6c3d4d5f UNKNOWN
* 5b8f5819fff8fec34864eb409fd429b95be17b9b UNKNOWN
* 5d37935bc8bb33260735d782ca560fd59e02f321 UNKNOWN
* f911d869f50009e5cd9f3fd341c83c732d7531ba Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5634) Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5657) Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5659) Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5665)
* 34b94b96b03109555201092bfabce21793add437 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] alexeykudinkin commented on a change in pull request #4556: [HUDI-3191][Stacked on 4716] Removing duplicating file-listing process w/in Hive's MOR `FileInputFormat`s
Posted by GitBox <gi...@apache.org>.
alexeykudinkin commented on a change in pull request #4556:
URL: https://github.com/apache/hudi/pull/4556#discussion_r798007427
##########
File path: hudi-hadoop-mr/src/main/java/org/apache/hudi/hadoop/HoodieFileInputFormatBase.java
##########
@@ -143,6 +121,127 @@ private static FileStatus getFileStatusUnchecked(Option<HoodieBaseFile> baseFile
return returns.toArray(new FileStatus[0]);
}
+ private void validate(List<FileStatus> targetFiles, List<FileStatus> legacyFileStatuses) {
+ List<FileStatus> diff = CollectionUtils.diff(targetFiles, legacyFileStatuses);
+ checkState(diff.isEmpty(), "Should be empty");
+ }
+
+ @Nonnull
+ private static FileStatus getFileStatusUnchecked(HoodieBaseFile baseFile) {
+ try {
+ return HoodieInputFormatUtils.getFileStatus(baseFile);
+ } catch (IOException ioe) {
+ throw new HoodieIOException("Failed to get file-status", ioe);
+ }
+ }
+
+ /**
+ * Abstracts and exposes {@link FileInputFormat#listStatus(JobConf)} operation to subclasses that
+ * lists files (returning an array of {@link FileStatus}) corresponding to the input paths specified
+ * as part of provided {@link JobConf}
+ */
+ protected final FileStatus[] doListStatus(JobConf job) throws IOException {
+ return super.listStatus(job);
+ }
+
+ /**
+ * Achieves listStatus functionality for an incrementally queried table. Instead of listing all
+ * partitions and then filtering based on the commits of interest, this logic first extracts the
+ * partitions touched by the desired commits and then lists only those partitions.
+ */
+ protected List<FileStatus> listStatusForIncrementalMode(JobConf job,
+ HoodieTableMetaClient tableMetaClient,
+ List<Path> inputPaths,
+ String incrementalTable) throws IOException {
+ String tableName = tableMetaClient.getTableConfig().getTableName();
+ Job jobContext = Job.getInstance(job);
+ Option<HoodieTimeline> timeline = HoodieInputFormatUtils.getFilteredCommitsTimeline(jobContext, tableMetaClient);
+ if (!timeline.isPresent()) {
+ return null;
+ }
+ Option<List<HoodieInstant>> commitsToCheck = HoodieInputFormatUtils.getCommitsForIncrementalQuery(jobContext, tableName, timeline.get());
+ if (!commitsToCheck.isPresent()) {
+ return null;
+ }
+ Option<String> incrementalInputPaths = HoodieInputFormatUtils.getAffectedPartitions(commitsToCheck.get(), tableMetaClient, timeline.get(), inputPaths);
+ // Mutate the JobConf to set the input paths to only partitions touched by incremental pull.
+ if (!incrementalInputPaths.isPresent()) {
+ return null;
+ }
+ setInputPaths(job, incrementalInputPaths.get());
+ FileStatus[] fileStatuses = doListStatus(job);
+ return HoodieInputFormatUtils.filterIncrementalFileStatus(jobContext, tableMetaClient, timeline.get(), fileStatuses, commitsToCheck.get());
+ }
+
+ protected abstract boolean includeLogFilesForSnapshotView();
+
+ @Nonnull
+ private static RealtimeFileStatus createRealtimeFileStatusUnchecked(HoodieBaseFile baseFile,
+ Stream<HoodieLogFile> logFiles,
+ Option<HoodieInstant> latestCompletedInstantOpt,
+ HoodieTableMetaClient tableMetaClient) {
+ List<HoodieLogFile> sortedLogFiles = logFiles.sorted(HoodieLogFile.getLogFileComparator()).collect(Collectors.toList());
+ FileStatus baseFileStatus = getFileStatusUnchecked(baseFile);
+ try {
+ RealtimeFileStatus rtFileStatus = new RealtimeFileStatus(baseFileStatus);
+ rtFileStatus.setDeltaLogFiles(sortedLogFiles);
+ rtFileStatus.setBaseFilePath(baseFile.getPath());
+ rtFileStatus.setBasePath(tableMetaClient.getBasePath());
+
+ if (latestCompletedInstantOpt.isPresent()) {
+ HoodieInstant latestCompletedInstant = latestCompletedInstantOpt.get();
+ checkState(latestCompletedInstant.isCompleted());
+
+ rtFileStatus.setMaxCommitTime(latestCompletedInstant.getTimestamp());
+ }
+
+ if (baseFileStatus instanceof LocatedFileStatusWithBootstrapBaseFile || baseFileStatus instanceof FileStatusWithBootstrapBaseFile) {
+ rtFileStatus.setBootStrapFileStatus(baseFileStatus);
+ }
+
+ return rtFileStatus;
+ } catch (IOException e) {
+ throw new HoodieIOException(String.format("Failed to init %s", RealtimeFileStatus.class.getSimpleName()), e);
+ }
+ }
+
+ @Nonnull
+ private List<FileStatus> listStatusForSnapshotModeLegacy(JobConf job, Map<String, HoodieTableMetaClient> tableMetaClientMap, List<Path> snapshotPaths) throws IOException {
+ return HoodieInputFormatUtils.filterFileStatusForSnapshotMode(job, tableMetaClientMap, snapshotPaths, includeLogFilesForSnapshotView());
+ }
+
+ @Nonnull
+ private static RealtimeFileStatus createRealtimeFileStatusUnchecked(HoodieLogFile latestLogFile,
Review comment:
Not sure i follow your suggestion, can you elaborate on what you have in mind to be included in this doc?
##########
File path: hudi-hadoop-mr/src/main/java/org/apache/hudi/hadoop/HoodieFileInputFormatBase.java
##########
@@ -143,6 +121,126 @@ private static FileStatus getFileStatusUnchecked(Option<HoodieBaseFile> baseFile
return returns.toArray(new FileStatus[0]);
}
+ private void validate(List<FileStatus> targetFiles, List<FileStatus> legacyFileStatuses) {
+ List<FileStatus> diff = CollectionUtils.diff(targetFiles, legacyFileStatuses);
+ checkState(diff.isEmpty(), "Should be empty");
+ }
+
+ @Nonnull
+ private static FileStatus getFileStatusUnchecked(HoodieBaseFile baseFile) {
+ try {
+ return HoodieInputFormatUtils.getFileStatus(baseFile);
+ } catch (IOException ioe) {
+ throw new HoodieIOException("Failed to get file-status", ioe);
+ }
+ }
+
+ /**
+ * Abstracts and exposes {@link FileInputFormat#listStatus(JobConf)} operation to subclasses that
+ * lists files (returning an array of {@link FileStatus}) corresponding to the input paths specified
+ * as part of provided {@link JobConf}
+ */
+ protected final FileStatus[] doListStatus(JobConf job) throws IOException {
+ return super.listStatus(job);
+ }
+
+ /**
+ * Achieves listStatus functionality for an incrementally queried table. Instead of listing all
+ * partitions and then filtering based on the commits of interest, this logic first extracts the
+ * partitions touched by the desired commits and then lists only those partitions.
+ */
+ protected List<FileStatus> listStatusForIncrementalMode(JobConf job,
+ HoodieTableMetaClient tableMetaClient,
+ List<Path> inputPaths,
+ String incrementalTable) throws IOException {
+ Job jobContext = Job.getInstance(job);
+ Option<HoodieTimeline> timeline = HoodieInputFormatUtils.getFilteredCommitsTimeline(jobContext, tableMetaClient);
+ if (!timeline.isPresent()) {
+ return null;
+ }
+ Option<List<HoodieInstant>> commitsToCheck = HoodieInputFormatUtils.getCommitsForIncrementalQuery(jobContext, incrementalTable, timeline.get());
+ if (!commitsToCheck.isPresent()) {
+ return null;
+ }
+ Option<String> incrementalInputPaths = HoodieInputFormatUtils.getAffectedPartitions(commitsToCheck.get(), tableMetaClient, timeline.get(), inputPaths);
+ // Mutate the JobConf to set the input paths to only partitions touched by incremental pull.
+ if (!incrementalInputPaths.isPresent()) {
+ return null;
+ }
+ setInputPaths(job, incrementalInputPaths.get());
+ FileStatus[] fileStatuses = doListStatus(job);
+ return HoodieInputFormatUtils.filterIncrementalFileStatus(jobContext, tableMetaClient, timeline.get(), fileStatuses, commitsToCheck.get());
+ }
+
+ protected abstract boolean includeLogFilesForSnapshotView();
+
+ @Nonnull
+ private static RealtimeFileStatus createRealtimeFileStatusUnchecked(HoodieBaseFile baseFile,
+ Stream<HoodieLogFile> logFiles,
+ Option<HoodieInstant> latestCompletedInstantOpt,
+ HoodieTableMetaClient tableMetaClient) {
+ List<HoodieLogFile> sortedLogFiles = logFiles.sorted(HoodieLogFile.getLogFileComparator()).collect(Collectors.toList());
Review comment:
This is a new
##########
File path: hudi-hadoop-mr/src/main/java/org/apache/hudi/hadoop/HoodieFileInputFormatBase.java
##########
@@ -143,6 +121,127 @@ private static FileStatus getFileStatusUnchecked(Option<HoodieBaseFile> baseFile
return returns.toArray(new FileStatus[0]);
}
+ private void validate(List<FileStatus> targetFiles, List<FileStatus> legacyFileStatuses) {
+ List<FileStatus> diff = CollectionUtils.diff(targetFiles, legacyFileStatuses);
+ checkState(diff.isEmpty(), "Should be empty");
+ }
+
+ @Nonnull
+ private static FileStatus getFileStatusUnchecked(HoodieBaseFile baseFile) {
+ try {
+ return HoodieInputFormatUtils.getFileStatus(baseFile);
+ } catch (IOException ioe) {
+ throw new HoodieIOException("Failed to get file-status", ioe);
+ }
+ }
+
+ /**
+ * Abstracts and exposes {@link FileInputFormat#listStatus(JobConf)} operation to subclasses that
+ * lists files (returning an array of {@link FileStatus}) corresponding to the input paths specified
+ * as part of provided {@link JobConf}
+ */
+ protected final FileStatus[] doListStatus(JobConf job) throws IOException {
+ return super.listStatus(job);
+ }
+
+ /**
+ * Achieves listStatus functionality for an incrementally queried table. Instead of listing all
+ * partitions and then filtering based on the commits of interest, this logic first extracts the
+ * partitions touched by the desired commits and then lists only those partitions.
+ */
+ protected List<FileStatus> listStatusForIncrementalMode(JobConf job,
+ HoodieTableMetaClient tableMetaClient,
+ List<Path> inputPaths,
+ String incrementalTable) throws IOException {
+ String tableName = tableMetaClient.getTableConfig().getTableName();
+ Job jobContext = Job.getInstance(job);
+ Option<HoodieTimeline> timeline = HoodieInputFormatUtils.getFilteredCommitsTimeline(jobContext, tableMetaClient);
+ if (!timeline.isPresent()) {
+ return null;
+ }
+ Option<List<HoodieInstant>> commitsToCheck = HoodieInputFormatUtils.getCommitsForIncrementalQuery(jobContext, tableName, timeline.get());
+ if (!commitsToCheck.isPresent()) {
+ return null;
+ }
+ Option<String> incrementalInputPaths = HoodieInputFormatUtils.getAffectedPartitions(commitsToCheck.get(), tableMetaClient, timeline.get(), inputPaths);
+ // Mutate the JobConf to set the input paths to only partitions touched by incremental pull.
+ if (!incrementalInputPaths.isPresent()) {
+ return null;
+ }
+ setInputPaths(job, incrementalInputPaths.get());
+ FileStatus[] fileStatuses = doListStatus(job);
+ return HoodieInputFormatUtils.filterIncrementalFileStatus(jobContext, tableMetaClient, timeline.get(), fileStatuses, commitsToCheck.get());
+ }
+
+ protected abstract boolean includeLogFilesForSnapshotView();
+
+ @Nonnull
+ private static RealtimeFileStatus createRealtimeFileStatusUnchecked(HoodieBaseFile baseFile,
Review comment:
Do you have something in mind?
##########
File path: hudi-client/hudi-spark-client/src/test/java/org/apache/hudi/table/TestHoodieMergeOnReadTable.java
##########
@@ -189,8 +190,10 @@ public void testUpsertPartitioner(boolean populateMetaFields) throws Exception {
assertTrue(fileIdToNewSize.entrySet().stream().anyMatch(entry -> fileIdToSize.get(entry.getKey()) < entry.getValue()));
- List<String> dataFiles = roView.getLatestBaseFiles().map(HoodieBaseFile::getPath).collect(Collectors.toList());
- List<GenericRecord> recordsRead = HoodieMergeOnReadTestUtils.getRecordsUsingInputFormat(hadoopConf(), dataFiles,
+ List<String> inputPaths = roView.getLatestBaseFiles()
+ .map(baseFile -> new Path(baseFile.getPath()).getParent().toString())
+ .collect(Collectors.toList());
Review comment:
Duplication isn't an issue b/c this list is only used for files filtering currently
##########
File path: hudi-hadoop-mr/src/main/java/org/apache/hudi/hadoop/HoodieFileInputFormatBase.java
##########
@@ -187,13 +285,28 @@ private static FileStatus getFileStatusUnchecked(Option<HoodieBaseFile> baseFile
.map(fileSlice -> {
Option<HoodieBaseFile> baseFileOpt = fileSlice.getBaseFile();
Option<HoodieLogFile> latestLogFileOpt = fileSlice.getLatestLogFile();
- if (baseFileOpt.isPresent()) {
- return getFileStatusUnchecked(baseFileOpt);
- } else if (includeLogFilesForSnapShotView() && latestLogFileOpt.isPresent()) {
- return createRealtimeFileStatusUnchecked(latestLogFileOpt.get(), fileSlice.getLogFiles());
+ Stream<HoodieLogFile> logFiles = fileSlice.getLogFiles();
+
+ Option<HoodieInstant> latestCompletedInstantOpt =
+ fromScala(fileIndex.latestCompletedInstant());
+
+ // Check if we're reading a MOR table
+ if (includeLogFilesForSnapshotView()) {
+ if (baseFileOpt.isPresent()) {
+ return createRealtimeFileStatusUnchecked(baseFileOpt.get(), logFiles, latestCompletedInstantOpt, tableMetaClient);
Review comment:
A list of partition paths that are being read by Hive in snapshot mode (name is a carry-over from the previous code)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #4556: [HUDI-3191] Removing duplicating file-listing process w/in Hive's MOR `FileInputFormat`s
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #4556:
URL: https://github.com/apache/hudi/pull/4556#issuecomment-1028462344
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "d87786af43a7aeba7549cc3cfcbd97fc312bee0e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5074",
"triggerID" : "d87786af43a7aeba7549cc3cfcbd97fc312bee0e",
"triggerType" : "PUSH"
}, {
"hash" : "4b87ba1474be575ec27109ccbe626e4c2fc9c224",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5077",
"triggerID" : "4b87ba1474be575ec27109ccbe626e4c2fc9c224",
"triggerType" : "PUSH"
}, {
"hash" : "77d11131baabd1c4e3cc2050337daca4df5f6427",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "77d11131baabd1c4e3cc2050337daca4df5f6427",
"triggerType" : "PUSH"
}, {
"hash" : "3d9c2ae28da858d1e8476052c99391015effb7db",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "3d9c2ae28da858d1e8476052c99391015effb7db",
"triggerType" : "PUSH"
}, {
"hash" : "79ac9affcb7f81497e0df755c8200638d35b02b7",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5081",
"triggerID" : "79ac9affcb7f81497e0df755c8200638d35b02b7",
"triggerType" : "PUSH"
}, {
"hash" : "3c14bbe6c6bcf49c4164c45e82f77b473f4de396",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5113",
"triggerID" : "3c14bbe6c6bcf49c4164c45e82f77b473f4de396",
"triggerType" : "PUSH"
}, {
"hash" : "276f13d6efd00b301b232b286d585729c9d1d26e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5116",
"triggerID" : "276f13d6efd00b301b232b286d585729c9d1d26e",
"triggerType" : "PUSH"
}, {
"hash" : "31b0669d7b638bd65a17b22a2ceb772f2627512c",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "31b0669d7b638bd65a17b22a2ceb772f2627512c",
"triggerType" : "PUSH"
}, {
"hash" : "096e26af39a477ffccbee0edd764493e12e15e71",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5124",
"triggerID" : "096e26af39a477ffccbee0edd764493e12e15e71",
"triggerType" : "PUSH"
}, {
"hash" : "97dd5ec7c9246f6d9f467b9076b790dd6017c5b4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5213",
"triggerID" : "97dd5ec7c9246f6d9f467b9076b790dd6017c5b4",
"triggerType" : "PUSH"
}, {
"hash" : "0538475fe488089c4cb3bc0afb63c2f518329969",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5257",
"triggerID" : "0538475fe488089c4cb3bc0afb63c2f518329969",
"triggerType" : "PUSH"
}, {
"hash" : "9f4b334e340fb26004e1b07fc8fbaaa047c76775",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5261",
"triggerID" : "9f4b334e340fb26004e1b07fc8fbaaa047c76775",
"triggerType" : "PUSH"
}, {
"hash" : "368c099820c3cbf57496d0e46d1858aa8eb153ee",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5330",
"triggerID" : "368c099820c3cbf57496d0e46d1858aa8eb153ee",
"triggerType" : "PUSH"
}, {
"hash" : "28a5a4f537544d35dfcd8700a7b97fb7216682ce",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "28a5a4f537544d35dfcd8700a7b97fb7216682ce",
"triggerType" : "PUSH"
}, {
"hash" : "08ffdd8b47d147c9b5c889a5f56e39b9b140612d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5351",
"triggerID" : "08ffdd8b47d147c9b5c889a5f56e39b9b140612d",
"triggerType" : "PUSH"
}, {
"hash" : "c09e228f7cce78a7dbbc394e93b3cf8c6c3d4d5f",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "c09e228f7cce78a7dbbc394e93b3cf8c6c3d4d5f",
"triggerType" : "PUSH"
}, {
"hash" : "8dadbf672d4d27505592f18bc89422fd7c013669",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5398",
"triggerID" : "8dadbf672d4d27505592f18bc89422fd7c013669",
"triggerType" : "PUSH"
}, {
"hash" : "906607be5bd62ee1cbbda34acb6a89916c1f7aee",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5424",
"triggerID" : "906607be5bd62ee1cbbda34acb6a89916c1f7aee",
"triggerType" : "PUSH"
}, {
"hash" : "dc1b033f40cea9642f71b8fcff74aa82106726b6",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5484",
"triggerID" : "dc1b033f40cea9642f71b8fcff74aa82106726b6",
"triggerType" : "PUSH"
}, {
"hash" : "5b8f5819fff8fec34864eb409fd429b95be17b9b",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "5b8f5819fff8fec34864eb409fd429b95be17b9b",
"triggerType" : "PUSH"
}, {
"hash" : "13702fc2232ebd9300966b0a917a3358d8d0f18c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5590",
"triggerID" : "13702fc2232ebd9300966b0a917a3358d8d0f18c",
"triggerType" : "PUSH"
}, {
"hash" : "13702fc2232ebd9300966b0a917a3358d8d0f18c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5600",
"triggerID" : "1024845655",
"triggerType" : "MANUAL"
}, {
"hash" : "9bdd8a60f95123f82a5f30f5e68929f5b7e1f8da",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5603",
"triggerID" : "9bdd8a60f95123f82a5f30f5e68929f5b7e1f8da",
"triggerType" : "PUSH"
}, {
"hash" : "aebb9df557c4afe3ca88f6b8b28ba2fbfdcbd597",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5631",
"triggerID" : "aebb9df557c4afe3ca88f6b8b28ba2fbfdcbd597",
"triggerType" : "PUSH"
}, {
"hash" : "5d37935bc8bb33260735d782ca560fd59e02f321",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "5d37935bc8bb33260735d782ca560fd59e02f321",
"triggerType" : "PUSH"
}, {
"hash" : "f911d869f50009e5cd9f3fd341c83c732d7531ba",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5634",
"triggerID" : "f911d869f50009e5cd9f3fd341c83c732d7531ba",
"triggerType" : "PUSH"
}, {
"hash" : "f911d869f50009e5cd9f3fd341c83c732d7531ba",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5657",
"triggerID" : "1027051107",
"triggerType" : "MANUAL"
}, {
"hash" : "f911d869f50009e5cd9f3fd341c83c732d7531ba",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5659",
"triggerID" : "1027166086",
"triggerType" : "MANUAL"
}, {
"hash" : "f911d869f50009e5cd9f3fd341c83c732d7531ba",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5665",
"triggerID" : "1027387044",
"triggerType" : "MANUAL"
}, {
"hash" : "34b94b96b03109555201092bfabce21793add437",
"status" : "CANCELED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5689",
"triggerID" : "34b94b96b03109555201092bfabce21793add437",
"triggerType" : "PUSH"
}, {
"hash" : "7f793744421a5ee304d5dff89d23e1e925bfd1cb",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5692",
"triggerID" : "7f793744421a5ee304d5dff89d23e1e925bfd1cb",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 77d11131baabd1c4e3cc2050337daca4df5f6427 UNKNOWN
* 3d9c2ae28da858d1e8476052c99391015effb7db UNKNOWN
* 31b0669d7b638bd65a17b22a2ceb772f2627512c UNKNOWN
* 28a5a4f537544d35dfcd8700a7b97fb7216682ce UNKNOWN
* c09e228f7cce78a7dbbc394e93b3cf8c6c3d4d5f UNKNOWN
* 5b8f5819fff8fec34864eb409fd429b95be17b9b UNKNOWN
* 5d37935bc8bb33260735d782ca560fd59e02f321 UNKNOWN
* 34b94b96b03109555201092bfabce21793add437 Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5689)
* 7f793744421a5ee304d5dff89d23e1e925bfd1cb Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5692)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #4556: [HUDI-3191][Stacked on 4716] Removing duplicating file-listing process w/in Hive's MOR `FileInputFormat`s
Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #4556:
URL: https://github.com/apache/hudi/pull/4556#issuecomment-1026320095
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "d87786af43a7aeba7549cc3cfcbd97fc312bee0e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5074",
"triggerID" : "d87786af43a7aeba7549cc3cfcbd97fc312bee0e",
"triggerType" : "PUSH"
}, {
"hash" : "4b87ba1474be575ec27109ccbe626e4c2fc9c224",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5077",
"triggerID" : "4b87ba1474be575ec27109ccbe626e4c2fc9c224",
"triggerType" : "PUSH"
}, {
"hash" : "77d11131baabd1c4e3cc2050337daca4df5f6427",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "77d11131baabd1c4e3cc2050337daca4df5f6427",
"triggerType" : "PUSH"
}, {
"hash" : "3d9c2ae28da858d1e8476052c99391015effb7db",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "3d9c2ae28da858d1e8476052c99391015effb7db",
"triggerType" : "PUSH"
}, {
"hash" : "79ac9affcb7f81497e0df755c8200638d35b02b7",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5081",
"triggerID" : "79ac9affcb7f81497e0df755c8200638d35b02b7",
"triggerType" : "PUSH"
}, {
"hash" : "3c14bbe6c6bcf49c4164c45e82f77b473f4de396",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5113",
"triggerID" : "3c14bbe6c6bcf49c4164c45e82f77b473f4de396",
"triggerType" : "PUSH"
}, {
"hash" : "276f13d6efd00b301b232b286d585729c9d1d26e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5116",
"triggerID" : "276f13d6efd00b301b232b286d585729c9d1d26e",
"triggerType" : "PUSH"
}, {
"hash" : "31b0669d7b638bd65a17b22a2ceb772f2627512c",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "31b0669d7b638bd65a17b22a2ceb772f2627512c",
"triggerType" : "PUSH"
}, {
"hash" : "096e26af39a477ffccbee0edd764493e12e15e71",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5124",
"triggerID" : "096e26af39a477ffccbee0edd764493e12e15e71",
"triggerType" : "PUSH"
}, {
"hash" : "97dd5ec7c9246f6d9f467b9076b790dd6017c5b4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5213",
"triggerID" : "97dd5ec7c9246f6d9f467b9076b790dd6017c5b4",
"triggerType" : "PUSH"
}, {
"hash" : "0538475fe488089c4cb3bc0afb63c2f518329969",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5257",
"triggerID" : "0538475fe488089c4cb3bc0afb63c2f518329969",
"triggerType" : "PUSH"
}, {
"hash" : "9f4b334e340fb26004e1b07fc8fbaaa047c76775",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5261",
"triggerID" : "9f4b334e340fb26004e1b07fc8fbaaa047c76775",
"triggerType" : "PUSH"
}, {
"hash" : "368c099820c3cbf57496d0e46d1858aa8eb153ee",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5330",
"triggerID" : "368c099820c3cbf57496d0e46d1858aa8eb153ee",
"triggerType" : "PUSH"
}, {
"hash" : "28a5a4f537544d35dfcd8700a7b97fb7216682ce",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "28a5a4f537544d35dfcd8700a7b97fb7216682ce",
"triggerType" : "PUSH"
}, {
"hash" : "08ffdd8b47d147c9b5c889a5f56e39b9b140612d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5351",
"triggerID" : "08ffdd8b47d147c9b5c889a5f56e39b9b140612d",
"triggerType" : "PUSH"
}, {
"hash" : "c09e228f7cce78a7dbbc394e93b3cf8c6c3d4d5f",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "c09e228f7cce78a7dbbc394e93b3cf8c6c3d4d5f",
"triggerType" : "PUSH"
}, {
"hash" : "8dadbf672d4d27505592f18bc89422fd7c013669",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5398",
"triggerID" : "8dadbf672d4d27505592f18bc89422fd7c013669",
"triggerType" : "PUSH"
}, {
"hash" : "906607be5bd62ee1cbbda34acb6a89916c1f7aee",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5424",
"triggerID" : "906607be5bd62ee1cbbda34acb6a89916c1f7aee",
"triggerType" : "PUSH"
}, {
"hash" : "dc1b033f40cea9642f71b8fcff74aa82106726b6",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5484",
"triggerID" : "dc1b033f40cea9642f71b8fcff74aa82106726b6",
"triggerType" : "PUSH"
}, {
"hash" : "5b8f5819fff8fec34864eb409fd429b95be17b9b",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "5b8f5819fff8fec34864eb409fd429b95be17b9b",
"triggerType" : "PUSH"
}, {
"hash" : "13702fc2232ebd9300966b0a917a3358d8d0f18c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5590",
"triggerID" : "13702fc2232ebd9300966b0a917a3358d8d0f18c",
"triggerType" : "PUSH"
}, {
"hash" : "13702fc2232ebd9300966b0a917a3358d8d0f18c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5600",
"triggerID" : "1024845655",
"triggerType" : "MANUAL"
}, {
"hash" : "9bdd8a60f95123f82a5f30f5e68929f5b7e1f8da",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5603",
"triggerID" : "9bdd8a60f95123f82a5f30f5e68929f5b7e1f8da",
"triggerType" : "PUSH"
}, {
"hash" : "aebb9df557c4afe3ca88f6b8b28ba2fbfdcbd597",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5631",
"triggerID" : "aebb9df557c4afe3ca88f6b8b28ba2fbfdcbd597",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 77d11131baabd1c4e3cc2050337daca4df5f6427 UNKNOWN
* 3d9c2ae28da858d1e8476052c99391015effb7db UNKNOWN
* 31b0669d7b638bd65a17b22a2ceb772f2627512c UNKNOWN
* 28a5a4f537544d35dfcd8700a7b97fb7216682ce UNKNOWN
* c09e228f7cce78a7dbbc394e93b3cf8c6c3d4d5f UNKNOWN
* 5b8f5819fff8fec34864eb409fd429b95be17b9b UNKNOWN
* aebb9df557c4afe3ca88f6b8b28ba2fbfdcbd597 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5631)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #4556: [HUDI-3191][Stacked on 4716] Removing duplicating file-listing process w/in Hive's MOR `FileInputFormat`s
Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #4556:
URL: https://github.com/apache/hudi/pull/4556#issuecomment-1026437170
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "d87786af43a7aeba7549cc3cfcbd97fc312bee0e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5074",
"triggerID" : "d87786af43a7aeba7549cc3cfcbd97fc312bee0e",
"triggerType" : "PUSH"
}, {
"hash" : "4b87ba1474be575ec27109ccbe626e4c2fc9c224",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5077",
"triggerID" : "4b87ba1474be575ec27109ccbe626e4c2fc9c224",
"triggerType" : "PUSH"
}, {
"hash" : "77d11131baabd1c4e3cc2050337daca4df5f6427",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "77d11131baabd1c4e3cc2050337daca4df5f6427",
"triggerType" : "PUSH"
}, {
"hash" : "3d9c2ae28da858d1e8476052c99391015effb7db",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "3d9c2ae28da858d1e8476052c99391015effb7db",
"triggerType" : "PUSH"
}, {
"hash" : "79ac9affcb7f81497e0df755c8200638d35b02b7",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5081",
"triggerID" : "79ac9affcb7f81497e0df755c8200638d35b02b7",
"triggerType" : "PUSH"
}, {
"hash" : "3c14bbe6c6bcf49c4164c45e82f77b473f4de396",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5113",
"triggerID" : "3c14bbe6c6bcf49c4164c45e82f77b473f4de396",
"triggerType" : "PUSH"
}, {
"hash" : "276f13d6efd00b301b232b286d585729c9d1d26e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5116",
"triggerID" : "276f13d6efd00b301b232b286d585729c9d1d26e",
"triggerType" : "PUSH"
}, {
"hash" : "31b0669d7b638bd65a17b22a2ceb772f2627512c",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "31b0669d7b638bd65a17b22a2ceb772f2627512c",
"triggerType" : "PUSH"
}, {
"hash" : "096e26af39a477ffccbee0edd764493e12e15e71",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5124",
"triggerID" : "096e26af39a477ffccbee0edd764493e12e15e71",
"triggerType" : "PUSH"
}, {
"hash" : "97dd5ec7c9246f6d9f467b9076b790dd6017c5b4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5213",
"triggerID" : "97dd5ec7c9246f6d9f467b9076b790dd6017c5b4",
"triggerType" : "PUSH"
}, {
"hash" : "0538475fe488089c4cb3bc0afb63c2f518329969",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5257",
"triggerID" : "0538475fe488089c4cb3bc0afb63c2f518329969",
"triggerType" : "PUSH"
}, {
"hash" : "9f4b334e340fb26004e1b07fc8fbaaa047c76775",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5261",
"triggerID" : "9f4b334e340fb26004e1b07fc8fbaaa047c76775",
"triggerType" : "PUSH"
}, {
"hash" : "368c099820c3cbf57496d0e46d1858aa8eb153ee",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5330",
"triggerID" : "368c099820c3cbf57496d0e46d1858aa8eb153ee",
"triggerType" : "PUSH"
}, {
"hash" : "28a5a4f537544d35dfcd8700a7b97fb7216682ce",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "28a5a4f537544d35dfcd8700a7b97fb7216682ce",
"triggerType" : "PUSH"
}, {
"hash" : "08ffdd8b47d147c9b5c889a5f56e39b9b140612d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5351",
"triggerID" : "08ffdd8b47d147c9b5c889a5f56e39b9b140612d",
"triggerType" : "PUSH"
}, {
"hash" : "c09e228f7cce78a7dbbc394e93b3cf8c6c3d4d5f",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "c09e228f7cce78a7dbbc394e93b3cf8c6c3d4d5f",
"triggerType" : "PUSH"
}, {
"hash" : "8dadbf672d4d27505592f18bc89422fd7c013669",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5398",
"triggerID" : "8dadbf672d4d27505592f18bc89422fd7c013669",
"triggerType" : "PUSH"
}, {
"hash" : "906607be5bd62ee1cbbda34acb6a89916c1f7aee",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5424",
"triggerID" : "906607be5bd62ee1cbbda34acb6a89916c1f7aee",
"triggerType" : "PUSH"
}, {
"hash" : "dc1b033f40cea9642f71b8fcff74aa82106726b6",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5484",
"triggerID" : "dc1b033f40cea9642f71b8fcff74aa82106726b6",
"triggerType" : "PUSH"
}, {
"hash" : "5b8f5819fff8fec34864eb409fd429b95be17b9b",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "5b8f5819fff8fec34864eb409fd429b95be17b9b",
"triggerType" : "PUSH"
}, {
"hash" : "13702fc2232ebd9300966b0a917a3358d8d0f18c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5590",
"triggerID" : "13702fc2232ebd9300966b0a917a3358d8d0f18c",
"triggerType" : "PUSH"
}, {
"hash" : "13702fc2232ebd9300966b0a917a3358d8d0f18c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5600",
"triggerID" : "1024845655",
"triggerType" : "MANUAL"
}, {
"hash" : "9bdd8a60f95123f82a5f30f5e68929f5b7e1f8da",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5603",
"triggerID" : "9bdd8a60f95123f82a5f30f5e68929f5b7e1f8da",
"triggerType" : "PUSH"
}, {
"hash" : "aebb9df557c4afe3ca88f6b8b28ba2fbfdcbd597",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5631",
"triggerID" : "aebb9df557c4afe3ca88f6b8b28ba2fbfdcbd597",
"triggerType" : "PUSH"
}, {
"hash" : "5d37935bc8bb33260735d782ca560fd59e02f321",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "5d37935bc8bb33260735d782ca560fd59e02f321",
"triggerType" : "PUSH"
}, {
"hash" : "f911d869f50009e5cd9f3fd341c83c732d7531ba",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5634",
"triggerID" : "f911d869f50009e5cd9f3fd341c83c732d7531ba",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 77d11131baabd1c4e3cc2050337daca4df5f6427 UNKNOWN
* 3d9c2ae28da858d1e8476052c99391015effb7db UNKNOWN
* 31b0669d7b638bd65a17b22a2ceb772f2627512c UNKNOWN
* 28a5a4f537544d35dfcd8700a7b97fb7216682ce UNKNOWN
* c09e228f7cce78a7dbbc394e93b3cf8c6c3d4d5f UNKNOWN
* 5b8f5819fff8fec34864eb409fd429b95be17b9b UNKNOWN
* 5d37935bc8bb33260735d782ca560fd59e02f321 UNKNOWN
* f911d869f50009e5cd9f3fd341c83c732d7531ba Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5634)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #4556: [HUDI-3191][Stacked on 4716] Removing duplicating file-listing process w/in Hive's MOR `FileInputFormat`s
Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #4556:
URL: https://github.com/apache/hudi/pull/4556#issuecomment-1027148203
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "d87786af43a7aeba7549cc3cfcbd97fc312bee0e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5074",
"triggerID" : "d87786af43a7aeba7549cc3cfcbd97fc312bee0e",
"triggerType" : "PUSH"
}, {
"hash" : "4b87ba1474be575ec27109ccbe626e4c2fc9c224",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5077",
"triggerID" : "4b87ba1474be575ec27109ccbe626e4c2fc9c224",
"triggerType" : "PUSH"
}, {
"hash" : "77d11131baabd1c4e3cc2050337daca4df5f6427",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "77d11131baabd1c4e3cc2050337daca4df5f6427",
"triggerType" : "PUSH"
}, {
"hash" : "3d9c2ae28da858d1e8476052c99391015effb7db",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "3d9c2ae28da858d1e8476052c99391015effb7db",
"triggerType" : "PUSH"
}, {
"hash" : "79ac9affcb7f81497e0df755c8200638d35b02b7",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5081",
"triggerID" : "79ac9affcb7f81497e0df755c8200638d35b02b7",
"triggerType" : "PUSH"
}, {
"hash" : "3c14bbe6c6bcf49c4164c45e82f77b473f4de396",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5113",
"triggerID" : "3c14bbe6c6bcf49c4164c45e82f77b473f4de396",
"triggerType" : "PUSH"
}, {
"hash" : "276f13d6efd00b301b232b286d585729c9d1d26e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5116",
"triggerID" : "276f13d6efd00b301b232b286d585729c9d1d26e",
"triggerType" : "PUSH"
}, {
"hash" : "31b0669d7b638bd65a17b22a2ceb772f2627512c",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "31b0669d7b638bd65a17b22a2ceb772f2627512c",
"triggerType" : "PUSH"
}, {
"hash" : "096e26af39a477ffccbee0edd764493e12e15e71",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5124",
"triggerID" : "096e26af39a477ffccbee0edd764493e12e15e71",
"triggerType" : "PUSH"
}, {
"hash" : "97dd5ec7c9246f6d9f467b9076b790dd6017c5b4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5213",
"triggerID" : "97dd5ec7c9246f6d9f467b9076b790dd6017c5b4",
"triggerType" : "PUSH"
}, {
"hash" : "0538475fe488089c4cb3bc0afb63c2f518329969",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5257",
"triggerID" : "0538475fe488089c4cb3bc0afb63c2f518329969",
"triggerType" : "PUSH"
}, {
"hash" : "9f4b334e340fb26004e1b07fc8fbaaa047c76775",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5261",
"triggerID" : "9f4b334e340fb26004e1b07fc8fbaaa047c76775",
"triggerType" : "PUSH"
}, {
"hash" : "368c099820c3cbf57496d0e46d1858aa8eb153ee",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5330",
"triggerID" : "368c099820c3cbf57496d0e46d1858aa8eb153ee",
"triggerType" : "PUSH"
}, {
"hash" : "28a5a4f537544d35dfcd8700a7b97fb7216682ce",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "28a5a4f537544d35dfcd8700a7b97fb7216682ce",
"triggerType" : "PUSH"
}, {
"hash" : "08ffdd8b47d147c9b5c889a5f56e39b9b140612d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5351",
"triggerID" : "08ffdd8b47d147c9b5c889a5f56e39b9b140612d",
"triggerType" : "PUSH"
}, {
"hash" : "c09e228f7cce78a7dbbc394e93b3cf8c6c3d4d5f",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "c09e228f7cce78a7dbbc394e93b3cf8c6c3d4d5f",
"triggerType" : "PUSH"
}, {
"hash" : "8dadbf672d4d27505592f18bc89422fd7c013669",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5398",
"triggerID" : "8dadbf672d4d27505592f18bc89422fd7c013669",
"triggerType" : "PUSH"
}, {
"hash" : "906607be5bd62ee1cbbda34acb6a89916c1f7aee",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5424",
"triggerID" : "906607be5bd62ee1cbbda34acb6a89916c1f7aee",
"triggerType" : "PUSH"
}, {
"hash" : "dc1b033f40cea9642f71b8fcff74aa82106726b6",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5484",
"triggerID" : "dc1b033f40cea9642f71b8fcff74aa82106726b6",
"triggerType" : "PUSH"
}, {
"hash" : "5b8f5819fff8fec34864eb409fd429b95be17b9b",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "5b8f5819fff8fec34864eb409fd429b95be17b9b",
"triggerType" : "PUSH"
}, {
"hash" : "13702fc2232ebd9300966b0a917a3358d8d0f18c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5590",
"triggerID" : "13702fc2232ebd9300966b0a917a3358d8d0f18c",
"triggerType" : "PUSH"
}, {
"hash" : "13702fc2232ebd9300966b0a917a3358d8d0f18c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5600",
"triggerID" : "1024845655",
"triggerType" : "MANUAL"
}, {
"hash" : "9bdd8a60f95123f82a5f30f5e68929f5b7e1f8da",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5603",
"triggerID" : "9bdd8a60f95123f82a5f30f5e68929f5b7e1f8da",
"triggerType" : "PUSH"
}, {
"hash" : "aebb9df557c4afe3ca88f6b8b28ba2fbfdcbd597",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5631",
"triggerID" : "aebb9df557c4afe3ca88f6b8b28ba2fbfdcbd597",
"triggerType" : "PUSH"
}, {
"hash" : "5d37935bc8bb33260735d782ca560fd59e02f321",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "5d37935bc8bb33260735d782ca560fd59e02f321",
"triggerType" : "PUSH"
}, {
"hash" : "f911d869f50009e5cd9f3fd341c83c732d7531ba",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5634",
"triggerID" : "f911d869f50009e5cd9f3fd341c83c732d7531ba",
"triggerType" : "PUSH"
}, {
"hash" : "f911d869f50009e5cd9f3fd341c83c732d7531ba",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5657",
"triggerID" : "1027051107",
"triggerType" : "MANUAL"
} ]
}-->
## CI report:
* 77d11131baabd1c4e3cc2050337daca4df5f6427 UNKNOWN
* 3d9c2ae28da858d1e8476052c99391015effb7db UNKNOWN
* 31b0669d7b638bd65a17b22a2ceb772f2627512c UNKNOWN
* 28a5a4f537544d35dfcd8700a7b97fb7216682ce UNKNOWN
* c09e228f7cce78a7dbbc394e93b3cf8c6c3d4d5f UNKNOWN
* 5b8f5819fff8fec34864eb409fd429b95be17b9b UNKNOWN
* 5d37935bc8bb33260735d782ca560fd59e02f321 UNKNOWN
* f911d869f50009e5cd9f3fd341c83c732d7531ba Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5634) Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5657)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #4556: [HUDI-3191][Stacked on 4716] Removing duplicating file-listing process w/in Hive's MOR `FileInputFormat`s
Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #4556:
URL: https://github.com/apache/hudi/pull/4556#issuecomment-1027052028
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "d87786af43a7aeba7549cc3cfcbd97fc312bee0e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5074",
"triggerID" : "d87786af43a7aeba7549cc3cfcbd97fc312bee0e",
"triggerType" : "PUSH"
}, {
"hash" : "4b87ba1474be575ec27109ccbe626e4c2fc9c224",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5077",
"triggerID" : "4b87ba1474be575ec27109ccbe626e4c2fc9c224",
"triggerType" : "PUSH"
}, {
"hash" : "77d11131baabd1c4e3cc2050337daca4df5f6427",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "77d11131baabd1c4e3cc2050337daca4df5f6427",
"triggerType" : "PUSH"
}, {
"hash" : "3d9c2ae28da858d1e8476052c99391015effb7db",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "3d9c2ae28da858d1e8476052c99391015effb7db",
"triggerType" : "PUSH"
}, {
"hash" : "79ac9affcb7f81497e0df755c8200638d35b02b7",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5081",
"triggerID" : "79ac9affcb7f81497e0df755c8200638d35b02b7",
"triggerType" : "PUSH"
}, {
"hash" : "3c14bbe6c6bcf49c4164c45e82f77b473f4de396",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5113",
"triggerID" : "3c14bbe6c6bcf49c4164c45e82f77b473f4de396",
"triggerType" : "PUSH"
}, {
"hash" : "276f13d6efd00b301b232b286d585729c9d1d26e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5116",
"triggerID" : "276f13d6efd00b301b232b286d585729c9d1d26e",
"triggerType" : "PUSH"
}, {
"hash" : "31b0669d7b638bd65a17b22a2ceb772f2627512c",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "31b0669d7b638bd65a17b22a2ceb772f2627512c",
"triggerType" : "PUSH"
}, {
"hash" : "096e26af39a477ffccbee0edd764493e12e15e71",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5124",
"triggerID" : "096e26af39a477ffccbee0edd764493e12e15e71",
"triggerType" : "PUSH"
}, {
"hash" : "97dd5ec7c9246f6d9f467b9076b790dd6017c5b4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5213",
"triggerID" : "97dd5ec7c9246f6d9f467b9076b790dd6017c5b4",
"triggerType" : "PUSH"
}, {
"hash" : "0538475fe488089c4cb3bc0afb63c2f518329969",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5257",
"triggerID" : "0538475fe488089c4cb3bc0afb63c2f518329969",
"triggerType" : "PUSH"
}, {
"hash" : "9f4b334e340fb26004e1b07fc8fbaaa047c76775",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5261",
"triggerID" : "9f4b334e340fb26004e1b07fc8fbaaa047c76775",
"triggerType" : "PUSH"
}, {
"hash" : "368c099820c3cbf57496d0e46d1858aa8eb153ee",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5330",
"triggerID" : "368c099820c3cbf57496d0e46d1858aa8eb153ee",
"triggerType" : "PUSH"
}, {
"hash" : "28a5a4f537544d35dfcd8700a7b97fb7216682ce",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "28a5a4f537544d35dfcd8700a7b97fb7216682ce",
"triggerType" : "PUSH"
}, {
"hash" : "08ffdd8b47d147c9b5c889a5f56e39b9b140612d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5351",
"triggerID" : "08ffdd8b47d147c9b5c889a5f56e39b9b140612d",
"triggerType" : "PUSH"
}, {
"hash" : "c09e228f7cce78a7dbbc394e93b3cf8c6c3d4d5f",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "c09e228f7cce78a7dbbc394e93b3cf8c6c3d4d5f",
"triggerType" : "PUSH"
}, {
"hash" : "8dadbf672d4d27505592f18bc89422fd7c013669",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5398",
"triggerID" : "8dadbf672d4d27505592f18bc89422fd7c013669",
"triggerType" : "PUSH"
}, {
"hash" : "906607be5bd62ee1cbbda34acb6a89916c1f7aee",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5424",
"triggerID" : "906607be5bd62ee1cbbda34acb6a89916c1f7aee",
"triggerType" : "PUSH"
}, {
"hash" : "dc1b033f40cea9642f71b8fcff74aa82106726b6",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5484",
"triggerID" : "dc1b033f40cea9642f71b8fcff74aa82106726b6",
"triggerType" : "PUSH"
}, {
"hash" : "5b8f5819fff8fec34864eb409fd429b95be17b9b",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "5b8f5819fff8fec34864eb409fd429b95be17b9b",
"triggerType" : "PUSH"
}, {
"hash" : "13702fc2232ebd9300966b0a917a3358d8d0f18c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5590",
"triggerID" : "13702fc2232ebd9300966b0a917a3358d8d0f18c",
"triggerType" : "PUSH"
}, {
"hash" : "13702fc2232ebd9300966b0a917a3358d8d0f18c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5600",
"triggerID" : "1024845655",
"triggerType" : "MANUAL"
}, {
"hash" : "9bdd8a60f95123f82a5f30f5e68929f5b7e1f8da",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5603",
"triggerID" : "9bdd8a60f95123f82a5f30f5e68929f5b7e1f8da",
"triggerType" : "PUSH"
}, {
"hash" : "aebb9df557c4afe3ca88f6b8b28ba2fbfdcbd597",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5631",
"triggerID" : "aebb9df557c4afe3ca88f6b8b28ba2fbfdcbd597",
"triggerType" : "PUSH"
}, {
"hash" : "5d37935bc8bb33260735d782ca560fd59e02f321",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "5d37935bc8bb33260735d782ca560fd59e02f321",
"triggerType" : "PUSH"
}, {
"hash" : "f911d869f50009e5cd9f3fd341c83c732d7531ba",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5634",
"triggerID" : "f911d869f50009e5cd9f3fd341c83c732d7531ba",
"triggerType" : "PUSH"
}, {
"hash" : "f911d869f50009e5cd9f3fd341c83c732d7531ba",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5657",
"triggerID" : "1027051107",
"triggerType" : "MANUAL"
} ]
}-->
## CI report:
* 77d11131baabd1c4e3cc2050337daca4df5f6427 UNKNOWN
* 3d9c2ae28da858d1e8476052c99391015effb7db UNKNOWN
* 31b0669d7b638bd65a17b22a2ceb772f2627512c UNKNOWN
* 28a5a4f537544d35dfcd8700a7b97fb7216682ce UNKNOWN
* c09e228f7cce78a7dbbc394e93b3cf8c6c3d4d5f UNKNOWN
* 5b8f5819fff8fec34864eb409fd429b95be17b9b UNKNOWN
* 5d37935bc8bb33260735d782ca560fd59e02f321 UNKNOWN
* f911d869f50009e5cd9f3fd341c83c732d7531ba Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5634) Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5657)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #4556: [HUDI-3191][Stacked on 4716] Removing duplicating file-listing process w/in Hive's MOR `FileInputFormat`s
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #4556:
URL: https://github.com/apache/hudi/pull/4556#issuecomment-1024864965
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "d87786af43a7aeba7549cc3cfcbd97fc312bee0e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5074",
"triggerID" : "d87786af43a7aeba7549cc3cfcbd97fc312bee0e",
"triggerType" : "PUSH"
}, {
"hash" : "4b87ba1474be575ec27109ccbe626e4c2fc9c224",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5077",
"triggerID" : "4b87ba1474be575ec27109ccbe626e4c2fc9c224",
"triggerType" : "PUSH"
}, {
"hash" : "77d11131baabd1c4e3cc2050337daca4df5f6427",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "77d11131baabd1c4e3cc2050337daca4df5f6427",
"triggerType" : "PUSH"
}, {
"hash" : "3d9c2ae28da858d1e8476052c99391015effb7db",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "3d9c2ae28da858d1e8476052c99391015effb7db",
"triggerType" : "PUSH"
}, {
"hash" : "79ac9affcb7f81497e0df755c8200638d35b02b7",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5081",
"triggerID" : "79ac9affcb7f81497e0df755c8200638d35b02b7",
"triggerType" : "PUSH"
}, {
"hash" : "3c14bbe6c6bcf49c4164c45e82f77b473f4de396",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5113",
"triggerID" : "3c14bbe6c6bcf49c4164c45e82f77b473f4de396",
"triggerType" : "PUSH"
}, {
"hash" : "276f13d6efd00b301b232b286d585729c9d1d26e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5116",
"triggerID" : "276f13d6efd00b301b232b286d585729c9d1d26e",
"triggerType" : "PUSH"
}, {
"hash" : "31b0669d7b638bd65a17b22a2ceb772f2627512c",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "31b0669d7b638bd65a17b22a2ceb772f2627512c",
"triggerType" : "PUSH"
}, {
"hash" : "096e26af39a477ffccbee0edd764493e12e15e71",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5124",
"triggerID" : "096e26af39a477ffccbee0edd764493e12e15e71",
"triggerType" : "PUSH"
}, {
"hash" : "97dd5ec7c9246f6d9f467b9076b790dd6017c5b4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5213",
"triggerID" : "97dd5ec7c9246f6d9f467b9076b790dd6017c5b4",
"triggerType" : "PUSH"
}, {
"hash" : "0538475fe488089c4cb3bc0afb63c2f518329969",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5257",
"triggerID" : "0538475fe488089c4cb3bc0afb63c2f518329969",
"triggerType" : "PUSH"
}, {
"hash" : "9f4b334e340fb26004e1b07fc8fbaaa047c76775",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5261",
"triggerID" : "9f4b334e340fb26004e1b07fc8fbaaa047c76775",
"triggerType" : "PUSH"
}, {
"hash" : "368c099820c3cbf57496d0e46d1858aa8eb153ee",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5330",
"triggerID" : "368c099820c3cbf57496d0e46d1858aa8eb153ee",
"triggerType" : "PUSH"
}, {
"hash" : "28a5a4f537544d35dfcd8700a7b97fb7216682ce",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "28a5a4f537544d35dfcd8700a7b97fb7216682ce",
"triggerType" : "PUSH"
}, {
"hash" : "08ffdd8b47d147c9b5c889a5f56e39b9b140612d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5351",
"triggerID" : "08ffdd8b47d147c9b5c889a5f56e39b9b140612d",
"triggerType" : "PUSH"
}, {
"hash" : "c09e228f7cce78a7dbbc394e93b3cf8c6c3d4d5f",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "c09e228f7cce78a7dbbc394e93b3cf8c6c3d4d5f",
"triggerType" : "PUSH"
}, {
"hash" : "8dadbf672d4d27505592f18bc89422fd7c013669",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5398",
"triggerID" : "8dadbf672d4d27505592f18bc89422fd7c013669",
"triggerType" : "PUSH"
}, {
"hash" : "906607be5bd62ee1cbbda34acb6a89916c1f7aee",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5424",
"triggerID" : "906607be5bd62ee1cbbda34acb6a89916c1f7aee",
"triggerType" : "PUSH"
}, {
"hash" : "dc1b033f40cea9642f71b8fcff74aa82106726b6",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5484",
"triggerID" : "dc1b033f40cea9642f71b8fcff74aa82106726b6",
"triggerType" : "PUSH"
}, {
"hash" : "5b8f5819fff8fec34864eb409fd429b95be17b9b",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "5b8f5819fff8fec34864eb409fd429b95be17b9b",
"triggerType" : "PUSH"
}, {
"hash" : "13702fc2232ebd9300966b0a917a3358d8d0f18c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5590",
"triggerID" : "13702fc2232ebd9300966b0a917a3358d8d0f18c",
"triggerType" : "PUSH"
}, {
"hash" : "13702fc2232ebd9300966b0a917a3358d8d0f18c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5600",
"triggerID" : "1024845655",
"triggerType" : "MANUAL"
}, {
"hash" : "9bdd8a60f95123f82a5f30f5e68929f5b7e1f8da",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5603",
"triggerID" : "9bdd8a60f95123f82a5f30f5e68929f5b7e1f8da",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 77d11131baabd1c4e3cc2050337daca4df5f6427 UNKNOWN
* 3d9c2ae28da858d1e8476052c99391015effb7db UNKNOWN
* 31b0669d7b638bd65a17b22a2ceb772f2627512c UNKNOWN
* 28a5a4f537544d35dfcd8700a7b97fb7216682ce UNKNOWN
* c09e228f7cce78a7dbbc394e93b3cf8c6c3d4d5f UNKNOWN
* 5b8f5819fff8fec34864eb409fd429b95be17b9b UNKNOWN
* 9bdd8a60f95123f82a5f30f5e68929f5b7e1f8da Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5603)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #4556: [HUDI-3191][Stacked on 4716] Removing duplicating file-listing process w/in Hive's MOR `FileInputFormat`s
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #4556:
URL: https://github.com/apache/hudi/pull/4556#issuecomment-1024802263
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "d87786af43a7aeba7549cc3cfcbd97fc312bee0e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5074",
"triggerID" : "d87786af43a7aeba7549cc3cfcbd97fc312bee0e",
"triggerType" : "PUSH"
}, {
"hash" : "4b87ba1474be575ec27109ccbe626e4c2fc9c224",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5077",
"triggerID" : "4b87ba1474be575ec27109ccbe626e4c2fc9c224",
"triggerType" : "PUSH"
}, {
"hash" : "77d11131baabd1c4e3cc2050337daca4df5f6427",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "77d11131baabd1c4e3cc2050337daca4df5f6427",
"triggerType" : "PUSH"
}, {
"hash" : "3d9c2ae28da858d1e8476052c99391015effb7db",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "3d9c2ae28da858d1e8476052c99391015effb7db",
"triggerType" : "PUSH"
}, {
"hash" : "79ac9affcb7f81497e0df755c8200638d35b02b7",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5081",
"triggerID" : "79ac9affcb7f81497e0df755c8200638d35b02b7",
"triggerType" : "PUSH"
}, {
"hash" : "3c14bbe6c6bcf49c4164c45e82f77b473f4de396",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5113",
"triggerID" : "3c14bbe6c6bcf49c4164c45e82f77b473f4de396",
"triggerType" : "PUSH"
}, {
"hash" : "276f13d6efd00b301b232b286d585729c9d1d26e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5116",
"triggerID" : "276f13d6efd00b301b232b286d585729c9d1d26e",
"triggerType" : "PUSH"
}, {
"hash" : "31b0669d7b638bd65a17b22a2ceb772f2627512c",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "31b0669d7b638bd65a17b22a2ceb772f2627512c",
"triggerType" : "PUSH"
}, {
"hash" : "096e26af39a477ffccbee0edd764493e12e15e71",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5124",
"triggerID" : "096e26af39a477ffccbee0edd764493e12e15e71",
"triggerType" : "PUSH"
}, {
"hash" : "97dd5ec7c9246f6d9f467b9076b790dd6017c5b4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5213",
"triggerID" : "97dd5ec7c9246f6d9f467b9076b790dd6017c5b4",
"triggerType" : "PUSH"
}, {
"hash" : "0538475fe488089c4cb3bc0afb63c2f518329969",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5257",
"triggerID" : "0538475fe488089c4cb3bc0afb63c2f518329969",
"triggerType" : "PUSH"
}, {
"hash" : "9f4b334e340fb26004e1b07fc8fbaaa047c76775",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5261",
"triggerID" : "9f4b334e340fb26004e1b07fc8fbaaa047c76775",
"triggerType" : "PUSH"
}, {
"hash" : "368c099820c3cbf57496d0e46d1858aa8eb153ee",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5330",
"triggerID" : "368c099820c3cbf57496d0e46d1858aa8eb153ee",
"triggerType" : "PUSH"
}, {
"hash" : "28a5a4f537544d35dfcd8700a7b97fb7216682ce",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "28a5a4f537544d35dfcd8700a7b97fb7216682ce",
"triggerType" : "PUSH"
}, {
"hash" : "08ffdd8b47d147c9b5c889a5f56e39b9b140612d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5351",
"triggerID" : "08ffdd8b47d147c9b5c889a5f56e39b9b140612d",
"triggerType" : "PUSH"
}, {
"hash" : "c09e228f7cce78a7dbbc394e93b3cf8c6c3d4d5f",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "c09e228f7cce78a7dbbc394e93b3cf8c6c3d4d5f",
"triggerType" : "PUSH"
}, {
"hash" : "8dadbf672d4d27505592f18bc89422fd7c013669",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5398",
"triggerID" : "8dadbf672d4d27505592f18bc89422fd7c013669",
"triggerType" : "PUSH"
}, {
"hash" : "906607be5bd62ee1cbbda34acb6a89916c1f7aee",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5424",
"triggerID" : "906607be5bd62ee1cbbda34acb6a89916c1f7aee",
"triggerType" : "PUSH"
}, {
"hash" : "dc1b033f40cea9642f71b8fcff74aa82106726b6",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5484",
"triggerID" : "dc1b033f40cea9642f71b8fcff74aa82106726b6",
"triggerType" : "PUSH"
}, {
"hash" : "5b8f5819fff8fec34864eb409fd429b95be17b9b",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "5b8f5819fff8fec34864eb409fd429b95be17b9b",
"triggerType" : "PUSH"
}, {
"hash" : "13702fc2232ebd9300966b0a917a3358d8d0f18c",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5590",
"triggerID" : "13702fc2232ebd9300966b0a917a3358d8d0f18c",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 77d11131baabd1c4e3cc2050337daca4df5f6427 UNKNOWN
* 3d9c2ae28da858d1e8476052c99391015effb7db UNKNOWN
* 31b0669d7b638bd65a17b22a2ceb772f2627512c UNKNOWN
* 28a5a4f537544d35dfcd8700a7b97fb7216682ce UNKNOWN
* c09e228f7cce78a7dbbc394e93b3cf8c6c3d4d5f UNKNOWN
* dc1b033f40cea9642f71b8fcff74aa82106726b6 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5484)
* 5b8f5819fff8fec34864eb409fd429b95be17b9b UNKNOWN
* 13702fc2232ebd9300966b0a917a3358d8d0f18c Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5590)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] yihua commented on a change in pull request #4556: [HUDI-3191] Removing duplicating file-listing process w/in Hive's MOR `FileInputFormat`s
Posted by GitBox <gi...@apache.org>.
yihua commented on a change in pull request #4556:
URL: https://github.com/apache/hudi/pull/4556#discussion_r794852662
##########
File path: hudi-common/src/main/scala/org/apache/hudi/HoodieTableFileIndexBase.scala
##########
@@ -87,6 +89,12 @@ abstract class HoodieTableFileIndexBase(engineContext: HoodieEngineContext,
refresh0()
+ /**
+ * Returns latest completed instant as seen by this instance of the file-index
+ */
+ def latestCompletedInstant(): Option[HoodieInstant] =
Review comment:
I'm trying to understand if this `def function` is more like a `val` function or method in a class. If it acts like a function, it can be defined as a `val` function (`val latestCompletedInstant = () => getActiveTimeline.filterCompletedInstants().lastInstant()`) and such naming is fine. If it's more like a method, `getLatestCompletedInstant()` naming is better.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #4556: [HUDI-3191][Stacked on 4531] Removing duplicating file-listing process w/in Hive's MOR `FIleInputFormat`s
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #4556:
URL: https://github.com/apache/hudi/pull/4556#issuecomment-1009484475
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "d87786af43a7aeba7549cc3cfcbd97fc312bee0e",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5074",
"triggerID" : "d87786af43a7aeba7549cc3cfcbd97fc312bee0e",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* d87786af43a7aeba7549cc3cfcbd97fc312bee0e Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5074)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #4556: [HUDI-3191][Stacked on 4531] Removing duplicating file-listing process w/in Hive's MOR `FIleInputFormat`s
Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #4556:
URL: https://github.com/apache/hudi/pull/4556#issuecomment-1009483007
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "d87786af43a7aeba7549cc3cfcbd97fc312bee0e",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "d87786af43a7aeba7549cc3cfcbd97fc312bee0e",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* d87786af43a7aeba7549cc3cfcbd97fc312bee0e UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #4556: [HUDI-3191] Removing duplicating file-listing process w/in Hive's MOR `FIleInputFormat`s
Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #4556:
URL: https://github.com/apache/hudi/pull/4556#issuecomment-1016950218
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "d87786af43a7aeba7549cc3cfcbd97fc312bee0e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5074",
"triggerID" : "d87786af43a7aeba7549cc3cfcbd97fc312bee0e",
"triggerType" : "PUSH"
}, {
"hash" : "4b87ba1474be575ec27109ccbe626e4c2fc9c224",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5077",
"triggerID" : "4b87ba1474be575ec27109ccbe626e4c2fc9c224",
"triggerType" : "PUSH"
}, {
"hash" : "77d11131baabd1c4e3cc2050337daca4df5f6427",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "77d11131baabd1c4e3cc2050337daca4df5f6427",
"triggerType" : "PUSH"
}, {
"hash" : "3d9c2ae28da858d1e8476052c99391015effb7db",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "3d9c2ae28da858d1e8476052c99391015effb7db",
"triggerType" : "PUSH"
}, {
"hash" : "79ac9affcb7f81497e0df755c8200638d35b02b7",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5081",
"triggerID" : "79ac9affcb7f81497e0df755c8200638d35b02b7",
"triggerType" : "PUSH"
}, {
"hash" : "3c14bbe6c6bcf49c4164c45e82f77b473f4de396",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5113",
"triggerID" : "3c14bbe6c6bcf49c4164c45e82f77b473f4de396",
"triggerType" : "PUSH"
}, {
"hash" : "276f13d6efd00b301b232b286d585729c9d1d26e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5116",
"triggerID" : "276f13d6efd00b301b232b286d585729c9d1d26e",
"triggerType" : "PUSH"
}, {
"hash" : "31b0669d7b638bd65a17b22a2ceb772f2627512c",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "31b0669d7b638bd65a17b22a2ceb772f2627512c",
"triggerType" : "PUSH"
}, {
"hash" : "096e26af39a477ffccbee0edd764493e12e15e71",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5124",
"triggerID" : "096e26af39a477ffccbee0edd764493e12e15e71",
"triggerType" : "PUSH"
}, {
"hash" : "97dd5ec7c9246f6d9f467b9076b790dd6017c5b4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5213",
"triggerID" : "97dd5ec7c9246f6d9f467b9076b790dd6017c5b4",
"triggerType" : "PUSH"
}, {
"hash" : "0538475fe488089c4cb3bc0afb63c2f518329969",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5257",
"triggerID" : "0538475fe488089c4cb3bc0afb63c2f518329969",
"triggerType" : "PUSH"
}, {
"hash" : "9f4b334e340fb26004e1b07fc8fbaaa047c76775",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5261",
"triggerID" : "9f4b334e340fb26004e1b07fc8fbaaa047c76775",
"triggerType" : "PUSH"
}, {
"hash" : "368c099820c3cbf57496d0e46d1858aa8eb153ee",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5330",
"triggerID" : "368c099820c3cbf57496d0e46d1858aa8eb153ee",
"triggerType" : "PUSH"
}, {
"hash" : "28a5a4f537544d35dfcd8700a7b97fb7216682ce",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "28a5a4f537544d35dfcd8700a7b97fb7216682ce",
"triggerType" : "PUSH"
}, {
"hash" : "08ffdd8b47d147c9b5c889a5f56e39b9b140612d",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5351",
"triggerID" : "08ffdd8b47d147c9b5c889a5f56e39b9b140612d",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 77d11131baabd1c4e3cc2050337daca4df5f6427 UNKNOWN
* 3d9c2ae28da858d1e8476052c99391015effb7db UNKNOWN
* 31b0669d7b638bd65a17b22a2ceb772f2627512c UNKNOWN
* 28a5a4f537544d35dfcd8700a7b97fb7216682ce UNKNOWN
* 08ffdd8b47d147c9b5c889a5f56e39b9b140612d Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5351)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #4556: [HUDI-3191] Removing duplicating file-listing process w/in Hive's MOR `FileInputFormat`s
Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #4556:
URL: https://github.com/apache/hudi/pull/4556#issuecomment-1018865352
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "d87786af43a7aeba7549cc3cfcbd97fc312bee0e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5074",
"triggerID" : "d87786af43a7aeba7549cc3cfcbd97fc312bee0e",
"triggerType" : "PUSH"
}, {
"hash" : "4b87ba1474be575ec27109ccbe626e4c2fc9c224",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5077",
"triggerID" : "4b87ba1474be575ec27109ccbe626e4c2fc9c224",
"triggerType" : "PUSH"
}, {
"hash" : "77d11131baabd1c4e3cc2050337daca4df5f6427",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "77d11131baabd1c4e3cc2050337daca4df5f6427",
"triggerType" : "PUSH"
}, {
"hash" : "3d9c2ae28da858d1e8476052c99391015effb7db",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "3d9c2ae28da858d1e8476052c99391015effb7db",
"triggerType" : "PUSH"
}, {
"hash" : "79ac9affcb7f81497e0df755c8200638d35b02b7",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5081",
"triggerID" : "79ac9affcb7f81497e0df755c8200638d35b02b7",
"triggerType" : "PUSH"
}, {
"hash" : "3c14bbe6c6bcf49c4164c45e82f77b473f4de396",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5113",
"triggerID" : "3c14bbe6c6bcf49c4164c45e82f77b473f4de396",
"triggerType" : "PUSH"
}, {
"hash" : "276f13d6efd00b301b232b286d585729c9d1d26e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5116",
"triggerID" : "276f13d6efd00b301b232b286d585729c9d1d26e",
"triggerType" : "PUSH"
}, {
"hash" : "31b0669d7b638bd65a17b22a2ceb772f2627512c",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "31b0669d7b638bd65a17b22a2ceb772f2627512c",
"triggerType" : "PUSH"
}, {
"hash" : "096e26af39a477ffccbee0edd764493e12e15e71",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5124",
"triggerID" : "096e26af39a477ffccbee0edd764493e12e15e71",
"triggerType" : "PUSH"
}, {
"hash" : "97dd5ec7c9246f6d9f467b9076b790dd6017c5b4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5213",
"triggerID" : "97dd5ec7c9246f6d9f467b9076b790dd6017c5b4",
"triggerType" : "PUSH"
}, {
"hash" : "0538475fe488089c4cb3bc0afb63c2f518329969",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5257",
"triggerID" : "0538475fe488089c4cb3bc0afb63c2f518329969",
"triggerType" : "PUSH"
}, {
"hash" : "9f4b334e340fb26004e1b07fc8fbaaa047c76775",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5261",
"triggerID" : "9f4b334e340fb26004e1b07fc8fbaaa047c76775",
"triggerType" : "PUSH"
}, {
"hash" : "368c099820c3cbf57496d0e46d1858aa8eb153ee",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5330",
"triggerID" : "368c099820c3cbf57496d0e46d1858aa8eb153ee",
"triggerType" : "PUSH"
}, {
"hash" : "28a5a4f537544d35dfcd8700a7b97fb7216682ce",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "28a5a4f537544d35dfcd8700a7b97fb7216682ce",
"triggerType" : "PUSH"
}, {
"hash" : "08ffdd8b47d147c9b5c889a5f56e39b9b140612d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5351",
"triggerID" : "08ffdd8b47d147c9b5c889a5f56e39b9b140612d",
"triggerType" : "PUSH"
}, {
"hash" : "c09e228f7cce78a7dbbc394e93b3cf8c6c3d4d5f",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "c09e228f7cce78a7dbbc394e93b3cf8c6c3d4d5f",
"triggerType" : "PUSH"
}, {
"hash" : "8dadbf672d4d27505592f18bc89422fd7c013669",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5398",
"triggerID" : "8dadbf672d4d27505592f18bc89422fd7c013669",
"triggerType" : "PUSH"
}, {
"hash" : "906607be5bd62ee1cbbda34acb6a89916c1f7aee",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5424",
"triggerID" : "906607be5bd62ee1cbbda34acb6a89916c1f7aee",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 77d11131baabd1c4e3cc2050337daca4df5f6427 UNKNOWN
* 3d9c2ae28da858d1e8476052c99391015effb7db UNKNOWN
* 31b0669d7b638bd65a17b22a2ceb772f2627512c UNKNOWN
* 28a5a4f537544d35dfcd8700a7b97fb7216682ce UNKNOWN
* c09e228f7cce78a7dbbc394e93b3cf8c6c3d4d5f UNKNOWN
* 8dadbf672d4d27505592f18bc89422fd7c013669 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5398)
* 906607be5bd62ee1cbbda34acb6a89916c1f7aee Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5424)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #4556: [HUDI-3191] Removing duplicating file-listing process w/in Hive's MOR `FileInputFormat`s
Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #4556:
URL: https://github.com/apache/hudi/pull/4556#issuecomment-1028513791
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "d87786af43a7aeba7549cc3cfcbd97fc312bee0e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5074",
"triggerID" : "d87786af43a7aeba7549cc3cfcbd97fc312bee0e",
"triggerType" : "PUSH"
}, {
"hash" : "4b87ba1474be575ec27109ccbe626e4c2fc9c224",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5077",
"triggerID" : "4b87ba1474be575ec27109ccbe626e4c2fc9c224",
"triggerType" : "PUSH"
}, {
"hash" : "77d11131baabd1c4e3cc2050337daca4df5f6427",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "77d11131baabd1c4e3cc2050337daca4df5f6427",
"triggerType" : "PUSH"
}, {
"hash" : "3d9c2ae28da858d1e8476052c99391015effb7db",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "3d9c2ae28da858d1e8476052c99391015effb7db",
"triggerType" : "PUSH"
}, {
"hash" : "79ac9affcb7f81497e0df755c8200638d35b02b7",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5081",
"triggerID" : "79ac9affcb7f81497e0df755c8200638d35b02b7",
"triggerType" : "PUSH"
}, {
"hash" : "3c14bbe6c6bcf49c4164c45e82f77b473f4de396",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5113",
"triggerID" : "3c14bbe6c6bcf49c4164c45e82f77b473f4de396",
"triggerType" : "PUSH"
}, {
"hash" : "276f13d6efd00b301b232b286d585729c9d1d26e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5116",
"triggerID" : "276f13d6efd00b301b232b286d585729c9d1d26e",
"triggerType" : "PUSH"
}, {
"hash" : "31b0669d7b638bd65a17b22a2ceb772f2627512c",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "31b0669d7b638bd65a17b22a2ceb772f2627512c",
"triggerType" : "PUSH"
}, {
"hash" : "096e26af39a477ffccbee0edd764493e12e15e71",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5124",
"triggerID" : "096e26af39a477ffccbee0edd764493e12e15e71",
"triggerType" : "PUSH"
}, {
"hash" : "97dd5ec7c9246f6d9f467b9076b790dd6017c5b4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5213",
"triggerID" : "97dd5ec7c9246f6d9f467b9076b790dd6017c5b4",
"triggerType" : "PUSH"
}, {
"hash" : "0538475fe488089c4cb3bc0afb63c2f518329969",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5257",
"triggerID" : "0538475fe488089c4cb3bc0afb63c2f518329969",
"triggerType" : "PUSH"
}, {
"hash" : "9f4b334e340fb26004e1b07fc8fbaaa047c76775",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5261",
"triggerID" : "9f4b334e340fb26004e1b07fc8fbaaa047c76775",
"triggerType" : "PUSH"
}, {
"hash" : "368c099820c3cbf57496d0e46d1858aa8eb153ee",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5330",
"triggerID" : "368c099820c3cbf57496d0e46d1858aa8eb153ee",
"triggerType" : "PUSH"
}, {
"hash" : "28a5a4f537544d35dfcd8700a7b97fb7216682ce",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "28a5a4f537544d35dfcd8700a7b97fb7216682ce",
"triggerType" : "PUSH"
}, {
"hash" : "08ffdd8b47d147c9b5c889a5f56e39b9b140612d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5351",
"triggerID" : "08ffdd8b47d147c9b5c889a5f56e39b9b140612d",
"triggerType" : "PUSH"
}, {
"hash" : "c09e228f7cce78a7dbbc394e93b3cf8c6c3d4d5f",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "c09e228f7cce78a7dbbc394e93b3cf8c6c3d4d5f",
"triggerType" : "PUSH"
}, {
"hash" : "8dadbf672d4d27505592f18bc89422fd7c013669",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5398",
"triggerID" : "8dadbf672d4d27505592f18bc89422fd7c013669",
"triggerType" : "PUSH"
}, {
"hash" : "906607be5bd62ee1cbbda34acb6a89916c1f7aee",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5424",
"triggerID" : "906607be5bd62ee1cbbda34acb6a89916c1f7aee",
"triggerType" : "PUSH"
}, {
"hash" : "dc1b033f40cea9642f71b8fcff74aa82106726b6",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5484",
"triggerID" : "dc1b033f40cea9642f71b8fcff74aa82106726b6",
"triggerType" : "PUSH"
}, {
"hash" : "5b8f5819fff8fec34864eb409fd429b95be17b9b",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "5b8f5819fff8fec34864eb409fd429b95be17b9b",
"triggerType" : "PUSH"
}, {
"hash" : "13702fc2232ebd9300966b0a917a3358d8d0f18c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5590",
"triggerID" : "13702fc2232ebd9300966b0a917a3358d8d0f18c",
"triggerType" : "PUSH"
}, {
"hash" : "13702fc2232ebd9300966b0a917a3358d8d0f18c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5600",
"triggerID" : "1024845655",
"triggerType" : "MANUAL"
}, {
"hash" : "9bdd8a60f95123f82a5f30f5e68929f5b7e1f8da",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5603",
"triggerID" : "9bdd8a60f95123f82a5f30f5e68929f5b7e1f8da",
"triggerType" : "PUSH"
}, {
"hash" : "aebb9df557c4afe3ca88f6b8b28ba2fbfdcbd597",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5631",
"triggerID" : "aebb9df557c4afe3ca88f6b8b28ba2fbfdcbd597",
"triggerType" : "PUSH"
}, {
"hash" : "5d37935bc8bb33260735d782ca560fd59e02f321",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "5d37935bc8bb33260735d782ca560fd59e02f321",
"triggerType" : "PUSH"
}, {
"hash" : "f911d869f50009e5cd9f3fd341c83c732d7531ba",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5634",
"triggerID" : "f911d869f50009e5cd9f3fd341c83c732d7531ba",
"triggerType" : "PUSH"
}, {
"hash" : "f911d869f50009e5cd9f3fd341c83c732d7531ba",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5657",
"triggerID" : "1027051107",
"triggerType" : "MANUAL"
}, {
"hash" : "f911d869f50009e5cd9f3fd341c83c732d7531ba",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5659",
"triggerID" : "1027166086",
"triggerType" : "MANUAL"
}, {
"hash" : "f911d869f50009e5cd9f3fd341c83c732d7531ba",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5665",
"triggerID" : "1027387044",
"triggerType" : "MANUAL"
}, {
"hash" : "34b94b96b03109555201092bfabce21793add437",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5689",
"triggerID" : "34b94b96b03109555201092bfabce21793add437",
"triggerType" : "PUSH"
}, {
"hash" : "7f793744421a5ee304d5dff89d23e1e925bfd1cb",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5692",
"triggerID" : "7f793744421a5ee304d5dff89d23e1e925bfd1cb",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 77d11131baabd1c4e3cc2050337daca4df5f6427 UNKNOWN
* 3d9c2ae28da858d1e8476052c99391015effb7db UNKNOWN
* 31b0669d7b638bd65a17b22a2ceb772f2627512c UNKNOWN
* 28a5a4f537544d35dfcd8700a7b97fb7216682ce UNKNOWN
* c09e228f7cce78a7dbbc394e93b3cf8c6c3d4d5f UNKNOWN
* 5b8f5819fff8fec34864eb409fd429b95be17b9b UNKNOWN
* 5d37935bc8bb33260735d782ca560fd59e02f321 UNKNOWN
* 7f793744421a5ee304d5dff89d23e1e925bfd1cb Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5692)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] alexeykudinkin commented on a change in pull request #4556: [HUDI-3191] Removing duplicating file-listing process w/in Hive's MOR `FileInputFormat`s
Posted by GitBox <gi...@apache.org>.
alexeykudinkin commented on a change in pull request #4556:
URL: https://github.com/apache/hudi/pull/4556#discussion_r798204981
##########
File path: hudi-hadoop-mr/src/main/java/org/apache/hudi/hadoop/utils/HoodieRealtimeInputFormatUtils.java
##########
@@ -65,11 +65,70 @@
import java.util.stream.Collectors;
import java.util.stream.Stream;
+import static org.apache.hudi.TypeUtils.unsafeCast;
+import static org.apache.hudi.common.util.ValidationUtils.checkState;
+
public class HoodieRealtimeInputFormatUtils extends HoodieInputFormatUtils {
private static final Logger LOG = LogManager.getLogger(HoodieRealtimeInputFormatUtils.class);
- public static InputSplit[] getRealtimeSplits(Configuration conf, Stream<FileSplit> fileSplits) {
+ public static InputSplit[] getRealtimeSplits(Configuration conf, List<FileSplit> fileSplits) throws IOException {
+ if (fileSplits.isEmpty()) {
+ return new InputSplit[0];
+ }
+
+ FileSplit fileSplit = fileSplits.get(0);
+
+ // Pre-process table-config to fetch virtual key info
+ Path partitionPath = fileSplit.getPath().getParent();
+ HoodieTableMetaClient metaClient = getTableMetaClientForBasePathUnchecked(conf, partitionPath);
+
+ Option<HoodieVirtualKeyInfo> hoodieVirtualKeyInfoOpt = getHoodieVirtualKeyInfo(metaClient);
+
+ // NOTE: This timeline is kept in sync w/ {@code HoodieTableFileIndexBase}
+ HoodieInstant latestCommitInstant =
+ metaClient.getActiveTimeline().getCommitsTimeline().filterCompletedInstants().lastInstant().get();
+
+ InputSplit[] finalSplits = fileSplits.stream()
+ .map(split -> {
+ // There are 4 types of splits could we have to handle here
+ // - {@code BootstrapBaseFileSplit}: in case base file does have associated bootstrap file,
+ // but does NOT have any log files appended (convert it to {@code RealtimeBootstrapBaseFileSplit})
+ // - {@code RealtimeBootstrapBaseFileSplit}: in case base file does have associated bootstrap file
+ // and does have log files appended
+ // - {@code BaseFileWithLogsSplit}: in case base file does NOT have associated bootstrap file
+ // and does have log files appended;
+ // - {@code FileSplit}: in case Hive passed down non-Hudi path
+ if (split instanceof RealtimeBootstrapBaseFileSplit) {
+ return split;
+ } else if (split instanceof BootstrapBaseFileSplit) {
+ BootstrapBaseFileSplit bootstrapBaseFileSplit = unsafeCast(split);
+ return createRealtimeBoostrapBaseFileSplit(
+ bootstrapBaseFileSplit,
+ metaClient.getBasePath(),
+ Collections.emptyList(),
+ latestCommitInstant.getTimestamp(),
+ false);
+ } else if (split instanceof BaseFileWithLogsSplit) {
+ BaseFileWithLogsSplit baseFileWithLogsSplit = unsafeCast(split);
Review comment:
Yes, it's in sync. However, you brought up a very good point that the instant shouldn't actually be set here. This will be cleaned up in subsequent PRs where `HoodieRealtimeFileSplit` will be merged with `BaseWithLogFilesSplit`
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #4556: [HUDI-3191][Stacked on 4531] Removing duplicating file-listing process w/in Hive's MOR `FIleInputFormat`s
Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #4556:
URL: https://github.com/apache/hudi/pull/4556#issuecomment-1009529185
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "d87786af43a7aeba7549cc3cfcbd97fc312bee0e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5074",
"triggerID" : "d87786af43a7aeba7549cc3cfcbd97fc312bee0e",
"triggerType" : "PUSH"
}, {
"hash" : "4b87ba1474be575ec27109ccbe626e4c2fc9c224",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5077",
"triggerID" : "4b87ba1474be575ec27109ccbe626e4c2fc9c224",
"triggerType" : "PUSH"
}, {
"hash" : "77d11131baabd1c4e3cc2050337daca4df5f6427",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "77d11131baabd1c4e3cc2050337daca4df5f6427",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 4b87ba1474be575ec27109ccbe626e4c2fc9c224 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5077)
* 77d11131baabd1c4e3cc2050337daca4df5f6427 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #4556: [HUDI-3191][Stacked on 4531] Removing duplicating file-listing process w/in Hive's MOR `FIleInputFormat`s
Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #4556:
URL: https://github.com/apache/hudi/pull/4556#issuecomment-1013554187
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "d87786af43a7aeba7549cc3cfcbd97fc312bee0e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5074",
"triggerID" : "d87786af43a7aeba7549cc3cfcbd97fc312bee0e",
"triggerType" : "PUSH"
}, {
"hash" : "4b87ba1474be575ec27109ccbe626e4c2fc9c224",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5077",
"triggerID" : "4b87ba1474be575ec27109ccbe626e4c2fc9c224",
"triggerType" : "PUSH"
}, {
"hash" : "77d11131baabd1c4e3cc2050337daca4df5f6427",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "77d11131baabd1c4e3cc2050337daca4df5f6427",
"triggerType" : "PUSH"
}, {
"hash" : "3d9c2ae28da858d1e8476052c99391015effb7db",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "3d9c2ae28da858d1e8476052c99391015effb7db",
"triggerType" : "PUSH"
}, {
"hash" : "79ac9affcb7f81497e0df755c8200638d35b02b7",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5081",
"triggerID" : "79ac9affcb7f81497e0df755c8200638d35b02b7",
"triggerType" : "PUSH"
}, {
"hash" : "3c14bbe6c6bcf49c4164c45e82f77b473f4de396",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5113",
"triggerID" : "3c14bbe6c6bcf49c4164c45e82f77b473f4de396",
"triggerType" : "PUSH"
}, {
"hash" : "276f13d6efd00b301b232b286d585729c9d1d26e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5116",
"triggerID" : "276f13d6efd00b301b232b286d585729c9d1d26e",
"triggerType" : "PUSH"
}, {
"hash" : "31b0669d7b638bd65a17b22a2ceb772f2627512c",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "31b0669d7b638bd65a17b22a2ceb772f2627512c",
"triggerType" : "PUSH"
}, {
"hash" : "096e26af39a477ffccbee0edd764493e12e15e71",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5124",
"triggerID" : "096e26af39a477ffccbee0edd764493e12e15e71",
"triggerType" : "PUSH"
}, {
"hash" : "97dd5ec7c9246f6d9f467b9076b790dd6017c5b4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5213",
"triggerID" : "97dd5ec7c9246f6d9f467b9076b790dd6017c5b4",
"triggerType" : "PUSH"
}, {
"hash" : "0538475fe488089c4cb3bc0afb63c2f518329969",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5257",
"triggerID" : "0538475fe488089c4cb3bc0afb63c2f518329969",
"triggerType" : "PUSH"
}, {
"hash" : "9f4b334e340fb26004e1b07fc8fbaaa047c76775",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5261",
"triggerID" : "9f4b334e340fb26004e1b07fc8fbaaa047c76775",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 77d11131baabd1c4e3cc2050337daca4df5f6427 UNKNOWN
* 3d9c2ae28da858d1e8476052c99391015effb7db UNKNOWN
* 31b0669d7b638bd65a17b22a2ceb772f2627512c UNKNOWN
* 0538475fe488089c4cb3bc0afb63c2f518329969 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5257)
* 9f4b334e340fb26004e1b07fc8fbaaa047c76775 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5261)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #4556: [HUDI-3191][Stacked on 4531] Removing duplicating file-listing process w/in Hive's MOR `FIleInputFormat`s
Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #4556:
URL: https://github.com/apache/hudi/pull/4556#issuecomment-1010567369
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "d87786af43a7aeba7549cc3cfcbd97fc312bee0e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5074",
"triggerID" : "d87786af43a7aeba7549cc3cfcbd97fc312bee0e",
"triggerType" : "PUSH"
}, {
"hash" : "4b87ba1474be575ec27109ccbe626e4c2fc9c224",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5077",
"triggerID" : "4b87ba1474be575ec27109ccbe626e4c2fc9c224",
"triggerType" : "PUSH"
}, {
"hash" : "77d11131baabd1c4e3cc2050337daca4df5f6427",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "77d11131baabd1c4e3cc2050337daca4df5f6427",
"triggerType" : "PUSH"
}, {
"hash" : "3d9c2ae28da858d1e8476052c99391015effb7db",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "3d9c2ae28da858d1e8476052c99391015effb7db",
"triggerType" : "PUSH"
}, {
"hash" : "79ac9affcb7f81497e0df755c8200638d35b02b7",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5081",
"triggerID" : "79ac9affcb7f81497e0df755c8200638d35b02b7",
"triggerType" : "PUSH"
}, {
"hash" : "3c14bbe6c6bcf49c4164c45e82f77b473f4de396",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5113",
"triggerID" : "3c14bbe6c6bcf49c4164c45e82f77b473f4de396",
"triggerType" : "PUSH"
}, {
"hash" : "276f13d6efd00b301b232b286d585729c9d1d26e",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5116",
"triggerID" : "276f13d6efd00b301b232b286d585729c9d1d26e",
"triggerType" : "PUSH"
}, {
"hash" : "31b0669d7b638bd65a17b22a2ceb772f2627512c",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "31b0669d7b638bd65a17b22a2ceb772f2627512c",
"triggerType" : "PUSH"
}, {
"hash" : "096e26af39a477ffccbee0edd764493e12e15e71",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5124",
"triggerID" : "096e26af39a477ffccbee0edd764493e12e15e71",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 77d11131baabd1c4e3cc2050337daca4df5f6427 UNKNOWN
* 3d9c2ae28da858d1e8476052c99391015effb7db UNKNOWN
* 276f13d6efd00b301b232b286d585729c9d1d26e Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5116)
* 31b0669d7b638bd65a17b22a2ceb772f2627512c UNKNOWN
* 096e26af39a477ffccbee0edd764493e12e15e71 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5124)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #4556: [HUDI-3191][Stacked on 4531] Removing duplicating file-listing process w/in Hive's MOR `FIleInputFormat`s
Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #4556:
URL: https://github.com/apache/hudi/pull/4556#issuecomment-1010551217
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "d87786af43a7aeba7549cc3cfcbd97fc312bee0e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5074",
"triggerID" : "d87786af43a7aeba7549cc3cfcbd97fc312bee0e",
"triggerType" : "PUSH"
}, {
"hash" : "4b87ba1474be575ec27109ccbe626e4c2fc9c224",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5077",
"triggerID" : "4b87ba1474be575ec27109ccbe626e4c2fc9c224",
"triggerType" : "PUSH"
}, {
"hash" : "77d11131baabd1c4e3cc2050337daca4df5f6427",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "77d11131baabd1c4e3cc2050337daca4df5f6427",
"triggerType" : "PUSH"
}, {
"hash" : "3d9c2ae28da858d1e8476052c99391015effb7db",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "3d9c2ae28da858d1e8476052c99391015effb7db",
"triggerType" : "PUSH"
}, {
"hash" : "79ac9affcb7f81497e0df755c8200638d35b02b7",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5081",
"triggerID" : "79ac9affcb7f81497e0df755c8200638d35b02b7",
"triggerType" : "PUSH"
}, {
"hash" : "3c14bbe6c6bcf49c4164c45e82f77b473f4de396",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5113",
"triggerID" : "3c14bbe6c6bcf49c4164c45e82f77b473f4de396",
"triggerType" : "PUSH"
}, {
"hash" : "276f13d6efd00b301b232b286d585729c9d1d26e",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5116",
"triggerID" : "276f13d6efd00b301b232b286d585729c9d1d26e",
"triggerType" : "PUSH"
}, {
"hash" : "31b0669d7b638bd65a17b22a2ceb772f2627512c",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "31b0669d7b638bd65a17b22a2ceb772f2627512c",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 77d11131baabd1c4e3cc2050337daca4df5f6427 UNKNOWN
* 3d9c2ae28da858d1e8476052c99391015effb7db UNKNOWN
* 276f13d6efd00b301b232b286d585729c9d1d26e Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5116)
* 31b0669d7b638bd65a17b22a2ceb772f2627512c UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #4556: [HUDI-3191][Stacked on 4531] Removing duplicating file-listing process w/in Hive's MOR `FIleInputFormat`s
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #4556:
URL: https://github.com/apache/hudi/pull/4556#issuecomment-1012735569
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "d87786af43a7aeba7549cc3cfcbd97fc312bee0e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5074",
"triggerID" : "d87786af43a7aeba7549cc3cfcbd97fc312bee0e",
"triggerType" : "PUSH"
}, {
"hash" : "4b87ba1474be575ec27109ccbe626e4c2fc9c224",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5077",
"triggerID" : "4b87ba1474be575ec27109ccbe626e4c2fc9c224",
"triggerType" : "PUSH"
}, {
"hash" : "77d11131baabd1c4e3cc2050337daca4df5f6427",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "77d11131baabd1c4e3cc2050337daca4df5f6427",
"triggerType" : "PUSH"
}, {
"hash" : "3d9c2ae28da858d1e8476052c99391015effb7db",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "3d9c2ae28da858d1e8476052c99391015effb7db",
"triggerType" : "PUSH"
}, {
"hash" : "79ac9affcb7f81497e0df755c8200638d35b02b7",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5081",
"triggerID" : "79ac9affcb7f81497e0df755c8200638d35b02b7",
"triggerType" : "PUSH"
}, {
"hash" : "3c14bbe6c6bcf49c4164c45e82f77b473f4de396",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5113",
"triggerID" : "3c14bbe6c6bcf49c4164c45e82f77b473f4de396",
"triggerType" : "PUSH"
}, {
"hash" : "276f13d6efd00b301b232b286d585729c9d1d26e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5116",
"triggerID" : "276f13d6efd00b301b232b286d585729c9d1d26e",
"triggerType" : "PUSH"
}, {
"hash" : "31b0669d7b638bd65a17b22a2ceb772f2627512c",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "31b0669d7b638bd65a17b22a2ceb772f2627512c",
"triggerType" : "PUSH"
}, {
"hash" : "096e26af39a477ffccbee0edd764493e12e15e71",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5124",
"triggerID" : "096e26af39a477ffccbee0edd764493e12e15e71",
"triggerType" : "PUSH"
}, {
"hash" : "97dd5ec7c9246f6d9f467b9076b790dd6017c5b4",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5213",
"triggerID" : "97dd5ec7c9246f6d9f467b9076b790dd6017c5b4",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 77d11131baabd1c4e3cc2050337daca4df5f6427 UNKNOWN
* 3d9c2ae28da858d1e8476052c99391015effb7db UNKNOWN
* 31b0669d7b638bd65a17b22a2ceb772f2627512c UNKNOWN
* 97dd5ec7c9246f6d9f467b9076b790dd6017c5b4 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5213)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #4556: [HUDI-3191][Stacked on 4531] Removing duplicating file-listing process w/in Hive's MOR `FIleInputFormat`s
Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #4556:
URL: https://github.com/apache/hudi/pull/4556#issuecomment-1013378615
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "d87786af43a7aeba7549cc3cfcbd97fc312bee0e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5074",
"triggerID" : "d87786af43a7aeba7549cc3cfcbd97fc312bee0e",
"triggerType" : "PUSH"
}, {
"hash" : "4b87ba1474be575ec27109ccbe626e4c2fc9c224",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5077",
"triggerID" : "4b87ba1474be575ec27109ccbe626e4c2fc9c224",
"triggerType" : "PUSH"
}, {
"hash" : "77d11131baabd1c4e3cc2050337daca4df5f6427",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "77d11131baabd1c4e3cc2050337daca4df5f6427",
"triggerType" : "PUSH"
}, {
"hash" : "3d9c2ae28da858d1e8476052c99391015effb7db",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "3d9c2ae28da858d1e8476052c99391015effb7db",
"triggerType" : "PUSH"
}, {
"hash" : "79ac9affcb7f81497e0df755c8200638d35b02b7",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5081",
"triggerID" : "79ac9affcb7f81497e0df755c8200638d35b02b7",
"triggerType" : "PUSH"
}, {
"hash" : "3c14bbe6c6bcf49c4164c45e82f77b473f4de396",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5113",
"triggerID" : "3c14bbe6c6bcf49c4164c45e82f77b473f4de396",
"triggerType" : "PUSH"
}, {
"hash" : "276f13d6efd00b301b232b286d585729c9d1d26e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5116",
"triggerID" : "276f13d6efd00b301b232b286d585729c9d1d26e",
"triggerType" : "PUSH"
}, {
"hash" : "31b0669d7b638bd65a17b22a2ceb772f2627512c",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "31b0669d7b638bd65a17b22a2ceb772f2627512c",
"triggerType" : "PUSH"
}, {
"hash" : "096e26af39a477ffccbee0edd764493e12e15e71",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5124",
"triggerID" : "096e26af39a477ffccbee0edd764493e12e15e71",
"triggerType" : "PUSH"
}, {
"hash" : "97dd5ec7c9246f6d9f467b9076b790dd6017c5b4",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5213",
"triggerID" : "97dd5ec7c9246f6d9f467b9076b790dd6017c5b4",
"triggerType" : "PUSH"
}, {
"hash" : "0538475fe488089c4cb3bc0afb63c2f518329969",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "0538475fe488089c4cb3bc0afb63c2f518329969",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 77d11131baabd1c4e3cc2050337daca4df5f6427 UNKNOWN
* 3d9c2ae28da858d1e8476052c99391015effb7db UNKNOWN
* 31b0669d7b638bd65a17b22a2ceb772f2627512c UNKNOWN
* 97dd5ec7c9246f6d9f467b9076b790dd6017c5b4 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5213)
* 0538475fe488089c4cb3bc0afb63c2f518329969 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #4556: [HUDI-3191] Removing duplicating file-listing process w/in Hive's MOR `FIleInputFormat`s
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #4556:
URL: https://github.com/apache/hudi/pull/4556#issuecomment-1017978413
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "d87786af43a7aeba7549cc3cfcbd97fc312bee0e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5074",
"triggerID" : "d87786af43a7aeba7549cc3cfcbd97fc312bee0e",
"triggerType" : "PUSH"
}, {
"hash" : "4b87ba1474be575ec27109ccbe626e4c2fc9c224",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5077",
"triggerID" : "4b87ba1474be575ec27109ccbe626e4c2fc9c224",
"triggerType" : "PUSH"
}, {
"hash" : "77d11131baabd1c4e3cc2050337daca4df5f6427",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "77d11131baabd1c4e3cc2050337daca4df5f6427",
"triggerType" : "PUSH"
}, {
"hash" : "3d9c2ae28da858d1e8476052c99391015effb7db",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "3d9c2ae28da858d1e8476052c99391015effb7db",
"triggerType" : "PUSH"
}, {
"hash" : "79ac9affcb7f81497e0df755c8200638d35b02b7",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5081",
"triggerID" : "79ac9affcb7f81497e0df755c8200638d35b02b7",
"triggerType" : "PUSH"
}, {
"hash" : "3c14bbe6c6bcf49c4164c45e82f77b473f4de396",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5113",
"triggerID" : "3c14bbe6c6bcf49c4164c45e82f77b473f4de396",
"triggerType" : "PUSH"
}, {
"hash" : "276f13d6efd00b301b232b286d585729c9d1d26e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5116",
"triggerID" : "276f13d6efd00b301b232b286d585729c9d1d26e",
"triggerType" : "PUSH"
}, {
"hash" : "31b0669d7b638bd65a17b22a2ceb772f2627512c",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "31b0669d7b638bd65a17b22a2ceb772f2627512c",
"triggerType" : "PUSH"
}, {
"hash" : "096e26af39a477ffccbee0edd764493e12e15e71",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5124",
"triggerID" : "096e26af39a477ffccbee0edd764493e12e15e71",
"triggerType" : "PUSH"
}, {
"hash" : "97dd5ec7c9246f6d9f467b9076b790dd6017c5b4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5213",
"triggerID" : "97dd5ec7c9246f6d9f467b9076b790dd6017c5b4",
"triggerType" : "PUSH"
}, {
"hash" : "0538475fe488089c4cb3bc0afb63c2f518329969",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5257",
"triggerID" : "0538475fe488089c4cb3bc0afb63c2f518329969",
"triggerType" : "PUSH"
}, {
"hash" : "9f4b334e340fb26004e1b07fc8fbaaa047c76775",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5261",
"triggerID" : "9f4b334e340fb26004e1b07fc8fbaaa047c76775",
"triggerType" : "PUSH"
}, {
"hash" : "368c099820c3cbf57496d0e46d1858aa8eb153ee",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5330",
"triggerID" : "368c099820c3cbf57496d0e46d1858aa8eb153ee",
"triggerType" : "PUSH"
}, {
"hash" : "28a5a4f537544d35dfcd8700a7b97fb7216682ce",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "28a5a4f537544d35dfcd8700a7b97fb7216682ce",
"triggerType" : "PUSH"
}, {
"hash" : "08ffdd8b47d147c9b5c889a5f56e39b9b140612d",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5351",
"triggerID" : "08ffdd8b47d147c9b5c889a5f56e39b9b140612d",
"triggerType" : "PUSH"
}, {
"hash" : "c09e228f7cce78a7dbbc394e93b3cf8c6c3d4d5f",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "c09e228f7cce78a7dbbc394e93b3cf8c6c3d4d5f",
"triggerType" : "PUSH"
}, {
"hash" : "8dadbf672d4d27505592f18bc89422fd7c013669",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5398",
"triggerID" : "8dadbf672d4d27505592f18bc89422fd7c013669",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 77d11131baabd1c4e3cc2050337daca4df5f6427 UNKNOWN
* 3d9c2ae28da858d1e8476052c99391015effb7db UNKNOWN
* 31b0669d7b638bd65a17b22a2ceb772f2627512c UNKNOWN
* 28a5a4f537544d35dfcd8700a7b97fb7216682ce UNKNOWN
* 08ffdd8b47d147c9b5c889a5f56e39b9b140612d Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5351)
* c09e228f7cce78a7dbbc394e93b3cf8c6c3d4d5f UNKNOWN
* 8dadbf672d4d27505592f18bc89422fd7c013669 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5398)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #4556: [HUDI-3191] Removing duplicating file-listing process w/in Hive's MOR `FIleInputFormat`s
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #4556:
URL: https://github.com/apache/hudi/pull/4556#issuecomment-1017976303
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "d87786af43a7aeba7549cc3cfcbd97fc312bee0e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5074",
"triggerID" : "d87786af43a7aeba7549cc3cfcbd97fc312bee0e",
"triggerType" : "PUSH"
}, {
"hash" : "4b87ba1474be575ec27109ccbe626e4c2fc9c224",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5077",
"triggerID" : "4b87ba1474be575ec27109ccbe626e4c2fc9c224",
"triggerType" : "PUSH"
}, {
"hash" : "77d11131baabd1c4e3cc2050337daca4df5f6427",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "77d11131baabd1c4e3cc2050337daca4df5f6427",
"triggerType" : "PUSH"
}, {
"hash" : "3d9c2ae28da858d1e8476052c99391015effb7db",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "3d9c2ae28da858d1e8476052c99391015effb7db",
"triggerType" : "PUSH"
}, {
"hash" : "79ac9affcb7f81497e0df755c8200638d35b02b7",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5081",
"triggerID" : "79ac9affcb7f81497e0df755c8200638d35b02b7",
"triggerType" : "PUSH"
}, {
"hash" : "3c14bbe6c6bcf49c4164c45e82f77b473f4de396",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5113",
"triggerID" : "3c14bbe6c6bcf49c4164c45e82f77b473f4de396",
"triggerType" : "PUSH"
}, {
"hash" : "276f13d6efd00b301b232b286d585729c9d1d26e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5116",
"triggerID" : "276f13d6efd00b301b232b286d585729c9d1d26e",
"triggerType" : "PUSH"
}, {
"hash" : "31b0669d7b638bd65a17b22a2ceb772f2627512c",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "31b0669d7b638bd65a17b22a2ceb772f2627512c",
"triggerType" : "PUSH"
}, {
"hash" : "096e26af39a477ffccbee0edd764493e12e15e71",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5124",
"triggerID" : "096e26af39a477ffccbee0edd764493e12e15e71",
"triggerType" : "PUSH"
}, {
"hash" : "97dd5ec7c9246f6d9f467b9076b790dd6017c5b4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5213",
"triggerID" : "97dd5ec7c9246f6d9f467b9076b790dd6017c5b4",
"triggerType" : "PUSH"
}, {
"hash" : "0538475fe488089c4cb3bc0afb63c2f518329969",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5257",
"triggerID" : "0538475fe488089c4cb3bc0afb63c2f518329969",
"triggerType" : "PUSH"
}, {
"hash" : "9f4b334e340fb26004e1b07fc8fbaaa047c76775",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5261",
"triggerID" : "9f4b334e340fb26004e1b07fc8fbaaa047c76775",
"triggerType" : "PUSH"
}, {
"hash" : "368c099820c3cbf57496d0e46d1858aa8eb153ee",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5330",
"triggerID" : "368c099820c3cbf57496d0e46d1858aa8eb153ee",
"triggerType" : "PUSH"
}, {
"hash" : "28a5a4f537544d35dfcd8700a7b97fb7216682ce",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "28a5a4f537544d35dfcd8700a7b97fb7216682ce",
"triggerType" : "PUSH"
}, {
"hash" : "08ffdd8b47d147c9b5c889a5f56e39b9b140612d",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5351",
"triggerID" : "08ffdd8b47d147c9b5c889a5f56e39b9b140612d",
"triggerType" : "PUSH"
}, {
"hash" : "c09e228f7cce78a7dbbc394e93b3cf8c6c3d4d5f",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "c09e228f7cce78a7dbbc394e93b3cf8c6c3d4d5f",
"triggerType" : "PUSH"
}, {
"hash" : "8dadbf672d4d27505592f18bc89422fd7c013669",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "8dadbf672d4d27505592f18bc89422fd7c013669",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 77d11131baabd1c4e3cc2050337daca4df5f6427 UNKNOWN
* 3d9c2ae28da858d1e8476052c99391015effb7db UNKNOWN
* 31b0669d7b638bd65a17b22a2ceb772f2627512c UNKNOWN
* 28a5a4f537544d35dfcd8700a7b97fb7216682ce UNKNOWN
* 08ffdd8b47d147c9b5c889a5f56e39b9b140612d Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5351)
* c09e228f7cce78a7dbbc394e93b3cf8c6c3d4d5f UNKNOWN
* 8dadbf672d4d27505592f18bc89422fd7c013669 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #4556: [HUDI-3191][Stacked on 4531] Removing duplicating file-listing process w/in Hive's MOR `FIleInputFormat`s
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #4556:
URL: https://github.com/apache/hudi/pull/4556#issuecomment-1015812000
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "d87786af43a7aeba7549cc3cfcbd97fc312bee0e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5074",
"triggerID" : "d87786af43a7aeba7549cc3cfcbd97fc312bee0e",
"triggerType" : "PUSH"
}, {
"hash" : "4b87ba1474be575ec27109ccbe626e4c2fc9c224",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5077",
"triggerID" : "4b87ba1474be575ec27109ccbe626e4c2fc9c224",
"triggerType" : "PUSH"
}, {
"hash" : "77d11131baabd1c4e3cc2050337daca4df5f6427",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "77d11131baabd1c4e3cc2050337daca4df5f6427",
"triggerType" : "PUSH"
}, {
"hash" : "3d9c2ae28da858d1e8476052c99391015effb7db",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "3d9c2ae28da858d1e8476052c99391015effb7db",
"triggerType" : "PUSH"
}, {
"hash" : "79ac9affcb7f81497e0df755c8200638d35b02b7",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5081",
"triggerID" : "79ac9affcb7f81497e0df755c8200638d35b02b7",
"triggerType" : "PUSH"
}, {
"hash" : "3c14bbe6c6bcf49c4164c45e82f77b473f4de396",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5113",
"triggerID" : "3c14bbe6c6bcf49c4164c45e82f77b473f4de396",
"triggerType" : "PUSH"
}, {
"hash" : "276f13d6efd00b301b232b286d585729c9d1d26e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5116",
"triggerID" : "276f13d6efd00b301b232b286d585729c9d1d26e",
"triggerType" : "PUSH"
}, {
"hash" : "31b0669d7b638bd65a17b22a2ceb772f2627512c",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "31b0669d7b638bd65a17b22a2ceb772f2627512c",
"triggerType" : "PUSH"
}, {
"hash" : "096e26af39a477ffccbee0edd764493e12e15e71",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5124",
"triggerID" : "096e26af39a477ffccbee0edd764493e12e15e71",
"triggerType" : "PUSH"
}, {
"hash" : "97dd5ec7c9246f6d9f467b9076b790dd6017c5b4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5213",
"triggerID" : "97dd5ec7c9246f6d9f467b9076b790dd6017c5b4",
"triggerType" : "PUSH"
}, {
"hash" : "0538475fe488089c4cb3bc0afb63c2f518329969",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5257",
"triggerID" : "0538475fe488089c4cb3bc0afb63c2f518329969",
"triggerType" : "PUSH"
}, {
"hash" : "9f4b334e340fb26004e1b07fc8fbaaa047c76775",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5261",
"triggerID" : "9f4b334e340fb26004e1b07fc8fbaaa047c76775",
"triggerType" : "PUSH"
}, {
"hash" : "368c099820c3cbf57496d0e46d1858aa8eb153ee",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5330",
"triggerID" : "368c099820c3cbf57496d0e46d1858aa8eb153ee",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 77d11131baabd1c4e3cc2050337daca4df5f6427 UNKNOWN
* 3d9c2ae28da858d1e8476052c99391015effb7db UNKNOWN
* 31b0669d7b638bd65a17b22a2ceb772f2627512c UNKNOWN
* 9f4b334e340fb26004e1b07fc8fbaaa047c76775 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5261)
* 368c099820c3cbf57496d0e46d1858aa8eb153ee Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5330)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #4556: [HUDI-3191] Removing duplicating file-listing process w/in Hive's MOR `FIleInputFormat`s
Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #4556:
URL: https://github.com/apache/hudi/pull/4556#issuecomment-1015856152
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "d87786af43a7aeba7549cc3cfcbd97fc312bee0e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5074",
"triggerID" : "d87786af43a7aeba7549cc3cfcbd97fc312bee0e",
"triggerType" : "PUSH"
}, {
"hash" : "4b87ba1474be575ec27109ccbe626e4c2fc9c224",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5077",
"triggerID" : "4b87ba1474be575ec27109ccbe626e4c2fc9c224",
"triggerType" : "PUSH"
}, {
"hash" : "77d11131baabd1c4e3cc2050337daca4df5f6427",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "77d11131baabd1c4e3cc2050337daca4df5f6427",
"triggerType" : "PUSH"
}, {
"hash" : "3d9c2ae28da858d1e8476052c99391015effb7db",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "3d9c2ae28da858d1e8476052c99391015effb7db",
"triggerType" : "PUSH"
}, {
"hash" : "79ac9affcb7f81497e0df755c8200638d35b02b7",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5081",
"triggerID" : "79ac9affcb7f81497e0df755c8200638d35b02b7",
"triggerType" : "PUSH"
}, {
"hash" : "3c14bbe6c6bcf49c4164c45e82f77b473f4de396",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5113",
"triggerID" : "3c14bbe6c6bcf49c4164c45e82f77b473f4de396",
"triggerType" : "PUSH"
}, {
"hash" : "276f13d6efd00b301b232b286d585729c9d1d26e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5116",
"triggerID" : "276f13d6efd00b301b232b286d585729c9d1d26e",
"triggerType" : "PUSH"
}, {
"hash" : "31b0669d7b638bd65a17b22a2ceb772f2627512c",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "31b0669d7b638bd65a17b22a2ceb772f2627512c",
"triggerType" : "PUSH"
}, {
"hash" : "096e26af39a477ffccbee0edd764493e12e15e71",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5124",
"triggerID" : "096e26af39a477ffccbee0edd764493e12e15e71",
"triggerType" : "PUSH"
}, {
"hash" : "97dd5ec7c9246f6d9f467b9076b790dd6017c5b4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5213",
"triggerID" : "97dd5ec7c9246f6d9f467b9076b790dd6017c5b4",
"triggerType" : "PUSH"
}, {
"hash" : "0538475fe488089c4cb3bc0afb63c2f518329969",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5257",
"triggerID" : "0538475fe488089c4cb3bc0afb63c2f518329969",
"triggerType" : "PUSH"
}, {
"hash" : "9f4b334e340fb26004e1b07fc8fbaaa047c76775",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5261",
"triggerID" : "9f4b334e340fb26004e1b07fc8fbaaa047c76775",
"triggerType" : "PUSH"
}, {
"hash" : "368c099820c3cbf57496d0e46d1858aa8eb153ee",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5330",
"triggerID" : "368c099820c3cbf57496d0e46d1858aa8eb153ee",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 77d11131baabd1c4e3cc2050337daca4df5f6427 UNKNOWN
* 3d9c2ae28da858d1e8476052c99391015effb7db UNKNOWN
* 31b0669d7b638bd65a17b22a2ceb772f2627512c UNKNOWN
* 368c099820c3cbf57496d0e46d1858aa8eb153ee Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5330)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] yihua commented on a change in pull request #4556: [HUDI-3191] Removing duplicating file-listing process w/in Hive's MOR `FileInputFormat`s
Posted by GitBox <gi...@apache.org>.
yihua commented on a change in pull request #4556:
URL: https://github.com/apache/hudi/pull/4556#discussion_r791314687
##########
File path: hudi-hadoop-mr/src/main/java/org/apache/hudi/hadoop/HoodieFileInputFormatBase.java
##########
@@ -187,13 +286,28 @@ private static FileStatus getFileStatusUnchecked(Option<HoodieBaseFile> baseFile
.map(fileSlice -> {
Option<HoodieBaseFile> baseFileOpt = fileSlice.getBaseFile();
Option<HoodieLogFile> latestLogFileOpt = fileSlice.getLatestLogFile();
- if (baseFileOpt.isPresent()) {
- return getFileStatusUnchecked(baseFileOpt);
- } else if (includeLogFilesForSnapShotView() && latestLogFileOpt.isPresent()) {
- return createRealtimeFileStatusUnchecked(latestLogFileOpt.get(), fileSlice.getLogFiles());
+ Stream<HoodieLogFile> logFiles = fileSlice.getLogFiles();
+
+ Option<HoodieInstant> latestCompletedInstantOpt =
+ fromScala(fileIndex.latestCompletedInstant());
+
+ // Check if we're reading a MOR table
+ if (includeLogFilesForSnapshotView()) {
+ if (baseFileOpt.isPresent()) {
+ return createRealtimeFileStatusUnchecked(baseFileOpt.get(), logFiles, latestCompletedInstantOpt, tableMetaClient);
+ } else if (latestLogFileOpt.isPresent()) {
+ return createRealtimeFileStatusUnchecked(latestLogFileOpt.get(), logFiles, latestCompletedInstantOpt, tableMetaClient);
+ } else {
+ throw new IllegalStateException("Invalid state: either base-file or log-file has to be present");
+ }
} else {
- throw new IllegalStateException("Invalid state: either base-file or log-file should be present");
+ if (baseFileOpt.isPresent()) {
+ return getFileStatusUnchecked(baseFileOpt.get());
+ } else {
+ throw new IllegalStateException("Invalid state: base-file has to be present");
+ }
}
Review comment:
It looks like the logic is changed here to cover broader cases, especially when both base file and log files exist. Basically, if base file exists, log files are ignored before. However, for Snapshot mode, should log files be ignored by default? Or do you intend to use this method `listStatusForSnapshotMode()` broadly for different query mode (renaming it if true)?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #4556: [HUDI-3191][Stacked on 4716] Removing duplicating file-listing process w/in Hive's MOR `FileInputFormat`s
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #4556:
URL: https://github.com/apache/hudi/pull/4556#issuecomment-1024801588
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "d87786af43a7aeba7549cc3cfcbd97fc312bee0e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5074",
"triggerID" : "d87786af43a7aeba7549cc3cfcbd97fc312bee0e",
"triggerType" : "PUSH"
}, {
"hash" : "4b87ba1474be575ec27109ccbe626e4c2fc9c224",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5077",
"triggerID" : "4b87ba1474be575ec27109ccbe626e4c2fc9c224",
"triggerType" : "PUSH"
}, {
"hash" : "77d11131baabd1c4e3cc2050337daca4df5f6427",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "77d11131baabd1c4e3cc2050337daca4df5f6427",
"triggerType" : "PUSH"
}, {
"hash" : "3d9c2ae28da858d1e8476052c99391015effb7db",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "3d9c2ae28da858d1e8476052c99391015effb7db",
"triggerType" : "PUSH"
}, {
"hash" : "79ac9affcb7f81497e0df755c8200638d35b02b7",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5081",
"triggerID" : "79ac9affcb7f81497e0df755c8200638d35b02b7",
"triggerType" : "PUSH"
}, {
"hash" : "3c14bbe6c6bcf49c4164c45e82f77b473f4de396",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5113",
"triggerID" : "3c14bbe6c6bcf49c4164c45e82f77b473f4de396",
"triggerType" : "PUSH"
}, {
"hash" : "276f13d6efd00b301b232b286d585729c9d1d26e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5116",
"triggerID" : "276f13d6efd00b301b232b286d585729c9d1d26e",
"triggerType" : "PUSH"
}, {
"hash" : "31b0669d7b638bd65a17b22a2ceb772f2627512c",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "31b0669d7b638bd65a17b22a2ceb772f2627512c",
"triggerType" : "PUSH"
}, {
"hash" : "096e26af39a477ffccbee0edd764493e12e15e71",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5124",
"triggerID" : "096e26af39a477ffccbee0edd764493e12e15e71",
"triggerType" : "PUSH"
}, {
"hash" : "97dd5ec7c9246f6d9f467b9076b790dd6017c5b4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5213",
"triggerID" : "97dd5ec7c9246f6d9f467b9076b790dd6017c5b4",
"triggerType" : "PUSH"
}, {
"hash" : "0538475fe488089c4cb3bc0afb63c2f518329969",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5257",
"triggerID" : "0538475fe488089c4cb3bc0afb63c2f518329969",
"triggerType" : "PUSH"
}, {
"hash" : "9f4b334e340fb26004e1b07fc8fbaaa047c76775",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5261",
"triggerID" : "9f4b334e340fb26004e1b07fc8fbaaa047c76775",
"triggerType" : "PUSH"
}, {
"hash" : "368c099820c3cbf57496d0e46d1858aa8eb153ee",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5330",
"triggerID" : "368c099820c3cbf57496d0e46d1858aa8eb153ee",
"triggerType" : "PUSH"
}, {
"hash" : "28a5a4f537544d35dfcd8700a7b97fb7216682ce",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "28a5a4f537544d35dfcd8700a7b97fb7216682ce",
"triggerType" : "PUSH"
}, {
"hash" : "08ffdd8b47d147c9b5c889a5f56e39b9b140612d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5351",
"triggerID" : "08ffdd8b47d147c9b5c889a5f56e39b9b140612d",
"triggerType" : "PUSH"
}, {
"hash" : "c09e228f7cce78a7dbbc394e93b3cf8c6c3d4d5f",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "c09e228f7cce78a7dbbc394e93b3cf8c6c3d4d5f",
"triggerType" : "PUSH"
}, {
"hash" : "8dadbf672d4d27505592f18bc89422fd7c013669",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5398",
"triggerID" : "8dadbf672d4d27505592f18bc89422fd7c013669",
"triggerType" : "PUSH"
}, {
"hash" : "906607be5bd62ee1cbbda34acb6a89916c1f7aee",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5424",
"triggerID" : "906607be5bd62ee1cbbda34acb6a89916c1f7aee",
"triggerType" : "PUSH"
}, {
"hash" : "dc1b033f40cea9642f71b8fcff74aa82106726b6",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5484",
"triggerID" : "dc1b033f40cea9642f71b8fcff74aa82106726b6",
"triggerType" : "PUSH"
}, {
"hash" : "5b8f5819fff8fec34864eb409fd429b95be17b9b",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "5b8f5819fff8fec34864eb409fd429b95be17b9b",
"triggerType" : "PUSH"
}, {
"hash" : "13702fc2232ebd9300966b0a917a3358d8d0f18c",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "13702fc2232ebd9300966b0a917a3358d8d0f18c",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 77d11131baabd1c4e3cc2050337daca4df5f6427 UNKNOWN
* 3d9c2ae28da858d1e8476052c99391015effb7db UNKNOWN
* 31b0669d7b638bd65a17b22a2ceb772f2627512c UNKNOWN
* 28a5a4f537544d35dfcd8700a7b97fb7216682ce UNKNOWN
* c09e228f7cce78a7dbbc394e93b3cf8c6c3d4d5f UNKNOWN
* dc1b033f40cea9642f71b8fcff74aa82106726b6 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5484)
* 5b8f5819fff8fec34864eb409fd429b95be17b9b UNKNOWN
* 13702fc2232ebd9300966b0a917a3358d8d0f18c UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #4556: [HUDI-3191][Stacked on 4716] Removing duplicating file-listing process w/in Hive's MOR `FileInputFormat`s
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #4556:
URL: https://github.com/apache/hudi/pull/4556#issuecomment-1026277163
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "d87786af43a7aeba7549cc3cfcbd97fc312bee0e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5074",
"triggerID" : "d87786af43a7aeba7549cc3cfcbd97fc312bee0e",
"triggerType" : "PUSH"
}, {
"hash" : "4b87ba1474be575ec27109ccbe626e4c2fc9c224",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5077",
"triggerID" : "4b87ba1474be575ec27109ccbe626e4c2fc9c224",
"triggerType" : "PUSH"
}, {
"hash" : "77d11131baabd1c4e3cc2050337daca4df5f6427",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "77d11131baabd1c4e3cc2050337daca4df5f6427",
"triggerType" : "PUSH"
}, {
"hash" : "3d9c2ae28da858d1e8476052c99391015effb7db",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "3d9c2ae28da858d1e8476052c99391015effb7db",
"triggerType" : "PUSH"
}, {
"hash" : "79ac9affcb7f81497e0df755c8200638d35b02b7",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5081",
"triggerID" : "79ac9affcb7f81497e0df755c8200638d35b02b7",
"triggerType" : "PUSH"
}, {
"hash" : "3c14bbe6c6bcf49c4164c45e82f77b473f4de396",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5113",
"triggerID" : "3c14bbe6c6bcf49c4164c45e82f77b473f4de396",
"triggerType" : "PUSH"
}, {
"hash" : "276f13d6efd00b301b232b286d585729c9d1d26e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5116",
"triggerID" : "276f13d6efd00b301b232b286d585729c9d1d26e",
"triggerType" : "PUSH"
}, {
"hash" : "31b0669d7b638bd65a17b22a2ceb772f2627512c",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "31b0669d7b638bd65a17b22a2ceb772f2627512c",
"triggerType" : "PUSH"
}, {
"hash" : "096e26af39a477ffccbee0edd764493e12e15e71",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5124",
"triggerID" : "096e26af39a477ffccbee0edd764493e12e15e71",
"triggerType" : "PUSH"
}, {
"hash" : "97dd5ec7c9246f6d9f467b9076b790dd6017c5b4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5213",
"triggerID" : "97dd5ec7c9246f6d9f467b9076b790dd6017c5b4",
"triggerType" : "PUSH"
}, {
"hash" : "0538475fe488089c4cb3bc0afb63c2f518329969",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5257",
"triggerID" : "0538475fe488089c4cb3bc0afb63c2f518329969",
"triggerType" : "PUSH"
}, {
"hash" : "9f4b334e340fb26004e1b07fc8fbaaa047c76775",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5261",
"triggerID" : "9f4b334e340fb26004e1b07fc8fbaaa047c76775",
"triggerType" : "PUSH"
}, {
"hash" : "368c099820c3cbf57496d0e46d1858aa8eb153ee",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5330",
"triggerID" : "368c099820c3cbf57496d0e46d1858aa8eb153ee",
"triggerType" : "PUSH"
}, {
"hash" : "28a5a4f537544d35dfcd8700a7b97fb7216682ce",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "28a5a4f537544d35dfcd8700a7b97fb7216682ce",
"triggerType" : "PUSH"
}, {
"hash" : "08ffdd8b47d147c9b5c889a5f56e39b9b140612d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5351",
"triggerID" : "08ffdd8b47d147c9b5c889a5f56e39b9b140612d",
"triggerType" : "PUSH"
}, {
"hash" : "c09e228f7cce78a7dbbc394e93b3cf8c6c3d4d5f",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "c09e228f7cce78a7dbbc394e93b3cf8c6c3d4d5f",
"triggerType" : "PUSH"
}, {
"hash" : "8dadbf672d4d27505592f18bc89422fd7c013669",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5398",
"triggerID" : "8dadbf672d4d27505592f18bc89422fd7c013669",
"triggerType" : "PUSH"
}, {
"hash" : "906607be5bd62ee1cbbda34acb6a89916c1f7aee",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5424",
"triggerID" : "906607be5bd62ee1cbbda34acb6a89916c1f7aee",
"triggerType" : "PUSH"
}, {
"hash" : "dc1b033f40cea9642f71b8fcff74aa82106726b6",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5484",
"triggerID" : "dc1b033f40cea9642f71b8fcff74aa82106726b6",
"triggerType" : "PUSH"
}, {
"hash" : "5b8f5819fff8fec34864eb409fd429b95be17b9b",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "5b8f5819fff8fec34864eb409fd429b95be17b9b",
"triggerType" : "PUSH"
}, {
"hash" : "13702fc2232ebd9300966b0a917a3358d8d0f18c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5590",
"triggerID" : "13702fc2232ebd9300966b0a917a3358d8d0f18c",
"triggerType" : "PUSH"
}, {
"hash" : "13702fc2232ebd9300966b0a917a3358d8d0f18c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5600",
"triggerID" : "1024845655",
"triggerType" : "MANUAL"
}, {
"hash" : "9bdd8a60f95123f82a5f30f5e68929f5b7e1f8da",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5603",
"triggerID" : "9bdd8a60f95123f82a5f30f5e68929f5b7e1f8da",
"triggerType" : "PUSH"
}, {
"hash" : "aebb9df557c4afe3ca88f6b8b28ba2fbfdcbd597",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "aebb9df557c4afe3ca88f6b8b28ba2fbfdcbd597",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 77d11131baabd1c4e3cc2050337daca4df5f6427 UNKNOWN
* 3d9c2ae28da858d1e8476052c99391015effb7db UNKNOWN
* 31b0669d7b638bd65a17b22a2ceb772f2627512c UNKNOWN
* 28a5a4f537544d35dfcd8700a7b97fb7216682ce UNKNOWN
* c09e228f7cce78a7dbbc394e93b3cf8c6c3d4d5f UNKNOWN
* 5b8f5819fff8fec34864eb409fd429b95be17b9b UNKNOWN
* 9bdd8a60f95123f82a5f30f5e68929f5b7e1f8da Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5603)
* aebb9df557c4afe3ca88f6b8b28ba2fbfdcbd597 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #4556: [HUDI-3191][Stacked on 4716] Removing duplicating file-listing process w/in Hive's MOR `FileInputFormat`s
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #4556:
URL: https://github.com/apache/hudi/pull/4556#issuecomment-1027148203
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "d87786af43a7aeba7549cc3cfcbd97fc312bee0e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5074",
"triggerID" : "d87786af43a7aeba7549cc3cfcbd97fc312bee0e",
"triggerType" : "PUSH"
}, {
"hash" : "4b87ba1474be575ec27109ccbe626e4c2fc9c224",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5077",
"triggerID" : "4b87ba1474be575ec27109ccbe626e4c2fc9c224",
"triggerType" : "PUSH"
}, {
"hash" : "77d11131baabd1c4e3cc2050337daca4df5f6427",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "77d11131baabd1c4e3cc2050337daca4df5f6427",
"triggerType" : "PUSH"
}, {
"hash" : "3d9c2ae28da858d1e8476052c99391015effb7db",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "3d9c2ae28da858d1e8476052c99391015effb7db",
"triggerType" : "PUSH"
}, {
"hash" : "79ac9affcb7f81497e0df755c8200638d35b02b7",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5081",
"triggerID" : "79ac9affcb7f81497e0df755c8200638d35b02b7",
"triggerType" : "PUSH"
}, {
"hash" : "3c14bbe6c6bcf49c4164c45e82f77b473f4de396",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5113",
"triggerID" : "3c14bbe6c6bcf49c4164c45e82f77b473f4de396",
"triggerType" : "PUSH"
}, {
"hash" : "276f13d6efd00b301b232b286d585729c9d1d26e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5116",
"triggerID" : "276f13d6efd00b301b232b286d585729c9d1d26e",
"triggerType" : "PUSH"
}, {
"hash" : "31b0669d7b638bd65a17b22a2ceb772f2627512c",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "31b0669d7b638bd65a17b22a2ceb772f2627512c",
"triggerType" : "PUSH"
}, {
"hash" : "096e26af39a477ffccbee0edd764493e12e15e71",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5124",
"triggerID" : "096e26af39a477ffccbee0edd764493e12e15e71",
"triggerType" : "PUSH"
}, {
"hash" : "97dd5ec7c9246f6d9f467b9076b790dd6017c5b4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5213",
"triggerID" : "97dd5ec7c9246f6d9f467b9076b790dd6017c5b4",
"triggerType" : "PUSH"
}, {
"hash" : "0538475fe488089c4cb3bc0afb63c2f518329969",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5257",
"triggerID" : "0538475fe488089c4cb3bc0afb63c2f518329969",
"triggerType" : "PUSH"
}, {
"hash" : "9f4b334e340fb26004e1b07fc8fbaaa047c76775",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5261",
"triggerID" : "9f4b334e340fb26004e1b07fc8fbaaa047c76775",
"triggerType" : "PUSH"
}, {
"hash" : "368c099820c3cbf57496d0e46d1858aa8eb153ee",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5330",
"triggerID" : "368c099820c3cbf57496d0e46d1858aa8eb153ee",
"triggerType" : "PUSH"
}, {
"hash" : "28a5a4f537544d35dfcd8700a7b97fb7216682ce",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "28a5a4f537544d35dfcd8700a7b97fb7216682ce",
"triggerType" : "PUSH"
}, {
"hash" : "08ffdd8b47d147c9b5c889a5f56e39b9b140612d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5351",
"triggerID" : "08ffdd8b47d147c9b5c889a5f56e39b9b140612d",
"triggerType" : "PUSH"
}, {
"hash" : "c09e228f7cce78a7dbbc394e93b3cf8c6c3d4d5f",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "c09e228f7cce78a7dbbc394e93b3cf8c6c3d4d5f",
"triggerType" : "PUSH"
}, {
"hash" : "8dadbf672d4d27505592f18bc89422fd7c013669",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5398",
"triggerID" : "8dadbf672d4d27505592f18bc89422fd7c013669",
"triggerType" : "PUSH"
}, {
"hash" : "906607be5bd62ee1cbbda34acb6a89916c1f7aee",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5424",
"triggerID" : "906607be5bd62ee1cbbda34acb6a89916c1f7aee",
"triggerType" : "PUSH"
}, {
"hash" : "dc1b033f40cea9642f71b8fcff74aa82106726b6",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5484",
"triggerID" : "dc1b033f40cea9642f71b8fcff74aa82106726b6",
"triggerType" : "PUSH"
}, {
"hash" : "5b8f5819fff8fec34864eb409fd429b95be17b9b",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "5b8f5819fff8fec34864eb409fd429b95be17b9b",
"triggerType" : "PUSH"
}, {
"hash" : "13702fc2232ebd9300966b0a917a3358d8d0f18c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5590",
"triggerID" : "13702fc2232ebd9300966b0a917a3358d8d0f18c",
"triggerType" : "PUSH"
}, {
"hash" : "13702fc2232ebd9300966b0a917a3358d8d0f18c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5600",
"triggerID" : "1024845655",
"triggerType" : "MANUAL"
}, {
"hash" : "9bdd8a60f95123f82a5f30f5e68929f5b7e1f8da",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5603",
"triggerID" : "9bdd8a60f95123f82a5f30f5e68929f5b7e1f8da",
"triggerType" : "PUSH"
}, {
"hash" : "aebb9df557c4afe3ca88f6b8b28ba2fbfdcbd597",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5631",
"triggerID" : "aebb9df557c4afe3ca88f6b8b28ba2fbfdcbd597",
"triggerType" : "PUSH"
}, {
"hash" : "5d37935bc8bb33260735d782ca560fd59e02f321",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "5d37935bc8bb33260735d782ca560fd59e02f321",
"triggerType" : "PUSH"
}, {
"hash" : "f911d869f50009e5cd9f3fd341c83c732d7531ba",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5634",
"triggerID" : "f911d869f50009e5cd9f3fd341c83c732d7531ba",
"triggerType" : "PUSH"
}, {
"hash" : "f911d869f50009e5cd9f3fd341c83c732d7531ba",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5657",
"triggerID" : "1027051107",
"triggerType" : "MANUAL"
} ]
}-->
## CI report:
* 77d11131baabd1c4e3cc2050337daca4df5f6427 UNKNOWN
* 3d9c2ae28da858d1e8476052c99391015effb7db UNKNOWN
* 31b0669d7b638bd65a17b22a2ceb772f2627512c UNKNOWN
* 28a5a4f537544d35dfcd8700a7b97fb7216682ce UNKNOWN
* c09e228f7cce78a7dbbc394e93b3cf8c6c3d4d5f UNKNOWN
* 5b8f5819fff8fec34864eb409fd429b95be17b9b UNKNOWN
* 5d37935bc8bb33260735d782ca560fd59e02f321 UNKNOWN
* f911d869f50009e5cd9f3fd341c83c732d7531ba Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5634) Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5657)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] alexeykudinkin commented on pull request #4556: [HUDI-3191][Stacked on 4716] Removing duplicating file-listing process w/in Hive's MOR `FileInputFormat`s
Posted by GitBox <gi...@apache.org>.
alexeykudinkin commented on pull request #4556:
URL: https://github.com/apache/hudi/pull/4556#issuecomment-1027166086
@hudi-bot run azure
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #4556: [HUDI-3191] Removing duplicating file-listing process w/in Hive's MOR `FileInputFormat`s
Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #4556:
URL: https://github.com/apache/hudi/pull/4556#issuecomment-1028365326
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "d87786af43a7aeba7549cc3cfcbd97fc312bee0e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5074",
"triggerID" : "d87786af43a7aeba7549cc3cfcbd97fc312bee0e",
"triggerType" : "PUSH"
}, {
"hash" : "4b87ba1474be575ec27109ccbe626e4c2fc9c224",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5077",
"triggerID" : "4b87ba1474be575ec27109ccbe626e4c2fc9c224",
"triggerType" : "PUSH"
}, {
"hash" : "77d11131baabd1c4e3cc2050337daca4df5f6427",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "77d11131baabd1c4e3cc2050337daca4df5f6427",
"triggerType" : "PUSH"
}, {
"hash" : "3d9c2ae28da858d1e8476052c99391015effb7db",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "3d9c2ae28da858d1e8476052c99391015effb7db",
"triggerType" : "PUSH"
}, {
"hash" : "79ac9affcb7f81497e0df755c8200638d35b02b7",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5081",
"triggerID" : "79ac9affcb7f81497e0df755c8200638d35b02b7",
"triggerType" : "PUSH"
}, {
"hash" : "3c14bbe6c6bcf49c4164c45e82f77b473f4de396",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5113",
"triggerID" : "3c14bbe6c6bcf49c4164c45e82f77b473f4de396",
"triggerType" : "PUSH"
}, {
"hash" : "276f13d6efd00b301b232b286d585729c9d1d26e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5116",
"triggerID" : "276f13d6efd00b301b232b286d585729c9d1d26e",
"triggerType" : "PUSH"
}, {
"hash" : "31b0669d7b638bd65a17b22a2ceb772f2627512c",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "31b0669d7b638bd65a17b22a2ceb772f2627512c",
"triggerType" : "PUSH"
}, {
"hash" : "096e26af39a477ffccbee0edd764493e12e15e71",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5124",
"triggerID" : "096e26af39a477ffccbee0edd764493e12e15e71",
"triggerType" : "PUSH"
}, {
"hash" : "97dd5ec7c9246f6d9f467b9076b790dd6017c5b4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5213",
"triggerID" : "97dd5ec7c9246f6d9f467b9076b790dd6017c5b4",
"triggerType" : "PUSH"
}, {
"hash" : "0538475fe488089c4cb3bc0afb63c2f518329969",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5257",
"triggerID" : "0538475fe488089c4cb3bc0afb63c2f518329969",
"triggerType" : "PUSH"
}, {
"hash" : "9f4b334e340fb26004e1b07fc8fbaaa047c76775",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5261",
"triggerID" : "9f4b334e340fb26004e1b07fc8fbaaa047c76775",
"triggerType" : "PUSH"
}, {
"hash" : "368c099820c3cbf57496d0e46d1858aa8eb153ee",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5330",
"triggerID" : "368c099820c3cbf57496d0e46d1858aa8eb153ee",
"triggerType" : "PUSH"
}, {
"hash" : "28a5a4f537544d35dfcd8700a7b97fb7216682ce",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "28a5a4f537544d35dfcd8700a7b97fb7216682ce",
"triggerType" : "PUSH"
}, {
"hash" : "08ffdd8b47d147c9b5c889a5f56e39b9b140612d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5351",
"triggerID" : "08ffdd8b47d147c9b5c889a5f56e39b9b140612d",
"triggerType" : "PUSH"
}, {
"hash" : "c09e228f7cce78a7dbbc394e93b3cf8c6c3d4d5f",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "c09e228f7cce78a7dbbc394e93b3cf8c6c3d4d5f",
"triggerType" : "PUSH"
}, {
"hash" : "8dadbf672d4d27505592f18bc89422fd7c013669",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5398",
"triggerID" : "8dadbf672d4d27505592f18bc89422fd7c013669",
"triggerType" : "PUSH"
}, {
"hash" : "906607be5bd62ee1cbbda34acb6a89916c1f7aee",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5424",
"triggerID" : "906607be5bd62ee1cbbda34acb6a89916c1f7aee",
"triggerType" : "PUSH"
}, {
"hash" : "dc1b033f40cea9642f71b8fcff74aa82106726b6",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5484",
"triggerID" : "dc1b033f40cea9642f71b8fcff74aa82106726b6",
"triggerType" : "PUSH"
}, {
"hash" : "5b8f5819fff8fec34864eb409fd429b95be17b9b",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "5b8f5819fff8fec34864eb409fd429b95be17b9b",
"triggerType" : "PUSH"
}, {
"hash" : "13702fc2232ebd9300966b0a917a3358d8d0f18c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5590",
"triggerID" : "13702fc2232ebd9300966b0a917a3358d8d0f18c",
"triggerType" : "PUSH"
}, {
"hash" : "13702fc2232ebd9300966b0a917a3358d8d0f18c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5600",
"triggerID" : "1024845655",
"triggerType" : "MANUAL"
}, {
"hash" : "9bdd8a60f95123f82a5f30f5e68929f5b7e1f8da",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5603",
"triggerID" : "9bdd8a60f95123f82a5f30f5e68929f5b7e1f8da",
"triggerType" : "PUSH"
}, {
"hash" : "aebb9df557c4afe3ca88f6b8b28ba2fbfdcbd597",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5631",
"triggerID" : "aebb9df557c4afe3ca88f6b8b28ba2fbfdcbd597",
"triggerType" : "PUSH"
}, {
"hash" : "5d37935bc8bb33260735d782ca560fd59e02f321",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "5d37935bc8bb33260735d782ca560fd59e02f321",
"triggerType" : "PUSH"
}, {
"hash" : "f911d869f50009e5cd9f3fd341c83c732d7531ba",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5634",
"triggerID" : "f911d869f50009e5cd9f3fd341c83c732d7531ba",
"triggerType" : "PUSH"
}, {
"hash" : "f911d869f50009e5cd9f3fd341c83c732d7531ba",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5657",
"triggerID" : "1027051107",
"triggerType" : "MANUAL"
}, {
"hash" : "f911d869f50009e5cd9f3fd341c83c732d7531ba",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5659",
"triggerID" : "1027166086",
"triggerType" : "MANUAL"
}, {
"hash" : "f911d869f50009e5cd9f3fd341c83c732d7531ba",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5665",
"triggerID" : "1027387044",
"triggerType" : "MANUAL"
}, {
"hash" : "34b94b96b03109555201092bfabce21793add437",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "34b94b96b03109555201092bfabce21793add437",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 77d11131baabd1c4e3cc2050337daca4df5f6427 UNKNOWN
* 3d9c2ae28da858d1e8476052c99391015effb7db UNKNOWN
* 31b0669d7b638bd65a17b22a2ceb772f2627512c UNKNOWN
* 28a5a4f537544d35dfcd8700a7b97fb7216682ce UNKNOWN
* c09e228f7cce78a7dbbc394e93b3cf8c6c3d4d5f UNKNOWN
* 5b8f5819fff8fec34864eb409fd429b95be17b9b UNKNOWN
* 5d37935bc8bb33260735d782ca560fd59e02f321 UNKNOWN
* f911d869f50009e5cd9f3fd341c83c732d7531ba Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5634) Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5657) Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5659) Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5665)
* 34b94b96b03109555201092bfabce21793add437 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #4556: [HUDI-3191][Stacked on 4531] Removing duplicating file-listing process w/in Hive's MOR `FIleInputFormat`s
Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #4556:
URL: https://github.com/apache/hudi/pull/4556#issuecomment-1015812000
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "d87786af43a7aeba7549cc3cfcbd97fc312bee0e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5074",
"triggerID" : "d87786af43a7aeba7549cc3cfcbd97fc312bee0e",
"triggerType" : "PUSH"
}, {
"hash" : "4b87ba1474be575ec27109ccbe626e4c2fc9c224",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5077",
"triggerID" : "4b87ba1474be575ec27109ccbe626e4c2fc9c224",
"triggerType" : "PUSH"
}, {
"hash" : "77d11131baabd1c4e3cc2050337daca4df5f6427",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "77d11131baabd1c4e3cc2050337daca4df5f6427",
"triggerType" : "PUSH"
}, {
"hash" : "3d9c2ae28da858d1e8476052c99391015effb7db",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "3d9c2ae28da858d1e8476052c99391015effb7db",
"triggerType" : "PUSH"
}, {
"hash" : "79ac9affcb7f81497e0df755c8200638d35b02b7",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5081",
"triggerID" : "79ac9affcb7f81497e0df755c8200638d35b02b7",
"triggerType" : "PUSH"
}, {
"hash" : "3c14bbe6c6bcf49c4164c45e82f77b473f4de396",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5113",
"triggerID" : "3c14bbe6c6bcf49c4164c45e82f77b473f4de396",
"triggerType" : "PUSH"
}, {
"hash" : "276f13d6efd00b301b232b286d585729c9d1d26e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5116",
"triggerID" : "276f13d6efd00b301b232b286d585729c9d1d26e",
"triggerType" : "PUSH"
}, {
"hash" : "31b0669d7b638bd65a17b22a2ceb772f2627512c",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "31b0669d7b638bd65a17b22a2ceb772f2627512c",
"triggerType" : "PUSH"
}, {
"hash" : "096e26af39a477ffccbee0edd764493e12e15e71",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5124",
"triggerID" : "096e26af39a477ffccbee0edd764493e12e15e71",
"triggerType" : "PUSH"
}, {
"hash" : "97dd5ec7c9246f6d9f467b9076b790dd6017c5b4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5213",
"triggerID" : "97dd5ec7c9246f6d9f467b9076b790dd6017c5b4",
"triggerType" : "PUSH"
}, {
"hash" : "0538475fe488089c4cb3bc0afb63c2f518329969",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5257",
"triggerID" : "0538475fe488089c4cb3bc0afb63c2f518329969",
"triggerType" : "PUSH"
}, {
"hash" : "9f4b334e340fb26004e1b07fc8fbaaa047c76775",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5261",
"triggerID" : "9f4b334e340fb26004e1b07fc8fbaaa047c76775",
"triggerType" : "PUSH"
}, {
"hash" : "368c099820c3cbf57496d0e46d1858aa8eb153ee",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5330",
"triggerID" : "368c099820c3cbf57496d0e46d1858aa8eb153ee",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 77d11131baabd1c4e3cc2050337daca4df5f6427 UNKNOWN
* 3d9c2ae28da858d1e8476052c99391015effb7db UNKNOWN
* 31b0669d7b638bd65a17b22a2ceb772f2627512c UNKNOWN
* 9f4b334e340fb26004e1b07fc8fbaaa047c76775 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5261)
* 368c099820c3cbf57496d0e46d1858aa8eb153ee Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5330)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #4556: [HUDI-3191][Stacked on 4531] Removing duplicating file-listing process w/in Hive's MOR `FIleInputFormat`s
Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #4556:
URL: https://github.com/apache/hudi/pull/4556#issuecomment-1010455087
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "d87786af43a7aeba7549cc3cfcbd97fc312bee0e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5074",
"triggerID" : "d87786af43a7aeba7549cc3cfcbd97fc312bee0e",
"triggerType" : "PUSH"
}, {
"hash" : "4b87ba1474be575ec27109ccbe626e4c2fc9c224",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5077",
"triggerID" : "4b87ba1474be575ec27109ccbe626e4c2fc9c224",
"triggerType" : "PUSH"
}, {
"hash" : "77d11131baabd1c4e3cc2050337daca4df5f6427",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "77d11131baabd1c4e3cc2050337daca4df5f6427",
"triggerType" : "PUSH"
}, {
"hash" : "3d9c2ae28da858d1e8476052c99391015effb7db",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "3d9c2ae28da858d1e8476052c99391015effb7db",
"triggerType" : "PUSH"
}, {
"hash" : "79ac9affcb7f81497e0df755c8200638d35b02b7",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5081",
"triggerID" : "79ac9affcb7f81497e0df755c8200638d35b02b7",
"triggerType" : "PUSH"
}, {
"hash" : "3c14bbe6c6bcf49c4164c45e82f77b473f4de396",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5113",
"triggerID" : "3c14bbe6c6bcf49c4164c45e82f77b473f4de396",
"triggerType" : "PUSH"
}, {
"hash" : "276f13d6efd00b301b232b286d585729c9d1d26e",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5116",
"triggerID" : "276f13d6efd00b301b232b286d585729c9d1d26e",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 77d11131baabd1c4e3cc2050337daca4df5f6427 UNKNOWN
* 3d9c2ae28da858d1e8476052c99391015effb7db UNKNOWN
* 276f13d6efd00b301b232b286d585729c9d1d26e Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5116)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #4556: [HUDI-3191][Stacked on 4531] Removing duplicating file-listing process w/in Hive's MOR `FIleInputFormat`s
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #4556:
URL: https://github.com/apache/hudi/pull/4556#issuecomment-1010567369
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "d87786af43a7aeba7549cc3cfcbd97fc312bee0e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5074",
"triggerID" : "d87786af43a7aeba7549cc3cfcbd97fc312bee0e",
"triggerType" : "PUSH"
}, {
"hash" : "4b87ba1474be575ec27109ccbe626e4c2fc9c224",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5077",
"triggerID" : "4b87ba1474be575ec27109ccbe626e4c2fc9c224",
"triggerType" : "PUSH"
}, {
"hash" : "77d11131baabd1c4e3cc2050337daca4df5f6427",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "77d11131baabd1c4e3cc2050337daca4df5f6427",
"triggerType" : "PUSH"
}, {
"hash" : "3d9c2ae28da858d1e8476052c99391015effb7db",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "3d9c2ae28da858d1e8476052c99391015effb7db",
"triggerType" : "PUSH"
}, {
"hash" : "79ac9affcb7f81497e0df755c8200638d35b02b7",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5081",
"triggerID" : "79ac9affcb7f81497e0df755c8200638d35b02b7",
"triggerType" : "PUSH"
}, {
"hash" : "3c14bbe6c6bcf49c4164c45e82f77b473f4de396",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5113",
"triggerID" : "3c14bbe6c6bcf49c4164c45e82f77b473f4de396",
"triggerType" : "PUSH"
}, {
"hash" : "276f13d6efd00b301b232b286d585729c9d1d26e",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5116",
"triggerID" : "276f13d6efd00b301b232b286d585729c9d1d26e",
"triggerType" : "PUSH"
}, {
"hash" : "31b0669d7b638bd65a17b22a2ceb772f2627512c",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "31b0669d7b638bd65a17b22a2ceb772f2627512c",
"triggerType" : "PUSH"
}, {
"hash" : "096e26af39a477ffccbee0edd764493e12e15e71",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5124",
"triggerID" : "096e26af39a477ffccbee0edd764493e12e15e71",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 77d11131baabd1c4e3cc2050337daca4df5f6427 UNKNOWN
* 3d9c2ae28da858d1e8476052c99391015effb7db UNKNOWN
* 276f13d6efd00b301b232b286d585729c9d1d26e Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5116)
* 31b0669d7b638bd65a17b22a2ceb772f2627512c UNKNOWN
* 096e26af39a477ffccbee0edd764493e12e15e71 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5124)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #4556: [HUDI-3191][Stacked on 4531] Removing duplicating file-listing process w/in Hive's MOR `FIleInputFormat`s
Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #4556:
URL: https://github.com/apache/hudi/pull/4556#issuecomment-1012696524
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "d87786af43a7aeba7549cc3cfcbd97fc312bee0e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5074",
"triggerID" : "d87786af43a7aeba7549cc3cfcbd97fc312bee0e",
"triggerType" : "PUSH"
}, {
"hash" : "4b87ba1474be575ec27109ccbe626e4c2fc9c224",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5077",
"triggerID" : "4b87ba1474be575ec27109ccbe626e4c2fc9c224",
"triggerType" : "PUSH"
}, {
"hash" : "77d11131baabd1c4e3cc2050337daca4df5f6427",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "77d11131baabd1c4e3cc2050337daca4df5f6427",
"triggerType" : "PUSH"
}, {
"hash" : "3d9c2ae28da858d1e8476052c99391015effb7db",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "3d9c2ae28da858d1e8476052c99391015effb7db",
"triggerType" : "PUSH"
}, {
"hash" : "79ac9affcb7f81497e0df755c8200638d35b02b7",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5081",
"triggerID" : "79ac9affcb7f81497e0df755c8200638d35b02b7",
"triggerType" : "PUSH"
}, {
"hash" : "3c14bbe6c6bcf49c4164c45e82f77b473f4de396",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5113",
"triggerID" : "3c14bbe6c6bcf49c4164c45e82f77b473f4de396",
"triggerType" : "PUSH"
}, {
"hash" : "276f13d6efd00b301b232b286d585729c9d1d26e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5116",
"triggerID" : "276f13d6efd00b301b232b286d585729c9d1d26e",
"triggerType" : "PUSH"
}, {
"hash" : "31b0669d7b638bd65a17b22a2ceb772f2627512c",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "31b0669d7b638bd65a17b22a2ceb772f2627512c",
"triggerType" : "PUSH"
}, {
"hash" : "096e26af39a477ffccbee0edd764493e12e15e71",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5124",
"triggerID" : "096e26af39a477ffccbee0edd764493e12e15e71",
"triggerType" : "PUSH"
}, {
"hash" : "97dd5ec7c9246f6d9f467b9076b790dd6017c5b4",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5213",
"triggerID" : "97dd5ec7c9246f6d9f467b9076b790dd6017c5b4",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 77d11131baabd1c4e3cc2050337daca4df5f6427 UNKNOWN
* 3d9c2ae28da858d1e8476052c99391015effb7db UNKNOWN
* 31b0669d7b638bd65a17b22a2ceb772f2627512c UNKNOWN
* 096e26af39a477ffccbee0edd764493e12e15e71 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5124)
* 97dd5ec7c9246f6d9f467b9076b790dd6017c5b4 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5213)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #4556: [HUDI-3191][Stacked on 4531] Removing duplicating file-listing process w/in Hive's MOR `FIleInputFormat`s
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #4556:
URL: https://github.com/apache/hudi/pull/4556#issuecomment-1010374342
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "d87786af43a7aeba7549cc3cfcbd97fc312bee0e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5074",
"triggerID" : "d87786af43a7aeba7549cc3cfcbd97fc312bee0e",
"triggerType" : "PUSH"
}, {
"hash" : "4b87ba1474be575ec27109ccbe626e4c2fc9c224",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5077",
"triggerID" : "4b87ba1474be575ec27109ccbe626e4c2fc9c224",
"triggerType" : "PUSH"
}, {
"hash" : "77d11131baabd1c4e3cc2050337daca4df5f6427",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "77d11131baabd1c4e3cc2050337daca4df5f6427",
"triggerType" : "PUSH"
}, {
"hash" : "3d9c2ae28da858d1e8476052c99391015effb7db",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "3d9c2ae28da858d1e8476052c99391015effb7db",
"triggerType" : "PUSH"
}, {
"hash" : "79ac9affcb7f81497e0df755c8200638d35b02b7",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5081",
"triggerID" : "79ac9affcb7f81497e0df755c8200638d35b02b7",
"triggerType" : "PUSH"
}, {
"hash" : "3c14bbe6c6bcf49c4164c45e82f77b473f4de396",
"status" : "CANCELED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5113",
"triggerID" : "3c14bbe6c6bcf49c4164c45e82f77b473f4de396",
"triggerType" : "PUSH"
}, {
"hash" : "276f13d6efd00b301b232b286d585729c9d1d26e",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "276f13d6efd00b301b232b286d585729c9d1d26e",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 77d11131baabd1c4e3cc2050337daca4df5f6427 UNKNOWN
* 3d9c2ae28da858d1e8476052c99391015effb7db UNKNOWN
* 3c14bbe6c6bcf49c4164c45e82f77b473f4de396 Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5113)
* 276f13d6efd00b301b232b286d585729c9d1d26e UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #4556: [HUDI-3191][Stacked on 4531] Removing duplicating file-listing process w/in Hive's MOR `FIleInputFormat`s
Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #4556:
URL: https://github.com/apache/hudi/pull/4556#issuecomment-1013380867
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "d87786af43a7aeba7549cc3cfcbd97fc312bee0e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5074",
"triggerID" : "d87786af43a7aeba7549cc3cfcbd97fc312bee0e",
"triggerType" : "PUSH"
}, {
"hash" : "4b87ba1474be575ec27109ccbe626e4c2fc9c224",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5077",
"triggerID" : "4b87ba1474be575ec27109ccbe626e4c2fc9c224",
"triggerType" : "PUSH"
}, {
"hash" : "77d11131baabd1c4e3cc2050337daca4df5f6427",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "77d11131baabd1c4e3cc2050337daca4df5f6427",
"triggerType" : "PUSH"
}, {
"hash" : "3d9c2ae28da858d1e8476052c99391015effb7db",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "3d9c2ae28da858d1e8476052c99391015effb7db",
"triggerType" : "PUSH"
}, {
"hash" : "79ac9affcb7f81497e0df755c8200638d35b02b7",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5081",
"triggerID" : "79ac9affcb7f81497e0df755c8200638d35b02b7",
"triggerType" : "PUSH"
}, {
"hash" : "3c14bbe6c6bcf49c4164c45e82f77b473f4de396",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5113",
"triggerID" : "3c14bbe6c6bcf49c4164c45e82f77b473f4de396",
"triggerType" : "PUSH"
}, {
"hash" : "276f13d6efd00b301b232b286d585729c9d1d26e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5116",
"triggerID" : "276f13d6efd00b301b232b286d585729c9d1d26e",
"triggerType" : "PUSH"
}, {
"hash" : "31b0669d7b638bd65a17b22a2ceb772f2627512c",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "31b0669d7b638bd65a17b22a2ceb772f2627512c",
"triggerType" : "PUSH"
}, {
"hash" : "096e26af39a477ffccbee0edd764493e12e15e71",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5124",
"triggerID" : "096e26af39a477ffccbee0edd764493e12e15e71",
"triggerType" : "PUSH"
}, {
"hash" : "97dd5ec7c9246f6d9f467b9076b790dd6017c5b4",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5213",
"triggerID" : "97dd5ec7c9246f6d9f467b9076b790dd6017c5b4",
"triggerType" : "PUSH"
}, {
"hash" : "0538475fe488089c4cb3bc0afb63c2f518329969",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5257",
"triggerID" : "0538475fe488089c4cb3bc0afb63c2f518329969",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 77d11131baabd1c4e3cc2050337daca4df5f6427 UNKNOWN
* 3d9c2ae28da858d1e8476052c99391015effb7db UNKNOWN
* 31b0669d7b638bd65a17b22a2ceb772f2627512c UNKNOWN
* 97dd5ec7c9246f6d9f467b9076b790dd6017c5b4 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5213)
* 0538475fe488089c4cb3bc0afb63c2f518329969 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5257)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #4556: [HUDI-3191] Removing duplicating file-listing process w/in Hive's MOR `FileInputFormat`s
Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #4556:
URL: https://github.com/apache/hudi/pull/4556#issuecomment-1020680629
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "d87786af43a7aeba7549cc3cfcbd97fc312bee0e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5074",
"triggerID" : "d87786af43a7aeba7549cc3cfcbd97fc312bee0e",
"triggerType" : "PUSH"
}, {
"hash" : "4b87ba1474be575ec27109ccbe626e4c2fc9c224",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5077",
"triggerID" : "4b87ba1474be575ec27109ccbe626e4c2fc9c224",
"triggerType" : "PUSH"
}, {
"hash" : "77d11131baabd1c4e3cc2050337daca4df5f6427",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "77d11131baabd1c4e3cc2050337daca4df5f6427",
"triggerType" : "PUSH"
}, {
"hash" : "3d9c2ae28da858d1e8476052c99391015effb7db",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "3d9c2ae28da858d1e8476052c99391015effb7db",
"triggerType" : "PUSH"
}, {
"hash" : "79ac9affcb7f81497e0df755c8200638d35b02b7",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5081",
"triggerID" : "79ac9affcb7f81497e0df755c8200638d35b02b7",
"triggerType" : "PUSH"
}, {
"hash" : "3c14bbe6c6bcf49c4164c45e82f77b473f4de396",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5113",
"triggerID" : "3c14bbe6c6bcf49c4164c45e82f77b473f4de396",
"triggerType" : "PUSH"
}, {
"hash" : "276f13d6efd00b301b232b286d585729c9d1d26e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5116",
"triggerID" : "276f13d6efd00b301b232b286d585729c9d1d26e",
"triggerType" : "PUSH"
}, {
"hash" : "31b0669d7b638bd65a17b22a2ceb772f2627512c",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "31b0669d7b638bd65a17b22a2ceb772f2627512c",
"triggerType" : "PUSH"
}, {
"hash" : "096e26af39a477ffccbee0edd764493e12e15e71",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5124",
"triggerID" : "096e26af39a477ffccbee0edd764493e12e15e71",
"triggerType" : "PUSH"
}, {
"hash" : "97dd5ec7c9246f6d9f467b9076b790dd6017c5b4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5213",
"triggerID" : "97dd5ec7c9246f6d9f467b9076b790dd6017c5b4",
"triggerType" : "PUSH"
}, {
"hash" : "0538475fe488089c4cb3bc0afb63c2f518329969",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5257",
"triggerID" : "0538475fe488089c4cb3bc0afb63c2f518329969",
"triggerType" : "PUSH"
}, {
"hash" : "9f4b334e340fb26004e1b07fc8fbaaa047c76775",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5261",
"triggerID" : "9f4b334e340fb26004e1b07fc8fbaaa047c76775",
"triggerType" : "PUSH"
}, {
"hash" : "368c099820c3cbf57496d0e46d1858aa8eb153ee",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5330",
"triggerID" : "368c099820c3cbf57496d0e46d1858aa8eb153ee",
"triggerType" : "PUSH"
}, {
"hash" : "28a5a4f537544d35dfcd8700a7b97fb7216682ce",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "28a5a4f537544d35dfcd8700a7b97fb7216682ce",
"triggerType" : "PUSH"
}, {
"hash" : "08ffdd8b47d147c9b5c889a5f56e39b9b140612d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5351",
"triggerID" : "08ffdd8b47d147c9b5c889a5f56e39b9b140612d",
"triggerType" : "PUSH"
}, {
"hash" : "c09e228f7cce78a7dbbc394e93b3cf8c6c3d4d5f",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "c09e228f7cce78a7dbbc394e93b3cf8c6c3d4d5f",
"triggerType" : "PUSH"
}, {
"hash" : "8dadbf672d4d27505592f18bc89422fd7c013669",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5398",
"triggerID" : "8dadbf672d4d27505592f18bc89422fd7c013669",
"triggerType" : "PUSH"
}, {
"hash" : "906607be5bd62ee1cbbda34acb6a89916c1f7aee",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5424",
"triggerID" : "906607be5bd62ee1cbbda34acb6a89916c1f7aee",
"triggerType" : "PUSH"
}, {
"hash" : "dc1b033f40cea9642f71b8fcff74aa82106726b6",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5484",
"triggerID" : "dc1b033f40cea9642f71b8fcff74aa82106726b6",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 77d11131baabd1c4e3cc2050337daca4df5f6427 UNKNOWN
* 3d9c2ae28da858d1e8476052c99391015effb7db UNKNOWN
* 31b0669d7b638bd65a17b22a2ceb772f2627512c UNKNOWN
* 28a5a4f537544d35dfcd8700a7b97fb7216682ce UNKNOWN
* c09e228f7cce78a7dbbc394e93b3cf8c6c3d4d5f UNKNOWN
* 906607be5bd62ee1cbbda34acb6a89916c1f7aee Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5424)
* dc1b033f40cea9642f71b8fcff74aa82106726b6 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5484)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #4556: [HUDI-3191] Removing duplicating file-listing process w/in Hive's MOR `FileInputFormat`s
Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #4556:
URL: https://github.com/apache/hudi/pull/4556#issuecomment-1018912156
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "d87786af43a7aeba7549cc3cfcbd97fc312bee0e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5074",
"triggerID" : "d87786af43a7aeba7549cc3cfcbd97fc312bee0e",
"triggerType" : "PUSH"
}, {
"hash" : "4b87ba1474be575ec27109ccbe626e4c2fc9c224",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5077",
"triggerID" : "4b87ba1474be575ec27109ccbe626e4c2fc9c224",
"triggerType" : "PUSH"
}, {
"hash" : "77d11131baabd1c4e3cc2050337daca4df5f6427",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "77d11131baabd1c4e3cc2050337daca4df5f6427",
"triggerType" : "PUSH"
}, {
"hash" : "3d9c2ae28da858d1e8476052c99391015effb7db",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "3d9c2ae28da858d1e8476052c99391015effb7db",
"triggerType" : "PUSH"
}, {
"hash" : "79ac9affcb7f81497e0df755c8200638d35b02b7",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5081",
"triggerID" : "79ac9affcb7f81497e0df755c8200638d35b02b7",
"triggerType" : "PUSH"
}, {
"hash" : "3c14bbe6c6bcf49c4164c45e82f77b473f4de396",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5113",
"triggerID" : "3c14bbe6c6bcf49c4164c45e82f77b473f4de396",
"triggerType" : "PUSH"
}, {
"hash" : "276f13d6efd00b301b232b286d585729c9d1d26e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5116",
"triggerID" : "276f13d6efd00b301b232b286d585729c9d1d26e",
"triggerType" : "PUSH"
}, {
"hash" : "31b0669d7b638bd65a17b22a2ceb772f2627512c",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "31b0669d7b638bd65a17b22a2ceb772f2627512c",
"triggerType" : "PUSH"
}, {
"hash" : "096e26af39a477ffccbee0edd764493e12e15e71",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5124",
"triggerID" : "096e26af39a477ffccbee0edd764493e12e15e71",
"triggerType" : "PUSH"
}, {
"hash" : "97dd5ec7c9246f6d9f467b9076b790dd6017c5b4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5213",
"triggerID" : "97dd5ec7c9246f6d9f467b9076b790dd6017c5b4",
"triggerType" : "PUSH"
}, {
"hash" : "0538475fe488089c4cb3bc0afb63c2f518329969",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5257",
"triggerID" : "0538475fe488089c4cb3bc0afb63c2f518329969",
"triggerType" : "PUSH"
}, {
"hash" : "9f4b334e340fb26004e1b07fc8fbaaa047c76775",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5261",
"triggerID" : "9f4b334e340fb26004e1b07fc8fbaaa047c76775",
"triggerType" : "PUSH"
}, {
"hash" : "368c099820c3cbf57496d0e46d1858aa8eb153ee",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5330",
"triggerID" : "368c099820c3cbf57496d0e46d1858aa8eb153ee",
"triggerType" : "PUSH"
}, {
"hash" : "28a5a4f537544d35dfcd8700a7b97fb7216682ce",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "28a5a4f537544d35dfcd8700a7b97fb7216682ce",
"triggerType" : "PUSH"
}, {
"hash" : "08ffdd8b47d147c9b5c889a5f56e39b9b140612d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5351",
"triggerID" : "08ffdd8b47d147c9b5c889a5f56e39b9b140612d",
"triggerType" : "PUSH"
}, {
"hash" : "c09e228f7cce78a7dbbc394e93b3cf8c6c3d4d5f",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "c09e228f7cce78a7dbbc394e93b3cf8c6c3d4d5f",
"triggerType" : "PUSH"
}, {
"hash" : "8dadbf672d4d27505592f18bc89422fd7c013669",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5398",
"triggerID" : "8dadbf672d4d27505592f18bc89422fd7c013669",
"triggerType" : "PUSH"
}, {
"hash" : "906607be5bd62ee1cbbda34acb6a89916c1f7aee",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5424",
"triggerID" : "906607be5bd62ee1cbbda34acb6a89916c1f7aee",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 77d11131baabd1c4e3cc2050337daca4df5f6427 UNKNOWN
* 3d9c2ae28da858d1e8476052c99391015effb7db UNKNOWN
* 31b0669d7b638bd65a17b22a2ceb772f2627512c UNKNOWN
* 28a5a4f537544d35dfcd8700a7b97fb7216682ce UNKNOWN
* c09e228f7cce78a7dbbc394e93b3cf8c6c3d4d5f UNKNOWN
* 906607be5bd62ee1cbbda34acb6a89916c1f7aee Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5424)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #4556: [HUDI-3191][Stacked on 4531] Removing duplicating file-listing process w/in Hive's MOR `FIleInputFormat`s
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #4556:
URL: https://github.com/apache/hudi/pull/4556#issuecomment-1010409713
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "d87786af43a7aeba7549cc3cfcbd97fc312bee0e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5074",
"triggerID" : "d87786af43a7aeba7549cc3cfcbd97fc312bee0e",
"triggerType" : "PUSH"
}, {
"hash" : "4b87ba1474be575ec27109ccbe626e4c2fc9c224",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5077",
"triggerID" : "4b87ba1474be575ec27109ccbe626e4c2fc9c224",
"triggerType" : "PUSH"
}, {
"hash" : "77d11131baabd1c4e3cc2050337daca4df5f6427",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "77d11131baabd1c4e3cc2050337daca4df5f6427",
"triggerType" : "PUSH"
}, {
"hash" : "3d9c2ae28da858d1e8476052c99391015effb7db",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "3d9c2ae28da858d1e8476052c99391015effb7db",
"triggerType" : "PUSH"
}, {
"hash" : "79ac9affcb7f81497e0df755c8200638d35b02b7",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5081",
"triggerID" : "79ac9affcb7f81497e0df755c8200638d35b02b7",
"triggerType" : "PUSH"
}, {
"hash" : "3c14bbe6c6bcf49c4164c45e82f77b473f4de396",
"status" : "CANCELED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5113",
"triggerID" : "3c14bbe6c6bcf49c4164c45e82f77b473f4de396",
"triggerType" : "PUSH"
}, {
"hash" : "276f13d6efd00b301b232b286d585729c9d1d26e",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5116",
"triggerID" : "276f13d6efd00b301b232b286d585729c9d1d26e",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 77d11131baabd1c4e3cc2050337daca4df5f6427 UNKNOWN
* 3d9c2ae28da858d1e8476052c99391015effb7db UNKNOWN
* 3c14bbe6c6bcf49c4164c45e82f77b473f4de396 Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5113)
* 276f13d6efd00b301b232b286d585729c9d1d26e Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5116)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #4556: [HUDI-3191] Removing duplicating file-listing process w/in Hive's MOR `FIleInputFormat`s
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #4556:
URL: https://github.com/apache/hudi/pull/4556#issuecomment-1018036962
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "d87786af43a7aeba7549cc3cfcbd97fc312bee0e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5074",
"triggerID" : "d87786af43a7aeba7549cc3cfcbd97fc312bee0e",
"triggerType" : "PUSH"
}, {
"hash" : "4b87ba1474be575ec27109ccbe626e4c2fc9c224",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5077",
"triggerID" : "4b87ba1474be575ec27109ccbe626e4c2fc9c224",
"triggerType" : "PUSH"
}, {
"hash" : "77d11131baabd1c4e3cc2050337daca4df5f6427",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "77d11131baabd1c4e3cc2050337daca4df5f6427",
"triggerType" : "PUSH"
}, {
"hash" : "3d9c2ae28da858d1e8476052c99391015effb7db",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "3d9c2ae28da858d1e8476052c99391015effb7db",
"triggerType" : "PUSH"
}, {
"hash" : "79ac9affcb7f81497e0df755c8200638d35b02b7",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5081",
"triggerID" : "79ac9affcb7f81497e0df755c8200638d35b02b7",
"triggerType" : "PUSH"
}, {
"hash" : "3c14bbe6c6bcf49c4164c45e82f77b473f4de396",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5113",
"triggerID" : "3c14bbe6c6bcf49c4164c45e82f77b473f4de396",
"triggerType" : "PUSH"
}, {
"hash" : "276f13d6efd00b301b232b286d585729c9d1d26e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5116",
"triggerID" : "276f13d6efd00b301b232b286d585729c9d1d26e",
"triggerType" : "PUSH"
}, {
"hash" : "31b0669d7b638bd65a17b22a2ceb772f2627512c",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "31b0669d7b638bd65a17b22a2ceb772f2627512c",
"triggerType" : "PUSH"
}, {
"hash" : "096e26af39a477ffccbee0edd764493e12e15e71",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5124",
"triggerID" : "096e26af39a477ffccbee0edd764493e12e15e71",
"triggerType" : "PUSH"
}, {
"hash" : "97dd5ec7c9246f6d9f467b9076b790dd6017c5b4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5213",
"triggerID" : "97dd5ec7c9246f6d9f467b9076b790dd6017c5b4",
"triggerType" : "PUSH"
}, {
"hash" : "0538475fe488089c4cb3bc0afb63c2f518329969",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5257",
"triggerID" : "0538475fe488089c4cb3bc0afb63c2f518329969",
"triggerType" : "PUSH"
}, {
"hash" : "9f4b334e340fb26004e1b07fc8fbaaa047c76775",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5261",
"triggerID" : "9f4b334e340fb26004e1b07fc8fbaaa047c76775",
"triggerType" : "PUSH"
}, {
"hash" : "368c099820c3cbf57496d0e46d1858aa8eb153ee",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5330",
"triggerID" : "368c099820c3cbf57496d0e46d1858aa8eb153ee",
"triggerType" : "PUSH"
}, {
"hash" : "28a5a4f537544d35dfcd8700a7b97fb7216682ce",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "28a5a4f537544d35dfcd8700a7b97fb7216682ce",
"triggerType" : "PUSH"
}, {
"hash" : "08ffdd8b47d147c9b5c889a5f56e39b9b140612d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5351",
"triggerID" : "08ffdd8b47d147c9b5c889a5f56e39b9b140612d",
"triggerType" : "PUSH"
}, {
"hash" : "c09e228f7cce78a7dbbc394e93b3cf8c6c3d4d5f",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "c09e228f7cce78a7dbbc394e93b3cf8c6c3d4d5f",
"triggerType" : "PUSH"
}, {
"hash" : "8dadbf672d4d27505592f18bc89422fd7c013669",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5398",
"triggerID" : "8dadbf672d4d27505592f18bc89422fd7c013669",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 77d11131baabd1c4e3cc2050337daca4df5f6427 UNKNOWN
* 3d9c2ae28da858d1e8476052c99391015effb7db UNKNOWN
* 31b0669d7b638bd65a17b22a2ceb772f2627512c UNKNOWN
* 28a5a4f537544d35dfcd8700a7b97fb7216682ce UNKNOWN
* c09e228f7cce78a7dbbc394e93b3cf8c6c3d4d5f UNKNOWN
* 8dadbf672d4d27505592f18bc89422fd7c013669 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5398)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] alexeykudinkin commented on pull request #4556: [HUDI-3191] Removing duplicating file-listing process w/in Hive's MOR `FileInputFormat`s
Posted by GitBox <gi...@apache.org>.
alexeykudinkin commented on pull request #4556:
URL: https://github.com/apache/hudi/pull/4556#issuecomment-1020803412
@yihua good call out. Idea is to remove duplicated file-listing operations w/in `HoodieInputFormatUtils.getRealtimeSplits` methods, leveraging file-structure fetched by `listFileStatus` w/in `InputFormat` impls.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] alexeykudinkin commented on a change in pull request #4556: [HUDI-3191] Removing duplicating file-listing process w/in Hive's MOR `FileInputFormat`s
Posted by GitBox <gi...@apache.org>.
alexeykudinkin commented on a change in pull request #4556:
URL: https://github.com/apache/hudi/pull/4556#discussion_r798022835
##########
File path: hudi-client/hudi-spark-client/src/test/java/org/apache/hudi/table/functional/TestHoodieSparkMergeOnReadTableRollback.java
##########
@@ -516,8 +556,6 @@ void testMORTableRestore(boolean restoreAfterCompaction) throws Exception {
JavaRDD<HoodieRecord> writeRecords = jsc().parallelize(records, 1);
JavaRDD<WriteStatus> writeStatusJavaRDD = client.upsert(writeRecords, newCommitTime);
client.commit(newCommitTime, writeStatusJavaRDD);
- List<WriteStatus> statuses = writeStatusJavaRDD.collect();
- assertNoWriteErrors(statuses);
Review comment:
Yeah, this is a coarse hack though (just to keep the tests mostly intact). We should not actually dereference RDDs here since this couples tests not with API but with current implementation that might be subject to change in the future
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #4556: [HUDI-3191][Stacked on 4531] Removing duplicating file-listing process w/in Hive's MOR `FIleInputFormat`s
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #4556:
URL: https://github.com/apache/hudi/pull/4556#issuecomment-1009529185
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "d87786af43a7aeba7549cc3cfcbd97fc312bee0e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5074",
"triggerID" : "d87786af43a7aeba7549cc3cfcbd97fc312bee0e",
"triggerType" : "PUSH"
}, {
"hash" : "4b87ba1474be575ec27109ccbe626e4c2fc9c224",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5077",
"triggerID" : "4b87ba1474be575ec27109ccbe626e4c2fc9c224",
"triggerType" : "PUSH"
}, {
"hash" : "77d11131baabd1c4e3cc2050337daca4df5f6427",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "77d11131baabd1c4e3cc2050337daca4df5f6427",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 4b87ba1474be575ec27109ccbe626e4c2fc9c224 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5077)
* 77d11131baabd1c4e3cc2050337daca4df5f6427 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #4556: [HUDI-3191][Stacked on 4531] Removing duplicating file-listing process w/in Hive's MOR `FIleInputFormat`s
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #4556:
URL: https://github.com/apache/hudi/pull/4556#issuecomment-1009547599
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "d87786af43a7aeba7549cc3cfcbd97fc312bee0e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5074",
"triggerID" : "d87786af43a7aeba7549cc3cfcbd97fc312bee0e",
"triggerType" : "PUSH"
}, {
"hash" : "4b87ba1474be575ec27109ccbe626e4c2fc9c224",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5077",
"triggerID" : "4b87ba1474be575ec27109ccbe626e4c2fc9c224",
"triggerType" : "PUSH"
}, {
"hash" : "77d11131baabd1c4e3cc2050337daca4df5f6427",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "77d11131baabd1c4e3cc2050337daca4df5f6427",
"triggerType" : "PUSH"
}, {
"hash" : "3d9c2ae28da858d1e8476052c99391015effb7db",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "3d9c2ae28da858d1e8476052c99391015effb7db",
"triggerType" : "PUSH"
}, {
"hash" : "79ac9affcb7f81497e0df755c8200638d35b02b7",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "79ac9affcb7f81497e0df755c8200638d35b02b7",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 4b87ba1474be575ec27109ccbe626e4c2fc9c224 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5077)
* 77d11131baabd1c4e3cc2050337daca4df5f6427 UNKNOWN
* 3d9c2ae28da858d1e8476052c99391015effb7db UNKNOWN
* 79ac9affcb7f81497e0df755c8200638d35b02b7 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #4556: [HUDI-3191][Stacked on 4716] Removing duplicating file-listing process w/in Hive's MOR `FileInputFormat`s
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #4556:
URL: https://github.com/apache/hudi/pull/4556#issuecomment-1027244710
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "d87786af43a7aeba7549cc3cfcbd97fc312bee0e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5074",
"triggerID" : "d87786af43a7aeba7549cc3cfcbd97fc312bee0e",
"triggerType" : "PUSH"
}, {
"hash" : "4b87ba1474be575ec27109ccbe626e4c2fc9c224",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5077",
"triggerID" : "4b87ba1474be575ec27109ccbe626e4c2fc9c224",
"triggerType" : "PUSH"
}, {
"hash" : "77d11131baabd1c4e3cc2050337daca4df5f6427",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "77d11131baabd1c4e3cc2050337daca4df5f6427",
"triggerType" : "PUSH"
}, {
"hash" : "3d9c2ae28da858d1e8476052c99391015effb7db",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "3d9c2ae28da858d1e8476052c99391015effb7db",
"triggerType" : "PUSH"
}, {
"hash" : "79ac9affcb7f81497e0df755c8200638d35b02b7",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5081",
"triggerID" : "79ac9affcb7f81497e0df755c8200638d35b02b7",
"triggerType" : "PUSH"
}, {
"hash" : "3c14bbe6c6bcf49c4164c45e82f77b473f4de396",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5113",
"triggerID" : "3c14bbe6c6bcf49c4164c45e82f77b473f4de396",
"triggerType" : "PUSH"
}, {
"hash" : "276f13d6efd00b301b232b286d585729c9d1d26e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5116",
"triggerID" : "276f13d6efd00b301b232b286d585729c9d1d26e",
"triggerType" : "PUSH"
}, {
"hash" : "31b0669d7b638bd65a17b22a2ceb772f2627512c",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "31b0669d7b638bd65a17b22a2ceb772f2627512c",
"triggerType" : "PUSH"
}, {
"hash" : "096e26af39a477ffccbee0edd764493e12e15e71",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5124",
"triggerID" : "096e26af39a477ffccbee0edd764493e12e15e71",
"triggerType" : "PUSH"
}, {
"hash" : "97dd5ec7c9246f6d9f467b9076b790dd6017c5b4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5213",
"triggerID" : "97dd5ec7c9246f6d9f467b9076b790dd6017c5b4",
"triggerType" : "PUSH"
}, {
"hash" : "0538475fe488089c4cb3bc0afb63c2f518329969",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5257",
"triggerID" : "0538475fe488089c4cb3bc0afb63c2f518329969",
"triggerType" : "PUSH"
}, {
"hash" : "9f4b334e340fb26004e1b07fc8fbaaa047c76775",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5261",
"triggerID" : "9f4b334e340fb26004e1b07fc8fbaaa047c76775",
"triggerType" : "PUSH"
}, {
"hash" : "368c099820c3cbf57496d0e46d1858aa8eb153ee",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5330",
"triggerID" : "368c099820c3cbf57496d0e46d1858aa8eb153ee",
"triggerType" : "PUSH"
}, {
"hash" : "28a5a4f537544d35dfcd8700a7b97fb7216682ce",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "28a5a4f537544d35dfcd8700a7b97fb7216682ce",
"triggerType" : "PUSH"
}, {
"hash" : "08ffdd8b47d147c9b5c889a5f56e39b9b140612d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5351",
"triggerID" : "08ffdd8b47d147c9b5c889a5f56e39b9b140612d",
"triggerType" : "PUSH"
}, {
"hash" : "c09e228f7cce78a7dbbc394e93b3cf8c6c3d4d5f",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "c09e228f7cce78a7dbbc394e93b3cf8c6c3d4d5f",
"triggerType" : "PUSH"
}, {
"hash" : "8dadbf672d4d27505592f18bc89422fd7c013669",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5398",
"triggerID" : "8dadbf672d4d27505592f18bc89422fd7c013669",
"triggerType" : "PUSH"
}, {
"hash" : "906607be5bd62ee1cbbda34acb6a89916c1f7aee",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5424",
"triggerID" : "906607be5bd62ee1cbbda34acb6a89916c1f7aee",
"triggerType" : "PUSH"
}, {
"hash" : "dc1b033f40cea9642f71b8fcff74aa82106726b6",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5484",
"triggerID" : "dc1b033f40cea9642f71b8fcff74aa82106726b6",
"triggerType" : "PUSH"
}, {
"hash" : "5b8f5819fff8fec34864eb409fd429b95be17b9b",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "5b8f5819fff8fec34864eb409fd429b95be17b9b",
"triggerType" : "PUSH"
}, {
"hash" : "13702fc2232ebd9300966b0a917a3358d8d0f18c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5590",
"triggerID" : "13702fc2232ebd9300966b0a917a3358d8d0f18c",
"triggerType" : "PUSH"
}, {
"hash" : "13702fc2232ebd9300966b0a917a3358d8d0f18c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5600",
"triggerID" : "1024845655",
"triggerType" : "MANUAL"
}, {
"hash" : "9bdd8a60f95123f82a5f30f5e68929f5b7e1f8da",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5603",
"triggerID" : "9bdd8a60f95123f82a5f30f5e68929f5b7e1f8da",
"triggerType" : "PUSH"
}, {
"hash" : "aebb9df557c4afe3ca88f6b8b28ba2fbfdcbd597",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5631",
"triggerID" : "aebb9df557c4afe3ca88f6b8b28ba2fbfdcbd597",
"triggerType" : "PUSH"
}, {
"hash" : "5d37935bc8bb33260735d782ca560fd59e02f321",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "5d37935bc8bb33260735d782ca560fd59e02f321",
"triggerType" : "PUSH"
}, {
"hash" : "f911d869f50009e5cd9f3fd341c83c732d7531ba",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5634",
"triggerID" : "f911d869f50009e5cd9f3fd341c83c732d7531ba",
"triggerType" : "PUSH"
}, {
"hash" : "f911d869f50009e5cd9f3fd341c83c732d7531ba",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5657",
"triggerID" : "1027051107",
"triggerType" : "MANUAL"
}, {
"hash" : "f911d869f50009e5cd9f3fd341c83c732d7531ba",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5659",
"triggerID" : "1027166086",
"triggerType" : "MANUAL"
} ]
}-->
## CI report:
* 77d11131baabd1c4e3cc2050337daca4df5f6427 UNKNOWN
* 3d9c2ae28da858d1e8476052c99391015effb7db UNKNOWN
* 31b0669d7b638bd65a17b22a2ceb772f2627512c UNKNOWN
* 28a5a4f537544d35dfcd8700a7b97fb7216682ce UNKNOWN
* c09e228f7cce78a7dbbc394e93b3cf8c6c3d4d5f UNKNOWN
* 5b8f5819fff8fec34864eb409fd429b95be17b9b UNKNOWN
* 5d37935bc8bb33260735d782ca560fd59e02f321 UNKNOWN
* f911d869f50009e5cd9f3fd341c83c732d7531ba Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5634) Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5657) Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5659)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #4556: [HUDI-3191][Stacked on 4716] Removing duplicating file-listing process w/in Hive's MOR `FileInputFormat`s
Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #4556:
URL: https://github.com/apache/hudi/pull/4556#issuecomment-1024851007
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "d87786af43a7aeba7549cc3cfcbd97fc312bee0e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5074",
"triggerID" : "d87786af43a7aeba7549cc3cfcbd97fc312bee0e",
"triggerType" : "PUSH"
}, {
"hash" : "4b87ba1474be575ec27109ccbe626e4c2fc9c224",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5077",
"triggerID" : "4b87ba1474be575ec27109ccbe626e4c2fc9c224",
"triggerType" : "PUSH"
}, {
"hash" : "77d11131baabd1c4e3cc2050337daca4df5f6427",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "77d11131baabd1c4e3cc2050337daca4df5f6427",
"triggerType" : "PUSH"
}, {
"hash" : "3d9c2ae28da858d1e8476052c99391015effb7db",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "3d9c2ae28da858d1e8476052c99391015effb7db",
"triggerType" : "PUSH"
}, {
"hash" : "79ac9affcb7f81497e0df755c8200638d35b02b7",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5081",
"triggerID" : "79ac9affcb7f81497e0df755c8200638d35b02b7",
"triggerType" : "PUSH"
}, {
"hash" : "3c14bbe6c6bcf49c4164c45e82f77b473f4de396",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5113",
"triggerID" : "3c14bbe6c6bcf49c4164c45e82f77b473f4de396",
"triggerType" : "PUSH"
}, {
"hash" : "276f13d6efd00b301b232b286d585729c9d1d26e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5116",
"triggerID" : "276f13d6efd00b301b232b286d585729c9d1d26e",
"triggerType" : "PUSH"
}, {
"hash" : "31b0669d7b638bd65a17b22a2ceb772f2627512c",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "31b0669d7b638bd65a17b22a2ceb772f2627512c",
"triggerType" : "PUSH"
}, {
"hash" : "096e26af39a477ffccbee0edd764493e12e15e71",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5124",
"triggerID" : "096e26af39a477ffccbee0edd764493e12e15e71",
"triggerType" : "PUSH"
}, {
"hash" : "97dd5ec7c9246f6d9f467b9076b790dd6017c5b4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5213",
"triggerID" : "97dd5ec7c9246f6d9f467b9076b790dd6017c5b4",
"triggerType" : "PUSH"
}, {
"hash" : "0538475fe488089c4cb3bc0afb63c2f518329969",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5257",
"triggerID" : "0538475fe488089c4cb3bc0afb63c2f518329969",
"triggerType" : "PUSH"
}, {
"hash" : "9f4b334e340fb26004e1b07fc8fbaaa047c76775",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5261",
"triggerID" : "9f4b334e340fb26004e1b07fc8fbaaa047c76775",
"triggerType" : "PUSH"
}, {
"hash" : "368c099820c3cbf57496d0e46d1858aa8eb153ee",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5330",
"triggerID" : "368c099820c3cbf57496d0e46d1858aa8eb153ee",
"triggerType" : "PUSH"
}, {
"hash" : "28a5a4f537544d35dfcd8700a7b97fb7216682ce",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "28a5a4f537544d35dfcd8700a7b97fb7216682ce",
"triggerType" : "PUSH"
}, {
"hash" : "08ffdd8b47d147c9b5c889a5f56e39b9b140612d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5351",
"triggerID" : "08ffdd8b47d147c9b5c889a5f56e39b9b140612d",
"triggerType" : "PUSH"
}, {
"hash" : "c09e228f7cce78a7dbbc394e93b3cf8c6c3d4d5f",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "c09e228f7cce78a7dbbc394e93b3cf8c6c3d4d5f",
"triggerType" : "PUSH"
}, {
"hash" : "8dadbf672d4d27505592f18bc89422fd7c013669",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5398",
"triggerID" : "8dadbf672d4d27505592f18bc89422fd7c013669",
"triggerType" : "PUSH"
}, {
"hash" : "906607be5bd62ee1cbbda34acb6a89916c1f7aee",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5424",
"triggerID" : "906607be5bd62ee1cbbda34acb6a89916c1f7aee",
"triggerType" : "PUSH"
}, {
"hash" : "dc1b033f40cea9642f71b8fcff74aa82106726b6",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5484",
"triggerID" : "dc1b033f40cea9642f71b8fcff74aa82106726b6",
"triggerType" : "PUSH"
}, {
"hash" : "5b8f5819fff8fec34864eb409fd429b95be17b9b",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "5b8f5819fff8fec34864eb409fd429b95be17b9b",
"triggerType" : "PUSH"
}, {
"hash" : "13702fc2232ebd9300966b0a917a3358d8d0f18c",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5590",
"triggerID" : "13702fc2232ebd9300966b0a917a3358d8d0f18c",
"triggerType" : "PUSH"
}, {
"hash" : "13702fc2232ebd9300966b0a917a3358d8d0f18c",
"status" : "CANCELED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5600",
"triggerID" : "1024845655",
"triggerType" : "MANUAL"
}, {
"hash" : "9bdd8a60f95123f82a5f30f5e68929f5b7e1f8da",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5603",
"triggerID" : "9bdd8a60f95123f82a5f30f5e68929f5b7e1f8da",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 77d11131baabd1c4e3cc2050337daca4df5f6427 UNKNOWN
* 3d9c2ae28da858d1e8476052c99391015effb7db UNKNOWN
* 31b0669d7b638bd65a17b22a2ceb772f2627512c UNKNOWN
* 28a5a4f537544d35dfcd8700a7b97fb7216682ce UNKNOWN
* c09e228f7cce78a7dbbc394e93b3cf8c6c3d4d5f UNKNOWN
* 5b8f5819fff8fec34864eb409fd429b95be17b9b UNKNOWN
* 13702fc2232ebd9300966b0a917a3358d8d0f18c Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5590) Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5600)
* 9bdd8a60f95123f82a5f30f5e68929f5b7e1f8da Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5603)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #4556: [HUDI-3191] Removing duplicating file-listing process w/in Hive's MOR `FileInputFormat`s
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #4556:
URL: https://github.com/apache/hudi/pull/4556#issuecomment-1024799065
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "d87786af43a7aeba7549cc3cfcbd97fc312bee0e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5074",
"triggerID" : "d87786af43a7aeba7549cc3cfcbd97fc312bee0e",
"triggerType" : "PUSH"
}, {
"hash" : "4b87ba1474be575ec27109ccbe626e4c2fc9c224",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5077",
"triggerID" : "4b87ba1474be575ec27109ccbe626e4c2fc9c224",
"triggerType" : "PUSH"
}, {
"hash" : "77d11131baabd1c4e3cc2050337daca4df5f6427",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "77d11131baabd1c4e3cc2050337daca4df5f6427",
"triggerType" : "PUSH"
}, {
"hash" : "3d9c2ae28da858d1e8476052c99391015effb7db",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "3d9c2ae28da858d1e8476052c99391015effb7db",
"triggerType" : "PUSH"
}, {
"hash" : "79ac9affcb7f81497e0df755c8200638d35b02b7",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5081",
"triggerID" : "79ac9affcb7f81497e0df755c8200638d35b02b7",
"triggerType" : "PUSH"
}, {
"hash" : "3c14bbe6c6bcf49c4164c45e82f77b473f4de396",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5113",
"triggerID" : "3c14bbe6c6bcf49c4164c45e82f77b473f4de396",
"triggerType" : "PUSH"
}, {
"hash" : "276f13d6efd00b301b232b286d585729c9d1d26e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5116",
"triggerID" : "276f13d6efd00b301b232b286d585729c9d1d26e",
"triggerType" : "PUSH"
}, {
"hash" : "31b0669d7b638bd65a17b22a2ceb772f2627512c",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "31b0669d7b638bd65a17b22a2ceb772f2627512c",
"triggerType" : "PUSH"
}, {
"hash" : "096e26af39a477ffccbee0edd764493e12e15e71",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5124",
"triggerID" : "096e26af39a477ffccbee0edd764493e12e15e71",
"triggerType" : "PUSH"
}, {
"hash" : "97dd5ec7c9246f6d9f467b9076b790dd6017c5b4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5213",
"triggerID" : "97dd5ec7c9246f6d9f467b9076b790dd6017c5b4",
"triggerType" : "PUSH"
}, {
"hash" : "0538475fe488089c4cb3bc0afb63c2f518329969",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5257",
"triggerID" : "0538475fe488089c4cb3bc0afb63c2f518329969",
"triggerType" : "PUSH"
}, {
"hash" : "9f4b334e340fb26004e1b07fc8fbaaa047c76775",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5261",
"triggerID" : "9f4b334e340fb26004e1b07fc8fbaaa047c76775",
"triggerType" : "PUSH"
}, {
"hash" : "368c099820c3cbf57496d0e46d1858aa8eb153ee",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5330",
"triggerID" : "368c099820c3cbf57496d0e46d1858aa8eb153ee",
"triggerType" : "PUSH"
}, {
"hash" : "28a5a4f537544d35dfcd8700a7b97fb7216682ce",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "28a5a4f537544d35dfcd8700a7b97fb7216682ce",
"triggerType" : "PUSH"
}, {
"hash" : "08ffdd8b47d147c9b5c889a5f56e39b9b140612d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5351",
"triggerID" : "08ffdd8b47d147c9b5c889a5f56e39b9b140612d",
"triggerType" : "PUSH"
}, {
"hash" : "c09e228f7cce78a7dbbc394e93b3cf8c6c3d4d5f",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "c09e228f7cce78a7dbbc394e93b3cf8c6c3d4d5f",
"triggerType" : "PUSH"
}, {
"hash" : "8dadbf672d4d27505592f18bc89422fd7c013669",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5398",
"triggerID" : "8dadbf672d4d27505592f18bc89422fd7c013669",
"triggerType" : "PUSH"
}, {
"hash" : "906607be5bd62ee1cbbda34acb6a89916c1f7aee",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5424",
"triggerID" : "906607be5bd62ee1cbbda34acb6a89916c1f7aee",
"triggerType" : "PUSH"
}, {
"hash" : "dc1b033f40cea9642f71b8fcff74aa82106726b6",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5484",
"triggerID" : "dc1b033f40cea9642f71b8fcff74aa82106726b6",
"triggerType" : "PUSH"
}, {
"hash" : "5b8f5819fff8fec34864eb409fd429b95be17b9b",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "5b8f5819fff8fec34864eb409fd429b95be17b9b",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 77d11131baabd1c4e3cc2050337daca4df5f6427 UNKNOWN
* 3d9c2ae28da858d1e8476052c99391015effb7db UNKNOWN
* 31b0669d7b638bd65a17b22a2ceb772f2627512c UNKNOWN
* 28a5a4f537544d35dfcd8700a7b97fb7216682ce UNKNOWN
* c09e228f7cce78a7dbbc394e93b3cf8c6c3d4d5f UNKNOWN
* dc1b033f40cea9642f71b8fcff74aa82106726b6 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5484)
* 5b8f5819fff8fec34864eb409fd429b95be17b9b UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #4556: [HUDI-3191][Stacked on 4531] Removing duplicating file-listing process w/in Hive's MOR `FIleInputFormat`s
Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #4556:
URL: https://github.com/apache/hudi/pull/4556#issuecomment-1009524295
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "d87786af43a7aeba7549cc3cfcbd97fc312bee0e",
"status" : "CANCELED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5074",
"triggerID" : "d87786af43a7aeba7549cc3cfcbd97fc312bee0e",
"triggerType" : "PUSH"
}, {
"hash" : "4b87ba1474be575ec27109ccbe626e4c2fc9c224",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5077",
"triggerID" : "4b87ba1474be575ec27109ccbe626e4c2fc9c224",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* d87786af43a7aeba7549cc3cfcbd97fc312bee0e Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5074)
* 4b87ba1474be575ec27109ccbe626e4c2fc9c224 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5077)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #4556: [HUDI-3191][Stacked on 4531] Removing duplicating file-listing process w/in Hive's MOR `FIleInputFormat`s
Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #4556:
URL: https://github.com/apache/hudi/pull/4556#issuecomment-1009547599
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "d87786af43a7aeba7549cc3cfcbd97fc312bee0e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5074",
"triggerID" : "d87786af43a7aeba7549cc3cfcbd97fc312bee0e",
"triggerType" : "PUSH"
}, {
"hash" : "4b87ba1474be575ec27109ccbe626e4c2fc9c224",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5077",
"triggerID" : "4b87ba1474be575ec27109ccbe626e4c2fc9c224",
"triggerType" : "PUSH"
}, {
"hash" : "77d11131baabd1c4e3cc2050337daca4df5f6427",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "77d11131baabd1c4e3cc2050337daca4df5f6427",
"triggerType" : "PUSH"
}, {
"hash" : "3d9c2ae28da858d1e8476052c99391015effb7db",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "3d9c2ae28da858d1e8476052c99391015effb7db",
"triggerType" : "PUSH"
}, {
"hash" : "79ac9affcb7f81497e0df755c8200638d35b02b7",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "79ac9affcb7f81497e0df755c8200638d35b02b7",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 4b87ba1474be575ec27109ccbe626e4c2fc9c224 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5077)
* 77d11131baabd1c4e3cc2050337daca4df5f6427 UNKNOWN
* 3d9c2ae28da858d1e8476052c99391015effb7db UNKNOWN
* 79ac9affcb7f81497e0df755c8200638d35b02b7 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #4556: [HUDI-3191][Stacked on 4531] Removing duplicating file-listing process w/in Hive's MOR `FIleInputFormat`s
Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #4556:
URL: https://github.com/apache/hudi/pull/4556#issuecomment-1009540462
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "d87786af43a7aeba7549cc3cfcbd97fc312bee0e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5074",
"triggerID" : "d87786af43a7aeba7549cc3cfcbd97fc312bee0e",
"triggerType" : "PUSH"
}, {
"hash" : "4b87ba1474be575ec27109ccbe626e4c2fc9c224",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5077",
"triggerID" : "4b87ba1474be575ec27109ccbe626e4c2fc9c224",
"triggerType" : "PUSH"
}, {
"hash" : "77d11131baabd1c4e3cc2050337daca4df5f6427",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "77d11131baabd1c4e3cc2050337daca4df5f6427",
"triggerType" : "PUSH"
}, {
"hash" : "3d9c2ae28da858d1e8476052c99391015effb7db",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "3d9c2ae28da858d1e8476052c99391015effb7db",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 4b87ba1474be575ec27109ccbe626e4c2fc9c224 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5077)
* 77d11131baabd1c4e3cc2050337daca4df5f6427 UNKNOWN
* 3d9c2ae28da858d1e8476052c99391015effb7db UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #4556: [HUDI-3191][Stacked on 4531] Removing duplicating file-listing process w/in Hive's MOR `FIleInputFormat`s
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #4556:
URL: https://github.com/apache/hudi/pull/4556#issuecomment-1010372011
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "d87786af43a7aeba7549cc3cfcbd97fc312bee0e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5074",
"triggerID" : "d87786af43a7aeba7549cc3cfcbd97fc312bee0e",
"triggerType" : "PUSH"
}, {
"hash" : "4b87ba1474be575ec27109ccbe626e4c2fc9c224",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5077",
"triggerID" : "4b87ba1474be575ec27109ccbe626e4c2fc9c224",
"triggerType" : "PUSH"
}, {
"hash" : "77d11131baabd1c4e3cc2050337daca4df5f6427",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "77d11131baabd1c4e3cc2050337daca4df5f6427",
"triggerType" : "PUSH"
}, {
"hash" : "3d9c2ae28da858d1e8476052c99391015effb7db",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "3d9c2ae28da858d1e8476052c99391015effb7db",
"triggerType" : "PUSH"
}, {
"hash" : "79ac9affcb7f81497e0df755c8200638d35b02b7",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5081",
"triggerID" : "79ac9affcb7f81497e0df755c8200638d35b02b7",
"triggerType" : "PUSH"
}, {
"hash" : "3c14bbe6c6bcf49c4164c45e82f77b473f4de396",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5113",
"triggerID" : "3c14bbe6c6bcf49c4164c45e82f77b473f4de396",
"triggerType" : "PUSH"
}, {
"hash" : "276f13d6efd00b301b232b286d585729c9d1d26e",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "276f13d6efd00b301b232b286d585729c9d1d26e",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 77d11131baabd1c4e3cc2050337daca4df5f6427 UNKNOWN
* 3d9c2ae28da858d1e8476052c99391015effb7db UNKNOWN
* 79ac9affcb7f81497e0df755c8200638d35b02b7 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5081)
* 3c14bbe6c6bcf49c4164c45e82f77b473f4de396 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5113)
* 276f13d6efd00b301b232b286d585729c9d1d26e UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #4556: [HUDI-3191][Stacked on 4531] Removing duplicating file-listing process w/in Hive's MOR `FIleInputFormat`s
Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #4556:
URL: https://github.com/apache/hudi/pull/4556#issuecomment-1010367217
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "d87786af43a7aeba7549cc3cfcbd97fc312bee0e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5074",
"triggerID" : "d87786af43a7aeba7549cc3cfcbd97fc312bee0e",
"triggerType" : "PUSH"
}, {
"hash" : "4b87ba1474be575ec27109ccbe626e4c2fc9c224",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5077",
"triggerID" : "4b87ba1474be575ec27109ccbe626e4c2fc9c224",
"triggerType" : "PUSH"
}, {
"hash" : "77d11131baabd1c4e3cc2050337daca4df5f6427",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "77d11131baabd1c4e3cc2050337daca4df5f6427",
"triggerType" : "PUSH"
}, {
"hash" : "3d9c2ae28da858d1e8476052c99391015effb7db",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "3d9c2ae28da858d1e8476052c99391015effb7db",
"triggerType" : "PUSH"
}, {
"hash" : "79ac9affcb7f81497e0df755c8200638d35b02b7",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5081",
"triggerID" : "79ac9affcb7f81497e0df755c8200638d35b02b7",
"triggerType" : "PUSH"
}, {
"hash" : "3c14bbe6c6bcf49c4164c45e82f77b473f4de396",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5113",
"triggerID" : "3c14bbe6c6bcf49c4164c45e82f77b473f4de396",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 77d11131baabd1c4e3cc2050337daca4df5f6427 UNKNOWN
* 3d9c2ae28da858d1e8476052c99391015effb7db UNKNOWN
* 79ac9affcb7f81497e0df755c8200638d35b02b7 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5081)
* 3c14bbe6c6bcf49c4164c45e82f77b473f4de396 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5113)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #4556: [HUDI-3191][Stacked on 4531] Removing duplicating file-listing process w/in Hive's MOR `FIleInputFormat`s
Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #4556:
URL: https://github.com/apache/hudi/pull/4556#issuecomment-1010613411
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "d87786af43a7aeba7549cc3cfcbd97fc312bee0e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5074",
"triggerID" : "d87786af43a7aeba7549cc3cfcbd97fc312bee0e",
"triggerType" : "PUSH"
}, {
"hash" : "4b87ba1474be575ec27109ccbe626e4c2fc9c224",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5077",
"triggerID" : "4b87ba1474be575ec27109ccbe626e4c2fc9c224",
"triggerType" : "PUSH"
}, {
"hash" : "77d11131baabd1c4e3cc2050337daca4df5f6427",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "77d11131baabd1c4e3cc2050337daca4df5f6427",
"triggerType" : "PUSH"
}, {
"hash" : "3d9c2ae28da858d1e8476052c99391015effb7db",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "3d9c2ae28da858d1e8476052c99391015effb7db",
"triggerType" : "PUSH"
}, {
"hash" : "79ac9affcb7f81497e0df755c8200638d35b02b7",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5081",
"triggerID" : "79ac9affcb7f81497e0df755c8200638d35b02b7",
"triggerType" : "PUSH"
}, {
"hash" : "3c14bbe6c6bcf49c4164c45e82f77b473f4de396",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5113",
"triggerID" : "3c14bbe6c6bcf49c4164c45e82f77b473f4de396",
"triggerType" : "PUSH"
}, {
"hash" : "276f13d6efd00b301b232b286d585729c9d1d26e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5116",
"triggerID" : "276f13d6efd00b301b232b286d585729c9d1d26e",
"triggerType" : "PUSH"
}, {
"hash" : "31b0669d7b638bd65a17b22a2ceb772f2627512c",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "31b0669d7b638bd65a17b22a2ceb772f2627512c",
"triggerType" : "PUSH"
}, {
"hash" : "096e26af39a477ffccbee0edd764493e12e15e71",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5124",
"triggerID" : "096e26af39a477ffccbee0edd764493e12e15e71",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 77d11131baabd1c4e3cc2050337daca4df5f6427 UNKNOWN
* 3d9c2ae28da858d1e8476052c99391015effb7db UNKNOWN
* 31b0669d7b638bd65a17b22a2ceb772f2627512c UNKNOWN
* 096e26af39a477ffccbee0edd764493e12e15e71 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5124)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #4556: [HUDI-3191][Stacked on 4531] Removing duplicating file-listing process w/in Hive's MOR `FIleInputFormat`s
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #4556:
URL: https://github.com/apache/hudi/pull/4556#issuecomment-1009483007
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "d87786af43a7aeba7549cc3cfcbd97fc312bee0e",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "d87786af43a7aeba7549cc3cfcbd97fc312bee0e",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* d87786af43a7aeba7549cc3cfcbd97fc312bee0e UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #4556: [HUDI-3191][Stacked on 4531] Removing duplicating file-listing process w/in Hive's MOR `FIleInputFormat`s
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #4556:
URL: https://github.com/apache/hudi/pull/4556#issuecomment-1009524295
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "d87786af43a7aeba7549cc3cfcbd97fc312bee0e",
"status" : "CANCELED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5074",
"triggerID" : "d87786af43a7aeba7549cc3cfcbd97fc312bee0e",
"triggerType" : "PUSH"
}, {
"hash" : "4b87ba1474be575ec27109ccbe626e4c2fc9c224",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5077",
"triggerID" : "4b87ba1474be575ec27109ccbe626e4c2fc9c224",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* d87786af43a7aeba7549cc3cfcbd97fc312bee0e Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5074)
* 4b87ba1474be575ec27109ccbe626e4c2fc9c224 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5077)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #4556: [HUDI-3191] Removing duplicating file-listing process w/in Hive's MOR `FileInputFormat`s
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #4556:
URL: https://github.com/apache/hudi/pull/4556#issuecomment-1020680629
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "d87786af43a7aeba7549cc3cfcbd97fc312bee0e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5074",
"triggerID" : "d87786af43a7aeba7549cc3cfcbd97fc312bee0e",
"triggerType" : "PUSH"
}, {
"hash" : "4b87ba1474be575ec27109ccbe626e4c2fc9c224",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5077",
"triggerID" : "4b87ba1474be575ec27109ccbe626e4c2fc9c224",
"triggerType" : "PUSH"
}, {
"hash" : "77d11131baabd1c4e3cc2050337daca4df5f6427",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "77d11131baabd1c4e3cc2050337daca4df5f6427",
"triggerType" : "PUSH"
}, {
"hash" : "3d9c2ae28da858d1e8476052c99391015effb7db",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "3d9c2ae28da858d1e8476052c99391015effb7db",
"triggerType" : "PUSH"
}, {
"hash" : "79ac9affcb7f81497e0df755c8200638d35b02b7",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5081",
"triggerID" : "79ac9affcb7f81497e0df755c8200638d35b02b7",
"triggerType" : "PUSH"
}, {
"hash" : "3c14bbe6c6bcf49c4164c45e82f77b473f4de396",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5113",
"triggerID" : "3c14bbe6c6bcf49c4164c45e82f77b473f4de396",
"triggerType" : "PUSH"
}, {
"hash" : "276f13d6efd00b301b232b286d585729c9d1d26e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5116",
"triggerID" : "276f13d6efd00b301b232b286d585729c9d1d26e",
"triggerType" : "PUSH"
}, {
"hash" : "31b0669d7b638bd65a17b22a2ceb772f2627512c",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "31b0669d7b638bd65a17b22a2ceb772f2627512c",
"triggerType" : "PUSH"
}, {
"hash" : "096e26af39a477ffccbee0edd764493e12e15e71",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5124",
"triggerID" : "096e26af39a477ffccbee0edd764493e12e15e71",
"triggerType" : "PUSH"
}, {
"hash" : "97dd5ec7c9246f6d9f467b9076b790dd6017c5b4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5213",
"triggerID" : "97dd5ec7c9246f6d9f467b9076b790dd6017c5b4",
"triggerType" : "PUSH"
}, {
"hash" : "0538475fe488089c4cb3bc0afb63c2f518329969",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5257",
"triggerID" : "0538475fe488089c4cb3bc0afb63c2f518329969",
"triggerType" : "PUSH"
}, {
"hash" : "9f4b334e340fb26004e1b07fc8fbaaa047c76775",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5261",
"triggerID" : "9f4b334e340fb26004e1b07fc8fbaaa047c76775",
"triggerType" : "PUSH"
}, {
"hash" : "368c099820c3cbf57496d0e46d1858aa8eb153ee",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5330",
"triggerID" : "368c099820c3cbf57496d0e46d1858aa8eb153ee",
"triggerType" : "PUSH"
}, {
"hash" : "28a5a4f537544d35dfcd8700a7b97fb7216682ce",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "28a5a4f537544d35dfcd8700a7b97fb7216682ce",
"triggerType" : "PUSH"
}, {
"hash" : "08ffdd8b47d147c9b5c889a5f56e39b9b140612d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5351",
"triggerID" : "08ffdd8b47d147c9b5c889a5f56e39b9b140612d",
"triggerType" : "PUSH"
}, {
"hash" : "c09e228f7cce78a7dbbc394e93b3cf8c6c3d4d5f",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "c09e228f7cce78a7dbbc394e93b3cf8c6c3d4d5f",
"triggerType" : "PUSH"
}, {
"hash" : "8dadbf672d4d27505592f18bc89422fd7c013669",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5398",
"triggerID" : "8dadbf672d4d27505592f18bc89422fd7c013669",
"triggerType" : "PUSH"
}, {
"hash" : "906607be5bd62ee1cbbda34acb6a89916c1f7aee",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5424",
"triggerID" : "906607be5bd62ee1cbbda34acb6a89916c1f7aee",
"triggerType" : "PUSH"
}, {
"hash" : "dc1b033f40cea9642f71b8fcff74aa82106726b6",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5484",
"triggerID" : "dc1b033f40cea9642f71b8fcff74aa82106726b6",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 77d11131baabd1c4e3cc2050337daca4df5f6427 UNKNOWN
* 3d9c2ae28da858d1e8476052c99391015effb7db UNKNOWN
* 31b0669d7b638bd65a17b22a2ceb772f2627512c UNKNOWN
* 28a5a4f537544d35dfcd8700a7b97fb7216682ce UNKNOWN
* c09e228f7cce78a7dbbc394e93b3cf8c6c3d4d5f UNKNOWN
* 906607be5bd62ee1cbbda34acb6a89916c1f7aee Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5424)
* dc1b033f40cea9642f71b8fcff74aa82106726b6 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5484)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] yihua commented on a change in pull request #4556: [HUDI-3191] Removing duplicating file-listing process w/in Hive's MOR `FileInputFormat`s
Posted by GitBox <gi...@apache.org>.
yihua commented on a change in pull request #4556:
URL: https://github.com/apache/hudi/pull/4556#discussion_r791234892
##########
File path: hudi-client/hudi-spark-client/src/test/java/org/apache/hudi/table/functional/TestHoodieSparkMergeOnReadTableRollback.java
##########
@@ -268,11 +281,13 @@ void testRollbackWithDeltaAndCompactionCommit(boolean rollbackUsingMarkers) thro
thirdClient.startCommitWithTime(newCommitTime);
writeStatusJavaRDD = thirdClient.upsert(writeRecords, newCommitTime);
+
statuses = writeStatusJavaRDD.collect();
- thirdClient.commit(newCommitTime, writeStatusJavaRDD);
// Verify there are no errors
assertNoWriteErrors(statuses);
+ thirdClient.commit(newCommitTime, jsc().parallelize(statuses));
+
Review comment:
No need to change these?
##########
File path: hudi-client/hudi-spark-client/src/test/java/org/apache/hudi/table/functional/TestHoodieSparkMergeOnReadTableInsertUpdateDelete.java
##########
@@ -213,8 +214,11 @@ public void testSimpleInsertUpdateAndDelete(boolean populateMetaFields) throws E
dataFilesToRead = tableView.getLatestBaseFiles();
assertTrue(dataFilesToRead.findAny().isPresent());
- List<String> dataFiles = tableView.getLatestBaseFiles().map(HoodieBaseFile::getPath).collect(Collectors.toList());
- List<GenericRecord> recordsRead = HoodieMergeOnReadTestUtils.getRecordsUsingInputFormat(hadoopConf(), dataFiles, basePath(), new JobConf(hadoopConf()), true, false);
+ List<String> inputPaths = tableView.getLatestBaseFiles()
+ .map(baseFile -> new Path(baseFile.getPath()).getParent().toString())
+ .collect(Collectors.toList());
Review comment:
Same here
##########
File path: hudi-client/hudi-spark-client/src/test/java/org/apache/hudi/table/functional/TestHoodieSparkMergeOnReadTableRollback.java
##########
@@ -166,10 +169,12 @@ void testRollbackWithDeltaAndCompactionCommit(boolean rollbackUsingMarkers) thro
JavaRDD<HoodieRecord> writeRecords = jsc().parallelize(records, 1);
JavaRDD<WriteStatus> writeStatusJavaRDD = client.upsert(writeRecords, newCommitTime);
- client.commit(newCommitTime, writeStatusJavaRDD);
+
List<WriteStatus> statuses = writeStatusJavaRDD.collect();
assertNoWriteErrors(statuses);
+ client.commit(newCommitTime, jsc().parallelize(statuses));
+
Review comment:
No need to change these lines?
##########
File path: hudi-client/hudi-spark-client/src/test/java/org/apache/hudi/table/functional/TestHoodieSparkMergeOnReadTableRollback.java
##########
@@ -201,8 +206,10 @@ void testRollbackWithDeltaAndCompactionCommit(boolean rollbackUsingMarkers) thro
copyOfRecords = dataGen.generateUpdates(commitTime1, copyOfRecords);
copyOfRecords.addAll(dataGen.generateInserts(commitTime1, 200));
- List<String> dataFiles = tableView.getLatestBaseFiles().map(HoodieBaseFile::getPath).collect(Collectors.toList());
- List<GenericRecord> recordsRead = HoodieMergeOnReadTestUtils.getRecordsUsingInputFormat(hadoopConf(), dataFiles,
+ List<String> inputPaths = tableView.getLatestBaseFiles()
+ .map(baseFile -> new Path(baseFile.getPath()).getParent().toString())
+ .collect(Collectors.toList());
Review comment:
Same here for duplicated partition paths and below.
##########
File path: hudi-client/hudi-spark-client/src/test/java/org/apache/hudi/table/TestHoodieMergeOnReadTable.java
##########
@@ -189,8 +190,10 @@ public void testUpsertPartitioner(boolean populateMetaFields) throws Exception {
assertTrue(fileIdToNewSize.entrySet().stream().anyMatch(entry -> fileIdToSize.get(entry.getKey()) < entry.getValue()));
- List<String> dataFiles = roView.getLatestBaseFiles().map(HoodieBaseFile::getPath).collect(Collectors.toList());
- List<GenericRecord> recordsRead = HoodieMergeOnReadTestUtils.getRecordsUsingInputFormat(hadoopConf(), dataFiles,
+ List<String> inputPaths = roView.getLatestBaseFiles()
+ .map(baseFile -> new Path(baseFile.getPath()).getParent().toString())
+ .collect(Collectors.toList());
Review comment:
This can include duplicated partition paths. Should `Set<String>` be used instead?
##########
File path: hudi-common/src/main/scala/org/apache/hudi/HoodieTableFileIndexBase.scala
##########
@@ -87,6 +89,12 @@ abstract class HoodieTableFileIndexBase(engineContext: HoodieEngineContext,
refresh0()
+ /**
+ * Returns latest completed instant as seen by this instance of the file-index
+ */
+ def latestCompletedInstant(): Option[HoodieInstant] =
Review comment:
nit: rename to `getLatestCompletedInstant`?
##########
File path: hudi-hadoop-mr/src/main/java/org/apache/hudi/hadoop/BootstrapBaseFileSplit.java
##########
@@ -32,10 +32,6 @@
private FileSplit bootstrapFileSplit;
- public BootstrapBaseFileSplit() {
- super();
- }
Review comment:
Are we sure this is not used outside Hudi repo by code in query engines, such as Presto/Trino? If not certain, we can keep it as is.
##########
File path: hudi-hadoop-mr/src/main/java/org/apache/hudi/hadoop/HoodieFileInputFormatBase.java
##########
@@ -143,6 +121,127 @@ private static FileStatus getFileStatusUnchecked(Option<HoodieBaseFile> baseFile
return returns.toArray(new FileStatus[0]);
}
+ private void validate(List<FileStatus> targetFiles, List<FileStatus> legacyFileStatuses) {
+ List<FileStatus> diff = CollectionUtils.diff(targetFiles, legacyFileStatuses);
+ checkState(diff.isEmpty(), "Should be empty");
+ }
+
+ @Nonnull
+ private static FileStatus getFileStatusUnchecked(HoodieBaseFile baseFile) {
+ try {
+ return HoodieInputFormatUtils.getFileStatus(baseFile);
+ } catch (IOException ioe) {
+ throw new HoodieIOException("Failed to get file-status", ioe);
+ }
+ }
+
+ /**
+ * Abstracts and exposes {@link FileInputFormat#listStatus(JobConf)} operation to subclasses that
+ * lists files (returning an array of {@link FileStatus}) corresponding to the input paths specified
+ * as part of provided {@link JobConf}
+ */
+ protected final FileStatus[] doListStatus(JobConf job) throws IOException {
+ return super.listStatus(job);
+ }
+
+ /**
+ * Achieves listStatus functionality for an incrementally queried table. Instead of listing all
+ * partitions and then filtering based on the commits of interest, this logic first extracts the
+ * partitions touched by the desired commits and then lists only those partitions.
+ */
+ protected List<FileStatus> listStatusForIncrementalMode(JobConf job,
+ HoodieTableMetaClient tableMetaClient,
+ List<Path> inputPaths,
+ String incrementalTable) throws IOException {
+ String tableName = tableMetaClient.getTableConfig().getTableName();
+ Job jobContext = Job.getInstance(job);
+ Option<HoodieTimeline> timeline = HoodieInputFormatUtils.getFilteredCommitsTimeline(jobContext, tableMetaClient);
+ if (!timeline.isPresent()) {
+ return null;
+ }
+ Option<List<HoodieInstant>> commitsToCheck = HoodieInputFormatUtils.getCommitsForIncrementalQuery(jobContext, tableName, timeline.get());
+ if (!commitsToCheck.isPresent()) {
+ return null;
+ }
+ Option<String> incrementalInputPaths = HoodieInputFormatUtils.getAffectedPartitions(commitsToCheck.get(), tableMetaClient, timeline.get(), inputPaths);
+ // Mutate the JobConf to set the input paths to only partitions touched by incremental pull.
+ if (!incrementalInputPaths.isPresent()) {
+ return null;
+ }
+ setInputPaths(job, incrementalInputPaths.get());
+ FileStatus[] fileStatuses = doListStatus(job);
+ return HoodieInputFormatUtils.filterIncrementalFileStatus(jobContext, tableMetaClient, timeline.get(), fileStatuses, commitsToCheck.get());
+ }
+
+ protected abstract boolean includeLogFilesForSnapshotView();
+
+ @Nonnull
+ private static RealtimeFileStatus createRealtimeFileStatusUnchecked(HoodieBaseFile baseFile,
+ Stream<HoodieLogFile> logFiles,
+ Option<HoodieInstant> latestCompletedInstantOpt,
+ HoodieTableMetaClient tableMetaClient) {
+ List<HoodieLogFile> sortedLogFiles = logFiles.sorted(HoodieLogFile.getLogFileComparator()).collect(Collectors.toList());
+ FileStatus baseFileStatus = getFileStatusUnchecked(baseFile);
+ try {
+ RealtimeFileStatus rtFileStatus = new RealtimeFileStatus(baseFileStatus);
+ rtFileStatus.setDeltaLogFiles(sortedLogFiles);
+ rtFileStatus.setBaseFilePath(baseFile.getPath());
+ rtFileStatus.setBasePath(tableMetaClient.getBasePath());
+
+ if (latestCompletedInstantOpt.isPresent()) {
+ HoodieInstant latestCompletedInstant = latestCompletedInstantOpt.get();
+ checkState(latestCompletedInstant.isCompleted());
+
+ rtFileStatus.setMaxCommitTime(latestCompletedInstant.getTimestamp());
+ }
+
+ if (baseFileStatus instanceof LocatedFileStatusWithBootstrapBaseFile || baseFileStatus instanceof FileStatusWithBootstrapBaseFile) {
+ rtFileStatus.setBootStrapFileStatus(baseFileStatus);
+ }
+
+ return rtFileStatus;
+ } catch (IOException e) {
+ throw new HoodieIOException(String.format("Failed to init %s", RealtimeFileStatus.class.getSimpleName()), e);
+ }
+ }
+
+ @Nonnull
+ private List<FileStatus> listStatusForSnapshotModeLegacy(JobConf job, Map<String, HoodieTableMetaClient> tableMetaClientMap, List<Path> snapshotPaths) throws IOException {
+ return HoodieInputFormatUtils.filterFileStatusForSnapshotMode(job, tableMetaClientMap, snapshotPaths, includeLogFilesForSnapshotView());
+ }
+
+ @Nonnull
+ private static RealtimeFileStatus createRealtimeFileStatusUnchecked(HoodieLogFile latestLogFile,
+ Stream<HoodieLogFile> logFiles,
+ Option<HoodieInstant> latestCompletedInstantOpt,
+ HoodieTableMetaClient tableMetaClient) {
+ List<HoodieLogFile> sortedLogFiles = logFiles.sorted(HoodieLogFile.getLogFileComparator()).collect(Collectors.toList());
+ try {
+ RealtimeFileStatus rtFileStatus = new RealtimeFileStatus(latestLogFile.getFileStatus());
+ rtFileStatus.setDeltaLogFiles(sortedLogFiles);
+ rtFileStatus.setBasePath(tableMetaClient.getBasePath());
+
+ if (latestCompletedInstantOpt.isPresent()) {
+ HoodieInstant latestCompletedInstant = latestCompletedInstantOpt.get();
+ checkState(latestCompletedInstant.isCompleted());
Review comment:
Do we need to keep this for production?
##########
File path: hudi-hadoop-mr/src/main/java/org/apache/hudi/hadoop/HoodieFileInputFormatBase.java
##########
@@ -143,6 +121,127 @@ private static FileStatus getFileStatusUnchecked(Option<HoodieBaseFile> baseFile
return returns.toArray(new FileStatus[0]);
}
+ private void validate(List<FileStatus> targetFiles, List<FileStatus> legacyFileStatuses) {
+ List<FileStatus> diff = CollectionUtils.diff(targetFiles, legacyFileStatuses);
+ checkState(diff.isEmpty(), "Should be empty");
+ }
+
+ @Nonnull
+ private static FileStatus getFileStatusUnchecked(HoodieBaseFile baseFile) {
+ try {
+ return HoodieInputFormatUtils.getFileStatus(baseFile);
+ } catch (IOException ioe) {
+ throw new HoodieIOException("Failed to get file-status", ioe);
+ }
+ }
+
+ /**
+ * Abstracts and exposes {@link FileInputFormat#listStatus(JobConf)} operation to subclasses that
+ * lists files (returning an array of {@link FileStatus}) corresponding to the input paths specified
+ * as part of provided {@link JobConf}
+ */
+ protected final FileStatus[] doListStatus(JobConf job) throws IOException {
+ return super.listStatus(job);
+ }
+
+ /**
+ * Achieves listStatus functionality for an incrementally queried table. Instead of listing all
+ * partitions and then filtering based on the commits of interest, this logic first extracts the
+ * partitions touched by the desired commits and then lists only those partitions.
+ */
+ protected List<FileStatus> listStatusForIncrementalMode(JobConf job,
+ HoodieTableMetaClient tableMetaClient,
+ List<Path> inputPaths,
+ String incrementalTable) throws IOException {
+ String tableName = tableMetaClient.getTableConfig().getTableName();
+ Job jobContext = Job.getInstance(job);
+ Option<HoodieTimeline> timeline = HoodieInputFormatUtils.getFilteredCommitsTimeline(jobContext, tableMetaClient);
+ if (!timeline.isPresent()) {
+ return null;
+ }
+ Option<List<HoodieInstant>> commitsToCheck = HoodieInputFormatUtils.getCommitsForIncrementalQuery(jobContext, tableName, timeline.get());
+ if (!commitsToCheck.isPresent()) {
+ return null;
+ }
+ Option<String> incrementalInputPaths = HoodieInputFormatUtils.getAffectedPartitions(commitsToCheck.get(), tableMetaClient, timeline.get(), inputPaths);
+ // Mutate the JobConf to set the input paths to only partitions touched by incremental pull.
+ if (!incrementalInputPaths.isPresent()) {
+ return null;
+ }
+ setInputPaths(job, incrementalInputPaths.get());
+ FileStatus[] fileStatuses = doListStatus(job);
+ return HoodieInputFormatUtils.filterIncrementalFileStatus(jobContext, tableMetaClient, timeline.get(), fileStatuses, commitsToCheck.get());
+ }
+
+ protected abstract boolean includeLogFilesForSnapshotView();
+
+ @Nonnull
+ private static RealtimeFileStatus createRealtimeFileStatusUnchecked(HoodieBaseFile baseFile,
+ Stream<HoodieLogFile> logFiles,
+ Option<HoodieInstant> latestCompletedInstantOpt,
+ HoodieTableMetaClient tableMetaClient) {
+ List<HoodieLogFile> sortedLogFiles = logFiles.sorted(HoodieLogFile.getLogFileComparator()).collect(Collectors.toList());
+ FileStatus baseFileStatus = getFileStatusUnchecked(baseFile);
+ try {
+ RealtimeFileStatus rtFileStatus = new RealtimeFileStatus(baseFileStatus);
+ rtFileStatus.setDeltaLogFiles(sortedLogFiles);
+ rtFileStatus.setBaseFilePath(baseFile.getPath());
+ rtFileStatus.setBasePath(tableMetaClient.getBasePath());
+
+ if (latestCompletedInstantOpt.isPresent()) {
+ HoodieInstant latestCompletedInstant = latestCompletedInstantOpt.get();
+ checkState(latestCompletedInstant.isCompleted());
+
+ rtFileStatus.setMaxCommitTime(latestCompletedInstant.getTimestamp());
+ }
+
+ if (baseFileStatus instanceof LocatedFileStatusWithBootstrapBaseFile || baseFileStatus instanceof FileStatusWithBootstrapBaseFile) {
+ rtFileStatus.setBootStrapFileStatus(baseFileStatus);
+ }
+
+ return rtFileStatus;
+ } catch (IOException e) {
+ throw new HoodieIOException(String.format("Failed to init %s", RealtimeFileStatus.class.getSimpleName()), e);
+ }
+ }
+
+ @Nonnull
+ private List<FileStatus> listStatusForSnapshotModeLegacy(JobConf job, Map<String, HoodieTableMetaClient> tableMetaClientMap, List<Path> snapshotPaths) throws IOException {
+ return HoodieInputFormatUtils.filterFileStatusForSnapshotMode(job, tableMetaClientMap, snapshotPaths, includeLogFilesForSnapshotView());
+ }
+
+ @Nonnull
+ private static RealtimeFileStatus createRealtimeFileStatusUnchecked(HoodieLogFile latestLogFile,
Review comment:
nit: add docs to explain what's included in the returned file status?
##########
File path: hudi-hadoop-mr/src/main/java/org/apache/hudi/hadoop/PathWithLogFilePath.java
##########
@@ -31,7 +31,7 @@
*/
public class PathWithLogFilePath extends Path {
// a flag to mark this split is produced by incremental query or not.
- private boolean belongToIncrementalPath = false;
+ private boolean belongsToIncrementalPath = false;
Review comment:
nit: I see quite some renaming in the PR. Can they be separated out to another PR from the refactoring?
##########
File path: hudi-hadoop-mr/src/main/java/org/apache/hudi/hadoop/HoodieFileInputFormatBase.java
##########
@@ -143,6 +121,124 @@ private static FileStatus getFileStatusUnchecked(Option<HoodieBaseFile> baseFile
return returns.toArray(new FileStatus[0]);
}
+ private void validate(List<FileStatus> targetFiles, List<FileStatus> legacyFileStatuses) {
Review comment:
Are most methods in this class reordered? Why not keep the same ordering so it's easier to check the changes?
##########
File path: hudi-hadoop-mr/src/main/java/org/apache/hudi/hadoop/realtime/HoodieRealtimeFileSplit.java
##########
@@ -44,9 +44,7 @@
private Option<HoodieVirtualKeyInfo> hoodieVirtualKeyInfo = Option.empty();
- public HoodieRealtimeFileSplit() {
- super();
Review comment:
Still need to call super class constructor?
##########
File path: hudi-hadoop-mr/src/main/java/org/apache/hudi/hadoop/utils/HoodieRealtimeInputFormatUtils.java
##########
@@ -65,11 +65,71 @@
import java.util.stream.Collectors;
import java.util.stream.Stream;
+import static org.apache.hudi.TypeUtils.unsafeCast;
+import static org.apache.hudi.common.util.ValidationUtils.checkState;
+
public class HoodieRealtimeInputFormatUtils extends HoodieInputFormatUtils {
private static final Logger LOG = LogManager.getLogger(HoodieRealtimeInputFormatUtils.class);
- public static InputSplit[] getRealtimeSplits(Configuration conf, Stream<FileSplit> fileSplits) {
+ public static InputSplit[] getRealtimeSplits(Configuration conf, List<FileSplit> fileSplits) throws IOException {
+ if (fileSplits.isEmpty()) {
+ return new InputSplit[0];
+ }
+
+ FileSplit fileSplit = fileSplits.get(0);
+
+ // Pre-process table-config to fetch virtual key info
+ Path partitionPath = fileSplit.getPath().getParent();
+ HoodieTableMetaClient metaClient = getTableMetaClientForBasePathUnchecked(conf, partitionPath);
+
+ Option<HoodieVirtualKeyInfo> hoodieVirtualKeyInfoOpt = getHoodieVirtualKeyInfo(metaClient);
+
+ // NOTE: This timeline is kept in sync w/ {@code HoodieTableFileIndexBase}
+ HoodieInstant latestCommitInstant =
+ metaClient.getActiveTimeline().getCommitsTimeline().filterCompletedInstants().lastInstant().get();
+
+ InputSplit[] finalSplits = fileSplits.stream()
+ .map(split -> {
+ // There are 4 types of splits could we have to handle here
+ // - {@code BootstrapBaseFileSplit}: in case base file does have associated bootstrap file,
+ // but does NOT have any log files appended (convert it to {@code RealtimeBootstrapBaseFileSplit})
+ // - {@code RealtimeBootstrapBaseFileSplit}: in case base file does have associated bootstrap file
+ // and does have log files appended
+ // - {@code BaseFileWithLogsSplit}: in case base file does NOT have associated bootstrap file
+ // and does have log files appended;
+ // - {@code FileSplit}: in case Hive passed down non-Hudi path
+ //
+ if (split instanceof RealtimeBootstrapBaseFileSplit) {
+ return split;
+ } else if (split instanceof BootstrapBaseFileSplit) {
+ BootstrapBaseFileSplit bootstrapBaseFileSplit = unsafeCast(split);
+ return createRealtimeBoostrapBaseFileSplit(
+ bootstrapBaseFileSplit,
+ metaClient.getBasePath(),
+ Collections.emptyList(),
+ latestCommitInstant.getTimestamp(),
+ false);
+ } else if (split instanceof BaseFileWithLogsSplit) {
+ BaseFileWithLogsSplit baseFileWithLogsSplit = unsafeCast(split);
+ return createHoodieRealtimeSplitUnchecked(baseFileWithLogsSplit, hoodieVirtualKeyInfoOpt);
+ } else {
+ // Non-Hudi paths might result in just generic {@code FileSplit} being
+ // propagated up to this point
+ return split;
+ }
+ })
+ .toArray(InputSplit[]::new);
Review comment:
This can be avoided if returning List<>.
##########
File path: hudi-hadoop-mr/src/main/java/org/apache/hudi/hadoop/utils/HoodieRealtimeInputFormatUtils.java
##########
@@ -144,28 +204,32 @@
return rtSplits.toArray(new InputSplit[0]);
}
+ /**
+ * @deprecated will be replaced w/ {@link #getRealtimeSplits(Configuration, List)}
+ */
// get IncrementalRealtimeSplits
- public static InputSplit[] getIncrementalRealtimeSplits(Configuration conf, Stream<FileSplit> fileSplits) throws IOException {
+ public static InputSplit[] getIncrementalRealtimeSplits(Configuration conf, List<FileSplit> fileSplits) throws IOException {
+ checkState(fileSplits.stream().allMatch(HoodieRealtimeInputFormatUtils::doesBelongToIncrementalQuery),
+ "All splits have to belong to incremental query");
+
List<InputSplit> rtSplits = new ArrayList<>();
- List<FileSplit> fileSplitList = fileSplits.collect(Collectors.toList());
- Set<Path> partitionSet = fileSplitList.stream().map(f -> f.getPath().getParent()).collect(Collectors.toSet());
+ Set<Path> partitionSet = fileSplits.stream().map(f -> f.getPath().getParent()).collect(Collectors.toSet());
Map<Path, HoodieTableMetaClient> partitionsToMetaClient = getTableMetaClientByPartitionPath(conf, partitionSet);
// Pre process tableConfig from first partition to fetch virtual key info
Option<HoodieVirtualKeyInfo> hoodieVirtualKeyInfo = Option.empty();
if (partitionSet.size() > 0) {
hoodieVirtualKeyInfo = getHoodieVirtualKeyInfo(partitionsToMetaClient.get(partitionSet.iterator().next()));
}
Option<HoodieVirtualKeyInfo> finalHoodieVirtualKeyInfo = hoodieVirtualKeyInfo;
- fileSplitList.stream().forEach(s -> {
+ fileSplits.stream().forEach(s -> {
// deal with incremental query.
try {
if (s instanceof BaseFileWithLogsSplit) {
- BaseFileWithLogsSplit bs = (BaseFileWithLogsSplit)s;
- if (bs.getBelongToIncrementalSplit()) {
- rtSplits.add(new HoodieRealtimeFileSplit(bs, bs.getBasePath(), bs.getDeltaLogFiles(), bs.getMaxCommitTime(), finalHoodieVirtualKeyInfo));
- }
+ BaseFileWithLogsSplit bs = unsafeCast(s);
+ rtSplits.add(new HoodieRealtimeFileSplit(bs, bs.getBasePath(), bs.getDeltaLogFiles(), bs.getMaxCommitTime(), finalHoodieVirtualKeyInfo));
} else if (s instanceof RealtimeBootstrapBaseFileSplit) {
- rtSplits.add(s);
+ RealtimeBootstrapBaseFileSplit bs = unsafeCast(s);
Review comment:
Is type cast redundant here?
##########
File path: hudi-client/hudi-spark-client/src/test/java/org/apache/hudi/table/functional/TestHoodieSparkMergeOnReadTableRollback.java
##########
@@ -361,15 +386,19 @@ void testMultiRollbackWithDeltaAndCompactionCommit() throws Exception {
copyOfRecords = dataGen.generateUpdates(newCommitTime, copyOfRecords);
copyOfRecords.addAll(dataGen.generateInserts(newCommitTime, 200));
- List<String> dataFiles = tableView.getLatestBaseFiles().map(hf -> hf.getPath()).collect(Collectors.toList());
+ List<String> dataFiles = tableView.getLatestBaseFiles()
+ .map(baseFile -> new Path(baseFile.getPath()).getParent().toString())
+ .collect(Collectors.toList());
List<GenericRecord> recordsRead = HoodieMergeOnReadTestUtils.getRecordsUsingInputFormat(hadoopConf(), dataFiles,
basePath());
assertEquals(200, recordsRead.size());
statuses = nClient.upsert(jsc().parallelize(copyOfRecords, 1), newCommitTime).collect();
// Verify there are no errors
assertNoWriteErrors(statuses);
- nClient.commit(newCommitTime, writeStatusJavaRDD);
+
+ nClient.commit(newCommitTime, jsc().parallelize(statuses));
+
Review comment:
Let's revert the cosmetic changes in this PR to make review easier. You can put up a separate PR for cleaning the code up.
##########
File path: hudi-client/hudi-spark-client/src/test/java/org/apache/hudi/table/functional/TestHoodieSparkMergeOnReadTableRollback.java
##########
@@ -516,8 +556,6 @@ void testMORTableRestore(boolean restoreAfterCompaction) throws Exception {
JavaRDD<HoodieRecord> writeRecords = jsc().parallelize(records, 1);
JavaRDD<WriteStatus> writeStatusJavaRDD = client.upsert(writeRecords, newCommitTime);
client.commit(newCommitTime, writeStatusJavaRDD);
- List<WriteStatus> statuses = writeStatusJavaRDD.collect();
- assertNoWriteErrors(statuses);
Review comment:
Still want to keep the check?
##########
File path: hudi-hadoop-mr/src/main/java/org/apache/hudi/hadoop/utils/HoodieInputFormatUtils.java
##########
@@ -440,6 +437,9 @@ public static HoodieMetadataConfig buildMetadataConfig(Configuration conf) {
.build();
}
+ /**
+ * @deprecated
+ */
Review comment:
Should be an actual annotation instead?
##########
File path: hudi-hadoop-mr/src/main/java/org/apache/hudi/hadoop/utils/HoodieRealtimeInputFormatUtils.java
##########
@@ -65,11 +65,71 @@
import java.util.stream.Collectors;
import java.util.stream.Stream;
+import static org.apache.hudi.TypeUtils.unsafeCast;
+import static org.apache.hudi.common.util.ValidationUtils.checkState;
+
public class HoodieRealtimeInputFormatUtils extends HoodieInputFormatUtils {
private static final Logger LOG = LogManager.getLogger(HoodieRealtimeInputFormatUtils.class);
- public static InputSplit[] getRealtimeSplits(Configuration conf, Stream<FileSplit> fileSplits) {
+ public static InputSplit[] getRealtimeSplits(Configuration conf, List<FileSplit> fileSplits) throws IOException {
+ if (fileSplits.isEmpty()) {
+ return new InputSplit[0];
+ }
+
+ FileSplit fileSplit = fileSplits.get(0);
+
+ // Pre-process table-config to fetch virtual key info
+ Path partitionPath = fileSplit.getPath().getParent();
+ HoodieTableMetaClient metaClient = getTableMetaClientForBasePathUnchecked(conf, partitionPath);
+
+ Option<HoodieVirtualKeyInfo> hoodieVirtualKeyInfoOpt = getHoodieVirtualKeyInfo(metaClient);
+
+ // NOTE: This timeline is kept in sync w/ {@code HoodieTableFileIndexBase}
+ HoodieInstant latestCommitInstant =
+ metaClient.getActiveTimeline().getCommitsTimeline().filterCompletedInstants().lastInstant().get();
+
+ InputSplit[] finalSplits = fileSplits.stream()
+ .map(split -> {
+ // There are 4 types of splits could we have to handle here
+ // - {@code BootstrapBaseFileSplit}: in case base file does have associated bootstrap file,
+ // but does NOT have any log files appended (convert it to {@code RealtimeBootstrapBaseFileSplit})
+ // - {@code RealtimeBootstrapBaseFileSplit}: in case base file does have associated bootstrap file
+ // and does have log files appended
+ // - {@code BaseFileWithLogsSplit}: in case base file does NOT have associated bootstrap file
+ // and does have log files appended;
+ // - {@code FileSplit}: in case Hive passed down non-Hudi path
+ //
+ if (split instanceof RealtimeBootstrapBaseFileSplit) {
+ return split;
+ } else if (split instanceof BootstrapBaseFileSplit) {
+ BootstrapBaseFileSplit bootstrapBaseFileSplit = unsafeCast(split);
+ return createRealtimeBoostrapBaseFileSplit(
+ bootstrapBaseFileSplit,
+ metaClient.getBasePath(),
+ Collections.emptyList(),
+ latestCommitInstant.getTimestamp(),
+ false);
+ } else if (split instanceof BaseFileWithLogsSplit) {
+ BaseFileWithLogsSplit baseFileWithLogsSplit = unsafeCast(split);
+ return createHoodieRealtimeSplitUnchecked(baseFileWithLogsSplit, hoodieVirtualKeyInfoOpt);
+ } else {
+ // Non-Hudi paths might result in just generic {@code FileSplit} being
+ // propagated up to this point
+ return split;
+ }
+ })
+ .toArray(InputSplit[]::new);
+
+ LOG.info("Returning a total splits of " + finalSplits.length);
+
+ return finalSplits;
+ }
+
+ /**
+ * @deprecated
+ */
Review comment:
Similar here.
##########
File path: hudi-hadoop-mr/src/main/java/org/apache/hudi/hadoop/utils/HoodieRealtimeInputFormatUtils.java
##########
@@ -65,11 +65,71 @@
import java.util.stream.Collectors;
import java.util.stream.Stream;
+import static org.apache.hudi.TypeUtils.unsafeCast;
+import static org.apache.hudi.common.util.ValidationUtils.checkState;
+
public class HoodieRealtimeInputFormatUtils extends HoodieInputFormatUtils {
private static final Logger LOG = LogManager.getLogger(HoodieRealtimeInputFormatUtils.class);
- public static InputSplit[] getRealtimeSplits(Configuration conf, Stream<FileSplit> fileSplits) {
+ public static InputSplit[] getRealtimeSplits(Configuration conf, List<FileSplit> fileSplits) throws IOException {
+ if (fileSplits.isEmpty()) {
+ return new InputSplit[0];
+ }
+
+ FileSplit fileSplit = fileSplits.get(0);
+
+ // Pre-process table-config to fetch virtual key info
+ Path partitionPath = fileSplit.getPath().getParent();
+ HoodieTableMetaClient metaClient = getTableMetaClientForBasePathUnchecked(conf, partitionPath);
+
+ Option<HoodieVirtualKeyInfo> hoodieVirtualKeyInfoOpt = getHoodieVirtualKeyInfo(metaClient);
+
+ // NOTE: This timeline is kept in sync w/ {@code HoodieTableFileIndexBase}
+ HoodieInstant latestCommitInstant =
+ metaClient.getActiveTimeline().getCommitsTimeline().filterCompletedInstants().lastInstant().get();
+
+ InputSplit[] finalSplits = fileSplits.stream()
+ .map(split -> {
+ // There are 4 types of splits could we have to handle here
+ // - {@code BootstrapBaseFileSplit}: in case base file does have associated bootstrap file,
+ // but does NOT have any log files appended (convert it to {@code RealtimeBootstrapBaseFileSplit})
+ // - {@code RealtimeBootstrapBaseFileSplit}: in case base file does have associated bootstrap file
+ // and does have log files appended
+ // - {@code BaseFileWithLogsSplit}: in case base file does NOT have associated bootstrap file
Review comment:
Should this scenario be considered here: base file does not have associated bootstrap file and does not have updates to it (i.e., no log files appended)?
##########
File path: hudi-hadoop-mr/src/main/java/org/apache/hudi/hadoop/realtime/RealtimeBootstrapBaseFileSplit.java
##########
@@ -43,17 +43,20 @@
private String basePath;
- public RealtimeBootstrapBaseFileSplit() {
- super();
- }
Review comment:
Similar here. Wondering what is the reason of keeping such empty-arg constructors in the first place, so maybe we should not remove them?
##########
File path: hudi-hadoop-mr/src/main/java/org/apache/hudi/hadoop/HoodieFileInputFormatBase.java
##########
@@ -143,6 +121,127 @@ private static FileStatus getFileStatusUnchecked(Option<HoodieBaseFile> baseFile
return returns.toArray(new FileStatus[0]);
}
+ private void validate(List<FileStatus> targetFiles, List<FileStatus> legacyFileStatuses) {
+ List<FileStatus> diff = CollectionUtils.diff(targetFiles, legacyFileStatuses);
+ checkState(diff.isEmpty(), "Should be empty");
+ }
+
+ @Nonnull
+ private static FileStatus getFileStatusUnchecked(HoodieBaseFile baseFile) {
+ try {
+ return HoodieInputFormatUtils.getFileStatus(baseFile);
+ } catch (IOException ioe) {
+ throw new HoodieIOException("Failed to get file-status", ioe);
+ }
+ }
+
+ /**
+ * Abstracts and exposes {@link FileInputFormat#listStatus(JobConf)} operation to subclasses that
+ * lists files (returning an array of {@link FileStatus}) corresponding to the input paths specified
+ * as part of provided {@link JobConf}
+ */
+ protected final FileStatus[] doListStatus(JobConf job) throws IOException {
+ return super.listStatus(job);
+ }
+
+ /**
+ * Achieves listStatus functionality for an incrementally queried table. Instead of listing all
+ * partitions and then filtering based on the commits of interest, this logic first extracts the
+ * partitions touched by the desired commits and then lists only those partitions.
+ */
+ protected List<FileStatus> listStatusForIncrementalMode(JobConf job,
+ HoodieTableMetaClient tableMetaClient,
+ List<Path> inputPaths,
+ String incrementalTable) throws IOException {
+ String tableName = tableMetaClient.getTableConfig().getTableName();
+ Job jobContext = Job.getInstance(job);
+ Option<HoodieTimeline> timeline = HoodieInputFormatUtils.getFilteredCommitsTimeline(jobContext, tableMetaClient);
+ if (!timeline.isPresent()) {
+ return null;
+ }
+ Option<List<HoodieInstant>> commitsToCheck = HoodieInputFormatUtils.getCommitsForIncrementalQuery(jobContext, tableName, timeline.get());
+ if (!commitsToCheck.isPresent()) {
+ return null;
+ }
+ Option<String> incrementalInputPaths = HoodieInputFormatUtils.getAffectedPartitions(commitsToCheck.get(), tableMetaClient, timeline.get(), inputPaths);
+ // Mutate the JobConf to set the input paths to only partitions touched by incremental pull.
+ if (!incrementalInputPaths.isPresent()) {
+ return null;
+ }
+ setInputPaths(job, incrementalInputPaths.get());
+ FileStatus[] fileStatuses = doListStatus(job);
+ return HoodieInputFormatUtils.filterIncrementalFileStatus(jobContext, tableMetaClient, timeline.get(), fileStatuses, commitsToCheck.get());
+ }
+
+ protected abstract boolean includeLogFilesForSnapshotView();
+
+ @Nonnull
+ private static RealtimeFileStatus createRealtimeFileStatusUnchecked(HoodieBaseFile baseFile,
Review comment:
It looks like this is newly added. Add docs to explain the purpose?
##########
File path: hudi-client/hudi-spark-client/src/test/java/org/apache/hudi/table/TestHoodieMergeOnReadTable.java
##########
@@ -189,8 +190,10 @@ public void testUpsertPartitioner(boolean populateMetaFields) throws Exception {
assertTrue(fileIdToNewSize.entrySet().stream().anyMatch(entry -> fileIdToSize.get(entry.getKey()) < entry.getValue()));
- List<String> dataFiles = roView.getLatestBaseFiles().map(HoodieBaseFile::getPath).collect(Collectors.toList());
- List<GenericRecord> recordsRead = HoodieMergeOnReadTestUtils.getRecordsUsingInputFormat(hadoopConf(), dataFiles,
+ List<String> inputPaths = roView.getLatestBaseFiles()
+ .map(baseFile -> new Path(baseFile.getPath()).getParent().toString())
+ .collect(Collectors.toList());
Review comment:
Looking at this again, are these changes and similar ones in other test classes legit? Basically, the list of results is changed from base file paths to partition paths.
##########
File path: hudi-hadoop-mr/src/main/java/org/apache/hudi/hadoop/utils/HoodieRealtimeInputFormatUtils.java
##########
@@ -65,11 +65,71 @@
import java.util.stream.Collectors;
import java.util.stream.Stream;
+import static org.apache.hudi.TypeUtils.unsafeCast;
+import static org.apache.hudi.common.util.ValidationUtils.checkState;
+
public class HoodieRealtimeInputFormatUtils extends HoodieInputFormatUtils {
private static final Logger LOG = LogManager.getLogger(HoodieRealtimeInputFormatUtils.class);
- public static InputSplit[] getRealtimeSplits(Configuration conf, Stream<FileSplit> fileSplits) {
+ public static InputSplit[] getRealtimeSplits(Configuration conf, List<FileSplit> fileSplits) throws IOException {
Review comment:
Any reason of sticking to the return type of array instead of List (for all getting-splits methods)?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] alexeykudinkin commented on pull request #4556: [HUDI-3191] Removing duplicating file-listing process w/in Hive's MOR `FileInputFormat`s
Posted by GitBox <gi...@apache.org>.
alexeykudinkin commented on pull request #4556:
URL: https://github.com/apache/hudi/pull/4556#issuecomment-1020803412
@yihua good call out. Idea is to remove duplicated file-listing operations w/in `HoodieInputFormatUtils.getRealtimeSplits` methods, leveraging file-structure fetched by `listFileStatus` w/in `InputFormat` impls.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #4556: [HUDI-3191][Stacked on 4531] Removing duplicating file-listing process w/in Hive's MOR `FIleInputFormat`s
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #4556:
URL: https://github.com/apache/hudi/pull/4556#issuecomment-1015856152
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "d87786af43a7aeba7549cc3cfcbd97fc312bee0e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5074",
"triggerID" : "d87786af43a7aeba7549cc3cfcbd97fc312bee0e",
"triggerType" : "PUSH"
}, {
"hash" : "4b87ba1474be575ec27109ccbe626e4c2fc9c224",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5077",
"triggerID" : "4b87ba1474be575ec27109ccbe626e4c2fc9c224",
"triggerType" : "PUSH"
}, {
"hash" : "77d11131baabd1c4e3cc2050337daca4df5f6427",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "77d11131baabd1c4e3cc2050337daca4df5f6427",
"triggerType" : "PUSH"
}, {
"hash" : "3d9c2ae28da858d1e8476052c99391015effb7db",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "3d9c2ae28da858d1e8476052c99391015effb7db",
"triggerType" : "PUSH"
}, {
"hash" : "79ac9affcb7f81497e0df755c8200638d35b02b7",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5081",
"triggerID" : "79ac9affcb7f81497e0df755c8200638d35b02b7",
"triggerType" : "PUSH"
}, {
"hash" : "3c14bbe6c6bcf49c4164c45e82f77b473f4de396",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5113",
"triggerID" : "3c14bbe6c6bcf49c4164c45e82f77b473f4de396",
"triggerType" : "PUSH"
}, {
"hash" : "276f13d6efd00b301b232b286d585729c9d1d26e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5116",
"triggerID" : "276f13d6efd00b301b232b286d585729c9d1d26e",
"triggerType" : "PUSH"
}, {
"hash" : "31b0669d7b638bd65a17b22a2ceb772f2627512c",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "31b0669d7b638bd65a17b22a2ceb772f2627512c",
"triggerType" : "PUSH"
}, {
"hash" : "096e26af39a477ffccbee0edd764493e12e15e71",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5124",
"triggerID" : "096e26af39a477ffccbee0edd764493e12e15e71",
"triggerType" : "PUSH"
}, {
"hash" : "97dd5ec7c9246f6d9f467b9076b790dd6017c5b4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5213",
"triggerID" : "97dd5ec7c9246f6d9f467b9076b790dd6017c5b4",
"triggerType" : "PUSH"
}, {
"hash" : "0538475fe488089c4cb3bc0afb63c2f518329969",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5257",
"triggerID" : "0538475fe488089c4cb3bc0afb63c2f518329969",
"triggerType" : "PUSH"
}, {
"hash" : "9f4b334e340fb26004e1b07fc8fbaaa047c76775",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5261",
"triggerID" : "9f4b334e340fb26004e1b07fc8fbaaa047c76775",
"triggerType" : "PUSH"
}, {
"hash" : "368c099820c3cbf57496d0e46d1858aa8eb153ee",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5330",
"triggerID" : "368c099820c3cbf57496d0e46d1858aa8eb153ee",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 77d11131baabd1c4e3cc2050337daca4df5f6427 UNKNOWN
* 3d9c2ae28da858d1e8476052c99391015effb7db UNKNOWN
* 31b0669d7b638bd65a17b22a2ceb772f2627512c UNKNOWN
* 368c099820c3cbf57496d0e46d1858aa8eb153ee Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5330)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #4556: [HUDI-3191] Removing duplicating file-listing process w/in Hive's MOR `FIleInputFormat`s
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #4556:
URL: https://github.com/apache/hudi/pull/4556#issuecomment-1017967886
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "d87786af43a7aeba7549cc3cfcbd97fc312bee0e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5074",
"triggerID" : "d87786af43a7aeba7549cc3cfcbd97fc312bee0e",
"triggerType" : "PUSH"
}, {
"hash" : "4b87ba1474be575ec27109ccbe626e4c2fc9c224",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5077",
"triggerID" : "4b87ba1474be575ec27109ccbe626e4c2fc9c224",
"triggerType" : "PUSH"
}, {
"hash" : "77d11131baabd1c4e3cc2050337daca4df5f6427",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "77d11131baabd1c4e3cc2050337daca4df5f6427",
"triggerType" : "PUSH"
}, {
"hash" : "3d9c2ae28da858d1e8476052c99391015effb7db",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "3d9c2ae28da858d1e8476052c99391015effb7db",
"triggerType" : "PUSH"
}, {
"hash" : "79ac9affcb7f81497e0df755c8200638d35b02b7",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5081",
"triggerID" : "79ac9affcb7f81497e0df755c8200638d35b02b7",
"triggerType" : "PUSH"
}, {
"hash" : "3c14bbe6c6bcf49c4164c45e82f77b473f4de396",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5113",
"triggerID" : "3c14bbe6c6bcf49c4164c45e82f77b473f4de396",
"triggerType" : "PUSH"
}, {
"hash" : "276f13d6efd00b301b232b286d585729c9d1d26e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5116",
"triggerID" : "276f13d6efd00b301b232b286d585729c9d1d26e",
"triggerType" : "PUSH"
}, {
"hash" : "31b0669d7b638bd65a17b22a2ceb772f2627512c",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "31b0669d7b638bd65a17b22a2ceb772f2627512c",
"triggerType" : "PUSH"
}, {
"hash" : "096e26af39a477ffccbee0edd764493e12e15e71",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5124",
"triggerID" : "096e26af39a477ffccbee0edd764493e12e15e71",
"triggerType" : "PUSH"
}, {
"hash" : "97dd5ec7c9246f6d9f467b9076b790dd6017c5b4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5213",
"triggerID" : "97dd5ec7c9246f6d9f467b9076b790dd6017c5b4",
"triggerType" : "PUSH"
}, {
"hash" : "0538475fe488089c4cb3bc0afb63c2f518329969",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5257",
"triggerID" : "0538475fe488089c4cb3bc0afb63c2f518329969",
"triggerType" : "PUSH"
}, {
"hash" : "9f4b334e340fb26004e1b07fc8fbaaa047c76775",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5261",
"triggerID" : "9f4b334e340fb26004e1b07fc8fbaaa047c76775",
"triggerType" : "PUSH"
}, {
"hash" : "368c099820c3cbf57496d0e46d1858aa8eb153ee",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5330",
"triggerID" : "368c099820c3cbf57496d0e46d1858aa8eb153ee",
"triggerType" : "PUSH"
}, {
"hash" : "28a5a4f537544d35dfcd8700a7b97fb7216682ce",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "28a5a4f537544d35dfcd8700a7b97fb7216682ce",
"triggerType" : "PUSH"
}, {
"hash" : "08ffdd8b47d147c9b5c889a5f56e39b9b140612d",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5351",
"triggerID" : "08ffdd8b47d147c9b5c889a5f56e39b9b140612d",
"triggerType" : "PUSH"
}, {
"hash" : "c09e228f7cce78a7dbbc394e93b3cf8c6c3d4d5f",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "c09e228f7cce78a7dbbc394e93b3cf8c6c3d4d5f",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 77d11131baabd1c4e3cc2050337daca4df5f6427 UNKNOWN
* 3d9c2ae28da858d1e8476052c99391015effb7db UNKNOWN
* 31b0669d7b638bd65a17b22a2ceb772f2627512c UNKNOWN
* 28a5a4f537544d35dfcd8700a7b97fb7216682ce UNKNOWN
* 08ffdd8b47d147c9b5c889a5f56e39b9b140612d Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5351)
* c09e228f7cce78a7dbbc394e93b3cf8c6c3d4d5f UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #4556: [HUDI-3191] Removing duplicating file-listing process w/in Hive's MOR `FileInputFormat`s
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #4556:
URL: https://github.com/apache/hudi/pull/4556#issuecomment-1018865352
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "d87786af43a7aeba7549cc3cfcbd97fc312bee0e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5074",
"triggerID" : "d87786af43a7aeba7549cc3cfcbd97fc312bee0e",
"triggerType" : "PUSH"
}, {
"hash" : "4b87ba1474be575ec27109ccbe626e4c2fc9c224",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5077",
"triggerID" : "4b87ba1474be575ec27109ccbe626e4c2fc9c224",
"triggerType" : "PUSH"
}, {
"hash" : "77d11131baabd1c4e3cc2050337daca4df5f6427",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "77d11131baabd1c4e3cc2050337daca4df5f6427",
"triggerType" : "PUSH"
}, {
"hash" : "3d9c2ae28da858d1e8476052c99391015effb7db",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "3d9c2ae28da858d1e8476052c99391015effb7db",
"triggerType" : "PUSH"
}, {
"hash" : "79ac9affcb7f81497e0df755c8200638d35b02b7",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5081",
"triggerID" : "79ac9affcb7f81497e0df755c8200638d35b02b7",
"triggerType" : "PUSH"
}, {
"hash" : "3c14bbe6c6bcf49c4164c45e82f77b473f4de396",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5113",
"triggerID" : "3c14bbe6c6bcf49c4164c45e82f77b473f4de396",
"triggerType" : "PUSH"
}, {
"hash" : "276f13d6efd00b301b232b286d585729c9d1d26e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5116",
"triggerID" : "276f13d6efd00b301b232b286d585729c9d1d26e",
"triggerType" : "PUSH"
}, {
"hash" : "31b0669d7b638bd65a17b22a2ceb772f2627512c",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "31b0669d7b638bd65a17b22a2ceb772f2627512c",
"triggerType" : "PUSH"
}, {
"hash" : "096e26af39a477ffccbee0edd764493e12e15e71",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5124",
"triggerID" : "096e26af39a477ffccbee0edd764493e12e15e71",
"triggerType" : "PUSH"
}, {
"hash" : "97dd5ec7c9246f6d9f467b9076b790dd6017c5b4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5213",
"triggerID" : "97dd5ec7c9246f6d9f467b9076b790dd6017c5b4",
"triggerType" : "PUSH"
}, {
"hash" : "0538475fe488089c4cb3bc0afb63c2f518329969",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5257",
"triggerID" : "0538475fe488089c4cb3bc0afb63c2f518329969",
"triggerType" : "PUSH"
}, {
"hash" : "9f4b334e340fb26004e1b07fc8fbaaa047c76775",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5261",
"triggerID" : "9f4b334e340fb26004e1b07fc8fbaaa047c76775",
"triggerType" : "PUSH"
}, {
"hash" : "368c099820c3cbf57496d0e46d1858aa8eb153ee",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5330",
"triggerID" : "368c099820c3cbf57496d0e46d1858aa8eb153ee",
"triggerType" : "PUSH"
}, {
"hash" : "28a5a4f537544d35dfcd8700a7b97fb7216682ce",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "28a5a4f537544d35dfcd8700a7b97fb7216682ce",
"triggerType" : "PUSH"
}, {
"hash" : "08ffdd8b47d147c9b5c889a5f56e39b9b140612d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5351",
"triggerID" : "08ffdd8b47d147c9b5c889a5f56e39b9b140612d",
"triggerType" : "PUSH"
}, {
"hash" : "c09e228f7cce78a7dbbc394e93b3cf8c6c3d4d5f",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "c09e228f7cce78a7dbbc394e93b3cf8c6c3d4d5f",
"triggerType" : "PUSH"
}, {
"hash" : "8dadbf672d4d27505592f18bc89422fd7c013669",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5398",
"triggerID" : "8dadbf672d4d27505592f18bc89422fd7c013669",
"triggerType" : "PUSH"
}, {
"hash" : "906607be5bd62ee1cbbda34acb6a89916c1f7aee",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5424",
"triggerID" : "906607be5bd62ee1cbbda34acb6a89916c1f7aee",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 77d11131baabd1c4e3cc2050337daca4df5f6427 UNKNOWN
* 3d9c2ae28da858d1e8476052c99391015effb7db UNKNOWN
* 31b0669d7b638bd65a17b22a2ceb772f2627512c UNKNOWN
* 28a5a4f537544d35dfcd8700a7b97fb7216682ce UNKNOWN
* c09e228f7cce78a7dbbc394e93b3cf8c6c3d4d5f UNKNOWN
* 8dadbf672d4d27505592f18bc89422fd7c013669 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5398)
* 906607be5bd62ee1cbbda34acb6a89916c1f7aee Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5424)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #4556: [HUDI-3191] Removing duplicating file-listing process w/in Hive's MOR `FileInputFormat`s
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #4556:
URL: https://github.com/apache/hudi/pull/4556#issuecomment-1020675804
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #4556: [HUDI-3191][Stacked on 4716] Removing duplicating file-listing process w/in Hive's MOR `FileInputFormat`s
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #4556:
URL: https://github.com/apache/hudi/pull/4556#issuecomment-1024819714
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "d87786af43a7aeba7549cc3cfcbd97fc312bee0e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5074",
"triggerID" : "d87786af43a7aeba7549cc3cfcbd97fc312bee0e",
"triggerType" : "PUSH"
}, {
"hash" : "4b87ba1474be575ec27109ccbe626e4c2fc9c224",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5077",
"triggerID" : "4b87ba1474be575ec27109ccbe626e4c2fc9c224",
"triggerType" : "PUSH"
}, {
"hash" : "77d11131baabd1c4e3cc2050337daca4df5f6427",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "77d11131baabd1c4e3cc2050337daca4df5f6427",
"triggerType" : "PUSH"
}, {
"hash" : "3d9c2ae28da858d1e8476052c99391015effb7db",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "3d9c2ae28da858d1e8476052c99391015effb7db",
"triggerType" : "PUSH"
}, {
"hash" : "79ac9affcb7f81497e0df755c8200638d35b02b7",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5081",
"triggerID" : "79ac9affcb7f81497e0df755c8200638d35b02b7",
"triggerType" : "PUSH"
}, {
"hash" : "3c14bbe6c6bcf49c4164c45e82f77b473f4de396",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5113",
"triggerID" : "3c14bbe6c6bcf49c4164c45e82f77b473f4de396",
"triggerType" : "PUSH"
}, {
"hash" : "276f13d6efd00b301b232b286d585729c9d1d26e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5116",
"triggerID" : "276f13d6efd00b301b232b286d585729c9d1d26e",
"triggerType" : "PUSH"
}, {
"hash" : "31b0669d7b638bd65a17b22a2ceb772f2627512c",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "31b0669d7b638bd65a17b22a2ceb772f2627512c",
"triggerType" : "PUSH"
}, {
"hash" : "096e26af39a477ffccbee0edd764493e12e15e71",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5124",
"triggerID" : "096e26af39a477ffccbee0edd764493e12e15e71",
"triggerType" : "PUSH"
}, {
"hash" : "97dd5ec7c9246f6d9f467b9076b790dd6017c5b4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5213",
"triggerID" : "97dd5ec7c9246f6d9f467b9076b790dd6017c5b4",
"triggerType" : "PUSH"
}, {
"hash" : "0538475fe488089c4cb3bc0afb63c2f518329969",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5257",
"triggerID" : "0538475fe488089c4cb3bc0afb63c2f518329969",
"triggerType" : "PUSH"
}, {
"hash" : "9f4b334e340fb26004e1b07fc8fbaaa047c76775",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5261",
"triggerID" : "9f4b334e340fb26004e1b07fc8fbaaa047c76775",
"triggerType" : "PUSH"
}, {
"hash" : "368c099820c3cbf57496d0e46d1858aa8eb153ee",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5330",
"triggerID" : "368c099820c3cbf57496d0e46d1858aa8eb153ee",
"triggerType" : "PUSH"
}, {
"hash" : "28a5a4f537544d35dfcd8700a7b97fb7216682ce",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "28a5a4f537544d35dfcd8700a7b97fb7216682ce",
"triggerType" : "PUSH"
}, {
"hash" : "08ffdd8b47d147c9b5c889a5f56e39b9b140612d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5351",
"triggerID" : "08ffdd8b47d147c9b5c889a5f56e39b9b140612d",
"triggerType" : "PUSH"
}, {
"hash" : "c09e228f7cce78a7dbbc394e93b3cf8c6c3d4d5f",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "c09e228f7cce78a7dbbc394e93b3cf8c6c3d4d5f",
"triggerType" : "PUSH"
}, {
"hash" : "8dadbf672d4d27505592f18bc89422fd7c013669",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5398",
"triggerID" : "8dadbf672d4d27505592f18bc89422fd7c013669",
"triggerType" : "PUSH"
}, {
"hash" : "906607be5bd62ee1cbbda34acb6a89916c1f7aee",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5424",
"triggerID" : "906607be5bd62ee1cbbda34acb6a89916c1f7aee",
"triggerType" : "PUSH"
}, {
"hash" : "dc1b033f40cea9642f71b8fcff74aa82106726b6",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5484",
"triggerID" : "dc1b033f40cea9642f71b8fcff74aa82106726b6",
"triggerType" : "PUSH"
}, {
"hash" : "5b8f5819fff8fec34864eb409fd429b95be17b9b",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "5b8f5819fff8fec34864eb409fd429b95be17b9b",
"triggerType" : "PUSH"
}, {
"hash" : "13702fc2232ebd9300966b0a917a3358d8d0f18c",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5590",
"triggerID" : "13702fc2232ebd9300966b0a917a3358d8d0f18c",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 77d11131baabd1c4e3cc2050337daca4df5f6427 UNKNOWN
* 3d9c2ae28da858d1e8476052c99391015effb7db UNKNOWN
* 31b0669d7b638bd65a17b22a2ceb772f2627512c UNKNOWN
* 28a5a4f537544d35dfcd8700a7b97fb7216682ce UNKNOWN
* c09e228f7cce78a7dbbc394e93b3cf8c6c3d4d5f UNKNOWN
* 5b8f5819fff8fec34864eb409fd429b95be17b9b UNKNOWN
* 13702fc2232ebd9300966b0a917a3358d8d0f18c Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5590)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #4556: [HUDI-3191][Stacked on 4716] Removing duplicating file-listing process w/in Hive's MOR `FileInputFormat`s
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #4556:
URL: https://github.com/apache/hudi/pull/4556#issuecomment-1026391541
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "d87786af43a7aeba7549cc3cfcbd97fc312bee0e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5074",
"triggerID" : "d87786af43a7aeba7549cc3cfcbd97fc312bee0e",
"triggerType" : "PUSH"
}, {
"hash" : "4b87ba1474be575ec27109ccbe626e4c2fc9c224",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5077",
"triggerID" : "4b87ba1474be575ec27109ccbe626e4c2fc9c224",
"triggerType" : "PUSH"
}, {
"hash" : "77d11131baabd1c4e3cc2050337daca4df5f6427",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "77d11131baabd1c4e3cc2050337daca4df5f6427",
"triggerType" : "PUSH"
}, {
"hash" : "3d9c2ae28da858d1e8476052c99391015effb7db",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "3d9c2ae28da858d1e8476052c99391015effb7db",
"triggerType" : "PUSH"
}, {
"hash" : "79ac9affcb7f81497e0df755c8200638d35b02b7",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5081",
"triggerID" : "79ac9affcb7f81497e0df755c8200638d35b02b7",
"triggerType" : "PUSH"
}, {
"hash" : "3c14bbe6c6bcf49c4164c45e82f77b473f4de396",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5113",
"triggerID" : "3c14bbe6c6bcf49c4164c45e82f77b473f4de396",
"triggerType" : "PUSH"
}, {
"hash" : "276f13d6efd00b301b232b286d585729c9d1d26e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5116",
"triggerID" : "276f13d6efd00b301b232b286d585729c9d1d26e",
"triggerType" : "PUSH"
}, {
"hash" : "31b0669d7b638bd65a17b22a2ceb772f2627512c",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "31b0669d7b638bd65a17b22a2ceb772f2627512c",
"triggerType" : "PUSH"
}, {
"hash" : "096e26af39a477ffccbee0edd764493e12e15e71",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5124",
"triggerID" : "096e26af39a477ffccbee0edd764493e12e15e71",
"triggerType" : "PUSH"
}, {
"hash" : "97dd5ec7c9246f6d9f467b9076b790dd6017c5b4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5213",
"triggerID" : "97dd5ec7c9246f6d9f467b9076b790dd6017c5b4",
"triggerType" : "PUSH"
}, {
"hash" : "0538475fe488089c4cb3bc0afb63c2f518329969",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5257",
"triggerID" : "0538475fe488089c4cb3bc0afb63c2f518329969",
"triggerType" : "PUSH"
}, {
"hash" : "9f4b334e340fb26004e1b07fc8fbaaa047c76775",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5261",
"triggerID" : "9f4b334e340fb26004e1b07fc8fbaaa047c76775",
"triggerType" : "PUSH"
}, {
"hash" : "368c099820c3cbf57496d0e46d1858aa8eb153ee",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5330",
"triggerID" : "368c099820c3cbf57496d0e46d1858aa8eb153ee",
"triggerType" : "PUSH"
}, {
"hash" : "28a5a4f537544d35dfcd8700a7b97fb7216682ce",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "28a5a4f537544d35dfcd8700a7b97fb7216682ce",
"triggerType" : "PUSH"
}, {
"hash" : "08ffdd8b47d147c9b5c889a5f56e39b9b140612d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5351",
"triggerID" : "08ffdd8b47d147c9b5c889a5f56e39b9b140612d",
"triggerType" : "PUSH"
}, {
"hash" : "c09e228f7cce78a7dbbc394e93b3cf8c6c3d4d5f",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "c09e228f7cce78a7dbbc394e93b3cf8c6c3d4d5f",
"triggerType" : "PUSH"
}, {
"hash" : "8dadbf672d4d27505592f18bc89422fd7c013669",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5398",
"triggerID" : "8dadbf672d4d27505592f18bc89422fd7c013669",
"triggerType" : "PUSH"
}, {
"hash" : "906607be5bd62ee1cbbda34acb6a89916c1f7aee",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5424",
"triggerID" : "906607be5bd62ee1cbbda34acb6a89916c1f7aee",
"triggerType" : "PUSH"
}, {
"hash" : "dc1b033f40cea9642f71b8fcff74aa82106726b6",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5484",
"triggerID" : "dc1b033f40cea9642f71b8fcff74aa82106726b6",
"triggerType" : "PUSH"
}, {
"hash" : "5b8f5819fff8fec34864eb409fd429b95be17b9b",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "5b8f5819fff8fec34864eb409fd429b95be17b9b",
"triggerType" : "PUSH"
}, {
"hash" : "13702fc2232ebd9300966b0a917a3358d8d0f18c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5590",
"triggerID" : "13702fc2232ebd9300966b0a917a3358d8d0f18c",
"triggerType" : "PUSH"
}, {
"hash" : "13702fc2232ebd9300966b0a917a3358d8d0f18c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5600",
"triggerID" : "1024845655",
"triggerType" : "MANUAL"
}, {
"hash" : "9bdd8a60f95123f82a5f30f5e68929f5b7e1f8da",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5603",
"triggerID" : "9bdd8a60f95123f82a5f30f5e68929f5b7e1f8da",
"triggerType" : "PUSH"
}, {
"hash" : "aebb9df557c4afe3ca88f6b8b28ba2fbfdcbd597",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5631",
"triggerID" : "aebb9df557c4afe3ca88f6b8b28ba2fbfdcbd597",
"triggerType" : "PUSH"
}, {
"hash" : "5d37935bc8bb33260735d782ca560fd59e02f321",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "5d37935bc8bb33260735d782ca560fd59e02f321",
"triggerType" : "PUSH"
}, {
"hash" : "f911d869f50009e5cd9f3fd341c83c732d7531ba",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "f911d869f50009e5cd9f3fd341c83c732d7531ba",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 77d11131baabd1c4e3cc2050337daca4df5f6427 UNKNOWN
* 3d9c2ae28da858d1e8476052c99391015effb7db UNKNOWN
* 31b0669d7b638bd65a17b22a2ceb772f2627512c UNKNOWN
* 28a5a4f537544d35dfcd8700a7b97fb7216682ce UNKNOWN
* c09e228f7cce78a7dbbc394e93b3cf8c6c3d4d5f UNKNOWN
* 5b8f5819fff8fec34864eb409fd429b95be17b9b UNKNOWN
* aebb9df557c4afe3ca88f6b8b28ba2fbfdcbd597 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5631)
* 5d37935bc8bb33260735d782ca560fd59e02f321 UNKNOWN
* f911d869f50009e5cd9f3fd341c83c732d7531ba UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #4556: [HUDI-3191][Stacked on 4716] Removing duplicating file-listing process w/in Hive's MOR `FileInputFormat`s
Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #4556:
URL: https://github.com/apache/hudi/pull/4556#issuecomment-1026395676
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "d87786af43a7aeba7549cc3cfcbd97fc312bee0e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5074",
"triggerID" : "d87786af43a7aeba7549cc3cfcbd97fc312bee0e",
"triggerType" : "PUSH"
}, {
"hash" : "4b87ba1474be575ec27109ccbe626e4c2fc9c224",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5077",
"triggerID" : "4b87ba1474be575ec27109ccbe626e4c2fc9c224",
"triggerType" : "PUSH"
}, {
"hash" : "77d11131baabd1c4e3cc2050337daca4df5f6427",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "77d11131baabd1c4e3cc2050337daca4df5f6427",
"triggerType" : "PUSH"
}, {
"hash" : "3d9c2ae28da858d1e8476052c99391015effb7db",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "3d9c2ae28da858d1e8476052c99391015effb7db",
"triggerType" : "PUSH"
}, {
"hash" : "79ac9affcb7f81497e0df755c8200638d35b02b7",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5081",
"triggerID" : "79ac9affcb7f81497e0df755c8200638d35b02b7",
"triggerType" : "PUSH"
}, {
"hash" : "3c14bbe6c6bcf49c4164c45e82f77b473f4de396",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5113",
"triggerID" : "3c14bbe6c6bcf49c4164c45e82f77b473f4de396",
"triggerType" : "PUSH"
}, {
"hash" : "276f13d6efd00b301b232b286d585729c9d1d26e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5116",
"triggerID" : "276f13d6efd00b301b232b286d585729c9d1d26e",
"triggerType" : "PUSH"
}, {
"hash" : "31b0669d7b638bd65a17b22a2ceb772f2627512c",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "31b0669d7b638bd65a17b22a2ceb772f2627512c",
"triggerType" : "PUSH"
}, {
"hash" : "096e26af39a477ffccbee0edd764493e12e15e71",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5124",
"triggerID" : "096e26af39a477ffccbee0edd764493e12e15e71",
"triggerType" : "PUSH"
}, {
"hash" : "97dd5ec7c9246f6d9f467b9076b790dd6017c5b4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5213",
"triggerID" : "97dd5ec7c9246f6d9f467b9076b790dd6017c5b4",
"triggerType" : "PUSH"
}, {
"hash" : "0538475fe488089c4cb3bc0afb63c2f518329969",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5257",
"triggerID" : "0538475fe488089c4cb3bc0afb63c2f518329969",
"triggerType" : "PUSH"
}, {
"hash" : "9f4b334e340fb26004e1b07fc8fbaaa047c76775",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5261",
"triggerID" : "9f4b334e340fb26004e1b07fc8fbaaa047c76775",
"triggerType" : "PUSH"
}, {
"hash" : "368c099820c3cbf57496d0e46d1858aa8eb153ee",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5330",
"triggerID" : "368c099820c3cbf57496d0e46d1858aa8eb153ee",
"triggerType" : "PUSH"
}, {
"hash" : "28a5a4f537544d35dfcd8700a7b97fb7216682ce",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "28a5a4f537544d35dfcd8700a7b97fb7216682ce",
"triggerType" : "PUSH"
}, {
"hash" : "08ffdd8b47d147c9b5c889a5f56e39b9b140612d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5351",
"triggerID" : "08ffdd8b47d147c9b5c889a5f56e39b9b140612d",
"triggerType" : "PUSH"
}, {
"hash" : "c09e228f7cce78a7dbbc394e93b3cf8c6c3d4d5f",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "c09e228f7cce78a7dbbc394e93b3cf8c6c3d4d5f",
"triggerType" : "PUSH"
}, {
"hash" : "8dadbf672d4d27505592f18bc89422fd7c013669",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5398",
"triggerID" : "8dadbf672d4d27505592f18bc89422fd7c013669",
"triggerType" : "PUSH"
}, {
"hash" : "906607be5bd62ee1cbbda34acb6a89916c1f7aee",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5424",
"triggerID" : "906607be5bd62ee1cbbda34acb6a89916c1f7aee",
"triggerType" : "PUSH"
}, {
"hash" : "dc1b033f40cea9642f71b8fcff74aa82106726b6",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5484",
"triggerID" : "dc1b033f40cea9642f71b8fcff74aa82106726b6",
"triggerType" : "PUSH"
}, {
"hash" : "5b8f5819fff8fec34864eb409fd429b95be17b9b",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "5b8f5819fff8fec34864eb409fd429b95be17b9b",
"triggerType" : "PUSH"
}, {
"hash" : "13702fc2232ebd9300966b0a917a3358d8d0f18c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5590",
"triggerID" : "13702fc2232ebd9300966b0a917a3358d8d0f18c",
"triggerType" : "PUSH"
}, {
"hash" : "13702fc2232ebd9300966b0a917a3358d8d0f18c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5600",
"triggerID" : "1024845655",
"triggerType" : "MANUAL"
}, {
"hash" : "9bdd8a60f95123f82a5f30f5e68929f5b7e1f8da",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5603",
"triggerID" : "9bdd8a60f95123f82a5f30f5e68929f5b7e1f8da",
"triggerType" : "PUSH"
}, {
"hash" : "aebb9df557c4afe3ca88f6b8b28ba2fbfdcbd597",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5631",
"triggerID" : "aebb9df557c4afe3ca88f6b8b28ba2fbfdcbd597",
"triggerType" : "PUSH"
}, {
"hash" : "5d37935bc8bb33260735d782ca560fd59e02f321",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "5d37935bc8bb33260735d782ca560fd59e02f321",
"triggerType" : "PUSH"
}, {
"hash" : "f911d869f50009e5cd9f3fd341c83c732d7531ba",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5634",
"triggerID" : "f911d869f50009e5cd9f3fd341c83c732d7531ba",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 77d11131baabd1c4e3cc2050337daca4df5f6427 UNKNOWN
* 3d9c2ae28da858d1e8476052c99391015effb7db UNKNOWN
* 31b0669d7b638bd65a17b22a2ceb772f2627512c UNKNOWN
* 28a5a4f537544d35dfcd8700a7b97fb7216682ce UNKNOWN
* c09e228f7cce78a7dbbc394e93b3cf8c6c3d4d5f UNKNOWN
* 5b8f5819fff8fec34864eb409fd429b95be17b9b UNKNOWN
* aebb9df557c4afe3ca88f6b8b28ba2fbfdcbd597 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5631)
* 5d37935bc8bb33260735d782ca560fd59e02f321 UNKNOWN
* f911d869f50009e5cd9f3fd341c83c732d7531ba Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5634)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #4556: [HUDI-3191][Stacked on 4716] Removing duplicating file-listing process w/in Hive's MOR `FileInputFormat`s
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #4556:
URL: https://github.com/apache/hudi/pull/4556#issuecomment-1027052028
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "d87786af43a7aeba7549cc3cfcbd97fc312bee0e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5074",
"triggerID" : "d87786af43a7aeba7549cc3cfcbd97fc312bee0e",
"triggerType" : "PUSH"
}, {
"hash" : "4b87ba1474be575ec27109ccbe626e4c2fc9c224",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5077",
"triggerID" : "4b87ba1474be575ec27109ccbe626e4c2fc9c224",
"triggerType" : "PUSH"
}, {
"hash" : "77d11131baabd1c4e3cc2050337daca4df5f6427",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "77d11131baabd1c4e3cc2050337daca4df5f6427",
"triggerType" : "PUSH"
}, {
"hash" : "3d9c2ae28da858d1e8476052c99391015effb7db",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "3d9c2ae28da858d1e8476052c99391015effb7db",
"triggerType" : "PUSH"
}, {
"hash" : "79ac9affcb7f81497e0df755c8200638d35b02b7",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5081",
"triggerID" : "79ac9affcb7f81497e0df755c8200638d35b02b7",
"triggerType" : "PUSH"
}, {
"hash" : "3c14bbe6c6bcf49c4164c45e82f77b473f4de396",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5113",
"triggerID" : "3c14bbe6c6bcf49c4164c45e82f77b473f4de396",
"triggerType" : "PUSH"
}, {
"hash" : "276f13d6efd00b301b232b286d585729c9d1d26e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5116",
"triggerID" : "276f13d6efd00b301b232b286d585729c9d1d26e",
"triggerType" : "PUSH"
}, {
"hash" : "31b0669d7b638bd65a17b22a2ceb772f2627512c",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "31b0669d7b638bd65a17b22a2ceb772f2627512c",
"triggerType" : "PUSH"
}, {
"hash" : "096e26af39a477ffccbee0edd764493e12e15e71",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5124",
"triggerID" : "096e26af39a477ffccbee0edd764493e12e15e71",
"triggerType" : "PUSH"
}, {
"hash" : "97dd5ec7c9246f6d9f467b9076b790dd6017c5b4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5213",
"triggerID" : "97dd5ec7c9246f6d9f467b9076b790dd6017c5b4",
"triggerType" : "PUSH"
}, {
"hash" : "0538475fe488089c4cb3bc0afb63c2f518329969",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5257",
"triggerID" : "0538475fe488089c4cb3bc0afb63c2f518329969",
"triggerType" : "PUSH"
}, {
"hash" : "9f4b334e340fb26004e1b07fc8fbaaa047c76775",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5261",
"triggerID" : "9f4b334e340fb26004e1b07fc8fbaaa047c76775",
"triggerType" : "PUSH"
}, {
"hash" : "368c099820c3cbf57496d0e46d1858aa8eb153ee",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5330",
"triggerID" : "368c099820c3cbf57496d0e46d1858aa8eb153ee",
"triggerType" : "PUSH"
}, {
"hash" : "28a5a4f537544d35dfcd8700a7b97fb7216682ce",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "28a5a4f537544d35dfcd8700a7b97fb7216682ce",
"triggerType" : "PUSH"
}, {
"hash" : "08ffdd8b47d147c9b5c889a5f56e39b9b140612d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5351",
"triggerID" : "08ffdd8b47d147c9b5c889a5f56e39b9b140612d",
"triggerType" : "PUSH"
}, {
"hash" : "c09e228f7cce78a7dbbc394e93b3cf8c6c3d4d5f",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "c09e228f7cce78a7dbbc394e93b3cf8c6c3d4d5f",
"triggerType" : "PUSH"
}, {
"hash" : "8dadbf672d4d27505592f18bc89422fd7c013669",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5398",
"triggerID" : "8dadbf672d4d27505592f18bc89422fd7c013669",
"triggerType" : "PUSH"
}, {
"hash" : "906607be5bd62ee1cbbda34acb6a89916c1f7aee",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5424",
"triggerID" : "906607be5bd62ee1cbbda34acb6a89916c1f7aee",
"triggerType" : "PUSH"
}, {
"hash" : "dc1b033f40cea9642f71b8fcff74aa82106726b6",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5484",
"triggerID" : "dc1b033f40cea9642f71b8fcff74aa82106726b6",
"triggerType" : "PUSH"
}, {
"hash" : "5b8f5819fff8fec34864eb409fd429b95be17b9b",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "5b8f5819fff8fec34864eb409fd429b95be17b9b",
"triggerType" : "PUSH"
}, {
"hash" : "13702fc2232ebd9300966b0a917a3358d8d0f18c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5590",
"triggerID" : "13702fc2232ebd9300966b0a917a3358d8d0f18c",
"triggerType" : "PUSH"
}, {
"hash" : "13702fc2232ebd9300966b0a917a3358d8d0f18c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5600",
"triggerID" : "1024845655",
"triggerType" : "MANUAL"
}, {
"hash" : "9bdd8a60f95123f82a5f30f5e68929f5b7e1f8da",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5603",
"triggerID" : "9bdd8a60f95123f82a5f30f5e68929f5b7e1f8da",
"triggerType" : "PUSH"
}, {
"hash" : "aebb9df557c4afe3ca88f6b8b28ba2fbfdcbd597",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5631",
"triggerID" : "aebb9df557c4afe3ca88f6b8b28ba2fbfdcbd597",
"triggerType" : "PUSH"
}, {
"hash" : "5d37935bc8bb33260735d782ca560fd59e02f321",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "5d37935bc8bb33260735d782ca560fd59e02f321",
"triggerType" : "PUSH"
}, {
"hash" : "f911d869f50009e5cd9f3fd341c83c732d7531ba",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5634",
"triggerID" : "f911d869f50009e5cd9f3fd341c83c732d7531ba",
"triggerType" : "PUSH"
}, {
"hash" : "f911d869f50009e5cd9f3fd341c83c732d7531ba",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5657",
"triggerID" : "1027051107",
"triggerType" : "MANUAL"
} ]
}-->
## CI report:
* 77d11131baabd1c4e3cc2050337daca4df5f6427 UNKNOWN
* 3d9c2ae28da858d1e8476052c99391015effb7db UNKNOWN
* 31b0669d7b638bd65a17b22a2ceb772f2627512c UNKNOWN
* 28a5a4f537544d35dfcd8700a7b97fb7216682ce UNKNOWN
* c09e228f7cce78a7dbbc394e93b3cf8c6c3d4d5f UNKNOWN
* 5b8f5819fff8fec34864eb409fd429b95be17b9b UNKNOWN
* 5d37935bc8bb33260735d782ca560fd59e02f321 UNKNOWN
* f911d869f50009e5cd9f3fd341c83c732d7531ba Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5634) Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5657)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #4556: [HUDI-3191][Stacked on 4716] Removing duplicating file-listing process w/in Hive's MOR `FileInputFormat`s
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #4556:
URL: https://github.com/apache/hudi/pull/4556#issuecomment-1024851007
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "d87786af43a7aeba7549cc3cfcbd97fc312bee0e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5074",
"triggerID" : "d87786af43a7aeba7549cc3cfcbd97fc312bee0e",
"triggerType" : "PUSH"
}, {
"hash" : "4b87ba1474be575ec27109ccbe626e4c2fc9c224",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5077",
"triggerID" : "4b87ba1474be575ec27109ccbe626e4c2fc9c224",
"triggerType" : "PUSH"
}, {
"hash" : "77d11131baabd1c4e3cc2050337daca4df5f6427",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "77d11131baabd1c4e3cc2050337daca4df5f6427",
"triggerType" : "PUSH"
}, {
"hash" : "3d9c2ae28da858d1e8476052c99391015effb7db",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "3d9c2ae28da858d1e8476052c99391015effb7db",
"triggerType" : "PUSH"
}, {
"hash" : "79ac9affcb7f81497e0df755c8200638d35b02b7",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5081",
"triggerID" : "79ac9affcb7f81497e0df755c8200638d35b02b7",
"triggerType" : "PUSH"
}, {
"hash" : "3c14bbe6c6bcf49c4164c45e82f77b473f4de396",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5113",
"triggerID" : "3c14bbe6c6bcf49c4164c45e82f77b473f4de396",
"triggerType" : "PUSH"
}, {
"hash" : "276f13d6efd00b301b232b286d585729c9d1d26e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5116",
"triggerID" : "276f13d6efd00b301b232b286d585729c9d1d26e",
"triggerType" : "PUSH"
}, {
"hash" : "31b0669d7b638bd65a17b22a2ceb772f2627512c",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "31b0669d7b638bd65a17b22a2ceb772f2627512c",
"triggerType" : "PUSH"
}, {
"hash" : "096e26af39a477ffccbee0edd764493e12e15e71",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5124",
"triggerID" : "096e26af39a477ffccbee0edd764493e12e15e71",
"triggerType" : "PUSH"
}, {
"hash" : "97dd5ec7c9246f6d9f467b9076b790dd6017c5b4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5213",
"triggerID" : "97dd5ec7c9246f6d9f467b9076b790dd6017c5b4",
"triggerType" : "PUSH"
}, {
"hash" : "0538475fe488089c4cb3bc0afb63c2f518329969",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5257",
"triggerID" : "0538475fe488089c4cb3bc0afb63c2f518329969",
"triggerType" : "PUSH"
}, {
"hash" : "9f4b334e340fb26004e1b07fc8fbaaa047c76775",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5261",
"triggerID" : "9f4b334e340fb26004e1b07fc8fbaaa047c76775",
"triggerType" : "PUSH"
}, {
"hash" : "368c099820c3cbf57496d0e46d1858aa8eb153ee",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5330",
"triggerID" : "368c099820c3cbf57496d0e46d1858aa8eb153ee",
"triggerType" : "PUSH"
}, {
"hash" : "28a5a4f537544d35dfcd8700a7b97fb7216682ce",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "28a5a4f537544d35dfcd8700a7b97fb7216682ce",
"triggerType" : "PUSH"
}, {
"hash" : "08ffdd8b47d147c9b5c889a5f56e39b9b140612d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5351",
"triggerID" : "08ffdd8b47d147c9b5c889a5f56e39b9b140612d",
"triggerType" : "PUSH"
}, {
"hash" : "c09e228f7cce78a7dbbc394e93b3cf8c6c3d4d5f",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "c09e228f7cce78a7dbbc394e93b3cf8c6c3d4d5f",
"triggerType" : "PUSH"
}, {
"hash" : "8dadbf672d4d27505592f18bc89422fd7c013669",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5398",
"triggerID" : "8dadbf672d4d27505592f18bc89422fd7c013669",
"triggerType" : "PUSH"
}, {
"hash" : "906607be5bd62ee1cbbda34acb6a89916c1f7aee",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5424",
"triggerID" : "906607be5bd62ee1cbbda34acb6a89916c1f7aee",
"triggerType" : "PUSH"
}, {
"hash" : "dc1b033f40cea9642f71b8fcff74aa82106726b6",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5484",
"triggerID" : "dc1b033f40cea9642f71b8fcff74aa82106726b6",
"triggerType" : "PUSH"
}, {
"hash" : "5b8f5819fff8fec34864eb409fd429b95be17b9b",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "5b8f5819fff8fec34864eb409fd429b95be17b9b",
"triggerType" : "PUSH"
}, {
"hash" : "13702fc2232ebd9300966b0a917a3358d8d0f18c",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5590",
"triggerID" : "13702fc2232ebd9300966b0a917a3358d8d0f18c",
"triggerType" : "PUSH"
}, {
"hash" : "13702fc2232ebd9300966b0a917a3358d8d0f18c",
"status" : "CANCELED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5600",
"triggerID" : "1024845655",
"triggerType" : "MANUAL"
}, {
"hash" : "9bdd8a60f95123f82a5f30f5e68929f5b7e1f8da",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5603",
"triggerID" : "9bdd8a60f95123f82a5f30f5e68929f5b7e1f8da",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 77d11131baabd1c4e3cc2050337daca4df5f6427 UNKNOWN
* 3d9c2ae28da858d1e8476052c99391015effb7db UNKNOWN
* 31b0669d7b638bd65a17b22a2ceb772f2627512c UNKNOWN
* 28a5a4f537544d35dfcd8700a7b97fb7216682ce UNKNOWN
* c09e228f7cce78a7dbbc394e93b3cf8c6c3d4d5f UNKNOWN
* 5b8f5819fff8fec34864eb409fd429b95be17b9b UNKNOWN
* 13702fc2232ebd9300966b0a917a3358d8d0f18c Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5590) Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5600)
* 9bdd8a60f95123f82a5f30f5e68929f5b7e1f8da Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5603)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #4556: [HUDI-3191][Stacked on 4716] Removing duplicating file-listing process w/in Hive's MOR `FileInputFormat`s
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #4556:
URL: https://github.com/apache/hudi/pull/4556#issuecomment-1024849640
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "d87786af43a7aeba7549cc3cfcbd97fc312bee0e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5074",
"triggerID" : "d87786af43a7aeba7549cc3cfcbd97fc312bee0e",
"triggerType" : "PUSH"
}, {
"hash" : "4b87ba1474be575ec27109ccbe626e4c2fc9c224",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5077",
"triggerID" : "4b87ba1474be575ec27109ccbe626e4c2fc9c224",
"triggerType" : "PUSH"
}, {
"hash" : "77d11131baabd1c4e3cc2050337daca4df5f6427",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "77d11131baabd1c4e3cc2050337daca4df5f6427",
"triggerType" : "PUSH"
}, {
"hash" : "3d9c2ae28da858d1e8476052c99391015effb7db",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "3d9c2ae28da858d1e8476052c99391015effb7db",
"triggerType" : "PUSH"
}, {
"hash" : "79ac9affcb7f81497e0df755c8200638d35b02b7",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5081",
"triggerID" : "79ac9affcb7f81497e0df755c8200638d35b02b7",
"triggerType" : "PUSH"
}, {
"hash" : "3c14bbe6c6bcf49c4164c45e82f77b473f4de396",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5113",
"triggerID" : "3c14bbe6c6bcf49c4164c45e82f77b473f4de396",
"triggerType" : "PUSH"
}, {
"hash" : "276f13d6efd00b301b232b286d585729c9d1d26e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5116",
"triggerID" : "276f13d6efd00b301b232b286d585729c9d1d26e",
"triggerType" : "PUSH"
}, {
"hash" : "31b0669d7b638bd65a17b22a2ceb772f2627512c",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "31b0669d7b638bd65a17b22a2ceb772f2627512c",
"triggerType" : "PUSH"
}, {
"hash" : "096e26af39a477ffccbee0edd764493e12e15e71",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5124",
"triggerID" : "096e26af39a477ffccbee0edd764493e12e15e71",
"triggerType" : "PUSH"
}, {
"hash" : "97dd5ec7c9246f6d9f467b9076b790dd6017c5b4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5213",
"triggerID" : "97dd5ec7c9246f6d9f467b9076b790dd6017c5b4",
"triggerType" : "PUSH"
}, {
"hash" : "0538475fe488089c4cb3bc0afb63c2f518329969",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5257",
"triggerID" : "0538475fe488089c4cb3bc0afb63c2f518329969",
"triggerType" : "PUSH"
}, {
"hash" : "9f4b334e340fb26004e1b07fc8fbaaa047c76775",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5261",
"triggerID" : "9f4b334e340fb26004e1b07fc8fbaaa047c76775",
"triggerType" : "PUSH"
}, {
"hash" : "368c099820c3cbf57496d0e46d1858aa8eb153ee",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5330",
"triggerID" : "368c099820c3cbf57496d0e46d1858aa8eb153ee",
"triggerType" : "PUSH"
}, {
"hash" : "28a5a4f537544d35dfcd8700a7b97fb7216682ce",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "28a5a4f537544d35dfcd8700a7b97fb7216682ce",
"triggerType" : "PUSH"
}, {
"hash" : "08ffdd8b47d147c9b5c889a5f56e39b9b140612d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5351",
"triggerID" : "08ffdd8b47d147c9b5c889a5f56e39b9b140612d",
"triggerType" : "PUSH"
}, {
"hash" : "c09e228f7cce78a7dbbc394e93b3cf8c6c3d4d5f",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "c09e228f7cce78a7dbbc394e93b3cf8c6c3d4d5f",
"triggerType" : "PUSH"
}, {
"hash" : "8dadbf672d4d27505592f18bc89422fd7c013669",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5398",
"triggerID" : "8dadbf672d4d27505592f18bc89422fd7c013669",
"triggerType" : "PUSH"
}, {
"hash" : "906607be5bd62ee1cbbda34acb6a89916c1f7aee",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5424",
"triggerID" : "906607be5bd62ee1cbbda34acb6a89916c1f7aee",
"triggerType" : "PUSH"
}, {
"hash" : "dc1b033f40cea9642f71b8fcff74aa82106726b6",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5484",
"triggerID" : "dc1b033f40cea9642f71b8fcff74aa82106726b6",
"triggerType" : "PUSH"
}, {
"hash" : "5b8f5819fff8fec34864eb409fd429b95be17b9b",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "5b8f5819fff8fec34864eb409fd429b95be17b9b",
"triggerType" : "PUSH"
}, {
"hash" : "13702fc2232ebd9300966b0a917a3358d8d0f18c",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5590",
"triggerID" : "13702fc2232ebd9300966b0a917a3358d8d0f18c",
"triggerType" : "PUSH"
}, {
"hash" : "13702fc2232ebd9300966b0a917a3358d8d0f18c",
"status" : "CANCELED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5600",
"triggerID" : "1024845655",
"triggerType" : "MANUAL"
}, {
"hash" : "9bdd8a60f95123f82a5f30f5e68929f5b7e1f8da",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "9bdd8a60f95123f82a5f30f5e68929f5b7e1f8da",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 77d11131baabd1c4e3cc2050337daca4df5f6427 UNKNOWN
* 3d9c2ae28da858d1e8476052c99391015effb7db UNKNOWN
* 31b0669d7b638bd65a17b22a2ceb772f2627512c UNKNOWN
* 28a5a4f537544d35dfcd8700a7b97fb7216682ce UNKNOWN
* c09e228f7cce78a7dbbc394e93b3cf8c6c3d4d5f UNKNOWN
* 5b8f5819fff8fec34864eb409fd429b95be17b9b UNKNOWN
* 13702fc2232ebd9300966b0a917a3358d8d0f18c Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5590) Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5600)
* 9bdd8a60f95123f82a5f30f5e68929f5b7e1f8da UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] yihua commented on pull request #4556: [HUDI-3191] Removing duplicating file-listing process w/in Hive's MOR `FileInputFormat`s
Posted by GitBox <gi...@apache.org>.
yihua commented on pull request #4556:
URL: https://github.com/apache/hudi/pull/4556#issuecomment-1028442601
@alexeykudinkin is this PR ready for another look or you're still addressing comments
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #4556: [HUDI-3191] Removing duplicating file-listing process w/in Hive's MOR `FileInputFormat`s
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #4556:
URL: https://github.com/apache/hudi/pull/4556#issuecomment-1028455516
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "d87786af43a7aeba7549cc3cfcbd97fc312bee0e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5074",
"triggerID" : "d87786af43a7aeba7549cc3cfcbd97fc312bee0e",
"triggerType" : "PUSH"
}, {
"hash" : "4b87ba1474be575ec27109ccbe626e4c2fc9c224",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5077",
"triggerID" : "4b87ba1474be575ec27109ccbe626e4c2fc9c224",
"triggerType" : "PUSH"
}, {
"hash" : "77d11131baabd1c4e3cc2050337daca4df5f6427",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "77d11131baabd1c4e3cc2050337daca4df5f6427",
"triggerType" : "PUSH"
}, {
"hash" : "3d9c2ae28da858d1e8476052c99391015effb7db",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "3d9c2ae28da858d1e8476052c99391015effb7db",
"triggerType" : "PUSH"
}, {
"hash" : "79ac9affcb7f81497e0df755c8200638d35b02b7",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5081",
"triggerID" : "79ac9affcb7f81497e0df755c8200638d35b02b7",
"triggerType" : "PUSH"
}, {
"hash" : "3c14bbe6c6bcf49c4164c45e82f77b473f4de396",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5113",
"triggerID" : "3c14bbe6c6bcf49c4164c45e82f77b473f4de396",
"triggerType" : "PUSH"
}, {
"hash" : "276f13d6efd00b301b232b286d585729c9d1d26e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5116",
"triggerID" : "276f13d6efd00b301b232b286d585729c9d1d26e",
"triggerType" : "PUSH"
}, {
"hash" : "31b0669d7b638bd65a17b22a2ceb772f2627512c",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "31b0669d7b638bd65a17b22a2ceb772f2627512c",
"triggerType" : "PUSH"
}, {
"hash" : "096e26af39a477ffccbee0edd764493e12e15e71",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5124",
"triggerID" : "096e26af39a477ffccbee0edd764493e12e15e71",
"triggerType" : "PUSH"
}, {
"hash" : "97dd5ec7c9246f6d9f467b9076b790dd6017c5b4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5213",
"triggerID" : "97dd5ec7c9246f6d9f467b9076b790dd6017c5b4",
"triggerType" : "PUSH"
}, {
"hash" : "0538475fe488089c4cb3bc0afb63c2f518329969",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5257",
"triggerID" : "0538475fe488089c4cb3bc0afb63c2f518329969",
"triggerType" : "PUSH"
}, {
"hash" : "9f4b334e340fb26004e1b07fc8fbaaa047c76775",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5261",
"triggerID" : "9f4b334e340fb26004e1b07fc8fbaaa047c76775",
"triggerType" : "PUSH"
}, {
"hash" : "368c099820c3cbf57496d0e46d1858aa8eb153ee",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5330",
"triggerID" : "368c099820c3cbf57496d0e46d1858aa8eb153ee",
"triggerType" : "PUSH"
}, {
"hash" : "28a5a4f537544d35dfcd8700a7b97fb7216682ce",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "28a5a4f537544d35dfcd8700a7b97fb7216682ce",
"triggerType" : "PUSH"
}, {
"hash" : "08ffdd8b47d147c9b5c889a5f56e39b9b140612d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5351",
"triggerID" : "08ffdd8b47d147c9b5c889a5f56e39b9b140612d",
"triggerType" : "PUSH"
}, {
"hash" : "c09e228f7cce78a7dbbc394e93b3cf8c6c3d4d5f",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "c09e228f7cce78a7dbbc394e93b3cf8c6c3d4d5f",
"triggerType" : "PUSH"
}, {
"hash" : "8dadbf672d4d27505592f18bc89422fd7c013669",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5398",
"triggerID" : "8dadbf672d4d27505592f18bc89422fd7c013669",
"triggerType" : "PUSH"
}, {
"hash" : "906607be5bd62ee1cbbda34acb6a89916c1f7aee",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5424",
"triggerID" : "906607be5bd62ee1cbbda34acb6a89916c1f7aee",
"triggerType" : "PUSH"
}, {
"hash" : "dc1b033f40cea9642f71b8fcff74aa82106726b6",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5484",
"triggerID" : "dc1b033f40cea9642f71b8fcff74aa82106726b6",
"triggerType" : "PUSH"
}, {
"hash" : "5b8f5819fff8fec34864eb409fd429b95be17b9b",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "5b8f5819fff8fec34864eb409fd429b95be17b9b",
"triggerType" : "PUSH"
}, {
"hash" : "13702fc2232ebd9300966b0a917a3358d8d0f18c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5590",
"triggerID" : "13702fc2232ebd9300966b0a917a3358d8d0f18c",
"triggerType" : "PUSH"
}, {
"hash" : "13702fc2232ebd9300966b0a917a3358d8d0f18c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5600",
"triggerID" : "1024845655",
"triggerType" : "MANUAL"
}, {
"hash" : "9bdd8a60f95123f82a5f30f5e68929f5b7e1f8da",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5603",
"triggerID" : "9bdd8a60f95123f82a5f30f5e68929f5b7e1f8da",
"triggerType" : "PUSH"
}, {
"hash" : "aebb9df557c4afe3ca88f6b8b28ba2fbfdcbd597",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5631",
"triggerID" : "aebb9df557c4afe3ca88f6b8b28ba2fbfdcbd597",
"triggerType" : "PUSH"
}, {
"hash" : "5d37935bc8bb33260735d782ca560fd59e02f321",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "5d37935bc8bb33260735d782ca560fd59e02f321",
"triggerType" : "PUSH"
}, {
"hash" : "f911d869f50009e5cd9f3fd341c83c732d7531ba",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5634",
"triggerID" : "f911d869f50009e5cd9f3fd341c83c732d7531ba",
"triggerType" : "PUSH"
}, {
"hash" : "f911d869f50009e5cd9f3fd341c83c732d7531ba",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5657",
"triggerID" : "1027051107",
"triggerType" : "MANUAL"
}, {
"hash" : "f911d869f50009e5cd9f3fd341c83c732d7531ba",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5659",
"triggerID" : "1027166086",
"triggerType" : "MANUAL"
}, {
"hash" : "f911d869f50009e5cd9f3fd341c83c732d7531ba",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5665",
"triggerID" : "1027387044",
"triggerType" : "MANUAL"
}, {
"hash" : "34b94b96b03109555201092bfabce21793add437",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5689",
"triggerID" : "34b94b96b03109555201092bfabce21793add437",
"triggerType" : "PUSH"
}, {
"hash" : "7f793744421a5ee304d5dff89d23e1e925bfd1cb",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "7f793744421a5ee304d5dff89d23e1e925bfd1cb",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 77d11131baabd1c4e3cc2050337daca4df5f6427 UNKNOWN
* 3d9c2ae28da858d1e8476052c99391015effb7db UNKNOWN
* 31b0669d7b638bd65a17b22a2ceb772f2627512c UNKNOWN
* 28a5a4f537544d35dfcd8700a7b97fb7216682ce UNKNOWN
* c09e228f7cce78a7dbbc394e93b3cf8c6c3d4d5f UNKNOWN
* 5b8f5819fff8fec34864eb409fd429b95be17b9b UNKNOWN
* 5d37935bc8bb33260735d782ca560fd59e02f321 UNKNOWN
* f911d869f50009e5cd9f3fd341c83c732d7531ba Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5634) Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5657) Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5659) Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5665)
* 34b94b96b03109555201092bfabce21793add437 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5689)
* 7f793744421a5ee304d5dff89d23e1e925bfd1cb UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] alexeykudinkin commented on pull request #4556: [HUDI-3191] Removing duplicating file-listing process w/in Hive's MOR `FileInputFormat`s
Posted by GitBox <gi...@apache.org>.
alexeykudinkin commented on pull request #4556:
URL: https://github.com/apache/hudi/pull/4556#issuecomment-1028453307
@yihua yeah, it's rebased on master now and ready for another pass
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #4556: [HUDI-3191] Removing duplicating file-listing process w/in Hive's MOR `FileInputFormat`s
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #4556:
URL: https://github.com/apache/hudi/pull/4556#issuecomment-1028547091
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "d87786af43a7aeba7549cc3cfcbd97fc312bee0e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5074",
"triggerID" : "d87786af43a7aeba7549cc3cfcbd97fc312bee0e",
"triggerType" : "PUSH"
}, {
"hash" : "4b87ba1474be575ec27109ccbe626e4c2fc9c224",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5077",
"triggerID" : "4b87ba1474be575ec27109ccbe626e4c2fc9c224",
"triggerType" : "PUSH"
}, {
"hash" : "77d11131baabd1c4e3cc2050337daca4df5f6427",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "77d11131baabd1c4e3cc2050337daca4df5f6427",
"triggerType" : "PUSH"
}, {
"hash" : "3d9c2ae28da858d1e8476052c99391015effb7db",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "3d9c2ae28da858d1e8476052c99391015effb7db",
"triggerType" : "PUSH"
}, {
"hash" : "79ac9affcb7f81497e0df755c8200638d35b02b7",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5081",
"triggerID" : "79ac9affcb7f81497e0df755c8200638d35b02b7",
"triggerType" : "PUSH"
}, {
"hash" : "3c14bbe6c6bcf49c4164c45e82f77b473f4de396",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5113",
"triggerID" : "3c14bbe6c6bcf49c4164c45e82f77b473f4de396",
"triggerType" : "PUSH"
}, {
"hash" : "276f13d6efd00b301b232b286d585729c9d1d26e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5116",
"triggerID" : "276f13d6efd00b301b232b286d585729c9d1d26e",
"triggerType" : "PUSH"
}, {
"hash" : "31b0669d7b638bd65a17b22a2ceb772f2627512c",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "31b0669d7b638bd65a17b22a2ceb772f2627512c",
"triggerType" : "PUSH"
}, {
"hash" : "096e26af39a477ffccbee0edd764493e12e15e71",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5124",
"triggerID" : "096e26af39a477ffccbee0edd764493e12e15e71",
"triggerType" : "PUSH"
}, {
"hash" : "97dd5ec7c9246f6d9f467b9076b790dd6017c5b4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5213",
"triggerID" : "97dd5ec7c9246f6d9f467b9076b790dd6017c5b4",
"triggerType" : "PUSH"
}, {
"hash" : "0538475fe488089c4cb3bc0afb63c2f518329969",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5257",
"triggerID" : "0538475fe488089c4cb3bc0afb63c2f518329969",
"triggerType" : "PUSH"
}, {
"hash" : "9f4b334e340fb26004e1b07fc8fbaaa047c76775",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5261",
"triggerID" : "9f4b334e340fb26004e1b07fc8fbaaa047c76775",
"triggerType" : "PUSH"
}, {
"hash" : "368c099820c3cbf57496d0e46d1858aa8eb153ee",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5330",
"triggerID" : "368c099820c3cbf57496d0e46d1858aa8eb153ee",
"triggerType" : "PUSH"
}, {
"hash" : "28a5a4f537544d35dfcd8700a7b97fb7216682ce",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "28a5a4f537544d35dfcd8700a7b97fb7216682ce",
"triggerType" : "PUSH"
}, {
"hash" : "08ffdd8b47d147c9b5c889a5f56e39b9b140612d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5351",
"triggerID" : "08ffdd8b47d147c9b5c889a5f56e39b9b140612d",
"triggerType" : "PUSH"
}, {
"hash" : "c09e228f7cce78a7dbbc394e93b3cf8c6c3d4d5f",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "c09e228f7cce78a7dbbc394e93b3cf8c6c3d4d5f",
"triggerType" : "PUSH"
}, {
"hash" : "8dadbf672d4d27505592f18bc89422fd7c013669",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5398",
"triggerID" : "8dadbf672d4d27505592f18bc89422fd7c013669",
"triggerType" : "PUSH"
}, {
"hash" : "906607be5bd62ee1cbbda34acb6a89916c1f7aee",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5424",
"triggerID" : "906607be5bd62ee1cbbda34acb6a89916c1f7aee",
"triggerType" : "PUSH"
}, {
"hash" : "dc1b033f40cea9642f71b8fcff74aa82106726b6",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5484",
"triggerID" : "dc1b033f40cea9642f71b8fcff74aa82106726b6",
"triggerType" : "PUSH"
}, {
"hash" : "5b8f5819fff8fec34864eb409fd429b95be17b9b",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "5b8f5819fff8fec34864eb409fd429b95be17b9b",
"triggerType" : "PUSH"
}, {
"hash" : "13702fc2232ebd9300966b0a917a3358d8d0f18c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5590",
"triggerID" : "13702fc2232ebd9300966b0a917a3358d8d0f18c",
"triggerType" : "PUSH"
}, {
"hash" : "13702fc2232ebd9300966b0a917a3358d8d0f18c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5600",
"triggerID" : "1024845655",
"triggerType" : "MANUAL"
}, {
"hash" : "9bdd8a60f95123f82a5f30f5e68929f5b7e1f8da",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5603",
"triggerID" : "9bdd8a60f95123f82a5f30f5e68929f5b7e1f8da",
"triggerType" : "PUSH"
}, {
"hash" : "aebb9df557c4afe3ca88f6b8b28ba2fbfdcbd597",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5631",
"triggerID" : "aebb9df557c4afe3ca88f6b8b28ba2fbfdcbd597",
"triggerType" : "PUSH"
}, {
"hash" : "5d37935bc8bb33260735d782ca560fd59e02f321",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "5d37935bc8bb33260735d782ca560fd59e02f321",
"triggerType" : "PUSH"
}, {
"hash" : "f911d869f50009e5cd9f3fd341c83c732d7531ba",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5634",
"triggerID" : "f911d869f50009e5cd9f3fd341c83c732d7531ba",
"triggerType" : "PUSH"
}, {
"hash" : "f911d869f50009e5cd9f3fd341c83c732d7531ba",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5657",
"triggerID" : "1027051107",
"triggerType" : "MANUAL"
}, {
"hash" : "f911d869f50009e5cd9f3fd341c83c732d7531ba",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5659",
"triggerID" : "1027166086",
"triggerType" : "MANUAL"
}, {
"hash" : "f911d869f50009e5cd9f3fd341c83c732d7531ba",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5665",
"triggerID" : "1027387044",
"triggerType" : "MANUAL"
}, {
"hash" : "34b94b96b03109555201092bfabce21793add437",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5689",
"triggerID" : "34b94b96b03109555201092bfabce21793add437",
"triggerType" : "PUSH"
}, {
"hash" : "7f793744421a5ee304d5dff89d23e1e925bfd1cb",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5692",
"triggerID" : "7f793744421a5ee304d5dff89d23e1e925bfd1cb",
"triggerType" : "PUSH"
}, {
"hash" : "7f793744421a5ee304d5dff89d23e1e925bfd1cb",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5694",
"triggerID" : "1028521365",
"triggerType" : "MANUAL"
} ]
}-->
## CI report:
* 77d11131baabd1c4e3cc2050337daca4df5f6427 UNKNOWN
* 3d9c2ae28da858d1e8476052c99391015effb7db UNKNOWN
* 31b0669d7b638bd65a17b22a2ceb772f2627512c UNKNOWN
* 28a5a4f537544d35dfcd8700a7b97fb7216682ce UNKNOWN
* c09e228f7cce78a7dbbc394e93b3cf8c6c3d4d5f UNKNOWN
* 5b8f5819fff8fec34864eb409fd429b95be17b9b UNKNOWN
* 5d37935bc8bb33260735d782ca560fd59e02f321 UNKNOWN
* 7f793744421a5ee304d5dff89d23e1e925bfd1cb Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5692) Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5694)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #4556: [HUDI-3191][Stacked on 4531] Removing duplicating file-listing process w/in Hive's MOR `FIleInputFormat`s
Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #4556:
URL: https://github.com/apache/hudi/pull/4556#issuecomment-1010372011
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "d87786af43a7aeba7549cc3cfcbd97fc312bee0e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5074",
"triggerID" : "d87786af43a7aeba7549cc3cfcbd97fc312bee0e",
"triggerType" : "PUSH"
}, {
"hash" : "4b87ba1474be575ec27109ccbe626e4c2fc9c224",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5077",
"triggerID" : "4b87ba1474be575ec27109ccbe626e4c2fc9c224",
"triggerType" : "PUSH"
}, {
"hash" : "77d11131baabd1c4e3cc2050337daca4df5f6427",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "77d11131baabd1c4e3cc2050337daca4df5f6427",
"triggerType" : "PUSH"
}, {
"hash" : "3d9c2ae28da858d1e8476052c99391015effb7db",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "3d9c2ae28da858d1e8476052c99391015effb7db",
"triggerType" : "PUSH"
}, {
"hash" : "79ac9affcb7f81497e0df755c8200638d35b02b7",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5081",
"triggerID" : "79ac9affcb7f81497e0df755c8200638d35b02b7",
"triggerType" : "PUSH"
}, {
"hash" : "3c14bbe6c6bcf49c4164c45e82f77b473f4de396",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5113",
"triggerID" : "3c14bbe6c6bcf49c4164c45e82f77b473f4de396",
"triggerType" : "PUSH"
}, {
"hash" : "276f13d6efd00b301b232b286d585729c9d1d26e",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "276f13d6efd00b301b232b286d585729c9d1d26e",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 77d11131baabd1c4e3cc2050337daca4df5f6427 UNKNOWN
* 3d9c2ae28da858d1e8476052c99391015effb7db UNKNOWN
* 79ac9affcb7f81497e0df755c8200638d35b02b7 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5081)
* 3c14bbe6c6bcf49c4164c45e82f77b473f4de396 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5113)
* 276f13d6efd00b301b232b286d585729c9d1d26e UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #4556: [HUDI-3191] Removing duplicating file-listing process w/in Hive's MOR `FileInputFormat`s
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #4556:
URL: https://github.com/apache/hudi/pull/4556#issuecomment-1020675804
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "d87786af43a7aeba7549cc3cfcbd97fc312bee0e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5074",
"triggerID" : "d87786af43a7aeba7549cc3cfcbd97fc312bee0e",
"triggerType" : "PUSH"
}, {
"hash" : "4b87ba1474be575ec27109ccbe626e4c2fc9c224",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5077",
"triggerID" : "4b87ba1474be575ec27109ccbe626e4c2fc9c224",
"triggerType" : "PUSH"
}, {
"hash" : "77d11131baabd1c4e3cc2050337daca4df5f6427",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "77d11131baabd1c4e3cc2050337daca4df5f6427",
"triggerType" : "PUSH"
}, {
"hash" : "3d9c2ae28da858d1e8476052c99391015effb7db",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "3d9c2ae28da858d1e8476052c99391015effb7db",
"triggerType" : "PUSH"
}, {
"hash" : "79ac9affcb7f81497e0df755c8200638d35b02b7",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5081",
"triggerID" : "79ac9affcb7f81497e0df755c8200638d35b02b7",
"triggerType" : "PUSH"
}, {
"hash" : "3c14bbe6c6bcf49c4164c45e82f77b473f4de396",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5113",
"triggerID" : "3c14bbe6c6bcf49c4164c45e82f77b473f4de396",
"triggerType" : "PUSH"
}, {
"hash" : "276f13d6efd00b301b232b286d585729c9d1d26e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5116",
"triggerID" : "276f13d6efd00b301b232b286d585729c9d1d26e",
"triggerType" : "PUSH"
}, {
"hash" : "31b0669d7b638bd65a17b22a2ceb772f2627512c",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "31b0669d7b638bd65a17b22a2ceb772f2627512c",
"triggerType" : "PUSH"
}, {
"hash" : "096e26af39a477ffccbee0edd764493e12e15e71",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5124",
"triggerID" : "096e26af39a477ffccbee0edd764493e12e15e71",
"triggerType" : "PUSH"
}, {
"hash" : "97dd5ec7c9246f6d9f467b9076b790dd6017c5b4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5213",
"triggerID" : "97dd5ec7c9246f6d9f467b9076b790dd6017c5b4",
"triggerType" : "PUSH"
}, {
"hash" : "0538475fe488089c4cb3bc0afb63c2f518329969",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5257",
"triggerID" : "0538475fe488089c4cb3bc0afb63c2f518329969",
"triggerType" : "PUSH"
}, {
"hash" : "9f4b334e340fb26004e1b07fc8fbaaa047c76775",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5261",
"triggerID" : "9f4b334e340fb26004e1b07fc8fbaaa047c76775",
"triggerType" : "PUSH"
}, {
"hash" : "368c099820c3cbf57496d0e46d1858aa8eb153ee",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5330",
"triggerID" : "368c099820c3cbf57496d0e46d1858aa8eb153ee",
"triggerType" : "PUSH"
}, {
"hash" : "28a5a4f537544d35dfcd8700a7b97fb7216682ce",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "28a5a4f537544d35dfcd8700a7b97fb7216682ce",
"triggerType" : "PUSH"
}, {
"hash" : "08ffdd8b47d147c9b5c889a5f56e39b9b140612d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5351",
"triggerID" : "08ffdd8b47d147c9b5c889a5f56e39b9b140612d",
"triggerType" : "PUSH"
}, {
"hash" : "c09e228f7cce78a7dbbc394e93b3cf8c6c3d4d5f",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "c09e228f7cce78a7dbbc394e93b3cf8c6c3d4d5f",
"triggerType" : "PUSH"
}, {
"hash" : "8dadbf672d4d27505592f18bc89422fd7c013669",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5398",
"triggerID" : "8dadbf672d4d27505592f18bc89422fd7c013669",
"triggerType" : "PUSH"
}, {
"hash" : "906607be5bd62ee1cbbda34acb6a89916c1f7aee",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5424",
"triggerID" : "906607be5bd62ee1cbbda34acb6a89916c1f7aee",
"triggerType" : "PUSH"
}, {
"hash" : "dc1b033f40cea9642f71b8fcff74aa82106726b6",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "dc1b033f40cea9642f71b8fcff74aa82106726b6",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 77d11131baabd1c4e3cc2050337daca4df5f6427 UNKNOWN
* 3d9c2ae28da858d1e8476052c99391015effb7db UNKNOWN
* 31b0669d7b638bd65a17b22a2ceb772f2627512c UNKNOWN
* 28a5a4f537544d35dfcd8700a7b97fb7216682ce UNKNOWN
* c09e228f7cce78a7dbbc394e93b3cf8c6c3d4d5f UNKNOWN
* 906607be5bd62ee1cbbda34acb6a89916c1f7aee Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5424)
* dc1b033f40cea9642f71b8fcff74aa82106726b6 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #4556: [HUDI-3191][Stacked on 4716] Removing duplicating file-listing process w/in Hive's MOR `FileInputFormat`s
Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #4556:
URL: https://github.com/apache/hudi/pull/4556#issuecomment-1024849226
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "d87786af43a7aeba7549cc3cfcbd97fc312bee0e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5074",
"triggerID" : "d87786af43a7aeba7549cc3cfcbd97fc312bee0e",
"triggerType" : "PUSH"
}, {
"hash" : "4b87ba1474be575ec27109ccbe626e4c2fc9c224",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5077",
"triggerID" : "4b87ba1474be575ec27109ccbe626e4c2fc9c224",
"triggerType" : "PUSH"
}, {
"hash" : "77d11131baabd1c4e3cc2050337daca4df5f6427",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "77d11131baabd1c4e3cc2050337daca4df5f6427",
"triggerType" : "PUSH"
}, {
"hash" : "3d9c2ae28da858d1e8476052c99391015effb7db",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "3d9c2ae28da858d1e8476052c99391015effb7db",
"triggerType" : "PUSH"
}, {
"hash" : "79ac9affcb7f81497e0df755c8200638d35b02b7",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5081",
"triggerID" : "79ac9affcb7f81497e0df755c8200638d35b02b7",
"triggerType" : "PUSH"
}, {
"hash" : "3c14bbe6c6bcf49c4164c45e82f77b473f4de396",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5113",
"triggerID" : "3c14bbe6c6bcf49c4164c45e82f77b473f4de396",
"triggerType" : "PUSH"
}, {
"hash" : "276f13d6efd00b301b232b286d585729c9d1d26e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5116",
"triggerID" : "276f13d6efd00b301b232b286d585729c9d1d26e",
"triggerType" : "PUSH"
}, {
"hash" : "31b0669d7b638bd65a17b22a2ceb772f2627512c",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "31b0669d7b638bd65a17b22a2ceb772f2627512c",
"triggerType" : "PUSH"
}, {
"hash" : "096e26af39a477ffccbee0edd764493e12e15e71",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5124",
"triggerID" : "096e26af39a477ffccbee0edd764493e12e15e71",
"triggerType" : "PUSH"
}, {
"hash" : "97dd5ec7c9246f6d9f467b9076b790dd6017c5b4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5213",
"triggerID" : "97dd5ec7c9246f6d9f467b9076b790dd6017c5b4",
"triggerType" : "PUSH"
}, {
"hash" : "0538475fe488089c4cb3bc0afb63c2f518329969",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5257",
"triggerID" : "0538475fe488089c4cb3bc0afb63c2f518329969",
"triggerType" : "PUSH"
}, {
"hash" : "9f4b334e340fb26004e1b07fc8fbaaa047c76775",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5261",
"triggerID" : "9f4b334e340fb26004e1b07fc8fbaaa047c76775",
"triggerType" : "PUSH"
}, {
"hash" : "368c099820c3cbf57496d0e46d1858aa8eb153ee",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5330",
"triggerID" : "368c099820c3cbf57496d0e46d1858aa8eb153ee",
"triggerType" : "PUSH"
}, {
"hash" : "28a5a4f537544d35dfcd8700a7b97fb7216682ce",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "28a5a4f537544d35dfcd8700a7b97fb7216682ce",
"triggerType" : "PUSH"
}, {
"hash" : "08ffdd8b47d147c9b5c889a5f56e39b9b140612d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5351",
"triggerID" : "08ffdd8b47d147c9b5c889a5f56e39b9b140612d",
"triggerType" : "PUSH"
}, {
"hash" : "c09e228f7cce78a7dbbc394e93b3cf8c6c3d4d5f",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "c09e228f7cce78a7dbbc394e93b3cf8c6c3d4d5f",
"triggerType" : "PUSH"
}, {
"hash" : "8dadbf672d4d27505592f18bc89422fd7c013669",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5398",
"triggerID" : "8dadbf672d4d27505592f18bc89422fd7c013669",
"triggerType" : "PUSH"
}, {
"hash" : "906607be5bd62ee1cbbda34acb6a89916c1f7aee",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5424",
"triggerID" : "906607be5bd62ee1cbbda34acb6a89916c1f7aee",
"triggerType" : "PUSH"
}, {
"hash" : "dc1b033f40cea9642f71b8fcff74aa82106726b6",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5484",
"triggerID" : "dc1b033f40cea9642f71b8fcff74aa82106726b6",
"triggerType" : "PUSH"
}, {
"hash" : "5b8f5819fff8fec34864eb409fd429b95be17b9b",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "5b8f5819fff8fec34864eb409fd429b95be17b9b",
"triggerType" : "PUSH"
}, {
"hash" : "13702fc2232ebd9300966b0a917a3358d8d0f18c",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5590",
"triggerID" : "13702fc2232ebd9300966b0a917a3358d8d0f18c",
"triggerType" : "PUSH"
}, {
"hash" : "13702fc2232ebd9300966b0a917a3358d8d0f18c",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5600",
"triggerID" : "1024845655",
"triggerType" : "MANUAL"
}, {
"hash" : "9bdd8a60f95123f82a5f30f5e68929f5b7e1f8da",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "9bdd8a60f95123f82a5f30f5e68929f5b7e1f8da",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 77d11131baabd1c4e3cc2050337daca4df5f6427 UNKNOWN
* 3d9c2ae28da858d1e8476052c99391015effb7db UNKNOWN
* 31b0669d7b638bd65a17b22a2ceb772f2627512c UNKNOWN
* 28a5a4f537544d35dfcd8700a7b97fb7216682ce UNKNOWN
* c09e228f7cce78a7dbbc394e93b3cf8c6c3d4d5f UNKNOWN
* 5b8f5819fff8fec34864eb409fd429b95be17b9b UNKNOWN
* 13702fc2232ebd9300966b0a917a3358d8d0f18c Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5590) Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5600)
* 9bdd8a60f95123f82a5f30f5e68929f5b7e1f8da UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #4556: [HUDI-3191][Stacked on 4716] Removing duplicating file-listing process w/in Hive's MOR `FileInputFormat`s
Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #4556:
URL: https://github.com/apache/hudi/pull/4556#issuecomment-1024845763
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "d87786af43a7aeba7549cc3cfcbd97fc312bee0e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5074",
"triggerID" : "d87786af43a7aeba7549cc3cfcbd97fc312bee0e",
"triggerType" : "PUSH"
}, {
"hash" : "4b87ba1474be575ec27109ccbe626e4c2fc9c224",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5077",
"triggerID" : "4b87ba1474be575ec27109ccbe626e4c2fc9c224",
"triggerType" : "PUSH"
}, {
"hash" : "77d11131baabd1c4e3cc2050337daca4df5f6427",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "77d11131baabd1c4e3cc2050337daca4df5f6427",
"triggerType" : "PUSH"
}, {
"hash" : "3d9c2ae28da858d1e8476052c99391015effb7db",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "3d9c2ae28da858d1e8476052c99391015effb7db",
"triggerType" : "PUSH"
}, {
"hash" : "79ac9affcb7f81497e0df755c8200638d35b02b7",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5081",
"triggerID" : "79ac9affcb7f81497e0df755c8200638d35b02b7",
"triggerType" : "PUSH"
}, {
"hash" : "3c14bbe6c6bcf49c4164c45e82f77b473f4de396",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5113",
"triggerID" : "3c14bbe6c6bcf49c4164c45e82f77b473f4de396",
"triggerType" : "PUSH"
}, {
"hash" : "276f13d6efd00b301b232b286d585729c9d1d26e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5116",
"triggerID" : "276f13d6efd00b301b232b286d585729c9d1d26e",
"triggerType" : "PUSH"
}, {
"hash" : "31b0669d7b638bd65a17b22a2ceb772f2627512c",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "31b0669d7b638bd65a17b22a2ceb772f2627512c",
"triggerType" : "PUSH"
}, {
"hash" : "096e26af39a477ffccbee0edd764493e12e15e71",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5124",
"triggerID" : "096e26af39a477ffccbee0edd764493e12e15e71",
"triggerType" : "PUSH"
}, {
"hash" : "97dd5ec7c9246f6d9f467b9076b790dd6017c5b4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5213",
"triggerID" : "97dd5ec7c9246f6d9f467b9076b790dd6017c5b4",
"triggerType" : "PUSH"
}, {
"hash" : "0538475fe488089c4cb3bc0afb63c2f518329969",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5257",
"triggerID" : "0538475fe488089c4cb3bc0afb63c2f518329969",
"triggerType" : "PUSH"
}, {
"hash" : "9f4b334e340fb26004e1b07fc8fbaaa047c76775",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5261",
"triggerID" : "9f4b334e340fb26004e1b07fc8fbaaa047c76775",
"triggerType" : "PUSH"
}, {
"hash" : "368c099820c3cbf57496d0e46d1858aa8eb153ee",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5330",
"triggerID" : "368c099820c3cbf57496d0e46d1858aa8eb153ee",
"triggerType" : "PUSH"
}, {
"hash" : "28a5a4f537544d35dfcd8700a7b97fb7216682ce",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "28a5a4f537544d35dfcd8700a7b97fb7216682ce",
"triggerType" : "PUSH"
}, {
"hash" : "08ffdd8b47d147c9b5c889a5f56e39b9b140612d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5351",
"triggerID" : "08ffdd8b47d147c9b5c889a5f56e39b9b140612d",
"triggerType" : "PUSH"
}, {
"hash" : "c09e228f7cce78a7dbbc394e93b3cf8c6c3d4d5f",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "c09e228f7cce78a7dbbc394e93b3cf8c6c3d4d5f",
"triggerType" : "PUSH"
}, {
"hash" : "8dadbf672d4d27505592f18bc89422fd7c013669",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5398",
"triggerID" : "8dadbf672d4d27505592f18bc89422fd7c013669",
"triggerType" : "PUSH"
}, {
"hash" : "906607be5bd62ee1cbbda34acb6a89916c1f7aee",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5424",
"triggerID" : "906607be5bd62ee1cbbda34acb6a89916c1f7aee",
"triggerType" : "PUSH"
}, {
"hash" : "dc1b033f40cea9642f71b8fcff74aa82106726b6",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5484",
"triggerID" : "dc1b033f40cea9642f71b8fcff74aa82106726b6",
"triggerType" : "PUSH"
}, {
"hash" : "5b8f5819fff8fec34864eb409fd429b95be17b9b",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "5b8f5819fff8fec34864eb409fd429b95be17b9b",
"triggerType" : "PUSH"
}, {
"hash" : "13702fc2232ebd9300966b0a917a3358d8d0f18c",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5590",
"triggerID" : "13702fc2232ebd9300966b0a917a3358d8d0f18c",
"triggerType" : "PUSH"
}, {
"hash" : "13702fc2232ebd9300966b0a917a3358d8d0f18c",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5600",
"triggerID" : "1024845655",
"triggerType" : "MANUAL"
} ]
}-->
## CI report:
* 77d11131baabd1c4e3cc2050337daca4df5f6427 UNKNOWN
* 3d9c2ae28da858d1e8476052c99391015effb7db UNKNOWN
* 31b0669d7b638bd65a17b22a2ceb772f2627512c UNKNOWN
* 28a5a4f537544d35dfcd8700a7b97fb7216682ce UNKNOWN
* c09e228f7cce78a7dbbc394e93b3cf8c6c3d4d5f UNKNOWN
* 5b8f5819fff8fec34864eb409fd429b95be17b9b UNKNOWN
* 13702fc2232ebd9300966b0a917a3358d8d0f18c Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5590) Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5600)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #4556: [HUDI-3191][Stacked on 4716] Removing duplicating file-listing process w/in Hive's MOR `FileInputFormat`s
Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #4556:
URL: https://github.com/apache/hudi/pull/4556#issuecomment-1024802263
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "d87786af43a7aeba7549cc3cfcbd97fc312bee0e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5074",
"triggerID" : "d87786af43a7aeba7549cc3cfcbd97fc312bee0e",
"triggerType" : "PUSH"
}, {
"hash" : "4b87ba1474be575ec27109ccbe626e4c2fc9c224",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5077",
"triggerID" : "4b87ba1474be575ec27109ccbe626e4c2fc9c224",
"triggerType" : "PUSH"
}, {
"hash" : "77d11131baabd1c4e3cc2050337daca4df5f6427",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "77d11131baabd1c4e3cc2050337daca4df5f6427",
"triggerType" : "PUSH"
}, {
"hash" : "3d9c2ae28da858d1e8476052c99391015effb7db",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "3d9c2ae28da858d1e8476052c99391015effb7db",
"triggerType" : "PUSH"
}, {
"hash" : "79ac9affcb7f81497e0df755c8200638d35b02b7",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5081",
"triggerID" : "79ac9affcb7f81497e0df755c8200638d35b02b7",
"triggerType" : "PUSH"
}, {
"hash" : "3c14bbe6c6bcf49c4164c45e82f77b473f4de396",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5113",
"triggerID" : "3c14bbe6c6bcf49c4164c45e82f77b473f4de396",
"triggerType" : "PUSH"
}, {
"hash" : "276f13d6efd00b301b232b286d585729c9d1d26e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5116",
"triggerID" : "276f13d6efd00b301b232b286d585729c9d1d26e",
"triggerType" : "PUSH"
}, {
"hash" : "31b0669d7b638bd65a17b22a2ceb772f2627512c",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "31b0669d7b638bd65a17b22a2ceb772f2627512c",
"triggerType" : "PUSH"
}, {
"hash" : "096e26af39a477ffccbee0edd764493e12e15e71",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5124",
"triggerID" : "096e26af39a477ffccbee0edd764493e12e15e71",
"triggerType" : "PUSH"
}, {
"hash" : "97dd5ec7c9246f6d9f467b9076b790dd6017c5b4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5213",
"triggerID" : "97dd5ec7c9246f6d9f467b9076b790dd6017c5b4",
"triggerType" : "PUSH"
}, {
"hash" : "0538475fe488089c4cb3bc0afb63c2f518329969",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5257",
"triggerID" : "0538475fe488089c4cb3bc0afb63c2f518329969",
"triggerType" : "PUSH"
}, {
"hash" : "9f4b334e340fb26004e1b07fc8fbaaa047c76775",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5261",
"triggerID" : "9f4b334e340fb26004e1b07fc8fbaaa047c76775",
"triggerType" : "PUSH"
}, {
"hash" : "368c099820c3cbf57496d0e46d1858aa8eb153ee",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5330",
"triggerID" : "368c099820c3cbf57496d0e46d1858aa8eb153ee",
"triggerType" : "PUSH"
}, {
"hash" : "28a5a4f537544d35dfcd8700a7b97fb7216682ce",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "28a5a4f537544d35dfcd8700a7b97fb7216682ce",
"triggerType" : "PUSH"
}, {
"hash" : "08ffdd8b47d147c9b5c889a5f56e39b9b140612d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5351",
"triggerID" : "08ffdd8b47d147c9b5c889a5f56e39b9b140612d",
"triggerType" : "PUSH"
}, {
"hash" : "c09e228f7cce78a7dbbc394e93b3cf8c6c3d4d5f",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "c09e228f7cce78a7dbbc394e93b3cf8c6c3d4d5f",
"triggerType" : "PUSH"
}, {
"hash" : "8dadbf672d4d27505592f18bc89422fd7c013669",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5398",
"triggerID" : "8dadbf672d4d27505592f18bc89422fd7c013669",
"triggerType" : "PUSH"
}, {
"hash" : "906607be5bd62ee1cbbda34acb6a89916c1f7aee",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5424",
"triggerID" : "906607be5bd62ee1cbbda34acb6a89916c1f7aee",
"triggerType" : "PUSH"
}, {
"hash" : "dc1b033f40cea9642f71b8fcff74aa82106726b6",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5484",
"triggerID" : "dc1b033f40cea9642f71b8fcff74aa82106726b6",
"triggerType" : "PUSH"
}, {
"hash" : "5b8f5819fff8fec34864eb409fd429b95be17b9b",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "5b8f5819fff8fec34864eb409fd429b95be17b9b",
"triggerType" : "PUSH"
}, {
"hash" : "13702fc2232ebd9300966b0a917a3358d8d0f18c",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5590",
"triggerID" : "13702fc2232ebd9300966b0a917a3358d8d0f18c",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 77d11131baabd1c4e3cc2050337daca4df5f6427 UNKNOWN
* 3d9c2ae28da858d1e8476052c99391015effb7db UNKNOWN
* 31b0669d7b638bd65a17b22a2ceb772f2627512c UNKNOWN
* 28a5a4f537544d35dfcd8700a7b97fb7216682ce UNKNOWN
* c09e228f7cce78a7dbbc394e93b3cf8c6c3d4d5f UNKNOWN
* dc1b033f40cea9642f71b8fcff74aa82106726b6 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5484)
* 5b8f5819fff8fec34864eb409fd429b95be17b9b UNKNOWN
* 13702fc2232ebd9300966b0a917a3358d8d0f18c Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5590)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #4556: [HUDI-3191][Stacked on 4716] Removing duplicating file-listing process w/in Hive's MOR `FileInputFormat`s
Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #4556:
URL: https://github.com/apache/hudi/pull/4556#issuecomment-1024864965
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "d87786af43a7aeba7549cc3cfcbd97fc312bee0e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5074",
"triggerID" : "d87786af43a7aeba7549cc3cfcbd97fc312bee0e",
"triggerType" : "PUSH"
}, {
"hash" : "4b87ba1474be575ec27109ccbe626e4c2fc9c224",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5077",
"triggerID" : "4b87ba1474be575ec27109ccbe626e4c2fc9c224",
"triggerType" : "PUSH"
}, {
"hash" : "77d11131baabd1c4e3cc2050337daca4df5f6427",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "77d11131baabd1c4e3cc2050337daca4df5f6427",
"triggerType" : "PUSH"
}, {
"hash" : "3d9c2ae28da858d1e8476052c99391015effb7db",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "3d9c2ae28da858d1e8476052c99391015effb7db",
"triggerType" : "PUSH"
}, {
"hash" : "79ac9affcb7f81497e0df755c8200638d35b02b7",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5081",
"triggerID" : "79ac9affcb7f81497e0df755c8200638d35b02b7",
"triggerType" : "PUSH"
}, {
"hash" : "3c14bbe6c6bcf49c4164c45e82f77b473f4de396",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5113",
"triggerID" : "3c14bbe6c6bcf49c4164c45e82f77b473f4de396",
"triggerType" : "PUSH"
}, {
"hash" : "276f13d6efd00b301b232b286d585729c9d1d26e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5116",
"triggerID" : "276f13d6efd00b301b232b286d585729c9d1d26e",
"triggerType" : "PUSH"
}, {
"hash" : "31b0669d7b638bd65a17b22a2ceb772f2627512c",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "31b0669d7b638bd65a17b22a2ceb772f2627512c",
"triggerType" : "PUSH"
}, {
"hash" : "096e26af39a477ffccbee0edd764493e12e15e71",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5124",
"triggerID" : "096e26af39a477ffccbee0edd764493e12e15e71",
"triggerType" : "PUSH"
}, {
"hash" : "97dd5ec7c9246f6d9f467b9076b790dd6017c5b4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5213",
"triggerID" : "97dd5ec7c9246f6d9f467b9076b790dd6017c5b4",
"triggerType" : "PUSH"
}, {
"hash" : "0538475fe488089c4cb3bc0afb63c2f518329969",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5257",
"triggerID" : "0538475fe488089c4cb3bc0afb63c2f518329969",
"triggerType" : "PUSH"
}, {
"hash" : "9f4b334e340fb26004e1b07fc8fbaaa047c76775",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5261",
"triggerID" : "9f4b334e340fb26004e1b07fc8fbaaa047c76775",
"triggerType" : "PUSH"
}, {
"hash" : "368c099820c3cbf57496d0e46d1858aa8eb153ee",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5330",
"triggerID" : "368c099820c3cbf57496d0e46d1858aa8eb153ee",
"triggerType" : "PUSH"
}, {
"hash" : "28a5a4f537544d35dfcd8700a7b97fb7216682ce",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "28a5a4f537544d35dfcd8700a7b97fb7216682ce",
"triggerType" : "PUSH"
}, {
"hash" : "08ffdd8b47d147c9b5c889a5f56e39b9b140612d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5351",
"triggerID" : "08ffdd8b47d147c9b5c889a5f56e39b9b140612d",
"triggerType" : "PUSH"
}, {
"hash" : "c09e228f7cce78a7dbbc394e93b3cf8c6c3d4d5f",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "c09e228f7cce78a7dbbc394e93b3cf8c6c3d4d5f",
"triggerType" : "PUSH"
}, {
"hash" : "8dadbf672d4d27505592f18bc89422fd7c013669",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5398",
"triggerID" : "8dadbf672d4d27505592f18bc89422fd7c013669",
"triggerType" : "PUSH"
}, {
"hash" : "906607be5bd62ee1cbbda34acb6a89916c1f7aee",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5424",
"triggerID" : "906607be5bd62ee1cbbda34acb6a89916c1f7aee",
"triggerType" : "PUSH"
}, {
"hash" : "dc1b033f40cea9642f71b8fcff74aa82106726b6",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5484",
"triggerID" : "dc1b033f40cea9642f71b8fcff74aa82106726b6",
"triggerType" : "PUSH"
}, {
"hash" : "5b8f5819fff8fec34864eb409fd429b95be17b9b",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "5b8f5819fff8fec34864eb409fd429b95be17b9b",
"triggerType" : "PUSH"
}, {
"hash" : "13702fc2232ebd9300966b0a917a3358d8d0f18c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5590",
"triggerID" : "13702fc2232ebd9300966b0a917a3358d8d0f18c",
"triggerType" : "PUSH"
}, {
"hash" : "13702fc2232ebd9300966b0a917a3358d8d0f18c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5600",
"triggerID" : "1024845655",
"triggerType" : "MANUAL"
}, {
"hash" : "9bdd8a60f95123f82a5f30f5e68929f5b7e1f8da",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5603",
"triggerID" : "9bdd8a60f95123f82a5f30f5e68929f5b7e1f8da",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 77d11131baabd1c4e3cc2050337daca4df5f6427 UNKNOWN
* 3d9c2ae28da858d1e8476052c99391015effb7db UNKNOWN
* 31b0669d7b638bd65a17b22a2ceb772f2627512c UNKNOWN
* 28a5a4f537544d35dfcd8700a7b97fb7216682ce UNKNOWN
* c09e228f7cce78a7dbbc394e93b3cf8c6c3d4d5f UNKNOWN
* 5b8f5819fff8fec34864eb409fd429b95be17b9b UNKNOWN
* 9bdd8a60f95123f82a5f30f5e68929f5b7e1f8da Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5603)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #4556: [HUDI-3191][Stacked on 4716] Removing duplicating file-listing process w/in Hive's MOR `FileInputFormat`s
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #4556:
URL: https://github.com/apache/hudi/pull/4556#issuecomment-1026320095
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "d87786af43a7aeba7549cc3cfcbd97fc312bee0e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5074",
"triggerID" : "d87786af43a7aeba7549cc3cfcbd97fc312bee0e",
"triggerType" : "PUSH"
}, {
"hash" : "4b87ba1474be575ec27109ccbe626e4c2fc9c224",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5077",
"triggerID" : "4b87ba1474be575ec27109ccbe626e4c2fc9c224",
"triggerType" : "PUSH"
}, {
"hash" : "77d11131baabd1c4e3cc2050337daca4df5f6427",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "77d11131baabd1c4e3cc2050337daca4df5f6427",
"triggerType" : "PUSH"
}, {
"hash" : "3d9c2ae28da858d1e8476052c99391015effb7db",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "3d9c2ae28da858d1e8476052c99391015effb7db",
"triggerType" : "PUSH"
}, {
"hash" : "79ac9affcb7f81497e0df755c8200638d35b02b7",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5081",
"triggerID" : "79ac9affcb7f81497e0df755c8200638d35b02b7",
"triggerType" : "PUSH"
}, {
"hash" : "3c14bbe6c6bcf49c4164c45e82f77b473f4de396",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5113",
"triggerID" : "3c14bbe6c6bcf49c4164c45e82f77b473f4de396",
"triggerType" : "PUSH"
}, {
"hash" : "276f13d6efd00b301b232b286d585729c9d1d26e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5116",
"triggerID" : "276f13d6efd00b301b232b286d585729c9d1d26e",
"triggerType" : "PUSH"
}, {
"hash" : "31b0669d7b638bd65a17b22a2ceb772f2627512c",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "31b0669d7b638bd65a17b22a2ceb772f2627512c",
"triggerType" : "PUSH"
}, {
"hash" : "096e26af39a477ffccbee0edd764493e12e15e71",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5124",
"triggerID" : "096e26af39a477ffccbee0edd764493e12e15e71",
"triggerType" : "PUSH"
}, {
"hash" : "97dd5ec7c9246f6d9f467b9076b790dd6017c5b4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5213",
"triggerID" : "97dd5ec7c9246f6d9f467b9076b790dd6017c5b4",
"triggerType" : "PUSH"
}, {
"hash" : "0538475fe488089c4cb3bc0afb63c2f518329969",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5257",
"triggerID" : "0538475fe488089c4cb3bc0afb63c2f518329969",
"triggerType" : "PUSH"
}, {
"hash" : "9f4b334e340fb26004e1b07fc8fbaaa047c76775",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5261",
"triggerID" : "9f4b334e340fb26004e1b07fc8fbaaa047c76775",
"triggerType" : "PUSH"
}, {
"hash" : "368c099820c3cbf57496d0e46d1858aa8eb153ee",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5330",
"triggerID" : "368c099820c3cbf57496d0e46d1858aa8eb153ee",
"triggerType" : "PUSH"
}, {
"hash" : "28a5a4f537544d35dfcd8700a7b97fb7216682ce",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "28a5a4f537544d35dfcd8700a7b97fb7216682ce",
"triggerType" : "PUSH"
}, {
"hash" : "08ffdd8b47d147c9b5c889a5f56e39b9b140612d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5351",
"triggerID" : "08ffdd8b47d147c9b5c889a5f56e39b9b140612d",
"triggerType" : "PUSH"
}, {
"hash" : "c09e228f7cce78a7dbbc394e93b3cf8c6c3d4d5f",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "c09e228f7cce78a7dbbc394e93b3cf8c6c3d4d5f",
"triggerType" : "PUSH"
}, {
"hash" : "8dadbf672d4d27505592f18bc89422fd7c013669",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5398",
"triggerID" : "8dadbf672d4d27505592f18bc89422fd7c013669",
"triggerType" : "PUSH"
}, {
"hash" : "906607be5bd62ee1cbbda34acb6a89916c1f7aee",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5424",
"triggerID" : "906607be5bd62ee1cbbda34acb6a89916c1f7aee",
"triggerType" : "PUSH"
}, {
"hash" : "dc1b033f40cea9642f71b8fcff74aa82106726b6",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5484",
"triggerID" : "dc1b033f40cea9642f71b8fcff74aa82106726b6",
"triggerType" : "PUSH"
}, {
"hash" : "5b8f5819fff8fec34864eb409fd429b95be17b9b",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "5b8f5819fff8fec34864eb409fd429b95be17b9b",
"triggerType" : "PUSH"
}, {
"hash" : "13702fc2232ebd9300966b0a917a3358d8d0f18c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5590",
"triggerID" : "13702fc2232ebd9300966b0a917a3358d8d0f18c",
"triggerType" : "PUSH"
}, {
"hash" : "13702fc2232ebd9300966b0a917a3358d8d0f18c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5600",
"triggerID" : "1024845655",
"triggerType" : "MANUAL"
}, {
"hash" : "9bdd8a60f95123f82a5f30f5e68929f5b7e1f8da",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5603",
"triggerID" : "9bdd8a60f95123f82a5f30f5e68929f5b7e1f8da",
"triggerType" : "PUSH"
}, {
"hash" : "aebb9df557c4afe3ca88f6b8b28ba2fbfdcbd597",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5631",
"triggerID" : "aebb9df557c4afe3ca88f6b8b28ba2fbfdcbd597",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 77d11131baabd1c4e3cc2050337daca4df5f6427 UNKNOWN
* 3d9c2ae28da858d1e8476052c99391015effb7db UNKNOWN
* 31b0669d7b638bd65a17b22a2ceb772f2627512c UNKNOWN
* 28a5a4f537544d35dfcd8700a7b97fb7216682ce UNKNOWN
* c09e228f7cce78a7dbbc394e93b3cf8c6c3d4d5f UNKNOWN
* 5b8f5819fff8fec34864eb409fd429b95be17b9b UNKNOWN
* aebb9df557c4afe3ca88f6b8b28ba2fbfdcbd597 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5631)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #4556: [HUDI-3191][Stacked on 4716] Removing duplicating file-listing process w/in Hive's MOR `FileInputFormat`s
Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #4556:
URL: https://github.com/apache/hudi/pull/4556#issuecomment-1024799065
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "d87786af43a7aeba7549cc3cfcbd97fc312bee0e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5074",
"triggerID" : "d87786af43a7aeba7549cc3cfcbd97fc312bee0e",
"triggerType" : "PUSH"
}, {
"hash" : "4b87ba1474be575ec27109ccbe626e4c2fc9c224",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5077",
"triggerID" : "4b87ba1474be575ec27109ccbe626e4c2fc9c224",
"triggerType" : "PUSH"
}, {
"hash" : "77d11131baabd1c4e3cc2050337daca4df5f6427",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "77d11131baabd1c4e3cc2050337daca4df5f6427",
"triggerType" : "PUSH"
}, {
"hash" : "3d9c2ae28da858d1e8476052c99391015effb7db",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "3d9c2ae28da858d1e8476052c99391015effb7db",
"triggerType" : "PUSH"
}, {
"hash" : "79ac9affcb7f81497e0df755c8200638d35b02b7",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5081",
"triggerID" : "79ac9affcb7f81497e0df755c8200638d35b02b7",
"triggerType" : "PUSH"
}, {
"hash" : "3c14bbe6c6bcf49c4164c45e82f77b473f4de396",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5113",
"triggerID" : "3c14bbe6c6bcf49c4164c45e82f77b473f4de396",
"triggerType" : "PUSH"
}, {
"hash" : "276f13d6efd00b301b232b286d585729c9d1d26e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5116",
"triggerID" : "276f13d6efd00b301b232b286d585729c9d1d26e",
"triggerType" : "PUSH"
}, {
"hash" : "31b0669d7b638bd65a17b22a2ceb772f2627512c",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "31b0669d7b638bd65a17b22a2ceb772f2627512c",
"triggerType" : "PUSH"
}, {
"hash" : "096e26af39a477ffccbee0edd764493e12e15e71",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5124",
"triggerID" : "096e26af39a477ffccbee0edd764493e12e15e71",
"triggerType" : "PUSH"
}, {
"hash" : "97dd5ec7c9246f6d9f467b9076b790dd6017c5b4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5213",
"triggerID" : "97dd5ec7c9246f6d9f467b9076b790dd6017c5b4",
"triggerType" : "PUSH"
}, {
"hash" : "0538475fe488089c4cb3bc0afb63c2f518329969",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5257",
"triggerID" : "0538475fe488089c4cb3bc0afb63c2f518329969",
"triggerType" : "PUSH"
}, {
"hash" : "9f4b334e340fb26004e1b07fc8fbaaa047c76775",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5261",
"triggerID" : "9f4b334e340fb26004e1b07fc8fbaaa047c76775",
"triggerType" : "PUSH"
}, {
"hash" : "368c099820c3cbf57496d0e46d1858aa8eb153ee",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5330",
"triggerID" : "368c099820c3cbf57496d0e46d1858aa8eb153ee",
"triggerType" : "PUSH"
}, {
"hash" : "28a5a4f537544d35dfcd8700a7b97fb7216682ce",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "28a5a4f537544d35dfcd8700a7b97fb7216682ce",
"triggerType" : "PUSH"
}, {
"hash" : "08ffdd8b47d147c9b5c889a5f56e39b9b140612d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5351",
"triggerID" : "08ffdd8b47d147c9b5c889a5f56e39b9b140612d",
"triggerType" : "PUSH"
}, {
"hash" : "c09e228f7cce78a7dbbc394e93b3cf8c6c3d4d5f",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "c09e228f7cce78a7dbbc394e93b3cf8c6c3d4d5f",
"triggerType" : "PUSH"
}, {
"hash" : "8dadbf672d4d27505592f18bc89422fd7c013669",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5398",
"triggerID" : "8dadbf672d4d27505592f18bc89422fd7c013669",
"triggerType" : "PUSH"
}, {
"hash" : "906607be5bd62ee1cbbda34acb6a89916c1f7aee",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5424",
"triggerID" : "906607be5bd62ee1cbbda34acb6a89916c1f7aee",
"triggerType" : "PUSH"
}, {
"hash" : "dc1b033f40cea9642f71b8fcff74aa82106726b6",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5484",
"triggerID" : "dc1b033f40cea9642f71b8fcff74aa82106726b6",
"triggerType" : "PUSH"
}, {
"hash" : "5b8f5819fff8fec34864eb409fd429b95be17b9b",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "5b8f5819fff8fec34864eb409fd429b95be17b9b",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 77d11131baabd1c4e3cc2050337daca4df5f6427 UNKNOWN
* 3d9c2ae28da858d1e8476052c99391015effb7db UNKNOWN
* 31b0669d7b638bd65a17b22a2ceb772f2627512c UNKNOWN
* 28a5a4f537544d35dfcd8700a7b97fb7216682ce UNKNOWN
* c09e228f7cce78a7dbbc394e93b3cf8c6c3d4d5f UNKNOWN
* dc1b033f40cea9642f71b8fcff74aa82106726b6 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5484)
* 5b8f5819fff8fec34864eb409fd429b95be17b9b UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #4556: [HUDI-3191][Stacked on 4716] Removing duplicating file-listing process w/in Hive's MOR `FileInputFormat`s
Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #4556:
URL: https://github.com/apache/hudi/pull/4556#issuecomment-1026386730
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "d87786af43a7aeba7549cc3cfcbd97fc312bee0e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5074",
"triggerID" : "d87786af43a7aeba7549cc3cfcbd97fc312bee0e",
"triggerType" : "PUSH"
}, {
"hash" : "4b87ba1474be575ec27109ccbe626e4c2fc9c224",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5077",
"triggerID" : "4b87ba1474be575ec27109ccbe626e4c2fc9c224",
"triggerType" : "PUSH"
}, {
"hash" : "77d11131baabd1c4e3cc2050337daca4df5f6427",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "77d11131baabd1c4e3cc2050337daca4df5f6427",
"triggerType" : "PUSH"
}, {
"hash" : "3d9c2ae28da858d1e8476052c99391015effb7db",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "3d9c2ae28da858d1e8476052c99391015effb7db",
"triggerType" : "PUSH"
}, {
"hash" : "79ac9affcb7f81497e0df755c8200638d35b02b7",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5081",
"triggerID" : "79ac9affcb7f81497e0df755c8200638d35b02b7",
"triggerType" : "PUSH"
}, {
"hash" : "3c14bbe6c6bcf49c4164c45e82f77b473f4de396",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5113",
"triggerID" : "3c14bbe6c6bcf49c4164c45e82f77b473f4de396",
"triggerType" : "PUSH"
}, {
"hash" : "276f13d6efd00b301b232b286d585729c9d1d26e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5116",
"triggerID" : "276f13d6efd00b301b232b286d585729c9d1d26e",
"triggerType" : "PUSH"
}, {
"hash" : "31b0669d7b638bd65a17b22a2ceb772f2627512c",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "31b0669d7b638bd65a17b22a2ceb772f2627512c",
"triggerType" : "PUSH"
}, {
"hash" : "096e26af39a477ffccbee0edd764493e12e15e71",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5124",
"triggerID" : "096e26af39a477ffccbee0edd764493e12e15e71",
"triggerType" : "PUSH"
}, {
"hash" : "97dd5ec7c9246f6d9f467b9076b790dd6017c5b4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5213",
"triggerID" : "97dd5ec7c9246f6d9f467b9076b790dd6017c5b4",
"triggerType" : "PUSH"
}, {
"hash" : "0538475fe488089c4cb3bc0afb63c2f518329969",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5257",
"triggerID" : "0538475fe488089c4cb3bc0afb63c2f518329969",
"triggerType" : "PUSH"
}, {
"hash" : "9f4b334e340fb26004e1b07fc8fbaaa047c76775",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5261",
"triggerID" : "9f4b334e340fb26004e1b07fc8fbaaa047c76775",
"triggerType" : "PUSH"
}, {
"hash" : "368c099820c3cbf57496d0e46d1858aa8eb153ee",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5330",
"triggerID" : "368c099820c3cbf57496d0e46d1858aa8eb153ee",
"triggerType" : "PUSH"
}, {
"hash" : "28a5a4f537544d35dfcd8700a7b97fb7216682ce",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "28a5a4f537544d35dfcd8700a7b97fb7216682ce",
"triggerType" : "PUSH"
}, {
"hash" : "08ffdd8b47d147c9b5c889a5f56e39b9b140612d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5351",
"triggerID" : "08ffdd8b47d147c9b5c889a5f56e39b9b140612d",
"triggerType" : "PUSH"
}, {
"hash" : "c09e228f7cce78a7dbbc394e93b3cf8c6c3d4d5f",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "c09e228f7cce78a7dbbc394e93b3cf8c6c3d4d5f",
"triggerType" : "PUSH"
}, {
"hash" : "8dadbf672d4d27505592f18bc89422fd7c013669",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5398",
"triggerID" : "8dadbf672d4d27505592f18bc89422fd7c013669",
"triggerType" : "PUSH"
}, {
"hash" : "906607be5bd62ee1cbbda34acb6a89916c1f7aee",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5424",
"triggerID" : "906607be5bd62ee1cbbda34acb6a89916c1f7aee",
"triggerType" : "PUSH"
}, {
"hash" : "dc1b033f40cea9642f71b8fcff74aa82106726b6",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5484",
"triggerID" : "dc1b033f40cea9642f71b8fcff74aa82106726b6",
"triggerType" : "PUSH"
}, {
"hash" : "5b8f5819fff8fec34864eb409fd429b95be17b9b",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "5b8f5819fff8fec34864eb409fd429b95be17b9b",
"triggerType" : "PUSH"
}, {
"hash" : "13702fc2232ebd9300966b0a917a3358d8d0f18c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5590",
"triggerID" : "13702fc2232ebd9300966b0a917a3358d8d0f18c",
"triggerType" : "PUSH"
}, {
"hash" : "13702fc2232ebd9300966b0a917a3358d8d0f18c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5600",
"triggerID" : "1024845655",
"triggerType" : "MANUAL"
}, {
"hash" : "9bdd8a60f95123f82a5f30f5e68929f5b7e1f8da",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5603",
"triggerID" : "9bdd8a60f95123f82a5f30f5e68929f5b7e1f8da",
"triggerType" : "PUSH"
}, {
"hash" : "aebb9df557c4afe3ca88f6b8b28ba2fbfdcbd597",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5631",
"triggerID" : "aebb9df557c4afe3ca88f6b8b28ba2fbfdcbd597",
"triggerType" : "PUSH"
}, {
"hash" : "5d37935bc8bb33260735d782ca560fd59e02f321",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "5d37935bc8bb33260735d782ca560fd59e02f321",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 77d11131baabd1c4e3cc2050337daca4df5f6427 UNKNOWN
* 3d9c2ae28da858d1e8476052c99391015effb7db UNKNOWN
* 31b0669d7b638bd65a17b22a2ceb772f2627512c UNKNOWN
* 28a5a4f537544d35dfcd8700a7b97fb7216682ce UNKNOWN
* c09e228f7cce78a7dbbc394e93b3cf8c6c3d4d5f UNKNOWN
* 5b8f5819fff8fec34864eb409fd429b95be17b9b UNKNOWN
* aebb9df557c4afe3ca88f6b8b28ba2fbfdcbd597 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5631)
* 5d37935bc8bb33260735d782ca560fd59e02f321 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #4556: [HUDI-3191][Stacked on 4716] Removing duplicating file-listing process w/in Hive's MOR `FileInputFormat`s
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #4556:
URL: https://github.com/apache/hudi/pull/4556#issuecomment-1026386730
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "d87786af43a7aeba7549cc3cfcbd97fc312bee0e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5074",
"triggerID" : "d87786af43a7aeba7549cc3cfcbd97fc312bee0e",
"triggerType" : "PUSH"
}, {
"hash" : "4b87ba1474be575ec27109ccbe626e4c2fc9c224",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5077",
"triggerID" : "4b87ba1474be575ec27109ccbe626e4c2fc9c224",
"triggerType" : "PUSH"
}, {
"hash" : "77d11131baabd1c4e3cc2050337daca4df5f6427",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "77d11131baabd1c4e3cc2050337daca4df5f6427",
"triggerType" : "PUSH"
}, {
"hash" : "3d9c2ae28da858d1e8476052c99391015effb7db",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "3d9c2ae28da858d1e8476052c99391015effb7db",
"triggerType" : "PUSH"
}, {
"hash" : "79ac9affcb7f81497e0df755c8200638d35b02b7",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5081",
"triggerID" : "79ac9affcb7f81497e0df755c8200638d35b02b7",
"triggerType" : "PUSH"
}, {
"hash" : "3c14bbe6c6bcf49c4164c45e82f77b473f4de396",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5113",
"triggerID" : "3c14bbe6c6bcf49c4164c45e82f77b473f4de396",
"triggerType" : "PUSH"
}, {
"hash" : "276f13d6efd00b301b232b286d585729c9d1d26e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5116",
"triggerID" : "276f13d6efd00b301b232b286d585729c9d1d26e",
"triggerType" : "PUSH"
}, {
"hash" : "31b0669d7b638bd65a17b22a2ceb772f2627512c",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "31b0669d7b638bd65a17b22a2ceb772f2627512c",
"triggerType" : "PUSH"
}, {
"hash" : "096e26af39a477ffccbee0edd764493e12e15e71",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5124",
"triggerID" : "096e26af39a477ffccbee0edd764493e12e15e71",
"triggerType" : "PUSH"
}, {
"hash" : "97dd5ec7c9246f6d9f467b9076b790dd6017c5b4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5213",
"triggerID" : "97dd5ec7c9246f6d9f467b9076b790dd6017c5b4",
"triggerType" : "PUSH"
}, {
"hash" : "0538475fe488089c4cb3bc0afb63c2f518329969",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5257",
"triggerID" : "0538475fe488089c4cb3bc0afb63c2f518329969",
"triggerType" : "PUSH"
}, {
"hash" : "9f4b334e340fb26004e1b07fc8fbaaa047c76775",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5261",
"triggerID" : "9f4b334e340fb26004e1b07fc8fbaaa047c76775",
"triggerType" : "PUSH"
}, {
"hash" : "368c099820c3cbf57496d0e46d1858aa8eb153ee",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5330",
"triggerID" : "368c099820c3cbf57496d0e46d1858aa8eb153ee",
"triggerType" : "PUSH"
}, {
"hash" : "28a5a4f537544d35dfcd8700a7b97fb7216682ce",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "28a5a4f537544d35dfcd8700a7b97fb7216682ce",
"triggerType" : "PUSH"
}, {
"hash" : "08ffdd8b47d147c9b5c889a5f56e39b9b140612d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5351",
"triggerID" : "08ffdd8b47d147c9b5c889a5f56e39b9b140612d",
"triggerType" : "PUSH"
}, {
"hash" : "c09e228f7cce78a7dbbc394e93b3cf8c6c3d4d5f",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "c09e228f7cce78a7dbbc394e93b3cf8c6c3d4d5f",
"triggerType" : "PUSH"
}, {
"hash" : "8dadbf672d4d27505592f18bc89422fd7c013669",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5398",
"triggerID" : "8dadbf672d4d27505592f18bc89422fd7c013669",
"triggerType" : "PUSH"
}, {
"hash" : "906607be5bd62ee1cbbda34acb6a89916c1f7aee",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5424",
"triggerID" : "906607be5bd62ee1cbbda34acb6a89916c1f7aee",
"triggerType" : "PUSH"
}, {
"hash" : "dc1b033f40cea9642f71b8fcff74aa82106726b6",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5484",
"triggerID" : "dc1b033f40cea9642f71b8fcff74aa82106726b6",
"triggerType" : "PUSH"
}, {
"hash" : "5b8f5819fff8fec34864eb409fd429b95be17b9b",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "5b8f5819fff8fec34864eb409fd429b95be17b9b",
"triggerType" : "PUSH"
}, {
"hash" : "13702fc2232ebd9300966b0a917a3358d8d0f18c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5590",
"triggerID" : "13702fc2232ebd9300966b0a917a3358d8d0f18c",
"triggerType" : "PUSH"
}, {
"hash" : "13702fc2232ebd9300966b0a917a3358d8d0f18c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5600",
"triggerID" : "1024845655",
"triggerType" : "MANUAL"
}, {
"hash" : "9bdd8a60f95123f82a5f30f5e68929f5b7e1f8da",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5603",
"triggerID" : "9bdd8a60f95123f82a5f30f5e68929f5b7e1f8da",
"triggerType" : "PUSH"
}, {
"hash" : "aebb9df557c4afe3ca88f6b8b28ba2fbfdcbd597",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5631",
"triggerID" : "aebb9df557c4afe3ca88f6b8b28ba2fbfdcbd597",
"triggerType" : "PUSH"
}, {
"hash" : "5d37935bc8bb33260735d782ca560fd59e02f321",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "5d37935bc8bb33260735d782ca560fd59e02f321",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 77d11131baabd1c4e3cc2050337daca4df5f6427 UNKNOWN
* 3d9c2ae28da858d1e8476052c99391015effb7db UNKNOWN
* 31b0669d7b638bd65a17b22a2ceb772f2627512c UNKNOWN
* 28a5a4f537544d35dfcd8700a7b97fb7216682ce UNKNOWN
* c09e228f7cce78a7dbbc394e93b3cf8c6c3d4d5f UNKNOWN
* 5b8f5819fff8fec34864eb409fd429b95be17b9b UNKNOWN
* aebb9df557c4afe3ca88f6b8b28ba2fbfdcbd597 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5631)
* 5d37935bc8bb33260735d782ca560fd59e02f321 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] alexeykudinkin commented on a change in pull request #4556: [HUDI-3191] Removing duplicating file-listing process w/in Hive's MOR `FileInputFormat`s
Posted by GitBox <gi...@apache.org>.
alexeykudinkin commented on a change in pull request #4556:
URL: https://github.com/apache/hudi/pull/4556#discussion_r791354207
##########
File path: hudi-client/hudi-spark-client/src/test/java/org/apache/hudi/table/functional/TestHoodieSparkMergeOnReadTableRollback.java
##########
@@ -361,15 +386,19 @@ void testMultiRollbackWithDeltaAndCompactionCommit() throws Exception {
copyOfRecords = dataGen.generateUpdates(newCommitTime, copyOfRecords);
copyOfRecords.addAll(dataGen.generateInserts(newCommitTime, 200));
- List<String> dataFiles = tableView.getLatestBaseFiles().map(hf -> hf.getPath()).collect(Collectors.toList());
+ List<String> dataFiles = tableView.getLatestBaseFiles()
+ .map(baseFile -> new Path(baseFile.getPath()).getParent().toString())
+ .collect(Collectors.toList());
List<GenericRecord> recordsRead = HoodieMergeOnReadTestUtils.getRecordsUsingInputFormat(hadoopConf(), dataFiles,
basePath());
assertEquals(200, recordsRead.size());
statuses = nClient.upsert(jsc().parallelize(copyOfRecords, 1), newCommitTime).collect();
// Verify there are no errors
assertNoWriteErrors(statuses);
- nClient.commit(newCommitTime, writeStatusJavaRDD);
+
+ nClient.commit(newCommitTime, jsc().parallelize(statuses));
+
Review comment:
These are not cosmetic -- these are real test failures fixes (fixes base-files double-writing)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] alexeykudinkin commented on a change in pull request #4556: [HUDI-3191] Removing duplicating file-listing process w/in Hive's MOR `FileInputFormat`s
Posted by GitBox <gi...@apache.org>.
alexeykudinkin commented on a change in pull request #4556:
URL: https://github.com/apache/hudi/pull/4556#discussion_r791350725
##########
File path: hudi-client/hudi-spark-client/src/test/java/org/apache/hudi/table/functional/TestHoodieSparkMergeOnReadTableRollback.java
##########
@@ -201,8 +206,10 @@ void testRollbackWithDeltaAndCompactionCommit(boolean rollbackUsingMarkers) thro
copyOfRecords = dataGen.generateUpdates(commitTime1, copyOfRecords);
copyOfRecords.addAll(dataGen.generateInserts(commitTime1, 200));
- List<String> dataFiles = tableView.getLatestBaseFiles().map(HoodieBaseFile::getPath).collect(Collectors.toList());
- List<GenericRecord> recordsRead = HoodieMergeOnReadTestUtils.getRecordsUsingInputFormat(hadoopConf(), dataFiles,
+ List<String> inputPaths = tableView.getLatestBaseFiles()
+ .map(baseFile -> new Path(baseFile.getPath()).getParent().toString())
+ .collect(Collectors.toList());
Review comment:
Preserving existing behavior (hence keeping lists instead of Sets)
##########
File path: hudi-client/hudi-spark-client/src/test/java/org/apache/hudi/table/functional/TestHoodieSparkMergeOnReadTableRollback.java
##########
@@ -268,11 +281,13 @@ void testRollbackWithDeltaAndCompactionCommit(boolean rollbackUsingMarkers) thro
thirdClient.startCommitWithTime(newCommitTime);
writeStatusJavaRDD = thirdClient.upsert(writeRecords, newCommitTime);
+
statuses = writeStatusJavaRDD.collect();
- thirdClient.commit(newCommitTime, writeStatusJavaRDD);
// Verify there are no errors
assertNoWriteErrors(statuses);
+ thirdClient.commit(newCommitTime, jsc().parallelize(statuses));
+
Review comment:
Replied above
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #4556: [HUDI-3191] Removing duplicating file-listing process w/in Hive's MOR `FileInputFormat`s
Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #4556:
URL: https://github.com/apache/hudi/pull/4556#issuecomment-1028455516
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "d87786af43a7aeba7549cc3cfcbd97fc312bee0e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5074",
"triggerID" : "d87786af43a7aeba7549cc3cfcbd97fc312bee0e",
"triggerType" : "PUSH"
}, {
"hash" : "4b87ba1474be575ec27109ccbe626e4c2fc9c224",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5077",
"triggerID" : "4b87ba1474be575ec27109ccbe626e4c2fc9c224",
"triggerType" : "PUSH"
}, {
"hash" : "77d11131baabd1c4e3cc2050337daca4df5f6427",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "77d11131baabd1c4e3cc2050337daca4df5f6427",
"triggerType" : "PUSH"
}, {
"hash" : "3d9c2ae28da858d1e8476052c99391015effb7db",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "3d9c2ae28da858d1e8476052c99391015effb7db",
"triggerType" : "PUSH"
}, {
"hash" : "79ac9affcb7f81497e0df755c8200638d35b02b7",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5081",
"triggerID" : "79ac9affcb7f81497e0df755c8200638d35b02b7",
"triggerType" : "PUSH"
}, {
"hash" : "3c14bbe6c6bcf49c4164c45e82f77b473f4de396",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5113",
"triggerID" : "3c14bbe6c6bcf49c4164c45e82f77b473f4de396",
"triggerType" : "PUSH"
}, {
"hash" : "276f13d6efd00b301b232b286d585729c9d1d26e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5116",
"triggerID" : "276f13d6efd00b301b232b286d585729c9d1d26e",
"triggerType" : "PUSH"
}, {
"hash" : "31b0669d7b638bd65a17b22a2ceb772f2627512c",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "31b0669d7b638bd65a17b22a2ceb772f2627512c",
"triggerType" : "PUSH"
}, {
"hash" : "096e26af39a477ffccbee0edd764493e12e15e71",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5124",
"triggerID" : "096e26af39a477ffccbee0edd764493e12e15e71",
"triggerType" : "PUSH"
}, {
"hash" : "97dd5ec7c9246f6d9f467b9076b790dd6017c5b4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5213",
"triggerID" : "97dd5ec7c9246f6d9f467b9076b790dd6017c5b4",
"triggerType" : "PUSH"
}, {
"hash" : "0538475fe488089c4cb3bc0afb63c2f518329969",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5257",
"triggerID" : "0538475fe488089c4cb3bc0afb63c2f518329969",
"triggerType" : "PUSH"
}, {
"hash" : "9f4b334e340fb26004e1b07fc8fbaaa047c76775",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5261",
"triggerID" : "9f4b334e340fb26004e1b07fc8fbaaa047c76775",
"triggerType" : "PUSH"
}, {
"hash" : "368c099820c3cbf57496d0e46d1858aa8eb153ee",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5330",
"triggerID" : "368c099820c3cbf57496d0e46d1858aa8eb153ee",
"triggerType" : "PUSH"
}, {
"hash" : "28a5a4f537544d35dfcd8700a7b97fb7216682ce",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "28a5a4f537544d35dfcd8700a7b97fb7216682ce",
"triggerType" : "PUSH"
}, {
"hash" : "08ffdd8b47d147c9b5c889a5f56e39b9b140612d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5351",
"triggerID" : "08ffdd8b47d147c9b5c889a5f56e39b9b140612d",
"triggerType" : "PUSH"
}, {
"hash" : "c09e228f7cce78a7dbbc394e93b3cf8c6c3d4d5f",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "c09e228f7cce78a7dbbc394e93b3cf8c6c3d4d5f",
"triggerType" : "PUSH"
}, {
"hash" : "8dadbf672d4d27505592f18bc89422fd7c013669",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5398",
"triggerID" : "8dadbf672d4d27505592f18bc89422fd7c013669",
"triggerType" : "PUSH"
}, {
"hash" : "906607be5bd62ee1cbbda34acb6a89916c1f7aee",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5424",
"triggerID" : "906607be5bd62ee1cbbda34acb6a89916c1f7aee",
"triggerType" : "PUSH"
}, {
"hash" : "dc1b033f40cea9642f71b8fcff74aa82106726b6",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5484",
"triggerID" : "dc1b033f40cea9642f71b8fcff74aa82106726b6",
"triggerType" : "PUSH"
}, {
"hash" : "5b8f5819fff8fec34864eb409fd429b95be17b9b",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "5b8f5819fff8fec34864eb409fd429b95be17b9b",
"triggerType" : "PUSH"
}, {
"hash" : "13702fc2232ebd9300966b0a917a3358d8d0f18c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5590",
"triggerID" : "13702fc2232ebd9300966b0a917a3358d8d0f18c",
"triggerType" : "PUSH"
}, {
"hash" : "13702fc2232ebd9300966b0a917a3358d8d0f18c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5600",
"triggerID" : "1024845655",
"triggerType" : "MANUAL"
}, {
"hash" : "9bdd8a60f95123f82a5f30f5e68929f5b7e1f8da",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5603",
"triggerID" : "9bdd8a60f95123f82a5f30f5e68929f5b7e1f8da",
"triggerType" : "PUSH"
}, {
"hash" : "aebb9df557c4afe3ca88f6b8b28ba2fbfdcbd597",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5631",
"triggerID" : "aebb9df557c4afe3ca88f6b8b28ba2fbfdcbd597",
"triggerType" : "PUSH"
}, {
"hash" : "5d37935bc8bb33260735d782ca560fd59e02f321",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "5d37935bc8bb33260735d782ca560fd59e02f321",
"triggerType" : "PUSH"
}, {
"hash" : "f911d869f50009e5cd9f3fd341c83c732d7531ba",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5634",
"triggerID" : "f911d869f50009e5cd9f3fd341c83c732d7531ba",
"triggerType" : "PUSH"
}, {
"hash" : "f911d869f50009e5cd9f3fd341c83c732d7531ba",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5657",
"triggerID" : "1027051107",
"triggerType" : "MANUAL"
}, {
"hash" : "f911d869f50009e5cd9f3fd341c83c732d7531ba",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5659",
"triggerID" : "1027166086",
"triggerType" : "MANUAL"
}, {
"hash" : "f911d869f50009e5cd9f3fd341c83c732d7531ba",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5665",
"triggerID" : "1027387044",
"triggerType" : "MANUAL"
}, {
"hash" : "34b94b96b03109555201092bfabce21793add437",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5689",
"triggerID" : "34b94b96b03109555201092bfabce21793add437",
"triggerType" : "PUSH"
}, {
"hash" : "7f793744421a5ee304d5dff89d23e1e925bfd1cb",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "7f793744421a5ee304d5dff89d23e1e925bfd1cb",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 77d11131baabd1c4e3cc2050337daca4df5f6427 UNKNOWN
* 3d9c2ae28da858d1e8476052c99391015effb7db UNKNOWN
* 31b0669d7b638bd65a17b22a2ceb772f2627512c UNKNOWN
* 28a5a4f537544d35dfcd8700a7b97fb7216682ce UNKNOWN
* c09e228f7cce78a7dbbc394e93b3cf8c6c3d4d5f UNKNOWN
* 5b8f5819fff8fec34864eb409fd429b95be17b9b UNKNOWN
* 5d37935bc8bb33260735d782ca560fd59e02f321 UNKNOWN
* f911d869f50009e5cd9f3fd341c83c732d7531ba Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5634) Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5657) Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5659) Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5665)
* 34b94b96b03109555201092bfabce21793add437 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5689)
* 7f793744421a5ee304d5dff89d23e1e925bfd1cb UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #4556: [HUDI-3191] Removing duplicating file-listing process w/in Hive's MOR `FileInputFormat`s
Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #4556:
URL: https://github.com/apache/hudi/pull/4556#issuecomment-1027470496
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "d87786af43a7aeba7549cc3cfcbd97fc312bee0e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5074",
"triggerID" : "d87786af43a7aeba7549cc3cfcbd97fc312bee0e",
"triggerType" : "PUSH"
}, {
"hash" : "4b87ba1474be575ec27109ccbe626e4c2fc9c224",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5077",
"triggerID" : "4b87ba1474be575ec27109ccbe626e4c2fc9c224",
"triggerType" : "PUSH"
}, {
"hash" : "77d11131baabd1c4e3cc2050337daca4df5f6427",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "77d11131baabd1c4e3cc2050337daca4df5f6427",
"triggerType" : "PUSH"
}, {
"hash" : "3d9c2ae28da858d1e8476052c99391015effb7db",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "3d9c2ae28da858d1e8476052c99391015effb7db",
"triggerType" : "PUSH"
}, {
"hash" : "79ac9affcb7f81497e0df755c8200638d35b02b7",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5081",
"triggerID" : "79ac9affcb7f81497e0df755c8200638d35b02b7",
"triggerType" : "PUSH"
}, {
"hash" : "3c14bbe6c6bcf49c4164c45e82f77b473f4de396",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5113",
"triggerID" : "3c14bbe6c6bcf49c4164c45e82f77b473f4de396",
"triggerType" : "PUSH"
}, {
"hash" : "276f13d6efd00b301b232b286d585729c9d1d26e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5116",
"triggerID" : "276f13d6efd00b301b232b286d585729c9d1d26e",
"triggerType" : "PUSH"
}, {
"hash" : "31b0669d7b638bd65a17b22a2ceb772f2627512c",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "31b0669d7b638bd65a17b22a2ceb772f2627512c",
"triggerType" : "PUSH"
}, {
"hash" : "096e26af39a477ffccbee0edd764493e12e15e71",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5124",
"triggerID" : "096e26af39a477ffccbee0edd764493e12e15e71",
"triggerType" : "PUSH"
}, {
"hash" : "97dd5ec7c9246f6d9f467b9076b790dd6017c5b4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5213",
"triggerID" : "97dd5ec7c9246f6d9f467b9076b790dd6017c5b4",
"triggerType" : "PUSH"
}, {
"hash" : "0538475fe488089c4cb3bc0afb63c2f518329969",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5257",
"triggerID" : "0538475fe488089c4cb3bc0afb63c2f518329969",
"triggerType" : "PUSH"
}, {
"hash" : "9f4b334e340fb26004e1b07fc8fbaaa047c76775",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5261",
"triggerID" : "9f4b334e340fb26004e1b07fc8fbaaa047c76775",
"triggerType" : "PUSH"
}, {
"hash" : "368c099820c3cbf57496d0e46d1858aa8eb153ee",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5330",
"triggerID" : "368c099820c3cbf57496d0e46d1858aa8eb153ee",
"triggerType" : "PUSH"
}, {
"hash" : "28a5a4f537544d35dfcd8700a7b97fb7216682ce",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "28a5a4f537544d35dfcd8700a7b97fb7216682ce",
"triggerType" : "PUSH"
}, {
"hash" : "08ffdd8b47d147c9b5c889a5f56e39b9b140612d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5351",
"triggerID" : "08ffdd8b47d147c9b5c889a5f56e39b9b140612d",
"triggerType" : "PUSH"
}, {
"hash" : "c09e228f7cce78a7dbbc394e93b3cf8c6c3d4d5f",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "c09e228f7cce78a7dbbc394e93b3cf8c6c3d4d5f",
"triggerType" : "PUSH"
}, {
"hash" : "8dadbf672d4d27505592f18bc89422fd7c013669",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5398",
"triggerID" : "8dadbf672d4d27505592f18bc89422fd7c013669",
"triggerType" : "PUSH"
}, {
"hash" : "906607be5bd62ee1cbbda34acb6a89916c1f7aee",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5424",
"triggerID" : "906607be5bd62ee1cbbda34acb6a89916c1f7aee",
"triggerType" : "PUSH"
}, {
"hash" : "dc1b033f40cea9642f71b8fcff74aa82106726b6",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5484",
"triggerID" : "dc1b033f40cea9642f71b8fcff74aa82106726b6",
"triggerType" : "PUSH"
}, {
"hash" : "5b8f5819fff8fec34864eb409fd429b95be17b9b",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "5b8f5819fff8fec34864eb409fd429b95be17b9b",
"triggerType" : "PUSH"
}, {
"hash" : "13702fc2232ebd9300966b0a917a3358d8d0f18c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5590",
"triggerID" : "13702fc2232ebd9300966b0a917a3358d8d0f18c",
"triggerType" : "PUSH"
}, {
"hash" : "13702fc2232ebd9300966b0a917a3358d8d0f18c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5600",
"triggerID" : "1024845655",
"triggerType" : "MANUAL"
}, {
"hash" : "9bdd8a60f95123f82a5f30f5e68929f5b7e1f8da",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5603",
"triggerID" : "9bdd8a60f95123f82a5f30f5e68929f5b7e1f8da",
"triggerType" : "PUSH"
}, {
"hash" : "aebb9df557c4afe3ca88f6b8b28ba2fbfdcbd597",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5631",
"triggerID" : "aebb9df557c4afe3ca88f6b8b28ba2fbfdcbd597",
"triggerType" : "PUSH"
}, {
"hash" : "5d37935bc8bb33260735d782ca560fd59e02f321",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "5d37935bc8bb33260735d782ca560fd59e02f321",
"triggerType" : "PUSH"
}, {
"hash" : "f911d869f50009e5cd9f3fd341c83c732d7531ba",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5634",
"triggerID" : "f911d869f50009e5cd9f3fd341c83c732d7531ba",
"triggerType" : "PUSH"
}, {
"hash" : "f911d869f50009e5cd9f3fd341c83c732d7531ba",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5657",
"triggerID" : "1027051107",
"triggerType" : "MANUAL"
}, {
"hash" : "f911d869f50009e5cd9f3fd341c83c732d7531ba",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5659",
"triggerID" : "1027166086",
"triggerType" : "MANUAL"
}, {
"hash" : "f911d869f50009e5cd9f3fd341c83c732d7531ba",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5665",
"triggerID" : "1027387044",
"triggerType" : "MANUAL"
} ]
}-->
## CI report:
* 77d11131baabd1c4e3cc2050337daca4df5f6427 UNKNOWN
* 3d9c2ae28da858d1e8476052c99391015effb7db UNKNOWN
* 31b0669d7b638bd65a17b22a2ceb772f2627512c UNKNOWN
* 28a5a4f537544d35dfcd8700a7b97fb7216682ce UNKNOWN
* c09e228f7cce78a7dbbc394e93b3cf8c6c3d4d5f UNKNOWN
* 5b8f5819fff8fec34864eb409fd429b95be17b9b UNKNOWN
* 5d37935bc8bb33260735d782ca560fd59e02f321 UNKNOWN
* f911d869f50009e5cd9f3fd341c83c732d7531ba Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5634) Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5657) Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5659) Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5665)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #4556: [HUDI-3191] Removing duplicating file-listing process w/in Hive's MOR `FileInputFormat`s
Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #4556:
URL: https://github.com/apache/hudi/pull/4556#issuecomment-1028462344
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "d87786af43a7aeba7549cc3cfcbd97fc312bee0e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5074",
"triggerID" : "d87786af43a7aeba7549cc3cfcbd97fc312bee0e",
"triggerType" : "PUSH"
}, {
"hash" : "4b87ba1474be575ec27109ccbe626e4c2fc9c224",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5077",
"triggerID" : "4b87ba1474be575ec27109ccbe626e4c2fc9c224",
"triggerType" : "PUSH"
}, {
"hash" : "77d11131baabd1c4e3cc2050337daca4df5f6427",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "77d11131baabd1c4e3cc2050337daca4df5f6427",
"triggerType" : "PUSH"
}, {
"hash" : "3d9c2ae28da858d1e8476052c99391015effb7db",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "3d9c2ae28da858d1e8476052c99391015effb7db",
"triggerType" : "PUSH"
}, {
"hash" : "79ac9affcb7f81497e0df755c8200638d35b02b7",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5081",
"triggerID" : "79ac9affcb7f81497e0df755c8200638d35b02b7",
"triggerType" : "PUSH"
}, {
"hash" : "3c14bbe6c6bcf49c4164c45e82f77b473f4de396",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5113",
"triggerID" : "3c14bbe6c6bcf49c4164c45e82f77b473f4de396",
"triggerType" : "PUSH"
}, {
"hash" : "276f13d6efd00b301b232b286d585729c9d1d26e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5116",
"triggerID" : "276f13d6efd00b301b232b286d585729c9d1d26e",
"triggerType" : "PUSH"
}, {
"hash" : "31b0669d7b638bd65a17b22a2ceb772f2627512c",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "31b0669d7b638bd65a17b22a2ceb772f2627512c",
"triggerType" : "PUSH"
}, {
"hash" : "096e26af39a477ffccbee0edd764493e12e15e71",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5124",
"triggerID" : "096e26af39a477ffccbee0edd764493e12e15e71",
"triggerType" : "PUSH"
}, {
"hash" : "97dd5ec7c9246f6d9f467b9076b790dd6017c5b4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5213",
"triggerID" : "97dd5ec7c9246f6d9f467b9076b790dd6017c5b4",
"triggerType" : "PUSH"
}, {
"hash" : "0538475fe488089c4cb3bc0afb63c2f518329969",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5257",
"triggerID" : "0538475fe488089c4cb3bc0afb63c2f518329969",
"triggerType" : "PUSH"
}, {
"hash" : "9f4b334e340fb26004e1b07fc8fbaaa047c76775",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5261",
"triggerID" : "9f4b334e340fb26004e1b07fc8fbaaa047c76775",
"triggerType" : "PUSH"
}, {
"hash" : "368c099820c3cbf57496d0e46d1858aa8eb153ee",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5330",
"triggerID" : "368c099820c3cbf57496d0e46d1858aa8eb153ee",
"triggerType" : "PUSH"
}, {
"hash" : "28a5a4f537544d35dfcd8700a7b97fb7216682ce",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "28a5a4f537544d35dfcd8700a7b97fb7216682ce",
"triggerType" : "PUSH"
}, {
"hash" : "08ffdd8b47d147c9b5c889a5f56e39b9b140612d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5351",
"triggerID" : "08ffdd8b47d147c9b5c889a5f56e39b9b140612d",
"triggerType" : "PUSH"
}, {
"hash" : "c09e228f7cce78a7dbbc394e93b3cf8c6c3d4d5f",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "c09e228f7cce78a7dbbc394e93b3cf8c6c3d4d5f",
"triggerType" : "PUSH"
}, {
"hash" : "8dadbf672d4d27505592f18bc89422fd7c013669",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5398",
"triggerID" : "8dadbf672d4d27505592f18bc89422fd7c013669",
"triggerType" : "PUSH"
}, {
"hash" : "906607be5bd62ee1cbbda34acb6a89916c1f7aee",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5424",
"triggerID" : "906607be5bd62ee1cbbda34acb6a89916c1f7aee",
"triggerType" : "PUSH"
}, {
"hash" : "dc1b033f40cea9642f71b8fcff74aa82106726b6",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5484",
"triggerID" : "dc1b033f40cea9642f71b8fcff74aa82106726b6",
"triggerType" : "PUSH"
}, {
"hash" : "5b8f5819fff8fec34864eb409fd429b95be17b9b",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "5b8f5819fff8fec34864eb409fd429b95be17b9b",
"triggerType" : "PUSH"
}, {
"hash" : "13702fc2232ebd9300966b0a917a3358d8d0f18c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5590",
"triggerID" : "13702fc2232ebd9300966b0a917a3358d8d0f18c",
"triggerType" : "PUSH"
}, {
"hash" : "13702fc2232ebd9300966b0a917a3358d8d0f18c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5600",
"triggerID" : "1024845655",
"triggerType" : "MANUAL"
}, {
"hash" : "9bdd8a60f95123f82a5f30f5e68929f5b7e1f8da",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5603",
"triggerID" : "9bdd8a60f95123f82a5f30f5e68929f5b7e1f8da",
"triggerType" : "PUSH"
}, {
"hash" : "aebb9df557c4afe3ca88f6b8b28ba2fbfdcbd597",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5631",
"triggerID" : "aebb9df557c4afe3ca88f6b8b28ba2fbfdcbd597",
"triggerType" : "PUSH"
}, {
"hash" : "5d37935bc8bb33260735d782ca560fd59e02f321",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "5d37935bc8bb33260735d782ca560fd59e02f321",
"triggerType" : "PUSH"
}, {
"hash" : "f911d869f50009e5cd9f3fd341c83c732d7531ba",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5634",
"triggerID" : "f911d869f50009e5cd9f3fd341c83c732d7531ba",
"triggerType" : "PUSH"
}, {
"hash" : "f911d869f50009e5cd9f3fd341c83c732d7531ba",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5657",
"triggerID" : "1027051107",
"triggerType" : "MANUAL"
}, {
"hash" : "f911d869f50009e5cd9f3fd341c83c732d7531ba",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5659",
"triggerID" : "1027166086",
"triggerType" : "MANUAL"
}, {
"hash" : "f911d869f50009e5cd9f3fd341c83c732d7531ba",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5665",
"triggerID" : "1027387044",
"triggerType" : "MANUAL"
}, {
"hash" : "34b94b96b03109555201092bfabce21793add437",
"status" : "CANCELED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5689",
"triggerID" : "34b94b96b03109555201092bfabce21793add437",
"triggerType" : "PUSH"
}, {
"hash" : "7f793744421a5ee304d5dff89d23e1e925bfd1cb",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5692",
"triggerID" : "7f793744421a5ee304d5dff89d23e1e925bfd1cb",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 77d11131baabd1c4e3cc2050337daca4df5f6427 UNKNOWN
* 3d9c2ae28da858d1e8476052c99391015effb7db UNKNOWN
* 31b0669d7b638bd65a17b22a2ceb772f2627512c UNKNOWN
* 28a5a4f537544d35dfcd8700a7b97fb7216682ce UNKNOWN
* c09e228f7cce78a7dbbc394e93b3cf8c6c3d4d5f UNKNOWN
* 5b8f5819fff8fec34864eb409fd429b95be17b9b UNKNOWN
* 5d37935bc8bb33260735d782ca560fd59e02f321 UNKNOWN
* 34b94b96b03109555201092bfabce21793add437 Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5689)
* 7f793744421a5ee304d5dff89d23e1e925bfd1cb Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5692)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #4556: [HUDI-3191] Removing duplicating file-listing process w/in Hive's MOR `FileInputFormat`s
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #4556:
URL: https://github.com/apache/hudi/pull/4556#issuecomment-1028382543
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "d87786af43a7aeba7549cc3cfcbd97fc312bee0e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5074",
"triggerID" : "d87786af43a7aeba7549cc3cfcbd97fc312bee0e",
"triggerType" : "PUSH"
}, {
"hash" : "4b87ba1474be575ec27109ccbe626e4c2fc9c224",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5077",
"triggerID" : "4b87ba1474be575ec27109ccbe626e4c2fc9c224",
"triggerType" : "PUSH"
}, {
"hash" : "77d11131baabd1c4e3cc2050337daca4df5f6427",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "77d11131baabd1c4e3cc2050337daca4df5f6427",
"triggerType" : "PUSH"
}, {
"hash" : "3d9c2ae28da858d1e8476052c99391015effb7db",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "3d9c2ae28da858d1e8476052c99391015effb7db",
"triggerType" : "PUSH"
}, {
"hash" : "79ac9affcb7f81497e0df755c8200638d35b02b7",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5081",
"triggerID" : "79ac9affcb7f81497e0df755c8200638d35b02b7",
"triggerType" : "PUSH"
}, {
"hash" : "3c14bbe6c6bcf49c4164c45e82f77b473f4de396",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5113",
"triggerID" : "3c14bbe6c6bcf49c4164c45e82f77b473f4de396",
"triggerType" : "PUSH"
}, {
"hash" : "276f13d6efd00b301b232b286d585729c9d1d26e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5116",
"triggerID" : "276f13d6efd00b301b232b286d585729c9d1d26e",
"triggerType" : "PUSH"
}, {
"hash" : "31b0669d7b638bd65a17b22a2ceb772f2627512c",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "31b0669d7b638bd65a17b22a2ceb772f2627512c",
"triggerType" : "PUSH"
}, {
"hash" : "096e26af39a477ffccbee0edd764493e12e15e71",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5124",
"triggerID" : "096e26af39a477ffccbee0edd764493e12e15e71",
"triggerType" : "PUSH"
}, {
"hash" : "97dd5ec7c9246f6d9f467b9076b790dd6017c5b4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5213",
"triggerID" : "97dd5ec7c9246f6d9f467b9076b790dd6017c5b4",
"triggerType" : "PUSH"
}, {
"hash" : "0538475fe488089c4cb3bc0afb63c2f518329969",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5257",
"triggerID" : "0538475fe488089c4cb3bc0afb63c2f518329969",
"triggerType" : "PUSH"
}, {
"hash" : "9f4b334e340fb26004e1b07fc8fbaaa047c76775",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5261",
"triggerID" : "9f4b334e340fb26004e1b07fc8fbaaa047c76775",
"triggerType" : "PUSH"
}, {
"hash" : "368c099820c3cbf57496d0e46d1858aa8eb153ee",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5330",
"triggerID" : "368c099820c3cbf57496d0e46d1858aa8eb153ee",
"triggerType" : "PUSH"
}, {
"hash" : "28a5a4f537544d35dfcd8700a7b97fb7216682ce",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "28a5a4f537544d35dfcd8700a7b97fb7216682ce",
"triggerType" : "PUSH"
}, {
"hash" : "08ffdd8b47d147c9b5c889a5f56e39b9b140612d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5351",
"triggerID" : "08ffdd8b47d147c9b5c889a5f56e39b9b140612d",
"triggerType" : "PUSH"
}, {
"hash" : "c09e228f7cce78a7dbbc394e93b3cf8c6c3d4d5f",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "c09e228f7cce78a7dbbc394e93b3cf8c6c3d4d5f",
"triggerType" : "PUSH"
}, {
"hash" : "8dadbf672d4d27505592f18bc89422fd7c013669",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5398",
"triggerID" : "8dadbf672d4d27505592f18bc89422fd7c013669",
"triggerType" : "PUSH"
}, {
"hash" : "906607be5bd62ee1cbbda34acb6a89916c1f7aee",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5424",
"triggerID" : "906607be5bd62ee1cbbda34acb6a89916c1f7aee",
"triggerType" : "PUSH"
}, {
"hash" : "dc1b033f40cea9642f71b8fcff74aa82106726b6",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5484",
"triggerID" : "dc1b033f40cea9642f71b8fcff74aa82106726b6",
"triggerType" : "PUSH"
}, {
"hash" : "5b8f5819fff8fec34864eb409fd429b95be17b9b",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "5b8f5819fff8fec34864eb409fd429b95be17b9b",
"triggerType" : "PUSH"
}, {
"hash" : "13702fc2232ebd9300966b0a917a3358d8d0f18c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5590",
"triggerID" : "13702fc2232ebd9300966b0a917a3358d8d0f18c",
"triggerType" : "PUSH"
}, {
"hash" : "13702fc2232ebd9300966b0a917a3358d8d0f18c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5600",
"triggerID" : "1024845655",
"triggerType" : "MANUAL"
}, {
"hash" : "9bdd8a60f95123f82a5f30f5e68929f5b7e1f8da",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5603",
"triggerID" : "9bdd8a60f95123f82a5f30f5e68929f5b7e1f8da",
"triggerType" : "PUSH"
}, {
"hash" : "aebb9df557c4afe3ca88f6b8b28ba2fbfdcbd597",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5631",
"triggerID" : "aebb9df557c4afe3ca88f6b8b28ba2fbfdcbd597",
"triggerType" : "PUSH"
}, {
"hash" : "5d37935bc8bb33260735d782ca560fd59e02f321",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "5d37935bc8bb33260735d782ca560fd59e02f321",
"triggerType" : "PUSH"
}, {
"hash" : "f911d869f50009e5cd9f3fd341c83c732d7531ba",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5634",
"triggerID" : "f911d869f50009e5cd9f3fd341c83c732d7531ba",
"triggerType" : "PUSH"
}, {
"hash" : "f911d869f50009e5cd9f3fd341c83c732d7531ba",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5657",
"triggerID" : "1027051107",
"triggerType" : "MANUAL"
}, {
"hash" : "f911d869f50009e5cd9f3fd341c83c732d7531ba",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5659",
"triggerID" : "1027166086",
"triggerType" : "MANUAL"
}, {
"hash" : "f911d869f50009e5cd9f3fd341c83c732d7531ba",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5665",
"triggerID" : "1027387044",
"triggerType" : "MANUAL"
}, {
"hash" : "34b94b96b03109555201092bfabce21793add437",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5689",
"triggerID" : "34b94b96b03109555201092bfabce21793add437",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 77d11131baabd1c4e3cc2050337daca4df5f6427 UNKNOWN
* 3d9c2ae28da858d1e8476052c99391015effb7db UNKNOWN
* 31b0669d7b638bd65a17b22a2ceb772f2627512c UNKNOWN
* 28a5a4f537544d35dfcd8700a7b97fb7216682ce UNKNOWN
* c09e228f7cce78a7dbbc394e93b3cf8c6c3d4d5f UNKNOWN
* 5b8f5819fff8fec34864eb409fd429b95be17b9b UNKNOWN
* 5d37935bc8bb33260735d782ca560fd59e02f321 UNKNOWN
* f911d869f50009e5cd9f3fd341c83c732d7531ba Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5634) Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5657) Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5659) Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5665)
* 34b94b96b03109555201092bfabce21793add437 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5689)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] alexeykudinkin commented on pull request #4556: [HUDI-3191] Removing duplicating file-listing process w/in Hive's MOR `FileInputFormat`s
Posted by GitBox <gi...@apache.org>.
alexeykudinkin commented on pull request #4556:
URL: https://github.com/apache/hudi/pull/4556#issuecomment-1028521365
@hudi-bot run azure
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] alexeykudinkin commented on a change in pull request #4556: [HUDI-3191] Removing duplicating file-listing process w/in Hive's MOR `FileInputFormat`s
Posted by GitBox <gi...@apache.org>.
alexeykudinkin commented on a change in pull request #4556:
URL: https://github.com/apache/hudi/pull/4556#discussion_r798204981
##########
File path: hudi-hadoop-mr/src/main/java/org/apache/hudi/hadoop/utils/HoodieRealtimeInputFormatUtils.java
##########
@@ -65,11 +65,70 @@
import java.util.stream.Collectors;
import java.util.stream.Stream;
+import static org.apache.hudi.TypeUtils.unsafeCast;
+import static org.apache.hudi.common.util.ValidationUtils.checkState;
+
public class HoodieRealtimeInputFormatUtils extends HoodieInputFormatUtils {
private static final Logger LOG = LogManager.getLogger(HoodieRealtimeInputFormatUtils.class);
- public static InputSplit[] getRealtimeSplits(Configuration conf, Stream<FileSplit> fileSplits) {
+ public static InputSplit[] getRealtimeSplits(Configuration conf, List<FileSplit> fileSplits) throws IOException {
+ if (fileSplits.isEmpty()) {
+ return new InputSplit[0];
+ }
+
+ FileSplit fileSplit = fileSplits.get(0);
+
+ // Pre-process table-config to fetch virtual key info
+ Path partitionPath = fileSplit.getPath().getParent();
+ HoodieTableMetaClient metaClient = getTableMetaClientForBasePathUnchecked(conf, partitionPath);
+
+ Option<HoodieVirtualKeyInfo> hoodieVirtualKeyInfoOpt = getHoodieVirtualKeyInfo(metaClient);
+
+ // NOTE: This timeline is kept in sync w/ {@code HoodieTableFileIndexBase}
+ HoodieInstant latestCommitInstant =
+ metaClient.getActiveTimeline().getCommitsTimeline().filterCompletedInstants().lastInstant().get();
+
+ InputSplit[] finalSplits = fileSplits.stream()
+ .map(split -> {
+ // There are 4 types of splits could we have to handle here
+ // - {@code BootstrapBaseFileSplit}: in case base file does have associated bootstrap file,
+ // but does NOT have any log files appended (convert it to {@code RealtimeBootstrapBaseFileSplit})
+ // - {@code RealtimeBootstrapBaseFileSplit}: in case base file does have associated bootstrap file
+ // and does have log files appended
+ // - {@code BaseFileWithLogsSplit}: in case base file does NOT have associated bootstrap file
+ // and does have log files appended;
+ // - {@code FileSplit}: in case Hive passed down non-Hudi path
+ if (split instanceof RealtimeBootstrapBaseFileSplit) {
+ return split;
+ } else if (split instanceof BootstrapBaseFileSplit) {
+ BootstrapBaseFileSplit bootstrapBaseFileSplit = unsafeCast(split);
+ return createRealtimeBoostrapBaseFileSplit(
+ bootstrapBaseFileSplit,
+ metaClient.getBasePath(),
+ Collections.emptyList(),
+ latestCommitInstant.getTimestamp(),
+ false);
+ } else if (split instanceof BaseFileWithLogsSplit) {
+ BaseFileWithLogsSplit baseFileWithLogsSplit = unsafeCast(split);
Review comment:
It does
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #4556: [HUDI-3191][Stacked on 4531] Removing duplicating file-listing process w/in Hive's MOR `FIleInputFormat`s
Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #4556:
URL: https://github.com/apache/hudi/pull/4556#issuecomment-1013537426
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "d87786af43a7aeba7549cc3cfcbd97fc312bee0e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5074",
"triggerID" : "d87786af43a7aeba7549cc3cfcbd97fc312bee0e",
"triggerType" : "PUSH"
}, {
"hash" : "4b87ba1474be575ec27109ccbe626e4c2fc9c224",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5077",
"triggerID" : "4b87ba1474be575ec27109ccbe626e4c2fc9c224",
"triggerType" : "PUSH"
}, {
"hash" : "77d11131baabd1c4e3cc2050337daca4df5f6427",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "77d11131baabd1c4e3cc2050337daca4df5f6427",
"triggerType" : "PUSH"
}, {
"hash" : "3d9c2ae28da858d1e8476052c99391015effb7db",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "3d9c2ae28da858d1e8476052c99391015effb7db",
"triggerType" : "PUSH"
}, {
"hash" : "79ac9affcb7f81497e0df755c8200638d35b02b7",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5081",
"triggerID" : "79ac9affcb7f81497e0df755c8200638d35b02b7",
"triggerType" : "PUSH"
}, {
"hash" : "3c14bbe6c6bcf49c4164c45e82f77b473f4de396",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5113",
"triggerID" : "3c14bbe6c6bcf49c4164c45e82f77b473f4de396",
"triggerType" : "PUSH"
}, {
"hash" : "276f13d6efd00b301b232b286d585729c9d1d26e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5116",
"triggerID" : "276f13d6efd00b301b232b286d585729c9d1d26e",
"triggerType" : "PUSH"
}, {
"hash" : "31b0669d7b638bd65a17b22a2ceb772f2627512c",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "31b0669d7b638bd65a17b22a2ceb772f2627512c",
"triggerType" : "PUSH"
}, {
"hash" : "096e26af39a477ffccbee0edd764493e12e15e71",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5124",
"triggerID" : "096e26af39a477ffccbee0edd764493e12e15e71",
"triggerType" : "PUSH"
}, {
"hash" : "97dd5ec7c9246f6d9f467b9076b790dd6017c5b4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5213",
"triggerID" : "97dd5ec7c9246f6d9f467b9076b790dd6017c5b4",
"triggerType" : "PUSH"
}, {
"hash" : "0538475fe488089c4cb3bc0afb63c2f518329969",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5257",
"triggerID" : "0538475fe488089c4cb3bc0afb63c2f518329969",
"triggerType" : "PUSH"
}, {
"hash" : "9f4b334e340fb26004e1b07fc8fbaaa047c76775",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "9f4b334e340fb26004e1b07fc8fbaaa047c76775",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 77d11131baabd1c4e3cc2050337daca4df5f6427 UNKNOWN
* 3d9c2ae28da858d1e8476052c99391015effb7db UNKNOWN
* 31b0669d7b638bd65a17b22a2ceb772f2627512c UNKNOWN
* 0538475fe488089c4cb3bc0afb63c2f518329969 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5257)
* 9f4b334e340fb26004e1b07fc8fbaaa047c76775 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #4556: [HUDI-3191][Stacked on 4531] Removing duplicating file-listing process w/in Hive's MOR `FIleInputFormat`s
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #4556:
URL: https://github.com/apache/hudi/pull/4556#issuecomment-1013451270
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "d87786af43a7aeba7549cc3cfcbd97fc312bee0e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5074",
"triggerID" : "d87786af43a7aeba7549cc3cfcbd97fc312bee0e",
"triggerType" : "PUSH"
}, {
"hash" : "4b87ba1474be575ec27109ccbe626e4c2fc9c224",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5077",
"triggerID" : "4b87ba1474be575ec27109ccbe626e4c2fc9c224",
"triggerType" : "PUSH"
}, {
"hash" : "77d11131baabd1c4e3cc2050337daca4df5f6427",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "77d11131baabd1c4e3cc2050337daca4df5f6427",
"triggerType" : "PUSH"
}, {
"hash" : "3d9c2ae28da858d1e8476052c99391015effb7db",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "3d9c2ae28da858d1e8476052c99391015effb7db",
"triggerType" : "PUSH"
}, {
"hash" : "79ac9affcb7f81497e0df755c8200638d35b02b7",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5081",
"triggerID" : "79ac9affcb7f81497e0df755c8200638d35b02b7",
"triggerType" : "PUSH"
}, {
"hash" : "3c14bbe6c6bcf49c4164c45e82f77b473f4de396",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5113",
"triggerID" : "3c14bbe6c6bcf49c4164c45e82f77b473f4de396",
"triggerType" : "PUSH"
}, {
"hash" : "276f13d6efd00b301b232b286d585729c9d1d26e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5116",
"triggerID" : "276f13d6efd00b301b232b286d585729c9d1d26e",
"triggerType" : "PUSH"
}, {
"hash" : "31b0669d7b638bd65a17b22a2ceb772f2627512c",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "31b0669d7b638bd65a17b22a2ceb772f2627512c",
"triggerType" : "PUSH"
}, {
"hash" : "096e26af39a477ffccbee0edd764493e12e15e71",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5124",
"triggerID" : "096e26af39a477ffccbee0edd764493e12e15e71",
"triggerType" : "PUSH"
}, {
"hash" : "97dd5ec7c9246f6d9f467b9076b790dd6017c5b4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5213",
"triggerID" : "97dd5ec7c9246f6d9f467b9076b790dd6017c5b4",
"triggerType" : "PUSH"
}, {
"hash" : "0538475fe488089c4cb3bc0afb63c2f518329969",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5257",
"triggerID" : "0538475fe488089c4cb3bc0afb63c2f518329969",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 77d11131baabd1c4e3cc2050337daca4df5f6427 UNKNOWN
* 3d9c2ae28da858d1e8476052c99391015effb7db UNKNOWN
* 31b0669d7b638bd65a17b22a2ceb772f2627512c UNKNOWN
* 0538475fe488089c4cb3bc0afb63c2f518329969 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5257)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #4556: [HUDI-3191][Stacked on 4531] Removing duplicating file-listing process w/in Hive's MOR `FIleInputFormat`s
Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #4556:
URL: https://github.com/apache/hudi/pull/4556#issuecomment-1013451270
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "d87786af43a7aeba7549cc3cfcbd97fc312bee0e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5074",
"triggerID" : "d87786af43a7aeba7549cc3cfcbd97fc312bee0e",
"triggerType" : "PUSH"
}, {
"hash" : "4b87ba1474be575ec27109ccbe626e4c2fc9c224",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5077",
"triggerID" : "4b87ba1474be575ec27109ccbe626e4c2fc9c224",
"triggerType" : "PUSH"
}, {
"hash" : "77d11131baabd1c4e3cc2050337daca4df5f6427",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "77d11131baabd1c4e3cc2050337daca4df5f6427",
"triggerType" : "PUSH"
}, {
"hash" : "3d9c2ae28da858d1e8476052c99391015effb7db",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "3d9c2ae28da858d1e8476052c99391015effb7db",
"triggerType" : "PUSH"
}, {
"hash" : "79ac9affcb7f81497e0df755c8200638d35b02b7",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5081",
"triggerID" : "79ac9affcb7f81497e0df755c8200638d35b02b7",
"triggerType" : "PUSH"
}, {
"hash" : "3c14bbe6c6bcf49c4164c45e82f77b473f4de396",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5113",
"triggerID" : "3c14bbe6c6bcf49c4164c45e82f77b473f4de396",
"triggerType" : "PUSH"
}, {
"hash" : "276f13d6efd00b301b232b286d585729c9d1d26e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5116",
"triggerID" : "276f13d6efd00b301b232b286d585729c9d1d26e",
"triggerType" : "PUSH"
}, {
"hash" : "31b0669d7b638bd65a17b22a2ceb772f2627512c",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "31b0669d7b638bd65a17b22a2ceb772f2627512c",
"triggerType" : "PUSH"
}, {
"hash" : "096e26af39a477ffccbee0edd764493e12e15e71",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5124",
"triggerID" : "096e26af39a477ffccbee0edd764493e12e15e71",
"triggerType" : "PUSH"
}, {
"hash" : "97dd5ec7c9246f6d9f467b9076b790dd6017c5b4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5213",
"triggerID" : "97dd5ec7c9246f6d9f467b9076b790dd6017c5b4",
"triggerType" : "PUSH"
}, {
"hash" : "0538475fe488089c4cb3bc0afb63c2f518329969",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5257",
"triggerID" : "0538475fe488089c4cb3bc0afb63c2f518329969",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 77d11131baabd1c4e3cc2050337daca4df5f6427 UNKNOWN
* 3d9c2ae28da858d1e8476052c99391015effb7db UNKNOWN
* 31b0669d7b638bd65a17b22a2ceb772f2627512c UNKNOWN
* 0538475fe488089c4cb3bc0afb63c2f518329969 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5257)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #4556: [HUDI-3191] Removing duplicating file-listing process w/in Hive's MOR `FIleInputFormat`s
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #4556:
URL: https://github.com/apache/hudi/pull/4556#issuecomment-1016914186
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "d87786af43a7aeba7549cc3cfcbd97fc312bee0e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5074",
"triggerID" : "d87786af43a7aeba7549cc3cfcbd97fc312bee0e",
"triggerType" : "PUSH"
}, {
"hash" : "4b87ba1474be575ec27109ccbe626e4c2fc9c224",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5077",
"triggerID" : "4b87ba1474be575ec27109ccbe626e4c2fc9c224",
"triggerType" : "PUSH"
}, {
"hash" : "77d11131baabd1c4e3cc2050337daca4df5f6427",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "77d11131baabd1c4e3cc2050337daca4df5f6427",
"triggerType" : "PUSH"
}, {
"hash" : "3d9c2ae28da858d1e8476052c99391015effb7db",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "3d9c2ae28da858d1e8476052c99391015effb7db",
"triggerType" : "PUSH"
}, {
"hash" : "79ac9affcb7f81497e0df755c8200638d35b02b7",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5081",
"triggerID" : "79ac9affcb7f81497e0df755c8200638d35b02b7",
"triggerType" : "PUSH"
}, {
"hash" : "3c14bbe6c6bcf49c4164c45e82f77b473f4de396",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5113",
"triggerID" : "3c14bbe6c6bcf49c4164c45e82f77b473f4de396",
"triggerType" : "PUSH"
}, {
"hash" : "276f13d6efd00b301b232b286d585729c9d1d26e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5116",
"triggerID" : "276f13d6efd00b301b232b286d585729c9d1d26e",
"triggerType" : "PUSH"
}, {
"hash" : "31b0669d7b638bd65a17b22a2ceb772f2627512c",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "31b0669d7b638bd65a17b22a2ceb772f2627512c",
"triggerType" : "PUSH"
}, {
"hash" : "096e26af39a477ffccbee0edd764493e12e15e71",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5124",
"triggerID" : "096e26af39a477ffccbee0edd764493e12e15e71",
"triggerType" : "PUSH"
}, {
"hash" : "97dd5ec7c9246f6d9f467b9076b790dd6017c5b4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5213",
"triggerID" : "97dd5ec7c9246f6d9f467b9076b790dd6017c5b4",
"triggerType" : "PUSH"
}, {
"hash" : "0538475fe488089c4cb3bc0afb63c2f518329969",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5257",
"triggerID" : "0538475fe488089c4cb3bc0afb63c2f518329969",
"triggerType" : "PUSH"
}, {
"hash" : "9f4b334e340fb26004e1b07fc8fbaaa047c76775",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5261",
"triggerID" : "9f4b334e340fb26004e1b07fc8fbaaa047c76775",
"triggerType" : "PUSH"
}, {
"hash" : "368c099820c3cbf57496d0e46d1858aa8eb153ee",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5330",
"triggerID" : "368c099820c3cbf57496d0e46d1858aa8eb153ee",
"triggerType" : "PUSH"
}, {
"hash" : "28a5a4f537544d35dfcd8700a7b97fb7216682ce",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "28a5a4f537544d35dfcd8700a7b97fb7216682ce",
"triggerType" : "PUSH"
}, {
"hash" : "08ffdd8b47d147c9b5c889a5f56e39b9b140612d",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5351",
"triggerID" : "08ffdd8b47d147c9b5c889a5f56e39b9b140612d",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 77d11131baabd1c4e3cc2050337daca4df5f6427 UNKNOWN
* 3d9c2ae28da858d1e8476052c99391015effb7db UNKNOWN
* 31b0669d7b638bd65a17b22a2ceb772f2627512c UNKNOWN
* 368c099820c3cbf57496d0e46d1858aa8eb153ee Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5330)
* 28a5a4f537544d35dfcd8700a7b97fb7216682ce UNKNOWN
* 08ffdd8b47d147c9b5c889a5f56e39b9b140612d Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5351)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #4556: [HUDI-3191] Removing duplicating file-listing process w/in Hive's MOR `FileInputFormat`s
Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #4556:
URL: https://github.com/apache/hudi/pull/4556#issuecomment-1018036962
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "d87786af43a7aeba7549cc3cfcbd97fc312bee0e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5074",
"triggerID" : "d87786af43a7aeba7549cc3cfcbd97fc312bee0e",
"triggerType" : "PUSH"
}, {
"hash" : "4b87ba1474be575ec27109ccbe626e4c2fc9c224",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5077",
"triggerID" : "4b87ba1474be575ec27109ccbe626e4c2fc9c224",
"triggerType" : "PUSH"
}, {
"hash" : "77d11131baabd1c4e3cc2050337daca4df5f6427",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "77d11131baabd1c4e3cc2050337daca4df5f6427",
"triggerType" : "PUSH"
}, {
"hash" : "3d9c2ae28da858d1e8476052c99391015effb7db",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "3d9c2ae28da858d1e8476052c99391015effb7db",
"triggerType" : "PUSH"
}, {
"hash" : "79ac9affcb7f81497e0df755c8200638d35b02b7",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5081",
"triggerID" : "79ac9affcb7f81497e0df755c8200638d35b02b7",
"triggerType" : "PUSH"
}, {
"hash" : "3c14bbe6c6bcf49c4164c45e82f77b473f4de396",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5113",
"triggerID" : "3c14bbe6c6bcf49c4164c45e82f77b473f4de396",
"triggerType" : "PUSH"
}, {
"hash" : "276f13d6efd00b301b232b286d585729c9d1d26e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5116",
"triggerID" : "276f13d6efd00b301b232b286d585729c9d1d26e",
"triggerType" : "PUSH"
}, {
"hash" : "31b0669d7b638bd65a17b22a2ceb772f2627512c",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "31b0669d7b638bd65a17b22a2ceb772f2627512c",
"triggerType" : "PUSH"
}, {
"hash" : "096e26af39a477ffccbee0edd764493e12e15e71",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5124",
"triggerID" : "096e26af39a477ffccbee0edd764493e12e15e71",
"triggerType" : "PUSH"
}, {
"hash" : "97dd5ec7c9246f6d9f467b9076b790dd6017c5b4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5213",
"triggerID" : "97dd5ec7c9246f6d9f467b9076b790dd6017c5b4",
"triggerType" : "PUSH"
}, {
"hash" : "0538475fe488089c4cb3bc0afb63c2f518329969",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5257",
"triggerID" : "0538475fe488089c4cb3bc0afb63c2f518329969",
"triggerType" : "PUSH"
}, {
"hash" : "9f4b334e340fb26004e1b07fc8fbaaa047c76775",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5261",
"triggerID" : "9f4b334e340fb26004e1b07fc8fbaaa047c76775",
"triggerType" : "PUSH"
}, {
"hash" : "368c099820c3cbf57496d0e46d1858aa8eb153ee",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5330",
"triggerID" : "368c099820c3cbf57496d0e46d1858aa8eb153ee",
"triggerType" : "PUSH"
}, {
"hash" : "28a5a4f537544d35dfcd8700a7b97fb7216682ce",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "28a5a4f537544d35dfcd8700a7b97fb7216682ce",
"triggerType" : "PUSH"
}, {
"hash" : "08ffdd8b47d147c9b5c889a5f56e39b9b140612d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5351",
"triggerID" : "08ffdd8b47d147c9b5c889a5f56e39b9b140612d",
"triggerType" : "PUSH"
}, {
"hash" : "c09e228f7cce78a7dbbc394e93b3cf8c6c3d4d5f",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "c09e228f7cce78a7dbbc394e93b3cf8c6c3d4d5f",
"triggerType" : "PUSH"
}, {
"hash" : "8dadbf672d4d27505592f18bc89422fd7c013669",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5398",
"triggerID" : "8dadbf672d4d27505592f18bc89422fd7c013669",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 77d11131baabd1c4e3cc2050337daca4df5f6427 UNKNOWN
* 3d9c2ae28da858d1e8476052c99391015effb7db UNKNOWN
* 31b0669d7b638bd65a17b22a2ceb772f2627512c UNKNOWN
* 28a5a4f537544d35dfcd8700a7b97fb7216682ce UNKNOWN
* c09e228f7cce78a7dbbc394e93b3cf8c6c3d4d5f UNKNOWN
* 8dadbf672d4d27505592f18bc89422fd7c013669 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5398)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #4556: [HUDI-3191] Removing duplicating file-listing process w/in Hive's MOR `FIleInputFormat`s
Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #4556:
URL: https://github.com/apache/hudi/pull/4556#issuecomment-1017976303
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "d87786af43a7aeba7549cc3cfcbd97fc312bee0e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5074",
"triggerID" : "d87786af43a7aeba7549cc3cfcbd97fc312bee0e",
"triggerType" : "PUSH"
}, {
"hash" : "4b87ba1474be575ec27109ccbe626e4c2fc9c224",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5077",
"triggerID" : "4b87ba1474be575ec27109ccbe626e4c2fc9c224",
"triggerType" : "PUSH"
}, {
"hash" : "77d11131baabd1c4e3cc2050337daca4df5f6427",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "77d11131baabd1c4e3cc2050337daca4df5f6427",
"triggerType" : "PUSH"
}, {
"hash" : "3d9c2ae28da858d1e8476052c99391015effb7db",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "3d9c2ae28da858d1e8476052c99391015effb7db",
"triggerType" : "PUSH"
}, {
"hash" : "79ac9affcb7f81497e0df755c8200638d35b02b7",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5081",
"triggerID" : "79ac9affcb7f81497e0df755c8200638d35b02b7",
"triggerType" : "PUSH"
}, {
"hash" : "3c14bbe6c6bcf49c4164c45e82f77b473f4de396",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5113",
"triggerID" : "3c14bbe6c6bcf49c4164c45e82f77b473f4de396",
"triggerType" : "PUSH"
}, {
"hash" : "276f13d6efd00b301b232b286d585729c9d1d26e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5116",
"triggerID" : "276f13d6efd00b301b232b286d585729c9d1d26e",
"triggerType" : "PUSH"
}, {
"hash" : "31b0669d7b638bd65a17b22a2ceb772f2627512c",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "31b0669d7b638bd65a17b22a2ceb772f2627512c",
"triggerType" : "PUSH"
}, {
"hash" : "096e26af39a477ffccbee0edd764493e12e15e71",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5124",
"triggerID" : "096e26af39a477ffccbee0edd764493e12e15e71",
"triggerType" : "PUSH"
}, {
"hash" : "97dd5ec7c9246f6d9f467b9076b790dd6017c5b4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5213",
"triggerID" : "97dd5ec7c9246f6d9f467b9076b790dd6017c5b4",
"triggerType" : "PUSH"
}, {
"hash" : "0538475fe488089c4cb3bc0afb63c2f518329969",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5257",
"triggerID" : "0538475fe488089c4cb3bc0afb63c2f518329969",
"triggerType" : "PUSH"
}, {
"hash" : "9f4b334e340fb26004e1b07fc8fbaaa047c76775",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5261",
"triggerID" : "9f4b334e340fb26004e1b07fc8fbaaa047c76775",
"triggerType" : "PUSH"
}, {
"hash" : "368c099820c3cbf57496d0e46d1858aa8eb153ee",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5330",
"triggerID" : "368c099820c3cbf57496d0e46d1858aa8eb153ee",
"triggerType" : "PUSH"
}, {
"hash" : "28a5a4f537544d35dfcd8700a7b97fb7216682ce",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "28a5a4f537544d35dfcd8700a7b97fb7216682ce",
"triggerType" : "PUSH"
}, {
"hash" : "08ffdd8b47d147c9b5c889a5f56e39b9b140612d",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5351",
"triggerID" : "08ffdd8b47d147c9b5c889a5f56e39b9b140612d",
"triggerType" : "PUSH"
}, {
"hash" : "c09e228f7cce78a7dbbc394e93b3cf8c6c3d4d5f",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "c09e228f7cce78a7dbbc394e93b3cf8c6c3d4d5f",
"triggerType" : "PUSH"
}, {
"hash" : "8dadbf672d4d27505592f18bc89422fd7c013669",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "8dadbf672d4d27505592f18bc89422fd7c013669",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 77d11131baabd1c4e3cc2050337daca4df5f6427 UNKNOWN
* 3d9c2ae28da858d1e8476052c99391015effb7db UNKNOWN
* 31b0669d7b638bd65a17b22a2ceb772f2627512c UNKNOWN
* 28a5a4f537544d35dfcd8700a7b97fb7216682ce UNKNOWN
* 08ffdd8b47d147c9b5c889a5f56e39b9b140612d Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5351)
* c09e228f7cce78a7dbbc394e93b3cf8c6c3d4d5f UNKNOWN
* 8dadbf672d4d27505592f18bc89422fd7c013669 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #4556: [HUDI-3191] Removing duplicating file-listing process w/in Hive's MOR `FIleInputFormat`s
Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #4556:
URL: https://github.com/apache/hudi/pull/4556#issuecomment-1017978413
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "d87786af43a7aeba7549cc3cfcbd97fc312bee0e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5074",
"triggerID" : "d87786af43a7aeba7549cc3cfcbd97fc312bee0e",
"triggerType" : "PUSH"
}, {
"hash" : "4b87ba1474be575ec27109ccbe626e4c2fc9c224",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5077",
"triggerID" : "4b87ba1474be575ec27109ccbe626e4c2fc9c224",
"triggerType" : "PUSH"
}, {
"hash" : "77d11131baabd1c4e3cc2050337daca4df5f6427",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "77d11131baabd1c4e3cc2050337daca4df5f6427",
"triggerType" : "PUSH"
}, {
"hash" : "3d9c2ae28da858d1e8476052c99391015effb7db",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "3d9c2ae28da858d1e8476052c99391015effb7db",
"triggerType" : "PUSH"
}, {
"hash" : "79ac9affcb7f81497e0df755c8200638d35b02b7",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5081",
"triggerID" : "79ac9affcb7f81497e0df755c8200638d35b02b7",
"triggerType" : "PUSH"
}, {
"hash" : "3c14bbe6c6bcf49c4164c45e82f77b473f4de396",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5113",
"triggerID" : "3c14bbe6c6bcf49c4164c45e82f77b473f4de396",
"triggerType" : "PUSH"
}, {
"hash" : "276f13d6efd00b301b232b286d585729c9d1d26e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5116",
"triggerID" : "276f13d6efd00b301b232b286d585729c9d1d26e",
"triggerType" : "PUSH"
}, {
"hash" : "31b0669d7b638bd65a17b22a2ceb772f2627512c",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "31b0669d7b638bd65a17b22a2ceb772f2627512c",
"triggerType" : "PUSH"
}, {
"hash" : "096e26af39a477ffccbee0edd764493e12e15e71",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5124",
"triggerID" : "096e26af39a477ffccbee0edd764493e12e15e71",
"triggerType" : "PUSH"
}, {
"hash" : "97dd5ec7c9246f6d9f467b9076b790dd6017c5b4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5213",
"triggerID" : "97dd5ec7c9246f6d9f467b9076b790dd6017c5b4",
"triggerType" : "PUSH"
}, {
"hash" : "0538475fe488089c4cb3bc0afb63c2f518329969",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5257",
"triggerID" : "0538475fe488089c4cb3bc0afb63c2f518329969",
"triggerType" : "PUSH"
}, {
"hash" : "9f4b334e340fb26004e1b07fc8fbaaa047c76775",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5261",
"triggerID" : "9f4b334e340fb26004e1b07fc8fbaaa047c76775",
"triggerType" : "PUSH"
}, {
"hash" : "368c099820c3cbf57496d0e46d1858aa8eb153ee",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5330",
"triggerID" : "368c099820c3cbf57496d0e46d1858aa8eb153ee",
"triggerType" : "PUSH"
}, {
"hash" : "28a5a4f537544d35dfcd8700a7b97fb7216682ce",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "28a5a4f537544d35dfcd8700a7b97fb7216682ce",
"triggerType" : "PUSH"
}, {
"hash" : "08ffdd8b47d147c9b5c889a5f56e39b9b140612d",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5351",
"triggerID" : "08ffdd8b47d147c9b5c889a5f56e39b9b140612d",
"triggerType" : "PUSH"
}, {
"hash" : "c09e228f7cce78a7dbbc394e93b3cf8c6c3d4d5f",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "c09e228f7cce78a7dbbc394e93b3cf8c6c3d4d5f",
"triggerType" : "PUSH"
}, {
"hash" : "8dadbf672d4d27505592f18bc89422fd7c013669",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5398",
"triggerID" : "8dadbf672d4d27505592f18bc89422fd7c013669",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 77d11131baabd1c4e3cc2050337daca4df5f6427 UNKNOWN
* 3d9c2ae28da858d1e8476052c99391015effb7db UNKNOWN
* 31b0669d7b638bd65a17b22a2ceb772f2627512c UNKNOWN
* 28a5a4f537544d35dfcd8700a7b97fb7216682ce UNKNOWN
* 08ffdd8b47d147c9b5c889a5f56e39b9b140612d Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5351)
* c09e228f7cce78a7dbbc394e93b3cf8c6c3d4d5f UNKNOWN
* 8dadbf672d4d27505592f18bc89422fd7c013669 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5398)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #4556: [HUDI-3191] Removing duplicating file-listing process w/in Hive's MOR `FIleInputFormat`s
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #4556:
URL: https://github.com/apache/hudi/pull/4556#issuecomment-1016891619
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "d87786af43a7aeba7549cc3cfcbd97fc312bee0e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5074",
"triggerID" : "d87786af43a7aeba7549cc3cfcbd97fc312bee0e",
"triggerType" : "PUSH"
}, {
"hash" : "4b87ba1474be575ec27109ccbe626e4c2fc9c224",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5077",
"triggerID" : "4b87ba1474be575ec27109ccbe626e4c2fc9c224",
"triggerType" : "PUSH"
}, {
"hash" : "77d11131baabd1c4e3cc2050337daca4df5f6427",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "77d11131baabd1c4e3cc2050337daca4df5f6427",
"triggerType" : "PUSH"
}, {
"hash" : "3d9c2ae28da858d1e8476052c99391015effb7db",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "3d9c2ae28da858d1e8476052c99391015effb7db",
"triggerType" : "PUSH"
}, {
"hash" : "79ac9affcb7f81497e0df755c8200638d35b02b7",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5081",
"triggerID" : "79ac9affcb7f81497e0df755c8200638d35b02b7",
"triggerType" : "PUSH"
}, {
"hash" : "3c14bbe6c6bcf49c4164c45e82f77b473f4de396",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5113",
"triggerID" : "3c14bbe6c6bcf49c4164c45e82f77b473f4de396",
"triggerType" : "PUSH"
}, {
"hash" : "276f13d6efd00b301b232b286d585729c9d1d26e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5116",
"triggerID" : "276f13d6efd00b301b232b286d585729c9d1d26e",
"triggerType" : "PUSH"
}, {
"hash" : "31b0669d7b638bd65a17b22a2ceb772f2627512c",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "31b0669d7b638bd65a17b22a2ceb772f2627512c",
"triggerType" : "PUSH"
}, {
"hash" : "096e26af39a477ffccbee0edd764493e12e15e71",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5124",
"triggerID" : "096e26af39a477ffccbee0edd764493e12e15e71",
"triggerType" : "PUSH"
}, {
"hash" : "97dd5ec7c9246f6d9f467b9076b790dd6017c5b4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5213",
"triggerID" : "97dd5ec7c9246f6d9f467b9076b790dd6017c5b4",
"triggerType" : "PUSH"
}, {
"hash" : "0538475fe488089c4cb3bc0afb63c2f518329969",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5257",
"triggerID" : "0538475fe488089c4cb3bc0afb63c2f518329969",
"triggerType" : "PUSH"
}, {
"hash" : "9f4b334e340fb26004e1b07fc8fbaaa047c76775",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5261",
"triggerID" : "9f4b334e340fb26004e1b07fc8fbaaa047c76775",
"triggerType" : "PUSH"
}, {
"hash" : "368c099820c3cbf57496d0e46d1858aa8eb153ee",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5330",
"triggerID" : "368c099820c3cbf57496d0e46d1858aa8eb153ee",
"triggerType" : "PUSH"
}, {
"hash" : "28a5a4f537544d35dfcd8700a7b97fb7216682ce",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "28a5a4f537544d35dfcd8700a7b97fb7216682ce",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 77d11131baabd1c4e3cc2050337daca4df5f6427 UNKNOWN
* 3d9c2ae28da858d1e8476052c99391015effb7db UNKNOWN
* 31b0669d7b638bd65a17b22a2ceb772f2627512c UNKNOWN
* 368c099820c3cbf57496d0e46d1858aa8eb153ee Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5330)
* 28a5a4f537544d35dfcd8700a7b97fb7216682ce UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #4556: [HUDI-3191] Removing duplicating file-listing process w/in Hive's MOR `FileInputFormat`s
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #4556:
URL: https://github.com/apache/hudi/pull/4556#issuecomment-1018834442
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "d87786af43a7aeba7549cc3cfcbd97fc312bee0e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5074",
"triggerID" : "d87786af43a7aeba7549cc3cfcbd97fc312bee0e",
"triggerType" : "PUSH"
}, {
"hash" : "4b87ba1474be575ec27109ccbe626e4c2fc9c224",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5077",
"triggerID" : "4b87ba1474be575ec27109ccbe626e4c2fc9c224",
"triggerType" : "PUSH"
}, {
"hash" : "77d11131baabd1c4e3cc2050337daca4df5f6427",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "77d11131baabd1c4e3cc2050337daca4df5f6427",
"triggerType" : "PUSH"
}, {
"hash" : "3d9c2ae28da858d1e8476052c99391015effb7db",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "3d9c2ae28da858d1e8476052c99391015effb7db",
"triggerType" : "PUSH"
}, {
"hash" : "79ac9affcb7f81497e0df755c8200638d35b02b7",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5081",
"triggerID" : "79ac9affcb7f81497e0df755c8200638d35b02b7",
"triggerType" : "PUSH"
}, {
"hash" : "3c14bbe6c6bcf49c4164c45e82f77b473f4de396",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5113",
"triggerID" : "3c14bbe6c6bcf49c4164c45e82f77b473f4de396",
"triggerType" : "PUSH"
}, {
"hash" : "276f13d6efd00b301b232b286d585729c9d1d26e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5116",
"triggerID" : "276f13d6efd00b301b232b286d585729c9d1d26e",
"triggerType" : "PUSH"
}, {
"hash" : "31b0669d7b638bd65a17b22a2ceb772f2627512c",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "31b0669d7b638bd65a17b22a2ceb772f2627512c",
"triggerType" : "PUSH"
}, {
"hash" : "096e26af39a477ffccbee0edd764493e12e15e71",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5124",
"triggerID" : "096e26af39a477ffccbee0edd764493e12e15e71",
"triggerType" : "PUSH"
}, {
"hash" : "97dd5ec7c9246f6d9f467b9076b790dd6017c5b4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5213",
"triggerID" : "97dd5ec7c9246f6d9f467b9076b790dd6017c5b4",
"triggerType" : "PUSH"
}, {
"hash" : "0538475fe488089c4cb3bc0afb63c2f518329969",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5257",
"triggerID" : "0538475fe488089c4cb3bc0afb63c2f518329969",
"triggerType" : "PUSH"
}, {
"hash" : "9f4b334e340fb26004e1b07fc8fbaaa047c76775",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5261",
"triggerID" : "9f4b334e340fb26004e1b07fc8fbaaa047c76775",
"triggerType" : "PUSH"
}, {
"hash" : "368c099820c3cbf57496d0e46d1858aa8eb153ee",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5330",
"triggerID" : "368c099820c3cbf57496d0e46d1858aa8eb153ee",
"triggerType" : "PUSH"
}, {
"hash" : "28a5a4f537544d35dfcd8700a7b97fb7216682ce",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "28a5a4f537544d35dfcd8700a7b97fb7216682ce",
"triggerType" : "PUSH"
}, {
"hash" : "08ffdd8b47d147c9b5c889a5f56e39b9b140612d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5351",
"triggerID" : "08ffdd8b47d147c9b5c889a5f56e39b9b140612d",
"triggerType" : "PUSH"
}, {
"hash" : "c09e228f7cce78a7dbbc394e93b3cf8c6c3d4d5f",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "c09e228f7cce78a7dbbc394e93b3cf8c6c3d4d5f",
"triggerType" : "PUSH"
}, {
"hash" : "8dadbf672d4d27505592f18bc89422fd7c013669",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5398",
"triggerID" : "8dadbf672d4d27505592f18bc89422fd7c013669",
"triggerType" : "PUSH"
}, {
"hash" : "906607be5bd62ee1cbbda34acb6a89916c1f7aee",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "906607be5bd62ee1cbbda34acb6a89916c1f7aee",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 77d11131baabd1c4e3cc2050337daca4df5f6427 UNKNOWN
* 3d9c2ae28da858d1e8476052c99391015effb7db UNKNOWN
* 31b0669d7b638bd65a17b22a2ceb772f2627512c UNKNOWN
* 28a5a4f537544d35dfcd8700a7b97fb7216682ce UNKNOWN
* c09e228f7cce78a7dbbc394e93b3cf8c6c3d4d5f UNKNOWN
* 8dadbf672d4d27505592f18bc89422fd7c013669 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5398)
* 906607be5bd62ee1cbbda34acb6a89916c1f7aee UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #4556: [HUDI-3191][Stacked on 4531] Removing duplicating file-listing process w/in Hive's MOR `FIleInputFormat`s
Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #4556:
URL: https://github.com/apache/hudi/pull/4556#issuecomment-1013567395
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "d87786af43a7aeba7549cc3cfcbd97fc312bee0e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5074",
"triggerID" : "d87786af43a7aeba7549cc3cfcbd97fc312bee0e",
"triggerType" : "PUSH"
}, {
"hash" : "4b87ba1474be575ec27109ccbe626e4c2fc9c224",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5077",
"triggerID" : "4b87ba1474be575ec27109ccbe626e4c2fc9c224",
"triggerType" : "PUSH"
}, {
"hash" : "77d11131baabd1c4e3cc2050337daca4df5f6427",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "77d11131baabd1c4e3cc2050337daca4df5f6427",
"triggerType" : "PUSH"
}, {
"hash" : "3d9c2ae28da858d1e8476052c99391015effb7db",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "3d9c2ae28da858d1e8476052c99391015effb7db",
"triggerType" : "PUSH"
}, {
"hash" : "79ac9affcb7f81497e0df755c8200638d35b02b7",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5081",
"triggerID" : "79ac9affcb7f81497e0df755c8200638d35b02b7",
"triggerType" : "PUSH"
}, {
"hash" : "3c14bbe6c6bcf49c4164c45e82f77b473f4de396",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5113",
"triggerID" : "3c14bbe6c6bcf49c4164c45e82f77b473f4de396",
"triggerType" : "PUSH"
}, {
"hash" : "276f13d6efd00b301b232b286d585729c9d1d26e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5116",
"triggerID" : "276f13d6efd00b301b232b286d585729c9d1d26e",
"triggerType" : "PUSH"
}, {
"hash" : "31b0669d7b638bd65a17b22a2ceb772f2627512c",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "31b0669d7b638bd65a17b22a2ceb772f2627512c",
"triggerType" : "PUSH"
}, {
"hash" : "096e26af39a477ffccbee0edd764493e12e15e71",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5124",
"triggerID" : "096e26af39a477ffccbee0edd764493e12e15e71",
"triggerType" : "PUSH"
}, {
"hash" : "97dd5ec7c9246f6d9f467b9076b790dd6017c5b4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5213",
"triggerID" : "97dd5ec7c9246f6d9f467b9076b790dd6017c5b4",
"triggerType" : "PUSH"
}, {
"hash" : "0538475fe488089c4cb3bc0afb63c2f518329969",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5257",
"triggerID" : "0538475fe488089c4cb3bc0afb63c2f518329969",
"triggerType" : "PUSH"
}, {
"hash" : "9f4b334e340fb26004e1b07fc8fbaaa047c76775",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5261",
"triggerID" : "9f4b334e340fb26004e1b07fc8fbaaa047c76775",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 77d11131baabd1c4e3cc2050337daca4df5f6427 UNKNOWN
* 3d9c2ae28da858d1e8476052c99391015effb7db UNKNOWN
* 31b0669d7b638bd65a17b22a2ceb772f2627512c UNKNOWN
* 9f4b334e340fb26004e1b07fc8fbaaa047c76775 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5261)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] yihua commented on a change in pull request #4556: [HUDI-3191] Removing duplicating file-listing process w/in Hive's MOR `FileInputFormat`s
Posted by GitBox <gi...@apache.org>.
yihua commented on a change in pull request #4556:
URL: https://github.com/apache/hudi/pull/4556#discussion_r794844054
##########
File path: hudi-client/hudi-spark-client/src/test/java/org/apache/hudi/table/functional/TestHoodieSparkMergeOnReadTableRollback.java
##########
@@ -516,8 +556,6 @@ void testMORTableRestore(boolean restoreAfterCompaction) throws Exception {
JavaRDD<HoodieRecord> writeRecords = jsc().parallelize(records, 1);
JavaRDD<WriteStatus> writeStatusJavaRDD = client.upsert(writeRecords, newCommitTime);
client.commit(newCommitTime, writeStatusJavaRDD);
- List<WriteStatus> statuses = writeStatusJavaRDD.collect();
- assertNoWriteErrors(statuses);
Review comment:
Here I think you can do similar checks like other tests you modified:
```
statuses = writeStatusJavaRDD.collect();
// Verify there are no errors
assertNoWriteErrors(statuses);
client.commit(newCommitTime, jsc().parallelize(statuses));
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] alexeykudinkin commented on pull request #4556: [HUDI-3191][Stacked on 4716] Removing duplicating file-listing process w/in Hive's MOR `FileInputFormat`s
Posted by GitBox <gi...@apache.org>.
alexeykudinkin commented on pull request #4556:
URL: https://github.com/apache/hudi/pull/4556#issuecomment-1024845655
@hudi-bot run azure
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] alexeykudinkin commented on a change in pull request #4556: [HUDI-3191] Removing duplicating file-listing process w/in Hive's MOR `FileInputFormat`s
Posted by GitBox <gi...@apache.org>.
alexeykudinkin commented on a change in pull request #4556:
URL: https://github.com/apache/hudi/pull/4556#discussion_r791350598
##########
File path: hudi-client/hudi-spark-client/src/test/java/org/apache/hudi/table/functional/TestHoodieSparkMergeOnReadTableRollback.java
##########
@@ -166,10 +169,12 @@ void testRollbackWithDeltaAndCompactionCommit(boolean rollbackUsingMarkers) thro
JavaRDD<HoodieRecord> writeRecords = jsc().parallelize(records, 1);
JavaRDD<WriteStatus> writeStatusJavaRDD = client.upsert(writeRecords, newCommitTime);
- client.commit(newCommitTime, writeStatusJavaRDD);
+
List<WriteStatus> statuses = writeStatusJavaRDD.collect();
assertNoWriteErrors(statuses);
+ client.commit(newCommitTime, jsc().parallelize(statuses));
+
Review comment:
These tests are actually written incorrectly -- they're dereferencing RDDs twice w/in `commit` and when the collect w/in the state itself. This leads to same base-files being double-written, which in turn fails assertion that i currently put in place to make sure that legacy flow and the new one yield identical results.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] yihua commented on a change in pull request #4556: [HUDI-3191] Removing duplicating file-listing process w/in Hive's MOR `FileInputFormat`s
Posted by GitBox <gi...@apache.org>.
yihua commented on a change in pull request #4556:
URL: https://github.com/apache/hudi/pull/4556#discussion_r791234892
##########
File path: hudi-client/hudi-spark-client/src/test/java/org/apache/hudi/table/functional/TestHoodieSparkMergeOnReadTableRollback.java
##########
@@ -268,11 +281,13 @@ void testRollbackWithDeltaAndCompactionCommit(boolean rollbackUsingMarkers) thro
thirdClient.startCommitWithTime(newCommitTime);
writeStatusJavaRDD = thirdClient.upsert(writeRecords, newCommitTime);
+
statuses = writeStatusJavaRDD.collect();
- thirdClient.commit(newCommitTime, writeStatusJavaRDD);
// Verify there are no errors
assertNoWriteErrors(statuses);
+ thirdClient.commit(newCommitTime, jsc().parallelize(statuses));
+
Review comment:
No need to change these?
##########
File path: hudi-client/hudi-spark-client/src/test/java/org/apache/hudi/table/functional/TestHoodieSparkMergeOnReadTableInsertUpdateDelete.java
##########
@@ -213,8 +214,11 @@ public void testSimpleInsertUpdateAndDelete(boolean populateMetaFields) throws E
dataFilesToRead = tableView.getLatestBaseFiles();
assertTrue(dataFilesToRead.findAny().isPresent());
- List<String> dataFiles = tableView.getLatestBaseFiles().map(HoodieBaseFile::getPath).collect(Collectors.toList());
- List<GenericRecord> recordsRead = HoodieMergeOnReadTestUtils.getRecordsUsingInputFormat(hadoopConf(), dataFiles, basePath(), new JobConf(hadoopConf()), true, false);
+ List<String> inputPaths = tableView.getLatestBaseFiles()
+ .map(baseFile -> new Path(baseFile.getPath()).getParent().toString())
+ .collect(Collectors.toList());
Review comment:
Same here
##########
File path: hudi-client/hudi-spark-client/src/test/java/org/apache/hudi/table/functional/TestHoodieSparkMergeOnReadTableRollback.java
##########
@@ -166,10 +169,12 @@ void testRollbackWithDeltaAndCompactionCommit(boolean rollbackUsingMarkers) thro
JavaRDD<HoodieRecord> writeRecords = jsc().parallelize(records, 1);
JavaRDD<WriteStatus> writeStatusJavaRDD = client.upsert(writeRecords, newCommitTime);
- client.commit(newCommitTime, writeStatusJavaRDD);
+
List<WriteStatus> statuses = writeStatusJavaRDD.collect();
assertNoWriteErrors(statuses);
+ client.commit(newCommitTime, jsc().parallelize(statuses));
+
Review comment:
No need to change these lines?
##########
File path: hudi-client/hudi-spark-client/src/test/java/org/apache/hudi/table/functional/TestHoodieSparkMergeOnReadTableRollback.java
##########
@@ -201,8 +206,10 @@ void testRollbackWithDeltaAndCompactionCommit(boolean rollbackUsingMarkers) thro
copyOfRecords = dataGen.generateUpdates(commitTime1, copyOfRecords);
copyOfRecords.addAll(dataGen.generateInserts(commitTime1, 200));
- List<String> dataFiles = tableView.getLatestBaseFiles().map(HoodieBaseFile::getPath).collect(Collectors.toList());
- List<GenericRecord> recordsRead = HoodieMergeOnReadTestUtils.getRecordsUsingInputFormat(hadoopConf(), dataFiles,
+ List<String> inputPaths = tableView.getLatestBaseFiles()
+ .map(baseFile -> new Path(baseFile.getPath()).getParent().toString())
+ .collect(Collectors.toList());
Review comment:
Same here for duplicated partition paths and below.
##########
File path: hudi-client/hudi-spark-client/src/test/java/org/apache/hudi/table/TestHoodieMergeOnReadTable.java
##########
@@ -189,8 +190,10 @@ public void testUpsertPartitioner(boolean populateMetaFields) throws Exception {
assertTrue(fileIdToNewSize.entrySet().stream().anyMatch(entry -> fileIdToSize.get(entry.getKey()) < entry.getValue()));
- List<String> dataFiles = roView.getLatestBaseFiles().map(HoodieBaseFile::getPath).collect(Collectors.toList());
- List<GenericRecord> recordsRead = HoodieMergeOnReadTestUtils.getRecordsUsingInputFormat(hadoopConf(), dataFiles,
+ List<String> inputPaths = roView.getLatestBaseFiles()
+ .map(baseFile -> new Path(baseFile.getPath()).getParent().toString())
+ .collect(Collectors.toList());
Review comment:
This can include duplicated partition paths. Should `Set<String>` be used instead?
##########
File path: hudi-common/src/main/scala/org/apache/hudi/HoodieTableFileIndexBase.scala
##########
@@ -87,6 +89,12 @@ abstract class HoodieTableFileIndexBase(engineContext: HoodieEngineContext,
refresh0()
+ /**
+ * Returns latest completed instant as seen by this instance of the file-index
+ */
+ def latestCompletedInstant(): Option[HoodieInstant] =
Review comment:
nit: rename to `getLatestCompletedInstant`?
##########
File path: hudi-hadoop-mr/src/main/java/org/apache/hudi/hadoop/BootstrapBaseFileSplit.java
##########
@@ -32,10 +32,6 @@
private FileSplit bootstrapFileSplit;
- public BootstrapBaseFileSplit() {
- super();
- }
Review comment:
Are we sure this is not used outside Hudi repo by code in query engines, such as Presto/Trino? If not certain, we can keep it as is.
##########
File path: hudi-hadoop-mr/src/main/java/org/apache/hudi/hadoop/HoodieFileInputFormatBase.java
##########
@@ -143,6 +121,127 @@ private static FileStatus getFileStatusUnchecked(Option<HoodieBaseFile> baseFile
return returns.toArray(new FileStatus[0]);
}
+ private void validate(List<FileStatus> targetFiles, List<FileStatus> legacyFileStatuses) {
+ List<FileStatus> diff = CollectionUtils.diff(targetFiles, legacyFileStatuses);
+ checkState(diff.isEmpty(), "Should be empty");
+ }
+
+ @Nonnull
+ private static FileStatus getFileStatusUnchecked(HoodieBaseFile baseFile) {
+ try {
+ return HoodieInputFormatUtils.getFileStatus(baseFile);
+ } catch (IOException ioe) {
+ throw new HoodieIOException("Failed to get file-status", ioe);
+ }
+ }
+
+ /**
+ * Abstracts and exposes {@link FileInputFormat#listStatus(JobConf)} operation to subclasses that
+ * lists files (returning an array of {@link FileStatus}) corresponding to the input paths specified
+ * as part of provided {@link JobConf}
+ */
+ protected final FileStatus[] doListStatus(JobConf job) throws IOException {
+ return super.listStatus(job);
+ }
+
+ /**
+ * Achieves listStatus functionality for an incrementally queried table. Instead of listing all
+ * partitions and then filtering based on the commits of interest, this logic first extracts the
+ * partitions touched by the desired commits and then lists only those partitions.
+ */
+ protected List<FileStatus> listStatusForIncrementalMode(JobConf job,
+ HoodieTableMetaClient tableMetaClient,
+ List<Path> inputPaths,
+ String incrementalTable) throws IOException {
+ String tableName = tableMetaClient.getTableConfig().getTableName();
+ Job jobContext = Job.getInstance(job);
+ Option<HoodieTimeline> timeline = HoodieInputFormatUtils.getFilteredCommitsTimeline(jobContext, tableMetaClient);
+ if (!timeline.isPresent()) {
+ return null;
+ }
+ Option<List<HoodieInstant>> commitsToCheck = HoodieInputFormatUtils.getCommitsForIncrementalQuery(jobContext, tableName, timeline.get());
+ if (!commitsToCheck.isPresent()) {
+ return null;
+ }
+ Option<String> incrementalInputPaths = HoodieInputFormatUtils.getAffectedPartitions(commitsToCheck.get(), tableMetaClient, timeline.get(), inputPaths);
+ // Mutate the JobConf to set the input paths to only partitions touched by incremental pull.
+ if (!incrementalInputPaths.isPresent()) {
+ return null;
+ }
+ setInputPaths(job, incrementalInputPaths.get());
+ FileStatus[] fileStatuses = doListStatus(job);
+ return HoodieInputFormatUtils.filterIncrementalFileStatus(jobContext, tableMetaClient, timeline.get(), fileStatuses, commitsToCheck.get());
+ }
+
+ protected abstract boolean includeLogFilesForSnapshotView();
+
+ @Nonnull
+ private static RealtimeFileStatus createRealtimeFileStatusUnchecked(HoodieBaseFile baseFile,
+ Stream<HoodieLogFile> logFiles,
+ Option<HoodieInstant> latestCompletedInstantOpt,
+ HoodieTableMetaClient tableMetaClient) {
+ List<HoodieLogFile> sortedLogFiles = logFiles.sorted(HoodieLogFile.getLogFileComparator()).collect(Collectors.toList());
+ FileStatus baseFileStatus = getFileStatusUnchecked(baseFile);
+ try {
+ RealtimeFileStatus rtFileStatus = new RealtimeFileStatus(baseFileStatus);
+ rtFileStatus.setDeltaLogFiles(sortedLogFiles);
+ rtFileStatus.setBaseFilePath(baseFile.getPath());
+ rtFileStatus.setBasePath(tableMetaClient.getBasePath());
+
+ if (latestCompletedInstantOpt.isPresent()) {
+ HoodieInstant latestCompletedInstant = latestCompletedInstantOpt.get();
+ checkState(latestCompletedInstant.isCompleted());
+
+ rtFileStatus.setMaxCommitTime(latestCompletedInstant.getTimestamp());
+ }
+
+ if (baseFileStatus instanceof LocatedFileStatusWithBootstrapBaseFile || baseFileStatus instanceof FileStatusWithBootstrapBaseFile) {
+ rtFileStatus.setBootStrapFileStatus(baseFileStatus);
+ }
+
+ return rtFileStatus;
+ } catch (IOException e) {
+ throw new HoodieIOException(String.format("Failed to init %s", RealtimeFileStatus.class.getSimpleName()), e);
+ }
+ }
+
+ @Nonnull
+ private List<FileStatus> listStatusForSnapshotModeLegacy(JobConf job, Map<String, HoodieTableMetaClient> tableMetaClientMap, List<Path> snapshotPaths) throws IOException {
+ return HoodieInputFormatUtils.filterFileStatusForSnapshotMode(job, tableMetaClientMap, snapshotPaths, includeLogFilesForSnapshotView());
+ }
+
+ @Nonnull
+ private static RealtimeFileStatus createRealtimeFileStatusUnchecked(HoodieLogFile latestLogFile,
+ Stream<HoodieLogFile> logFiles,
+ Option<HoodieInstant> latestCompletedInstantOpt,
+ HoodieTableMetaClient tableMetaClient) {
+ List<HoodieLogFile> sortedLogFiles = logFiles.sorted(HoodieLogFile.getLogFileComparator()).collect(Collectors.toList());
+ try {
+ RealtimeFileStatus rtFileStatus = new RealtimeFileStatus(latestLogFile.getFileStatus());
+ rtFileStatus.setDeltaLogFiles(sortedLogFiles);
+ rtFileStatus.setBasePath(tableMetaClient.getBasePath());
+
+ if (latestCompletedInstantOpt.isPresent()) {
+ HoodieInstant latestCompletedInstant = latestCompletedInstantOpt.get();
+ checkState(latestCompletedInstant.isCompleted());
Review comment:
Do we need to keep this for production?
##########
File path: hudi-hadoop-mr/src/main/java/org/apache/hudi/hadoop/HoodieFileInputFormatBase.java
##########
@@ -143,6 +121,127 @@ private static FileStatus getFileStatusUnchecked(Option<HoodieBaseFile> baseFile
return returns.toArray(new FileStatus[0]);
}
+ private void validate(List<FileStatus> targetFiles, List<FileStatus> legacyFileStatuses) {
+ List<FileStatus> diff = CollectionUtils.diff(targetFiles, legacyFileStatuses);
+ checkState(diff.isEmpty(), "Should be empty");
+ }
+
+ @Nonnull
+ private static FileStatus getFileStatusUnchecked(HoodieBaseFile baseFile) {
+ try {
+ return HoodieInputFormatUtils.getFileStatus(baseFile);
+ } catch (IOException ioe) {
+ throw new HoodieIOException("Failed to get file-status", ioe);
+ }
+ }
+
+ /**
+ * Abstracts and exposes {@link FileInputFormat#listStatus(JobConf)} operation to subclasses that
+ * lists files (returning an array of {@link FileStatus}) corresponding to the input paths specified
+ * as part of provided {@link JobConf}
+ */
+ protected final FileStatus[] doListStatus(JobConf job) throws IOException {
+ return super.listStatus(job);
+ }
+
+ /**
+ * Achieves listStatus functionality for an incrementally queried table. Instead of listing all
+ * partitions and then filtering based on the commits of interest, this logic first extracts the
+ * partitions touched by the desired commits and then lists only those partitions.
+ */
+ protected List<FileStatus> listStatusForIncrementalMode(JobConf job,
+ HoodieTableMetaClient tableMetaClient,
+ List<Path> inputPaths,
+ String incrementalTable) throws IOException {
+ String tableName = tableMetaClient.getTableConfig().getTableName();
+ Job jobContext = Job.getInstance(job);
+ Option<HoodieTimeline> timeline = HoodieInputFormatUtils.getFilteredCommitsTimeline(jobContext, tableMetaClient);
+ if (!timeline.isPresent()) {
+ return null;
+ }
+ Option<List<HoodieInstant>> commitsToCheck = HoodieInputFormatUtils.getCommitsForIncrementalQuery(jobContext, tableName, timeline.get());
+ if (!commitsToCheck.isPresent()) {
+ return null;
+ }
+ Option<String> incrementalInputPaths = HoodieInputFormatUtils.getAffectedPartitions(commitsToCheck.get(), tableMetaClient, timeline.get(), inputPaths);
+ // Mutate the JobConf to set the input paths to only partitions touched by incremental pull.
+ if (!incrementalInputPaths.isPresent()) {
+ return null;
+ }
+ setInputPaths(job, incrementalInputPaths.get());
+ FileStatus[] fileStatuses = doListStatus(job);
+ return HoodieInputFormatUtils.filterIncrementalFileStatus(jobContext, tableMetaClient, timeline.get(), fileStatuses, commitsToCheck.get());
+ }
+
+ protected abstract boolean includeLogFilesForSnapshotView();
+
+ @Nonnull
+ private static RealtimeFileStatus createRealtimeFileStatusUnchecked(HoodieBaseFile baseFile,
+ Stream<HoodieLogFile> logFiles,
+ Option<HoodieInstant> latestCompletedInstantOpt,
+ HoodieTableMetaClient tableMetaClient) {
+ List<HoodieLogFile> sortedLogFiles = logFiles.sorted(HoodieLogFile.getLogFileComparator()).collect(Collectors.toList());
+ FileStatus baseFileStatus = getFileStatusUnchecked(baseFile);
+ try {
+ RealtimeFileStatus rtFileStatus = new RealtimeFileStatus(baseFileStatus);
+ rtFileStatus.setDeltaLogFiles(sortedLogFiles);
+ rtFileStatus.setBaseFilePath(baseFile.getPath());
+ rtFileStatus.setBasePath(tableMetaClient.getBasePath());
+
+ if (latestCompletedInstantOpt.isPresent()) {
+ HoodieInstant latestCompletedInstant = latestCompletedInstantOpt.get();
+ checkState(latestCompletedInstant.isCompleted());
+
+ rtFileStatus.setMaxCommitTime(latestCompletedInstant.getTimestamp());
+ }
+
+ if (baseFileStatus instanceof LocatedFileStatusWithBootstrapBaseFile || baseFileStatus instanceof FileStatusWithBootstrapBaseFile) {
+ rtFileStatus.setBootStrapFileStatus(baseFileStatus);
+ }
+
+ return rtFileStatus;
+ } catch (IOException e) {
+ throw new HoodieIOException(String.format("Failed to init %s", RealtimeFileStatus.class.getSimpleName()), e);
+ }
+ }
+
+ @Nonnull
+ private List<FileStatus> listStatusForSnapshotModeLegacy(JobConf job, Map<String, HoodieTableMetaClient> tableMetaClientMap, List<Path> snapshotPaths) throws IOException {
+ return HoodieInputFormatUtils.filterFileStatusForSnapshotMode(job, tableMetaClientMap, snapshotPaths, includeLogFilesForSnapshotView());
+ }
+
+ @Nonnull
+ private static RealtimeFileStatus createRealtimeFileStatusUnchecked(HoodieLogFile latestLogFile,
Review comment:
nit: add docs to explain what's included in the returned file status?
##########
File path: hudi-hadoop-mr/src/main/java/org/apache/hudi/hadoop/PathWithLogFilePath.java
##########
@@ -31,7 +31,7 @@
*/
public class PathWithLogFilePath extends Path {
// a flag to mark this split is produced by incremental query or not.
- private boolean belongToIncrementalPath = false;
+ private boolean belongsToIncrementalPath = false;
Review comment:
nit: I see quite some renaming in the PR. Can they be separated out to another PR from the refactoring?
##########
File path: hudi-hadoop-mr/src/main/java/org/apache/hudi/hadoop/HoodieFileInputFormatBase.java
##########
@@ -143,6 +121,124 @@ private static FileStatus getFileStatusUnchecked(Option<HoodieBaseFile> baseFile
return returns.toArray(new FileStatus[0]);
}
+ private void validate(List<FileStatus> targetFiles, List<FileStatus> legacyFileStatuses) {
Review comment:
Are most methods in this class reordered? Why not keep the same ordering so it's easier to check the changes?
##########
File path: hudi-hadoop-mr/src/main/java/org/apache/hudi/hadoop/realtime/HoodieRealtimeFileSplit.java
##########
@@ -44,9 +44,7 @@
private Option<HoodieVirtualKeyInfo> hoodieVirtualKeyInfo = Option.empty();
- public HoodieRealtimeFileSplit() {
- super();
Review comment:
Still need to call super class constructor?
##########
File path: hudi-hadoop-mr/src/main/java/org/apache/hudi/hadoop/utils/HoodieRealtimeInputFormatUtils.java
##########
@@ -65,11 +65,71 @@
import java.util.stream.Collectors;
import java.util.stream.Stream;
+import static org.apache.hudi.TypeUtils.unsafeCast;
+import static org.apache.hudi.common.util.ValidationUtils.checkState;
+
public class HoodieRealtimeInputFormatUtils extends HoodieInputFormatUtils {
private static final Logger LOG = LogManager.getLogger(HoodieRealtimeInputFormatUtils.class);
- public static InputSplit[] getRealtimeSplits(Configuration conf, Stream<FileSplit> fileSplits) {
+ public static InputSplit[] getRealtimeSplits(Configuration conf, List<FileSplit> fileSplits) throws IOException {
+ if (fileSplits.isEmpty()) {
+ return new InputSplit[0];
+ }
+
+ FileSplit fileSplit = fileSplits.get(0);
+
+ // Pre-process table-config to fetch virtual key info
+ Path partitionPath = fileSplit.getPath().getParent();
+ HoodieTableMetaClient metaClient = getTableMetaClientForBasePathUnchecked(conf, partitionPath);
+
+ Option<HoodieVirtualKeyInfo> hoodieVirtualKeyInfoOpt = getHoodieVirtualKeyInfo(metaClient);
+
+ // NOTE: This timeline is kept in sync w/ {@code HoodieTableFileIndexBase}
+ HoodieInstant latestCommitInstant =
+ metaClient.getActiveTimeline().getCommitsTimeline().filterCompletedInstants().lastInstant().get();
+
+ InputSplit[] finalSplits = fileSplits.stream()
+ .map(split -> {
+ // There are 4 types of splits could we have to handle here
+ // - {@code BootstrapBaseFileSplit}: in case base file does have associated bootstrap file,
+ // but does NOT have any log files appended (convert it to {@code RealtimeBootstrapBaseFileSplit})
+ // - {@code RealtimeBootstrapBaseFileSplit}: in case base file does have associated bootstrap file
+ // and does have log files appended
+ // - {@code BaseFileWithLogsSplit}: in case base file does NOT have associated bootstrap file
+ // and does have log files appended;
+ // - {@code FileSplit}: in case Hive passed down non-Hudi path
+ //
+ if (split instanceof RealtimeBootstrapBaseFileSplit) {
+ return split;
+ } else if (split instanceof BootstrapBaseFileSplit) {
+ BootstrapBaseFileSplit bootstrapBaseFileSplit = unsafeCast(split);
+ return createRealtimeBoostrapBaseFileSplit(
+ bootstrapBaseFileSplit,
+ metaClient.getBasePath(),
+ Collections.emptyList(),
+ latestCommitInstant.getTimestamp(),
+ false);
+ } else if (split instanceof BaseFileWithLogsSplit) {
+ BaseFileWithLogsSplit baseFileWithLogsSplit = unsafeCast(split);
+ return createHoodieRealtimeSplitUnchecked(baseFileWithLogsSplit, hoodieVirtualKeyInfoOpt);
+ } else {
+ // Non-Hudi paths might result in just generic {@code FileSplit} being
+ // propagated up to this point
+ return split;
+ }
+ })
+ .toArray(InputSplit[]::new);
Review comment:
This can be avoided if returning List<>.
##########
File path: hudi-hadoop-mr/src/main/java/org/apache/hudi/hadoop/utils/HoodieRealtimeInputFormatUtils.java
##########
@@ -144,28 +204,32 @@
return rtSplits.toArray(new InputSplit[0]);
}
+ /**
+ * @deprecated will be replaced w/ {@link #getRealtimeSplits(Configuration, List)}
+ */
// get IncrementalRealtimeSplits
- public static InputSplit[] getIncrementalRealtimeSplits(Configuration conf, Stream<FileSplit> fileSplits) throws IOException {
+ public static InputSplit[] getIncrementalRealtimeSplits(Configuration conf, List<FileSplit> fileSplits) throws IOException {
+ checkState(fileSplits.stream().allMatch(HoodieRealtimeInputFormatUtils::doesBelongToIncrementalQuery),
+ "All splits have to belong to incremental query");
+
List<InputSplit> rtSplits = new ArrayList<>();
- List<FileSplit> fileSplitList = fileSplits.collect(Collectors.toList());
- Set<Path> partitionSet = fileSplitList.stream().map(f -> f.getPath().getParent()).collect(Collectors.toSet());
+ Set<Path> partitionSet = fileSplits.stream().map(f -> f.getPath().getParent()).collect(Collectors.toSet());
Map<Path, HoodieTableMetaClient> partitionsToMetaClient = getTableMetaClientByPartitionPath(conf, partitionSet);
// Pre process tableConfig from first partition to fetch virtual key info
Option<HoodieVirtualKeyInfo> hoodieVirtualKeyInfo = Option.empty();
if (partitionSet.size() > 0) {
hoodieVirtualKeyInfo = getHoodieVirtualKeyInfo(partitionsToMetaClient.get(partitionSet.iterator().next()));
}
Option<HoodieVirtualKeyInfo> finalHoodieVirtualKeyInfo = hoodieVirtualKeyInfo;
- fileSplitList.stream().forEach(s -> {
+ fileSplits.stream().forEach(s -> {
// deal with incremental query.
try {
if (s instanceof BaseFileWithLogsSplit) {
- BaseFileWithLogsSplit bs = (BaseFileWithLogsSplit)s;
- if (bs.getBelongToIncrementalSplit()) {
- rtSplits.add(new HoodieRealtimeFileSplit(bs, bs.getBasePath(), bs.getDeltaLogFiles(), bs.getMaxCommitTime(), finalHoodieVirtualKeyInfo));
- }
+ BaseFileWithLogsSplit bs = unsafeCast(s);
+ rtSplits.add(new HoodieRealtimeFileSplit(bs, bs.getBasePath(), bs.getDeltaLogFiles(), bs.getMaxCommitTime(), finalHoodieVirtualKeyInfo));
} else if (s instanceof RealtimeBootstrapBaseFileSplit) {
- rtSplits.add(s);
+ RealtimeBootstrapBaseFileSplit bs = unsafeCast(s);
Review comment:
Is type cast redundant here?
##########
File path: hudi-client/hudi-spark-client/src/test/java/org/apache/hudi/table/functional/TestHoodieSparkMergeOnReadTableRollback.java
##########
@@ -361,15 +386,19 @@ void testMultiRollbackWithDeltaAndCompactionCommit() throws Exception {
copyOfRecords = dataGen.generateUpdates(newCommitTime, copyOfRecords);
copyOfRecords.addAll(dataGen.generateInserts(newCommitTime, 200));
- List<String> dataFiles = tableView.getLatestBaseFiles().map(hf -> hf.getPath()).collect(Collectors.toList());
+ List<String> dataFiles = tableView.getLatestBaseFiles()
+ .map(baseFile -> new Path(baseFile.getPath()).getParent().toString())
+ .collect(Collectors.toList());
List<GenericRecord> recordsRead = HoodieMergeOnReadTestUtils.getRecordsUsingInputFormat(hadoopConf(), dataFiles,
basePath());
assertEquals(200, recordsRead.size());
statuses = nClient.upsert(jsc().parallelize(copyOfRecords, 1), newCommitTime).collect();
// Verify there are no errors
assertNoWriteErrors(statuses);
- nClient.commit(newCommitTime, writeStatusJavaRDD);
+
+ nClient.commit(newCommitTime, jsc().parallelize(statuses));
+
Review comment:
Let's revert the cosmetic changes in this PR to make review easier. You can put up a separate PR for cleaning the code up.
##########
File path: hudi-client/hudi-spark-client/src/test/java/org/apache/hudi/table/functional/TestHoodieSparkMergeOnReadTableRollback.java
##########
@@ -516,8 +556,6 @@ void testMORTableRestore(boolean restoreAfterCompaction) throws Exception {
JavaRDD<HoodieRecord> writeRecords = jsc().parallelize(records, 1);
JavaRDD<WriteStatus> writeStatusJavaRDD = client.upsert(writeRecords, newCommitTime);
client.commit(newCommitTime, writeStatusJavaRDD);
- List<WriteStatus> statuses = writeStatusJavaRDD.collect();
- assertNoWriteErrors(statuses);
Review comment:
Still want to keep the check?
##########
File path: hudi-hadoop-mr/src/main/java/org/apache/hudi/hadoop/utils/HoodieInputFormatUtils.java
##########
@@ -440,6 +437,9 @@ public static HoodieMetadataConfig buildMetadataConfig(Configuration conf) {
.build();
}
+ /**
+ * @deprecated
+ */
Review comment:
Should be an actual annotation instead?
##########
File path: hudi-hadoop-mr/src/main/java/org/apache/hudi/hadoop/utils/HoodieRealtimeInputFormatUtils.java
##########
@@ -65,11 +65,71 @@
import java.util.stream.Collectors;
import java.util.stream.Stream;
+import static org.apache.hudi.TypeUtils.unsafeCast;
+import static org.apache.hudi.common.util.ValidationUtils.checkState;
+
public class HoodieRealtimeInputFormatUtils extends HoodieInputFormatUtils {
private static final Logger LOG = LogManager.getLogger(HoodieRealtimeInputFormatUtils.class);
- public static InputSplit[] getRealtimeSplits(Configuration conf, Stream<FileSplit> fileSplits) {
+ public static InputSplit[] getRealtimeSplits(Configuration conf, List<FileSplit> fileSplits) throws IOException {
+ if (fileSplits.isEmpty()) {
+ return new InputSplit[0];
+ }
+
+ FileSplit fileSplit = fileSplits.get(0);
+
+ // Pre-process table-config to fetch virtual key info
+ Path partitionPath = fileSplit.getPath().getParent();
+ HoodieTableMetaClient metaClient = getTableMetaClientForBasePathUnchecked(conf, partitionPath);
+
+ Option<HoodieVirtualKeyInfo> hoodieVirtualKeyInfoOpt = getHoodieVirtualKeyInfo(metaClient);
+
+ // NOTE: This timeline is kept in sync w/ {@code HoodieTableFileIndexBase}
+ HoodieInstant latestCommitInstant =
+ metaClient.getActiveTimeline().getCommitsTimeline().filterCompletedInstants().lastInstant().get();
+
+ InputSplit[] finalSplits = fileSplits.stream()
+ .map(split -> {
+ // There are 4 types of splits could we have to handle here
+ // - {@code BootstrapBaseFileSplit}: in case base file does have associated bootstrap file,
+ // but does NOT have any log files appended (convert it to {@code RealtimeBootstrapBaseFileSplit})
+ // - {@code RealtimeBootstrapBaseFileSplit}: in case base file does have associated bootstrap file
+ // and does have log files appended
+ // - {@code BaseFileWithLogsSplit}: in case base file does NOT have associated bootstrap file
+ // and does have log files appended;
+ // - {@code FileSplit}: in case Hive passed down non-Hudi path
+ //
+ if (split instanceof RealtimeBootstrapBaseFileSplit) {
+ return split;
+ } else if (split instanceof BootstrapBaseFileSplit) {
+ BootstrapBaseFileSplit bootstrapBaseFileSplit = unsafeCast(split);
+ return createRealtimeBoostrapBaseFileSplit(
+ bootstrapBaseFileSplit,
+ metaClient.getBasePath(),
+ Collections.emptyList(),
+ latestCommitInstant.getTimestamp(),
+ false);
+ } else if (split instanceof BaseFileWithLogsSplit) {
+ BaseFileWithLogsSplit baseFileWithLogsSplit = unsafeCast(split);
+ return createHoodieRealtimeSplitUnchecked(baseFileWithLogsSplit, hoodieVirtualKeyInfoOpt);
+ } else {
+ // Non-Hudi paths might result in just generic {@code FileSplit} being
+ // propagated up to this point
+ return split;
+ }
+ })
+ .toArray(InputSplit[]::new);
+
+ LOG.info("Returning a total splits of " + finalSplits.length);
+
+ return finalSplits;
+ }
+
+ /**
+ * @deprecated
+ */
Review comment:
Similar here.
##########
File path: hudi-hadoop-mr/src/main/java/org/apache/hudi/hadoop/utils/HoodieRealtimeInputFormatUtils.java
##########
@@ -65,11 +65,71 @@
import java.util.stream.Collectors;
import java.util.stream.Stream;
+import static org.apache.hudi.TypeUtils.unsafeCast;
+import static org.apache.hudi.common.util.ValidationUtils.checkState;
+
public class HoodieRealtimeInputFormatUtils extends HoodieInputFormatUtils {
private static final Logger LOG = LogManager.getLogger(HoodieRealtimeInputFormatUtils.class);
- public static InputSplit[] getRealtimeSplits(Configuration conf, Stream<FileSplit> fileSplits) {
+ public static InputSplit[] getRealtimeSplits(Configuration conf, List<FileSplit> fileSplits) throws IOException {
+ if (fileSplits.isEmpty()) {
+ return new InputSplit[0];
+ }
+
+ FileSplit fileSplit = fileSplits.get(0);
+
+ // Pre-process table-config to fetch virtual key info
+ Path partitionPath = fileSplit.getPath().getParent();
+ HoodieTableMetaClient metaClient = getTableMetaClientForBasePathUnchecked(conf, partitionPath);
+
+ Option<HoodieVirtualKeyInfo> hoodieVirtualKeyInfoOpt = getHoodieVirtualKeyInfo(metaClient);
+
+ // NOTE: This timeline is kept in sync w/ {@code HoodieTableFileIndexBase}
+ HoodieInstant latestCommitInstant =
+ metaClient.getActiveTimeline().getCommitsTimeline().filterCompletedInstants().lastInstant().get();
+
+ InputSplit[] finalSplits = fileSplits.stream()
+ .map(split -> {
+ // There are 4 types of splits could we have to handle here
+ // - {@code BootstrapBaseFileSplit}: in case base file does have associated bootstrap file,
+ // but does NOT have any log files appended (convert it to {@code RealtimeBootstrapBaseFileSplit})
+ // - {@code RealtimeBootstrapBaseFileSplit}: in case base file does have associated bootstrap file
+ // and does have log files appended
+ // - {@code BaseFileWithLogsSplit}: in case base file does NOT have associated bootstrap file
Review comment:
Should this scenario be considered here: base file does not have associated bootstrap file and does not have updates to it (i.e., no log files appended)?
##########
File path: hudi-hadoop-mr/src/main/java/org/apache/hudi/hadoop/realtime/RealtimeBootstrapBaseFileSplit.java
##########
@@ -43,17 +43,20 @@
private String basePath;
- public RealtimeBootstrapBaseFileSplit() {
- super();
- }
Review comment:
Similar here. Wondering what is the reason of keeping such empty-arg constructors in the first place, so maybe we should not remove them?
##########
File path: hudi-hadoop-mr/src/main/java/org/apache/hudi/hadoop/HoodieFileInputFormatBase.java
##########
@@ -143,6 +121,127 @@ private static FileStatus getFileStatusUnchecked(Option<HoodieBaseFile> baseFile
return returns.toArray(new FileStatus[0]);
}
+ private void validate(List<FileStatus> targetFiles, List<FileStatus> legacyFileStatuses) {
+ List<FileStatus> diff = CollectionUtils.diff(targetFiles, legacyFileStatuses);
+ checkState(diff.isEmpty(), "Should be empty");
+ }
+
+ @Nonnull
+ private static FileStatus getFileStatusUnchecked(HoodieBaseFile baseFile) {
+ try {
+ return HoodieInputFormatUtils.getFileStatus(baseFile);
+ } catch (IOException ioe) {
+ throw new HoodieIOException("Failed to get file-status", ioe);
+ }
+ }
+
+ /**
+ * Abstracts and exposes {@link FileInputFormat#listStatus(JobConf)} operation to subclasses that
+ * lists files (returning an array of {@link FileStatus}) corresponding to the input paths specified
+ * as part of provided {@link JobConf}
+ */
+ protected final FileStatus[] doListStatus(JobConf job) throws IOException {
+ return super.listStatus(job);
+ }
+
+ /**
+ * Achieves listStatus functionality for an incrementally queried table. Instead of listing all
+ * partitions and then filtering based on the commits of interest, this logic first extracts the
+ * partitions touched by the desired commits and then lists only those partitions.
+ */
+ protected List<FileStatus> listStatusForIncrementalMode(JobConf job,
+ HoodieTableMetaClient tableMetaClient,
+ List<Path> inputPaths,
+ String incrementalTable) throws IOException {
+ String tableName = tableMetaClient.getTableConfig().getTableName();
+ Job jobContext = Job.getInstance(job);
+ Option<HoodieTimeline> timeline = HoodieInputFormatUtils.getFilteredCommitsTimeline(jobContext, tableMetaClient);
+ if (!timeline.isPresent()) {
+ return null;
+ }
+ Option<List<HoodieInstant>> commitsToCheck = HoodieInputFormatUtils.getCommitsForIncrementalQuery(jobContext, tableName, timeline.get());
+ if (!commitsToCheck.isPresent()) {
+ return null;
+ }
+ Option<String> incrementalInputPaths = HoodieInputFormatUtils.getAffectedPartitions(commitsToCheck.get(), tableMetaClient, timeline.get(), inputPaths);
+ // Mutate the JobConf to set the input paths to only partitions touched by incremental pull.
+ if (!incrementalInputPaths.isPresent()) {
+ return null;
+ }
+ setInputPaths(job, incrementalInputPaths.get());
+ FileStatus[] fileStatuses = doListStatus(job);
+ return HoodieInputFormatUtils.filterIncrementalFileStatus(jobContext, tableMetaClient, timeline.get(), fileStatuses, commitsToCheck.get());
+ }
+
+ protected abstract boolean includeLogFilesForSnapshotView();
+
+ @Nonnull
+ private static RealtimeFileStatus createRealtimeFileStatusUnchecked(HoodieBaseFile baseFile,
Review comment:
It looks like this is newly added. Add docs to explain the purpose?
##########
File path: hudi-client/hudi-spark-client/src/test/java/org/apache/hudi/table/TestHoodieMergeOnReadTable.java
##########
@@ -189,8 +190,10 @@ public void testUpsertPartitioner(boolean populateMetaFields) throws Exception {
assertTrue(fileIdToNewSize.entrySet().stream().anyMatch(entry -> fileIdToSize.get(entry.getKey()) < entry.getValue()));
- List<String> dataFiles = roView.getLatestBaseFiles().map(HoodieBaseFile::getPath).collect(Collectors.toList());
- List<GenericRecord> recordsRead = HoodieMergeOnReadTestUtils.getRecordsUsingInputFormat(hadoopConf(), dataFiles,
+ List<String> inputPaths = roView.getLatestBaseFiles()
+ .map(baseFile -> new Path(baseFile.getPath()).getParent().toString())
+ .collect(Collectors.toList());
Review comment:
Looking at this again, are these changes and similar ones in other test classes legit? Basically, the list of results is changed from base file paths to partition paths.
##########
File path: hudi-hadoop-mr/src/main/java/org/apache/hudi/hadoop/utils/HoodieRealtimeInputFormatUtils.java
##########
@@ -65,11 +65,71 @@
import java.util.stream.Collectors;
import java.util.stream.Stream;
+import static org.apache.hudi.TypeUtils.unsafeCast;
+import static org.apache.hudi.common.util.ValidationUtils.checkState;
+
public class HoodieRealtimeInputFormatUtils extends HoodieInputFormatUtils {
private static final Logger LOG = LogManager.getLogger(HoodieRealtimeInputFormatUtils.class);
- public static InputSplit[] getRealtimeSplits(Configuration conf, Stream<FileSplit> fileSplits) {
+ public static InputSplit[] getRealtimeSplits(Configuration conf, List<FileSplit> fileSplits) throws IOException {
Review comment:
Any reason of sticking to the return type of array instead of List (for all getting-splits methods)?
##########
File path: hudi-hadoop-mr/src/main/java/org/apache/hudi/hadoop/HoodieFileInputFormatBase.java
##########
@@ -187,13 +286,28 @@ private static FileStatus getFileStatusUnchecked(Option<HoodieBaseFile> baseFile
.map(fileSlice -> {
Option<HoodieBaseFile> baseFileOpt = fileSlice.getBaseFile();
Option<HoodieLogFile> latestLogFileOpt = fileSlice.getLatestLogFile();
- if (baseFileOpt.isPresent()) {
- return getFileStatusUnchecked(baseFileOpt);
- } else if (includeLogFilesForSnapShotView() && latestLogFileOpt.isPresent()) {
- return createRealtimeFileStatusUnchecked(latestLogFileOpt.get(), fileSlice.getLogFiles());
+ Stream<HoodieLogFile> logFiles = fileSlice.getLogFiles();
+
+ Option<HoodieInstant> latestCompletedInstantOpt =
+ fromScala(fileIndex.latestCompletedInstant());
+
+ // Check if we're reading a MOR table
+ if (includeLogFilesForSnapshotView()) {
+ if (baseFileOpt.isPresent()) {
+ return createRealtimeFileStatusUnchecked(baseFileOpt.get(), logFiles, latestCompletedInstantOpt, tableMetaClient);
+ } else if (latestLogFileOpt.isPresent()) {
+ return createRealtimeFileStatusUnchecked(latestLogFileOpt.get(), logFiles, latestCompletedInstantOpt, tableMetaClient);
+ } else {
+ throw new IllegalStateException("Invalid state: either base-file or log-file has to be present");
+ }
} else {
- throw new IllegalStateException("Invalid state: either base-file or log-file should be present");
+ if (baseFileOpt.isPresent()) {
+ return getFileStatusUnchecked(baseFileOpt.get());
+ } else {
+ throw new IllegalStateException("Invalid state: base-file has to be present");
+ }
}
Review comment:
It looks like the logic is changed here to cover broader cases, especially when both base file and log files exist. Basically, if base file exists, log files are ignored before. However, for Snapshot mode, should log files be ignored by default? Or do you intend to use this method `listStatusForSnapshotMode()` broadly for different query mode (renaming it if true)?
##########
File path: hudi-hadoop-mr/src/main/java/org/apache/hudi/hadoop/HoodieFileInputFormatBase.java
##########
@@ -187,13 +286,28 @@ private static FileStatus getFileStatusUnchecked(Option<HoodieBaseFile> baseFile
.map(fileSlice -> {
Option<HoodieBaseFile> baseFileOpt = fileSlice.getBaseFile();
Option<HoodieLogFile> latestLogFileOpt = fileSlice.getLatestLogFile();
- if (baseFileOpt.isPresent()) {
- return getFileStatusUnchecked(baseFileOpt);
- } else if (includeLogFilesForSnapShotView() && latestLogFileOpt.isPresent()) {
- return createRealtimeFileStatusUnchecked(latestLogFileOpt.get(), fileSlice.getLogFiles());
+ Stream<HoodieLogFile> logFiles = fileSlice.getLogFiles();
+
+ Option<HoodieInstant> latestCompletedInstantOpt =
+ fromScala(fileIndex.latestCompletedInstant());
+
+ // Check if we're reading a MOR table
+ if (includeLogFilesForSnapshotView()) {
+ if (baseFileOpt.isPresent()) {
+ return createRealtimeFileStatusUnchecked(baseFileOpt.get(), logFiles, latestCompletedInstantOpt, tableMetaClient);
+ } else if (latestLogFileOpt.isPresent()) {
+ return createRealtimeFileStatusUnchecked(latestLogFileOpt.get(), logFiles, latestCompletedInstantOpt, tableMetaClient);
+ } else {
+ throw new IllegalStateException("Invalid state: either base-file or log-file has to be present");
+ }
} else {
- throw new IllegalStateException("Invalid state: either base-file or log-file should be present");
+ if (baseFileOpt.isPresent()) {
+ return getFileStatusUnchecked(baseFileOpt.get());
+ } else {
+ throw new IllegalStateException("Invalid state: base-file has to be present");
+ }
}
Review comment:
To clarify, for Snapshot query on MOR table, we do need the merging of base file and log files. For Snapshot query on COW table, only base file is needed. I think that is your intention of changes here.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #4556: [HUDI-3191][Stacked on 4716] Removing duplicating file-listing process w/in Hive's MOR `FileInputFormat`s
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #4556:
URL: https://github.com/apache/hudi/pull/4556#issuecomment-1027166525
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "d87786af43a7aeba7549cc3cfcbd97fc312bee0e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5074",
"triggerID" : "d87786af43a7aeba7549cc3cfcbd97fc312bee0e",
"triggerType" : "PUSH"
}, {
"hash" : "4b87ba1474be575ec27109ccbe626e4c2fc9c224",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5077",
"triggerID" : "4b87ba1474be575ec27109ccbe626e4c2fc9c224",
"triggerType" : "PUSH"
}, {
"hash" : "77d11131baabd1c4e3cc2050337daca4df5f6427",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "77d11131baabd1c4e3cc2050337daca4df5f6427",
"triggerType" : "PUSH"
}, {
"hash" : "3d9c2ae28da858d1e8476052c99391015effb7db",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "3d9c2ae28da858d1e8476052c99391015effb7db",
"triggerType" : "PUSH"
}, {
"hash" : "79ac9affcb7f81497e0df755c8200638d35b02b7",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5081",
"triggerID" : "79ac9affcb7f81497e0df755c8200638d35b02b7",
"triggerType" : "PUSH"
}, {
"hash" : "3c14bbe6c6bcf49c4164c45e82f77b473f4de396",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5113",
"triggerID" : "3c14bbe6c6bcf49c4164c45e82f77b473f4de396",
"triggerType" : "PUSH"
}, {
"hash" : "276f13d6efd00b301b232b286d585729c9d1d26e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5116",
"triggerID" : "276f13d6efd00b301b232b286d585729c9d1d26e",
"triggerType" : "PUSH"
}, {
"hash" : "31b0669d7b638bd65a17b22a2ceb772f2627512c",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "31b0669d7b638bd65a17b22a2ceb772f2627512c",
"triggerType" : "PUSH"
}, {
"hash" : "096e26af39a477ffccbee0edd764493e12e15e71",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5124",
"triggerID" : "096e26af39a477ffccbee0edd764493e12e15e71",
"triggerType" : "PUSH"
}, {
"hash" : "97dd5ec7c9246f6d9f467b9076b790dd6017c5b4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5213",
"triggerID" : "97dd5ec7c9246f6d9f467b9076b790dd6017c5b4",
"triggerType" : "PUSH"
}, {
"hash" : "0538475fe488089c4cb3bc0afb63c2f518329969",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5257",
"triggerID" : "0538475fe488089c4cb3bc0afb63c2f518329969",
"triggerType" : "PUSH"
}, {
"hash" : "9f4b334e340fb26004e1b07fc8fbaaa047c76775",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5261",
"triggerID" : "9f4b334e340fb26004e1b07fc8fbaaa047c76775",
"triggerType" : "PUSH"
}, {
"hash" : "368c099820c3cbf57496d0e46d1858aa8eb153ee",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5330",
"triggerID" : "368c099820c3cbf57496d0e46d1858aa8eb153ee",
"triggerType" : "PUSH"
}, {
"hash" : "28a5a4f537544d35dfcd8700a7b97fb7216682ce",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "28a5a4f537544d35dfcd8700a7b97fb7216682ce",
"triggerType" : "PUSH"
}, {
"hash" : "08ffdd8b47d147c9b5c889a5f56e39b9b140612d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5351",
"triggerID" : "08ffdd8b47d147c9b5c889a5f56e39b9b140612d",
"triggerType" : "PUSH"
}, {
"hash" : "c09e228f7cce78a7dbbc394e93b3cf8c6c3d4d5f",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "c09e228f7cce78a7dbbc394e93b3cf8c6c3d4d5f",
"triggerType" : "PUSH"
}, {
"hash" : "8dadbf672d4d27505592f18bc89422fd7c013669",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5398",
"triggerID" : "8dadbf672d4d27505592f18bc89422fd7c013669",
"triggerType" : "PUSH"
}, {
"hash" : "906607be5bd62ee1cbbda34acb6a89916c1f7aee",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5424",
"triggerID" : "906607be5bd62ee1cbbda34acb6a89916c1f7aee",
"triggerType" : "PUSH"
}, {
"hash" : "dc1b033f40cea9642f71b8fcff74aa82106726b6",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5484",
"triggerID" : "dc1b033f40cea9642f71b8fcff74aa82106726b6",
"triggerType" : "PUSH"
}, {
"hash" : "5b8f5819fff8fec34864eb409fd429b95be17b9b",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "5b8f5819fff8fec34864eb409fd429b95be17b9b",
"triggerType" : "PUSH"
}, {
"hash" : "13702fc2232ebd9300966b0a917a3358d8d0f18c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5590",
"triggerID" : "13702fc2232ebd9300966b0a917a3358d8d0f18c",
"triggerType" : "PUSH"
}, {
"hash" : "13702fc2232ebd9300966b0a917a3358d8d0f18c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5600",
"triggerID" : "1024845655",
"triggerType" : "MANUAL"
}, {
"hash" : "9bdd8a60f95123f82a5f30f5e68929f5b7e1f8da",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5603",
"triggerID" : "9bdd8a60f95123f82a5f30f5e68929f5b7e1f8da",
"triggerType" : "PUSH"
}, {
"hash" : "aebb9df557c4afe3ca88f6b8b28ba2fbfdcbd597",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5631",
"triggerID" : "aebb9df557c4afe3ca88f6b8b28ba2fbfdcbd597",
"triggerType" : "PUSH"
}, {
"hash" : "5d37935bc8bb33260735d782ca560fd59e02f321",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "5d37935bc8bb33260735d782ca560fd59e02f321",
"triggerType" : "PUSH"
}, {
"hash" : "f911d869f50009e5cd9f3fd341c83c732d7531ba",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5634",
"triggerID" : "f911d869f50009e5cd9f3fd341c83c732d7531ba",
"triggerType" : "PUSH"
}, {
"hash" : "f911d869f50009e5cd9f3fd341c83c732d7531ba",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5657",
"triggerID" : "1027051107",
"triggerType" : "MANUAL"
}, {
"hash" : "f911d869f50009e5cd9f3fd341c83c732d7531ba",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5659",
"triggerID" : "1027166086",
"triggerType" : "MANUAL"
} ]
}-->
## CI report:
* 77d11131baabd1c4e3cc2050337daca4df5f6427 UNKNOWN
* 3d9c2ae28da858d1e8476052c99391015effb7db UNKNOWN
* 31b0669d7b638bd65a17b22a2ceb772f2627512c UNKNOWN
* 28a5a4f537544d35dfcd8700a7b97fb7216682ce UNKNOWN
* c09e228f7cce78a7dbbc394e93b3cf8c6c3d4d5f UNKNOWN
* 5b8f5819fff8fec34864eb409fd429b95be17b9b UNKNOWN
* 5d37935bc8bb33260735d782ca560fd59e02f321 UNKNOWN
* f911d869f50009e5cd9f3fd341c83c732d7531ba Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5634) Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5657) Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5659)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #4556: [HUDI-3191][Stacked on 4716] Removing duplicating file-listing process w/in Hive's MOR `FileInputFormat`s
Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #4556:
URL: https://github.com/apache/hudi/pull/4556#issuecomment-1027166525
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "d87786af43a7aeba7549cc3cfcbd97fc312bee0e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5074",
"triggerID" : "d87786af43a7aeba7549cc3cfcbd97fc312bee0e",
"triggerType" : "PUSH"
}, {
"hash" : "4b87ba1474be575ec27109ccbe626e4c2fc9c224",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5077",
"triggerID" : "4b87ba1474be575ec27109ccbe626e4c2fc9c224",
"triggerType" : "PUSH"
}, {
"hash" : "77d11131baabd1c4e3cc2050337daca4df5f6427",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "77d11131baabd1c4e3cc2050337daca4df5f6427",
"triggerType" : "PUSH"
}, {
"hash" : "3d9c2ae28da858d1e8476052c99391015effb7db",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "3d9c2ae28da858d1e8476052c99391015effb7db",
"triggerType" : "PUSH"
}, {
"hash" : "79ac9affcb7f81497e0df755c8200638d35b02b7",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5081",
"triggerID" : "79ac9affcb7f81497e0df755c8200638d35b02b7",
"triggerType" : "PUSH"
}, {
"hash" : "3c14bbe6c6bcf49c4164c45e82f77b473f4de396",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5113",
"triggerID" : "3c14bbe6c6bcf49c4164c45e82f77b473f4de396",
"triggerType" : "PUSH"
}, {
"hash" : "276f13d6efd00b301b232b286d585729c9d1d26e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5116",
"triggerID" : "276f13d6efd00b301b232b286d585729c9d1d26e",
"triggerType" : "PUSH"
}, {
"hash" : "31b0669d7b638bd65a17b22a2ceb772f2627512c",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "31b0669d7b638bd65a17b22a2ceb772f2627512c",
"triggerType" : "PUSH"
}, {
"hash" : "096e26af39a477ffccbee0edd764493e12e15e71",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5124",
"triggerID" : "096e26af39a477ffccbee0edd764493e12e15e71",
"triggerType" : "PUSH"
}, {
"hash" : "97dd5ec7c9246f6d9f467b9076b790dd6017c5b4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5213",
"triggerID" : "97dd5ec7c9246f6d9f467b9076b790dd6017c5b4",
"triggerType" : "PUSH"
}, {
"hash" : "0538475fe488089c4cb3bc0afb63c2f518329969",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5257",
"triggerID" : "0538475fe488089c4cb3bc0afb63c2f518329969",
"triggerType" : "PUSH"
}, {
"hash" : "9f4b334e340fb26004e1b07fc8fbaaa047c76775",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5261",
"triggerID" : "9f4b334e340fb26004e1b07fc8fbaaa047c76775",
"triggerType" : "PUSH"
}, {
"hash" : "368c099820c3cbf57496d0e46d1858aa8eb153ee",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5330",
"triggerID" : "368c099820c3cbf57496d0e46d1858aa8eb153ee",
"triggerType" : "PUSH"
}, {
"hash" : "28a5a4f537544d35dfcd8700a7b97fb7216682ce",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "28a5a4f537544d35dfcd8700a7b97fb7216682ce",
"triggerType" : "PUSH"
}, {
"hash" : "08ffdd8b47d147c9b5c889a5f56e39b9b140612d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5351",
"triggerID" : "08ffdd8b47d147c9b5c889a5f56e39b9b140612d",
"triggerType" : "PUSH"
}, {
"hash" : "c09e228f7cce78a7dbbc394e93b3cf8c6c3d4d5f",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "c09e228f7cce78a7dbbc394e93b3cf8c6c3d4d5f",
"triggerType" : "PUSH"
}, {
"hash" : "8dadbf672d4d27505592f18bc89422fd7c013669",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5398",
"triggerID" : "8dadbf672d4d27505592f18bc89422fd7c013669",
"triggerType" : "PUSH"
}, {
"hash" : "906607be5bd62ee1cbbda34acb6a89916c1f7aee",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5424",
"triggerID" : "906607be5bd62ee1cbbda34acb6a89916c1f7aee",
"triggerType" : "PUSH"
}, {
"hash" : "dc1b033f40cea9642f71b8fcff74aa82106726b6",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5484",
"triggerID" : "dc1b033f40cea9642f71b8fcff74aa82106726b6",
"triggerType" : "PUSH"
}, {
"hash" : "5b8f5819fff8fec34864eb409fd429b95be17b9b",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "5b8f5819fff8fec34864eb409fd429b95be17b9b",
"triggerType" : "PUSH"
}, {
"hash" : "13702fc2232ebd9300966b0a917a3358d8d0f18c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5590",
"triggerID" : "13702fc2232ebd9300966b0a917a3358d8d0f18c",
"triggerType" : "PUSH"
}, {
"hash" : "13702fc2232ebd9300966b0a917a3358d8d0f18c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5600",
"triggerID" : "1024845655",
"triggerType" : "MANUAL"
}, {
"hash" : "9bdd8a60f95123f82a5f30f5e68929f5b7e1f8da",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5603",
"triggerID" : "9bdd8a60f95123f82a5f30f5e68929f5b7e1f8da",
"triggerType" : "PUSH"
}, {
"hash" : "aebb9df557c4afe3ca88f6b8b28ba2fbfdcbd597",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5631",
"triggerID" : "aebb9df557c4afe3ca88f6b8b28ba2fbfdcbd597",
"triggerType" : "PUSH"
}, {
"hash" : "5d37935bc8bb33260735d782ca560fd59e02f321",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "5d37935bc8bb33260735d782ca560fd59e02f321",
"triggerType" : "PUSH"
}, {
"hash" : "f911d869f50009e5cd9f3fd341c83c732d7531ba",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5634",
"triggerID" : "f911d869f50009e5cd9f3fd341c83c732d7531ba",
"triggerType" : "PUSH"
}, {
"hash" : "f911d869f50009e5cd9f3fd341c83c732d7531ba",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5657",
"triggerID" : "1027051107",
"triggerType" : "MANUAL"
}, {
"hash" : "f911d869f50009e5cd9f3fd341c83c732d7531ba",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5659",
"triggerID" : "1027166086",
"triggerType" : "MANUAL"
} ]
}-->
## CI report:
* 77d11131baabd1c4e3cc2050337daca4df5f6427 UNKNOWN
* 3d9c2ae28da858d1e8476052c99391015effb7db UNKNOWN
* 31b0669d7b638bd65a17b22a2ceb772f2627512c UNKNOWN
* 28a5a4f537544d35dfcd8700a7b97fb7216682ce UNKNOWN
* c09e228f7cce78a7dbbc394e93b3cf8c6c3d4d5f UNKNOWN
* 5b8f5819fff8fec34864eb409fd429b95be17b9b UNKNOWN
* 5d37935bc8bb33260735d782ca560fd59e02f321 UNKNOWN
* f911d869f50009e5cd9f3fd341c83c732d7531ba Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5634) Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5657) Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5659)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] nsivabalan commented on a change in pull request #4556: [HUDI-3191][Stacked on 4716] Removing duplicating file-listing process w/in Hive's MOR `FileInputFormat`s
Posted by GitBox <gi...@apache.org>.
nsivabalan commented on a change in pull request #4556:
URL: https://github.com/apache/hudi/pull/4556#discussion_r797255058
##########
File path: hudi-client/hudi-spark-client/src/test/java/org/apache/hudi/table/TestHoodieMergeOnReadTable.java
##########
@@ -189,8 +190,10 @@ public void testUpsertPartitioner(boolean populateMetaFields) throws Exception {
assertTrue(fileIdToNewSize.entrySet().stream().anyMatch(entry -> fileIdToSize.get(entry.getKey()) < entry.getValue()));
- List<String> dataFiles = roView.getLatestBaseFiles().map(HoodieBaseFile::getPath).collect(Collectors.toList());
- List<GenericRecord> recordsRead = HoodieMergeOnReadTestUtils.getRecordsUsingInputFormat(hadoopConf(), dataFiles,
+ List<String> inputPaths = roView.getLatestBaseFiles()
+ .map(baseFile -> new Path(baseFile.getPath()).getParent().toString())
+ .collect(Collectors.toList());
Review comment:
+1
##########
File path: hudi-hadoop-mr/src/main/java/org/apache/hudi/hadoop/HoodieFileInputFormatBase.java
##########
@@ -187,13 +285,28 @@ private static FileStatus getFileStatusUnchecked(Option<HoodieBaseFile> baseFile
.map(fileSlice -> {
Option<HoodieBaseFile> baseFileOpt = fileSlice.getBaseFile();
Option<HoodieLogFile> latestLogFileOpt = fileSlice.getLatestLogFile();
- if (baseFileOpt.isPresent()) {
- return getFileStatusUnchecked(baseFileOpt);
- } else if (includeLogFilesForSnapShotView() && latestLogFileOpt.isPresent()) {
- return createRealtimeFileStatusUnchecked(latestLogFileOpt.get(), fileSlice.getLogFiles());
+ Stream<HoodieLogFile> logFiles = fileSlice.getLogFiles();
+
+ Option<HoodieInstant> latestCompletedInstantOpt =
+ fromScala(fileIndex.latestCompletedInstant());
+
+ // Check if we're reading a MOR table
+ if (includeLogFilesForSnapshotView()) {
+ if (baseFileOpt.isPresent()) {
+ return createRealtimeFileStatusUnchecked(baseFileOpt.get(), logFiles, latestCompletedInstantOpt, tableMetaClient);
Review comment:
can you help me understand, what does a List<Path> snapshotPaths can refer to. can it represent both a base file and a log file, or only either of them ?
##########
File path: hudi-hadoop-mr/src/main/java/org/apache/hudi/hadoop/HoodieFileInputFormatBase.java
##########
@@ -143,6 +121,126 @@ private static FileStatus getFileStatusUnchecked(Option<HoodieBaseFile> baseFile
return returns.toArray(new FileStatus[0]);
}
+ private void validate(List<FileStatus> targetFiles, List<FileStatus> legacyFileStatuses) {
+ List<FileStatus> diff = CollectionUtils.diff(targetFiles, legacyFileStatuses);
+ checkState(diff.isEmpty(), "Should be empty");
+ }
+
+ @Nonnull
+ private static FileStatus getFileStatusUnchecked(HoodieBaseFile baseFile) {
+ try {
+ return HoodieInputFormatUtils.getFileStatus(baseFile);
+ } catch (IOException ioe) {
+ throw new HoodieIOException("Failed to get file-status", ioe);
+ }
+ }
+
+ /**
+ * Abstracts and exposes {@link FileInputFormat#listStatus(JobConf)} operation to subclasses that
+ * lists files (returning an array of {@link FileStatus}) corresponding to the input paths specified
+ * as part of provided {@link JobConf}
+ */
+ protected final FileStatus[] doListStatus(JobConf job) throws IOException {
+ return super.listStatus(job);
+ }
+
+ /**
+ * Achieves listStatus functionality for an incrementally queried table. Instead of listing all
+ * partitions and then filtering based on the commits of interest, this logic first extracts the
+ * partitions touched by the desired commits and then lists only those partitions.
+ */
+ protected List<FileStatus> listStatusForIncrementalMode(JobConf job,
+ HoodieTableMetaClient tableMetaClient,
+ List<Path> inputPaths,
+ String incrementalTable) throws IOException {
+ Job jobContext = Job.getInstance(job);
+ Option<HoodieTimeline> timeline = HoodieInputFormatUtils.getFilteredCommitsTimeline(jobContext, tableMetaClient);
+ if (!timeline.isPresent()) {
+ return null;
+ }
+ Option<List<HoodieInstant>> commitsToCheck = HoodieInputFormatUtils.getCommitsForIncrementalQuery(jobContext, incrementalTable, timeline.get());
+ if (!commitsToCheck.isPresent()) {
+ return null;
+ }
+ Option<String> incrementalInputPaths = HoodieInputFormatUtils.getAffectedPartitions(commitsToCheck.get(), tableMetaClient, timeline.get(), inputPaths);
+ // Mutate the JobConf to set the input paths to only partitions touched by incremental pull.
+ if (!incrementalInputPaths.isPresent()) {
+ return null;
+ }
+ setInputPaths(job, incrementalInputPaths.get());
+ FileStatus[] fileStatuses = doListStatus(job);
+ return HoodieInputFormatUtils.filterIncrementalFileStatus(jobContext, tableMetaClient, timeline.get(), fileStatuses, commitsToCheck.get());
+ }
+
+ protected abstract boolean includeLogFilesForSnapshotView();
+
+ @Nonnull
+ private static RealtimeFileStatus createRealtimeFileStatusUnchecked(HoodieBaseFile baseFile,
+ Stream<HoodieLogFile> logFiles,
+ Option<HoodieInstant> latestCompletedInstantOpt,
+ HoodieTableMetaClient tableMetaClient) {
+ List<HoodieLogFile> sortedLogFiles = logFiles.sorted(HoodieLogFile.getLogFileComparator()).collect(Collectors.toList());
Review comment:
did we move this method from elsewhere or did you add it as part of this patch ?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #4556: [HUDI-3191][Stacked on 4716] Removing duplicating file-listing process w/in Hive's MOR `FileInputFormat`s
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #4556:
URL: https://github.com/apache/hudi/pull/4556#issuecomment-1026437170
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "d87786af43a7aeba7549cc3cfcbd97fc312bee0e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5074",
"triggerID" : "d87786af43a7aeba7549cc3cfcbd97fc312bee0e",
"triggerType" : "PUSH"
}, {
"hash" : "4b87ba1474be575ec27109ccbe626e4c2fc9c224",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5077",
"triggerID" : "4b87ba1474be575ec27109ccbe626e4c2fc9c224",
"triggerType" : "PUSH"
}, {
"hash" : "77d11131baabd1c4e3cc2050337daca4df5f6427",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "77d11131baabd1c4e3cc2050337daca4df5f6427",
"triggerType" : "PUSH"
}, {
"hash" : "3d9c2ae28da858d1e8476052c99391015effb7db",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "3d9c2ae28da858d1e8476052c99391015effb7db",
"triggerType" : "PUSH"
}, {
"hash" : "79ac9affcb7f81497e0df755c8200638d35b02b7",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5081",
"triggerID" : "79ac9affcb7f81497e0df755c8200638d35b02b7",
"triggerType" : "PUSH"
}, {
"hash" : "3c14bbe6c6bcf49c4164c45e82f77b473f4de396",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5113",
"triggerID" : "3c14bbe6c6bcf49c4164c45e82f77b473f4de396",
"triggerType" : "PUSH"
}, {
"hash" : "276f13d6efd00b301b232b286d585729c9d1d26e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5116",
"triggerID" : "276f13d6efd00b301b232b286d585729c9d1d26e",
"triggerType" : "PUSH"
}, {
"hash" : "31b0669d7b638bd65a17b22a2ceb772f2627512c",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "31b0669d7b638bd65a17b22a2ceb772f2627512c",
"triggerType" : "PUSH"
}, {
"hash" : "096e26af39a477ffccbee0edd764493e12e15e71",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5124",
"triggerID" : "096e26af39a477ffccbee0edd764493e12e15e71",
"triggerType" : "PUSH"
}, {
"hash" : "97dd5ec7c9246f6d9f467b9076b790dd6017c5b4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5213",
"triggerID" : "97dd5ec7c9246f6d9f467b9076b790dd6017c5b4",
"triggerType" : "PUSH"
}, {
"hash" : "0538475fe488089c4cb3bc0afb63c2f518329969",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5257",
"triggerID" : "0538475fe488089c4cb3bc0afb63c2f518329969",
"triggerType" : "PUSH"
}, {
"hash" : "9f4b334e340fb26004e1b07fc8fbaaa047c76775",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5261",
"triggerID" : "9f4b334e340fb26004e1b07fc8fbaaa047c76775",
"triggerType" : "PUSH"
}, {
"hash" : "368c099820c3cbf57496d0e46d1858aa8eb153ee",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5330",
"triggerID" : "368c099820c3cbf57496d0e46d1858aa8eb153ee",
"triggerType" : "PUSH"
}, {
"hash" : "28a5a4f537544d35dfcd8700a7b97fb7216682ce",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "28a5a4f537544d35dfcd8700a7b97fb7216682ce",
"triggerType" : "PUSH"
}, {
"hash" : "08ffdd8b47d147c9b5c889a5f56e39b9b140612d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5351",
"triggerID" : "08ffdd8b47d147c9b5c889a5f56e39b9b140612d",
"triggerType" : "PUSH"
}, {
"hash" : "c09e228f7cce78a7dbbc394e93b3cf8c6c3d4d5f",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "c09e228f7cce78a7dbbc394e93b3cf8c6c3d4d5f",
"triggerType" : "PUSH"
}, {
"hash" : "8dadbf672d4d27505592f18bc89422fd7c013669",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5398",
"triggerID" : "8dadbf672d4d27505592f18bc89422fd7c013669",
"triggerType" : "PUSH"
}, {
"hash" : "906607be5bd62ee1cbbda34acb6a89916c1f7aee",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5424",
"triggerID" : "906607be5bd62ee1cbbda34acb6a89916c1f7aee",
"triggerType" : "PUSH"
}, {
"hash" : "dc1b033f40cea9642f71b8fcff74aa82106726b6",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5484",
"triggerID" : "dc1b033f40cea9642f71b8fcff74aa82106726b6",
"triggerType" : "PUSH"
}, {
"hash" : "5b8f5819fff8fec34864eb409fd429b95be17b9b",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "5b8f5819fff8fec34864eb409fd429b95be17b9b",
"triggerType" : "PUSH"
}, {
"hash" : "13702fc2232ebd9300966b0a917a3358d8d0f18c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5590",
"triggerID" : "13702fc2232ebd9300966b0a917a3358d8d0f18c",
"triggerType" : "PUSH"
}, {
"hash" : "13702fc2232ebd9300966b0a917a3358d8d0f18c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5600",
"triggerID" : "1024845655",
"triggerType" : "MANUAL"
}, {
"hash" : "9bdd8a60f95123f82a5f30f5e68929f5b7e1f8da",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5603",
"triggerID" : "9bdd8a60f95123f82a5f30f5e68929f5b7e1f8da",
"triggerType" : "PUSH"
}, {
"hash" : "aebb9df557c4afe3ca88f6b8b28ba2fbfdcbd597",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5631",
"triggerID" : "aebb9df557c4afe3ca88f6b8b28ba2fbfdcbd597",
"triggerType" : "PUSH"
}, {
"hash" : "5d37935bc8bb33260735d782ca560fd59e02f321",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "5d37935bc8bb33260735d782ca560fd59e02f321",
"triggerType" : "PUSH"
}, {
"hash" : "f911d869f50009e5cd9f3fd341c83c732d7531ba",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5634",
"triggerID" : "f911d869f50009e5cd9f3fd341c83c732d7531ba",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 77d11131baabd1c4e3cc2050337daca4df5f6427 UNKNOWN
* 3d9c2ae28da858d1e8476052c99391015effb7db UNKNOWN
* 31b0669d7b638bd65a17b22a2ceb772f2627512c UNKNOWN
* 28a5a4f537544d35dfcd8700a7b97fb7216682ce UNKNOWN
* c09e228f7cce78a7dbbc394e93b3cf8c6c3d4d5f UNKNOWN
* 5b8f5819fff8fec34864eb409fd429b95be17b9b UNKNOWN
* 5d37935bc8bb33260735d782ca560fd59e02f321 UNKNOWN
* f911d869f50009e5cd9f3fd341c83c732d7531ba Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5634)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] alexeykudinkin commented on pull request #4556: [HUDI-3191][Stacked on 4716] Removing duplicating file-listing process w/in Hive's MOR `FileInputFormat`s
Posted by GitBox <gi...@apache.org>.
alexeykudinkin commented on pull request #4556:
URL: https://github.com/apache/hudi/pull/4556#issuecomment-1027051107
@hudi-bot run azure
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #4556: [HUDI-3191][Stacked on 4716] Removing duplicating file-listing process w/in Hive's MOR `FileInputFormat`s
Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #4556:
URL: https://github.com/apache/hudi/pull/4556#issuecomment-1027389109
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "d87786af43a7aeba7549cc3cfcbd97fc312bee0e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5074",
"triggerID" : "d87786af43a7aeba7549cc3cfcbd97fc312bee0e",
"triggerType" : "PUSH"
}, {
"hash" : "4b87ba1474be575ec27109ccbe626e4c2fc9c224",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5077",
"triggerID" : "4b87ba1474be575ec27109ccbe626e4c2fc9c224",
"triggerType" : "PUSH"
}, {
"hash" : "77d11131baabd1c4e3cc2050337daca4df5f6427",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "77d11131baabd1c4e3cc2050337daca4df5f6427",
"triggerType" : "PUSH"
}, {
"hash" : "3d9c2ae28da858d1e8476052c99391015effb7db",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "3d9c2ae28da858d1e8476052c99391015effb7db",
"triggerType" : "PUSH"
}, {
"hash" : "79ac9affcb7f81497e0df755c8200638d35b02b7",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5081",
"triggerID" : "79ac9affcb7f81497e0df755c8200638d35b02b7",
"triggerType" : "PUSH"
}, {
"hash" : "3c14bbe6c6bcf49c4164c45e82f77b473f4de396",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5113",
"triggerID" : "3c14bbe6c6bcf49c4164c45e82f77b473f4de396",
"triggerType" : "PUSH"
}, {
"hash" : "276f13d6efd00b301b232b286d585729c9d1d26e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5116",
"triggerID" : "276f13d6efd00b301b232b286d585729c9d1d26e",
"triggerType" : "PUSH"
}, {
"hash" : "31b0669d7b638bd65a17b22a2ceb772f2627512c",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "31b0669d7b638bd65a17b22a2ceb772f2627512c",
"triggerType" : "PUSH"
}, {
"hash" : "096e26af39a477ffccbee0edd764493e12e15e71",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5124",
"triggerID" : "096e26af39a477ffccbee0edd764493e12e15e71",
"triggerType" : "PUSH"
}, {
"hash" : "97dd5ec7c9246f6d9f467b9076b790dd6017c5b4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5213",
"triggerID" : "97dd5ec7c9246f6d9f467b9076b790dd6017c5b4",
"triggerType" : "PUSH"
}, {
"hash" : "0538475fe488089c4cb3bc0afb63c2f518329969",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5257",
"triggerID" : "0538475fe488089c4cb3bc0afb63c2f518329969",
"triggerType" : "PUSH"
}, {
"hash" : "9f4b334e340fb26004e1b07fc8fbaaa047c76775",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5261",
"triggerID" : "9f4b334e340fb26004e1b07fc8fbaaa047c76775",
"triggerType" : "PUSH"
}, {
"hash" : "368c099820c3cbf57496d0e46d1858aa8eb153ee",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5330",
"triggerID" : "368c099820c3cbf57496d0e46d1858aa8eb153ee",
"triggerType" : "PUSH"
}, {
"hash" : "28a5a4f537544d35dfcd8700a7b97fb7216682ce",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "28a5a4f537544d35dfcd8700a7b97fb7216682ce",
"triggerType" : "PUSH"
}, {
"hash" : "08ffdd8b47d147c9b5c889a5f56e39b9b140612d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5351",
"triggerID" : "08ffdd8b47d147c9b5c889a5f56e39b9b140612d",
"triggerType" : "PUSH"
}, {
"hash" : "c09e228f7cce78a7dbbc394e93b3cf8c6c3d4d5f",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "c09e228f7cce78a7dbbc394e93b3cf8c6c3d4d5f",
"triggerType" : "PUSH"
}, {
"hash" : "8dadbf672d4d27505592f18bc89422fd7c013669",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5398",
"triggerID" : "8dadbf672d4d27505592f18bc89422fd7c013669",
"triggerType" : "PUSH"
}, {
"hash" : "906607be5bd62ee1cbbda34acb6a89916c1f7aee",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5424",
"triggerID" : "906607be5bd62ee1cbbda34acb6a89916c1f7aee",
"triggerType" : "PUSH"
}, {
"hash" : "dc1b033f40cea9642f71b8fcff74aa82106726b6",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5484",
"triggerID" : "dc1b033f40cea9642f71b8fcff74aa82106726b6",
"triggerType" : "PUSH"
}, {
"hash" : "5b8f5819fff8fec34864eb409fd429b95be17b9b",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "5b8f5819fff8fec34864eb409fd429b95be17b9b",
"triggerType" : "PUSH"
}, {
"hash" : "13702fc2232ebd9300966b0a917a3358d8d0f18c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5590",
"triggerID" : "13702fc2232ebd9300966b0a917a3358d8d0f18c",
"triggerType" : "PUSH"
}, {
"hash" : "13702fc2232ebd9300966b0a917a3358d8d0f18c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5600",
"triggerID" : "1024845655",
"triggerType" : "MANUAL"
}, {
"hash" : "9bdd8a60f95123f82a5f30f5e68929f5b7e1f8da",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5603",
"triggerID" : "9bdd8a60f95123f82a5f30f5e68929f5b7e1f8da",
"triggerType" : "PUSH"
}, {
"hash" : "aebb9df557c4afe3ca88f6b8b28ba2fbfdcbd597",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5631",
"triggerID" : "aebb9df557c4afe3ca88f6b8b28ba2fbfdcbd597",
"triggerType" : "PUSH"
}, {
"hash" : "5d37935bc8bb33260735d782ca560fd59e02f321",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "5d37935bc8bb33260735d782ca560fd59e02f321",
"triggerType" : "PUSH"
}, {
"hash" : "f911d869f50009e5cd9f3fd341c83c732d7531ba",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5634",
"triggerID" : "f911d869f50009e5cd9f3fd341c83c732d7531ba",
"triggerType" : "PUSH"
}, {
"hash" : "f911d869f50009e5cd9f3fd341c83c732d7531ba",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5657",
"triggerID" : "1027051107",
"triggerType" : "MANUAL"
}, {
"hash" : "f911d869f50009e5cd9f3fd341c83c732d7531ba",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5659",
"triggerID" : "1027166086",
"triggerType" : "MANUAL"
}, {
"hash" : "f911d869f50009e5cd9f3fd341c83c732d7531ba",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5665",
"triggerID" : "1027387044",
"triggerType" : "MANUAL"
} ]
}-->
## CI report:
* 77d11131baabd1c4e3cc2050337daca4df5f6427 UNKNOWN
* 3d9c2ae28da858d1e8476052c99391015effb7db UNKNOWN
* 31b0669d7b638bd65a17b22a2ceb772f2627512c UNKNOWN
* 28a5a4f537544d35dfcd8700a7b97fb7216682ce UNKNOWN
* c09e228f7cce78a7dbbc394e93b3cf8c6c3d4d5f UNKNOWN
* 5b8f5819fff8fec34864eb409fd429b95be17b9b UNKNOWN
* 5d37935bc8bb33260735d782ca560fd59e02f321 UNKNOWN
* f911d869f50009e5cd9f3fd341c83c732d7531ba Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5634) Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5657) Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5659) Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5665)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] alexeykudinkin commented on a change in pull request #4556: [HUDI-3191] Removing duplicating file-listing process w/in Hive's MOR `FileInputFormat`s
Posted by GitBox <gi...@apache.org>.
alexeykudinkin commented on a change in pull request #4556:
URL: https://github.com/apache/hudi/pull/4556#discussion_r798092122
##########
File path: hudi-hadoop-mr/src/main/java/org/apache/hudi/hadoop/realtime/HoodieRealtimeFileSplit.java
##########
@@ -44,9 +44,7 @@
private Option<HoodieVirtualKeyInfo> hoodieVirtualKeyInfo = Option.empty();
- public HoodieRealtimeFileSplit() {
- super();
Review comment:
We don't need to remove it, but there's also no point in keeping it
##########
File path: hudi-hadoop-mr/src/main/java/org/apache/hudi/hadoop/utils/HoodieRealtimeInputFormatUtils.java
##########
@@ -144,28 +204,32 @@
return rtSplits.toArray(new InputSplit[0]);
}
+ /**
+ * @deprecated will be replaced w/ {@link #getRealtimeSplits(Configuration, List)}
+ */
// get IncrementalRealtimeSplits
- public static InputSplit[] getIncrementalRealtimeSplits(Configuration conf, Stream<FileSplit> fileSplits) throws IOException {
+ public static InputSplit[] getIncrementalRealtimeSplits(Configuration conf, List<FileSplit> fileSplits) throws IOException {
+ checkState(fileSplits.stream().allMatch(HoodieRealtimeInputFormatUtils::doesBelongToIncrementalQuery),
+ "All splits have to belong to incremental query");
+
List<InputSplit> rtSplits = new ArrayList<>();
- List<FileSplit> fileSplitList = fileSplits.collect(Collectors.toList());
- Set<Path> partitionSet = fileSplitList.stream().map(f -> f.getPath().getParent()).collect(Collectors.toSet());
+ Set<Path> partitionSet = fileSplits.stream().map(f -> f.getPath().getParent()).collect(Collectors.toSet());
Map<Path, HoodieTableMetaClient> partitionsToMetaClient = getTableMetaClientByPartitionPath(conf, partitionSet);
// Pre process tableConfig from first partition to fetch virtual key info
Option<HoodieVirtualKeyInfo> hoodieVirtualKeyInfo = Option.empty();
if (partitionSet.size() > 0) {
hoodieVirtualKeyInfo = getHoodieVirtualKeyInfo(partitionsToMetaClient.get(partitionSet.iterator().next()));
}
Option<HoodieVirtualKeyInfo> finalHoodieVirtualKeyInfo = hoodieVirtualKeyInfo;
- fileSplitList.stream().forEach(s -> {
+ fileSplits.stream().forEach(s -> {
// deal with incremental query.
try {
if (s instanceof BaseFileWithLogsSplit) {
- BaseFileWithLogsSplit bs = (BaseFileWithLogsSplit)s;
- if (bs.getBelongToIncrementalSplit()) {
- rtSplits.add(new HoodieRealtimeFileSplit(bs, bs.getBasePath(), bs.getDeltaLogFiles(), bs.getMaxCommitTime(), finalHoodieVirtualKeyInfo));
- }
+ BaseFileWithLogsSplit bs = unsafeCast(s);
+ rtSplits.add(new HoodieRealtimeFileSplit(bs, bs.getBasePath(), bs.getDeltaLogFiles(), bs.getMaxCommitTime(), finalHoodieVirtualKeyInfo));
} else if (s instanceof RealtimeBootstrapBaseFileSplit) {
- rtSplits.add(s);
+ RealtimeBootstrapBaseFileSplit bs = unsafeCast(s);
Review comment:
I see now. Makes sense
##########
File path: hudi-common/src/main/scala/org/apache/hudi/HoodieTableFileIndexBase.scala
##########
@@ -87,6 +89,12 @@ abstract class HoodieTableFileIndexBase(engineContext: HoodieEngineContext,
refresh0()
+ /**
+ * Returns latest completed instant as seen by this instance of the file-index
+ */
+ def latestCompletedInstant(): Option[HoodieInstant] =
Review comment:
It's def closer to former
##########
File path: hudi-hadoop-mr/src/main/java/org/apache/hudi/hadoop/utils/HoodieRealtimeInputFormatUtils.java
##########
@@ -65,11 +65,71 @@
import java.util.stream.Collectors;
import java.util.stream.Stream;
+import static org.apache.hudi.TypeUtils.unsafeCast;
+import static org.apache.hudi.common.util.ValidationUtils.checkState;
+
public class HoodieRealtimeInputFormatUtils extends HoodieInputFormatUtils {
private static final Logger LOG = LogManager.getLogger(HoodieRealtimeInputFormatUtils.class);
- public static InputSplit[] getRealtimeSplits(Configuration conf, Stream<FileSplit> fileSplits) {
+ public static InputSplit[] getRealtimeSplits(Configuration conf, List<FileSplit> fileSplits) throws IOException {
+ if (fileSplits.isEmpty()) {
+ return new InputSplit[0];
+ }
+
+ FileSplit fileSplit = fileSplits.get(0);
+
+ // Pre-process table-config to fetch virtual key info
+ Path partitionPath = fileSplit.getPath().getParent();
+ HoodieTableMetaClient metaClient = getTableMetaClientForBasePathUnchecked(conf, partitionPath);
+
+ Option<HoodieVirtualKeyInfo> hoodieVirtualKeyInfoOpt = getHoodieVirtualKeyInfo(metaClient);
+
+ // NOTE: This timeline is kept in sync w/ {@code HoodieTableFileIndexBase}
+ HoodieInstant latestCommitInstant =
+ metaClient.getActiveTimeline().getCommitsTimeline().filterCompletedInstants().lastInstant().get();
+
+ InputSplit[] finalSplits = fileSplits.stream()
+ .map(split -> {
+ // There are 4 types of splits could we have to handle here
+ // - {@code BootstrapBaseFileSplit}: in case base file does have associated bootstrap file,
+ // but does NOT have any log files appended (convert it to {@code RealtimeBootstrapBaseFileSplit})
+ // - {@code RealtimeBootstrapBaseFileSplit}: in case base file does have associated bootstrap file
+ // and does have log files appended
+ // - {@code BaseFileWithLogsSplit}: in case base file does NOT have associated bootstrap file
Review comment:
Apologies, meant to say that this will still be handled by `BaseFileWithLogsSplit` section
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #4556: [HUDI-3191] Removing duplicating file-listing process w/in Hive's MOR `FileInputFormat`s
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #4556:
URL: https://github.com/apache/hudi/pull/4556#issuecomment-1028457463
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "d87786af43a7aeba7549cc3cfcbd97fc312bee0e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5074",
"triggerID" : "d87786af43a7aeba7549cc3cfcbd97fc312bee0e",
"triggerType" : "PUSH"
}, {
"hash" : "4b87ba1474be575ec27109ccbe626e4c2fc9c224",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5077",
"triggerID" : "4b87ba1474be575ec27109ccbe626e4c2fc9c224",
"triggerType" : "PUSH"
}, {
"hash" : "77d11131baabd1c4e3cc2050337daca4df5f6427",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "77d11131baabd1c4e3cc2050337daca4df5f6427",
"triggerType" : "PUSH"
}, {
"hash" : "3d9c2ae28da858d1e8476052c99391015effb7db",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "3d9c2ae28da858d1e8476052c99391015effb7db",
"triggerType" : "PUSH"
}, {
"hash" : "79ac9affcb7f81497e0df755c8200638d35b02b7",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5081",
"triggerID" : "79ac9affcb7f81497e0df755c8200638d35b02b7",
"triggerType" : "PUSH"
}, {
"hash" : "3c14bbe6c6bcf49c4164c45e82f77b473f4de396",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5113",
"triggerID" : "3c14bbe6c6bcf49c4164c45e82f77b473f4de396",
"triggerType" : "PUSH"
}, {
"hash" : "276f13d6efd00b301b232b286d585729c9d1d26e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5116",
"triggerID" : "276f13d6efd00b301b232b286d585729c9d1d26e",
"triggerType" : "PUSH"
}, {
"hash" : "31b0669d7b638bd65a17b22a2ceb772f2627512c",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "31b0669d7b638bd65a17b22a2ceb772f2627512c",
"triggerType" : "PUSH"
}, {
"hash" : "096e26af39a477ffccbee0edd764493e12e15e71",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5124",
"triggerID" : "096e26af39a477ffccbee0edd764493e12e15e71",
"triggerType" : "PUSH"
}, {
"hash" : "97dd5ec7c9246f6d9f467b9076b790dd6017c5b4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5213",
"triggerID" : "97dd5ec7c9246f6d9f467b9076b790dd6017c5b4",
"triggerType" : "PUSH"
}, {
"hash" : "0538475fe488089c4cb3bc0afb63c2f518329969",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5257",
"triggerID" : "0538475fe488089c4cb3bc0afb63c2f518329969",
"triggerType" : "PUSH"
}, {
"hash" : "9f4b334e340fb26004e1b07fc8fbaaa047c76775",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5261",
"triggerID" : "9f4b334e340fb26004e1b07fc8fbaaa047c76775",
"triggerType" : "PUSH"
}, {
"hash" : "368c099820c3cbf57496d0e46d1858aa8eb153ee",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5330",
"triggerID" : "368c099820c3cbf57496d0e46d1858aa8eb153ee",
"triggerType" : "PUSH"
}, {
"hash" : "28a5a4f537544d35dfcd8700a7b97fb7216682ce",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "28a5a4f537544d35dfcd8700a7b97fb7216682ce",
"triggerType" : "PUSH"
}, {
"hash" : "08ffdd8b47d147c9b5c889a5f56e39b9b140612d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5351",
"triggerID" : "08ffdd8b47d147c9b5c889a5f56e39b9b140612d",
"triggerType" : "PUSH"
}, {
"hash" : "c09e228f7cce78a7dbbc394e93b3cf8c6c3d4d5f",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "c09e228f7cce78a7dbbc394e93b3cf8c6c3d4d5f",
"triggerType" : "PUSH"
}, {
"hash" : "8dadbf672d4d27505592f18bc89422fd7c013669",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5398",
"triggerID" : "8dadbf672d4d27505592f18bc89422fd7c013669",
"triggerType" : "PUSH"
}, {
"hash" : "906607be5bd62ee1cbbda34acb6a89916c1f7aee",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5424",
"triggerID" : "906607be5bd62ee1cbbda34acb6a89916c1f7aee",
"triggerType" : "PUSH"
}, {
"hash" : "dc1b033f40cea9642f71b8fcff74aa82106726b6",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5484",
"triggerID" : "dc1b033f40cea9642f71b8fcff74aa82106726b6",
"triggerType" : "PUSH"
}, {
"hash" : "5b8f5819fff8fec34864eb409fd429b95be17b9b",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "5b8f5819fff8fec34864eb409fd429b95be17b9b",
"triggerType" : "PUSH"
}, {
"hash" : "13702fc2232ebd9300966b0a917a3358d8d0f18c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5590",
"triggerID" : "13702fc2232ebd9300966b0a917a3358d8d0f18c",
"triggerType" : "PUSH"
}, {
"hash" : "13702fc2232ebd9300966b0a917a3358d8d0f18c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5600",
"triggerID" : "1024845655",
"triggerType" : "MANUAL"
}, {
"hash" : "9bdd8a60f95123f82a5f30f5e68929f5b7e1f8da",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5603",
"triggerID" : "9bdd8a60f95123f82a5f30f5e68929f5b7e1f8da",
"triggerType" : "PUSH"
}, {
"hash" : "aebb9df557c4afe3ca88f6b8b28ba2fbfdcbd597",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5631",
"triggerID" : "aebb9df557c4afe3ca88f6b8b28ba2fbfdcbd597",
"triggerType" : "PUSH"
}, {
"hash" : "5d37935bc8bb33260735d782ca560fd59e02f321",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "5d37935bc8bb33260735d782ca560fd59e02f321",
"triggerType" : "PUSH"
}, {
"hash" : "f911d869f50009e5cd9f3fd341c83c732d7531ba",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5634",
"triggerID" : "f911d869f50009e5cd9f3fd341c83c732d7531ba",
"triggerType" : "PUSH"
}, {
"hash" : "f911d869f50009e5cd9f3fd341c83c732d7531ba",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5657",
"triggerID" : "1027051107",
"triggerType" : "MANUAL"
}, {
"hash" : "f911d869f50009e5cd9f3fd341c83c732d7531ba",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5659",
"triggerID" : "1027166086",
"triggerType" : "MANUAL"
}, {
"hash" : "f911d869f50009e5cd9f3fd341c83c732d7531ba",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5665",
"triggerID" : "1027387044",
"triggerType" : "MANUAL"
}, {
"hash" : "34b94b96b03109555201092bfabce21793add437",
"status" : "CANCELED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5689",
"triggerID" : "34b94b96b03109555201092bfabce21793add437",
"triggerType" : "PUSH"
}, {
"hash" : "7f793744421a5ee304d5dff89d23e1e925bfd1cb",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "7f793744421a5ee304d5dff89d23e1e925bfd1cb",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 77d11131baabd1c4e3cc2050337daca4df5f6427 UNKNOWN
* 3d9c2ae28da858d1e8476052c99391015effb7db UNKNOWN
* 31b0669d7b638bd65a17b22a2ceb772f2627512c UNKNOWN
* 28a5a4f537544d35dfcd8700a7b97fb7216682ce UNKNOWN
* c09e228f7cce78a7dbbc394e93b3cf8c6c3d4d5f UNKNOWN
* 5b8f5819fff8fec34864eb409fd429b95be17b9b UNKNOWN
* 5d37935bc8bb33260735d782ca560fd59e02f321 UNKNOWN
* 34b94b96b03109555201092bfabce21793add437 Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5689)
* 7f793744421a5ee304d5dff89d23e1e925bfd1cb UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] yihua merged pull request #4556: [HUDI-3191] Removing duplicating file-listing process w/in Hive's MOR `FileInputFormat`s
Posted by GitBox <gi...@apache.org>.
yihua merged pull request #4556:
URL: https://github.com/apache/hudi/pull/4556
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #4556: [HUDI-3191][Stacked on 4531] Removing duplicating file-listing process w/in Hive's MOR `FIleInputFormat`s
Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #4556:
URL: https://github.com/apache/hudi/pull/4556#issuecomment-1009525456
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "d87786af43a7aeba7549cc3cfcbd97fc312bee0e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5074",
"triggerID" : "d87786af43a7aeba7549cc3cfcbd97fc312bee0e",
"triggerType" : "PUSH"
}, {
"hash" : "4b87ba1474be575ec27109ccbe626e4c2fc9c224",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5077",
"triggerID" : "4b87ba1474be575ec27109ccbe626e4c2fc9c224",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 4b87ba1474be575ec27109ccbe626e4c2fc9c224 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5077)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #4556: [HUDI-3191][Stacked on 4531] Removing duplicating file-listing process w/in Hive's MOR `FIleInputFormat`s
Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #4556:
URL: https://github.com/apache/hudi/pull/4556#issuecomment-1010374342
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "d87786af43a7aeba7549cc3cfcbd97fc312bee0e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5074",
"triggerID" : "d87786af43a7aeba7549cc3cfcbd97fc312bee0e",
"triggerType" : "PUSH"
}, {
"hash" : "4b87ba1474be575ec27109ccbe626e4c2fc9c224",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5077",
"triggerID" : "4b87ba1474be575ec27109ccbe626e4c2fc9c224",
"triggerType" : "PUSH"
}, {
"hash" : "77d11131baabd1c4e3cc2050337daca4df5f6427",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "77d11131baabd1c4e3cc2050337daca4df5f6427",
"triggerType" : "PUSH"
}, {
"hash" : "3d9c2ae28da858d1e8476052c99391015effb7db",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "3d9c2ae28da858d1e8476052c99391015effb7db",
"triggerType" : "PUSH"
}, {
"hash" : "79ac9affcb7f81497e0df755c8200638d35b02b7",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5081",
"triggerID" : "79ac9affcb7f81497e0df755c8200638d35b02b7",
"triggerType" : "PUSH"
}, {
"hash" : "3c14bbe6c6bcf49c4164c45e82f77b473f4de396",
"status" : "CANCELED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5113",
"triggerID" : "3c14bbe6c6bcf49c4164c45e82f77b473f4de396",
"triggerType" : "PUSH"
}, {
"hash" : "276f13d6efd00b301b232b286d585729c9d1d26e",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "276f13d6efd00b301b232b286d585729c9d1d26e",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 77d11131baabd1c4e3cc2050337daca4df5f6427 UNKNOWN
* 3d9c2ae28da858d1e8476052c99391015effb7db UNKNOWN
* 3c14bbe6c6bcf49c4164c45e82f77b473f4de396 Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5113)
* 276f13d6efd00b301b232b286d585729c9d1d26e UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #4556: [HUDI-3191][Stacked on 4531] Removing duplicating file-listing process w/in Hive's MOR `FIleInputFormat`s
Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #4556:
URL: https://github.com/apache/hudi/pull/4556#issuecomment-1010409713
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "d87786af43a7aeba7549cc3cfcbd97fc312bee0e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5074",
"triggerID" : "d87786af43a7aeba7549cc3cfcbd97fc312bee0e",
"triggerType" : "PUSH"
}, {
"hash" : "4b87ba1474be575ec27109ccbe626e4c2fc9c224",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5077",
"triggerID" : "4b87ba1474be575ec27109ccbe626e4c2fc9c224",
"triggerType" : "PUSH"
}, {
"hash" : "77d11131baabd1c4e3cc2050337daca4df5f6427",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "77d11131baabd1c4e3cc2050337daca4df5f6427",
"triggerType" : "PUSH"
}, {
"hash" : "3d9c2ae28da858d1e8476052c99391015effb7db",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "3d9c2ae28da858d1e8476052c99391015effb7db",
"triggerType" : "PUSH"
}, {
"hash" : "79ac9affcb7f81497e0df755c8200638d35b02b7",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5081",
"triggerID" : "79ac9affcb7f81497e0df755c8200638d35b02b7",
"triggerType" : "PUSH"
}, {
"hash" : "3c14bbe6c6bcf49c4164c45e82f77b473f4de396",
"status" : "CANCELED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5113",
"triggerID" : "3c14bbe6c6bcf49c4164c45e82f77b473f4de396",
"triggerType" : "PUSH"
}, {
"hash" : "276f13d6efd00b301b232b286d585729c9d1d26e",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5116",
"triggerID" : "276f13d6efd00b301b232b286d585729c9d1d26e",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 77d11131baabd1c4e3cc2050337daca4df5f6427 UNKNOWN
* 3d9c2ae28da858d1e8476052c99391015effb7db UNKNOWN
* 3c14bbe6c6bcf49c4164c45e82f77b473f4de396 Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5113)
* 276f13d6efd00b301b232b286d585729c9d1d26e Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5116)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #4556: [HUDI-3191][Stacked on 4531] Removing duplicating file-listing process w/in Hive's MOR `FIleInputFormat`s
Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #4556:
URL: https://github.com/apache/hudi/pull/4556#issuecomment-1009484475
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "d87786af43a7aeba7549cc3cfcbd97fc312bee0e",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5074",
"triggerID" : "d87786af43a7aeba7549cc3cfcbd97fc312bee0e",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* d87786af43a7aeba7549cc3cfcbd97fc312bee0e Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5074)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org