You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hudi.apache.org by GitBox <gi...@apache.org> on 2022/03/04 22:16:33 UTC
[GitHub] [hudi] alexeykudinkin opened a new pull request #4954: [HUDI-3561] Avoid including whole `MultipleSparkJobExecutionStrategy` object into the closure for Spark to serialize
alexeykudinkin opened a new pull request #4954:
URL: https://github.com/apache/hudi/pull/4954
## *Tips*
- *Thank you very much for contributing to Apache Hudi.*
- *Please review https://hudi.apache.org/contribute/how-to-contribute before opening a pull request.*
## What is the purpose of the pull request
Avoid including whole `MultipleSparkJobExecutionStrategy` object into the closure for Spark to serialize
## Brief change log
See above
## Verify this pull request
This pull request is a trivial rework / code cleanup without any test coverage.
This pull request is already covered by existing tests, such as *(please describe tests)*.
*(example:)*
- *Added integration tests for end-to-end.*
- *Added HoodieClientWriteTest to verify the change.*
- *Manually verified the change by running a job locally.*
## Committer checklist
- [ ] Has a corresponding JIRA in PR title & commit
- [ ] Commit message is descriptive of the change
- [ ] CI is green
- [ ] Necessary doc changes done or have another open PR
- [ ] For large changes, please consider breaking it into sub-tasks under an umbrella JIRA.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #4954: [HUDI-3561] Avoid including whole `MultipleSparkJobExecutionStrategy` object into the closure for Spark to serialize
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #4954:
URL: https://github.com/apache/hudi/pull/4954#issuecomment-1059600901
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "34a530a85a4a1ce41dc10881e79a83e9931a0649",
"status" : "CANCELED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6557",
"triggerID" : "34a530a85a4a1ce41dc10881e79a83e9931a0649",
"triggerType" : "PUSH"
}, {
"hash" : "00009bdcca154d461a6af1a028eb3d953f1ea03e",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "00009bdcca154d461a6af1a028eb3d953f1ea03e",
"triggerType" : "PUSH"
}, {
"hash" : "3cd70db10fdc7848b014106e83f4b76c5123077b",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6559",
"triggerID" : "3cd70db10fdc7848b014106e83f4b76c5123077b",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 34a530a85a4a1ce41dc10881e79a83e9931a0649 Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6557)
* 00009bdcca154d461a6af1a028eb3d953f1ea03e UNKNOWN
* 3cd70db10fdc7848b014106e83f4b76c5123077b Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6559)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #4954: [HUDI-3561] Avoid including whole `MultipleSparkJobExecutionStrategy` object into the closure for Spark to serialize
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #4954:
URL: https://github.com/apache/hudi/pull/4954#issuecomment-1059577086
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "34a530a85a4a1ce41dc10881e79a83e9931a0649",
"status" : "CANCELED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6557",
"triggerID" : "34a530a85a4a1ce41dc10881e79a83e9931a0649",
"triggerType" : "PUSH"
}, {
"hash" : "00009bdcca154d461a6af1a028eb3d953f1ea03e",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "00009bdcca154d461a6af1a028eb3d953f1ea03e",
"triggerType" : "PUSH"
}, {
"hash" : "3cd70db10fdc7848b014106e83f4b76c5123077b",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "3cd70db10fdc7848b014106e83f4b76c5123077b",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 34a530a85a4a1ce41dc10881e79a83e9931a0649 Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6557)
* 00009bdcca154d461a6af1a028eb3d953f1ea03e UNKNOWN
* 3cd70db10fdc7848b014106e83f4b76c5123077b UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #4954: [HUDI-3561] Avoid including whole `MultipleSparkJobExecutionStrategy` object into the closure for Spark to serialize
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #4954:
URL: https://github.com/apache/hudi/pull/4954#issuecomment-1059680651
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "34a530a85a4a1ce41dc10881e79a83e9931a0649",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6557",
"triggerID" : "34a530a85a4a1ce41dc10881e79a83e9931a0649",
"triggerType" : "PUSH"
}, {
"hash" : "00009bdcca154d461a6af1a028eb3d953f1ea03e",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "00009bdcca154d461a6af1a028eb3d953f1ea03e",
"triggerType" : "PUSH"
}, {
"hash" : "3cd70db10fdc7848b014106e83f4b76c5123077b",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6559",
"triggerID" : "3cd70db10fdc7848b014106e83f4b76c5123077b",
"triggerType" : "PUSH"
}, {
"hash" : "de9ad1511f673c1802b1638a57bd30cad33df485",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6562",
"triggerID" : "de9ad1511f673c1802b1638a57bd30cad33df485",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 00009bdcca154d461a6af1a028eb3d953f1ea03e UNKNOWN
* de9ad1511f673c1802b1638a57bd30cad33df485 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6562)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] nsivabalan merged pull request #4954: [HUDI-3561] Avoid including whole `MultipleSparkJobExecutionStrategy` object into the closure for Spark to serialize
Posted by GitBox <gi...@apache.org>.
nsivabalan merged pull request #4954:
URL: https://github.com/apache/hudi/pull/4954
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #4954: [HUDI-3561] Avoid including whole `MultipleSparkJobExecutionStrategy` object into the closure for Spark to serialize
Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #4954:
URL: https://github.com/apache/hudi/pull/4954#issuecomment-1059575688
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "34a530a85a4a1ce41dc10881e79a83e9931a0649",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6557",
"triggerID" : "34a530a85a4a1ce41dc10881e79a83e9931a0649",
"triggerType" : "PUSH"
}, {
"hash" : "00009bdcca154d461a6af1a028eb3d953f1ea03e",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "00009bdcca154d461a6af1a028eb3d953f1ea03e",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 34a530a85a4a1ce41dc10881e79a83e9931a0649 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6557)
* 00009bdcca154d461a6af1a028eb3d953f1ea03e UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #4954: [HUDI-3561] Avoid including whole `MultipleSparkJobExecutionStrategy` object into the closure for Spark to serialize
Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #4954:
URL: https://github.com/apache/hudi/pull/4954#issuecomment-1059600901
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "34a530a85a4a1ce41dc10881e79a83e9931a0649",
"status" : "CANCELED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6557",
"triggerID" : "34a530a85a4a1ce41dc10881e79a83e9931a0649",
"triggerType" : "PUSH"
}, {
"hash" : "00009bdcca154d461a6af1a028eb3d953f1ea03e",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "00009bdcca154d461a6af1a028eb3d953f1ea03e",
"triggerType" : "PUSH"
}, {
"hash" : "3cd70db10fdc7848b014106e83f4b76c5123077b",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6559",
"triggerID" : "3cd70db10fdc7848b014106e83f4b76c5123077b",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 34a530a85a4a1ce41dc10881e79a83e9931a0649 Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6557)
* 00009bdcca154d461a6af1a028eb3d953f1ea03e UNKNOWN
* 3cd70db10fdc7848b014106e83f4b76c5123077b Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6559)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] boneanxs commented on pull request #4954: [HUDI-3561] Avoid including whole `MultipleSparkJobExecutionStrategy` object into the closure for Spark to serialize
Posted by GitBox <gi...@apache.org>.
boneanxs commented on pull request #4954:
URL: https://github.com/apache/hudi/pull/4954#issuecomment-1061481475
Hi guys, I also met this exception when enable async clustering in a HoodieSparkStreaming job, not the same as the stacktrace this issue hit, following is the stacktrace I met,
```java
ERROR AsyncClusteringService: Clustering executor failed java.util.concurrent.CompletionException: org.apache.spark.SparkException: Task not serializable
at java.util.concurrent.CompletableFuture.encodeThrowable(CompletableFuture.java:273)
at java.util.concurrent.CompletableFuture.completeThrowable(CompletableFuture.java:280)
at java.util.concurrent.CompletableFuture$AsyncSupply.run(CompletableFuture.java:1606)
at java.util.concurrent.CompletableFuture$AsyncSupply.exec(CompletableFuture.java:1596)
at java.util.concurrent.ForkJoinTask.doExec(ForkJoinTask.java:289)
at java.util.concurrent.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1056)
at java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1692)
at java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:157)
Caused by: org.apache.spark.SparkException: Task not serializable
at org.apache.spark.util.ClosureCleaner$.ensureSerializable(ClosureCleaner.scala:416)
at org.apache.spark.util.ClosureCleaner$.clean(ClosureCleaner.scala:406)
at org.apache.spark.util.ClosureCleaner$.clean(ClosureCleaner.scala:162)
at org.apache.spark.SparkContext.clean(SparkContext.scala:2467)
at org.apache.spark.rdd.RDD.$anonfun$mapPartitionsWithIndex$1(RDD.scala:912)
at org.apache.spark.rdd.RDDOperationScope$.withScope(RDDOperationScope.scala:151)
at org.apache.spark.rdd.RDDOperationScope$.withScope(RDDOperationScope.scala:112)
at org.apache.spark.rdd.RDD.withScope(RDD.scala:414)
at org.apache.spark.rdd.RDD.mapPartitionsWithIndex(RDD.scala:911)
at org.apache.spark.api.java.JavaRDDLike.mapPartitionsWithIndex(JavaRDDLike.scala:103)
at org.apache.spark.api.java.JavaRDDLike.mapPartitionsWithIndex$(JavaRDDLike.scala:99)
at org.apache.spark.api.java.AbstractJavaRDDLike.mapPartitionsWithIndex(JavaRDDLike.scala:45)
at org.apache.hudi.table.action.commit.SparkBulkInsertHelper.bulkInsert(SparkBulkInsertHelper.java:115)
at org.apache.hudi.client.clustering.run.strategy.SparkSortAndSizeExecutionStrategy.performClusteringWithRecordsRDD(SparkSortAndSizeExecutionStrategy.java:68)
at org.apache.hudi.client.clustering.run.strategy.MultipleSparkJobExecutionStrategy.lambda$runClusteringForGroupAsync$4(MultipleSparkJobExecutionStrategy.java:175)
at java.util.concurrent.CompletableFuture$AsyncSupply.run(CompletableFuture.java:1604) ... 5 more
Caused by: java.util.ConcurrentModificationException
at java.util.LinkedHashMap$LinkedHashIterator.nextNode(LinkedHashMap.java:719)
at java.util.LinkedHashMap$LinkedKeyIterator.next(LinkedHashMap.java:742)
at java.util.HashSet.writeObject(HashSet.java:287)
at sun.reflect.GeneratedMethodAccessor54.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at java.io.ObjectStreamClass.invokeWriteObject(ObjectStreamClass.java:1140)
at java.io.ObjectOutputStream.writeSerialData(ObjectOutputStream.java:1496)
at java.io.ObjectOutputStream.writeOrdinaryObject(ObjectOutputStream.java:1432)
at java.io.ObjectOutputStream.writeObject0(ObjectOutputStream.java:1178)
at java.io.ObjectOutputStream.defaultWriteFields(ObjectOutputStream.java:1548)
at java.io.ObjectOutputStream.writeSerialData(ObjectOutputStream.java:1509)
at java.io.ObjectOutputStream.writeOrdinaryObject(ObjectOutputStream.java:1432)
at java.io.ObjectOutputStream.writeObject0(ObjectOutputStream.java:1178)
at java.io.ObjectOutputStream.defaultWriteFields(ObjectOutputStream.java:1548)
at java.io.ObjectOutputStream.writeSerialData(ObjectOutputStream.java:1509)
at java.io.ObjectOutputStream.writeOrdinaryObject(ObjectOutputStream.java:1432)
at java.io.ObjectOutputStream.writeObject0(ObjectOutputStream.java:1178)
at java.io.ObjectOutputStream.defaultWriteFields(ObjectOutputStream.java:1548)
at java.io.ObjectOutputStream.writeSerialData(ObjectOutputStream.java:1509)
at java.io.ObjectOutputStream.writeOrdinaryObject(ObjectOutputStream.java:1432)
at java.io.ObjectOutputStream.writeObject0(ObjectOutputStream.java:1178)
at java.io.ObjectOutputStream.defaultWriteFields(ObjectOutputStream.java:1548)
at java.io.ObjectOutputStream.writeSerialData(ObjectOutputStream.java:1509)
at java.io.ObjectOutputStream.writeOrdinaryObject(ObjectOutputStream.java:1432)
at java.io.ObjectOutputStream.writeObject0(ObjectOutputStream.java:1178)
at java.io.ObjectOutputStream.writeArray(ObjectOutputStream.java:1378)
at java.io.ObjectOutputStream.writeObject0(ObjectOutputStream.java:1174)
at java.io.ObjectOutputStream.defaultWriteFields(ObjectOutputStream.java:1548)
at java.io.ObjectOutputStream.writeSerialData(ObjectOutputStream.java:1509)
at java.io.ObjectOutputStream.writeOrdinaryObject(ObjectOutputStream.java:1432)
at java.io.ObjectOutputStream.writeObject0(ObjectOutputStream.java:1178)
at java.io.ObjectOutputStream.writeObject(ObjectOutputStream.java:348)
at org.apache.spark.serializer.JavaSerializationStream.writeObject(JavaSerializer.scala:44)
at org.apache.spark.serializer.JavaSerializerInstance
```
From my perspective, it might be `TypedProperties#keys` is not thread safe, and another thread is trying to change this HashSet(like `put` or `putall` from TypedProperties) while spark is trying to iterate it to serialize it at the same time. `TypedProperties` could be used by HoodieTable's config(HoodieWriteConfig), so this pr could fix it by avoiding HoodieTable to be serialized.
But when I'm trying to solve it with the same way as this pr used, Unfortunately found there could be a lot changes to avoid serializing HoodieTable (Change construction methods of `BulkInsertMapFunction`, `SparkLazyInsertIterable`, `HoodieLazyInsertIterable`, and many kinds of `WriteHandler`), I'm afraid this could be a huge change.
Another solution is to make `TypedProperties` thread-safe, there are two ways to make `TypedProperties` thread-safe
1. Only change keys to be `Collections.newSetFromMap(new ConcurrentHashMap<>())`, this could avoid `ConcurrentModificationException`, but `TypedProperties` is not really thread-safe, as modify attribute `keys` and save key-value pair is divided into two steps, for example,
```java
// Synchronized is not work actually, because get methods are not synchronized
public synchronized Object put(Object key, Object value) {
keys.remove(key);
keys.add(key);
// This could cause key is added in keys, but its value is not saved by TypedProperties
return super.put(key, value);
}
```
2. Not let `TypedProperties` to extend `Properties`, use an internal `ConcurrentHashMap` to save key and values, this could make `TypedProperties` to be real thread-safe.
```java
public class TypedProperties implements Serializable {
private final ConcurrentHashMap<Object, Object> props = new ConcurrentHashMap<Object, Object>();
public TypedProperties() {
}
public TypedProperties(Properties defaults) {
if (Objects.nonNull(defaults)) {
for (String key : defaults.stringPropertyNames()) {
put(key, defaults.getProperty(key));
}
}
}
public Enumeration<Object> keys() {
return Collections.enumeration(props.keySet());
}
...
```
Do you guys have any other suggestions? Thanks~
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #4954: [HUDI-3561] Avoid including whole `MultipleSparkJobExecutionStrategy` object into the closure for Spark to serialize
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #4954:
URL: https://github.com/apache/hudi/pull/4954#issuecomment-1059836611
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "34a530a85a4a1ce41dc10881e79a83e9931a0649",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6557",
"triggerID" : "34a530a85a4a1ce41dc10881e79a83e9931a0649",
"triggerType" : "PUSH"
}, {
"hash" : "00009bdcca154d461a6af1a028eb3d953f1ea03e",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "00009bdcca154d461a6af1a028eb3d953f1ea03e",
"triggerType" : "PUSH"
}, {
"hash" : "3cd70db10fdc7848b014106e83f4b76c5123077b",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6559",
"triggerID" : "3cd70db10fdc7848b014106e83f4b76c5123077b",
"triggerType" : "PUSH"
}, {
"hash" : "de9ad1511f673c1802b1638a57bd30cad33df485",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6562",
"triggerID" : "de9ad1511f673c1802b1638a57bd30cad33df485",
"triggerType" : "PUSH"
}, {
"hash" : "de9ad1511f673c1802b1638a57bd30cad33df485",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6573",
"triggerID" : "1059836265",
"triggerType" : "MANUAL"
} ]
}-->
## CI report:
* 00009bdcca154d461a6af1a028eb3d953f1ea03e UNKNOWN
* de9ad1511f673c1802b1638a57bd30cad33df485 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6562) Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6573)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] alexeykudinkin edited a comment on pull request #4954: [HUDI-3561] Avoid including whole `MultipleSparkJobExecutionStrategy` object into the closure for Spark to serialize
Posted by GitBox <gi...@apache.org>.
alexeykudinkin edited a comment on pull request #4954:
URL: https://github.com/apache/hudi/pull/4954#issuecomment-1062362168
@boneanxs can you create a JIRA for your issue so that we can keep track of it and concentrate all of the conversation in there.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] boneanxs commented on pull request #4954: [HUDI-3561] Avoid including whole `MultipleSparkJobExecutionStrategy` object into the closure for Spark to serialize
Posted by GitBox <gi...@apache.org>.
boneanxs commented on pull request #4954:
URL: https://github.com/apache/hudi/pull/4954#issuecomment-1062829280
@alexeykudinkin, @xushiyan, @yihua Sure, created a JIRA ticket: https://issues.apache.org/jira/browse/HUDI-3593, looking forward to get your feedback:-)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #4954: [HUDI-3561] Avoid including whole `MultipleSparkJobExecutionStrategy` object into the closure for Spark to serialize
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #4954:
URL: https://github.com/apache/hudi/pull/4954#issuecomment-1059648613
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "34a530a85a4a1ce41dc10881e79a83e9931a0649",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6557",
"triggerID" : "34a530a85a4a1ce41dc10881e79a83e9931a0649",
"triggerType" : "PUSH"
}, {
"hash" : "00009bdcca154d461a6af1a028eb3d953f1ea03e",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "00009bdcca154d461a6af1a028eb3d953f1ea03e",
"triggerType" : "PUSH"
}, {
"hash" : "3cd70db10fdc7848b014106e83f4b76c5123077b",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6559",
"triggerID" : "3cd70db10fdc7848b014106e83f4b76c5123077b",
"triggerType" : "PUSH"
}, {
"hash" : "de9ad1511f673c1802b1638a57bd30cad33df485",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "de9ad1511f673c1802b1638a57bd30cad33df485",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 00009bdcca154d461a6af1a028eb3d953f1ea03e UNKNOWN
* 3cd70db10fdc7848b014106e83f4b76c5123077b Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6559)
* de9ad1511f673c1802b1638a57bd30cad33df485 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #4954: [HUDI-3561] Avoid including whole `MultipleSparkJobExecutionStrategy` object into the closure for Spark to serialize
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #4954:
URL: https://github.com/apache/hudi/pull/4954#issuecomment-1059655825
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "34a530a85a4a1ce41dc10881e79a83e9931a0649",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6557",
"triggerID" : "34a530a85a4a1ce41dc10881e79a83e9931a0649",
"triggerType" : "PUSH"
}, {
"hash" : "00009bdcca154d461a6af1a028eb3d953f1ea03e",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "00009bdcca154d461a6af1a028eb3d953f1ea03e",
"triggerType" : "PUSH"
}, {
"hash" : "3cd70db10fdc7848b014106e83f4b76c5123077b",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6559",
"triggerID" : "3cd70db10fdc7848b014106e83f4b76c5123077b",
"triggerType" : "PUSH"
}, {
"hash" : "de9ad1511f673c1802b1638a57bd30cad33df485",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6562",
"triggerID" : "de9ad1511f673c1802b1638a57bd30cad33df485",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 00009bdcca154d461a6af1a028eb3d953f1ea03e UNKNOWN
* 3cd70db10fdc7848b014106e83f4b76c5123077b Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6559)
* de9ad1511f673c1802b1638a57bd30cad33df485 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6562)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #4954: [HUDI-3561] Avoid including whole `MultipleSparkJobExecutionStrategy` object into the closure for Spark to serialize
Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #4954:
URL: https://github.com/apache/hudi/pull/4954#issuecomment-1059655825
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "34a530a85a4a1ce41dc10881e79a83e9931a0649",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6557",
"triggerID" : "34a530a85a4a1ce41dc10881e79a83e9931a0649",
"triggerType" : "PUSH"
}, {
"hash" : "00009bdcca154d461a6af1a028eb3d953f1ea03e",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "00009bdcca154d461a6af1a028eb3d953f1ea03e",
"triggerType" : "PUSH"
}, {
"hash" : "3cd70db10fdc7848b014106e83f4b76c5123077b",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6559",
"triggerID" : "3cd70db10fdc7848b014106e83f4b76c5123077b",
"triggerType" : "PUSH"
}, {
"hash" : "de9ad1511f673c1802b1638a57bd30cad33df485",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6562",
"triggerID" : "de9ad1511f673c1802b1638a57bd30cad33df485",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 00009bdcca154d461a6af1a028eb3d953f1ea03e UNKNOWN
* 3cd70db10fdc7848b014106e83f4b76c5123077b Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6559)
* de9ad1511f673c1802b1638a57bd30cad33df485 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6562)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #4954: [HUDI-3561] Avoid including whole `MultipleSparkJobExecutionStrategy` object into the closure for Spark to serialize
Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #4954:
URL: https://github.com/apache/hudi/pull/4954#issuecomment-1059836611
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "34a530a85a4a1ce41dc10881e79a83e9931a0649",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6557",
"triggerID" : "34a530a85a4a1ce41dc10881e79a83e9931a0649",
"triggerType" : "PUSH"
}, {
"hash" : "00009bdcca154d461a6af1a028eb3d953f1ea03e",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "00009bdcca154d461a6af1a028eb3d953f1ea03e",
"triggerType" : "PUSH"
}, {
"hash" : "3cd70db10fdc7848b014106e83f4b76c5123077b",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6559",
"triggerID" : "3cd70db10fdc7848b014106e83f4b76c5123077b",
"triggerType" : "PUSH"
}, {
"hash" : "de9ad1511f673c1802b1638a57bd30cad33df485",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6562",
"triggerID" : "de9ad1511f673c1802b1638a57bd30cad33df485",
"triggerType" : "PUSH"
}, {
"hash" : "de9ad1511f673c1802b1638a57bd30cad33df485",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6573",
"triggerID" : "1059836265",
"triggerType" : "MANUAL"
} ]
}-->
## CI report:
* 00009bdcca154d461a6af1a028eb3d953f1ea03e UNKNOWN
* de9ad1511f673c1802b1638a57bd30cad33df485 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6562) Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6573)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] alexeykudinkin commented on pull request #4954: [HUDI-3561] Avoid including whole `MultipleSparkJobExecutionStrategy` object into the closure for Spark to serialize
Posted by GitBox <gi...@apache.org>.
alexeykudinkin commented on pull request #4954:
URL: https://github.com/apache/hudi/pull/4954#issuecomment-1062362168
@boneanxs can you create a JIRA for your issue so that we can keep track of it?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #4954: [HUDI-3561] Avoid including whole `MultipleSparkJobExecutionStrategy` object into the closure for Spark to serialize
Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #4954:
URL: https://github.com/apache/hudi/pull/4954#issuecomment-1059577086
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "34a530a85a4a1ce41dc10881e79a83e9931a0649",
"status" : "CANCELED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6557",
"triggerID" : "34a530a85a4a1ce41dc10881e79a83e9931a0649",
"triggerType" : "PUSH"
}, {
"hash" : "00009bdcca154d461a6af1a028eb3d953f1ea03e",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "00009bdcca154d461a6af1a028eb3d953f1ea03e",
"triggerType" : "PUSH"
}, {
"hash" : "3cd70db10fdc7848b014106e83f4b76c5123077b",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "3cd70db10fdc7848b014106e83f4b76c5123077b",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 34a530a85a4a1ce41dc10881e79a83e9931a0649 Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6557)
* 00009bdcca154d461a6af1a028eb3d953f1ea03e UNKNOWN
* 3cd70db10fdc7848b014106e83f4b76c5123077b UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #4954: [HUDI-3561] Avoid including whole `MultipleSparkJobExecutionStrategy` object into the closure for Spark to serialize
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #4954:
URL: https://github.com/apache/hudi/pull/4954#issuecomment-1059628495
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "34a530a85a4a1ce41dc10881e79a83e9931a0649",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6557",
"triggerID" : "34a530a85a4a1ce41dc10881e79a83e9931a0649",
"triggerType" : "PUSH"
}, {
"hash" : "00009bdcca154d461a6af1a028eb3d953f1ea03e",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "00009bdcca154d461a6af1a028eb3d953f1ea03e",
"triggerType" : "PUSH"
}, {
"hash" : "3cd70db10fdc7848b014106e83f4b76c5123077b",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6559",
"triggerID" : "3cd70db10fdc7848b014106e83f4b76c5123077b",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 00009bdcca154d461a6af1a028eb3d953f1ea03e UNKNOWN
* 3cd70db10fdc7848b014106e83f4b76c5123077b Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6559)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #4954: [HUDI-3561] Avoid including whole `MultipleSparkJobExecutionStrategy` object into the closure for Spark to serialize
Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #4954:
URL: https://github.com/apache/hudi/pull/4954#issuecomment-1059628495
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "34a530a85a4a1ce41dc10881e79a83e9931a0649",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6557",
"triggerID" : "34a530a85a4a1ce41dc10881e79a83e9931a0649",
"triggerType" : "PUSH"
}, {
"hash" : "00009bdcca154d461a6af1a028eb3d953f1ea03e",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "00009bdcca154d461a6af1a028eb3d953f1ea03e",
"triggerType" : "PUSH"
}, {
"hash" : "3cd70db10fdc7848b014106e83f4b76c5123077b",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6559",
"triggerID" : "3cd70db10fdc7848b014106e83f4b76c5123077b",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 00009bdcca154d461a6af1a028eb3d953f1ea03e UNKNOWN
* 3cd70db10fdc7848b014106e83f4b76c5123077b Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6559)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #4954: [HUDI-3561] Avoid including whole `MultipleSparkJobExecutionStrategy` object into the closure for Spark to serialize
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #4954:
URL: https://github.com/apache/hudi/pull/4954#issuecomment-1059575688
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "34a530a85a4a1ce41dc10881e79a83e9931a0649",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6557",
"triggerID" : "34a530a85a4a1ce41dc10881e79a83e9931a0649",
"triggerType" : "PUSH"
}, {
"hash" : "00009bdcca154d461a6af1a028eb3d953f1ea03e",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "00009bdcca154d461a6af1a028eb3d953f1ea03e",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 34a530a85a4a1ce41dc10881e79a83e9931a0649 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6557)
* 00009bdcca154d461a6af1a028eb3d953f1ea03e UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #4954: [HUDI-3561] Avoid including whole `MultipleSparkJobExecutionStrategy` object into the closure for Spark to serialize
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #4954:
URL: https://github.com/apache/hudi/pull/4954#issuecomment-1059845896
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "34a530a85a4a1ce41dc10881e79a83e9931a0649",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6557",
"triggerID" : "34a530a85a4a1ce41dc10881e79a83e9931a0649",
"triggerType" : "PUSH"
}, {
"hash" : "00009bdcca154d461a6af1a028eb3d953f1ea03e",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "00009bdcca154d461a6af1a028eb3d953f1ea03e",
"triggerType" : "PUSH"
}, {
"hash" : "3cd70db10fdc7848b014106e83f4b76c5123077b",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6559",
"triggerID" : "3cd70db10fdc7848b014106e83f4b76c5123077b",
"triggerType" : "PUSH"
}, {
"hash" : "de9ad1511f673c1802b1638a57bd30cad33df485",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6562",
"triggerID" : "de9ad1511f673c1802b1638a57bd30cad33df485",
"triggerType" : "PUSH"
}, {
"hash" : "de9ad1511f673c1802b1638a57bd30cad33df485",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6573",
"triggerID" : "1059836265",
"triggerType" : "MANUAL"
} ]
}-->
## CI report:
* 00009bdcca154d461a6af1a028eb3d953f1ea03e UNKNOWN
* de9ad1511f673c1802b1638a57bd30cad33df485 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6562) Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6573)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #4954: [HUDI-3561] Avoid including whole `MultipleSparkJobExecutionStrategy` object into the closure for Spark to serialize
Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #4954:
URL: https://github.com/apache/hudi/pull/4954#issuecomment-1059648613
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "34a530a85a4a1ce41dc10881e79a83e9931a0649",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6557",
"triggerID" : "34a530a85a4a1ce41dc10881e79a83e9931a0649",
"triggerType" : "PUSH"
}, {
"hash" : "00009bdcca154d461a6af1a028eb3d953f1ea03e",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "00009bdcca154d461a6af1a028eb3d953f1ea03e",
"triggerType" : "PUSH"
}, {
"hash" : "3cd70db10fdc7848b014106e83f4b76c5123077b",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6559",
"triggerID" : "3cd70db10fdc7848b014106e83f4b76c5123077b",
"triggerType" : "PUSH"
}, {
"hash" : "de9ad1511f673c1802b1638a57bd30cad33df485",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "de9ad1511f673c1802b1638a57bd30cad33df485",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 00009bdcca154d461a6af1a028eb3d953f1ea03e UNKNOWN
* 3cd70db10fdc7848b014106e83f4b76c5123077b Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6559)
* de9ad1511f673c1802b1638a57bd30cad33df485 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #4954: [HUDI-3561] Avoid including whole `MultipleSparkJobExecutionStrategy` object into the closure for Spark to serialize
Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #4954:
URL: https://github.com/apache/hudi/pull/4954#issuecomment-1059574258
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "34a530a85a4a1ce41dc10881e79a83e9931a0649",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "34a530a85a4a1ce41dc10881e79a83e9931a0649",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 34a530a85a4a1ce41dc10881e79a83e9931a0649 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #4954: [HUDI-3561] Avoid including whole `MultipleSparkJobExecutionStrategy` object into the closure for Spark to serialize
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #4954:
URL: https://github.com/apache/hudi/pull/4954#issuecomment-1059574258
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "34a530a85a4a1ce41dc10881e79a83e9931a0649",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "34a530a85a4a1ce41dc10881e79a83e9931a0649",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 34a530a85a4a1ce41dc10881e79a83e9931a0649 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #4954: [HUDI-3561] Avoid including whole `MultipleSparkJobExecutionStrategy` object into the closure for Spark to serialize
Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #4954:
URL: https://github.com/apache/hudi/pull/4954#issuecomment-1059680651
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "34a530a85a4a1ce41dc10881e79a83e9931a0649",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6557",
"triggerID" : "34a530a85a4a1ce41dc10881e79a83e9931a0649",
"triggerType" : "PUSH"
}, {
"hash" : "00009bdcca154d461a6af1a028eb3d953f1ea03e",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "00009bdcca154d461a6af1a028eb3d953f1ea03e",
"triggerType" : "PUSH"
}, {
"hash" : "3cd70db10fdc7848b014106e83f4b76c5123077b",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6559",
"triggerID" : "3cd70db10fdc7848b014106e83f4b76c5123077b",
"triggerType" : "PUSH"
}, {
"hash" : "de9ad1511f673c1802b1638a57bd30cad33df485",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6562",
"triggerID" : "de9ad1511f673c1802b1638a57bd30cad33df485",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 00009bdcca154d461a6af1a028eb3d953f1ea03e UNKNOWN
* de9ad1511f673c1802b1638a57bd30cad33df485 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6562)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] alexeykudinkin commented on pull request #4954: [HUDI-3561] Avoid including whole `MultipleSparkJobExecutionStrategy` object into the closure for Spark to serialize
Posted by GitBox <gi...@apache.org>.
alexeykudinkin commented on pull request #4954:
URL: https://github.com/apache/hudi/pull/4954#issuecomment-1059836265
@hudi-bot run azure
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org