You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hudi.apache.org by GitBox <gi...@apache.org> on 2022/10/19 20:38:42 UTC
[GitHub] [hudi] jonvex opened a new pull request, #7005: Utilities and spark ci gh actions
jonvex opened a new pull request, #7005:
URL: https://github.com/apache/hudi/pull/7005
### Change Logs
_Describe context and summary for this change. Highlight if any code was copied._
### Impact
_Describe any public API or user-facing feature change or any performance impact._
### Risk level (write none, low medium or high below)
_If medium or high, explain what verification was done to mitigate the risks._
### Documentation Update
_Describe any necessary documentation update if there is any new feature, config, or user-facing change_
- _The config description must be updated if new configs are added or the default value of the configs are changed_
- _Any new feature or user-facing change requires updating the Hudi website. Please create a Jira ticket, attach the
ticket number here and follow the [instruction](https://hudi.apache.org/contribute/developer-setup#website) to make
changes to the website._
### Contributor's checklist
- [ ] Read through [contributor's guide](https://hudi.apache.org/contribute/how-to-contribute)
- [ ] Change Logs and Impact were stated clearly
- [ ] Adequate tests were added if applicable
- [ ] CI passed
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] xushiyan commented on a diff in pull request #7005: Utilities and spark ci gh actions
Posted by GitBox <gi...@apache.org>.
xushiyan commented on code in PR #7005:
URL: https://github.com/apache/hudi/pull/7005#discussion_r1000479932
##########
packaging/bundle-validation/validate.sh:
##########
@@ -0,0 +1,114 @@
+#!/bin/bash
+
+# Licensed to the Apache Software Foundation (ASF) under one
+# or more contributor license agreements. See the NOTICE file
+# distributed with this work for additional information
+# regarding copyright ownership. The ASF licenses this file
+# to you under the Apache License, Version 2.0 (the
+# "License"); you may not use this file except in compliance
+# with the License. You may obtain a copy of the License at
+#
+# http://www.apache.org/licenses/LICENSE-2.0
+#
+# Unless required by applicable law or agreed to in writing,
+# software distributed under the License is distributed on an
+# "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
+# KIND, either express or implied. See the License for the
+# specific language governing permissions and limitations
+# under the License.
+
+# NOTE: this script runs inside hudi-ci-bundle-validation container
+# $WORKDIR/jars/ is supposed to be mounted to a host directory where bundle jars are placed
+# TODO: $JAR_COMBINATIONS should have different orders for different jars to detect class loading issues
+
+WORKDIR=/opt/bundle-validation
+HIVE_DATA=${WORKDIR}/data/hive
+JAR_DATA=${WORKDIR}/data/jars
+UTILITIES_DATA=${WORKDIR}/data/utilities
+
+run_hive_sync () {
+ echo "::warning::validate.sh setting up hive sync"
+ #put config files in correct place
+ cp $HIVE_DATA/spark-defaults.conf $SPARK_HOME/conf/
+ cp $HIVE_DATA/hive-site.xml $HIVE_HOME/conf/
+ ln -sf $HIVE_HOME/conf/hive-site.xml $SPARK_HOME/conf/hive-site.xml
+ cp $DERBY_HOME/lib/derbyclient.jar $SPARK_HOME/jars/
+
+ $DERBY_HOME/bin/startNetworkServer -h 0.0.0.0 &
+ $HIVE_HOME/bin/hiveserver2 &
+ echo "::warning::validate.sh hive setup complete. Testing"
+ $SPARK_HOME/bin/spark-shell --jars $JAR_DATA/spark.jar < $HIVE_DATA/validate.scala
+ if [ "$?" -ne 0 ]; then
+ echo "::error::validate.sh failed hive testing)"
+ exit 1
+ fi
+ echo "::warning::validate.sh hive testing succesfull. Cleaning up hive sync"
+ #remove config files
Review Comment:
/nit code style: try always put a space after `#`
##########
packaging/bundle-validation/validate.sh:
##########
@@ -0,0 +1,114 @@
+#!/bin/bash
+
+# Licensed to the Apache Software Foundation (ASF) under one
+# or more contributor license agreements. See the NOTICE file
+# distributed with this work for additional information
+# regarding copyright ownership. The ASF licenses this file
+# to you under the Apache License, Version 2.0 (the
+# "License"); you may not use this file except in compliance
+# with the License. You may obtain a copy of the License at
+#
+# http://www.apache.org/licenses/LICENSE-2.0
+#
+# Unless required by applicable law or agreed to in writing,
+# software distributed under the License is distributed on an
+# "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
+# KIND, either express or implied. See the License for the
+# specific language governing permissions and limitations
+# under the License.
+
+# NOTE: this script runs inside hudi-ci-bundle-validation container
+# $WORKDIR/jars/ is supposed to be mounted to a host directory where bundle jars are placed
+# TODO: $JAR_COMBINATIONS should have different orders for different jars to detect class loading issues
+
+WORKDIR=/opt/bundle-validation
+HIVE_DATA=${WORKDIR}/data/hive
+JAR_DATA=${WORKDIR}/data/jars
+UTILITIES_DATA=${WORKDIR}/data/utilities
+
+run_hive_sync () {
Review Comment:
align function name: test_spark_bundle()
##########
packaging/bundle-validation/validate.sh:
##########
@@ -0,0 +1,114 @@
+#!/bin/bash
+
+# Licensed to the Apache Software Foundation (ASF) under one
+# or more contributor license agreements. See the NOTICE file
+# distributed with this work for additional information
+# regarding copyright ownership. The ASF licenses this file
+# to you under the Apache License, Version 2.0 (the
+# "License"); you may not use this file except in compliance
+# with the License. You may obtain a copy of the License at
+#
+# http://www.apache.org/licenses/LICENSE-2.0
+#
+# Unless required by applicable law or agreed to in writing,
+# software distributed under the License is distributed on an
+# "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
+# KIND, either express or implied. See the License for the
+# specific language governing permissions and limitations
+# under the License.
+
+# NOTE: this script runs inside hudi-ci-bundle-validation container
+# $WORKDIR/jars/ is supposed to be mounted to a host directory where bundle jars are placed
+# TODO: $JAR_COMBINATIONS should have different orders for different jars to detect class loading issues
+
+WORKDIR=/opt/bundle-validation
+HIVE_DATA=${WORKDIR}/data/hive
+JAR_DATA=${WORKDIR}/data/jars
+UTILITIES_DATA=${WORKDIR}/data/utilities
+
+run_hive_sync () {
+ echo "::warning::validate.sh setting up hive sync"
+ #put config files in correct place
+ cp $HIVE_DATA/spark-defaults.conf $SPARK_HOME/conf/
+ cp $HIVE_DATA/hive-site.xml $HIVE_HOME/conf/
+ ln -sf $HIVE_HOME/conf/hive-site.xml $SPARK_HOME/conf/hive-site.xml
+ cp $DERBY_HOME/lib/derbyclient.jar $SPARK_HOME/jars/
+
+ $DERBY_HOME/bin/startNetworkServer -h 0.0.0.0 &
+ $HIVE_HOME/bin/hiveserver2 &
+ echo "::warning::validate.sh hive setup complete. Testing"
+ $SPARK_HOME/bin/spark-shell --jars $JAR_DATA/spark.jar < $HIVE_DATA/validate.scala
+ if [ "$?" -ne 0 ]; then
+ echo "::error::validate.sh failed hive testing)"
+ exit 1
+ fi
+ echo "::warning::validate.sh hive testing succesfull. Cleaning up hive sync"
+ #remove config files
+ rm -f $SPARK_HOME/jars/derbyclient.jar
+ unlink $SPARK_HOME/conf/hive-site.xml
+ rm -f $HIVE_HOME/conf/hive-site.xml
+ rm -f $SPARK_HOME/conf/spark-defaults.conf
+}
+
+test_utilities_bundle () {
+ echo "::warning::validate.sh running deltastreamer"
+ $SPARK_HOME/bin/spark-submit --driver-memory 8g --executor-memory 8g \
+ --class org.apache.hudi.utilities.deltastreamer.HoodieDeltaStreamer \
+ $JARS_BEGIN $JARS_ARG \
+ --props $UTILITIES_DATA/parquet-dfs-compact.props \
+ --schemaprovider-class org.apache.hudi.utilities.schema.FilebasedSchemaProvider \
+ --source-class org.apache.hudi.utilities.sources.ParquetDFSSource \
Review Comment:
it is not a good practice to version control parquet files (binary data) for testing, not easy to inspect what the content is and hard to evolve. we should use JsonDFSSource and make use of the stocks data from docker/demo/data/. cc @nsivabalan thought we agreed on this ?
##########
packaging/bundle-validation/validate.sh:
##########
@@ -0,0 +1,114 @@
+#!/bin/bash
+
+# Licensed to the Apache Software Foundation (ASF) under one
+# or more contributor license agreements. See the NOTICE file
+# distributed with this work for additional information
+# regarding copyright ownership. The ASF licenses this file
+# to you under the Apache License, Version 2.0 (the
+# "License"); you may not use this file except in compliance
+# with the License. You may obtain a copy of the License at
+#
+# http://www.apache.org/licenses/LICENSE-2.0
+#
+# Unless required by applicable law or agreed to in writing,
+# software distributed under the License is distributed on an
+# "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
+# KIND, either express or implied. See the License for the
+# specific language governing permissions and limitations
+# under the License.
+
+# NOTE: this script runs inside hudi-ci-bundle-validation container
+# $WORKDIR/jars/ is supposed to be mounted to a host directory where bundle jars are placed
+# TODO: $JAR_COMBINATIONS should have different orders for different jars to detect class loading issues
+
+WORKDIR=/opt/bundle-validation
+HIVE_DATA=${WORKDIR}/data/hive
+JAR_DATA=${WORKDIR}/data/jars
+UTILITIES_DATA=${WORKDIR}/data/utilities
+
+run_hive_sync () {
+ echo "::warning::validate.sh setting up hive sync"
+ #put config files in correct place
+ cp $HIVE_DATA/spark-defaults.conf $SPARK_HOME/conf/
+ cp $HIVE_DATA/hive-site.xml $HIVE_HOME/conf/
+ ln -sf $HIVE_HOME/conf/hive-site.xml $SPARK_HOME/conf/hive-site.xml
+ cp $DERBY_HOME/lib/derbyclient.jar $SPARK_HOME/jars/
+
+ $DERBY_HOME/bin/startNetworkServer -h 0.0.0.0 &
+ $HIVE_HOME/bin/hiveserver2 &
+ echo "::warning::validate.sh hive setup complete. Testing"
+ $SPARK_HOME/bin/spark-shell --jars $JAR_DATA/spark.jar < $HIVE_DATA/validate.scala
+ if [ "$?" -ne 0 ]; then
+ echo "::error::validate.sh failed hive testing)"
+ exit 1
+ fi
+ echo "::warning::validate.sh hive testing succesfull. Cleaning up hive sync"
+ #remove config files
+ rm -f $SPARK_HOME/jars/derbyclient.jar
+ unlink $SPARK_HOME/conf/hive-site.xml
+ rm -f $HIVE_HOME/conf/hive-site.xml
+ rm -f $SPARK_HOME/conf/spark-defaults.conf
+}
+
+test_utilities_bundle () {
+ echo "::warning::validate.sh running deltastreamer"
+ $SPARK_HOME/bin/spark-submit --driver-memory 8g --executor-memory 8g \
+ --class org.apache.hudi.utilities.deltastreamer.HoodieDeltaStreamer \
+ $JARS_BEGIN $JARS_ARG \
+ --props $UTILITIES_DATA/parquet-dfs-compact.props \
+ --schemaprovider-class org.apache.hudi.utilities.schema.FilebasedSchemaProvider \
+ --source-class org.apache.hudi.utilities.sources.ParquetDFSSource \
+ --source-ordering-field date_col --table-type MERGE_ON_READ \
+ --target-base-path file://${OUTPUT_DIR} \
+ --target-table ny_hudi_tbl --op UPSERT
+ echo "::warning::validate.sh done with deltastreamer"
+
+ OUTPUT_SIZE=$(du -s ${OUTPUT_DIR} | awk '{print $1}')
+ if [[ -z $OUTPUT_SIZE || "$OUTPUT_SIZE" -lt "1000" ]]; then
+ echo "::error::validate.sh deltastreamer output folder is much smaller than expected)"
+ exit 1
+ fi
+
+ echo "::warning::validate.sh validating deltastreamer in spark shell"
+ SHELL_COMMAND="$SPARK_HOME/bin/spark-shell --jars $JARS_ARG $SHELL_ARGS -i $COMMANDS_FILE"
+ echo "this is the shell command: $SHELL_COMMAND"
+ LOGFILE="$WORKDIR/submit.log"
+ $SHELL_COMMAND >> $LOGFILE
+ if [ "$?" -ne 0 ]; then
+ SHELL_RESULT=$(cat $LOGFILE | grep "Counts don't match")
+ echo "::error::validate.sh $SHELL_RESULT)"
+ exit 1
+ fi
+ echo "::warning::validate.sh done validating deltastreamer in spark shell"
+}
+
+
+# run_hive_sync
+# if [ "$?" -ne 0 ]; then
+# exit 1
+# fi
+
+SHELL_ARGS=$(cat $UTILITIES_DATA/shell_args)
+
+echo "::warning::validate.sh testing utilities bundle"
+JARS_BEGIN=""
+JARS_ARG=$JAR_DATA/utilities.jar
+OUTPUT_DIR=/tmp/hudi-deltastreamer-ny/
+COMMANDS_FILE=$UTILITIES_DATA/commands.scala
+test_utilities_bundle
+if [ "$?" -ne 0 ]; then
+ exit 1
+fi
+echo "::warning::validate.sh done testing utilities bundle"
+
+echo "::warning::validate.sh testing utilities slim bundle"
+JARS_BEGIN="--jars"
+JARS_ARG="$JAR_DATA/spark.jar $JAR_DATA/utilities-slim.jar"
Review Comment:
JARS_BEGIN and JAR_ARG are a bit weird. you can set `MAIN_JAR` to be always using utilities bundle and `JARS_OPT='--jars xxx'` or empty string. MAIN_JAR can only be set to 1 jar and JARS_OPT can be multiple comma-delimited jars
##########
packaging/bundle-validation/validate.sh:
##########
@@ -0,0 +1,114 @@
+#!/bin/bash
+
+# Licensed to the Apache Software Foundation (ASF) under one
+# or more contributor license agreements. See the NOTICE file
+# distributed with this work for additional information
+# regarding copyright ownership. The ASF licenses this file
+# to you under the Apache License, Version 2.0 (the
+# "License"); you may not use this file except in compliance
+# with the License. You may obtain a copy of the License at
+#
+# http://www.apache.org/licenses/LICENSE-2.0
+#
+# Unless required by applicable law or agreed to in writing,
+# software distributed under the License is distributed on an
+# "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
+# KIND, either express or implied. See the License for the
+# specific language governing permissions and limitations
+# under the License.
+
+# NOTE: this script runs inside hudi-ci-bundle-validation container
+# $WORKDIR/jars/ is supposed to be mounted to a host directory where bundle jars are placed
+# TODO: $JAR_COMBINATIONS should have different orders for different jars to detect class loading issues
+
+WORKDIR=/opt/bundle-validation
+HIVE_DATA=${WORKDIR}/data/hive
+JAR_DATA=${WORKDIR}/data/jars
+UTILITIES_DATA=${WORKDIR}/data/utilities
+
+run_hive_sync () {
+ echo "::warning::validate.sh setting up hive sync"
+ #put config files in correct place
+ cp $HIVE_DATA/spark-defaults.conf $SPARK_HOME/conf/
+ cp $HIVE_DATA/hive-site.xml $HIVE_HOME/conf/
+ ln -sf $HIVE_HOME/conf/hive-site.xml $SPARK_HOME/conf/hive-site.xml
+ cp $DERBY_HOME/lib/derbyclient.jar $SPARK_HOME/jars/
Review Comment:
interesting.. what is the consideration here that you moved these out from docker building? these configs are quite common to different bundle testing scenarios. if any specific setting, we can pass via CLI arg to the test case's spark command
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] xushiyan commented on a diff in pull request #7005: [HUDI-4982] Add Utilities and Utilities Slim + Spark Bundle testing to GH Actions
Posted by GitBox <gi...@apache.org>.
xushiyan commented on code in PR #7005:
URL: https://github.com/apache/hudi/pull/7005#discussion_r1004496983
##########
packaging/bundle-validation/validate.sh:
##########
@@ -0,0 +1,114 @@
+#!/bin/bash
+
+# Licensed to the Apache Software Foundation (ASF) under one
+# or more contributor license agreements. See the NOTICE file
+# distributed with this work for additional information
+# regarding copyright ownership. The ASF licenses this file
+# to you under the Apache License, Version 2.0 (the
+# "License"); you may not use this file except in compliance
+# with the License. You may obtain a copy of the License at
+#
+# http://www.apache.org/licenses/LICENSE-2.0
+#
+# Unless required by applicable law or agreed to in writing,
+# software distributed under the License is distributed on an
+# "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
+# KIND, either express or implied. See the License for the
+# specific language governing permissions and limitations
+# under the License.
+
+# NOTE: this script runs inside hudi-ci-bundle-validation container
+# $WORKDIR/jars/ is supposed to be mounted to a host directory where bundle jars are placed
+# TODO: $JAR_COMBINATIONS should have different orders for different jars to detect class loading issues
+
+WORKDIR=/opt/bundle-validation
+HIVE_DATA=${WORKDIR}/data/hive
+JAR_DATA=${WORKDIR}/data/jars
+UTILITIES_DATA=${WORKDIR}/data/utilities
+
+run_hive_sync () {
+ echo "::warning::validate.sh setting up hive sync"
+ #put config files in correct place
+ cp $HIVE_DATA/spark-defaults.conf $SPARK_HOME/conf/
+ cp $HIVE_DATA/hive-site.xml $HIVE_HOME/conf/
+ ln -sf $HIVE_HOME/conf/hive-site.xml $SPARK_HOME/conf/hive-site.xml
+ cp $DERBY_HOME/lib/derbyclient.jar $SPARK_HOME/jars/
Review Comment:
@jonvex in the latest refactoring commit i'm making shared conf for the whole stack, meaning the infra (hadoop, hive, etc) we setup should be appropriate to handle all bundle tests, no need to swap in and out some confs. We should be able to bypass the problem you encountered by doing direct spark datasource read (not via registered temp table)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #7005: Utilities and spark ci gh actions
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #7005:
URL: https://github.com/apache/hudi/pull/7005#issuecomment-1289375371
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "8d571a216ccbeb61d6365785b215291fc0d1d899",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=12357",
"triggerID" : "8d571a216ccbeb61d6365785b215291fc0d1d899",
"triggerType" : "PUSH"
}, {
"hash" : "7c19a482abfae743281ebbbd51842a034159295c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=12393",
"triggerID" : "7c19a482abfae743281ebbbd51842a034159295c",
"triggerType" : "PUSH"
}, {
"hash" : "56032a44e18867e8ae21f47383ee1273d5c9c806",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "56032a44e18867e8ae21f47383ee1273d5c9c806",
"triggerType" : "PUSH"
}, {
"hash" : "5cebd12dbcd4f87c35fb39c504141f0b1147a8b2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=12399",
"triggerID" : "5cebd12dbcd4f87c35fb39c504141f0b1147a8b2",
"triggerType" : "PUSH"
}, {
"hash" : "c3c4376ccec55470031fd3c516722547cd553ee5",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "c3c4376ccec55470031fd3c516722547cd553ee5",
"triggerType" : "PUSH"
}, {
"hash" : "03ffae125238e63048a248b3cb916b1397c882b5",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "03ffae125238e63048a248b3cb916b1397c882b5",
"triggerType" : "PUSH"
}, {
"hash" : "3ad93ee2ab40eb85811b7cd82f592451eb48b432",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=12401",
"triggerID" : "3ad93ee2ab40eb85811b7cd82f592451eb48b432",
"triggerType" : "PUSH"
}, {
"hash" : "f2c11d3b0feb26fc38e3725f957e4944620394c9",
"status" : "CANCELED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=12532",
"triggerID" : "f2c11d3b0feb26fc38e3725f957e4944620394c9",
"triggerType" : "PUSH"
}, {
"hash" : "c2111026a798413ed4e5e15b20f1fcce5d5fc64d",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=12534",
"triggerID" : "c2111026a798413ed4e5e15b20f1fcce5d5fc64d",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 56032a44e18867e8ae21f47383ee1273d5c9c806 UNKNOWN
* c3c4376ccec55470031fd3c516722547cd553ee5 UNKNOWN
* 03ffae125238e63048a248b3cb916b1397c882b5 UNKNOWN
* f2c11d3b0feb26fc38e3725f957e4944620394c9 Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=12532)
* c2111026a798413ed4e5e15b20f1fcce5d5fc64d Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=12534)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #7005: [HUDI-4982] Add Utilities and Utilities Slim + Spark Bundle testing to GH Actions
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #7005:
URL: https://github.com/apache/hudi/pull/7005#issuecomment-1289852685
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "8d571a216ccbeb61d6365785b215291fc0d1d899",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=12357",
"triggerID" : "8d571a216ccbeb61d6365785b215291fc0d1d899",
"triggerType" : "PUSH"
}, {
"hash" : "7c19a482abfae743281ebbbd51842a034159295c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=12393",
"triggerID" : "7c19a482abfae743281ebbbd51842a034159295c",
"triggerType" : "PUSH"
}, {
"hash" : "56032a44e18867e8ae21f47383ee1273d5c9c806",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "56032a44e18867e8ae21f47383ee1273d5c9c806",
"triggerType" : "PUSH"
}, {
"hash" : "5cebd12dbcd4f87c35fb39c504141f0b1147a8b2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=12399",
"triggerID" : "5cebd12dbcd4f87c35fb39c504141f0b1147a8b2",
"triggerType" : "PUSH"
}, {
"hash" : "c3c4376ccec55470031fd3c516722547cd553ee5",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "c3c4376ccec55470031fd3c516722547cd553ee5",
"triggerType" : "PUSH"
}, {
"hash" : "03ffae125238e63048a248b3cb916b1397c882b5",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "03ffae125238e63048a248b3cb916b1397c882b5",
"triggerType" : "PUSH"
}, {
"hash" : "3ad93ee2ab40eb85811b7cd82f592451eb48b432",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=12401",
"triggerID" : "3ad93ee2ab40eb85811b7cd82f592451eb48b432",
"triggerType" : "PUSH"
}, {
"hash" : "f2c11d3b0feb26fc38e3725f957e4944620394c9",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=12532",
"triggerID" : "f2c11d3b0feb26fc38e3725f957e4944620394c9",
"triggerType" : "PUSH"
}, {
"hash" : "c2111026a798413ed4e5e15b20f1fcce5d5fc64d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=12534",
"triggerID" : "c2111026a798413ed4e5e15b20f1fcce5d5fc64d",
"triggerType" : "PUSH"
}, {
"hash" : "4809c5d330fe9a62984e6a7d09f2bf4b18749a76",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "4809c5d330fe9a62984e6a7d09f2bf4b18749a76",
"triggerType" : "PUSH"
}, {
"hash" : "3e104758addc5b684a9537c67a9c1620376d07f3",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=12535",
"triggerID" : "3e104758addc5b684a9537c67a9c1620376d07f3",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 56032a44e18867e8ae21f47383ee1273d5c9c806 UNKNOWN
* c3c4376ccec55470031fd3c516722547cd553ee5 UNKNOWN
* 03ffae125238e63048a248b3cb916b1397c882b5 UNKNOWN
* 4809c5d330fe9a62984e6a7d09f2bf4b18749a76 UNKNOWN
* 3e104758addc5b684a9537c67a9c1620376d07f3 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=12535)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #7005: [HUDI-4982] Add Utilities and Utilities Slim + Spark Bundle testing to GH Actions
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #7005:
URL: https://github.com/apache/hudi/pull/7005#issuecomment-1290645386
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "8d571a216ccbeb61d6365785b215291fc0d1d899",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=12357",
"triggerID" : "8d571a216ccbeb61d6365785b215291fc0d1d899",
"triggerType" : "PUSH"
}, {
"hash" : "7c19a482abfae743281ebbbd51842a034159295c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=12393",
"triggerID" : "7c19a482abfae743281ebbbd51842a034159295c",
"triggerType" : "PUSH"
}, {
"hash" : "56032a44e18867e8ae21f47383ee1273d5c9c806",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "56032a44e18867e8ae21f47383ee1273d5c9c806",
"triggerType" : "PUSH"
}, {
"hash" : "5cebd12dbcd4f87c35fb39c504141f0b1147a8b2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=12399",
"triggerID" : "5cebd12dbcd4f87c35fb39c504141f0b1147a8b2",
"triggerType" : "PUSH"
}, {
"hash" : "c3c4376ccec55470031fd3c516722547cd553ee5",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "c3c4376ccec55470031fd3c516722547cd553ee5",
"triggerType" : "PUSH"
}, {
"hash" : "03ffae125238e63048a248b3cb916b1397c882b5",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "03ffae125238e63048a248b3cb916b1397c882b5",
"triggerType" : "PUSH"
}, {
"hash" : "3ad93ee2ab40eb85811b7cd82f592451eb48b432",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=12401",
"triggerID" : "3ad93ee2ab40eb85811b7cd82f592451eb48b432",
"triggerType" : "PUSH"
}, {
"hash" : "f2c11d3b0feb26fc38e3725f957e4944620394c9",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=12532",
"triggerID" : "f2c11d3b0feb26fc38e3725f957e4944620394c9",
"triggerType" : "PUSH"
}, {
"hash" : "c2111026a798413ed4e5e15b20f1fcce5d5fc64d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=12534",
"triggerID" : "c2111026a798413ed4e5e15b20f1fcce5d5fc64d",
"triggerType" : "PUSH"
}, {
"hash" : "4809c5d330fe9a62984e6a7d09f2bf4b18749a76",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "4809c5d330fe9a62984e6a7d09f2bf4b18749a76",
"triggerType" : "PUSH"
}, {
"hash" : "3e104758addc5b684a9537c67a9c1620376d07f3",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=12535",
"triggerID" : "3e104758addc5b684a9537c67a9c1620376d07f3",
"triggerType" : "PUSH"
}, {
"hash" : "6a797ca2ada799dafb16fd00f841b731ad8f33d6",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "6a797ca2ada799dafb16fd00f841b731ad8f33d6",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 56032a44e18867e8ae21f47383ee1273d5c9c806 UNKNOWN
* c3c4376ccec55470031fd3c516722547cd553ee5 UNKNOWN
* 03ffae125238e63048a248b3cb916b1397c882b5 UNKNOWN
* 4809c5d330fe9a62984e6a7d09f2bf4b18749a76 UNKNOWN
* 3e104758addc5b684a9537c67a9c1620376d07f3 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=12535)
* 6a797ca2ada799dafb16fd00f841b731ad8f33d6 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] jonvex commented on a diff in pull request #7005: Utilities and spark ci gh actions
Posted by GitBox <gi...@apache.org>.
jonvex commented on code in PR #7005:
URL: https://github.com/apache/hudi/pull/7005#discussion_r1000706204
##########
packaging/bundle-validation/validate.sh:
##########
@@ -0,0 +1,114 @@
+#!/bin/bash
+
+# Licensed to the Apache Software Foundation (ASF) under one
+# or more contributor license agreements. See the NOTICE file
+# distributed with this work for additional information
+# regarding copyright ownership. The ASF licenses this file
+# to you under the Apache License, Version 2.0 (the
+# "License"); you may not use this file except in compliance
+# with the License. You may obtain a copy of the License at
+#
+# http://www.apache.org/licenses/LICENSE-2.0
+#
+# Unless required by applicable law or agreed to in writing,
+# software distributed under the License is distributed on an
+# "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
+# KIND, either express or implied. See the License for the
+# specific language governing permissions and limitations
+# under the License.
+
+# NOTE: this script runs inside hudi-ci-bundle-validation container
+# $WORKDIR/jars/ is supposed to be mounted to a host directory where bundle jars are placed
+# TODO: $JAR_COMBINATIONS should have different orders for different jars to detect class loading issues
+
+WORKDIR=/opt/bundle-validation
+HIVE_DATA=${WORKDIR}/data/hive
+JAR_DATA=${WORKDIR}/data/jars
+UTILITIES_DATA=${WORKDIR}/data/utilities
+
+run_hive_sync () {
+ echo "::warning::validate.sh setting up hive sync"
+ #put config files in correct place
+ cp $HIVE_DATA/spark-defaults.conf $SPARK_HOME/conf/
+ cp $HIVE_DATA/hive-site.xml $HIVE_HOME/conf/
+ ln -sf $HIVE_HOME/conf/hive-site.xml $SPARK_HOME/conf/hive-site.xml
+ cp $DERBY_HOME/lib/derbyclient.jar $SPARK_HOME/jars/
Review Comment:
It was causing spark to try using the metastore and some strange behavior was happening. I am not sure if every one of those was causing the issue, but I just wanted to be safe.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] xushiyan merged pull request #7005: [HUDI-4982] Add Utilities and Utilities Slim + Spark Bundle testing to GH Actions
Posted by GitBox <gi...@apache.org>.
xushiyan merged PR #7005:
URL: https://github.com/apache/hudi/pull/7005
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #7005: [HUDI-4982] Add Utilities and Utilities Slim + Spark Bundle testing to GH Actions
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #7005:
URL: https://github.com/apache/hudi/pull/7005#issuecomment-1289458269
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "8d571a216ccbeb61d6365785b215291fc0d1d899",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=12357",
"triggerID" : "8d571a216ccbeb61d6365785b215291fc0d1d899",
"triggerType" : "PUSH"
}, {
"hash" : "7c19a482abfae743281ebbbd51842a034159295c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=12393",
"triggerID" : "7c19a482abfae743281ebbbd51842a034159295c",
"triggerType" : "PUSH"
}, {
"hash" : "56032a44e18867e8ae21f47383ee1273d5c9c806",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "56032a44e18867e8ae21f47383ee1273d5c9c806",
"triggerType" : "PUSH"
}, {
"hash" : "5cebd12dbcd4f87c35fb39c504141f0b1147a8b2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=12399",
"triggerID" : "5cebd12dbcd4f87c35fb39c504141f0b1147a8b2",
"triggerType" : "PUSH"
}, {
"hash" : "c3c4376ccec55470031fd3c516722547cd553ee5",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "c3c4376ccec55470031fd3c516722547cd553ee5",
"triggerType" : "PUSH"
}, {
"hash" : "03ffae125238e63048a248b3cb916b1397c882b5",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "03ffae125238e63048a248b3cb916b1397c882b5",
"triggerType" : "PUSH"
}, {
"hash" : "3ad93ee2ab40eb85811b7cd82f592451eb48b432",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=12401",
"triggerID" : "3ad93ee2ab40eb85811b7cd82f592451eb48b432",
"triggerType" : "PUSH"
}, {
"hash" : "f2c11d3b0feb26fc38e3725f957e4944620394c9",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=12532",
"triggerID" : "f2c11d3b0feb26fc38e3725f957e4944620394c9",
"triggerType" : "PUSH"
}, {
"hash" : "c2111026a798413ed4e5e15b20f1fcce5d5fc64d",
"status" : "CANCELED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=12534",
"triggerID" : "c2111026a798413ed4e5e15b20f1fcce5d5fc64d",
"triggerType" : "PUSH"
}, {
"hash" : "4809c5d330fe9a62984e6a7d09f2bf4b18749a76",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "4809c5d330fe9a62984e6a7d09f2bf4b18749a76",
"triggerType" : "PUSH"
}, {
"hash" : "3e104758addc5b684a9537c67a9c1620376d07f3",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "3e104758addc5b684a9537c67a9c1620376d07f3",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 56032a44e18867e8ae21f47383ee1273d5c9c806 UNKNOWN
* c3c4376ccec55470031fd3c516722547cd553ee5 UNKNOWN
* 03ffae125238e63048a248b3cb916b1397c882b5 UNKNOWN
* c2111026a798413ed4e5e15b20f1fcce5d5fc64d Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=12534)
* 4809c5d330fe9a62984e6a7d09f2bf4b18749a76 UNKNOWN
* 3e104758addc5b684a9537c67a9c1620376d07f3 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #7005: [HUDI-4982] Add Utilities and Utilities Slim + Spark Bundle testing to GH Actions
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #7005:
URL: https://github.com/apache/hudi/pull/7005#issuecomment-1289465330
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "8d571a216ccbeb61d6365785b215291fc0d1d899",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=12357",
"triggerID" : "8d571a216ccbeb61d6365785b215291fc0d1d899",
"triggerType" : "PUSH"
}, {
"hash" : "7c19a482abfae743281ebbbd51842a034159295c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=12393",
"triggerID" : "7c19a482abfae743281ebbbd51842a034159295c",
"triggerType" : "PUSH"
}, {
"hash" : "56032a44e18867e8ae21f47383ee1273d5c9c806",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "56032a44e18867e8ae21f47383ee1273d5c9c806",
"triggerType" : "PUSH"
}, {
"hash" : "5cebd12dbcd4f87c35fb39c504141f0b1147a8b2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=12399",
"triggerID" : "5cebd12dbcd4f87c35fb39c504141f0b1147a8b2",
"triggerType" : "PUSH"
}, {
"hash" : "c3c4376ccec55470031fd3c516722547cd553ee5",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "c3c4376ccec55470031fd3c516722547cd553ee5",
"triggerType" : "PUSH"
}, {
"hash" : "03ffae125238e63048a248b3cb916b1397c882b5",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "03ffae125238e63048a248b3cb916b1397c882b5",
"triggerType" : "PUSH"
}, {
"hash" : "3ad93ee2ab40eb85811b7cd82f592451eb48b432",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=12401",
"triggerID" : "3ad93ee2ab40eb85811b7cd82f592451eb48b432",
"triggerType" : "PUSH"
}, {
"hash" : "f2c11d3b0feb26fc38e3725f957e4944620394c9",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=12532",
"triggerID" : "f2c11d3b0feb26fc38e3725f957e4944620394c9",
"triggerType" : "PUSH"
}, {
"hash" : "c2111026a798413ed4e5e15b20f1fcce5d5fc64d",
"status" : "CANCELED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=12534",
"triggerID" : "c2111026a798413ed4e5e15b20f1fcce5d5fc64d",
"triggerType" : "PUSH"
}, {
"hash" : "4809c5d330fe9a62984e6a7d09f2bf4b18749a76",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "4809c5d330fe9a62984e6a7d09f2bf4b18749a76",
"triggerType" : "PUSH"
}, {
"hash" : "3e104758addc5b684a9537c67a9c1620376d07f3",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=12535",
"triggerID" : "3e104758addc5b684a9537c67a9c1620376d07f3",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 56032a44e18867e8ae21f47383ee1273d5c9c806 UNKNOWN
* c3c4376ccec55470031fd3c516722547cd553ee5 UNKNOWN
* 03ffae125238e63048a248b3cb916b1397c882b5 UNKNOWN
* c2111026a798413ed4e5e15b20f1fcce5d5fc64d Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=12534)
* 4809c5d330fe9a62984e6a7d09f2bf4b18749a76 UNKNOWN
* 3e104758addc5b684a9537c67a9c1620376d07f3 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=12535)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] xushiyan commented on a diff in pull request #7005: Utilities and spark ci gh actions
Posted by GitBox <gi...@apache.org>.
xushiyan commented on code in PR #7005:
URL: https://github.com/apache/hudi/pull/7005#discussion_r1001331925
##########
packaging/bundle-validation/utilities/newSchema.avsc:
##########
@@ -0,0 +1,54 @@
+{
+ "type" : "record",
+ "name" : "test_struct",
Review Comment:
the schema is here docker/demo/config/schema.avsc
##########
packaging/bundle-validation/ci_run.sh:
##########
@@ -59,7 +54,34 @@ elif [[ ${SPARK_PROFILE} == 'spark3.3' ]]; then
IMAGE_TAG=spark330hive313
fi
-cd packaging/bundle-validation/spark-write-hive-sync || exit 1
+# Copy bundle jars
+BUNDLE_VALIDATION_DIR=${GITHUB_WORKSPACE}/bundle-validation
+mkdir $BUNDLE_VALIDATION_DIR
+JARS_DIR=${BUNDLE_VALIDATION_DIR}/jars
+mkdir $JARS_DIR
+cp ${GITHUB_WORKSPACE}/packaging/hudi-spark-bundle/target/hudi-${SPARK_PROFILE}-bundle_${SCALA_PROFILE#'scala-'}-$HUDI_VERSION.jar $JARS_DIR/spark.jar
+cp ${GITHUB_WORKSPACE}/packaging/hudi-utilities-bundle/target/hudi-utilities-bundle_${SCALA_PROFILE#'scala-'}-$HUDI_VERSION.jar $JARS_DIR/utilities.jar
+cp ${GITHUB_WORKSPACE}/packaging/hudi-utilities-slim-bundle/target/hudi-utilities-slim-bundle_${SCALA_PROFILE#'scala-'}-$HUDI_VERSION.jar $JARS_DIR/utilities-slim.jar
Review Comment:
this pattern `packaging/<bundle dir>/target/hudi-*-$HUDI_VERSION.jar ` should guarantee to copy the intended jar, as long as we do `mvn clean package` which will clean jars from last build. so we can avoid some interpolation with env vars, kinda error-prone.
##########
packaging/bundle-validation/validate.sh:
##########
@@ -0,0 +1,118 @@
+#!/bin/bash
+
+# Licensed to the Apache Software Foundation (ASF) under one
+# or more contributor license agreements. See the NOTICE file
+# distributed with this work for additional information
+# regarding copyright ownership. The ASF licenses this file
+# to you under the Apache License, Version 2.0 (the
+# "License"); you may not use this file except in compliance
+# with the License. You may obtain a copy of the License at
+#
+# http://www.apache.org/licenses/LICENSE-2.0
+#
+# Unless required by applicable law or agreed to in writing,
+# software distributed under the License is distributed on an
+# "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
+# KIND, either express or implied. See the License for the
+# specific language governing permissions and limitations
+# under the License.
+
+# NOTE: this script runs inside hudi-ci-bundle-validation container
+# $WORKDIR/jars/ is supposed to be mounted to a host directory where bundle jars are placed
+# TODO: $JAR_COMBINATIONS should have different orders for different jars to detect class loading issues
+
+WORKDIR=/opt/bundle-validation
+HIVE_DATA=${WORKDIR}/data/hive
+JAR_DATA=${WORKDIR}/data/jars
+UTILITIES_DATA=${WORKDIR}/data/utilities
+
+test_spark_bundle () {
+ echo "::warning::validate.sh setting up hive sync"
+ # put config files in correct place
+ cp $HIVE_DATA/spark-defaults.conf $SPARK_HOME/conf/
+ cp $HIVE_DATA/hive-site.xml $HIVE_HOME/conf/
+ ln -sf $HIVE_HOME/conf/hive-site.xml $SPARK_HOME/conf/hive-site.xml
+ cp $DERBY_HOME/lib/derbyclient.jar $SPARK_HOME/jars/
+
+ $DERBY_HOME/bin/startNetworkServer -h 0.0.0.0 &
+ $HIVE_HOME/bin/hiveserver2 &
+ echo "::warning::validate.sh hive setup complete. Testing"
+ $SPARK_HOME/bin/spark-shell --jars $JAR_DATA/spark.jar < $HIVE_DATA/validate.scala
+ if [ "$?" -ne 0 ]; then
+ echo "::error::validate.sh failed hive testing)"
+ exit 1
+ fi
+ echo "::warning::validate.sh hive testing succesfull. Cleaning up hive sync"
+ # remove config files
+ rm -f $SPARK_HOME/jars/derbyclient.jar
+ unlink $SPARK_HOME/conf/hive-site.xml
+ rm -f $HIVE_HOME/conf/hive-site.xml
+ rm -f $SPARK_HOME/conf/spark-defaults.conf
+}
+
+test_utilities_bundle () {
+ OPT_JARS=""
+ if [[ -n $ADDITIONAL_JARS ]]; then
+ OPT_JARS="--jars $ADDITIONAL_JARS"
+ fi
+ echo "::warning::validate.sh running deltastreamer"
+ $SPARK_HOME/bin/spark-submit --driver-memory 8g --executor-memory 8g \
+ --class org.apache.hudi.utilities.deltastreamer.HoodieDeltaStreamer \
+ $OPT_JARS $MAIN_JAR \
+ --props $UTILITIES_DATA/newProps.props \
+ --schemaprovider-class org.apache.hudi.utilities.schema.FilebasedSchemaProvider \
+ --source-class org.apache.hudi.utilities.sources.JsonDFSSource \
+ --source-ordering-field ts --table-type MERGE_ON_READ \
+ --target-base-path file://${OUTPUT_DIR} \
+ --target-table utilities_tbl --op UPSERT
+ echo "::warning::validate.sh done with deltastreamer"
+
+ OUTPUT_SIZE=$(du -s ${OUTPUT_DIR} | awk '{print $1}')
+ if [[ -z $OUTPUT_SIZE || "$OUTPUT_SIZE" -lt "550" ]]; then
+ echo "::error::validate.sh deltastreamer output folder ($OUTPUT_SIZE) is smaller than expected (550) )"
+ exit 1
+ fi
+
+ echo "::warning::validate.sh validating deltastreamer in spark shell"
+ SHELL_COMMAND="$SPARK_HOME/bin/spark-shell --jars $ADDITIONAL_JARS $MAIN_JAR $SHELL_ARGS -i $COMMANDS_FILE"
+ echo "::debug::this is the shell command: $SHELL_COMMAND"
+ LOGFILE="$WORKDIR/submit.log"
+ $SHELL_COMMAND >> $LOGFILE
+ if [ "$?" -ne 0 ]; then
+ SHELL_RESULT=$(cat $LOGFILE | grep "Counts don't match")
+ echo "::error::validate.sh $SHELL_RESULT"
+ exit 1
+ fi
+ echo "::warning::validate.sh done validating deltastreamer in spark shell"
+}
+
+
+# test_spark_bundle
+# if [ "$?" -ne 0 ]; then
+# exit 1
+# fi
Review Comment:
clean up?
##########
packaging/bundle-validation/ci_run.sh:
##########
@@ -59,7 +54,34 @@ elif [[ ${SPARK_PROFILE} == 'spark3.3' ]]; then
IMAGE_TAG=spark330hive313
fi
-cd packaging/bundle-validation/spark-write-hive-sync || exit 1
+# Copy bundle jars
+BUNDLE_VALIDATION_DIR=${GITHUB_WORKSPACE}/bundle-validation
+mkdir $BUNDLE_VALIDATION_DIR
+JARS_DIR=${BUNDLE_VALIDATION_DIR}/jars
+mkdir $JARS_DIR
+cp ${GITHUB_WORKSPACE}/packaging/hudi-spark-bundle/target/hudi-${SPARK_PROFILE}-bundle_${SCALA_PROFILE#'scala-'}-$HUDI_VERSION.jar $JARS_DIR/spark.jar
+cp ${GITHUB_WORKSPACE}/packaging/hudi-utilities-bundle/target/hudi-utilities-bundle_${SCALA_PROFILE#'scala-'}-$HUDI_VERSION.jar $JARS_DIR/utilities.jar
+cp ${GITHUB_WORKSPACE}/packaging/hudi-utilities-slim-bundle/target/hudi-utilities-slim-bundle_${SCALA_PROFILE#'scala-'}-$HUDI_VERSION.jar $JARS_DIR/utilities-slim.jar
Review Comment:
it's helpful to keep the original jar artifact name while copying so we can ls dir and verify what versions are actually used. also helpful when troubleshoot. you can make symlink $JARS_DIR/spark.jar -> $JARS_DIR/<full bundle name>.jar and use fixed symlink paths for application later
##########
packaging/bundle-validation/utilities/newProps.props:
##########
@@ -0,0 +1,11 @@
+hoodie.datasource.write.recordkey.field=key
+hoodie.datasource.write.partitionpath.field=date
+hoodie.datasource.write.precombine.field=ts
+hoodie.metadata.enable=true
+hoodie.upsert.shuffle.parallelism=8
+hoodie.insert.shuffle.parallelism=8
+hoodie.delete.shuffle.parallelism=8
+hoodie.bulkinsert.shuffle.parallelism=8
+hoodie.deltastreamer.source.dfs.root=/opt/bundle-validation/data/utilities/data
+hoodie.deltastreamer.schemaprovider.target.schema.file=file:/opt/bundle-validation/data/utilities/newSchema.avsc
+hoodie.deltastreamer.schemaprovider.source.schema.file=file:/opt/bundle-validation/data/utilities/newSchema.avsc
Review Comment:
not sure what do "newSchema" and "newProps" imply.. better make the name meaningful.. e.g. stocks_schema.avsc and <name for this job>.properties ? btw `.properties` should be the right suffix
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #7005: Utilities and spark ci gh actions
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #7005:
URL: https://github.com/apache/hudi/pull/7005#issuecomment-1286117033
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "8d571a216ccbeb61d6365785b215291fc0d1d899",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=12357",
"triggerID" : "8d571a216ccbeb61d6365785b215291fc0d1d899",
"triggerType" : "PUSH"
}, {
"hash" : "7c19a482abfae743281ebbbd51842a034159295c",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=12393",
"triggerID" : "7c19a482abfae743281ebbbd51842a034159295c",
"triggerType" : "PUSH"
}, {
"hash" : "56032a44e18867e8ae21f47383ee1273d5c9c806",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "56032a44e18867e8ae21f47383ee1273d5c9c806",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 8d571a216ccbeb61d6365785b215291fc0d1d899 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=12357)
* 7c19a482abfae743281ebbbd51842a034159295c Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=12393)
* 56032a44e18867e8ae21f47383ee1273d5c9c806 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #7005: Utilities and spark ci gh actions
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #7005:
URL: https://github.com/apache/hudi/pull/7005#issuecomment-1286531691
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "8d571a216ccbeb61d6365785b215291fc0d1d899",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=12357",
"triggerID" : "8d571a216ccbeb61d6365785b215291fc0d1d899",
"triggerType" : "PUSH"
}, {
"hash" : "7c19a482abfae743281ebbbd51842a034159295c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=12393",
"triggerID" : "7c19a482abfae743281ebbbd51842a034159295c",
"triggerType" : "PUSH"
}, {
"hash" : "56032a44e18867e8ae21f47383ee1273d5c9c806",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "56032a44e18867e8ae21f47383ee1273d5c9c806",
"triggerType" : "PUSH"
}, {
"hash" : "5cebd12dbcd4f87c35fb39c504141f0b1147a8b2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=12399",
"triggerID" : "5cebd12dbcd4f87c35fb39c504141f0b1147a8b2",
"triggerType" : "PUSH"
}, {
"hash" : "c3c4376ccec55470031fd3c516722547cd553ee5",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "c3c4376ccec55470031fd3c516722547cd553ee5",
"triggerType" : "PUSH"
}, {
"hash" : "03ffae125238e63048a248b3cb916b1397c882b5",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "03ffae125238e63048a248b3cb916b1397c882b5",
"triggerType" : "PUSH"
}, {
"hash" : "3ad93ee2ab40eb85811b7cd82f592451eb48b432",
"status" : "CANCELED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=12401",
"triggerID" : "3ad93ee2ab40eb85811b7cd82f592451eb48b432",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 56032a44e18867e8ae21f47383ee1273d5c9c806 UNKNOWN
* c3c4376ccec55470031fd3c516722547cd553ee5 UNKNOWN
* 03ffae125238e63048a248b3cb916b1397c882b5 UNKNOWN
* 3ad93ee2ab40eb85811b7cd82f592451eb48b432 Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=12401)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #7005: [HUDI-4982] Add Utilities and Utilities Slim + Spark Bundle testing to GH Actions
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #7005:
URL: https://github.com/apache/hudi/pull/7005#issuecomment-1291390759
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "8d571a216ccbeb61d6365785b215291fc0d1d899",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=12357",
"triggerID" : "8d571a216ccbeb61d6365785b215291fc0d1d899",
"triggerType" : "PUSH"
}, {
"hash" : "7c19a482abfae743281ebbbd51842a034159295c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=12393",
"triggerID" : "7c19a482abfae743281ebbbd51842a034159295c",
"triggerType" : "PUSH"
}, {
"hash" : "56032a44e18867e8ae21f47383ee1273d5c9c806",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "56032a44e18867e8ae21f47383ee1273d5c9c806",
"triggerType" : "PUSH"
}, {
"hash" : "5cebd12dbcd4f87c35fb39c504141f0b1147a8b2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=12399",
"triggerID" : "5cebd12dbcd4f87c35fb39c504141f0b1147a8b2",
"triggerType" : "PUSH"
}, {
"hash" : "c3c4376ccec55470031fd3c516722547cd553ee5",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "c3c4376ccec55470031fd3c516722547cd553ee5",
"triggerType" : "PUSH"
}, {
"hash" : "03ffae125238e63048a248b3cb916b1397c882b5",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "03ffae125238e63048a248b3cb916b1397c882b5",
"triggerType" : "PUSH"
}, {
"hash" : "3ad93ee2ab40eb85811b7cd82f592451eb48b432",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=12401",
"triggerID" : "3ad93ee2ab40eb85811b7cd82f592451eb48b432",
"triggerType" : "PUSH"
}, {
"hash" : "f2c11d3b0feb26fc38e3725f957e4944620394c9",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=12532",
"triggerID" : "f2c11d3b0feb26fc38e3725f957e4944620394c9",
"triggerType" : "PUSH"
}, {
"hash" : "c2111026a798413ed4e5e15b20f1fcce5d5fc64d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=12534",
"triggerID" : "c2111026a798413ed4e5e15b20f1fcce5d5fc64d",
"triggerType" : "PUSH"
}, {
"hash" : "4809c5d330fe9a62984e6a7d09f2bf4b18749a76",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "4809c5d330fe9a62984e6a7d09f2bf4b18749a76",
"triggerType" : "PUSH"
}, {
"hash" : "3e104758addc5b684a9537c67a9c1620376d07f3",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=12535",
"triggerID" : "3e104758addc5b684a9537c67a9c1620376d07f3",
"triggerType" : "PUSH"
}, {
"hash" : "6a797ca2ada799dafb16fd00f841b731ad8f33d6",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=12569",
"triggerID" : "6a797ca2ada799dafb16fd00f841b731ad8f33d6",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 56032a44e18867e8ae21f47383ee1273d5c9c806 UNKNOWN
* c3c4376ccec55470031fd3c516722547cd553ee5 UNKNOWN
* 03ffae125238e63048a248b3cb916b1397c882b5 UNKNOWN
* 4809c5d330fe9a62984e6a7d09f2bf4b18749a76 UNKNOWN
* 6a797ca2ada799dafb16fd00f841b731ad8f33d6 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=12569)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #7005: [HUDI-4982] Add Utilities and Utilities Slim + Spark Bundle testing to GH Actions
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #7005:
URL: https://github.com/apache/hudi/pull/7005#issuecomment-1291398750
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "8d571a216ccbeb61d6365785b215291fc0d1d899",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=12357",
"triggerID" : "8d571a216ccbeb61d6365785b215291fc0d1d899",
"triggerType" : "PUSH"
}, {
"hash" : "7c19a482abfae743281ebbbd51842a034159295c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=12393",
"triggerID" : "7c19a482abfae743281ebbbd51842a034159295c",
"triggerType" : "PUSH"
}, {
"hash" : "56032a44e18867e8ae21f47383ee1273d5c9c806",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "56032a44e18867e8ae21f47383ee1273d5c9c806",
"triggerType" : "PUSH"
}, {
"hash" : "5cebd12dbcd4f87c35fb39c504141f0b1147a8b2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=12399",
"triggerID" : "5cebd12dbcd4f87c35fb39c504141f0b1147a8b2",
"triggerType" : "PUSH"
}, {
"hash" : "c3c4376ccec55470031fd3c516722547cd553ee5",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "c3c4376ccec55470031fd3c516722547cd553ee5",
"triggerType" : "PUSH"
}, {
"hash" : "03ffae125238e63048a248b3cb916b1397c882b5",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "03ffae125238e63048a248b3cb916b1397c882b5",
"triggerType" : "PUSH"
}, {
"hash" : "3ad93ee2ab40eb85811b7cd82f592451eb48b432",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=12401",
"triggerID" : "3ad93ee2ab40eb85811b7cd82f592451eb48b432",
"triggerType" : "PUSH"
}, {
"hash" : "f2c11d3b0feb26fc38e3725f957e4944620394c9",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=12532",
"triggerID" : "f2c11d3b0feb26fc38e3725f957e4944620394c9",
"triggerType" : "PUSH"
}, {
"hash" : "c2111026a798413ed4e5e15b20f1fcce5d5fc64d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=12534",
"triggerID" : "c2111026a798413ed4e5e15b20f1fcce5d5fc64d",
"triggerType" : "PUSH"
}, {
"hash" : "4809c5d330fe9a62984e6a7d09f2bf4b18749a76",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "4809c5d330fe9a62984e6a7d09f2bf4b18749a76",
"triggerType" : "PUSH"
}, {
"hash" : "3e104758addc5b684a9537c67a9c1620376d07f3",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=12535",
"triggerID" : "3e104758addc5b684a9537c67a9c1620376d07f3",
"triggerType" : "PUSH"
}, {
"hash" : "6a797ca2ada799dafb16fd00f841b731ad8f33d6",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=12569",
"triggerID" : "6a797ca2ada799dafb16fd00f841b731ad8f33d6",
"triggerType" : "PUSH"
}, {
"hash" : "4025ed772285911d89c5a0c6bac6a425c33e0217",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=12575",
"triggerID" : "4025ed772285911d89c5a0c6bac6a425c33e0217",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 56032a44e18867e8ae21f47383ee1273d5c9c806 UNKNOWN
* c3c4376ccec55470031fd3c516722547cd553ee5 UNKNOWN
* 03ffae125238e63048a248b3cb916b1397c882b5 UNKNOWN
* 4809c5d330fe9a62984e6a7d09f2bf4b18749a76 UNKNOWN
* 6a797ca2ada799dafb16fd00f841b731ad8f33d6 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=12569)
* 4025ed772285911d89c5a0c6bac6a425c33e0217 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=12575)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #7005: Utilities and spark ci gh actions
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #7005:
URL: https://github.com/apache/hudi/pull/7005#issuecomment-1286206453
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "8d571a216ccbeb61d6365785b215291fc0d1d899",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=12357",
"triggerID" : "8d571a216ccbeb61d6365785b215291fc0d1d899",
"triggerType" : "PUSH"
}, {
"hash" : "7c19a482abfae743281ebbbd51842a034159295c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=12393",
"triggerID" : "7c19a482abfae743281ebbbd51842a034159295c",
"triggerType" : "PUSH"
}, {
"hash" : "56032a44e18867e8ae21f47383ee1273d5c9c806",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "56032a44e18867e8ae21f47383ee1273d5c9c806",
"triggerType" : "PUSH"
}, {
"hash" : "5cebd12dbcd4f87c35fb39c504141f0b1147a8b2",
"status" : "CANCELED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=12399",
"triggerID" : "5cebd12dbcd4f87c35fb39c504141f0b1147a8b2",
"triggerType" : "PUSH"
}, {
"hash" : "c3c4376ccec55470031fd3c516722547cd553ee5",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "c3c4376ccec55470031fd3c516722547cd553ee5",
"triggerType" : "PUSH"
}, {
"hash" : "03ffae125238e63048a248b3cb916b1397c882b5",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "03ffae125238e63048a248b3cb916b1397c882b5",
"triggerType" : "PUSH"
}, {
"hash" : "3ad93ee2ab40eb85811b7cd82f592451eb48b432",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=12401",
"triggerID" : "3ad93ee2ab40eb85811b7cd82f592451eb48b432",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 56032a44e18867e8ae21f47383ee1273d5c9c806 UNKNOWN
* 5cebd12dbcd4f87c35fb39c504141f0b1147a8b2 Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=12399)
* c3c4376ccec55470031fd3c516722547cd553ee5 UNKNOWN
* 03ffae125238e63048a248b3cb916b1397c882b5 UNKNOWN
* 3ad93ee2ab40eb85811b7cd82f592451eb48b432 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=12401)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #7005: Utilities and spark ci gh actions
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #7005:
URL: https://github.com/apache/hudi/pull/7005#issuecomment-1286201505
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "8d571a216ccbeb61d6365785b215291fc0d1d899",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=12357",
"triggerID" : "8d571a216ccbeb61d6365785b215291fc0d1d899",
"triggerType" : "PUSH"
}, {
"hash" : "7c19a482abfae743281ebbbd51842a034159295c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=12393",
"triggerID" : "7c19a482abfae743281ebbbd51842a034159295c",
"triggerType" : "PUSH"
}, {
"hash" : "56032a44e18867e8ae21f47383ee1273d5c9c806",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "56032a44e18867e8ae21f47383ee1273d5c9c806",
"triggerType" : "PUSH"
}, {
"hash" : "5cebd12dbcd4f87c35fb39c504141f0b1147a8b2",
"status" : "CANCELED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=12399",
"triggerID" : "5cebd12dbcd4f87c35fb39c504141f0b1147a8b2",
"triggerType" : "PUSH"
}, {
"hash" : "c3c4376ccec55470031fd3c516722547cd553ee5",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "c3c4376ccec55470031fd3c516722547cd553ee5",
"triggerType" : "PUSH"
}, {
"hash" : "03ffae125238e63048a248b3cb916b1397c882b5",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "03ffae125238e63048a248b3cb916b1397c882b5",
"triggerType" : "PUSH"
}, {
"hash" : "3ad93ee2ab40eb85811b7cd82f592451eb48b432",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "3ad93ee2ab40eb85811b7cd82f592451eb48b432",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 56032a44e18867e8ae21f47383ee1273d5c9c806 UNKNOWN
* 5cebd12dbcd4f87c35fb39c504141f0b1147a8b2 Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=12399)
* c3c4376ccec55470031fd3c516722547cd553ee5 UNKNOWN
* 03ffae125238e63048a248b3cb916b1397c882b5 UNKNOWN
* 3ad93ee2ab40eb85811b7cd82f592451eb48b432 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #7005: [HUDI-4982] Add Utilities and Utilities Slim + Spark Bundle testing to GH Actions
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #7005:
URL: https://github.com/apache/hudi/pull/7005#issuecomment-1290653988
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "8d571a216ccbeb61d6365785b215291fc0d1d899",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=12357",
"triggerID" : "8d571a216ccbeb61d6365785b215291fc0d1d899",
"triggerType" : "PUSH"
}, {
"hash" : "7c19a482abfae743281ebbbd51842a034159295c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=12393",
"triggerID" : "7c19a482abfae743281ebbbd51842a034159295c",
"triggerType" : "PUSH"
}, {
"hash" : "56032a44e18867e8ae21f47383ee1273d5c9c806",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "56032a44e18867e8ae21f47383ee1273d5c9c806",
"triggerType" : "PUSH"
}, {
"hash" : "5cebd12dbcd4f87c35fb39c504141f0b1147a8b2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=12399",
"triggerID" : "5cebd12dbcd4f87c35fb39c504141f0b1147a8b2",
"triggerType" : "PUSH"
}, {
"hash" : "c3c4376ccec55470031fd3c516722547cd553ee5",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "c3c4376ccec55470031fd3c516722547cd553ee5",
"triggerType" : "PUSH"
}, {
"hash" : "03ffae125238e63048a248b3cb916b1397c882b5",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "03ffae125238e63048a248b3cb916b1397c882b5",
"triggerType" : "PUSH"
}, {
"hash" : "3ad93ee2ab40eb85811b7cd82f592451eb48b432",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=12401",
"triggerID" : "3ad93ee2ab40eb85811b7cd82f592451eb48b432",
"triggerType" : "PUSH"
}, {
"hash" : "f2c11d3b0feb26fc38e3725f957e4944620394c9",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=12532",
"triggerID" : "f2c11d3b0feb26fc38e3725f957e4944620394c9",
"triggerType" : "PUSH"
}, {
"hash" : "c2111026a798413ed4e5e15b20f1fcce5d5fc64d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=12534",
"triggerID" : "c2111026a798413ed4e5e15b20f1fcce5d5fc64d",
"triggerType" : "PUSH"
}, {
"hash" : "4809c5d330fe9a62984e6a7d09f2bf4b18749a76",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "4809c5d330fe9a62984e6a7d09f2bf4b18749a76",
"triggerType" : "PUSH"
}, {
"hash" : "3e104758addc5b684a9537c67a9c1620376d07f3",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=12535",
"triggerID" : "3e104758addc5b684a9537c67a9c1620376d07f3",
"triggerType" : "PUSH"
}, {
"hash" : "6a797ca2ada799dafb16fd00f841b731ad8f33d6",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=12569",
"triggerID" : "6a797ca2ada799dafb16fd00f841b731ad8f33d6",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 56032a44e18867e8ae21f47383ee1273d5c9c806 UNKNOWN
* c3c4376ccec55470031fd3c516722547cd553ee5 UNKNOWN
* 03ffae125238e63048a248b3cb916b1397c882b5 UNKNOWN
* 4809c5d330fe9a62984e6a7d09f2bf4b18749a76 UNKNOWN
* 3e104758addc5b684a9537c67a9c1620376d07f3 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=12535)
* 6a797ca2ada799dafb16fd00f841b731ad8f33d6 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=12569)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #7005: Utilities and spark ci gh actions
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #7005:
URL: https://github.com/apache/hudi/pull/7005#issuecomment-1289281131
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "8d571a216ccbeb61d6365785b215291fc0d1d899",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=12357",
"triggerID" : "8d571a216ccbeb61d6365785b215291fc0d1d899",
"triggerType" : "PUSH"
}, {
"hash" : "7c19a482abfae743281ebbbd51842a034159295c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=12393",
"triggerID" : "7c19a482abfae743281ebbbd51842a034159295c",
"triggerType" : "PUSH"
}, {
"hash" : "56032a44e18867e8ae21f47383ee1273d5c9c806",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "56032a44e18867e8ae21f47383ee1273d5c9c806",
"triggerType" : "PUSH"
}, {
"hash" : "5cebd12dbcd4f87c35fb39c504141f0b1147a8b2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=12399",
"triggerID" : "5cebd12dbcd4f87c35fb39c504141f0b1147a8b2",
"triggerType" : "PUSH"
}, {
"hash" : "c3c4376ccec55470031fd3c516722547cd553ee5",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "c3c4376ccec55470031fd3c516722547cd553ee5",
"triggerType" : "PUSH"
}, {
"hash" : "03ffae125238e63048a248b3cb916b1397c882b5",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "03ffae125238e63048a248b3cb916b1397c882b5",
"triggerType" : "PUSH"
}, {
"hash" : "3ad93ee2ab40eb85811b7cd82f592451eb48b432",
"status" : "CANCELED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=12401",
"triggerID" : "3ad93ee2ab40eb85811b7cd82f592451eb48b432",
"triggerType" : "PUSH"
}, {
"hash" : "f2c11d3b0feb26fc38e3725f957e4944620394c9",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "f2c11d3b0feb26fc38e3725f957e4944620394c9",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 56032a44e18867e8ae21f47383ee1273d5c9c806 UNKNOWN
* c3c4376ccec55470031fd3c516722547cd553ee5 UNKNOWN
* 03ffae125238e63048a248b3cb916b1397c882b5 UNKNOWN
* 3ad93ee2ab40eb85811b7cd82f592451eb48b432 Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=12401)
* f2c11d3b0feb26fc38e3725f957e4944620394c9 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #7005: Utilities and spark ci gh actions
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #7005:
URL: https://github.com/apache/hudi/pull/7005#issuecomment-1289388973
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "8d571a216ccbeb61d6365785b215291fc0d1d899",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=12357",
"triggerID" : "8d571a216ccbeb61d6365785b215291fc0d1d899",
"triggerType" : "PUSH"
}, {
"hash" : "7c19a482abfae743281ebbbd51842a034159295c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=12393",
"triggerID" : "7c19a482abfae743281ebbbd51842a034159295c",
"triggerType" : "PUSH"
}, {
"hash" : "56032a44e18867e8ae21f47383ee1273d5c9c806",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "56032a44e18867e8ae21f47383ee1273d5c9c806",
"triggerType" : "PUSH"
}, {
"hash" : "5cebd12dbcd4f87c35fb39c504141f0b1147a8b2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=12399",
"triggerID" : "5cebd12dbcd4f87c35fb39c504141f0b1147a8b2",
"triggerType" : "PUSH"
}, {
"hash" : "c3c4376ccec55470031fd3c516722547cd553ee5",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "c3c4376ccec55470031fd3c516722547cd553ee5",
"triggerType" : "PUSH"
}, {
"hash" : "03ffae125238e63048a248b3cb916b1397c882b5",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "03ffae125238e63048a248b3cb916b1397c882b5",
"triggerType" : "PUSH"
}, {
"hash" : "3ad93ee2ab40eb85811b7cd82f592451eb48b432",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=12401",
"triggerID" : "3ad93ee2ab40eb85811b7cd82f592451eb48b432",
"triggerType" : "PUSH"
}, {
"hash" : "f2c11d3b0feb26fc38e3725f957e4944620394c9",
"status" : "CANCELED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=12532",
"triggerID" : "f2c11d3b0feb26fc38e3725f957e4944620394c9",
"triggerType" : "PUSH"
}, {
"hash" : "c2111026a798413ed4e5e15b20f1fcce5d5fc64d",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=12534",
"triggerID" : "c2111026a798413ed4e5e15b20f1fcce5d5fc64d",
"triggerType" : "PUSH"
}, {
"hash" : "4809c5d330fe9a62984e6a7d09f2bf4b18749a76",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "4809c5d330fe9a62984e6a7d09f2bf4b18749a76",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 56032a44e18867e8ae21f47383ee1273d5c9c806 UNKNOWN
* c3c4376ccec55470031fd3c516722547cd553ee5 UNKNOWN
* 03ffae125238e63048a248b3cb916b1397c882b5 UNKNOWN
* f2c11d3b0feb26fc38e3725f957e4944620394c9 Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=12532)
* c2111026a798413ed4e5e15b20f1fcce5d5fc64d Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=12534)
* 4809c5d330fe9a62984e6a7d09f2bf4b18749a76 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #7005: Utilities and spark ci gh actions
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #7005:
URL: https://github.com/apache/hudi/pull/7005#issuecomment-1286124731
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "8d571a216ccbeb61d6365785b215291fc0d1d899",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=12357",
"triggerID" : "8d571a216ccbeb61d6365785b215291fc0d1d899",
"triggerType" : "PUSH"
}, {
"hash" : "7c19a482abfae743281ebbbd51842a034159295c",
"status" : "CANCELED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=12393",
"triggerID" : "7c19a482abfae743281ebbbd51842a034159295c",
"triggerType" : "PUSH"
}, {
"hash" : "56032a44e18867e8ae21f47383ee1273d5c9c806",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "56032a44e18867e8ae21f47383ee1273d5c9c806",
"triggerType" : "PUSH"
}, {
"hash" : "5cebd12dbcd4f87c35fb39c504141f0b1147a8b2",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "5cebd12dbcd4f87c35fb39c504141f0b1147a8b2",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 7c19a482abfae743281ebbbd51842a034159295c Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=12393)
* 56032a44e18867e8ae21f47383ee1273d5c9c806 UNKNOWN
* 5cebd12dbcd4f87c35fb39c504141f0b1147a8b2 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] nsivabalan commented on pull request #7005: Utilities and spark ci gh actions
Posted by GitBox <gi...@apache.org>.
nsivabalan commented on PR #7005:
URL: https://github.com/apache/hudi/pull/7005#issuecomment-1286408416
if its ready for review, please add the jira link.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #7005: Utilities and spark ci gh actions
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #7005:
URL: https://github.com/apache/hudi/pull/7005#issuecomment-1289369094
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "8d571a216ccbeb61d6365785b215291fc0d1d899",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=12357",
"triggerID" : "8d571a216ccbeb61d6365785b215291fc0d1d899",
"triggerType" : "PUSH"
}, {
"hash" : "7c19a482abfae743281ebbbd51842a034159295c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=12393",
"triggerID" : "7c19a482abfae743281ebbbd51842a034159295c",
"triggerType" : "PUSH"
}, {
"hash" : "56032a44e18867e8ae21f47383ee1273d5c9c806",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "56032a44e18867e8ae21f47383ee1273d5c9c806",
"triggerType" : "PUSH"
}, {
"hash" : "5cebd12dbcd4f87c35fb39c504141f0b1147a8b2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=12399",
"triggerID" : "5cebd12dbcd4f87c35fb39c504141f0b1147a8b2",
"triggerType" : "PUSH"
}, {
"hash" : "c3c4376ccec55470031fd3c516722547cd553ee5",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "c3c4376ccec55470031fd3c516722547cd553ee5",
"triggerType" : "PUSH"
}, {
"hash" : "03ffae125238e63048a248b3cb916b1397c882b5",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "03ffae125238e63048a248b3cb916b1397c882b5",
"triggerType" : "PUSH"
}, {
"hash" : "3ad93ee2ab40eb85811b7cd82f592451eb48b432",
"status" : "CANCELED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=12401",
"triggerID" : "3ad93ee2ab40eb85811b7cd82f592451eb48b432",
"triggerType" : "PUSH"
}, {
"hash" : "f2c11d3b0feb26fc38e3725f957e4944620394c9",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=12532",
"triggerID" : "f2c11d3b0feb26fc38e3725f957e4944620394c9",
"triggerType" : "PUSH"
}, {
"hash" : "c2111026a798413ed4e5e15b20f1fcce5d5fc64d",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "c2111026a798413ed4e5e15b20f1fcce5d5fc64d",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 56032a44e18867e8ae21f47383ee1273d5c9c806 UNKNOWN
* c3c4376ccec55470031fd3c516722547cd553ee5 UNKNOWN
* 03ffae125238e63048a248b3cb916b1397c882b5 UNKNOWN
* 3ad93ee2ab40eb85811b7cd82f592451eb48b432 Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=12401)
* f2c11d3b0feb26fc38e3725f957e4944620394c9 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=12532)
* c2111026a798413ed4e5e15b20f1fcce5d5fc64d UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #7005: [HUDI-4982] Add Utilities and Utilities Slim + Spark Bundle testing to GH Actions
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #7005:
URL: https://github.com/apache/hudi/pull/7005#issuecomment-1291488367
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "8d571a216ccbeb61d6365785b215291fc0d1d899",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=12357",
"triggerID" : "8d571a216ccbeb61d6365785b215291fc0d1d899",
"triggerType" : "PUSH"
}, {
"hash" : "7c19a482abfae743281ebbbd51842a034159295c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=12393",
"triggerID" : "7c19a482abfae743281ebbbd51842a034159295c",
"triggerType" : "PUSH"
}, {
"hash" : "56032a44e18867e8ae21f47383ee1273d5c9c806",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "56032a44e18867e8ae21f47383ee1273d5c9c806",
"triggerType" : "PUSH"
}, {
"hash" : "5cebd12dbcd4f87c35fb39c504141f0b1147a8b2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=12399",
"triggerID" : "5cebd12dbcd4f87c35fb39c504141f0b1147a8b2",
"triggerType" : "PUSH"
}, {
"hash" : "c3c4376ccec55470031fd3c516722547cd553ee5",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "c3c4376ccec55470031fd3c516722547cd553ee5",
"triggerType" : "PUSH"
}, {
"hash" : "03ffae125238e63048a248b3cb916b1397c882b5",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "03ffae125238e63048a248b3cb916b1397c882b5",
"triggerType" : "PUSH"
}, {
"hash" : "3ad93ee2ab40eb85811b7cd82f592451eb48b432",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=12401",
"triggerID" : "3ad93ee2ab40eb85811b7cd82f592451eb48b432",
"triggerType" : "PUSH"
}, {
"hash" : "f2c11d3b0feb26fc38e3725f957e4944620394c9",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=12532",
"triggerID" : "f2c11d3b0feb26fc38e3725f957e4944620394c9",
"triggerType" : "PUSH"
}, {
"hash" : "c2111026a798413ed4e5e15b20f1fcce5d5fc64d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=12534",
"triggerID" : "c2111026a798413ed4e5e15b20f1fcce5d5fc64d",
"triggerType" : "PUSH"
}, {
"hash" : "4809c5d330fe9a62984e6a7d09f2bf4b18749a76",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "4809c5d330fe9a62984e6a7d09f2bf4b18749a76",
"triggerType" : "PUSH"
}, {
"hash" : "3e104758addc5b684a9537c67a9c1620376d07f3",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=12535",
"triggerID" : "3e104758addc5b684a9537c67a9c1620376d07f3",
"triggerType" : "PUSH"
}, {
"hash" : "6a797ca2ada799dafb16fd00f841b731ad8f33d6",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=12569",
"triggerID" : "6a797ca2ada799dafb16fd00f841b731ad8f33d6",
"triggerType" : "PUSH"
}, {
"hash" : "4025ed772285911d89c5a0c6bac6a425c33e0217",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=12575",
"triggerID" : "4025ed772285911d89c5a0c6bac6a425c33e0217",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 56032a44e18867e8ae21f47383ee1273d5c9c806 UNKNOWN
* c3c4376ccec55470031fd3c516722547cd553ee5 UNKNOWN
* 03ffae125238e63048a248b3cb916b1397c882b5 UNKNOWN
* 4809c5d330fe9a62984e6a7d09f2bf4b18749a76 UNKNOWN
* 4025ed772285911d89c5a0c6bac6a425c33e0217 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=12575)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] xushiyan commented on a diff in pull request #7005: [HUDI-4982] Add Utilities and Utilities Slim + Spark Bundle testing to GH Actions
Posted by GitBox <gi...@apache.org>.
xushiyan commented on code in PR #7005:
URL: https://github.com/apache/hudi/pull/7005#discussion_r1004549785
##########
packaging/bundle-validation/Dockerfile:
##########
@@ -47,5 +47,18 @@ RUN wget https://archive.apache.org/dist/spark/spark-$SPARK_VERSION/spark-$SPARK
&& tar -xf $WORKDIR/spark-$SPARK_VERSION-bin-hadoop$SPARK_HADOOP_VERSION.tgz -C $WORKDIR/ \
&& rm $WORKDIR/spark-$SPARK_VERSION-bin-hadoop$SPARK_HADOOP_VERSION.tgz
ENV SPARK_HOME=$WORKDIR/spark-$SPARK_VERSION-bin-hadoop$SPARK_HADOOP_VERSION
-COPY validate.sh .
+# TODO: the commands above can be moved to base images
Review Comment:
@jonvex let's also start using base images in this PR. the image building is taking >20min mostly just downloading. we need to have different image tags to use directly for different build profiles.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #7005: [HUDI-4982] Add Utilities and Utilities Slim + Spark Bundle testing to GH Actions
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #7005:
URL: https://github.com/apache/hudi/pull/7005#issuecomment-1291395206
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "8d571a216ccbeb61d6365785b215291fc0d1d899",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=12357",
"triggerID" : "8d571a216ccbeb61d6365785b215291fc0d1d899",
"triggerType" : "PUSH"
}, {
"hash" : "7c19a482abfae743281ebbbd51842a034159295c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=12393",
"triggerID" : "7c19a482abfae743281ebbbd51842a034159295c",
"triggerType" : "PUSH"
}, {
"hash" : "56032a44e18867e8ae21f47383ee1273d5c9c806",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "56032a44e18867e8ae21f47383ee1273d5c9c806",
"triggerType" : "PUSH"
}, {
"hash" : "5cebd12dbcd4f87c35fb39c504141f0b1147a8b2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=12399",
"triggerID" : "5cebd12dbcd4f87c35fb39c504141f0b1147a8b2",
"triggerType" : "PUSH"
}, {
"hash" : "c3c4376ccec55470031fd3c516722547cd553ee5",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "c3c4376ccec55470031fd3c516722547cd553ee5",
"triggerType" : "PUSH"
}, {
"hash" : "03ffae125238e63048a248b3cb916b1397c882b5",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "03ffae125238e63048a248b3cb916b1397c882b5",
"triggerType" : "PUSH"
}, {
"hash" : "3ad93ee2ab40eb85811b7cd82f592451eb48b432",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=12401",
"triggerID" : "3ad93ee2ab40eb85811b7cd82f592451eb48b432",
"triggerType" : "PUSH"
}, {
"hash" : "f2c11d3b0feb26fc38e3725f957e4944620394c9",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=12532",
"triggerID" : "f2c11d3b0feb26fc38e3725f957e4944620394c9",
"triggerType" : "PUSH"
}, {
"hash" : "c2111026a798413ed4e5e15b20f1fcce5d5fc64d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=12534",
"triggerID" : "c2111026a798413ed4e5e15b20f1fcce5d5fc64d",
"triggerType" : "PUSH"
}, {
"hash" : "4809c5d330fe9a62984e6a7d09f2bf4b18749a76",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "4809c5d330fe9a62984e6a7d09f2bf4b18749a76",
"triggerType" : "PUSH"
}, {
"hash" : "3e104758addc5b684a9537c67a9c1620376d07f3",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=12535",
"triggerID" : "3e104758addc5b684a9537c67a9c1620376d07f3",
"triggerType" : "PUSH"
}, {
"hash" : "6a797ca2ada799dafb16fd00f841b731ad8f33d6",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=12569",
"triggerID" : "6a797ca2ada799dafb16fd00f841b731ad8f33d6",
"triggerType" : "PUSH"
}, {
"hash" : "4025ed772285911d89c5a0c6bac6a425c33e0217",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "4025ed772285911d89c5a0c6bac6a425c33e0217",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 56032a44e18867e8ae21f47383ee1273d5c9c806 UNKNOWN
* c3c4376ccec55470031fd3c516722547cd553ee5 UNKNOWN
* 03ffae125238e63048a248b3cb916b1397c882b5 UNKNOWN
* 4809c5d330fe9a62984e6a7d09f2bf4b18749a76 UNKNOWN
* 6a797ca2ada799dafb16fd00f841b731ad8f33d6 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=12569)
* 4025ed772285911d89c5a0c6bac6a425c33e0217 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #7005: Utilities and spark ci gh actions
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #7005:
URL: https://github.com/apache/hudi/pull/7005#issuecomment-1285755006
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "8d571a216ccbeb61d6365785b215291fc0d1d899",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=12357",
"triggerID" : "8d571a216ccbeb61d6365785b215291fc0d1d899",
"triggerType" : "PUSH"
}, {
"hash" : "7c19a482abfae743281ebbbd51842a034159295c",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=12393",
"triggerID" : "7c19a482abfae743281ebbbd51842a034159295c",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 8d571a216ccbeb61d6365785b215291fc0d1d899 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=12357)
* 7c19a482abfae743281ebbbd51842a034159295c Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=12393)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #7005: Utilities and spark ci gh actions
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #7005:
URL: https://github.com/apache/hudi/pull/7005#issuecomment-1284595934
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "8d571a216ccbeb61d6365785b215291fc0d1d899",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=12357",
"triggerID" : "8d571a216ccbeb61d6365785b215291fc0d1d899",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 8d571a216ccbeb61d6365785b215291fc0d1d899 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=12357)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #7005: Utilities and spark ci gh actions
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #7005:
URL: https://github.com/apache/hudi/pull/7005#issuecomment-1284591411
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "8d571a216ccbeb61d6365785b215291fc0d1d899",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "8d571a216ccbeb61d6365785b215291fc0d1d899",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 8d571a216ccbeb61d6365785b215291fc0d1d899 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #7005: Utilities and spark ci gh actions
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #7005:
URL: https://github.com/apache/hudi/pull/7005#issuecomment-1285745525
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "8d571a216ccbeb61d6365785b215291fc0d1d899",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=12357",
"triggerID" : "8d571a216ccbeb61d6365785b215291fc0d1d899",
"triggerType" : "PUSH"
}, {
"hash" : "7c19a482abfae743281ebbbd51842a034159295c",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "7c19a482abfae743281ebbbd51842a034159295c",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 8d571a216ccbeb61d6365785b215291fc0d1d899 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=12357)
* 7c19a482abfae743281ebbbd51842a034159295c UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #7005: Utilities and spark ci gh actions
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #7005:
URL: https://github.com/apache/hudi/pull/7005#issuecomment-1286131599
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "8d571a216ccbeb61d6365785b215291fc0d1d899",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=12357",
"triggerID" : "8d571a216ccbeb61d6365785b215291fc0d1d899",
"triggerType" : "PUSH"
}, {
"hash" : "7c19a482abfae743281ebbbd51842a034159295c",
"status" : "CANCELED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=12393",
"triggerID" : "7c19a482abfae743281ebbbd51842a034159295c",
"triggerType" : "PUSH"
}, {
"hash" : "56032a44e18867e8ae21f47383ee1273d5c9c806",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "56032a44e18867e8ae21f47383ee1273d5c9c806",
"triggerType" : "PUSH"
}, {
"hash" : "5cebd12dbcd4f87c35fb39c504141f0b1147a8b2",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=12399",
"triggerID" : "5cebd12dbcd4f87c35fb39c504141f0b1147a8b2",
"triggerType" : "PUSH"
}, {
"hash" : "c3c4376ccec55470031fd3c516722547cd553ee5",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "c3c4376ccec55470031fd3c516722547cd553ee5",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 7c19a482abfae743281ebbbd51842a034159295c Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=12393)
* 56032a44e18867e8ae21f47383ee1273d5c9c806 UNKNOWN
* 5cebd12dbcd4f87c35fb39c504141f0b1147a8b2 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=12399)
* c3c4376ccec55470031fd3c516722547cd553ee5 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #7005: Utilities and spark ci gh actions
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #7005:
URL: https://github.com/apache/hudi/pull/7005#issuecomment-1286137583
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "8d571a216ccbeb61d6365785b215291fc0d1d899",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=12357",
"triggerID" : "8d571a216ccbeb61d6365785b215291fc0d1d899",
"triggerType" : "PUSH"
}, {
"hash" : "7c19a482abfae743281ebbbd51842a034159295c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=12393",
"triggerID" : "7c19a482abfae743281ebbbd51842a034159295c",
"triggerType" : "PUSH"
}, {
"hash" : "56032a44e18867e8ae21f47383ee1273d5c9c806",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "56032a44e18867e8ae21f47383ee1273d5c9c806",
"triggerType" : "PUSH"
}, {
"hash" : "5cebd12dbcd4f87c35fb39c504141f0b1147a8b2",
"status" : "CANCELED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=12399",
"triggerID" : "5cebd12dbcd4f87c35fb39c504141f0b1147a8b2",
"triggerType" : "PUSH"
}, {
"hash" : "c3c4376ccec55470031fd3c516722547cd553ee5",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "c3c4376ccec55470031fd3c516722547cd553ee5",
"triggerType" : "PUSH"
}, {
"hash" : "03ffae125238e63048a248b3cb916b1397c882b5",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "03ffae125238e63048a248b3cb916b1397c882b5",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 56032a44e18867e8ae21f47383ee1273d5c9c806 UNKNOWN
* 5cebd12dbcd4f87c35fb39c504141f0b1147a8b2 Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=12399)
* c3c4376ccec55470031fd3c516722547cd553ee5 UNKNOWN
* 03ffae125238e63048a248b3cb916b1397c882b5 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #7005: Utilities and spark ci gh actions
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #7005:
URL: https://github.com/apache/hudi/pull/7005#issuecomment-1284931557
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "8d571a216ccbeb61d6365785b215291fc0d1d899",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=12357",
"triggerID" : "8d571a216ccbeb61d6365785b215291fc0d1d899",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 8d571a216ccbeb61d6365785b215291fc0d1d899 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=12357)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #7005: Utilities and spark ci gh actions
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #7005:
URL: https://github.com/apache/hudi/pull/7005#issuecomment-1289288317
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "8d571a216ccbeb61d6365785b215291fc0d1d899",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=12357",
"triggerID" : "8d571a216ccbeb61d6365785b215291fc0d1d899",
"triggerType" : "PUSH"
}, {
"hash" : "7c19a482abfae743281ebbbd51842a034159295c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=12393",
"triggerID" : "7c19a482abfae743281ebbbd51842a034159295c",
"triggerType" : "PUSH"
}, {
"hash" : "56032a44e18867e8ae21f47383ee1273d5c9c806",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "56032a44e18867e8ae21f47383ee1273d5c9c806",
"triggerType" : "PUSH"
}, {
"hash" : "5cebd12dbcd4f87c35fb39c504141f0b1147a8b2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=12399",
"triggerID" : "5cebd12dbcd4f87c35fb39c504141f0b1147a8b2",
"triggerType" : "PUSH"
}, {
"hash" : "c3c4376ccec55470031fd3c516722547cd553ee5",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "c3c4376ccec55470031fd3c516722547cd553ee5",
"triggerType" : "PUSH"
}, {
"hash" : "03ffae125238e63048a248b3cb916b1397c882b5",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "03ffae125238e63048a248b3cb916b1397c882b5",
"triggerType" : "PUSH"
}, {
"hash" : "3ad93ee2ab40eb85811b7cd82f592451eb48b432",
"status" : "CANCELED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=12401",
"triggerID" : "3ad93ee2ab40eb85811b7cd82f592451eb48b432",
"triggerType" : "PUSH"
}, {
"hash" : "f2c11d3b0feb26fc38e3725f957e4944620394c9",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=12532",
"triggerID" : "f2c11d3b0feb26fc38e3725f957e4944620394c9",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 56032a44e18867e8ae21f47383ee1273d5c9c806 UNKNOWN
* c3c4376ccec55470031fd3c516722547cd553ee5 UNKNOWN
* 03ffae125238e63048a248b3cb916b1397c882b5 UNKNOWN
* 3ad93ee2ab40eb85811b7cd82f592451eb48b432 Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=12401)
* f2c11d3b0feb26fc38e3725f957e4944620394c9 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=12532)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org