You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hudi.apache.org by "yihua (via GitHub)" <gi...@apache.org> on 2025/12/15 21:44:39 UTC
[PR] chore: Add scripts and docs for Docker image used in Azure CI [hudi]
yihua opened a new pull request, #17602:
URL: https://github.com/apache/hudi/pull/17602
### Describe the issue this Pull Request addresses
There are two problems:
- The Docker image used for Azure CI only has JDK 8;
- The scripts and docs are missing for building the image.
### Summary and Changelog
This PR adds the scripts and docs for Docker image used in Azure CI. All Java versions, 8, 11, and 17, are supported.
### Impact
Unblocks Java 11 as default.
### Risk Level
none
### Documentation Update
none
### Contributor's checklist
- [ ] Read through [contributor's guide](https://hudi.apache.org/contribute/how-to-contribute)
- [ ] Enough context is provided in the sections above
- [ ] Adequate tests were added if applicable
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] chore: Add scripts and docs for Docker image used in Azure CI [hudi]
Posted by "yihua (via GitHub)" <gi...@apache.org>.
yihua commented on PR #17602:
URL: https://github.com/apache/hudi/pull/17602#issuecomment-3677096656
@the-other-tim-brown given that #17637 works with the new Java 11 image, should we merge this PR too?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] chore: Add scripts and docs for Docker image used in Azure CI [hudi]
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #17602:
URL: https://github.com/apache/hudi/pull/17602#issuecomment-3658509875
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "d0aa884b85efb7244a16993676c7ac3cc34fddbd",
"status" : "PENDING",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=10259",
"triggerID" : "d0aa884b85efb7244a16993676c7ac3cc34fddbd",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* d0aa884b85efb7244a16993676c7ac3cc34fddbd Azure: [PENDING](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=10259)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] chore: Add scripts and docs for Docker image used in Azure CI [hudi]
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #17602:
URL: https://github.com/apache/hudi/pull/17602#issuecomment-3657838031
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "2e2793d085b88ac95e5400130cb8caba4380bc07",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=10255",
"triggerID" : "2e2793d085b88ac95e5400130cb8caba4380bc07",
"triggerType" : "PUSH"
}, {
"hash" : "3befa94c90183058888e2a426c9a26a7bb21df00",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "3befa94c90183058888e2a426c9a26a7bb21df00",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 2e2793d085b88ac95e5400130cb8caba4380bc07 Azure: [FAILURE](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=10255)
* 3befa94c90183058888e2a426c9a26a7bb21df00 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] chore: Add scripts and docs for Docker image used in Azure CI [hudi]
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #17602:
URL: https://github.com/apache/hudi/pull/17602#issuecomment-3657739019
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "2e2793d085b88ac95e5400130cb8caba4380bc07",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "2e2793d085b88ac95e5400130cb8caba4380bc07",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 2e2793d085b88ac95e5400130cb8caba4380bc07 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] chore: Add scripts and docs for Docker image used in Azure CI [hudi]
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #17602:
URL: https://github.com/apache/hudi/pull/17602#issuecomment-3658636381
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "d0aa884b85efb7244a16993676c7ac3cc34fddbd",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=10259",
"triggerID" : "d0aa884b85efb7244a16993676c7ac3cc34fddbd",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* d0aa884b85efb7244a16993676c7ac3cc34fddbd Azure: [FAILURE](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=10259)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] chore: Add scripts and docs for Docker image used in Azure CI [hudi]
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #17602:
URL: https://github.com/apache/hudi/pull/17602#issuecomment-3657896369
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "2e2793d085b88ac95e5400130cb8caba4380bc07",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=10255",
"triggerID" : "2e2793d085b88ac95e5400130cb8caba4380bc07",
"triggerType" : "PUSH"
}, {
"hash" : "3befa94c90183058888e2a426c9a26a7bb21df00",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "3befa94c90183058888e2a426c9a26a7bb21df00",
"triggerType" : "PUSH"
}, {
"hash" : "d0aa884b85efb7244a16993676c7ac3cc34fddbd",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "d0aa884b85efb7244a16993676c7ac3cc34fddbd",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 2e2793d085b88ac95e5400130cb8caba4380bc07 Azure: [FAILURE](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=10255)
* 3befa94c90183058888e2a426c9a26a7bb21df00 UNKNOWN
* d0aa884b85efb7244a16993676c7ac3cc34fddbd UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] chore: Add scripts and docs for Docker image used in Azure CI [hudi]
Posted by "yihua (via GitHub)" <gi...@apache.org>.
yihua commented on code in PR #17602:
URL: https://github.com/apache/hudi/pull/17602#discussion_r2621207970
##########
packaging/bundle-validation/azure/Dockerfile:
##########
@@ -0,0 +1,57 @@
+# Licensed to the Apache Software Foundation (ASF) under one
+# or more contributor license agreements. See the NOTICE file
+# distributed with this work for additional information
+# regarding copyright ownership. The ASF licenses this file
+# to you under the Apache License, Version 2.0 (the
+# "License"); you may not use this file except in compliance
+# with the License. You may obtain a copy of the License at
+#
+# http://www.apache.org/licenses/LICENSE-2.0
+#
+# Unless required by applicable law or agreed to in writing,
+# software distributed under the License is distributed on an
+# "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
+# KIND, either express or implied. See the License for the
+# specific language governing permissions and limitations
+# under the License.
+FROM --platform=linux/amd64 adoptopenjdk/openjdk8:alpine
Review Comment:
This is for current Java 8 build on master, otherwise Azure CI will fail.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] chore: Add scripts and docs for Docker image used in Azure CI [hudi]
Posted by "the-other-tim-brown (via GitHub)" <gi...@apache.org>.
the-other-tim-brown commented on code in PR #17602:
URL: https://github.com/apache/hudi/pull/17602#discussion_r2621209920
##########
packaging/bundle-validation/azure/Dockerfile:
##########
@@ -0,0 +1,57 @@
+# Licensed to the Apache Software Foundation (ASF) under one
+# or more contributor license agreements. See the NOTICE file
+# distributed with this work for additional information
+# regarding copyright ownership. The ASF licenses this file
+# to you under the Apache License, Version 2.0 (the
+# "License"); you may not use this file except in compliance
+# with the License. You may obtain a copy of the License at
+#
+# http://www.apache.org/licenses/LICENSE-2.0
+#
+# Unless required by applicable law or agreed to in writing,
+# software distributed under the License is distributed on an
+# "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
+# KIND, either express or implied. See the License for the
+# specific language governing permissions and limitations
+# under the License.
+FROM --platform=linux/amd64 adoptopenjdk/openjdk8:alpine
Review Comment:
This isn't run as part of CI though right? It is a process that is run elsewhere?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] chore: Add scripts and docs for Docker image used in Azure CI [hudi]
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #17602:
URL: https://github.com/apache/hudi/pull/17602#issuecomment-3661984676
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "d0aa884b85efb7244a16993676c7ac3cc34fddbd",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=10259",
"triggerID" : "d0aa884b85efb7244a16993676c7ac3cc34fddbd",
"triggerType" : "PUSH"
}, {
"hash" : "e07ceb5540cde51bf058f2b6a45e20cbd3f702ed",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "e07ceb5540cde51bf058f2b6a45e20cbd3f702ed",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* d0aa884b85efb7244a16993676c7ac3cc34fddbd Azure: [FAILURE](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=10259)
* e07ceb5540cde51bf058f2b6a45e20cbd3f702ed UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] chore: Add scripts and docs for Docker image used in Azure CI [hudi]
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #17602:
URL: https://github.com/apache/hudi/pull/17602#issuecomment-3662202391
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "d0aa884b85efb7244a16993676c7ac3cc34fddbd",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=10259",
"triggerID" : "d0aa884b85efb7244a16993676c7ac3cc34fddbd",
"triggerType" : "PUSH"
}, {
"hash" : "e07ceb5540cde51bf058f2b6a45e20cbd3f702ed",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=10294",
"triggerID" : "e07ceb5540cde51bf058f2b6a45e20cbd3f702ed",
"triggerType" : "PUSH"
}, {
"hash" : "cc330bc269f9447a5bc9f860e6d2dccc5589333f",
"status" : "PENDING",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=10300",
"triggerID" : "cc330bc269f9447a5bc9f860e6d2dccc5589333f",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* e07ceb5540cde51bf058f2b6a45e20cbd3f702ed Azure: [FAILURE](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=10294)
* cc330bc269f9447a5bc9f860e6d2dccc5589333f Azure: [PENDING](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=10300)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] chore: Add scripts and docs for Docker image used in Azure CI [hudi]
Posted by "yihua (via GitHub)" <gi...@apache.org>.
yihua commented on code in PR #17602:
URL: https://github.com/apache/hudi/pull/17602#discussion_r2621217235
##########
packaging/bundle-validation/azure/Dockerfile:
##########
@@ -0,0 +1,57 @@
+# Licensed to the Apache Software Foundation (ASF) under one
+# or more contributor license agreements. See the NOTICE file
+# distributed with this work for additional information
+# regarding copyright ownership. The ASF licenses this file
+# to you under the Apache License, Version 2.0 (the
+# "License"); you may not use this file except in compliance
+# with the License. You may obtain a copy of the License at
+#
+# http://www.apache.org/licenses/LICENSE-2.0
+#
+# Unless required by applicable law or agreed to in writing,
+# software distributed under the License is distributed on an
+# "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
+# KIND, either express or implied. See the License for the
+# specific language governing permissions and limitations
+# under the License.
+FROM --platform=linux/amd64 adoptopenjdk/openjdk8:alpine
Review Comment:
The image generated from this `Dockerfile` is used by the 7th (`UT Hudi Streamer & FT utilities`) and 10th job (`UT FT common & other modules`) in Azure CI to build the branch from a PR.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] chore: Add scripts and docs for Docker image used in Azure CI [hudi]
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #17602:
URL: https://github.com/apache/hudi/pull/17602#issuecomment-3657744354
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "2e2793d085b88ac95e5400130cb8caba4380bc07",
"status" : "PENDING",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=10255",
"triggerID" : "2e2793d085b88ac95e5400130cb8caba4380bc07",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 2e2793d085b88ac95e5400130cb8caba4380bc07 Azure: [PENDING](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=10255)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] chore: Add scripts and docs for Docker image used in Azure CI [hudi]
Posted by "the-other-tim-brown (via GitHub)" <gi...@apache.org>.
the-other-tim-brown commented on code in PR #17602:
URL: https://github.com/apache/hudi/pull/17602#discussion_r2621178809
##########
packaging/bundle-validation/azure/Dockerfile:
##########
@@ -0,0 +1,57 @@
+# Licensed to the Apache Software Foundation (ASF) under one
+# or more contributor license agreements. See the NOTICE file
+# distributed with this work for additional information
+# regarding copyright ownership. The ASF licenses this file
+# to you under the Apache License, Version 2.0 (the
+# "License"); you may not use this file except in compliance
+# with the License. You may obtain a copy of the License at
+#
+# http://www.apache.org/licenses/LICENSE-2.0
+#
+# Unless required by applicable law or agreed to in writing,
+# software distributed under the License is distributed on an
+# "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
+# KIND, either express or implied. See the License for the
+# specific language governing permissions and limitations
+# under the License.
+FROM --platform=linux/amd64 adoptopenjdk/openjdk8:alpine
Review Comment:
Why do we need java 8 here?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] chore: Add scripts and docs for Docker image used in Azure CI [hudi]
Posted by "yihua (via GitHub)" <gi...@apache.org>.
yihua commented on code in PR #17602:
URL: https://github.com/apache/hudi/pull/17602#discussion_r2628451226
##########
packaging/bundle-validation/azure/Dockerfile:
##########
@@ -0,0 +1,57 @@
+# Licensed to the Apache Software Foundation (ASF) under one
+# or more contributor license agreements. See the NOTICE file
+# distributed with this work for additional information
+# regarding copyright ownership. The ASF licenses this file
+# to you under the Apache License, Version 2.0 (the
+# "License"); you may not use this file except in compliance
+# with the License. You may obtain a copy of the License at
+#
+# http://www.apache.org/licenses/LICENSE-2.0
+#
+# Unless required by applicable law or agreed to in writing,
+# software distributed under the License is distributed on an
+# "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
+# KIND, either express or implied. See the License for the
+# specific language governing permissions and limitations
+# under the License.
+FROM --platform=linux/amd64 adoptopenjdk/openjdk8:alpine
Review Comment:
Java 8 is removed in the latest commit.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] chore: Add scripts and docs for Docker image used in Azure CI [hudi]
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #17602:
URL: https://github.com/apache/hudi/pull/17602#issuecomment-3658503912
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "d0aa884b85efb7244a16993676c7ac3cc34fddbd",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "d0aa884b85efb7244a16993676c7ac3cc34fddbd",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* d0aa884b85efb7244a16993676c7ac3cc34fddbd UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] chore: Add scripts and docs for Docker image used in Azure CI [hudi]
Posted by "the-other-tim-brown (via GitHub)" <gi...@apache.org>.
the-other-tim-brown commented on code in PR #17602:
URL: https://github.com/apache/hudi/pull/17602#discussion_r2621222993
##########
packaging/bundle-validation/azure/Dockerfile:
##########
@@ -0,0 +1,57 @@
+# Licensed to the Apache Software Foundation (ASF) under one
+# or more contributor license agreements. See the NOTICE file
+# distributed with this work for additional information
+# regarding copyright ownership. The ASF licenses this file
+# to you under the Apache License, Version 2.0 (the
+# "License"); you may not use this file except in compliance
+# with the License. You may obtain a copy of the License at
+#
+# http://www.apache.org/licenses/LICENSE-2.0
+#
+# Unless required by applicable law or agreed to in writing,
+# software distributed under the License is distributed on an
+# "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
+# KIND, either express or implied. See the License for the
+# specific language governing permissions and limitations
+# under the License.
+FROM --platform=linux/amd64 adoptopenjdk/openjdk8:alpine
Review Comment:
Are we building this image per run or once and uploading it?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] chore: Add scripts and docs for Docker image used in Azure CI [hudi]
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #17602:
URL: https://github.com/apache/hudi/pull/17602#issuecomment-3661990582
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "d0aa884b85efb7244a16993676c7ac3cc34fddbd",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=10259",
"triggerID" : "d0aa884b85efb7244a16993676c7ac3cc34fddbd",
"triggerType" : "PUSH"
}, {
"hash" : "e07ceb5540cde51bf058f2b6a45e20cbd3f702ed",
"status" : "PENDING",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=10294",
"triggerID" : "e07ceb5540cde51bf058f2b6a45e20cbd3f702ed",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* d0aa884b85efb7244a16993676c7ac3cc34fddbd Azure: [FAILURE](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=10259)
* e07ceb5540cde51bf058f2b6a45e20cbd3f702ed Azure: [PENDING](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=10294)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] chore: Add scripts and docs for Docker image used in Azure CI [hudi]
Posted by "yihua (via GitHub)" <gi...@apache.org>.
yihua merged PR #17602:
URL: https://github.com/apache/hudi/pull/17602
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] chore: Add scripts and docs for Docker image used in Azure CI [hudi]
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #17602:
URL: https://github.com/apache/hudi/pull/17602#issuecomment-3662076078
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "d0aa884b85efb7244a16993676c7ac3cc34fddbd",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=10259",
"triggerID" : "d0aa884b85efb7244a16993676c7ac3cc34fddbd",
"triggerType" : "PUSH"
}, {
"hash" : "e07ceb5540cde51bf058f2b6a45e20cbd3f702ed",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=10294",
"triggerID" : "e07ceb5540cde51bf058f2b6a45e20cbd3f702ed",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* e07ceb5540cde51bf058f2b6a45e20cbd3f702ed Azure: [FAILURE](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=10294)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] chore: Add scripts and docs for Docker image used in Azure CI [hudi]
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #17602:
URL: https://github.com/apache/hudi/pull/17602#issuecomment-3662196266
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "d0aa884b85efb7244a16993676c7ac3cc34fddbd",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=10259",
"triggerID" : "d0aa884b85efb7244a16993676c7ac3cc34fddbd",
"triggerType" : "PUSH"
}, {
"hash" : "e07ceb5540cde51bf058f2b6a45e20cbd3f702ed",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=10294",
"triggerID" : "e07ceb5540cde51bf058f2b6a45e20cbd3f702ed",
"triggerType" : "PUSH"
}, {
"hash" : "cc330bc269f9447a5bc9f860e6d2dccc5589333f",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "cc330bc269f9447a5bc9f860e6d2dccc5589333f",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* e07ceb5540cde51bf058f2b6a45e20cbd3f702ed Azure: [FAILURE](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=10294)
* cc330bc269f9447a5bc9f860e6d2dccc5589333f UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] chore: Add scripts and docs for Docker image used in Azure CI [hudi]
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #17602:
URL: https://github.com/apache/hudi/pull/17602#issuecomment-3657758358
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "2e2793d085b88ac95e5400130cb8caba4380bc07",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=10255",
"triggerID" : "2e2793d085b88ac95e5400130cb8caba4380bc07",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 2e2793d085b88ac95e5400130cb8caba4380bc07 Azure: [FAILURE](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=10255)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] chore: Add scripts and docs for Docker image used in Azure CI [hudi]
Posted by "yihua (via GitHub)" <gi...@apache.org>.
yihua commented on code in PR #17602:
URL: https://github.com/apache/hudi/pull/17602#discussion_r2621228125
##########
packaging/bundle-validation/azure/Dockerfile:
##########
@@ -0,0 +1,57 @@
+# Licensed to the Apache Software Foundation (ASF) under one
+# or more contributor license agreements. See the NOTICE file
+# distributed with this work for additional information
+# regarding copyright ownership. The ASF licenses this file
+# to you under the Apache License, Version 2.0 (the
+# "License"); you may not use this file except in compliance
+# with the License. You may obtain a copy of the License at
+#
+# http://www.apache.org/licenses/LICENSE-2.0
+#
+# Unless required by applicable law or agreed to in writing,
+# software distributed under the License is distributed on an
+# "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
+# KIND, either express or implied. See the License for the
+# specific language governing permissions and limitations
+# under the License.
+FROM --platform=linux/amd64 adoptopenjdk/openjdk8:alpine
Review Comment:
It's built once locally and uploaded to docker hub. I've done that from my side. Every Azure CI run uses the `Dockerfile` at the root folder to pull the image.
`azure-pipelines-20230430.yml`:
```
- job: UT_FT_10
displayName: UT FT common & other modules
timeoutInMinutes: '90'
steps:
- task: Docker@2
displayName: "login to docker hub"
inputs:
command: "login"
containerRegistry: "apachehudi-docker-hub"
- task: Docker@2
displayName: "load repo into image"
inputs:
containerRegistry: 'apachehudi-docker-hub'
repository: 'apachehudi/hudi-ci-bundle-validation-base'
command: 'build'
Dockerfile: '**/Dockerfile'
ImageName: $(Build.BuildId)
```
`Dockerfile`:
```
FROM apachehudi/hudi-ci-bundle-validation-base:azure_ci_test_base_v2
CMD ["java", "-version"]
# Set the working directory to /app
WORKDIR /hudi
# Copy git repo into the working directory
COPY . /hudi
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] chore: Add scripts and docs for Docker image used in Azure CI [hudi]
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #17602:
URL: https://github.com/apache/hudi/pull/17602#issuecomment-3662589513
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "d0aa884b85efb7244a16993676c7ac3cc34fddbd",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=10259",
"triggerID" : "d0aa884b85efb7244a16993676c7ac3cc34fddbd",
"triggerType" : "PUSH"
}, {
"hash" : "e07ceb5540cde51bf058f2b6a45e20cbd3f702ed",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=10294",
"triggerID" : "e07ceb5540cde51bf058f2b6a45e20cbd3f702ed",
"triggerType" : "PUSH"
}, {
"hash" : "cc330bc269f9447a5bc9f860e6d2dccc5589333f",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=10300",
"triggerID" : "cc330bc269f9447a5bc9f860e6d2dccc5589333f",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* cc330bc269f9447a5bc9f860e6d2dccc5589333f Azure: [SUCCESS](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=10300)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] chore: Add scripts and docs for Docker image used in Azure CI [hudi]
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #17602:
URL: https://github.com/apache/hudi/pull/17602#issuecomment-3657901529
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "2e2793d085b88ac95e5400130cb8caba4380bc07",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=10255",
"triggerID" : "2e2793d085b88ac95e5400130cb8caba4380bc07",
"triggerType" : "PUSH"
}, {
"hash" : "3befa94c90183058888e2a426c9a26a7bb21df00",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "3befa94c90183058888e2a426c9a26a7bb21df00",
"triggerType" : "PUSH"
}, {
"hash" : "d0aa884b85efb7244a16993676c7ac3cc34fddbd",
"status" : "PENDING",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=10259",
"triggerID" : "d0aa884b85efb7244a16993676c7ac3cc34fddbd",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 2e2793d085b88ac95e5400130cb8caba4380bc07 Azure: [FAILURE](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=10255)
* 3befa94c90183058888e2a426c9a26a7bb21df00 UNKNOWN
* d0aa884b85efb7244a16993676c7ac3cc34fddbd Azure: [PENDING](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=10259)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] chore: Add scripts and docs for Docker image used in Azure CI [hudi]
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #17602:
URL: https://github.com/apache/hudi/pull/17602#issuecomment-3658048482
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "2e2793d085b88ac95e5400130cb8caba4380bc07",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=10255",
"triggerID" : "2e2793d085b88ac95e5400130cb8caba4380bc07",
"triggerType" : "PUSH"
}, {
"hash" : "3befa94c90183058888e2a426c9a26a7bb21df00",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "3befa94c90183058888e2a426c9a26a7bb21df00",
"triggerType" : "PUSH"
}, {
"hash" : "d0aa884b85efb7244a16993676c7ac3cc34fddbd",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=10259",
"triggerID" : "d0aa884b85efb7244a16993676c7ac3cc34fddbd",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 3befa94c90183058888e2a426c9a26a7bb21df00 UNKNOWN
* d0aa884b85efb7244a16993676c7ac3cc34fddbd Azure: [FAILURE](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=10259)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org