You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@spark.apache.org by do...@apache.org on 2025/09/15 15:43:34 UTC
(spark) branch branch-4.0 updated: [SPARK-53539][INFRA][4.0] Add `libwebp-dev` to recover `spark-rm/Dockerfile` building
This is an automated email from the ASF dual-hosted git repository.
dongjoon pushed a commit to branch branch-4.0
in repository https://gitbox.apache.org/repos/asf/spark.git
The following commit(s) were added to refs/heads/branch-4.0 by this push:
new 6f9733e4a838 [SPARK-53539][INFRA][4.0] Add `libwebp-dev` to recover `spark-rm/Dockerfile` building
6f9733e4a838 is described below
commit 6f9733e4a8387349e7d0456fbe40b5bb5293a6f7
Author: Dongjoon Hyun <do...@apache.org>
AuthorDate: Mon Sep 15 08:43:22 2025 -0700
[SPARK-53539][INFRA][4.0] Add `libwebp-dev` to recover `spark-rm/Dockerfile` building
### What changes were proposed in this pull request?
This PR aims to add `libwebp-dev` to recover `spark-rm/Dockerfile` building.
### Why are the changes needed?
`Apache Spark` release docker image compilation has been broken for last 7 days due to the SparkR package compilation.
- https://github.com/apache/spark/actions/workflows/release.yml
- https://github.com/apache/spark/actions/runs/17425825244
```
#11 559.4 No package 'libwebpmux' found
...
#11 559.4 -------------------------- [ERROR MESSAGE] ---------------------------
#11 559.4 <stdin>:1:10: fatal error: ft2build.h: No such file or directory
#11 559.4 compilation terminated.
#11 559.4 --------------------------------------------------------------------
#11 559.4 ERROR: configuration failed for package 'ragg'
```
### Does this PR introduce _any_ user-facing change?
No, this is a fix for Apache Spark release tool.
### How was this patch tested?
Manually build.
```
$ cd dev/create-release/spark-rm
$ docker build .
```
**BEFORE**
```
...
Dockerfile:83
--------------------
82 | # See more in SPARK-39959, roxygen2 < 7.2.1
83 | >>> RUN Rscript -e "install.packages(c('devtools', 'knitr', 'markdown', \
84 | >>> 'rmarkdown', 'testthat', 'devtools', 'e1071', 'survival', 'arrow', \
85 | >>> 'ggplot2', 'mvtnorm', 'statmod', 'xml2'), repos='https://cloud.r-project.org/')" && \
86 | >>> Rscript -e "devtools::install_version('roxygen2', version='7.2.0', repos='https://cloud.r-project.org')" && \
87 | >>> Rscript -e "devtools::install_version('lintr', version='2.0.1', repos='https://cloud.r-project.org')" && \
88 | >>> Rscript -e "devtools::install_version('pkgdown', version='2.0.1', repos='https://cloud.r-project.org')" && \
89 | >>> Rscript -e "devtools::install_version('preferably', version='0.4', repos='https://cloud.r-project.org')"
90 |
--------------------
ERROR: failed to build: failed to solve:
```
**AFTER**
```
...
=> [ 6/22] RUN add-apt-repository 'deb https://cloud.r-project.org/bin/linux/ubuntu jammy-cran40/' 3.8s
=> [ 7/22] RUN Rscript -e "install.packages(c('devtools', 'knitr', 'markdown', 'rmarkdown', 'testthat', 'devtools', 'e1071', 'survival', 'arrow', 892.2s
=> [ 8/22] RUN add-apt-repository ppa:pypy/ppa 15.3s
...
```
After merging this PR, we can validate via the daily release dry-run CI.
- https://github.com/apache/spark/actions/workflows/release.yml
### Was this patch authored or co-authored using generative AI tooling?
No.
Closes #52339 from peter-toth/SPARK-53539-4.0.
Authored-by: Dongjoon Hyun <do...@apache.org>
Signed-off-by: Dongjoon Hyun <do...@apache.org>
---
dev/create-release/spark-rm/Dockerfile | 1 +
1 file changed, 1 insertion(+)
diff --git a/dev/create-release/spark-rm/Dockerfile b/dev/create-release/spark-rm/Dockerfile
index b070aad1c52f..399136c959eb 100644
--- a/dev/create-release/spark-rm/Dockerfile
+++ b/dev/create-release/spark-rm/Dockerfile
@@ -49,6 +49,7 @@ RUN apt-get update && apt-get install -y \
libpython3-dev \
libssl-dev \
libtiff5-dev \
+ libwebp-dev \
libxml2-dev \
msmtp \
nodejs \
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@spark.apache.org
For additional commands, e-mail: commits-help@spark.apache.org