You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@spark.apache.org by do...@apache.org on 2023/01/04 06:05:26 UTC
[spark] branch branch-3.2 updated (576ca6e43c3 -> 0f5e231923b)
This is an automated email from the ASF dual-hosted git repository.
dongjoon pushed a change to branch branch-3.2
in repository https://gitbox.apache.org/repos/asf/spark.git
from 576ca6e43c3 Revert "[SPARK-36939][PYTHON][DOCS] Add orphan migration page into list in PySpark documentation"
new b8978fecea4 [SPARK-38261][INFRA] Add missing R packages from base image
new 706cecdc028 [SPARK-39596][INFRA] Install `ggplot2` for GitHub Action linter job
new 0f5e231923b [SPARK-39596][INFRA][FOLLOWUP] Install `mvtnorm` and `statmod` at linter job
The 3 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails. The revisions
listed as "add" were already present in the repository and have only
been added to this reference.
Summary of changes:
.github/workflows/build_and_test.yml | 2 +-
1 file changed, 1 insertion(+), 1 deletion(-)
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@spark.apache.org
For additional commands, e-mail: commits-help@spark.apache.org
[spark] 02/03: [SPARK-39596][INFRA] Install `ggplot2` for GitHub Action linter job
Posted by do...@apache.org.
This is an automated email from the ASF dual-hosted git repository.
dongjoon pushed a commit to branch branch-3.2
in repository https://gitbox.apache.org/repos/asf/spark.git
commit 706cecdc02833e2ea8f2137383cd0ff1222e8f44
Author: Dongjoon Hyun <do...@apache.org>
AuthorDate: Sat Jun 25 00:31:54 2022 -0700
[SPARK-39596][INFRA] Install `ggplot2` for GitHub Action linter job
### What changes were proposed in this pull request?
This PR aims to fix GitHub Action linter job by installing `ggplot2`.
### Why are the changes needed?
It starts to fail like the following.
- https://github.com/apache/spark/runs/7047294196?check_suite_focus=true
```
x Failed to parse Rd in histogram.Rd
ℹ there is no package called ‘ggplot2’
```
### Does this PR introduce _any_ user-facing change?
No. This is a dev-only change.
### How was this patch tested?
Pass the GitHub Action linter job.
Closes #36987 from dongjoon-hyun/SPARK-39596.
Authored-by: Dongjoon Hyun <do...@apache.org>
Signed-off-by: Dongjoon Hyun <do...@apache.org>
(cherry picked from commit bf59f6e4bd7f34f8a36bfef1e93e0ddccddf9e43)
Signed-off-by: Dongjoon Hyun <do...@apache.org>
---
.github/workflows/build_and_test.yml | 1 +
1 file changed, 1 insertion(+)
diff --git a/.github/workflows/build_and_test.yml b/.github/workflows/build_and_test.yml
index 2d2e96fdee8..7639fea7e79 100644
--- a/.github/workflows/build_and_test.yml
+++ b/.github/workflows/build_and_test.yml
@@ -385,6 +385,7 @@ jobs:
libtiff5-dev libjpeg-dev
Rscript -e "install.packages(c('devtools'), repos='https://cloud.r-project.org/')"
Rscript -e "devtools::install_version('lintr', version='2.0.1', repos='https://cloud.r-project.org')"
+ Rscript -e "install.packages(c('ggplot2'), repos='https://cloud.r-project.org/')"
./R/install-dev.sh
- name: Instll JavaScript linter dependencies
run: |
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@spark.apache.org
For additional commands, e-mail: commits-help@spark.apache.org
[spark] 01/03: [SPARK-38261][INFRA] Add missing R packages from base image
Posted by do...@apache.org.
This is an automated email from the ASF dual-hosted git repository.
dongjoon pushed a commit to branch branch-3.2
in repository https://gitbox.apache.org/repos/asf/spark.git
commit b8978fecea4580300c51be748a6afb99fb352974
Author: khalidmammadov <xm...@hotmail.com>
AuthorDate: Mon Feb 21 11:04:48 2022 +0900
[SPARK-38261][INFRA] Add missing R packages from base image
Current GitHub workflow job **Linters, licenses, dependencies and documentation generation** is missing R packages to complete Documentation and API build.
**Build and test** - is not failing as these packages are installed on the base image.
We need to keep them in-sync IMO with the base image for easy switch back to ubuntu runner when ready.
Reference: [**The base image**](https://hub.docker.com/layers/dongjoon/apache-spark-github-action-image/20220207/images/sha256-af09d172ff8e2cbd71df9a1bc5384a47578c4a4cc293786c539333cafaf4a7ce?context=explore)
Adding missing packages to the workflow file
To make them inline with the base image config and make the job task **complete** for standalone execution (i.e. without this image)
No
GitHub builds and in the local Docker containers
Closes #35583 from khalidmammadov/sync_doc_build_with_base.
Authored-by: khalidmammadov <xm...@hotmail.com>
Signed-off-by: Hyukjin Kwon <gu...@apache.org>
(cherry picked from commit 898542746b2c56b2571562ed8e9818bcb565aff2)
Signed-off-by: Dongjoon Hyun <do...@apache.org>
---
.github/workflows/build_and_test.yml | 2 +-
1 file changed, 1 insertion(+), 1 deletion(-)
diff --git a/.github/workflows/build_and_test.yml b/.github/workflows/build_and_test.yml
index 4d8e6db73e0..2d2e96fdee8 100644
--- a/.github/workflows/build_and_test.yml
+++ b/.github/workflows/build_and_test.yml
@@ -406,7 +406,7 @@ jobs:
python3.9 -m pip install 'docutils<0.18.0' # See SPARK-39421
apt-get update -y
apt-get install -y ruby ruby-dev
- Rscript -e "install.packages(c('devtools', 'testthat', 'knitr', 'rmarkdown', 'roxygen2'), repos='https://cloud.r-project.org/')"
+ Rscript -e "install.packages(c('devtools', 'testthat', 'knitr', 'rmarkdown', 'markdown', 'e1071', 'roxygen2'), repos='https://cloud.r-project.org/')"
gem install bundler
cd docs
bundle install
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@spark.apache.org
For additional commands, e-mail: commits-help@spark.apache.org
[spark] 03/03: [SPARK-39596][INFRA][FOLLOWUP] Install `mvtnorm` and `statmod` at linter job
Posted by do...@apache.org.
This is an automated email from the ASF dual-hosted git repository.
dongjoon pushed a commit to branch branch-3.2
in repository https://gitbox.apache.org/repos/asf/spark.git
commit 0f5e231923b77d39239acef80b654834834e9b29
Author: Dongjoon Hyun <do...@apache.org>
AuthorDate: Sat Jun 25 20:37:53 2022 +0900
[SPARK-39596][INFRA][FOLLOWUP] Install `mvtnorm` and `statmod` at linter job
Closes #36988 from dongjoon-hyun/SPARK-39596-2.
Authored-by: Dongjoon Hyun <do...@apache.org>
Signed-off-by: Hyukjin Kwon <gu...@apache.org>
(cherry picked from commit 4c79cc7d5f0d818e479565f5d623e168d777ba0a)
Signed-off-by: Dongjoon Hyun <do...@apache.org>
---
.github/workflows/build_and_test.yml | 3 +--
1 file changed, 1 insertion(+), 2 deletions(-)
diff --git a/.github/workflows/build_and_test.yml b/.github/workflows/build_and_test.yml
index 7639fea7e79..4a4840995a1 100644
--- a/.github/workflows/build_and_test.yml
+++ b/.github/workflows/build_and_test.yml
@@ -385,7 +385,6 @@ jobs:
libtiff5-dev libjpeg-dev
Rscript -e "install.packages(c('devtools'), repos='https://cloud.r-project.org/')"
Rscript -e "devtools::install_version('lintr', version='2.0.1', repos='https://cloud.r-project.org')"
- Rscript -e "install.packages(c('ggplot2'), repos='https://cloud.r-project.org/')"
./R/install-dev.sh
- name: Instll JavaScript linter dependencies
run: |
@@ -407,7 +406,7 @@ jobs:
python3.9 -m pip install 'docutils<0.18.0' # See SPARK-39421
apt-get update -y
apt-get install -y ruby ruby-dev
- Rscript -e "install.packages(c('devtools', 'testthat', 'knitr', 'rmarkdown', 'markdown', 'e1071', 'roxygen2'), repos='https://cloud.r-project.org/')"
+ Rscript -e "install.packages(c('devtools', 'testthat', 'knitr', 'rmarkdown', 'markdown', 'e1071', 'roxygen2', 'ggplot2', 'mvtnorm', 'statmod'), repos='https://cloud.r-project.org/')"
gem install bundler
cd docs
bundle install
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@spark.apache.org
For additional commands, e-mail: commits-help@spark.apache.org