You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@arrow.apache.org by ko...@apache.org on 2019/08/15 22:08:44 UTC
[arrow] branch master updated: ARROW-6170: [R] Faster
docker-compose build
This is an automated email from the ASF dual-hosted git repository.
kou pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/arrow.git
The following commit(s) were added to refs/heads/master by this push:
new ea91067 ARROW-6170: [R] Faster docker-compose build
ea91067 is described below
commit ea9106798993c9b54127c1a6f1b13a6aa394f9de
Author: Antoine Pitrou <an...@python.org>
AuthorDate: Fri Aug 16 07:08:24 2019 +0900
ARROW-6170: [R] Faster docker-compose build
Use parallel package compilation and installation.
Closes #5039 from pitrou/ARROW-6170-faster-build-r and squashes the following commits:
5ef5f06df <Antoine Pitrou> Hopefully appease lint thing
c40eca821 <Antoine Pitrou> ARROW-6170: Faster docker-compose build
Authored-by: Antoine Pitrou <an...@python.org>
Signed-off-by: Sutou Kouhei <ko...@clear-code.com>
---
.dockerignore | 3 +++
r/Dockerfile | 11 ++++++++---
2 files changed, 11 insertions(+), 3 deletions(-)
diff --git a/.dockerignore b/.dockerignore
index 16bdebb..64e3890 100644
--- a/.dockerignore
+++ b/.dockerignore
@@ -38,6 +38,9 @@ cpp/.idea
cpp/build
cpp/*-build
cpp/*_build
+cpp/build-debug
+cpp/build-release
+cpp/build-test
cpp/Testing
cpp/thirdparty
!cpp/thirdparty/jemalloc
diff --git a/r/Dockerfile b/r/Dockerfile
index a43ac20..01262bf 100644
--- a/r/Dockerfile
+++ b/r/Dockerfile
@@ -60,9 +60,14 @@ ENV ARROW_R_DEV=TRUE
ENV PKG_CONFIG_PATH=${PKG_CONFIG_PATH}:/build/cpp/src/arrow:/opt/conda/lib/pkgconfig
ENV LD_LIBRARY_PATH=/opt/conda/lib/:/build/cpp/src/arrow:/arrow/r/src
-RUN Rscript -e "install.packages('devtools', repos = 'http://cran.rstudio.com')" && \
- Rscript -e "devtools::install_github('romainfrancois/decor')" && \
- Rscript -e "install.packages(c( \
+# Ensure parallel R package installation
+RUN printf "options(Ncpus = parallel::detectCores())\n" >> /etc/R/Rprofile.site
+# Also ensure parallel compilation of each individual package
+RUN printf "MAKEFLAGS=-j8\n" >> /usr/lib/R/etc/Makeconf
+
+RUN Rscript -e "install.packages('devtools', repos = 'http://cran.rstudio.com')"
+RUN Rscript -e "devtools::install_github('romainfrancois/decor')"
+RUN Rscript -e "install.packages(c( \
'Rcpp', 'dplyr', 'stringr', 'glue', 'vctrs', \
'purrr', \
'assertthat', \