You are viewing a plain text version of this content. The canonical link for it is here.
Posted to jira@arrow.apache.org by "Antoine Pitrou (Jira)" <ji...@apache.org> on 2021/06/10 17:13:00 UTC
[jira] [Commented] (ARROW-13038) [Dev] r_valgrind image doesn't use
full parallelism
[ https://issues.apache.org/jira/browse/ARROW-13038?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17361094#comment-17361094 ]
Antoine Pitrou commented on ARROW-13038:
----------------------------------------
[~jonkeane]
> [Dev] r_valgrind image doesn't use full parallelism
> ---------------------------------------------------
>
> Key: ARROW-13038
> URL: https://issues.apache.org/jira/browse/ARROW-13038
> Project: Apache Arrow
> Issue Type: Bug
> Components: Developer Tools, R
> Reporter: Antoine Pitrou
> Priority: Minor
>
> I have a 12-core 24-thread CPU, but the {{ubuntu_r_valgrind}} Docker image only seems to be using 4 threads when I build Arrow:
> {code}
> 35 pts/0 S+ 0:00 /bin/sh /usr/local/RDvalgrind/lib/R/bin/INSTALL /arrow/r
> 39 pts/0 S+ 0:00 \_ /usr/local/RDvalgrind/lib/R/bin/exec/R --no-save --no-restore --no-restore --no-echo --args nextArg/arrow/r
> 55 pts/0 S+ 0:00 \_ sh -c _R_SHLIB_BUILD_OBJECTS_SYMBOL_TABLES_=false ./configure
> 56 pts/0 S+ 0:00 \_ /bin/sh ./configure
> 86 pts/0 S+ 0:00 \_ /usr/local/RDvalgrind/lib/R/bin/exec/R --no-save --no-restore --no-echo --no-restore --file=tools/nixlibs.R --args 4.0.1.900
> 205 pts/0 S+ 0:00 \_ sh -c SOURCE_DIR="../cpp" BUILD_DIR="/tmp/Rtmpz9DiSI/file561e1b1cec" DEST_DIR="libarrow/arrow-4.0.1.9000" CMAKE="/tmp/Rt
> 206 pts/0 S+ 0:00 \_ /bin/bash inst/build_arrow_static.sh
> 388 pts/0 S+ 0:00 \_ /tmp/Rtmpz9DiSI/file565b17078b/cmake-3.19.2-Linux-x86_64/bin/cmake --build . --target install
> 389 pts/0 S+ 0:00 \_ /bin/make install
> 392 pts/0 S+ 0:00 \_ make -s -f CMakeFiles/Makefile2 all
> 2571 pts/0 S+ 0:00 \_ make -s -f src/arrow/CMakeFiles/arrow_objlib.dir/build.make src/arrow/CMakeFiles/arrow_objlib.dir/bu
> 2622 pts/0 S+ 0:00 \_ /bin/sh -c cd /tmp/Rtmpz9DiSI/file561e1b1cec/src/arrow && /bin/g++ -std=gnu++11 -DARROW_EXPORTI
> 2623 pts/0 S+ 0:00 | \_ /bin/g++ -std=gnu++11 -DARROW_EXPORTING -DARROW_HAVE_RUNTIME_AVX2 -DARROW_HAVE_RUNTIME_BMI2
> 2624 pts/0 R+ 0:28 | \_ /usr/lib/gcc/x86_64-linux-gnu/10/cc1plus -quiet -I /tmp/Rtmpz9DiSI/file561e1b1cec/src -I
> 2628 pts/0 S+ 0:00 \_ /bin/sh -c cd /tmp/Rtmpz9DiSI/file561e1b1cec/src/arrow && /bin/g++ -std=gnu++11 -DARROW_EXPORTI
> 2629 pts/0 S+ 0:00 | \_ /bin/g++ -std=gnu++11 -DARROW_EXPORTING -DARROW_HAVE_RUNTIME_AVX2 -DARROW_HAVE_RUNTIME_BMI2
> 2646 pts/0 R+ 0:00 | \_ as -I /tmp/Rtmpz9DiSI/file561e1b1cec/src -I /arrow/cpp/src -I /arrow/cpp/src/generated -
> 2635 pts/0 S+ 0:00 \_ /bin/sh -c cd /tmp/Rtmpz9DiSI/file561e1b1cec/src/arrow && /bin/g++ -std=gnu++11 -DARROW_EXPORTI
> 2636 pts/0 S+ 0:00 | \_ /bin/g++ -std=gnu++11 -DARROW_EXPORTING -DARROW_HAVE_RUNTIME_AVX2 -DARROW_HAVE_RUNTIME_BMI2
> 2637 pts/0 R+ 0:07 | \_ /usr/lib/gcc/x86_64-linux-gnu/10/cc1plus -quiet -I /tmp/Rtmpz9DiSI/file561e1b1cec/src -I
> 2642 pts/0 S+ 0:00 \_ /bin/sh -c cd /tmp/Rtmpz9DiSI/file561e1b1cec/src/arrow && /bin/g++ -std=gnu++11 -DARROW_EXPORTI
> 2643 pts/0 S+ 0:00 \_ /bin/g++ -std=gnu++11 -DARROW_EXPORTING -DARROW_HAVE_RUNTIME_AVX2 -DARROW_HAVE_RUNTIME_BMI2
> 2644 pts/0 R+ 0:02 \_ /usr/lib/gcc/x86_64-linux-gnu/10/cc1plus -quiet -I /tmp/Rtmpz9DiSI/file561e1b1cec/src -I
> {code}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)