You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@arrow.apache.org by cu...@apache.org on 2018/04/28 01:48:54 UTC

[arrow] branch master updated: ARROW-2452: [TEST] Spark integration test fails with permission error

This is an automated email from the ASF dual-hosted git repository.

cutlerb pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/arrow.git


The following commit(s) were added to refs/heads/master by this push:
     new 16820a2  ARROW-2452: [TEST] Spark integration test fails with permission error
16820a2 is described below

commit 16820a2128075d8d9ca13bec6d6c6244541d34a4
Author: Krisztián Szűcs <sz...@gmail.com>
AuthorDate: Fri Apr 27 18:48:44 2018 -0700

    ARROW-2452: [TEST] Spark integration test fails with permission error
    
    The build itself fails too:
    
    ```bash
    [info] Compiling 103 Scala sources and 6 Java sources to /apache-arrow/spark/streaming/target/scala-2.11/classes...
    [error] Compile failed at Apr 13, 2018 9:50:50 AM [1:05.284s]
    [INFO] ------------------------------------------------------------------------
    [INFO] Reactor Summary:
    [INFO]
    [INFO] Spark Project Parent POM ........................... SUCCESS [ 17.349 s]
    [INFO] Spark Project Tags ................................. SUCCESS [ 20.587 s]
    [INFO] Spark Project Sketch ............................... SUCCESS [ 12.047 s]
    [INFO] Spark Project Local DB ............................. SUCCESS [  8.086 s]
    [INFO] Spark Project Networking ........................... SUCCESS [ 18.759 s]
    [INFO] Spark Project Shuffle Streaming Service ............ SUCCESS [ 10.423 s]
    [INFO] Spark Project Unsafe ............................... SUCCESS [ 19.453 s]
    [INFO] Spark Project Launcher ............................. SUCCESS [ 17.220 s]
    [INFO] Spark Project Core ................................. SUCCESS [12:40 min]
    [INFO] Spark Project ML Local Library ..................... SUCCESS [ 32.734 s]
    [INFO] Spark Project GraphX ............................... SUCCESS [01:02 min]
    [INFO] Spark Project Streaming ............................ FAILURE [01:09 min]
    [INFO] Spark Project Catalyst ............................. SKIPPED
    [INFO] Spark Project SQL .................................. SKIPPED
    [INFO] Spark Project ML Library ........................... SKIPPED
    [INFO] Spark Project Tools ................................ SKIPPED
    [INFO] Spark Project Hive ................................. SKIPPED
    [INFO] Spark Project REPL ................................. SKIPPED
    [INFO] Spark Project Assembly ............................. SKIPPED
    [INFO] Spark Integration for Kafka 0.10 ................... SKIPPED
    [INFO] Kafka 0.10 Source for Structured Streaming ......... SKIPPED
    [INFO] Spark Project Examples ............................. SKIPPED
    [INFO] Spark Integration for Kafka 0.10 Assembly .......... SKIPPED
    [INFO] ------------------------------------------------------------------------
    [INFO] BUILD FAILURE
    [INFO] ------------------------------------------------------------------------
    [INFO] Total time: 17:29 min
    [INFO] Finished at: 2018-04-13T09:50:50Z
    [INFO] Final Memory: 59M/741M
    [INFO] ------------------------------------------------------------------------
    [ERROR] Failed to execute goal net.alchim31.maven:scala-maven-plugin:3.2.2:compile (scala-compile-first) on project spark-streaming_2.11: Execution scala-compile-first of goal net.alchim31.maven:scala-maven-plugin:3.2.2:compile failed.: C
    ompileFailed -> [Help 1]
    [ERROR]
    [ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch.
    [ERROR] Re-run Maven using the -X switch to enable full debug logging.
    [ERROR]
    [ERROR] For more information about the errors and possible solutions, please read the following articles:
    [ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/PluginExecutionException
    [ERROR]
    [ERROR] After correcting the problems, you can resume the build with the command
    [ERROR]   mvn <goals> -rf :spark-streaming_2.11
    ```
    
    Should I create a JIRA ticket?
    
    Author: Krisztián Szűcs <sz...@gmail.com>
    
    Closes #1890 from kszucs/ARROW-2452 and squashes the following commits:
    
    224e9dd <Krisztián Szűcs> forward all arguments to docker-compose
    1d34704 <Krisztián Szűcs> fix order of arguments
    2641080 <Krisztián Szűcs> don't pass group- and userid to docker-compose
---
 dev/run_docker_compose.sh | 4 +---
 1 file changed, 1 insertion(+), 3 deletions(-)

diff --git a/dev/run_docker_compose.sh b/dev/run_docker_compose.sh
index 681a3a7..bb353b5 100755
--- a/dev/run_docker_compose.sh
+++ b/dev/run_docker_compose.sh
@@ -35,6 +35,4 @@ if [ ! -d parquet-cpp ]; then
     exit 1
 fi
 
-GID=$(id -g ${USERNAME})
-docker-compose -f arrow/dev/docker-compose.yml run \
-               --rm -u "${UID}:${GID}" "${1}"
+docker-compose -f arrow/dev/docker-compose.yml run --rm "${@}"

-- 
To stop receiving notification emails like this one, please contact
cutlerb@apache.org.