You are viewing a plain text version of this content. The canonical link for it is here.
Posted to reviews@spark.apache.org by bersprockets <gi...@git.apache.org> on 2018/02/19 20:45:48 UTC

[GitHub] spark pull request #20638: [SPARK-23417][python] Fix the build instructions ...

GitHub user bersprockets opened a pull request:

    https://github.com/apache/spark/pull/20638

    [SPARK-23417][python] Fix the build instructions supplied by exception messages in python streaming tests

    ## What changes were proposed in this pull request?
    
    Fix the build instructions supplied by exception messages in python streaming tests. 
    
    I also added -DskipTests to the maven instructions to avoid the 170 minutes of scala tests that occurs each time one wants to add a jar to the assembly directory.
    
    ## How was this patch tested?
    
    - clone branch
    - run build/sbt package
    - run python/run-tests --modules "pyspark-streaming" , expect error message
    - follow instructions in error message. i.e., run build/sbt assembly/package streaming-kafka-0-8-assembly/assembly
    - rerun python tests, expect error message
    - follow instructions in error message. i.e run build/sbt -Pflume assembly/package streaming-flume-assembly/assembly
    - rerun python tests, see success.
    - repeated all of the above for mvn version of the process.
    


You can merge this pull request into a Git repository by running:

    $ git pull https://github.com/bersprockets/spark SPARK-23417_propa

Alternatively you can review and apply these changes as the patch at:

    https://github.com/apache/spark/pull/20638.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

    This closes #20638
    
----
commit a80a4c5df8064934784091e8650b8d13d09ef66f
Author: Bruce Robbins <be...@...>
Date:   2018-02-17T17:30:06Z

    Fix build instructions embedded in error message

commit 824131355cfdd531101308cc6f803820aa5c941e
Author: Bruce Robbins <be...@...>
Date:   2018-02-17T18:55:17Z

    Fix mvn instructions also

----


---

---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org


[GitHub] spark issue #20638: [SPARK-23417][python] Fix the build instructions supplie...

Posted by AmplabJenkins <gi...@git.apache.org>.
Github user AmplabJenkins commented on the issue:

    https://github.com/apache/spark/pull/20638
  
    Merged build finished. Test PASSed.


---

---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org


[GitHub] spark issue #20638: [SPARK-23417][python] Fix the build instructions supplie...

Posted by HyukjinKwon <gi...@git.apache.org>.
Github user HyukjinKwon commented on the issue:

    https://github.com/apache/spark/pull/20638
  
    ok to test


---

---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org


[GitHub] spark issue #20638: [SPARK-23417][python] Fix the build instructions supplie...

Posted by bersprockets <gi...@git.apache.org>.
Github user bersprockets commented on the issue:

    https://github.com/apache/spark/pull/20638
  
    @HyukjinKwon Oh, thanks. I guess I learned what "approved these changes" means.


---

---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org


[GitHub] spark issue #20638: [SPARK-23417][python] Fix the build instructions supplie...

Posted by AmplabJenkins <gi...@git.apache.org>.
Github user AmplabJenkins commented on the issue:

    https://github.com/apache/spark/pull/20638
  
    Can one of the admins verify this patch?


---

---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org


[GitHub] spark issue #20638: [SPARK-23417][python] Fix the build instructions supplie...

Posted by HyukjinKwon <gi...@git.apache.org>.
Github user HyukjinKwon commented on the issue:

    https://github.com/apache/spark/pull/20638
  
    add to whitelist


---

---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org


[GitHub] spark issue #20638: [SPARK-23417][python] Fix the build instructions supplie...

Posted by AmplabJenkins <gi...@git.apache.org>.
Github user AmplabJenkins commented on the issue:

    https://github.com/apache/spark/pull/20638
  
    Can one of the admins verify this patch?


---

---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org


[GitHub] spark pull request #20638: [SPARK-23417][python] Fix the build instructions ...

Posted by asfgit <gi...@git.apache.org>.
Github user asfgit closed the pull request at:

    https://github.com/apache/spark/pull/20638


---

---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org


[GitHub] spark issue #20638: [SPARK-23417][python] Fix the build instructions supplie...

Posted by HyukjinKwon <gi...@git.apache.org>.
Github user HyukjinKwon commented on the issue:

    https://github.com/apache/spark/pull/20638
  
    Merged to master.


---

---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org


[GitHub] spark issue #20638: [SPARK-23417][python] Fix the build instructions supplie...

Posted by bersprockets <gi...@git.apache.org>.
Github user bersprockets commented on the issue:

    https://github.com/apache/spark/pull/20638
  
    Do we want to merge this or does it need more eyes?


---

---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org


[GitHub] spark issue #20638: [SPARK-23417][python] Fix the build instructions supplie...

Posted by AmplabJenkins <gi...@git.apache.org>.
Github user AmplabJenkins commented on the issue:

    https://github.com/apache/spark/pull/20638
  
    Test PASSed.
    Refer to this link for build results (access rights to CI server needed): 
    https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/87545/
    Test PASSed.


---

---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org


[GitHub] spark issue #20638: [SPARK-23417][python] Fix the build instructions supplie...

Posted by SparkQA <gi...@git.apache.org>.
Github user SparkQA commented on the issue:

    https://github.com/apache/spark/pull/20638
  
    **[Test build #87545 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/87545/testReport)** for PR 20638 at commit [`8241313`](https://github.com/apache/spark/commit/824131355cfdd531101308cc6f803820aa5c941e).


---

---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org


[GitHub] spark issue #20638: [SPARK-23417][python] Fix the build instructions supplie...

Posted by SparkQA <gi...@git.apache.org>.
Github user SparkQA commented on the issue:

    https://github.com/apache/spark/pull/20638
  
    **[Test build #87545 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/87545/testReport)** for PR 20638 at commit [`8241313`](https://github.com/apache/spark/commit/824131355cfdd531101308cc6f803820aa5c941e).
     * This patch passes all tests.
     * This patch merges cleanly.
     * This patch adds no public classes.


---

---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org