You are viewing a plain text version of this content. The canonical link for it is here.
Posted to reviews@spark.apache.org by vanzin <gi...@git.apache.org> on 2016/05/04 21:43:55 UTC

[GitHub] spark pull request: [SPARK-13670][launcher] Propagate error from l...

GitHub user vanzin opened a pull request:

    https://github.com/apache/spark/pull/12910

    [SPARK-13670][launcher] Propagate error from launcher to shell.

    bash doesn't really propagate errors from subshells when using redirection
    the way spark-class does; so, instead, this change captures the exit code
    of the launcher process in the command array, and checks it before executing
    the actual command.
    
    Tested by injecting an error in Main.java (the launcher entry point) and
    verifying the shell gets the right exit code from spark-class.

You can merge this pull request into a Git repository by running:

    $ git pull https://github.com/vanzin/spark SPARK-13670

Alternatively you can review and apply these changes as the patch at:

    https://github.com/apache/spark/pull/12910.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

    This closes #12910
    
----
commit 552a48f09d627c6739e2c802a2821417be981c6f
Author: Marcelo Vanzin <va...@cloudera.com>
Date:   2016-05-04T21:40:46Z

    [SPARK-13670][launcher] Propagate error from launcher to shell.
    
    bash doesn't really propagate errors from subshells when using redirection
    the way spark-class does; so, instead, this change captures the exit code
    of the launcher process in the command array, and checks it before executing
    the actual command.
    
    Tested by injecting an error in Main.java (the launcher entry point) and
    verifying the shell gets the right exit code from spark-class.

----


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---

---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org


[GitHub] spark pull request: [SPARK-13670][launcher] Propagate error from l...

Posted by markgrover <gi...@git.apache.org>.
Github user markgrover commented on the pull request:

    https://github.com/apache/spark/pull/12910#issuecomment-218020176
  
    LGTM, I had tested this on mac a while back (on 03/22) and it worked for me.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---

---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org


[GitHub] spark pull request: [SPARK-13670][launcher] Propagate error from l...

Posted by SparkQA <gi...@git.apache.org>.
Github user SparkQA commented on the pull request:

    https://github.com/apache/spark/pull/12910#issuecomment-217040499
  
    **[Test build #57808 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/57808/consoleFull)** for PR 12910 at commit [`552a48f`](https://github.com/apache/spark/commit/552a48f09d627c6739e2c802a2821417be981c6f).
     * This patch passes all tests.
     * This patch merges cleanly.
     * This patch adds no public classes.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---

---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org


[GitHub] spark pull request: [SPARK-13670][launcher] Propagate error from l...

Posted by vanzin <gi...@git.apache.org>.
Github user vanzin commented on the pull request:

    https://github.com/apache/spark/pull/12910#issuecomment-218232117
  
    Merging to master / 2.0.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---

---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org


[GitHub] spark pull request: [SPARK-13670][launcher] Propagate error from l...

Posted by AmplabJenkins <gi...@git.apache.org>.
Github user AmplabJenkins commented on the pull request:

    https://github.com/apache/spark/pull/12910#issuecomment-217040645
  
    Test PASSed.
    Refer to this link for build results (access rights to CI server needed): 
    https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/57808/
    Test PASSed.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---

---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org


[GitHub] spark pull request: [SPARK-13670][launcher] Propagate error from l...

Posted by vanzin <gi...@git.apache.org>.
Github user vanzin commented on the pull request:

    https://github.com/apache/spark/pull/12910#issuecomment-218011128
  
    @andrewor14 @markgrover 


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---

---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org


[GitHub] spark pull request: [SPARK-13670][launcher] Propagate error from l...

Posted by AmplabJenkins <gi...@git.apache.org>.
Github user AmplabJenkins commented on the pull request:

    https://github.com/apache/spark/pull/12910#issuecomment-217040642
  
    Merged build finished. Test PASSed.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---

---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org


[GitHub] spark pull request: [SPARK-13670][launcher] Propagate error from l...

Posted by asfgit <gi...@git.apache.org>.
Github user asfgit closed the pull request at:

    https://github.com/apache/spark/pull/12910


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---

---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org


[GitHub] spark pull request: [SPARK-13670][launcher] Propagate error from l...

Posted by SparkQA <gi...@git.apache.org>.
Github user SparkQA commented on the pull request:

    https://github.com/apache/spark/pull/12910#issuecomment-217013840
  
    **[Test build #57808 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/57808/consoleFull)** for PR 12910 at commit [`552a48f`](https://github.com/apache/spark/commit/552a48f09d627c6739e2c802a2821417be981c6f).


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---

---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org