You are viewing a plain text version of this content. The canonical link for it is here.
Posted to reviews@spark.apache.org by vanzin <gi...@git.apache.org> on 2018/01/04 23:32:11 UTC

[GitHub] spark pull request #20161: [SPARK-21525][streaming] Check error code from su...

GitHub user vanzin opened a pull request:

    https://github.com/apache/spark/pull/20161

    [SPARK-21525][streaming] Check error code from supervisor RPC.

    The code was ignoring the error code from the AddBlock RPC, which
    means that a failure to write to the WAL was being ignored by the
    receiver, and would lead to the block being acked (in the case of
    the Flume receiver) and data potentially lost.

You can merge this pull request into a Git repository by running:

    $ git pull https://github.com/vanzin/spark SPARK-21525

Alternatively you can review and apply these changes as the patch at:

    https://github.com/apache/spark/pull/20161.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

    This closes #20161
    
----
commit 3175bd6d98d14df6dbdaf95eb1bc05166e6fa8ac
Author: Marcelo Vanzin <va...@...>
Date:   2018-01-04T23:25:01Z

    [SPARK-21525][streaming] Check error code from supervisor RPC.
    
    The code was ignoring the error code from the AddBlock RPC, which
    means that a failure to write to the WAL was being ignored by the
    receiver, and would lead to the block being acked (in the case of
    the Flume receiver) and data potentially lost.

----


---

---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org


[GitHub] spark issue #20161: [SPARK-21525][streaming] Check error code from superviso...

Posted by AmplabJenkins <gi...@git.apache.org>.
Github user AmplabJenkins commented on the issue:

    https://github.com/apache/spark/pull/20161
  
    Test PASSed.
    Refer to this link for build results (access rights to CI server needed): 
    https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/86360/
    Test PASSed.


---

---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org


[GitHub] spark issue #20161: [SPARK-21525][streaming] Check error code from superviso...

Posted by SparkQA <gi...@git.apache.org>.
Github user SparkQA commented on the issue:

    https://github.com/apache/spark/pull/20161
  
    **[Test build #86360 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/86360/testReport)** for PR 20161 at commit [`3175bd6`](https://github.com/apache/spark/commit/3175bd6d98d14df6dbdaf95eb1bc05166e6fa8ac).
     * This patch passes all tests.
     * This patch merges cleanly.
     * This patch adds no public classes.


---

---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org


[GitHub] spark issue #20161: [SPARK-21525][streaming] Check error code from superviso...

Posted by vanzin <gi...@git.apache.org>.
Github user vanzin commented on the issue:

    https://github.com/apache/spark/pull/20161
  
    @tdas 


---

---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org


[GitHub] spark pull request #20161: [SPARK-21525][streaming] Check error code from su...

Posted by asfgit <gi...@git.apache.org>.
Github user asfgit closed the pull request at:

    https://github.com/apache/spark/pull/20161


---

---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org


[GitHub] spark issue #20161: [SPARK-21525][streaming] Check error code from superviso...

Posted by AmplabJenkins <gi...@git.apache.org>.
Github user AmplabJenkins commented on the issue:

    https://github.com/apache/spark/pull/20161
  
    Merged build finished. Test PASSed.


---

---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org


[GitHub] spark issue #20161: [SPARK-21525][streaming] Check error code from superviso...

Posted by AmplabJenkins <gi...@git.apache.org>.
Github user AmplabJenkins commented on the issue:

    https://github.com/apache/spark/pull/20161
  
    Test PASSed.
    Refer to this link for build results (access rights to CI server needed): 
    https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/85704/
    Test PASSed.


---

---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org


[GitHub] spark issue #20161: [SPARK-21525][streaming] Check error code from superviso...

Posted by SparkQA <gi...@git.apache.org>.
Github user SparkQA commented on the issue:

    https://github.com/apache/spark/pull/20161
  
    **[Test build #85704 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/85704/testReport)** for PR 20161 at commit [`3175bd6`](https://github.com/apache/spark/commit/3175bd6d98d14df6dbdaf95eb1bc05166e6fa8ac).


---

---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org


[GitHub] spark issue #20161: [SPARK-21525][streaming] Check error code from superviso...

Posted by zsxwing <gi...@git.apache.org>.
Github user zsxwing commented on the issue:

    https://github.com/apache/spark/pull/20161
  
    LGTM


---

---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org


[GitHub] spark issue #20161: [SPARK-21525][streaming] Check error code from superviso...

Posted by squito <gi...@git.apache.org>.
Github user squito commented on the issue:

    https://github.com/apache/spark/pull/20161
  
    lgtm


---

---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org


[GitHub] spark issue #20161: [SPARK-21525][streaming] Check error code from superviso...

Posted by SparkQA <gi...@git.apache.org>.
Github user SparkQA commented on the issue:

    https://github.com/apache/spark/pull/20161
  
    **[Test build #85704 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/85704/testReport)** for PR 20161 at commit [`3175bd6`](https://github.com/apache/spark/commit/3175bd6d98d14df6dbdaf95eb1bc05166e6fa8ac).
     * This patch passes all tests.
     * This patch merges cleanly.
     * This patch adds no public classes.


---

---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org


[GitHub] spark issue #20161: [SPARK-21525][streaming] Check error code from superviso...

Posted by SparkQA <gi...@git.apache.org>.
Github user SparkQA commented on the issue:

    https://github.com/apache/spark/pull/20161
  
    **[Test build #86360 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/86360/testReport)** for PR 20161 at commit [`3175bd6`](https://github.com/apache/spark/commit/3175bd6d98d14df6dbdaf95eb1bc05166e6fa8ac).


---

---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org


[GitHub] spark issue #20161: [SPARK-21525][streaming] Check error code from superviso...

Posted by vanzin <gi...@git.apache.org>.
Github user vanzin commented on the issue:

    https://github.com/apache/spark/pull/20161
  
    Just pinging again to get some eyes.


---

---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org


[GitHub] spark issue #20161: [SPARK-21525][streaming] Check error code from superviso...

Posted by AmplabJenkins <gi...@git.apache.org>.
Github user AmplabJenkins commented on the issue:

    https://github.com/apache/spark/pull/20161
  
    Merged build finished. Test PASSed.


---

---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org


[GitHub] spark issue #20161: [SPARK-21525][streaming] Check error code from superviso...

Posted by vanzin <gi...@git.apache.org>.
Github user vanzin commented on the issue:

    https://github.com/apache/spark/pull/20161
  
    Alright merging to master.


---

---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org


[GitHub] spark issue #20161: [SPARK-21525][streaming] Check error code from superviso...

Posted by vanzin <gi...@git.apache.org>.
Github user vanzin commented on the issue:

    https://github.com/apache/spark/pull/20161
  
    Let's try different people. @zsxwing @squito 


---

---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org