You are viewing a plain text version of this content. The canonical link for it is here.
Posted to reviews@spark.apache.org by simonjscott <gi...@git.apache.org> on 2016/05/20 10:50:34 UTC

[GitHub] spark pull request: [SPARK-10722] RDDBlockId not found in driver-h...

GitHub user simonjscott opened a pull request:

    https://github.com/apache/spark/pull/13222

    [SPARK-10722] RDDBlockId not found in driver-heartbeater

    ## What changes were proposed in this pull request?
    
    To ensure that the deserialization of TaskMetrics uses a ClassLoader that knows about RDDBlockIds. The problem occurs only very rarely since it depends on which thread of the thread pool is used for the heartbeat.
    
    I observe that the code in question has been largely rewritten for v2.0.0 of Spark and the problem no longer manifests. However it would seem reasonable to fix this for those users who need to continue with the 1.6 version for some time yet. Hence I have created a fix for the 1.6 code branch.
    
    ## How was this patch tested?
    
    Due to the nature of the problem a reproducible testcase is difficult to produce. This problem was causing our application's nightly integration tests to fail randomly. Since applying the fix the tests have not failed due to this problem, for nearly six weeks now.
    
    
    
    
    


You can merge this pull request into a Git repository by running:

    $ git pull https://github.com/simonjscott/spark fix-10722

Alternatively you can review and apply these changes as the patch at:

    https://github.com/apache/spark/pull/13222.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

    This closes #13222
    
----
commit 9ea4dcaf6ab8bc776f28b17a3d35668f3471b0af
Author: Simon Scott <si...@viavisolutions.com>
Date:   2016-05-20T10:29:04Z

    [SPARK-10722] RDDBlockId not found in driver-heartbeater

----


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---

---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org


[GitHub] spark pull request: [SPARK-10722] RDDBlockId not found in driver-h...

Posted by simonjscott <gi...@git.apache.org>.
Github user simonjscott commented on the pull request:

    https://github.com/apache/spark/pull/13222#issuecomment-221871215
  
    @srowen Yes  however when I closed it there was a message about unmerged commits, so I re-opened it. Should I close it anyway?


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---

---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org


[GitHub] spark pull request: [SPARK-10722] RDDBlockId not found in driver-h...

Posted by simonjscott <gi...@git.apache.org>.
Github user simonjscott commented on the pull request:

    https://github.com/apache/spark/pull/13222#issuecomment-221228347
  
    @andrewor14  Allow me to try to clarify my reasoning…
    
    We have reports from at least three users of an exception occurring unpredictably (and not reproducible on demand) while running Spark applications using a “local” master url.
    
    Inspection of the stack trace shows that the class RDDBlockId cannot be loaded while deserializing  TaskMetrics. The deserialization is part of a serialize/deserialize combo used (in “local” mode only) to make a copy of the TaskMetrics. Now since everything is running in the same JVM we can reasonably assume that the classpath is properly configured, otherwise how could the RDDBlockId have been created and present in the TaskMetrics in the first place?
    
    Yet the stack trace tells us that the classloader assigned to the heartbeater thread is not able to load RDDBlockId.
    
    So my fix is to tell the deserialize() to use a specific classloader (defined by Utils.getContextOrSparkClassLoader) that *is* able to load RDDBlockId. A nice property of the fix is that it is entirely localised to the call to deserialize() – there can be no side-effects outside of that call.
    
    Why is the exception so unpredictable? My original conjecture was that the “heartbeat” thread is drawn from a pool and so may be a different actual thread instance on each tick of the heartbeat. And so everything will work until by some chance the actual thread for a given tick is not configured with the right class loader. Another possibility is that RDDBlockIds may be rare and most of the time the heartbeat thread doesn’t encounter them.
    
    I hope that this is helpful.
    



---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---

---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org


[GitHub] spark pull request: [SPARK-10722] RDDBlockId not found in driver-h...

Posted by srowen <gi...@git.apache.org>.
Github user srowen commented on the pull request:

    https://github.com/apache/spark/pull/13222#issuecomment-221866770
  
    Merged to 1.6


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---

---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org


[GitHub] spark pull request: [SPARK-10722] RDDBlockId not found in driver-h...

Posted by simonjscott <gi...@git.apache.org>.
Github user simonjscott commented on the pull request:

    https://github.com/apache/spark/pull/13222#issuecomment-221871700
  
    Thank you for reassurance, Closing...


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---

---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org


[GitHub] spark pull request: [SPARK-10722] RDDBlockId not found in driver-h...

Posted by SparkQA <gi...@git.apache.org>.
Github user SparkQA commented on the pull request:

    https://github.com/apache/spark/pull/13222#issuecomment-220584742
  
    **[Test build #58981 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/58981/consoleFull)** for PR 13222 at commit [`9ea4dca`](https://github.com/apache/spark/commit/9ea4dcaf6ab8bc776f28b17a3d35668f3471b0af).
     * This patch **fails to build**.
     * This patch merges cleanly.
     * This patch adds no public classes.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---

---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org


[GitHub] spark pull request: [SPARK-10722] RDDBlockId not found in driver-h...

Posted by srowen <gi...@git.apache.org>.
Github user srowen commented on the pull request:

    https://github.com/apache/spark/pull/13222#issuecomment-220589436
  
    That looks like an unrelated failure.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---

---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org


[GitHub] spark pull request: [SPARK-10722] RDDBlockId not found in driver-h...

Posted by AmplabJenkins <gi...@git.apache.org>.
Github user AmplabJenkins commented on the pull request:

    https://github.com/apache/spark/pull/13222#issuecomment-220575938
  
    Can one of the admins verify this patch?


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---

---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org


[GitHub] spark pull request: [SPARK-10722] RDDBlockId not found in driver-h...

Posted by simonjscott <gi...@git.apache.org>.
Github user simonjscott commented on the pull request:

    https://github.com/apache/spark/pull/13222#issuecomment-220691593
  
    @andrewor14 yes I believe so. I first encountered this exception when we deployed a new nightly integration test for our application. The test failed with this exception for six of the first seven nights. After investigation and deploying this fix in a locally-built spark lib, the exception has not recurred at all for the past six weeks.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---

---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org


[GitHub] spark pull request: [SPARK-10722] RDDBlockId not found in driver-h...

Posted by simonjscott <gi...@git.apache.org>.
Github user simonjscott closed the pull request at:

    https://github.com/apache/spark/pull/13222


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---

---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org


[GitHub] spark pull request: [SPARK-10722] RDDBlockId not found in driver-h...

Posted by simonjscott <gi...@git.apache.org>.
GitHub user simonjscott reopened a pull request:

    https://github.com/apache/spark/pull/13222

    [SPARK-10722] RDDBlockId not found in driver-heartbeater

    ## What changes were proposed in this pull request?
    
    To ensure that the deserialization of TaskMetrics uses a ClassLoader that knows about RDDBlockIds. The problem occurs only very rarely since it depends on which thread of the thread pool is used for the heartbeat.
    
    I observe that the code in question has been largely rewritten for v2.0.0 of Spark and the problem no longer manifests. However it would seem reasonable to fix this for those users who need to continue with the 1.6 version for some time yet. Hence I have created a fix for the 1.6 code branch.
    
    ## How was this patch tested?
    
    Due to the nature of the problem a reproducible testcase is difficult to produce. This problem was causing our application's nightly integration tests to fail randomly. Since applying the fix the tests have not failed due to this problem, for nearly six weeks now.
    
    
    
    
    


You can merge this pull request into a Git repository by running:

    $ git pull https://github.com/simonjscott/spark fix-10722

Alternatively you can review and apply these changes as the patch at:

    https://github.com/apache/spark/pull/13222.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

    This closes #13222
    
----
commit 9ea4dcaf6ab8bc776f28b17a3d35668f3471b0af
Author: Simon Scott <si...@viavisolutions.com>
Date:   2016-05-20T10:29:04Z

    [SPARK-10722] RDDBlockId not found in driver-heartbeater

----


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---

---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org


[GitHub] spark pull request: [SPARK-10722] RDDBlockId not found in driver-h...

Posted by simonjscott <gi...@git.apache.org>.
Github user simonjscott commented on the pull request:

    https://github.com/apache/spark/pull/13222#issuecomment-220588246
  
    Apologies. Please accept that I am new around here, and of course the change built just fine for me. Looking at the changed file above it really does seem innocent.
    
    I am unsure how to proceed. The only error I can see in the Jenkins output is this:
    `[error] (streaming-flume-sink/*:update) java.lang.IllegalStateException: impossible to get artifacts when data has not been loaded. IvyNode = io.netty#netty;3.4.0.Final`
    
    which I'm afraid doesn't help me understand what I should have done better. Thanks


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---

---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org


[GitHub] spark pull request: [SPARK-10722] RDDBlockId not found in driver-h...

Posted by andrewor14 <gi...@git.apache.org>.
Github user andrewor14 commented on the pull request:

    https://github.com/apache/spark/pull/13222#issuecomment-220676407
  
    @simonjscott have you verified that before this fix we still see the exception, and after this fix we no longer do?


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---

---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org


[GitHub] spark pull request: [SPARK-10722] RDDBlockId not found in driver-h...

Posted by AmplabJenkins <gi...@git.apache.org>.
Github user AmplabJenkins commented on the pull request:

    https://github.com/apache/spark/pull/13222#issuecomment-220617289
  
    Test PASSed.
    Refer to this link for build results (access rights to CI server needed): 
    https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/58985/
    Test PASSed.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---

---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org


[GitHub] spark pull request: [SPARK-10722] RDDBlockId not found in driver-h...

Posted by srowen <gi...@git.apache.org>.
Github user srowen commented on the pull request:

    https://github.com/apache/spark/pull/13222#issuecomment-220831802
  
    @andrewor14 it seems pretty surgical and could plausibly fix this. Tests pass and @simonjscott is reasonably sure it's the right fix. Are you OK merging?


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---

---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org


[GitHub] spark pull request: [SPARK-10722] RDDBlockId not found in driver-h...

Posted by AmplabJenkins <gi...@git.apache.org>.
Github user AmplabJenkins commented on the pull request:

    https://github.com/apache/spark/pull/13222#issuecomment-220584750
  
    Test FAILed.
    Refer to this link for build results (access rights to CI server needed): 
    https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/58981/
    Test FAILed.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---

---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org


[GitHub] spark pull request: [SPARK-10722] RDDBlockId not found in driver-h...

Posted by simonjscott <gi...@git.apache.org>.
Github user simonjscott closed the pull request at:

    https://github.com/apache/spark/pull/13222


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---

---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org


[GitHub] spark pull request: [SPARK-10722] RDDBlockId not found in driver-h...

Posted by srowen <gi...@git.apache.org>.
Github user srowen commented on the pull request:

    https://github.com/apache/spark/pull/13222#issuecomment-221870205
  
    Thanks @simonjscott but yes you will actually have to close this manually -- the bot won't do it and we can't.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---

---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org


[GitHub] spark pull request: [SPARK-10722] RDDBlockId not found in driver-h...

Posted by SparkQA <gi...@git.apache.org>.
Github user SparkQA commented on the pull request:

    https://github.com/apache/spark/pull/13222#issuecomment-220583598
  
    **[Test build #58981 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/58981/consoleFull)** for PR 13222 at commit [`9ea4dca`](https://github.com/apache/spark/commit/9ea4dcaf6ab8bc776f28b17a3d35668f3471b0af).


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---

---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org


[GitHub] spark pull request: [SPARK-10722] RDDBlockId not found in driver-h...

Posted by srowen <gi...@git.apache.org>.
Github user srowen commented on the pull request:

    https://github.com/apache/spark/pull/13222#issuecomment-221871492
  
    It is merged (see https://github.com/apache/spark/commit/5cc1e2cec71ef18c76973608e909b4f37fcfcf6b referenced above). Github doesn't quite know that. It always says there are unmerged commits.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---

---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org


[GitHub] spark pull request: [SPARK-10722] RDDBlockId not found in driver-h...

Posted by srowen <gi...@git.apache.org>.
Github user srowen commented on the pull request:

    https://github.com/apache/spark/pull/13222#issuecomment-220583225
  
    Jenkins test this please


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---

---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org


[GitHub] spark pull request: [SPARK-10722] RDDBlockId not found in driver-h...

Posted by AmplabJenkins <gi...@git.apache.org>.
Github user AmplabJenkins commented on the pull request:

    https://github.com/apache/spark/pull/13222#issuecomment-220584747
  
    Merged build finished. Test FAILed.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---

---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org


[GitHub] spark pull request: [SPARK-10722] RDDBlockId not found in driver-h...

Posted by AmplabJenkins <gi...@git.apache.org>.
Github user AmplabJenkins commented on the pull request:

    https://github.com/apache/spark/pull/13222#issuecomment-220617285
  
    Merged build finished. Test PASSed.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---

---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org


[GitHub] spark pull request: [SPARK-10722] RDDBlockId not found in driver-h...

Posted by SparkQA <gi...@git.apache.org>.
Github user SparkQA commented on the pull request:

    https://github.com/apache/spark/pull/13222#issuecomment-220589631
  
    **[Test build #58985 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/58985/consoleFull)** for PR 13222 at commit [`9ea4dca`](https://github.com/apache/spark/commit/9ea4dcaf6ab8bc776f28b17a3d35668f3471b0af).


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---

---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org


[GitHub] spark pull request: [SPARK-10722] RDDBlockId not found in driver-h...

Posted by srowen <gi...@git.apache.org>.
Github user srowen commented on the pull request:

    https://github.com/apache/spark/pull/13222#issuecomment-220589448
  
    Jenkins add to whitelist


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---

---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org


[GitHub] spark pull request: [SPARK-10722] RDDBlockId not found in driver-h...

Posted by SparkQA <gi...@git.apache.org>.
Github user SparkQA commented on the pull request:

    https://github.com/apache/spark/pull/13222#issuecomment-220617088
  
    **[Test build #58985 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/58985/consoleFull)** for PR 13222 at commit [`9ea4dca`](https://github.com/apache/spark/commit/9ea4dcaf6ab8bc776f28b17a3d35668f3471b0af).
     * This patch passes all tests.
     * This patch merges cleanly.
     * This patch adds no public classes.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---

---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org


[GitHub] spark pull request: [SPARK-10722] RDDBlockId not found in driver-h...

Posted by andrewor14 <gi...@git.apache.org>.
Github user andrewor14 commented on the pull request:

    https://github.com/apache/spark/pull/13222#issuecomment-221049294
  
    I can merge it, but I just don't really understand why this fixes the problem (or what the problem was caused by)


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---

---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org


[GitHub] spark pull request: [SPARK-10722] RDDBlockId not found in driver-h...

Posted by srowen <gi...@git.apache.org>.
Github user srowen commented on the pull request:

    https://github.com/apache/spark/pull/13222#issuecomment-220589456
  
    Jenkins retest this please


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---

---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org