You are viewing a plain text version of this content. The canonical link for it is here.
Posted to reviews@spark.apache.org by GitBox <gi...@apache.org> on 2020/06/24 09:21:43 UTC

[GitHub] [spark] wankunde opened a new pull request #28921: [SPARK-32086][YARN]Bug fix for RemoveBroadcast RPC failed after executor is shutdown

wankunde opened a new pull request #28921:
URL: https://github.com/apache/spark/pull/28921


   ### What changes were proposed in this pull request?
   
   Bug fix for yarn Dynamic Resource Allocation.
   
   ### Why are the changes needed?
   
   There are some exceptions when RemoveBroadcast RPC are called from BlockManagerMaster to BlockManagers on executors.
   
   It seems that `blockManagerInfo.values` in `BlockManagerMaster` has not been updated after the executor is closed
   
   ### Does this PR introduce _any_ user-facing change?
   
   No
   
   ### How was this patch tested?
   Using Exists patch
   


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org


[GitHub] [spark] AmplabJenkins commented on pull request #28921: [SPARK-32086][YARN]Bug fix for RemoveBroadcast RPC failed after executor is shutdown

Posted by GitBox <gi...@apache.org>.
AmplabJenkins commented on pull request #28921:
URL: https://github.com/apache/spark/pull/28921#issuecomment-648706656


   Can one of the admins verify this patch?


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org


[GitHub] [spark] dongjoon-hyun commented on a change in pull request #28921: [SPARK-32086][YARN]Bug fix for RemoveBroadcast RPC failed after executor is shutdown

Posted by GitBox <gi...@apache.org>.
dongjoon-hyun commented on a change in pull request #28921:
URL: https://github.com/apache/spark/pull/28921#discussion_r446690486



##########
File path: resource-managers/yarn/src/main/scala/org/apache/spark/scheduler/cluster/YarnSchedulerBackend.scala
##########
@@ -154,6 +154,7 @@ private[spark] abstract class YarnSchedulerBackend(
    * Request that the ApplicationMaster kill the specified executors.
    */
   override def doKillExecutors(executorIds: Seq[String]): Future[Boolean] = {
+    executorIds.foreach(sc.env.blockManager.master.removeExecutor)

Review comment:
       Hi, @wankunde . Do you think you can add a valid unit test case for that bug?
   > Bug fix for yarn Dynamic Resource Allocation.




----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org


[GitHub] [spark] AmplabJenkins commented on pull request #28921: [SPARK-32086][YARN]Bug fix for RemoveBroadcast RPC failed after executor is shutdown

Posted by GitBox <gi...@apache.org>.
AmplabJenkins commented on pull request #28921:
URL: https://github.com/apache/spark/pull/28921#issuecomment-650815415






----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org


[GitHub] [spark] github-actions[bot] closed pull request #28921: [SPARK-32086][YARN]Bug fix for RemoveBroadcast RPC failed after executor is shutdown

Posted by GitBox <gi...@apache.org>.
github-actions[bot] closed pull request #28921:
URL: https://github.com/apache/spark/pull/28921


   


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org


[GitHub] [spark] github-actions[bot] commented on pull request #28921: [SPARK-32086][YARN]Bug fix for RemoveBroadcast RPC failed after executor is shutdown

Posted by GitBox <gi...@apache.org>.
github-actions[bot] commented on pull request #28921:
URL: https://github.com/apache/spark/pull/28921#issuecomment-756483392


   We're closing this PR because it hasn't been updated in a while. This isn't a judgement on the merit of the PR in any way. It's just a way of keeping the PR queue manageable.
   If you'd like to revive this PR, please reopen it and ask a committer to remove the Stale tag!


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org


[GitHub] [spark] dongjoon-hyun commented on pull request #28921: [SPARK-32086][YARN]Bug fix for RemoveBroadcast RPC failed after executor is shutdown

Posted by GitBox <gi...@apache.org>.
dongjoon-hyun commented on pull request #28921:
URL: https://github.com/apache/spark/pull/28921#issuecomment-650814440


   cc @tgravescs and @holdenk 


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org


[GitHub] [spark] github-actions[bot] closed pull request #28921: [SPARK-32086][YARN]Bug fix for RemoveBroadcast RPC failed after executor is shutdown

Posted by GitBox <gi...@apache.org>.
github-actions[bot] closed pull request #28921:
URL: https://github.com/apache/spark/pull/28921


   


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org


[GitHub] [spark] AmplabJenkins removed a comment on pull request #28921: [SPARK-32086][YARN]Bug fix for RemoveBroadcast RPC failed after executor is shutdown

Posted by GitBox <gi...@apache.org>.
AmplabJenkins removed a comment on pull request #28921:
URL: https://github.com/apache/spark/pull/28921#issuecomment-650813260






----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org


[GitHub] [spark] wankunde commented on pull request #28921: [SPARK-32086][YARN]Bug fix for RemoveBroadcast RPC failed after executor is shutdown

Posted by GitBox <gi...@apache.org>.
wankunde commented on pull request #28921:
URL: https://github.com/apache/spark/pull/28921#issuecomment-650997690


   Now I have no unit test case.
   
   The issue has relevant log, and possible causes of this error as follow:
   
   ![image](https://user-images.githubusercontent.com/3626747/85987789-b6fd6100-ba20-11ea-8e48-5c8de3b84b24.png)
   
   
   


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org


[GitHub] [spark] SparkQA commented on pull request #28921: [SPARK-32086][YARN]Bug fix for RemoveBroadcast RPC failed after executor is shutdown

Posted by GitBox <gi...@apache.org>.
SparkQA commented on pull request #28921:
URL: https://github.com/apache/spark/pull/28921#issuecomment-650815382


   **[Test build #124608 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/124608/testReport)** for PR 28921 at commit [`6cfabad`](https://github.com/apache/spark/commit/6cfabad7a6ea9fdb7c5b9f0325e1f924965f9344).
    * This patch passes all tests.
    * This patch merges cleanly.
    * This patch adds no public classes.


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org


[GitHub] [spark] AmplabJenkins removed a comment on pull request #28921: [SPARK-32086][YARN]Bug fix for RemoveBroadcast RPC failed after executor is shutdown

Posted by GitBox <gi...@apache.org>.
AmplabJenkins removed a comment on pull request #28921:
URL: https://github.com/apache/spark/pull/28921#issuecomment-697868192






----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org


[GitHub] [spark] SparkQA commented on pull request #28921: [SPARK-32086][YARN]Bug fix for RemoveBroadcast RPC failed after executor is shutdown

Posted by GitBox <gi...@apache.org>.
SparkQA commented on pull request #28921:
URL: https://github.com/apache/spark/pull/28921#issuecomment-697840508


   **[Test build #129041 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/129041/testReport)** for PR 28921 at commit [`6cfabad`](https://github.com/apache/spark/commit/6cfabad7a6ea9fdb7c5b9f0325e1f924965f9344).


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org


[GitHub] [spark] AmplabJenkins removed a comment on pull request #28921: [SPARK-32086][YARN]Bug fix for RemoveBroadcast RPC failed after executor is shutdown

Posted by GitBox <gi...@apache.org>.
AmplabJenkins removed a comment on pull request #28921:
URL: https://github.com/apache/spark/pull/28921#issuecomment-694943473






----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org


[GitHub] [spark] AmplabJenkins commented on pull request #28921: [SPARK-32086][YARN]Bug fix for RemoveBroadcast RPC failed after executor is shutdown

Posted by GitBox <gi...@apache.org>.
AmplabJenkins commented on pull request #28921:
URL: https://github.com/apache/spark/pull/28921#issuecomment-650813260






----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org


[GitHub] [spark] SparkQA commented on pull request #28921: [SPARK-32086][YARN]Bug fix for RemoveBroadcast RPC failed after executor is shutdown

Posted by GitBox <gi...@apache.org>.
SparkQA commented on pull request #28921:
URL: https://github.com/apache/spark/pull/28921#issuecomment-697867721


   **[Test build #129041 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/129041/testReport)** for PR 28921 at commit [`6cfabad`](https://github.com/apache/spark/commit/6cfabad7a6ea9fdb7c5b9f0325e1f924965f9344).
    * This patch passes all tests.
    * This patch merges cleanly.
    * This patch adds no public classes.


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org


[GitHub] [spark] dongjoon-hyun commented on pull request #28921: [SPARK-32086][YARN]Bug fix for RemoveBroadcast RPC failed after executor is shutdown

Posted by GitBox <gi...@apache.org>.
dongjoon-hyun commented on pull request #28921:
URL: https://github.com/apache/spark/pull/28921#issuecomment-650812879


   ok to test


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org


[GitHub] [spark] AmplabJenkins removed a comment on pull request #28921: [SPARK-32086][YARN]Bug fix for RemoveBroadcast RPC failed after executor is shutdown

Posted by GitBox <gi...@apache.org>.
AmplabJenkins removed a comment on pull request #28921:
URL: https://github.com/apache/spark/pull/28921#issuecomment-648706030


   Can one of the admins verify this patch?


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org


[GitHub] [spark] AmplabJenkins commented on pull request #28921: [SPARK-32086][YARN]Bug fix for RemoveBroadcast RPC failed after executor is shutdown

Posted by GitBox <gi...@apache.org>.
AmplabJenkins commented on pull request #28921:
URL: https://github.com/apache/spark/pull/28921#issuecomment-694943473


   Can one of the admins verify this patch?


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org


[GitHub] [spark] AmplabJenkins commented on pull request #28921: [SPARK-32086][YARN]Bug fix for RemoveBroadcast RPC failed after executor is shutdown

Posted by GitBox <gi...@apache.org>.
AmplabJenkins commented on pull request #28921:
URL: https://github.com/apache/spark/pull/28921#issuecomment-648706030


   Can one of the admins verify this patch?


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org


[GitHub] [spark] AmplabJenkins removed a comment on pull request #28921: [SPARK-32086][YARN]Bug fix for RemoveBroadcast RPC failed after executor is shutdown

Posted by GitBox <gi...@apache.org>.
AmplabJenkins removed a comment on pull request #28921:
URL: https://github.com/apache/spark/pull/28921#issuecomment-648706656


   Can one of the admins verify this patch?


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org


[GitHub] [spark] SparkQA removed a comment on pull request #28921: [SPARK-32086][YARN]Bug fix for RemoveBroadcast RPC failed after executor is shutdown

Posted by GitBox <gi...@apache.org>.
SparkQA removed a comment on pull request #28921:
URL: https://github.com/apache/spark/pull/28921#issuecomment-650813132


   **[Test build #124608 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/124608/testReport)** for PR 28921 at commit [`6cfabad`](https://github.com/apache/spark/commit/6cfabad7a6ea9fdb7c5b9f0325e1f924965f9344).


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org


[GitHub] [spark] wankunde commented on pull request #28921: [SPARK-32086][YARN]Bug fix for RemoveBroadcast RPC failed after executor is shutdown

Posted by GitBox <gi...@apache.org>.
wankunde commented on pull request #28921:
URL: https://github.com/apache/spark/pull/28921#issuecomment-700800417


   > So I want to clarify, the only issue here is you see a warning log in the log files, correct?
   
   No, that's a RPC fail exception. 
   
   And I think the possible reason is :
   Phase 1: The AM killed the executor container while BlockManagerMaster has not removed the executor ref.
   Phase 2: BlockManagerMaster sends an RPC call to BlockManager on the dead executor.
   
   ![image](https://user-images.githubusercontent.com/3626747/85987789-b6fd6100-ba20-11ea-8e48-5c8de3b84b24.png)
   


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org


[GitHub] [spark] SparkQA removed a comment on pull request #28921: [SPARK-32086][YARN]Bug fix for RemoveBroadcast RPC failed after executor is shutdown

Posted by GitBox <gi...@apache.org>.
SparkQA removed a comment on pull request #28921:
URL: https://github.com/apache/spark/pull/28921#issuecomment-697840508


   **[Test build #129041 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/129041/testReport)** for PR 28921 at commit [`6cfabad`](https://github.com/apache/spark/commit/6cfabad7a6ea9fdb7c5b9f0325e1f924965f9344).


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org


[GitHub] [spark] dongjoon-hyun commented on a change in pull request #28921: [SPARK-32086][YARN]Bug fix for RemoveBroadcast RPC failed after executor is shutdown

Posted by GitBox <gi...@apache.org>.
dongjoon-hyun commented on a change in pull request #28921:
URL: https://github.com/apache/spark/pull/28921#discussion_r446690486



##########
File path: resource-managers/yarn/src/main/scala/org/apache/spark/scheduler/cluster/YarnSchedulerBackend.scala
##########
@@ -154,6 +154,7 @@ private[spark] abstract class YarnSchedulerBackend(
    * Request that the ApplicationMaster kill the specified executors.
    */
   override def doKillExecutors(executorIds: Seq[String]): Future[Boolean] = {
+    executorIds.foreach(sc.env.blockManager.master.removeExecutor)

Review comment:
       Hi, @wankunde . Do you think you can add a valid unit test case for that bug if you think so?
   > Bug fix for yarn Dynamic Resource Allocation.




----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org


[GitHub] [spark] SparkQA commented on pull request #28921: [SPARK-32086][YARN]Bug fix for RemoveBroadcast RPC failed after executor is shutdown

Posted by GitBox <gi...@apache.org>.
SparkQA commented on pull request #28921:
URL: https://github.com/apache/spark/pull/28921#issuecomment-650813132


   **[Test build #124608 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/124608/testReport)** for PR 28921 at commit [`6cfabad`](https://github.com/apache/spark/commit/6cfabad7a6ea9fdb7c5b9f0325e1f924965f9344).


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org


[GitHub] [spark] AmplabJenkins commented on pull request #28921: [SPARK-32086][YARN]Bug fix for RemoveBroadcast RPC failed after executor is shutdown

Posted by GitBox <gi...@apache.org>.
AmplabJenkins commented on pull request #28921:
URL: https://github.com/apache/spark/pull/28921#issuecomment-697868192






----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org


[GitHub] [spark] tgravescs commented on pull request #28921: [SPARK-32086][YARN]Bug fix for RemoveBroadcast RPC failed after executor is shutdown

Posted by GitBox <gi...@apache.org>.
tgravescs commented on pull request #28921:
URL: https://github.com/apache/spark/pull/28921#issuecomment-700252566


   So I want to clarify, the only issue here is you see a warning log in the log files, correct?


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org


[GitHub] [spark] AmplabJenkins commented on pull request #28921: [SPARK-32086][YARN]Bug fix for RemoveBroadcast RPC failed after executor is shutdown

Posted by GitBox <gi...@apache.org>.
AmplabJenkins commented on pull request #28921:
URL: https://github.com/apache/spark/pull/28921#issuecomment-697830954






----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org


[GitHub] [spark] AmplabJenkins removed a comment on pull request #28921: [SPARK-32086][YARN]Bug fix for RemoveBroadcast RPC failed after executor is shutdown

Posted by GitBox <gi...@apache.org>.
AmplabJenkins removed a comment on pull request #28921:
URL: https://github.com/apache/spark/pull/28921#issuecomment-650815415






----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org


[GitHub] [spark] holdenk commented on pull request #28921: [SPARK-32086][YARN]Bug fix for RemoveBroadcast RPC failed after executor is shutdown

Posted by GitBox <gi...@apache.org>.
holdenk commented on pull request #28921:
URL: https://github.com/apache/spark/pull/28921#issuecomment-697829881


   Jenkins ok to test.


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org