You are viewing a plain text version of this content. The canonical link for it is here.

Posted to reviews@spark.apache.org by GitBox <gi...@apache.org> on 2019/02/14 12:54:50 UTC

[GitHub] liupc commented on issue #23563: [SPARK-26634]Do not allow task of FetchFailureStage commit in OutputCommitCoordinator

liupc commented on issue #23563: [SPARK-26634]Do not allow task of FetchFailureStage commit in OutputCommitCoordinator
URL: https://github.com/apache/spark/pull/23563#issuecomment-463616803
 
 
   @cloud-fan @vanzin @viirya @HyukjinKwon 
   Sorry, I think this issue is resolved by https://github.com/apache/spark/pull/21131, and this PR allow `markPartitionCompletedInAllTaskSets` which is a better way to fix the issue we encountered in spark2.1,  as it improves performance by letting the partition being marked as successful by the first completion attempt.

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


With regards,
Apache Git Services

---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org