You are viewing a plain text version of this content. The canonical link for it is here.

Posted to reviews@spark.apache.org by xuanyuanking <gi...@git.apache.org> on 2018/11/12 03:38:50 UTC

[GitHub] spark pull request #22962: [SPARK-25921][PySpark] Fix barrier task run witho...

Github user xuanyuanking commented on a diff in the pull request:

    https://github.com/apache/spark/pull/22962#discussion_r232527808
  
    --- Diff: python/pyspark/tests.py ---
    @@ -614,6 +614,18 @@ def context_barrier(x):
             times = rdd.barrier().mapPartitions(f).map(context_barrier).collect()
             self.assertTrue(max(times) - min(times) < 1)
     
    +    def test_barrier_with_python_worker_reuse(self):
    +        """
    +        Verify that BarrierTaskContext.barrier() with reused python worker.
    +        """
    +        rdd = self.sc.parallelize(range(4), 4)
    --- End diff --
    
    Thanks, done in 02555b8.


---

---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org