You are viewing a plain text version of this content. The canonical link for it is here.
Posted to reviews@spark.apache.org by MaxGekk <gi...@git.apache.org> on 2018/08/03 12:09:50 UTC

[GitHub] spark pull request #21913: [WIP][SPARK-24005][CORE] Remove usage of Scala���...

Github user MaxGekk commented on a diff in the pull request:

    https://github.com/apache/spark/pull/21913#discussion_r207524725
  
    --- Diff: core/src/main/scala/org/apache/spark/util/ThreadUtils.scala ---
    @@ -254,4 +254,49 @@ private[spark] object ThreadUtils {
           executor.shutdownNow()
         }
       }
    +
    +  /**
    +   * Transforms input collection by applying the given function to each element in parallel fashion.
    +   *
    +   * @param in - the input collection which should be transformed in parallel.
    +   * @param prefix - the prefix assigned to the underlying thread pool.
    +   * @param maxThreads - maximum number of thread can be created during execution.
    +   * @param f - the lambda function will be applied to each element of `in`.
    +   * @tparam I - the type of elements in the input collection.
    +   * @tparam O - the type of elements in resulted collection.
    +   * @return new collection in which each element was given from the input collection `in` by
    +   *         applying the lambda function `f`.
    +   */
    +  def parmap[I, O](
    +      in: TraversableOnce[I],
    --- End diff --
    
    @zsxwing Thank you very much for the code.


---

---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org