You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@spark.apache.org by "Kan Zhang (JIRA)" <ji...@apache.org> on 2014/05/11 00:12:11 UTC

[jira] [Commented] (SPARK-1519) support minPartitions parameter of wholeTextFiles() in pyspark

    [ https://issues.apache.org/jira/browse/SPARK-1519?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13992980#comment-13992980 ] 

Kan Zhang commented on SPARK-1519:
----------------------------------

PR: https://github.com/apache/spark/pull/697

> support minPartitions parameter of wholeTextFiles() in pyspark
> --------------------------------------------------------------
>
>                 Key: SPARK-1519
>                 URL: https://issues.apache.org/jira/browse/SPARK-1519
>             Project: Spark
>          Issue Type: Improvement
>          Components: PySpark
>            Reporter: Nan Zhu
>
> though Scala implementation provides the parameter of minPartitions in wholeTextFiles, PySpark hasn't support it, 
> should be easy to add in context.py



--
This message was sent by Atlassian JIRA
(v6.2#6252)