You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@spark.apache.org by "Narine Kokhlikyan (JIRA)" <ji...@apache.org> on 2016/06/10 21:50:20 UTC

[jira] [Created] (SPARK-15884) Override stringArgs method in MapPartitionsInR case class in order to avoid Out Of Mermory exceptions when calling toString

Narine Kokhlikyan created SPARK-15884:
-----------------------------------------

             Summary: Override stringArgs method in MapPartitionsInR case class in order to avoid Out Of Mermory exceptions when calling toString
                 Key: SPARK-15884
                 URL: https://issues.apache.org/jira/browse/SPARK-15884
             Project: Spark
          Issue Type: Bug
          Components: SparkR, SQL
            Reporter: Narine Kokhlikyan


As discussed in https://github.com/apache/spark/pull/12836
we need to override stringArgs method in MapPartitionsInR in order to avoid too large strings generated by "stringArgs" method based on the input arguments. 

In this case exclude some of the input arguments: serialized R objects.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org