You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@spark.apache.org by Jan-Paul Bultmann <ja...@me.com> on 2015/04/24 14:40:34 UTC
Stackoverflow in createDataFrame.
Hey,
I get a stack overflow when calling the following method on SQLContext.
def createDataFrame(rowRDD: JavaRDD[Row], columns: java.util.List[String]): DataFrame = {
createDataFrame(rowRDD.rdd, columns.toSeq)
} <https://github.com/apache/spark/blob/master/sql/core/src/main/scala/org/apache/spark/sql/SQLContext.scala#L441>
The function will just call itself over and over.
If you consider this a bug as well I'll gladly open an JIRA issue :).
Cheers Jan
Re: Stackoverflow in createDataFrame.
Posted by Jan-Paul Bultmann <ja...@me.com>.
Sorry, missed that issue :)
> On 24 Apr 2015, at 15:17, yash datta <sa...@gmail.com> wrote:
>
> This is already reported :
>
> https://issues.apache.org/jira/browse/SPARK-6999 <https://issues.apache.org/jira/browse/SPARK-6999>
> On 24 Apr 2015 18:11, "Jan-Paul Bultmann" <janpaulbultmann@me.com <ma...@me.com>> wrote:
> Hey,
> I get a stack overflow when calling the following method on SQLContext.
>
> def createDataFrame(rowRDD: JavaRDD[Row], columns: java.util.List[String]): DataFrame = {
> createDataFrame(rowRDD.rdd, columns.toSeq)
> } <https://github.com/apache/spark/blob/master/sql/core/src/main/scala/org/apache/spark/sql/SQLContext.scala#L441 <https://github.com/apache/spark/blob/master/sql/core/src/main/scala/org/apache/spark/sql/SQLContext.scala#L441>>
>
> The function will just call itself over and over.
>
> If you consider this a bug as well I'll gladly open an JIRA issue :).
>
> Cheers Jan
Re: Stackoverflow in createDataFrame.
Posted by yash datta <sa...@gmail.com>.
This is already reported :
https://issues.apache.org/jira/browse/SPARK-6999
On 24 Apr 2015 18:11, "Jan-Paul Bultmann" <ja...@me.com> wrote:
> Hey,
> I get a stack overflow when calling the following method on SQLContext.
>
> def createDataFrame(rowRDD: JavaRDD[Row], columns:
> java.util.List[String]): DataFrame = {
> createDataFrame(rowRDD.rdd, columns.toSeq)
> } <
> https://github.com/apache/spark/blob/master/sql/core/src/main/scala/org/apache/spark/sql/SQLContext.scala#L441
> >
>
> The function will just call itself over and over.
>
> If you consider this a bug as well I'll gladly open an JIRA issue :).
>
> Cheers Jan