You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@spark.apache.org by janardhan shetty <ja...@gmail.com> on 2016/11/21 02:09:03 UTC
Linear regression + Janino Exception
Hi,
I am trying to execute Linear regression algorithm for Spark 2.02 and
hitting the below error when I am fitting my training set:
val lrModel = lr.fit(train)
It happened on 2.0.0 as well. Any resolution steps is appreciated.
*Error Snippet: *
16/11/20 18:03:45 *ERROR CodeGenerator: failed to compile:
org.codehaus.janino.JaninoRuntimeException: Code of method
"(Lorg/apache/spark/sql/catalyst/expressions/GeneratedClass;[Ljava/lang/Object;)V"
of class
"org.apache.spark.sql.catalyst.expressions.GeneratedClass$SpecificUnsafeProjection"
grows beyond 64 KB*
/* 001 */ public java.lang.Object generate(Object[] references) {
/* 002 */ return new SpecificUnsafeProjection(references);
/* 003 */ }
/* 004 */
/* 005 */ class SpecificUnsafeProjection extends
org.apache.spark.sql.catalyst.expressions.UnsafeProjection {
/* 006 */
/* 007 */ private Object[] references;
/* 008 */ private org.apache.spark.sql.catalyst.expressions.ScalaUDF
scalaUDF;
/* 009 */ private scala.Function1 catalystConverter;
/* 010 */ private scala.Function1 converter;
/* 011 */ private scala.Function1 udf;
/* 012 */ private org.apache.spark.sql.catalyst.expressions.ScalaUDF
scalaUDF1;
/* 013 */ private scala.Function1 catalystConverter1;
/* 014 */ private scala.Function1 converter1;
/* 015 */ private scala.Function1 udf1;
/* 016 */ private org.apache.spark.sql.catalyst.expressions.ScalaUDF
scalaUDF2;
/* 017 */ private scala.Function1 catalystConverter2;
Re: Linear regression + Janino Exception
Posted by Kazuaki Ishizaki <IS...@jp.ibm.com>.
Thank you for reporting the error.
I think that this is associated to
https://issues.apache.org/jira/browse/SPARK-18492
The reporter of this JIRA entry has not posted the program yet. Would it
be possible to add your program that can reproduce this issue to this JIRA
entry?
Regards,
Kazuaki Ishizaki
From: janardhan shetty <ja...@gmail.com>
To: user <us...@spark.apache.org>
Date: 2016/11/21 12:01
Subject: Re: Linear regression + Janino Exception
Seems like this is associated to :
https://issues.apache.org/jira/browse/SPARK-16845
On Sun, Nov 20, 2016 at 6:09 PM, janardhan shetty <ja...@gmail.com>
wrote:
Hi,
I am trying to execute Linear regression algorithm for Spark 2.02 and
hitting the below error when I am fitting my training set:
val lrModel = lr.fit(train)
It happened on 2.0.0 as well. Any resolution steps is appreciated.
Error Snippet:
16/11/20 18:03:45 ERROR CodeGenerator: failed to compile:
org.codehaus.janino.JaninoRuntimeException: Code of method
"(Lorg/apache/spark/sql/catalyst/expressions/GeneratedClass;[Ljava/lang/Object;)V"
of class
"org.apache.spark.sql.catalyst.expressions.GeneratedClass$SpecificUnsafeProjection"
grows beyond 64 KB
/* 001 */ public java.lang.Object generate(Object[] references) {
/* 002 */ return new SpecificUnsafeProjection(references);
/* 003 */ }
/* 004 */
/* 005 */ class SpecificUnsafeProjection extends
org.apache.spark.sql.catalyst.expressions.UnsafeProjection {
/* 006 */
/* 007 */ private Object[] references;
/* 008 */ private org.apache.spark.sql.catalyst.expressions.ScalaUDF
scalaUDF;
/* 009 */ private scala.Function1 catalystConverter;
/* 010 */ private scala.Function1 converter;
/* 011 */ private scala.Function1 udf;
/* 012 */ private org.apache.spark.sql.catalyst.expressions.ScalaUDF
scalaUDF1;
/* 013 */ private scala.Function1 catalystConverter1;
/* 014 */ private scala.Function1 converter1;
/* 015 */ private scala.Function1 udf1;
/* 016 */ private org.apache.spark.sql.catalyst.expressions.ScalaUDF
scalaUDF2;
/* 017 */ private scala.Function1 catalystConverter2;
Re: Linear regression + Janino Exception
Posted by janardhan shetty <ja...@gmail.com>.
Seems like this is associated to :
https://issues.apache.org/jira/browse/SPARK-16845
On Sun, Nov 20, 2016 at 6:09 PM, janardhan shetty <ja...@gmail.com>
wrote:
> Hi,
>
> I am trying to execute Linear regression algorithm for Spark 2.02 and
> hitting the below error when I am fitting my training set:
>
> val lrModel = lr.fit(train)
>
>
> It happened on 2.0.0 as well. Any resolution steps is appreciated.
>
> *Error Snippet: *
> 16/11/20 18:03:45 *ERROR CodeGenerator: failed to compile:
> org.codehaus.janino.JaninoRuntimeException: Code of method
> "(Lorg/apache/spark/sql/catalyst/expressions/GeneratedClass;[Ljava/lang/Object;)V"
> of class
> "org.apache.spark.sql.catalyst.expressions.GeneratedClass$SpecificUnsafeProjection"
> grows beyond 64 KB*
> /* 001 */ public java.lang.Object generate(Object[] references) {
> /* 002 */ return new SpecificUnsafeProjection(references);
> /* 003 */ }
> /* 004 */
> /* 005 */ class SpecificUnsafeProjection extends
> org.apache.spark.sql.catalyst.expressions.UnsafeProjection {
> /* 006 */
> /* 007 */ private Object[] references;
> /* 008 */ private org.apache.spark.sql.catalyst.expressions.ScalaUDF
> scalaUDF;
> /* 009 */ private scala.Function1 catalystConverter;
> /* 010 */ private scala.Function1 converter;
> /* 011 */ private scala.Function1 udf;
> /* 012 */ private org.apache.spark.sql.catalyst.expressions.ScalaUDF
> scalaUDF1;
> /* 013 */ private scala.Function1 catalystConverter1;
> /* 014 */ private scala.Function1 converter1;
> /* 015 */ private scala.Function1 udf1;
> /* 016 */ private org.apache.spark.sql.catalyst.expressions.ScalaUDF
> scalaUDF2;
> /* 017 */ private scala.Function1 catalystConverter2;
>
>
>