You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "翟玉勇 (JIRA)" <ji...@apache.org> on 2017/04/06 10:18:41 UTC
[jira] [Comment Edited] (SPARK-20241)
java.lang.IllegalArgumentException: Can not set final [B field
org.codehaus.janino.util.ClassFile$CodeAttribute.code to
org.codehaus.janino.util.ClassFile$CodeAttribute
[ https://issues.apache.org/jira/browse/SPARK-20241?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15958698#comment-15958698 ]
翟玉勇 edited comment on SPARK-20241 at 4/6/17 10:18 AM:
------------------------------------------------------
add debug code
{code}
logInfo("***************" + codeAttrField.getDeclaringClass().getClassLoader())
logInfo("***************" + a.getClass().getClassLoader())
logInfo("***************" + (codeAttrField.getDeclaringClass() == a.getClass()))
{code}
if no WARN log
{code}
17/04/06 18:12:55 INFO [org.apache.spark.sql.catalyst.expressions.codegen.CodeGenerator(54) -- main]: ***************sun.misc.Launcher$AppClassLoader@44f757b9
17/04/06 18:12:55 INFO [org.apache.spark.sql.catalyst.expressions.codegen.CodeGenerator(54) -- main]: ***************sun.misc.Launcher$AppClassLoader@44f757b9
17/04/06 18:12:55 INFO [org.apache.spark.sql.catalyst.expressions.codegen.CodeGenerator(54) -- main]: ***************true
{code}
else
{code}
17/04/06 18:13:33 INFO [org.apache.spark.sql.catalyst.expressions.codegen.CodeGenerator(54) -- main]: ***************org.apache.spark.sql.hive.client.IsolatedClientLoader$$anon$1@54b30fa4
17/04/06 18:13:33 INFO [org.apache.spark.sql.catalyst.expressions.codegen.CodeGenerator(54) -- main]: ***************sun.misc.Launcher$AppClassLoader@44f757b9
17/04/06 18:13:33 INFO [org.apache.spark.sql.catalyst.expressions.codegen.CodeGenerator(54) -- main]: ***************false
{code}
was (Author: zhaiyuyong):
add debug code
{code}
logInfo("***************" + codeAttrField.getDeclaringClass().getClassLoader())
logInfo("***************" + a.getClass().getClassLoader())
logInfo("***************" + (codeAttrField.getDeclaringClass() == a.getClass()))
{code}
if no WARN log
17/04/06 18:12:55 INFO [org.apache.spark.sql.catalyst.expressions.codegen.CodeGenerator(54) -- main]: ***************sun.misc.Launcher$AppClassLoader@44f757b9
17/04/06 18:12:55 INFO [org.apache.spark.sql.catalyst.expressions.codegen.CodeGenerator(54) -- main]: ***************sun.misc.Launcher$AppClassLoader@44f757b9
17/04/06 18:12:55 INFO [org.apache.spark.sql.catalyst.expressions.codegen.CodeGenerator(54) -- main]: ***************true
else
17/04/06 18:13:33 INFO [org.apache.spark.sql.catalyst.expressions.codegen.CodeGenerator(54) -- main]: ***************org.apache.spark.sql.hive.client.IsolatedClientLoader$$anon$1@54b30fa4
17/04/06 18:13:33 INFO [org.apache.spark.sql.catalyst.expressions.codegen.CodeGenerator(54) -- main]: ***************sun.misc.Launcher$AppClassLoader@44f757b9
17/04/06 18:13:33 INFO [org.apache.spark.sql.catalyst.expressions.codegen.CodeGenerator(54) -- main]: ***************false
> java.lang.IllegalArgumentException: Can not set final [B field org.codehaus.janino.util.ClassFile$CodeAttribute.code to org.codehaus.janino.util.ClassFile$CodeAttribute
> ------------------------------------------------------------------------------------------------------------------------------------------------------------------------
>
> Key: SPARK-20241
> URL: https://issues.apache.org/jira/browse/SPARK-20241
> Project: Spark
> Issue Type: Bug
> Components: SQL
> Affects Versions: 2.1.0
> Reporter: 翟玉勇
> Priority: Minor
>
> do some sql operate for example :insert into table mytable select * from othertable
> there are WARN log:
> 17/04/06 17:04:55 WARN [org.apache.spark.sql.catalyst.expressions.codegen.CodeGenerator(87) -- main]: Error calculating stats of compiled class.
> java.lang.IllegalArgumentException: Can not set final [B field org.codehaus.janino.util.ClassFile$CodeAttribute.code to org.codehaus.janino.util.ClassFile$CodeAttribute
> at sun.reflect.UnsafeFieldAccessorImpl.throwSetIllegalArgumentException(UnsafeFieldAccessorImpl.java:164)
> at sun.reflect.UnsafeFieldAccessorImpl.throwSetIllegalArgumentException(UnsafeFieldAccessorImpl.java:168)
> at sun.reflect.UnsafeFieldAccessorImpl.ensureObj(UnsafeFieldAccessorImpl.java:55)
> at sun.reflect.UnsafeQualifiedObjectFieldAccessorImpl.get(UnsafeQualifiedObjectFieldAccessorImpl.java:38)
> at java.lang.reflect.Field.get(Field.java:379)
> at org.apache.spark.sql.catalyst.expressions.codegen.CodeGenerator$$anonfun$recordCompilationStats$1$$anonfun$apply$4$$anonfun$apply$5.apply(CodeGenerator.scala:997)
> at org.apache.spark.sql.catalyst.expressions.codegen.CodeGenerator$$anonfun$recordCompilationStats$1$$anonfun$apply$4$$anonfun$apply$5.apply(CodeGenerator.scala:984)
> at scala.collection.IndexedSeqOptimized$class.foreach(IndexedSeqOptimized.scala:33)
> at scala.collection.mutable.ArrayOps$ofRef.foreach(ArrayOps.scala:186)
> at org.apache.spark.sql.catalyst.expressions.codegen.CodeGenerator$$anonfun$recordCompilationStats$1$$anonfun$apply$4.apply(CodeGenerator.scala:984)
> at org.apache.spark.sql.catalyst.expressions.codegen.CodeGenerator$$anonfun$recordCompilationStats$1$$anonfun$apply$4.apply(CodeGenerator.scala:983)
> at scala.collection.Iterator$class.foreach(Iterator.scala:893)
> at scala.collection.AbstractIterator.foreach(Iterator.scala:1336)
> at scala.collection.IterableLike$class.foreach(IterableLike.scala:72)
> at scala.collection.AbstractIterable.foreach(Iterable.scala:54)
> at org.apache.spark.sql.catalyst.expressions.codegen.CodeGenerator$$anonfun$recordCompilationStats$1.apply(CodeGenerator.scala:983)
> at org.apache.spark.sql.catalyst.expressions.codegen.CodeGenerator$$anonfun$recordCompilationStats$1.apply(CodeGenerator.scala:979)
> at scala.collection.Iterator$class.foreach(Iterator.scala:893)
> at scala.collection.AbstractIterator.foreach(Iterator.scala:1336)
> at scala.collection.IterableLike$class.foreach(IterableLike.scala:72)
> at scala.collection.AbstractIterable.foreach(Iterable.scala:54)
> at org.apache.spark.sql.catalyst.expressions.codegen.CodeGenerator$.recordCompilationStats(CodeGenerator.scala:979)
> at org.apache.spark.sql.catalyst.expressions.codegen.CodeGenerator$.org$apache$spark$sql$catalyst$expressions$codegen$CodeGenerator$$doCompile(CodeGenerator.scala:951)
> at org.apache.spark.sql.catalyst.expressions.codegen.CodeGenerator$$anon$1.load(CodeGenerator.scala:1023)
> at org.apache.spark.sql.catalyst.expressions.codegen.CodeGenerator$$anon$1.load(CodeGenerator.scala:1020)
> at org.spark_project.guava.cache.LocalCache$LoadingValueReference.loadFuture(LocalCache.java:3599)
> at org.spark_project.guava.cache.LocalCache$Segment.loadSync(LocalCache.java:2379)
> at org.spark_project.guava.cache.LocalCache$Segment.lockedGetOrLoad(LocalCache.java:2342)
> at org.spark_project.guava.cache.LocalCache$Segment.get(LocalCache.java:2257)
> at org.spark_project.guava.cache.LocalCache.get(LocalCache.java:4000)
> at org.spark_project.guava.cache.LocalCache.getOrLoad(LocalCache.java:4004)
> at org.spark_project.guava.cache.LocalCache$LocalLoadingCache.get(LocalCache.java:4874)
> at org.apache.spark.sql.catalyst.expressions.codegen.CodeGenerator$.compile(CodeGenerator.scala:905)
> at org.apache.spark.sql.execution.WholeStageCodegenExec.doExecute(WholeStageCodegenExec.scala:357)
> at org.apache.spark.sql.execution.SparkPlan$$anonfun$execute$1.apply(SparkPlan.scala:114)
> at org.apache.spark.sql.execution.SparkPlan$$anonfun$execute$1.apply(SparkPlan.scala:114)
> at org.apache.spark.sql.execution.SparkPlan$$anonfun$executeQuery$1.apply(SparkPlan.scala:135)
> at org.apache.spark.rdd.RDDOperationScope$.withScope(RDDOperationScope.scala:151)
> at org.apache.spark.sql.execution.SparkPlan.executeQuery(SparkPlan.scala:132)
> at org.apache.spark.sql.execution.SparkPlan.execute(SparkPlan.scala:113)
> at org.apache.spark.sql.hive.execution.InsertIntoHiveTable.sideEffectResult$lzycompute(InsertIntoHiveTable.scala:310)
> at org.apache.spark.sql.hive.execution.InsertIntoHiveTable.sideEffectResult(InsertIntoHiveTable.scala:221)
> at org.apache.spark.sql.hive.execution.InsertIntoHiveTable.executeCollect(InsertIntoHiveTable.scala:404)
> at org.apache.spark.sql.execution.SparkPlan.executeCollectPublic(SparkPlan.scala:295)
> at org.apache.spark.sql.execution.QueryExecution$$anonfun$hiveResultString$3.apply(QueryExecution.scala:137)
> at org.apache.spark.sql.execution.QueryExecution$$anonfun$hiveResultString$3.apply(QueryExecution.scala:136)
> at org.apache.spark.sql.execution.SQLExecution$.withNewExecutionId(SQLExecution.scala:57)
> at org.apache.spark.sql.execution.QueryExecution.hiveResultString(QueryExecution.scala:136)
> at org.apache.spark.sql.hive.thriftserver.SparkSQLDriver.run(SparkSQLDriver.scala:63)
> at org.apache.spark.sql.hive.thriftserver.SparkSQLCLIDriver.processCmd(SparkSQLCLIDriver.scala:335)
> at org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:376)
> at org.apache.spark.sql.hive.thriftserver.SparkSQLCLIDriver$.main(SparkSQLCLIDriver.scala:247)
> at org.apache.spark.sql.hive.thriftserver.SparkSQLCLIDriver.main(SparkSQLCLIDriver.scala)
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> at java.lang.reflect.Method.invoke(Method.java:606)
> at org.apache.spark.deploy.SparkSubmit$.org$apache$spark$deploy$SparkSubmit$$runMain(SparkSubmit.scala:737)
> at org.apache.spark.deploy.SparkSubmit$$anon$1.run(SparkSubmit.scala:168)
> at org.apache.spark.deploy.SparkSubmit$$anon$1.run(SparkSubmit.scala:166)
> at java.security.AccessController.doPrivileged(Native Method)
> at javax.security.auth.Subject.doAs(Subject.java:415)
> at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1693)
> at org.apache.spark.deploy.SparkSubmit$.doRunMain$1(SparkSubmit.scala:166)
> at org.apache.spark.deploy.SparkSubmit$.submit(SparkSubmit.scala:211)
> at org.apache.spark.deploy.SparkSubmit$.main(SparkSubmit.scala:126)
> at org.apache.spark.deploy.SparkSubmit.main(SparkSubmit.scala)
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org