You are viewing a plain text version of this content. The canonical link for it is here.

Posted to user@spark.apache.org by Lijun Cao <64...@qq.com> on 2018/10/09 11:22:03 UTC

Internal Spark class is not registered by Kryo

Hi developers:

I have set spark.kryo.registrationRequired=true, but an exception occured: java.lang.IllegalArgumentException: Class is not registered: org.apache.spark.internal.io.FileCommitProtocol$TaskCommitMessage when I run the program. 

I tried to register it manually by kryo.register() and Sparkconf.registerKryoClasses, but it still not work.

The related JIRA is SPARK-21569. And SPARK-10251, SPARK-6497 are may the same problem I think. 

Be grateful if someone can help me..

Best Regards,
Lijun Cao