You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@linkis.apache.org by 肖培栋 <xi...@163.com> on 2022/07/26 08:18:45 UTC
linkis 调用spark 问题
linkis 1.0.3 版本
spark spark-2.4.5-bin-hadoop2.7
出现报错内容：Job with execId-IDE_admin_spark_8 and subJobId : 9 from orchestrator completed with state ErrorExecuteResponse(21304, Task is Failed,errorMsg: errCode: 12003 ,desc: hadoop1:9101_8 Failed to async get EngineNode RMErrorException: errCode: 11006 ,desc: Failed to request external resourceClassCastException: org.json4s.JsonAST$JNothing$ cannot be cast to org.json4s.JsonAST$JString ,ip: hadoop1 ,port: 9101 ,serviceKind: linkis-cg-linkismanager ,ip: hadoop1 ,port: 9104 ,serviceKind: linkis-cg-entrance,null)
查看 json4s 的版本都一致，问题出在哪里呢
Re: linkis 调用spark 问题
Posted by peacewong <pe...@apache.org>.
Hello, does the corresponding Yarn queue name not exist? You can give it to
the log of linkisManager.、
你好，是不是对应的Yarn队列名不存在呢，可以给下linkisManager的日志下
肖培栋 <xi...@163.com> 于2022年7月26日周二 19:43写道：
> linkis 1.0.3 版本
> spark spark-2.4.5-bin-hadoop2.7
>
> 出现报错内容：Job with execId-IDE_admin_spark_8 and subJobId : 9 from
> orchestrator completed with state ErrorExecuteResponse(21304, Task is
> Failed,errorMsg: errCode: 12003 ,desc: hadoop1:9101_8 Failed to async get
> EngineNode RMErrorException: errCode: 11006 ,desc: Failed to request
> external resourceClassCastException: org.json4s.JsonAST$JNothing$ cannot be
> cast to org.json4s.JsonAST$JString ,ip: hadoop1 ,port: 9101 ,serviceKind:
> linkis-cg-linkismanager ,ip: hadoop1 ,port: 9104 ,serviceKind:
> linkis-cg-entrance,null)
>
>
> 查看 json4s 的版本都一致，问题出在哪里呢
>
Re: linkis 调用spark 问题
Posted by Ling Xu <ja...@apache.org>.
json4s jar不能直接替换，替换json4s jar 后需要重新编译。
mvn -N install mvn clean install
肖培栋 <xi...@163.com> 于2022年7月26日周二 19:43写道：
> linkis 1.0.3 版本
> spark spark-2.4.5-bin-hadoop2.7
>
> 出现报错内容：Job with execId-IDE_admin_spark_8 and subJobId : 9 from
> orchestrator completed with state ErrorExecuteResponse(21304, Task is
> Failed,errorMsg: errCode: 12003 ,desc: hadoop1:9101_8 Failed to async get
> EngineNode RMErrorException: errCode: 11006 ,desc: Failed to request
> external resourceClassCastException: org.json4s.JsonAST$JNothing$ cannot be
> cast to org.json4s.JsonAST$JString ,ip: hadoop1 ,port: 9101 ,serviceKind:
> linkis-cg-linkismanager ,ip: hadoop1 ,port: 9104 ,serviceKind:
> linkis-cg-entrance,null)
>
>
> 查看 json4s 的版本都一致，问题出在哪里呢
>