You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@linkis.apache.org by king hao <ki...@gmail.com> on 2023/02/28 11:14:32 UTC

[DISCUSS] spark engine jar package problem

silver

Teachers have a question for you.




linkis-engineplugin-spark-1.3.1.jar is not copied from
linkis-engineconn-plugins




Zhang Huajin

The logic is as follows: At startup, upload the local engine to HDFS,
download the engine management service from HDFS, generate a soft
connection to the EC directory, and then start




silver

Then why didn't you upload it?




Zhang Huajin

The engine is updated and the ecm needs to be restarted. The specific
reason why the ECM cannot be uploaded is to check the log. For example,
there is no hdfs directory permission or the hdfs cannot be connected




silver

Well, thank you, Miss Zhang. I'll look in the journal




silver

各位老师有个问题请教一下 linkis-engineplugin-spark-1.3.1.jar 为啥会到新生成的目录下面去寻找,而且还没有从
linkis-engineconn-plugins 复制过去。




Zhang Huajin

逻辑是这样的 启动的时候 把本地引擎上传到HDFS 然后引擎管理服务从HDFS下载下来 生成软连接到EC目录,再启动




silver

那为啥没有上传上去?




Zhang Huajin

更新了引擎 需要重启ecm的 具体为啥传不上去 要看看日志 一般是比如说没有hdfs目录权限或者hdfs连不上之类的




silver

嗯嗯,谢谢张老师,我找找日志看看