You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@linkis.apache.org by king hao <ki...@gmail.com> on 2023/02/28 11:14:32 UTC
[DISCUSS] spark engine jar package problem
silver
Teachers have a question for you.
linkis-engineplugin-spark-1.3.1.jar is not copied from
linkis-engineconn-plugins
Zhang Huajin
The logic is as follows: At startup, upload the local engine to HDFS,
download the engine management service from HDFS, generate a soft
connection to the EC directory, and then start
silver
Then why didn't you upload it?
Zhang Huajin
The engine is updated and the ecm needs to be restarted. The specific
reason why the ECM cannot be uploaded is to check the log. For example,
there is no hdfs directory permission or the hdfs cannot be connected
silver
Well, thank you, Miss Zhang. I'll look in the journal
silver
各位老师有个问题请教一下 linkis-engineplugin-spark-1.3.1.jar 为啥会到新生成的目录下面去寻找,而且还没有从
linkis-engineconn-plugins 复制过去。
Zhang Huajin
逻辑是这样的 启动的时候 把本地引擎上传到HDFS 然后引擎管理服务从HDFS下载下来 生成软连接到EC目录,再启动
silver
那为啥没有上传上去?
Zhang Huajin
更新了引擎 需要重启ecm的 具体为啥传不上去 要看看日志 一般是比如说没有hdfs目录权限或者hdfs连不上之类的
silver
嗯嗯,谢谢张老师,我找找日志看看