You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@linkis.apache.org by binbincheng <74...@qq.com.INVALID> on 2023/02/24 09:08:31 UTC
[DISCUSS]Discussion of some problems encountered in the process of deploying Linkis
Wechat group "Apache Linkis community Development group " chat records are as follows:
Barbarossa:
Hello everyone, when I deployed Linkis for the first time, linkis-ps-publicservice.log printed out the error "The first upload of the resource failed". How can I solve it? I use hadoop3.3.1, linkis1.3.1, hive3.3.1
Xia Chen:
Is it adapted according to the official website process?
Barbarossa:
hmm, yes
Xia Chen:
See if there is any abnormal information in the ps-publicservice log
speechless:
Have you used the flink engine?
Xia Chen:
https://github.com/apache/linkis/issues/4260 Is this the problem?
Barbarossa:
Yes, I just wanted to take a screenshot. This is the question I posted last night?
Barbarossa:
I modified the flink version according to the process, but it was not enabled
speechless:
Verified that there are not a bunch of mistakes, tuned one by one
Change!! (Intellect):
Permissions issue
Change!! (Intellect):
It seems to be hdfs
Barbarossa:
Is linkis the authority to call HDFS?
Barbarossa:
I tested that HDFS can be uploaded separately, and linkis can also create folders on HDFS during installation.
Mr. Lightning:
You can look up related information on the Internet
Mr. Lightning:
It is that hdfs is not working properly, and the command line interface is different from the java interface.
Barbarossa:
My installation user and user user are the same
Numbly:
This installation refers to the user who executes the install script?
Barbarossa:
Yes, that's how I understand it
Change!! (Intellect):
I have installed it a few times, and every time I encounter it, it should be solved by modifying the permissions or owner in hdfs.
Barbarossa:
I'll test it
-----------------
微信群“Apache Linkis社区开发群”聊天记录
如下面所述:
巴巴罗萨:
大家好,我在第一次部署Linkis的时候linkis-ps-publicservice.log打印出“The first upload of the resource failed”的错误。请问我该如何解决?我这用的是hadoop3.3.1、linkis1.3.1、hive3.3.1
夏晨:
是按官网流程进行的适配吗?
巴巴罗萨:
嗯嗯,对的
夏晨:
看下ps-publicservice日志下有没有异常信息
无言:
有没有用了flink引擎的
夏晨:
https://github.com/apache/linkis/issues/4260 是这个问题吗?
巴巴罗萨:
对对,我刚想去截图,这个就是我昨晚发的问题?
巴巴罗萨:
我按照流程修改了flink版本,但没有启用
无言:
验证了没有 一堆错 一个个调
Change!!(智纲):
权限问题
Change!!(智纲):
好像是hdfs的
巴巴罗萨:
linkis调用HDFS的权限吗?
巴巴罗萨:
我单独测试了HDFS是可以上传的,linkis在安装的时候也是能在HDFS上创建文件夹。
闪电先生:
这个问题可以看看上网查查相关资料
闪电先生:
是hdfs工作不正常,命令行接口和java接口不一样。
巴巴罗萨:
我的安装用户和使用用户是一致的
木然:
这个安装 指的是执行 install 脚本的用户?
巴巴罗萨:
对的,我是这样理解的
Change!!(智纲):
我安装过几次,每次都会碰到,应该都是通过修改hdfs里头的权限或者owner解决的。
巴巴罗萨:
我测试一下