You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@linkis.apache.org by binbincheng <74...@qq.com.INVALID> on 2023/02/18 12:42:23 UTC
[DISCUSS]Will the datax engine execute twice?
Wechat group "Apache Linkis community Development group " chat records are as follows:
She said:
@ peacewong@WDS Is there any idea that Big Brother Exchangegis will start the datax engine twice? This engine is not reusable
Mr. Lightning:
Appconn is all reusable
She said:
Datax is not the same as reading and writing plug-ins. What I observed was also destroyed directly after use
tree:
@She said that Boss, does 1.3.1 you deploy have "save/configure"?
She said:
Yes, do you choose to put it on hdfs?
Mr. Lightning:
I'm so worried
tree:
yes. Does the storage path have these two options in hdfs?
She said:
yes
tree:
ok
peacewong@WDS :
I think it can be compatible. Which proxy user is it? What is wrong? Normally, it will not start twice. Is there any error?
She said:
freedom from error
peacewong@WDS :
Front-end problems. You can check the log of linkis manager
She said:
I didn't see any errors in this one. It was started successfully and automatically destroyed
Ltz:
We have solved the problem of error in transformation
peacewong@WDS :
Let me have a look at the Exchanges log
peacewong@WDS :
good
-----------------
微信群“Apache Linkis社区开发群”聊天记录
如下面所述:
她说:
@peacewong@WDS 大佬exchangis执行datax引擎会启动两次这个有思路吗?这个引擎是不可复用的吧
闪电先生:
Appconn全部是复用的
她说:
datax的不会吧读取写入的插件插件一样。我观察的也是用完直接销毁的
乔木:
@她說 大佬 你部署的1.3.1 有“保存/配置”吗?
她说:
这个有啊 你是不是选择放到hdfs上了?
闪电先生:
都好担心没了
乔木:
是的。存储路径在hdfs就没有这两个选项吗?
她说:
是的
乔木:
好吧
peacewong@WDS:
感觉可以做兼容下。是哪个代理用户呢?是什么报错呢?正常不会启动两次,有错误吗?
她说:
没有错误
peacewong@WDS:
前端的问题。可以看看linkis manager的日志
她说:
这个也没看到错误,启动成功还自动销毁了
Ltz:
转化的时候出错的 我们已经解决了
peacewong@WDS:
Exchangis额日志给下看看
peacewong@WDS:
好的