You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@linkis.apache.org by binbincheng <74...@qq.com.INVALID> on 2023/02/18 12:42:23 UTC

[DISCUSS]Will the datax engine execute twice?

Wechat group "Apache Linkis community Development group " chat records are as follows:


She said:
@ peacewong@WDS Is there any idea that Big Brother Exchangegis will start the datax engine twice? This engine is not reusable


Mr. Lightning:
Appconn is all reusable


She said:
Datax is not the same as reading and writing plug-ins. What I observed was also destroyed directly after use


tree:
@She said that Boss, does 1.3.1 you deploy have "save/configure"?


She said:
Yes, do you choose to put it on hdfs?


Mr. Lightning:
I'm so worried


tree:
yes. Does the storage path have these two options in hdfs?


She said:
yes


tree:
ok


peacewong@WDS :
I think it can be compatible. Which proxy user is it? What is wrong? Normally, it will not start twice. Is there any error?


She said:
freedom from error


peacewong@WDS :
Front-end problems. You can check the log of linkis manager


She said:
I didn't see any errors in this one. It was started successfully and automatically destroyed


Ltz:
We have solved the problem of error in transformation


peacewong@WDS :
Let me have a look at the Exchanges log


peacewong@WDS :
good



-----------------




微信群“Apache Linkis社区开发群”聊天记录
如下面所述:



她说:
@peacewong@WDS 大佬exchangis执行datax引擎会启动两次这个有思路吗?这个引擎是不可复用的吧


闪电先生:
Appconn全部是复用的



她说:
datax的不会吧读取写入的插件插件一样。我观察的也是用完直接销毁的


乔木:
@她說 大佬 你部署的1.3.1 有“保存/配置”吗?


她说:
这个有啊 你是不是选择放到hdfs上了?


闪电先生:
都好担心没了


乔木:
是的。存储路径在hdfs就没有这两个选项吗?


她说:
是的


乔木:
好吧


peacewong@WDS:
感觉可以做兼容下。是哪个代理用户呢?是什么报错呢?正常不会启动两次,有错误吗?


她说:
没有错误


peacewong@WDS:
前端的问题。可以看看linkis manager的日志


她说:
这个也没看到错误,启动成功还自动销毁了


Ltz:
转化的时候出错的 我们已经解决了


peacewong@WDS:
Exchangis额日志给下看看


peacewong@WDS:
好的