You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@linkis.apache.org by binbincheng <74...@qq.com.INVALID> on 2023/01/18 07:00:05 UTC

[DISCUSS]When linkis submits tasks, can multiple queue settings be set?

Wechat group "Apache Linkis community Development group " chat records are as follows:
QiaoMu:
Now when linkis submits tasks, can we only set one queue globally? Can multiple queues be set up according to different engines, or different queues be set up according to different projects, or do you have this plan?


ZhangHuaJin:
It stands to reason that it is set by installing a proxy user


ZhangHuaJin:
Logically speaking, it is set by installing the proxy user, that is to say, the proxy user is a certain user who belongs to a certain user group. According to the prevention rules, the job will be submitted to a certain queue by default.



ocean:
very good!


ZhangHuaJin:
Of course, in the workflow, it is possible to set which queue each job is submitted to.



QiaoMu:
Let me see, if each workflow can be set, it means that resources can be divided according to the project



ZhangHuaJin:
In fact, it is with the proxy user



QiaoMu:
Then it is still based on the queue built by the proxy user, so it is impossible to specify a queue other than the proxy user?



ZhangHuaJin:
The node can specify which queue it needs to be in separately, provided that your proxy user needs to have permission to submit to the specified queue




QiaoMu:
very good!We plan to modify it later, and each project can set up a submission queue.




ZhangHuaJin:
nice!




------
微信群"Apache Linkis(incubating) 社区开发群"的聊天记录如下:&nbsp;



乔木:
咱们现在linkis提交任务的时候 队列设置&nbsp; 只能全局设置一个吗?能不能根据不同引擎设置多个队列&nbsp; 或者根据不同项目设置不同的队列&nbsp; 或者有这个规划没?


张华金:
按道理来说是安装代理用户来设置的,就是说代理用户是某个用户,属于某个用户组,根据防止规则默认将会把作业提交到某个队列。


ocean:
很棒!



张华金:
当然,在workflow里面,是可以设置每个作业提交到哪个队列的。


乔木:
我看看,如果每个工作流可以设置&nbsp; 那就等于可以按照项目进行资源划分了



张华金:
其实是跟代理用户走的


乔木:
那就还是根据代理用户建的队列,没法指定代理用户以外的队列了哟?




张华金:
节点可以单独指定需要在哪个队列,前提是你的代理用户需要有权限提交到这个指定的队列


乔木:
很棒!我们后面打算改造一下,每个项目可以设置一下提交的队列



张华金:
好的!