You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@streampark.apache.org by "lordk911 (via GitHub)" <gi...@apache.org> on 2023/10/08 10:20:01 UTC
[I] [Feature] when submit jar type application to yarn , use the user logged in to streampark. [incubator-streampark]
lordk911 opened a new issue, #3222:
URL: https://github.com/apache/incubator-streampark/issues/3222
### Search before asking
- [X] I had searched in the [issues](https://github.com/apache/incubator-streampark/issues?q=is%3Aissue+label%3A%22bug%22) and found no similar issues.
### Java Version
1.8
### Scala Version
2.12.x
### StreamPark Version
2.1.1
### Flink Version
flink-1.17
### deploy mode
yarn-application
### What happened
when submit jar type application to yarn , the user is hadoop-user-name configed in application.yml
can this use streampark logged in user , or maybe the streampark user could map to a system user?
### Error Exception
_No response_
### Screenshots
_No response_
### Are you willing to submit PR?
- [ ] Yes I am willing to submit a PR!(您是否要贡献这个PR?)
### Code of Conduct
- [X] I agree to follow this project's [Code of Conduct](https://www.apache.org/foundation/policies/conduct)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@streampark.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [Feature] when submit application to yarn , use the user logged in to streampark. [incubator-streampark]
Posted by "zhaoyu810373097 (via GitHub)" <gi...@apache.org>.
zhaoyu810373097 commented on issue #3222:
URL: https://github.com/apache/incubator-streampark/issues/3222#issuecomment-1835710668
> 当作业在 yarn 模式下运行时,我们可以通过允许在作业中指定 hadoop-user 来支持此功能。
要如何指定hadoop-user呢?通过哪个配置参数
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@streampark.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [Feature] when submit application to yarn , use the user logged in to streampark. [incubator-streampark]
Posted by "lordk911 (via GitHub)" <gi...@apache.org>.
lordk911 commented on issue #3222:
URL: https://github.com/apache/incubator-streampark/issues/3222#issuecomment-2216288857
@wolfboys Is this Feature already supported or any plan about it?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@streampark.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [Feature] when submit application to yarn , use the user logged in to streampark. [incubator-streampark]
Posted by "lordk911 (via GitHub)" <gi...@apache.org>.
lordk911 commented on issue #3222:
URL: https://github.com/apache/incubator-streampark/issues/3222#issuecomment-1851235002
hi, Is there any draft or progress on resolving this issue? @wolfboys
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@streampark.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [Feature] when submit application to yarn , use the user logged in to streampark. [incubator-streampark]
Posted by "wolfboys (via GitHub)" <gi...@apache.org>.
wolfboys closed issue #3222: [Feature] when submit application to yarn , use the user logged in to streampark.
URL: https://github.com/apache/incubator-streampark/issues/3222
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@streampark.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [Feature] when submit application to yarn , use the user logged in to streampark. [incubator-streampark]
Posted by "lordk911 (via GitHub)" <gi...@apache.org>.
lordk911 commented on issue #3222:
URL: https://github.com/apache/incubator-streampark/issues/3222#issuecomment-1751999516
> Currently, hadoop-user is read from application.yml. I guess you need different login users to bind different user identities when submitting jobs, right?
Yes, For one reason, it is for security considerations, and for another reason, from the perspective of operation and maintenance, it can easily differentiate whose task it is through user identification.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@streampark.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [Feature] when submit application to yarn , use the user logged in to streampark. [incubator-streampark]
Posted by "wolfboys (via GitHub)" <gi...@apache.org>.
wolfboys commented on issue #3222:
URL: https://github.com/apache/incubator-streampark/issues/3222#issuecomment-1752334242
We can support this feature by allowing the specification of hadoop-user in the job when it is running on yarn mode.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@streampark.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [Feature] when submit application to yarn , use the user logged in to streampark. [incubator-streampark]
Posted by "wolfboys (via GitHub)" <gi...@apache.org>.
wolfboys commented on issue #3222:
URL: https://github.com/apache/incubator-streampark/issues/3222#issuecomment-1851271461
> when submit jar type application to yarn , the user is hadoop-user-name configed in application.yml
> can this use streampark logged in user , or maybe the streampark user could map to a system user?
Thanks for your feedback. We have compiled [tracking issues of StreamPark 2.2.0](#3278)
Currently, this feature is not included in the plan. After my evaluation, I found that implementing this feature is simple. We just need to add an input for the Hadoop-user in the job definition page and retrieve the specified Hadoop-user when start the job. This is a good first issue, and of course, welcome your contribution and participation. 😊
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@streampark.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [Feature] when submit application to yarn , use the user logged in to streampark. [incubator-streampark]
Posted by "saLeox (via GitHub)" <gi...@apache.org>.
saLeox commented on issue #3222:
URL: https://github.com/apache/incubator-streampark/issues/3222#issuecomment-1763794894
@lordk911 Hi, if you have kerberos environment, you can consider to add keytab into your Flink application within streampark, so that your job will be runing on the behalf of the user you sepecify.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@streampark.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [Feature] when submit application to yarn , use the user logged in to streampark. [incubator-streampark]
Posted by "wolfboys (via GitHub)" <gi...@apache.org>.
wolfboys commented on issue #3222:
URL: https://github.com/apache/incubator-streampark/issues/3222#issuecomment-1751998186
Currently, hadoop-user is read from application.yml. I guess you need different login users to bind different user identities when submitting jobs, right?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@streampark.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [Feature] when submit application to yarn , use the user logged in to streampark. [incubator-streampark]
Posted by "lordk911 (via GitHub)" <gi...@apache.org>.
lordk911 commented on issue #3222:
URL: https://github.com/apache/incubator-streampark/issues/3222#issuecomment-1857731532
@wolfboys I've made a PR, I'm not familiar with front-end development. And I think the change about YarnApplicationClient is not good , but I don't know how to use ProxyUser.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@streampark.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [Feature] when submit application to yarn , use the user logged in to streampark. [incubator-streampark]
Posted by "lordk911 (via GitHub)" <gi...@apache.org>.
lordk911 commented on issue #3222:
URL: https://github.com/apache/incubator-streampark/issues/3222#issuecomment-1853478177
我在useCreateAndEditSchema.ts里加了一个输入项,在编辑 Application 和新建 Application时,可以看到这个输入项目。
通过浏览器的调试工具可以看到,提交表单时的请求路径是:/flink/app/update,在app.ts可以找到。但是我在后端的代码里,没有看到相关的request mapping。我该怎么把新加的输入项的值保存到数据库?
@wolfboys 能否给些线索
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@streampark.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org