You are viewing a plain text version of this content. The canonical link for it is here.
Posted to notifications@kyuubi.apache.org by "zwangsheng (via GitHub)" <gi...@apache.org> on 2023/11/13 06:14:37 UTC
[I] [TASK][MEDIUM] Optimize kyuubi spark engine driver pod name generation [kyuubi]
zwangsheng opened a new issue, #5680:
URL: https://github.com/apache/kyuubi/issues/5680
### What's the level of this task?
MEDIUM
### Code of Conduct
- [X] I agree to follow this project's [Code of Conduct](https://www.apache.org/foundation/policies/conduct)
### Search before creating
- [X] I have searched in the [task list](https://github.com/orgs/apache/projects/296) and found no similar tasks.
### Mentor
- [X] I have sufficient expertise on this task, and I volunteer to be a mentor of this task to guide contributors through the task.
### Skill requirements
- Scala
- Spark Config about Spark Driver Pod Name and Spark App Name
### Background and Goals
Background:
In default case, when kyuubi submit spark sql engine on kubernetes, will generate spark driver pod name with `kyuubi--${app_name}-${engine_ref_id}-driver`. And app_name will be `kyuubi_${shareLevel}_${engineType}_${appUser}_${engineRefId}` if not set by user. In result, we may get spark driver pod name with `kyuubi-kyuubi-${shareLevel}-${engineType}-${appUser}-${engineRefId}-${engineRefId}-driver`.
We were hoping for a more concise name, such as `kyuubi-${shareLevel}-${engineType}-${appUser}-${engineRefId}-driver`.
### Implementation steps
1. modify logic in `SparkProcessBuilder#appendPodNameConf` method.
### Additional context
Introduction of [2023 Kyuubi Code Contribution Program](https://github.com/apache/kyuubi/issues/5357)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: notifications-unsubscribe@kyuubi.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: notifications-unsubscribe@kyuubi.apache.org
For additional commands, e-mail: notifications-help@kyuubi.apache.org
Re: [I] [TASK][EASY] Optimize kyuubi spark engine driver pod name generation [kyuubi]
Posted by "zwangsheng (via GitHub)" <gi...@apache.org>.
zwangsheng commented on issue #5680:
URL: https://github.com/apache/kyuubi/issues/5680#issuecomment-1822339868
> someone is doing this task, right ? @zwangsheng
Yes, there is PR #5695 to fix this
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: notifications-unsubscribe@kyuubi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: notifications-unsubscribe@kyuubi.apache.org
For additional commands, e-mail: notifications-help@kyuubi.apache.org
Re: [I] [TASK][EASY] Optimize kyuubi spark engine driver pod name generation [kyuubi]
Posted by "pan3793 (via GitHub)" <gi...@apache.org>.
pan3793 closed issue #5680: [TASK][EASY] Optimize kyuubi spark engine driver pod name generation
URL: https://github.com/apache/kyuubi/issues/5680
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: notifications-unsubscribe@kyuubi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: notifications-unsubscribe@kyuubi.apache.org
For additional commands, e-mail: notifications-help@kyuubi.apache.org
Re: [I] [TASK][EASY] Optimize kyuubi spark engine driver pod name generation [kyuubi]
Posted by "Ocean22 (via GitHub)" <gi...@apache.org>.
Ocean22 commented on issue #5680:
URL: https://github.com/apache/kyuubi/issues/5680#issuecomment-1837694073
Yes,you can refer to PR #5695 to fix it yourself first.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: notifications-unsubscribe@kyuubi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: notifications-unsubscribe@kyuubi.apache.org
For additional commands, e-mail: notifications-help@kyuubi.apache.org
Re: [I] [TASK][EASY] Optimize kyuubi spark engine driver pod name generation [kyuubi]
Posted by "zhaohehuhu (via GitHub)" <gi...@apache.org>.
zhaohehuhu commented on issue #5680:
URL: https://github.com/apache/kyuubi/issues/5680#issuecomment-1822199479
someone is doing this task, right ? @zwangsheng
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: notifications-unsubscribe@kyuubi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: notifications-unsubscribe@kyuubi.apache.org
For additional commands, e-mail: notifications-help@kyuubi.apache.org
Re: [I] [TASK][EASY] Optimize kyuubi spark engine driver pod name generation [kyuubi]
Posted by "liaoyt (via GitHub)" <gi...@apache.org>.
liaoyt commented on issue #5680:
URL: https://github.com/apache/kyuubi/issues/5680#issuecomment-1837075463
does this still in progress?
i'm facing the issue that the pod name is too long, and hoping this issue is fixed.
<img width="1518" alt="image" src="https://github.com/apache/kyuubi/assets/12195059/605b6346-8f35-497f-bfed-c55c8c0c67b5">
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: notifications-unsubscribe@kyuubi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: notifications-unsubscribe@kyuubi.apache.org
For additional commands, e-mail: notifications-help@kyuubi.apache.org
Re: [I] [TASK][EASY] Optimize kyuubi spark engine driver pod name generation [kyuubi]
Posted by "pan3793 (via GitHub)" <gi...@apache.org>.
pan3793 commented on issue #5680:
URL: https://github.com/apache/kyuubi/issues/5680#issuecomment-1837856774
@liaoyt please try master or branch-1.8
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: notifications-unsubscribe@kyuubi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: notifications-unsubscribe@kyuubi.apache.org
For additional commands, e-mail: notifications-help@kyuubi.apache.org