You are viewing a plain text version of this content. The canonical link for it is here.
Posted to notifications@kyuubi.apache.org by "Xaprice (via GitHub)" <gi...@apache.org> on 2023/08/24 06:13:57 UTC

[GitHub] [kyuubi] Xaprice opened a new issue, #5197: [Improvement] enhancing TTL feature of spark engine instance

Xaprice opened a new issue, #5197:
URL: https://github.com/apache/kyuubi/issues/5197

   ### Code of Conduct
   
   - [X] I agree to follow this project's [Code of Conduct](https://www.apache.org/foundation/policies/conduct)
   
   
   ### Search before asking
   
   - [X] I have searched in the [issues](https://github.com/apache/kyuubi/issues?q=is%3Aissue) and found no similar issues.
   
   
   ### What would you like to be improved?
   
   We are currently using the sharelevel+subdomain feature of kyuubi. It's a useful feature, and in most cases works well. only one problem is that some application will be long-living. Long-living application will have too many jobs , in our case the number of jobs will be 10000+. Considering the efficiency of reviewing history and stability, maybe this is not a good thing.
   
   Now in kyuubi, Spark Engine Instance already has the concept of TTL, but it's more like IDLE_TIME_OUT. 
   Is this a good idea to enhance the TTL feature of Spark Engine Instance? 
    
   
   ### How should we improve?
   
   Add an optional TTL to spark instance, when some instance reaches its lifespan, a new rolling instance will be created to accept connections from the same subdomain.
   two possible ways of TTL:
   1) precise TTL
   2)a time label, for example by nature day or hour
   
   ### Are you willing to submit PR?
   
   - [X] Yes. I would be willing to submit a PR with guidance from the Kyuubi community to improve.
   - [ ] No. I cannot submit a PR at this time.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: notifications-unsubscribe@kyuubi.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: notifications-unsubscribe@kyuubi.apache.org
For additional commands, e-mail: notifications-help@kyuubi.apache.org


[GitHub] [kyuubi] pan3793 commented on issue #5197: [Improvement] enhancing TTL feature of spark engine instance

Posted by "pan3793 (via GitHub)" <gi...@apache.org>.
pan3793 commented on issue #5197:
URL: https://github.com/apache/kyuubi/issues/5197#issuecomment-1691266746

   Does `kyuubi.session.engine.spark.max.lifetime` satisfy the requirement?


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: notifications-unsubscribe@kyuubi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: notifications-unsubscribe@kyuubi.apache.org
For additional commands, e-mail: notifications-help@kyuubi.apache.org


[GitHub] [kyuubi] github-actions[bot] commented on issue #5197: [Improvement] enhancing TTL feature of spark engine instance

Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on issue #5197:
URL: https://github.com/apache/kyuubi/issues/5197#issuecomment-1691064465

   Hello @Xaprice,
   Thanks for finding the time to report the issue!
   We really appreciate the community's efforts to improve Apache Kyuubi.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: notifications-unsubscribe@kyuubi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: notifications-unsubscribe@kyuubi.apache.org
For additional commands, e-mail: notifications-help@kyuubi.apache.org