You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@kyuubi.apache.org by GitBox <gi...@apache.org> on 2021/09/06 09:34:01 UTC

[GitHub] [incubator-kyuubi] zhang1002 opened a new issue #1039: Kyuubi can't cancle the app that the running queue has no resource until user kill manually

zhang1002 opened a new issue #1039:
URL: https://github.com/apache/incubator-kyuubi/issues/1039


   ### 1. Describe the bug
   If the queue that you submmit the app through kyuubi that has no resource, the app will always stay in a state of ACCEPTED until you kill manually.
   
   The yarnApplicationState: ACCEPTED: waiting for AM container to be allocated, launched and register with RM.
   
   ### 2. Environments
   yarn: 2.9.2
   kyuubi: 1.1.0
   
   #### 2.1 Versions
   
   - Kyuubi
     - [ ] 1.1.0
     - [ ] 1.0.3
     - [ ] 0.8.x and earlier <!-- Please update Kyuubi, versions of 0.x are no longer supported by the community -->
   
   - Spark
     - [ ] 3.1.x
     - [ ] 3.0.x
     - [ ] 2.4.x and earlier <!-- Please update Spark, versions of 2.x are no longer supported by the community -->
   
   #### 2.2 Kyuubi Configurations
   
   #### 2.3 Spark Configurations
   
   
   ### 3. Steps to reproduce
   
   #### 3.1 Operations
   
   #### 3.2 Expected behavior
   
   <!-- A clear and concise description of what you expected to happen. -->
   
   #### 3.3 Actual behavior
   
   ### 4. Additional context
   
   #### 4.1 Log of the server
   
   #### 4.2 Log of the corresponding engine


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: dev-unsubscribe@kyuubi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [incubator-kyuubi] simon824 commented on issue #1039: Kyuubi can't cancel the app that the running queue has no resource until user kill manually

Posted by GitBox <gi...@apache.org>.
simon824 commented on issue #1039:
URL: https://github.com/apache/incubator-kyuubi/issues/1039#issuecomment-920764311


   If no one else following can assign it to me.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: dev-unsubscribe@kyuubi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [incubator-kyuubi] yaooqinn commented on issue #1039: Kyuubi can't cancel the app that the running queue has no resource until user kill manually

Posted by GitBox <gi...@apache.org>.
yaooqinn commented on issue #1039:
URL: https://github.com/apache/incubator-kyuubi/issues/1039#issuecomment-920524137


   @zhang1002 Are you still working on this?


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: dev-unsubscribe@kyuubi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [incubator-kyuubi] simon824 commented on issue #1039: Kyuubi can't cancel the app that the running queue has no resource until user kill manually

Posted by GitBox <gi...@apache.org>.
simon824 commented on issue #1039:
URL: https://github.com/apache/incubator-kyuubi/issues/1039#issuecomment-921375517


   > @simon824 are you willing to work on this?
   
   yep


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: dev-unsubscribe@kyuubi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [incubator-kyuubi] akizminet commented on issue #1039: Kyuubi can't cancel the app that the running queue has no resource until user kill manually

Posted by GitBox <gi...@apache.org>.
akizminet commented on issue #1039:
URL: https://github.com/apache/incubator-kyuubi/issues/1039#issuecomment-919970927


   So if ACCEPTED stages take longer than `kyuubi.session.engine.initialize.timeout` and kyuubi doesn't kill those apps. They will take resources when the queue is free and live for a long time on YARN cluster. I think this is a bug.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: dev-unsubscribe@kyuubi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [incubator-kyuubi] akizminet edited a comment on issue #1039: Kyuubi can't cancel the app that the running queue has no resource until user kill manually

Posted by GitBox <gi...@apache.org>.
akizminet edited a comment on issue #1039:
URL: https://github.com/apache/incubator-kyuubi/issues/1039#issuecomment-919970927


   So if ACCEPTED stages take longer than `kyuubi.session.engine.initialize.timeout` and kyuubi doesn't kill those apps. They will take resources when the queue is free and live for a long time on YARN cluster. I think this is a serious bug.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: dev-unsubscribe@kyuubi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [incubator-kyuubi] akizminet edited a comment on issue #1039: Kyuubi can't cancel the app that the running queue has no resource until user kill manually

Posted by GitBox <gi...@apache.org>.
akizminet edited a comment on issue #1039:
URL: https://github.com/apache/incubator-kyuubi/issues/1039#issuecomment-919970927


   If ACCEPTED stage takes longer than `kyuubi.session.engine.initialize.timeout` and kyuubi doesn't kill that app. Then It will take resources when the queue is free and live for a long time on YARN cluster. So if the SQL client auto creates a new session, kyuubi will submit a new spark app and it will also in ACCEPTED queue again. The YARN cluster will be attacked by kyuubi engine. I think this is a serious bug.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: dev-unsubscribe@kyuubi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [incubator-kyuubi] ulysses-you closed issue #1039: Kyuubi can't cancel the app that the running queue has no resource until user kill manually

Posted by GitBox <gi...@apache.org>.
ulysses-you closed issue #1039:
URL: https://github.com/apache/incubator-kyuubi/issues/1039


   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: dev-unsubscribe@kyuubi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [incubator-kyuubi] akizminet edited a comment on issue #1039: Kyuubi can't cancel the app that the running queue has no resource until user kill manually

Posted by GitBox <gi...@apache.org>.
akizminet edited a comment on issue #1039:
URL: https://github.com/apache/incubator-kyuubi/issues/1039#issuecomment-919970927


   If ACCEPTED stage takes longer than `kyuubi.session.engine.initialize.timeout` and kyuubi doesn't kill that app, it will take resources when the queue is free and live for a long time on YARN cluster. So if the SQL client auto creates a new session, kyuubi will submit a new spark app and it will also in ACCEPTED queue again. The YARN cluster will be attacked by kyuubi engine. I think this is a serious bug.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: dev-unsubscribe@kyuubi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [incubator-kyuubi] yaooqinn commented on issue #1039: Kyuubi can't cancel the app that the running queue has no resource until user kill manually

Posted by GitBox <gi...@apache.org>.
yaooqinn commented on issue #1039:
URL: https://github.com/apache/incubator-kyuubi/issues/1039#issuecomment-920788066


   @simon824 are you willing to work on this?


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: dev-unsubscribe@kyuubi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org