You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@kyuubi.apache.org by GitBox <gi...@apache.org> on 2022/02/22 13:22:14 UTC
[GitHub] [incubator-kyuubi] yaooqinn opened a new issue #1962: [Improvement] Make sparkSession or SparkContext as a scala.concurrent.Future to give it proper timeout
yaooqinn opened a new issue #1962:
URL: https://github.com/apache/incubator-kyuubi/issues/1962
### Code of Conduct
- [X] I agree to follow this project's [Code of Conduct](https://www.apache.org/foundation/policies/conduct)
### Search before asking
- [X] I have searched in the [issues](https://github.com/apache/incubator-kyuubi/issues?q=is%3Aissue) and found no similar issues.
### What would you like to be improved?
https://github.com/apache/incubator-kyuubi/issues/1960 fixes a certain problem with master deploy mode, for client mode, the timeout describe there will almost not happen. The sc might get stuck will the driver is on and wait for the ApplicaitonMaster to be allocated. Although spark will have a timeout for checking for driver-am connected. But this may not happen when the AM is not able to be allocated in time.
### How should we improve?
We need a timeout for this whole progress.
### Are you willing to submit PR?
- [ ] Yes I am willing to submit a PR!
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@kyuubi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-kyuubi] wForget commented on issue #1962: [Improvement] Make sparkSession or SparkContext as a scala.concurrent.Future to give it proper timeout
Posted by GitBox <gi...@apache.org>.
wForget commented on issue #1962:
URL: https://github.com/apache/incubator-kyuubi/issues/1962#issuecomment-1056333547
+1, @yaooqinn Could you please assign this to me? I will implement this.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@kyuubi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-kyuubi] ulysses-you closed issue #1962: [Improvement] Make sparkSession or SparkContext as a scala.concurrent.Future to give it proper timeout
Posted by GitBox <gi...@apache.org>.
ulysses-you closed issue #1962:
URL: https://github.com/apache/incubator-kyuubi/issues/1962
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: notifications-unsubscribe@kyuubi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: notifications-unsubscribe@kyuubi.apache.org
For additional commands, e-mail: notifications-help@kyuubi.apache.org
[GitHub] [incubator-kyuubi] yaooqinn commented on issue #1962: [Improvement] Make sparkSession or SparkContext as a scala.concurrent.Future to give it proper timeout
Posted by GitBox <gi...@apache.org>.
yaooqinn commented on issue #1962:
URL: https://github.com/apache/incubator-kyuubi/issues/1962#issuecomment-1057019564
> the submit process will be killed
maybe this way is better than killing?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@kyuubi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-kyuubi] yaooqinn commented on issue #1962: [Improvement] Make sparkSession or SparkContext as a scala.concurrent.Future to give it proper timeout
Posted by GitBox <gi...@apache.org>.
yaooqinn commented on issue #1962:
URL: https://github.com/apache/incubator-kyuubi/issues/1962#issuecomment-1047818235
cc @wForget @turboFei
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@kyuubi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-kyuubi] wForget commented on issue #1962: [Improvement] Make sparkSession or SparkContext as a scala.concurrent.Future to give it proper timeout
Posted by GitBox <gi...@apache.org>.
wForget commented on issue #1962:
URL: https://github.com/apache/incubator-kyuubi/issues/1962#issuecomment-1056981381
@yaooqinn @ulysses-you I found that this seems unnecessary, because the submit process will be killed when starting the Engine timeout, and the driver will also stop in client mode.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@kyuubi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org