You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@kyuubi.apache.org by GitBox <gi...@apache.org> on 2021/07/19 08:38:02 UTC
[GitHub] [incubator-kyuubi] yaooqinn opened a new issue #832: [Umbrella] Spark Configuration Validation
yaooqinn opened a new issue #832:
URL: https://github.com/apache/incubator-kyuubi/issues/832
# Describe the proposal
<!--
A clear and concise description of what the proposal is.
If this is a KPIP https://kyuubi.apache.org/improvement-proposals.html, please put related link here.
-->
When a SparkConf is invalid for launching our engines, it is better to fail fast instead of waiting for Spark to check while engine bootstrapping.
## Motivation
1. Save time to create an invalid engine
2. Avoid possible hang
3. better error message
Here is an example I did for Spark to validate its own configs when talking to Kubernetes. https://github.com/apache/spark/pull/32610
## Cons
# Task list
- [ ] #
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@kyuubi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-kyuubi] ulysses-you commented on issue #832: [Umbrella] Spark Configuration Validation
Posted by GitBox <gi...@apache.org>.
ulysses-you commented on issue #832:
URL: https://github.com/apache/incubator-kyuubi/issues/832#issuecomment-912283830
FYI some working in Apache Spark https://github.com/apache/spark/pull/33491
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@kyuubi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org