You are viewing a plain text version of this content. The canonical link for it is here.
Posted to notifications@kyuubi.apache.org by "zwangsheng (via GitHub)" <gi...@apache.org> on 2023/10/24 08:46:15 UTC
[PR] [KYUUBI #5513][Improvement][BATCH] Redirect delete batch request when… [kyuubi]
zwangsheng opened a new pull request, #5514:
URL: https://github.com/apache/kyuubi/pull/5514
… enabled v2 and current kyuubi not submitted this batch
<!--
Thanks for sending a pull request!
Here are some tips for you:
1. If this is your first time, please read our contributor guidelines: https://kyuubi.readthedocs.io/en/latest/community/CONTRIBUTING.html
2. If the PR is related to an issue in https://github.com/apache/kyuubi/issues, add '[KYUUBI #XXXX]' in your PR title, e.g., '[KYUUBI #XXXX] Your PR title ...'.
3. If the PR is unfinished, add '[WIP]' in your PR title, e.g., '[WIP][KYUUBI #XXXX] Your PR title ...'.
-->
### _Why are the changes needed?_
<!--
Please clarify why the changes are needed. For instance,
1. If you add a feature, you can talk about the use case of it.
2. If you fix a bug, you can clarify why it is a bug.
-->
### _How was this patch tested?_
- [ ] Add some test cases that check the changes thoroughly including negative and positive cases if possible
- [ ] Add screenshots for manual tests if appropriate
- [ ] [Run test](https://kyuubi.readthedocs.io/en/master/contributing/code/testing.html#running-tests) locally before make a pull request
### _Was this patch authored or co-authored using generative AI tooling?_
<!--
If a generative AI tooling has been used in the process of authoring this patch, please include
phrase 'Generated-by: ' followed by the name of the tool and its version.
If no, write 'No'.
Please refer to the [ASF Generative Tooling Guidance](https://www.apache.org/legal/generative-tooling.html) for details.
-->
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: notifications-unsubscribe@kyuubi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: notifications-unsubscribe@kyuubi.apache.org
For additional commands, e-mail: notifications-help@kyuubi.apache.org
Re: [PR] [KYUUBI #5513][BATCH] Always redirect delete batch request to Kyuubi instance that owns batch session [kyuubi]
Posted by "pan3793 (via GitHub)" <gi...@apache.org>.
pan3793 commented on code in PR #5514:
URL: https://github.com/apache/kyuubi/pull/5514#discussion_r1371238916
##########
kyuubi-server/src/main/scala/org/apache/kyuubi/server/api/v1/BatchesResource.scala:
##########
@@ -477,16 +477,15 @@ private[v1] class BatchesResource extends ApiRequestContext with Logging {
checkPermission(userName, metadata.username)
if (OperationState.isTerminal(OperationState.withName(metadata.state))) {
new CloseBatchResponse(false, s"The batch[$metadata] has been terminated.")
- } else if (batchV2Enabled(metadata.requestConf) && metadata.state == "INITIALIZED") {
- if (batchService.get.cancelUnscheduledBatch(batchId)) {
- new CloseBatchResponse(true, s"Unscheduled batch $batchId is canceled.")
- } else if (OperationState.isTerminal(OperationState.withName(metadata.state))) {
- new CloseBatchResponse(false, s"The batch[$metadata] has been terminated.")
- } else {
- info(s"Cancel batch[$batchId] with state ${metadata.state} by killing application")
- val (killed, msg) = forceKill(metadata.appMgrInfo, batchId, userName)
- new CloseBatchResponse(killed, msg)
- }
+ } else if (batchV2Enabled(metadata.requestConf) && metadata.state == "INITIALIZED" &&
+ // there is a chance that metadata is outdated, then `cancelUnscheduledBatch` fails
+ // and returns false
+ batchService.get.cancelUnscheduledBatch(batchId)) {
+ new CloseBatchResponse(true, s"Unscheduled batch $batchId is canceled.")
+ } else if (metadata.kyuubiInstance == null) {
+ // code goes here indicates metadata is outdated, recursively calls itself to
+ // refresh the metadata
Review Comment:
```suggestion
// code goes here indicates metadata is outdated, recursively calls itself to refresh
// the metadata
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: notifications-unsubscribe@kyuubi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: notifications-unsubscribe@kyuubi.apache.org
For additional commands, e-mail: notifications-help@kyuubi.apache.org
Re: [PR] [KYUUBI #5513][BATCH] Always redirect delete batch request to Kyuubi instance that owns batch session [kyuubi]
Posted by "pan3793 (via GitHub)" <gi...@apache.org>.
pan3793 closed pull request #5514: [KYUUBI #5513][BATCH] Always redirect delete batch request to Kyuubi instance that owns batch session
URL: https://github.com/apache/kyuubi/pull/5514
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: notifications-unsubscribe@kyuubi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: notifications-unsubscribe@kyuubi.apache.org
For additional commands, e-mail: notifications-help@kyuubi.apache.org
Re: [PR] [KYUUBI #5513][BATCH] Always redirect delete batch request to Kyuubi instance that owns batch session [kyuubi]
Posted by "pan3793 (via GitHub)" <gi...@apache.org>.
pan3793 commented on code in PR #5514:
URL: https://github.com/apache/kyuubi/pull/5514#discussion_r1371230747
##########
kyuubi-server/src/main/scala/org/apache/kyuubi/server/api/v1/BatchesResource.scala:
##########
@@ -477,16 +477,16 @@ private[v1] class BatchesResource extends ApiRequestContext with Logging {
checkPermission(userName, metadata.username)
if (OperationState.isTerminal(OperationState.withName(metadata.state))) {
new CloseBatchResponse(false, s"The batch[$metadata] has been terminated.")
- } else if (batchV2Enabled(metadata.requestConf) && metadata.state == "INITIALIZED") {
- if (batchService.get.cancelUnscheduledBatch(batchId)) {
- new CloseBatchResponse(true, s"Unscheduled batch $batchId is canceled.")
- } else if (OperationState.isTerminal(OperationState.withName(metadata.state))) {
- new CloseBatchResponse(false, s"The batch[$metadata] has been terminated.")
- } else {
- info(s"Cancel batch[$batchId] with state ${metadata.state} by killing application")
- val (killed, msg) = forceKill(metadata.appMgrInfo, batchId, userName)
- new CloseBatchResponse(killed, msg)
- }
+ } else if (batchV2Enabled(metadata.requestConf) && metadata.state == "INITIALIZED" &&
+ // Since this code does not retrieve metadata to check,
+ // the metadata may be outdated, which means that the cancelUnscheduledBatch function
+ // here will not necessarily succeed
+ batchService.get.cancelUnscheduledBatch(batchId)) {
+ new CloseBatchResponse(true, s"Unscheduled batch $batchId is canceled.")
+ } else if (metadata.kyuubiInstance == null) {
+ // Again, we may arrive here with an empty kyuubiInstance field because the metadata
+ // may be out of date, so let's call the method again here to refresh the metadata
Review Comment:
```suggestion
// code goes here indicates metadata is outdated, recursively calls itself to
// refresh the metadata
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: notifications-unsubscribe@kyuubi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: notifications-unsubscribe@kyuubi.apache.org
For additional commands, e-mail: notifications-help@kyuubi.apache.org
Re: [PR] [KYUUBI #5513][BATCH] Always redirect delete batch request to Kyuubi instance that owns batch session [kyuubi]
Posted by "pan3793 (via GitHub)" <gi...@apache.org>.
pan3793 commented on code in PR #5514:
URL: https://github.com/apache/kyuubi/pull/5514#discussion_r1371227459
##########
kyuubi-server/src/main/scala/org/apache/kyuubi/server/api/v1/BatchesResource.scala:
##########
@@ -477,16 +477,16 @@ private[v1] class BatchesResource extends ApiRequestContext with Logging {
checkPermission(userName, metadata.username)
if (OperationState.isTerminal(OperationState.withName(metadata.state))) {
new CloseBatchResponse(false, s"The batch[$metadata] has been terminated.")
- } else if (batchV2Enabled(metadata.requestConf) && metadata.state == "INITIALIZED") {
- if (batchService.get.cancelUnscheduledBatch(batchId)) {
- new CloseBatchResponse(true, s"Unscheduled batch $batchId is canceled.")
- } else if (OperationState.isTerminal(OperationState.withName(metadata.state))) {
- new CloseBatchResponse(false, s"The batch[$metadata] has been terminated.")
- } else {
- info(s"Cancel batch[$batchId] with state ${metadata.state} by killing application")
- val (killed, msg) = forceKill(metadata.appMgrInfo, batchId, userName)
- new CloseBatchResponse(killed, msg)
- }
+ } else if (batchV2Enabled(metadata.requestConf) && metadata.state == "INITIALIZED" &&
+ // Since this code does not retrieve metadata to check,
+ // the metadata may be outdated, which means that the cancelUnscheduledBatch function
+ // here will not necessarily succeed
Review Comment:
```suggestion
// there is a chance that metadata is outdated, then `cancelUnscheduledBatch`
// fails and returns false
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: notifications-unsubscribe@kyuubi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: notifications-unsubscribe@kyuubi.apache.org
For additional commands, e-mail: notifications-help@kyuubi.apache.org
Re: [PR] [KYUUBI #5513][BATCH] Always redirect delete batch request to Kyuubi instance that owns batch session [kyuubi]
Posted by "zwangsheng (via GitHub)" <gi...@apache.org>.
zwangsheng commented on code in PR #5514:
URL: https://github.com/apache/kyuubi/pull/5514#discussion_r1370168974
##########
kyuubi-server/src/main/scala/org/apache/kyuubi/server/api/v1/BatchesResource.scala:
##########
@@ -477,16 +477,9 @@ private[v1] class BatchesResource extends ApiRequestContext with Logging {
checkPermission(userName, metadata.username)
if (OperationState.isTerminal(OperationState.withName(metadata.state))) {
new CloseBatchResponse(false, s"The batch[$metadata] has been terminated.")
- } else if (batchV2Enabled(metadata.requestConf) && metadata.state == "INITIALIZED") {
- if (batchService.get.cancelUnscheduledBatch(batchId)) {
- new CloseBatchResponse(true, s"Unscheduled batch $batchId is canceled.")
- } else if (OperationState.isTerminal(OperationState.withName(metadata.state))) {
- new CloseBatchResponse(false, s"The batch[$metadata] has been terminated.")
- } else {
- info(s"Cancel batch[$batchId] with state ${metadata.state} by killing application")
- val (killed, msg) = forceKill(metadata.appMgrInfo, batchId, userName)
- new CloseBatchResponse(killed, msg)
- }
+ } else if (batchV2Enabled(metadata.requestConf) && metadata.state == "INITIALIZED" &&
+ batchService.get.cancelUnscheduledBatch(batchId)) {
+ new CloseBatchResponse(true, s"Unscheduled batch $batchId is canceled.")
} else if (metadata.kyuubiInstance != fe.connectionUrl) {
Review Comment:
Right, metadata.kyuubiInstance = null may happen when this batch picked within this function. Due to we won't fresh batch state by getting newest metadata.
We can call this delete function again to handle this case
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: notifications-unsubscribe@kyuubi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: notifications-unsubscribe@kyuubi.apache.org
For additional commands, e-mail: notifications-help@kyuubi.apache.org
Re: [PR] [KYUUBI #5513][BATCH] Always redirect delete batch request to Kyuubi instance that owns batch session [kyuubi]
Posted by "pan3793 (via GitHub)" <gi...@apache.org>.
pan3793 commented on code in PR #5514:
URL: https://github.com/apache/kyuubi/pull/5514#discussion_r1371227459
##########
kyuubi-server/src/main/scala/org/apache/kyuubi/server/api/v1/BatchesResource.scala:
##########
@@ -477,16 +477,16 @@ private[v1] class BatchesResource extends ApiRequestContext with Logging {
checkPermission(userName, metadata.username)
if (OperationState.isTerminal(OperationState.withName(metadata.state))) {
new CloseBatchResponse(false, s"The batch[$metadata] has been terminated.")
- } else if (batchV2Enabled(metadata.requestConf) && metadata.state == "INITIALIZED") {
- if (batchService.get.cancelUnscheduledBatch(batchId)) {
- new CloseBatchResponse(true, s"Unscheduled batch $batchId is canceled.")
- } else if (OperationState.isTerminal(OperationState.withName(metadata.state))) {
- new CloseBatchResponse(false, s"The batch[$metadata] has been terminated.")
- } else {
- info(s"Cancel batch[$batchId] with state ${metadata.state} by killing application")
- val (killed, msg) = forceKill(metadata.appMgrInfo, batchId, userName)
- new CloseBatchResponse(killed, msg)
- }
+ } else if (batchV2Enabled(metadata.requestConf) && metadata.state == "INITIALIZED" &&
+ // Since this code does not retrieve metadata to check,
+ // the metadata may be outdated, which means that the cancelUnscheduledBatch function
+ // here will not necessarily succeed
Review Comment:
```suggestion
// there is a chance that metadata is outdated, then `cancelUnscheduledBatch` fails
// and returns false
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: notifications-unsubscribe@kyuubi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: notifications-unsubscribe@kyuubi.apache.org
For additional commands, e-mail: notifications-help@kyuubi.apache.org
Re: [PR] [KYUUBI #5513][BATCH] Always redirect delete batch request to Kyuubi instance that owns batch session [kyuubi]
Posted by "pan3793 (via GitHub)" <gi...@apache.org>.
pan3793 commented on PR #5514:
URL: https://github.com/apache/kyuubi/pull/5514#issuecomment-1779259754
Merged to master/1.8
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: notifications-unsubscribe@kyuubi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: notifications-unsubscribe@kyuubi.apache.org
For additional commands, e-mail: notifications-help@kyuubi.apache.org
Re: [PR] [KYUUBI #5513][BATCH] Always redirect delete batch request to Kyuubi instance that owns batch session [kyuubi]
Posted by "pan3793 (via GitHub)" <gi...@apache.org>.
pan3793 commented on code in PR #5514:
URL: https://github.com/apache/kyuubi/pull/5514#discussion_r1371240496
##########
kyuubi-server/src/main/scala/org/apache/kyuubi/server/api/v1/BatchesResource.scala:
##########
@@ -477,16 +477,15 @@ private[v1] class BatchesResource extends ApiRequestContext with Logging {
checkPermission(userName, metadata.username)
if (OperationState.isTerminal(OperationState.withName(metadata.state))) {
new CloseBatchResponse(false, s"The batch[$metadata] has been terminated.")
- } else if (batchV2Enabled(metadata.requestConf) && metadata.state == "INITIALIZED") {
- if (batchService.get.cancelUnscheduledBatch(batchId)) {
- new CloseBatchResponse(true, s"Unscheduled batch $batchId is canceled.")
- } else if (OperationState.isTerminal(OperationState.withName(metadata.state))) {
- new CloseBatchResponse(false, s"The batch[$metadata] has been terminated.")
- } else {
- info(s"Cancel batch[$batchId] with state ${metadata.state} by killing application")
- val (killed, msg) = forceKill(metadata.appMgrInfo, batchId, userName)
- new CloseBatchResponse(killed, msg)
- }
+ } else if (batchV2Enabled(metadata.requestConf) && metadata.state == "INITIALIZED" &&
+ // there is a chance that metadata is outdated, then `cancelUnscheduledBatch` fails
+ // and returns false
+ batchService.get.cancelUnscheduledBatch(batchId)) {
+ new CloseBatchResponse(true, s"Unscheduled batch $batchId is canceled.")
+ } else if (metadata.kyuubiInstance == null) {
+ // code goes here indicates metadata is outdated, recursively calls itself to refresh
+ // the metadata
+ closeBatchSession(batchId, hs2ProxyUser)
Review Comment:
let's add an assertion here
```
assert batchV2Enabled(metadata.requestConf)
```
##########
kyuubi-server/src/main/scala/org/apache/kyuubi/server/api/v1/BatchesResource.scala:
##########
@@ -477,16 +477,15 @@ private[v1] class BatchesResource extends ApiRequestContext with Logging {
checkPermission(userName, metadata.username)
if (OperationState.isTerminal(OperationState.withName(metadata.state))) {
new CloseBatchResponse(false, s"The batch[$metadata] has been terminated.")
- } else if (batchV2Enabled(metadata.requestConf) && metadata.state == "INITIALIZED") {
- if (batchService.get.cancelUnscheduledBatch(batchId)) {
- new CloseBatchResponse(true, s"Unscheduled batch $batchId is canceled.")
- } else if (OperationState.isTerminal(OperationState.withName(metadata.state))) {
- new CloseBatchResponse(false, s"The batch[$metadata] has been terminated.")
- } else {
- info(s"Cancel batch[$batchId] with state ${metadata.state} by killing application")
- val (killed, msg) = forceKill(metadata.appMgrInfo, batchId, userName)
- new CloseBatchResponse(killed, msg)
- }
+ } else if (batchV2Enabled(metadata.requestConf) && metadata.state == "INITIALIZED" &&
+ // there is a chance that metadata is outdated, then `cancelUnscheduledBatch` fails
+ // and returns false
+ batchService.get.cancelUnscheduledBatch(batchId)) {
+ new CloseBatchResponse(true, s"Unscheduled batch $batchId is canceled.")
+ } else if (metadata.kyuubiInstance == null) {
Review Comment:
```suggestion
} else if (batchV2Enabled(metadata.requestConf) && metadata.kyuubiInstance == null) {
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: notifications-unsubscribe@kyuubi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: notifications-unsubscribe@kyuubi.apache.org
For additional commands, e-mail: notifications-help@kyuubi.apache.org
Re: [PR] [KYUUBI #5513][BATCH] Always redirect delete batch request to Kyuubi instance that owns batch session [kyuubi]
Posted by "pan3793 (via GitHub)" <gi...@apache.org>.
pan3793 commented on code in PR #5514:
URL: https://github.com/apache/kyuubi/pull/5514#discussion_r1371240496
##########
kyuubi-server/src/main/scala/org/apache/kyuubi/server/api/v1/BatchesResource.scala:
##########
@@ -477,16 +477,15 @@ private[v1] class BatchesResource extends ApiRequestContext with Logging {
checkPermission(userName, metadata.username)
if (OperationState.isTerminal(OperationState.withName(metadata.state))) {
new CloseBatchResponse(false, s"The batch[$metadata] has been terminated.")
- } else if (batchV2Enabled(metadata.requestConf) && metadata.state == "INITIALIZED") {
- if (batchService.get.cancelUnscheduledBatch(batchId)) {
- new CloseBatchResponse(true, s"Unscheduled batch $batchId is canceled.")
- } else if (OperationState.isTerminal(OperationState.withName(metadata.state))) {
- new CloseBatchResponse(false, s"The batch[$metadata] has been terminated.")
- } else {
- info(s"Cancel batch[$batchId] with state ${metadata.state} by killing application")
- val (killed, msg) = forceKill(metadata.appMgrInfo, batchId, userName)
- new CloseBatchResponse(killed, msg)
- }
+ } else if (batchV2Enabled(metadata.requestConf) && metadata.state == "INITIALIZED" &&
+ // there is a chance that metadata is outdated, then `cancelUnscheduledBatch` fails
+ // and returns false
+ batchService.get.cancelUnscheduledBatch(batchId)) {
+ new CloseBatchResponse(true, s"Unscheduled batch $batchId is canceled.")
+ } else if (metadata.kyuubiInstance == null) {
+ // code goes here indicates metadata is outdated, recursively calls itself to refresh
+ // the metadata
+ closeBatchSession(batchId, hs2ProxyUser)
Review Comment:
let's add an assertion here
```
assert batchV2Enabled(metadata.requestConf)
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: notifications-unsubscribe@kyuubi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: notifications-unsubscribe@kyuubi.apache.org
For additional commands, e-mail: notifications-help@kyuubi.apache.org
Re: [PR] [KYUUBI #5513][Improvement][BATCH] Redirect delete batch request when enabled v2 and current kyuubi not submitted this batch [kyuubi]
Posted by "pan3793 (via GitHub)" <gi...@apache.org>.
pan3793 commented on code in PR #5514:
URL: https://github.com/apache/kyuubi/pull/5514#discussion_r1369865433
##########
kyuubi-server/src/main/scala/org/apache/kyuubi/server/api/v1/BatchesResource.scala:
##########
@@ -477,16 +477,9 @@ private[v1] class BatchesResource extends ApiRequestContext with Logging {
checkPermission(userName, metadata.username)
if (OperationState.isTerminal(OperationState.withName(metadata.state))) {
new CloseBatchResponse(false, s"The batch[$metadata] has been terminated.")
- } else if (batchV2Enabled(metadata.requestConf) && metadata.state == "INITIALIZED") {
- if (batchService.get.cancelUnscheduledBatch(batchId)) {
- new CloseBatchResponse(true, s"Unscheduled batch $batchId is canceled.")
- } else if (OperationState.isTerminal(OperationState.withName(metadata.state))) {
- new CloseBatchResponse(false, s"The batch[$metadata] has been terminated.")
- } else {
- info(s"Cancel batch[$batchId] with state ${metadata.state} by killing application")
- val (killed, msg) = forceKill(metadata.appMgrInfo, batchId, userName)
- new CloseBatchResponse(killed, msg)
- }
+ } else if (batchV2Enabled(metadata.requestConf) && metadata.state == "INITIALIZED" &&
+ batchService.get.cancelUnscheduledBatch(batchId)) {
+ new CloseBatchResponse(true, s"Unscheduled batch $batchId is canceled.")
} else if (metadata.kyuubiInstance != fe.connectionUrl) {
Review Comment:
should we add condition `metadata.kyuubiInstance != null`?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: notifications-unsubscribe@kyuubi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: notifications-unsubscribe@kyuubi.apache.org
For additional commands, e-mail: notifications-help@kyuubi.apache.org