You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@kyuubi.apache.org by ul...@apache.org on 2021/08/19 04:40:58 UTC

[incubator-kyuubi] branch master updated: [KYUUBI #959] Reduce EventLoggingService.onEvent time to one with compiled state

This is an automated email from the ASF dual-hosted git repository.

ulyssesyou pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/incubator-kyuubi.git


The following commit(s) were added to refs/heads/master by this push:
     new a263ee9  [KYUUBI #959] Reduce EventLoggingService.onEvent time to one with compiled state
a263ee9 is described below

commit a263ee9cd26623b4c1fab8fbfe8d6dc857be8e8a
Author: ulysses-you <ul...@gmail.com>
AuthorDate: Thu Aug 19 12:40:51 2021 +0800

    [KYUUBI #959] Reduce EventLoggingService.onEvent time to one with compiled state
    
    <!--
    Thanks for sending a pull request!
    
    Here are some tips for you:
      1. If this is your first time, please read our contributor guidelines: https://kyuubi.readthedocs.io/en/latest/community/contributions.html
      2. If the PR is related to an issue in https://github.com/apache/incubator-kyuubi/issues, add '[KYUUBI #XXXX]' in your PR title, e.g., '[KYUUBI #XXXX] Your PR title ...'.
      3. If the PR is unfinished, add '[WIP]' in your PR title, e.g., '[WIP][KYUUBI #XXXX] Your PR title ...'.
    -->
    
    ### _Why are the changes needed?_
    <!--
    Please clarify why the changes are needed. For instance,
      1. If you add a feature, you can talk about the use case of it.
      2. If you fix a bug, you can clarify why it is a bug.
    -->
    
    `setState`  has already call `EventLoggingService.onEvent`, so we don't need to call `EventLoggingService.onEvent` twice with compiled state .
    
    ```
      override def setState(newState: OperationState): Unit = {
        super.setState(newState)
        statementEvent.state = newState.toString
        statementEvent.stateTime = lastAccessTime
        EventLoggingService.onEvent(statementEvent)
      }
    ```
    
    ### _How was this patch tested?_
    - [ ] Add some test cases that check the changes thoroughly including negative and positive cases if possible
    
    - [ ] Add screenshots for manual tests if appropriate
    
    - [ ] [Run test](https://kyuubi.readthedocs.io/en/latest/develop_tools/testing.html#running-tests) locally before make a pull request
    
    Closes #959 from ulysses-you/compile.
    
    Closes #959
    
    dc517a65 [ulysses-you] reduce on event
    
    Authored-by: ulysses-you <ul...@gmail.com>
    Signed-off-by: ulysses-you <ul...@gmail.com>
---
 .../org/apache/kyuubi/engine/spark/operation/ExecuteStatement.scala    | 3 +--
 1 file changed, 1 insertion(+), 2 deletions(-)

diff --git a/externals/kyuubi-spark-sql-engine/src/main/scala/org/apache/kyuubi/engine/spark/operation/ExecuteStatement.scala b/externals/kyuubi-spark-sql-engine/src/main/scala/org/apache/kyuubi/engine/spark/operation/ExecuteStatement.scala
index 752fe3e..b932acc 100644
--- a/externals/kyuubi-spark-sql-engine/src/main/scala/org/apache/kyuubi/engine/spark/operation/ExecuteStatement.scala
+++ b/externals/kyuubi-spark-sql-engine/src/main/scala/org/apache/kyuubi/engine/spark/operation/ExecuteStatement.scala
@@ -91,9 +91,8 @@ class ExecuteStatement(
       spark.sparkContext.addSparkListener(operationListener)
       result = spark.sql(statement)
       // TODO( #921): COMPILED need consider eagerly executed commands
-      setState(OperationState.COMPILED)
       statementEvent.queryExecution = result.queryExecution.toString()
-      EventLoggingService.onEvent(statementEvent)
+      setState(OperationState.COMPILED)
       debug(result.queryExecution)
       iter = new ArrayFetchIterator(result.collect())
       setState(OperationState.FINISHED)