You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@kyuubi.apache.org by GitBox <gi...@apache.org> on 2022/03/02 07:45:05 UTC

[GitHub] [incubator-kyuubi] yaooqinn opened a new issue #1990: CreateHoodieTableCommand is very slow shown in Github actions

yaooqinn opened a new issue #1990:
URL: https://github.com/apache/incubator-kyuubi/issues/1990


   ### Code of Conduct
   
   - [X] I agree to follow this project's [Code of Conduct](https://www.apache.org/foundation/policies/conduct)
   
   
   ### Search before asking
   
   - [X] I have searched in the [issues](https://github.com/apache/incubator-kyuubi/issues?q=is%3Aissue) and found no similar issues.
   
   
   ### Describe the bug
   
   ```
   12:38:24.040 SparkSQLSessionManager-exec-pool: Thread-1855 DEBUG ExecuteStatement: == Parsed Logical Plan ==
   'CreateTableStatement [table_1_test], [StructField(id,IntegerType,true), StructField(name,StringType,true), StructField(price,DoubleType,true), StructField(ts,LongType,true)], hudi, [primaryKey=id, preCombineField=ts, hoodie.bootstrap.index.class=org.apache.hudi.common.bootstrap.index.NoOpBootstrapIndex], false, false
   
   == Analyzed Logical Plan ==
   
   CreateHoodieTableCommand `default`.`table_1_test`, false
   
   == Optimized Logical Plan ==
   CreateHoodieTableCommand `default`.`table_1_test`, false
   
   == Physical Plan ==
   Execute CreateHoodieTableCommand
      +- CreateHoodieTableCommand `default`.`table_1_test`, false
   
   12:38:24.040 SparkSQLSessionManager-exec-pool: Thread-1855 INFO ExecuteStatement: Execute in full collect mode
   12:38:24.043 SparkSQLSessionManager-exec-pool: Thread-1855 INFO ExecuteStatement: Processing runner's query[7c19e75e-f644-4a69-9e55-458e10d724d9]: RUNNING_STATE -> FINISHED_STATE, statement:
    create table table_1_test (
     id int,
     name string,
     price double,
     ts long
    ) using hudi
    options (
      primaryKey = 'id',
      preCombineField = 'ts',
      hoodie.bootstrap.index.class =
      'org.apache.hudi.common.bootstrap.index.NoOpBootstrapIndex'
    )
          , time taken: 25.728 seconds
   ```
   
   ### Affects Version(s)
   
   master
   
   ### Kyuubi Server Log Output
   
   _No response_
   
   ### Kyuubi Engine Log Output
   
   _No response_
   
   ### Kyuubi Server Configurations
   
   _No response_
   
   ### Kyuubi Engine Configurations
   
   _No response_
   
   ### Additional context
   
   _No response_
   
   ### Are you willing to submit PR?
   
   - [ ] Yes I am willing to submit a PR!


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: dev-unsubscribe@kyuubi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [incubator-kyuubi] yaooqinn commented on issue #1990: CreateHoodieTableCommand is very slow shown in Github actions

Posted by GitBox <gi...@apache.org>.
yaooqinn commented on issue #1990:
URL: https://github.com/apache/incubator-kyuubi/issues/1990#issuecomment-1063655883


   this is slow because of hiveingmetastore client initializing，not related to kyuubi and we are now using spark immemory catalog in tests. shouldn't be a problem anymore


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: notifications-unsubscribe@kyuubi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



---------------------------------------------------------------------
To unsubscribe, e-mail: notifications-unsubscribe@kyuubi.apache.org
For additional commands, e-mail: notifications-help@kyuubi.apache.org

[GitHub] [incubator-kyuubi] yaooqinn closed issue #1990: CreateHoodieTableCommand is very slow shown in Github actions

Posted by GitBox <gi...@apache.org>.
yaooqinn closed issue #1990:
URL: https://github.com/apache/incubator-kyuubi/issues/1990


   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: notifications-unsubscribe@kyuubi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



---------------------------------------------------------------------
To unsubscribe, e-mail: notifications-unsubscribe@kyuubi.apache.org
For additional commands, e-mail: notifications-help@kyuubi.apache.org

[GitHub] [incubator-kyuubi] SteNicholas commented on issue #1990: CreateHoodieTableCommand is very slow shown in Github actions

Posted by GitBox <gi...@apache.org>.
SteNicholas commented on issue #1990:
URL: https://github.com/apache/incubator-kyuubi/issues/1990#issuecomment-1056700601


   @yaooqinn, could you please assign this ticket to me? I will take a look.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: dev-unsubscribe@kyuubi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org