[GitHub] [incubator-kyuubi] ulysses-you commented on issue #939: [Umbrella] Add Z-Order extensions to optimize table with zorder

[GitBox <gi...@apache.org>]

ulysses-you commented on issue #939:
URL: https://github.com/apache/incubator-kyuubi/issues/939#issuecomment-914862007


   To developers:
   
   We merged zorder https://github.com/apache/incubator-kyuubi/pull/990 into master branch (for 1.4.0) recently. There are still many things can be done for the zorder and the test.
   
   # zorder work
   
   - support more relation (only `HiveTableRelation` for now)
   - support more table format, since Spark doesn't support insert overwrite and read the same datasource table
   - support optimzie zorder through tbl properteis; I think @qphien is working on this
   - zorder expression with codegen
   - zorder docs
   - beanchmark of zorder for write side
   - beanchmark of zorder for read side
   - etc ...
   
   # test coverage
   we only have the end-end test of zorder, . as far as I know, we need more test include:
   
   - unit test of analyzed zorder plan
   - test different column data type
   - test different partition data type
   - test different table format
   - etc ...
   
   I wonder If you are interested in this feature. Look forward to your idea. @qphien  @cfmcgrady @hzxiongyinke @timothy65535 @hddong @zhaomin1423 
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: dev-unsubscribe@kyuubi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org