You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@doris.apache.org by "kaka11chen (via GitHub)" <gi...@apache.org> on 2023/04/25 05:33:26 UTC

[GitHub] [doris] kaka11chen opened a new issue, #19038: [Enhancement] qt_q11 in regression test test_external_catalog_hive is very slow.

kaka11chen opened a new issue, #19038:
URL: https://github.com/apache/doris/issues/19038

   ### Search before asking
   
   - [X] I had searched in the [issues](https://github.com/apache/doris/issues?q=is%3Aissue) and found no similar issues.
   
   
   ### Description
   
   We found `qt_q11` in regression test `test_external_catalog_hive` is very slow. 
   The result is only one record, so other data should be filtered out in the parquet lazy read situation.
   Then we found currently the parquet reader read many records because we can only skip parquet page. But in order to skip parquet page, currently we need to read page header, then it will caused prefetch data. Therefore, prefetch data in this case may be not good.
   
   So there are two issues:
   
   1. Skip whole row group in this case.
   2. Prefetching data in this case may be not good, need to improve it.
   
   ### Solution
   
   _No response_
   
   ### Are you willing to submit PR?
   
   - [X] Yes I am willing to submit a PR!
   
   ### Code of Conduct
   
   - [X] I agree to follow this project's [Code of Conduct](https://www.apache.org/foundation/policies/conduct)
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org

[GitHub] [doris] yiguolei closed issue #19038: [Enhancement] qt_q11 in regression test test_external_catalog_hive is very slow.

Posted by "yiguolei (via GitHub)" <gi...@apache.org>.
yiguolei closed issue #19038: [Enhancement] qt_q11 in regression test test_external_catalog_hive is very slow.
URL: https://github.com/apache/doris/issues/19038


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org