You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@kylin.apache.org by "zznlime (via GitHub)" <gi...@apache.org> on 2023/12/26 06:55:12 UTC
[PR] KYLIN-5748 Skip build flat table for index build job if all new created indexes can be built from existed parent index [kylin]
zznlime opened a new pull request, #2162:
URL: https://github.com/apache/kylin/pull/2162
For an index build job, if all the new added indexes can be built from their existed parent index. No index was built from new created flat table.
For this case, there won't be any data inconsistency across indexes. And there is no need to build a new flat table to serve the stage of index build by layer.
So I think we can skip stage BUILD DICT and stage GENERATE FLAT TABLE for an index build job in condition that all new added indexes can be built from their existed parent index
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@kylin.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] KYLIN-5748 Skip build flat table for index build job if all new created indexes can be built from existed parent index [kylin]
Posted by "Mrhs121 (via GitHub)" <gi...@apache.org>.
Mrhs121 commented on PR #2162:
URL: https://github.com/apache/kylin/pull/2162#issuecomment-2021131685
Your proposal will be invalid in this use case: if you add a new bitmap type metric to the model, you can build the new index separately, and the task type is also INDEX_BUIDL. If you skip building the dictionary, an error will occur when generating encoding columns for the flat table later.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@kylin.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] KYLIN-5748 Skip build flat table for index build job if all new created indexes can be built from existed parent index [kylin]
Posted by "zznlime (via GitHub)" <gi...@apache.org>.
zznlime commented on PR #2162:
URL: https://github.com/apache/kylin/pull/2162#issuecomment-1869324455
@hit-lacus PTAL, Thanks
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@kylin.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org