You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@iceberg.apache.org by "ajantha-bhat (via GitHub)" <gi...@apache.org> on 2023/09/01 06:12:19 UTC

[GitHub] [iceberg] ajantha-bhat opened a new issue, #8450: Partition stats task tracker

ajantha-bhat opened a new issue, #8450:
URL: https://github.com/apache/iceberg/issues/8450

   - [ ] Define the partition stats schema and requirements then add them to the Iceberg spec.
   - [ ] Define how to track partition stats files and add it to the Iceberg spec.
   - [ ] Move iceberg-parquet files to iceberg-core module
   - [ ] Move iceberg-orc files to iceberg-core module
   - [ ] Move PartitionsTable.Partition to a separate class and re-use them for partition stats.
   - [ ] Build a util to read and write partition stats file for a table on a single node.
   - [ ] Implement stats file tracking via TableMetadata.
   - [ ] Implement Synchronous partition stats writing during write operation (controlled by table property).
   - [ ] Implement parallel stats using metadata tables and a CALL procedure.
   - [ ] Build incremental update for a stats file based on incremental scan.
   - [ ] Implement incremental update using commit stats (SnapshotSummary) and add a flag to turn it off.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org

Re: [I] Partition stats task tracker [iceberg]

Posted by "ajantha-bhat (via GitHub)" <gi...@apache.org>.
ajantha-bhat commented on issue #8450:
URL: https://github.com/apache/iceberg/issues/8450#issuecomment-4046636545

   @sopel39: Still valid and I think @gaborkaszab had new proposal for this. 
   
   I closed this issue tracker as we can track from subtask directly now. 


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org

Re: [I] Partition stats task tracker [iceberg]

Posted by "ajantha-bhat (via GitHub)" <gi...@apache.org>.
ajantha-bhat commented on issue #8450:
URL: https://github.com/apache/iceberg/issues/8450#issuecomment-3060786325

   Closing this task as completed today. V4 and future work can still be tracked in this even after closing it. 


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org

Re: [I] Partition stats task tracker [iceberg]

Posted by "ajantha-bhat (via GitHub)" <gi...@apache.org>.
ajantha-bhat closed issue #8450: Partition stats task tracker
URL: https://github.com/apache/iceberg/issues/8450


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org

Re: [I] Partition stats task tracker [iceberg]

Posted by "sopel39 (via GitHub)" <gi...@apache.org>.
sopel39 commented on issue #8450:
URL: https://github.com/apache/iceberg/issues/8450#issuecomment-4040150136

   @ajantha-bhat is https://github.com/apache/iceberg/issues/11083 still valid after this is closed?


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org