You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@iceberg.apache.org by "holdenk (via GitHub)" <gi...@apache.org> on 2023/01/23 21:10:16 UTC
[GitHub] [iceberg] holdenk opened a new issue, #6652: Support for global shadow writes + logs
holdenk opened a new issue, #6652:
URL: https://github.com/apache/iceberg/issues/6652
### Feature Request / Improvement
For job migration testing I'd really like to be able to set an environment variable that indicates all of the commits should be staged and logged for comparison.
### Query engine
None
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org
[GitHub] [iceberg] holdenk commented on issue #6652: Support for global shadow writes + logs
Posted by "holdenk (via GitHub)" <gi...@apache.org>.
holdenk commented on issue #6652:
URL: https://github.com/apache/iceberg/issues/6652#issuecomment-1404153325
hmm more poking I can probably do this with an Iceberg listener. Closing for now.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org
[GitHub] [iceberg] RussellSpitzer commented on issue #6652: Support for global shadow writes + logs
Posted by "RussellSpitzer (via GitHub)" <gi...@apache.org>.
RussellSpitzer commented on issue #6652:
URL: https://github.com/apache/iceberg/issues/6652#issuecomment-1404156574
This is also kind of similar to Nessie's branching idea, I think Iceberg is also moving towards having some first level branching support.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org
[GitHub] [iceberg] holdenk closed issue #6652: Support for global shadow writes + logs
Posted by "holdenk (via GitHub)" <gi...@apache.org>.
holdenk closed issue #6652: Support for global shadow writes + logs
URL: https://github.com/apache/iceberg/issues/6652
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org
[GitHub] [iceberg] holdenk commented on issue #6652: Support for global shadow writes + logs
Posted by "holdenk (via GitHub)" <gi...@apache.org>.
holdenk commented on issue #6652:
URL: https://github.com/apache/iceberg/issues/6652#issuecomment-1404136088
Actually I think we could do this with a small extension to Icebergs WAP so that the logs contain the table names.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org
[GitHub] [iceberg] amogh-jahagirdar commented on issue #6652: Support for global shadow writes + logs
Posted by "amogh-jahagirdar (via GitHub)" <gi...@apache.org>.
amogh-jahagirdar commented on issue #6652:
URL: https://github.com/apache/iceberg/issues/6652#issuecomment-1405777734
Yeah +1 to what @RussellSpitzer mentioned, we've recently added support for writes to branches in Iceberg itself and if I understand your use case correctly that's actually a perfect application of branching. I'm working on a separate page in documentation for branching and tagging, after I publish the initial PR I'll add you @holdenk for review and you can also help confirm if branching would help facilitate your use case?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org
[GitHub] [iceberg] holdenk commented on issue #6652: Support for global shadow writes + logs
Posted by "holdenk (via GitHub)" <gi...@apache.org>.
holdenk commented on issue #6652:
URL: https://github.com/apache/iceberg/issues/6652#issuecomment-1405779103
Awesome thanks @amogh-jahagirdar :)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org