You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@iceberg.apache.org by "jpugliesi (via GitHub)" <gi...@apache.org> on 2023/06/13 16:24:13 UTC

[GitHub] [iceberg] jpugliesi opened a new issue, #7830: Implement Spark `fast_forward` procedure

jpugliesi opened a new issue, #7830:
URL: https://github.com/apache/iceberg/issues/7830

   ### Feature Request / Improvement
   
   [As discussed on slack](https://apache-iceberg.slack.com/archives/C025PH0G1D4/p1682464799477819?thread_ts=1682025581.770009&cid=C025PH0G1D4), it would be useful to have a Spark procedure to fast-forward a table to a branch.
   
   Example (copied from the slack thread):
   ```sql
   -- update main branch to the state of xyz
   call system.fast_forward(
       table => 'db.table',
       to => 'xyz');
   
   -- update another branch to the state of xyz
   call system.fast_forward(
       table => 'db.table',
       branch => 'another',
       to => 'xyz')
   ```
   
   ### Query engine
   
   Spark


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org

[GitHub] [iceberg] flyrain commented on issue #7830: Implement Spark `fast_forward` procedure

Posted by "flyrain (via GitHub)" <gi...@apache.org>.
flyrain commented on issue #7830:
URL: https://github.com/apache/iceberg/issues/7830#issuecomment-1592420845

   I'm not aware of anyone working on it. @amogh-jahagirdar and @jackye1995 may know more.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org

[GitHub] [iceberg] rakesh-das08 commented on issue #7830: Implement Spark `fast_forward` procedure

Posted by "rakesh-das08 (via GitHub)" <gi...@apache.org>.
rakesh-das08 commented on issue #7830:
URL: https://github.com/apache/iceberg/issues/7830#issuecomment-1650088214

   Adding a little more background:
   Lets say we are working on a branch (wap) where we have ran some operations like `rewrite_data_files`.
   Now we want to fast forward the `main` or `some_other_branch` to `wap_branch`.
   Currently we do not have a procedure that does this. 


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org

[GitHub] [iceberg] rdblue closed issue #7830: Implement Spark `fast_forward` procedure

Posted by "rdblue (via GitHub)" <gi...@apache.org>.
rdblue closed issue #7830: Implement Spark `fast_forward` procedure
URL: https://github.com/apache/iceberg/issues/7830


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org

[GitHub] [iceberg] rakesh-das08 commented on issue #7830: Implement Spark `fast_forward` procedure

Posted by "rakesh-das08 (via GitHub)" <gi...@apache.org>.
rakesh-das08 commented on issue #7830:
URL: https://github.com/apache/iceberg/issues/7830#issuecomment-1607414954

   Looks like no is currently working on this and @rdblue also confirmed the same on Slack.
   I will start working on this.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org

[GitHub] [iceberg] manuzhang commented on issue #7830: Implement Spark `fast_forward` procedure

Posted by "manuzhang (via GitHub)" <gi...@apache.org>.
manuzhang commented on issue #7830:
URL: https://github.com/apache/iceberg/issues/7830#issuecomment-1657441515

   Yes, it looks really weird in this [audit-branch](https://iceberg.apache.org/docs/latest/branching/#audit-branch) SQL example that we have to use table API to fast-forward.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org

[GitHub] [iceberg] rakesh-das08 commented on issue #7830: Implement Spark `fast_forward` procedure

Posted by "rakesh-das08 (via GitHub)" <gi...@apache.org>.
rakesh-das08 commented on issue #7830:
URL: https://github.com/apache/iceberg/issues/7830#issuecomment-1591556460

   Is anyone currently working on this? If not i would like to take a stab at it.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org