You are viewing a plain text version of this content. The canonical link for it is here.

Posted to github@arrow.apache.org by GitBox <gi...@apache.org> on 2022/05/21 15:07:28 UTC

[GitHub] [arrow-datafusion] andygrove opened a new issue, #2583: Improve process for making changes to both `arrow-datafusion` and `arrow-ballista`

andygrove opened a new issue, #2583:
URL: https://github.com/apache/arrow-datafusion/issues/2583

   **Is your feature request related to a problem or challenge? Please describe what you are trying to do.**
   As a follow-on to https://github.com/apache/arrow-datafusion/pull/2582 it would be nice if we could make the process a little easier and more automated.
   
   **Describe the solution you'd like**
   I am hoping other people have some ideas. I could not think of a better way.
   
   **Describe alternatives you've considered**
   Live with the current solution.
   
   **Additional context**
   None
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [arrow-datafusion] tustvold commented on issue #2583: Improve process for making changes to both `arrow-datafusion` and `arrow-ballista`

Posted by GitBox <gi...@apache.org>.

tustvold commented on issue #2583:
URL: https://github.com/apache/arrow-datafusion/issues/2583#issuecomment-1139477308

I've created https://github.com/apache/arrow-datafusion/pull/2632 to try to improve the workflow for arrow upgrades, as they're every two weeks. That said I feel something is a bit off with this, in my opinion Ballista should follow DataFusion upgrades, not lead them.

Perhaps in lieu of releasing DataFusion more frequently, we could simply update the git pin within Ballista more frequently. This is what we do with IOx, and often prior to a more risky DataFusion PR we will create a candidate IOx PR to test it out. I think this strikes a pragmatic balance, leaving reviewer discretion as to when to upgrade what.

When a breaking change is made to DataFusion, I think there should be an expectation that the contributor will help out with the corresponding changes to Ballista, but I think requiring the corresponding Ballista change in advance of changing DataFusion is a bit burdensome. My feeling is that at this stage in the arrow-rs and arrow-datafusion projects, which I'd describe as beta-ish, the priority should be iteration speed and trying out new ideas, and not on calcifying APIs for fear of breaking downstream code.

I don't know, I would appreciate your thoughts

--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [arrow-datafusion] andygrove commented on issue #2583: Improve process for making changes to both `arrow-datafusion` and `arrow-ballista`

Posted by GitBox <gi...@apache.org>.

andygrove commented on issue #2583:
URL: https://github.com/apache/arrow-datafusion/issues/2583#issuecomment-1212058927

   I think we can close this now. The current approach seems to be working well enough. Feel free to re-open is I am missing anything.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [arrow-datafusion] andygrove closed issue #2583: Improve process for making changes to both `arrow-datafusion` and `arrow-ballista`

Posted by GitBox <gi...@apache.org>.

andygrove closed issue #2583: Improve process for making changes to both `arrow-datafusion` and `arrow-ballista`
URL: https://github.com/apache/arrow-datafusion/issues/2583


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org