You are viewing a plain text version of this content. The canonical link for it is here.
Posted to github@datafusion.apache.org by "alamb (via GitHub)" <gi...@apache.org> on 2024/10/16 16:12:29 UTC

[I] Oct 16, 2024: This week in DataFusion [datafusion]

alamb opened a new issue, #12973:
URL: https://github.com/apache/datafusion/issues/12973

   ## Introduction
   Goal of this ticket is a weekly summary if interesting things happening in DataFusion over the last week. Note this is not a complete list. Please feel free to comment on this ticket about things that I may have missed or you think should get wider attention by the community
   
   ## Andrew's TLDR:
   We are preparing for the 43.0.0 release and I am personally pretty excited about:
   - https://github.com/apache/datafusion/issues/12821
   - https://github.com/apache/datafusion/issues/8709 
   - https://github.com/apache/datafusion/issues/12740
   
   ## Upcoming Releases 
   - https://github.com/apache/datafusion/issues/12813 (thanks @Xuanwo and @matthewmturner)
   - https://github.com/apache/datafusion/issues/12470 (thanks @andygrove)
   
   ## Project Happenings
   - Integrate sqlparser into DataFusion governance: https://github.com/apache/datafusion-sqlparser-rs/issues/1294#issuecomment-2377918831
   
   
   ## Highlights from last week(s):
   (I am sorry if I missed you -- please add a note to this ticket with anything you would like to add)
   - @dmitrybugakov started managing extension functions in  https://github.com/datafusion-contrib/datafusion-functions-extra
   - @eejbyfeldt is doing some great work on grouping sets such as https://github.com/apache/datafusion/pull/12704
   - @tokoko, @Blizzara @vbarua and @westonpace continue to mature the substrait support such as  https://github.com/apache/datafusion/pull/12800
   - Along with @devanbenz  and @Rachelint and @jayzhan211 I implemented https://github.com/apache/datafusion/pull/12792 to help clickbench queries
   - @timesaucer made a beautiful macro https://github.com/apache/datafusion/pull/12846
   - @Rachelint made a beautiful aggregation fuzzing proect
   - @jonahgao continues to make our SQL handling more beautiful and correct (https://github.com/apache/datafusion/pull/12808, https://github.com/apache/datafusion/pull/12844, etc)
   
   ### Performance
   - https://github.com/apache/datafusion/issues/12821 (thanks to the epic work of @Rachelint, @goldmedal, @jayzhan211, @Dandandan @XiangpengHao and others, we are quite close)
   - https://github.com/apache/datafusion/issues/12680 (kudos to @jayzhan211 and @Rachelint)
   - @simonvandel and @tlmn https://github.com/apache/datafusion/pull/12890
   
   ### Quality
   - https://github.com/apache/datafusion/issues/12114 (already found several bugs -- thanks @Rachelint)
   
   
   ### Extensibility
   - Very close to finishing https://github.com/apache/datafusion/issues/8709 (thanks @jcsherin @jatin510 @hailelagi)
   - @Omega359  started https://github.com/apache/datafusion/issues/12740 and we are making great progress thanks to @jonathanc-n @juroberttyb and others
   - @notfillipo and @findepi are working to better separate logical and physical types https://github.com/apache/datafusion/issues/12622
   
   ### Features
   
   
   ## Interesting discussions underway:
   - https://github.com/apache/datafusion/issues/11442
   - https://github.com/apache/datafusion/issues/12357
   
   ## Community 
   * [Weekly Call](https://docs.google.com/document/d/1NBpkIAuU7O9h8Br5CbFksDhX-L9TyO9wmGLPMe0Plc8/edit#heading=h.kpjkpncdmt1g)
   * Slack/Discord: [info links](https://datafusion.apache.org/contributor-guide/communication.html#slack-and-discord) 
   
   ## Upcoming meetups:
   * [Oct 14 Seattle](https://github.com/apache/datafusion/discussions/10348): https://lu.ma/tnwl866b @phillipleblanc @likekim
   * [Dec 18 Chicago](https://github.com/apache/datafusion/discussions/12894): https://lu.ma/eq5myc5i @adriangb @timsaucer 
   
   
   ## Background:
   I got some great feedback from @timsaucer,  @findepi and @andygrove on the DataFusion weekly call  that having a weekly summary like https://github.com/apache/datafusion/issues/12494 was helpful. I will therefore try to write up one each week
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For additional commands, e-mail: github-help@datafusion.apache.org


Re: [I] Oct 16, 2024: This week in DataFusion [datafusion]

Posted by "alamb (via GitHub)" <gi...@apache.org>.
alamb commented on issue #12973:
URL: https://github.com/apache/datafusion/issues/12973#issuecomment-2419533070

   A discussion about meetup in Amsterdam:
   - https://github.com/apache/datafusion/discussions/12988


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For additional commands, e-mail: github-help@datafusion.apache.org


Re: [I] Oct 16, 2024: This week in DataFusion [datafusion]

Posted by "alamb (via GitHub)" <gi...@apache.org>.
alamb commented on issue #12973:
URL: https://github.com/apache/datafusion/issues/12973#issuecomment-2426654137

   Next week's issue: https://github.com/apache/datafusion/issues/13035


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For additional commands, e-mail: github-help@datafusion.apache.org


Re: [I] Oct 16, 2024: This week in DataFusion [datafusion]

Posted by "alamb (via GitHub)" <gi...@apache.org>.
alamb closed issue #12973: Oct 16, 2024: This week in DataFusion
URL: https://github.com/apache/datafusion/issues/12973


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For additional commands, e-mail: github-help@datafusion.apache.org


Re: [I] Oct 16, 2024: This week in DataFusion [datafusion]

Posted by "jonathanc-n (via GitHub)" <gi...@apache.org>.
jonathanc-n commented on issue #12973:
URL: https://github.com/apache/datafusion/issues/12973#issuecomment-2418383762

   @alamb I really like this, keeping one up each week would be great. Gives everybody a good direction to go in for the overall project. Thanks for writing this!


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For additional commands, e-mail: github-help@datafusion.apache.org


Re: [I] Oct 16, 2024: This week in DataFusion [datafusion]

Posted by "alamb (via GitHub)" <gi...@apache.org>.
alamb commented on issue #12973:
URL: https://github.com/apache/datafusion/issues/12973#issuecomment-2425201823

   Something else I hope to highlight next week is how the process of reviewing PRs helps understand the code, helps the community, and drives the process forward


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For additional commands, e-mail: github-help@datafusion.apache.org