You are viewing a plain text version of this content. The canonical link for it is here.
Posted to github@arrow.apache.org by GitBox <gi...@apache.org> on 2022/05/09 02:37:46 UTC
[GitHub] [arrow-datafusion] andygrove opened a new pull request, #2490: WIP: Prepare for 8.0.0 release
andygrove opened a new pull request, #2490:
URL: https://github.com/apache/arrow-datafusion/pull/2490
# Which issue does this PR close?
<!--
We generally require a GitHub issue to be filed for all bug fixes and enhancements and this helps us generate change logs for our releases. You can link an issue to this PR using the GitHub syntax. For example `Closes #123` indicates that this PR will close issue #123.
-->
Closes https://github.com/apache/arrow-datafusion/issues/2392
# Rationale for this change
<!--
Why are you proposing this change? If this is already explained clearly in the issue then this section is not needed.
Explaining clearly why changes are proposed helps reviewers understand your changes and offer better suggestions for fixes.
-->
We want to release a new version
# What changes are included in this PR?
<!--
There is no need to duplicate the description in the issue here but it is sometimes worth providing a summary of the individual changes in this PR.
-->
- Bump version numbers
- Generate changelogs
# Are there any user-facing changes?
<!--
If there are user-facing changes then we may require documentation to be updated before approving the PR.
-->
No
<!--
If there are any breaking changes to public APIs, please add the `api change` label.
-->
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow-datafusion] andygrove merged pull request #2490: Prepare for datafusion 8.0.0 , ballista 0.7.0 release
Posted by GitBox <gi...@apache.org>.
andygrove merged PR #2490:
URL: https://github.com/apache/arrow-datafusion/pull/2490
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow-datafusion] alamb commented on pull request #2490: Prepare for 8.0.0 release
Posted by GitBox <gi...@apache.org>.
alamb commented on PR #2490:
URL: https://github.com/apache/arrow-datafusion/pull/2490#issuecomment-1125173086
> One issue is that there is no 7.1.0 tag so I generated the changelog from 7.0.0. Maybe we need to create the 7.1.0 tag and then generate the changelog again?
Sorry about that -- I appear to have missed I step. I created the 7.1.0-rc1 tag, but never made a 7.1.0 tag (should be the same commit as 7.1.0-rc1). I am happy to do so if that would help
https://github.com/apache/arrow-datafusion/releases/tag/7.1.0-rc1
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow-datafusion] andygrove commented on a diff in pull request #2490: Prepare for datafusion 8.0.0 , ballista 0.7.0 release
Posted by GitBox <gi...@apache.org>.
andygrove commented on code in PR #2490:
URL: https://github.com/apache/arrow-datafusion/pull/2490#discussion_r871573099
##########
ballista/CHANGELOG.md:
##########
@@ -19,6 +19,154 @@
# Changelog
+## [8.0.0](https://github.com/apache/arrow-datafusion/tree/8.0.0) (2022-05-12)
Review Comment:
Yes, it is confusing for sure, and Ballista is actually 0.7.0 not 7.0.0.
My preference would be to move Ballista as soon as possible after this release and keep the version < 1.0.0.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow-datafusion] andygrove commented on a diff in pull request #2490: Prepare for datafusion 8.0.0 , ballista 0.7.0 release
Posted by GitBox <gi...@apache.org>.
andygrove commented on code in PR #2490:
URL: https://github.com/apache/arrow-datafusion/pull/2490#discussion_r871579914
##########
ballista/CHANGELOG.md:
##########
@@ -19,6 +19,154 @@
# Changelog
+## [8.0.0](https://github.com/apache/arrow-datafusion/tree/8.0.0) (2022-05-12)
Review Comment:
I should have run `./dev/release/update_change_log-ballista.sh master ballista-0.7.0 ballista-0.6.0`.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow-datafusion] andygrove commented on pull request #2490: Prepare for 8.0.0 release
Posted by GitBox <gi...@apache.org>.
andygrove commented on PR #2490:
URL: https://github.com/apache/arrow-datafusion/pull/2490#issuecomment-1125145753
> @andygrove did i get the `CREATE VIEW` feature added in time for this release? I dont see it in changelog
Yes, `CREATE VIEW` is definitely in here. Changelogs are wrong and I am not sure why but am looking into it ...
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow-datafusion] andygrove commented on a diff in pull request #2490: Prepare for datafusion 8.0.0 , ballista 0.7.0 release
Posted by GitBox <gi...@apache.org>.
andygrove commented on code in PR #2490:
URL: https://github.com/apache/arrow-datafusion/pull/2490#discussion_r871577097
##########
ballista/CHANGELOG.md:
##########
@@ -19,6 +19,154 @@
# Changelog
+## [8.0.0](https://github.com/apache/arrow-datafusion/tree/8.0.0) (2022-05-12)
Review Comment:
I think I should have used different parameters when generating the ballista changelog. Our instructions are not correct here ... I will do this now.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow-datafusion] andygrove commented on a diff in pull request #2490: Prepare for datafusion 8.0.0 , ballista 0.7.0 release
Posted by GitBox <gi...@apache.org>.
andygrove commented on code in PR #2490:
URL: https://github.com/apache/arrow-datafusion/pull/2490#discussion_r871590021
##########
ballista/CHANGELOG.md:
##########
@@ -19,6 +19,289 @@
# Changelog
+## [ballista-0.7.0](https://github.com/apache/arrow-datafusion/tree/ballista-0.7.0) (2022-05-12)
+
+[Full Changelog](https://github.com/apache/arrow-datafusion/compare/7.1.0-rc1...ballista-0.7.0)
Review Comment:
@alamb This looks better now although still slightly confusing because there is also a reference to `7.1.0-rc1` but I think we can live with that.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow-datafusion] andygrove commented on pull request #2490: Prepare for 8.0.0 release
Posted by GitBox <gi...@apache.org>.
andygrove commented on PR #2490:
URL: https://github.com/apache/arrow-datafusion/pull/2490#issuecomment-1125168833
@matthewmturner Change logs look good now. I see `CREATE VIEW` in there.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow-datafusion] andygrove commented on pull request #2490: Prepare for 8.0.0 release
Posted by GitBox <gi...@apache.org>.
andygrove commented on PR #2490:
URL: https://github.com/apache/arrow-datafusion/pull/2490#issuecomment-1125129229
@alamb @tustvold @yjshen Here is the 8.0.0 release PR. One issue is that there is no 7.1.0 tag so I generated the changelog from 7.0.0. Maybe we need to create the 7.1.0 tag and then generate the changelog again?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow-datafusion] matthewmturner commented on pull request #2490: Prepare for datafusion 8.0.0 , ballista 0.7.0 release
Posted by GitBox <gi...@apache.org>.
matthewmturner commented on PR #2490:
URL: https://github.com/apache/arrow-datafusion/pull/2490#issuecomment-1125180146
> @matthewmturner Change logs look good now. I see `CREATE VIEW` in there.
Thanks!
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow-datafusion] alamb commented on a diff in pull request #2490: Prepare for datafusion 8.0.0 , ballista 0.7.0 release
Posted by GitBox <gi...@apache.org>.
alamb commented on code in PR #2490:
URL: https://github.com/apache/arrow-datafusion/pull/2490#discussion_r871568048
##########
ballista/CHANGELOG.md:
##########
@@ -19,6 +19,154 @@
# Changelog
+## [8.0.0](https://github.com/apache/arrow-datafusion/tree/8.0.0) (2022-05-12)
Review Comment:
I wonder if it is confusing to have ballista be version 7 but the changelog refer to version 8?
Maybe it makes sense to change the ballista version to 8.0.0 (and skip releasing version 7.0.0) for convenience and then when we split the repo (e.g. #2502 ) we can let the versions diverge
##########
ballista/CHANGELOG.md:
##########
@@ -19,6 +19,154 @@
# Changelog
+## [8.0.0](https://github.com/apache/arrow-datafusion/tree/8.0.0) (2022-05-12)
+
+[Full Changelog](https://github.com/apache/arrow-datafusion/compare/7.1.0-rc1...8.0.0)
+
+**Breaking changes:**
+
+- Make `ExecutionPlan::execute` Sync [\#2434](https://github.com/apache/arrow-datafusion/pull/2434) ([tustvold](https://github.com/tustvold))
+- Add `Expr::Exists` to represent EXISTS subquery expression [\#2339](https://github.com/apache/arrow-datafusion/pull/2339) ([andygrove](https://github.com/andygrove))
+- Remove dependency from `LogicalPlan::TableScan` to `ExecutionPlan` [\#2284](https://github.com/apache/arrow-datafusion/pull/2284) ([andygrove](https://github.com/andygrove))
+- Move logical expression type-coercion code from `physical-expr` crate to `expr` crate [\#2257](https://github.com/apache/arrow-datafusion/pull/2257) ([andygrove](https://github.com/andygrove))
+- feat: 2061 create external table ddl table partition cols [\#2099](https://github.com/apache/arrow-datafusion/pull/2099) [[sql](https://github.com/apache/arrow-datafusion/labels/sql)] ([jychen7](https://github.com/jychen7))
+- Reorganize the project folders [\#2081](https://github.com/apache/arrow-datafusion/pull/2081) ([yahoNanJing](https://github.com/yahoNanJing))
+- Support more ScalarFunction in Ballista [\#2008](https://github.com/apache/arrow-datafusion/pull/2008) ([Ted-Jiang](https://github.com/Ted-Jiang))
+- Merge dataframe and dataframe imp [\#1998](https://github.com/apache/arrow-datafusion/pull/1998) ([vchag](https://github.com/vchag))
+- Rename `ExecutionContext` to `SessionContext`, `ExecutionContextState` to `SessionState`, add `TaskContext` to support multi-tenancy configurations - Part 1 [\#1987](https://github.com/apache/arrow-datafusion/pull/1987) ([mingmwang](https://github.com/mingmwang))
+- Add Coalesce function [\#1969](https://github.com/apache/arrow-datafusion/pull/1969) ([msathis](https://github.com/msathis))
+- Add Create Schema functionality in SQL [\#1959](https://github.com/apache/arrow-datafusion/pull/1959) [[sql](https://github.com/apache/arrow-datafusion/labels/sql)] ([matthewmturner](https://github.com/matthewmturner))
+- remove sync constraint of SendableRecordBatchStream [\#1884](https://github.com/apache/arrow-datafusion/pull/1884) ([doki23](https://github.com/doki23))
+
+**Implemented enhancements:**
+
+- Add `CREATE VIEW` [\#2279](https://github.com/apache/arrow-datafusion/pull/2279) ([matthewmturner](https://github.com/matthewmturner))
+- \[Ballista\] Support Union in ballista. [\#2098](https://github.com/apache/arrow-datafusion/pull/2098) ([Ted-Jiang](https://github.com/Ted-Jiang))
+- Add missing aggr\_expr to PhysicalExprNode for Ballista. [\#1989](https://github.com/apache/arrow-datafusion/pull/1989) ([Ted-Jiang](https://github.com/Ted-Jiang))
+
+**Fixed bugs:**
+
+- Ballista integration tests no longer work [\#2440](https://github.com/apache/arrow-datafusion/issues/2440)
+- Ballista crates cannot be released from DafaFusion 7.0.0 source release [\#1980](https://github.com/apache/arrow-datafusion/issues/1980)
+- protobuf OctetLength should be deserialized as octet\_length, not length [\#1834](https://github.com/apache/arrow-datafusion/pull/1834) ([carols10cents](https://github.com/carols10cents))
+
+**Documentation updates:**
+
+- MINOR: Make crate READMEs consistent [\#2437](https://github.com/apache/arrow-datafusion/pull/2437) ([andygrove](https://github.com/andygrove))
+- docs: Update the Ballista dev env instructions [\#2419](https://github.com/apache/arrow-datafusion/pull/2419) ([haoxins](https://github.com/haoxins))
+- Revise document of installing ballista pinned to specified version [\#2034](https://github.com/apache/arrow-datafusion/pull/2034) ([WinkerDu](https://github.com/WinkerDu))
+- Fix typos \(Datafusion -\> DataFusion\) [\#1993](https://github.com/apache/arrow-datafusion/pull/1993) ([andygrove](https://github.com/andygrove))
+
+**Performance improvements:**
+
+- Introduce StageManager for managing tasks stage by stage [\#1983](https://github.com/apache/arrow-datafusion/pull/1983) ([yahoNanJing](https://github.com/yahoNanJing))
+
+**Closed issues:**
+
+- Make expected result string in unit tests more readable [\#2412](https://github.com/apache/arrow-datafusion/issues/2412)
+- remove duplicated `fn aggregate()` in aggregate expression tests [\#2399](https://github.com/apache/arrow-datafusion/issues/2399)
+- split `distinct_expression.rs` into `count_distinct.rs` and `array_agg_distinct.rs` [\#2385](https://github.com/apache/arrow-datafusion/issues/2385)
+- move sql tests in `context.rs` to corresponding test files in `datafustion/core/tests/sql` [\#2328](https://github.com/apache/arrow-datafusion/issues/2328)
+- Date32/Date64 as join keys for merge join [\#2314](https://github.com/apache/arrow-datafusion/issues/2314)
+- Error precision and scale for decimal coercion in logic comparison [\#2232](https://github.com/apache/arrow-datafusion/issues/2232)
+- Support Multiple row layout [\#2188](https://github.com/apache/arrow-datafusion/issues/2188)
+- Discussion: Is Ballista a standalone system or framework [\#1916](https://github.com/apache/arrow-datafusion/issues/1916)
+
+**Merged pull requests:**
Review Comment:
"not bad" -- this is a pretty awesome list of features 👍
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow-datafusion] andygrove commented on pull request #2490: Prepare for datafusion 8.0.0 , ballista 0.7.0 release
Posted by GitBox <gi...@apache.org>.
andygrove commented on PR #2490:
URL: https://github.com/apache/arrow-datafusion/pull/2490#issuecomment-1125175341
> > One issue is that there is no 7.1.0 tag so I generated the changelog from 7.0.0. Maybe we need to create the 7.1.0 tag and then generate the changelog again?
>
> Sorry about that -- I appear to have missed I step. I created the 7.1.0-rc1 tag, but never made a 7.1.0 tag (should be the same commit as 7.1.0-rc1). I am happy to do so if that would help
>
> https://github.com/apache/arrow-datafusion/releases/tag/7.1.0-rc1
Yes, I generated the change log from 7.1.0-rc1 this time and that worked fine.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow-datafusion] alamb commented on a diff in pull request #2490: WIP: Prepare for 8.0.0 release
Posted by GitBox <gi...@apache.org>.
alamb commented on code in PR #2490:
URL: https://github.com/apache/arrow-datafusion/pull/2490#discussion_r870259245
##########
datafusion/CHANGELOG.md:
##########
@@ -19,6 +19,328 @@
# Changelog
+## [8.0.0](https://github.com/apache/arrow-datafusion/tree/8.0.0) (2022-05-08)
+
+[Full Changelog](https://github.com/apache/arrow-datafusion/compare/7.1.0-rc1...8.0.0)
+
+**Breaking changes:**
Review Comment:
😮 -- lots of stuff has happened
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow-datafusion] andygrove commented on pull request #2490: Prepare for 8.0.0 release
Posted by GitBox <gi...@apache.org>.
andygrove commented on PR #2490:
URL: https://github.com/apache/arrow-datafusion/pull/2490#issuecomment-1125137457
Something is wrong with the changelogs. They are way too small now.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow-datafusion] matthewmturner commented on pull request #2490: Prepare for 8.0.0 release
Posted by GitBox <gi...@apache.org>.
matthewmturner commented on PR #2490:
URL: https://github.com/apache/arrow-datafusion/pull/2490#issuecomment-1125137953
@andygrove did i get the `CREATE VIEW` feature added in time for this release? I dont see it in changelog
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow-datafusion] matthewmturner commented on pull request #2490: Prepare for 8.0.0 release
Posted by GitBox <gi...@apache.org>.
matthewmturner commented on PR #2490:
URL: https://github.com/apache/arrow-datafusion/pull/2490#issuecomment-1125155683
great thanks. i wrote that at the same time you were saying something wrong with changelogs lol
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org