You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@arrow.apache.org by ag...@apache.org on 2023/04/24 22:14:34 UTC
[arrow-datafusion-python] branch main updated: Prepare for 23.0.0 release (#335)
This is an automated email from the ASF dual-hosted git repository.
agrove pushed a commit to branch main
in repository https://gitbox.apache.org/repos/asf/arrow-datafusion-python.git
The following commit(s) were added to refs/heads/main by this push:
new e6e8e12 Prepare for 23.0.0 release (#335)
e6e8e12 is described below
commit e6e8e128b95ceb91b5baaec6d04389b1c642c9d6
Author: Andy Grove <an...@gmail.com>
AuthorDate: Mon Apr 24 16:14:29 2023 -0600
Prepare for 23.0.0 release (#335)
---
CHANGELOG.md | 25 ++++---
Cargo.lock | 182 +++++++++++++++++++++------------------------
Cargo.toml | 14 ++--
dev/release/README.md | 12 ++-
src/common/data_type.rs | 2 +-
src/expr/literal.rs | 4 +-
src/expr/subquery_alias.rs | 2 +-
src/udaf.rs | 4 +-
src/udf.rs | 2 +-
9 files changed, 127 insertions(+), 120 deletions(-)
diff --git a/CHANGELOG.md b/CHANGELOG.md
index 7f4a35c..b8942f9 100644
--- a/CHANGELOG.md
+++ b/CHANGELOG.md
@@ -19,6 +19,15 @@
# Changelog
+## [23.0.0](https://github.com/apache/arrow-datafusion-python/tree/23.0.0) (2023-04-23)
+
+[Full Changelog](https://github.com/apache/arrow-datafusion-python/compare/22.0.0...23.0.0)
+
+**Merged pull requests:**
+
+- Improve API docs, README, and examples for configuring context [#321](https://github.com/apache/arrow-datafusion-python/pull/321) (andygrove)
+- Osx build linker args [#330](https://github.com/apache/arrow-datafusion-python/pull/330) (jdye64)
+
## [22.0.0](https://github.com/apache/arrow-datafusion-python/tree/22.0.0) (2023-04-10)
[Full Changelog](https://github.com/apache/arrow-datafusion-python/compare/21.0.0...22.0.0)
@@ -163,7 +172,7 @@
- Arrow type bindings [\#173](https://github.com/apache/arrow-datafusion-python/pull/173) ([jdye64](https://github.com/jdye64))
- Pyo3 bump [\#171](https://github.com/apache/arrow-datafusion-python/pull/171) ([jdye64](https://github.com/jdye64))
- feature: Add additional aggregation functions [\#170](https://github.com/apache/arrow-datafusion-python/pull/170) ([simicd](https://github.com/simicd))
-- Make from\_substrait\_plan return DataFrame instead of LogicalPlan [\#164](https://github.com/apache/arrow-datafusion-python/pull/164) ([andygrove](https://github.com/andygrove))
+- Make from_substrait_plan return DataFrame instead of LogicalPlan [\#164](https://github.com/apache/arrow-datafusion-python/pull/164) ([andygrove](https://github.com/andygrove))
- feature: Implement count method [\#163](https://github.com/apache/arrow-datafusion-python/pull/163) ([simicd](https://github.com/simicd))
- CI Fixes [\#162](https://github.com/apache/arrow-datafusion-python/pull/162) ([jdye64](https://github.com/jdye64))
- Upgrade to DataFusion 17 [\#160](https://github.com/apache/arrow-datafusion-python/pull/160) ([andygrove](https://github.com/andygrove))
@@ -180,7 +189,7 @@
- Prepare for 0.8.0 release [\#141](https://github.com/apache/arrow-datafusion-python/pull/141) ([andygrove](https://github.com/andygrove))
- Improve README and add more examples [\#137](https://github.com/apache/arrow-datafusion-python/pull/137) ([andygrove](https://github.com/andygrove))
- test: Expand tests for built-in functions [\#129](https://github.com/apache/arrow-datafusion-python/pull/129) ([simicd](https://github.com/simicd))
-- build\(deps\): bump object\_store from 0.5.2 to 0.5.3 [\#126](https://github.com/apache/arrow-datafusion-python/pull/126) ([dependabot[bot]](https://github.com/apps/dependabot))
+- build\(deps\): bump object_store from 0.5.2 to 0.5.3 [\#126](https://github.com/apache/arrow-datafusion-python/pull/126) ([dependabot[bot]](https://github.com/apps/dependabot))
- build\(deps\): bump mimalloc from 0.1.32 to 0.1.34 [\#125](https://github.com/apache/arrow-datafusion-python/pull/125) ([dependabot[bot]](https://github.com/apps/dependabot))
- Introduce conda directory containing datafusion-dev.yaml conda enviro… [\#124](https://github.com/apache/arrow-datafusion-python/pull/124) ([jdye64](https://github.com/jdye64))
- build\(deps\): bump bzip2 from 0.4.3 to 0.4.4 [\#121](https://github.com/apache/arrow-datafusion-python/pull/121) ([dependabot[bot]](https://github.com/apps/dependabot))
@@ -188,7 +197,7 @@
- build\(deps\): bump async-trait from 0.1.60 to 0.1.61 [\#118](https://github.com/apache/arrow-datafusion-python/pull/118) ([dependabot[bot]](https://github.com/apps/dependabot))
- Upgrade to DataFusion 16.0.0 [\#115](https://github.com/apache/arrow-datafusion-python/pull/115) ([andygrove](https://github.com/andygrove))
- Bump async-trait from 0.1.57 to 0.1.60 [\#114](https://github.com/apache/arrow-datafusion-python/pull/114) ([dependabot[bot]](https://github.com/apps/dependabot))
-- Bump object\_store from 0.5.1 to 0.5.2 [\#112](https://github.com/apache/arrow-datafusion-python/pull/112) ([dependabot[bot]](https://github.com/apps/dependabot))
+- Bump object_store from 0.5.1 to 0.5.2 [\#112](https://github.com/apache/arrow-datafusion-python/pull/112) ([dependabot[bot]](https://github.com/apps/dependabot))
- Bump tokio from 1.21.2 to 1.23.0 [\#109](https://github.com/apache/arrow-datafusion-python/pull/109) ([dependabot[bot]](https://github.com/apps/dependabot))
- Add entries for publishing production \(asf-site\) and staging docs [\#107](https://github.com/apache/arrow-datafusion-python/pull/107) ([martin-g](https://github.com/martin-g))
- Add a workflow that builds the docs and deploys them at staged or production [\#104](https://github.com/apache/arrow-datafusion-python/pull/104) ([martin-g](https://github.com/martin-g))
@@ -212,9 +221,9 @@
**Implemented enhancements:**
-- Add bindings for datafusion\_common::DFField [\#184](https://github.com/apache/arrow-datafusion-python/issues/184)
+- Add bindings for datafusion_common::DFField [\#184](https://github.com/apache/arrow-datafusion-python/issues/184)
- Add bindings for DFSchema/DFSchemaRef [\#181](https://github.com/apache/arrow-datafusion-python/issues/181)
-- Add bindings for datafusion\_expr Projection [\#179](https://github.com/apache/arrow-datafusion-python/issues/179)
+- Add bindings for datafusion_expr Projection [\#179](https://github.com/apache/arrow-datafusion-python/issues/179)
- Add bindings for `TableScan` struct from `datafusion_expr::TableScan` [\#177](https://github.com/apache/arrow-datafusion-python/issues/177)
- Add a "mapping" struct for types [\#172](https://github.com/apache/arrow-datafusion-python/issues/172)
- Improve string representation of datafusion classes \(dataframe, context, expression, ...\) [\#158](https://github.com/apache/arrow-datafusion-python/issues/158)
@@ -233,7 +242,7 @@
- Build is broken [\#161](https://github.com/apache/arrow-datafusion-python/issues/161)
- Out of memory when sorting [\#157](https://github.com/apache/arrow-datafusion-python/issues/157)
-- window\_lead test appears to be non-deterministic [\#135](https://github.com/apache/arrow-datafusion-python/issues/135)
+- window_lead test appears to be non-deterministic [\#135](https://github.com/apache/arrow-datafusion-python/issues/135)
- Reading csv does not work [\#130](https://github.com/apache/arrow-datafusion-python/issues/130)
- Github actions produce a lot of warnings [\#94](https://github.com/apache/arrow-datafusion-python/issues/94)
- ASF source release tarball has wrong directory name [\#90](https://github.com/apache/arrow-datafusion-python/issues/90)
@@ -252,7 +261,6 @@
[Full Changelog](https://github.com/apache/arrow-datafusion-python/compare/0.7.0...0.7.0-rc2)
-
## [Unreleased](https://github.com/datafusion-contrib/datafusion-python/tree/HEAD)
[Full Changelog](https://github.com/datafusion-contrib/datafusion-python/compare/0.5.1...HEAD)
@@ -319,5 +327,4 @@
\* _This Changelog was automatically generated by [github_changelog_generator](https://github.com/github-changelog-generator/github-changelog-generator)_
-
-\* *This Changelog was automatically generated by [github_changelog_generator](https://github.com/github-changelog-generator/github-changelog-generator)*
+\* _This Changelog was automatically generated by [github_changelog_generator](https://github.com/github-changelog-generator/github-changelog-generator)_
diff --git a/Cargo.lock b/Cargo.lock
index f4d8e0f..2622625 100644
--- a/Cargo.lock
+++ b/Cargo.lock
@@ -29,9 +29,9 @@ dependencies = [
[[package]]
name = "aho-corasick"
-version = "0.7.20"
+version = "1.0.1"
source = "registry+https://github.com/rust-lang/crates.io-index"
-checksum = "cc936419f96fa211c1b9166887b38e5e40b19958e5b895be7c1f93adec7071ac"
+checksum = "67fc08ce920c31afb70f013dcce1bfc3a3195de6a228474e45e1f145b36f8d04"
dependencies = [
"memchr",
]
@@ -113,9 +113,9 @@ checksum = "8da52d66c7071e2e3fa2a1e5c6d088fec47b593032b254f5e980de8ea54454d6"
[[package]]
name = "arrow"
-version = "36.0.0"
+version = "37.0.0"
source = "registry+https://github.com/rust-lang/crates.io-index"
-checksum = "990dfa1a9328504aa135820da1c95066537b69ad94c04881b785f64328e0fa6b"
+checksum = "1aea9fcb25bbb70f7f922f95b99ca29c1013dab47f6df61a6f24861842dd7f2e"
dependencies = [
"ahash",
"arrow-arith",
@@ -136,9 +136,9 @@ dependencies = [
[[package]]
name = "arrow-arith"
-version = "36.0.0"
+version = "37.0.0"
source = "registry+https://github.com/rust-lang/crates.io-index"
-checksum = "f2b2e52de0ab54173f9b08232b7184c26af82ee7ab4ac77c83396633c90199fa"
+checksum = "8d967b42f7b12c91fd78acd396b20c2973b184c8866846674abbb00c963e93ab"
dependencies = [
"arrow-array",
"arrow-buffer",
@@ -151,9 +151,9 @@ dependencies = [
[[package]]
name = "arrow-array"
-version = "36.0.0"
+version = "37.0.0"
source = "registry+https://github.com/rust-lang/crates.io-index"
-checksum = "e10849b60c17dbabb334be1f4ef7550701aa58082b71335ce1ed586601b2f423"
+checksum = "3190f208ee7aa0f3596fa0098d42911dec5e123ca88c002a08b24877ad14c71e"
dependencies = [
"ahash",
"arrow-buffer",
@@ -168,9 +168,9 @@ dependencies = [
[[package]]
name = "arrow-buffer"
-version = "36.0.0"
+version = "37.0.0"
source = "registry+https://github.com/rust-lang/crates.io-index"
-checksum = "b0746ae991b186be39933147117f8339eb1c4bbbea1c8ad37e7bf5851a1a06ba"
+checksum = "5d33c733c5b6c44a0fc526f29c09546e04eb56772a7a21e48e602f368be381f6"
dependencies = [
"half",
"num",
@@ -178,9 +178,9 @@ dependencies = [
[[package]]
name = "arrow-cast"
-version = "36.0.0"
+version = "37.0.0"
source = "registry+https://github.com/rust-lang/crates.io-index"
-checksum = "b88897802515d7b193e38b27ddd9d9e43923d410a9e46307582d756959ee9595"
+checksum = "abd349520b6a1ed4924ae2afc9d23330a3044319e4ec3d5b124c09e4d440ae87"
dependencies = [
"arrow-array",
"arrow-buffer",
@@ -195,9 +195,9 @@ dependencies = [
[[package]]
name = "arrow-csv"
-version = "36.0.0"
+version = "37.0.0"
source = "registry+https://github.com/rust-lang/crates.io-index"
-checksum = "1c8220d9741fc37961262710ceebd8451a5b393de57c464f0267ffdda1775c0a"
+checksum = "c80af3c3e290a2a7e1cc518f1471dff331878cb4af9a5b088bf030b89debf649"
dependencies = [
"arrow-array",
"arrow-buffer",
@@ -214,9 +214,9 @@ dependencies = [
[[package]]
name = "arrow-data"
-version = "36.0.0"
+version = "37.0.0"
source = "registry+https://github.com/rust-lang/crates.io-index"
-checksum = "533f937efa1aaad9dc86f6a0e382c2fa736a4943e2090c946138079bdf060cef"
+checksum = "b1c8361947aaa96d331da9df3f7a08bdd8ab805a449994c97f5c4d24c4b7e2cf"
dependencies = [
"arrow-buffer",
"arrow-schema",
@@ -226,9 +226,9 @@ dependencies = [
[[package]]
name = "arrow-ipc"
-version = "36.0.0"
+version = "37.0.0"
source = "registry+https://github.com/rust-lang/crates.io-index"
-checksum = "18b75296ff01833f602552dff26a423fc213db8e5049b540ca4a00b1c957e41c"
+checksum = "9a46ee000b9fbd1e8db6e8b26acb8c760838512b39d8c9f9d73892cb55351d50"
dependencies = [
"arrow-array",
"arrow-buffer",
@@ -240,9 +240,9 @@ dependencies = [
[[package]]
name = "arrow-json"
-version = "36.0.0"
+version = "37.0.0"
source = "registry+https://github.com/rust-lang/crates.io-index"
-checksum = "e501d3de4d612c90677594896ca6c0fa075665a7ff980dc4189bb531c17e19f6"
+checksum = "4bf2366607be867ced681ad7f272371a5cf1fc2941328eef7b4fee14565166fb"
dependencies = [
"arrow-array",
"arrow-buffer",
@@ -254,14 +254,15 @@ dependencies = [
"indexmap",
"lexical-core",
"num",
+ "serde",
"serde_json",
]
[[package]]
name = "arrow-ord"
-version = "36.0.0"
+version = "37.0.0"
source = "registry+https://github.com/rust-lang/crates.io-index"
-checksum = "33d2671eb3793f9410230ac3efb0e6d36307be8a2dac5fad58ac9abde8e9f01e"
+checksum = "304069901c867200e21ec868ae7521165875470ef2f1f6d58f979a443d63997e"
dependencies = [
"arrow-array",
"arrow-buffer",
@@ -274,9 +275,9 @@ dependencies = [
[[package]]
name = "arrow-row"
-version = "36.0.0"
+version = "37.0.0"
source = "registry+https://github.com/rust-lang/crates.io-index"
-checksum = "fc11fa039338cebbf4e29cf709c8ac1d6a65c7540063d4a25f991ab255ca85c8"
+checksum = "0d57fe8ceef3392fdd493269d8a2d589de17bafce151aacbffbddac7a57f441a"
dependencies = [
"ahash",
"arrow-array",
@@ -289,18 +290,18 @@ dependencies = [
[[package]]
name = "arrow-schema"
-version = "36.0.0"
+version = "37.0.0"
source = "registry+https://github.com/rust-lang/crates.io-index"
-checksum = "d04f17f7b86ded0b5baf98fe6123391c4343e031acc3ccc5fa604cc180bff220"
+checksum = "a16b88a93ac8350f0200b1cd336a1f887315925b8dd7aa145a37b8bdbd8497a4"
dependencies = [
- "bitflags 2.1.0",
+ "bitflags 2.2.1",
]
[[package]]
name = "arrow-select"
-version = "36.0.0"
+version = "37.0.0"
source = "registry+https://github.com/rust-lang/crates.io-index"
-checksum = "163e35de698098ff5f5f672ada9dc1f82533f10407c7a11e2cd09f3bcf31d18a"
+checksum = "98e8a4d6ca37d5212439b24caad4d80743fcbb706706200dd174bb98e68fe9d8"
dependencies = [
"arrow-array",
"arrow-buffer",
@@ -311,9 +312,9 @@ dependencies = [
[[package]]
name = "arrow-string"
-version = "36.0.0"
+version = "37.0.0"
source = "registry+https://github.com/rust-lang/crates.io-index"
-checksum = "bfdfbed1b10209f0dc68e6aa4c43dc76079af65880965c7c3b73f641f23d4aba"
+checksum = "cbb594efa397eb6a546f42b1f8df3d242ea84dbfda5232e06035dc2b2e2c8459"
dependencies = [
"arrow-array",
"arrow-buffer",
@@ -321,7 +322,7 @@ dependencies = [
"arrow-schema",
"arrow-select",
"regex",
- "regex-syntax",
+ "regex-syntax 0.6.29",
]
[[package]]
@@ -393,9 +394,9 @@ checksum = "bef38d45163c2f1dde094a7dfd33ccf595c92905c8f8f4fdc18d06fb1037718a"
[[package]]
name = "bitflags"
-version = "2.1.0"
+version = "2.2.1"
source = "registry+https://github.com/rust-lang/crates.io-index"
-checksum = "c70beb79cbb5ce9c4f8e20849978f34225931f665bb49efa6982875a4d5facb3"
+checksum = "24a6904aef64d73cf10ab17ebace7befb918b82164785cb89907993be7f83813"
[[package]]
name = "blake2"
@@ -473,9 +474,9 @@ dependencies = [
[[package]]
name = "bumpalo"
-version = "3.12.0"
+version = "3.12.1"
source = "registry+https://github.com/rust-lang/crates.io-index"
-checksum = "0d261e256854913907f67ed06efbc3338dfe6179796deefc1ff763fc1aee5535"
+checksum = "9b1ce199063694f33ffb7dd4e0ee620741495c32833cde5aa08f02a0bf96f0c8"
[[package]]
name = "byteorder"
@@ -532,12 +533,9 @@ source = "registry+https://github.com/rust-lang/crates.io-index"
checksum = "4e3c5919066adf22df73762e50cffcde3a758f2a848b113b586d1f86728b673b"
dependencies = [
"iana-time-zone",
- "js-sys",
"num-integer",
"num-traits",
"serde",
- "time 0.1.45",
- "wasm-bindgen",
"winapi",
]
@@ -626,9 +624,9 @@ checksum = "e496a50fda8aacccc86d7529e2c1e0892dbd0f898a6b5645b5561b89c3210efa"
[[package]]
name = "cpufeatures"
-version = "0.2.6"
+version = "0.2.7"
source = "registry+https://github.com/rust-lang/crates.io-index"
-checksum = "280a9f2d8b3a38871a3c8a46fb80db65e5e5ed97da80c4d08bf27fb63e35e181"
+checksum = "3e4c1eaa2012c47becbbad2ab175484c2a84d1185b566fb2cc5b8707343dfe58"
dependencies = [
"libc",
]
@@ -738,13 +736,15 @@ dependencies = [
[[package]]
name = "datafusion"
-version = "22.0.0"
+version = "23.0.0"
source = "registry+https://github.com/rust-lang/crates.io-index"
-checksum = "9bdb93fee4f30368f1f71bfd5cd28882ec9fab0183db7924827b76129d33227c"
+checksum = "a8a7d4b334f4512ff2fdbce87f511f570ae895af1ac7c729e77c12583253b22a"
dependencies = [
"ahash",
"apache-avro",
"arrow",
+ "arrow-array",
+ "arrow-schema",
"async-compression",
"async-trait",
"bytes",
@@ -788,9 +788,9 @@ dependencies = [
[[package]]
name = "datafusion-common"
-version = "22.0.0"
+version = "23.0.0"
source = "registry+https://github.com/rust-lang/crates.io-index"
-checksum = "e82401ce129e601d406012b6d718f8978ba84c386e1c342fa155877120d68824"
+checksum = "80abfcb1dbc6390f952f21de9069e6177ad6318fcae5fbceabb50666d96533dd"
dependencies = [
"apache-avro",
"arrow",
@@ -805,9 +805,9 @@ dependencies = [
[[package]]
name = "datafusion-execution"
-version = "22.0.0"
+version = "23.0.0"
source = "registry+https://github.com/rust-lang/crates.io-index"
-checksum = "b08b2078aed21a27239cd93f3015e492a58b0d50ebeeaf8d2236cf108ef583ce"
+checksum = "df2524f1b4b58319895b112809d2a59e54fa662d0e46330a455f22882c2cb7b9"
dependencies = [
"dashmap",
"datafusion-common",
@@ -823,9 +823,9 @@ dependencies = [
[[package]]
name = "datafusion-expr"
-version = "22.0.0"
+version = "23.0.0"
source = "registry+https://github.com/rust-lang/crates.io-index"
-checksum = "16b5b977ce9695fb4c67614266ec57f384fc11e9a9f9b3e6d0e62b9c5a9f2c1f"
+checksum = "af8040b7a75b04685f4db0a1b11ffa93cd163c1bc13751df3f5cf76baabaf5a1"
dependencies = [
"ahash",
"arrow",
@@ -835,9 +835,9 @@ dependencies = [
[[package]]
name = "datafusion-optimizer"
-version = "22.0.0"
+version = "23.0.0"
source = "registry+https://github.com/rust-lang/crates.io-index"
-checksum = "a0b2bb9e73ed778d1bc5af63a270f0154bf6eab5099c77668a6362296888e46b"
+checksum = "74ceae25accc0f640a4238283f55f3a9fd181d55398703a4330fb2c46261e6a2"
dependencies = [
"arrow",
"async-trait",
@@ -848,14 +848,14 @@ dependencies = [
"hashbrown 0.13.2",
"itertools",
"log",
- "regex-syntax",
+ "regex-syntax 0.6.29",
]
[[package]]
name = "datafusion-physical-expr"
-version = "22.0.0"
+version = "23.0.0"
source = "registry+https://github.com/rust-lang/crates.io-index"
-checksum = "80cd8ea5ab0a07b1b2a3e17d5909f1b1035bd129ffeeb5c66842a32e682f8f79"
+checksum = "df4cf228b312f2758cb78e93fe3d2dc602345028efdf7cfa5b338cb370d0a347"
dependencies = [
"ahash",
"arrow",
@@ -873,6 +873,7 @@ dependencies = [
"indexmap",
"itertools",
"lazy_static",
+ "libc",
"md-5",
"paste",
"petgraph",
@@ -885,7 +886,7 @@ dependencies = [
[[package]]
name = "datafusion-python"
-version = "22.0.0"
+version = "23.0.0"
dependencies = [
"async-trait",
"datafusion",
@@ -901,7 +902,7 @@ dependencies = [
"pyo3",
"pyo3-build-config",
"rand",
- "regex-syntax",
+ "regex-syntax 0.6.29",
"syn 2.0.15",
"tokio",
"url",
@@ -910,9 +911,9 @@ dependencies = [
[[package]]
name = "datafusion-row"
-version = "22.0.0"
+version = "23.0.0"
source = "registry+https://github.com/rust-lang/crates.io-index"
-checksum = "2a95d6badab19fd6e9195fdc5209ac0a7e5ce9bcdedc67767b9ffc1b4e645760"
+checksum = "b52b486fb3d81bb132e400304be01af5aba0ad6737e3518045bb98944991fe32"
dependencies = [
"arrow",
"datafusion-common",
@@ -922,9 +923,9 @@ dependencies = [
[[package]]
name = "datafusion-sql"
-version = "22.0.0"
+version = "23.0.0"
source = "registry+https://github.com/rust-lang/crates.io-index"
-checksum = "37a78f8fc67123c4357e63bc0c87622a2a663d26f074958d749a633d0ecde90f"
+checksum = "773e985c182e41cfd68f7a7b483ab6bfb68beaac241c348cd4b1bf9f9d61b762"
dependencies = [
"arrow",
"arrow-schema",
@@ -936,9 +937,9 @@ dependencies = [
[[package]]
name = "datafusion-substrait"
-version = "22.0.0"
+version = "23.0.0"
source = "registry+https://github.com/rust-lang/crates.io-index"
-checksum = "ae6ed64a2005f0d78f2b1b3ec3f8148183f4523d5d364e5367115f8d8a82b7df"
+checksum = "836e9b1c0ea430199c9bd4b88024cb8d617e3768ffdb412064169e2504a850ed"
dependencies = [
"async-recursion",
"chrono",
@@ -1204,7 +1205,7 @@ checksum = "c85e1d9ab2eadba7e5040d4e09cbd6d072b76a557ad64e797c2cb9d4da21d7e4"
dependencies = [
"cfg-if",
"libc",
- "wasi 0.11.0+wasi-snapshot-preview1",
+ "wasi",
]
[[package]]
@@ -1365,7 +1366,7 @@ dependencies = [
"bstr",
"itoa",
"thiserror",
- "time 0.3.20",
+ "time",
]
[[package]]
@@ -2123,9 +2124,9 @@ dependencies = [
[[package]]
name = "linux-raw-sys"
-version = "0.3.3"
+version = "0.3.4"
source = "registry+https://github.com/rust-lang/crates.io-index"
-checksum = "9b085a4f2cde5781fc4b1717f2e86c62f5cda49de7ba99a7c2eae02b61c9064c"
+checksum = "36eb31c1778188ae1e64398743890d0877fef36d11521ac60406b42016e8c2cf"
[[package]]
name = "lock_api"
@@ -2248,7 +2249,7 @@ checksum = "5b9d9a46eff5b4ff64b45a9e316a6d1e0bc719ef429cbec4dc630684212bfdf9"
dependencies = [
"libc",
"log",
- "wasi 0.11.0+wasi-snapshot-preview1",
+ "wasi",
"windows-sys 0.45.0",
]
@@ -2444,9 +2445,9 @@ dependencies = [
[[package]]
name = "parquet"
-version = "36.0.0"
+version = "37.0.0"
source = "registry+https://github.com/rust-lang/crates.io-index"
-checksum = "321a15f8332645759f29875b07f8233d16ed8ec1b3582223de81625a9f8506b7"
+checksum = "b5022d98333271f4ca3e87bab760498e61726bf5a6ca919123c80517e20ded29"
dependencies = [
"ahash",
"arrow-array",
@@ -2806,13 +2807,13 @@ dependencies = [
[[package]]
name = "regex"
-version = "1.7.3"
+version = "1.8.1"
source = "registry+https://github.com/rust-lang/crates.io-index"
-checksum = "8b1f693b24f6ac912f4893ef08244d70b6067480d2f1a46e950c9691e6749d1d"
+checksum = "af83e617f331cc6ae2da5443c602dfa5af81e517212d9d611a5b3ba1777b5370"
dependencies = [
"aho-corasick",
"memchr",
- "regex-syntax",
+ "regex-syntax 0.7.1",
]
[[package]]
@@ -2827,6 +2828,12 @@ version = "0.6.29"
source = "registry+https://github.com/rust-lang/crates.io-index"
checksum = "f162c6dd7b008981e4d40210aca20b4bd0f9b60ca9271061b07f78537722f2e1"
+[[package]]
+name = "regex-syntax"
+version = "0.7.1"
+source = "registry+https://github.com/rust-lang/crates.io-index"
+checksum = "a5996294f19bd3aae0453a862ad728f60e6600695733dd5df01da90c54363a3c"
+
[[package]]
name = "regress"
version = "0.5.0"
@@ -2910,9 +2917,9 @@ dependencies = [
[[package]]
name = "rustix"
-version = "0.37.13"
+version = "0.37.14"
source = "registry+https://github.com/rust-lang/crates.io-index"
-checksum = "f79bef90eb6d984c72722595b5b1348ab39275a5e5123faca6863bf07d75a4e0"
+checksum = "d9b864d3c18a5785a05953adeed93e2dca37ed30f18e69bba9f30079d51f363f"
dependencies = [
"bitflags 1.3.2",
"errno",
@@ -3203,9 +3210,9 @@ checksum = "6e63cff320ae2c57904679ba7cb63280a3dc4613885beafb148ee7bf9aa9042d"
[[package]]
name = "sqlparser"
-version = "0.32.0"
+version = "0.33.0"
source = "registry+https://github.com/rust-lang/crates.io-index"
-checksum = "0366f270dbabb5cc2e4c88427dc4c08bba144f81e32fbd459a013f26a4d16aa0"
+checksum = "355dc4d4b6207ca8a3434fc587db0a8016130a574dbcdbfb93d7f7b5bc5b211a"
dependencies = [
"log",
"sqlparser_derive",
@@ -3357,17 +3364,6 @@ dependencies = [
"ordered-float",
]
-[[package]]
-name = "time"
-version = "0.1.45"
-source = "registry+https://github.com/rust-lang/crates.io-index"
-checksum = "1b797afad3f312d1c66a56d11d0316f916356d11bd158fbc6ca6389ff6bf805a"
-dependencies = [
- "libc",
- "wasi 0.10.0+wasi-snapshot-preview1",
- "winapi",
-]
-
[[package]]
name = "time"
version = "0.3.20"
@@ -3506,13 +3502,13 @@ dependencies = [
[[package]]
name = "tracing-attributes"
-version = "0.1.23"
+version = "0.1.24"
source = "registry+https://github.com/rust-lang/crates.io-index"
-checksum = "4017f8f45139870ca7e672686113917c71c7a6e02d4924eda67186083c03081a"
+checksum = "0f57e3ca2a01450b1a921183a9c9cbfda207fd822cef4ccb00a65402cbba7a74"
dependencies = [
"proc-macro2",
"quote",
- "syn 1.0.109",
+ "syn 2.0.15",
]
[[package]]
@@ -3705,12 +3701,6 @@ dependencies = [
"try-lock",
]
-[[package]]
-name = "wasi"
-version = "0.10.0+wasi-snapshot-preview1"
-source = "registry+https://github.com/rust-lang/crates.io-index"
-checksum = "1a143597ca7c7793eff794def352d41792a93c481eb1042423ff7ff72ba2c31f"
-
[[package]]
name = "wasi"
version = "0.11.0+wasi-snapshot-preview1"
diff --git a/Cargo.toml b/Cargo.toml
index 22a2989..8c205a4 100644
--- a/Cargo.toml
+++ b/Cargo.toml
@@ -17,7 +17,7 @@
[package]
name = "datafusion-python"
-version = "22.0.0"
+version = "23.0.0"
homepage = "https://github.com/apache/arrow-datafusion-python"
repository = "https://github.com/apache/arrow-datafusion-python"
authors = ["Apache Arrow <de...@arrow.apache.org>"]
@@ -36,12 +36,12 @@ protoc = [ "datafusion-substrait/protoc" ]
tokio = { version = "1.24", features = ["macros", "rt", "rt-multi-thread", "sync"] }
rand = "0.8"
pyo3 = { version = "0.18.1", features = ["extension-module", "abi3", "abi3-py37"] }
-datafusion = { version = "22.0.0", features = ["pyarrow", "avro"] }
-datafusion-common = { version = "22.0.0", features = ["pyarrow"] }
-datafusion-expr = { version = "22.0.0" }
-datafusion-optimizer = { version = "22.0.0" }
-datafusion-sql = { version = "22.0.0" }
-datafusion-substrait = { version = "22.0.0" }
+datafusion = { version = "23.0.0" , features = ["pyarrow", "avro"] }
+datafusion-common = { version = "23.0.0", features = ["pyarrow"] }
+datafusion-expr = "23.0.0"
+datafusion-optimizer = "23.0.0"
+datafusion-sql = "23.0.0"
+datafusion-substrait = "23.0.0"
uuid = { version = "1.2", features = ["v4"] }
mimalloc = { version = "0.1", optional = true, default-features = false }
async-trait = "0.1"
diff --git a/dev/release/README.md b/dev/release/README.md
index 84058a6..1ba44fb 100644
--- a/dev/release/README.md
+++ b/dev/release/README.md
@@ -145,14 +145,22 @@ Pushing an `rc` tag to the release branch will cause a GitHub Workflow to run th
Go to https://github.com/apache/arrow-datafusion-python/actions and look for an action named "Python Release Build"
that has run against the pushed tag.
-Click on the action and scroll down to the bottom of the page titled "Artifacts". Download `dist.zip`.
+Click on the action and scroll down to the bottom of the page titled "Artifacts". Download `dist.zip`. It should
+contain files such as:
+
+```text
+datafusion-22.0.0-cp37-abi3-macosx_10_7_x86_64.whl
+datafusion-22.0.0-cp37-abi3-macosx_11_0_arm64.whl
+datafusion-22.0.0-cp37-abi3-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
+datafusion-22.0.0-cp37-abi3-win_amd64.whl
+```
Upload the wheels to testpypi.
```bash
unzip dist.zip
python3 -m pip install --upgrade setuptools twine build
-python3 -m twine upload --repository testpypi datafusion-0.7.0-cp37-abi3-*.whl
+python3 -m twine upload --repository testpypi datafusion-22.0.0-cp37-abi3-*.whl
```
When prompted for username, enter `__token__`. When prompted for a password, enter a valid GitHub Personal Access Token
diff --git a/src/common/data_type.rs b/src/common/data_type.rs
index e07805c..a7b79f4 100644
--- a/src/common/data_type.rs
+++ b/src/common/data_type.rs
@@ -180,7 +180,7 @@ impl DataTypeMap {
DataType::Struct(_) => Err(py_datafusion_err(DataFusionError::NotImplemented(
format!("{:?}", arrow_type),
))),
- DataType::Union(_, _, _) => Err(py_datafusion_err(DataFusionError::NotImplemented(
+ DataType::Union(_, _) => Err(py_datafusion_err(DataFusionError::NotImplemented(
format!("{:?}", arrow_type),
))),
DataType::Dictionary(_, _) => Err(py_datafusion_err(DataFusionError::NotImplemented(
diff --git a/src/expr/literal.rs b/src/expr/literal.rs
index f992169..076f89a 100644
--- a/src/expr/literal.rs
+++ b/src/expr/literal.rs
@@ -117,7 +117,9 @@ impl PyLiteral {
ScalarValue::TimestampNanosecond(iv, tz)
| ScalarValue::TimestampMicrosecond(iv, tz)
| ScalarValue::TimestampMillisecond(iv, tz)
- | ScalarValue::TimestampSecond(iv, tz) => Ok((*iv, tz.clone())),
+ | ScalarValue::TimestampSecond(iv, tz) => {
+ Ok((*iv, tz.as_ref().map(|s| s.as_ref().to_string())))
+ }
other => Err(unexpected_literal_value(other)),
}
}
diff --git a/src/expr/subquery_alias.rs b/src/expr/subquery_alias.rs
index 5360bbb..d3abd2e 100644
--- a/src/expr/subquery_alias.rs
+++ b/src/expr/subquery_alias.rs
@@ -68,7 +68,7 @@ impl PySubqueryAlias {
}
fn alias(&self) -> PyResult<String> {
- Ok(self.subquery_alias.alias.clone())
+ Ok(self.subquery_alias.alias.to_string())
}
fn __repr__(&self) -> PyResult<String> {
diff --git a/src/udaf.rs b/src/udaf.rs
index d5866f8..756fa56 100644
--- a/src/udaf.rs
+++ b/src/udaf.rs
@@ -56,7 +56,7 @@ impl Accumulator for RustAccumulator {
// 1. cast args to Pyarrow array
let py_args = values
.iter()
- .map(|arg| arg.data().to_owned().to_pyarrow(py).unwrap())
+ .map(|arg| arg.into_data().to_pyarrow(py).unwrap())
.collect::<Vec<_>>();
let py_args = PyTuple::new(py, py_args);
@@ -76,7 +76,7 @@ impl Accumulator for RustAccumulator {
// 1. cast states to Pyarrow array
let state = state
- .data()
+ .into_data()
.to_pyarrow(py)
.map_err(|e| DataFusionError::Execution(format!("{e}")))?;
diff --git a/src/udf.rs b/src/udf.rs
index f3e6cfb..dcb9cd5 100644
--- a/src/udf.rs
+++ b/src/udf.rs
@@ -41,7 +41,7 @@ fn to_rust_function(func: PyObject) -> ScalarFunctionImplementation {
// 1. cast args to Pyarrow arrays
let py_args = args
.iter()
- .map(|arg| arg.data().to_owned().to_pyarrow(py).unwrap())
+ .map(|arg| arg.into_data().to_pyarrow(py).unwrap())
.collect::<Vec<_>>();
let py_args = PyTuple::new(py, py_args);