You are viewing a plain text version of this content. The canonical link for it is here.
Posted to github@arrow.apache.org by GitBox <gi...@apache.org> on 2022/02/14 08:37:57 UTC
[GitHub] [arrow-datafusion] dependabot[bot] opened a new pull request #1826: Update parquet requirement from 8.0.0 to 9.0.2
dependabot[bot] opened a new pull request #1826:
URL: https://github.com/apache/arrow-datafusion/pull/1826
Updates the requirements on [parquet](https://github.com/apache/arrow-rs) to permit the latest version.
<details>
<summary>Changelog</summary>
<p><em>Sourced from <a href="https://github.com/apache/arrow-rs/blob/master/CHANGELOG.md">parquet's changelog</a>.</em></p>
<blockquote>
<h2><a href="https://github.com/apache/arrow-rs/tree/9.0.2">9.0.2</a> (2022-02-09)</h2>
<p><a href="https://github.com/apache/arrow-rs/compare/8.0.0...9.0.2">Full Changelog</a></p>
<p><strong>Breaking changes:</strong></p>
<ul>
<li>Add <code>Send</code> + <code>Sync</code> to <code>DataType</code>, <code>RowGroupReader</code>, <code>FileReader</code>, <code>ChunkReader</code>. <a href="https://github-redirect.dependabot.com/apache/arrow-rs/issues/1264">#1264</a></li>
<li>Rename the function <code>Bitmap::len</code> to <code>Bitmap::bit_len</code> to clarify its meaning <a href="https://github-redirect.dependabot.com/apache/arrow-rs/pull/1242">#1242</a> [<a href="https://github.com/apache/arrow-rs/labels/parquet">parquet</a>] [<a href="https://github.com/apache/arrow-rs/labels/arrow">arrow</a>] (<a href="https://github.com/HaoYang670">HaoYang670</a>)</li>
<li>Remove unused / broken <code>memory-check</code> feature <a href="https://github-redirect.dependabot.com/apache/arrow-rs/pull/1222">#1222</a> [<a href="https://github.com/apache/arrow-rs/labels/arrow">arrow</a>] (<a href="https://github.com/jhorstmann">jhorstmann</a>)</li>
<li>Potentially buffer multiple <code>RecordBatches</code> before writing a parquet row group in <code>ArrowWriter</code> <a href="https://github-redirect.dependabot.com/apache/arrow-rs/pull/1214">#1214</a> [<a href="https://github.com/apache/arrow-rs/labels/parquet">parquet</a>] [<a href="https://github.com/apache/arrow-rs/labels/arrow">arrow</a>] (<a href="https://github.com/tustvold">tustvold</a>)</li>
</ul>
<p><strong>Implemented enhancements:</strong></p>
<ul>
<li>Add <code>async</code> arrow parquet reader <a href="https://github-redirect.dependabot.com/apache/arrow-rs/pull/1154">#1154</a> [<a href="https://github.com/apache/arrow-rs/labels/parquet">parquet</a>] [<a href="https://github.com/apache/arrow-rs/labels/arrow">arrow</a>] (<a href="https://github.com/tustvold">tustvold</a>)</li>
<li>Rename <code>Bitmap::len</code> to <code>Bitmap::bit_len</code> <a href="https://github-redirect.dependabot.com/apache/arrow-rs/issues/1233">#1233</a></li>
<li>Extend CSV schema inference to allow scientific notation for floating point types <a href="https://github-redirect.dependabot.com/apache/arrow-rs/issues/1215">#1215</a> [<a href="https://github.com/apache/arrow-rs/labels/arrow">arrow</a>]</li>
<li>Write Multiple RecordBatch to Parquet Row Group <a href="https://github-redirect.dependabot.com/apache/arrow-rs/issues/1211">#1211</a></li>
<li>Add doc examples for <code>eq_dyn</code> etc. <a href="https://github-redirect.dependabot.com/apache/arrow-rs/issues/1202">#1202</a> [<a href="https://github.com/apache/arrow-rs/labels/arrow">arrow</a>]</li>
<li>Add comparison kernels for <code>BinaryArray</code> <a href="https://github-redirect.dependabot.com/apache/arrow-rs/issues/1108">#1108</a></li>
<li><code>impl ArrowNativeType for i128</code> <a href="https://github-redirect.dependabot.com/apache/arrow-rs/issues/1098">#1098</a></li>
<li>Remove <code>Copy</code> trait bound from dyn scalar kernels <a href="https://github-redirect.dependabot.com/apache/arrow-rs/pull/1243">#1243</a> [<a href="https://github.com/apache/arrow-rs/labels/arrow">arrow</a>] (<a href="https://github.com/matthewmturner">matthewmturner</a>)</li>
<li>Add <code>into_inner</code> for IPC <code>FileWriter</code> <a href="https://github-redirect.dependabot.com/apache/arrow-rs/pull/1236">#1236</a> [<a href="https://github.com/apache/arrow-rs/labels/arrow">arrow</a>] (<a href="https://github.com/yjshen">yjshen</a>)</li>
<li>[Minor]Re-export <code>array::builder::make_builder</code> to make it available for downstream <a href="https://github-redirect.dependabot.com/apache/arrow-rs/pull/1235">#1235</a> [<a href="https://github.com/apache/arrow-rs/labels/arrow">arrow</a>] (<a href="https://github.com/yjshen">yjshen</a>)</li>
</ul>
<p><strong>Fixed bugs:</strong></p>
<ul>
<li>Parquet v8.0.0 panics when reading all null column to NullArray <a href="https://github-redirect.dependabot.com/apache/arrow-rs/issues/1245">#1245</a> [<a href="https://github.com/apache/arrow-rs/labels/parquet">parquet</a>]</li>
<li>Get <code>Unknown configuration option rust-version</code> when running the rust format command <a href="https://github-redirect.dependabot.com/apache/arrow-rs/issues/1240">#1240</a></li>
<li><code>Bitmap</code> Length Validation is Incorrect <a href="https://github-redirect.dependabot.com/apache/arrow-rs/issues/1231">#1231</a> [<a href="https://github.com/apache/arrow-rs/labels/arrow">arrow</a>]</li>
<li>Writing sliced <code>ListArray</code> or <code>MapArray</code> ignore offsets <a href="https://github-redirect.dependabot.com/apache/arrow-rs/issues/1226">#1226</a> [<a href="https://github.com/apache/arrow-rs/labels/parquet">parquet</a>]</li>
<li>Remove broken <code>memory-tracking</code> crate feature <a href="https://github-redirect.dependabot.com/apache/arrow-rs/issues/1171">#1171</a></li>
<li>Revert making <code>parquet::data_type</code> and <code>parquet::arrow::schema</code> experimental <a href="https://github-redirect.dependabot.com/apache/arrow-rs/pull/1244">#1244</a> [<a href="https://github.com/apache/arrow-rs/labels/parquet">parquet</a>] (<a href="https://github.com/tustvold">tustvold</a>)</li>
</ul>
<p><strong>Documentation updates:</strong></p>
<ul>
<li>Update parquet crate documentation and examples <a href="https://github-redirect.dependabot.com/apache/arrow-rs/pull/1253">#1253</a> [<a href="https://github.com/apache/arrow-rs/labels/parquet">parquet</a>] [<a href="https://github.com/apache/arrow-rs/labels/arrow">arrow</a>] (<a href="https://github.com/alamb">alamb</a>)</li>
<li>Refresh parquet readme / contributing guide <a href="https://github-redirect.dependabot.com/apache/arrow-rs/pull/1252">#1252</a> [<a href="https://github.com/apache/arrow-rs/labels/parquet">parquet</a>] (<a href="https://github.com/alamb">alamb</a>)</li>
<li>Add docs examples for dynamically compare functions <a href="https://github-redirect.dependabot.com/apache/arrow-rs/pull/1250">#1250</a> [<a href="https://github.com/apache/arrow-rs/labels/arrow">arrow</a>] (<a href="https://github.com/HaoYang670">HaoYang670</a>)</li>
<li>Add Rust Docs examples for UnionArray <a href="https://github-redirect.dependabot.com/apache/arrow-rs/pull/1241">#1241</a> [<a href="https://github.com/apache/arrow-rs/labels/arrow">arrow</a>] (<a href="https://github.com/HaoYang670">HaoYang670</a>)</li>
<li>Improve documentation for Bitmap <a href="https://github-redirect.dependabot.com/apache/arrow-rs/pull/1237">#1237</a> [<a href="https://github.com/apache/arrow-rs/labels/arrow">arrow</a>] (<a href="https://github.com/alamb">alamb</a>)</li>
</ul>
<p><strong>Performance improvements:</strong></p>
<ul>
<li>Improve performance for arithmetic kernels with <code>simd</code> feature enabled (except for division/modulo) <a href="https://github-redirect.dependabot.com/apache/arrow-rs/pull/1221">#1221</a> [<a href="https://github.com/apache/arrow-rs/labels/arrow">arrow</a>] (<a href="https://github.com/jhorstmann">jhorstmann</a>)</li>
<li>Do not concatenate identical dictionaries <a href="https://github-redirect.dependabot.com/apache/arrow-rs/pull/1219">#1219</a> [<a href="https://github.com/apache/arrow-rs/labels/arrow">arrow</a>] (<a href="https://github.com/tustvold">tustvold</a>)</li>
<li>Preserve dictionary encoding when decoding parquet into Arrow arrays, 60x perf improvement (<a href="https://github-redirect.dependabot.com/apache/arrow-rs/issues/171">#171</a>) <a href="https://github-redirect.dependabot.com/apache/arrow-rs/pull/1180">#1180</a> [<a href="https://github.com/apache/arrow-rs/labels/parquet">parquet</a>] (<a href="https://github.com/tustvold">tustvold</a>)</li>
</ul>
<p><strong>Closed issues:</strong></p>
<ul>
<li><code>UnalignedBitChunkIterator</code> to that iterates through already aligned <code>u64</code> blocks <a href="https://github-redirect.dependabot.com/apache/arrow-rs/issues/1227">#1227</a></li>
</ul>
<!-- raw HTML omitted -->
</blockquote>
<p>... (truncated)</p>
</details>
<details>
<summary>Commits</summary>
<ul>
<li><a href="https://github.com/apache/arrow-rs/commit/ab7c2904ccc03d0c05687ef416fbc5f4ed92f125"><code>ab7c290</code></a> Update versions and changelog for 9.0.2</li>
<li><a href="https://github.com/apache/arrow-rs/commit/ca9d9bb2fc234f7e6f9026da0001aa5b2314b8f2"><code>ca9d9bb</code></a> Fix bitmask creation also for simd comparisons with scalar (<a href="https://github-redirect.dependabot.com/apache/arrow-rs/issues/1290">#1290</a>)</li>
<li><a href="https://github.com/apache/arrow-rs/commit/e5003bf40bceb942c1c78cc2311e7d7a7e87ebf6"><code>e5003bf</code></a> Update changelog</li>
<li><a href="https://github.com/apache/arrow-rs/commit/0ebc20423fac771351d041783de1b0938ae9b0ca"><code>0ebc204</code></a> Update version to 9.0.1</li>
<li><a href="https://github.com/apache/arrow-rs/commit/411171ac7ad3efe9391b2a0f8709f7fe97672a20"><code>411171a</code></a> Fix bitmask creation in chunked part of simd comparison (<a href="https://github-redirect.dependabot.com/apache/arrow-rs/issues/1286">#1286</a>)</li>
<li><a href="https://github.com/apache/arrow-rs/commit/fa728736bffb44af2d2e7fd3a890678f3e807cfd"><code>fa72873</code></a> Prepare for 9.0.0 release: Update version + CHANGELOG (<a href="https://github-redirect.dependabot.com/apache/arrow-rs/issues/1265">#1265</a>)</li>
<li><a href="https://github.com/apache/arrow-rs/commit/43299cc3b9e4a0a7120fc9870f2e0e2d7d8746a0"><code>43299cc</code></a> upgrade clap (<a href="https://github-redirect.dependabot.com/apache/arrow-rs/issues/1261">#1261</a>)</li>
<li><a href="https://github.com/apache/arrow-rs/commit/1764399f828bce3e8f73df288fd98c6ce5ca110a"><code>1764399</code></a> Remove unsupported flag in rustfmt.toml (<a href="https://github-redirect.dependabot.com/apache/arrow-rs/issues/1262">#1262</a>)</li>
<li><a href="https://github.com/apache/arrow-rs/commit/3ddb156879c33ec706af62dc49563d67b217e8e7"><code>3ddb156</code></a> Improve module documentation for parquet crate (<a href="https://github-redirect.dependabot.com/apache/arrow-rs/issues/1253">#1253</a>)</li>
<li><a href="https://github.com/apache/arrow-rs/commit/f055fb04e98664499ac97e6966e6cef51ebfe2f4"><code>f055fb0</code></a> Faster bitmask iteration (<a href="https://github-redirect.dependabot.com/apache/arrow-rs/issues/1228">#1228</a>)</li>
<li>Additional commits viewable in <a href="https://github.com/apache/arrow-rs/compare/8.0.0...9.0.2">compare view</a></li>
</ul>
</details>
<br />
Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting `@dependabot rebase`.
[//]: # (dependabot-automerge-start)
[//]: # (dependabot-automerge-end)
---
<details>
<summary>Dependabot commands and options</summary>
<br />
You can trigger Dependabot actions by commenting on this PR:
- `@dependabot rebase` will rebase this PR
- `@dependabot recreate` will recreate this PR, overwriting any edits that have been made to it
- `@dependabot merge` will merge this PR after your CI passes on it
- `@dependabot squash and merge` will squash and merge this PR after your CI passes on it
- `@dependabot cancel merge` will cancel a previously requested merge and block automerging
- `@dependabot reopen` will reopen this PR if it is closed
- `@dependabot close` will close this PR and stop Dependabot recreating it. You can achieve the same result by closing it manually
- `@dependabot ignore this major version` will close this PR and stop Dependabot creating any more for this major version (unless you reopen the PR or upgrade to it yourself)
- `@dependabot ignore this minor version` will close this PR and stop Dependabot creating any more for this minor version (unless you reopen the PR or upgrade to it yourself)
- `@dependabot ignore this dependency` will close this PR and stop Dependabot creating any more for this dependency (unless you reopen the PR or upgrade to it yourself)
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow-datafusion] alamb closed pull request #1826: Update parquet requirement from 8.0.0 to 9.0.2
Posted by GitBox <gi...@apache.org>.
alamb closed pull request #1826:
URL: https://github.com/apache/arrow-datafusion/pull/1826
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow-datafusion] dependabot[bot] commented on pull request #1826: Update parquet requirement from 8.0.0 to 9.0.2
Posted by GitBox <gi...@apache.org>.
dependabot[bot] commented on pull request #1826:
URL: https://github.com/apache/arrow-datafusion/pull/1826#issuecomment-1039005381
OK, I won't notify you again about this release, but will get in touch when a new version is available. If you'd rather skip all updates until the next major or minor version, let me know by commenting `@dependabot ignore this major version` or `@dependabot ignore this minor version`. You can also ignore all major, minor, or patch releases for a dependency by adding an [`ignore` condition](https://docs.github.com/en/code-security/supply-chain-security/configuration-options-for-dependency-updates#ignore) with the desired `update_types` to your config file.
If you change your mind, just re-open this PR and I'll resolve any conflicts on it.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org