You are viewing a plain text version of this content. The canonical link for it is here.
Posted to notifications@superset.apache.org by "dependabot[bot] (via GitHub)" <gi...@apache.org> on 2026/05/02 07:03:01 UTC
[PR] chore(deps-dev): update pyathena requirement from <3,>=2 to >=2,<4 [superset]
dependabot[bot] opened a new pull request, #39830:
URL: https://github.com/apache/superset/pull/39830
Updates the requirements on [pyathena](https://github.com/pyathena-dev/PyAthena) to permit the latest version.
<details>
<summary>Release notes</summary>
<p><em>Sourced from <a href="https://github.com/pyathena-dev/PyAthena/releases">pyathena's releases</a>.</em></p>
<blockquote>
<h2>v3.30.1</h2>
<h2>What's Changed</h2>
<ul>
<li>Move _normalize_hive_syntax to DefaultTypeConverter and fix pass stubs by <a href="https://github.com/laughingman7743"><code>@laughingman7743</code></a> in <a href="https://redirect.github.com/pyathena-dev/PyAthena/pull/695">pyathena-dev/PyAthena#695</a></li>
<li>Always use C engine for CSV parsing and simplify engine selection logic by <a href="https://github.com/laughingman7743"><code>@laughingman7743</code></a> in <a href="https://redirect.github.com/pyathena-dev/PyAthena/pull/697">pyathena-dev/PyAthena#697</a></li>
</ul>
<h3>Bug Fixes</h3>
<ul>
<li><strong>Fix CSV parsing performance regression</strong> — PR <a href="https://redirect.github.com/pyathena-dev/PyAthena/issues/594">#594</a> incorrectly forced the Python CSV engine for files over 50MB based on fabricated claims about pandas C parser int32 limitations. The C engine is now always used as the default (same as pandas' own default), restoring up to 28% faster CSV parsing. See <a href="https://redirect.github.com/pyathena-dev/PyAthena/issues/696">#696</a> for details.</li>
</ul>
<h3>Internal</h3>
<ul>
<li>Refactored type converter: moved <code>_normalize_hive_syntax</code> to <code>DefaultTypeConverter</code> and cleaned up pass stubs.</li>
<li>Simplified CSV engine selection from 4 methods to 2 by removing dead code and inlining pyarrow compatibility checks.</li>
</ul>
<h3>Affected Versions</h3>
<p>All versions from <strong>v3.17.0</strong> through <strong>v3.30.0</strong> (released 2025-08-09 to 2026-02-28) are affected by this performance regression. The last unaffected version is v3.16.0.</p>
<h3>Workaround for older versions</h3>
<p>If you cannot upgrade to v3.30.1, explicitly specify the C engine to bypass the incorrect engine selection:</p>
<pre lang="python"><code>cursor = connection.cursor(PandasCursor, engine="c")
</code></pre>
<p><strong>Full Changelog</strong>: <a href="https://github.com/pyathena-dev/PyAthena/compare/v3.30.0...v3.30.1">https://github.com/pyathena-dev/PyAthena/compare/v3.30.0...v3.30.1</a></p>
</blockquote>
</details>
<details>
<summary>Commits</summary>
<ul>
<li><a href="https://github.com/pyathena-dev/PyAthena/commit/f546a81f99c5b0e93fcb6d562511acb19cff4167"><code>f546a81</code></a> Merge pull request <a href="https://redirect.github.com/pyathena-dev/PyAthena/issues/697">#697</a> from pyathena-dev/fix/csv-engine-always-use-c</li>
<li><a href="https://github.com/pyathena-dev/PyAthena/commit/16599b5d2be98f0f3476a53f30a1850603f99472"><code>16599b5</code></a> Refactor _get_csv_engine: single return point for C engine default</li>
<li><a href="https://github.com/pyathena-dev/PyAthena/commit/0116ca33a5dc42865fee92ef39a0fbc1fd4e865f"><code>0116ca3</code></a> Simplify CSV engine selection: remove dead methods and inline pyarrow logic</li>
<li><a href="https://github.com/pyathena-dev/PyAthena/commit/cf38e6b7ad69d35e2fd681414ab68436bef9f618"><code>cf38e6b</code></a> Always use C engine for CSV parsing, fix incorrect hallucinated claims</li>
<li><a href="https://github.com/pyathena-dev/PyAthena/commit/981e7868c68ca1cc04726c44ccae535a07bf6230"><code>981e786</code></a> Merge pull request <a href="https://redirect.github.com/pyathena-dev/PyAthena/issues/695">#695</a> from pyathena-dev/refactor/converter-cleanup</li>
<li><a href="https://github.com/pyathena-dev/PyAthena/commit/a8df601e71ac9b8f24974707391960f7405a9e30"><code>a8df601</code></a> Move _normalize_hive_syntax to DefaultTypeConverter and fix pass stubs</li>
<li><a href="https://github.com/pyathena-dev/PyAthena/commit/90e67bc7e1ff8ccab3c3e97bca87fbc1030e1669"><code>90e67bc</code></a> Merge pull request <a href="https://redirect.github.com/pyathena-dev/PyAthena/issues/690">#690</a> from pyathena-dev/feat/result-set-type-hints</li>
<li><a href="https://github.com/pyathena-dev/PyAthena/commit/add20b48052e923fda416ac5f1d9a8c2f9677014"><code>add20b4</code></a> Fix parser robustness: matching paren lookup and unnamed struct split</li>
<li><a href="https://github.com/pyathena-dev/PyAthena/commit/ab33667ca19c9f44fbbd2a79f46d5ec276188a8e"><code>ab33667</code></a> Add Hive syntax support, type aliases, parse fallback, and index-based hints</li>
<li><a href="https://github.com/pyathena-dev/PyAthena/commit/989aab2f6e25dd4f068a5152ea2b72c85d46bd81"><code>989aab2</code></a> Fix nested array JSON detection and pre-compute column metadata</li>
<li>Additional commits viewable in <a href="https://github.com/pyathena-dev/PyAthena/compare/v2.0.0...v3.30.1">compare view</a></li>
</ul>
</details>
<br />
Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting `@dependabot rebase`.
[//]: # (dependabot-automerge-start)
[//]: # (dependabot-automerge-end)
---
<details>
<summary>Dependabot commands and options</summary>
<br />
You can trigger Dependabot actions by commenting on this PR:
- `@dependabot rebase` will rebase this PR
- `@dependabot recreate` will recreate this PR, overwriting any edits that have been made to it
- `@dependabot show <dependency name> ignore conditions` will show all of the ignore conditions of the specified dependency
- `@dependabot ignore this major version` will close this PR and stop Dependabot creating any more for this major version (unless you reopen the PR or upgrade to it yourself)
- `@dependabot ignore this minor version` will close this PR and stop Dependabot creating any more for this minor version (unless you reopen the PR or upgrade to it yourself)
- `@dependabot ignore this dependency` will close this PR and stop Dependabot creating any more for this dependency (unless you reopen the PR or upgrade to it yourself)
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: notifications-unsubscribe@superset.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: notifications-unsubscribe@superset.apache.org
For additional commands, e-mail: notifications-help@superset.apache.org
Re: [PR] chore(deps-dev): update pyathena requirement from <3,>=2 to >=2,<4 [superset]
Posted by "rusackas (via GitHub)" <gi...@apache.org>.
rusackas merged PR #39830:
URL: https://github.com/apache/superset/pull/39830
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: notifications-unsubscribe@superset.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: notifications-unsubscribe@superset.apache.org
For additional commands, e-mail: notifications-help@superset.apache.org
Re: [PR] chore(deps-dev): update pyathena requirement from <3,>=2 to >=2,<4 [superset]
Posted by "dependabot[bot] (via GitHub)" <gi...@apache.org>.
dependabot[bot] commented on PR #39830:
URL: https://github.com/apache/superset/pull/39830#issuecomment-4363248526
### Labels
The following labels could not be found: `pip`. Please create it before Dependabot can add it to a pull request.
Please fix the above issues or remove invalid values from `dependabot.yml`.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: notifications-unsubscribe@superset.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: notifications-unsubscribe@superset.apache.org
For additional commands, e-mail: notifications-help@superset.apache.org
Re: [PR] chore(deps-dev): update pyathena requirement from <3,>=2 to >=2,<4 [superset]
Posted by "bito-code-review[bot] (via GitHub)" <gi...@apache.org>.
bito-code-review[bot] commented on PR #39830:
URL: https://github.com/apache/superset/pull/39830#issuecomment-4363248758
AI Code Review is in progress (usually takes 3 to 15 minutes unless it's a very large PR).
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: notifications-unsubscribe@superset.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: notifications-unsubscribe@superset.apache.org
For additional commands, e-mail: notifications-help@superset.apache.org