You are viewing a plain text version of this content. The canonical link for it is here.
Posted to reviews@spark.apache.org by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/01/02 02:09:36 UTC
[PR] Revert "[SPARK-54182][SQL][PYTHON] Optimize non-arrow conversion of df.toPandas`" [spark]
zhengruifeng opened a new pull request, #53661:
URL: https://github.com/apache/spark/pull/53661
revert https://github.com/apache/spark/pull/52897 due to perf regression when the number of columns are small
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
Re: [PR] Revert "[SPARK-54182][SQL][PYTHON] Optimize non-arrow conversion of df.toPandas`" [spark]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #53661:
URL: https://github.com/apache/spark/pull/53661#issuecomment-3704331189
## JIRA Issue Information
=== Sub-task SPARK-54182 ===
Summary: Avoid intermediate pandas dataframe creation in df.toPandas without Arrow optimization
Assignee: Yicong Huang
Status: Resolved
Affected: ["4.2.0"]
---
*This comment was automatically generated by GitHub Actions*
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
Re: [PR] Revert "[SPARK-54182][SQL][PYTHON] Optimize non-arrow conversion of df.toPandas`" [spark]
Posted by "HyukjinKwon (via GitHub)" <gi...@apache.org>.
HyukjinKwon closed pull request #53661: Revert "[SPARK-54182][SQL][PYTHON] Optimize non-arrow conversion of df.toPandas`"
URL: https://github.com/apache/spark/pull/53661
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
Re: [PR] Revert "[SPARK-54182][SQL][PYTHON] Optimize non-arrow conversion of df.toPandas`" [spark]
Posted by "HyukjinKwon (via GitHub)" <gi...@apache.org>.
HyukjinKwon commented on PR #53661:
URL: https://github.com/apache/spark/pull/53661#issuecomment-3704561291
Merged to master and branch-4.1.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org