You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@arrow.apache.org by "palday (via GitHub)" <gi...@apache.org> on 2025/02/28 18:30:53 UTC
[I] Substantial performance regression on 1.11 relative to 1.10 [arrow-julia]
palday opened a new issue, #542:
URL: https://github.com/apache/arrow-julia/issues/542
Casual testing on my M1 Macbook shows a pretty substantial performance regression on tests in 1.11 relative to 1.10.
Julia 1.10:
```julia
Test Summary: | Pass Total Time
Arrow | 66047 66047 5m08.9s
```
Julia 1.11:
```julia
Test Summary: | Pass Total Time
Arrow | 66047 66047 13m54.1s
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@arrow.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Substantial performance regression on 1.11 relative to 1.10 [arrow-julia]
Posted by "quinnj (via GitHub)" <gi...@apache.org>.
quinnj commented on issue #542:
URL: https://github.com/apache/arrow-julia/issues/542#issuecomment-3748061627
Closing - this performance regression has been fixed in Julia 1.12 per @vtjnash's confirmation.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Substantial performance regression on 1.11 relative to 1.10 [arrow-julia]
Posted by "vtjnash (via GitHub)" <gi...@apache.org>.
vtjnash commented on issue #542:
URL: https://github.com/apache/arrow-julia/issues/542#issuecomment-3353646094
Seems to be mostly fixed as of v1.12 (looking locally, and at latest CI for example: https://github.com/apache/arrow-julia/actions/runs/17845280009/job/50743369381)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Substantial performance regression on 1.11 relative to 1.10 [arrow-julia]
Posted by "Moelf (via GitHub)" <gi...@apache.org>.
Moelf commented on issue #542:
URL: https://github.com/apache/arrow-julia/issues/542#issuecomment-2691311071
tests are run with stuff like bounds checking force on for everything
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Substantial performance regression on 1.11 relative to 1.10 [arrow-julia]
Posted by "palday (via GitHub)" <gi...@apache.org>.
palday commented on issue #542:
URL: https://github.com/apache/arrow-julia/issues/542#issuecomment-2691308797
Why would testing be different?
Also, more than doubling the time it takes to run tests seems ... less than optimal when it comes to development.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Substantial performance regression on 1.11 relative to 1.10 [arrow-julia]
Posted by "Moelf (via GitHub)" <gi...@apache.org>.
Moelf commented on issue #542:
URL: https://github.com/apache/arrow-julia/issues/542#issuecomment-2691305161
is this just running `]test`? if so it may not be a performance regression on normal usage
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Substantial performance regression on 1.11 relative to 1.10 [arrow-julia]
Posted by "Moelf (via GitHub)" <gi...@apache.org>.
Moelf commented on issue #542:
URL: https://github.com/apache/arrow-julia/issues/542#issuecomment-2691379940
that's pretty bad huh
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Substantial performance regression on 1.11 relative to 1.10 [arrow-julia]
Posted by "palday (via GitHub)" <gi...@apache.org>.
palday commented on issue #542:
URL: https://github.com/apache/arrow-julia/issues/542#issuecomment-2695067364
Possibly related julialang issues:
- https://github.com/JuliaLang/julia/issues/56080
- https://github.com/JuliaLang/julia/issues/56093
- https://github.com/JuliaLang/julia/issues/56861
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Substantial performance regression on 1.11 relative to 1.10 [arrow-julia]
Posted by "palday (via GitHub)" <gi...@apache.org>.
palday commented on issue #542:
URL: https://github.com/apache/arrow-julia/issues/542#issuecomment-2691351622
Manually running tests outside of `Pkg.test`:
# 1.10:
```
julia +1.10 --project=test -e'using Pkg; Pkg.develop(path="./"); Pkg.update(); @time include("test/runtests.jl")'
```
```julia
Test Summary: | Pass Total Time
ArrowTypes | 127 127 0.5s
Test Summary: | Pass Total Time
Date and time wrappers with missing | 4 4 5.0s
Test Summary: | Pass Total Time
`default(T) isa T` | 10 10 0.0s
Test Summary: | Pass Total Time
Arrow | 66047 66047 3m48.7s
239.948859 seconds (897.30 M allocations: 59.172 GiB, 5.05% gc time, 97.20% compilation time: <1% of which was recompilation)
```
# 1.11:
```
julia +1.11 --project=test -e'using Pkg; Pkg.develop(path="./"); Pkg.update(); @time include("test/runtests.jl")'
```
```julia
Test Summary: | Pass Total Time
ArrowTypes | 127 127 0.5s
Test Summary: | Pass Total Time
Date and time wrappers with missing | 4 4 5.9s
Test Summary: | Pass Total Time
`default(T) isa T` | 10 10 0.0s
Test Summary: | Pass Total Time
Arrow | 66047 66047 11m50.4s
724.425272 seconds (4.33 G allocations: 196.264 GiB, 2.73% gc time, 99.11% compilation time: <1% of which was recompilation
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Substantial performance regression on 1.11 relative to 1.10 [arrow-julia]
Posted by "quinnj (via GitHub)" <gi...@apache.org>.
quinnj closed issue #542: Substantial performance regression on 1.11 relative to 1.10
URL: https://github.com/apache/arrow-julia/issues/542
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Substantial performance regression on 1.11 relative to 1.10 [arrow-julia]
Posted by "kou (via GitHub)" <gi...@apache.org>.
kou commented on issue #542:
URL: https://github.com/apache/arrow-julia/issues/542#issuecomment-3353934096
Thanks.
Can we close this?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org