You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@arrow.apache.org by "palday (via GitHub)" <gi...@apache.org> on 2025/02/28 18:30:53 UTC

[I] Substantial performance regression on 1.11 relative to 1.10 [arrow-julia]

palday opened a new issue, #542:
URL: https://github.com/apache/arrow-julia/issues/542

   Casual testing on my M1 Macbook shows a pretty substantial performance regression on tests in 1.11 relative to 1.10.
   
   Julia 1.10:
   
   ```julia
   Test Summary: |  Pass  Total     Time
   Arrow         | 66047  66047  5m08.9s
   ```
   
   Julia 1.11:
   
   ```julia
   Test Summary: |  Pass  Total      Time
   Arrow         | 66047  66047  13m54.1s
   ```


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@arrow.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [I] Substantial performance regression on 1.11 relative to 1.10 [arrow-julia]

Posted by "quinnj (via GitHub)" <gi...@apache.org>.
quinnj commented on issue #542:
URL: https://github.com/apache/arrow-julia/issues/542#issuecomment-3748061627

   Closing - this performance regression has been fixed in Julia 1.12 per @vtjnash's confirmation.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [I] Substantial performance regression on 1.11 relative to 1.10 [arrow-julia]

Posted by "vtjnash (via GitHub)" <gi...@apache.org>.
vtjnash commented on issue #542:
URL: https://github.com/apache/arrow-julia/issues/542#issuecomment-3353646094

   Seems to be mostly fixed as of v1.12 (looking locally, and at latest CI for example: https://github.com/apache/arrow-julia/actions/runs/17845280009/job/50743369381)


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [I] Substantial performance regression on 1.11 relative to 1.10 [arrow-julia]

Posted by "Moelf (via GitHub)" <gi...@apache.org>.
Moelf commented on issue #542:
URL: https://github.com/apache/arrow-julia/issues/542#issuecomment-2691311071

   tests are run with stuff like bounds checking force on for everything


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [I] Substantial performance regression on 1.11 relative to 1.10 [arrow-julia]

Posted by "palday (via GitHub)" <gi...@apache.org>.
palday commented on issue #542:
URL: https://github.com/apache/arrow-julia/issues/542#issuecomment-2691308797

   Why would testing be different?
   
   Also, more than doubling the time it takes to run tests seems ... less than optimal when it comes to development.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [I] Substantial performance regression on 1.11 relative to 1.10 [arrow-julia]

Posted by "Moelf (via GitHub)" <gi...@apache.org>.
Moelf commented on issue #542:
URL: https://github.com/apache/arrow-julia/issues/542#issuecomment-2691305161

   is this just running `]test`? if so it may not be a performance regression on normal usage


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [I] Substantial performance regression on 1.11 relative to 1.10 [arrow-julia]

Posted by "Moelf (via GitHub)" <gi...@apache.org>.
Moelf commented on issue #542:
URL: https://github.com/apache/arrow-julia/issues/542#issuecomment-2691379940

   that's pretty bad huh


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [I] Substantial performance regression on 1.11 relative to 1.10 [arrow-julia]

Posted by "palday (via GitHub)" <gi...@apache.org>.
palday commented on issue #542:
URL: https://github.com/apache/arrow-julia/issues/542#issuecomment-2695067364

   Possibly related julialang issues:
   - https://github.com/JuliaLang/julia/issues/56080
   - https://github.com/JuliaLang/julia/issues/56093
   - https://github.com/JuliaLang/julia/issues/56861


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [I] Substantial performance regression on 1.11 relative to 1.10 [arrow-julia]

Posted by "palday (via GitHub)" <gi...@apache.org>.
palday commented on issue #542:
URL: https://github.com/apache/arrow-julia/issues/542#issuecomment-2691351622

   Manually running tests outside of `Pkg.test`:
   
   # 1.10:
   
   ```
   julia +1.10 --project=test -e'using Pkg; Pkg.develop(path="./"); Pkg.update(); @time include("test/runtests.jl")'
   ```
   
   ```julia
   Test Summary: | Pass  Total  Time
   ArrowTypes    |  127    127  0.5s
   Test Summary:                       | Pass  Total  Time
   Date and time wrappers with missing |    4      4  5.0s
   Test Summary:      | Pass  Total  Time
   `default(T) isa T` |   10     10  0.0s
   Test Summary: |  Pass  Total     Time
   Arrow         | 66047  66047  3m48.7s
   239.948859 seconds (897.30 M allocations: 59.172 GiB, 5.05% gc time, 97.20% compilation time: <1% of which was recompilation)
   ```
   
   # 1.11:
   
   ```
   julia +1.11 --project=test -e'using Pkg; Pkg.develop(path="./"); Pkg.update(); @time include("test/runtests.jl")'
   ```
   
   ```julia
   Test Summary: | Pass  Total  Time
   ArrowTypes    |  127    127  0.5s
   Test Summary:                       | Pass  Total  Time
   Date and time wrappers with missing |    4      4  5.9s
   Test Summary:      | Pass  Total  Time
   `default(T) isa T` |   10     10  0.0s
   Test Summary: |  Pass  Total      Time
   Arrow         | 66047  66047  11m50.4s
   724.425272 seconds (4.33 G allocations: 196.264 GiB, 2.73% gc time, 99.11% compilation time: <1% of which was recompilation
   ```


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [I] Substantial performance regression on 1.11 relative to 1.10 [arrow-julia]

Posted by "quinnj (via GitHub)" <gi...@apache.org>.
quinnj closed issue #542: Substantial performance regression on 1.11 relative to 1.10
URL: https://github.com/apache/arrow-julia/issues/542


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@arrow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [I] Substantial performance regression on 1.11 relative to 1.10 [arrow-julia]

Posted by "kou (via GitHub)" <gi...@apache.org>.
kou commented on issue #542:
URL: https://github.com/apache/arrow-julia/issues/542#issuecomment-3353934096

   Thanks.
   Can we close this?


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org