You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@auron.apache.org by "yew1eb (via GitHub)" <gi...@apache.org> on 2025/12/05 01:56:06 UTC
[PR] [AURON #1697] Lazy-cache NativePlan after native conversion check to avoid recomputation [auron]
yew1eb opened a new pull request, #1698:
URL: https://github.com/apache/auron/pull/1698
# Which issue does this PR close?
Closes #1697 .
# Rationale for this change
Cache NativePlan nodes after conversion check and reuse in doExecuteNative
# What changes are included in this PR?
- Cache serialized NativePlan nodes as lazy vals right after the native support check.
- Reuse the cached nodes in doExecuteNative when creating NativeRDD to avoid recomputation.
# Are there any user-facing changes?
No.
# How was this patch tested?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@auron.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] [AURON #1697] Lazy-cache NativePlan after native conversion check to avoid recomputation [auron]
Posted by "richox (via GitHub)" <gi...@apache.org>.
richox commented on PR #1698:
URL: https://github.com/apache/auron/pull/1698#issuecomment-3640699382
this native conversions are designed to be eagerly computed in native plan construction, so we can fallback the plan when any conversion fails.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@auron.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] [AURON #1697] Lazy-cache NativePlan after native conversion check to avoid recomputation [auron]
Posted by "yew1eb (via GitHub)" <gi...@apache.org>.
yew1eb commented on PR #1698:
URL: https://github.com/apache/auron/pull/1698#issuecomment-3627965758
> Change LGTM, but are we seeing any benefits coming from the lazy-caching? Curious if there is a real-world use-case that drove this change.
This change is a small optimization to avoid unnecessary repeated conversions of Spark Plan nodes (e.g., expressions) into Native Plan nodes (serialized into protobuf format).
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@auron.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] [AURON #1697] Lazy-cache NativePlan after native conversion check to avoid recomputation [auron]
Posted by "yew1eb (via GitHub)" <gi...@apache.org>.
yew1eb closed pull request #1698: [AURON #1697] Lazy-cache NativePlan after native conversion check to avoid recomputation
URL: https://github.com/apache/auron/pull/1698
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@auron.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org