You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@auron.apache.org by "yew1eb (via GitHub)" <gi...@apache.org> on 2025/11/23 08:22:45 UTC
[I] Add AuronQueryTest: compare results with vanilla Spark and check native operators [auron]
yew1eb opened a new issue, #1654:
URL: https://github.com/apache/auron/issues/1654
**Is your feature request related to a problem? Please describe.**
+ Manually writing expected results is error-prone, hard to maintain, and often breaks across spark versions duto to behavioral differences.
+ Many existing tests never verify the physical plan; in practice, a lot of cases silently fallback to vanilla spark instead of executing with native operators.
**Describe the solution you'd like**
+ Add `AuronQueryTest` extending `org.apache.spark.sql.QueryTest`
+ Provide helpers to:
+ Run a query once with native disabled to collect the baseline(vanilla spark), then run with native enabled ans assert results match vanilla spark.
+ Optionally enforce that the physical plan contains only native operators (ignoring stage/adapter nodes), failing fast otherwise.
**Describe alternatives you've considered**
**Additional context**
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@auron.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Add AuronQueryTest: compare results with vanilla Spark and check native operators [auron]
Posted by "richox (via GitHub)" <gi...@apache.org>.
richox closed issue #1654: Add AuronQueryTest: compare results with vanilla Spark and check native operators
URL: https://github.com/apache/auron/issues/1654
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@auron.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Add AuronQueryTest: compare results with vanilla Spark and check native operators [auron]
Posted by "yew1eb (via GitHub)" <gi...@apache.org>.
yew1eb commented on issue #1654:
URL: https://github.com/apache/auron/issues/1654#issuecomment-3568732379
cc @merrily01 @richox
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@auron.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org