You are viewing a plain text version of this content. The canonical link for it is here.
Posted to github@datafusion.apache.org by "andygrove (via GitHub)" <gi...@apache.org> on 2026/10/01 13:04:50 UTC

Re: [PR] fix: arrays_zip with duplicate field names falls back to Spark [datafusion-comet]

andygrove commented on code in PR #6324:
URL: https://github.com/apache/datafusion-comet/pull/6324#discussion_r4155655848


##########
spark/src/test/resources/sql-tests/expressions/array/arrays_zip.sql:
##########
@@ -141,6 +141,12 @@ INSERT INTO test_arrays_zip VALUES (array(1), array(10, 20)), (array(2, 3), arra
 query
 select arrays_zip(a, b) FROM test_arrays_zip
 
+query
+select arrays_zip(a, a) FROM test_arrays_zip

Review Comment:
   I think this query fails today. `arrays_zip(a, a)` produces a struct with two children named `a`, and the Arrow Java importer collapses them into one. Could you run this case and `arrays_zip(b, b)` below against the JVM import path and confirm they pass without a fix in the serde? If they fail, a `query expect_fallback(...)` case paired with a `getSupportLevel` guard would cover it.



-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For additional commands, e-mail: github-help@datafusion.apache.org