[jira] [Created] (SPARK-59116) Complete PySpark 4.2.0 behavioral parity for the Rust drop-in (window functions, chained when, lag/lead, json_tuple, parameterized SQL, struct to Row, na.fill, nested/empty createDataFrame)

["Hyukjin Kwon (Jira)" <ji...@apache.org>]

Hyukjin Kwon created SPARK-59116:
------------------------------------

             Summary: Complete PySpark 4.2.0 behavioral parity for the Rust drop-in (window functions, chained when, lag/lead, json_tuple, parameterized SQL, struct to Row, na.fill, nested/empty createDataFrame)
                 Key: SPARK-59116
                 URL: https://issues.apache.org/jira/browse/SPARK-59116
             Project: Spark
          Issue Type: Bug
          Components: Connect
    Affects Versions: connect-rust-4.2.0
            Reporter: Hyukjin Kwon


Complete PySpark 4.2.0 behavioral parity for the Rust drop-in; drove an exhaustive differential harness (real PySpark 4.2.0 vs the drop-in) to zero (143/143). Fixes window functions, chained when, lag/lead offset/default, json_tuple variadic, parameterized spark.sql args, struct->Row conversion, na.fill value types, single-field DDL schema, and empty/array<struct> createDataFrame. Verified: harness 143/143, batteries 32/32+83/83+56/56, offline 236, fmt/build/ruff clean.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org