You are viewing a plain text version of this content. The canonical link for it is here.
Posted to github@datafusion.apache.org by "gstvg (via GitHub)" <gi...@apache.org> on 2026/07/16 07:00:41 UTC

[PR] [branch-54] Handle nulls in type coercion of higher-order UDFs, map_extract, spark array_repeat [datafusion]

gstvg opened a new pull request, #23629:
URL: https://github.com/apache/datafusion/pull/23629

   ## Which issue does this PR close?
   
   - Backport of #23071 (clean cherry-pick of non-merge commits)
   - Closes #23068 .
   
   ## Rationale for this change
   
   Unresolved lambda variables and unspecified placeholders report a `DataType::Null` data type, which causes an error when used as argument of a function that doesn't handle nulls during type coercion 
   
   ## What changes are included in this PR?
   
   Handle null in `coerce_single_list_arg` for higher-order functions, `map_extract` and in spark `array_repeat`. All other functions (scalar, window, agg and higher-order) that uses user defined type coercion have been checked to currently handle null args. 
   
   ## Are these changes tested?
   
   Test passing `array_filter` with an unresolved lambda variable to `Dataframe::with_column` (which indirectly calls `value_fields_with_higher_order_udf_and_lambdas` coercion via `Projection::try_new`, `projection_schema`, `exprlist_to_fields`, `Expr::to_field` ), and sqllogictests
   
   ## Are there any user-facing changes?
   
   No
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For additional commands, e-mail: github-help@datafusion.apache.org


Re: [PR] [branch-54] Handle nulls in type coercion of higher-order UDFs, map_extract, spark array_repeat (backport #23071) [datafusion]

Posted by "mbutrovich (via GitHub)" <gi...@apache.org>.
mbutrovich merged PR #23629:
URL: https://github.com/apache/datafusion/pull/23629


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For additional commands, e-mail: github-help@datafusion.apache.org