You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@spark.apache.org by "Naveen Kumar Kumar Puppala (Jira)" <ji...@apache.org> on 2026/04/22 05:25:00 UTC

[jira] [Commented] (SPARK-46367) PartitioningPreservingUnaryExecNode breaks KeyGroupedPartitioning

    [ https://issues.apache.org/jira/browse/SPARK-46367?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=18075341#comment-18075341 ] 

Naveen Kumar Kumar Puppala commented on SPARK-46367:
----------------------------------------------------

Confirmed this issue persists on current master (4.2.0) following the KeyGroupedPartitioning → KeyedPartitioning refactor in SPARK-55535 (PR #54330). ProjectExec still extends PartitioningPreservingUnaryExecNode without overriding outputPartitioning to remap KeyedPartitioning expressions through column aliases. Added a failing reproduction test in KeyGroupedPartitioningSuite.

> PartitioningPreservingUnaryExecNode breaks KeyGroupedPartitioning
> -----------------------------------------------------------------
>
>                 Key: SPARK-46367
>                 URL: https://issues.apache.org/jira/browse/SPARK-46367
>             Project: Spark
>          Issue Type: Bug
>          Components: Spark Core
>    Affects Versions: 3.5.0
>            Reporter: Nikita Sokolov
>            Priority: Major
>
> When aliasing columns with Project, the KeyGroupedPartitioning from outputPartitioning still points to the old column names and etc.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org