You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@spark.apache.org by "Zhe Dong (Jira)" <ji...@apache.org> on 2022/12/05 07:16:00 UTC

[jira] [Created] (SPARK-41386) Resolve small files with REBALANCE Hint

Zhe Dong created SPARK-41386:
--------------------------------

             Summary: Resolve small files with REBALANCE Hint
                 Key: SPARK-41386
                 URL: https://issues.apache.org/jira/browse/SPARK-41386
             Project: Spark
          Issue Type: Sub-task
          Components: Connect
    Affects Versions: 3.4.0
            Reporter: Zhe Dong


For compatibility, we need support for expressing window functions. Window functions are different from regular unresolved expressions as they need a window spec and are generally treated more like aggregate functions.

Part of this task is to identify if we can fully express the logic of window functions using unresolved functions with expression arguments that represent the window spec.

Only once this validation is done, we should consider adding a new plan operator / expression type.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org