You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Max Gekk (Jira)" <ji...@apache.org> on 2023/03/10 11:08:00 UTC

[jira] [Updated] (SPARK-42746) Add the LISTAGG() aggregate function

     [ https://issues.apache.org/jira/browse/SPARK-42746?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Max Gekk updated SPARK-42746:
-----------------------------
    Description: 
{{listagg()}} is a common and useful aggregation function to concatenate string values in a column, optionally by a certain order. The systems below have supported such function already:
 * Oracle: [https://docs.oracle.com/cd/E11882_01/server.112/e41084/functions089.htm#SQLRF30030]
 * Snowflake: [https://docs.snowflake.com/en/sql-reference/functions/listagg]
 * Amazon Redshift: [https://docs.aws.amazon.com/redshift/latest/dg/r_LISTAGG.html]
 * Google BigQuery: [https://cloud.google.com/bigquery/docs/reference/standard-sql/functions-and-operators#string_agg]

Need to introduce this new aggregate in Spark, both as a regular aggregate and as a window function.

Proposed syntax:
{code:sql}
LISTAGG( [ DISTINCT ] <expr> [, <delimiter> ] ) [ WITHIN GROUP ( <orderby_clause> ) ]
{code}

  was:
{{listagg()}} is a common and useful aggregation function to concatenate string values in a column, optionally by a certain order. The systems below have supported such function already:
 *  Oracle: https://docs.oracle.com/cd/E11882_01/server.112/e41084/functions089.htm#SQLRF30030
 * Snowflake: https://docs.snowflake.com/en/sql-reference/functions/listagg
 * Amazon Redshift: https://docs.aws.amazon.com/redshift/latest/dg/r_LISTAGG.html
 * Google BigQuery: https://cloud.google.com/bigquery/docs/reference/standard-sql/functions-and-operators#string_agg

Need to introduce this new aggregate in Spark, both as a regular aggregate and as a window function.

Proposed syntax:

{code:sql}
LISTAGG( [ DISTINCT ] <expr> [, <delimiter> ] ) [ WITHIN GROUP ( <orderby_clause> ) ]
{code}



> Add the LISTAGG() aggregate function
> ------------------------------------
>
>                 Key: SPARK-42746
>                 URL: https://issues.apache.org/jira/browse/SPARK-42746
>             Project: Spark
>          Issue Type: New Feature
>          Components: SQL
>    Affects Versions: 3.4.0
>            Reporter: Max Gekk
>            Priority: Major
>
> {{listagg()}} is a common and useful aggregation function to concatenate string values in a column, optionally by a certain order. The systems below have supported such function already:
>  * Oracle: [https://docs.oracle.com/cd/E11882_01/server.112/e41084/functions089.htm#SQLRF30030]
>  * Snowflake: [https://docs.snowflake.com/en/sql-reference/functions/listagg]
>  * Amazon Redshift: [https://docs.aws.amazon.com/redshift/latest/dg/r_LISTAGG.html]
>  * Google BigQuery: [https://cloud.google.com/bigquery/docs/reference/standard-sql/functions-and-operators#string_agg]
> Need to introduce this new aggregate in Spark, both as a regular aggregate and as a window function.
> Proposed syntax:
> {code:sql}
> LISTAGG( [ DISTINCT ] <expr> [, <delimiter> ] ) [ WITHIN GROUP ( <orderby_clause> ) ]
> {code}



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org