You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@datafu.apache.org by "Eyal Allweil (Jira)" <ji...@apache.org> on 2022/11/15 15:00:00 UTC

[jira] [Commented] (DATAFU-171) dedupWithCombiner to support Cols list in the order / group by params

    [ https://issues.apache.org/jira/browse/DATAFU-171?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17634394#comment-17634394 ] 

Eyal Allweil commented on DATAFU-171:
-------------------------------------

If this can be done in a backwards-compatible way, we'll also add it to upcoming release 1.7.0.

> dedupWithCombiner to support Cols list in the order / group by params
> ---------------------------------------------------------------------
>
>                 Key: DATAFU-171
>                 URL: https://issues.apache.org/jira/browse/DATAFU-171
>             Project: DataFu
>          Issue Type: Improvement
>            Reporter: Shaked Aharon
>            Priority: Minor
>
> Currently, dedupWithCombiner only support a single column as its groupBy / orderBy keys. you can still leverage multiple keys, but you will need to add them as column with some expression to unify the columns.
> I would suggest adding support of multiple columns in the function itself without having to modify the df prior to that



--
This message was sent by Atlassian Jira
(v8.20.10#820010)