You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@flink.apache.org by "Etienne Chauchot (Jira)" <ji...@apache.org> on 2021/03/18 15:20:00 UTC

[jira] [Created] (FLINK-21863) SortPartition should allow chaining of KeySelectors to support different sorting orders for the fields

Etienne Chauchot created FLINK-21863:
----------------------------------------

             Summary: SortPartition should allow chaining of KeySelectors to support different sorting orders for the fields
                 Key: FLINK-21863
                 URL: https://issues.apache.org/jira/browse/FLINK-21863
             Project: Flink
          Issue Type: Improvement
            Reporter: Etienne Chauchot


If we need to sort data in a DataSet using a KeySelector (for example to extract avro fields or when sort using field index or name is not available) we cannot have different sort orders for the fields. We can sort by a list of fields by making the keySelector return a tuple but they will all be sorted in the same order. 
 To allow _sort by field 1 ASC, field 2 DESC_ kind of semantics with KeySelectors we need to be able to chain the KeySelectors like this
{code:java}
DataSet.sortPartition(field1KeySelector , Order.ASCENDING)
                .sortPartition(field2KeySelector, Order.DESCENDING)
{code}
which is currently not possible.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)