You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@flink.apache.org by "Etienne Chauchot (Jira)" <ji...@apache.org> on 2021/03/18 15:20:00 UTC
[jira] [Created] (FLINK-21863) SortPartition should allow chaining
of KeySelectors to support different sorting orders for the fields
Etienne Chauchot created FLINK-21863:
----------------------------------------
Summary: SortPartition should allow chaining of KeySelectors to support different sorting orders for the fields
Key: FLINK-21863
URL: https://issues.apache.org/jira/browse/FLINK-21863
Project: Flink
Issue Type: Improvement
Reporter: Etienne Chauchot
If we need to sort data in a DataSet using a KeySelector (for example to extract avro fields or when sort using field index or name is not available) we cannot have different sort orders for the fields. We can sort by a list of fields by making the keySelector return a tuple but they will all be sorted in the same order.
To allow _sort by field 1 ASC, field 2 DESC_ kind of semantics with KeySelectors we need to be able to chain the KeySelectors like this
{code:java}
DataSet.sortPartition(field1KeySelector , Order.ASCENDING)
.sortPartition(field2KeySelector, Order.DESCENDING)
{code}
which is currently not possible.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)