You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@druid.apache.org by "takaaki7 (via GitHub)" <gi...@apache.org> on 2023/10/22 04:25:03 UTC

[I] Option to disable dimension sorting of GroupBy query result (druid)

takaaki7 opened a new issue, #15225:
URL: https://github.com/apache/druid/issues/15225

   ### Description
   Currently GroupBy query result is sorted by dimension key, and we cannot optout
   https://github.com/takaaki7/druid/blob/97207cdcc7c8445bd3875bae0c41e5d2c0c9b082/processing/src/main/java/org/apache/druid/query/groupby/epinephelinae/RowBasedGrouperHelper.java#L581
   
   Sorting causes much overhead, especially the result is large. I want to disable it.
   It seems the implementation is following.
   - Sort each parallelized results(per processing thread).
   - Combine all iterators and for every `next()` call, check what iterator is the next one by comparing head elements order.
     - https://github.com/takaaki7/druid/blob/08b5951cc53c4fe474a129500c62a6adad78337f/processing/src/main/java/org/apache/druid/java/util/common/guava/MergeIterator.java#L81
     - https://github.com/takaaki7/druid/blob/08b5951cc53c4fe474a129500c62a6adad78337f/processing/src/main/java/org/apache/druid/java/util/common/guava/MergeIterator.java#L53


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@druid.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@druid.apache.org
For additional commands, e-mail: commits-help@druid.apache.org