[GitHub] [incubator-druid] pdeva opened a new issue #7819: regression: queries unnecessary pushed down to historicals

[GitBox <gi...@apache.org>]

pdeva opened a new issue #7819: regression: queries unnecessary pushed down to historicals
URL: https://github.com/apache/incubator-druid/issues/7819
 
 
   
   ### Affected Version
   0.14.0-iap12
   
   
   ### Description
   
   
   our segments are hour long (with 1 minute granularity).
   
   However, we are noticing that queries with short time intervals (1 min to 5 mins) that should be handled by KIS tasks on middle managers are being pushed down to historicals for no reason.
   
   for example, the query below covers a 5 minute time range, and is still pushed down to historical for no reason.  
   
   This seems to be a regression which was introduced in some recent version of druid, maybe 0.12 or something, since we didn't see this behavior previously.
   
   Logged query in historical logs:
   
   ```js
   {
     "queryType": "groupBy",
     "dataSource": {
       "type": "table",
       "name": "apm-minute"
     },
     "intervals": {
       "type": "segments",
       "segments": [
         {
           "itvl": "2019-06-03T02:22:00.000Z/2019-06-03T02:27:00.000Z",
           "ver": "2019-06-02T23:58:59.432Z",
           "part": 0
         }
       ]
     },
     "virtualColumns": [],
     "filter": {
       "type": "and",
       "fields": [
         {
           "type": "selector",
           "dimension": "name",
           "value": "JVM/Memory/HeapMax",
           "extractionFn": null
         },
         {
           "type": "selector",
           "dimension": "jvmid",
           "value": "xxx",
           "extractionFn": null
         }
       ]
     },
     "granularity": {
       "type": "period",
       "period": "PT129600M",
       "timeZone": "UTC",
       "origin": "2019-06-03T02:22:00.000Z"
     },
     "dimensions": [
       {
         "type": "LegacyDimensionSpec",
         "dimension": "name",
         "outputName": "name",
         "outputType": "STRING"
       }
     ],
     "aggregations": [
       {
         "type": "doubleSum",
         "name": "value",
         "fieldName": "value",
         "expression": null
       }
     ],
     "postAggregations": [],
     "having": null,
     "limitSpec": {
       "type": "NoopLimitSpec"
     },
     "context": {
       "applyLimitPushDown": false,
       "defaultTimeout": 300000,
       "finalize": false,
       "groupByOutermost": false,
       "groupByStrategy": "v2",
       "maxQueuedBytes": 0,
       "maxScatterGatherBytes": 9223372036854775807,
       "queryFailTime": 1559529245069,
       "queryId": "f1f0e693-dedb-40fb-8616-06143f4e1639",
       "timeout": 300000
     },
     "descending": false
   }
   ```

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


With regards,
Apache Git Services

---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@druid.apache.org
For additional commands, e-mail: commits-help@druid.apache.org