[jira] [Updated] (AMBARI-22191) Druid stack advisor for memory does not account number of merge buffers while calculating processing buffer size

["Nishant Bangarwa (JIRA)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/AMBARI-22191?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Nishant Bangarwa updated AMBARI-22191:
--------------------------------------
    Priority: Critical  (was: Major)

> Druid stack advisor for memory does not account number of merge buffers while calculating processing buffer size
> ----------------------------------------------------------------------------------------------------------------
>
>                 Key: AMBARI-22191
>                 URL: https://issues.apache.org/jira/browse/AMBARI-22191
>             Project: Ambari
>          Issue Type: Bug
>            Reporter: Nishant Bangarwa
>            Assignee: Nishant Bangarwa
>            Priority: Critical
>             Fix For: trunk, 2.6.0
>
>
> This is leading to OOME with default configs on a 16 core machine with 16G of ram. 
> {code} 
> 5) Error in custom provider, java.lang.OutOfMemoryError
>   at io.druid.guice.DruidProcessingModule.getMergeBufferPool(DruidProcessingModule.java:124) (via modules: com.google.inject.util.Modules$OverrideModule -> com.google.inject.util.Modules$OverrideModule -> io.druid.guice.DruidProcessingModule)
>   at io.druid.guice.DruidProcessingModule.getMergeBufferPool(DruidProcessingModule.java:124) (via modules: com.google.inject.util.Modules$OverrideModule -> com.google.inject.util.Modules$OverrideModule -> io.druid.guice.DruidProcessingModule)
>   while locating io.druid.collections.BlockingPool<java.nio.ByteBuffer> annotated with @io.druid.guice.annotations.Merging()
>     for the 4th parameter of io.druid.query.groupby.strategy.GroupByStrategyV2.<init>(GroupByStrategyV2.java:97)
>   while locating io.druid.query.groupby.strategy.GroupByStrategyV2
>     for the 3rd parameter of io.druid.query.groupby.strategy.GroupByStrategySelector.<init>(GroupByStrategySelector.java:43)
>   while locating io.druid.query.groupby.strategy.GroupByStrategySelector
>     for the 1st parameter of io.druid.query.groupby.GroupByQueryQueryToolChest.<init>(GroupByQueryQueryToolChest.java:104)
>   at io.druid.guice.QueryToolChestModule.configure(QueryToolChestModule.java:95) (via modules: com.google.inject.util.Modules$OverrideModule -> com.google.inject.util.Modules$OverrideModule -> io.druid.guice.QueryRunnerFactoryModule)
>   while locating io.druid.query.groupby.GroupByQueryQueryToolChest
>   while locating io.druid.query.QueryToolChest annotated with @com.google.inject.multibindings.Element(setNa
> {code} 



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)