[jira] [Created] (AMBARI-22191) Druid stack advisor for memory does not account number of merge buffers while calculating processing buffer size

["Nishant Bangarwa (JIRA)" <ji...@apache.org>]

Nishant Bangarwa created AMBARI-22191:
-----------------------------------------

             Summary: Druid stack advisor for memory does not account number of merge buffers while calculating processing buffer size
                 Key: AMBARI-22191
                 URL: https://issues.apache.org/jira/browse/AMBARI-22191
             Project: Ambari
          Issue Type: Bug
            Reporter: Nishant Bangarwa
            Assignee: Nishant Bangarwa
             Fix For: trunk, 2.6.0


This is leading to OOME with default configs on a 16 core machine with 16G of ram. 
{code} 
5) Error in custom provider, java.lang.OutOfMemoryError
  at io.druid.guice.DruidProcessingModule.getMergeBufferPool(DruidProcessingModule.java:124) (via modules: com.google.inject.util.Modules$OverrideModule -> com.google.inject.util.Modules$OverrideModule -> io.druid.guice.DruidProcessingModule)
  at io.druid.guice.DruidProcessingModule.getMergeBufferPool(DruidProcessingModule.java:124) (via modules: com.google.inject.util.Modules$OverrideModule -> com.google.inject.util.Modules$OverrideModule -> io.druid.guice.DruidProcessingModule)
  while locating io.druid.collections.BlockingPool<java.nio.ByteBuffer> annotated with @io.druid.guice.annotations.Merging()
    for the 4th parameter of io.druid.query.groupby.strategy.GroupByStrategyV2.<init>(GroupByStrategyV2.java:97)
  while locating io.druid.query.groupby.strategy.GroupByStrategyV2
    for the 3rd parameter of io.druid.query.groupby.strategy.GroupByStrategySelector.<init>(GroupByStrategySelector.java:43)
  while locating io.druid.query.groupby.strategy.GroupByStrategySelector
    for the 1st parameter of io.druid.query.groupby.GroupByQueryQueryToolChest.<init>(GroupByQueryQueryToolChest.java:104)
  at io.druid.guice.QueryToolChestModule.configure(QueryToolChestModule.java:95) (via modules: com.google.inject.util.Modules$OverrideModule -> com.google.inject.util.Modules$OverrideModule -> io.druid.guice.QueryRunnerFactoryModule)
  while locating io.druid.query.groupby.GroupByQueryQueryToolChest
  while locating io.druid.query.QueryToolChest annotated with @com.google.inject.multibindings.Element(setNa
{code} 



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)