You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@drill.apache.org by "Krystal (JIRA)" <ji...@apache.org> on 2015/01/29 19:31:35 UTC

[jira] [Created] (DRILL-2117) tpcds impala q53 query randomly fails with memory leak

Krystal created DRILL-2117:
------------------------------

             Summary: tpcds impala q53 query randomly fails with memory leak
                 Key: DRILL-2117
                 URL: https://issues.apache.org/jira/browse/DRILL-2117
             Project: Apache Drill
          Issue Type: Bug
          Components: Execution - RPC
    Affects Versions: 0.8.0
            Reporter: Krystal
            Assignee: Victoria Markman


Commit  54b5f80

The following tpcds impala sf1 q53 randomly fails:

select
  *
from
  (select
    i.i_manufact_id as imid,
    sum(ss.ss_sales_price) sum_sales
    -- avg(sum(ss.ss_sales_price)) over (partition by i.i_manufact_id) avg_quarterly_sales
  from
    item as i,
    store_sales as ss,
    date_dim as d,
    store as s
  where
    ss.ss_item_sk = i.i_item_sk
    and ss.ss_sold_date_sk = d.d_date_sk
    and ss.ss_store_sk = s.s_store_sk
    and d.d_month_seq in (1212, 1212 + 1, 1212 + 2, 1212 + 3, 1212 + 4, 1212 + 5, 1212 + 6, 1212 + 7, 1212 + 8, 1212 + 9, 1212 + 10, 1212 + 11)
    and ((i.i_category in ('Books', 'Children', 'Electronics')
      and i.i_class in ('personal', 'portable', 'reference', 'self-help')
      and i.i_brand in ('scholaramalgamalg #14', 'scholaramalgamalg #7', 'exportiunivamalg #9', 'scholaramalgamalg #9'))
    or (i.i_category in ('Women', 'Music', 'Men')
      and i.i_class in ('accessories', 'classical', 'fragrances', 'pants')
      and i.i_brand in ('amalgimporto #1', 'edu packscholar #1', 'exportiimporto #1', 'importoamalg #1')))
    and ss.ss_sold_date_sk between 2451911 and 2452275 -- partition key filter
  group by
    i.i_manufact_id,
    d.d_qoy
  ) tmp1
-- where
--   case when avg_quarterly_sales > 0 then abs (sum_sales - avg_quarterly_sales) / avg_quarterly_sales else null end > 0.1
order by
  -- avg_quarterly_sales,
  sum_sales,
  tmp1.imid
limit 100

Query failed: RemoteRpcException: Failure while running fragment., Attempted to close accountor with 1 buffer(s) still allocatedfor QueryId: 2b35963d-aae2-d069-c5cc-c8ce3d414cf6, MajorFragmentId: 4, MinorFragmentId: 9.


	Total 1 allocation(s) of byte size(s): 23058, at stack location:
		org.apache.drill.exec.memory.TopLevelAllocator$ChildAllocator.takeOwnership(TopLevelAllocator.java:197)
		org.apache.drill.exec.rpc.data.DataServer.handle(DataServer.java:119)
		org.apache.drill.exec.rpc.data.DataServer.handle(DataServer.java:48)
		org.apache.drill.exec.rpc.RpcBus$InboundHandler.decode(RpcBus.java:194)
		org.apache.drill.exec.rpc.RpcBus$InboundHandler.decode(RpcBus.java:173)
		io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:89)
		io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:333)
		io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:319)
		io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:103)
		io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:333)
		io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:319)
		io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:161)
		io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:333)
		io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:319)
		io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:86)
		io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:333)
		io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:319)
		io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:787)
		io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:130)
		io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:511)
		io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:468)
		io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:382)
		io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:354)
		io.netty.util.concurrent.SingleThreadEventExecutor$2.run(SingleThreadEventExecutor.java:116)
		java.lang.Thread.run(Thread.java:744)
 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)