You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@drill.apache.org by "Steven Phillips (JIRA)" <ji...@apache.org> on 2014/05/07 09:35:21 UTC

[jira] [Commented] (DRILL-650) Left outer join sometimes fails sometimes with Failure while setting up Foreman error

    [ https://issues.apache.org/jira/browse/DRILL-650?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13991535#comment-13991535 ] 

Steven Phillips commented on DRILL-650:
---------------------------------------

It would be very helpful if you could include more information about the remote failure. The stack traces you include here are client side stack traces that don't tell us anything about the actual failure. The useful part here is this:

Remote failure while running query.[error_id: "8136e657-1366-476e-ba67-0cfa2aeda169"
endpoint
{ address: "drillats2.qa.lab" user_port: 31010 control_port: 31011 data_port: 31012 }
error_type: 0
message: "Failure while setting up Foreman. < AssertionError"
]

This tells us that there was a remote failure on node drillats2.qa.lab. You should be able to find a log message corresponding to this failure on that node. You can use the error id to find the correct error message.

If you have lilith running, you can find it there. Otherwise, the drillbit should be logging to a local file. There is currently a bug with logging, but DRILL-652 addresses this. You can manually modify the scripts if you want to get file logging.

> Left outer join sometimes fails sometimes  with Failure while setting up Foreman error
> --------------------------------------------------------------------------------------
>
>                 Key: DRILL-650
>                 URL: https://issues.apache.org/jira/browse/DRILL-650
>             Project: Apache Drill
>          Issue Type: Bug
>            Reporter: Ramana Inukonda Nagaraj
>
> Have been seeing this sporadically. Does not happen on a clean drill install or on a recently restarted drillbit.
> select c.C_custkey,c.C_NAME,o.O_ORDERKEY from customer c left outer join orders o on c.c_custkey = o.o_custkey
> Query failed: org.apache.drill.exec.rpc.RpcException: Remote failure while running query.[error_id: "8136e657-1366-476e-ba67-0cfa2aeda169"
> endpoint {
>   address: "drillats2.qa.lab"
>   user_port: 31010
>   control_port: 31011
> java.sql.SQLException: exception while executing query
>   data_port: 31012
> }
> 	at net.hydromatic.avatica.Helper.createException(Helper.java:40)
> 	at net.hydromatic.avatica.AvaticaConnection.executeQueryInternal(AvaticaConnection.java:406)
> error_type: 0
> 	at net.hydromatic.avatica.AvaticaStatement.executeQueryInternal(AvaticaStatement.java:350)
> message: "Failure while setting up Foreman. < AssertionError"
> ]
> 	at net.hydromatic.avatica.AvaticaStatement.executeQuery(AvaticaStatement.java:78)
> 	at org.apache.drill.test.framework.GenericQueryDispatcher.dispatchQueryJDBC(GenericQueryDispatcher.java:88)
> 	at org.apache.drill.test.framework.DrillTestBase$RunThread.run(DrillTestBase.java:269)
> Caused by: java.sql.SQLException: Failure while trying to get next result batch.
> 	at org.apache.drill.jdbc.DrillCursor.next(DrillCursor.java:101)
> 	at org.apache.drill.jdbc.DrillResultSet.execute(DrillResultSet.java:89)
> 	at org.apache.drill.jdbc.DrillResultSet.execute(DrillResultSet.java:43)
> 	at net.hydromatic.avatica.AvaticaConnection.executeQueryInternal(AvaticaConnection.java:404)
> 	... 4 more
> Caused by: org.apache.drill.exec.rpc.RpcException: Remote failure while running query.[error_id: "8136e657-1366-476e-ba67-0cfa2aeda169"
> endpoint {
>   address: "drillats2.qa.lab"
>   user_port: 31010
>   control_port: 31011
>   data_port: 31012
> }
> error_type: 0
> message: "Failure while setting up Foreman. < AssertionError"
> ]
> 	at org.apache.drill.exec.rpc.user.QueryResultHandler.batchArrived(QueryResultHandler.java:72)
> 	at org.apache.drill.exec.rpc.user.UserClient.handleReponse(UserClient.java:80)
> 	at org.apache.drill.exec.rpc.BasicClientWithConnection.handle(BasicClientWithConnection.java:52)
> 	at org.apache.drill.exec.rpc.BasicClientWithConnection.handle(BasicClientWithConnection.java:34)
> 	at org.apache.drill.exec.rpc.RpcBus$InboundHandler.decode(RpcBus.java:154)
> 	at org.apache.drill.exec.rpc.RpcBus$InboundHandler.decode(RpcBus.java:139)
> 	at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:89)
> 	at io.netty.channel.DefaultChannelHandlerContext.invokeChannelRead(DefaultChannelHandlerContext.java:334)
> 	at io.netty.channel.DefaultChannelHandlerContext.fireChannelRead(DefaultChannelHandlerContext.java:320)
> 	at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102)
> 	at io.netty.channel.DefaultChannelHandlerContext.invokeChannelRead(DefaultChannelHandlerContext.java:334)
> 	at io.netty.channel.DefaultChannelHandlerContext.fireChannelRead(DefaultChannelHandlerContext.java:320)
> 	at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:173)
> 	at io.netty.channel.DefaultChannelHandlerContext.invokeChannelRead(DefaultChannelHandlerContext.java:334)
> 	at io.netty.channel.DefaultChannelHandlerContext.fireChannelRead(DefaultChannelHandlerContext.java:320)
> 	at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:86)
> 	at io.netty.channel.DefaultChannelHandlerContext.invokeChannelRead(DefaultChannelHandlerContext.java:334)
> 	at io.netty.channel.DefaultChannelHandlerContext.fireChannelRead(DefaultChannelHandlerContext.java:320)
> 	at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:785)
> 	at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:100)
> 	at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:497)
> 	at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:465)
> 	at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:359)
> 	at io.netty.util.concurrent.SingleThreadEventExecutor$2.run(SingleThreadEventExecutor.java:101)
> 	at java.lang.Thread.run(Thread.java:744)



--
This message was sent by Atlassian JIRA
(v6.2#6252)