You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@drill.apache.org by "Jacques Nadeau (JIRA)" <ji...@apache.org> on 2014/11/17 02:53:37 UTC

[jira] [Commented] (DRILL-1630) CorruptedFrameException when querying larger data set

    [ https://issues.apache.org/jira/browse/DRILL-1630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14214188#comment-14214188 ] 

Jacques Nadeau commented on DRILL-1630:
---------------------------------------

Closing until we have solid reproduction.

> CorruptedFrameException when querying larger data set
> -----------------------------------------------------
>
>                 Key: DRILL-1630
>                 URL: https://issues.apache.org/jira/browse/DRILL-1630
>             Project: Apache Drill
>          Issue Type: Bug
>          Components: Execution - RPC
>    Affects Versions: 0.6.0
>            Reporter: Aman Sinha
>            Assignee: Parth Chandra
>
> When querying a private data set that has about 4B row fact table  of CSV data and doing left outer joins with 6 dimension tables, one of which has 40M rows,   I have seen the following 2 types of CorruptedFrameException.  The first one occurred on a 4 node cluster, but the second stack trace is from a single node execution. 
> {code}
> 2014-10-29 21:01:48,279 [BitServer-6] ERROR o.a.d.exec.rpc.RpcExceptionHandler - Exception in pipeline.  Closing channel between local /10.10.100.173:31012 and remote /10.10.100.174:48664
> io.netty.handler.codec.CorruptedFrameException: Received a message of length 0.
>         at org.apache.drill.exec.rpc.ProtobufLengthDecoder.decode(ProtobufLengthDecoder.java:74) ~[drill-java-exec-0.7.0-incubating-SNAPSHOT-rebuffed.jar:0.7.0-incubating-SNAPSHOT]
>         at org.apache.drill.exec.rpc.data.DataProtobufLengthDecoder.decode(DataProtobufLengthDecoder.java:38) ~[drill-java-exec-0.7.0-incubating-SNAPSHOT-rebuffed.jar:0.7.0-incubating-SNAPSHOT]
> {code} 
> and 
> {code}
> 2014-10-29 06:33:03,988 [BitServer-5] ERROR o.a.d.exec.rpc.RpcExceptionHandler - Exception in pipeline.  Closing channel between local /10.10.100.171:31012 and remote /10.10.100.171:46069
> io.netty.handler.codec.CorruptedFrameException: Expected to read a tag of 10 but actually received a value of 53.  Happened after reading 271790 message.
>         at org.apache.drill.exec.rpc.RpcDecoder.checkTag(RpcDecoder.java:126) ~[drill-java-exec-0.7.0-incubating-SNAPSHOT-rebuffed.jar:0.7.0-incubating-SNAPSHOT]
>         at org.apache.drill.exec.rpc.RpcDecoder.decode(RpcDecoder.java:61) ~[drill-java-exec-0.7.0-incubating-SNAPSHOT-rebuffed.jar:0.7.0-incubating-SNAPSHOT]
>         at org.apache.drill.exec.rpc.RpcDecoder.decode(RpcDecoder.java:35) ~[drill-java-exec-0.7.0-incubating-SNAPSHOT-rebuffed.jar:0.7.0-incubating-SNAPSHOT]
>         at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:89) ~[netty-codec-4.0.20.Final.jar:4.0.20.Final]
>         at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:332) [netty-transport-4.0.20.Final.jar:4.0.20.Final]
> {code}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)