You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@mesos.apache.org by "Santhosh Kumar Shanmugham (JIRA)" <ji...@apache.org> on 2017/02/13 22:25:41 UTC
[jira] [Comment Edited] (MESOS-4210) Investigate increasing
protobuf protocol message size limit.
[ https://issues.apache.org/jira/browse/MESOS-4210?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15864576#comment-15864576 ]
Santhosh Kumar Shanmugham edited comment on MESOS-4210 at 2/13/17 10:24 PM:
----------------------------------------------------------------------------
We are seeing a similar failure during our scale tests. The issue appears to be occurring at `ResourceOffersMessage` parsing. Looks like the Mesos master is bundling up multiple resource offers into a single gigantic `ResourceOffersMessage` which fails to parse on the Scheduler due to the default protobuf size of 64MB.
Options,
- either increase the protobuf message size limit (1MB is recommended size limit)
- limit the number of offers clubbed into a single message.
was (Author: santhk):
We are seeing a similar failure during our scale tests. The issue appears to be occurring at `ResourceOffersMessage` parsing. Looks like the Mesos master is bundling up multiple resource offers into a single gigantic `ResourceOffersMessage` which fails to parse on the Scheduler due to the default protobuf size of 64MB.
Options,
- either increase the protobuf message size limit (seems like 1MB is the recommended size limit - http://stackoverflow.com/questions/34128872/google-protobuf-maximum-size)
- limit the number of offers clubbed into a single message.
> Investigate increasing protobuf protocol message size limit.
> ------------------------------------------------------------
>
> Key: MESOS-4210
> URL: https://issues.apache.org/jira/browse/MESOS-4210
> Project: Mesos
> Issue Type: Bug
> Reporter: Artem Harutyunyan
>
> {noformat}
> [libprotobuf ERROR google/protobuf/io/coded_stream.cc:171] A protocol message was rejected because it was too big (more than 67108864 bytes). To increase the limit (or to disable these warnings), see CodedInputStream::SetTotalBytesLimit() in google/protobuf/io/coded_stream.h.
> F20151217 16:33:44.832834 4076 construct.cpp:48] Check failed: parsed Unexpected failure while parsing protobuf
> Check failure stack trace: ***
> @ 0x2b9bab353b68 (unknown)
> @ 0x2b9bab353ac4 (unknown)
> @ 0x2b9bab3534ba (unknown)
> @ 0x2b9bab356274 (unknown)
> @ 0x2b9bab339d09 (unknown)
> @ 0x2b9bab338917 (unknown)
> @ 0x2b9bab33f404 (unknown)
> @ 0x2b9b68350e18 (unknown)
> {noformat}
> The error is presumably caused by a "user sending a very large command line".
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)