You are viewing a plain text version of this content. The canonical link for it is here.
Posted to users@kafka.apache.org by Fang Wong <fw...@salesforce.com> on 2016/03/02 01:48:45 UTC
due to invalid request: Request of length
[2016-02-26 20:33:43,025] INFO Closing socket connection to /x due to
invalid request: Request of length 1937006964 is not valid, it is larger
than the maximum size of 104857600 bytes. (kafka.network.Processor)
[2016-02-26 20:33:43,047] INFO Closing socket connection to /x due to
invalid request: Request of length 1937006964 is not valid, it is larger
than the maximum size of 104857600 bytes. (kafka.network.Processor)
[2016-02-26 20:33:43,049] INFO Closing socket connection to /x due to
invalid request: Request of length 1937006964 is not valid, it is larger
than the maximum size of 104857600 bytes. (kafka.network.Processor)
[2016-02-26 20:33:43,055] INFO Closing socket connection to /x due to
invalid request: Request of length 1937006964 is not valid, it is larger
than the maximum size of 104857600 bytes. (kafka.network.Processor)
[2016-02-26 20:33:43,112] INFO Closing socket connection to /x due to
invalid request: Request of length 1937006964 is not valid, it is larger
than the maximum size of 104857600 bytes. (kafka.network.Processor)
Re: due to invalid request: Request of length
Posted by Fang Wong <fw...@salesforce.com>.
Thanks Anirudh!
I didn't send a large message, so most likely an encoding issue, how to fix
the encoding issue?
I googled, found one link: https://github.com/st23am/ExKafka/issues/4
But we are using Java, I couldn't see how to do this line:
IO.iodata_to_binary(iodata)
Thanks,
Fang
On Tue, Mar 1, 2016 at 5:40 PM, Anirudh P <pa...@gmail.com> wrote:
> Hello,
>
> What is the size of the message you are sending. If it is 1937006964 then
> you should set message.max.bytes and replica.fetch.max.bytes to values
> larger than the size of the message you are trying to send.
>
> If it isnt, then its most likely an encoding issue on your side. The kafka
> message is size delimited.
>
> Make sure you are not sending a partial request(or a request with an
> invalid size). The server might wrongly calculate the size of the next
> request and you could see such an error.
>
> Thank you,
> Anirudh
>
> On Wed, Mar 2, 2016 at 6:18 AM, Fang Wong <fw...@salesforce.com> wrote:
>
> > [2016-02-26 20:33:43,025] INFO Closing socket connection to /x due to
> > invalid request: Request of length 1937006964 is not valid, it is larger
> > than the maximum size of 104857600 bytes. (kafka.network.Processor)
> > [2016-02-26 20:33:43,047] INFO Closing socket connection to /x due to
> > invalid request: Request of length 1937006964 is not valid, it is larger
> > than the maximum size of 104857600 bytes. (kafka.network.Processor)
> > [2016-02-26 20:33:43,049] INFO Closing socket connection to /x due to
> > invalid request: Request of length 1937006964 is not valid, it is larger
> > than the maximum size of 104857600 bytes. (kafka.network.Processor)
> > [2016-02-26 20:33:43,055] INFO Closing socket connection to /x due to
> > invalid request: Request of length 1937006964 is not valid, it is larger
> > than the maximum size of 104857600 bytes. (kafka.network.Processor)
> > [2016-02-26 20:33:43,112] INFO Closing socket connection to /x due to
> > invalid request: Request of length 1937006964 is not valid, it is larger
> > than the maximum size of 104857600 bytes. (kafka.network.Processor)
> >
>
Re: due to invalid request: Request of length
Posted by Anirudh P <pa...@gmail.com>.
Hello,
What is the size of the message you are sending. If it is 1937006964 then
you should set message.max.bytes and replica.fetch.max.bytes to values
larger than the size of the message you are trying to send.
If it isnt, then its most likely an encoding issue on your side. The kafka
message is size delimited.
Make sure you are not sending a partial request(or a request with an
invalid size). The server might wrongly calculate the size of the next
request and you could see such an error.
Thank you,
Anirudh
On Wed, Mar 2, 2016 at 6:18 AM, Fang Wong <fw...@salesforce.com> wrote:
> [2016-02-26 20:33:43,025] INFO Closing socket connection to /x due to
> invalid request: Request of length 1937006964 is not valid, it is larger
> than the maximum size of 104857600 bytes. (kafka.network.Processor)
> [2016-02-26 20:33:43,047] INFO Closing socket connection to /x due to
> invalid request: Request of length 1937006964 is not valid, it is larger
> than the maximum size of 104857600 bytes. (kafka.network.Processor)
> [2016-02-26 20:33:43,049] INFO Closing socket connection to /x due to
> invalid request: Request of length 1937006964 is not valid, it is larger
> than the maximum size of 104857600 bytes. (kafka.network.Processor)
> [2016-02-26 20:33:43,055] INFO Closing socket connection to /x due to
> invalid request: Request of length 1937006964 is not valid, it is larger
> than the maximum size of 104857600 bytes. (kafka.network.Processor)
> [2016-02-26 20:33:43,112] INFO Closing socket connection to /x due to
> invalid request: Request of length 1937006964 is not valid, it is larger
> than the maximum size of 104857600 bytes. (kafka.network.Processor)
>