You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@pulsar.apache.org by GitBox <gi...@apache.org> on 2022/07/19 05:06:25 UTC
[GitHub] [pulsar-manager] youzipi opened a new issue, #473: fail to create environment as broker throw error: `io.netty.handler.codec.TooLongFrameException`
youzipi opened a new issue, #473:
URL: https://github.com/apache/pulsar-manager/issues/473
when i create new environment, got error: `This environment is error. Please check it`
container log:
```
pulsar_1 | 2022-07-19T04:57:04,910+0000 [pulsar-io-31-4] WARN org.apache.pulsar.broker.service.ServerCnx - [/172.31.0.3:40930] Got exception io.netty.handler.codec.TooLongFrameException: Adjusted frame length exceeds 5253120: 1195725860 - discarded
pulsar_1 | at io.netty.handler.codec.LengthFieldBasedFrameDecoder.fail(LengthFieldBasedFrameDecoder.java:507)
pulsar_1 | at io.netty.handler.codec.LengthFieldBasedFrameDecoder.failIfNecessary(LengthFieldBasedFrameDecoder.java:493)
pulsar_1 | at io.netty.handler.codec.LengthFieldBasedFrameDecoder.exceededFrameLength(LengthFieldBasedFrameDecoder.java:377)
pulsar_1 | at io.netty.handler.codec.LengthFieldBasedFrameDecoder.decode(LengthFieldBasedFrameDecoder.java:423)
pulsar_1 | at io.netty.handler.codec.LengthFieldBasedFrameDecoder.decode(LengthFieldBasedFrameDecoder.java:333)
pulsar_1 | at io.netty.handler.codec.ByteToMessageDecoder.decodeRemovalReentryProtection(ByteToMessageDecoder.java:510)
pulsar_1 | at io.netty.handler.codec.ByteToMessageDecoder.callDecode(ByteToMessageDecoder.java:449)
pulsar_1 | at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:279)
pulsar_1 | at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
pulsar_1 | at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
pulsar_1 | at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
pulsar_1 | at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410)
pulsar_1 | at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
pulsar_1 | at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
pulsar_1 | at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919)
pulsar_1 | at io.netty.channel.epoll.AbstractEpollStreamChannel$EpollStreamUnsafe.epollInReady(AbstractEpollStreamChannel.java:800)
pulsar_1 | at io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:487)
pulsar_1 | at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:385)
pulsar_1 | at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:995)
pulsar_1 | at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
pulsar_1 | at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
pulsar_1 | at java.base/java.lang.Thread.run(Thread.java:829)
```
i found this issue: https://github.com/apache/pulsar/issues/15688
```
# The maximum netty frame size in bytes. Any message received larger than this will be rejected. The default value is 5MB.
nettyMaxFrameSizeBytes=5253120
5,253,120
1,195,725,860 # 1G ??
```
is manager backend call the wrong interface? why the data size is 1G?
this is our test environment with 100 topic and not too much msgs.
https://github.com/apache/pulsar-manager/blob/master/src/main/java/org/apache/pulsar/manager/controller/EnvironmentsController.java#L124
```
pulsarAdminService.clusters(environmentEntity.getBroker()).getClusters();
```
my configuration:
```yaml
# docker-compose.yml
---
version: "3.7"
services:
pulsar:
image: apachepulsar/pulsar:2.10.1
environment:
- PULSAR_MEM=-Xms512m -Xmx512m -XX:MaxDirectMemorySize=1g
- PULSAR_PREFIX_defaultRetentionTimeInMinutes=14400
- PULSAR_PREFIX_defaultRetentionSizeInMB=1000
# - PULSAR_PREFIX_httpServerEnabled=true
- PULSAR_PREFIX_bookkeeperClientExposeStatsToPrometheus=true
- PULSAR_PREFIX_transactionCoordinatorEnabled=true
# - PULSAR_PREFIX_nettyMaxFrameSizeBytes=5,253,120 # default
# - PULSAR_PREFIX_nettyMaxFrameSizeBytes=1,195,725,860
# command: bin/pulsar standalone
command: >
/bin/bash -c
"bin/apply-config-from-env.py conf/standalone.conf && bin/pulsar standalone"
hostname: pulsar
ports:
- "8090:8080"
- "6650:6650"
restart: unless-stopped
volumes:
- "./data/:/pulsar/data"
dashboard:
image: apachepulsar/pulsar-manager:v0.3.0
ports:
- "8091:9527"
- "7750:7750"
depends_on:
- pulsar
links:
- pulsar
environment:
SPRING_CONFIGURATION_FILE: /pulsar-manager/pulsar-manager/application.properties
USERNAME: "pulsar"
PASSWORD: "pulsar"
...
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@pulsar.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [pulsar-manager] youzipi commented on issue #473: fail to create environment as broker throw error: `io.netty.handler.codec.TooLongFrameException`
Posted by GitBox <gi...@apache.org>.
youzipi commented on issue #473:
URL: https://github.com/apache/pulsar-manager/issues/473#issuecomment-1188671403
use the wrong url
found this in manager backend log:
```js
Create Pulsar Admin instance. url=http://pulsar:6650, authPlugin=, authParams=, tlsAllowInsecureConnection=false, tlsTrustCertsFilePath=, tlsEnableHostnameVerification=false
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@pulsar.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org