You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@flink.apache.org by "Ufuk Celebi (JIRA)" <ji...@apache.org> on 2017/07/25 14:12:00 UTC
[jira] [Closed] (FLINK-7258) IllegalArgumentException in Netty
bootstrap with large memory state segment size
[ https://issues.apache.org/jira/browse/FLINK-7258?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Ufuk Celebi closed FLINK-7258.
------------------------------
Resolution: Fixed
Fix Version/s: 1.3.2
1.4.0
Fixed in 96ccffd (release-1.3), 038a9ac (master).
> IllegalArgumentException in Netty bootstrap with large memory state segment size
> --------------------------------------------------------------------------------
>
> Key: FLINK-7258
> URL: https://issues.apache.org/jira/browse/FLINK-7258
> Project: Flink
> Issue Type: Bug
> Components: Network
> Affects Versions: 1.3.1
> Reporter: Ufuk Celebi
> Assignee: Ufuk Celebi
> Priority: Minor
> Fix For: 1.4.0, 1.3.2
>
>
> In NettyBootstrap we configure the low and high watermarks in the following order:
> {code}
> bootstrap.childOption(ChannelOption.WRITE_BUFFER_LOW_WATER_MARK, config.getMemorySegmentSize() + 1);
> bootstrap.childOption(ChannelOption.WRITE_BUFFER_HIGH_WATER_MARK, 2 * config.getMemorySegmentSize());
> {code}
> When the memory segment size is higher than the default high water mark, this throws an `IllegalArgumentException` when a client tries to connect. Hence, this unfortunately only happens during runtime when a intermediate result is requested. This doesn't fail the job, but logs a warning and ignores the failed configuration attempt, potentially resulting in degraded performance because of a lower than expected watermark.
> A simple fix is to first configure the high water mark and only then configure the low watermark.
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)