You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@flink.apache.org by "Chesnay Schepler (Jira)" <ji...@apache.org> on 2021/08/23 19:06:00 UTC
[jira] [Commented] (FLINK-23928) Test the buffer debloating
[ https://issues.apache.org/jira/browse/FLINK-23928?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17403345#comment-17403345 ]
Chesnay Schepler commented on FLINK-23928:
------------------------------------------
What's the relationship of this ticket to FLINK-23456?
> Test the buffer debloating
> --------------------------
>
> Key: FLINK-23928
> URL: https://issues.apache.org/jira/browse/FLINK-23928
> Project: Flink
> Issue Type: Sub-task
> Reporter: Anton Kalashnikov
> Priority: Major
> Labels: release-testing
> Fix For: 1.14.0
>
>
> # {color:#6a8759}Configure the buffer debloat by setting `taskmanager.network.memory.buffer-debloat.enabled` to true{color}
> # {color:#6a8759}Start the job with a long checkpoint time{color}
> # {color:#6a8759}Check the alignment time for each subtask it should be near taskmanager.network.memory.buffer-debloat.target{color}
> # {color:#6a8759}Check the checkpoint time it should be near taskCount * taskmanager.network.memory.buffer-debloat.target{color}
> # {color:#6a8759}Try to change taskmanager.network.memory.buffer-debloat.target. Checkponint time should be changed correspondetly.{color}
> # {color:#6a8759}Check metrics {color}{color:#6a8759}estimatedTimeToConsumerBuffersMs and {color}{color:#6a8759}debloatedBufferSize which also should depend on the current debloat configuration.
> {color}
> {color:#6a8759} {color}
> {color:#6a8759}Other configuration which can be changed for test.{color}
> * {color:#6a8759}taskmanager.memory.min-segment-size(if this would be equal to taskmanager.memory.segment-size then the behaviour should be same as with disabled buffer debloat)
> {color}
> * {color:#6a8759}taskmanager.network.memory.buffer-debloat.period{color}
> * {color:#6a8759}taskmanager.network.memory.buffer-debloat.samples{color}
> * {color:#6a8759}taskmanager.network.memory.buffer-debloat.threshold-percentages{color}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)