You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@flink.apache.org by GitBox <gi...@apache.org> on 2021/10/21 16:09:01 UTC

[GitHub] [flink] dawidwys opened a new pull request #17541: [FLINK-24189] Perform buffer debloating per single gate

dawidwys opened a new pull request #17541:
URL: https://github.com/apache/flink/pull/17541


   ## What is the purpose of the change
   
   This PR moves calculating throughput as well debloating buffers to
   the gate level. It should help with situations when there is a
   significant difference in gates throughput.
   
   
   ## Does this pull request potentially affect one of the following parts:
   
     - Dependencies (does it add or upgrade a dependency): (yes / **no**)
     - The public API, i.e., is any changed class annotated with `@Public(Evolving)`: (yes / **no**)
     - The serializers: (yes / **no** / don't know)
     - The runtime per-record code paths (performance sensitive): (**yes** / no / don't know)
     - Anything that affects deployment or recovery: JobManager (and its components), Checkpointing, Kubernetes/Yarn, ZooKeeper: (yes / **no** / don't know)
     - The S3 file system connector: (yes / **no** / don't know)
   
   ## Documentation
   
     - Does this pull request introduce a new feature? (yes / **no**)
     - If yes, how is the feature documented? (not applicable / **docs** / JavaDocs / not documented)
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@flink.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [flink] dawidwys commented on a change in pull request #17541: [FLINK-24189] Perform buffer debloating per single gate

Posted by GitBox <gi...@apache.org>.
dawidwys commented on a change in pull request #17541:
URL: https://github.com/apache/flink/pull/17541#discussion_r741127153



##########
File path: flink-runtime/src/main/java/org/apache/flink/runtime/io/network/metrics/TimeToConsumeGauge.java
##########
@@ -0,0 +1,42 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one
+ * or more contributor license agreements.  See the NOTICE file
+ * distributed with this work for additional information
+ * regarding copyright ownership.  The ASF licenses this file
+ * to you under the Apache License, Version 2.0 (the
+ * "License"); you may not use this file except in compliance
+ * with the License.  You may obtain a copy of the License at
+ *
+ *     http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.flink.runtime.io.network.metrics;
+
+import org.apache.flink.metrics.Gauge;
+import org.apache.flink.runtime.io.network.partition.consumer.SingleInputGate;
+
+/** Gauge metric measuring the maximal time to consume all buffers of all input gates. */
+public class TimeToConsumeGauge implements Gauge<Long> {
+
+    private final SingleInputGate[] gates;
+
+    public TimeToConsumeGauge(SingleInputGate[] gates) {
+        this.gates = gates;
+    }
+
+    @Override
+    public Long getValue() {
+        long result = Long.MIN_VALUE;
+        for (SingleInputGate gate : gates) {
+            result = Math.max(gate.getLastEstimatedTimeToConsume().toMillis(), result);

Review comment:
       I guess theoretically. If were to never see any more records a correct calculation would be to sum all `lastEstimatedTimeToConsume` and divide it by the number of gates. 
   
   Taking the max incorporates an assumption that the "faster" gates will keep on producing at a similar rate, so even after consuming them entirely they will occupy some time with records from a "next portion".

##########
File path: flink-runtime/src/main/java/org/apache/flink/runtime/io/network/metrics/TimeToConsumeGauge.java
##########
@@ -0,0 +1,42 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one
+ * or more contributor license agreements.  See the NOTICE file
+ * distributed with this work for additional information
+ * regarding copyright ownership.  The ASF licenses this file
+ * to you under the Apache License, Version 2.0 (the
+ * "License"); you may not use this file except in compliance
+ * with the License.  You may obtain a copy of the License at
+ *
+ *     http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.flink.runtime.io.network.metrics;
+
+import org.apache.flink.metrics.Gauge;
+import org.apache.flink.runtime.io.network.partition.consumer.SingleInputGate;
+
+/** Gauge metric measuring the maximal time to consume all buffers of all input gates. */
+public class TimeToConsumeGauge implements Gauge<Long> {
+
+    private final SingleInputGate[] gates;
+
+    public TimeToConsumeGauge(SingleInputGate[] gates) {
+        this.gates = gates;
+    }
+
+    @Override
+    public Long getValue() {
+        long result = Long.MIN_VALUE;
+        for (SingleInputGate gate : gates) {
+            result = Math.max(gate.getLastEstimatedTimeToConsume().toMillis(), result);

Review comment:
       I guess theoretically, If were to never see any more records a correct calculation would be to sum all `lastEstimatedTimeToConsume` and divide it by the number of gates. 
   
   Taking the max incorporates an assumption that the "faster" gates will keep on producing at a similar rate, so even after consuming them entirely they will occupy some time with records from a "next portion".




-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@flink.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [flink] flinkbot edited a comment on pull request #17541: [FLINK-24189] Perform buffer debloating per single gate

Posted by GitBox <gi...@apache.org>.
flinkbot edited a comment on pull request #17541:
URL: https://github.com/apache/flink/pull/17541#issuecomment-948765818


   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "9a4f892294645741be037fc2daf930e7a437929f",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=25335",
       "triggerID" : "9a4f892294645741be037fc2daf930e7a437929f",
       "triggerType" : "PUSH"
     }, {
       "hash" : "7ca4c5fe0f72aa6b232dbf18b6b1c0e7291e30aa",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=25337",
       "triggerID" : "7ca4c5fe0f72aa6b232dbf18b6b1c0e7291e30aa",
       "triggerType" : "PUSH"
     }, {
       "hash" : "139a005b569486e13783d67b7da1d4b82dcf5d16",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=25353",
       "triggerID" : "139a005b569486e13783d67b7da1d4b82dcf5d16",
       "triggerType" : "PUSH"
     }, {
       "hash" : "e39429176d84272811882833354f775e0c5d10b0",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=25359",
       "triggerID" : "e39429176d84272811882833354f775e0c5d10b0",
       "triggerType" : "PUSH"
     }, {
       "hash" : "d53cab3a2b923885e421d0fa8a5de9dac47d75bd",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=25724",
       "triggerID" : "d53cab3a2b923885e421d0fa8a5de9dac47d75bd",
       "triggerType" : "PUSH"
     }, {
       "hash" : "bc2203eaab919b4df93f2efd951e757c847a6c72",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=25752",
       "triggerID" : "bc2203eaab919b4df93f2efd951e757c847a6c72",
       "triggerType" : "PUSH"
     }, {
       "hash" : "9b84d08ded8b9bb26c497dd0b541a4c2c01bde4c",
       "status" : "FAILURE",
       "url" : "https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=25761",
       "triggerID" : "9b84d08ded8b9bb26c497dd0b541a4c2c01bde4c",
       "triggerType" : "PUSH"
     }, {
       "hash" : "f43d31bf75a76df316a986e2afab6fcc550c9f80",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "f43d31bf75a76df316a986e2afab6fcc550c9f80",
       "triggerType" : "PUSH"
     } ]
   }-->
   ## CI report:
   
   * 9b84d08ded8b9bb26c497dd0b541a4c2c01bde4c Azure: [FAILURE](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=25761) 
   * f43d31bf75a76df316a986e2afab6fcc550c9f80 UNKNOWN
   
   <details>
   <summary>Bot commands</summary>
     The @flinkbot bot supports the following commands:
   
    - `@flinkbot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@flink.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [flink] flinkbot edited a comment on pull request #17541: [FLINK-24189] Perform buffer debloating per single gate

Posted by GitBox <gi...@apache.org>.
flinkbot edited a comment on pull request #17541:
URL: https://github.com/apache/flink/pull/17541#issuecomment-948765818


   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "9a4f892294645741be037fc2daf930e7a437929f",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=25335",
       "triggerID" : "9a4f892294645741be037fc2daf930e7a437929f",
       "triggerType" : "PUSH"
     }, {
       "hash" : "7ca4c5fe0f72aa6b232dbf18b6b1c0e7291e30aa",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=25337",
       "triggerID" : "7ca4c5fe0f72aa6b232dbf18b6b1c0e7291e30aa",
       "triggerType" : "PUSH"
     }, {
       "hash" : "139a005b569486e13783d67b7da1d4b82dcf5d16",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=25353",
       "triggerID" : "139a005b569486e13783d67b7da1d4b82dcf5d16",
       "triggerType" : "PUSH"
     }, {
       "hash" : "e39429176d84272811882833354f775e0c5d10b0",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=25359",
       "triggerID" : "e39429176d84272811882833354f775e0c5d10b0",
       "triggerType" : "PUSH"
     }, {
       "hash" : "d53cab3a2b923885e421d0fa8a5de9dac47d75bd",
       "status" : "SUCCESS",
       "url" : "https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=25724",
       "triggerID" : "d53cab3a2b923885e421d0fa8a5de9dac47d75bd",
       "triggerType" : "PUSH"
     }, {
       "hash" : "bc2203eaab919b4df93f2efd951e757c847a6c72",
       "status" : "PENDING",
       "url" : "https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=25752",
       "triggerID" : "bc2203eaab919b4df93f2efd951e757c847a6c72",
       "triggerType" : "PUSH"
     }, {
       "hash" : "9b84d08ded8b9bb26c497dd0b541a4c2c01bde4c",
       "status" : "PENDING",
       "url" : "https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=25761",
       "triggerID" : "9b84d08ded8b9bb26c497dd0b541a4c2c01bde4c",
       "triggerType" : "PUSH"
     } ]
   }-->
   ## CI report:
   
   * d53cab3a2b923885e421d0fa8a5de9dac47d75bd Azure: [SUCCESS](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=25724) 
   * bc2203eaab919b4df93f2efd951e757c847a6c72 Azure: [PENDING](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=25752) 
   * 9b84d08ded8b9bb26c497dd0b541a4c2c01bde4c Azure: [PENDING](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=25761) 
   
   <details>
   <summary>Bot commands</summary>
     The @flinkbot bot supports the following commands:
   
    - `@flinkbot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@flink.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [flink] dawidwys commented on a change in pull request #17541: [FLINK-24189] Perform buffer debloating per single gate

Posted by GitBox <gi...@apache.org>.
dawidwys commented on a change in pull request #17541:
URL: https://github.com/apache/flink/pull/17541#discussion_r741117079



##########
File path: flink-runtime/src/main/java/org/apache/flink/runtime/io/network/metrics/TimeToConsumeGauge.java
##########
@@ -0,0 +1,42 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one
+ * or more contributor license agreements.  See the NOTICE file
+ * distributed with this work for additional information
+ * regarding copyright ownership.  The ASF licenses this file
+ * to you under the Apache License, Version 2.0 (the
+ * "License"); you may not use this file except in compliance
+ * with the License.  You may obtain a copy of the License at
+ *
+ *     http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.flink.runtime.io.network.metrics;
+
+import org.apache.flink.metrics.Gauge;
+import org.apache.flink.runtime.io.network.partition.consumer.SingleInputGate;
+
+/** Gauge metric measuring the maximal time to consume all buffers of all input gates. */
+public class TimeToConsumeGauge implements Gauge<Long> {
+
+    private final SingleInputGate[] gates;
+
+    public TimeToConsumeGauge(SingleInputGate[] gates) {
+        this.gates = gates;
+    }
+
+    @Override
+    public Long getValue() {
+        long result = Long.MIN_VALUE;
+        for (SingleInputGate gate : gates) {
+            result = Math.max(gate.getLastEstimatedTimeToConsume().toMillis(), result);

Review comment:
       It is because the throughput of each gate is affected by the other gate. 
   Basically 
   ```
   throughput_1 = data_1/(busy_1 + busy_2)
   ```
   At the same time gates are consumed in a fair manner. The `getLastEstimatedTimeToConsume` always includes some portion of the time spent on processing the other gate. And in a special case the bigger time will include the entire `lastEstimatedTimeToConsume` of the other gate.
   

##########
File path: flink-runtime/src/main/java/org/apache/flink/runtime/io/network/metrics/TimeToConsumeGauge.java
##########
@@ -0,0 +1,42 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one
+ * or more contributor license agreements.  See the NOTICE file
+ * distributed with this work for additional information
+ * regarding copyright ownership.  The ASF licenses this file
+ * to you under the Apache License, Version 2.0 (the
+ * "License"); you may not use this file except in compliance
+ * with the License.  You may obtain a copy of the License at
+ *
+ *     http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.flink.runtime.io.network.metrics;
+
+import org.apache.flink.metrics.Gauge;
+import org.apache.flink.runtime.io.network.partition.consumer.SingleInputGate;
+
+/** Gauge metric measuring the maximal time to consume all buffers of all input gates. */
+public class TimeToConsumeGauge implements Gauge<Long> {
+
+    private final SingleInputGate[] gates;
+
+    public TimeToConsumeGauge(SingleInputGate[] gates) {
+        this.gates = gates;
+    }
+
+    @Override
+    public Long getValue() {
+        long result = Long.MIN_VALUE;
+        for (SingleInputGate gate : gates) {
+            result = Math.max(gate.getLastEstimatedTimeToConsume().toMillis(), result);

Review comment:
       I guess theoretically. If were to never see any more records a correct calculation would be to sum all `lastEstimatedTimeToConsume` and divide it by the number of gates. 
   
   Taking the max incorporates an assumption that the "faster" gates will keep on producing at a similar rate, so even after consuming them entirely they will occupy some time with records from a "next portion".

##########
File path: flink-runtime/src/main/java/org/apache/flink/runtime/io/network/metrics/TimeToConsumeGauge.java
##########
@@ -0,0 +1,42 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one
+ * or more contributor license agreements.  See the NOTICE file
+ * distributed with this work for additional information
+ * regarding copyright ownership.  The ASF licenses this file
+ * to you under the Apache License, Version 2.0 (the
+ * "License"); you may not use this file except in compliance
+ * with the License.  You may obtain a copy of the License at
+ *
+ *     http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.flink.runtime.io.network.metrics;
+
+import org.apache.flink.metrics.Gauge;
+import org.apache.flink.runtime.io.network.partition.consumer.SingleInputGate;
+
+/** Gauge metric measuring the maximal time to consume all buffers of all input gates. */
+public class TimeToConsumeGauge implements Gauge<Long> {
+
+    private final SingleInputGate[] gates;
+
+    public TimeToConsumeGauge(SingleInputGate[] gates) {
+        this.gates = gates;
+    }
+
+    @Override
+    public Long getValue() {
+        long result = Long.MIN_VALUE;
+        for (SingleInputGate gate : gates) {
+            result = Math.max(gate.getLastEstimatedTimeToConsume().toMillis(), result);

Review comment:
       I guess theoretically, If were to never see any more records a correct calculation would be to sum all `lastEstimatedTimeToConsume` and divide it by the number of gates. 
   
   Taking the max incorporates an assumption that the "faster" gates will keep on producing at a similar rate, so even after consuming them entirely they will occupy some time with records from a "next portion".




-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@flink.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [flink] flinkbot edited a comment on pull request #17541: [FLINK-24189] Perform buffer debloating per single gate

Posted by GitBox <gi...@apache.org>.
flinkbot edited a comment on pull request #17541:
URL: https://github.com/apache/flink/pull/17541#issuecomment-948765818


   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "9a4f892294645741be037fc2daf930e7a437929f",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=25335",
       "triggerID" : "9a4f892294645741be037fc2daf930e7a437929f",
       "triggerType" : "PUSH"
     }, {
       "hash" : "7ca4c5fe0f72aa6b232dbf18b6b1c0e7291e30aa",
       "status" : "FAILURE",
       "url" : "https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=25337",
       "triggerID" : "7ca4c5fe0f72aa6b232dbf18b6b1c0e7291e30aa",
       "triggerType" : "PUSH"
     } ]
   }-->
   ## CI report:
   
   * 7ca4c5fe0f72aa6b232dbf18b6b1c0e7291e30aa Azure: [FAILURE](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=25337) 
   
   <details>
   <summary>Bot commands</summary>
     The @flinkbot bot supports the following commands:
   
    - `@flinkbot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@flink.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [flink] flinkbot edited a comment on pull request #17541: [FLINK-24189] Perform buffer debloating per single gate

Posted by GitBox <gi...@apache.org>.
flinkbot edited a comment on pull request #17541:
URL: https://github.com/apache/flink/pull/17541#issuecomment-948765818


   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "9a4f892294645741be037fc2daf930e7a437929f",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=25335",
       "triggerID" : "9a4f892294645741be037fc2daf930e7a437929f",
       "triggerType" : "PUSH"
     }, {
       "hash" : "7ca4c5fe0f72aa6b232dbf18b6b1c0e7291e30aa",
       "status" : "FAILURE",
       "url" : "https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=25337",
       "triggerID" : "7ca4c5fe0f72aa6b232dbf18b6b1c0e7291e30aa",
       "triggerType" : "PUSH"
     }, {
       "hash" : "139a005b569486e13783d67b7da1d4b82dcf5d16",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "139a005b569486e13783d67b7da1d4b82dcf5d16",
       "triggerType" : "PUSH"
     } ]
   }-->
   ## CI report:
   
   * 7ca4c5fe0f72aa6b232dbf18b6b1c0e7291e30aa Azure: [FAILURE](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=25337) 
   * 139a005b569486e13783d67b7da1d4b82dcf5d16 UNKNOWN
   
   <details>
   <summary>Bot commands</summary>
     The @flinkbot bot supports the following commands:
   
    - `@flinkbot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@flink.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [flink] flinkbot edited a comment on pull request #17541: [FLINK-24189] Perform buffer debloating per single gate

Posted by GitBox <gi...@apache.org>.
flinkbot edited a comment on pull request #17541:
URL: https://github.com/apache/flink/pull/17541#issuecomment-948765818


   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "9a4f892294645741be037fc2daf930e7a437929f",
       "status" : "PENDING",
       "url" : "https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=25335",
       "triggerID" : "9a4f892294645741be037fc2daf930e7a437929f",
       "triggerType" : "PUSH"
     }, {
       "hash" : "7ca4c5fe0f72aa6b232dbf18b6b1c0e7291e30aa",
       "status" : "PENDING",
       "url" : "https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=25337",
       "triggerID" : "7ca4c5fe0f72aa6b232dbf18b6b1c0e7291e30aa",
       "triggerType" : "PUSH"
     } ]
   }-->
   ## CI report:
   
   * 9a4f892294645741be037fc2daf930e7a437929f Azure: [PENDING](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=25335) 
   * 7ca4c5fe0f72aa6b232dbf18b6b1c0e7291e30aa Azure: [PENDING](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=25337) 
   
   <details>
   <summary>Bot commands</summary>
     The @flinkbot bot supports the following commands:
   
    - `@flinkbot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@flink.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [flink] flinkbot edited a comment on pull request #17541: [FLINK-24189] Perform buffer debloating per single gate

Posted by GitBox <gi...@apache.org>.
flinkbot edited a comment on pull request #17541:
URL: https://github.com/apache/flink/pull/17541#issuecomment-948765818


   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "9a4f892294645741be037fc2daf930e7a437929f",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=25335",
       "triggerID" : "9a4f892294645741be037fc2daf930e7a437929f",
       "triggerType" : "PUSH"
     }, {
       "hash" : "7ca4c5fe0f72aa6b232dbf18b6b1c0e7291e30aa",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=25337",
       "triggerID" : "7ca4c5fe0f72aa6b232dbf18b6b1c0e7291e30aa",
       "triggerType" : "PUSH"
     }, {
       "hash" : "139a005b569486e13783d67b7da1d4b82dcf5d16",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=25353",
       "triggerID" : "139a005b569486e13783d67b7da1d4b82dcf5d16",
       "triggerType" : "PUSH"
     }, {
       "hash" : "e39429176d84272811882833354f775e0c5d10b0",
       "status" : "SUCCESS",
       "url" : "https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=25359",
       "triggerID" : "e39429176d84272811882833354f775e0c5d10b0",
       "triggerType" : "PUSH"
     } ]
   }-->
   ## CI report:
   
   * e39429176d84272811882833354f775e0c5d10b0 Azure: [SUCCESS](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=25359) 
   
   <details>
   <summary>Bot commands</summary>
     The @flinkbot bot supports the following commands:
   
    - `@flinkbot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@flink.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [flink] akalash commented on a change in pull request #17541: [FLINK-24189] Perform buffer debloating per single gate

Posted by GitBox <gi...@apache.org>.
akalash commented on a change in pull request #17541:
URL: https://github.com/apache/flink/pull/17541#discussion_r739087076



##########
File path: flink-runtime/src/main/java/org/apache/flink/runtime/io/network/metrics/TimeToConsumeGauge.java
##########
@@ -0,0 +1,42 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one
+ * or more contributor license agreements.  See the NOTICE file
+ * distributed with this work for additional information
+ * regarding copyright ownership.  The ASF licenses this file
+ * to you under the Apache License, Version 2.0 (the
+ * "License"); you may not use this file except in compliance
+ * with the License.  You may obtain a copy of the License at
+ *
+ *     http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.flink.runtime.io.network.metrics;
+
+import org.apache.flink.metrics.Gauge;
+import org.apache.flink.runtime.io.network.partition.consumer.SingleInputGate;
+
+/** Gauge metric measuring the maximal time to consume all buffers of all input gates. */
+public class TimeToConsumeGauge implements Gauge<Long> {
+
+    private final SingleInputGate[] gates;
+
+    public TimeToConsumeGauge(SingleInputGate[] gates) {
+        this.gates = gates;
+    }
+
+    @Override
+    public Long getValue() {
+        long result = Long.MIN_VALUE;
+        for (SingleInputGate gate : gates) {
+            result = Math.max(gate.getLastEstimatedTimeToConsume().toMillis(), result);

Review comment:
       Why is it max but not sum?

##########
File path: flink-runtime/src/main/java/org/apache/flink/runtime/throughput/BufferDebloatConfiguration.java
##########
@@ -0,0 +1,105 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one
+ * or more contributor license agreements.  See the NOTICE file
+ * distributed with this work for additional information
+ * regarding copyright ownership.  The ASF licenses this file
+ * to you under the Apache License, Version 2.0 (the
+ * "License"); you may not use this file except in compliance
+ * with the License.  You may obtain a copy of the License at
+ *
+ *     http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.flink.runtime.throughput;
+
+import org.apache.flink.configuration.ReadableConfig;
+import org.apache.flink.configuration.TaskManagerOptions;
+
+import java.time.Duration;
+
+import static org.apache.flink.configuration.TaskManagerOptions.BUFFER_DEBLOAT_SAMPLES;
+import static org.apache.flink.configuration.TaskManagerOptions.BUFFER_DEBLOAT_TARGET;
+import static org.apache.flink.configuration.TaskManagerOptions.BUFFER_DEBLOAT_THRESHOLD_PERCENTAGES;
+import static org.apache.flink.util.Preconditions.checkArgument;
+import static org.apache.flink.util.Preconditions.checkNotNull;
+
+/** Configuration for {@link BufferDebloater}. */
+public final class BufferDebloatConfiguration {

Review comment:
       Maybe it makes sense to extract all things related to BufferDebloatConfiguration to separate commit because it is not directly connected to your changes and it will be easy to understand the major change?

##########
File path: flink-runtime/src/main/java/org/apache/flink/runtime/io/network/metrics/TimeToConsumeGauge.java
##########
@@ -0,0 +1,42 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one
+ * or more contributor license agreements.  See the NOTICE file
+ * distributed with this work for additional information
+ * regarding copyright ownership.  The ASF licenses this file
+ * to you under the Apache License, Version 2.0 (the
+ * "License"); you may not use this file except in compliance
+ * with the License.  You may obtain a copy of the License at
+ *
+ *     http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.flink.runtime.io.network.metrics;
+
+import org.apache.flink.metrics.Gauge;
+import org.apache.flink.runtime.io.network.partition.consumer.SingleInputGate;
+
+/** Gauge metric measuring the maximal time to consume all buffers of all input gates. */
+public class TimeToConsumeGauge implements Gauge<Long> {
+
+    private final SingleInputGate[] gates;
+
+    public TimeToConsumeGauge(SingleInputGate[] gates) {
+        this.gates = gates;
+    }
+
+    @Override
+    public Long getValue() {
+        long result = Long.MIN_VALUE;
+        for (SingleInputGate gate : gates) {
+            result = Math.max(gate.getLastEstimatedTimeToConsume().toMillis(), result);

Review comment:
       thanks for the explanation. Actually, it is obvious that throughput and number of buffers would be divided by each channel.




-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@flink.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [flink] dawidwys commented on pull request #17541: [FLINK-24189] Perform buffer debloating per single gate

Posted by GitBox <gi...@apache.org>.
dawidwys commented on pull request #17541:
URL: https://github.com/apache/flink/pull/17541#issuecomment-958721163


   @flinkbot run azure


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@flink.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [flink] flinkbot edited a comment on pull request #17541: [FLINK-24189] Perform buffer debloating per single gate

Posted by GitBox <gi...@apache.org>.
flinkbot edited a comment on pull request #17541:
URL: https://github.com/apache/flink/pull/17541#issuecomment-948765818


   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "9a4f892294645741be037fc2daf930e7a437929f",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=25335",
       "triggerID" : "9a4f892294645741be037fc2daf930e7a437929f",
       "triggerType" : "PUSH"
     }, {
       "hash" : "7ca4c5fe0f72aa6b232dbf18b6b1c0e7291e30aa",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=25337",
       "triggerID" : "7ca4c5fe0f72aa6b232dbf18b6b1c0e7291e30aa",
       "triggerType" : "PUSH"
     }, {
       "hash" : "139a005b569486e13783d67b7da1d4b82dcf5d16",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=25353",
       "triggerID" : "139a005b569486e13783d67b7da1d4b82dcf5d16",
       "triggerType" : "PUSH"
     }, {
       "hash" : "e39429176d84272811882833354f775e0c5d10b0",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=25359",
       "triggerID" : "e39429176d84272811882833354f775e0c5d10b0",
       "triggerType" : "PUSH"
     }, {
       "hash" : "d53cab3a2b923885e421d0fa8a5de9dac47d75bd",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=25724",
       "triggerID" : "d53cab3a2b923885e421d0fa8a5de9dac47d75bd",
       "triggerType" : "PUSH"
     }, {
       "hash" : "bc2203eaab919b4df93f2efd951e757c847a6c72",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=25752",
       "triggerID" : "bc2203eaab919b4df93f2efd951e757c847a6c72",
       "triggerType" : "PUSH"
     }, {
       "hash" : "9b84d08ded8b9bb26c497dd0b541a4c2c01bde4c",
       "status" : "PENDING",
       "url" : "https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=25761",
       "triggerID" : "9b84d08ded8b9bb26c497dd0b541a4c2c01bde4c",
       "triggerType" : "PUSH"
     }, {
       "hash" : "f43d31bf75a76df316a986e2afab6fcc550c9f80",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=25776",
       "triggerID" : "f43d31bf75a76df316a986e2afab6fcc550c9f80",
       "triggerType" : "PUSH"
     }, {
       "hash" : "f43d31bf75a76df316a986e2afab6fcc550c9f80",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=25776",
       "triggerID" : "957321556",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "9b84d08ded8b9bb26c497dd0b541a4c2c01bde4c",
       "status" : "PENDING",
       "url" : "https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=25761",
       "triggerID" : "957321556",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "9b84d08ded8b9bb26c497dd0b541a4c2c01bde4c",
       "status" : "PENDING",
       "url" : "https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=25761",
       "triggerID" : "957723927",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "f43d31bf75a76df316a986e2afab6fcc550c9f80",
       "status" : "CANCELED",
       "url" : "https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=25776",
       "triggerID" : "957723927",
       "triggerType" : "MANUAL"
     } ]
   }-->
   ## CI report:
   
   * 9b84d08ded8b9bb26c497dd0b541a4c2c01bde4c Azure: [PENDING](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=25761) 
   * f43d31bf75a76df316a986e2afab6fcc550c9f80 Azure: [CANCELED](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=25776) 
   
   <details>
   <summary>Bot commands</summary>
     The @flinkbot bot supports the following commands:
   
    - `@flinkbot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@flink.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [flink] flinkbot edited a comment on pull request #17541: [FLINK-24189] Perform buffer debloating per single gate

Posted by GitBox <gi...@apache.org>.
flinkbot edited a comment on pull request #17541:
URL: https://github.com/apache/flink/pull/17541#issuecomment-948765818


   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "9a4f892294645741be037fc2daf930e7a437929f",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=25335",
       "triggerID" : "9a4f892294645741be037fc2daf930e7a437929f",
       "triggerType" : "PUSH"
     }, {
       "hash" : "7ca4c5fe0f72aa6b232dbf18b6b1c0e7291e30aa",
       "status" : "FAILURE",
       "url" : "https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=25337",
       "triggerID" : "7ca4c5fe0f72aa6b232dbf18b6b1c0e7291e30aa",
       "triggerType" : "PUSH"
     }, {
       "hash" : "139a005b569486e13783d67b7da1d4b82dcf5d16",
       "status" : "PENDING",
       "url" : "https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=25353",
       "triggerID" : "139a005b569486e13783d67b7da1d4b82dcf5d16",
       "triggerType" : "PUSH"
     }, {
       "hash" : "e39429176d84272811882833354f775e0c5d10b0",
       "status" : "PENDING",
       "url" : "https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=25359",
       "triggerID" : "e39429176d84272811882833354f775e0c5d10b0",
       "triggerType" : "PUSH"
     } ]
   }-->
   ## CI report:
   
   * 7ca4c5fe0f72aa6b232dbf18b6b1c0e7291e30aa Azure: [FAILURE](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=25337) 
   * 139a005b569486e13783d67b7da1d4b82dcf5d16 Azure: [PENDING](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=25353) 
   * e39429176d84272811882833354f775e0c5d10b0 Azure: [PENDING](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=25359) 
   
   <details>
   <summary>Bot commands</summary>
     The @flinkbot bot supports the following commands:
   
    - `@flinkbot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@flink.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [flink] flinkbot commented on pull request #17541: [FLINK-24189] Perform buffer debloating per single gate

Posted by GitBox <gi...@apache.org>.
flinkbot commented on pull request #17541:
URL: https://github.com/apache/flink/pull/17541#issuecomment-948768027


   Thanks a lot for your contribution to the Apache Flink project. I'm the @flinkbot. I help the community
   to review your pull request. We will use this comment to track the progress of the review.
   
   
   ## Automated Checks
   Last check on commit 9a4f892294645741be037fc2daf930e7a437929f (Thu Oct 21 16:13:55 UTC 2021)
   
   **Warnings:**
    * No documentation files were touched! Remember to keep the Flink docs up to date!
    * **This pull request references an unassigned [Jira ticket](https://issues.apache.org/jira/browse/FLINK-24189).** According to the [code contribution guide](https://flink.apache.org/contributing/contribute-code.html), tickets need to be assigned before starting with the implementation work.
   
   
   <sub>Mention the bot in a comment to re-run the automated checks.</sub>
   ## Review Progress
   
   * ❓ 1. The [description] looks good.
   * ❓ 2. There is [consensus] that the contribution should go into to Flink.
   * ❓ 3. Needs [attention] from.
   * ❓ 4. The change fits into the overall [architecture].
   * ❓ 5. Overall code [quality] is good.
   
   Please see the [Pull Request Review Guide](https://flink.apache.org/contributing/reviewing-prs.html) for a full explanation of the review process.<details>
    The Bot is tracking the review progress through labels. Labels are applied according to the order of the review items. For consensus, approval by a Flink committer of PMC member is required <summary>Bot commands</summary>
     The @flinkbot bot supports the following commands:
   
    - `@flinkbot approve description` to approve one or more aspects (aspects: `description`, `consensus`, `architecture` and `quality`)
    - `@flinkbot approve all` to approve all aspects
    - `@flinkbot approve-until architecture` to approve everything until `architecture`
    - `@flinkbot attention @username1 [@username2 ..]` to require somebody's attention
    - `@flinkbot disapprove architecture` to remove an approval you gave earlier
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@flink.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [flink] flinkbot edited a comment on pull request #17541: [FLINK-24189] Perform buffer debloating per single gate

Posted by GitBox <gi...@apache.org>.
flinkbot edited a comment on pull request #17541:
URL: https://github.com/apache/flink/pull/17541#issuecomment-948765818


   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "9a4f892294645741be037fc2daf930e7a437929f",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=25335",
       "triggerID" : "9a4f892294645741be037fc2daf930e7a437929f",
       "triggerType" : "PUSH"
     }, {
       "hash" : "7ca4c5fe0f72aa6b232dbf18b6b1c0e7291e30aa",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=25337",
       "triggerID" : "7ca4c5fe0f72aa6b232dbf18b6b1c0e7291e30aa",
       "triggerType" : "PUSH"
     }, {
       "hash" : "139a005b569486e13783d67b7da1d4b82dcf5d16",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=25353",
       "triggerID" : "139a005b569486e13783d67b7da1d4b82dcf5d16",
       "triggerType" : "PUSH"
     }, {
       "hash" : "e39429176d84272811882833354f775e0c5d10b0",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=25359",
       "triggerID" : "e39429176d84272811882833354f775e0c5d10b0",
       "triggerType" : "PUSH"
     }, {
       "hash" : "d53cab3a2b923885e421d0fa8a5de9dac47d75bd",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=25724",
       "triggerID" : "d53cab3a2b923885e421d0fa8a5de9dac47d75bd",
       "triggerType" : "PUSH"
     }, {
       "hash" : "bc2203eaab919b4df93f2efd951e757c847a6c72",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=25752",
       "triggerID" : "bc2203eaab919b4df93f2efd951e757c847a6c72",
       "triggerType" : "PUSH"
     }, {
       "hash" : "9b84d08ded8b9bb26c497dd0b541a4c2c01bde4c",
       "status" : "FAILURE",
       "url" : "https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=25761",
       "triggerID" : "9b84d08ded8b9bb26c497dd0b541a4c2c01bde4c",
       "triggerType" : "PUSH"
     }, {
       "hash" : "f43d31bf75a76df316a986e2afab6fcc550c9f80",
       "status" : "PENDING",
       "url" : "https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=25776",
       "triggerID" : "f43d31bf75a76df316a986e2afab6fcc550c9f80",
       "triggerType" : "PUSH"
     }, {
       "hash" : "f43d31bf75a76df316a986e2afab6fcc550c9f80",
       "status" : "PENDING",
       "url" : "https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=25776",
       "triggerID" : "957321556",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "9b84d08ded8b9bb26c497dd0b541a4c2c01bde4c",
       "status" : "FAILURE",
       "url" : "https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=25761",
       "triggerID" : "957321556",
       "triggerType" : "MANUAL"
     } ]
   }-->
   ## CI report:
   
   * 9b84d08ded8b9bb26c497dd0b541a4c2c01bde4c Azure: [FAILURE](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=25761) 
   * f43d31bf75a76df316a986e2afab6fcc550c9f80 Azure: [PENDING](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=25776) 
   
   <details>
   <summary>Bot commands</summary>
     The @flinkbot bot supports the following commands:
   
    - `@flinkbot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@flink.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [flink] dawidwys commented on pull request #17541: [FLINK-24189] Perform buffer debloating per single gate

Posted by GitBox <gi...@apache.org>.
dawidwys commented on pull request #17541:
URL: https://github.com/apache/flink/pull/17541#issuecomment-957321556


   @flinkbot run azure


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@flink.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [flink] dawidwys commented on pull request #17541: [FLINK-24189] Perform buffer debloating per single gate

Posted by GitBox <gi...@apache.org>.
dawidwys commented on pull request #17541:
URL: https://github.com/apache/flink/pull/17541#issuecomment-957723927


   @flinkbot run azure


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@flink.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [flink] flinkbot edited a comment on pull request #17541: [FLINK-24189] Perform buffer debloating per single gate

Posted by GitBox <gi...@apache.org>.
flinkbot edited a comment on pull request #17541:
URL: https://github.com/apache/flink/pull/17541#issuecomment-948765818


   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "9a4f892294645741be037fc2daf930e7a437929f",
       "status" : "CANCELED",
       "url" : "https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=25335",
       "triggerID" : "9a4f892294645741be037fc2daf930e7a437929f",
       "triggerType" : "PUSH"
     }, {
       "hash" : "7ca4c5fe0f72aa6b232dbf18b6b1c0e7291e30aa",
       "status" : "PENDING",
       "url" : "https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=25337",
       "triggerID" : "7ca4c5fe0f72aa6b232dbf18b6b1c0e7291e30aa",
       "triggerType" : "PUSH"
     } ]
   }-->
   ## CI report:
   
   * 9a4f892294645741be037fc2daf930e7a437929f Azure: [CANCELED](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=25335) 
   * 7ca4c5fe0f72aa6b232dbf18b6b1c0e7291e30aa Azure: [PENDING](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=25337) 
   
   <details>
   <summary>Bot commands</summary>
     The @flinkbot bot supports the following commands:
   
    - `@flinkbot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@flink.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [flink] flinkbot edited a comment on pull request #17541: [FLINK-24189] Perform buffer debloating per single gate

Posted by GitBox <gi...@apache.org>.
flinkbot edited a comment on pull request #17541:
URL: https://github.com/apache/flink/pull/17541#issuecomment-948765818


   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "9a4f892294645741be037fc2daf930e7a437929f",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=25335",
       "triggerID" : "9a4f892294645741be037fc2daf930e7a437929f",
       "triggerType" : "PUSH"
     }, {
       "hash" : "7ca4c5fe0f72aa6b232dbf18b6b1c0e7291e30aa",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=25337",
       "triggerID" : "7ca4c5fe0f72aa6b232dbf18b6b1c0e7291e30aa",
       "triggerType" : "PUSH"
     }, {
       "hash" : "139a005b569486e13783d67b7da1d4b82dcf5d16",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=25353",
       "triggerID" : "139a005b569486e13783d67b7da1d4b82dcf5d16",
       "triggerType" : "PUSH"
     }, {
       "hash" : "e39429176d84272811882833354f775e0c5d10b0",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=25359",
       "triggerID" : "e39429176d84272811882833354f775e0c5d10b0",
       "triggerType" : "PUSH"
     }, {
       "hash" : "d53cab3a2b923885e421d0fa8a5de9dac47d75bd",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=25724",
       "triggerID" : "d53cab3a2b923885e421d0fa8a5de9dac47d75bd",
       "triggerType" : "PUSH"
     }, {
       "hash" : "bc2203eaab919b4df93f2efd951e757c847a6c72",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=25752",
       "triggerID" : "bc2203eaab919b4df93f2efd951e757c847a6c72",
       "triggerType" : "PUSH"
     }, {
       "hash" : "9b84d08ded8b9bb26c497dd0b541a4c2c01bde4c",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=25761",
       "triggerID" : "9b84d08ded8b9bb26c497dd0b541a4c2c01bde4c",
       "triggerType" : "PUSH"
     }, {
       "hash" : "f43d31bf75a76df316a986e2afab6fcc550c9f80",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=25776",
       "triggerID" : "f43d31bf75a76df316a986e2afab6fcc550c9f80",
       "triggerType" : "PUSH"
     }, {
       "hash" : "f43d31bf75a76df316a986e2afab6fcc550c9f80",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=25776",
       "triggerID" : "957321556",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "9b84d08ded8b9bb26c497dd0b541a4c2c01bde4c",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=25761",
       "triggerID" : "957321556",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "9b84d08ded8b9bb26c497dd0b541a4c2c01bde4c",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=25761",
       "triggerID" : "957723927",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "f43d31bf75a76df316a986e2afab6fcc550c9f80",
       "status" : "CANCELED",
       "url" : "https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=25776",
       "triggerID" : "957723927",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "e3c0e6252742d042dcc093f5dea7cb5ec40faad3",
       "status" : "PENDING",
       "url" : "https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=25813",
       "triggerID" : "e3c0e6252742d042dcc093f5dea7cb5ec40faad3",
       "triggerType" : "PUSH"
     } ]
   }-->
   ## CI report:
   
   * f43d31bf75a76df316a986e2afab6fcc550c9f80 Azure: [CANCELED](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=25776) 
   * e3c0e6252742d042dcc093f5dea7cb5ec40faad3 Azure: [PENDING](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=25813) 
   
   <details>
   <summary>Bot commands</summary>
     The @flinkbot bot supports the following commands:
   
    - `@flinkbot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@flink.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [flink] flinkbot edited a comment on pull request #17541: [FLINK-24189] Perform buffer debloating per single gate

Posted by GitBox <gi...@apache.org>.
flinkbot edited a comment on pull request #17541:
URL: https://github.com/apache/flink/pull/17541#issuecomment-948765818


   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "9a4f892294645741be037fc2daf930e7a437929f",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=25335",
       "triggerID" : "9a4f892294645741be037fc2daf930e7a437929f",
       "triggerType" : "PUSH"
     }, {
       "hash" : "7ca4c5fe0f72aa6b232dbf18b6b1c0e7291e30aa",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=25337",
       "triggerID" : "7ca4c5fe0f72aa6b232dbf18b6b1c0e7291e30aa",
       "triggerType" : "PUSH"
     }, {
       "hash" : "139a005b569486e13783d67b7da1d4b82dcf5d16",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=25353",
       "triggerID" : "139a005b569486e13783d67b7da1d4b82dcf5d16",
       "triggerType" : "PUSH"
     }, {
       "hash" : "e39429176d84272811882833354f775e0c5d10b0",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=25359",
       "triggerID" : "e39429176d84272811882833354f775e0c5d10b0",
       "triggerType" : "PUSH"
     }, {
       "hash" : "d53cab3a2b923885e421d0fa8a5de9dac47d75bd",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=25724",
       "triggerID" : "d53cab3a2b923885e421d0fa8a5de9dac47d75bd",
       "triggerType" : "PUSH"
     }, {
       "hash" : "bc2203eaab919b4df93f2efd951e757c847a6c72",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=25752",
       "triggerID" : "bc2203eaab919b4df93f2efd951e757c847a6c72",
       "triggerType" : "PUSH"
     }, {
       "hash" : "9b84d08ded8b9bb26c497dd0b541a4c2c01bde4c",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=25761",
       "triggerID" : "9b84d08ded8b9bb26c497dd0b541a4c2c01bde4c",
       "triggerType" : "PUSH"
     }, {
       "hash" : "f43d31bf75a76df316a986e2afab6fcc550c9f80",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=25776",
       "triggerID" : "f43d31bf75a76df316a986e2afab6fcc550c9f80",
       "triggerType" : "PUSH"
     }, {
       "hash" : "f43d31bf75a76df316a986e2afab6fcc550c9f80",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=25776",
       "triggerID" : "957321556",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "9b84d08ded8b9bb26c497dd0b541a4c2c01bde4c",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=25761",
       "triggerID" : "957321556",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "9b84d08ded8b9bb26c497dd0b541a4c2c01bde4c",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=25761",
       "triggerID" : "957723927",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "f43d31bf75a76df316a986e2afab6fcc550c9f80",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=25776",
       "triggerID" : "957723927",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "e3c0e6252742d042dcc093f5dea7cb5ec40faad3",
       "status" : "FAILURE",
       "url" : "https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=25813",
       "triggerID" : "e3c0e6252742d042dcc093f5dea7cb5ec40faad3",
       "triggerType" : "PUSH"
     }, {
       "hash" : "e3c0e6252742d042dcc093f5dea7cb5ec40faad3",
       "status" : "PENDING",
       "url" : "https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=25813",
       "triggerID" : "958721163",
       "triggerType" : "MANUAL"
     } ]
   }-->
   ## CI report:
   
   * e3c0e6252742d042dcc093f5dea7cb5ec40faad3 Azure: [PENDING](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=25813) 
   
   <details>
   <summary>Bot commands</summary>
     The @flinkbot bot supports the following commands:
   
    - `@flinkbot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@flink.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [flink] dawidwys commented on pull request #17541: [FLINK-24189] Perform buffer debloating per single gate

Posted by GitBox <gi...@apache.org>.
dawidwys commented on pull request #17541:
URL: https://github.com/apache/flink/pull/17541#issuecomment-958721163


   @flinkbot run azure


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@flink.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [flink] akalash commented on a change in pull request #17541: [FLINK-24189] Perform buffer debloating per single gate

Posted by GitBox <gi...@apache.org>.
akalash commented on a change in pull request #17541:
URL: https://github.com/apache/flink/pull/17541#discussion_r739087076



##########
File path: flink-runtime/src/main/java/org/apache/flink/runtime/io/network/metrics/TimeToConsumeGauge.java
##########
@@ -0,0 +1,42 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one
+ * or more contributor license agreements.  See the NOTICE file
+ * distributed with this work for additional information
+ * regarding copyright ownership.  The ASF licenses this file
+ * to you under the Apache License, Version 2.0 (the
+ * "License"); you may not use this file except in compliance
+ * with the License.  You may obtain a copy of the License at
+ *
+ *     http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.flink.runtime.io.network.metrics;
+
+import org.apache.flink.metrics.Gauge;
+import org.apache.flink.runtime.io.network.partition.consumer.SingleInputGate;
+
+/** Gauge metric measuring the maximal time to consume all buffers of all input gates. */
+public class TimeToConsumeGauge implements Gauge<Long> {
+
+    private final SingleInputGate[] gates;
+
+    public TimeToConsumeGauge(SingleInputGate[] gates) {
+        this.gates = gates;
+    }
+
+    @Override
+    public Long getValue() {
+        long result = Long.MIN_VALUE;
+        for (SingleInputGate gate : gates) {
+            result = Math.max(gate.getLastEstimatedTimeToConsume().toMillis(), result);

Review comment:
       Why is it max but not sum?

##########
File path: flink-runtime/src/main/java/org/apache/flink/runtime/throughput/BufferDebloatConfiguration.java
##########
@@ -0,0 +1,105 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one
+ * or more contributor license agreements.  See the NOTICE file
+ * distributed with this work for additional information
+ * regarding copyright ownership.  The ASF licenses this file
+ * to you under the Apache License, Version 2.0 (the
+ * "License"); you may not use this file except in compliance
+ * with the License.  You may obtain a copy of the License at
+ *
+ *     http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.flink.runtime.throughput;
+
+import org.apache.flink.configuration.ReadableConfig;
+import org.apache.flink.configuration.TaskManagerOptions;
+
+import java.time.Duration;
+
+import static org.apache.flink.configuration.TaskManagerOptions.BUFFER_DEBLOAT_SAMPLES;
+import static org.apache.flink.configuration.TaskManagerOptions.BUFFER_DEBLOAT_TARGET;
+import static org.apache.flink.configuration.TaskManagerOptions.BUFFER_DEBLOAT_THRESHOLD_PERCENTAGES;
+import static org.apache.flink.util.Preconditions.checkArgument;
+import static org.apache.flink.util.Preconditions.checkNotNull;
+
+/** Configuration for {@link BufferDebloater}. */
+public final class BufferDebloatConfiguration {

Review comment:
       Maybe it makes sense to extract all things related to BufferDebloatConfiguration to separate commit because it is not directly connected to your changes and it will be easy to understand the major change?

##########
File path: flink-runtime/src/main/java/org/apache/flink/runtime/io/network/metrics/TimeToConsumeGauge.java
##########
@@ -0,0 +1,42 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one
+ * or more contributor license agreements.  See the NOTICE file
+ * distributed with this work for additional information
+ * regarding copyright ownership.  The ASF licenses this file
+ * to you under the Apache License, Version 2.0 (the
+ * "License"); you may not use this file except in compliance
+ * with the License.  You may obtain a copy of the License at
+ *
+ *     http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.flink.runtime.io.network.metrics;
+
+import org.apache.flink.metrics.Gauge;
+import org.apache.flink.runtime.io.network.partition.consumer.SingleInputGate;
+
+/** Gauge metric measuring the maximal time to consume all buffers of all input gates. */
+public class TimeToConsumeGauge implements Gauge<Long> {
+
+    private final SingleInputGate[] gates;
+
+    public TimeToConsumeGauge(SingleInputGate[] gates) {
+        this.gates = gates;
+    }
+
+    @Override
+    public Long getValue() {
+        long result = Long.MIN_VALUE;
+        for (SingleInputGate gate : gates) {
+            result = Math.max(gate.getLastEstimatedTimeToConsume().toMillis(), result);

Review comment:
       thanks for the explanation. Actually, it is obvious that throughput and number of buffers would be divided by each channel.




-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@flink.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [flink] flinkbot edited a comment on pull request #17541: [FLINK-24189] Perform buffer debloating per single gate

Posted by GitBox <gi...@apache.org>.
flinkbot edited a comment on pull request #17541:
URL: https://github.com/apache/flink/pull/17541#issuecomment-948765818


   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "9a4f892294645741be037fc2daf930e7a437929f",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=25335",
       "triggerID" : "9a4f892294645741be037fc2daf930e7a437929f",
       "triggerType" : "PUSH"
     }, {
       "hash" : "7ca4c5fe0f72aa6b232dbf18b6b1c0e7291e30aa",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=25337",
       "triggerID" : "7ca4c5fe0f72aa6b232dbf18b6b1c0e7291e30aa",
       "triggerType" : "PUSH"
     }, {
       "hash" : "139a005b569486e13783d67b7da1d4b82dcf5d16",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=25353",
       "triggerID" : "139a005b569486e13783d67b7da1d4b82dcf5d16",
       "triggerType" : "PUSH"
     }, {
       "hash" : "e39429176d84272811882833354f775e0c5d10b0",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=25359",
       "triggerID" : "e39429176d84272811882833354f775e0c5d10b0",
       "triggerType" : "PUSH"
     }, {
       "hash" : "d53cab3a2b923885e421d0fa8a5de9dac47d75bd",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=25724",
       "triggerID" : "d53cab3a2b923885e421d0fa8a5de9dac47d75bd",
       "triggerType" : "PUSH"
     }, {
       "hash" : "bc2203eaab919b4df93f2efd951e757c847a6c72",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=25752",
       "triggerID" : "bc2203eaab919b4df93f2efd951e757c847a6c72",
       "triggerType" : "PUSH"
     }, {
       "hash" : "9b84d08ded8b9bb26c497dd0b541a4c2c01bde4c",
       "status" : "FAILURE",
       "url" : "https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=25761",
       "triggerID" : "9b84d08ded8b9bb26c497dd0b541a4c2c01bde4c",
       "triggerType" : "PUSH"
     }, {
       "hash" : "f43d31bf75a76df316a986e2afab6fcc550c9f80",
       "status" : "PENDING",
       "url" : "https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=25776",
       "triggerID" : "f43d31bf75a76df316a986e2afab6fcc550c9f80",
       "triggerType" : "PUSH"
     } ]
   }-->
   ## CI report:
   
   * 9b84d08ded8b9bb26c497dd0b541a4c2c01bde4c Azure: [FAILURE](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=25761) 
   * f43d31bf75a76df316a986e2afab6fcc550c9f80 Azure: [PENDING](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=25776) 
   
   <details>
   <summary>Bot commands</summary>
     The @flinkbot bot supports the following commands:
   
    - `@flinkbot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@flink.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [flink] flinkbot edited a comment on pull request #17541: [FLINK-24189] Perform buffer debloating per single gate

Posted by GitBox <gi...@apache.org>.
flinkbot edited a comment on pull request #17541:
URL: https://github.com/apache/flink/pull/17541#issuecomment-948765818


   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "9a4f892294645741be037fc2daf930e7a437929f",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=25335",
       "triggerID" : "9a4f892294645741be037fc2daf930e7a437929f",
       "triggerType" : "PUSH"
     }, {
       "hash" : "7ca4c5fe0f72aa6b232dbf18b6b1c0e7291e30aa",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=25337",
       "triggerID" : "7ca4c5fe0f72aa6b232dbf18b6b1c0e7291e30aa",
       "triggerType" : "PUSH"
     }, {
       "hash" : "139a005b569486e13783d67b7da1d4b82dcf5d16",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=25353",
       "triggerID" : "139a005b569486e13783d67b7da1d4b82dcf5d16",
       "triggerType" : "PUSH"
     }, {
       "hash" : "e39429176d84272811882833354f775e0c5d10b0",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=25359",
       "triggerID" : "e39429176d84272811882833354f775e0c5d10b0",
       "triggerType" : "PUSH"
     }, {
       "hash" : "d53cab3a2b923885e421d0fa8a5de9dac47d75bd",
       "status" : "SUCCESS",
       "url" : "https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=25724",
       "triggerID" : "d53cab3a2b923885e421d0fa8a5de9dac47d75bd",
       "triggerType" : "PUSH"
     }, {
       "hash" : "bc2203eaab919b4df93f2efd951e757c847a6c72",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "bc2203eaab919b4df93f2efd951e757c847a6c72",
       "triggerType" : "PUSH"
     } ]
   }-->
   ## CI report:
   
   * d53cab3a2b923885e421d0fa8a5de9dac47d75bd Azure: [SUCCESS](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=25724) 
   * bc2203eaab919b4df93f2efd951e757c847a6c72 UNKNOWN
   
   <details>
   <summary>Bot commands</summary>
     The @flinkbot bot supports the following commands:
   
    - `@flinkbot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@flink.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [flink] flinkbot edited a comment on pull request #17541: [FLINK-24189] Perform buffer debloating per single gate

Posted by GitBox <gi...@apache.org>.
flinkbot edited a comment on pull request #17541:
URL: https://github.com/apache/flink/pull/17541#issuecomment-948765818


   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "9a4f892294645741be037fc2daf930e7a437929f",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=25335",
       "triggerID" : "9a4f892294645741be037fc2daf930e7a437929f",
       "triggerType" : "PUSH"
     }, {
       "hash" : "7ca4c5fe0f72aa6b232dbf18b6b1c0e7291e30aa",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=25337",
       "triggerID" : "7ca4c5fe0f72aa6b232dbf18b6b1c0e7291e30aa",
       "triggerType" : "PUSH"
     }, {
       "hash" : "139a005b569486e13783d67b7da1d4b82dcf5d16",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=25353",
       "triggerID" : "139a005b569486e13783d67b7da1d4b82dcf5d16",
       "triggerType" : "PUSH"
     }, {
       "hash" : "e39429176d84272811882833354f775e0c5d10b0",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=25359",
       "triggerID" : "e39429176d84272811882833354f775e0c5d10b0",
       "triggerType" : "PUSH"
     }, {
       "hash" : "d53cab3a2b923885e421d0fa8a5de9dac47d75bd",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=25724",
       "triggerID" : "d53cab3a2b923885e421d0fa8a5de9dac47d75bd",
       "triggerType" : "PUSH"
     }, {
       "hash" : "bc2203eaab919b4df93f2efd951e757c847a6c72",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=25752",
       "triggerID" : "bc2203eaab919b4df93f2efd951e757c847a6c72",
       "triggerType" : "PUSH"
     }, {
       "hash" : "9b84d08ded8b9bb26c497dd0b541a4c2c01bde4c",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=25761",
       "triggerID" : "9b84d08ded8b9bb26c497dd0b541a4c2c01bde4c",
       "triggerType" : "PUSH"
     }, {
       "hash" : "f43d31bf75a76df316a986e2afab6fcc550c9f80",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=25776",
       "triggerID" : "f43d31bf75a76df316a986e2afab6fcc550c9f80",
       "triggerType" : "PUSH"
     }, {
       "hash" : "f43d31bf75a76df316a986e2afab6fcc550c9f80",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=25776",
       "triggerID" : "957321556",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "9b84d08ded8b9bb26c497dd0b541a4c2c01bde4c",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=25761",
       "triggerID" : "957321556",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "9b84d08ded8b9bb26c497dd0b541a4c2c01bde4c",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=25761",
       "triggerID" : "957723927",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "f43d31bf75a76df316a986e2afab6fcc550c9f80",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=25776",
       "triggerID" : "957723927",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "e3c0e6252742d042dcc093f5dea7cb5ec40faad3",
       "status" : "FAILURE",
       "url" : "https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=25813",
       "triggerID" : "e3c0e6252742d042dcc093f5dea7cb5ec40faad3",
       "triggerType" : "PUSH"
     } ]
   }-->
   ## CI report:
   
   * e3c0e6252742d042dcc093f5dea7cb5ec40faad3 Azure: [FAILURE](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=25813) 
   
   <details>
   <summary>Bot commands</summary>
     The @flinkbot bot supports the following commands:
   
    - `@flinkbot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@flink.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [flink] flinkbot edited a comment on pull request #17541: [FLINK-24189] Perform buffer debloating per single gate

Posted by GitBox <gi...@apache.org>.
flinkbot edited a comment on pull request #17541:
URL: https://github.com/apache/flink/pull/17541#issuecomment-948765818


   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "9a4f892294645741be037fc2daf930e7a437929f",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=25335",
       "triggerID" : "9a4f892294645741be037fc2daf930e7a437929f",
       "triggerType" : "PUSH"
     }, {
       "hash" : "7ca4c5fe0f72aa6b232dbf18b6b1c0e7291e30aa",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=25337",
       "triggerID" : "7ca4c5fe0f72aa6b232dbf18b6b1c0e7291e30aa",
       "triggerType" : "PUSH"
     }, {
       "hash" : "139a005b569486e13783d67b7da1d4b82dcf5d16",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=25353",
       "triggerID" : "139a005b569486e13783d67b7da1d4b82dcf5d16",
       "triggerType" : "PUSH"
     }, {
       "hash" : "e39429176d84272811882833354f775e0c5d10b0",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=25359",
       "triggerID" : "e39429176d84272811882833354f775e0c5d10b0",
       "triggerType" : "PUSH"
     }, {
       "hash" : "d53cab3a2b923885e421d0fa8a5de9dac47d75bd",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=25724",
       "triggerID" : "d53cab3a2b923885e421d0fa8a5de9dac47d75bd",
       "triggerType" : "PUSH"
     }, {
       "hash" : "bc2203eaab919b4df93f2efd951e757c847a6c72",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=25752",
       "triggerID" : "bc2203eaab919b4df93f2efd951e757c847a6c72",
       "triggerType" : "PUSH"
     }, {
       "hash" : "9b84d08ded8b9bb26c497dd0b541a4c2c01bde4c",
       "status" : "FAILURE",
       "url" : "https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=25761",
       "triggerID" : "9b84d08ded8b9bb26c497dd0b541a4c2c01bde4c",
       "triggerType" : "PUSH"
     }, {
       "hash" : "f43d31bf75a76df316a986e2afab6fcc550c9f80",
       "status" : "PENDING",
       "url" : "https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=25776",
       "triggerID" : "f43d31bf75a76df316a986e2afab6fcc550c9f80",
       "triggerType" : "PUSH"
     }, {
       "hash" : "9b84d08ded8b9bb26c497dd0b541a4c2c01bde4c",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "957321556",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "f43d31bf75a76df316a986e2afab6fcc550c9f80",
       "status" : "PENDING",
       "url" : "https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=25776",
       "triggerID" : "957321556",
       "triggerType" : "MANUAL"
     } ]
   }-->
   ## CI report:
   
   * 9b84d08ded8b9bb26c497dd0b541a4c2c01bde4c Azure: [FAILURE](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=25761) 
   * f43d31bf75a76df316a986e2afab6fcc550c9f80 Azure: [PENDING](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=25776) 
   
   <details>
   <summary>Bot commands</summary>
     The @flinkbot bot supports the following commands:
   
    - `@flinkbot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@flink.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [flink] dawidwys commented on pull request #17541: [FLINK-24189] Perform buffer debloating per single gate

Posted by GitBox <gi...@apache.org>.
dawidwys commented on pull request #17541:
URL: https://github.com/apache/flink/pull/17541#issuecomment-958721163


   @flinkbot run azure


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@flink.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [flink] flinkbot edited a comment on pull request #17541: [FLINK-24189] Perform buffer debloating per single gate

Posted by GitBox <gi...@apache.org>.
flinkbot edited a comment on pull request #17541:
URL: https://github.com/apache/flink/pull/17541#issuecomment-948765818


   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "9a4f892294645741be037fc2daf930e7a437929f",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=25335",
       "triggerID" : "9a4f892294645741be037fc2daf930e7a437929f",
       "triggerType" : "PUSH"
     }, {
       "hash" : "7ca4c5fe0f72aa6b232dbf18b6b1c0e7291e30aa",
       "status" : "FAILURE",
       "url" : "https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=25337",
       "triggerID" : "7ca4c5fe0f72aa6b232dbf18b6b1c0e7291e30aa",
       "triggerType" : "PUSH"
     }, {
       "hash" : "139a005b569486e13783d67b7da1d4b82dcf5d16",
       "status" : "PENDING",
       "url" : "https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=25353",
       "triggerID" : "139a005b569486e13783d67b7da1d4b82dcf5d16",
       "triggerType" : "PUSH"
     }, {
       "hash" : "e39429176d84272811882833354f775e0c5d10b0",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "e39429176d84272811882833354f775e0c5d10b0",
       "triggerType" : "PUSH"
     } ]
   }-->
   ## CI report:
   
   * 7ca4c5fe0f72aa6b232dbf18b6b1c0e7291e30aa Azure: [FAILURE](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=25337) 
   * 139a005b569486e13783d67b7da1d4b82dcf5d16 Azure: [PENDING](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=25353) 
   * e39429176d84272811882833354f775e0c5d10b0 UNKNOWN
   
   <details>
   <summary>Bot commands</summary>
     The @flinkbot bot supports the following commands:
   
    - `@flinkbot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@flink.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [flink] flinkbot edited a comment on pull request #17541: [FLINK-24189] Perform buffer debloating per single gate

Posted by GitBox <gi...@apache.org>.
flinkbot edited a comment on pull request #17541:
URL: https://github.com/apache/flink/pull/17541#issuecomment-948765818


   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "9a4f892294645741be037fc2daf930e7a437929f",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=25335",
       "triggerID" : "9a4f892294645741be037fc2daf930e7a437929f",
       "triggerType" : "PUSH"
     }, {
       "hash" : "7ca4c5fe0f72aa6b232dbf18b6b1c0e7291e30aa",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=25337",
       "triggerID" : "7ca4c5fe0f72aa6b232dbf18b6b1c0e7291e30aa",
       "triggerType" : "PUSH"
     }, {
       "hash" : "139a005b569486e13783d67b7da1d4b82dcf5d16",
       "status" : "CANCELED",
       "url" : "https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=25353",
       "triggerID" : "139a005b569486e13783d67b7da1d4b82dcf5d16",
       "triggerType" : "PUSH"
     }, {
       "hash" : "e39429176d84272811882833354f775e0c5d10b0",
       "status" : "PENDING",
       "url" : "https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=25359",
       "triggerID" : "e39429176d84272811882833354f775e0c5d10b0",
       "triggerType" : "PUSH"
     } ]
   }-->
   ## CI report:
   
   * 139a005b569486e13783d67b7da1d4b82dcf5d16 Azure: [CANCELED](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=25353) 
   * e39429176d84272811882833354f775e0c5d10b0 Azure: [PENDING](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=25359) 
   
   <details>
   <summary>Bot commands</summary>
     The @flinkbot bot supports the following commands:
   
    - `@flinkbot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@flink.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [flink] flinkbot edited a comment on pull request #17541: [FLINK-24189] Perform buffer debloating per single gate

Posted by GitBox <gi...@apache.org>.
flinkbot edited a comment on pull request #17541:
URL: https://github.com/apache/flink/pull/17541#issuecomment-948765818


   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "9a4f892294645741be037fc2daf930e7a437929f",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=25335",
       "triggerID" : "9a4f892294645741be037fc2daf930e7a437929f",
       "triggerType" : "PUSH"
     }, {
       "hash" : "7ca4c5fe0f72aa6b232dbf18b6b1c0e7291e30aa",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=25337",
       "triggerID" : "7ca4c5fe0f72aa6b232dbf18b6b1c0e7291e30aa",
       "triggerType" : "PUSH"
     }, {
       "hash" : "139a005b569486e13783d67b7da1d4b82dcf5d16",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=25353",
       "triggerID" : "139a005b569486e13783d67b7da1d4b82dcf5d16",
       "triggerType" : "PUSH"
     }, {
       "hash" : "e39429176d84272811882833354f775e0c5d10b0",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=25359",
       "triggerID" : "e39429176d84272811882833354f775e0c5d10b0",
       "triggerType" : "PUSH"
     }, {
       "hash" : "d53cab3a2b923885e421d0fa8a5de9dac47d75bd",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=25724",
       "triggerID" : "d53cab3a2b923885e421d0fa8a5de9dac47d75bd",
       "triggerType" : "PUSH"
     }, {
       "hash" : "bc2203eaab919b4df93f2efd951e757c847a6c72",
       "status" : "CANCELED",
       "url" : "https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=25752",
       "triggerID" : "bc2203eaab919b4df93f2efd951e757c847a6c72",
       "triggerType" : "PUSH"
     }, {
       "hash" : "9b84d08ded8b9bb26c497dd0b541a4c2c01bde4c",
       "status" : "PENDING",
       "url" : "https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=25761",
       "triggerID" : "9b84d08ded8b9bb26c497dd0b541a4c2c01bde4c",
       "triggerType" : "PUSH"
     } ]
   }-->
   ## CI report:
   
   * bc2203eaab919b4df93f2efd951e757c847a6c72 Azure: [CANCELED](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=25752) 
   * 9b84d08ded8b9bb26c497dd0b541a4c2c01bde4c Azure: [PENDING](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=25761) 
   
   <details>
   <summary>Bot commands</summary>
     The @flinkbot bot supports the following commands:
   
    - `@flinkbot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@flink.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [flink] flinkbot edited a comment on pull request #17541: [FLINK-24189] Perform buffer debloating per single gate

Posted by GitBox <gi...@apache.org>.
flinkbot edited a comment on pull request #17541:
URL: https://github.com/apache/flink/pull/17541#issuecomment-948765818


   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "9a4f892294645741be037fc2daf930e7a437929f",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=25335",
       "triggerID" : "9a4f892294645741be037fc2daf930e7a437929f",
       "triggerType" : "PUSH"
     }, {
       "hash" : "7ca4c5fe0f72aa6b232dbf18b6b1c0e7291e30aa",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=25337",
       "triggerID" : "7ca4c5fe0f72aa6b232dbf18b6b1c0e7291e30aa",
       "triggerType" : "PUSH"
     }, {
       "hash" : "139a005b569486e13783d67b7da1d4b82dcf5d16",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=25353",
       "triggerID" : "139a005b569486e13783d67b7da1d4b82dcf5d16",
       "triggerType" : "PUSH"
     }, {
       "hash" : "e39429176d84272811882833354f775e0c5d10b0",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=25359",
       "triggerID" : "e39429176d84272811882833354f775e0c5d10b0",
       "triggerType" : "PUSH"
     }, {
       "hash" : "d53cab3a2b923885e421d0fa8a5de9dac47d75bd",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=25724",
       "triggerID" : "d53cab3a2b923885e421d0fa8a5de9dac47d75bd",
       "triggerType" : "PUSH"
     }, {
       "hash" : "bc2203eaab919b4df93f2efd951e757c847a6c72",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=25752",
       "triggerID" : "bc2203eaab919b4df93f2efd951e757c847a6c72",
       "triggerType" : "PUSH"
     }, {
       "hash" : "9b84d08ded8b9bb26c497dd0b541a4c2c01bde4c",
       "status" : "FAILURE",
       "url" : "https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=25761",
       "triggerID" : "9b84d08ded8b9bb26c497dd0b541a4c2c01bde4c",
       "triggerType" : "PUSH"
     } ]
   }-->
   ## CI report:
   
   * 9b84d08ded8b9bb26c497dd0b541a4c2c01bde4c Azure: [FAILURE](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=25761) 
   
   <details>
   <summary>Bot commands</summary>
     The @flinkbot bot supports the following commands:
   
    - `@flinkbot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@flink.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [flink] flinkbot edited a comment on pull request #17541: [FLINK-24189] Perform buffer debloating per single gate

Posted by GitBox <gi...@apache.org>.
flinkbot edited a comment on pull request #17541:
URL: https://github.com/apache/flink/pull/17541#issuecomment-948765818


   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "9a4f892294645741be037fc2daf930e7a437929f",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=25335",
       "triggerID" : "9a4f892294645741be037fc2daf930e7a437929f",
       "triggerType" : "PUSH"
     }, {
       "hash" : "7ca4c5fe0f72aa6b232dbf18b6b1c0e7291e30aa",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=25337",
       "triggerID" : "7ca4c5fe0f72aa6b232dbf18b6b1c0e7291e30aa",
       "triggerType" : "PUSH"
     }, {
       "hash" : "139a005b569486e13783d67b7da1d4b82dcf5d16",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=25353",
       "triggerID" : "139a005b569486e13783d67b7da1d4b82dcf5d16",
       "triggerType" : "PUSH"
     }, {
       "hash" : "e39429176d84272811882833354f775e0c5d10b0",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=25359",
       "triggerID" : "e39429176d84272811882833354f775e0c5d10b0",
       "triggerType" : "PUSH"
     }, {
       "hash" : "d53cab3a2b923885e421d0fa8a5de9dac47d75bd",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=25724",
       "triggerID" : "d53cab3a2b923885e421d0fa8a5de9dac47d75bd",
       "triggerType" : "PUSH"
     }, {
       "hash" : "bc2203eaab919b4df93f2efd951e757c847a6c72",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=25752",
       "triggerID" : "bc2203eaab919b4df93f2efd951e757c847a6c72",
       "triggerType" : "PUSH"
     }, {
       "hash" : "9b84d08ded8b9bb26c497dd0b541a4c2c01bde4c",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=25761",
       "triggerID" : "9b84d08ded8b9bb26c497dd0b541a4c2c01bde4c",
       "triggerType" : "PUSH"
     }, {
       "hash" : "f43d31bf75a76df316a986e2afab6fcc550c9f80",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=25776",
       "triggerID" : "f43d31bf75a76df316a986e2afab6fcc550c9f80",
       "triggerType" : "PUSH"
     }, {
       "hash" : "f43d31bf75a76df316a986e2afab6fcc550c9f80",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=25776",
       "triggerID" : "957321556",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "9b84d08ded8b9bb26c497dd0b541a4c2c01bde4c",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=25761",
       "triggerID" : "957321556",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "9b84d08ded8b9bb26c497dd0b541a4c2c01bde4c",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=25761",
       "triggerID" : "957723927",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "f43d31bf75a76df316a986e2afab6fcc550c9f80",
       "status" : "CANCELED",
       "url" : "https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=25776",
       "triggerID" : "957723927",
       "triggerType" : "MANUAL"
     } ]
   }-->
   ## CI report:
   
   * f43d31bf75a76df316a986e2afab6fcc550c9f80 Azure: [CANCELED](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=25776) 
   
   <details>
   <summary>Bot commands</summary>
     The @flinkbot bot supports the following commands:
   
    - `@flinkbot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@flink.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [flink] dawidwys commented on pull request #17541: [FLINK-24189] Perform buffer debloating per single gate

Posted by GitBox <gi...@apache.org>.
dawidwys commented on pull request #17541:
URL: https://github.com/apache/flink/pull/17541#issuecomment-957321556






-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@flink.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [flink] dawidwys merged pull request #17541: [FLINK-24189] Perform buffer debloating per single gate

Posted by GitBox <gi...@apache.org>.
dawidwys merged pull request #17541:
URL: https://github.com/apache/flink/pull/17541


   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@flink.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [flink] flinkbot edited a comment on pull request #17541: [FLINK-24189] Perform buffer debloating per single gate

Posted by GitBox <gi...@apache.org>.
flinkbot edited a comment on pull request #17541:
URL: https://github.com/apache/flink/pull/17541#issuecomment-948765818


   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "9a4f892294645741be037fc2daf930e7a437929f",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=25335",
       "triggerID" : "9a4f892294645741be037fc2daf930e7a437929f",
       "triggerType" : "PUSH"
     }, {
       "hash" : "7ca4c5fe0f72aa6b232dbf18b6b1c0e7291e30aa",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=25337",
       "triggerID" : "7ca4c5fe0f72aa6b232dbf18b6b1c0e7291e30aa",
       "triggerType" : "PUSH"
     }, {
       "hash" : "139a005b569486e13783d67b7da1d4b82dcf5d16",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=25353",
       "triggerID" : "139a005b569486e13783d67b7da1d4b82dcf5d16",
       "triggerType" : "PUSH"
     }, {
       "hash" : "e39429176d84272811882833354f775e0c5d10b0",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=25359",
       "triggerID" : "e39429176d84272811882833354f775e0c5d10b0",
       "triggerType" : "PUSH"
     }, {
       "hash" : "d53cab3a2b923885e421d0fa8a5de9dac47d75bd",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=25724",
       "triggerID" : "d53cab3a2b923885e421d0fa8a5de9dac47d75bd",
       "triggerType" : "PUSH"
     }, {
       "hash" : "bc2203eaab919b4df93f2efd951e757c847a6c72",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=25752",
       "triggerID" : "bc2203eaab919b4df93f2efd951e757c847a6c72",
       "triggerType" : "PUSH"
     }, {
       "hash" : "9b84d08ded8b9bb26c497dd0b541a4c2c01bde4c",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=25761",
       "triggerID" : "9b84d08ded8b9bb26c497dd0b541a4c2c01bde4c",
       "triggerType" : "PUSH"
     }, {
       "hash" : "f43d31bf75a76df316a986e2afab6fcc550c9f80",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=25776",
       "triggerID" : "f43d31bf75a76df316a986e2afab6fcc550c9f80",
       "triggerType" : "PUSH"
     }, {
       "hash" : "f43d31bf75a76df316a986e2afab6fcc550c9f80",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=25776",
       "triggerID" : "957321556",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "9b84d08ded8b9bb26c497dd0b541a4c2c01bde4c",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=25761",
       "triggerID" : "957321556",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "9b84d08ded8b9bb26c497dd0b541a4c2c01bde4c",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=25761",
       "triggerID" : "957723927",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "f43d31bf75a76df316a986e2afab6fcc550c9f80",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=25776",
       "triggerID" : "957723927",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "e3c0e6252742d042dcc093f5dea7cb5ec40faad3",
       "status" : "SUCCESS",
       "url" : "https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=25813",
       "triggerID" : "e3c0e6252742d042dcc093f5dea7cb5ec40faad3",
       "triggerType" : "PUSH"
     }, {
       "hash" : "e3c0e6252742d042dcc093f5dea7cb5ec40faad3",
       "status" : "SUCCESS",
       "url" : "https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=25813",
       "triggerID" : "958721163",
       "triggerType" : "MANUAL"
     } ]
   }-->
   ## CI report:
   
   * e3c0e6252742d042dcc093f5dea7cb5ec40faad3 Azure: [SUCCESS](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=25813) 
   
   <details>
   <summary>Bot commands</summary>
     The @flinkbot bot supports the following commands:
   
    - `@flinkbot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@flink.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [flink] flinkbot commented on pull request #17541: [FLINK-24189] Perform buffer debloating per single gate

Posted by GitBox <gi...@apache.org>.
flinkbot commented on pull request #17541:
URL: https://github.com/apache/flink/pull/17541#issuecomment-948765818


   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "9a4f892294645741be037fc2daf930e7a437929f",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "9a4f892294645741be037fc2daf930e7a437929f",
       "triggerType" : "PUSH"
     } ]
   }-->
   ## CI report:
   
   * 9a4f892294645741be037fc2daf930e7a437929f UNKNOWN
   
   <details>
   <summary>Bot commands</summary>
     The @flinkbot bot supports the following commands:
   
    - `@flinkbot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@flink.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [flink] flinkbot edited a comment on pull request #17541: [FLINK-24189] Perform buffer debloating per single gate

Posted by GitBox <gi...@apache.org>.
flinkbot edited a comment on pull request #17541:
URL: https://github.com/apache/flink/pull/17541#issuecomment-948765818


   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "9a4f892294645741be037fc2daf930e7a437929f",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=25335",
       "triggerID" : "9a4f892294645741be037fc2daf930e7a437929f",
       "triggerType" : "PUSH"
     }, {
       "hash" : "7ca4c5fe0f72aa6b232dbf18b6b1c0e7291e30aa",
       "status" : "FAILURE",
       "url" : "https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=25337",
       "triggerID" : "7ca4c5fe0f72aa6b232dbf18b6b1c0e7291e30aa",
       "triggerType" : "PUSH"
     }, {
       "hash" : "139a005b569486e13783d67b7da1d4b82dcf5d16",
       "status" : "PENDING",
       "url" : "https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=25353",
       "triggerID" : "139a005b569486e13783d67b7da1d4b82dcf5d16",
       "triggerType" : "PUSH"
     } ]
   }-->
   ## CI report:
   
   * 7ca4c5fe0f72aa6b232dbf18b6b1c0e7291e30aa Azure: [FAILURE](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=25337) 
   * 139a005b569486e13783d67b7da1d4b82dcf5d16 Azure: [PENDING](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=25353) 
   
   <details>
   <summary>Bot commands</summary>
     The @flinkbot bot supports the following commands:
   
    - `@flinkbot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@flink.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [flink] flinkbot edited a comment on pull request #17541: [FLINK-24189] Perform buffer debloating per single gate

Posted by GitBox <gi...@apache.org>.
flinkbot edited a comment on pull request #17541:
URL: https://github.com/apache/flink/pull/17541#issuecomment-948765818


   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "9a4f892294645741be037fc2daf930e7a437929f",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=25335",
       "triggerID" : "9a4f892294645741be037fc2daf930e7a437929f",
       "triggerType" : "PUSH"
     }, {
       "hash" : "7ca4c5fe0f72aa6b232dbf18b6b1c0e7291e30aa",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=25337",
       "triggerID" : "7ca4c5fe0f72aa6b232dbf18b6b1c0e7291e30aa",
       "triggerType" : "PUSH"
     }, {
       "hash" : "139a005b569486e13783d67b7da1d4b82dcf5d16",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=25353",
       "triggerID" : "139a005b569486e13783d67b7da1d4b82dcf5d16",
       "triggerType" : "PUSH"
     }, {
       "hash" : "e39429176d84272811882833354f775e0c5d10b0",
       "status" : "SUCCESS",
       "url" : "https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=25359",
       "triggerID" : "e39429176d84272811882833354f775e0c5d10b0",
       "triggerType" : "PUSH"
     }, {
       "hash" : "d53cab3a2b923885e421d0fa8a5de9dac47d75bd",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "d53cab3a2b923885e421d0fa8a5de9dac47d75bd",
       "triggerType" : "PUSH"
     } ]
   }-->
   ## CI report:
   
   * e39429176d84272811882833354f775e0c5d10b0 Azure: [SUCCESS](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=25359) 
   * d53cab3a2b923885e421d0fa8a5de9dac47d75bd UNKNOWN
   
   <details>
   <summary>Bot commands</summary>
     The @flinkbot bot supports the following commands:
   
    - `@flinkbot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@flink.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [flink] flinkbot edited a comment on pull request #17541: [FLINK-24189] Perform buffer debloating per single gate

Posted by GitBox <gi...@apache.org>.
flinkbot edited a comment on pull request #17541:
URL: https://github.com/apache/flink/pull/17541#issuecomment-948765818






-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@flink.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [flink] dawidwys commented on a change in pull request #17541: [FLINK-24189] Perform buffer debloating per single gate

Posted by GitBox <gi...@apache.org>.
dawidwys commented on a change in pull request #17541:
URL: https://github.com/apache/flink/pull/17541#discussion_r741117079



##########
File path: flink-runtime/src/main/java/org/apache/flink/runtime/io/network/metrics/TimeToConsumeGauge.java
##########
@@ -0,0 +1,42 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one
+ * or more contributor license agreements.  See the NOTICE file
+ * distributed with this work for additional information
+ * regarding copyright ownership.  The ASF licenses this file
+ * to you under the Apache License, Version 2.0 (the
+ * "License"); you may not use this file except in compliance
+ * with the License.  You may obtain a copy of the License at
+ *
+ *     http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.flink.runtime.io.network.metrics;
+
+import org.apache.flink.metrics.Gauge;
+import org.apache.flink.runtime.io.network.partition.consumer.SingleInputGate;
+
+/** Gauge metric measuring the maximal time to consume all buffers of all input gates. */
+public class TimeToConsumeGauge implements Gauge<Long> {
+
+    private final SingleInputGate[] gates;
+
+    public TimeToConsumeGauge(SingleInputGate[] gates) {
+        this.gates = gates;
+    }
+
+    @Override
+    public Long getValue() {
+        long result = Long.MIN_VALUE;
+        for (SingleInputGate gate : gates) {
+            result = Math.max(gate.getLastEstimatedTimeToConsume().toMillis(), result);

Review comment:
       It is because the throughput of each gate is affected by the other gate. 
   Basically 
   ```
   throughput_1 = data_1/(busy_1 + busy_2)
   ```
   At the same time gates are consumed in a fair manner. The `getLastEstimatedTimeToConsume` always includes some portion of the time spent on processing the other gate. And in a special case the bigger time will include the entire `lastEstimatedTimeToConsume` of the other gate.
   




-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@flink.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [flink] dawidwys commented on pull request #17541: [FLINK-24189] Perform buffer debloating per single gate

Posted by GitBox <gi...@apache.org>.
dawidwys commented on pull request #17541:
URL: https://github.com/apache/flink/pull/17541#issuecomment-957321556






-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@flink.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [flink] akalash commented on a change in pull request #17541: [FLINK-24189] Perform buffer debloating per single gate

Posted by GitBox <gi...@apache.org>.
akalash commented on a change in pull request #17541:
URL: https://github.com/apache/flink/pull/17541#discussion_r741142294



##########
File path: flink-runtime/src/main/java/org/apache/flink/runtime/io/network/metrics/TimeToConsumeGauge.java
##########
@@ -0,0 +1,42 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one
+ * or more contributor license agreements.  See the NOTICE file
+ * distributed with this work for additional information
+ * regarding copyright ownership.  The ASF licenses this file
+ * to you under the Apache License, Version 2.0 (the
+ * "License"); you may not use this file except in compliance
+ * with the License.  You may obtain a copy of the License at
+ *
+ *     http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.flink.runtime.io.network.metrics;
+
+import org.apache.flink.metrics.Gauge;
+import org.apache.flink.runtime.io.network.partition.consumer.SingleInputGate;
+
+/** Gauge metric measuring the maximal time to consume all buffers of all input gates. */
+public class TimeToConsumeGauge implements Gauge<Long> {
+
+    private final SingleInputGate[] gates;
+
+    public TimeToConsumeGauge(SingleInputGate[] gates) {
+        this.gates = gates;
+    }
+
+    @Override
+    public Long getValue() {
+        long result = Long.MIN_VALUE;
+        for (SingleInputGate gate : gates) {
+            result = Math.max(gate.getLastEstimatedTimeToConsume().toMillis(), result);

Review comment:
       thanks for the explanation. Actually, it is obvious that throughput and number of buffers would be divided by each channel.




-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@flink.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [flink] dawidwys commented on a change in pull request #17541: [FLINK-24189] Perform buffer debloating per single gate

Posted by GitBox <gi...@apache.org>.
dawidwys commented on a change in pull request #17541:
URL: https://github.com/apache/flink/pull/17541#discussion_r741117079



##########
File path: flink-runtime/src/main/java/org/apache/flink/runtime/io/network/metrics/TimeToConsumeGauge.java
##########
@@ -0,0 +1,42 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one
+ * or more contributor license agreements.  See the NOTICE file
+ * distributed with this work for additional information
+ * regarding copyright ownership.  The ASF licenses this file
+ * to you under the Apache License, Version 2.0 (the
+ * "License"); you may not use this file except in compliance
+ * with the License.  You may obtain a copy of the License at
+ *
+ *     http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.flink.runtime.io.network.metrics;
+
+import org.apache.flink.metrics.Gauge;
+import org.apache.flink.runtime.io.network.partition.consumer.SingleInputGate;
+
+/** Gauge metric measuring the maximal time to consume all buffers of all input gates. */
+public class TimeToConsumeGauge implements Gauge<Long> {
+
+    private final SingleInputGate[] gates;
+
+    public TimeToConsumeGauge(SingleInputGate[] gates) {
+        this.gates = gates;
+    }
+
+    @Override
+    public Long getValue() {
+        long result = Long.MIN_VALUE;
+        for (SingleInputGate gate : gates) {
+            result = Math.max(gate.getLastEstimatedTimeToConsume().toMillis(), result);

Review comment:
       It is because the throughput of each gate is affected by the other gate. 
   Basically 
   ```
   throughput_1 = data_1/(busy_1 + busy_2)
   ```
   At the same time gates are consumed in a fair manner. The `getLastEstimatedTimeToConsume` always includes some portion of the time spent on processing the other gate. And in a special case the bigger time will include the entire `lastEstimatedTimeToConsume` of the other gate.
   

##########
File path: flink-runtime/src/main/java/org/apache/flink/runtime/io/network/metrics/TimeToConsumeGauge.java
##########
@@ -0,0 +1,42 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one
+ * or more contributor license agreements.  See the NOTICE file
+ * distributed with this work for additional information
+ * regarding copyright ownership.  The ASF licenses this file
+ * to you under the Apache License, Version 2.0 (the
+ * "License"); you may not use this file except in compliance
+ * with the License.  You may obtain a copy of the License at
+ *
+ *     http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.flink.runtime.io.network.metrics;
+
+import org.apache.flink.metrics.Gauge;
+import org.apache.flink.runtime.io.network.partition.consumer.SingleInputGate;
+
+/** Gauge metric measuring the maximal time to consume all buffers of all input gates. */
+public class TimeToConsumeGauge implements Gauge<Long> {
+
+    private final SingleInputGate[] gates;
+
+    public TimeToConsumeGauge(SingleInputGate[] gates) {
+        this.gates = gates;
+    }
+
+    @Override
+    public Long getValue() {
+        long result = Long.MIN_VALUE;
+        for (SingleInputGate gate : gates) {
+            result = Math.max(gate.getLastEstimatedTimeToConsume().toMillis(), result);

Review comment:
       I guess theoretically. If were to never see any more records a correct calculation would be to sum all `lastEstimatedTimeToConsume` and divide it by the number of gates. 
   
   Taking the max incorporates an assumption that the "faster" gates will keep on producing at a similar rate, so even after consuming them entirely they will occupy some time with records from a "next portion".

##########
File path: flink-runtime/src/main/java/org/apache/flink/runtime/io/network/metrics/TimeToConsumeGauge.java
##########
@@ -0,0 +1,42 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one
+ * or more contributor license agreements.  See the NOTICE file
+ * distributed with this work for additional information
+ * regarding copyright ownership.  The ASF licenses this file
+ * to you under the Apache License, Version 2.0 (the
+ * "License"); you may not use this file except in compliance
+ * with the License.  You may obtain a copy of the License at
+ *
+ *     http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.flink.runtime.io.network.metrics;
+
+import org.apache.flink.metrics.Gauge;
+import org.apache.flink.runtime.io.network.partition.consumer.SingleInputGate;
+
+/** Gauge metric measuring the maximal time to consume all buffers of all input gates. */
+public class TimeToConsumeGauge implements Gauge<Long> {
+
+    private final SingleInputGate[] gates;
+
+    public TimeToConsumeGauge(SingleInputGate[] gates) {
+        this.gates = gates;
+    }
+
+    @Override
+    public Long getValue() {
+        long result = Long.MIN_VALUE;
+        for (SingleInputGate gate : gates) {
+            result = Math.max(gate.getLastEstimatedTimeToConsume().toMillis(), result);

Review comment:
       I guess theoretically, If were to never see any more records a correct calculation would be to sum all `lastEstimatedTimeToConsume` and divide it by the number of gates. 
   
   Taking the max incorporates an assumption that the "faster" gates will keep on producing at a similar rate, so even after consuming them entirely they will occupy some time with records from a "next portion".




-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@flink.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [flink] flinkbot edited a comment on pull request #17541: [FLINK-24189] Perform buffer debloating per single gate

Posted by GitBox <gi...@apache.org>.
flinkbot edited a comment on pull request #17541:
URL: https://github.com/apache/flink/pull/17541#issuecomment-948765818


   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "9a4f892294645741be037fc2daf930e7a437929f",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=25335",
       "triggerID" : "9a4f892294645741be037fc2daf930e7a437929f",
       "triggerType" : "PUSH"
     }, {
       "hash" : "7ca4c5fe0f72aa6b232dbf18b6b1c0e7291e30aa",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=25337",
       "triggerID" : "7ca4c5fe0f72aa6b232dbf18b6b1c0e7291e30aa",
       "triggerType" : "PUSH"
     }, {
       "hash" : "139a005b569486e13783d67b7da1d4b82dcf5d16",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=25353",
       "triggerID" : "139a005b569486e13783d67b7da1d4b82dcf5d16",
       "triggerType" : "PUSH"
     }, {
       "hash" : "e39429176d84272811882833354f775e0c5d10b0",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=25359",
       "triggerID" : "e39429176d84272811882833354f775e0c5d10b0",
       "triggerType" : "PUSH"
     }, {
       "hash" : "d53cab3a2b923885e421d0fa8a5de9dac47d75bd",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=25724",
       "triggerID" : "d53cab3a2b923885e421d0fa8a5de9dac47d75bd",
       "triggerType" : "PUSH"
     }, {
       "hash" : "bc2203eaab919b4df93f2efd951e757c847a6c72",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=25752",
       "triggerID" : "bc2203eaab919b4df93f2efd951e757c847a6c72",
       "triggerType" : "PUSH"
     }, {
       "hash" : "9b84d08ded8b9bb26c497dd0b541a4c2c01bde4c",
       "status" : "FAILURE",
       "url" : "https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=25761",
       "triggerID" : "9b84d08ded8b9bb26c497dd0b541a4c2c01bde4c",
       "triggerType" : "PUSH"
     }, {
       "hash" : "f43d31bf75a76df316a986e2afab6fcc550c9f80",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=25776",
       "triggerID" : "f43d31bf75a76df316a986e2afab6fcc550c9f80",
       "triggerType" : "PUSH"
     }, {
       "hash" : "f43d31bf75a76df316a986e2afab6fcc550c9f80",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=25776",
       "triggerID" : "957321556",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "9b84d08ded8b9bb26c497dd0b541a4c2c01bde4c",
       "status" : "FAILURE",
       "url" : "https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=25761",
       "triggerID" : "957321556",
       "triggerType" : "MANUAL"
     } ]
   }-->
   ## CI report:
   
   * 9b84d08ded8b9bb26c497dd0b541a4c2c01bde4c Azure: [FAILURE](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=25761) 
   
   <details>
   <summary>Bot commands</summary>
     The @flinkbot bot supports the following commands:
   
    - `@flinkbot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@flink.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [flink] flinkbot edited a comment on pull request #17541: [FLINK-24189] Perform buffer debloating per single gate

Posted by GitBox <gi...@apache.org>.
flinkbot edited a comment on pull request #17541:
URL: https://github.com/apache/flink/pull/17541#issuecomment-948765818


   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "9a4f892294645741be037fc2daf930e7a437929f",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=25335",
       "triggerID" : "9a4f892294645741be037fc2daf930e7a437929f",
       "triggerType" : "PUSH"
     }, {
       "hash" : "7ca4c5fe0f72aa6b232dbf18b6b1c0e7291e30aa",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=25337",
       "triggerID" : "7ca4c5fe0f72aa6b232dbf18b6b1c0e7291e30aa",
       "triggerType" : "PUSH"
     }, {
       "hash" : "139a005b569486e13783d67b7da1d4b82dcf5d16",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=25353",
       "triggerID" : "139a005b569486e13783d67b7da1d4b82dcf5d16",
       "triggerType" : "PUSH"
     }, {
       "hash" : "e39429176d84272811882833354f775e0c5d10b0",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=25359",
       "triggerID" : "e39429176d84272811882833354f775e0c5d10b0",
       "triggerType" : "PUSH"
     }, {
       "hash" : "d53cab3a2b923885e421d0fa8a5de9dac47d75bd",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=25724",
       "triggerID" : "d53cab3a2b923885e421d0fa8a5de9dac47d75bd",
       "triggerType" : "PUSH"
     }, {
       "hash" : "bc2203eaab919b4df93f2efd951e757c847a6c72",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=25752",
       "triggerID" : "bc2203eaab919b4df93f2efd951e757c847a6c72",
       "triggerType" : "PUSH"
     }, {
       "hash" : "9b84d08ded8b9bb26c497dd0b541a4c2c01bde4c",
       "status" : "FAILURE",
       "url" : "https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=25761",
       "triggerID" : "9b84d08ded8b9bb26c497dd0b541a4c2c01bde4c",
       "triggerType" : "PUSH"
     }, {
       "hash" : "f43d31bf75a76df316a986e2afab6fcc550c9f80",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=25776",
       "triggerID" : "f43d31bf75a76df316a986e2afab6fcc550c9f80",
       "triggerType" : "PUSH"
     }, {
       "hash" : "f43d31bf75a76df316a986e2afab6fcc550c9f80",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=25776",
       "triggerID" : "957321556",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "9b84d08ded8b9bb26c497dd0b541a4c2c01bde4c",
       "status" : "FAILURE",
       "url" : "https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=25761",
       "triggerID" : "957321556",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "f43d31bf75a76df316a986e2afab6fcc550c9f80",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "957723927",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "9b84d08ded8b9bb26c497dd0b541a4c2c01bde4c",
       "status" : "PENDING",
       "url" : "https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=25761",
       "triggerID" : "957723927",
       "triggerType" : "MANUAL"
     } ]
   }-->
   ## CI report:
   
   * 9b84d08ded8b9bb26c497dd0b541a4c2c01bde4c Azure: [PENDING](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=25761) 
   
   <details>
   <summary>Bot commands</summary>
     The @flinkbot bot supports the following commands:
   
    - `@flinkbot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@flink.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [flink] flinkbot edited a comment on pull request #17541: [FLINK-24189] Perform buffer debloating per single gate

Posted by GitBox <gi...@apache.org>.
flinkbot edited a comment on pull request #17541:
URL: https://github.com/apache/flink/pull/17541#issuecomment-948765818


   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "9a4f892294645741be037fc2daf930e7a437929f",
       "status" : "PENDING",
       "url" : "https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=25335",
       "triggerID" : "9a4f892294645741be037fc2daf930e7a437929f",
       "triggerType" : "PUSH"
     } ]
   }-->
   ## CI report:
   
   * 9a4f892294645741be037fc2daf930e7a437929f Azure: [PENDING](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=25335) 
   
   <details>
   <summary>Bot commands</summary>
     The @flinkbot bot supports the following commands:
   
    - `@flinkbot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@flink.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [flink] flinkbot edited a comment on pull request #17541: [FLINK-24189] Perform buffer debloating per single gate

Posted by GitBox <gi...@apache.org>.
flinkbot edited a comment on pull request #17541:
URL: https://github.com/apache/flink/pull/17541#issuecomment-948765818


   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "9a4f892294645741be037fc2daf930e7a437929f",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=25335",
       "triggerID" : "9a4f892294645741be037fc2daf930e7a437929f",
       "triggerType" : "PUSH"
     }, {
       "hash" : "7ca4c5fe0f72aa6b232dbf18b6b1c0e7291e30aa",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=25337",
       "triggerID" : "7ca4c5fe0f72aa6b232dbf18b6b1c0e7291e30aa",
       "triggerType" : "PUSH"
     }, {
       "hash" : "139a005b569486e13783d67b7da1d4b82dcf5d16",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=25353",
       "triggerID" : "139a005b569486e13783d67b7da1d4b82dcf5d16",
       "triggerType" : "PUSH"
     }, {
       "hash" : "e39429176d84272811882833354f775e0c5d10b0",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=25359",
       "triggerID" : "e39429176d84272811882833354f775e0c5d10b0",
       "triggerType" : "PUSH"
     }, {
       "hash" : "d53cab3a2b923885e421d0fa8a5de9dac47d75bd",
       "status" : "SUCCESS",
       "url" : "https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=25724",
       "triggerID" : "d53cab3a2b923885e421d0fa8a5de9dac47d75bd",
       "triggerType" : "PUSH"
     }, {
       "hash" : "bc2203eaab919b4df93f2efd951e757c847a6c72",
       "status" : "PENDING",
       "url" : "https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=25752",
       "triggerID" : "bc2203eaab919b4df93f2efd951e757c847a6c72",
       "triggerType" : "PUSH"
     } ]
   }-->
   ## CI report:
   
   * d53cab3a2b923885e421d0fa8a5de9dac47d75bd Azure: [SUCCESS](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=25724) 
   * bc2203eaab919b4df93f2efd951e757c847a6c72 Azure: [PENDING](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=25752) 
   
   <details>
   <summary>Bot commands</summary>
     The @flinkbot bot supports the following commands:
   
    - `@flinkbot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@flink.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [flink] flinkbot edited a comment on pull request #17541: [FLINK-24189] Perform buffer debloating per single gate

Posted by GitBox <gi...@apache.org>.
flinkbot edited a comment on pull request #17541:
URL: https://github.com/apache/flink/pull/17541#issuecomment-948765818


   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "9a4f892294645741be037fc2daf930e7a437929f",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=25335",
       "triggerID" : "9a4f892294645741be037fc2daf930e7a437929f",
       "triggerType" : "PUSH"
     }, {
       "hash" : "7ca4c5fe0f72aa6b232dbf18b6b1c0e7291e30aa",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=25337",
       "triggerID" : "7ca4c5fe0f72aa6b232dbf18b6b1c0e7291e30aa",
       "triggerType" : "PUSH"
     }, {
       "hash" : "139a005b569486e13783d67b7da1d4b82dcf5d16",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=25353",
       "triggerID" : "139a005b569486e13783d67b7da1d4b82dcf5d16",
       "triggerType" : "PUSH"
     }, {
       "hash" : "e39429176d84272811882833354f775e0c5d10b0",
       "status" : "SUCCESS",
       "url" : "https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=25359",
       "triggerID" : "e39429176d84272811882833354f775e0c5d10b0",
       "triggerType" : "PUSH"
     }, {
       "hash" : "d53cab3a2b923885e421d0fa8a5de9dac47d75bd",
       "status" : "PENDING",
       "url" : "https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=25724",
       "triggerID" : "d53cab3a2b923885e421d0fa8a5de9dac47d75bd",
       "triggerType" : "PUSH"
     } ]
   }-->
   ## CI report:
   
   * e39429176d84272811882833354f775e0c5d10b0 Azure: [SUCCESS](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=25359) 
   * d53cab3a2b923885e421d0fa8a5de9dac47d75bd Azure: [PENDING](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=25724) 
   
   <details>
   <summary>Bot commands</summary>
     The @flinkbot bot supports the following commands:
   
    - `@flinkbot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@flink.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [flink] flinkbot edited a comment on pull request #17541: [FLINK-24189] Perform buffer debloating per single gate

Posted by GitBox <gi...@apache.org>.
flinkbot edited a comment on pull request #17541:
URL: https://github.com/apache/flink/pull/17541#issuecomment-948765818


   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "9a4f892294645741be037fc2daf930e7a437929f",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=25335",
       "triggerID" : "9a4f892294645741be037fc2daf930e7a437929f",
       "triggerType" : "PUSH"
     }, {
       "hash" : "7ca4c5fe0f72aa6b232dbf18b6b1c0e7291e30aa",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=25337",
       "triggerID" : "7ca4c5fe0f72aa6b232dbf18b6b1c0e7291e30aa",
       "triggerType" : "PUSH"
     }, {
       "hash" : "139a005b569486e13783d67b7da1d4b82dcf5d16",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=25353",
       "triggerID" : "139a005b569486e13783d67b7da1d4b82dcf5d16",
       "triggerType" : "PUSH"
     }, {
       "hash" : "e39429176d84272811882833354f775e0c5d10b0",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=25359",
       "triggerID" : "e39429176d84272811882833354f775e0c5d10b0",
       "triggerType" : "PUSH"
     }, {
       "hash" : "d53cab3a2b923885e421d0fa8a5de9dac47d75bd",
       "status" : "SUCCESS",
       "url" : "https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=25724",
       "triggerID" : "d53cab3a2b923885e421d0fa8a5de9dac47d75bd",
       "triggerType" : "PUSH"
     } ]
   }-->
   ## CI report:
   
   * d53cab3a2b923885e421d0fa8a5de9dac47d75bd Azure: [SUCCESS](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=25724) 
   
   <details>
   <summary>Bot commands</summary>
     The @flinkbot bot supports the following commands:
   
    - `@flinkbot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@flink.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [flink] akalash commented on a change in pull request #17541: [FLINK-24189] Perform buffer debloating per single gate

Posted by GitBox <gi...@apache.org>.
akalash commented on a change in pull request #17541:
URL: https://github.com/apache/flink/pull/17541#discussion_r739087076



##########
File path: flink-runtime/src/main/java/org/apache/flink/runtime/io/network/metrics/TimeToConsumeGauge.java
##########
@@ -0,0 +1,42 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one
+ * or more contributor license agreements.  See the NOTICE file
+ * distributed with this work for additional information
+ * regarding copyright ownership.  The ASF licenses this file
+ * to you under the Apache License, Version 2.0 (the
+ * "License"); you may not use this file except in compliance
+ * with the License.  You may obtain a copy of the License at
+ *
+ *     http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.flink.runtime.io.network.metrics;
+
+import org.apache.flink.metrics.Gauge;
+import org.apache.flink.runtime.io.network.partition.consumer.SingleInputGate;
+
+/** Gauge metric measuring the maximal time to consume all buffers of all input gates. */
+public class TimeToConsumeGauge implements Gauge<Long> {
+
+    private final SingleInputGate[] gates;
+
+    public TimeToConsumeGauge(SingleInputGate[] gates) {
+        this.gates = gates;
+    }
+
+    @Override
+    public Long getValue() {
+        long result = Long.MIN_VALUE;
+        for (SingleInputGate gate : gates) {
+            result = Math.max(gate.getLastEstimatedTimeToConsume().toMillis(), result);

Review comment:
       Why is it max but not sum?

##########
File path: flink-runtime/src/main/java/org/apache/flink/runtime/throughput/BufferDebloatConfiguration.java
##########
@@ -0,0 +1,105 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one
+ * or more contributor license agreements.  See the NOTICE file
+ * distributed with this work for additional information
+ * regarding copyright ownership.  The ASF licenses this file
+ * to you under the Apache License, Version 2.0 (the
+ * "License"); you may not use this file except in compliance
+ * with the License.  You may obtain a copy of the License at
+ *
+ *     http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.flink.runtime.throughput;
+
+import org.apache.flink.configuration.ReadableConfig;
+import org.apache.flink.configuration.TaskManagerOptions;
+
+import java.time.Duration;
+
+import static org.apache.flink.configuration.TaskManagerOptions.BUFFER_DEBLOAT_SAMPLES;
+import static org.apache.flink.configuration.TaskManagerOptions.BUFFER_DEBLOAT_TARGET;
+import static org.apache.flink.configuration.TaskManagerOptions.BUFFER_DEBLOAT_THRESHOLD_PERCENTAGES;
+import static org.apache.flink.util.Preconditions.checkArgument;
+import static org.apache.flink.util.Preconditions.checkNotNull;
+
+/** Configuration for {@link BufferDebloater}. */
+public final class BufferDebloatConfiguration {

Review comment:
       Maybe it makes sense to extract all things related to BufferDebloatConfiguration to separate commit because it is not directly connected to your changes and it will be easy to understand the major change?




-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@flink.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [flink] dawidwys commented on pull request #17541: [FLINK-24189] Perform buffer debloating per single gate

Posted by GitBox <gi...@apache.org>.
dawidwys commented on pull request #17541:
URL: https://github.com/apache/flink/pull/17541#issuecomment-958721163


   @flinkbot run azure


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@flink.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [flink] flinkbot edited a comment on pull request #17541: [FLINK-24189] Perform buffer debloating per single gate

Posted by GitBox <gi...@apache.org>.
flinkbot edited a comment on pull request #17541:
URL: https://github.com/apache/flink/pull/17541#issuecomment-948765818


   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "9a4f892294645741be037fc2daf930e7a437929f",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=25335",
       "triggerID" : "9a4f892294645741be037fc2daf930e7a437929f",
       "triggerType" : "PUSH"
     }, {
       "hash" : "7ca4c5fe0f72aa6b232dbf18b6b1c0e7291e30aa",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=25337",
       "triggerID" : "7ca4c5fe0f72aa6b232dbf18b6b1c0e7291e30aa",
       "triggerType" : "PUSH"
     }, {
       "hash" : "139a005b569486e13783d67b7da1d4b82dcf5d16",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=25353",
       "triggerID" : "139a005b569486e13783d67b7da1d4b82dcf5d16",
       "triggerType" : "PUSH"
     }, {
       "hash" : "e39429176d84272811882833354f775e0c5d10b0",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=25359",
       "triggerID" : "e39429176d84272811882833354f775e0c5d10b0",
       "triggerType" : "PUSH"
     }, {
       "hash" : "d53cab3a2b923885e421d0fa8a5de9dac47d75bd",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=25724",
       "triggerID" : "d53cab3a2b923885e421d0fa8a5de9dac47d75bd",
       "triggerType" : "PUSH"
     }, {
       "hash" : "bc2203eaab919b4df93f2efd951e757c847a6c72",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=25752",
       "triggerID" : "bc2203eaab919b4df93f2efd951e757c847a6c72",
       "triggerType" : "PUSH"
     }, {
       "hash" : "9b84d08ded8b9bb26c497dd0b541a4c2c01bde4c",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=25761",
       "triggerID" : "9b84d08ded8b9bb26c497dd0b541a4c2c01bde4c",
       "triggerType" : "PUSH"
     }, {
       "hash" : "f43d31bf75a76df316a986e2afab6fcc550c9f80",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=25776",
       "triggerID" : "f43d31bf75a76df316a986e2afab6fcc550c9f80",
       "triggerType" : "PUSH"
     }, {
       "hash" : "f43d31bf75a76df316a986e2afab6fcc550c9f80",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=25776",
       "triggerID" : "957321556",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "9b84d08ded8b9bb26c497dd0b541a4c2c01bde4c",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=25761",
       "triggerID" : "957321556",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "9b84d08ded8b9bb26c497dd0b541a4c2c01bde4c",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=25761",
       "triggerID" : "957723927",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "f43d31bf75a76df316a986e2afab6fcc550c9f80",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=25776",
       "triggerID" : "957723927",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "e3c0e6252742d042dcc093f5dea7cb5ec40faad3",
       "status" : "PENDING",
       "url" : "https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=25813",
       "triggerID" : "e3c0e6252742d042dcc093f5dea7cb5ec40faad3",
       "triggerType" : "PUSH"
     }, {
       "hash" : "e3c0e6252742d042dcc093f5dea7cb5ec40faad3",
       "status" : "PENDING",
       "url" : "https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=25813",
       "triggerID" : "958721163",
       "triggerType" : "MANUAL"
     } ]
   }-->
   ## CI report:
   
   * e3c0e6252742d042dcc093f5dea7cb5ec40faad3 Azure: [PENDING](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=25813) 
   
   <details>
   <summary>Bot commands</summary>
     The @flinkbot bot supports the following commands:
   
    - `@flinkbot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@flink.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [flink] dawidwys merged pull request #17541: [FLINK-24189] Perform buffer debloating per single gate

Posted by GitBox <gi...@apache.org>.
dawidwys merged pull request #17541:
URL: https://github.com/apache/flink/pull/17541






-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@flink.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [flink] flinkbot edited a comment on pull request #17541: [FLINK-24189] Perform buffer debloating per single gate

Posted by GitBox <gi...@apache.org>.
flinkbot edited a comment on pull request #17541:
URL: https://github.com/apache/flink/pull/17541#issuecomment-948765818


   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "9a4f892294645741be037fc2daf930e7a437929f",
       "status" : "PENDING",
       "url" : "https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=25335",
       "triggerID" : "9a4f892294645741be037fc2daf930e7a437929f",
       "triggerType" : "PUSH"
     }, {
       "hash" : "7ca4c5fe0f72aa6b232dbf18b6b1c0e7291e30aa",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "7ca4c5fe0f72aa6b232dbf18b6b1c0e7291e30aa",
       "triggerType" : "PUSH"
     } ]
   }-->
   ## CI report:
   
   * 9a4f892294645741be037fc2daf930e7a437929f Azure: [PENDING](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=25335) 
   * 7ca4c5fe0f72aa6b232dbf18b6b1c0e7291e30aa UNKNOWN
   
   <details>
   <summary>Bot commands</summary>
     The @flinkbot bot supports the following commands:
   
    - `@flinkbot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@flink.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [flink] flinkbot edited a comment on pull request #17541: [FLINK-24189] Perform buffer debloating per single gate

Posted by GitBox <gi...@apache.org>.
flinkbot edited a comment on pull request #17541:
URL: https://github.com/apache/flink/pull/17541#issuecomment-948765818


   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "9a4f892294645741be037fc2daf930e7a437929f",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=25335",
       "triggerID" : "9a4f892294645741be037fc2daf930e7a437929f",
       "triggerType" : "PUSH"
     }, {
       "hash" : "7ca4c5fe0f72aa6b232dbf18b6b1c0e7291e30aa",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=25337",
       "triggerID" : "7ca4c5fe0f72aa6b232dbf18b6b1c0e7291e30aa",
       "triggerType" : "PUSH"
     }, {
       "hash" : "139a005b569486e13783d67b7da1d4b82dcf5d16",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=25353",
       "triggerID" : "139a005b569486e13783d67b7da1d4b82dcf5d16",
       "triggerType" : "PUSH"
     }, {
       "hash" : "e39429176d84272811882833354f775e0c5d10b0",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=25359",
       "triggerID" : "e39429176d84272811882833354f775e0c5d10b0",
       "triggerType" : "PUSH"
     }, {
       "hash" : "d53cab3a2b923885e421d0fa8a5de9dac47d75bd",
       "status" : "SUCCESS",
       "url" : "https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=25724",
       "triggerID" : "d53cab3a2b923885e421d0fa8a5de9dac47d75bd",
       "triggerType" : "PUSH"
     }, {
       "hash" : "bc2203eaab919b4df93f2efd951e757c847a6c72",
       "status" : "PENDING",
       "url" : "https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=25752",
       "triggerID" : "bc2203eaab919b4df93f2efd951e757c847a6c72",
       "triggerType" : "PUSH"
     }, {
       "hash" : "9b84d08ded8b9bb26c497dd0b541a4c2c01bde4c",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "9b84d08ded8b9bb26c497dd0b541a4c2c01bde4c",
       "triggerType" : "PUSH"
     } ]
   }-->
   ## CI report:
   
   * d53cab3a2b923885e421d0fa8a5de9dac47d75bd Azure: [SUCCESS](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=25724) 
   * bc2203eaab919b4df93f2efd951e757c847a6c72 Azure: [PENDING](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=25752) 
   * 9b84d08ded8b9bb26c497dd0b541a4c2c01bde4c UNKNOWN
   
   <details>
   <summary>Bot commands</summary>
     The @flinkbot bot supports the following commands:
   
    - `@flinkbot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@flink.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [flink] flinkbot edited a comment on pull request #17541: [FLINK-24189] Perform buffer debloating per single gate

Posted by GitBox <gi...@apache.org>.
flinkbot edited a comment on pull request #17541:
URL: https://github.com/apache/flink/pull/17541#issuecomment-948765818






-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@flink.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [flink] flinkbot edited a comment on pull request #17541: [FLINK-24189] Perform buffer debloating per single gate

Posted by GitBox <gi...@apache.org>.
flinkbot edited a comment on pull request #17541:
URL: https://github.com/apache/flink/pull/17541#issuecomment-948765818


   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "9a4f892294645741be037fc2daf930e7a437929f",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=25335",
       "triggerID" : "9a4f892294645741be037fc2daf930e7a437929f",
       "triggerType" : "PUSH"
     }, {
       "hash" : "7ca4c5fe0f72aa6b232dbf18b6b1c0e7291e30aa",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=25337",
       "triggerID" : "7ca4c5fe0f72aa6b232dbf18b6b1c0e7291e30aa",
       "triggerType" : "PUSH"
     }, {
       "hash" : "139a005b569486e13783d67b7da1d4b82dcf5d16",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=25353",
       "triggerID" : "139a005b569486e13783d67b7da1d4b82dcf5d16",
       "triggerType" : "PUSH"
     }, {
       "hash" : "e39429176d84272811882833354f775e0c5d10b0",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=25359",
       "triggerID" : "e39429176d84272811882833354f775e0c5d10b0",
       "triggerType" : "PUSH"
     }, {
       "hash" : "d53cab3a2b923885e421d0fa8a5de9dac47d75bd",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=25724",
       "triggerID" : "d53cab3a2b923885e421d0fa8a5de9dac47d75bd",
       "triggerType" : "PUSH"
     }, {
       "hash" : "bc2203eaab919b4df93f2efd951e757c847a6c72",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=25752",
       "triggerID" : "bc2203eaab919b4df93f2efd951e757c847a6c72",
       "triggerType" : "PUSH"
     }, {
       "hash" : "9b84d08ded8b9bb26c497dd0b541a4c2c01bde4c",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=25761",
       "triggerID" : "9b84d08ded8b9bb26c497dd0b541a4c2c01bde4c",
       "triggerType" : "PUSH"
     }, {
       "hash" : "f43d31bf75a76df316a986e2afab6fcc550c9f80",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=25776",
       "triggerID" : "f43d31bf75a76df316a986e2afab6fcc550c9f80",
       "triggerType" : "PUSH"
     }, {
       "hash" : "f43d31bf75a76df316a986e2afab6fcc550c9f80",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=25776",
       "triggerID" : "957321556",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "9b84d08ded8b9bb26c497dd0b541a4c2c01bde4c",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=25761",
       "triggerID" : "957321556",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "9b84d08ded8b9bb26c497dd0b541a4c2c01bde4c",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=25761",
       "triggerID" : "957723927",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "f43d31bf75a76df316a986e2afab6fcc550c9f80",
       "status" : "CANCELED",
       "url" : "https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=25776",
       "triggerID" : "957723927",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "e3c0e6252742d042dcc093f5dea7cb5ec40faad3",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "e3c0e6252742d042dcc093f5dea7cb5ec40faad3",
       "triggerType" : "PUSH"
     } ]
   }-->
   ## CI report:
   
   * f43d31bf75a76df316a986e2afab6fcc550c9f80 Azure: [CANCELED](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=25776) 
   * e3c0e6252742d042dcc093f5dea7cb5ec40faad3 UNKNOWN
   
   <details>
   <summary>Bot commands</summary>
     The @flinkbot bot supports the following commands:
   
    - `@flinkbot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@flink.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [flink] dawidwys merged pull request #17541: [FLINK-24189] Perform buffer debloating per single gate

Posted by GitBox <gi...@apache.org>.
dawidwys merged pull request #17541:
URL: https://github.com/apache/flink/pull/17541


   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@flink.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [flink] flinkbot edited a comment on pull request #17541: [FLINK-24189] Perform buffer debloating per single gate

Posted by GitBox <gi...@apache.org>.
flinkbot edited a comment on pull request #17541:
URL: https://github.com/apache/flink/pull/17541#issuecomment-948765818






-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@flink.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [flink] flinkbot edited a comment on pull request #17541: [FLINK-24189] Perform buffer debloating per single gate

Posted by GitBox <gi...@apache.org>.
flinkbot edited a comment on pull request #17541:
URL: https://github.com/apache/flink/pull/17541#issuecomment-948765818






-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@flink.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org