You are viewing a plain text version of this content. The canonical link for it is here.
Posted to github@beam.apache.org by GitBox <gi...@apache.org> on 2022/06/04 21:34:56 UTC
[GitHub] [beam] damccorm opened a new issue, #21094: Flink Go XVR tests fail on TestXLang_Multi: Insufficient number of network buffers
damccorm opened a new issue, #21094:
URL: https://github.com/apache/beam/issues/21094
When running the cross-language test suites () Flink fails on TestXLang_Multi with the following error:
```
19:29:14 2021/08/27 02:29:14 (): java.io.IOException: Insufficient number of network buffers: required
17, but only 16 available. The total number of network buffers is currently set to 2048 of 32768 bytes
each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction',
'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
19:29:14 2021/08/27 02:29:14
Job state: FAILED
19:29:14 --- FAIL: TestXLang_Multi (6.26s)
```
This doesn't seem to be a parallelism problem (go test is run with "-p 1" as expected) and is only happening on this specific test.
Imported from Jira [BEAM-12815](https://issues.apache.org/jira/browse/BEAM-12815). Original Jira may contain additional context.
Reported by: danoliveira.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@beam.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [beam] lukecwik commented on issue #21094: Flink Go XVR tests fail on TestXLang_Multi: Insufficient number of network buffers
Posted by GitBox <gi...@apache.org>.
lukecwik commented on issue #21094:
URL: https://github.com/apache/beam/issues/21094#issuecomment-1317776044
It fails on other flink [XLang tests](https://ci-beam.apache.org/job/beam_PostCommit_XVR_Flink/6134/consoleFull):
```
02:32:22 Caused by: java.io.IOException: Insufficient number of network buffers: required 16, but only 10 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
02:32:22 at org.apache.flink.runtime.io.network.buffer.NetworkBufferPool.internalCreateBufferPool(NetworkBufferPool.java:483)
02:32:22 at org.apache.flink.runtime.io.network.buffer.NetworkBufferPool.createBufferPool(NetworkBufferPool.java:461)
02:32:22 at org.apache.flink.runtime.io.network.partition.ResultPartitionFactory.lambda$createBufferPoolFactory$0(ResultPartitionFactory.java:279)
02:32:22 at org.apache.flink.runtime.io.network.partition.ResultPartition.setup(ResultPartition.java:160)
02:32:22 at org.apache.flink.runtime.io.network.partition.SortMergeResultPartition.setup(SortMergeResultPartition.java:190)
02:32:22 at org.apache.flink.runtime.taskmanager.Task.setupPartitionsAndGates(Task.java:959)
02:32:22 at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:652)
02:32:22 at org.apache.flink.runtime.taskmanager.Task.run(Task.java:563)
02:32:22 at java.lang.Thread.run(Thread.java:750)
02:32:22 2022/11/15 10:32:22 (): java.io.IOException: Insufficient number of network buffers: required 16, but only 10 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
02:32:22 2022/11/15 10:32:22 Job state: FAILED
02:32:22 ptest.go:108: Failed to execute job: job go0testxlang0partition0705-jenkins-1115103209-155225b7_dbefca6f-b4ba-44ad-8304-8266dad6660c failed
02:32:22 --- FAIL: TestXLang_Partition (16.33s)
02:32:22 FAIL
02:32:22 FAIL github.com/apache/beam/sdks/v2/go/test/integration/xlang 92.103s
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@beam.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [beam] Abacn commented on issue #21094: Flink Go XVR tests fail on TestXLang_Multi: Insufficient number of network buffers
Posted by GitBox <gi...@apache.org>.
Abacn commented on issue #21094:
URL: https://github.com/apache/beam/issues/21094#issuecomment-1317260834
Note that TestXLang_Multi is skipped that is why it was not seen
```
05:29:50 === RUN TestXLang_Multi
05:29:50 integration.go:309: Test TestXLang_Multi is currently filtered for runner flink
05:29:50 --- SKIP: TestXLang_Multi (0.00s)
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@beam.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [beam] Abacn commented on issue #21094: Flink Go XVR tests fail on TestXLang_Multi: Insufficient number of network buffers
Posted by GitBox <gi...@apache.org>.
Abacn commented on issue #21094:
URL: https://github.com/apache/beam/issues/21094#issuecomment-1317256404
It happens again after switched to use Flink 1.15 for testing and being permared:
Task :runners:flink:1.15:job-server:validatesCrossLanguageRunnerGoUsingJava FAILED
```
05:30:04 Caused by: java.io.IOException: Insufficient number of network buffers: required 17, but only 0 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
05:30:04 at org.apache.flink.runtime.io.network.buffer.NetworkBufferPool.internalCreateBufferPool(NetworkBufferPool.java:483)
05:30:04 at org.apache.flink.runtime.io.network.buffer.NetworkBufferPool.createBufferPool(NetworkBufferPool.java:461)
05:30:04 at org.apache.flink.runtime.io.network.partition.ResultPartitionFactory.lambda$createBufferPoolFactory$0(ResultPartitionFactory.java:279)
05:30:04 at org.apache.flink.runtime.io.network.partition.ResultPartition.setup(ResultPartition.java:160)
05:30:04 at org.apache.flink.runtime.io.network.partition.BufferWritingResultPartition.setup(BufferWritingResultPartition.java:97)
05:30:04 at org.apache.flink.runtime.taskmanager.Task.setupPartitionsAndGates(Task.java:959)
05:30:04 at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:652)
05:30:04 at org.apache.flink.runtime.taskmanager.Task.run(Task.java:563)
05:30:04 at java.lang.Thread.run(Thread.java:750)
05:30:04 2022/11/16 10:30:03 (): java.io.IOException: Insufficient number of network buffers: required 17, but only 0 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
05:30:04 2022/11/16 10:30:03 Job state: FAILED
05:30:04 ptest.go:108: Failed to execute job: job go0testxlang0partition0717-jenkins-1116102953-b57d468_c2e367a3-5ff1-4ff6-a475-1faea47d2c99 failed
05:30:04 --- FAIL: TestXLang_Partition (13.36s)
05:30:04 FAIL
05:30:04 FAIL github.com/apache/beam/sdks/v2/go/test/integration/xlang 82.614s
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@beam.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [beam] damccorm commented on issue #21094: Flink Go XVR tests fail on TestXLang_...: Insufficient number of network buffers
Posted by GitBox <gi...@apache.org>.
damccorm commented on issue #21094:
URL: https://github.com/apache/beam/issues/21094#issuecomment-1320258907
This should be generally fixed by https://github.com/apache/beam/pull/24228 - there's a few cleanup items left though so I'll leave this open
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@beam.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org