[jira] [Created] (FLINK-25480) Create dashboard/monitoring to see resource usage per E2E test

["Martijn Visser (Jira)" <ji...@apache.org>]

Martijn Visser created FLINK-25480:
--------------------------------------

             Summary: Create dashboard/monitoring to see resource usage per E2E test
                 Key: FLINK-25480
                 URL: https://issues.apache.org/jira/browse/FLINK-25480
             Project: Flink
          Issue Type: Improvement
          Components: Test Infrastructure
    Affects Versions: 1.15.0, 1.13.6, 1.14.3
            Reporter: Martijn Visser
             Fix For: 1.15.0, 1.13.6, 1.14.3


Over the past couple of weeks, we've encountered multiple problems with tests failing due to out-of-memory errors and/or exit code 137 happening. These are happening both on Alibaba CI machines, as well as Azure hosted agents. For the Alibaba CI machines, we've mitigated the problem by reducing the number of workers per CI machine from 7 to 5. These workers can spin up multiple Docker containers, especially with Testcontainers getting used more and more. 

If we can get insights in the resource usage per end-to-end test, it will also help in debugging test infrastructure problems more quickly. 



--
This message was sent by Atlassian Jira
(v8.20.1#820001)