[jira] [Created] (GEODE-8230) cut pipeline time from 10hrs to 5hrs by running benchmarks in parallel with other tests

["Owen Nichols (Jira)" <ji...@apache.org>]

Owen Nichols created GEODE-8230:
-----------------------------------

             Summary: cut pipeline time from 10hrs to 5hrs by running benchmarks in parallel with other tests
                 Key: GEODE-8230
                 URL: https://issues.apache.org/jira/browse/GEODE-8230
             Project: Geode
          Issue Type: Improvement
          Components: ci
            Reporter: Owen Nichols


currently, we run Build, then all <x>Test jobs in parallel (which takes ~5 hours), then all Benchmark<x> jobs (which takes ~5 hours).

Presumably the benchmarks were run after all tests, on the premise that benchmarks are meaningless if the code is not correct.  However, required PR checks now prevent incorrect code from getting into develop in the first place, and the remaining occasional failures are flaky, so it's rather arbitrary to gate benchmarks on a lottery.

However, faster feedback has clear benefits, and cutting our CI pipeline from 10 hours to 5 hours seems like low-hanging fruit.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)