(pulsar) branch lh-dispatcher-lockfree-flow-master updated (e3a6f09209ea -> 3754d1e860a3)

[lh...@apache.org]

This is an automated email from the ASF dual-hosted git repository.

lhotari pushed a change to branch lh-dispatcher-lockfree-flow-master
in repository https://gitbox.apache.org/repos/asf/pulsar.git


 discard e3a6f09209ea [improve][broker] Apply Shared and Key_Shared Flow permits without the dispatcher monitor
 discard a7c8d6a176d6 [improve][ml] Drain each add entry handover batch into a local list before running it
 discard 710538d45b49 [improve][ml] Rename managedLedgerMaxAddEntryHandoverBatchSize to managedLedgerAddEntryHandoverMaxBatchSize
 discard e30b242b55cd [improve][ml] Rename managedLedgerMaxAddBatchSize to managedLedgerMaxAddEntryHandoverBatchSize
 discard bd31998eb505 [improve][ml] Make the maximum add batch size configurable with managedLedgerMaxAddBatchSize
 discard 2b630eb28397 [improve][ml] Create the add batch queue lazily and name it for what it does
 discard 69456a4d93f4 [improve][ml] Hand off adds to the managed-ledger executor through an MPSC queue
 discard 745d7e06e35b [improve][test] Keep the Key_Shared 500x20 scenario saturating after the high-rate scenario got a rate limit
 discard 67598923a189 [improve][test] Move the Key_Shared 500x20 scenarios to the restructured scenario settings
 discard 2124c564869a [improve][test] Name the Key_Shared 500x20 runs after their scenario files
 discard 485f73156487 [improve][test] Add a launcher scenario for 500 producers and a 20-member Key_Shared subscription
     add e06bbda0dbb4 [improve][test] Collect the performance tests' Pulsar metrics into VictoriaMetrics and show them on Grafana's Pulsar dashboards
     add 4f9168008bcb [fix][test] Address a review of the performance tests' profiling, heap dumps, sampling and metrics stack
     add 094297dbe852 [improve][test] Add a launcher scenario for 500 producers and a 20-member Key_Shared subscription
     add 20e33ad264d6 [improve][test] Name the Key_Shared 500x20 runs after their scenario files
     add 963b755b7713 [improve][test] Move the Key_Shared 500x20 scenarios to the restructured scenario settings
     add dfb674dd80f3 [improve][test] Keep the Key_Shared 500x20 scenario saturating after the high-rate scenario got a rate limit
     add bcfa15a66652 [improve][ml] Hand off adds to the managed-ledger executor through an MPSC queue
     add 6c890a4d1bbf [improve][ml] Create the add batch queue lazily and name it for what it does
     add a72d93308cd2 [improve][ml] Make the maximum add batch size configurable with managedLedgerMaxAddBatchSize
     add 30242e7b2ad4 [improve][ml] Rename managedLedgerMaxAddBatchSize to managedLedgerMaxAddEntryHandoverBatchSize
     add b4b7f2d24c62 [improve][ml] Rename managedLedgerMaxAddEntryHandoverBatchSize to managedLedgerAddEntryHandoverMaxBatchSize
     add d7fe05346c4f [improve][ml] Drain each add entry handover batch into a local list before running it
     add 3754d1e860a3 [improve][broker] Apply Shared and Key_Shared Flow permits without the dispatcher monitor

This update added new revisions after undoing existing revisions.
That is to say, some revisions that were in the old version of the
branch are not in the new version.  This situation occurs
when a user --force pushes a change and generates a repository
containing something like this:

 * -- * -- B -- O -- O -- O   (e3a6f09209ea)
            \
             N -- N -- N   refs/heads/lh-dispatcher-lockfree-flow-master (3754d1e860a3)

You should already have received notification emails for all of the O
revisions, and so the following emails describe only the N revisions
from the common base, B.

Any revisions marked "omit" are not gone; other references still
refer to them.  Any revisions marked "discard" are gone forever.

No new revisions were added by this update.

Summary of changes:
 settings.gradle.kts                                |   2 +
 .../integration/profiling/JonoffcpuAgent.java      |   8 +-
 tests/performance/AGENTS.md                        |  13 +-
 tests/performance/README.md                        |  16 ++
 tests/performance/docs/heap-dumps.md               |   6 +-
 tests/performance/docs/metrics.md                  | 222 +++++++++++++++
 tests/performance/docs/run-reports.md              |   7 +
 tests/performance/docs/running-scenarios.md        |   2 +
 tests/performance/launcher/build.gradle.kts        |  10 +
 .../tests/performance/launcher/HeapDumper.java     |  42 ++-
 .../performance/launcher/MetricsCollection.java    | 299 +++++++++++++++++++++
 .../performance/launcher/MetricsSettings.java      | 110 ++++++++
 .../performance/launcher/PerformanceLauncher.java  | 100 ++++++-
 .../performance/launcher/TopicStatsSampler.java    |  75 +++++-
 .../performance/launcher/WorkloadStartup.java      |  63 +++--
 .../performance/launcher/HeapDumpSettingsTest.java |  13 +-
 .../tests/performance/launcher/HeapDumperTest.java |  31 +++
 .../performance/launcher/MetricsSettingsTest.java  |  74 +++++
 .../performance/launcher/WorkloadStartupTest.java  |  21 ++
 tests/performance/metrics/build.gradle.kts         |  70 +++++
 tests/performance/metrics/compose.yaml             | 111 ++++++++
 .../grafana/provisioning/dashboards/pulsar.yaml    |  19 +-
 .../provisioning/datasources/victoriametrics.yaml  |  23 +-
 tests/performance/metrics/grafana/setup.sh         |  72 +++++
 .../pulsar/tests/performance/metrics/Grafana.java  | 109 ++++++++
 .../tests/performance/metrics/GrafanaApi.java      | 104 +++++++
 .../tests/performance/metrics/MetricsCommand.java  | 102 +++++++
 .../tests/performance/metrics/MetricsStack.java    | 205 ++++++++++++++
 .../tests/performance/metrics/RunScrape.java       | 109 ++++++++
 .../tests/performance/metrics/ScrapeConfig.java    |  91 +++++++
 .../tests/performance/metrics}/package-info.java   |   3 +-
 .../performance/metrics/ScrapeConfigTest.java      |  96 +++++++
 .../metrics/victoriametrics/scrape.yaml            |  16 +-
 .../tests/performance/report/ReportsUrl.java       |   3 +-
 .../pulsar/tests/performance/report/RunReport.java |  54 +++-
 .../tests/performance/report/RunReportTest.java    |  47 ++++
 tests/performance/scenarios/docs/iot-telemetry.md  |   3 +-
 .../performance/scenarios/docs/scenario-format.md  |   2 +
 .../performance/scenarios/iot-telemetry-base.yaml  |   4 +
 39 files changed, 2254 insertions(+), 103 deletions(-)
 create mode 100644 tests/performance/docs/metrics.md
 create mode 100644 tests/performance/launcher/src/main/java/org/apache/pulsar/tests/performance/launcher/MetricsCollection.java
 create mode 100644 tests/performance/launcher/src/main/java/org/apache/pulsar/tests/performance/launcher/MetricsSettings.java
 create mode 100644 tests/performance/launcher/src/test/java/org/apache/pulsar/tests/performance/launcher/MetricsSettingsTest.java
 create mode 100644 tests/performance/metrics/build.gradle.kts
 create mode 100644 tests/performance/metrics/compose.yaml
 copy deployment/terraform-ansible/aws/ansible.cfg => tests/performance/metrics/grafana/provisioning/dashboards/pulsar.yaml (75%)
 copy .github/actions/copy-test-reports/action.yml => tests/performance/metrics/grafana/provisioning/datasources/victoriametrics.yaml (67%)
 create mode 100755 tests/performance/metrics/grafana/setup.sh
 create mode 100644 tests/performance/metrics/src/main/java/org/apache/pulsar/tests/performance/metrics/Grafana.java
 create mode 100644 tests/performance/metrics/src/main/java/org/apache/pulsar/tests/performance/metrics/GrafanaApi.java
 create mode 100644 tests/performance/metrics/src/main/java/org/apache/pulsar/tests/performance/metrics/MetricsCommand.java
 create mode 100644 tests/performance/metrics/src/main/java/org/apache/pulsar/tests/performance/metrics/MetricsStack.java
 create mode 100644 tests/performance/metrics/src/main/java/org/apache/pulsar/tests/performance/metrics/RunScrape.java
 create mode 100644 tests/performance/metrics/src/main/java/org/apache/pulsar/tests/performance/metrics/ScrapeConfig.java
 copy {jclouds-shaded/src/main/java/org/apache/pulsar/jclouds => tests/performance/metrics/src/main/java/org/apache/pulsar/tests/performance/metrics}/package-info.java (83%)
 create mode 100644 tests/performance/metrics/src/test/java/org/apache/pulsar/tests/performance/metrics/ScrapeConfigTest.java
 copy deployment/terraform-ansible/aws/ansible.cfg => tests/performance/metrics/victoriametrics/scrape.yaml (74%)