[jira] [Created] (CAMEL-23684) BacklogTracer message history should correlate exchanges by breadcrumb ID for full end-to-end flow

["Claus Ibsen (Jira)" <ji...@apache.org>]

Claus Ibsen created CAMEL-23684:
-----------------------------------

             Summary: BacklogTracer message history should correlate exchanges by breadcrumb ID for full end-to-end flow
                 Key: CAMEL-23684
                 URL: https://issues.apache.org/jira/browse/CAMEL-23684
             Project: Camel
          Issue Type: Improvement
          Components: camel-core
            Reporter: Claus Ibsen


The BacklogTracer message history (used by the message-history dev console and camel-tui) currently captures the latest completed exchange by tracking a single exchange ID and its direct correlation IDs. This works well for exchanges that stay within a single route or use in-memory multicast with correlated sub-exchanges.

However, when routes are connected through external brokers (Kafka, SEDA, JMS, etc.) in an event-driven architecture, each consumer creates a new independent exchange with a new exchange ID. The correlation chain is broken, so the history only shows one slice of the flow rather than the full end-to-end picture.

Camel already has a mechanism to link these independent exchanges: the breadcrumb ID (CamelBreadcrumbId header). This ID is propagated through message headers across broker boundaries, effectively linking the entire flow from the initial trigger through all downstream routes.

The BacklogTracer should support grouping/correlating exchanges by breadcrumb ID to capture the full end-to-end message history across broker boundaries. This would allow the TUI history tab (and other tools) to show the complete flow, e.g.:

timer -> kafka:orders -> order-dispatcher -> multicast -> kafka:fulfillment + kafka:notifications -> fulfillment-route + notification-route

All linked by the same breadcrumb ID.

This approach is lighter weight than full OpenTelemetry tracing while still providing the complete picture for debugging and monitoring.

Affected files:
- core/camel-base-engine/src/main/java/org/apache/camel/impl/debugger/BacklogTracer.java (provisional/complete history queue logic)
- core/camel-console/src/main/java/org/apache/camel/impl/console/MessageHistoryDevConsole.java (dev console output)



--
This message was sent by Atlassian Jira
(v8.20.10#820010)