You are viewing a plain text version of this content. The canonical link for it is here.
Posted to users@kafka.apache.org by Jonathan Roy <jo...@caldera.com.INVALID> on 2018/07/19 10:22:08 UTC
Monitor the state of an event-based choreography
Hello,
We are currently studying event-driven architectures with Kafka, and one thing that scares me a bit is that we have no way to know at any moment what is the state of a business transaction that spans multiple services. Let’s consider the following simple flow:
1. the ‘orders’ service creates a ‘new order’ event.
2. the ‘validation’ service validates the order and publishes an ‘order validated’ or ‘order rejected’.
3. the ‘email’ service sends a confirmation email to the customer.
This does not directly concern Kafka but are there some tools that help visually tracking the status of any particular order, and know which part of the flow remains to be done? I know Confluent Control Center allows to monitor the Kafka topics, but I’m not aware of any tool allowing to visualize the business flows of events.
Thanks!
Jonathan Roy
Re: Monitor the state of an event-based choreography
Posted by Tony Liu <ji...@zuora.com.INVALID>.
Interested, will put some time learn about opentracing.org.
On Thu, Jul 19, 2018 at 9:34 AM, Christopher Smith <cb...@gmail.com>
wrote:
> This sounds like a pretty good use case for opentracing.org. There is some
> nice integration with Kafka now too.
>
> --Chris
>
> On Thu, Jul 19, 2018, 8:26 AM Dan Rosanova <da...@microsoft.com.invalid>
> wrote:
>
> > Are you looking more for an Actor or orchestration layer and visibility?
> I
> > don’t know of one per se, it would also be interested.
> >
> > Dan
> >
> >
> > ________________________________
> > From: Jonathan Roy <jo...@caldera.com.invalid>
> > Sent: Thursday, July 19, 2018 3:22 AM
> > To: users@kafka.apache.org
> > Subject: Monitor the state of an event-based choreography
> >
> > Hello,
> >
> > We are currently studying event-driven architectures with Kafka, and one
> > thing that scares me a bit is that we have no way to know at any moment
> > what is the state of a business transaction that spans multiple services.
> > Let’s consider the following simple flow:
> > 1. the ‘orders’ service creates a ‘new order’ event.
> > 2. the ‘validation’ service validates the order and publishes an ‘order
> > validated’ or ‘order rejected’.
> > 3. the ‘email’ service sends a confirmation email to the customer.
> >
> > This does not directly concern Kafka but are there some tools that help
> > visually tracking the status of any particular order, and know which part
> > of the flow remains to be done? I know Confluent Control Center allows to
> > monitor the Kafka topics, but I’m not aware of any tool allowing to
> > visualize the business flows of events.
> >
> > Thanks!
> >
> > Jonathan Roy
> >
>
Re: Monitor the state of an event-based choreography
Posted by Christopher Smith <cb...@gmail.com>.
This sounds like a pretty good use case for opentracing.org. There is some
nice integration with Kafka now too.
--Chris
On Thu, Jul 19, 2018, 8:26 AM Dan Rosanova <da...@microsoft.com.invalid>
wrote:
> Are you looking more for an Actor or orchestration layer and visibility? I
> don’t know of one per se, it would also be interested.
>
> Dan
>
>
> ________________________________
> From: Jonathan Roy <jo...@caldera.com.invalid>
> Sent: Thursday, July 19, 2018 3:22 AM
> To: users@kafka.apache.org
> Subject: Monitor the state of an event-based choreography
>
> Hello,
>
> We are currently studying event-driven architectures with Kafka, and one
> thing that scares me a bit is that we have no way to know at any moment
> what is the state of a business transaction that spans multiple services.
> Let’s consider the following simple flow:
> 1. the ‘orders’ service creates a ‘new order’ event.
> 2. the ‘validation’ service validates the order and publishes an ‘order
> validated’ or ‘order rejected’.
> 3. the ‘email’ service sends a confirmation email to the customer.
>
> This does not directly concern Kafka but are there some tools that help
> visually tracking the status of any particular order, and know which part
> of the flow remains to be done? I know Confluent Control Center allows to
> monitor the Kafka topics, but I’m not aware of any tool allowing to
> visualize the business flows of events.
>
> Thanks!
>
> Jonathan Roy
>
Re: Monitor the state of an event-based choreography
Posted by Dan Rosanova <da...@microsoft.com.INVALID>.
Are you looking more for an Actor or orchestration layer and visibility? I don’t know of one per se, it would also be interested.
Dan
________________________________
From: Jonathan Roy <jo...@caldera.com.invalid>
Sent: Thursday, July 19, 2018 3:22 AM
To: users@kafka.apache.org
Subject: Monitor the state of an event-based choreography
Hello,
We are currently studying event-driven architectures with Kafka, and one thing that scares me a bit is that we have no way to know at any moment what is the state of a business transaction that spans multiple services. Let’s consider the following simple flow:
1. the ‘orders’ service creates a ‘new order’ event.
2. the ‘validation’ service validates the order and publishes an ‘order validated’ or ‘order rejected’.
3. the ‘email’ service sends a confirmation email to the customer.
This does not directly concern Kafka but are there some tools that help visually tracking the status of any particular order, and know which part of the flow remains to be done? I know Confluent Control Center allows to monitor the Kafka topics, but I’m not aware of any tool allowing to visualize the business flows of events.
Thanks!
Jonathan Roy