You are viewing a plain text version of this content. The canonical link for it is here.
Posted to users@kafka.apache.org by "Ghosh, Achintya (Contractor)" <Ac...@comcast.com> on 2016/09/19 03:08:42 UTC

Kafka usecase

Hi there,

We have an usecase where we do a lot of business logic to process each message and sometime it takes 1-2 sec, so will be Kafka fit in our usecase?

Thanks
Achintya

Re: Kafka usecase

Posted by kant kodali <ka...@gmail.com>.
Why does comcast needs to do better than 1-2 seconds?
 





On Sun, Sep 18, 2016 8:08 PM, Ghosh, Achintya (Contractor) 
Achintya_Ghosh@comcast.com
wrote:
Hi there,




We have an usecase where we do a lot of business logic to process each message
and sometime it takes 1-2 sec, so will be Kafka fit in our usecase?




Thanks

Achintya

Re: Kafka usecase

Posted by kant kodali <ka...@gmail.com>.
Why does comcast needs to do better than 1-2 seconds?
 





On Sun, Sep 18, 2016 8:08 PM, Ghosh, Achintya (Contractor) 
Achintya_Ghosh@comcast.com
wrote:
Hi there,




We have an usecase where we do a lot of business logic to process each message
and sometime it takes 1-2 sec, so will be Kafka fit in our usecase?




Thanks

Achintya

RE: Kafka usecase

Posted by "Ghosh, Achintya (Contractor)" <Ac...@comcast.com>.
Please find my response here.

1. Kafka can be used as a message store.
2. What is the message arrival rate per second? 20 per sec
3. What is the SLA for the messages to be processed? 500 ms per message
4. If your messages arrive faster than they are consumed, you will get a backlog of messages. In that case, you may need to grow your cluster so that more messages are processed in parallel.
 You mean here to create more partitions or any thing else we need to do?

-----Original Message-----
From: Lohith Samaga M [mailto:Lohith.Samaga@mphasis.com] 
Sent: Monday, September 19, 2016 12:24 AM
To: users@kafka.apache.org
Cc: dev@kafka.apache.org
Subject: RE: Kafka usecase

Hi Achintya,
	1. Kafka can be used as a message store.
	2. What is the message arrival rate per second?
	3. What is the SLA for the messages to be processed?
	4. If your messages arrive faster than they are consumed, you will get a backlog of messages. In that case, you may need to grow your cluster so that more messages are processed in parallel.

Best regards / Mit freundlichen Grüßen / Sincères salutations M. Lohith Samaga



-----Original Message-----
From: Ghosh, Achintya (Contractor) [mailto:Achintya_Ghosh@comcast.com]
Sent: Monday, September 19, 2016 08.39
To: users@kafka.apache.org
Cc: dev@kafka.apache.org
Subject: Kafka usecase

Hi there,

We have an usecase where we do a lot of business logic to process each message and sometime it takes 1-2 sec, so will be Kafka fit in our usecase?

Thanks
Achintya
Information transmitted by this e-mail is proprietary to Mphasis, its associated companies and/ or its customers and is intended for use only by the individual or entity to which it is addressed, and may contain information that is privileged, confidential or exempt from disclosure under applicable law. If you are not the intended recipient or it appears that this mail has been forwarded to you without proper authority, you are notified that any use or dissemination of this information in any manner is strictly prohibited. In such cases, please notify us immediately at mailmaster@mphasis.com and delete this mail from your records.

RE: Kafka usecase

Posted by "Ghosh, Achintya (Contractor)" <Ac...@comcast.com>.
Please find my response here.

1. Kafka can be used as a message store.
2. What is the message arrival rate per second? 20 per sec
3. What is the SLA for the messages to be processed? 500 ms per message
4. If your messages arrive faster than they are consumed, you will get a backlog of messages. In that case, you may need to grow your cluster so that more messages are processed in parallel.
 You mean here to create more partitions or any thing else we need to do?

-----Original Message-----
From: Lohith Samaga M [mailto:Lohith.Samaga@mphasis.com] 
Sent: Monday, September 19, 2016 12:24 AM
To: users@kafka.apache.org
Cc: dev@kafka.apache.org
Subject: RE: Kafka usecase

Hi Achintya,
	1. Kafka can be used as a message store.
	2. What is the message arrival rate per second?
	3. What is the SLA for the messages to be processed?
	4. If your messages arrive faster than they are consumed, you will get a backlog of messages. In that case, you may need to grow your cluster so that more messages are processed in parallel.

Best regards / Mit freundlichen Grüßen / Sincères salutations M. Lohith Samaga



-----Original Message-----
From: Ghosh, Achintya (Contractor) [mailto:Achintya_Ghosh@comcast.com]
Sent: Monday, September 19, 2016 08.39
To: users@kafka.apache.org
Cc: dev@kafka.apache.org
Subject: Kafka usecase

Hi there,

We have an usecase where we do a lot of business logic to process each message and sometime it takes 1-2 sec, so will be Kafka fit in our usecase?

Thanks
Achintya
Information transmitted by this e-mail is proprietary to Mphasis, its associated companies and/ or its customers and is intended for use only by the individual or entity to which it is addressed, and may contain information that is privileged, confidential or exempt from disclosure under applicable law. If you are not the intended recipient or it appears that this mail has been forwarded to you without proper authority, you are notified that any use or dissemination of this information in any manner is strictly prohibited. In such cases, please notify us immediately at mailmaster@mphasis.com and delete this mail from your records.

RE: Kafka usecase

Posted by Lohith Samaga M <Lo...@mphasis.com>.
Hi Achintya,
	1. Kafka can be used as a message store.
	2. What is the message arrival rate per second?
	3. What is the SLA for the messages to be processed?
	4. If your messages arrive faster than they are consumed, you will get a backlog of messages. In that case, you may need to grow your cluster so that more messages are processed in parallel.

Best regards / Mit freundlichen Grüßen / Sincères salutations
M. Lohith Samaga



-----Original Message-----
From: Ghosh, Achintya (Contractor) [mailto:Achintya_Ghosh@comcast.com] 
Sent: Monday, September 19, 2016 08.39
To: users@kafka.apache.org
Cc: dev@kafka.apache.org
Subject: Kafka usecase

Hi there,

We have an usecase where we do a lot of business logic to process each message and sometime it takes 1-2 sec, so will be Kafka fit in our usecase?

Thanks
Achintya
Information transmitted by this e-mail is proprietary to Mphasis, its associated companies and/ or its customers and is intended 
for use only by the individual or entity to which it is addressed, and may contain information that is privileged, confidential or 
exempt from disclosure under applicable law. If you are not the intended recipient or it appears that this mail has been forwarded 
to you without proper authority, you are notified that any use or dissemination of this information in any manner is strictly 
prohibited. In such cases, please notify us immediately at mailmaster@mphasis.com and delete this mail from your records.

RE: Kafka usecase

Posted by Lohith Samaga M <Lo...@mphasis.com>.
Hi Achintya,
	1. Kafka can be used as a message store.
	2. What is the message arrival rate per second?
	3. What is the SLA for the messages to be processed?
	4. If your messages arrive faster than they are consumed, you will get a backlog of messages. In that case, you may need to grow your cluster so that more messages are processed in parallel.

Best regards / Mit freundlichen Grüßen / Sincères salutations
M. Lohith Samaga



-----Original Message-----
From: Ghosh, Achintya (Contractor) [mailto:Achintya_Ghosh@comcast.com] 
Sent: Monday, September 19, 2016 08.39
To: users@kafka.apache.org
Cc: dev@kafka.apache.org
Subject: Kafka usecase

Hi there,

We have an usecase where we do a lot of business logic to process each message and sometime it takes 1-2 sec, so will be Kafka fit in our usecase?

Thanks
Achintya
Information transmitted by this e-mail is proprietary to Mphasis, its associated companies and/ or its customers and is intended 
for use only by the individual or entity to which it is addressed, and may contain information that is privileged, confidential or 
exempt from disclosure under applicable law. If you are not the intended recipient or it appears that this mail has been forwarded 
to you without proper authority, you are notified that any use or dissemination of this information in any manner is strictly 
prohibited. In such cases, please notify us immediately at mailmaster@mphasis.com and delete this mail from your records.