I am finding a way to solve my problem (using kafka)

["Zhao GuoHao (技术中心)" <gu...@sohu-inc.com>]

Hello Kafka :

I want to load message in brokers to hadoop,but I don't have a totally design for it , Can you
Give me a solution  ? Use camps ? Hadoop consumer ? How to use it ?

I find that the Hadoop Consumer in github (kafka version 0.7.2), I can only consume one partition of one topic ,but indeed ,each topic have 4 partitions in my company ,how to edit the source code and how to compile it  ? Please tell me  .


Thank you ! My lovely kafka .

Re: I am finding a way to solve my problem (using kafka)

[Guozhang Wang <wa...@gmail.com>]

Hello Guohao,

Have you taken a look at Camus?

https://groups.google.com/forum/#!forum/camus_etl

Guozhang




On Sat, Oct 12, 2013 at 2:42 AM, Zhao GuoHao(技术中心) <
guohaozhao116008@sohu-inc.com> wrote:

> Hello Kafka :
>
> I want to load message in brokers to hadoop,but I don't have a totally
> design for it , Can you
> Give me a solution  ? Use camps ? Hadoop consumer ? How to use it ?
>
> I find that the Hadoop Consumer in github (kafka version 0.7.2), I can
> only consume one partition of one topic ,but indeed ,each topic have 4
> partitions in my company ,how to edit the source code and how to compile it
>  ? Please tell me  .
>
>
> Thank you ! My lovely kafka .
>
>
>


-- 
-- Guozhang