You are viewing a plain text version of this content. The canonical link for it is here.
Posted to users@kafka.apache.org by Oleg Ruchovets <or...@gmail.com> on 2013/04/03 12:40:41 UTC
installation Kafka to existing hadoop environment
Hi ,
I want to install it to the existing hadoop environment.
I want to read data from Kafka and put it to HDFS.
I use a Hortonworks distributions.
Questions:
I didn't find any guide how to install Kafka ( I read quick start
http://kafka.apache.org/quickstart.html). Do I only need to change Kafka
configuration (add zookeper configuration to it) or I need to change
zookeper configuration (add Kafka details to zookeeper configuration also)?
Thanks
Oleg
Re: installation Kafka to existing hadoop environment
Posted by Jun Rao <ju...@gmail.com>.
There should be a release-zip target that you can run from sbt in 0.7. It's
broken in 0.8 and we plan to fix it (
https://issues.apache.org/jira/browse/KAFKA-843).
Jun
On Wed, Apr 3, 2013 at 8:29 AM, Oleg Ruchovets <or...@gmail.com> wrote:
> Hi Jun
> Thank you for the answers.
>
>
> I've seen this link also : https://cwiki.apache.org/
> confluence/display/KAFKA/Operations .
>
> The problem that from this link I don't see how to install Kafka to already
> deployed hadoop cluster. Is there a simple short document with the steps
> how to do it.
> I have hadoop cluster and want to add Kafka product to use it in my
> solution. What it the steps to install Kafka?
>
> Thanks
> Oleg.
>
>
> On Wed, Apr 3, 2013 at 5:44 PM, Jun Rao <ju...@gmail.com> wrote:
>
> > The configs at LinkedIn can be found at
> > https://cwiki.apache.org/confluence/display/KAFKA/Operations
> >
> > You may also want to checkout Kafka->Hadoop pipeline at LinkedIn:
> > https://github.com/linkedin/camus
> >
> > Thanks,
> >
> > Jun
> >
> > On Wed, Apr 3, 2013 at 3:40 AM, Oleg Ruchovets <or...@gmail.com>
> > wrote:
> >
> > > Hi ,
> > > I want to install it to the existing hadoop environment.
> > > I want to read data from Kafka and put it to HDFS.
> > > I use a Hortonworks distributions.
> > >
> > > Questions:
> > > I didn't find any guide how to install Kafka ( I read quick start
> > > http://kafka.apache.org/quickstart.html). Do I only need to change
> Kafka
> > > configuration (add zookeper configuration to it) or I need to change
> > > zookeper configuration (add Kafka details to zookeeper configuration
> > also)?
> > >
> > > Thanks
> > > Oleg
> > >
> >
>
Re: installation Kafka to existing hadoop environment
Posted by Oleg Ruchovets <or...@gmail.com>.
Hi Jun
Thank you for the answers.
I've seen this link also : https://cwiki.apache.org/
confluence/display/KAFKA/Operations .
The problem that from this link I don't see how to install Kafka to already
deployed hadoop cluster. Is there a simple short document with the steps
how to do it.
I have hadoop cluster and want to add Kafka product to use it in my
solution. What it the steps to install Kafka?
Thanks
Oleg.
On Wed, Apr 3, 2013 at 5:44 PM, Jun Rao <ju...@gmail.com> wrote:
> The configs at LinkedIn can be found at
> https://cwiki.apache.org/confluence/display/KAFKA/Operations
>
> You may also want to checkout Kafka->Hadoop pipeline at LinkedIn:
> https://github.com/linkedin/camus
>
> Thanks,
>
> Jun
>
> On Wed, Apr 3, 2013 at 3:40 AM, Oleg Ruchovets <or...@gmail.com>
> wrote:
>
> > Hi ,
> > I want to install it to the existing hadoop environment.
> > I want to read data from Kafka and put it to HDFS.
> > I use a Hortonworks distributions.
> >
> > Questions:
> > I didn't find any guide how to install Kafka ( I read quick start
> > http://kafka.apache.org/quickstart.html). Do I only need to change Kafka
> > configuration (add zookeper configuration to it) or I need to change
> > zookeper configuration (add Kafka details to zookeeper configuration
> also)?
> >
> > Thanks
> > Oleg
> >
>
Re: installation Kafka to existing hadoop environment
Posted by Jun Rao <ju...@gmail.com>.
The configs at LinkedIn can be found at
https://cwiki.apache.org/confluence/display/KAFKA/Operations
You may also want to checkout Kafka->Hadoop pipeline at LinkedIn:
https://github.com/linkedin/camus
Thanks,
Jun
On Wed, Apr 3, 2013 at 3:40 AM, Oleg Ruchovets <or...@gmail.com> wrote:
> Hi ,
> I want to install it to the existing hadoop environment.
> I want to read data from Kafka and put it to HDFS.
> I use a Hortonworks distributions.
>
> Questions:
> I didn't find any guide how to install Kafka ( I read quick start
> http://kafka.apache.org/quickstart.html). Do I only need to change Kafka
> configuration (add zookeper configuration to it) or I need to change
> zookeper configuration (add Kafka details to zookeeper configuration also)?
>
> Thanks
> Oleg
>