You are viewing a plain text version of this content. The canonical link for it is here.
Posted to users@kafka.apache.org by Vignesh <da...@gmail.com> on 2018/03/26 15:31:02 UTC
Kafka & ZooKeeper IDs
Hello Kafka Users,
I'm setting up 3 node kafka cluster in RHEL
I don't see a documentation for what ID these services should be running
under.
I'm creating unique Id's for Kafka & Zookeeper .. each on their unique
nodes.
Does it has any restriction or any mandatory IDs it should be running
under? Like "mqm" for IBM MQ.
Thanks,
Vignesh
Re: Kafka & ZooKeeper IDs
Posted by Vignesh <da...@gmail.com>.
Hi Chritophe,
Thank you...This helps!!
It is User IDs. I untarred and set appropriate permissions.
-
Vignesh
On Mon, Mar 26, 2018 at 5:32 PM, Christophe Schmitz <
christophe@instaclustr.com> wrote:
> Hi Vignesh
>
> I am not sure what you mean by UNIX IDs is. Do you mean User ID (UID) which
> is the ID (number) of a given user? If so, there is no real requirement.
> You can run as root, or you can run as a user you create, provided that it
> has read and write access to a set of directories (data, logs etc...). Best
> security practice would say that you shouldn't run as root.
> Depending on how you installed Kafka and Zookeeper, it could be that the
> install packager already created a corresponding user (kafka, zookeeper)
> and already set the appropriate permissions to the directory it should
> write to. If you just untarred a binary archive, then it will be up to you
> to set the permissions.
>
> Hope it helps!
>
> Cheers,
>
> Christophe
>
>
> On 27 March 2018 at 08:55, Vignesh <da...@gmail.com> wrote:
>
> > Hi Christophe,
> >
> > No, not the PIDs... UNIX IDs.
> > Are they(kafka & zookeeper) suppose to run under root ? or can i define
> my
> > own Ids?
> >
> > Thanks,
> > Vignesh
> >
> > On Mon, Mar 26, 2018 at 4:09 PM, Christophe Schmitz <
> > christophe@instaclustr.com> wrote:
> >
> > > Hi Vignesh,
> > >
> > > Are you talking about the PID (process ID)? If so, those are
> > automatically
> > > allocated by the kernel and you don't have to worry about.
> > >
> > > Cheers,
> > >
> > > Christophe
> > >
> > > On 27 March 2018 at 03:29, Vignesh <da...@gmail.com> wrote:
> > >
> > > > Hi Anand, Thanks..
> > > > I was asking about linux/unix ids these kafka & zookeeper processes
> are
> > > > running.
> > > >
> > > > On Mon, Mar 26, 2018 at 11:16 AM, Anand, Uttam <Uttam.Anand@bnsf.com
> >
> > > > wrote:
> > > >
> > > > > Hi Vigensh,
> > > > >
> > > > >
> > > > >
> > > > > There is no restriction on ID. It can be any unique number.
> > > > >
> > > > >
> > > > >
> > > > > broker.id=0
> > > > >
> > > > > broker.id=1
> > > > >
> > > > > broker.id=2
> > > > >
> > > > >
> > > > >
> > > > > Thanks
> > > > >
> > > > > Uttam
> > > > >
> > > > >
> > > > >
> > > > > -----Original Message-----
> > > > > From: Vignesh [mailto:davidvikimca@gmail.com]
> > > > > Sent: Monday, March 26, 2018 10:31 AM
> > > > > To: users@kafka.apache.org
> > > > > Subject: Kafka & ZooKeeper IDs
> > > > >
> > > > >
> > > > >
> > > > > <center><p style="color:red; font-size:24px;"><b>EXTERNAL
> > > > > EMAIL</b></p></center> Hello Kafka Users,
> > > > >
> > > > >
> > > > >
> > > > >
> > > > >
> > > > >
> > > > >
> > > > > I'm setting up 3 node kafka cluster in RHEL
> > > > >
> > > > >
> > > > >
> > > > >
> > > > >
> > > > >
> > > > >
> > > > > I don't see a documentation for what ID these services should be
> > > running
> > > > > under.
> > > > >
> > > > >
> > > > >
> > > > > I'm creating unique Id's for Kafka & Zookeeper .. each on their
> > unique
> > > > > nodes.
> > > > >
> > > > >
> > > > >
> > > > >
> > > > >
> > > > >
> > > > >
> > > > > Does it has any restriction or any mandatory IDs it should be
> running
> > > > > under? Like "mqm" for IBM MQ.
> > > > >
> > > > >
> > > > >
> > > > >
> > > > >
> > > > >
> > > > >
> > > > > Thanks,
> > > > >
> > > > >
> > > > >
> > > > > Vignesh
> > > > >
> > > >
> > >
> > >
> > >
> > > --
> > >
> > > *Christophe Schmitz - **VP Consulting*
> > >
> > > AU: +61 4 03751980 / FR: +33 7 82022899
> > >
> > > <https://www.facebook.com/instaclustr> <https://twitter.com/
> > instaclustr>
> > > <https://www.linkedin.com/company/instaclustr>
> > >
> > > Read our latest technical blog posts here
> > > <https://www.instaclustr.com/blog/>. This email has been sent on
> behalf
> > > of Instaclustr Pty. Limited (Australia) and Instaclustr Inc (USA). This
> > > email and any attachments may contain confidential and legally
> > > privileged information. If you are not the intended recipient, do not
> > copy
> > > or disclose its content, but please reply to this email immediately and
> > > highlight the error to the sender and then immediately delete the
> > message.
> > >
> >
>
>
>
> --
>
> *Christophe Schmitz - **VP Consulting*
>
> AU: +61 4 03751980 / FR: +33 7 82022899
>
> <https://www.facebook.com/instaclustr> <https://twitter.com/instaclustr>
> <https://www.linkedin.com/company/instaclustr>
>
> Read our latest technical blog posts here
> <https://www.instaclustr.com/blog/>. This email has been sent on behalf
> of Instaclustr Pty. Limited (Australia) and Instaclustr Inc (USA). This
> email and any attachments may contain confidential and legally
> privileged information. If you are not the intended recipient, do not copy
> or disclose its content, but please reply to this email immediately and
> highlight the error to the sender and then immediately delete the message.
>
Re: Kafka & ZooKeeper IDs
Posted by Christophe Schmitz <ch...@instaclustr.com>.
Hi Vignesh
I am not sure what you mean by UNIX IDs is. Do you mean User ID (UID) which
is the ID (number) of a given user? If so, there is no real requirement.
You can run as root, or you can run as a user you create, provided that it
has read and write access to a set of directories (data, logs etc...). Best
security practice would say that you shouldn't run as root.
Depending on how you installed Kafka and Zookeeper, it could be that the
install packager already created a corresponding user (kafka, zookeeper)
and already set the appropriate permissions to the directory it should
write to. If you just untarred a binary archive, then it will be up to you
to set the permissions.
Hope it helps!
Cheers,
Christophe
On 27 March 2018 at 08:55, Vignesh <da...@gmail.com> wrote:
> Hi Christophe,
>
> No, not the PIDs... UNIX IDs.
> Are they(kafka & zookeeper) suppose to run under root ? or can i define my
> own Ids?
>
> Thanks,
> Vignesh
>
> On Mon, Mar 26, 2018 at 4:09 PM, Christophe Schmitz <
> christophe@instaclustr.com> wrote:
>
> > Hi Vignesh,
> >
> > Are you talking about the PID (process ID)? If so, those are
> automatically
> > allocated by the kernel and you don't have to worry about.
> >
> > Cheers,
> >
> > Christophe
> >
> > On 27 March 2018 at 03:29, Vignesh <da...@gmail.com> wrote:
> >
> > > Hi Anand, Thanks..
> > > I was asking about linux/unix ids these kafka & zookeeper processes are
> > > running.
> > >
> > > On Mon, Mar 26, 2018 at 11:16 AM, Anand, Uttam <Ut...@bnsf.com>
> > > wrote:
> > >
> > > > Hi Vigensh,
> > > >
> > > >
> > > >
> > > > There is no restriction on ID. It can be any unique number.
> > > >
> > > >
> > > >
> > > > broker.id=0
> > > >
> > > > broker.id=1
> > > >
> > > > broker.id=2
> > > >
> > > >
> > > >
> > > > Thanks
> > > >
> > > > Uttam
> > > >
> > > >
> > > >
> > > > -----Original Message-----
> > > > From: Vignesh [mailto:davidvikimca@gmail.com]
> > > > Sent: Monday, March 26, 2018 10:31 AM
> > > > To: users@kafka.apache.org
> > > > Subject: Kafka & ZooKeeper IDs
> > > >
> > > >
> > > >
> > > > <center><p style="color:red; font-size:24px;"><b>EXTERNAL
> > > > EMAIL</b></p></center> Hello Kafka Users,
> > > >
> > > >
> > > >
> > > >
> > > >
> > > >
> > > >
> > > > I'm setting up 3 node kafka cluster in RHEL
> > > >
> > > >
> > > >
> > > >
> > > >
> > > >
> > > >
> > > > I don't see a documentation for what ID these services should be
> > running
> > > > under.
> > > >
> > > >
> > > >
> > > > I'm creating unique Id's for Kafka & Zookeeper .. each on their
> unique
> > > > nodes.
> > > >
> > > >
> > > >
> > > >
> > > >
> > > >
> > > >
> > > > Does it has any restriction or any mandatory IDs it should be running
> > > > under? Like "mqm" for IBM MQ.
> > > >
> > > >
> > > >
> > > >
> > > >
> > > >
> > > >
> > > > Thanks,
> > > >
> > > >
> > > >
> > > > Vignesh
> > > >
> > >
> >
> >
> >
> > --
> >
> > *Christophe Schmitz - **VP Consulting*
> >
> > AU: +61 4 03751980 / FR: +33 7 82022899
> >
> > <https://www.facebook.com/instaclustr> <https://twitter.com/
> instaclustr>
> > <https://www.linkedin.com/company/instaclustr>
> >
> > Read our latest technical blog posts here
> > <https://www.instaclustr.com/blog/>. This email has been sent on behalf
> > of Instaclustr Pty. Limited (Australia) and Instaclustr Inc (USA). This
> > email and any attachments may contain confidential and legally
> > privileged information. If you are not the intended recipient, do not
> copy
> > or disclose its content, but please reply to this email immediately and
> > highlight the error to the sender and then immediately delete the
> message.
> >
>
--
*Christophe Schmitz - **VP Consulting*
AU: +61 4 03751980 / FR: +33 7 82022899
<https://www.facebook.com/instaclustr> <https://twitter.com/instaclustr>
<https://www.linkedin.com/company/instaclustr>
Read our latest technical blog posts here
<https://www.instaclustr.com/blog/>. This email has been sent on behalf
of Instaclustr Pty. Limited (Australia) and Instaclustr Inc (USA). This
email and any attachments may contain confidential and legally
privileged information. If you are not the intended recipient, do not copy
or disclose its content, but please reply to this email immediately and
highlight the error to the sender and then immediately delete the message.
Re: Kafka & ZooKeeper IDs
Posted by Vignesh <da...@gmail.com>.
Hi Christophe,
No, not the PIDs... UNIX IDs.
Are they(kafka & zookeeper) suppose to run under root ? or can i define my
own Ids?
Thanks,
Vignesh
On Mon, Mar 26, 2018 at 4:09 PM, Christophe Schmitz <
christophe@instaclustr.com> wrote:
> Hi Vignesh,
>
> Are you talking about the PID (process ID)? If so, those are automatically
> allocated by the kernel and you don't have to worry about.
>
> Cheers,
>
> Christophe
>
> On 27 March 2018 at 03:29, Vignesh <da...@gmail.com> wrote:
>
> > Hi Anand, Thanks..
> > I was asking about linux/unix ids these kafka & zookeeper processes are
> > running.
> >
> > On Mon, Mar 26, 2018 at 11:16 AM, Anand, Uttam <Ut...@bnsf.com>
> > wrote:
> >
> > > Hi Vigensh,
> > >
> > >
> > >
> > > There is no restriction on ID. It can be any unique number.
> > >
> > >
> > >
> > > broker.id=0
> > >
> > > broker.id=1
> > >
> > > broker.id=2
> > >
> > >
> > >
> > > Thanks
> > >
> > > Uttam
> > >
> > >
> > >
> > > -----Original Message-----
> > > From: Vignesh [mailto:davidvikimca@gmail.com]
> > > Sent: Monday, March 26, 2018 10:31 AM
> > > To: users@kafka.apache.org
> > > Subject: Kafka & ZooKeeper IDs
> > >
> > >
> > >
> > > <center><p style="color:red; font-size:24px;"><b>EXTERNAL
> > > EMAIL</b></p></center> Hello Kafka Users,
> > >
> > >
> > >
> > >
> > >
> > >
> > >
> > > I'm setting up 3 node kafka cluster in RHEL
> > >
> > >
> > >
> > >
> > >
> > >
> > >
> > > I don't see a documentation for what ID these services should be
> running
> > > under.
> > >
> > >
> > >
> > > I'm creating unique Id's for Kafka & Zookeeper .. each on their unique
> > > nodes.
> > >
> > >
> > >
> > >
> > >
> > >
> > >
> > > Does it has any restriction or any mandatory IDs it should be running
> > > under? Like "mqm" for IBM MQ.
> > >
> > >
> > >
> > >
> > >
> > >
> > >
> > > Thanks,
> > >
> > >
> > >
> > > Vignesh
> > >
> >
>
>
>
> --
>
> *Christophe Schmitz - **VP Consulting*
>
> AU: +61 4 03751980 / FR: +33 7 82022899
>
> <https://www.facebook.com/instaclustr> <https://twitter.com/instaclustr>
> <https://www.linkedin.com/company/instaclustr>
>
> Read our latest technical blog posts here
> <https://www.instaclustr.com/blog/>. This email has been sent on behalf
> of Instaclustr Pty. Limited (Australia) and Instaclustr Inc (USA). This
> email and any attachments may contain confidential and legally
> privileged information. If you are not the intended recipient, do not copy
> or disclose its content, but please reply to this email immediately and
> highlight the error to the sender and then immediately delete the message.
>
Re: Kafka & ZooKeeper IDs
Posted by Christophe Schmitz <ch...@instaclustr.com>.
Hi Vignesh,
Are you talking about the PID (process ID)? If so, those are automatically
allocated by the kernel and you don't have to worry about.
Cheers,
Christophe
On 27 March 2018 at 03:29, Vignesh <da...@gmail.com> wrote:
> Hi Anand, Thanks..
> I was asking about linux/unix ids these kafka & zookeeper processes are
> running.
>
> On Mon, Mar 26, 2018 at 11:16 AM, Anand, Uttam <Ut...@bnsf.com>
> wrote:
>
> > Hi Vigensh,
> >
> >
> >
> > There is no restriction on ID. It can be any unique number.
> >
> >
> >
> > broker.id=0
> >
> > broker.id=1
> >
> > broker.id=2
> >
> >
> >
> > Thanks
> >
> > Uttam
> >
> >
> >
> > -----Original Message-----
> > From: Vignesh [mailto:davidvikimca@gmail.com]
> > Sent: Monday, March 26, 2018 10:31 AM
> > To: users@kafka.apache.org
> > Subject: Kafka & ZooKeeper IDs
> >
> >
> >
> > <center><p style="color:red; font-size:24px;"><b>EXTERNAL
> > EMAIL</b></p></center> Hello Kafka Users,
> >
> >
> >
> >
> >
> >
> >
> > I'm setting up 3 node kafka cluster in RHEL
> >
> >
> >
> >
> >
> >
> >
> > I don't see a documentation for what ID these services should be running
> > under.
> >
> >
> >
> > I'm creating unique Id's for Kafka & Zookeeper .. each on their unique
> > nodes.
> >
> >
> >
> >
> >
> >
> >
> > Does it has any restriction or any mandatory IDs it should be running
> > under? Like "mqm" for IBM MQ.
> >
> >
> >
> >
> >
> >
> >
> > Thanks,
> >
> >
> >
> > Vignesh
> >
>
--
*Christophe Schmitz - **VP Consulting*
AU: +61 4 03751980 / FR: +33 7 82022899
<https://www.facebook.com/instaclustr> <https://twitter.com/instaclustr>
<https://www.linkedin.com/company/instaclustr>
Read our latest technical blog posts here
<https://www.instaclustr.com/blog/>. This email has been sent on behalf
of Instaclustr Pty. Limited (Australia) and Instaclustr Inc (USA). This
email and any attachments may contain confidential and legally
privileged information. If you are not the intended recipient, do not copy
or disclose its content, but please reply to this email immediately and
highlight the error to the sender and then immediately delete the message.
Re: Kafka & ZooKeeper IDs
Posted by Vignesh <da...@gmail.com>.
Hi Anand, Thanks..
I was asking about linux/unix ids these kafka & zookeeper processes are
running.
On Mon, Mar 26, 2018 at 11:16 AM, Anand, Uttam <Ut...@bnsf.com> wrote:
> Hi Vigensh,
>
>
>
> There is no restriction on ID. It can be any unique number.
>
>
>
> broker.id=0
>
> broker.id=1
>
> broker.id=2
>
>
>
> Thanks
>
> Uttam
>
>
>
> -----Original Message-----
> From: Vignesh [mailto:davidvikimca@gmail.com]
> Sent: Monday, March 26, 2018 10:31 AM
> To: users@kafka.apache.org
> Subject: Kafka & ZooKeeper IDs
>
>
>
> <center><p style="color:red; font-size:24px;"><b>EXTERNAL
> EMAIL</b></p></center> Hello Kafka Users,
>
>
>
>
>
>
>
> I'm setting up 3 node kafka cluster in RHEL
>
>
>
>
>
>
>
> I don't see a documentation for what ID these services should be running
> under.
>
>
>
> I'm creating unique Id's for Kafka & Zookeeper .. each on their unique
> nodes.
>
>
>
>
>
>
>
> Does it has any restriction or any mandatory IDs it should be running
> under? Like "mqm" for IBM MQ.
>
>
>
>
>
>
>
> Thanks,
>
>
>
> Vignesh
>
RE: Kafka & ZooKeeper IDs
Posted by "Anand, Uttam" <Ut...@BNSF.com>.
Hi Vigensh,
There is no restriction on ID. It can be any unique number.
broker.id=0
broker.id=1
broker.id=2
Thanks
Uttam
-----Original Message-----
From: Vignesh [mailto:davidvikimca@gmail.com]
Sent: Monday, March 26, 2018 10:31 AM
To: users@kafka.apache.org
Subject: Kafka & ZooKeeper IDs
<center><p style="color:red; font-size:24px;"><b>EXTERNAL EMAIL</b></p></center> Hello Kafka Users,
I'm setting up 3 node kafka cluster in RHEL
I don't see a documentation for what ID these services should be running under.
I'm creating unique Id's for Kafka & Zookeeper .. each on their unique nodes.
Does it has any restriction or any mandatory IDs it should be running under? Like "mqm" for IBM MQ.
Thanks,
Vignesh