You are viewing a plain text version of this content. The canonical link for it is here.
Posted to users@kafka.apache.org by Monika Garg <ga...@gmail.com> on 2014/01/08 11:18:27 UTC
Property Name Changes in Different Versions of Kafka
Hi,
I have two doubts for changes in different versions of Kafka available:
*Doubt1:*
I am using Kafka from the version kafka-0.7.1-incubating-src.tgz.
The latest stable version is kafka_2.8.0-0.8.0.tar.gz.
But there is propertyName difference in config/server.properties file of
different versions.
kafka-0.7.1-incubating-src.tgz and kafka-0.7.2-incubating-src.tgz have
below property(ies) :
brokerid = 0
log.dir = /tmp/kafka-logs
But kafka-0.8.0-beta1-src.tgz have as below :
broker.id = 0
log.dir = /tmp/kafka-logs
But kafka_2.8.0-0.8.0.tar.gz have as below:
broker.id = 0
log.dirs = /tmp/kafka-logs
So May I know why the difference in property-Name of different versions(One
thing I understood that from kafka-0.8.0-beta1 version,Kafka is supporting
multiple log-directory,so that might be the reason for change of log.dir to
log.dirs).
*Doubt2:*
/bin/kafka-server-start.sh file export JMX_PORT till version
kafka-0.8.0-beta1-src.tgz,but
in stable latest version it is not exporting JMX_PORT.So why this has been
done.
--
*Moniii*
Re: Property Name Changes in Different Versions of Kafka
Posted by Monika Garg <ga...@gmail.com>.
Hi,
I have two doubts for changes in different versions of Kafka available:
*Doubt1:*
I am using Kafka from the version kafka-0.7.1-incubating-src.tgz.
The latest stable version is kafka_2.8.0-0.8.0.tar.gz.
But there is propertyName difference in config/server.properties file of
different versions.
*kafka-0.7.1-incubating-src.tgz and kafka-0.7.2-incubating-src.tgz have
below property(ies) :*
brokerid = 0
log.dir = /tmp/kafka-logs
zk.connect=localhost:2181
*But kafka-0.8.0-beta1-src.tgz have as below :*
broker.id = 0
log.dir = /tmp/kafka-logs
zookeeper.connect=localhost:2181
*But kafka_2.8.0-0.8.0.tar.gz have as below: *
broker.id = 0
log.dirs = /tmp/kafka-logs
zookeeper.connect=localhost:2181
So May I know why the difference in property-Name of different versions(One
thing I understood that from kafka-0.8.0-beta1 version,Kafka is supporting
multiple log-directory,so that might be the reason for change of log.dir to
log.dirs).
*Doubt2:*
/bin/kafka-server-start.sh file export JMX_PORT till version
kafka-0.8.0-beta1-src.tgz,but
in stable latest version it is not exporting JMX_PORT.So why this has been
done.
On Wed, Jan 8, 2014 at 3:48 PM, Monika Garg <ga...@gmail.com> wrote:
> Hi,
>
> I have two doubts for changes in different versions of Kafka available:
>
> *Doubt1:*
>
> I am using Kafka from the version kafka-0.7.1-incubating-src.tgz.
> The latest stable version is kafka_2.8.0-0.8.0.tar.gz.
>
> But there is propertyName difference in config/server.properties file of
> different versions.
>
> kafka-0.7.1-incubating-src.tgz and kafka-0.7.2-incubating-src.tgz have
> below property(ies) :
>
> brokerid = 0
> log.dir = /tmp/kafka-logs
>
> But kafka-0.8.0-beta1-src.tgz have as below :
> broker.id = 0
> log.dir = /tmp/kafka-logs
>
> But kafka_2.8.0-0.8.0.tar.gz have as below:
>
> broker.id = 0
> log.dirs = /tmp/kafka-logs
>
> So May I know why the difference in property-Name of different
> versions(One thing I understood that from kafka-0.8.0-beta1 version,Kafka
> is supporting multiple log-directory,so that might be the reason for change
> of log.dir to log.dirs).
>
>
>
>
>
> *Doubt2:*
> /bin/kafka-server-start.sh file export JMX_PORT till version kafka-0.8.0-beta1-src.tgz,but
> in stable latest version it is not exporting JMX_PORT.So why this has been
> done.
>
>
>
> --
> *Moniii*
>
--
*Moniii*
Re: Property Name Changes in Different Versions of Kafka
Posted by Monika Garg <ga...@gmail.com>.
Thanks a lot Joe...all my doubts/questions are cleared.
Thanks again...:)
Re: Property Name Changes in Different Versions of Kafka
Posted by Joe Stein <jo...@stealth.ly>.
you can do a git blame
https://www.kernel.org/pub/software/scm/git/docs/git-blame.html on a file
to see the commit log changes which has the JIRA ticket which then gives
you the reason behind changes to the code (or through github's git blame ui
https://github.com/apache/kafka/blame/0.8/config/server.properties) so for
brokerid to broker.id it is
https://issues.apache.org/jira/browse/KAFKA-648to make uniform the
property names
for setting the JMX_PORT look at step #6 of the quick start
http://kafka.apache.org/documentation.html#quickstart
/*******************************************
Joe Stein
Founder, Principal Consultant
Big Data Open Source Security LLC
http://www.stealth.ly
Twitter: @allthingshadoop <http://www.twitter.com/allthingshadoop>
********************************************/
On Thu, Jan 9, 2014 at 5:39 AM, Monika Garg <ga...@gmail.com> wrote:
> Thanks for reply Joe...
> Yes you understood my question/doubt well...I also saw the link -
> https://issues.apache.org/jira/browse/KAFKA-188
>
> This is the same reason I mentioned in my previous mail in brackets
>
> >(One thing I understood that from kafka-0.8.0-beta1 version,Kafka is
> supporting
> > multiple log-directory,so that might be the reason for change of log.dir
> to
> > log.dirs).
>
> Can you please provide me the link where I can see other changes in Jira
> for brokerid to broker.id and zk.connect to zookeeper.connect and their
> corresponding reasons.
>
> #2 - JMX_PORT to use is checked in the (if [ $JMX_PORT ]; then)
> kafka-run-class.sh file.Also the default value of JMX_PORT is taken as
> "9999".But what if I want to change this port,where should I configure
> this.
>
> Please let me know if something is not clear.
> Thanks
> <https://issues.apache.org/jira/browse/KAFKA-188>
>
>
> On Wed, Jan 8, 2014 at 7:29 PM, Joe Stein <jo...@stealth.ly> wrote:
>
> > Monika changes to Kafka are tracked in JIRA and you will see this almost
> > always in the commit log (so you can find the file, review the history,
> do
> > a git blame and often (if not always) see the JIRA ticket number that
> > caused the change... go to JIRA and see why).
> >
> > e.g: the answer to your first question =
> > https://issues.apache.org/jira/browse/KAFKA-188
> >
> > for #2 the JMX is set in kafka-run-class.sh and removed from the other
> in a
> > cleanup commit since it was redundant (and is defaulted in the code).
> not
> > sure I understand your question or what you mean by "Doubt"
> >
> > /*******************************************
> > Joe Stein
> > Founder, Principal Consultant
> > Big Data Open Source Security LLC
> > http://www.stealth.ly
> > Twitter: @allthingshadoop <http://www.twitter.com/allthingshadoop>
> > ********************************************/
> >
> >
> > On Wed, Jan 8, 2014 at 5:18 AM, Monika Garg <ga...@gmail.com>
> wrote:
> >
> > > Hi,
> > >
> > > I have two doubts for changes in different versions of Kafka available:
> > >
> > > *Doubt1:*
> > >
> > > I am using Kafka from the version kafka-0.7.1-incubating-src.tgz.
> > > The latest stable version is kafka_2.8.0-0.8.0.tar.gz.
> > >
> > > But there is propertyName difference in config/server.properties file
> of
> > > different versions.
> > >
> > > kafka-0.7.1-incubating-src.tgz and kafka-0.7.2-incubating-src.tgz have
> > > below property(ies) :
> > >
> > > brokerid = 0
> > > log.dir = /tmp/kafka-logs
> > >
> > > But kafka-0.8.0-beta1-src.tgz have as below :
> > > broker.id = 0
> > > log.dir = /tmp/kafka-logs
> > >
> > > But kafka_2.8.0-0.8.0.tar.gz have as below:
> > >
> > > broker.id = 0
> > > log.dirs = /tmp/kafka-logs
> > >
> > > So May I know why the difference in property-Name of different
> > versions(One
> > > thing I understood that from kafka-0.8.0-beta1 version,Kafka is
> > supporting
> > > multiple log-directory,so that might be the reason for change of
> log.dir
> > to
> > > log.dirs).
> > >
> > >
> > >
> > >
> > >
> > > *Doubt2:*
> > > /bin/kafka-server-start.sh file export JMX_PORT till version
> > > kafka-0.8.0-beta1-src.tgz,but
> > > in stable latest version it is not exporting JMX_PORT.So why this has
> > been
> > > done.
> > >
> > >
> > >
> > > --
> > > *Moniii*
> > >
> >
>
>
>
> --
> *Moniii*
>
Re: Property Name Changes in Different Versions of Kafka
Posted by Monika Garg <ga...@gmail.com>.
Thanks for reply Joe...
Yes you understood my question/doubt well...I also saw the link -
https://issues.apache.org/jira/browse/KAFKA-188
This is the same reason I mentioned in my previous mail in brackets
>(One thing I understood that from kafka-0.8.0-beta1 version,Kafka is
supporting
> multiple log-directory,so that might be the reason for change of log.dir
to
> log.dirs).
Can you please provide me the link where I can see other changes in Jira
for brokerid to broker.id and zk.connect to zookeeper.connect and their
corresponding reasons.
#2 - JMX_PORT to use is checked in the (if [ $JMX_PORT ]; then)
kafka-run-class.sh file.Also the default value of JMX_PORT is taken as
"9999".But what if I want to change this port,where should I configure this.
Please let me know if something is not clear.
Thanks
<https://issues.apache.org/jira/browse/KAFKA-188>
On Wed, Jan 8, 2014 at 7:29 PM, Joe Stein <jo...@stealth.ly> wrote:
> Monika changes to Kafka are tracked in JIRA and you will see this almost
> always in the commit log (so you can find the file, review the history, do
> a git blame and often (if not always) see the JIRA ticket number that
> caused the change... go to JIRA and see why).
>
> e.g: the answer to your first question =
> https://issues.apache.org/jira/browse/KAFKA-188
>
> for #2 the JMX is set in kafka-run-class.sh and removed from the other in a
> cleanup commit since it was redundant (and is defaulted in the code). not
> sure I understand your question or what you mean by "Doubt"
>
> /*******************************************
> Joe Stein
> Founder, Principal Consultant
> Big Data Open Source Security LLC
> http://www.stealth.ly
> Twitter: @allthingshadoop <http://www.twitter.com/allthingshadoop>
> ********************************************/
>
>
> On Wed, Jan 8, 2014 at 5:18 AM, Monika Garg <ga...@gmail.com> wrote:
>
> > Hi,
> >
> > I have two doubts for changes in different versions of Kafka available:
> >
> > *Doubt1:*
> >
> > I am using Kafka from the version kafka-0.7.1-incubating-src.tgz.
> > The latest stable version is kafka_2.8.0-0.8.0.tar.gz.
> >
> > But there is propertyName difference in config/server.properties file of
> > different versions.
> >
> > kafka-0.7.1-incubating-src.tgz and kafka-0.7.2-incubating-src.tgz have
> > below property(ies) :
> >
> > brokerid = 0
> > log.dir = /tmp/kafka-logs
> >
> > But kafka-0.8.0-beta1-src.tgz have as below :
> > broker.id = 0
> > log.dir = /tmp/kafka-logs
> >
> > But kafka_2.8.0-0.8.0.tar.gz have as below:
> >
> > broker.id = 0
> > log.dirs = /tmp/kafka-logs
> >
> > So May I know why the difference in property-Name of different
> versions(One
> > thing I understood that from kafka-0.8.0-beta1 version,Kafka is
> supporting
> > multiple log-directory,so that might be the reason for change of log.dir
> to
> > log.dirs).
> >
> >
> >
> >
> >
> > *Doubt2:*
> > /bin/kafka-server-start.sh file export JMX_PORT till version
> > kafka-0.8.0-beta1-src.tgz,but
> > in stable latest version it is not exporting JMX_PORT.So why this has
> been
> > done.
> >
> >
> >
> > --
> > *Moniii*
> >
>
--
*Moniii*
Re: Property Name Changes in Different Versions of Kafka
Posted by Joe Stein <jo...@stealth.ly>.
Monika changes to Kafka are tracked in JIRA and you will see this almost
always in the commit log (so you can find the file, review the history, do
a git blame and often (if not always) see the JIRA ticket number that
caused the change... go to JIRA and see why).
e.g: the answer to your first question =
https://issues.apache.org/jira/browse/KAFKA-188
for #2 the JMX is set in kafka-run-class.sh and removed from the other in a
cleanup commit since it was redundant (and is defaulted in the code). not
sure I understand your question or what you mean by "Doubt"
/*******************************************
Joe Stein
Founder, Principal Consultant
Big Data Open Source Security LLC
http://www.stealth.ly
Twitter: @allthingshadoop <http://www.twitter.com/allthingshadoop>
********************************************/
On Wed, Jan 8, 2014 at 5:18 AM, Monika Garg <ga...@gmail.com> wrote:
> Hi,
>
> I have two doubts for changes in different versions of Kafka available:
>
> *Doubt1:*
>
> I am using Kafka from the version kafka-0.7.1-incubating-src.tgz.
> The latest stable version is kafka_2.8.0-0.8.0.tar.gz.
>
> But there is propertyName difference in config/server.properties file of
> different versions.
>
> kafka-0.7.1-incubating-src.tgz and kafka-0.7.2-incubating-src.tgz have
> below property(ies) :
>
> brokerid = 0
> log.dir = /tmp/kafka-logs
>
> But kafka-0.8.0-beta1-src.tgz have as below :
> broker.id = 0
> log.dir = /tmp/kafka-logs
>
> But kafka_2.8.0-0.8.0.tar.gz have as below:
>
> broker.id = 0
> log.dirs = /tmp/kafka-logs
>
> So May I know why the difference in property-Name of different versions(One
> thing I understood that from kafka-0.8.0-beta1 version,Kafka is supporting
> multiple log-directory,so that might be the reason for change of log.dir to
> log.dirs).
>
>
>
>
>
> *Doubt2:*
> /bin/kafka-server-start.sh file export JMX_PORT till version
> kafka-0.8.0-beta1-src.tgz,but
> in stable latest version it is not exporting JMX_PORT.So why this has been
> done.
>
>
>
> --
> *Moniii*
>