You are viewing a plain text version of this content. The canonical link for it is here.
Posted to users@kafka.apache.org by Soby Chacko <so...@gmail.com> on 2013/03/26 23:28:18 UTC
Kafka 0.8 build artifacts
Hello,
I built kafka 0.8 with scala 2.9.2. However, I ran into some issues after
publishing the 0.8-SNAPSHOT into my local maven repository. From my
application, I simply depended on this new jar thinking that it would pull
all the other dependencies transitively from a public maven repository. (I
look in a handful of repos in my build script) But, it could not find the
following 3 jars from any repository:
zkclient-20120522.jar
metrics-annotation-3.0.0-c0c8be71.jar
metrics-core-3.0.0-c0c8be71.jar
I found these in the kafka 0.8 artifact that I built and was able to
manually copy them. Are there any plans to make these jars available
through any maven repositories, as they seem to contain custom changes?
Appreciate any help.
Regards,
Soby Chacko
Re: Kafka 0.8 build artifacts
Posted by Soby Chacko <so...@gmail.com>.
That will be awesome.
Thanks,
Soby Chacko
On Wed, Mar 27, 2013 at 11:51 AM, Neha Narkhede <ne...@gmail.com>wrote:
> We are looking into the possibility of changing Kafka 0.8 to depend on
> metrics 2.2.0 instead. This will allow us to mavenize Kafka.
>
> THanks,
> Neha
>
> On Wed, Mar 27, 2013 at 8:45 AM, Soby Chacko <so...@gmail.com> wrote:
> > Hello,
> >
> > Whats the likelihood of more changes to these two yammer metrics
> libraries?
> > Or are they going to stay the same for kafka 0.8?
> >
> > Regards,
> > Soby Chacko
> >
> > On Tue, Mar 26, 2013 at 7:34 PM, Soby Chacko <so...@gmail.com>
> wrote:
> >
> >> Thanks Dragos!!
> >>
> >> Is the zkclient 0.2 change is pushed?
> >>
> >> I will see what I can do with the metrics jars locally.
> >>
> >> Thanks again!!
> >>
> >> Soby Chacko.
> >>
> >>
> >> On Tue, Mar 26, 2013 at 7:18 PM, Dragos Manolescu <
> >> Dragos.Manolescu@servicenow.com> wrote:
> >>
> >>> Hi Soby --
> >>>
> >>> As far as I can tell the zkclient dependency is a leftover from 0.7.2.
> >>> With the exception of the migration tool, which has a comment along
> these
> >>> lines but I haven't looked into 0.8 uses the 0.2 version of the library
> >>> (available from maven). I submitted a patch to address this, it is in
> the
> >>> pipeline (http://j.mp/13uX6rs).
> >>>
> >>> It is not as simple with the metics library as there are significant
> API
> >>> changes between the 3.0.0-c0c8be71 used in the Kafka code and
> >>> 3.0.0-SNAPSHOT. There's an open item on that (http://j.mp/10ccTnE);
> >>> meanwhile the path of least resistance is to manually add the 2 metrics
> >>> JARs to the class path.
> >>>
> >>> I have a fork that addresses the above and has a couple of other minor
> >>> fixes. With the caveat that it hasn't been reviewed by the Kafka team
> yore
> >>> welcome to have a look: http://j.mp/ZsSld2
> >>>
> >>> Welcome to the club ;)
> >>>
> >>> -Dragos
> >>>
> >>> On 3/26/13 3:28 PM, "Soby Chacko" <so...@gmail.com> wrote:
> >>>
> >>> >Hello,
> >>> >
> >>> >I built kafka 0.8 with scala 2.9.2. However, I ran into some issues
> after
> >>> >publishing the 0.8-SNAPSHOT into my local maven repository. From my
> >>> >application, I simply depended on this new jar thinking that it would
> >>> pull
> >>> >all the other dependencies transitively from a public maven
> repository.
> >>> (I
> >>> >look in a handful of repos in my build script) But, it could not find
> the
> >>> >following 3 jars from any repository:
> >>> >
> >>> >zkclient-20120522.jar
> >>> >metrics-annotation-3.0.0-c0c8be71.jar
> >>> >metrics-core-3.0.0-c0c8be71.jar
> >>> >
> >>> >I found these in the kafka 0.8 artifact that I built and was able to
> >>> >manually copy them. Are there any plans to make these jars available
> >>> >through any maven repositories, as they seem to contain custom
> changes?
> >>> >
> >>> >Appreciate any help.
> >>> >
> >>> >Regards,
> >>> >Soby Chacko
> >>>
> >>>
> >>
>
Re: Kafka 0.8 build artifacts
Posted by Neha Narkhede <ne...@gmail.com>.
We are looking into the possibility of changing Kafka 0.8 to depend on
metrics 2.2.0 instead. This will allow us to mavenize Kafka.
THanks,
Neha
On Wed, Mar 27, 2013 at 8:45 AM, Soby Chacko <so...@gmail.com> wrote:
> Hello,
>
> Whats the likelihood of more changes to these two yammer metrics libraries?
> Or are they going to stay the same for kafka 0.8?
>
> Regards,
> Soby Chacko
>
> On Tue, Mar 26, 2013 at 7:34 PM, Soby Chacko <so...@gmail.com> wrote:
>
>> Thanks Dragos!!
>>
>> Is the zkclient 0.2 change is pushed?
>>
>> I will see what I can do with the metrics jars locally.
>>
>> Thanks again!!
>>
>> Soby Chacko.
>>
>>
>> On Tue, Mar 26, 2013 at 7:18 PM, Dragos Manolescu <
>> Dragos.Manolescu@servicenow.com> wrote:
>>
>>> Hi Soby --
>>>
>>> As far as I can tell the zkclient dependency is a leftover from 0.7.2.
>>> With the exception of the migration tool, which has a comment along these
>>> lines but I haven't looked into 0.8 uses the 0.2 version of the library
>>> (available from maven). I submitted a patch to address this, it is in the
>>> pipeline (http://j.mp/13uX6rs).
>>>
>>> It is not as simple with the metics library as there are significant API
>>> changes between the 3.0.0-c0c8be71 used in the Kafka code and
>>> 3.0.0-SNAPSHOT. There's an open item on that (http://j.mp/10ccTnE);
>>> meanwhile the path of least resistance is to manually add the 2 metrics
>>> JARs to the class path.
>>>
>>> I have a fork that addresses the above and has a couple of other minor
>>> fixes. With the caveat that it hasn't been reviewed by the Kafka team yore
>>> welcome to have a look: http://j.mp/ZsSld2
>>>
>>> Welcome to the club ;)
>>>
>>> -Dragos
>>>
>>> On 3/26/13 3:28 PM, "Soby Chacko" <so...@gmail.com> wrote:
>>>
>>> >Hello,
>>> >
>>> >I built kafka 0.8 with scala 2.9.2. However, I ran into some issues after
>>> >publishing the 0.8-SNAPSHOT into my local maven repository. From my
>>> >application, I simply depended on this new jar thinking that it would
>>> pull
>>> >all the other dependencies transitively from a public maven repository.
>>> (I
>>> >look in a handful of repos in my build script) But, it could not find the
>>> >following 3 jars from any repository:
>>> >
>>> >zkclient-20120522.jar
>>> >metrics-annotation-3.0.0-c0c8be71.jar
>>> >metrics-core-3.0.0-c0c8be71.jar
>>> >
>>> >I found these in the kafka 0.8 artifact that I built and was able to
>>> >manually copy them. Are there any plans to make these jars available
>>> >through any maven repositories, as they seem to contain custom changes?
>>> >
>>> >Appreciate any help.
>>> >
>>> >Regards,
>>> >Soby Chacko
>>>
>>>
>>
Re: Kafka 0.8 build artifacts
Posted by Soby Chacko <so...@gmail.com>.
Hello,
Whats the likelihood of more changes to these two yammer metrics libraries?
Or are they going to stay the same for kafka 0.8?
Regards,
Soby Chacko
On Tue, Mar 26, 2013 at 7:34 PM, Soby Chacko <so...@gmail.com> wrote:
> Thanks Dragos!!
>
> Is the zkclient 0.2 change is pushed?
>
> I will see what I can do with the metrics jars locally.
>
> Thanks again!!
>
> Soby Chacko.
>
>
> On Tue, Mar 26, 2013 at 7:18 PM, Dragos Manolescu <
> Dragos.Manolescu@servicenow.com> wrote:
>
>> Hi Soby --
>>
>> As far as I can tell the zkclient dependency is a leftover from 0.7.2.
>> With the exception of the migration tool, which has a comment along these
>> lines but I haven't looked into 0.8 uses the 0.2 version of the library
>> (available from maven). I submitted a patch to address this, it is in the
>> pipeline (http://j.mp/13uX6rs).
>>
>> It is not as simple with the metics library as there are significant API
>> changes between the 3.0.0-c0c8be71 used in the Kafka code and
>> 3.0.0-SNAPSHOT. There's an open item on that (http://j.mp/10ccTnE);
>> meanwhile the path of least resistance is to manually add the 2 metrics
>> JARs to the class path.
>>
>> I have a fork that addresses the above and has a couple of other minor
>> fixes. With the caveat that it hasn't been reviewed by the Kafka team yore
>> welcome to have a look: http://j.mp/ZsSld2
>>
>> Welcome to the club ;)
>>
>> -Dragos
>>
>> On 3/26/13 3:28 PM, "Soby Chacko" <so...@gmail.com> wrote:
>>
>> >Hello,
>> >
>> >I built kafka 0.8 with scala 2.9.2. However, I ran into some issues after
>> >publishing the 0.8-SNAPSHOT into my local maven repository. From my
>> >application, I simply depended on this new jar thinking that it would
>> pull
>> >all the other dependencies transitively from a public maven repository.
>> (I
>> >look in a handful of repos in my build script) But, it could not find the
>> >following 3 jars from any repository:
>> >
>> >zkclient-20120522.jar
>> >metrics-annotation-3.0.0-c0c8be71.jar
>> >metrics-core-3.0.0-c0c8be71.jar
>> >
>> >I found these in the kafka 0.8 artifact that I built and was able to
>> >manually copy them. Are there any plans to make these jars available
>> >through any maven repositories, as they seem to contain custom changes?
>> >
>> >Appreciate any help.
>> >
>> >Regards,
>> >Soby Chacko
>>
>>
>
Re: Kafka 0.8 build artifacts
Posted by Soby Chacko <so...@gmail.com>.
Thanks Dragos!!
Is the zkclient 0.2 change is pushed?
I will see what I can do with the metrics jars locally.
Thanks again!!
Soby Chacko.
On Tue, Mar 26, 2013 at 7:18 PM, Dragos Manolescu <
Dragos.Manolescu@servicenow.com> wrote:
> Hi Soby --
>
> As far as I can tell the zkclient dependency is a leftover from 0.7.2.
> With the exception of the migration tool, which has a comment along these
> lines but I haven't looked into 0.8 uses the 0.2 version of the library
> (available from maven). I submitted a patch to address this, it is in the
> pipeline (http://j.mp/13uX6rs).
>
> It is not as simple with the metics library as there are significant API
> changes between the 3.0.0-c0c8be71 used in the Kafka code and
> 3.0.0-SNAPSHOT. There's an open item on that (http://j.mp/10ccTnE);
> meanwhile the path of least resistance is to manually add the 2 metrics
> JARs to the class path.
>
> I have a fork that addresses the above and has a couple of other minor
> fixes. With the caveat that it hasn't been reviewed by the Kafka team yore
> welcome to have a look: http://j.mp/ZsSld2
>
> Welcome to the club ;)
>
> -Dragos
>
> On 3/26/13 3:28 PM, "Soby Chacko" <so...@gmail.com> wrote:
>
> >Hello,
> >
> >I built kafka 0.8 with scala 2.9.2. However, I ran into some issues after
> >publishing the 0.8-SNAPSHOT into my local maven repository. From my
> >application, I simply depended on this new jar thinking that it would pull
> >all the other dependencies transitively from a public maven repository. (I
> >look in a handful of repos in my build script) But, it could not find the
> >following 3 jars from any repository:
> >
> >zkclient-20120522.jar
> >metrics-annotation-3.0.0-c0c8be71.jar
> >metrics-core-3.0.0-c0c8be71.jar
> >
> >I found these in the kafka 0.8 artifact that I built and was able to
> >manually copy them. Are there any plans to make these jars available
> >through any maven repositories, as they seem to contain custom changes?
> >
> >Appreciate any help.
> >
> >Regards,
> >Soby Chacko
>
>
Re: Kafka 0.8 build artifacts
Posted by Dragos Manolescu <Dr...@servicenow.com>.
Hi Soby --
As far as I can tell the zkclient dependency is a leftover from 0.7.2.
With the exception of the migration tool, which has a comment along these
lines but I haven't looked into 0.8 uses the 0.2 version of the library
(available from maven). I submitted a patch to address this, it is in the
pipeline (http://j.mp/13uX6rs).
It is not as simple with the metics library as there are significant API
changes between the 3.0.0-c0c8be71 used in the Kafka code and
3.0.0-SNAPSHOT. There's an open item on that (http://j.mp/10ccTnE);
meanwhile the path of least resistance is to manually add the 2 metrics
JARs to the class path.
I have a fork that addresses the above and has a couple of other minor
fixes. With the caveat that it hasn't been reviewed by the Kafka team yore
welcome to have a look: http://j.mp/ZsSld2
Welcome to the club ;)
-Dragos
On 3/26/13 3:28 PM, "Soby Chacko" <so...@gmail.com> wrote:
>Hello,
>
>I built kafka 0.8 with scala 2.9.2. However, I ran into some issues after
>publishing the 0.8-SNAPSHOT into my local maven repository. From my
>application, I simply depended on this new jar thinking that it would pull
>all the other dependencies transitively from a public maven repository. (I
>look in a handful of repos in my build script) But, it could not find the
>following 3 jars from any repository:
>
>zkclient-20120522.jar
>metrics-annotation-3.0.0-c0c8be71.jar
>metrics-core-3.0.0-c0c8be71.jar
>
>I found these in the kafka 0.8 artifact that I built and was able to
>manually copy them. Are there any plans to make these jars available
>through any maven repositories, as they seem to contain custom changes?
>
>Appreciate any help.
>
>Regards,
>Soby Chacko