You are viewing a plain text version of this content. The canonical link for it is here.
Posted to users@kafka.apache.org by Joe Stein <jo...@stealth.ly> on 2013/10/31 00:00:25 UTC
Re: Kafka 0.8, Scala 2.10.2, OSGi
Can you go off the 0.8 branch please? We're in the process of the 0.8.0 release so if you still have problems that were not resolved we can know what they are.
/*******************************************
Joe Stein
Founder, Principal Consultant
Big Data Open Source Security LLC
http://www.stealth.ly
Twitter: @allthingshadoop
********************************************/
On Oct 30, 2013, at 6:26 PM, "Ngu, Bob" <bo...@intel.com> wrote:
> Hi,
>
> I decided to start a new thread regarding Kafka 0.8 beta1 support for Scala 2.10.2 and OSGi. I asked about 2.10.2 in a different thread
>
> I am using Maven to build my Scala library but to resolve the bad POM
> definition issue, https://issues.apache.org/jira/browse/KAFKA-1064, I
> added all the required dependencies to my POM and thought I had to use
> Scala 2.9.2 but it seems to build just fine with 2.10.2, this should be
> fine, right?
>
> However, I am getting java.lang.NoClassDefFoundError: scala/reflect/ClassManifest error calling ProducerConfig
> val config = new ProducerConfig(props)
>
> I believe this is because Kafka is built with 2.9.2 so I made the following changes to Build.scala
> scalaVersion := “2.10.2” ,
> publishTo := Some(Resolver.file("file", new File(Path.userHome.absolutePath+"/.m2/repository"))),
>
> I should be able to run “sbt publish” to my local maven repository. However, I also need to package this library in OSGi format since I am using the library in OSGi, does anyone know if this works in OSGi? I would also need to include addSbtPlugin("com.typesafe.sbt" % "sbt-osgi" % "0.4.0”) for OSGi bundling.
>
> Thanks for any help!
> Bob
>
>
>
Re: Kafka 0.8, Scala 2.10.2, OSGi
Posted by "Ngu, Bob" <bo...@intel.com>.
Ok, so I guess this means there isn’t explicit support for OSGi yet, I’ll
take a look at the client rewrite when I get a chance, thanks.
On 10/30/13, 5:31 PM, "Joe Stein" <jo...@stealth.ly> wrote:
>In regards to OSGi maybe it is something you would propose and help out
>with for the client rewrite
>https://cwiki.apache.org/confluence/display/KAFKA/Client+Rewrite I don't
>know what is entailed for coding and long term support and what the
>community benefit would be. If you could help with any of that it would
>go
>towards making it happening.
>
>/*******************************************
> Joe Stein
> Founder, Principal Consultant
> Big Data Open Source Security LLC
> http://www.stealth.ly
> Twitter: @allthingshadoop <http://www.twitter.com/allthingshadoop>
>********************************************/
>
>
>On Wed, Oct 30, 2013 at 7:12 PM, Ngu, Bob <bo...@intel.com> wrote:
>
>> Thanks, I did just that, I found the kafka github repo, grabbed the 0.8
>> branch and it builds fine now. Any thoughts on the OSGi support
>>question?
>>
>> On 10/30/13, 4:00 PM, "Joe Stein" <jo...@stealth.ly> wrote:
>>
>> >Can you go off the 0.8 branch please? We're in the process of the 0.8.0
>> >release so if you still have problems that were not resolved we can
>>know
>> >what they are.
>> >
>> >
>> >/*******************************************
>> > Joe Stein
>> > Founder, Principal Consultant
>> > Big Data Open Source Security LLC
>> > http://www.stealth.ly
>> > Twitter: @allthingshadoop
>> >********************************************/
>> >
>> >
>> >On Oct 30, 2013, at 6:26 PM, "Ngu, Bob" <bo...@intel.com> wrote:
>> >
>> >> Hi,
>> >>
>> >> I decided to start a new thread regarding Kafka 0.8 beta1 support for
>> >>Scala 2.10.2 and OSGi. I asked about 2.10.2 in a different thread
>> >>
>> >> I am using Maven to build my Scala library but to resolve the bad POM
>> >> definition issue, https://issues.apache.org/jira/browse/KAFKA-1064, I
>> >> added all the required dependencies to my POM and thought I had to
>>use
>> >> Scala 2.9.2 but it seems to build just fine with 2.10.2, this should
>>be
>> >> fine, right?
>> >>
>> >> However, I am getting java.lang.NoClassDefFoundError:
>> >>scala/reflect/ClassManifest error calling ProducerConfig
>> >> val config = new ProducerConfig(props)
>> >>
>> >> I believe this is because Kafka is built with 2.9.2 so I made the
>> >>following changes to Build.scala
>> >> scalaVersion := ³2.10.2² ,
>> >> publishTo := Some(Resolver.file("file", new
>> >>File(Path.userHome.absolutePath+"/.m2/repository"))),
>> >>
>> >> I should be able to run ³sbt publish² to my local maven repository.
>> >>However, I also need to package this library in OSGi format since I am
>> >>using the library in OSGi, does anyone know if this works in OSGi? I
>> >>would also need to include addSbtPlugin("com.typesafe.sbt" %
>>"sbt-osgi"
>> >>% "0.4.0²) for OSGi bundling.
>> >>
>> >> Thanks for any help!
>> >> Bob
>> >>
>> >>
>> >>
>>
>>
Re: Kafka 0.8, Scala 2.10.2, OSGi
Posted by Joe Stein <jo...@stealth.ly>.
In regards to OSGi maybe it is something you would propose and help out
with for the client rewrite
https://cwiki.apache.org/confluence/display/KAFKA/Client+Rewrite I don't
know what is entailed for coding and long term support and what the
community benefit would be. If you could help with any of that it would go
towards making it happening.
/*******************************************
Joe Stein
Founder, Principal Consultant
Big Data Open Source Security LLC
http://www.stealth.ly
Twitter: @allthingshadoop <http://www.twitter.com/allthingshadoop>
********************************************/
On Wed, Oct 30, 2013 at 7:12 PM, Ngu, Bob <bo...@intel.com> wrote:
> Thanks, I did just that, I found the kafka github repo, grabbed the 0.8
> branch and it builds fine now. Any thoughts on the OSGi support question?
>
> On 10/30/13, 4:00 PM, "Joe Stein" <jo...@stealth.ly> wrote:
>
> >Can you go off the 0.8 branch please? We're in the process of the 0.8.0
> >release so if you still have problems that were not resolved we can know
> >what they are.
> >
> >
> >/*******************************************
> > Joe Stein
> > Founder, Principal Consultant
> > Big Data Open Source Security LLC
> > http://www.stealth.ly
> > Twitter: @allthingshadoop
> >********************************************/
> >
> >
> >On Oct 30, 2013, at 6:26 PM, "Ngu, Bob" <bo...@intel.com> wrote:
> >
> >> Hi,
> >>
> >> I decided to start a new thread regarding Kafka 0.8 beta1 support for
> >>Scala 2.10.2 and OSGi. I asked about 2.10.2 in a different thread
> >>
> >> I am using Maven to build my Scala library but to resolve the bad POM
> >> definition issue, https://issues.apache.org/jira/browse/KAFKA-1064, I
> >> added all the required dependencies to my POM and thought I had to use
> >> Scala 2.9.2 but it seems to build just fine with 2.10.2, this should be
> >> fine, right?
> >>
> >> However, I am getting java.lang.NoClassDefFoundError:
> >>scala/reflect/ClassManifest error calling ProducerConfig
> >> val config = new ProducerConfig(props)
> >>
> >> I believe this is because Kafka is built with 2.9.2 so I made the
> >>following changes to Build.scala
> >> scalaVersion := ³2.10.2² ,
> >> publishTo := Some(Resolver.file("file", new
> >>File(Path.userHome.absolutePath+"/.m2/repository"))),
> >>
> >> I should be able to run ³sbt publish² to my local maven repository.
> >>However, I also need to package this library in OSGi format since I am
> >>using the library in OSGi, does anyone know if this works in OSGi? I
> >>would also need to include addSbtPlugin("com.typesafe.sbt" % "sbt-osgi"
> >>% "0.4.0²) for OSGi bundling.
> >>
> >> Thanks for any help!
> >> Bob
> >>
> >>
> >>
>
>
Re: Kafka 0.8, Scala 2.10.2, OSGi
Posted by "Ngu, Bob" <bo...@intel.com>.
Thanks, got it to work, much appreciated.
On 10/30/13, 5:23 PM, "Joe Stein" <jo...@stealth.ly> wrote:
>you need a pgp keypair.
>
>if you use sbt you could try http://www.scala-sbt.org/sbt-pgp/usage.html
>
>or without sbt get OpenPGP installed http://linux.die.net/man/1/gpg2 and
>then
>
>gpg2 --gen-key
>
>
>On Wed, Oct 30, 2013 at 8:05 PM, Ngu, Bob <bo...@intel.com> wrote:
>
>> Hi Joe,
>>
>> I ran into a number of missing PGP key error with “sbt publish-local”
>> [error] (Kafka/*:packaged-artifacts) java.io.FileNotFoundException:
>> /Users/rngu/.sbt/gpg/secring.asc (No such file or directory)
>> [error] (perf/*:packaged-artifacts) java.io.FileNotFoundException:
>> /Users/rngu/.sbt/gpg/secring.asc (No such file or directory)
>> [error] (contrib/*:packaged-artifacts) java.io.FileNotFoundException:
>> /Users/rngu/.sbt/gpg/secring.asc (No such file or directory)
>> [error] (hadoop-consumer/*:packaged-artifacts)
>> java.io.FileNotFoundException: /Users/rngu/.sbt/gpg/secring.asc (No such
>> file or directory)
>> [error] (hadoop-producer/*:packaged-artifacts)
>> java.io.FileNotFoundException: /Users/rngu/.sbt/gpg/secring.asc (No such
>> file or directory)
>> [error] (java-examples/*:packaged-artifacts)
>> java.io.FileNotFoundException: /Users/rngu/.sbt/gpg/secring.asc (No such
>> file or directory)
>> [error] (core/*:packaged-artifacts) java.io.FileNotFoundException:
>> /Users/rngu/.sbt/gpg/secring.asc (No such file or directory)
>>
>>
>> Any ideas?
>> Thanks,
>> Bob
>>
>> On 10/30/13, 4:12 PM, "Ngu, Bob" <bo...@intel.com> wrote:
>>
>> >Thanks, I did just that, I found the kafka github repo, grabbed the 0.8
>> >branch and it builds fine now. Any thoughts on the OSGi support
>>question?
>> >
>> >On 10/30/13, 4:00 PM, "Joe Stein" <jo...@stealth.ly> wrote:
>> >
>> >>Can you go off the 0.8 branch please? We're in the process of the
>>0.8.0
>> >>release so if you still have problems that were not resolved we can
>>know
>> >>what they are.
>> >>
>> >>
>> >>/*******************************************
>> >> Joe Stein
>> >> Founder, Principal Consultant
>> >> Big Data Open Source Security LLC
>> >> http://www.stealth.ly
>> >> Twitter: @allthingshadoop
>> >>********************************************/
>> >>
>> >>
>> >>On Oct 30, 2013, at 6:26 PM, "Ngu, Bob" <bo...@intel.com> wrote:
>> >>
>> >>> Hi,
>> >>>
>> >>> I decided to start a new thread regarding Kafka 0.8 beta1 support
>>for
>> >>>Scala 2.10.2 and OSGi. I asked about 2.10.2 in a different thread
>> >>>
>> >>> I am using Maven to build my Scala library but to resolve the bad
>>POM
>> >>> definition issue, https://issues.apache.org/jira/browse/KAFKA-1064,
>>I
>> >>> added all the required dependencies to my POM and thought I had to
>>use
>> >>> Scala 2.9.2 but it seems to build just fine with 2.10.2, this
>>should be
>> >>> fine, right?
>> >>>
>> >>> However, I am getting java.lang.NoClassDefFoundError:
>> >>>scala/reflect/ClassManifest error calling ProducerConfig
>> >>> val config = new ProducerConfig(props)
>> >>>
>> >>> I believe this is because Kafka is built with 2.9.2 so I made the
>> >>>following changes to Build.scala
>> >>> scalaVersion := ³2.10.2² ,
>> >>> publishTo := Some(Resolver.file("file", new
>> >>>File(Path.userHome.absolutePath+"/.m2/repository"))),
>> >>>
>> >>> I should be able to run ³sbt publish² to my local maven repository.
>> >>>However, I also need to package this library in OSGi format since I
>>am
>> >>>using the library in OSGi, does anyone know if this works in OSGi? I
>> >>>would also need to include addSbtPlugin("com.typesafe.sbt" %
>>"sbt-osgi"
>> >>>% "0.4.0²) for OSGi bundling.
>> >>>
>> >>> Thanks for any help!
>> >>> Bob
>> >>>
>> >>>
>> >>>
>> >
>>
>>
Re: Kafka 0.8, Scala 2.10.2, OSGi
Posted by Joe Stein <jo...@stealth.ly>.
you need a pgp keypair.
if you use sbt you could try http://www.scala-sbt.org/sbt-pgp/usage.html
or without sbt get OpenPGP installed http://linux.die.net/man/1/gpg2 and
then
gpg2 --gen-key
On Wed, Oct 30, 2013 at 8:05 PM, Ngu, Bob <bo...@intel.com> wrote:
> Hi Joe,
>
> I ran into a number of missing PGP key error with “sbt publish-local”
> [error] (Kafka/*:packaged-artifacts) java.io.FileNotFoundException:
> /Users/rngu/.sbt/gpg/secring.asc (No such file or directory)
> [error] (perf/*:packaged-artifacts) java.io.FileNotFoundException:
> /Users/rngu/.sbt/gpg/secring.asc (No such file or directory)
> [error] (contrib/*:packaged-artifacts) java.io.FileNotFoundException:
> /Users/rngu/.sbt/gpg/secring.asc (No such file or directory)
> [error] (hadoop-consumer/*:packaged-artifacts)
> java.io.FileNotFoundException: /Users/rngu/.sbt/gpg/secring.asc (No such
> file or directory)
> [error] (hadoop-producer/*:packaged-artifacts)
> java.io.FileNotFoundException: /Users/rngu/.sbt/gpg/secring.asc (No such
> file or directory)
> [error] (java-examples/*:packaged-artifacts)
> java.io.FileNotFoundException: /Users/rngu/.sbt/gpg/secring.asc (No such
> file or directory)
> [error] (core/*:packaged-artifacts) java.io.FileNotFoundException:
> /Users/rngu/.sbt/gpg/secring.asc (No such file or directory)
>
>
> Any ideas?
> Thanks,
> Bob
>
> On 10/30/13, 4:12 PM, "Ngu, Bob" <bo...@intel.com> wrote:
>
> >Thanks, I did just that, I found the kafka github repo, grabbed the 0.8
> >branch and it builds fine now. Any thoughts on the OSGi support question?
> >
> >On 10/30/13, 4:00 PM, "Joe Stein" <jo...@stealth.ly> wrote:
> >
> >>Can you go off the 0.8 branch please? We're in the process of the 0.8.0
> >>release so if you still have problems that were not resolved we can know
> >>what they are.
> >>
> >>
> >>/*******************************************
> >> Joe Stein
> >> Founder, Principal Consultant
> >> Big Data Open Source Security LLC
> >> http://www.stealth.ly
> >> Twitter: @allthingshadoop
> >>********************************************/
> >>
> >>
> >>On Oct 30, 2013, at 6:26 PM, "Ngu, Bob" <bo...@intel.com> wrote:
> >>
> >>> Hi,
> >>>
> >>> I decided to start a new thread regarding Kafka 0.8 beta1 support for
> >>>Scala 2.10.2 and OSGi. I asked about 2.10.2 in a different thread
> >>>
> >>> I am using Maven to build my Scala library but to resolve the bad POM
> >>> definition issue, https://issues.apache.org/jira/browse/KAFKA-1064, I
> >>> added all the required dependencies to my POM and thought I had to use
> >>> Scala 2.9.2 but it seems to build just fine with 2.10.2, this should be
> >>> fine, right?
> >>>
> >>> However, I am getting java.lang.NoClassDefFoundError:
> >>>scala/reflect/ClassManifest error calling ProducerConfig
> >>> val config = new ProducerConfig(props)
> >>>
> >>> I believe this is because Kafka is built with 2.9.2 so I made the
> >>>following changes to Build.scala
> >>> scalaVersion := ³2.10.2² ,
> >>> publishTo := Some(Resolver.file("file", new
> >>>File(Path.userHome.absolutePath+"/.m2/repository"))),
> >>>
> >>> I should be able to run ³sbt publish² to my local maven repository.
> >>>However, I also need to package this library in OSGi format since I am
> >>>using the library in OSGi, does anyone know if this works in OSGi? I
> >>>would also need to include addSbtPlugin("com.typesafe.sbt" % "sbt-osgi"
> >>>% "0.4.0²) for OSGi bundling.
> >>>
> >>> Thanks for any help!
> >>> Bob
> >>>
> >>>
> >>>
> >
>
>
Re: Kafka 0.8, Scala 2.10.2, OSGi
Posted by "Ngu, Bob" <bo...@intel.com>.
Hi Joe,
I ran into a number of missing PGP key error with “sbt publish-local”
[error] (Kafka/*:packaged-artifacts) java.io.FileNotFoundException:
/Users/rngu/.sbt/gpg/secring.asc (No such file or directory)
[error] (perf/*:packaged-artifacts) java.io.FileNotFoundException:
/Users/rngu/.sbt/gpg/secring.asc (No such file or directory)
[error] (contrib/*:packaged-artifacts) java.io.FileNotFoundException:
/Users/rngu/.sbt/gpg/secring.asc (No such file or directory)
[error] (hadoop-consumer/*:packaged-artifacts)
java.io.FileNotFoundException: /Users/rngu/.sbt/gpg/secring.asc (No such
file or directory)
[error] (hadoop-producer/*:packaged-artifacts)
java.io.FileNotFoundException: /Users/rngu/.sbt/gpg/secring.asc (No such
file or directory)
[error] (java-examples/*:packaged-artifacts)
java.io.FileNotFoundException: /Users/rngu/.sbt/gpg/secring.asc (No such
file or directory)
[error] (core/*:packaged-artifacts) java.io.FileNotFoundException:
/Users/rngu/.sbt/gpg/secring.asc (No such file or directory)
Any ideas?
Thanks,
Bob
On 10/30/13, 4:12 PM, "Ngu, Bob" <bo...@intel.com> wrote:
>Thanks, I did just that, I found the kafka github repo, grabbed the 0.8
>branch and it builds fine now. Any thoughts on the OSGi support question?
>
>On 10/30/13, 4:00 PM, "Joe Stein" <jo...@stealth.ly> wrote:
>
>>Can you go off the 0.8 branch please? We're in the process of the 0.8.0
>>release so if you still have problems that were not resolved we can know
>>what they are.
>>
>>
>>/*******************************************
>> Joe Stein
>> Founder, Principal Consultant
>> Big Data Open Source Security LLC
>> http://www.stealth.ly
>> Twitter: @allthingshadoop
>>********************************************/
>>
>>
>>On Oct 30, 2013, at 6:26 PM, "Ngu, Bob" <bo...@intel.com> wrote:
>>
>>> Hi,
>>>
>>> I decided to start a new thread regarding Kafka 0.8 beta1 support for
>>>Scala 2.10.2 and OSGi. I asked about 2.10.2 in a different thread
>>>
>>> I am using Maven to build my Scala library but to resolve the bad POM
>>> definition issue, https://issues.apache.org/jira/browse/KAFKA-1064, I
>>> added all the required dependencies to my POM and thought I had to use
>>> Scala 2.9.2 but it seems to build just fine with 2.10.2, this should be
>>> fine, right?
>>>
>>> However, I am getting java.lang.NoClassDefFoundError:
>>>scala/reflect/ClassManifest error calling ProducerConfig
>>> val config = new ProducerConfig(props)
>>>
>>> I believe this is because Kafka is built with 2.9.2 so I made the
>>>following changes to Build.scala
>>> scalaVersion := ³2.10.2² ,
>>> publishTo := Some(Resolver.file("file", new
>>>File(Path.userHome.absolutePath+"/.m2/repository"))),
>>>
>>> I should be able to run ³sbt publish² to my local maven repository.
>>>However, I also need to package this library in OSGi format since I am
>>>using the library in OSGi, does anyone know if this works in OSGi? I
>>>would also need to include addSbtPlugin("com.typesafe.sbt" % "sbt-osgi"
>>>% "0.4.0²) for OSGi bundling.
>>>
>>> Thanks for any help!
>>> Bob
>>>
>>>
>>>
>
Re: Kafka 0.8, Scala 2.10.2, OSGi
Posted by "Ngu, Bob" <bo...@intel.com>.
Thanks, I did just that, I found the kafka github repo, grabbed the 0.8
branch and it builds fine now. Any thoughts on the OSGi support question?
On 10/30/13, 4:00 PM, "Joe Stein" <jo...@stealth.ly> wrote:
>Can you go off the 0.8 branch please? We're in the process of the 0.8.0
>release so if you still have problems that were not resolved we can know
>what they are.
>
>
>/*******************************************
> Joe Stein
> Founder, Principal Consultant
> Big Data Open Source Security LLC
> http://www.stealth.ly
> Twitter: @allthingshadoop
>********************************************/
>
>
>On Oct 30, 2013, at 6:26 PM, "Ngu, Bob" <bo...@intel.com> wrote:
>
>> Hi,
>>
>> I decided to start a new thread regarding Kafka 0.8 beta1 support for
>>Scala 2.10.2 and OSGi. I asked about 2.10.2 in a different thread
>>
>> I am using Maven to build my Scala library but to resolve the bad POM
>> definition issue, https://issues.apache.org/jira/browse/KAFKA-1064, I
>> added all the required dependencies to my POM and thought I had to use
>> Scala 2.9.2 but it seems to build just fine with 2.10.2, this should be
>> fine, right?
>>
>> However, I am getting java.lang.NoClassDefFoundError:
>>scala/reflect/ClassManifest error calling ProducerConfig
>> val config = new ProducerConfig(props)
>>
>> I believe this is because Kafka is built with 2.9.2 so I made the
>>following changes to Build.scala
>> scalaVersion := ³2.10.2² ,
>> publishTo := Some(Resolver.file("file", new
>>File(Path.userHome.absolutePath+"/.m2/repository"))),
>>
>> I should be able to run ³sbt publish² to my local maven repository.
>>However, I also need to package this library in OSGi format since I am
>>using the library in OSGi, does anyone know if this works in OSGi? I
>>would also need to include addSbtPlugin("com.typesafe.sbt" % "sbt-osgi"
>>% "0.4.0²) for OSGi bundling.
>>
>> Thanks for any help!
>> Bob
>>
>>
>>