You are viewing a plain text version of this content. The canonical link for it is here.
Posted to users@kafka.apache.org by Abhishek Bhattacharjee <ab...@gmail.com> on 2014/06/05 02:07:10 UTC
Unable to build kafka.
I followed the readme for kafka-0.8.0.
After I am getting the following warnings
>> ./sbt assembly-package-dependency
[info] Loading project definition from
/home/abhishek/Project/kafka-0.8.0-src/project
[warn] Multiple resolvers having different access mechanism configured with
same name 'sbt-plugin-releases'. To avoid conflict, Remove duplicate
project resolvers (`resolvers`) or rename publishing resolver (`publishTo`).
[info] Set current project to Kafka (in build
file:/home/abhishek/Project/kafka-0.8.0-src/)
[warn] Credentials file /home/abhishek/.m2/.credentials does not exist
[info] Compiling 213 Scala sources and 2 Java sources to
/home/abhishek/Project/kafka-0.8.0-src/core/target/scala-2.8.0/classes...
[warn]
/home/abhishek/Project/kafka-0.8.0-src/core/src/main/scala/kafka/api/LeaderAndIsrResponse.scala:66:
non variable type-argument String in type pattern (String, Int) is
unchecked since it is eliminated by erasure
[warn] for ((key:(String, Int), value) <- responseMap) {
[warn] ^
[warn]
/home/abhishek/Project/kafka-0.8.0-src/core/src/main/scala/kafka/api/StopReplicaResponse.scala:67:
non variable type-argument String in type pattern (String, Int) is
unchecked since it is eliminated by erasure
[warn] for ((key:(String, Int), value) <- responseMap){
[warn] ^
[warn]
/home/abhishek/Project/kafka-0.8.0-src/core/src/main/scala/kafka/utils/Utils.scala:383:
non variable type-argument V in type pattern List[V] is unchecked since it
is eliminated by erasure
[warn] case Some(l: List[V]) => m.put(k, v :: l)
[warn] ^
[warn] three warnings found
[warn] warning: [options] bootstrap class path not set in conjunction with
-source 1.5
[warn]
/home/abhishek/Project/kafka-0.8.0-src/core/src/main/scala/kafka/tools/KafkaMigrationTool.java:261:
warning: [unchecked] unchecked conversion
[warn] ProducerThread producerThread = new
ProducerThread(producerDataChannel, producer, i);
[warn]
^
[warn] required: Producer<byte[],byte[]>
[warn] found: Producer
[warn]
/home/abhishek/Project/kafka-0.8.0-src/core/src/main/scala/kafka/tools/KafkaMigrationTool.java:338:
warning: [unchecked] unchecked call to KeyedMessage(String,K,V) as a member
of the raw type KeyedMessage
[warn] KeyedMessage<byte[], byte[]> producerData = new
KeyedMessage((String)topic, null, bytes);
[warn] ^
[warn] where K,V are type-variables:
[warn] K extends Object declared in class KeyedMessage
[warn] V extends Object declared in class KeyedMessage
[warn]
/home/abhishek/Project/kafka-0.8.0-src/core/src/main/scala/kafka/tools/KafkaMigrationTool.java:338:
warning: [unchecked] unchecked conversion
[warn] KeyedMessage<byte[], byte[]> producerData = new
KeyedMessage((String)topic, null, bytes);
[warn] ^
[warn] required: KeyedMessage<byte[],byte[]>
[warn] found: KeyedMessage
[warn]
/home/abhishek/Project/kafka-0.8.0-src/core/src/main/scala/kafka/tools/KafkaMigrationTool.java:371:
warning: [unchecked] unchecked call to KeyedMessage(String,K,V) as a member
of the raw type KeyedMessage
[warn] private KeyedMessage<byte[], byte[]> shutdownMessage = new
KeyedMessage("shutdown", null, null);
[warn] ^
[warn] where K,V are type-variables:
[warn] K extends Object declared in class KeyedMessage
[warn] V extends Object declared in class KeyedMessage
[warn]
/home/abhishek/Project/kafka-0.8.0-src/core/src/main/scala/kafka/tools/KafkaMigrationTool.java:371:
warning: [unchecked] unchecked conversion
[warn] private KeyedMessage<byte[], byte[]> shutdownMessage = new
KeyedMessage("shutdown", null, null);
[warn] ^
[warn] required: KeyedMessage<byte[],byte[]>
[warn] found: KeyedMessage
[warn] 6 warnings
[info] Including zkclient-0.3.jar
[info] Including snappy-java-1.0.4.1.jar
[info] Including zookeeper-3.3.4.jar
[info] Including metrics-core-2.2.0.jar
[info] Including metrics-annotation-2.2.0.jar
[info] Including log4j-1.2.15.jar
[info] Including scala-compiler.jar
[info] Including jopt-simple-3.2.jar
[info] Including slf4j-api-1.7.2.jar
[info] Including slf4j-simple-1.6.4.jar
[info] Including scala-library.jar
[warn] Merging 'META-INF/NOTICE' with strategy 'rename'
[warn] Merging 'org/xerial/snappy/native/README' with strategy 'rename'
[warn] Merging 'META-INF/maven/org.xerial.snappy/snappy-java/LICENSE' with
strategy 'rename'
[warn] Merging 'LICENSE.txt' with strategy 'rename'
[warn] Merging 'META-INF/LICENSE' with strategy 'rename'
[warn] Merging 'META-INF/MANIFEST.MF' with strategy 'discard'
[warn] Strategy 'discard' was applied to a file
[warn] Strategy 'rename' was applied to 5 files
[info] Packaging
/home/abhishek/Project/kafka-0.8.0-src/core/target/scala-2.8.0/kafka-assembly-0.8.0-deps.jar
...
[info] Done packaging.
[success] Total time: 67 s, completed 5 Jun, 2014 5:31:28 AM
I am not able run my Producer to insert into kafka.
The server runs but data doesn't go in. LeaderNotAvailableException is
raised.
Thanks
--
*Abhishek Bhattacharjee*
*Pune Institute of Computer Technology*
Re: Unable to build kafka.
Posted by Abhishek Bhattacharjee <ab...@gmail.com>.
Thanks a lot for your reply. I'll migrate later :-D . I'll use the 0.8.0 as
per now.
Thanks.
On Jun 5, 2014 6:03 PM, "Joe Stein" <jo...@stealth.ly> wrote:
> There are overloaded changes. You don't have to use them (e.g. key is now
> used in compaction with partKey for the partition key
>
> https://github.com/apache/kafka/commit/d285e263bf403f3db27f5d138594c395643a2284#diff-9df10051217ceff96ecce28d087cf0bb
> for new compaction feature
> https://cwiki.apache.org/confluence/display/KAFKA/Log+Compaction). If you
> can keep on the latest stable release you will get the most support options
> from the community.
>
> We also have downloads for the 0.8.0 release so you do not have to build.
> That might be an option for now and migrate later?
>
> https://kafka.apache.org/downloads.html
>
> - Release Notes
> <https://archive.apache.org/dist/kafka/0.8.0/RELEASE_NOTES.html>
> - Source download: kafka-0.8.0-src.tgz
> <https://archive.apache.org/dist/kafka/0.8.0/kafka-0.8.0-src.tgz> (asc
> <https://archive.apache.org/dist/kafka/0.8.0/kafka-0.8.0-src.tgz.asc>,
> md5
> <
> https://archive.apache.org/dist/kafka/0.8.0/0.8.0/kafka-0.8.0-src.tgz.md5>
> )
> - Binary download: kafka_2.8.0-0.8.0.tar.gz
> <https://archive.apache.org/dist/kafka/0.8.0/kafka_2.8.0-0.8.0.tar.gz>
> (
> asc
> <
> https://archive.apache.org/dist/kafka/0.8.0/kafka_2.8.0-0.8.0.tar.gz.asc>
> , md5
> <
> https://archive.apache.org/dist/kafka/0.8.0/kafka_2.8.0-0.8.0.tar.gz.md5>
> )
>
> You can also look at the release process for 0.8.0 and below
> https://cwiki.apache.org/confluence/display/KAFKA/Release+Process with sbt
> maybe there is a step you missed or incorrect something or another.
>
> /*******************************************
> Joe Stein
> Founder, Principal Consultant
> Big Data Open Source Security LLC
> http://www.stealth.ly
> Twitter: @allthingshadoop <http://www.twitter.com/allthingshadoop>
> ********************************************/
>
>
> On Thu, Jun 5, 2014 at 8:16 AM, Abhishek Bhattacharjee <
> abhishek.bhattacharjee11@gmail.com> wrote:
>
> > I have a project running on kafka.0.8.0. Are there any changes in the
> > Producer and consumer APIs in the new version ?
> > Thanks.
> > On Jun 5, 2014 3:53 PM, "Joe Stein" <jo...@stealth.ly> wrote:
> >
> > > Can you try the latest stable branch, please?
> > >
> > > We moved to gradle
> https://github.com/apache/kafka/blob/0.8.1/README.md
> > > and
> > > also distribute binaries as artifacts for download
> > > https://kafka.apache.org/downloads.html
> > >
> > > /*******************************************
> > > Joe Stein
> > > Founder, Principal Consultant
> > > Big Data Open Source Security LLC
> > > http://www.stealth.ly
> > > Twitter: @allthingshadoop <http://www.twitter.com/allthingshadoop>
> > > ********************************************/
> > >
> > >
> > > On Thu, Jun 5, 2014 at 4:25 AM, Abhishek Bhattacharjee <
> > > abhishek.bhattacharjee11@gmail.com> wrote:
> > >
> > > > Thanks for the reply. I re built kafka. And now when I am running
> > server
> > > it
> > > > is stopping saying it cannot find the class Kafka.Kafka.
> > > > I don't know what went most probably it's an sbt problem.
> > > > Any help is welcome.
> > > > Thanks :-)
> > > > On Jun 5, 2014 6:05 AM, "Joe Stein" <jo...@stealth.ly> wrote:
> > > >
> > > > > The build looks fine your error seems valid maybe like your
> broker(s)
> > > > > is(are) not up.
> > > > >
> > > > > /*******************************************
> > > > > Joe Stein
> > > > > Founder, Principal Consultant
> > > > > Big Data Open Source Security LLC
> > > > > http://www.stealth.ly
> > > > > Twitter: @allthingshadoop
> > > > > ********************************************/
> > > > >
> > > > >
> > > > > > On Jun 4, 2014, at 8:07 PM, Abhishek Bhattacharjee <
> > > > > abhishek.bhattacharjee11@gmail.com> wrote:
> > > > > >
> > > > > > I followed the readme for kafka-0.8.0.
> > > > > > After I am getting the following warnings
> > > > > >
> > > > > >>> ./sbt assembly-package-dependency
> > > > > >
> > > > > > [info] Loading project definition from
> > > > > > /home/abhishek/Project/kafka-0.8.0-src/project
> > > > > > [warn] Multiple resolvers having different access mechanism
> > > configured
> > > > > with
> > > > > > same name 'sbt-plugin-releases'. To avoid conflict, Remove
> > duplicate
> > > > > > project resolvers (`resolvers`) or rename publishing resolver
> > > > > (`publishTo`).
> > > > > > [info] Set current project to Kafka (in build
> > > > > > file:/home/abhishek/Project/kafka-0.8.0-src/)
> > > > > > [warn] Credentials file /home/abhishek/.m2/.credentials does not
> > > exist
> > > > > > [info] Compiling 213 Scala sources and 2 Java sources to
> > > > > >
> > > >
> > /home/abhishek/Project/kafka-0.8.0-src/core/target/scala-2.8.0/classes...
> > > > > > [warn]
> > > > > >
> > > > >
> > > >
> > >
> >
> /home/abhishek/Project/kafka-0.8.0-src/core/src/main/scala/kafka/api/LeaderAndIsrResponse.scala:66:
> > > > > > non variable type-argument String in type pattern (String, Int)
> is
> > > > > > unchecked since it is eliminated by erasure
> > > > > > [warn] for ((key:(String, Int), value) <- responseMap) {
> > > > > > [warn] ^
> > > > > > [warn]
> > > > > >
> > > > >
> > > >
> > >
> >
> /home/abhishek/Project/kafka-0.8.0-src/core/src/main/scala/kafka/api/StopReplicaResponse.scala:67:
> > > > > > non variable type-argument String in type pattern (String, Int)
> is
> > > > > > unchecked since it is eliminated by erasure
> > > > > > [warn] for ((key:(String, Int), value) <- responseMap){
> > > > > > [warn] ^
> > > > > > [warn]
> > > > > >
> > > > >
> > > >
> > >
> >
> /home/abhishek/Project/kafka-0.8.0-src/core/src/main/scala/kafka/utils/Utils.scala:383:
> > > > > > non variable type-argument V in type pattern List[V] is unchecked
> > > since
> > > > > it
> > > > > > is eliminated by erasure
> > > > > > [warn] case Some(l: List[V]) => m.put(k, v :: l)
> > > > > > [warn] ^
> > > > > > [warn] three warnings found
> > > > > > [warn] warning: [options] bootstrap class path not set in
> > conjunction
> > > > > with
> > > > > > -source 1.5
> > > > > > [warn]
> > > > > >
> > > > >
> > > >
> > >
> >
> /home/abhishek/Project/kafka-0.8.0-src/core/src/main/scala/kafka/tools/KafkaMigrationTool.java:261:
> > > > > > warning: [unchecked] unchecked conversion
> > > > > > [warn] ProducerThread producerThread = new
> > > > > > ProducerThread(producerDataChannel, producer, i);
> > > > > > [warn]
> > > > > > ^
> > > > > > [warn] required: Producer<byte[],byte[]>
> > > > > > [warn] found: Producer
> > > > > > [warn]
> > > > > >
> > > > >
> > > >
> > >
> >
> /home/abhishek/Project/kafka-0.8.0-src/core/src/main/scala/kafka/tools/KafkaMigrationTool.java:338:
> > > > > > warning: [unchecked] unchecked call to KeyedMessage(String,K,V)
> as
> > a
> > > > > member
> > > > > > of the raw type KeyedMessage
> > > > > > [warn] KeyedMessage<byte[], byte[]> producerData = new
> > > > > > KeyedMessage((String)topic, null, bytes);
> > > > > > [warn] ^
> > > > > > [warn] where K,V are type-variables:
> > > > > > [warn] K extends Object declared in class KeyedMessage
> > > > > > [warn] V extends Object declared in class KeyedMessage
> > > > > > [warn]
> > > > > >
> > > > >
> > > >
> > >
> >
> /home/abhishek/Project/kafka-0.8.0-src/core/src/main/scala/kafka/tools/KafkaMigrationTool.java:338:
> > > > > > warning: [unchecked] unchecked conversion
> > > > > > [warn] KeyedMessage<byte[], byte[]> producerData = new
> > > > > > KeyedMessage((String)topic, null, bytes);
> > > > > > [warn] ^
> > > > > > [warn] required: KeyedMessage<byte[],byte[]>
> > > > > > [warn] found: KeyedMessage
> > > > > > [warn]
> > > > > >
> > > > >
> > > >
> > >
> >
> /home/abhishek/Project/kafka-0.8.0-src/core/src/main/scala/kafka/tools/KafkaMigrationTool.java:371:
> > > > > > warning: [unchecked] unchecked call to KeyedMessage(String,K,V)
> as
> > a
> > > > > member
> > > > > > of the raw type KeyedMessage
> > > > > > [warn] private KeyedMessage<byte[], byte[]> shutdownMessage =
> > new
> > > > > > KeyedMessage("shutdown", null, null);
> > > > > > [warn]
> ^
> > > > > > [warn] where K,V are type-variables:
> > > > > > [warn] K extends Object declared in class KeyedMessage
> > > > > > [warn] V extends Object declared in class KeyedMessage
> > > > > > [warn]
> > > > > >
> > > > >
> > > >
> > >
> >
> /home/abhishek/Project/kafka-0.8.0-src/core/src/main/scala/kafka/tools/KafkaMigrationTool.java:371:
> > > > > > warning: [unchecked] unchecked conversion
> > > > > > [warn] private KeyedMessage<byte[], byte[]> shutdownMessage =
> > new
> > > > > > KeyedMessage("shutdown", null, null);
> > > > > > [warn]
> ^
> > > > > > [warn] required: KeyedMessage<byte[],byte[]>
> > > > > > [warn] found: KeyedMessage
> > > > > > [warn] 6 warnings
> > > > > > [info] Including zkclient-0.3.jar
> > > > > > [info] Including snappy-java-1.0.4.1.jar
> > > > > > [info] Including zookeeper-3.3.4.jar
> > > > > > [info] Including metrics-core-2.2.0.jar
> > > > > > [info] Including metrics-annotation-2.2.0.jar
> > > > > > [info] Including log4j-1.2.15.jar
> > > > > > [info] Including scala-compiler.jar
> > > > > > [info] Including jopt-simple-3.2.jar
> > > > > > [info] Including slf4j-api-1.7.2.jar
> > > > > > [info] Including slf4j-simple-1.6.4.jar
> > > > > > [info] Including scala-library.jar
> > > > > > [warn] Merging 'META-INF/NOTICE' with strategy 'rename'
> > > > > > [warn] Merging 'org/xerial/snappy/native/README' with strategy
> > > 'rename'
> > > > > > [warn] Merging
> > 'META-INF/maven/org.xerial.snappy/snappy-java/LICENSE'
> > > > > with
> > > > > > strategy 'rename'
> > > > > > [warn] Merging 'LICENSE.txt' with strategy 'rename'
> > > > > > [warn] Merging 'META-INF/LICENSE' with strategy 'rename'
> > > > > > [warn] Merging 'META-INF/MANIFEST.MF' with strategy 'discard'
> > > > > > [warn] Strategy 'discard' was applied to a file
> > > > > > [warn] Strategy 'rename' was applied to 5 files
> > > > > > [info] Packaging
> > > > > >
> > > > >
> > > >
> > >
> >
> /home/abhishek/Project/kafka-0.8.0-src/core/target/scala-2.8.0/kafka-assembly-0.8.0-deps.jar
> > > > > > ...
> > > > > > [info] Done packaging.
> > > > > > [success] Total time: 67 s, completed 5 Jun, 2014 5:31:28 AM
> > > > > >
> > > > > > I am not able run my Producer to insert into kafka.
> > > > > > The server runs but data doesn't go in.
> LeaderNotAvailableException
> > > is
> > > > > > raised.
> > > > > >
> > > > > > Thanks
> > > > > > --
> > > > > > *Abhishek Bhattacharjee*
> > > > > > *Pune Institute of Computer Technology*
> > > > >
> > > >
> > >
> >
>
Re: Unable to build kafka.
Posted by Joe Stein <jo...@stealth.ly>.
There are overloaded changes. You don't have to use them (e.g. key is now
used in compaction with partKey for the partition key
https://github.com/apache/kafka/commit/d285e263bf403f3db27f5d138594c395643a2284#diff-9df10051217ceff96ecce28d087cf0bb
for new compaction feature
https://cwiki.apache.org/confluence/display/KAFKA/Log+Compaction). If you
can keep on the latest stable release you will get the most support options
from the community.
We also have downloads for the 0.8.0 release so you do not have to build.
That might be an option for now and migrate later?
https://kafka.apache.org/downloads.html
- Release Notes
<https://archive.apache.org/dist/kafka/0.8.0/RELEASE_NOTES.html>
- Source download: kafka-0.8.0-src.tgz
<https://archive.apache.org/dist/kafka/0.8.0/kafka-0.8.0-src.tgz> (asc
<https://archive.apache.org/dist/kafka/0.8.0/kafka-0.8.0-src.tgz.asc>,
md5
<https://archive.apache.org/dist/kafka/0.8.0/0.8.0/kafka-0.8.0-src.tgz.md5>
)
- Binary download: kafka_2.8.0-0.8.0.tar.gz
<https://archive.apache.org/dist/kafka/0.8.0/kafka_2.8.0-0.8.0.tar.gz> (
asc
<https://archive.apache.org/dist/kafka/0.8.0/kafka_2.8.0-0.8.0.tar.gz.asc>
, md5
<https://archive.apache.org/dist/kafka/0.8.0/kafka_2.8.0-0.8.0.tar.gz.md5>
)
You can also look at the release process for 0.8.0 and below
https://cwiki.apache.org/confluence/display/KAFKA/Release+Process with sbt
maybe there is a step you missed or incorrect something or another.
/*******************************************
Joe Stein
Founder, Principal Consultant
Big Data Open Source Security LLC
http://www.stealth.ly
Twitter: @allthingshadoop <http://www.twitter.com/allthingshadoop>
********************************************/
On Thu, Jun 5, 2014 at 8:16 AM, Abhishek Bhattacharjee <
abhishek.bhattacharjee11@gmail.com> wrote:
> I have a project running on kafka.0.8.0. Are there any changes in the
> Producer and consumer APIs in the new version ?
> Thanks.
> On Jun 5, 2014 3:53 PM, "Joe Stein" <jo...@stealth.ly> wrote:
>
> > Can you try the latest stable branch, please?
> >
> > We moved to gradle https://github.com/apache/kafka/blob/0.8.1/README.md
> > and
> > also distribute binaries as artifacts for download
> > https://kafka.apache.org/downloads.html
> >
> > /*******************************************
> > Joe Stein
> > Founder, Principal Consultant
> > Big Data Open Source Security LLC
> > http://www.stealth.ly
> > Twitter: @allthingshadoop <http://www.twitter.com/allthingshadoop>
> > ********************************************/
> >
> >
> > On Thu, Jun 5, 2014 at 4:25 AM, Abhishek Bhattacharjee <
> > abhishek.bhattacharjee11@gmail.com> wrote:
> >
> > > Thanks for the reply. I re built kafka. And now when I am running
> server
> > it
> > > is stopping saying it cannot find the class Kafka.Kafka.
> > > I don't know what went most probably it's an sbt problem.
> > > Any help is welcome.
> > > Thanks :-)
> > > On Jun 5, 2014 6:05 AM, "Joe Stein" <jo...@stealth.ly> wrote:
> > >
> > > > The build looks fine your error seems valid maybe like your broker(s)
> > > > is(are) not up.
> > > >
> > > > /*******************************************
> > > > Joe Stein
> > > > Founder, Principal Consultant
> > > > Big Data Open Source Security LLC
> > > > http://www.stealth.ly
> > > > Twitter: @allthingshadoop
> > > > ********************************************/
> > > >
> > > >
> > > > > On Jun 4, 2014, at 8:07 PM, Abhishek Bhattacharjee <
> > > > abhishek.bhattacharjee11@gmail.com> wrote:
> > > > >
> > > > > I followed the readme for kafka-0.8.0.
> > > > > After I am getting the following warnings
> > > > >
> > > > >>> ./sbt assembly-package-dependency
> > > > >
> > > > > [info] Loading project definition from
> > > > > /home/abhishek/Project/kafka-0.8.0-src/project
> > > > > [warn] Multiple resolvers having different access mechanism
> > configured
> > > > with
> > > > > same name 'sbt-plugin-releases'. To avoid conflict, Remove
> duplicate
> > > > > project resolvers (`resolvers`) or rename publishing resolver
> > > > (`publishTo`).
> > > > > [info] Set current project to Kafka (in build
> > > > > file:/home/abhishek/Project/kafka-0.8.0-src/)
> > > > > [warn] Credentials file /home/abhishek/.m2/.credentials does not
> > exist
> > > > > [info] Compiling 213 Scala sources and 2 Java sources to
> > > > >
> > >
> /home/abhishek/Project/kafka-0.8.0-src/core/target/scala-2.8.0/classes...
> > > > > [warn]
> > > > >
> > > >
> > >
> >
> /home/abhishek/Project/kafka-0.8.0-src/core/src/main/scala/kafka/api/LeaderAndIsrResponse.scala:66:
> > > > > non variable type-argument String in type pattern (String, Int) is
> > > > > unchecked since it is eliminated by erasure
> > > > > [warn] for ((key:(String, Int), value) <- responseMap) {
> > > > > [warn] ^
> > > > > [warn]
> > > > >
> > > >
> > >
> >
> /home/abhishek/Project/kafka-0.8.0-src/core/src/main/scala/kafka/api/StopReplicaResponse.scala:67:
> > > > > non variable type-argument String in type pattern (String, Int) is
> > > > > unchecked since it is eliminated by erasure
> > > > > [warn] for ((key:(String, Int), value) <- responseMap){
> > > > > [warn] ^
> > > > > [warn]
> > > > >
> > > >
> > >
> >
> /home/abhishek/Project/kafka-0.8.0-src/core/src/main/scala/kafka/utils/Utils.scala:383:
> > > > > non variable type-argument V in type pattern List[V] is unchecked
> > since
> > > > it
> > > > > is eliminated by erasure
> > > > > [warn] case Some(l: List[V]) => m.put(k, v :: l)
> > > > > [warn] ^
> > > > > [warn] three warnings found
> > > > > [warn] warning: [options] bootstrap class path not set in
> conjunction
> > > > with
> > > > > -source 1.5
> > > > > [warn]
> > > > >
> > > >
> > >
> >
> /home/abhishek/Project/kafka-0.8.0-src/core/src/main/scala/kafka/tools/KafkaMigrationTool.java:261:
> > > > > warning: [unchecked] unchecked conversion
> > > > > [warn] ProducerThread producerThread = new
> > > > > ProducerThread(producerDataChannel, producer, i);
> > > > > [warn]
> > > > > ^
> > > > > [warn] required: Producer<byte[],byte[]>
> > > > > [warn] found: Producer
> > > > > [warn]
> > > > >
> > > >
> > >
> >
> /home/abhishek/Project/kafka-0.8.0-src/core/src/main/scala/kafka/tools/KafkaMigrationTool.java:338:
> > > > > warning: [unchecked] unchecked call to KeyedMessage(String,K,V) as
> a
> > > > member
> > > > > of the raw type KeyedMessage
> > > > > [warn] KeyedMessage<byte[], byte[]> producerData = new
> > > > > KeyedMessage((String)topic, null, bytes);
> > > > > [warn] ^
> > > > > [warn] where K,V are type-variables:
> > > > > [warn] K extends Object declared in class KeyedMessage
> > > > > [warn] V extends Object declared in class KeyedMessage
> > > > > [warn]
> > > > >
> > > >
> > >
> >
> /home/abhishek/Project/kafka-0.8.0-src/core/src/main/scala/kafka/tools/KafkaMigrationTool.java:338:
> > > > > warning: [unchecked] unchecked conversion
> > > > > [warn] KeyedMessage<byte[], byte[]> producerData = new
> > > > > KeyedMessage((String)topic, null, bytes);
> > > > > [warn] ^
> > > > > [warn] required: KeyedMessage<byte[],byte[]>
> > > > > [warn] found: KeyedMessage
> > > > > [warn]
> > > > >
> > > >
> > >
> >
> /home/abhishek/Project/kafka-0.8.0-src/core/src/main/scala/kafka/tools/KafkaMigrationTool.java:371:
> > > > > warning: [unchecked] unchecked call to KeyedMessage(String,K,V) as
> a
> > > > member
> > > > > of the raw type KeyedMessage
> > > > > [warn] private KeyedMessage<byte[], byte[]> shutdownMessage =
> new
> > > > > KeyedMessage("shutdown", null, null);
> > > > > [warn] ^
> > > > > [warn] where K,V are type-variables:
> > > > > [warn] K extends Object declared in class KeyedMessage
> > > > > [warn] V extends Object declared in class KeyedMessage
> > > > > [warn]
> > > > >
> > > >
> > >
> >
> /home/abhishek/Project/kafka-0.8.0-src/core/src/main/scala/kafka/tools/KafkaMigrationTool.java:371:
> > > > > warning: [unchecked] unchecked conversion
> > > > > [warn] private KeyedMessage<byte[], byte[]> shutdownMessage =
> new
> > > > > KeyedMessage("shutdown", null, null);
> > > > > [warn] ^
> > > > > [warn] required: KeyedMessage<byte[],byte[]>
> > > > > [warn] found: KeyedMessage
> > > > > [warn] 6 warnings
> > > > > [info] Including zkclient-0.3.jar
> > > > > [info] Including snappy-java-1.0.4.1.jar
> > > > > [info] Including zookeeper-3.3.4.jar
> > > > > [info] Including metrics-core-2.2.0.jar
> > > > > [info] Including metrics-annotation-2.2.0.jar
> > > > > [info] Including log4j-1.2.15.jar
> > > > > [info] Including scala-compiler.jar
> > > > > [info] Including jopt-simple-3.2.jar
> > > > > [info] Including slf4j-api-1.7.2.jar
> > > > > [info] Including slf4j-simple-1.6.4.jar
> > > > > [info] Including scala-library.jar
> > > > > [warn] Merging 'META-INF/NOTICE' with strategy 'rename'
> > > > > [warn] Merging 'org/xerial/snappy/native/README' with strategy
> > 'rename'
> > > > > [warn] Merging
> 'META-INF/maven/org.xerial.snappy/snappy-java/LICENSE'
> > > > with
> > > > > strategy 'rename'
> > > > > [warn] Merging 'LICENSE.txt' with strategy 'rename'
> > > > > [warn] Merging 'META-INF/LICENSE' with strategy 'rename'
> > > > > [warn] Merging 'META-INF/MANIFEST.MF' with strategy 'discard'
> > > > > [warn] Strategy 'discard' was applied to a file
> > > > > [warn] Strategy 'rename' was applied to 5 files
> > > > > [info] Packaging
> > > > >
> > > >
> > >
> >
> /home/abhishek/Project/kafka-0.8.0-src/core/target/scala-2.8.0/kafka-assembly-0.8.0-deps.jar
> > > > > ...
> > > > > [info] Done packaging.
> > > > > [success] Total time: 67 s, completed 5 Jun, 2014 5:31:28 AM
> > > > >
> > > > > I am not able run my Producer to insert into kafka.
> > > > > The server runs but data doesn't go in. LeaderNotAvailableException
> > is
> > > > > raised.
> > > > >
> > > > > Thanks
> > > > > --
> > > > > *Abhishek Bhattacharjee*
> > > > > *Pune Institute of Computer Technology*
> > > >
> > >
> >
>
Re: Unable to build kafka.
Posted by Abhishek Bhattacharjee <ab...@gmail.com>.
I have a project running on kafka.0.8.0. Are there any changes in the
Producer and consumer APIs in the new version ?
Thanks.
On Jun 5, 2014 3:53 PM, "Joe Stein" <jo...@stealth.ly> wrote:
> Can you try the latest stable branch, please?
>
> We moved to gradle https://github.com/apache/kafka/blob/0.8.1/README.md
> and
> also distribute binaries as artifacts for download
> https://kafka.apache.org/downloads.html
>
> /*******************************************
> Joe Stein
> Founder, Principal Consultant
> Big Data Open Source Security LLC
> http://www.stealth.ly
> Twitter: @allthingshadoop <http://www.twitter.com/allthingshadoop>
> ********************************************/
>
>
> On Thu, Jun 5, 2014 at 4:25 AM, Abhishek Bhattacharjee <
> abhishek.bhattacharjee11@gmail.com> wrote:
>
> > Thanks for the reply. I re built kafka. And now when I am running server
> it
> > is stopping saying it cannot find the class Kafka.Kafka.
> > I don't know what went most probably it's an sbt problem.
> > Any help is welcome.
> > Thanks :-)
> > On Jun 5, 2014 6:05 AM, "Joe Stein" <jo...@stealth.ly> wrote:
> >
> > > The build looks fine your error seems valid maybe like your broker(s)
> > > is(are) not up.
> > >
> > > /*******************************************
> > > Joe Stein
> > > Founder, Principal Consultant
> > > Big Data Open Source Security LLC
> > > http://www.stealth.ly
> > > Twitter: @allthingshadoop
> > > ********************************************/
> > >
> > >
> > > > On Jun 4, 2014, at 8:07 PM, Abhishek Bhattacharjee <
> > > abhishek.bhattacharjee11@gmail.com> wrote:
> > > >
> > > > I followed the readme for kafka-0.8.0.
> > > > After I am getting the following warnings
> > > >
> > > >>> ./sbt assembly-package-dependency
> > > >
> > > > [info] Loading project definition from
> > > > /home/abhishek/Project/kafka-0.8.0-src/project
> > > > [warn] Multiple resolvers having different access mechanism
> configured
> > > with
> > > > same name 'sbt-plugin-releases'. To avoid conflict, Remove duplicate
> > > > project resolvers (`resolvers`) or rename publishing resolver
> > > (`publishTo`).
> > > > [info] Set current project to Kafka (in build
> > > > file:/home/abhishek/Project/kafka-0.8.0-src/)
> > > > [warn] Credentials file /home/abhishek/.m2/.credentials does not
> exist
> > > > [info] Compiling 213 Scala sources and 2 Java sources to
> > > >
> > /home/abhishek/Project/kafka-0.8.0-src/core/target/scala-2.8.0/classes...
> > > > [warn]
> > > >
> > >
> >
> /home/abhishek/Project/kafka-0.8.0-src/core/src/main/scala/kafka/api/LeaderAndIsrResponse.scala:66:
> > > > non variable type-argument String in type pattern (String, Int) is
> > > > unchecked since it is eliminated by erasure
> > > > [warn] for ((key:(String, Int), value) <- responseMap) {
> > > > [warn] ^
> > > > [warn]
> > > >
> > >
> >
> /home/abhishek/Project/kafka-0.8.0-src/core/src/main/scala/kafka/api/StopReplicaResponse.scala:67:
> > > > non variable type-argument String in type pattern (String, Int) is
> > > > unchecked since it is eliminated by erasure
> > > > [warn] for ((key:(String, Int), value) <- responseMap){
> > > > [warn] ^
> > > > [warn]
> > > >
> > >
> >
> /home/abhishek/Project/kafka-0.8.0-src/core/src/main/scala/kafka/utils/Utils.scala:383:
> > > > non variable type-argument V in type pattern List[V] is unchecked
> since
> > > it
> > > > is eliminated by erasure
> > > > [warn] case Some(l: List[V]) => m.put(k, v :: l)
> > > > [warn] ^
> > > > [warn] three warnings found
> > > > [warn] warning: [options] bootstrap class path not set in conjunction
> > > with
> > > > -source 1.5
> > > > [warn]
> > > >
> > >
> >
> /home/abhishek/Project/kafka-0.8.0-src/core/src/main/scala/kafka/tools/KafkaMigrationTool.java:261:
> > > > warning: [unchecked] unchecked conversion
> > > > [warn] ProducerThread producerThread = new
> > > > ProducerThread(producerDataChannel, producer, i);
> > > > [warn]
> > > > ^
> > > > [warn] required: Producer<byte[],byte[]>
> > > > [warn] found: Producer
> > > > [warn]
> > > >
> > >
> >
> /home/abhishek/Project/kafka-0.8.0-src/core/src/main/scala/kafka/tools/KafkaMigrationTool.java:338:
> > > > warning: [unchecked] unchecked call to KeyedMessage(String,K,V) as a
> > > member
> > > > of the raw type KeyedMessage
> > > > [warn] KeyedMessage<byte[], byte[]> producerData = new
> > > > KeyedMessage((String)topic, null, bytes);
> > > > [warn] ^
> > > > [warn] where K,V are type-variables:
> > > > [warn] K extends Object declared in class KeyedMessage
> > > > [warn] V extends Object declared in class KeyedMessage
> > > > [warn]
> > > >
> > >
> >
> /home/abhishek/Project/kafka-0.8.0-src/core/src/main/scala/kafka/tools/KafkaMigrationTool.java:338:
> > > > warning: [unchecked] unchecked conversion
> > > > [warn] KeyedMessage<byte[], byte[]> producerData = new
> > > > KeyedMessage((String)topic, null, bytes);
> > > > [warn] ^
> > > > [warn] required: KeyedMessage<byte[],byte[]>
> > > > [warn] found: KeyedMessage
> > > > [warn]
> > > >
> > >
> >
> /home/abhishek/Project/kafka-0.8.0-src/core/src/main/scala/kafka/tools/KafkaMigrationTool.java:371:
> > > > warning: [unchecked] unchecked call to KeyedMessage(String,K,V) as a
> > > member
> > > > of the raw type KeyedMessage
> > > > [warn] private KeyedMessage<byte[], byte[]> shutdownMessage = new
> > > > KeyedMessage("shutdown", null, null);
> > > > [warn] ^
> > > > [warn] where K,V are type-variables:
> > > > [warn] K extends Object declared in class KeyedMessage
> > > > [warn] V extends Object declared in class KeyedMessage
> > > > [warn]
> > > >
> > >
> >
> /home/abhishek/Project/kafka-0.8.0-src/core/src/main/scala/kafka/tools/KafkaMigrationTool.java:371:
> > > > warning: [unchecked] unchecked conversion
> > > > [warn] private KeyedMessage<byte[], byte[]> shutdownMessage = new
> > > > KeyedMessage("shutdown", null, null);
> > > > [warn] ^
> > > > [warn] required: KeyedMessage<byte[],byte[]>
> > > > [warn] found: KeyedMessage
> > > > [warn] 6 warnings
> > > > [info] Including zkclient-0.3.jar
> > > > [info] Including snappy-java-1.0.4.1.jar
> > > > [info] Including zookeeper-3.3.4.jar
> > > > [info] Including metrics-core-2.2.0.jar
> > > > [info] Including metrics-annotation-2.2.0.jar
> > > > [info] Including log4j-1.2.15.jar
> > > > [info] Including scala-compiler.jar
> > > > [info] Including jopt-simple-3.2.jar
> > > > [info] Including slf4j-api-1.7.2.jar
> > > > [info] Including slf4j-simple-1.6.4.jar
> > > > [info] Including scala-library.jar
> > > > [warn] Merging 'META-INF/NOTICE' with strategy 'rename'
> > > > [warn] Merging 'org/xerial/snappy/native/README' with strategy
> 'rename'
> > > > [warn] Merging 'META-INF/maven/org.xerial.snappy/snappy-java/LICENSE'
> > > with
> > > > strategy 'rename'
> > > > [warn] Merging 'LICENSE.txt' with strategy 'rename'
> > > > [warn] Merging 'META-INF/LICENSE' with strategy 'rename'
> > > > [warn] Merging 'META-INF/MANIFEST.MF' with strategy 'discard'
> > > > [warn] Strategy 'discard' was applied to a file
> > > > [warn] Strategy 'rename' was applied to 5 files
> > > > [info] Packaging
> > > >
> > >
> >
> /home/abhishek/Project/kafka-0.8.0-src/core/target/scala-2.8.0/kafka-assembly-0.8.0-deps.jar
> > > > ...
> > > > [info] Done packaging.
> > > > [success] Total time: 67 s, completed 5 Jun, 2014 5:31:28 AM
> > > >
> > > > I am not able run my Producer to insert into kafka.
> > > > The server runs but data doesn't go in. LeaderNotAvailableException
> is
> > > > raised.
> > > >
> > > > Thanks
> > > > --
> > > > *Abhishek Bhattacharjee*
> > > > *Pune Institute of Computer Technology*
> > >
> >
>
Re: Unable to build kafka.
Posted by Joe Stein <jo...@stealth.ly>.
Can you try the latest stable branch, please?
We moved to gradle https://github.com/apache/kafka/blob/0.8.1/README.md and
also distribute binaries as artifacts for download
https://kafka.apache.org/downloads.html
/*******************************************
Joe Stein
Founder, Principal Consultant
Big Data Open Source Security LLC
http://www.stealth.ly
Twitter: @allthingshadoop <http://www.twitter.com/allthingshadoop>
********************************************/
On Thu, Jun 5, 2014 at 4:25 AM, Abhishek Bhattacharjee <
abhishek.bhattacharjee11@gmail.com> wrote:
> Thanks for the reply. I re built kafka. And now when I am running server it
> is stopping saying it cannot find the class Kafka.Kafka.
> I don't know what went most probably it's an sbt problem.
> Any help is welcome.
> Thanks :-)
> On Jun 5, 2014 6:05 AM, "Joe Stein" <jo...@stealth.ly> wrote:
>
> > The build looks fine your error seems valid maybe like your broker(s)
> > is(are) not up.
> >
> > /*******************************************
> > Joe Stein
> > Founder, Principal Consultant
> > Big Data Open Source Security LLC
> > http://www.stealth.ly
> > Twitter: @allthingshadoop
> > ********************************************/
> >
> >
> > > On Jun 4, 2014, at 8:07 PM, Abhishek Bhattacharjee <
> > abhishek.bhattacharjee11@gmail.com> wrote:
> > >
> > > I followed the readme for kafka-0.8.0.
> > > After I am getting the following warnings
> > >
> > >>> ./sbt assembly-package-dependency
> > >
> > > [info] Loading project definition from
> > > /home/abhishek/Project/kafka-0.8.0-src/project
> > > [warn] Multiple resolvers having different access mechanism configured
> > with
> > > same name 'sbt-plugin-releases'. To avoid conflict, Remove duplicate
> > > project resolvers (`resolvers`) or rename publishing resolver
> > (`publishTo`).
> > > [info] Set current project to Kafka (in build
> > > file:/home/abhishek/Project/kafka-0.8.0-src/)
> > > [warn] Credentials file /home/abhishek/.m2/.credentials does not exist
> > > [info] Compiling 213 Scala sources and 2 Java sources to
> > >
> /home/abhishek/Project/kafka-0.8.0-src/core/target/scala-2.8.0/classes...
> > > [warn]
> > >
> >
> /home/abhishek/Project/kafka-0.8.0-src/core/src/main/scala/kafka/api/LeaderAndIsrResponse.scala:66:
> > > non variable type-argument String in type pattern (String, Int) is
> > > unchecked since it is eliminated by erasure
> > > [warn] for ((key:(String, Int), value) <- responseMap) {
> > > [warn] ^
> > > [warn]
> > >
> >
> /home/abhishek/Project/kafka-0.8.0-src/core/src/main/scala/kafka/api/StopReplicaResponse.scala:67:
> > > non variable type-argument String in type pattern (String, Int) is
> > > unchecked since it is eliminated by erasure
> > > [warn] for ((key:(String, Int), value) <- responseMap){
> > > [warn] ^
> > > [warn]
> > >
> >
> /home/abhishek/Project/kafka-0.8.0-src/core/src/main/scala/kafka/utils/Utils.scala:383:
> > > non variable type-argument V in type pattern List[V] is unchecked since
> > it
> > > is eliminated by erasure
> > > [warn] case Some(l: List[V]) => m.put(k, v :: l)
> > > [warn] ^
> > > [warn] three warnings found
> > > [warn] warning: [options] bootstrap class path not set in conjunction
> > with
> > > -source 1.5
> > > [warn]
> > >
> >
> /home/abhishek/Project/kafka-0.8.0-src/core/src/main/scala/kafka/tools/KafkaMigrationTool.java:261:
> > > warning: [unchecked] unchecked conversion
> > > [warn] ProducerThread producerThread = new
> > > ProducerThread(producerDataChannel, producer, i);
> > > [warn]
> > > ^
> > > [warn] required: Producer<byte[],byte[]>
> > > [warn] found: Producer
> > > [warn]
> > >
> >
> /home/abhishek/Project/kafka-0.8.0-src/core/src/main/scala/kafka/tools/KafkaMigrationTool.java:338:
> > > warning: [unchecked] unchecked call to KeyedMessage(String,K,V) as a
> > member
> > > of the raw type KeyedMessage
> > > [warn] KeyedMessage<byte[], byte[]> producerData = new
> > > KeyedMessage((String)topic, null, bytes);
> > > [warn] ^
> > > [warn] where K,V are type-variables:
> > > [warn] K extends Object declared in class KeyedMessage
> > > [warn] V extends Object declared in class KeyedMessage
> > > [warn]
> > >
> >
> /home/abhishek/Project/kafka-0.8.0-src/core/src/main/scala/kafka/tools/KafkaMigrationTool.java:338:
> > > warning: [unchecked] unchecked conversion
> > > [warn] KeyedMessage<byte[], byte[]> producerData = new
> > > KeyedMessage((String)topic, null, bytes);
> > > [warn] ^
> > > [warn] required: KeyedMessage<byte[],byte[]>
> > > [warn] found: KeyedMessage
> > > [warn]
> > >
> >
> /home/abhishek/Project/kafka-0.8.0-src/core/src/main/scala/kafka/tools/KafkaMigrationTool.java:371:
> > > warning: [unchecked] unchecked call to KeyedMessage(String,K,V) as a
> > member
> > > of the raw type KeyedMessage
> > > [warn] private KeyedMessage<byte[], byte[]> shutdownMessage = new
> > > KeyedMessage("shutdown", null, null);
> > > [warn] ^
> > > [warn] where K,V are type-variables:
> > > [warn] K extends Object declared in class KeyedMessage
> > > [warn] V extends Object declared in class KeyedMessage
> > > [warn]
> > >
> >
> /home/abhishek/Project/kafka-0.8.0-src/core/src/main/scala/kafka/tools/KafkaMigrationTool.java:371:
> > > warning: [unchecked] unchecked conversion
> > > [warn] private KeyedMessage<byte[], byte[]> shutdownMessage = new
> > > KeyedMessage("shutdown", null, null);
> > > [warn] ^
> > > [warn] required: KeyedMessage<byte[],byte[]>
> > > [warn] found: KeyedMessage
> > > [warn] 6 warnings
> > > [info] Including zkclient-0.3.jar
> > > [info] Including snappy-java-1.0.4.1.jar
> > > [info] Including zookeeper-3.3.4.jar
> > > [info] Including metrics-core-2.2.0.jar
> > > [info] Including metrics-annotation-2.2.0.jar
> > > [info] Including log4j-1.2.15.jar
> > > [info] Including scala-compiler.jar
> > > [info] Including jopt-simple-3.2.jar
> > > [info] Including slf4j-api-1.7.2.jar
> > > [info] Including slf4j-simple-1.6.4.jar
> > > [info] Including scala-library.jar
> > > [warn] Merging 'META-INF/NOTICE' with strategy 'rename'
> > > [warn] Merging 'org/xerial/snappy/native/README' with strategy 'rename'
> > > [warn] Merging 'META-INF/maven/org.xerial.snappy/snappy-java/LICENSE'
> > with
> > > strategy 'rename'
> > > [warn] Merging 'LICENSE.txt' with strategy 'rename'
> > > [warn] Merging 'META-INF/LICENSE' with strategy 'rename'
> > > [warn] Merging 'META-INF/MANIFEST.MF' with strategy 'discard'
> > > [warn] Strategy 'discard' was applied to a file
> > > [warn] Strategy 'rename' was applied to 5 files
> > > [info] Packaging
> > >
> >
> /home/abhishek/Project/kafka-0.8.0-src/core/target/scala-2.8.0/kafka-assembly-0.8.0-deps.jar
> > > ...
> > > [info] Done packaging.
> > > [success] Total time: 67 s, completed 5 Jun, 2014 5:31:28 AM
> > >
> > > I am not able run my Producer to insert into kafka.
> > > The server runs but data doesn't go in. LeaderNotAvailableException is
> > > raised.
> > >
> > > Thanks
> > > --
> > > *Abhishek Bhattacharjee*
> > > *Pune Institute of Computer Technology*
> >
>
Re: Unable to build kafka.
Posted by Abhishek Bhattacharjee <ab...@gmail.com>.
Thanks for the reply. I re built kafka. And now when I am running server it
is stopping saying it cannot find the class Kafka.Kafka.
I don't know what went most probably it's an sbt problem.
Any help is welcome.
Thanks :-)
On Jun 5, 2014 6:05 AM, "Joe Stein" <jo...@stealth.ly> wrote:
> The build looks fine your error seems valid maybe like your broker(s)
> is(are) not up.
>
> /*******************************************
> Joe Stein
> Founder, Principal Consultant
> Big Data Open Source Security LLC
> http://www.stealth.ly
> Twitter: @allthingshadoop
> ********************************************/
>
>
> > On Jun 4, 2014, at 8:07 PM, Abhishek Bhattacharjee <
> abhishek.bhattacharjee11@gmail.com> wrote:
> >
> > I followed the readme for kafka-0.8.0.
> > After I am getting the following warnings
> >
> >>> ./sbt assembly-package-dependency
> >
> > [info] Loading project definition from
> > /home/abhishek/Project/kafka-0.8.0-src/project
> > [warn] Multiple resolvers having different access mechanism configured
> with
> > same name 'sbt-plugin-releases'. To avoid conflict, Remove duplicate
> > project resolvers (`resolvers`) or rename publishing resolver
> (`publishTo`).
> > [info] Set current project to Kafka (in build
> > file:/home/abhishek/Project/kafka-0.8.0-src/)
> > [warn] Credentials file /home/abhishek/.m2/.credentials does not exist
> > [info] Compiling 213 Scala sources and 2 Java sources to
> > /home/abhishek/Project/kafka-0.8.0-src/core/target/scala-2.8.0/classes...
> > [warn]
> >
> /home/abhishek/Project/kafka-0.8.0-src/core/src/main/scala/kafka/api/LeaderAndIsrResponse.scala:66:
> > non variable type-argument String in type pattern (String, Int) is
> > unchecked since it is eliminated by erasure
> > [warn] for ((key:(String, Int), value) <- responseMap) {
> > [warn] ^
> > [warn]
> >
> /home/abhishek/Project/kafka-0.8.0-src/core/src/main/scala/kafka/api/StopReplicaResponse.scala:67:
> > non variable type-argument String in type pattern (String, Int) is
> > unchecked since it is eliminated by erasure
> > [warn] for ((key:(String, Int), value) <- responseMap){
> > [warn] ^
> > [warn]
> >
> /home/abhishek/Project/kafka-0.8.0-src/core/src/main/scala/kafka/utils/Utils.scala:383:
> > non variable type-argument V in type pattern List[V] is unchecked since
> it
> > is eliminated by erasure
> > [warn] case Some(l: List[V]) => m.put(k, v :: l)
> > [warn] ^
> > [warn] three warnings found
> > [warn] warning: [options] bootstrap class path not set in conjunction
> with
> > -source 1.5
> > [warn]
> >
> /home/abhishek/Project/kafka-0.8.0-src/core/src/main/scala/kafka/tools/KafkaMigrationTool.java:261:
> > warning: [unchecked] unchecked conversion
> > [warn] ProducerThread producerThread = new
> > ProducerThread(producerDataChannel, producer, i);
> > [warn]
> > ^
> > [warn] required: Producer<byte[],byte[]>
> > [warn] found: Producer
> > [warn]
> >
> /home/abhishek/Project/kafka-0.8.0-src/core/src/main/scala/kafka/tools/KafkaMigrationTool.java:338:
> > warning: [unchecked] unchecked call to KeyedMessage(String,K,V) as a
> member
> > of the raw type KeyedMessage
> > [warn] KeyedMessage<byte[], byte[]> producerData = new
> > KeyedMessage((String)topic, null, bytes);
> > [warn] ^
> > [warn] where K,V are type-variables:
> > [warn] K extends Object declared in class KeyedMessage
> > [warn] V extends Object declared in class KeyedMessage
> > [warn]
> >
> /home/abhishek/Project/kafka-0.8.0-src/core/src/main/scala/kafka/tools/KafkaMigrationTool.java:338:
> > warning: [unchecked] unchecked conversion
> > [warn] KeyedMessage<byte[], byte[]> producerData = new
> > KeyedMessage((String)topic, null, bytes);
> > [warn] ^
> > [warn] required: KeyedMessage<byte[],byte[]>
> > [warn] found: KeyedMessage
> > [warn]
> >
> /home/abhishek/Project/kafka-0.8.0-src/core/src/main/scala/kafka/tools/KafkaMigrationTool.java:371:
> > warning: [unchecked] unchecked call to KeyedMessage(String,K,V) as a
> member
> > of the raw type KeyedMessage
> > [warn] private KeyedMessage<byte[], byte[]> shutdownMessage = new
> > KeyedMessage("shutdown", null, null);
> > [warn] ^
> > [warn] where K,V are type-variables:
> > [warn] K extends Object declared in class KeyedMessage
> > [warn] V extends Object declared in class KeyedMessage
> > [warn]
> >
> /home/abhishek/Project/kafka-0.8.0-src/core/src/main/scala/kafka/tools/KafkaMigrationTool.java:371:
> > warning: [unchecked] unchecked conversion
> > [warn] private KeyedMessage<byte[], byte[]> shutdownMessage = new
> > KeyedMessage("shutdown", null, null);
> > [warn] ^
> > [warn] required: KeyedMessage<byte[],byte[]>
> > [warn] found: KeyedMessage
> > [warn] 6 warnings
> > [info] Including zkclient-0.3.jar
> > [info] Including snappy-java-1.0.4.1.jar
> > [info] Including zookeeper-3.3.4.jar
> > [info] Including metrics-core-2.2.0.jar
> > [info] Including metrics-annotation-2.2.0.jar
> > [info] Including log4j-1.2.15.jar
> > [info] Including scala-compiler.jar
> > [info] Including jopt-simple-3.2.jar
> > [info] Including slf4j-api-1.7.2.jar
> > [info] Including slf4j-simple-1.6.4.jar
> > [info] Including scala-library.jar
> > [warn] Merging 'META-INF/NOTICE' with strategy 'rename'
> > [warn] Merging 'org/xerial/snappy/native/README' with strategy 'rename'
> > [warn] Merging 'META-INF/maven/org.xerial.snappy/snappy-java/LICENSE'
> with
> > strategy 'rename'
> > [warn] Merging 'LICENSE.txt' with strategy 'rename'
> > [warn] Merging 'META-INF/LICENSE' with strategy 'rename'
> > [warn] Merging 'META-INF/MANIFEST.MF' with strategy 'discard'
> > [warn] Strategy 'discard' was applied to a file
> > [warn] Strategy 'rename' was applied to 5 files
> > [info] Packaging
> >
> /home/abhishek/Project/kafka-0.8.0-src/core/target/scala-2.8.0/kafka-assembly-0.8.0-deps.jar
> > ...
> > [info] Done packaging.
> > [success] Total time: 67 s, completed 5 Jun, 2014 5:31:28 AM
> >
> > I am not able run my Producer to insert into kafka.
> > The server runs but data doesn't go in. LeaderNotAvailableException is
> > raised.
> >
> > Thanks
> > --
> > *Abhishek Bhattacharjee*
> > *Pune Institute of Computer Technology*
>
Re: Unable to build kafka.
Posted by Joe Stein <jo...@stealth.ly>.
The build looks fine your error seems valid maybe like your broker(s) is(are) not up.
/*******************************************
Joe Stein
Founder, Principal Consultant
Big Data Open Source Security LLC
http://www.stealth.ly
Twitter: @allthingshadoop
********************************************/
> On Jun 4, 2014, at 8:07 PM, Abhishek Bhattacharjee <ab...@gmail.com> wrote:
>
> I followed the readme for kafka-0.8.0.
> After I am getting the following warnings
>
>>> ./sbt assembly-package-dependency
>
> [info] Loading project definition from
> /home/abhishek/Project/kafka-0.8.0-src/project
> [warn] Multiple resolvers having different access mechanism configured with
> same name 'sbt-plugin-releases'. To avoid conflict, Remove duplicate
> project resolvers (`resolvers`) or rename publishing resolver (`publishTo`).
> [info] Set current project to Kafka (in build
> file:/home/abhishek/Project/kafka-0.8.0-src/)
> [warn] Credentials file /home/abhishek/.m2/.credentials does not exist
> [info] Compiling 213 Scala sources and 2 Java sources to
> /home/abhishek/Project/kafka-0.8.0-src/core/target/scala-2.8.0/classes...
> [warn]
> /home/abhishek/Project/kafka-0.8.0-src/core/src/main/scala/kafka/api/LeaderAndIsrResponse.scala:66:
> non variable type-argument String in type pattern (String, Int) is
> unchecked since it is eliminated by erasure
> [warn] for ((key:(String, Int), value) <- responseMap) {
> [warn] ^
> [warn]
> /home/abhishek/Project/kafka-0.8.0-src/core/src/main/scala/kafka/api/StopReplicaResponse.scala:67:
> non variable type-argument String in type pattern (String, Int) is
> unchecked since it is eliminated by erasure
> [warn] for ((key:(String, Int), value) <- responseMap){
> [warn] ^
> [warn]
> /home/abhishek/Project/kafka-0.8.0-src/core/src/main/scala/kafka/utils/Utils.scala:383:
> non variable type-argument V in type pattern List[V] is unchecked since it
> is eliminated by erasure
> [warn] case Some(l: List[V]) => m.put(k, v :: l)
> [warn] ^
> [warn] three warnings found
> [warn] warning: [options] bootstrap class path not set in conjunction with
> -source 1.5
> [warn]
> /home/abhishek/Project/kafka-0.8.0-src/core/src/main/scala/kafka/tools/KafkaMigrationTool.java:261:
> warning: [unchecked] unchecked conversion
> [warn] ProducerThread producerThread = new
> ProducerThread(producerDataChannel, producer, i);
> [warn]
> ^
> [warn] required: Producer<byte[],byte[]>
> [warn] found: Producer
> [warn]
> /home/abhishek/Project/kafka-0.8.0-src/core/src/main/scala/kafka/tools/KafkaMigrationTool.java:338:
> warning: [unchecked] unchecked call to KeyedMessage(String,K,V) as a member
> of the raw type KeyedMessage
> [warn] KeyedMessage<byte[], byte[]> producerData = new
> KeyedMessage((String)topic, null, bytes);
> [warn] ^
> [warn] where K,V are type-variables:
> [warn] K extends Object declared in class KeyedMessage
> [warn] V extends Object declared in class KeyedMessage
> [warn]
> /home/abhishek/Project/kafka-0.8.0-src/core/src/main/scala/kafka/tools/KafkaMigrationTool.java:338:
> warning: [unchecked] unchecked conversion
> [warn] KeyedMessage<byte[], byte[]> producerData = new
> KeyedMessage((String)topic, null, bytes);
> [warn] ^
> [warn] required: KeyedMessage<byte[],byte[]>
> [warn] found: KeyedMessage
> [warn]
> /home/abhishek/Project/kafka-0.8.0-src/core/src/main/scala/kafka/tools/KafkaMigrationTool.java:371:
> warning: [unchecked] unchecked call to KeyedMessage(String,K,V) as a member
> of the raw type KeyedMessage
> [warn] private KeyedMessage<byte[], byte[]> shutdownMessage = new
> KeyedMessage("shutdown", null, null);
> [warn] ^
> [warn] where K,V are type-variables:
> [warn] K extends Object declared in class KeyedMessage
> [warn] V extends Object declared in class KeyedMessage
> [warn]
> /home/abhishek/Project/kafka-0.8.0-src/core/src/main/scala/kafka/tools/KafkaMigrationTool.java:371:
> warning: [unchecked] unchecked conversion
> [warn] private KeyedMessage<byte[], byte[]> shutdownMessage = new
> KeyedMessage("shutdown", null, null);
> [warn] ^
> [warn] required: KeyedMessage<byte[],byte[]>
> [warn] found: KeyedMessage
> [warn] 6 warnings
> [info] Including zkclient-0.3.jar
> [info] Including snappy-java-1.0.4.1.jar
> [info] Including zookeeper-3.3.4.jar
> [info] Including metrics-core-2.2.0.jar
> [info] Including metrics-annotation-2.2.0.jar
> [info] Including log4j-1.2.15.jar
> [info] Including scala-compiler.jar
> [info] Including jopt-simple-3.2.jar
> [info] Including slf4j-api-1.7.2.jar
> [info] Including slf4j-simple-1.6.4.jar
> [info] Including scala-library.jar
> [warn] Merging 'META-INF/NOTICE' with strategy 'rename'
> [warn] Merging 'org/xerial/snappy/native/README' with strategy 'rename'
> [warn] Merging 'META-INF/maven/org.xerial.snappy/snappy-java/LICENSE' with
> strategy 'rename'
> [warn] Merging 'LICENSE.txt' with strategy 'rename'
> [warn] Merging 'META-INF/LICENSE' with strategy 'rename'
> [warn] Merging 'META-INF/MANIFEST.MF' with strategy 'discard'
> [warn] Strategy 'discard' was applied to a file
> [warn] Strategy 'rename' was applied to 5 files
> [info] Packaging
> /home/abhishek/Project/kafka-0.8.0-src/core/target/scala-2.8.0/kafka-assembly-0.8.0-deps.jar
> ...
> [info] Done packaging.
> [success] Total time: 67 s, completed 5 Jun, 2014 5:31:28 AM
>
> I am not able run my Producer to insert into kafka.
> The server runs but data doesn't go in. LeaderNotAvailableException is
> raised.
>
> Thanks
> --
> *Abhishek Bhattacharjee*
> *Pune Institute of Computer Technology*