You are viewing a plain text version of this content. The canonical link for it is here.
Posted to users@kafka.apache.org by "Matthias J. Sax" <ma...@confluent.io> on 2018/06/23 01:43:08 UTC
[VOTE] 0.10.2.2 RC1
Hello Kafka users, developers and client-developers,
This is the second candidate for release of Apache Kafka 0.10.2.2.
Note, that RC0 was created before the upgrade to Gradle 4.8.1 and thus,
we discarded it in favor of RC1 (without sending out a email for RC0).
This is a bug fix release closing 29 tickets:
https://cwiki.apache.org/confluence/display/KAFKA/Release+Plan+0.10.2.2
Release notes for the 0.10.2.2 release:
http://home.apache.org/~mjsax/kafka-0.10.2.2-rc1/RELEASE_NOTES.html
*** Please download, test and vote by Tuesday, 6/26/18 end-of-day, so we
can close the vote on Wednesday.
Kafka's KEYS file containing PGP keys we use to sign the release:
http://kafka.apache.org/KEYS
* Release artifacts to be voted upon (source and binary):
http://home.apache.org/~mjsax/kafka-0.10.2.2-rc1/
* Maven artifacts to be voted upon:
https://repository.apache.org/content/groups/staging/
* Javadoc:
http://home.apache.org/~mjsax/kafka-0.10.2.2-rc1/javadoc/
* Tag to be voted upon (off 0.10.2 branch) is the 0.10.2.2 tag:
https://github.com/apache/kafka/releases/tag/0.10.2.2-rc1
* Documentation:
http://kafka.apache.org/0102/documentation.html
* Protocol:
http://kafka.apache.org/0102/protocol.html
* Successful Jenkins builds for the 0.10.2 branch:
Unit/integration tests: https://builds.apache.org/job/kafka-0.10.2-jdk7/220/
/**************************************
Thanks,
-Matthias
Re: [kafka-clients] [VOTE] 0.10.2.2 RC1
Posted by "Matthias J. Sax" <ma...@confluent.io>.
+1
-Matthias
On 6/29/18 2:46 PM, Jun Rao wrote:
> Hi, Matthias,
>
> Thanks for running the release. Verified quickstart on scala 2.12 binary. +1
>
> Jun
>
> On Fri, Jun 22, 2018 at 6:43 PM, Matthias J. Sax <matthias@confluent.io
> <ma...@confluent.io>> wrote:
>
> Hello Kafka users, developers and client-developers,
>
> This is the second candidate for release of Apache Kafka 0.10.2.2.
>
> Note, that RC0 was created before the upgrade to Gradle 4.8.1 and thus,
> we discarded it in favor of RC1 (without sending out a email for RC0).
>
> This is a bug fix release closing 29 tickets:
> https://cwiki.apache.org/confluence/display/KAFKA/Release+Plan+0.10.2.2
> <https://cwiki.apache.org/confluence/display/KAFKA/Release+Plan+0.10.2.2>
>
> Release notes for the 0.10.2.2 release:
> http://home.apache.org/~mjsax/kafka-0.10.2.2-rc1/RELEASE_NOTES.html
> <http://home.apache.org/~mjsax/kafka-0.10.2.2-rc1/RELEASE_NOTES.html>
>
> *** Please download, test and vote by Tuesday, 6/26/18 end-of-day, so we
> can close the vote on Wednesday.
>
> Kafka's KEYS file containing PGP keys we use to sign the release:
> http://kafka.apache.org/KEYS
>
> * Release artifacts to be voted upon (source and binary):
> http://home.apache.org/~mjsax/kafka-0.10.2.2-rc1/
> <http://home.apache.org/~mjsax/kafka-0.10.2.2-rc1/>
>
> * Maven artifacts to be voted upon:
> https://repository.apache.org/content/groups/staging/
> <https://repository.apache.org/content/groups/staging/>
>
> * Javadoc:
> http://home.apache.org/~mjsax/kafka-0.10.2.2-rc1/javadoc/
> <http://home.apache.org/~mjsax/kafka-0.10.2.2-rc1/javadoc/>
>
> * Tag to be voted upon (off 0.10.2 branch) is the 0.10.2.2 tag:
> https://github.com/apache/kafka/releases/tag/0.10.2.2-rc1
> <https://github.com/apache/kafka/releases/tag/0.10.2.2-rc1>
>
> * Documentation:
> http://kafka.apache.org/0102/documentation.html
> <http://kafka.apache.org/0102/documentation.html>
>
> * Protocol:
> http://kafka.apache.org/0102/protocol.html
> <http://kafka.apache.org/0102/protocol.html>
>
> * Successful Jenkins builds for the 0.10.2 branch:
> Unit/integration tests:
> https://builds.apache.org/job/kafka-0.10.2-jdk7/220/
> <https://builds.apache.org/job/kafka-0.10.2-jdk7/220/>
>
> /**************************************
>
> Thanks,
> -Matthias
>
> --
> You received this message because you are subscribed to the Google
> Groups "kafka-clients" group.
> To unsubscribe from this group and stop receiving emails from it,
> send an email to kafka-clients+unsubscribe@googlegroups.com
> <ma...@googlegroups.com>.
> To post to this group, send email to kafka-clients@googlegroups.com
> <ma...@googlegroups.com>.
> Visit this group at https://groups.google.com/group/kafka-clients
> <https://groups.google.com/group/kafka-clients>.
> To view this discussion on the web visit
> https://groups.google.com/d/msgid/kafka-clients/8228115e-6913-5c37-06d9-7410a7bd7f69%40confluent.io
> <https://groups.google.com/d/msgid/kafka-clients/8228115e-6913-5c37-06d9-7410a7bd7f69%40confluent.io>.
> For more options, visit https://groups.google.com/d/optout
> <https://groups.google.com/d/optout>.
>
>
Re: [kafka-clients] [VOTE] 0.10.2.2 RC1
Posted by "Matthias J. Sax" <ma...@confluent.io>.
+1
-Matthias
On 6/29/18 2:46 PM, Jun Rao wrote:
> Hi, Matthias,
>
> Thanks for running the release. Verified quickstart on scala 2.12 binary. +1
>
> Jun
>
> On Fri, Jun 22, 2018 at 6:43 PM, Matthias J. Sax <matthias@confluent.io
> <ma...@confluent.io>> wrote:
>
> Hello Kafka users, developers and client-developers,
>
> This is the second candidate for release of Apache Kafka 0.10.2.2.
>
> Note, that RC0 was created before the upgrade to Gradle 4.8.1 and thus,
> we discarded it in favor of RC1 (without sending out a email for RC0).
>
> This is a bug fix release closing 29 tickets:
> https://cwiki.apache.org/confluence/display/KAFKA/Release+Plan+0.10.2.2
> <https://cwiki.apache.org/confluence/display/KAFKA/Release+Plan+0.10.2.2>
>
> Release notes for the 0.10.2.2 release:
> http://home.apache.org/~mjsax/kafka-0.10.2.2-rc1/RELEASE_NOTES.html
> <http://home.apache.org/~mjsax/kafka-0.10.2.2-rc1/RELEASE_NOTES.html>
>
> *** Please download, test and vote by Tuesday, 6/26/18 end-of-day, so we
> can close the vote on Wednesday.
>
> Kafka's KEYS file containing PGP keys we use to sign the release:
> http://kafka.apache.org/KEYS
>
> * Release artifacts to be voted upon (source and binary):
> http://home.apache.org/~mjsax/kafka-0.10.2.2-rc1/
> <http://home.apache.org/~mjsax/kafka-0.10.2.2-rc1/>
>
> * Maven artifacts to be voted upon:
> https://repository.apache.org/content/groups/staging/
> <https://repository.apache.org/content/groups/staging/>
>
> * Javadoc:
> http://home.apache.org/~mjsax/kafka-0.10.2.2-rc1/javadoc/
> <http://home.apache.org/~mjsax/kafka-0.10.2.2-rc1/javadoc/>
>
> * Tag to be voted upon (off 0.10.2 branch) is the 0.10.2.2 tag:
> https://github.com/apache/kafka/releases/tag/0.10.2.2-rc1
> <https://github.com/apache/kafka/releases/tag/0.10.2.2-rc1>
>
> * Documentation:
> http://kafka.apache.org/0102/documentation.html
> <http://kafka.apache.org/0102/documentation.html>
>
> * Protocol:
> http://kafka.apache.org/0102/protocol.html
> <http://kafka.apache.org/0102/protocol.html>
>
> * Successful Jenkins builds for the 0.10.2 branch:
> Unit/integration tests:
> https://builds.apache.org/job/kafka-0.10.2-jdk7/220/
> <https://builds.apache.org/job/kafka-0.10.2-jdk7/220/>
>
> /**************************************
>
> Thanks,
> -Matthias
>
> --
> You received this message because you are subscribed to the Google
> Groups "kafka-clients" group.
> To unsubscribe from this group and stop receiving emails from it,
> send an email to kafka-clients+unsubscribe@googlegroups.com
> <ma...@googlegroups.com>.
> To post to this group, send email to kafka-clients@googlegroups.com
> <ma...@googlegroups.com>.
> Visit this group at https://groups.google.com/group/kafka-clients
> <https://groups.google.com/group/kafka-clients>.
> To view this discussion on the web visit
> https://groups.google.com/d/msgid/kafka-clients/8228115e-6913-5c37-06d9-7410a7bd7f69%40confluent.io
> <https://groups.google.com/d/msgid/kafka-clients/8228115e-6913-5c37-06d9-7410a7bd7f69%40confluent.io>.
> For more options, visit https://groups.google.com/d/optout
> <https://groups.google.com/d/optout>.
>
>
Re: [kafka-clients] [VOTE] 0.10.2.2 RC1
Posted by Jun Rao <ju...@confluent.io>.
Hi, Matthias,
Thanks for running the release. Verified quickstart on scala 2.12 binary. +1
Jun
On Fri, Jun 22, 2018 at 6:43 PM, Matthias J. Sax <ma...@confluent.io>
wrote:
> Hello Kafka users, developers and client-developers,
>
> This is the second candidate for release of Apache Kafka 0.10.2.2.
>
> Note, that RC0 was created before the upgrade to Gradle 4.8.1 and thus,
> we discarded it in favor of RC1 (without sending out a email for RC0).
>
> This is a bug fix release closing 29 tickets:
> https://cwiki.apache.org/confluence/display/KAFKA/Release+Plan+0.10.2.2
>
> Release notes for the 0.10.2.2 release:
> http://home.apache.org/~mjsax/kafka-0.10.2.2-rc1/RELEASE_NOTES.html
>
> *** Please download, test and vote by Tuesday, 6/26/18 end-of-day, so we
> can close the vote on Wednesday.
>
> Kafka's KEYS file containing PGP keys we use to sign the release:
> http://kafka.apache.org/KEYS
>
> * Release artifacts to be voted upon (source and binary):
> http://home.apache.org/~mjsax/kafka-0.10.2.2-rc1/
>
> * Maven artifacts to be voted upon:
> https://repository.apache.org/content/groups/staging/
>
> * Javadoc:
> http://home.apache.org/~mjsax/kafka-0.10.2.2-rc1/javadoc/
>
> * Tag to be voted upon (off 0.10.2 branch) is the 0.10.2.2 tag:
> https://github.com/apache/kafka/releases/tag/0.10.2.2-rc1
>
> * Documentation:
> http://kafka.apache.org/0102/documentation.html
>
> * Protocol:
> http://kafka.apache.org/0102/protocol.html
>
> * Successful Jenkins builds for the 0.10.2 branch:
> Unit/integration tests: https://builds.apache.org/job/
> kafka-0.10.2-jdk7/220/
>
> /**************************************
>
> Thanks,
> -Matthias
>
> --
> You received this message because you are subscribed to the Google Groups
> "kafka-clients" group.
> To unsubscribe from this group and stop receiving emails from it, send an
> email to kafka-clients+unsubscribe@googlegroups.com.
> To post to this group, send email to kafka-clients@googlegroups.com.
> Visit this group at https://groups.google.com/group/kafka-clients.
> To view this discussion on the web visit https://groups.google.com/d/
> msgid/kafka-clients/8228115e-6913-5c37-06d9-7410a7bd7f69%40confluent.io.
> For more options, visit https://groups.google.com/d/optout.
>
Re: [VOTE] 0.10.2.2 RC1
Posted by Ted Yu <yu...@gmail.com>.
+1
Ran test suite.
Checked signatures.
On Fri, Jun 29, 2018 at 10:21 AM, Jason Gustafson <ja...@confluent.io>
wrote:
> +1 (binding). I checked release notes, documentation, and went through the
> quickstart.
>
> Thanks Matthias!
>
> On Fri, Jun 22, 2018 at 6:43 PM, Matthias J. Sax <ma...@confluent.io>
> wrote:
>
> > Hello Kafka users, developers and client-developers,
> >
> > This is the second candidate for release of Apache Kafka 0.10.2.2.
> >
> > Note, that RC0 was created before the upgrade to Gradle 4.8.1 and thus,
> > we discarded it in favor of RC1 (without sending out a email for RC0).
> >
> > This is a bug fix release closing 29 tickets:
> > https://cwiki.apache.org/confluence/display/KAFKA/Release+Plan+0.10.2.2
> >
> > Release notes for the 0.10.2.2 release:
> > http://home.apache.org/~mjsax/kafka-0.10.2.2-rc1/RELEASE_NOTES.html
> >
> > *** Please download, test and vote by Tuesday, 6/26/18 end-of-day, so we
> > can close the vote on Wednesday.
> >
> > Kafka's KEYS file containing PGP keys we use to sign the release:
> > http://kafka.apache.org/KEYS
> >
> > * Release artifacts to be voted upon (source and binary):
> > http://home.apache.org/~mjsax/kafka-0.10.2.2-rc1/
> >
> > * Maven artifacts to be voted upon:
> > https://repository.apache.org/content/groups/staging/
> >
> > * Javadoc:
> > http://home.apache.org/~mjsax/kafka-0.10.2.2-rc1/javadoc/
> >
> > * Tag to be voted upon (off 0.10.2 branch) is the 0.10.2.2 tag:
> > https://github.com/apache/kafka/releases/tag/0.10.2.2-rc1
> >
> > * Documentation:
> > http://kafka.apache.org/0102/documentation.html
> >
> > * Protocol:
> > http://kafka.apache.org/0102/protocol.html
> >
> > * Successful Jenkins builds for the 0.10.2 branch:
> > Unit/integration tests: https://builds.apache.org/job/
> > kafka-0.10.2-jdk7/220/
> >
> > /**************************************
> >
> > Thanks,
> > -Matthias
> >
> >
>
Re: [VOTE] 0.10.2.2 RC1
Posted by Guozhang Wang <wa...@gmail.com>.
+1 (binding). Verified java docs, and ran the unit tests with the source
tgz.
Guozhang
On Fri, Jun 29, 2018 at 10:22 AM Jason Gustafson <ja...@confluent.io> wrote:
> +1 (binding). I checked release notes, documentation, and went through the
> quickstart.
>
> Thanks Matthias!
>
> On Fri, Jun 22, 2018 at 6:43 PM, Matthias J. Sax <ma...@confluent.io>
> wrote:
>
> > Hello Kafka users, developers and client-developers,
> >
> > This is the second candidate for release of Apache Kafka 0.10.2.2.
> >
> > Note, that RC0 was created before the upgrade to Gradle 4.8.1 and thus,
> > we discarded it in favor of RC1 (without sending out a email for RC0).
> >
> > This is a bug fix release closing 29 tickets:
> > https://cwiki.apache.org/confluence/display/KAFKA/Release+Plan+0.10.2.2
> >
> > Release notes for the 0.10.2.2 release:
> > http://home.apache.org/~mjsax/kafka-0.10.2.2-rc1/RELEASE_NOTES.html
> >
> > *** Please download, test and vote by Tuesday, 6/26/18 end-of-day, so we
> > can close the vote on Wednesday.
> >
> > Kafka's KEYS file containing PGP keys we use to sign the release:
> > http://kafka.apache.org/KEYS
> >
> > * Release artifacts to be voted upon (source and binary):
> > http://home.apache.org/~mjsax/kafka-0.10.2.2-rc1/
> >
> > * Maven artifacts to be voted upon:
> > https://repository.apache.org/content/groups/staging/
> >
> > * Javadoc:
> > http://home.apache.org/~mjsax/kafka-0.10.2.2-rc1/javadoc/
> >
> > * Tag to be voted upon (off 0.10.2 branch) is the 0.10.2.2 tag:
> > https://github.com/apache/kafka/releases/tag/0.10.2.2-rc1
> >
> > * Documentation:
> > http://kafka.apache.org/0102/documentation.html
> >
> > * Protocol:
> > http://kafka.apache.org/0102/protocol.html
> >
> > * Successful Jenkins builds for the 0.10.2 branch:
> > Unit/integration tests: https://builds.apache.org/job/
> > kafka-0.10.2-jdk7/220/
> >
> > /**************************************
> >
> > Thanks,
> > -Matthias
> >
> >
>
--
-- Guozhang
RE: [VOTE] 0.10.2.2 RC1
Posted by "Coluccio, Stephen" <St...@weil.com>.
Hey Everyone,
I have been experiencing some problems and have not been able to find sufficient documentation online to help me figure out the root cuase. I have a 3 node kafka cluster set up on 3 different Windows 2012 servers. The cluster runs perfectly fine, ingesting data that is being sent via filebeat and winlogbeat (Elastic log collectors). I then have my logstash cluster configured to consume the data from Kafka. But pretty frequently, the data will stop coming in to my Logstash cluster. When I go to check on Kafak, it looks like something keeps preventing it from reaching the broker. When I run " .\kafka-console-consumer.bat --bootstrap-server localhost:9092 --topic winlogbeat" I get the following message.
[2018-06-29 13:48:13,921] WARN [Consumer clientId=consumer-1, groupId=console-consumer-34649] Connection to node -1 coul
d not be established. Broker may not be available. (org.apache.kafka.clients.NetworkClient)
[2018-06-29 13:48:14,999] WARN [Consumer clientId=consumer-1, groupId=console-consumer-34649] Connection to node -1 coul
d not be established. Broker may not be available. (org.apache.kafka.clients.NetworkClient)
The only way to fix it is to stop Kafka, remove all of the _consumer_offset files in C:\kafka\var\data and then starting Kafka again.
I see these errors in the Zookeeper logs:
[2018-06-25 04:54:12,305] WARN Interrupted while waiting for message on queue (org.apache.zookeeper.server.quorum.QuorumCnxManager)
java.lang.InterruptedException
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.reportInterruptAfterWait(AbstractQueuedSynchronizer.java:2014)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2088)
at java.util.concurrent.ArrayBlockingQueue.poll(ArrayBlockingQueue.java:418)
at org.apache.zookeeper.server.quorum.QuorumCnxManager.pollSendQueue(QuorumCnxManager.java:1097)
at org.apache.zookeeper.server.quorum.QuorumCnxManager.access$700(QuorumCnxManager.java:74)
at org.apache.zookeeper.server.quorum.QuorumCnxManager$SendWorker.run(QuorumCnxManager.java:932)
[2018-06-25 04:54:12,305] WARN Send worker leaving thread (org.apache.zookeeper.server.quorum.QuorumCnxManager)
[2018-06-25 04:55:19,336] INFO Received connection request /10.1.17.93:57654 (org.apache.zookeeper.server.quorum.QuorumCnxManager)
[2018-06-25 04:55:23,711] WARN Exception reading or writing challenge: java.net.SocketException: Connection reset (org.apache.zookeeper.server.quorum.QuorumCnxManager)
[2018-06-25 04:55:23,711] INFO Received connection request /10.1.17.93:57655 (org.apache.zookeeper.server.quorum.QuorumCnxManager)
[2018-06-25 04:55:23,711] WARN Exception reading or writing challenge: java.net.SocketException: Connection reset (org.apache.zookeeper.server.quorum.QuorumCnxManager)
[2018-06-25 05:03:02,134] INFO Received connection request /10.1.17.93:59024 (org.apache.zookeeper.server.quorum.QuorumCnxManager)
And I see these errors on Kafka:
log4j:ERROR Failed to rename [/logs/server.log] to [/logs/server.log.2018-06-25-13].
log4j:ERROR Failed to rename [/logs/log-cleaner.log] to [/logs/log-cleaner.log.2018-06-25-13].
log4j:ERROR Failed to rename [/logs/server.log] to [/logs/server.log.2018-06-25-14].
log4j:ERROR Failed to rename [/logs/log-cleaner.log] to [/logs/log-cleaner.log.2018-06-25-14].
log4j:ERROR Failed to rename [/logs/server.log] to [/logs/server.log.2018-06-25-15].
Can anyone help me out?
-Steve
________________________________
The information contained in this email message is intended only for use of the individual or entity named above. If the reader of this message is not the intended recipient, or the employee or agent responsible to deliver it to the intended recipient, you are hereby notified that any dissemination, distribution or copying of this communication is strictly prohibited. If you have received this communication in error, please immediately notify us by email, postmaster@weil.com, and destroy the original message. Thank you.
RE: [VOTE] 0.10.2.2 RC1
Posted by "Coluccio, Stephen" <St...@weil.com>.
Sorry everyone, I meant to change the subject of this email but forgot to before I sent it. I did not mean to hijack this thread. I apologize for the interruption.
-Steve
-----Original Message-----
From: Coluccio, Stephen
Sent: Friday, June 29, 2018 2:05 PM
To: Kafka Users <us...@kafka.apache.org>
Cc: dev <de...@kafka.apache.org>; kafka-clients <ka...@googlegroups.com>
Subject: RE: [VOTE] 0.10.2.2 RC1
Hey Everyone,
I have been experiencing some problems and have not been able to find sufficient documentation online to help me figure out the root cuase. I have a 3 node kafka cluster set up on 3 different Windows 2012 servers. The cluster runs perfectly fine, ingesting data that is being sent via filebeat and winlogbeat (Elastic log collectors). I then have my logstash cluster configured to consume the data from Kafka. But pretty frequently, the data will stop coming in to my Logstash cluster. When I go to check on Kafak, it looks like something keeps preventing it from reaching the broker. When I run " .\kafka-console-consumer.bat --bootstrap-server localhost:9092 --topic winlogbeat" I get the following message.
[2018-06-29 13:48:13,921] WARN [Consumer clientId=consumer-1, groupId=console-consumer-34649] Connection to node -1 coul d not be established. Broker may not be available. (org.apache.kafka.clients.NetworkClient)
[2018-06-29 13:48:14,999] WARN [Consumer clientId=consumer-1, groupId=console-consumer-34649] Connection to node -1 coul d not be established. Broker may not be available. (org.apache.kafka.clients.NetworkClient)
The only way to fix it is to stop Kafka, remove all of the _consumer_offset files in C:\kafka\var\data and then starting Kafka again.
I see these errors in the Zookeeper logs:
[2018-06-25 04:54:12,305] WARN Interrupted while waiting for message on queue (org.apache.zookeeper.server.quorum.QuorumCnxManager)
java.lang.InterruptedException
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.reportInterruptAfterWait(AbstractQueuedSynchronizer.java:2014)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2088)
at java.util.concurrent.ArrayBlockingQueue.poll(ArrayBlockingQueue.java:418)
at org.apache.zookeeper.server.quorum.QuorumCnxManager.pollSendQueue(QuorumCnxManager.java:1097)
at org.apache.zookeeper.server.quorum.QuorumCnxManager.access$700(QuorumCnxManager.java:74)
at org.apache.zookeeper.server.quorum.QuorumCnxManager$SendWorker.run(QuorumCnxManager.java:932)
[2018-06-25 04:54:12,305] WARN Send worker leaving thread (org.apache.zookeeper.server.quorum.QuorumCnxManager)
[2018-06-25 04:55:19,336] INFO Received connection request /10.1.17.93:57654 (org.apache.zookeeper.server.quorum.QuorumCnxManager)
[2018-06-25 04:55:23,711] WARN Exception reading or writing challenge: java.net.SocketException: Connection reset (org.apache.zookeeper.server.quorum.QuorumCnxManager)
[2018-06-25 04:55:23,711] INFO Received connection request /10.1.17.93:57655 (org.apache.zookeeper.server.quorum.QuorumCnxManager)
[2018-06-25 04:55:23,711] WARN Exception reading or writing challenge: java.net.SocketException: Connection reset (org.apache.zookeeper.server.quorum.QuorumCnxManager)
[2018-06-25 05:03:02,134] INFO Received connection request /10.1.17.93:59024 (org.apache.zookeeper.server.quorum.QuorumCnxManager)
And I see these errors on Kafka:
log4j:ERROR Failed to rename [/logs/server.log] to [/logs/server.log.2018-06-25-13].
log4j:ERROR Failed to rename [/logs/log-cleaner.log] to [/logs/log-cleaner.log.2018-06-25-13].
log4j:ERROR Failed to rename [/logs/server.log] to [/logs/server.log.2018-06-25-14].
log4j:ERROR Failed to rename [/logs/log-cleaner.log] to [/logs/log-cleaner.log.2018-06-25-14].
log4j:ERROR Failed to rename [/logs/server.log] to [/logs/server.log.2018-06-25-15].
Can anyone help me out?
-Steve
________________________________
The information contained in this email message is intended only for use of the individual or entity named above. If the reader of this message is not the intended recipient, or the employee or agent responsible to deliver it to the intended recipient, you are hereby notified that any dissemination, distribution or copying of this communication is strictly prohibited. If you have received this communication in error, please immediately notify us by email, postmaster@weil.com, and destroy the original message. Thank you.
Re: [VOTE] 0.10.2.2 RC1
Posted by Ted Yu <yu...@gmail.com>.
+1
Ran test suite.
Checked signatures.
On Fri, Jun 29, 2018 at 10:21 AM, Jason Gustafson <ja...@confluent.io>
wrote:
> +1 (binding). I checked release notes, documentation, and went through the
> quickstart.
>
> Thanks Matthias!
>
> On Fri, Jun 22, 2018 at 6:43 PM, Matthias J. Sax <ma...@confluent.io>
> wrote:
>
> > Hello Kafka users, developers and client-developers,
> >
> > This is the second candidate for release of Apache Kafka 0.10.2.2.
> >
> > Note, that RC0 was created before the upgrade to Gradle 4.8.1 and thus,
> > we discarded it in favor of RC1 (without sending out a email for RC0).
> >
> > This is a bug fix release closing 29 tickets:
> > https://cwiki.apache.org/confluence/display/KAFKA/Release+Plan+0.10.2.2
> >
> > Release notes for the 0.10.2.2 release:
> > http://home.apache.org/~mjsax/kafka-0.10.2.2-rc1/RELEASE_NOTES.html
> >
> > *** Please download, test and vote by Tuesday, 6/26/18 end-of-day, so we
> > can close the vote on Wednesday.
> >
> > Kafka's KEYS file containing PGP keys we use to sign the release:
> > http://kafka.apache.org/KEYS
> >
> > * Release artifacts to be voted upon (source and binary):
> > http://home.apache.org/~mjsax/kafka-0.10.2.2-rc1/
> >
> > * Maven artifacts to be voted upon:
> > https://repository.apache.org/content/groups/staging/
> >
> > * Javadoc:
> > http://home.apache.org/~mjsax/kafka-0.10.2.2-rc1/javadoc/
> >
> > * Tag to be voted upon (off 0.10.2 branch) is the 0.10.2.2 tag:
> > https://github.com/apache/kafka/releases/tag/0.10.2.2-rc1
> >
> > * Documentation:
> > http://kafka.apache.org/0102/documentation.html
> >
> > * Protocol:
> > http://kafka.apache.org/0102/protocol.html
> >
> > * Successful Jenkins builds for the 0.10.2 branch:
> > Unit/integration tests: https://builds.apache.org/job/
> > kafka-0.10.2-jdk7/220/
> >
> > /**************************************
> >
> > Thanks,
> > -Matthias
> >
> >
>
RE: [VOTE] 0.10.2.2 RC1
Posted by "Coluccio, Stephen" <St...@weil.com>.
Hey Everyone,
I have been experiencing some problems and have not been able to find sufficient documentation online to help me figure out the root cuase. I have a 3 node kafka cluster set up on 3 different Windows 2012 servers. The cluster runs perfectly fine, ingesting data that is being sent via filebeat and winlogbeat (Elastic log collectors). I then have my logstash cluster configured to consume the data from Kafka. But pretty frequently, the data will stop coming in to my Logstash cluster. When I go to check on Kafak, it looks like something keeps preventing it from reaching the broker. When I run " .\kafka-console-consumer.bat --bootstrap-server localhost:9092 --topic winlogbeat" I get the following message.
[2018-06-29 13:48:13,921] WARN [Consumer clientId=consumer-1, groupId=console-consumer-34649] Connection to node -1 coul
d not be established. Broker may not be available. (org.apache.kafka.clients.NetworkClient)
[2018-06-29 13:48:14,999] WARN [Consumer clientId=consumer-1, groupId=console-consumer-34649] Connection to node -1 coul
d not be established. Broker may not be available. (org.apache.kafka.clients.NetworkClient)
The only way to fix it is to stop Kafka, remove all of the _consumer_offset files in C:\kafka\var\data and then starting Kafka again.
I see these errors in the Zookeeper logs:
[2018-06-25 04:54:12,305] WARN Interrupted while waiting for message on queue (org.apache.zookeeper.server.quorum.QuorumCnxManager)
java.lang.InterruptedException
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.reportInterruptAfterWait(AbstractQueuedSynchronizer.java:2014)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2088)
at java.util.concurrent.ArrayBlockingQueue.poll(ArrayBlockingQueue.java:418)
at org.apache.zookeeper.server.quorum.QuorumCnxManager.pollSendQueue(QuorumCnxManager.java:1097)
at org.apache.zookeeper.server.quorum.QuorumCnxManager.access$700(QuorumCnxManager.java:74)
at org.apache.zookeeper.server.quorum.QuorumCnxManager$SendWorker.run(QuorumCnxManager.java:932)
[2018-06-25 04:54:12,305] WARN Send worker leaving thread (org.apache.zookeeper.server.quorum.QuorumCnxManager)
[2018-06-25 04:55:19,336] INFO Received connection request /10.1.17.93:57654 (org.apache.zookeeper.server.quorum.QuorumCnxManager)
[2018-06-25 04:55:23,711] WARN Exception reading or writing challenge: java.net.SocketException: Connection reset (org.apache.zookeeper.server.quorum.QuorumCnxManager)
[2018-06-25 04:55:23,711] INFO Received connection request /10.1.17.93:57655 (org.apache.zookeeper.server.quorum.QuorumCnxManager)
[2018-06-25 04:55:23,711] WARN Exception reading or writing challenge: java.net.SocketException: Connection reset (org.apache.zookeeper.server.quorum.QuorumCnxManager)
[2018-06-25 05:03:02,134] INFO Received connection request /10.1.17.93:59024 (org.apache.zookeeper.server.quorum.QuorumCnxManager)
And I see these errors on Kafka:
log4j:ERROR Failed to rename [/logs/server.log] to [/logs/server.log.2018-06-25-13].
log4j:ERROR Failed to rename [/logs/log-cleaner.log] to [/logs/log-cleaner.log.2018-06-25-13].
log4j:ERROR Failed to rename [/logs/server.log] to [/logs/server.log.2018-06-25-14].
log4j:ERROR Failed to rename [/logs/log-cleaner.log] to [/logs/log-cleaner.log.2018-06-25-14].
log4j:ERROR Failed to rename [/logs/server.log] to [/logs/server.log.2018-06-25-15].
Can anyone help me out?
-Steve
________________________________
The information contained in this email message is intended only for use of the individual or entity named above. If the reader of this message is not the intended recipient, or the employee or agent responsible to deliver it to the intended recipient, you are hereby notified that any dissemination, distribution or copying of this communication is strictly prohibited. If you have received this communication in error, please immediately notify us by email, postmaster@weil.com, and destroy the original message. Thank you.
RE: [VOTE] 0.10.2.2 RC1
Posted by "Coluccio, Stephen" <St...@weil.com>.
Sorry everyone, I meant to change the subject of this email but forgot to before I sent it. I did not mean to hijack this thread. I apologize for the interruption.
-Steve
-----Original Message-----
From: Coluccio, Stephen
Sent: Friday, June 29, 2018 2:05 PM
To: Kafka Users <us...@kafka.apache.org>
Cc: dev <de...@kafka.apache.org>; kafka-clients <ka...@googlegroups.com>
Subject: RE: [VOTE] 0.10.2.2 RC1
Hey Everyone,
I have been experiencing some problems and have not been able to find sufficient documentation online to help me figure out the root cuase. I have a 3 node kafka cluster set up on 3 different Windows 2012 servers. The cluster runs perfectly fine, ingesting data that is being sent via filebeat and winlogbeat (Elastic log collectors). I then have my logstash cluster configured to consume the data from Kafka. But pretty frequently, the data will stop coming in to my Logstash cluster. When I go to check on Kafak, it looks like something keeps preventing it from reaching the broker. When I run " .\kafka-console-consumer.bat --bootstrap-server localhost:9092 --topic winlogbeat" I get the following message.
[2018-06-29 13:48:13,921] WARN [Consumer clientId=consumer-1, groupId=console-consumer-34649] Connection to node -1 coul d not be established. Broker may not be available. (org.apache.kafka.clients.NetworkClient)
[2018-06-29 13:48:14,999] WARN [Consumer clientId=consumer-1, groupId=console-consumer-34649] Connection to node -1 coul d not be established. Broker may not be available. (org.apache.kafka.clients.NetworkClient)
The only way to fix it is to stop Kafka, remove all of the _consumer_offset files in C:\kafka\var\data and then starting Kafka again.
I see these errors in the Zookeeper logs:
[2018-06-25 04:54:12,305] WARN Interrupted while waiting for message on queue (org.apache.zookeeper.server.quorum.QuorumCnxManager)
java.lang.InterruptedException
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.reportInterruptAfterWait(AbstractQueuedSynchronizer.java:2014)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2088)
at java.util.concurrent.ArrayBlockingQueue.poll(ArrayBlockingQueue.java:418)
at org.apache.zookeeper.server.quorum.QuorumCnxManager.pollSendQueue(QuorumCnxManager.java:1097)
at org.apache.zookeeper.server.quorum.QuorumCnxManager.access$700(QuorumCnxManager.java:74)
at org.apache.zookeeper.server.quorum.QuorumCnxManager$SendWorker.run(QuorumCnxManager.java:932)
[2018-06-25 04:54:12,305] WARN Send worker leaving thread (org.apache.zookeeper.server.quorum.QuorumCnxManager)
[2018-06-25 04:55:19,336] INFO Received connection request /10.1.17.93:57654 (org.apache.zookeeper.server.quorum.QuorumCnxManager)
[2018-06-25 04:55:23,711] WARN Exception reading or writing challenge: java.net.SocketException: Connection reset (org.apache.zookeeper.server.quorum.QuorumCnxManager)
[2018-06-25 04:55:23,711] INFO Received connection request /10.1.17.93:57655 (org.apache.zookeeper.server.quorum.QuorumCnxManager)
[2018-06-25 04:55:23,711] WARN Exception reading or writing challenge: java.net.SocketException: Connection reset (org.apache.zookeeper.server.quorum.QuorumCnxManager)
[2018-06-25 05:03:02,134] INFO Received connection request /10.1.17.93:59024 (org.apache.zookeeper.server.quorum.QuorumCnxManager)
And I see these errors on Kafka:
log4j:ERROR Failed to rename [/logs/server.log] to [/logs/server.log.2018-06-25-13].
log4j:ERROR Failed to rename [/logs/log-cleaner.log] to [/logs/log-cleaner.log.2018-06-25-13].
log4j:ERROR Failed to rename [/logs/server.log] to [/logs/server.log.2018-06-25-14].
log4j:ERROR Failed to rename [/logs/log-cleaner.log] to [/logs/log-cleaner.log.2018-06-25-14].
log4j:ERROR Failed to rename [/logs/server.log] to [/logs/server.log.2018-06-25-15].
Can anyone help me out?
-Steve
________________________________
The information contained in this email message is intended only for use of the individual or entity named above. If the reader of this message is not the intended recipient, or the employee or agent responsible to deliver it to the intended recipient, you are hereby notified that any dissemination, distribution or copying of this communication is strictly prohibited. If you have received this communication in error, please immediately notify us by email, postmaster@weil.com, and destroy the original message. Thank you.
Re: [VOTE] 0.10.2.2 RC1
Posted by Guozhang Wang <wa...@gmail.com>.
+1 (binding). Verified java docs, and ran the unit tests with the source
tgz.
Guozhang
On Fri, Jun 29, 2018 at 10:22 AM Jason Gustafson <ja...@confluent.io> wrote:
> +1 (binding). I checked release notes, documentation, and went through the
> quickstart.
>
> Thanks Matthias!
>
> On Fri, Jun 22, 2018 at 6:43 PM, Matthias J. Sax <ma...@confluent.io>
> wrote:
>
> > Hello Kafka users, developers and client-developers,
> >
> > This is the second candidate for release of Apache Kafka 0.10.2.2.
> >
> > Note, that RC0 was created before the upgrade to Gradle 4.8.1 and thus,
> > we discarded it in favor of RC1 (without sending out a email for RC0).
> >
> > This is a bug fix release closing 29 tickets:
> > https://cwiki.apache.org/confluence/display/KAFKA/Release+Plan+0.10.2.2
> >
> > Release notes for the 0.10.2.2 release:
> > http://home.apache.org/~mjsax/kafka-0.10.2.2-rc1/RELEASE_NOTES.html
> >
> > *** Please download, test and vote by Tuesday, 6/26/18 end-of-day, so we
> > can close the vote on Wednesday.
> >
> > Kafka's KEYS file containing PGP keys we use to sign the release:
> > http://kafka.apache.org/KEYS
> >
> > * Release artifacts to be voted upon (source and binary):
> > http://home.apache.org/~mjsax/kafka-0.10.2.2-rc1/
> >
> > * Maven artifacts to be voted upon:
> > https://repository.apache.org/content/groups/staging/
> >
> > * Javadoc:
> > http://home.apache.org/~mjsax/kafka-0.10.2.2-rc1/javadoc/
> >
> > * Tag to be voted upon (off 0.10.2 branch) is the 0.10.2.2 tag:
> > https://github.com/apache/kafka/releases/tag/0.10.2.2-rc1
> >
> > * Documentation:
> > http://kafka.apache.org/0102/documentation.html
> >
> > * Protocol:
> > http://kafka.apache.org/0102/protocol.html
> >
> > * Successful Jenkins builds for the 0.10.2 branch:
> > Unit/integration tests: https://builds.apache.org/job/
> > kafka-0.10.2-jdk7/220/
> >
> > /**************************************
> >
> > Thanks,
> > -Matthias
> >
> >
>
--
-- Guozhang
Re: [VOTE] 0.10.2.2 RC1
Posted by Jason Gustafson <ja...@confluent.io>.
+1 (binding). I checked release notes, documentation, and went through the
quickstart.
Thanks Matthias!
On Fri, Jun 22, 2018 at 6:43 PM, Matthias J. Sax <ma...@confluent.io>
wrote:
> Hello Kafka users, developers and client-developers,
>
> This is the second candidate for release of Apache Kafka 0.10.2.2.
>
> Note, that RC0 was created before the upgrade to Gradle 4.8.1 and thus,
> we discarded it in favor of RC1 (without sending out a email for RC0).
>
> This is a bug fix release closing 29 tickets:
> https://cwiki.apache.org/confluence/display/KAFKA/Release+Plan+0.10.2.2
>
> Release notes for the 0.10.2.2 release:
> http://home.apache.org/~mjsax/kafka-0.10.2.2-rc1/RELEASE_NOTES.html
>
> *** Please download, test and vote by Tuesday, 6/26/18 end-of-day, so we
> can close the vote on Wednesday.
>
> Kafka's KEYS file containing PGP keys we use to sign the release:
> http://kafka.apache.org/KEYS
>
> * Release artifacts to be voted upon (source and binary):
> http://home.apache.org/~mjsax/kafka-0.10.2.2-rc1/
>
> * Maven artifacts to be voted upon:
> https://repository.apache.org/content/groups/staging/
>
> * Javadoc:
> http://home.apache.org/~mjsax/kafka-0.10.2.2-rc1/javadoc/
>
> * Tag to be voted upon (off 0.10.2 branch) is the 0.10.2.2 tag:
> https://github.com/apache/kafka/releases/tag/0.10.2.2-rc1
>
> * Documentation:
> http://kafka.apache.org/0102/documentation.html
>
> * Protocol:
> http://kafka.apache.org/0102/protocol.html
>
> * Successful Jenkins builds for the 0.10.2 branch:
> Unit/integration tests: https://builds.apache.org/job/
> kafka-0.10.2-jdk7/220/
>
> /**************************************
>
> Thanks,
> -Matthias
>
>
Re: [kafka-clients] [VOTE] 0.10.2.2 RC1
Posted by Jun Rao <ju...@confluent.io>.
Hi, Matthias,
Thanks for running the release. Verified quickstart on scala 2.12 binary. +1
Jun
On Fri, Jun 22, 2018 at 6:43 PM, Matthias J. Sax <ma...@confluent.io>
wrote:
> Hello Kafka users, developers and client-developers,
>
> This is the second candidate for release of Apache Kafka 0.10.2.2.
>
> Note, that RC0 was created before the upgrade to Gradle 4.8.1 and thus,
> we discarded it in favor of RC1 (without sending out a email for RC0).
>
> This is a bug fix release closing 29 tickets:
> https://cwiki.apache.org/confluence/display/KAFKA/Release+Plan+0.10.2.2
>
> Release notes for the 0.10.2.2 release:
> http://home.apache.org/~mjsax/kafka-0.10.2.2-rc1/RELEASE_NOTES.html
>
> *** Please download, test and vote by Tuesday, 6/26/18 end-of-day, so we
> can close the vote on Wednesday.
>
> Kafka's KEYS file containing PGP keys we use to sign the release:
> http://kafka.apache.org/KEYS
>
> * Release artifacts to be voted upon (source and binary):
> http://home.apache.org/~mjsax/kafka-0.10.2.2-rc1/
>
> * Maven artifacts to be voted upon:
> https://repository.apache.org/content/groups/staging/
>
> * Javadoc:
> http://home.apache.org/~mjsax/kafka-0.10.2.2-rc1/javadoc/
>
> * Tag to be voted upon (off 0.10.2 branch) is the 0.10.2.2 tag:
> https://github.com/apache/kafka/releases/tag/0.10.2.2-rc1
>
> * Documentation:
> http://kafka.apache.org/0102/documentation.html
>
> * Protocol:
> http://kafka.apache.org/0102/protocol.html
>
> * Successful Jenkins builds for the 0.10.2 branch:
> Unit/integration tests: https://builds.apache.org/job/
> kafka-0.10.2-jdk7/220/
>
> /**************************************
>
> Thanks,
> -Matthias
>
> --
> You received this message because you are subscribed to the Google Groups
> "kafka-clients" group.
> To unsubscribe from this group and stop receiving emails from it, send an
> email to kafka-clients+unsubscribe@googlegroups.com.
> To post to this group, send email to kafka-clients@googlegroups.com.
> Visit this group at https://groups.google.com/group/kafka-clients.
> To view this discussion on the web visit https://groups.google.com/d/
> msgid/kafka-clients/8228115e-6913-5c37-06d9-7410a7bd7f69%40confluent.io.
> For more options, visit https://groups.google.com/d/optout.
>
Re: [VOTE] 0.10.2.2 RC1
Posted by Jason Gustafson <ja...@confluent.io>.
+1 (binding). I checked release notes, documentation, and went through the
quickstart.
Thanks Matthias!
On Fri, Jun 22, 2018 at 6:43 PM, Matthias J. Sax <ma...@confluent.io>
wrote:
> Hello Kafka users, developers and client-developers,
>
> This is the second candidate for release of Apache Kafka 0.10.2.2.
>
> Note, that RC0 was created before the upgrade to Gradle 4.8.1 and thus,
> we discarded it in favor of RC1 (without sending out a email for RC0).
>
> This is a bug fix release closing 29 tickets:
> https://cwiki.apache.org/confluence/display/KAFKA/Release+Plan+0.10.2.2
>
> Release notes for the 0.10.2.2 release:
> http://home.apache.org/~mjsax/kafka-0.10.2.2-rc1/RELEASE_NOTES.html
>
> *** Please download, test and vote by Tuesday, 6/26/18 end-of-day, so we
> can close the vote on Wednesday.
>
> Kafka's KEYS file containing PGP keys we use to sign the release:
> http://kafka.apache.org/KEYS
>
> * Release artifacts to be voted upon (source and binary):
> http://home.apache.org/~mjsax/kafka-0.10.2.2-rc1/
>
> * Maven artifacts to be voted upon:
> https://repository.apache.org/content/groups/staging/
>
> * Javadoc:
> http://home.apache.org/~mjsax/kafka-0.10.2.2-rc1/javadoc/
>
> * Tag to be voted upon (off 0.10.2 branch) is the 0.10.2.2 tag:
> https://github.com/apache/kafka/releases/tag/0.10.2.2-rc1
>
> * Documentation:
> http://kafka.apache.org/0102/documentation.html
>
> * Protocol:
> http://kafka.apache.org/0102/protocol.html
>
> * Successful Jenkins builds for the 0.10.2 branch:
> Unit/integration tests: https://builds.apache.org/job/
> kafka-0.10.2-jdk7/220/
>
> /**************************************
>
> Thanks,
> -Matthias
>
>