You are viewing a plain text version of this content. The canonical link for it is here.
Posted to users@kafka.apache.org by Ron Arts <ro...@novantum.com> on 2017/11/29 12:09:26 UTC
Kafka beginner: problem with interpreting logs, troubleshooting
running in docker swarm
Hi,
I am running one kafka broker, against a 3 node zookeeper cluster, all in
AWS.
Using Kafka Tool on it, which works flawlessly against my local Kafka (in
docker)
Kafka Tool can connect, and comes up with information, but I can't create
topics,
even though it reports success.
On the other hand creating topics from the Kafka container seems to work,
listing
them does work.
In the docker container I do get Java java.io.EOFException, which I have
trouble understanding.
I upped the Kafka loglevel to DEBU, it's attached, hope it's not too long.
I hope someone can take a quick glance at it, and point me in the right
direction.
Thanks,
Ron Arts
----- Kafka log here ------
Nov 29 11:52:22 ec2-IP.AWS.X.X 5623226517f6[2643]: New Monit id:
8bf4a30eab07533f3c2a0e86c003ec09
Nov 29 11:52:22 ec2-IP.AWS.X.X 5623226517f6[2643]: Stored in '/opt/kafka/.
monit.id'
Nov 29 11:52:22 ec2-IP.AWS.X.X 5623226517f6[2643]: Starting Monit 5.24.0
daemon with http interface at [*]:2812
Nov 29 11:52:22 ec2-IP.AWS.X.X 5623226517f6[2643]: '5623226517f6' Monit
5.24.0 started
Nov 29 11:52:22 ec2-IP.AWS.X.X 5623226517f6[2643]: 'kafka-service' process
is not running
Nov 29 11:52:22 ec2-IP.AWS.X.X 5623226517f6[2643]: 'kafka-service' trying
to restart
Nov 29 11:52:22 ec2-IP.AWS.X.X 5623226517f6[2643]: 'kafka-service' start:
'/opt/kafka/bin/kafka-service.sh start'
Nov 29 11:52:23 ec2-IP.AWS.X.X 5623226517f6[2643]: [2017-11-29
11:52:23,991] INFO KafkaConfig values:
Nov 29 11:52:23 ec2-IP.AWS.X.X 5623226517f6[2643]: #011advertised.host.name
= null
Nov 29 11:52:23 ec2-IP.AWS.X.X 5623226517f6[2643]: #011advertised.listeners
= PLAINTEXT://IP.AWS.X.X:9092
Nov 29 11:52:23 ec2-IP.AWS.X.X 5623226517f6[2643]: #011advertised.port =
null
Nov 29 11:52:23 ec2-IP.AWS.X.X 5623226517f6[2643]: #
011alter.config.policy.class.name = null
Nov 29 11:52:23 ec2-IP.AWS.X.X 5623226517f6[2643]: #011authorizer.class.name
=
Nov 29 11:52:23 ec2-IP.AWS.X.X 5623226517f6[2643]:
#011auto.create.topics.enable = true
Nov 29 11:52:23 ec2-IP.AWS.X.X 5623226517f6[2643]:
#011auto.leader.rebalance.enable = true
Nov 29 11:52:23 ec2-IP.AWS.X.X 5623226517f6[2643]: #011background.threads =
10
Nov 29 11:52:23 ec2-IP.AWS.X.X 5623226517f6[2643]: #011broker.id = 0
Nov 29 11:52:23 ec2-IP.AWS.X.X 5623226517f6[2643]:
#011broker.id.generation.enable = true
Nov 29 11:52:23 ec2-IP.AWS.X.X 5623226517f6[2643]: #011broker.rack = null
Nov 29 11:52:23 ec2-IP.AWS.X.X 5623226517f6[2643]: #011compression.type =
producer
Nov 29 11:52:23 ec2-IP.AWS.X.X 5623226517f6[2643]: #
011connections.max.idle.ms = 600000
Nov 29 11:52:23 ec2-IP.AWS.X.X 5623226517f6[2643]:
#011controlled.shutdown.enable = true
Nov 29 11:52:23 ec2-IP.AWS.X.X 5623226517f6[2643]:
#011controlled.shutdown.max.retries = 3
Nov 29 11:52:23 ec2-IP.AWS.X.X 5623226517f6[2643]: #
011controlled.shutdown.retry.backoff.ms = 5000
Nov 29 11:52:23 ec2-IP.AWS.X.X 5623226517f6[2643]: #
011controller.socket.timeout.ms = 30000
Nov 29 11:52:23 ec2-IP.AWS.X.X 5623226517f6[2643]: #
011create.topic.policy.class.name = null
Nov 29 11:52:23 ec2-IP.AWS.X.X 5623226517f6[2643]:
#011default.replication.factor = 1
Nov 29 11:52:23 ec2-IP.AWS.X.X 5623226517f6[2643]:
#011delete.records.purgatory.purge.interval.requests = 1
Nov 29 11:52:23 ec2-IP.AWS.X.X 5623226517f6[2643]: #011delete.topic.enable
= false
Nov 29 11:52:23 ec2-IP.AWS.X.X 5623226517f6[2643]:
#011fetch.purgatory.purge.interval.requests = 1000
Nov 29 11:52:23 ec2-IP.AWS.X.X 5623226517f6[2643]: #
011group.initial.rebalance.delay.ms = 3000
Nov 29 11:52:23 ec2-IP.AWS.X.X 5623226517f6[2643]: #
011group.max.session.timeout.ms = 300000
Nov 29 11:52:23 ec2-IP.AWS.X.X 5623226517f6[2643]: #
011group.min.session.timeout.ms = 6000
Nov 29 11:52:23 ec2-IP.AWS.X.X 5623226517f6[2643]: #011host.name =
Nov 29 11:52:23 ec2-IP.AWS.X.X 5623226517f6[2643]: #
011inter.broker.listener.name = null
Nov 29 11:52:23 ec2-IP.AWS.X.X 5623226517f6[2643]:
#011inter.broker.protocol.version = 1.0-IV0
Nov 29 11:52:23 ec2-IP.AWS.X.X 5623226517f6[2643]:
#011leader.imbalance.check.interval.seconds = 300
Nov 29 11:52:23 ec2-IP.AWS.X.X 5623226517f6[2643]:
#011leader.imbalance.per.broker.percentage = 10
Nov 29 11:52:23 ec2-IP.AWS.X.X 5623226517f6[2643]:
#011listener.security.protocol.map =
PLAINTEXT:PLAINTEXT,SSL:SSL,SASL_PLAINTEXT:SASL_PLAINTEXT,SASL_SSL:SASL_SSL
Nov 29 11:52:23 ec2-IP.AWS.X.X 5623226517f6[2643]: #011listeners =
PLAINTEXT://0.0.0.0:9092
Nov 29 11:52:23 ec2-IP.AWS.X.X 5623226517f6[2643]: #
011log.cleaner.backoff.ms = 15000
Nov 29 11:52:23 ec2-IP.AWS.X.X 5623226517f6[2643]:
#011log.cleaner.dedupe.buffer.size = 134217728
Nov 29 11:52:23 ec2-IP.AWS.X.X 5623226517f6[2643]: #
011log.cleaner.delete.retention.ms = 86400000
Nov 29 11:52:23 ec2-IP.AWS.X.X 5623226517f6[2643]: #011log.cleaner.enable =
true
Nov 29 11:52:23 ec2-IP.AWS.X.X 5623226517f6[2643]:
#011log.cleaner.io.buffer.load.factor = 0.9
Nov 29 11:52:23 ec2-IP.AWS.X.X 5623226517f6[2643]:
#011log.cleaner.io.buffer.size = 524288
Nov 29 11:52:23 ec2-IP.AWS.X.X 5623226517f6[2643]:
#011log.cleaner.io.max.bytes.per.second = 1.7976931348623157E308
Nov 29 11:52:23 ec2-IP.AWS.X.X 5623226517f6[2643]:
#011log.cleaner.min.cleanable.ratio = 0.5
Nov 29 11:52:23 ec2-IP.AWS.X.X 5623226517f6[2643]: #
011log.cleaner.min.compaction.lag.ms = 0
Nov 29 11:52:23 ec2-IP.AWS.X.X 5623226517f6[2643]: #011log.cleaner.threads
= 1
Nov 29 11:52:23 ec2-IP.AWS.X.X 5623226517f6[2643]: #011log.cleanup.policy =
[delete]
Nov 29 11:52:23 ec2-IP.AWS.X.X 5623226517f6[2643]: #011log.dir =
/tmp/kafka-logs
Nov 29 11:52:23 ec2-IP.AWS.X.X 5623226517f6[2643]: #011log.dirs =
/opt/kafka/logs
Nov 29 11:52:23 ec2-IP.AWS.X.X 5623226517f6[2643]:
#011log.flush.interval.messages = 9223372036854775807
Nov 29 11:52:23 ec2-IP.AWS.X.X 5623226517f6[2643]: #011log.flush.interval.ms
= null
Nov 29 11:52:23 ec2-IP.AWS.X.X 5623226517f6[2643]: #
011log.flush.offset.checkpoint.interval.ms = 60000
Nov 29 11:52:23 ec2-IP.AWS.X.X 5623226517f6[2643]: #
011log.flush.scheduler.interval.ms = 9223372036854775807
Nov 29 11:52:23 ec2-IP.AWS.X.X 5623226517f6[2643]: #
011log.flush.start.offset.checkpoint.interval.ms = 60000
Nov 29 11:52:23 ec2-IP.AWS.X.X 5623226517f6[2643]:
#011log.index.interval.bytes = 4096
Nov 29 11:52:23 ec2-IP.AWS.X.X 5623226517f6[2643]:
#011log.index.size.max.bytes = 10485760
Nov 29 11:52:23 ec2-IP.AWS.X.X 5623226517f6[2643]:
#011log.message.format.version = 1.0-IV0
Nov 29 11:52:23 ec2-IP.AWS.X.X 5623226517f6[2643]: #
011log.message.timestamp.difference.max.ms = 9223372036854775807
Nov 29 11:52:23 ec2-IP.AWS.X.X 5623226517f6[2643]:
#011log.message.timestamp.type = CreateTime
Nov 29 11:52:23 ec2-IP.AWS.X.X 5623226517f6[2643]: #011log.preallocate =
false
Nov 29 11:52:23 ec2-IP.AWS.X.X 5623226517f6[2643]: #011log.retention.bytes
= -1
Nov 29 11:52:23 ec2-IP.AWS.X.X 5623226517f6[2643]: #
011log.retention.check.interval.ms = 300000
Nov 29 11:52:23 ec2-IP.AWS.X.X 5623226517f6[2643]: #011log.retention.hours
= 168
Nov 29 11:52:23 ec2-IP.AWS.X.X 5623226517f6[2643]:
#011log.retention.minutes = null
Nov 29 11:52:23 ec2-IP.AWS.X.X 5623226517f6[2643]: #011log.retention.ms =
null
Nov 29 11:52:23 ec2-IP.AWS.X.X 5623226517f6[2643]: #011log.roll.hours = 168
Nov 29 11:52:23 ec2-IP.AWS.X.X 5623226517f6[2643]:
#011log.roll.jitter.hours = 0
Nov 29 11:52:23 ec2-IP.AWS.X.X 5623226517f6[2643]: #011log.roll.jitter.ms =
null
Nov 29 11:52:23 ec2-IP.AWS.X.X 5623226517f6[2643]: #011log.roll.ms = null
Nov 29 11:52:23 ec2-IP.AWS.X.X 5623226517f6[2643]: #011log.segment.bytes =
1073741824
Nov 29 11:52:23 ec2-IP.AWS.X.X 5623226517f6[2643]: #
011log.segment.delete.delay.ms = 60000
Nov 29 11:52:23 ec2-IP.AWS.X.X 5623226517f6[2643]:
#011max.connections.per.ip = 2147483647
Nov 29 11:52:23 ec2-IP.AWS.X.X 5623226517f6[2643]:
#011max.connections.per.ip.overrides =
Nov 29 11:52:23 ec2-IP.AWS.X.X 5623226517f6[2643]: #011message.max.bytes =
1000012
Nov 29 11:52:23 ec2-IP.AWS.X.X 5623226517f6[2643]: #011metric.reporters = []
Nov 29 11:52:23 ec2-IP.AWS.X.X 5623226517f6[2643]: #011metrics.num.samples
= 2
Nov 29 11:52:23 ec2-IP.AWS.X.X 5623226517f6[2643]:
#011metrics.recording.level = INFO
Nov 29 11:52:23 ec2-IP.AWS.X.X 5623226517f6[2643]: #
011metrics.sample.window.ms = 30000
Nov 29 11:52:23 ec2-IP.AWS.X.X 5623226517f6[2643]: #011min.insync.replicas
= 1
Nov 29 11:52:23 ec2-IP.AWS.X.X 5623226517f6[2643]: #011num.io.threads = 8
Nov 29 11:52:23 ec2-IP.AWS.X.X 5623226517f6[2643]: #011num.network.threads
= 3
Nov 29 11:52:23 ec2-IP.AWS.X.X 5623226517f6[2643]: #011num.partitions = 1
Nov 29 11:52:23 ec2-IP.AWS.X.X 5623226517f6[2643]:
#011num.recovery.threads.per.data.dir = 1
Nov 29 11:52:23 ec2-IP.AWS.X.X 5623226517f6[2643]: #011num.replica.fetchers
= 1
Nov 29 11:52:23 ec2-IP.AWS.X.X 5623226517f6[2643]:
#011offset.metadata.max.bytes = 4096
Nov 29 11:52:23 ec2-IP.AWS.X.X 5623226517f6[2643]:
#011offsets.commit.required.acks = -1
Nov 29 11:52:23 ec2-IP.AWS.X.X 5623226517f6[2643]: #
011offsets.commit.timeout.ms = 5000
Nov 29 11:52:23 ec2-IP.AWS.X.X 5623226517f6[2643]:
#011offsets.load.buffer.size = 5242880
Nov 29 11:52:23 ec2-IP.AWS.X.X 5623226517f6[2643]: #
011offsets.retention.check.interval.ms = 600000
Nov 29 11:52:23 ec2-IP.AWS.X.X 5623226517f6[2643]:
#011offsets.retention.minutes = 1440
Nov 29 11:52:23 ec2-IP.AWS.X.X 5623226517f6[2643]:
#011offsets.topic.compression.codec = 0
Nov 29 11:52:23 ec2-IP.AWS.X.X 5623226517f6[2643]:
#011offsets.topic.num.partitions = 50
Nov 29 11:52:23 ec2-IP.AWS.X.X 5623226517f6[2643]:
#011offsets.topic.replication.factor = 3
Nov 29 11:52:23 ec2-IP.AWS.X.X 5623226517f6[2643]:
#011offsets.topic.segment.bytes = 104857600
Nov 29 11:52:23 ec2-IP.AWS.X.X 5623226517f6[2643]: #011port = 9092
Nov 29 11:52:23 ec2-IP.AWS.X.X 5623226517f6[2643]:
#011principal.builder.class = null
Nov 29 11:52:23 ec2-IP.AWS.X.X 5623226517f6[2643]:
#011producer.purgatory.purge.interval.requests = 1000
Nov 29 11:52:23 ec2-IP.AWS.X.X 5623226517f6[2643]:
#011queued.max.request.bytes = -1
Nov 29 11:52:23 ec2-IP.AWS.X.X 5623226517f6[2643]: #011queued.max.requests
= 500
Nov 29 11:52:23 ec2-IP.AWS.X.X 5623226517f6[2643]:
#011quota.consumer.default = 9223372036854775807
Nov 29 11:52:23 ec2-IP.AWS.X.X 5623226517f6[2643]:
#011quota.producer.default = 9223372036854775807
Nov 29 11:52:23 ec2-IP.AWS.X.X 5623226517f6[2643]: #011quota.window.num = 11
Nov 29 11:52:23 ec2-IP.AWS.X.X 5623226517f6[2643]:
#011quota.window.size.seconds = 1
Nov 29 11:52:23 ec2-IP.AWS.X.X 5623226517f6[2643]: #
011replica.fetch.backoff.ms = 1000
Nov 29 11:52:23 ec2-IP.AWS.X.X 5623226517f6[2643]:
#011replica.fetch.max.bytes = 1048576
Nov 29 11:52:23 ec2-IP.AWS.X.X 5623226517f6[2643]:
#011replica.fetch.min.bytes = 1
Nov 29 11:52:23 ec2-IP.AWS.X.X 5623226517f6[2643]:
#011replica.fetch.response.max.bytes = 10485760
Nov 29 11:52:23 ec2-IP.AWS.X.X 5623226517f6[2643]: #
011replica.fetch.wait.max.ms = 500
Nov 29 11:52:23 ec2-IP.AWS.X.X 5623226517f6[2643]: #
011replica.high.watermark.checkpoint.interval.ms = 5000
Nov 29 11:52:23 ec2-IP.AWS.X.X 5623226517f6[2643]: #
011replica.lag.time.max.ms = 10000
Nov 29 11:52:23 ec2-IP.AWS.X.X 5623226517f6[2643]:
#011replica.socket.receive.buffer.bytes = 65536
Nov 29 11:52:23 ec2-IP.AWS.X.X 5623226517f6[2643]: #
011replica.socket.timeout.ms = 30000
Nov 29 11:52:23 ec2-IP.AWS.X.X 5623226517f6[2643]:
#011replication.quota.window.num = 11
Nov 29 11:52:23 ec2-IP.AWS.X.X 5623226517f6[2643]:
#011replication.quota.window.size.seconds = 1
Nov 29 11:52:23 ec2-IP.AWS.X.X 5623226517f6[2643]: #011request.timeout.ms =
30000
Nov 29 11:52:23 ec2-IP.AWS.X.X 5623226517f6[2643]: #
011reserved.broker.max.id = 1000
Nov 29 11:52:23 ec2-IP.AWS.X.X 5623226517f6[2643]:
#011sasl.enabled.mechanisms = [GSSAPI]
Nov 29 11:52:23 ec2-IP.AWS.X.X 5623226517f6[2643]:
#011sasl.kerberos.kinit.cmd = /usr/bin/kinit
Nov 29 11:52:23 ec2-IP.AWS.X.X 5623226517f6[2643]:
#011sasl.kerberos.min.time.before.relogin = 60000
Nov 29 11:52:23 ec2-IP.AWS.X.X 5623226517f6[2643]:
#011sasl.kerberos.principal.to.local.rules = [DEFAULT]
Nov 29 11:52:23 ec2-IP.AWS.X.X 5623226517f6[2643]: #
011sasl.kerberos.service.name = null
Nov 29 11:52:23 ec2-IP.AWS.X.X 5623226517f6[2643]:
#011sasl.kerberos.ticket.renew.jitter = 0.05
Nov 29 11:52:23 ec2-IP.AWS.X.X 5623226517f6[2643]:
#011sasl.kerberos.ticket.renew.window.factor = 0.8
Nov 29 11:52:23 ec2-IP.AWS.X.X 5623226517f6[2643]:
#011sasl.mechanism.inter.broker.protocol = GSSAPI
Nov 29 11:52:23 ec2-IP.AWS.X.X 5623226517f6[2643]:
#011security.inter.broker.protocol = PLAINTEXT
Nov 29 11:52:23 ec2-IP.AWS.X.X 5623226517f6[2643]:
#011socket.receive.buffer.bytes = 102400
Nov 29 11:52:23 ec2-IP.AWS.X.X 5623226517f6[2643]:
#011socket.request.max.bytes = 104857600
Nov 29 11:52:23 ec2-IP.AWS.X.X 5623226517f6[2643]:
#011socket.send.buffer.bytes = 102400
Nov 29 11:52:23 ec2-IP.AWS.X.X 5623226517f6[2643]: #011ssl.cipher.suites =
null
Nov 29 11:52:23 ec2-IP.AWS.X.X 5623226517f6[2643]: #011ssl.client.auth =
none
Nov 29 11:52:23 ec2-IP.AWS.X.X 5623226517f6[2643]:
#011ssl.enabled.protocols = [TLSv1.2, TLSv1.1, TLSv1]
Nov 29 11:52:23 ec2-IP.AWS.X.X 5623226517f6[2643]:
#011ssl.endpoint.identification.algorithm = null
Nov 29 11:52:23 ec2-IP.AWS.X.X 5623226517f6[2643]: #011ssl.key.password =
null
Nov 29 11:52:23 ec2-IP.AWS.X.X 5623226517f6[2643]:
#011ssl.keymanager.algorithm = SunX509
Nov 29 11:52:23 ec2-IP.AWS.X.X 5623226517f6[2643]:
#011ssl.keystore.location = null
Nov 29 11:52:23 ec2-IP.AWS.X.X 5623226517f6[2643]:
#011ssl.keystore.password = null
Nov 29 11:52:23 ec2-IP.AWS.X.X 5623226517f6[2643]: #011ssl.keystore.type =
JKS
Nov 29 11:52:23 ec2-IP.AWS.X.X 5623226517f6[2643]: #011ssl.protocol = TLS
Nov 29 11:52:23 ec2-IP.AWS.X.X 5623226517f6[2643]: #011ssl.provider = null
Nov 29 11:52:23 ec2-IP.AWS.X.X 5623226517f6[2643]:
#011ssl.secure.random.implementation = null
Nov 29 11:52:23 ec2-IP.AWS.X.X 5623226517f6[2643]:
#011ssl.trustmanager.algorithm = PKIX
Nov 29 11:52:23 ec2-IP.AWS.X.X 5623226517f6[2643]:
#011ssl.truststore.location = null
Nov 29 11:52:23 ec2-IP.AWS.X.X 5623226517f6[2643]:
#011ssl.truststore.password = null
Nov 29 11:52:23 ec2-IP.AWS.X.X 5623226517f6[2643]: #011ssl.truststore.type
= JKS
Nov 29 11:52:23 ec2-IP.AWS.X.X 5623226517f6[2643]: #
011transaction.abort.timed.out.transaction.cleanup.interval.ms = 60000
Nov 29 11:52:23 ec2-IP.AWS.X.X 5623226517f6[2643]: #
011transaction.max.timeout.ms = 900000
Nov 29 11:52:23 ec2-IP.AWS.X.X 5623226517f6[2643]: #
011transaction.remove.expired.transaction.cleanup.interval.ms = 3600000
Nov 29 11:52:23 ec2-IP.AWS.X.X 5623226517f6[2643]:
#011transaction.state.log.load.buffer.size = 5242880
Nov 29 11:52:23 ec2-IP.AWS.X.X 5623226517f6[2643]:
#011transaction.state.log.min.isr = 2
Nov 29 11:52:23 ec2-IP.AWS.X.X 5623226517f6[2643]:
#011transaction.state.log.num.partitions = 50
Nov 29 11:52:23 ec2-IP.AWS.X.X 5623226517f6[2643]:
#011transaction.state.log.replication.factor = 3
Nov 29 11:52:23 ec2-IP.AWS.X.X 5623226517f6[2643]:
#011transaction.state.log.segment.bytes = 104857600
Nov 29 11:52:23 ec2-IP.AWS.X.X 5623226517f6[2643]: #
011transactional.id.expiration.ms = 604800000
Nov 29 11:52:23 ec2-IP.AWS.X.X 5623226517f6[2643]:
#011unclean.leader.election.enable = false
Nov 29 11:52:23 ec2-IP.AWS.X.X 5623226517f6[2643]: #011zookeeper.connect =
zoo1:2181
Nov 29 11:52:23 ec2-IP.AWS.X.X 5623226517f6[2643]: #
011zookeeper.connection.timeout.ms = 6000
Nov 29 11:52:23 ec2-IP.AWS.X.X 5623226517f6[2643]: #
011zookeeper.session.timeout.ms = 6000
Nov 29 11:52:23 ec2-IP.AWS.X.X 5623226517f6[2643]: #011zookeeper.set.acl =
false
Nov 29 11:52:23 ec2-IP.AWS.X.X 5623226517f6[2643]: #
011zookeeper.sync.time.ms = 2000
Nov 29 11:52:23 ec2-IP.AWS.X.X 5623226517f6[2643]:
(kafka.server.KafkaConfig)
Nov 29 11:52:24 ec2-IP.AWS.X.X 5623226517f6[2643]: [2017-11-29
11:52:24,071] INFO starting (kafka.server.KafkaServer)
Nov 29 11:52:24 ec2-IP.AWS.X.X 5623226517f6[2643]: [2017-11-29
11:52:24,072] DEBUG Initializing task scheduler.
(kafka.utils.KafkaScheduler)
Nov 29 11:52:24 ec2-IP.AWS.X.X 5623226517f6[2643]: [2017-11-29
11:52:24,074] INFO Connecting to zookeeper on zoo1:2181
(kafka.server.KafkaServer)
Nov 29 11:52:24 ec2-IP.AWS.X.X 5623226517f6[2643]: [2017-11-29
11:52:24,090] INFO Starting ZkClient event thread.
(org.I0Itec.zkclient.ZkEventThread)
Nov 29 11:52:24 ec2-IP.AWS.X.X 5623226517f6[2643]: [2017-11-29
11:52:24,095] INFO Client
environment:zookeeper.version=3.4.10-39d3a4f269333c922ed3db283be479f9deacaa0f,
built on 03/23/2017 10:13 GMT (org.apache.zookeeper.ZooKeeper)
Nov 29 11:52:24 ec2-IP.AWS.X.X 5623226517f6[2643]: [2017-11-29
11:52:24,095] INFO Client environment:host.name=5623226517f6
(org.apache.zookeeper.ZooKeeper)
Nov 29 11:52:24 ec2-IP.AWS.X.X 5623226517f6[2643]: [2017-11-29
11:52:24,095] INFO Client environment:java.version=1.8.0_152
(org.apache.zookeeper.ZooKeeper)
Nov 29 11:52:24 ec2-IP.AWS.X.X 5623226517f6[2643]: [2017-11-29
11:52:24,095] INFO Client environment:java.vendor=Oracle Corporation
(org.apache.zookeeper.ZooKeeper)
Nov 29 11:52:24 ec2-IP.AWS.X.X 5623226517f6[2643]: [2017-11-29
11:52:24,096] INFO Client environment:java.home=/opt/jre1.8.0_152
(org.apache.zookeeper.ZooKeeper)
Nov 29 11:52:24 ec2-IP.AWS.X.X 5623226517f6[2643]: [2017-11-29
11:52:24,096] INFO Client
environment:java.class.path=:/opt/kafka/bin/../libs/aopalliance-repackaged-2.5.0-b32.jar:/opt/kafka/bin/../libs/argparse4j-0.7.0.jar:/opt/kafka/bin/../libs/commons-lang3-3.5.jar:/opt/kafka/bin/../libs/connect-api-1.0.0.jar:/opt/kafka/bin/../libs/connect-file-1.0.0.jar:/opt/kafka/bin/../libs/connect-json-1.0.0.jar:/opt/kafka/bin/../libs/connect-runtime-1.0.0.jar:/opt/kafka/bin/../libs/connect-transforms-1.0.0.jar:/opt/kafka/bin/../libs/guava-20.0.jar:/opt/kafka/bin/../libs/hk2-api-2.5.0-b32.jar:/opt/kafka/bin/../libs/hk2-locator-2.5.0-b32.jar:/opt/kafka/bin/../libs/hk2-utils-2.5.0-b32.jar:/opt/kafka/bin/../libs/jackson-annotations-2.9.1.jar:/opt/kafka/bin/../libs/jackson-core-2.9.1.jar:/opt/kafka/bin/../libs/jackson-databind-2.9.1.jar:/opt/kafka/bin/../libs/jackson-jaxrs-base-2.9.1.jar:/opt/kafka/bin/../libs/jackson-jaxrs-json-provider-2.9.1.jar:/opt/kafka/bin/../libs/jackson-module-jaxb-annotations-2.9.1.jar:/opt/kafka/bin/../libs/javassist-3.20.0-GA.jar:/opt/kafka/bin/../libs/javassist-3.21.0-GA.jar:/opt/kafka/bin/../libs/javax.annotation-api-1.2.jar:/opt/kafka/bin/../libs/javax.inject-1.jar:/opt/kafka/bin/../libs/javax.inject-2.5.0-b32.jar:/opt/kafka/bin/../libs/javax.servlet-api-3.1.0.jar:/opt/kafka/bin/../libs/javax.ws.rs-api-2.0.1.jar:/opt/kafka/bin/../libs/jersey-client-2.25.1.jar:/opt/kafka/bin/../libs/jersey-common-2.25.1.jar:/opt/kafka/bin/../libs/jersey-container-servlet-2.25.1.jar:/opt/kafka/bin/../libs/jersey-container-servlet-core-2.25.1.jar:/opt/kafka/bin/../libs/jersey-guava-2.25.1.jar:/opt/kafka/bin/../libs/jersey-media-jaxb-2.25.1.jar:/opt/kafka/bin/../libs/jersey-server-2.25.1.jar:/opt/kafka/bin/../libs/jetty-continuation-9.2.22.v20170606.jar:/opt/kafka/bin/../libs/jetty-http-9.2.22.v20170606.jar:/opt/kafka/bin/../libs/jetty-io-9.2.22.v20170606.jar:/opt/kafka/bin/../libs/jetty-security-9.2.22.v20170606.jar:/opt/kafka/bin/../libs/jetty-server-9.2.22.v20170606.jar:/opt/kafka/bin/../libs/jetty-servlet-9.2.22.v20170606.jar
Nov 29 11:52:24 ec2-IP.AWS.X.X 5623226517f6[2643]: [2017-11-29
11:52:24,096] INFO Client
environment:java.library.path=/usr/java/packages/lib/amd64:/usr/lib64:/lib64:/lib:/usr/lib
(org.apache.zookeeper.ZooKeeper)
Nov 29 11:52:24 ec2-IP.AWS.X.X 5623226517f6[2643]: [2017-11-29
11:52:24,096] INFO Client environment:java.io.tmpdir=/tmp
(org.apache.zookeeper.ZooKeeper)
Nov 29 11:52:24 ec2-IP.AWS.X.X 5623226517f6[2643]: [2017-11-29
11:52:24,096] INFO Client environment:java.compiler=<NA>
(org.apache.zookeeper.ZooKeeper)
Nov 29 11:52:24 ec2-IP.AWS.X.X 5623226517f6[2643]: [2017-11-29
11:52:24,096] INFO Client environment:os.name=Linux
(org.apache.zookeeper.ZooKeeper)
Nov 29 11:52:24 ec2-IP.AWS.X.X 5623226517f6[2643]: [2017-11-29
11:52:24,096] INFO Client environment:os.arch=amd64
(org.apache.zookeeper.ZooKeeper)
Nov 29 11:52:24 ec2-IP.AWS.X.X 5623226517f6[2643]: [2017-11-29
11:52:24,096] INFO Client environment:os.version=4.9.62-21.56.amzn1.x86_64
(org.apache.zookeeper.ZooKeeper)
Nov 29 11:52:24 ec2-IP.AWS.X.X 5623226517f6[2643]: [2017-11-29
11:52:24,096] INFO Client environment:user.name=kafka
(org.apache.zookeeper.ZooKeeper)
Nov 29 11:52:24 ec2-IP.AWS.X.X 5623226517f6[2643]: [2017-11-29
11:52:24,096] INFO Client environment:user.home=/opt/kafka
(org.apache.zookeeper.ZooKeeper)
Nov 29 11:52:24 ec2-IP.AWS.X.X 5623226517f6[2643]: [2017-11-29
11:52:24,097] INFO Client environment:user.dir=/opt/kafka
(org.apache.zookeeper.ZooKeeper)
Nov 29 11:52:24 ec2-IP.AWS.X.X 5623226517f6[2643]: [2017-11-29
11:52:24,097] INFO Initiating client connection, connectString=zoo1:2181
sessionTimeout=6000 watcher=org.I0Itec.zkclient.ZkClient@1534f01b
(org.apache.zookeeper.ZooKeeper)
Nov 29 11:52:24 ec2-IP.AWS.X.X 5623226517f6[2643]: [2017-11-29
11:52:24,109] INFO Waiting for keeper state SyncConnected
(org.I0Itec.zkclient.ZkClient)
Nov 29 11:52:24 ec2-IP.AWS.X.X 5623226517f6[2643]: [2017-11-29
11:52:24,158] INFO Opening socket connection to server
ip-10-0-1-6.ec2.internal/10.0.1.6:2181. Will not attempt to authenticate
using SASL (unknown error) (org.apache.zookeeper.ClientCnxn)
Nov 29 11:52:24 ec2-IP.AWS.X.X 5623226517f6[2643]: [2017-11-29
11:52:24,164] INFO Socket connection established to
ip-10-0-1-6.ec2.internal/10.0.1.6:2181, initiating session
(org.apache.zookeeper.ClientCnxn)
Nov 29 11:52:24 ec2-IP.AWS.X.X 5623226517f6[2643]: [2017-11-29
11:52:24,171] INFO Session establishment complete on server
ip-10-0-1-6.ec2.internal/10.0.1.6:2181, sessionid = 0x10000005e28001e,
negotiated timeout = 6000 (org.apache.zookeeper.ClientCnxn)
Nov 29 11:52:24 ec2-IP.AWS.X.X 5623226517f6[2643]: [2017-11-29
11:52:24,173] INFO zookeeper state changed (SyncConnected)
(org.I0Itec.zkclient.ZkClient)
Nov 29 11:52:24 ec2-IP.AWS.X.X 5623226517f6[2643]: [2017-11-29
11:52:24,367] INFO Cluster ID = erwKqa9hTluUJeOpjiP-XQ
(kafka.server.KafkaServer)
Nov 29 11:52:24 ec2-IP.AWS.X.X 5623226517f6[2643]: [2017-11-29
11:52:24,374] WARN No meta.properties file under dir
/opt/kafka/logs/meta.properties (kafka.server.BrokerMetadataCheckpoint)
Nov 29 11:52:24 ec2-IP.AWS.X.X 5623226517f6[2643]: [2017-11-29
11:52:24,412] DEBUG Added sensor with name Fetch-delayQueue
(org.apache.kafka.common.metrics.Metrics)
Nov 29 11:52:24 ec2-IP.AWS.X.X 5623226517f6[2643]: [2017-11-29
11:52:24,413] DEBUG Added sensor with name Produce-delayQueue
(org.apache.kafka.common.metrics.Metrics)
Nov 29 11:52:24 ec2-IP.AWS.X.X 5623226517f6[2643]: [2017-11-29
11:52:24,413] INFO [ThrottledRequestReaper-Fetch]: Starting
(kafka.server.ClientQuotaManager$ThrottledRequestReaper)
Nov 29 11:52:24 ec2-IP.AWS.X.X 5623226517f6[2643]: [2017-11-29
11:52:24,414] DEBUG Added sensor with name Request-delayQueue
(org.apache.kafka.common.metrics.Metrics)
Nov 29 11:52:24 ec2-IP.AWS.X.X 5623226517f6[2643]: [2017-11-29
11:52:24,415] INFO [ThrottledRequestReaper-Produce]: Starting
(kafka.server.ClientQuotaManager$ThrottledRequestReaper)
Nov 29 11:52:24 ec2-IP.AWS.X.X 5623226517f6[2643]: [2017-11-29
11:52:24,415] INFO [ThrottledRequestReaper-Request]: Starting
(kafka.server.ClientQuotaManager$ThrottledRequestReaper)
Nov 29 11:52:24 ec2-IP.AWS.X.X 5623226517f6[2643]: [2017-11-29
11:52:24,491] INFO Loading logs. (kafka.log.LogManager)
Nov 29 11:52:24 ec2-IP.AWS.X.X 5623226517f6[2643]: [2017-11-29
11:52:24,510] INFO Logs loading complete in 19 ms. (kafka.log.LogManager)
Nov 29 11:52:24 ec2-IP.AWS.X.X 5623226517f6[2643]: [2017-11-29
11:52:24,596] INFO Starting log cleanup with a period of 300000 ms.
(kafka.log.LogManager)
Nov 29 11:52:24 ec2-IP.AWS.X.X 5623226517f6[2643]: [2017-11-29
11:52:24,599] DEBUG Scheduling task kafka-log-retention with initial delay
30000 ms and period 300000 ms. (kafka.utils.KafkaScheduler)
Nov 29 11:52:24 ec2-IP.AWS.X.X 5623226517f6[2643]: [2017-11-29
11:52:24,602] INFO Starting log flusher with a default period of
9223372036854775807 ms. (kafka.log.LogManager)
Nov 29 11:52:24 ec2-IP.AWS.X.X 5623226517f6[2643]: [2017-11-29
11:52:24,603] DEBUG Scheduling task kafka-log-flusher with initial delay
30000 ms and period 9223372036854775807 ms. (kafka.utils.KafkaScheduler)
Nov 29 11:52:24 ec2-IP.AWS.X.X 5623226517f6[2643]: [2017-11-29
11:52:24,604] DEBUG Scheduling task kafka-recovery-point-checkpoint with
initial delay 30000 ms and period 60000 ms. (kafka.utils.KafkaScheduler)
Nov 29 11:52:24 ec2-IP.AWS.X.X 5623226517f6[2643]: [2017-11-29
11:52:24,605] DEBUG Scheduling task kafka-log-start-offset-checkpoint with
initial delay 30000 ms and period 60000 ms. (kafka.utils.KafkaScheduler)
Nov 29 11:52:24 ec2-IP.AWS.X.X 5623226517f6[2643]: [2017-11-29
11:52:24,606] DEBUG Scheduling task kafka-delete-logs with initial delay
30000 ms and period 60000 ms. (kafka.utils.KafkaScheduler)
Nov 29 11:52:24 ec2-IP.AWS.X.X 5623226517f6[2643]: [2017-11-29
11:52:24,617] DEBUG Added sensor with name MemoryPoolUtilization
(org.apache.kafka.common.metrics.Metrics)
Nov 29 11:52:24 ec2-IP.AWS.X.X 5623226517f6[2643]: [2017-11-29
11:52:24,923] DEBUG Added sensor with name
connections-closed:listener-PLAINTEXTnetworkProcessor-0
(org.apache.kafka.common.metrics.Metrics)
Nov 29 11:52:24 ec2-IP.AWS.X.X 5623226517f6[2643]: [2017-11-29
11:52:24,924] DEBUG Added sensor with name
connections-created:listener-PLAINTEXTnetworkProcessor-0
(org.apache.kafka.common.metrics.Metrics)
Nov 29 11:52:24 ec2-IP.AWS.X.X 5623226517f6[2643]: [2017-11-29
11:52:24,926] DEBUG Added sensor with name
successful-authentication:listener-PLAINTEXTnetworkProcessor-0
(org.apache.kafka.common.metrics.Metrics)
Nov 29 11:52:24 ec2-IP.AWS.X.X 5623226517f6[2643]: [2017-11-29
11:52:24,929] DEBUG Added sensor with name
failed-authentication:listener-PLAINTEXTnetworkProcessor-0
(org.apache.kafka.common.metrics.Metrics)
Nov 29 11:52:24 ec2-IP.AWS.X.X 5623226517f6[2643]: [2017-11-29
11:52:24,929] DEBUG Added sensor with name
bytes-sent-received:listener-PLAINTEXTnetworkProcessor-0
(org.apache.kafka.common.metrics.Metrics)
Nov 29 11:52:24 ec2-IP.AWS.X.X 5623226517f6[2643]: [2017-11-29
11:52:24,930] DEBUG Added sensor with name
bytes-sent:listener-PLAINTEXTnetworkProcessor-0
(org.apache.kafka.common.metrics.Metrics)
Nov 29 11:52:24 ec2-IP.AWS.X.X 5623226517f6[2643]: [2017-11-29
11:52:24,932] DEBUG Added sensor with name
bytes-received:listener-PLAINTEXTnetworkProcessor-0
(org.apache.kafka.common.metrics.Metrics)
Nov 29 11:52:24 ec2-IP.AWS.X.X 5623226517f6[2643]: [2017-11-29
11:52:24,933] DEBUG Added sensor with name
select-time:listener-PLAINTEXTnetworkProcessor-0
(org.apache.kafka.common.metrics.Metrics)
Nov 29 11:52:24 ec2-IP.AWS.X.X 5623226517f6[2643]: [2017-11-29
11:52:24,933] DEBUG Added sensor with name
io-time:listener-PLAINTEXTnetworkProcessor-0
(org.apache.kafka.common.metrics.Metrics)
Nov 29 11:52:24 ec2-IP.AWS.X.X 5623226517f6[2643]: [2017-11-29
11:52:24,936] DEBUG Added sensor with name
connections-closed:listener-PLAINTEXTnetworkProcessor-1
(org.apache.kafka.common.metrics.Metrics)
Nov 29 11:52:24 ec2-IP.AWS.X.X 5623226517f6[2643]: [2017-11-29
11:52:24,936] DEBUG Added sensor with name
connections-created:listener-PLAINTEXTnetworkProcessor-1
(org.apache.kafka.common.metrics.Metrics)
Nov 29 11:52:24 ec2-IP.AWS.X.X 5623226517f6[2643]: [2017-11-29
11:52:24,936] DEBUG Added sensor with name
successful-authentication:listener-PLAINTEXTnetworkProcessor-1
(org.apache.kafka.common.metrics.Metrics)
Nov 29 11:52:24 ec2-IP.AWS.X.X 5623226517f6[2643]: [2017-11-29
11:52:24,937] DEBUG Added sensor with name
failed-authentication:listener-PLAINTEXTnetworkProcessor-1
(org.apache.kafka.common.metrics.Metrics)
Nov 29 11:52:24 ec2-IP.AWS.X.X 5623226517f6[2643]: [2017-11-29
11:52:24,937] DEBUG Added sensor with name
bytes-sent-received:listener-PLAINTEXTnetworkProcessor-1
(org.apache.kafka.common.metrics.Metrics)
Nov 29 11:52:24 ec2-IP.AWS.X.X 5623226517f6[2643]: [2017-11-29
11:52:24,937] DEBUG Added sensor with name
bytes-sent:listener-PLAINTEXTnetworkProcessor-1
(org.apache.kafka.common.metrics.Metrics)
Nov 29 11:52:24 ec2-IP.AWS.X.X 5623226517f6[2643]: [2017-11-29
11:52:24,938] DEBUG Added sensor with name
bytes-received:listener-PLAINTEXTnetworkProcessor-1
(org.apache.kafka.common.metrics.Metrics)
Nov 29 11:52:24 ec2-IP.AWS.X.X 5623226517f6[2643]: [2017-11-29
11:52:24,938] DEBUG Added sensor with name
select-time:listener-PLAINTEXTnetworkProcessor-1
(org.apache.kafka.common.metrics.Metrics)
Nov 29 11:52:24 ec2-IP.AWS.X.X 5623226517f6[2643]: [2017-11-29
11:52:24,939] DEBUG Added sensor with name
io-time:listener-PLAINTEXTnetworkProcessor-1
(org.apache.kafka.common.metrics.Metrics)
Nov 29 11:52:24 ec2-IP.AWS.X.X 5623226517f6[2643]: [2017-11-29
11:52:24,940] DEBUG Added sensor with name
connections-closed:listener-PLAINTEXTnetworkProcessor-2
(org.apache.kafka.common.metrics.Metrics)
Nov 29 11:52:24 ec2-IP.AWS.X.X 5623226517f6[2643]: [2017-11-29
11:52:24,940] DEBUG Added sensor with name
connections-created:listener-PLAINTEXTnetworkProcessor-2
(org.apache.kafka.common.metrics.Metrics)
Nov 29 11:52:24 ec2-IP.AWS.X.X 5623226517f6[2643]: [2017-11-29
11:52:24,947] DEBUG Added sensor with name
successful-authentication:listener-PLAINTEXTnetworkProcessor-2
(org.apache.kafka.common.metrics.Metrics)
Nov 29 11:52:24 ec2-IP.AWS.X.X 5623226517f6[2643]: [2017-11-29
11:52:24,947] DEBUG Added sensor with name
failed-authentication:listener-PLAINTEXTnetworkProcessor-2
(org.apache.kafka.common.metrics.Metrics)
Nov 29 11:52:24 ec2-IP.AWS.X.X 5623226517f6[2643]: [2017-11-29
11:52:24,947] DEBUG Added sensor with name
bytes-sent-received:listener-PLAINTEXTnetworkProcessor-2
(org.apache.kafka.common.metrics.Metrics)
Nov 29 11:52:24 ec2-IP.AWS.X.X 5623226517f6[2643]: [2017-11-29
11:52:24,947] DEBUG Added sensor with name
bytes-sent:listener-PLAINTEXTnetworkProcessor-2
(org.apache.kafka.common.metrics.Metrics)
Nov 29 11:52:24 ec2-IP.AWS.X.X 5623226517f6[2643]: [2017-11-29
11:52:24,948] DEBUG Added sensor with name
bytes-received:listener-PLAINTEXTnetworkProcessor-2
(org.apache.kafka.common.metrics.Metrics)
Nov 29 11:52:24 ec2-IP.AWS.X.X 5623226517f6[2643]: [2017-11-29
11:52:24,949] DEBUG Added sensor with name
select-time:listener-PLAINTEXTnetworkProcessor-2
(org.apache.kafka.common.metrics.Metrics)
Nov 29 11:52:24 ec2-IP.AWS.X.X 5623226517f6[2643]: [2017-11-29
11:52:24,950] DEBUG Added sensor with name
io-time:listener-PLAINTEXTnetworkProcessor-2
(org.apache.kafka.common.metrics.Metrics)
Nov 29 11:52:24 ec2-IP.AWS.X.X 5623226517f6[2643]: [2017-11-29
11:52:24,957] INFO Awaiting socket connections on 0.0.0.0:9092.
(kafka.network.Acceptor)
Nov 29 11:52:24 ec2-IP.AWS.X.X 5623226517f6[2643]: [2017-11-29
11:52:24,965] INFO [SocketServer brokerId=0] Started 1 acceptor threads
(kafka.network.SocketServer)
Nov 29 11:52:24 ec2-IP.AWS.X.X 5623226517f6[2643]: [2017-11-29
11:52:24,988] INFO [ExpirationReaper-0-Produce]: Starting
(kafka.server.DelayedOperationPurgatory$ExpiredOperationReaper)
Nov 29 11:52:24 ec2-IP.AWS.X.X 5623226517f6[2643]: [2017-11-29
11:52:24,991] INFO [ExpirationReaper-0-Fetch]: Starting
(kafka.server.DelayedOperationPurgatory$ExpiredOperationReaper)
Nov 29 11:52:24 ec2-IP.AWS.X.X 5623226517f6[2643]: [2017-11-29
11:52:24,997] INFO [ExpirationReaper-0-DeleteRecords]: Starting
(kafka.server.DelayedOperationPurgatory$ExpiredOperationReaper)
Nov 29 11:52:25 ec2-IP.AWS.X.X 5623226517f6[2643]: [2017-11-29
11:52:25,006] DEBUG Scheduling task isr-expiration with initial delay 0 ms
and period 5000 ms. (kafka.utils.KafkaScheduler)
Nov 29 11:52:25 ec2-IP.AWS.X.X 5623226517f6[2643]: [2017-11-29
11:52:25,011] DEBUG Scheduling task isr-change-propagation with initial
delay 0 ms and period 2500 ms. (kafka.utils.KafkaScheduler)
Nov 29 11:52:25 ec2-IP.AWS.X.X 5623226517f6[2643]: [2017-11-29
11:52:25,016] INFO [LogDirFailureHandler]: Starting
(kafka.server.ReplicaManager$LogDirFailureHandler)
Nov 29 11:52:25 ec2-IP.AWS.X.X 5623226517f6[2643]: [2017-11-29
11:52:25,057] INFO [ExpirationReaper-0-topic]: Starting
(kafka.server.DelayedOperationPurgatory$ExpiredOperationReaper)
Nov 29 11:52:25 ec2-IP.AWS.X.X 5623226517f6[2643]: [2017-11-29
11:52:25,066] DEBUG Path: /controller, Prefix: /controller, Suffix:
(kafka.utils.ZKCheckedEphemeral)
Nov 29 11:52:25 ec2-IP.AWS.X.X 5623226517f6[2643]: [2017-11-29
11:52:25,067] INFO Creating /controller (is it secure? false)
(kafka.utils.ZKCheckedEphemeral)
Nov 29 11:52:25 ec2-IP.AWS.X.X 5623226517f6[2643]: [2017-11-29
11:52:25,068] INFO [ExpirationReaper-0-Heartbeat]: Starting
(kafka.server.DelayedOperationPurgatory$ExpiredOperationReaper)
Nov 29 11:52:25 ec2-IP.AWS.X.X 5623226517f6[2643]: [2017-11-29
11:52:25,068] DEBUG Path: /controller, Prefix: /controller, Suffix:
(kafka.utils.ZKCheckedEphemeral)
Nov 29 11:52:25 ec2-IP.AWS.X.X 5623226517f6[2643]: [2017-11-29
11:52:25,076] INFO Result of znode creation is: OK
(kafka.utils.ZKCheckedEphemeral)
Nov 29 11:52:25 ec2-IP.AWS.X.X 5623226517f6[2643]: [2017-11-29
11:52:25,078] INFO [ExpirationReaper-0-Rebalance]: Starting
(kafka.server.DelayedOperationPurgatory$ExpiredOperationReaper)
Nov 29 11:52:25 ec2-IP.AWS.X.X 5623226517f6[2643]: [2017-11-29
11:52:25,087] DEBUG Partition map for /brokers/topics/__consumer_offsets is
Map() (kafka.utils.ZkUtils)
Nov 29 11:52:25 ec2-IP.AWS.X.X 5623226517f6[2643]: [2017-11-29
11:52:25,091] DEBUG Conditional update of path /controller_epoch with value
8 and expected version 6 succeeded, returning the new version: 7
(kafka.utils.ZkUtils)
Nov 29 11:52:25 ec2-IP.AWS.X.X 5623226517f6[2643]: [2017-11-29
11:52:25,096] INFO [GroupCoordinator 0]: Starting up.
(kafka.coordinator.group.GroupCoordinator)
Nov 29 11:52:25 ec2-IP.AWS.X.X 5623226517f6[2643]: [2017-11-29
11:52:25,096] DEBUG Initializing task scheduler.
(kafka.utils.KafkaScheduler)
Nov 29 11:52:25 ec2-IP.AWS.X.X 5623226517f6[2643]: [2017-11-29
11:52:25,096] DEBUG Scheduling task delete-expired-group-metadata with
initial delay 0 ms and period 600000 ms. (kafka.utils.KafkaScheduler)
Nov 29 11:52:25 ec2-IP.AWS.X.X 5623226517f6[2643]: [2017-11-29
11:52:25,097] INFO [GroupCoordinator 0]: Startup complete.
(kafka.coordinator.group.GroupCoordinator)
Nov 29 11:52:25 ec2-IP.AWS.X.X 5623226517f6[2643]: [2017-11-29
11:52:25,116] DEBUG [ProducerId Manager 0]: Read current producerId block
(brokerId:0,blockStartProducerId:9000,blockEndProducerId:9999), Zk path
version 10 (kafka.coordinator.transaction.ProducerIdManager)
Nov 29 11:52:25 ec2-IP.AWS.X.X 5623226517f6[2643]: [2017-11-29
11:52:25,120] INFO [GroupMetadataManager brokerId=0] Removed 0 expired
offsets in 13 milliseconds. (kafka.coordinator.group.GroupMetadataManager)
Nov 29 11:52:25 ec2-IP.AWS.X.X 5623226517f6[2643]: [2017-11-29
11:52:25,122] DEBUG Conditional update of path /latest_producer_id_block
with value
{"version":1,"broker":0,"block_start":"10000","block_end":"10999"} and
expected version 10 succeeded, returning the new version: 11
(kafka.utils.ZkUtils)
Nov 29 11:52:25 ec2-IP.AWS.X.X 5623226517f6[2643]: [2017-11-29
11:52:25,123] INFO [ProducerId Manager 0]: Acquired new producerId block
(brokerId:0,blockStartProducerId:10000,blockEndProducerId:10999) by writing
to Zk with path version 11 (kafka.coordinator.transaction.ProducerIdManager)
Nov 29 11:52:25 ec2-IP.AWS.X.X 5623226517f6[2643]: [2017-11-29
11:52:25,127] DEBUG Replicas assigned to topic [test], partition [0] are
[[0]] (kafka.utils.ZkUtils)
Nov 29 11:52:25 ec2-IP.AWS.X.X 5623226517f6[2643]: [2017-11-29
11:52:25,131] DEBUG Partition map for /brokers/topics/__transaction_state
is Map() (kafka.utils.ZkUtils)
Nov 29 11:52:25 ec2-IP.AWS.X.X 5623226517f6[2643]: [2017-11-29
11:52:25,132] DEBUG Added sensor with name connections-closed:
(org.apache.kafka.common.metrics.Metrics)
Nov 29 11:52:25 ec2-IP.AWS.X.X 5623226517f6[2643]: [2017-11-29
11:52:25,133] DEBUG Added sensor with name connections-created:
(org.apache.kafka.common.metrics.Metrics)
Nov 29 11:52:25 ec2-IP.AWS.X.X 5623226517f6[2643]: [2017-11-29
11:52:25,133] DEBUG Added sensor with name successful-authentication:
(org.apache.kafka.common.metrics.Metrics)
Nov 29 11:52:25 ec2-IP.AWS.X.X 5623226517f6[2643]: [2017-11-29
11:52:25,134] DEBUG Added sensor with name failed-authentication:
(org.apache.kafka.common.metrics.Metrics)
Nov 29 11:52:25 ec2-IP.AWS.X.X 5623226517f6[2643]: [2017-11-29
11:52:25,134] DEBUG Added sensor with name bytes-sent-received:
(org.apache.kafka.common.metrics.Metrics)
Nov 29 11:52:25 ec2-IP.AWS.X.X 5623226517f6[2643]: [2017-11-29
11:52:25,134] DEBUG Added sensor with name bytes-sent:
(org.apache.kafka.common.metrics.Metrics)
Nov 29 11:52:25 ec2-IP.AWS.X.X 5623226517f6[2643]: [2017-11-29
11:52:25,135] DEBUG Added sensor with name bytes-received:
(org.apache.kafka.common.metrics.Metrics)
Nov 29 11:52:25 ec2-IP.AWS.X.X 5623226517f6[2643]: [2017-11-29
11:52:25,136] DEBUG Read leaderISR
Some({"controller_epoch":6,"leader":0,"version":1,"leader_epoch":4,"isr":[0]})
for test-0 (kafka.utils.ReplicationUtils$)
Nov 29 11:52:25 ec2-IP.AWS.X.X 5623226517f6[2643]: [2017-11-29
11:52:25,136] DEBUG Added sensor with name select-time:
(org.apache.kafka.common.metrics.Metrics)
Nov 29 11:52:25 ec2-IP.AWS.X.X 5623226517f6[2643]: [2017-11-29
11:52:25,138] DEBUG Added sensor with name io-time:
(org.apache.kafka.common.metrics.Metrics)
Nov 29 11:52:25 ec2-IP.AWS.X.X 5623226517f6[2643]: [2017-11-29
11:52:25,156] INFO [TransactionCoordinator id=0] Starting up.
(kafka.coordinator.transaction.TransactionCoordinator)
Nov 29 11:52:25 ec2-IP.AWS.X.X 5623226517f6[2643]: [2017-11-29
11:52:25,156] DEBUG Initializing task scheduler.
(kafka.utils.KafkaScheduler)
Nov 29 11:52:25 ec2-IP.AWS.X.X 5623226517f6[2643]: [2017-11-29
11:52:25,156] DEBUG Scheduling task transaction-abort with initial delay
60000 ms and period 60000 ms. (kafka.utils.KafkaScheduler)
Nov 29 11:52:25 ec2-IP.AWS.X.X 5623226517f6[2643]: [2017-11-29
11:52:25,158] DEBUG Scheduling task transactionalId-expiration with initial
delay 3600000 ms and period 3600000 ms. (kafka.utils.KafkaScheduler)
Nov 29 11:52:25 ec2-IP.AWS.X.X 5623226517f6[2643]: [2017-11-29
11:52:25,158] INFO [TransactionCoordinator id=0] Startup complete.
(kafka.coordinator.transaction.TransactionCoordinator)
Nov 29 11:52:25 ec2-IP.AWS.X.X 5623226517f6[2643]: [2017-11-29
11:52:25,167] INFO [Transaction Marker Channel Manager 0]: Starting
(kafka.coordinator.transaction.TransactionMarkerChannelManager)
Nov 29 11:52:25 ec2-IP.AWS.X.X 5623226517f6[2643]: [2017-11-29
11:52:25,213] DEBUG Removing leader.replication.throttled.replicas from
broker 0 for topic test (kafka.server.TopicConfigHandler)
Nov 29 11:52:25 ec2-IP.AWS.X.X 5623226517f6[2643]: [2017-11-29
11:52:25,213] DEBUG Removing follower.replication.throttled.replicas from
broker 0 for topic test (kafka.server.TopicConfigHandler)
Nov 29 11:52:25 ec2-IP.AWS.X.X 5623226517f6[2643]: [2017-11-29
11:52:25,229] DEBUG Path: /brokers/ids/0, Prefix: /brokers, Suffix: /ids/0
(kafka.utils.ZKCheckedEphemeral)
Nov 29 11:52:25 ec2-IP.AWS.X.X 5623226517f6[2643]: [2017-11-29
11:52:25,229] INFO Creating /brokers/ids/0 (is it secure? false)
(kafka.utils.ZKCheckedEphemeral)
Nov 29 11:52:25 ec2-IP.AWS.X.X 5623226517f6[2643]: [2017-11-29
11:52:25,229] DEBUG Path: /brokers/ids/0, Prefix: /brokers, Suffix: /ids/0
(kafka.utils.ZKCheckedEphemeral)
Nov 29 11:52:25 ec2-IP.AWS.X.X 5623226517f6[2643]: [2017-11-29
11:52:25,231] DEBUG Path: /brokers/ids/0, Prefix: /brokers/ids, Suffix: /0
(kafka.utils.ZKCheckedEphemeral)
Nov 29 11:52:25 ec2-IP.AWS.X.X 5623226517f6[2643]: [2017-11-29
11:52:25,231] DEBUG Path: /brokers/ids/0, Prefix: /brokers/ids/0, Suffix:
(kafka.utils.ZKCheckedEphemeral)
Nov 29 11:52:25 ec2-IP.AWS.X.X 3f3d5ba7811c[2643]: 2017-11-29 11:52:25,232
[myid:2] - INFO [ProcessThread(sid:2 cport:-1)::PrepRequestProcessor@653]
- Got user-level KeeperException when processing
sessionid:0x10000005e28001e type:create cxid:0x38 zxid:0x1000000a0
txntype:-1 reqpath:n/a Error Path:/brokers Error:KeeperErrorCode =
NodeExists for /brokers
Nov 29 11:52:25 ec2-IP.AWS.X.X 3f3d5ba7811c[2643]: 2017-11-29 11:52:25,235
[myid:2] - INFO [ProcessThread(sid:2 cport:-1)::PrepRequestProcessor@653]
- Got user-level KeeperException when processing
sessionid:0x10000005e28001e type:create cxid:0x39 zxid:0x1000000a1
txntype:-1 reqpath:n/a Error Path:/brokers/ids Error:KeeperErrorCode =
NodeExists for /brokers/ids
Nov 29 11:52:25 ec2-IP.AWS.X.X 5623226517f6[2643]: [2017-11-29
11:52:25,238] INFO Result of znode creation is: OK
(kafka.utils.ZKCheckedEphemeral)
Nov 29 11:52:25 ec2-IP.AWS.X.X 5623226517f6[2643]: [2017-11-29
11:52:25,239] INFO Registered broker 0 at path /brokers/ids/0 with
addresses: EndPoint(IP.AWS.X.X,9092,ListenerName(PLAINTEXT),PLAINTEXT)
(kafka.utils.ZkUtils)
Nov 29 11:52:25 ec2-IP.AWS.X.X 5623226517f6[2643]: [2017-11-29
11:52:25,241] WARN No meta.properties file under dir
/opt/kafka/logs/meta.properties (kafka.server.BrokerMetadataCheckpoint)
Nov 29 11:52:25 ec2-IP.AWS.X.X 5623226517f6[2643]: [2017-11-29
11:52:25,254] INFO Kafka version : 1.0.0
(org.apache.kafka.common.utils.AppInfoParser)
Nov 29 11:52:25 ec2-IP.AWS.X.X 5623226517f6[2643]: [2017-11-29
11:52:25,254] INFO Kafka commitId : aaa7af6d4a11b29d
(org.apache.kafka.common.utils.AppInfoParser)
Nov 29 11:52:25 ec2-IP.AWS.X.X 5623226517f6[2643]: [2017-11-29
11:52:25,259] INFO [KafkaServer id=0] started (kafka.server.KafkaServer)
Nov 29 11:52:25 ec2-IP.AWS.X.X 5623226517f6[2643]: [2017-11-29
11:52:25,259] DEBUG Read leaderISR
Some({"controller_epoch":6,"leader":0,"version":1,"leader_epoch":4,"isr":[0]})
for test-0 (kafka.utils.ReplicationUtils$)
Nov 29 11:52:25 ec2-IP.AWS.X.X 3f3d5ba7811c[2643]: 2017-11-29 11:52:25,282
[myid:2] - INFO [ProcessThread(sid:2 cport:-1)::PrepRequestProcessor@653]
- Got user-level KeeperException when processing
sessionid:0x10000005e28001e type:delete cxid:0x41 zxid:0x1000000a3
txntype:-1 reqpath:n/a Error Path:/admin/preferred_replica_election
Error:KeeperErrorCode = NoNode for /admin/preferred_replica_election
Nov 29 11:52:25 ec2-IP.AWS.X.X 5623226517f6[2643]: [2017-11-29
11:52:25,285] DEBUG Initializing task scheduler.
(kafka.utils.KafkaScheduler)
Nov 29 11:52:25 ec2-IP.AWS.X.X 5623226517f6[2643]: [2017-11-29
11:52:25,286] DEBUG Scheduling task auto-leader-rebalance-task with initial
delay 5000 ms and period -1000 ms. (kafka.utils.KafkaScheduler)
Nov 29 11:52:25 ec2-IP.AWS.X.X 5623226517f6[2643]: [2017-11-29
11:52:25,325] DEBUG Added sensor with name connections-closed:broker-id-0
(org.apache.kafka.common.metrics.Metrics)
Nov 29 11:52:25 ec2-IP.AWS.X.X 5623226517f6[2643]: [2017-11-29
11:52:25,330] DEBUG Added sensor with name connections-created:broker-id-0
(org.apache.kafka.common.metrics.Metrics)
Nov 29 11:52:25 ec2-IP.AWS.X.X 5623226517f6[2643]: [2017-11-29
11:52:25,331] DEBUG Added sensor with name
successful-authentication:broker-id-0
(org.apache.kafka.common.metrics.Metrics)
Nov 29 11:52:25 ec2-IP.AWS.X.X 5623226517f6[2643]: [2017-11-29
11:52:25,332] DEBUG Added sensor with name
failed-authentication:broker-id-0 (org.apache.kafka.common.metrics.Metrics)
Nov 29 11:52:25 ec2-IP.AWS.X.X 5623226517f6[2643]: [2017-11-29
11:52:25,333] DEBUG Added sensor with name bytes-sent-received:broker-id-0
(org.apache.kafka.common.metrics.Metrics)
Nov 29 11:52:25 ec2-IP.AWS.X.X 5623226517f6[2643]: [2017-11-29
11:52:25,334] DEBUG Added sensor with name bytes-sent:broker-id-0
(org.apache.kafka.common.metrics.Metrics)
Nov 29 11:52:25 ec2-IP.AWS.X.X 5623226517f6[2643]: [2017-11-29
11:52:25,336] DEBUG Added sensor with name bytes-received:broker-id-0
(org.apache.kafka.common.metrics.Metrics)
Nov 29 11:52:25 ec2-IP.AWS.X.X 5623226517f6[2643]: [2017-11-29
11:52:25,336] DEBUG Added sensor with name select-time:broker-id-0
(org.apache.kafka.common.metrics.Metrics)
Nov 29 11:52:25 ec2-IP.AWS.X.X 5623226517f6[2643]: [2017-11-29
11:52:25,338] DEBUG Added sensor with name io-time:broker-id-0
(org.apache.kafka.common.metrics.Metrics)
Nov 29 11:52:25 ec2-IP.AWS.X.X 5623226517f6[2643]: [2017-11-29
11:52:25,351] DEBUG [Controller id=0, targetBrokerId=0] Initiating
connection to node IP.AWS.X.X:9092 (id: 0 rack: null)
(org.apache.kafka.clients.NetworkClient)
Nov 29 11:52:25 ec2-IP.AWS.X.X 5623226517f6[2643]: [2017-11-29
11:52:25,373] DEBUG Read leaderISR
Some({"controller_epoch":6,"leader":0,"version":1,"leader_epoch":4,"isr":[0]})
for test-0 (kafka.utils.ReplicationUtils$)
Nov 29 11:52:25 ec2-IP.AWS.X.X 5623226517f6[2643]: [2017-11-29
11:52:25,378] DEBUG Updated ISR for test-0 to 0
(kafka.utils.ReplicationUtils$)
Nov 29 11:52:25 ec2-IP.AWS.X.X 5623226517f6[2643]: [2017-11-29
11:52:25,382] DEBUG Conditional update of path
/brokers/topics/test/partitions/0/state with value
{"controller_epoch":8,"leader":0,"version":1,"leader_epoch":5,"isr":[0]}
and expected version 4 succeeded, returning the new version: 5
(kafka.utils.ZkUtils)
Nov 29 11:52:30 ec2-IP.AWS.X.X 5623226517f6[2643]: [2017-11-29
11:52:30,294] DEBUG Scheduling task auto-leader-rebalance-task with initial
delay 300000 ms and period -1000 ms. (kafka.utils.KafkaScheduler)
Nov 29 11:52:54 ec2-IP.AWS.X.X 5623226517f6[2643]: [2017-11-29
11:52:54,600] DEBUG Beginning log cleanup... (kafka.log.LogManager)
Nov 29 11:52:54 ec2-IP.AWS.X.X 5623226517f6[2643]: [2017-11-29
11:52:54,604] DEBUG Checking for dirty logs to flush...
(kafka.log.LogManager)
Nov 29 11:52:54 ec2-IP.AWS.X.X 5623226517f6[2643]: [2017-11-29
11:52:54,612] DEBUG Log cleanup completed. 0 files deleted in 0 seconds
(kafka.log.LogManager)
Nov 29 11:52:55 ec2-IP.AWS.X.X 5623226517f6[2643]: [2017-11-29
11:52:55,467] DEBUG [Controller id=0, targetBrokerId=0] Initiating
connection to node IP.AWS.X.X:9092 (id: 0 rack: null)
(org.apache.kafka.clients.NetworkClient)
Nov 29 11:53:23 ec2-IP.AWS.X.X 5623226517f6[2643]: 'kafka-service' process
is running with pid 264
Nov 29 11:53:23 ec2-IP.AWS.X.X 5623226517f6[2643]: [2017-11-29
11:53:23,257] DEBUG Accepted connection from /0:0:0:0:0:0:0:1:51612 on
/0:0:0:0:0:0:0:1:9092 and assigned it to processor 0, sendBufferSize
[actual|requested]: [102400|102400] recvBufferSize [actual|requested]:
[102400|102400] (kafka.network.Acceptor)
Nov 29 11:53:23 ec2-IP.AWS.X.X 5623226517f6[2643]: [2017-11-29
11:53:23,258] DEBUG Processor 0 listening to new connection from
/0:0:0:0:0:0:0:1:51612 (kafka.network.Processor)
Nov 29 11:53:23 ec2-IP.AWS.X.X 5623226517f6[2643]: [2017-11-29
11:53:23,260] DEBUG [SocketServer brokerId=0] Connection with
/0:0:0:0:0:0:0:1 disconnected (org.apache.kafka.common.network.Selector)
Nov 29 11:53:23 ec2-IP.AWS.X.X 5623226517f6[2643]: java.io.EOFException
Nov 29 11:53:23 ec2-IP.AWS.X.X 5623226517f6[2643]: #011at
org.apache.kafka.common.network.NetworkReceive.readFromReadableChannel(NetworkReceive.java:124)
Nov 29 11:53:23 ec2-IP.AWS.X.X 5623226517f6[2643]: #011at
org.apache.kafka.common.network.NetworkReceive.readFrom(NetworkReceive.java:93)
Nov 29 11:53:23 ec2-IP.AWS.X.X 5623226517f6[2643]: #011at
org.apache.kafka.common.network.KafkaChannel.receive(KafkaChannel.java:231)
Nov 29 11:53:23 ec2-IP.AWS.X.X 5623226517f6[2643]: #011at
org.apache.kafka.common.network.KafkaChannel.read(KafkaChannel.java:192)
Nov 29 11:53:23 ec2-IP.AWS.X.X 5623226517f6[2643]: #011at
org.apache.kafka.common.network.Selector.attemptRead(Selector.java:528)
Nov 29 11:53:23 ec2-IP.AWS.X.X 5623226517f6[2643]: #011at
org.apache.kafka.common.network.Selector.pollSelectionKeys(Selector.java:469)
Nov 29 11:53:23 ec2-IP.AWS.X.X 5623226517f6[2643]: #011at
org.apache.kafka.common.network.Selector.poll(Selector.java:398)
Nov 29 11:53:23 ec2-IP.AWS.X.X 5623226517f6[2643]: #011at
kafka.network.Processor.poll(SocketServer.scala:535)
Nov 29 11:53:23 ec2-IP.AWS.X.X 5623226517f6[2643]: #011at
kafka.network.Processor.run(SocketServer.scala:452)
Nov 29 11:53:23 ec2-IP.AWS.X.X 5623226517f6[2643]: #011at
java.lang.Thread.run(Thread.java:748)
Nov 29 11:53:25 ec2-IP.AWS.X.X 5623226517f6[2643]: [2017-11-29
11:53:25,597] DEBUG [Controller id=0, targetBrokerId=0] Initiating
connection to node IP.AWS.X.X:9092 (id: 0 rack: null)
(org.apache.kafka.clients.NetworkClient)
Nov 29 11:53:44 ec2-IP.AWS.X.X dhclient[2234]: XMT: Solicit on eth0,
interval 122890ms.
Nov 29 11:53:55 ec2-IP.AWS.X.X 5623226517f6[2643]: [2017-11-29
11:53:55,725] DEBUG [Controller id=0, targetBrokerId=0] Initiating
connection to node IP.AWS.X.X:9092 (id: 0 rack: null)
(org.apache.kafka.clients.NetworkClient)
Nov 29 11:54:23 ec2-IP.AWS.X.X 5623226517f6[2643]: [2017-11-29
11:54:23,258] DEBUG Accepted connection from /0:0:0:0:0:0:0:1:51630 on
/0:0:0:0:0:0:0:1:9092 and assigned it to processor 1, sendBufferSize
[actual|requested]: [102400|102400] recvBufferSize [actual|requested]:
[102400|102400] (kafka.network.Acceptor)
Nov 29 11:54:23 ec2-IP.AWS.X.X 5623226517f6[2643]: [2017-11-29
11:54:23,258] DEBUG Processor 1 listening to new connection from
/0:0:0:0:0:0:0:1:51630 (kafka.network.Processor)
Nov 29 11:54:23 ec2-IP.AWS.X.X 5623226517f6[2643]: [2017-11-29
11:54:23,259] DEBUG [SocketServer brokerId=0] Connection with
/0:0:0:0:0:0:0:1 disconnected (org.apache.kafka.common.network.Selector)
Nov 29 11:54:23 ec2-IP.AWS.X.X 5623226517f6[2643]: java.io.EOFException
Nov 29 11:54:23 ec2-IP.AWS.X.X 5623226517f6[2643]: #011at
org.apache.kafka.common.network.NetworkReceive.readFromReadableChannel(NetworkReceive.java:124)
Nov 29 11:54:23 ec2-IP.AWS.X.X 5623226517f6[2643]: #011at
org.apache.kafka.common.network.NetworkReceive.readFrom(NetworkReceive.java:93)
Nov 29 11:54:23 ec2-IP.AWS.X.X 5623226517f6[2643]: #011at
org.apache.kafka.common.network.KafkaChannel.receive(KafkaChannel.java:231)
Nov 29 11:54:23 ec2-IP.AWS.X.X 5623226517f6[2643]: #011at
org.apache.kafka.common.network.KafkaChannel.read(KafkaChannel.java:192)
Nov 29 11:54:23 ec2-IP.AWS.X.X 5623226517f6[2643]: #011at
org.apache.kafka.common.network.Selector.attemptRead(Selector.java:528)
Nov 29 11:54:23 ec2-IP.AWS.X.X 5623226517f6[2643]: #011at
org.apache.kafka.common.network.Selector.pollSelectionKeys(Selector.java:469)
Nov 29 11:54:23 ec2-IP.AWS.X.X 5623226517f6[2643]: #011at
org.apache.kafka.common.network.Selector.poll(Selector.java:398)
Nov 29 11:54:23 ec2-IP.AWS.X.X 5623226517f6[2643]: #011at
kafka.network.Processor.poll(SocketServer.scala:535)
Nov 29 11:54:23 ec2-IP.AWS.X.X 5623226517f6[2643]: #011at
kafka.network.Processor.run(SocketServer.scala:452)
Nov 29 11:54:23 ec2-IP.AWS.X.X 5623226517f6[2643]: #011at
java.lang.Thread.run(Thread.java:748)
Nov 29 11:54:25 ec2-IP.AWS.X.X 5623226517f6[2643]: [2017-11-29
11:54:25,853] DEBUG [Controller id=0, targetBrokerId=0] Initiating
connection to node IP.AWS.X.X:9092 (id: 0 rack: null)
(org.apache.kafka.clients.NetworkClient)
Nov 29 11:54:48 ec2-IP.AWS.X.X 3f3d5ba7811c[2643]: 2017-11-29 11:54:48,101
[myid:2] - INFO [ProcessThread(sid:2 cport:-1)::PrepRequestProcessor@487]
- Processed session termination for sessionid: 0x10000005e28001f
Nov 29 11:54:48 ec2-IP.AWS.X.X 5623226517f6[2643]: [2017-11-29
11:54:48,335] DEBUG Accepted connection from /10.255.0.3:64745 on /
10.255.0.6:9092 and assigned it to processor 2, sendBufferSize
[actual|requested]: [102400|102400] recvBufferSize [actual|requested]:
[102400|102400] (kafka.network.Acceptor)
Nov 29 11:54:48 ec2-IP.AWS.X.X 5623226517f6[2643]: [2017-11-29
11:54:48,335] DEBUG Processor 2 listening to new connection from /
10.255.0.3:64745 (kafka.network.Processor)
Nov 29 11:54:48 ec2-IP.AWS.X.X 5623226517f6[2643]: [2017-11-29
11:54:48,596] DEBUG [SocketServer brokerId=0] Connection with /10.255.0.3
disconnected (org.apache.kafka.common.network.Selector)
Nov 29 11:54:48 ec2-IP.AWS.X.X 5623226517f6[2643]: java.io.EOFException
Nov 29 11:54:48 ec2-IP.AWS.X.X 5623226517f6[2643]: #011at
org.apache.kafka.common.network.NetworkReceive.readFromReadableChannel(NetworkReceive.java:124)
Nov 29 11:54:48 ec2-IP.AWS.X.X 5623226517f6[2643]: #011at
org.apache.kafka.common.network.NetworkReceive.readFrom(NetworkReceive.java:93)
Nov 29 11:54:48 ec2-IP.AWS.X.X 5623226517f6[2643]: #011at
org.apache.kafka.common.network.KafkaChannel.receive(KafkaChannel.java:231)
Nov 29 11:54:48 ec2-IP.AWS.X.X 5623226517f6[2643]: #011at
org.apache.kafka.common.network.KafkaChannel.read(KafkaChannel.java:192)
Nov 29 11:54:48 ec2-IP.AWS.X.X 5623226517f6[2643]: #011at
org.apache.kafka.common.network.Selector.attemptRead(Selector.java:528)
Nov 29 11:54:48 ec2-IP.AWS.X.X 5623226517f6[2643]: #011at
org.apache.kafka.common.network.Selector.pollSelectionKeys(Selector.java:469)
Nov 29 11:54:48 ec2-IP.AWS.X.X 5623226517f6[2643]: #011at
org.apache.kafka.common.network.Selector.poll(Selector.java:398)
Nov 29 11:54:48 ec2-IP.AWS.X.X 5623226517f6[2643]: #011at
kafka.network.Processor.poll(SocketServer.scala:535)
Nov 29 11:54:48 ec2-IP.AWS.X.X 5623226517f6[2643]: #011at
kafka.network.Processor.run(SocketServer.scala:452)
Nov 29 11:54:48 ec2-IP.AWS.X.X 5623226517f6[2643]: #011at
java.lang.Thread.run(Thread.java:748)
Nov 29 11:54:55 ec2-IP.AWS.X.X 5623226517f6[2643]: [2017-11-29
11:54:55,981] DEBUG [Controller id=0, targetBrokerId=0] Initiating
connection to node IP.AWS.X.X:9092 (id: 0 rack: null)
(org.apache.kafka.clients.NetworkClient)
Nov 29 11:55:18 ec2-IP.AWS.X.X 3f3d5ba7811c[2643]: 2017-11-29 11:55:18,795
[myid:2] - INFO [ProcessThread(sid:2 cport:-1)::PrepRequestProcessor@487]
- Processed session termination for sessionid: 0x10000005e280020
Nov 29 11:55:19 ec2-IP.AWS.X.X 5623226517f6[2643]: [2017-11-29
11:55:19,129] DEBUG Accepted connection from /10.255.0.3:64885 on /
10.255.0.6:9092 and assigned it to processor 0, sendBufferSize
[actual|requested]: [102400|102400] recvBufferSize [actual|requested]:
[102400|102400] (kafka.network.Acceptor)
Nov 29 11:55:19 ec2-IP.AWS.X.X 5623226517f6[2643]: [2017-11-29
11:55:19,129] DEBUG Processor 0 listening to new connection from /
10.255.0.3:64885 (kafka.network.Processor)
Nov 29 11:55:23 ec2-IP.AWS.X.X 5623226517f6[2643]: [2017-11-29
11:55:23,260] DEBUG Accepted connection from /0:0:0:0:0:0:0:1:51646 on
/0:0:0:0:0:0:0:1:9092 and assigned it to processor 1, sendBufferSize
[actual|requested]: [102400|102400] recvBufferSize [actual|requested]:
[102400|102400] (kafka.network.Acceptor)
Nov 29 11:55:23 ec2-IP.AWS.X.X 5623226517f6[2643]: [2017-11-29
11:55:23,261] DEBUG Processor 1 listening to new connection from
/0:0:0:0:0:0:0:1:51646 (kafka.network.Processor)
Nov 29 11:55:23 ec2-IP.AWS.X.X 5623226517f6[2643]: [2017-11-29
11:55:23,261] DEBUG [SocketServer brokerId=0] Connection with
/0:0:0:0:0:0:0:1 disconnected (org.apache.kafka.common.network.Selector)
Nov 29 11:55:23 ec2-IP.AWS.X.X 5623226517f6[2643]: java.io.EOFException
Nov 29 11:55:23 ec2-IP.AWS.X.X 5623226517f6[2643]: #011at
org.apache.kafka.common.network.NetworkReceive.readFromReadableChannel(NetworkReceive.java:124)
Nov 29 11:55:23 ec2-IP.AWS.X.X 5623226517f6[2643]: #011at
org.apache.kafka.common.network.NetworkReceive.readFrom(NetworkReceive.java:93)
Nov 29 11:55:23 ec2-IP.AWS.X.X 5623226517f6[2643]: #011at
org.apache.kafka.common.network.KafkaChannel.receive(KafkaChannel.java:231)
Nov 29 11:55:23 ec2-IP.AWS.X.X 5623226517f6[2643]: #011at
org.apache.kafka.common.network.KafkaChannel.read(KafkaChannel.java:192)
Nov 29 11:55:23 ec2-IP.AWS.X.X 5623226517f6[2643]: #011at
org.apache.kafka.common.network.Selector.attemptRead(Selector.java:528)
Nov 29 11:55:23 ec2-IP.AWS.X.X 5623226517f6[2643]: #011at
org.apache.kafka.common.network.Selector.pollSelectionKeys(Selector.java:469)
Nov 29 11:55:23 ec2-IP.AWS.X.X 5623226517f6[2643]: #011at
org.apache.kafka.common.network.Selector.poll(Selector.java:398)
Nov 29 11:55:23 ec2-IP.AWS.X.X 5623226517f6[2643]: #011at
kafka.network.Processor.poll(SocketServer.scala:535)
Nov 29 11:55:23 ec2-IP.AWS.X.X 5623226517f6[2643]: #011at
kafka.network.Processor.run(SocketServer.scala:452)
Nov 29 11:55:23 ec2-IP.AWS.X.X 5623226517f6[2643]: #011at
java.lang.Thread.run(Thread.java:748)
Nov 29 11:55:26 ec2-IP.AWS.X.X 5623226517f6[2643]: [2017-11-29
11:55:26,100] DEBUG [Controller id=0, targetBrokerId=0] Initiating
connection to node IP.AWS.X.X:9092 (id: 0 rack: null)
(org.apache.kafka.clients.NetworkClient)
Nov 29 11:55:47 ec2-IP.AWS.X.X dhclient[2234]: XMT: Solicit on eth0,
interval 113300ms.
Nov 29 11:55:56 ec2-IP.AWS.X.X 5623226517f6[2643]: [2017-11-29
11:55:56,229] DEBUG [Controller id=0, targetBrokerId=0] Initiating
connection to node IP.AWS.X.X:9092 (id: 0 rack: null)
(org.apache.kafka.clients.NetworkClient)
--
Novantum
ron.arts@novantum.com
Amsterdam