You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@ambari.apache.org by "Hadoop QA (JIRA)" <ji...@apache.org> on 2017/05/19 15:17:04 UTC

[jira] [Commented] (AMBARI-21075) Kafka broker goes down after Ambari upgrade from 2.5.0 to 2.5.1 due to missing 'kafka.timeline.metrics.instanceId' property

    [ https://issues.apache.org/jira/browse/AMBARI-21075?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16017524#comment-16017524 ] 

Hadoop QA commented on AMBARI-21075:
------------------------------------

{color:red}-1 overall{color}.  Here are the results of testing the latest attachment 
  http://issues.apache.org/jira/secure/attachment/12868976/AMBARI-21075-trunk.patch
  against trunk revision .

    {color:red}-1 patch{color}.  Top-level [trunk compilation|https://builds.apache.org/job/Ambari-trunk-test-patch/11602//artifact/patch-work/trunkJavacWarnings.txt] may be broken.

Console output: https://builds.apache.org/job/Ambari-trunk-test-patch/11602//console

This message is automatically generated.

> Kafka broker goes down after Ambari upgrade from 2.5.0 to 2.5.1 due to missing 'kafka.timeline.metrics.instanceId' property
> ---------------------------------------------------------------------------------------------------------------------------
>
>                 Key: AMBARI-21075
>                 URL: https://issues.apache.org/jira/browse/AMBARI-21075
>             Project: Ambari
>          Issue Type: Bug
>          Components: ambari-upgrade
>    Affects Versions: 2.5.1
>            Reporter: Dmytro Sen
>            Assignee: Dmytro Sen
>            Priority: Blocker
>             Fix For: 2.5.1
>
>         Attachments: AMBARI-21075-trunk.patch
>
>
> Kafka logs indicate:
> {code}
> [2017-05-19 03:42:17,105] FATAL  (kafka.Kafka$)
> java.lang.IllegalArgumentException: requirement failed: Missing required property 'kafka.timeline.metrics.instanceId'
>         at scala.Predef$.require(Predef.scala:233)
>         at kafka.utils.VerifiableProperties.getString(VerifiableProperties.scala:177)
>         at org.apache.hadoop.metrics2.sink.kafka.KafkaTimelineMetricsReporter.init(KafkaTimelineMetricsReporter.java:169)
>         at kafka.metrics.KafkaMetricsReporter$$anonfun$startReporters$1.apply(KafkaMetricsReporter.scala:66)
>         at kafka.metrics.KafkaMetricsReporter$$anonfun$startReporters$1.apply(KafkaMetricsReporter.scala:64)
>         at scala.collection.IndexedSeqOptimized$class.foreach(IndexedSeqOptimized.scala:33)
>         at scala.collection.mutable.WrappedArray.foreach(WrappedArray.scala:34)
>         at kafka.metrics.KafkaMetricsReporter$.startReporters(KafkaMetricsReporter.scala:64)
>         at kafka.server.KafkaServerStartable$.fromProps(KafkaServerStartable.scala:27)
>         at kafka.Kafka$.main(Kafka.scala:58)
>         at kafka.Kafka.main(Kafka.scala)
> {code}
> Did not see this property being added on ambari_upgrade_config_changes.json file
> On a different upgrade path like fromAmbari-2.2.2.o to 2.5.1, this property got added
> {code}
> [root@ ambari-server]# cat ambari_upgrade_config_changes_05-19-2017_00\:23\:28.json | grep -C4 kafka.timeline.metrics.instanceId
>     "kafka-broker": {
>       "Added": {
>         "kafka.timeline.metrics.hosts": "{{ams_collector_hosts}}",
>         "kafka.timeline.metrics.set.instanceId": "{{set_instanceId}}",
>         "kafka.timeline.metrics.instanceId": "{{cluster_name}}",
>         "port": "6667"
>       },
> {code}



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)