[jira] [Commented] (AMBARI-18841) Grafana fails to start

["Aravindan Vijayan (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/AMBARI-18841?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15652425#comment-15652425 ] 

Aravindan Vijayan commented on AMBARI-18841:
--------------------------------------------


PROBLEM
Grafana Start fails intermittently. This is because at times Grafana DB starts up slower than the Grafana Server startup. Hence, Grafana server scripts give up and exit as error, with a running Grafana Server instance. The DB starts up fine sometime after that. Since the PID is not logged correctly, Ambari assumes Grafana Server is down. Therefore START Grafana fails from Ambari because of an already running Grafana instance.

FIX
On Ambari's end, kill any running instance of Grafana while starting up Grafana. In the worst case of slow DB startup, the second START will succeed.

> Grafana fails to start
> ----------------------
>
>                 Key: AMBARI-18841
>                 URL: https://issues.apache.org/jira/browse/AMBARI-18841
>             Project: Ambari
>          Issue Type: Bug
>          Components: ambari-metrics
>    Affects Versions: 2.5.0
>         Environment: Fresh install of 2.5.0 cluster.
>            Reporter: Aravindan Vijayan
>            Assignee: Aravindan Vijayan
>            Priority: Blocker
>             Fix For: 2.5.0
>
>         Attachments: AMBARI-18841.patch
>
>
> Grafana fails to start with the below error
> {code}
> Traceback (most recent call last):
>   File "/var/lib/ambari-agent/cache/common-services/AMBARI_METRICS/0.1.0/package/scripts/metrics_grafana.py", line 69, in <module>
>     AmsGrafana().execute()
>   File "/usr/lib/python2.6/site-packages/resource_management/libraries/script/script.py", line 280, in execute
>     method(env)
>   File "/var/lib/ambari-agent/cache/common-services/AMBARI_METRICS/0.1.0/package/scripts/metrics_grafana.py", line 47, in start
>     not_if = params.grafana_process_exists_cmd,
>   File "/usr/lib/python2.6/site-packages/resource_management/core/base.py", line 155, in __init__
>     self.env.run()
>   File "/usr/lib/python2.6/site-packages/resource_management/core/environment.py", line 160, in run
>     self.run_action(resource, action)
>   File "/usr/lib/python2.6/site-packages/resource_management/core/environment.py", line 124, in run_action
>     provider_action()
>   File "/usr/lib/python2.6/site-packages/resource_management/core/providers/system.py", line 262, in action_run
>     tries=self.resource.tries, try_sleep=self.resource.try_sleep)
>   File "/usr/lib/python2.6/site-packages/resource_management/core/shell.py", line 72, in inner
>     result = function(command, **kwargs)
>   File "/usr/lib/python2.6/site-packages/resource_management/core/shell.py", line 102, in checked_call
>     tries=tries, try_sleep=try_sleep, timeout_kill_strategy=timeout_kill_strategy)
>   File "/usr/lib/python2.6/site-packages/resource_management/core/shell.py", line 150, in _call_wrapper
>     result = _call(command, **kwargs_copy)
>   File "/usr/lib/python2.6/site-packages/resource_management/core/shell.py", line 303, in _call
>     raise ExecutionFailed(err_msg, code, out, err)
> resource_management.core.exceptions.ExecutionFailed: Execution of '/usr/sbin/ambari-metrics-grafana start' returned 1. ######## Hortonworks #############
> This is MOTD message, added for testing in qe infra
> Starting Ambari Metrics Grafana: .... FAILED
> {code}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)