You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@metron.apache.org by dlyle65535 <gi...@git.apache.org> on 2016/08/01 14:50:32 UTC
[GitHub] incubator-metron pull request #203: METRON-357: Create Ambari Service Defini...
GitHub user dlyle65535 opened a pull request:
https://github.com/apache/incubator-metron/pull/203
METRON-357: Create Ambari Service Definition for Kibana
First iteration of the Kibana Service which is required to deploy Metron via Ambari.
Steps to test:
On a running Ambari-managed cluster:
copy metron-deployment/packaging/ambari/src/main/resources/stacks/HDP/2.4/services/KIBANA to /var/lib/ambari-server/resources/stacks/<STACK-NAME>/<STACK-VERSION>/services/KIBANA
copy metron-deployment/packaging/ambari/src/main/resources/common-services/KIBANA to /var/lib/ambari-server/resources/common-services/KIBANA
restart ambari-server
use the Add Service wizard to add Kibana to your cluster.
Note: STACK-NAME and STACK-VERSION need to be substituted for your environment. For example, if testing on HDP 2.4, STACK-NAME = HDP and STACK-VERSION = 2.4
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/dlyle65535/incubator-metron KIBANA_AMBARI
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/incubator-metron/pull/203.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #203
----
commit de338da8357bf7ae6f386e19aa20a77fc477f09c
Author: David Lyle <dl...@gmail.com>
Date: 2016-07-28T20:00:38Z
METRON-357: Create Ambari Service Definition for Kibana
----
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---
[GitHub] incubator-metron issue #203: METRON-357: Create Ambari Service Definition fo...
Posted by nickwallen <gi...@git.apache.org>.
Github user nickwallen commented on the issue:
https://github.com/apache/incubator-metron/pull/203
I can spin-up a cluster with the latest from master and try it out there, if you like. If it is just an issue with my environment, and we're not aiming for backwards-compat, then maybe that makes sense.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---
[GitHub] incubator-metron issue #203: METRON-357: Create Ambari Service Definition fo...
Posted by james-sirota <gi...@git.apache.org>.
Github user james-sirota commented on the issue:
https://github.com/apache/incubator-metron/pull/203
+1
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---
[GitHub] incubator-metron pull request #203: METRON-357: Create Ambari Service Defini...
Posted by asfgit <gi...@git.apache.org>.
Github user asfgit closed the pull request at:
https://github.com/apache/incubator-metron/pull/203
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---
[GitHub] incubator-metron issue #203: METRON-357: Create Ambari Service Definition fo...
Posted by dlyle65535 <gi...@git.apache.org>.
Github user dlyle65535 commented on the issue:
https://github.com/apache/incubator-metron/pull/203
I think I'll fire up a 2.3 and see if the problem occurs there as well.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---
[GitHub] incubator-metron issue #203: METRON-357: Create Ambari Service Definition fo...
Posted by dlyle65535 <gi...@git.apache.org>.
Github user dlyle65535 commented on the issue:
https://github.com/apache/incubator-metron/pull/203
I ran this up on 2.2 and 2.4 and both ran fine. There must be some sort of issue with 2.1.2.1.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---
[GitHub] incubator-metron issue #203: METRON-357: Create Ambari Service Definition fo...
Posted by cestella <gi...@git.apache.org>.
Github user cestella commented on the issue:
https://github.com/apache/incubator-metron/pull/203
Sorry Dave! I was sleeping on the job. +1 by inspection, this looks good
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---
[GitHub] incubator-metron issue #203: METRON-357: Create Ambari Service Definition fo...
Posted by nickwallen <gi...@git.apache.org>.
Github user nickwallen commented on the issue:
https://github.com/apache/incubator-metron/pull/203
Yes, my testing was with quick-dev and 2.1.2.1
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---
[GitHub] incubator-metron issue #203: METRON-357: Create Ambari Service Definition fo...
Posted by dlyle65535 <gi...@git.apache.org>.
Github user dlyle65535 commented on the issue:
https://github.com/apache/incubator-metron/pull/203
Bump?
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---
[GitHub] incubator-metron issue #203: METRON-357: Create Ambari Service Definition fo...
Posted by dlyle65535 <gi...@git.apache.org>.
Github user dlyle65535 commented on the issue:
https://github.com/apache/incubator-metron/pull/203
I don't have an Ambari running right now, but it's somewhere under Stacks and Versions (then Stacks under that iirc).
Looks like yours will be 2.3.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---
[GitHub] incubator-metron issue #203: METRON-357: Create Ambari Service Definition fo...
Posted by nickwallen <gi...@git.apache.org>.
Github user nickwallen commented on the issue:
https://github.com/apache/incubator-metron/pull/203
Looks very cool. I am trying to test this. In your instructions you have a placeholder called STACK-VERSION.
When I look at my install of Ambari, I see a clusterf* of possible STACK-VERSIONs. How can I tell which STACK-VERSION I should be using? Can I find that in the Ambari UI somehow?
```
[root@node1 ambari-server]# ls -l /var/lib/ambari-server/resources/stacks/HDP/
total 32
drwxr-xr-x. 4 root root 4096 May 2 16:55 2.0
drwxr-xr-x. 6 root root 4096 May 2 16:55 2.0.6
drwxr-xr-x. 4 root root 4096 May 2 16:55 2.0.6.GlusterFS
drwxr-xr-x. 5 root root 4096 May 2 16:55 2.1
drwxr-xr-x. 5 root root 4096 May 2 16:55 2.1.GlusterFS
drwxr-xr-x. 6 root root 4096 May 2 16:55 2.2
drwxr-xr-x. 5 root root 4096 May 2 16:55 2.3
drwxr-xr-x. 5 root root 4096 May 2 16:55 2.3.GlusterFS
```
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---
[GitHub] incubator-metron issue #203: METRON-357: Create Ambari Service Definition fo...
Posted by dlyle65535 <gi...@git.apache.org>.
Github user dlyle65535 commented on the issue:
https://github.com/apache/incubator-metron/pull/203
I'm not really sure what the right answer is. I've been testing with 2.4 (that's the targeted version), but I would expect it to run on 2.3. Our current quick dev is actually 2.1.2.1, so that could be an issue.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---
[GitHub] incubator-metron issue #203: METRON-357: Create Ambari Service Definition fo...
Posted by dlyle65535 <gi...@git.apache.org>.
Github user dlyle65535 commented on the issue:
https://github.com/apache/incubator-metron/pull/203
I suspect this requires Ambari 2.4 to work, there seems to be an issue with the params getting filled in otherwise. I'll dig into it a bit.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---
[GitHub] incubator-metron issue #203: METRON-357: Create Ambari Service Definition fo...
Posted by nickwallen <gi...@git.apache.org>.
Github user nickwallen commented on the issue:
https://github.com/apache/incubator-metron/pull/203
Everything went smoothly with the Kibana installation. Love the guided installation process.
I did get a warning when it tried to start Kibana and failed to. I get the same error when trying to start Kibana through Ambari after the installation process.
I can login to the host and successfully start Kibana with a `service kibana start`. I am assuming its an issue with the Ambari configuration, not the Kibana configuration that Ambari laid down.
```
Traceback (most recent call last):
File "/var/lib/ambari-agent/cache/common-services/KIBANA/4.5.1/package/scripts/kibana_master.py", line 86, in <module>
Kibana().execute()
File "/usr/lib/python2.6/site-packages/resource_management/libraries/script/script.py", line 216, in execute
method(env)
File "/var/lib/ambari-agent/cache/common-services/KIBANA/4.5.1/package/scripts/kibana_master.py", line 63, in start
self.configure(env)
File "/var/lib/ambari-agent/cache/common-services/KIBANA/4.5.1/package/scripts/kibana_master.py", line 50, in configure
kibana()
File "/var/lib/ambari-agent/cache/common-services/KIBANA/4.5.1/package/scripts/kibana.py", line 42, in kibana
print "Master env: ""{}/kibana.yml".format(params.conf_dir)
ValueError: zero length field name in format
```
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---
[GitHub] incubator-metron issue #203: METRON-357: Create Ambari Service Definition fo...
Posted by nickwallen <gi...@git.apache.org>.
Github user nickwallen commented on the issue:
https://github.com/apache/incubator-metron/pull/203
I was able stop Kibana from the command-line and after a minute or so Ambari reported Kibana as stopped (red) in the UI. That's good stuff.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---