You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@whirr.apache.org by "Lars George (JIRA)" <ji...@apache.org> on 2011/03/10 23:41:59 UTC
[jira] Created: (WHIRR-255) Add support for Puppet
Add support for Puppet
----------------------
Key: WHIRR-255
URL: https://issues.apache.org/jira/browse/WHIRR-255
Project: Whirr
Issue Type: Improvement
Components: core
Affects Versions: 0.3.0
Reporter: Lars George
Along the lines of WHIRR-49, implement support for Puppet to bootstrap servers.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] Commented: (WHIRR-255) Add support for Puppet
Posted by "Andrei Savu (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/WHIRR-255?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13005634#comment-13005634 ]
Andrei Savu commented on WHIRR-255:
-----------------------------------
I just had a chat with the guys behind hstack.org and they would love to help us reuse the Puppet recipes they wrote. I will work side by side with them for the following 3 months.
> Add support for Puppet
> ----------------------
>
> Key: WHIRR-255
> URL: https://issues.apache.org/jira/browse/WHIRR-255
> Project: Whirr
> Issue Type: Improvement
> Components: core
> Affects Versions: 0.3.0
> Reporter: Lars George
>
> Along the lines of WHIRR-49, implement support for Puppet to bootstrap servers.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (WHIRR-255) Add support for Puppet
Posted by "Adrian Cole (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/WHIRR-255?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13057525#comment-13057525 ]
Adrian Cole commented on WHIRR-255:
-----------------------------------
referring to http://semicomplete.com/presentations/puppet-at-loggly/puppet-at-loggly.pdf.html it seems nodeless setup would work well in whirr, as we could translate whirr roles into puppet role tags. thoughts?
> Add support for Puppet
> ----------------------
>
> Key: WHIRR-255
> URL: https://issues.apache.org/jira/browse/WHIRR-255
> Project: Whirr
> Issue Type: Improvement
> Components: core
> Affects Versions: 0.3.0
> Reporter: Lars George
> Assignee: Adrian Cole
> Attachments: WHIRR-255+311.patch, WHIRR-255+311.patch, WHIRR-255.patch, WHIRR-255.patch, WHIRR-255.patch, WHIRR-255.patch
>
>
> Along the lines of WHIRR-49, implement support for Puppet to bootstrap servers.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (WHIRR-255) Add support for Puppet
Posted by "Adrian Cole (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/WHIRR-255?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13054332#comment-13054332 ]
Adrian Cole commented on WHIRR-255:
-----------------------------------
related issue in jclouds
http://code.google.com/p/jclouds/issues/detail?id=603
I'm going to puppet training next week so can help on this.
> Add support for Puppet
> ----------------------
>
> Key: WHIRR-255
> URL: https://issues.apache.org/jira/browse/WHIRR-255
> Project: Whirr
> Issue Type: Improvement
> Components: core
> Affects Versions: 0.3.0
> Reporter: Lars George
> Assignee: Andrei Savu
> Attachments: WHIRR-255+311.patch, WHIRR-255+311.patch, WHIRR-255.patch, WHIRR-255.patch, WHIRR-255.patch, WHIRR-255.patch
>
>
> Along the lines of WHIRR-49, implement support for Puppet to bootstrap servers.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] Commented: (WHIRR-255) Add support for Puppet
Posted by "Tom White (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/WHIRR-255?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13005807#comment-13005807 ]
Tom White commented on WHIRR-255:
---------------------------------
Great!
> Add support for Puppet
> ----------------------
>
> Key: WHIRR-255
> URL: https://issues.apache.org/jira/browse/WHIRR-255
> Project: Whirr
> Issue Type: Improvement
> Components: core
> Affects Versions: 0.3.0
> Reporter: Lars George
>
> Along the lines of WHIRR-49, implement support for Puppet to bootstrap servers.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] Commented: (WHIRR-255) Add support for Puppet
Posted by "James Turnbull (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/WHIRR-255?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13005867#comment-13005867 ]
James Turnbull commented on WHIRR-255:
--------------------------------------
Andrei et al - let me know if you need any help - I work at Puppet Labs and am happy to devote some time in getting this to work.
> Add support for Puppet
> ----------------------
>
> Key: WHIRR-255
> URL: https://issues.apache.org/jira/browse/WHIRR-255
> Project: Whirr
> Issue Type: Improvement
> Components: core
> Affects Versions: 0.3.0
> Reporter: Lars George
>
> Along the lines of WHIRR-49, implement support for Puppet to bootstrap servers.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Assigned] (WHIRR-255) Add support for Puppet
Posted by "Adrian Cole (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/WHIRR-255?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Adrian Cole reassigned WHIRR-255:
---------------------------------
Assignee: Adrian Cole (was: Andrei Savu)
> Add support for Puppet
> ----------------------
>
> Key: WHIRR-255
> URL: https://issues.apache.org/jira/browse/WHIRR-255
> Project: Whirr
> Issue Type: Improvement
> Components: core
> Affects Versions: 0.3.0
> Reporter: Lars George
> Assignee: Adrian Cole
> Attachments: WHIRR-255+311.patch, WHIRR-255+311.patch, WHIRR-255.patch, WHIRR-255.patch, WHIRR-255.patch, WHIRR-255.patch
>
>
> Along the lines of WHIRR-49, implement support for Puppet to bootstrap servers.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (WHIRR-255) Add support for Puppet
Posted by "Andrei Savu (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/WHIRR-255?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Andrei Savu updated WHIRR-255:
------------------------------
Attachment: WHIRR-255.patch
In this patch I've added Puppet as a service and performed some testing on EC2.
Next I'm planning to use SPI to discover CLI commands so that we can add new commands in services (e.g. run-puppet).
The patch is far from being ready but I appreciate any feedback.
> Add support for Puppet
> ----------------------
>
> Key: WHIRR-255
> URL: https://issues.apache.org/jira/browse/WHIRR-255
> Project: Whirr
> Issue Type: Improvement
> Components: core
> Affects Versions: 0.3.0
> Reporter: Lars George
> Assignee: Andrei Savu
> Attachments: WHIRR-255.patch, WHIRR-255.patch
>
>
> Along the lines of WHIRR-49, implement support for Puppet to bootstrap servers.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (WHIRR-255) Add support for Puppet
Posted by "Andrei Savu (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/WHIRR-255?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13045064#comment-13045064 ]
Andrei Savu commented on WHIRR-255:
-----------------------------------
I understand. I will keep that in mind and rework the patch to match your requirements.
We could to this in a few steps, probably as multiple JIRAs:
* masterless Puppet deployment (most of the components are already in place)
* dummy Puppet master server (no database, no special configs, version control support) with Puppet agents executed as needed by running "whirr run-puppet" (this approach implemented by the current patch)
* only Puppet agents using an external Puppet master - I believe we are going to need to have a convention in place for setting hostnames. Are IPs good enough? How should we handle certificates? Auto-signing?
> Add support for Puppet
> ----------------------
>
> Key: WHIRR-255
> URL: https://issues.apache.org/jira/browse/WHIRR-255
> Project: Whirr
> Issue Type: Improvement
> Components: core
> Affects Versions: 0.3.0
> Reporter: Lars George
> Assignee: Andrei Savu
> Attachments: WHIRR-255+311.patch, WHIRR-255+311.patch, WHIRR-255.patch, WHIRR-255.patch, WHIRR-255.patch, WHIRR-255.patch
>
>
> Along the lines of WHIRR-49, implement support for Puppet to bootstrap servers.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (WHIRR-255) Add support for Puppet
Posted by "Chad Metcalf (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/WHIRR-255?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13045041#comment-13045041 ]
Chad Metcalf commented on WHIRR-255:
------------------------------------
I might suggest you follow a slightly different model. Take vagrant for example. There are two routes to configure a box with puppet on vagrant:
Standalone, via puppet apply. Set a manifest/modules path and viola masterless install. http://vagrantup.com/docs/provisioners/puppet.html
Server, via puppet agent. Set a puppet server and point the node to it. Standard puppet rules apply. http://vagrantup.com/docs/provisioners/puppet_server.html
If you need the functionality associated with a full puppet master you'll likely want more control over its configuration then you're going to want to encode in a template. thin configs/pluginsync/stored config db/etc. If you don't need that level of functionality, masterless would be easier.
> Add support for Puppet
> ----------------------
>
> Key: WHIRR-255
> URL: https://issues.apache.org/jira/browse/WHIRR-255
> Project: Whirr
> Issue Type: Improvement
> Components: core
> Affects Versions: 0.3.0
> Reporter: Lars George
> Assignee: Andrei Savu
> Attachments: WHIRR-255+311.patch, WHIRR-255+311.patch, WHIRR-255.patch, WHIRR-255.patch, WHIRR-255.patch, WHIRR-255.patch
>
>
> Along the lines of WHIRR-49, implement support for Puppet to bootstrap servers.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] Commented: (WHIRR-255) Add support for Puppet
Posted by "Eugene Koontz (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/WHIRR-255?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13005370#comment-13005370 ]
Eugene Koontz commented on WHIRR-255:
-------------------------------------
This might be useful: https://github.com/hstack/puppet
> Add support for Puppet
> ----------------------
>
> Key: WHIRR-255
> URL: https://issues.apache.org/jira/browse/WHIRR-255
> Project: Whirr
> Issue Type: Improvement
> Components: core
> Affects Versions: 0.3.0
> Reporter: Lars George
>
> Along the lines of WHIRR-49, implement support for Puppet to bootstrap servers.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] Commented: (WHIRR-255) Add support for Puppet
Posted by "Tom White (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/WHIRR-255?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13007005#comment-13007005 ]
Tom White commented on WHIRR-255:
---------------------------------
I don't think we should add the install_puppet call to ScriptBasedClusterAction - handlers should add it themselves if they use Puppet. (This is true of install_runurl now too, so we should remove it in a separate JIRA.)
It would be good to have something to test the abstraction - perhaps add a new service, or rewrite an existing one (e.g. ZooKeeper)?
> Add support for Puppet
> ----------------------
>
> Key: WHIRR-255
> URL: https://issues.apache.org/jira/browse/WHIRR-255
> Project: Whirr
> Issue Type: Improvement
> Components: core
> Affects Versions: 0.3.0
> Reporter: Lars George
> Attachments: WHIRR-255.patch
>
>
> Along the lines of WHIRR-49, implement support for Puppet to bootstrap servers.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] Commented: (WHIRR-255) Add support for Puppet
Posted by "Andrei Savu (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/WHIRR-255?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13007012#comment-13007012 ]
Andrei Savu commented on WHIRR-255:
-----------------------------------
Indeed. I hope to be able to rewrite the ZooKeeper install / configure scripts by the end of the week.
> Add support for Puppet
> ----------------------
>
> Key: WHIRR-255
> URL: https://issues.apache.org/jira/browse/WHIRR-255
> Project: Whirr
> Issue Type: Improvement
> Components: core
> Affects Versions: 0.3.0
> Reporter: Lars George
> Attachments: WHIRR-255.patch
>
>
> Along the lines of WHIRR-49, implement support for Puppet to bootstrap servers.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] Commented: (WHIRR-255) Add support for Puppet
Posted by "Tom White (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/WHIRR-255?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13005381#comment-13005381 ]
Tom White commented on WHIRR-255:
---------------------------------
Using Puppet in standalone mode might be a good way to start this, then there is no need to have a Puppet master running (though we might want to add one later).
The install script would be something like:
{code}
function install_puppet() {
if which rpm &> /dev/null; then
yum install -y ruby-devel ruby-irb ruby-rdoc rubygems
wget http://puppetlabs.com/downloads/facter/facter-latest.tgz
tar xf facter-latest.tgz
cd facter-*; ruby install.rb; cd -
wget http://puppetlabs.com/downloads/puppet/puppet-latest.tgz
tar xf puppet-latest.tgz
cd puppet-*; sudo ruby install.rb; cd -
fi
}
{code}
Then instead of bash scripts a service could use puppet scripts (copied to the nodes just like the Hadoop service copies configuration files), running them with {{puppet apply}}. Could this work?
> Add support for Puppet
> ----------------------
>
> Key: WHIRR-255
> URL: https://issues.apache.org/jira/browse/WHIRR-255
> Project: Whirr
> Issue Type: Improvement
> Components: core
> Affects Versions: 0.3.0
> Reporter: Lars George
>
> Along the lines of WHIRR-49, implement support for Puppet to bootstrap servers.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] Updated: (WHIRR-255) Add support for Puppet
Posted by "Andrei Savu (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/WHIRR-255?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Andrei Savu updated WHIRR-255:
------------------------------
Attachment: WHIRR-255.patch
Just the basics: install latest Puppet. I've created a new type of statement for Puppet scripts. Tested with virtualbox (ubuntu 10.10 and centos 5.5) and aws-ec2 (ubuntu 10.04 & amazon ami).
> Add support for Puppet
> ----------------------
>
> Key: WHIRR-255
> URL: https://issues.apache.org/jira/browse/WHIRR-255
> Project: Whirr
> Issue Type: Improvement
> Components: core
> Affects Versions: 0.3.0
> Reporter: Lars George
> Attachments: WHIRR-255.patch
>
>
> Along the lines of WHIRR-49, implement support for Puppet to bootstrap servers.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (WHIRR-255) Add support for Puppet
Posted by "Andrei Savu (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/WHIRR-255?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13050720#comment-13050720 ]
Andrei Savu commented on WHIRR-255:
-----------------------------------
> What help do you need to make this happen?
Unfortunately I'm not going to be able to put enough time into this in the near future (weeks). For the following two weeks I'm going to work on an internal Adobe project and from July I will join Facebook in US.
If you could takeover I would gladly help you with testing. Thanks Chad.
> Add support for Puppet
> ----------------------
>
> Key: WHIRR-255
> URL: https://issues.apache.org/jira/browse/WHIRR-255
> Project: Whirr
> Issue Type: Improvement
> Components: core
> Affects Versions: 0.3.0
> Reporter: Lars George
> Assignee: Andrei Savu
> Attachments: WHIRR-255+311.patch, WHIRR-255+311.patch, WHIRR-255.patch, WHIRR-255.patch, WHIRR-255.patch, WHIRR-255.patch
>
>
> Along the lines of WHIRR-49, implement support for Puppet to bootstrap servers.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] Commented: (WHIRR-255) Add support for Puppet
Posted by "James Turnbull (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/WHIRR-255?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13005901#comment-13005901 ]
James Turnbull commented on WHIRR-255:
--------------------------------------
This may work
{code}
function install_puppet() {
if which rpm &> /dev/null; then
yum install -y ruby ruby-rdoc rubygems
gem install facter puppet
fi
}
{code}
> Add support for Puppet
> ----------------------
>
> Key: WHIRR-255
> URL: https://issues.apache.org/jira/browse/WHIRR-255
> Project: Whirr
> Issue Type: Improvement
> Components: core
> Affects Versions: 0.3.0
> Reporter: Lars George
>
> Along the lines of WHIRR-49, implement support for Puppet to bootstrap servers.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (WHIRR-255) Add support for Puppet
Posted by "Andrei Savu (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/WHIRR-255?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Andrei Savu updated WHIRR-255:
------------------------------
Attachment: WHIRR-255+311.patch
In this patch:
* manage puppet manifests using git
* run-puppet works for all nodes
Next:
* add support for multiple install / configure scripts for services
* migrate zookeeper or cassandra
I will get back to this in a few days. Now I'm working on adding the ability to repair a ZooKeeper cluster for a demo.
> Add support for Puppet
> ----------------------
>
> Key: WHIRR-255
> URL: https://issues.apache.org/jira/browse/WHIRR-255
> Project: Whirr
> Issue Type: Improvement
> Components: core
> Affects Versions: 0.3.0
> Reporter: Lars George
> Assignee: Andrei Savu
> Attachments: WHIRR-255+311.patch, WHIRR-255+311.patch, WHIRR-255.patch, WHIRR-255.patch, WHIRR-255.patch
>
>
> Along the lines of WHIRR-49, implement support for Puppet to bootstrap servers.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Assigned] (WHIRR-255) Add support for Puppet
Posted by "Andrei Savu (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/WHIRR-255?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Andrei Savu reassigned WHIRR-255:
---------------------------------
Assignee: Andrei Savu
> Add support for Puppet
> ----------------------
>
> Key: WHIRR-255
> URL: https://issues.apache.org/jira/browse/WHIRR-255
> Project: Whirr
> Issue Type: Improvement
> Components: core
> Affects Versions: 0.3.0
> Reporter: Lars George
> Assignee: Andrei Savu
> Attachments: WHIRR-255.patch
>
>
> Along the lines of WHIRR-49, implement support for Puppet to bootstrap servers.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (WHIRR-255) Add support for Puppet
Posted by "Andrei Savu (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/WHIRR-255?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Andrei Savu updated WHIRR-255:
------------------------------
Attachment: WHIRR-255+311.patch
WHIRR-255.patch
In this patch I've added a new CLI command for triggering the execution of the puppet client on all the instances.
One known issue: it's not possible to run both the master and the client on the same machine.
Next: add git support for puppet-master. allow users to pull and push manifest files. by using this it should be easy to interact with running clusters.
Next: create puppet recipe for deploying Cassandra (as Adrian suggested)
> Add support for Puppet
> ----------------------
>
> Key: WHIRR-255
> URL: https://issues.apache.org/jira/browse/WHIRR-255
> Project: Whirr
> Issue Type: Improvement
> Components: core
> Affects Versions: 0.3.0
> Reporter: Lars George
> Assignee: Andrei Savu
> Attachments: WHIRR-255+311.patch, WHIRR-255.patch, WHIRR-255.patch, WHIRR-255.patch
>
>
> Along the lines of WHIRR-49, implement support for Puppet to bootstrap servers.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (WHIRR-255) Add support for Puppet
Posted by "Andrei Savu (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/WHIRR-255?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13050542#comment-13050542 ]
Andrei Savu commented on WHIRR-255:
-----------------------------------
I've found a nice article describing how Loggly uses a masterless Puppet setup:
http://semicomplete.com/presentations/puppet-at-loggly/puppet-at-loggly.pdf.html
What do you think?
> Add support for Puppet
> ----------------------
>
> Key: WHIRR-255
> URL: https://issues.apache.org/jira/browse/WHIRR-255
> Project: Whirr
> Issue Type: Improvement
> Components: core
> Affects Versions: 0.3.0
> Reporter: Lars George
> Assignee: Andrei Savu
> Attachments: WHIRR-255+311.patch, WHIRR-255+311.patch, WHIRR-255.patch, WHIRR-255.patch, WHIRR-255.patch, WHIRR-255.patch
>
>
> Along the lines of WHIRR-49, implement support for Puppet to bootstrap servers.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (WHIRR-255) Add support for Puppet
Posted by "Chad Metcalf (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/WHIRR-255?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13050555#comment-13050555 ]
Chad Metcalf commented on WHIRR-255:
------------------------------------
I agree with your three steps above.
As for the masterless puppet from Loggly. Jordan (aka Whack) is pretty much the most active masterless user I know. I think that we can start with the easy masterless. And if their is additional need/desire for the rest (exported resources and the like) we can add them.
Between the three pathways above I think most puppet users would be well covered.
What help do you need to make this happen?
> Add support for Puppet
> ----------------------
>
> Key: WHIRR-255
> URL: https://issues.apache.org/jira/browse/WHIRR-255
> Project: Whirr
> Issue Type: Improvement
> Components: core
> Affects Versions: 0.3.0
> Reporter: Lars George
> Assignee: Andrei Savu
> Attachments: WHIRR-255+311.patch, WHIRR-255+311.patch, WHIRR-255.patch, WHIRR-255.patch, WHIRR-255.patch, WHIRR-255.patch
>
>
> Along the lines of WHIRR-49, implement support for Puppet to bootstrap servers.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (WHIRR-255) Add support for Puppet
Posted by "Chad Metcalf (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/WHIRR-255?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13045055#comment-13045055 ]
Chad Metcalf commented on WHIRR-255:
------------------------------------
It sure does. My concern is that abstracting a fully working master is a lot to bite off. For example we use exported resources very common especially for Hadoop clusters that would use monitoring (nagios) or security (kerberos). So now you've got to deploy a database.
I agree 100% that puppet is great for a mechanism that can be used to manage a cluster not only at deployment but in the future. My point was to build start even more simple. Have the capability to use masterless or point to a master. Then once that is working if you've time/use for it tackle building a master from scratch.
Also from my use case, I've already got a master in ec2 that I can point this to. The above allows for that as well as building your own.
> Add support for Puppet
> ----------------------
>
> Key: WHIRR-255
> URL: https://issues.apache.org/jira/browse/WHIRR-255
> Project: Whirr
> Issue Type: Improvement
> Components: core
> Affects Versions: 0.3.0
> Reporter: Lars George
> Assignee: Andrei Savu
> Attachments: WHIRR-255+311.patch, WHIRR-255+311.patch, WHIRR-255.patch, WHIRR-255.patch, WHIRR-255.patch, WHIRR-255.patch
>
>
> Along the lines of WHIRR-49, implement support for Puppet to bootstrap servers.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (WHIRR-255) Add support for Puppet
Posted by "Andrei Savu (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/WHIRR-255?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13033082#comment-13033082 ]
Andrei Savu commented on WHIRR-255:
-----------------------------------
I've done more work on this (created a new set of roles for puppet related components: puppet-master, puppet-daemon, puppet). How should we go about managing multiple configuration scripts for services? How should a configuration for a cluster that uses puppet ideally look like?
> Add support for Puppet
> ----------------------
>
> Key: WHIRR-255
> URL: https://issues.apache.org/jira/browse/WHIRR-255
> Project: Whirr
> Issue Type: Improvement
> Components: core
> Affects Versions: 0.3.0
> Reporter: Lars George
> Assignee: Andrei Savu
> Attachments: WHIRR-255.patch
>
>
> Along the lines of WHIRR-49, implement support for Puppet to bootstrap servers.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (WHIRR-255) Add support for Puppet
Posted by "Andrei Savu (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/WHIRR-255?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13045053#comment-13045053 ]
Andrei Savu commented on WHIRR-255:
-----------------------------------
Chad, thanks for feedback. I understand the trade-offs and I believe it's more useful to have a Puppet master that can be used as a central repository for cluster configuration (also accessible as a git repository).
I'm thinking about Puppet support in Whirr as an alternative service configuration mechanism when creating a new cluster and at the same time as a mechanism that can be used to manage cluster later on (we are lacking something like this). Does it make sense for you?
> Add support for Puppet
> ----------------------
>
> Key: WHIRR-255
> URL: https://issues.apache.org/jira/browse/WHIRR-255
> Project: Whirr
> Issue Type: Improvement
> Components: core
> Affects Versions: 0.3.0
> Reporter: Lars George
> Assignee: Andrei Savu
> Attachments: WHIRR-255+311.patch, WHIRR-255+311.patch, WHIRR-255.patch, WHIRR-255.patch, WHIRR-255.patch, WHIRR-255.patch
>
>
> Along the lines of WHIRR-49, implement support for Puppet to bootstrap servers.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (WHIRR-255) Add support for Puppet
Posted by "Andrei Savu (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/WHIRR-255?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Andrei Savu updated WHIRR-255:
------------------------------
Attachment: WHIRR-255.patch
Updated patch for the current trunk. I will move forward to get to the point where using Puppet scripts for a new service or for rewriting an existing one is a viable option.
I guess the interface should be similar to the jclouds statements with scripts stored as resources.
> Add support for Puppet
> ----------------------
>
> Key: WHIRR-255
> URL: https://issues.apache.org/jira/browse/WHIRR-255
> Project: Whirr
> Issue Type: Improvement
> Components: core
> Affects Versions: 0.3.0
> Reporter: Lars George
> Assignee: Andrei Savu
> Attachments: WHIRR-255+311.patch, WHIRR-255+311.patch, WHIRR-255.patch, WHIRR-255.patch, WHIRR-255.patch, WHIRR-255.patch
>
>
> Along the lines of WHIRR-49, implement support for Puppet to bootstrap servers.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (WHIRR-255) Add support for Puppet
Posted by "Adrian Cole (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/WHIRR-255?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13035184#comment-13035184 ]
Adrian Cole commented on WHIRR-255:
-----------------------------------
andrei I think that the next step is to have alternate service configuration sets that use puppet manifests for configuration. puppet is more a supporting service to achieve a cluster configuration in this role. perhaps an easier one would be to start with cassandra: http://www.edwardcapriolo.com/roller/edwardcapriolo/entry/easy_street_deploying_cassandra_via
> Add support for Puppet
> ----------------------
>
> Key: WHIRR-255
> URL: https://issues.apache.org/jira/browse/WHIRR-255
> Project: Whirr
> Issue Type: Improvement
> Components: core
> Affects Versions: 0.3.0
> Reporter: Lars George
> Assignee: Andrei Savu
> Attachments: WHIRR-255.patch, WHIRR-255.patch
>
>
> Along the lines of WHIRR-49, implement support for Puppet to bootstrap servers.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] Commented: (WHIRR-255) Add support for Puppet
Posted by "James Turnbull (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/WHIRR-255?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13005429#comment-13005429 ]
James Turnbull commented on WHIRR-255:
--------------------------------------
Easier might be:
{code}
function install_puppet() {
if which rpm &> /dev/null; then
yum install -y ruby-devel ruby-irb ruby-rdoc rubygems
gem install facter puppet
fi
}
{code}
> Add support for Puppet
> ----------------------
>
> Key: WHIRR-255
> URL: https://issues.apache.org/jira/browse/WHIRR-255
> Project: Whirr
> Issue Type: Improvement
> Components: core
> Affects Versions: 0.3.0
> Reporter: Lars George
>
> Along the lines of WHIRR-49, implement support for Puppet to bootstrap servers.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira