You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@bigtop.apache.org by "Roman Shaposhnik (JIRA)" <ji...@apache.org> on 2011/09/14 00:41:10 UTC

[jira] [Created] (BIGTOP-95) Puppet-based deployment infrastructure needs to be added to bigtop

Puppet-based deployment infrastructure needs to be added to bigtop
------------------------------------------------------------------

                 Key: BIGTOP-95
                 URL: https://issues.apache.org/jira/browse/BIGTOP-95
             Project: Bigtop
          Issue Type: New Feature
          Components: General, Tests
    Affects Versions: 0.1.0
            Reporter: Roman Shaposhnik
            Assignee: Roman Shaposhnik
             Fix For: 0.2.0


In order to facilitate dynamic bringup/teardown of Bigtop cluster for the purposes of stack validation we need to have an infrastructure that lets us:
   1. continuously deploy Bigtop packages from Jenkis artifacts
   2. do the required amount of configuration management
   3. be able to auto-deploy Bigtop dependencies such as databases, etc.

Puppet seems to be the preferred CM solution that fits the above uses cases rather well.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Resolved] (BIGTOP-95) Puppet-based deployment infrastructure needs to be added to bigtop

Posted by "Roman Shaposhnik (Resolved) (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/BIGTOP-95?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Roman Shaposhnik resolved BIGTOP-95.
------------------------------------

    Resolution: Fixed
    
> Puppet-based deployment infrastructure needs to be added to bigtop
> ------------------------------------------------------------------
>
>                 Key: BIGTOP-95
>                 URL: https://issues.apache.org/jira/browse/BIGTOP-95
>             Project: Bigtop
>          Issue Type: New Feature
>          Components: General, Tests
>    Affects Versions: 0.1.0
>            Reporter: Roman Shaposhnik
>            Assignee: Roman Shaposhnik
>             Fix For: 0.2.0
>
>
> In order to facilitate dynamic bringup/teardown of Bigtop cluster for the purposes of stack validation we need to have an infrastructure that lets us:
>    1. continuously deploy Bigtop packages from Jenkis artifacts
>    2. do the required amount of configuration management
>    3. be able to auto-deploy Bigtop dependencies such as databases, etc.
> Puppet seems to be the preferred CM solution that fits the above uses cases rather well.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (BIGTOP-95) Puppet-based deployment infrastructure needs to be added to bigtop

Posted by "Roman Shaposhnik (Commented) (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/BIGTOP-95?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13127996#comment-13127996 ] 

Roman Shaposhnik commented on BIGTOP-95:
----------------------------------------

Given how huge a diff it was I simply committed. Please chime in if you see that something is not quite kosher. And I'd be happy to take any kind of feedback into account ASAP.
                
> Puppet-based deployment infrastructure needs to be added to bigtop
> ------------------------------------------------------------------
>
>                 Key: BIGTOP-95
>                 URL: https://issues.apache.org/jira/browse/BIGTOP-95
>             Project: Bigtop
>          Issue Type: New Feature
>          Components: General, Tests
>    Affects Versions: 0.1.0
>            Reporter: Roman Shaposhnik
>            Assignee: Roman Shaposhnik
>             Fix For: 0.2.0
>
>
> In order to facilitate dynamic bringup/teardown of Bigtop cluster for the purposes of stack validation we need to have an infrastructure that lets us:
>    1. continuously deploy Bigtop packages from Jenkis artifacts
>    2. do the required amount of configuration management
>    3. be able to auto-deploy Bigtop dependencies such as databases, etc.
> Puppet seems to be the preferred CM solution that fits the above uses cases rather well.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (BIGTOP-95) Puppet-based deployment infrastructure needs to be added to bigtop

Posted by "Bruno Mahé (Commented JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/BIGTOP-95?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13128545#comment-13128545 ] 

Bruno Mahé commented on BIGTOP-95:
----------------------------------

+1 LGTM
                
> Puppet-based deployment infrastructure needs to be added to bigtop
> ------------------------------------------------------------------
>
>                 Key: BIGTOP-95
>                 URL: https://issues.apache.org/jira/browse/BIGTOP-95
>             Project: Bigtop
>          Issue Type: New Feature
>          Components: General, Tests
>    Affects Versions: 0.1.0
>            Reporter: Roman Shaposhnik
>            Assignee: Roman Shaposhnik
>             Fix For: 0.2.0
>
>
> In order to facilitate dynamic bringup/teardown of Bigtop cluster for the purposes of stack validation we need to have an infrastructure that lets us:
>    1. continuously deploy Bigtop packages from Jenkis artifacts
>    2. do the required amount of configuration management
>    3. be able to auto-deploy Bigtop dependencies such as databases, etc.
> Puppet seems to be the preferred CM solution that fits the above uses cases rather well.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

       

[jira] [Commented] (BIGTOP-95) Puppet-based deployment infrastructure needs to be added to bigtop

Posted by "Konstantin Boudnik (Commented) (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/BIGTOP-95?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13128337#comment-13128337 ] 

Konstantin Boudnik commented on BIGTOP-95:
------------------------------------------

I see you have committed kerb recipes as well. Great!
                
> Puppet-based deployment infrastructure needs to be added to bigtop
> ------------------------------------------------------------------
>
>                 Key: BIGTOP-95
>                 URL: https://issues.apache.org/jira/browse/BIGTOP-95
>             Project: Bigtop
>          Issue Type: New Feature
>          Components: General, Tests
>    Affects Versions: 0.1.0
>            Reporter: Roman Shaposhnik
>            Assignee: Roman Shaposhnik
>             Fix For: 0.2.0
>
>
> In order to facilitate dynamic bringup/teardown of Bigtop cluster for the purposes of stack validation we need to have an infrastructure that lets us:
>    1. continuously deploy Bigtop packages from Jenkis artifacts
>    2. do the required amount of configuration management
>    3. be able to auto-deploy Bigtop dependencies such as databases, etc.
> Puppet seems to be the preferred CM solution that fits the above uses cases rather well.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (BIGTOP-95) Puppet-based deployment infrastructure needs to be added to bigtop

Posted by "Roman Shaposhnik (Commented) (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/BIGTOP-95?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13128513#comment-13128513 ] 

Roman Shaposhnik commented on BIGTOP-95:
----------------------------------------

Yup, all the nuts-n-bolts for making both secure and unsecure Hadoop deployments have been pushed. The only thing that's left is to tweak the code a little bit to be be 100% compatible with how Bigtop does packaging. I plan to work on it next week, but any help would be appreciated. Its pretty easy to deploy locally (without the need to run the puppet master, etc) and test the code: just do puppet puppet  --modulepath `pwd`/modules manifests/example.pp where example.pp is a  subset of a cluster.pp manifest appropriate for a single node testing.
                
> Puppet-based deployment infrastructure needs to be added to bigtop
> ------------------------------------------------------------------
>
>                 Key: BIGTOP-95
>                 URL: https://issues.apache.org/jira/browse/BIGTOP-95
>             Project: Bigtop
>          Issue Type: New Feature
>          Components: General, Tests
>    Affects Versions: 0.1.0
>            Reporter: Roman Shaposhnik
>            Assignee: Roman Shaposhnik
>             Fix For: 0.2.0
>
>
> In order to facilitate dynamic bringup/teardown of Bigtop cluster for the purposes of stack validation we need to have an infrastructure that lets us:
>    1. continuously deploy Bigtop packages from Jenkis artifacts
>    2. do the required amount of configuration management
>    3. be able to auto-deploy Bigtop dependencies such as databases, etc.
> Puppet seems to be the preferred CM solution that fits the above uses cases rather well.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira