You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@bigtop.apache.org by "Roman Shaposhnik (JIRA)" <ji...@apache.org> on 2012/11/22 03:26:57 UTC
[jira] [Created] (BIGTOP-794) puppet code around hadoop_head_node
breaks on newer puppets
Roman Shaposhnik created BIGTOP-794:
---------------------------------------
Summary: puppet code around hadoop_head_node breaks on newer puppets
Key: BIGTOP-794
URL: https://issues.apache.org/jira/browse/BIGTOP-794
Project: Bigtop
Issue Type: Bug
Components: Deployment
Affects Versions: 0.5.0
Reporter: Roman Shaposhnik
Assignee: Roman Shaposhnik
Fix For: 0.5.0
At least on puppet 2.7.18 our puppet code breaks since in certain places it expects hadoop_head_node to be an array and in certain other places to be a string. We need to fix this before releasing 0.5.0 to the wild.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (BIGTOP-794) puppet code around hadoop_head_node
breaks on newer puppets
Posted by "Roman Shaposhnik (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/BIGTOP-794?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Roman Shaposhnik updated BIGTOP-794:
------------------------------------
Attachment: 0002-BIGTOP-794.-puppet-code-around-hadoop_head_node-brea.patch
Here's one more piece to enable our Puppet on all the Linux distros. I've opted out to moving repo management outside of Puppet propper on non-yum platforms. It would be nice if somebody can help with implementing proper handling for zypper/apt-get as well.
> puppet code around hadoop_head_node breaks on newer puppets
> -----------------------------------------------------------
>
> Key: BIGTOP-794
> URL: https://issues.apache.org/jira/browse/BIGTOP-794
> Project: Bigtop
> Issue Type: Bug
> Components: Deployment
> Affects Versions: 0.5.0
> Reporter: Roman Shaposhnik
> Assignee: Roman Shaposhnik
> Fix For: 0.5.0
>
> Attachments: 0001-BIGTOP-794.-puppet-code-around-hadoop_head_node-brea.patch, 0002-BIGTOP-794.-puppet-code-around-hadoop_head_node-brea.patch
>
>
> At least on puppet 2.7.18 our puppet code breaks since in certain places it expects hadoop_head_node to be an array and in certain other places to be a string. We need to fix this before releasing 0.5.0 to the wild.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (BIGTOP-794) puppet code around hadoop_head_node
breaks on newer puppets
Posted by "Mark Grover (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/BIGTOP-794?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13505916#comment-13505916 ]
Mark Grover commented on BIGTOP-794:
------------------------------------
Roman, I took a quick look at the script, looks good to me.
One question: any particular reason why you are redirecting output of some of the commands to {{/etc/apt/apt.conf.d/9999force_yes}} instead of somewhere under {{/tmp}}?
> puppet code around hadoop_head_node breaks on newer puppets
> -----------------------------------------------------------
>
> Key: BIGTOP-794
> URL: https://issues.apache.org/jira/browse/BIGTOP-794
> Project: Bigtop
> Issue Type: Bug
> Components: Deployment
> Affects Versions: 0.5.0
> Reporter: Roman Shaposhnik
> Assignee: Roman Shaposhnik
> Fix For: 0.5.0
>
> Attachments: 0001-BIGTOP-794.-puppet-code-around-hadoop_head_node-brea.patch, 0002-BIGTOP-794.-puppet-code-around-hadoop_head_node-brea.patch, launch.cluster.sh
>
>
> At least on puppet 2.7.18 our puppet code breaks since in certain places it expects hadoop_head_node to be an array and in certain other places to be a string. We need to fix this before releasing 0.5.0 to the wild.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (BIGTOP-794) puppet code around hadoop_head_node
breaks on newer puppets
Posted by "Roman Shaposhnik (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/BIGTOP-794?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Roman Shaposhnik updated BIGTOP-794:
------------------------------------
Attachment: launch.cluster.sh
Attaching a crude Whirr-based script I've been using to test Bigtop on newer platforms. At some point it would be nice to have it folded into the project, I suppose.
> puppet code around hadoop_head_node breaks on newer puppets
> -----------------------------------------------------------
>
> Key: BIGTOP-794
> URL: https://issues.apache.org/jira/browse/BIGTOP-794
> Project: Bigtop
> Issue Type: Bug
> Components: Deployment
> Affects Versions: 0.5.0
> Reporter: Roman Shaposhnik
> Assignee: Roman Shaposhnik
> Fix For: 0.5.0
>
> Attachments: 0001-BIGTOP-794.-puppet-code-around-hadoop_head_node-brea.patch, 0002-BIGTOP-794.-puppet-code-around-hadoop_head_node-brea.patch, launch.cluster.sh
>
>
> At least on puppet 2.7.18 our puppet code breaks since in certain places it expects hadoop_head_node to be an array and in certain other places to be a string. We need to fix this before releasing 0.5.0 to the wild.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (BIGTOP-794) puppet code around hadoop_head_node
breaks on newer puppets
Posted by "Roman Shaposhnik (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/BIGTOP-794?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Roman Shaposhnik updated BIGTOP-794:
------------------------------------
Attachment: launch.cluster.sh
> puppet code around hadoop_head_node breaks on newer puppets
> -----------------------------------------------------------
>
> Key: BIGTOP-794
> URL: https://issues.apache.org/jira/browse/BIGTOP-794
> Project: Bigtop
> Issue Type: Bug
> Components: Deployment
> Affects Versions: 0.5.0
> Reporter: Roman Shaposhnik
> Assignee: Roman Shaposhnik
> Fix For: 0.5.0
>
> Attachments: 0001-BIGTOP-794.-puppet-code-around-hadoop_head_node-brea.patch, 0002-BIGTOP-794.-puppet-code-around-hadoop_head_node-brea.patch, launch.cluster.sh
>
>
> At least on puppet 2.7.18 our puppet code breaks since in certain places it expects hadoop_head_node to be an array and in certain other places to be a string. We need to fix this before releasing 0.5.0 to the wild.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (BIGTOP-794) puppet code around hadoop_head_node
breaks on newer puppets
Posted by "Roman Shaposhnik (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/BIGTOP-794?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13506133#comment-13506133 ]
Roman Shaposhnik commented on BIGTOP-794:
-----------------------------------------
Actually, this is not the redirection but rather how I create the content of the file /etc/apt/apt.conf.d/9999force_yes -- the point of the exersize is to have that file in there so that apt gets to be friendlier and not asking so many questions.
> puppet code around hadoop_head_node breaks on newer puppets
> -----------------------------------------------------------
>
> Key: BIGTOP-794
> URL: https://issues.apache.org/jira/browse/BIGTOP-794
> Project: Bigtop
> Issue Type: Bug
> Components: Deployment
> Affects Versions: 0.5.0
> Reporter: Roman Shaposhnik
> Assignee: Roman Shaposhnik
> Fix For: 0.5.0
>
> Attachments: 0001-BIGTOP-794.-puppet-code-around-hadoop_head_node-brea.patch, 0002-BIGTOP-794.-puppet-code-around-hadoop_head_node-brea.patch, launch.cluster.sh
>
>
> At least on puppet 2.7.18 our puppet code breaks since in certain places it expects hadoop_head_node to be an array and in certain other places to be a string. We need to fix this before releasing 0.5.0 to the wild.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (BIGTOP-794) puppet code around hadoop_head_node
breaks on newer puppets
Posted by "Roman Shaposhnik (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/BIGTOP-794?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Roman Shaposhnik updated BIGTOP-794:
------------------------------------
Attachment: (was: launch.cluster.sh)
> puppet code around hadoop_head_node breaks on newer puppets
> -----------------------------------------------------------
>
> Key: BIGTOP-794
> URL: https://issues.apache.org/jira/browse/BIGTOP-794
> Project: Bigtop
> Issue Type: Bug
> Components: Deployment
> Affects Versions: 0.5.0
> Reporter: Roman Shaposhnik
> Assignee: Roman Shaposhnik
> Fix For: 0.5.0
>
> Attachments: 0001-BIGTOP-794.-puppet-code-around-hadoop_head_node-brea.patch, 0002-BIGTOP-794.-puppet-code-around-hadoop_head_node-brea.patch, launch.cluster.sh
>
>
> At least on puppet 2.7.18 our puppet code breaks since in certain places it expects hadoop_head_node to be an array and in certain other places to be a string. We need to fix this before releasing 0.5.0 to the wild.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (BIGTOP-794) puppet code around hadoop_head_node
breaks on newer puppets
Posted by "Patrick Taylor Ramsey (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/BIGTOP-794?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13504076#comment-13504076 ]
Patrick Taylor Ramsey commented on BIGTOP-794:
----------------------------------------------
+1. Thanks for this, Roman.
> puppet code around hadoop_head_node breaks on newer puppets
> -----------------------------------------------------------
>
> Key: BIGTOP-794
> URL: https://issues.apache.org/jira/browse/BIGTOP-794
> Project: Bigtop
> Issue Type: Bug
> Components: Deployment
> Affects Versions: 0.5.0
> Reporter: Roman Shaposhnik
> Assignee: Roman Shaposhnik
> Fix For: 0.5.0
>
> Attachments: 0001-BIGTOP-794.-puppet-code-around-hadoop_head_node-brea.patch
>
>
> At least on puppet 2.7.18 our puppet code breaks since in certain places it expects hadoop_head_node to be an array and in certain other places to be a string. We need to fix this before releasing 0.5.0 to the wild.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (BIGTOP-794) puppet code around hadoop_head_node
breaks on newer puppets
Posted by "Roman Shaposhnik (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/BIGTOP-794?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Roman Shaposhnik updated BIGTOP-794:
------------------------------------
Attachment: 0001-BIGTOP-794.-puppet-code-around-hadoop_head_node-brea.patch
This gets us ublocked. Will keep posting here until all the kinks are ironed out.
> puppet code around hadoop_head_node breaks on newer puppets
> -----------------------------------------------------------
>
> Key: BIGTOP-794
> URL: https://issues.apache.org/jira/browse/BIGTOP-794
> Project: Bigtop
> Issue Type: Bug
> Components: Deployment
> Affects Versions: 0.5.0
> Reporter: Roman Shaposhnik
> Assignee: Roman Shaposhnik
> Fix For: 0.5.0
>
> Attachments: 0001-BIGTOP-794.-puppet-code-around-hadoop_head_node-brea.patch
>
>
> At least on puppet 2.7.18 our puppet code breaks since in certain places it expects hadoop_head_node to be an array and in certain other places to be a string. We need to fix this before releasing 0.5.0 to the wild.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (BIGTOP-794) puppet code around hadoop_head_node
breaks on newer puppets
Posted by "Patrick Taylor Ramsey (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/BIGTOP-794?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13505118#comment-13505118 ]
Patrick Taylor Ramsey commented on BIGTOP-794:
----------------------------------------------
+1. LGTM.
> puppet code around hadoop_head_node breaks on newer puppets
> -----------------------------------------------------------
>
> Key: BIGTOP-794
> URL: https://issues.apache.org/jira/browse/BIGTOP-794
> Project: Bigtop
> Issue Type: Bug
> Components: Deployment
> Affects Versions: 0.5.0
> Reporter: Roman Shaposhnik
> Assignee: Roman Shaposhnik
> Fix For: 0.5.0
>
> Attachments: 0001-BIGTOP-794.-puppet-code-around-hadoop_head_node-brea.patch, 0002-BIGTOP-794.-puppet-code-around-hadoop_head_node-brea.patch
>
>
> At least on puppet 2.7.18 our puppet code breaks since in certain places it expects hadoop_head_node to be an array and in certain other places to be a string. We need to fix this before releasing 0.5.0 to the wild.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (BIGTOP-794) puppet code around hadoop_head_node
breaks on newer puppets
Posted by "Mark Grover (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/BIGTOP-794?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13506142#comment-13506142 ]
Mark Grover commented on BIGTOP-794:
------------------------------------
Ah, I see. Thanks!
> puppet code around hadoop_head_node breaks on newer puppets
> -----------------------------------------------------------
>
> Key: BIGTOP-794
> URL: https://issues.apache.org/jira/browse/BIGTOP-794
> Project: Bigtop
> Issue Type: Bug
> Components: Deployment
> Affects Versions: 0.5.0
> Reporter: Roman Shaposhnik
> Assignee: Roman Shaposhnik
> Fix For: 0.5.0
>
> Attachments: 0001-BIGTOP-794.-puppet-code-around-hadoop_head_node-brea.patch, 0002-BIGTOP-794.-puppet-code-around-hadoop_head_node-brea.patch, launch.cluster.sh
>
>
> At least on puppet 2.7.18 our puppet code breaks since in certain places it expects hadoop_head_node to be an array and in certain other places to be a string. We need to fix this before releasing 0.5.0 to the wild.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira