You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-dev@hadoop.apache.org by "Steve Loughran (JIRA)" <ji...@apache.org> on 2008/07/28 14:35:31 UTC

[jira] Commented: (HADOOP-3835) Develop scripts to create rpm package to facilitate deployment of hadoop on Linux machines

    [ https://issues.apache.org/jira/browse/HADOOP-3835?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12617414#action_12617414 ] 

Steve Loughran commented on HADOOP-3835:
----------------------------------------

As someone who has done RPMs for other OSS projects, I should warn this is a major undertaking

* you need to understand all the rules of where to place things in a well-managed linux system, else rpmlint will complain.
* you need to select which linux distros to support and create real/virtual machines that contain these 
* to test, you need to automate RPM upload install and then operations
* the RPM upgrade model is, well, wierd. you get your install script run before the next version is uninstalled. 
* You need to decide if farm configuration goes into the RPMs, in which case you have to give downstream people the tools to create their own custom RPMs. If not, you need to make it easy to push out the configuration as a separate RPM (or do configuration in some other manner)
* Dont try doing anything clever like stopping hadoop during uninstall, because it is very hard to have this work in all situations.
* You have to be prepared to field all the support calls related to installs, upgrades, alien installs on debian, etc.

I do think RPMs are useful, especially for big farm rollouts, But they are also surprisingly hard work, as in "full time for some weeks" kind of hard work

Some example code to build RPMs and test them over ssh installations. 

http://smartfrog.svn.sourceforge.net/viewvc/smartfrog/trunk/core/release

.spec file (prior to being pushed through Ant property expansion)
http://smartfrog.svn.sourceforge.net/viewvc/smartfrog/trunk/core/release/metadata/rpm/smartfrog.spec?view=markup

> Develop scripts to create rpm package to facilitate deployment of hadoop on Linux machines
> ------------------------------------------------------------------------------------------
>
>                 Key: HADOOP-3835
>                 URL: https://issues.apache.org/jira/browse/HADOOP-3835
>             Project: Hadoop Core
>          Issue Type: Improvement
>          Components: build
>            Reporter: dhruba borthakur
>            Priority: Minor
>
> A rpm-like packing scheme to package and then install hadoop binaries is very helpful, especially when the number of machines in the cluster is huge. 

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.