You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@hbase.apache.org by "Eric Yang (JIRA)" <ji...@apache.org> on 2011/03/04 22:08:45 UTC

[jira] Created: (HBASE-3606) Create an package integration project

Create an package integration project
-------------------------------------

                 Key: HBASE-3606
                 URL: https://issues.apache.org/jira/browse/HBASE-3606
             Project: HBase
          Issue Type: New Feature
          Components: build
         Environment: Java 6, Redhat 5.5/Ubuntu 10.10
            Reporter: Eric Yang


For integrating Hadoop ecosystem more tightly and reduce the cost of hadoop stack development, it would be nice to have a set of installable packages which can setup hadoop stack with least amount effort.  The goal of this jira is to create installable rpm and debian packages for HBase from the build system.

-- 
This message is automatically generated by JIRA.
-
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] Updated: (HBASE-3606) Create an package integration project

Posted by "Eric Yang (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HBASE-3606?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Eric Yang updated HBASE-3606:
-----------------------------

    Fix Version/s: 0.92.0
     Release Note: Build script for creating rpm/deb packages for HBase.
           Status: Patch Available  (was: Open)

> Create an package integration project
> -------------------------------------
>
>                 Key: HBASE-3606
>                 URL: https://issues.apache.org/jira/browse/HBASE-3606
>             Project: HBase
>          Issue Type: New Feature
>          Components: build
>         Environment: Java 6, Redhat 5.5/Ubuntu 10.10
>            Reporter: Eric Yang
>             Fix For: 0.92.0
>
>         Attachments: HBASE-3606.patch
>
>
> For integrating Hadoop ecosystem more tightly and reduce the cost of hadoop stack development, it would be nice to have a set of installable packages which can setup hadoop stack with least amount effort.  The goal of this jira is to create installable rpm and debian packages for HBase from the build system.

-- 
This message is automatically generated by JIRA.
-
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (HBASE-3606) Create an package integration project

Posted by "Giridharan Kesavan (Commented) (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HBASE-3606?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13127881#comment-13127881 ] 

Giridharan Kesavan commented on HBASE-3606:
-------------------------------------------

Eric, it looks like hbase rpm spec file sets dependency on jdk. Can we remove the jdk dependency ? As everyone will not be installing jdk through rpm. 
                
> Create an package integration project
> -------------------------------------
>
>                 Key: HBASE-3606
>                 URL: https://issues.apache.org/jira/browse/HBASE-3606
>             Project: HBase
>          Issue Type: New Feature
>          Components: build
>         Environment: Java 6, Redhat 5.5/Ubuntu 10.10
>            Reporter: Eric Yang
>            Assignee: Eric Yang
>             Fix For: 0.92.0
>
>         Attachments: HBASE-3606.patch
>
>
> For integrating Hadoop ecosystem more tightly and reduce the cost of hadoop stack development, it would be nice to have a set of installable packages which can setup hadoop stack with least amount effort.  The goal of this jira is to create installable rpm and debian packages for HBase from the build system.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] Commented: (HBASE-3606) Create an package integration project

Posted by "Eric Yang (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HBASE-3606?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13002834#comment-13002834 ] 

Eric Yang commented on HBASE-3606:
----------------------------------

Implementation notes:

maven-rpm-plugin and maven-jdeb-plugin are both hard coded to use artifact name for packaging.  This limitation prevented easy creation of config package for pseudo-cluster deployment.  It was originally planned to make conf-pseudo package as a submodule, but that implementation require more restructure the top level maven to be pom package, and change the jar file into a submodule.  Instead of large build structure change, it is easier to use maven ant plugin to build packages in ant.

src/packages/update-hbase-env.sh script is called post package installation and symlink hbase structure to Owen described directory layout. In hbase-env.sh, the class path is automatically setup to use hadoop and zookeeper from system path.  Hence, the rpm/deb packages do not need to bundle hadoop and zookeeper jar files.

> Create an package integration project
> -------------------------------------
>
>                 Key: HBASE-3606
>                 URL: https://issues.apache.org/jira/browse/HBASE-3606
>             Project: HBase
>          Issue Type: New Feature
>          Components: build
>         Environment: Java 6, Redhat 5.5/Ubuntu 10.10
>            Reporter: Eric Yang
>             Fix For: 0.92.0
>
>         Attachments: HBASE-3606.patch
>
>
> For integrating Hadoop ecosystem more tightly and reduce the cost of hadoop stack development, it would be nice to have a set of installable packages which can setup hadoop stack with least amount effort.  The goal of this jira is to create installable rpm and debian packages for HBase from the build system.

-- 
This message is automatically generated by JIRA.
-
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (HBASE-3606) Create an package integration project

Posted by "Ramya Sunil (Commented) (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HBASE-3606?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13127973#comment-13127973 ] 

Ramya Sunil commented on HBASE-3606:
------------------------------------

Eric, when I install hbase rpm, I see the following  message "ls: cannot access /*.jar: No such file or directory" 
Can you please take a look?
                
> Create an package integration project
> -------------------------------------
>
>                 Key: HBASE-3606
>                 URL: https://issues.apache.org/jira/browse/HBASE-3606
>             Project: HBase
>          Issue Type: New Feature
>          Components: build
>         Environment: Java 6, Redhat 5.5/Ubuntu 10.10
>            Reporter: Eric Yang
>            Assignee: Eric Yang
>             Fix For: 0.92.0
>
>         Attachments: HBASE-3606.patch
>
>
> For integrating Hadoop ecosystem more tightly and reduce the cost of hadoop stack development, it would be nice to have a set of installable packages which can setup hadoop stack with least amount effort.  The goal of this jira is to create installable rpm and debian packages for HBase from the build system.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (HBASE-3606) Create an package integration project

Posted by "Eric Yang (Commented) (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HBASE-3606?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13131736#comment-13131736 ] 

Eric Yang commented on HBASE-3606:
----------------------------------

Giri, java dependency issue has been filed as HBASE-4635.
Ramya, make sure the HBASE_HOME is defined correctly.
                
> Create an package integration project
> -------------------------------------
>
>                 Key: HBASE-3606
>                 URL: https://issues.apache.org/jira/browse/HBASE-3606
>             Project: HBase
>          Issue Type: New Feature
>          Components: build
>         Environment: Java 6, Redhat 5.5/Ubuntu 10.10
>            Reporter: Eric Yang
>            Assignee: Eric Yang
>             Fix For: 0.92.0
>
>         Attachments: HBASE-3606.patch
>
>
> For integrating Hadoop ecosystem more tightly and reduce the cost of hadoop stack development, it would be nice to have a set of installable packages which can setup hadoop stack with least amount effort.  The goal of this jira is to create installable rpm and debian packages for HBase from the build system.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (HBASE-3606) Create an package integration project

Posted by "Eric Yang (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HBASE-3606?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13010475#comment-13010475 ] 

Eric Yang commented on HBASE-3606:
----------------------------------

Role package may be the next step.  If HBase maven project can subdivide into master, coprocessor, regionalserver.  Then, we can use the cookie cutter template in this patch to create additional packages.  

conf-pseudo package plays the role of toggling start up all daemons in a single node cluster.  In real cluster deployment, it will have conf package for each role.  A role can be turn on by installing role config rpm by the current implementation.

The role based package would be decision of the HBase community.

> Create an package integration project
> -------------------------------------
>
>                 Key: HBASE-3606
>                 URL: https://issues.apache.org/jira/browse/HBASE-3606
>             Project: HBase
>          Issue Type: New Feature
>          Components: build
>         Environment: Java 6, Redhat 5.5/Ubuntu 10.10
>            Reporter: Eric Yang
>             Fix For: 0.92.0
>
>         Attachments: HBASE-3606.patch
>
>
> For integrating Hadoop ecosystem more tightly and reduce the cost of hadoop stack development, it would be nice to have a set of installable packages which can setup hadoop stack with least amount effort.  The goal of this jira is to create installable rpm and debian packages for HBase from the build system.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Commented] (HBASE-3606) Create an package integration project

Posted by "Eric Yang (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HBASE-3606?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13099642#comment-13099642 ] 

Eric Yang commented on HBASE-3606:
----------------------------------

Thanks stack. :)

> Create an package integration project
> -------------------------------------
>
>                 Key: HBASE-3606
>                 URL: https://issues.apache.org/jira/browse/HBASE-3606
>             Project: HBase
>          Issue Type: New Feature
>          Components: build
>         Environment: Java 6, Redhat 5.5/Ubuntu 10.10
>            Reporter: Eric Yang
>            Assignee: Eric Yang
>             Fix For: 0.92.0
>
>         Attachments: HBASE-3606.patch
>
>
> For integrating Hadoop ecosystem more tightly and reduce the cost of hadoop stack development, it would be nice to have a set of installable packages which can setup hadoop stack with least amount effort.  The goal of this jira is to create installable rpm and debian packages for HBase from the build system.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] Updated: (HBASE-3606) Create an package integration project

Posted by "ryan rawson (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HBASE-3606?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

ryan rawson updated HBASE-3606:
-------------------------------

      Resolution: Fixed
    Hadoop Flags: [Reviewed]
          Status: Resolved  (was: Patch Available)

> Create an package integration project
> -------------------------------------
>
>                 Key: HBASE-3606
>                 URL: https://issues.apache.org/jira/browse/HBASE-3606
>             Project: HBase
>          Issue Type: New Feature
>          Components: build
>         Environment: Java 6, Redhat 5.5/Ubuntu 10.10
>            Reporter: Eric Yang
>             Fix For: 0.92.0
>
>         Attachments: HBASE-3606.patch
>
>
> For integrating Hadoop ecosystem more tightly and reduce the cost of hadoop stack development, it would be nice to have a set of installable packages which can setup hadoop stack with least amount effort.  The goal of this jira is to create installable rpm and debian packages for HBase from the build system.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Assigned] (HBASE-3606) Create an package integration project

Posted by "stack (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HBASE-3606?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

stack reassigned HBASE-3606:
----------------------------

    Assignee: Eric Yang

Assigned.  I added you as contributor Eric so you should be able to do it yourself going forward.  Thanks for the help.

> Create an package integration project
> -------------------------------------
>
>                 Key: HBASE-3606
>                 URL: https://issues.apache.org/jira/browse/HBASE-3606
>             Project: HBase
>          Issue Type: New Feature
>          Components: build
>         Environment: Java 6, Redhat 5.5/Ubuntu 10.10
>            Reporter: Eric Yang
>            Assignee: Eric Yang
>             Fix For: 0.92.0
>
>         Attachments: HBASE-3606.patch
>
>
> For integrating Hadoop ecosystem more tightly and reduce the cost of hadoop stack development, it would be nice to have a set of installable packages which can setup hadoop stack with least amount effort.  The goal of this jira is to create installable rpm and debian packages for HBase from the build system.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] Commented: (HBASE-3606) Create an package integration project

Posted by "Hudson (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HBASE-3606?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13007876#comment-13007876 ] 

Hudson commented on HBASE-3606:
-------------------------------

Integrated in HBase-TRUNK #1792 (See [https://hudson.apache.org/hudson/job/HBase-TRUNK/1792/])
    

> Create an package integration project
> -------------------------------------
>
>                 Key: HBASE-3606
>                 URL: https://issues.apache.org/jira/browse/HBASE-3606
>             Project: HBase
>          Issue Type: New Feature
>          Components: build
>         Environment: Java 6, Redhat 5.5/Ubuntu 10.10
>            Reporter: Eric Yang
>             Fix For: 0.92.0
>
>         Attachments: HBASE-3606.patch
>
>
> For integrating Hadoop ecosystem more tightly and reduce the cost of hadoop stack development, it would be nice to have a set of installable packages which can setup hadoop stack with least amount effort.  The goal of this jira is to create installable rpm and debian packages for HBase from the build system.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] Commented: (HBASE-3606) Create an package integration project

Posted by "ryan rawson (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HBASE-3606?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13003267#comment-13003267 ] 

ryan rawson commented on HBASE-3606:
------------------------------------

so it seems like the trend is moving towards role packages, because they are easily manageable by puppet/etc. There is a base binary package containing all the files, then little stub files that contain the appropriate /etc/init.d/* type files and whatnot.  Right now you have to tweak a file on every machine that is NOT the master (!!), I don't think that is a good approach. 

What was the intention to control startup of daemons?

> Create an package integration project
> -------------------------------------
>
>                 Key: HBASE-3606
>                 URL: https://issues.apache.org/jira/browse/HBASE-3606
>             Project: HBase
>          Issue Type: New Feature
>          Components: build
>         Environment: Java 6, Redhat 5.5/Ubuntu 10.10
>            Reporter: Eric Yang
>             Fix For: 0.92.0
>
>         Attachments: HBASE-3606.patch
>
>
> For integrating Hadoop ecosystem more tightly and reduce the cost of hadoop stack development, it would be nice to have a set of installable packages which can setup hadoop stack with least amount effort.  The goal of this jira is to create installable rpm and debian packages for HBase from the build system.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] Commented: (HBASE-3606) Create an package integration project

Posted by "ryan rawson (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HBASE-3606?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13003266#comment-13003266 ] 

ryan rawson commented on HBASE-3606:
------------------------------------

I tried this, a few notes:

- -P deb runs on OSX, but -P rpm does not.
- There are no role packages being built, is this deliberate or a missing feature?

otherwise looks good!

> Create an package integration project
> -------------------------------------
>
>                 Key: HBASE-3606
>                 URL: https://issues.apache.org/jira/browse/HBASE-3606
>             Project: HBase
>          Issue Type: New Feature
>          Components: build
>         Environment: Java 6, Redhat 5.5/Ubuntu 10.10
>            Reporter: Eric Yang
>             Fix For: 0.92.0
>
>         Attachments: HBASE-3606.patch
>
>
> For integrating Hadoop ecosystem more tightly and reduce the cost of hadoop stack development, it would be nice to have a set of installable packages which can setup hadoop stack with least amount effort.  The goal of this jira is to create installable rpm and debian packages for HBase from the build system.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Commented] (HBASE-3606) Create an package integration project

Posted by "Eric Yang (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HBASE-3606?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13099318#comment-13099318 ] 

Eric Yang commented on HBASE-3606:
----------------------------------

Could someone assign this issue to me?  Thanks for helping my patch count. :)

> Create an package integration project
> -------------------------------------
>
>                 Key: HBASE-3606
>                 URL: https://issues.apache.org/jira/browse/HBASE-3606
>             Project: HBase
>          Issue Type: New Feature
>          Components: build
>         Environment: Java 6, Redhat 5.5/Ubuntu 10.10
>            Reporter: Eric Yang
>             Fix For: 0.92.0
>
>         Attachments: HBASE-3606.patch
>
>
> For integrating Hadoop ecosystem more tightly and reduce the cost of hadoop stack development, it would be nice to have a set of installable packages which can setup hadoop stack with least amount effort.  The goal of this jira is to create installable rpm and debian packages for HBase from the build system.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] Updated: (HBASE-3606) Create an package integration project

Posted by "Eric Yang (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HBASE-3606?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Eric Yang updated HBASE-3606:
-----------------------------

    Attachment: HBASE-3606.patch

Usage:

mvn -Dmaven.test.skip.exec=true site package -P deb,rpm

Each profile builds one type of packages for one OS vendor.

> Create an package integration project
> -------------------------------------
>
>                 Key: HBASE-3606
>                 URL: https://issues.apache.org/jira/browse/HBASE-3606
>             Project: HBase
>          Issue Type: New Feature
>          Components: build
>         Environment: Java 6, Redhat 5.5/Ubuntu 10.10
>            Reporter: Eric Yang
>         Attachments: HBASE-3606.patch
>
>
> For integrating Hadoop ecosystem more tightly and reduce the cost of hadoop stack development, it would be nice to have a set of installable packages which can setup hadoop stack with least amount effort.  The goal of this jira is to create installable rpm and debian packages for HBase from the build system.

-- 
This message is automatically generated by JIRA.
-
For more information on JIRA, see: http://www.atlassian.com/software/jira