You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@bigtop.apache.org by "Guodong Wang (JIRA)" <ji...@apache.org> on 2014/07/14 10:29:04 UTC

[jira] [Created] (BIGTOP-1376) Split Oozie package into several small packages

Guodong Wang created BIGTOP-1376:
------------------------------------

             Summary: Split Oozie package into several small packages
                 Key: BIGTOP-1376
                 URL: https://issues.apache.org/jira/browse/BIGTOP-1376
             Project: Bigtop
          Issue Type: Improvement
            Reporter: Guodong Wang


Oozie can manage hive/pig/sqoop actions, while user do not need to enable them all. It is better to provide a way for user to enable them.

My proposal is like what bigtop has done in Hue packaging, split the functions as separate plugin package.
# provide packages: oozie-hive, oozie-sqoop, oozie-pig. Each of them depends on hive, sqoop and pig respectively.
# In each package, use the symlinks to manage the dependency jars. For example, if oozie-hive is installed, some symlinks are created under /usr/lib/oozie/share/lib/hive/. 
# After install oozie-hive/oozie-sqoop/oozie-pig packages, users need to do sharelib upgrade with oozie-setup script.

We can have the following benifits with this proposal
# No dependency jars are in Oozie packages. All dependency jars are managed by symlinks.
# Recently, BIGTOP-1349 was found in our cluster. If using this proposal, this issue can be solved. Because oozie-hive depends on hive. If user enable oozie-hive plugin, hive jars are installed on Oozie node.




--
This message was sent by Atlassian JIRA
(v6.2#6252)