[jira] [Commented] (BIGTOP-1230) Create version-less symlinks for all components

["Olaf Flebbe (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/BIGTOP-1230?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14530584#comment-14530584 ] 

Olaf Flebbe commented on BIGTOP-1230:
-------------------------------------

Well let me step into this old discussion.

AFAIK this is not possible since there are way to much version interdependencies between jars in the extended hadoop universe. 

The shared library document referenced by roman does only work, because in the tenths of years since ELF shared libraries there was a tremendous effort underway in each project to define and implement a common ABI of libraries where one can rely on. The hadoop core project has some notion of stable API but if you look for instance into hive or oozie you will notice that every release is more or less incompatible to each other, ABI wise.

AFAIK the only promise in the hadoop world are network protocols are stable/upward compatible. So IMHO the only solution is that each application should include its own stack of dependency jars as defined in there pom.xml. This is ugly as hell but has to be fixed upstream in each project.

As a side notice : Alle the distribution related java packaging efforts are stalled because there is simply no "good" version in the complex network of jars (aka Dependency Hell) .

I would recommend to close this issue. The real solution is to work at the upstream projects in order to upgrade all their dependencies.

> Create version-less symlinks for all components
> -----------------------------------------------
>
>                 Key: BIGTOP-1230
>                 URL: https://issues.apache.org/jira/browse/BIGTOP-1230
>             Project: Bigtop
>          Issue Type: Improvement
>          Components: debian, rpm
>    Affects Versions: 0.7.0
>            Reporter: Hu Liu,
>
> Now Bigtop just created version-less symlinks for hadoop only to offer integration point, Bigtop may need to create the version-less symlinks for other components and use them instead of jar files across different components.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)