[jira] [Updated] (BIGTOP-1004) Hadoop install should have version independent symlinks

["Andrew Purtell (JIRA)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/BIGTOP-1004?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Andrew Purtell updated BIGTOP-1004:
-----------------------------------

    Attachment: BIGTOP-1004.patch

There is actually this in install_hadoop.sh meant to create version independent symlinks:

{noformat}
# Remove all source and create version-less symlinks to offer integration point with other projects
for DIR in ${HADOOP_DIR} ${HDFS_DIR} ${YARN_DIR} ${MAPREDUCE_DIR} ${HTTPFS_DIR} ; do
  (cd $DIR &&
   rm -fv *-sources.jar
   rm -fv lib/hadoop-*.jar
   for j in hadoop-*.jar; do
     if [[ $j =~ hadoop-(.*)-${HADOOP_VERSION}.jar ]]; then
       name=${BASH_REMATCH[1]}
       ln -s $j hadoop-$name.jar
     fi
   done)
done
{noformat}

However, the symlinks are not present as expected after installation.

The problem is HADOOP_VERSION is hardcoded in install_hadoop.sh to "0.21.3".

{noformat}
+ for j in 'hadoop-*.jar'
+ [[ hadoop-annotations-2.0.5-alpha.jar =~ hadoop-(.*)-0.23.1.jar ]]
...
{noformat}

Attached a patch that sets up HADOOP_VERSION in the environment. Confirmed the presence of expected symlinks after package install.
                
> Hadoop install should have version independent symlinks
> -------------------------------------------------------
>
>                 Key: BIGTOP-1004
>                 URL: https://issues.apache.org/jira/browse/BIGTOP-1004
>             Project: Bigtop
>          Issue Type: Improvement
>            Reporter: Andrew Purtell
>         Attachments: BIGTOP-1004.patch
>
>
> The Hadoop packages should install version independent symlinks. 
> When working on BIGTOP-993 I couldn't replace Hadoop dependencies in the component lib/ with symlinks, unlike the case for Zookeeper and HBase, because version independent symlinks aren't available for Hadoop jars. 

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira