You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-issues@hadoop.apache.org by "Alejandro Abdelnur (Created) (JIRA)" <ji...@apache.org> on 2011/12/01 01:17:40 UTC

[jira] [Created] (HADOOP-7874) native libs should be under lib/native/ dir

native libs should be under lib/native/ dir
-------------------------------------------

                 Key: HADOOP-7874
                 URL: https://issues.apache.org/jira/browse/HADOOP-7874
             Project: Hadoop Common
          Issue Type: Bug
          Components: build
    Affects Versions: 0.24.0, 0.23.1
            Reporter: Alejandro Abdelnur
            Assignee: Alejandro Abdelnur
         Attachments: HADOOP-7874.patch

Currently common and hdfs SO files end up under lib/ dir with all JARs, they should end up under lib/native.

In addition, the hadoop-config.sh script needs some cleanup when comes to native lib handling:

* it is using lib/native/${JAVA_PLATFORM} for the java.library.path, when it should use lib/native.
* it is looking for build/lib/native, this is from the old ant build, not applicable anymore.
* it is looking for the libhdfs.a and adding to the java.librar.path, this is not correct.


--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (HADOOP-7874) native libs should be under lib/native/ dir

Posted by "Hudson (Commented) (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HADOOP-7874?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13161289#comment-13161289 ] 

Hudson commented on HADOOP-7874:
--------------------------------

Integrated in Hadoop-Hdfs-trunk-Commit #1428 (See [https://builds.apache.org/job/Hadoop-Hdfs-trunk-Commit/1428/])
    HADOOP-7874. native libs should be under lib/native/ dir. (tucu)

tucu : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1209286
Files : 
* /hadoop/common/trunk/hadoop-common-project/hadoop-common/CHANGES.txt
* /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/main/bin/hadoop-config.sh
* /hadoop/common/trunk/hadoop-project-dist/pom.xml

                
> native libs should be under lib/native/ dir
> -------------------------------------------
>
>                 Key: HADOOP-7874
>                 URL: https://issues.apache.org/jira/browse/HADOOP-7874
>             Project: Hadoop Common
>          Issue Type: Bug
>          Components: build
>    Affects Versions: 0.24.0, 0.23.1
>            Reporter: Alejandro Abdelnur
>            Assignee: Alejandro Abdelnur
>              Labels: bigtop
>         Attachments: HADOOP-7874.patch
>
>
> Currently common and hdfs SO files end up under lib/ dir with all JARs, they should end up under lib/native.
> In addition, the hadoop-config.sh script needs some cleanup when comes to native lib handling:
> * it is using lib/native/${JAVA_PLATFORM} for the java.library.path, when it should use lib/native.
> * it is looking for build/lib/native, this is from the old ant build, not applicable anymore.
> * it is looking for the libhdfs.a and adding to the java.librar.path, this is not correct.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (HADOOP-7874) native libs should be under lib/native/ dir

Posted by "Hudson (Commented) (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HADOOP-7874?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13161597#comment-13161597 ] 

Hudson commented on HADOOP-7874:
--------------------------------

Integrated in Hadoop-Hdfs-trunk #882 (See [https://builds.apache.org/job/Hadoop-Hdfs-trunk/882/])
    HADOOP-7874. native libs should be under lib/native/ dir. (tucu)

tucu : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1209286
Files : 
* /hadoop/common/trunk/hadoop-common-project/hadoop-common/CHANGES.txt
* /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/main/bin/hadoop-config.sh
* /hadoop/common/trunk/hadoop-project-dist/pom.xml

                
> native libs should be under lib/native/ dir
> -------------------------------------------
>
>                 Key: HADOOP-7874
>                 URL: https://issues.apache.org/jira/browse/HADOOP-7874
>             Project: Hadoop Common
>          Issue Type: Bug
>          Components: build
>    Affects Versions: 0.24.0, 0.23.1
>            Reporter: Alejandro Abdelnur
>            Assignee: Alejandro Abdelnur
>              Labels: bigtop
>         Attachments: HADOOP-7874.patch
>
>
> Currently common and hdfs SO files end up under lib/ dir with all JARs, they should end up under lib/native.
> In addition, the hadoop-config.sh script needs some cleanup when comes to native lib handling:
> * it is using lib/native/${JAVA_PLATFORM} for the java.library.path, when it should use lib/native.
> * it is looking for build/lib/native, this is from the old ant build, not applicable anymore.
> * it is looking for the libhdfs.a and adding to the java.librar.path, this is not correct.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (HADOOP-7874) native libs should be under lib/native/ dir

Posted by "Hudson (Commented) (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HADOOP-7874?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13161631#comment-13161631 ] 

Hudson commented on HADOOP-7874:
--------------------------------

Integrated in Hadoop-Mapreduce-trunk #915 (See [https://builds.apache.org/job/Hadoop-Mapreduce-trunk/915/])
    HADOOP-7874. native libs should be under lib/native/ dir. (tucu)

tucu : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1209286
Files : 
* /hadoop/common/trunk/hadoop-common-project/hadoop-common/CHANGES.txt
* /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/main/bin/hadoop-config.sh
* /hadoop/common/trunk/hadoop-project-dist/pom.xml

                
> native libs should be under lib/native/ dir
> -------------------------------------------
>
>                 Key: HADOOP-7874
>                 URL: https://issues.apache.org/jira/browse/HADOOP-7874
>             Project: Hadoop Common
>          Issue Type: Bug
>          Components: build
>    Affects Versions: 0.24.0, 0.23.1
>            Reporter: Alejandro Abdelnur
>            Assignee: Alejandro Abdelnur
>              Labels: bigtop
>         Attachments: HADOOP-7874.patch
>
>
> Currently common and hdfs SO files end up under lib/ dir with all JARs, they should end up under lib/native.
> In addition, the hadoop-config.sh script needs some cleanup when comes to native lib handling:
> * it is using lib/native/${JAVA_PLATFORM} for the java.library.path, when it should use lib/native.
> * it is looking for build/lib/native, this is from the old ant build, not applicable anymore.
> * it is looking for the libhdfs.a and adding to the java.librar.path, this is not correct.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (HADOOP-7874) native libs should be under lib/native/ dir

Posted by "Hudson (Commented) (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HADOOP-7874?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13161312#comment-13161312 ] 

Hudson commented on HADOOP-7874:
--------------------------------

Integrated in Hadoop-Mapreduce-trunk-Commit #1379 (See [https://builds.apache.org/job/Hadoop-Mapreduce-trunk-Commit/1379/])
    HADOOP-7874. native libs should be under lib/native/ dir. (tucu)

tucu : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1209286
Files : 
* /hadoop/common/trunk/hadoop-common-project/hadoop-common/CHANGES.txt
* /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/main/bin/hadoop-config.sh
* /hadoop/common/trunk/hadoop-project-dist/pom.xml

                
> native libs should be under lib/native/ dir
> -------------------------------------------
>
>                 Key: HADOOP-7874
>                 URL: https://issues.apache.org/jira/browse/HADOOP-7874
>             Project: Hadoop Common
>          Issue Type: Bug
>          Components: build
>    Affects Versions: 0.24.0, 0.23.1
>            Reporter: Alejandro Abdelnur
>            Assignee: Alejandro Abdelnur
>              Labels: bigtop
>         Attachments: HADOOP-7874.patch
>
>
> Currently common and hdfs SO files end up under lib/ dir with all JARs, they should end up under lib/native.
> In addition, the hadoop-config.sh script needs some cleanup when comes to native lib handling:
> * it is using lib/native/${JAVA_PLATFORM} for the java.library.path, when it should use lib/native.
> * it is looking for build/lib/native, this is from the old ant build, not applicable anymore.
> * it is looking for the libhdfs.a and adding to the java.librar.path, this is not correct.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (HADOOP-7874) native libs should be under lib/native/ dir

Posted by "Tom White (Commented) (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HADOOP-7874?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13161260#comment-13161260 ] 

Tom White commented on HADOOP-7874:
-----------------------------------

+1
                
> native libs should be under lib/native/ dir
> -------------------------------------------
>
>                 Key: HADOOP-7874
>                 URL: https://issues.apache.org/jira/browse/HADOOP-7874
>             Project: Hadoop Common
>          Issue Type: Bug
>          Components: build
>    Affects Versions: 0.24.0, 0.23.1
>            Reporter: Alejandro Abdelnur
>            Assignee: Alejandro Abdelnur
>              Labels: bigtop
>         Attachments: HADOOP-7874.patch
>
>
> Currently common and hdfs SO files end up under lib/ dir with all JARs, they should end up under lib/native.
> In addition, the hadoop-config.sh script needs some cleanup when comes to native lib handling:
> * it is using lib/native/${JAVA_PLATFORM} for the java.library.path, when it should use lib/native.
> * it is looking for build/lib/native, this is from the old ant build, not applicable anymore.
> * it is looking for the libhdfs.a and adding to the java.librar.path, this is not correct.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (HADOOP-7874) native libs should be under lib/native/ dir

Posted by "Hudson (Commented) (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HADOOP-7874?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13162109#comment-13162109 ] 

Hudson commented on HADOOP-7874:
--------------------------------

Integrated in Hadoop-Hdfs-0.23-Commit #241 (See [https://builds.apache.org/job/Hadoop-Hdfs-0.23-Commit/241/])
    Merge -r 1209285:1209286 from trunk to branch. FIXES: HADOOP-7874

tucu : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1209289
Files : 
* /hadoop/common/branches/branch-0.23/hadoop-common-project/hadoop-common/CHANGES.txt
* /hadoop/common/branches/branch-0.23/hadoop-common-project/hadoop-common/src/main/bin/hadoop-config.sh
* /hadoop/common/branches/branch-0.23/hadoop-project-dist/pom.xml

                
> native libs should be under lib/native/ dir
> -------------------------------------------
>
>                 Key: HADOOP-7874
>                 URL: https://issues.apache.org/jira/browse/HADOOP-7874
>             Project: Hadoop Common
>          Issue Type: Bug
>          Components: build
>    Affects Versions: 0.24.0, 0.23.1
>            Reporter: Alejandro Abdelnur
>            Assignee: Alejandro Abdelnur
>              Labels: bigtop
>         Attachments: HADOOP-7874.patch
>
>
> Currently common and hdfs SO files end up under lib/ dir with all JARs, they should end up under lib/native.
> In addition, the hadoop-config.sh script needs some cleanup when comes to native lib handling:
> * it is using lib/native/${JAVA_PLATFORM} for the java.library.path, when it should use lib/native.
> * it is looking for build/lib/native, this is from the old ant build, not applicable anymore.
> * it is looking for the libhdfs.a and adding to the java.librar.path, this is not correct.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Updated] (HADOOP-7874) native libs should be under lib/native/ dir

Posted by "Eli Collins (Updated) (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HADOOP-7874?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Eli Collins updated HADOOP-7874:
--------------------------------

    Fix Version/s: 0.23.1
                   0.24.0
    
> native libs should be under lib/native/ dir
> -------------------------------------------
>
>                 Key: HADOOP-7874
>                 URL: https://issues.apache.org/jira/browse/HADOOP-7874
>             Project: Hadoop Common
>          Issue Type: Bug
>          Components: build
>    Affects Versions: 0.24.0, 0.23.1
>            Reporter: Alejandro Abdelnur
>            Assignee: Alejandro Abdelnur
>              Labels: bigtop
>             Fix For: 0.24.0, 0.23.1
>
>         Attachments: HADOOP-7874.patch
>
>
> Currently common and hdfs SO files end up under lib/ dir with all JARs, they should end up under lib/native.
> In addition, the hadoop-config.sh script needs some cleanup when comes to native lib handling:
> * it is using lib/native/${JAVA_PLATFORM} for the java.library.path, when it should use lib/native.
> * it is looking for build/lib/native, this is from the old ant build, not applicable anymore.
> * it is looking for the libhdfs.a and adding to the java.librar.path, this is not correct.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (HADOOP-7874) native libs should be under lib/native/ dir

Posted by "Hudson (Commented) (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HADOOP-7874?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13161588#comment-13161588 ] 

Hudson commented on HADOOP-7874:
--------------------------------

Integrated in Hadoop-Hdfs-HAbranch-build #3 (See [https://builds.apache.org/job/Hadoop-Hdfs-HAbranch-build/3/])
    Merge -r 1209285:1209286 from trunk to branch. FIXES: HADOOP-7874

tucu : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1209289
Files : 
* /hadoop/common/branches/branch-0.23/hadoop-common-project/hadoop-common/CHANGES.txt
* /hadoop/common/branches/branch-0.23/hadoop-common-project/hadoop-common/src/main/bin/hadoop-config.sh
* /hadoop/common/branches/branch-0.23/hadoop-project-dist/pom.xml

                
> native libs should be under lib/native/ dir
> -------------------------------------------
>
>                 Key: HADOOP-7874
>                 URL: https://issues.apache.org/jira/browse/HADOOP-7874
>             Project: Hadoop Common
>          Issue Type: Bug
>          Components: build
>    Affects Versions: 0.24.0, 0.23.1
>            Reporter: Alejandro Abdelnur
>            Assignee: Alejandro Abdelnur
>              Labels: bigtop
>         Attachments: HADOOP-7874.patch
>
>
> Currently common and hdfs SO files end up under lib/ dir with all JARs, they should end up under lib/native.
> In addition, the hadoop-config.sh script needs some cleanup when comes to native lib handling:
> * it is using lib/native/${JAVA_PLATFORM} for the java.library.path, when it should use lib/native.
> * it is looking for build/lib/native, this is from the old ant build, not applicable anymore.
> * it is looking for the libhdfs.a and adding to the java.librar.path, this is not correct.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (HADOOP-7874) native libs should be under lib/native/ dir

Posted by "Tom White (Commented) (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HADOOP-7874?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13160509#comment-13160509 ] 

Tom White commented on HADOOP-7874:
-----------------------------------

> it is using lib/native/${JAVA_PLATFORM} for the java.library.path, when it should use lib/native

Why has the arch directory been dropped?
                
> native libs should be under lib/native/ dir
> -------------------------------------------
>
>                 Key: HADOOP-7874
>                 URL: https://issues.apache.org/jira/browse/HADOOP-7874
>             Project: Hadoop Common
>          Issue Type: Bug
>          Components: build
>    Affects Versions: 0.24.0, 0.23.1
>            Reporter: Alejandro Abdelnur
>            Assignee: Alejandro Abdelnur
>              Labels: bigtop
>         Attachments: HADOOP-7874.patch
>
>
> Currently common and hdfs SO files end up under lib/ dir with all JARs, they should end up under lib/native.
> In addition, the hadoop-config.sh script needs some cleanup when comes to native lib handling:
> * it is using lib/native/${JAVA_PLATFORM} for the java.library.path, when it should use lib/native.
> * it is looking for build/lib/native, this is from the old ant build, not applicable anymore.
> * it is looking for the libhdfs.a and adding to the java.librar.path, this is not correct.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Updated] (HADOOP-7874) native libs should be under lib/native/ dir

Posted by "Alejandro Abdelnur (Updated) (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HADOOP-7874?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Alejandro Abdelnur updated HADOOP-7874:
---------------------------------------

    Labels: bigtop  (was: )
    
> native libs should be under lib/native/ dir
> -------------------------------------------
>
>                 Key: HADOOP-7874
>                 URL: https://issues.apache.org/jira/browse/HADOOP-7874
>             Project: Hadoop Common
>          Issue Type: Bug
>          Components: build
>    Affects Versions: 0.24.0, 0.23.1
>            Reporter: Alejandro Abdelnur
>            Assignee: Alejandro Abdelnur
>              Labels: bigtop
>         Attachments: HADOOP-7874.patch
>
>
> Currently common and hdfs SO files end up under lib/ dir with all JARs, they should end up under lib/native.
> In addition, the hadoop-config.sh script needs some cleanup when comes to native lib handling:
> * it is using lib/native/${JAVA_PLATFORM} for the java.library.path, when it should use lib/native.
> * it is looking for build/lib/native, this is from the old ant build, not applicable anymore.
> * it is looking for the libhdfs.a and adding to the java.librar.path, this is not correct.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Updated] (HADOOP-7874) native libs should be under lib/native/ dir

Posted by "Alejandro Abdelnur (Updated) (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HADOOP-7874?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Alejandro Abdelnur updated HADOOP-7874:
---------------------------------------

    Attachment: HADOOP-7874.patch
    
> native libs should be under lib/native/ dir
> -------------------------------------------
>
>                 Key: HADOOP-7874
>                 URL: https://issues.apache.org/jira/browse/HADOOP-7874
>             Project: Hadoop Common
>          Issue Type: Bug
>          Components: build
>    Affects Versions: 0.24.0, 0.23.1
>            Reporter: Alejandro Abdelnur
>            Assignee: Alejandro Abdelnur
>         Attachments: HADOOP-7874.patch
>
>
> Currently common and hdfs SO files end up under lib/ dir with all JARs, they should end up under lib/native.
> In addition, the hadoop-config.sh script needs some cleanup when comes to native lib handling:
> * it is using lib/native/${JAVA_PLATFORM} for the java.library.path, when it should use lib/native.
> * it is looking for build/lib/native, this is from the old ant build, not applicable anymore.
> * it is looking for the libhdfs.a and adding to the java.librar.path, this is not correct.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (HADOOP-7874) native libs should be under lib/native/ dir

Posted by "Hudson (Commented) (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HADOOP-7874?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13161581#comment-13161581 ] 

Hudson commented on HADOOP-7874:
--------------------------------

Integrated in Hadoop-Hdfs-0.23-Build #95 (See [https://builds.apache.org/job/Hadoop-Hdfs-0.23-Build/95/])
    Merge -r 1209285:1209286 from trunk to branch. FIXES: HADOOP-7874

tucu : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1209289
Files : 
* /hadoop/common/branches/branch-0.23/hadoop-common-project/hadoop-common/CHANGES.txt
* /hadoop/common/branches/branch-0.23/hadoop-common-project/hadoop-common/src/main/bin/hadoop-config.sh
* /hadoop/common/branches/branch-0.23/hadoop-project-dist/pom.xml

                
> native libs should be under lib/native/ dir
> -------------------------------------------
>
>                 Key: HADOOP-7874
>                 URL: https://issues.apache.org/jira/browse/HADOOP-7874
>             Project: Hadoop Common
>          Issue Type: Bug
>          Components: build
>    Affects Versions: 0.24.0, 0.23.1
>            Reporter: Alejandro Abdelnur
>            Assignee: Alejandro Abdelnur
>              Labels: bigtop
>         Attachments: HADOOP-7874.patch
>
>
> Currently common and hdfs SO files end up under lib/ dir with all JARs, they should end up under lib/native.
> In addition, the hadoop-config.sh script needs some cleanup when comes to native lib handling:
> * it is using lib/native/${JAVA_PLATFORM} for the java.library.path, when it should use lib/native.
> * it is looking for build/lib/native, this is from the old ant build, not applicable anymore.
> * it is looking for the libhdfs.a and adding to the java.librar.path, this is not correct.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (HADOOP-7874) native libs should be under lib/native/ dir

Posted by "Alejandro Abdelnur (Commented) (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HADOOP-7874?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13161221#comment-13161221 ] 

Alejandro Abdelnur commented on HADOOP-7874:
--------------------------------------------

verified that the generate TAR has the native libs in the expected place lib/native/ an that hadoop-config.sh is setting the right path to java.library.path (by testing hadoop script)
                
> native libs should be under lib/native/ dir
> -------------------------------------------
>
>                 Key: HADOOP-7874
>                 URL: https://issues.apache.org/jira/browse/HADOOP-7874
>             Project: Hadoop Common
>          Issue Type: Bug
>          Components: build
>    Affects Versions: 0.24.0, 0.23.1
>            Reporter: Alejandro Abdelnur
>            Assignee: Alejandro Abdelnur
>              Labels: bigtop
>         Attachments: HADOOP-7874.patch
>
>
> Currently common and hdfs SO files end up under lib/ dir with all JARs, they should end up under lib/native.
> In addition, the hadoop-config.sh script needs some cleanup when comes to native lib handling:
> * it is using lib/native/${JAVA_PLATFORM} for the java.library.path, when it should use lib/native.
> * it is looking for build/lib/native, this is from the old ant build, not applicable anymore.
> * it is looking for the libhdfs.a and adding to the java.librar.path, this is not correct.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (HADOOP-7874) native libs should be under lib/native/ dir

Posted by "Hudson (Commented) (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HADOOP-7874?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13161297#comment-13161297 ] 

Hudson commented on HADOOP-7874:
--------------------------------

Integrated in Hadoop-Common-trunk-Commit #1354 (See [https://builds.apache.org/job/Hadoop-Common-trunk-Commit/1354/])
    HADOOP-7874. native libs should be under lib/native/ dir. (tucu)

tucu : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1209286
Files : 
* /hadoop/common/trunk/hadoop-common-project/hadoop-common/CHANGES.txt
* /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/main/bin/hadoop-config.sh
* /hadoop/common/trunk/hadoop-project-dist/pom.xml

                
> native libs should be under lib/native/ dir
> -------------------------------------------
>
>                 Key: HADOOP-7874
>                 URL: https://issues.apache.org/jira/browse/HADOOP-7874
>             Project: Hadoop Common
>          Issue Type: Bug
>          Components: build
>    Affects Versions: 0.24.0, 0.23.1
>            Reporter: Alejandro Abdelnur
>            Assignee: Alejandro Abdelnur
>              Labels: bigtop
>         Attachments: HADOOP-7874.patch
>
>
> Currently common and hdfs SO files end up under lib/ dir with all JARs, they should end up under lib/native.
> In addition, the hadoop-config.sh script needs some cleanup when comes to native lib handling:
> * it is using lib/native/${JAVA_PLATFORM} for the java.library.path, when it should use lib/native.
> * it is looking for build/lib/native, this is from the old ant build, not applicable anymore.
> * it is looking for the libhdfs.a and adding to the java.librar.path, this is not correct.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (HADOOP-7874) native libs should be under lib/native/ dir

Posted by "Hudson (Commented) (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HADOOP-7874?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13161301#comment-13161301 ] 

Hudson commented on HADOOP-7874:
--------------------------------

Integrated in Hadoop-Common-0.23-Commit #245 (See [https://builds.apache.org/job/Hadoop-Common-0.23-Commit/245/])
    Merge -r 1209285:1209286 from trunk to branch. FIXES: HADOOP-7874

tucu : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1209289
Files : 
* /hadoop/common/branches/branch-0.23/hadoop-common-project/hadoop-common/CHANGES.txt
* /hadoop/common/branches/branch-0.23/hadoop-common-project/hadoop-common/src/main/bin/hadoop-config.sh
* /hadoop/common/branches/branch-0.23/hadoop-project-dist/pom.xml

                
> native libs should be under lib/native/ dir
> -------------------------------------------
>
>                 Key: HADOOP-7874
>                 URL: https://issues.apache.org/jira/browse/HADOOP-7874
>             Project: Hadoop Common
>          Issue Type: Bug
>          Components: build
>    Affects Versions: 0.24.0, 0.23.1
>            Reporter: Alejandro Abdelnur
>            Assignee: Alejandro Abdelnur
>              Labels: bigtop
>         Attachments: HADOOP-7874.patch
>
>
> Currently common and hdfs SO files end up under lib/ dir with all JARs, they should end up under lib/native.
> In addition, the hadoop-config.sh script needs some cleanup when comes to native lib handling:
> * it is using lib/native/${JAVA_PLATFORM} for the java.library.path, when it should use lib/native.
> * it is looking for build/lib/native, this is from the old ant build, not applicable anymore.
> * it is looking for the libhdfs.a and adding to the java.librar.path, this is not correct.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (HADOOP-7874) native libs should be under lib/native/ dir

Posted by "Hudson (Commented) (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HADOOP-7874?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13161318#comment-13161318 ] 

Hudson commented on HADOOP-7874:
--------------------------------

Integrated in Hadoop-Mapreduce-0.23-Commit #256 (See [https://builds.apache.org/job/Hadoop-Mapreduce-0.23-Commit/256/])
    Merge -r 1209285:1209286 from trunk to branch. FIXES: HADOOP-7874

tucu : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1209289
Files : 
* /hadoop/common/branches/branch-0.23/hadoop-common-project/hadoop-common/CHANGES.txt
* /hadoop/common/branches/branch-0.23/hadoop-common-project/hadoop-common/src/main/bin/hadoop-config.sh
* /hadoop/common/branches/branch-0.23/hadoop-project-dist/pom.xml

                
> native libs should be under lib/native/ dir
> -------------------------------------------
>
>                 Key: HADOOP-7874
>                 URL: https://issues.apache.org/jira/browse/HADOOP-7874
>             Project: Hadoop Common
>          Issue Type: Bug
>          Components: build
>    Affects Versions: 0.24.0, 0.23.1
>            Reporter: Alejandro Abdelnur
>            Assignee: Alejandro Abdelnur
>              Labels: bigtop
>         Attachments: HADOOP-7874.patch
>
>
> Currently common and hdfs SO files end up under lib/ dir with all JARs, they should end up under lib/native.
> In addition, the hadoop-config.sh script needs some cleanup when comes to native lib handling:
> * it is using lib/native/${JAVA_PLATFORM} for the java.library.path, when it should use lib/native.
> * it is looking for build/lib/native, this is from the old ant build, not applicable anymore.
> * it is looking for the libhdfs.a and adding to the java.librar.path, this is not correct.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Updated] (HADOOP-7874) native libs should be under lib/native/ dir

Posted by "Alejandro Abdelnur (Updated) (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HADOOP-7874?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Alejandro Abdelnur updated HADOOP-7874:
---------------------------------------

      Resolution: Fixed
    Hadoop Flags: Reviewed
          Status: Resolved  (was: Patch Available)

committed to trunk and branch-0.23
                
> native libs should be under lib/native/ dir
> -------------------------------------------
>
>                 Key: HADOOP-7874
>                 URL: https://issues.apache.org/jira/browse/HADOOP-7874
>             Project: Hadoop Common
>          Issue Type: Bug
>          Components: build
>    Affects Versions: 0.24.0, 0.23.1
>            Reporter: Alejandro Abdelnur
>            Assignee: Alejandro Abdelnur
>              Labels: bigtop
>         Attachments: HADOOP-7874.patch
>
>
> Currently common and hdfs SO files end up under lib/ dir with all JARs, they should end up under lib/native.
> In addition, the hadoop-config.sh script needs some cleanup when comes to native lib handling:
> * it is using lib/native/${JAVA_PLATFORM} for the java.library.path, when it should use lib/native.
> * it is looking for build/lib/native, this is from the old ant build, not applicable anymore.
> * it is looking for the libhdfs.a and adding to the java.librar.path, this is not correct.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (HADOOP-7874) native libs should be under lib/native/ dir

Posted by "Hudson (Commented) (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HADOOP-7874?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13161610#comment-13161610 ] 

Hudson commented on HADOOP-7874:
--------------------------------

Integrated in Hadoop-Mapreduce-0.23-Build #113 (See [https://builds.apache.org/job/Hadoop-Mapreduce-0.23-Build/113/])
    Merge -r 1209285:1209286 from trunk to branch. FIXES: HADOOP-7874

tucu : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1209289
Files : 
* /hadoop/common/branches/branch-0.23/hadoop-common-project/hadoop-common/CHANGES.txt
* /hadoop/common/branches/branch-0.23/hadoop-common-project/hadoop-common/src/main/bin/hadoop-config.sh
* /hadoop/common/branches/branch-0.23/hadoop-project-dist/pom.xml

                
> native libs should be under lib/native/ dir
> -------------------------------------------
>
>                 Key: HADOOP-7874
>                 URL: https://issues.apache.org/jira/browse/HADOOP-7874
>             Project: Hadoop Common
>          Issue Type: Bug
>          Components: build
>    Affects Versions: 0.24.0, 0.23.1
>            Reporter: Alejandro Abdelnur
>            Assignee: Alejandro Abdelnur
>              Labels: bigtop
>         Attachments: HADOOP-7874.patch
>
>
> Currently common and hdfs SO files end up under lib/ dir with all JARs, they should end up under lib/native.
> In addition, the hadoop-config.sh script needs some cleanup when comes to native lib handling:
> * it is using lib/native/${JAVA_PLATFORM} for the java.library.path, when it should use lib/native.
> * it is looking for build/lib/native, this is from the old ant build, not applicable anymore.
> * it is looking for the libhdfs.a and adding to the java.librar.path, this is not correct.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (HADOOP-7874) native libs should be under lib/native/ dir

Posted by "Alejandro Abdelnur (Commented) (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HADOOP-7874?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13160532#comment-13160532 ] 

Alejandro Abdelnur commented on HADOOP-7874:
--------------------------------------------

The ARCH directory was dropped when we the tar layout for common/hdfs was introduced.

While we could easily re-introduce it, IMO it is not the right thing to do for the following reasons:

* The ARCH used by is a mix of the OS type (ie linux, mac,) and CPU ARCH (i386,amd64). However, having the same OS type and CPU arch does not ensure things will work because of native libraries depedencies required/available  in different OSes (we can restrict ourselves to linux for practical purposes).

* The build system does not handle building/packaging for different architectures.

* Hadoop release distribution is a source TARBALL, you can easily build it correctly (talking about nativelibs here) in your target platform.

                
> native libs should be under lib/native/ dir
> -------------------------------------------
>
>                 Key: HADOOP-7874
>                 URL: https://issues.apache.org/jira/browse/HADOOP-7874
>             Project: Hadoop Common
>          Issue Type: Bug
>          Components: build
>    Affects Versions: 0.24.0, 0.23.1
>            Reporter: Alejandro Abdelnur
>            Assignee: Alejandro Abdelnur
>              Labels: bigtop
>         Attachments: HADOOP-7874.patch
>
>
> Currently common and hdfs SO files end up under lib/ dir with all JARs, they should end up under lib/native.
> In addition, the hadoop-config.sh script needs some cleanup when comes to native lib handling:
> * it is using lib/native/${JAVA_PLATFORM} for the java.library.path, when it should use lib/native.
> * it is looking for build/lib/native, this is from the old ant build, not applicable anymore.
> * it is looking for the libhdfs.a and adding to the java.librar.path, this is not correct.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (HADOOP-7874) native libs should be under lib/native/ dir

Posted by "Tom White (Commented) (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HADOOP-7874?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13161071#comment-13161071 ] 

Tom White commented on HADOOP-7874:
-----------------------------------

Sounds reasonable. What testing did you do on the current patch?
                
> native libs should be under lib/native/ dir
> -------------------------------------------
>
>                 Key: HADOOP-7874
>                 URL: https://issues.apache.org/jira/browse/HADOOP-7874
>             Project: Hadoop Common
>          Issue Type: Bug
>          Components: build
>    Affects Versions: 0.24.0, 0.23.1
>            Reporter: Alejandro Abdelnur
>            Assignee: Alejandro Abdelnur
>              Labels: bigtop
>         Attachments: HADOOP-7874.patch
>
>
> Currently common and hdfs SO files end up under lib/ dir with all JARs, they should end up under lib/native.
> In addition, the hadoop-config.sh script needs some cleanup when comes to native lib handling:
> * it is using lib/native/${JAVA_PLATFORM} for the java.library.path, when it should use lib/native.
> * it is looking for build/lib/native, this is from the old ant build, not applicable anymore.
> * it is looking for the libhdfs.a and adding to the java.librar.path, this is not correct.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (HADOOP-7874) native libs should be under lib/native/ dir

Posted by "Hadoop QA (Commented) (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HADOOP-7874?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13160501#comment-13160501 ] 

Hadoop QA commented on HADOOP-7874:
-----------------------------------

-1 overall.  Here are the results of testing the latest attachment 
  http://issues.apache.org/jira/secure/attachment/12505695/HADOOP-7874.patch
  against trunk revision .

    +1 @author.  The patch does not contain any @author tags.

    -1 tests included.  The patch doesn't appear to include any new or modified tests.
                        Please justify why no new tests are needed for this patch.
                        Also please list what manual steps were performed to verify this patch.

    -1 patch.  The patch command could not apply the patch.

Console output: https://builds.apache.org/job/PreCommit-HADOOP-Build/419//console

This message is automatically generated.
                
> native libs should be under lib/native/ dir
> -------------------------------------------
>
>                 Key: HADOOP-7874
>                 URL: https://issues.apache.org/jira/browse/HADOOP-7874
>             Project: Hadoop Common
>          Issue Type: Bug
>          Components: build
>    Affects Versions: 0.24.0, 0.23.1
>            Reporter: Alejandro Abdelnur
>            Assignee: Alejandro Abdelnur
>              Labels: bigtop
>         Attachments: HADOOP-7874.patch
>
>
> Currently common and hdfs SO files end up under lib/ dir with all JARs, they should end up under lib/native.
> In addition, the hadoop-config.sh script needs some cleanup when comes to native lib handling:
> * it is using lib/native/${JAVA_PLATFORM} for the java.library.path, when it should use lib/native.
> * it is looking for build/lib/native, this is from the old ant build, not applicable anymore.
> * it is looking for the libhdfs.a and adding to the java.librar.path, this is not correct.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Updated] (HADOOP-7874) native libs should be under lib/native/ dir

Posted by "Alejandro Abdelnur (Updated) (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HADOOP-7874?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Alejandro Abdelnur updated HADOOP-7874:
---------------------------------------

    Status: Patch Available  (was: Open)
    
> native libs should be under lib/native/ dir
> -------------------------------------------
>
>                 Key: HADOOP-7874
>                 URL: https://issues.apache.org/jira/browse/HADOOP-7874
>             Project: Hadoop Common
>          Issue Type: Bug
>          Components: build
>    Affects Versions: 0.24.0, 0.23.1
>            Reporter: Alejandro Abdelnur
>            Assignee: Alejandro Abdelnur
>         Attachments: HADOOP-7874.patch
>
>
> Currently common and hdfs SO files end up under lib/ dir with all JARs, they should end up under lib/native.
> In addition, the hadoop-config.sh script needs some cleanup when comes to native lib handling:
> * it is using lib/native/${JAVA_PLATFORM} for the java.library.path, when it should use lib/native.
> * it is looking for build/lib/native, this is from the old ant build, not applicable anymore.
> * it is looking for the libhdfs.a and adding to the java.librar.path, this is not correct.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira