You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-issues@hadoop.apache.org by "Roman Shaposhnik (Created) (JIRA)" <ji...@apache.org> on 2012/03/29 19:56:22 UTC
[jira] [Created] (HADOOP-8226) a few native libraries are missing
from a full build and binary tarball
a few native libraries are missing from a full build and binary tarball
-----------------------------------------------------------------------
Key: HADOOP-8226
URL: https://issues.apache.org/jira/browse/HADOOP-8226
Project: Hadoop Common
Issue Type: Bug
Components: build
Affects Versions: 0.23.1
Reporter: Roman Shaposhnik
Assignee: Roman Shaposhnik
Hadoop 1.0.X ships the following native libraries in its tarball:
{noformat}
hadoop-1.0.1/c++/Linux-amd64-64/lib/libhadooppipes.a
hadoop-1.0.1/c++/Linux-amd64-64/lib/libhadooputils.a
hadoop-1.0.1/c++/Linux-i386-32/lib/libhadooppipes.a
hadoop-1.0.1/c++/Linux-i386-32/lib/libhadooputils.a
hadoop-1.0.1/lib/native/Linux-amd64-64/libhadoop.a
hadoop-1.0.1/lib/native/Linux-i386-32/libhadoop.a
hadoop-1.0.1/c++/Linux-amd64-64/lib/libhdfs.so
hadoop-1.0.1/c++/Linux-i386-32/lib/libhdfs.so
hadoop-1.0.1/lib/native/Linux-amd64-64/libhadoop.so
hadoop-1.0.1/lib/native/Linux-i386-32/libhadoop.so
{noformat}
While Hadoop 0.23.1 ships a subset:
{noformat}
./lib/native/libhadoop.a
./lib/native/libhdfs.a
./lib/native/libhadoop.so
./lib/native/libhdfs.so
{noformat}
The question is: do we have any reason not to support/publish the following libraries:
libhadooppipes.a, libhadooputils.a ?
And we also used to have librecordio that now seems to be missing from both.
If this is not intentional I can provide a patch to re-enable these bits.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HADOOP-8226) a few native libraries are missing
from a full build and binary tarball
Posted by "Harsh J (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-8226?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Harsh J updated HADOOP-8226:
----------------------------
Resolution: Not A Problem
Status: Resolved (was: Patch Available)
Doesn't seem to be a problem on trunk anymore. From a built tarball extracted:
{code}
➜ hadoop-3.0.0-SNAPSHOT git:(trunk) ✗ ls -lR lib/
lib/:
total 4
drwxrwxr-x 2 harsh harsh 4096 Sep 23 03:47 native
lib/native:
total 3388
-rw-rw-r-- 1 harsh harsh 616824 Sep 23 03:47 libhadoop.a
-rw-rw-r-- 1 harsh harsh 1481644 Sep 23 03:47 libhadooppipes.a
lrwxrwxrwx 1 harsh harsh 18 Sep 23 04:28 libhadoop.so -> libhadoop.so.1.0.0
-rwxrwxr-x 1 harsh harsh 341760 Sep 23 03:47 libhadoop.so.1.0.0
-rw-rw-r-- 1 harsh harsh 579408 Sep 23 03:47 libhadooputils.a
-rw-rw-r-- 1 harsh harsh 266168 Sep 23 03:47 libhdfs.a
lrwxrwxrwx 1 harsh harsh 16 Sep 23 04:28 libhdfs.so -> libhdfs.so.0.0.0
-rwxrwxr-x 1 harsh harsh 176118 Sep 23 03:47 libhdfs.so.0.0.0
{code}
> a few native libraries are missing from a full build and binary tarball
> -----------------------------------------------------------------------
>
> Key: HADOOP-8226
> URL: https://issues.apache.org/jira/browse/HADOOP-8226
> Project: Hadoop Common
> Issue Type: Bug
> Components: build
> Affects Versions: 0.23.1
> Reporter: Roman Shaposhnik
> Assignee: Roman Shaposhnik
> Attachments: HADOOP-8226.patch.txt
>
>
> Hadoop 1.0.X ships the following native libraries in its tarball:
> {noformat}
> hadoop-1.0.1/c++/Linux-amd64-64/lib/libhadooppipes.a
> hadoop-1.0.1/c++/Linux-amd64-64/lib/libhadooputils.a
> hadoop-1.0.1/c++/Linux-i386-32/lib/libhadooppipes.a
> hadoop-1.0.1/c++/Linux-i386-32/lib/libhadooputils.a
> hadoop-1.0.1/lib/native/Linux-amd64-64/libhadoop.a
> hadoop-1.0.1/lib/native/Linux-i386-32/libhadoop.a
> hadoop-1.0.1/c++/Linux-amd64-64/lib/libhdfs.so
> hadoop-1.0.1/c++/Linux-i386-32/lib/libhdfs.so
> hadoop-1.0.1/lib/native/Linux-amd64-64/libhadoop.so
> hadoop-1.0.1/lib/native/Linux-i386-32/libhadoop.so
> {noformat}
> While Hadoop 0.23.1 ships a subset:
> {noformat}
> ./lib/native/libhadoop.a
> ./lib/native/libhdfs.a
> ./lib/native/libhadoop.so
> ./lib/native/libhdfs.so
> {noformat}
> The question is: do we have any reason not to support/publish the following libraries:
> libhadooppipes.a, libhadooputils.a ?
> And we also used to have librecordio that now seems to be missing from both.
> If this is not intentional I can provide a patch to re-enable these bits.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HADOOP-8226) a few native libraries are missing
from a full build and binary tarball
Posted by "Roman Shaposhnik (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-8226?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Roman Shaposhnik updated HADOOP-8226:
-------------------------------------
Attachment: HADOOP-8226.patch.txt
Here's the first cut at the patch. It makes hadooppipes and utils bits appear under include and lib subdirectories and it also makes C++ examples appear under examples.
Please let me know if you'd rather have me integrate the native parts of the build with make-maven-plugin.
> a few native libraries are missing from a full build and binary tarball
> -----------------------------------------------------------------------
>
> Key: HADOOP-8226
> URL: https://issues.apache.org/jira/browse/HADOOP-8226
> Project: Hadoop Common
> Issue Type: Bug
> Components: build
> Affects Versions: 0.23.1
> Reporter: Roman Shaposhnik
> Assignee: Roman Shaposhnik
> Attachments: HADOOP-8226.patch.txt
>
>
> Hadoop 1.0.X ships the following native libraries in its tarball:
> {noformat}
> hadoop-1.0.1/c++/Linux-amd64-64/lib/libhadooppipes.a
> hadoop-1.0.1/c++/Linux-amd64-64/lib/libhadooputils.a
> hadoop-1.0.1/c++/Linux-i386-32/lib/libhadooppipes.a
> hadoop-1.0.1/c++/Linux-i386-32/lib/libhadooputils.a
> hadoop-1.0.1/lib/native/Linux-amd64-64/libhadoop.a
> hadoop-1.0.1/lib/native/Linux-i386-32/libhadoop.a
> hadoop-1.0.1/c++/Linux-amd64-64/lib/libhdfs.so
> hadoop-1.0.1/c++/Linux-i386-32/lib/libhdfs.so
> hadoop-1.0.1/lib/native/Linux-amd64-64/libhadoop.so
> hadoop-1.0.1/lib/native/Linux-i386-32/libhadoop.so
> {noformat}
> While Hadoop 0.23.1 ships a subset:
> {noformat}
> ./lib/native/libhadoop.a
> ./lib/native/libhdfs.a
> ./lib/native/libhadoop.so
> ./lib/native/libhdfs.so
> {noformat}
> The question is: do we have any reason not to support/publish the following libraries:
> libhadooppipes.a, libhadooputils.a ?
> And we also used to have librecordio that now seems to be missing from both.
> If this is not intentional I can provide a patch to re-enable these bits.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HADOOP-8226) a few native libraries are missing
from a full build and binary tarball
Posted by "Roman Shaposhnik (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-8226?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Roman Shaposhnik updated HADOOP-8226:
-------------------------------------
Status: Patch Available (was: Open)
> a few native libraries are missing from a full build and binary tarball
> -----------------------------------------------------------------------
>
> Key: HADOOP-8226
> URL: https://issues.apache.org/jira/browse/HADOOP-8226
> Project: Hadoop Common
> Issue Type: Bug
> Components: build
> Affects Versions: 0.23.1
> Reporter: Roman Shaposhnik
> Assignee: Roman Shaposhnik
> Attachments: HADOOP-8226.patch.txt
>
>
> Hadoop 1.0.X ships the following native libraries in its tarball:
> {noformat}
> hadoop-1.0.1/c++/Linux-amd64-64/lib/libhadooppipes.a
> hadoop-1.0.1/c++/Linux-amd64-64/lib/libhadooputils.a
> hadoop-1.0.1/c++/Linux-i386-32/lib/libhadooppipes.a
> hadoop-1.0.1/c++/Linux-i386-32/lib/libhadooputils.a
> hadoop-1.0.1/lib/native/Linux-amd64-64/libhadoop.a
> hadoop-1.0.1/lib/native/Linux-i386-32/libhadoop.a
> hadoop-1.0.1/c++/Linux-amd64-64/lib/libhdfs.so
> hadoop-1.0.1/c++/Linux-i386-32/lib/libhdfs.so
> hadoop-1.0.1/lib/native/Linux-amd64-64/libhadoop.so
> hadoop-1.0.1/lib/native/Linux-i386-32/libhadoop.so
> {noformat}
> While Hadoop 0.23.1 ships a subset:
> {noformat}
> ./lib/native/libhadoop.a
> ./lib/native/libhdfs.a
> ./lib/native/libhadoop.so
> ./lib/native/libhdfs.so
> {noformat}
> The question is: do we have any reason not to support/publish the following libraries:
> libhadooppipes.a, libhadooputils.a ?
> And we also used to have librecordio that now seems to be missing from both.
> If this is not intentional I can provide a patch to re-enable these bits.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HADOOP-8226) a few native libraries are missing
from a full build and binary tarball
Posted by "Hadoop QA (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-8226?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13242018#comment-13242018 ]
Hadoop QA commented on HADOOP-8226:
-----------------------------------
-1 overall. Here are the results of testing the latest attachment
http://issues.apache.org/jira/secure/attachment/12520548/HADOOP-8226.patch.txt
against trunk revision .
+1 @author. The patch does not contain any @author tags.
-1 tests included. The patch doesn't appear to include any new or modified tests.
Please justify why no new tests are needed for this patch.
Also please list what manual steps were performed to verify this patch.
-1 patch. The patch command could not apply the patch.
Console output: https://builds.apache.org/job/PreCommit-HADOOP-Build/800//console
This message is automatically generated.
> a few native libraries are missing from a full build and binary tarball
> -----------------------------------------------------------------------
>
> Key: HADOOP-8226
> URL: https://issues.apache.org/jira/browse/HADOOP-8226
> Project: Hadoop Common
> Issue Type: Bug
> Components: build
> Affects Versions: 0.23.1
> Reporter: Roman Shaposhnik
> Assignee: Roman Shaposhnik
> Attachments: HADOOP-8226.patch.txt
>
>
> Hadoop 1.0.X ships the following native libraries in its tarball:
> {noformat}
> hadoop-1.0.1/c++/Linux-amd64-64/lib/libhadooppipes.a
> hadoop-1.0.1/c++/Linux-amd64-64/lib/libhadooputils.a
> hadoop-1.0.1/c++/Linux-i386-32/lib/libhadooppipes.a
> hadoop-1.0.1/c++/Linux-i386-32/lib/libhadooputils.a
> hadoop-1.0.1/lib/native/Linux-amd64-64/libhadoop.a
> hadoop-1.0.1/lib/native/Linux-i386-32/libhadoop.a
> hadoop-1.0.1/c++/Linux-amd64-64/lib/libhdfs.so
> hadoop-1.0.1/c++/Linux-i386-32/lib/libhdfs.so
> hadoop-1.0.1/lib/native/Linux-amd64-64/libhadoop.so
> hadoop-1.0.1/lib/native/Linux-i386-32/libhadoop.so
> {noformat}
> While Hadoop 0.23.1 ships a subset:
> {noformat}
> ./lib/native/libhadoop.a
> ./lib/native/libhdfs.a
> ./lib/native/libhadoop.so
> ./lib/native/libhdfs.so
> {noformat}
> The question is: do we have any reason not to support/publish the following libraries:
> libhadooppipes.a, libhadooputils.a ?
> And we also used to have librecordio that now seems to be missing from both.
> If this is not intentional I can provide a patch to re-enable these bits.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira