You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-issues@hadoop.apache.org by "Binglin Chang (JIRA)" <ji...@apache.org> on 2014/05/29 09:34:01 UTC

[jira] [Updated] (HADOOP-10444) add pom.xml infrastructure for hadoop-native-core

     [ https://issues.apache.org/jira/browse/HADOOP-10444?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Binglin Chang updated HADOOP-10444:
-----------------------------------

    Attachment: HADOOP-10444.v1.patch

Changes: 
1. change project structure to maven, move all code from hadoop-native-core to hadoop-native-core/src/main/native
2. change build dir from hadoop-native-core to hadoop-native-core/target/native
3. add pom artifact hadoop-native-core, make according changes in hadoop-dist/pom.xml hadoop-project/pom.xml and pom.xml
4. add a new assembly hadoop-native-core-dist to copy .h files only.
5. add a new profile: native-core to activate hadoop-native-core compile/test/package, I didn't reuse -Pnative, cause currently -Pnative can't work on MacOSX.

When invoke using: mvn package -Pdist -DskipTests -Pnative -Pnative-core
native client libraries are packaged in following locations:
{code}
decster@localhost:~/hadoop-trunk$ ll hadoop-dist/target/hadoop-3.0.0-SNAPSHOT/{include/common,include/rpc,lib/native}
hadoop-dist/target/hadoop-3.0.0-SNAPSHOT/include/common:
total 76
-rw-rw-r-- 1 decster decster  2380 2014-05-29 00:10 hadoop_err.h
-rw-rw-r-- 1 decster decster  1025 2014-05-29 00:10 net.h
-rw-rw-r-- 1 decster decster 23781 2014-05-29 00:10 queue.h
-rw-rw-r-- 1 decster decster  1349 2014-05-29 00:10 string.h
-rw-rw-r-- 1 decster decster  4936 2014-05-29 00:10 test.h
-rw-rw-r-- 1 decster decster 25776 2014-05-29 00:10 tree.h
-rw-rw-r-- 1 decster decster  1189 2014-05-29 00:10 user.h

hadoop-dist/target/hadoop-3.0.0-SNAPSHOT/include/rpc:
total 36
-rw-rw-r-- 1 decster decster 3479 2014-05-29 00:10 call.h
-rw-rw-r-- 1 decster decster 1561 2014-05-29 00:10 client_id.h
-rw-rw-r-- 1 decster decster 6392 2014-05-29 00:10 conn.h
-rw-rw-r-- 1 decster decster 2939 2014-05-29 00:10 messenger.h
-rw-rw-r-- 1 decster decster 5395 2014-05-29 00:10 proxy.h
-rw-rw-r-- 1 decster decster 3700 2014-05-29 00:10 reactor.h
-rw-rw-r-- 1 decster decster 2647 2014-05-29 00:10 varint.h

hadoop-dist/target/hadoop-3.0.0-SNAPSHOT/lib/native:
total 7464
-rw-rw-r-- 1 decster decster 1239398 2014-05-29 00:10 libhadoop.a
-rw-rw-r-- 1 decster decster 1374292 2014-05-29 00:10 libhadooppipes.a
lrwxrwxrwx 1 decster decster      18 2014-05-29 00:10 libhadoop.so -> libhadoop.so.1.0.0*
-rwxrwxr-x 1 decster decster  721343 2014-05-29 00:10 libhadoop.so.1.0.0*
-rw-rw-r-- 1 decster decster  453186 2014-05-29 00:10 libhadooputils.a
-rw-rw-r-- 1 decster decster  317370 2014-05-29 00:10 libhdfs.a
lrwxrwxrwx 1 decster decster      17 2014-05-29 00:10 libhdfs-core.so -> libhdfs-core.so.1*
lrwxrwxrwx 1 decster decster      21 2014-05-29 00:10 libhdfs-core.so.1 -> libhdfs-core.so.1.0.0*
-rwxrwxr-x 1 decster decster 2747719 2014-05-29 00:10 libhdfs-core.so.1.0.0*
lrwxrwxrwx 1 decster decster      16 2014-05-29 00:10 libhdfs.so -> libhdfs.so.0.0.0*
-rwxrwxr-x 1 decster decster  212967 2014-05-29 00:10 libhdfs.so.0.0.0*
lrwxrwxrwx 1 decster decster      17 2014-05-29 00:10 libyarn-core.so -> libyarn-core.so.1*
lrwxrwxrwx 1 decster decster      21 2014-05-29 00:10 libyarn-core.so.1 -> libyarn-core.so.1.0.0*
-rwxrwxr-x 1 decster decster  564923 2014-05-29 00:10 libyarn-core.so.1.0.0*
{code}

> add pom.xml infrastructure for hadoop-native-core
> -------------------------------------------------
>
>                 Key: HADOOP-10444
>                 URL: https://issues.apache.org/jira/browse/HADOOP-10444
>             Project: Hadoop Common
>          Issue Type: Sub-task
>            Reporter: Colin Patrick McCabe
>            Assignee: Binglin Chang
>         Attachments: HADOOP-10444.v1.patch
>
>
> Add pom.xml infrastructure for hadoop-native-core, so that it builds under Maven.  We can look to how we integrated CMake into hadoop-hdfs-project and hadoop-common-project for inspiration here.  In the long term, it would be nice to use a Maven plugin here (see HADOOP-8887)



--
This message was sent by Atlassian JIRA
(v6.2#6252)