You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@bigtop.apache.org by GitBox <gi...@apache.org> on 2021/05/11 15:59:52 UTC

[GitHub] [bigtop] iwasakims opened a new pull request #770: BIGTOP-3457. Add libhdfspp packages to hadoop.

iwasakims opened a new pull request #770:
URL: https://github.com/apache/bigtop/pull/770


   https://issues.apache.org/jira/browse/BIGTOP-3457
   
   tested hadoop-pkg on CentOS 8.
   
   ```
   $ rpm -qlp output/hadoop/x86_64/hadoop-libhdfspp-3.2.2-1.el8.x86_64.rpm
   /usr/lib64/libhdfspp.so
   /usr/lib64/libhdfspp.so.0.1.0
   
   $ rpm -qlp output/hadoop/x86_64/hadoop-libhdfspp-devel-3.2.2-1.el8.x86_64.rpm
   /usr/include/hdfspp
   /usr/include/hdfspp/block_location.h
   /usr/include/hdfspp/config_parser.h
   /usr/include/hdfspp/content_summary.h
   /usr/include/hdfspp/events.h
   /usr/include/hdfspp/fsinfo.h
   /usr/include/hdfspp/hdfs_ext.h
   /usr/include/hdfspp/hdfspp.h
   /usr/include/hdfspp/ioservice.h
   /usr/include/hdfspp/locks.h
   /usr/include/hdfspp/log.h
   /usr/include/hdfspp/options.h
   /usr/include/hdfspp/statinfo.h
   /usr/include/hdfspp/status.h
   /usr/include/hdfspp/uri.h
   ```


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [bigtop] elukey commented on pull request #770: BIGTOP-3457. Add libhdfspp packages to hadoop.

Posted by GitBox <gi...@apache.org>.
elukey commented on pull request #770:
URL: https://github.com/apache/bigtop/pull/770#issuecomment-840411997


   Built the patch for debian10, successful! Inspected with dpkg -c the new packages for libhdfspp, all good as far as I can see (tried also to install them on Docker).


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [bigtop] sekikn merged pull request #770: BIGTOP-3457. Add libhdfspp packages to hadoop.

Posted by GitBox <gi...@apache.org>.
sekikn merged pull request #770:
URL: https://github.com/apache/bigtop/pull/770


   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [bigtop] sekikn commented on pull request #770: BIGTOP-3457. Add libhdfspp packages to hadoop.

Posted by GitBox <gi...@apache.org>.
sekikn commented on pull request #770:
URL: https://github.com/apache/bigtop/pull/770#issuecomment-841518576


   +1, I succeeded in building hadoop with this PR on all distros we support. Thanks @iwasakims!


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [bigtop] iwasakims commented on pull request #770: BIGTOP-3457. Add libhdfspp packages to hadoop.

Posted by GitBox <gi...@apache.org>.
iwasakims commented on pull request #770:
URL: https://github.com/apache/bigtop/pull/770#issuecomment-841083314


   @elukey @sekikn Thanks for the feedback. I can reproduce the issue on my local CentOS 7. looking into the cause.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [bigtop] iwasakims commented on pull request #770: BIGTOP-3457. Add libhdfspp packages to hadoop.

Posted by GitBox <gi...@apache.org>.
iwasakims commented on pull request #770:
URL: https://github.com/apache/bigtop/pull/770#issuecomment-839360079


   I added the fix for dh_shlibdeps error on Ubuntu.
   ```
   dpkg-shlibdeps: error: no dependency information found for /usr/local/lib/libprotobuf.so.8 (used by debian/libhdfspp/usr/lib/libhdfspp.so.0.1.0)
   Hint: check if the library actually comes from a package.
   ```
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [bigtop] iwasakims commented on pull request #770: BIGTOP-3457. Add libhdfspp packages to hadoop.

Posted by GitBox <gi...@apache.org>.
iwasakims commented on pull request #770:
URL: https://github.com/apache/bigtop/pull/770#issuecomment-841221444


   With HADOOP-17196, libhdfspp is skipped on CentOS 7. Since HADOOP-17196 is just addressing compiler warnings on Windows, adding patch to revert it on Bigtop side should cause no issue.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [bigtop] elukey edited a comment on pull request #770: BIGTOP-3457. Add libhdfspp packages to hadoop.

Posted by GitBox <gi...@apache.org>.
elukey edited a comment on pull request #770:
URL: https://github.com/apache/bigtop/pull/770#issuecomment-840411997


   Built the patch for debian10, all good! Inspected with dpkg -c the new packages for libhdfspp, all good as far as I can see (tried also to install them on Docker).


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [bigtop] sekikn commented on pull request #770: BIGTOP-3457. Add libhdfspp packages to hadoop.

Posted by GitBox <gi...@apache.org>.
sekikn commented on pull request #770:
URL: https://github.com/apache/bigtop/pull/770#issuecomment-840917109


   @iwasakims This PR seems to fail on CentOS 7. Would you take a look?
   
   ```
   + for library in libhdfs.so.0.0.0 libhdfspp.so.0.1.0
   + cp /home/vagrant/bigtop/build/hadoop/rpm/BUILD/hadoop-3.2.2-src/build/lib/native/libhdfspp.so.0.1.0 /home/vagrant/bigtop/build/hadoop/rpm/BUILDROOT/hadoop-3.2.2-1.el7.x86_64/usr/lib64/
   cp: cannot stat '/home/vagrant/bigtop/build/hadoop/rpm/BUILD/hadoop-3.2.2-src/build/lib/native/libhdfspp.so.0.1.0': No such file or directory
   
   
   RPM build errors:
   error: Bad exit status from /var/tmp/rpm-tmp.7V2ozY (%install)
       Bad exit status from /var/tmp/rpm-tmp.7V2ozY (%install)
   
   > Task :hadoop-rpm FAILED
   ```


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org