You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@bigtop.apache.org by GitBox <gi...@apache.org> on 2021/05/31 08:05:27 UTC

[GitHub] [bigtop] iwasakims opened a new pull request #780: BIGTOP-3329. Bump ambari to v2.7.5.

iwasakims opened a new pull request #780:
URL: https://github.com/apache/bigtop/pull/780


   https://issues.apache.org/jira/browse/BIGTOP-3329


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [bigtop] iwasakims edited a comment on pull request #780: BIGTOP-3329. Bump ambari to v2.7.5.

Posted by GitBox <gi...@apache.org>.
iwasakims edited a comment on pull request #780:
URL: https://github.com/apache/bigtop/pull/780#issuecomment-852039391


   I got another error on Ubuntu 18.04.
   ```
   ...
      dh_strip_nondeterminism
           Using 1622541556 as canonical time
           Normalizing debian/ambari-server/usr/lib/ambari-server/ehcache-2.10.0.jar using File::StripNondeterminism::handlers::jar
           ...
           Normalizing debian/ambaridh_strip_nondeterminism: debian/ambari-server/usr/lib/ambari-server/ambari-server-2.7.5.0.0.jar: Reading ZIP archive failed: IO error: reading zipfile comment :
   
   -server/usr/lib/ambari-server/spring-security-kerberos-core-1.0.1.RELEASE.jar using File::StripNondeterminism::handlers::jar
           Normalizing debian/ambari-server/usr/lib/ambari-server/spring-webmvc-5.1.8.RELEASE.jar using File::StripNondeterminism::handlers::jar
           Normalizing debian/ambari-server/usr/lib/ambari-server/spring-jcl-5.1.8.RELEASE.jar using File::StripNondeterminism::handlers::jar
           Normalizing debian/ambari-server/usr/lib/ambari-server/HikariCP-java7-2.4.13.jar using File::StripNondeterminism::handlers::jar
           Normalizing debian/ambari-server/usr/lib/ambari-server/spring-aop-5.1.8.RELEASE.jar using File::StripNondeterminism::handlers::jar
           Normalizing debian/ambari-server/usr/lib/ambari-server/commons-logging-1.1.1.jar using File::StripNondeterminism::handlers::jar
           Normalizing debian/ambari-server/usr/lib/ambari-server/api-ldap-extras-aci-2.0.0.AM1.jar using File::StripNondeterminism::handlers::jar
           Normalizing debian/ambari-server/usr/lib/ambari-server/metrics-core-3.1.0.jar using File::StripNondeterminism::handlers::jar
           Normalizing debian/ambari-server/usr/lib/ambari-server/ant-1.7.1.jar using File::StripNondeterminism::handlers::jar
           Normalizing debian/ambari-server/usr/lib/ambari-server/slf4j-api-1.7.20.jar using File::StripNondeterminism::handlers::jar
           Normalizing debian/ambari-server/usr/lib/ambari-server/ambari-metrics-common-2.7.5.0.0.jar using File::StripNondeterminism::handlers::jar
           Normalizing debian/ambari-server/usr/lib/ambari-server/guice-4.1.0.jar using File::StripNondeterminism::handlers::jar
           Normalizing debian/ambari-server/usr/lib/ambari-server/jsr305-1.3.9.jar using File::StripNondeterminism::handlers::jar
           Normalizing debian/ambari-server/usr/lib/ambari-server/mina-core-2.0.18.jar using File::StripNondeterminism::handlers::jar
           Normalizing debian/ambari-server/usr/lib/ambari-server/error_prone_annotations-2.3.2.jar using File::StripNondeterminism::handlers::jar
           Normalizing debian/ambari-server/usr/lib/ambari-server/hadoop-auth-2.7.2.jar using File::StripNondeterminism::handlers::jar
           Normalizing debian/ambari-server/usr/lib/ambari-server/ambari-server-2.7.5.0.0.jar using File::StripNondeterminism::handlers::jar
   debian/rules:26: recipe for target 'binary' failed
   make: *** [binary] Error 255
   dpkg-buildpackage: error: fakeroot debian/rules binary subprocess returned exit status 2
   
   > Task :ambari-deb FAILED
   6 actionable tasks: 6 executed
   ```
   ```


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [bigtop] iwasakims commented on pull request #780: BIGTOP-3329. Bump ambari to v2.7.5.

Posted by GitBox <gi...@apache.org>.
iwasakims commented on pull request #780:
URL: https://github.com/apache/bigtop/pull/780#issuecomment-851314109


   I need additional fix to address changes of contained files.
   ```
   $ ./gradlew ambari-clean ambari-pkg
   ...
   + install -d -m 0755 /home/centos/srcs/bigtop/build/ambari/rpm/BUILDROOT/ambari-2.7.5.0-1.el8.x86_64//usr/lib/ambari-client/lib
   + cp -a '/home/centos/srcs/bigtop/build/ambari/rpm/BUILD/apache-ambari-2.7.5-src/ambari-client/groovy-client/target/groovy-client*.jar' /home/centos/srcs/bigtop/build/ambari/rpm/BUILDROOT/ambari-2.7.5.0-1.el8.x86_64//usr/lib/ambari-client/lib
   cp: cannot stat '/home/centos/srcs/bigtop/build/ambari/rpm/BUILD/apache-ambari-2.7.5-src/ambari-client/groovy-client/target/groovy-client*.jar': No such file or directory
   error: Bad exit status from /var/tmp/rpm-tmp.tVSEHZ (%install)
   ```


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [bigtop] sekikn merged pull request #780: BIGTOP-3329. Bump ambari to v2.7.5.

Posted by GitBox <gi...@apache.org>.
sekikn merged pull request #780:
URL: https://github.com/apache/bigtop/pull/780


   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [bigtop] iwasakims commented on pull request #780: BIGTOP-3329. Bump ambari to v2.7.5.

Posted by GitBox <gi...@apache.org>.
iwasakims commented on pull request #780:
URL: https://github.com/apache/bigtop/pull/780#issuecomment-852039391


   I got another error on Ubuntu 18.04.
   ```
   debian/rules:26: recipe for target 'binary' failed
   make: *** [binary] Error 255
   dpkg-buildpackage: error: fakeroot debian/rules binary subprocess returned exit status 2
   
   > Task :ambari-deb FAILED
   6 actionable tasks: 6 executed
   dpkg-buildpackage: warning: debian/rules is not executable; fixing that
    dpkg-source --before-build ambari-2.7.5.0
    fakeroot debian/rules clean
   pyversions: missing X(S)-Python-Version in control file, fall back to debian/pyversions
   pyversions: missing debian/pyversions file, fall back to supported versions
   'build/lib.linux-x86_64-2.7' does not exist -- can't clean it
   'build/bdist.linux-x86_64' does not exist -- can't clean it
   'build/scripts-2.7' does not exist -- can't clean it
    dpkg-source -b ambari-2.7.5.0
    dpkg-genbuildinfo --build=source
    dpkg-genchanges -sa --build=source >../ambari_2.7.5.0-1_source.changes
   dpkg-genchanges: info: including full source code in upload
    dpkg-source --after-build ambari-2.7.5.0
   dpkg-source: warning: extracting unsigned source package (ambari_2.7.5.0-1.dsc)
   debuild: fatal error at line 1152:
   dpkg-buildpackage -rfakeroot -us -uc -ui -b
    failed
   
   FAILURE: Build failed with an exception.
   ```


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [bigtop] iwasakims commented on pull request #780: BIGTOP-3329. Bump ambari to v2.7.5.

Posted by GitBox <gi...@apache.org>.
iwasakims commented on pull request #780:
URL: https://github.com/apache/bigtop/pull/780#issuecomment-852031278


   @sekikn I could not reproduce the `ImportError: No module named setuptools`. Maybe because there is python-setuptools on my Ubuntu VM. Could you try updating bigtop_toolchain/manifests/packages.pp like below on your env? If it works, I will add the fix to this PR.
   ```
   diff --git a/bigtop_toolchain/manifests/packages.pp b/bigtop_toolchain/manifests/packages.pp
   index f25e79f8..d97cc176 100644
   --- a/bigtop_toolchain/manifests/packages.pp
   +++ b/bigtop_toolchain/manifests/packages.pp
   @@ -207,6 +207,7 @@ class bigtop_toolchain::packages {
            "bison",
            "flex",
            "python-dev",
   +        "python-setuptools",
            "libffi-dev"
          ]
          file { '/etc/apt/apt.conf.d/01retries':
   ```


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [bigtop] sekikn commented on pull request #780: BIGTOP-3329. Bump ambari to v2.7.5.

Posted by GitBox <gi...@apache.org>.
sekikn commented on pull request #780:
URL: https://github.com/apache/bigtop/pull/780#issuecomment-851983299


   Thank you for taking this issue @iwasakims!
   
   `./gradlew ambari-pkg` seems to fail with the following error on Debian 10 and Ubuntu 18.04, 20.04:
   
   ```
   > Task :ambari-sdeb
   
   ...
   
   dh clean
      dh_auto_clean
   dh_auto_clean: warning: Please use the third-party "pybuild" build system instead of python-distutils
   dh_auto_clean: warning: This feature will be removed in compat 12.
   pyversions: missing X(S)-Python-Version in control file, fall back to debian/pyversions
   pyversions: missing debian/pyversions file, fall back to supported versions
           python setup.py clean -a
   Traceback (most recent call last):
     File "setup.py", line 22, in <module>
       from setuptools import find_packages, setup
   ImportError: No module named setuptools
   dh_auto_clean: error: python setup.py clean -a returned exit code 1
   make: *** [debian/rules:26: clean] Error 25
   dpkg-buildpackage: error: fakeroot debian/rules clean subprocess returned exit status 2
   
   > Task :ambari-sdeb FAILED
   
   FAILURE: Build failed with an exception.
   ```


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [bigtop] sekikn commented on pull request #780: BIGTOP-3329. Bump ambari to v2.7.5.

Posted by GitBox <gi...@apache.org>.
sekikn commented on pull request #780:
URL: https://github.com/apache/bigtop/pull/780#issuecomment-852705462


   +1, tested with all supported distros on the x86_64 platforms. I've not run the smoke test yet, but if there's any problem, we can address it as another issue. Thanks @iwasakims!


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [bigtop] sekikn commented on pull request #780: BIGTOP-3329. Bump ambari to v2.7.5.

Posted by GitBox <gi...@apache.org>.
sekikn commented on pull request #780:
URL: https://github.com/apache/bigtop/pull/780#issuecomment-852599429


   Thanks for the advice @iwasakims, updating bigtop_toolchain/manifests/packages.pp just worked.
   I didn't come across the error you mentioned above, but got another one at least on Debian 9, 10 and Ubuntu 20.04:
   
   ```
      dh_install
   dh_install: warning: Cannot find (any matches for) "/usr/lib/python2.6/site-packages/ambari_server" (tried in ., debian/tmp)
   
   dh_install: warning: ambari-server missing files: /usr/lib/python2.6/site-packages/ambari_server
           install -d debian/ambari-server//etc
           cp --reflink=auto -a debian/tmp/etc/ambari-server debian/ambari-server//etc/
           install -d debian/ambari-server//etc/init.d
           cp --reflink=auto -a debian/tmp/etc/init.d/ambari-server debian/ambari-server//etc/init.d/
           install -d debian/ambari-server//usr/sbin
           cp --reflink=auto -a debian/tmp/usr/sbin/ambari-server.py debian/tmp/usr/sbin/ambari_server_main.py debian/ambari-server//usr/sbin/
           install -d debian/ambari-server//var/lib
           cp --reflink=auto -a debian/tmp/var/lib/ambari-server/ debian/ambari-server//var/lib/
   dh_install: warning: Cannot find (any matches for) "/usr/lib/python2.6/site-packages/ambari_agent" (tried in ., debian/tmp)
   
   dh_install: warning: ambari-agent missing files: /usr/lib/python2.6/site-packages/ambari_agent
   dh_install: error: missing files, aborting
           install -d debian/.debhelper/generated/ambari-server
           install -d debian/.debhelper/generated/ambari-agent
   make: *** [debian/rules:26: binary] Error 25
   dpkg-buildpackage: error: fakeroot debian/rules binary subprocess returned exit status 2
   debuild: fatal error at line 1182:
   dpkg-buildpackage -us -uc -ui -b
    failed
   
   > Task :ambari-deb FAILED
   
   FAILURE: Build failed with an exception.
   ```


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [bigtop] iwasakims commented on pull request #780: BIGTOP-3329. Bump ambari to v2.7.5.

Posted by GitBox <gi...@apache.org>.
iwasakims commented on pull request #780:
URL: https://github.com/apache/bigtop/pull/780#issuecomment-851435028


   `./gradlew ambari-pkg` succeeded on CentOS 8.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [bigtop] sekikn edited a comment on pull request #780: BIGTOP-3329. Bump ambari to v2.7.5.

Posted by GitBox <gi...@apache.org>.
sekikn edited a comment on pull request #780:
URL: https://github.com/apache/bigtop/pull/780#issuecomment-852599429


   Thanks for the advice @iwasakims, updating bigtop_toolchain/manifests/packages.pp just worked. Will try the latest commit.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [bigtop] iwasakims commented on pull request #780: BIGTOP-3329. Bump ambari to v2.7.5.

Posted by GitBox <gi...@apache.org>.
iwasakims commented on pull request #780:
URL: https://github.com/apache/bigtop/pull/780#issuecomment-851388215


   ambari-shell and ambari-client are removed by [AMBARI-23144](https://issues.apache.org/jira/browse/AMBARI-23144).


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org