[GitHub] [bigtop] dmasice commented on pull request #555: BIGTOP-3264: Add a new Bigtop Mpack definition for Ambari

[GitBox <gi...@apache.org>]

dmasice commented on pull request #555:
URL: https://github.com/apache/bigtop/pull/555#issuecomment-948787999


   Hi,
   
   I think this might be related to this issue, but if not I'll create a new one. My company is also trying to move from HDP to pure opensource and right now, I'm unable to move forward.
   
   I managed to create Debian packages for Ambari 2.7.5 and Hadoop 3.3 with Bigtop, and also managed to create an apt repository including GPG signatures.  This works as expected.  Then I tried to install Hadoop through Ambari.  First, I got an error about a missing property (stack_packages) in cluster-env.xml.  I managed to fix that by looking at our HDP cluster.
   
   After that, the cluster install process seems to work until it tries to install the packages for the selected services.  I'm getting the following error:
   ```
   Traceback (most recent call last):
     File "/var/lib/ambari-agent/cache/stack-hooks/after-INSTALL/scripts/hook.py", line 39, in <module>
       AfterInstallHook().execute()
     File "/usr/lib/ambari-agent/lib/resource_management/libraries/script/script.py", line 352, in execute
       method(env)
     File "/var/lib/ambari-agent/cache/stack-hooks/after-INSTALL/scripts/hook.py", line 32, in hook
       setup_stack_symlinks(self.stroutfile)
     File "/var/lib/ambari-agent/cache/stack-hooks/after-INSTALL/scripts/shared_initialization.py", line 53, in setup_stack_symlinks
       stack_packages = stack_select.get_packages(stack_select.PACKAGE_SCOPE_INSTALL)
     File "/usr/lib/ambari-agent/lib/resource_management/libraries/functions/stack_select.py", line 223, in get_packages
       supported_packages = get_supported_packages()
     File "/usr/lib/ambari-agent/lib/resource_management/libraries/functions/stack_select.py", line 147, in get_supported_packages
       raise Fail("Unable to query for supported packages using {0}".format(stack_selector_path))
   resource_management.core.exceptions.Fail: Unable to query for supported packages using /usr/bin/distro-select
   ```
   
   This command (distro-select) is nowhere to be found.  Poking around with HDP, it has a similar script called hdp-select, but it does not work with this (as expected).
   
   I've been inspecting those scripts (stack_select.py, shared_initialization.py, etc), but I'm a bit lost right now.
   
   @dongqiu, how did you manage to make it work?
   
   Any help would be appreciated.
   
   Thanks.
   
   
   Regards.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: dev-unsubscribe@bigtop.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org