[jira] [Comment Edited] (AMBARI-21674) Ambari to support Hybrid cluster

["Yussuf Shaikh (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/AMBARI-21674?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16197026#comment-16197026 ] 

Yussuf Shaikh edited comment on AMBARI-21674 at 10/9/17 2:11 PM:
-----------------------------------------------------------------

We have identified the following list of sub-tasks for supporting Ambari Hybrid cluster. Planning to work on the list in sequence for next couple of months.

* Add a function in Configuration class to reload the configs and read a custom property	
* Allow different OS type and version for Hybrid setup	
* Backend and UI changes for different JAVA_HOME related to OS arch types	
** 	Verify JAVA_HOME and prompt user to enter JAVA_HOME for new OS family
** 	UI for validating JAVA_HOME depending on the OS family and store in ambari.properties with OS family suffix
** 	Display Host check report (warning popup) for JAVA_HOME depending on OS family and UI validations
** 	Read the JAVA_HOME depending on the OS family during Service install (action & command) and upgrade
** 	Set java.home.<os_family> in ambari-server setup script for server OS family
* Backend and UI changes for HDP & HDP-UTILS repo URLs related to OS arch types (Install and Add Host action)	
** 	UI for verifying if repo exist for new OS family and user prompt for entering HDP and HDP-UTILs repo URLs
** 	Validate the HDP and HDP-UTILS repo URLs entered by the user and use skip/satellite option
**	Store the user input at step 3 for custom  HDP and HDP-UTILS repo URLs
** 	Display the custom repo set in reporting section and UI validations
* Backend and UI changes for Ambari repo URLs related to OS arch types	
**	Verify if new OS family to the cluster is different from server
** 	UI changes for prompting user during registration failure for new OS family
** 	Store and retrieve the ambari repo urls for os family during bootstrap


was (Author: yussufshaikh):
We have identified the following list of sub-tasks for supporting Ambari Hybrid cluster. Planning to work on the list in sequence for next couple of months.

Add a function in Configuration class to reload the configs and read a custom property	
Allow different OS type and version for Hybrid setup	
Backend and UI changes for different JAVA_HOME related to OS arch types	
	Verify JAVA_HOME and prompt user to enter JAVA_HOME for new OS family
	UI for validating JAVA_HOME depending on the OS family and store in ambari.properties with OS family suffix
	Display Host check report (warning popup) for JAVA_HOME depending on OS family and UI validations
	Read the JAVA_HOME depending on the OS family during Service install (action & command) and upgrade
	Set java.home.<os_family> in ambari-server setup script for server OS family
Backend and UI changes for HDP & HDP-UTILS repo URLs related to OS arch types (Install and Add Host action)	
	UI for verifying if repo exist for new OS family and user prompt for entering HDP and HDP-UTILs repo URLs
	Validate the HDP and HDP-UTILS repo URLs entered by the user and use skip/satellite option
	Store the user input at step 3 for custom  HDP and HDP-UTILS repo URLs
	Display the custom repo set in reporting section and UI validations
Backend and UI changes for Ambari repo URLs related to OS arch types	
	Verify if new OS family to the cluster is different from server
	UI changes for prompting user during registration failure for new OS family
	Store and retrieve the Ambari repo URLs for OS family during bootstrap

> Ambari to support Hybrid cluster 
> ---------------------------------
>
>                 Key: AMBARI-21674
>                 URL: https://issues.apache.org/jira/browse/AMBARI-21674
>             Project: Ambari
>          Issue Type: New Feature
>          Components: ambari-agent, ambari-server
>            Reporter: Ayappan
>
> We have been exploring Hybrid hadoop cluster recently. By hybrid, i mean the nodes in the cluster have different platform architectures. Some nodes are intel x86_64 , some are IBM Power ppc64le., and so on. Right now Ambari doesn't have this hybrid support. It selects the repo based on the machine where it is installed and then ask the users to add the nodes. I think this order has to be changed as the first step to provide hybrid support in Ambari.
> We were actually able to bring up a hybrid cluster using some hacks (not so good) like manually configuring the yum repos according to the arch, installing the rpms before ambari does and also manipulating the JAVA_HOME variable. We also ran some examples like terasort without any issues.
> So the thing here is we kind of starting to work on making Ambari provide a smooth hybrid support which requires some design changes. We very much welcome Ambari community to provide some ideas, patch contributions, or whatever way you can help us on. 



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)