You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@ambari.apache.org by Jeff Zhang <zj...@gmail.com> on 2016/03/31 03:43:34 UTC

Does Start All follow the service order ?

Here's the service starting order I see when I click Start All:

Spark actually depends on Hive/Yarn/HDFS, but it's strange that I
NodeManager/HiveServer2 start after Spark HistoryServer and there's no
NameNode/DataNode start.


 YARN Client Install <http://localhost:8080/#>
 ZooKeeper Client Install <http://localhost:8080/#>
 Atlas Metadata Server Start <http://localhost:8080/#>
 MySQL Server Start <http://localhost:8080/#>
 Ranger Admin Start <http://localhost:8080/#>
 Zeppelin Notebook Start <http://localhost:8080/#>
 Ranger Usersync Start <http://localhost:8080/#>
 App Timeline Server Start <http://localhost:8080/#>
 History Server Start <http://localhost:8080/#>
 Hive Metastore Start <http://localhost:8080/#>
 ResourceManager Start <http://localhost:8080/#>
 Spark History Server Start <http://localhost:8080/#>
 ZooKeeper Server Start <http://localhost:8080/#>
 NodeManager Start <http://localhost:8080/#>
 HiveServer2 Start <http://localhost:8080/#>
 Oozie Server Start <http://localhost:8080/#>
 Flume Start <http://localhost:8080/#>
 WebHCat Server Start <http://localhost:8080/#>

-- 
Best Regards

Jeff Zhang

Re: Does Start All follow the service order ?

Posted by Mithun Mathew <mi...@gmail.com>.
This means that the service (we'll call it serviceX) cannot be installed
without YARN.

I guess requiredServices is responsible for this behavior:
On the Add Service page, un-check all services. Check serviceX and click
Next - This would complain YARN has to be checked too, if it has not
already been installed.

On Wed, Mar 30, 2016 at 7:08 PM, Jeff Zhang <zj...@gmail.com> wrote:

> Thanks Mithun,  I thought the order was specified in metainfo.xml as
> following
>
> <requiredServices>
>   <service>YARN</service>
> </requiredServices>
>
>
>
>
> On Thu, Mar 31, 2016 at 10:05 AM, Mithun Mathew <mi...@gmail.com>
> wrote:
>
>> To my understanding, Start All Services would start the individual
>> components according to the dependencies mentioned in
>> role_command_order.json
>> You can find this file under every stack. Here's the role_command_order.json
>> for HDP 2.3
>> <https://github.com/apache/ambari/blob/trunk/ambari-server/src/main/resources/stacks/HDP/2.3/role_command_order.json>
>>
>> If you want to force a start order for the component, you might have to
>> look into adding an entry to the above file for that stack.
>>
>> Also note that if a service is already started state, Start All Services
>> would not restart it (at least this was how it was, the last time I
>> checked).
>>
>> On Wed, Mar 30, 2016 at 6:43 PM, Jeff Zhang <zj...@gmail.com> wrote:
>>
>>>
>>> Here's the service starting order I see when I click Start All:
>>>
>>> Spark actually depends on Hive/Yarn/HDFS, but it's strange that I
>>> NodeManager/HiveServer2 start after Spark HistoryServer and there's no
>>> NameNode/DataNode start.
>>>
>>>
>>>  YARN Client Install <http://localhost:8080/#>
>>>  ZooKeeper Client Install <http://localhost:8080/#>
>>>  Atlas Metadata Server Start <http://localhost:8080/#>
>>>  MySQL Server Start <http://localhost:8080/#>
>>>  Ranger Admin Start <http://localhost:8080/#>
>>>  Zeppelin Notebook Start <http://localhost:8080/#>
>>>  Ranger Usersync Start <http://localhost:8080/#>
>>>  App Timeline Server Start <http://localhost:8080/#>
>>>  History Server Start <http://localhost:8080/#>
>>>  Hive Metastore Start <http://localhost:8080/#>
>>>  ResourceManager Start <http://localhost:8080/#>
>>>  Spark History Server Start <http://localhost:8080/#>
>>>  ZooKeeper Server Start <http://localhost:8080/#>
>>>  NodeManager Start <http://localhost:8080/#>
>>>  HiveServer2 Start <http://localhost:8080/#>
>>>  Oozie Server Start <http://localhost:8080/#>
>>>  Flume Start <http://localhost:8080/#>
>>>  WebHCat Server Start <http://localhost:8080/#>
>>>
>>> --
>>> Best Regards
>>>
>>> Jeff Zhang
>>>
>>
>>
>>
>> --
>> *Mithun Mathew* (Matt)
>>
>>    - www.linkedin.com/in/mithunmatt/
>>
>>
>
>
> --
> Best Regards
>
> Jeff Zhang
>



-- 
*Mithun Mathew* (Matt)

   - www.linkedin.com/in/mithunmatt/

Re: Does Start All follow the service order ?

Posted by Mithun Mathew <mi...@gmail.com>.
This means that the service (we'll call it serviceX) cannot be installed
without YARN.

I guess requiredServices is responsible for this behavior:
On the Add Service page, un-check all services. Check serviceX and click
Next - This would complain YARN has to be checked too, if it has not
already been installed.

On Wed, Mar 30, 2016 at 7:08 PM, Jeff Zhang <zj...@gmail.com> wrote:

> Thanks Mithun,  I thought the order was specified in metainfo.xml as
> following
>
> <requiredServices>
>   <service>YARN</service>
> </requiredServices>
>
>
>
>
> On Thu, Mar 31, 2016 at 10:05 AM, Mithun Mathew <mi...@gmail.com>
> wrote:
>
>> To my understanding, Start All Services would start the individual
>> components according to the dependencies mentioned in
>> role_command_order.json
>> You can find this file under every stack. Here's the role_command_order.json
>> for HDP 2.3
>> <https://github.com/apache/ambari/blob/trunk/ambari-server/src/main/resources/stacks/HDP/2.3/role_command_order.json>
>>
>> If you want to force a start order for the component, you might have to
>> look into adding an entry to the above file for that stack.
>>
>> Also note that if a service is already started state, Start All Services
>> would not restart it (at least this was how it was, the last time I
>> checked).
>>
>> On Wed, Mar 30, 2016 at 6:43 PM, Jeff Zhang <zj...@gmail.com> wrote:
>>
>>>
>>> Here's the service starting order I see when I click Start All:
>>>
>>> Spark actually depends on Hive/Yarn/HDFS, but it's strange that I
>>> NodeManager/HiveServer2 start after Spark HistoryServer and there's no
>>> NameNode/DataNode start.
>>>
>>>
>>>  YARN Client Install <http://localhost:8080/#>
>>>  ZooKeeper Client Install <http://localhost:8080/#>
>>>  Atlas Metadata Server Start <http://localhost:8080/#>
>>>  MySQL Server Start <http://localhost:8080/#>
>>>  Ranger Admin Start <http://localhost:8080/#>
>>>  Zeppelin Notebook Start <http://localhost:8080/#>
>>>  Ranger Usersync Start <http://localhost:8080/#>
>>>  App Timeline Server Start <http://localhost:8080/#>
>>>  History Server Start <http://localhost:8080/#>
>>>  Hive Metastore Start <http://localhost:8080/#>
>>>  ResourceManager Start <http://localhost:8080/#>
>>>  Spark History Server Start <http://localhost:8080/#>
>>>  ZooKeeper Server Start <http://localhost:8080/#>
>>>  NodeManager Start <http://localhost:8080/#>
>>>  HiveServer2 Start <http://localhost:8080/#>
>>>  Oozie Server Start <http://localhost:8080/#>
>>>  Flume Start <http://localhost:8080/#>
>>>  WebHCat Server Start <http://localhost:8080/#>
>>>
>>> --
>>> Best Regards
>>>
>>> Jeff Zhang
>>>
>>
>>
>>
>> --
>> *Mithun Mathew* (Matt)
>>
>>    - www.linkedin.com/in/mithunmatt/
>>
>>
>
>
> --
> Best Regards
>
> Jeff Zhang
>



-- 
*Mithun Mathew* (Matt)

   - www.linkedin.com/in/mithunmatt/

Re: Does Start All follow the service order ?

Posted by Jeff Zhang <zj...@gmail.com>.
Thanks Mithun,  I thought the order was specified in metainfo.xml as
following

<requiredServices>
  <service>YARN</service>
</requiredServices>




On Thu, Mar 31, 2016 at 10:05 AM, Mithun Mathew <mi...@gmail.com> wrote:

> To my understanding, Start All Services would start the individual
> components according to the dependencies mentioned in
> role_command_order.json
> You can find this file under every stack. Here's the role_command_order.json
> for HDP 2.3
> <https://github.com/apache/ambari/blob/trunk/ambari-server/src/main/resources/stacks/HDP/2.3/role_command_order.json>
>
> If you want to force a start order for the component, you might have to
> look into adding an entry to the above file for that stack.
>
> Also note that if a service is already started state, Start All Services
> would not restart it (at least this was how it was, the last time I
> checked).
>
> On Wed, Mar 30, 2016 at 6:43 PM, Jeff Zhang <zj...@gmail.com> wrote:
>
>>
>> Here's the service starting order I see when I click Start All:
>>
>> Spark actually depends on Hive/Yarn/HDFS, but it's strange that I
>> NodeManager/HiveServer2 start after Spark HistoryServer and there's no
>> NameNode/DataNode start.
>>
>>
>>  YARN Client Install <http://localhost:8080/#>
>>  ZooKeeper Client Install <http://localhost:8080/#>
>>  Atlas Metadata Server Start <http://localhost:8080/#>
>>  MySQL Server Start <http://localhost:8080/#>
>>  Ranger Admin Start <http://localhost:8080/#>
>>  Zeppelin Notebook Start <http://localhost:8080/#>
>>  Ranger Usersync Start <http://localhost:8080/#>
>>  App Timeline Server Start <http://localhost:8080/#>
>>  History Server Start <http://localhost:8080/#>
>>  Hive Metastore Start <http://localhost:8080/#>
>>  ResourceManager Start <http://localhost:8080/#>
>>  Spark History Server Start <http://localhost:8080/#>
>>  ZooKeeper Server Start <http://localhost:8080/#>
>>  NodeManager Start <http://localhost:8080/#>
>>  HiveServer2 Start <http://localhost:8080/#>
>>  Oozie Server Start <http://localhost:8080/#>
>>  Flume Start <http://localhost:8080/#>
>>  WebHCat Server Start <http://localhost:8080/#>
>>
>> --
>> Best Regards
>>
>> Jeff Zhang
>>
>
>
>
> --
> *Mithun Mathew* (Matt)
>
>    - www.linkedin.com/in/mithunmatt/
>
>


-- 
Best Regards

Jeff Zhang

Re: Does Start All follow the service order ?

Posted by Jeff Zhang <zj...@gmail.com>.
Thanks Mithun,  I thought the order was specified in metainfo.xml as
following

<requiredServices>
  <service>YARN</service>
</requiredServices>




On Thu, Mar 31, 2016 at 10:05 AM, Mithun Mathew <mi...@gmail.com> wrote:

> To my understanding, Start All Services would start the individual
> components according to the dependencies mentioned in
> role_command_order.json
> You can find this file under every stack. Here's the role_command_order.json
> for HDP 2.3
> <https://github.com/apache/ambari/blob/trunk/ambari-server/src/main/resources/stacks/HDP/2.3/role_command_order.json>
>
> If you want to force a start order for the component, you might have to
> look into adding an entry to the above file for that stack.
>
> Also note that if a service is already started state, Start All Services
> would not restart it (at least this was how it was, the last time I
> checked).
>
> On Wed, Mar 30, 2016 at 6:43 PM, Jeff Zhang <zj...@gmail.com> wrote:
>
>>
>> Here's the service starting order I see when I click Start All:
>>
>> Spark actually depends on Hive/Yarn/HDFS, but it's strange that I
>> NodeManager/HiveServer2 start after Spark HistoryServer and there's no
>> NameNode/DataNode start.
>>
>>
>>  YARN Client Install <http://localhost:8080/#>
>>  ZooKeeper Client Install <http://localhost:8080/#>
>>  Atlas Metadata Server Start <http://localhost:8080/#>
>>  MySQL Server Start <http://localhost:8080/#>
>>  Ranger Admin Start <http://localhost:8080/#>
>>  Zeppelin Notebook Start <http://localhost:8080/#>
>>  Ranger Usersync Start <http://localhost:8080/#>
>>  App Timeline Server Start <http://localhost:8080/#>
>>  History Server Start <http://localhost:8080/#>
>>  Hive Metastore Start <http://localhost:8080/#>
>>  ResourceManager Start <http://localhost:8080/#>
>>  Spark History Server Start <http://localhost:8080/#>
>>  ZooKeeper Server Start <http://localhost:8080/#>
>>  NodeManager Start <http://localhost:8080/#>
>>  HiveServer2 Start <http://localhost:8080/#>
>>  Oozie Server Start <http://localhost:8080/#>
>>  Flume Start <http://localhost:8080/#>
>>  WebHCat Server Start <http://localhost:8080/#>
>>
>> --
>> Best Regards
>>
>> Jeff Zhang
>>
>
>
>
> --
> *Mithun Mathew* (Matt)
>
>    - www.linkedin.com/in/mithunmatt/
>
>


-- 
Best Regards

Jeff Zhang

Re: Does Start All follow the service order ?

Posted by Mithun Mathew <mi...@gmail.com>.
To my understanding, Start All Services would start the individual
components according to the dependencies mentioned in
role_command_order.json
You can find this file under every stack. Here's the role_command_order.json
for HDP 2.3
<https://github.com/apache/ambari/blob/trunk/ambari-server/src/main/resources/stacks/HDP/2.3/role_command_order.json>

If you want to force a start order for the component, you might have to
look into adding an entry to the above file for that stack.

Also note that if a service is already started state, Start All Services
would not restart it (at least this was how it was, the last time I
checked).

On Wed, Mar 30, 2016 at 6:43 PM, Jeff Zhang <zj...@gmail.com> wrote:

>
> Here's the service starting order I see when I click Start All:
>
> Spark actually depends on Hive/Yarn/HDFS, but it's strange that I
> NodeManager/HiveServer2 start after Spark HistoryServer and there's no
> NameNode/DataNode start.
>
>
>  YARN Client Install <http://localhost:8080/#>
>  ZooKeeper Client Install <http://localhost:8080/#>
>  Atlas Metadata Server Start <http://localhost:8080/#>
>  MySQL Server Start <http://localhost:8080/#>
>  Ranger Admin Start <http://localhost:8080/#>
>  Zeppelin Notebook Start <http://localhost:8080/#>
>  Ranger Usersync Start <http://localhost:8080/#>
>  App Timeline Server Start <http://localhost:8080/#>
>  History Server Start <http://localhost:8080/#>
>  Hive Metastore Start <http://localhost:8080/#>
>  ResourceManager Start <http://localhost:8080/#>
>  Spark History Server Start <http://localhost:8080/#>
>  ZooKeeper Server Start <http://localhost:8080/#>
>  NodeManager Start <http://localhost:8080/#>
>  HiveServer2 Start <http://localhost:8080/#>
>  Oozie Server Start <http://localhost:8080/#>
>  Flume Start <http://localhost:8080/#>
>  WebHCat Server Start <http://localhost:8080/#>
>
> --
> Best Regards
>
> Jeff Zhang
>



-- 
*Mithun Mathew* (Matt)

   - www.linkedin.com/in/mithunmatt/

Re: Does Start All follow the service order ?

Posted by Mithun Mathew <mi...@gmail.com>.
To my understanding, Start All Services would start the individual
components according to the dependencies mentioned in
role_command_order.json
You can find this file under every stack. Here's the role_command_order.json
for HDP 2.3
<https://github.com/apache/ambari/blob/trunk/ambari-server/src/main/resources/stacks/HDP/2.3/role_command_order.json>

If you want to force a start order for the component, you might have to
look into adding an entry to the above file for that stack.

Also note that if a service is already started state, Start All Services
would not restart it (at least this was how it was, the last time I
checked).

On Wed, Mar 30, 2016 at 6:43 PM, Jeff Zhang <zj...@gmail.com> wrote:

>
> Here's the service starting order I see when I click Start All:
>
> Spark actually depends on Hive/Yarn/HDFS, but it's strange that I
> NodeManager/HiveServer2 start after Spark HistoryServer and there's no
> NameNode/DataNode start.
>
>
>  YARN Client Install <http://localhost:8080/#>
>  ZooKeeper Client Install <http://localhost:8080/#>
>  Atlas Metadata Server Start <http://localhost:8080/#>
>  MySQL Server Start <http://localhost:8080/#>
>  Ranger Admin Start <http://localhost:8080/#>
>  Zeppelin Notebook Start <http://localhost:8080/#>
>  Ranger Usersync Start <http://localhost:8080/#>
>  App Timeline Server Start <http://localhost:8080/#>
>  History Server Start <http://localhost:8080/#>
>  Hive Metastore Start <http://localhost:8080/#>
>  ResourceManager Start <http://localhost:8080/#>
>  Spark History Server Start <http://localhost:8080/#>
>  ZooKeeper Server Start <http://localhost:8080/#>
>  NodeManager Start <http://localhost:8080/#>
>  HiveServer2 Start <http://localhost:8080/#>
>  Oozie Server Start <http://localhost:8080/#>
>  Flume Start <http://localhost:8080/#>
>  WebHCat Server Start <http://localhost:8080/#>
>
> --
> Best Regards
>
> Jeff Zhang
>



-- 
*Mithun Mathew* (Matt)

   - www.linkedin.com/in/mithunmatt/