You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@bigtop.apache.org by "Battula, Brahma Reddy" <bb...@visa.com.INVALID> on 2022/05/07 07:50:19 UTC
Using the mpacks
Hi All,
Plan to use bigtop and ambari for cluster management with custom repo(Hadoop,hive ,ZK and spark).
Any references for beginners..?
Is it good to use bigtop mpacks so that we need to define the stacks in ambari..?(stack managemet will be problem..?)
Re: Using the mpacks
Posted by "Battula, Brahma Reddy" <bb...@visa.com>.
Thanks Yuqi Gu for prompt reply, it really helpful.
So, going with bigtop mpack shouldn’t be risk..? Or having the stack definition in ambari is better..?
Looks still mpacks not ready for Hadoop-3 (“https://issues.apache.org/jira/browse/BIGTOP-3586”)..?
And you references given thought on “bring back ambari” ( as so many people still Widley using the ambari), lets discuss on separate thread to take collective opinion on this. ( Ambari was moved to attic.)
From: Yuqi Gu <gu...@apache.org>
Reply-To: "user@bigtop.apache.org" <us...@bigtop.apache.org>
Date: Saturday, 7 May 2022 at 3:18 PM
To: "user@bigtop.apache.org" <us...@bigtop.apache.org>
Cc: "dev@bigtop.apache.org" <de...@bigtop.apache.org>
Subject: Re: Using the mpacks
Hi Battula,
The deployment steps with Bigtop Mpack: Quick Guide<https://nam10.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Fapache%2Fbigtop%2Fpull%2F555%23issuecomment-562415260&data=05%7C01%7Cbbattula%40visa.com%7Ceb151e74046e4e33044c08da300e9e22%7C38305e12e15d4ee888b9c4db1c477d76%7C0%7C0%7C637875137177616033%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=9mzbZjtdsQ8EVO9OMXYmloTR3%2B3rJAZLwGtxAS1WG8A%3D&reserved=0>.
A simple Bigtop Ambari Demo: here<https://nam10.safelinks.protection.outlook.com/?url=https%3A%2F%2Fwww.youtube.com%2Fwatch%3Fv%3DvnyUQtF8ZyM&data=05%7C01%7Cbbattula%40visa.com%7Ceb151e74046e4e33044c08da300e9e22%7C38305e12e15d4ee888b9c4db1c477d76%7C0%7C0%7C637875137177616033%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=UrRIwvnIzZq9kafhdDR2TEWJQE1SnTOFwHJSEhyKREY%3D&reserved=0>.
The services stacks included in the current Bigtop Mpack are HDFS, YARN, MapReduce and Zookeeper, but not hive, spark in it.
You need to define the hive, spark in the stacks as the services included into Bigtop Mpacks.
BRs,
Yuqi
Battula, Brahma Reddy <bb...@visa.com>> 于2022年5月7日周六 15:50写道：
Hi All,
Plan to use bigtop and ambari for cluster management with custom repo(Hadoop,hive ,ZK and spark).
Any references for beginners..?
Is it good to use bigtop mpacks so that we need to define the stacks in ambari..?(stack managemet will be problem..?)
Re: Using the mpacks
Posted by "Battula, Brahma Reddy" <bb...@visa.com.INVALID>.
Thanks Yuqi Gu for prompt reply, it really helpful.
So, going with bigtop mpack shouldn’t be risk..? Or having the stack definition in ambari is better..?
Looks still mpacks not ready for Hadoop-3 (“https://issues.apache.org/jira/browse/BIGTOP-3586”)..?
And you references given thought on “bring back ambari” ( as so many people still Widley using the ambari), lets discuss on separate thread to take collective opinion on this. ( Ambari was moved to attic.)
From: Yuqi Gu <gu...@apache.org>
Reply-To: "user@bigtop.apache.org" <us...@bigtop.apache.org>
Date: Saturday, 7 May 2022 at 3:18 PM
To: "user@bigtop.apache.org" <us...@bigtop.apache.org>
Cc: "dev@bigtop.apache.org" <de...@bigtop.apache.org>
Subject: Re: Using the mpacks
Hi Battula,
The deployment steps with Bigtop Mpack: Quick Guide<https://nam10.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Fapache%2Fbigtop%2Fpull%2F555%23issuecomment-562415260&data=05%7C01%7Cbbattula%40visa.com%7Ceb151e74046e4e33044c08da300e9e22%7C38305e12e15d4ee888b9c4db1c477d76%7C0%7C0%7C637875137177616033%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=9mzbZjtdsQ8EVO9OMXYmloTR3%2B3rJAZLwGtxAS1WG8A%3D&reserved=0>.
A simple Bigtop Ambari Demo: here<https://nam10.safelinks.protection.outlook.com/?url=https%3A%2F%2Fwww.youtube.com%2Fwatch%3Fv%3DvnyUQtF8ZyM&data=05%7C01%7Cbbattula%40visa.com%7Ceb151e74046e4e33044c08da300e9e22%7C38305e12e15d4ee888b9c4db1c477d76%7C0%7C0%7C637875137177616033%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=UrRIwvnIzZq9kafhdDR2TEWJQE1SnTOFwHJSEhyKREY%3D&reserved=0>.
The services stacks included in the current Bigtop Mpack are HDFS, YARN, MapReduce and Zookeeper, but not hive, spark in it.
You need to define the hive, spark in the stacks as the services included into Bigtop Mpacks.
BRs,
Yuqi
Battula, Brahma Reddy <bb...@visa.com>> 于2022年5月7日周六 15:50写道：
Hi All,
Plan to use bigtop and ambari for cluster management with custom repo(Hadoop,hive ,ZK and spark).
Any references for beginners..?
Is it good to use bigtop mpacks so that we need to define the stacks in ambari..?(stack managemet will be problem..?)
Re: Using the mpacks
Posted by Yuqi Gu <gu...@apache.org>.
Hi Battula,
The deployment steps with Bigtop Mpack: Quick Guide
<https://github.com/apache/bigtop/pull/555#issuecomment-562415260>.
A simple Bigtop Ambari Demo: here
<https://www.youtube.com/watch?v=vnyUQtF8ZyM>.
The services stacks included in the current Bigtop Mpack are HDFS, YARN,
MapReduce and Zookeeper, but not hive, spark in it.
You need to define the hive, spark in the stacks as the services included
into Bigtop Mpacks.
BRs,
Yuqi
Battula, Brahma Reddy <bb...@visa.com> 于2022年5月7日周六 15:50写道：
> Hi All,
>
>
>
> Plan to use bigtop and ambari for cluster management with custom
> repo(Hadoop,hive ,ZK and spark).
>
>
>
> Any references for beginners..?
>
>
>
> Is it good to use bigtop mpacks so that we need to define the stacks in
> ambari..?(stack managemet will be problem..?)
>
>
>
>
>
Re: Using the mpacks
Posted by Yuqi Gu <gu...@apache.org>.
Hi Battula,
The deployment steps with Bigtop Mpack: Quick Guide
<https://github.com/apache/bigtop/pull/555#issuecomment-562415260>.
A simple Bigtop Ambari Demo: here
<https://www.youtube.com/watch?v=vnyUQtF8ZyM>.
The services stacks included in the current Bigtop Mpack are HDFS, YARN,
MapReduce and Zookeeper, but not hive, spark in it.
You need to define the hive, spark in the stacks as the services included
into Bigtop Mpacks.
BRs,
Yuqi
Battula, Brahma Reddy <bb...@visa.com> 于2022年5月7日周六 15:50写道：
> Hi All,
>
>
>
> Plan to use bigtop and ambari for cluster management with custom
> repo(Hadoop,hive ,ZK and spark).
>
>
>
> Any references for beginners..?
>
>
>
> Is it good to use bigtop mpacks so that we need to define the stacks in
> ambari..?(stack managemet will be problem..?)
>
>
>
>
>