You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@bigtop.apache.org by Satish Iyengar <sa...@gmail.com> on 2021/05/20 16:52:38 UTC

Bigtop Ambari mpack

Hi all,

I am looking to use Bigtop to create a cluster by using Ambari (part of
Bigtop stack).

I was trying Bigtop 1.5.0 as it includes the versions that we need (hive,
tez, hadoop & spark). I however see Bigtop ambari mpack shipped with 1.5.0
points to the repo for Bigtop 1.4.0 which uses centos7 (Big 1.5.0 has
support for centos8).

https://github.com/apache/bigtop/blob/branch-1.5/bigtop-packages/src/common/bigtop-ambari-mpack/bgtp-ambari-mpack/src/main/resources/stacks/BGTP/1.0/repos/repoinfo.xml

This breaks the compatibility of the hive/hadoop versions. Was there a
specific reason to ship mpack pointing to 1.4.0 in 1.5.0?

Am I missing something here?

Any insights or recommendations would be appreciated.

Thanks in advance
Satish

Re: Bigtop Ambari mpack

Posted by Satish <sa...@gmail.com>.
Sure I would love to do it.

Sent from my iPhone

> On May 21, 2021, at 11:30 PM, Evans Ye <ev...@apache.org> wrote:
> 
> 
> Hey Satish,
> 
> Maybe you can help us by contributing the 1.5.0 mpack?
> 
>> Satish <sa...@gmail.com> 於 2021年5月21日 週五 11:02 寫道:
>> Thanks Yuqi for the clarification. I just finished creating an mpack for 1.5.0. I will test it as we are working to build hadoop stack based on 1.5.0. 
>> 
>> Sent from my iPhone
>> 
>>>> On May 20, 2021, at 10:47 PM, Yuqi Gu <gu...@apache.org> wrote:
>>>> 
>>> 
>>> Hi Satish,
>>> 
>>> The Bigtop 1.5.0 hadn't released yet when we created this Bigtop Mpack. So the Mpack adopted the 1.4.0 as its SW packages repos. 
>>> I would like to update the repo to 1.5.0 and maybe it would take some time to test the Mpack on 1.5.0.
>>> 
>>> BRs,
>>> Yuqi
>>> 
>>> 
>>> Satish Iyengar <sa...@gmail.com> 于2021年5月21日周五 上午12:53写道:
>>>> Hi all,
>>>> 
>>>> I am looking to use Bigtop to create a cluster by using Ambari (part of Bigtop stack). 
>>>> 
>>>> I was trying Bigtop 1.5.0 as it includes the versions that we need (hive, tez, hadoop & spark). I however see Bigtop ambari mpack shipped with 1.5.0 points to the repo for Bigtop 1.4.0 which uses centos7 (Big 1.5.0 has support for centos8). 
>>>> 
>>>> https://github.com/apache/bigtop/blob/branch-1.5/bigtop-packages/src/common/bigtop-ambari-mpack/bgtp-ambari-mpack/src/main/resources/stacks/BGTP/1.0/repos/repoinfo.xml
>>>> 
>>>> This breaks the compatibility of the hive/hadoop versions. Was there a specific reason to ship mpack pointing to 1.4.0 in 1.5.0? 
>>>> 
>>>> Am I missing something here?
>>>> 
>>>> Any insights or recommendations would be appreciated. 
>>>> 
>>>> Thanks in advance
>>>> Satish

Re: Bigtop Ambari mpack

Posted by Evans Ye <ev...@apache.org>.
Hey Satish,

Maybe you can help us by contributing the 1.5.0 mpack?

Satish <sa...@gmail.com> 於 2021年5月21日 週五 11:02 寫道:

> Thanks Yuqi for the clarification. I just finished creating an mpack for
> 1.5.0. I will test it as we are working to build hadoop stack based on
> 1.5.0.
>
> Sent from my iPhone
>
> On May 20, 2021, at 10:47 PM, Yuqi Gu <gu...@apache.org> wrote:
>
> 
> Hi Satish,
>
> The Bigtop 1.5.0 hadn't released yet when we created this Bigtop Mpack. So
> the Mpack adopted the 1.4.0 as its SW packages repos.
> I would like to update the repo to 1.5.0 and maybe it would take some time
> to test the Mpack on 1.5.0.
>
> BRs,
> Yuqi
>
>
> Satish Iyengar <sa...@gmail.com> 于2021年5月21日周五 上午12:53写道:
>
>> Hi all,
>>
>> I am looking to use Bigtop to create a cluster by using Ambari (part of
>> Bigtop stack).
>>
>> I was trying Bigtop 1.5.0 as it includes the versions that we need (hive,
>> tez, hadoop & spark). I however see Bigtop ambari mpack shipped with 1.5.0
>> points to the repo for Bigtop 1.4.0 which uses centos7 (Big 1.5.0 has
>> support for centos8).
>>
>>
>> https://github.com/apache/bigtop/blob/branch-1.5/bigtop-packages/src/common/bigtop-ambari-mpack/bgtp-ambari-mpack/src/main/resources/stacks/BGTP/1.0/repos/repoinfo.xml
>>
>> This breaks the compatibility of the hive/hadoop versions. Was there a
>> specific reason to ship mpack pointing to 1.4.0 in 1.5.0?
>>
>> Am I missing something here?
>>
>> Any insights or recommendations would be appreciated.
>>
>> Thanks in advance
>> Satish
>>
>

Re: Bigtop Ambari mpack

Posted by Satish <sa...@gmail.com>.
Thanks Yuqi for the clarification. I just finished creating an mpack for 1.5.0. I will test it as we are working to build hadoop stack based on 1.5.0. 

Sent from my iPhone

> On May 20, 2021, at 10:47 PM, Yuqi Gu <gu...@apache.org> wrote:
> 
> 
> Hi Satish,
> 
> The Bigtop 1.5.0 hadn't released yet when we created this Bigtop Mpack. So the Mpack adopted the 1.4.0 as its SW packages repos. 
> I would like to update the repo to 1.5.0 and maybe it would take some time to test the Mpack on 1.5.0.
> 
> BRs,
> Yuqi
> 
> 
> Satish Iyengar <sa...@gmail.com> 于2021年5月21日周五 上午12:53写道:
>> Hi all,
>> 
>> I am looking to use Bigtop to create a cluster by using Ambari (part of Bigtop stack). 
>> 
>> I was trying Bigtop 1.5.0 as it includes the versions that we need (hive, tez, hadoop & spark). I however see Bigtop ambari mpack shipped with 1.5.0 points to the repo for Bigtop 1.4.0 which uses centos7 (Big 1.5.0 has support for centos8). 
>> 
>> https://github.com/apache/bigtop/blob/branch-1.5/bigtop-packages/src/common/bigtop-ambari-mpack/bgtp-ambari-mpack/src/main/resources/stacks/BGTP/1.0/repos/repoinfo.xml
>> 
>> This breaks the compatibility of the hive/hadoop versions. Was there a specific reason to ship mpack pointing to 1.4.0 in 1.5.0? 
>> 
>> Am I missing something here?
>> 
>> Any insights or recommendations would be appreciated. 
>> 
>> Thanks in advance
>> Satish

Re: Bigtop Ambari mpack

Posted by Yuqi Gu <gu...@apache.org>.
Hi Satish,

The Bigtop 1.5.0 hadn't released yet when we created this Bigtop Mpack. So
the Mpack adopted the 1.4.0 as its SW packages repos.
I would like to update the repo to 1.5.0 and maybe it would take some time
to test the Mpack on 1.5.0.

BRs,
Yuqi


Satish Iyengar <sa...@gmail.com> 于2021年5月21日周五 上午12:53写道:

> Hi all,
>
> I am looking to use Bigtop to create a cluster by using Ambari (part of
> Bigtop stack).
>
> I was trying Bigtop 1.5.0 as it includes the versions that we need (hive,
> tez, hadoop & spark). I however see Bigtop ambari mpack shipped with 1.5.0
> points to the repo for Bigtop 1.4.0 which uses centos7 (Big 1.5.0 has
> support for centos8).
>
>
> https://github.com/apache/bigtop/blob/branch-1.5/bigtop-packages/src/common/bigtop-ambari-mpack/bgtp-ambari-mpack/src/main/resources/stacks/BGTP/1.0/repos/repoinfo.xml
>
> This breaks the compatibility of the hive/hadoop versions. Was there a
> specific reason to ship mpack pointing to 1.4.0 in 1.5.0?
>
> Am I missing something here?
>
> Any insights or recommendations would be appreciated.
>
> Thanks in advance
> Satish
>