You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@bigtop.apache.org by Ganesh Raju <ga...@linaro.org> on 2020/05/12 16:17:12 UTC
Re: life after Hortonworks
Matt
Here is the JIRA <https://issues.apache.org/jira/browse/BIGTOP-3211>for the
work done on Bigtop on Ambari mpack. Also BIGTOP-3264
<https://issues.apache.org/jira/browse/BIGTOP-3264>, AMBARI-25366
<https://issues.apache.org/jira/browse/AMBARI-25366>
Here is a helpful youtube <https://www.youtube.com/watch?v=vnyUQtF8ZyM>video
on using Ambari to install Bigtop stack. Here is a talk
<https://www.youtube.com/watch?v=XhC7_IYRPxI>about it as well. And here is
a wiki
<https://github.com/apache/bigtop/pull/555/commits/3b3af11341806567d5edf7a7cfbe20051c074988>page
on instructions.
Yes please, i would appreciate it if you can ask in the Bigtop dev mailing
list and you will get lots of help.
Univ of Michigan is an example customer who is using Ambari mpack with
Bigtop stack in production.
Thanks,
Ganesh
On Tue, May 12, 2020 at 10:57 AM Matt Andruff <ma...@gmail.com>
wrote:
> thanks,
>
> It may be easier to work with getting big top running on Ambari. I am
> sorry but I thought I went through the site pretty thoroughly. Where did
> you think the big top stack was? Is there something newer than the 0.8 one
> list in the ambari repo? Or should I just push this question to the dev
> list?
>
> On Mon, May 11, 2020 at 12:51 PM Ganesh Raju <ga...@linaro.org>
> wrote:
>
>> Stable version is v1.4. Master is at v1.5
>>
>> releases <https://cwiki.apache.org/confluence/display/BIGTOP/Releases>
>> github <https://github.com/apache/bigtop>
>> mailinglist <https://bigtop.apache.org/mail-lists.html>
>> components
>> <https://cwiki.apache.org/confluence/display/BIGTOP/Bigtop+1.4.0+Release>
>>
>> I would suggest signup for dev mailing list
>> Please ask questions there and I am willing to help with all you need.
>> You are welcome to contribute towards it as well. Bigtop will be happy to
>> add any new component that you think would be important.
>>
>> Thanks,
>> Ganesh
>>
>> On Mon, May 11, 2020 at 10:52 AM Matt Andruff <ma...@gmail.com>
>> wrote:
>>
>>> Can you share the link? I can only see them in the git repo with
>>> bigtop. 0.8 and that's kinda old.
>>>
>>> On Mon, May 11, 2020 at 11:01 AM Ganesh Raju <ga...@linaro.org>
>>> wrote:
>>>
>>>> Yes that's what Bigtop did. BTW, Apache Bigtop already has hadoop and
>>>> 30 other components.
>>>>
>>>> Ganesh
>>>>
>>>> On Mon, May 11, 2020 at 9:56 AM Matt Andruff <ma...@gmail.com>
>>>> wrote:
>>>>
>>>>> I kept digging and I found that ambari supports stacks (that we have
>>>>> all seen before). You can write your own custom stack
>>>>> <https://cwiki.apache.org/confluence/display/AMBARI/Overview#Overview-Structure>
>>>>> meaning you could write the "glue" what apache projects hortonworks had
>>>>> written to roll out a set of services. I guess this is how they got around
>>>>> being open source. I guess I'll start looking into making my own stack
>>>>> from scratch. If anyone already has one or know of one, please let me know.
>>>>>
>>>>> On Mon, May 11, 2020 at 10:41 AM Ganesh Raju <ga...@linaro.org>
>>>>> wrote:
>>>>>
>>>>>> Apache Bigtop now has mpack and works with Ambari. You could try
>>>>>> that.
>>>>>>
>>>>>> Thanks,
>>>>>> Ganesh
>>>>>>
>>>>>> On Mon, May 11, 2020 at 9:15 AM Matt Andruff <ma...@gmail.com>
>>>>>> wrote:
>>>>>>
>>>>>>> Hey I was just poking around today trying to figure out if ambari
>>>>>>> still works to install a cluster.
>>>>>>>
>>>>>>> I recently was able to install a Cloudera Manager installation.
>>>>>>>
>>>>>>> I was about to start an Ambari installation but when I poke the
>>>>>>> repos they all seem to need a user/password.
>>>>>>>
>>>>>>> Is there a non-hortonworks(cloudera) hadoop that can be still be
>>>>>>> installed with Amabari?
>>>>>>>
>>>>>>> If there is documentation somewhere just let me know, I couldn't
>>>>>>> find the answer googling as Hortonworks(cloudera) docs are all that come up.
>>>>>>>
>>>>>>> --
>>>>>>> Live life
>>>>>>> Laugh Often
>>>>>>>
>>>>>>
>>>>>>
>>>>>> --
>>>>>> IRC: ganeshraju@#linaro on irc.freenode.ne <http://irc.freenode.net/>
>>>>>> t
>>>>>>
>>>>>
>>>>>
>>>>> --
>>>>> Live life
>>>>> Laugh Often
>>>>>
>>>>
>>>>
>>>> --
>>>> IRC: ganeshraju@#linaro on irc.freenode.ne <http://irc.freenode.net/>t
>>>>
>>>
>>>
>>> --
>>> Live life
>>> Laugh Often
>>>
>>
>>
>> --
>> IRC: ganeshraju@#linaro on irc.freenode.ne <http://irc.freenode.net/>t
>>
>
>
> --
> Live life
> Laugh Often
>
--
IRC: ganeshraju@#linaro on irc.freenode.ne <http://irc.freenode.net/>t
Re: life after Hortonworks
Posted by Ganesh Raju <ga...@linaro.org>.
Bigtopers
Please feel free to jump in / correct me.
Hi Matt
Agree, documentation could be improved.
https://cwiki.apache.org/confluence/display/BIGTOP/How+to+install+Hadoop+distribution+from+Bigtop+1.2.0
Here is the link <https://ci.bigtop.apache.org/job/Bigtop-trunk-packages/>to
master branch CI on various distro.
Bigtop Docker hub <https://hub.docker.com/u/bigtop>
Additional documentation:
Here is a talk <https://www.youtube.com/watch?v=DudUj0McwHQ>that walks
through the build and deployment process.
https://collaborate.linaro.org/display/BDTS/How+to+%27Consume%27+a+Bigtop+release+-+to+get+a+repository+URL
https://collaborate.linaro.org/display/BDTS/Bigtop+%28v1.3.0%29+Build%2C+Smoketest%2C+and+Deploy+on+Multiple+Physical+Machines
Thanks,
Ganesh
On Tue, May 12, 2020 at 1:26 PM Matt Andruff <ma...@gmail.com> wrote:
> So, looking through this there is not a clear path from "Never worked with
> Bigtop ---> installing BigTop on Ambari"
>
> The README is a great first step, but was totally written by someone that
> already super familiar with BigTop. The Youtube video was a genius idea as
> well and a huge help. (I wished it didn't use a private repo, cause that
> steps seems to be a mystery to me still.)
>
> But I'm totally will to help make the newbie - to - big top installed, if
> you guys can just point me in the right direction.
>
> Where is the right place for the page?
>
>
> https://cwiki.apache.org/confluence/display/BIGTOP/Deployment+and+Integration+Testing
>
> or
>
> https://cwiki.apache.org/confluence/display/BIGTOP/Getting+Started
>
> or Both (under one with a link to it from the other?)
>
> Thanks
>
> Matt
>
> On Tue, May 12, 2020 at 1:16 PM Matt Andruff <ma...@gmail.com>
> wrote:
>
>> Wow thanks a lot!
>>
>> On Tue, May 12, 2020 at 12:17 PM Ganesh Raju <ga...@linaro.org>
>> wrote:
>>
>>> Matt
>>>
>>> Here is the JIRA <https://issues.apache.org/jira/browse/BIGTOP-3211>for
>>> the work done on Bigtop on Ambari mpack. Also BIGTOP-3264
>>> <https://issues.apache.org/jira/browse/BIGTOP-3264>, AMBARI-25366
>>> <https://issues.apache.org/jira/browse/AMBARI-25366>
>>> Here is a helpful youtube <https://www.youtube.com/watch?v=vnyUQtF8ZyM>video
>>> on using Ambari to install Bigtop stack. Here is a talk
>>> <https://www.youtube.com/watch?v=XhC7_IYRPxI>about it as well. And here
>>> is a wiki
>>> <https://github.com/apache/bigtop/pull/555/commits/3b3af11341806567d5edf7a7cfbe20051c074988>page
>>> on instructions.
>>> Yes please, i would appreciate it if you can ask in the Bigtop dev
>>> mailing list and you will get lots of help.
>>>
>>> Univ of Michigan is an example customer who is using Ambari mpack with
>>> Bigtop stack in production.
>>>
>>> Thanks,
>>> Ganesh
>>>
>>> On Tue, May 12, 2020 at 10:57 AM Matt Andruff <ma...@gmail.com>
>>> wrote:
>>>
>>>> thanks,
>>>>
>>>> It may be easier to work with getting big top running on Ambari. I am
>>>> sorry but I thought I went through the site pretty thoroughly. Where did
>>>> you think the big top stack was? Is there something newer than the 0.8 one
>>>> list in the ambari repo? Or should I just push this question to the dev
>>>> list?
>>>>
>>>> On Mon, May 11, 2020 at 12:51 PM Ganesh Raju <ga...@linaro.org>
>>>> wrote:
>>>>
>>>>> Stable version is v1.4. Master is at v1.5
>>>>>
>>>>> releases <https://cwiki.apache.org/confluence/display/BIGTOP/Releases>
>>>>> github <https://github.com/apache/bigtop>
>>>>> mailinglist <https://bigtop.apache.org/mail-lists.html>
>>>>> components
>>>>> <https://cwiki.apache.org/confluence/display/BIGTOP/Bigtop+1.4.0+Release>
>>>>>
>>>>> I would suggest signup for dev mailing list
>>>>> Please ask questions there and I am willing to help with all you need.
>>>>> You are welcome to contribute towards it as well. Bigtop will be happy to
>>>>> add any new component that you think would be important.
>>>>>
>>>>> Thanks,
>>>>> Ganesh
>>>>>
>>>>> On Mon, May 11, 2020 at 10:52 AM Matt Andruff <ma...@gmail.com>
>>>>> wrote:
>>>>>
>>>>>> Can you share the link? I can only see them in the git repo with
>>>>>> bigtop. 0.8 and that's kinda old.
>>>>>>
>>>>>> On Mon, May 11, 2020 at 11:01 AM Ganesh Raju <ga...@linaro.org>
>>>>>> wrote:
>>>>>>
>>>>>>> Yes that's what Bigtop did. BTW, Apache Bigtop already has hadoop
>>>>>>> and 30 other components.
>>>>>>>
>>>>>>> Ganesh
>>>>>>>
>>>>>>> On Mon, May 11, 2020 at 9:56 AM Matt Andruff <ma...@gmail.com>
>>>>>>> wrote:
>>>>>>>
>>>>>>>> I kept digging and I found that ambari supports stacks (that we
>>>>>>>> have all seen before). You can write your own custom stack
>>>>>>>> <https://cwiki.apache.org/confluence/display/AMBARI/Overview#Overview-Structure>
>>>>>>>> meaning you could write the "glue" what apache projects hortonworks had
>>>>>>>> written to roll out a set of services. I guess this is how they got around
>>>>>>>> being open source. I guess I'll start looking into making my own stack
>>>>>>>> from scratch. If anyone already has one or know of one, please let me know.
>>>>>>>>
>>>>>>>> On Mon, May 11, 2020 at 10:41 AM Ganesh Raju <
>>>>>>>> ganesh.raju@linaro.org> wrote:
>>>>>>>>
>>>>>>>>> Apache Bigtop now has mpack and works with Ambari. You could try
>>>>>>>>> that.
>>>>>>>>>
>>>>>>>>> Thanks,
>>>>>>>>> Ganesh
>>>>>>>>>
>>>>>>>>> On Mon, May 11, 2020 at 9:15 AM Matt Andruff <
>>>>>>>>> matt.andruff@gmail.com> wrote:
>>>>>>>>>
>>>>>>>>>> Hey I was just poking around today trying to figure out if ambari
>>>>>>>>>> still works to install a cluster.
>>>>>>>>>>
>>>>>>>>>> I recently was able to install a Cloudera Manager installation.
>>>>>>>>>>
>>>>>>>>>> I was about to start an Ambari installation but when I poke the
>>>>>>>>>> repos they all seem to need a user/password.
>>>>>>>>>>
>>>>>>>>>> Is there a non-hortonworks(cloudera) hadoop that can be still be
>>>>>>>>>> installed with Amabari?
>>>>>>>>>>
>>>>>>>>>> If there is documentation somewhere just let me know, I couldn't
>>>>>>>>>> find the answer googling as Hortonworks(cloudera) docs are all that come up.
>>>>>>>>>>
>>>>>>>>>> --
>>>>>>>>>> Live life
>>>>>>>>>> Laugh Often
>>>>>>>>>>
>>>>>>>>>
>>>>>>>>>
>>>>>>>>> --
>>>>>>>>> IRC: ganeshraju@#linaro on irc.freenode.ne
>>>>>>>>> <http://irc.freenode.net/>t
>>>>>>>>>
>>>>>>>>
>>>>>>>>
>>>>>>>> --
>>>>>>>> Live life
>>>>>>>> Laugh Often
>>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>> --
>>>>>>> IRC: ganeshraju@#linaro on irc.freenode.ne
>>>>>>> <http://irc.freenode.net/>t
>>>>>>>
>>>>>>
>>>>>>
>>>>>> --
>>>>>> Live life
>>>>>> Laugh Often
>>>>>>
>>>>>
>>>>>
>>>>> --
>>>>> IRC: ganeshraju@#linaro on irc.freenode.ne <http://irc.freenode.net/>t
>>>>>
>>>>
>>>>
>>>> --
>>>> Live life
>>>> Laugh Often
>>>>
>>>
>>>
>>> --
>>> IRC: ganeshraju@#linaro on irc.freenode.ne <http://irc.freenode.net/>t
>>>
>>
>>
>> --
>> Live life
>> Laugh Often
>>
>
>
> --
> Live life
> Laugh Often
>
--
IRC: ganeshraju@#linaro on irc.freenode.ne <http://irc.freenode.net/>t