You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@mesos.apache.org by Dima Fadeyev <li...@gmail.com> on 2016/12/20 16:01:49 UTC

Could mesos be a replacement for yarn?

Hello, everyone,

Is it possible to run software from hadoop ecosystem on mesos? Do these
work: Hive, Oozie, Sqoop, MRv2, Pig?

Thanks in advance and best regards

Re: Could mesos be a replacement for yarn?

Posted by Darin Johnson <db...@gmail.com>.
I'll echo Klaus's sentiment.  There was an old hadoop framework at
github.com/mesos/hadoop which is unmaintained.  Myriad
github.com/apache/incubator-myriad is in incubator but needs a significant
effort in terms of stability and documentation, though I've tested Tez,
Flink, Spark and MapReduce with it.  You're best bet would probably be to
run Yarn in Marathon, though you'd have to be careful with allocation of
ports or use an ip per container solution.

Good luck.

On Tue, Dec 20, 2016 at 8:27 PM, Klaus Ma <kl...@gmail.com> wrote:

> I don-t think so :(. There's Apache incubator project, named Myriad, can
> run YARN on Mesos, but it's far away from production.
>
> On Wed, Dec 21, 2016 at 12:01 AM Dima Fadeyev <li...@gmail.com>
> wrote:
>
>> Hello, everyone,
>>
>> Is it possible to run software from hadoop ecosystem on mesos? Do these
>> work: Hive, Oozie, Sqoop, MRv2, Pig?
>>
>> Thanks in advance and best regards
>>
> --
>
> Regards,
> ----
> Da (Klaus), Ma (马达), PMP® | Software Architect
> IBM Platform Development & Support, STG, IBM GCG
> +86-10-8245 4084 <+86%2010%208245%204084> | madaxa@cn.ibm.com |
> http://k82.me
>

Re: Could mesos be a replacement for yarn?

Posted by Klaus Ma <kl...@gmail.com>.
I don-t think so :(. There's Apache incubator project, named Myriad, can
run YARN on Mesos, but it's far away from production.

On Wed, Dec 21, 2016 at 12:01 AM Dima Fadeyev <li...@gmail.com> wrote:

> Hello, everyone,
>
> Is it possible to run software from hadoop ecosystem on mesos? Do these
> work: Hive, Oozie, Sqoop, MRv2, Pig?
>
> Thanks in advance and best regards
>
-- 

Regards,
----
Da (Klaus), Ma (马达), PMP® | Software Architect
IBM Platform Development & Support, STG, IBM GCG
+86-10-8245 4084 | madaxa@cn.ibm.com | http://k82.me