You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@slider.apache.org by Steve Loughran <st...@hortonworks.com> on 2014/11/12 15:05:29 UTC
Hadoop 2.6.0 being voted on on hadoop common-dev list, what do we
need in Hadoop 2.7?
Hadoop 2.6.0 is being voted on in the common-dev list...everyone is
encouraged to download it and play with it, make a vote. Everyone's
opinions matter.
Now, what do we want in Hadoop 2.7?
off the top of my head
- finish the registry stuff, including REST API
- full support of REST APIs in YARN apps with AM Filter and RM Proxy
supporting other verbs
- some other things under YARN-896
if we can think of some more I can put them in a slider "update to hadoop
2.7" JIRA.
BTW, Hadoop 2.7 is Java7+ only
--
CONFIDENTIALITY NOTICE
NOTICE: This message is intended for the use of the individual or entity to
which it is addressed and may contain information that is confidential,
privileged and exempt from disclosure under applicable law. If the reader
of this message is not the intended recipient, you are hereby notified that
any printing, copying, dissemination, distribution, disclosure or
forwarding of this communication is strictly prohibited. If you have
received this communication in error, please contact the sender immediately
and delete it from your system. Thank You.
Re: Hadoop 2.6.0 being voted on on hadoop common-dev list, what do we need in Hadoop 2.7?
Posted by Jon Maron <jm...@hortonworks.com>.
Security wise - perhaps the ability to actually wire encrypt AM traffic (i.e AM HTTPS support). Will require management of AM specific keystones, RM/AM trust establishment, etc (YARN-2554)
— Jon
On Nov 12, 2014, at 9:37 AM, Sumit Mohanty <su...@gmail.com> wrote:
> Java7 is good news.
>
> Lets go through other open issues and feature that we have in SLIDER jiras
> and see if any of then are better addressed in Hadoop. Anti-affinity (the
> YARN jira exists), application instance specific vmem, pmem checks such as
> if an app is using label then it has the hosts to itself anyway.
>
> On Wed, Nov 12, 2014 at 6:05 AM, Steve Loughran <st...@hortonworks.com>
> wrote:
>
>> Hadoop 2.6.0 is being voted on in the common-dev list...everyone is
>> encouraged to download it and play with it, make a vote. Everyone's
>> opinions matter.
>>
>> Now, what do we want in Hadoop 2.7?
>>
>> off the top of my head
>>
>> - finish the registry stuff, including REST API
>> - full support of REST APIs in YARN apps with AM Filter and RM Proxy
>> supporting other verbs
>> - some other things under YARN-896
>>
>> if we can think of some more I can put them in a slider "update to hadoop
>> 2.7" JIRA.
>>
>> BTW, Hadoop 2.7 is Java7+ only
>>
>> --
>> CONFIDENTIALITY NOTICE
>> NOTICE: This message is intended for the use of the individual or entity to
>> which it is addressed and may contain information that is confidential,
>> privileged and exempt from disclosure under applicable law. If the reader
>> of this message is not the intended recipient, you are hereby notified that
>> any printing, copying, dissemination, distribution, disclosure or
>> forwarding of this communication is strictly prohibited. If you have
>> received this communication in error, please contact the sender immediately
>> and delete it from your system. Thank You.
>>
>
>
>
> --
> thanks
> Sumit
--
CONFIDENTIALITY NOTICE
NOTICE: This message is intended for the use of the individual or entity to
which it is addressed and may contain information that is confidential,
privileged and exempt from disclosure under applicable law. If the reader
of this message is not the intended recipient, you are hereby notified that
any printing, copying, dissemination, distribution, disclosure or
forwarding of this communication is strictly prohibited. If you have
received this communication in error, please contact the sender immediately
and delete it from your system. Thank You.
Re: Hadoop 2.6.0 being voted on on hadoop common-dev list, what do we
need in Hadoop 2.7?
Posted by Sumit Mohanty <su...@gmail.com>.
Java7 is good news.
Lets go through other open issues and feature that we have in SLIDER jiras
and see if any of then are better addressed in Hadoop. Anti-affinity (the
YARN jira exists), application instance specific vmem, pmem checks such as
if an app is using label then it has the hosts to itself anyway.
On Wed, Nov 12, 2014 at 6:05 AM, Steve Loughran <st...@hortonworks.com>
wrote:
> Hadoop 2.6.0 is being voted on in the common-dev list...everyone is
> encouraged to download it and play with it, make a vote. Everyone's
> opinions matter.
>
> Now, what do we want in Hadoop 2.7?
>
> off the top of my head
>
> - finish the registry stuff, including REST API
> - full support of REST APIs in YARN apps with AM Filter and RM Proxy
> supporting other verbs
> - some other things under YARN-896
>
> if we can think of some more I can put them in a slider "update to hadoop
> 2.7" JIRA.
>
> BTW, Hadoop 2.7 is Java7+ only
>
> --
> CONFIDENTIALITY NOTICE
> NOTICE: This message is intended for the use of the individual or entity to
> which it is addressed and may contain information that is confidential,
> privileged and exempt from disclosure under applicable law. If the reader
> of this message is not the intended recipient, you are hereby notified that
> any printing, copying, dissemination, distribution, disclosure or
> forwarding of this communication is strictly prohibited. If you have
> received this communication in error, please contact the sender immediately
> and delete it from your system. Thank You.
>
--
thanks
Sumit