You are viewing a plain text version of this content. The canonical link for it is here.
Posted to mapreduce-user@hadoop.apache.org by Sangjin Lee <sj...@apache.org> on 2015/07/07 00:19:08 UTC
Re: Hadoop YARN Birds of a Feather (BOF) Session at Hadoop Summit San
Jose 2015
I also put up the timeline service next gen (YARN-2928) deck on slideshare:
http://www.slideshare.net/sjlee0/timeline-service-next-gen-yarn2928-yarn-bof
Comments are welcome. Thanks!
On Mon, Jun 8, 2015 at 2:06 PM, Vinod Kumar Vavilapalli <
vinodkv@hortonworks.com> wrote:
> +1
>
> Thanks
> +Vinod
>
> On Jun 4, 2015, at 1:05 PM, Subramaniam V K <subru.vk@gmail.com<mailto:
> subru.vk@gmail.com>> wrote:
>
> Hi Vinod,
>
> Thanks for organizing the BoF meetup.
>
> We have put up an initial proposal @YARN-2915<
> https://issues.apache.org/jira/browse/YARN-2915> on Federating YARN to
> make it elastically scalable. This is critical for us to scale out YARN to
> match the cluster sizes at Microsoft which are already at 10s of 1000s of
> nodes (and growing daily). BoF would be a great venue to discuss our
> proposal in more detail as we are looking for feedback from the larger YARN
> community.
>
> Cheers,
> Subru
>
> On Wed, Jun 3, 2015 at 10:12 AM, Vinod Kumar Vavilapalli <
> vinodkv@apache.org<ma...@apache.org>> wrote:
> Hi all,
>
> We had a blast of a BOF session on Hadoop YARN at last year's Hadoop
> Summit. We had lots of fruitful discussions led by many developers about
> various features, their contributions, it was a great session overall.
>
> I am coordinating this year's BOF as well and garnering topics of
> discussion. A BOF by definition involves on-the-spot non-planned
> discussions, but it doesn't hurt to have a bunch of pre-planned topics for
> starters.
>
> YARN developers/committers, if you are attending, please feel free to send
> me topics that you want to discuss about at the BOF session.
>
> Hadoop users, you are welcome to attend and join the discussion around
> Hadoop YARN. The meetup link is here:
> http://www.meetup.com/Hadoop-Summit-Community-San-Jose/events/222465938/
>
> Thanks all,
> +Vinod
>
>
>
Re: Hadoop YARN Birds of a Feather (BOF) Session at Hadoop Summit San
Jose 2015
Posted by Subramaniam V K <su...@gmail.com>.
Following Sangjin's lead we have also put up the YARN Federation BoF deck
<https://issues.apache.org/jira/secure/attachment/12744547/Federation-BoF.pdf>in
the YARN-2915 JIRA.
One question we were consistently asked was, how will global scheduler
invariants be enforced in a Federated setting. We have been thinking about
it (with inputs from Karthik, Anubhav, Arun Suresh, Wangda, Jian, Zhijie
etc all) & have put up an initial proposal
<https://issues.apache.org/jira/secure/attachment/12744104/FEDERATION_CAPACITY_ALLOCATION_JIRA.pdf>for
the same in the JIRA.
We are looking for feedback from the larger YARN developer community.
Thanks,
Subru
On Mon, Jul 6, 2015 at 3:19 PM, Sangjin Lee <sj...@apache.org> wrote:
> I also put up the timeline service next gen (YARN-2928) deck on slideshare:
>
> http://www.slideshare.net/sjlee0/timeline-service-next-gen-yarn2928-yarn-bof
>
> Comments are welcome. Thanks!
>
> On Mon, Jun 8, 2015 at 2:06 PM, Vinod Kumar Vavilapalli <
> vinodkv@hortonworks.com> wrote:
>
> > +1
> >
> > Thanks
> > +Vinod
> >
> > On Jun 4, 2015, at 1:05 PM, Subramaniam V K <subru.vk@gmail.com<mailto:
> > subru.vk@gmail.com>> wrote:
> >
> > Hi Vinod,
> >
> > Thanks for organizing the BoF meetup.
> >
> > We have put up an initial proposal @YARN-2915<
> > https://issues.apache.org/jira/browse/YARN-2915> on Federating YARN to
> > make it elastically scalable. This is critical for us to scale out YARN
> to
> > match the cluster sizes at Microsoft which are already at 10s of 1000s of
> > nodes (and growing daily). BoF would be a great venue to discuss our
> > proposal in more detail as we are looking for feedback from the larger
> YARN
> > community.
> >
> > Cheers,
> > Subru
> >
> > On Wed, Jun 3, 2015 at 10:12 AM, Vinod Kumar Vavilapalli <
> > vinodkv@apache.org<ma...@apache.org>> wrote:
> > Hi all,
> >
> > We had a blast of a BOF session on Hadoop YARN at last year's Hadoop
> > Summit. We had lots of fruitful discussions led by many developers about
> > various features, their contributions, it was a great session overall.
> >
> > I am coordinating this year's BOF as well and garnering topics of
> > discussion. A BOF by definition involves on-the-spot non-planned
> > discussions, but it doesn't hurt to have a bunch of pre-planned topics
> for
> > starters.
> >
> > YARN developers/committers, if you are attending, please feel free to
> send
> > me topics that you want to discuss about at the BOF session.
> >
> > Hadoop users, you are welcome to attend and join the discussion around
> > Hadoop YARN. The meetup link is here:
> > http://www.meetup.com/Hadoop-Summit-Community-San-Jose/events/222465938/
> >
> > Thanks all,
> > +Vinod
> >
> >
> >
>
Re: Hadoop YARN Birds of a Feather (BOF) Session at Hadoop Summit San
Jose 2015
Posted by Subramaniam V K <su...@gmail.com>.
Following Sangjin's lead we have also put up the YARN Federation BoF deck
<https://issues.apache.org/jira/secure/attachment/12744547/Federation-BoF.pdf>in
the YARN-2915 JIRA.
One question we were consistently asked was, how will global scheduler
invariants be enforced in a Federated setting. We have been thinking about
it (with inputs from Karthik, Anubhav, Arun Suresh, Wangda, Jian, Zhijie
etc all) & have put up an initial proposal
<https://issues.apache.org/jira/secure/attachment/12744104/FEDERATION_CAPACITY_ALLOCATION_JIRA.pdf>for
the same in the JIRA.
We are looking for feedback from the larger YARN developer community.
Thanks,
Subru
On Mon, Jul 6, 2015 at 3:19 PM, Sangjin Lee <sj...@apache.org> wrote:
> I also put up the timeline service next gen (YARN-2928) deck on slideshare:
>
> http://www.slideshare.net/sjlee0/timeline-service-next-gen-yarn2928-yarn-bof
>
> Comments are welcome. Thanks!
>
> On Mon, Jun 8, 2015 at 2:06 PM, Vinod Kumar Vavilapalli <
> vinodkv@hortonworks.com> wrote:
>
> > +1
> >
> > Thanks
> > +Vinod
> >
> > On Jun 4, 2015, at 1:05 PM, Subramaniam V K <subru.vk@gmail.com<mailto:
> > subru.vk@gmail.com>> wrote:
> >
> > Hi Vinod,
> >
> > Thanks for organizing the BoF meetup.
> >
> > We have put up an initial proposal @YARN-2915<
> > https://issues.apache.org/jira/browse/YARN-2915> on Federating YARN to
> > make it elastically scalable. This is critical for us to scale out YARN
> to
> > match the cluster sizes at Microsoft which are already at 10s of 1000s of
> > nodes (and growing daily). BoF would be a great venue to discuss our
> > proposal in more detail as we are looking for feedback from the larger
> YARN
> > community.
> >
> > Cheers,
> > Subru
> >
> > On Wed, Jun 3, 2015 at 10:12 AM, Vinod Kumar Vavilapalli <
> > vinodkv@apache.org<ma...@apache.org>> wrote:
> > Hi all,
> >
> > We had a blast of a BOF session on Hadoop YARN at last year's Hadoop
> > Summit. We had lots of fruitful discussions led by many developers about
> > various features, their contributions, it was a great session overall.
> >
> > I am coordinating this year's BOF as well and garnering topics of
> > discussion. A BOF by definition involves on-the-spot non-planned
> > discussions, but it doesn't hurt to have a bunch of pre-planned topics
> for
> > starters.
> >
> > YARN developers/committers, if you are attending, please feel free to
> send
> > me topics that you want to discuss about at the BOF session.
> >
> > Hadoop users, you are welcome to attend and join the discussion around
> > Hadoop YARN. The meetup link is here:
> > http://www.meetup.com/Hadoop-Summit-Community-San-Jose/events/222465938/
> >
> > Thanks all,
> > +Vinod
> >
> >
> >
>
Re: Hadoop YARN Birds of a Feather (BOF) Session at Hadoop Summit San
Jose 2015
Posted by Subramaniam V K <su...@gmail.com>.
Following Sangjin's lead we have also put up the YARN Federation BoF deck
<https://issues.apache.org/jira/secure/attachment/12744547/Federation-BoF.pdf>in
the YARN-2915 JIRA.
One question we were consistently asked was, how will global scheduler
invariants be enforced in a Federated setting. We have been thinking about
it (with inputs from Karthik, Anubhav, Arun Suresh, Wangda, Jian, Zhijie
etc all) & have put up an initial proposal
<https://issues.apache.org/jira/secure/attachment/12744104/FEDERATION_CAPACITY_ALLOCATION_JIRA.pdf>for
the same in the JIRA.
We are looking for feedback from the larger YARN developer community.
Thanks,
Subru
On Mon, Jul 6, 2015 at 3:19 PM, Sangjin Lee <sj...@apache.org> wrote:
> I also put up the timeline service next gen (YARN-2928) deck on slideshare:
>
> http://www.slideshare.net/sjlee0/timeline-service-next-gen-yarn2928-yarn-bof
>
> Comments are welcome. Thanks!
>
> On Mon, Jun 8, 2015 at 2:06 PM, Vinod Kumar Vavilapalli <
> vinodkv@hortonworks.com> wrote:
>
> > +1
> >
> > Thanks
> > +Vinod
> >
> > On Jun 4, 2015, at 1:05 PM, Subramaniam V K <subru.vk@gmail.com<mailto:
> > subru.vk@gmail.com>> wrote:
> >
> > Hi Vinod,
> >
> > Thanks for organizing the BoF meetup.
> >
> > We have put up an initial proposal @YARN-2915<
> > https://issues.apache.org/jira/browse/YARN-2915> on Federating YARN to
> > make it elastically scalable. This is critical for us to scale out YARN
> to
> > match the cluster sizes at Microsoft which are already at 10s of 1000s of
> > nodes (and growing daily). BoF would be a great venue to discuss our
> > proposal in more detail as we are looking for feedback from the larger
> YARN
> > community.
> >
> > Cheers,
> > Subru
> >
> > On Wed, Jun 3, 2015 at 10:12 AM, Vinod Kumar Vavilapalli <
> > vinodkv@apache.org<ma...@apache.org>> wrote:
> > Hi all,
> >
> > We had a blast of a BOF session on Hadoop YARN at last year's Hadoop
> > Summit. We had lots of fruitful discussions led by many developers about
> > various features, their contributions, it was a great session overall.
> >
> > I am coordinating this year's BOF as well and garnering topics of
> > discussion. A BOF by definition involves on-the-spot non-planned
> > discussions, but it doesn't hurt to have a bunch of pre-planned topics
> for
> > starters.
> >
> > YARN developers/committers, if you are attending, please feel free to
> send
> > me topics that you want to discuss about at the BOF session.
> >
> > Hadoop users, you are welcome to attend and join the discussion around
> > Hadoop YARN. The meetup link is here:
> > http://www.meetup.com/Hadoop-Summit-Community-San-Jose/events/222465938/
> >
> > Thanks all,
> > +Vinod
> >
> >
> >
>
Re: Hadoop YARN Birds of a Feather (BOF) Session at Hadoop Summit San
Jose 2015
Posted by Subramaniam V K <su...@gmail.com>.
Following Sangjin's lead we have also put up the YARN Federation BoF deck
<https://issues.apache.org/jira/secure/attachment/12744547/Federation-BoF.pdf>in
the YARN-2915 JIRA.
One question we were consistently asked was, how will global scheduler
invariants be enforced in a Federated setting. We have been thinking about
it (with inputs from Karthik, Anubhav, Arun Suresh, Wangda, Jian, Zhijie
etc all) & have put up an initial proposal
<https://issues.apache.org/jira/secure/attachment/12744104/FEDERATION_CAPACITY_ALLOCATION_JIRA.pdf>for
the same in the JIRA.
We are looking for feedback from the larger YARN developer community.
Thanks,
Subru
On Mon, Jul 6, 2015 at 3:19 PM, Sangjin Lee <sj...@apache.org> wrote:
> I also put up the timeline service next gen (YARN-2928) deck on slideshare:
>
> http://www.slideshare.net/sjlee0/timeline-service-next-gen-yarn2928-yarn-bof
>
> Comments are welcome. Thanks!
>
> On Mon, Jun 8, 2015 at 2:06 PM, Vinod Kumar Vavilapalli <
> vinodkv@hortonworks.com> wrote:
>
> > +1
> >
> > Thanks
> > +Vinod
> >
> > On Jun 4, 2015, at 1:05 PM, Subramaniam V K <subru.vk@gmail.com<mailto:
> > subru.vk@gmail.com>> wrote:
> >
> > Hi Vinod,
> >
> > Thanks for organizing the BoF meetup.
> >
> > We have put up an initial proposal @YARN-2915<
> > https://issues.apache.org/jira/browse/YARN-2915> on Federating YARN to
> > make it elastically scalable. This is critical for us to scale out YARN
> to
> > match the cluster sizes at Microsoft which are already at 10s of 1000s of
> > nodes (and growing daily). BoF would be a great venue to discuss our
> > proposal in more detail as we are looking for feedback from the larger
> YARN
> > community.
> >
> > Cheers,
> > Subru
> >
> > On Wed, Jun 3, 2015 at 10:12 AM, Vinod Kumar Vavilapalli <
> > vinodkv@apache.org<ma...@apache.org>> wrote:
> > Hi all,
> >
> > We had a blast of a BOF session on Hadoop YARN at last year's Hadoop
> > Summit. We had lots of fruitful discussions led by many developers about
> > various features, their contributions, it was a great session overall.
> >
> > I am coordinating this year's BOF as well and garnering topics of
> > discussion. A BOF by definition involves on-the-spot non-planned
> > discussions, but it doesn't hurt to have a bunch of pre-planned topics
> for
> > starters.
> >
> > YARN developers/committers, if you are attending, please feel free to
> send
> > me topics that you want to discuss about at the BOF session.
> >
> > Hadoop users, you are welcome to attend and join the discussion around
> > Hadoop YARN. The meetup link is here:
> > http://www.meetup.com/Hadoop-Summit-Community-San-Jose/events/222465938/
> >
> > Thanks all,
> > +Vinod
> >
> >
> >
>
Re: Hadoop YARN Birds of a Feather (BOF) Session at Hadoop Summit San
Jose 2015
Posted by Subramaniam V K <su...@gmail.com>.
Following Sangjin's lead we have also put up the YARN Federation BoF deck
<https://issues.apache.org/jira/secure/attachment/12744547/Federation-BoF.pdf>in
the YARN-2915 JIRA.
One question we were consistently asked was, how will global scheduler
invariants be enforced in a Federated setting. We have been thinking about
it (with inputs from Karthik, Anubhav, Arun Suresh, Wangda, Jian, Zhijie
etc all) & have put up an initial proposal
<https://issues.apache.org/jira/secure/attachment/12744104/FEDERATION_CAPACITY_ALLOCATION_JIRA.pdf>for
the same in the JIRA.
We are looking for feedback from the larger YARN developer community.
Thanks,
Subru
On Mon, Jul 6, 2015 at 3:19 PM, Sangjin Lee <sj...@apache.org> wrote:
> I also put up the timeline service next gen (YARN-2928) deck on slideshare:
>
> http://www.slideshare.net/sjlee0/timeline-service-next-gen-yarn2928-yarn-bof
>
> Comments are welcome. Thanks!
>
> On Mon, Jun 8, 2015 at 2:06 PM, Vinod Kumar Vavilapalli <
> vinodkv@hortonworks.com> wrote:
>
> > +1
> >
> > Thanks
> > +Vinod
> >
> > On Jun 4, 2015, at 1:05 PM, Subramaniam V K <subru.vk@gmail.com<mailto:
> > subru.vk@gmail.com>> wrote:
> >
> > Hi Vinod,
> >
> > Thanks for organizing the BoF meetup.
> >
> > We have put up an initial proposal @YARN-2915<
> > https://issues.apache.org/jira/browse/YARN-2915> on Federating YARN to
> > make it elastically scalable. This is critical for us to scale out YARN
> to
> > match the cluster sizes at Microsoft which are already at 10s of 1000s of
> > nodes (and growing daily). BoF would be a great venue to discuss our
> > proposal in more detail as we are looking for feedback from the larger
> YARN
> > community.
> >
> > Cheers,
> > Subru
> >
> > On Wed, Jun 3, 2015 at 10:12 AM, Vinod Kumar Vavilapalli <
> > vinodkv@apache.org<ma...@apache.org>> wrote:
> > Hi all,
> >
> > We had a blast of a BOF session on Hadoop YARN at last year's Hadoop
> > Summit. We had lots of fruitful discussions led by many developers about
> > various features, their contributions, it was a great session overall.
> >
> > I am coordinating this year's BOF as well and garnering topics of
> > discussion. A BOF by definition involves on-the-spot non-planned
> > discussions, but it doesn't hurt to have a bunch of pre-planned topics
> for
> > starters.
> >
> > YARN developers/committers, if you are attending, please feel free to
> send
> > me topics that you want to discuss about at the BOF session.
> >
> > Hadoop users, you are welcome to attend and join the discussion around
> > Hadoop YARN. The meetup link is here:
> > http://www.meetup.com/Hadoop-Summit-Community-San-Jose/events/222465938/
> >
> > Thanks all,
> > +Vinod
> >
> >
> >
>