You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@slider.apache.org by Steve Loughran <st...@hortonworks.com> on 2015/11/11 13:54:58 UTC
proposed: google+ hangout
After asking yesterday, there were a few of us interested in having a g+ hangout or similar on Slider topics next week.
Time
For everyone who is interested, what are their available times in their TZ
me: mon &wed, 16:00 GMT to 20:00 GMT; thur 17:00 to GMT
I can also do a morning call for people east of me; say 10:00 GMT+. I'm not good without the first coffee or two
Technology
Google+ hangouts works best if we have the numbers for it, and there's nobody trying to join in from countries which block it. Otherwise, I've got a webex account we can use
Agenda
Open to ideas here. I can talk for 15-20 minutes on anti-affinity
Begin forwarded message:
From: Rohith Sharma K S <ro...@huawei.com>>
Date: 11 November 2015 at 04:20:22 GMT
To: "dev@slider.incubator.apache.org<ma...@slider.incubator.apache.org>" <de...@slider.incubator.apache.org>>
Subject: RE: Concerning Sentry: A disagreement over the Apache Way and graduation
who would be interested in some video conferences next week? Set a date and we can work out an agenda. I'll gladly talk about where I've been going with anti-affinity & even show some of the code
+1, I would like to be part of this discussion for sync up even though I am not actively contributing to SLIDER. :-)
@Stev, let me know the time and date.
Thanks & Regards
Rohith Sharma K S
Re: proposed: google+ hangout
Posted by Steve Loughran <st...@hortonworks.com>.
> On 20 Nov 2015, at 06:42, Rohith Sharma K S <ro...@huawei.com> wrote:
>
> Great to know the summary. I will go through the JIRAs mentioned for more details.
>
> Given the direction, I can spare some time to test affinity feature next week:-)
>
> Thanks & Regards
> Rohith Sharma K S
>
oh, that will be good.
If you want a catch-up session, you and I could do a g+ hangout in a TZ that suited you -you pull down the slider-with-AA code first and bring it up in your IDE, and I can cover some of the details
RE: proposed: google+ hangout
Posted by Rohith Sharma K S <ro...@huawei.com>.
Great to know the summary. I will go through the JIRAs mentioned for more details.
Given the direction, I can spare some time to test affinity feature next week:-)
Thanks & Regards
Rohith Sharma K S
-----Original Message-----
From: Steve Loughran [mailto:stevel@hortonworks.com]
Sent: 19 November 2015 19:14
To: dev@slider.incubator.apache.org
Subject: Re: proposed: google+ hangout
> On 19 Nov 2015, at 05:39, Rohith Sharma K S <ro...@huawei.com> wrote:
>
>
> Hi floks,
>
> I could not able to attend sync meeting:-( Apologies for this.
>
> @Attendees, Would anyone summarize ? And If any recorded audio/video
> of meeting is there, I would love more to listen those discussions
> directly:-)
>
> Thanks & Regards
> Rohith Sharma K S
>
I gave a walkthrough of some of the code; specifically the anti-affine placement, and showed the changes made to AppState and RoleHistory.
you can see the status of that work
https://issues.apache.org/jira/browse/SLIDER-82
I've done the mock & minicluster tests and am doing the functional tests (SLIDER-970).,
I couldn't demo the stuff working on a cluster as SLIDER-993 is stopping me talk to my kerberosed VM cluster; I did just demo that in the minicluster you dont' get as many workers as you want, as there's only one host to deploy on. The AA placement code will leave the number of containers below desired rather than compromise the anti-affinity requirements. I've also got the web UI showing this and adding some explanations, Look at https://issues.apache.org/jira/browse/SLIDER-979 if you want screen shots.
Thomas Weise came in with some of his experience, especially fair scheduler placement problems. YARN-1412, relating to when that scheduler relaxes its placement. Thomas? Remember how I said that it didn't matter as we never set relaxLocality==true? It turns out that I do that when escalating placements —after the non-relaxed placement has failed. I don't think YARN-1412 will matter then, as that request is only issued if the relax=false request wasn't satisfied after its time limit.
Anyway, if i do get some functional test working (one designed to scale), then I'll merge the stuff in at the weekend. At that point the code will be ready to play with —and I do need people to play with it.
That initial release will be :
-check out and build yourself (no ASF packaged release &vote) -wont use the history of previous placements before starting the AA placement sequence. I've focused on the core AA code first
Re: proposed: google+ hangout
Posted by Steve Loughran <st...@hortonworks.com>.
> On 19 Nov 2015, at 05:39, Rohith Sharma K S <ro...@huawei.com> wrote:
>
>
> Hi floks,
>
> I could not able to attend sync meeting:-( Apologies for this.
>
> @Attendees, Would anyone summarize ? And If any recorded audio/video of meeting is there, I would love more to listen those discussions directly:-)
>
> Thanks & Regards
> Rohith Sharma K S
>
I gave a walkthrough of some of the code; specifically the anti-affine placement, and showed the changes made to AppState and RoleHistory.
you can see the status of that work
https://issues.apache.org/jira/browse/SLIDER-82
I've done the mock & minicluster tests and am doing the functional tests (SLIDER-970).,
I couldn't demo the stuff working on a cluster as SLIDER-993 is stopping me talk to my kerberosed VM cluster; I did just demo that in the minicluster you dont' get as many workers as you want, as there's only one host to deploy on. The AA placement code will leave the number of containers below desired rather than compromise the anti-affinity requirements. I've also got the web UI showing this and adding some explanations, Look at https://issues.apache.org/jira/browse/SLIDER-979 if you want screen shots.
Thomas Weise came in with some of his experience, especially fair scheduler placement problems. YARN-1412, relating to when that scheduler relaxes its placement. Thomas? Remember how I said that it didn't matter as we never set relaxLocality==true? It turns out that I do that when escalating placements —after the non-relaxed placement has failed. I don't think YARN-1412 will matter then, as that request is only issued if the relax=false request wasn't satisfied after its time limit.
Anyway, if i do get some functional test working (one designed to scale), then I'll merge the stuff in at the weekend. At that point the code will be ready to play with —and I do need people to play with it.
That initial release will be :
-check out and build yourself (no ASF packaged release &vote)
-wont use the history of previous placements before starting the AA placement sequence. I've focused on the core AA code first
RE: proposed: google+ hangout
Posted by Rohith Sharma K S <ro...@huawei.com>.
Hi floks,
I could not able to attend sync meeting:-( Apologies for this.
@Attendees, Would anyone summarize ? And If any recorded audio/video of meeting is there, I would love more to listen those discussions directly:-)
Thanks & Regards
Rohith Sharma K S
-----Original Message-----
From: Steve Loughran [mailto:stevel@hortonworks.com]
Sent: 14 November 2015 20:02
To: dev@slider.incubator.apache.org
Subject: Re: proposed: google+ hangout
> On 11 Nov 2015, at 13:09, Jon Maron <jm...@hortonworks.com> wrote:
>
>
>> On Nov 11, 2015, at 7:54 AM, Steve Loughran <st...@hortonworks.com> wrote:
>>
>>
>> After asking yesterday, there were a few of us interested in having a g+ hangout or similar on Slider topics next week.
>>
>> Time
>>
>> For everyone who is interested, what are their available times in their TZ
>>
>> me: mon &wed, 16:00 GMT to 20:00 GMT; thur 17:00 to GMT
>
> In those slots, I can do:
>
> Mon: 18:30 GMT - 20:00 GMT
> Wed: 17:00 GMT - 20:00 GMT
> Thu: 17:00 GMT
Let's make it wednesday, 19:00 GMT puts it in at, what, 11:00 PST
I'll invite some colleagues who want to use the AA code too
webex room: https://hortonworks.webex.com/meet/stevel
Re: proposed: google+ hangout
Posted by Steve Loughran <st...@hortonworks.com>.
> On 11 Nov 2015, at 13:09, Jon Maron <jm...@hortonworks.com> wrote:
>
>
>> On Nov 11, 2015, at 7:54 AM, Steve Loughran <st...@hortonworks.com> wrote:
>>
>>
>> After asking yesterday, there were a few of us interested in having a g+ hangout or similar on Slider topics next week.
>>
>> Time
>>
>> For everyone who is interested, what are their available times in their TZ
>>
>> me: mon &wed, 16:00 GMT to 20:00 GMT; thur 17:00 to GMT
>
> In those slots, I can do:
>
> Mon: 18:30 GMT - 20:00 GMT
> Wed: 17:00 GMT - 20:00 GMT
> Thu: 17:00 GMT
Let's make it wednesday, 19:00 GMT puts it in at, what, 11:00 PST
I'll invite some colleagues who want to use the AA code too
webex room: https://hortonworks.webex.com/meet/stevel
Re: proposed: google+ hangout
Posted by Jon Maron <jm...@hortonworks.com>.
> On Nov 11, 2015, at 7:54 AM, Steve Loughran <st...@hortonworks.com> wrote:
>
>
> After asking yesterday, there were a few of us interested in having a g+ hangout or similar on Slider topics next week.
>
> Time
>
> For everyone who is interested, what are their available times in their TZ
>
> me: mon &wed, 16:00 GMT to 20:00 GMT; thur 17:00 to GMT
In those slots, I can do:
Mon: 18:30 GMT - 20:00 GMT
Wed: 17:00 GMT - 20:00 GMT
Thu: 17:00 GMT
>
> I can also do a morning call for people east of me; say 10:00 GMT+. I'm not good without the first coffee or two
>
> Technology
>
> Google+ hangouts works best if we have the numbers for it, and there's nobody trying to join in from countries which block it. Otherwise, I've got a webex account we can use
>
> Agenda
>
> Open to ideas here. I can talk for 15-20 minutes on anti-affinity
>
>
> Begin forwarded message:
>
> From: Rohith Sharma K S <ro...@huawei.com>>
> Date: 11 November 2015 at 04:20:22 GMT
> To: "dev@slider.incubator.apache.org<ma...@slider.incubator.apache.org>" <de...@slider.incubator.apache.org>>
> Subject: RE: Concerning Sentry: A disagreement over the Apache Way and graduation
>
> who would be interested in some video conferences next week? Set a date and we can work out an agenda. I'll gladly talk about where I've been going with anti-affinity & even show some of the code
> +1, I would like to be part of this discussion for sync up even though I am not actively contributing to SLIDER. :-)
>
> @Stev, let me know the time and date.
>
> Thanks & Regards
> Rohith Sharma K S
>