You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@reef.apache.org by "Dudoladov, Sergey" <se...@tu-berlin.de> on 2016/01/18 12:28:51 UTC
Consider REEF for GSoC 2016.
Hi all,
I feel REEF can apply as a mentoring organization to the Google Summer of Code 2016 (GSoC). In this program, Google pays students to work on open source projects - aka mentoring organizations - over the summer. In between 8th - 19th of February, Google will accept applications from the projects for GSoC 2016.
GSoC guidelines: https://developers.google.com/open-source/gsoc/
ASF projects in GSoC 2015: https://www.google-melange.com/gsoc/org2/google/gsoc2015/apache
A few ideas on potential projects:
1) Checkpoint service for .NET aka REEF-683
2) Driver restart logic for Java aka REEF-582
3) Unified exception policy for .NET similar to REEF-864
4) General bug fixing/TODO triage etc. such as REEF-519 or REEF-1124
Each project needs a mentor to supervise a student.
Best,
Sergey
RE: Consider REEF for GSoC 2016.
Posted by Mariia Mykhailova <ma...@microsoft.com>.
I see ASF participated in GSoC 2015 as organization (http://community.apache.org/gsoc.html)
There should probably be something similar this year, but that page is not updated, and mentors mailing list is not available in archives. I can't find any indication of 2016 GSoC. I guess we can ask - what would be a good mailing list for that?
-Mariia
-----Original Message-----
From: Dudoladov, Sergey [mailto:sergey.dudoladov@tu-berlin.de]
Sent: Thursday, January 28, 2016 12:27 PM
To: dev@reef.apache.org
Subject: Re: Consider REEF for GSoC 2016.
Hi again,
I've just learned that the ASF used to file a GSoC application as an umbrella organization, and then evaluate its GSoC candidate projects internally. We need to clarify if REEF should apply within the ASF or separately.
Best,
Sergey
Re: Consider REEF for GSoC 2016.
Posted by "Dudoladov, Sergey" <se...@tu-berlin.de>.
Hi again,
I've just learned that the ASF used to file a GSoC application as an umbrella organization, and then evaluate its GSoC candidate projects internally. We need to clarify if REEF should apply within the ASF or separately.
Best,
Sergey
RE: Consider REEF for GSoC 2016.
Posted by Mariia Mykhailova <ma...@microsoft.com>.
Looks like JIRA filter is private to only me
You can use
https://issues.apache.org/jira/browse/REEF-1162?jql=project%20%3D%20REEF%20AND%20labels%20%3D%20GSOC
instead, it's open even if not logged in
We'll replace it with wiki page in the final proposal
-Mariia
-----Original Message-----
From: Dudoladov, Sergey [mailto:sergey.dudoladov@tu-berlin.de]
Sent: Thursday, January 28, 2016 4:30 AM
To: dev@reef.apache.org
Subject: Re: Consider REEF for GSoC 2016.
Hey,
Notes on the ideas list:
1) Projects ideas should link to relevant JIRAs.
2) Each idea should probably mention a potential mentor, relative difficulty (e.g. easy, medium, hard), and skills required.
Notes on the proposal:
1) Is the URL for ideas list (aka JIRA filter) private to commiters ? I cannot access it even after JIRA login.
2) Project description can mention that REEF is a top-level Apache project.
Best,
Sergey
Re: Consider REEF for GSoC 2016.
Posted by "Dudoladov, Sergey" <se...@tu-berlin.de>.
Hey,
Notes on the ideas list:
1) Projects ideas should link to relevant JIRAs.
2) Each idea should probably mention a potential mentor, relative difficulty (e.g. easy, medium, hard), and skills required.
Notes on the proposal:
1) Is the URL for ideas list (aka JIRA filter) private to commiters ? I cannot access it even after JIRA login.
2) Project description can mention that REEF is a top-level Apache project.
Best,
Sergey
Re: Consider REEF for GSoC 2016.
Posted by Byung-Gon Chun <bg...@gmail.com>.
I added or updated items in the wiki.
- Long-running application management on REEF
- New language (e.g., Scala, python, C++) binding for Tang
- Wake visualiser for profiling
On Thu, Jan 28, 2016 at 2:56 PM, Byung-Gon Chun <bg...@gmail.com> wrote:
> Thanks, Mariia!
>
> 1. Let's write up the ideas we've discussed in the wiki page:
> https://cwiki.apache.org/confluence/display/REEF/Project+Ideas.
>
> Thanks.
> - Gon
>
>
> On Thu, Jan 28, 2016 at 11:28 AM, Mariia Mykhailova <
> mamykhai@microsoft.com> wrote:
>
>> I've posted a proposal draft to
>> https://cwiki.apache.org/confluence/display/REEF/Google+Summer+of+Code+mentoring+organization+proposal
>>
>> Couple of notes:
>> 1. Google requirements say specifically that a link to bug tracker is not
>> an ideas list.
>> Maybe we should expand
>> https://cwiki.apache.org/confluence/display/REEF/Project+Ideas to
>> include the ideas which we discussed here, with links to JIRAs as
>> "discussion"
>>
>> 2. Compared to other proposals I've seen, we look somewhat unimpressive
>> in terms of mentors list.
>> The recommendation is "Request 1 student slot for every 2 mentors you
>> have." - so right now we qualify for one student
>> Any more volunteers? :-)
>>
>> 3. Need to agree on backup administrator.
>>
>> 4. Please feel free to add to the document, especially in "dealing with
>> issues" and "student encouragement" sections!
>>
>> I'll continue reading on the topic, to check whether we're missing
>> anything
>>
>> -Mariia
>>
>> -----Original Message-----
>> From: Markus Weimer [mailto:markus@weimo.de]
>> Sent: Wednesday, January 27, 2016 3:29 PM
>> To: dev@reef.apache.org
>> Subject: Re: Consider REEF for GSoC 2016.
>>
>> On 2016-01-27 15:08, Byung-Gon Chun wrote:
>> > - Slider on REEF
>>
>> +1 We should coordinate with the slider community, though. I don't think
>> it is in anyone's interest to have an orphaned proof-of-concept at the
>> end of GSoC.
>>
>> > - New language (e.g., Scala, python, C++) binding for Tang
>>
>> +1 Especially if we view it as a stepping stone towards broader language
>> support in REEF as well.
>>
>> Markus
>>
>
>
>
> --
> Byung-Gon Chun
>
--
Byung-Gon Chun
Re: Consider REEF for GSoC 2016.
Posted by Byung-Gon Chun <bg...@gmail.com>.
Thanks, Mariia!
1. Let's write up the ideas we've discussed in the wiki page:
https://cwiki.apache.org/confluence/display/REEF/Project+Ideas.
Thanks.
- Gon
On Thu, Jan 28, 2016 at 11:28 AM, Mariia Mykhailova <ma...@microsoft.com>
wrote:
> I've posted a proposal draft to
> https://cwiki.apache.org/confluence/display/REEF/Google+Summer+of+Code+mentoring+organization+proposal
>
> Couple of notes:
> 1. Google requirements say specifically that a link to bug tracker is not
> an ideas list.
> Maybe we should expand
> https://cwiki.apache.org/confluence/display/REEF/Project+Ideas to include
> the ideas which we discussed here, with links to JIRAs as "discussion"
>
> 2. Compared to other proposals I've seen, we look somewhat unimpressive in
> terms of mentors list.
> The recommendation is "Request 1 student slot for every 2 mentors you
> have." - so right now we qualify for one student
> Any more volunteers? :-)
>
> 3. Need to agree on backup administrator.
>
> 4. Please feel free to add to the document, especially in "dealing with
> issues" and "student encouragement" sections!
>
> I'll continue reading on the topic, to check whether we're missing anything
>
> -Mariia
>
> -----Original Message-----
> From: Markus Weimer [mailto:markus@weimo.de]
> Sent: Wednesday, January 27, 2016 3:29 PM
> To: dev@reef.apache.org
> Subject: Re: Consider REEF for GSoC 2016.
>
> On 2016-01-27 15:08, Byung-Gon Chun wrote:
> > - Slider on REEF
>
> +1 We should coordinate with the slider community, though. I don't think
> it is in anyone's interest to have an orphaned proof-of-concept at the end
> of GSoC.
>
> > - New language (e.g., Scala, python, C++) binding for Tang
>
> +1 Especially if we view it as a stepping stone towards broader language
> support in REEF as well.
>
> Markus
>
--
Byung-Gon Chun
RE: Consider REEF for GSoC 2016.
Posted by Mariia Mykhailova <ma...@microsoft.com>.
I've posted a proposal draft to https://cwiki.apache.org/confluence/display/REEF/Google+Summer+of+Code+mentoring+organization+proposal
Couple of notes:
1. Google requirements say specifically that a link to bug tracker is not an ideas list.
Maybe we should expand https://cwiki.apache.org/confluence/display/REEF/Project+Ideas to include the ideas which we discussed here, with links to JIRAs as "discussion"
2. Compared to other proposals I've seen, we look somewhat unimpressive in terms of mentors list.
The recommendation is "Request 1 student slot for every 2 mentors you have." - so right now we qualify for one student
Any more volunteers? :-)
3. Need to agree on backup administrator.
4. Please feel free to add to the document, especially in "dealing with issues" and "student encouragement" sections!
I'll continue reading on the topic, to check whether we're missing anything
-Mariia
-----Original Message-----
From: Markus Weimer [mailto:markus@weimo.de]
Sent: Wednesday, January 27, 2016 3:29 PM
To: dev@reef.apache.org
Subject: Re: Consider REEF for GSoC 2016.
On 2016-01-27 15:08, Byung-Gon Chun wrote:
> - Slider on REEF
+1 We should coordinate with the slider community, though. I don't think
it is in anyone's interest to have an orphaned proof-of-concept at the end of GSoC.
> - New language (e.g., Scala, python, C++) binding for Tang
+1 Especially if we view it as a stepping stone towards broader language
support in REEF as well.
Markus
Re: Consider REEF for GSoC 2016.
Posted by Markus Weimer <ma...@weimo.de>.
On 2016-01-27 15:08, Byung-Gon Chun wrote:
> - Slider on REEF
+1 We should coordinate with the slider community, though. I don't think
it is in anyone's interest to have an orphaned proof-of-concept at the
end of GSoC.
> - New language (e.g., Scala, python, C++) binding for Tang
+1 Especially if we view it as a stepping stone towards broader language
support in REEF as well.
Markus
Re: Consider REEF for GSoC 2016.
Posted by Byung-Gon Chun <bg...@gmail.com>.
Thanks, Mariia and Markus!
What do you think about the following topics?
- Slider on REEF: Slider is a framework to make it easy to deploy and
manage long-running static applications in a YARN cluster. The focus is
to adapt existing applications such as HBase and Accumulo to run on
YARN with
little modification. This project explores implementing the Slider
functionality on REEF and demonstrates that such a service can be easily
implementable with REEF.
- New language (e.g., Scala, python, C++) binding for Tang: Tang
<https://github.com/Microsoft-CISL/TANG> is the dependency injection
framework for configuring distributed systems developed with REEF. The Tang
APIs give configurations that are strongly typed and easily verified for
correctness. In this project, you will implement a new language binding for
Tang.
On Wed, Jan 27, 2016 at 5:55 AM, Markus Weimer <ma...@weimo.de> wrote:
> I have filled the following JIRAs:
>
> * REEF-1157: Improve memory usage and performance of the Java group
> communications code.
> * REEF-1158: A REEF runtime on VMs provided by [Azure|AWS|Google|...]
> * REEF-1161: Tang visualization tools
> * REEF-1162: Wake visualization and performance analysis tools.
> * REEF-1159: A pluggable web ui for the driver
>
> Markus
>
--
Byung-Gon Chun
Re: Consider REEF for GSoC 2016.
Posted by Markus Weimer <ma...@weimo.de>.
I have filled the following JIRAs:
* REEF-1157: Improve memory usage and performance of the Java group
communications code.
* REEF-1158: A REEF runtime on VMs provided by [Azure|AWS|Google|...]
* REEF-1161: Tang visualization tools
* REEF-1162: Wake visualization and performance analysis tools.
* REEF-1159: A pluggable web ui for the driver
Markus
Re: Consider REEF for GSoC 2016.
Posted by Markus Weimer <ma...@weimo.de>.
On 2016-01-26 10:57, Mariia Mykhailova wrote:
> I've labeled mentioned JIRAs with "GSoC", and created a filter that
> we'll use as an entry point for them:
> https://issues.apache.org/jira/issues/?filter=12334592
Thanks!
> Markus, could you please file JIRAs for ideas you mentioned which
> don't have JIRAs yet? They need more details in description than I
> can provide
Will do. This affects the following items:
* Improve memory usage and performance of the Java group
communications code.
* A REEF runtime on VMs provided by [Azure|AWS|Google|...]
* Tang visualization tools
* Wake visualization and performance analysis tools.
* A pluggable web ui for the driver
I'll respond to this thread once I am done.
Markus
RE: Consider REEF for GSoC 2016.
Posted by Mariia Mykhailova <ma...@microsoft.com>.
I've labeled mentioned JIRAs with "GSoC", and created a filter that we'll use as an entry point for them: https://issues.apache.org/jira/issues/?filter=12334592
Markus, could you please file JIRAs for ideas you mentioned which don't have JIRAs yet? They need more details in description than I can provide
I'll try to write a proposal draft today
-Mariia
-----Original Message-----
From: Byung-Gon Chun [mailto:bgchun@gmail.com]
Sent: Thursday, January 21, 2016 4:57 PM
To: dev@reef.apache.org
Subject: Re: Consider REEF for GSoC 2016.
Mariia,
I'm happy to mentor student(s) as well. I'll also think about additional issues we might want to register.
Thanks.
-Gon
On Fri, Jan 22, 2016 at 9:45 AM, Mariia Mykhailova <ma...@microsoft.com>
wrote:
> I can start a draft, but there are items on the list which are unclear
> to
> me: the ones about mentors selection (Markus and Byung-Gon?), and
> about encouraging students.
>
> Besides, we need to have a list of JIRAs marked for GSoC, so that they
> are all on the same link. Should we just go through the JIRAs
> mentioned in this thread and mark them all?
>
> -Mariia
>
> -----Original Message-----
> From: Markus Weimer [mailto:markus@weimo.de]
> Sent: Thursday, January 21, 2016 12:53 PM
> To: dev@reef.apache.org
> Subject: Re: Consider REEF for GSoC 2016.
>
> We all seem to like the idea of participating in GSoC 2016. Now, we
> should act on that consensus. Any volunteers? I think the first step
> would be to draft a proposal according to the guidelines[0] on our wiki.
>
> Markus
>
> [0]:
>
> https://na01.safelinks.protection.outlook.com/?url=https%3a%2f%2fdevel
> opers.google.com%2fopen-source%2fgsoc%2ffaq%23how_does_a_mentoring_org
> anization_apply&data=01%7c01%7cmamykhai%40microsoft.com%7c53702155368a
> 430e2d3108d322a4e3c4%7c72f988bf86f141af91ab2d7cd011db47%7c1&sdata=ZwTy
> xoKCir9cv1hr%2f7jZgVeB6c6MhZpJnCuvHWAtQOQ%3d
>
--
Byung-Gon Chun
Re: Consider REEF for GSoC 2016.
Posted by Byung-Gon Chun <bg...@gmail.com>.
Mariia,
I'm happy to mentor student(s) as well. I'll also think about additional
issues we might want to register.
Thanks.
-Gon
On Fri, Jan 22, 2016 at 9:45 AM, Mariia Mykhailova <ma...@microsoft.com>
wrote:
> I can start a draft, but there are items on the list which are unclear to
> me: the ones about mentors selection (Markus and Byung-Gon?), and about
> encouraging students.
>
> Besides, we need to have a list of JIRAs marked for GSoC, so that they are
> all on the same link. Should we just go through the JIRAs mentioned in this
> thread and mark them all?
>
> -Mariia
>
> -----Original Message-----
> From: Markus Weimer [mailto:markus@weimo.de]
> Sent: Thursday, January 21, 2016 12:53 PM
> To: dev@reef.apache.org
> Subject: Re: Consider REEF for GSoC 2016.
>
> We all seem to like the idea of participating in GSoC 2016. Now, we should
> act on that consensus. Any volunteers? I think the first step would be to
> draft a proposal according to the guidelines[0] on our wiki.
>
> Markus
>
> [0]:
>
> https://na01.safelinks.protection.outlook.com/?url=https%3a%2f%2fdevelopers.google.com%2fopen-source%2fgsoc%2ffaq%23how_does_a_mentoring_organization_apply&data=01%7c01%7cmamykhai%40microsoft.com%7c53702155368a430e2d3108d322a4e3c4%7c72f988bf86f141af91ab2d7cd011db47%7c1&sdata=ZwTyxoKCir9cv1hr%2f7jZgVeB6c6MhZpJnCuvHWAtQOQ%3d
>
--
Byung-Gon Chun
RE: Consider REEF for GSoC 2016.
Posted by Mariia Mykhailova <ma...@microsoft.com>.
I can start a draft, but there are items on the list which are unclear to me: the ones about mentors selection (Markus and Byung-Gon?), and about encouraging students.
Besides, we need to have a list of JIRAs marked for GSoC, so that they are all on the same link. Should we just go through the JIRAs mentioned in this thread and mark them all?
-Mariia
-----Original Message-----
From: Markus Weimer [mailto:markus@weimo.de]
Sent: Thursday, January 21, 2016 12:53 PM
To: dev@reef.apache.org
Subject: Re: Consider REEF for GSoC 2016.
We all seem to like the idea of participating in GSoC 2016. Now, we should act on that consensus. Any volunteers? I think the first step would be to draft a proposal according to the guidelines[0] on our wiki.
Markus
[0]:
https://na01.safelinks.protection.outlook.com/?url=https%3a%2f%2fdevelopers.google.com%2fopen-source%2fgsoc%2ffaq%23how_does_a_mentoring_organization_apply&data=01%7c01%7cmamykhai%40microsoft.com%7c53702155368a430e2d3108d322a4e3c4%7c72f988bf86f141af91ab2d7cd011db47%7c1&sdata=ZwTyxoKCir9cv1hr%2f7jZgVeB6c6MhZpJnCuvHWAtQOQ%3d
Re: Consider REEF for GSoC 2016.
Posted by Markus Weimer <ma...@weimo.de>.
We all seem to like the idea of participating in GSoC 2016. Now, we
should act on that consensus. Any volunteers? I think the first step
would be to draft a proposal according to the guidelines[0] on our wiki.
Markus
[0]:
https://developers.google.com/open-source/gsoc/faq#how_does_a_mentoring_organization_apply
Re: Consider REEF for GSoC 2016.
Posted by Markus Weimer <ma...@weimo.de>.
+1 as well on the idea.
I'm with Mariia on the JIRAs to be chosen. It would be nice to have some
self-contained piece of work as the project. Also, it would be helpful
for someone in the community to deeply care about the project at hand to
be a dependable mentor.
A couple of them come to my mind:
* Improve memory usage and performance of the Java group
communications code.
* REEF-334: Port REEF.NET to Linux
* REEF-64: Driver discovery API for the client
* A REEF runtime on VMs provided by [Azure|AWS|Google|...]
* Tang visualization tools
* Wake visualization and performance analysis tools.
* A pluggable web ui for the driver
* REEF-222: High performance `Cache`
* REEF-267: Tang / JUnit integration
* REEF-362: Wake over HTTP2
* REEF-683: Checkpointing for REEF.NET
* REEF-751: Cluster configuration
Markus
RE: Consider REEF for GSoC 2016.
Posted by Mariia Mykhailova <ma...@microsoft.com>.
+1, that sounds cool. I even know a Googler who could vouch for us, if we're not impressive enough ourselves :-)
If we want to apply, we probably need to label the JIRAs we select as "GSoC", so that they can be selected in a single list.
I feel REEF-519 or REEF-1124 are not the best choices for GSoC. The issues we select must be attractive for external people (so that students want to choose them).
REEF-519 heavily relies on prior knowledge of the code and asking code owners to triage TODOs they put in, which is not very inspiring for a new person.
REEF-1124 heavily relies on REEF-specific things, and is not trivial even for a person who has an idea what injection is (see discussion in REEF-703).
For an easier thing to do, I would suggest REEF-820 (FxCop adoption), which is standalone, is not very REEF-specific and teaches student tools potentially useful in other projects.
And it has potential to discover real bugs, which is always nice :-)
I could probably mentor this one.
-Mariia
-----Original Message-----
From: Byung-Gon Chun [mailto:bgchun@gmail.com]
Sent: Monday, January 18, 2016 7:31 AM
To: dev@reef.apache.org
Subject: Re: Consider REEF for GSoC 2016.
Hi Sergey,
This sounds great.
GSoC is a great way to expose REEF to students.
Maybe my students can also take advantage of GSoC support. ;-)
Cheers,
Gon
On Mon, Jan 18, 2016 at 8:28 PM, Dudoladov, Sergey < sergey.dudoladov@tu-berlin.de> wrote:
>
> Hi all,
>
> I feel REEF can apply as a mentoring organization to the Google
> Summer of Code 2016 (GSoC). In this program, Google pays students to work on open
> source projects - aka mentoring organizations - over the summer. In
> between 8th - 19th of February, Google will accept applications from
> the projects for GSoC 2016.
>
> GSoC guidelines:
> https://na01.safelinks.protection.outlook.com/?url=https%3a%2f%2fdevel
> opers.google.com%2fopen-source%2fgsoc%2f&data=01%7c01%7cmamykhai%40mic
> rosoft.com%7c2bdf88e7756f41a5704408d3201c76cf%7c72f988bf86f141af91ab2d
> 7cd011db47%7c1&sdata=t0cFc%2fpuZFgf5X6EO4J6VAtF5SukhDyFwX2%2fo0A8dfo%3
> d
> ASF projects in GSoC 2015:
> https://na01.safelinks.protection.outlook.com/?url=https%3a%2f%2fwww.g
> oogle-melange.com%2fgsoc%2forg2%2fgoogle%2fgsoc2015%2fapache&data=01%7
> c01%7cmamykhai%40microsoft.com%7c2bdf88e7756f41a5704408d3201c76cf%7c72
> f988bf86f141af91ab2d7cd011db47%7c1&sdata=KBxRmLyYRkt62T9dF4hbFKF3qNgQT
> SptFuCyaXllDeE%3d
>
> A few ideas on potential projects:
> 1) Checkpoint service for .NET aka REEF-683
> 2) Driver restart logic for Java aka REEF-582
> 3) Unified exception policy for .NET similar to REEF-864
> 4) General bug fixing/TODO triage etc. such as REEF-519 or REEF-1124
>
> Each project needs a mentor to supervise a student.
>
> Best,
> Sergey
--
Byung-Gon Chun
Re: Consider REEF for GSoC 2016.
Posted by Byung-Gon Chun <bg...@gmail.com>.
Hi Sergey,
This sounds great.
GSoC is a great way to expose REEF to students.
Maybe my students can also take advantage of GSoC support. ;-)
Cheers,
Gon
On Mon, Jan 18, 2016 at 8:28 PM, Dudoladov, Sergey <
sergey.dudoladov@tu-berlin.de> wrote:
>
> Hi all,
>
> I feel REEF can apply as a mentoring organization to the Google Summer of
> Code 2016 (GSoC). In this program, Google pays students to work on open
> source projects - aka mentoring organizations - over the summer. In
> between 8th - 19th of February, Google will accept applications from the
> projects for GSoC 2016.
>
> GSoC guidelines: https://developers.google.com/open-source/gsoc/
> ASF projects in GSoC 2015:
> https://www.google-melange.com/gsoc/org2/google/gsoc2015/apache
>
> A few ideas on potential projects:
> 1) Checkpoint service for .NET aka REEF-683
> 2) Driver restart logic for Java aka REEF-582
> 3) Unified exception policy for .NET similar to REEF-864
> 4) General bug fixing/TODO triage etc. such as REEF-519 or REEF-1124
>
> Each project needs a mentor to supervise a student.
>
> Best,
> Sergey
--
Byung-Gon Chun