You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@reef.apache.org by sh...@gmail.com on 2015/08/31 06:38:47 UTC
Possible to contribute to REEF-580?
Hi all,
I am interested in contributing to
https://issues.apache.org/jira/browse/REEF-580
Adding a Block Management Service to REEF.
How should I proceed?
Thanks,
Shahan
Re: Possible to contribute to REEF-580?
Posted by Byung-Gon Chun <bg...@gmail.com>.
Hi Shahan,
Thanks!
As Markus mentioned, no worries about the timeline.
I created the issue in the hope that you may be interested in the topic. :)
Thanks.
-Gon
On Mon, Sep 28, 2015 at 7:10 AM, Markus Weimer <ma...@weimo.de> wrote:
> On Fri, Sep 25, 2015 at 7:55 AM, <sh...@gmail.com> wrote:
> > Thanks for suggesting the easy problem. I will be happy to work on it. I
> noticed that you created an issue for it as well. I hope to make progress
> on it over the next week. I hope that is okay since I notice many issues
> are created and completed quickly.
>
> Yes, that seems to be our rhythm. Don't worry about the issue in
> question, though: We treat issue assignment as a reservation system.
> Issues that aren't assigned can be grabbed by anyone. Just leave a
> comment on it to make sure others are aware that you are currently
> looking into it.
>
> Markus
>
--
Byung-Gon Chun
Re: Possible to contribute to REEF-580?
Posted by Markus Weimer <ma...@weimo.de>.
On Fri, Sep 25, 2015 at 7:55 AM, <sh...@gmail.com> wrote:
> Thanks for suggesting the easy problem. I will be happy to work on it. I noticed that you created an issue for it as well. I hope to make progress on it over the next week. I hope that is okay since I notice many issues are created and completed quickly.
Yes, that seems to be our rhythm. Don't worry about the issue in
question, though: We treat issue assignment as a reservation system.
Issues that aren't assigned can be grabbed by anyone. Just leave a
comment on it to make sure others are aware that you are currently
looking into it.
Markus
Re: Possible to contribute to REEF-580?
Posted by sh...@gmail.com.
Hi Gon,
Sorry for the late reply.
Thanks for suggesting the easy problem. I will be happy to work on it. I noticed that you created an issue for it as well. I hope to make progress on it over the next week. I hope that is okay since I notice many issues are created and completed quickly.
Shahan
> On Sep 16, 2015, at 8:43 PM, Byung-Gon Chun <bg...@gmail.com> wrote:
>
> Hi Shahan,
>
> REEF-580 is an open problem, which involves designs we need to agree upon.
>
> If you'd like to start with an easy problem, I suggest a locality-aware
> task scheduler.
> We have TaskScheduler, which launches tasks without considering data
> locality.
> One can improve it to consider data locality to schedule tasks when data's
> stored in HDFS.
> This seems to be a nice extension to the current implementation, and it's a
> feature that our users want.
>
> Thanks.
> -Gon
>
>
>
>> On Tue, Sep 1, 2015 at 10:24 AM, Markus Weimer <ma...@weimo.de> wrote:
>>
>>> On 2015-08-31 09:50, Andrew Chung wrote:
>>> I'm not aware that there is a solid direction for REEF-580 yet, but
>>> Markus and Gon please jump in and correct me if you have something in
>>> mind :).
>>
>> Correct. There is broad consensus that such a feature would be desirable
>> for REEF, but "real" work hasn't started yet. Feel free to leave your
>> thoughts on the JIRA, and we'll take it from there.
>>
>> Markus
>
>
> --
> Byung-Gon Chun
Re: Possible to contribute to REEF-580?
Posted by Byung-Gon Chun <bg...@gmail.com>.
Hi Shahan,
REEF-580 is an open problem, which involves designs we need to agree upon.
If you'd like to start with an easy problem, I suggest a locality-aware
task scheduler.
We have TaskScheduler, which launches tasks without considering data
locality.
One can improve it to consider data locality to schedule tasks when data's
stored in HDFS.
This seems to be a nice extension to the current implementation, and it's a
feature that our users want.
Thanks.
-Gon
On Tue, Sep 1, 2015 at 10:24 AM, Markus Weimer <ma...@weimo.de> wrote:
> On 2015-08-31 09:50, Andrew Chung wrote:
> > I'm not aware that there is a solid direction for REEF-580 yet, but
> > Markus and Gon please jump in and correct me if you have something in
> > mind :).
>
> Correct. There is broad consensus that such a feature would be desirable
> for REEF, but "real" work hasn't started yet. Feel free to leave your
> thoughts on the JIRA, and we'll take it from there.
>
> Markus
>
>
--
Byung-Gon Chun
Re: Possible to contribute to REEF-580?
Posted by Markus Weimer <ma...@weimo.de>.
On 2015-08-31 09:50, Andrew Chung wrote:
> I'm not aware that there is a solid direction for REEF-580 yet, but
> Markus and Gon please jump in and correct me if you have something in
> mind :).
Correct. There is broad consensus that such a feature would be desirable
for REEF, but "real" work hasn't started yet. Feel free to leave your
thoughts on the JIRA, and we'll take it from there.
Markus
Re: Possible to contribute to REEF-580?
Posted by Andrew Chung <af...@gmail.com>.
Hi Shahan,
Welcome!
It's always a good idea to comment on the JIRA item first. If you have a
design in mind, let others who are interested (me included) know about it
before writing any code to make sure there isn't any conflict and efforts
aren't duplicated. I'm not aware that there is a solid direction for
REEF-580 yet, but Markus and Gon please jump in and correct me if you have
something in mind :).
Thanks,
Andrew
On Sun, Aug 30, 2015 at 9:38 PM, <sh...@gmail.com> wrote:
>
> Hi all,
>
> I am interested in contributing to
> https://issues.apache.org/jira/browse/REEF-580
> Adding a Block Management Service to REEF.
>
> How should I proceed?
>
> Thanks,
> Shahan
>
>