You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@whirr.apache.org by Doron Tsur <qb...@gmail.com> on 2012/04/24 13:15:15 UTC

Re: GSoC proposal draft, BlobStore Client, Whirr-286.

Hi Guys,

Last night I was informed that I got in to Google Summer of Code as a
student. I was and still am very excited. Right now the community bonding
period is starting. This means that I will be reading up
code/documentation, getting a grip over the system version control being
used and so on. I hope (and intend) to meet excpectation regarding my
project. Please feel free to engage me personally and in the list in any
way or form.  If you have a doc that you want to share or just want to get
to know me.

Wanted to thank Adrian and Andrei for helping out with the proposal and
especially Karel which will be my mentor.

May the design begin! :)

Good Day,
qballer


On Fri, Mar 30, 2012 at 5:18 PM, Adrian Cole <ad...@jclouds.org> wrote:

> you can mention me, sure.
>
> -A
>
> On Thu, Mar 29, 2012 at 2:41 PM, Doron Tsur <qb...@gmail.com> wrote:
> > Thanks Andrei, Karel and Adrian. This is an awesome development.
> > Here is the Apache doc for GSoC this year:
> > http://community.apache.org/gsoc.html
> >
> > Would you mind if I mention your names in the official proposal?  The
> > people in the Org need to see some details, It will help them out.
> > I will not mention any contact details, I assume they have it.
> >
> >
> >
> > On Thu, Mar 29, 2012 at 11:32 PM, Andrei Savu <sa...@gmail.com>
> wrote:
> >
> >> I can also help as much as needed on the way :)
> >>
> >> PS: Karel don't forget to signup as a mentor on [1] and send an email
> for
> >> approval
> >> to codeawards@apache.org (a list you need to subscribe to as a mentor)
> >>
> >> [1] https://www.google-melange.com/gsoc/homepage/google/gsoc2012
> >>
> >> On Thu, Mar 29, 2012 at 10:54 PM, Doron Tsur <qb...@gmail.com> wrote:
> >>
> >> > I excpect to be a lot more indpedent in that phase of the project.
> There
> >> > are also other people in the comunity and they might be able to tip me
> >> here
> >> > and there. We know this in advance so we can prepare, for me it works.
> >> >
> >> > Lets continue the discussion in IRC/mail. what do you say?
> >> >
> >> > On Thu, Mar 29, 2012 at 6:11 PM, Karel Vervaeke <ka...@ngdata.com>
> >> > wrote:et
> >> >
> >> > > Hi, I'll take up mentorship if you 'd like.
> >> > >
> >> > > Just one practical probem: I'm going to be on holiday from July 16
> and
> >> > July
> >> > > 31st.
> >> > > I can't guarantee any level of support between that period.
> >> > > (That's the entire 'Third Patch' phase for your propoasal)
> >> > >
> >> > > Let me know if you're allright with that.
> >> > >
> >> > > Regards,
> >> > > Karel
> >> > >
> >> > > On Thu, Mar 29, 2012 at 4:53 PM, Doron Tsur <qb...@gmail.com>
> wrote:
> >> > >
> >> > > > Thanks for the feedback, I basically tried to draw an outline of
> the
> >> > kind
> >> > > > of project I want to do. Regarding copy between different
> providers,
> >> I
> >> > > > understood that S3 might be able to support something like that.
> It
> >> > could
> >> > > > be that only when using specific providers we will be able to do
> >> that.
> >> > I
> >> > > > believe that detail will be made clear as coding begin. I will
> >> probably
> >> > > go
> >> > > > for what's feasible first.
> >> > > >
> >> > > > The real issue for me right now is finding a mentor, this is a
> must
> >> for
> >> > > the
> >> > > > project. GSoC is usually a great opportunity for the projects and
> >> > > students
> >> > > > involved. So what do you say guys, would one of you be able to
> mentor
> >> > me?
> >> > > >
> >> > > > good day,
> >> > > > qballer
> >> > > >
> >> > > > On Thu, Mar 29, 2012 at 3:09 PM, Karel Vervaeke <karel@ngdata.com
> >
> >> > > wrote:
> >> > > >
> >> > > > > (b) Support copy from BlobStore A to B, hopefully without going
> >> > through
> >> > > > the
> >> > > > > client
> >> > > > > bandwidth (A to client to B is less nice than client request: A
> to
> >> > B).
> >> > > > >
> >> > > > > There are 3 different 'copy' operations that I can imagine:
> >> > > > > - copying to another folder / under a new name in the same
> folder
> >> > > > > - copying to other containers on the same provider
> >> > > > > - copying between providers (e.g. from aws-s3 to walrus)
> >> > > > >
> >> > > > > The first 2 seem doable (I haven't viewed s3 documentation up
> >> close,
> >> > > but
> >> > > > it
> >> > > > > seems reasonable),
> >> > > > > but don't know if there are blobstores with API's for copying
> >> between
> >> > > > > providers.
> >> > > > >
> >> > > > > Other than that, sounds like a fun project.
> >> > > > > Bonus points if you manage to build a 'fake' blobstore (which
> >> > supports
> >> > > a
> >> > > > > subset of operations) which just does parallel scp instead of
> >> > uploading
> >> > > > > files.
> >> > > > > (This is useful in BYON contexts, where people don't have a
> >> blobstore
> >> > > > > available).
> >> > > > >
> >> > > > > Regards,
> >> > > > > Karel
> >> > > > >
> >> > > > > On Mon, Mar 26, 2012 at 11:27 PM, Doron Tsur <qballer@gmail.com
> >
> >> > > wrote:
> >> > > > >
> >> > > > > > It seems as if the mailing list didn't forward my file. Here
> is a
> >> > > link
> >> > > > to
> >> > > > > > the Google doc<
> >> > > > > >
> >> > > > >
> >> > > >
> >> > >
> >> >
> >>
> https://docs.google.com/open?id=0B248KArTz_thT01zbFdSZDhTOUtVOUM3aU85VXJodw
> >> > > > > > >.
> >> > > > > >
> >> > > > > >
> >> > > > > > [non HTML mail clients:
> >> > > > > >
> >> > > > >
> >> > > >
> >> > >
> >> >
> >>
> https://docs.google.com/open?id=0B248KArTz_thT01zbFdSZDhTOUtVOUM3aU85VXJodw
> >> > > > > > ]
> >> > > > > >
> >> > > > > > On Mon, Mar 26, 2012 at 9:33 PM, Doron Tsur <
> qballer@gmail.com>
> >> > > wrote:
> >> > > > > >
> >> > > > > > > HI Guys,
> >> > > > > > >
> >> > > > > > > I've written down a proposal draft. I'm sending this as a
> PDF
> >> to
> >> > > make
> >> > > > > > sure
> >> > > > > > > that most of you can view it not to discourage comments.
> Please
> >> > > feel
> >> > > > > free
> >> > > > > > > to add any insights, I would like to improve my proposal if
> >> > needed.
> >> > > > > > > There is also the issue of finding a Mentor, if any of you
> guys
> >> > > would
> >> > > > > > like
> >> > > > > > > to guide me in this project it would be great talking to
> you.
> >> > > > > > >
> >> > > > > > > Good Day,
> >> > > > > > > qballer
> >> > > > > > >
> >> > > > > > >
> >> > > > > >
> >> > > > >
> >> > > >
> >> > >
> >> >
> >>
>

Re: GSoC proposal draft, BlobStore Client, Whirr-286.

Posted by Adrian Cole <fe...@gmail.com>.
congrats, qballer!  see you in irc.

-A
On Apr 24, 2012 4:15 AM, "Doron Tsur" <qb...@gmail.com> wrote:

> Hi Guys,
>
> Last night I was informed that I got in to Google Summer of Code as a
> student. I was and still am very excited. Right now the community bonding
> period is starting. This means that I will be reading up
> code/documentation, getting a grip over the system version control being
> used and so on. I hope (and intend) to meet excpectation regarding my
> project. Please feel free to engage me personally and in the list in any
> way or form.  If you have a doc that you want to share or just want to get
> to know me.
>
> Wanted to thank Adrian and Andrei for helping out with the proposal and
> especially Karel which will be my mentor.
>
> May the design begin! :)
>
> Good Day,
> qballer
>
>
> On Fri, Mar 30, 2012 at 5:18 PM, Adrian Cole <ad...@jclouds.org> wrote:
>
> > you can mention me, sure.
> >
> > -A
> >
> > On Thu, Mar 29, 2012 at 2:41 PM, Doron Tsur <qb...@gmail.com> wrote:
> > > Thanks Andrei, Karel and Adrian. This is an awesome development.
> > > Here is the Apache doc for GSoC this year:
> > > http://community.apache.org/gsoc.html
> > >
> > > Would you mind if I mention your names in the official proposal?  The
> > > people in the Org need to see some details, It will help them out.
> > > I will not mention any contact details, I assume they have it.
> > >
> > >
> > >
> > > On Thu, Mar 29, 2012 at 11:32 PM, Andrei Savu <sa...@gmail.com>
> > wrote:
> > >
> > >> I can also help as much as needed on the way :)
> > >>
> > >> PS: Karel don't forget to signup as a mentor on [1] and send an email
> > for
> > >> approval
> > >> to codeawards@apache.org (a list you need to subscribe to as a
> mentor)
> > >>
> > >> [1] https://www.google-melange.com/gsoc/homepage/google/gsoc2012
> > >>
> > >> On Thu, Mar 29, 2012 at 10:54 PM, Doron Tsur <qb...@gmail.com>
> wrote:
> > >>
> > >> > I excpect to be a lot more indpedent in that phase of the project.
> > There
> > >> > are also other people in the comunity and they might be able to tip
> me
> > >> here
> > >> > and there. We know this in advance so we can prepare, for me it
> works.
> > >> >
> > >> > Lets continue the discussion in IRC/mail. what do you say?
> > >> >
> > >> > On Thu, Mar 29, 2012 at 6:11 PM, Karel Vervaeke <ka...@ngdata.com>
> > >> > wrote:et
> > >> >
> > >> > > Hi, I'll take up mentorship if you 'd like.
> > >> > >
> > >> > > Just one practical probem: I'm going to be on holiday from July 16
> > and
> > >> > July
> > >> > > 31st.
> > >> > > I can't guarantee any level of support between that period.
> > >> > > (That's the entire 'Third Patch' phase for your propoasal)
> > >> > >
> > >> > > Let me know if you're allright with that.
> > >> > >
> > >> > > Regards,
> > >> > > Karel
> > >> > >
> > >> > > On Thu, Mar 29, 2012 at 4:53 PM, Doron Tsur <qb...@gmail.com>
> > wrote:
> > >> > >
> > >> > > > Thanks for the feedback, I basically tried to draw an outline of
> > the
> > >> > kind
> > >> > > > of project I want to do. Regarding copy between different
> > providers,
> > >> I
> > >> > > > understood that S3 might be able to support something like that.
> > It
> > >> > could
> > >> > > > be that only when using specific providers we will be able to do
> > >> that.
> > >> > I
> > >> > > > believe that detail will be made clear as coding begin. I will
> > >> probably
> > >> > > go
> > >> > > > for what's feasible first.
> > >> > > >
> > >> > > > The real issue for me right now is finding a mentor, this is a
> > must
> > >> for
> > >> > > the
> > >> > > > project. GSoC is usually a great opportunity for the projects
> and
> > >> > > students
> > >> > > > involved. So what do you say guys, would one of you be able to
> > mentor
> > >> > me?
> > >> > > >
> > >> > > > good day,
> > >> > > > qballer
> > >> > > >
> > >> > > > On Thu, Mar 29, 2012 at 3:09 PM, Karel Vervaeke <
> karel@ngdata.com
> > >
> > >> > > wrote:
> > >> > > >
> > >> > > > > (b) Support copy from BlobStore A to B, hopefully without
> going
> > >> > through
> > >> > > > the
> > >> > > > > client
> > >> > > > > bandwidth (A to client to B is less nice than client request:
> A
> > to
> > >> > B).
> > >> > > > >
> > >> > > > > There are 3 different 'copy' operations that I can imagine:
> > >> > > > > - copying to another folder / under a new name in the same
> > folder
> > >> > > > > - copying to other containers on the same provider
> > >> > > > > - copying between providers (e.g. from aws-s3 to walrus)
> > >> > > > >
> > >> > > > > The first 2 seem doable (I haven't viewed s3 documentation up
> > >> close,
> > >> > > but
> > >> > > > it
> > >> > > > > seems reasonable),
> > >> > > > > but don't know if there are blobstores with API's for copying
> > >> between
> > >> > > > > providers.
> > >> > > > >
> > >> > > > > Other than that, sounds like a fun project.
> > >> > > > > Bonus points if you manage to build a 'fake' blobstore (which
> > >> > supports
> > >> > > a
> > >> > > > > subset of operations) which just does parallel scp instead of
> > >> > uploading
> > >> > > > > files.
> > >> > > > > (This is useful in BYON contexts, where people don't have a
> > >> blobstore
> > >> > > > > available).
> > >> > > > >
> > >> > > > > Regards,
> > >> > > > > Karel
> > >> > > > >
> > >> > > > > On Mon, Mar 26, 2012 at 11:27 PM, Doron Tsur <
> qballer@gmail.com
> > >
> > >> > > wrote:
> > >> > > > >
> > >> > > > > > It seems as if the mailing list didn't forward my file. Here
> > is a
> > >> > > link
> > >> > > > to
> > >> > > > > > the Google doc<
> > >> > > > > >
> > >> > > > >
> > >> > > >
> > >> > >
> > >> >
> > >>
> >
> https://docs.google.com/open?id=0B248KArTz_thT01zbFdSZDhTOUtVOUM3aU85VXJodw
> > >> > > > > > >.
> > >> > > > > >
> > >> > > > > >
> > >> > > > > > [non HTML mail clients:
> > >> > > > > >
> > >> > > > >
> > >> > > >
> > >> > >
> > >> >
> > >>
> >
> https://docs.google.com/open?id=0B248KArTz_thT01zbFdSZDhTOUtVOUM3aU85VXJodw
> > >> > > > > > ]
> > >> > > > > >
> > >> > > > > > On Mon, Mar 26, 2012 at 9:33 PM, Doron Tsur <
> > qballer@gmail.com>
> > >> > > wrote:
> > >> > > > > >
> > >> > > > > > > HI Guys,
> > >> > > > > > >
> > >> > > > > > > I've written down a proposal draft. I'm sending this as a
> > PDF
> > >> to
> > >> > > make
> > >> > > > > > sure
> > >> > > > > > > that most of you can view it not to discourage comments.
> > Please
> > >> > > feel
> > >> > > > > free
> > >> > > > > > > to add any insights, I would like to improve my proposal
> if
> > >> > needed.
> > >> > > > > > > There is also the issue of finding a Mentor, if any of you
> > guys
> > >> > > would
> > >> > > > > > like
> > >> > > > > > > to guide me in this project it would be great talking to
> > you.
> > >> > > > > > >
> > >> > > > > > > Good Day,
> > >> > > > > > > qballer
> > >> > > > > > >
> > >> > > > > > >
> > >> > > > > >
> > >> > > > >
> > >> > > >
> > >> > >
> > >> >
> > >>
> >
>