You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@systemml.apache.org by Luciano Resende <lu...@gmail.com> on 2015/11/12 14:37:32 UTC
Migrating source code from GitHub
We now have a new empty repo for Apache Systeml that is also mirrored in
GitHub under the Apache Organization :
https://github.com/apache/incubator-systemml
I am planning to start the migration process on the next couple days, which
means :
- current repository will go into read mode
- some folder cleanup/refactoring might be done to have all code from root
folder (instead of system-ml)
- code import into new apache systemml repository
Please let me know if you have questions and/or suggestions.
--
Luciano Resende
http://people.apache.org/~lresende
http://twitter.com/lresende1975
http://lresende.blogspot.com/
Re: Migrating source code from GitHub
Posted by Reynold Xin <rx...@databricks.com>.
Sorry I don't have any extra tips or recipes beyond what you can Google.
On Thu, Nov 12, 2015 at 11:38 AM, Christian R Kadner <ck...@us.ibm.com>
wrote:
> @Luciano, I think Reynold has a good point. In some of my experiments to
> flatten the SystemML folder structure, the new git repo shrank to 33 MB --
> down from 200+ MB currently.
>
> @Reynold, do you have experience with weeding out git repos? If so, could
> you share a script or "recipe" beyond what can be found in the Git book or
> on Stackoverflow?
>
> Best regards,
> Christian Kadner
>
> [image: Inactive hide details for Reynold Xin ---11/12/2015 11:32:39
> AM---I wouldn't normally do this, but if you have a very large cod]Reynold
> Xin ---11/12/2015 11:32:39 AM---I wouldn't normally do this, but if you
> have a very large codebase that filled with binary files in
>
> From: Reynold Xin <rx...@databricks.com>
> To: dev@systemml.incubator.apache.org
> Date: 11/12/2015 11:32 AM
> Subject: Re: Migrating source code from GitHub
> ------------------------------
>
>
>
> I wouldn't normally do this, but if you have a very large codebase that
> filled with binary files in the past, this is your last chance to truncate
> (or remove binary files from) the commit log.
>
> On Thu, Nov 12, 2015 at 11:16 AM, Luciano Resende <lu...@gmail.com>
> wrote:
>
> > Looks like few of you have ongoing changes that are about ready and need
> a
> > day or two to get it into trunk.
> >
> > How about we target this to Monday then ?
> >
> > On Thursday, November 12, 2015, Niketan Pansare <np...@us.ibm.com>
> > wrote:
> >
> > > Hi Luciano,
> > >
> > > Thanks Luciano for taking care of migration.
> > >
> > > Based on Mike's comment, I think it is still unclear whether the
> > > repository will be open today. I too have MLContext related commit
> > (which I
> > > can hold off if necessary). Can you please let us know about the status
> > of
> > > git for today ?
> > >
> > > Thanks,
> > >
> > > Niketan Pansare
> > > IBM Almaden Research Center
> > > Phone (office): (408) 927 1740
> > > E-mail: npansar@us.ibm.com
> > > <javascript:_e(%7B%7D,'cvml','npansar@us.ibm.com');>
> > > http://researcher.watson.ibm.com/researcher/view.php?person=us-npansar
> > >
> > > [image: Inactive hide details for Acs S ---11/12/2015 08:28:01 AM---Can
> > > you pull PR #72 before proceeding with this?Its been ready sinc]Acs S
> > > ---11/12/2015 08:28:01 AM---Can you pull PR #72 before proceeding with
> > > this?Its been ready since last week, apparently there wer
> > >
> > > From: Acs S <ac...@yahoo.com.INVALID>
> > > To: "dev@systemml.incubator.apache.org
> > > <javascript:_e(%7B%7D,'cvml','dev@systemml.incubator.apache.org');>" <
> > > dev@systemml.incubator.apache.org
> > > <javascript:_e(%7B%7D,'cvml','dev@systemml.incubator.apache.org');>>
> > > Date: 11/12/2015 08:28 AM
> > > Subject: Re: Migrating source code from GitHub
> > > ------------------------------
> > >
> > >
> > >
> > > Can you pull PR #72 before proceeding with this?Its been ready since
> last
> > > week, apparently there were some Jenkins issues giving false errors
> > > yesterday or earlier, but seems like Alan could address them.
> > > -Arvind
> > > From: Mike Dusenberry <dusenberrymw@gmail.com
> > > <javascript:_e(%7B%7D,'cvml','dusenberrymw@gmail.com');>>
> > > To: dev@systemml.incubator.apache.org
> > > <javascript:_e(%7B%7D,'cvml','dev@systemml.incubator.apache.org');>
> > > Sent: Thursday, November 12, 2015 6:58 AM
> > > Subject: Re: Migrating source code from GitHub
> > >
> > > Great! Let's leave the current repo open today and make a last call
> for
> > > any PRs the need to be made before the switch. I for one have a PR
> that
> > I
> > > plan to open today that I think will be much easier to review and merge
> > > before all the folder changes take place.
> > >
> > >
> > > - Mike
> > >
> > >
> > >
> > >
> > >
> > >
> > >
> > > --
> > >
> > >
> > >
> > > Michael W. Dusenberry
> > > GitHub: github.com/dusenberrymw
> > >
> > > LinkedIn: linkedin.com/in/mikedusenberry
> > >
> > >
> > >
> > >
> > >
> > >
> > > Sent from my iPhone
> > >
> > >
> > >
> > >
> > >
> > >
> > >
> > >
> > > On Thursday, Nov 12, 2015 at 5:37 AM, Luciano Resende <
> > > luckbr1975@gmail.com
> > > <javascript:_e(%7B%7D,'cvml','luckbr1975@gmail.com');>>, wrote:
> > > We now have a new empty repo for Apache Systeml that is also mirrored
> in
> > >
> > > GitHub under the Apache Organization :
> > >
> > >
> > > https://github.com/apache/incubator-systemml
> > >
> > >
> > > I am planning to start the migration process on the next couple days,
> > which
> > >
> > > means :
> > >
> > >
> > > - current repository will go into read mode
> > >
> > > - some folder cleanup/refactoring might be done to have all code from
> > root
> > >
> > > folder (instead of system-ml)
> > >
> > > - code import into new apache systemml repository
> > >
> > >
> > >
> > > Please let me know if you have questions and/or suggestions.
> > >
> > >
> > > --
> > >
> > > Luciano Resende
> > >
> > > http://people.apache.org/~lresende
> > >
> > > http://twitter.com/lresende1975
> > >
> > > http://lresende.blogspot.com/
> > >
> > >
> > >
> > >
> >
> > --
> > Sent from my Mobile device
> >
>
>
>
>
Re: Migrating source code from GitHub
Posted by Christian R Kadner <ck...@us.ibm.com>.
Hi Luciano,
those were experiments creating a new Git repo from the system-ml folder!
The new repo size of 33 MB I get when using either "git filter-branch
--subdirectory-filter ... system-ml" or "git subtree split ... system-ml"
to create a new repo from the system-ml folder. This approach also looses
all history pre-GitHub, so we are not doing that.
When using "git filter-branch --index-filter 'git ls-files -s |
sed ..." (example from Git book) to move up the system-ml folder contents
to repo root level, then the size of the repo remains at 200+ MB and it
keeps pre-GitHub history.
Best regards,
Christian Kadner
From: Luciano Resende <lu...@gmail.com>
To: "dev@systemml.incubator.apache.org"
<de...@systemml.incubator.apache.org>
Date: 11/12/2015 02:04 PM
Subject: Re: Migrating source code from GitHub
Christian,
Could you please share what you were trying to flatten the folder structure
? I would not expect to have this large reduction in reponsize by setting
up system-ml as root of the repository and moving some of the current root
to inside the new root.
On Thursday, November 12, 2015, Christian R Kadner <ck...@us.ibm.com>
wrote:
> @Luciano, I think Reynold has a good point. In some of my experiments to
> flatten the SystemML folder structure, the new git repo shrank to 33 MB
--
> down from 200+ MB currently.
>
> @Reynold, do you have experience with weeding out git repos? If so, could
> you share a script or "recipe" beyond what can be found in the Git book
or
> on Stackoverflow?
>
> Best regards,
> Christian Kadner
>
> [image: Inactive hide details for Reynold Xin ---11/12/2015 11:32:39
> AM---I wouldn't normally do this, but if you have a very large
cod]Reynold
> Xin ---11/12/2015 11:32:39 AM---I wouldn't normally do this, but if you
> have a very large codebase that filled with binary files in
>
> From: Reynold Xin <rxin@databricks.com
> <javascript:_e(%7B%7D,'cvml','rxin@databricks.com');>>
> To: dev@systemml.incubator.apache.org
> <javascript:_e(%7B%7D,'cvml','dev@systemml.incubator.apache.org');>
> Date: 11/12/2015 11:32 AM
> Subject: Re: Migrating source code from GitHub
> ------------------------------
>
>
>
> I wouldn't normally do this, but if you have a very large codebase that
> filled with binary files in the past, this is your last chance to
truncate
> (or remove binary files from) the commit log.
>
> On Thu, Nov 12, 2015 at 11:16 AM, Luciano Resende <luckbr1975@gmail.com
> <javascript:_e(%7B%7D,'cvml','luckbr1975@gmail.com');>>
> wrote:
>
> > Looks like few of you have ongoing changes that are about ready and
need
> a
> > day or two to get it into trunk.
> >
> > How about we target this to Monday then ?
> >
> > On Thursday, November 12, 2015, Niketan Pansare <npansar@us.ibm.com
> <javascript:_e(%7B%7D,'cvml','npansar@us.ibm.com');>>
> > wrote:
> >
> > > Hi Luciano,
> > >
> > > Thanks Luciano for taking care of migration.
> > >
> > > Based on Mike's comment, I think it is still unclear whether the
> > > repository will be open today. I too have MLContext related commit
> > (which I
> > > can hold off if necessary). Can you please let us know about the
status
> > of
> > > git for today ?
> > >
> > > Thanks,
> > >
> > > Niketan Pansare
> > > IBM Almaden Research Center
> > > Phone (office): (408) 927 1740
> > > E-mail: npansar@us.ibm.com
> <javascript:_e(%7B%7D,'cvml','npansar@us.ibm.com');>
> > > <javascript:_e(%7B%7D,'cvml','npansar@us.ibm.com');>
> > >
http://researcher.watson.ibm.com/researcher/view.php?person=us-npansar
> > >
> > > [image: Inactive hide details for Acs S ---11/12/2015 08:28:01
AM---Can
> > > you pull PR #72 before proceeding with this?Its been ready sinc]Acs S
> > > ---11/12/2015 08:28:01 AM---Can you pull PR #72 before proceeding
with
> > > this?Its been ready since last week, apparently there wer
> > >
> > > From: Acs S <ac...@yahoo.com.INVALID>
> > > To: "dev@systemml.incubator.apache.org
> <javascript:_e(%7B%7D,'cvml','dev@systemml.incubator.apache.org');>
> > > <javascript:_e(%7B%7D,'cvml','dev@systemml.incubator.apache.org');>"
<
> > > dev@systemml.incubator.apache.org
> <javascript:_e(%7B%7D,'cvml','dev@systemml.incubator.apache.org');>
> > > <javascript:_e(%7B%7D,'cvml','dev@systemml.incubator.apache.org');>>
> > > Date: 11/12/2015 08:28 AM
> > > Subject: Re: Migrating source code from GitHub
> > > ------------------------------
> > >
> > >
> > >
> > > Can you pull PR #72 before proceeding with this?Its been ready since
> last
> > > week, apparently there were some Jenkins issues giving false errors
> > > yesterday or earlier, but seems like Alan could address them.
> > > -Arvind
> > > From: Mike Dusenberry <dusenberrymw@gmail.com
> <javascript:_e(%7B%7D,'cvml','dusenberrymw@gmail.com');>
> > > <javascript:_e(%7B%7D,'cvml','dusenberrymw@gmail.com');>>
> > > To: dev@systemml.incubator.apache.org
> <javascript:_e(%7B%7D,'cvml','dev@systemml.incubator.apache.org');>
> > > <javascript:_e(%7B%7D,'cvml','dev@systemml.incubator.apache.org');>
> > > Sent: Thursday, November 12, 2015 6:58 AM
> > > Subject: Re: Migrating source code from GitHub
> > >
> > > Great! Let's leave the current repo open today and make a last call
> for
> > > any PRs the need to be made before the switch. I for one have a PR
> that
> > I
> > > plan to open today that I think will be much easier to review and
merge
> > > before all the folder changes take place.
> > >
> > >
> > > - Mike
> > >
> > >
> > >
> > >
> > >
> > >
> > >
> > > --
> > >
> > >
> > >
> > > Michael W. Dusenberry
> > > GitHub: github.com/dusenberrymw
> > >
> > > LinkedIn: linkedin.com/in/mikedusenberry
> > >
> > >
> > >
> > >
> > >
> > >
> > > Sent from my iPhone
> > >
> > >
> > >
> > >
> > >
> > >
> > >
> > >
> > > On Thursday, Nov 12, 2015 at 5:37 AM, Luciano Resende <
> > > luckbr1975@gmail.com
> <javascript:_e(%7B%7D,'cvml','luckbr1975@gmail.com');>
> > > <javascript:_e(%7B%7D,'cvml','luckbr1975@gmail.com');>>, wrote:
> > > We now have a new empty repo for Apache Systeml that is also mirrored
> in
> > >
> > > GitHub under the Apache Organization :
> > >
> > >
> > > https://github.com/apache/incubator-systemml
> > >
> > >
> > > I am planning to start the migration process on the next couple days,
> > which
> > >
> > > means :
> > >
> > >
> > > - current repository will go into read mode
> > >
> > > - some folder cleanup/refactoring might be done to have all code from
> > root
> > >
> > > folder (instead of system-ml)
> > >
> > > - code import into new apache systemml repository
> > >
> > >
> > >
> > > Please let me know if you have questions and/or suggestions.
> > >
> > >
> > > --
> > >
> > > Luciano Resende
> > >
> > > http://people.apache.org/~lresende
> > >
> > > http://twitter.com/lresende1975
> > >
> > > http://lresende.blogspot.com/
> > >
> > >
> > >
> > >
> >
> > --
> > Sent from my Mobile device
> >
>
>
>
>
--
Sent from my Mobile device
Re: Migrating source code from GitHub
Posted by Luciano Resende <lu...@gmail.com>.
Christian,
Could you please share what you were trying to flatten the folder structure
? I would not expect to have this large reduction in reponsize by setting
up system-ml as root of the repository and moving some of the current root
to inside the new root.
On Thursday, November 12, 2015, Christian R Kadner <ck...@us.ibm.com>
wrote:
> @Luciano, I think Reynold has a good point. In some of my experiments to
> flatten the SystemML folder structure, the new git repo shrank to 33 MB --
> down from 200+ MB currently.
>
> @Reynold, do you have experience with weeding out git repos? If so, could
> you share a script or "recipe" beyond what can be found in the Git book or
> on Stackoverflow?
>
> Best regards,
> Christian Kadner
>
> [image: Inactive hide details for Reynold Xin ---11/12/2015 11:32:39
> AM---I wouldn't normally do this, but if you have a very large cod]Reynold
> Xin ---11/12/2015 11:32:39 AM---I wouldn't normally do this, but if you
> have a very large codebase that filled with binary files in
>
> From: Reynold Xin <rxin@databricks.com
> <javascript:_e(%7B%7D,'cvml','rxin@databricks.com');>>
> To: dev@systemml.incubator.apache.org
> <javascript:_e(%7B%7D,'cvml','dev@systemml.incubator.apache.org');>
> Date: 11/12/2015 11:32 AM
> Subject: Re: Migrating source code from GitHub
> ------------------------------
>
>
>
> I wouldn't normally do this, but if you have a very large codebase that
> filled with binary files in the past, this is your last chance to truncate
> (or remove binary files from) the commit log.
>
> On Thu, Nov 12, 2015 at 11:16 AM, Luciano Resende <luckbr1975@gmail.com
> <javascript:_e(%7B%7D,'cvml','luckbr1975@gmail.com');>>
> wrote:
>
> > Looks like few of you have ongoing changes that are about ready and need
> a
> > day or two to get it into trunk.
> >
> > How about we target this to Monday then ?
> >
> > On Thursday, November 12, 2015, Niketan Pansare <npansar@us.ibm.com
> <javascript:_e(%7B%7D,'cvml','npansar@us.ibm.com');>>
> > wrote:
> >
> > > Hi Luciano,
> > >
> > > Thanks Luciano for taking care of migration.
> > >
> > > Based on Mike's comment, I think it is still unclear whether the
> > > repository will be open today. I too have MLContext related commit
> > (which I
> > > can hold off if necessary). Can you please let us know about the status
> > of
> > > git for today ?
> > >
> > > Thanks,
> > >
> > > Niketan Pansare
> > > IBM Almaden Research Center
> > > Phone (office): (408) 927 1740
> > > E-mail: npansar@us.ibm.com
> <javascript:_e(%7B%7D,'cvml','npansar@us.ibm.com');>
> > > <javascript:_e(%7B%7D,'cvml','npansar@us.ibm.com');>
> > > http://researcher.watson.ibm.com/researcher/view.php?person=us-npansar
> > >
> > > [image: Inactive hide details for Acs S ---11/12/2015 08:28:01 AM---Can
> > > you pull PR #72 before proceeding with this?Its been ready sinc]Acs S
> > > ---11/12/2015 08:28:01 AM---Can you pull PR #72 before proceeding with
> > > this?Its been ready since last week, apparently there wer
> > >
> > > From: Acs S <ac...@yahoo.com.INVALID>
> > > To: "dev@systemml.incubator.apache.org
> <javascript:_e(%7B%7D,'cvml','dev@systemml.incubator.apache.org');>
> > > <javascript:_e(%7B%7D,'cvml','dev@systemml.incubator.apache.org');>" <
> > > dev@systemml.incubator.apache.org
> <javascript:_e(%7B%7D,'cvml','dev@systemml.incubator.apache.org');>
> > > <javascript:_e(%7B%7D,'cvml','dev@systemml.incubator.apache.org');>>
> > > Date: 11/12/2015 08:28 AM
> > > Subject: Re: Migrating source code from GitHub
> > > ------------------------------
> > >
> > >
> > >
> > > Can you pull PR #72 before proceeding with this?Its been ready since
> last
> > > week, apparently there were some Jenkins issues giving false errors
> > > yesterday or earlier, but seems like Alan could address them.
> > > -Arvind
> > > From: Mike Dusenberry <dusenberrymw@gmail.com
> <javascript:_e(%7B%7D,'cvml','dusenberrymw@gmail.com');>
> > > <javascript:_e(%7B%7D,'cvml','dusenberrymw@gmail.com');>>
> > > To: dev@systemml.incubator.apache.org
> <javascript:_e(%7B%7D,'cvml','dev@systemml.incubator.apache.org');>
> > > <javascript:_e(%7B%7D,'cvml','dev@systemml.incubator.apache.org');>
> > > Sent: Thursday, November 12, 2015 6:58 AM
> > > Subject: Re: Migrating source code from GitHub
> > >
> > > Great! Let's leave the current repo open today and make a last call
> for
> > > any PRs the need to be made before the switch. I for one have a PR
> that
> > I
> > > plan to open today that I think will be much easier to review and merge
> > > before all the folder changes take place.
> > >
> > >
> > > - Mike
> > >
> > >
> > >
> > >
> > >
> > >
> > >
> > > --
> > >
> > >
> > >
> > > Michael W. Dusenberry
> > > GitHub: github.com/dusenberrymw
> > >
> > > LinkedIn: linkedin.com/in/mikedusenberry
> > >
> > >
> > >
> > >
> > >
> > >
> > > Sent from my iPhone
> > >
> > >
> > >
> > >
> > >
> > >
> > >
> > >
> > > On Thursday, Nov 12, 2015 at 5:37 AM, Luciano Resende <
> > > luckbr1975@gmail.com
> <javascript:_e(%7B%7D,'cvml','luckbr1975@gmail.com');>
> > > <javascript:_e(%7B%7D,'cvml','luckbr1975@gmail.com');>>, wrote:
> > > We now have a new empty repo for Apache Systeml that is also mirrored
> in
> > >
> > > GitHub under the Apache Organization :
> > >
> > >
> > > https://github.com/apache/incubator-systemml
> > >
> > >
> > > I am planning to start the migration process on the next couple days,
> > which
> > >
> > > means :
> > >
> > >
> > > - current repository will go into read mode
> > >
> > > - some folder cleanup/refactoring might be done to have all code from
> > root
> > >
> > > folder (instead of system-ml)
> > >
> > > - code import into new apache systemml repository
> > >
> > >
> > >
> > > Please let me know if you have questions and/or suggestions.
> > >
> > >
> > > --
> > >
> > > Luciano Resende
> > >
> > > http://people.apache.org/~lresende
> > >
> > > http://twitter.com/lresende1975
> > >
> > > http://lresende.blogspot.com/
> > >
> > >
> > >
> > >
> >
> > --
> > Sent from my Mobile device
> >
>
>
>
>
--
Sent from my Mobile device
Re: Migrating source code from GitHub
Posted by Christian R Kadner <ck...@us.ibm.com>.
@Luciano, I think Reynold has a good point. In some of my experiments to
flatten the SystemML folder structure, the new git repo shrank to 33 MB --
down from 200+ MB currently.
@Reynold, do you have experience with weeding out git repos? If so, could
you share a script or "recipe" beyond what can be found in the Git book or
on Stackoverflow?
Best regards,
Christian Kadner
From: Reynold Xin <rx...@databricks.com>
To: dev@systemml.incubator.apache.org
Date: 11/12/2015 11:32 AM
Subject: Re: Migrating source code from GitHub
I wouldn't normally do this, but if you have a very large codebase that
filled with binary files in the past, this is your last chance to truncate
(or remove binary files from) the commit log.
On Thu, Nov 12, 2015 at 11:16 AM, Luciano Resende <lu...@gmail.com>
wrote:
> Looks like few of you have ongoing changes that are about ready and need
a
> day or two to get it into trunk.
>
> How about we target this to Monday then ?
>
> On Thursday, November 12, 2015, Niketan Pansare <np...@us.ibm.com>
> wrote:
>
> > Hi Luciano,
> >
> > Thanks Luciano for taking care of migration.
> >
> > Based on Mike's comment, I think it is still unclear whether the
> > repository will be open today. I too have MLContext related commit
> (which I
> > can hold off if necessary). Can you please let us know about the status
> of
> > git for today ?
> >
> > Thanks,
> >
> > Niketan Pansare
> > IBM Almaden Research Center
> > Phone (office): (408) 927 1740
> > E-mail: npansar@us.ibm.com
> > <javascript:_e(%7B%7D,'cvml','npansar@us.ibm.com');>
> > http://researcher.watson.ibm.com/researcher/view.php?person=us-npansar
> >
> > [image: Inactive hide details for Acs S ---11/12/2015 08:28:01 AM---Can
> > you pull PR #72 before proceeding with this?Its been ready sinc]Acs S
> > ---11/12/2015 08:28:01 AM---Can you pull PR #72 before proceeding with
> > this?Its been ready since last week, apparently there wer
> >
> > From: Acs S <ac...@yahoo.com.INVALID>
> > To: "dev@systemml.incubator.apache.org
> > <javascript:_e(%7B%7D,'cvml','dev@systemml.incubator.apache.org');>" <
> > dev@systemml.incubator.apache.org
> > <javascript:_e(%7B%7D,'cvml','dev@systemml.incubator.apache.org');>>
> > Date: 11/12/2015 08:28 AM
> > Subject: Re: Migrating source code from GitHub
> > ------------------------------
> >
> >
> >
> > Can you pull PR #72 before proceeding with this?Its been ready since
last
> > week, apparently there were some Jenkins issues giving false errors
> > yesterday or earlier, but seems like Alan could address them.
> > -Arvind
> > From: Mike Dusenberry <dusenberrymw@gmail.com
> > <javascript:_e(%7B%7D,'cvml','dusenberrymw@gmail.com');>>
> > To: dev@systemml.incubator.apache.org
> > <javascript:_e(%7B%7D,'cvml','dev@systemml.incubator.apache.org');>
> > Sent: Thursday, November 12, 2015 6:58 AM
> > Subject: Re: Migrating source code from GitHub
> >
> > Great! Let's leave the current repo open today and make a last call
for
> > any PRs the need to be made before the switch. I for one have a PR
that
> I
> > plan to open today that I think will be much easier to review and merge
> > before all the folder changes take place.
> >
> >
> > - Mike
> >
> >
> >
> >
> >
> >
> >
> > --
> >
> >
> >
> > Michael W. Dusenberry
> > GitHub: github.com/dusenberrymw
> >
> > LinkedIn: linkedin.com/in/mikedusenberry
> >
> >
> >
> >
> >
> >
> > Sent from my iPhone
> >
> >
> >
> >
> >
> >
> >
> >
> > On Thursday, Nov 12, 2015 at 5:37 AM, Luciano Resende <
> > luckbr1975@gmail.com
> > <javascript:_e(%7B%7D,'cvml','luckbr1975@gmail.com');>>, wrote:
> > We now have a new empty repo for Apache Systeml that is also mirrored
in
> >
> > GitHub under the Apache Organization :
> >
> >
> > https://github.com/apache/incubator-systemml
> >
> >
> > I am planning to start the migration process on the next couple days,
> which
> >
> > means :
> >
> >
> > - current repository will go into read mode
> >
> > - some folder cleanup/refactoring might be done to have all code from
> root
> >
> > folder (instead of system-ml)
> >
> > - code import into new apache systemml repository
> >
> >
> >
> > Please let me know if you have questions and/or suggestions.
> >
> >
> > --
> >
> > Luciano Resende
> >
> > http://people.apache.org/~lresende
> >
> > http://twitter.com/lresende1975
> >
> > http://lresende.blogspot.com/
> >
> >
> >
> >
>
> --
> Sent from my Mobile device
>
Re: Migrating source code from GitHub
Posted by Reynold Xin <rx...@databricks.com>.
I wouldn't normally do this, but if you have a very large codebase that
filled with binary files in the past, this is your last chance to truncate
(or remove binary files from) the commit log.
On Thu, Nov 12, 2015 at 11:16 AM, Luciano Resende <lu...@gmail.com>
wrote:
> Looks like few of you have ongoing changes that are about ready and need a
> day or two to get it into trunk.
>
> How about we target this to Monday then ?
>
> On Thursday, November 12, 2015, Niketan Pansare <np...@us.ibm.com>
> wrote:
>
> > Hi Luciano,
> >
> > Thanks Luciano for taking care of migration.
> >
> > Based on Mike's comment, I think it is still unclear whether the
> > repository will be open today. I too have MLContext related commit
> (which I
> > can hold off if necessary). Can you please let us know about the status
> of
> > git for today ?
> >
> > Thanks,
> >
> > Niketan Pansare
> > IBM Almaden Research Center
> > Phone (office): (408) 927 1740
> > E-mail: npansar@us.ibm.com
> > <javascript:_e(%7B%7D,'cvml','npansar@us.ibm.com');>
> > http://researcher.watson.ibm.com/researcher/view.php?person=us-npansar
> >
> > [image: Inactive hide details for Acs S ---11/12/2015 08:28:01 AM---Can
> > you pull PR #72 before proceeding with this?Its been ready sinc]Acs S
> > ---11/12/2015 08:28:01 AM---Can you pull PR #72 before proceeding with
> > this?Its been ready since last week, apparently there wer
> >
> > From: Acs S <ac...@yahoo.com.INVALID>
> > To: "dev@systemml.incubator.apache.org
> > <javascript:_e(%7B%7D,'cvml','dev@systemml.incubator.apache.org');>" <
> > dev@systemml.incubator.apache.org
> > <javascript:_e(%7B%7D,'cvml','dev@systemml.incubator.apache.org');>>
> > Date: 11/12/2015 08:28 AM
> > Subject: Re: Migrating source code from GitHub
> > ------------------------------
> >
> >
> >
> > Can you pull PR #72 before proceeding with this?Its been ready since last
> > week, apparently there were some Jenkins issues giving false errors
> > yesterday or earlier, but seems like Alan could address them.
> > -Arvind
> > From: Mike Dusenberry <dusenberrymw@gmail.com
> > <javascript:_e(%7B%7D,'cvml','dusenberrymw@gmail.com');>>
> > To: dev@systemml.incubator.apache.org
> > <javascript:_e(%7B%7D,'cvml','dev@systemml.incubator.apache.org');>
> > Sent: Thursday, November 12, 2015 6:58 AM
> > Subject: Re: Migrating source code from GitHub
> >
> > Great! Let's leave the current repo open today and make a last call for
> > any PRs the need to be made before the switch. I for one have a PR that
> I
> > plan to open today that I think will be much easier to review and merge
> > before all the folder changes take place.
> >
> >
> > - Mike
> >
> >
> >
> >
> >
> >
> >
> > --
> >
> >
> >
> > Michael W. Dusenberry
> > GitHub: github.com/dusenberrymw
> >
> > LinkedIn: linkedin.com/in/mikedusenberry
> >
> >
> >
> >
> >
> >
> > Sent from my iPhone
> >
> >
> >
> >
> >
> >
> >
> >
> > On Thursday, Nov 12, 2015 at 5:37 AM, Luciano Resende <
> > luckbr1975@gmail.com
> > <javascript:_e(%7B%7D,'cvml','luckbr1975@gmail.com');>>, wrote:
> > We now have a new empty repo for Apache Systeml that is also mirrored in
> >
> > GitHub under the Apache Organization :
> >
> >
> > https://github.com/apache/incubator-systemml
> >
> >
> > I am planning to start the migration process on the next couple days,
> which
> >
> > means :
> >
> >
> > - current repository will go into read mode
> >
> > - some folder cleanup/refactoring might be done to have all code from
> root
> >
> > folder (instead of system-ml)
> >
> > - code import into new apache systemml repository
> >
> >
> >
> > Please let me know if you have questions and/or suggestions.
> >
> >
> > --
> >
> > Luciano Resende
> >
> > http://people.apache.org/~lresende
> >
> > http://twitter.com/lresende1975
> >
> > http://lresende.blogspot.com/
> >
> >
> >
> >
>
> --
> Sent from my Mobile device
>
Re: Migrating source code from GitHub
Posted by Luciano Resende <lu...@gmail.com>.
Looks like few of you have ongoing changes that are about ready and need a
day or two to get it into trunk.
How about we target this to Monday then ?
On Thursday, November 12, 2015, Niketan Pansare <np...@us.ibm.com> wrote:
> Hi Luciano,
>
> Thanks Luciano for taking care of migration.
>
> Based on Mike's comment, I think it is still unclear whether the
> repository will be open today. I too have MLContext related commit (which I
> can hold off if necessary). Can you please let us know about the status of
> git for today ?
>
> Thanks,
>
> Niketan Pansare
> IBM Almaden Research Center
> Phone (office): (408) 927 1740
> E-mail: npansar@us.ibm.com
> <javascript:_e(%7B%7D,'cvml','npansar@us.ibm.com');>
> http://researcher.watson.ibm.com/researcher/view.php?person=us-npansar
>
> [image: Inactive hide details for Acs S ---11/12/2015 08:28:01 AM---Can
> you pull PR #72 before proceeding with this?Its been ready sinc]Acs S
> ---11/12/2015 08:28:01 AM---Can you pull PR #72 before proceeding with
> this?Its been ready since last week, apparently there wer
>
> From: Acs S <ac...@yahoo.com.INVALID>
> To: "dev@systemml.incubator.apache.org
> <javascript:_e(%7B%7D,'cvml','dev@systemml.incubator.apache.org');>" <
> dev@systemml.incubator.apache.org
> <javascript:_e(%7B%7D,'cvml','dev@systemml.incubator.apache.org');>>
> Date: 11/12/2015 08:28 AM
> Subject: Re: Migrating source code from GitHub
> ------------------------------
>
>
>
> Can you pull PR #72 before proceeding with this?Its been ready since last
> week, apparently there were some Jenkins issues giving false errors
> yesterday or earlier, but seems like Alan could address them.
> -Arvind
> From: Mike Dusenberry <dusenberrymw@gmail.com
> <javascript:_e(%7B%7D,'cvml','dusenberrymw@gmail.com');>>
> To: dev@systemml.incubator.apache.org
> <javascript:_e(%7B%7D,'cvml','dev@systemml.incubator.apache.org');>
> Sent: Thursday, November 12, 2015 6:58 AM
> Subject: Re: Migrating source code from GitHub
>
> Great! Let's leave the current repo open today and make a last call for
> any PRs the need to be made before the switch. I for one have a PR that I
> plan to open today that I think will be much easier to review and merge
> before all the folder changes take place.
>
>
> - Mike
>
>
>
>
>
>
>
> --
>
>
>
> Michael W. Dusenberry
> GitHub: github.com/dusenberrymw
>
> LinkedIn: linkedin.com/in/mikedusenberry
>
>
>
>
>
>
> Sent from my iPhone
>
>
>
>
>
>
>
>
> On Thursday, Nov 12, 2015 at 5:37 AM, Luciano Resende <
> luckbr1975@gmail.com
> <javascript:_e(%7B%7D,'cvml','luckbr1975@gmail.com');>>, wrote:
> We now have a new empty repo for Apache Systeml that is also mirrored in
>
> GitHub under the Apache Organization :
>
>
> https://github.com/apache/incubator-systemml
>
>
> I am planning to start the migration process on the next couple days, which
>
> means :
>
>
> - current repository will go into read mode
>
> - some folder cleanup/refactoring might be done to have all code from root
>
> folder (instead of system-ml)
>
> - code import into new apache systemml repository
>
>
>
> Please let me know if you have questions and/or suggestions.
>
>
> --
>
> Luciano Resende
>
> http://people.apache.org/~lresende
>
> http://twitter.com/lresende1975
>
> http://lresende.blogspot.com/
>
>
>
>
--
Sent from my Mobile device
Re: Migrating source code from GitHub
Posted by Niketan Pansare <np...@us.ibm.com>.
Hi Luciano,
Thanks Luciano for taking care of migration.
Based on Mike's comment, I think it is still unclear whether the repository
will be open today. I too have MLContext related commit (which I can hold
off if necessary). Can you please let us know about the status of git for
today ?
Thanks,
Niketan Pansare
IBM Almaden Research Center
Phone (office): (408) 927 1740
E-mail: npansar@us.ibm.com
http://researcher.watson.ibm.com/researcher/view.php?person=us-npansar
From: Acs S <ac...@yahoo.com.INVALID>
To: "dev@systemml.incubator.apache.org"
<de...@systemml.incubator.apache.org>
Date: 11/12/2015 08:28 AM
Subject: Re: Migrating source code from GitHub
Can you pull PR #72 before proceeding with this?Its been ready since last
week, apparently there were some Jenkins issues giving false errors
yesterday or earlier, but seems like Alan could address them.
-Arvind
From: Mike Dusenberry <du...@gmail.com>
To: dev@systemml.incubator.apache.org
Sent: Thursday, November 12, 2015 6:58 AM
Subject: Re: Migrating source code from GitHub
Great! Let's leave the current repo open today and make a last call for
any PRs the need to be made before the switch. I for one have a PR that I
plan to open today that I think will be much easier to review and merge
before all the folder changes take place.
- Mike
--
Michael W. Dusenberry
GitHub: github.com/dusenberrymw
LinkedIn: linkedin.com/in/mikedusenberry
Sent from my iPhone
On Thursday, Nov 12, 2015 at 5:37 AM, Luciano Resende
<lu...@gmail.com>, wrote:
We now have a new empty repo for Apache Systeml that is also mirrored in
GitHub under the Apache Organization :
https://github.com/apache/incubator-systemml
I am planning to start the migration process on the next couple days, which
means :
- current repository will go into read mode
- some folder cleanup/refactoring might be done to have all code from root
folder (instead of system-ml)
- code import into new apache systemml repository
Please let me know if you have questions and/or suggestions.
--
Luciano Resende
http://people.apache.org/~lresende
http://twitter.com/lresende1975
http://lresende.blogspot.com/
Re: Migrating source code from GitHub
Posted by Acs S <ac...@yahoo.com.INVALID>.
Can you pull PR #72 before proceeding with this?Its been ready since last week, apparently there were some Jenkins issues giving false errors yesterday or earlier, but seems like Alan could address them.
-Arvind
From: Mike Dusenberry <du...@gmail.com>
To: dev@systemml.incubator.apache.org
Sent: Thursday, November 12, 2015 6:58 AM
Subject: Re: Migrating source code from GitHub
Great! Let's leave the current repo open today and make a last call for any PRs the need to be made before the switch. I for one have a PR that I plan to open today that I think will be much easier to review and merge before all the folder changes take place.
- Mike
--
Michael W. Dusenberry
GitHub: github.com/dusenberrymw
LinkedIn: linkedin.com/in/mikedusenberry
Sent from my iPhone
On Thursday, Nov 12, 2015 at 5:37 AM, Luciano Resende <lu...@gmail.com>, wrote:
We now have a new empty repo for Apache Systeml that is also mirrored in
GitHub under the Apache Organization :
https://github.com/apache/incubator-systemml
I am planning to start the migration process on the next couple days, which
means :
- current repository will go into read mode
- some folder cleanup/refactoring might be done to have all code from root
folder (instead of system-ml)
- code import into new apache systemml repository
Please let me know if you have questions and/or suggestions.
--
Luciano Resende
http://people.apache.org/~lresende
http://twitter.com/lresende1975
http://lresende.blogspot.com/
Re: Migrating source code from GitHub
Posted by Mike Dusenberry <du...@gmail.com>.
Great! Let's leave the current repo open today and make a last call for any PRs the need to be made before the switch. I for one have a PR that I plan to open today that I think will be much easier to review and merge before all the folder changes take place.
- Mike
--
Michael W. Dusenberry
GitHub: github.com/dusenberrymw
LinkedIn: linkedin.com/in/mikedusenberry
Sent from my iPhone
On Thursday, Nov 12, 2015 at 5:37 AM, Luciano Resende <lu...@gmail.com>, wrote:
We now have a new empty repo for Apache Systeml that is also mirrored in
GitHub under the Apache Organization :
https://github.com/apache/incubator-systemml
I am planning to start the migration process on the next couple days, which
means :
- current repository will go into read mode
- some folder cleanup/refactoring might be done to have all code from root
folder (instead of system-ml)
- code import into new apache systemml repository
Please let me know if you have questions and/or suggestions.
--
Luciano Resende
http://people.apache.org/~lresende
http://twitter.com/lresende1975
http://lresende.blogspot.com/
Re: Migrating source code from GitHub
Posted by Luciano Resende <lu...@gmail.com>.
On Thu, Nov 19, 2015 at 2:33 PM, Reynold Xin <rx...@databricks.com> wrote:
> If you are going to take pull requests as contributions, you should totally
> take this script from Spark for merging:
> https://github.com/apache/spark/blob/master/dev/merge_spark_pr.py
>
> It also keeps linearity in history.
>
>
+1, we were doing this manually in github, but now a script helps us scale.
--
Luciano Resende
http://people.apache.org/~lresende
http://twitter.com/lresende1975
http://lresende.blogspot.com/
Re: Migrating source code from GitHub
Posted by Reynold Xin <rx...@databricks.com>.
If you are going to take pull requests as contributions, you should totally
take this script from Spark for merging:
https://github.com/apache/spark/blob/master/dev/merge_spark_pr.py
It also keeps linearity in history.
On Thu, Nov 19, 2015 at 2:30 PM, Luciano Resende <lu...@gmail.com>
wrote:
> On Mon, Nov 16, 2015 at 2:25 PM, Luciano Resende <lu...@gmail.com>
> wrote:
>
> >
> >
> >
> > On Thu, Nov 12, 2015 at 5:37 AM, Luciano Resende <lu...@gmail.com>
> > wrote:
> >
> >> We now have a new empty repo for Apache Systeml that is also mirrored in
> >> GitHub under the Apache Organization :
> >>
> >> https://github.com/apache/incubator-systemml
> >>
> >> I am planning to start the migration process on the next couple days,
> >> which means :
> >>
> >> - current repository will go into read mode
> >> - some folder cleanup/refactoring might be done to have all code from
> >> root folder (instead of system-ml)
> >> - code import into new apache systemml repository
> >>
> >>
> >> Please let me know if you have questions and/or suggestions.
> >>
> >>
> > GitHub repository has been put in read only mode, and we are starting
> code
> > migration steps now.
> >
>
> The repository is now available at
>
> https://git-wip-us.apache.org/repos/asf?p=incubator-systemml.git
>
> And is also mirrored at
>
> https://github.com/apache/incubator-systemml
>
> --
> Luciano Resende
> http://people.apache.org/~lresende
> http://twitter.com/lresende1975
> http://lresende.blogspot.com/
>
Re: Migrating source code from GitHub
Posted by Luciano Resende <lu...@gmail.com>.
On Mon, Nov 16, 2015 at 2:25 PM, Luciano Resende <lu...@gmail.com>
wrote:
>
>
>
> On Thu, Nov 12, 2015 at 5:37 AM, Luciano Resende <lu...@gmail.com>
> wrote:
>
>> We now have a new empty repo for Apache Systeml that is also mirrored in
>> GitHub under the Apache Organization :
>>
>> https://github.com/apache/incubator-systemml
>>
>> I am planning to start the migration process on the next couple days,
>> which means :
>>
>> - current repository will go into read mode
>> - some folder cleanup/refactoring might be done to have all code from
>> root folder (instead of system-ml)
>> - code import into new apache systemml repository
>>
>>
>> Please let me know if you have questions and/or suggestions.
>>
>>
> GitHub repository has been put in read only mode, and we are starting code
> migration steps now.
>
The repository is now available at
https://git-wip-us.apache.org/repos/asf?p=incubator-systemml.git
And is also mirrored at
https://github.com/apache/incubator-systemml
--
Luciano Resende
http://people.apache.org/~lresende
http://twitter.com/lresende1975
http://lresende.blogspot.com/
Re: Migrating source code from GitHub
Posted by Luciano Resende <lu...@gmail.com>.
On Thu, Nov 12, 2015 at 5:37 AM, Luciano Resende <lu...@gmail.com>
wrote:
> We now have a new empty repo for Apache Systeml that is also mirrored in
> GitHub under the Apache Organization :
>
> https://github.com/apache/incubator-systemml
>
> I am planning to start the migration process on the next couple days,
> which means :
>
> - current repository will go into read mode
> - some folder cleanup/refactoring might be done to have all code from root
> folder (instead of system-ml)
> - code import into new apache systemml repository
>
>
> Please let me know if you have questions and/or suggestions.
>
>
GitHub repository has been put in read only mode, and we are starting code
migration steps now.
--
Luciano Resende
http://people.apache.org/~lresende
http://twitter.com/lresende1975
http://lresende.blogspot.com/