You are viewing a plain text version of this content. The canonical link for it is here.
Posted to users@subversion.apache.org by Rajnish Kumar Singh <Ra...@kpitcummins.com> on 2011/01/30 08:54:08 UTC

FW: Permanent deleting the deleted files.

Hi All,

I am working on a  repository in SVN.
As this repository is quite old, its size has gone to 65GB.
There were many files that was deleted. According to me SVN doesn't allow permanent delete.
So all those deleted file would be stored in the back end as a revision.

I can view the names of the deleted files from the log.
So is there any way to permanently get rid of deleted files, as this will reduce my server space issue also.
Is there any commands that I can run on the server to get the list of all deleted items and to permanently delete them.

Any help will be appreciated.
Regards,
Rajnish K Singh


RE: Permanent deleting the deleted files.

Posted by "Echlin, Jamie" <ja...@credit-suisse.com>.
> Where "thread" is a link to
> http://svn.haxx.se/dev/archive-2010-08/0456.shtml

Thanks Stefan. I had actually read all that ;-) I just thought because
the talk was listed as it was perhaps Wandisco had managed to get this
feature in. It's not even a feature that I am that desparate for, in
comparison with branching/merging improvements anyway!


=============================================================================== 
Please access the attached hyperlink for an important electronic communications disclaimer: 
http://www.credit-suisse.com/legal/en/disclaimer_email_ib.html 
=============================================================================== 


Re: Permanent deleting the deleted files.

Posted by Stefan Sperling <st...@elego.de>.
On Mon, Jan 31, 2011 at 10:17:08AM -0000, Echlin, Jamie wrote:
> > It is listed as "unscheduled", meaning it is not slated to 
> > appear in any particular version of Subversion at this time. 
> > 1.7 is already full of WC-NG so I would expect the devs to 
> > want to move any other major changes to the next version.
> 
> Indeed, hence my question to the list. And yes, the conference is
> sponsored by Wandisco, and so I am somewhat wary.
> 
> It would be perfectly legitimate to only discuss progress of this
> feature, and maybe that's what this talk is about. However because the
> conference's headline is "World Premiere of Subversion 1.7", and because
> the talk summary is "During this session, Mr. Foad will discuss
> Obliterate, a new feature designed to cleanly remove obsolete files and
> other data from Subversion repositories" the implication is that this is
> in 1.7. If not then fair enough, but maybe this could be clearer.

There were plans to implement parts of this feature for 1.7.
But because of technical difficulties work on this feature has
been suspended for now. It won't be on 1.7.

See http://subversion.apache.org/roadmap.html for the authoritative
source on such matters. The release status section lists all the
items planned for 1.7. It says:

 The obliterate feature work made only extremely minimal progress,
 and does not carry enough practical usefulness to warrant release.
 See this thread for discussion.

Where "thread" is a link to
http://svn.haxx.se/dev/archive-2010-08/0456.shtml

Stefan

RE: Permanent deleting the deleted files.

Posted by "Echlin, Jamie" <ja...@credit-suisse.com>.
> It is listed as "unscheduled", meaning it is not slated to 
> appear in any particular version of Subversion at this time. 
> 1.7 is already full of WC-NG so I would expect the devs to 
> want to move any other major changes to the next version.

Indeed, hence my question to the list. And yes, the conference is
sponsored by Wandisco, and so I am somewhat wary.

It would be perfectly legitimate to only discuss progress of this
feature, and maybe that's what this talk is about. However because the
conference's headline is "World Premiere of Subversion 1.7", and because
the talk summary is "During this session, Mr. Foad will discuss
Obliterate, a new feature designed to cleanly remove obsolete files and
other data from Subversion repositories" the implication is that this is
in 1.7. If not then fair enough, but maybe this could be clearer.

Cheers, jamie

=============================================================================== 
Please access the attached hyperlink for an important electronic communications disclaimer: 
http://www.credit-suisse.com/legal/en/disclaimer_email_ib.html 
=============================================================================== 


Re: Permanent deleting the deleted files.

Posted by Ryan Schmidt <su...@ryandesign.com>.
On Jan 31, 2011, at 03:33, Echlin, Jamie wrote:

>> What you're looking for is an "obliterate" function. That's 
>> been discussed a number of times in the past, and never been 
>> successfully pursuied. 
> 
> The last update I've seen about the obliterate feature imply that it's
> been abandoned for the medium-term:
> http://svn.haxx.se/dev/archive-2010-08/0457.shtml

According to that message, because work on WC-NG was more important for 1.7. But I haven't been following the dev list so I don't know what else was said.


> Yet Julian Foad appears to be doing a talk about just this feature in
> 1.7 at "Subversion Live" -
> http://www.wandisco.com/events/subversionlive2011/agenda.

Julian Foad is, I believe, an employee of WANdisco, the company that seems to be behind that event, and which recently announced their intention to implement various long-outstanding feature requests and bug fixes in Subversion. Perhaps the talk is about their continued desire to implement obliterate, or perhaps some renewed successes at doing so.

https://blogs.apache.org/foundation/entry/apache_subversion_to_wandisco_1


> So, will it be in 1.7?

This is the ticket for the obliterate feature request:

http://subversion.tigris.org/issues/show_bug.cgi?id=516

It is listed as "unscheduled", meaning it is not slated to appear in any particular version of Subversion at this time. 1.7 is already full of WC-NG so I would expect the devs to want to move any other major changes to the next version.

There also have not been any comments in that issue since 2009; if someone were working on implementing it, I'd hope the ticket would so indicate.





RE: Permanent deleting the deleted files.

Posted by "Echlin, Jamie" <ja...@credit-suisse.com>.
> What you're looking for is an "obliterate" function. That's 
> been discussed a number of times in the past, and never been 
> successfully pursuied. 
 
The last update I've seen about the obliterate feature imply that it's
been abandoned for the medium-term:
http://svn.haxx.se/dev/archive-2010-08/0457.shtml

Yet Julian Foad appears to be doing a talk about just this feature in
1.7 at "Subversion Live" -
http://www.wandisco.com/events/subversionlive2011/agenda.

So, will it be in 1.7?

Cheers, jamie

=============================================================================== 
Please access the attached hyperlink for an important electronic communications disclaimer: 
http://www.credit-suisse.com/legal/en/disclaimer_email_ib.html 
=============================================================================== 


Re: Permanent deleting the deleted files.

Posted by Ryan Schmidt <su...@ryandesign.com>.
On Jan 31, 2011, at 06:45, Ulrich Eckhardt wrote:

> On Monday 31 January 2011, Ryan Schmidt wrote:
>> If you dump your repository, filter out part of it, then load it into a new
>> repository, that new repository MUST have a new UUID, since it is not the
>> same repository anymore (it's missing parts). Therefore, you CANNOT "svn
>> switch --relocate"; instead you MUST discard existing working copies and
>> check out new ones.
> 
> Can you not keep the UUID and also generate dummy revisions while loading in 
> order to keep existing revision numbers?

There might be ways to trick Subversion but I wouldn't advocate using any of them. The UUID is there to help you uniquely identify a repository. If you've dumped a repository, changed the dumpfile, and loaded it somewhere else, it is no longer the same repository, and it deserves a new UUID and everything that comes with that.




Re: Permanent deleting the deleted files.

Posted by Ulrich Eckhardt <ul...@dominolaser.com>.
On Monday 31 January 2011, Ryan Schmidt wrote:
> If you dump your repository, filter out part of it, then load it into a new
> repository, that new repository MUST have a new UUID, since it is not the
> same repository anymore (it's missing parts). Therefore, you CANNOT "svn
> switch --relocate"; instead you MUST discard existing working copies and
> check out new ones.

Can you not keep the UUID and also generate dummy revisions while loading in 
order to keep existing revision numbers? Of course, anything referring to 
anything that was deleted will become invalid, but as I understand it those 
elements are already obsolete and effectively unused anyway.

Otherwise I completely agree. Having multiple repos with the same UUID is of 
course just asking for trouble, as is mucking with existing revisions.

Cheers!

Uli


-- 
ML: http://subversion.apache.org/docs/community-guide/mailing-lists.html
FAQ: http://subversion.apache.org/faq.html
Docs: http://svnbook.red-bean.com/


**************************************************************************************
Domino Laser GmbH, Fangdieckstraße 75a, 22547 Hamburg, Deutschland
Geschäftsführer: Thorsten Föcking, Amtsgericht Hamburg HR B62 932
**************************************************************************************
Visit our website at <http://www.dominolaser.com/>
**************************************************************************************
Diese E-Mail einschließlich sämtlicher Anhänge ist nur für den Adressaten bestimmt und kann vertrauliche Informationen enthalten. Bitte benachrichtigen Sie den Absender umgehend, falls Sie nicht der beabsichtigte Empfänger sein sollten. Die E-Mail ist in diesem Fall zu löschen und darf weder gelesen, weitergeleitet, veröffentlicht oder anderweitig benutzt werden.
E-Mails können durch Dritte gelesen werden und Viren sowie nichtautorisierte Änderungen enthalten. Domino Laser GmbH ist für diese Folgen nicht verantwortlich.
**************************************************************************************



Re: Permanent deleting the deleted files.

Posted by Ryan Schmidt <su...@ryandesign.com>.
On Jan 31, 2011, at 01:03, Nico Kadel-Garcia wrote:
> The only practical way to do it right now, inside Subversion iteself,
> is to do a complete repository dump and reload to a new repository,
> excluding the relevant files or directories entirely. Look up the
> "svndumpfilter" command and its examples in the Subversion book at
> http://svnbook.red-bean.com/.
> 
> When you do this, you *will* want to switch your user's working copies
> to tthe new, stripped down repository using the "svn switch
> --relocate" command or its equivalent with your particular toolkit.

If you dump your repository, filter out part of it, then load it into a new repository, that new repository MUST have a new UUID, since it is not the same repository anymore (it's missing parts). Therefore, you CANNOT "svn switch --relocate"; instead you MUST discard existing working copies and check out new ones.



Re: Permanent deleting the deleted files.

Posted by Nico Kadel-Garcia <nk...@gmail.com>.
On Sun, Jan 30, 2011 at 11:34 PM, amol gole <mo...@yahoo.com> wrote:
> Hi Rajnish,
>
> 65GB isn't that large in terms of memory cost today... do you think your
> repo access is slow because of the size and is that the reason you want to
> delete files?
>
> I'm new to SVN so I'm not 100% sure this is an option but what if you
> created a new repository and seeded it with a "recent-enough" version of
> your current repository?
>
> AG

Hi, Rayish.

What you're looking for is an "obliterate" function. That's been
discussed a number of times in the past, and never been successfully
pursuied. It's tricky, and potentially dangerous to a database or
change history to rip out selected files or directories.

The only practical way to do it right now, inside Subversion iteself,
is to do a complete repository dump and reload to a new repository,
excluding the relevant files or directories entirely. Look up the
"svndumpfilter" command and its examples in the Subversion book at
http://svnbook.red-bean.com/.

When you do this, you *will* want to switch your user's working copies
to tthe new, stripped down repository using the "svn switch
--relocate" command or its equivalent with your particular toolkit.

Re: Permanent deleting the deleted files.

Posted by amol gole <mo...@yahoo.com>.
Hi Rajnish,

65GB isn't that large in terms of memory cost today... do you think your repo 
access is slow because of the size and is that the reason you want to delete 
files?

I'm new to SVN so I'm not 100% sure this is an option but what if you created a 
new repository and seeded it with a "recent-enough" version of your current 
repository? 


AG





________________________________
From: Rajnish Kumar Singh <Ra...@kpitcummins.com>
To: "users@subversion.apache.org" <us...@subversion.apache.org>
Sent: Sun, January 30, 2011 2:54:08 AM
Subject: FW: Permanent deleting the deleted files.


Hi All,
 
I am working on a  repository in SVN.
As this repository is quite old, its size has gone to 65GB.
There were many files that was deleted. According to me SVN doesn’t allow 
permanent delete.
So all those deleted file would be stored in the back end as a revision.
 
I can view the names of the deleted files from the log.
So is there any way to permanently get rid of deleted files, as this will reduce 
my server space issue also. 

Is there any commands that I can run on the server to get the list of all 
deleted items and to permanently delete them.
 
Any help will be appreciated.
Regards, 
Rajnish K Singh
 
This message contains information that may be privileged or confidential and is 
the property of the KPIT Cummins Infosystems Ltd. It is intended only for the 
person to whom it is addressed. If you are not the intended recipient, you are 
not authorized to read, print, retain copy, disseminate, distribute, or use this 
message or any part thereof. If you receive this message in error, please notify 
the sender immediately and delete all copies of this message. KPIT Cummins 
Infosystems Ltd. does not accept any liability for virus infected mails. 



      

Re: FW: Permanent deleting the deleted files.

Posted by vishwajeet singh <de...@gmail.com>.
On Sun, Jan 30, 2011 at 1:24 PM, Rajnish Kumar Singh <
Rajnish.K.Singh@kpitcummins.com> wrote:

> Hi All,
>
>
>
> I am working on a  repository in SVN.
>
> As this repository is quite old, its size has gone to 65GB.
>
> There were many files that was deleted. According to me SVN doesn’t allow
> permanent delete.
>
> So all those deleted file would be stored in the back end as a revision.
>
>
>
> I can view the names of the deleted files from the log.
>
> So is there any way to permanently get rid of deleted files, as this will
> reduce my server space issue also.
>

  Subversion currently does not have obliterate command that leaves you with
painful option of doing dump and filter the paths you don't want using
dumpfilter.


>  Is there any commands that I can run on the server to get the list of all
> deleted items and to permanently delete them.
>

 you will have to iterate through log to get this info


>
>
> Any help will be appreciated.
>
> *Regards, *
>
> *Rajnish K Singh*
>
>
>
> This message contains information that may be privileged or confidential
> and is the property of the KPIT Cummins Infosystems Ltd. It is intended only
> for the person to whom it is addressed. If you are not the intended
> recipient, you are not authorized to read, print, retain copy, disseminate,
> distribute, or use this message or any part thereof. If you receive this
> message in error, please notify the sender immediately and delete all copies
> of this message. KPIT Cummins Infosystems Ltd. does not accept any liability
> for virus infected mails.
>



-- 
Vishwajeet Singh
+91-9657702154 | dextrous85@gmail.com | http://bootstraptoday.com
Twitter: http://twitter.com/vishwajeets | LinkedIn:
http://www.linkedin.com/in/singhvishwajeet