You are viewing a plain text version of this content. The canonical link for it is here.
Posted to users@subversion.apache.org by Niko Sams <ns...@vivid-planet.com> on 2006/10/30 08:29:15 UTC
modify dump
Hello,
I'm trying to remove some sensible data from a repository. I created a dump
and removed those strings (using sed). However when I want to load the dump
into a new repository I get this error:
* adding path : foo ...svn: Checksum mismatch, rep 'kg':
expected: 7e853364f12897352d85a980e78b151d
actual: 8b6997316c9d32a858280e6fc0049a38
Which is of course correct - as I didn't adjust the checksums.
So my question is: how can I modify the dump?
thanks,
niko sams
---------------------------------------------------------------------
To unsubscribe, e-mail: users-unsubscribe@subversion.tigris.org
For additional commands, e-mail: users-help@subversion.tigris.org
Re: modify dump
Posted by Niko Sams <ns...@vivid-planet.com>.
> I'd assume you'd keep a copy, modify it, and recommit it later.
>
> This will be messy if you need multiple versions of the file, each with
> the mods. In that case you might need to rebuild the repository: start
> with a working copy of the whole repository just before the first time
> the bad file was committed. Merge the diff that updated the file,
> manually edit out the secret stuff, and commit. Repeat through every
> revision of that file in every branch and tag.
thanks for your answer
sounds quite complicated, i will look if we can go around the problem in
another way...
niko
---------------------------------------------------------------------
To unsubscribe, e-mail: users-unsubscribe@subversion.tigris.org
For additional commands, e-mail: users-help@subversion.tigris.org
Re: modify dump
Posted by Duncan Murdoch <mu...@stats.uwo.ca>.
On 10/31/2006 1:09 AM, Niko Sams wrote:
>>> So my question is: how can I modify the dump?
>> I think you want to dump and use svndumpfilter to remove the entire
>> file. I don't think it's safe to try to be finer grained than that.
> thanks for your reply.
> removing the entire file is not possible for me - as there is some other
> (needed) code in it.
I'd assume you'd keep a copy, modify it, and recommit it later.
This will be messy if you need multiple versions of the file, each with
the mods. In that case you might need to rebuild the repository: start
with a working copy of the whole repository just before the first time
the bad file was committed. Merge the diff that updated the file,
manually edit out the secret stuff, and commit. Repeat through every
revision of that file in every branch and tag.
Duncan Murdoch
---------------------------------------------------------------------
To unsubscribe, e-mail: users-unsubscribe@subversion.tigris.org
For additional commands, e-mail: users-help@subversion.tigris.org
Re: modify dump
Posted by Niko Sams <ns...@vivid-planet.com>.
> I think the Checksum is per file, correct? How many copies of that file do
> you have in the repository? If only a few, it might not be difficult to
> recompute the hashes per file.
1635 different revisions are in the repository :D
Too much to do it manually.
> Also some people mentioned that you can just zero out or delete the
> Checksum.
> Also people mentioned that the length of the file changes with your
> modifications. Perhaps you can replace the sensitive data with data of the
> same size? Add some comments or something.
that would be easier, yes
> And lastly, how sensitive is the data? If its a pasword or something,
> perhaps its easier to just change the pasword?
yep, its a password.
the problem is that we can't change it ourselves :(
But I will try to request a new one - I thought removing it from the
svn-history is a simpler job...
thanks!
niko sams
---------------------------------------------------------------------
To unsubscribe, e-mail: users-unsubscribe@subversion.tigris.org
For additional commands, e-mail: users-help@subversion.tigris.org
Re: modify dump
Posted by Russ <rs...@istandfor.com>.
I think the Checksum is per file, correct? How many copies of that file do you have in the repository? If only a few, it might not be difficult to recompute the hashes per file.
Also some people mentioned that you can just zero out or delete the Checksum.
Also people mentioned that the length of the file changes with your modifications. Perhaps you can replace the sensitive data with data of the same size? Add some comments or something.
And lastly, how sensitive is the data? If its a pasword or something, perhaps its easier to just change the pasword?
Russ
Sent wirelessly via BlackBerry from T-Mobile.
-----Original Message-----
From: Niko Sams <ns...@vivid-planet.com>
Date: Tue, 31 Oct 2006 17:10:21
To:rsivak@istandfor.com
Cc:users@subversion.tigris.org
Subject: Re: modify dump
> I guess you can always modify the file, and calculate and update the
> Checksum.
Yes - But how do I update the checksum? Doing this on a 3.5Gb-File isn't that
easy...
> Is there a reason you don't just do this find/replace on a
> working copy and check in the changes?
It's sensible data that should not get visible through the history of the
file.
niko
---------------------------------------------------------------------
To unsubscribe, e-mail: users-unsubscribe@subversion.tigris.org
For additional commands, e-mail: users-help@subversion.tigris.org
Re: modify dump
Posted by Niko Sams <ns...@vivid-planet.com>.
> I guess you can always modify the file, and calculate and update the
> Checksum.
Yes - But how do I update the checksum? Doing this on a 3.5Gb-File isn't that
easy...
> Is there a reason you don't just do this find/replace on a
> working copy and check in the changes?
It's sensible data that should not get visible through the history of the
file.
niko
---------------------------------------------------------------------
To unsubscribe, e-mail: users-unsubscribe@subversion.tigris.org
For additional commands, e-mail: users-help@subversion.tigris.org
Re: modify dump
Posted by Andy Levy <an...@gmail.com>.
On 10/31/06, Russ <rs...@istandfor.com> wrote:
> I guess you can always modify the file, and calculate and update the Checksum. Is there a reason you don't just do this find/replace on a working copy and check in the changes?
He originally said it was "sensible" data, which I took to mean
"sensitive" ("I'm trying to remove some sensible data from a
repository."). Removing the data in a WC and checking in the new
version won't remove it from the repository, you can still get at it.
---------------------------------------------------------------------
To unsubscribe, e-mail: users-unsubscribe@subversion.tigris.org
For additional commands, e-mail: users-help@subversion.tigris.org
Re: modify dump
Posted by Russ <rs...@istandfor.com>.
I guess you can always modify the file, and calculate and update the Checksum. Is there a reason you don't just do this find/replace on a working copy and check in the changes?
Russ
Sent wirelessly via BlackBerry from T-Mobile.
-----Original Message-----
From: Niko Sams <ns...@vivid-planet.com>
Date: Tue, 31 Oct 2006 08:09:48
To:Duncan Murdoch <mu...@stats.uwo.ca>
Cc:users@subversion.tigris.org
Subject: Re: modify dump
> > So my question is: how can I modify the dump?
>
> I think you want to dump and use svndumpfilter to remove the entire
> file. I don't think it's safe to try to be finer grained than that.
thanks for your reply.
removing the entire file is not possible for me - as there is some other
(needed) code in it.
niko
---------------------------------------------------------------------
To unsubscribe, e-mail: users-unsubscribe@subversion.tigris.org
For additional commands, e-mail: users-help@subversion.tigris.org
---------------------------------------------------------------------
To unsubscribe, e-mail: users-unsubscribe@subversion.tigris.org
For additional commands, e-mail: users-help@subversion.tigris.org
Re: modify dump
Posted by Niko Sams <ns...@vivid-planet.com>.
> > So my question is: how can I modify the dump?
>
> I think you want to dump and use svndumpfilter to remove the entire
> file. I don't think it's safe to try to be finer grained than that.
thanks for your reply.
removing the entire file is not possible for me - as there is some other
(needed) code in it.
niko
---------------------------------------------------------------------
To unsubscribe, e-mail: users-unsubscribe@subversion.tigris.org
For additional commands, e-mail: users-help@subversion.tigris.org
Re: modify dump
Posted by Duncan Murdoch <mu...@stats.uwo.ca>.
On 10/30/2006 3:29 AM, Niko Sams wrote:
> Hello,
>
> I'm trying to remove some sensible data from a repository. I created a dump
> and removed those strings (using sed). However when I want to load the dump
> into a new repository I get this error:
> * adding path : foo ...svn: Checksum mismatch, rep 'kg':
> expected: 7e853364f12897352d85a980e78b151d
> actual: 8b6997316c9d32a858280e6fc0049a38
>
> Which is of course correct - as I didn't adjust the checksums.
>
> So my question is: how can I modify the dump?
I think you want to dump and use svndumpfilter to remove the entire
file. I don't think it's safe to try to be finer grained than that.
Duncan Murdoch
---------------------------------------------------------------------
To unsubscribe, e-mail: users-unsubscribe@subversion.tigris.org
For additional commands, e-mail: users-help@subversion.tigris.org
Re: modify dump
Posted by Ryan Schmidt <su...@ryandesign.com>.
On Oct 30, 2006, at 02:29, Niko Sams wrote:
> I'm trying to remove some sensible data from a repository. I
> created a dump
> and removed those strings (using sed). However when I want to load
> the dump
> into a new repository I get this error:
> * adding path : foo ...svn: Checksum mismatch, rep 'kg':
> expected: 7e853364f12897352d85a980e78b151d
> actual: 8b6997316c9d32a858280e6fc0049a38
>
> Which is of course correct - as I didn't adjust the checksums.
>
> So my question is: how can I modify the dump?
With the svndumpfilter program?
http://svnbook.red-bean.com/en/1.2/
svn.reposadmin.maint.html#svn.reposadmin.maint.tk.svndumpfilter
---------------------------------------------------------------------
To unsubscribe, e-mail: users-unsubscribe@subversion.tigris.org
For additional commands, e-mail: users-help@subversion.tigris.org
Re: modify dump
Posted by Gert Kello <Ge...@mail.ee>.
> AFAIK You can remove the checksum line all together.
>
> But be sure to adjust content-length and text-content-length values also.
Duh: The removal of check-sum does not make content-length to be
different. But if You change the length of the file body, then You must
change those values.
--
Gert
---------------------------------------------------------------------
To unsubscribe, e-mail: users-unsubscribe@subversion.tigris.org
For additional commands, e-mail: users-help@subversion.tigris.org
Re: modify dump
Posted by Gert Kello <Ge...@mail.ee>.
Niko Sams wrote:
> Hello,
>
> I'm trying to remove some sensible data from a repository. I created a dump
> and removed those strings (using sed). However when I want to load the dump
> into a new repository I get this error:
> * adding path : foo ...svn: Checksum mismatch, rep 'kg':
> expected: 7e853364f12897352d85a980e78b151d
> actual: 8b6997316c9d32a858280e6fc0049a38
>
> Which is of course correct - as I didn't adjust the checksums.
>
> So my question is: how can I modify the dump?
>
> thanks,
> niko sams
AFAIK You can remove the checksum line all together.
But be sure to adjust content-length and text-content-length values also.
But again: be *very careful* when editing the file.
Gert
--
Gert
---------------------------------------------------------------------
To unsubscribe, e-mail: users-unsubscribe@subversion.tigris.org
For additional commands, e-mail: users-help@subversion.tigris.org