You are viewing a plain text version of this content. The canonical link for it is here.
Posted to users@subversion.apache.org by Edward Harvey <eh...@chilsemi.com> on 2007/03/13 21:16:54 UTC
Can I have mirrored subversion servers?
If I can, I would like to have a svn server at location A, and another
svn server at location B. They should both contain the same
repositories, and all the changes should propagate everywhere.
The reasoning behind it is - A user at location A wants to update&commit
files at LAN speed, and a user at location B wants to use the same
repository, also at LAN speed. Let the users experience LAN speed, and
let the server propagate the changes at WAN speeds.
I don't see anything written anywhere saying I can do this... But then
again the subversion book is down right now so I haven't been able to
look there.
Is it possible?
Thanks...
---------------------------------------------------------------------
To unsubscribe, e-mail: users-unsubscribe@subversion.tigris.org
For additional commands, e-mail: users-help@subversion.tigris.org
RE: Can I have mirrored subversion servers?
Posted by Tom Malia <to...@ttdsinc.com>.
Oh! Then let me vote like a Chicago person (early and often)...Bring on
version 1.5 ASAP Then!
-----Original Message-----
From: Erik Huelsmann [mailto:ehuels@gmail.com]
Sent: Tuesday, March 13, 2007 5:00 PM
To: Ryan Schmidt
Cc: Edward Harvey; users@subversion.tigris.org
Subject: Re: Can I have mirrored subversion servers?
On 3/13/07, Ryan Schmidt <su...@ryandesign.com> wrote:
>
> On Mar 13, 2007, at 16:16, Edward Harvey wrote:
>
> > If I can, I would like to have a svn server at location A, and another
> > svn server at location B. They should both contain the same
> > repositories, and all the changes should propagate everywhere.
> >
> > The reasoning behind it is - A user at location A wants to
> > update&commit
> > files at LAN speed, and a user at location B wants to use the same
> > repository, also at LAN speed. Let the users experience LAN speed,
> > and
> > let the server propagate the changes at WAN speeds.
> >
> > I don't see anything written anywhere saying I can do this... But
> > then
> > again the subversion book is down right now so I haven't been able to
> > look there.
> >
> > Is it possible?
>
> No, not possible.
>
> New with Subversion 1.4 is the svnsync program, which lets you create
> a read-only mirror of a repository. However that cannot be extended
> to having multiple read-write repositories as you want.
But it will be possible 1.5 (over HTTP)!
bye,
Erik.
---------------------------------------------------------------------
To unsubscribe, e-mail: users-unsubscribe@subversion.tigris.org
For additional commands, e-mail: users-help@subversion.tigris.org
---------------------------------------------------------------------
To unsubscribe, e-mail: users-unsubscribe@subversion.tigris.org
For additional commands, e-mail: users-help@subversion.tigris.org
RE: Can I have mirrored subversion servers?
Posted by Carol Wesolowski <Ca...@arroweyesolutions.com>.
I'm using svk to sync and merge 3 remote mirrored sites from a main repository. My users at each of the remote sites work off their local "mirrored" repository server. Then in the backend the remote servers do a sync and merge to the main repository over the Internet via http protocol.
-Regards, Carol
-----Original Message-----
From: Erik Huelsmann [mailto:ehuels@gmail.com]
Sent: Tuesday, March 13, 2007 3:00 PM
To: Ryan Schmidt
Cc: Edward Harvey; users@subversion.tigris.org
Subject: Re: Can I have mirrored subversion servers?
On 3/13/07, Ryan Schmidt <su...@ryandesign.com> wrote:
>
> On Mar 13, 2007, at 16:16, Edward Harvey wrote:
>
> > If I can, I would like to have a svn server at location A, and another
> > svn server at location B. They should both contain the same
> > repositories, and all the changes should propagate everywhere.
> >
> > The reasoning behind it is - A user at location A wants to
> > update&commit
> > files at LAN speed, and a user at location B wants to use the same
> > repository, also at LAN speed. Let the users experience LAN speed,
> > and
> > let the server propagate the changes at WAN speeds.
> >
> > I don't see anything written anywhere saying I can do this... But
> > then
> > again the subversion book is down right now so I haven't been able to
> > look there.
> >
> > Is it possible?
>
> No, not possible.
>
> New with Subversion 1.4 is the svnsync program, which lets you create
> a read-only mirror of a repository. However that cannot be extended
> to having multiple read-write repositories as you want.
But it will be possible 1.5 (over HTTP)!
bye,
Erik.
---------------------------------------------------------------------
To unsubscribe, e-mail: users-unsubscribe@subversion.tigris.org
For additional commands, e-mail: users-help@subversion.tigris.org
Re: Can I have mirrored subversion servers?
Posted by Erik Huelsmann <eh...@gmail.com>.
On 3/13/07, Ryan Schmidt <su...@ryandesign.com> wrote:
>
> On Mar 13, 2007, at 16:16, Edward Harvey wrote:
>
> > If I can, I would like to have a svn server at location A, and another
> > svn server at location B. They should both contain the same
> > repositories, and all the changes should propagate everywhere.
> >
> > The reasoning behind it is - A user at location A wants to
> > update&commit
> > files at LAN speed, and a user at location B wants to use the same
> > repository, also at LAN speed. Let the users experience LAN speed,
> > and
> > let the server propagate the changes at WAN speeds.
> >
> > I don't see anything written anywhere saying I can do this... But
> > then
> > again the subversion book is down right now so I haven't been able to
> > look there.
> >
> > Is it possible?
>
> No, not possible.
>
> New with Subversion 1.4 is the svnsync program, which lets you create
> a read-only mirror of a repository. However that cannot be extended
> to having multiple read-write repositories as you want.
But it will be possible 1.5 (over HTTP)!
bye,
Erik.
---------------------------------------------------------------------
To unsubscribe, e-mail: users-unsubscribe@subversion.tigris.org
For additional commands, e-mail: users-help@subversion.tigris.org
Re: Can I have mirrored subversion servers?
Posted by Ryan Schmidt <su...@ryandesign.com>.
On Mar 13, 2007, at 16:16, Edward Harvey wrote:
> If I can, I would like to have a svn server at location A, and another
> svn server at location B. They should both contain the same
> repositories, and all the changes should propagate everywhere.
>
> The reasoning behind it is - A user at location A wants to
> update&commit
> files at LAN speed, and a user at location B wants to use the same
> repository, also at LAN speed. Let the users experience LAN speed,
> and
> let the server propagate the changes at WAN speeds.
>
> I don't see anything written anywhere saying I can do this... But
> then
> again the subversion book is down right now so I haven't been able to
> look there.
>
> Is it possible?
No, not possible.
New with Subversion 1.4 is the svnsync program, which lets you create
a read-only mirror of a repository. However that cannot be extended
to having multiple read-write repositories as you want.
You could consider SVK, which is based on Subversion and may do what
you want:
http://svk.bestpractical.com/
You could also look into WANdisco, which looks like it would almost
certainly do what you want, but it is a commercial product):
http://www.wandisco.com/
I have never used WANdisco and am not affiliated with them, I just
heard it mentioned on the list before.
--
To reply to the mailing list, please use your mailer's Reply To All
function
---------------------------------------------------------------------
To unsubscribe, e-mail: users-unsubscribe@subversion.tigris.org
For additional commands, e-mail: users-help@subversion.tigris.org
Re: Can I have mirrored subversion servers?
Posted by John Waycott <ja...@cox.net>.
Erik Huelsmann wrote:
> On 3/14/07, Duncan Murdoch <mu...@stats.uwo.ca> wrote:
>> On 3/14/2007 8:21 AM, Edward Harvey wrote:
>> >> -----Original Message-----
>> >> From: Jared Hardy [mailto:jaredhardy@gmail.com]
>> >> Sent: Tuesday, March 13, 2007 9:42 PM
>> >> To: users@subversion.tigris.org
>> >> Cc: Edward Harvey
>> >> Subject: Re: Can I have mirrored subversion servers?
>> >>
>> >> The reason is: while replication/mirror solutions will
>> >> certainly speed up updates (or any read-only operation),
>> >> commits (write operations) should propagate to all repository
>> >> servers before they are considered "complete", no matter what
>> >> solution you choose.
>> >
>> > Well, I think that's just a matter of implementation. It is entirely
>> > possible, if a system were so designed, for the LAN repository to
>> accept
>> > a commit request from the client, and quickly reserve whatever it
>> needs
>> > to reserve on all the WAN repositories before returning success.
>>
>> And if the LAN repository suffers a catastrophic failure (or a backhoe
>> takes out their WAN connection) before the commit really finishes, the
>> WAN repositories will be left waiting indefinitely, unable to process
>> updates or commit, while the local user may think everything is fine.
>>
>> I don't know the details of what Eric hinted at for 1.5, but I hope that
>> it sticks with the model of a single master repository where commits
>> must succeed before a commit request returns.
>
> See
> http://svn.collab.net/repos/svn/trunk/notes/webdav-proxy
> for more information.
>
> bye,
>
> Erik.
>
We have development offices scattered throughout the world. We find that
the initial checkout takes the most time going to a central server.
Updates and commits are seldom a problem, thanks to Subversion's ability
to send/receive the deltas.
The workaround we use currently is to keep working copies of the project
trunks checked out to a local machines. This is a solution that Ryan
Schmidt mentioned a while ago, and it works very well for us. When a
developer wants to checkout a project, they just make a copy of the
locally checked-out working copy, then do an update or switch. The local
copies are updated about once a week or more to keep them current.
One big advantage for us is that it doesn't require remote SVN servers.
That translates to less administrative overhead. Any old desktop machine
will work fine for housing the local copies.
This doesn't solve the backhoe severing the WAN connection, but that is
seldom a problem for us since we have redundancy built into the network.
-- John
---------------------------------------------------------------------
To unsubscribe, e-mail: users-unsubscribe@subversion.tigris.org
For additional commands, e-mail: users-help@subversion.tigris.org
Re: Can I have mirrored subversion servers?
Posted by Erik Huelsmann <eh...@gmail.com>.
On 3/14/07, Duncan Murdoch <mu...@stats.uwo.ca> wrote:
> On 3/14/2007 8:21 AM, Edward Harvey wrote:
> >> -----Original Message-----
> >> From: Jared Hardy [mailto:jaredhardy@gmail.com]
> >> Sent: Tuesday, March 13, 2007 9:42 PM
> >> To: users@subversion.tigris.org
> >> Cc: Edward Harvey
> >> Subject: Re: Can I have mirrored subversion servers?
> >>
> >> The reason is: while replication/mirror solutions will
> >> certainly speed up updates (or any read-only operation),
> >> commits (write operations) should propagate to all repository
> >> servers before they are considered "complete", no matter what
> >> solution you choose.
> >
> > Well, I think that's just a matter of implementation. It is entirely
> > possible, if a system were so designed, for the LAN repository to accept
> > a commit request from the client, and quickly reserve whatever it needs
> > to reserve on all the WAN repositories before returning success.
>
> And if the LAN repository suffers a catastrophic failure (or a backhoe
> takes out their WAN connection) before the commit really finishes, the
> WAN repositories will be left waiting indefinitely, unable to process
> updates or commit, while the local user may think everything is fine.
>
> I don't know the details of what Eric hinted at for 1.5, but I hope that
> it sticks with the model of a single master repository where commits
> must succeed before a commit request returns.
See
http://svn.collab.net/repos/svn/trunk/notes/webdav-proxy
for more information.
bye,
Erik.
---------------------------------------------------------------------
To unsubscribe, e-mail: users-unsubscribe@subversion.tigris.org
For additional commands, e-mail: users-help@subversion.tigris.org
Re: Can I have mirrored subversion servers?
Posted by Duncan Murdoch <mu...@stats.uwo.ca>.
On 3/14/2007 8:21 AM, Edward Harvey wrote:
>> -----Original Message-----
>> From: Jared Hardy [mailto:jaredhardy@gmail.com]
>> Sent: Tuesday, March 13, 2007 9:42 PM
>> To: users@subversion.tigris.org
>> Cc: Edward Harvey
>> Subject: Re: Can I have mirrored subversion servers?
>>
>> The reason is: while replication/mirror solutions will
>> certainly speed up updates (or any read-only operation),
>> commits (write operations) should propagate to all repository
>> servers before they are considered "complete", no matter what
>> solution you choose.
>
> Well, I think that's just a matter of implementation. It is entirely
> possible, if a system were so designed, for the LAN repository to accept
> a commit request from the client, and quickly reserve whatever it needs
> to reserve on all the WAN repositories before returning success.
And if the LAN repository suffers a catastrophic failure (or a backhoe
takes out their WAN connection) before the commit really finishes, the
WAN repositories will be left waiting indefinitely, unable to process
updates or commit, while the local user may think everything is fine.
I don't know the details of what Eric hinted at for 1.5, but I hope that
it sticks with the model of a single master repository where commits
must succeed before a commit request returns.
Duncan Murdoch
>
> I'll go look at SVK and Wandisco, to see what they're capable of
> doing....
>
> Thanks for the responses, everyone.
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: users-unsubscribe@subversion.tigris.org
> For additional commands, e-mail: users-help@subversion.tigris.org
>
---------------------------------------------------------------------
To unsubscribe, e-mail: users-unsubscribe@subversion.tigris.org
For additional commands, e-mail: users-help@subversion.tigris.org
RE: Can I have mirrored subversion servers?
Posted by Edward Harvey <eh...@chilsemi.com>.
> -----Original Message-----
> From: Jared Hardy [mailto:jaredhardy@gmail.com]
> Sent: Tuesday, March 13, 2007 9:42 PM
> To: users@subversion.tigris.org
> Cc: Edward Harvey
> Subject: Re: Can I have mirrored subversion servers?
>
> The reason is: while replication/mirror solutions will
> certainly speed up updates (or any read-only operation),
> commits (write operations) should propagate to all repository
> servers before they are considered "complete", no matter what
> solution you choose.
Well, I think that's just a matter of implementation. It is entirely
possible, if a system were so designed, for the LAN repository to accept
a commit request from the client, and quickly reserve whatever it needs
to reserve on all the WAN repositories before returning success.
I'll go look at SVK and Wandisco, to see what they're capable of
doing....
Thanks for the responses, everyone.
---------------------------------------------------------------------
To unsubscribe, e-mail: users-unsubscribe@subversion.tigris.org
For additional commands, e-mail: users-help@subversion.tigris.org
Re: Can I have mirrored subversion servers?
Posted by Jared Hardy <ja...@gmail.com>.
On 3/13/07, Edward Harvey <eh...@chilsemi.com> wrote:
> If I can, I would like to have a svn server at location A, and another
> svn server at location B. They should both contain the same
> repositories, and all the changes should propagate everywhere.
I think you should pick the repository location, A or B, which sees
the most committed changes at any point of time. The reason is: while
replication/mirror solutions will certainly speed up updates (or any
read-only operation), commits (write operations) should propagate to
all repository servers before they are considered "complete", no
matter what solution you choose. That is the only means of preventing
one server's problem from corrupting the data of the rest, no matter
how you implement it. That means that updates (reads) can be at LAN
speed, but commits (writes) will always be at WAN speed, if you really
want to trust the data. In practice, this works out pretty well,
because read operations are far more large and frequent than write
operations, after initial repository population.
> I don't see anything written anywhere saying I can do this... But then
> again the subversion book is down right now so I haven't been able to
> look there.
Search the dev@subversion.tigris.org mailing list archive. Someone
there mentioned some success at using an unstable release of SVN 1.5
on an Apache server, with the new reverse-proxy capability. HTTP read
type requests were handled on a local (LAN) repository, but write
requests were always forwarded to a central (WAN) repository. The
local repository was kept up to date using the svnsync tool, run by a
post-commit hook script on the central repository server.
You should also research SVK to see if it's right for your
environment. I personally use it as my default Working Copy client.
The author of SVK, Chia Liang Kao, also wrote a tool called "pushmi",
which allows you to set up a local repository "mirror" that
automatically forwards commit requests to the main repository. It
keeps the mirror up to date by running a command similar to "svk pull
//mirror //local" as a cron job, every 5 minutes or so. I think
"pushmi" does for svn:// access what the SVN 1.5 Apache reverse-proxy
does for http[s]:// access.
If you want less of a hack, and commercial support, look into WANdisco.
:) Jred
---------------------------------------------------------------------
To unsubscribe, e-mail: users-unsubscribe@subversion.tigris.org
For additional commands, e-mail: users-help@subversion.tigris.org