You are viewing a plain text version of this content. The canonical link for it is here.
Posted to users@subversion.apache.org by Li Ma <li...@gmail.com> on 2007/03/02 19:27:39 UTC
Submit large bunch of files over a slow ad unstable network
Hi there,
I set out this question yesterday after I joint the mail list. But got no
response. Maybe it was lost. So I send it again. Please help me if you have
any solution on this.
I am in US and I have a repository in China. very often, I need to submit
large bunch of files ( 100M+ ) to the repository,especially when a new
project is started.
The network connection is about 30K byte per sec and very unstable. So most
likely my big commit will fail because of network connection. This is very
frustrating, because if network failed in the last M, the whole 100M of
transmission will be wasted.
I know SVN can handle slow network, but is there anyway to handle slow and
unstable network?
Thanks!
--
Li Ma
lima01@gmail.com
http://www.idealtechs.com
Re: Submit large bunch of files over a slow ad unstable network
Posted by Li Ma <li...@gmail.com>.
Isnt there any retry ability on SVN? Cause the network might be slow or
unreliable, but most of the time, it worked. I could connect my remote
server with SSH and work for long time.
Since the nature of SVN is transaction based, it will be great if it could
cache the uploaded stuff somewhere on server, push the data up ( with
retries ), then submit in transaction over there. Otherwise, it is too easy
to break a big transaction in case like mine.
Thanks!
Li
On 3/2/07, Mark Phippard <ma...@gmail.com> wrote:
>
> On 3/2/07, Li Ma <li...@gmail.com> wrote:
>
> > Hi there,
> >
> > I set out this question yesterday after I joint the mail list. But got
> > no response. Maybe it was lost. So I send it again. Please help me if you
> > have any solution on this.
> >
> > I am in US and I have a repository in China. very often, I need to
> > submit large bunch of files ( 100M+ ) to the repository,especially when a
> > new project is started.
> >
> > The network connection is about 30K byte per sec and very unstable. So
> > most likely my big commit will fail because of network connection. This is
> > very frustrating, because if network failed in the last M, the whole 100M of
> > transmission will be wasted.
> >
> > I know SVN can handle slow network, but is there anyway to handle slow
> > and unstable network?
>
>
> My guess is that there isn't a solution which is why you did not get a
> reply.
>
> --
> Thanks
>
> Mark Phippard
> http://markphip.blogspot.com/
--
Li Ma
lima01@gmail.com
http://www.idealtechs.com
Re: Submit large bunch of files over a slow ad unstable network
Posted by Kyle Kline <ky...@gmail.com>.
Do you have to commit it as one commit, or could you commit smaller chunks
(files, dirs)?
On 3/2/07, Mark Phippard <ma...@gmail.com> wrote:
>
> On 3/2/07, Li Ma <li...@gmail.com> wrote:
>
> > Hi there,
> >
> > I set out this question yesterday after I joint the mail list. But got
> > no response. Maybe it was lost. So I send it again. Please help me if you
> > have any solution on this.
> >
> > I am in US and I have a repository in China. very often, I need to
> > submit large bunch of files ( 100M+ ) to the repository,especially when a
> > new project is started.
> >
> > The network connection is about 30K byte per sec and very unstable. So
> > most likely my big commit will fail because of network connection. This is
> > very frustrating, because if network failed in the last M, the whole 100M of
> > transmission will be wasted.
> >
> > I know SVN can handle slow network, but is there anyway to handle slow
> > and unstable network?
>
>
> My guess is that there isn't a solution which is why you did not get a
> reply.
>
> --
> Thanks
>
> Mark Phippard
> http://markphip.blogspot.com/
Re: Submit large bunch of files over a slow ad unstable network
Posted by Jeff Smith <js...@robotronics.com>.
On Friday 02 March 2007 12:45, Li Ma wrote:
> Isnt there any retry ability on SVN? Cause the network might be
> slow or unreliable, but most of the time, it worked. I could
> connect my remote server with SSH and work for long time.
The "Internet" itself handles retries. It's not at all like every
TCP/IP stream just gives up when it hits the first error. The
application is normally not even aware it had a few errors durring
the first attempts. The problem is that most people don't want to
keep trying forever if too unstable (not to mention one error in a
million could be mis-interpereted and do the wrong thing).
> Since the nature of SVN is transaction based, it will be great if
> it could cache the uploaded stuff somewhere on server, push the
> data up ( with retries ), then submit in transaction over there.
> Otherwise, it is too easy to break a big transaction in case like
> mine.
I wonder if there is a more specific problem you are having. What
exactly is a problem you've had? What error? Are you trying to add
all the files initially, or just committing routine changes? Normally
the routine changes are not anywhere near the size of transmitting
the entire files.
---------------------------------------------------------------------
To unsubscribe, e-mail: users-unsubscribe@subversion.tigris.org
For additional commands, e-mail: users-help@subversion.tigris.org
Re: Submit large bunch of files over a slow ad unstable network
Posted by Mark Phippard <ma...@gmail.com>.
On 3/2/07, Li Ma <li...@gmail.com> wrote:
>
> Hi there,
>
> I set out this question yesterday after I joint the mail list. But got no
> response. Maybe it was lost. So I send it again. Please help me if you have
> any solution on this.
>
> I am in US and I have a repository in China. very often, I need to submit
> large bunch of files ( 100M+ ) to the repository,especially when a new
> project is started.
>
> The network connection is about 30K byte per sec and very unstable. So
> most likely my big commit will fail because of network connection. This is
> very frustrating, because if network failed in the last M, the whole 100M of
> transmission will be wasted.
>
> I know SVN can handle slow network, but is there anyway to handle slow and
> unstable network?
My guess is that there isn't a solution which is why you did not get a
reply.
--
Thanks
Mark Phippard
http://markphip.blogspot.com/
Re: Submit large bunch of files over a slow ad unstable network
Posted by Ivan Aleman <bo...@gmail.com>.
2007/3/2, Li Ma <li...@gmail.com>:
> OK, so far the suggestions are I have to commit piece by piece. I guess I
> will have to that .
>
I think so :)
> But still, is it possible to make SVN more reliable? And I'malso thinking to
> build a bridge in between , such as a reliable VPN which will handle the
> comminucation, then SVN will do the rest. Is it possible? VPN, SSH Tunnel,
> whatelse?
Yes it's possible vpn+ssh and desirable too, but consider that the
problem are the transport and the physical layers, a vpn will not make
any difference for this matter, so better get a better connection ;)
>
Sorry for the duplicated email Li, silly me forgot to reply the list.
--
Iván Alemán -- bonovoxmofo.blogspot.com
Cambia ya!
http://goodbye-microsoft.com/
---------------------------------------------------------------------
To unsubscribe, e-mail: users-unsubscribe@subversion.tigris.org
For additional commands, e-mail: users-help@subversion.tigris.org