You are viewing a plain text version of this content. The canonical link for it is here.
Posted to users@subversion.apache.org by Lorenz <lo...@yahoo.com> on 2013/04/29 07:33:28 UTC

Re: Tortoise SVN Issue Noticed

Ajay Pawar wrote:
>Scenario #1 :
>
>1. I delete a file(in this case ETools Weekly Presentation_09-Apr-2013.xls Size 540 KB)  from my machine and then Click on 'SVN Update'.
>
>2. After some time, the file gets restored/updated back from the server and the following status is seen on the Client.
>
>3. Error : Notice the statement '2 kBytes transferred in 0 min 38 second' . The file restored was 538 Kb. Then why does the client show this incorrect information.

the file most likely gets restored from the local copy in .svn


>Scenario # 2 :
>
>1. I had a new excel Sheet Created of size 1496 kb. Then right click and slect 'Add'. Then right Click and Select 'SVN Commit.
>
>2. After some time, the client shows '583 kBytes transferred in >>>" . But why does the client report a size which does not seem to match the transaction.

transmissions are compressed
-- 

Lorenz


RE: Tortoise SVN Issue Noticed

Posted by Bert Huijben <be...@qqmail.nl>.

> -----Original Message-----
> From: Johan Corveleyn [mailto:jcorvel@gmail.com]
> Sent: maandag 29 april 2013 13:31
> To: Martin Bischoff
> Cc: Ajay Pawar; users@subversion.apache.org; Thorsten Schöning
> Subject: Re: Tortoise SVN Issue Noticed
> 
> On Mon, Apr 29, 2013 at 1:16 PM, Martin Bischoff <ti...@gmail.com>
> wrote:
> > On Mon, Apr 29, 2013 at 12:26 PM, Johan Corveleyn <jc...@gmail.com>
> wrote:
> >>
> >> On Mon, Apr 29, 2013 at 12:17 PM, Thorsten Schöning
> >> <ts...@am-soft.de> wrote:
> >> > Guten Tag Ajay Pawar,
> >> > am Montag, 29. April 2013 um 12:08 schrieben Sie:
> >> >
> >> >> I added a new file XYZ.ppt which is of size 984 kb but still the
client
> >> >> shows 0 kb.
> >> >
> >> > As already said, Subversion uses delta transmission, compresses
> >> > content on transmission and my even use some kind of
> >> > deduplication/representation sharing on the client. I'm not sure what
> >> > exactly your problem is? Do you want to force Subversion that only
the
> >> > exact amount of data a file on your hard disk needs gets transferred?
> >> > You can't predict how much data gets transferred, simple as that.
> >>
> >> I'm wondering if this is actually an 'svn core' issue, or if this is
> >> specific to TortoiseSVN. I can't remember seeing a "transferred X KB"
> >> output when running 'svn update' on the command line. If it's
> >> TSVN-specific, it's probably better to try your luck on their
> >> mailinglist first.
> >>
> >> See here: http://tortoisesvn.net/community.html
> >>
> > There is definitely a bug in the display of the data transfer progress.
> >
> > See here for an old discussion on the tortoisesvn-users list:
> >
> http://tortoisesvn.tigris.org/ds/viewMessage.do?dsForumId=4061&dsMess
> ageId=2991921
> >
> > But it seems the root cause is somewhere in SVN. It has to do with issue
> > 3260:
> > http://subversion.tigris.org/issues/show_bug.cgi?id=3260
> >
> 
> Ah, so it's a known issue then. Thanks, that's good to know.
> 
> Unfortunately, it seems no work has been done on that issue (and
> AFAICS nobody is actively working on it). Perhaps the new activity
> around this issue might motivate a developer to take it on ... Or
> perhaps someone new wants to take a closer look and maybe write a
> patch? [1]

Most of this issue is 'neon' specific and 1.8.X switches to the Serf http(s)
client by default.
Neon just sends progress data on the body of requests, not headers and most
of what is written to the server. (The progress callback is called for
different http sessions and there is no way to find out for which one the
report is). The reporting somewhat improved in 1.7, compared to the very bad
case in 1.5.

Given that, we also use optimizations for what is already in the working
copy, wire compression, plain zlib compression and several other
optimizations that makes it impossible to guess how much data would be
transferred for a specific operation. 

How much data is send depends on your exact working copy (e.g. mixed
revisionness, switches, cached data); the exact client version; the exact
server version, several of their dependencies. 
So depending on the output of the progress report is generally not
recommended. But clients usually want to show the difference between a stuck
connection and an active transfer. And for that case it works fine. And if
it reports the expected amount of data (for a session) it might provide some
input on how much should still be received/send.


	Bert

> 
> [1] http://subversion.apache.org/docs/community-
> guide/general.html#patches
> 
> --
> Johan


Re: Tortoise SVN Issue Noticed

Posted by Johan Corveleyn <jc...@gmail.com>.
On Mon, Apr 29, 2013 at 1:16 PM, Martin Bischoff <ti...@gmail.com> wrote:
> On Mon, Apr 29, 2013 at 12:26 PM, Johan Corveleyn <jc...@gmail.com> wrote:
>>
>> On Mon, Apr 29, 2013 at 12:17 PM, Thorsten Schöning
>> <ts...@am-soft.de> wrote:
>> > Guten Tag Ajay Pawar,
>> > am Montag, 29. April 2013 um 12:08 schrieben Sie:
>> >
>> >> I added a new file XYZ.ppt which is of size 984 kb but still the client
>> >> shows 0 kb.
>> >
>> > As already said, Subversion uses delta transmission, compresses
>> > content on transmission and my even use some kind of
>> > deduplication/representation sharing on the client. I'm not sure what
>> > exactly your problem is? Do you want to force Subversion that only the
>> > exact amount of data a file on your hard disk needs gets transferred?
>> > You can't predict how much data gets transferred, simple as that.
>>
>> I'm wondering if this is actually an 'svn core' issue, or if this is
>> specific to TortoiseSVN. I can't remember seeing a "transferred X KB"
>> output when running 'svn update' on the command line. If it's
>> TSVN-specific, it's probably better to try your luck on their
>> mailinglist first.
>>
>> See here: http://tortoisesvn.net/community.html
>>
> There is definitely a bug in the display of the data transfer progress.
>
> See here for an old discussion on the tortoisesvn-users list:
> http://tortoisesvn.tigris.org/ds/viewMessage.do?dsForumId=4061&dsMessageId=2991921
>
> But it seems the root cause is somewhere in SVN. It has to do with issue
> 3260:
> http://subversion.tigris.org/issues/show_bug.cgi?id=3260
>

Ah, so it's a known issue then. Thanks, that's good to know.

Unfortunately, it seems no work has been done on that issue (and
AFAICS nobody is actively working on it). Perhaps the new activity
around this issue might motivate a developer to take it on ... Or
perhaps someone new wants to take a closer look and maybe write a
patch? [1]

[1] http://subversion.apache.org/docs/community-guide/general.html#patches

--
Johan

Re: Tortoise SVN Issue Noticed

Posted by Martin Bischoff <ti...@gmail.com>.
There is definitely a bug in the display of the data transfer progress.

See here for an old discussion on the tortoisesvn-users list:
http://tortoisesvn.tigris.org/ds/viewMessage.do?dsForumId=4061&dsMessageId=2991921

But it seems the root cause is somewhere in SVN. It has to do with issue
3260:
http://subversion.tigris.org/issues/show_bug.cgi?id=3260

-Martin

On Mon, Apr 29, 2013 at 12:26 PM, Johan Corveleyn <jc...@gmail.com> wrote:

> On Mon, Apr 29, 2013 at 12:17 PM, Thorsten Schöning
> <ts...@am-soft.de> wrote:
> > Guten Tag Ajay Pawar,
> > am Montag, 29. April 2013 um 12:08 schrieben Sie:
> >
> >> I added a new file XYZ.ppt which is of size 984 kb but still the client
> shows 0 kb.
> >
> > As already said, Subversion uses delta transmission, compresses
> > content on transmission and my even use some kind of
> > deduplication/representation sharing on the client. I'm not sure what
> > exactly your problem is? Do you want to force Subversion that only the
> > exact amount of data a file on your hard disk needs gets transferred?
> > You can't predict how much data gets transferred, simple as that.
>
> I'm wondering if this is actually an 'svn core' issue, or if this is
> specific to TortoiseSVN. I can't remember seeing a "transferred X KB"
> output when running 'svn update' on the command line. If it's
> TSVN-specific, it's probably better to try your luck on their
> mailinglist first.
>
> See here: http://tortoisesvn.net/community.html
>
> --
> Johan
>

Re: Tortoise SVN Issue Noticed

Posted by Johan Corveleyn <jc...@gmail.com>.
On Mon, Apr 29, 2013 at 12:17 PM, Thorsten Schöning
<ts...@am-soft.de> wrote:
> Guten Tag Ajay Pawar,
> am Montag, 29. April 2013 um 12:08 schrieben Sie:
>
>> I added a new file XYZ.ppt which is of size 984 kb but still the client shows 0 kb.
>
> As already said, Subversion uses delta transmission, compresses
> content on transmission and my even use some kind of
> deduplication/representation sharing on the client. I'm not sure what
> exactly your problem is? Do you want to force Subversion that only the
> exact amount of data a file on your hard disk needs gets transferred?
> You can't predict how much data gets transferred, simple as that.

I'm wondering if this is actually an 'svn core' issue, or if this is
specific to TortoiseSVN. I can't remember seeing a "transferred X KB"
output when running 'svn update' on the command line. If it's
TSVN-specific, it's probably better to try your luck on their
mailinglist first.

See here: http://tortoisesvn.net/community.html

--
Johan

Re: Tortoise SVN Issue Noticed

Posted by Thorsten Schöning <ts...@am-soft.de>.
Guten Tag Ajay Pawar,
am Montag, 29. April 2013 um 12:08 schrieben Sie:

> I added a new file XYZ.ppt which is of size 984 kb but still the client shows 0 kb.

As already said, Subversion uses delta transmission, compresses
content on transmission and my even use some kind of
deduplication/representation sharing on the client. I'm not sure what
exactly your problem is? Do you want to force Subversion that only the
exact amount of data a file on your hard disk needs gets transferred?
You can't predict how much data gets transferred, simple as that.

Mit freundlichen Grüßen,

Thorsten Schöning

-- 
Thorsten Schöning       E-Mail:Thorsten.Schoening@AM-SoFT.de
AM-SoFT IT-Systeme      http://www.AM-SoFT.de/

Telefon...........05151-  9468- 55
Fax...............05151-  9468- 88
Mobil..............0178-8 9468- 04

AM-SoFT GmbH IT-Systeme, Brandenburger Str. 7c, 31789 Hameln
AG Hannover HRB 207 694 - Geschäftsführer: Andreas Muchow


RE: Tortoise SVN Issue Noticed

Posted by Ajay Pawar <Aj...@kpitcummins.com>.
I added a new file XYZ.ppt which is of size 984 kb but still the client shows 0 kb.

-----Original Message-----
From: Thorsten Schöning [mailto:tschoening@am-soft.de] 
Sent: Monday, April 29, 2013 3:31 PM
To: users@subversion.apache.org
Subject: Re: Tortoise SVN Issue Noticed

Guten Tag Ajay Pawar,
am Montag, 29. April 2013 um 11:28 schrieben Sie:

> When I add the same file in some other location with different name when also the size differs.

I think(!) Subversion uses representation sharing for clients with the new working copy format wc-ng, meaning it is able to detect that data for a given file is already present in the working copy regardless of file names. In those cases it can use the already present data to copy it out of the working copy to any place in the working copy it likes.

Mit freundlichen Grüßen,

Thorsten Schöning

-- 
Thorsten Schöning       E-Mail:Thorsten.Schoening@AM-SoFT.de
AM-SoFT IT-Systeme      http://www.AM-SoFT.de/

Telefon...........05151-  9468- 55
Fax...............05151-  9468- 88
Mobil..............0178-8 9468- 04

AM-SoFT GmbH IT-Systeme, Brandenburger Str. 7c, 31789 Hameln AG Hannover HRB 207 694 - Geschäftsführer: Andreas Muchow



Re: Tortoise SVN Issue Noticed

Posted by Thorsten Schöning <ts...@am-soft.de>.
Guten Tag Ajay Pawar,
am Montag, 29. April 2013 um 11:28 schrieben Sie:

> When I add the same file in some other location with different name when also the size differs.

I think(!) Subversion uses representation sharing for clients with the
new working copy format wc-ng, meaning it is able to detect that data
for a given file is already present in the working copy regardless of
file names. In those cases it can use the already present data to copy
it out of the working copy to any place in the working copy it likes.

Mit freundlichen Grüßen,

Thorsten Schöning

-- 
Thorsten Schöning       E-Mail:Thorsten.Schoening@AM-SoFT.de
AM-SoFT IT-Systeme      http://www.AM-SoFT.de/

Telefon...........05151-  9468- 55
Fax...............05151-  9468- 88
Mobil..............0178-8 9468- 04

AM-SoFT GmbH IT-Systeme, Brandenburger Str. 7c, 31789 Hameln
AG Hannover HRB 207 694 - Geschäftsführer: Andreas Muchow


RE: Tortoise SVN Issue Noticed

Posted by Ajay Pawar <Aj...@kpitcummins.com>.
Hi Johan,

When I add the same file in some other location with different name when also the size differs.

-----Original Message-----
From: Johan Corveleyn [mailto:jcorvel@gmail.com] 
Sent: Monday, April 29, 2013 11:53 AM
To: Ajay Pawar
Cc: Lorenz; users@subversion.apache.org
Subject: Re: Tortoise SVN Issue Noticed

On Mon, Apr 29, 2013 at 7:33 AM, Ajay Pawar <Aj...@kpitcummins.com> wrote:
> Hi Lorenz,
>
> Scenario #1
>
> Thanks for your quick response but when I add the same file in repo browser and then take an update it is showing me the same size .
>

SVN will not transmit the entire file contents if it doesn't need to.
If you have a previous version of the file already in your working copy, the "svn update" will only transmit the delta, which might be very small. SVN uses a binary delta algorithm (xdelta) for sending updates to files.

--
Johan



Re: Tortoise SVN Issue Noticed

Posted by Johan Corveleyn <jc...@gmail.com>.
On Mon, Apr 29, 2013 at 7:33 AM, Ajay Pawar <Aj...@kpitcummins.com> wrote:
> Hi Lorenz,
>
> Scenario #1
>
> Thanks for your quick response but when I add the same file in repo browser and then take an update it is showing me the same size .
>

SVN will not transmit the entire file contents if it doesn't need to.
If you have a previous version of the file already in your working
copy, the "svn update" will only transmit the delta, which might be
very small. SVN uses a binary delta algorithm (xdelta) for sending
updates to files.

--
Johan

RE: Tortoise SVN Issue Noticed

Posted by Ajay Pawar <Aj...@kpitcummins.com>.
Hi Lorenz,

Scenario #1

Thanks for your quick response but when I add the same file in repo browser and then take an update it is showing me the same size . 

Regards,
Ajay


-----Original Message-----
From: Lorenz [mailto:lorenznl@yahoo.com] 
Sent: Monday, April 29, 2013 11:03 AM
To: users@subversion.apache.org
Subject: Re: Tortoise SVN Issue Noticed

Ajay Pawar wrote:
>Scenario #1 :
>
>1. I delete a file(in this case ETools Weekly Presentation_09-Apr-2013.xls Size 540 KB)  from my machine and then Click on 'SVN Update'.
>
>2. After some time, the file gets restored/updated back from the server and the following status is seen on the Client.
>
>3. Error : Notice the statement '2 kBytes transferred in 0 min 38 second' . The file restored was 538 Kb. Then why does the client show this incorrect information.

the file most likely gets restored from the local copy in .svn


>Scenario # 2 :
>
>1. I had a new excel Sheet Created of size 1496 kb. Then right click and slect 'Add'. Then right Click and Select 'SVN Commit.
>
>2. After some time, the client shows '583 kBytes transferred in >>>" . But why does the client report a size which does not seem to match the transaction.

transmissions are compressed
-- 

Lorenz