You are viewing a plain text version of this content. The canonical link for it is here.
Posted to users@httpd.apache.org by Freddie <fr...@madcowdisease.org> on 2005/03/10 10:20:37 UTC
[users@httpd] Bug? 206 partial content logged incorrectly
Hi,
I was just looking over the generated stats for some websites I host, and I
noticed some strange results. Several users have used tools such as GetRight
to download files in multiple parts, and the log entries for these seem
incorrect to me. The actual size of the file is 183,353,344 bytes, but the
total of these log entries ends up being several gigabytes. It's my
understanding that the byte count field is the bytes transferred for this
connection. Any ideas?
Running FreeBSD 4.11-RELEASE, Apache 2.0.53 + mod_php 4.3.10 + mod_scgi 1.2
(all installed from ports)
Freddie
127.0.0.1 - testuser [10/Mar/2005:02:56:34 -0500] "GET /TestFile.zip HTTP/1.1"
206 138030066 "-" "GetRight/5.2 [Segment 3]"
127.0.0.1 - testuser [10/Mar/2005:03:08:58 -0500] "GET /TestFile.zip HTTP/1.1"
206 136931066 "-" "GetRight/5.2 [Segment 1]"
127.0.0.1 - testuser [10/Mar/2005:03:08:58 -0500] "GET /TestFile.zip HTTP/1.1"
206 182513344 "-" "GetRight/5.2 [Segment 0]"
127.0.0.1 - testuser [10/Mar/2005:03:08:59 -0500] "GET /TestFile.zip HTTP/1.1"
206 182513344 "-" "GetRight/5.2 [Segment 0]"
127.0.0.1 - testuser [10/Mar/2005:03:08:59 -0500] "GET /TestFile.zip HTTP/1.1"
206 136929280 "-" "GetRight/5.2 [Segment 1]"
127.0.0.1 - testuser [10/Mar/2005:03:09:04 -0500] "GET /TestFile.zip HTTP/1.1"
206 46832842 "-" "GetRight/5.2 [Segment 3]"
127.0.0.1 - testuser [10/Mar/2005:03:09:04 -0500] "GET /TestFile.zip HTTP/1.1"
206 91310368 "-" "GetRight/5.2 [Segment 2]"
127.0.0.1 - testuser [10/Mar/2005:03:10:28 -0500] "GET /TestFile.zip HTTP/1.1"
206 181379072 "-" "GetRight/5.2 [Segment 0]"
127.0.0.1 - testuser [10/Mar/2005:03:10:36 -0500] "GET /TestFile.zip HTTP/1.1"
206 90206208 "-" "GetRight/5.2 [Segment 2]"
127.0.0.1 - testuser [10/Mar/2005:03:10:37 -0500] "GET /TestFile.zip HTTP/1.1"
206 46115608 "-" "GetRight/5.2 [Segment 3]"
127.0.0.1 - testuser [10/Mar/2005:03:10:36 -0500] "GET /TestFile.zip HTTP/1.1"
206 135950072 "-" "GetRight/5.2 [Segment 1]"
127.0.0.1 - testuser [10/Mar/2005:03:34:41 -0500] "GET /TestFile.zip HTTP/1.1"
206 125542864 "-" "GetRight/5.2 [Segment 1]"
127.0.0.1 - testuser [10/Mar/2005:03:34:38 -0500] "GET /TestFile.zip HTTP/1.1"
206 171949768 "-" "GetRight/5.2 [Segment 0]"
127.0.0.1 - testuser [10/Mar/2005:03:34:41 -0500] "GET /TestFile.zip HTTP/1.1"
206 80761584 "-" "GetRight/5.2 [Segment 2]"
127.0.0.1 - testuser [10/Mar/2005:03:55:36 -0500] "GET /TestFile.zip HTTP/1.1"
206 49443659 "-" "GetRight/5.2 [Segment 1]"
127.0.0.1 - testuser [10/Mar/2005:03:34:41 -0500] "GET /TestFile.zip HTTP/1.1"
206 35073496 "-" "GetRight/5.2 [Segment 3]"
127.0.0.1 - testuser [10/Mar/2005:03:56:23 -0500] "GET /TestFile.zip HTTP/1.1"
206 138032288 "-" "GetRight/5.2 [Segment 0]"
127.0.0.1 - testuser [10/Mar/2005:03:56:23 -0500] "GET /TestFile.zip HTTP/1.1"
206 47831416 "-" "GetRight/5.2 [Segment 1]"
127.0.0.1 - testuser [10/Mar/2005:03:56:24 -0500] "GET /TestFile.zip HTTP/1.1"
206 493912 "-" "GetRight/5.2 [Segment 0]"
---------------------------------------------------------------------
The official User-To-User support forum of the Apache HTTP Server Project.
See <URL:http://httpd.apache.org/userslist.html> for more info.
To unsubscribe, e-mail: users-unsubscribe@httpd.apache.org
" from the digest: users-digest-unsubscribe@httpd.apache.org
For additional commands, e-mail: users-help@httpd.apache.org
Re: [users@httpd] Bug? 206 partial content logged incorrectly
Posted by Freddie <fr...@madcowdisease.org>.
Nope, the user reports the file is coming in at normal speeds. An hour or so
for a ~180MB file is possible on his connection, but several GB in an hour is
definitely not.
Phillip Susi wrote:
> I'm going to take a guess here, but maybe getright is actually
> downloading the same chunks of the file several times, thus wasting
> bandwidth and giving you numbers that add up to more than the file size?
>
> Might be worth looking into.
>
>
> Freddie wrote:
>
>> Hi,
>>
>> I was just looking over the generated stats for some websites I host,
>> and I noticed some strange results. Several users have used tools such
>> as GetRight to download files in multiple parts, and the log entries
>> for these seem incorrect to me. The actual size of the file is
>> 183,353,344 bytes, but the total of these log entries ends up being
>> several gigabytes. It's my understanding that the byte count field is
>> the bytes transferred for this connection. Any ideas?
>>
>> Running FreeBSD 4.11-RELEASE, Apache 2.0.53 + mod_php 4.3.10 +
>> mod_scgi 1.2 (all installed from ports)
>>
>> Freddie
>>
>>
>> 127.0.0.1 - testuser [10/Mar/2005:02:56:34 -0500] "GET /TestFile.zip
>> HTTP/1.1" 206 138030066 "-" "GetRight/5.2 [Segment 3]"
>> 127.0.0.1 - testuser [10/Mar/2005:03:08:58 -0500] "GET /TestFile.zip
>> HTTP/1.1" 206 136931066 "-" "GetRight/5.2 [Segment 1]"
>> 127.0.0.1 - testuser [10/Mar/2005:03:08:58 -0500] "GET /TestFile.zip
>> HTTP/1.1" 206 182513344 "-" "GetRight/5.2 [Segment 0]"
>> 127.0.0.1 - testuser [10/Mar/2005:03:08:59 -0500] "GET /TestFile.zip
>> HTTP/1.1" 206 182513344 "-" "GetRight/5.2 [Segment 0]"
>> 127.0.0.1 - testuser [10/Mar/2005:03:08:59 -0500] "GET /TestFile.zip
>> HTTP/1.1" 206 136929280 "-" "GetRight/5.2 [Segment 1]"
>> 127.0.0.1 - testuser [10/Mar/2005:03:09:04 -0500] "GET /TestFile.zip
>> HTTP/1.1" 206 46832842 "-" "GetRight/5.2 [Segment 3]"
>> 127.0.0.1 - testuser [10/Mar/2005:03:09:04 -0500] "GET /TestFile.zip
>> HTTP/1.1" 206 91310368 "-" "GetRight/5.2 [Segment 2]"
>> 127.0.0.1 - testuser [10/Mar/2005:03:10:28 -0500] "GET /TestFile.zip
>> HTTP/1.1" 206 181379072 "-" "GetRight/5.2 [Segment 0]"
>> 127.0.0.1 - testuser [10/Mar/2005:03:10:36 -0500] "GET /TestFile.zip
>> HTTP/1.1" 206 90206208 "-" "GetRight/5.2 [Segment 2]"
>> 127.0.0.1 - testuser [10/Mar/2005:03:10:37 -0500] "GET /TestFile.zip
>> HTTP/1.1" 206 46115608 "-" "GetRight/5.2 [Segment 3]"
>> 127.0.0.1 - testuser [10/Mar/2005:03:10:36 -0500] "GET /TestFile.zip
>> HTTP/1.1" 206 135950072 "-" "GetRight/5.2 [Segment 1]"
>> 127.0.0.1 - testuser [10/Mar/2005:03:34:41 -0500] "GET /TestFile.zip
>> HTTP/1.1" 206 125542864 "-" "GetRight/5.2 [Segment 1]"
>> 127.0.0.1 - testuser [10/Mar/2005:03:34:38 -0500] "GET /TestFile.zip
>> HTTP/1.1" 206 171949768 "-" "GetRight/5.2 [Segment 0]"
>> 127.0.0.1 - testuser [10/Mar/2005:03:34:41 -0500] "GET /TestFile.zip
>> HTTP/1.1" 206 80761584 "-" "GetRight/5.2 [Segment 2]"
>> 127.0.0.1 - testuser [10/Mar/2005:03:55:36 -0500] "GET /TestFile.zip
>> HTTP/1.1" 206 49443659 "-" "GetRight/5.2 [Segment 1]"
>> 127.0.0.1 - testuser [10/Mar/2005:03:34:41 -0500] "GET /TestFile.zip
>> HTTP/1.1" 206 35073496 "-" "GetRight/5.2 [Segment 3]"
>> 127.0.0.1 - testuser [10/Mar/2005:03:56:23 -0500] "GET /TestFile.zip
>> HTTP/1.1" 206 138032288 "-" "GetRight/5.2 [Segment 0]"
>> 127.0.0.1 - testuser [10/Mar/2005:03:56:23 -0500] "GET /TestFile.zip
>> HTTP/1.1" 206 47831416 "-" "GetRight/5.2 [Segment 1]"
>> 127.0.0.1 - testuser [10/Mar/2005:03:56:24 -0500] "GET /TestFile.zip
>> HTTP/1.1" 206 493912 "-" "GetRight/5.2 [Segment 0]"
>>
>> ---------------------------------------------------------------------
>> The official User-To-User support forum of the Apache HTTP Server
>> Project.
>> See <URL:http://httpd.apache.org/userslist.html> for more info.
>> To unsubscribe, e-mail: users-unsubscribe@httpd.apache.org
>> " from the digest: users-digest-unsubscribe@httpd.apache.org
>> For additional commands, e-mail: users-help@httpd.apache.org
>>
>>
>
>
> ---------------------------------------------------------------------
> The official User-To-User support forum of the Apache HTTP Server Project.
> See <URL:http://httpd.apache.org/userslist.html> for more info.
> To unsubscribe, e-mail: users-unsubscribe@httpd.apache.org
> " from the digest: users-digest-unsubscribe@httpd.apache.org
> For additional commands, e-mail: users-help@httpd.apache.org
>
---------------------------------------------------------------------
The official User-To-User support forum of the Apache HTTP Server Project.
See <URL:http://httpd.apache.org/userslist.html> for more info.
To unsubscribe, e-mail: users-unsubscribe@httpd.apache.org
" from the digest: users-digest-unsubscribe@httpd.apache.org
For additional commands, e-mail: users-help@httpd.apache.org
Re: [users@httpd] Bug? 206 partial content logged incorrectly
Posted by Phillip Susi <ps...@cfl.rr.com>.
I'm going to take a guess here, but maybe getright is actually
downloading the same chunks of the file several times, thus wasting
bandwidth and giving you numbers that add up to more than the file size?
Might be worth looking into.
Freddie wrote:
> Hi,
>
> I was just looking over the generated stats for some websites I host,
> and I noticed some strange results. Several users have used tools such
> as GetRight to download files in multiple parts, and the log entries for
> these seem incorrect to me. The actual size of the file is 183,353,344
> bytes, but the total of these log entries ends up being several
> gigabytes. It's my understanding that the byte count field is the bytes
> transferred for this connection. Any ideas?
>
> Running FreeBSD 4.11-RELEASE, Apache 2.0.53 + mod_php 4.3.10 + mod_scgi
> 1.2 (all installed from ports)
>
> Freddie
>
>
> 127.0.0.1 - testuser [10/Mar/2005:02:56:34 -0500] "GET /TestFile.zip
> HTTP/1.1" 206 138030066 "-" "GetRight/5.2 [Segment 3]"
> 127.0.0.1 - testuser [10/Mar/2005:03:08:58 -0500] "GET /TestFile.zip
> HTTP/1.1" 206 136931066 "-" "GetRight/5.2 [Segment 1]"
> 127.0.0.1 - testuser [10/Mar/2005:03:08:58 -0500] "GET /TestFile.zip
> HTTP/1.1" 206 182513344 "-" "GetRight/5.2 [Segment 0]"
> 127.0.0.1 - testuser [10/Mar/2005:03:08:59 -0500] "GET /TestFile.zip
> HTTP/1.1" 206 182513344 "-" "GetRight/5.2 [Segment 0]"
> 127.0.0.1 - testuser [10/Mar/2005:03:08:59 -0500] "GET /TestFile.zip
> HTTP/1.1" 206 136929280 "-" "GetRight/5.2 [Segment 1]"
> 127.0.0.1 - testuser [10/Mar/2005:03:09:04 -0500] "GET /TestFile.zip
> HTTP/1.1" 206 46832842 "-" "GetRight/5.2 [Segment 3]"
> 127.0.0.1 - testuser [10/Mar/2005:03:09:04 -0500] "GET /TestFile.zip
> HTTP/1.1" 206 91310368 "-" "GetRight/5.2 [Segment 2]"
> 127.0.0.1 - testuser [10/Mar/2005:03:10:28 -0500] "GET /TestFile.zip
> HTTP/1.1" 206 181379072 "-" "GetRight/5.2 [Segment 0]"
> 127.0.0.1 - testuser [10/Mar/2005:03:10:36 -0500] "GET /TestFile.zip
> HTTP/1.1" 206 90206208 "-" "GetRight/5.2 [Segment 2]"
> 127.0.0.1 - testuser [10/Mar/2005:03:10:37 -0500] "GET /TestFile.zip
> HTTP/1.1" 206 46115608 "-" "GetRight/5.2 [Segment 3]"
> 127.0.0.1 - testuser [10/Mar/2005:03:10:36 -0500] "GET /TestFile.zip
> HTTP/1.1" 206 135950072 "-" "GetRight/5.2 [Segment 1]"
> 127.0.0.1 - testuser [10/Mar/2005:03:34:41 -0500] "GET /TestFile.zip
> HTTP/1.1" 206 125542864 "-" "GetRight/5.2 [Segment 1]"
> 127.0.0.1 - testuser [10/Mar/2005:03:34:38 -0500] "GET /TestFile.zip
> HTTP/1.1" 206 171949768 "-" "GetRight/5.2 [Segment 0]"
> 127.0.0.1 - testuser [10/Mar/2005:03:34:41 -0500] "GET /TestFile.zip
> HTTP/1.1" 206 80761584 "-" "GetRight/5.2 [Segment 2]"
> 127.0.0.1 - testuser [10/Mar/2005:03:55:36 -0500] "GET /TestFile.zip
> HTTP/1.1" 206 49443659 "-" "GetRight/5.2 [Segment 1]"
> 127.0.0.1 - testuser [10/Mar/2005:03:34:41 -0500] "GET /TestFile.zip
> HTTP/1.1" 206 35073496 "-" "GetRight/5.2 [Segment 3]"
> 127.0.0.1 - testuser [10/Mar/2005:03:56:23 -0500] "GET /TestFile.zip
> HTTP/1.1" 206 138032288 "-" "GetRight/5.2 [Segment 0]"
> 127.0.0.1 - testuser [10/Mar/2005:03:56:23 -0500] "GET /TestFile.zip
> HTTP/1.1" 206 47831416 "-" "GetRight/5.2 [Segment 1]"
> 127.0.0.1 - testuser [10/Mar/2005:03:56:24 -0500] "GET /TestFile.zip
> HTTP/1.1" 206 493912 "-" "GetRight/5.2 [Segment 0]"
>
> ---------------------------------------------------------------------
> The official User-To-User support forum of the Apache HTTP Server Project.
> See <URL:http://httpd.apache.org/userslist.html> for more info.
> To unsubscribe, e-mail: users-unsubscribe@httpd.apache.org
> " from the digest: users-digest-unsubscribe@httpd.apache.org
> For additional commands, e-mail: users-help@httpd.apache.org
>
>
---------------------------------------------------------------------
The official User-To-User support forum of the Apache HTTP Server Project.
See <URL:http://httpd.apache.org/userslist.html> for more info.
To unsubscribe, e-mail: users-unsubscribe@httpd.apache.org
" from the digest: users-digest-unsubscribe@httpd.apache.org
For additional commands, e-mail: users-help@httpd.apache.org
Re: [users@httpd] Bug? 206 partial content logged incorrectly
Posted by Freddie <fr...@madcowdisease.org>.
Joshua Slive wrote:
> On Thu, 10 Mar 2005 19:50:37 +1030, Freddie <fr...@madcowdisease.org> wrote:
>
>>Hi,
>>
>>I was just looking over the generated stats for some websites I host, and I
>>noticed some strange results. Several users have used tools such as GetRight
>>to download files in multiple parts, and the log entries for these seem
>>incorrect to me. The actual size of the file is 183,353,344 bytes, but the
>>total of these log entries ends up being several gigabytes. It's my
>>understanding that the byte count field is the bytes transferred for this
>>connection. Any ideas?
>
>
> No, the byte count in the log is the number of bytes requested, not
> the number transferred. And many of these "accelerators" (better
> named: bandwidth hoggers) work not by requesting different chunks of
> the file, but rather by making requests for "everything from byte x to
> the end" where byte x changes. Then they simply drop the connection
> when they have what they want.
>
> More accurate byte counts can be obtained using mod_logio:
> http://httpd.apache.org/docs-2.0/mod/mod_logio.html
>
> Joshua.
This seems a bit strange, to be honest. What is the use of logging the number
of bytes requested if the connection is dropped partway through? Requesting
from byte x to the end does seem like a pretty stupid choice on the part of
the "accelerator" authors, though :|
mod_logio looks a lot more useful, I'll try setting up a custom log format and
smacking AWStats until it behaves. Thanks for the info.
Freddie
---------------------------------------------------------------------
The official User-To-User support forum of the Apache HTTP Server Project.
See <URL:http://httpd.apache.org/userslist.html> for more info.
To unsubscribe, e-mail: users-unsubscribe@httpd.apache.org
" from the digest: users-digest-unsubscribe@httpd.apache.org
For additional commands, e-mail: users-help@httpd.apache.org
Re: [users@httpd] Bug? 206 partial content logged incorrectly
Posted by Joshua Slive <js...@gmail.com>.
On Thu, 10 Mar 2005 19:50:37 +1030, Freddie <fr...@madcowdisease.org> wrote:
> Hi,
>
> I was just looking over the generated stats for some websites I host, and I
> noticed some strange results. Several users have used tools such as GetRight
> to download files in multiple parts, and the log entries for these seem
> incorrect to me. The actual size of the file is 183,353,344 bytes, but the
> total of these log entries ends up being several gigabytes. It's my
> understanding that the byte count field is the bytes transferred for this
> connection. Any ideas?
No, the byte count in the log is the number of bytes requested, not
the number transferred. And many of these "accelerators" (better
named: bandwidth hoggers) work not by requesting different chunks of
the file, but rather by making requests for "everything from byte x to
the end" where byte x changes. Then they simply drop the connection
when they have what they want.
More accurate byte counts can be obtained using mod_logio:
http://httpd.apache.org/docs-2.0/mod/mod_logio.html
Joshua.
---------------------------------------------------------------------
The official User-To-User support forum of the Apache HTTP Server Project.
See <URL:http://httpd.apache.org/userslist.html> for more info.
To unsubscribe, e-mail: users-unsubscribe@httpd.apache.org
" from the digest: users-digest-unsubscribe@httpd.apache.org
For additional commands, e-mail: users-help@httpd.apache.org