You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@tomcat.apache.org by bu...@apache.org on 2010/12/01 17:38:08 UTC

DO NOT REPLY [Bug 50394] New: InternalAprInputBuffer.fill() doesn't deal correctly with EOF

https://issues.apache.org/bugzilla/show_bug.cgi?id=50394

           Summary: InternalAprInputBuffer.fill() doesn't deal correctly
                    with EOF
           Product: Tomcat Native
           Version: 1.1.20
          Platform: PC
        OS/Version: Linux
            Status: NEW
          Severity: normal
          Priority: P2
         Component: Library
        AssignedTo: dev@tomcat.apache.org
        ReportedBy: hugh@acunu.com


I'm using tomcat-native-1.1.20 and tomcat-6.0.29 on CentOS 5.5, and I've
written a servlet that is sent large (gigabyte) streams of bytes over HTTP.

>From time to time it fails with the following stacktrace:


Caused by: java.io.IOException
        at
org.apache.coyote.http11.InternalAprInputBuffer.fill(InternalAprInputBuffer.java:798)
        at
org.apache.coyote.http11.InternalAprInputBuffer$SocketInputBuffer.doRead(InternalAprInputBuffer.java:827)
        at
org.apache.coyote.http11.filters.IdentityInputFilter.doRead(IdentityInputFilter.java:116)
        at
org.apache.coyote.http11.InternalAprInputBuffer.doRead(InternalAprInputBuffer.java:738)
        at org.apache.coyote.Request.doRead(Request.java:428)
        at
org.apache.catalina.connector.InputBuffer.realReadBytes(InputBuffer.java:304)
        at org.apache.tomcat.util.buf.ByteChunk.substract(ByteChunk.java:403)
        at org.apache.catalina.connector.InputBuffer.read(InputBuffer.java:327)
        at
org.apache.catalina.connector.CoyoteInputStream.read(CoyoteInputStream.java:193)
        at java.io.BufferedInputStream.read1(BufferedInputStream.java:273)
        at java.io.BufferedInputStream.read(BufferedInputStream.java:334)
        at java.io.FilterInputStream.read(FilterInputStream.java:107)
[...]


Unfortunately, InternalAprInputBuffer throws away the error code on line 798,
but I've run it under a debugger and nRead was -70014.

If you look in the source of apr-1.3.8 at include/apr_errno.h, you'll see this
is -APR_EOF.

The bug is in the implementation of recvbb at line 892 onwards in
tomcat-native-1.1.20-src/jni/native/src/network.c. Specifically, at the end of
the function we check for APR_SUCCESS, and assume all other codes are an error,
returning -ss. It should also check for EOF (APR_STATUS_IS_EOF), and return
zero. (Or at least, InternalAprInputBuffer assumes that a return code of 0 <=>
EOF).

Incidentally, apr-1.3.8/include/apr_network_io.h says in its comment on
apr_socket_recv() that "It is possible for both bytes to be received and an
APR_EOF or other error to be returned.". This is a lie. All provided
implementations of apr_socket_recv return with *len == 0 in case of APR_EOF.

-- 
Configure bugmail: https://issues.apache.org/bugzilla/userprefs.cgi?tab=email
------- You are receiving this mail because: -------
You are the assignee for the bug.

---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@tomcat.apache.org
For additional commands, e-mail: dev-help@tomcat.apache.org


DO NOT REPLY [Bug 50394] InternalAprInputBuffer.fill() doesn't deal correctly with EOF

Posted by bu...@apache.org.
https://issues.apache.org/bugzilla/show_bug.cgi?id=50394

Konstantin Kolinko <kn...@gmail.com> changed:

           What    |Removed                     |Added
----------------------------------------------------------------------------
             Status|RESOLVED                    |REOPENED
         Resolution|FIXED                       |

--- Comment #5 from Konstantin Kolinko <kn...@gmail.com> 2011-08-25 17:26:42 UTC ---
(In reply to comment #3)
> Fix by 1148254 backport proposed.

There is some confusion on the status of this issue.
The r1148254 mentioned above was essentially reverted by r1148815.

The actual fix is in Tomcat-Native 1.1.22 by r1148814.

Native 1.1.22 is already released - you may download it.

It seems that part of r1148815 still needs a backport to 6.0 and 5.5:
s/} else {/} else if (nRead != 0) {/

-- 
Configure bugmail: https://issues.apache.org/bugzilla/userprefs.cgi?tab=email
------- You are receiving this mail because: -------
You are the assignee for the bug.

---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@tomcat.apache.org
For additional commands, e-mail: dev-help@tomcat.apache.org


DO NOT REPLY [Bug 50394] InternalAprInputBuffer.fill() doesn't deal correctly with EOF

Posted by bu...@apache.org.
https://issues.apache.org/bugzilla/show_bug.cgi?id=50394

Konstantin Kolinko <kn...@gmail.com> changed:

           What    |Removed                     |Added
----------------------------------------------------------------------------
             Status|REOPENED                    |RESOLVED
         Resolution|                            |FIXED

--- Comment #10 from Konstantin Kolinko <kn...@gmail.com> 2011-09-16 18:52:09 UTC ---
Fixed in 5.5.x with r1171684 and will be in 5.5.34 onwards.

-- 
Configure bugmail: https://issues.apache.org/bugzilla/userprefs.cgi?tab=email
------- You are receiving this mail because: -------
You are the assignee for the bug.

---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@tomcat.apache.org
For additional commands, e-mail: dev-help@tomcat.apache.org


DO NOT REPLY [Bug 50394] InternalAprInputBuffer.fill() doesn't deal correctly with EOF

Posted by bu...@apache.org.
https://issues.apache.org/bugzilla/show_bug.cgi?id=50394

--- Comment #6 from Konstantin Kolinko <kn...@gmail.com> 2011-08-26 12:33:39 UTC ---
Created attachment 27437
  --> https://issues.apache.org/bugzilla/attachment.cgi?id=27437
2011-08-26_tc55_50394_InternalAprInputBuffer.patch

-- 
Configure bugmail: https://issues.apache.org/bugzilla/userprefs.cgi?tab=email
------- You are receiving this mail because: -------
You are the assignee for the bug.

---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@tomcat.apache.org
For additional commands, e-mail: dev-help@tomcat.apache.org


DO NOT REPLY [Bug 50394] InternalAprInputBuffer.fill() doesn't deal correctly with EOF

Posted by bu...@apache.org.
https://issues.apache.org/bugzilla/show_bug.cgi?id=50394

--- Comment #9 from Mark Thomas <ma...@apache.org> 2011-09-02 11:53:16 UTC ---
Fixed in 6.0.x and will be included in 6.0.34 onwards

-- 
Configure bugmail: https://issues.apache.org/bugzilla/userprefs.cgi?tab=email
------- You are receiving this mail because: -------
You are the assignee for the bug.

---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@tomcat.apache.org
For additional commands, e-mail: dev-help@tomcat.apache.org


DO NOT REPLY [Bug 50394] InternalAprInputBuffer.fill() doesn't deal correctly with EOF

Posted by bu...@apache.org.
https://issues.apache.org/bugzilla/show_bug.cgi?id=50394

jfclere <jf...@gmail.com> changed:

           What    |Removed                     |Added
----------------------------------------------------------------------------
             Status|REOPENED                    |RESOLVED
         Resolution|                            |FIXED

--- Comment #3 from jfclere <jf...@gmail.com> 2011-07-19 09:39:49 UTC ---
Fix by 1148254 backport proposed.

-- 
Configure bugmail: https://issues.apache.org/bugzilla/userprefs.cgi?tab=email
------- You are receiving this mail because: -------
You are the assignee for the bug.

---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@tomcat.apache.org
For additional commands, e-mail: dev-help@tomcat.apache.org


DO NOT REPLY [Bug 50394] InternalAprInputBuffer.fill() doesn't deal correctly with EOF

Posted by bu...@apache.org.
https://issues.apache.org/bugzilla/show_bug.cgi?id=50394

jfclere <jf...@gmail.com> changed:

           What    |Removed                     |Added
----------------------------------------------------------------------------
             Status|NEW                         |RESOLVED
         Resolution|                            |INVALID

--- Comment #1 from jfclere <jf...@gmail.com> 2011-03-10 07:43:44 EST ---
The code in org/apache/coyote/http11/InternalAprInputBuffer is:
+++
            nRead = Socket.recvbb(socket, 0, buf.length - lastValid);
            if (nRead > 0) {
                bbuf.limit(nRead);
                bbuf.get(buf, pos, nRead);
                lastValid = pos + nRead;
            } else {
                if ((-nRead) == Status.ETIMEDOUT || (-nRead) == Status.TIMEUP)
{
                    throw new
SocketTimeoutException(sm.getString("iib.failedread"));
                } else {
                    throw new IOException(sm.getString("iib.failedread"));
                }
            }
+++
So returning 0 won't help.

-- 
Configure bugmail: https://issues.apache.org/bugzilla/userprefs.cgi?tab=email
------- You are receiving this mail because: -------
You are the assignee for the bug.

---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@tomcat.apache.org
For additional commands, e-mail: dev-help@tomcat.apache.org


DO NOT REPLY [Bug 50394] InternalAprInputBuffer.fill() doesn't deal correctly with EOF

Posted by bu...@apache.org.
https://issues.apache.org/bugzilla/show_bug.cgi?id=50394

Hugh Warrington <hu...@acunu.com> changed:

           What    |Removed                     |Added
----------------------------------------------------------------------------
                 CC|                            |hugh@acunu.com

-- 
Configure bugmail: https://issues.apache.org/bugzilla/userprefs.cgi?tab=email
------- You are receiving this mail because: -------
You are the assignee for the bug.

---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@tomcat.apache.org
For additional commands, e-mail: dev-help@tomcat.apache.org


DO NOT REPLY [Bug 50394] InternalAprInputBuffer.fill() doesn't deal correctly with EOF

Posted by bu...@apache.org.
https://issues.apache.org/bugzilla/show_bug.cgi?id=50394

--- Comment #4 from Rohini <ro...@gmail.com> 2011-08-25 16:58:33 UTC ---
We hit this issue yesterday with tomcat-native-1.1.20 when uploading 1G file.
But found that if we did not use BufferedInputStream and read directly into a
buffer it worked fine. 

InputStream in = request.getInputStream(); //new
BufferedInputStream(request.getInputStream());
int bytesRead;
      while ((bytesRead = in.read(buf)) != -1) {
        out.write(buf, 0, bytesRead);
      }

-- 
Configure bugmail: https://issues.apache.org/bugzilla/userprefs.cgi?tab=email
------- You are receiving this mail because: -------
You are the assignee for the bug.

---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@tomcat.apache.org
For additional commands, e-mail: dev-help@tomcat.apache.org


DO NOT REPLY [Bug 50394] InternalAprInputBuffer.fill() doesn't deal correctly with EOF

Posted by bu...@apache.org.
https://issues.apache.org/bugzilla/show_bug.cgi?id=50394

--- Comment #8 from Konstantin Kolinko <kn...@gmail.com> 2011-08-26 12:43:33 UTC ---
Proposed the patches for Tomcat 6.0 and 5.5.

-- 
Configure bugmail: https://issues.apache.org/bugzilla/userprefs.cgi?tab=email
------- You are receiving this mail because: -------
You are the assignee for the bug.

---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@tomcat.apache.org
For additional commands, e-mail: dev-help@tomcat.apache.org


DO NOT REPLY [Bug 50394] InternalAprInputBuffer.fill() doesn't deal correctly with EOF

Posted by bu...@apache.org.
https://issues.apache.org/bugzilla/show_bug.cgi?id=50394

--- Comment #7 from Konstantin Kolinko <kn...@gmail.com> 2011-08-26 12:34:10 UTC ---
Created attachment 27438
  --> https://issues.apache.org/bugzilla/attachment.cgi?id=27438
2011-08-26_tc6_50394_InternalAprInputBuffer.patch

-- 
Configure bugmail: https://issues.apache.org/bugzilla/userprefs.cgi?tab=email
------- You are receiving this mail because: -------
You are the assignee for the bug.

---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@tomcat.apache.org
For additional commands, e-mail: dev-help@tomcat.apache.org


DO NOT REPLY [Bug 50394] InternalAprInputBuffer.fill() doesn't deal correctly with EOF

Posted by bu...@apache.org.
https://issues.apache.org/bugzilla/show_bug.cgi?id=50394

Hugh Warrington <hu...@acunu.com> changed:

           What    |Removed                     |Added
----------------------------------------------------------------------------
             Status|RESOLVED                    |REOPENED
         Resolution|INVALID                     |

--- Comment #2 from Hugh Warrington <hu...@acunu.com> 2011-03-15 11:52:12 EDT ---
Ok, well perhaps my proposed fix won't work, but this is still an issue since
it's not conforming to the InputStream specification.

-- 
Configure bugmail: https://issues.apache.org/bugzilla/userprefs.cgi?tab=email
------- You are receiving this mail because: -------
You are the assignee for the bug.

---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@tomcat.apache.org
For additional commands, e-mail: dev-help@tomcat.apache.org