You are viewing a plain text version of this content. The canonical link for it is here.
Posted to infrastructure-issues@apache.org by "Michael McCandless (JIRA)" <ji...@apache.org> on 2008/01/03 11:59:34 UTC

[jira] Created: (INFRA-1460) Intermittent SVN checkout errors during Lucene nightly build

Intermittent SVN checkout errors during Lucene nightly build
------------------------------------------------------------

                 Key: INFRA-1460
                 URL: https://issues.apache.org/jira/browse/INFRA-1460
             Project: Infrastructure
          Issue Type: Bug
      Security Level: public (Regular issues)
          Components: Subversion
            Reporter: Michael McCandless
            Priority: Minor


We've been seeing the Lucene nightly build fail occasionally from
exceptions during SVN checkout.

In the past it was somewhat rare (maybe 1 in 15 builds) but suddenly
in the past few days it seems to be happening much more frequently.

The exceptions are rather "varied".  My only guess is some sort of low
level network communication issue (especially the SSL error below)?
Maybe there are corresponding errors in the svn server logs?  Maybe
other projects are seeing similar exceptions?

When our nightly build hits this, the build aborts and it's marked as
failed.

Here's the first example:

ERROR: Failed to check out https://svn.apache.org/repos/asf/lucene/java/trunk
org.tmatesoft.svn.core.SVNException: svn: REPORT request failed on '/repos/asf/!svn/vcc/default'
svn: SSL peer shut down incorrectly
	at org.tmatesoft.svn.core.internal.wc.SVNErrorManager.error(SVNErrorManager.java:80)
	at org.tmatesoft.svn.core.internal.io.dav.http.HTTPConnection.request(HTTPConnection.java:517)
	at org.tmatesoft.svn.core.internal.io.dav.http.HTTPConnection.request(HTTPConnection.java:234)
	at org.tmatesoft.svn.core.internal.io.dav.http.HTTPConnection.request(HTTPConnection.java:222)
	at org.tmatesoft.svn.core.internal.io.dav.DAVConnection.doReport(DAVConnection.java:219)
	at org.tmatesoft.svn.core.internal.io.dav.DAVConnection.doReport(DAVConnection.java:211)
	at org.tmatesoft.svn.core.internal.io.dav.DAVRepository.update(DAVRepository.java:609)
	at org.tmatesoft.svn.core.wc.SVNUpdateClient.doUpdate(SVNUpdateClient.java:162)
	at org.tmatesoft.svn.core.wc.SVNUpdateClient.doCheckout(SVNUpdateClient.java:325)
	at hudson.scm.SubversionSCM$CheckOutTask.invoke(SubversionSCM.java:397)
	at hudson.scm.SubversionSCM$CheckOutTask.invoke(SubversionSCM.java:349)
	at hudson.FilePath.act(FilePath.java:291)
	at hudson.scm.SubversionSCM.checkout(SubversionSCM.java:346)
	at hudson.scm.SubversionSCM.checkout(SubversionSCM.java:292)
	at hudson.model.AbstractProject.checkout(AbstractProject.java:541)
	at hudson.model.AbstractBuild$AbstractRunner.checkout(AbstractBuild.java:223)
	at hudson.model.AbstractBuild$AbstractRunner.run(AbstractBuild.java:189)
	at hudson.model.Run.run(Run.java:649)
	at hudson.model.Build.run(Build.java:102)
	at hudson.model.ResourceController.execute(ResourceController.java:70)
	at hudson.model.Executor.run(Executor.java:64)


2nd example:

ERROR: Failed to check out http://svn.apache.org/repos/asf/lucene/java/trunk
org.tmatesoft.svn.core.SVNException: svn: REPORT request failed on '/repos/asf/!svn/vcc/default'
svn: CRLF expected at end of chunk: 151/115
	at org.tmatesoft.svn.core.internal.wc.SVNErrorManager.error(SVNErrorManager.java:80)
	at org.tmatesoft.svn.core.internal.io.dav.http.HTTPConnection.request(HTTPConnection.java:517)
	at org.tmatesoft.svn.core.internal.io.dav.http.HTTPConnection.request(HTTPConnection.java:234)
	at org.tmatesoft.svn.core.internal.io.dav.http.HTTPConnection.request(HTTPConnection.java:222)
	at org.tmatesoft.svn.core.internal.io.dav.DAVConnection.doReport(DAVConnection.java:219)
	at org.tmatesoft.svn.core.internal.io.dav.DAVConnection.doReport(DAVConnection.java:211)
	at org.tmatesoft.svn.core.internal.io.dav.DAVRepository.update(DAVRepository.java:609)
	at org.tmatesoft.svn.core.wc.SVNUpdateClient.doUpdate(SVNUpdateClient.java:162)
	at org.tmatesoft.svn.core.wc.SVNUpdateClient.doCheckout(SVNUpdateClient.java:325)
	at hudson.scm.SubversionSCM$CheckOutTask.invoke(SubversionSCM.java:397)
	at hudson.scm.SubversionSCM$CheckOutTask.invoke(SubversionSCM.java:349)
	at hudson.FilePath.act(FilePath.java:291)
	at hudson.scm.SubversionSCM.checkout(SubversionSCM.java:346)
	at hudson.scm.SubversionSCM.checkout(SubversionSCM.java:292)
	at hudson.model.AbstractProject.checkout(AbstractProject.java:541)
	at hudson.model.AbstractBuild$AbstractRunner.checkout(AbstractBuild.java:223)
	at hudson.model.AbstractBuild$AbstractRunner.run(AbstractBuild.java:189)
	at hudson.model.Run.run(Run.java:649)
	at hudson.model.Build.run(Build.java:102)
	at hudson.model.ResourceController.execute(ResourceController.java:70)
	at hudson.model.Executor.run(Executor.java:64)



3rd example:

FATAL: Java heap space
java.lang.OutOfMemoryError: Java heap space
	at org.tmatesoft.svn.core.internal.delta.SVNDeltaReader.deflate(SVNDeltaReader.java:163)
	at org.tmatesoft.svn.core.internal.delta.SVNDeltaReader.nextWindow(SVNDeltaReader.java:127)
	at org.tmatesoft.svn.core.internal.io.dav.handlers.BasicDAVDeltaHandler.characters(BasicDAVDeltaHandler.java:96)
	at com.sun.org.apache.xerces.internal.parsers.AbstractSAXParser.characters(AbstractSAXParser.java:538)
	at com.sun.org.apache.xerces.internal.impl.XMLDocumentFragmentScannerImpl.scanDocument(XMLDocumentFragmentScannerImpl.java:461)
	at com.sun.org.apache.xerces.internal.parsers.XML11Configuration.parse(XML11Configuration.java:807)
	at com.sun.org.apache.xerces.internal.parsers.XML11Configuration.parse(XML11Configuration.java:737)
	at com.sun.org.apache.xerces.internal.parsers.XMLParser.parse(XMLParser.java:107)
	at com.sun.org.apache.xerces.internal.parsers.AbstractSAXParser.parse(AbstractSAXParser.java:1205)
	at com.sun.org.apache.xerces.internal.jaxp.SAXParserImpl$JAXPSAXParser.parse(SAXParserImpl.java:522)
	at org.tmatesoft.svn.core.internal.io.dav.http.HTTPConnection.readData(HTTPConnection.java:646)
	at org.tmatesoft.svn.core.internal.io.dav.http.HTTPConnection.readData(HTTPConnection.java:611)
	at org.tmatesoft.svn.core.internal.io.dav.http.HTTPRequest.dispatch(HTTPRequest.java:196)
	at org.tmatesoft.svn.core.internal.io.dav.http.HTTPConnection.request(HTTPConnection.java:289)
	at org.tmatesoft.svn.core.internal.io.dav.http.HTTPConnection.request(HTTPConnection.java:234)
	at org.tmatesoft.svn.core.internal.io.dav.http.HTTPConnection.request(HTTPConnection.java:222)
	at org.tmatesoft.svn.core.internal.io.dav.DAVConnection.doReport(DAVConnection.java:219)
	at org.tmatesoft.svn.core.internal.io.dav.DAVConnection.doReport(DAVConnection.java:211)
	at org.tmatesoft.svn.core.internal.io.dav.DAVRepository.update(DAVRepository.java:609)
	at org.tmatesoft.svn.core.wc.SVNUpdateClient.doUpdate(SVNUpdateClient.java:162)
	at org.tmatesoft.svn.core.wc.SVNUpdateClient.doCheckout(SVNUpdateClient.java:325)
	at hudson.scm.SubversionSCM$CheckOutTask.invoke(SubversionSCM.java:397)
	at hudson.scm.SubversionSCM$CheckOutTask.invoke(SubversionSCM.java:349)
	at hudson.FilePath.act(FilePath.java:291)
	at hudson.scm.SubversionSCM.checkout(SubversionSCM.java:346)
	at hudson.scm.SubversionSCM.checkout(SubversionSCM.java:292)
	at hudson.model.AbstractProject.checkout(AbstractProject.java:541)
	at hudson.model.AbstractBuild$AbstractRunner.checkout(AbstractBuild.java:223)
	at hudson.model.AbstractBuild$AbstractRunner.run(AbstractBuild.java:189)
	at hudson.model.Run.run(Run.java:649)
	at hudson.model.Build.run(Build.java:102)
	at hudson.model.ResourceController.execute(ResourceController.java:70)



4th example:

ERROR: Failed to check out http://svn.apache.org/repos/asf/lucene/java/trunk
org.tmatesoft.svn.core.SVNException: svn: REPORT request failed on '/repos/asf/!svn/vcc/default'
svn: Processing REPORT request response failed: The element type "S:txdelta" must be terminated by the matching end-tag "</S:txdelta>". (/repos/asf/!svn/vcc/default) 
	at org.tmatesoft.svn.core.internal.wc.SVNErrorManager.error(SVNErrorManager.java:80)
	at org.tmatesoft.svn.core.internal.io.dav.http.HTTPConnection.request(HTTPConnection.java:517)
	at org.tmatesoft.svn.core.internal.io.dav.http.HTTPConnection.request(HTTPConnection.java:234)
	at org.tmatesoft.svn.core.internal.io.dav.http.HTTPConnection.request(HTTPConnection.java:222)
	at org.tmatesoft.svn.core.internal.io.dav.DAVConnection.doReport(DAVConnection.java:219)
	at org.tmatesoft.svn.core.internal.io.dav.DAVConnection.doReport(DAVConnection.java:211)
	at org.tmatesoft.svn.core.internal.io.dav.DAVRepository.update(DAVRepository.java:609)
	at org.tmatesoft.svn.core.wc.SVNUpdateClient.doUpdate(SVNUpdateClient.java:162)
	at org.tmatesoft.svn.core.wc.SVNUpdateClient.doCheckout(SVNUpdateClient.java:325)
	at hudson.scm.SubversionSCM$CheckOutTask.invoke(SubversionSCM.java:397)
	at hudson.scm.SubversionSCM$CheckOutTask.invoke(SubversionSCM.java:349)
	at hudson.FilePath.act(FilePath.java:291)
	at hudson.scm.SubversionSCM.checkout(SubversionSCM.java:346)
	at hudson.scm.SubversionSCM.checkout(SubversionSCM.java:292)
	at hudson.model.AbstractProject.checkout(AbstractProject.java:541)
	at hudson.model.AbstractBuild$AbstractRunner.checkout(AbstractBuild.java:223)
	at hudson.model.AbstractBuild$AbstractRunner.run(AbstractBuild.java:189)
	at hudson.model.Run.run(Run.java:649)
	at hudson.model.Build.run(Build.java:102)
	at hudson.model.ResourceController.execute(ResourceController.java:70)
	at hudson.model.Executor.run(Executor.java:64)


-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Updated: (INFRA-1460) Intermittent SVN checkout errors during Lucene nightly build

Posted by "Michael McCandless (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/INFRA-1460?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Michael McCandless updated INFRA-1460:
--------------------------------------

    Priority: Major  (was: Minor)

> Intermittent SVN checkout errors during Lucene nightly build
> ------------------------------------------------------------
>
>                 Key: INFRA-1460
>                 URL: https://issues.apache.org/jira/browse/INFRA-1460
>             Project: Infrastructure
>          Issue Type: Bug
>      Security Level: public(Regular issues) 
>          Components: Subversion
>            Reporter: Michael McCandless
>
> We've been seeing the Lucene nightly build fail occasionally from
> exceptions during SVN checkout.
> In the past it was somewhat rare (maybe 1 in 15 builds) but suddenly
> in the past few days it seems to be happening much more frequently.
> The exceptions are rather "varied".  My only guess is some sort of low
> level network communication issue (especially the SSL error below)?
> Maybe there are corresponding errors in the svn server logs?  Maybe
> other projects are seeing similar exceptions?
> When our nightly build hits this, the build aborts and it's marked as
> failed.
> Here's the first example:
> ERROR: Failed to check out https://svn.apache.org/repos/asf/lucene/java/trunk
> org.tmatesoft.svn.core.SVNException: svn: REPORT request failed on '/repos/asf/!svn/vcc/default'
> svn: SSL peer shut down incorrectly
> 	at org.tmatesoft.svn.core.internal.wc.SVNErrorManager.error(SVNErrorManager.java:80)
> 	at org.tmatesoft.svn.core.internal.io.dav.http.HTTPConnection.request(HTTPConnection.java:517)
> 	at org.tmatesoft.svn.core.internal.io.dav.http.HTTPConnection.request(HTTPConnection.java:234)
> 	at org.tmatesoft.svn.core.internal.io.dav.http.HTTPConnection.request(HTTPConnection.java:222)
> 	at org.tmatesoft.svn.core.internal.io.dav.DAVConnection.doReport(DAVConnection.java:219)
> 	at org.tmatesoft.svn.core.internal.io.dav.DAVConnection.doReport(DAVConnection.java:211)
> 	at org.tmatesoft.svn.core.internal.io.dav.DAVRepository.update(DAVRepository.java:609)
> 	at org.tmatesoft.svn.core.wc.SVNUpdateClient.doUpdate(SVNUpdateClient.java:162)
> 	at org.tmatesoft.svn.core.wc.SVNUpdateClient.doCheckout(SVNUpdateClient.java:325)
> 	at hudson.scm.SubversionSCM$CheckOutTask.invoke(SubversionSCM.java:397)
> 	at hudson.scm.SubversionSCM$CheckOutTask.invoke(SubversionSCM.java:349)
> 	at hudson.FilePath.act(FilePath.java:291)
> 	at hudson.scm.SubversionSCM.checkout(SubversionSCM.java:346)
> 	at hudson.scm.SubversionSCM.checkout(SubversionSCM.java:292)
> 	at hudson.model.AbstractProject.checkout(AbstractProject.java:541)
> 	at hudson.model.AbstractBuild$AbstractRunner.checkout(AbstractBuild.java:223)
> 	at hudson.model.AbstractBuild$AbstractRunner.run(AbstractBuild.java:189)
> 	at hudson.model.Run.run(Run.java:649)
> 	at hudson.model.Build.run(Build.java:102)
> 	at hudson.model.ResourceController.execute(ResourceController.java:70)
> 	at hudson.model.Executor.run(Executor.java:64)
> 2nd example:
> ERROR: Failed to check out http://svn.apache.org/repos/asf/lucene/java/trunk
> org.tmatesoft.svn.core.SVNException: svn: REPORT request failed on '/repos/asf/!svn/vcc/default'
> svn: CRLF expected at end of chunk: 151/115
> 	at org.tmatesoft.svn.core.internal.wc.SVNErrorManager.error(SVNErrorManager.java:80)
> 	at org.tmatesoft.svn.core.internal.io.dav.http.HTTPConnection.request(HTTPConnection.java:517)
> 	at org.tmatesoft.svn.core.internal.io.dav.http.HTTPConnection.request(HTTPConnection.java:234)
> 	at org.tmatesoft.svn.core.internal.io.dav.http.HTTPConnection.request(HTTPConnection.java:222)
> 	at org.tmatesoft.svn.core.internal.io.dav.DAVConnection.doReport(DAVConnection.java:219)
> 	at org.tmatesoft.svn.core.internal.io.dav.DAVConnection.doReport(DAVConnection.java:211)
> 	at org.tmatesoft.svn.core.internal.io.dav.DAVRepository.update(DAVRepository.java:609)
> 	at org.tmatesoft.svn.core.wc.SVNUpdateClient.doUpdate(SVNUpdateClient.java:162)
> 	at org.tmatesoft.svn.core.wc.SVNUpdateClient.doCheckout(SVNUpdateClient.java:325)
> 	at hudson.scm.SubversionSCM$CheckOutTask.invoke(SubversionSCM.java:397)
> 	at hudson.scm.SubversionSCM$CheckOutTask.invoke(SubversionSCM.java:349)
> 	at hudson.FilePath.act(FilePath.java:291)
> 	at hudson.scm.SubversionSCM.checkout(SubversionSCM.java:346)
> 	at hudson.scm.SubversionSCM.checkout(SubversionSCM.java:292)
> 	at hudson.model.AbstractProject.checkout(AbstractProject.java:541)
> 	at hudson.model.AbstractBuild$AbstractRunner.checkout(AbstractBuild.java:223)
> 	at hudson.model.AbstractBuild$AbstractRunner.run(AbstractBuild.java:189)
> 	at hudson.model.Run.run(Run.java:649)
> 	at hudson.model.Build.run(Build.java:102)
> 	at hudson.model.ResourceController.execute(ResourceController.java:70)
> 	at hudson.model.Executor.run(Executor.java:64)
> 3rd example:
> FATAL: Java heap space
> java.lang.OutOfMemoryError: Java heap space
> 	at org.tmatesoft.svn.core.internal.delta.SVNDeltaReader.deflate(SVNDeltaReader.java:163)
> 	at org.tmatesoft.svn.core.internal.delta.SVNDeltaReader.nextWindow(SVNDeltaReader.java:127)
> 	at org.tmatesoft.svn.core.internal.io.dav.handlers.BasicDAVDeltaHandler.characters(BasicDAVDeltaHandler.java:96)
> 	at com.sun.org.apache.xerces.internal.parsers.AbstractSAXParser.characters(AbstractSAXParser.java:538)
> 	at com.sun.org.apache.xerces.internal.impl.XMLDocumentFragmentScannerImpl.scanDocument(XMLDocumentFragmentScannerImpl.java:461)
> 	at com.sun.org.apache.xerces.internal.parsers.XML11Configuration.parse(XML11Configuration.java:807)
> 	at com.sun.org.apache.xerces.internal.parsers.XML11Configuration.parse(XML11Configuration.java:737)
> 	at com.sun.org.apache.xerces.internal.parsers.XMLParser.parse(XMLParser.java:107)
> 	at com.sun.org.apache.xerces.internal.parsers.AbstractSAXParser.parse(AbstractSAXParser.java:1205)
> 	at com.sun.org.apache.xerces.internal.jaxp.SAXParserImpl$JAXPSAXParser.parse(SAXParserImpl.java:522)
> 	at org.tmatesoft.svn.core.internal.io.dav.http.HTTPConnection.readData(HTTPConnection.java:646)
> 	at org.tmatesoft.svn.core.internal.io.dav.http.HTTPConnection.readData(HTTPConnection.java:611)
> 	at org.tmatesoft.svn.core.internal.io.dav.http.HTTPRequest.dispatch(HTTPRequest.java:196)
> 	at org.tmatesoft.svn.core.internal.io.dav.http.HTTPConnection.request(HTTPConnection.java:289)
> 	at org.tmatesoft.svn.core.internal.io.dav.http.HTTPConnection.request(HTTPConnection.java:234)
> 	at org.tmatesoft.svn.core.internal.io.dav.http.HTTPConnection.request(HTTPConnection.java:222)
> 	at org.tmatesoft.svn.core.internal.io.dav.DAVConnection.doReport(DAVConnection.java:219)
> 	at org.tmatesoft.svn.core.internal.io.dav.DAVConnection.doReport(DAVConnection.java:211)
> 	at org.tmatesoft.svn.core.internal.io.dav.DAVRepository.update(DAVRepository.java:609)
> 	at org.tmatesoft.svn.core.wc.SVNUpdateClient.doUpdate(SVNUpdateClient.java:162)
> 	at org.tmatesoft.svn.core.wc.SVNUpdateClient.doCheckout(SVNUpdateClient.java:325)
> 	at hudson.scm.SubversionSCM$CheckOutTask.invoke(SubversionSCM.java:397)
> 	at hudson.scm.SubversionSCM$CheckOutTask.invoke(SubversionSCM.java:349)
> 	at hudson.FilePath.act(FilePath.java:291)
> 	at hudson.scm.SubversionSCM.checkout(SubversionSCM.java:346)
> 	at hudson.scm.SubversionSCM.checkout(SubversionSCM.java:292)
> 	at hudson.model.AbstractProject.checkout(AbstractProject.java:541)
> 	at hudson.model.AbstractBuild$AbstractRunner.checkout(AbstractBuild.java:223)
> 	at hudson.model.AbstractBuild$AbstractRunner.run(AbstractBuild.java:189)
> 	at hudson.model.Run.run(Run.java:649)
> 	at hudson.model.Build.run(Build.java:102)
> 	at hudson.model.ResourceController.execute(ResourceController.java:70)
> 4th example:
> ERROR: Failed to check out http://svn.apache.org/repos/asf/lucene/java/trunk
> org.tmatesoft.svn.core.SVNException: svn: REPORT request failed on '/repos/asf/!svn/vcc/default'
> svn: Processing REPORT request response failed: The element type "S:txdelta" must be terminated by the matching end-tag "</S:txdelta>". (/repos/asf/!svn/vcc/default) 
> 	at org.tmatesoft.svn.core.internal.wc.SVNErrorManager.error(SVNErrorManager.java:80)
> 	at org.tmatesoft.svn.core.internal.io.dav.http.HTTPConnection.request(HTTPConnection.java:517)
> 	at org.tmatesoft.svn.core.internal.io.dav.http.HTTPConnection.request(HTTPConnection.java:234)
> 	at org.tmatesoft.svn.core.internal.io.dav.http.HTTPConnection.request(HTTPConnection.java:222)
> 	at org.tmatesoft.svn.core.internal.io.dav.DAVConnection.doReport(DAVConnection.java:219)
> 	at org.tmatesoft.svn.core.internal.io.dav.DAVConnection.doReport(DAVConnection.java:211)
> 	at org.tmatesoft.svn.core.internal.io.dav.DAVRepository.update(DAVRepository.java:609)
> 	at org.tmatesoft.svn.core.wc.SVNUpdateClient.doUpdate(SVNUpdateClient.java:162)
> 	at org.tmatesoft.svn.core.wc.SVNUpdateClient.doCheckout(SVNUpdateClient.java:325)
> 	at hudson.scm.SubversionSCM$CheckOutTask.invoke(SubversionSCM.java:397)
> 	at hudson.scm.SubversionSCM$CheckOutTask.invoke(SubversionSCM.java:349)
> 	at hudson.FilePath.act(FilePath.java:291)
> 	at hudson.scm.SubversionSCM.checkout(SubversionSCM.java:346)
> 	at hudson.scm.SubversionSCM.checkout(SubversionSCM.java:292)
> 	at hudson.model.AbstractProject.checkout(AbstractProject.java:541)
> 	at hudson.model.AbstractBuild$AbstractRunner.checkout(AbstractBuild.java:223)
> 	at hudson.model.AbstractBuild$AbstractRunner.run(AbstractBuild.java:189)
> 	at hudson.model.Run.run(Run.java:649)
> 	at hudson.model.Build.run(Build.java:102)
> 	at hudson.model.ResourceController.execute(ResourceController.java:70)
> 	at hudson.model.Executor.run(Executor.java:64)

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Commented: (INFRA-1460) Intermittent SVN checkout errors during Lucene nightly build

Posted by "Mads Toftum (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/INFRA-1460?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12557402#action_12557402 ] 

Mads Toftum commented on INFRA-1460:
------------------------------------

One of the batteries failed on the raid array, so the write caching is off which makes things a whole lot slower than usual. That should improve with a new battery and more disks in the array.
Also remember that this is a shared system and there might well be others hitting the disk hard at the same time which you can't see inside the lucene zone.


> Intermittent SVN checkout errors during Lucene nightly build
> ------------------------------------------------------------
>
>                 Key: INFRA-1460
>                 URL: https://issues.apache.org/jira/browse/INFRA-1460
>             Project: Infrastructure
>          Issue Type: Bug
>      Security Level: public(Regular issues) 
>          Components: Subversion
>            Reporter: Michael McCandless
>
> We've been seeing the Lucene nightly build fail occasionally from
> exceptions during SVN checkout.
> In the past it was somewhat rare (maybe 1 in 15 builds) but suddenly
> in the past few days it seems to be happening much more frequently.
> The exceptions are rather "varied".  My only guess is some sort of low
> level network communication issue (especially the SSL error below)?
> Maybe there are corresponding errors in the svn server logs?  Maybe
> other projects are seeing similar exceptions?
> When our nightly build hits this, the build aborts and it's marked as
> failed.
> Here's the first example:
> ERROR: Failed to check out https://svn.apache.org/repos/asf/lucene/java/trunk
> org.tmatesoft.svn.core.SVNException: svn: REPORT request failed on '/repos/asf/!svn/vcc/default'
> svn: SSL peer shut down incorrectly
> 	at org.tmatesoft.svn.core.internal.wc.SVNErrorManager.error(SVNErrorManager.java:80)
> 	at org.tmatesoft.svn.core.internal.io.dav.http.HTTPConnection.request(HTTPConnection.java:517)
> 	at org.tmatesoft.svn.core.internal.io.dav.http.HTTPConnection.request(HTTPConnection.java:234)
> 	at org.tmatesoft.svn.core.internal.io.dav.http.HTTPConnection.request(HTTPConnection.java:222)
> 	at org.tmatesoft.svn.core.internal.io.dav.DAVConnection.doReport(DAVConnection.java:219)
> 	at org.tmatesoft.svn.core.internal.io.dav.DAVConnection.doReport(DAVConnection.java:211)
> 	at org.tmatesoft.svn.core.internal.io.dav.DAVRepository.update(DAVRepository.java:609)
> 	at org.tmatesoft.svn.core.wc.SVNUpdateClient.doUpdate(SVNUpdateClient.java:162)
> 	at org.tmatesoft.svn.core.wc.SVNUpdateClient.doCheckout(SVNUpdateClient.java:325)
> 	at hudson.scm.SubversionSCM$CheckOutTask.invoke(SubversionSCM.java:397)
> 	at hudson.scm.SubversionSCM$CheckOutTask.invoke(SubversionSCM.java:349)
> 	at hudson.FilePath.act(FilePath.java:291)
> 	at hudson.scm.SubversionSCM.checkout(SubversionSCM.java:346)
> 	at hudson.scm.SubversionSCM.checkout(SubversionSCM.java:292)
> 	at hudson.model.AbstractProject.checkout(AbstractProject.java:541)
> 	at hudson.model.AbstractBuild$AbstractRunner.checkout(AbstractBuild.java:223)
> 	at hudson.model.AbstractBuild$AbstractRunner.run(AbstractBuild.java:189)
> 	at hudson.model.Run.run(Run.java:649)
> 	at hudson.model.Build.run(Build.java:102)
> 	at hudson.model.ResourceController.execute(ResourceController.java:70)
> 	at hudson.model.Executor.run(Executor.java:64)
> 2nd example:
> ERROR: Failed to check out http://svn.apache.org/repos/asf/lucene/java/trunk
> org.tmatesoft.svn.core.SVNException: svn: REPORT request failed on '/repos/asf/!svn/vcc/default'
> svn: CRLF expected at end of chunk: 151/115
> 	at org.tmatesoft.svn.core.internal.wc.SVNErrorManager.error(SVNErrorManager.java:80)
> 	at org.tmatesoft.svn.core.internal.io.dav.http.HTTPConnection.request(HTTPConnection.java:517)
> 	at org.tmatesoft.svn.core.internal.io.dav.http.HTTPConnection.request(HTTPConnection.java:234)
> 	at org.tmatesoft.svn.core.internal.io.dav.http.HTTPConnection.request(HTTPConnection.java:222)
> 	at org.tmatesoft.svn.core.internal.io.dav.DAVConnection.doReport(DAVConnection.java:219)
> 	at org.tmatesoft.svn.core.internal.io.dav.DAVConnection.doReport(DAVConnection.java:211)
> 	at org.tmatesoft.svn.core.internal.io.dav.DAVRepository.update(DAVRepository.java:609)
> 	at org.tmatesoft.svn.core.wc.SVNUpdateClient.doUpdate(SVNUpdateClient.java:162)
> 	at org.tmatesoft.svn.core.wc.SVNUpdateClient.doCheckout(SVNUpdateClient.java:325)
> 	at hudson.scm.SubversionSCM$CheckOutTask.invoke(SubversionSCM.java:397)
> 	at hudson.scm.SubversionSCM$CheckOutTask.invoke(SubversionSCM.java:349)
> 	at hudson.FilePath.act(FilePath.java:291)
> 	at hudson.scm.SubversionSCM.checkout(SubversionSCM.java:346)
> 	at hudson.scm.SubversionSCM.checkout(SubversionSCM.java:292)
> 	at hudson.model.AbstractProject.checkout(AbstractProject.java:541)
> 	at hudson.model.AbstractBuild$AbstractRunner.checkout(AbstractBuild.java:223)
> 	at hudson.model.AbstractBuild$AbstractRunner.run(AbstractBuild.java:189)
> 	at hudson.model.Run.run(Run.java:649)
> 	at hudson.model.Build.run(Build.java:102)
> 	at hudson.model.ResourceController.execute(ResourceController.java:70)
> 	at hudson.model.Executor.run(Executor.java:64)
> 3rd example:
> FATAL: Java heap space
> java.lang.OutOfMemoryError: Java heap space
> 	at org.tmatesoft.svn.core.internal.delta.SVNDeltaReader.deflate(SVNDeltaReader.java:163)
> 	at org.tmatesoft.svn.core.internal.delta.SVNDeltaReader.nextWindow(SVNDeltaReader.java:127)
> 	at org.tmatesoft.svn.core.internal.io.dav.handlers.BasicDAVDeltaHandler.characters(BasicDAVDeltaHandler.java:96)
> 	at com.sun.org.apache.xerces.internal.parsers.AbstractSAXParser.characters(AbstractSAXParser.java:538)
> 	at com.sun.org.apache.xerces.internal.impl.XMLDocumentFragmentScannerImpl.scanDocument(XMLDocumentFragmentScannerImpl.java:461)
> 	at com.sun.org.apache.xerces.internal.parsers.XML11Configuration.parse(XML11Configuration.java:807)
> 	at com.sun.org.apache.xerces.internal.parsers.XML11Configuration.parse(XML11Configuration.java:737)
> 	at com.sun.org.apache.xerces.internal.parsers.XMLParser.parse(XMLParser.java:107)
> 	at com.sun.org.apache.xerces.internal.parsers.AbstractSAXParser.parse(AbstractSAXParser.java:1205)
> 	at com.sun.org.apache.xerces.internal.jaxp.SAXParserImpl$JAXPSAXParser.parse(SAXParserImpl.java:522)
> 	at org.tmatesoft.svn.core.internal.io.dav.http.HTTPConnection.readData(HTTPConnection.java:646)
> 	at org.tmatesoft.svn.core.internal.io.dav.http.HTTPConnection.readData(HTTPConnection.java:611)
> 	at org.tmatesoft.svn.core.internal.io.dav.http.HTTPRequest.dispatch(HTTPRequest.java:196)
> 	at org.tmatesoft.svn.core.internal.io.dav.http.HTTPConnection.request(HTTPConnection.java:289)
> 	at org.tmatesoft.svn.core.internal.io.dav.http.HTTPConnection.request(HTTPConnection.java:234)
> 	at org.tmatesoft.svn.core.internal.io.dav.http.HTTPConnection.request(HTTPConnection.java:222)
> 	at org.tmatesoft.svn.core.internal.io.dav.DAVConnection.doReport(DAVConnection.java:219)
> 	at org.tmatesoft.svn.core.internal.io.dav.DAVConnection.doReport(DAVConnection.java:211)
> 	at org.tmatesoft.svn.core.internal.io.dav.DAVRepository.update(DAVRepository.java:609)
> 	at org.tmatesoft.svn.core.wc.SVNUpdateClient.doUpdate(SVNUpdateClient.java:162)
> 	at org.tmatesoft.svn.core.wc.SVNUpdateClient.doCheckout(SVNUpdateClient.java:325)
> 	at hudson.scm.SubversionSCM$CheckOutTask.invoke(SubversionSCM.java:397)
> 	at hudson.scm.SubversionSCM$CheckOutTask.invoke(SubversionSCM.java:349)
> 	at hudson.FilePath.act(FilePath.java:291)
> 	at hudson.scm.SubversionSCM.checkout(SubversionSCM.java:346)
> 	at hudson.scm.SubversionSCM.checkout(SubversionSCM.java:292)
> 	at hudson.model.AbstractProject.checkout(AbstractProject.java:541)
> 	at hudson.model.AbstractBuild$AbstractRunner.checkout(AbstractBuild.java:223)
> 	at hudson.model.AbstractBuild$AbstractRunner.run(AbstractBuild.java:189)
> 	at hudson.model.Run.run(Run.java:649)
> 	at hudson.model.Build.run(Build.java:102)
> 	at hudson.model.ResourceController.execute(ResourceController.java:70)
> 4th example:
> ERROR: Failed to check out http://svn.apache.org/repos/asf/lucene/java/trunk
> org.tmatesoft.svn.core.SVNException: svn: REPORT request failed on '/repos/asf/!svn/vcc/default'
> svn: Processing REPORT request response failed: The element type "S:txdelta" must be terminated by the matching end-tag "</S:txdelta>". (/repos/asf/!svn/vcc/default) 
> 	at org.tmatesoft.svn.core.internal.wc.SVNErrorManager.error(SVNErrorManager.java:80)
> 	at org.tmatesoft.svn.core.internal.io.dav.http.HTTPConnection.request(HTTPConnection.java:517)
> 	at org.tmatesoft.svn.core.internal.io.dav.http.HTTPConnection.request(HTTPConnection.java:234)
> 	at org.tmatesoft.svn.core.internal.io.dav.http.HTTPConnection.request(HTTPConnection.java:222)
> 	at org.tmatesoft.svn.core.internal.io.dav.DAVConnection.doReport(DAVConnection.java:219)
> 	at org.tmatesoft.svn.core.internal.io.dav.DAVConnection.doReport(DAVConnection.java:211)
> 	at org.tmatesoft.svn.core.internal.io.dav.DAVRepository.update(DAVRepository.java:609)
> 	at org.tmatesoft.svn.core.wc.SVNUpdateClient.doUpdate(SVNUpdateClient.java:162)
> 	at org.tmatesoft.svn.core.wc.SVNUpdateClient.doCheckout(SVNUpdateClient.java:325)
> 	at hudson.scm.SubversionSCM$CheckOutTask.invoke(SubversionSCM.java:397)
> 	at hudson.scm.SubversionSCM$CheckOutTask.invoke(SubversionSCM.java:349)
> 	at hudson.FilePath.act(FilePath.java:291)
> 	at hudson.scm.SubversionSCM.checkout(SubversionSCM.java:346)
> 	at hudson.scm.SubversionSCM.checkout(SubversionSCM.java:292)
> 	at hudson.model.AbstractProject.checkout(AbstractProject.java:541)
> 	at hudson.model.AbstractBuild$AbstractRunner.checkout(AbstractBuild.java:223)
> 	at hudson.model.AbstractBuild$AbstractRunner.run(AbstractBuild.java:189)
> 	at hudson.model.Run.run(Run.java:649)
> 	at hudson.model.Build.run(Build.java:102)
> 	at hudson.model.ResourceController.execute(ResourceController.java:70)
> 	at hudson.model.Executor.run(Executor.java:64)

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Commented: (INFRA-1460) Intermittent SVN checkout errors during Lucene nightly build

Posted by "Nigel Daley (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/INFRA-1460?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12555830#action_12555830 ] 

Nigel Daley commented on INFRA-1460:
------------------------------------

This might be a problem with the Java SVN client used by our Hudson build server.  Hudson uses SVNKit 1.1.4 (http://svnkit.com/).  Having said that, no one else is complaining about this problem on the Hudson dev/user lists.

> Intermittent SVN checkout errors during Lucene nightly build
> ------------------------------------------------------------
>
>                 Key: INFRA-1460
>                 URL: https://issues.apache.org/jira/browse/INFRA-1460
>             Project: Infrastructure
>          Issue Type: Bug
>      Security Level: public(Regular issues) 
>          Components: Subversion
>            Reporter: Michael McCandless
>            Priority: Minor
>
> We've been seeing the Lucene nightly build fail occasionally from
> exceptions during SVN checkout.
> In the past it was somewhat rare (maybe 1 in 15 builds) but suddenly
> in the past few days it seems to be happening much more frequently.
> The exceptions are rather "varied".  My only guess is some sort of low
> level network communication issue (especially the SSL error below)?
> Maybe there are corresponding errors in the svn server logs?  Maybe
> other projects are seeing similar exceptions?
> When our nightly build hits this, the build aborts and it's marked as
> failed.
> Here's the first example:
> ERROR: Failed to check out https://svn.apache.org/repos/asf/lucene/java/trunk
> org.tmatesoft.svn.core.SVNException: svn: REPORT request failed on '/repos/asf/!svn/vcc/default'
> svn: SSL peer shut down incorrectly
> 	at org.tmatesoft.svn.core.internal.wc.SVNErrorManager.error(SVNErrorManager.java:80)
> 	at org.tmatesoft.svn.core.internal.io.dav.http.HTTPConnection.request(HTTPConnection.java:517)
> 	at org.tmatesoft.svn.core.internal.io.dav.http.HTTPConnection.request(HTTPConnection.java:234)
> 	at org.tmatesoft.svn.core.internal.io.dav.http.HTTPConnection.request(HTTPConnection.java:222)
> 	at org.tmatesoft.svn.core.internal.io.dav.DAVConnection.doReport(DAVConnection.java:219)
> 	at org.tmatesoft.svn.core.internal.io.dav.DAVConnection.doReport(DAVConnection.java:211)
> 	at org.tmatesoft.svn.core.internal.io.dav.DAVRepository.update(DAVRepository.java:609)
> 	at org.tmatesoft.svn.core.wc.SVNUpdateClient.doUpdate(SVNUpdateClient.java:162)
> 	at org.tmatesoft.svn.core.wc.SVNUpdateClient.doCheckout(SVNUpdateClient.java:325)
> 	at hudson.scm.SubversionSCM$CheckOutTask.invoke(SubversionSCM.java:397)
> 	at hudson.scm.SubversionSCM$CheckOutTask.invoke(SubversionSCM.java:349)
> 	at hudson.FilePath.act(FilePath.java:291)
> 	at hudson.scm.SubversionSCM.checkout(SubversionSCM.java:346)
> 	at hudson.scm.SubversionSCM.checkout(SubversionSCM.java:292)
> 	at hudson.model.AbstractProject.checkout(AbstractProject.java:541)
> 	at hudson.model.AbstractBuild$AbstractRunner.checkout(AbstractBuild.java:223)
> 	at hudson.model.AbstractBuild$AbstractRunner.run(AbstractBuild.java:189)
> 	at hudson.model.Run.run(Run.java:649)
> 	at hudson.model.Build.run(Build.java:102)
> 	at hudson.model.ResourceController.execute(ResourceController.java:70)
> 	at hudson.model.Executor.run(Executor.java:64)
> 2nd example:
> ERROR: Failed to check out http://svn.apache.org/repos/asf/lucene/java/trunk
> org.tmatesoft.svn.core.SVNException: svn: REPORT request failed on '/repos/asf/!svn/vcc/default'
> svn: CRLF expected at end of chunk: 151/115
> 	at org.tmatesoft.svn.core.internal.wc.SVNErrorManager.error(SVNErrorManager.java:80)
> 	at org.tmatesoft.svn.core.internal.io.dav.http.HTTPConnection.request(HTTPConnection.java:517)
> 	at org.tmatesoft.svn.core.internal.io.dav.http.HTTPConnection.request(HTTPConnection.java:234)
> 	at org.tmatesoft.svn.core.internal.io.dav.http.HTTPConnection.request(HTTPConnection.java:222)
> 	at org.tmatesoft.svn.core.internal.io.dav.DAVConnection.doReport(DAVConnection.java:219)
> 	at org.tmatesoft.svn.core.internal.io.dav.DAVConnection.doReport(DAVConnection.java:211)
> 	at org.tmatesoft.svn.core.internal.io.dav.DAVRepository.update(DAVRepository.java:609)
> 	at org.tmatesoft.svn.core.wc.SVNUpdateClient.doUpdate(SVNUpdateClient.java:162)
> 	at org.tmatesoft.svn.core.wc.SVNUpdateClient.doCheckout(SVNUpdateClient.java:325)
> 	at hudson.scm.SubversionSCM$CheckOutTask.invoke(SubversionSCM.java:397)
> 	at hudson.scm.SubversionSCM$CheckOutTask.invoke(SubversionSCM.java:349)
> 	at hudson.FilePath.act(FilePath.java:291)
> 	at hudson.scm.SubversionSCM.checkout(SubversionSCM.java:346)
> 	at hudson.scm.SubversionSCM.checkout(SubversionSCM.java:292)
> 	at hudson.model.AbstractProject.checkout(AbstractProject.java:541)
> 	at hudson.model.AbstractBuild$AbstractRunner.checkout(AbstractBuild.java:223)
> 	at hudson.model.AbstractBuild$AbstractRunner.run(AbstractBuild.java:189)
> 	at hudson.model.Run.run(Run.java:649)
> 	at hudson.model.Build.run(Build.java:102)
> 	at hudson.model.ResourceController.execute(ResourceController.java:70)
> 	at hudson.model.Executor.run(Executor.java:64)
> 3rd example:
> FATAL: Java heap space
> java.lang.OutOfMemoryError: Java heap space
> 	at org.tmatesoft.svn.core.internal.delta.SVNDeltaReader.deflate(SVNDeltaReader.java:163)
> 	at org.tmatesoft.svn.core.internal.delta.SVNDeltaReader.nextWindow(SVNDeltaReader.java:127)
> 	at org.tmatesoft.svn.core.internal.io.dav.handlers.BasicDAVDeltaHandler.characters(BasicDAVDeltaHandler.java:96)
> 	at com.sun.org.apache.xerces.internal.parsers.AbstractSAXParser.characters(AbstractSAXParser.java:538)
> 	at com.sun.org.apache.xerces.internal.impl.XMLDocumentFragmentScannerImpl.scanDocument(XMLDocumentFragmentScannerImpl.java:461)
> 	at com.sun.org.apache.xerces.internal.parsers.XML11Configuration.parse(XML11Configuration.java:807)
> 	at com.sun.org.apache.xerces.internal.parsers.XML11Configuration.parse(XML11Configuration.java:737)
> 	at com.sun.org.apache.xerces.internal.parsers.XMLParser.parse(XMLParser.java:107)
> 	at com.sun.org.apache.xerces.internal.parsers.AbstractSAXParser.parse(AbstractSAXParser.java:1205)
> 	at com.sun.org.apache.xerces.internal.jaxp.SAXParserImpl$JAXPSAXParser.parse(SAXParserImpl.java:522)
> 	at org.tmatesoft.svn.core.internal.io.dav.http.HTTPConnection.readData(HTTPConnection.java:646)
> 	at org.tmatesoft.svn.core.internal.io.dav.http.HTTPConnection.readData(HTTPConnection.java:611)
> 	at org.tmatesoft.svn.core.internal.io.dav.http.HTTPRequest.dispatch(HTTPRequest.java:196)
> 	at org.tmatesoft.svn.core.internal.io.dav.http.HTTPConnection.request(HTTPConnection.java:289)
> 	at org.tmatesoft.svn.core.internal.io.dav.http.HTTPConnection.request(HTTPConnection.java:234)
> 	at org.tmatesoft.svn.core.internal.io.dav.http.HTTPConnection.request(HTTPConnection.java:222)
> 	at org.tmatesoft.svn.core.internal.io.dav.DAVConnection.doReport(DAVConnection.java:219)
> 	at org.tmatesoft.svn.core.internal.io.dav.DAVConnection.doReport(DAVConnection.java:211)
> 	at org.tmatesoft.svn.core.internal.io.dav.DAVRepository.update(DAVRepository.java:609)
> 	at org.tmatesoft.svn.core.wc.SVNUpdateClient.doUpdate(SVNUpdateClient.java:162)
> 	at org.tmatesoft.svn.core.wc.SVNUpdateClient.doCheckout(SVNUpdateClient.java:325)
> 	at hudson.scm.SubversionSCM$CheckOutTask.invoke(SubversionSCM.java:397)
> 	at hudson.scm.SubversionSCM$CheckOutTask.invoke(SubversionSCM.java:349)
> 	at hudson.FilePath.act(FilePath.java:291)
> 	at hudson.scm.SubversionSCM.checkout(SubversionSCM.java:346)
> 	at hudson.scm.SubversionSCM.checkout(SubversionSCM.java:292)
> 	at hudson.model.AbstractProject.checkout(AbstractProject.java:541)
> 	at hudson.model.AbstractBuild$AbstractRunner.checkout(AbstractBuild.java:223)
> 	at hudson.model.AbstractBuild$AbstractRunner.run(AbstractBuild.java:189)
> 	at hudson.model.Run.run(Run.java:649)
> 	at hudson.model.Build.run(Build.java:102)
> 	at hudson.model.ResourceController.execute(ResourceController.java:70)
> 4th example:
> ERROR: Failed to check out http://svn.apache.org/repos/asf/lucene/java/trunk
> org.tmatesoft.svn.core.SVNException: svn: REPORT request failed on '/repos/asf/!svn/vcc/default'
> svn: Processing REPORT request response failed: The element type "S:txdelta" must be terminated by the matching end-tag "</S:txdelta>". (/repos/asf/!svn/vcc/default) 
> 	at org.tmatesoft.svn.core.internal.wc.SVNErrorManager.error(SVNErrorManager.java:80)
> 	at org.tmatesoft.svn.core.internal.io.dav.http.HTTPConnection.request(HTTPConnection.java:517)
> 	at org.tmatesoft.svn.core.internal.io.dav.http.HTTPConnection.request(HTTPConnection.java:234)
> 	at org.tmatesoft.svn.core.internal.io.dav.http.HTTPConnection.request(HTTPConnection.java:222)
> 	at org.tmatesoft.svn.core.internal.io.dav.DAVConnection.doReport(DAVConnection.java:219)
> 	at org.tmatesoft.svn.core.internal.io.dav.DAVConnection.doReport(DAVConnection.java:211)
> 	at org.tmatesoft.svn.core.internal.io.dav.DAVRepository.update(DAVRepository.java:609)
> 	at org.tmatesoft.svn.core.wc.SVNUpdateClient.doUpdate(SVNUpdateClient.java:162)
> 	at org.tmatesoft.svn.core.wc.SVNUpdateClient.doCheckout(SVNUpdateClient.java:325)
> 	at hudson.scm.SubversionSCM$CheckOutTask.invoke(SubversionSCM.java:397)
> 	at hudson.scm.SubversionSCM$CheckOutTask.invoke(SubversionSCM.java:349)
> 	at hudson.FilePath.act(FilePath.java:291)
> 	at hudson.scm.SubversionSCM.checkout(SubversionSCM.java:346)
> 	at hudson.scm.SubversionSCM.checkout(SubversionSCM.java:292)
> 	at hudson.model.AbstractProject.checkout(AbstractProject.java:541)
> 	at hudson.model.AbstractBuild$AbstractRunner.checkout(AbstractBuild.java:223)
> 	at hudson.model.AbstractBuild$AbstractRunner.run(AbstractBuild.java:189)
> 	at hudson.model.Run.run(Run.java:649)
> 	at hudson.model.Build.run(Build.java:102)
> 	at hudson.model.ResourceController.execute(ResourceController.java:70)
> 	at hudson.model.Executor.run(Executor.java:64)

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Commented: (INFRA-1460) Intermittent SVN checkout errors during Lucene nightly build

Posted by "Henri Yandell (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/INFRA-1460?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12557155#action_12557155 ] 

Henri Yandell commented on INFRA-1460:
--------------------------------------

Noticed the same from Continuum a couple of days ago wrt Commons builds.

> Intermittent SVN checkout errors during Lucene nightly build
> ------------------------------------------------------------
>
>                 Key: INFRA-1460
>                 URL: https://issues.apache.org/jira/browse/INFRA-1460
>             Project: Infrastructure
>          Issue Type: Bug
>      Security Level: public(Regular issues) 
>          Components: Subversion
>            Reporter: Michael McCandless
>            Priority: Minor
>
> We've been seeing the Lucene nightly build fail occasionally from
> exceptions during SVN checkout.
> In the past it was somewhat rare (maybe 1 in 15 builds) but suddenly
> in the past few days it seems to be happening much more frequently.
> The exceptions are rather "varied".  My only guess is some sort of low
> level network communication issue (especially the SSL error below)?
> Maybe there are corresponding errors in the svn server logs?  Maybe
> other projects are seeing similar exceptions?
> When our nightly build hits this, the build aborts and it's marked as
> failed.
> Here's the first example:
> ERROR: Failed to check out https://svn.apache.org/repos/asf/lucene/java/trunk
> org.tmatesoft.svn.core.SVNException: svn: REPORT request failed on '/repos/asf/!svn/vcc/default'
> svn: SSL peer shut down incorrectly
> 	at org.tmatesoft.svn.core.internal.wc.SVNErrorManager.error(SVNErrorManager.java:80)
> 	at org.tmatesoft.svn.core.internal.io.dav.http.HTTPConnection.request(HTTPConnection.java:517)
> 	at org.tmatesoft.svn.core.internal.io.dav.http.HTTPConnection.request(HTTPConnection.java:234)
> 	at org.tmatesoft.svn.core.internal.io.dav.http.HTTPConnection.request(HTTPConnection.java:222)
> 	at org.tmatesoft.svn.core.internal.io.dav.DAVConnection.doReport(DAVConnection.java:219)
> 	at org.tmatesoft.svn.core.internal.io.dav.DAVConnection.doReport(DAVConnection.java:211)
> 	at org.tmatesoft.svn.core.internal.io.dav.DAVRepository.update(DAVRepository.java:609)
> 	at org.tmatesoft.svn.core.wc.SVNUpdateClient.doUpdate(SVNUpdateClient.java:162)
> 	at org.tmatesoft.svn.core.wc.SVNUpdateClient.doCheckout(SVNUpdateClient.java:325)
> 	at hudson.scm.SubversionSCM$CheckOutTask.invoke(SubversionSCM.java:397)
> 	at hudson.scm.SubversionSCM$CheckOutTask.invoke(SubversionSCM.java:349)
> 	at hudson.FilePath.act(FilePath.java:291)
> 	at hudson.scm.SubversionSCM.checkout(SubversionSCM.java:346)
> 	at hudson.scm.SubversionSCM.checkout(SubversionSCM.java:292)
> 	at hudson.model.AbstractProject.checkout(AbstractProject.java:541)
> 	at hudson.model.AbstractBuild$AbstractRunner.checkout(AbstractBuild.java:223)
> 	at hudson.model.AbstractBuild$AbstractRunner.run(AbstractBuild.java:189)
> 	at hudson.model.Run.run(Run.java:649)
> 	at hudson.model.Build.run(Build.java:102)
> 	at hudson.model.ResourceController.execute(ResourceController.java:70)
> 	at hudson.model.Executor.run(Executor.java:64)
> 2nd example:
> ERROR: Failed to check out http://svn.apache.org/repos/asf/lucene/java/trunk
> org.tmatesoft.svn.core.SVNException: svn: REPORT request failed on '/repos/asf/!svn/vcc/default'
> svn: CRLF expected at end of chunk: 151/115
> 	at org.tmatesoft.svn.core.internal.wc.SVNErrorManager.error(SVNErrorManager.java:80)
> 	at org.tmatesoft.svn.core.internal.io.dav.http.HTTPConnection.request(HTTPConnection.java:517)
> 	at org.tmatesoft.svn.core.internal.io.dav.http.HTTPConnection.request(HTTPConnection.java:234)
> 	at org.tmatesoft.svn.core.internal.io.dav.http.HTTPConnection.request(HTTPConnection.java:222)
> 	at org.tmatesoft.svn.core.internal.io.dav.DAVConnection.doReport(DAVConnection.java:219)
> 	at org.tmatesoft.svn.core.internal.io.dav.DAVConnection.doReport(DAVConnection.java:211)
> 	at org.tmatesoft.svn.core.internal.io.dav.DAVRepository.update(DAVRepository.java:609)
> 	at org.tmatesoft.svn.core.wc.SVNUpdateClient.doUpdate(SVNUpdateClient.java:162)
> 	at org.tmatesoft.svn.core.wc.SVNUpdateClient.doCheckout(SVNUpdateClient.java:325)
> 	at hudson.scm.SubversionSCM$CheckOutTask.invoke(SubversionSCM.java:397)
> 	at hudson.scm.SubversionSCM$CheckOutTask.invoke(SubversionSCM.java:349)
> 	at hudson.FilePath.act(FilePath.java:291)
> 	at hudson.scm.SubversionSCM.checkout(SubversionSCM.java:346)
> 	at hudson.scm.SubversionSCM.checkout(SubversionSCM.java:292)
> 	at hudson.model.AbstractProject.checkout(AbstractProject.java:541)
> 	at hudson.model.AbstractBuild$AbstractRunner.checkout(AbstractBuild.java:223)
> 	at hudson.model.AbstractBuild$AbstractRunner.run(AbstractBuild.java:189)
> 	at hudson.model.Run.run(Run.java:649)
> 	at hudson.model.Build.run(Build.java:102)
> 	at hudson.model.ResourceController.execute(ResourceController.java:70)
> 	at hudson.model.Executor.run(Executor.java:64)
> 3rd example:
> FATAL: Java heap space
> java.lang.OutOfMemoryError: Java heap space
> 	at org.tmatesoft.svn.core.internal.delta.SVNDeltaReader.deflate(SVNDeltaReader.java:163)
> 	at org.tmatesoft.svn.core.internal.delta.SVNDeltaReader.nextWindow(SVNDeltaReader.java:127)
> 	at org.tmatesoft.svn.core.internal.io.dav.handlers.BasicDAVDeltaHandler.characters(BasicDAVDeltaHandler.java:96)
> 	at com.sun.org.apache.xerces.internal.parsers.AbstractSAXParser.characters(AbstractSAXParser.java:538)
> 	at com.sun.org.apache.xerces.internal.impl.XMLDocumentFragmentScannerImpl.scanDocument(XMLDocumentFragmentScannerImpl.java:461)
> 	at com.sun.org.apache.xerces.internal.parsers.XML11Configuration.parse(XML11Configuration.java:807)
> 	at com.sun.org.apache.xerces.internal.parsers.XML11Configuration.parse(XML11Configuration.java:737)
> 	at com.sun.org.apache.xerces.internal.parsers.XMLParser.parse(XMLParser.java:107)
> 	at com.sun.org.apache.xerces.internal.parsers.AbstractSAXParser.parse(AbstractSAXParser.java:1205)
> 	at com.sun.org.apache.xerces.internal.jaxp.SAXParserImpl$JAXPSAXParser.parse(SAXParserImpl.java:522)
> 	at org.tmatesoft.svn.core.internal.io.dav.http.HTTPConnection.readData(HTTPConnection.java:646)
> 	at org.tmatesoft.svn.core.internal.io.dav.http.HTTPConnection.readData(HTTPConnection.java:611)
> 	at org.tmatesoft.svn.core.internal.io.dav.http.HTTPRequest.dispatch(HTTPRequest.java:196)
> 	at org.tmatesoft.svn.core.internal.io.dav.http.HTTPConnection.request(HTTPConnection.java:289)
> 	at org.tmatesoft.svn.core.internal.io.dav.http.HTTPConnection.request(HTTPConnection.java:234)
> 	at org.tmatesoft.svn.core.internal.io.dav.http.HTTPConnection.request(HTTPConnection.java:222)
> 	at org.tmatesoft.svn.core.internal.io.dav.DAVConnection.doReport(DAVConnection.java:219)
> 	at org.tmatesoft.svn.core.internal.io.dav.DAVConnection.doReport(DAVConnection.java:211)
> 	at org.tmatesoft.svn.core.internal.io.dav.DAVRepository.update(DAVRepository.java:609)
> 	at org.tmatesoft.svn.core.wc.SVNUpdateClient.doUpdate(SVNUpdateClient.java:162)
> 	at org.tmatesoft.svn.core.wc.SVNUpdateClient.doCheckout(SVNUpdateClient.java:325)
> 	at hudson.scm.SubversionSCM$CheckOutTask.invoke(SubversionSCM.java:397)
> 	at hudson.scm.SubversionSCM$CheckOutTask.invoke(SubversionSCM.java:349)
> 	at hudson.FilePath.act(FilePath.java:291)
> 	at hudson.scm.SubversionSCM.checkout(SubversionSCM.java:346)
> 	at hudson.scm.SubversionSCM.checkout(SubversionSCM.java:292)
> 	at hudson.model.AbstractProject.checkout(AbstractProject.java:541)
> 	at hudson.model.AbstractBuild$AbstractRunner.checkout(AbstractBuild.java:223)
> 	at hudson.model.AbstractBuild$AbstractRunner.run(AbstractBuild.java:189)
> 	at hudson.model.Run.run(Run.java:649)
> 	at hudson.model.Build.run(Build.java:102)
> 	at hudson.model.ResourceController.execute(ResourceController.java:70)
> 4th example:
> ERROR: Failed to check out http://svn.apache.org/repos/asf/lucene/java/trunk
> org.tmatesoft.svn.core.SVNException: svn: REPORT request failed on '/repos/asf/!svn/vcc/default'
> svn: Processing REPORT request response failed: The element type "S:txdelta" must be terminated by the matching end-tag "</S:txdelta>". (/repos/asf/!svn/vcc/default) 
> 	at org.tmatesoft.svn.core.internal.wc.SVNErrorManager.error(SVNErrorManager.java:80)
> 	at org.tmatesoft.svn.core.internal.io.dav.http.HTTPConnection.request(HTTPConnection.java:517)
> 	at org.tmatesoft.svn.core.internal.io.dav.http.HTTPConnection.request(HTTPConnection.java:234)
> 	at org.tmatesoft.svn.core.internal.io.dav.http.HTTPConnection.request(HTTPConnection.java:222)
> 	at org.tmatesoft.svn.core.internal.io.dav.DAVConnection.doReport(DAVConnection.java:219)
> 	at org.tmatesoft.svn.core.internal.io.dav.DAVConnection.doReport(DAVConnection.java:211)
> 	at org.tmatesoft.svn.core.internal.io.dav.DAVRepository.update(DAVRepository.java:609)
> 	at org.tmatesoft.svn.core.wc.SVNUpdateClient.doUpdate(SVNUpdateClient.java:162)
> 	at org.tmatesoft.svn.core.wc.SVNUpdateClient.doCheckout(SVNUpdateClient.java:325)
> 	at hudson.scm.SubversionSCM$CheckOutTask.invoke(SubversionSCM.java:397)
> 	at hudson.scm.SubversionSCM$CheckOutTask.invoke(SubversionSCM.java:349)
> 	at hudson.FilePath.act(FilePath.java:291)
> 	at hudson.scm.SubversionSCM.checkout(SubversionSCM.java:346)
> 	at hudson.scm.SubversionSCM.checkout(SubversionSCM.java:292)
> 	at hudson.model.AbstractProject.checkout(AbstractProject.java:541)
> 	at hudson.model.AbstractBuild$AbstractRunner.checkout(AbstractBuild.java:223)
> 	at hudson.model.AbstractBuild$AbstractRunner.run(AbstractBuild.java:189)
> 	at hudson.model.Run.run(Run.java:649)
> 	at hudson.model.Build.run(Build.java:102)
> 	at hudson.model.ResourceController.execute(ResourceController.java:70)
> 	at hudson.model.Executor.run(Executor.java:64)

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Commented: (INFRA-1460) Intermittent SVN checkout errors during Lucene nightly build

Posted by "Michael McCandless (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/INFRA-1460?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12557416#action_12557416 ] 

Michael McCandless commented on INFRA-1460:
-------------------------------------------

OK, got it.  Ooh, that's good news about the battery.  I'm looking forward to its replacement!



> Intermittent SVN checkout errors during Lucene nightly build
> ------------------------------------------------------------
>
>                 Key: INFRA-1460
>                 URL: https://issues.apache.org/jira/browse/INFRA-1460
>             Project: Infrastructure
>          Issue Type: Bug
>      Security Level: public(Regular issues) 
>          Components: Subversion
>            Reporter: Michael McCandless
>
> We've been seeing the Lucene nightly build fail occasionally from
> exceptions during SVN checkout.
> In the past it was somewhat rare (maybe 1 in 15 builds) but suddenly
> in the past few days it seems to be happening much more frequently.
> The exceptions are rather "varied".  My only guess is some sort of low
> level network communication issue (especially the SSL error below)?
> Maybe there are corresponding errors in the svn server logs?  Maybe
> other projects are seeing similar exceptions?
> When our nightly build hits this, the build aborts and it's marked as
> failed.
> Here's the first example:
> ERROR: Failed to check out https://svn.apache.org/repos/asf/lucene/java/trunk
> org.tmatesoft.svn.core.SVNException: svn: REPORT request failed on '/repos/asf/!svn/vcc/default'
> svn: SSL peer shut down incorrectly
> 	at org.tmatesoft.svn.core.internal.wc.SVNErrorManager.error(SVNErrorManager.java:80)
> 	at org.tmatesoft.svn.core.internal.io.dav.http.HTTPConnection.request(HTTPConnection.java:517)
> 	at org.tmatesoft.svn.core.internal.io.dav.http.HTTPConnection.request(HTTPConnection.java:234)
> 	at org.tmatesoft.svn.core.internal.io.dav.http.HTTPConnection.request(HTTPConnection.java:222)
> 	at org.tmatesoft.svn.core.internal.io.dav.DAVConnection.doReport(DAVConnection.java:219)
> 	at org.tmatesoft.svn.core.internal.io.dav.DAVConnection.doReport(DAVConnection.java:211)
> 	at org.tmatesoft.svn.core.internal.io.dav.DAVRepository.update(DAVRepository.java:609)
> 	at org.tmatesoft.svn.core.wc.SVNUpdateClient.doUpdate(SVNUpdateClient.java:162)
> 	at org.tmatesoft.svn.core.wc.SVNUpdateClient.doCheckout(SVNUpdateClient.java:325)
> 	at hudson.scm.SubversionSCM$CheckOutTask.invoke(SubversionSCM.java:397)
> 	at hudson.scm.SubversionSCM$CheckOutTask.invoke(SubversionSCM.java:349)
> 	at hudson.FilePath.act(FilePath.java:291)
> 	at hudson.scm.SubversionSCM.checkout(SubversionSCM.java:346)
> 	at hudson.scm.SubversionSCM.checkout(SubversionSCM.java:292)
> 	at hudson.model.AbstractProject.checkout(AbstractProject.java:541)
> 	at hudson.model.AbstractBuild$AbstractRunner.checkout(AbstractBuild.java:223)
> 	at hudson.model.AbstractBuild$AbstractRunner.run(AbstractBuild.java:189)
> 	at hudson.model.Run.run(Run.java:649)
> 	at hudson.model.Build.run(Build.java:102)
> 	at hudson.model.ResourceController.execute(ResourceController.java:70)
> 	at hudson.model.Executor.run(Executor.java:64)
> 2nd example:
> ERROR: Failed to check out http://svn.apache.org/repos/asf/lucene/java/trunk
> org.tmatesoft.svn.core.SVNException: svn: REPORT request failed on '/repos/asf/!svn/vcc/default'
> svn: CRLF expected at end of chunk: 151/115
> 	at org.tmatesoft.svn.core.internal.wc.SVNErrorManager.error(SVNErrorManager.java:80)
> 	at org.tmatesoft.svn.core.internal.io.dav.http.HTTPConnection.request(HTTPConnection.java:517)
> 	at org.tmatesoft.svn.core.internal.io.dav.http.HTTPConnection.request(HTTPConnection.java:234)
> 	at org.tmatesoft.svn.core.internal.io.dav.http.HTTPConnection.request(HTTPConnection.java:222)
> 	at org.tmatesoft.svn.core.internal.io.dav.DAVConnection.doReport(DAVConnection.java:219)
> 	at org.tmatesoft.svn.core.internal.io.dav.DAVConnection.doReport(DAVConnection.java:211)
> 	at org.tmatesoft.svn.core.internal.io.dav.DAVRepository.update(DAVRepository.java:609)
> 	at org.tmatesoft.svn.core.wc.SVNUpdateClient.doUpdate(SVNUpdateClient.java:162)
> 	at org.tmatesoft.svn.core.wc.SVNUpdateClient.doCheckout(SVNUpdateClient.java:325)
> 	at hudson.scm.SubversionSCM$CheckOutTask.invoke(SubversionSCM.java:397)
> 	at hudson.scm.SubversionSCM$CheckOutTask.invoke(SubversionSCM.java:349)
> 	at hudson.FilePath.act(FilePath.java:291)
> 	at hudson.scm.SubversionSCM.checkout(SubversionSCM.java:346)
> 	at hudson.scm.SubversionSCM.checkout(SubversionSCM.java:292)
> 	at hudson.model.AbstractProject.checkout(AbstractProject.java:541)
> 	at hudson.model.AbstractBuild$AbstractRunner.checkout(AbstractBuild.java:223)
> 	at hudson.model.AbstractBuild$AbstractRunner.run(AbstractBuild.java:189)
> 	at hudson.model.Run.run(Run.java:649)
> 	at hudson.model.Build.run(Build.java:102)
> 	at hudson.model.ResourceController.execute(ResourceController.java:70)
> 	at hudson.model.Executor.run(Executor.java:64)
> 3rd example:
> FATAL: Java heap space
> java.lang.OutOfMemoryError: Java heap space
> 	at org.tmatesoft.svn.core.internal.delta.SVNDeltaReader.deflate(SVNDeltaReader.java:163)
> 	at org.tmatesoft.svn.core.internal.delta.SVNDeltaReader.nextWindow(SVNDeltaReader.java:127)
> 	at org.tmatesoft.svn.core.internal.io.dav.handlers.BasicDAVDeltaHandler.characters(BasicDAVDeltaHandler.java:96)
> 	at com.sun.org.apache.xerces.internal.parsers.AbstractSAXParser.characters(AbstractSAXParser.java:538)
> 	at com.sun.org.apache.xerces.internal.impl.XMLDocumentFragmentScannerImpl.scanDocument(XMLDocumentFragmentScannerImpl.java:461)
> 	at com.sun.org.apache.xerces.internal.parsers.XML11Configuration.parse(XML11Configuration.java:807)
> 	at com.sun.org.apache.xerces.internal.parsers.XML11Configuration.parse(XML11Configuration.java:737)
> 	at com.sun.org.apache.xerces.internal.parsers.XMLParser.parse(XMLParser.java:107)
> 	at com.sun.org.apache.xerces.internal.parsers.AbstractSAXParser.parse(AbstractSAXParser.java:1205)
> 	at com.sun.org.apache.xerces.internal.jaxp.SAXParserImpl$JAXPSAXParser.parse(SAXParserImpl.java:522)
> 	at org.tmatesoft.svn.core.internal.io.dav.http.HTTPConnection.readData(HTTPConnection.java:646)
> 	at org.tmatesoft.svn.core.internal.io.dav.http.HTTPConnection.readData(HTTPConnection.java:611)
> 	at org.tmatesoft.svn.core.internal.io.dav.http.HTTPRequest.dispatch(HTTPRequest.java:196)
> 	at org.tmatesoft.svn.core.internal.io.dav.http.HTTPConnection.request(HTTPConnection.java:289)
> 	at org.tmatesoft.svn.core.internal.io.dav.http.HTTPConnection.request(HTTPConnection.java:234)
> 	at org.tmatesoft.svn.core.internal.io.dav.http.HTTPConnection.request(HTTPConnection.java:222)
> 	at org.tmatesoft.svn.core.internal.io.dav.DAVConnection.doReport(DAVConnection.java:219)
> 	at org.tmatesoft.svn.core.internal.io.dav.DAVConnection.doReport(DAVConnection.java:211)
> 	at org.tmatesoft.svn.core.internal.io.dav.DAVRepository.update(DAVRepository.java:609)
> 	at org.tmatesoft.svn.core.wc.SVNUpdateClient.doUpdate(SVNUpdateClient.java:162)
> 	at org.tmatesoft.svn.core.wc.SVNUpdateClient.doCheckout(SVNUpdateClient.java:325)
> 	at hudson.scm.SubversionSCM$CheckOutTask.invoke(SubversionSCM.java:397)
> 	at hudson.scm.SubversionSCM$CheckOutTask.invoke(SubversionSCM.java:349)
> 	at hudson.FilePath.act(FilePath.java:291)
> 	at hudson.scm.SubversionSCM.checkout(SubversionSCM.java:346)
> 	at hudson.scm.SubversionSCM.checkout(SubversionSCM.java:292)
> 	at hudson.model.AbstractProject.checkout(AbstractProject.java:541)
> 	at hudson.model.AbstractBuild$AbstractRunner.checkout(AbstractBuild.java:223)
> 	at hudson.model.AbstractBuild$AbstractRunner.run(AbstractBuild.java:189)
> 	at hudson.model.Run.run(Run.java:649)
> 	at hudson.model.Build.run(Build.java:102)
> 	at hudson.model.ResourceController.execute(ResourceController.java:70)
> 4th example:
> ERROR: Failed to check out http://svn.apache.org/repos/asf/lucene/java/trunk
> org.tmatesoft.svn.core.SVNException: svn: REPORT request failed on '/repos/asf/!svn/vcc/default'
> svn: Processing REPORT request response failed: The element type "S:txdelta" must be terminated by the matching end-tag "</S:txdelta>". (/repos/asf/!svn/vcc/default) 
> 	at org.tmatesoft.svn.core.internal.wc.SVNErrorManager.error(SVNErrorManager.java:80)
> 	at org.tmatesoft.svn.core.internal.io.dav.http.HTTPConnection.request(HTTPConnection.java:517)
> 	at org.tmatesoft.svn.core.internal.io.dav.http.HTTPConnection.request(HTTPConnection.java:234)
> 	at org.tmatesoft.svn.core.internal.io.dav.http.HTTPConnection.request(HTTPConnection.java:222)
> 	at org.tmatesoft.svn.core.internal.io.dav.DAVConnection.doReport(DAVConnection.java:219)
> 	at org.tmatesoft.svn.core.internal.io.dav.DAVConnection.doReport(DAVConnection.java:211)
> 	at org.tmatesoft.svn.core.internal.io.dav.DAVRepository.update(DAVRepository.java:609)
> 	at org.tmatesoft.svn.core.wc.SVNUpdateClient.doUpdate(SVNUpdateClient.java:162)
> 	at org.tmatesoft.svn.core.wc.SVNUpdateClient.doCheckout(SVNUpdateClient.java:325)
> 	at hudson.scm.SubversionSCM$CheckOutTask.invoke(SubversionSCM.java:397)
> 	at hudson.scm.SubversionSCM$CheckOutTask.invoke(SubversionSCM.java:349)
> 	at hudson.FilePath.act(FilePath.java:291)
> 	at hudson.scm.SubversionSCM.checkout(SubversionSCM.java:346)
> 	at hudson.scm.SubversionSCM.checkout(SubversionSCM.java:292)
> 	at hudson.model.AbstractProject.checkout(AbstractProject.java:541)
> 	at hudson.model.AbstractBuild$AbstractRunner.checkout(AbstractBuild.java:223)
> 	at hudson.model.AbstractBuild$AbstractRunner.run(AbstractBuild.java:189)
> 	at hudson.model.Run.run(Run.java:649)
> 	at hudson.model.Build.run(Build.java:102)
> 	at hudson.model.ResourceController.execute(ResourceController.java:70)
> 	at hudson.model.Executor.run(Executor.java:64)

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Resolved: (INFRA-1460) Intermittent SVN checkout errors during Lucene nightly build

Posted by "Michael McCandless (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/INFRA-1460?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Michael McCandless resolved INFRA-1460.
---------------------------------------

    Resolution: Fixed

We have not hit this failure since the httpd timeout was increased on svn.apache.org, so, I think it's fixed -- thanks!

> Intermittent SVN checkout errors during Lucene nightly build
> ------------------------------------------------------------
>
>                 Key: INFRA-1460
>                 URL: https://issues.apache.org/jira/browse/INFRA-1460
>             Project: Infrastructure
>          Issue Type: Bug
>      Security Level: public(Regular issues) 
>          Components: Subversion
>            Reporter: Michael McCandless
>
> We've been seeing the Lucene nightly build fail occasionally from
> exceptions during SVN checkout.
> In the past it was somewhat rare (maybe 1 in 15 builds) but suddenly
> in the past few days it seems to be happening much more frequently.
> The exceptions are rather "varied".  My only guess is some sort of low
> level network communication issue (especially the SSL error below)?
> Maybe there are corresponding errors in the svn server logs?  Maybe
> other projects are seeing similar exceptions?
> When our nightly build hits this, the build aborts and it's marked as
> failed.
> Here's the first example:
> ERROR: Failed to check out https://svn.apache.org/repos/asf/lucene/java/trunk
> org.tmatesoft.svn.core.SVNException: svn: REPORT request failed on '/repos/asf/!svn/vcc/default'
> svn: SSL peer shut down incorrectly
> 	at org.tmatesoft.svn.core.internal.wc.SVNErrorManager.error(SVNErrorManager.java:80)
> 	at org.tmatesoft.svn.core.internal.io.dav.http.HTTPConnection.request(HTTPConnection.java:517)
> 	at org.tmatesoft.svn.core.internal.io.dav.http.HTTPConnection.request(HTTPConnection.java:234)
> 	at org.tmatesoft.svn.core.internal.io.dav.http.HTTPConnection.request(HTTPConnection.java:222)
> 	at org.tmatesoft.svn.core.internal.io.dav.DAVConnection.doReport(DAVConnection.java:219)
> 	at org.tmatesoft.svn.core.internal.io.dav.DAVConnection.doReport(DAVConnection.java:211)
> 	at org.tmatesoft.svn.core.internal.io.dav.DAVRepository.update(DAVRepository.java:609)
> 	at org.tmatesoft.svn.core.wc.SVNUpdateClient.doUpdate(SVNUpdateClient.java:162)
> 	at org.tmatesoft.svn.core.wc.SVNUpdateClient.doCheckout(SVNUpdateClient.java:325)
> 	at hudson.scm.SubversionSCM$CheckOutTask.invoke(SubversionSCM.java:397)
> 	at hudson.scm.SubversionSCM$CheckOutTask.invoke(SubversionSCM.java:349)
> 	at hudson.FilePath.act(FilePath.java:291)
> 	at hudson.scm.SubversionSCM.checkout(SubversionSCM.java:346)
> 	at hudson.scm.SubversionSCM.checkout(SubversionSCM.java:292)
> 	at hudson.model.AbstractProject.checkout(AbstractProject.java:541)
> 	at hudson.model.AbstractBuild$AbstractRunner.checkout(AbstractBuild.java:223)
> 	at hudson.model.AbstractBuild$AbstractRunner.run(AbstractBuild.java:189)
> 	at hudson.model.Run.run(Run.java:649)
> 	at hudson.model.Build.run(Build.java:102)
> 	at hudson.model.ResourceController.execute(ResourceController.java:70)
> 	at hudson.model.Executor.run(Executor.java:64)
> 2nd example:
> ERROR: Failed to check out http://svn.apache.org/repos/asf/lucene/java/trunk
> org.tmatesoft.svn.core.SVNException: svn: REPORT request failed on '/repos/asf/!svn/vcc/default'
> svn: CRLF expected at end of chunk: 151/115
> 	at org.tmatesoft.svn.core.internal.wc.SVNErrorManager.error(SVNErrorManager.java:80)
> 	at org.tmatesoft.svn.core.internal.io.dav.http.HTTPConnection.request(HTTPConnection.java:517)
> 	at org.tmatesoft.svn.core.internal.io.dav.http.HTTPConnection.request(HTTPConnection.java:234)
> 	at org.tmatesoft.svn.core.internal.io.dav.http.HTTPConnection.request(HTTPConnection.java:222)
> 	at org.tmatesoft.svn.core.internal.io.dav.DAVConnection.doReport(DAVConnection.java:219)
> 	at org.tmatesoft.svn.core.internal.io.dav.DAVConnection.doReport(DAVConnection.java:211)
> 	at org.tmatesoft.svn.core.internal.io.dav.DAVRepository.update(DAVRepository.java:609)
> 	at org.tmatesoft.svn.core.wc.SVNUpdateClient.doUpdate(SVNUpdateClient.java:162)
> 	at org.tmatesoft.svn.core.wc.SVNUpdateClient.doCheckout(SVNUpdateClient.java:325)
> 	at hudson.scm.SubversionSCM$CheckOutTask.invoke(SubversionSCM.java:397)
> 	at hudson.scm.SubversionSCM$CheckOutTask.invoke(SubversionSCM.java:349)
> 	at hudson.FilePath.act(FilePath.java:291)
> 	at hudson.scm.SubversionSCM.checkout(SubversionSCM.java:346)
> 	at hudson.scm.SubversionSCM.checkout(SubversionSCM.java:292)
> 	at hudson.model.AbstractProject.checkout(AbstractProject.java:541)
> 	at hudson.model.AbstractBuild$AbstractRunner.checkout(AbstractBuild.java:223)
> 	at hudson.model.AbstractBuild$AbstractRunner.run(AbstractBuild.java:189)
> 	at hudson.model.Run.run(Run.java:649)
> 	at hudson.model.Build.run(Build.java:102)
> 	at hudson.model.ResourceController.execute(ResourceController.java:70)
> 	at hudson.model.Executor.run(Executor.java:64)
> 3rd example:
> FATAL: Java heap space
> java.lang.OutOfMemoryError: Java heap space
> 	at org.tmatesoft.svn.core.internal.delta.SVNDeltaReader.deflate(SVNDeltaReader.java:163)
> 	at org.tmatesoft.svn.core.internal.delta.SVNDeltaReader.nextWindow(SVNDeltaReader.java:127)
> 	at org.tmatesoft.svn.core.internal.io.dav.handlers.BasicDAVDeltaHandler.characters(BasicDAVDeltaHandler.java:96)
> 	at com.sun.org.apache.xerces.internal.parsers.AbstractSAXParser.characters(AbstractSAXParser.java:538)
> 	at com.sun.org.apache.xerces.internal.impl.XMLDocumentFragmentScannerImpl.scanDocument(XMLDocumentFragmentScannerImpl.java:461)
> 	at com.sun.org.apache.xerces.internal.parsers.XML11Configuration.parse(XML11Configuration.java:807)
> 	at com.sun.org.apache.xerces.internal.parsers.XML11Configuration.parse(XML11Configuration.java:737)
> 	at com.sun.org.apache.xerces.internal.parsers.XMLParser.parse(XMLParser.java:107)
> 	at com.sun.org.apache.xerces.internal.parsers.AbstractSAXParser.parse(AbstractSAXParser.java:1205)
> 	at com.sun.org.apache.xerces.internal.jaxp.SAXParserImpl$JAXPSAXParser.parse(SAXParserImpl.java:522)
> 	at org.tmatesoft.svn.core.internal.io.dav.http.HTTPConnection.readData(HTTPConnection.java:646)
> 	at org.tmatesoft.svn.core.internal.io.dav.http.HTTPConnection.readData(HTTPConnection.java:611)
> 	at org.tmatesoft.svn.core.internal.io.dav.http.HTTPRequest.dispatch(HTTPRequest.java:196)
> 	at org.tmatesoft.svn.core.internal.io.dav.http.HTTPConnection.request(HTTPConnection.java:289)
> 	at org.tmatesoft.svn.core.internal.io.dav.http.HTTPConnection.request(HTTPConnection.java:234)
> 	at org.tmatesoft.svn.core.internal.io.dav.http.HTTPConnection.request(HTTPConnection.java:222)
> 	at org.tmatesoft.svn.core.internal.io.dav.DAVConnection.doReport(DAVConnection.java:219)
> 	at org.tmatesoft.svn.core.internal.io.dav.DAVConnection.doReport(DAVConnection.java:211)
> 	at org.tmatesoft.svn.core.internal.io.dav.DAVRepository.update(DAVRepository.java:609)
> 	at org.tmatesoft.svn.core.wc.SVNUpdateClient.doUpdate(SVNUpdateClient.java:162)
> 	at org.tmatesoft.svn.core.wc.SVNUpdateClient.doCheckout(SVNUpdateClient.java:325)
> 	at hudson.scm.SubversionSCM$CheckOutTask.invoke(SubversionSCM.java:397)
> 	at hudson.scm.SubversionSCM$CheckOutTask.invoke(SubversionSCM.java:349)
> 	at hudson.FilePath.act(FilePath.java:291)
> 	at hudson.scm.SubversionSCM.checkout(SubversionSCM.java:346)
> 	at hudson.scm.SubversionSCM.checkout(SubversionSCM.java:292)
> 	at hudson.model.AbstractProject.checkout(AbstractProject.java:541)
> 	at hudson.model.AbstractBuild$AbstractRunner.checkout(AbstractBuild.java:223)
> 	at hudson.model.AbstractBuild$AbstractRunner.run(AbstractBuild.java:189)
> 	at hudson.model.Run.run(Run.java:649)
> 	at hudson.model.Build.run(Build.java:102)
> 	at hudson.model.ResourceController.execute(ResourceController.java:70)
> 4th example:
> ERROR: Failed to check out http://svn.apache.org/repos/asf/lucene/java/trunk
> org.tmatesoft.svn.core.SVNException: svn: REPORT request failed on '/repos/asf/!svn/vcc/default'
> svn: Processing REPORT request response failed: The element type "S:txdelta" must be terminated by the matching end-tag "</S:txdelta>". (/repos/asf/!svn/vcc/default) 
> 	at org.tmatesoft.svn.core.internal.wc.SVNErrorManager.error(SVNErrorManager.java:80)
> 	at org.tmatesoft.svn.core.internal.io.dav.http.HTTPConnection.request(HTTPConnection.java:517)
> 	at org.tmatesoft.svn.core.internal.io.dav.http.HTTPConnection.request(HTTPConnection.java:234)
> 	at org.tmatesoft.svn.core.internal.io.dav.http.HTTPConnection.request(HTTPConnection.java:222)
> 	at org.tmatesoft.svn.core.internal.io.dav.DAVConnection.doReport(DAVConnection.java:219)
> 	at org.tmatesoft.svn.core.internal.io.dav.DAVConnection.doReport(DAVConnection.java:211)
> 	at org.tmatesoft.svn.core.internal.io.dav.DAVRepository.update(DAVRepository.java:609)
> 	at org.tmatesoft.svn.core.wc.SVNUpdateClient.doUpdate(SVNUpdateClient.java:162)
> 	at org.tmatesoft.svn.core.wc.SVNUpdateClient.doCheckout(SVNUpdateClient.java:325)
> 	at hudson.scm.SubversionSCM$CheckOutTask.invoke(SubversionSCM.java:397)
> 	at hudson.scm.SubversionSCM$CheckOutTask.invoke(SubversionSCM.java:349)
> 	at hudson.FilePath.act(FilePath.java:291)
> 	at hudson.scm.SubversionSCM.checkout(SubversionSCM.java:346)
> 	at hudson.scm.SubversionSCM.checkout(SubversionSCM.java:292)
> 	at hudson.model.AbstractProject.checkout(AbstractProject.java:541)
> 	at hudson.model.AbstractBuild$AbstractRunner.checkout(AbstractBuild.java:223)
> 	at hudson.model.AbstractBuild$AbstractRunner.run(AbstractBuild.java:189)
> 	at hudson.model.Run.run(Run.java:649)
> 	at hudson.model.Build.run(Build.java:102)
> 	at hudson.model.ResourceController.execute(ResourceController.java:70)
> 	at hudson.model.Executor.run(Executor.java:64)

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Commented: (INFRA-1460) Intermittent SVN checkout errors during Lucene nightly build

Posted by "Michael McCandless (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/INFRA-1460?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12556025#action_12556025 ] 

Michael McCandless commented on INFRA-1460:
-------------------------------------------

Hadoop's nightly build (also run using Hudson) failed last night with this exception (same as one of the above):

ERROR: Failed to check out http://svn.apache.org/repos/asf/lucene/java/trunk
org.tmatesoft.svn.core.SVNException: svn: REPORT request failed on '/repos/asf/!svn/vcc/default'
svn: Processing REPORT request response failed: The element type "S:txdelta" must be terminated by the matching end-tag "</S:txdelta>". (/repos/asf/!svn/vcc/default) 
	at org.tmatesoft.svn.core.internal.wc.SVNErrorManager.error(SVNErrorManager.java:80)
	at org.tmatesoft.svn.core.internal.io.dav.http.HTTPConnection.request(HTTPConnection.java:517)
	at org.tmatesoft.svn.core.internal.io.dav.http.HTTPConnection.request(HTTPConnection.java:234)
	at org.tmatesoft.svn.core.internal.io.dav.http.HTTPConnection.request(HTTPConnection.java:222)
	at org.tmatesoft.svn.core.internal.io.dav.DAVConnection.doReport(DAVConnection.java:219)
	at org.tmatesoft.svn.core.internal.io.dav.DAVConnection.doReport(DAVConnection.java:211)
	at org.tmatesoft.svn.core.internal.io.dav.DAVRepository.update(DAVRepository.java:609)
	at org.tmatesoft.svn.core.wc.SVNUpdateClient.doUpdate(SVNUpdateClient.java:162)
	at org.tmatesoft.svn.core.wc.SVNUpdateClient.doCheckout(SVNUpdateClient.java:325)
	at hudson.scm.SubversionSCM$CheckOutTask.invoke(SubversionSCM.java:397)
	at hudson.scm.SubversionSCM$CheckOutTask.invoke(SubversionSCM.java:349)
	at hudson.FilePath.act(FilePath.java:291)
	at hudson.scm.SubversionSCM.checkout(SubversionSCM.java:346)
	at hudson.scm.SubversionSCM.checkout(SubversionSCM.java:292)
	at hudson.model.AbstractProject.checkout(AbstractProject.java:541)
	at hudson.model.AbstractBuild$AbstractRunner.checkout(AbstractBuild.java:223)
	at hudson.model.AbstractBuild$AbstractRunner.run(AbstractBuild.java:189)
	at hudson.model.Run.run(Run.java:649)
	at hudson.model.Build.run(Build.java:102)
	at hudson.model.ResourceController.execute(ResourceController.java:70)
	at hudson.model.Executor.run(Executor.java:64)


> Intermittent SVN checkout errors during Lucene nightly build
> ------------------------------------------------------------
>
>                 Key: INFRA-1460
>                 URL: https://issues.apache.org/jira/browse/INFRA-1460
>             Project: Infrastructure
>          Issue Type: Bug
>      Security Level: public(Regular issues) 
>          Components: Subversion
>            Reporter: Michael McCandless
>            Priority: Minor
>
> We've been seeing the Lucene nightly build fail occasionally from
> exceptions during SVN checkout.
> In the past it was somewhat rare (maybe 1 in 15 builds) but suddenly
> in the past few days it seems to be happening much more frequently.
> The exceptions are rather "varied".  My only guess is some sort of low
> level network communication issue (especially the SSL error below)?
> Maybe there are corresponding errors in the svn server logs?  Maybe
> other projects are seeing similar exceptions?
> When our nightly build hits this, the build aborts and it's marked as
> failed.
> Here's the first example:
> ERROR: Failed to check out https://svn.apache.org/repos/asf/lucene/java/trunk
> org.tmatesoft.svn.core.SVNException: svn: REPORT request failed on '/repos/asf/!svn/vcc/default'
> svn: SSL peer shut down incorrectly
> 	at org.tmatesoft.svn.core.internal.wc.SVNErrorManager.error(SVNErrorManager.java:80)
> 	at org.tmatesoft.svn.core.internal.io.dav.http.HTTPConnection.request(HTTPConnection.java:517)
> 	at org.tmatesoft.svn.core.internal.io.dav.http.HTTPConnection.request(HTTPConnection.java:234)
> 	at org.tmatesoft.svn.core.internal.io.dav.http.HTTPConnection.request(HTTPConnection.java:222)
> 	at org.tmatesoft.svn.core.internal.io.dav.DAVConnection.doReport(DAVConnection.java:219)
> 	at org.tmatesoft.svn.core.internal.io.dav.DAVConnection.doReport(DAVConnection.java:211)
> 	at org.tmatesoft.svn.core.internal.io.dav.DAVRepository.update(DAVRepository.java:609)
> 	at org.tmatesoft.svn.core.wc.SVNUpdateClient.doUpdate(SVNUpdateClient.java:162)
> 	at org.tmatesoft.svn.core.wc.SVNUpdateClient.doCheckout(SVNUpdateClient.java:325)
> 	at hudson.scm.SubversionSCM$CheckOutTask.invoke(SubversionSCM.java:397)
> 	at hudson.scm.SubversionSCM$CheckOutTask.invoke(SubversionSCM.java:349)
> 	at hudson.FilePath.act(FilePath.java:291)
> 	at hudson.scm.SubversionSCM.checkout(SubversionSCM.java:346)
> 	at hudson.scm.SubversionSCM.checkout(SubversionSCM.java:292)
> 	at hudson.model.AbstractProject.checkout(AbstractProject.java:541)
> 	at hudson.model.AbstractBuild$AbstractRunner.checkout(AbstractBuild.java:223)
> 	at hudson.model.AbstractBuild$AbstractRunner.run(AbstractBuild.java:189)
> 	at hudson.model.Run.run(Run.java:649)
> 	at hudson.model.Build.run(Build.java:102)
> 	at hudson.model.ResourceController.execute(ResourceController.java:70)
> 	at hudson.model.Executor.run(Executor.java:64)
> 2nd example:
> ERROR: Failed to check out http://svn.apache.org/repos/asf/lucene/java/trunk
> org.tmatesoft.svn.core.SVNException: svn: REPORT request failed on '/repos/asf/!svn/vcc/default'
> svn: CRLF expected at end of chunk: 151/115
> 	at org.tmatesoft.svn.core.internal.wc.SVNErrorManager.error(SVNErrorManager.java:80)
> 	at org.tmatesoft.svn.core.internal.io.dav.http.HTTPConnection.request(HTTPConnection.java:517)
> 	at org.tmatesoft.svn.core.internal.io.dav.http.HTTPConnection.request(HTTPConnection.java:234)
> 	at org.tmatesoft.svn.core.internal.io.dav.http.HTTPConnection.request(HTTPConnection.java:222)
> 	at org.tmatesoft.svn.core.internal.io.dav.DAVConnection.doReport(DAVConnection.java:219)
> 	at org.tmatesoft.svn.core.internal.io.dav.DAVConnection.doReport(DAVConnection.java:211)
> 	at org.tmatesoft.svn.core.internal.io.dav.DAVRepository.update(DAVRepository.java:609)
> 	at org.tmatesoft.svn.core.wc.SVNUpdateClient.doUpdate(SVNUpdateClient.java:162)
> 	at org.tmatesoft.svn.core.wc.SVNUpdateClient.doCheckout(SVNUpdateClient.java:325)
> 	at hudson.scm.SubversionSCM$CheckOutTask.invoke(SubversionSCM.java:397)
> 	at hudson.scm.SubversionSCM$CheckOutTask.invoke(SubversionSCM.java:349)
> 	at hudson.FilePath.act(FilePath.java:291)
> 	at hudson.scm.SubversionSCM.checkout(SubversionSCM.java:346)
> 	at hudson.scm.SubversionSCM.checkout(SubversionSCM.java:292)
> 	at hudson.model.AbstractProject.checkout(AbstractProject.java:541)
> 	at hudson.model.AbstractBuild$AbstractRunner.checkout(AbstractBuild.java:223)
> 	at hudson.model.AbstractBuild$AbstractRunner.run(AbstractBuild.java:189)
> 	at hudson.model.Run.run(Run.java:649)
> 	at hudson.model.Build.run(Build.java:102)
> 	at hudson.model.ResourceController.execute(ResourceController.java:70)
> 	at hudson.model.Executor.run(Executor.java:64)
> 3rd example:
> FATAL: Java heap space
> java.lang.OutOfMemoryError: Java heap space
> 	at org.tmatesoft.svn.core.internal.delta.SVNDeltaReader.deflate(SVNDeltaReader.java:163)
> 	at org.tmatesoft.svn.core.internal.delta.SVNDeltaReader.nextWindow(SVNDeltaReader.java:127)
> 	at org.tmatesoft.svn.core.internal.io.dav.handlers.BasicDAVDeltaHandler.characters(BasicDAVDeltaHandler.java:96)
> 	at com.sun.org.apache.xerces.internal.parsers.AbstractSAXParser.characters(AbstractSAXParser.java:538)
> 	at com.sun.org.apache.xerces.internal.impl.XMLDocumentFragmentScannerImpl.scanDocument(XMLDocumentFragmentScannerImpl.java:461)
> 	at com.sun.org.apache.xerces.internal.parsers.XML11Configuration.parse(XML11Configuration.java:807)
> 	at com.sun.org.apache.xerces.internal.parsers.XML11Configuration.parse(XML11Configuration.java:737)
> 	at com.sun.org.apache.xerces.internal.parsers.XMLParser.parse(XMLParser.java:107)
> 	at com.sun.org.apache.xerces.internal.parsers.AbstractSAXParser.parse(AbstractSAXParser.java:1205)
> 	at com.sun.org.apache.xerces.internal.jaxp.SAXParserImpl$JAXPSAXParser.parse(SAXParserImpl.java:522)
> 	at org.tmatesoft.svn.core.internal.io.dav.http.HTTPConnection.readData(HTTPConnection.java:646)
> 	at org.tmatesoft.svn.core.internal.io.dav.http.HTTPConnection.readData(HTTPConnection.java:611)
> 	at org.tmatesoft.svn.core.internal.io.dav.http.HTTPRequest.dispatch(HTTPRequest.java:196)
> 	at org.tmatesoft.svn.core.internal.io.dav.http.HTTPConnection.request(HTTPConnection.java:289)
> 	at org.tmatesoft.svn.core.internal.io.dav.http.HTTPConnection.request(HTTPConnection.java:234)
> 	at org.tmatesoft.svn.core.internal.io.dav.http.HTTPConnection.request(HTTPConnection.java:222)
> 	at org.tmatesoft.svn.core.internal.io.dav.DAVConnection.doReport(DAVConnection.java:219)
> 	at org.tmatesoft.svn.core.internal.io.dav.DAVConnection.doReport(DAVConnection.java:211)
> 	at org.tmatesoft.svn.core.internal.io.dav.DAVRepository.update(DAVRepository.java:609)
> 	at org.tmatesoft.svn.core.wc.SVNUpdateClient.doUpdate(SVNUpdateClient.java:162)
> 	at org.tmatesoft.svn.core.wc.SVNUpdateClient.doCheckout(SVNUpdateClient.java:325)
> 	at hudson.scm.SubversionSCM$CheckOutTask.invoke(SubversionSCM.java:397)
> 	at hudson.scm.SubversionSCM$CheckOutTask.invoke(SubversionSCM.java:349)
> 	at hudson.FilePath.act(FilePath.java:291)
> 	at hudson.scm.SubversionSCM.checkout(SubversionSCM.java:346)
> 	at hudson.scm.SubversionSCM.checkout(SubversionSCM.java:292)
> 	at hudson.model.AbstractProject.checkout(AbstractProject.java:541)
> 	at hudson.model.AbstractBuild$AbstractRunner.checkout(AbstractBuild.java:223)
> 	at hudson.model.AbstractBuild$AbstractRunner.run(AbstractBuild.java:189)
> 	at hudson.model.Run.run(Run.java:649)
> 	at hudson.model.Build.run(Build.java:102)
> 	at hudson.model.ResourceController.execute(ResourceController.java:70)
> 4th example:
> ERROR: Failed to check out http://svn.apache.org/repos/asf/lucene/java/trunk
> org.tmatesoft.svn.core.SVNException: svn: REPORT request failed on '/repos/asf/!svn/vcc/default'
> svn: Processing REPORT request response failed: The element type "S:txdelta" must be terminated by the matching end-tag "</S:txdelta>". (/repos/asf/!svn/vcc/default) 
> 	at org.tmatesoft.svn.core.internal.wc.SVNErrorManager.error(SVNErrorManager.java:80)
> 	at org.tmatesoft.svn.core.internal.io.dav.http.HTTPConnection.request(HTTPConnection.java:517)
> 	at org.tmatesoft.svn.core.internal.io.dav.http.HTTPConnection.request(HTTPConnection.java:234)
> 	at org.tmatesoft.svn.core.internal.io.dav.http.HTTPConnection.request(HTTPConnection.java:222)
> 	at org.tmatesoft.svn.core.internal.io.dav.DAVConnection.doReport(DAVConnection.java:219)
> 	at org.tmatesoft.svn.core.internal.io.dav.DAVConnection.doReport(DAVConnection.java:211)
> 	at org.tmatesoft.svn.core.internal.io.dav.DAVRepository.update(DAVRepository.java:609)
> 	at org.tmatesoft.svn.core.wc.SVNUpdateClient.doUpdate(SVNUpdateClient.java:162)
> 	at org.tmatesoft.svn.core.wc.SVNUpdateClient.doCheckout(SVNUpdateClient.java:325)
> 	at hudson.scm.SubversionSCM$CheckOutTask.invoke(SubversionSCM.java:397)
> 	at hudson.scm.SubversionSCM$CheckOutTask.invoke(SubversionSCM.java:349)
> 	at hudson.FilePath.act(FilePath.java:291)
> 	at hudson.scm.SubversionSCM.checkout(SubversionSCM.java:346)
> 	at hudson.scm.SubversionSCM.checkout(SubversionSCM.java:292)
> 	at hudson.model.AbstractProject.checkout(AbstractProject.java:541)
> 	at hudson.model.AbstractBuild$AbstractRunner.checkout(AbstractBuild.java:223)
> 	at hudson.model.AbstractBuild$AbstractRunner.run(AbstractBuild.java:189)
> 	at hudson.model.Run.run(Run.java:649)
> 	at hudson.model.Build.run(Build.java:102)
> 	at hudson.model.ResourceController.execute(ResourceController.java:70)
> 	at hudson.model.Executor.run(Executor.java:64)

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Commented: (INFRA-1460) Intermittent SVN checkout errors during Lucene nightly build

Posted by "Joe Schaefer (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/INFRA-1460?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12557380#action_12557380 ] 

Joe Schaefer commented on INFRA-1460:
-------------------------------------

That's probably because I had to restart the server in order to change the timeout from 60s
to 600s.

> Intermittent SVN checkout errors during Lucene nightly build
> ------------------------------------------------------------
>
>                 Key: INFRA-1460
>                 URL: https://issues.apache.org/jira/browse/INFRA-1460
>             Project: Infrastructure
>          Issue Type: Bug
>      Security Level: public(Regular issues) 
>          Components: Subversion
>            Reporter: Michael McCandless
>
> We've been seeing the Lucene nightly build fail occasionally from
> exceptions during SVN checkout.
> In the past it was somewhat rare (maybe 1 in 15 builds) but suddenly
> in the past few days it seems to be happening much more frequently.
> The exceptions are rather "varied".  My only guess is some sort of low
> level network communication issue (especially the SSL error below)?
> Maybe there are corresponding errors in the svn server logs?  Maybe
> other projects are seeing similar exceptions?
> When our nightly build hits this, the build aborts and it's marked as
> failed.
> Here's the first example:
> ERROR: Failed to check out https://svn.apache.org/repos/asf/lucene/java/trunk
> org.tmatesoft.svn.core.SVNException: svn: REPORT request failed on '/repos/asf/!svn/vcc/default'
> svn: SSL peer shut down incorrectly
> 	at org.tmatesoft.svn.core.internal.wc.SVNErrorManager.error(SVNErrorManager.java:80)
> 	at org.tmatesoft.svn.core.internal.io.dav.http.HTTPConnection.request(HTTPConnection.java:517)
> 	at org.tmatesoft.svn.core.internal.io.dav.http.HTTPConnection.request(HTTPConnection.java:234)
> 	at org.tmatesoft.svn.core.internal.io.dav.http.HTTPConnection.request(HTTPConnection.java:222)
> 	at org.tmatesoft.svn.core.internal.io.dav.DAVConnection.doReport(DAVConnection.java:219)
> 	at org.tmatesoft.svn.core.internal.io.dav.DAVConnection.doReport(DAVConnection.java:211)
> 	at org.tmatesoft.svn.core.internal.io.dav.DAVRepository.update(DAVRepository.java:609)
> 	at org.tmatesoft.svn.core.wc.SVNUpdateClient.doUpdate(SVNUpdateClient.java:162)
> 	at org.tmatesoft.svn.core.wc.SVNUpdateClient.doCheckout(SVNUpdateClient.java:325)
> 	at hudson.scm.SubversionSCM$CheckOutTask.invoke(SubversionSCM.java:397)
> 	at hudson.scm.SubversionSCM$CheckOutTask.invoke(SubversionSCM.java:349)
> 	at hudson.FilePath.act(FilePath.java:291)
> 	at hudson.scm.SubversionSCM.checkout(SubversionSCM.java:346)
> 	at hudson.scm.SubversionSCM.checkout(SubversionSCM.java:292)
> 	at hudson.model.AbstractProject.checkout(AbstractProject.java:541)
> 	at hudson.model.AbstractBuild$AbstractRunner.checkout(AbstractBuild.java:223)
> 	at hudson.model.AbstractBuild$AbstractRunner.run(AbstractBuild.java:189)
> 	at hudson.model.Run.run(Run.java:649)
> 	at hudson.model.Build.run(Build.java:102)
> 	at hudson.model.ResourceController.execute(ResourceController.java:70)
> 	at hudson.model.Executor.run(Executor.java:64)
> 2nd example:
> ERROR: Failed to check out http://svn.apache.org/repos/asf/lucene/java/trunk
> org.tmatesoft.svn.core.SVNException: svn: REPORT request failed on '/repos/asf/!svn/vcc/default'
> svn: CRLF expected at end of chunk: 151/115
> 	at org.tmatesoft.svn.core.internal.wc.SVNErrorManager.error(SVNErrorManager.java:80)
> 	at org.tmatesoft.svn.core.internal.io.dav.http.HTTPConnection.request(HTTPConnection.java:517)
> 	at org.tmatesoft.svn.core.internal.io.dav.http.HTTPConnection.request(HTTPConnection.java:234)
> 	at org.tmatesoft.svn.core.internal.io.dav.http.HTTPConnection.request(HTTPConnection.java:222)
> 	at org.tmatesoft.svn.core.internal.io.dav.DAVConnection.doReport(DAVConnection.java:219)
> 	at org.tmatesoft.svn.core.internal.io.dav.DAVConnection.doReport(DAVConnection.java:211)
> 	at org.tmatesoft.svn.core.internal.io.dav.DAVRepository.update(DAVRepository.java:609)
> 	at org.tmatesoft.svn.core.wc.SVNUpdateClient.doUpdate(SVNUpdateClient.java:162)
> 	at org.tmatesoft.svn.core.wc.SVNUpdateClient.doCheckout(SVNUpdateClient.java:325)
> 	at hudson.scm.SubversionSCM$CheckOutTask.invoke(SubversionSCM.java:397)
> 	at hudson.scm.SubversionSCM$CheckOutTask.invoke(SubversionSCM.java:349)
> 	at hudson.FilePath.act(FilePath.java:291)
> 	at hudson.scm.SubversionSCM.checkout(SubversionSCM.java:346)
> 	at hudson.scm.SubversionSCM.checkout(SubversionSCM.java:292)
> 	at hudson.model.AbstractProject.checkout(AbstractProject.java:541)
> 	at hudson.model.AbstractBuild$AbstractRunner.checkout(AbstractBuild.java:223)
> 	at hudson.model.AbstractBuild$AbstractRunner.run(AbstractBuild.java:189)
> 	at hudson.model.Run.run(Run.java:649)
> 	at hudson.model.Build.run(Build.java:102)
> 	at hudson.model.ResourceController.execute(ResourceController.java:70)
> 	at hudson.model.Executor.run(Executor.java:64)
> 3rd example:
> FATAL: Java heap space
> java.lang.OutOfMemoryError: Java heap space
> 	at org.tmatesoft.svn.core.internal.delta.SVNDeltaReader.deflate(SVNDeltaReader.java:163)
> 	at org.tmatesoft.svn.core.internal.delta.SVNDeltaReader.nextWindow(SVNDeltaReader.java:127)
> 	at org.tmatesoft.svn.core.internal.io.dav.handlers.BasicDAVDeltaHandler.characters(BasicDAVDeltaHandler.java:96)
> 	at com.sun.org.apache.xerces.internal.parsers.AbstractSAXParser.characters(AbstractSAXParser.java:538)
> 	at com.sun.org.apache.xerces.internal.impl.XMLDocumentFragmentScannerImpl.scanDocument(XMLDocumentFragmentScannerImpl.java:461)
> 	at com.sun.org.apache.xerces.internal.parsers.XML11Configuration.parse(XML11Configuration.java:807)
> 	at com.sun.org.apache.xerces.internal.parsers.XML11Configuration.parse(XML11Configuration.java:737)
> 	at com.sun.org.apache.xerces.internal.parsers.XMLParser.parse(XMLParser.java:107)
> 	at com.sun.org.apache.xerces.internal.parsers.AbstractSAXParser.parse(AbstractSAXParser.java:1205)
> 	at com.sun.org.apache.xerces.internal.jaxp.SAXParserImpl$JAXPSAXParser.parse(SAXParserImpl.java:522)
> 	at org.tmatesoft.svn.core.internal.io.dav.http.HTTPConnection.readData(HTTPConnection.java:646)
> 	at org.tmatesoft.svn.core.internal.io.dav.http.HTTPConnection.readData(HTTPConnection.java:611)
> 	at org.tmatesoft.svn.core.internal.io.dav.http.HTTPRequest.dispatch(HTTPRequest.java:196)
> 	at org.tmatesoft.svn.core.internal.io.dav.http.HTTPConnection.request(HTTPConnection.java:289)
> 	at org.tmatesoft.svn.core.internal.io.dav.http.HTTPConnection.request(HTTPConnection.java:234)
> 	at org.tmatesoft.svn.core.internal.io.dav.http.HTTPConnection.request(HTTPConnection.java:222)
> 	at org.tmatesoft.svn.core.internal.io.dav.DAVConnection.doReport(DAVConnection.java:219)
> 	at org.tmatesoft.svn.core.internal.io.dav.DAVConnection.doReport(DAVConnection.java:211)
> 	at org.tmatesoft.svn.core.internal.io.dav.DAVRepository.update(DAVRepository.java:609)
> 	at org.tmatesoft.svn.core.wc.SVNUpdateClient.doUpdate(SVNUpdateClient.java:162)
> 	at org.tmatesoft.svn.core.wc.SVNUpdateClient.doCheckout(SVNUpdateClient.java:325)
> 	at hudson.scm.SubversionSCM$CheckOutTask.invoke(SubversionSCM.java:397)
> 	at hudson.scm.SubversionSCM$CheckOutTask.invoke(SubversionSCM.java:349)
> 	at hudson.FilePath.act(FilePath.java:291)
> 	at hudson.scm.SubversionSCM.checkout(SubversionSCM.java:346)
> 	at hudson.scm.SubversionSCM.checkout(SubversionSCM.java:292)
> 	at hudson.model.AbstractProject.checkout(AbstractProject.java:541)
> 	at hudson.model.AbstractBuild$AbstractRunner.checkout(AbstractBuild.java:223)
> 	at hudson.model.AbstractBuild$AbstractRunner.run(AbstractBuild.java:189)
> 	at hudson.model.Run.run(Run.java:649)
> 	at hudson.model.Build.run(Build.java:102)
> 	at hudson.model.ResourceController.execute(ResourceController.java:70)
> 4th example:
> ERROR: Failed to check out http://svn.apache.org/repos/asf/lucene/java/trunk
> org.tmatesoft.svn.core.SVNException: svn: REPORT request failed on '/repos/asf/!svn/vcc/default'
> svn: Processing REPORT request response failed: The element type "S:txdelta" must be terminated by the matching end-tag "</S:txdelta>". (/repos/asf/!svn/vcc/default) 
> 	at org.tmatesoft.svn.core.internal.wc.SVNErrorManager.error(SVNErrorManager.java:80)
> 	at org.tmatesoft.svn.core.internal.io.dav.http.HTTPConnection.request(HTTPConnection.java:517)
> 	at org.tmatesoft.svn.core.internal.io.dav.http.HTTPConnection.request(HTTPConnection.java:234)
> 	at org.tmatesoft.svn.core.internal.io.dav.http.HTTPConnection.request(HTTPConnection.java:222)
> 	at org.tmatesoft.svn.core.internal.io.dav.DAVConnection.doReport(DAVConnection.java:219)
> 	at org.tmatesoft.svn.core.internal.io.dav.DAVConnection.doReport(DAVConnection.java:211)
> 	at org.tmatesoft.svn.core.internal.io.dav.DAVRepository.update(DAVRepository.java:609)
> 	at org.tmatesoft.svn.core.wc.SVNUpdateClient.doUpdate(SVNUpdateClient.java:162)
> 	at org.tmatesoft.svn.core.wc.SVNUpdateClient.doCheckout(SVNUpdateClient.java:325)
> 	at hudson.scm.SubversionSCM$CheckOutTask.invoke(SubversionSCM.java:397)
> 	at hudson.scm.SubversionSCM$CheckOutTask.invoke(SubversionSCM.java:349)
> 	at hudson.FilePath.act(FilePath.java:291)
> 	at hudson.scm.SubversionSCM.checkout(SubversionSCM.java:346)
> 	at hudson.scm.SubversionSCM.checkout(SubversionSCM.java:292)
> 	at hudson.model.AbstractProject.checkout(AbstractProject.java:541)
> 	at hudson.model.AbstractBuild$AbstractRunner.checkout(AbstractBuild.java:223)
> 	at hudson.model.AbstractBuild$AbstractRunner.run(AbstractBuild.java:189)
> 	at hudson.model.Run.run(Run.java:649)
> 	at hudson.model.Build.run(Build.java:102)
> 	at hudson.model.ResourceController.execute(ResourceController.java:70)
> 	at hudson.model.Executor.run(Executor.java:64)

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Commented: (INFRA-1460) Intermittent SVN checkout errors during Lucene nightly build

Posted by "Joe Schaefer (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/INFRA-1460?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12557374#action_12557374 ] 

Joe Schaefer commented on INFRA-1460:
-------------------------------------

I raised the server-side timeout a bit- see if that helps any.


> Intermittent SVN checkout errors during Lucene nightly build
> ------------------------------------------------------------
>
>                 Key: INFRA-1460
>                 URL: https://issues.apache.org/jira/browse/INFRA-1460
>             Project: Infrastructure
>          Issue Type: Bug
>      Security Level: public(Regular issues) 
>          Components: Subversion
>            Reporter: Michael McCandless
>
> We've been seeing the Lucene nightly build fail occasionally from
> exceptions during SVN checkout.
> In the past it was somewhat rare (maybe 1 in 15 builds) but suddenly
> in the past few days it seems to be happening much more frequently.
> The exceptions are rather "varied".  My only guess is some sort of low
> level network communication issue (especially the SSL error below)?
> Maybe there are corresponding errors in the svn server logs?  Maybe
> other projects are seeing similar exceptions?
> When our nightly build hits this, the build aborts and it's marked as
> failed.
> Here's the first example:
> ERROR: Failed to check out https://svn.apache.org/repos/asf/lucene/java/trunk
> org.tmatesoft.svn.core.SVNException: svn: REPORT request failed on '/repos/asf/!svn/vcc/default'
> svn: SSL peer shut down incorrectly
> 	at org.tmatesoft.svn.core.internal.wc.SVNErrorManager.error(SVNErrorManager.java:80)
> 	at org.tmatesoft.svn.core.internal.io.dav.http.HTTPConnection.request(HTTPConnection.java:517)
> 	at org.tmatesoft.svn.core.internal.io.dav.http.HTTPConnection.request(HTTPConnection.java:234)
> 	at org.tmatesoft.svn.core.internal.io.dav.http.HTTPConnection.request(HTTPConnection.java:222)
> 	at org.tmatesoft.svn.core.internal.io.dav.DAVConnection.doReport(DAVConnection.java:219)
> 	at org.tmatesoft.svn.core.internal.io.dav.DAVConnection.doReport(DAVConnection.java:211)
> 	at org.tmatesoft.svn.core.internal.io.dav.DAVRepository.update(DAVRepository.java:609)
> 	at org.tmatesoft.svn.core.wc.SVNUpdateClient.doUpdate(SVNUpdateClient.java:162)
> 	at org.tmatesoft.svn.core.wc.SVNUpdateClient.doCheckout(SVNUpdateClient.java:325)
> 	at hudson.scm.SubversionSCM$CheckOutTask.invoke(SubversionSCM.java:397)
> 	at hudson.scm.SubversionSCM$CheckOutTask.invoke(SubversionSCM.java:349)
> 	at hudson.FilePath.act(FilePath.java:291)
> 	at hudson.scm.SubversionSCM.checkout(SubversionSCM.java:346)
> 	at hudson.scm.SubversionSCM.checkout(SubversionSCM.java:292)
> 	at hudson.model.AbstractProject.checkout(AbstractProject.java:541)
> 	at hudson.model.AbstractBuild$AbstractRunner.checkout(AbstractBuild.java:223)
> 	at hudson.model.AbstractBuild$AbstractRunner.run(AbstractBuild.java:189)
> 	at hudson.model.Run.run(Run.java:649)
> 	at hudson.model.Build.run(Build.java:102)
> 	at hudson.model.ResourceController.execute(ResourceController.java:70)
> 	at hudson.model.Executor.run(Executor.java:64)
> 2nd example:
> ERROR: Failed to check out http://svn.apache.org/repos/asf/lucene/java/trunk
> org.tmatesoft.svn.core.SVNException: svn: REPORT request failed on '/repos/asf/!svn/vcc/default'
> svn: CRLF expected at end of chunk: 151/115
> 	at org.tmatesoft.svn.core.internal.wc.SVNErrorManager.error(SVNErrorManager.java:80)
> 	at org.tmatesoft.svn.core.internal.io.dav.http.HTTPConnection.request(HTTPConnection.java:517)
> 	at org.tmatesoft.svn.core.internal.io.dav.http.HTTPConnection.request(HTTPConnection.java:234)
> 	at org.tmatesoft.svn.core.internal.io.dav.http.HTTPConnection.request(HTTPConnection.java:222)
> 	at org.tmatesoft.svn.core.internal.io.dav.DAVConnection.doReport(DAVConnection.java:219)
> 	at org.tmatesoft.svn.core.internal.io.dav.DAVConnection.doReport(DAVConnection.java:211)
> 	at org.tmatesoft.svn.core.internal.io.dav.DAVRepository.update(DAVRepository.java:609)
> 	at org.tmatesoft.svn.core.wc.SVNUpdateClient.doUpdate(SVNUpdateClient.java:162)
> 	at org.tmatesoft.svn.core.wc.SVNUpdateClient.doCheckout(SVNUpdateClient.java:325)
> 	at hudson.scm.SubversionSCM$CheckOutTask.invoke(SubversionSCM.java:397)
> 	at hudson.scm.SubversionSCM$CheckOutTask.invoke(SubversionSCM.java:349)
> 	at hudson.FilePath.act(FilePath.java:291)
> 	at hudson.scm.SubversionSCM.checkout(SubversionSCM.java:346)
> 	at hudson.scm.SubversionSCM.checkout(SubversionSCM.java:292)
> 	at hudson.model.AbstractProject.checkout(AbstractProject.java:541)
> 	at hudson.model.AbstractBuild$AbstractRunner.checkout(AbstractBuild.java:223)
> 	at hudson.model.AbstractBuild$AbstractRunner.run(AbstractBuild.java:189)
> 	at hudson.model.Run.run(Run.java:649)
> 	at hudson.model.Build.run(Build.java:102)
> 	at hudson.model.ResourceController.execute(ResourceController.java:70)
> 	at hudson.model.Executor.run(Executor.java:64)
> 3rd example:
> FATAL: Java heap space
> java.lang.OutOfMemoryError: Java heap space
> 	at org.tmatesoft.svn.core.internal.delta.SVNDeltaReader.deflate(SVNDeltaReader.java:163)
> 	at org.tmatesoft.svn.core.internal.delta.SVNDeltaReader.nextWindow(SVNDeltaReader.java:127)
> 	at org.tmatesoft.svn.core.internal.io.dav.handlers.BasicDAVDeltaHandler.characters(BasicDAVDeltaHandler.java:96)
> 	at com.sun.org.apache.xerces.internal.parsers.AbstractSAXParser.characters(AbstractSAXParser.java:538)
> 	at com.sun.org.apache.xerces.internal.impl.XMLDocumentFragmentScannerImpl.scanDocument(XMLDocumentFragmentScannerImpl.java:461)
> 	at com.sun.org.apache.xerces.internal.parsers.XML11Configuration.parse(XML11Configuration.java:807)
> 	at com.sun.org.apache.xerces.internal.parsers.XML11Configuration.parse(XML11Configuration.java:737)
> 	at com.sun.org.apache.xerces.internal.parsers.XMLParser.parse(XMLParser.java:107)
> 	at com.sun.org.apache.xerces.internal.parsers.AbstractSAXParser.parse(AbstractSAXParser.java:1205)
> 	at com.sun.org.apache.xerces.internal.jaxp.SAXParserImpl$JAXPSAXParser.parse(SAXParserImpl.java:522)
> 	at org.tmatesoft.svn.core.internal.io.dav.http.HTTPConnection.readData(HTTPConnection.java:646)
> 	at org.tmatesoft.svn.core.internal.io.dav.http.HTTPConnection.readData(HTTPConnection.java:611)
> 	at org.tmatesoft.svn.core.internal.io.dav.http.HTTPRequest.dispatch(HTTPRequest.java:196)
> 	at org.tmatesoft.svn.core.internal.io.dav.http.HTTPConnection.request(HTTPConnection.java:289)
> 	at org.tmatesoft.svn.core.internal.io.dav.http.HTTPConnection.request(HTTPConnection.java:234)
> 	at org.tmatesoft.svn.core.internal.io.dav.http.HTTPConnection.request(HTTPConnection.java:222)
> 	at org.tmatesoft.svn.core.internal.io.dav.DAVConnection.doReport(DAVConnection.java:219)
> 	at org.tmatesoft.svn.core.internal.io.dav.DAVConnection.doReport(DAVConnection.java:211)
> 	at org.tmatesoft.svn.core.internal.io.dav.DAVRepository.update(DAVRepository.java:609)
> 	at org.tmatesoft.svn.core.wc.SVNUpdateClient.doUpdate(SVNUpdateClient.java:162)
> 	at org.tmatesoft.svn.core.wc.SVNUpdateClient.doCheckout(SVNUpdateClient.java:325)
> 	at hudson.scm.SubversionSCM$CheckOutTask.invoke(SubversionSCM.java:397)
> 	at hudson.scm.SubversionSCM$CheckOutTask.invoke(SubversionSCM.java:349)
> 	at hudson.FilePath.act(FilePath.java:291)
> 	at hudson.scm.SubversionSCM.checkout(SubversionSCM.java:346)
> 	at hudson.scm.SubversionSCM.checkout(SubversionSCM.java:292)
> 	at hudson.model.AbstractProject.checkout(AbstractProject.java:541)
> 	at hudson.model.AbstractBuild$AbstractRunner.checkout(AbstractBuild.java:223)
> 	at hudson.model.AbstractBuild$AbstractRunner.run(AbstractBuild.java:189)
> 	at hudson.model.Run.run(Run.java:649)
> 	at hudson.model.Build.run(Build.java:102)
> 	at hudson.model.ResourceController.execute(ResourceController.java:70)
> 4th example:
> ERROR: Failed to check out http://svn.apache.org/repos/asf/lucene/java/trunk
> org.tmatesoft.svn.core.SVNException: svn: REPORT request failed on '/repos/asf/!svn/vcc/default'
> svn: Processing REPORT request response failed: The element type "S:txdelta" must be terminated by the matching end-tag "</S:txdelta>". (/repos/asf/!svn/vcc/default) 
> 	at org.tmatesoft.svn.core.internal.wc.SVNErrorManager.error(SVNErrorManager.java:80)
> 	at org.tmatesoft.svn.core.internal.io.dav.http.HTTPConnection.request(HTTPConnection.java:517)
> 	at org.tmatesoft.svn.core.internal.io.dav.http.HTTPConnection.request(HTTPConnection.java:234)
> 	at org.tmatesoft.svn.core.internal.io.dav.http.HTTPConnection.request(HTTPConnection.java:222)
> 	at org.tmatesoft.svn.core.internal.io.dav.DAVConnection.doReport(DAVConnection.java:219)
> 	at org.tmatesoft.svn.core.internal.io.dav.DAVConnection.doReport(DAVConnection.java:211)
> 	at org.tmatesoft.svn.core.internal.io.dav.DAVRepository.update(DAVRepository.java:609)
> 	at org.tmatesoft.svn.core.wc.SVNUpdateClient.doUpdate(SVNUpdateClient.java:162)
> 	at org.tmatesoft.svn.core.wc.SVNUpdateClient.doCheckout(SVNUpdateClient.java:325)
> 	at hudson.scm.SubversionSCM$CheckOutTask.invoke(SubversionSCM.java:397)
> 	at hudson.scm.SubversionSCM$CheckOutTask.invoke(SubversionSCM.java:349)
> 	at hudson.FilePath.act(FilePath.java:291)
> 	at hudson.scm.SubversionSCM.checkout(SubversionSCM.java:346)
> 	at hudson.scm.SubversionSCM.checkout(SubversionSCM.java:292)
> 	at hudson.model.AbstractProject.checkout(AbstractProject.java:541)
> 	at hudson.model.AbstractBuild$AbstractRunner.checkout(AbstractBuild.java:223)
> 	at hudson.model.AbstractBuild$AbstractRunner.run(AbstractBuild.java:189)
> 	at hudson.model.Run.run(Run.java:649)
> 	at hudson.model.Build.run(Build.java:102)
> 	at hudson.model.ResourceController.execute(ResourceController.java:70)
> 	at hudson.model.Executor.run(Executor.java:64)

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Commented: (INFRA-1460) Intermittent SVN checkout errors during Lucene nightly build

Posted by "Nigel Daley (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/INFRA-1460?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12557377#action_12557377 ] 

Nigel Daley commented on INFRA-1460:
------------------------------------

Thanks Joe.  What was the value and what's the new value for the timeout?

I've also seen a few checkouts fail from our internal Yahoo! machines (around 10 minutes before your posted comment).  We'll continue to look for this problem.

> Intermittent SVN checkout errors during Lucene nightly build
> ------------------------------------------------------------
>
>                 Key: INFRA-1460
>                 URL: https://issues.apache.org/jira/browse/INFRA-1460
>             Project: Infrastructure
>          Issue Type: Bug
>      Security Level: public(Regular issues) 
>          Components: Subversion
>            Reporter: Michael McCandless
>
> We've been seeing the Lucene nightly build fail occasionally from
> exceptions during SVN checkout.
> In the past it was somewhat rare (maybe 1 in 15 builds) but suddenly
> in the past few days it seems to be happening much more frequently.
> The exceptions are rather "varied".  My only guess is some sort of low
> level network communication issue (especially the SSL error below)?
> Maybe there are corresponding errors in the svn server logs?  Maybe
> other projects are seeing similar exceptions?
> When our nightly build hits this, the build aborts and it's marked as
> failed.
> Here's the first example:
> ERROR: Failed to check out https://svn.apache.org/repos/asf/lucene/java/trunk
> org.tmatesoft.svn.core.SVNException: svn: REPORT request failed on '/repos/asf/!svn/vcc/default'
> svn: SSL peer shut down incorrectly
> 	at org.tmatesoft.svn.core.internal.wc.SVNErrorManager.error(SVNErrorManager.java:80)
> 	at org.tmatesoft.svn.core.internal.io.dav.http.HTTPConnection.request(HTTPConnection.java:517)
> 	at org.tmatesoft.svn.core.internal.io.dav.http.HTTPConnection.request(HTTPConnection.java:234)
> 	at org.tmatesoft.svn.core.internal.io.dav.http.HTTPConnection.request(HTTPConnection.java:222)
> 	at org.tmatesoft.svn.core.internal.io.dav.DAVConnection.doReport(DAVConnection.java:219)
> 	at org.tmatesoft.svn.core.internal.io.dav.DAVConnection.doReport(DAVConnection.java:211)
> 	at org.tmatesoft.svn.core.internal.io.dav.DAVRepository.update(DAVRepository.java:609)
> 	at org.tmatesoft.svn.core.wc.SVNUpdateClient.doUpdate(SVNUpdateClient.java:162)
> 	at org.tmatesoft.svn.core.wc.SVNUpdateClient.doCheckout(SVNUpdateClient.java:325)
> 	at hudson.scm.SubversionSCM$CheckOutTask.invoke(SubversionSCM.java:397)
> 	at hudson.scm.SubversionSCM$CheckOutTask.invoke(SubversionSCM.java:349)
> 	at hudson.FilePath.act(FilePath.java:291)
> 	at hudson.scm.SubversionSCM.checkout(SubversionSCM.java:346)
> 	at hudson.scm.SubversionSCM.checkout(SubversionSCM.java:292)
> 	at hudson.model.AbstractProject.checkout(AbstractProject.java:541)
> 	at hudson.model.AbstractBuild$AbstractRunner.checkout(AbstractBuild.java:223)
> 	at hudson.model.AbstractBuild$AbstractRunner.run(AbstractBuild.java:189)
> 	at hudson.model.Run.run(Run.java:649)
> 	at hudson.model.Build.run(Build.java:102)
> 	at hudson.model.ResourceController.execute(ResourceController.java:70)
> 	at hudson.model.Executor.run(Executor.java:64)
> 2nd example:
> ERROR: Failed to check out http://svn.apache.org/repos/asf/lucene/java/trunk
> org.tmatesoft.svn.core.SVNException: svn: REPORT request failed on '/repos/asf/!svn/vcc/default'
> svn: CRLF expected at end of chunk: 151/115
> 	at org.tmatesoft.svn.core.internal.wc.SVNErrorManager.error(SVNErrorManager.java:80)
> 	at org.tmatesoft.svn.core.internal.io.dav.http.HTTPConnection.request(HTTPConnection.java:517)
> 	at org.tmatesoft.svn.core.internal.io.dav.http.HTTPConnection.request(HTTPConnection.java:234)
> 	at org.tmatesoft.svn.core.internal.io.dav.http.HTTPConnection.request(HTTPConnection.java:222)
> 	at org.tmatesoft.svn.core.internal.io.dav.DAVConnection.doReport(DAVConnection.java:219)
> 	at org.tmatesoft.svn.core.internal.io.dav.DAVConnection.doReport(DAVConnection.java:211)
> 	at org.tmatesoft.svn.core.internal.io.dav.DAVRepository.update(DAVRepository.java:609)
> 	at org.tmatesoft.svn.core.wc.SVNUpdateClient.doUpdate(SVNUpdateClient.java:162)
> 	at org.tmatesoft.svn.core.wc.SVNUpdateClient.doCheckout(SVNUpdateClient.java:325)
> 	at hudson.scm.SubversionSCM$CheckOutTask.invoke(SubversionSCM.java:397)
> 	at hudson.scm.SubversionSCM$CheckOutTask.invoke(SubversionSCM.java:349)
> 	at hudson.FilePath.act(FilePath.java:291)
> 	at hudson.scm.SubversionSCM.checkout(SubversionSCM.java:346)
> 	at hudson.scm.SubversionSCM.checkout(SubversionSCM.java:292)
> 	at hudson.model.AbstractProject.checkout(AbstractProject.java:541)
> 	at hudson.model.AbstractBuild$AbstractRunner.checkout(AbstractBuild.java:223)
> 	at hudson.model.AbstractBuild$AbstractRunner.run(AbstractBuild.java:189)
> 	at hudson.model.Run.run(Run.java:649)
> 	at hudson.model.Build.run(Build.java:102)
> 	at hudson.model.ResourceController.execute(ResourceController.java:70)
> 	at hudson.model.Executor.run(Executor.java:64)
> 3rd example:
> FATAL: Java heap space
> java.lang.OutOfMemoryError: Java heap space
> 	at org.tmatesoft.svn.core.internal.delta.SVNDeltaReader.deflate(SVNDeltaReader.java:163)
> 	at org.tmatesoft.svn.core.internal.delta.SVNDeltaReader.nextWindow(SVNDeltaReader.java:127)
> 	at org.tmatesoft.svn.core.internal.io.dav.handlers.BasicDAVDeltaHandler.characters(BasicDAVDeltaHandler.java:96)
> 	at com.sun.org.apache.xerces.internal.parsers.AbstractSAXParser.characters(AbstractSAXParser.java:538)
> 	at com.sun.org.apache.xerces.internal.impl.XMLDocumentFragmentScannerImpl.scanDocument(XMLDocumentFragmentScannerImpl.java:461)
> 	at com.sun.org.apache.xerces.internal.parsers.XML11Configuration.parse(XML11Configuration.java:807)
> 	at com.sun.org.apache.xerces.internal.parsers.XML11Configuration.parse(XML11Configuration.java:737)
> 	at com.sun.org.apache.xerces.internal.parsers.XMLParser.parse(XMLParser.java:107)
> 	at com.sun.org.apache.xerces.internal.parsers.AbstractSAXParser.parse(AbstractSAXParser.java:1205)
> 	at com.sun.org.apache.xerces.internal.jaxp.SAXParserImpl$JAXPSAXParser.parse(SAXParserImpl.java:522)
> 	at org.tmatesoft.svn.core.internal.io.dav.http.HTTPConnection.readData(HTTPConnection.java:646)
> 	at org.tmatesoft.svn.core.internal.io.dav.http.HTTPConnection.readData(HTTPConnection.java:611)
> 	at org.tmatesoft.svn.core.internal.io.dav.http.HTTPRequest.dispatch(HTTPRequest.java:196)
> 	at org.tmatesoft.svn.core.internal.io.dav.http.HTTPConnection.request(HTTPConnection.java:289)
> 	at org.tmatesoft.svn.core.internal.io.dav.http.HTTPConnection.request(HTTPConnection.java:234)
> 	at org.tmatesoft.svn.core.internal.io.dav.http.HTTPConnection.request(HTTPConnection.java:222)
> 	at org.tmatesoft.svn.core.internal.io.dav.DAVConnection.doReport(DAVConnection.java:219)
> 	at org.tmatesoft.svn.core.internal.io.dav.DAVConnection.doReport(DAVConnection.java:211)
> 	at org.tmatesoft.svn.core.internal.io.dav.DAVRepository.update(DAVRepository.java:609)
> 	at org.tmatesoft.svn.core.wc.SVNUpdateClient.doUpdate(SVNUpdateClient.java:162)
> 	at org.tmatesoft.svn.core.wc.SVNUpdateClient.doCheckout(SVNUpdateClient.java:325)
> 	at hudson.scm.SubversionSCM$CheckOutTask.invoke(SubversionSCM.java:397)
> 	at hudson.scm.SubversionSCM$CheckOutTask.invoke(SubversionSCM.java:349)
> 	at hudson.FilePath.act(FilePath.java:291)
> 	at hudson.scm.SubversionSCM.checkout(SubversionSCM.java:346)
> 	at hudson.scm.SubversionSCM.checkout(SubversionSCM.java:292)
> 	at hudson.model.AbstractProject.checkout(AbstractProject.java:541)
> 	at hudson.model.AbstractBuild$AbstractRunner.checkout(AbstractBuild.java:223)
> 	at hudson.model.AbstractBuild$AbstractRunner.run(AbstractBuild.java:189)
> 	at hudson.model.Run.run(Run.java:649)
> 	at hudson.model.Build.run(Build.java:102)
> 	at hudson.model.ResourceController.execute(ResourceController.java:70)
> 4th example:
> ERROR: Failed to check out http://svn.apache.org/repos/asf/lucene/java/trunk
> org.tmatesoft.svn.core.SVNException: svn: REPORT request failed on '/repos/asf/!svn/vcc/default'
> svn: Processing REPORT request response failed: The element type "S:txdelta" must be terminated by the matching end-tag "</S:txdelta>". (/repos/asf/!svn/vcc/default) 
> 	at org.tmatesoft.svn.core.internal.wc.SVNErrorManager.error(SVNErrorManager.java:80)
> 	at org.tmatesoft.svn.core.internal.io.dav.http.HTTPConnection.request(HTTPConnection.java:517)
> 	at org.tmatesoft.svn.core.internal.io.dav.http.HTTPConnection.request(HTTPConnection.java:234)
> 	at org.tmatesoft.svn.core.internal.io.dav.http.HTTPConnection.request(HTTPConnection.java:222)
> 	at org.tmatesoft.svn.core.internal.io.dav.DAVConnection.doReport(DAVConnection.java:219)
> 	at org.tmatesoft.svn.core.internal.io.dav.DAVConnection.doReport(DAVConnection.java:211)
> 	at org.tmatesoft.svn.core.internal.io.dav.DAVRepository.update(DAVRepository.java:609)
> 	at org.tmatesoft.svn.core.wc.SVNUpdateClient.doUpdate(SVNUpdateClient.java:162)
> 	at org.tmatesoft.svn.core.wc.SVNUpdateClient.doCheckout(SVNUpdateClient.java:325)
> 	at hudson.scm.SubversionSCM$CheckOutTask.invoke(SubversionSCM.java:397)
> 	at hudson.scm.SubversionSCM$CheckOutTask.invoke(SubversionSCM.java:349)
> 	at hudson.FilePath.act(FilePath.java:291)
> 	at hudson.scm.SubversionSCM.checkout(SubversionSCM.java:346)
> 	at hudson.scm.SubversionSCM.checkout(SubversionSCM.java:292)
> 	at hudson.model.AbstractProject.checkout(AbstractProject.java:541)
> 	at hudson.model.AbstractBuild$AbstractRunner.checkout(AbstractBuild.java:223)
> 	at hudson.model.AbstractBuild$AbstractRunner.run(AbstractBuild.java:189)
> 	at hudson.model.Run.run(Run.java:649)
> 	at hudson.model.Build.run(Build.java:102)
> 	at hudson.model.ResourceController.execute(ResourceController.java:70)
> 	at hudson.model.Executor.run(Executor.java:64)

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Commented: (INFRA-1460) Intermittent SVN checkout errors during Lucene nightly build

Posted by "Michael McCandless (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/INFRA-1460?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12557391#action_12557391 ] 

Michael McCandless commented on INFRA-1460:
-------------------------------------------

I was just able to complete 3 lucene checkouts successfully on lucene.zones.apache.org, so, I'm cautiously optimistic -- thanks Joe!

The IO on the box is still shockingly slow.  I don't understand why...

> Intermittent SVN checkout errors during Lucene nightly build
> ------------------------------------------------------------
>
>                 Key: INFRA-1460
>                 URL: https://issues.apache.org/jira/browse/INFRA-1460
>             Project: Infrastructure
>          Issue Type: Bug
>      Security Level: public(Regular issues) 
>          Components: Subversion
>            Reporter: Michael McCandless
>
> We've been seeing the Lucene nightly build fail occasionally from
> exceptions during SVN checkout.
> In the past it was somewhat rare (maybe 1 in 15 builds) but suddenly
> in the past few days it seems to be happening much more frequently.
> The exceptions are rather "varied".  My only guess is some sort of low
> level network communication issue (especially the SSL error below)?
> Maybe there are corresponding errors in the svn server logs?  Maybe
> other projects are seeing similar exceptions?
> When our nightly build hits this, the build aborts and it's marked as
> failed.
> Here's the first example:
> ERROR: Failed to check out https://svn.apache.org/repos/asf/lucene/java/trunk
> org.tmatesoft.svn.core.SVNException: svn: REPORT request failed on '/repos/asf/!svn/vcc/default'
> svn: SSL peer shut down incorrectly
> 	at org.tmatesoft.svn.core.internal.wc.SVNErrorManager.error(SVNErrorManager.java:80)
> 	at org.tmatesoft.svn.core.internal.io.dav.http.HTTPConnection.request(HTTPConnection.java:517)
> 	at org.tmatesoft.svn.core.internal.io.dav.http.HTTPConnection.request(HTTPConnection.java:234)
> 	at org.tmatesoft.svn.core.internal.io.dav.http.HTTPConnection.request(HTTPConnection.java:222)
> 	at org.tmatesoft.svn.core.internal.io.dav.DAVConnection.doReport(DAVConnection.java:219)
> 	at org.tmatesoft.svn.core.internal.io.dav.DAVConnection.doReport(DAVConnection.java:211)
> 	at org.tmatesoft.svn.core.internal.io.dav.DAVRepository.update(DAVRepository.java:609)
> 	at org.tmatesoft.svn.core.wc.SVNUpdateClient.doUpdate(SVNUpdateClient.java:162)
> 	at org.tmatesoft.svn.core.wc.SVNUpdateClient.doCheckout(SVNUpdateClient.java:325)
> 	at hudson.scm.SubversionSCM$CheckOutTask.invoke(SubversionSCM.java:397)
> 	at hudson.scm.SubversionSCM$CheckOutTask.invoke(SubversionSCM.java:349)
> 	at hudson.FilePath.act(FilePath.java:291)
> 	at hudson.scm.SubversionSCM.checkout(SubversionSCM.java:346)
> 	at hudson.scm.SubversionSCM.checkout(SubversionSCM.java:292)
> 	at hudson.model.AbstractProject.checkout(AbstractProject.java:541)
> 	at hudson.model.AbstractBuild$AbstractRunner.checkout(AbstractBuild.java:223)
> 	at hudson.model.AbstractBuild$AbstractRunner.run(AbstractBuild.java:189)
> 	at hudson.model.Run.run(Run.java:649)
> 	at hudson.model.Build.run(Build.java:102)
> 	at hudson.model.ResourceController.execute(ResourceController.java:70)
> 	at hudson.model.Executor.run(Executor.java:64)
> 2nd example:
> ERROR: Failed to check out http://svn.apache.org/repos/asf/lucene/java/trunk
> org.tmatesoft.svn.core.SVNException: svn: REPORT request failed on '/repos/asf/!svn/vcc/default'
> svn: CRLF expected at end of chunk: 151/115
> 	at org.tmatesoft.svn.core.internal.wc.SVNErrorManager.error(SVNErrorManager.java:80)
> 	at org.tmatesoft.svn.core.internal.io.dav.http.HTTPConnection.request(HTTPConnection.java:517)
> 	at org.tmatesoft.svn.core.internal.io.dav.http.HTTPConnection.request(HTTPConnection.java:234)
> 	at org.tmatesoft.svn.core.internal.io.dav.http.HTTPConnection.request(HTTPConnection.java:222)
> 	at org.tmatesoft.svn.core.internal.io.dav.DAVConnection.doReport(DAVConnection.java:219)
> 	at org.tmatesoft.svn.core.internal.io.dav.DAVConnection.doReport(DAVConnection.java:211)
> 	at org.tmatesoft.svn.core.internal.io.dav.DAVRepository.update(DAVRepository.java:609)
> 	at org.tmatesoft.svn.core.wc.SVNUpdateClient.doUpdate(SVNUpdateClient.java:162)
> 	at org.tmatesoft.svn.core.wc.SVNUpdateClient.doCheckout(SVNUpdateClient.java:325)
> 	at hudson.scm.SubversionSCM$CheckOutTask.invoke(SubversionSCM.java:397)
> 	at hudson.scm.SubversionSCM$CheckOutTask.invoke(SubversionSCM.java:349)
> 	at hudson.FilePath.act(FilePath.java:291)
> 	at hudson.scm.SubversionSCM.checkout(SubversionSCM.java:346)
> 	at hudson.scm.SubversionSCM.checkout(SubversionSCM.java:292)
> 	at hudson.model.AbstractProject.checkout(AbstractProject.java:541)
> 	at hudson.model.AbstractBuild$AbstractRunner.checkout(AbstractBuild.java:223)
> 	at hudson.model.AbstractBuild$AbstractRunner.run(AbstractBuild.java:189)
> 	at hudson.model.Run.run(Run.java:649)
> 	at hudson.model.Build.run(Build.java:102)
> 	at hudson.model.ResourceController.execute(ResourceController.java:70)
> 	at hudson.model.Executor.run(Executor.java:64)
> 3rd example:
> FATAL: Java heap space
> java.lang.OutOfMemoryError: Java heap space
> 	at org.tmatesoft.svn.core.internal.delta.SVNDeltaReader.deflate(SVNDeltaReader.java:163)
> 	at org.tmatesoft.svn.core.internal.delta.SVNDeltaReader.nextWindow(SVNDeltaReader.java:127)
> 	at org.tmatesoft.svn.core.internal.io.dav.handlers.BasicDAVDeltaHandler.characters(BasicDAVDeltaHandler.java:96)
> 	at com.sun.org.apache.xerces.internal.parsers.AbstractSAXParser.characters(AbstractSAXParser.java:538)
> 	at com.sun.org.apache.xerces.internal.impl.XMLDocumentFragmentScannerImpl.scanDocument(XMLDocumentFragmentScannerImpl.java:461)
> 	at com.sun.org.apache.xerces.internal.parsers.XML11Configuration.parse(XML11Configuration.java:807)
> 	at com.sun.org.apache.xerces.internal.parsers.XML11Configuration.parse(XML11Configuration.java:737)
> 	at com.sun.org.apache.xerces.internal.parsers.XMLParser.parse(XMLParser.java:107)
> 	at com.sun.org.apache.xerces.internal.parsers.AbstractSAXParser.parse(AbstractSAXParser.java:1205)
> 	at com.sun.org.apache.xerces.internal.jaxp.SAXParserImpl$JAXPSAXParser.parse(SAXParserImpl.java:522)
> 	at org.tmatesoft.svn.core.internal.io.dav.http.HTTPConnection.readData(HTTPConnection.java:646)
> 	at org.tmatesoft.svn.core.internal.io.dav.http.HTTPConnection.readData(HTTPConnection.java:611)
> 	at org.tmatesoft.svn.core.internal.io.dav.http.HTTPRequest.dispatch(HTTPRequest.java:196)
> 	at org.tmatesoft.svn.core.internal.io.dav.http.HTTPConnection.request(HTTPConnection.java:289)
> 	at org.tmatesoft.svn.core.internal.io.dav.http.HTTPConnection.request(HTTPConnection.java:234)
> 	at org.tmatesoft.svn.core.internal.io.dav.http.HTTPConnection.request(HTTPConnection.java:222)
> 	at org.tmatesoft.svn.core.internal.io.dav.DAVConnection.doReport(DAVConnection.java:219)
> 	at org.tmatesoft.svn.core.internal.io.dav.DAVConnection.doReport(DAVConnection.java:211)
> 	at org.tmatesoft.svn.core.internal.io.dav.DAVRepository.update(DAVRepository.java:609)
> 	at org.tmatesoft.svn.core.wc.SVNUpdateClient.doUpdate(SVNUpdateClient.java:162)
> 	at org.tmatesoft.svn.core.wc.SVNUpdateClient.doCheckout(SVNUpdateClient.java:325)
> 	at hudson.scm.SubversionSCM$CheckOutTask.invoke(SubversionSCM.java:397)
> 	at hudson.scm.SubversionSCM$CheckOutTask.invoke(SubversionSCM.java:349)
> 	at hudson.FilePath.act(FilePath.java:291)
> 	at hudson.scm.SubversionSCM.checkout(SubversionSCM.java:346)
> 	at hudson.scm.SubversionSCM.checkout(SubversionSCM.java:292)
> 	at hudson.model.AbstractProject.checkout(AbstractProject.java:541)
> 	at hudson.model.AbstractBuild$AbstractRunner.checkout(AbstractBuild.java:223)
> 	at hudson.model.AbstractBuild$AbstractRunner.run(AbstractBuild.java:189)
> 	at hudson.model.Run.run(Run.java:649)
> 	at hudson.model.Build.run(Build.java:102)
> 	at hudson.model.ResourceController.execute(ResourceController.java:70)
> 4th example:
> ERROR: Failed to check out http://svn.apache.org/repos/asf/lucene/java/trunk
> org.tmatesoft.svn.core.SVNException: svn: REPORT request failed on '/repos/asf/!svn/vcc/default'
> svn: Processing REPORT request response failed: The element type "S:txdelta" must be terminated by the matching end-tag "</S:txdelta>". (/repos/asf/!svn/vcc/default) 
> 	at org.tmatesoft.svn.core.internal.wc.SVNErrorManager.error(SVNErrorManager.java:80)
> 	at org.tmatesoft.svn.core.internal.io.dav.http.HTTPConnection.request(HTTPConnection.java:517)
> 	at org.tmatesoft.svn.core.internal.io.dav.http.HTTPConnection.request(HTTPConnection.java:234)
> 	at org.tmatesoft.svn.core.internal.io.dav.http.HTTPConnection.request(HTTPConnection.java:222)
> 	at org.tmatesoft.svn.core.internal.io.dav.DAVConnection.doReport(DAVConnection.java:219)
> 	at org.tmatesoft.svn.core.internal.io.dav.DAVConnection.doReport(DAVConnection.java:211)
> 	at org.tmatesoft.svn.core.internal.io.dav.DAVRepository.update(DAVRepository.java:609)
> 	at org.tmatesoft.svn.core.wc.SVNUpdateClient.doUpdate(SVNUpdateClient.java:162)
> 	at org.tmatesoft.svn.core.wc.SVNUpdateClient.doCheckout(SVNUpdateClient.java:325)
> 	at hudson.scm.SubversionSCM$CheckOutTask.invoke(SubversionSCM.java:397)
> 	at hudson.scm.SubversionSCM$CheckOutTask.invoke(SubversionSCM.java:349)
> 	at hudson.FilePath.act(FilePath.java:291)
> 	at hudson.scm.SubversionSCM.checkout(SubversionSCM.java:346)
> 	at hudson.scm.SubversionSCM.checkout(SubversionSCM.java:292)
> 	at hudson.model.AbstractProject.checkout(AbstractProject.java:541)
> 	at hudson.model.AbstractBuild$AbstractRunner.checkout(AbstractBuild.java:223)
> 	at hudson.model.AbstractBuild$AbstractRunner.run(AbstractBuild.java:189)
> 	at hudson.model.Run.run(Run.java:649)
> 	at hudson.model.Build.run(Build.java:102)
> 	at hudson.model.ResourceController.execute(ResourceController.java:70)
> 	at hudson.model.Executor.run(Executor.java:64)

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Commented: (INFRA-1460) Intermittent SVN checkout errors during Lucene nightly build

Posted by "Michael McCandless (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/INFRA-1460?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12557048#action_12557048 ] 

Michael McCandless commented on INFRA-1460:
-------------------------------------------

This issue is fairly serious for lucene-java: of the past 21 builds,
13 of them failed from this.

It's also frustrating timing because we are just now working on a new
release (2.3).

I've done some testing on lucene.zones.apache.org:

  * This issue is repeatable just using the "svn" command-line
    client.  When I run:

        svn checkout https://svn.apache.org/repos/asf/lucene/java/trunk/ lucene.trunk

    Then after running for ~18 minutes I get this failure:

        A    lucene.trunk/contrib/benchmark/lib/commons-logging-1.0.4.jar
        svn: REPORT request failed on '/repos/asf/!svn/vcc/default'
        svn: REPORT of '/repos/asf/!svn/vcc/default': Compressed response was truncated (https://svn.apache.org)

    This is svn version 1.4.3.

  * Then I ran the same command under truss, and it failed with the
    same error, though at a different point in the checkout:

        lstat64("lucene.trunk3/contrib/memory/src/java/org/apache/lucene/index/memory/SynonymMap.java", 0x08047134) Err#2 ENOENT
        open("lucene.trunk3/contrib/memory/src/java/org/apache/lucene/index/memory/.svn/text-base/SynonymMap.java.svn-base", O_RDONLY|O_LARGEFILE) Err#2 ENOENT
        open("lucene.trunk3/contrib/memory/src/java/org/apache/lucene/index/memory/.svn/tmp/text-base/SynonymMap.java.svn-base", O_WRONLY|O_CREAT|O_TRUNC|O_EXCL|O_LARGEFILE, 0666) = 6
        pollsys(0x08047410, 1, 0x08047488, 0x00000000)  = 1
        read(4, "170301\018", 5)                        = 5
        read(4, "FFA2 ; > V86A4 cA1 x  A5".., 24)       = 24
        pollsys(0x08047420, 1, 0x08047498, 0x00000000)  = 1
        read(4, "170301\0  ", 5)                        = 5
        read(4, " T06 t8FFE - t97CE !9C1F".., 32)       = 32
        pollsys(0x08047420, 1, 0x080474A0, 0x00000000)  = 1
        read(4, "1703011FB8", 5)                        = 5
        read(4, "9D11 > G U w b\f829BCBE3".., 8120)     = 7730
        read(4, 0x080C92EF, 390)                        = 0  <--- this is bad!

    I think the error was on that final read: svn client wanted to
    read 8120 bytes, and got 7730 on the first read, and so tried to
    read the remaining 390 on the next read but that next read
    returned 0.  The svn client then prints that error, cleans up, and
    calls exit(1).

  * If I cd to /tmp (= swap) and run the same command, it finishes
    very quickly without error.  It seems like this error might have
    something to do with how long our checkout takes.

  * The box seems to have exceptionally slow IO; maybe if we fix that,
    it would at least [temporarily] mask this problem and let us get
    our builds going again?

  * Thinking maybe the apache server on svn.apache.org could be
    severing our connection if it stays connected too long (we are
    desperate here), I ran "telnet svn.apache.org 80" and then let it
    wait.  But, it remains connected now (more than 1.5 hrs later) so
    I don't think that theory is right.

Still digging....


> Intermittent SVN checkout errors during Lucene nightly build
> ------------------------------------------------------------
>
>                 Key: INFRA-1460
>                 URL: https://issues.apache.org/jira/browse/INFRA-1460
>             Project: Infrastructure
>          Issue Type: Bug
>      Security Level: public(Regular issues) 
>          Components: Subversion
>            Reporter: Michael McCandless
>            Priority: Minor
>
> We've been seeing the Lucene nightly build fail occasionally from
> exceptions during SVN checkout.
> In the past it was somewhat rare (maybe 1 in 15 builds) but suddenly
> in the past few days it seems to be happening much more frequently.
> The exceptions are rather "varied".  My only guess is some sort of low
> level network communication issue (especially the SSL error below)?
> Maybe there are corresponding errors in the svn server logs?  Maybe
> other projects are seeing similar exceptions?
> When our nightly build hits this, the build aborts and it's marked as
> failed.
> Here's the first example:
> ERROR: Failed to check out https://svn.apache.org/repos/asf/lucene/java/trunk
> org.tmatesoft.svn.core.SVNException: svn: REPORT request failed on '/repos/asf/!svn/vcc/default'
> svn: SSL peer shut down incorrectly
> 	at org.tmatesoft.svn.core.internal.wc.SVNErrorManager.error(SVNErrorManager.java:80)
> 	at org.tmatesoft.svn.core.internal.io.dav.http.HTTPConnection.request(HTTPConnection.java:517)
> 	at org.tmatesoft.svn.core.internal.io.dav.http.HTTPConnection.request(HTTPConnection.java:234)
> 	at org.tmatesoft.svn.core.internal.io.dav.http.HTTPConnection.request(HTTPConnection.java:222)
> 	at org.tmatesoft.svn.core.internal.io.dav.DAVConnection.doReport(DAVConnection.java:219)
> 	at org.tmatesoft.svn.core.internal.io.dav.DAVConnection.doReport(DAVConnection.java:211)
> 	at org.tmatesoft.svn.core.internal.io.dav.DAVRepository.update(DAVRepository.java:609)
> 	at org.tmatesoft.svn.core.wc.SVNUpdateClient.doUpdate(SVNUpdateClient.java:162)
> 	at org.tmatesoft.svn.core.wc.SVNUpdateClient.doCheckout(SVNUpdateClient.java:325)
> 	at hudson.scm.SubversionSCM$CheckOutTask.invoke(SubversionSCM.java:397)
> 	at hudson.scm.SubversionSCM$CheckOutTask.invoke(SubversionSCM.java:349)
> 	at hudson.FilePath.act(FilePath.java:291)
> 	at hudson.scm.SubversionSCM.checkout(SubversionSCM.java:346)
> 	at hudson.scm.SubversionSCM.checkout(SubversionSCM.java:292)
> 	at hudson.model.AbstractProject.checkout(AbstractProject.java:541)
> 	at hudson.model.AbstractBuild$AbstractRunner.checkout(AbstractBuild.java:223)
> 	at hudson.model.AbstractBuild$AbstractRunner.run(AbstractBuild.java:189)
> 	at hudson.model.Run.run(Run.java:649)
> 	at hudson.model.Build.run(Build.java:102)
> 	at hudson.model.ResourceController.execute(ResourceController.java:70)
> 	at hudson.model.Executor.run(Executor.java:64)
> 2nd example:
> ERROR: Failed to check out http://svn.apache.org/repos/asf/lucene/java/trunk
> org.tmatesoft.svn.core.SVNException: svn: REPORT request failed on '/repos/asf/!svn/vcc/default'
> svn: CRLF expected at end of chunk: 151/115
> 	at org.tmatesoft.svn.core.internal.wc.SVNErrorManager.error(SVNErrorManager.java:80)
> 	at org.tmatesoft.svn.core.internal.io.dav.http.HTTPConnection.request(HTTPConnection.java:517)
> 	at org.tmatesoft.svn.core.internal.io.dav.http.HTTPConnection.request(HTTPConnection.java:234)
> 	at org.tmatesoft.svn.core.internal.io.dav.http.HTTPConnection.request(HTTPConnection.java:222)
> 	at org.tmatesoft.svn.core.internal.io.dav.DAVConnection.doReport(DAVConnection.java:219)
> 	at org.tmatesoft.svn.core.internal.io.dav.DAVConnection.doReport(DAVConnection.java:211)
> 	at org.tmatesoft.svn.core.internal.io.dav.DAVRepository.update(DAVRepository.java:609)
> 	at org.tmatesoft.svn.core.wc.SVNUpdateClient.doUpdate(SVNUpdateClient.java:162)
> 	at org.tmatesoft.svn.core.wc.SVNUpdateClient.doCheckout(SVNUpdateClient.java:325)
> 	at hudson.scm.SubversionSCM$CheckOutTask.invoke(SubversionSCM.java:397)
> 	at hudson.scm.SubversionSCM$CheckOutTask.invoke(SubversionSCM.java:349)
> 	at hudson.FilePath.act(FilePath.java:291)
> 	at hudson.scm.SubversionSCM.checkout(SubversionSCM.java:346)
> 	at hudson.scm.SubversionSCM.checkout(SubversionSCM.java:292)
> 	at hudson.model.AbstractProject.checkout(AbstractProject.java:541)
> 	at hudson.model.AbstractBuild$AbstractRunner.checkout(AbstractBuild.java:223)
> 	at hudson.model.AbstractBuild$AbstractRunner.run(AbstractBuild.java:189)
> 	at hudson.model.Run.run(Run.java:649)
> 	at hudson.model.Build.run(Build.java:102)
> 	at hudson.model.ResourceController.execute(ResourceController.java:70)
> 	at hudson.model.Executor.run(Executor.java:64)
> 3rd example:
> FATAL: Java heap space
> java.lang.OutOfMemoryError: Java heap space
> 	at org.tmatesoft.svn.core.internal.delta.SVNDeltaReader.deflate(SVNDeltaReader.java:163)
> 	at org.tmatesoft.svn.core.internal.delta.SVNDeltaReader.nextWindow(SVNDeltaReader.java:127)
> 	at org.tmatesoft.svn.core.internal.io.dav.handlers.BasicDAVDeltaHandler.characters(BasicDAVDeltaHandler.java:96)
> 	at com.sun.org.apache.xerces.internal.parsers.AbstractSAXParser.characters(AbstractSAXParser.java:538)
> 	at com.sun.org.apache.xerces.internal.impl.XMLDocumentFragmentScannerImpl.scanDocument(XMLDocumentFragmentScannerImpl.java:461)
> 	at com.sun.org.apache.xerces.internal.parsers.XML11Configuration.parse(XML11Configuration.java:807)
> 	at com.sun.org.apache.xerces.internal.parsers.XML11Configuration.parse(XML11Configuration.java:737)
> 	at com.sun.org.apache.xerces.internal.parsers.XMLParser.parse(XMLParser.java:107)
> 	at com.sun.org.apache.xerces.internal.parsers.AbstractSAXParser.parse(AbstractSAXParser.java:1205)
> 	at com.sun.org.apache.xerces.internal.jaxp.SAXParserImpl$JAXPSAXParser.parse(SAXParserImpl.java:522)
> 	at org.tmatesoft.svn.core.internal.io.dav.http.HTTPConnection.readData(HTTPConnection.java:646)
> 	at org.tmatesoft.svn.core.internal.io.dav.http.HTTPConnection.readData(HTTPConnection.java:611)
> 	at org.tmatesoft.svn.core.internal.io.dav.http.HTTPRequest.dispatch(HTTPRequest.java:196)
> 	at org.tmatesoft.svn.core.internal.io.dav.http.HTTPConnection.request(HTTPConnection.java:289)
> 	at org.tmatesoft.svn.core.internal.io.dav.http.HTTPConnection.request(HTTPConnection.java:234)
> 	at org.tmatesoft.svn.core.internal.io.dav.http.HTTPConnection.request(HTTPConnection.java:222)
> 	at org.tmatesoft.svn.core.internal.io.dav.DAVConnection.doReport(DAVConnection.java:219)
> 	at org.tmatesoft.svn.core.internal.io.dav.DAVConnection.doReport(DAVConnection.java:211)
> 	at org.tmatesoft.svn.core.internal.io.dav.DAVRepository.update(DAVRepository.java:609)
> 	at org.tmatesoft.svn.core.wc.SVNUpdateClient.doUpdate(SVNUpdateClient.java:162)
> 	at org.tmatesoft.svn.core.wc.SVNUpdateClient.doCheckout(SVNUpdateClient.java:325)
> 	at hudson.scm.SubversionSCM$CheckOutTask.invoke(SubversionSCM.java:397)
> 	at hudson.scm.SubversionSCM$CheckOutTask.invoke(SubversionSCM.java:349)
> 	at hudson.FilePath.act(FilePath.java:291)
> 	at hudson.scm.SubversionSCM.checkout(SubversionSCM.java:346)
> 	at hudson.scm.SubversionSCM.checkout(SubversionSCM.java:292)
> 	at hudson.model.AbstractProject.checkout(AbstractProject.java:541)
> 	at hudson.model.AbstractBuild$AbstractRunner.checkout(AbstractBuild.java:223)
> 	at hudson.model.AbstractBuild$AbstractRunner.run(AbstractBuild.java:189)
> 	at hudson.model.Run.run(Run.java:649)
> 	at hudson.model.Build.run(Build.java:102)
> 	at hudson.model.ResourceController.execute(ResourceController.java:70)
> 4th example:
> ERROR: Failed to check out http://svn.apache.org/repos/asf/lucene/java/trunk
> org.tmatesoft.svn.core.SVNException: svn: REPORT request failed on '/repos/asf/!svn/vcc/default'
> svn: Processing REPORT request response failed: The element type "S:txdelta" must be terminated by the matching end-tag "</S:txdelta>". (/repos/asf/!svn/vcc/default) 
> 	at org.tmatesoft.svn.core.internal.wc.SVNErrorManager.error(SVNErrorManager.java:80)
> 	at org.tmatesoft.svn.core.internal.io.dav.http.HTTPConnection.request(HTTPConnection.java:517)
> 	at org.tmatesoft.svn.core.internal.io.dav.http.HTTPConnection.request(HTTPConnection.java:234)
> 	at org.tmatesoft.svn.core.internal.io.dav.http.HTTPConnection.request(HTTPConnection.java:222)
> 	at org.tmatesoft.svn.core.internal.io.dav.DAVConnection.doReport(DAVConnection.java:219)
> 	at org.tmatesoft.svn.core.internal.io.dav.DAVConnection.doReport(DAVConnection.java:211)
> 	at org.tmatesoft.svn.core.internal.io.dav.DAVRepository.update(DAVRepository.java:609)
> 	at org.tmatesoft.svn.core.wc.SVNUpdateClient.doUpdate(SVNUpdateClient.java:162)
> 	at org.tmatesoft.svn.core.wc.SVNUpdateClient.doCheckout(SVNUpdateClient.java:325)
> 	at hudson.scm.SubversionSCM$CheckOutTask.invoke(SubversionSCM.java:397)
> 	at hudson.scm.SubversionSCM$CheckOutTask.invoke(SubversionSCM.java:349)
> 	at hudson.FilePath.act(FilePath.java:291)
> 	at hudson.scm.SubversionSCM.checkout(SubversionSCM.java:346)
> 	at hudson.scm.SubversionSCM.checkout(SubversionSCM.java:292)
> 	at hudson.model.AbstractProject.checkout(AbstractProject.java:541)
> 	at hudson.model.AbstractBuild$AbstractRunner.checkout(AbstractBuild.java:223)
> 	at hudson.model.AbstractBuild$AbstractRunner.run(AbstractBuild.java:189)
> 	at hudson.model.Run.run(Run.java:649)
> 	at hudson.model.Build.run(Build.java:102)
> 	at hudson.model.ResourceController.execute(ResourceController.java:70)
> 	at hudson.model.Executor.run(Executor.java:64)

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.