You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by Policeman Jenkins Server <je...@thetaphi.de> on 2013/03/12 16:00:53 UTC

[JENKINS] Lucene-Solr-trunk-MacOSX (64bit/jdk1.7.0) - Build # 313 - Failure!

Build: http://jenkins.thetaphi.de/job/Lucene-Solr-trunk-MacOSX/313/
Java: 64bit/jdk1.7.0 -XX:+UseParallelGC

All tests passed

Build Log:
[...truncated 26442 lines...]
  [javadoc] Generating Javadoc
  [javadoc] Javadoc execution
  [javadoc] Loading source files for package org.apache.lucene...
  [javadoc] Loading source files for package org.apache.lucene.analysis...
  [javadoc] warning: [options] bootstrap class path not set in conjunction with -source 1.6
  [javadoc] Loading source files for package org.apache.lucene.analysis.tokenattributes...
  [javadoc] Loading source files for package org.apache.lucene.codecs...
  [javadoc] Loading source files for package org.apache.lucene.codecs.compressing...
  [javadoc] Loading source files for package org.apache.lucene.codecs.lucene40...
  [javadoc] Loading source files for package org.apache.lucene.codecs.lucene41...
  [javadoc] Loading source files for package org.apache.lucene.codecs.lucene42...
  [javadoc] Loading source files for package org.apache.lucene.codecs.perfield...
  [javadoc] Loading source files for package org.apache.lucene.document...
  [javadoc] Loading source files for package org.apache.lucene.index...
  [javadoc] Loading source files for package org.apache.lucene.search...
  [javadoc] Loading source files for package org.apache.lucene.search.payloads...
  [javadoc] Loading source files for package org.apache.lucene.search.similarities...
  [javadoc] Loading source files for package org.apache.lucene.search.spans...
  [javadoc] Loading source files for package org.apache.lucene.store...
  [javadoc] Loading source files for package org.apache.lucene.util...
  [javadoc] Loading source files for package org.apache.lucene.util.automaton...
  [javadoc] Loading source files for package org.apache.lucene.util.fst...
  [javadoc] Loading source files for package org.apache.lucene.util.mutable...
  [javadoc] Loading source files for package org.apache.lucene.util.packed...
  [javadoc] Constructing Javadoc information...
  [javadoc] Standard Doclet version 1.7.0_15
  [javadoc] Building tree for all the packages and classes...
  [javadoc] Generating /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/lucene/build/docs/core/org/apache/lucene/search/package-summary.html...
  [javadoc] Copying file /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/lucene/core/src/java/org/apache/lucene/search/doc-files/nrq-formula-1.png to directory /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/lucene/build/docs/core/org/apache/lucene/search/doc-files...
  [javadoc] Copying file /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/lucene/core/src/java/org/apache/lucene/search/doc-files/nrq-formula-2.png to directory /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/lucene/build/docs/core/org/apache/lucene/search/doc-files...
  [javadoc] Building index for all the packages and classes...
  [javadoc] Building index for all classes...
  [javadoc] Generating /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/lucene/build/docs/core/help-doc.html...
  [javadoc] 1 warning

[...truncated 33 lines...]
  [javadoc] Generating Javadoc
  [javadoc] Javadoc execution
  [javadoc] warning: [options] bootstrap class path not set in conjunction with -source 1.6
  [javadoc] Loading source files for package org.apache.lucene.analysis.ar...
  [javadoc] Loading source files for package org.apache.lucene.analysis.bg...
  [javadoc] Loading source files for package org.apache.lucene.analysis.br...
  [javadoc] Loading source files for package org.apache.lucene.analysis.ca...
  [javadoc] Loading source files for package org.apache.lucene.analysis.charfilter...
  [javadoc] Loading source files for package org.apache.lucene.analysis.cjk...
  [javadoc] Loading source files for package org.apache.lucene.analysis.commongrams...
  [javadoc] Loading source files for package org.apache.lucene.analysis.compound...
  [javadoc] Loading source files for package org.apache.lucene.analysis.compound.hyphenation...
  [javadoc] Loading source files for package org.apache.lucene.analysis.core...
  [javadoc] Loading source files for package org.apache.lucene.analysis.cz...
  [javadoc] Loading source files for package org.apache.lucene.analysis.da...
  [javadoc] Loading source files for package org.apache.lucene.analysis.de...
  [javadoc] Loading source files for package org.apache.lucene.analysis.el...
  [javadoc] Loading source files for package org.apache.lucene.analysis.en...
  [javadoc] Loading source files for package org.apache.lucene.analysis.es...
  [javadoc] Loading source files for package org.apache.lucene.analysis.eu...
  [javadoc] Loading source files for package org.apache.lucene.analysis.fa...
  [javadoc] Loading source files for package org.apache.lucene.analysis.fi...
  [javadoc] Loading source files for package org.apache.lucene.analysis.fr...
  [javadoc] Loading source files for package org.apache.lucene.analysis.ga...
  [javadoc] Loading source files for package org.apache.lucene.analysis.gl...
  [javadoc] Loading source files for package org.apache.lucene.analysis.hi...
  [javadoc] Loading source files for package org.apache.lucene.analysis.hu...
  [javadoc] Loading source files for package org.apache.lucene.analysis.hunspell...
  [javadoc] Loading source files for package org.apache.lucene.analysis.hy...
  [javadoc] Loading source files for package org.apache.lucene.analysis.id...
  [javadoc] Loading source files for package org.apache.lucene.analysis.in...
  [javadoc] Loading source files for package org.apache.lucene.analysis.it...
  [javadoc] Loading source files for package org.apache.lucene.analysis.lv...
  [javadoc] Loading source files for package org.apache.lucene.analysis.miscellaneous...
  [javadoc] Loading source files for package org.apache.lucene.analysis.ngram...
  [javadoc] Loading source files for package org.apache.lucene.analysis.nl...
  [javadoc] Loading source files for package org.apache.lucene.analysis.no...
  [javadoc] Loading source files for package org.apache.lucene.analysis.path...
  [javadoc] Loading source files for package org.apache.lucene.analysis.pattern...
  [javadoc] Loading source files for package org.apache.lucene.analysis.payloads...
  [javadoc] Loading source files for package org.apache.lucene.analysis.position...
  [javadoc] Loading source files for package org.apache.lucene.analysis.pt...
  [javadoc] Loading source files for package org.apache.lucene.analysis.query...
  [javadoc] Loading source files for package org.apache.lucene.analysis.reverse...
  [javadoc] Loading source files for package org.apache.lucene.analysis.ro...
  [javadoc] Loading source files for package org.apache.lucene.analysis.ru...
  [javadoc] Loading source files for package org.apache.lucene.analysis.shingle...
  [javadoc] Loading source files for package org.apache.lucene.analysis.sinks...
  [javadoc] Loading source files for package org.apache.lucene.analysis.snowball...
  [javadoc] Loading source files for package org.apache.lucene.analysis.standard...
  [javadoc] Loading source files for package org.apache.lucene.analysis.sv...
  [javadoc] Loading source files for package org.apache.lucene.analysis.synonym...
  [javadoc] Loading source files for package org.apache.lucene.analysis.th...
  [javadoc] Loading source files for package org.apache.lucene.analysis.tr...
  [javadoc] Loading source files for package org.apache.lucene.analysis.util...
  [javadoc] Loading source files for package org.apache.lucene.analysis.wikipedia...
  [javadoc] Loading source files for package org.apache.lucene.collation...
  [javadoc] Loading source files for package org.apache.lucene.collation.tokenattributes...
  [javadoc] Loading source files for package org.tartarus.snowball...
  [javadoc] Loading source files for package org.tartarus.snowball.ext...
  [javadoc] Constructing Javadoc information...
  [javadoc] Standard Doclet version 1.7.0_15
  [javadoc] Building tree for all the packages and classes...
  [javadoc] Building index for all the packages and classes...
  [javadoc] Building index for all classes...
  [javadoc] Generating /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/lucene/build/docs/analyzers-common/help-doc.html...
  [javadoc] 1 warning

[...truncated 28 lines...]
  [javadoc] Generating Javadoc
  [javadoc] Javadoc execution
  [javadoc] warning: [options] bootstrap class path not set in conjunction with -source 1.6
  [javadoc] Loading source files for package org.apache.lucene.analysis.icu...
  [javadoc] Loading source files for package org.apache.lucene.analysis.icu.segmentation...
  [javadoc] Loading source files for package org.apache.lucene.analysis.icu.tokenattributes...
  [javadoc] Loading source files for package org.apache.lucene.collation...
  [javadoc] Loading source files for package org.apache.lucene.collation.tokenattributes...
  [javadoc] Constructing Javadoc information...
  [javadoc] Standard Doclet version 1.7.0_15
  [javadoc] Building tree for all the packages and classes...
  [javadoc] Building index for all the packages and classes...
  [javadoc] Building index for all classes...
  [javadoc] Generating /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/lucene/build/docs/analyzers-icu/help-doc.html...
  [javadoc] Note: Custom tags that were not seen:  @lucene.internal
  [javadoc] 1 warning

[...truncated 27 lines...]
  [javadoc] Generating Javadoc
  [javadoc] Javadoc execution
  [javadoc] warning: [options] bootstrap class path not set in conjunction with -source 1.6
  [javadoc] Loading source files for package org.apache.lucene.analysis.ja...
  [javadoc] Loading source files for package org.apache.lucene.analysis.ja.dict...
  [javadoc] Loading source files for package org.apache.lucene.analysis.ja.tokenattributes...
  [javadoc] Loading source files for package org.apache.lucene.analysis.ja.util...
  [javadoc] Constructing Javadoc information...
  [javadoc] Standard Doclet version 1.7.0_15
  [javadoc] Building tree for all the packages and classes...
  [javadoc] Building index for all the packages and classes...
  [javadoc] Building index for all classes...
  [javadoc] Generating /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/lucene/build/docs/analyzers-kuromoji/help-doc.html...
  [javadoc] Note: Custom tags that were not seen:  @lucene.internal
  [javadoc] 1 warning

[...truncated 27 lines...]
  [javadoc] Generating Javadoc
  [javadoc] Javadoc execution
  [javadoc] warning: [options] bootstrap class path not set in conjunction with -source 1.6
  [javadoc] Loading source files for package org.apache.lucene.analysis.morfologik...
  [javadoc] Constructing Javadoc information...
  [javadoc] Standard Doclet version 1.7.0_15
  [javadoc] Building tree for all the packages and classes...
  [javadoc] Building index for all the packages and classes...
  [javadoc] Building index for all classes...
  [javadoc] Generating /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/lucene/build/docs/analyzers-morfologik/help-doc.html...
  [javadoc] Note: Custom tags that were not seen:  @lucene.internal, @lucene.experimental
  [javadoc] 1 warning

[...truncated 27 lines...]
  [javadoc] Generating Javadoc
  [javadoc] Javadoc execution
  [javadoc] Loading source files for package org.apache.lucene.analysis.phonetic...
  [javadoc] warning: [options] bootstrap class path not set in conjunction with -source 1.6
  [javadoc] Constructing Javadoc information...
  [javadoc] Standard Doclet version 1.7.0_15
  [javadoc] Building tree for all the packages and classes...
  [javadoc] Building index for all the packages and classes...
  [javadoc] Building index for all classes...
  [javadoc] Generating /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/lucene/build/docs/analyzers-phonetic/help-doc.html...
  [javadoc] Note: Custom tags that were not seen:  @lucene.internal
  [javadoc] 1 warning

[...truncated 27 lines...]
  [javadoc] Generating Javadoc
  [javadoc] Javadoc execution
  [javadoc] warning: [options] bootstrap class path not set in conjunction with -source 1.6
  [javadoc] Loading source files for package org.apache.lucene.analysis.cn.smart...
  [javadoc] Loading source files for package org.apache.lucene.analysis.cn.smart.hhmm...
  [javadoc] Constructing Javadoc information...
  [javadoc] Standard Doclet version 1.7.0_15
  [javadoc] Building tree for all the packages and classes...
  [javadoc] Building index for all the packages and classes...
  [javadoc] Building index for all classes...
  [javadoc] Generating /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/lucene/build/docs/analyzers-smartcn/help-doc.html...
  [javadoc] Note: Custom tags that were not seen:  @lucene.internal
  [javadoc] 1 warning

[...truncated 27 lines...]
  [javadoc] Generating Javadoc
  [javadoc] Javadoc execution
  [javadoc] warning: [options] bootstrap class path not set in conjunction with -source 1.6
  [javadoc] Loading source files for package org.apache.lucene.analysis.pl...
  [javadoc] Loading source files for package org.apache.lucene.analysis.stempel...
  [javadoc] Loading source files for package org.egothor.stemmer...
  [javadoc] Constructing Javadoc information...
  [javadoc] Standard Doclet version 1.7.0_15
  [javadoc] Building tree for all the packages and classes...
  [javadoc] Building index for all the packages and classes...
  [javadoc] Building index for all classes...
  [javadoc] Generating /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/lucene/build/docs/analyzers-stempel/help-doc.html...
  [javadoc] Note: Custom tags that were not seen:  @lucene.internal, @lucene.experimental
  [javadoc] 1 warning

[...truncated 27 lines...]
  [javadoc] Generating Javadoc
  [javadoc] Javadoc execution
  [javadoc] Loading source files for package org.apache.lucene.analysis.uima...
  [javadoc] warning: [options] bootstrap class path not set in conjunction with -source 1.6
  [javadoc] Loading source files for package org.apache.lucene.analysis.uima.ae...
  [javadoc] Constructing Javadoc information...
  [javadoc] Standard Doclet version 1.7.0_15
  [javadoc] Building tree for all the packages and classes...
  [javadoc] Building index for all the packages and classes...
  [javadoc] Building index for all classes...
  [javadoc] Generating /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/lucene/build/docs/analyzers-uima/help-doc.html...
  [javadoc] Note: Custom tags that were not seen:  @lucene.internal, @lucene.experimental
  [javadoc] 1 warning

[...truncated 30 lines...]
  [javadoc] Generating Javadoc
  [javadoc] Javadoc execution
  [javadoc] Loading source files for package org.apache.lucene.index.memory...
  [javadoc] warning: [options] bootstrap class path not set in conjunction with -source 1.6
  [javadoc] Constructing Javadoc information...
  [javadoc] Standard Doclet version 1.7.0_15
  [javadoc] Building tree for all the packages and classes...
  [javadoc] Building index for all the packages and classes...
  [javadoc] Building index for all classes...
  [javadoc] Generating /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/lucene/build/docs/memory/help-doc.html...
  [javadoc] Note: Custom tags that were not seen:  @lucene.internal, @lucene.experimental
  [javadoc] 1 warning

[...truncated 29 lines...]
  [javadoc] Generating Javadoc
  [javadoc] Javadoc execution
  [javadoc] warning: [options] bootstrap class path not set in conjunction with -source 1.6
  [javadoc] Loading source files for package org.apache.lucene.search.highlight...
  [javadoc] Loading source files for package org.apache.lucene.search.postingshighlight...
  [javadoc] Loading source files for package org.apache.lucene.search.vectorhighlight...
  [javadoc] Constructing Javadoc information...
  [javadoc] Standard Doclet version 1.7.0_15
  [javadoc] Building tree for all the packages and classes...
  [javadoc] Building index for all the packages and classes...
  [javadoc] Building index for all classes...
  [javadoc] Generating /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/lucene/build/docs/highlighter/help-doc.html...
  [javadoc] 1 warning

[...truncated 31 lines...]
  [javadoc] Generating Javadoc
  [javadoc] Javadoc execution
  [javadoc] warning: [options] bootstrap class path not set in conjunction with -source 1.6
  [javadoc] Loading source files for package org.apache.lucene.queries...
  [javadoc] Loading source files for package org.apache.lucene.queries.function...
  [javadoc] Loading source files for package org.apache.lucene.queries.function.docvalues...
  [javadoc] Loading source files for package org.apache.lucene.queries.function.valuesource...
  [javadoc] Loading source files for package org.apache.lucene.queries.mlt...
  [javadoc] Constructing Javadoc information...
  [javadoc] Standard Doclet version 1.7.0_15
  [javadoc] Building tree for all the packages and classes...
  [javadoc] Building index for all the packages and classes...
  [javadoc] Building index for all classes...
  [javadoc] Generating /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/lucene/build/docs/queries/help-doc.html...
  [javadoc] 1 warning

[...truncated 26 lines...]
  [javadoc] Generating Javadoc
  [javadoc] Javadoc execution
  [javadoc] warning: [options] bootstrap class path not set in conjunction with -source 1.6
  [javadoc] Loading source files for package org.apache.lucene.sandbox.queries...
  [javadoc] Loading source files for package org.apache.lucene.sandbox.queries.regex...
  [javadoc] Constructing Javadoc information...
  [javadoc] Standard Doclet version 1.7.0_15
  [javadoc] Building tree for all the packages and classes...
  [javadoc] Building index for all the packages and classes...
  [javadoc] Building index for all classes...
  [javadoc] Generating /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/lucene/build/docs/sandbox/help-doc.html...
  [javadoc] Note: Custom tags that were not seen:  @lucene.internal, @lucene.experimental
  [javadoc] 1 warning

[...truncated 26 lines...]
  [javadoc] Generating Javadoc
  [javadoc] Javadoc execution
  [javadoc] warning: [options] bootstrap class path not set in conjunction with -source 1.6
  [javadoc] Loading source files for package org.apache.lucene.queryparser.analyzing...
  [javadoc] Loading source files for package org.apache.lucene.queryparser.classic...
  [javadoc] Loading source files for package org.apache.lucene.queryparser.complexPhrase...
  [javadoc] Loading source files for package org.apache.lucene.queryparser.ext...
  [javadoc] Loading source files for package org.apache.lucene.queryparser.flexible.core...
  [javadoc] Loading source files for package org.apache.lucene.queryparser.flexible.core.builders...
  [javadoc] Loading source files for package org.apache.lucene.queryparser.flexible.core.config...
  [javadoc] Loading source files for package org.apache.lucene.queryparser.flexible.core.messages...
  [javadoc] Loading source files for package org.apache.lucene.queryparser.flexible.core.nodes...
  [javadoc] Loading source files for package org.apache.lucene.queryparser.flexible.core.parser...
  [javadoc] Loading source files for package org.apache.lucene.queryparser.flexible.core.processors...
  [javadoc] Loading source files for package org.apache.lucene.queryparser.flexible.core.util...
  [javadoc] Loading source files for package org.apache.lucene.queryparser.flexible.messages...
  [javadoc] Loading source files for package org.apache.lucene.queryparser.flexible.precedence...
  [javadoc] Loading source files for package org.apache.lucene.queryparser.flexible.precedence.processors...
  [javadoc] Loading source files for package org.apache.lucene.queryparser.flexible.standard...
  [javadoc] Loading source files for package org.apache.lucene.queryparser.flexible.standard.builders...
  [javadoc] Loading source files for package org.apache.lucene.queryparser.flexible.standard.config...
  [javadoc] Loading source files for package org.apache.lucene.queryparser.flexible.standard.nodes...
  [javadoc] Loading source files for package org.apache.lucene.queryparser.flexible.standard.parser...
  [javadoc] Loading source files for package org.apache.lucene.queryparser.flexible.standard.processors...
  [javadoc] Loading source files for package org.apache.lucene.queryparser.surround.parser...
  [javadoc] Loading source files for package org.apache.lucene.queryparser.surround.query...
  [javadoc] Loading source files for package org.apache.lucene.queryparser.xml...
  [javadoc] Loading source files for package org.apache.lucene.queryparser.xml.builders...
  [javadoc] Constructing Javadoc information...
  [javadoc] Standard Doclet version 1.7.0_15
  [javadoc] Building tree for all the packages and classes...
  [javadoc] Building index for all the packages and classes...
  [javadoc] Building index for all classes...
  [javadoc] Generating /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/lucene/build/docs/queryparser/help-doc.html...
  [javadoc] Note: Custom tags that were not seen:  @lucene.internal, @lucene.experimental
  [javadoc] 1 warning

[...truncated 26 lines...]
  [javadoc] Generating Javadoc
  [javadoc] Javadoc execution
  [javadoc] warning: [options] bootstrap class path not set in conjunction with -source 1.6
  [javadoc] Loading source files for package org.apache.lucene.facet...
  [javadoc] Loading source files for package org.apache.lucene.facet.associations...
  [javadoc] Loading source files for package org.apache.lucene.facet.codecs.facet42...
  [javadoc] Loading source files for package org.apache.lucene.facet.collections...
  [javadoc] Loading source files for package org.apache.lucene.facet.complements...
  [javadoc] Loading source files for package org.apache.lucene.facet.encoding...
  [javadoc] Loading source files for package org.apache.lucene.facet.index...
  [javadoc] Loading source files for package org.apache.lucene.facet.params...
  [javadoc] Loading source files for package org.apache.lucene.facet.partitions...
  [javadoc] Loading source files for package org.apache.lucene.facet.sampling...
  [javadoc] Loading source files for package org.apache.lucene.facet.search...
  [javadoc] Loading source files for package org.apache.lucene.facet.taxonomy...
  [javadoc] Loading source files for package org.apache.lucene.facet.taxonomy.directory...
  [javadoc] Loading source files for package org.apache.lucene.facet.taxonomy.writercache...
  [javadoc] Loading source files for package org.apache.lucene.facet.taxonomy.writercache.cl2o...
  [javadoc] Loading source files for package org.apache.lucene.facet.taxonomy.writercache.lru...
  [javadoc] Loading source files for package org.apache.lucene.facet.util...
  [javadoc] Constructing Javadoc information...
  [javadoc] Standard Doclet version 1.7.0_15
  [javadoc] Building tree for all the packages and classes...
  [javadoc] Generating /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/lucene/build/docs/facet/org/apache/lucene/facet/package-summary.html...
  [javadoc] Copying file /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/lucene/facet/src/java/org/apache/lucene/facet/doc-files/prettify.css to directory /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/lucene/build/docs/facet/org/apache/lucene/facet/doc-files...
  [javadoc] Copying file /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/lucene/facet/src/java/org/apache/lucene/facet/doc-files/prettify.js to directory /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/lucene/build/docs/facet/org/apache/lucene/facet/doc-files...
  [javadoc] Copying file /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/lucene/facet/src/java/org/apache/lucene/facet/doc-files/userguide.html to directory /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/lucene/build/docs/facet/org/apache/lucene/facet/doc-files...
  [javadoc] Building index for all the packages and classes...
  [javadoc] Building index for all classes...
  [javadoc] Generating /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/lucene/build/docs/facet/help-doc.html...
  [javadoc] 1 warning

[...truncated 40 lines...]
  [javadoc] Generating Javadoc
  [javadoc] Javadoc execution
  [javadoc] Loading source files for package org.apache.lucene.benchmark...
  [javadoc] warning: [options] bootstrap class path not set in conjunction with -source 1.6
  [javadoc] Loading source files for package org.apache.lucene.benchmark.byTask...
  [javadoc] Loading source files for package org.apache.lucene.benchmark.byTask.feeds...
  [javadoc] Loading source files for package org.apache.lucene.benchmark.byTask.programmatic...
  [javadoc] Loading source files for package org.apache.lucene.benchmark.byTask.stats...
  [javadoc] Loading source files for package org.apache.lucene.benchmark.byTask.tasks...
  [javadoc] Loading source files for package org.apache.lucene.benchmark.byTask.utils...
  [javadoc] Loading source files for package org.apache.lucene.benchmark.quality...
  [javadoc] Loading source files for package org.apache.lucene.benchmark.quality.trec...
  [javadoc] Loading source files for package org.apache.lucene.benchmark.quality.utils...
  [javadoc] Loading source files for package org.apache.lucene.benchmark.utils...
  [javadoc] Constructing Javadoc information...
  [javadoc] Standard Doclet version 1.7.0_15
  [javadoc] Building tree for all the packages and classes...
  [javadoc] Building index for all the packages and classes...
  [javadoc] Building index for all classes...
  [javadoc] Generating /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/lucene/build/docs/benchmark/help-doc.html...
  [javadoc] Note: Custom tags that were not seen:  @lucene.internal
  [javadoc] 1 warning

[...truncated 29 lines...]
  [javadoc] Generating Javadoc
  [javadoc] Javadoc execution
  [javadoc] Loading source files for package org.apache.lucene.classification...
  [javadoc] warning: [options] bootstrap class path not set in conjunction with -source 1.6
  [javadoc] Loading source files for package org.apache.lucene.classification.utils...
  [javadoc] Constructing Javadoc information...
  [javadoc] Standard Doclet version 1.7.0_15
  [javadoc] Building tree for all the packages and classes...
  [javadoc] Building index for all the packages and classes...
  [javadoc] Building index for all classes...
  [javadoc] Generating /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/lucene/build/docs/classification/help-doc.html...
  [javadoc] Note: Custom tags that were not seen:  @lucene.internal
  [javadoc] 1 warning

[...truncated 24 lines...]
  [javadoc] Generating Javadoc
  [javadoc] Javadoc execution
  [javadoc] warning: [options] bootstrap class path not set in conjunction with -source 1.6
  [javadoc] Loading source files for package org.apache.lucene.codecs.blockterms...
  [javadoc] Loading source files for package org.apache.lucene.codecs.bloom...
  [javadoc] Loading source files for package org.apache.lucene.codecs.diskdv...
  [javadoc] Loading source files for package org.apache.lucene.codecs.intblock...
  [javadoc] Loading source files for package org.apache.lucene.codecs.memory...
  [javadoc] Loading source files for package org.apache.lucene.codecs.pulsing...
  [javadoc] Loading source files for package org.apache.lucene.codecs.sep...
  [javadoc] Loading source files for package org.apache.lucene.codecs.simpletext...
  [javadoc] Constructing Javadoc information...
  [javadoc] Standard Doclet version 1.7.0_15
  [javadoc] Building tree for all the packages and classes...
  [javadoc] Building index for all the packages and classes...
  [javadoc] Building index for all classes...
  [javadoc] Generating /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/lucene/build/docs/codecs/help-doc.html...
  [javadoc] 1 warning

[...truncated 38 lines...]
  [javadoc] Generating Javadoc
  [javadoc] Javadoc execution
  [javadoc] Loading source files for package org.apache.lucene.demo...
  [javadoc] warning: [options] bootstrap class path not set in conjunction with -source 1.6
  [javadoc] Loading source files for package org.apache.lucene.demo.facet...
  [javadoc] Loading source files for package org.apache.lucene.demo.xmlparser...
  [javadoc] Constructing Javadoc information...
  [javadoc] Standard Doclet version 1.7.0_15
  [javadoc] Building tree for all the packages and classes...
  [javadoc] Building index for all the packages and classes...
  [javadoc] Building index for all classes...
  [javadoc] Generating /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/lucene/build/docs/demo/help-doc.html...
  [javadoc] Note: Custom tags that were not seen:  @lucene.internal
  [javadoc] 1 warning

[...truncated 23 lines...]
  [javadoc] Generating Javadoc
  [javadoc] Javadoc execution
  [javadoc] warning: [options] bootstrap class path not set in conjunction with -source 1.6
  [javadoc] Loading source files for package org.apache.lucene.facet...
  [javadoc] Loading source files for package org.apache.lucene.facet.associations...
  [javadoc] Loading source files for package org.apache.lucene.facet.codecs.facet42...
  [javadoc] Loading source files for package org.apache.lucene.facet.collections...
  [javadoc] Loading source files for package org.apache.lucene.facet.complements...
  [javadoc] Loading source files for package org.apache.lucene.facet.encoding...
  [javadoc] Loading source files for package org.apache.lucene.facet.index...
  [javadoc] Loading source files for package org.apache.lucene.facet.params...
  [javadoc] Loading source files for package org.apache.lucene.facet.partitions...
  [javadoc] Loading source files for package org.apache.lucene.facet.sampling...
  [javadoc] Loading source files for package org.apache.lucene.facet.search...
  [javadoc] Loading source files for package org.apache.lucene.facet.taxonomy...
  [javadoc] Loading source files for package org.apache.lucene.facet.taxonomy.directory...
  [javadoc] Loading source files for package org.apache.lucene.facet.taxonomy.writercache...
  [javadoc] Loading source files for package org.apache.lucene.facet.taxonomy.writercache.cl2o...
  [javadoc] Loading source files for package org.apache.lucene.facet.taxonomy.writercache.lru...
  [javadoc] Loading source files for package org.apache.lucene.facet.util...
  [javadoc] Constructing Javadoc information...
  [javadoc] Standard Doclet version 1.7.0_15
  [javadoc] Building tree for all the packages and classes...
  [javadoc] Generating /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/lucene/build/docs/facet/org/apache/lucene/facet/package-summary.html...
  [javadoc] Copying file /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/lucene/facet/src/java/org/apache/lucene/facet/doc-files/prettify.css to directory /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/lucene/build/docs/facet/org/apache/lucene/facet/doc-files...
  [javadoc] Copying file /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/lucene/facet/src/java/org/apache/lucene/facet/doc-files/prettify.js to directory /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/lucene/build/docs/facet/org/apache/lucene/facet/doc-files...
  [javadoc] Copying file /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/lucene/facet/src/java/org/apache/lucene/facet/doc-files/userguide.html to directory /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/lucene/build/docs/facet/org/apache/lucene/facet/doc-files...
  [javadoc] Building index for all the packages and classes...
  [javadoc] Building index for all classes...
  [javadoc] Generating /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/lucene/build/docs/facet/help-doc.html...
  [javadoc] 1 warning

[...truncated 27 lines...]
  [javadoc] Generating Javadoc
  [javadoc] Javadoc execution
  [javadoc] warning: [options] bootstrap class path not set in conjunction with -source 1.6
  [javadoc] Loading source files for package org.apache.lucene.search.grouping...
  [javadoc] Loading source files for package org.apache.lucene.search.grouping.function...
  [javadoc] Loading source files for package org.apache.lucene.search.grouping.term...
  [javadoc] Constructing Javadoc information...
  [javadoc] Standard Doclet version 1.7.0_15
  [javadoc] Building tree for all the packages and classes...
  [javadoc] Building index for all the packages and classes...
  [javadoc] Building index for all classes...
  [javadoc] Generating /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/lucene/build/docs/grouping/help-doc.html...
  [javadoc] 1 warning

[...truncated 26 lines...]
  [javadoc] Generating Javadoc
  [javadoc] Javadoc execution
  [javadoc] warning: [options] bootstrap class path not set in conjunction with -source 1.6
  [javadoc] Loading source files for package org.apache.lucene.search.highlight...
  [javadoc] Loading source files for package org.apache.lucene.search.postingshighlight...
  [javadoc] Loading source files for package org.apache.lucene.search.vectorhighlight...
  [javadoc] Constructing Javadoc information...
  [javadoc] Standard Doclet version 1.7.0_15
  [javadoc] Building tree for all the packages and classes...
  [javadoc] Building index for all the packages and classes...
  [javadoc] Building index for all classes...
  [javadoc] Generating /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/lucene/build/docs/highlighter/help-doc.html...
  [javadoc] 1 warning

[...truncated 27 lines...]
  [javadoc] Generating Javadoc
  [javadoc] Javadoc execution
  [javadoc] warning: [options] bootstrap class path not set in conjunction with -source 1.6
  [javadoc] Loading source files for package org.apache.lucene.search.join...
  [javadoc] Constructing Javadoc information...
  [javadoc] Standard Doclet version 1.7.0_15
  [javadoc] Building tree for all the packages and classes...
  [javadoc] Building index for all the packages and classes...
  [javadoc] Building index for all classes...
  [javadoc] Generating /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/lucene/build/docs/join/help-doc.html...
  [javadoc] Note: Custom tags that were not seen:  @lucene.internal
  [javadoc] 1 warning

[...truncated 26 lines...]
  [javadoc] Generating Javadoc
  [javadoc] Javadoc execution
  [javadoc] warning: [options] bootstrap class path not set in conjunction with -source 1.6
  [javadoc] Loading source files for package org.apache.lucene.index.memory...
  [javadoc] Constructing Javadoc information...
  [javadoc] Standard Doclet version 1.7.0_15
  [javadoc] Building tree for all the packages and classes...
  [javadoc] Building index for all the packages and classes...
  [javadoc] Building index for all classes...
  [javadoc] Generating /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/lucene/build/docs/memory/help-doc.html...
  [javadoc] Note: Custom tags that were not seen:  @lucene.internal, @lucene.experimental
  [javadoc] 1 warning

[...truncated 24 lines...]
  [javadoc] Generating Javadoc
  [javadoc] Javadoc execution
  [javadoc] Loading source files for package org.apache.lucene.document...
  [javadoc] warning: [options] bootstrap class path not set in conjunction with -source 1.6
  [javadoc] Loading source files for package org.apache.lucene.index...
  [javadoc] Loading source files for package org.apache.lucene.index.sorter...
  [javadoc] Loading source files for package org.apache.lucene.misc...
  [javadoc] Loading source files for package org.apache.lucene.store...
  [javadoc] Loading source files for package org.apache.lucene.util.fst...
  [javadoc] Constructing Javadoc information...
  [javadoc] Standard Doclet version 1.7.0_15
  [javadoc] Building tree for all the packages and classes...
  [javadoc] Generating /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/lucene/build/docs/misc/org/apache/lucene/misc/package-summary.html...
  [javadoc] Copying file /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/lucene/misc/src/java/org/apache/lucene/misc/doc-files/ss.baselineTf.svg to directory /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/lucene/build/docs/misc/org/apache/lucene/misc/doc-files...
  [javadoc] Copying file /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/lucene/misc/src/java/org/apache/lucene/misc/doc-files/ss.computeLengthNorm.svg to directory /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/lucene/build/docs/misc/org/apache/lucene/misc/doc-files...
  [javadoc] Copying file /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/lucene/misc/src/java/org/apache/lucene/misc/doc-files/ss.gnuplot to directory /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/lucene/build/docs/misc/org/apache/lucene/misc/doc-files...
  [javadoc] Copying file /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/lucene/misc/src/java/org/apache/lucene/misc/doc-files/ss.hyperbolicTf.svg to directory /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/lucene/build/docs/misc/org/apache/lucene/misc/doc-files...
  [javadoc] Building index for all the packages and classes...
  [javadoc] Building index for all classes...
  [javadoc] Generating /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/lucene/build/docs/misc/help-doc.html...
  [javadoc] Note: Custom tags that were not seen:  @lucene.internal
  [javadoc] 1 warning

[...truncated 23 lines...]
  [javadoc] Generating Javadoc
  [javadoc] Javadoc execution
  [javadoc] Loading source files for package org.apache.lucene.queries...
  [javadoc] warning: [options] bootstrap class path not set in conjunction with -source 1.6
  [javadoc] Loading source files for package org.apache.lucene.queries.function...
  [javadoc] Loading source files for package org.apache.lucene.queries.function.docvalues...
  [javadoc] Loading source files for package org.apache.lucene.queries.function.valuesource...
  [javadoc] Loading source files for package org.apache.lucene.queries.mlt...
  [javadoc] Constructing Javadoc information...
  [javadoc] Standard Doclet version 1.7.0_15
  [javadoc] Building tree for all the packages and classes...
  [javadoc] Building index for all the packages and classes...
  [javadoc] Building index for all classes...
  [javadoc] Generating /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/lucene/build/docs/queries/help-doc.html...
  [javadoc] 1 warning

[...truncated 30 lines...]
  [javadoc] Generating Javadoc
  [javadoc] Javadoc execution
  [javadoc] warning: [options] bootstrap class path not set in conjunction with -source 1.6
  [javadoc] Loading source files for package org.apache.lucene.queryparser.analyzing...
  [javadoc] Loading source files for package org.apache.lucene.queryparser.classic...
  [javadoc] Loading source files for package org.apache.lucene.queryparser.complexPhrase...
  [javadoc] Loading source files for package org.apache.lucene.queryparser.ext...
  [javadoc] Loading source files for package org.apache.lucene.queryparser.flexible.core...
  [javadoc] Loading source files for package org.apache.lucene.queryparser.flexible.core.builders...
  [javadoc] Loading source files for package org.apache.lucene.queryparser.flexible.core.config...
  [javadoc] Loading source files for package org.apache.lucene.queryparser.flexible.core.messages...
  [javadoc] Loading source files for package org.apache.lucene.queryparser.flexible.core.nodes...
  [javadoc] Loading source files for package org.apache.lucene.queryparser.flexible.core.parser...
  [javadoc] Loading source files for package org.apache.lucene.queryparser.flexible.core.processors...
  [javadoc] Loading source files for package org.apache.lucene.queryparser.flexible.core.util...
  [javadoc] Loading source files for package org.apache.lucene.queryparser.flexible.messages...
  [javadoc] Loading source files for package org.apache.lucene.queryparser.flexible.precedence...
  [javadoc] Loading source files for package org.apache.lucene.queryparser.flexible.precedence.processors...
  [javadoc] Loading source files for package org.apache.lucene.queryparser.flexible.standard...
  [javadoc] Loading source files for package org.apache.lucene.queryparser.flexible.standard.builders...
  [javadoc] Loading source files for package org.apache.lucene.queryparser.flexible.standard.config...
  [javadoc] Loading source files for package org.apache.lucene.queryparser.flexible.standard.nodes...
  [javadoc] Loading source files for package org.apache.lucene.queryparser.flexible.standard.parser...
  [javadoc] Loading source files for package org.apache.lucene.queryparser.flexible.standard.processors...
  [javadoc] Loading source files for package org.apache.lucene.queryparser.surround.parser...
  [javadoc] Loading source files for package org.apache.lucene.queryparser.surround.query...
  [javadoc] Loading source files for package org.apache.lucene.queryparser.xml...
  [javadoc] Loading source files for package org.apache.lucene.queryparser.xml.builders...
  [javadoc] Constructing Javadoc information...
  [javadoc] Standard Doclet version 1.7.0_15
  [javadoc] Building tree for all the packages and classes...
  [javadoc] Building index for all the packages and classes...
  [javadoc] Building index for all classes...
  [javadoc] Generating /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/lucene/build/docs/queryparser/help-doc.html...
  [javadoc] Note: Custom tags that were not seen:  @lucene.internal, @lucene.experimental
  [javadoc] 1 warning

[...truncated 23 lines...]
  [javadoc] Generating Javadoc
  [javadoc] Javadoc execution
  [javadoc] warning: [options] bootstrap class path not set in conjunction with -source 1.6
  [javadoc] Loading source files for package org.apache.lucene.sandbox.queries...
  [javadoc] Loading source files for package org.apache.lucene.sandbox.queries.regex...
  [javadoc] Constructing Javadoc information...
  [javadoc] Standard Doclet version 1.7.0_15
  [javadoc] Building tree for all the packages and classes...
  [javadoc] Building index for all the packages and classes...
  [javadoc] Building index for all classes...
  [javadoc] Generating /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/lucene/build/docs/sandbox/help-doc.html...
  [javadoc] Note: Custom tags that were not seen:  @lucene.internal, @lucene.experimental
  [javadoc] 1 warning

[...truncated 27 lines...]
  [javadoc] Generating Javadoc
  [javadoc] Javadoc execution
  [javadoc] warning: [options] bootstrap class path not set in conjunction with -source 1.6
  [javadoc] Loading source files for package org.apache.lucene.spatial...
  [javadoc] Loading source files for package org.apache.lucene.spatial.bbox...
  [javadoc] Loading source files for package org.apache.lucene.spatial.prefix...
  [javadoc] Loading source files for package org.apache.lucene.spatial.prefix.tree...
  [javadoc] Loading source files for package org.apache.lucene.spatial.query...
  [javadoc] Loading source files for package org.apache.lucene.spatial.util...
  [javadoc] Loading source files for package org.apache.lucene.spatial.vector...
  [javadoc] Constructing Javadoc information...
  [javadoc] Standard Doclet version 1.7.0_15
  [javadoc] Building tree for all the packages and classes...
  [javadoc] Building index for all the packages and classes...
  [javadoc] Building index for all classes...
  [javadoc] Generating /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/lucene/build/docs/spatial/help-doc.html...
  [javadoc] 1 warning

[...truncated 24 lines...]
  [javadoc] Generating Javadoc
  [javadoc] Javadoc execution
  [javadoc] warning: [options] bootstrap class path not set in conjunction with -source 1.6
  [javadoc] Loading source files for package org.apache.lucene.search.spell...
  [javadoc] Loading source files for package org.apache.lucene.search.suggest...
  [javadoc] Loading source files for package org.apache.lucene.search.suggest.analyzing...
  [javadoc] Loading source files for package org.apache.lucene.search.suggest.fst...
  [javadoc] Loading source files for package org.apache.lucene.search.suggest.jaspell...
  [javadoc] Loading source files for package org.apache.lucene.search.suggest.tst...
  [javadoc] Constructing Javadoc information...
  [javadoc] Standard Doclet version 1.7.0_15
  [javadoc] Building tree for all the packages and classes...
  [javadoc] Building index for all the packages and classes...
  [javadoc] Building index for all classes...
  [javadoc] Generating /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/lucene/build/docs/suggest/help-doc.html...
  [javadoc] 1 warning

[...truncated 17 lines...]
  [javadoc] Generating Javadoc
  [javadoc] Javadoc execution
  [javadoc] warning: [options] bootstrap class path not set in conjunction with -source 1.6
  [javadoc] Loading source files for package org.apache.lucene.analysis...
  [javadoc] Loading source files for package org.apache.lucene.codecs.asserting...
  [javadoc] Loading source files for package org.apache.lucene.codecs.bloom...
  [javadoc] Loading source files for package org.apache.lucene.codecs.cheapbastard...
  [javadoc] Loading source files for package org.apache.lucene.codecs.compressing...
  [javadoc] Loading source files for package org.apache.lucene.codecs.compressing.dummy...
  [javadoc] Loading source files for package org.apache.lucene.codecs.lucene40...
  [javadoc] Loading source files for package org.apache.lucene.codecs.lucene41...
  [javadoc] Loading source files for package org.apache.lucene.codecs.lucene41ords...
  [javadoc] Loading source files for package org.apache.lucene.codecs.mockintblock...
  [javadoc] Loading source files for package org.apache.lucene.codecs.mockrandom...
  [javadoc] Loading source files for package org.apache.lucene.codecs.mocksep...
  [javadoc] Loading source files for package org.apache.lucene.codecs.nestedpulsing...
  [javadoc] Loading source files for package org.apache.lucene.codecs.ramonly...
  [javadoc] Loading source files for package org.apache.lucene.index...
  [javadoc] Loading source files for package org.apache.lucene.search...
  [javadoc] Loading source files for package org.apache.lucene.store...
  [javadoc] Loading source files for package org.apache.lucene.util...
  [javadoc] Loading source files for package org.apache.lucene.util.automaton...
  [javadoc] Loading source files for package org.apache.lucene.util.fst...
  [javadoc] Constructing Javadoc information...
  [javadoc] Standard Doclet version 1.7.0_15
  [javadoc] Building tree for all the packages and classes...
  [javadoc] Building index for all the packages and classes...
  [javadoc] Building index for all classes...
  [javadoc] Generating /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/lucene/build/docs/test-framework/help-doc.html...
  [javadoc] 1 warning

[...truncated 7 lines...]
BUILD FAILED
/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/build.xml:381: The following error occurred while executing this line:
/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/build.xml:60: The following error occurred while executing this line:
/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/lucene/build.xml:244: The following error occurred while executing this line:
/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/lucene/build.xml:552: The following error occurred while executing this line:
/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/lucene/common-build.xml:2040: java.net.SocketException: Connection reset
	at java.net.SocketInputStream.read(SocketInputStream.java:189)
	at java.net.SocketInputStream.read(SocketInputStream.java:121)
	at sun.security.ssl.InputRecord.readFully(InputRecord.java:442)
	at sun.security.ssl.InputRecord.read(InputRecord.java:480)
	at sun.security.ssl.SSLSocketImpl.readRecord(SSLSocketImpl.java:927)
	at sun.security.ssl.SSLSocketImpl.performInitialHandshake(SSLSocketImpl.java:1312)
	at sun.security.ssl.SSLSocketImpl.startHandshake(SSLSocketImpl.java:1339)
	at sun.security.ssl.SSLSocketImpl.startHandshake(SSLSocketImpl.java:1323)
	at sun.net.www.protocol.https.HttpsClient.afterConnect(HttpsClient.java:515)
	at sun.net.www.protocol.https.AbstractDelegateHttpsURLConnection.connect(AbstractDelegateHttpsURLConnection.java:185)
	at sun.net.www.protocol.https.HttpsURLConnectionImpl.connect(HttpsURLConnectionImpl.java:153)
	at org.apache.tools.ant.taskdefs.Get$GetThread.openConnection(Get.java:660)
	at org.apache.tools.ant.taskdefs.Get$GetThread.get(Get.java:579)
	at org.apache.tools.ant.taskdefs.Get$GetThread.run(Get.java:569)

Total time: 99 minutes 15 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Recording test results
Description set: Java: 64bit/jdk1.7.0 -XX:+UseParallelGC
Email was triggered for: Failure
Sending email for trigger: Failure



[JENKINS] Lucene-Solr-trunk-MacOSX (64bit/jdk1.7.0) - Build # 316 - Still Failing!

Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: http://jenkins.thetaphi.de/job/Lucene-Solr-trunk-MacOSX/316/
Java: 64bit/jdk1.7.0 -XX:+UseG1GC

1 tests failed.
REGRESSION:  org.apache.solr.core.OpenCloseCoreStressTest.test30SecondsOld

Error Message:
Core 00000_core bad! expected:<655> but was:<0>

Stack Trace:
java.lang.AssertionError: Core 00000_core bad! expected:<655> but was:<0>
	at __randomizedtesting.SeedInfo.seed([FEA00B1AD7221E86:D29181444BC233E5]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.junit.Assert.failNotEquals(Assert.java:647)
	at org.junit.Assert.assertEquals(Assert.java:128)
	at org.junit.Assert.assertEquals(Assert.java:472)
	at org.apache.solr.core.OpenCloseCoreStressTest.checkResults(OpenCloseCoreStressTest.java:304)
	at org.apache.solr.core.OpenCloseCoreStressTest.doStress(OpenCloseCoreStressTest.java:202)
	at org.apache.solr.core.OpenCloseCoreStressTest.test30SecondsOld(OpenCloseCoreStressTest.java:116)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:601)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
	at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at java.lang.Thread.run(Thread.java:722)




Build Log:
[...truncated 9198 lines...]
[junit4:junit4] Suite: org.apache.solr.core.OpenCloseCoreStressTest
[junit4:junit4] IGNOR/A 0.04s | OpenCloseCoreStressTest.test1HourNew
[junit4:junit4]    > Assumption #1: 'weekly' test group is disabled (@Weekly)
[junit4:junit4] IGNOR/A 0.02s | OpenCloseCoreStressTest.test1HourOld
[junit4:junit4]    > Assumption #1: 'weekly' test group is disabled (@Weekly)
[junit4:junit4]   2> 69 T4211 oas.SolrTestCaseJ4.setUp ###Starting test30SecondsNew
[junit4:junit4]   2> 183 T4211 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4]   2> 190 T4211 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:50562
[junit4:junit4]   2> 191 T4211 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4]   2> 191 T4211 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 192 T4211 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./OpenCloseCoreStressTest_
[junit4:junit4]   2> 193 T4211 oasc.CoreContainer$Initializer.initialize looking for solr config file: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./OpenCloseCoreStressTest_/solr.xml
[junit4:junit4]   2> 193 T4211 oasc.CoreContainer.<init> New CoreContainer 1887989620
[junit4:junit4]   2> 195 T4211 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./OpenCloseCoreStressTest_/'
[junit4:junit4]   2> 195 T4211 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./OpenCloseCoreStressTest_/'
[junit4:junit4]   2> 221 T4211 oasc.SolrProperties.walkFromHere Looking for cores in /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./OpenCloseCoreStressTest_
[junit4:junit4]   2> 222 T4211 oasc.SolrProperties.walkFromHere Discovered properties file /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./OpenCloseCoreStressTest_/00000_core/core.properties, adding to cores
[junit4:junit4]   2> 223 T4211 oasc.SolrProperties.walkFromHere Discovered properties file /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./OpenCloseCoreStressTest_/00001_core/core.properties, adding to cores
[junit4:junit4]   2> 224 T4211 oasc.SolrProperties.walkFromHere Discovered properties file /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./OpenCloseCoreStressTest_/00002_core/core.properties, adding to cores
[junit4:junit4]   2> 230 T4211 oasc.SolrProperties.walkFromHere Discovered properties file /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./OpenCloseCoreStressTest_/00003_core/core.properties, adding to cores
[junit4:junit4]   2> 233 T4211 oasc.SolrProperties.walkFromHere Discovered properties file /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./OpenCloseCoreStressTest_/00004_core/core.properties, adding to cores
[junit4:junit4]   2> 234 T4211 oasc.SolrProperties.walkFromHere Discovered properties file /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./OpenCloseCoreStressTest_/00005_core/core.properties, adding to cores
[junit4:junit4]   2> 234 T4211 oasc.SolrProperties.walkFromHere Discovered properties file /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./OpenCloseCoreStressTest_/00006_core/core.properties, adding to cores
[junit4:junit4]   2> 235 T4211 oasc.SolrProperties.walkFromHere Discovered properties file /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./OpenCloseCoreStressTest_/00007_core/core.properties, adding to cores
[junit4:junit4]   2> 236 T4211 oasc.SolrProperties.walkFromHere Discovered properties file /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./OpenCloseCoreStressTest_/00008_core/core.properties, adding to cores
[junit4:junit4]   2> 237 T4211 oasc.SolrProperties.walkFromHere Discovered properties file /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./OpenCloseCoreStressTest_/00009_core/core.properties, adding to cores
[junit4:junit4]   2> 238 T4211 oasc.SolrProperties.walkFromHere Discovered properties file /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./OpenCloseCoreStressTest_/00010_core/core.properties, adding to cores
[junit4:junit4]   2> 239 T4211 oasc.SolrProperties.walkFromHere Discovered properties file /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./OpenCloseCoreStressTest_/00011_core/core.properties, adding to cores
[junit4:junit4]   2> 239 T4211 oasc.SolrProperties.walkFromHere Discovered properties file /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./OpenCloseCoreStressTest_/00012_core/core.properties, adding to cores
[junit4:junit4]   2> 240 T4211 oasc.SolrProperties.walkFromHere Discovered properties file /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./OpenCloseCoreStressTest_/00013_core/core.properties, adding to cores
[junit4:junit4]   2> 241 T4211 oasc.SolrProperties.walkFromHere Discovered properties file /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./OpenCloseCoreStressTest_/00014_core/core.properties, adding to cores
[junit4:junit4]   2> 242 T4211 oasc.SolrProperties.walkFromHere Discovered properties file /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./OpenCloseCoreStressTest_/00015_core/core.properties, adding to cores
[junit4:junit4]   2> 243 T4211 oasc.SolrProperties.walkFromHere Discovered properties file /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./OpenCloseCoreStressTest_/00016_core/core.properties, adding to cores
[junit4:junit4]   2> 244 T4211 oasc.SolrProperties.walkFromHere Discovered properties file /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./OpenCloseCoreStressTest_/00017_core/core.properties, adding to cores
[junit4:junit4]   2> 245 T4211 oasc.SolrProperties.walkFromHere Discovered properties file /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./OpenCloseCoreStressTest_/00018_core/core.properties, adding to cores
[junit4:junit4]   2> 246 T4211 oasc.SolrProperties.walkFromHere Discovered properties file /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./OpenCloseCoreStressTest_/00019_core/core.properties, adding to cores
[junit4:junit4]   2> 248 T4211 oasc.SolrProperties.walkFromHere Looking for cores in /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./OpenCloseCoreStressTest_
[junit4:junit4]   2> 249 T4211 oasc.SolrProperties.walkFromHere Discovered properties file /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./OpenCloseCoreStressTest_/00000_core/core.properties, adding to cores
[junit4:junit4]   2> 250 T4211 oasc.SolrProperties.walkFromHere Discovered properties file /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./OpenCloseCoreStressTest_/00001_core/core.properties, adding to cores
[junit4:junit4]   2> 251 T4211 oasc.SolrProperties.walkFromHere Discovered properties file /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./OpenCloseCoreStressTest_/00002_core/core.properties, adding to cores
[junit4:junit4]   2> 251 T4211 oasc.SolrProperties.walkFromHere Discovered properties file /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./OpenCloseCoreStressTest_/00003_core/core.properties, adding to cores
[junit4:junit4]   2> 252 T4211 oasc.SolrProperties.walkFromHere Discovered properties file /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./OpenCloseCoreStressTest_/00004_core/core.properties, adding to cores
[junit4:junit4]   2> 253 T4211 oasc.SolrProperties.walkFromHere Discovered properties file /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./OpenCloseCoreStressTest_/00005_core/core.properties, adding to cores
[junit4:junit4]   2> 254 T4211 oasc.SolrProperties.walkFromHere Discovered properties file /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./OpenCloseCoreStressTest_/00006_core/core.properties, adding to cores
[junit4:junit4]   2> 255 T4211 oasc.SolrProperties.walkFromHere Discovered properties file /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./OpenCloseCoreStressTest_/00007_core/core.properties, adding to cores
[junit4:junit4]   2> 256 T4211 oasc.SolrProperties.walkFromHere Discovered properties file /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./OpenCloseCoreStressTest_/00008_core/core.properties, adding to cores
[junit4:junit4]   2> 256 T4211 oasc.SolrProperties.walkFromHere Discovered properties file /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./OpenCloseCoreStressTest_/00009_core/core.properties, adding to cores
[junit4:junit4]   2> 257 T4211 oasc.SolrProperties.walkFromHere Discovered properties file /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./OpenCloseCoreStressTest_/00010_core/core.properties, adding to cores
[junit4:junit4]   2> 258 T4211 oasc.SolrProperties.walkFromHere Discovered properties file /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./OpenCloseCoreStressTest_/00011_core/core.properties, adding to cores
[junit4:junit4]   2> 259 T4211 oasc.SolrProperties.walkFromHere Discovered properties file /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./OpenCloseCoreStressTest_/00012_core/core.properties, adding to cores
[junit4:junit4]   2> 260 T4211 oasc.SolrProperties.walkFromHere Discovered properties file /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./OpenCloseCoreStressTest_/00013_core/core.properties, adding to cores
[junit4:junit4]   2> 260 T4211 oasc.SolrProperties.walkFromHere Discovered properties file /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./OpenCloseCoreStressTest_/00014_core/core.properties, adding to cores
[junit4:junit4]   2> 261 T4211 oasc.SolrProperties.walkFromHere Discovered properties file /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./OpenCloseCoreStressTest_/00015_core/core.properties, adding to cores
[junit4:junit4]   2> 262 T4211 oasc.SolrProperties.walkFromHere Discovered properties file /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./OpenCloseCoreStressTest_/00016_core/core.properties, adding to cores
[junit4:junit4]   2> 263 T4211 oasc.SolrProperties.walkFromHere Discovered properties file /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./OpenCloseCoreStressTest_/00017_core/core.properties, adding to cores
[junit4:junit4]   2> 264 T4211 oasc.SolrProperties.walkFromHere Discovered properties file /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./OpenCloseCoreStressTest_/00018_core/core.properties, adding to cores
[junit4:junit4]   2> 265 T4211 oasc.SolrProperties.walkFromHere Discovered properties file /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./OpenCloseCoreStressTest_/00019_core/core.properties, adding to cores
[junit4:junit4]   2> 265 T4211 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 0
[junit4:junit4]   2> 266 T4211 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4]   2> 267 T4211 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 0
[junit4:junit4]   2> 267 T4211 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4]   2> 268 T4211 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4]   2> 269 T4211 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4]   2> 269 T4211 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4]   2> 270 T4211 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4]   2> 270 T4211 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4]   2> 271 T4211 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=0&connTimeout=0&retry=false
[junit4:junit4]   2> 278 T4211 oasc.CoreMaps.allocateLazyCores Allocating transient cache for 10 transient cores
[junit4:junit4]   2> 279 T4211 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4]   2> 285 T4211 oass.SolrDispatchFilter.init user.dir=/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0
[junit4:junit4]   2> 286 T4211 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4]   2> 286 T4211 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 297 T4211 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 305 T4211 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 311 T4211 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 317 T4211 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 322 T4211 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 336 T4211 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 341 T4211 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 347 T4211 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 353 T4211 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 359 T4211 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 365 T4211 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 372 T4211 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 378 T4211 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 383 T4211 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 389 T4211 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 395 T4211 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 402 T4211 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 408 T4211 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 414 T4211 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 419 T4211 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 436 T4211 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 440 T4211 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 447 T4211 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 454 T4211 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 460 T4211 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 466 T4211 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 472 T4211 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 478 T4211 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 484 T4211 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 490 T4211 oasc.OpenCloseCoreStressTest.doStress Starting indexing and querying
[junit4:junit4]   2> 491 T4211 oasc.OpenCloseCoreStressTest.doStress 
[junit4:junit4]   2> 	
[junit4:junit4]   2> 	
[junit4:junit4]   2> 	
[junit4:junit4]   2> 	
[junit4:junit4]   2> 	Starting a 30 second cycle, seconds left: 30. Seconds run so far: 0.
[junit4:junit4]   2> 495 T4222 oasc.OneIndexer.run Starting indexing thread: 4222
[junit4:junit4]   2> 498 T4223 oasc.OneIndexer.run Starting indexing thread: 4223
[junit4:junit4]   2> 501 T4224 oasc.OneIndexer.run Starting indexing thread: 4224
[junit4:junit4]   2> 503 T4215 oasc.CoreContainer.create Creating SolrCore '00008_core' using instanceDir: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./OpenCloseCoreStressTest_/00008_core
[junit4:junit4]   2> 504 T4215 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./OpenCloseCoreStressTest_/00008_core/'
[junit4:junit4]   2> 516 T4216 oasc.CoreContainer.create Creating SolrCore '00007_core' using instanceDir: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./OpenCloseCoreStressTest_/00007_core
[junit4:junit4]   2> 517 T4216 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./OpenCloseCoreStressTest_/00007_core/'
[junit4:junit4]   2> 527 T4225 oasc.OneIndexer.run Starting indexing thread: 4225
[junit4:junit4]   2> 536 T4236 oasc.OneIndexer.run Starting indexing thread: 4236
[junit4:junit4]   2> 535 T4235 oasc.OneIndexer.run Starting indexing thread: 4235
[junit4:junit4]   2> 534 T4234 oasc.OneIndexer.run Starting indexing thread: 4234
[junit4:junit4]   2> 534 T4233 oasc.OneIndexer.run Starting indexing thread: 4233
[junit4:junit4]   2> 532 T4232 oasc.OneIndexer.run Starting indexing thread: 4232
[junit4:junit4]   2> 531 T4231 oasc.OneIndexer.run Starting indexing thread: 4231
[junit4:junit4]   2> 530 T4230 oasc.OneIndexer.run Starting indexing thread: 4230
[junit4:junit4]   2> 529 T4229 oasc.OneIndexer.run Starting indexing thread: 4229
[junit4:junit4]   2> 529 T4228 oasc.OneIndexer.run Starting indexing thread: 4228
[junit4:junit4]   2> 528 T4227 oasc.OneIndexer.run Starting indexing thread: 4227
[junit4:junit4]   2> 528 T4226 oasc.OneIndexer.run Starting indexing thread: 4226
[junit4:junit4]   2> 550 T4217 oasc.CoreContainer.create Creating SolrCore '00015_core' using instanceDir: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./OpenCloseCoreStressTest_/00015_core
[junit4:junit4]   2> 584 T4217 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./OpenCloseCoreStressTest_/00015_core/'
[junit4:junit4]   2> 582 T4215 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_41
[junit4:junit4]   2> 604 T4238 oasc.OneQuery.run Starting query thread: 4238
[junit4:junit4]   2> 604 T4237 oasc.OneQuery.run Starting query thread: 4237
[junit4:junit4]   2> 631 T4247 oasc.OneQuery.run Starting query thread: 4247
[junit4:junit4]   2> 625 T4246 oasc.OneQuery.run Starting query thread: 4246
[junit4:junit4]   2> 624 T4245 oasc.OneQuery.run Starting query thread: 4245
[junit4:junit4]   2> 624 T4244 oasc.OneQuery.run Starting query thread: 4244
[junit4:junit4]   2> 623 T4243 oasc.OneQuery.run Starting query thread: 4243
[junit4:junit4]   2> 622 T4242 oasc.OneQuery.run Starting query thread: 4242
[junit4:junit4]   2> 610 T4216 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_41
[junit4:junit4]   2> 607 T4241 oasc.OneQuery.run Starting query thread: 4241
[junit4:junit4]   2> 606 T4240 oasc.OneQuery.run Starting query thread: 4240
[junit4:junit4]   2> 605 T4239 oasc.OneQuery.run Starting query thread: 4239
[junit4:junit4]   2> 691 T4251 oasc.OneQuery.run Starting query thread: 4251
[junit4:junit4]   2> 697 T4248 oasc.CoreContainer.create Creating SolrCore '00016_core' using instanceDir: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./OpenCloseCoreStressTest_/00016_core
[junit4:junit4]   2> 697 T4220 oasc.CoreContainer.create Creating SolrCore '00010_core' using instanceDir: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./OpenCloseCoreStressTest_/00010_core
[junit4:junit4]   2> 698 T4249 oasc.CoreContainer.create Creating SolrCore '00012_core' using instanceDir: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./OpenCloseCoreStressTest_/00012_core
[junit4:junit4]   2> 698 T4252 oasc.CoreContainer.create Creating SolrCore '00013_core' using instanceDir: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./OpenCloseCoreStressTest_/00013_core
[junit4:junit4]   2> 699 T4255 oasc.CoreContainer.create Creating SolrCore '00000_core' using instanceDir: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./OpenCloseCoreStressTest_/00000_core
[junit4:junit4]   2> 698 T4253 oasc.CoreContainer.create Creating SolrCore '00009_core' using instanceDir: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./OpenCloseCoreStressTest_/00009_core
[junit4:junit4]   2> 700 T4257 oasc.OneQuery.run Starting query thread: 4257
[junit4:junit4]   2> 701 T4253 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./OpenCloseCoreStressTest_/00009_core/'
[junit4:junit4]   2> 699 T4256 oasc.CoreContainer.create Creating SolrCore '00001_core' using instanceDir: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./OpenCloseCoreStressTest_/00001_core
[junit4:junit4]   2> 702 T4256 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./OpenCloseCoreStressTest_/00001_core/'
[junit4:junit4]   2> 703 T4220 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./OpenCloseCoreStressTest_/00010_core/'
[junit4:junit4]   2> 701 T4252 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./OpenCloseCoreStressTest_/00013_core/'
[junit4:junit4]   2> 711 T4255 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./OpenCloseCoreStressTest_/00000_core/'
[junit4:junit4]   2> 713 T4248 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./OpenCloseCoreStressTest_/00016_core/'
[junit4:junit4]   2> 714 T4249 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./OpenCloseCoreStressTest_/00012_core/'
[junit4:junit4]   2> 732 T4258 oasc.OneQuery.run Starting query thread: 4258
[junit4:junit4]   2> 748 T4259 oasc.OneQuery.run Starting query thread: 4259
[junit4:junit4]   2> 765 T4260 oasc.CoreContainer.create Creating SolrCore '00006_core' using instanceDir: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./OpenCloseCoreStressTest_/00006_core
[junit4:junit4]   2> 807 T4268 oasc.CoreContainer.create Creating SolrCore '00004_core' using instanceDir: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./OpenCloseCoreStressTest_/00004_core
[junit4:junit4]   2> 812 T4260 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./OpenCloseCoreStressTest_/00006_core/'
[junit4:junit4]   2> 807 T4265 oasc.CoreContainer.create Creating SolrCore '00003_core' using instanceDir: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./OpenCloseCoreStressTest_/00003_core
[junit4:junit4]   2> 817 T4265 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./OpenCloseCoreStressTest_/00003_core/'
[junit4:junit4]   2> 806 T4262 oasc.CoreContainer.create Creating SolrCore '00005_core' using instanceDir: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./OpenCloseCoreStressTest_/00005_core
[junit4:junit4]   2> 825 T4262 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./OpenCloseCoreStressTest_/00005_core/'
[junit4:junit4]   2> 806 T4264 oasc.CoreContainer.create Creating SolrCore '00011_core' using instanceDir: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./OpenCloseCoreStressTest_/00011_core
[junit4:junit4]   2> 830 T4264 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./OpenCloseCoreStressTest_/00011_core/'
[junit4:junit4]   2> 839 T4271 oasc.CoreContainer.create Creating SolrCore '00018_core' using instanceDir: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./OpenCloseCoreStressTest_/00018_core
[junit4:junit4]   2> 840 T4271 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./OpenCloseCoreStressTest_/00018_core/'
[junit4:junit4]   2> 788 T4217 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_41
[junit4:junit4]   2> 767 T4261 oasc.CoreContainer.create Creating SolrCore '00014_core' using instanceDir: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./OpenCloseCoreStressTest_/00014_core
[junit4:junit4]   2> 842 T4261 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./OpenCloseCoreStressTest_/00014_core/'
[junit4:junit4]   2> 812 T4268 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./OpenCloseCoreStressTest_/00004_core/'
[junit4:junit4]   2> 879 T4215 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig-minimal.xml
[junit4:junit4]   2> 880 T4215 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4]   2> 884 T4215 oass.IndexSchema.readSchema Schema name=tiny
[junit4:junit4]   2> 906 T4216 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig-minimal.xml
[junit4:junit4]   2> 907 T4216 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4]   2> 911 T4216 oass.IndexSchema.readSchema Schema name=tiny
[junit4:junit4]   2> 994 T4264 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_41
[junit4:junit4]   2> 1116 T4253 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_41
[junit4:junit4]   2> 1139 T4261 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_41
[junit4:junit4]   2> 1231 T4220 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_41
[junit4:junit4]   2> 1299 T4216 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> 1301 T4216 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockFSDirectoryFactory
[junit4:junit4]   2> 1302 T4216 oasc.SolrCore.<init> [00007_core] Opening new SolrCore at /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./OpenCloseCoreStressTest_/00007_core/, dataDir=/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/OpenCloseCoreStressTest_/00007_core/data/
[junit4:junit4]   2> 1302 T4216 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@298925ae
[junit4:junit4]   2> 1303 T4216 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockFSDirectoryFactory
[junit4:junit4]   2> 1304 T4216 oasc.CachingDirectoryFactory.get return new directory for /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/OpenCloseCoreStressTest_/00007_core/data forceNew: false
[junit4:junit4]   2> 1312 T4216 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/OpenCloseCoreStressTest_/00007_core/data/index/
[junit4:junit4]   2> 1313 T4216 oasc.SolrCore.initIndex WARNING [00007_core] Solr index directory '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/OpenCloseCoreStressTest_/00007_core/data/index' doesn't exist. Creating new index...
[junit4:junit4]   2> 1314 T4216 oasc.CachingDirectoryFactory.get return new directory for /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/OpenCloseCoreStressTest_/00007_core/data/index forceNew: false
[junit4:junit4]   2> 1314 T4217 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig-minimal.xml
[junit4:junit4]   2> 1316 T4217 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4]   2> 1316 T4260 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_41
[junit4:junit4]   2> 1325 T4248 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_41
[junit4:junit4]   2> 1371 T4249 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_41
[junit4:junit4]   2> 1371 T4255 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_41
[junit4:junit4]   2> 1380 T4271 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_41
[junit4:junit4]   2> 1402 T4216 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4]   2> 		commit{dir=MockDirWrapper(org.apache.lucene.store.SimpleFSDirectory@/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/OpenCloseCoreStressTest_/00007_core/data/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@53db4dea),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 1403 T4216 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4]   2> 1406 T4265 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_41
[junit4:junit4]   2> 1414 T4216 oasc.SolrCore.initWriters created json: solr.JSONResponseWriter
[junit4:junit4]   2> 1417 T4216 oasc.RequestHandlers.initHandlersFromConfig created /admin/: solr.admin.AdminHandlers
[junit4:junit4]   2> 1418 T4216 oasc.RequestHandlers.initHandlersFromConfig created /select: solr.SearchHandler
[junit4:junit4]   2> 1419 T4216 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4]   2> 1423 T4262 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_41
[junit4:junit4]   2> 1434 T4268 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_41
[junit4:junit4]   2> 1446 T4216 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4]   2> 1447 T4217 oass.IndexSchema.readSchema Schema name=tiny
[junit4:junit4]   2> 1478 T4216 oass.SolrIndexSearcher.<init> Opening Searcher@2e5d1e20 main
[junit4:junit4]   2> 1479 T4216 oasc.SolrCore.registerSearcher [00007_core] Registered new searcher Searcher@2e5d1e20 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   2> 1480 T4216 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4]   2> 1480 T4216 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4]   2> 1491 T4252 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_41
[junit4:junit4]   2> 1584 T4215 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> 1585 T4216 oasc.CoreMaps.putTransientCore Opening transient core 00007_core
[junit4:junit4]   2> 1585 T4216 oasc.CoreContainer.registerCore registering core: 00007_core
[junit4:junit4]   2> ASYNC  NEW_CORE C244 name=00007_core org.apache.solr.core.SolrCore@40d71fbe
[junit4:junit4]   2> 1594 T4269 C244 REQ [00007_core] webapp=/solr path=/select params={q=*:*&wt=javabin&qt=/select&version=2} hits=0 status=0 QTime=0 
[junit4:junit4]   2> 1601 T4254 C244 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4]   2> 		commit{dir=MockDirWrapper(org.apache.lucene.store.SimpleFSDirectory@/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/OpenCloseCoreStressTest_/00007_core/data/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@53db4dea),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 1602 T4254 C244 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4]   2> 1605 T4254 C244 UPDATE [00007_core] webapp=/solr path=/update params={wt=javabin&version=2} {add=[id15]} 0 11
[junit4:junit4]   2> 1615 T4256 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_41
[junit4:junit4]   2> 1619 T4215 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockFSDirectoryFactory
[junit4:junit4]   2> 1620 T4215 oasc.SolrCore.<init> [00008_core] Opening new SolrCore at /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./OpenCloseCoreStressTest_/00008_core/, dataDir=/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/OpenCloseCoreStressTest_/00008_core/data/
[junit4:junit4]   2> 1620 T4215 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@298925ae
[junit4:junit4]   2> 1621 T4215 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockFSDirectoryFactory
[junit4:junit4]   2> 1623 T4215 oasc.CachingDirectoryFactory.get return new directory for /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/OpenCloseCoreStressTest_/00008_core/data forceNew: false
[junit4:junit4]   2> 1624 T4215 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/OpenCloseCoreStressTest_/00008_core/data/index/
[junit4:junit4]   2> 1625 T4215 oasc.SolrCore.initIndex WARNING [00008_core] Solr index directory '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/OpenCloseCoreStressTest_/00008_core/data/index' doesn't exist. Creating new index...
[junit4:junit4]   2> 1626 T4215 oasc.CachingDirectoryFactory.get return new directory for /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/OpenCloseCoreStressTest_/00008_core/data/index forceNew: false
[junit4:junit4]   2> 1637 T4215 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4]   2> 		commit{dir=MockDirWrapper(org.apache.lucene.store.SimpleFSDirectory@/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/OpenCloseCoreStressTest_/00008_core/data/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@4d8524c9),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 1637 T4215 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4]   2> 1638 T4215 oasc.SolrCore.initWriters created json: solr.JSONResponseWriter
[junit4:junit4]   2> 1641 T4215 oasc.RequestHandlers.initHandlersFromConfig created /admin/: solr.admin.AdminHandlers
[junit4:junit4]   2> 1642 T4215 oasc.RequestHandlers.initHandlersFromConfig created /select: solr.SearchHandler
[junit4:junit4]   2> 1643 T4215 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4]   2> 1649 T4216 C244 UPDATE [00007_core] webapp=/solr path=/update params={wt=javabin&version=2} {add=[id2]} 0 16
[junit4:junit4]   2> 1710 T4278 oasc.CoreContainer.create Creating SolrCore '00002_core' using instanceDir: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./OpenCloseCoreStressTest_/00002_core
[junit4:junit4]   2> 1711 T4278 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./OpenCloseCoreStressTest_/00002_core/'
[junit4:junit4]   2> 1778 T4215 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4]   2> 1870 T4217 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> 1872 T4217 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockFSDirectoryFactory
[junit4:junit4]   2> 1873 T4217 oasc.SolrCore.<init> [00015_core] Opening new SolrCore at /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./OpenCloseCoreStressTest_/00015_core/, dataDir=/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/OpenCloseCoreStressTest_/00015_core/data/
[junit4:junit4]   2> 1873 T4217 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@298925ae
[junit4:junit4]   2> 1874 T4217 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockFSDirectoryFactory
[junit4:junit4]   2> 1877 T4217 oasc.CachingDirectoryFactory.get return new directory for /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/OpenCloseCoreStressTest_/00015_core/data forceNew: false
[junit4:junit4]   2> 1899 T4217 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/OpenCloseCoreStressTest_/00015_core/data/index/
[junit4:junit4]   2> 1900 T4217 oasc.SolrCore.initIndex WARNING [00015_core] Solr index directory '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/OpenCloseCoreStressTest_/00015_core/data/index' doesn't exist. Creating new index...
[junit4:junit4]   2> 1901 T4217 oasc.CachingDirectoryFactory.get return new directory for /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/OpenCloseCoreStressTest_/00015_core/data/index forceNew: false
[junit4:junit4]   2> 1955 T4217 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4]   2> 		commit{dir=MockDirWrapper(org.apache.lucene.store.SimpleFSDirectory@/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/OpenCloseCoreStressTest_/00015_core/data/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@42b01efc),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 1956 T4217 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4]   2> 1956 T4249 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig-minimal.xml
[junit4:junit4]   2> 1959 T4220 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig-minimal.xml
[junit4:junit4]   2> 1961 T4220 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4]   2> 1843 T4260 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig-minimal.xml
[junit4:junit4]   2> 1965 T4260 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4]   2> 1968 T4217 oasc.SolrCore.initWriters created json: solr.JSONResponseWriter
[junit4:junit4]   2> 1971 T4217 oasc.RequestHandlers.initHandlersFromConfig created /admin/: solr.admin.AdminHandlers
[junit4:junit4]   2> 1972 T4217 oasc.RequestHandlers.initHandlersFromConfig created /select: solr.SearchHandler
[junit4:junit4]   2> 1973 T4217 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4]   2> 1987 T4249 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4]   2> 1991 T4249 oass.IndexSchema.readSchema Schema name=tiny
[junit4:junit4]   2> 2002 T4255 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig-minimal.xml
[junit4:junit4]   2> 2005 T4255 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4]   2> 2009 T4255 oass.IndexSchema.readSchema Schema name=tiny
[junit4:junit4]   2> 2035 T4253 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig-minimal.xml
[junit4:junit4]   2> 2042 T4253 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4]   2> 2062 T4264 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig-minimal.xml
[junit4:junit4]   2> 2047 T4215 oass.SolrIndexSearcher.<init> Opening Searcher@870e3b3 main
[junit4:junit4]   2> 2068 T4264 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4]   2> 2069 T4215 oasc.SolrCore.registerSearcher [00008_core] Registered new searcher Searcher@870e3b3 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   2> 2070 T4215 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4]   2> 2070 T4215 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4]   2> 2075 T4215 oasc.CoreMaps.putTransientCore Opening transient core 00008_core
[junit4:junit4]   2> 2083 T4262 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig-minimal.xml
[junit4:junit4]   2> 2084 T4262 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4]   2> 2088 T4262 oass.IndexSchema.readSchema Schema name=tiny
[junit4:junit4]   2> 2091 T4215 oasc.CoreContainer.registerCore registering core: 00008_core
[junit4:junit4]   2> 2104 T4248 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig-minimal.xml
[junit4:junit4]   2> 2105 T4248 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4]   2> 2109 T4248 oass.IndexSchema.readSchema Schema name=tiny
[junit4:junit4]   2> 2124 T4217 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4]   2> 2126 T4268 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig-minimal.xml
[junit4:junit4]   2> 2127 T4268 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4]   2> 2130 T4264 oass.IndexSchema.readSchema Schema name=tiny
[junit4:junit4]   2> 2143 T4261 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig-minimal.xml
[junit4:junit4]   2> 2144 T4261 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4]   2> 2149 T4253 oass.IndexSchema.readSchema Schema name=tiny
[junit4:junit4]   2> 2151 T4278 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_41
[junit4:junit4]   2> 2167 T4265 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig-minimal.xml
[junit4:junit4]   2> 2171 T4255 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> 2173 T4255 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockFSDirectoryFactory
[junit4:junit4]   2> 2174 T4255 oasc.SolrCore.<init> [00000_core] Opening new SolrCore at /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./OpenCloseCoreStressTest_/00000_core/, dataDir=/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/OpenCloseCoreStressTest_/00000_core/data/
[junit4:junit4]   2> 2175 T4255 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@298925ae
[junit4:junit4]   2> 2180 T4255 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockFSDirectoryFactory
[junit4:junit4]   2> 2181 T4255 oasc.CachingDirectoryFactory.get return new directory for /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/OpenCloseCoreStressTest_/00000_core/data forceNew: false
[junit4:junit4]   2> 2176 T4260 oass.IndexSchema.readSchema Schema name=tiny
[junit4:junit4]   2> 2188 T4265 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4]   2> ASYNC  NEW_CORE C245 name=00008_core org.apache.solr.core.SolrCore@6cf15013
[junit4:junit4]   2> 2198 T4218 C245 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4]   2> 		commit{dir=MockDirWrapper(org.apache.lucene.store.SimpleFSDirectory@/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/OpenCloseCoreStressTest_/00008_core/data/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@4d8524c9),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 2200 T4218 C245 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4]   2> 2208 T4265 oass.IndexSchema.readSchema Schema name=tiny
[junit4:junit4]   2> 2223 T4217 oass.SolrIndexSearcher.<init> Opening Searcher@5a932bf7 main
[junit4:junit4]   2> 2226 T4218 C245 UPDATE [00008_core] webapp=/solr path=/update params={wt=javabin&version=2} {add=[id7]} 0 126
[junit4:junit4]   2> 2226 T4219 C245 UPDATE [00008_core] webapp=/solr path=/update params={wt=javabin&version=2} {add=[id4]} 0 126
[junit4:junit4]   2> 2227 T4215 C245 UPDATE [00008_core] webapp=/solr path=/update params={wt=javabin&version=2} {add=[id1]} 0 48
[junit4:junit4]   2> 2232 T4250 C245 UPDATE [00008_core] webapp=/solr path=/update params={wt=javabin&version=2} {add=[id13]} 0 131
[junit4:junit4]   2> 2246 T4220 oass.IndexSchema.readSchema Schema name=tiny
[junit4:junit4]   2> 2246 T4217 oasc.SolrCore.registerSearcher [00015_core] Registered new searcher Searcher@5a932bf7 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   2> 2260 T4217 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4]   2> 2261 T4217 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4]   2> 2268 T4256 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig-minimal.xml
[junit4:junit4]   2> 2273 T4255 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/OpenCloseCoreStressTest_/00000_core/data/index/
[junit4:junit4]   2> 2273 T4255 oasc.SolrCore.initIndex WARNING [00000_core] Solr index directory '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/OpenCloseCoreStressTest_/00000_core/data/index' doesn't exist. Creating new index...
[junit4:junit4]   2> 2274 T4255 oasc.CachingDirectoryFactory.get return new directory for /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/OpenCloseCoreStressTest_/00000_core/data/index forceNew: false
[junit4:junit4]   2> 2276 T4268 oass.IndexSchema.readSchema Schema name=tiny
[junit4:junit4]   2> 2279 T4256 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4]   2> 2283 T4250 oasc.CoreContainer.create Creating SolrCore '00019_core' using instanceDir: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./OpenCloseCoreStressTest_/00019_core
[junit4:junit4]   2> 2283 T4219 C244 UPDATE [00007_core] webapp=/solr path=/update params={wt=javabin&version=2} {add=[id19]} 0 0
[junit4:junit4]   2> 2284 T4250 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./OpenCloseCoreStressTest_/00019_core/'
[junit4:junit4]   2> 2287 T4217 oasc.CoreMaps.putTransientCore Opening transient core 00015_core
[junit4:junit4]   2> 2288 T4217 oasc.CoreContainer.registerCore registering core: 00015_core
[junit4:junit4]   2> 2292 T4252 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig-minimal.xml
[junit4:junit4]   2> 2292 T4252 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4]   2> 2306 T4253 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> 2308 T4253 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockFSDirectoryFactory
[junit4:junit4]   2> 2325 T4260 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> 2327 T4260 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockFSDirectoryFactory
[junit4:junit4]   2> 2327 T4260 oasc.SolrCore.<init> [00006_core] Opening new SolrCore at /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./OpenCloseCoreStressTest_/00006_core/, dataDir=/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/OpenCloseCoreStressTest_/00006_core/data/
[junit4:junit4]   2> 2328 T4260 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@298925ae
[junit4:junit4]   2> 2331 T4260 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockFSDirectoryFactory
[junit4:junit4]   2> 2333 T4260 oasc.CachingDirectoryFactory.get return new directory for /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/OpenCloseCoreStressTest_/00006_core/data forceNew: false
[junit4:junit4]   2> 2327 T4261 oass.IndexSchema.readSchema Schema name=tiny
[junit4:junit4]   2> 2330 T4271 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig-minimal.xml
[junit4:junit4]   2> 2334 T4271 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4]   2> 2339 T4271 oass.IndexSchema.readSchema Schema name=tiny
[junit4:junit4]   2> 2343 T4253 oasc.SolrCore.<init> [00009_core] Opening new SolrCore at /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./OpenCloseCoreStressTest_/00009_core/, dataDir=/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/OpenCloseCoreStressTest_/00009_core/data/
[junit4:junit4]   2> 2344 T4253 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@298925ae
[junit4:junit4]   2> 2352 T4262 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> 2354 T4262 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockFSDirectoryFactory
[junit4:junit4]   2> 2354 T4262 oasc.SolrCore.<init> [00005_core] Opening new SolrCore at /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./OpenCloseCoreStressTest_/00005_core/, dataDir=/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/OpenCloseCoreStressTest_/00005_core/data/
[junit4:junit4]   2> 2355 T4262 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@298925ae
[junit4:junit4]   2> 2356 T4262 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockFSDirectoryFactory
[junit4:junit4]   2> 2357 T4262 oasc.CachingDirectoryFactory.get return new directory for /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/OpenCloseCoreStressTest_/00005_core/data forceNew: false
[junit4:junit4]   2> 2377 T4249 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> 2379 T4249 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockFSDirectoryFactory
[junit4:junit4]   2> 2380 T4249 oasc.SolrCore.<init> [00012_core] Opening new SolrCore at /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./OpenCloseCoreStressTest_/00012_core/, dataDir=/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/OpenCloseCoreStressTest_/00012_core/data/
[junit4:junit4]   2> 2380 T4249 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@298925ae
[junit4:junit4]   2> 2381 T4249 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockFSDirectoryFactory
[junit4:junit4]   2> 2382 T4249 oasc.CachingDirectoryFactory.get return new directory for /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/OpenCloseCoreStressTest_/00012_core/data forceNew: false
[junit4:junit4]   2> 2385 T4220 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> 2386 T4262 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/OpenCloseCoreStressTest_/00005_core/data/index/
[junit4:junit4]   2> 2387 T4220 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockFSDirectoryFactory
[junit4:junit4]   2> 2387 T4262 oasc.SolrCore.initIndex WARNING [00005_core] Solr index directory '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/OpenCloseCoreStressTest_/00005_core/data/index' doesn't exist. Creating new index...
[junit4:junit4]   2> 2388 T4262 oasc.CachingDirectoryFactory.get return new directory for /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/OpenCloseCoreStressTest_/00005_core/data/index forceNew: false
[junit4:junit4]   2> 2391 T4264 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> 2393 T4264 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockFSDirectoryFactory
[junit4:junit4]   2> 2394 T4264 oasc.SolrCore.<init> [00011_core] Opening new SolrCore at /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./OpenCloseCoreStressTest_/00011_core/, dataDir=/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/OpenCloseCoreStressTest_/00011_core/data/
[junit4:junit4]   2> 2394 T4264 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@298925ae
[junit4:junit4]   2> 2395 T4264 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockFSDirectoryFactory
[junit4:junit4]   2> 2396 T4264 oasc.CachingDirectoryFactory.get return new directory for /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/OpenCloseCoreStressTest_/00011_core/data forceNew: false
[junit4:junit4]   2> 2345 T4253 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockFSDirectoryFactory
[junit4:junit4]   2> 2406 T4253 oasc.CachingDirectoryFactory.get return new directory for /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/OpenCloseCoreStressTest_/00009_core/data forceNew: false
[junit4:junit4]   2> 2407 T4249 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/OpenCloseCoreStressTest_/00012_core/data/index/
[junit4:junit4]   2> 2408 T4249 oasc.SolrCore.initIndex WARNING [00012_core] Solr index directory '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/OpenCloseCoreStressTest_/00012_core/data/index' doesn't exist. Creating new index...
[junit4:junit4]   2> 2408 T4249 oasc.CachingDirectoryFactory.get return new directory for /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/OpenCloseCoreStressTest_/00012_core/data/index forceNew: false
[junit4:junit4]   2> 2387 T4220 oasc.SolrCore.<init> [00010_core] Opening new SolrCore at /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./OpenCloseCoreStressTest_/00010_core/, dataDir=/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/OpenCloseCoreStressTest_/00010_core/data/
[junit4:junit4]   2> 2409 T4220 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@298925ae
[junit4:junit4]   2> 2410 T4220 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockFSDirectoryFactory
[junit4:junit4]   2> 2411 T4220 oasc.CachingDirectoryFactory.get return new directory for /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/OpenCloseCoreStressTest_/00010_core/data forceNew: false
[junit4:junit4]   2> 2411 T4264 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/OpenCloseCoreStressTest_/00011_core/data/index/
[junit4:junit4]   2> 2386 T4248 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> 2474 T4256 oass.IndexSchema.readSchema Schema name=tiny
[junit4:junit4]   2> 2482 T4252 oass.IndexSchema.readSchema Schema name=tiny
[junit4:junit4]   2> 2503 T4255 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4]   2> 		commit{dir=MockDirWrapper(org.apache.lucene.store.SimpleFSDirectory@/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/OpenCloseCoreStressTest_/00000_core/data/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@eee92bd),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 2503 T4255 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4]   2> 2506 T4253 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/OpenCloseCoreStressTest_/00009_core/data/index/
[junit4:junit4]   2> 2507 T4253 oasc.SolrCore.initIndex WARNING [00009_core] Solr index directory '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/OpenCloseCoreStressTest_/00009_core/data/index' doesn't exist. Creating new index...
[junit4:junit4]   2> 2508 T4253 oasc.CachingDirectoryFactory.get return new directory for /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/OpenCloseCoreStressTest_/00009_core/data/index forceNew: false
[junit4:junit4]   2> 2509 T4255 oasc.SolrCore.initWriters created json: solr.JSONResponseWriter
[junit4:junit4]   2> 2509 T4248 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockFSDirectoryFactory
[junit4:junit4]   2> 2510 T4248 oasc.SolrCore.<init> [00016_core] Opening new SolrCore at /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./OpenCloseCoreStressTest_/00016_core/, dataDir=/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/OpenCloseCoreStressTest_/00016_core/data/
[junit4:junit4]   2> 2511 T4248 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@298925ae
[junit4:junit4]   2> 2511 T4255 oasc.RequestHandlers.initHandlersFromConfig created /admin/: solr.admin.AdminHandlers
[junit4:junit4]   2> 2512 T4255 oasc.RequestHandlers.initHandlersFromConfig created /select: solr.SearchHandler
[junit4:junit4]   2> 2513 T4255 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4]   2> 2521 T4255 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4]   2> 2526 T4271 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> 2530 T4268 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> 2531 T4271 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockFSDirectoryFactory
[junit4:junit4]   2> 2532 T4271 oasc.SolrCore.<init> [00018_core] Opening new SolrCore at /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./OpenCloseCoreStressTest_/00018_core/, dataDir=/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/OpenCloseCoreStressTest_/00018_core/data/
[junit4:junit4]   2> 2532 T4271 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@298925ae
[junit4:junit4]   2> 2533 T4271 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockFSDirectoryFactory
[junit4:junit4]   2> 2535 T4253 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4]   2> 		commit{dir=MockDirWrapper(org.apache.lucene.store.SimpleFSDirectory@/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/OpenCloseCoreStressTest_/00009_core/data/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@e9b2793),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 2536 T4253 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4]   2> 2537 T4220 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/OpenCloseCoreStressTest_/00010_core/data/index/
[junit4:junit4]   2> 2539 T4220 oasc.SolrCore.initIndex WARNING [00010_core] Solr index directory '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/OpenCloseCoreStressTest_/00010_core/data/index' doesn't exist. Creating new index...
[junit4:junit4]   2> 2541 T4220 oasc.CachingDirectoryFactory.get return new directory for /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/OpenCloseCoreStressTest_/00010_core/data/index forceNew: false
[junit4:junit4]   2> 2542 T4265 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> 2543 T4264 oasc.SolrCore.initIndex WARNING [00011_core] Solr index directory '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/OpenCloseCoreStressTest_/00011_core/data/index' doesn't exist. Creating new index...
[junit4:junit4]   2> 2544 T4264 oasc.CachingDirectoryFactory.get return new directory for /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/OpenCloseCoreStressTest_/00011_core/data/index forceNew: false
[junit4:junit4]   2> 2511 T4248 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockFSDirectoryFactory
[junit4:junit4]   2> 2547 T4253 oasc.SolrCore.initWriters created json: solr.JSONResponseWriter
[junit4:junit4]   2> 2545 T4265 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockFSDirectoryFactory
[junit4:junit4]   2> 2552 T4265 oasc.SolrCore.<init> [00003_core] Opening new SolrCore at /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./OpenCloseCoreStressTest_/00003_core/, dataDir=/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/OpenCloseCoreStressTest_/00003_core/data/
[junit4:junit4]   2> 2532 T4268 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockFSDirectoryFactory
[junit4:junit4]   2> 2554 T4268 oasc.SolrCore.<init> [00004_core] Opening new SolrCore at /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./OpenCloseCoreStressTest_/00004_core/, dataDir=/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/OpenCloseCoreStressTest_/00004_core/data/
[junit4:junit4]   2> 2552 T4255 oass.SolrIndexSearcher.<init> Opening Searcher@627f4e85 main
[junit4:junit4]   2> 2555 T4265 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@298925ae
[junit4:junit4]   2> 2556 T4265 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockFSDirectoryFactory
[junit4:junit4]   2> 2557 T4265 oasc.CachingDirectoryFactory.get return new directory for /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/OpenCloseCoreStressTest_/00003_core/data forceNew: false
[junit4:junit4]   2> 2551 T4253 oasc.RequestHandlers.initHandlersFromConfig created /admin/: solr.admin.AdminHandlers
[junit4:junit4]   2> 2558 T4253 oasc.RequestHandlers.initHandlersFromConfig created /select: solr.SearchHandler
[junit4:junit4]   2> 2559 T4253 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4]   2> 2564 T4249 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4]   2> 		commit{dir=MockDirWrapper(org.apache.lucene.store.SimpleFSDirectory@/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/OpenCloseCoreStressTest_/00012_core/data/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@4b545701),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 2565 T4249 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4]   2> 2567 T4268 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@298925ae
[junit4:junit4]   2> 2568 T4268 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockFSDirectoryFactory
[junit4:junit4]   2> 2570 T4268 oasc.CachingDirectoryFactory.get return new directory for /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/OpenCloseCoreStressTest_/00004_core/data forceNew: false
[junit4:junit4]   2> 2573 T4265 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/OpenCloseCoreStressTest_/00003_core/data/index/
[junit4:junit4]   2> 2574 T4265 oasc.SolrCore.initIndex WARNING [00003_core] Solr index directory '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/OpenCloseCoreStressTest_/00003_core/data/index' doesn't exist. Creating new index...
[junit4:junit4]   2> 2575 T4265 oasc.CachingDirectoryFactory.get return new directory for /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/OpenCloseCoreStressTest_/00003_core/data/index forceNew: false
[junit4:junit4]   2> 2577 T4249 oasc.SolrCore.initWriters created json: solr.JSONResponseWriter
[junit4:junit4]   2> 2580 T4249 oasc.RequestHandlers.initHandlersFromConfig created /admin/: solr.admin.AdminHandlers
[junit4:junit4]   2> 2581 T4249 oasc.RequestHandlers.initHandlersFromConfig created /select: solr.SearchHandler
[junit4:junit4]   2> 2581 T4249 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4]   2> 2583 T4268 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/OpenCloseCoreStressTest_/00004_core/data/index/
[junit4:junit4]   2> 2584 T4268 oasc.SolrCore.initIndex WARNING [00004_core] Solr index directory '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/OpenCloseCoreStressTest_/00004_core/data/index' doesn't exist. Creating new index...
[junit4:junit4]   2> 2585 T4268 oasc.CachingDirectoryFactory.get return new directory for /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/OpenCloseCoreStressTest_/00004_core/data/index forceNew: false
[junit4:junit4]   2> 2586 T4260 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/OpenCloseCoreStressTest_/00006_core/data/index/
[junit4:junit4]   2> 2586 T4261 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> 2587 T4260 oasc.SolrCore.initIndex WARNING [00006_core] Solr index directory '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/OpenCloseCoreStressTest_/00006_core/data/index' doesn't exist. Creating new index...
[junit4:junit4]   2> 2587 T4260 oasc.CachingDirectoryFactory.get return new directory for /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/OpenCloseCoreStressTest_/00006_core/data/index forceNew: false
[junit4:junit4]   2> 2588 T4261 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockFSDirectoryFactory
[junit4:junit4]   2> 2589 T4261 oasc.SolrCore.<init> [00014_core] Opening new SolrCore at /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./OpenCloseCoreStressTest_/00014_core/, dataDir=/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/OpenCloseCoreStressTest_/00014_core/data/
[junit4:junit4]   2> 2589 T4261 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@298925ae
[junit4:junit4]   2> 2590 T4261 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockFSDirectoryFactory
[junit4:junit4]   2> 2591 T4249 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4]   2> 2591 T4261 oasc.CachingDirectoryFactory.get return new directory for /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/OpenCloseCoreStressTest_/00014_core/data forceNew: false
[junit4:junit4]   2> ASYNC  NEW_CORE C246 name=00015_core org.apache.solr.core.SolrCore@6369998a
[junit4:junit4]   2> 2593 T4217 C246 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4]   2> 		commit{dir=MockDirWrapper(org.apache.lucene.store.SimpleFSDirectory@/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/OpenCloseCoreStressTest_/00015_core/data/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@42b01efc),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 2594 T4217 C246 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4]   2> 2596 T4217 C246 UPDATE [00015_core] webapp=/solr path=/update params={wt=javabin&version=2} {add=[id3]} 0 202
[junit4:junit4]   2> 2547 T4248 oasc.CachingDirectoryFactory.get return new directory for /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/OpenCloseCoreStressTest_/00016_core/data forceNew: false
[junit4:junit4]   2> 2615 T4248 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/OpenCloseCoreStressTest_/00016_core/data/index/
[junit4:junit4]   2> 2616 T4248 oasc.SolrCore.initIndex WARNING [00016_core] Solr index directory '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/OpenCloseCoreStressTest_/00016_core/data/index' doesn't exist. Creating new index...
[junit4:junit4]   2> 2617 T4248 oasc.CachingDirectoryFactory.get return new directory for /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/OpenCloseCoreStressTest_/00016_core/data/index forceNew: false
[junit4:junit4]   2> 2617 T4261 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/OpenCloseCoreStressTest_/00014_core/data/index/
[junit4:junit4]   2> 2618 T4261 oasc.SolrCore.initIndex WARNING [00014_core] Solr index directory '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/OpenCloseCoreStressTest_/00014_core/data/index' doesn't exist. Creating new index...
[junit4:junit4]   2> 2619 T4261 oasc.CachingDirectoryFactory.get return new directory for /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/OpenCloseCoreStressTest_/00014_core/data/index forceNew: false
[junit4:junit4]   2> 2602 T4271 oasc.CachingDirectoryFactory.get return new directory for /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/OpenCloseCoreStressTest_/00018_core/data forceNew: false
[junit4:junit4]   2> 2620 T4255 oasc.SolrCore.registerSearcher [00000_core] Registered new searcher Searcher@627f4e85 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   2> 2621 T4255 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4]   2> 2621 T4255 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4]   2> 2629 T4255 oasc.CoreMaps.putTransientCore Opening transient core 00000_core
[junit4:junit4]   2> 2629 T4255 oasc.CoreContainer.registerCore registering core: 00000_core
[junit4:junit4]   2> 2631 T4264 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4]   2> 		commit{dir=MockDirWrapper(org.apache.lucene.store.SimpleFSDirectory@/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/OpenCloseCoreStressTest_/00011_core/data/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@280adf1e),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 2635 T4220 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4]   2> 		commit{dir=MockDirWrapper(org.apache.lucene.store.SimpleFSDirectory@/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/OpenCloseCoreStressTest_/00010_core/data/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@458ee7c4),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 2636 T4220 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4]   2> 2638 T4264 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4]   2> 2639 T4271 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/OpenCloseCoreStressTest_/00018_core/data/index/
[junit4:junit4]   2> 2581 T4253 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4]   2> 2641 T4271 oasc.SolrCore.initIndex WARNING [00018_core] Solr index directory '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/OpenCloseCoreStressTest_/00018_core/data/index' doesn't exist. Creating new index...
[junit4:junit4]   2> 2642 T4271 oasc.CachingDirectoryFactory.get return new directory for /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/OpenCloseCoreStressTest_/00018_core/data/index forceNew: false
[junit4:junit4]   2> 2643 T4262 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4]   2> 		commit{dir=MockDirWrapper(org.apache.lucene.store.SimpleFSDirectory@/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/OpenCloseCoreStressTest_/00005_core/data/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@32d19333),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 2643 T4262 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4]   2> 2646 T4264 oasc.SolrCore.initWriters created json: solr.JSONResponseWriter
[junit4:junit4]   2> 2648 T4220 oasc.SolrCore.initWriters created json: solr.JSONResponseWriter
[junit4:junit4]   2> 2648 T4264 oasc.RequestHandlers.initHandlersFromConfig created /admin/: solr.admin.AdminHandlers
[junit4:junit4]   2> 2649 T4264 oasc.RequestHandlers.initHandlersFromConfig created /select: solr.SearchHandler
[junit4:junit4]   2> 2650 T4264 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4]   2> 2651 T4220 oasc.RequestHandlers.initHandlersFromConfig created /admin/: solr.admin.AdminHandlers
[junit4:junit4]   2> 2652 T4220 oasc.RequestHandlers.initHandlersFromConfig created /select: solr.SearchHandler
[junit4:junit4]   2> 2653 T4220 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4]   2> 2654 T4260 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4]   2> 		commit{dir=MockDirWrapper(org.apache.lucene.store.SimpleFSDirectory@/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/OpenCloseCoreStressTest_/00006_core/data/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@4082076a),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 2654 T4260 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4]   2> 2660 T4262 oasc.SolrCore.initWriters created json: solr.JSONResponseWriter
[junit4:junit4]   2> 2663 T4262 oasc.RequestHandlers.initHandlersFromConfig created /admin/: solr.admin.AdminHandlers
[junit4:junit4]   2> 2664 T4262 oasc.RequestHandlers.initHandlersFromConfig created /select: solr.SearchHandler
[junit4:junit4]   2> 2665 T4262 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4]   2> 2671 T4260 oasc.SolrCore.initWriters created json: solr.JSONResponseWriter
[junit4:junit4]   2> 2674 T4260 oasc.RequestHandlers.initHandlersFromConfig created /admin/: solr.admin.AdminHandlers
[junit4:junit4]   2> 2675 T4260 oasc.RequestHandlers.initHandlersFromConfig created /select: solr.SearchHandler
[junit4:junit4]   2> 2675 T4260 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4]   2> ASYNC  NEW_CORE C247 name=00000_core org.apache.solr.core.SolrCore@5d94346d
[junit4:junit4]   2> 2684 T4263 C247 REQ [00000_core] webapp=/solr path=/select params={q=*:*&wt=javabin&qt=/select&version=2} hits=0 status=0 QTime=1 
[junit4:junit4]   2> 2700 T4220 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4]   2> 2714 T4248 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4]   2> 		commit{dir=MockDirWrapper(org.apache.lucene.store.SimpleFSDirectory@/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/OpenCloseCoreStressTest_/00016_core/data/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@195b88d3),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 2715 T4248 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4]   2> 2705 T4265 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4]   2> 		commit{dir=MockDirWrapper(org.apache.lucene.store.SimpleFSDirectory@/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/OpenCloseCoreStressTest_/00003_core/data/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@82c895),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 2716 T4261 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4]   2> 		commit{dir=MockDirWrapper(org.apache.lucene.store.SimpleFSDirectory@/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/OpenCloseCoreStressTest_/00014_core/data/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@304a28a2),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 2717 T4261 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4]   2> 2719 T4260 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4]   2> 2706 T4262 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4]   2> 2706 T4249 oass.SolrIndexSearcher.<init> Opening Searcher@6ab43e7a main
[junit4:junit4]   2> 2721 T4250 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_41
[junit4:junit4]   2> 2721 T4249 oasc.SolrCore.registerSearcher [00012_core] Registered new searcher Searcher@6ab43e7a main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   2> 2722 T4249 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4]   2> 2723 T4249 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4]   2> 2717 T4265 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4]   2> 2727 T4248 oasc.SolrCore.initWriters created json: solr.JSONResponseWriter
[junit4:junit4]   2> 2728 T4256 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> 2730 T4248 oasc.RequestHandlers.initHandlersFromConfig created /admin/: solr.admin.AdminHandlers
[junit4:junit4]   2> 2730 T4256 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockFSDirectoryFactory
[junit4:junit4]   2> 2731 T4261 oasc.SolrCore.initWriters created json: solr.JSONResponseWriter
[junit4:junit4]   2> 2733 T4261 oasc.RequestHandlers.initHandlersFromConfig created /admin/: solr.admin.AdminHandlers
[junit4:junit4]   2> 2734 T4261 oasc.RequestHandlers.initHandlersFromConfig created /select: solr.SearchHandler
[junit4:junit4]   2> 2735 T4261 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4]   2> 2737 T4271 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4]   2> 		commit{dir=MockDirWrapper(org.apache.lucene.store.SimpleFSDirectory@/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/OpenCloseCoreStressTest_/00018_core/data/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@403dd7cf),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 2737 T4271 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4]   2> 2739 T4264 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4]   2> 2741 T4265 oasc.SolrCore.initWriters created json: solr.JSONResponseWriter
[junit4:junit4]   2> 2743 T4265 oasc.RequestHandlers.initHandlersFromConfig created /admin/: solr.admin.AdminHandlers
[junit4:junit4]   2> 2744 T4265 oasc.RequestHandlers.initHandlersFromConfig created /select: solr.SearchHandler
[junit4:junit4]   2> 2745 T4265 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4]   2> 2730 T4248 oasc.RequestHandlers.initHandlersFromConfig created /select: solr.SearchHandler
[junit4:junit4]   2> 2746 T4248 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4]   2> 2748 T4265 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4]   2> 2749 T4248 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4]   2> 2731 T4256 oasc.SolrCore.<init> [00001_core] Opening new SolrCore at /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./OpenCloseCoreStressTest_/00001_core/, dataDir=/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/OpenCloseCoreStressTest_/00001_core/data/
[junit4:junit4]   2> 2752 T4256 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@298925ae
[junit4:junit4]   2> 2753 T4256 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockFSDirectoryFactory
[junit4:junit4]   2> 2755 T4256 oasc.CachingDirectoryFactory.get return new directory for /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/OpenCloseCoreStressTest_/00001_core/data forceNew: false
[junit4:junit4]   2> 2755 T4253 oass.SolrIndexSearcher.<init> Opening Searcher@513a1618 main
[junit4:junit4]   2> 2757 T4271 oasc.SolrCore.initWriters created json: solr.JSONResponseWriter
[junit4:junit4]   2> 2758 T4249 oasc.CoreMaps.putTransientCore Opening transient core 00012_core
[junit4:junit4]   2> 2759 T4249 oasc.CoreContainer.registerCore registering core: 00012_core
[junit4:junit4]   2> 2757 T4253 oasc.SolrCore.registerSearcher [00009_core] Registered new searcher Searcher@513a1618 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   2> 2760 T4253 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4]   2> 2760 T4253 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4]   2> 2759 T4271 oasc.RequestHandlers.initHandlersFromConfig created /admin/: solr.admin.AdminHandlers
[junit4:junit4]   2> 2762 T4271 oasc.RequestHandlers.initHandlersFromConfig created /select: solr.SearchHandler
[junit4:junit4]   2> 2764 T4271 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4]   2> 2766 T4256 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/OpenCloseCoreStressTest_/00001_core/data/index/
[junit4:junit4]   2> 2766 T4256 oasc.SolrCore.initIndex WARNING [00001_core] Solr index directory '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/OpenCloseCoreStressTest_/00001_core/data/index' doesn't exist. Creating new index...
[junit4:junit4]   2> 2767 T4253 oasc.CoreMaps.putTransientCore Opening transient core 00009_core
[junit4:junit4]   2> 2768 T4253 oasc.CoreContainer.registerCore registering core: 00009_core
[junit4:junit4]   2> 2768 T4268 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4]   2> 		commit{dir=MockDirWrapper(org.apache.lucene.store.SimpleFSDirectory@/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/OpenCloseCoreStressTest_/00004_core/data/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@54b1bc72),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 2771 T4268 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4]   2> 2760 T4252 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> 2771 T4264 oass.SolrIndexSearcher.<init> Opening Searcher@3e1a043a main
[junit4:junit4]   2> 2772 T4268 oasc.SolrCore.initWriters created json: solr.JSONResponseWriter
[junit4:junit4]   2> 2776 T4268 oasc.RequestHandlers.initHandlersFromConfig created /admin/: solr.admin.AdminHandlers
[junit4:junit4]   2> 2777 T4268 oasc.RequestHandlers.initHandlersFromConfig created /select: solr.SearchHandler
[junit4:junit4]   2> 2777 T4268 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4]   2> 2768 T4256 oasc.CachingDirectoryFactory.get return new directory for /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/OpenCloseCoreStressTest_/00001_core/data/index forceNew: false
[junit4:junit4]   2> 2781 T4220 oass.SolrIndexSearcher.<init> Opening Searcher@7600d5c7 main
[junit4:junit4]   2> 2782 T4220 oasc.SolrCore.registerSearcher [00010_core] Registered new searcher Searcher@7600d5c7 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   2> 2783 T4220 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4]   2> 2783 T4220 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4]   2> 2773 T4264 oasc.SolrCore.registerSearcher [00011_core] Registered new searcher Searcher@3e1a043a main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   2> 2785 T4264 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4]   2> 2786 T4264 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4]   2> 2790 T4252 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockFSDirectoryFactory
[junit4:junit4]   2> 2791 T4252 oasc.SolrCore.<init> [00013_core] Opening new SolrCore at /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./OpenCloseCoreStressTest_/00013_core/, dataDir=/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/OpenCloseCoreStressTest_/00013_core/data/
[junit4:junit4]   2> 2796 T4268 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4]   2> 2797 T4271 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4]   2> 2801 T4252 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@298925ae
[junit4:junit4]   2> 2801 T4261 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4]   2> 2802 T4252 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockFSDirectoryFactory
[junit4:junit4]   2> 2808 T4252 oasc.CachingDirectoryFactory.get return new directory for /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/OpenCloseCoreStressTest_/00013_core/data forceNew: false
[junit4:junit4]   2> 2809 T4220 oasc.CoreMaps.putTransientCore Opening transient core 00010_core
[junit4:junit4]   2> 2809 T4220 oasc.CoreContainer.registerCore registering core: 00010_core
[junit4:junit4]   2> 2817 T4278 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig-minimal.xml
[junit4:junit4]   2> 2818 T4278 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4]   2> 2820 T4252 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/OpenCloseCoreStressTest_/00013_core/data/index/
[junit4:junit4]   2> 2820 T4252 oasc.SolrCore.initIndex WARNING [00013_core] Solr index directory '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/OpenCloseCoreStressTest_/00013_core/data/index' doesn't exist. Creating new index...
[junit4:junit4]   2> 2822 T4252 oasc.CachingDirectoryFactory.get return new directory for /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/OpenCloseCoreStressTest_/00013_core/data/index forceNew: false
[junit4:junit4]   2> ASYNC  NEW_CORE C248 name=00009_core org.apache.solr.core.SolrCore@6ecc37c
[junit4:junit4]   2> 2831 T4253 C248 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4]   2> 		commit{dir=MockDirWrapper(org.apache.lucene.store.SimpleFSDirectory@/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/OpenCloseCoreStressTest_/00009_core/data/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@e9b2793),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 2832 T4253 C248 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4]   2> ASYNC  NEW_CORE C249 name=00012_core org.apache.solr.core.SolrCore@ddaf661
[junit4:junit4]   2> 2835 T4249 C249 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4]   2> 		commit{dir=MockDirWrapper(org.apache.lucene.store.SimpleFSDirectory@/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/OpenCloseCoreStressTest_/00012_core/data/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@4b545701),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 2836 T4249 C249 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4]   2> 2841 T4249 C249 UPDATE [00012_core] webapp=/solr path=/update params={wt=javabin&version=2} {add=[id10]} 0 35
[junit4:junit4]   2> 2843 T4264 oasc.CoreMaps.putTransientCore Opening transient core 00011_core
[junit4:junit4]   2> 2844 T4264 oasc.CoreContainer.registerCore registering core: 00011_core
[junit4:junit4]   2> 2848 T4263 C244 UPDATE [00007_core] webapp=/solr path=/update params={wt=javabin&version=2} {add=[id24]} 0 1
[junit4:junit4]   2> 2852 T4265 oass.SolrIndexSearcher.<init> Opening Searcher@5a400792 main
[junit4:junit4]   2> 2853 T4265 oasc.SolrCore.registerSearcher [00003_core] Registered new searcher Searcher@5a400792 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   2> 2854 T4265 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4]   2> 2855 T4265 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4]   2> 2856 T4255 C247 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4]   2> 		commit{dir=MockDirWrapper(org.apache.lucene.store.SimpleFSDirectory@/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/OpenCloseCoreStressTest_/00000_core/data/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@eee92bd),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 2856 T4255 C247 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4]   2> 2859 T4255 C247 UPDATE [00000_core] webapp=/solr path=/update params={wt=javabin&version=2} {add=[id12]} 0 49
[junit4:junit4]   2> 2867 T4278 oass.IndexSchema.readSchema Schema name=tiny
[junit4:junit4]   2> 2879 T4271 oass.SolrIndexSearcher.<init> Opening Searcher@6f0540ea main
[junit4:junit4]   2> 2880 T4271 oasc.SolrCore.registerSearcher [00018_core] Registered new searcher Searcher@6f0540ea main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   2> 2881 T4271 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4]   2> 2881 T4271 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4]   2> 2883 T4260 oass.SolrIndexSearcher.<init> Opening Searcher@7202267d main
[junit4:junit4]   2> 2884 T4260 oasc.SolrCore.registerSearcher [00006_core] Registered new searcher Searcher@7202267d main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   2> 2885 T4260 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4]   2> 2888 T4249 C249 UPDATE [00012_core] webapp=/solr path=/update params={wt=javabin&version=2} {add=[id26]} 0 1
[junit4:junit4]   2> 2888 T4260 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4]   2> 2892 T4256 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4]   2> 		commit{dir=MockDirWrapper(org.apache.lucene.store.SimpleFSDirectory@/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/OpenCloseCoreStressTest_/00001_core/data/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@532d66a5),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 2893 T4256 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4]   2> 2896 T4256 oasc.SolrCore.initWriters created json: solr.JSONResponseWriter
[junit4:junit4]   2> 2903 T4252 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4]   2> 		commit{dir=MockDirWrapper(org.apache.lucene.store.SimpleFSDirectory@/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/OpenCloseCoreStressTest_/00013_core/data/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@295fed10),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 2905 T4252 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4]   2> 2905 T4260 oasc.CoreMaps.putTransientCore Opening transient core 00006_core
[junit4:junit4]   2> 2901 T4256 oasc.RequestHandlers.initHandlersFromConfig created /admin/: solr.admin.AdminHandlers
[junit4:junit4]   2> 2906 T4252 oasc.SolrCore.initWriters created json: solr.JSONResponseWriter
[junit4:junit4]   2> 2906 T4260 oasc.CoreContainer.registerCore registering core: 00006_core
[junit4:junit4]   2> 2909 T4252 oasc.RequestHandlers.initHandlersFromConfig created /admin/: solr.admin.AdminHandlers
[junit4:junit4]   2> 2910 T4252 oasc.RequestHandlers.initHandlersFromConfig created /select: solr.SearchHandler
[junit4:junit4]   2> 2910 T4268 oass.SolrIndexSearcher.<init> Opening Searcher@5a5b360a main
[junit4:junit4]   2> 2910 T4252 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4]   2> 2911 T4268 oasc.SolrCore.registerSearcher [00004_core] Registered new searcher Searcher@5a5b360a main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   2> 2912 T4268 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4]   2> 2912 T4268 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4]   2> 2906 T4256 oasc.RequestHandlers.initHandlersFromConfig created /select: solr.SearchHandler
[junit4:junit4]   2> 2916 T4256 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4]   2> 2915 T4253 C248 UPDATE [00009_core] webapp=/solr path=/update params={wt=javabin&version=2} {add=[id11]} 0 119
[junit4:junit4]   2> 2926 T4262 oass.SolrIndexSearcher.<init> Opening Searcher@4baeee77 main
[junit4:junit4]   2> 2928 T4262 oasc.SolrCore.registerSearcher [00005_core] Registered new searcher Searcher@4baeee77 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   2> 2930 T4262 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4]   2> 2938 T4262 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4]   2> 2939 T4261 oass.SolrIndexSearcher.<init> Opening Searcher@3bc6be29 main
[junit4:junit4]   2> 2937 T4249 C244 UPDATE [00007_core] webapp=/solr path=/update params={wt=javabin&version=2} {add=[id28]} 0 0
[junit4:junit4]   2> 2946 T4261 oasc.SolrCore.registerSearcher [00014_core] Registered new searcher Searcher@3bc6be29 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   2> 2947 T4262 oasc.CoreMaps.putTransientCore Opening transient core 00005_core
[junit4:junit4]   2> 2947 T4261 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4]   2> 2949 T4261 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4]   2> 2950 T4248 oass.SolrIndexSearcher.<init> Opening Searcher@3978a3d8 main
[junit4:junit4]   2> 2951 T4248 oasc.SolrCore.registerSearcher [00016_core] Registered new searcher Searcher@3978a3d8 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   2> 2952 T4248 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4]   2> 2952 T4248 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4]   2> 2954 T4261 oasc.CoreMaps.putTransientCore Opening transient core 00014_core
[junit4:junit4]   2> 2955 T4261 oasc.CoreContainer.registerCore registering core: 00014_core
[junit4:junit4]   2> 2957 T4221 oasc.SolrCore.close [00008_core]  CLOSING SolrCore org.apache.solr.core.SolrCore@6cf15013
[junit4:junit4]   2> 2958 T4248 oasc.CoreMaps.putTransientCore Opening transient core 00016_core
[junit4:junit4]   2> 2959 T4248 oasc.CoreContainer.registerCore registering core: 00016_core
[junit4:junit4]   2> 2960 T4253 C248 UPDATE [00009_core] webapp=/solr path=/update params={wt=javabin&version=2} {add=[id29]} 0 0
[junit4:junit4]   2> 2937 T4265 oasc.CoreMaps.putTransientCore Opening transient core 00003_core
[junit4:junit4]   2> 2962 T4265 oasc.CoreContainer.registerCore registering core: 00003_core
[junit4:junit4]   2> 2947 T4262 oasc.CoreContainer.registerCore registering core: 00005_core
[junit4:junit4]   2> 2968 T4221 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=0,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=4,adds=4,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=4,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0}
[junit4:junit4]   2> 2968 T4221 oasu.SolrCoreState.decrefSolrCoreState Closing SolrCoreState
[junit4:junit4]   2> 2968 T4221 oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has reached 0 - closing IndexWriter
[junit4:junit4]   2> 2969 T4221 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser
[junit4:junit4]   2> 2971 T4271 oasc.CoreMaps.putTransientCore Opening transient core 00018_core
[junit4:junit4]   2> 2972 T4271 oasc.CoreContainer.registerCore registering core: 00018_core
[junit4:junit4]   2> ASYNC  NEW_CORE C250 name=00003_core org.apache.solr.core.SolrCore@13fc3048
[junit4:junit4]   2> 2976 T4265 C250 REQ [00003_core] webapp=/solr path=/select params={q=*:*&wt=javabin&qt=/select&version=2} hits=0 status=0 QTime=0 
[junit4:junit4]   2> ASYNC  NEW_CORE C251 name=00018_core org.apache.solr.core.SolrCore@2dd56675
[junit4:junit4]   2> 2978 T4271 C251 REQ [00018_core] webapp=/solr path=/select params={q=*:*&wt=javabin&qt=/select&version=2} hits=0 status=0 QTime=0 
[junit4:junit4]   2> 2989 T4268 oasc.CoreMaps.putTransientCore Opening transient core 00004_core
[junit4:junit4]   2> 2990 T4268 oasc.CoreContainer.registerCore registering core: 00004_core
[junit4:junit4]   2> ASYNC  NEW_CORE C252 name=00010_core org.apache.solr.core.SolrCore@bb04b91
[junit4:junit4]   2> 3001 T4220 C252 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4]   2> 		commit{dir=MockDirWrapper(org.apache.lucene.store.SimpleFSDirectory@/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/OpenCloseCoreStressTest_/00010_core/data/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@458ee7c4),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 3003 T4273 C251 REQ [00018_core] webapp=/solr path=/select params={q=*:*&wt=javabin&qt=/select&version=2} hits=0 status=0 QTime=1 
[junit4:junit4]   2> 3015 T4252 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4]   2> 3017 T4220 C252 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4]   2> ASYNC  NEW_CORE C253 name=00016_core org.apache.solr.core.SolrCore@617c8341
[junit4:junit4]   2> 3035 T4275 C253 REQ [00016_core] webapp=/solr path=/select params={q=*:*&wt=javabin&qt=/select&version=2} hits=0 status=0 QTime=1 
[junit4:junit4]   2> ASYNC  NEW_CORE C254 name=00004_core org.apache.solr.core.SolrCore@11c5d138
[junit4:junit4]   2> 3030 T4219 C254 REQ [00004_core] webapp=/solr path=/select params={q=*:*&wt=javabin&qt=/select&version=2} hits=0 status=0 QTime=0 
[junit4:junit4]   2> ASYNC  NEW_CORE C255 name=00005_core org.apache.solr.core.SolrCore@22160571
[junit4:junit4]   2> 3030 T4270 C255 REQ [00005_core] webapp=/solr path=/select params={q=*:*&wt=javabin&qt=/select&version=2} hits=0 status=0 QTime=0 
[junit4:junit4]   2> 3053 T4268 C254 REQ [00004_core] webapp=/solr path=/select params={q=*:*&wt=javabin&qt=/select&version=2} hits=0 status=0 QTime=0 
[junit4:junit4]   2> 3062 T4262 C255 REQ [00005_core] webapp=/solr path=/select params={q=*:*&wt=javabin&qt=/select&version=2} hits=0 status=0 QTime=0 
[junit4:junit4]   2> ASYNC  NEW_CORE C256 name=00014_core org.apache.solr.core.SolrCore@3c2e5a88
[junit4:junit4]   2> 3064 T4261 C256 REQ [00014_core] webapp=/solr path=/select params={q=*:*&wt=javabin&qt=/select&version=2} hits=0 status=0 QTime=1 
[junit4:junit4]   2> ASYNC  NEW_CORE C257 name=00011_core org.apache.solr.core.SolrCore@3c68c87f
[junit4:junit4]   2> 3068 T4264 C257 REQ [00011_core] webapp=/solr path=/select params={q=*:*&wt=javabin&qt=/select&version=2} hits=0 status=0 QTime=0 
[junit4:junit4]   2> 3076 T4255 C251 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4]   2> 		commit{dir=MockDirWrapper(org.apache.lucene.store.SimpleFSDirectory@/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/OpenCloseCoreStressTest_/00018_core/data/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@403dd7cf),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 3077 T4220 C252 UPDATE [00010_core] webapp=/solr path=/update params={wt=javabin&version=2} {add=[id5]} 0 251
[junit4:junit4]   2> 3115 T4248 C253 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4]   2> 		commit{dir=MockDirWrapper(org.apache.lucene.store.SimpleFSDirectory@/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/OpenCloseCoreStressTest_/00016_core/data/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@195b88d3),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 3122 T4248 C253 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4]   2> 3079 T4256 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4]   2> 3098 T4274 C253 REQ [00016_core] webapp=/solr path=/select params={q=*:*&wt=javabin&qt=/select&version=2} hits=0 status=0 QTime=0 
[junit4:junit4]   2> 3095 T4218 C256 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4]   2> 		commit{dir=MockDirWrapper(org.apache.lucene.store.SimpleFSDirectory@/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/OpenCloseCoreStressTest_/00014_core/data/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@304a28a2),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 3094 T4267 C257 REQ [00011_core] webapp=/solr path=/select params={q=*:*&wt=javabin&qt=/select&version=2} hits=0 status=0 QTime=0 
[junit4:junit4]   2> 3127 T4253 oasc.CoreContainer.create Creating SolrCore '00017_core' using instanceDir: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./OpenCloseCoreStressTest_/00017_core
[junit4:junit4]   2> 3129 T4253 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./OpenCloseCoreStressTest_/00017_core/'
[junit4:junit4]   2> 3145 T4219 C244 REQ [00007_core] webapp=/solr path=/select params={q=*:*&wt=javabin&qt=/select&version=2} hits=0 status=0 QTime=0 
[junit4:junit4]   2> 3084 T4265 C255 REQ [00005_core] webapp=/solr path=/select params={q=*:*&wt=javabin&qt=/select&version=2} hits=0 status=0 QTime=1 
[junit4:junit4]   2> 3155 T4275 C257 REQ [00011_core] webapp=/solr path=/select params={q=*:*&wt=javabin&qt=/select&version=2} hits=0 status=0 QTime=0 
[junit4:junit4]   2> 3078 T4255 C251 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4]   2> 3154 T4278 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> 3164 T4278 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockFSDirectoryFactory
[junit4:junit4]   2> 3165 T4278 oasc.SolrCore.<init> [00002_core] Opening new SolrCore at /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./OpenCloseCoreStressTest_/00002_core/, dataDir=/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/OpenCloseCoreStressTest_/00002_core/data/
[junit4:junit4]   2> 3166 T4278 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@298925ae
[junit4:junit4]   2> 3166 T4278 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockFSDirectoryFactory
[junit4:junit4]   2> 3153 T4252 oass.SolrIndexSearcher.<init> Opening Searcher@3c26e8ac main
[junit4:junit4]   2> 3172 T4252 oasc.SolrCore.registerSearcher [00013_core] Registered new searcher Searcher@3c26e8ac main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   2> 3173 T4252 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4]   2> 3173 T4252 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4]   2> 3151 T4254 C253 UPDATE [00016_core] webapp=/solr path=/update params={wt=javabin&version=2} {add=[id16]} 0 57
[junit4:junit4]   2> 3147 T4248 C253 UPDATE [00016_core] webapp=/solr path=/update params={wt=javabin&version=2} {add=[id9]} 0 91
[junit4:junit4]   2> 3151 T4218 C256 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4]   2> 3177 T4278 oasc.CachingDirectoryFactory.get return new directory for /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/OpenCloseCoreStressTest_/00002_core/data forceNew: false
[junit4:junit4]   2> ASYNC  NEW_CORE C258 name=00006_core org.apache.solr.core.SolrCore@730a9275
[junit4:junit4]   2> 3124 T4263 C258 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4]   2> 		commit{dir=MockDirWrapper(org.apache.lucene.store.SimpleFSDirectory@/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/OpenCloseCoreStressTest_/00006_core/data/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@4082076a),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 3181 T4271 C253 UPDATE [00016_core] webapp=/solr path=/update params={wt=javabin&version=2} {add=[id32]} 0 2
[junit4:junit4]   2> 3162 T4268 C251 REQ [00018_core] webapp=/solr path=/select params={q=*:*&wt=javabin&qt=/select&version=2} hits=0 status=0 QTime=0 
[junit4:junit4]   2> 3159 T4255 C251 UPDATE [00018_core] webapp=/solr path=/update params={wt=javabin&version=2} {add=[id25]} 0 155
[junit4:junit4]   2> 3192 T4271 C254 REQ [00004_core] webapp=/solr path=/select params={q=*:*&wt=javabin&qt=/select&version=2} hits=0 status=0 QTime=0 
[junit4:junit4]   2> 3189 T4278 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/OpenCloseCoreStressTest_/00002_core/data/index/
[junit4:junit4]   2> 3222 T4278 oasc.SolrCore.initIndex WARNING [00002_core] Solr index directory '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/OpenCloseCoreStressTest_/00002_core/data/index' doesn't exist. Creating new index...
[junit4:junit4]   2> 3223 T4278 oasc.CachingDirectoryFactory.get return new directory for /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/OpenCloseCoreStressTest_/00002_core/data/index forceNew: false
[junit4:junit4]   2> 3189 T4256 oass.SolrIndexSearcher.<init> Opening Searcher@3041700b main
[junit4:junit4]   2> 3188 T4252 oasc.CoreMaps.putTransientCore Opening transient core 00013_core
[junit4:junit4]   2> 3184 T4263 C258 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4]   2> 3255 T4263 C258 UPDATE [00006_core] webapp=/solr path=/update params={wt=javabin&version=2} {add=[id27]} 0 208
[junit4:junit4]   2> 3184 T4218 C256 UPDATE [00014_core] webapp=/solr path=/update params={wt=javabin&version=2} {add=[id22]} 0 150
[junit4:junit4]   2> 3250 T4265 C253 REQ [00016_core] webapp=/solr path=/select params={q=*:*&wt=javabin&qt=/select&version=2} hits=0 status=0 QTime=0 
[junit4:junit4]   2> 3266 T4274 C253 UPDATE [00016_core] webapp=/solr path=/update params={wt=javabin&version=2} {add=[id36]} 0 1
[junit4:junit4]   2> 3251 T4252 oasc.CoreContainer.registerCore registering core: 00013_core
[junit4:junit4]   2> 3250 T4256 oasc.SolrCore.registerSearcher [00001_core] Registered new searcher Searcher@3041700b main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   2> 3236 T4219 C256 UPDATE [00014_core] webapp=/solr path=/update params={wt=javabin&version=2} {add=[id35]} 0 10
[junit4:junit4]   2> 3286 T4250 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig-minimal.xml
[junit4:junit4]   2> 3286 T4256 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4]   2> 3286 T4256 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4]   2> ASYNC  NEW_CORE C259 name=00013_core org.apache.solr.core.SolrCore@4732f9f7
[junit4:junit4]   2> 3284 T4252 C259 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4]   2> 		commit{dir=MockDirWrapper(org.apache.lucene.store.SimpleFSDirectory@/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/OpenCloseCoreStressTest_/00013_core/data/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@295fed10),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 3292 T4252 C259 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4]   2> 3276 T4260 C258 UPDATE [00006_core] webapp=/solr path=/update params={wt=javabin&version=2} {add=[id8]} 0 174
[junit4:junit4]   2> 3276 T4280 C258 UPDATE [00006_core] webapp=/solr path=/update params={wt=javabin&version=2} {add=[id21]} 0 229
[junit4:junit4]   2> 3276 T4217 C258 UPDATE [00006_core] webapp=/solr path=/update params={wt=javabin&version=2} {add=[id23]} 0 207
[junit4:junit4]   2> 3298 T4280 C253 REQ [00016_core] webapp=/solr path=/select params={q=*:*&wt=javabin&qt=/select&version=2} hits=0 status=0 QTime=1 
[junit4:junit4]   2> 3265 T4267 C259 REQ [00013_core] webapp=/solr path=/select params={q=*:*&wt=javabin&qt=/select&version=2} hits=0 status=0 QTime=0 
[junit4:junit4]   2> 3288 T4262 C259 REQ [00013_core] webapp=/solr path=/select params={q=*:*&wt=javabin&qt=/select&version=2} hits=0 status=0 QTime=0 
[junit4:junit4]   2> 3296 T4252 C259 UPDATE [00013_core] webapp=/solr path=/update params={wt=javabin&version=2} {add=[id14]} 0 29
[junit4:junit4]   2> 3286 T4250 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4]   2> 3304 T4256 oasc.CoreMaps.putTransientCore Opening transient core 00001_core
[junit4:junit4]   2> 3305 T4256 oasc.CoreContainer.registerCore registering core: 00001_core
[junit4:junit4]   2> 3308 T4250 oass.IndexSchema.readSchema Schema name=tiny
[junit4:junit4]   2> ASYNC  NEW_CORE C260 name=00001_core org.apache.solr.core.SolrCore@3f041549
[junit4:junit4]   2> 3327 T4216 C260 REQ [00001_core] webapp=/solr path=/select params={q=*:*&wt=javabin&qt=/select&version=2} hits=0 status=0 QTime=0 
[junit4:junit4]   2> 3327 T4272 C260 REQ [00001_core] webapp=/solr path=/select params={q=*:*&wt=javabin&qt=/select&version=2} hits=0 status=0 QTime=0 
[junit4:junit4]   2> 3328 T4266 C260 REQ [00001_core] webapp=/solr path=/select params={q=*:*&wt=javabin&qt=/select&version=2} hits=0 status=0 QTime=0 
[junit4:junit4]   2> 3332 T4253 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_41
[junit4:junit4]   2> 3334 T4256 C260 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4]   2> 		commit{dir=MockDirWrapper(org.apache.lucene.store.SimpleFSDirectory@/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/OpenCloseCoreStressTest_/00001_core/data/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@532d66a5),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 3334 T4256 C260 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4]   2> 3341 T4278 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4]   2> 		commit{dir=MockDirWrapper(org.apache.lucene.store.SimpleFSDirectory@/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/OpenCloseCoreStressTest_/00002_core/data/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@a98ddd),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 3342 T4278 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4]   2> 3354 T4256 C260 UPDATE [00001_core] webapp=/solr path=/update params={wt=javabin&version=2} {add=[id6]} 0 44
[junit4:junit4]   2> 3362 T4265 C250 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4]   2> 		commit{dir=MockDirWrapper(org.apache.lucene.store.SimpleFSDirectory@/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/OpenCloseCoreStressTest_/00003_core/data/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@82c895),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 3363 T4265 C250 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4]   2> 3365 T4265 C250 UPDATE [00003_core] webapp=/solr path=/update params={wt=javabin&version=2} {add=[id44]} 0 7
[junit4:junit4]   2> 3366 T4252 C257 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4]   2> 		commit{dir=MockDirWrapper(org.apache.lucene.store.SimpleFSDirectory@/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/OpenCloseCoreStressTest_/00011_core/data/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@280adf1e),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 3370 T4278 oasc.SolrCore.initWriters created json: solr.JSONResponseWriter
[junit4:junit4]   2> 3373 T4278 oasc.RequestHandlers.initHandlersFromConfig created /admin/: solr.admin.AdminHandlers
[junit4:junit4]   2> 3382 T4215 C260 UPDATE [00001_core] webapp=/solr path=/update params={wt=javabin&version=2} {add=[id18]} 0 56
[junit4:junit4]   2> 3380 T4249 C260 UPDATE [00001_core] webapp=/solr path=/update params={wt=javabin&version=2} {add=[id30]} 0 54
[junit4:junit4]   2> 3381 T4252 C257 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4]   2> 3381 T4219 C251 UPDATE [00018_core] webapp=/solr path=/update params={wt=javabin&version=2} {add=[id45]} 0 11
[junit4:junit4]   2> 3398 T4278 oasc.RequestHandlers.initHandlersFromConfig created /select: solr.SearchHandler
[junit4:junit4]   2> 3401 T4278 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4]   2> 3414 T4216 C250 REQ [00003_core] webapp=/solr path=/select params={q=*:*&wt=javabin&qt=/select&version=2} hits=0 status=0 QTime=0 
[junit4:junit4]   2> 3414 T4262 C254 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4]   2> 		commit{dir=MockDirWrapper(org.apache.lucene.store.SimpleFSDirectory@/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/OpenCloseCoreStressTest_/00004_core/data/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@54b1bc72),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 3419 T4250 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> 3420 T4278 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4]   2> 3421 T4250 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockFSDirectoryFactory
[junit4:junit4]   2> 3422 T4250 oasc.SolrCore.<init> [00019_core] Opening new SolrCore at /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./OpenCloseCoreStressTest_/00019_core/, dataDir=/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/OpenCloseCoreStressTest_/00019_core/data/
[junit4:junit4]   2> 3422 T4250 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@298925ae
[junit4:junit4]   2> 3423 T4250 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockFSDirectoryFactory
[junit4:junit4]   2> 3452 T4215 C254 REQ [00004_core] webapp=/solr path=/select params={q=*:*&wt=javabin&qt=/select&version=2} hits=0 status=0 QTime=0 
[junit4:junit4]   2> 3406 T4260 C250 UPDATE [00003_core] webapp=/solr path=/update params={wt=javabin&version=2} {add=[id47]} 0 1
[junit4:junit4]   2> 3456 T4250 oasc.CachingDirectoryFactory.get return new directory for /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/OpenCloseCoreStressTest_/00019_core/data forceNew: false
[junit4:junit4]   2> 3457 T4250 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/OpenCloseCoreStressTest_/00019_core/data/index/
[junit4:junit4]   2> 3457 T4250 oasc.SolrCore.initIndex WARNING [00019_core] Solr index directory '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/OpenCloseCoreStressTest_/00019_core/data/index' doesn't exist. Creating new index...
[junit4:junit4]   2> 3458 T4250 oasc.CachingDirectoryFactory.get return new directory for /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/OpenCloseCoreStressTest_/00019_core/data/index forceNew: false
[junit4:junit4]   2> 3401 T4252 C257 UPDATE [00011_core] webapp=/solr path=/update params={wt=javabin&version=2} {add=[id41]} 0 89
[junit4:junit4]   2> 3451 T4256 C255 REQ [00005_core] webapp=/solr path=/select params={q=*:*&wt=javabin&qt=/select&version=2} hits=0 status=0 QTime=0 
[junit4:junit4]   2> 3442 T4278 oass.SolrIndexSearcher.<init> Opening Searcher@1141c6a7 main
[junit4:junit4]   2> 3434 T4262 C254 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4]   2> 3467 T4278 oasc.SolrCore.registerSearcher [00002_core] Registered new searcher Searcher@1141c6a7 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   2> 3468 T4278 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4]   2> 3468 T4278 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4]   2> 3475 T4278 oasc.CoreMaps.putTransientCore Opening transient core 00002_core
[junit4:junit4]   2> 3475 T4278 oasc.CoreContainer.registerCore registering core: 00002_core
[junit4:junit4]   2> 3497 T4262 C254 UPDATE [00004_core] webapp=/solr path=/update params={wt=javabin&version=2} {add=[id46]} 0 100
[junit4:junit4]   2> ASYNC  NEW_CORE C261 name=00002_core org.apache.solr.core.SolrCore@6049c9
[junit4:junit4]   2> 3506 T4216 C261 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4]   2> 		commit{dir=MockDirWrapper(org.apache.lucene.store.SimpleFSDirectory@/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/OpenCloseCoreStressTest_/00002_core/data/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@a98ddd),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 3507 T4216 C261 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4]   2> 3509 T4221 C245 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4]   2> 		commit{dir=MockDirWrapper(org.apache.lucene.store.SimpleFSDirectory@/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/OpenCloseCoreStressTest_/00008_core/data/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@4d8524c9),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 		commit{dir=MockDirWrapper(org.apache.lucene.store.SimpleFSDirectory@/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/OpenCloseCoreStressTest_/00008_core/data/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@4d8524c9),segFN=segments_2,generation=2,filenames=[_1_MockFixedIntBlock_0.pyl, _0_MockFixedIntBlock_0.tib, _2_MockFixedIntBlock_0.tii, _1.fnm, _1_MockRandom_0.pos, _2_MockFixedIntBlock_0.tib, _2_MockFixedIntBlock_0.pyl, _0_MockFixedIntBlock_0.tii, _2_MockFixedIntBlock_0.frq, _1.nvm, _0.fnm, _1_MockFixedIntBlock_0.frq, _1_MockRandom_0.tip, _1.nvd, _2.fdt, _0_MockFixedIntBlock_0.pos, _1_MockRandom_0.sd, _1_MockRandom_0.tim, _2.fdx, _1.fdx, _2.nvm, _1_MockFixedIntBlock_0.skp, _1.fdt, _2_MockFixedIntBlock_0.pos, _0_MockRandom_0.doc, _0_MockRandom_0.pos, _2.nvd, _1_MockRandom_0.doc, _2_MockFixedIntBlock_0.doc, _1_MockFixedIntBlock_0.pos, _2.si, _2_MockRandom_0.tip, _1_MockFixedIntBlock_0.doc, _2_MockRandom_0.tim, _2_MockFixedIntBlock_0.skp, _0_MockFixedIntBlock_0.pyl, _0_MockFixedIntBlock_0.skp, _0.nvd, _2_MockRandom_0.pos, _0.si, _0_MockRandom_0.tib, _1_MockFixedIntBlock_0.tii, _0.nvm, _2.fnm, _0_MockFixedIntBlock_0.frq, _2_MockRandom_0.sd, _0_MockRandom_0.sd, _0_MockRandom_0.tiv, _0_MockFixedIntBlock_0.doc, _1.si, _1_MockFixedIntBlock_0.tib, segments_2, _0.fdx, _2_MockRandom_0.doc, _0.fdt]
[junit4:junit4]   2> 3509 T4221 C245 oasc.SolrDeletionPolicy.updateCommits newest commit = 2[_1_MockFixedIntBlock_0.pyl, _0_MockFixedIntBlock_0.tib, _2_MockFixedIntBlock_0.tii, _1.fnm, _1_MockRandom_0.pos, _2_MockFixedIntBlock_0.tib, _2_MockFixedIntBlock_0.pyl, _0_MockFixedIntBlock_0.tii, _2_MockFixedIntBlock_0.frq, _1.nvm, _0.fnm, _1_MockFixedIntBlock_0.frq, _1_MockRandom_0.tip, _1.nvd, _2.fdt, _0_MockFixedIntBlock_0.pos, _1_MockRandom_0.sd, _1_MockRandom_0.tim, _2.fdx, _1.fdx, _2.nvm, _1_MockFixedIntBlock_0.skp, _1.fdt, _2_MockFixedIntBlock_0.pos, _0_MockRandom_0.doc, _0_MockRandom_0.pos, _2.nvd, _1_MockRandom_0.doc, _2_MockFixedIntBlock_0.doc, _1_MockFixedIntBlock_0.pos, _2.si, _2_MockRandom_0.tip, _1_MockFixedIntBlock_0.doc, _2_MockRandom_0.tim, _2_MockFixedIntBlock_0.skp, _0_MockFixedIntBlock_0.pyl, _0_MockFixedIntBlock_0.skp, _0.nvd, _2_MockRandom_0.pos, _0.si, _0_MockRandom_0.tib, _1_MockFixedIntBlock_0.tii, _0.nvm, _2.fnm, _0_MockFixedIntBlock_0.frq, _2_MockRandom_0.sd, _0_MockRandom_0.sd, _0_MockRandom_0.tiv, _0_MockFixedIntBlock_0.doc, _1.si, _1_MockFixedIntBlock_0.tib, segments_2, _0.fdx, _2_MockRandom_0.doc, _0.fdt]
[junit4:junit4]   2> 3511 T4216 C261 UPDATE [00002_core] webapp=/solr path=/update params={wt=javabin&version=2} {add=[id49]} 0 29
[junit4:junit4]   2> 3515 T4215 C261 UPDATE [00002_core] webapp=/solr path=/update params={wt=javabin&version=2} {add=[id51]} 0 1
[junit4:junit4]   2> 3517 T4221 oasc.SolrCore.closeSearcher [00008_core] Closing main searcher on request.
[junit4:junit4]   2> 3517 T4221 oasc.CachingDirectoryFactory.close Closing directory when closing factory: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/OpenCloseCoreStressTest_/00008_core/data/index
[junit4:junit4]   2> 3518 T4221 oasc.CachingDirectoryFactory.closeDirectory Closing directory: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/OpenCloseCoreStressTest_/00008_core/data/index
[junit4:junit4]   2> 3522 T4260 C261 UPDATE [00002_core] webapp=/solr path=/update params={wt=javabin&version=2} {add=[id53]} 0 1
[junit4:junit4]   2> 3523 T4278 C261 UPDATE [00002_core] webapp=/solr path=/update params={wt=javabin&version=2} {add=[id17]} 0 1
[junit4:junit4]   2> 3542 T4262 C250 UPDATE [00003_core] webapp=/solr path=/update params={wt=javabin&version=2} {add=[id55]} 0 12
[junit4:junit4]   2> 3548 T4215 C253 UPDATE [00016_core] webapp=/solr path=/update params={wt=javabin&version=2} {add=[id56]} 0 1
[junit4:junit4]   2> 3549 T4250 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4]   2> 		commit{dir=MockDirWrapper(org.apache.lucene.store.SimpleFSDirectory@/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/OpenCloseCoreStressTest_/00019_core/data/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@4deda16b),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 3550 T4250 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4]   2> 3551 T4250 oasc.SolrCore.initWriters created json: solr.JSONResponseWriter
[junit4:junit4]   2> 3555 T4250 oasc.RequestHandlers.initHandlersFromConfig created /admin/: solr.admin.AdminHandlers
[junit4:junit4]   2> 3564 T4260 C255 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4]   2> 		commit{dir=MockDirWrapper(org.apache.lucene.store.SimpleFSDirectory@/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/OpenCloseCoreStressTest_/00005_core/data/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@32d19333),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 3566 T4260 C255 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4]   2> 3570 T4260 C255 UPDATE [00005_core] webapp=/solr path=/update params={wt=javabin&version=2} {add=[id57]} 0 15
[junit4:junit4]   2> 3572 T4250 oasc.RequestHandlers.initHandlersFromConfig created /select: solr.SearchHandler
[junit4:junit4]   2> 3577 T4250 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4]   2> 3582 T4215 C250 UPDATE [00003_core] webapp=/solr path=/update params={wt=javabin&version=2} {add=[id58]} 0 0
[junit4:junit4]   2> 3583 T4262 C251 REQ [00018_core] webapp=/solr path=/select params={q=*:*&wt=javabin&qt=/select&version=2} hits=0 status=0 QTime=0 
[junit4:junit4]   2> 3587 T4250 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4]   2> 3600 T4250 oass.SolrIndexSearcher.<init> Opening Searcher@72285c4 main
[junit4:junit4]   2> 3601 T4250 oasc.SolrCore.registerSearcher [00019_core] Registered new searcher Searcher@72285c4 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   2> 3602 T4250 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4]   2> 3602 T4250 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4]   2> 3611 T4250 oasc.CoreMaps.putTransientCore Opening transient core 00019_core
[junit4:junit4]   2> 3612 T4250 oasc.CoreContainer.registerCore registering core: 00019_core
[junit4:junit4]   2> 3621 T4253 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig-minimal.xml
[junit4:junit4]   2> ASYNC  NEW_CORE C262 name=00019_core org.apache.solr.core.SolrCore@bb5f22c
[junit4:junit4]   2> 3621 T4250 C262 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4]   2> 		commit{dir=MockDirWrapper(org.apache.lucene.store.SimpleFSDirectory@/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/OpenCloseCoreStressTest_/00019_core/data/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@4deda16b),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 3621 T4253 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4]   2> 3622 T4250 C262 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4]   2> 3627 T4255 C262 UPDATE [00019_core] webapp=/solr path=/update params={wt=javabin&version=2} {add=[id38]} 0 5
[junit4:junit4]   2> 3627 T4250 C262 UPDATE [00019_core] webapp=/solr path=/update params={wt=javabin&version=2} {add=[id20]} 0 9
[junit4:junit4]   2> 3634 T4253 oass.IndexSchema.readSchema Schema name=tiny
[junit4:junit4]   2> 3641 T4262 C254 UPDATE [00004_core] webapp=/solr path=/update params={wt=javabin&version=2} {add=[id61]} 0 0
[junit4:junit4]   2> 3646 T4255 C259 UPDATE [00013_core] webapp=/solr path=/update params={wt=javabin&version=2} {add=[id62]} 0 0
[junit4:junit4]   2> 3662 T4250 C259 UPDATE [00013_core] webapp=/solr path=/update params={wt=javabin&version=2} {add=[id63]} 0 5
[junit4:junit4]   2> 3687 T4253 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> 3689 T4255 C254 REQ [00004_core] webapp=/solr path=/select params={q=*:*&wt=javabin&qt=/select&version=2} hits=0 status=0 QTime=0 
[junit4:junit4]   2> 3690 T4253 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockFSDirectoryFactory
[junit4:junit4]   2> 3691 T4253 oasc.SolrCore.<init> [00017_core] Opening new SolrCore at /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./OpenCloseCoreStressTest_/00017_core/, dataDir=/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/OpenCloseCoreStressTest_/00017_core/data/
[junit4:junit4]   2> 3691 T4253 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@298925ae
[junit4:junit4]   2> 3692 T4221 oasc.CachingDirectoryFactory.close Closing directory when closing factory: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/OpenCloseCoreStressTest_/00008_core/data
[junit4:junit4]   2> 3692 T4253 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockFSDirectoryFactory
[junit4:junit4]   2> 3692 T4221 oasc.CachingDirectoryFactory.closeDirectory Closing directory: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/OpenCloseCoreStressTest_/00008_core/data
[junit4:junit4]   2> 3694 T4253 oasc.CachingDirectoryFactory.get return new directory for /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/OpenCloseCoreStressTest_/00017_core/data forceNew: false
[junit4:junit4]   2> 3694 T4215 oasc.CoreContainer.create Creating SolrCore '00008_core' using instanceDir: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./OpenCloseCoreStressTest_/00008_core
[junit4:junit4]   2> 3694 T4253 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/OpenCloseCoreStressTest_/00017_core/data/index/
[junit4:junit4]   2> 3695 T4215 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./OpenCloseCoreStressTest_/00008_core/'
[junit4:junit4]   2> 3694 T4221 oasc.SolrCore.close [00015_core]  CLOSING SolrCore org.apache.solr.core.SolrCore@6369998a
[junit4:junit4]   2> 3701 T4221 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=0,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=1,adds=1,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=1,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0}
[junit4:junit4]   2> 3702 T4221 oasu.SolrCoreState.decrefSolrCoreState Closing SolrCoreState
[junit4:junit4]   2> 3703 T4221 oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has reached 0 - closing IndexWriter
[junit4:junit4]   2> 3704 T4221 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser
[junit4:junit4]   2> 3695 T4253 oasc.SolrCore.initIndex WARNING [00017_core] Solr index directory '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/OpenCloseCoreStressTest_/00017_core/data/index' doesn't exist. Creating new index...
[junit4:junit4]   2> 3709 T4253 oasc.CachingDirectoryFactory.get return new directory for /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/OpenCloseCoreStressTest_/00017_core/data/index forceNew: false
[junit4:junit4]   2> 3725 T4253 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4]   2> 		commit{dir=MockDirWrapper(org.apache.lucene.store.MMapDirectory@/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/OpenCloseCoreStressTest_/00017_core/data/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@615f93cc),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 3726 T4253 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4]   2> 3735 T4253 oasc.SolrCore.initWriters created json: solr.JSONResponseWriter
[junit4:junit4]   2> 3738 T4253 oasc.RequestHandlers.initHandlersFromConfig created /admin/: solr.admin.AdminHandlers
[junit4:junit4]   2> 3739 T4253 oasc.RequestHandlers.initHandlersFromConfig created /select: solr.SearchHandler
[junit4:junit4]   2> 3739 T4253 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4]   2> 3751 T4253 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4]   2> 3758 T4253 oass.SolrIndexSearcher.<init> Opening Searcher@68912a86 main
[junit4:junit4]   2> 3760 T4253 oasc.SolrCore.registerSearcher [00017_core] Registered new searcher Searcher@68912a86 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   2> 3760 T4253 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4]   2> 3761 T4253 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4]   2> 3773 T4221 C246 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4]   2> 		commit{dir=MockDirWrapper(org.apache.lucene.store.SimpleFSDirectory@/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/OpenCloseCoreStressTest_/00015_core/data/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@42b01efc),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 		commit{dir=MockDirWrapper(org.apache.lucene.store.SimpleFSDirectory@/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/OpenCloseCoreStressTest_/00015_core/data/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@42b01efc),segFN=segments_2,generation=2,filenames=[_0.fnm, _0_MockFixedIntBlock_0.pos, _0.nvm, _0_MockFixedIntBlock_0.tib, _0_MockRandom_0.skp, _0_MockFixedIntBlock_0.frq, _0_MockRandom_0.sd, _0_MockRandom_0.frq, _0_MockRandom_0.tip, _0_MockFixedIntBlock_0.skp, _0_MockFixedIntBlock_0.pyl, _0_MockFixedIntBlock_0.doc, _0_MockRandom_0.doc, _0_MockFixedIntBlock_0.tii, _0_MockRandom_0.pos, _0.nvd, segments_2, _0.fdx, _0.si, _0_MockRandom_0.pyl, _0_MockRandom_0.tim, _0.fdt]
[junit4:junit4]   2> 3777 T4221 C246 oasc.SolrDeletionPolicy.updateCommits newest commit = 2[_0.fnm, _0_MockFixedIntBlock_0.pos, _0.nvm, _0_MockFixedIntBlock_0.tib, _0_MockRandom_0.skp, _0_MockFixedIntBlock_0.frq, _0_MockRandom_0.sd, _0_MockRandom_0.frq, _0_MockRandom_0.tip, _0_MockFixedIntBlock_0.skp, _0_MockFixedIntBlock_0.pyl, _0_MockFixedIntBlock_0.doc, _0_MockRandom_0.doc, _0_MockFixedIntBlock_0.tii, _0_MockRandom_0.pos, _0.nvd, segments_2, _0.fdx, _0.si, _0_MockRandom_0.pyl, _0_MockRandom_0.tim, _0.fdt]
[junit4:junit4]   2> 3786 T4215 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_41
[junit4:junit4]   2> 3791 T4253 oasc.CoreMaps.putTransientCore Opening transient core 00017_core
[junit4:junit4]   2> 3795 T4221 oasc.SolrCore.closeSearcher [00015_core] Closing main searcher on request.
[junit4:junit4]   2> 3796 T4221 oasc.CachingDirectoryFactory.close Closing directory when closing factory: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/OpenCloseCoreStressTest_/00015_core/data
[junit4:junit4]   2> 3796 T4221 oasc.CachingDirectoryFactory.closeDirectory Closing directory: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/OpenCloseCoreStressTest_/00015_core/data
[junit4:junit4]   2> 3797 T4221 oasc.CachingDirectoryFactory.close Closing directory when closing factory: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/OpenCloseCoreStressTest_/00015_core/data/index
[junit4:junit4]   2> 3797 T4221 oasc.CachingDirectoryFactory.closeDirectory Closing directory: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/OpenCloseCoreStressTest_/00015_core/data/index
[junit4:junit4]   2> 3803 T4253 oasc.CoreContainer.registerCore registering core: 00017_core
[junit4:junit4]   2> ASYNC  NEW_CORE C263 name=00017_core org.apache.solr.core.SolrCore@19603e49
[junit4:junit4]   2> 3830 T4253 C263 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4]   2> 		commit{dir=MockDirWrapper(org.apache.lucene.store.MMapDirectory@/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/OpenCloseCoreStressTest_/00017_core/data/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@615f93cc),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 3831 T4253 C263 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4]   2> 3835 T4253 C263 UPDATE [00017_core] webapp=/solr path=/update params={wt=javabin&version=2} {add=[id31]} 0 10
[junit4:junit4]   2> 3836 T4270 C263 REQ [00017_core] webapp=/solr path=/select params={q=*:*&wt=javabin&qt=/select&version=2} hits=0 status=0 QTime=0 
[junit4:junit4]   2> 3839 T4218 C263 REQ [00017_core] webapp=/solr path=/select params={q=*:*&wt=javabin&qt=/select&version=2} hits=0 status=0 QTime=0 
[junit4:junit4]   2> 3875 T4221 oasc.SolrCore.close [00000_core]  CLOSING SolrCore org.apache.solr.core.SolrCore@5d94346d
[junit4:junit4]   2> 3882 T4221 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=0,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=1,adds=1,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=1,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0}
[junit4:junit4]   2> 3882 T4221 oasu.SolrCoreState.decrefSolrCoreState Closing SolrCoreState
[junit4:junit4]   2> 3883 T4256 oasc.CoreContainer.create Creating SolrCore '00015_core' using instanceDir: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./OpenCloseCoreStressTest_/00015_core
[junit4:junit4]   2> 3884 T4256 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./OpenCloseCoreStressTest_/00015_core/'
[junit4:junit4]   2> 3883 T4221 oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has reached 0 - closing IndexWriter
[junit4:junit4]   2> 3887 T4221 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser
[junit4:junit4]   2> 3913 T4215 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig-minimal.xml
[junit4:junit4]   2> 3914 T4215 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4]   2> 3918 T4215 oass.IndexSchema.readSchema Schema name=tiny
[junit4:junit4]   2> 3947 T4218 C254 REQ [00004_core] webapp=/solr path=/select params={q=*:*&wt=javabin&qt=/select&version=2} hits=0 status=0 QTime=1 
[junit4:junit4]   2> 3962 T4256 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_41
[junit4:junit4]   2> 3969 T4215 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> 3971 T4215 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockFSDirectoryFactory
[junit4:junit4]   2> 3973 T4215 oasc.SolrCore.<init> [00008_core] Opening new SolrCore at /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./OpenCloseCoreStressTest_/00008_core/, dataDir=/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/OpenCloseCoreStressTest_/00008_core/data/
[junit4:junit4]   2> 3973 T4215 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@298925ae
[junit4:junit4]   2> 3986 T4215 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockFSDirectoryFactory
[junit4:junit4]   2> 3987 T4215 oasc.CachingDirectoryFactory.get return new directory for /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/OpenCloseCoreStressTest_/00008_core/data forceNew: false
[junit4:junit4]   2> 3987 T4215 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/OpenCloseCoreStressTest_/00008_core/data/index/
[junit4:junit4]   2> 3989 T4215 oasc.SolrCore.initWriters created json: solr.JSONResponseWriter
[junit4:junit4]   2> 3991 T4215 oasc.RequestHandlers.initHandlersFromConfig created /admin/: solr.admin.AdminHandlers
[junit4:junit4]   2> 3992 T4215 oasc.RequestHandlers.initHandlersFromConfig created /select: solr.SearchHandler
[junit4:junit4]   2> 3993 T4215 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4]   2> 4004 T4215 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4]   2> 4044 T4215 oasc.CachingDirectoryFactory.get return new directory for /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/OpenCloseCoreStressTest_/00008_core/data/index forceNew: false
[junit4:junit4]   2> 4054 T4221 C247 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4]   2> 		commit{dir=MockDirWrapper(org.apache.lucene.store.SimpleFSDirectory@/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/OpenCloseCoreStressTest_/00000_core/data/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@eee92bd),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 		commit{dir=MockDirWrapper(org.apache.lucene.store.SimpleFSDirectory@/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/OpenCloseCoreStressTest_/00000_core/data/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@eee92bd),segFN=segments_2,generation=2,filenames=[_0.fnm, _0_MockFixedIntBlock_0.pos, _0.nvm, _0_MockFixedIntBlock_0.tib, _0_MockFixedIntBlock_0.frq, _0_MockRandom_0.sd, _0_MockRandom_0.tip, _0_MockFixedIntBlock_0.pyl, _0_MockFixedIntBlock_0.skp, _0_MockFixedIntBlock_0.doc, _0_MockFixedIntBlock_0.tii, _0_MockRandom_0.doc, _0_MockRandom_0.pos, _0.nvd, segments_2, _0.fdx, _0.si, _0_MockRandom_0.tim, _0.fdt]
[junit4:junit4]   2> 4055 T4221 C247 oasc.SolrDeletionPolicy.updateCommits newest commit = 2[_0.fnm, _0_MockFixedIntBlock_0.pos, _0.nvm, _0_MockFixedIntBlock_0.tib, _0_MockFixedIntBlock_0.frq, _0_MockRandom_0.sd, _0_MockRandom_0.tip, _0_MockFixedIntBlock_0.pyl, _0_MockFixedIntBlock_0.skp, _0_MockFixedIntBlock_0.doc, _0_MockFixedIntBlock_0.tii, _0_MockRandom_0.doc, _0_MockRandom_0.pos, _0.nvd, segments_2, _0.fdx, _0.si, _0_MockRandom_0.tim, _0.fdt]
[junit4:junit4]   2> 4057 T4256 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig-minimal.xml
[junit4:junit4]   2> 4058 T4256 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4]   2> 4062 T4221 oasc.SolrCore.closeSearcher [00000_core] Closing main searcher on request.
[junit4:junit4]   2> 4063 T4221 oasc.CachingDirectoryFactory.close Closing directory when closing factory: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/OpenCloseCoreStressTest_/00000_core/data
[junit4:junit4]   2> 4063 T4221 oasc.CachingDirectoryFactory.closeDirectory Closing directory: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/OpenCloseCoreStressTest_/00000_core/data
[junit4:junit4]   2> 4065 T4221 oasc.CachingDirectoryFactory.close Closing directory when closing factory: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/OpenCloseCoreStressTest_/00000_core/data/index
[junit4:junit4]   2> 4065 T4221 oasc.CachingDirectoryFactory.closeDirectory Closing directory: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/OpenCloseCoreStressTest_/00000_core/data/index
[junit4:junit4]   2> 4084 T4256 oass.IndexSchema.readSchema Schema name=tiny
[junit4:junit4]   2> 4104 T4221 oasc.SolrCore.close [00010_core]  CLOSING SolrCore org.apache.solr.core.SolrCore@bb04b91
[junit4:junit4]   2> 4109 T4264 oasc.CoreContainer.create Creating SolrCore '00000_core' using instanceDir: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./OpenCloseCoreStressTest_/00000_core
[junit4:junit4]   2> 4110 T4264 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./OpenCloseCoreStressTest_/00000_core/'
[junit4:junit4]   2> 4122 T4256 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> 4123 T4221 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=0,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=1,adds=1,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=1,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0}
[junit4:junit4]   2> 4123 T4221 oasu.SolrCoreState.decrefSolrCoreState Closing SolrCoreState
[junit4:junit4]   2> 4123 T4221 oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has reached 0 - closing IndexWriter
[junit4:junit4]   2> 4124 T4221 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser
[junit4:junit4]   2> 4125 T4256 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockFSDirectoryFactory
[junit4:junit4]   2> 4127 T4256 oasc.SolrCore.<init> [00015_core] Opening new SolrCore at /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./OpenCloseCoreStressTest_/00015_core/, dataDir=/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/OpenCloseCoreStressTest_/00015_core/data/
[junit4:junit4]   2> 4128 T4256 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@298925ae
[junit4:junit4]   2> 4128 T4256 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockFSDirectoryFactory
[junit4:junit4]   2> 4139 T4256 oasc.CachingDirectoryFactory.get return new directory for /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/OpenCloseCoreStressTest_/00015_core/data forceNew: false
[junit4:junit4]   2> 4140 T4256 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/OpenCloseCoreStressTest_/00015_core/data/index/
[junit4:junit4]   2> 4141 T4256 oasc.SolrCore.initWriters created json: solr.JSONResponseWriter
[junit4:junit4]   2> 4143 T4256 oasc.RequestHandlers.initHandlersFromConfig created /admin/: solr.admin.AdminHandlers
[junit4:junit4]   2> 4144 T4256 oasc.RequestHandlers.initHandlersFromConfig created /select: solr.SearchHandler
[junit4:junit4]   2> 4145 T4256 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4]   2> 4185 T4215 oass.SolrIndexSearcher.<init> Opening Searcher@1bd86aba main
[junit4:junit4]   2> 4189 T4215 oasc.SolrCore.registerSearcher [00008_core] Registered new searcher Searcher@1bd86aba main{StandardDirectoryReader(segments_2:7 _0(5.0):C2 _2(5.0):C1 _1(5.0):C1)}
[junit4:junit4]   2> 4189 T4215 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4]   2> 4190 T4215 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4]   2> 4195 T4215 oasc.CoreMaps.putTransientCore Opening transient core 00008_core
[junit4:junit4]   2> 4196 T4215 oasc.CoreContainer.registerCore registering core: 00008_core
[junit4:junit4]   2> ASYNC  NEW_CORE C264 name=00008_core org.apache.solr.core.SolrCore@d921631
[junit4:junit4]   2> 4208 T4273 C264 REQ [00008_core] webapp=/solr path=/select params={q=*:*&wt=javabin&qt=/select&version=2} hits=4 status=0 QTime=1 
[junit4:junit4]   2> 4193 T4256 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4]   2> 4220 T4264 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_41
[junit4:junit4]   2> 4223 T4219 C264 REQ [00008_core] webapp=/solr path=/select params={q=*:*&wt=javabin&qt=/select&version=2} hits=4 status=0 QTime=0 
[junit4:junit4]   2> 4250 T4256 oasc.CachingDirectoryFactory.get return new directory for /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/OpenCloseCoreStressTest_/00015_core/data/index forceNew: false
[junit4:junit4]   2> 4281 T4215 C264 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4]   2> 		commit{dir=MockDirWrapper(org.apache.lucene.store.MMapDirectory@/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/OpenCloseCoreStressTest_/00008_core/data/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@42954b7c),segFN=segments_2,generation=2,filenames=[_1_MockFixedIntBlock_0.pyl, _0_MockFixedIntBlock_0.tib, _2_MockFixedIntBlock_0.tii, _1.fnm, _1_MockRandom_0.pos, _2_MockFixedIntBlock_0.tib, _2_MockFixedIntBlock_0.pyl, _0_MockFixedIntBlock_0.tii, _2_MockFixedIntBlock_0.frq, _1.nvm, _0.fnm, _1_MockFixedIntBlock_0.frq, _1_MockRandom_0.tip, _1.nvd, _2.fdt, _0_MockFixedIntBlock_0.pos, _1_MockRandom_0.sd, _1_MockRandom_0.tim, _2.fdx, _1.fdx, _2.nvm, _1_MockFixedIntBlock_0.skp, _1.fdt, _2_MockFixedIntBlock_0.pos, _0_MockRandom_0.doc, _0_MockRandom_0.pos, _2.nvd, _1_MockRandom_0.doc, _2_MockFixedIntBlock_0.doc, _1_MockFixedIntBlock_0.pos, _2.si, _2_MockRandom_0.tip, _1_MockFixedIntBlock_0.doc, _2_MockRandom_0.tim, _2_MockFixedIntBlock_0.skp, _0_MockFixedIntBlock_0.pyl, _0_MockFixedIntBlock_0.skp, _0.nvd, _2_MockRandom_0.pos, _0.si, _0_MockRandom_0.tib, _1_MockFixedIntBlock_0.tii, _0.nvm, _2.fnm, _0_MockFixedIntBlock_0.frq, _2_MockRandom_0.sd, _0_MockRandom_0.sd, _0_MockRandom_0.tiv, _0_MockFixedIntBlock_0.doc, _1.si, _1_MockFixedIntBlock_0.tib, segments_2, _0.fdx, _2_MockRandom_0.doc, _0.fdt]
[junit4:junit4]   2> 4282 T4215 C264 oasc.SolrDeletionPolicy.updateCommits newest commit = 2[_1_MockFixedIntBlock_0.pyl, _0_MockFixedIntBlock_0.tib, _2_MockFixedIntBlock_0.tii, _1.fnm, _1_MockRandom_0.pos, _2_MockFixedIntBlock_0.tib, _2_MockFixedIntBlock_0.pyl, _0_MockFixedIntBlock_0.tii, _2_MockFixedIntBlock_0.frq, _1.nvm, _0.fnm, _1_MockFixedIntBlock_0.frq, _1_MockRandom_0.tip, _1.nvd, _2.fdt, _0_MockFixedIntBlock_0.pos, _1_MockRandom_0.sd, _1_MockRandom_0.tim, _2.fdx, _1.fdx, _2.nvm, _1_MockFixedIntBlock_0.skp, _1.fdt, _2_MockFixedIntBlock_0.pos, _0_MockRandom_0.doc, _0_MockRandom_0.pos, _2.nvd, _1_MockRandom_0.doc, _2_MockFixedIntBlock_0.doc, _1_MockFixedIntBlock_0.pos, _2.si, _2_MockRandom_0.tip, _1_MockFixedIntBlock_0.doc, _2_MockRandom_0.tim, _2_MockFixedIntBlock_0.skp, _0_MockFixedIntBlock_0.pyl, _0_MockFixedIntBlock_0.skp, _0.nvd, _2_MockRandom_0.pos, _0.si, _0_MockRandom_0.tib, _1_MockFixedIntBlock_0.tii, _0.nvm, _2.fnm, _0_MockFixedIntBlock_0.frq, _2_MockRandom_0.sd, _0_MockRandom_0.sd, _0_MockRandom_0.tiv, _0_MockFixedIntBlock_0.doc, _1.si, _1_MockFixedIntBlock_0.tib, segments_2, _0.fdx, _2_MockRandom_0.doc, _0.fdt]
[junit4:junit4]   2> 4290 T4266 C264 UPDATE [00008_core] webapp=/solr path=/update params={wt=javabin&version=2} {add=[id48]} 0 67
[junit4:junit4]   2> 4294 T4268 C264 UPDATE [00008_core] webapp=/solr path=/update params={wt=javabin&version=2} {add=[id40]} 0 68
[junit4:junit4]   2> 4294 T4217 C264 UPDATE [00008_core] webapp=/solr path=/update params={wt=javabin&version=2} {add=[id42]} 0 68
[junit4:junit4]   2> 4301 T4256 oass.SolrIndexSearcher.<init> Opening Searcher@69424db4 main
[junit4:junit4]   2> 4302 T4256 oasc.SolrCore.registerSearcher [00015_core] Registered new searcher Searcher@69424db4 main{StandardDirectoryReader(segments_2:3 _0(5.0):C1)}
[junit4:junit4]   2> 4303 T4256 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4]   2> 4303 T4256 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4]   2> 4307 T4218 C255 UPDATE [00005_core] webapp=/solr path=/update params={wt=javabin&version=2} {add=[id66]} 0 11
[junit4:junit4]   2> 4312 T4219 C251 UPDATE [00018_core] webapp=/solr path=/update params={wt=javabin&version=2} {add=[id69]} 0 0
[junit4:junit4]   2> 4313 T4215 C264 UPDATE [00008_core] webapp=/solr path=/update params={wt=javabin&version=2} {add=[id60]} 0 102
[junit4:junit4]   2> 4315 T4256 oasc.CoreMaps.putTransientCore Opening transient core 00015_core
[junit4:junit4]   2> 4316 T4256 oasc.CoreContainer.registerCore registering core: 00015_core
[junit4:junit4]   2> 4322 T4268 C250 REQ [00003_core] webapp=/solr path=/select params={q=*:*&wt=javabin&qt=/select&version=2} hits=0 status=0 QTime=1 
[junit4:junit4]   2> 4402 T4268 C262 UPDATE [00019_core] webapp=/solr path=/update params={wt=javabin&version=2} {add=[id71]} 0 1
[junit4:junit4]   2> ASYNC  NEW_CORE C265 name=00015_core org.apache.solr.core.SolrCore@5fcd149a
[junit4:junit4]   2> 4412 T4275 C265 REQ [00015_core] webapp=/solr path=/select params={q=*:*&wt=javabin&qt=/select&version=2} hits=1 status=0 QTime=0 
[junit4:junit4]   2> 4412 T4219 C253 UPDATE [00016_core] webapp=/solr path=/update params={wt=javabin&version=2} {add=[id72]} 0 0
[junit4:junit4]   2> 4423 T4264 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig-minimal.xml
[junit4:junit4]   2> 4423 T4264 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4]   2> 4425 T4267 C265 REQ [00015_core] webapp=/solr path=/select params={q=*:*&wt=javabin&qt=/select&version=2} hits=1 status=0 QTime=0 
[junit4:junit4]   2> 4433 T4221 C252 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4]   2> 		commit{dir=MockDirWrapper(org.apache.lucene.store.SimpleFSDirectory@/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/OpenCloseCoreStressTest_/00010_core/data/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@458ee7c4),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 		commit{dir=MockDirWrapper(org.apache.lucene.store.SimpleFSDirectory@/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/OpenCloseCoreStressTest_/00010_core/data/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@458ee7c4),segFN=segments_2,generation=2,filenames=[_0.fnm, _0_MockFixedIntBlock_0.pos, _0.nvm, _0_MockFixedIntBlock_0.tib, _0_MockFixedIntBlock_0.frq, _0_MockRandom_0.sd, _0_MockRandom_0.tip, _0_MockFixedIntBlock_0.pyl, _0_MockFixedIntBlock_0.skp, _0_MockFixedIntBlock_0.doc, _0_MockFixedIntBlock_0.tii, _0_MockRandom_0.doc, _0_MockRandom_0.pos, _0.nvd, segments_2, _0.fdx, _0.si, _0_MockRandom_0.tim, _0.fdt]
[junit4:junit4]   2> 4434 T4221 C252 oasc.SolrDeletionPolicy.updateCommits newest commit = 2[_0.fnm, _0_MockFixedIntBlock_0.pos, _0.nvm, _0_MockFixedIntBlock_0.tib, _0_MockFixedIntBlock_0.frq, _0_MockRandom_0.sd, _0_MockRandom_0.tip, _0_MockFixedIntBlock_0.pyl, _0_MockFixedIntBlock_0.skp, _0_MockFixedIntBlock_0.doc, _0_MockFixedIntBlock_0.tii, _0_MockRandom_0.doc, _0_MockRandom_0.pos, _0.nvd, segments_2, _0.fdx, _0.si, _0_MockRandom_0.tim, _0.fdt]
[junit4:junit4]   2> 4437 T4264 oass.IndexSchema.readSchema Schema name=tiny
[junit4:junit4]   2> 4447 T4217 C265 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4]   2> 		commit{dir=MockDirWrapper(org.apache.lucene.store.MMapDirectory@/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/OpenCloseCoreStressTest_/00015_core/data/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@47f1aaec),segFN=segments_2,generation=2,filenames=[_0.fnm, _0_MockFixedIntBlock_0.pos, _0.nvm, _0_MockFixedIntBlock_0.tib, _0_MockRandom_0.skp, _0_MockFixedIntBlock_0.frq, _0_MockRandom_0.sd, _0_MockRandom_0.frq, _0_MockRandom_0.tip, _0_MockFixedIntBlock_0.skp, _0_MockFixedIntBlock_0.pyl, _0_MockFixedIntBlock_0.tii, _0_MockRandom_0.doc, _0_MockFixedIntBlock_0.doc, _0.nvd, _0_MockRandom_0.pos, segments_2, _0.fdx, _0_MockRandom_0.pyl, _0.si, _0_MockRandom_0.tim, _0.fdt]
[junit4:junit4]   2> 4448 T4217 C265 oasc.SolrDeletionPolicy.updateCommits newest commit = 2[_0.fnm, _0_MockFixedIntBlock_0.pos, _0.nvm, _0_MockFixedIntBlock_0.tib, _0_MockRandom_0.skp, _0_MockFixedIntBlock_0.frq, _0_MockRandom_0.sd, _0_MockRandom_0.frq, _0_MockRandom_0.tip, _0_MockFixedIntBlock_0.skp, _0_MockFixedIntBlock_0.pyl, _0_MockFixedIntBlock_0.tii, _0_MockRandom_0.doc, _0_MockFixedIntBlock_0.doc, _0.nvd, _0_MockRandom_0.pos, segments_2, _0.fdx, _0_MockRandom_0.pyl, _0.si, _0_MockRandom_0.tim, _0.fdt]
[junit4:junit4]   2> 4449 T4221 oasc.SolrCore.closeSearcher [00010_core] Closing main searcher on request.
[junit4:junit4]   2> 4450 T4221 oasc.CachingDirectoryFactory.close Closing directory when closing factory: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/OpenCloseCoreStressTest_/00010_core/data/index
[junit4:junit4]   2> 4450 T4221 oasc.CachingDirectoryFactory.closeDirectory Closing directory: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/OpenCloseCoreStressTest_/00010_core/data/index
[junit4:junit4]   2> 4454 T4217 C265 UPDATE [00015_core] webapp=/solr path=/update params={wt=javabin&version=2} {add=[id70]} 0 45
[junit4:junit4]   2> 4466 T4265 C265 UPDATE [00015_core] webapp=/solr path=/update params={wt=javabin&version=2} {add=[id50]} 0 37
[junit4:junit4]   2> 4467 T4256 C265 UPDATE [00015_core] webapp=/solr path=/update params={wt=javabin&version=2} {add=[id54]} 0 23
[junit4:junit4]   2> 4467 T4220 C265 UPDATE [00015_core] webapp=/solr path=/update params={wt=javabin&version=2} {add=[id34]} 0 55
[junit4:junit4]   2> 4472 T4266 C264 UPDATE [00008_core] webapp=/solr path=/update params={wt=javabin&version=2} {add=[id76]} 0 1
[junit4:junit4]   2> 4495 T4264 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> 4507 T4219 C250 REQ [00003_core] webapp=/solr path=/select params={q=*:*&wt=javabin&qt=/select&version=2} hits=0 status=0 QTime=0 
[junit4:junit4]   2> 4507 T4264 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockFSDirectoryFactory
[junit4:junit4]   2> 4510 T4264 oasc.SolrCore.<init> [00000_core] Opening new SolrCore at /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./OpenCloseCoreStressTest_/00000_core/, dataDir=/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/OpenCloseCoreStressTest_/00000_core/data/
[junit4:junit4]   2> 4511 T4264 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@298925ae
[junit4:junit4]   2> 4512 T4264 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockFSDirectoryFactory
[junit4:junit4]   2> 4514 T4264 oasc.CachingDirectoryFactory.get return new directory for /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/OpenCloseCoreStressTest_/00000_core/data forceNew: false
[junit4:junit4]   2> 4515 T4264 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/OpenCloseCoreStressTest_/00000_core/data/index/
[junit4:junit4]   2> 4517 T4264 oasc.SolrCore.initWriters created json: solr.JSONResponseWriter
[junit4:junit4]   2> 4520 T4220 C251 REQ [00018_core] webapp=/solr path=/select params={q=*:*&wt=javabin&qt=/select&version=2} hits=0 status=0 QTime=1 
[junit4:junit4]   2> 4523 T4221 oasc.CachingDirectoryFactory.close Closing directory when closing factory: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/OpenCloseCoreStressTest_/00010_core/data
[junit4:junit4]   2> 4523 T4264 oasc.RequestHandlers.initHandlersFromConfig created /admin/: solr.admin.AdminHandlers
[junit4:junit4]   2> 4524 T4221 oasc.CachingDirectoryFactory.closeDirectory Closing directory: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/OpenCloseCoreStressTest_/00010_core/data
[junit4:junit4]   2> 4524 T4264 oasc.RequestHandlers.initHandlersFromConfig created /select: solr.SearchHandler
[junit4:junit4]   2> 4525 T4221 oasc.SolrCore.close [00012_core]  CLOSING SolrCore org.apache.solr.core.SolrCore@ddaf661
[junit4:junit4]   2> 4525 T4264 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4]   2> 4528 T4267 oasc.CoreContainer.create Creating SolrCore '00010_core' using instanceDir: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./OpenCloseCoreStressTest_/00010_core
[junit4:junit4]   2> 4530 T4267 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./OpenCloseCoreStressTest_/00010_core/'
[junit4:junit4]   2> 4533 T4221 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=0,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=2,adds=2,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=2,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0}
[junit4:junit4]   2> 4533 T4221 oasu.SolrCoreState.decrefSolrCoreState Closing SolrCoreState
[junit4:junit4]   2> 4534 T4221 oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has reached 0 - closing IndexWriter
[junit4:junit4]   2> 4534 T4221 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser
[junit4:junit4]   2> 4538 T4264 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4]   2> 4566 T4264 oasc.CachingDirectoryFactory.get return new directory for /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/OpenCloseCoreStressTest_/00000_core/data/index forceNew: false
[junit4:junit4]   2> 4564 T4256 C254 REQ [00004_core] webapp=/solr path=/select params={q=*:*&wt=javabin&qt=/select&version=2} hits=0 status=0 QTime=0 
[junit4:junit4]   2> 4599 T4264 oass.SolrIndexSearcher.<init> Opening Searcher@61b21156 main
[junit4:junit4]   2> 4601 T4264 oasc.SolrCore.registerSearcher [00000_core] Registered new searcher Searcher@61b21156 main{StandardDirectoryReader(segments_2:3 _0(5.0):C1)}
[junit4:junit4]   2> 4601 T4264 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4]   2> 4602 T4264 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4]   2> 4613 T4266 C265 REQ [00015_core] webapp=/solr path=/select params={q=*:*&wt=javabin&qt=/select&version=2} hits=1 status=0 QTime=1 
[junit4:junit4]   2> 4616 T4264 oasc.CoreMaps.putTransientCore Opening transient core 00000_core
[junit4:junit4]   2> 4616 T4264 oasc.CoreContainer.registerCore registering core: 00000_core
[junit4:junit4]   2> ASYNC  NEW_CORE C266 name=00000_core org.apache.solr.core.SolrCore@43c8df5d
[junit4:junit4]   2> 4630 T4254 C266 REQ [00000_core] webapp=/solr path=/select params={q=*:*&wt=javabin&qt=/select&version=2} hits=1 status=0 QTime=0 
[junit4:junit4]   2> 4630 T4250 C266 REQ [00000_core] webapp=/solr path=/select params={q=*:*&wt=javabin&qt=/select&version=2} hits=1 status=0 QTime=0 
[junit4:junit4]   2> 4633 T4261 C266 REQ [00000_core] webapp=/solr path=/select params={q=*:*&wt=javabin&qt=/select&version=2} hits=1 status=0 QTime=0 
[junit4:junit4]   2> 4654 T4267 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_41
[junit4:junit4]   2> 4656 T4280 C266 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4]   2> 		commit{dir=MockDirWrapper(org.apache.lucene.store.MMapDirectory@/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/OpenCloseCoreStressTest_/00000_core/data/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@7b3efaf0),segFN=segments_2,generation=2,filenames=[_0.fnm, _0_MockFixedIntBlock_0.pos, _0.nvm, _0_MockFixedIntBlock_0.tib, _0_MockFixedIntBlock_0.frq, _0_MockRandom_0.sd, _0_MockRandom_0.tip, _0_MockFixedIntBlock_0.pyl, _0_MockFixedIntBlock_0.skp, _0_MockFixedIntBlock_0.doc, _0_MockFixedIntBlock_0.tii, _0_MockRandom_0.doc, _0.nvd, _0_MockRandom_0.pos, segments_2, _0.fdx, _0.si, _0_MockRandom_0.tim, _0.fdt]
[junit4:junit4]   2> 4657 T4280 C266 oasc.SolrDeletionPolicy.updateCommits newest commit = 2[_0.fnm, _0_MockFixedIntBlock_0.pos, _0.nvm, _0_MockFixedIntBlock_0.tib, _0_MockFixedIntBlock_0.frq, _0_MockRandom_0.sd, _0_MockRandom_0.tip, _0_MockFixedIntBlock_0.pyl, _0_MockFixedIntBlock_0.skp, _0_MockFixedIntBlock_0.doc, _0_MockFixedIntBlock_0.tii, _0_MockRandom_0.doc, _0.nvd, _0_MockRandom_0.pos, segments_2, _0.fdx, _0.si, _0_MockRandom_0.tim, _0.fdt]
[junit4:junit4]   2> 4662 T4280 C266 UPDATE [00000_core] webapp=/solr path=/update params={wt=javabin&version=2} {add=[id43]} 0 29
[junit4:junit4]   2> 4679 T4220 C265 UPDATE [00015_core] webapp=/solr path=/update params={wt=javabin&version=2} {add=[id79]} 0 9
[junit4:junit4]   2> 4680 T4256 C251 REQ [00018_core] webapp=/solr path=/select params={q=*:*&wt=javabin&qt=/select&version=2} hits=0 status=0 QTime=0 
[junit4:junit4]   2> 4682 T4265 C266 UPDATE [00000_core] webapp=/solr path=/update params={wt=javabin&version=2} {add=[id74]} 0 40
[junit4:junit4]   2> 4684 T4264 C266 UPDATE [00000_core] webapp=/solr path=/update params={wt=javabin&version=2} {add=[id33]} 0 43
[junit4:junit4]   2> 4692 T4263 C266 UPDATE [00000_core] webapp=/solr path=/update params={wt=javabin&version=2} {add=[id39]} 0 59
[junit4:junit4]   2> 4694 T4250 C253 UPDATE [00016_core] webapp=/solr path=/update params={wt=javabin&version=2} {add=[id82]} 0 0
[junit4:junit4]   2> 4715 T4221 C249 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4]   2> 		commit{dir=MockDirWrapper(org.apache.lucene.store.SimpleFSDirectory@/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/OpenCloseCoreStressTest_/00012_core/data/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@4b545701),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 		commit{dir=MockDirWrapper(org.apache.lucene.store.SimpleFSDirectory@/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/OpenCloseCoreStressTest_/00012_core/data/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@4b545701),segFN=segments_2,generation=2,filenames=[_0_MockRandom_0.tib, _0.fnm, _0_MockFixedIntBlock_0.pos, _0.nvm, _0_MockFixedIntBlock_0.tib, _0_MockRandom_0.skp, _0_MockFixedIntBlock_0.frq, _0_MockRandom_0.sd, _0_MockRandom_0.frq, _0_MockFixedIntBlock_0.skp, _0_MockFixedIntBlock_0.pyl, _0_MockRandom_0.tiv, _0_MockFixedIntBlock_0.doc, _0_MockRandom_0.doc, _0_MockFixedIntBlock_0.tii, _0_MockRandom_0.pos, _0.nvd, segments_2, _0.fdx, _0.si, _0_MockRandom_0.pyl, _0.fdt]
[junit4:junit4]   2> 4716 T4221 C249 oasc.SolrDeletionPolicy.updateCommits newest commit = 2[_0_MockRandom_0.tib, _0.fnm, _0_MockFixedIntBlock_0.pos, _0.nvm, _0_MockFixedIntBlock_0.tib, _0_MockRandom_0.skp, _0_MockFixedIntBlock_0.frq, _0_MockRandom_0.sd, _0_MockRandom_0.frq, _0_MockFixedIntBlock_0.skp, _0_MockFixedIntBlock_0.pyl, _0_MockRandom_0.tiv, _0_MockFixedIntBlock_0.doc, _0_MockRandom_0.doc, _0_MockFixedIntBlock_0.tii, _0_MockRandom_0.pos, _0.nvd, segments_2, _0.fdx, _0.si, _0_MockRandom_0.pyl, _0.fdt]
[junit4:junit4]   2> 4717 T4218 C266 UPDATE [00000_core] webapp=/solr path=/update params={wt=javabin&version=2} {add=[id67]} 0 78
[junit4:junit4]   2> 4729 T4221 oasc.SolrCore.closeSearcher [00012_core] Closing main searcher on request.
[junit4:junit4]   2> 4730 T4221 oasc.CachingDirectoryFactory.close Closing directory when closing factory: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/OpenCloseCoreStressTest_/00012_core/data/index
[junit4:junit4]   2> 4730 T4221 oasc.CachingDirectoryFactory.closeDirectory Closing directory: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/OpenCloseCoreStressTest_/00012_core/data/index
[junit4:junit4]   2> 4736 T4220 C262 REQ [00019_core] webapp=/solr path=/select params={q=*:*&wt=javabin&qt=/select&version=2} hits=0 status=0 QTime=7 
[junit4:junit4]   2> 4742 T4250 C264 REQ [00008_core] webapp=/solr path=/select params={q=*:*&wt=javabin&qt=/select&version=2} hits=4 status=0 QTime=0 
[junit4:junit4]   2> 4750 T4221 oasc.CachingDirectoryFactory.close Closing directory when closing factory: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/OpenCloseCoreStressTest_/00012_core/data
[junit4:junit4]   2> 4750 T4221 oasc.CachingDirectoryFactory.closeDirectory Closing directory: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/OpenCloseCoreStressTest_/00012_core/data
[junit4:junit4]   2> 4751 T4221 oasc.SolrCore.close [00006_core]  CLOSING SolrCore org.apache.solr.core.SolrCore@730a9275
[junit4:junit4]   2> 4752 T4280 oasc.CoreContainer.create Creating SolrCore '00012_core' using instanceDir: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./OpenCloseCoreStressTest_/00012_core
[junit4:junit4]   2> 4753 T4280 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./OpenCloseCoreStressTest_/00012_core/'
[junit4:junit4]   2> 4762 T4221 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=0,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=4,adds=4,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=4,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0}
[junit4:junit4]   2> 4763 T4221 oasu.SolrCoreState.decrefSolrCoreState Closing SolrCoreState
[junit4:junit4]   2> 4763 T4221 oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has reached 0 - closing IndexWriter
[junit4:junit4]   2> 4763 T4221 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser
[junit4:junit4]   2> 4778 T4267 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig-minimal.xml
[junit4:junit4]   2> 4779 T4267 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4]   2> 4785 T4263 C264 REQ [00008_core] webapp=/solr path=/select params={q=*:*&wt=javabin&qt=/select&version=2} hits=4 status=0 QTime=0 
[junit4:junit4]   2> 4795 T4267 oass.IndexSchema.readSchema Schema name=tiny
[junit4:junit4]   2> 4846 T4280 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_41
[junit4:junit4]   2> 4860 T4250 C255 REQ [00005_core] webapp=/solr path=/select params={q=*:*&wt=javabin&qt=/select&version=2} hits=0 status=0 QTime=1 
[junit4:junit4]   2> 4879 T4221 C258 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4]   2> 		commit{dir=MockDirWrapper(org.apache.lucene.store.SimpleFSDirectory@/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/OpenCloseCoreStressTest_/00006_core/data/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@4082076a),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 		commit{dir=MockDirWrapper(org.apache.lucene.store.SimpleFSDirectory@/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/OpenCloseCoreStressTest_/00006_core/data/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@4082076a),segFN=segments_2,generation=2,filenames=[_0_MockRandom_0.tib, _0.fnm, _0_MockFixedIntBlock_0.pos, _0.nvm, _0_MockFixedIntBlock_0.tib, _0_MockRandom_0.skp, _0_MockFixedIntBlock_0.frq, _0_MockRandom_0.sd, _0_MockRandom_0.frq, _0_MockFixedIntBlock_0.skp, _0_MockFixedIntBlock_0.pyl, _0_MockFixedIntBlock_0.doc, _0_MockRandom_0.doc, _0_MockFixedIntBlock_0.tii, _0_MockRandom_0.pos, _0.nvd, _0_MockRandom_0.tii, segments_2, _0.fdx, _0.si, _0_MockRandom_0.pyl, _0.fdt]
[junit4:junit4]   2> 4880 T4221 C258 oasc.SolrDeletionPolicy.updateCommits newest commit = 2[_0_MockRandom_0.tib, _0.fnm, _0_MockFixedIntBlock_0.pos, _0.nvm, _0_MockFixedIntBlock_0.tib, _0_MockRandom_0.skp, _0_MockFixedIntBlock_0.frq, _0_MockRandom_0.sd, _0_MockRandom_0.frq, _0_MockFixedIntBlock_0.skp, _0_MockFixedIntBlock_0.pyl, _0_MockFixedIntBlock_0.doc, _0_MockRandom_0.doc, _0_MockFixedIntBlock_0.tii, _0_MockRandom_0.pos, _0.nvd, _0_MockRandom_0.tii, segments_2, _0.fdx, _0.si, _0_MockRandom_0.pyl, _0.fdt]
[junit4:junit4]   2> 4882 T4221 oasc.SolrCore.closeSearcher [00006_core] Closing main searcher on request.
[junit4:junit4]   2> 4882 T4221 oasc.CachingDirectoryFactory.close Closing directory when closing factory: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/OpenCloseCoreStressTest_/00006_core/data
[junit4:junit4]   2> 4883 T4221 oasc.CachingDirectoryFactory.closeDirectory Closing directory: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/OpenCloseCoreStressTest_/00006_core/data
[junit4:junit4]   2> 4883 T4221 oasc.CachingDirectoryFactory.close Closing directory when closing factory: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/OpenCloseCoreStressTest_/00006_core/data/index
[junit4:junit4]   2> 4884 T4221 oasc.CachingDirectoryFactory.closeDirectory Closing directory: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/OpenCloseCoreStressTest_/00006_core/data/index
[junit4:junit4]   2> 4887 T4267 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> 4889 T4267 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockFSDirectoryFactory
[junit4:junit4]   2> 4891 T4263 C265 REQ [00015_core] webapp=/solr path=/select params={q=*:*&wt=javabin&qt=/select&version=2} hits=1 status=0 QTime=0 
[junit4:junit4]   2> 4892 T4267 oasc.SolrCore.<init> [00010_core] Opening new SolrCore at /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./OpenCloseCoreStressTest_/00010_core/, dataDir=/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/OpenCloseCoreStressTest_/00010_core/data/
[junit4:junit4]   2> 4892 T4267 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@298925ae
[junit4:junit4]   2> 4893 T4267 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockFSDirectoryFactory
[junit4:junit4]   2> 4895 T4267 oasc.CachingDirectoryFactory.get return new directory for /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/OpenCloseCoreStressTest_/00010_core/data forceNew: false
[junit4:junit4]   2> 4896 T4267 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/OpenCloseCoreStressTest_/00010_core/data/index/
[junit4:junit4]   2> 4897 T4267 oasc.SolrCore.initWriters created json: solr.JSONResponseWriter
[junit4:junit4]   2> 4900 T4267 oasc.RequestHandlers.initHandlersFromConfig created /admin/: solr.admin.AdminHandlers
[junit4:junit4]   2> 4901 T4267 oasc.RequestHandlers.initHandlersFromConfig created /select: solr.SearchHandler
[junit4:junit4]   2> 4902 T4267 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4]   2> 4915 T4267 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4]   2> 4940 T4267 oasc.CachingDirectoryFactory.get return new directory for /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/OpenCloseCoreStressTest_/00010_core/data/index forceNew: false
[junit4:junit4]   2> 4961 T4267 oass.SolrIndexSearcher.<init> Opening Searcher@76d5be87 main
[junit4:junit4]   2> 4962 T4280 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig-minimal.xml
[junit4:junit4]   2> 4963 T4267 oasc.SolrCore.registerSearcher [00010_core] Registered new searcher Searcher@76d5be87 main{StandardDirectoryReader(segments_2:3 _0(5.0):C1)}
[junit4:junit4]   2> 4963 T4280 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4]   2> 4963 T4267 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4]   2> 4965 T4267 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4]   2> 4970 T4267 oasc.CoreMaps.putTransientCore Opening transient core 00010_core
[junit4:junit4]   2> 4970 T4221 oasc.SolrCore.close [00009_core]  CLOSING SolrCore org.apache.solr.core.SolrCore@6ecc37c
[junit4:junit4]   2> 4970 T4218 oasc.CoreContainer.create Creating SolrCore '00006_core' using instanceDir: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./OpenCloseCoreStressTest_/00006_core
[junit4:junit4]   2> 4972 T4218 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./OpenCloseCoreStressTest_/00006_core/'
[junit4:junit4]   2> 4971 T4267 oasc.CoreContainer.registerCore registering core: 00010_core
[junit4:junit4]   2> ASYNC  NEW_CORE C267 name=00010_core org.apache.solr.core.SolrCore@2b10da04
[junit4:junit4]   2> 4984 T4253 C267 REQ [00010_core] webapp=/solr path=/select params={q=*:*&wt=javabin&qt=/select&version=2} hits=1 status=0 QTime=1 
[junit4:junit4]   2> 4988 T4221 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=0,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=2,adds=2,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=2,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0}
[junit4:junit4]   2> 4989 T4221 oasu.SolrCoreState.decrefSolrCoreState Closing SolrCoreState
[junit4:junit4]   2> 4990 T4221 oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has reached 0 - closing IndexWriter
[junit4:junit4]   2> 4990 T4221 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser
[junit4:junit4]   2> 4997 T4250 C262 REQ [00019_core] webapp=/solr path=/select params={q=*:*&wt=javabin&qt=/select&version=2} hits=0 status=0 QTime=0 
[junit4:junit4]   2> 4998 T4271 C267 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4]   2> 		commit{dir=MockDirWrapper(org.apache.lucene.store.SimpleFSDirectory@/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/OpenCloseCoreStressTest_/00010_core/data/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@2da5235e),segFN=segments_2,generation=2,filenames=[_0.fnm, _0_MockFixedIntBlock_0.pos, _0.nvm, _0_MockFixedIntBlock_0.tib, _0_MockFixedIntBlock_0.frq, _0_MockRandom_0.sd, _0_MockRandom_0.tip, _0_MockFixedIntBlock_0.pyl, _0_MockFixedIntBlock_0.skp, _0_MockFixedIntBlock_0.doc, _0_MockFixedIntBlock_0.tii, _0_MockRandom_0.doc, _0.nvd, _0_MockRandom_0.pos, segments_2, _0.fdx, _0.si, _0_MockRandom_0.tim, _0.fdt]
[junit4:junit4]   2> 4999 T4271 C267 oasc.SolrDeletionPolicy.updateCommits newest commit = 2[_0.fnm, _0_MockFixedIntBlock_0.pos, _0.nvm, _0_MockFixedIntBlock_0.tib, _0_MockFixedIntBlock_0.frq, _0_MockRandom_0.sd, _0_MockRandom_0.tip, _0_MockFixedIntBlock_0.pyl, _0_MockFixedIntBlock_0.skp, _0_MockFixedIntBlock_0.doc, _0_MockFixedIntBlock_0.tii, _0_MockRandom_0.doc, _0.nvd, _0_MockRandom_0.pos, segments_2, _0.fdx, _0.si, _0_MockRa

[...truncated too long message...]

.core.OpenCloseCoreStressTest.doStress(OpenCloseCoreStressTest.java:202)
[junit4:junit4]    > 	at org.apache.solr.core.OpenCloseCoreStressTest.test30SecondsOld(OpenCloseCoreStressTest.java:116)
[junit4:junit4]    > 	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
[junit4:junit4]    > 	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
[junit4:junit4]    > 	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
[junit4:junit4]    > 	at java.lang.reflect.Method.invoke(Method.java:601)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
[junit4:junit4]    > 	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
[junit4:junit4]    > 	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
[junit4:junit4]    > 	at java.lang.Thread.run(Thread.java:722)
[junit4:junit4]   2> 99319 T4211 oas.SolrTestCaseJ4.deleteCore ###deleteCore
[junit4:junit4]   2> NOTE: test params are: codec=Lucene42: {id=PostingsFormat(name=MockRandom), text=MockFixedIntBlock(blockSize=1243)}, docValues:{}, sim=DefaultSimilarity, locale=sr_CS, timezone=Eire
[junit4:junit4]   2> NOTE: Mac OS X 10.8.2 x86_64/Oracle Corporation 1.7.0_15 (64-bit)/cpus=2,threads=1,free=388883936,total=534773760
[junit4:junit4]   2> NOTE: All tests run in this JVM: [TestPseudoReturnFields, TestExtendedDismaxParser, SynonymTokenizerTest, TestStressReorder, SearchHandlerTest, ShardRoutingCustomTest, StatsComponentTest, URLClassifyProcessorTest, UniqFieldsUpdateProcessorFactoryTest, TestFaceting, TestDistributedGrouping, XsltUpdateRequestHandlerTest, TestZkChroot, SampleTest, TestBinaryResponseWriter, TestQuerySenderListener, TestDocSet, RequestHandlersTest, TestMergePolicyConfig, TestXIncludeConfig, MBeansHandlerTest, StatelessScriptUpdateProcessorFactoryTest, DirectSolrSpellCheckerTest, PreAnalyzedFieldTest, SuggesterTSTTest, CollectionsAPIDistributedZkTest, SolrIndexConfigTest, ZkSolrClientTest, TestSurroundQueryParser, TestBM25SimilarityFactory, ReturnFieldsTest, SystemInfoHandlerTest, RequiredFieldsTest, TestPhraseSuggestions, TestFastLRUCache, TestBadConfig, TestStressLucene, TestSuggestSpellingConverter, TestSolr4Spatial, TestIBSimilarityFactory, TestFieldCollectionResource, PolyFieldTest, BasicDistributedZk2Test, ShowFileRequestHandlerTest, BadIndexSchemaTest, IndexBasedSpellCheckerTest, StandardRequestHandlerTest, LegacyHTMLStripCharFilterTest, ShardRoutingTest, TestUpdate, DefaultValueUpdateProcessorTest, AlternateDirectoryTest, HighlighterConfigTest, DocumentAnalysisRequestHandlerTest, TestPropInject, TestRTGBase, TermVectorComponentTest, DateMathParserTest, ClusterStateTest, SuggesterFSTTest, RegexBoostProcessorTest, TestPHPSerializedResponseWriter, TestLazyCores, SimplePostToolTest, TestCodecSupport, FileBasedSpellCheckerTest, DistributedTermsComponentTest, TestQuerySenderNoQuery, OpenExchangeRatesOrgProviderTest, TestStressRecovery, TestGroupingSearch, TestFastWriter, TestRandomDVFaceting, AnalysisAfterCoreReloadTest, TestFieldResource, UpdateRequestProcessorFactoryTest, TestCSVLoader, CoreContainerCoreInitFailuresTest, DistributedQueryElevationComponentTest, SuggesterWFSTTest, TestMultiCoreConfBootstrap, JSONWriterTest, MoreLikeThisHandlerTest, TestFastOutputStream, QueryElevationComponentTest, UUIDFieldTest, UpdateParamsTest, DebugComponentTest, PeerSyncTest, SpellPossibilityIteratorTest, CurrencyFieldOpenExchangeTest, LukeRequestHandlerTest, RAMDirectoryFactoryTest, TestWriterPerf, TestStressVersions, MultiTermTest, TestPropInjectDefaults, TestCopyFieldCollectionResource, TestUtils, TestLuceneMatchVersion, AutoCommitTest, TestDefaultSimilarityFactory, RecoveryZkTest, DocumentBuilderTest, TestRemoteStreaming, SolrRequestParserTest, SignatureUpdateProcessorFactoryTest, UnloadDistributedZkTest, CurrencyFieldXmlFileTest, TestQueryTypes, OutputWriterTest, ChaosMonkeyNothingIsSafeTest, DistanceFunctionTest, FastVectorHighlighterTest, DisMaxRequestHandlerTest, CoreAdminHandlerTest, TestOmitPositions, TestWordDelimiterFilterFactory, TestReplicationHandler, TestValueSourceCache, XmlUpdateRequestHandlerTest, TestSolrDeletionPolicy2, TestAtomicUpdateErrorCases, SolrIndexSplitterTest, IndexSchemaRuntimeFieldTest, PluginInfoTest, TestDynamicFieldCollectionResource, TestReload, ZkNodePropsTest, OverseerTest, TestReversedWildcardFilterFactory, TestSolrDiscoveryProperties, PingRequestHandlerTest, ZkCLITest, BasicDistributedZkTest, ChaosMonkeySafeLeaderTest, SyncSliceTest, OpenCloseCoreStressTest]
[junit4:junit4] Completed in 99.36s, 6 tests, 1 failure, 4 skipped <<< FAILURES!

[...truncated 402 lines...]
BUILD FAILED
/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/build.xml:381: The following error occurred while executing this line:
/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/build.xml:361: The following error occurred while executing this line:
/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/build.xml:39: The following error occurred while executing this line:
/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build.xml:183: The following error occurred while executing this line:
/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/common-build.xml:449: The following error occurred while executing this line:
/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/lucene/common-build.xml:1213: The following error occurred while executing this line:
/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/lucene/common-build.xml:877: There were test failures: 271 suites, 1141 tests, 1 failure, 18 ignored (6 assumptions)

Total time: 89 minutes 40 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Recording test results
Description set: Java: 64bit/jdk1.7.0 -XX:+UseG1GC
Email was triggered for: Failure
Sending email for trigger: Failure



[JENKINS] Lucene-Solr-trunk-MacOSX (64bit/jdk1.7.0) - Build # 315 - Still Failing!

Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: http://jenkins.thetaphi.de/job/Lucene-Solr-trunk-MacOSX/315/
Java: 64bit/jdk1.7.0 -XX:+UseSerialGC

4 tests failed.
FAILED:  junit.framework.TestSuite.org.apache.solr.cloud.ChaosMonkeySafeLeaderTest

Error Message:
ERROR: SolrIndexSearcher opens=50 closes=49

Stack Trace:
java.lang.AssertionError: ERROR: SolrIndexSearcher opens=50 closes=49
	at __randomizedtesting.SeedInfo.seed([17B32D70BCAC7975]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.apache.solr.SolrTestCaseJ4.endTrackingSearchers(SolrTestCaseJ4.java:247)
	at org.apache.solr.SolrTestCaseJ4.afterClass(SolrTestCaseJ4.java:97)
	at sun.reflect.GeneratedMethodAccessor18.invoke(Unknown Source)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:601)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:700)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at java.lang.Thread.run(Thread.java:722)


FAILED:  junit.framework.TestSuite.org.apache.solr.cloud.ChaosMonkeySafeLeaderTest

Error Message:
2 threads leaked from SUITE scope at org.apache.solr.cloud.ChaosMonkeySafeLeaderTest:     1) Thread[id=4391, name=RecoveryThread, state=TIMED_WAITING, group=TGRP-ChaosMonkeySafeLeaderTest]         at java.lang.Thread.sleep(Native Method)         at org.apache.solr.cloud.RecoveryStrategy.doRecovery(RecoveryStrategy.java:490)         at org.apache.solr.cloud.RecoveryStrategy.run(RecoveryStrategy.java:223)    2) Thread[id=4269, name=searcherExecutor-2550-thread-1, state=WAITING, group=TGRP-ChaosMonkeySafeLeaderTest]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)         at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)         at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)         at java.lang.Thread.run(Thread.java:722)

Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: 2 threads leaked from SUITE scope at org.apache.solr.cloud.ChaosMonkeySafeLeaderTest: 
   1) Thread[id=4391, name=RecoveryThread, state=TIMED_WAITING, group=TGRP-ChaosMonkeySafeLeaderTest]
        at java.lang.Thread.sleep(Native Method)
        at org.apache.solr.cloud.RecoveryStrategy.doRecovery(RecoveryStrategy.java:490)
        at org.apache.solr.cloud.RecoveryStrategy.run(RecoveryStrategy.java:223)
   2) Thread[id=4269, name=searcherExecutor-2550-thread-1, state=WAITING, group=TGRP-ChaosMonkeySafeLeaderTest]
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
        at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
        at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
        at java.lang.Thread.run(Thread.java:722)
	at __randomizedtesting.SeedInfo.seed([17B32D70BCAC7975]:0)


FAILED:  junit.framework.TestSuite.org.apache.solr.cloud.ChaosMonkeySafeLeaderTest

Error Message:
There are still zombie threads that couldn't be terminated:    1) Thread[id=4391, name=RecoveryThread, state=WAITING, group=TGRP-ChaosMonkeySafeLeaderTest]         at java.lang.Object.wait(Native Method)         at java.lang.Thread.join(Thread.java:1258)         at java.lang.Thread.join(Thread.java:1332)         at org.apache.solr.update.DefaultSolrCoreState.cancelRecovery(DefaultSolrCoreState.java:250)         at org.apache.solr.update.DefaultSolrCoreState.close(DefaultSolrCoreState.java:277)         at org.apache.solr.update.SolrCoreState.decrefSolrCoreState(SolrCoreState.java:73)         at org.apache.solr.core.SolrCore.close(SolrCore.java:986)         at org.apache.solr.cloud.RecoveryStrategy.run(RecoveryStrategy.java:235)    2) Thread[id=4269, name=searcherExecutor-2550-thread-1, state=WAITING, group=TGRP-ChaosMonkeySafeLeaderTest]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)         at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)         at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)         at java.lang.Thread.run(Thread.java:722)

Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: There are still zombie threads that couldn't be terminated:
   1) Thread[id=4391, name=RecoveryThread, state=WAITING, group=TGRP-ChaosMonkeySafeLeaderTest]
        at java.lang.Object.wait(Native Method)
        at java.lang.Thread.join(Thread.java:1258)
        at java.lang.Thread.join(Thread.java:1332)
        at org.apache.solr.update.DefaultSolrCoreState.cancelRecovery(DefaultSolrCoreState.java:250)
        at org.apache.solr.update.DefaultSolrCoreState.close(DefaultSolrCoreState.java:277)
        at org.apache.solr.update.SolrCoreState.decrefSolrCoreState(SolrCoreState.java:73)
        at org.apache.solr.core.SolrCore.close(SolrCore.java:986)
        at org.apache.solr.cloud.RecoveryStrategy.run(RecoveryStrategy.java:235)
   2) Thread[id=4269, name=searcherExecutor-2550-thread-1, state=WAITING, group=TGRP-ChaosMonkeySafeLeaderTest]
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
        at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
        at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
        at java.lang.Thread.run(Thread.java:722)
	at __randomizedtesting.SeedInfo.seed([17B32D70BCAC7975]:0)


REGRESSION:  org.apache.solr.cloud.CollectionsAPIDistributedZkTest.testDistribSearch

Error Message:
No live SolrServers available to handle this request:[http://127.0.0.1:50012/d_/yo, http://127.0.0.1:50009/d_/yo, http://127.0.0.1:50003/d_/yo, http://127.0.0.1:49999/d_/yo, http://127.0.0.1:50006/d_/yo]

Stack Trace:
org.apache.solr.client.solrj.SolrServerException: No live SolrServers available to handle this request:[http://127.0.0.1:50012/d_/yo, http://127.0.0.1:50009/d_/yo, http://127.0.0.1:50003/d_/yo, http://127.0.0.1:49999/d_/yo, http://127.0.0.1:50006/d_/yo]
	at __randomizedtesting.SeedInfo.seed([17B32D70BCAC7975:9655A368CBF31949]:0)
	at org.apache.solr.client.solrj.impl.LBHttpSolrServer.request(LBHttpSolrServer.java:333)
	at org.apache.solr.client.solrj.impl.CloudSolrServer.request(CloudSolrServer.java:306)
	at org.apache.solr.cloud.AbstractFullDistribZkTestBase.createCollection(AbstractFullDistribZkTestBase.java:1400)
	at org.apache.solr.cloud.CollectionsAPIDistributedZkTest.testCollectionsAPI(CollectionsAPIDistributedZkTest.java:230)
	at org.apache.solr.cloud.CollectionsAPIDistributedZkTest.doTest(CollectionsAPIDistributedZkTest.java:141)
	at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:806)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:601)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
	at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at java.lang.Thread.run(Thread.java:722)
Caused by: org.apache.solr.client.solrj.SolrServerException: Timeout occured while waiting response from server at: http://127.0.0.1:49999/d_/yo
	at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:412)
	at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:181)
	at org.apache.solr.client.solrj.impl.LBHttpSolrServer.request(LBHttpSolrServer.java:264)
	... 45 more
Caused by: java.net.SocketTimeoutException: Read timed out
	at java.net.SocketInputStream.socketRead0(Native Method)
	at java.net.SocketInputStream.read(SocketInputStream.java:150)
	at java.net.SocketInputStream.read(SocketInputStream.java:121)
	at org.apache.http.impl.io.AbstractSessionInputBuffer.fillBuffer(AbstractSessionInputBuffer.java:166)
	at org.apache.http.impl.io.SocketInputBuffer.fillBuffer(SocketInputBuffer.java:90)
	at org.apache.http.impl.io.AbstractSessionInputBuffer.readLine(AbstractSessionInputBuffer.java:281)
	at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:92)
	at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:62)
	at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:254)
	at org.apache.http.impl.AbstractHttpClientConnection.receiveResponseHeader(AbstractHttpClientConnection.java:289)
	at org.apache.http.impl.conn.DefaultClientConnection.receiveResponseHeader(DefaultClientConnection.java:252)
	at org.apache.http.impl.conn.ManagedClientConnectionImpl.receiveResponseHeader(ManagedClientConnectionImpl.java:191)
	at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:300)
	at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:127)
	at org.apache.http.impl.client.DefaultRequestDirector.tryExecute(DefaultRequestDirector.java:717)
	at org.apache.http.impl.client.DefaultRequestDirector.execute(DefaultRequestDirector.java:522)
	at org.apache.http.impl.client.AbstractHttpClient.execute(AbstractHttpClient.java:906)
	at org.apache.http.impl.client.AbstractHttpClient.execute(AbstractHttpClient.java:805)
	at org.apache.http.impl.client.AbstractHttpClient.execute(AbstractHttpClient.java:784)
	at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:353)
	... 47 more




Build Log:
[...truncated 9044 lines...]
[junit4:junit4] Suite: org.apache.solr.cloud.CollectionsAPIDistributedZkTest
[junit4:junit4]   2> 0 T2888 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /d_/yo
[junit4:junit4]   2> 13 T2888 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch
[junit4:junit4]   2> Creating dataDir: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./solrtest-CollectionsAPIDistributedZkTest-1363135972498
[junit4:junit4]   2> 15 T2888 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4:junit4]   2> 16 T2889 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
[junit4:junit4]   2> 20 T2889 oazs.ZooKeeperServer.setTickTime tickTime set to 1000
[junit4:junit4]   2> 20 T2889 oazs.ZooKeeperServer.setMinSessionTimeout minSessionTimeout set to -1
[junit4:junit4]   2> 21 T2889 oazs.ZooKeeperServer.setMaxSessionTimeout maxSessionTimeout set to -1
[junit4:junit4]   2> 22 T2889 oazs.NIOServerCnxnFactory.configure binding to port 0.0.0.0/0.0.0.0:0
[junit4:junit4]   2> 24 T2888 oasc.ZkTestServer.run start zk server on port:49996
[junit4:junit4]   2> 24 T2888 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:49996 sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@251244c9
[junit4:junit4]   2> 25 T2889 oazsp.FileTxnSnapLog.save Snapshotting: 0x0 to /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-1363135972497/zookeeper/server1/data/version-2/snapshot.0
[junit4:junit4]   2> 30 T2888 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 31 T2894 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:49996. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 32 T2890 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:49997
[junit4:junit4]   2> 32 T2894 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:49996, initiating session
[junit4:junit4]   2> 33 T2890 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:49997
[junit4:junit4]   2> 33 T2892 oazsp.FileTxnLog.append Creating new log file: log.1
[junit4:junit4]   2> 35 T2894 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:49996, sessionid = 0x13d613c449e0000, negotiated timeout = 10000
[junit4:junit4]   2> 36 T2895 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@251244c9 name:ZooKeeperConnection Watcher:127.0.0.1:49996 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 36 T2888 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 36 T2888 oascc.SolrZkClient.makePath makePath: /solr
[junit4:junit4]   2> 37 T2892 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d613c449e0000 with negotiated timeout 10000 for client /127.0.0.1:49997
[junit4:junit4]   2> 51 T2893 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d613c449e0000
[junit4:junit4]   2> 54 T2890 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:49997 which had sessionid 0x13d613c449e0000
[junit4:junit4]   2> 54 T2895 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 54 T2888 oaz.ZooKeeper.close Session: 0x13d613c449e0000 closed
[junit4:junit4]   2> 55 T2888 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:49996/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@290a9290
[junit4:junit4]   2> 56 T2888 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 57 T2896 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:49996. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 57 T2896 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:49996, initiating session
[junit4:junit4]   2> 58 T2890 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:49998
[junit4:junit4]   2> 58 T2890 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:49998
[junit4:junit4]   2> 60 T2892 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d613c449e0001 with negotiated timeout 10000 for client /127.0.0.1:49998
[junit4:junit4]   2> 60 T2896 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:49996, sessionid = 0x13d613c449e0001, negotiated timeout = 10000
[junit4:junit4]   2> 60 T2897 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@290a9290 name:ZooKeeperConnection Watcher:127.0.0.1:49996/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 60 T2888 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 61 T2888 oascc.SolrZkClient.makePath makePath: /collections/collection1
[junit4:junit4]   2> 68 T2888 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
[junit4:junit4]   2> 74 T2888 oascc.SolrZkClient.makePath makePath: /collections/control_collection
[junit4:junit4]   2> 77 T2888 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
[junit4:junit4]   2> 82 T2888 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
[junit4:junit4]   2> 82 T2888 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
[junit4:junit4]   2> 89 T2888 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
[junit4:junit4]   2> 90 T2888 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
[junit4:junit4]   2> 95 T2888 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4:junit4]   2> 95 T2888 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
[junit4:junit4]   2> 100 T2888 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4:junit4]   2> 103 T2888 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
[junit4:junit4]   2> 112 T2888 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4:junit4]   2> 113 T2888 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
[junit4:junit4]   2> 118 T2888 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4:junit4]   2> 119 T2888 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
[junit4:junit4]   2> 124 T2888 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4]   2> 125 T2888 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4]   2> 130 T2888 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4:junit4]   2> 131 T2888 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
[junit4:junit4]   2> 135 T2888 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4:junit4]   2> 136 T2888 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
[junit4:junit4]   2> 141 T2893 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d613c449e0001
[junit4:junit4]   2> 142 T2890 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:49998 which had sessionid 0x13d613c449e0001
[junit4:junit4]   2> 142 T2897 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 143 T2888 oaz.ZooKeeper.close Session: 0x13d613c449e0001 closed
[junit4:junit4]   2> 432 T2888 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4]   2> 468 T2888 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:49999
[junit4:junit4]   2> 469 T2888 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4]   2> 469 T2888 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 470 T2888 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1363135972626
[junit4:junit4]   2> 471 T2888 oasc.CoreContainer$Initializer.initialize looking for solr config file: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1363135972626/solr.xml
[junit4:junit4]   2> 472 T2888 oasc.CoreContainer.<init> New CoreContainer 708937399
[junit4:junit4]   2> 472 T2888 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1363135972626/'
[junit4:junit4]   2> 473 T2888 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1363135972626/'
[junit4:junit4]   2> 530 T2888 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4]   2> 531 T2888 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4]   2> 532 T2888 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4]   2> 532 T2888 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4]   2> 532 T2888 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4]   2> 533 T2888 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4]   2> 534 T2888 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4]   2> 536 T2888 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4]   2> 540 T2888 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4]   2> 541 T2888 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4]   2> 557 T2888 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4]   2> 576 T2888 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:49996/solr
[junit4:junit4]   2> 577 T2888 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4]   2> 577 T2888 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:49996 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@40e603ff
[junit4:junit4]   2> 579 T2907 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:49996. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 579 T2888 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 581 T2907 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:49996, initiating session
[junit4:junit4]   2> 582 T2890 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:50000
[junit4:junit4]   2> 582 T2890 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:50000
[junit4:junit4]   2> 583 T2907 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:49996, sessionid = 0x13d613c449e0002, negotiated timeout = 20000
[junit4:junit4]   2> 584 T2908 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@40e603ff name:ZooKeeperConnection Watcher:127.0.0.1:49996 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 584 T2888 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 585 T2892 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d613c449e0002 with negotiated timeout 20000 for client /127.0.0.1:50000
[junit4:junit4]   2> 586 T2893 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d613c449e0002
[junit4:junit4]   2> 587 T2890 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:50000 which had sessionid 0x13d613c449e0002
[junit4:junit4]   2> 588 T2908 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 588 T2888 oaz.ZooKeeper.close Session: 0x13d613c449e0002 closed
[junit4:junit4]   2> 589 T2888 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4]   2> 596 T2888 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:49996/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@5abf49d6
[junit4:junit4]   2> 598 T2909 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:49996. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 599 T2890 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:50001
[junit4:junit4]   2> 599 T2888 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 600 T2909 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:49996, initiating session
[junit4:junit4]   2> 601 T2890 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:50001
[junit4:junit4]   2> 602 T2892 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d613c449e0003 with negotiated timeout 20000 for client /127.0.0.1:50001
[junit4:junit4]   2> 602 T2909 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:49996, sessionid = 0x13d613c449e0003, negotiated timeout = 20000
[junit4:junit4]   2> 603 T2910 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@5abf49d6 name:ZooKeeperConnection Watcher:127.0.0.1:49996/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 603 T2888 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 610 T2893 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d613c449e0003 type:create cxid:0x2 zxid:0x1a txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 615 T2888 oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4:junit4]   2> 619 T2888 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:49999_d_%2Fyo
[junit4:junit4]   2> 620 T2893 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d613c449e0003 type:delete cxid:0x8 zxid:0x1c txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:49999_d_%2Fyo Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:49999_d_%2Fyo
[junit4:junit4]   2> 621 T2888 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:49999_d_%2Fyo
[junit4:junit4]   2> 628 T2888 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4:junit4]   2> 636 T2893 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d613c449e0003 type:delete cxid:0x16 zxid:0x21 txntype:-1 reqpath:n/a Error Path:/solr/overseer_elect/leader Error:KeeperErrorCode = NoNode for /solr/overseer_elect/leader
[junit4:junit4]   2> 637 T2888 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4:junit4]   2> 641 T2888 oasc.Overseer.start Overseer (id=89334479094415363-127.0.0.1:49999_d_%2Fyo-n_0000000000) starting
[junit4:junit4]   2> 641 T2893 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d613c449e0003 type:create cxid:0x1b zxid:0x23 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 643 T2893 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d613c449e0003 type:create cxid:0x1c zxid:0x24 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 644 T2893 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d613c449e0003 type:create cxid:0x1d zxid:0x25 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 646 T2893 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d613c449e0003 type:create cxid:0x1e zxid:0x26 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 647 T2912 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4:junit4]   2> 649 T2888 oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4:junit4]   2> 654 T2888 oascc.SolrZkClient.makePath makePath: /aliases.json
[junit4:junit4]   2> 656 T2888 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 663 T2888 oass.SolrDispatchFilter.init user.dir=/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0
[junit4:junit4]   2> 663 T2888 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4]   2> 664 T2888 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 689 T2911 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4:junit4]   2> 690 T2888 oascsi.HttpClientUtil.createClient Creating new http client, config:
[junit4:junit4]   2> 692 T2888 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:49996/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@49e5befb
[junit4:junit4]   2> 694 T2888 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 695 T2914 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:49996. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 696 T2890 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:50002
[junit4:junit4]   2> 696 T2914 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:49996, initiating session
[junit4:junit4]   2> 696 T2890 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:50002
[junit4:junit4]   2> 698 T2892 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d613c449e0004 with negotiated timeout 10000 for client /127.0.0.1:50002
[junit4:junit4]   2> 698 T2914 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:49996, sessionid = 0x13d613c449e0004, negotiated timeout = 10000
[junit4:junit4]   2> 698 T2915 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@49e5befb name:ZooKeeperConnection Watcher:127.0.0.1:49996/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 699 T2888 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 701 T2888 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 705 T2888 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:true cause connection loss:true
[junit4:junit4]   2> 980 T2888 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4]   2> 986 T2888 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:50003
[junit4:junit4]   2> 987 T2888 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4]   2> 988 T2888 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 989 T2888 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1363135973188
[junit4:junit4]   2> 990 T2888 oasc.CoreContainer$Initializer.initialize looking for solr config file: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1363135973188/solr.xml
[junit4:junit4]   2> 991 T2888 oasc.CoreContainer.<init> New CoreContainer 1480801864
[junit4:junit4]   2> 992 T2888 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1363135973188/'
[junit4:junit4]   2> 993 T2888 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1363135973188/'
[junit4:junit4]   2> 1077 T2888 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4]   2> 1079 T2888 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4]   2> 1079 T2888 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4]   2> 1080 T2888 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4]   2> 1080 T2888 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4]   2> 1081 T2888 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4]   2> 1081 T2888 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4]   2> 1082 T2888 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4]   2> 1082 T2888 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4]   2> 1083 T2888 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4]   2> 1099 T2888 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4]   2> 1120 T2888 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:49996/solr
[junit4:junit4]   2> 1121 T2888 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4]   2> 1122 T2888 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:49996 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@5d00bfc7
[junit4:junit4]   2> 1123 T2888 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 1124 T2925 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:49996. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 1125 T2925 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:49996, initiating session
[junit4:junit4]   2> 1126 T2890 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:50004
[junit4:junit4]   2> 1127 T2890 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:50004
[junit4:junit4]   2> 1128 T2892 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d613c449e0005 with negotiated timeout 20000 for client /127.0.0.1:50004
[junit4:junit4]   2> 1128 T2925 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:49996, sessionid = 0x13d613c449e0005, negotiated timeout = 20000
[junit4:junit4]   2> 1129 T2926 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@5d00bfc7 name:ZooKeeperConnection Watcher:127.0.0.1:49996 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 1129 T2888 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 1134 T2893 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d613c449e0005
[junit4:junit4]   2> 1137 T2890 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:50004 which had sessionid 0x13d613c449e0005
[junit4:junit4]   2> 1138 T2926 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 1138 T2888 oaz.ZooKeeper.close Session: 0x13d613c449e0005 closed
[junit4:junit4]   2> 1138 T2888 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4]   2> 1148 T2888 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:49996/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@6014ba92
[junit4:junit4]   2> 1151 T2888 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 1151 T2927 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:49996. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 1153 T2927 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:49996, initiating session
[junit4:junit4]   2> 1153 T2890 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:50005
[junit4:junit4]   2> 1154 T2890 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:50005
[junit4:junit4]   2> 1156 T2927 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:49996, sessionid = 0x13d613c449e0006, negotiated timeout = 20000
[junit4:junit4]   2> 1156 T2892 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d613c449e0006 with negotiated timeout 20000 for client /127.0.0.1:50005
[junit4:junit4]   2> 1156 T2928 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@6014ba92 name:ZooKeeperConnection Watcher:127.0.0.1:49996/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 1157 T2888 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 1158 T2893 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d613c449e0006 type:create cxid:0x1 zxid:0x2e txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 1160 T2893 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d613c449e0006 type:create cxid:0x2 zxid:0x2f txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 1164 T2888 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 2169 T2888 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:50003_d_%2Fyo
[junit4:junit4]   2> 2170 T2893 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d613c449e0006 type:delete cxid:0xb zxid:0x30 txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:50003_d_%2Fyo Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:50003_d_%2Fyo
[junit4:junit4]   2> 2171 T2888 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:50003_d_%2Fyo
[junit4:junit4]   2> 2175 T2915 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4]   2> 2177 T2928 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4]   2> 2178 T2910 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4]   2> 2184 T2888 oass.SolrDispatchFilter.init user.dir=/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0
[junit4:junit4]   2> 2185 T2888 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4]   2> 2186 T2888 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 2482 T2888 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4]   2> 2487 T2888 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:50006
[junit4:junit4]   2> 2488 T2888 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4]   2> 2489 T2888 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 2489 T2888 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1363135974676
[junit4:junit4]   2> 2490 T2888 oasc.CoreContainer$Initializer.initialize looking for solr config file: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1363135974676/solr.xml
[junit4:junit4]   2> 2490 T2888 oasc.CoreContainer.<init> New CoreContainer 2040739005
[junit4:junit4]   2> 2491 T2888 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1363135974676/'
[junit4:junit4]   2> 2491 T2888 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1363135974676/'
[junit4:junit4]   2> 2552 T2888 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4]   2> 2554 T2888 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4]   2> 2555 T2888 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4]   2> 2555 T2888 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4]   2> 2556 T2888 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4]   2> 2557 T2888 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4]   2> 2558 T2888 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4]   2> 2560 T2888 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4]   2> 2561 T2888 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4]   2> 2562 T2888 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4]   2> 2577 T2888 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4]   2> 2618 T2888 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:49996/solr
[junit4:junit4]   2> 2619 T2888 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4]   2> 2620 T2888 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:49996 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@19a7020a
[junit4:junit4]   2> 2622 T2888 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 2622 T2939 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:49996. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 2624 T2939 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:49996, initiating session
[junit4:junit4]   2> 2624 T2890 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:50007
[junit4:junit4]   2> 2624 T2890 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:50007
[junit4:junit4]   2> 2627 T2892 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d613c449e0007 with negotiated timeout 20000 for client /127.0.0.1:50007
[junit4:junit4]   2> 2627 T2939 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:49996, sessionid = 0x13d613c449e0007, negotiated timeout = 20000
[junit4:junit4]   2> 2628 T2940 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@19a7020a name:ZooKeeperConnection Watcher:127.0.0.1:49996 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 2628 T2888 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 2630 T2893 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d613c449e0007
[junit4:junit4]   2> 2631 T2890 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:50007 which had sessionid 0x13d613c449e0007
[junit4:junit4]   2> 2632 T2940 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 2632 T2888 oaz.ZooKeeper.close Session: 0x13d613c449e0007 closed
[junit4:junit4]   2> 2633 T2888 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4]   2> 2639 T2888 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:49996/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@5119c01
[junit4:junit4]   2> 2641 T2941 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:49996. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 2642 T2890 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:50008
[junit4:junit4]   2> 2642 T2888 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 2643 T2941 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:49996, initiating session
[junit4:junit4]   2> 2643 T2890 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:50008
[junit4:junit4]   2> 2645 T2892 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d613c449e0008 with negotiated timeout 20000 for client /127.0.0.1:50008
[junit4:junit4]   2> 2646 T2941 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:49996, sessionid = 0x13d613c449e0008, negotiated timeout = 20000
[junit4:junit4]   2> 2646 T2942 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@5119c01 name:ZooKeeperConnection Watcher:127.0.0.1:49996/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 2647 T2888 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 2648 T2893 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d613c449e0008 type:create cxid:0x1 zxid:0x36 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 2650 T2893 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d613c449e0008 type:create cxid:0x2 zxid:0x37 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 2654 T2888 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 3661 T2888 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:50006_d_%2Fyo
[junit4:junit4]   2> 3662 T2893 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d613c449e0008 type:delete cxid:0xb zxid:0x38 txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:50006_d_%2Fyo Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:50006_d_%2Fyo
[junit4:junit4]   2> 3664 T2888 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:50006_d_%2Fyo
[junit4:junit4]   2> 3668 T2910 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4]   2> 3674 T2915 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4]   2> 3680 T2888 oass.SolrDispatchFilter.init user.dir=/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0
[junit4:junit4]   2> 3681 T2888 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4]   2> 3682 T2888 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 3703 T2928 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4]   2> 3703 T2942 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4]   2> 3952 T2888 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4]   2> 3956 T2888 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:50009
[junit4:junit4]   2> 3956 T2888 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4]   2> 3957 T2888 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 3958 T2888 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1363135976188
[junit4:junit4]   2> 3958 T2888 oasc.CoreContainer$Initializer.initialize looking for solr config file: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1363135976188/solr.xml
[junit4:junit4]   2> 3958 T2888 oasc.CoreContainer.<init> New CoreContainer 1953009118
[junit4:junit4]   2> 3959 T2888 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1363135976188/'
[junit4:junit4]   2> 3960 T2888 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1363135976188/'
[junit4:junit4]   2> 4050 T2888 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4]   2> 4050 T2888 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4]   2> 4051 T2888 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4]   2> 4051 T2888 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4]   2> 4052 T2888 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4]   2> 4052 T2888 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4]   2> 4053 T2888 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4]   2> 4053 T2888 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4]   2> 4054 T2888 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4]   2> 4054 T2888 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4]   2> 4067 T2888 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4]   2> 4087 T2888 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:49996/solr
[junit4:junit4]   2> 4088 T2888 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4]   2> 4088 T2888 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:49996 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@41a85e54
[junit4:junit4]   2> 4090 T2888 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 4091 T2953 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:49996. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 4093 T2953 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:49996, initiating session
[junit4:junit4]   2> 4094 T2890 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:50010
[junit4:junit4]   2> 4094 T2890 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:50010
[junit4:junit4]   2> 4095 T2892 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d613c449e0009 with negotiated timeout 20000 for client /127.0.0.1:50010
[junit4:junit4]   2> 4096 T2953 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:49996, sessionid = 0x13d613c449e0009, negotiated timeout = 20000
[junit4:junit4]   2> 4096 T2954 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@41a85e54 name:ZooKeeperConnection Watcher:127.0.0.1:49996 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 4096 T2888 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 4098 T2893 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d613c449e0009
[junit4:junit4]   2> 4099 T2890 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:50010 which had sessionid 0x13d613c449e0009
[junit4:junit4]   2> 4099 T2954 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 4100 T2888 oaz.ZooKeeper.close Session: 0x13d613c449e0009 closed
[junit4:junit4]   2> 4106 T2888 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4]   2> 4115 T2888 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:49996/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@3c5fed32
[junit4:junit4]   2> 4116 T2888 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 4117 T2955 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:49996. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 4117 T2955 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:49996, initiating session
[junit4:junit4]   2> 4118 T2890 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:50011
[junit4:junit4]   2> 4118 T2890 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:50011
[junit4:junit4]   2> 4120 T2892 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d613c449e000a with negotiated timeout 20000 for client /127.0.0.1:50011
[junit4:junit4]   2> 4120 T2955 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:49996, sessionid = 0x13d613c449e000a, negotiated timeout = 20000
[junit4:junit4]   2> 4121 T2956 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@3c5fed32 name:ZooKeeperConnection Watcher:127.0.0.1:49996/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 4121 T2888 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 4122 T2893 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d613c449e000a type:create cxid:0x1 zxid:0x3e txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 4123 T2893 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d613c449e000a type:create cxid:0x2 zxid:0x3f txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 4127 T2888 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 5133 T2888 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:50009_d_%2Fyo
[junit4:junit4]   2> 5134 T2893 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d613c449e000a type:delete cxid:0xb zxid:0x40 txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:50009_d_%2Fyo Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:50009_d_%2Fyo
[junit4:junit4]   2> 5136 T2888 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:50009_d_%2Fyo
[junit4:junit4]   2> 5143 T2915 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4]   2> 5143 T2942 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4]   2> 5145 T2956 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4]   2> 5154 T2888 oass.SolrDispatchFilter.init user.dir=/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0
[junit4:junit4]   2> 5155 T2888 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4]   2> 5155 T2888 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 5167 T2910 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4]   2> 5175 T2928 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4]   2> 5433 T2888 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4]   2> 5446 T2888 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:50012
[junit4:junit4]   2> 5448 T2888 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4]   2> 5449 T2888 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 5450 T2888 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1363135977646
[junit4:junit4]   2> 5451 T2888 oasc.CoreContainer$Initializer.initialize looking for solr config file: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1363135977646/solr.xml
[junit4:junit4]   2> 5452 T2888 oasc.CoreContainer.<init> New CoreContainer 2091116638
[junit4:junit4]   2> 5457 T2888 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1363135977646/'
[junit4:junit4]   2> 5458 T2888 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1363135977646/'
[junit4:junit4]   2> 5514 T2888 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4]   2> 5516 T2888 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4]   2> 5517 T2888 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4]   2> 5517 T2888 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4]   2> 5518 T2888 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4]   2> 5518 T2888 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4]   2> 5519 T2888 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4]   2> 5519 T2888 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4]   2> 5520 T2888 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4]   2> 5520 T2888 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4]   2> 5566 T2888 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4]   2> 5598 T2888 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:49996/solr
[junit4:junit4]   2> 5599 T2888 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4]   2> 5600 T2888 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:49996 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@2233a68f
[junit4:junit4]   2> 5601 T2888 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 5602 T2967 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:49996. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 5605 T2967 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:49996, initiating session
[junit4:junit4]   2> 5606 T2890 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:50013
[junit4:junit4]   2> 5607 T2890 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:50013
[junit4:junit4]   2> 5608 T2892 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d613c449e000b with negotiated timeout 20000 for client /127.0.0.1:50013
[junit4:junit4]   2> 5608 T2967 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:49996, sessionid = 0x13d613c449e000b, negotiated timeout = 20000
[junit4:junit4]   2> 5609 T2968 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@2233a68f name:ZooKeeperConnection Watcher:127.0.0.1:49996 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 5609 T2888 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 5611 T2893 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d613c449e000b
[junit4:junit4]   2> 5612 T2890 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:50013 which had sessionid 0x13d613c449e000b
[junit4:junit4]   2> 5612 T2968 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 5613 T2888 oaz.ZooKeeper.close Session: 0x13d613c449e000b closed
[junit4:junit4]   2> 5613 T2888 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4]   2> 5620 T2888 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:49996/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@35f79c51
[junit4:junit4]   2> 5621 T2888 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 5622 T2969 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:49996. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 5623 T2890 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:50014
[junit4:junit4]   2> 5624 T2969 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:49996, initiating session
[junit4:junit4]   2> 5624 T2890 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:50014
[junit4:junit4]   2> 5626 T2892 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d613c449e000c with negotiated timeout 20000 for client /127.0.0.1:50014
[junit4:junit4]   2> 5626 T2969 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:49996, sessionid = 0x13d613c449e000c, negotiated timeout = 20000
[junit4:junit4]   2> 5627 T2970 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@35f79c51 name:ZooKeeperConnection Watcher:127.0.0.1:49996/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 5627 T2888 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 5629 T2893 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d613c449e000c type:create cxid:0x1 zxid:0x46 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 5633 T2893 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d613c449e000c type:create cxid:0x2 zxid:0x47 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 5640 T2888 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 6649 T2888 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:50012_d_%2Fyo
[junit4:junit4]   2> 6651 T2893 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d613c449e000c type:delete cxid:0xb zxid:0x48 txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:50012_d_%2Fyo Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:50012_d_%2Fyo
[junit4:junit4]   2> 6653 T2888 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:50012_d_%2Fyo
[junit4:junit4]   2> 6658 T2970 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4]   2> 6658 T2956 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4]   2> 6658 T2915 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4]   2> 6659 T2928 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4]   2> 6659 T2910 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4]   2> 6659 T2942 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4]   2> 6666 T2888 oass.SolrDispatchFilter.init user.dir=/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0
[junit4:junit4]   2> 6667 T2888 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4]   2> 6668 T2888 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 6677 T2888 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 6694 T2920 oasha.CollectionsHandler.handleCreateAction Creating Collection : numShards=2&name=nodes_used_collection&replicationFactor=2&action=CREATE&wt=javabin&version=2
[junit4:junit4]   2> 6696 T2910 oasc.DistributedQueue$LatchChildWatcher.process Watcher fired on path: /overseer/collection-queue-work state: SyncConnected type NodeChildrenChanged
[junit4:junit4]   2> 6706 T2910 oasc.DistributedQueue$LatchChildWatcher.process Watcher fired on path: /overseer/collection-queue-work state: SyncConnected type NodeChildrenChanged
[junit4:junit4]   2> 6710 T2912 oasc.OverseerCollectionProcessor.run Overseer Collection Processor: Get the message id:/overseer/collection-queue-work/qn-0000000000 message:{
[junit4:junit4]   2> 	  "operation":"createcollection",
[junit4:junit4]   2> 	  "numShards":"2",
[junit4:junit4]   2> 	  "maxShardsPerNode":null,
[junit4:junit4]   2> 	  "createNodeSet":null,
[junit4:junit4]   2> 	  "name":"nodes_used_collection",
[junit4:junit4]   2> 	  "replicationFactor":"2"}
[junit4:junit4]   2> 6712 T2912 oasc.OverseerCollectionProcessor.createCollection Creating shard nodes_used_collection_shard1_replica1 as part of slice shard1 of collection nodes_used_collection on 127.0.0.1:50009_d_%2Fyo
[junit4:junit4]   2> 6716 T2912 oasc.OverseerCollectionProcessor.createCollection Creating shard nodes_used_collection_shard1_replica2 as part of slice shard1 of collection nodes_used_collection on 127.0.0.1:49999_d_%2Fyo
[junit4:junit4]   2> 6719 T2912 oasc.OverseerCollectionProcessor.createCollection Creating shard nodes_used_collection_shard2_replica1 as part of slice shard2 of collection nodes_used_collection on 127.0.0.1:50006_d_%2Fyo
[junit4:junit4]   2> 6720 T2912 oasc.OverseerCollectionProcessor.createCollection Creating shard nodes_used_collection_shard2_replica2 as part of slice shard2 of collection nodes_used_collection on 127.0.0.1:50003_d_%2Fyo
[junit4:junit4]   2> 6728 T2904 oasc.CoreContainer.create Creating SolrCore 'nodes_used_collection_shard1_replica2' using instanceDir: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1363135972626/nodes_used_collection_shard1_replica2
[junit4:junit4]   2> 6729 T2904 oasc.ZkController.createCollectionZkNode Check for collection zkNode:nodes_used_collection
[junit4:junit4]   2> 6729 T2936 oasc.CoreContainer.create Creating SolrCore 'nodes_used_collection_shard2_replica1' using instanceDir: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1363135974676/nodes_used_collection_shard2_replica1
[junit4:junit4]   2> 6733 T2936 oasc.ZkController.createCollectionZkNode Check for collection zkNode:nodes_used_collection
[junit4:junit4]   2> 6732 T2947 oasc.CoreContainer.create Creating SolrCore 'nodes_used_collection_shard1_replica1' using instanceDir: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1363135976188/nodes_used_collection_shard1_replica1
[junit4:junit4]   2> 6734 T2947 oasc.ZkController.createCollectionZkNode Check for collection zkNode:nodes_used_collection
[junit4:junit4]   2> 6731 T2921 oasc.CoreContainer.create Creating SolrCore 'nodes_used_collection_shard2_replica2' using instanceDir: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1363135973188/nodes_used_collection_shard2_replica2
[junit4:junit4]   2> 6735 T2921 oasc.ZkController.createCollectionZkNode Check for collection zkNode:nodes_used_collection
[junit4:junit4]   2> 6736 T2947 oasc.ZkController.createCollectionZkNode Creating collection in ZooKeeper:nodes_used_collection
[junit4:junit4]   2> 6737 T2947 oasc.ZkController.getConfName Looking for collection configName
[junit4:junit4]   2> 6739 T2947 oasc.ZkController.getConfName Only one config set found in zk - using it:conf1
[junit4:junit4]   2> 6740 T2947 oascc.SolrZkClient.makePath makePath: /collections/nodes_used_collection
[junit4:junit4]   2> 6744 T2947 oasc.ZkController.readConfigName Load collection config from:/collections/nodes_used_collection
[junit4:junit4]   2> 6746 T2947 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1363135976188/nodes_used_collection_shard1_replica1/'
[junit4:junit4]   2> 6750 T2904 oasc.ZkController.createCollectionZkNode Creating collection in ZooKeeper:nodes_used_collection
[junit4:junit4]   2> 6750 T2904 oasc.ZkController.getConfName Looking for collection configName
[junit4:junit4]   2> 6752 T2921 oasc.ZkController.createCollectionZkNode Creating collection in ZooKeeper:nodes_used_collection
[junit4:junit4]   2> 6753 T2921 oasc.ZkController.getConfName Looking for collection configName
[junit4:junit4]   2> 6756 T2936 oasc.ZkController.createCollectionZkNode Creating collection in ZooKeeper:nodes_used_collection
[junit4:junit4]   2> 6757 T2936 oasc.ZkController.getConfName Looking for collection configName
[junit4:junit4]   2> 6786 T2936 oascc.SolrZkClient.makePath makePath: /collections/nodes_used_collection
[junit4:junit4]   2> 6788 T2904 oascc.SolrZkClient.makePath makePath: /collections/nodes_used_collection
[junit4:junit4]   2> 6789 T2921 oascc.SolrZkClient.makePath makePath: /collections/nodes_used_collection
[junit4:junit4]   2> 6803 T2893 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d613c449e0008 type:create cxid:0x1d zxid:0x4e txntype:-1 reqpath:n/a Error Path:/solr/collections/nodes_used_collection Error:KeeperErrorCode = NodeExists for /solr/collections/nodes_used_collection
[junit4:junit4]   2> 6804 T2893 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d613c449e0003 type:create cxid:0x4b zxid:0x4f txntype:-1 reqpath:n/a Error Path:/solr/collections/nodes_used_collection Error:KeeperErrorCode = NodeExists for /solr/collections/nodes_used_collection
[junit4:junit4]   2> 6805 T2893 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d613c449e0006 type:create cxid:0x21 zxid:0x50 txntype:-1 reqpath:n/a Error Path:/solr/collections/nodes_used_collection Error:KeeperErrorCode = NodeExists for /solr/collections/nodes_used_collection
[junit4:junit4]   2> 6857 T2936 oasc.ZkController.readConfigName Load collection config from:/collections/nodes_used_collection
[junit4:junit4]   2> 6867 T2904 oasc.ZkController.readConfigName Load collection config from:/collections/nodes_used_collection
[junit4:junit4]   2> 6867 T2921 oasc.ZkController.readConfigName Load collection config from:/collections/nodes_used_collection
[junit4:junit4]   2> 6876 T2936 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1363135974676/nodes_used_collection_shard2_replica1/'
[junit4:junit4]   2> 6886 T2904 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1363135972626/nodes_used_collection_shard1_replica2/'
[junit4:junit4]   2> 6890 T2921 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1363135973188/nodes_used_collection_shard2_replica2/'
[junit4:junit4]   2> 6913 T2947 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4]   2> 7583 T2904 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4]   2> 7625 T2936 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4]   2> 7764 T2936 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   2> 7767 T2921 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4]   2> 7773 T2947 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   2> 7789 T2936 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4]   2> 7789 T2947 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4]   2> 7797 T2936 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4]   2> 7801 T2947 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4]   2> 7949 T2904 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   2> 7952 T2904 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4]   2> 7985 T2904 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4]   2> 8031 T2921 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   2> 8044 T2921 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4]   2> 8050 T2921 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4]   2> 10296 T2936 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   2> 10349 T2936 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4]   2> 10353 T2936 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> 10466 T2947 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   2> 10487 T2904 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   2> 10506 T2936 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 10516 T2936 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 10529 T2947 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4]   2> 10531 T2904 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4]   2> 10535 T2947 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> 10535 T2904 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> 10545 T2936 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 10548 T2936 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4]   2> 10549 T2936 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4]   2> 10549 T2936 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 10551 T2936 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4]   2> 10552 T2936 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4]   2> 10552 T2936 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4]   2> 10553 T2936 oasc.SolrCore.<init> [nodes_used_collection_shard2_replica1] Opening new SolrCore at /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1363135974676/nodes_used_collection_shard2_replica1/, dataDir=/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1363135974676/nodes_used_collection_shard2_replica1/data/
[junit4:junit4]   2> 10553 T2936 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@7d4acb8
[junit4:junit4]   2> 10554 T2936 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4]   2> 10555 T2936 oasc.CachingDirectoryFactory.get return new directory for /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1363135974676/nodes_used_collection_shard2_replica1/data forceNew: false
[junit4:junit4]   2> 10565 T2936 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1363135974676/nodes_used_collection_shard2_replica1/data/index/
[junit4:junit4]   2> 10565 T2936 oasc.SolrCore.initIndex WARNING [nodes_used_collection_shard2_replica1] Solr index directory '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1363135974676/nodes_used_collection_shard2_replica1/data/index' doesn't exist. Creating new index...
[junit4:junit4]   2> 10566 T2936 oasc.CachingDirectoryFactory.get return new directory for /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1363135974676/nodes_used_collection_shard2_replica1/data/index forceNew: false
[junit4:junit4]   2> 10570 T2936 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4]   2> 		commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@2dbe43d lockFactory=org.apache.lucene.store.NativeFSLockFactory@1e15f4e7),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 10571 T2936 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4]   2> 10594 T2936 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   2> 10595 T2936 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   2> 10595 T2936 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   2> 10596 T2936 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4]   2> 10596 T2936 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4]   2> 10597 T2936 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   2> 10597 T2936 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4]   2> 10598 T2936 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4]   2> 10598 T2936 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   2> 10604 T2936 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4]   2> 10624 T2921 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   2> 10628 T2936 oass.SolrIndexSearcher.<init> Opening Searcher@264334dc main
[junit4:junit4]   2> 10632 T2936 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1363135974676/nodes_used_collection_shard2_replica1/data/tlog
[junit4:junit4]   2> 10634 T2936 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4]   2> 10634 T2936 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4]   2> 10638 T2976 oasc.SolrCore.registerSearcher [nodes_used_collection_shard2_replica1] Registered new searcher Searcher@264334dc main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   2> 10642 T2904 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 10644 T2936 oasc.ZkController.publish publishing core=nodes_used_collection_shard2_replica1 state=down
[junit4:junit4]   2> 10645 T2893 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d613c449e0008 type:create cxid:0x3e zxid:0x51 txntype:-1 reqpath:n/a Error Path:/solr/overseer/queue Error:KeeperErrorCode = NoNode for /solr/overseer/queue
[junit4:junit4]   2> 10657 T2904 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 10659 T2921 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4]   2> 10663 T2921 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> 10675 T2904 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 10677 T2947 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 10690 T2947 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 10694 T2904 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4]   2> 10695 T2904 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4]   2> 10695 T2904 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 10693 T2936 oasc.CoreContainer.registerCore registering core: nodes_used_collection_shard2_replica1
[junit4:junit4]   2> 10697 T2936 oasc.ZkController.register Register replica - core:nodes_used_collection_shard2_replica1 address:http://127.0.0.1:50006/d_/yo collection:nodes_used_collection shard:shard2
[junit4:junit4]   2> 10699 T2936 oascc.SolrZkClient.makePath makePath: /collections/nodes_used_collection/leader_elect/shard2/election
[junit4:junit4]   2> 10704 T2947 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 10707 T2947 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4]   2> 10708 T2947 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4]   2> 10708 T2904 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4]   2> 10709 T2947 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 10710 T2904 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4]   2> 10710 T2904 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4]   2> 10718 T2904 oasc.SolrCore.<init> [nodes_used_collection_shard1_replica2] Opening new SolrCore at /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1363135972626/nodes_used_collection_shard1_replica2/, dataDir=/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1363135972626/nodes_used_collection_shard1_replica2/data/
[junit4:junit4]   2> 10719 T2904 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@7d4acb8
[junit4:junit4]   2> 10714 T2947 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4]   2> 10722 T2947 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4]   2> 10722 T2947 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4]   2> 10723 T2947 oasc.SolrCore.<init> [nodes_used_collection_shard1_replica1] Opening new SolrCore at /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1363135976188/nodes_used_collection_shard1_replica1/, dataDir=/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1363135976188/nodes_used_collection_shard1_replica1/data/
[junit4:junit4]   2> 10724 T2947 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@7d4acb8
[junit4:junit4]   2> 10724 T2947 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4]   2> 10720 T2904 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4]   2> 10728 T2947 oasc.CachingDirectoryFactory.get return new directory for /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1363135976188/nodes_used_collection_shard1_replica1/data forceNew: false
[junit4:junit4]   2> 10728 T2947 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1363135976188/nodes_used_collection_shard1_replica1/data/index/
[junit4:junit4]   2> 10728 T2947 oasc.SolrCore.initIndex WARNING [nodes_used_collection_shard1_replica1] Solr index directory '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1363135976188/nodes_used_collection_shard1_replica1/data/index' doesn't exist. Creating new index...
[junit4:junit4]   2> 10729 T2947 oasc.CachingDirectoryFactory.get return new directory for /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1363135976188/nodes_used_collection_shard1_replica1/data/index forceNew: false
[junit4:junit4]   2> 10734 T2904 oasc.CachingDirectoryFactory.get return new directory for /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1363135972626/nodes_used_collection_shard1_replica2/data forceNew: false
[junit4:junit4]   2> 10735 T2904 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1363135972626/nodes_used_collection_shard1_replica2/data/index/
[junit4:junit4]   2> 10735 T2904 oasc.SolrCore.initIndex WARNING [nodes_used_collection_shard1_replica2] Solr index directory '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1363135972626/nodes_used_collection_shard1_replica2/data/index' doesn't exist. Creating new index...
[junit4:junit4]   2> 10736 T2904 oasc.CachingDirectoryFactory.get return new directory for /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1363135972626/nodes_used_collection_shard1_replica2/data/index forceNew: false
[junit4:junit4]   2> 10745 T2904 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4]   2> 		commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@16665884 lockFactory=org.apache.lucene.store.NativeFSLockFactory@7b184c1),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 10746 T2904 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4]   2> 10748 T2893 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d613c449e0008 type:delete cxid:0x4d zxid:0x58 txntype:-1 reqpath:n/a Error Path:/solr/collections/nodes_used_collection/leaders Error:KeeperErrorCode = NoNode for /solr/collections/nodes_used_collection/leaders
[junit4:junit4]   2> 10750 T2947 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4]   2> 		commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@73dcc7be lockFactory=org.apache.lucene.store.NativeFSLockFactory@2a994e),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 10751 T2947 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4]   2> 10752 T2904 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   2> 10752 T2904 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   2> 10753 T2936 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4]   2> 10754 T2893 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d613c449e0008 type:create cxid:0x4e zxid:0x59 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 10755 T2904 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   2> 10757 T2904 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4]   2> 10758 T2904 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4]   2> 10758 T2947 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   2> 10759 T2947 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   2> 10760 T2947 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   2> 10760 T2947 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4]   2> 10761 T2947 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4]   2> 10761 T2947 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   2> 10762 T2947 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4]   2> 10763 T2947 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4]   2> 10763 T2947 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   2> 10758 T2904 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   2> 10765 T2904 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4]   2> 10767 T2904 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4]   2> 10768 T2904 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   2> 10772 T2947 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4]   2> 10773 T2904 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4]   2> 10779 T2921 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 10781 T2904 oass.SolrIndexSearcher.<init> Opening Searcher@436a004c main
[junit4:junit4]   2> 10795 T2921 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 10796 T2904 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1363135972626/nodes_used_collection_shard1_replica2/data/tlog
[junit4:junit4]   2> 10782 T2947 oass.SolrIndexSearcher.<init> Opening Searcher@140efee7 main
[junit4:junit4]   2> 10804 T2947 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1363135976188/nodes_used_collection_shard1_replica1/data/tlog
[junit4:junit4]   2> 10804 T2904 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4]   2> 10805 T2904 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4]   2> 10809 T2947 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4]   2> 10809 T2921 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 10810 T2977 oasc.SolrCore.registerSearcher [nodes_used_collection_shard1_replica2] Registered new searcher Searcher@436a004c main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   2> 10809 T2947 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4]   2> 10818 T2904 oasc.ZkController.publish publishing core=nodes_used_collection_shard1_replica2 state=down
[junit4:junit4]   2> 10819 T2978 oasc.SolrCore.registerSearcher [nodes_used_collection_shard1_replica1] Registered new searcher Searcher@140efee7 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   2> 10819 T2921 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4]   2> 10820 T2921 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4]   2> 10821 T2921 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 10822 T2947 oasc.ZkController.publish publishing core=nodes_used_collection_shard1_replica1 state=down
[junit4:junit4]   2> 10824 T2904 oasc.CoreContainer.registerCore registering core: nodes_used_collection_shard1_replica2
[junit4:junit4]   2> 10824 T2904 oasc.ZkController.register Register replica - core:nodes_used_collection_shard1_replica2 address:http://127.0.0.1:49999/d_/yo collection:nodes_used_collection shard:shard1
[junit4:junit4]   2> 10825 T2921 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4]   2> 10825 T2921 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4]   2> 10826 T2921 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4]   2> 10826 T2904 oascc.SolrZkClient.makePath makePath: /collections/nodes_used_collection/leader_elect/shard1/election
[junit4:junit4]   2> 10825 T2947 oasc.CoreContainer.registerCore registering core: nodes_used_collection_shard1_replica1
[junit4:junit4]   2> 10828 T2947 oasc.ZkController.register Register replica - core:nodes_used_collection_shard1_replica1 address:http://127.0.0.1:50009/d_/yo collection:nodes_used_collection shard:shard1
[junit4:junit4]   2> 10827 T2921 oasc.SolrCore.<init> [nodes_used_collection_shard2_replica2] Opening new SolrCore at /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1363135973188/nodes_used_collection_shard2_replica2/, dataDir=/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1363135973188/nodes_used_collection_shard2_replica2/data/
[junit4:junit4]   2> 10830 T2921 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@7d4acb8
[junit4:junit4]   2> 10831 T2921 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4]   2> 10833 T2921 oasc.CachingDirectoryFactory.get return new directory for /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1363135973188/nodes_used_collection_shard2_replica2/data forceNew: false
[junit4:junit4]   2> 10834 T2921 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1363135973188/nodes_used_collection_shard2_replica2/data/index/
[junit4:junit4]   2> 10834 T2921 oasc.SolrCore.initIndex WARNING [nodes_used_collection_shard2_replica2] Solr index directory '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1363135973188/nodes_used_collection_shard2_replica2/data/index' doesn't exist. Creating new index...
[junit4:junit4]   2> 10836 T2921 oasc.CachingDirectoryFactory.get return new directory for /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1363135973188/nodes_used_collection_shard2_replica2/data/index forceNew: false
[junit4:junit4]   2> 10839 T2947 oascc.SolrZkClient.makePath makePath: /collections/nodes_used_collection/leader_elect/shard1/election
[junit4:junit4]   2> 10841 T2921 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4]   2> 		commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@7914beda lockFactory=org.apache.lucene.store.NativeFSLockFactory@69ee4d85),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 10841 T2921 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4]   2> 10845 T2921 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   2> 10846 T2921 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   2> 10847 T2921 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   2> 10847 T2921 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4]   2> 10848 T2921 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4]   2> 10849 T2921 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   2> 10853 T2921 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4]   2> 10855 T2893 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d613c449e000a type:create cxid:0x45 zxid:0x60 txntype:-1 reqpath:n/a Error Path:/solr/collections/nodes_used_collection/leader_elect/shard1/election Error:KeeperErrorCode = NodeExists for /solr/collections/nodes_used_collection/leader_elect/shard1/election
[junit4:junit4]   2> 10854 T2921 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4]   2> 10857 T2921 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   2> 10864 T2921 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4]   2> 10866 T2893 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d613c449e0003 type:delete cxid:0x7e zxid:0x62 txntype:-1 reqpath:n/a Error Path:/solr/collections/nodes_used_collection/leaders Error:KeeperErrorCode = NoNode for /solr/collections/nodes_used_collection/leaders
[junit4:junit4]   2> 10867 T2904 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4]   2> 10870 T2893 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d613c449e0003 type:create cxid:0x7f zxid:0x63 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 10870 T2921 oass.SolrIndexSearcher.<init> Opening Searcher@444c0299 main
[junit4:junit4]   2> 10871 T2921 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1363135973188/nodes_used_collection_shard2_replica2/data/tlog
[junit4:junit4]   2> 10872 T2921 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4]   2> 10873 T2921 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4]   2> 10877 T2979 oasc.SolrCore.registerSearcher [nodes_used_collection_shard2_replica2] Registered new searcher Searcher@444c0299 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   2> 10879 T2921 oasc.ZkController.publish publishing core=nodes_used_collection_shard2_replica2 state=down
[junit4:junit4]   2> 10882 T2921 oasc.CoreContainer.registerCore registering core: nodes_used_collection_shard2_replica2
[junit4:junit4]   2> 10883 T2921 oasc.ZkController.register Register replica - core:nodes_used_collection_shard2_replica2 address:http://127.0.0.1:50003/d_/yo collection:nodes_used_collection shard:shard2
[junit4:junit4]   2> 11332 T2911 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 11333 T2911 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "core_node_name":null,
[junit4:junit4]   2> 	  "numShards":"2",
[junit4:junit4]   2> 	  "shard":"shard2",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"down",
[junit4:junit4]   2> 	  "core":"nodes_used_collection_shard2_replica1",
[junit4:junit4]   2> 	  "collection":"nodes_used_collection",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:50006_d_%2Fyo",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:50006/d_/yo"}
[junit4:junit4]   2> 11334 T2911 oasc.Overseer$ClusterStateUpdater.createCollection Create collection nodes_used_collection with numShards 2
[junit4:junit4]   2> 11337 T2893 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d613c449e0003 type:create cxid:0x86 zxid:0x67 txntype:-1 reqpath:n/a Error Path:/solr/overseer/queue-work Error:KeeperErrorCode = NoNode for /solr/overseer/queue-work
[junit4:junit4]   2> 11358 T2911 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "core_node_name":null,
[junit4:junit4]   2> 	  "numShards":"2",
[junit4:junit4]   2> 	  "shard":"shard1",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"down",
[junit4:junit4]   2> 	  "core":"nodes_used_collection_shard1_replica2",
[junit4:junit4]   2> 	  "collection":"nodes_used_collection",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:49999_d_%2Fyo",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:49999/d_/yo"}
[junit4:junit4]   2> 11364 T2911 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "core_node_name":null,
[junit4:junit4]   2> 	  "numShards":"2",
[junit4:junit4]   2> 	  "shard":"shard1",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"down",
[junit4:junit4]   2> 	  "core":"nodes_used_collection_shard1_replica1",
[junit4:junit4]   2> 	  "collection":"nodes_used_collection",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:50009_d_%2Fyo",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:50009/d_/yo"}
[junit4:junit4]   2> 11369 T2911 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "core_node_name":null,
[junit4:junit4]   2> 	  "numShards":"2",
[junit4:junit4]   2> 	  "shard":"shard2",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"down",
[junit4:junit4]   2> 	  "core":"nodes_used_collection_shard2_replica2",
[junit4:junit4]   2> 	  "collection":"nodes_used_collection",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:50003_d_%2Fyo",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:50003/d_/yo"}
[junit4:junit4]   2> 11379 T2970 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 11379 T2910 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 11384 T2928 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 11384 T2915 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 11385 T2956 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 11385 T2942 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 11779 T2936 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4]   2> 11780 T2936 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4]   2> 11780 T2936 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:50006/d_/yo/nodes_used_collection_shard2_replica1/
[junit4:junit4]   2> 11780 T2936 oasu.PeerSync.sync PeerSync: core=nodes_used_collection_shard2_replica1 url=http://127.0.0.1:50006/d_/yo START replicas=[http://127.0.0.1:50003/d_/yo/nodes_used_collection_shard2_replica2/] nUpdates=100
[junit4:junit4]   2> 11781 T2936 oasu.PeerSync.sync PeerSync: core=nodes_used_collection_shard2_replica1 url=http://127.0.0.1:50006/d_/yo DONE.  We have no versions.  sync failed.
[junit4:junit4]   2> 11782 T2936 oasc.SyncStrategy.syncReplicas Leader's attempt to sync with shard failed, moving to the next canidate
[junit4:junit4]   2> 11782 T2936 oasc.ShardLeaderElectionContext.runLeaderProcess We failed sync, but we have no versions - we can't sync in that case - we were active before, so become leader anyway
[junit4:junit4]   2> 11784 T2936 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:50006/d_/yo/nodes_used_collection_shard2_replica1/
[junit4:junit4]   2> 11784 T2936 oascc.SolrZkClient.makePath makePath: /collections/nodes_used_collection/leaders/shard2
[junit4:junit4]   2> 11797 T2893 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d613c449e0008 type:create cxid:0x5a zxid:0x7e txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> ASYNC  NEW_CORE C273 name=nodes_used_collection_shard2_replica2 org.apache.solr.core.SolrCore@70a70dfc url=http://127.0.0.1:50003/d_/yo/nodes_used_collection_shard2_replica2 node=127.0.0.1:50003_d_%2Fyo C273_STATE=coll:nodes_used_collection core:nodes_used_collection_shard2_replica2 props:{shard=shard2, state=down, core=nodes_used_collection_shard2_replica2, collection=nodes_used_collection, node_name=127.0.0.1:50003_d_%2Fyo, base_url=http://127.0.0.1:50003/d_/yo}
[junit4:junit4]   2> 11799 T2924 C273 P50003 REQ /get {getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=6 
[junit4:junit4]   2> 11888 T2904 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4]   2> 11889 T2904 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4]   2> 11889 T2904 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:49999/d_/yo/nodes_used_collection_shard1_replica2/
[junit4:junit4]   2> 11890 T2904 oasu.PeerSync.sync PeerSync: core=nodes_used_collection_shard1_replica2 url=http://127.0.0.1:49999/d_/yo START replicas=[http://127.0.0.1:50009/d_/yo/nodes_used_collection_shard1_replica1/] nUpdates=100
[junit4:junit4]   2> 11891 T2904 oasu.PeerSync.sync PeerSync: core=nodes_used_collection_shard1_replica2 url=http://127.0.0.1:49999/d_/yo DONE.  We have no versions.  sync failed.
[junit4:junit4]   2> 11892 T2904 oasc.SyncStrategy.syncReplicas Leader's attempt to sync with shard failed, moving to the next canidate
[junit4:junit4]   2> 11901 T2904 oasc.ShardLeaderElectionContext.runLeaderProcess We failed sync, but we have no versions - we can't sync in that case - we were active before, so become leader anyway
[junit4:junit4]   2> 11901 T2904 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:49999/d_/yo/nodes_used_collection_shard1_replica2/
[junit4:junit4]   2> 11902 T2904 oascc.SolrZkClient.makePath makePath: /collections/nodes_used_collection/leaders/shard1
[junit4:junit4]   2> ASYNC  NEW_CORE C274 name=nodes_used_collection_shard1_replica1 org.apache.solr.core.SolrCore@53bdd8b5 url=http://127.0.0.1:50009/d_/yo/nodes_used_collection_shard1_replica1 node=127.0.0.1:50009_d_%2Fyo C274_STATE=coll:nodes_used_collection core:nodes_used_collection_shard1_replica1 props:{shard=shard1, state=down, core=nodes_used_collection_shard1_replica1, collection=nodes_used_collection, node_name=127.0.0.1:50009_d_%2Fyo, base_url=http://127.0.0.1:50009/d_/yo}
[junit4:junit4]   2> 11900 T2949 C274 P50009 REQ /get {getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=1 
[junit4:junit4]   2> 11910 T2893 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d613c449e0003 type:create cxid:0xc8 zxid:0x81 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 12918 T2911 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 12934 T2956 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 12935 T2970 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 12935 T2942 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 12940 T2928 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 12941 T2915 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 12944 T2910 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 12988 T2936 oasc.ZkController.register We are http://127.0.0.1:50006/d_/yo/nodes_used_collection_shard2_replica1/ and leader is http://127.0.0.1:50006/d_/yo/nodes_used_collection_shard2_replica1/
[junit4:junit4]   2> 12988 T2921 oasc.ZkController.register We are http://127.0.0.1:50003/d_/yo/nodes_used_collection_shard2_replica2/ and leader is http://127.0.0.1:50006/d_/yo/nodes_used_collection_shard2_replica1/
[junit4:junit4]   2> 12989 T2936 oasc.ZkController.register No LogReplay needed for core=nodes_used_collection_shard2_replica1 baseURL=http://127.0.0.1:50006/d_/yo
[junit4:junit4]   2> 12989 T2921 oasc.ZkController.register No LogReplay needed for core=nodes_used_collection_shard2_replica2 baseURL=http://127.0.0.1:50003/d_/yo
[junit4:junit4]   2> 12989 T2936 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4]   2> 12989 T2921 oasc.ZkController.checkRecovery Core needs to recover:nodes_used_collection_shard2_replica2
[junit4:junit4]   2> 12990 T2921 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4:junit4]   2> 12990 T2936 oasc.ZkController.publish publishing core=nodes_used_collection_shard2_replica1 state=active
[junit4:junit4]   2> 12990 T2947 oasc.ZkController.register We are http://127.0.0.1:50009/d_/yo/nodes_used_collection_shard1_replica1/ and leader is http://127.0.0.1:49999/d_/yo/nodes_used_collection_shard1_replica2/
[junit4:junit4]   2> 12991 T2947 oasc.ZkController.register No LogReplay needed for core=nodes_used_collection_shard1_replica1 baseURL=http://127.0.0.1:50009/d_/yo
[junit4:junit4]   2> 12991 T2982 C273 P50003 oasc.RecoveryStrategy.run Starting recovery process.  core=nodes_used_collection_shard2_replica2 recoveringAfterStartup=true
[junit4:junit4]   2> 12992 T2982 C273 P50003 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4]   2> 12992 T2982 C273 P50003 oasc.ZkController.publish publishing core=nodes_used_collection_shard2_replica2 state=recovering
[junit4:junit4]   2> 12991 T2947 oasc.ZkController.checkRecovery Core needs to recover:nodes_used_collection_shard1_replica1
[junit4:junit4]   2> 12993 T2947 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4:junit4]   2> 12994 T2983 C274 P50009 oasc.RecoveryStrategy.run Starting recovery process.  core=nodes_used_collection_shard1_replica1 recoveringAfterStartup=true
[junit4:junit4]   2> 12995 T2983 C274 P50009 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4]   2> 12995 T2983 C274 P50009 oasc.ZkController.publish publishing core=nodes_used_collection_shard1_replica1 state=recovering
[junit4:junit4]   2> 12997 T2947 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 12997 T2921 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 12999 T2904 oasc.ZkController.register We are http://127.0.0.1:49999/d_/yo/nodes_used_collection_shard1_replica2/ and leader is http://127.0.0.1:49999/d_/yo/nodes_used_collection_shard1_replica2/
[junit4:junit4]   2> 13000 T2904 oasc.ZkController.register No LogReplay needed for core=nodes_used_collection_shard1_replica2 baseURL=http://127.0.0.1:49999/d_/yo
[junit4:junit4]   2> 13000 T2904 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4]   2> 13001 T2904 oasc.ZkController.publish publishing core=nodes_used_collection_shard1_replica2 state=active
[junit4:junit4]   2> 13001 T2983 C274 P50009 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 13011 T2947 oasc.CoreContainer.persistFile Persisting cores config to /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1363135976188/solr.xml
[junit4:junit4]   2> 13043 T2982 C273 P50003 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 13046 T2947 oasc.SolrXMLSerializer.persistFile Persisting cores config to /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1363135976188/solr.xml
[junit4:junit4]   2> 13048 T2947 oass.SolrDispatchFilter.handleAdminRequest /admin/cores {numShards=2&shard=shard1&name=nodes_used_collection_shard1_replica1&action=CREATE&collection=nodes_used_collection&wt=javabin&qt=/admin/cores&version=2} status=0 QTime=6316 
[junit4:junit4]   2> 13049 T2936 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 13051 T2921 oasc.CoreContainer.persistFile Persisting cores config to /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1363135973188/solr.xml
[junit4:junit4]   2> 13057 T2904 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 13059 T2904 oasc.CoreContainer.persistFile Persisting cores config to /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1363135972626/solr.xml
[junit4:junit4]   2> 13068 T2904 oasc.SolrXMLSerializer.persistFile Persisting cores config to /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1363135972626/solr.xml
[junit4:junit4]   2> 13071 T2904 oass.SolrDispatchFilter.handleAdminRequest /admin/cores {numShards=2&shard=shard1&name=nodes_used_collection_shard1_replica2&action=CREATE&collection=nodes_used_collection&wt=javabin&qt=/admin/cores&version=2} status=0 QTime=6343 
[junit4:junit4]   2> 13069 T2936 oasc.CoreContainer.persistFile Persisting cores config to /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1363135974676/solr.xml
[junit4:junit4]   2> 13084 T2921 oasc.SolrXMLSerializer.persistFile Persisting cores config to /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1363135973188/solr.xml
[junit4:junit4]   2> 13086 T2921 oass.SolrDispatchFilter.handleAdminRequest /admin/cores {numShards=2&shard=shard2&name=nodes_used_collection_shard2_replica2&action=CREATE&collection=nodes_used_collection&wt=javabin&qt=/admin/cores&version=2} status=0 QTime=6355 
[junit4:junit4]   2> 13095 T2936 oasc.SolrXMLSerializer.persistFile Persisting cores config to /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1363135974676/solr.xml
[junit4:junit4]   2> 13097 T2936 oass.SolrDispatchFilter.handleAdminRequest /admin/cores {numShards=2&shard=shard2&name=nodes_used_collection_shard2_replica1&action=CREATE&collection=nodes_used_collection&wt=javabin&qt=/admin/cores&version=2} status=0 QTime=6368 
[junit4:junit4]   2> 13098 T2912 oasc.OverseerCollectionProcessor.createCollection Successfully created all shards for collection nodes_used_collection
[junit4:junit4]   2> 13106 T2928 oasc.DistributedQueue$LatchChildWatcher.process Watcher fired on path: /overseer/collection-queue-work/qnr-0000000000 state: SyncConnected type NodeDataChanged
[junit4:junit4]   2> 13115 T2912 oasc.OverseerCollectionProcessor.run Overseer Collection Processor: Message id:/overseer/collection-queue-work/qn-0000000000 complete, response:{}
[junit4:junit4]   2> 13115 T2920 oass.SolrDispatchFilter.handleAdminRequest /admin/collections {numShards=2&name=nodes_used_collection&replicationFactor=2&action=CREATE&wt=javabin&version=2} status=0 QTime=6429 
[junit4:junit4]   2> 13116 T2888 oascsi.HttpClientUtil.createClient Creating new http client, config:
[junit4:junit4]   2> 13117 T2888 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:49996/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@57f1b4fd
[junit4:junit4]   2> 13118 T2888 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 13119 T2984 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:49996. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 13120 T2984 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:49996, initiating session
[junit4:junit4]   2> 13120 T2890 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:50024
[junit4:junit4]   2> 13121 T2890 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:50024
[junit4:junit4]   2> 13122 T2892 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d613c449e000d with negotiated timeout 10000 for client /127.0.0.1:50024
[junit4:junit4]   2> 13122 T2984 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:49996, sessionid = 0x13d613c449e000d, negotiated timeout = 10000
[junit4:junit4]   2> 13123 T2985 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@57f1b4fd name:ZooKeeperConnection Watcher:127.0.0.1:49996/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 13123 T2888 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 13128 T2888 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 13133 T2888 oascsi.HttpClientUtil.createClient Creating new http client, config:
[junit4:junit4]   2> 13137 T2888 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:49996/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@61e5e099
[junit4:junit4]   2> 13139 T2986 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:49996. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 13139 T2986 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:49996, initiating session
[junit4:junit4]   2> 13140 T2888 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 13141 T2890 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:50025
[junit4:junit4]   2> 13142 T2890 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:50025
[junit4:junit4]   2> 13143 T2986 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:49996, sessionid = 0x13d613c449e000e, negotiated timeout = 10000
[junit4:junit4]   2> 13144 T2987 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@61e5e099 name:ZooKeeperConnection Watcher:127.0.0.1:49996/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 13144 T2888 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 13145 T2892 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d613c449e000e with negotiated timeout 10000 for client /127.0.0.1:50025
[junit4:junit4]   2> 13146 T2888 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 13158 T2966 oasha.CollectionsHandler.handleCreateAction Creating Collection : numShards=1&maxShardsPerNode=1&name=awholynewcollection_0&replicationFactor=3&action=CREATE&wt=javabin&version=2
[junit4:junit4]   2> 13161 T2910 oasc.DistributedQueue$LatchChildWatcher.process Watcher fired on path: /overseer/collection-queue-work state: SyncConnected type NodeChildrenChanged
[junit4:junit4]   2> 13164 T2912 oasc.OverseerCollectionProcessor.run Overseer Collection Processor: Get the message id:/overseer/collection-queue-work/qn-0000000002 message:{
[junit4:junit4]   2> 	  "operation":"createcollection",
[junit4:junit4]   2> 	  "numShards":"1",
[junit4:junit4]   2> 	  "maxShardsPerNode":"1",
[junit4:junit4]   2> 	  "createNodeSet":null,
[junit4:junit4]   2> 	  "name":"awholynewcollection_0",
[junit4:junit4]   2> 	  "replicationFactor":"3"}
[junit4:junit4]   2> 13164 T2912 oasc.OverseerCollectionProcessor.createCollection Creating shard awholynewcollection_0_shard1_replica1 as part of slice shard1 of collection awholynewcollection_0 on 127.0.0.1:49999_d_%2Fyo
[junit4:junit4]   2> 13165 T2912 oasc.OverseerCollectionProcessor.createCollection Creating shard awholynewcollection_0_shard1_replica2 as part of slice shard1 of collection awholynewcollection_0 on 127.0.0.1:50009_d_%2Fyo
[junit4:junit4]   2> 13165 T2912 oasc.OverseerCollectionProcessor.createCollection Creating shard awholynewcollection_0_shard1_replica3 as part of slice shard1 of collection awholynewcollection_0 on 127.0.0.1:50006_d_%2Fyo
[junit4:junit4]   2> 13169 T2946 oasc.CoreContainer.create Creating SolrCore 'awholynewcollection_0_shard1_replica2' using instanceDir: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1363135976188/awholynewcollection_0_shard1_replica2
[junit4:junit4]   2> 13169 T2946 oasc.ZkController.createCollectionZkNode Check for collection zkNode:awholynewcollection_0
[junit4:junit4]   2> 13178 T2905 oasc.CoreContainer.create Creating SolrCore 'awholynewcollection_0_shard1_replica1' using instanceDir: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1363135972626/awholynewcollection_0_shard1_replica1
[junit4:junit4]   2> 13178 T2905 oasc.ZkController.createCollectionZkNode Check for collection zkNode:awholynewcollection_0
[junit4:junit4]   2> 13179 T2935 oasc.CoreContainer.create Creating SolrCore 'awholynewcollection_0_shard1_replica3' using instanceDir: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1363135974676/awholynewcollection_0_shard1_replica3
[junit4:junit4]   2> 13179 T2935 oasc.ZkController.createCollectionZkNode Check for collection zkNode:awholynewcollection_0
[junit4:junit4]   2> 13181 T2946 oasc.ZkController.createCollectionZkNode Creating collection in ZooKeeper:awholynewcollection_0
[junit4:junit4]   2> 13181 T2946 oasc.ZkController.getConfName Looking for collection configName
[junit4:junit4]   2> 13182 T2905 oasc.ZkController.createCollectionZkNode Creating collection in ZooKeeper:awholynewcollection_0
[junit4:junit4]   2> 13183 T2905 oasc.ZkController.getConfName Looking for collection configName
[junit4:junit4]   2> 13184 T2935 oasc.ZkController.createCollectionZkNode Creating collection in ZooKeeper:awholynewcollection_0
[junit4:junit4]   2> 13184 T2935 oasc.ZkController.getConfName Looking for collection configName
[junit4:junit4]   2> 13185 T2946 oasc.ZkController.getConfName Only one config set found in zk - using it:conf1
[junit4:junit4]   2> 13185 T2905 oasc.ZkController.getConfName Only one config set found in zk - using it:conf1
[junit4:junit4]   2> 13186 T2946 oascc.SolrZkClient.makePath makePath: /collections/awholynewcollection_0
[junit4:junit4]   2> 13186 T2905 oascc.SolrZkClient.makePath makePath: /collections/awholynewcollection_0
[junit4:junit4]   2> 13191 T2935 oasc.ZkController.getConfName Only one config set found in zk - using it:conf1
[junit4:junit4]   2> 13192 T2935 oascc.SolrZkClient.makePath makePath: /collections/awholynewcollection_0
[junit4:junit4]   2> 13193 T2946 oasc.ZkController.readConfigName Load collection config from:/collections/awholynewcollection_0
[junit4:junit4]   2> 13196 T2946 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1363135976188/awholynewcollection_0_shard1_replica2/'
[junit4:junit4]   2> 13217 T2893 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d613c449e0008 type:create cxid:0x67 zxid:0x96 txntype:-1 reqpath:n/a Error Path:/solr/collections/awholynewcollection_0 Error:KeeperErrorCode = NodeExists for /solr/collections/awholynewcollection_0
[junit4:junit4]   2> 13223 T2893 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d613c449e0003 type:create cxid:0xf5 zxid:0x97 txntype:-1 reqpath:n/a Error Path:/solr/collections/awholynewcollection_0 Error:KeeperErrorCode = NodeExists for /solr/collections/awholynewcollection_0
[junit4:junit4]   2> 13233 T2935 oasc.ZkController.readConfigName Load collection config from:/collections/awholynewcollection_0
[junit4:junit4]   2> 13240 T2905 oasc.ZkController.readConfigName Load collection config from:/collections/awholynewcollection_0
[junit4:junit4]   2> 13241 T2935 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1363135974676/awholynewcollection_0_shard1_replica3/'
[junit4:junit4]   2> 13274 T2946 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4]   2> 13290 T2905 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1363135972626/awholynewcollection_0_shard1_replica1/'
[junit4:junit4]   2> 13404 T2935 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4]   2> 13419 T2946 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   2> 13426 T2905 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4]   2> 13431 T2946 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4]   2> 13486 T2946 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4]   2> 13572 T2935 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   2> 13585 T2905 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   2> 13586 T2905 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4]   2> 13593 T2905 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4]   2> 13617 T2935 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4]   2> 13623 T2935 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4]   2> 14488 T2911 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 14494 T2911 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "core_node_name":null,
[junit4:junit4]   2> 	  "numShards":"2",
[junit4:junit4]   2> 	  "shard":"shard2",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"active",
[junit4:junit4]   2> 	  "core":"nodes_used_collection_shard2_replica1",
[junit4:junit4]   2> 	  "collection":"nodes_used_collection",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:50006_d_%2Fyo",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:50006/d_/yo"}
[junit4:junit4]   2> 14504 T2911 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "core_node_name":null,
[junit4:junit4]   2> 	  "numShards":"2",
[junit4:junit4]   2> 	  "shard":"shard2",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"recovering",
[junit4:junit4]   2> 	  "core":"nodes_used_collection_shard2_replica2",
[junit4:junit4]   2> 	  "collection":"nodes_used_collection",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:50003_d_%2Fyo",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:50003/d_/yo"}
[junit4:junit4]   2> 14523 T2911 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "core_node_name":null,
[junit4:junit4]   2> 	  "numShards":"2",
[junit4:junit4]   2> 	  "shard":"shard1",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"recovering",
[junit4:junit4]   2> 	  "core":"nodes_used_collection_shard1_replica1",
[junit4:junit4]   2> 	  "collection":"nodes_used_collection",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:50009_d_%2Fyo",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:50009/d_/yo"}
[junit4:junit4]   2> 14605 T2911 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "core_node_name":null,
[junit4:junit4]   2> 	  "numShards":"2",
[junit4:junit4]   2> 	  "shard":"shard1",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"active",
[junit4:junit4]   2> 	  "core":"nodes_used_collection_shard1_replica2",
[junit4:junit4]   2> 	  "collection":"nodes_used_collection",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:49999_d_%2Fyo",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:49999/d_/yo"}
[junit4:junit4]   2> 14714 T2956 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 14715 T2987 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 14716 T2985 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 14716 T2970 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 14717 T2928 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 14717 T2942 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 14717 T2915 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 14722 T2910 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 15052 T2903 oass.SolrDispatchFilter.handleAdminRequest /admin/cores {coreNodeName=127.0.0.1:50009_d_%252Fyo_nodes_used_collection_shard1_replica1&state=recovering&nodeName=127.0.0.1:50009_d_%252Fyo&action=PREPRECOVERY&checkLive=true&core=nodes_used_collection_shard1_replica2&wt=javabin&onlyIfLeader=true&version=2} status=0 QTime=2003 
[junit4:junit4]   2> 15084 T2934 oass.SolrDispatchFilter.handleAdminRequest /admin/cores {coreNodeName=127.0.0.1:50003_d_%252Fyo_nodes_used_collection_shard2_replica2&state=recovering&nodeName=127.0.0.1:50003_d_%252Fyo&action=PREPRECOVERY&checkLive=true&core=nodes_used_collection_shard2_replica1&wt=javabin&onlyIfLeader=true&version=2} status=0 QTime=2029 
[junit4:junit4]   2> 15361 T2905 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   2> 15371 T2905 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4]   2> 15377 T2935 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   2> 15399 T2905 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> 15413 T2935 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4]   2> 15417 T2935 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> 15454 T2946 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   2> 15476 T2946 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4]   2> 15483 T2946 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> 15490 T2905 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 15497 T2905 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 15507 T2905 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 15523 T2946 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 15530 T2905 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4]   2> 15530 T2905 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4]   2> 15531 T2905 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 15531 T2946 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 15534 T2905 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4]   2> 15542 T2905 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4]   2> 15542 T2905 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4]   2> 15543 T2905 oasc.SolrCore.<init> [awholynewcollection_0_shard1_replica1] Opening new SolrCore at /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1363135972626/awholynewcollection_0_shard1_replica1/, dataDir=/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1363135972626/awholynewcollection_0_shard1_replica1/data/
[junit4:junit4]   2> 15543 T2905 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@7d4acb8
[junit4:junit4]   2> 15546 T2905 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4]   2> 15547 T2946 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 15548 T2905 oasc.CachingDirectoryFactory.get return new directory for /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1363135972626/awholynewcollection_0_shard1_replica1/data forceNew: false
[junit4:junit4]   2> 15548 T2905 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1363135972626/awholynewcollection_0_shard1_replica1/data/index/
[junit4:junit4]   2> 15549 T2905 oasc.SolrCore.initIndex WARNING [awholynewcollection_0_shard1_replica1] Solr index directory '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1363135972626/awholynewcollection_0_shard1_replica1/data/index' doesn't exist. Creating new index...
[junit4:junit4]   2> 15550 T2935 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 15550 T2905 oasc.CachingDirectoryFactory.get return new directory for /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1363135972626/awholynewcollection_0_shard1_replica1/data/index forceNew: false
[junit4:junit4]   2> 15553 T2946 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4]   2> 15553 T2946 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4]   2> 15554 T2946 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 15555 T2946 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4]   2> 15556 T2946 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4]   2> 15556 T2946 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4]   2> 15557 T2946 oasc.SolrCore.<init> [awholynewcollection_0_shard1_replica2] Opening new SolrCore at /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1363135976188/awholynewcollection_0_shard1_replica2/, dataDir=/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1363135976188/awholynewcollection_0_shard1_replica2/data/
[junit4:junit4]   2> 15558 T2946 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@7d4acb8
[junit4:junit4]   2> 15553 T2905 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4]   2> 		commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@2484ce98 lockFactory=org.apache.lucene.store.NativeFSLockFactory@2fb2a5c5),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 15558 T2905 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4]   2> 15562 T2905 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   2> 15558 T2935 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 15558 T2946 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4]   2> 15564 T2946 oasc.CachingDirectoryFactory.get return new directory for /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1363135976188/awholynewcollection_0_shard1_replica2/data forceNew: false
[junit4:junit4]   2> 15565 T2946 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1363135976188/awholynewcollection_0_shard1_replica2/data/index/
[junit4:junit4]   2> 15565 T2946 oasc.SolrCore.initIndex WARNING [awholynewcollection_0_shard1_replica2] Solr index directory '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1363135976188/awholynewcollection_0_shard1_replica2/data/index' doesn't exist. Creating new index...
[junit4:junit4]   2> 15566 T2946 oasc.CachingDirectoryFactory.get return new directory for /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1363135976188/awholynewcollection_0_shard1_replica2/data/index forceNew: false
[junit4:junit4]   2> 15567 T2905 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   2> 15569 T2905 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   2> 15570 T2905 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4]   2> 15570 T2905 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4]   2> 15571 T2905 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   2> 15571 T2905 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4]   2> 15572 T2905 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4]   2> 15573 T2905 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   2> 15575 T2946 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4]   2> 		commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@709633b2 lockFactory=org.apache.lucene.store.NativeFSLockFactory@6ab833fe),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 15575 T2946 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4]   2> 15579 T2946 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   2> 15579 T2946 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   2> 15581 T2946 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   2> 15581 T2946 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4]   2> 15582 T2946 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4]   2> 15582 T2946 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   2> 15583 T2946 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4]   2> 15585 T2905 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4]   2> 15590 T2946 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4]   2> 15591 T2946 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   2> 15594 T2905 oass.SolrIndexSearcher.<init> Opening Searcher@3728eed8 main
[junit4:junit4]   2> 15595 T2905 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1363135972626/awholynewcollection_0_shard1_replica1/data/tlog
[junit4:junit4]   2> 15596 T2905 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4]   2> 15597 T2905 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4]   2> 15600 T2988 oasc.SolrCore.registerSearcher [awholynewcollection_0_shard1_replica1] Registered new searcher Searcher@3728eed8 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   2> 15603 T2905 oasc.ZkController.publish publishing core=awholynewcollection_0_shard1_replica1 state=down
[junit4:junit4]   2> 15606 T2946 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4]   2> 15606 T2935 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 15610 T2946 oass.SolrIndexSearcher.<init> Opening Searcher@6d7bcfa6 main
[junit4:junit4]   2> 15611 T2946 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1363135976188/awholynewcollection_0_shard1_replica2/data/tlog
[junit4:junit4]   2> 15612 T2946 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4]   2> 15612 T2946 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4]   2> 15622 T2989 oasc.SolrCore.registerSearcher [awholynewcollection_0_shard1_replica2] Registered new searcher Searcher@6d7bcfa6 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   2> 15607 T2905 oasc.CoreContainer.registerCore registering core: awholynewcollection_0_shard1_replica1
[junit4:junit4]   2> 15622 T2935 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4]   2> 15622 T2935 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4]   2> 15623 T2935 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 15623 T2905 oasc.ZkController.register Register replica - core:awholynewcollection_0_shard1_replica1 address:http://127.0.0.1:49999/d_/yo collection:awholynewcollection_0 shard:shard1
[junit4:junit4]   2> 15625 T2946 oasc.ZkController.publish publishing core=awholynewcollection_0_shard1_replica2 state=down
[junit4:junit4]   2> 15625 T2905 oascc.SolrZkClient.makePath makePath: /collections/awholynewcollection_0/leader_elect/shard1/election
[junit4:junit4]   2> 15630 T2935 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4]   2> 15630 T2935 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4]   2> 15631 T2935 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4]   2> 15631 T2935 oasc.SolrCore.<init> [awholynewcollection_0_shard1_replica3] Opening new SolrCore at /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1363135974676/awholynewcollection_0_shard1_replica3/, dataDir=/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1363135974676/awholynewcollection_0_shard1_replica3/data/
[junit4:junit4]   2> 15632 T2935 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@7d4acb8
[junit4:junit4]   2> 15632 T2935 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4]   2> 15634 T2935 oasc.CachingDirectoryFactory.get return new directory for /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1363135974676/awholynewcollection_0_shard1_replica3/data forceNew: false
[junit4:junit4]   2> 15634 T2935 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1363135974676/awholynewcollection_0_shard1_replica3/data/index/
[junit4:junit4]   2> 15635 T2935 oasc.SolrCore.initIndex WARNING [awholynewcollection_0_shard1_replica3] Solr index directory '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1363135974676/awholynewcollection_0_shard1_replica3/data/index' doesn't exist. Creating new index...
[junit4:junit4]   2> 15635 T2935 oasc.CachingDirectoryFactory.get return new directory for /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1363135974676/awholynewcollection_0_shard1_replica3/data/index forceNew: false
[junit4:junit4]   2> 15635 T2946 oasc.CoreContainer.registerCore registering core: awholynewcollection_0_shard1_replica2
[junit4:junit4]   2> 15639 T2946 oasc.ZkController.register Register replica - core:awholynewcollection_0_shard1_replica2 address:http://127.0.0.1:50009/d_/yo collection:awholynewcollection_0 shard:shard1
[junit4:junit4]   2> 15639 T2935 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4]   2> 		commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@1a975e90 lockFactory=org.apache.lucene.store.NativeFSLockFactory@63cc12b2),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 15640 T2935 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4]   2> 15644 T2946 oascc.SolrZkClient.makePath makePath: /collections/awholynewcollection_0/leader_elect/shard1/election
[junit4:junit4]   2> 15649 T2935 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   2> 15649 T2935 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   2> 15650 T2935 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   2> 15651 T2935 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4]   2> 15652 T2935 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4]   2> 15653 T2935 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   2> 15654 T2935 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4]   2> 15654 T2935 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4]   2> 15656 T2935 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   2> 15662 T2935 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4]   2> 15666 T2893 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d613c449e0003 type:delete cxid:0x14f zxid:0xab txntype:-1 reqpath:n/a Error Path:/solr/collections/awholynewcollection_0/leaders Error:KeeperErrorCode = NoNode for /solr/collections/awholynewcollection_0/leaders
[junit4:junit4]   2> 15667 T2905 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4]   2> 15668 T2893 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d613c449e0003 type:create cxid:0x150 zxid:0xac txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 15672 T2893 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d613c449e000a type:create cxid:0x83 zxid:0xae txntype:-1 reqpath:n/a Error Path:/solr/collections/awholynewcollection_0/leader_elect/shard1/election Error:KeeperErrorCode = NodeExists for /solr/collections/awholynewcollection_0/leader_elect/shard1/election
[junit4:junit4]   2> 15673 T2935 oass.SolrIndexSearcher.<init> Opening Searcher@35c9e2cd main
[junit4:junit4]   2> 15673 T2935 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1363135974676/awholynewcollection_0_shard1_replica3/data/tlog
[junit4:junit4]   2> 15680 T2935 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4]   2> 15682 T2935 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4]   2> 15687 T2990 oasc.SolrCore.registerSearcher [awholynewcollection_0_shard1_replica3] Registered new searcher Searcher@35c9e2cd main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   2> 15690 T2935 oasc.ZkController.publish publishing core=awholynewcollection_0_shard1_replica3 state=down
[junit4:junit4]   2> 15692 T2935 oasc.CoreContainer.registerCore registering core: awholynewcollection_0_shard1_replica3
[junit4:junit4]   2> 15692 T2935 oasc.ZkController.register Register replica - core:awholynewcollection_0_shard1_replica3 address:http://127.0.0.1:50006/d_/yo collection:awholynewcollection_0 shard:shard1
[junit4:junit4]   2> 16300 T2911 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 16302 T2911 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "core_node_name":null,
[junit4:junit4]   2> 	  "numShards":"1",
[junit4:junit4]   2> 	  "shard":"shard1",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"down",
[junit4:junit4]   2> 	  "core":"awholynewcollection_0_shard1_replica1",
[junit4:junit4]   2> 	  "collection":"awholynewcollection_0",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:49999_d_%2Fyo",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:49999/d_/yo"}
[junit4:junit4]   2> 16302 T2911 oasc.Overseer$ClusterStateUpdater.createCollection Create collection awholynewcollection_0 with numShards 1
[junit4:junit4]   2> 16307 T2911 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "core_node_name":null,
[junit4:junit4]   2> 	  "numShards":"1",
[junit4:junit4]   2> 	  "shard":"shard1",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"down",
[junit4:junit4]   2> 	  "core":"awholynewcollection_0_shard1_replica2",
[junit4:junit4]   2> 	  "collection":"awholynewcollection_0",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:50009_d_%2Fyo",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:50009/d_/yo"}
[junit4:junit4]   2> 16317 T2911 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "core_node_name":null,
[junit4:junit4]   2> 	  "numShards":"1",
[junit4:junit4]   2> 	  "shard":"shard1",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"down",
[junit4:junit4]   2> 	  "core":"awholynewcollection_0_shard1_replica3",
[junit4:junit4]   2> 	  "collection":"awholynewcollection_0",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:50006_d_%2Fyo",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:50006/d_/yo"}
[junit4:junit4]   2> 16324 T2970 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 16324 T2985 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 16324 T2942 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 16328 T2956 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 16330 T2987 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 16331 T2915 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 16332 T2910 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 16333 T2928 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 16674 T2905 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4]   2> 16675 T2905 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4]   2> 16675 T2905 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:49999/d_/yo/awholynewcollection_0_shard1_replica1/
[junit4:junit4]   2> 16676 T2905 oasu.PeerSync.sync PeerSync: core=awholynewcollection_0_shard1_replica1 url=http://127.0.0.1:49999/d_/yo START replicas=[http://127.0.0.1:50009/d_/yo/awholynewcollection_0_shard1_replica2/, http://127.0.0.1:50006/d_/yo/awholynewcollection_0_shard1_replica3/] nUpdates=100
[junit4:junit4]   2> 16678 T2905 oasu.PeerSync.sync PeerSync: core=awholynewcollection_0_shard1_replica1 url=http://127.0.0.1:49999/d_/yo DONE.  We have no versions.  sync failed.
[junit4:junit4]   2> 16678 T2905 oasc.SyncStrategy.syncReplicas Leader's attempt to sync with shard failed, moving to the next canidate
[junit4:junit4]   2> 16678 T2905 oasc.ShardLeaderElectionContext.runLeaderProcess We failed sync, but we have no versions - we can't sync in that case - we were active before, so become leader anyway
[junit4:junit4]   2> 16679 T2905 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:49999/d_/yo/awholynewcollection_0_shard1_replica1/
[junit4:junit4]   2> 16679 T2905 oascc.SolrZkClient.makePath makePath: /collections/awholynewcollection_0/leaders/shard1
[junit4:junit4]   2> ASYNC  NEW_CORE C275 name=awholynewcollection_0_shard1_replica3 org.apache.solr.core.SolrCore@48f5f445 url=http://127.0.0.1:50006/d_/yo/awholynewcollection_0_shard1_replica3 node=127.0.0.1:50006_d_%2Fyo C275_STATE=coll:awholynewcollection_0 core:awholynewcollection_0_shard1_replica3 props:{shard=shard1, state=down, core=awholynewcollection_0_shard1_replica3, collection=awholynewcollection_0, node_name=127.0.0.1:50006_d_%2Fyo, base_url=http://127.0.0.1:50006/d_/yo}
[junit4:junit4]   2> 16698 T2934 C275 P50006 REQ /get {getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=4 
[junit4:junit4]   2> ASYNC  NEW_CORE C276 name=awholynewcollection_0_shard1_replica2 org.apache.solr.core.SolrCore@1f3dd896 url=http://127.0.0.1:50009/d_/yo/awholynewcollection_0_shard1_replica2 node=127.0.0.1:50009_d_%2Fyo C276_STATE=coll:awholynewcollection_0 core:awholynewcollection_0_shard1_replica2 props:{shard=shard1, state=down, core=awholynewcollection_0_shard1_replica2, collection=awholynewcollection_0, node_name=127.0.0.1:50009_d_%2Fyo, base_url=http://127.0.0.1:50009/d_/yo}
[junit4:junit4]   2> 16710 T2951 C276 P50009 REQ /get {getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=3 
[junit4:junit4]   2> 16711 T2893 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d613c449e0003 type:create cxid:0x186 zxid:0xc1 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2>  C274_STATE=coll:nodes_used_collection core:nodes_used_collection_shard1_replica1 props:{shard=shard1, state=recovering, core=nodes_used_collection_shard1_replica1, collection=nodes_used_collection, node_name=127.0.0.1:50009_d_%2Fyo, base_url=http://127.0.0.1:50009/d_/yo}
[junit4:junit4]   2> 17054 T2983 C274 P50009 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:49999/d_/yo/nodes_used_collection_shard1_replica2/ core=nodes_used_collection_shard1_replica1 - recoveringAfterStartup=true
[junit4:junit4]   2> 17055 T2983 C274 P50009 oasu.PeerSync.sync PeerSync: core=nodes_used_collection_shard1_replica1 url=http://127.0.0.1:50009/d_/yo START replicas=[http://127.0.0.1:49999/d_/yo/nodes_used_collection_shard1_replica2/] nUpdates=100
[junit4:junit4]   2> 17055 T2983 C274 P50009 oasu.PeerSync.sync WARNING no frame of reference to tell of we've missed updates
[junit4:junit4]   2> 17055 T2983 C274 P50009 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=nodes_used_collection_shard1_replica1
[junit4:junit4]   2> 17056 T2983 C274 P50009 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=nodes_used_collection_shard1_replica1
[junit4:junit4]   2> 17056 T2983 C274 P50009 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=nodes_used_collection_shard1_replica1
[junit4:junit4]   2> 17056 T2983 C274 P50009 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4]   2> 17056 T2983 C274 P50009 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:49999/d_/yo/nodes_used_collection_shard1_replica2/. core=nodes_used_collection_shard1_replica1
[junit4:junit4]   2> 17057 T2983 C274 P50009 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> ASYNC  NEW_CORE C277 name=nodes_used_collection_shard1_replica2 org.apache.solr.core.SolrCore@91d12cf url=http://127.0.0.1:49999/d_/yo/nodes_used_collection_shard1_replica2 node=127.0.0.1:49999_d_%2Fyo C277_STATE=coll:nodes_used_collection core:nodes_used_collection_shard1_replica2 props:{shard=shard1, state=active, core=nodes_used_collection_shard1_replica2, collection=nodes_used_collection, node_name=127.0.0.1:49999_d_%2Fyo, base_url=http://127.0.0.1:49999/d_/yo, leader=true}
[junit4:junit4]   2> 17075 T2899 C277 P49999 REQ /get {getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=0 
[junit4:junit4]   2> 17078 T2902 C277 P49999 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4]   2> 17080 T2902 C277 P49999 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4]   2> 		commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@16665884 lockFactory=org.apache.lucene.store.NativeFSLockFactory@7b184c1),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 17080 T2902 C277 P49999 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4]   2> 17084 T2902 C277 P49999 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4]   2> 		commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@16665884 lockFactory=org.apache.lucene.store.NativeFSLockFactory@7b184c1),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 		commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@16665884 lockFactory=org.apache.lucene.store.NativeFSLockFactory@7b184c1),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4]   2> 17085 T2902 C277 P49999 oasc.SolrDeletionPolicy.updateCommits newest commit = 2[segments_2]
[junit4:junit4]   2> 17085 T2902 C277 P49999 oass.SolrIndexSearcher.<init> Opening Searcher@4ebba926 realtime
[junit4:junit4]   2> 17086 T2902 C277 P49999 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4]   2> 17086 T2902 C277 P49999 /update {waitSearcher=true&openSearcher=false&commit=true&wt=javabin&commit_end_point=true&version=2&softCommit=false} {commit=} 0 8
[junit4:junit4]   2> 17087 T2983 C274 P50009 oash.ReplicationHandler.inform Commits will be reserved for  10000
[junit4:junit4]   2> 17088 T2983 C274 P50009 oash.SnapPuller.<init>  No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4]   2> 17091 T2906 C277 P49999 oash.ReplicationHandler.inform Commits will be reserved for  10000
[junit4:junit4]   2> 17092 T2906 C277 P49999 REQ /replication {command=indexversion&qt=/replication&wt=javabin&version=2} status=0 QTime=2 
[junit4:junit4]   2> 17093 T2983 C274 P50009 oash.SnapPuller.fetchLatestIndex Master's generation: 2
[junit4:junit4]   2> 17093 T2983 C274 P50009 oash.SnapPuller.fetchLatestIndex Slave's generation: 1
[junit4:junit4]   2> 17094 T2983 C274 P50009 oash.SnapPuller.fetchLatestIndex Starting replication process
[junit4:junit4]   2>  C273_STATE=coll:nodes_used_collection core:nodes_used_collection_shard2_replica2 props:{shard=shard2, state=recovering, core=nodes_used_collection_shard2_replica2, collection=nodes_used_collection, node_name=127.0.0.1:50003_d_%2Fyo, base_url=http://127.0.0.1:50003/d_/yo}
[junit4:junit4]   2> 17095 T2982 C273 P50003 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:50006/d_/yo/nodes_used_collection_shard2_replica1/ core=nodes_used_collection_shard2_replica2 - recoveringAfterStartup=true
[junit4:junit4]   2> 17095 T2982 C273 P50003 oasu.PeerSync.sync PeerSync: core=nodes_used_collection_shard2_replica2 url=http://127.0.0.1:50003/d_/yo START replicas=[http://127.0.0.1:50006/d_/yo/nodes_used_collection_shard2_replica1/] nUpdates=100
[junit4:junit4]   2> 17097 T2903 C277 P49999 REQ /replication {command=filelist&qt=/replication&wt=javabin&generation=2&version=2} status=0 QTime=0 
[junit4:junit4]   2> 17098 T2983 C274 P50009 oash.SnapPuller.fetchLatestIndex Number of files in latest index in master: 1
[junit4:junit4]   2> 17099 T2982 C273 P50003 oasu.PeerSync.sync WARNING no frame of reference to tell of we've missed updates
[junit4:junit4]   2> 17099 T2982 C273 P50003 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=nodes_used_collection_shard2_replica2
[junit4:junit4]   2> 17100 T2982 C273 P50003 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=nodes_used_collection_shard2_replica2
[junit4:junit4]   2> 17100 T2982 C273 P50003 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=nodes_used_collection_shard2_replica2
[junit4:junit4]   2> 17100 T2982 C273 P50003 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4]   2> 17107 T2982 C273 P50003 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:50006/d_/yo/nodes_used_collection_shard2_replica1/. core=nodes_used_collection_shard2_replica2
[junit4:junit4]   2> 17108 T2982 C273 P50003 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 17105 T2983 C274 P50009 oasc.CachingDirectoryFactory.get return new directory for /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1363135976188/nodes_used_collection_shard1_replica1/data/index.20130313005309582 forceNew: false
[junit4:junit4]   2> 17111 T2983 C274 P50009 oash.SnapPuller.fetchLatestIndex Starting download to MockDirWrapper(org.apache.lucene.store.RAMDirectory@3413fbe lockFactory=org.apache.lucene.store.NativeFSLockFactory@21fa86c) fullCopy=false
[junit4:junit4]   2> ASYNC  NEW_CORE C278 name=nodes_used_collection_shard2_replica1 org.apache.solr.core.SolrCore@6f6574f0 url=http://127.0.0.1:50006/d_/yo/nodes_used_collection_shard2_replica1 node=127.0.0.1:50006_d_%2Fyo C278_STATE=coll:nodes_used_collection core:nodes_used_collection_shard2_replica1 props:{shard=shard2, state=active, core=nodes_used_collection_shard2_replica1, collection=nodes_used_collection, node_name=127.0.0.1:50006_d_%2Fyo, base_url=http://127.0.0.1:50006/d_/yo, leader=true}
[junit4:junit4]   2> 17119 T2938 C278 P50006 REQ /get {getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=1 
[junit4:junit4]   2> 17121 T2902 C277 P49999 REQ /replication {file=segments_2&command=filecontent&checksum=true&wt=filestream&qt=/replication&generation=2} status=0 QTime=0 
[junit4:junit4]   2> 17121 T2933 C278 P50006 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4]   2> 17123 T2983 C274 P50009 oash.SnapPuller.fetchLatestIndex Total time taken for download : 0 secs
[junit4:junit4]   2> 17124 T2933 C278 P50006 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4]   2> 		commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@2dbe43d lockFactory=org.apache.lucene.store.NativeFSLockFactory@1e15f4e7),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 17124 T2983 C274 P50009 oasu.DefaultSolrCoreState.newIndexWriter Creating new IndexWriter...
[junit4:junit4]   2> 17125 T2933 C278 P50006 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4]   2> 17125 T2983 C274 P50009 oasu.DefaultSolrCoreState.newIndexWriter Waiting until IndexWriter is unused... core=nodes_used_collection_shard1_replica1
[junit4:junit4]   2> 17130 T2983 C274 P50009 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=2
[junit4:junit4]   2> 		commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@73dcc7be lockFactory=org.apache.lucene.store.NativeFSLockFactory@2a994e),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 		commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@73dcc7be lockFactory=org.apache.lucene.store.NativeFSLockFactory@2a994e),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4]   2> 17135 T2983 C274 P50009 oasc.SolrDeletionPolicy.updateCommits newest commit = 2[segments_2]
[junit4:junit4]   2> 17136 T2983 C274 P50009 oasu.DefaultSolrCoreState.newIndexWriter New IndexWriter is ready to be used.
[junit4:junit4]   2> 17137 T2983 C274 P50009 oass.SolrIndexSearcher.<init> Opening Searcher@2791d6ad main
[junit4:junit4]   2> 17137 T2933 C278 P50006 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4]   2> 		commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@2dbe43d lockFactory=org.apache.lucene.store.NativeFSLockFactory@1e15f4e7),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 		commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@2dbe43d lockFactory=org.apache.lucene.store.NativeFSLockFactory@1e15f4e7),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4]   2> 17138 T2933 C278 P50006 oasc.SolrDeletionPolicy.updateCommits newest commit = 2[segments_2]
[junit4:junit4]   2> 17138 T2933 C278 P50006 oass.SolrIndexSearcher.<init> Opening Searcher@7a6c5d96 realtime
[junit4:junit4]   2> 17139 T2933 C278 P50006 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4]   2> 17139 T2933 C278 P50006 /update {waitSearcher=true&openSearcher=false&commit=true&wt=javabin&commit_end_point=true&version=2&softCommit=false} {commit=} 0 18
[junit4:junit4]   2> 17141 T2978 oasc.SolrCore.registerSearcher [nodes_used_collection_shard1_replica1] Registered new searcher Searcher@2791d6ad main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4]   2> 17142 T2983 C274 P50009 oash.SnapPuller.fetchLatestIndex removing temporary index download directory files MockDirWrapper(org.apache.lucene.store.RAMDirectory@3413fbe lockFactory=org.apache.lucene.store.NativeFSLockFactory@21fa86c)
[junit4:junit4]   2> 17142 T2983 C274 P50009 oasc.RecoveryStrategy.replay No replay needed. core=nodes_used_collection_shard1_replica1
[junit4:junit4]   2> 17142 T2983 C274 P50009 oasc.RecoveryStrategy.doRecovery Replication Recovery was successful - registering as Active. core=nodes_used_collection_shard1_replica1
[junit4:junit4]   2> 17142 T2983 C274 P50009 oasc.ZkController.publish publishing core=nodes_used_collection_shard1_replica1 state=active
[junit4:junit4]   2> 17146 T2982 C273 P50003 oash.ReplicationHandler.inform Commits will be reserved for  10000
[junit4:junit4]   2> 17146 T2982 C273 P50003 oash.SnapPuller.<init>  No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4]   2> 17147 T2983 C274 P50009 oasc.RecoveryStrategy.doRecovery Finished recovery process. core=nodes_used_collection_shard1_replica1
[junit4:junit4]   2> 17151 T2934 C278 P50006 oash.ReplicationHandler.inform Commits will be reserved for  10000
[junit4:junit4]   2> 17152 T2934 C278 P50006 REQ /replication {command=indexversion&qt=/replication&wt=javabin&version=2} status=0 QTime=3 
[junit4:junit4]   2> 17154 T2982 C273 P50003 oash.SnapPuller.fetchLatestIndex Master's generation: 2
[junit4:junit4]   2> 17154 T2982 C273 P50003 oash.SnapPuller.fetchLatestIndex Slave's generation: 1
[junit4:junit4]   2> 17154 T2982 C273 P50003 oash.SnapPuller.fetchLatestIndex Starting replication process
[junit4:junit4]   2> 17157 T2937 C278 P50006 REQ /replication {command=filelist&qt=/replication&wt=javabin&generation=2&version=2} status=0 QTime=0 
[junit4:junit4]   2> 17160 T2982 C273 P50003 oash.SnapPuller.fetchLatestIndex Number of files in latest index in master: 1
[junit4:junit4]   2> 17161 T2982 C273 P50003 oasc.CachingDirectoryFactory.get return new directory for /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1363135973188/nodes_used_collection_shard2_replica2/data/index.20130313005309643 forceNew: false
[junit4:junit4]   2> 17161 T2982 C27

[...truncated too long message...]

andlerTest, SolrTestCaseJ4Test, TestRemoteStreaming, UniqFieldsUpdateProcessorFactoryTest, SimpleFacetsTest, TestStressReorder, DistributedTermsComponentTest, TestSweetSpotSimilarityFactory, CachingDirectoryFactoryTest, TestComponentsName, TestFieldTypeResource, SliceStateTest, TestReplicationHandler, TestPerFieldSimilarity, SpatialFilterTest, TestQuerySenderNoQuery, CollectionsAPIDistributedZkTest, DistanceFunctionTest, TestPluginEnable, MoreLikeThisHandlerTest, TestFuzzyAnalyzedSuggestions, FileUtilsTest, UpdateParamsTest, TestPseudoReturnFields, TestFunctionQuery, CurrencyFieldOpenExchangeTest, DocumentBuilderTest, TestElisionMultitermQuery, TestLFUCache, UUIDFieldTest, TestSolrDiscoveryProperties, PeerSyncTest, QueryElevationComponentTest, ZkControllerTest, TestStressLucene, PrimUtilsTest, HardAutoCommitTest, TestArbitraryIndexDir, ExternalFileFieldSortTest, FullSolrCloudDistribCmdsTest, TestSystemIdResolver, BasicDistributedZk2Test, EchoParamsTest, IndexSchemaTest, RegexBoostProcessorTest, TestDocumentBuilder, FileBasedSpellCheckerTest, ResourceLoaderTest, StatsComponentTest, TestConfig, TestFieldResource, TestCSVResponseWriter, SpellingQueryConverterTest, SearchHandlerTest, TestSearchPerf, DisMaxRequestHandlerTest, TestPostingsSolrHighlighter, TestStressVersions, SyncSliceTest, TestRandomDVFaceting, TestDynamicFieldCollectionResource, ChaosMonkeyNothingIsSafeTest, TestSolrIndexConfig, SoftAutoCommitTest, OutputWriterTest, TestFastOutputStream, OpenExchangeRatesOrgProviderTest, TestQueryUtils, TestBinaryResponseWriter, SchemaVersionSpecificBehaviorTest, RequestHandlersTest, ShowFileRequestHandlerTest, DocValuesMultiTest, StandardRequestHandlerTest, DateMathParserTest, ChaosMonkeySafeLeaderTest]
[junit4:junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=ChaosMonkeySafeLeaderTest -Dtests.seed=17B32D70BCAC7975 -Dtests.slow=true -Dtests.locale=th_TH -Dtests.timezone=NST -Dtests.file.encoding=US-ASCII
[junit4:junit4] ERROR   0.00s | ChaosMonkeySafeLeaderTest (suite) <<<
[junit4:junit4]    > Throwable #1: java.lang.AssertionError: ERROR: SolrIndexSearcher opens=50 closes=49
[junit4:junit4]    > 	at __randomizedtesting.SeedInfo.seed([17B32D70BCAC7975]:0)
[junit4:junit4]    > 	at org.junit.Assert.fail(Assert.java:93)
[junit4:junit4]    > 	at org.apache.solr.SolrTestCaseJ4.endTrackingSearchers(SolrTestCaseJ4.java:247)
[junit4:junit4]    > 	at org.apache.solr.SolrTestCaseJ4.afterClass(SolrTestCaseJ4.java:97)
[junit4:junit4]    > 	at sun.reflect.GeneratedMethodAccessor18.invoke(Unknown Source)
[junit4:junit4]    > 	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
[junit4:junit4]    > 	at java.lang.reflect.Method.invoke(Method.java:601)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:700)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
[junit4:junit4]    > 	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
[junit4:junit4]    > 	at java.lang.Thread.run(Thread.java:722)
[junit4:junit4]    > Throwable #2: com.carrotsearch.randomizedtesting.ThreadLeakError: 2 threads leaked from SUITE scope at org.apache.solr.cloud.ChaosMonkeySafeLeaderTest: 
[junit4:junit4]    >    1) Thread[id=4391, name=RecoveryThread, state=TIMED_WAITING, group=TGRP-ChaosMonkeySafeLeaderTest]
[junit4:junit4]    >         at java.lang.Thread.sleep(Native Method)
[junit4:junit4]    >         at org.apache.solr.cloud.RecoveryStrategy.doRecovery(RecoveryStrategy.java:490)
[junit4:junit4]    >         at org.apache.solr.cloud.RecoveryStrategy.run(RecoveryStrategy.java:223)
[junit4:junit4]    >    2) Thread[id=4269, name=searcherExecutor-2550-thread-1, state=WAITING, group=TGRP-ChaosMonkeySafeLeaderTest]
[junit4:junit4]    >         at sun.misc.Unsafe.park(Native Method)
[junit4:junit4]    >         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
[junit4:junit4]    >         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
[junit4:junit4]    >         at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
[junit4:junit4]    >         at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)
[junit4:junit4]    >         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
[junit4:junit4]    >         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
[junit4:junit4]    >         at java.lang.Thread.run(Thread.java:722)
[junit4:junit4]    > 	at __randomizedtesting.SeedInfo.seed([17B32D70BCAC7975]:0)
[junit4:junit4]    > Throwable #3: com.carrotsearch.randomizedtesting.ThreadLeakError: There are still zombie threads that couldn't be terminated:
[junit4:junit4]    >    1) Thread[id=4391, name=RecoveryThread, state=WAITING, group=TGRP-ChaosMonkeySafeLeaderTest]
[junit4:junit4]    >         at java.lang.Object.wait(Native Method)
[junit4:junit4]    >         at java.lang.Thread.join(Thread.java:1258)
[junit4:junit4]    >         at java.lang.Thread.join(Thread.java:1332)
[junit4:junit4]    >         at org.apache.solr.update.DefaultSolrCoreState.cancelRecovery(DefaultSolrCoreState.java:250)
[junit4:junit4]    >         at org.apache.solr.update.DefaultSolrCoreState.close(DefaultSolrCoreState.java:277)
[junit4:junit4]    >         at org.apache.solr.update.SolrCoreState.decrefSolrCoreState(SolrCoreState.java:73)
[junit4:junit4]    >         at org.apache.solr.core.SolrCore.close(SolrCore.java:986)
[junit4:junit4]    >         at org.apache.solr.cloud.RecoveryStrategy.run(RecoveryStrategy.java:235)
[junit4:junit4]    >    2) Thread[id=4269, name=searcherExecutor-2550-thread-1, state=WAITING, group=TGRP-ChaosMonkeySafeLeaderTest]
[junit4:junit4]    >         at sun.misc.Unsafe.park(Native Method)
[junit4:junit4]    >         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
[junit4:junit4]    >         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
[junit4:junit4]    >         at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
[junit4:junit4]    >         at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)
[junit4:junit4]    >         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
[junit4:junit4]    >         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
[junit4:junit4]    >         at java.lang.Thread.run(Thread.java:722)
[junit4:junit4]    > 	at __randomizedtesting.SeedInfo.seed([17B32D70BCAC7975]:0)
[junit4:junit4] Completed in 292.17s, 1 test, 1 failure, 2 errors <<< FAILURES!

[...truncated 412 lines...]
BUILD FAILED
/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/build.xml:381: The following error occurred while executing this line:
/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/build.xml:361: The following error occurred while executing this line:
/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/build.xml:39: The following error occurred while executing this line:
/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build.xml:183: The following error occurred while executing this line:
/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/common-build.xml:449: The following error occurred while executing this line:
/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/lucene/common-build.xml:1213: The following error occurred while executing this line:
/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/lucene/common-build.xml:877: There were test failures: 271 suites, 1141 tests, 3 suite-level errors, 1 error, 582 ignored (6 assumptions)

Total time: 72 minutes 8 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Recording test results
Description set: Java: 64bit/jdk1.7.0 -XX:+UseSerialGC
Email was triggered for: Failure
Sending email for trigger: Failure



[JENKINS] Lucene-Solr-trunk-MacOSX (64bit/jdk1.7.0) - Build # 314 - Still Failing!

Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: http://jenkins.thetaphi.de/job/Lucene-Solr-trunk-MacOSX/314/
Java: 64bit/jdk1.7.0 -XX:+UseParallelGC

1 tests failed.
REGRESSION:  org.apache.solr.cloud.ChaosMonkeySafeLeaderTest.testDistribSearch

Error Message:
IOException occured when talking to server at: http://127.0.0.1:50219/u/collection1

Stack Trace:
org.apache.solr.client.solrj.SolrServerException: IOException occured when talking to server at: http://127.0.0.1:50219/u/collection1
	at __randomizedtesting.SeedInfo.seed([A83E6E30D79F3BC7:29D8E028A0C05BFB]:0)
	at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:416)
	at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:181)
	at org.apache.solr.client.solrj.request.QueryRequest.process(QueryRequest.java:90)
	at org.apache.solr.client.solrj.SolrServer.query(SolrServer.java:301)
	at org.apache.solr.cloud.AbstractFullDistribZkTestBase.checkShardConsistency(AbstractFullDistribZkTestBase.java:994)
	at org.apache.solr.cloud.ChaosMonkeySafeLeaderTest.doTest(ChaosMonkeySafeLeaderTest.java:137)
	at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:806)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:601)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
	at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at java.lang.Thread.run(Thread.java:722)
Caused by: java.net.SocketException: Invalid argument
	at java.net.SocketInputStream.socketRead0(Native Method)
	at java.net.SocketInputStream.read(SocketInputStream.java:150)
	at java.net.SocketInputStream.read(SocketInputStream.java:121)
	at org.apache.http.impl.io.AbstractSessionInputBuffer.fillBuffer(AbstractSessionInputBuffer.java:166)
	at org.apache.http.impl.io.SocketInputBuffer.fillBuffer(SocketInputBuffer.java:90)
	at org.apache.http.impl.io.AbstractSessionInputBuffer.readLine(AbstractSessionInputBuffer.java:281)
	at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:92)
	at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:62)
	at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:254)
	at org.apache.http.impl.AbstractHttpClientConnection.receiveResponseHeader(AbstractHttpClientConnection.java:289)
	at org.apache.http.impl.conn.DefaultClientConnection.receiveResponseHeader(DefaultClientConnection.java:252)
	at org.apache.http.impl.conn.ManagedClientConnectionImpl.receiveResponseHeader(ManagedClientConnectionImpl.java:191)
	at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:300)
	at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:127)
	at org.apache.http.impl.client.DefaultRequestDirector.tryExecute(DefaultRequestDirector.java:717)
	at org.apache.http.impl.client.DefaultRequestDirector.execute(DefaultRequestDirector.java:522)
	at org.apache.http.impl.client.AbstractHttpClient.execute(AbstractHttpClient.java:906)
	at org.apache.http.impl.client.AbstractHttpClient.execute(AbstractHttpClient.java:805)
	at org.apache.http.impl.client.AbstractHttpClient.execute(AbstractHttpClient.java:784)
	at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:353)
	... 46 more




Build Log:
[...truncated 9241 lines...]
[junit4:junit4] Suite: org.apache.solr.cloud.ChaosMonkeySafeLeaderTest
[junit4:junit4]   2> 0 T3803 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /u/
[junit4:junit4]   2> 10 T3803 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch
[junit4:junit4]   2> Creating dataDir: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./solrtest-ChaosMonkeySafeLeaderTest-1363116997565
[junit4:junit4]   2> 11 T3803 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4:junit4]   2> 13 T3804 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
[junit4:junit4]   2> 15 T3804 oazs.ZooKeeperServer.setTickTime tickTime set to 1000
[junit4:junit4]   2> 16 T3804 oazs.ZooKeeperServer.setMinSessionTimeout minSessionTimeout set to -1
[junit4:junit4]   2> 16 T3804 oazs.ZooKeeperServer.setMaxSessionTimeout maxSessionTimeout set to -1
[junit4:junit4]   2> 17 T3804 oazs.NIOServerCnxnFactory.configure binding to port 0.0.0.0/0.0.0.0:0
[junit4:junit4]   2> 18 T3804 oazsp.FileTxnSnapLog.save Snapshotting: 0x0 to /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1363116997564/zookeeper/server1/data/version-2/snapshot.0
[junit4:junit4]   2> 114 T3803 oasc.ZkTestServer.run start zk server on port:50168
[junit4:junit4]   2> 114 T3803 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:50168 sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@175fe055
[junit4:junit4]   2> 116 T3803 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 116 T3809 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:50168. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 117 T3809 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:50168, initiating session
[junit4:junit4]   2> 117 T3805 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:50169
[junit4:junit4]   2> 118 T3805 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:50169
[junit4:junit4]   2> 118 T3807 oazsp.FileTxnLog.append Creating new log file: log.1
[junit4:junit4]   2> 120 T3807 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d601abbc50000 with negotiated timeout 10000 for client /127.0.0.1:50169
[junit4:junit4]   2> 121 T3809 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:50168, sessionid = 0x13d601abbc50000, negotiated timeout = 10000
[junit4:junit4]   2> 121 T3810 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@175fe055 name:ZooKeeperConnection Watcher:127.0.0.1:50168 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 122 T3803 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 122 T3803 oascc.SolrZkClient.makePath makePath: /solr
[junit4:junit4]   2> 125 T3808 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d601abbc50000
[junit4:junit4]   2> 126 T3803 oaz.ZooKeeper.close Session: 0x13d601abbc50000 closed
[junit4:junit4]   2> 126 T3803 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:50168/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@4a820d4e
[junit4:junit4]   2> 127 T3810 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 128 T3811 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:50168. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 130 T3803 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 141 T3811 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:50168, initiating session
[junit4:junit4]   2> 142 T3805 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:50169 which had sessionid 0x13d601abbc50000
[junit4:junit4]   2> 142 T3805 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:50170
[junit4:junit4]   2> 143 T3805 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:50170
[junit4:junit4]   2> 144 T3807 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d601abbc50001 with negotiated timeout 10000 for client /127.0.0.1:50170
[junit4:junit4]   2> 144 T3811 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:50168, sessionid = 0x13d601abbc50001, negotiated timeout = 10000
[junit4:junit4]   2> 145 T3812 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@4a820d4e name:ZooKeeperConnection Watcher:127.0.0.1:50168/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 145 T3803 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 146 T3803 oascc.SolrZkClient.makePath makePath: /collections/collection1
[junit4:junit4]   2> 155 T3803 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
[junit4:junit4]   2> 165 T3803 oascc.SolrZkClient.makePath makePath: /collections/control_collection
[junit4:junit4]   2> 168 T3803 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
[junit4:junit4]   2> 176 T3803 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
[junit4:junit4]   2> 177 T3803 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
[junit4:junit4]   2> 185 T3803 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
[junit4:junit4]   2> 186 T3803 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
[junit4:junit4]   2> 198 T3803 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4:junit4]   2> 199 T3803 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
[junit4:junit4]   2> 203 T3803 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4:junit4]   2> 204 T3803 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
[junit4:junit4]   2> 208 T3803 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4:junit4]   2> 210 T3803 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
[junit4:junit4]   2> 221 T3803 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4:junit4]   2> 222 T3803 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
[junit4:junit4]   2> 236 T3803 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4]   2> 238 T3803 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4]   2> 267 T3803 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4:junit4]   2> 272 T3803 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
[junit4:junit4]   2> 277 T3803 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4:junit4]   2> 278 T3803 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
[junit4:junit4]   2> 297 T3808 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d601abbc50001
[junit4:junit4]   2> 298 T3805 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:50170 which had sessionid 0x13d601abbc50001
[junit4:junit4]   2> 300 T3812 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 300 T3803 oaz.ZooKeeper.close Session: 0x13d601abbc50001 closed
[junit4:junit4]   2> 550 T3803 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4]   2> 557 T3803 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:50171
[junit4:junit4]   2> 558 T3803 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4]   2> 559 T3803 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 561 T3803 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-controljetty-1363116997855
[junit4:junit4]   2> 561 T3803 oasc.CoreContainer$Initializer.initialize looking for solr config file: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-controljetty-1363116997855/solr.xml
[junit4:junit4]   2> 562 T3803 oasc.CoreContainer.<init> New CoreContainer 1383181243
[junit4:junit4]   2> 563 T3803 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-controljetty-1363116997855/'
[junit4:junit4]   2> 564 T3803 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-controljetty-1363116997855/'
[junit4:junit4]   2> 617 T3803 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4]   2> 618 T3803 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4]   2> 619 T3803 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4]   2> 619 T3803 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4]   2> 620 T3803 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4]   2> 621 T3803 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4]   2> 621 T3803 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4]   2> 622 T3803 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4]   2> 622 T3803 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4]   2> 623 T3803 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4]   2> 643 T3803 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4]   2> 663 T3803 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:50168/solr
[junit4:junit4]   2> 664 T3803 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4]   2> 665 T3803 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:50168 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@27b4602a
[junit4:junit4]   2> 666 T3803 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 668 T3822 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:50168. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 669 T3822 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:50168, initiating session
[junit4:junit4]   2> 669 T3805 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:50172
[junit4:junit4]   2> 670 T3805 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:50172
[junit4:junit4]   2> 672 T3822 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:50168, sessionid = 0x13d601abbc50002, negotiated timeout = 20000
[junit4:junit4]   2> 672 T3823 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@27b4602a name:ZooKeeperConnection Watcher:127.0.0.1:50168 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 672 T3807 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d601abbc50002 with negotiated timeout 20000 for client /127.0.0.1:50172
[junit4:junit4]   2> 673 T3803 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 676 T3808 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d601abbc50002
[junit4:junit4]   2> 677 T3805 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:50172 which had sessionid 0x13d601abbc50002
[junit4:junit4]   2> 683 T3823 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 683 T3803 oaz.ZooKeeper.close Session: 0x13d601abbc50002 closed
[junit4:junit4]   2> 684 T3803 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4]   2> 695 T3803 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:50168/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@59a7c969
[junit4:junit4]   2> 698 T3824 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:50168. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 699 T3824 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:50168, initiating session
[junit4:junit4]   2> 697 T3803 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 713 T3805 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:50173
[junit4:junit4]   2> 715 T3805 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:50173
[junit4:junit4]   2> 716 T3807 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d601abbc50003 with negotiated timeout 20000 for client /127.0.0.1:50173
[junit4:junit4]   2> 717 T3824 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:50168, sessionid = 0x13d601abbc50003, negotiated timeout = 20000
[junit4:junit4]   2> 718 T3825 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@59a7c969 name:ZooKeeperConnection Watcher:127.0.0.1:50168/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 727 T3803 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 731 T3808 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d601abbc50003 type:create cxid:0x2 zxid:0x1a txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 750 T3803 oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4:junit4]   2> 760 T3803 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:50171_u
[junit4:junit4]   2> 763 T3808 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d601abbc50003 type:delete cxid:0x8 zxid:0x1c txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:50171_u Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:50171_u
[junit4:junit4]   2> 771 T3803 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:50171_u
[junit4:junit4]   2> 785 T3803 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4:junit4]   2> 796 T3808 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d601abbc50003 type:delete cxid:0x16 zxid:0x21 txntype:-1 reqpath:n/a Error Path:/solr/overseer_elect/leader Error:KeeperErrorCode = NoNode for /solr/overseer_elect/leader
[junit4:junit4]   2> 797 T3803 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4:junit4]   2> 802 T3803 oasc.Overseer.start Overseer (id=89333235552944131-127.0.0.1:50171_u-n_0000000000) starting
[junit4:junit4]   2> 804 T3808 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d601abbc50003 type:create cxid:0x1b zxid:0x23 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 806 T3808 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d601abbc50003 type:create cxid:0x1c zxid:0x24 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 807 T3808 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d601abbc50003 type:create cxid:0x1d zxid:0x25 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 809 T3808 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d601abbc50003 type:create cxid:0x1e zxid:0x26 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 811 T3827 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4:junit4]   2> 814 T3803 oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4:junit4]   2> 820 T3803 oascc.SolrZkClient.makePath makePath: /aliases.json
[junit4:junit4]   2> 824 T3803 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 830 T3826 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4:junit4]   2> 836 T3828 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-controljetty-1363116997855/collection1
[junit4:junit4]   2> 836 T3828 oasc.ZkController.createCollectionZkNode Check for collection zkNode:control_collection
[junit4:junit4]   2> 838 T3828 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4]   2> 838 T3828 oasc.ZkController.readConfigName Load collection config from:/collections/control_collection
[junit4:junit4]   2> 842 T3828 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-controljetty-1363116997855/collection1/'
[junit4:junit4]   2> 843 T3828 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-controljetty-1363116997855/collection1/lib/classes/' to classloader
[junit4:junit4]   2> 844 T3828 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-controljetty-1363116997855/collection1/lib/README' to classloader
[junit4:junit4]   2> 900 T3828 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4]   2> 960 T3828 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   2> 962 T3828 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4]   2> 970 T3828 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4]   2> 1588 T3828 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   2> 1600 T3828 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4]   2> 1605 T3828 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> 1631 T3828 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 1638 T3828 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 1644 T3828 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 1647 T3828 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4]   2> 1647 T3828 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4]   2> 1647 T3828 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 1650 T3828 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4]   2> 1650 T3828 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4]   2> 1651 T3828 oasc.SolrCore.initDirectoryFactory solr.StandardDirectoryFactory
[junit4:junit4]   2> 1671 T3828 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-controljetty-1363116997855/collection1/, dataDir=./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1363116997564/control/data/
[junit4:junit4]   2> 1671 T3828 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@7df92e01
[junit4:junit4]   2> 1672 T3828 oasc.SolrCore.initDirectoryFactory solr.StandardDirectoryFactory
[junit4:junit4]   2> 1673 T3828 oasc.CachingDirectoryFactory.get return new directory for /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1363116997564/control/data forceNew: false
[junit4:junit4]   2> 1674 T3828 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1363116997564/control/data/index/
[junit4:junit4]   2> 1675 T3828 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1363116997564/control/data/index' doesn't exist. Creating new index...
[junit4:junit4]   2> 1675 T3828 oasc.CachingDirectoryFactory.get return new directory for /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1363116997564/control/data/index forceNew: false
[junit4:junit4]   2> 1681 T3828 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4]   2> 		commit{dir=/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1363116997564/control/data/index,segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 1682 T3828 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4]   2> 1685 T3828 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   2> 1685 T3828 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   2> 1687 T3828 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   2> 1687 T3828 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4]   2> 1688 T3828 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4]   2> 1688 T3828 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   2> 1689 T3828 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4]   2> 1690 T3828 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4]   2> 1690 T3828 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   2> 1697 T3828 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4]   2> 1719 T3828 oass.SolrIndexSearcher.<init> Opening Searcher@17b926cb main
[junit4:junit4]   2> 1721 T3828 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4]   2> 1722 T3828 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4]   2> 1725 T3829 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@17b926cb main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   2> 1727 T3828 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4]   2> 1727 T3828 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 1728 T3808 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d601abbc50003 type:create cxid:0x55 zxid:0x2a txntype:-1 reqpath:n/a Error Path:/solr/overseer/queue Error:KeeperErrorCode = NoNode for /solr/overseer/queue
[junit4:junit4]   2> 2338 T3826 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 2339 T3826 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "core_node_name":null,
[junit4:junit4]   2> 	  "numShards":"1",
[junit4:junit4]   2> 	  "shard":null,
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"down",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"control_collection",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:50171_u",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:50171/u"}
[junit4:junit4]   2> 2340 T3826 oasc.Overseer$ClusterStateUpdater.createCollection Create collection control_collection with numShards 1
[junit4:junit4]   2> 2340 T3826 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4:junit4]   2> 2341 T3808 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d601abbc50003 type:create cxid:0x5d zxid:0x2d txntype:-1 reqpath:n/a Error Path:/solr/overseer/queue-work Error:KeeperErrorCode = NoNode for /solr/overseer/queue-work
[junit4:junit4]   2> 2352 T3825 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4]   2> 2735 T3828 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4]   2> 2736 T3828 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:50171/u collection:control_collection shard:shard1
[junit4:junit4]   2> 2738 T3828 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leader_elect/shard1/election
[junit4:junit4]   2> 2752 T3808 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d601abbc50003 type:delete cxid:0x77 zxid:0x37 txntype:-1 reqpath:n/a Error Path:/solr/collections/control_collection/leaders Error:KeeperErrorCode = NoNode for /solr/collections/control_collection/leaders
[junit4:junit4]   2> 2753 T3828 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4]   2> 2754 T3808 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d601abbc50003 type:create cxid:0x78 zxid:0x38 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 2757 T3828 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4]   2> 2758 T3828 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4]   2> 2758 T3828 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:50171/u/collection1/
[junit4:junit4]   2> 2758 T3828 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4]   2> 2759 T3828 oasc.SyncStrategy.syncToMe http://127.0.0.1:50171/u/collection1/ has no replicas
[junit4:junit4]   2> 2759 T3828 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:50171/u/collection1/
[junit4:junit4]   2> 2759 T3828 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leaders/shard1
[junit4:junit4]   2> 2768 T3808 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d601abbc50003 type:create cxid:0x82 zxid:0x3c txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 3862 T3826 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 3878 T3825 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4]   2> 3913 T3828 oasc.ZkController.register We are http://127.0.0.1:50171/u/collection1/ and leader is http://127.0.0.1:50171/u/collection1/
[junit4:junit4]   2> 3914 T3828 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:50171/u
[junit4:junit4]   2> 3914 T3828 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4]   2> 3915 T3828 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4]   2> 3915 T3828 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 3919 T3828 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 3921 T3803 oass.SolrDispatchFilter.init user.dir=/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0
[junit4:junit4]   2> 3922 T3803 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4]   2> 3924 T3803 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 3941 T3803 oascsi.HttpClientUtil.createClient Creating new http client, config:
[junit4:junit4]   2> 3944 T3803 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:50168/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@3771111a
[junit4:junit4]   2> 3946 T3803 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 3947 T3831 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:50168. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 3948 T3831 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:50168, initiating session
[junit4:junit4]   2> 3950 T3805 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:50174
[junit4:junit4]   2> 3951 T3805 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:50174
[junit4:junit4]   2> 3952 T3807 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d601abbc50004 with negotiated timeout 10000 for client /127.0.0.1:50174
[junit4:junit4]   2> 3953 T3831 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:50168, sessionid = 0x13d601abbc50004, negotiated timeout = 10000
[junit4:junit4]   2> 3953 T3832 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@3771111a name:ZooKeeperConnection Watcher:127.0.0.1:50168/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 3955 T3803 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 3959 T3803 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 3966 T3803 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:true cause connection loss:true
[junit4:junit4]   2> 4231 T3803 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4]   2> 4236 T3803 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:50175
[junit4:junit4]   2> 4237 T3803 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4]   2> 4237 T3803 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 4237 T3803 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty1-1363117001520
[junit4:junit4]   2> 4238 T3803 oasc.CoreContainer$Initializer.initialize looking for solr config file: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty1-1363117001520/solr.xml
[junit4:junit4]   2> 4238 T3803 oasc.CoreContainer.<init> New CoreContainer 1912308584
[junit4:junit4]   2> 4239 T3803 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty1-1363117001520/'
[junit4:junit4]   2> 4240 T3803 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty1-1363117001520/'
[junit4:junit4]   2> 4275 T3803 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4]   2> 4275 T3803 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4]   2> 4276 T3803 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4]   2> 4276 T3803 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4]   2> 4277 T3803 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4]   2> 4279 T3803 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4]   2> 4279 T3803 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4]   2> 4280 T3803 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4]   2> 4281 T3803 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4]   2> 4282 T3803 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4]   2> 4300 T3803 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4]   2> 4325 T3803 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:50168/solr
[junit4:junit4]   2> 4326 T3803 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4]   2> 4327 T3803 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:50168 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@1baa38b0
[junit4:junit4]   2> 4329 T3842 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:50168. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 4329 T3803 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 4331 T3842 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:50168, initiating session
[junit4:junit4]   2> 4331 T3805 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:50176
[junit4:junit4]   2> 4332 T3805 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:50176
[junit4:junit4]   2> 4485 T3807 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d601abbc50005 with negotiated timeout 20000 for client /127.0.0.1:50176
[junit4:junit4]   2> 4485 T3842 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:50168, sessionid = 0x13d601abbc50005, negotiated timeout = 20000
[junit4:junit4]   2> 4486 T3843 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1baa38b0 name:ZooKeeperConnection Watcher:127.0.0.1:50168 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 4486 T3803 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 4490 T3808 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d601abbc50005
[junit4:junit4]   2> 4491 T3805 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:50176 which had sessionid 0x13d601abbc50005
[junit4:junit4]   2> 4491 T3843 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 4491 T3803 oaz.ZooKeeper.close Session: 0x13d601abbc50005 closed
[junit4:junit4]   2> 4492 T3803 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4]   2> 4498 T3803 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:50168/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@c42039c
[junit4:junit4]   2> 4499 T3803 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 4500 T3844 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:50168. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 4501 T3844 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:50168, initiating session
[junit4:junit4]   2> 4501 T3805 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:50177
[junit4:junit4]   2> 4502 T3805 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:50177
[junit4:junit4]   2> 4503 T3807 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d601abbc50006 with negotiated timeout 20000 for client /127.0.0.1:50177
[junit4:junit4]   2> 4503 T3844 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:50168, sessionid = 0x13d601abbc50006, negotiated timeout = 20000
[junit4:junit4]   2> 4504 T3845 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@c42039c name:ZooKeeperConnection Watcher:127.0.0.1:50168/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 4504 T3803 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 4506 T3808 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d601abbc50006 type:create cxid:0x1 zxid:0x4a txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 4508 T3808 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d601abbc50006 type:create cxid:0x2 zxid:0x4b txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 4512 T3803 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 5389 T3826 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 5391 T3826 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "core_node_name":null,
[junit4:junit4]   2> 	  "numShards":"1",
[junit4:junit4]   2> 	  "shard":"shard1",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"active",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"control_collection",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:50171_u",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:50171/u"}
[junit4:junit4]   2> 5397 T3832 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4]   2> 5397 T3825 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4]   2> 5397 T3845 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4]   2> 5519 T3803 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:50175_u
[junit4:junit4]   2> 5520 T3808 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d601abbc50006 type:delete cxid:0xd zxid:0x50 txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:50175_u Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:50175_u
[junit4:junit4]   2> 5522 T3803 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:50175_u
[junit4:junit4]   2> 5527 T3845 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1)
[junit4:junit4]   2> 5528 T3832 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4]   2> 5529 T3825 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4]   2> 5529 T3832 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 5529 T3825 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 5532 T3845 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4]   2> 5545 T3846 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty1-1363117001520/collection1
[junit4:junit4]   2> 5545 T3846 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4]   2> 5547 T3846 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4]   2> 5548 T3846 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4]   2> 5551 T3846 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty1-1363117001520/collection1/'
[junit4:junit4]   2> 5552 T3846 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty1-1363117001520/collection1/lib/classes/' to classloader
[junit4:junit4]   2> 5553 T3846 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty1-1363117001520/collection1/lib/README' to classloader
[junit4:junit4]   2> 5613 T3846 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4]   2> 5667 T3846 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   2> 5668 T3846 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4]   2> 5677 T3846 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4]   2> 6314 T3846 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   2> 6328 T3846 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4]   2> 6332 T3846 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> 6359 T3846 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 6367 T3846 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 6373 T3846 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 6375 T3846 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4]   2> 6376 T3846 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4]   2> 6376 T3846 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 6379 T3846 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4]   2> 6379 T3846 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4]   2> 6379 T3846 oasc.SolrCore.initDirectoryFactory solr.StandardDirectoryFactory
[junit4:junit4]   2> 6380 T3846 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty1-1363117001520/collection1/, dataDir=./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1363116997564/jetty1/
[junit4:junit4]   2> 6380 T3846 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@7df92e01
[junit4:junit4]   2> 6381 T3846 oasc.SolrCore.initDirectoryFactory solr.StandardDirectoryFactory
[junit4:junit4]   2> 6382 T3846 oasc.CachingDirectoryFactory.get return new directory for /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1363116997564/jetty1 forceNew: false
[junit4:junit4]   2> 6382 T3846 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1363116997564/jetty1/index/
[junit4:junit4]   2> 6383 T3846 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1363116997564/jetty1/index' doesn't exist. Creating new index...
[junit4:junit4]   2> 6383 T3846 oasc.CachingDirectoryFactory.get return new directory for /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1363116997564/jetty1/index forceNew: false
[junit4:junit4]   2> 6387 T3846 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4]   2> 		commit{dir=/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1363116997564/jetty1/index,segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 6388 T3846 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4]   2> 6391 T3846 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   2> 6391 T3846 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   2> 6392 T3846 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   2> 6393 T3846 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4]   2> 6394 T3846 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4]   2> 6394 T3846 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   2> 6395 T3846 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4]   2> 6396 T3846 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4]   2> 6396 T3846 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   2> 6404 T3846 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4]   2> 6410 T3846 oass.SolrIndexSearcher.<init> Opening Searcher@e5c7901 main
[junit4:junit4]   2> 6412 T3846 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4]   2> 6412 T3846 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4]   2> 6416 T3847 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@e5c7901 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   2> 6418 T3846 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4]   2> 6419 T3846 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 6913 T3826 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 6914 T3826 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "core_node_name":null,
[junit4:junit4]   2> 	  "numShards":"3",
[junit4:junit4]   2> 	  "shard":null,
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"down",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:50175_u",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:50175/u"}
[junit4:junit4]   2> 6914 T3826 oasc.Overseer$ClusterStateUpdater.createCollection Create collection collection1 with numShards 3
[junit4:junit4]   2> 6914 T3826 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4:junit4]   2> 6925 T3845 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 6926 T3832 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 6926 T3825 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 7422 T3846 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4]   2> 7422 T3846 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:50175/u collection:collection1 shard:shard1
[junit4:junit4]   2> 7424 T3846 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4:junit4]   2> 7437 T3808 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d601abbc50006 type:delete cxid:0x4a zxid:0x5c txntype:-1 reqpath:n/a Error Path:/solr/collections/collection1/leaders Error:KeeperErrorCode = NoNode for /solr/collections/collection1/leaders
[junit4:junit4]   2> 7438 T3846 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4]   2> 7439 T3808 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d601abbc50006 type:create cxid:0x4b zxid:0x5d txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 7442 T3846 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4]   2> 7442 T3846 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4]   2> 7443 T3846 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:50175/u/collection1/
[junit4:junit4]   2> 7443 T3846 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4]   2> 7443 T3846 oasc.SyncStrategy.syncToMe http://127.0.0.1:50175/u/collection1/ has no replicas
[junit4:junit4]   2> 7443 T3846 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:50175/u/collection1/
[junit4:junit4]   2> 7444 T3846 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4:junit4]   2> 7453 T3808 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d601abbc50006 type:create cxid:0x55 zxid:0x61 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 8441 T3826 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 8456 T3832 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 8456 T3825 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 8456 T3845 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 8487 T3846 oasc.ZkController.register We are http://127.0.0.1:50175/u/collection1/ and leader is http://127.0.0.1:50175/u/collection1/
[junit4:junit4]   2> 8487 T3846 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:50175/u
[junit4:junit4]   2> 8488 T3846 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4]   2> 8488 T3846 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4]   2> 8489 T3846 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 8493 T3846 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 8495 T3803 oass.SolrDispatchFilter.init user.dir=/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0
[junit4:junit4]   2> 8496 T3803 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4]   2> 8498 T3803 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 8837 T3803 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4]   2> 8843 T3803 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:50178
[junit4:junit4]   2> 8844 T3803 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4]   2> 8844 T3803 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 8845 T3803 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty2-1363117006060
[junit4:junit4]   2> 8846 T3803 oasc.CoreContainer$Initializer.initialize looking for solr config file: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty2-1363117006060/solr.xml
[junit4:junit4]   2> 8846 T3803 oasc.CoreContainer.<init> New CoreContainer 1323414313
[junit4:junit4]   2> 8847 T3803 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty2-1363117006060/'
[junit4:junit4]   2> 8847 T3803 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty2-1363117006060/'
[junit4:junit4]   2> 8891 T3803 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4]   2> 8891 T3803 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4]   2> 8892 T3803 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4]   2> 8892 T3803 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4]   2> 8893 T3803 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4]   2> 8895 T3803 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4]   2> 8896 T3803 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4]   2> 8896 T3803 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4]   2> 8897 T3803 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4]   2> 8898 T3803 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4]   2> 8918 T3803 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4]   2> 8946 T3803 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:50168/solr
[junit4:junit4]   2> 8947 T3803 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4]   2> 8948 T3803 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:50168 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@3aecb75b
[junit4:junit4]   2> 8950 T3803 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 8951 T3858 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:50168. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 8953 T3858 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:50168, initiating session
[junit4:junit4]   2> 8953 T3805 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:50179
[junit4:junit4]   2> 8954 T3805 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:50179
[junit4:junit4]   2> 8956 T3807 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d601abbc50007 with negotiated timeout 20000 for client /127.0.0.1:50179
[junit4:junit4]   2> 8956 T3858 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:50168, sessionid = 0x13d601abbc50007, negotiated timeout = 20000
[junit4:junit4]   2> 8956 T3859 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@3aecb75b name:ZooKeeperConnection Watcher:127.0.0.1:50168 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 8957 T3803 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 8960 T3808 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d601abbc50007
[junit4:junit4]   2> 8962 T3805 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:50179 which had sessionid 0x13d601abbc50007
[junit4:junit4]   2> 8962 T3803 oaz.ZooKeeper.close Session: 0x13d601abbc50007 closed
[junit4:junit4]   2> 8962 T3859 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 8963 T3803 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4]   2> 8971 T3803 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:50168/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@595e8c22
[junit4:junit4]   2> 8972 T3803 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 8973 T3860 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:50168. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 8974 T3860 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:50168, initiating session
[junit4:junit4]   2> 8974 T3805 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:50180
[junit4:junit4]   2> 8975 T3805 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:50180
[junit4:junit4]   2> 8977 T3807 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d601abbc50008 with negotiated timeout 20000 for client /127.0.0.1:50180
[junit4:junit4]   2> 8977 T3860 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:50168, sessionid = 0x13d601abbc50008, negotiated timeout = 20000
[junit4:junit4]   2> 8978 T3861 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@595e8c22 name:ZooKeeperConnection Watcher:127.0.0.1:50168/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 8978 T3803 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 8981 T3808 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d601abbc50008 type:create cxid:0x1 zxid:0x6e txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 8983 T3808 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d601abbc50008 type:create cxid:0x2 zxid:0x6f txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 8987 T3803 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 9974 T3826 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 9976 T3826 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "core_node_name":null,
[junit4:junit4]   2> 	  "numShards":"3",
[junit4:junit4]   2> 	  "shard":"shard1",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"active",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:50175_u",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:50175/u"}
[junit4:junit4]   2> 9985 T3825 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 9985 T3845 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 9986 T3861 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 9987 T3832 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 9995 T3803 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:50178_u
[junit4:junit4]   2> 9996 T3808 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d601abbc50008 type:delete cxid:0xd zxid:0x74 txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:50178_u Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:50178_u
[junit4:junit4]   2> 9997 T3803 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:50178_u
[junit4:junit4]   2> 10003 T3845 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 10006 T3832 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4]   2> 10007 T3832 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 10007 T3861 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4]   2> 10008 T3861 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 10008 T3825 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4]   2> 10010 T3825 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 10018 T3845 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4]   2> 10033 T3862 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty2-1363117006060/collection1
[junit4:junit4]   2> 10034 T3862 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4]   2> 10035 T3862 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4]   2> 10036 T3862 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4]   2> 10038 T3862 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty2-1363117006060/collection1/'
[junit4:junit4]   2> 10039 T3862 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty2-1363117006060/collection1/lib/classes/' to classloader
[junit4:junit4]   2> 10039 T3862 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty2-1363117006060/collection1/lib/README' to classloader
[junit4:junit4]   2> 10083 T3862 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4]   2> 10152 T3862 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   2> 10154 T3862 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4]   2> 10162 T3862 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4]   2> 10755 T3862 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   2> 10768 T3862 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4]   2> 10774 T3862 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> 10802 T3862 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 10810 T3862 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 10819 T3862 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 10821 T3862 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4]   2> 10823 T3862 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4]   2> 10823 T3862 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 10825 T3862 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4]   2> 10825 T3862 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4]   2> 10826 T3862 oasc.SolrCore.initDirectoryFactory solr.StandardDirectoryFactory
[junit4:junit4]   2> 10826 T3862 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty2-1363117006060/collection1/, dataDir=./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1363116997564/jetty2/
[junit4:junit4]   2> 10827 T3862 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@7df92e01
[junit4:junit4]   2> 10828 T3862 oasc.SolrCore.initDirectoryFactory solr.StandardDirectoryFactory
[junit4:junit4]   2> 10828 T3862 oasc.CachingDirectoryFactory.get return new directory for /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1363116997564/jetty2 forceNew: false
[junit4:junit4]   2> 10829 T3862 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1363116997564/jetty2/index/
[junit4:junit4]   2> 10830 T3862 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1363116997564/jetty2/index' doesn't exist. Creating new index...
[junit4:junit4]   2> 10831 T3862 oasc.CachingDirectoryFactory.get return new directory for /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1363116997564/jetty2/index forceNew: false
[junit4:junit4]   2> 10835 T3862 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4]   2> 		commit{dir=/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1363116997564/jetty2/index,segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 10836 T3862 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4]   2> 10839 T3862 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   2> 10840 T3862 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   2> 10841 T3862 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   2> 10842 T3862 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4]   2> 10843 T3862 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4]   2> 10844 T3862 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   2> 10844 T3862 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4]   2> 10845 T3862 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4]   2> 10846 T3862 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   2> 10853 T3862 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4]   2> 10860 T3862 oass.SolrIndexSearcher.<init> Opening Searcher@69d03b12 main
[junit4:junit4]   2> 10861 T3862 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4]   2> 10861 T3862 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4]   2> 10865 T3863 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@69d03b12 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   2> 10868 T3862 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4]   2> 10868 T3862 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 11502 T3826 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 11503 T3826 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "core_node_name":null,
[junit4:junit4]   2> 	  "numShards":"3",
[junit4:junit4]   2> 	  "shard":null,
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"down",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:50178_u",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:50178/u"}
[junit4:junit4]   2> 11504 T3826 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=3
[junit4:junit4]   2> 11504 T3826 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard2
[junit4:junit4]   2> 11511 T3861 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 11512 T3845 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 11512 T3825 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 11512 T3832 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 11872 T3862 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4]   2> 11872 T3862 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:50178/u collection:collection1 shard:shard2
[junit4:junit4]   2> 11875 T3862 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard2/election
[junit4:junit4]   2> 11888 T3808 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d601abbc50008 type:delete cxid:0x49 zxid:0x7f txntype:-1 reqpath:n/a Error Path:/solr/collections/collection1/leaders/shard2 Error:KeeperErrorCode = NoNode for /solr/collections/collection1/leaders/shard2
[junit4:junit4]   2> 11889 T3862 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4]   2> 11890 T3808 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d601abbc50008 type:create cxid:0x4a zxid:0x80 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 11894 T3862 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4]   2> 11894 T3862 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4]   2> 11895 T3862 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:50178/u/collection1/
[junit4:junit4]   2> 11896 T3862 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4]   2> 11896 T3862 oasc.SyncStrategy.syncToMe http://127.0.0.1:50178/u/collection1/ has no replicas
[junit4:junit4]   2> 11897 T3862 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:50178/u/collection1/
[junit4:junit4]   2> 11898 T3862 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard2
[junit4:junit4]   2> 11905 T3808 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d601abbc50008 type:create cxid:0x53 zxid:0x83 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 13023 T3826 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 13042 T3825 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 13042 T3861 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 13042 T3845 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 13042 T3832 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 13086 T3862 oasc.ZkController.register We are http://127.0.0.1:50178/u/collection1/ and leader is http://127.0.0.1:50178/u/collection1/
[junit4:junit4]   2> 13086 T3862 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:50178/u
[junit4:junit4]   2> 13087 T3862 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4]   2> 13087 T3862 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4]   2> 13087 T3862 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 13090 T3862 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 13092 T3803 oass.SolrDispatchFilter.init user.dir=/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0
[junit4:junit4]   2> 13093 T3803 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4]   2> 13094 T3803 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 13303 T3803 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4]   2> 13307 T3803 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:50181
[junit4:junit4]   2> 13308 T3803 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4]   2> 13309 T3803 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 13309 T3803 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty3-1363117010656
[junit4:junit4]   2> 13310 T3803 oasc.CoreContainer$Initializer.initialize looking for solr config file: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty3-1363117010656/solr.xml
[junit4:junit4]   2> 13310 T3803 oasc.CoreContainer.<init> New CoreContainer 926219306
[junit4:junit4]   2> 13311 T3803 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty3-1363117010656/'
[junit4:junit4]   2> 13311 T3803 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty3-1363117010656/'
[junit4:junit4]   2> 13358 T3803 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4]   2> 13359 T3803 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4]   2> 13360 T3803 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4]   2> 13360 T3803 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4]   2> 13361 T3803 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4]   2> 13362 T3803 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4]   2> 13362 T3803 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4]   2> 13363 T3803 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4]   2> 13363 T3803 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4]   2> 13364 T3803 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4]   2> 13377 T3803 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4]   2> 13398 T3803 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:50168/solr
[junit4:junit4]   2> 13399 T3803 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4]   2> 13400 T3803 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:50168 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@36419326
[junit4:junit4]   2> 13401 T3803 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 13402 T3874 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:50168. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 13404 T3874 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:50168, initiating session
[junit4:junit4]   2> 13404 T3805 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:50182
[junit4:junit4]   2> 13405 T3805 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:50182
[junit4:junit4]   2> 13406 T3807 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d601abbc50009 with negotiated timeout 20000 for client /127.0.0.1:50182
[junit4:junit4]   2> 13406 T3874 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:50168, sessionid = 0x13d601abbc50009, negotiated timeout = 20000
[junit4:junit4]   2> 13407 T3875 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@36419326 name:ZooKeeperConnection Watcher:127.0.0.1:50168 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 13407 T3803 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 13410 T3808 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d601abbc50009
[junit4:junit4]   2> 13411 T3805 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:50182 which had sessionid 0x13d601abbc50009
[junit4:junit4]   2> 13411 T3803 oaz.ZooKeeper.close Session: 0x13d601abbc50009 closed
[junit4:junit4]   2> 13412 T3875 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 13412 T3803 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4]   2> 13418 T3803 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:50168/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@2618e625
[junit4:junit4]   2> 13420 T3803 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 13420 T3876 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:50168. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 13422 T3876 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:50168, initiating session
[junit4:junit4]   2> 13422 T3805 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:50183
[junit4:junit4]   2> 13423 T3805 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:50183
[junit4:junit4]   2> 13424 T3807 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d601abbc5000a with negotiated timeout 20000 for client /127.0.0.1:50183
[junit4:junit4]   2> 13424 T3876 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:50168, sessionid = 0x13d601abbc5000a, negotiated timeout = 20000
[junit4:junit4]   2> 13425 T3877 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@2618e625 name:ZooKeeperConnection Watcher:127.0.0.1:50168/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 13426 T3803 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 13428 T3808 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d601abbc5000a type:create cxid:0x1 zxid:0x90 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 13430 T3808 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d601abbc5000a type:create cxid:0x2 zxid:0x91 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 13434 T3803 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 14441 T3803 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:50181_u
[junit4:junit4]   2> 14442 T3808 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d601abbc5000a type:delete cxid:0xb zxid:0x92 txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:50181_u Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:50181_u
[junit4:junit4]   2> 14443 T3803 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:50181_u
[junit4:junit4]   2> 14448 T3845 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 14451 T3825 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4]   2> 14452 T3832 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4]   2> 14452 T3825 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 14452 T3877 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4]   2> 14452 T3832 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 14452 T3861 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4]   2> 14453 T3861 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 14455 T3845 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4]   2> 14466 T3878 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty3-1363117010656/collection1
[junit4:junit4]   2> 14467 T3878 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4]   2> 14468 T3878 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4]   2> 14469 T3878 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4]   2> 14472 T3878 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty3-1363117010656/collection1/'
[junit4:junit4]   2> 14474 T3878 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty3-1363117010656/collection1/lib/classes/' to classloader
[junit4:junit4]   2> 14475 T3878 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty3-1363117010656/collection1/lib/README' to classloader
[junit4:junit4]   2> 14536 T3878 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4]   2> 14556 T3826 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 14557 T3826 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "core_node_name":null,
[junit4:junit4]   2> 	  "numShards":"3",
[junit4:junit4]   2> 	  "shard":"shard2",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"active",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:50178_u",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:50178/u"}
[junit4:junit4]   2> 14563 T3877 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 14566 T3845 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 14567 T3825 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 14568 T3861 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 14570 T3832 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 14606 T3878 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   2> 14608 T3878 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4]   2> 14616 T3878 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4]   2> 15261 T3878 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   2> 15270 T3878 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4]   2> 15273 T3878 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> 15293 T3878 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 15299 T3878 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 15306 T3878 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 15309 T3878 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4]   2> 15310 T3878 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4]   2> 15310 T3878 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 15312 T3878 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4]   2> 15312 T3878 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4]   2> 15313 T3878 oasc.SolrCore.initDirectoryFactory solr.StandardDirectoryFactory
[junit4:junit4]   2> 15313 T3878 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty3-1363117010656/collection1/, dataDir=./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1363116997564/jetty3/
[junit4:junit4]   2> 15313 T3878 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@7df92e01
[junit4:junit4]   2> 15314 T3878 oasc.SolrCore.initDirectoryFactory solr.StandardDirectoryFactory
[junit4:junit4]   2> 15315 T3878 oasc.CachingDirectoryFactory.get return new directory for /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1363116997564/jetty3 forceNew: false
[junit4:junit4]   2> 15315 T3878 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1363116997564/jetty3/index/
[junit4:junit4]   2> 15316 T3878 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1363116997564/jetty3/index' doesn't exist. Creating new index...
[junit4:junit4]   2> 15316 T3878 oasc.CachingDirectoryFactory.get return new directory for /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1363116997564/jetty3/index forceNew: false
[junit4:junit4]   2> 15320 T3878 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4]   2> 		commit{dir=/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1363116997564/jetty3/index,segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 15322 T3878 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4]   2> 15325 T3878 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   2> 15326 T3878 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   2> 15327 T3878 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   2> 15328 T3878 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4]   2> 15328 T3878 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4]   2> 15329 T3878 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   2> 15329 T3878 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4]   2> 15330 T3878 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4]   2> 15331 T3878 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   2> 15337 T3878 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4]   2> 15343 T3878 oass.SolrIndexSearcher.<init> Opening Searcher@16a5504c main
[junit4:junit4]   2> 15345 T3878 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4]   2> 15345 T3878 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4]   2> 15349 T3879 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@16a5504c main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   2> 15351 T3878 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4]   2> 15351 T3878 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 16072 T3826 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 16074 T3826 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "core_node_name":null,
[junit4:junit4]   2> 	  "numShards":"3",
[junit4:junit4]   2> 	  "shard":null,
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"down",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:50181_u",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:50181/u"}
[junit4:junit4]   2> 16076 T3826 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=3
[junit4:junit4]   2> 16086 T3826 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard3
[junit4:junit4]   2> 16095 T3877 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 16095 T3832 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 16095 T3845 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 16111 T3825 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 16112 T3861 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 16355 T3878 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4]   2> 16355 T3878 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:50181/u collection:collection1 shard:shard3
[junit4:junit4]   2> 16357 T3878 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard3/election
[junit4:junit4]   2> 16365 T3808 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d601abbc5000a type:delete cxid:0x47 zxid:0xa1 txntype:-1 reqpath:n/a Error Path:/solr/collections/collection1/leaders/shard3 Error:KeeperErrorCode = NoNode for /solr/collections/collection1/leaders/shard3
[junit4:junit4]   2> 16367 T3878 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4]   2> 16367 T3808 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d601abbc5000a type:create cxid:0x48 zxid:0xa2 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 16370 T3878 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4]   2> 16371 T3878 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4]   2> 16371 T3878 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:50181/u/collection1/
[junit4:junit4]   2> 16371 T3878 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4]   2> 16371 T3878 oasc.SyncStrategy.syncToMe http://127.0.0.1:50181/u/collection1/ has no replicas
[junit4:junit4]   2> 16372 T3878 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:50181/u/collection1/
[junit4:junit4]   2> 16372 T3878 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard3
[junit4:junit4]   2> 16377 T3808 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d601abbc5000a type:create cxid:0x51 zxid:0xa5 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 17627 T3826 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 17643 T3832 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 17643 T3877 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 17644 T3845 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 17644 T3861 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 17644 T3825 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 17655 T3878 oasc.ZkController.register We are http://127.0.0.1:50181/u/collection1/ and leader is http://127.0.0.1:50181/u/collection1/
[junit4:junit4]   2> 17656 T3878 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:50181/u
[junit4:junit4]   2> 17656 T3878 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4]   2> 17656 T3878 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4]   2> 17657 T3878 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 17660 T3878 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 17663 T3803 oass.SolrDispatchFilter.init user.dir=/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0
[junit4:junit4]   2> 17663 T3803 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4]   2> 17664 T3803 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 17867 T3803 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4]   2> 17872 T3803 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:50184
[junit4:junit4]   2> 17873 T3803 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4]   2> 17873 T3803 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 17874 T3803 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty4-1363117015223
[junit4:junit4]   2> 17874 T3803 oasc.CoreContainer$Initializer.initialize looking for solr config file: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty4-1363117015223/solr.xml
[junit4:junit4]   2> 17875 T3803 oasc.CoreContainer.<init> New CoreContainer 677557428
[junit4:junit4]   2> 17875 T3803 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty4-1363117015223/'
[junit4:junit4]   2> 17876 T3803 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty4-1363117015223/'
[junit4:junit4]   2> 17918 T3803 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4]   2> 17919 T3803 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4]   2> 17920 T3803 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4]   2> 17920 T3803 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4]   2> 17921 T3803 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4]   2> 17921 T3803 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4]   2> 17922 T3803 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4]   2> 17922 T3803 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4]   2> 17923 T3803 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4]   2> 17923 T3803 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4]   2> 17938 T3803 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4]   2> 17961 T3803 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:50168/solr
[junit4:junit4]   2> 17962 T3803 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4]   2> 17963 T3803 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:50168 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@247ec5e2
[junit4:junit4]   2> 17965 T3803 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 17965 T3890 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:50168. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 17967 T3890 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:50168, initiating session
[junit4:junit4]   2> 17967 T3805 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:50185
[junit4:junit4]   2> 17968 T3805 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:50185
[junit4:junit4]   2> 17969 T3807 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d601abbc5000b with negotiated timeout 20000 for client /127.0.0.1:50185
[junit4:junit4]   2> 17969 T3890 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:50168, sessionid = 0x13d601abbc5000b, negotiated timeout = 20000
[junit4:junit4]   2> 17970 T3891 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@247ec5e2 name:ZooKeeperConnection Watcher:127.0.0.1:50168 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 17970 T3803 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 17973 T3808 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d601abbc5000b
[junit4:junit4]   2> 17974 T3805 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:50185 which had sessionid 0x13d601abbc5000b
[junit4:junit4]   2> 17974 T3803 oaz.ZooKeeper.close Session: 0x13d601abbc5000b closed
[junit4:junit4]   2> 17974 T3891 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 17975 T3803 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4]   2> 17981 T3803 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:50168/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@74aba0dc
[junit4:junit4]   2> 17982 T3803 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 17983 T3892 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:50168. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 17984 T3892 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:50168, initiating session
[junit4:junit4]   2> 17984 T3805 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:50186
[junit4:junit4]   2> 17985 T3805 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:50186
[junit4:junit4]   2> 17986 T3807 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d601abbc5000c with negotiated timeout 20000 for client /127.0.0.1:50186
[junit4:junit4]   2> 17986 T3892 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:50168, sessionid = 0x13d601abbc5000c, negotiated timeout = 20000
[junit4:junit4]   2> 17987 T3893 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@74aba0dc name:ZooKeeperConnection Watcher:127.0.0.1:50168/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 17987 T3803 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 17989 T3808 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d601abbc5000c type:create cxid:0x1 zxid:0xb2 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 17991 T3808 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d601abbc5000c type:create cxid:0x2 zxid:0xb3 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 17995 T3803 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 19002 T3803 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:50184_u
[junit4:junit4]   2> 19004 T3808 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d601abbc5000c type:delete cxid:0xb zxid:0xb4 txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:50184_u Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:50184_u
[junit4:junit4]   2> 19005 T3803 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:50184_u
[junit4:junit4]   2> 19015 T3877 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 19015 T3845 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 19017 T3832 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4]   2> 19018 T3832 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 19017 T3825 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4]   2> 19019 T3825 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 19020 T3893 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4]   2> 19021 T3861 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4]   2> 19021 T3861 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 19025 T3877 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4]   2> 19026 T3845 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4]   2> 19036 T3894 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty4-1363117015223/collection1
[junit4:junit4]   2> 19036 T3894 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4]   2> 19038 T3894 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4]   2> 19038 T3894 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4]   2> 19041 T3894 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty4-1363117015223/collection1/'
[junit4:junit4]   2> 19042 T3894 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty4-1363117015223/collection1/lib/classes/' to classloader
[junit4:junit4]   2> 19043 T3894 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty4-1363117015223/collection1/lib/README' to classloader
[junit4:junit4]   2> 19100 T3894 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4]   2> 19158 T3826 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 19159 T3826 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "core_node_name":null,
[junit4:junit4]   2> 	  "numShards":"3",
[junit4:junit4]   2> 	  "shard":"shard3",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"active",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:50181_u",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:50181/u"}
[junit4:junit4]   2> 19170 T3845 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 19171 T3877 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 19172 T3861 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 19172 T3825 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 19173 T3893 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 19177 T3894 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   2> 19178 T3832 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 19182 T3894 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4]   2> 19195 T3894 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4]   2> 19898 T3894 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   2> 19909 T3894 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4]   2> 19913 T3894 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> 19938 T3894 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 19945 T3894 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 19952 T3894 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 19955 T3894 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4]   2> 19956 T3894 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4]   2> 19956 T3894 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 19958 T3894 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4]   2> 19959 T3894 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4]   2> 19959 T3894 oasc.SolrCore.initDirectoryFactory solr.StandardDirectoryFactory
[junit4:junit4]   2> 19960 T3894 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty4-1363117015223/collection1/, dataDir=./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1363116997564/jetty4/
[junit4:junit4]   2> 19960 T3894 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@7df92e01
[junit4:junit4]   2> 19961 T3894 oasc.SolrCore.initDirectoryFactory solr.StandardDirectoryFactory
[junit4:junit4]   2> 19961 T3894 oasc.CachingDirectoryFactory.get return new directory for /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1363116997564/jetty4 forceNew: false
[junit4:junit4]   2> 19962 T3894 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1363116997564/jetty4/index/
[junit4:junit4]   2> 19962 T3894 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1363116997564/jetty4/index' doesn't exist. Creating new index...
[junit4:junit4]   2> 19963 T3894 oasc.CachingDirectoryFactory.get return new directory for /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1363116997564/jetty4/index forceNew: false
[junit4:junit4]   2> 19967 T3894 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4]   2> 		commit{dir=/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1363116997564/jetty4/index,segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 19968 T3894 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4]   2> 19971 T3894 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   2> 19972 T3894 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   2> 19973 T3894 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   2> 19974 T3894 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4]   2> 19975 T3894 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4]   2> 19975 T3894 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   2> 19976 T3894 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4]   2> 19977 T3894 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4]   2> 19977 T3894 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   2> 19984 T3894 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4]   2> 19990 T3894 oass.SolrIndexSearcher.<init> Opening Searcher@76f91a main
[junit4:junit4]   2> 19991 T3894 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4]   2> 19992 T3894 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4]   2> 19995 T3895 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@76f91a main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   2> 19998 T3894 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4]   2> 19998 T3894 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 20693 T3826 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 20694 T3826 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "core_node_name":null,
[junit4:junit4]   2> 	  "numShards":"3",
[junit4:junit4]   2> 	  "shard":null,
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"down",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:50184_u",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:50184/u"}
[junit4:junit4]   2> 20695 T3826 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=3
[junit4:junit4]   2> 20695 T3826 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4:junit4]   2> 20703 T3877 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 20704 T3832 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 20704 T3845 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 20704 T3893 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 20705 T3825 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 20705 T3861 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 21001 T3894 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4]   2> 21001 T3894 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:50184/u collection:collection1 shard:shard1
[junit4:junit4]   2> 21007 T3894 oasc.ZkController.register We are http://127.0.0.1:50184/u/collection1/ and leader is http://127.0.0.1:50175/u/collection1/
[junit4:junit4]   2> 21007 T3894 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:50184/u
[junit4:junit4]   2> 21008 T3894 oasc.ZkController.checkRecovery Core needs to recover:collection1
[junit4:junit4]   2> 21008 T3894 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4:junit4]   2> ASYNC  NEW_CORE C373 name=collection1 org.apache.solr.core.SolrCore@683a079c url=http://127.0.0.1:50184/u/collection1 node=127.0.0.1:50184_u C373_STATE=coll:collection1 core:collection1 props:{state=down, core=collection1, collection=collection1, node_name=127.0.0.1:50184_u, base_url=http://127.0.0.1:50184/u}
[junit4:junit4]   2> 21009 T3896 C373 P50184 oasc.RecoveryStrategy.run Starting recovery process.  core=collection1 recoveringAfterStartup=true
[junit4:junit4]   2> 21010 T3896 C373 P50184 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4]   2> 21011 T3894 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 21011 T3896 C373 P50184 oasc.ZkController.publish publishing core=collection1 state=recovering
[junit4:junit4]   2> 21011 T3896 C373 P50184 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 21013 T3896 C373 P50184 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 21013 T3803 oass.SolrDispatchFilter.init user.dir=/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0
[junit4:junit4]   2> 21014 T3803 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4]   2> 21014 T3803 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 21238 T3803 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4]   2> 21244 T3803 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:50188
[junit4:junit4]   2> 21245 T3803 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4]   2> 21246 T3803 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 21247 T3803 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty5-1363117018579
[junit4:junit4]   2> 21248 T3803 oasc.CoreContainer$Initializer.initialize looking for solr config file: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty5-1363117018579/solr.xml
[junit4:junit4]   2> 21248 T3803 oasc.CoreContainer.<init> New CoreContainer 1510939359
[junit4:junit4]   2> 21249 T3803 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty5-1363117018579/'
[junit4:junit4]   2> 21250 T3803 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty5-1363117018579/'
[junit4:junit4]   2> 21302 T3803 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4]   2> 21303 T3803 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4]   2> 21303 T3803 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4]   2> 21304 T3803 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4]   2> 21305 T3803 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4]   2> 21305 T3803 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4]   2> 21306 T3803 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4]   2> 21306 T3803 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4]   2> 21307 T3803 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4]   2> 21308 T3803 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4]   2> 21323 T3803 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4]   2> 21344 T3803 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:50168/solr
[junit4:junit4]   2> 21344 T3803 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4]   2> 21345 T3803 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:50168 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@7795eafb
[junit4:junit4]   2> 21346 T3803 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 21347 T3907 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:50168. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 21349 T3907 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:50168, initiating session
[junit4:junit4]   2> 21349 T3805 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:50189
[junit4:junit4]   2> 21350 T3805 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:50189
[junit4:junit4]   2> 21352 T3807 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d601abbc5000d with negotiated timeout 20000 for client /127.0.0.1:50189
[junit4:junit4]   2> 21352 T3907 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:50168, sessionid = 0x13d601abbc5000d, negotiated timeout = 20000
[junit4:junit4]   2> 21352 T3908 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@7795eafb name:ZooKeeperConnection Watcher:127.0.0.1:50168 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 21353 T3803 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 21355 T3808 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d601abbc5000d
[junit4:junit4]   2> 21357 T3805 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:50189 which had sessionid 0x13d601abbc5000d
[junit4:junit4]   2> 21357 T3803 oaz.ZooKeeper.close Session: 0x13d601abbc5000d closed
[junit4:junit4]   2> 21357 T3908 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 21358 T3803 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4]   2> 21364 T3803 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:50168/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@64648dd9
[junit4:junit4]   2> 21366 T3803 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 21367 T3909 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:50168. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 21368 T3909 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:50168, initiating session
[junit4:junit4]   2> 21368 T3805 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:50190
[junit4:junit4]   2> 21369 T3805 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:50190
[junit4:junit4]   2> 21370 T3807 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d601abbc5000e with negotiated timeout 20000 for client /127.0.0.1:50190
[junit4:junit4]   2> 21371 T3909 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:50168, sessionid = 0x13d601abbc5000e, negotiated timeout = 20000
[junit4:junit4]   2> 21371 T3910 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@64648dd9 name:ZooKeeperConnection Watcher:127.0.0.1:50168/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 21371 T3803 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 21374 T3808 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d601abbc5000e type:create cxid:0x1 zxid:0xc5 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 21375 T3808 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d601abbc5000e type:create cxid:0x2 zxid:0xc6 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 21379 T3803 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 22219 T3826 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 22220 T3826 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "core_node_name":null,
[junit4:junit4]   2> 	  "numShards":"3",
[junit4:junit4]   2> 	  "shard":"shard1",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"recovering",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:50184_u",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:50184/u"}
[junit4:junit4]   2> 22229 T3845 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 22229 T3825 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 22230 T3893 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 22230 T3910 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 22230 T3861 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 22230 T3877 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 22230 T3832 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 22388 T3803 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:50188_u
[junit4:junit4]   2> 22389 T3808 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d601abbc5000e type:delete cxid:0xd zxid:0xcb txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:50188_u Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:50188_u
[junit4:junit4]   2> 22390 T3803 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:50188_u
[junit4:junit4]   2> 22394 T3877 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 22394 T3910 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 22395 T3845 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 22395 T3893 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 22398 T3832 oascc.ZkStateReader$3.process Updating live nodes... (6)
[junit4:junit4]   2> 22398 T3832 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 6)
[junit4:junit4]   2> 22398 T3825 oascc.ZkStateReader$3.process Updating live nodes... (6)
[junit4:junit4]   2> 22398 T3861 oascc.ZkStateReader$3.process Updating live nodes... (6)
[junit4:junit4]   2> 22398 T3825 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 6)
[junit4:junit4]   2> 22399 T3861 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 6)
[junit4:junit4]   2> 22404 T3910 oascc.ZkStateReader$3.process Updating live nodes... (6)
[junit4:junit4]   2> 22404 T3877 oascc.ZkStateReader$3.process Updating live nodes... (6)
[junit4:junit4]   2> 22404 T3845 oascc.ZkStateReader$3.process Updating live nodes... (6)
[junit4:junit4]   2> 22405 T3893 oascc.ZkStateReader$3.process Updating live nodes... (6)
[junit4:junit4]   2> 22414 T3911 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty5-1363117018579/collection1
[junit4:junit4]   2> 22414 T3911 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4]   2> 22415 T3911 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4]   2> 22415 T3911 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4]   2> 22417 T3911 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty5-1363117018579/collection1/'
[junit4:junit4]   2> 22418 T3911 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty5-1363117018579/collection1/lib/classes/' to classloader
[junit4:junit4]   2> 22419 T3911 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty5-1363117018579/collection1/lib/README' to classloader
[junit4:junit4]   2> 22463 T3911 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4]   2> 22525 T3911 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   2> 22527 T3911 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4]   2> 22539 T3911 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4]   2> 23038 T3840 oass.SolrDispatchFilter.handleAdminRequest /admin/cores {coreNodeName=127.0.0.1:50184_u_collection1&state=recovering&nodeName=127.0.0.1:50184_u&action=PREPRECOVERY&checkLive=true&core=collection1&wt=javabin&onlyIfLeader=true&version=2} status=0 QTime=2009 
[junit4:junit4]   2> 23239 T3911 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   2> 23259 T3911 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4]   2> 23264 T3911 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> 23290 T3911 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 23301 T3911 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 23311 T3911 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 23314 T3911 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4]   2> 23314 T3911 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4]   2> 23315 T3911 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 23317 T3911 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4]   2> 23317 T3911 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4]   2> 23318 T3911 oasc.SolrCore.initDirectoryFactory solr.StandardDirectoryFactory
[junit4:junit4]   2> 23319 T3911 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty5-1363117018579/collection1/, dataDir=./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1363116997564/jetty5/
[junit4:junit4]   2> 23319 T3911 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@7df92e01
[junit4:junit4]   2> 23320 T3911 oasc.SolrCore.initDirectoryFactory solr.StandardDirectoryFactory
[junit4:junit4]   2> 23322 T3911 oasc.CachingDirectoryFactory.get return new directory for /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1363116997564/jetty5 forceNew: false
[junit4:junit4]   2> 23323 T3911 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1363116997564/jetty5/index/
[junit4:junit4]   2> 23324 T3911 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1363116997564/jetty5/index' doesn't exist. Creating new index...
[junit4:junit4]   2> 23325 T3911 oasc.CachingDirectoryFactory.get return new directory for /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1363116997564/jetty5/index forceNew: false
[junit4:junit4]   2> 23331 T3911 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4]   2> 		commit{dir=/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1363116997564/jetty5/index,segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 23332 T3911 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4]   2> 23335 T3911 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   2> 23336 T3911 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   2> 23337 T3911 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   2> 23338 T3911 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4]   2> 23338 T3911 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4]   2> 23339 T3911 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   2> 23339 T3911 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4]   2> 23340 T3911 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4]   2> 23340 T3911 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   2> 23347 T3911 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4]   2> 23354 T3911 oass.SolrIndexSearcher.<init> Opening Searcher@152f5db9 main
[junit4:junit4]   2> 23355 T3911 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4]   2> 23355 T3911 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4]   2> 23359 T3912 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@152f5db9 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   2> 23361 T3911 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4]   2> 23361 T3911 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 23747 T3826 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 23748 T3826 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "core_node_name":null,
[junit4:junit4]   2> 	  "numShards":"3",
[junit4:junit4]   2> 	  "shard":null,
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"down",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:50188_u",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:50188/u"}
[junit4:junit4]   2> 23748 T3826 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=3
[junit4:junit4]   2> 23749 T3826 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard2
[junit4:junit4]   2> 23759 T3877 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 6)
[junit4:junit4]   2> 23759 T3861 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 6)
[junit4:junit4]   2> 23759 T3845 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 6)
[junit4:junit4]   2> 23759 T3832 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 6)
[junit4:junit4]   2> 23760 T3825 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 6)
[junit4:junit4]   2> 23760 T3893 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 6)
[junit4:junit4]   2> 23759 T3910 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 6)
[junit4:junit4]   2> 24368 T3911 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4]   2> 24368 T3911 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:50188/u collection:collection1 shard:shard2
[junit4:junit4]   2> 24374 T3911 oasc.ZkController.register We are http://127.0.0.1:50188/u/collection1/ and leader is http://127.0.0.1:50178/u/collection1/
[junit4:junit4]   2> 24374 T3911 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:50188/u
[junit4:junit4]   2> 24374 T3911 oasc.ZkController.checkRecovery Core needs to recover:collection1
[junit4:junit4]   2> 24374 T3911 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4:junit4]   2> ASYNC  NEW_CORE C374 name=collection1 org.apache.solr.core.SolrCore@32046251 url=http://127.0.0.1:50188/u/collection1 node=127.0.0.1:50188_u C374_STATE=coll:collection1 core:collection1 props:{state=down, core=collection1, collection=collection1, node_name=127.0.0.1:50188_u, base_url=http://127.0.0.1:50188/u}
[junit4:junit4]   2> 24375 T3913 C374 P50188 oasc.RecoveryStrategy.run Starting recovery process.  core=collection1 recoveringAfterStartup=true
[junit4:junit4]   2> 24377 T3913 C374 P50188 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4]   2> 24376 T3911 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 24377 T3913 C374 P50188 oasc.ZkController.publish publishing core=collection1 state=recovering
[junit4:junit4]   2> 24377 T3913 C374 P50188 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 24379 T3803 oass.SolrDispatchFilter.init user.dir=/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0
[junit4:junit4]   2> 24380 T3913 C374 P50188 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 24380 T3803 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4]   2> 24380 T3803 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 24612 T3803 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4]   2> 24618 T3803 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:50192
[junit4:junit4]   2> 24619 T3803 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4]   2> 24620 T3803 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 24620 T3803 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty6-1363117021943
[junit4:junit4]   2> 24621 T3803 oasc.CoreContainer$Initializer.initialize looking for solr config file: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty6-1363117021943/solr.xml
[junit4:junit4]   2> 24621 T3803 oasc.CoreContainer.<init> New CoreContainer 1167780212
[junit4:junit4]   2> 24622 T3803 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty6-1363117021943/'
[junit4:junit4]   2> 24623 T3803 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty6-1363117021943/'
[junit4:junit4]   2> 24677 T3803 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4]   2> 24678 T3803 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4]   2> 24679 T3803 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4]   2> 24679 T3803 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4]   2> 24680 T3803 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4]   2> 24680 T3803 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4]   2> 24681 T3803 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4]   2> 24681 T3803 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4]   2> 24682 T3803 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4]   2> 24683 T3803 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4]   2> 24697 T3803 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4]   2> 24719 T3803 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:50168/solr
[junit4:junit4]   2> 24720 T3803 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4]   2> 24721 T3803 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:50168 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@86be8f3
[junit4:junit4]   2> 24722 T3803 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 24723 T3924 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:50168. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 24725 T3924 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:50168, initiating session
[junit4:junit4]   2> 24725 T3805 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:50193
[junit4:junit4]   2> 24726 T3805 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:50193
[junit4:junit4]   2> 24728 T3807 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d601abbc5000f with negotiated timeout 20000 for client /127.0.0.1:50193
[junit4:junit4]   2> 24728 T3924 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:50168, sessionid = 0x13d601abbc5000f, negotiated timeout = 20000
[junit4:junit4]   2> 24728 T3925 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@86be8f3 name:ZooKeeperConnection Watcher:127.0.0.1:50168 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 24729 T3803 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 24731 T3808 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d601abbc5000f
[junit4:junit4]   2> 24733 T3805 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:50193 which had sessionid 0x13d601abbc5000f
[junit4:junit4]   2> 24733 T3803 oaz.ZooKeeper.close Session: 0x13d601abbc5000f closed
[junit4:junit4]   2> 24733 T3925 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 24733 T3803 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4]   2> 24739 T3803 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:50168/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@76aaf76c
[junit4:junit4]   2> 24741 T3803 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 24741 T3926 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:50168. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 24742 T3926 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:50168, initiating session
[junit4:junit4]   2> 24743 T3805 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:50194
[junit4:junit4]   2> 24743 T3805 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:50194
[junit4:junit4]   2> 24745 T3807 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d601abbc50010 with negotiated timeout 20000 for client /127.0.0.1:50194
[junit4:junit4]   2> 24745 T3926 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:50168, sessionid = 0x13d601abbc50010, negotiated timeout = 20000
[junit4:junit4]   2> 24745 T3927 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@76aaf76c name:ZooKeeperConnection Watcher:127.0.0.1:50168/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 24746 T3803 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 24748 T3808 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d601abbc50010 type:create cxid:0x1 zxid:0xd8 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 24750 T3808 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d601abbc50010 type:create cxid:0x2 zxid:0xd9 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 24754 T3803 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2>  C373_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=recovering, core=collection1, collection=collection1, node_name=127.0.0.1:50184_u, base_url=http://127.0.0.1:50184/u}
[junit4:junit4]   2> 25040 T3896 C373 P50184 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:50175/u/collection1/ core=collection1 - recoveringAfterStartup=true
[junit4:junit4]   2> 25041 T3896 C373 P50184 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:50184/u START replicas=[http://127.0.0.1:50175/u/collection1/] nUpdates=100
[junit4:junit4]   2> 25043 T3896 C373 P50184 oasu.PeerSync.sync WARNING no frame of reference to tell of we've missed updates
[junit4:junit4]   2> 25046 T3896 C373 P50184 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=collection1
[junit4:junit4]   2> 25047 T3896 C373 P50184 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=collection1
[junit4:junit4]   2> 25048 T3896 C373 P50184 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=collection1
[junit4:junit4]   2> 25051 T3896 C373 P50184 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4]   2> 25052 T3896 C373 P50184 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:50175/u/collection1/. core=collection1
[junit4:junit4]   2> 25052 T3896 C373 P50184 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> ASYNC  NEW_CORE C375 name=collection1 org.apache.solr.core.SolrCore@b7e1ce3 url=http://127.0.0.1:50175/u/collection1 node=127.0.0.1:50175_u C375_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:50175_u, base_url=http://127.0.0.1:50175/u, leader=true}
[junit4:junit4]   2> 25057 T3841 C375 P50175 REQ /get {getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=1 
[junit4:junit4]   2> 25066 T3836 C375 P50175 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4]   2> 25069 T3836 C375 P50175 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4]   2> 		commit{dir=/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1363116997564/jetty1/index,segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 25069 T3836 C375 P50175 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4]   2> 25071 T3836 C375 P50175 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4]   2> 		commit{dir=/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1363116997564/jetty1/index,segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 		commit{dir=/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1363116997564/jetty1/index,segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4]   2> 25071 T3836 C375 P50175 oasc.SolrDeletionPolicy.updateCommits newest commit = 2[segments_2]
[junit4:junit4]   2> 25072 T3836 C375 P50175 oass.SolrIndexSearcher.<init> Opening Searcher@89f7205 realtime
[junit4:junit4]   2> 25073 T3836 C375 P50175 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4]   2> 25073 T3836 C375 P50175 /update {waitSearcher=true&openSearcher=false&commit=true&wt=javabin&commit_end_point=true&version=2&softCommit=false} {commit=} 0 7
[junit4:junit4]   2> 25074 T3896 C373 P50184 oash.ReplicationHandler.inform Commits will be reserved for  10000
[junit4:junit4]   2> 25074 T3896 C373 P50184 oash.SnapPuller.<init>  No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4]   2> 25078 T3838 C375 P50175 oash.ReplicationHandler.inform Commits will be reserved for  10000
[junit4:junit4]   2> 25078 T3838 C375 P50175 REQ /replication {command=indexversion&qt=/replication&wt=javabin&version=2} status=0 QTime=2 
[junit4:junit4]   2> 25080 T3896 C373 P50184 oash.SnapPuller.fetchLatestIndex Master's generation: 2
[junit4:junit4]   2> 25080 T3896 C373 P50184 oash.SnapPuller.fetchLatestIndex Slave's generation: 1
[junit4:junit4]   2> 25081 T3896 C373 P50184 oash.SnapPuller.fetchLatestIndex Starting replication process
[junit4:junit4]   2> 25086 T3839 C375 P50175 REQ /replication {command=filelist&qt=/replication&wt=javabin&generation=2&version=2} status=0 QTime=1 
[junit4:junit4]   2> 25086 T3896 C373 P50184 oash.SnapPuller.fetchLatestIndex Number of files in latest index in master: 1
[junit4:junit4]   2> 25087 T3896 C373 P50184 oasc.CachingDirectoryFactory.get return new directory for /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1363116997564/jetty4/index.20130313073702641 forceNew: false
[junit4:junit4]   2> 25088 T3896 C373 P50184 oash.SnapPuller.fetchLatestIndex Starting download to org.apache.lucene.store.NIOFSDirectory@/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1363116997564/jetty4/index.20130313073702641 lockFactory=org.apache.lucene.store.NativeFSLockFactory@1047d36a fullCopy=false
[junit4:junit4]   2> 25091 T3840 C375 P50175 REQ /replication {file=segments_2&command=filecontent&checksum=true&wt=filestream&qt=/replication&generation=2} status=0 QTime=0 
[junit4:junit4]   2> 25093 T3896 C373 P50184 oash.SnapPuller.fetchLatestIndex Total time taken for download : 0 secs
[junit4:junit4]   2> 25095 T3896 C373 P50184 oasu.DefaultSolrCoreState.newIndexWriter Creating new IndexWriter...
[junit4:junit4]   2> 25096 T3896 C373 P50184 oasu.DefaultSolrCoreState.newIndexWriter Waiting until IndexWriter is unused... core=collection1
[junit4:junit4]   2> 25099 T3896 C373 P50184 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=2
[junit4:junit4]   2> 		commit{dir=/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1363116997564/jetty4/index,segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 		commit{dir=/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1363116997564/jetty4/index,segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4]   2> 25099 T3896 C373 P50184 oasc.SolrDeletionPolicy.updateCommits newest commit = 2[segments_2]
[junit4:junit4]   2> 25100 T3896 C373 P50184 oasu.DefaultSolrCoreState.newIndexWriter New IndexWriter is ready to be used.
[junit4:junit4]   2> 25100 T3896 C373 P50184 oass.SolrIndexSearcher.<init> Opening Searcher@f1b3a4d main
[junit4:junit4]   2> 25102 T3895 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@f1b3a4d main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4]   2> 25103 T3896 C373 P50184 oash.SnapPuller.fetchLatestIndex removing temporary index download directory files org.apache.lucene.store.NIOFSDirectory@/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1363116997564/jetty4/index.20130313073702641 lockFactory=org.apache.lucene.store.NativeFSLockFactory@1047d36a
[junit4:junit4]   2> 25104 T3896 C373 P50184 oasc.RecoveryStrategy.replay No replay needed. core=collection1
[junit4:junit4]   2> 25104 T3896 C373 P50184 oasc.RecoveryStrategy.doRecovery Replication Recovery was successful - registering as Active. core=collection1
[junit4:junit4]   2> 25104 T3896 C373 P50184 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4]   2> 25105 T3896 C373 P50184 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 25107 T3896 C373 P50184 oasc.RecoveryStrategy.doRecovery Finished recovery process. core=collection1
[junit4:junit4]   2> 25271 T3826 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 25272 T3826 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "core_node_name":null,
[junit4:junit4]   2> 	  "numShards":"3",
[junit4:junit4]   2> 	  "shard":"shard2",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"recovering",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:50188_u",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:50188/u"}
[junit4:junit4]   2> 25279 T3826 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "core_node_name":null,
[junit4:junit4]   2> 	  "numShards":"3",
[junit4:junit4]   2> 	  "shard":"shard1",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"active",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:50184_u",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:50184/u"}
[junit4:junit4]   2> 25289 T3832 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 6)
[junit4:junit4]   2> 25289 T3877 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 6)
[junit4:junit4]   2> 25289 T3910 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 6)
[junit4:junit4]   2> 25290 T3845 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 6)
[junit4:junit4]   2> 25289 T3927 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 6)
[junit4:junit4]   2> 25289 T3893 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 6)
[junit4:junit4]   2> 25289 T3825 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 6)
[junit4:junit4]   2> 25290 T3861 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 6)
[junit4:junit4]   2> 25392 T3852 oass.SolrDispatchFilter.handleAdminRequest /admin/cores {coreNodeName=127.0.0.1:50188_u_collection1&state=recovering&nodeName=127.0.0.1:50188_u&action=PREPRECOVERY&checkLive=true&core=collection1&wt=javabin&onlyIfLeader=true&version=2} status=0 QTime=1001 
[junit4:junit4]   2> 25761 T3803 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:50192_u
[junit4:junit4]   2> 25763 T3808 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d601abbc50010 type:delete cxid:0xd zxid:0xe2 txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:50192_u Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:50192_u
[junit4:junit4]   2> 25764 T3803 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:50192_u
[junit4:junit4]   2> 25769 T3845 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 6)
[junit4:junit4]   2> 25770 T3877 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 6)
[junit4:junit4]   2> 25770 T3910 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 6)
[junit4:junit4]   2> 25770 T3893 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 6)
[junit4:junit4]   2> 25773 T3832 oascc.ZkStateReader$3.process Updating live nodes... (7)
[junit4:junit4]   2> 25773 T3832 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 7)
[junit4:junit4]   2> 25774 T3927 oascc.ZkStateReader$3.process Updating live nodes... (7)
[junit4:junit4]   2> 25774 T3927 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 7)
[junit4:junit4]   2> 25774 T3861 oascc.ZkStateReader$3.process Updating live nodes... (7)
[junit4:junit4]   2> 25775 T3861 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 7)
[junit4:junit4]   2> 25775 T3825 oascc.ZkStateReader$3.process Updating live nodes... (7)
[junit4:junit4]   2> 25775 T3825 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 7)
[junit4:junit4]   2> 25779 T3893 oascc.ZkStateReader$3.process Updating live nodes... (7)
[junit4:junit4]   2> 25779 T3910 oascc.ZkStateReader$3.process Updating live nodes... (7)
[junit4:junit4]   2> 25780 T3877 oascc.ZkStateReader$3.process Updating live nodes... (7)
[junit4:junit4]   2> 25779 T3845 oascc.ZkStateReader$3.process Updating live nodes... (7)
[junit4:junit4]   2> 25791 T3930 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty6-1363117021943/collection1
[junit4:junit4]   2> 25792 T3930 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4]   2> 25793 T3930 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4]   2> 25793 T3930 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4]   2> 25796 T3930 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty6-1363117021943/collection1/'
[junit4:junit4]   2> 25797 T3930 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty6-1363117021943/collection1/lib/classes/' to classloader
[junit4:junit4]   2> 25798 T3930 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty6-1363117021943/collection1/lib/README' to classloader
[junit4:junit4]   2> 25863 T3930 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4]   2> 25919 T3930 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   2> 25921 T3930 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4]   2> 25928 T3930 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4]   2> 26516 T3930 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   2> 26527 T3930 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4]   2> 26531 T3930 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> 26553 T3930 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 26558 T3930 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 26565 T3930 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 26567 T3930 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4]   2> 26568 T3930 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4]   2> 26568 T3930 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 26571 T3930 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4]   2> 26571 T3930 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4]   2> 26571 T3930 oasc.SolrCore.initDirectoryFactory solr.StandardDirectoryFactory
[junit4:junit4]   2> 26572 T3930 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty6-1363117021943/collection1/, dataDir=./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1363116997564/jetty6/
[junit4:junit4]   2> 26572 T3930 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@7df92e01
[junit4:junit4]   2> 26573 T3930 oasc.SolrCore.initDirectoryFactory solr.StandardDirectoryFactory
[junit4:junit4]   2> 26573 T3930 oasc.CachingDirectoryFactory.get return new directory for /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1363116997564/jetty6 forceNew: false
[junit4:junit4]   2> 26574 T3930 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1363116997564/jetty6/index/
[junit4:junit4]   2> 26574 T3930 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1363116997564/jetty6/index' doesn't exist. Creating new index...
[junit4:junit4]   2> 26575 T3930 oasc.Cachin

[...truncated too long message...]

omizedRunner$3.evaluate(RandomizedRunner.java:648)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
[junit4:junit4]    > 	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
[junit4:junit4]    > 	at java.lang.Thread.run(Thread.java:722)
[junit4:junit4]    > Caused by: java.net.SocketException: Invalid argument
[junit4:junit4]    > 	at java.net.SocketInputStream.socketRead0(Native Method)
[junit4:junit4]    > 	at java.net.SocketInputStream.read(SocketInputStream.java:150)
[junit4:junit4]    > 	at java.net.SocketInputStream.read(SocketInputStream.java:121)
[junit4:junit4]    > 	at org.apache.http.impl.io.AbstractSessionInputBuffer.fillBuffer(AbstractSessionInputBuffer.java:166)
[junit4:junit4]    > 	at org.apache.http.impl.io.SocketInputBuffer.fillBuffer(SocketInputBuffer.java:90)
[junit4:junit4]    > 	at org.apache.http.impl.io.AbstractSessionInputBuffer.readLine(AbstractSessionInputBuffer.java:281)
[junit4:junit4]    > 	at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:92)
[junit4:junit4]    > 	at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:62)
[junit4:junit4]    > 	at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:254)
[junit4:junit4]    > 	at org.apache.http.impl.AbstractHttpClientConnection.receiveResponseHeader(AbstractHttpClientConnection.java:289)
[junit4:junit4]    > 	at org.apache.http.impl.conn.DefaultClientConnection.receiveResponseHeader(DefaultClientConnection.java:252)
[junit4:junit4]    > 	at org.apache.http.impl.conn.ManagedClientConnectionImpl.receiveResponseHeader(ManagedClientConnectionImpl.java:191)
[junit4:junit4]    > 	at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:300)
[junit4:junit4]    > 	at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:127)
[junit4:junit4]    > 	at org.apache.http.impl.client.DefaultRequestDirector.tryExecute(DefaultRequestDirector.java:717)
[junit4:junit4]    > 	at org.apache.http.impl.client.DefaultRequestDirector.execute(DefaultRequestDirector.java:522)
[junit4:junit4]    > 	at org.apache.http.impl.client.AbstractHttpClient.execute(AbstractHttpClient.java:906)
[junit4:junit4]    > 	at org.apache.http.impl.client.AbstractHttpClient.execute(AbstractHttpClient.java:805)
[junit4:junit4]    > 	at org.apache.http.impl.client.AbstractHttpClient.execute(AbstractHttpClient.java:784)
[junit4:junit4]    > 	at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:353)
[junit4:junit4]    > 	... 46 more
[junit4:junit4]   2> 188810 T3803 oas.SolrTestCaseJ4.deleteCore ###deleteCore
[junit4:junit4]   2> 188816 T3802 ccr.ThreadLeakControl.checkThreadLeaks WARNING Will linger awaiting termination of 1 leaked thread(s).
[junit4:junit4]   2> 189456 T3806 oazs.SessionTrackerImpl.run SessionTrackerImpl exited loop!
[junit4:junit4]   2> NOTE: test params are: codec=Lucene42: {range_facet_l=PostingsFormat(name=MockSep), text=PostingsFormat(name=NestedPulsing), _version_=PostingsFormat(name=MockSep), rnd_b=PostingsFormat(name=SimpleText), intDefault=PostingsFormat(name=MockSep), timestamp=PostingsFormat(name=MockSep), id=PostingsFormat(name=SimpleText), a_t=PostingsFormat(name=MockSep), range_facet_sl=PostingsFormat(name=NestedPulsing), range_facet_si=Pulsing41(freqCutoff=11 minBlockSize=89 maxBlockSize=244), other_tl1=PostingsFormat(name=MockSep), multiDefault=Pulsing41(freqCutoff=11 minBlockSize=89 maxBlockSize=244), a_si=Pulsing41(freqCutoff=11 minBlockSize=89 maxBlockSize=244)}, docValues:{timestamp=DocValuesFormat(name=CheapBastard)}, sim=DefaultSimilarity, locale=nl_NL, timezone=Pacific/Wallis
[junit4:junit4]   2> NOTE: Mac OS X 10.8.2 x86_64/Oracle Corporation 1.7.0_15 (64-bit)/cpus=2,threads=2,free=208192392,total=370212864
[junit4:junit4]   2> NOTE: All tests run in this JVM: [HighlighterTest, TestRemoteStreaming, DistributedSpellCheckComponentTest, BadComponentTest, TestLazyCores, LeaderElectionTest, StatsComponentTest, TestSweetSpotSimilarityFactory, TestLFUCache, DateMathParserTest, TestDistributedSearch, TestCSVLoader, TestPHPSerializedResponseWriter, TermsComponentTest, SyncSliceTest, TestNumberUtils, TestStressReorder, SpellCheckCollatorTest, TestPseudoReturnFields, TestCharFilters, TestBinaryField, ZkControllerTest, TestAnalyzedSuggestions, MBeansHandlerTest, DefaultValueUpdateProcessorTest, TestFastOutputStream, BasicDistributedZk2Test, JSONWriterTest, ReturnFieldsTest, UpdateRequestProcessorFactoryTest, ZkCLITest, TestBM25SimilarityFactory, TestComponentsName, SolrIndexConfigTest, RAMDirectoryFactoryTest, ClusterStateTest, PrimUtilsTest, TestPostingsSolrHighlighter, SolrRequestParserTest, TestHashPartitioner, TestJoin, RecoveryZkTest, TestFieldResource, HardAutoCommitTest, TestBinaryResponseWriter, TestRTGBase, DirectSolrSpellCheckerTest, TestFastLRUCache, TestStressRecovery, UnloadDistributedZkTest, CacheHeaderTest, JsonLoaderTest, TestArbitraryIndexDir, TestSurroundQueryParser, UniqFieldsUpdateProcessorFactoryTest, SimpleFacetsTest, ChaosMonkeyNothingIsSafeTest, TestConfig, TestRandomDVFaceting, TestSearchPerf, UUIDFieldTest, TestIndexSearcher, SuggesterTSTTest, SolrCmdDistributorTest, DocValuesMultiTest, IndexBasedSpellCheckerTest, TestMergePolicyConfig, TestQuerySenderListener, RegexBoostProcessorTest, DocumentBuilderTest, SoftAutoCommitTest, PeerSyncTest, TestDocumentBuilder, SolrCoreTest, FileUtilsTest, PreAnalyzedFieldTest, SpellCheckComponentTest, TestSuggestSpellingConverter, SystemInfoHandlerTest, DistributedTermsComponentTest, TestQueryUtils, SolrTestCaseJ4Test, TestRealTimeGet, AlternateDirectoryTest, TestFunctionQuery, TestLRUCache, ResponseLogComponentTest, TestQuerySenderNoQuery, TestWordDelimiterFilterFactory, TestDistributedGrouping, ShardRoutingCustomTest, TestJmxMonitoredMap, TestFieldCollectionResource, BasicDistributedZkTest, TestReversedWildcardFilterFactory, SolrIndexSplitterTest, ShardRoutingTest, CurrencyFieldOpenExchangeTest, TestSolrDeletionPolicy2, TestMultiCoreConfBootstrap, OpenCloseCoreStressTest, TestSolrDiscoveryProperties, TestLuceneMatchVersion, TestRandomFaceting, TestOmitPositions, SynonymTokenizerTest, TestPluginEnable, AutoCommitTest, ScriptEngineTest, TestCodecSupport, OpenExchangeRatesOrgProviderTest, TestUpdate, TestLMDirichletSimilarityFactory, TestPartialUpdateDeduplication, ClusterStateUpdateTest, TestCollationField, HighlighterConfigTest, TestGroupingSearch, DirectSolrConnectionTest, TestValueSourceCache, RequiredFieldsTest, PolyFieldTest, TestFastWriter, TestPerFieldSimilarity, ZkNodePropsTest, TestQueryTypes, TestBadConfig, CircularListTest, TimeZoneUtilsTest, ChaosMonkeySafeLeaderTest]
[junit4:junit4] Completed in 189.62s, 1 test, 1 error <<< FAILURES!

[...truncated 414 lines...]
BUILD FAILED
/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/build.xml:381: The following error occurred while executing this line:
/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/build.xml:361: The following error occurred while executing this line:
/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/build.xml:39: The following error occurred while executing this line:
/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build.xml:183: The following error occurred while executing this line:
/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/common-build.xml:449: The following error occurred while executing this line:
/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/lucene/common-build.xml:1213: The following error occurred while executing this line:
/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/lucene/common-build.xml:877: There were test failures: 271 suites, 1141 tests, 1 error, 18 ignored (6 assumptions)

Total time: 76 minutes 31 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Recording test results
Description set: Java: 64bit/jdk1.7.0 -XX:+UseParallelGC
Email was triggered for: Failure
Sending email for trigger: Failure