You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by Policeman Jenkins Server <je...@thetaphi.de> on 2014/07/02 07:20:32 UTC
[JENKINS] Lucene-Solr-4.x-Linux (64bit/jdk1.8.0_05) - Build # 10579
- Still Failing!
Build: http://jenkins.thetaphi.de/job/Lucene-Solr-4.x-Linux/10579/
Java: 64bit/jdk1.8.0_05 -XX:+UseCompressedOops -XX:+UseParallelGC
2 tests failed.
FAILED: junit.framework.TestSuite.org.apache.solr.cloud.ReplicationFactorTest
Error Message:
Suite timeout exceeded (>= 7200000 msec).
Stack Trace:
java.lang.Exception: Suite timeout exceeded (>= 7200000 msec).
at __randomizedtesting.SeedInfo.seed([CAD320064FE6F409]:0)
FAILED: org.apache.solr.cloud.ReplicationFactorTest.testDistribSearch
Error Message:
Test abandoned because suite timeout was reached.
Stack Trace:
java.lang.Exception: Test abandoned because suite timeout was reached.
at __randomizedtesting.SeedInfo.seed([CAD320064FE6F409]:0)
Build Log:
[...truncated 12047 lines...]
[junit4] Suite: org.apache.solr.cloud.ReplicationFactorTest
[junit4] 2> Creating dataDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solr.cloud.ReplicationFactorTest-CAD320064FE6F409-001/init-core-data-001
[junit4] 2> 291217 T2045 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /
[junit4] 2> 291220 T2045 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch
[junit4] 2> 291221 T2045 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4] 1> client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 291221 T2046 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
[junit4] 2> 291321 T2045 oasc.ZkTestServer.run start zk server on port:54759
[junit4] 2> 291322 T2045 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 291409 T2052 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@61d2646f name:ZooKeeperConnection Watcher:127.0.0.1:54759 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 291410 T2045 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 291410 T2045 oascc.SolrZkClient.makePath makePath: /solr
[junit4] 2> 291414 T2045 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 291416 T2054 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@3da43591 name:ZooKeeperConnection Watcher:127.0.0.1:54759/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 291416 T2045 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 291416 T2045 oascc.SolrZkClient.makePath makePath: /collections/collection1
[junit4] 2> 291418 T2045 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
[junit4] 2> 291419 T2045 oascc.SolrZkClient.makePath makePath: /collections/control_collection
[junit4] 2> 291420 T2045 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
[junit4] 2> 291422 T2045 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
[junit4] 2> 291422 T2045 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
[junit4] 2> 291424 T2045 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/src/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
[junit4] 2> 291425 T2045 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
[junit4] 2> 291427 T2045 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 291428 T2045 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 291431 T2045 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/src/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4] 2> 291432 T2045 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
[junit4] 2> 291434 T2045 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/src/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4] 2> 291434 T2045 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
[junit4] 2> 291436 T2045 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/src/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4] 2> 291437 T2045 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
[junit4] 2> 291439 T2045 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf1/enumsConfig.xml
[junit4] 2> 291439 T2045 oascc.SolrZkClient.makePath makePath: /configs/conf1/enumsConfig.xml
[junit4] 2> 291441 T2045 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4] 2> 291442 T2045 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
[junit4] 2> 291444 T2045 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 291444 T2045 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 291447 T2045 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4] 2> 291447 T2045 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
[junit4] 2> 291449 T2045 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/src/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4] 2> 291450 T2045 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
[junit4] 2> 291728 T2045 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 291729 T2045 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:46157
[junit4] 2> 291730 T2045 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 291730 T2045 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 291730 T2045 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ./solr.cloud.ReplicationFactorTest-CAD320064FE6F409-001/tempDir-002
[junit4] 2> 291730 T2045 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './solr.cloud.ReplicationFactorTest-CAD320064FE6F409-001/tempDir-002/'
[junit4] 2> 291740 T2045 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solr.cloud.ReplicationFactorTest-CAD320064FE6F409-001/tempDir-002/solr.xml
[junit4] 2> 291746 T2045 oasc.CoreContainer.<init> New CoreContainer 1699254222
[junit4] 2> 291747 T2045 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=./solr.cloud.ReplicationFactorTest-CAD320064FE6F409-001/tempDir-002/]
[junit4] 2> 291747 T2045 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 291747 T2045 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to:
[junit4] 2> 291748 T2045 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 291748 T2045 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 291748 T2045 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 291748 T2045 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 291748 T2045 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 291749 T2045 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 291749 T2045 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 291749 T2045 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 291749 T2045 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 291750 T2045 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 291750 T2045 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:54759/solr
[junit4] 2> 291750 T2045 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 291751 T2045 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 291752 T2065 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@4619b22c name:ZooKeeperConnection Watcher:127.0.0.1:54759 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 291752 T2045 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 291753 T2045 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 291754 T2067 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@542f7886 name:ZooKeeperConnection Watcher:127.0.0.1:54759/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 291754 T2045 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 291755 T2045 oascc.SolrZkClient.makePath makePath: /overseer/queue
[junit4] 2> 291757 T2045 oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work
[junit4] 2> 291758 T2045 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-running
[junit4] 2> 291760 T2045 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-completed
[junit4] 2> 291761 T2045 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-failure
[junit4] 2> 291771 T2045 oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4] 2> 291773 T2045 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:55563_
[junit4] 2> 291774 T2045 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:55563_
[junit4] 2> 291776 T2045 oascc.SolrZkClient.makePath makePath: /overseer_elect
[junit4] 2> 291777 T2045 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4] 2> 291779 T2045 oasc.OverseerElectionContext.runLeaderProcess I am going to be the leader 127.0.0.1:55563_
[junit4] 2> 291779 T2045 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4] 2> 291780 T2045 oasc.Overseer.start Overseer (id=92030316605734915-127.0.0.1:55563_-n_0000000000) starting
[junit4] 2> 291781 T2045 oascc.SolrZkClient.makePath makePath: /overseer/queue-work
[junit4] 2> 291786 T2069 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4] 2> 291786 T2045 oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4] 2> 291787 T2045 oascc.SolrZkClient.makePath makePath: /aliases.json
[junit4] 2> 291789 T2045 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 291791 T2068 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4] 2> 291792 T2070 oasc.ZkController.publish publishing core=collection1 state=down collection=control_collection
[junit4] 2> 291792 T2070 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 291793 T2067 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 291793 T2070 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 291793 T2068 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 291793 T2068 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:55563",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:55563_",
[junit4] 2> "shard":null,
[junit4] 2> "collection":"control_collection",
[junit4] 2> "numShards":"1",
[junit4] 2> "core_node_name":null}
[junit4] 2> 291794 T2068 oasc.Overseer$ClusterStateUpdater.createCollection Create collection control_collection with shards [shard1]
[junit4] 2> 291794 T2068 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4] 2> 291795 T2067 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 291795 T2067 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 292793 T2070 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
[junit4] 2> 292793 T2070 oasc.ZkController.createCollectionZkNode Check for collection zkNode:control_collection
[junit4] 2> 292794 T2070 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 292795 T2070 oascc.ZkStateReader.readConfigName Load collection config from:/collections/control_collection
[junit4] 2> 292796 T2070 oascc.ZkStateReader.readConfigName path=/collections/control_collection configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 292796 T2070 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './solr.cloud.ReplicationFactorTest-CAD320064FE6F409-001/tempDir-002/collection1/'
[junit4] 2> 292797 T2070 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/solr.cloud.ReplicationFactorTest-CAD320064FE6F409-001/tempDir-002/collection1/lib/.svn/' to classloader
[junit4] 2> 292798 T2070 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/solr.cloud.ReplicationFactorTest-CAD320064FE6F409-001/tempDir-002/collection1/lib/classes/' to classloader
[junit4] 2> 292798 T2070 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/solr.cloud.ReplicationFactorTest-CAD320064FE6F409-001/tempDir-002/collection1/lib/README' to classloader
[junit4] 2> 292818 T2070 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_4_10
[junit4] 2> 292825 T2070 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 292826 T2070 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 292830 T2070 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4] 2> 292921 T2070 oass.ByteField.init WARN ByteField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
[junit4] 2> 292921 T2070 oass.ShortField.init WARN ShortField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
[junit4] 2> 292922 T2070 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4] 2> 292925 T2070 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 292926 T2070 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 292935 T2070 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 292938 T2070 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 292940 T2070 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 292941 T2070 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 292941 T2070 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 292942 T2070 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 292942 T2070 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 292943 T2070 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 292943 T2070 oasc.CoreContainer.create Creating SolrCore 'collection1' using configuration from collection control_collection
[junit4] 2> 292943 T2070 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 292943 T2070 oasc.SolrCore.<init> [collection1] Opening new SolrCore at ./solr.cloud.ReplicationFactorTest-CAD320064FE6F409-001/tempDir-002/collection1/, dataDir=./solr.cloud.ReplicationFactorTest-CAD320064FE6F409-001/tempDir-001/control/data/
[junit4] 2> 292943 T2070 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@2914a6d0
[junit4] 2> 292944 T2070 oasc.CachingDirectoryFactory.get return new directory for ./solr.cloud.ReplicationFactorTest-CAD320064FE6F409-001/tempDir-001/control/data
[junit4] 2> 292944 T2070 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./solr.cloud.ReplicationFactorTest-CAD320064FE6F409-001/tempDir-001/control/data/index/
[junit4] 2> 292944 T2070 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './solr.cloud.ReplicationFactorTest-CAD320064FE6F409-001/tempDir-001/control/data/index' doesn't exist. Creating new index...
[junit4] 2> 292945 T2070 oasc.CachingDirectoryFactory.get return new directory for ./solr.cloud.ReplicationFactorTest-CAD320064FE6F409-001/tempDir-001/control/data/index
[junit4] 2> 292945 T2070 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=50, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.7627639309808609]
[junit4] 2> 292945 T2070 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@326a9b32 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@75e52aa),segFN=segments_1,generation=1}
[junit4] 2> 292946 T2070 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 292947 T2070 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
[junit4] 2> 292947 T2070 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
[junit4] 2> 292948 T2070 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 292948 T2070 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
[junit4] 2> 292948 T2070 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 292948 T2070 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
[junit4] 2> 292948 T2070 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 292949 T2070 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 292949 T2070 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 292949 T2070 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4] 2> 292949 T2070 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4] 2> 292949 T2070 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4] 2> 292950 T2070 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4] 2> 292950 T2070 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4] 2> 292950 T2070 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4] 2> 292950 T2070 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
[junit4] 2> 292952 T2070 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 292953 T2070 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 292953 T2070 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 292954 T2070 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=15, maxMergeAtOnceExplicit=49, maxMergedSegmentMB=31.1396484375, floorSegmentMB=1.046875, forceMergeDeletesPctAllowed=1.7284291932442009, segmentsPerTier=47.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.5523492831752316
[junit4] 2> 292954 T2070 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@326a9b32 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@75e52aa),segFN=segments_1,generation=1}
[junit4] 2> 292954 T2070 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 292955 T2070 oass.SolrIndexSearcher.<init> Opening Searcher@481b5531[collection1] main
[junit4] 2> 292955 T2070 oascc.ZkStateReader.readConfigName Load collection config from:/collections/control_collection
[junit4] 2> 292956 T2070 oascc.ZkStateReader.readConfigName path=/collections/control_collection configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 292956 T2070 oasr.ManagedResourceStorage.newStorageIO Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1
[junit4] 2> 292957 T2070 oasr.ManagedResourceStorage$ZooKeeperStorageIO.configure Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 292957 T2070 oasr.RestManager.init Initializing RestManager with initArgs: {}
[junit4] 2> 292957 T2070 oasr.ManagedResourceStorage.load Reading _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 292958 T2070 oasr.ManagedResourceStorage$ZooKeeperStorageIO.openInputStream No data found for znode /configs/conf1/_rest_managed.json
[junit4] 2> 292958 T2070 oasr.ManagedResourceStorage.load Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 292958 T2070 oasr.ManagedResource.notifyObserversDuringInit WARN No registered observers for /rest/managed
[junit4] 2> 292958 T2070 oasr.RestManager.init Initializing 0 registered ManagedResources
[junit4] 2> 292959 T2071 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@481b5531[collection1] main{StandardDirectoryReader(segments_1:1:nrt)}
[junit4] 2> 292960 T2070 oasc.CoreContainer.registerCore registering core: collection1
[junit4] 2> 292961 T2074 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:55563 collection:control_collection shard:shard1
[junit4] 2> 292961 T2045 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1
[junit4] 2> 292962 T2045 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 292962 T2074 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leader_elect/shard1/election
[junit4] 2> 292964 T2045 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 292965 T2077 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@5ff24e13 name:ZooKeeperConnection Watcher:127.0.0.1:54759/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 292965 T2045 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 292966 T2045 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 292966 T2074 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard1
[junit4] 2> 292968 T2067 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 292968 T2045 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:false cause connection loss:false
[junit4] 2> 292968 T2074 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4] 2> 292968 T2074 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4] 2> 292968 T2068 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> ASYNC NEW_CORE C285 name=collection1 org.apache.solr.core.SolrCore@5cf5d13c url=http://127.0.0.1:55563/collection1 node=127.0.0.1:55563_ C285_STATE=coll:control_collection core:collection1 props:{state=down, base_url=http://127.0.0.1:55563, core=collection1, node_name=127.0.0.1:55563_}
[junit4] 2> 292969 T2074 C285 P55563 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:55563/collection1/
[junit4] 2> 292969 T2074 C285 P55563 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4] 2> 292969 T2074 C285 P55563 oasc.SyncStrategy.syncToMe http://127.0.0.1:55563/collection1/ has no replicas
[junit4] 2> 292969 T2074 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:55563/collection1/ shard1
[junit4] 2> 292970 T2074 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leaders/shard1
[junit4] 2> 292970 T2067 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 292972 T2067 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 292973 T2067 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 293075 T2067 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 293075 T2077 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 293123 T2074 oasc.ZkController.register We are http://127.0.0.1:55563/collection1/ and leader is http://127.0.0.1:55563/collection1/
[junit4] 2> 293123 T2074 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:55563
[junit4] 2> 293123 T2074 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4] 2> 293123 T2074 oasc.ZkController.publish publishing core=collection1 state=active collection=control_collection
[junit4] 2> 293123 T2074 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 293124 T2067 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 293124 T2067 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 293125 T2067 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 293125 T2074 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 293126 T2068 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 293126 T2068 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"active",
[junit4] 2> "base_url":"http://127.0.0.1:55563",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:55563_",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"control_collection",
[junit4] 2> "numShards":"3",
[junit4] 2> "core_node_name":"core_node1"}
[junit4] 2> 293127 T2067 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 293187 T2045 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 1
[junit4] 2> 293187 T2045 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 293190 T2045 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:59521
[junit4] 2> 293190 T2045 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 293191 T2045 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 293191 T2045 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ./solr.cloud.ReplicationFactorTest-CAD320064FE6F409-001/tempDir-003
[junit4] 2> 293191 T2045 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './solr.cloud.ReplicationFactorTest-CAD320064FE6F409-001/tempDir-003/'
[junit4] 2> 293209 T2045 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solr.cloud.ReplicationFactorTest-CAD320064FE6F409-001/tempDir-003/solr.xml
[junit4] 2> 293225 T2045 oasc.CoreContainer.<init> New CoreContainer 1398713933
[junit4] 2> 293225 T2045 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=./solr.cloud.ReplicationFactorTest-CAD320064FE6F409-001/tempDir-003/]
[junit4] 2> 293226 T2045 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 293226 T2045 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to:
[junit4] 2> 293227 T2045 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 293227 T2045 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 293227 T2045 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 293228 T2045 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 293228 T2045 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 293229 T2045 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 293229 T2045 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 293229 T2077 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 293229 T2067 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 293230 T2045 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 293231 T2045 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 293232 T2045 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 293232 T2045 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:54759/solr
[junit4] 2> 293233 T2045 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 293235 T2045 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 293236 T2088 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@aac11fa name:ZooKeeperConnection Watcher:127.0.0.1:54759 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 293236 T2045 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 293238 T2045 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 293239 T2090 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@4e3816bc name:ZooKeeperConnection Watcher:127.0.0.1:54759/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 293240 T2045 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 293248 T2045 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 294254 T2045 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:52718_
[junit4] 2> 294262 T2045 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:52718_
[junit4] 2> 294266 T2067 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4] 2> 294266 T2090 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4] 2> 294266 T2077 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4] 2> 294274 T2091 oasc.ZkController.publish publishing core=collection1 state=down collection=collection1
[junit4] 2> 294274 T2091 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 294276 T2091 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 294276 T2067 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 294276 T2067 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 294277 T2067 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 294278 T2068 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 294279 T2068 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:52718",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:52718_",
[junit4] 2> "shard":null,
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"3",
[junit4] 2> "core_node_name":null}
[junit4] 2> 294279 T2068 oasc.Overseer$ClusterStateUpdater.createCollection Create collection collection1 with shards [shard1, shard2, shard3]
[junit4] 2> 294280 T2068 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard2
[junit4] 2> 294282 T2067 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 294384 T2077 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 294384 T2090 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 294384 T2067 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 295276 T2091 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
[junit4] 2> 295277 T2091 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4] 2> 295278 T2091 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 295278 T2091 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
[junit4] 2> 295280 T2091 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 295280 T2091 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './solr.cloud.ReplicationFactorTest-CAD320064FE6F409-001/tempDir-003/collection1/'
[junit4] 2> 295281 T2091 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/solr.cloud.ReplicationFactorTest-CAD320064FE6F409-001/tempDir-003/collection1/lib/.svn/' to classloader
[junit4] 2> 295281 T2091 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/solr.cloud.ReplicationFactorTest-CAD320064FE6F409-001/tempDir-003/collection1/lib/classes/' to classloader
[junit4] 2> 295281 T2091 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/solr.cloud.ReplicationFactorTest-CAD320064FE6F409-001/tempDir-003/collection1/lib/README' to classloader
[junit4] 2> 295300 T2091 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_4_10
[junit4] 2> 295308 T2091 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 295309 T2091 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 295313 T2091 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4] 2> 295421 T2091 oass.ByteField.init WARN ByteField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
[junit4] 2> 295422 T2091 oass.ShortField.init WARN ShortField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
[junit4] 2> 295422 T2091 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4] 2> 295425 T2091 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 295426 T2091 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 295438 T2091 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 295441 T2091 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 295443 T2091 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 295445 T2091 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 295445 T2091 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 295445 T2091 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 295446 T2091 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 295447 T2091 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 295447 T2091 oasc.CoreContainer.create Creating SolrCore 'collection1' using configuration from collection collection1
[junit4] 2> 295447 T2091 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 295447 T2091 oasc.SolrCore.<init> [collection1] Opening new SolrCore at ./solr.cloud.ReplicationFactorTest-CAD320064FE6F409-001/tempDir-003/collection1/, dataDir=./solr.cloud.ReplicationFactorTest-CAD320064FE6F409-001/tempDir-001/jetty1/
[junit4] 2> 295447 T2091 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@2914a6d0
[junit4] 2> 295448 T2091 oasc.CachingDirectoryFactory.get return new directory for ./solr.cloud.ReplicationFactorTest-CAD320064FE6F409-001/tempDir-001/jetty1
[junit4] 2> 295448 T2091 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./solr.cloud.ReplicationFactorTest-CAD320064FE6F409-001/tempDir-001/jetty1/index/
[junit4] 2> 295449 T2091 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './solr.cloud.ReplicationFactorTest-CAD320064FE6F409-001/tempDir-001/jetty1/index' doesn't exist. Creating new index...
[junit4] 2> 295449 T2091 oasc.CachingDirectoryFactory.get return new directory for ./solr.cloud.ReplicationFactorTest-CAD320064FE6F409-001/tempDir-001/jetty1/index
[junit4] 2> 295450 T2091 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=50, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.7627639309808609]
[junit4] 2> 295450 T2091 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@42cecf1c lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@67b7bde3),segFN=segments_1,generation=1}
[junit4] 2> 295450 T2091 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 295455 T2091 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
[junit4] 2> 295456 T2091 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
[junit4] 2> 295456 T2091 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 295456 T2091 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
[junit4] 2> 295456 T2091 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 295457 T2091 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
[junit4] 2> 295457 T2091 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 295458 T2091 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 295458 T2091 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 295458 T2091 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4] 2> 295459 T2091 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4] 2> 295459 T2091 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4] 2> 295459 T2091 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4] 2> 295460 T2091 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4] 2> 295460 T2091 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4] 2> 295461 T2091 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
[junit4] 2> 295463 T2091 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 295465 T2091 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 295465 T2091 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 295466 T2091 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=15, maxMergeAtOnceExplicit=49, maxMergedSegmentMB=31.1396484375, floorSegmentMB=1.046875, forceMergeDeletesPctAllowed=1.7284291932442009, segmentsPerTier=47.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.5523492831752316
[junit4] 2> 295467 T2091 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@42cecf1c lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@67b7bde3),segFN=segments_1,generation=1}
[junit4] 2> 295467 T2091 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 295467 T2091 oass.SolrIndexSearcher.<init> Opening Searcher@295b277[collection1] main
[junit4] 2> 295468 T2091 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
[junit4] 2> 295469 T2091 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 295469 T2091 oasr.ManagedResourceStorage.newStorageIO Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1
[junit4] 2> 295469 T2091 oasr.ManagedResourceStorage$ZooKeeperStorageIO.configure Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 295470 T2091 oasr.RestManager.init Initializing RestManager with initArgs: {}
[junit4] 2> 295470 T2091 oasr.ManagedResourceStorage.load Reading _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 295470 T2091 oasr.ManagedResourceStorage$ZooKeeperStorageIO.openInputStream No data found for znode /configs/conf1/_rest_managed.json
[junit4] 2> 295470 T2091 oasr.ManagedResourceStorage.load Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 295470 T2091 oasr.ManagedResource.notifyObserversDuringInit WARN No registered observers for /rest/managed
[junit4] 2> 295470 T2091 oasr.RestManager.init Initializing 0 registered ManagedResources
[junit4] 2> 295472 T2092 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@295b277[collection1] main{StandardDirectoryReader(segments_1:1:nrt)}
[junit4] 2> 295473 T2091 oasc.CoreContainer.registerCore registering core: collection1
[junit4] 2> 295474 T2095 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:52718 collection:collection1 shard:shard2
[junit4] 2> 295474 T2045 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1
[junit4] 2> 295475 T2045 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 295476 T2095 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard2/election
[junit4] 2> 295481 T2095 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard2
[junit4] 2> 295482 T2067 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 295482 T2067 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 295482 T2067 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 295483 T2095 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4] 2> 295483 T2095 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4] 2> ASYNC NEW_CORE C286 name=collection1 org.apache.solr.core.SolrCore@4c398d4d url=http://127.0.0.1:52718/collection1 node=127.0.0.1:52718_ C286_STATE=coll:collection1 core:collection1 props:{state=down, base_url=http://127.0.0.1:52718, core=collection1, node_name=127.0.0.1:52718_}
[junit4] 2> 295483 T2095 C286 P52718 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:52718/collection1/
[junit4] 2> 295483 T2068 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 295484 T2095 C286 P52718 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4] 2> 295484 T2095 C286 P52718 oasc.SyncStrategy.syncToMe http://127.0.0.1:52718/collection1/ has no replicas
[junit4] 2> 295484 T2095 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:52718/collection1/ shard2
[junit4] 2> 295484 T2095 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard2
[junit4] 2> 295486 T2067 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 295491 T2067 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 295493 T2067 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 295596 T2090 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 295596 T2077 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 295596 T2067 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 295642 T2095 oasc.ZkController.register We are http://127.0.0.1:52718/collection1/ and leader is http://127.0.0.1:52718/collection1/
[junit4] 2> 295642 T2095 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:52718
[junit4] 2> 295642 T2095 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4] 2> 295642 T2095 oasc.ZkController.publish publishing core=collection1 state=active collection=collection1
[junit4] 2> 295642 T2095 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 295644 T2067 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 295644 T2067 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 295644 T2095 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 295644 T2067 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 295645 T2068 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 295646 T2068 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"active",
[junit4] 2> "base_url":"http://127.0.0.1:52718",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:52718_",
[junit4] 2> "shard":"shard2",
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"3",
[junit4] 2> "core_node_name":"core_node1"}
[junit4] 2> 295647 T2067 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 295690 T2045 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 2
[junit4] 2> 295690 T2045 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 295694 T2045 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:36276
[junit4] 2> 295695 T2045 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 295696 T2045 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 295696 T2045 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ./solr.cloud.ReplicationFactorTest-CAD320064FE6F409-001/tempDir-004
[junit4] 2> 295696 T2045 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './solr.cloud.ReplicationFactorTest-CAD320064FE6F409-001/tempDir-004/'
[junit4] 2> 295710 T2045 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solr.cloud.ReplicationFactorTest-CAD320064FE6F409-001/tempDir-004/solr.xml
[junit4] 2> 295716 T2045 oasc.CoreContainer.<init> New CoreContainer 1179038194
[junit4] 2> 295716 T2045 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=./solr.cloud.ReplicationFactorTest-CAD320064FE6F409-001/tempDir-004/]
[junit4] 2> 295716 T2045 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 295716 T2045 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to:
[junit4] 2> 295717 T2045 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 295717 T2045 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 295717 T2045 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 295717 T2045 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 295717 T2045 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 295718 T2045 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 295718 T2045 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 295718 T2045 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 295718 T2045 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 295719 T2045 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 295719 T2045 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:54759/solr
[junit4] 2> 295719 T2045 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 295720 T2045 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 295721 T2107 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@2362e717 name:ZooKeeperConnection Watcher:127.0.0.1:54759 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 295722 T2045 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 295723 T2045 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 295724 T2109 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@701b8a4a name:ZooKeeperConnection Watcher:127.0.0.1:54759/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 295724 T2045 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 295729 T2045 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 295753 T2090 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 295753 T2109 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 295753 T2077 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 295753 T2067 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 296732 T2045 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:53557_
[junit4] 2> 296733 T2045 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:53557_
[junit4] 2> 296734 T2090 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4] 2> 296734 T2077 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4] 2> 296734 T2067 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4] 2> 296734 T2109 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4] 2> 296737 T2110 oasc.ZkController.publish publishing core=collection1 state=down collection=collection1
[junit4] 2> 296737 T2110 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 296738 T2067 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 296738 T2067 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 296738 T2067 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 296738 T2110 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 296739 T2068 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 296739 T2068 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:53557",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:53557_",
[junit4] 2> "shard":null,
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"3",
[junit4] 2> "core_node_name":null}
[junit4] 2> 296740 T2068 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=3
[junit4] 2> 296740 T2068 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard3
[junit4] 2> 296741 T2067 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 296843 T2090 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 296843 T2109 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 296843 T2077 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 296843 T2067 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 297739 T2110 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
[junit4] 2> 297739 T2110 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4] 2> 297740 T2110 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 297740 T2110 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
[junit4] 2> 297740 T2110 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 297740 T2110 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './solr.cloud.ReplicationFactorTest-CAD320064FE6F409-001/tempDir-004/collection1/'
[junit4] 2> 297741 T2110 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/solr.cloud.ReplicationFactorTest-CAD320064FE6F409-001/tempDir-004/collection1/lib/.svn/' to classloader
[junit4] 2> 297741 T2110 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/solr.cloud.ReplicationFactorTest-CAD320064FE6F409-001/tempDir-004/collection1/lib/classes/' to classloader
[junit4] 2> 297741 T2110 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/solr.cloud.ReplicationFactorTest-CAD320064FE6F409-001/tempDir-004/collection1/lib/README' to classloader
[junit4] 2> 297765 T2110 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_4_10
[junit4] 2> 297776 T2110 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 297782 T2110 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 297788 T2110 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4] 2> 297889 T2110 oass.ByteField.init WARN ByteField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
[junit4] 2> 297889 T2110 oass.ShortField.init WARN ShortField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
[junit4] 2> 297890 T2110 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4] 2> 297893 T2110 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 297894 T2110 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 297902 T2110 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 297904 T2110 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 297905 T2110 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 297908 T2110 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 297908 T2110 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 297908 T2110 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 297909 T2110 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 297909 T2110 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 297909 T2110 oasc.CoreContainer.create Creating SolrCore 'collection1' using configuration from collection collection1
[junit4] 2> 297909 T2110 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 297910 T2110 oasc.SolrCore.<init> [collection1] Opening new SolrCore at ./solr.cloud.ReplicationFactorTest-CAD320064FE6F409-001/tempDir-004/collection1/, dataDir=./solr.cloud.ReplicationFactorTest-CAD320064FE6F409-001/tempDir-001/jetty2/
[junit4] 2> 297910 T2110 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@2914a6d0
[junit4] 2> 297911 T2110 oasc.CachingDirectoryFactory.get return new directory for ./solr.cloud.ReplicationFactorTest-CAD320064FE6F409-001/tempDir-001/jetty2
[junit4] 2> 297911 T2110 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./solr.cloud.ReplicationFactorTest-CAD320064FE6F409-001/tempDir-001/jetty2/index/
[junit4] 2> 297911 T2110 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './solr.cloud.ReplicationFactorTest-CAD320064FE6F409-001/tempDir-001/jetty2/index' doesn't exist. Creating new index...
[junit4] 2> 297911 T2110 oasc.CachingDirectoryFactory.get return new directory for ./solr.cloud.ReplicationFactorTest-CAD320064FE6F409-001/tempDir-001/jetty2/index
[junit4] 2> 297911 T2110 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=50, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.7627639309808609]
[junit4] 2> 297912 T2110 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@36c2d864 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@42da7d6d),segFN=segments_1,generation=1}
[junit4] 2> 297912 T2110 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 297914 T2110 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
[junit4] 2> 297914 T2110 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
[junit4] 2> 297914 T2110 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 297914 T2110 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
[junit4] 2> 297914 T2110 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 297914 T2110 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
[junit4] 2> 297915 T2110 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 297915 T2110 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 297915 T2110 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 297915 T2110 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4] 2> 297915 T2110 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4] 2> 297916 T2110 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4] 2> 297916 T2110 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4] 2> 297916 T2110 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4] 2> 297916 T2110 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4] 2> 297916 T2110 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
[junit4] 2> 297918 T2110 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 297919 T2110 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 297919 T2110 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 297919 T2110 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=15, maxMergeAtOnceExplicit=49, maxMergedSegmentMB=31.1396484375, floorSegmentMB=1.046875, forceMergeDeletesPctAllowed=1.7284291932442009, segmentsPerTier=47.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.5523492831752316
[junit4] 2> 297920 T2110 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@36c2d864 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@42da7d6d),segFN=segments_1,generation=1}
[junit4] 2> 297920 T2110 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 297920 T2110 oass.SolrIndexSearcher.<init> Opening Searcher@268ccad9[collection1] main
[junit4] 2> 297920 T2110 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
[junit4] 2> 297921 T2110 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 297921 T2110 oasr.ManagedResourceStorage.newStorageIO Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1
[junit4] 2> 297922 T2110 oasr.ManagedResourceStorage$ZooKeeperStorageIO.configure Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 297922 T2110 oasr.RestManager.init Initializing RestManager with initArgs: {}
[junit4] 2> 297922 T2110 oasr.ManagedResourceStorage.load Reading _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 297922 T2110 oasr.ManagedResourceStorage$ZooKeeperStorageIO.openInputStream No data found for znode /configs/conf1/_rest_managed.json
[junit4] 2> 297922 T2110 oasr.ManagedResourceStorage.load Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 297923 T2110 oasr.ManagedResource.notifyObserversDuringInit WARN No registered observers for /rest/managed
[junit4] 2> 297923 T2110 oasr.RestManager.init Initializing 0 registered ManagedResources
[junit4] 2> 297925 T2111 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@268ccad9[collection1] main{StandardDirectoryReader(segments_1:1:nrt)}
[junit4] 2> 297926 T2110 oasc.CoreContainer.registerCore registering core: collection1
[junit4] 2> 297926 T2114 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:53557 collection:collection1 shard:shard3
[junit4] 2> 297927 T2045 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1
[junit4] 2> 297927 T2114 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard3/election
[junit4] 2> 297927 T2045 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 297930 T2114 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard3
[junit4] 2> 297931 T2067 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 297931 T2067 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 297931 T2067 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 297931 T2114 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4] 2> 297931 T2114 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4] 2> 297932 T2068 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> ASYNC NEW_CORE C287 name=collection1 org.apache.solr.core.SolrCore@656a0d01 url=http://127.0.0.1:53557/collection1 node=127.0.0.1:53557_ C287_STATE=coll:collection1 core:collection1 props:{state=down, base_url=http://127.0.0.1:53557, core=collection1, node_name=127.0.0.1:53557_}
[junit4] 2> 297932 T2114 C287 P53557 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:53557/collection1/
[junit4] 2> 297932 T2114 C287 P53557 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4] 2> 297932 T2114 C287 P53557 oasc.SyncStrategy.syncToMe http://127.0.0.1:53557/collection1/ has no replicas
[junit4] 2> 297932 T2114 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:53557/collection1/ shard3
[junit4] 2> 297933 T2114 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard3
[junit4] 2> 297933 T2067 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 297937 T2067 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 297938 T2067 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 298040 T2067 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 298040 T2109 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 298040 T2090 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 298040 T2077 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 298088 T2114 oasc.ZkController.register We are http://127.0.0.1:53557/collection1/ and leader is http://127.0.0.1:53557/collection1/
[junit4] 2> 298088 T2114 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:53557
[junit4] 2> 298088 T2114 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4] 2> 298088 T2114 oasc.ZkController.publish publishing core=collection1 state=active collection=collection1
[junit4] 2> 298088 T2114 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 298090 T2067 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 298090 T2067 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 298090 T2067 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 298091 T2114 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 298091 T2068 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 298091 T2068 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"active",
[junit4] 2> "base_url":"http://127.0.0.1:53557",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:53557_",
[junit4] 2> "shard":"shard3",
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"3",
[junit4] 2> "core_node_name":"core_node2"}
[junit4] 2> 298093 T2067 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 298145 T2045 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 3
[junit4] 2> 298146 T2045 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 298147 T2045 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:41117
[junit4] 2> 298148 T2045 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 298148 T2045 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 298149 T2045 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ./solr.cloud.ReplicationFactorTest-CAD320064FE6F409-001/tempDir-005
[junit4] 2> 298149 T2045 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './solr.cloud.ReplicationFactorTest-CAD320064FE6F409-001/tempDir-005/'
[junit4] 2> 298162 T2045 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solr.cloud.ReplicationFactorTest-CAD320064FE6F409-001/tempDir-005/solr.xml
[junit4] 2> 298171 T2045 oasc.CoreContainer.<init> New CoreContainer 125503110
[junit4] 2> 298171 T2045 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=./solr.cloud.ReplicationFactorTest-CAD320064FE6F409-001/tempDir-005/]
[junit4] 2> 298171 T2045 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 298172 T2045 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to:
[junit4] 2> 298172 T2045 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 298172 T2045 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 298172 T2045 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 298173 T2045 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 298173 T2045 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 298173 T2045 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 298173 T2045 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 298174 T2045 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 298174 T2045 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 298174 T2045 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 298174 T2045 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:54759/solr
[junit4] 2> 298175 T2045 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 298175 T2045 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 298177 T2126 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@73a31f20 name:ZooKeeperConnection Watcher:127.0.0.1:54759 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 298177 T2045 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 298180 T2045 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 298181 T2128 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@4a863bea name:ZooKeeperConnection Watcher:127.0.0.1:54759/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 298181 T2045 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 298185 T2045 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 298198 T2090 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 298198 T2067 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 298198 T2128 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 298198 T2077 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 298198 T2109 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 299187 T2045 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:38646_
[junit4] 2> 299188 T2045 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:38646_
[junit4] 2> 299189 T2077 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4] 2> 299189 T2067 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4] 2> 299189 T2109 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4] 2> 299189 T2128 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4] 2> 299189 T2090 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4] 2> 299192 T2129 oasc.ZkController.publish publishing core=collection1 state=down collection=collection1
[junit4] 2> 299193 T2129 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 299193 T2067 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 299193 T2129 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 299193 T2067 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 299194 T2067 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 299194 T2068 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 299195 T2068 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:38646",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:38646_",
[junit4] 2> "shard":null,
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"3",
[junit4] 2> "core_node_name":null}
[junit4] 2> 299195 T2068 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=3
[junit4] 2> 299195 T2068 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4] 2> 299196 T2067 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 299298 T2128 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4] 2> 299298 T2067 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4] 2> 299298 T2077 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4] 2> 299298 T2109 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4] 2> 299298 T2090 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4] 2> 300194 T2129 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
[junit4] 2> 300194 T2129 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4] 2> 300194 T2129 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 300195 T2129 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
[junit4] 2> 300195 T2129 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 300195 T2129 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './solr.cloud.ReplicationFactorTest-CAD320064FE6F409-001/tempDir-005/collection1/'
[junit4] 2> 300196 T2129 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/solr.cloud.ReplicationFactorTest-CAD320064FE6F409-001/tempDir-005/collection1/lib/.svn/' to classloader
[junit4] 2> 300196 T2129 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/solr.cloud.ReplicationFactorTest-CAD320064FE6F409-001/tempDir-005/collection1/lib/classes/' to classloader
[junit4] 2> 300196 T2129 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/solr.cloud.ReplicationFactorTest-CAD320064FE6F409-001/tempDir-005/collection1/lib/README' to classloader
[junit4] 2> 300212 T2129 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_4_10
[junit4] 2> 300227 T2129 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 300227 T2129 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 300231 T2129 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4] 2> 300320 T2129 oass.ByteField.init WARN ByteField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
[junit4] 2> 300321 T2129 oass.ShortField.init WARN ShortField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
[junit4] 2> 300321 T2129 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4] 2> 300324 T2129 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 300326 T2129 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 300334 T2129 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 300336 T2129 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 300337 T2129 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 300338 T2129 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 300338 T2129 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 300338 T2129 oass.OpenExchangeR
[...truncated too long message...]
at java.lang.reflect.Method.invoke(Method.java:483)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1618)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:827)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:877)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
[junit4] 2> at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
[junit4] 2> at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
[junit4] 2> at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
[junit4] 2> at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
[junit4] 2> at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
[junit4] 2> at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
[junit4] 2> at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:798)
[junit4] 2> at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:458)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:836)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:738)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:772)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:783)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
[junit4] 2> at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
[junit4] 2> at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
[junit4] 2> at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
[junit4] 2> at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
[junit4] 2> at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
[junit4] 2> at java.lang.Thread.run(Thread.java:745)
[junit4] 2> 11) Thread[id=2127, name=TEST-ReplicationFactorTest.testDistribSearch-seed#[CAD320064FE6F409]-SendThread(127.0.0.1:54759), state=TIMED_WAITING, group=TGRP-ReplicationFactorTest]
[junit4] 2> at java.lang.Thread.sleep(Native Method)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:994)
[junit4] 2> 12) Thread[id=2116, name=HashSessionScavenger-62, state=TIMED_WAITING, group=TGRP-ReplicationFactorTest]
[junit4] 2> at java.lang.Object.wait(Native Method)
[junit4] 2> at java.util.TimerThread.mainLoop(Timer.java:552)
[junit4] 2> at java.util.TimerThread.run(Timer.java:505)
[junit4] 2> 13) Thread[id=2119, name=qtp1990202290-2119 Acceptor0 SelectChannelConnector@127.0.0.1:41117, state=RUNNABLE, group=TGRP-ReplicationFactorTest]
[junit4] 2> at org.eclipse.jetty.server.nio.SelectChannelConnector.accept(SelectChannelConnector.java:102)
[junit4] 2> at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938)
[junit4] 2> at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
[junit4] 2> at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
[junit4] 2> at java.lang.Thread.run(Thread.java:745)
[junit4] 2> 14) Thread[id=2076, name=TEST-ReplicationFactorTest.testDistribSearch-seed#[CAD320064FE6F409]-SendThread(127.0.0.1:54759), state=TIMED_WAITING, group=TGRP-ReplicationFactorTest]
[junit4] 2> at java.lang.Thread.sleep(Native Method)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:994)
[junit4] 2> NOTE: test params are: codec=Lucene40, sim=RandomSimilarityProvider(queryNorm=true,coord=crazy): {}, locale=es_HN, timezone=WET
[junit4] 2> NOTE: Linux 3.8.0-42-generic amd64/Oracle Corporation 1.8.0_05 (64-bit)/cpus=8,threads=18,free=75586536,total=222298112
[junit4] 2> NOTE: All tests run in this JVM: [TestStandardQParsers, ChaosMonkeyNothingIsSafeTest, DistributedSuggestComponentTest, TestNoOpRegenerator, TestLMDirichletSimilarityFactory, TestSolrQueryParserResource, TestRecovery, OutputWriterTest, TestSuggestSpellingConverter, TestSchemaNameResource, DOMUtilTest, TestLazyCores, TestFastWriter, TestZkChroot, TestAtomicUpdateErrorCases, DirectSolrConnectionTest, TestRandomFaceting, DistributedTermsComponentTest, TestPseudoReturnFields, TestPostingsSolrHighlighter, IndexSchemaRuntimeFieldTest, TestPhraseSuggestions, TestNonDefinedSimilarityFactory, TestBadConfig, PolyFieldTest, FullSolrCloudDistribCmdsTest, ZkSolrClientTest, SearchHandlerTest, TestReplicationHandlerBackup, TestSchemaResource, TestFieldTypeResource, UpdateRequestProcessorFactoryTest, StatsComponentTest, ShardRoutingCustomTest, DistributedQueryComponentCustomSortTest, LukeRequestHandlerTest, TestCollapseQParserPlugin, TestMiniSolrCloudCluster, TestHighlightDedupGrouping, CoreContainerCoreInitFailuresTest, TestWriterPerf, TestCoreContainer, TestStressLucene, SynonymTokenizerTest, SolrInfoMBeanTest, TestCloudManagedSchema, TestCollationField, SolrPluginUtilsTest, UniqFieldsUpdateProcessorFactoryTest, TestLRUCache, DebugComponentTest, URLClassifyProcessorTest, ReplicationFactorTest]
[junit4] 2> NOTE: reproduce with: ant test -Dtestcase=ReplicationFactorTest -Dtests.seed=CAD320064FE6F409 -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=es_HN -Dtests.timezone=WET -Dtests.file.encoding=ISO-8859-1
[junit4] ERROR 0.00s J1 | ReplicationFactorTest (suite) <<<
[junit4] > Throwable #1: java.lang.Exception: Suite timeout exceeded (>= 7200000 msec).
[junit4] > at __randomizedtesting.SeedInfo.seed([CAD320064FE6F409]:0)
[junit4] Completed on J1 in 7223.62s, 1 test, 2 errors <<< FAILURES!
[...truncated 147 lines...]
BUILD FAILED
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/build.xml:467: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/build.xml:447: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/build.xml:45: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/extra-targets.xml:37: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build.xml:189: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/common-build.xml:496: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/common-build.xml:1299: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/common-build.xml:923: There were test failures: 404 suites, 1654 tests, 1 suite-level error, 1 error, 173 ignored (15 assumptions)
Total time: 169 minutes 8 seconds
Build step 'Invoke Ant' marked build as failure
[description-setter] Description set: Java: 64bit/jdk1.8.0_05 -XX:+UseCompressedOops -XX:+UseParallelGC
Archiving artifacts
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any
[JENKINS] Lucene-Solr-4.x-Linux (64bit/jdk1.8.0_20-ea-b15) - Build
# 10580 - Still Failing!
Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: http://jenkins.thetaphi.de/job/Lucene-Solr-4.x-Linux/10580/
Java: 64bit/jdk1.8.0_20-ea-b15 -XX:+UseCompressedOops -XX:+UseSerialGC
1 tests failed.
REGRESSION: org.apache.solr.cloud.CollectionsAPIAsyncDistributedZkTest.testDistribSearch
Error Message:
Shard split did not complete. Last recorded state: running expected:<[completed]> but was:<[running]>
Stack Trace:
org.junit.ComparisonFailure: Shard split did not complete. Last recorded state: running expected:<[completed]> but was:<[running]>
at __randomizedtesting.SeedInfo.seed([96B88152F866DEEC:175E0F4A8F39BED0]:0)
at org.junit.Assert.assertEquals(Assert.java:125)
at org.apache.solr.cloud.CollectionsAPIAsyncDistributedZkTest.testSolrJAPICalls(CollectionsAPIAsyncDistributedZkTest.java:95)
at org.apache.solr.cloud.CollectionsAPIAsyncDistributedZkTest.doTest(CollectionsAPIAsyncDistributedZkTest.java:61)
at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:865)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:483)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1618)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:827)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:877)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:798)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:458)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:836)
at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:738)
at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:772)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:783)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
at java.lang.Thread.run(Thread.java:745)
Build Log:
[...truncated 11050 lines...]
[junit4] Suite: org.apache.solr.cloud.CollectionsAPIAsyncDistributedZkTest
[junit4] 2> 246103 T3 oasu.ConcurrentLRUCache.finalize ERROR ConcurrentLRUCache was not destroyed prior to finalize(), indicates a bug -- POSSIBLE RESOURCE LEAK!!!
[junit4] 2> Creating dataDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solr.cloud.CollectionsAPIAsyncDistributedZkTest-96B88152F866DEEC-001/init-core-data-001
[junit4] 2> 246118 T1055 oas.SolrTestCaseJ4.buildSSLConfig Randomized ssl (true) and clientAuth (true)
[junit4] 2> 246119 T1055 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /
[junit4] 2> 246126 T1055 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch
[junit4] 2> 246127 T1055 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4] 1> client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 246128 T1056 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
[junit4] 2> 246228 T1055 oasc.ZkTestServer.run start zk server on port:43273
[junit4] 2> 246228 T1055 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 246316 T1062 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@6ac279f1 name:ZooKeeperConnection Watcher:127.0.0.1:43273 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 246316 T1055 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 246316 T1055 oascc.SolrZkClient.makePath makePath: /solr
[junit4] 2> 246321 T1055 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 246323 T1064 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@5f05b472 name:ZooKeeperConnection Watcher:127.0.0.1:43273/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 246323 T1055 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 246323 T1055 oascc.SolrZkClient.makePath makePath: /collections/collection1
[junit4] 2> 246325 T1055 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
[junit4] 2> 246327 T1055 oascc.SolrZkClient.makePath makePath: /collections/control_collection
[junit4] 2> 246328 T1055 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
[junit4] 2> 246329 T1055 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
[junit4] 2> 246329 T1055 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
[junit4] 2> 246333 T1055 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/src/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
[junit4] 2> 246334 T1055 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
[junit4] 2> 246337 T1055 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 246338 T1055 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 246339 T1055 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/src/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4] 2> 246339 T1055 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
[junit4] 2> 246341 T1055 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/src/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4] 2> 246341 T1055 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
[junit4] 2> 246343 T1055 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/src/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4] 2> 246344 T1055 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
[junit4] 2> 246347 T1055 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf1/enumsConfig.xml
[junit4] 2> 246347 T1055 oascc.SolrZkClient.makePath makePath: /configs/conf1/enumsConfig.xml
[junit4] 2> 246350 T1055 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4] 2> 246350 T1055 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
[junit4] 2> 246354 T1055 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 246354 T1055 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 246356 T1055 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4] 2> 246357 T1055 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
[junit4] 2> 246360 T1055 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/src/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4] 2> 246361 T1055 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
[junit4] 2> 246368 T1055 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 246369 T1066 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1e466e0f name:ZooKeeperConnection Watcher:127.0.0.1:43273/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 246370 T1055 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 246603 T1055 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 246606 T1055 oejus.SslContextFactory.doStart Enabled Protocols [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2] of [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2]
[junit4] 2> 246617 T1055 oejs.AbstractConnector.doStart Started SslSelectChannelConnector@127.0.0.1:48111
[junit4] 2> 246619 T1055 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 246620 T1055 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 246620 T1055 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ./solr.cloud.CollectionsAPIAsyncDistributedZkTest-96B88152F866DEEC-001/tempDir-002
[junit4] 2> 246621 T1055 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './solr.cloud.CollectionsAPIAsyncDistributedZkTest-96B88152F866DEEC-001/tempDir-002/'
[junit4] 2> 246637 T1055 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solr.cloud.CollectionsAPIAsyncDistributedZkTest-96B88152F866DEEC-001/tempDir-002/solr.xml
[junit4] 2> 246646 T1055 oasc.CoreContainer.<init> New CoreContainer 1626610298
[junit4] 2> 246646 T1055 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=./solr.cloud.CollectionsAPIAsyncDistributedZkTest-96B88152F866DEEC-001/tempDir-002/]
[junit4] 2> 246647 T1055 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 246647 T1055 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to:
[junit4] 2> 246648 T1055 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 246648 T1055 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 246648 T1055 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 246649 T1055 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 246649 T1055 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 246649 T1055 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 246649 T1055 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 246652 T1055 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 246652 T1055 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 246653 T1055 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 246653 T1055 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:43273/solr
[junit4] 2> 246653 T1055 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 246654 T1055 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 246656 T1077 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@93a1d5c name:ZooKeeperConnection Watcher:127.0.0.1:43273 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 246657 T1055 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 246659 T1055 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 246663 T1079 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@3ff622e0 name:ZooKeeperConnection Watcher:127.0.0.1:43273/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 246663 T1055 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 246664 T1055 oascc.SolrZkClient.makePath makePath: /overseer/queue
[junit4] 2> 246666 T1055 oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work
[junit4] 2> 246668 T1055 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-running
[junit4] 2> 246670 T1055 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-completed
[junit4] 2> 246678 T1055 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-failure
[junit4] 2> 246681 T1055 oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4] 2> 246682 T1055 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:48111_
[junit4] 2> 246683 T1055 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:48111_
[junit4] 2> 246687 T1055 oascc.SolrZkClient.makePath makePath: /overseer_elect
[junit4] 2> 246688 T1055 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4] 2> 246690 T1055 oasc.OverseerElectionContext.runLeaderProcess I am going to be the leader 127.0.0.1:48111_
[junit4] 2> 246691 T1055 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4] 2> 246692 T1055 oasc.Overseer.start Overseer (id=92031202152153092-127.0.0.1:48111_-n_0000000000) starting
[junit4] 2> 246695 T1055 oascc.SolrZkClient.makePath makePath: /overseer/queue-work
[junit4] 2> 246701 T1081 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4] 2> 246701 T1055 oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4] 2> 246705 T1055 oascc.SolrZkClient.makePath makePath: /aliases.json
[junit4] 2> 246706 T1055 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 246707 T1080 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4] 2> 246711 T1082 oasc.ZkController.publish publishing core=collection1 state=down collection=control_collection
[junit4] 2> 246711 T1082 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 246712 T1079 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 246712 T1082 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 246713 T1080 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 246713 T1080 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"https://127.0.0.1:48111",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:48111_",
[junit4] 2> "shard":null,
[junit4] 2> "collection":"control_collection",
[junit4] 2> "numShards":"1",
[junit4] 2> "core_node_name":null}
[junit4] 2> 246713 T1080 oasc.Overseer$ClusterStateUpdater.createCollection Create collection control_collection with shards [shard1]
[junit4] 2> 246713 T1080 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4] 2> 246715 T1079 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 246715 T1079 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 247712 T1082 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
[junit4] 2> 247713 T1082 oasc.ZkController.createCollectionZkNode Check for collection zkNode:control_collection
[junit4] 2> 247713 T1082 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 247714 T1082 oascc.ZkStateReader.readConfigName Load collection config from:/collections/control_collection
[junit4] 2> 247714 T1082 oascc.ZkStateReader.readConfigName path=/collections/control_collection configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 247714 T1082 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './solr.cloud.CollectionsAPIAsyncDistributedZkTest-96B88152F866DEEC-001/tempDir-002/collection1/'
[junit4] 2> 247715 T1082 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/solr.cloud.CollectionsAPIAsyncDistributedZkTest-96B88152F866DEEC-001/tempDir-002/collection1/lib/.svn/' to classloader
[junit4] 2> 247715 T1082 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/solr.cloud.CollectionsAPIAsyncDistributedZkTest-96B88152F866DEEC-001/tempDir-002/collection1/lib/classes/' to classloader
[junit4] 2> 247715 T1082 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/solr.cloud.CollectionsAPIAsyncDistributedZkTest-96B88152F866DEEC-001/tempDir-002/collection1/lib/README' to classloader
[junit4] 2> 247741 T1082 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_4_10
[junit4] 2> 247748 T1082 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 247749 T1082 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 247753 T1082 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4] 2> 247840 T1082 oass.ByteField.init WARN ByteField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
[junit4] 2> 247841 T1082 oass.ShortField.init WARN ShortField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
[junit4] 2> 247841 T1082 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4] 2> 247844 T1082 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 247845 T1082 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 247851 T1082 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 247853 T1082 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 247854 T1082 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 247855 T1082 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 247855 T1082 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 247855 T1082 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 247856 T1082 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 247856 T1082 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 247856 T1082 oasc.CoreContainer.create Creating SolrCore 'collection1' using configuration from collection control_collection
[junit4] 2> 247856 T1082 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 247857 T1082 oasc.SolrCore.<init> [collection1] Opening new SolrCore at ./solr.cloud.CollectionsAPIAsyncDistributedZkTest-96B88152F866DEEC-001/tempDir-002/collection1/, dataDir=./solr.cloud.CollectionsAPIAsyncDistributedZkTest-96B88152F866DEEC-001/tempDir-001/control/data/
[junit4] 2> 247857 T1082 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@32e9ad41
[junit4] 2> 247857 T1082 oasc.CachingDirectoryFactory.get return new directory for ./solr.cloud.CollectionsAPIAsyncDistributedZkTest-96B88152F866DEEC-001/tempDir-001/control/data
[junit4] 2> 247857 T1082 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./solr.cloud.CollectionsAPIAsyncDistributedZkTest-96B88152F866DEEC-001/tempDir-001/control/data/index/
[junit4] 2> 247857 T1082 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './solr.cloud.CollectionsAPIAsyncDistributedZkTest-96B88152F866DEEC-001/tempDir-001/control/data/index' doesn't exist. Creating new index...
[junit4] 2> 247858 T1082 oasc.CachingDirectoryFactory.get return new directory for ./solr.cloud.CollectionsAPIAsyncDistributedZkTest-96B88152F866DEEC-001/tempDir-001/control/data/index
[junit4] 2> 247858 T1082 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=6, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0]
[junit4] 2> 247858 T1082 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@34e81957 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@1354d403),segFN=segments_1,generation=1}
[junit4] 2> 247859 T1082 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 247860 T1082 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
[junit4] 2> 247861 T1082 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
[junit4] 2> 247861 T1082 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 247861 T1082 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
[junit4] 2> 247861 T1082 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 247861 T1082 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
[junit4] 2> 247862 T1082 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 247862 T1082 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 247862 T1082 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 247862 T1082 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4] 2> 247862 T1082 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4] 2> 247862 T1082 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4] 2> 247863 T1082 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4] 2> 247863 T1082 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4] 2> 247863 T1082 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4] 2> 247863 T1082 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
[junit4] 2> 247865 T1082 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 247866 T1082 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 247866 T1082 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 247866 T1082 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=49, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0]
[junit4] 2> 247867 T1082 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@34e81957 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@1354d403),segFN=segments_1,generation=1}
[junit4] 2> 247867 T1082 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 247867 T1082 oass.SolrIndexSearcher.<init> Opening Searcher@57c57ed3[collection1] main
[junit4] 2> 247867 T1082 oascc.ZkStateReader.readConfigName Load collection config from:/collections/control_collection
[junit4] 2> 247868 T1082 oascc.ZkStateReader.readConfigName path=/collections/control_collection configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 247868 T1082 oasr.ManagedResourceStorage.newStorageIO Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1
[junit4] 2> 247868 T1082 oasr.ManagedResourceStorage$ZooKeeperStorageIO.configure Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 247869 T1082 oasr.RestManager.init Initializing RestManager with initArgs: {}
[junit4] 2> 247869 T1082 oasr.ManagedResourceStorage.load Reading _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 247869 T1082 oasr.ManagedResourceStorage$ZooKeeperStorageIO.openInputStream No data found for znode /configs/conf1/_rest_managed.json
[junit4] 2> 247869 T1082 oasr.ManagedResourceStorage.load Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 247869 T1082 oasr.ManagedResource.notifyObserversDuringInit WARN No registered observers for /rest/managed
[junit4] 2> 247869 T1082 oasr.RestManager.init Initializing 0 registered ManagedResources
[junit4] 2> 247871 T1083 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@57c57ed3[collection1] main{StandardDirectoryReader(segments_1:1:nrt)}
[junit4] 2> 247871 T1082 oasc.CoreContainer.registerCore registering core: collection1
[junit4] 2> 247872 T1086 oasc.ZkController.register Register replica - core:collection1 address:https://127.0.0.1:48111 collection:control_collection shard:shard1
[junit4] 2> 247872 T1055 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1
[junit4] 2> 247873 T1055 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 247874 T1055 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 247875 T1086 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leader_elect/shard1/election
[junit4] 2> 247876 T1088 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@8e2bc53 name:ZooKeeperConnection Watcher:127.0.0.1:43273/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 247876 T1055 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 247877 T1055 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 247879 T1055 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:false cause connection loss:false
[junit4] 2> 247880 T1086 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard1
[junit4] 2> 247882 T1079 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 247882 T1086 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4] 2> 247882 T1086 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4] 2> ASYNC NEW_CORE C231 name=collection1 org.apache.solr.core.SolrCore@2b07b2fa url=https://127.0.0.1:48111/collection1 node=127.0.0.1:48111_ C231_STATE=coll:control_collection core:collection1 props:{state=down, base_url=https://127.0.0.1:48111, core=collection1, node_name=127.0.0.1:48111_}
[junit4] 2> 247882 T1086 C231 P48111 oasc.SyncStrategy.sync Sync replicas to https://127.0.0.1:48111/collection1/
[junit4] 2> 247882 T1080 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 247882 T1086 C231 P48111 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4] 2> 247883 T1086 C231 P48111 oasc.SyncStrategy.syncToMe https://127.0.0.1:48111/collection1/ has no replicas
[junit4] 2> 247883 T1086 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: https://127.0.0.1:48111/collection1/ shard1
[junit4] 2> 247883 T1086 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leaders/shard1
[junit4] 2> 247884 T1079 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 247886 T1079 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 247887 T1079 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 247990 T1088 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 247990 T1079 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 248037 T1086 oasc.ZkController.register We are https://127.0.0.1:48111/collection1/ and leader is https://127.0.0.1:48111/collection1/
[junit4] 2> 248037 T1086 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=https://127.0.0.1:48111
[junit4] 2> 248037 T1086 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4] 2> 248037 T1086 oasc.ZkController.publish publishing core=collection1 state=active collection=control_collection
[junit4] 2> 248037 T1086 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 248038 T1079 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 248038 T1079 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 248038 T1079 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 248038 T1086 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 248039 T1080 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 248040 T1080 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"active",
[junit4] 2> "base_url":"https://127.0.0.1:48111",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:48111_",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"control_collection",
[junit4] 2> "numShards":"2",
[junit4] 2> "core_node_name":"core_node1"}
[junit4] 2> 248041 T1079 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 248126 T1055 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 1
[junit4] 2> 248127 T1055 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 248130 T1055 oejus.SslContextFactory.doStart Enabled Protocols [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2] of [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2]
[junit4] 2> 248131 T1055 oejs.AbstractConnector.doStart Started SslSelectChannelConnector@127.0.0.1:38209
[junit4] 2> 248133 T1055 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 248134 T1055 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 248134 T1055 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ./solr.cloud.CollectionsAPIAsyncDistributedZkTest-96B88152F866DEEC-001/tempDir-003
[junit4] 2> 248134 T1055 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './solr.cloud.CollectionsAPIAsyncDistributedZkTest-96B88152F866DEEC-001/tempDir-003/'
[junit4] 2> 248143 T1079 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 248143 T1088 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 248149 T1055 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solr.cloud.CollectionsAPIAsyncDistributedZkTest-96B88152F866DEEC-001/tempDir-003/solr.xml
[junit4] 2> 248165 T1055 oasc.CoreContainer.<init> New CoreContainer 1177797920
[junit4] 2> 248165 T1055 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=./solr.cloud.CollectionsAPIAsyncDistributedZkTest-96B88152F866DEEC-001/tempDir-003/]
[junit4] 2> 248166 T1055 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 248166 T1055 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to:
[junit4] 2> 248166 T1055 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 248166 T1055 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 248166 T1055 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 248167 T1055 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 248167 T1055 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 248167 T1055 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 248167 T1055 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 248169 T1055 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 248169 T1055 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 248169 T1055 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 248170 T1055 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:43273/solr
[junit4] 2> 248170 T1055 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 248170 T1055 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 248172 T1099 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@640d4fc name:ZooKeeperConnection Watcher:127.0.0.1:43273 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 248172 T1055 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 248174 T1055 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 248175 T1101 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@5a5d98ef name:ZooKeeperConnection Watcher:127.0.0.1:43273/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 248175 T1055 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 248184 T1055 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 249189 T1055 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:38209_
[junit4] 2> 249191 T1055 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:38209_
[junit4] 2> 249194 T1079 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4] 2> 249194 T1101 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4] 2> 249194 T1088 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4] 2> 249200 T1102 oasc.ZkController.publish publishing core=collection1 state=down collection=collection1
[junit4] 2> 249200 T1102 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 249201 T1079 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 249201 T1102 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 249201 T1079 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 249202 T1079 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 249203 T1080 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 249204 T1080 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"https://127.0.0.1:38209",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:38209_",
[junit4] 2> "shard":null,
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"2",
[junit4] 2> "core_node_name":null}
[junit4] 2> 249204 T1080 oasc.Overseer$ClusterStateUpdater.createCollection Create collection collection1 with shards [shard1, shard2]
[junit4] 2> 249205 T1080 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard2
[junit4] 2> 249208 T1079 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 249311 T1079 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 249311 T1088 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 249311 T1101 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 250202 T1102 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
[junit4] 2> 250202 T1102 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4] 2> 250203 T1102 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 250203 T1102 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
[junit4] 2> 250204 T1102 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 250204 T1102 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './solr.cloud.CollectionsAPIAsyncDistributedZkTest-96B88152F866DEEC-001/tempDir-003/collection1/'
[junit4] 2> 250205 T1102 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/solr.cloud.CollectionsAPIAsyncDistributedZkTest-96B88152F866DEEC-001/tempDir-003/collection1/lib/.svn/' to classloader
[junit4] 2> 250205 T1102 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/solr.cloud.CollectionsAPIAsyncDistributedZkTest-96B88152F866DEEC-001/tempDir-003/collection1/lib/classes/' to classloader
[junit4] 2> 250205 T1102 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/solr.cloud.CollectionsAPIAsyncDistributedZkTest-96B88152F866DEEC-001/tempDir-003/collection1/lib/README' to classloader
[junit4] 2> 250231 T1102 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_4_10
[junit4] 2> 250238 T1102 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 250239 T1102 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 250243 T1102 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4] 2> 250343 T1102 oass.ByteField.init WARN ByteField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
[junit4] 2> 250343 T1102 oass.ShortField.init WARN ShortField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
[junit4] 2> 250344 T1102 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4] 2> 250347 T1102 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 250348 T1102 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 250354 T1102 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 250356 T1102 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 250357 T1102 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 250358 T1102 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 250358 T1102 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 250358 T1102 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 250359 T1102 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 250359 T1102 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 250359 T1102 oasc.CoreContainer.create Creating SolrCore 'collection1' using configuration from collection collection1
[junit4] 2> 250359 T1102 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 250359 T1102 oasc.SolrCore.<init> [collection1] Opening new SolrCore at ./solr.cloud.CollectionsAPIAsyncDistributedZkTest-96B88152F866DEEC-001/tempDir-003/collection1/, dataDir=./solr.cloud.CollectionsAPIAsyncDistributedZkTest-96B88152F866DEEC-001/tempDir-003/collection1/data/
[junit4] 2> 250359 T1102 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@32e9ad41
[junit4] 2> 250360 T1102 oasc.CachingDirectoryFactory.get return new directory for ./solr.cloud.CollectionsAPIAsyncDistributedZkTest-96B88152F866DEEC-001/tempDir-003/collection1/data
[junit4] 2> 250360 T1102 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./solr.cloud.CollectionsAPIAsyncDistributedZkTest-96B88152F866DEEC-001/tempDir-003/collection1/data/index/
[junit4] 2> 250360 T1102 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './solr.cloud.CollectionsAPIAsyncDistributedZkTest-96B88152F866DEEC-001/tempDir-003/collection1/data/index' doesn't exist. Creating new index...
[junit4] 2> 250360 T1102 oasc.CachingDirectoryFactory.get return new directory for ./solr.cloud.CollectionsAPIAsyncDistributedZkTest-96B88152F866DEEC-001/tempDir-003/collection1/data/index
[junit4] 2> 250361 T1102 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=6, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0]
[junit4] 2> 250361 T1102 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@7e5058f4 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@4410d4ee),segFN=segments_1,generation=1}
[junit4] 2> 250361 T1102 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 250363 T1102 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
[junit4] 2> 250364 T1102 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
[junit4] 2> 250364 T1102 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 250364 T1102 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
[junit4] 2> 250364 T1102 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 250364 T1102 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
[junit4] 2> 250365 T1102 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 250365 T1102 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 250365 T1102 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 250365 T1102 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4] 2> 250365 T1102 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4] 2> 250366 T1102 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4] 2> 250366 T1102 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4] 2> 250366 T1102 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4] 2> 250366 T1102 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4] 2> 250367 T1102 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
[junit4] 2> 250368 T1102 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 250369 T1102 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 250369 T1102 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 250370 T1102 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=49, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0]
[junit4] 2> 250370 T1102 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@7e5058f4 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@4410d4ee),segFN=segments_1,generation=1}
[junit4] 2> 250370 T1102 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 250370 T1102 oass.SolrIndexSearcher.<init> Opening Searcher@6499a5b1[collection1] main
[junit4] 2> 250371 T1102 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
[junit4] 2> 250371 T1102 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 250371 T1102 oasr.ManagedResourceStorage.newStorageIO Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1
[junit4] 2> 250372 T1102 oasr.ManagedResourceStorage$ZooKeeperStorageIO.configure Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 250372 T1102 oasr.RestManager.init Initializing RestManager with initArgs: {}
[junit4] 2> 250372 T1102 oasr.ManagedResourceStorage.load Reading _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 250372 T1102 oasr.ManagedResourceStorage$ZooKeeperStorageIO.openInputStream No data found for znode /configs/conf1/_rest_managed.json
[junit4] 2> 250373 T1102 oasr.ManagedResourceStorage.load Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 250373 T1102 oasr.ManagedResource.notifyObserversDuringInit WARN No registered observers for /rest/managed
[junit4] 2> 250373 T1102 oasr.RestManager.init Initializing 0 registered ManagedResources
[junit4] 2> 250374 T1103 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@6499a5b1[collection1] main{StandardDirectoryReader(segments_1:1:nrt)}
[junit4] 2> 250375 T1102 oasc.CoreContainer.registerCore registering core: collection1
[junit4] 2> 250384 T1106 oasc.ZkController.register Register replica - core:collection1 address:https://127.0.0.1:38209 collection:collection1 shard:shard2
[junit4] 2> 250384 T1055 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1
[junit4] 2> 250384 T1055 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 250385 T1106 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard2/election
[junit4] 2> 250388 T1106 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard2
[junit4] 2> 250389 T1079 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 250389 T1079 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 250389 T1079 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 250389 T1106 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4] 2> 250390 T1106 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4] 2> 250390 T1080 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> ASYNC NEW_CORE C232 name=collection1 org.apache.solr.core.SolrCore@38552542 url=https://127.0.0.1:38209/collection1 node=127.0.0.1:38209_ C232_STATE=coll:collection1 core:collection1 props:{state=down, base_url=https://127.0.0.1:38209, core=collection1, node_name=127.0.0.1:38209_}
[junit4] 2> 250390 T1106 C232 P38209 oasc.SyncStrategy.sync Sync replicas to https://127.0.0.1:38209/collection1/
[junit4] 2> 250390 T1106 C232 P38209 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4] 2> 250390 T1106 C232 P38209 oasc.SyncStrategy.syncToMe https://127.0.0.1:38209/collection1/ has no replicas
[junit4] 2> 250390 T1106 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: https://127.0.0.1:38209/collection1/ shard2
[junit4] 2> 250391 T1106 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard2
[junit4] 2> 250391 T1079 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 250394 T1079 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 250396 T1079 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 250499 T1079 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 250499 T1088 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 250499 T1101 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 250545 T1106 oasc.ZkController.register We are https://127.0.0.1:38209/collection1/ and leader is https://127.0.0.1:38209/collection1/
[junit4] 2> 250545 T1106 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=https://127.0.0.1:38209
[junit4] 2> 250546 T1106 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4] 2> 250546 T1106 oasc.ZkController.publish publishing core=collection1 state=active collection=collection1
[junit4] 2> 250546 T1106 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 250547 T1079 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 250548 T1079 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 250548 T1079 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 250548 T1106 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 250549 T1080 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 250549 T1080 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"active",
[junit4] 2> "base_url":"https://127.0.0.1:38209",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:38209_",
[junit4] 2> "shard":"shard2",
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"2",
[junit4] 2> "core_node_name":"core_node1"}
[junit4] 2> 250551 T1079 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 250652 T1088 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 250652 T1079 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 250652 T1101 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 250687 T1055 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 2
[junit4] 2> 250688 T1055 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 250691 T1055 oejus.SslContextFactory.doStart Enabled Protocols [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2] of [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2]
[junit4] 2> 250692 T1055 oejs.AbstractConnector.doStart Started SslSelectChannelConnector@127.0.0.1:58398
[junit4] 2> 250693 T1055 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 250693 T1055 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 250693 T1055 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ./solr.cloud.CollectionsAPIAsyncDistributedZkTest-96B88152F866DEEC-001/tempDir-004
[junit4] 2> 250694 T1055 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './solr.cloud.CollectionsAPIAsyncDistributedZkTest-96B88152F866DEEC-001/tempDir-004/'
[junit4] 2> 250706 T1055 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solr.cloud.CollectionsAPIAsyncDistributedZkTest-96B88152F866DEEC-001/tempDir-004/solr.xml
[junit4] 2> 250716 T1055 oasc.CoreContainer.<init> New CoreContainer 1407761054
[junit4] 2> 250716 T1055 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=./solr.cloud.CollectionsAPIAsyncDistributedZkTest-96B88152F866DEEC-001/tempDir-004/]
[junit4] 2> 250717 T1055 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 250717 T1055 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to:
[junit4] 2> 250717 T1055 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 250718 T1055 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 250718 T1055 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 250718 T1055 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 250719 T1055 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 250719 T1055 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 250719 T1055 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 250722 T1055 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 250722 T1055 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 250723 T1055 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 250723 T1055 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:43273/solr
[junit4] 2> 250724 T1055 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 250724 T1055 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 250726 T1117 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1c4da23a name:ZooKeeperConnection Watcher:127.0.0.1:43273 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 250727 T1055 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 250728 T1055 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 250730 T1119 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@2662751 name:ZooKeeperConnection Watcher:127.0.0.1:43273/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 250731 T1055 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 250745 T1055 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 251747 T1055 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:58398_
[junit4] 2> 251748 T1055 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:58398_
[junit4] 2> 251750 T1088 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4] 2> 251750 T1101 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4] 2> 251751 T1119 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4] 2> 251751 T1079 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4] 2> 251756 T1120 oasc.ZkController.publish publishing core=collection1 state=down collection=collection1
[junit4] 2> 251756 T1120 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 251758 T1079 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 251758 T1120 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 251758 T1079 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 251758 T1079 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 251759 T1080 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 251759 T1080 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"https://127.0.0.1:58398",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:58398_",
[junit4] 2> "shard":null,
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"2",
[junit4] 2> "core_node_name":null}
[junit4] 2> 251760 T1080 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
[junit4] 2> 251760 T1080 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4] 2> 251765 T1079 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 251865 T1101 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 251865 T1079 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 251865 T1088 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 251865 T1119 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 252758 T1120 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
[junit4] 2> 252758 T1120 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4] 2> 252759 T1120 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 252759 T1120 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
[junit4] 2> 252760 T1120 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 252760 T1120 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './solr.cloud.CollectionsAPIAsyncDistributedZkTest-96B88152F866DEEC-001/tempDir-004/collection1/'
[junit4] 2> 252761 T1120 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/solr.cloud.CollectionsAPIAsyncDistributedZkTest-96B88152F866DEEC-001/tempDir-004/collection1/lib/.svn/' to classloader
[junit4] 2> 252761 T1120 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/solr.cloud.CollectionsAPIAsyncDistributedZkTest-96B88152F866DEEC-001/tempDir-004/collection1/lib/classes/' to classloader
[junit4] 2> 252761 T1120 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/solr.cloud.CollectionsAPIAsyncDistributedZkTest-96B88152F866DEEC-001/tempDir-004/collection1/lib/README' to classloader
[junit4] 2> 252785 T1120 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_4_10
[junit4] 2> 252809 T1120 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 252810 T1120 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 252814 T1120 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4] 2> 252913 T1120 oass.ByteField.init WARN ByteField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
[junit4] 2> 252914 T1120 oass.ShortField.init WARN ShortField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
[junit4] 2> 252914 T1120 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4] 2> 252917 T1120 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 252919 T1120 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 252926 T1120 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 252929 T1120 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 252930 T1120 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 252931 T1120 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 252931 T1120 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 252932 T1120 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 252932 T1120 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 252933 T1120 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 252933 T1120 oasc.CoreContainer.create Creating SolrCore 'collection1' using configuration from collection collection1
[junit4] 2> 252933 T1120 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 252933 T1120 oasc.SolrCore.<init> [collection1] Opening new SolrCore at ./solr.cloud.CollectionsAPIAsyncDistributedZkTest-96B88152F866DEEC-001/tempDir-004/collection1/, dataDir=./solr.cloud.CollectionsAPIAsyncDistributedZkTest-96B88152F866DEEC-001/tempDir-004/collection1/data/
[junit4] 2> 252934 T1120 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@32e9ad41
[junit4] 2> 252934 T1120 oasc.CachingDirectoryFactory.get return new directory for ./solr.cloud.CollectionsAPIAsyncDistributedZkTest-96B88152F866DEEC-001/tempDir-004/collection1/data
[junit4] 2> 252934 T1120 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./solr.cloud.CollectionsAPIAsyncDistributedZkTest-96B88152F866DEEC-001/tempDir-004/collection1/data/index/
[junit4] 2> 252934 T1120 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './solr.cloud.CollectionsAPIAsyncDistributedZkTest-96B88152F866DEEC-001/tempDir-004/collection1/data/index' doesn't exist. Creating new index...
[junit4] 2> 252935 T1120 oasc.CachingDirectoryFactory.get return new directory for ./solr.cloud.CollectionsAPIAsyncDistributedZkTest-96B88152F866DEEC-001/tempDir-004/collection1/data/index
[junit4] 2> 252935 T1120 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=6, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0]
[junit4] 2> 252936 T1120 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@ca09f96 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@7342dc79),segFN=segments_1,generation=1}
[junit4] 2> 252936 T1120 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 252938 T1120 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
[junit4] 2> 252938 T1120 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
[junit4] 2> 252939 T1120 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 252939 T1120 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
[junit4] 2> 252939 T1120 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 252939 T1120 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
[junit4] 2> 252940 T1120 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 252940 T1120 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 252940 T1120 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 252940 T1120 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4] 2> 252941 T1120 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4] 2> 252941 T1120 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4] 2> 252941 T1120 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4] 2> 252942 T1120 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4] 2> 252942 T1120 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4] 2> 252942 T1120 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
[junit4] 2> 252944 T1120 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 252946 T1120 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 252946 T1120 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 252946 T1120 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=49, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0]
[junit4] 2> 252947 T1120 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@ca09f96 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@7342dc79),segFN=segments_1,generation=1}
[junit4] 2> 252947 T1120 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 252947 T1120 oass.SolrIndexSearcher.<init> Opening Searcher@1a803bba[collection1] main
[junit4] 2> 252948 T1120 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
[junit4] 2> 252952 T1120 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 252952 T1120 oasr.ManagedResourceStorage.newStorageIO Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1
[junit4] 2> 252953 T1120 oasr.ManagedResourceStorage$ZooKeeperStorageIO.configure Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 252953 T1120 oasr.RestManager.init Initializing RestManager with initArgs: {}
[junit4] 2> 252953 T1120 oasr.ManagedResourceStorage.load Reading _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 252954 T1120 oasr.ManagedResourceStorage$ZooKeeperStorageIO.openInputStream No data found for znode /configs/conf1/_rest_managed.json
[junit4] 2> 252954 T1120 oasr.ManagedResourceStorage.load Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 252954 T1120 oasr.ManagedResource.notifyObserversDuringInit WARN No registered observers for /rest/managed
[junit4] 2> 252954 T1120 oasr.RestManager.init Initializing 0 registered ManagedResources
[junit4] 2> 252957 T1121 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@1a803bba[collection1] main{StandardDirectoryReader(segments_1:1:nrt)}
[junit4] 2> 252958 T1120 oasc.CoreContainer.registerCore registering core: collection1
[junit4] 2> 252959 T1124 oasc.ZkController.register Register replica - core:collection1 address:https://127.0.0.1:58398 collection:collection1 shard:shard1
[junit4] 2> 252959 T1055 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1
[junit4] 2> 252960 T1124 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4] 2> 252960 T1055 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 252963 T1124 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard1
[junit4] 2> 252964 T1079 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 252964 T1079 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 252965 T1079 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 252965 T1124 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4] 2> 252965 T1124 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4] 2> 252965 T1080 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> ASYNC NEW_CORE C233 name=collection1 org.apache.solr.core.SolrCore@a9b0bda url=https://127.0.0.1:58398/collection1 node=127.0.0.1:58398_ C233_STATE=coll:collection1 core:collection1 props:{state=down, base_url=https://127.0.0.1:58398, core=collection1, node_name=127.0.0.1:58398_}
[junit4] 2> 252966 T1124 C233 P58398 oasc.SyncStrategy.sync Sync replicas to https://127.0.0.1:58398/collection1/
[junit4] 2> 252966 T1124 C233 P58398 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4] 2> 252966 T1124 C233 P58398 oasc.SyncStrategy.syncToMe https://127.0.0.1:58398/collection1/ has no replicas
[junit4] 2> 252966 T1124 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: https://127.0.0.1:58398/collection1/ shard1
[junit4] 2> 252966 T1124 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4] 2> 252968 T1079 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 252971 T1079 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 252973 T1079 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 253075 T1101 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 253075 T1119 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 253075 T1088 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 253075 T1079 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 253122 T1124 oasc.ZkController.register We are https://127.0.0.1:58398/collection1/ and leader is https://127.0.0.1:58398/collection1/
[junit4] 2> 253122 T1124 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=https://127.0.0.1:58398
[junit4] 2> 253122 T1124 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4] 2> 253122 T1124 oasc.ZkController.publish publishing core=collection1 state=active collection=collection1
[junit4] 2> 253122 T1124 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 253123 T1079 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 253123 T1079 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 253123 T1124 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 253123 T1079 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 253124 T1080 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 253125 T1080 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"active",
[junit4] 2> "base_url":"https://127.0.0.1:58398",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:58398_",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"2",
[junit4] 2> "core_node_name":"core_node2"}
[junit4] 2> 253126 T1079 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 253190 T1055 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 3
[junit4] 2> 253191 T1055 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 253193 T1055 oejus.SslContextFactory.doStart Enabled Protocols [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2] of [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2]
[junit4] 2> 253194 T1055 oejs.AbstractConnector.doStart Started SslSelectChannelConnector@127.0.0.1:37261
[junit4] 2> 253196 T1055 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 253196 T1055 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 253196 T1055 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solr.cloud.CollectionsAPIAsyncDistributedZkTest-96B88152F866DEEC-001/tempDir-005
[junit4] 2> 253197 T1055 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solr.cloud.CollectionsAPIAsyncDistributedZkTest-96B88152F866DEEC-001/tempDir-005/'
[junit4] 2> 253207 T1055 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solr.cloud.CollectionsAPIAsyncDistributedZkTest-96B88152F866DEEC-001/tempDir-005/solr.xml
[junit4] 2> 253214 T1055 oasc.CoreContainer.<init> New CoreContainer 1712148381
[junit4] 2> 253214 T1055 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solr.cloud.CollectionsAPIAsyncDistributedZkTest-96B88152F866DEEC-001/tempDir-005/]
[junit4] 2> 253214 T1055 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 253215 T1055 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to:
[junit4] 2> 253215 T1055 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 253215 T1055 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 253215 T1055 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 253215 T1055 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 253216 T1055 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 253216 T1055 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 253216 T1055 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 253218 T1055 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 253218 T1055 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 253218 T1055 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 253218 T1055 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:43273/solr
[junit4] 2> 253219 T1055 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 253219 T1055 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 253221 T1135 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@4c65ae9c name:ZooKeeperConnection Watcher:127.0.0.1:43273 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 253222 T1055 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 253223 T1055 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 253225 T1137 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@424c0b3f name:ZooKeeperConnection Watcher:127.0.0.1:43273/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 253225 T1055 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 253231 T1101 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 253231 T1119 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 253231 T1088 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 253231 T1079 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 253234 T1055 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 254235 T1055 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:37261_
[junit4] 2> 254236 T1055 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:37261_
[junit4] 2> 254238 T1101 oascc.ZkStateReader$3.process Updating live nodes... (4)
[juni
[...truncated too long message...]
as the leader:org.apache.solr.common.SolrException: Could not register as the leader because creating the ephemeral registration node in ZooKeeper failed
[junit4] 2> at org.apache.solr.cloud.ShardLeaderElectionContextBase.runLeaderProcess(ElectionContext.java:143)
[junit4] 2> at org.apache.solr.cloud.ShardLeaderElectionContext.runLeaderProcess(ElectionContext.java:298)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.runIamLeaderProcess(LeaderElector.java:163)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:125)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.access$200(LeaderElector.java:55)
[junit4] 2> at org.apache.solr.cloud.LeaderElector$ElectionWatcher.process(LeaderElector.java:358)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:522)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:498)
[junit4] 2> Caused by: org.apache.solr.common.SolrException: org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /collections
[junit4] 2> at org.apache.solr.common.util.RetryUtil.retryOnThrowable(RetryUtil.java:40)
[junit4] 2> at org.apache.solr.cloud.ShardLeaderElectionContextBase.runLeaderProcess(ElectionContext.java:130)
[junit4] 2> ... 7 more
[junit4] 2> Caused by: org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /collections
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4] 2> at org.apache.zookeeper.ZooKeeper.exists(ZooKeeper.java:1045)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$3.execute(SolrZkClient.java:209)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$3.execute(SolrZkClient.java:206)
[junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:73)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.exists(SolrZkClient.java:206)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.makePath(SolrZkClient.java:417)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.makePath(SolrZkClient.java:386)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.makePath(SolrZkClient.java:373)
[junit4] 2> at org.apache.solr.cloud.ShardLeaderElectionContextBase$1.execute(ElectionContext.java:135)
[junit4] 2> at org.apache.solr.common.util.RetryUtil.retryOnThrowable(RetryUtil.java:34)
[junit4] 2> ... 8 more
[junit4] 2>
[junit4] 2> 329406 T1157 oasc.LeaderElector$ElectionWatcher.process WARN org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer_elect/election
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4] 2> at org.apache.zookeeper.ZooKeeper.getChildren(ZooKeeper.java:1472)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:260)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:257)
[junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:73)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.getChildren(SolrZkClient.java:257)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:94)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.access$200(LeaderElector.java:55)
[junit4] 2> at org.apache.solr.cloud.LeaderElector$ElectionWatcher.process(LeaderElector.java:358)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:522)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:498)
[junit4] 2>
[junit4] 2> 329406 T1137 oascc.ZkStateReader$3.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4] 2> 329407 T1137 oasc.LeaderElector$ElectionWatcher.process WARN org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /collections/collection1/leader_elect/shard2/election
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4] 2> at org.apache.zookeeper.ZooKeeper.getChildren(ZooKeeper.java:1472)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:260)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:257)
[junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:73)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.getChildren(SolrZkClient.java:257)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:94)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.access$200(LeaderElector.java:55)
[junit4] 2> at org.apache.solr.cloud.LeaderElector$ElectionWatcher.process(LeaderElector.java:358)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:522)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:498)
[junit4] 2>
[junit4] 2> 329407 T1137 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 329407 T1137 oascc.ZkStateReader$2.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4] 2> 329408 T1137 oasc.LeaderElector$ElectionWatcher.process WARN org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer_elect/election
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4] 2> at org.apache.zookeeper.ZooKeeper.getChildren(ZooKeeper.java:1472)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:260)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:257)
[junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:73)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.getChildren(SolrZkClient.java:257)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:94)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.access$200(LeaderElector.java:55)
[junit4] 2> at org.apache.solr.cloud.LeaderElector$ElectionWatcher.process(LeaderElector.java:358)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:522)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:498)
[junit4] 2>
[junit4] 2> NOTE: leaving temporary files on disk at: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solr.cloud.CollectionsAPIAsyncDistributedZkTest-96B88152F866DEEC-001
[junit4] 2> NOTE: test params are: codec=Lucene41, sim=RandomSimilarityProvider(queryNorm=true,coord=crazy): {}, locale=ar_MA, timezone=Africa/Khartoum
[junit4] 2> NOTE: Linux 3.8.0-42-generic amd64/Oracle Corporation 1.8.0_20-ea (64-bit)/cpus=8,threads=1,free=33775832,total=243122176
[junit4] 2> NOTE: All tests run in this JVM: [TestZkChroot, BJQParserTest, TestUpdate, TestExtendedDismaxParser, CollectionsAPIDistributedZkTest, HdfsDirectoryTest, DeleteReplicaTest, TestRTGBase, TimeZoneUtilsTest, TestElisionMultitermQuery, TestCSVLoader, TestAtomicUpdateErrorCases, HdfsRecoveryZkTest, SoftAutoCommitTest, SolrXmlInZkTest, MultiTermTest, TestXIncludeConfig, TestFastWriter, UpdateRequestProcessorFactoryTest, TestPseudoReturnFields, TestQueryUtils, DeleteInactiveReplicaTest, TestValueSourceCache, TestOmitPositions, TestCollapseQParserPlugin, CoreContainerCoreInitFailuresTest, SampleTest, DOMUtilTest, HdfsChaosMonkeySafeLeaderTest, TestFastLRUCache, CollectionsAPIAsyncDistributedZkTest]
[junit4] Completed on J1 in 83.99s, 1 test, 1 failure <<< FAILURES!
[...truncated 1055 lines...]
BUILD FAILED
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/build.xml:467: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/build.xml:447: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/build.xml:45: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/extra-targets.xml:37: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build.xml:189: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/common-build.xml:496: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/common-build.xml:1299: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/common-build.xml:923: There were test failures: 404 suites, 1654 tests, 1 failure, 37 ignored (16 assumptions)
Total time: 65 minutes 14 seconds
Build step 'Invoke Ant' marked build as failure
[description-setter] Description set: Java: 64bit/jdk1.8.0_20-ea-b15 -XX:+UseCompressedOops -XX:+UseSerialGC
Archiving artifacts
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any
Re: [JENKINS] Lucene-Solr-4.x-Linux (64bit/jdk1.8.0_05) - Build #
10579 - Still Failing!
Posted by Timothy Potter <th...@gmail.com>.
Committed this test with AwaitsFix annotation as this is still
happening ... wonder if it is because this test uses 4 Jetty's?
On Tue, Jul 1, 2014 at 10:20 PM, Policeman Jenkins Server
<je...@thetaphi.de> wrote:
> Build: http://jenkins.thetaphi.de/job/Lucene-Solr-4.x-Linux/10579/
> Java: 64bit/jdk1.8.0_05 -XX:+UseCompressedOops -XX:+UseParallelGC
>
> 2 tests failed.
> FAILED: junit.framework.TestSuite.org.apache.solr.cloud.ReplicationFactorTest
>
> Error Message:
> Suite timeout exceeded (>= 7200000 msec).
>
> Stack Trace:
> java.lang.Exception: Suite timeout exceeded (>= 7200000 msec).
> at __randomizedtesting.SeedInfo.seed([CAD320064FE6F409]:0)
>
>
> FAILED: org.apache.solr.cloud.ReplicationFactorTest.testDistribSearch
>
> Error Message:
> Test abandoned because suite timeout was reached.
>
> Stack Trace:
> java.lang.Exception: Test abandoned because suite timeout was reached.
> at __randomizedtesting.SeedInfo.seed([CAD320064FE6F409]:0)
>
>
>
>
> Build Log:
> [...truncated 12047 lines...]
> [junit4] Suite: org.apache.solr.cloud.ReplicationFactorTest
> [junit4] 2> Creating dataDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solr.cloud.ReplicationFactorTest-CAD320064FE6F409-001/init-core-data-001
> [junit4] 2> 291217 T2045 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /
> [junit4] 2> 291220 T2045 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch
> [junit4] 2> 291221 T2045 oasc.ZkTestServer.run STARTING ZK TEST SERVER
> [junit4] 1> client port:0.0.0.0/0.0.0.0:0
> [junit4] 2> 291221 T2046 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
> [junit4] 2> 291321 T2045 oasc.ZkTestServer.run start zk server on port:54759
> [junit4] 2> 291322 T2045 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
> [junit4] 2> 291409 T2052 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@61d2646f name:ZooKeeperConnection Watcher:127.0.0.1:54759 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
> [junit4] 2> 291410 T2045 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
> [junit4] 2> 291410 T2045 oascc.SolrZkClient.makePath makePath: /solr
> [junit4] 2> 291414 T2045 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
> [junit4] 2> 291416 T2054 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@3da43591 name:ZooKeeperConnection Watcher:127.0.0.1:54759/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
> [junit4] 2> 291416 T2045 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
> [junit4] 2> 291416 T2045 oascc.SolrZkClient.makePath makePath: /collections/collection1
> [junit4] 2> 291418 T2045 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
> [junit4] 2> 291419 T2045 oascc.SolrZkClient.makePath makePath: /collections/control_collection
> [junit4] 2> 291420 T2045 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
> [junit4] 2> 291422 T2045 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
> [junit4] 2> 291422 T2045 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
> [junit4] 2> 291424 T2045 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/src/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
> [junit4] 2> 291425 T2045 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
> [junit4] 2> 291427 T2045 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
> [junit4] 2> 291428 T2045 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.snippet.randomindexconfig.xml
> [junit4] 2> 291431 T2045 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/src/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
> [junit4] 2> 291432 T2045 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
> [junit4] 2> 291434 T2045 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/src/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
> [junit4] 2> 291434 T2045 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
> [junit4] 2> 291436 T2045 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/src/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
> [junit4] 2> 291437 T2045 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
> [junit4] 2> 291439 T2045 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf1/enumsConfig.xml
> [junit4] 2> 291439 T2045 oascc.SolrZkClient.makePath makePath: /configs/conf1/enumsConfig.xml
> [junit4] 2> 291441 T2045 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
> [junit4] 2> 291442 T2045 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
> [junit4] 2> 291444 T2045 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
> [junit4] 2> 291444 T2045 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
> [junit4] 2> 291447 T2045 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
> [junit4] 2> 291447 T2045 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
> [junit4] 2> 291449 T2045 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/src/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
> [junit4] 2> 291450 T2045 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
> [junit4] 2> 291728 T2045 oejs.Server.doStart jetty-8.1.10.v20130312
> [junit4] 2> 291729 T2045 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:46157
> [junit4] 2> 291730 T2045 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
> [junit4] 2> 291730 T2045 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
> [junit4] 2> 291730 T2045 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ./solr.cloud.ReplicationFactorTest-CAD320064FE6F409-001/tempDir-002
> [junit4] 2> 291730 T2045 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './solr.cloud.ReplicationFactorTest-CAD320064FE6F409-001/tempDir-002/'
> [junit4] 2> 291740 T2045 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solr.cloud.ReplicationFactorTest-CAD320064FE6F409-001/tempDir-002/solr.xml
> [junit4] 2> 291746 T2045 oasc.CoreContainer.<init> New CoreContainer 1699254222
> [junit4] 2> 291747 T2045 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=./solr.cloud.ReplicationFactorTest-CAD320064FE6F409-001/tempDir-002/]
> [junit4] 2> 291747 T2045 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
> [junit4] 2> 291747 T2045 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to:
> [junit4] 2> 291748 T2045 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
> [junit4] 2> 291748 T2045 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
> [junit4] 2> 291748 T2045 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
> [junit4] 2> 291748 T2045 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
> [junit4] 2> 291748 T2045 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
> [junit4] 2> 291749 T2045 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
> [junit4] 2> 291749 T2045 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
> [junit4] 2> 291749 T2045 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
> [junit4] 2> 291749 T2045 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
> [junit4] 2> 291750 T2045 oasc.CoreContainer.load Host Name: 127.0.0.1
> [junit4] 2> 291750 T2045 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:54759/solr
> [junit4] 2> 291750 T2045 oasc.ZkController.checkChrootPath zkHost includes chroot
> [junit4] 2> 291751 T2045 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
> [junit4] 2> 291752 T2065 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@4619b22c name:ZooKeeperConnection Watcher:127.0.0.1:54759 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
> [junit4] 2> 291752 T2045 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
> [junit4] 2> 291753 T2045 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
> [junit4] 2> 291754 T2067 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@542f7886 name:ZooKeeperConnection Watcher:127.0.0.1:54759/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
> [junit4] 2> 291754 T2045 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
> [junit4] 2> 291755 T2045 oascc.SolrZkClient.makePath makePath: /overseer/queue
> [junit4] 2> 291757 T2045 oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work
> [junit4] 2> 291758 T2045 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-running
> [junit4] 2> 291760 T2045 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-completed
> [junit4] 2> 291761 T2045 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-failure
> [junit4] 2> 291771 T2045 oascc.SolrZkClient.makePath makePath: /live_nodes
> [junit4] 2> 291773 T2045 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:55563_
> [junit4] 2> 291774 T2045 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:55563_
> [junit4] 2> 291776 T2045 oascc.SolrZkClient.makePath makePath: /overseer_elect
> [junit4] 2> 291777 T2045 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
> [junit4] 2> 291779 T2045 oasc.OverseerElectionContext.runLeaderProcess I am going to be the leader 127.0.0.1:55563_
> [junit4] 2> 291779 T2045 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
> [junit4] 2> 291780 T2045 oasc.Overseer.start Overseer (id=92030316605734915-127.0.0.1:55563_-n_0000000000) starting
> [junit4] 2> 291781 T2045 oascc.SolrZkClient.makePath makePath: /overseer/queue-work
> [junit4] 2> 291786 T2069 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
> [junit4] 2> 291786 T2045 oascc.SolrZkClient.makePath makePath: /clusterstate.json
> [junit4] 2> 291787 T2045 oascc.SolrZkClient.makePath makePath: /aliases.json
> [junit4] 2> 291789 T2045 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
> [junit4] 2> 291791 T2068 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
> [junit4] 2> 291792 T2070 oasc.ZkController.publish publishing core=collection1 state=down collection=control_collection
> [junit4] 2> 291792 T2070 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
> [junit4] 2> 291793 T2067 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
> [junit4] 2> 291793 T2070 oasc.ZkController.waitForCoreNodeName look for our core node name
> [junit4] 2> 291793 T2068 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
> [junit4] 2> 291793 T2068 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
> [junit4] 2> "operation":"state",
> [junit4] 2> "state":"down",
> [junit4] 2> "base_url":"http://127.0.0.1:55563",
> [junit4] 2> "core":"collection1",
> [junit4] 2> "roles":null,
> [junit4] 2> "node_name":"127.0.0.1:55563_",
> [junit4] 2> "shard":null,
> [junit4] 2> "collection":"control_collection",
> [junit4] 2> "numShards":"1",
> [junit4] 2> "core_node_name":null}
> [junit4] 2> 291794 T2068 oasc.Overseer$ClusterStateUpdater.createCollection Create collection control_collection with shards [shard1]
> [junit4] 2> 291794 T2068 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
> [junit4] 2> 291795 T2067 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
> [junit4] 2> 291795 T2067 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
> [junit4] 2> 292793 T2070 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
> [junit4] 2> 292793 T2070 oasc.ZkController.createCollectionZkNode Check for collection zkNode:control_collection
> [junit4] 2> 292794 T2070 oasc.ZkController.createCollectionZkNode Collection zkNode exists
> [junit4] 2> 292795 T2070 oascc.ZkStateReader.readConfigName Load collection config from:/collections/control_collection
> [junit4] 2> 292796 T2070 oascc.ZkStateReader.readConfigName path=/collections/control_collection configName=conf1 specified config exists in ZooKeeper
> [junit4] 2> 292796 T2070 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './solr.cloud.ReplicationFactorTest-CAD320064FE6F409-001/tempDir-002/collection1/'
> [junit4] 2> 292797 T2070 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/solr.cloud.ReplicationFactorTest-CAD320064FE6F409-001/tempDir-002/collection1/lib/.svn/' to classloader
> [junit4] 2> 292798 T2070 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/solr.cloud.ReplicationFactorTest-CAD320064FE6F409-001/tempDir-002/collection1/lib/classes/' to classloader
> [junit4] 2> 292798 T2070 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/solr.cloud.ReplicationFactorTest-CAD320064FE6F409-001/tempDir-002/collection1/lib/README' to classloader
> [junit4] 2> 292818 T2070 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_4_10
> [junit4] 2> 292825 T2070 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
> [junit4] 2> 292826 T2070 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
> [junit4] 2> 292830 T2070 oass.IndexSchema.readSchema [collection1] Schema name=test
> [junit4] 2> 292921 T2070 oass.ByteField.init WARN ByteField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
> [junit4] 2> 292921 T2070 oass.ShortField.init WARN ShortField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
> [junit4] 2> 292922 T2070 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
> [junit4] 2> 292925 T2070 oass.IndexSchema.readSchema default search field in schema is text
> [junit4] 2> 292926 T2070 oass.IndexSchema.readSchema unique key field: id
> [junit4] 2> 292935 T2070 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
> [junit4] 2> 292938 T2070 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
> [junit4] 2> 292940 T2070 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
> [junit4] 2> 292941 T2070 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
> [junit4] 2> 292941 T2070 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
> [junit4] 2> 292942 T2070 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
> [junit4] 2> 292942 T2070 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
> [junit4] 2> 292943 T2070 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
> [junit4] 2> 292943 T2070 oasc.CoreContainer.create Creating SolrCore 'collection1' using configuration from collection control_collection
> [junit4] 2> 292943 T2070 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
> [junit4] 2> 292943 T2070 oasc.SolrCore.<init> [collection1] Opening new SolrCore at ./solr.cloud.ReplicationFactorTest-CAD320064FE6F409-001/tempDir-002/collection1/, dataDir=./solr.cloud.ReplicationFactorTest-CAD320064FE6F409-001/tempDir-001/control/data/
> [junit4] 2> 292943 T2070 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@2914a6d0
> [junit4] 2> 292944 T2070 oasc.CachingDirectoryFactory.get return new directory for ./solr.cloud.ReplicationFactorTest-CAD320064FE6F409-001/tempDir-001/control/data
> [junit4] 2> 292944 T2070 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./solr.cloud.ReplicationFactorTest-CAD320064FE6F409-001/tempDir-001/control/data/index/
> [junit4] 2> 292944 T2070 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './solr.cloud.ReplicationFactorTest-CAD320064FE6F409-001/tempDir-001/control/data/index' doesn't exist. Creating new index...
> [junit4] 2> 292945 T2070 oasc.CachingDirectoryFactory.get return new directory for ./solr.cloud.ReplicationFactorTest-CAD320064FE6F409-001/tempDir-001/control/data/index
> [junit4] 2> 292945 T2070 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=50, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.7627639309808609]
> [junit4] 2> 292945 T2070 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
> [junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@326a9b32 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@75e52aa),segFN=segments_1,generation=1}
> [junit4] 2> 292946 T2070 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
> [junit4] 2> 292947 T2070 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
> [junit4] 2> 292947 T2070 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
> [junit4] 2> 292948 T2070 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
> [junit4] 2> 292948 T2070 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
> [junit4] 2> 292948 T2070 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
> [junit4] 2> 292948 T2070 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
> [junit4] 2> 292948 T2070 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
> [junit4] 2> 292949 T2070 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
> [junit4] 2> 292949 T2070 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
> [junit4] 2> 292949 T2070 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
> [junit4] 2> 292949 T2070 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
> [junit4] 2> 292949 T2070 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
> [junit4] 2> 292950 T2070 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
> [junit4] 2> 292950 T2070 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
> [junit4] 2> 292950 T2070 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
> [junit4] 2> 292950 T2070 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
> [junit4] 2> 292952 T2070 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
> [junit4] 2> 292953 T2070 oasu.CommitTracker.<init> Hard AutoCommit: disabled
> [junit4] 2> 292953 T2070 oasu.CommitTracker.<init> Soft AutoCommit: disabled
> [junit4] 2> 292954 T2070 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=15, maxMergeAtOnceExplicit=49, maxMergedSegmentMB=31.1396484375, floorSegmentMB=1.046875, forceMergeDeletesPctAllowed=1.7284291932442009, segmentsPerTier=47.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.5523492831752316
> [junit4] 2> 292954 T2070 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
> [junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@326a9b32 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@75e52aa),segFN=segments_1,generation=1}
> [junit4] 2> 292954 T2070 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
> [junit4] 2> 292955 T2070 oass.SolrIndexSearcher.<init> Opening Searcher@481b5531[collection1] main
> [junit4] 2> 292955 T2070 oascc.ZkStateReader.readConfigName Load collection config from:/collections/control_collection
> [junit4] 2> 292956 T2070 oascc.ZkStateReader.readConfigName path=/collections/control_collection configName=conf1 specified config exists in ZooKeeper
> [junit4] 2> 292956 T2070 oasr.ManagedResourceStorage.newStorageIO Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1
> [junit4] 2> 292957 T2070 oasr.ManagedResourceStorage$ZooKeeperStorageIO.configure Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
> [junit4] 2> 292957 T2070 oasr.RestManager.init Initializing RestManager with initArgs: {}
> [junit4] 2> 292957 T2070 oasr.ManagedResourceStorage.load Reading _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
> [junit4] 2> 292958 T2070 oasr.ManagedResourceStorage$ZooKeeperStorageIO.openInputStream No data found for znode /configs/conf1/_rest_managed.json
> [junit4] 2> 292958 T2070 oasr.ManagedResourceStorage.load Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
> [junit4] 2> 292958 T2070 oasr.ManagedResource.notifyObserversDuringInit WARN No registered observers for /rest/managed
> [junit4] 2> 292958 T2070 oasr.RestManager.init Initializing 0 registered ManagedResources
> [junit4] 2> 292959 T2071 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@481b5531[collection1] main{StandardDirectoryReader(segments_1:1:nrt)}
> [junit4] 2> 292960 T2070 oasc.CoreContainer.registerCore registering core: collection1
> [junit4] 2> 292961 T2074 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:55563 collection:control_collection shard:shard1
> [junit4] 2> 292961 T2045 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1
> [junit4] 2> 292962 T2045 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
> [junit4] 2> 292962 T2074 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leader_elect/shard1/election
> [junit4] 2> 292964 T2045 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
> [junit4] 2> 292965 T2077 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@5ff24e13 name:ZooKeeperConnection Watcher:127.0.0.1:54759/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
> [junit4] 2> 292965 T2045 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
> [junit4] 2> 292966 T2045 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
> [junit4] 2> 292966 T2074 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard1
> [junit4] 2> 292968 T2067 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
> [junit4] 2> 292968 T2045 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:false cause connection loss:false
> [junit4] 2> 292968 T2074 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
> [junit4] 2> 292968 T2074 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
> [junit4] 2> 292968 T2068 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
> [junit4] 2> ASYNC NEW_CORE C285 name=collection1 org.apache.solr.core.SolrCore@5cf5d13c url=http://127.0.0.1:55563/collection1 node=127.0.0.1:55563_ C285_STATE=coll:control_collection core:collection1 props:{state=down, base_url=http://127.0.0.1:55563, core=collection1, node_name=127.0.0.1:55563_}
> [junit4] 2> 292969 T2074 C285 P55563 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:55563/collection1/
> [junit4] 2> 292969 T2074 C285 P55563 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
> [junit4] 2> 292969 T2074 C285 P55563 oasc.SyncStrategy.syncToMe http://127.0.0.1:55563/collection1/ has no replicas
> [junit4] 2> 292969 T2074 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:55563/collection1/ shard1
> [junit4] 2> 292970 T2074 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leaders/shard1
> [junit4] 2> 292970 T2067 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
> [junit4] 2> 292972 T2067 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
> [junit4] 2> 292973 T2067 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
> [junit4] 2> 293075 T2067 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
> [junit4] 2> 293075 T2077 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
> [junit4] 2> 293123 T2074 oasc.ZkController.register We are http://127.0.0.1:55563/collection1/ and leader is http://127.0.0.1:55563/collection1/
> [junit4] 2> 293123 T2074 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:55563
> [junit4] 2> 293123 T2074 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
> [junit4] 2> 293123 T2074 oasc.ZkController.publish publishing core=collection1 state=active collection=control_collection
> [junit4] 2> 293123 T2074 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
> [junit4] 2> 293124 T2067 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
> [junit4] 2> 293124 T2067 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
> [junit4] 2> 293125 T2067 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
> [junit4] 2> 293125 T2074 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
> [junit4] 2> 293126 T2068 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
> [junit4] 2> 293126 T2068 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
> [junit4] 2> "operation":"state",
> [junit4] 2> "state":"active",
> [junit4] 2> "base_url":"http://127.0.0.1:55563",
> [junit4] 2> "core":"collection1",
> [junit4] 2> "roles":null,
> [junit4] 2> "node_name":"127.0.0.1:55563_",
> [junit4] 2> "shard":"shard1",
> [junit4] 2> "collection":"control_collection",
> [junit4] 2> "numShards":"3",
> [junit4] 2> "core_node_name":"core_node1"}
> [junit4] 2> 293127 T2067 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
> [junit4] 2> 293187 T2045 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 1
> [junit4] 2> 293187 T2045 oejs.Server.doStart jetty-8.1.10.v20130312
> [junit4] 2> 293190 T2045 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:59521
> [junit4] 2> 293190 T2045 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
> [junit4] 2> 293191 T2045 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
> [junit4] 2> 293191 T2045 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ./solr.cloud.ReplicationFactorTest-CAD320064FE6F409-001/tempDir-003
> [junit4] 2> 293191 T2045 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './solr.cloud.ReplicationFactorTest-CAD320064FE6F409-001/tempDir-003/'
> [junit4] 2> 293209 T2045 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solr.cloud.ReplicationFactorTest-CAD320064FE6F409-001/tempDir-003/solr.xml
> [junit4] 2> 293225 T2045 oasc.CoreContainer.<init> New CoreContainer 1398713933
> [junit4] 2> 293225 T2045 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=./solr.cloud.ReplicationFactorTest-CAD320064FE6F409-001/tempDir-003/]
> [junit4] 2> 293226 T2045 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
> [junit4] 2> 293226 T2045 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to:
> [junit4] 2> 293227 T2045 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
> [junit4] 2> 293227 T2045 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
> [junit4] 2> 293227 T2045 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
> [junit4] 2> 293228 T2045 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
> [junit4] 2> 293228 T2045 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
> [junit4] 2> 293229 T2045 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
> [junit4] 2> 293229 T2045 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
> [junit4] 2> 293229 T2077 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
> [junit4] 2> 293229 T2067 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
> [junit4] 2> 293230 T2045 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
> [junit4] 2> 293231 T2045 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
> [junit4] 2> 293232 T2045 oasc.CoreContainer.load Host Name: 127.0.0.1
> [junit4] 2> 293232 T2045 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:54759/solr
> [junit4] 2> 293233 T2045 oasc.ZkController.checkChrootPath zkHost includes chroot
> [junit4] 2> 293235 T2045 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
> [junit4] 2> 293236 T2088 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@aac11fa name:ZooKeeperConnection Watcher:127.0.0.1:54759 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
> [junit4] 2> 293236 T2045 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
> [junit4] 2> 293238 T2045 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
> [junit4] 2> 293239 T2090 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@4e3816bc name:ZooKeeperConnection Watcher:127.0.0.1:54759/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
> [junit4] 2> 293240 T2045 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
> [junit4] 2> 293248 T2045 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
> [junit4] 2> 294254 T2045 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:52718_
> [junit4] 2> 294262 T2045 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:52718_
> [junit4] 2> 294266 T2067 oascc.ZkStateReader$3.process Updating live nodes... (2)
> [junit4] 2> 294266 T2090 oascc.ZkStateReader$3.process Updating live nodes... (2)
> [junit4] 2> 294266 T2077 oascc.ZkStateReader$3.process Updating live nodes... (2)
> [junit4] 2> 294274 T2091 oasc.ZkController.publish publishing core=collection1 state=down collection=collection1
> [junit4] 2> 294274 T2091 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
> [junit4] 2> 294276 T2091 oasc.ZkController.waitForCoreNodeName look for our core node name
> [junit4] 2> 294276 T2067 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
> [junit4] 2> 294276 T2067 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
> [junit4] 2> 294277 T2067 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
> [junit4] 2> 294278 T2068 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
> [junit4] 2> 294279 T2068 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
> [junit4] 2> "operation":"state",
> [junit4] 2> "state":"down",
> [junit4] 2> "base_url":"http://127.0.0.1:52718",
> [junit4] 2> "core":"collection1",
> [junit4] 2> "roles":null,
> [junit4] 2> "node_name":"127.0.0.1:52718_",
> [junit4] 2> "shard":null,
> [junit4] 2> "collection":"collection1",
> [junit4] 2> "numShards":"3",
> [junit4] 2> "core_node_name":null}
> [junit4] 2> 294279 T2068 oasc.Overseer$ClusterStateUpdater.createCollection Create collection collection1 with shards [shard1, shard2, shard3]
> [junit4] 2> 294280 T2068 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard2
> [junit4] 2> 294282 T2067 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
> [junit4] 2> 294384 T2077 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
> [junit4] 2> 294384 T2090 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
> [junit4] 2> 294384 T2067 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
> [junit4] 2> 295276 T2091 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
> [junit4] 2> 295277 T2091 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
> [junit4] 2> 295278 T2091 oasc.ZkController.createCollectionZkNode Collection zkNode exists
> [junit4] 2> 295278 T2091 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
> [junit4] 2> 295280 T2091 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
> [junit4] 2> 295280 T2091 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './solr.cloud.ReplicationFactorTest-CAD320064FE6F409-001/tempDir-003/collection1/'
> [junit4] 2> 295281 T2091 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/solr.cloud.ReplicationFactorTest-CAD320064FE6F409-001/tempDir-003/collection1/lib/.svn/' to classloader
> [junit4] 2> 295281 T2091 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/solr.cloud.ReplicationFactorTest-CAD320064FE6F409-001/tempDir-003/collection1/lib/classes/' to classloader
> [junit4] 2> 295281 T2091 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/solr.cloud.ReplicationFactorTest-CAD320064FE6F409-001/tempDir-003/collection1/lib/README' to classloader
> [junit4] 2> 295300 T2091 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_4_10
> [junit4] 2> 295308 T2091 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
> [junit4] 2> 295309 T2091 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
> [junit4] 2> 295313 T2091 oass.IndexSchema.readSchema [collection1] Schema name=test
> [junit4] 2> 295421 T2091 oass.ByteField.init WARN ByteField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
> [junit4] 2> 295422 T2091 oass.ShortField.init WARN ShortField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
> [junit4] 2> 295422 T2091 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
> [junit4] 2> 295425 T2091 oass.IndexSchema.readSchema default search field in schema is text
> [junit4] 2> 295426 T2091 oass.IndexSchema.readSchema unique key field: id
> [junit4] 2> 295438 T2091 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
> [junit4] 2> 295441 T2091 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
> [junit4] 2> 295443 T2091 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
> [junit4] 2> 295445 T2091 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
> [junit4] 2> 295445 T2091 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
> [junit4] 2> 295445 T2091 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
> [junit4] 2> 295446 T2091 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
> [junit4] 2> 295447 T2091 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
> [junit4] 2> 295447 T2091 oasc.CoreContainer.create Creating SolrCore 'collection1' using configuration from collection collection1
> [junit4] 2> 295447 T2091 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
> [junit4] 2> 295447 T2091 oasc.SolrCore.<init> [collection1] Opening new SolrCore at ./solr.cloud.ReplicationFactorTest-CAD320064FE6F409-001/tempDir-003/collection1/, dataDir=./solr.cloud.ReplicationFactorTest-CAD320064FE6F409-001/tempDir-001/jetty1/
> [junit4] 2> 295447 T2091 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@2914a6d0
> [junit4] 2> 295448 T2091 oasc.CachingDirectoryFactory.get return new directory for ./solr.cloud.ReplicationFactorTest-CAD320064FE6F409-001/tempDir-001/jetty1
> [junit4] 2> 295448 T2091 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./solr.cloud.ReplicationFactorTest-CAD320064FE6F409-001/tempDir-001/jetty1/index/
> [junit4] 2> 295449 T2091 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './solr.cloud.ReplicationFactorTest-CAD320064FE6F409-001/tempDir-001/jetty1/index' doesn't exist. Creating new index...
> [junit4] 2> 295449 T2091 oasc.CachingDirectoryFactory.get return new directory for ./solr.cloud.ReplicationFactorTest-CAD320064FE6F409-001/tempDir-001/jetty1/index
> [junit4] 2> 295450 T2091 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=50, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.7627639309808609]
> [junit4] 2> 295450 T2091 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
> [junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@42cecf1c lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@67b7bde3),segFN=segments_1,generation=1}
> [junit4] 2> 295450 T2091 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
> [junit4] 2> 295455 T2091 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
> [junit4] 2> 295456 T2091 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
> [junit4] 2> 295456 T2091 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
> [junit4] 2> 295456 T2091 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
> [junit4] 2> 295456 T2091 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
> [junit4] 2> 295457 T2091 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
> [junit4] 2> 295457 T2091 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
> [junit4] 2> 295458 T2091 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
> [junit4] 2> 295458 T2091 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
> [junit4] 2> 295458 T2091 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
> [junit4] 2> 295459 T2091 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
> [junit4] 2> 295459 T2091 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
> [junit4] 2> 295459 T2091 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
> [junit4] 2> 295460 T2091 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
> [junit4] 2> 295460 T2091 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
> [junit4] 2> 295461 T2091 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
> [junit4] 2> 295463 T2091 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
> [junit4] 2> 295465 T2091 oasu.CommitTracker.<init> Hard AutoCommit: disabled
> [junit4] 2> 295465 T2091 oasu.CommitTracker.<init> Soft AutoCommit: disabled
> [junit4] 2> 295466 T2091 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=15, maxMergeAtOnceExplicit=49, maxMergedSegmentMB=31.1396484375, floorSegmentMB=1.046875, forceMergeDeletesPctAllowed=1.7284291932442009, segmentsPerTier=47.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.5523492831752316
> [junit4] 2> 295467 T2091 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
> [junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@42cecf1c lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@67b7bde3),segFN=segments_1,generation=1}
> [junit4] 2> 295467 T2091 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
> [junit4] 2> 295467 T2091 oass.SolrIndexSearcher.<init> Opening Searcher@295b277[collection1] main
> [junit4] 2> 295468 T2091 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
> [junit4] 2> 295469 T2091 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
> [junit4] 2> 295469 T2091 oasr.ManagedResourceStorage.newStorageIO Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1
> [junit4] 2> 295469 T2091 oasr.ManagedResourceStorage$ZooKeeperStorageIO.configure Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
> [junit4] 2> 295470 T2091 oasr.RestManager.init Initializing RestManager with initArgs: {}
> [junit4] 2> 295470 T2091 oasr.ManagedResourceStorage.load Reading _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
> [junit4] 2> 295470 T2091 oasr.ManagedResourceStorage$ZooKeeperStorageIO.openInputStream No data found for znode /configs/conf1/_rest_managed.json
> [junit4] 2> 295470 T2091 oasr.ManagedResourceStorage.load Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
> [junit4] 2> 295470 T2091 oasr.ManagedResource.notifyObserversDuringInit WARN No registered observers for /rest/managed
> [junit4] 2> 295470 T2091 oasr.RestManager.init Initializing 0 registered ManagedResources
> [junit4] 2> 295472 T2092 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@295b277[collection1] main{StandardDirectoryReader(segments_1:1:nrt)}
> [junit4] 2> 295473 T2091 oasc.CoreContainer.registerCore registering core: collection1
> [junit4] 2> 295474 T2095 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:52718 collection:collection1 shard:shard2
> [junit4] 2> 295474 T2045 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1
> [junit4] 2> 295475 T2045 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
> [junit4] 2> 295476 T2095 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard2/election
> [junit4] 2> 295481 T2095 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard2
> [junit4] 2> 295482 T2067 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
> [junit4] 2> 295482 T2067 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
> [junit4] 2> 295482 T2067 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
> [junit4] 2> 295483 T2095 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
> [junit4] 2> 295483 T2095 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
> [junit4] 2> ASYNC NEW_CORE C286 name=collection1 org.apache.solr.core.SolrCore@4c398d4d url=http://127.0.0.1:52718/collection1 node=127.0.0.1:52718_ C286_STATE=coll:collection1 core:collection1 props:{state=down, base_url=http://127.0.0.1:52718, core=collection1, node_name=127.0.0.1:52718_}
> [junit4] 2> 295483 T2095 C286 P52718 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:52718/collection1/
> [junit4] 2> 295483 T2068 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
> [junit4] 2> 295484 T2095 C286 P52718 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
> [junit4] 2> 295484 T2095 C286 P52718 oasc.SyncStrategy.syncToMe http://127.0.0.1:52718/collection1/ has no replicas
> [junit4] 2> 295484 T2095 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:52718/collection1/ shard2
> [junit4] 2> 295484 T2095 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard2
> [junit4] 2> 295486 T2067 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
> [junit4] 2> 295491 T2067 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
> [junit4] 2> 295493 T2067 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
> [junit4] 2> 295596 T2090 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
> [junit4] 2> 295596 T2077 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
> [junit4] 2> 295596 T2067 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
> [junit4] 2> 295642 T2095 oasc.ZkController.register We are http://127.0.0.1:52718/collection1/ and leader is http://127.0.0.1:52718/collection1/
> [junit4] 2> 295642 T2095 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:52718
> [junit4] 2> 295642 T2095 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
> [junit4] 2> 295642 T2095 oasc.ZkController.publish publishing core=collection1 state=active collection=collection1
> [junit4] 2> 295642 T2095 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
> [junit4] 2> 295644 T2067 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
> [junit4] 2> 295644 T2067 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
> [junit4] 2> 295644 T2095 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
> [junit4] 2> 295644 T2067 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
> [junit4] 2> 295645 T2068 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
> [junit4] 2> 295646 T2068 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
> [junit4] 2> "operation":"state",
> [junit4] 2> "state":"active",
> [junit4] 2> "base_url":"http://127.0.0.1:52718",
> [junit4] 2> "core":"collection1",
> [junit4] 2> "roles":null,
> [junit4] 2> "node_name":"127.0.0.1:52718_",
> [junit4] 2> "shard":"shard2",
> [junit4] 2> "collection":"collection1",
> [junit4] 2> "numShards":"3",
> [junit4] 2> "core_node_name":"core_node1"}
> [junit4] 2> 295647 T2067 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
> [junit4] 2> 295690 T2045 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 2
> [junit4] 2> 295690 T2045 oejs.Server.doStart jetty-8.1.10.v20130312
> [junit4] 2> 295694 T2045 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:36276
> [junit4] 2> 295695 T2045 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
> [junit4] 2> 295696 T2045 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
> [junit4] 2> 295696 T2045 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ./solr.cloud.ReplicationFactorTest-CAD320064FE6F409-001/tempDir-004
> [junit4] 2> 295696 T2045 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './solr.cloud.ReplicationFactorTest-CAD320064FE6F409-001/tempDir-004/'
> [junit4] 2> 295710 T2045 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solr.cloud.ReplicationFactorTest-CAD320064FE6F409-001/tempDir-004/solr.xml
> [junit4] 2> 295716 T2045 oasc.CoreContainer.<init> New CoreContainer 1179038194
> [junit4] 2> 295716 T2045 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=./solr.cloud.ReplicationFactorTest-CAD320064FE6F409-001/tempDir-004/]
> [junit4] 2> 295716 T2045 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
> [junit4] 2> 295716 T2045 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to:
> [junit4] 2> 295717 T2045 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
> [junit4] 2> 295717 T2045 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
> [junit4] 2> 295717 T2045 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
> [junit4] 2> 295717 T2045 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
> [junit4] 2> 295717 T2045 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
> [junit4] 2> 295718 T2045 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
> [junit4] 2> 295718 T2045 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
> [junit4] 2> 295718 T2045 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
> [junit4] 2> 295718 T2045 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
> [junit4] 2> 295719 T2045 oasc.CoreContainer.load Host Name: 127.0.0.1
> [junit4] 2> 295719 T2045 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:54759/solr
> [junit4] 2> 295719 T2045 oasc.ZkController.checkChrootPath zkHost includes chroot
> [junit4] 2> 295720 T2045 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
> [junit4] 2> 295721 T2107 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@2362e717 name:ZooKeeperConnection Watcher:127.0.0.1:54759 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
> [junit4] 2> 295722 T2045 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
> [junit4] 2> 295723 T2045 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
> [junit4] 2> 295724 T2109 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@701b8a4a name:ZooKeeperConnection Watcher:127.0.0.1:54759/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
> [junit4] 2> 295724 T2045 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
> [junit4] 2> 295729 T2045 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
> [junit4] 2> 295753 T2090 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
> [junit4] 2> 295753 T2109 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
> [junit4] 2> 295753 T2077 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
> [junit4] 2> 295753 T2067 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
> [junit4] 2> 296732 T2045 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:53557_
> [junit4] 2> 296733 T2045 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:53557_
> [junit4] 2> 296734 T2090 oascc.ZkStateReader$3.process Updating live nodes... (3)
> [junit4] 2> 296734 T2077 oascc.ZkStateReader$3.process Updating live nodes... (3)
> [junit4] 2> 296734 T2067 oascc.ZkStateReader$3.process Updating live nodes... (3)
> [junit4] 2> 296734 T2109 oascc.ZkStateReader$3.process Updating live nodes... (3)
> [junit4] 2> 296737 T2110 oasc.ZkController.publish publishing core=collection1 state=down collection=collection1
> [junit4] 2> 296737 T2110 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
> [junit4] 2> 296738 T2067 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
> [junit4] 2> 296738 T2067 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
> [junit4] 2> 296738 T2067 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
> [junit4] 2> 296738 T2110 oasc.ZkController.waitForCoreNodeName look for our core node name
> [junit4] 2> 296739 T2068 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
> [junit4] 2> 296739 T2068 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
> [junit4] 2> "operation":"state",
> [junit4] 2> "state":"down",
> [junit4] 2> "base_url":"http://127.0.0.1:53557",
> [junit4] 2> "core":"collection1",
> [junit4] 2> "roles":null,
> [junit4] 2> "node_name":"127.0.0.1:53557_",
> [junit4] 2> "shard":null,
> [junit4] 2> "collection":"collection1",
> [junit4] 2> "numShards":"3",
> [junit4] 2> "core_node_name":null}
> [junit4] 2> 296740 T2068 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=3
> [junit4] 2> 296740 T2068 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard3
> [junit4] 2> 296741 T2067 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
> [junit4] 2> 296843 T2090 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
> [junit4] 2> 296843 T2109 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
> [junit4] 2> 296843 T2077 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
> [junit4] 2> 296843 T2067 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
> [junit4] 2> 297739 T2110 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
> [junit4] 2> 297739 T2110 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
> [junit4] 2> 297740 T2110 oasc.ZkController.createCollectionZkNode Collection zkNode exists
> [junit4] 2> 297740 T2110 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
> [junit4] 2> 297740 T2110 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
> [junit4] 2> 297740 T2110 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './solr.cloud.ReplicationFactorTest-CAD320064FE6F409-001/tempDir-004/collection1/'
> [junit4] 2> 297741 T2110 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/solr.cloud.ReplicationFactorTest-CAD320064FE6F409-001/tempDir-004/collection1/lib/.svn/' to classloader
> [junit4] 2> 297741 T2110 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/solr.cloud.ReplicationFactorTest-CAD320064FE6F409-001/tempDir-004/collection1/lib/classes/' to classloader
> [junit4] 2> 297741 T2110 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/solr.cloud.ReplicationFactorTest-CAD320064FE6F409-001/tempDir-004/collection1/lib/README' to classloader
> [junit4] 2> 297765 T2110 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_4_10
> [junit4] 2> 297776 T2110 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
> [junit4] 2> 297782 T2110 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
> [junit4] 2> 297788 T2110 oass.IndexSchema.readSchema [collection1] Schema name=test
> [junit4] 2> 297889 T2110 oass.ByteField.init WARN ByteField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
> [junit4] 2> 297889 T2110 oass.ShortField.init WARN ShortField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
> [junit4] 2> 297890 T2110 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
> [junit4] 2> 297893 T2110 oass.IndexSchema.readSchema default search field in schema is text
> [junit4] 2> 297894 T2110 oass.IndexSchema.readSchema unique key field: id
> [junit4] 2> 297902 T2110 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
> [junit4] 2> 297904 T2110 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
> [junit4] 2> 297905 T2110 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
> [junit4] 2> 297908 T2110 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
> [junit4] 2> 297908 T2110 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
> [junit4] 2> 297908 T2110 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
> [junit4] 2> 297909 T2110 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
> [junit4] 2> 297909 T2110 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
> [junit4] 2> 297909 T2110 oasc.CoreContainer.create Creating SolrCore 'collection1' using configuration from collection collection1
> [junit4] 2> 297909 T2110 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
> [junit4] 2> 297910 T2110 oasc.SolrCore.<init> [collection1] Opening new SolrCore at ./solr.cloud.ReplicationFactorTest-CAD320064FE6F409-001/tempDir-004/collection1/, dataDir=./solr.cloud.ReplicationFactorTest-CAD320064FE6F409-001/tempDir-001/jetty2/
> [junit4] 2> 297910 T2110 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@2914a6d0
> [junit4] 2> 297911 T2110 oasc.CachingDirectoryFactory.get return new directory for ./solr.cloud.ReplicationFactorTest-CAD320064FE6F409-001/tempDir-001/jetty2
> [junit4] 2> 297911 T2110 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./solr.cloud.ReplicationFactorTest-CAD320064FE6F409-001/tempDir-001/jetty2/index/
> [junit4] 2> 297911 T2110 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './solr.cloud.ReplicationFactorTest-CAD320064FE6F409-001/tempDir-001/jetty2/index' doesn't exist. Creating new index...
> [junit4] 2> 297911 T2110 oasc.CachingDirectoryFactory.get return new directory for ./solr.cloud.ReplicationFactorTest-CAD320064FE6F409-001/tempDir-001/jetty2/index
> [junit4] 2> 297911 T2110 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=50, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.7627639309808609]
> [junit4] 2> 297912 T2110 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
> [junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@36c2d864 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@42da7d6d),segFN=segments_1,generation=1}
> [junit4] 2> 297912 T2110 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
> [junit4] 2> 297914 T2110 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
> [junit4] 2> 297914 T2110 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
> [junit4] 2> 297914 T2110 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
> [junit4] 2> 297914 T2110 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
> [junit4] 2> 297914 T2110 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
> [junit4] 2> 297914 T2110 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
> [junit4] 2> 297915 T2110 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
> [junit4] 2> 297915 T2110 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
> [junit4] 2> 297915 T2110 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
> [junit4] 2> 297915 T2110 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
> [junit4] 2> 297915 T2110 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
> [junit4] 2> 297916 T2110 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
> [junit4] 2> 297916 T2110 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
> [junit4] 2> 297916 T2110 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
> [junit4] 2> 297916 T2110 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
> [junit4] 2> 297916 T2110 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
> [junit4] 2> 297918 T2110 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
> [junit4] 2> 297919 T2110 oasu.CommitTracker.<init> Hard AutoCommit: disabled
> [junit4] 2> 297919 T2110 oasu.CommitTracker.<init> Soft AutoCommit: disabled
> [junit4] 2> 297919 T2110 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=15, maxMergeAtOnceExplicit=49, maxMergedSegmentMB=31.1396484375, floorSegmentMB=1.046875, forceMergeDeletesPctAllowed=1.7284291932442009, segmentsPerTier=47.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.5523492831752316
> [junit4] 2> 297920 T2110 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
> [junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@36c2d864 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@42da7d6d),segFN=segments_1,generation=1}
> [junit4] 2> 297920 T2110 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
> [junit4] 2> 297920 T2110 oass.SolrIndexSearcher.<init> Opening Searcher@268ccad9[collection1] main
> [junit4] 2> 297920 T2110 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
> [junit4] 2> 297921 T2110 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
> [junit4] 2> 297921 T2110 oasr.ManagedResourceStorage.newStorageIO Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1
> [junit4] 2> 297922 T2110 oasr.ManagedResourceStorage$ZooKeeperStorageIO.configure Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
> [junit4] 2> 297922 T2110 oasr.RestManager.init Initializing RestManager with initArgs: {}
> [junit4] 2> 297922 T2110 oasr.ManagedResourceStorage.load Reading _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
> [junit4] 2> 297922 T2110 oasr.ManagedResourceStorage$ZooKeeperStorageIO.openInputStream No data found for znode /configs/conf1/_rest_managed.json
> [junit4] 2> 297922 T2110 oasr.ManagedResourceStorage.load Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
> [junit4] 2> 297923 T2110 oasr.ManagedResource.notifyObserversDuringInit WARN No registered observers for /rest/managed
> [junit4] 2> 297923 T2110 oasr.RestManager.init Initializing 0 registered ManagedResources
> [junit4] 2> 297925 T2111 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@268ccad9[collection1] main{StandardDirectoryReader(segments_1:1:nrt)}
> [junit4] 2> 297926 T2110 oasc.CoreContainer.registerCore registering core: collection1
> [junit4] 2> 297926 T2114 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:53557 collection:collection1 shard:shard3
> [junit4] 2> 297927 T2045 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1
> [junit4] 2> 297927 T2114 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard3/election
> [junit4] 2> 297927 T2045 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
> [junit4] 2> 297930 T2114 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard3
> [junit4] 2> 297931 T2067 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
> [junit4] 2> 297931 T2067 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
> [junit4] 2> 297931 T2067 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
> [junit4] 2> 297931 T2114 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
> [junit4] 2> 297931 T2114 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
> [junit4] 2> 297932 T2068 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
> [junit4] 2> ASYNC NEW_CORE C287 name=collection1 org.apache.solr.core.SolrCore@656a0d01 url=http://127.0.0.1:53557/collection1 node=127.0.0.1:53557_ C287_STATE=coll:collection1 core:collection1 props:{state=down, base_url=http://127.0.0.1:53557, core=collection1, node_name=127.0.0.1:53557_}
> [junit4] 2> 297932 T2114 C287 P53557 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:53557/collection1/
> [junit4] 2> 297932 T2114 C287 P53557 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
> [junit4] 2> 297932 T2114 C287 P53557 oasc.SyncStrategy.syncToMe http://127.0.0.1:53557/collection1/ has no replicas
> [junit4] 2> 297932 T2114 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:53557/collection1/ shard3
> [junit4] 2> 297933 T2114 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard3
> [junit4] 2> 297933 T2067 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
> [junit4] 2> 297937 T2067 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
> [junit4] 2> 297938 T2067 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
> [junit4] 2> 298040 T2067 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
> [junit4] 2> 298040 T2109 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
> [junit4] 2> 298040 T2090 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
> [junit4] 2> 298040 T2077 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
> [junit4] 2> 298088 T2114 oasc.ZkController.register We are http://127.0.0.1:53557/collection1/ and leader is http://127.0.0.1:53557/collection1/
> [junit4] 2> 298088 T2114 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:53557
> [junit4] 2> 298088 T2114 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
> [junit4] 2> 298088 T2114 oasc.ZkController.publish publishing core=collection1 state=active collection=collection1
> [junit4] 2> 298088 T2114 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
> [junit4] 2> 298090 T2067 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
> [junit4] 2> 298090 T2067 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
> [junit4] 2> 298090 T2067 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
> [junit4] 2> 298091 T2114 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
> [junit4] 2> 298091 T2068 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
> [junit4] 2> 298091 T2068 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
> [junit4] 2> "operation":"state",
> [junit4] 2> "state":"active",
> [junit4] 2> "base_url":"http://127.0.0.1:53557",
> [junit4] 2> "core":"collection1",
> [junit4] 2> "roles":null,
> [junit4] 2> "node_name":"127.0.0.1:53557_",
> [junit4] 2> "shard":"shard3",
> [junit4] 2> "collection":"collection1",
> [junit4] 2> "numShards":"3",
> [junit4] 2> "core_node_name":"core_node2"}
> [junit4] 2> 298093 T2067 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
> [junit4] 2> 298145 T2045 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 3
> [junit4] 2> 298146 T2045 oejs.Server.doStart jetty-8.1.10.v20130312
> [junit4] 2> 298147 T2045 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:41117
> [junit4] 2> 298148 T2045 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
> [junit4] 2> 298148 T2045 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
> [junit4] 2> 298149 T2045 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ./solr.cloud.ReplicationFactorTest-CAD320064FE6F409-001/tempDir-005
> [junit4] 2> 298149 T2045 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './solr.cloud.ReplicationFactorTest-CAD320064FE6F409-001/tempDir-005/'
> [junit4] 2> 298162 T2045 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solr.cloud.ReplicationFactorTest-CAD320064FE6F409-001/tempDir-005/solr.xml
> [junit4] 2> 298171 T2045 oasc.CoreContainer.<init> New CoreContainer 125503110
> [junit4] 2> 298171 T2045 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=./solr.cloud.ReplicationFactorTest-CAD320064FE6F409-001/tempDir-005/]
> [junit4] 2> 298171 T2045 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
> [junit4] 2> 298172 T2045 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to:
> [junit4] 2> 298172 T2045 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
> [junit4] 2> 298172 T2045 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
> [junit4] 2> 298172 T2045 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
> [junit4] 2> 298173 T2045 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
> [junit4] 2> 298173 T2045 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
> [junit4] 2> 298173 T2045 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
> [junit4] 2> 298173 T2045 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
> [junit4] 2> 298174 T2045 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
> [junit4] 2> 298174 T2045 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
> [junit4] 2> 298174 T2045 oasc.CoreContainer.load Host Name: 127.0.0.1
> [junit4] 2> 298174 T2045 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:54759/solr
> [junit4] 2> 298175 T2045 oasc.ZkController.checkChrootPath zkHost includes chroot
> [junit4] 2> 298175 T2045 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
> [junit4] 2> 298177 T2126 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@73a31f20 name:ZooKeeperConnection Watcher:127.0.0.1:54759 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
> [junit4] 2> 298177 T2045 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
> [junit4] 2> 298180 T2045 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
> [junit4] 2> 298181 T2128 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@4a863bea name:ZooKeeperConnection Watcher:127.0.0.1:54759/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
> [junit4] 2> 298181 T2045 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
> [junit4] 2> 298185 T2045 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
> [junit4] 2> 298198 T2090 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
> [junit4] 2> 298198 T2067 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
> [junit4] 2> 298198 T2128 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
> [junit4] 2> 298198 T2077 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
> [junit4] 2> 298198 T2109 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
> [junit4] 2> 299187 T2045 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:38646_
> [junit4] 2> 299188 T2045 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:38646_
> [junit4] 2> 299189 T2077 oascc.ZkStateReader$3.process Updating live nodes... (4)
> [junit4] 2> 299189 T2067 oascc.ZkStateReader$3.process Updating live nodes... (4)
> [junit4] 2> 299189 T2109 oascc.ZkStateReader$3.process Updating live nodes... (4)
> [junit4] 2> 299189 T2128 oascc.ZkStateReader$3.process Updating live nodes... (4)
> [junit4] 2> 299189 T2090 oascc.ZkStateReader$3.process Updating live nodes... (4)
> [junit4] 2> 299192 T2129 oasc.ZkController.publish publishing core=collection1 state=down collection=collection1
> [junit4] 2> 299193 T2129 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
> [junit4] 2> 299193 T2067 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
> [junit4] 2> 299193 T2129 oasc.ZkController.waitForCoreNodeName look for our core node name
> [junit4] 2> 299193 T2067 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
> [junit4] 2> 299194 T2067 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
> [junit4] 2> 299194 T2068 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
> [junit4] 2> 299195 T2068 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
> [junit4] 2> "operation":"state",
> [junit4] 2> "state":"down",
> [junit4] 2> "base_url":"http://127.0.0.1:38646",
> [junit4] 2> "core":"collection1",
> [junit4] 2> "roles":null,
> [junit4] 2> "node_name":"127.0.0.1:38646_",
> [junit4] 2> "shard":null,
> [junit4] 2> "collection":"collection1",
> [junit4] 2> "numShards":"3",
> [junit4] 2> "core_node_name":null}
> [junit4] 2> 299195 T2068 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=3
> [junit4] 2> 299195 T2068 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
> [junit4] 2> 299196 T2067 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
> [junit4] 2> 299298 T2128 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
> [junit4] 2> 299298 T2067 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
> [junit4] 2> 299298 T2077 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
> [junit4] 2> 299298 T2109 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
> [junit4] 2> 299298 T2090 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
> [junit4] 2> 300194 T2129 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
> [junit4] 2> 300194 T2129 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
> [junit4] 2> 300194 T2129 oasc.ZkController.createCollectionZkNode Collection zkNode exists
> [junit4] 2> 300195 T2129 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
> [junit4] 2> 300195 T2129 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
> [junit4] 2> 300195 T2129 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './solr.cloud.ReplicationFactorTest-CAD320064FE6F409-001/tempDir-005/collection1/'
> [junit4] 2> 300196 T2129 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/solr.cloud.ReplicationFactorTest-CAD320064FE6F409-001/tempDir-005/collection1/lib/.svn/' to classloader
> [junit4] 2> 300196 T2129 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/solr.cloud.ReplicationFactorTest-CAD320064FE6F409-001/tempDir-005/collection1/lib/classes/' to classloader
> [junit4] 2> 300196 T2129 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/solr.cloud.ReplicationFactorTest-CAD320064FE6F409-001/tempDir-005/collection1/lib/README' to classloader
> [junit4] 2> 300212 T2129 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_4_10
> [junit4] 2> 300227 T2129 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
> [junit4] 2> 300227 T2129 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
> [junit4] 2> 300231 T2129 oass.IndexSchema.readSchema [collection1] Schema name=test
> [junit4] 2> 300320 T2129 oass.ByteField.init WARN ByteField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
> [junit4] 2> 300321 T2129 oass.ShortField.init WARN ShortField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
> [junit4] 2> 300321 T2129 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
> [junit4] 2> 300324 T2129 oass.IndexSchema.readSchema default search field in schema is text
> [junit4] 2> 300326 T2129 oass.IndexSchema.readSchema unique key field: id
> [junit4] 2> 300334 T2129 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
> [junit4] 2> 300336 T2129 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
> [junit4] 2> 300337 T2129 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
> [junit4] 2> 300338 T2129 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
> [junit4] 2> 300338 T2129 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
> [junit4] 2> 300338 T2129 oass.OpenExchangeR
>
> [...truncated too long message...]
>
> at java.lang.reflect.Method.invoke(Method.java:483)
> [junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1618)
> [junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:827)
> [junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
> [junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:877)
> [junit4] 2> at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
> [junit4] 2> at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
> [junit4] 2> at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
> [junit4] 2> at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
> [junit4] 2> at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
> [junit4] 2> at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
> [junit4] 2> at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
> [junit4] 2> at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
> [junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
> [junit4] 2> at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
> [junit4] 2> at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:798)
> [junit4] 2> at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:458)
> [junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:836)
> [junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:738)
> [junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:772)
> [junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:783)
> [junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
> [junit4] 2> at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
> [junit4] 2> at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
> [junit4] 2> at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
> [junit4] 2> at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
> [junit4] 2> at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
> [junit4] 2> at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
> [junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
> [junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
> [junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
> [junit4] 2> at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
> [junit4] 2> at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
> [junit4] 2> at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
> [junit4] 2> at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
> [junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
> [junit4] 2> at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
> [junit4] 2> at java.lang.Thread.run(Thread.java:745)
> [junit4] 2> 11) Thread[id=2127, name=TEST-ReplicationFactorTest.testDistribSearch-seed#[CAD320064FE6F409]-SendThread(127.0.0.1:54759), state=TIMED_WAITING, group=TGRP-ReplicationFactorTest]
> [junit4] 2> at java.lang.Thread.sleep(Native Method)
> [junit4] 2> at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:994)
> [junit4] 2> 12) Thread[id=2116, name=HashSessionScavenger-62, state=TIMED_WAITING, group=TGRP-ReplicationFactorTest]
> [junit4] 2> at java.lang.Object.wait(Native Method)
> [junit4] 2> at java.util.TimerThread.mainLoop(Timer.java:552)
> [junit4] 2> at java.util.TimerThread.run(Timer.java:505)
> [junit4] 2> 13) Thread[id=2119, name=qtp1990202290-2119 Acceptor0 SelectChannelConnector@127.0.0.1:41117, state=RUNNABLE, group=TGRP-ReplicationFactorTest]
> [junit4] 2> at org.eclipse.jetty.server.nio.SelectChannelConnector.accept(SelectChannelConnector.java:102)
> [junit4] 2> at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938)
> [junit4] 2> at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
> [junit4] 2> at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
> [junit4] 2> at java.lang.Thread.run(Thread.java:745)
> [junit4] 2> 14) Thread[id=2076, name=TEST-ReplicationFactorTest.testDistribSearch-seed#[CAD320064FE6F409]-SendThread(127.0.0.1:54759), state=TIMED_WAITING, group=TGRP-ReplicationFactorTest]
> [junit4] 2> at java.lang.Thread.sleep(Native Method)
> [junit4] 2> at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:994)
> [junit4] 2> NOTE: test params are: codec=Lucene40, sim=RandomSimilarityProvider(queryNorm=true,coord=crazy): {}, locale=es_HN, timezone=WET
> [junit4] 2> NOTE: Linux 3.8.0-42-generic amd64/Oracle Corporation 1.8.0_05 (64-bit)/cpus=8,threads=18,free=75586536,total=222298112
> [junit4] 2> NOTE: All tests run in this JVM: [TestStandardQParsers, ChaosMonkeyNothingIsSafeTest, DistributedSuggestComponentTest, TestNoOpRegenerator, TestLMDirichletSimilarityFactory, TestSolrQueryParserResource, TestRecovery, OutputWriterTest, TestSuggestSpellingConverter, TestSchemaNameResource, DOMUtilTest, TestLazyCores, TestFastWriter, TestZkChroot, TestAtomicUpdateErrorCases, DirectSolrConnectionTest, TestRandomFaceting, DistributedTermsComponentTest, TestPseudoReturnFields, TestPostingsSolrHighlighter, IndexSchemaRuntimeFieldTest, TestPhraseSuggestions, TestNonDefinedSimilarityFactory, TestBadConfig, PolyFieldTest, FullSolrCloudDistribCmdsTest, ZkSolrClientTest, SearchHandlerTest, TestReplicationHandlerBackup, TestSchemaResource, TestFieldTypeResource, UpdateRequestProcessorFactoryTest, StatsComponentTest, ShardRoutingCustomTest, DistributedQueryComponentCustomSortTest, LukeRequestHandlerTest, TestCollapseQParserPlugin, TestMiniSolrCloudCluster, TestHighlightDedupGrouping, CoreContainerCoreInitFailuresTest, TestWriterPerf, TestCoreContainer, TestStressLucene, SynonymTokenizerTest, SolrInfoMBeanTest, TestCloudManagedSchema, TestCollationField, SolrPluginUtilsTest, UniqFieldsUpdateProcessorFactoryTest, TestLRUCache, DebugComponentTest, URLClassifyProcessorTest, ReplicationFactorTest]
> [junit4] 2> NOTE: reproduce with: ant test -Dtestcase=ReplicationFactorTest -Dtests.seed=CAD320064FE6F409 -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=es_HN -Dtests.timezone=WET -Dtests.file.encoding=ISO-8859-1
> [junit4] ERROR 0.00s J1 | ReplicationFactorTest (suite) <<<
> [junit4] > Throwable #1: java.lang.Exception: Suite timeout exceeded (>= 7200000 msec).
> [junit4] > at __randomizedtesting.SeedInfo.seed([CAD320064FE6F409]:0)
> [junit4] Completed on J1 in 7223.62s, 1 test, 2 errors <<< FAILURES!
>
> [...truncated 147 lines...]
> BUILD FAILED
> /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/build.xml:467: The following error occurred while executing this line:
> /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/build.xml:447: The following error occurred while executing this line:
> /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/build.xml:45: The following error occurred while executing this line:
> /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/extra-targets.xml:37: The following error occurred while executing this line:
> /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build.xml:189: The following error occurred while executing this line:
> /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/common-build.xml:496: The following error occurred while executing this line:
> /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/common-build.xml:1299: The following error occurred while executing this line:
> /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/common-build.xml:923: There were test failures: 404 suites, 1654 tests, 1 suite-level error, 1 error, 173 ignored (15 assumptions)
>
> Total time: 169 minutes 8 seconds
> Build step 'Invoke Ant' marked build as failure
> [description-setter] Description set: Java: 64bit/jdk1.8.0_05 -XX:+UseCompressedOops -XX:+UseParallelGC
> Archiving artifacts
> Recording test results
> Email was triggered for: Failure - Any
> Sending email for trigger: Failure - Any
>
>
>
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
> For additional commands, e-mail: dev-help@lucene.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org