You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@lucene.apache.org by ma...@apache.org on 2021/03/18 20:16:54 UTC

[lucene-solr] branch reference_impl_dev updated (68a0882 -> b8f7753)

This is an automated email from the ASF dual-hosted git repository.

markrmiller pushed a change to branch reference_impl_dev
in repository https://gitbox.apache.org/repos/asf/lucene-solr.git.


 discard 68a0882  @1441 Log it for the load tests, don't kill it.
 discard 9be0632  @1440 Debug logging.
 discard 5aeb2c4  @1439 Logging cleanup and zkstatewriter use the latest replica stats exception state.
 discard 013a61b  @1438 Small tweaks for mocky tests.
 discard b662d81  @1437 State publish cache back in.
     add cf45866  @1437 State publish cache back in.
     add 8876bf7  @1438 Small tweaks for mocky tests.
     add edbf817  @1439 Logging cleanup and zkstatewriter use the latest replica stats exception state.
     add 15c0f97  @1440 Debug logging.
     add f2dcb3f  @1441 Log it for the load tests, don't kill it.
     add 2113132  @1442 Raise timeout to be more reasonable.
     add 3fb35b9  wip - workaround, create old clusterstate.json.
     add c8f7f3c  @1443 Make some more real world tweaks, allow config of per thread exec.
     add bb845ec  @1444 Disable Qos filter until it's ready.
     add 4bcf82f  @1445 Config tweaks for load.
     add 2a2d146  @1446 Stress test prep.
     add 76e5337  @1447 Clean up prep for stress test. Yeah, I know it's all still dirty, code cleanup later.
     add a2d1e27  @1448 Fix delete by count and a test. Let's stress test.
     add 6dcb8c3  @1449 Fix Overseer takeover to get latest znode version for state.json.
     add 58c138a  @1450 Write out props and some fixes.
     add 3609ee8  @1451 Turn back on large pages for fair comparison.
     add 6a76a0a  @1452 Return null in getCollectionLive on zk error.
     add d2cd114  @1453 Need collection prop too and fix race for tolerant test.
     add 169fbe7  @1454 Need to be thread safe.
     add ec7a1da  @1455 Write the collection we are interested in.
     add fbff836  @1456 Cleanup current proper waiting.
     add e85ec50  @1457 Write out cleared state updates.
     add d119b2e  @1458 Fix some issues with disordered updates.
     add 7db4993  @1459 Put in the down publish.
     add 5d7e5aa  @1460 Fix a couple NPE possibilities. Finally. Let's load test.
     add a6eb63b  @1461 Take publish down out for now for this tests and raise the lazy cache a bit.
     add caf527a  @1462 Stress tweaks.
     add c42cba5  @1463 Stress concurrency fix and tweaks.
     add 6d5b4c7  @1464 Don't screw up ids.
     add 620be61  @1465 Clean and up fixes after stress adjustment. Yes, I know, dirty still. Gotta work first.
     add a048094  @1466 Quick cleanup for visitors - my office needs the same.
     add 17f883d  @1467 Cleanup after stress work.
     add b8f7753  @1468 Stress test addressing and cleanup, bring back publish recovery and down node.

This update added new revisions after undoing existing revisions.
That is to say, some revisions that were in the old version of the
branch are not in the new version.  This situation occurs
when a user --force pushes a change and generates a repository
containing something like this:

 * -- * -- B -- O -- O -- O   (68a0882)
            \
             N -- N -- N   refs/heads/reference_impl_dev (b8f7753)

You should already have received notification emails for all of the O
revisions, and so the following emails describe only the N revisions
from the common base, B.

Any revisions marked "omit" are not gone; other references still
refer to them.  Any revisions marked "discard" are gone forever.

No new revisions were added by this update.

Summary of changes:
 solr/bin/solr                                      |    2 +
 .../client/solrj/embedded/JettySolrRunner.java     |    5 +-
 .../java/org/apache/solr/cloud/LeaderElector.java  |   10 +-
 .../src/java/org/apache/solr/cloud/Overseer.java   |  526 +++++---
 .../solr/cloud/OverseerTaskExecutorTask.java       |  103 --
 .../org/apache/solr/cloud/OverseerTaskQueue.java   |    3 +-
 .../org/apache/solr/cloud/RecoveryStrategy.java    |  142 ++-
 .../solr/cloud/ShardLeaderElectionContextBase.java |    5 +-
 .../java/org/apache/solr/cloud/StatePublisher.java |  140 ++-
 .../java/org/apache/solr/cloud/ZkController.java   |  215 ++--
 .../apache/solr/cloud/api/collections/Assign.java  |    2 +-
 .../solr/cloud/api/collections/BackupCmd.java      |    4 +-
 ...dReplicaCmd.java => CollectionCmdResponse.java} |   72 +-
 .../solr/cloud/api/collections/CreateAliasCmd.java |    4 +-
 .../cloud/api/collections/CreateCollectionCmd.java |   48 +-
 .../solr/cloud/api/collections/CreateShardCmd.java |   33 +-
 .../cloud/api/collections/CreateSnapshotCmd.java   |    4 +-
 .../solr/cloud/api/collections/DeleteAliasCmd.java |    4 +-
 .../cloud/api/collections/DeleteCollectionCmd.java |   11 +-
 .../solr/cloud/api/collections/DeleteNodeCmd.java  |   21 +-
 .../cloud/api/collections/DeleteReplicaCmd.java    |  108 +-
 .../solr/cloud/api/collections/DeleteShardCmd.java |   54 +-
 .../cloud/api/collections/DeleteSnapshotCmd.java   |    4 +-
 .../api/collections/MaintainRoutedAliasCmd.java    |    4 +-
 .../solr/cloud/api/collections/MigrateCmd.java     |    4 +-
 .../cloud/api/collections/ModifyCollectionCmd.java |    4 +-
 .../solr/cloud/api/collections/MoveReplicaCmd.java |   44 +-
 .../OverseerCollectionMessageHandler.java          |  127 +-
 .../cloud/api/collections/OverseerRoleCmd.java     |    4 +-
 .../cloud/api/collections/OverseerStatusCmd.java   |    4 +-
 .../api/collections/ReindexCollectionCmd.java      |    4 +-
 .../solr/cloud/api/collections/RenameCmd.java      |    4 +-
 .../solr/cloud/api/collections/ReplaceNodeCmd.java |   24 +-
 .../solr/cloud/api/collections/RestoreCmd.java     |    4 +-
 .../cloud/api/collections/SetAliasPropCmd.java     |    2 +-
 .../solr/cloud/api/collections/SplitShardCmd.java  |   24 +-
 .../solr/cloud/overseer/ClusterStateMutator.java   |    2 +-
 .../solr/cloud/overseer/CollectionMutator.java     |    4 +-
 .../apache/solr/cloud/overseer/NodeMutator.java    |    4 +-
 .../apache/solr/cloud/overseer/ZkStateWriter.java  |  867 +++++++------
 .../java/org/apache/solr/core/CoreContainer.java   |  274 ++---
 .../java/org/apache/solr/core/CoreDescriptor.java  |    4 +-
 .../src/java/org/apache/solr/core/SolrCore.java    |   14 +-
 .../src/java/org/apache/solr/core/SolrCores.java   |    7 +-
 .../java/org/apache/solr/handler/IndexFetcher.java |    2 +-
 .../org/apache/solr/handler/admin/ColStatus.java   |    5 +-
 .../solr/handler/admin/CollectionsHandler.java     |   23 +-
 .../apache/solr/handler/admin/PrepRecoveryOp.java  |   41 +-
 .../handler/component/RealTimeGetComponent.java    |   10 +-
 .../src/java/org/apache/solr/pkg/PackageAPI.java   |    2 +-
 .../apache/solr/rest/ManagedResourceStorage.java   |    6 +-
 .../apache/solr/schema/ZkIndexSchemaReader.java    |    3 +-
 .../java/org/apache/solr/servlet/HttpSolrCall.java |   75 +-
 .../apache/solr/servlet/SolrDispatchFilter.java    |   29 +-
 .../org/apache/solr/servlet/SolrQoSFilter.java     |   46 +-
 .../java/org/apache/solr/update/CommitTracker.java |    2 +-
 .../apache/solr/update/DefaultSolrCoreState.java   |    1 -
 .../org/apache/solr/update/SolrCmdDistributor.java |   12 +-
 .../org/apache/solr/update/SolrIndexWriter.java    |    3 +-
 .../java/org/apache/solr/update/UpdateHandler.java |    5 +-
 .../src/java/org/apache/solr/update/UpdateLog.java |    6 +-
 .../java/org/apache/solr/update/VersionInfo.java   |    2 +-
 .../processor/DistributedUpdateProcessor.java      |    4 +-
 .../processor/DistributedZkUpdateProcessor.java    |   27 +-
 .../solr/util/plugin/AbstractPluginLoader.java     |   57 +-
 .../apache/solr/HelloWorldSolrCloudTestCase.java   |    2 +-
 .../test/org/apache/solr/cloud/AddReplicaTest.java |    3 +
 .../cloud/AssignBackwardCompatibilityTest.java     |   13 +-
 .../solr/cloud/ChaosMonkeySafeLeaderTest.java      |    4 +-
 .../cloud/CloudExitableDirectoryReaderTest.java    |    2 +-
 .../solr/cloud/CollectionStateZnodeTest.java       |    3 +-
 .../apache/solr/cloud/CollectionsAPISolrJTest.java |   61 +-
 .../org/apache/solr/cloud/ConfigSetsAPITest.java   |    1 +
 .../org/apache/solr/cloud/DeleteReplicaTest.java   |   46 +-
 .../org/apache/solr/cloud/DeleteShardTest.java     |   41 +-
 .../solr/cloud/DistributedVersionInfoTest.java     |    2 +-
 .../solr/cloud/FullSolrCloudDistribCmdsTest.java   |    8 +-
 .../org/apache/solr/cloud/MoveReplicaTest.java     |    2 +-
 .../test/org/apache/solr/cloud/RecoveryZkTest.java |   28 +-
 .../apache/solr/cloud/RemoteQueryErrorTest.java    |    2 +-
 .../apache/solr/cloud/SolrCloudBridgeTestCase.java |   37 +-
 .../test/org/apache/solr/cloud/SyncSliceTest.java  |  123 +-
 .../apache/solr/cloud/TestCloudDeleteByQuery.java  |    3 +
 .../TestCloudPhrasesIdentificationComponent.java   |    1 +
 .../org/apache/solr/cloud/TestCloudRecovery.java   |   17 +-
 .../org/apache/solr/cloud/TestCloudRecovery2.java  |   18 +-
 .../solr/cloud/TestDownShardTolerantSearch.java    |    4 +-
 .../cloud/TestExclusionRuleCollectionAccess.java   |    2 +-
 .../solr/cloud/TestOnReconnectListenerSupport.java |    2 +
 .../org/apache/solr/cloud/TestPrepRecovery.java    |    7 +-
 .../org/apache/solr/cloud/TestPullReplica.java     |   86 +-
 .../apache/solr/cloud/TestRequestForwarding.java   |    1 +
 .../org/apache/solr/cloud/TestSegmentSorting.java  |    5 +-
 .../TestTolerantUpdateProcessorRandomCloud.java    |    1 +
 .../cloud/TestWaitForStateWithJettyShutdowns.java  |    2 +-
 .../api/collections/CollectionReloadTest.java      |    1 +
 .../CollectionsAPIAsyncDistributedZkTest.java      |    8 +-
 .../CollectionsAPIDistClusterPerZkTest.java        |   23 +-
 .../CreateCollectionsIndexAndRestartTest.java      |   20 +-
 .../api/collections/CustomCollectionTest.java      |   11 +-
 .../cloud/api/collections/TestCollectionAPI.java   |   22 +-
 .../TestCollectionsAPIViaSolrCloudCluster.java     |   18 +-
 .../solr/core/CachingDirectoryFactoryTest.java     |    2 +-
 .../test/org/apache/solr/core/TestConfigSets.java  |    4 +-
 .../solr/handler/PingRequestHandlerTest.java       |    2 +-
 .../solr/handler/TestSystemCollAutoCreate.java     |    2 +
 .../apache/solr/handler/V2ApiIntegrationTest.java  |    2 +-
 .../solr/handler/admin/DaemonStreamApiTest.java    |    3 +
 .../handler/admin/MetricsHistoryHandlerTest.java   |    2 +-
 .../DistributedQueryComponentOptimizationTest.java |    2 +-
 .../solr/handler/component/SearchHandlerTest.java  |    8 +-
 .../reporters/SolrJmxReporterCloudTest.java        |    2 +-
 .../org/apache/solr/rest/SolrRestletTestBase.java  |    2 +
 .../rest/schema/TestUniqueKeyFieldResource.java    |    3 +-
 .../apache/solr/schema/SchemaApiFailureTest.java   |    1 +
 .../apache/solr/schema/TestManagedSchemaAPI.java   |    2 +-
 .../org/apache/solr/search/FuzzySearchTest.java    |    2 +-
 .../search/facet/TestCloudJSONFacetJoinDomain.java |    1 +
 .../solr/search/facet/TestCloudJSONFacetSKG.java   |    1 +
 .../search/facet/TestCloudJSONFacetSKGEquiv.java   |    1 +
 .../solr/search/join/TestCloudNestedDocsSort.java  |    1 +
 .../apache/solr/search/stats/TestDistribIDF.java   |    2 +-
 .../processor/AtomicUpdateRemovalJavabinTest.java  |    1 +
 solr/server/etc/jetty-http.xml                     |    2 +-
 solr/server/etc/jetty-https.xml                    |    2 +-
 .../org/apache/solr/cli/ClusterCheckCommand.java   |    2 +-
 .../apache/solr/client/solrj/cloud/ShardTerms.java |    7 +-
 .../client/solrj/impl/BaseCloudSolrClient.java     |  218 ++--
 .../solrj/impl/ConcurrentUpdateSolrClient.java     |    2 +-
 .../solr/client/solrj/impl/Http2SolrClient.java    |   29 +-
 .../solr/client/solrj/impl/SolrClientBuilder.java  |    2 +-
 .../solrj/impl/SolrClientNodeStateProvider.java    |    2 +-
 .../solrj/impl/ZkClientClusterStateProvider.java   |    6 +-
 .../solrj/request/CollectionAdminRequest.java      |   36 +-
 .../src/java/org/apache/solr/common/ParWork.java   |    2 +-
 .../org/apache/solr/common/cloud/ClusterState.java |   16 +-
 .../solr/common/cloud/ConnectionManager.java       |    2 +-
 .../apache/solr/common/cloud/DocCollection.java    |   39 +-
 .../java/org/apache/solr/common/cloud/Replica.java |    7 +-
 .../java/org/apache/solr/common/cloud/Slice.java   |   14 +-
 .../org/apache/solr/common/cloud/SolrZkClient.java |   72 +-
 .../apache/solr/common/cloud/ZkStateReader.java    | 1290 +++++++++++---------
 .../solr/common/util/ObjectReleaseTracker.java     |    2 +-
 .../solr/common/util/SolrQueuedThreadPool.java     |    2 +-
 .../apache/solr/common/util/ValidatingJsonMap.java |    4 +-
 .../src/java/org/apache/solr/SolrTestCase.java     |    2 +
 .../apache/solr/cloud/MiniSolrCloudCluster.java    |    5 +-
 .../org/apache/solr/cloud/MockZkStateReader.java   |    8 +-
 .../src/resources/logconf/log4j2-startup-debug.xml |    3 +-
 149 files changed, 3176 insertions(+), 2586 deletions(-)
 delete mode 100644 solr/core/src/java/org/apache/solr/cloud/OverseerTaskExecutorTask.java
 rename solr/core/src/java/org/apache/solr/cloud/api/collections/{AddReplicaCmd.java => CollectionCmdResponse.java} (91%)