You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@bookkeeper.apache.org by ch...@apache.org on 2023/03/23 03:59:13 UTC
[bookkeeper] branch branch-4.16 updated (2a7fae2090 -> 97e3bb1962)
This is an automated email from the ASF dual-hosted git repository.
chenhang pushed a change to branch branch-4.16
in repository https://gitbox.apache.org/repos/asf/bookkeeper.git
discard 2a7fae2090 Use BlockingQueue.drainTo() in JournalForceWrite thread (#3545)
discard 5a02996aa2 Make the rocksDB configuration compatible with previous versions (#3523)
discard b4931cc9a8 cut branch-4.16
add cbb74eab4f Adjust log stack output (#3496)
add c9055c40e3 Create CONTRIBUTING.md (#3533)
add e313f60d48 Make the rocksDB configuration compatible with previous versions (#3523)
add 7f1842bd66 Replication throttle rate support dynamic set (#3157)
add 30bdedc25a Fix memory leak when reading entry but the connection disconnected. (#3528)
add b63cca8bbb Use BlockingQueue.drainTo() in JournalForceWrite thread (#3545)
add 5c6e78f5f4 Show content of map (#3538)
add 2e1a2f0acd Rename success with writableResult and update final writableResult about wait writeSet (#3505)
add dbec4e91ec fix close ledgerAuditorManager repeatedly (#3503)
add 3083412b1c [website]Declare the bookkeeper shell queryautorecoverystatuscommand on the web site #3536 (#3537)
add 255416a855 <Issue #3534>[website]fix website mailing_lists_url/slack_url (#3535)
add 16a4365d7d Use BlockingQueue.drainTo() in Journal thread (#3544)
add dff6d03a59 Use SingleThreadExecutor for OrderedExecutor and drainTo() tasks into local array (#3546)
add d5e86038d8 [docs] fix mistake in ledger api docs (#3566)
add c76e549fc9 fix flaky-test testWriteSetWriteableCheck (#3555)
add 1966512a21 Update website to record the RocksDB configuration changes (#3540)
add 9d17efa431 [website][fix]Repair `sequential nodes` address (#3569)
add cfc6b9770f skipping placementPolicyCheck when ledger replication disabled (#3561)
add c97b57635b Flush time started moved to after lock (#3570)
add a58f11ff13 Change masterKeyCache to dynamic size (#3522)
add ec79daa6c7 Single thread executor should not have max capacity by default (#3575)
add 1704ca43d6 skip replicasCheck when replication disabled (#3563)
add e169cbd3f5 Add new api resumeCompaction and suspendCompaction to support resume and suspend compaction through api (#3509)
add 3a4af4a806 remove unused variable in checkEnvironment (#3572)
add da4583e939 [configuration] fix typo in bk_server.conf (#3574)
add e50cf06ce2 Add example for multiple server list in metadataServiceUri configuration (#3580)
add b7af1e9240 [doc]Fixed incorrect checkstyle configuration prompts (#3571)
add 4c79215af5 Fix the typo of double the (#3552)
add 520c3e4419 [test] Fix flaky test testAutoRecoverySessionLoss (#3576)
add 5a9fb5ff44 Replace sleep with await to avoid flaky test in SlowBookieTest (#3581)
add ace4f8a4a3 Upgrade dependencies for CVE-2022-3171 and CVE-2022-42003 (#3579)
add ef31c7a374 When call openLedgerOp, make the timeout ex is a separate error code (#3562)
add 8ac28db161 Issue 3588: write meta to log header before fsync in DirectIO mode (#3589)
add ca922fed05 Fix typo issue when Header.assertFingerPrint throws IOException (#3590)
add 75a293b77c add javadoc comments for test classes (#3587)
add 9efd606d1c Correct link class name (#3594)
add 96b2446b35 fix memtable getEntryStats typo (#3592)
add 02be9d2ee2 Avoid extra buffer to prepend frame size (#3560)
add faaf041ac5 Fix ByteBuf memory leak problem when setExplicitLac (#3577)
add e6722848e0 Optimized debug log enable (#3596)
add 6e7ff78e7c Fix readEntryStats typo (#3591)
add 9843ad62c9 Add ByteBuf refCnt test for AddEntry and use pooled ByteBuf reduce heap usage (#3598)
add 2c5d98ebbe Removed the necessity of SafeRunnable (#3593)
add b82e2247e6 Allow to use IO uring instead of epoll (#3595)
add 396ec12dc7 Optimize ReadResponse for small entry sizes (#3597)
add 5724bc8434 Using a separate thread pool to execute openWithMetadata (#3548)
add 860d40d58c update doc about flushInterval config (#3601)
add 43bdfb3531 migrate apply-config-from-env.py from python2 to python3 (#3614)
add 8357e4b00f [log] Add journal file path that caused failure in multi-journal config (#3623)
add 74e9ef4d73 Fix GetBookieInfo failed event stats (#3622)
add 94f247c5a3 Upgrade maven version in release docker image (#3625)
add 830116280f Issue #3488 Create an EmbeddedSever extracting code from Main class and adding a builder pattern (#3489)
add a9d40822af Include bkperf into bk all package (#3632)
add f8b9e1886d Use LinkedHashMap instead of HashMap to fix flaky tests due non-deterministic order (#3551)
add 0d2fbe434e Apply recycle logic during add entry creation but ledger close to LedgerHandleAdv (#3621)
add 0f37dd8756 Add 4.15.3 relese note (#3602)
add 17dbd50296 Generate 4.15.3 website docs (#3635)
add fbad323775 Upgrade docker image version to fix CVEs (#3640)
add e4ef0ef7f4 [website] Fix releases page header and move latest release to 4.15.3 (#3645)
add a3401a2139 make rocksdb delete entries batch size configurable (#3646)
add 696919cccb bring back deleteRange for RocksDB to improve location delete performance (#3653)
add 034e8997ab bookkeeper-daemon script supports restart command (#3649)
add 948d94fb65 Dont validate CompactionInterval when compaction is disabled (#3664)
add 221cba4ed3 Check client if closed when complete callback. (#3661)
add 7d44414484 sync depedency version with source version in license (#3633)
add c2e59e1411 Add Http-service to check bookie sanity state (#3630)
add 145ab15894 fix testWriteLac (#3627)
add 381af55b69 Include com.google.guava:failureaccess in shaded package (#3624)
add aa6d3f9efe Run CI when a pull request contains doc changes (#3671)
add dd8ba477ee Exit bookkeeper shell correctly even if fails to run for some reason (#3663)
add 109688c1b4 [fix][server]fix memory leak when operating ledger metadata (#3662)
add 25f03a046b InterleavedLedgerStorage: safe release ByteBuf (#3674)
add 8fce024989 [refactor][bookkeeper] Refactor ByteBuf release method in DefaultEntryLogger (#3673)
add 01232c94c9 Enhance simple test (#3675)
add ac7e9092ae clean code: remove unused gcExecutor (#3682)
add f186d2a0a2 module bookkeeper-server: refactor ByteBuf release usage (#3688)
add 324b8d43ab [refactor][bookkeeper] Refactor ByteBuf release method in stream/statelib (#3689)
add 542926c163 remove unused attempts (#3685)
add 9d8b922708 Add an argument to decide expose the default JVM metrics (#3676)
add 7ae5a04a83 module distributedlog-core: refactor ByteBuf release usage (#3691)
add e13ff85234 refactor ByteBuf release usage (#3687)
add 394ff12dc1 Show result of isFenced in log (#3678)
add eda9c4284d use READ_ENTRY_SCHEDULING_DELAY to stable stickyReadsWithFailures (#3628)
add 4574ba0233 Fix RegionAwareEnsemblePlacementPolicy update rack info problem. (#3666)
add 5a38080ccf Make `jvm_memory_direct_bytes_used` metrics compatible with jdk8. (#3677)
add a19d849a37 [fix][server]fix memory leak when closeRecovered,failed on clearing newEnsemblesFromRecovery (#3672)
add a71c7a7e68 module distributedlog-common/distributedlog-protocol: refactor ByteBuf release usage (#3693)
add 4e37cf68d1 module stream-storage-common/stream-storage-java-kv-client/stream-storage-cli: refactor ByteBuf release usage (#3694)
add 004dfa86bf refactor ByteBuf release usage (#3695)
add c67dfb9733 Issue #3701 Fixed Flaky Tests (#3702)
add 44edbd10b7 fix docker compose deployment (#3660)
add dd80e967e7 [fix][server] When dbStorage_directIOEntryLogger=true, EntryLogIdsImpl only takes effect for a single ledger directory (#3680)
add 5194c5bbd6 [refactor][bookkeeper] Refactor ByteBuf release method in stream/storage (#3703)
add 700c5281e8 [refactor][bookkeeper] Refactor ByteBuf release method in bookkeeper-server (#3700)
add c31e3997ba refactor ByteBuf release usage (#3698)
add 1ce1bedfbf Added new way to self-invite to BK Slack (#3712)
add 032aef7e75 [FEATURE] Added api/v1/bookie/cluster_info REST API
add 405e72acf4 unify SLASHSTAR_STYLE for licenses in Java files (#3717)
add 03ba1883df Expose registrationClient in DefaultBookieAddressResolver (#3724)
add 05378442f7 [improve][doc] improve bk_server.conf docs (#3715)
add ce229a4ce0 Add 4.14.6 release note (#3659)
add c64dbcd305 Upgrade Netty to 4.1.86.Final (#3669)
add 49ca9fe3b1 BP-60:Change PCBC limitStatsLogging default value to true (#3719)
add 4fd5f814dd [docs] update parameter in manual deployment page (#3573)
add b5f85e0d1d Bump json5 from 1.0.1 to 1.0.2 in /site3/website (#3727)
add 2536a580dd Generate 4.14.6 website docs (#3729)
add 9e8cda30d4 Bump loader-utils from 1.4.0 to 1.4.2 in /site3/website (#3648)
add 7b5b6b240c CI: move all tests in a single workflow (#3735)
add e7636086ed unify SLASHSTAR_STYLE for licenses in Java files (#3741)
add 8ea2234183 Update copy right year from 2022 to 2023 (#3742)
add a2b0709627 Bump hadoop-common from 3.2.4 to 3.3.4 (#3756)
add dbf682d76c Remove unnecessary hasExplicitLac check (#3748)
add c7cc668230 Add code coverage report and upload to Codecov (#3586)
add accaa6966f Bump snakeyaml from 1.32 to 1.33 (#3757)
add f6a7c0617c Add push trigger condition for CI (#3760)
add 901f76ce4c Fix QueueEntry recycle problem. (#3747)
add 02e64a4b97 [improve] Upgrade zk to 3.8.1 (#3754)
add af82d14cb1 Fix memory leak when the Bookie is in read-only mode. (#3746)
add 700d45f435 Replace LedgerStorageNotificationListener with existing LedgerDeletionListener (#3736)
add 61c553b9a8 Bump http-cache-semantics from 4.1.0 to 4.1.1 in /site3/website (#3765)
add 4ca4b4e484 Fix issue where checkAllLedgers could get stuck when read throttling is enabled (#3655)
add b85ac48e8b BookieImpl remove wait until journal quits (#3603)
add 7303cf1af3 Upgrade Netty to 4.1.87.Final (#3766)
add 3068b2ae92 Upgrade dependency-check-maven plugin to fix broken OWASP check (#3731)
add cec8267682 recycle LongPairWrapper (#3728)
add 591ceb971a fix admin rest api typo (#3776)
add b9a82c54c7 Remove duplicated JournalQueueStats (#3753)
add 6489a7d419 Fix numLedgersReplicated metric (#3654)
add d6d9212a64 Not wrap IOException twice form checkpoint (#3683)
add c217385ea4 [improvement] Refactor Auditor to simplify the readability (#3637)
add 1162512fd8 Fix missing blank in log text (#3781)
add 7f8c31bdad New ensemble choose different rack first. (#3721)
add 2381d9b65a Fix RegionAwareEnsemblePlacementPolicy.newEnsemble sometimes failed problem. (#3725)
add 10daf4cd4d Generate 4.14.7 release note (#3770)
add 5726e8f1c0 generate 4.14.7 website docs (#3787)
add 13ccc4caf8 Only acquire buffer when need write. (#3786)
add e0fd93a4bc Bump vertx-web from 4.3.2 to 4.3.8 (#3775)
add 6b6ea76201 Fix CI is not failed when test have errors (#3790)
add 5fced0d434 change directIO configuration names to avoid confuse (#3791)
add c295f1880f Made PendingAddOp thread safe (#3784)
add 9ff2954430 Add logs for ensemble select failed (#3779)
add 58cdd499c6 Make profile code-coverage and dev-debug tests using `-Dio.netty.leakDetection.level=paranoid`. (#3785)
add 80d3aac30f upgrade rocksdb version to 7.9.2 (#3795)
add 8d922634c7 Fixed locking of PendingAddOp (#3806)
add 7f263fa8f4 Fixed the pivot selection in the group quick-sort (#3800)
add 08ef6491a6 Fix ReadEntryProcessor v2 SchedulingDelayStats (#3758)
add f65b72d54b Use mixed quick/insertion sort (#3807)
add 1f8de8ffa2 Improved efficiency in DigestManager.verify() (#3810)
add 1e02853485 Avoid thread-local state when computing CRCs (#3811)
add 6f09c60d2c Upgrade lombok to 1.18.26 (#3814)
add c389b96f12 Speed up shutdown in test cases (#3809)
add 284cf9611a Remove compiling with `-Werror` to support Java 19 (#3820)
add e0ee708269 Support update ledger metadata option bk-cli (#3821)
add ade30bda19 Fix: bookie-shell ledger-metadata usage with correct param (#3822)
add 0ca4fe2697 Fix: typo for ledger-metadata param: restorefromfile (#3823)
add 6d00336728 fix mailing-lists dead links (#3804)
add b70d128ad0 Upgrade Netty to 4.1.89.Final (#3816)
add fbd18aeeca Use JNI directly for posix_fadvise (#3824)
add a96317e353 Update testcontainers to last version to support m1 (#3819)
add 73294ce00f Fixed back API of Crc32cIntChecksum (#3826)
add 3dcd8d5869 Remove callback threadpool for sending add responses (#3825)
add 7852db6059 remove unused 'close ledger manager' comment (#3827)
add 227b166018 Support build in the aarch64 linux platform (#3828)
add 20aad8006e Avoid using thread-local WriteSet when possible (#3829)
add b4112dfdbf Fix Spotbugs check failed (#3836)
add dfde3d6836 Pass BookieRequestHandler instead of Channel to the request processors (#3835)
add 128c52eeff Simplified the logic for ForceWriteThread after we introduced queue.drainTo() (#3830)
add 3199fbe4d6 Add directIO entry logger settings documents (#3789)
add 3844bf128c Make RrocksDB checksum type configurable (#3793)
add bf5a6aabb6 BP61: revert BP-59 to release ByteBuf using ReferenceCountUtil.release() instead of ReferenceCountUtil.safeRelease() (#3796)
add 1bd1745742 fix website deploy build failed (#3841)
add 73c5a0e011 Added BatchedArrayBlockingQueue (#3838)
add 08c3138aeb Add num not adhering placement ledgers replicated metric for ReplicationWorker (#3652)
add d6748f915d Group and flush add-responses after journal sync (#3837)
add 5703132316 Fix memory leak issue of reading small entries (#3844)
add 09365dfdd8 Make read entry request recyclable (#3842)
add f9313195f0 Avoid unnecessary force write. (#3847)
add caddb6ee5b Correct the running job name for the test group (#3851)
add 0a21dd5387 add timeout for two flaky timeout tests (#3855)
add 3a488150e9 add V2 protocal and warmupMessages support for benchMark (#3856)
add cd43c91add disable trimStackTrack for code-coverage profile (#3854)
add 06c3cabde7 Fix bkperf log directory not found (#3858)
add 263d8cc32e [improve] Fix indexDirs upgrade failed (#3762)
add 1a8d84251b Bump checkstyle-plugin from 3.1.2 to 3.2.1 (#3850)
add caea6c9451 [Flaky] Fix flaky test in testRaceGuavaEvictAndReleaseBeforeRetain (#3857)
add ebf3108d54 Fix NPE in BenchThroughputLatency (#3859)
add 0bc1785134 Update website to 4.15.4 (#3862)
add 5542afe6b6 change rocksDB config level_compaction_dynamic_level_bytes to CFOptions (#3860)
add 8ea5590e78 Correct the running job flag for the test group. (#3865)
add ea04926a0a Release note for 4.15.4 (#3831)
add 0fa39b6236 Add trigger entry location index rocksDB compact interface. (#3802)
add 915deb035b Pick the higher leak detection level between netty and bookkeeper. (#3794)
add 8aee66a2f7 Disable code coverage and codecov report (#3863)
add 2fad33bfcf Add small files check in garbage collection (#3631)
add ed542b9636 [improvement] Delay all audit task when have a already delayed bookie check task (#3818)
add a633ec4bd8 Change order of doGcLedgers and extractMetaFromEntryLogs (#3869)
add c3e5bfe431 [Bugfix] make metadataDriver initialization more robust (#3873)
add dda42a3a33 Enable CI for the streamstorage python client (#3875)
add e19cb9d822 Fix compaction threshold default value precision problem. (#3871)
add 234b817cdb Single buffer for small add requests (#3783)
add b3aca10dea Add log for entry log file delete. (#3872)
add e3c24ae138 Improve group and flush add-responses after journal sync (#3848)
add 9fe07bb1fd Add V2 protocol support for BenchReadThroughputLatency (#3878)
add 97e3bb1962 Use BatchedArrayBlockingQueue in Journal (#3843)
This update added new revisions after undoing existing revisions.
That is to say, some revisions that were in the old version of the
branch are not in the new version. This situation occurs
when a user --force pushes a change and generates a repository
containing something like this:
* -- * -- B -- O -- O -- O (2a7fae2090)
\
N -- N -- N refs/heads/branch-4.16 (97e3bb1962)
You should already have received notification emails for all of the O
revisions, and so the following emails describe only the N revisions
from the common base, B.
Any revisions marked "omit" are not gone; other references still
refer to them. Any revisions marked "discard" are gone forever.
No new revisions were added by this update.
Summary of changes:
.github/changes-filter.yaml | 16 +
.github/workflows/backward-compat-tests.yml | 81 -
.github/workflows/bk-ci.yml | 473 +++++
...-validation.yml => bk-streamstorage-python.yml} | 73 +-
.github/workflows/bookie-tests.yml | 98 -
.github/workflows/client-tests.yml | 89 -
.github/workflows/compatibility-check-java11.yml | 75 -
.github/workflows/compatibility-check-java17.yml | 74 -
.github/workflows/compatibility-check-java8.yml | 75 -
.github/workflows/integration-tests.yml | 85 -
.github/workflows/macos-build.yml | 69 -
.github/workflows/owasp-dep-check.yml | 85 -
.github/workflows/remaining-tests.yml | 91 -
.github/workflows/replication-tests.yml | 90 -
.github/workflows/stream-tests.yml | 93 -
.github/workflows/tls-tests.yml | 90 -
.github/workflows/website-deploy.yaml | 5 +
.github/workflows/website-pr-validation.yml | 5 +
.github/workflows/windows-build.yml | 74 -
.gitignore | 2 +
CONTRIBUTING.md | 25 +
NOTICE | 2 +-
README.md | 2 +-
bin/bkperf | 2 +
bin/bookkeeper-daemon.sh | 140 +-
.../benchmark/BenchReadThroughputLatency.java | 5 +
.../benchmark/BenchThroughputLatency.java | 21 +-
.../common/allocator/ByteBufAllocatorBuilder.java | 2 +-
.../allocator/ByteBufAllocatorWithOomHandler.java | 2 +-
.../common/allocator/LeakDetectionPolicy.java | 19 +-
.../common/allocator/OutOfMemoryPolicy.java | 2 +-
.../bookkeeper/common/allocator/PoolingPolicy.java | 2 +-
.../impl/ByteBufAllocatorBuilderImpl.java | 2 +-
.../allocator/impl/ByteBufAllocatorImpl.java | 2 +-
.../common/allocator/impl/package-info.java | 2 +-
.../bookkeeper/common/allocator/package-info.java | 2 +-
.../impl/ByteBufAllocatorBuilderTest.java | 15 +-
bookkeeper-common/pom.xml | 15 +
.../collections/BatchedArrayBlockingQueue.java | 409 +++++
.../common/collections/BatchedBlockingQueue.java | 49 +-
.../common/collections/BlockingMpscQueue.java | 41 +-
...=> GrowableMpScArrayConsumerBlockingQueue.java} | 208 +--
.../component/AutoCloseableLifecycleComponent.java | 1 +
.../common/component/ComponentInfoPublisher.java | 1 +
.../bookkeeper/common/concurrent/FutureUtils.java | 6 +-
.../bookkeeper/common/conf/package-info.java | 2 +-
.../bookkeeper/common/stats/OpStatsListener.java | 2 +-
.../bookkeeper/common/stats/package-info.java | 2 +-
.../common/util/BoundedExecutorService.java | 2 +-
.../util/BoundedScheduledExecutorService.java | 2 +-
.../common/util/ExceptionMessageHelper.java | 2 +-
.../common/util/MemoryLimitController.java | 2 +-
.../bookkeeper/common/util/OrderedExecutor.java | 123 +-
.../bookkeeper/common/util/OrderedScheduler.java | 81 +-
.../bookkeeper/common/util/ReferenceCounted.java | 1 +
.../common/util/SingleThreadExecutor.java | 305 ++++
.../SingleThreadSafeScheduledExecutorService.java | 74 +
.../java/org/apache/bookkeeper/util/MathUtils.java | 2 +-
.../org/apache/bookkeeper/util/package-info.java | 2 +-
...est.java => BatchedArrayBlockingQueueTest.java} | 137 +-
.../GrowableArrayBlockingQueueTest.java | 76 +-
.../common/concurrent/TestFutureUtils.java | 7 +-
.../common/testing/annotations/FlakyTest.java | 1 +
.../common/util/MemoryLimitControllerTest.java | 2 +-
.../common/util/TestOrderedExecutorDecorators.java | 9 +-
.../common/util/TestSingleThreadExecutor.java | 319 ++++
bookkeeper-dist/all/pom.xml | 6 +
bookkeeper-dist/src/assemble/bin-all.xml | 2 +-
bookkeeper-dist/src/assemble/bin-server.xml | 2 +-
bookkeeper-dist/src/assemble/bkctl.xml | 2 +-
.../src/main/resources/LICENSE-all.bin.txt | 235 +--
.../src/main/resources/LICENSE-bkctl.bin.txt | 215 +--
.../src/main/resources/LICENSE-server.bin.txt | 233 +--
.../src/main/resources/NOTICE-all.bin.txt | 46 +-
.../src/main/resources/NOTICE-bkctl.bin.txt | 42 +-
.../src/main/resources/NOTICE-server.bin.txt | 46 +-
.../LICENSE.aalto-xml.txt | 2 +-
.../LICENSE.base64.txt | 0
.../LICENSE.bouncycastle.txt | 2 +-
.../LICENSE.caliper.txt | 4 +-
.../LICENSE.commons-lang.txt | 2 +-
.../LICENSE.commons-logging.txt | 2 +-
.../LICENSE.compress-lzf.txt | 2 +-
.../LICENSE.dnsinfo.txt | 2 +-
.../LICENSE.harmony.txt | 2 +-
.../LICENSE.hpack.txt | 4 +-
.../LICENSE.hyper-hpack.txt | 0
.../LICENSE.jboss-marshalling.txt | 2 +-
.../LICENSE.jbzip2.txt | 0
.../LICENSE.jctools.txt | 2 +-
.../LICENSE.jfastlz.txt | 0
.../LICENSE.jsr166y.txt | 0
.../LICENSE.jzlib.txt | 0
.../LICENSE.libdivsufsort.txt | 0
.../LICENSE.log4j.txt | 2 +-
.../LICENSE.lz4.txt | 4 +-
.../LICENSE.lzma-java.txt | 4 +-
.../LICENSE.mvn-wrapper.txt | 4 +-
.../LICENSE.nghttp2-hpack.txt | 0
.../LICENSE.protobuf.txt | 0
.../LICENSE.slf4j.txt | 0
.../LICENSE.snappy.txt | 0
.../LICENSE.webbit.txt | 2 +-
.../NOTICE.harmony.txt | 2 +-
.../http/AbstractHttpHandlerFactory.java | 2 +-
.../org/apache/bookkeeper/http/HttpRouter.java | 15 +-
.../org/apache/bookkeeper/http/HttpServer.java | 9 +-
.../bookkeeper/http/HttpServerConfiguration.java | 2 +-
.../apache/bookkeeper/http/HttpServerLoader.java | 2 +-
.../bookkeeper/http/HttpServiceProvider.java | 2 +-
.../bookkeeper/http/NullHttpServiceProvider.java | 2 +-
.../bookkeeper/http/service/ErrorHttpService.java | 2 +-
.../bookkeeper/http/service/HeartbeatService.java | 2 +-
.../http/service/HttpEndpointService.java | 2 +-
.../http/service/HttpServiceRequest.java | 2 +-
.../http/service/HttpServiceResponse.java | 2 +-
.../bookkeeper/http/service/NullHttpService.java | 2 +-
.../http/servlet/BookieHttpServiceServlet.java | 2 +-
.../http/servlet/BookieServletHttpServer.java | 2 +-
.../bookkeeper/http/servlet/JettyHttpServer.java | 2 +-
.../http/servlet/TestBookieHttpServiceServlet.java | 2 +-
.../http/vertx/VertxAbstractHandler.java | 2 +-
.../http/vertx/VertxHttpHandlerFactory.java | 2 +-
.../bookkeeper/http/vertx/VertxHttpServer.java | 2 +-
.../bookkeeper/http/vertx/TestVertxHttpServer.java | 2 +-
.../http/vertx/TestVertxHttpsServer.java | 2 +-
bookkeeper-proto/src/main/proto/DataFormats.proto | 2 +-
.../main/proto/DbLedgerStorageDataFormats.proto | 2 +-
bookkeeper-server/pom.xml | 8 +-
.../org/apache/bookkeeper/auth/AuthCallbacks.java | 2 +-
.../auth/AuthProviderFactoryFactory.java | 2 +-
.../java/org/apache/bookkeeper/auth/AuthToken.java | 2 +-
.../bookkeeper/auth/BookKeeperPrincipal.java | 2 +-
.../apache/bookkeeper/auth/BookieAuthProvider.java | 2 +-
.../apache/bookkeeper/auth/ClientAuthProvider.java | 2 +-
.../bookkeeper/bookie/AbstractLogCompactor.java | 2 +-
.../bookkeeper/bookie/BookKeeperServerStats.java | 4 -
.../bookkeeper/bookie/BookieCriticalThread.java | 2 +-
.../bookkeeper/bookie/BookieFileChannel.java | 2 +-
.../org/apache/bookkeeper/bookie/BookieImpl.java | 92 +-
.../apache/bookkeeper/bookie/BookieResources.java | 2 +-
.../org/apache/bookkeeper/bookie/BookieShell.java | 88 +-
.../bookkeeper/bookie/BookieStateManager.java | 2 +-
.../org/apache/bookkeeper/bookie/BookieStatus.java | 10 +-
.../org/apache/bookkeeper/bookie/BookieThread.java | 2 +-
.../apache/bookkeeper/bookie/BufferedChannel.java | 2 +-
.../bookkeeper/bookie/BufferedChannelBase.java | 2 +-
.../java/org/apache/bookkeeper/bookie/Cookie.java | 2 +-
.../apache/bookkeeper/bookie/CookieValidation.java | 2 +-
.../bookkeeper/bookie/DefaultEntryLogger.java | 11 +-
.../bookkeeper/bookie/EntryLogCompactor.java | 2 +-
.../apache/bookkeeper/bookie/EntryLogManager.java | 2 +-
.../bookkeeper/bookie/EntryLogManagerBase.java | 6 +-
.../EntryLogManagerForEntryLogPerLedger.java | 8 +-
.../bookie/EntryLogManagerForSingleEntryLog.java | 2 +-
.../apache/bookkeeper/bookie/EntryLogMetadata.java | 4 +-
.../bookkeeper/bookie/EntryLoggerAllocator.java | 2 +-
.../bookie/EntryMemTableWithParallelFlusher.java | 52 +-
.../bookkeeper/bookie/FileChannelProvider.java | 2 +-
.../bookkeeper/bookie/FileInfoBackingCache.java | 2 +-
.../bookkeeper/bookie/FileSystemUpgrade.java | 15 +-
.../bookkeeper/bookie/GarbageCollectionStatus.java | 2 +-
.../apache/bookkeeper/bookie/GarbageCollector.java | 2 +-
.../bookkeeper/bookie/GarbageCollectorThread.java | 45 +-
.../bookie/InMemoryEntryLogMetadataMap.java | 2 +-
.../bookkeeper/bookie/IndexInMemPageMgr.java | 2 +-
.../bookkeeper/bookie/IndexPersistenceMgr.java | 2 +-
.../bookie/InterleavedLedgerStorage.java | 39 +-
.../InterleavedStorageRegenerateIndexOp.java | 2 +-
.../java/org/apache/bookkeeper/bookie/Journal.java | 524 +++---
.../apache/bookkeeper/bookie/JournalChannel.java | 6 +-
.../bookie/LastAddConfirmedUpdateNotification.java | 2 +-
.../bookkeeper/bookie/LedgerDirsManager.java | 2 +-
.../bookkeeper/bookie/LedgerDirsMonitor.java | 12 +-
.../apache/bookkeeper/bookie/LedgerStorage.java | 45 +
.../bookkeeper/bookie/LegacyCookieValidation.java | 2 +-
.../apache/bookkeeper/bookie/ReadOnlyBookie.java | 2 +-
.../bookie/ScanAndCompareGarbageCollector.java | 2 +-
.../apache/bookkeeper/bookie/ScrubberStats.java | 2 +-
.../apache/bookkeeper/bookie/SkipListArena.java | 2 +-
.../bookkeeper/bookie/SortedLedgerStorage.java | 30 +
.../org/apache/bookkeeper/bookie/SyncThread.java | 2 +-
.../bookie/datainteg/EntryCopierImpl.java | 3 +-
.../bookie/stats/EntryMemTableStats.java | 3 +-
.../bookkeeper/bookie/stats/JournalStats.java | 30 -
.../bookie/storage/CompactionEntryLog.java | 2 +-
.../bookkeeper/bookie/storage/EntryLogIds.java | 2 +-
.../bookkeeper/bookie/storage/EntryLogIdsImpl.java | 2 +-
.../bookkeeper/bookie/storage/EntryLogScanner.java | 2 +-
.../bookkeeper/bookie/storage/EntryLogger.java | 2 +-
.../bookie/storage/directentrylogger/Buffer.java | 4 +-
.../storage/directentrylogger/BufferPool.java | 2 +-
.../DirectCompactionEntryLog.java | 2 +-
.../directentrylogger/DirectEntryLogger.java | 5 +-
.../directentrylogger/DirectEntryLoggerStats.java | 2 +-
.../storage/directentrylogger/DirectReader.java | 12 +-
.../storage/directentrylogger/DirectWriter.java | 5 +-
.../bookie/storage/directentrylogger/Events.java | 2 +-
.../bookie/storage/directentrylogger/Header.java | 8 +-
.../storage/directentrylogger/LogMetadata.java | 15 +-
.../storage/directentrylogger/LogReader.java | 2 +-
.../storage/directentrylogger/LogReaderScan.java | 5 +-
.../storage/directentrylogger/LogWriter.java | 2 +-
.../directentrylogger/WriterWithMetadata.java | 2 +-
.../bookie/storage/ldb/ArrayGroupSort.java | 104 +-
.../bookkeeper/bookie/storage/ldb/ArrayUtil.java | 2 +-
.../bookie/storage/ldb/DbLedgerStorage.java | 96 +-
.../bookie/storage/ldb/DbLedgerStorageStats.java | 3 +-
.../bookie/storage/ldb/EntryLocationIndex.java | 90 +-
.../bookie/storage/ldb/KeyValueStorage.java | 12 +-
.../bookie/storage/ldb/KeyValueStorageFactory.java | 2 +-
.../bookie/storage/ldb/KeyValueStorageRocksDB.java | 59 +-
.../bookie/storage/ldb/LedgerMetadataIndex.java | 26 +-
.../bookie/storage/ldb/LedgersIndexCheckOp.java | 2 +-
.../bookie/storage/ldb/LedgersIndexRebuildOp.java | 2 +-
.../storage/ldb/LocationsIndexRebuildOp.java | 10 +-
.../bookie/storage/ldb/LongPairWrapper.java | 2 +-
.../bookkeeper/bookie/storage/ldb/LongWrapper.java | 2 +-
.../storage/ldb/PersistentEntryLogMetadataMap.java | 2 +-
.../bookkeeper/bookie/storage/ldb/ReadCache.java | 5 +-
.../ldb/SingleDirectoryDbLedgerStorage.java | 105 +-
.../bookie/storage/ldb/TransientLedgerInfo.java | 2 +-
.../bookkeeper/bookie/storage/ldb/WriteCache.java | 11 +-
.../bookie/storage/ldb/package-info.java | 2 +-
.../apache/bookkeeper/client/AsyncCallback.java | 2 +-
.../org/apache/bookkeeper/client/BKException.java | 2 +-
.../org/apache/bookkeeper/client/BookKeeper.java | 14 +-
.../apache/bookkeeper/client/BookKeeperAdmin.java | 24 +-
.../client/BookieAddressResolverDisabled.java | 2 +-
.../apache/bookkeeper/client/BookieInfoReader.java | 2 +-
.../apache/bookkeeper/client/BookieWatcher.java | 2 +-
.../bookkeeper/client/BookieWatcherImpl.java | 2 +-
.../bookkeeper/client/BookiesHealthInfo.java | 2 +-
.../apache/bookkeeper/client/BookiesListener.java | 2 +-
.../client/DefaultBookieAddressResolver.java | 12 +-
.../bookkeeper/client/DistributionSchedule.java | 14 +-
.../bookkeeper/client/ExplicitLacFlushPolicy.java | 16 +-
.../apache/bookkeeper/client/ForceLedgerOp.java | 7 +-
.../apache/bookkeeper/client/LedgerChecker.java | 13 +-
.../apache/bookkeeper/client/LedgerCreateOp.java | 8 +-
.../apache/bookkeeper/client/LedgerFragment.java | 2 +-
.../client/LedgerFragmentReplicator.java | 34 +-
.../org/apache/bookkeeper/client/LedgerHandle.java | 197 +-
.../apache/bookkeeper/client/LedgerHandleAdv.java | 15 +-
.../bookkeeper/client/LedgerMetadataBuilder.java | 2 +-
.../bookkeeper/client/LedgerMetadataImpl.java | 2 +-
.../bookkeeper/client/LedgerMetadataUtils.java | 2 +-
.../org/apache/bookkeeper/client/LedgerOpenOp.java | 40 +-
.../apache/bookkeeper/client/LedgerRecoveryOp.java | 4 +-
.../bookkeeper/client/MetadataUpdateLoop.java | 21 +-
.../org/apache/bookkeeper/client/PendingAddOp.java | 97 +-
.../apache/bookkeeper/client/PendingReadLacOp.java | 2 +-
.../apache/bookkeeper/client/PendingReadOp.java | 5 +-
.../bookkeeper/client/PendingWriteLacOp.java | 12 +-
.../RackawareEnsemblePlacementPolicyImpl.java | 46 +-
.../client/ReadLastConfirmedAndEntryOp.java | 2 +-
.../bookkeeper/client/ReadLastConfirmedOp.java | 2 +-
.../bookkeeper/client/ReadOnlyLedgerHandle.java | 18 +-
.../client/RegionAwareEnsemblePlacementPolicy.java | 85 +-
.../client/RoundRobinDistributionSchedule.java | 20 +-
.../bookkeeper/client/SyncCallbackUtils.java | 6 +-
.../TopologyAwareEnsemblePlacementPolicy.java | 6 +-
.../bookkeeper/client/TryReadLastConfirmedOp.java | 2 +-
.../apache/bookkeeper/client/UpdateLedgerOp.java | 2 +-
.../client/ZoneawareEnsemblePlacementPolicy.java | 2 +-
.../ZoneawareEnsemblePlacementPolicyImpl.java | 4 +-
.../apache/bookkeeper/client/api/BookKeeper.java | 2 +-
.../bookkeeper/client/api/BookKeeperBuilder.java | 2 +-
.../bookkeeper/client/api/CreateAdvBuilder.java | 2 +-
.../bookkeeper/client/api/CreateBuilder.java | 2 +-
.../bookkeeper/client/api/DeleteBuilder.java | 2 +-
.../apache/bookkeeper/client/api/DigestType.java | 2 +-
.../bookkeeper/client/api/ForceableHandle.java | 2 +-
.../org/apache/bookkeeper/client/api/Handle.java | 2 +-
.../client/api/LastConfirmedAndEntry.java | 2 +-
.../bookkeeper/client/api/LedgerEntries.java | 2 +-
.../apache/bookkeeper/client/api/LedgerEntry.java | 2 +-
.../client/api/ListLedgersResultBuilder.java | 2 +-
.../apache/bookkeeper/client/api/OpBuilder.java | 2 +-
.../apache/bookkeeper/client/api/OpenBuilder.java | 2 +-
.../apache/bookkeeper/client/api/ReadHandle.java | 4 +-
.../bookkeeper/client/api/WriteAdvHandle.java | 2 +-
.../apache/bookkeeper/client/api/WriteFlag.java | 2 +-
.../apache/bookkeeper/client/api/WriteHandle.java | 2 +-
.../apache/bookkeeper/client/api/package-info.java | 2 +-
.../client/impl/BookKeeperBuilderImpl.java | 2 +-
.../client/impl/LastConfirmedAndEntryImpl.java | 2 +-
.../bookkeeper/conf/AbstractConfiguration.java | 17 +-
.../bookkeeper/conf/ClientConfiguration.java | 2 +-
.../org/apache/bookkeeper/conf/Configurable.java | 2 +-
.../bookkeeper/conf/ServerConfiguration.java | 22 +-
.../bookkeeper/discover/ZKRegistrationClient.java | 17 +-
.../meta/AbstractHierarchicalLedgerManager.java | 2 +-
.../bookkeeper/meta/AbstractZkLedgerManager.java | 27 +-
.../meta/AbstractZkLedgerManagerFactory.java | 2 +-
.../bookkeeper/meta/CleanupLedgerManager.java | 16 +-
.../apache/bookkeeper/meta/FlatLedgerManager.java | 2 +-
.../bookkeeper/meta/FlatLedgerManagerFactory.java | 2 +-
.../bookkeeper/meta/HierarchicalLedgerManager.java | 13 +-
.../meta/HierarchicalLedgerManagerFactory.java | 2 +-
.../bookkeeper/meta/LedgerAuditorManager.java | 2 +-
.../apache/bookkeeper/meta/LedgerIdGenerator.java | 2 +-
.../org/apache/bookkeeper/meta/LedgerLayout.java | 2 +-
.../org/apache/bookkeeper/meta/LedgerManager.java | 29 +-
.../bookkeeper/meta/LedgerManagerFactory.java | 2 +-
.../bookkeeper/meta/LedgerMetadataSerDe.java | 2 +-
.../meta/LedgerUnderreplicationManager.java | 2 +-
.../meta/LegacyHierarchicalLedgerManager.java | 2 +-
.../LegacyHierarchicalLedgerManagerFactory.java | 2 +-
.../meta/LongHierarchicalLedgerManager.java | 2 +-
.../meta/LongHierarchicalLedgerManagerFactory.java | 2 +-
.../bookkeeper/meta/LongZkLedgerIdGenerator.java | 2 +-
.../bookkeeper/meta/MSLedgerManagerFactory.java | 2 +-
.../apache/bookkeeper/meta/MetadataDrivers.java | 16 +-
.../bookkeeper/meta/NullMetadataBookieDriver.java | 2 +-
.../bookkeeper/meta/UnderreplicatedLedger.java | 2 +-
.../bookkeeper/meta/ZkLedgerAuditorManager.java | 2 +-
.../bookkeeper/meta/ZkLedgerIdGenerator.java | 2 +-
.../meta/ZkLedgerUnderreplicationManager.java | 22 +-
.../bookkeeper/meta/zk/ZKMetadataDriverBase.java | 8 +-
.../bookkeeper/metastore/InMemoryMetaStore.java | 2 +-
.../metastore/InMemoryMetastoreCursor.java | 2 +-
.../metastore/InMemoryMetastoreTable.java | 2 +-
.../apache/bookkeeper/metastore/MSException.java | 2 +-
.../bookkeeper/metastore/MSWatchedEvent.java | 2 +-
.../org/apache/bookkeeper/metastore/MetaStore.java | 2 +-
.../bookkeeper/metastore/MetastoreCallback.java | 2 +-
.../bookkeeper/metastore/MetastoreCursor.java | 2 +-
.../bookkeeper/metastore/MetastoreException.java | 2 +-
.../bookkeeper/metastore/MetastoreFactory.java | 2 +-
.../metastore/MetastoreScannableTable.java | 2 +-
.../bookkeeper/metastore/MetastoreTable.java | 2 +-
.../bookkeeper/metastore/MetastoreTableItem.java | 2 +-
.../bookkeeper/metastore/MetastoreUtils.java | 2 +-
.../bookkeeper/metastore/MetastoreWatcher.java | 2 +-
.../org/apache/bookkeeper/metastore/Value.java | 2 +-
.../bookkeeper/net/AbstractDNSToSwitchMapping.java | 2 +-
.../java/org/apache/bookkeeper/net/BookieId.java | 2 +-
.../java/org/apache/bookkeeper/net/BookieNode.java | 2 +-
.../apache/bookkeeper/net/BookieSocketAddress.java | 2 +-
.../bookkeeper/net/CachedDNSToSwitchMapping.java | 2 +-
.../bookkeeper/net/CommonConfigurationKeys.java | 2 +-
.../main/java/org/apache/bookkeeper/net/DNS.java | 2 +-
.../apache/bookkeeper/net/DNSToSwitchMapping.java | 2 +-
.../java/org/apache/bookkeeper/net/NetUtils.java | 2 +-
.../apache/bookkeeper/net/NetworkTopologyImpl.java | 9 +-
.../main/java/org/apache/bookkeeper/net/Node.java | 2 +-
.../java/org/apache/bookkeeper/net/NodeBase.java | 2 +-
.../apache/bookkeeper/net/ScriptBasedMapping.java | 2 +-
.../bookkeeper/processor/RequestProcessor.java | 6 +-
.../org/apache/bookkeeper/proto/AuthHandler.java | 8 +-
.../java/org/apache/bookkeeper/proto/BKStats.java | 2 +-
.../org/apache/bookkeeper/proto/BookieClient.java | 3 +-
.../apache/bookkeeper/proto/BookieClientImpl.java | 73 +-
.../bookkeeper/proto/BookieConnectionPeer.java | 2 +-
.../apache/bookkeeper/proto/BookieNettyServer.java | 16 +-
.../bookkeeper/proto/BookieProtoEncoding.java | 99 +-
.../apache/bookkeeper/proto/BookieProtocol.java | 133 +-
.../bookkeeper/proto/BookieRequestHandler.java | 53 +-
.../bookkeeper/proto/BookieRequestProcessor.java | 103 +-
.../org/apache/bookkeeper/proto/BookieServer.java | 5 +-
.../bookkeeper/proto/ClientConnectionPeer.java | 2 +-
.../apache/bookkeeper/proto/ConnectionPeer.java | 2 +-
.../bookkeeper/proto/ForceLedgerProcessorV3.java | 11 +-
.../bookkeeper/proto/GetBookieInfoProcessorV3.java | 17 +-
.../proto/GetListOfEntriesOfLedgerProcessorV3.java | 7 +-
.../bookkeeper/proto/LocalBookiesRegistry.java | 2 +-
.../proto/LongPollReadEntryProcessorV3.java | 7 +-
.../bookkeeper/proto/PacketProcessorBase.java | 67 +-
.../bookkeeper/proto/PacketProcessorBaseV3.java | 18 +-
.../bookkeeper/proto/PerChannelBookieClient.java | 112 +-
.../bookkeeper/proto/ReadEntryProcessor.java | 17 +-
.../bookkeeper/proto/ReadEntryProcessorV3.java | 15 +-
.../bookkeeper/proto/ReadLacProcessorV3.java | 9 +-
.../org/apache/bookkeeper/proto/RequestUtils.java | 2 +-
.../apache/bookkeeper/proto/ResponseBuilder.java | 2 +-
.../proto/SimpleBookieServiceInfoProvider.java | 2 +-
.../bookkeeper/proto/WriteEntryProcessor.java | 23 +-
.../bookkeeper/proto/WriteEntryProcessorV3.java | 17 +-
.../bookkeeper/proto/WriteLacProcessorV3.java | 12 +-
.../proto/checksum/CRC32CDigestManager.java | 26 +-
.../proto/checksum/CRC32DigestManager.java | 15 +-
.../bookkeeper/proto/checksum/DigestManager.java | 156 +-
.../proto/checksum/DirectMemoryCRC32Digest.java | 5 +-
.../proto/checksum/DummyDigestManager.java | 13 +-
.../proto/checksum/MacDigestManager.java | 12 +-
.../proto/checksum/StandardCRC32Digest.java | 4 +-
.../org/apache/bookkeeper/replication/Auditor.java | 1889 ++------------------
.../replication/AuditorBookieCheckTask.java | 184 ++
.../replication/AuditorCheckAllLedgersTask.java | 293 +++
.../bookkeeper/replication/AuditorElector.java | 13 +-
.../AuditorPlacementPolicyCheckTask.java | 321 ++++
.../replication/AuditorReplicasCheckTask.java | 766 ++++++++
.../bookkeeper/replication/AuditorStats.java | 294 +++
.../apache/bookkeeper/replication/AuditorTask.java | 163 ++
.../bookkeeper/replication/AutoRecoveryMain.java | 2 +-
.../replication/BookieLedgerIndexer.java | 2 +-
.../replication/ReplicationEnableCb.java | 2 +-
.../replication/ReplicationException.java | 2 +-
.../bookkeeper/replication/ReplicationStats.java | 1 +
.../bookkeeper/replication/ReplicationWorker.java | 26 +-
.../bookkeeper/sasl/JAASCredentialsContainer.java | 2 +-
.../bookkeeper/sasl/SASLBookieAuthProvider.java | 2 +-
.../sasl/SASLBookieAuthProviderFactory.java | 2 +-
.../bookkeeper/sasl/SASLClientAuthProvider.java | 2 +-
.../bookkeeper/sasl/SASLClientProviderFactory.java | 2 +-
.../apache/bookkeeper/sasl/SaslClientState.java | 2 +-
.../org/apache/bookkeeper/sasl/SaslConstants.java | 2 +-
.../apache/bookkeeper/sasl/TGTRefreshThread.java | 2 +-
.../apache/bookkeeper/server/EmbeddedServer.java | 641 +++++++
.../java/org/apache/bookkeeper/server/Main.java | 260 +--
.../server/http/BKHttpServiceProvider.java | 15 +
.../server/http/service/BookieSanityService.java | 111 ++
.../server/http/service/ClusterInfoService.java | 137 ++
.../server/http/service/DeleteLedgerService.java | 4 +-
.../server/http/service/ExpandStorageService.java | 4 +-
.../server/http/service/GetLastLogMarkService.java | 12 +-
.../server/http/service/GetLedgerMetaService.java | 4 +-
.../server/http/service/ListBookieInfoService.java | 4 +-
.../server/http/service/ListBookiesService.java | 4 +-
.../server/http/service/ListDiskFilesService.java | 4 +-
.../server/http/service/ListLedgerService.java | 4 +-
.../service/ListUnderReplicatedLedgerService.java | 4 +-
.../service/LostBookieRecoveryDelayService.java | 4 +-
.../http/service/ReadLedgerEntryService.java | 4 +-
.../server/http/service/RecoveryBookieService.java | 6 +-
.../http/service/ResumeCompactionService.java | 86 +
.../http/service/SuspendCompactionService.java | 99 +
.../server/http/service/TriggerAuditService.java | 4 +-
.../service/TriggerLocationCompactService.java | 143 ++
.../server/http/service/WhoIsAuditorService.java | 4 +-
.../bookkeeper/server/service/ScrubberService.java | 2 +-
.../apache/bookkeeper/tls/BookieAuthZFactory.java | 2 +-
.../bookkeeper/tls/FileModifiedTimeUpdater.java | 2 +-
.../apache/bookkeeper/tls/SecurityException.java | 2 +-
.../bookkeeper/tls/SecurityHandlerFactory.java | 2 +-
.../tls/SecurityProviderFactoryFactory.java | 2 +-
.../apache/bookkeeper/tls/TLSContextFactory.java | 2 +-
.../cli/commands/autorecovery/package-info.java | 3 +-
.../tools/cli/commands/bookie/InitCommand.java | 1 +
.../commands/bookie/ListActiveLedgersCommand.java | 2 +-
.../cli/commands/bookie/ListLedgersCommand.java | 4 +-
.../cli/commands/client/LedgerMetaDataCommand.java | 18 +-
.../cli/commands/client/SimpleTestCommand.java | 50 +-
.../tools/cli/commands/health/package-info.java | 3 +-
.../util/AvailabilityOfEntriesOfLedger.java | 2 +-
.../bookkeeper/util/BookKeeperConstants.java | 2 +-
.../org/apache/bookkeeper/util/ByteBufList.java | 26 +-
.../java/org/apache/bookkeeper/util/CertUtils.java | 2 +-
.../bookkeeper/util/DaemonThreadFactory.java | 2 +-
.../org/apache/bookkeeper/util/DiskChecker.java | 2 +-
.../org/apache/bookkeeper/util/EventLoopUtil.java | 66 +-
.../java/org/apache/bookkeeper/util/HardLink.java | 2 +-
.../apache/bookkeeper/util/LocalBookKeeper.java | 2 +-
.../bookkeeper/util/OrderedGenericCallback.java | 7 +-
.../util/{NativeIO.java => PageCacheUtil.java} | 64 +-
.../org/apache/bookkeeper/util/SafeRunnable.java | 2 +-
.../java/org/apache/bookkeeper/util/Shell.java | 2 +-
.../org/apache/bookkeeper/util/SnapshotMap.java | 2 +-
.../org/apache/bookkeeper/util/StringUtils.java | 2 +-
.../main/java/org/apache/bookkeeper/util/Tool.java | 2 +-
.../org/apache/bookkeeper/util/ZeroBuffer.java | 2 +-
.../bookkeeper/verifier/BookkeeperVerifier.java | 3 +-
.../verifier/BookkeeperVerifierMain.java | 2 +-
.../verifier/DirectBookkeeperDriver.java | 2 +-
.../apache/bookkeeper/versioning/Versioned.java | 2 +-
.../BoundExponentialBackoffRetryPolicy.java | 2 +-
.../ExponentialBackOffWithDeadlinePolicy.java | 2 +-
.../zookeeper/ExponentialBackoffRetryPolicy.java | 2 +-
.../apache/bookkeeper/zookeeper/RetryPolicy.java | 2 +-
.../bookkeeper/zookeeper/ZooKeeperClient.java | 2 +-
.../bookkeeper/zookeeper/ZooKeeperWatcherBase.java | 2 +-
.../org/apache/bookkeeper/zookeeper/ZooWorker.java | 2 +-
.../apache/bookkeeper/bookie/BookieAccessor.java | 2 +-
.../apache/bookkeeper/bookie/BookieImplTest.java | 195 ++
.../bookie/BookieInitializationTest.java | 6 +-
.../bookkeeper/bookie/BookieJournalForceTest.java | 23 +-
.../bookie/BookieJournalMaxMemoryTest.java | 2 +
.../bookie/BookieJournalPageCacheFlushTest.java | 26 +-
.../bookkeeper/bookie/BookieJournalTest.java | 14 +-
.../apache/bookkeeper/bookie/BookieShellTest.java | 2 +
.../bookkeeper/bookie/BookieStickyReadsTest.java | 19 +-
.../apache/bookkeeper/bookie/BookieThreadTest.java | 2 +-
.../bookie/BookieWriteToJournalTest.java | 3 +-
.../bookie/CheckpointOnNewLedgersTest.java | 5 +-
.../apache/bookkeeper/bookie/CreateNewLogTest.java | 2 +-
.../bookkeeper/bookie/DefaultEntryLogTest.java | 5 +-
.../bookie/FileInfoBackingCacheTest.java | 18 +-
.../bookie/GarbageCollectorThreadTest.java | 135 ++
.../bookkeeper/bookie/IndexCorruptionTest.java | 8 +-
.../bookie/InterleavedLedgerStorageTest.java | 2 +-
.../apache/bookkeeper/bookie/LedgerCacheTest.java | 9 +-
.../bookkeeper/bookie/LedgerDirsManagerTest.java | 2 +-
.../bookie/LedgerStorageCheckpointTest.java | 2 +-
.../bookkeeper/bookie/LedgerStorageTest.java | 2 +-
.../bookkeeper/bookie/MockLedgerStorage.java | 24 +
.../bookie/MockUncleanShutdownDetection.java | 2 +-
.../bookkeeper/bookie/SortedLedgerStorageTest.java | 2 +-
.../apache/bookkeeper/bookie/StateManagerTest.java | 2 +-
.../apache/bookkeeper/bookie/SyncThreadTest.java | 2 +-
.../apache/bookkeeper/bookie/TestBookieImpl.java | 2 +-
.../bookie/UncleanShutdownDetectionTest.java | 2 +-
.../bookkeeper/bookie/UpdateCookieCmdTest.java | 2 +-
.../org/apache/bookkeeper/bookie/UpgradeTest.java | 133 +-
.../datainteg/MetadataAsyncIteratorTest.java | 8 +-
.../bookie/storage/EntryLogTestUtils.java | 2 +-
.../bookkeeper/bookie/storage/MockEntryLogIds.java | 2 +-
.../bookkeeper/bookie/storage/TestEntryLogIds.java | 49 +-
.../storage/directentrylogger/TestBuffer.java | 2 +-
.../directentrylogger/TestDirectEntryLogger.java | 11 +-
.../TestDirectEntryLoggerCompat.java | 2 +-
.../directentrylogger/TestDirectReader.java | 2 +-
.../directentrylogger/TestDirectWriter.java | 2 +-
.../storage/directentrylogger/TestMetadata.java | 80 +
.../TestTransactionalEntryLogCompactor.java | 2 +-
.../bookie/storage/ldb/ArraySortGroupTest.java | 38 +-
.../bookie/storage/ldb/ConversionRollbackTest.java | 2 +-
.../bookie/storage/ldb/ConversionTest.java | 2 +-
.../storage/ldb/DbLedgerStorageBookieTest.java | 2 +-
.../storage/ldb/DbLedgerStorageIndexDirTest.java | 2 +-
.../bookie/storage/ldb/DbLedgerStorageTest.java | 15 +-
.../DbLedgerStorageWithDirectEntryLoggerTest.java | 2 +-
.../storage/ldb/DbLedgerStorageWriteCacheTest.java | 11 +-
.../storage/ldb/DbReadLedgerIndexEntriesTest.java | 2 +-
.../bookie/storage/ldb/EntryLocationIndexTest.java | 66 +-
.../storage/ldb/KeyValueStorageRocksDBTest.java | 55 +-
.../bookie/storage/ldb/KeyValueStorageTest.java | 2 +-
.../storage/ldb/LedgersIndexCheckOpTest.java | 2 +-
.../storage/ldb/LedgersIndexRebuildOpTest.java | 2 +-
.../storage/ldb/LedgersIndexRebuildTest.java | 2 +-
.../storage/ldb/LocationsIndexRebuildTest.java | 2 +-
.../ldb/PersistentEntryLogMetadataMapTest.java | 2 +-
.../bookie/storage/ldb/ReadCacheTest.java | 2 +-
.../bookie/storage/ldb/WriteCacheTest.java | 29 +-
.../bookkeeper/client/BookKeeperAdminTest.java | 2 +-
.../bookkeeper/client/BookKeeperCloseTest.java | 2 +-
.../client/BookieRecoveryUseIOThreadTest.java | 5 +-
.../bookkeeper/client/BookieWriteLedgerTest.java | 32 +-
...BookieWriteLedgersWithDifferentDigestsTest.java | 10 +-
.../org/apache/bookkeeper/client/ClientUtil.java | 8 +-
.../bookkeeper/client/HandleFailuresTest.java | 24 +-
.../apache/bookkeeper/client/LedgerCmdTest.java | 2 +-
.../bookkeeper/client/LedgerHandleAdapter.java | 11 +-
.../apache/bookkeeper/client/ListLedgersTest.java | 2 +-
.../bookkeeper/client/MetadataUpdateLoopTest.java | 2 +-
.../apache/bookkeeper/client/MockBookKeeper.java | 25 +-
.../bookkeeper/client/MockBookKeeperTest.java | 2 +-
.../bookkeeper/client/MockBookKeeperTestCase.java | 10 +-
.../apache/bookkeeper/client/MockLedgerEntry.java | 2 +-
.../apache/bookkeeper/client/MockLedgerHandle.java | 17 +-
.../apache/bookkeeper/client/MockReadHandle.java | 10 +-
.../client/ParallelLedgerRecoveryTest.java | 7 +-
.../apache/bookkeeper/client/PendingAddOpTest.java | 2 +-
.../client/ReadLastConfirmedAndEntryOpTest.java | 14 +-
.../apache/bookkeeper/client/SlowBookieTest.java | 55 +-
.../client/TestDisableEnsembleChange.java | 2 +-
.../client/TestGetBookieInfoTimeout.java | 4 +-
.../bookkeeper/client/TestLedgerChecker.java | 2 +-
.../client/TestLedgerFragmentReplication.java | 2 +-
.../bookkeeper/client/TestMaxSizeWorkersQueue.java | 2 +-
.../bookkeeper/client/TestPendingReadLacOp.java | 13 +-
.../apache/bookkeeper/client/TestPiggybackLAC.java | 2 +-
.../TestRackawareEnsemblePlacementPolicy.java | 172 +-
...ackawareEnsemblePlacementPolicyUsingScript.java | 2 +-
.../client/TestReadLastConfirmedAndEntry.java | 2 +-
.../TestRegionAwareEnsemblePlacementPolicy.java | 273 +++
.../bookkeeper/client/TestSpeculativeRead.java | 4 +-
.../bookkeeper/client/UpdateLedgerCmdTest.java | 2 +-
.../bookkeeper/client/UpdateLedgerOpTest.java | 2 +-
.../api/BookKeeperBuildersOpenLedgerTest.java | 167 ++
.../client/api/BookKeeperBuildersTest.java | 42 -
.../api/ExplicitLACWithWriteHandleAPITest.java | 2 +-
.../bookkeeper/client/api/WriteFlagTest.java | 2 +-
.../bookkeeper/conf/AbstractConfigurationTest.java | 49 +
.../discover/AbstractTestZkRegistrationClient.java | 2 +
.../meta/AbstractZkLedgerManagerTest.java | 2 +-
.../bookkeeper/meta/CleanupLedgerManagerTest.java | 81 +
.../apache/bookkeeper/meta/MockLedgerManager.java | 2 +-
.../bookkeeper/meta/TestLedgerMetadataSerDe.java | 2 +-
.../meta/TestLongZkLedgerIdGenerator.java | 2 +-
.../bookkeeper/meta/TestZkLedgerIdGenerator.java | 2 +-
.../apache/bookkeeper/meta/ZkLedgerLayoutTest.java | 2 +-
.../meta/zk/ZKMetadataBookieDriverTest.java | 2 +
.../meta/zk/ZKMetadataClientDriverTest.java | 2 +
.../meta/zk/ZKMetadataDriverBaseTest.java | 2 +
...etastoreScannableTableAsyncToSyncConverter.java | 2 +-
.../MetastoreTableAsyncToSyncConverter.java | 2 +-
.../apache/bookkeeper/metastore/TestMetaStore.java | 2 +-
.../org/apache/bookkeeper/net/BookieIdTest.java | 2 +-
.../net/ResolvedBookieSocketAddressTest.java | 2 +-
.../proto/BookieBackpressureForV2Test.java | 6 +-
.../bookkeeper/proto/BookieProtoEncodingTest.java | 6 +-
.../proto/ForceLedgerProcessorV3Test.java | 19 +-
.../proto/GetBookieInfoProcessorV3Test.java | 111 ++
.../proto/LongPollReadEntryProcessorV3Test.java | 9 +-
.../apache/bookkeeper/proto/MockBookieClient.java | 67 +-
.../org/apache/bookkeeper/proto/MockBookies.java | 4 +-
.../bookkeeper/proto/ReadEntryProcessorTest.java | 21 +-
.../org/apache/bookkeeper/proto/TestBKStats.java | 2 +-
.../bookkeeper/proto/TestBackwardCompatCMS42.java | 7 +-
.../proto/TestBookieRequestProcessor.java | 29 +-
.../proto/TestPerChannelBookieClient.java | 8 +-
.../bookkeeper/proto/WriteEntryProcessorTest.java | 86 +-
.../proto/WriteEntryProcessorV3Test.java | 13 +-
.../replication/AuditorBookieCheckTaskTest.java | 153 ++
.../bookkeeper/replication/AuditorBookieTest.java | 22 +-
.../AuditorCheckAllLedgersTaskTest.java | 104 ++
.../replication/AuditorLedgerCheckerTest.java | 114 +-
.../AuditorPeriodicBookieCheckTest.java | 2 +-
.../replication/AuditorPeriodicCheckTest.java | 290 ++-
.../AuditorPlacementPolicyCheckTaskTest.java | 105 ++
.../AuditorPlacementPolicyCheckTest.java | 4 +-
.../replication/AuditorReplicasCheckTaskTest.java | 97 +
.../replication/AuditorReplicasCheckTest.java | 16 +-
.../replication/AuditorRollingRestartTest.java | 2 +-
.../replication/AuthAutoRecoveryTest.java | 2 +-
.../replication/AutoRecoveryMainTest.java | 70 +-
.../replication/BookieAutoRecoveryTest.java | 32 +-
.../replication/BookieLedgerIndexTest.java | 2 +-
.../replication/ReplicationTestUtil.java | 2 +-
.../TestAutoRecoveryAlongWithBookieServers.java | 2 +-
.../TestLedgerUnderreplicationManager.java | 28 +-
.../replication/TestReplicationWorker.java | 75 +-
.../java/org/apache/bookkeeper/sasl/MiniKdc.java | 2 +-
.../apache/bookkeeper/server/TestBookieBoot.java | 2 +-
.../{TestMain.java => TestEmbeddedServer.java} | 109 +-
.../bookkeeper/server/http/TestHttpService.java | 204 +++
.../server/http/service/ListLedgerServiceTest.java | 2 +-
.../apache/bookkeeper/test/AsyncLedgerOpsTest.java | 21 +-
.../bookkeeper/test/BookKeeperClusterTestCase.java | 15 +-
.../apache/bookkeeper/test/BookieFailureTest.java | 20 +-
.../bookkeeper/test/BookieReadWriteTest.java | 155 +-
.../apache/bookkeeper/test/ConditionalSetTest.java | 16 +-
.../apache/bookkeeper/test/ConfigurationTest.java | 2 +-
.../bookkeeper/test/ForceReadOnlyBookieTest.java | 2 +-
.../bookkeeper/test/LocalBookiesRegistryTest.java | 2 +-
.../org/apache/bookkeeper/test/OpStatTest.java | 2 -
.../apache/bookkeeper/test/ReadOnlyBookieTest.java | 4 +-
.../org/apache/bookkeeper/test/TestCallbacks.java | 2 +-
.../bookkeeper/test/ZooKeeperClusterUtil.java | 4 +-
.../org/apache/bookkeeper/test/ZooKeeperUtil.java | 12 +-
.../bookkeeper/tls/TestBookieAuthZFactory.java | 2 +-
.../java/org/apache/bookkeeper/tls/TestTLS.java | 3 +-
.../util/AvailabilityOfEntriesOfLedgerTest.java | 2 +-
.../apache/bookkeeper/util/ByteBufListTest.java | 8 +-
.../apache/bookkeeper/util/TestDiskChecker.java | 2 +-
.../org/apache/bookkeeper/util/TestZkUtils.java | 2 +-
.../collections/ConcurrentLongHashMapTest.java | 35 +
.../verifier/BookkeeperVerifierTest.java | 2 +-
.../bookkeeper/zookeeper/TestRetryPolicy.java | 2 +-
.../zookeeper/TestZKClientBoundExpBackoffRP.java | 2 +-
.../TestZKClientExpBackoffWithDeadlineRP.java | 2 +-
.../bookkeeper/zookeeper/TestZooKeeperClient.java | 2 +-
.../resources/conf/entry_location_rocksdb.conf | 6 +-
.../resources/test_entry_location_rocksdb.conf | 16 +
.../org/apache/bookkeeper/slogger/SloggerTest.java | 3 +-
.../main/resources/bookkeeper/findbugsExclude.xml | 5 +
.../src/main/resources/bookkeeper/suppressions.xml | 2 +
.../circe/checksum/Crc32cIntChecksum.java | 22 +
.../com/scurrilous/circe/checksum/IntHash.java | 5 +
.../scurrilous/circe/checksum/Java8IntHash.java | 16 +-
.../scurrilous/circe/checksum/Java9IntHash.java | 24 +-
.../com/scurrilous/circe/checksum/JniIntHash.java | 20 +-
.../com/scurrilous/circe/utils/NativeUtils.java | 2 +-
.../scurrilous/circe/checksum/ChecksumTest.java | 10 +-
.../scurrilous/circe/utils/NativeUtilsTests.java | 2 +-
conf/bk_server.conf | 55 +-
...t_rocksdb.conf => default_rocksdb.conf.default} | 6 +-
...db.conf => entry_location_rocksdb.conf.default} | 6 +-
...b.conf => ledger_metadata_rocksdb.conf.default} | 6 +-
cpu-affinity/src/main/affinity/cpp/affinity_jni.c | 2 +-
.../common/util/affinity/CpuAffinity.java | 2 +-
.../common/util/affinity/impl/CpuAffinityImpl.java | 2 +-
.../common/util/affinity/impl/CpuAffinityJni.java | 2 +-
.../util/affinity/impl/IsolatedProcessors.java | 2 +-
.../common/util/affinity/impl/NativeUtils.java | 2 +-
.../common/util/affinity/impl/ProcessorsInfo.java | 2 +-
.../common/util/affinity/impl/CpuInfoTest.java | 2 +-
.../util/affinity/impl/IsolatedProcessorsTest.java | 2 +-
deploy/docker-compose/README.md | 21 +-
deploy/docker-compose/compose/Chart.yaml | 4 +-
.../compose/templates/docker-compose.yml | 69 +-
deploy/docker-compose/compose/values.yaml | 9 +-
deploy/docker-compose/docker-compose.yaml | 101 +-
dev/docker/Dockerfile | 2 +-
dev/release/Dockerfile | 2 +-
docker/Dockerfile | 6 +-
docker/scripts/apply-config-from-env.py | 10 +-
.../bookkeeper/metadata/etcd/EtcdConstants.java | 2 +-
.../metadata/etcd/helpers/KeySetReaderTest.java | 2 +-
.../metadata/etcd/testing/EtcdContainer.java | 4 +-
.../bookkeeper/bookie/GroupSortBenchmark.java | 119 ++
.../bookkeeper/common/MpScQueueBenchmark.java | 134 ++
.../apache/bookkeeper/proto/ProtocolBenchmark.java | 16 -
.../proto/checksum/DigestManagerBenchmark.java | 103 ++
.../proto/checksum/DigestTypeBenchmark.java | 6 +-
.../bookkeeper/stats/codahale/TimerBenchmark.java | 2 +-
.../bookkeeper/common/util/nativeio/NativeIO.java | 8 +-
.../common/util/nativeio/NativeIOException.java | 2 +-
.../common/util/nativeio/NativeIOImpl.java | 7 +-
.../common/util/nativeio/NativeIOJni.java | 4 +-
.../common/util/nativeio/NativeUtils.java | 2 +-
.../src/main/native-io-jni/cpp/native_io_jni.c | 23 +-
pom.xml | 101 +-
shaded/bookkeeper-server-shaded/pom.xml | 1 +
shaded/distributedlog-core-shaded/pom.xml | 6 -
site3/website/docs/admin/http.md | 146 +-
site3/website/docs/admin/upgrade.md | 2 +-
site3/website/docs/api/ledger-api.md | 2 +-
site3/website/docs/deployment/manual.md | 4 +-
site3/website/docs/getting-started/concepts.md | 2 +-
site3/website/docs/reference/cli.md | 13 +
site3/website/docs/reference/config.md | 28 +-
site3/website/docusaurus.config.js | 4 +-
site3/website/src/pages/bps/BP-31-durability.md | 2 +-
site3/website/src/pages/bps/BP-41-bookieid.md | 2 +-
site3/website/src/pages/community/contributing.md | 6 +-
site3/website/src/pages/community/mailing-lists.md | 8 +-
site3/website/src/pages/community/meeting.md | 2 +-
site3/website/src/pages/community/slack.md | 2 +-
site3/website/src/pages/release-notes.md | 243 ++-
site3/website/src/pages/releases.md | 6 +-
.../versioned_docs/version-4.10.0/admin/http.md | 2 +-
.../versioned_docs/version-4.11.1/admin/http.md | 2 +-
.../versioned_docs/version-4.12.1/admin/http.md | 2 +-
.../versioned_docs/version-4.13.0/admin/http.md | 2 +-
.../versioned_docs/version-4.14.5/admin/http.md | 510 ------
.../admin/autorecovery.md | 0
.../admin/bookies.md | 0
.../admin/decomission.md | 0
.../admin/geo-replication.md | 0
.../version-4.14.7}/admin/http.md | 2 +-
.../admin/metrics.md | 0
.../admin/perf.md | 0
.../admin/placement.md | 0
.../admin/upgrade.md | 0
.../api/distributedlog-api.md | 0
.../api/ledger-adv-api.md | 0
.../api/ledger-api.md | 8 +-
.../api/overview.md | 0
.../deployment/kubernetes.md | 0
.../deployment/manual.md | 0
.../development/codebase.md | 0
.../development/protocol.md | 0
.../getting-started/concepts.md | 0
.../getting-started/installation.md | 0
.../getting-started/run-locally.md | 0
.../overview/overview.md | 6 +-
.../reference/cli.md | 0
.../reference/config.md | 0
.../reference/metrics.md | 0
.../security/overview.md | 0
.../security/sasl.md | 0
.../security/tls.md | 0
.../security/zookeeper.md | 0
.../versioned_docs/version-4.15.2/admin/http.md | 510 ------
.../admin/autorecovery.md | 0
.../admin/bookies.md | 0
.../admin/decomission.md | 0
.../admin/geo-replication.md | 0
.../version-4.15.4}/admin/http.md | 2 +-
.../admin/metrics.md | 0
.../admin/perf.md | 0
.../admin/placement.md | 0
.../admin/upgrade.md | 0
.../api/distributedlog-api.md | 0
.../api/ledger-adv-api.md | 0
.../api/ledger-api.md | 0
.../api/overview.md | 0
.../deployment/kubernetes.md | 0
.../deployment/manual.md | 0
.../development/codebase.md | 0
.../development/protocol.md | 0
.../getting-started/concepts.md | 0
.../getting-started/installation.md | 0
.../getting-started/run-locally.md | 0
.../overview/overview.md | 2 +-
.../reference/cli.md | 0
.../reference/config.md | 6 +
.../security/overview.md | 0
.../security/sasl.md | 0
.../security/tls.md | 0
.../security/zookeeper.md | 0
.../versioned_docs/version-4.8.2/admin/http.md | 2 +-
.../versioned_docs/version-4.9.2/admin/http.md | 2 +-
...-sidebars.json => version-4.14.7-sidebars.json} | 48 +-
...-sidebars.json => version-4.15.4-sidebars.json} | 0
site3/website/versions.json | 4 +-
site3/website/yarn.lock | 24 +-
...le_m1_aol.properties => aarch64_aol.properties} | 34 +
src/owasp-dependency-check-suppressions.xml | 29 +-
.../apache/bookkeeper/stats/AlertStatsLogger.java | 2 +-
.../bookkeeper/stats/CachingStatsLogger.java | 2 +-
.../bookkeeper/stats/CachingStatsProvider.java | 2 +-
.../java/org/apache/bookkeeper/stats/Counter.java | 2 +-
.../java/org/apache/bookkeeper/stats/Gauge.java | 2 +-
.../apache/bookkeeper/stats/NullStatsLogger.java | 2 +-
.../apache/bookkeeper/stats/NullStatsProvider.java | 2 +-
.../org/apache/bookkeeper/stats/OpStatsData.java | 2 +-
.../org/apache/bookkeeper/stats/OpStatsLogger.java | 2 +-
.../java/org/apache/bookkeeper/stats/Stats.java | 2 +-
.../org/apache/bookkeeper/stats/StatsLogger.java | 2 +-
.../org/apache/bookkeeper/stats/StatsProvider.java | 2 +-
.../apache/bookkeeper/stats/ThreadRegistry.java | 2 +-
.../stats/codahale/CodahaleMetricsProvider.java | 2 +-
.../stats/codahale/CodahaleOpStatsLogger.java | 2 +-
.../stats/codahale/CodahaleStatsLogger.java | 2 +-
.../codahale/FastCodahaleMetricsProvider.java | 2 +-
.../stats/codahale/FastCodahaleStatsLogger.java | 2 +-
.../bookkeeper/stats/codahale/FastSnapshot.java | 2 +-
.../bookkeeper/stats/codahale/FastTimer.java | 2 +-
.../stats/codahale/CodahaleOpStatsTest.java | 2 +-
.../bookkeeper/stats/codahale/FastTimerTest.java | 2 +-
.../prometheus-metrics-provider/pom.xml | 6 +-
.../prometheus/DataSketchesOpStatsLogger.java | 2 +-
.../stats/prometheus/LongAdderCounter.java | 2 +-
.../prometheus/PrometheusMetricsProvider.java | 72 +-
.../stats/prometheus/PrometheusServlet.java | 2 +-
.../stats/prometheus/PrometheusStatsLogger.java | 2 +-
.../stats/prometheus/PrometheusTextFormat.java | 2 +-
.../bookkeeper/stats/prometheus/ScopeContext.java | 2 +-
.../bookkeeper/stats/prometheus/SimpleGauge.java | 2 +-
.../ThreadScopedDataSketchesStatsLogger.java | 2 +-
.../prometheus/ThreadScopedLongAdderCounter.java | 2 +-
.../stats/prometheus/PrometheusTextFormatTest.java | 2 +-
.../stats/prometheus/TestPrometheusFormatter.java | 2 +-
.../prometheus/TestPrometheusMetricsProvider.java | 9 +-
.../org/apache/bookkeeper/api/kv/package-info.java | 2 +-
.../bookkeeper/clients/StorageClientBuilder.java | 1 +
.../clients/admin/StorageAdminClientImpl.java | 8 +-
.../apache/bookkeeper/clients/package-info.java | 2 +-
.../impl/channel/StorageServerChannelManager.java | 8 +-
.../clients/impl/channel/package-info.java | 2 +-
.../impl/internal/ProtocolInternalUtils.java | 1 +
.../bookkeeper/clients/utils/ClientResources.java | 1 +
.../clients/impl/kv/PByteBufSimpleTableImpl.java | 25 +-
.../clients/impl/kv/PByteBufTableRangeImpl.java | 25 +-
stream/clients/pom.xml | 18 +
stream/clients/python/.flake8 | 1 +
stream/clients/python/.gitignore | 2 +
stream/clients/python/README.rst | 19 +
.../python/bookkeeper/common/protobuf_helpers.py | 22 +-
stream/clients/python/bookkeeper/common/timeout.py | 2 +-
.../clients/python/bookkeeper/proto/cluster_pb2.py | 207 +--
.../clients/python/bookkeeper/proto/common_pb2.py | 70 +-
stream/clients/python/bookkeeper/proto/kv_pb2.py | 192 +-
.../clients/python/bookkeeper/proto/kv_rpc_pb2.py | 1302 ++------------
.../python/bookkeeper/proto/kv_store_pb2.py | 312 +---
.../clients/python/bookkeeper/proto/storage_pb2.py | 1328 ++------------
.../clients/python/bookkeeper/proto/stream_pb2.py | 1401 ++-------------
.../clients/python/docker}/Dockerfile | 39 +-
.../test.sh => docker/build-local-image.sh} | 20 +-
.../python/scripts/docker_integration_tests.sh | 7 +-
.../python/scripts/run_integration_tests.sh | 3 +
stream/clients/python/scripts/test.sh | 1 -
stream/clients/python/setup.py | 2 +-
.../tests/integration/bookkeeper/kv/test_client.py | 1 -
.../apache/bookkeeper/common/hash/MurmurHash.java | 1 +
.../bookkeeper/common/hash/package-info.java | 2 +-
.../common/router/AbstractHashRouter.java | 5 +-
.../bookkeeper/common/router/HashRouter.java | 3 +-
.../common/router/StringUtf8HashRouter.java | 2 +-
.../bookkeeper/common/router/package-info.java | 2 +-
.../org/apache/bookkeeper/common/util/Bytes.java | 2 +-
.../apache/bookkeeper/common/util/IRevisioned.java | 3 +-
.../annotations/DistributedLogAnnotations.java | 2 +-
.../common/annotations/package-info.java | 2 +-
.../common/concurrent/AsyncSemaphore.java | 2 +-
.../common/config/ConfigurationSubscription.java | 14 +-
.../common/rate/MovingAverageRate.java | 2 +-
.../common/rate/MovingAverageRateFactory.java | 2 +-
.../common/rate/SampledMovingAverageRate.java | 2 +-
.../common/stats/OpStatsListener.java | 2 +-
.../distributedlog/common/stats/package-info.java | 2 +-
.../distributedlog/common/util/BitMaskUtils.java | 2 +-
.../distributedlog/common/util/MathUtil.java | 2 +-
.../apache/distributedlog/common/util/Permit.java | 2 +-
.../common/util/ReferenceCounted.java | 2 +-
.../apache/distributedlog/io/AsyncCloseable.java | 2 +-
.../apache/distributedlog/io/AsyncDeleteable.java | 2 +-
.../apache/distributedlog/io/CompressionCodec.java | 2 +-
.../apache/distributedlog/io/CompressionUtils.java | 2 +-
.../io/IdentityCompressionCodec.java | 2 +-
.../distributedlog/io/LZ4CompressionCodec.java | 2 +-
.../common/config/PropertiesWriter.java | 4 +-
.../distributedlog/io/TestCompressionCodec.java | 13 +-
.../bookkeeper/client/BookKeeperAccessor.java | 2 +-
.../org/apache/bookkeeper/client/LedgerReader.java | 5 +-
.../distributedlog/AppendOnlyStreamReader.java | 18 +-
.../distributedlog/AppendOnlyStreamWriter.java | 6 +-
.../apache/distributedlog/AsyncNotification.java | 2 +-
.../apache/distributedlog/BKAbstractLogWriter.java | 8 +-
.../apache/distributedlog/BKAsyncLogReader.java | 70 +-
.../apache/distributedlog/BKAsyncLogWriter.java | 2 +-
.../distributedlog/BKDistributedLogManager.java | 2 +-
.../distributedlog/BKDistributedLogNamespace.java | 2 +-
.../org/apache/distributedlog/BKLogHandler.java | 2 +-
.../apache/distributedlog/BKLogReadHandler.java | 2 +-
.../apache/distributedlog/BKLogSegmentWriter.java | 13 +-
.../apache/distributedlog/BKLogWriteHandler.java | 20 +-
.../org/apache/distributedlog/BKSyncLogReader.java | 2 +-
.../org/apache/distributedlog/BKSyncLogWriter.java | 12 +-
.../apache/distributedlog/BKTransmitPacket.java | 2 +-
.../apache/distributedlog/BookKeeperClient.java | 2 +-
.../distributedlog/BookKeeperClientBuilder.java | 2 +-
.../DistributedLogConfiguration.java | 2 +-
.../distributedlog/DistributedLogConstants.java | 2 +-
.../main/java/org/apache/distributedlog/Entry.java | 2 +-
.../org/apache/distributedlog/EntryBuffer.java | 2 +-
.../org/apache/distributedlog/EntryPosition.java | 2 +-
.../org/apache/distributedlog/EnvelopedEntry.java | 5 +-
.../distributedlog/EnvelopedEntryReader.java | 5 +-
.../distributedlog/EnvelopedEntryWriter.java | 6 +-
.../apache/distributedlog/LocalDLMEmulator.java | 2 +-
.../apache/distributedlog/LogSegmentMetadata.java | 2 +-
.../distributedlog/MaxLogSegmentSequenceNo.java | 2 +-
.../java/org/apache/distributedlog/MaxTxId.java | 2 +-
.../distributedlog/ReadAheadEntryReader.java | 4 +-
.../java/org/apache/distributedlog/ReadUtils.java | 2 +-
.../org/apache/distributedlog/WriteLimiter.java | 2 +-
.../org/apache/distributedlog/ZooKeeperClient.java | 4 +-
.../distributedlog/ZooKeeperClientBuilder.java | 2 +-
.../distributedlog/acl/AccessControlManager.java | 2 +-
.../acl/DefaultAccessControlManager.java | 2 +-
.../apache/distributedlog/acl/package-info.java | 2 +-
.../distributedlog/admin/DistributedLogAdmin.java | 2 +-
.../apache/distributedlog/admin/package-info.java | 2 +-
.../api/subscription/SubscriptionStateStore.java | 2 +-
.../api/subscription/SubscriptionsStore.java | 2 +-
.../apache/distributedlog/auditor/DLAuditor.java | 2 +-
.../bk/DynamicQuorumConfigProvider.java | 2 +-
.../bk/ImmutableQuorumConfigProvider.java | 2 +-
.../apache/distributedlog/bk/LedgerAllocator.java | 2 +-
.../bk/LedgerAllocatorDelegator.java | 2 +-
.../distributedlog/bk/LedgerAllocatorPool.java | 2 +-
.../distributedlog/bk/LedgerAllocatorUtils.java | 2 +-
.../org/apache/distributedlog/bk/QuorumConfig.java | 2 +-
.../distributedlog/bk/QuorumConfigProvider.java | 2 +-
.../distributedlog/bk/SimpleLedgerAllocator.java | 12 +-
.../org/apache/distributedlog/bk/package-info.java | 2 +-
.../callback/LogSegmentListener.java | 2 +-
.../callback/LogSegmentNamesListener.java | 2 +-
.../distributedlog/callback/NamespaceListener.java | 2 +-
.../distributedlog/callback/package-info.java | 2 +-
.../config/DynamicConfigurationFactory.java | 2 +-
.../config/DynamicDistributedLogConfiguration.java | 2 +-
.../apache/distributedlog/config/package-info.java | 2 +-
.../distributedlog/exceptions/ZKException.java | 2 +-
.../distributedlog/exceptions/package-info.java | 2 +-
.../feature/AbstractFeatureProvider.java | 2 +-
.../feature/ConfigurationFeatureProvider.java | 2 +-
.../distributedlog/feature/CoreFeatureKeys.java | 2 +-
.../feature/DefaultFeatureProvider.java | 2 +-
.../DynamicConfigurationFeatureProvider.java | 2 +-
.../distributedlog/feature/package-info.java | 2 +-
.../function/GetLastTxIdFunction.java | 2 +-
.../distributedlog/function/package-info.java | 2 +-
.../distributedlog/impl/BKNamespaceDriver.java | 2 +-
.../distributedlog/impl/ZKLogMetadataStore.java | 2 +-
.../distributedlog/impl/ZKLogSegmentFilters.java | 2 +-
.../impl/ZKLogSegmentMetadataStore.java | 11 +-
.../distributedlog/impl/ZKMetadataAccessor.java | 10 +-
.../distributedlog/impl/ZKNamespaceWatcher.java | 2 +-
.../distributedlog/impl/acl/ZKAccessControl.java | 2 +-
.../impl/acl/ZKAccessControlManager.java | 2 +-
.../distributedlog/impl/acl/package-info.java | 2 +-
.../federated/FederatedZKLogMetadataStore.java | 2 +-
.../impl/federated/package-info.java | 2 +-
.../impl/logsegment/BKLogSegmentAllocator.java | 2 +-
.../impl/logsegment/BKLogSegmentEntryReader.java | 13 +-
.../impl/logsegment/BKLogSegmentEntryStore.java | 2 +-
.../impl/logsegment/BKLogSegmentEntryWriter.java | 2 +-
.../BKLogSegmentRandomAccessEntryReader.java | 2 +-
.../distributedlog/impl/logsegment/BKUtils.java | 2 +-
.../impl/logsegment/package-info.java | 2 +-
.../distributedlog/impl/metadata/BKDLConfig.java | 2 +-
.../impl/metadata/ZKLogStreamMetadataStore.java | 2 +-
.../impl/metadata/ZkMetadataResolver.java | 2 +-
.../distributedlog/impl/metadata/package-info.java | 2 +-
.../apache/distributedlog/impl/package-info.java | 2 +-
.../subscription/ZKSubscriptionStateStore.java | 2 +-
.../impl/subscription/ZKSubscriptionsStore.java | 2 +-
.../impl/subscription/package-info.java | 2 +-
.../injector/AsyncFailureInjector.java | 2 +-
.../injector/AsyncRandomFailureInjector.java | 2 +-
.../distributedlog/injector/FailureInjector.java | 2 +-
.../injector/RandomDelayFailureInjector.java | 2 +-
.../distributedlog/injector/package-info.java | 2 +-
.../limiter/ChainedRequestLimiter.java | 2 +-
.../limiter/ComposableRequestLimiter.java | 2 +-
.../distributedlog/limiter/GuavaRateLimiter.java | 2 +-
.../apache/distributedlog/limiter/RateLimiter.java | 2 +-
.../distributedlog/limiter/RequestLimiter.java | 2 +-
.../distributedlog/limiter/package-info.java | 2 +-
.../distributedlog/lock/DistributedLock.java | 2 +-
.../lock/DistributedLockContext.java | 2 +-
.../distributedlog/lock/EpochChangedException.java | 2 +-
.../org/apache/distributedlog/lock/LockAction.java | 2 +-
.../distributedlog/lock/LockClosedException.java | 2 +-
.../apache/distributedlog/lock/LockListener.java | 2 +-
.../lock/LockSessionExpiredException.java | 2 +-
.../lock/LockStateChangedException.java | 2 +-
.../distributedlog/lock/LockTimeoutException.java | 2 +-
.../org/apache/distributedlog/lock/LockWaiter.java | 2 +-
.../distributedlog/lock/NopDistributedLock.java | 2 +-
.../apache/distributedlog/lock/SessionLock.java | 2 +-
.../distributedlog/lock/SessionLockFactory.java | 2 +-
.../distributedlog/lock/ZKDistributedLock.java | 2 +-
.../apache/distributedlog/lock/ZKSessionLock.java | 173 +-
.../distributedlog/lock/ZKSessionLockFactory.java | 64 +-
.../apache/distributedlog/lock/package-info.java | 2 +-
.../logsegment/LogSegmentEntryReader.java | 2 +-
.../logsegment/LogSegmentEntryStore.java | 2 +-
.../logsegment/LogSegmentEntryWriter.java | 2 +-
.../logsegment/LogSegmentFilter.java | 2 +-
.../logsegment/LogSegmentMetadataCache.java | 2 +-
.../logsegment/LogSegmentMetadataStore.java | 2 +-
.../LogSegmentRandomAccessEntryReader.java | 2 +-
.../logsegment/LogSegmentWriter.java | 2 +-
.../logsegment/PerStreamLogSegmentCache.java | 6 +-
.../distributedlog/logsegment/RollingPolicy.java | 2 +-
.../logsegment/SizeBasedRollingPolicy.java | 2 +-
.../logsegment/TimeBasedRollingPolicy.java | 4 +-
.../distributedlog/logsegment/package-info.java | 2 +-
.../apache/distributedlog/metadata/DLConfig.java | 2 +-
.../apache/distributedlog/metadata/DLMetadata.java | 10 +-
.../DryrunLogSegmentMetadataStoreUpdater.java | 2 +-
.../distributedlog/metadata/LogMetadata.java | 2 +-
.../metadata/LogMetadataForReader.java | 2 +-
.../metadata/LogMetadataForWriter.java | 2 +-
.../distributedlog/metadata/LogMetadataStore.java | 2 +-
.../metadata/LogSegmentMetadataStoreUpdater.java | 2 +-
.../metadata/LogStreamMetadataStore.java | 2 +-
.../distributedlog/metadata/MetadataResolver.java | 2 +-
.../distributedlog/metadata/MetadataUpdater.java | 2 +-
.../distributedlog/metadata/package-info.java | 2 +-
.../distributedlog/namespace/NamespaceDriver.java | 2 +-
.../namespace/NamespaceDriverManager.java | 2 +-
.../distributedlog/namespace/NamespaceWatcher.java | 2 +-
.../distributedlog/namespace/package-info.java | 2 +-
.../org/apache/distributedlog/net/DNSResolver.java | 2 +-
.../distributedlog/net/DNSResolverForRacks.java | 2 +-
.../distributedlog/net/DNSResolverForRows.java | 2 +-
.../org/apache/distributedlog/net/NetUtils.java | 2 +-
.../apache/distributedlog/net/package-info.java | 2 +-
.../org/apache/distributedlog/package-info.java | 2 +-
.../selector/FirstDLSNNotLessThanSelector.java | 2 +-
.../selector/FirstRecordSelector.java | 2 +-
.../selector/FirstTxIdNotLessThanSelector.java | 2 +-
.../selector/LastRecordSelector.java | 2 +-
.../distributedlog/selector/LogRecordSelector.java | 2 +-
.../distributedlog/selector/package-info.java | 2 +-
.../apache/distributedlog/thrift/package-info.java | 2 +-
.../distributedlog/tools/DistributedLogTool.java | 9 +-
.../java/org/apache/distributedlog/tools/Tool.java | 2 +-
.../apache/distributedlog/tools/package-info.java | 2 +-
.../org/apache/distributedlog/util/Allocator.java | 2 +-
.../distributedlog/util/CommandLineUtils.java | 2 +-
.../org/apache/distributedlog/util/ConfUtils.java | 2 +-
.../org/apache/distributedlog/util/DLUtils.java | 2 +-
.../apache/distributedlog/util/FailpointUtils.java | 2 +-
.../distributedlog/util/RetryPolicyUtils.java | 2 +-
.../apache/distributedlog/util/TimeSequencer.java | 2 +-
.../java/org/apache/distributedlog/util/Utils.java | 2 +-
.../apache/distributedlog/util/package-info.java | 2 +-
.../org/apache/distributedlog/zk/DefaultZKOp.java | 2 +-
.../distributedlog/zk/LimitedPermitManager.java | 2 +-
.../java/org/apache/distributedlog/zk/ZKOp.java | 2 +-
.../apache/distributedlog/zk/ZKTransaction.java | 2 +-
.../apache/distributedlog/zk/ZKVersionedSetOp.java | 2 +-
.../apache/distributedlog/zk/ZKWatcherManager.java | 2 +-
.../org/apache/distributedlog/zk/package-info.java | 2 +-
.../core/src/main/thrift/metadata.thrift | 2 +-
.../org/apache/distributedlog/DLMTestUtil.java | 2 +-
.../distributedlog/NonBlockingReadsTestUtil.java | 10 +-
.../distributedlog/TestAppendOnlyStreamReader.java | 2 +-
.../distributedlog/TestAppendOnlyStreamWriter.java | 2 +-
.../apache/distributedlog/TestAsyncBulkWrite.java | 2 +-
.../apache/distributedlog/TestAsyncReaderLock.java | 2 +-
.../distributedlog/TestAsyncReaderWriter.java | 29 +-
.../TestBKDistributedLogManager.java | 2 +-
.../TestBKDistributedLogNamespace.java | 2 +-
.../distributedlog/TestBKLogReadHandler.java | 2 +-
.../distributedlog/TestBKLogSegmentWriter.java | 2 +-
.../distributedlog/TestBKLogWriteHandler.java | 2 +-
.../apache/distributedlog/TestBKSyncLogReader.java | 2 +-
.../apache/distributedlog/TestCancelledRead.java | 2 +-
.../org/apache/distributedlog/TestDLMTestUtil.java | 2 +-
.../distributedlog/TestDistributedLogBase.java | 2 +-
.../TestDistributedLogConfiguration.java | 2 +-
.../java/org/apache/distributedlog/TestEntry.java | 11 +-
.../apache/distributedlog/TestEntryPosition.java | 2 +-
.../distributedlog/TestInterleavedReaders.java | 2 +-
.../distributedlog/TestLogSegmentCreation.java | 2 +-
.../distributedlog/TestLogSegmentMetadata.java | 2 +-
.../apache/distributedlog/TestLogSegmentsZK.java | 2 +-
.../distributedlog/TestNonBlockingReads.java | 2 +-
.../TestNonBlockingReadsMultiReader.java | 2 +-
.../distributedlog/TestReadAheadEntryReader.java | 2 +-
.../org/apache/distributedlog/TestReadUtils.java | 2 +-
.../java/org/apache/distributedlog/TestReader.java | 2 +-
.../apache/distributedlog/TestRollLogSegments.java | 2 +-
.../org/apache/distributedlog/TestSequenceID.java | 2 +-
.../org/apache/distributedlog/TestTruncate.java | 2 +-
.../java/org/apache/distributedlog/TestTxnId.java | 2 +-
.../apache/distributedlog/TestWriteLimiter.java | 2 +-
.../apache/distributedlog/TestZooKeeperClient.java | 2 +-
.../distributedlog/TestZooKeeperClientBuilder.java | 2 +-
.../distributedlog/ZooKeeperClientUtils.java | 2 +-
.../distributedlog/ZooKeeperClusterTestCase.java | 2 +-
.../distributedlog/acl/TestZKAccessControl.java | 2 +-
.../acl/TestZKAccessControlManager.java | 2 +-
.../org/apache/distributedlog/admin/TestDLCK.java | 2 +-
.../admin/TestDistributedLogAdmin.java | 2 +-
.../distributedlog/bk/TestLedgerAllocator.java | 2 +-
.../distributedlog/bk/TestLedgerAllocatorPool.java | 2 +-
.../distributedlog/config/PropertiesWriter.java | 4 +-
.../config/TestDynamicConfigurationFactory.java | 2 +-
.../TestDynamicDistributedLogConfiguration.java | 2 +-
.../feature/TestConfigurationFeatureProvider.java | 2 +-
.../TestDynamicConfigurationFeatureProvider.java | 2 +-
.../impl/TestZKLogMetadataStore.java | 2 +-
.../impl/TestZKLogSegmentFilters.java | 2 +-
.../impl/TestZKLogSegmentMetadataStore.java | 2 +-
.../impl/TestZKNamespaceWatcher.java | 2 +-
.../federated/TestFederatedZKLogMetadataStore.java | 2 +-
.../logsegment/TestBKLogSegmentEntryReader.java | 2 +-
.../metadata/TestZKLogStreamMetadataStore.java | 2 +-
.../TestZKLogStreamMetadataStoreUtils.java | 2 +-
.../impl/metadata/TestZkMetadataResolver.java | 2 +-
.../distributedlog/limiter/TestRequestLimiter.java | 2 +-
.../distributedlog/lock/TestDistributedLock.java | 2 +-
.../distributedlog/lock/TestZKSessionLock.java | 2 +-
.../logsegment/TestPerStreamLogSegmentCache.java | 2 +-
.../logsegment/TestRollingPolicy.java | 2 +-
.../distributedlog/metadata/TestDLMetadata.java | 2 +-
.../distributedlog/metadata/TestLogMetadata.java | 2 +-
.../TestLogSegmentMetadataStoreUpdater.java | 2 +-
.../namespace/TestNamespaceBuilder.java | 2 +-
.../apache/distributedlog/net/TestDNSResolver.java | 2 +-
.../apache/distributedlog/net/TestNetUtils.java | 2 +-
.../selector/TestLogRecordSelectors.java | 2 +-
.../tools/TestDistributedLogTool.java | 2 +-
.../apache/distributedlog/util/TestConfUtils.java | 2 +-
.../apache/distributedlog/util/TestDLUtils.java | 2 +-
.../distributedlog/util/TestPermitManager.java | 2 +-
.../distributedlog/util/TestTimeSequencer.java | 2 +-
.../org/apache/distributedlog/util/TestUtils.java | 2 +-
.../distributedlog/zk/TestZKTransaction.java | 2 +-
.../distributedlog/zk/TestZKVersionedSetOp.java | 2 +-
.../distributedlog/zk/TestZKWatcherManager.java | 2 +-
.../main/java/org/apache/distributedlog/DLSN.java | 2 +-
.../distributedlog/EnvelopedRecordSetReader.java | 11 +-
.../distributedlog/EnvelopedRecordSetWriter.java | 6 +-
.../java/org/apache/distributedlog/LogRecord.java | 9 +-
.../org/apache/distributedlog/LogRecordSet.java | 2 +-
.../apache/distributedlog/LogRecordSetBuffer.java | 2 +-
.../apache/distributedlog/LogRecordWithDLSN.java | 2 +-
.../org/apache/distributedlog/RecordStream.java | 2 +-
.../exceptions/AlreadyClosedException.java | 2 +-
.../AlreadyTruncatedTransactionException.java | 2 +-
.../exceptions/BKTransmitException.java | 2 +-
.../exceptions/ChecksumFailedException.java | 2 +-
.../exceptions/DLClientClosedException.java | 2 +-
.../distributedlog/exceptions/DLException.java | 2 +-
.../exceptions/DLIllegalStateException.java | 2 +-
.../exceptions/DLInterruptedException.java | 2 +-
.../exceptions/EndOfLogSegmentException.java | 2 +-
.../exceptions/EndOfStreamException.java | 2 +-
.../distributedlog/exceptions/FlushException.java | 2 +-
.../exceptions/IdleReaderException.java | 2 +-
.../exceptions/InternalServerException.java | 2 +-
.../exceptions/InvalidEnvelopedEntryException.java | 2 +-
.../exceptions/InvalidStreamNameException.java | 2 +-
.../exceptions/LockCancelledException.java | 2 +-
.../exceptions/LockingException.java | 2 +-
.../exceptions/LogEmptyException.java | 2 +-
.../exceptions/LogExistsException.java | 2 +-
.../exceptions/LogNotFoundException.java | 2 +-
.../exceptions/LogReadException.java | 2 +-
.../exceptions/LogRecordTooLongException.java | 2 +-
.../exceptions/LogSegmentIsTruncatedException.java | 2 +-
.../exceptions/LogSegmentNotFoundException.java | 2 +-
.../exceptions/MetadataException.java | 2 +-
.../exceptions/NotYetImplementedException.java | 2 +-
.../exceptions/OverCapacityException.java | 2 +-
.../OwnershipAcquireFailedException.java | 2 +-
.../exceptions/ReadCancelledException.java | 2 +-
.../exceptions/RegionUnavailableException.java | 2 +-
.../exceptions/RequestDeniedException.java | 2 +-
.../exceptions/RetryableReadException.java | 2 +-
.../exceptions/ServiceUnavailableException.java | 2 +-
.../distributedlog/exceptions/StatusCode.java | 2 +-
.../exceptions/StreamNotReadyException.java | 2 +-
.../exceptions/StreamUnavailableException.java | 2 +-
.../exceptions/TooManyStreamsException.java | 2 +-
.../TransactionIdOutOfOrderException.java | 2 +-
.../exceptions/UnexpectedException.java | 2 +-
.../UnsupportedMetadataVersionException.java | 2 +-
.../exceptions/WriteCancelledException.java | 2 +-
.../distributedlog/exceptions/WriteException.java | 2 +-
.../distributedlog/exceptions/package-info.java | 2 +-
.../org/apache/distributedlog/package-info.java | 2 +-
.../java/org/apache/distributedlog/TestDLSN.java | 2 +-
.../apache/distributedlog/TestLogRecordSet.java | 2 +-
.../stream/protocol/util/ProtoUtils.java | 1 +
stream/proto/src/main/proto/cluster.proto | 2 +-
stream/proto/src/main/proto/common.proto | 2 +-
stream/proto/src/main/proto/kv.proto | 2 +-
stream/proto/src/main/proto/kv_rpc.proto | 2 +-
stream/proto/src/main/proto/kv_store.proto | 2 +-
stream/proto/src/main/proto/storage.proto | 2 +-
stream/proto/src/main/proto/stream.proto | 2 +-
.../bookkeeper/stream/server/StorageServer.java | 13 +
.../org/apache/bookkeeper/statelib/impl/Bytes.java | 2 +-
.../journal/AbstractStateStoreWithJournal.java | 5 +-
.../bookkeeper/statelib/impl/kv/KVUtils.java | 3 +-
.../statelib/impl/kv/RocksdbKVAsyncStore.java | 5 +-
.../bookkeeper/statelib/impl/mvcc/MVCCRecord.java | 5 +-
.../statelib/impl/mvcc/MVCCRecordCoder.java | 3 +-
.../statelib/impl/mvcc/MVCCStoreImpl.java | 3 +-
stream/statelib/src/main/proto/kv.proto | 2 +-
.../routing/RoutingHeaderProxyInterceptor.java | 3 +-
stream/tests-common/src/main/proto/rpc.proto | 2 +-
.../org/apache/bookkeeper/tls/TestBCNonFips.java | 2 +-
.../TestCompatRecoveryNoPassword.groovy | 4 +-
.../tests/containers/BookieContainer.java | 2 +-
.../bookkeeper/tests/containers/ZKContainer.java | 2 +-
.../tests/containers/wait/HttpWaitStrategy.java | 2 +-
.../cli/commands/bookies/InfoCommandTest.java | 1 +
.../commands/client/LedgerMetaDataCommandTest.java | 13 +
.../cli/commands/client/SimpleTestCommandTest.java | 46 +-
.../tools/perf/journal/JournalWriter.java | 3 +-
.../bookkeeper/tools/perf/table/IncrementTask.java | 3 +-
.../bookkeeper/tools/perf/table/WriteTask.java | 5 +-
.../stream/cli/commands/table/DelCommand.java | 3 +-
1236 files changed, 15217 insertions(+), 12858 deletions(-)
create mode 100644 .github/changes-filter.yaml
delete mode 100644 .github/workflows/backward-compat-tests.yml
create mode 100644 .github/workflows/bk-ci.yml
rename .github/workflows/{pr-validation.yml => bk-streamstorage-python.yml} (53%)
delete mode 100644 .github/workflows/bookie-tests.yml
delete mode 100644 .github/workflows/client-tests.yml
delete mode 100644 .github/workflows/compatibility-check-java11.yml
delete mode 100644 .github/workflows/compatibility-check-java17.yml
delete mode 100644 .github/workflows/compatibility-check-java8.yml
delete mode 100644 .github/workflows/integration-tests.yml
delete mode 100644 .github/workflows/macos-build.yml
delete mode 100644 .github/workflows/owasp-dep-check.yml
delete mode 100644 .github/workflows/remaining-tests.yml
delete mode 100644 .github/workflows/replication-tests.yml
delete mode 100644 .github/workflows/stream-tests.yml
delete mode 100644 .github/workflows/tls-tests.yml
delete mode 100644 .github/workflows/windows-build.yml
create mode 100644 CONTRIBUTING.md
create mode 100644 bookkeeper-common/src/main/java/org/apache/bookkeeper/common/collections/BatchedArrayBlockingQueue.java
copy bookkeeper-server/src/main/java/org/apache/bookkeeper/client/api/LastConfirmedAndEntry.java => bookkeeper-common/src/main/java/org/apache/bookkeeper/common/collections/BatchedBlockingQueue.java (50%)
rename bookkeeper-common/src/main/java/org/apache/bookkeeper/common/collections/{GrowableArrayBlockingQueue.java => GrowableMpScArrayConsumerBlockingQueue.java} (57%)
create mode 100644 bookkeeper-common/src/main/java/org/apache/bookkeeper/common/util/SingleThreadExecutor.java
create mode 100644 bookkeeper-common/src/main/java/org/apache/bookkeeper/common/util/SingleThreadSafeScheduledExecutorService.java
copy bookkeeper-common/src/test/java/org/apache/bookkeeper/common/collections/{GrowableArrayBlockingQueueTest.java => BatchedArrayBlockingQueueTest.java} (59%)
create mode 100644 bookkeeper-common/src/test/java/org/apache/bookkeeper/common/util/TestSingleThreadExecutor.java
rename bookkeeper-dist/src/main/resources/deps/{netty-4.1.81.Final => netty-4.1.89.Final}/LICENSE.aalto-xml.txt (93%)
rename bookkeeper-dist/src/main/resources/deps/{netty-4.1.81.Final => netty-4.1.89.Final}/LICENSE.base64.txt (100%)
rename bookkeeper-dist/src/main/resources/deps/{netty-4.1.81.Final => netty-4.1.89.Final}/LICENSE.bouncycastle.txt (95%)
rename bookkeeper-dist/src/main/resources/deps/{netty-4.1.81.Final => netty-4.1.89.Final}/LICENSE.caliper.txt (99%)
rename bookkeeper-dist/src/main/resources/deps/{netty-4.1.81.Final => netty-4.1.89.Final}/LICENSE.commons-lang.txt (99%)
rename bookkeeper-dist/src/main/resources/deps/{netty-4.1.81.Final => netty-4.1.89.Final}/LICENSE.commons-logging.txt (99%)
rename bookkeeper-dist/src/main/resources/deps/{netty-4.1.81.Final => netty-4.1.89.Final}/LICENSE.compress-lzf.txt (89%)
rename bookkeeper-dist/src/main/resources/deps/{netty-4.1.81.Final => netty-4.1.89.Final}/LICENSE.dnsinfo.txt (92%)
rename bookkeeper-dist/src/main/resources/deps/{netty-4.1.81.Final => netty-4.1.89.Final}/LICENSE.harmony.txt (99%)
rename bookkeeper-dist/src/main/resources/deps/{netty-4.1.81.Final => netty-4.1.89.Final}/LICENSE.hpack.txt (99%)
rename bookkeeper-dist/src/main/resources/deps/{netty-4.1.81.Final => netty-4.1.89.Final}/LICENSE.hyper-hpack.txt (100%)
rename bookkeeper-dist/src/main/resources/deps/{netty-4.1.81.Final => netty-4.1.89.Final}/LICENSE.jboss-marshalling.txt (99%)
rename bookkeeper-dist/src/main/resources/deps/{netty-4.1.81.Final => netty-4.1.89.Final}/LICENSE.jbzip2.txt (100%)
rename bookkeeper-dist/src/main/resources/deps/{netty-4.1.81.Final => netty-4.1.89.Final}/LICENSE.jctools.txt (99%)
rename bookkeeper-dist/src/main/resources/deps/{netty-4.1.81.Final => netty-4.1.89.Final}/LICENSE.jfastlz.txt (100%)
rename bookkeeper-dist/src/main/resources/deps/{netty-4.1.81.Final => netty-4.1.89.Final}/LICENSE.jsr166y.txt (100%)
rename bookkeeper-dist/src/main/resources/deps/{netty-4.1.81.Final => netty-4.1.89.Final}/LICENSE.jzlib.txt (100%)
rename bookkeeper-dist/src/main/resources/deps/{netty-4.1.81.Final => netty-4.1.89.Final}/LICENSE.libdivsufsort.txt (100%)
rename bookkeeper-dist/src/main/resources/deps/{netty-4.1.81.Final => netty-4.1.89.Final}/LICENSE.log4j.txt (99%)
rename bookkeeper-dist/src/main/resources/deps/{netty-4.1.81.Final => netty-4.1.89.Final}/LICENSE.lz4.txt (99%)
rename bookkeeper-dist/src/main/resources/deps/{netty-4.1.81.Final => netty-4.1.89.Final}/LICENSE.lzma-java.txt (99%)
rename bookkeeper-dist/src/main/resources/deps/{netty-4.1.81.Final => netty-4.1.89.Final}/LICENSE.mvn-wrapper.txt (99%)
rename bookkeeper-dist/src/main/resources/deps/{netty-4.1.81.Final => netty-4.1.89.Final}/LICENSE.nghttp2-hpack.txt (100%)
rename bookkeeper-dist/src/main/resources/deps/{netty-4.1.81.Final => netty-4.1.89.Final}/LICENSE.protobuf.txt (100%)
rename bookkeeper-dist/src/main/resources/deps/{netty-4.1.81.Final => netty-4.1.89.Final}/LICENSE.slf4j.txt (100%)
rename bookkeeper-dist/src/main/resources/deps/{netty-4.1.81.Final => netty-4.1.89.Final}/LICENSE.snappy.txt (100%)
rename bookkeeper-dist/src/main/resources/deps/{netty-4.1.81.Final => netty-4.1.89.Final}/LICENSE.webbit.txt (96%)
rename bookkeeper-dist/src/main/resources/deps/{netty-4.1.81.Final => netty-4.1.89.Final}/NOTICE.harmony.txt (66%)
create mode 100644 bookkeeper-server/src/main/java/org/apache/bookkeeper/replication/AuditorBookieCheckTask.java
create mode 100644 bookkeeper-server/src/main/java/org/apache/bookkeeper/replication/AuditorCheckAllLedgersTask.java
create mode 100644 bookkeeper-server/src/main/java/org/apache/bookkeeper/replication/AuditorPlacementPolicyCheckTask.java
create mode 100644 bookkeeper-server/src/main/java/org/apache/bookkeeper/replication/AuditorReplicasCheckTask.java
create mode 100644 bookkeeper-server/src/main/java/org/apache/bookkeeper/replication/AuditorStats.java
create mode 100644 bookkeeper-server/src/main/java/org/apache/bookkeeper/replication/AuditorTask.java
create mode 100644 bookkeeper-server/src/main/java/org/apache/bookkeeper/server/EmbeddedServer.java
create mode 100644 bookkeeper-server/src/main/java/org/apache/bookkeeper/server/http/service/BookieSanityService.java
create mode 100644 bookkeeper-server/src/main/java/org/apache/bookkeeper/server/http/service/ClusterInfoService.java
create mode 100644 bookkeeper-server/src/main/java/org/apache/bookkeeper/server/http/service/ResumeCompactionService.java
create mode 100644 bookkeeper-server/src/main/java/org/apache/bookkeeper/server/http/service/SuspendCompactionService.java
create mode 100644 bookkeeper-server/src/main/java/org/apache/bookkeeper/server/http/service/TriggerLocationCompactService.java
rename bookkeeper-server/src/main/java/org/apache/bookkeeper/util/{NativeIO.java => PageCacheUtil.java} (58%)
create mode 100644 bookkeeper-server/src/test/java/org/apache/bookkeeper/bookie/BookieImplTest.java
create mode 100644 bookkeeper-server/src/test/java/org/apache/bookkeeper/bookie/storage/directentrylogger/TestMetadata.java
create mode 100644 bookkeeper-server/src/test/java/org/apache/bookkeeper/client/api/BookKeeperBuildersOpenLedgerTest.java
create mode 100644 bookkeeper-server/src/test/java/org/apache/bookkeeper/meta/CleanupLedgerManagerTest.java
create mode 100644 bookkeeper-server/src/test/java/org/apache/bookkeeper/proto/GetBookieInfoProcessorV3Test.java
create mode 100644 bookkeeper-server/src/test/java/org/apache/bookkeeper/replication/AuditorBookieCheckTaskTest.java
create mode 100644 bookkeeper-server/src/test/java/org/apache/bookkeeper/replication/AuditorCheckAllLedgersTaskTest.java
create mode 100644 bookkeeper-server/src/test/java/org/apache/bookkeeper/replication/AuditorPlacementPolicyCheckTaskTest.java
create mode 100644 bookkeeper-server/src/test/java/org/apache/bookkeeper/replication/AuditorReplicasCheckTaskTest.java
rename bookkeeper-server/src/test/java/org/apache/bookkeeper/server/{TestMain.java => TestEmbeddedServer.java} (58%)
rename conf/{default_rocksdb.conf => default_rocksdb.conf.default} (89%)
rename conf/{entry_location_rocksdb.conf => entry_location_rocksdb.conf.default} (97%)
rename conf/{ledger_metadata_rocksdb.conf => ledger_metadata_rocksdb.conf.default} (89%)
create mode 100644 microbenchmarks/src/main/java/org/apache/bookkeeper/bookie/GroupSortBenchmark.java
create mode 100644 microbenchmarks/src/main/java/org/apache/bookkeeper/common/MpScQueueBenchmark.java
create mode 100644 microbenchmarks/src/main/java/org/apache/bookkeeper/proto/checksum/DigestManagerBenchmark.java
delete mode 100644 site3/website/versioned_docs/version-4.14.5/admin/http.md
rename site3/website/versioned_docs/{version-4.14.5 => version-4.14.7}/admin/autorecovery.md (100%)
rename site3/website/versioned_docs/{version-4.14.5 => version-4.14.7}/admin/bookies.md (100%)
rename site3/website/versioned_docs/{version-4.14.5 => version-4.14.7}/admin/decomission.md (100%)
rename site3/website/versioned_docs/{version-4.14.5 => version-4.14.7}/admin/geo-replication.md (100%)
copy site3/website/{docs => versioned_docs/version-4.14.7}/admin/http.md (99%)
rename site3/website/versioned_docs/{version-4.14.5 => version-4.14.7}/admin/metrics.md (100%)
rename site3/website/versioned_docs/{version-4.14.5 => version-4.14.7}/admin/perf.md (100%)
rename site3/website/versioned_docs/{version-4.14.5 => version-4.14.7}/admin/placement.md (100%)
rename site3/website/versioned_docs/{version-4.14.5 => version-4.14.7}/admin/upgrade.md (100%)
rename site3/website/versioned_docs/{version-4.14.5 => version-4.14.7}/api/distributedlog-api.md (100%)
rename site3/website/versioned_docs/{version-4.14.5 => version-4.14.7}/api/ledger-adv-api.md (100%)
rename site3/website/versioned_docs/{version-4.14.5 => version-4.14.7}/api/ledger-api.md (99%)
rename site3/website/versioned_docs/{version-4.14.5 => version-4.14.7}/api/overview.md (100%)
rename site3/website/versioned_docs/{version-4.14.5 => version-4.14.7}/deployment/kubernetes.md (100%)
rename site3/website/versioned_docs/{version-4.14.5 => version-4.14.7}/deployment/manual.md (100%)
rename site3/website/versioned_docs/{version-4.14.5 => version-4.14.7}/development/codebase.md (100%)
rename site3/website/versioned_docs/{version-4.14.5 => version-4.14.7}/development/protocol.md (100%)
rename site3/website/versioned_docs/{version-4.14.5 => version-4.14.7}/getting-started/concepts.md (100%)
rename site3/website/versioned_docs/{version-4.14.5 => version-4.14.7}/getting-started/installation.md (100%)
rename site3/website/versioned_docs/{version-4.14.5 => version-4.14.7}/getting-started/run-locally.md (100%)
rename site3/website/versioned_docs/{version-4.14.5 => version-4.14.7}/overview/overview.md (97%)
rename site3/website/versioned_docs/{version-4.14.5 => version-4.14.7}/reference/cli.md (100%)
rename site3/website/versioned_docs/{version-4.14.5 => version-4.14.7}/reference/config.md (100%)
rename site3/website/versioned_docs/{version-4.14.5 => version-4.14.7}/reference/metrics.md (100%)
rename site3/website/versioned_docs/{version-4.14.5 => version-4.14.7}/security/overview.md (100%)
rename site3/website/versioned_docs/{version-4.14.5 => version-4.14.7}/security/sasl.md (100%)
rename site3/website/versioned_docs/{version-4.14.5 => version-4.14.7}/security/tls.md (100%)
rename site3/website/versioned_docs/{version-4.14.5 => version-4.14.7}/security/zookeeper.md (100%)
delete mode 100644 site3/website/versioned_docs/version-4.15.2/admin/http.md
rename site3/website/versioned_docs/{version-4.15.2 => version-4.15.4}/admin/autorecovery.md (100%)
rename site3/website/versioned_docs/{version-4.15.2 => version-4.15.4}/admin/bookies.md (100%)
rename site3/website/versioned_docs/{version-4.15.2 => version-4.15.4}/admin/decomission.md (100%)
rename site3/website/versioned_docs/{version-4.15.2 => version-4.15.4}/admin/geo-replication.md (100%)
copy site3/website/{docs => versioned_docs/version-4.15.4}/admin/http.md (99%)
rename site3/website/versioned_docs/{version-4.15.2 => version-4.15.4}/admin/metrics.md (100%)
rename site3/website/versioned_docs/{version-4.15.2 => version-4.15.4}/admin/perf.md (100%)
rename site3/website/versioned_docs/{version-4.15.2 => version-4.15.4}/admin/placement.md (100%)
rename site3/website/versioned_docs/{version-4.15.2 => version-4.15.4}/admin/upgrade.md (100%)
rename site3/website/versioned_docs/{version-4.15.2 => version-4.15.4}/api/distributedlog-api.md (100%)
rename site3/website/versioned_docs/{version-4.15.2 => version-4.15.4}/api/ledger-adv-api.md (100%)
rename site3/website/versioned_docs/{version-4.15.2 => version-4.15.4}/api/ledger-api.md (100%)
rename site3/website/versioned_docs/{version-4.15.2 => version-4.15.4}/api/overview.md (100%)
rename site3/website/versioned_docs/{version-4.15.2 => version-4.15.4}/deployment/kubernetes.md (100%)
rename site3/website/versioned_docs/{version-4.15.2 => version-4.15.4}/deployment/manual.md (100%)
rename site3/website/versioned_docs/{version-4.15.2 => version-4.15.4}/development/codebase.md (100%)
rename site3/website/versioned_docs/{version-4.15.2 => version-4.15.4}/development/protocol.md (100%)
rename site3/website/versioned_docs/{version-4.15.2 => version-4.15.4}/getting-started/concepts.md (100%)
rename site3/website/versioned_docs/{version-4.15.2 => version-4.15.4}/getting-started/installation.md (100%)
rename site3/website/versioned_docs/{version-4.15.2 => version-4.15.4}/getting-started/run-locally.md (100%)
rename site3/website/versioned_docs/{version-4.15.2 => version-4.15.4}/overview/overview.md (99%)
rename site3/website/versioned_docs/{version-4.15.2 => version-4.15.4}/reference/cli.md (100%)
rename site3/website/versioned_docs/{version-4.15.2 => version-4.15.4}/reference/config.md (98%)
rename site3/website/versioned_docs/{version-4.15.2 => version-4.15.4}/security/overview.md (100%)
rename site3/website/versioned_docs/{version-4.15.2 => version-4.15.4}/security/sasl.md (100%)
rename site3/website/versioned_docs/{version-4.15.2 => version-4.15.4}/security/tls.md (100%)
rename site3/website/versioned_docs/{version-4.15.2 => version-4.15.4}/security/zookeeper.md (100%)
rename site3/website/versioned_sidebars/{version-4.14.5-sidebars.json => version-4.14.7-sidebars.json} (67%)
rename site3/website/versioned_sidebars/{version-4.15.2-sidebars.json => version-4.15.4-sidebars.json} (100%)
rename src/{apple_m1_aol.properties => aarch64_aol.properties} (58%)
copy {docker => stream/clients/python/docker}/Dockerfile (55%)
copy stream/clients/python/{scripts/test.sh => docker/build-local-image.sh} (62%)