You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@pulsar.apache.org by GitBox <gi...@apache.org> on 2022/12/20 10:34:25 UTC

[GitHub] [pulsar] codelipenghui opened a new pull request, #19003: [improve][broker] Add logs for why namespace bundle been unload

codelipenghui opened a new pull request, #19003:
URL: https://github.com/apache/pulsar/pull/19003

   ### Motivation
   
   Add logs for why namespace bundle been unload
   
   ```
   18:28:07.197 [pulsar-modular-load-manager-31-1] INFO  org.apache.pulsar.broker.loadbalance.BundleSplitStrategy - The bundle public/default/0x50000000_0x60000000 is considered to be unload. Topics: 10/1000, Sessions: (10+0)/1000, Message Rate: 49976.285872448774/30000 (msgs/s), Message Throughput: 0.5233347144619912/100 (MB/s)
   18:28:07.218 [pulsar-modular-load-manager-31-1] INFO  org.apache.pulsar.broker.loadbalance.BundleSplitStrategy - The bundle public/default/0xd0000000_0xe0000000 is considered to be unload. Topics: 9/1000, Sessions: (8+3)/1000, Message Rate: 39837.6273878898/30000 (msgs/s), Message Throughput: 0.41714825665545885/100 (MB/s)
   18:28:16.290 [pulsar-modular-load-manager-31-1] INFO  org.apache.pulsar.broker.loadbalance.BundleSplitStrategy - The bundle public/default/0xb0000000_0xc0000000 is considered to be unload. Topics: 10/1000, Sessions: (10+0)/1000, Message Rate: 49572.71491202636/30000 (msgs/s), Message Throughput: 0.5195150078973758/100 (MB/s)
   18:28:16.332 [pulsar-modular-load-manager-31-1] INFO  org.apache.pulsar.broker.loadbalance.BundleSplitStrategy - The bundle public/default/0xa0000000_0xb0000000 is considered to be unload. Topics: 8/1000, Sessions: (8+0)/1000, Message Rate: 39809.21623701227/30000 (msgs/s), Message Throughput: 0.4172123698464636/100 (MB/s)
   18:28:16.393 [pulsar-modular-load-manager-31-1] INFO  org.apache.pulsar.broker.loadbalance.BundleSplitStrategy - The bundle public/default/0x20000000_0x30000000 is considered to be unload. Topics: 10/1000, Sessions: (10+0)/1000, Message Rate: 50415.7972425106/30000 (msgs/s), Message Throughput: 0.5283939562704797/100 (MB/s)
   18:28:21.406 [pulsar-modular-load-manager-31-1] INFO  org.apache.pulsar.broker.loadbalance.BundleSplitStrategy - The bundle public/default/0x20000000_0x30000000 is considered to be unload. Topics: 10/1000, Sessions: (10+0)/1000, Message Rate: 50415.7972425106/30000 (msgs/s), Message Throughput: 0.5283939562704797/100 (MB/s)
   18:28:59.112 [pulsar-modular-load-manager-31-1] INFO  org.apache.pulsar.broker.loadbalance.BundleSplitStrategy - The bundle public/default/0x20000000_0x30000000 is considered to be unload. Topics: 10/1000, Sessions: (10+0)/1000, Message Rate: 50415.7972425106/30000 (msgs/s), Message Throughput: 0.5283939562704797/100 (MB/s)
   18:29:06.666 [pulsar-modular-load-manager-31-1] INFO  org.apache.pulsar.broker.loadbalance.BundleSplitStrategy - The bundle public/default/0xb8000000_0xc0000000 is considered to be unload. Topics: 7/1000, Sessions: (7+0)/1000, Message Rate: 39170.64232204444/30000 (msgs/s), Message Throughput: 0.4131560949721377/100 (MB/s)
   18:29:06.676 [pulsar-modular-load-manager-31-1] INFO  org.apache.pulsar.broker.loadbalance.BundleSplitStrategy - The bundle public/default/0x50000000_0x58000000 is considered to be unload. Topics: 6/1000, Sessions: (6+0)/1000, Message Rate: 33308.84162853347/30000 (msgs/s), Message Throughput: 0.35130126128578953/100 (MB/s)
   18:29:06.685 [pulsar-modular-load-manager-31-1] INFO  org.apache.pulsar.broker.loadbalance.BundleSplitStrategy - The bundle public/default/0xf0000000_0xffffffff is considered to be unload. Topics: 6/1000, Sessions: (6+0)/1000, Message Rate: 31255.591676699634/30000 (msgs/s), Message Throughput: 0.329708951203032/100 (MB/s)
   18:29:06.690 [pulsar-modular-load-manager-31-1] INFO  org.apache.pulsar.broker.loadbalance.BundleSplitStrategy - The bundle public/default/0x20000000_0x30000000 is considered to be unload. Topics: 10/1000, Sessions: (10+0)/1000, Message Rate: 50415.7972425106/30000 (msgs/s), Message Throughput: 0.5283939562704797/100 (MB/s)
   18:29:12.510 [pulsar-modular-load-manager-31-1] INFO  org.apache.pulsar.broker.loadbalance.BundleSplitStrategy - The bundle public/default/0xc0000000_0xd0000000 is considered to be unload. Topics: 11/1000, Sessions: (74+0)/1000, Message Rate: 30204.324830724177/30000 (msgs/s), Message Throughput: 2.059469199580096/100 (MB/s)
   18:29:12.510 [pulsar-modular-load-manager-31-1] INFO  org.apache.pulsar.broker.loadbalance.BundleSplitStrategy - The bundle public/default/0x20000000_0x30000000 is considered to be unload. Topics: 10/1000, Sessions: (10+0)/1000, Message Rate: 50415.7972425106/30000 (msgs/s), Message Throughput: 0.5283939562704797/100 (MB/s)
   18:29:14.040 [pulsar-modular-load-manager-31-1] INFO  org.apache.pulsar.broker.loadbalance.BundleSplitStrategy - The bundle public/default/0x20000000_0x30000000 is considered to be unload. Topics: 10/1000, Sessions: (10+0)/1000, Message Rate: 50415.7972425106/30000 (msgs/s), Message Throughput: 0.5283939562704797/100 (MB/s)
   18:29:15.494 [pulsar-modular-load-manager-31-1] INFO  org.apache.pulsar.broker.loadbalance.BundleSplitStrategy - The bundle public/default/0x80000000_0x90000000 is considered to be unload. Topics: 6/1000, Sessions: (6+0)/1000, Message Rate: 32364.419750693123/30000 (msgs/s), Message Throughput: 0.3413933785702919/100 (MB/s)
   18:29:15.518 [pulsar-modular-load-manager-31-1] INFO  org.apache.pulsar.broker.loadbalance.BundleSplitStrategy - The bundle public/default/0x20000000_0x28000000 is considered to be unload. Topics: 6/1000, Sessions: (6+0)/1000, Message Rate: 33342.31966631791/30000 (msgs/s), Message Throughput: 0.3516866646614494/100 (MB/s)
   18:30:08.348 [pulsar-modular-load-manager-31-1] INFO  org.apache.pulsar.broker.loadbalance.BundleSplitStrategy - The bundle public/default/0xc8000000_0xd0000000 is considered to be unload. Topics: 7/1000, Sessions: (7+0)/1000, Message Rate: 35024.66246401582/30000 (msgs/s), Message Throughput: 0.3693784850036239/100 (MB/s)
   ```
   
   ### Does this pull request potentially affect one of the following parts:
   
   <!-- DO NOT REMOVE THIS SECTION. CHECK THE PROPER BOX ONLY. -->
   
   *If the box was checked, please highlight the changes*
   
   - [ ] Dependencies (add or upgrade a dependency)
   - [ ] The public API
   - [ ] The schema
   - [ ] The default values of configurations
   - [ ] The threading model
   - [ ] The binary protocol
   - [ ] The REST endpoints
   - [ ] The admin CLI options
   - [ ] The metrics
   - [ ] Anything that affects deployment
   
   ### Documentation
   
   <!-- DO NOT REMOVE THIS SECTION. CHECK THE PROPER BOX ONLY. -->
   
   - [ ] `doc` <!-- Your PR contains doc changes. Please attach the local preview screenshots (run `sh start.sh` at `pulsar/site2/website`) to your PR description, or else your PR might not get merged. -->
   - [ ] `doc-required` <!-- Your PR changes impact docs and you will update later -->
   - [x] `doc-not-needed` <!-- Your PR changes do not impact docs -->
   - [ ] `doc-complete` <!-- Docs have been already added -->
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@pulsar.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


[GitHub] [pulsar] codecov-commenter commented on pull request #19003: [improve][broker] Add logs for why namespace bundle been split

Posted by GitBox <gi...@apache.org>.
codecov-commenter commented on PR #19003:
URL: https://github.com/apache/pulsar/pull/19003#issuecomment-1359202077

   # [Codecov](https://codecov.io/gh/apache/pulsar/pull/19003?src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation) Report
   > Merging [#19003](https://codecov.io/gh/apache/pulsar/pull/19003?src=pr&el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation) (3c20117) into [master](https://codecov.io/gh/apache/pulsar/commit/feb3cb4d7a484a284e06474713870609b220abfc?el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation) (feb3cb4) will **increase** coverage by `0.36%`.
   > The diff coverage is `2.38%`.
   
   [![Impacted file tree graph](https://codecov.io/gh/apache/pulsar/pull/19003/graphs/tree.svg?width=650&height=150&src=pr&token=acYqCpsK9J&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation)](https://codecov.io/gh/apache/pulsar/pull/19003?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation)
   
   ```diff
   @@             Coverage Diff              @@
   ##             master   #19003      +/-   ##
   ============================================
   + Coverage     46.35%   46.71%   +0.36%     
   - Complexity     8939    10510    +1571     
   ============================================
     Files           597      706     +109     
     Lines         56858    69010   +12152     
     Branches       5905     7391    +1486     
   ============================================
   + Hits          26357    32241    +5884     
   - Misses        27616    33164    +5548     
   - Partials       2885     3605     +720     
   ```
   
   | Flag | Coverage Δ | |
   |---|---|---|
   | unittests | `46.71% <2.38%> (+0.36%)` | :arrow_up: |
   
   Flags with carried forward coverage won't be shown. [Click here](https://docs.codecov.io/docs/carryforward-flags?utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#carryforward-flags-in-the-pull-request-comment) to find out more.
   
   | [Impacted Files](https://codecov.io/gh/apache/pulsar/pull/19003?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation) | Coverage Δ | |
   |---|---|---|
   | [...elayed/bucket/BookkeeperBucketSnapshotStorage.java](https://codecov.io/gh/apache/pulsar/pull/19003/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-cHVsc2FyLWJyb2tlci9zcmMvbWFpbi9qYXZhL29yZy9hcGFjaGUvcHVsc2FyL2Jyb2tlci9kZWxheWVkL2J1Y2tldC9Cb29ra2VlcGVyQnVja2V0U25hcHNob3RTdG9yYWdlLmphdmE=) | `0.00% <0.00%> (ø)` | |
   | [...rg/apache/pulsar/broker/delayed/bucket/Bucket.java](https://codecov.io/gh/apache/pulsar/pull/19003/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-cHVsc2FyLWJyb2tlci9zcmMvbWFpbi9qYXZhL29yZy9hcGFjaGUvcHVsc2FyL2Jyb2tlci9kZWxheWVkL2J1Y2tldC9CdWNrZXQuamF2YQ==) | `0.00% <0.00%> (ø)` | |
   | [...yed/bucket/BucketSnapshotPersistenceException.java](https://codecov.io/gh/apache/pulsar/pull/19003/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-cHVsc2FyLWJyb2tlci9zcmMvbWFpbi9qYXZhL29yZy9hcGFjaGUvcHVsc2FyL2Jyb2tlci9kZWxheWVkL2J1Y2tldC9CdWNrZXRTbmFwc2hvdFBlcnNpc3RlbmNlRXhjZXB0aW9uLmphdmE=) | `0.00% <0.00%> (ø)` | |
   | [...d/bucket/BucketSnapshotSerializationException.java](https://codecov.io/gh/apache/pulsar/pull/19003/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-cHVsc2FyLWJyb2tlci9zcmMvbWFpbi9qYXZhL29yZy9hcGFjaGUvcHVsc2FyL2Jyb2tlci9kZWxheWVkL2J1Y2tldC9CdWNrZXRTbmFwc2hvdFNlcmlhbGl6YXRpb25FeGNlcHRpb24uamF2YQ==) | `0.00% <0.00%> (ø)` | |
   | [...ar/broker/loadbalance/impl/BundleSplitterTask.java](https://codecov.io/gh/apache/pulsar/pull/19003/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-cHVsc2FyLWJyb2tlci9zcmMvbWFpbi9qYXZhL29yZy9hcGFjaGUvcHVsc2FyL2Jyb2tlci9sb2FkYmFsYW5jZS9pbXBsL0J1bmRsZVNwbGl0dGVyVGFzay5qYXZh) | `54.00% <0.00%> (-26.00%)` | :arrow_down: |
   | [.../pulsar/broker/service/BrokerServiceException.java](https://codecov.io/gh/apache/pulsar/pull/19003/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-cHVsc2FyLWJyb2tlci9zcmMvbWFpbi9qYXZhL29yZy9hcGFjaGUvcHVsc2FyL2Jyb2tlci9zZXJ2aWNlL0Jyb2tlclNlcnZpY2VFeGNlcHRpb24uamF2YQ==) | `48.18% <0.00%> (+1.88%)` | :arrow_up: |
   | [...e/bookkeeper/mledger/impl/LedgerMetadataUtils.java](https://codecov.io/gh/apache/pulsar/pull/19003/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-bWFuYWdlZC1sZWRnZXIvc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2Jvb2trZWVwZXIvbWxlZGdlci9pbXBsL0xlZGdlck1ldGFkYXRhVXRpbHMuamF2YQ==) | `68.42% <50.00%> (ø)` | |
   | [...che/bookkeeper/mledger/impl/ManagedLedgerImpl.java](https://codecov.io/gh/apache/pulsar/pull/19003/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-bWFuYWdlZC1sZWRnZXIvc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2Jvb2trZWVwZXIvbWxlZGdlci9pbXBsL01hbmFnZWRMZWRnZXJJbXBsLmphdmE=) | `53.90% <100.00%> (ø)` | |
   | [...lsar/broker/loadbalance/impl/ThresholdShedder.java](https://codecov.io/gh/apache/pulsar/pull/19003/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-cHVsc2FyLWJyb2tlci9zcmMvbWFpbi9qYXZhL29yZy9hcGFjaGUvcHVsc2FyL2Jyb2tlci9sb2FkYmFsYW5jZS9pbXBsL1RocmVzaG9sZFNoZWRkZXIuamF2YQ==) | `3.27% <0.00%> (-27.05%)` | :arrow_down: |
   | ... and [163 more](https://codecov.io/gh/apache/pulsar/pull/19003/diff?src=pr&el=tree-more&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation) | |
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@pulsar.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


[GitHub] [pulsar] merlimat merged pull request #19003: [improve][broker] Add logs for why namespace bundle been split

Posted by GitBox <gi...@apache.org>.
merlimat merged PR #19003:
URL: https://github.com/apache/pulsar/pull/19003


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@pulsar.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org