You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@druid.apache.org by "sachidananda007 (via GitHub)" <gi...@apache.org> on 2023/03/17 05:47:46 UTC
[GitHub] [druid] sachidananda007 opened a new issue, #13944: Inconsistent size column in druid-ui when multiple tiers are loading data
sachidananda007 opened a new issue, #13944:
URL: https://github.com/apache/druid/issues/13944
We have deployed druid 25.0.0 on k8s with 2 tiers for Router -> Broker -> Historical
we use the following configuration related to tiering
for _default_tier
```
in router
druid.service: druid/router
druid.router.defaultBrokerServiceName: druid/broker
druid.router.tierToBrokerMap: {"_default_tier":"druid/broker"}
in broker
druid.service: druid/broker
druid.broker.select.tier: custom
druid.broker.select.tier.custom.priorities: 0
druid.broker.segment.watchedTiers: ["_default_tier"]
in historical
druid.service: druid/historical
druid.server.tier: _default_tier
druid.server.priority: 0
```
for ingestion_tier
```
in router
druid.service: druid/router-test
druid.router.defaultBrokerServiceName: druid/broker-ingestion
druid.router.tierToBrokerMap: {"test_tier":"druid/broker-ingestion"}
in broker
druid.service: druid/broker-ingestion
druid.broker.select.tier: custom
druid.broker.select.tier.custom.priorities: 1
druid.broker.segment.watchedTiers: ["ingestion_tier"]
in historical
druid.service: druid/historical-ingestion
druid.server.tier: ingestion_tier
druid.server.priority: 1
```
we have added loadRule
<img width="500" alt="Screenshot 2023-03-17 at 11 15 05 AM" src="https://user-images.githubusercontent.com/106651335/225822612-620a4b38-b367-4239-8503-85666f260f5a.png">
observing the following issue:
When accessing UI through default_tier router, it shows size only for default_tier historicals
<img width="500" alt="Screenshot 2023-03-15 at 2 11 51 PM" src="https://user-images.githubusercontent.com/106651335/225819564-29b4bad5-cc12-4812-912c-4f7fa10c2567.png">
<img width="500" alt="Screenshot 2023-03-15 at 6 15 39 PM" src="https://user-images.githubusercontent.com/106651335/225820100-c1c671b6-0ca6-4ce6-8277-8ab2580a8f4b.png">
When accessing UI through ingestion_tier router, it shows size only for test_tier historicals
<img width="500" alt="Screenshot 2023-03-15 at 2 11 58 PM" src="https://user-images.githubusercontent.com/106651335/225819583-3cd79ab9-0032-4166-84b9-579caa0baecf.png">
<img width="500" alt="Screenshot 2023-03-15 at 6 16 18 PM" src="https://user-images.githubusercontent.com/106651335/225820106-5a194679-908b-4bd5-9f24-98d02cec6d28.png">
we have another cluster with tiering where it shows size for both tier historicals in single ui. Is there any config where it will show both size combined in _default_tier router
I checked the ui code
`where this api is used '/druid/coordinator/v1/servers?simple' in service-view.tsx`
which is returning sizes for all clusters but in UI its not displaying
due to this it shows sizes for both tiers in 'coordinator mode'
```
[
{
"host": "1.1.1.1:8083",
"tier": "_default_tier",
"type": "historical",
"priority": 0,
"currSize": 20452535,
"maxSize": 5000000000
},
{
"host": "1.1.1.2:8083",
"tier": "_default_tier",
"type": "historical",
"priority": 0,
"currSize": 20452535,
"maxSize": 5000000000
},
{
"host": "1.1.1.3:8083",
"tier": "ingestion_tier",
"type": "historical",
"priority": 1,
"currSize": 20452535,
"maxSize": 5000000000
},
{
"host": "1.1.1.4:8083",
"tier": "ingestion_tier",
"type": "historical",
"priority": 1,
"currSize": 20452535,
"maxSize": 5000000000
}
]
```
`however, this call '/druid/v2/sql' is returning different result .. is this excepted?`
<img width="500" alt="Screenshot 2023-03-16 at 9 42 44 AM" src="https://user-images.githubusercontent.com/106651335/225821078-a0908e97-3191-45dd-966d-c0194e196b9c.png">
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@druid.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@druid.apache.org
For additional commands, e-mail: commits-help@druid.apache.org
Re: [I] Inconsistent size column in druid-ui when multiple tiers are loading data (druid)
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on issue #13944:
URL: https://github.com/apache/druid/issues/13944#issuecomment-1984824567
This issue has been closed due to lack of activity. If you think that
is incorrect, or the issue requires additional review, you can revive the issue at
any time.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@druid.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@druid.apache.org
For additional commands, e-mail: commits-help@druid.apache.org
[GitHub] [druid] sachidananda007 commented on issue #13944: Inconsistent size column in druid-ui when multiple tiers are loading data
Posted by "sachidananda007 (via GitHub)" <gi...@apache.org>.
sachidananda007 commented on issue #13944:
URL: https://github.com/apache/druid/issues/13944#issuecomment-1473168628
slack thread for reference
https://apachedruidworkspace.slack.com/archives/C030K0Z7S1Z/p1678869848406019
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@druid.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@druid.apache.org
For additional commands, e-mail: commits-help@druid.apache.org
Re: [I] Inconsistent size column in druid-ui when multiple tiers are loading data (druid)
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on issue #13944:
URL: https://github.com/apache/druid/issues/13944#issuecomment-1935131160
This issue has been marked as stale due to 280 days of inactivity.
It will be closed in 4 weeks if no further activity occurs. If this issue is still
relevant, please simply write any comment. Even if closed, you can still revive the
issue at any time or discuss it on the dev@druid.apache.org list.
Thank you for your contributions.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@druid.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@druid.apache.org
For additional commands, e-mail: commits-help@druid.apache.org
Re: [I] Inconsistent size column in druid-ui when multiple tiers are loading data (druid)
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] closed issue #13944: Inconsistent size column in druid-ui when multiple tiers are loading data
URL: https://github.com/apache/druid/issues/13944
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@druid.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@druid.apache.org
For additional commands, e-mail: commits-help@druid.apache.org