You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@druid.apache.org by GitBox <gi...@apache.org> on 2020/11/05 01:42:13 UTC
[GitHub] [druid] amal-v opened a new issue #10558: Druid UI with datasources pages crashes.
amal-v opened a new issue #10558:
URL: https://github.com/apache/druid/issues/10558
### Description
While the segments are unavailable(loading), the UI tries to populate the datasource pages with this query and fails.
```
2020-11-04T13:37:55,948 WARN [sql[ae2011e4-8731-4b9a-beaf-81513ffec9c9]] org.apache.druid.sql.http.SqlResource - Failed to handle query: SqlQuery{query='SELECT
Nov 04 13:37:55 ip-10-1-130-103 druid-node.sh[1986]: datasource,
Nov 04 13:37:55 ip-10-1-130-103 druid-node.sh[1986]: COUNT(*) FILTER (WHERE (is_published = 1 AND is_overshadowed = 0) OR is_realtime = 1) AS num_segments,
Nov 04 13:37:55 ip-10-1-130-103 druid-node.sh[1986]: COUNT(*) FILTER (WHERE is_available = 1 AND ((is_published = 1 AND is_overshadowed = 0) OR is_realtime = 1)) AS num_available_segments,
Nov 04 13:37:55 ip-10-1-130-103 druid-node.sh[1986]: COUNT(*) FILTER (WHERE is_published = 1 AND is_overshadowed = 0 AND is_available = 0) AS num_segments_to_load,
Nov 04 13:37:55 ip-10-1-130-103 druid-node.sh[1986]: COUNT(*) FILTER (WHERE is_available = 1 AND NOT ((is_published = 1 AND is_overshadowed = 0) OR is_realtime = 1)) AS num_segments_to_drop,
Nov 04 13:37:55 ip-10-1-130-103 druid-node.sh[1986]: SUM("size") FILTER (WHERE (is_published = 1 AND is_overshadowed = 0)) AS total_data_size,
Nov 04 13:37:55 ip-10-1-130-103 druid-node.sh[1986]: SUM("size" * "num_replicas") FILTER (WHERE (is_published = 1 AND is_overshadowed = 0)) AS replicated_size,
Nov 04 13:37:55 ip-10-1-130-103 druid-node.sh[1986]: MIN("size") FILTER (WHERE (is_published = 1 AND is_overshadowed = 0)) AS min_segment_size,
Nov 04 13:37:55 ip-10-1-130-103 druid-node.sh[1986]: (
Nov 04 13:37:55 ip-10-1-130-103 druid-node.sh[1986]: SUM("size") FILTER (WHERE (is_published = 1 AND is_overshadowed = 0)) /
Nov 04 13:37:55 ip-10-1-130-103 druid-node.sh[1986]: COUNT(*) FILTER (WHERE (is_published = 1 AND is_overshadowed = 0))
Nov 04 13:37:55 ip-10-1-130-103 druid-node.sh[1986]: ) AS avg_segment_size,
Nov 04 13:37:55 ip-10-1-130-103 druid-node.sh[1986]: MAX("size") FILTER (WHERE (is_published = 1 AND is_overshadowed = 0)) AS max_segment_size,
Nov 04 13:37:55 ip-10-1-130-103 druid-node.sh[1986]: SUM("num_rows") FILTER (WHERE (is_published = 1 AND is_overshadowed = 0) OR is_realtime = 1) AS total_rows,
Nov 04 13:37:55 ip-10-1-130-103 druid-node.sh[1986]: (
Nov 04 13:37:55 ip-10-1-130-103 druid-node.sh[1986]: SUM("size") FILTER (WHERE (is_published = 1 AND is_overshadowed = 0)) /
Nov 04 13:37:55 ip-10-1-130-103 druid-node.sh[1986]: SUM("num_rows") FILTER (WHERE (is_published = 1 AND is_overshadowed = 0))
Nov 04 13:37:55 ip-10-1-130-103 druid-node.sh[1986]: ) AS avg_row_size
Nov 04 13:37:55 ip-10-1-130-103 druid-node.sh[1986]: FROM sys.segments
Nov 04 13:37:55 ip-10-1-130-103 druid-node.sh[1986]: GROUP BY 1', resultFormat=OBJECT, header=false, context={}, parameters=[]}
Nov 04 13:37:55 ip-10-1-130-103 druid-node.sh[1986]: java.lang.ArithmeticException: / by zero
```
The issue resolves ones all the segments are loaded.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@druid.apache.org
For additional commands, e-mail: commits-help@druid.apache.org
[GitHub] [druid] suneet-s closed issue #10558: Druid UI (datasources pages) crashes if all segments are not loaded.
Posted by GitBox <gi...@apache.org>.
suneet-s closed issue #10558:
URL: https://github.com/apache/druid/issues/10558
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@druid.apache.org
For additional commands, e-mail: commits-help@druid.apache.org
[GitHub] [druid] suneet-s commented on issue #10558: Druid UI (datasources pages) crashes if all segments are not loaded.
Posted by GitBox <gi...@apache.org>.
suneet-s commented on issue #10558:
URL: https://github.com/apache/druid/issues/10558#issuecomment-722697683
Fixed by #10496
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@druid.apache.org
For additional commands, e-mail: commits-help@druid.apache.org
[GitHub] [druid] amal-v commented on issue #10558: Druid UI (datasources pages) crashes if all segments are not loaded.
Posted by GitBox <gi...@apache.org>.
amal-v commented on issue #10558:
URL: https://github.com/apache/druid/issues/10558#issuecomment-722083823
I am facing this issue with `.20`.


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@druid.apache.org
For additional commands, e-mail: commits-help@druid.apache.org
[GitHub] [druid] suneet-s commented on issue #10558: Druid UI (datasources pages) crashes if all segments are not loaded.
Posted by GitBox <gi...@apache.org>.
suneet-s commented on issue #10558:
URL: https://github.com/apache/druid/issues/10558#issuecomment-722697473
@amal-v I found the correct issue where this was fixed - https://github.com/apache/druid/pull/10496/files#diff-b424606a1aed0c701cf23b70d252bab3b445c334a46fd4f5909c7ced137816ccR230-R244
It did not make the cut for 0.20.0, but will be fixed in the next release
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@druid.apache.org
For additional commands, e-mail: commits-help@druid.apache.org
[GitHub] [druid] amal-v edited a comment on issue #10558: Druid UI (datasources pages) crashes if all segments are not loaded.
Posted by GitBox <gi...@apache.org>.
amal-v edited a comment on issue #10558:
URL: https://github.com/apache/druid/issues/10558#issuecomment-722083823
I am facing this issue with `.20`.


This can be understood from the part of query
```
(
SUM("size") FILTER (WHERE (is_published = 1 AND is_overshadowed = 0)) /
SUM("num_rows") FILTER (WHERE (is_published = 1 AND is_overshadowed = 0))
) AS avg_row_size
```
some cases the `num_rows` are zero untill fully loaded.
_Note: In our case we are deploying new boxes while upgrading resulting in Historical to pull all the segments._
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@druid.apache.org
For additional commands, e-mail: commits-help@druid.apache.org
[GitHub] [druid] suneet-s commented on issue #10558: Druid UI (datasources pages) crashes if all segments are not loaded.
Posted by GitBox <gi...@apache.org>.
suneet-s commented on issue #10558:
URL: https://github.com/apache/druid/issues/10558#issuecomment-722078309
@amal-v Which version of Druid are you using? I've seen the same symptoms that were fixed in #10482 which is released in 0.20.0
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@druid.apache.org
For additional commands, e-mail: commits-help@druid.apache.org