You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@druid.apache.org by GitBox <gi...@apache.org> on 2020/06/03 18:46:38 UTC
[GitHub] [druid] jihoonson opened a new issue #9981: Suspicious persists during the ingestion
jihoonson opened a new issue #9981:
URL: https://github.com/apache/druid/issues/9981
### Affected Version
0.17, 0.18
### Description
```
2020-05-29T19:39:41,325 INFO [[index_kinesis_events_f3f78b11e73489e_cpmeplam]-appenderator-persist] org.apache.druid.segment.realtime.appenderator.AppenderatorImpl - Flushed in-memory data for segment[events_2020-05-29T17:00:00.000Z_2020-05-29T18:00:00.000Z_2020-05-29T17:00:00.217Z_58] spill[12] to disk in [2,861] ms (99,998 rows).
2020-05-29T19:39:41,354 INFO [[index_kinesis_events_f3f78b11e73489e_cpmeplam]-appenderator-persist] org.apache.druid.segment.realtime.appenderator.AppenderatorImpl - Flushed in-memory data for segment[events_2020-05-29T16:00:00.000Z_2020-05-29T17:00:00.000Z_2020-05-29T16:00:00.435Z_378] spill[9] to disk in [10] ms (2 rows).
...
```
Observed this pattern of persists was repeatedly happening when `maxRowsInMemory` was 100,000. `maxTotalRows` was default.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@druid.apache.org
For additional commands, e-mail: commits-help@druid.apache.org
[GitHub] [druid] liran-funaro commented on issue #9981: Suspicious persists during the ingestion
Posted by GitBox <gi...@apache.org>.
liran-funaro commented on issue #9981:
URL: https://github.com/apache/druid/issues/9981#issuecomment-643746032
Hi @jihoonson,
It could be helpful if you could share the entire log.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@druid.apache.org
For additional commands, e-mail: commits-help@druid.apache.org
[GitHub] [druid] louisliu318 edited a comment on issue #9981: Suspicious persists during the ingestion
Posted by GitBox <gi...@apache.org>.
louisliu318 edited a comment on issue #9981:
URL: https://github.com/apache/druid/issues/9981#issuecomment-661745124
@jihoonson same pattern of persists happening. Have you found the cause?
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@druid.apache.org
For additional commands, e-mail: commits-help@druid.apache.org
[GitHub] [druid] louisliu318 commented on issue #9981: Suspicious persists during the ingestion
Posted by GitBox <gi...@apache.org>.
louisliu318 commented on issue #9981:
URL: https://github.com/apache/druid/issues/9981#issuecomment-661745124
@jihoonson same pattern of persists happens. Have you found the cause?
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@druid.apache.org
For additional commands, e-mail: commits-help@druid.apache.org