[GitHub] [pinot] satish-mittal commented on issue #10861: SIGSEGV in pinot-server

["satish-mittal (via GitHub)" <gi...@apache.org>]

satish-mittal commented on issue #10861:
URL: https://github.com/apache/pinot/issues/10861#issuecomment-1580172849

   The entire 10 minutes seem to be taken in index building only. That explains why we are seeing SIGSEGV only now after enabling lucene index.
   
   ```
   2023/06/06 12:37:08.773 INFO [LLRealtimeSegmentDataManager_viewName__3__11117__20230606T1148Z] [viewName__3__11117__20230606T1148Z] Trying to build segment
   
   2023/06/06 12:37:35.248 INFO [SegmentDictionaryCreator] [viewName__3__11117__20230606T1148Z] Created dictionary for STRING column: protocol_name with cardinality: 4, max length in bytes: 5, range:  to HTTPS
   
   2023/06/06 12:37:35.249 INFO [SegmentIndexCreationDriverImpl] [viewName__3__11117__20230606T1148Z] Start building IndexCreator!
   
   2023/06/06 12:47:09.036 WARN [LLRealtimeSegmentDataManager_viewName__3__11117__20230606T1148Z] [HelixTaskExecutor-message_handle_thread_29] Failed to stop consumer thread within 10 minutes
   ```
   
   If we look at the above timeline, consumer thread starts building segment at `12:37:08.773`. Dictionary creation finishes by `12:37:35.248`. Then it starts building index creator at `12:37:35.249`. But `SegmentIndexCreationDriverImpl` is not able to finish its work in next 10 minutes, and helix handler ends up deleting segment.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For additional commands, e-mail: commits-help@pinot.apache.org