[GitHub] [pinot] navina commented on issue #9417: Connection with Kafka successfully but the query is not showing the topic data

[GitBox <gi...@apache.org>]

navina commented on issue #9417:
URL: https://github.com/apache/pinot/issues/9417#issuecomment-1253653002

   @pedrov-santos98 can you check the logs in the server directory for any exceptions that is happening during ingestion? 
   
   Based on your description, it looks like ingestion is silently failing or dropping the records. Here are some possible ways in which you can verify that the ingestion is still progressing:
   1. Using the Rest APIs via the Swagger UI:
   a. `/getTableStatus` and verify that the state is `HEALTHY`
   b. `/debug/tables/{tableName}` to view the debug information for the table. You can increase the verbosity to see more details.
   c. `/consumingSegmentsInfo` -> if this doesn't return any segments, it means there are no consuming segments and ideally, you would have caught this "error" state in the previous 2 queries
   2. Look at the metrics, if you have them exported somewhere:
   a. if `LLC_PARTITION_CONSUMING` is non-zero, there is an ingestion issue
   3. Look at the ZK status - make sure that the ideal state (IS) and external view (EV) for that table match and each partition has a consuming segment. 
   4. Search the server logs for any error or exception.
   
   Happy to connect on the Apache Pinot slack and troubleshoot as well. My id is `navina` 
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For additional commands, e-mail: commits-help@pinot.apache.org