You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@pinot.apache.org by GitBox <gi...@apache.org> on 2022/09/16 23:38:42 UTC
[GitHub] [pinot] pedrov-santos98 opened a new issue, #9417: Connection with Kafka successfully but the query is not showing the topic data
pedrov-santos98 opened a new issue, #9417:
URL: https://github.com/apache/pinot/issues/9417
Hi guys, I'm having a problem with Apache Pinot.
I'm testing the tool and I would like to create a table with data from a kafka topic.
For the environment I'm using a docker-compose with kafka confluent community + apache pinot.
I am following the following official tutorial -> [https://docs.pinot.apache.org/basics/data-import/pinot-stream-ingestion/import-from-apache-kafka](url)
All connection is successful, I create the "transcript" schema and the "transcript_realtime" table.
I know the connection is correct because Apache Pinot creates the topic in kafka if it doesn't exist
The problem is that when generating the messages in the kafka topic
When doing the select on the table nothing happens.
Do you know what could be happening?
Thank you very much!
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For additional commands, e-mail: commits-help@pinot.apache.org
[GitHub] [pinot] Jackie-Jiang commented on issue #9417: Connection with Kafka successfully but the query is not showing the topic data
Posted by GitBox <gi...@apache.org>.
Jackie-Jiang commented on issue #9417:
URL: https://github.com/apache/pinot/issues/9417#issuecomment-1253047211
Do you see any exception logged on the servers?
cc @npawar @navina to take a look
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For additional commands, e-mail: commits-help@pinot.apache.org
[GitHub] [pinot] npawar closed issue #9417: Connection with Kafka successfully but the query is not showing the topic data
Posted by GitBox <gi...@apache.org>.
npawar closed issue #9417: Connection with Kafka successfully but the query is not showing the topic data
URL: https://github.com/apache/pinot/issues/9417
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For additional commands, e-mail: commits-help@pinot.apache.org
[GitHub] [pinot] npawar commented on issue #9417: Connection with Kafka successfully but the query is not showing the topic data
Posted by GitBox <gi...@apache.org>.
npawar commented on issue #9417:
URL: https://github.com/apache/pinot/issues/9417#issuecomment-1262915543
Hello @pedrov-santos98 , were you able to resolve the issue?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For additional commands, e-mail: commits-help@pinot.apache.org
[GitHub] [pinot] npawar commented on issue #9417: Connection with Kafka successfully but the query is not showing the topic data
Posted by GitBox <gi...@apache.org>.
npawar commented on issue #9417:
URL: https://github.com/apache/pinot/issues/9417#issuecomment-1316418080
Closing this issue for now. Please reopen if issue persists and debugging steps provided by @navina don't help
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For additional commands, e-mail: commits-help@pinot.apache.org
[GitHub] [pinot] navina commented on issue #9417: Connection with Kafka successfully but the query is not showing the topic data
Posted by GitBox <gi...@apache.org>.
navina commented on issue #9417:
URL: https://github.com/apache/pinot/issues/9417#issuecomment-1253653002
@pedrov-santos98 can you check the logs in the server directory for any exceptions that is happening during ingestion?
Based on your description, it looks like ingestion is silently failing or dropping the records. Here are some possible ways in which you can verify that the ingestion is still progressing:
1. Using the Rest APIs via the Swagger UI:
a. `/getTableStatus` and verify that the state is `HEALTHY`
b. `/debug/tables/{tableName}` to view the debug information for the table. You can increase the verbosity to see more details.
c. `/consumingSegmentsInfo` -> if this doesn't return any segments, it means there are no consuming segments and ideally, you would have caught this "error" state in the previous 2 queries
2. Look at the metrics, if you have them exported somewhere:
a. if `LLC_PARTITION_CONSUMING` is non-zero, there is an ingestion issue
3. Look at the ZK status - make sure that the ideal state (IS) and external view (EV) for that table match and each partition has a consuming segment.
4. Search the server logs for any error or exception.
Happy to connect on the Apache Pinot slack and troubleshoot as well. My id is `navina`
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For additional commands, e-mail: commits-help@pinot.apache.org