Apache Pinot Daily Email Digest (2021-11-01)

[Pinot Slack Email Digest <ap...@gmail.com>]

### _#general_

  
 **@piyush.chauhan:** How to use GraphQL API endpoint with Pinot? We are
storing data in Pinot DB. GraphQL endpoint should query the Pinot DB. The need
of GraphQL endpoint is to fulfill dynamic info requirements from front end.  
**@mayanks:** Pinot does not have GraphQL API support atm.  
**@ashwinviswanath:** Does Pinot support retrieval from gRPC endpoints?  
**@rajanikanth.r:** AWS AppSync backed by pinot api is working perfectly for
us  
**@g.kishore:** we have gRPC endpoints on servers not brokers.. what would you
get if there was a grpc end point  
 **@shreya.chakraborty:** @shreya.chakraborty has joined the channel  
 **@joseph.roldan:** @joseph.roldan has joined the channel  
 **@folutade:** @folutade has joined the channel  

###  _#random_

  
 **@shreya.chakraborty:** @shreya.chakraborty has joined the channel  
 **@joseph.roldan:** @joseph.roldan has joined the channel  
 **@folutade:** @folutade has joined the channel  

###  _#troubleshooting_

  
 **@shreya.chakraborty:** @shreya.chakraborty has joined the channel  
 **@joseph.roldan:** @joseph.roldan has joined the channel  
 **@folutade:** @folutade has joined the channel  
 **@kchavda:** Hi all, I have created a realtime Pinot table and after the
initial snapshot it's not streaming any any new records. I queried the source
table and it has new data in it. I'm using debezium connector and it's up and
running. Any suggestions/ideas on troubleshooting?  
**@kchavda:** table config ```{ "tableName": "profiles", "tableType":
"REALTIME", "segmentsConfig": { "schemaName": "profiles", "replication": 1,
"timeColumnName": "created_at", "timeType": "MILLISECONDS",
"replicasPerPartition": "1", "allowNullTimeValue": false, "retentionTimeUnit":
"DAYS", "retentionTimeValue": "1", "segmentPushType": "APPEND",
"completionConfig": { "completionMode": "DOWNLOAD" } }, "ingestionConfig": {
"transformConfigs": [ { "columnName": "dob", "transformFunction":
"Groovy({date_of_birth != 'null' ? new Date(date_of_birth).format('yyyy-MM-
dd'):'1900-01-01'},date_of_birth)" } ] }, "tenants": { "broker":
"DefaultTenant", "server": "DefaultTenant" }, "tableIndexConfig": {
"loadMode": "MMAP", "nullHandlingEnabled": true, "streamConfigs": {
"streamType": "kafka", "stream.kafka.consumer.type": "LowLevel",
"stream.kafka.topic.name": "profiles",
"stream.kafka.consumer.prop.auto.offset.reset": "smallest",
"stream.kafka.isolation.level": "read_committed",
"stream.kafka.decoder.class.name":
"org.apache.pinot.plugin.stream.kafka.KafkaJSONMessageDecoder",
"stream.kafka.consumer.factory.class.name":
"org.apache.pinot.plugin.stream.kafka20.KafkaConsumerFactory",
"stream.kafka.broker.list": "kafka:9092", "stream.kafka.zk.broker.url":
"zookeeper:2181", "realtime.segment.flush.threshold.size": "0",
"realtime.segment.flush.threshold.time": "24h",
"realtime.segment.flush.desired.size": "200M" } }, "routing": {
"instanceSelectorType": "strictReplicaGroup" }, "upsertConfig": { "mode":
"FULL" }, "metadata": {} }```  
**@npawar:** likely some issue with Segment build. Can you check server logs
and controller logs? might help to look for the exact segment name that was
stuck  

###  _#pinot-dev_

  
 **@falexvr:** Sure, in a moment  
 **@falexvr:**  
\--------------------------------------------------------------------- To
unsubscribe, e-mail: dev-unsubscribe@pinot.apache.org For additional commands,
e-mail: dev-help@pinot.apache.org