You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@pinot.apache.org by "FranMorilloAWS (via GitHub)" <gi...@apache.org> on 2023/09/05 14:54:59 UTC
[GitHub] [pinot] FranMorilloAWS commented on issue #9869: Pinot stop consuming from Kinesis Data Stream
FranMorilloAWS commented on issue #9869:
URL: https://github.com/apache/pinot/issues/9869#issuecomment-1706778830
Hi! I am running tests in Pinot consuming from Kinesis Data Streams. I am running two r5x.large servers. I noticed that once it reached 8 segments and it wont create any new segments, until it reaches the flush time. This is my current configuration:
"realtime.segment.flush.threshold.rows": "0",
"realtime.segment.flush.threshold.time": "1h",
"realtime.segment.flush.threshold.size": "200M"
When i go into each segment i see that the tresholdrows is defined to be and it doesnt reach the size. (each segment is 1.7 MB in S3)
"segment.flush.threshold.size": "150000",
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For additional commands, e-mail: commits-help@pinot.apache.org