You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@pinot.apache.org by GitBox <gi...@apache.org> on 2022/06/22 16:22:18 UTC
[GitHub] [pinot] GaruGaru opened a new issue, #8954: Support time based segment split in flink connector
GaruGaru opened a new issue, #8954:
URL: https://github.com/apache/pinot/issues/8954
## Goal
Allow consistent segment overwrite using the flink connector for time sorted data.
## Description
In order to support segment overwite for time-sorted data we need to implement segment split based on the time column ( the current implementation only takes the row count per segment split in account ).
### Reference
Follow up of https://apache-pinot.slack.com/archives/C01S5EHPS2U/p1655911946659589?thread_ts=1655654979.793919&cid=C01S5EHPS2U
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For additional commands, e-mail: commits-help@pinot.apache.org
[GitHub] [pinot] walterddr commented on issue #8954: Support time based segment split in flink connector
Posted by GitBox <gi...@apache.org>.
walterddr commented on issue #8954:
URL: https://github.com/apache/pinot/issues/8954#issuecomment-1163627344
If I understand correctly pinot's OFFLINE segment is already generated by nameprefix + start/end timestamp
I was wondering if those are automatically generated based on the data being ingested, or is it preset?
CC: @npawar @xiangfu0 do you know if our current pinot-spark connector support splitting by natural timestamp?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For additional commands, e-mail: commits-help@pinot.apache.org