You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@pinot.apache.org by GitBox <gi...@apache.org> on 2022/02/03 04:59:32 UTC
[GitHub] [pinot] yupeng9 opened a new issue #8114: Delete segments of a given time range
yupeng9 opened a new issue #8114:
URL: https://github.com/apache/pinot/issues/8114
There are occasional asks from users to delete segments of a given range. (.e.g from 4days ago to yesterday). Since the segment metadata has the range info, it's possible for such deletion at the day's level for offline tables.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For additional commands, e-mail: commits-help@pinot.apache.org
[GitHub] [pinot] yupeng9 commented on issue #8114: Delete segments of a given time range
Posted by GitBox <gi...@apache.org>.
yupeng9 commented on issue #8114:
URL: https://github.com/apache/pinot/issues/8114#issuecomment-1029213089
Agreed. Perhaps there's a way for the user to review the identified segments (via dryrun), and then choose.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For additional commands, e-mail: commits-help@pinot.apache.org
[GitHub] [pinot] walterddr commented on issue #8114: Delete segments of a given time range
Posted by GitBox <gi...@apache.org>.
walterddr commented on issue #8114:
URL: https://github.com/apache/pinot/issues/8114#issuecomment-1029193460
I think we need a more formal definition for this feature before we consider the implementation.
For example,
- do we only support absolutely aligned segment time boundaries? (e.g. do not touch any segment that are across the start/end timestamp)
- if so, what happen to those that cross the start/end timestamp?
- also what happen if data were reuploaded?
also i felt like this can be achieve via a 2 step action - first query the segments by time range, and then use the delete segment endpoint.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For additional commands, e-mail: commits-help@pinot.apache.org