You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@pulsar.apache.org by GitBox <gi...@apache.org> on 2022/12/07 05:03:03 UTC

[GitHub] [pulsar] kinbod created a discussion: hot&cool data strategy

GitHub user kinbod created a discussion: hot&cool data strategy

**Is your feature request related to a problem? Please describe.**
after a long time, we got a lot of old date in pulsar, but we just need search in a small range of data sometime.
 
**Describe the solution you'd like**
if there were some oldest data unused and need delete, we can use some tag like timestamp or others what help us to choose the data we'll remove. or we can use some way to manage the unused date, sometimes they may affect the performance and speed of presto. just like elasticsearch we can close some index when we think some date are out of the range。

**Describe alternatives you've considered**
A clear and concise description of any alternative solutions or features you've considered.

**Additional context**
Add any other context or screenshots about the feature request here.


GitHub link: https://github.com/apache/pulsar/discussions/18789

----
This is an automatically sent email for dev@pulsar.apache.org.
To unsubscribe, please send an email to: dev-unsubscribe@pulsar.apache.org


[GitHub] [pulsar] codelipenghui added a comment to the discussion: hot&cool data strategy

Posted by GitBox <gi...@apache.org>.
GitHub user codelipenghui added a comment to the discussion: hot&cool data strategy

@kinbod Apache Pulsar supports size-based and time-based data retention, does this works for you?

GitHub link: https://github.com/apache/pulsar/discussions/18789#discussioncomment-4329393

----
This is an automatically sent email for dev@pulsar.apache.org.
To unsubscribe, please send an email to: dev-unsubscribe@pulsar.apache.org


[GitHub] [pulsar] kinbod added a comment to the discussion: hot&cool data strategy

Posted by GitBox <gi...@apache.org>.
GitHub user kinbod added a comment to the discussion: hot&cool data strategy

> data retention

size&time based date retention will truncate the data, sometimes I need expand the search scope witch will includ some epired data, but I won't get it back agine, doesn't it ??

GitHub link: https://github.com/apache/pulsar/discussions/18789#discussioncomment-4329394

----
This is an automatically sent email for dev@pulsar.apache.org.
To unsubscribe, please send an email to: dev-unsubscribe@pulsar.apache.org


[GitHub] [pulsar] github-actions[bot] added a comment to the discussion: hot&cool data strategy

Posted by GitBox <gi...@apache.org>.
GitHub user github-actions[bot] added a comment to the discussion: hot&cool data strategy

The issue had no activity for 30 days, mark with Stale label.

GitHub link: https://github.com/apache/pulsar/discussions/18789#discussioncomment-4329395

----
This is an automatically sent email for dev@pulsar.apache.org.
To unsubscribe, please send an email to: dev-unsubscribe@pulsar.apache.org