You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@druid.apache.org by GitBox <gi...@apache.org> on 2022/01/24 11:17:01 UTC
[GitHub] [druid] azadsagar opened a new issue #12193: Load dropped segment from deep storage (s3)
azadsagar opened a new issue #12193:
URL: https://github.com/apache/druid/issues/12193
I have data worth 2 TB in deep storage. However my cluster seems to have dropped the segments and only showing replicated data not more than ~110 GB. Is it possible to load the data from deep storage ?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@druid.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@druid.apache.org
For additional commands, e-mail: commits-help@druid.apache.org
[GitHub] [druid] azadsagar commented on issue #12193: Load dropped segment from deep storage (s3)
Posted by GitBox <gi...@apache.org>.
azadsagar commented on issue #12193:
URL: https://github.com/apache/druid/issues/12193#issuecomment-1020155737
I have enough space on my historical nodes. 3TB per node and 10 historical nodes. How can I restore data from deep storage ?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@druid.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@druid.apache.org
For additional commands, e-mail: commits-help@druid.apache.org
[GitHub] [druid] abhishekagarwal87 commented on issue #12193: Load dropped segment from deep storage (s3)
Posted by GitBox <gi...@apache.org>.
abhishekagarwal87 commented on issue #12193:
URL: https://github.com/apache/druid/issues/12193#issuecomment-1020055706
Yes, it is possible. You may not have enough disk capacity on the
historical or the load rules are not configured correctly. That will result
in data not getting loaded from deep storage.
On Mon, Jan 24, 2022 at 4:47 PM azadsagar ***@***.***> wrote:
> I have data worth 2 TB in deep storage. However my cluster seems to have
> dropped the segments and only showing replicated data not more than ~110
> GB. Is it possible to load the data from deep storage ?
>
> —
> Reply to this email directly, view it on GitHub
> <https://github.com/apache/druid/issues/12193>, or unsubscribe
> <https://github.com/notifications/unsubscribe-auth/AALIWULPZFVD7R53ES56MNTUXUYLTANCNFSM5MVCQRSA>
> .
> Triage notifications on the go with GitHub Mobile for iOS
> <https://apps.apple.com/app/apple-store/id1477376905?ct=notification-email&mt=8&pt=524675>
> or Android
> <https://play.google.com/store/apps/details?id=com.github.android&referrer=utm_campaign%3Dnotification-email%26utm_medium%3Demail%26utm_source%3Dgithub>.
>
> You are receiving this because you are subscribed to this thread.Message
> ID: ***@***.***>
>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@druid.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@druid.apache.org
For additional commands, e-mail: commits-help@druid.apache.org
[GitHub] [druid] LakshSingla commented on issue #12193: Load dropped segment from deep storage (s3)
Posted by GitBox <gi...@apache.org>.
LakshSingla commented on issue #12193:
URL: https://github.com/apache/druid/issues/12193#issuecomment-1020932615
Is it possible that the load and drop rules for your cluster are configured not to ingest the data that is not getting loaded? For example, the rules specify to not ingest before a certain time period, and the data which is not ingested belongs to that time period?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@druid.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@druid.apache.org
For additional commands, e-mail: commits-help@druid.apache.org
[GitHub] [druid] LakshSingla commented on issue #12193: Load dropped segment from deep storage (s3)
Posted by GitBox <gi...@apache.org>.
LakshSingla commented on issue #12193:
URL: https://github.com/apache/druid/issues/12193#issuecomment-1020932615
Is it possible that the load and drop rules for your cluster are configured not to ingest the data that is not getting loaded? For example, the rules specify to not ingest before a certain time period, and the data which is not ingested belongs to that time period?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@druid.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@druid.apache.org
For additional commands, e-mail: commits-help@druid.apache.org