You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@druid.apache.org by GitBox <gi...@apache.org> on 2019/10/28 05:27:03 UTC
[GitHub] [incubator-druid] pdngayan commented on issue #8730: druid
migration issue
pdngayan commented on issue #8730: druid migration issue
URL: https://github.com/apache/incubator-druid/issues/8730#issuecomment-546796088
Hi,
Now we are running druid 0.13.0-incubating as single-server deployments.
Our goal is to migrate current setup in to druid Cluster setup ( V :
0.16.0-incubating)
First we try to migrate 0.13.0 to 0.16.0 single-server and there is a
problem when migrating deep-storage because the structure has been changed
from 0.13 to 0.16. ( In current version 0.13.0, there are two files in
segments *descriptor.json & index.zip *But in new version 0.16.0
*descriptor.json* is not there ). Also when we copy the segments in to new
location still it is searching for old path.
Also we used Export Metadata Tool to migrate durby metadate in to
Postgress in clusterd environment and it was success.
But We were unable to find a way to migrate deep storage in to clustered
environment. We are using Azure blob storage as deep storage and your
documentation only provide some
details on migrate to S3 but still not clear. ( means there is no other
tool than export metadata tool)
So we would like to know what is the best way to follow to migrate data
from druid 0.13.0-incubating single-server deployment to druid
0.16.0-incubating Clustered deployment.
Thanks
Gayan
On Thu, Oct 24, 2019 at 10:08 PM Jihoon Son <no...@github.com>
wrote:
> Hi @pdngayan <https://github.com/pdngayan>, have you had a chance to
> check
> https://druid.apache.org/docs/latest/operations/deep-storage-migration.html?
> If so, what part was not clear to you? Please feel free to ask more
> questions if you have. Also, you may want to check what has changed between
> 0.13 and 0.16 and what you should be aware of for upgrading your cluster.
> Please check the release notes for those:
> https://github.com/apache/incubator-druid/releases.
>
> —
> You are receiving this because you were mentioned.
> Reply to this email directly, view it on GitHub
> <https://github.com/apache/incubator-druid/issues/8730?email_source=notifications&email_token=ADLPNOW3IGLPZAJUTJRODWTQQHFSDA5CNFSM4JEUGR22YY3PNVWWK3TUL52HS4DFVREXG43VMVBW63LNMVXHJKTDN5WW2ZLOORPWSZGOECFVILA#issuecomment-546001964>,
> or unsubscribe
> <https://github.com/notifications/unsubscribe-auth/ADLPNOTJR7PNL2ZAXXAXDOLQQHFSDANCNFSM4JEUGR2Q>
> .
>
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
With regards,
Apache Git Services
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@druid.apache.org
For additional commands, e-mail: commits-help@druid.apache.org