You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@iceberg.apache.org by "zixiao144 (via GitHub)" <gi...@apache.org> on 2023/06/13 11:26:44 UTC
[GitHub] [iceberg] zixiao144 opened a new issue, #7827: How to change the IP address of the original data when migrating data
zixiao144 opened a new issue, #7827:
URL: https://github.com/apache/iceberg/issues/7827
### Apache Iceberg version
1.2.1 (latest release)
### Query engine
Flink
### Please describe the bug 🐞
At present, I have a problem. I have an old hadoop cluster and a new cluster. The old cluster IP address is 10.0.0.1, and the new cluster IP address is 10.0.0.2. How to migrate the old cluster's Data migration to the new cluster.
updateLocation().setLocation not work
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org
[GitHub] [iceberg] zixiao144 commented on issue #7827: How to change the IP address of the original data when migrating data
Posted by "zixiao144 (via GitHub)" <gi...@apache.org>.
zixiao144 commented on issue #7827:
URL: https://github.com/apache/iceberg/issues/7827#issuecomment-1590981825
Thanks you for your answer
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org
[GitHub] [iceberg] RussellSpitzer commented on issue #7827: How to change the IP address of the original data when migrating data
Posted by "RussellSpitzer (via GitHub)" <gi...@apache.org>.
RussellSpitzer commented on issue #7827:
URL: https://github.com/apache/iceberg/issues/7827#issuecomment-1589400420
You actually have two problems. The "Location based table" means there is no catalog for your table. It's location is wherever it is. Basically when looking for a metadata.json file, it just looks in that spot. So you can't ever "change" this location because by definition the location of the table is where you are looking for the file.
The second issue is that even if you could update the location, or set a new data directory or metadata directory (those are options with a location based table), this would only effect new files. The metadata for old files would remain and the references to files would be unchanged. This means if you saved the full cluster path in the only metadata files, the only way to update the location would be to write new metadata files. Unfortunately, at the moment there is no automatic way to do this. Internally we have written small actions to do this but that code is not in OSS.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org
[GitHub] [iceberg] zixiao144 closed issue #7827: How to change the IP address of the original data when migrating data
Posted by "zixiao144 (via GitHub)" <gi...@apache.org>.
zixiao144 closed issue #7827: How to change the IP address of the original data when migrating data
URL: https://github.com/apache/iceberg/issues/7827
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org