You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@iceberg.apache.org by "dpaani (via GitHub)" <gi...@apache.org> on 2023/03/23 20:31:17 UTC
[GitHub] [iceberg] dpaani opened a new issue, #7187: Refactoring metadata location and adding API to get data and metadata location
dpaani opened a new issue, #7187:
URL: https://github.com/apache/iceberg/issues/7187
### Feature Request / Improvement
Currently, the LocationProvider interface only provides a way to retrieve the new file location. However, if one wants to obtain the location of the data folder for a specific table, there are too many table properties to consider, and the current Iceberg implementation lacks any public APIs for this purpose.
It would be beneficial to expose the following API within the LocationProvider interface:
```
/**
* Returns a fully-qualified data location for a table.
*
* @return a fully-qualified data location URI
*/
default String dataLocation() {
throw new UnsupportedOperationException("dataLocation() not implemented");
}
```
Furthermore, the logic for obtaining the metadata location is duplicated in multiple places, including the following classes:
AddFilesProcedure.java (for all Spark versions)
BaseTableCreationSparkAction.java
RESTTableOperations.java
It would be helpful if Iceberg added a MetadataLocationProvider to the LocationProviders.java class, similar to the Data LocationProvider, and also included a metadataLocationProvider API within the TableMetadata class for public use like.
```
public interface MetadataLocationProvider extends Serializable {
String metadataLocation();
String newMetadataLocation(String filename);
}
```
### Query engine
None
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org
Re: [I] Refactoring metadata location and adding API to get data and metadata location [iceberg]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on issue #7187:
URL: https://github.com/apache/iceberg/issues/7187#issuecomment-1776250753
This issue has been closed because it has not received any activity in the last 14 days since being marked as 'stale'
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org
[GitHub] [iceberg] github-actions[bot] commented on issue #7187: Refactoring metadata location and adding API to get data and metadata location
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on issue #7187:
URL: https://github.com/apache/iceberg/issues/7187#issuecomment-1726702772
This issue has been automatically marked as stale because it has been open for 180 days with no activity. It will be closed in next 14 days if no further activity occurs. To permanently prevent this issue from being considered stale, add the label 'not-stale', but commenting on the issue is preferred when possible.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org
Re: [I] Refactoring metadata location and adding API to get data and metadata location [iceberg]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] closed issue #7187: Refactoring metadata location and adding API to get data and metadata location
URL: https://github.com/apache/iceberg/issues/7187
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org