You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@iceberg.apache.org by GitBox <gi...@apache.org> on 2022/08/23 09:22:26 UTC
[GitHub] [iceberg] allenhaozi opened a new issue, #5620: Can use HadoopCatalog to create Iceberg on S3?
allenhaozi opened a new issue, #5620:
URL: https://github.com/apache/iceberg/issues/5620
### Apache Iceberg version
0.14.0 (latest release)
### Query engine
_No response_
### Please describe the bug 🐞
like the following code:
```java
HadoopCatalog catalog = HadoopCatalog();
Schema schema = buildSchema(createTable.getColumns());
String tableName = createTable.getName();
TableIdentifier name = TableIdentifier.of(fqn.split("\\."));
catalog.createTable(name, schema);
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org
[GitHub] [iceberg] Fokko commented on issue #5620: Can use HadoopCatalog to create Iceberg on S3?
Posted by GitBox <gi...@apache.org>.
Fokko commented on issue #5620:
URL: https://github.com/apache/iceberg/issues/5620#issuecomment-1223807948
Hey @allenhaozi You can, but it is highly discouraged. The HadoopCatalog relies on atomic renames that HDFS provides, and this isn't supported by object storage like S3. Therefore using a catalog is the recommended way of doing this.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org
[GitHub] [iceberg] allenhaozi commented on issue #5620: Can use HadoopCatalog to create Iceberg on S3?
Posted by GitBox <gi...@apache.org>.
allenhaozi commented on issue #5620:
URL: https://github.com/apache/iceberg/issues/5620#issuecomment-1225098989
got it, thank you @Fokko
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org
[GitHub] [iceberg] allenhaozi commented on issue #5620: Can use HadoopCatalog to create Iceberg on S3?
Posted by GitBox <gi...@apache.org>.
allenhaozi commented on issue #5620:
URL: https://github.com/apache/iceberg/issues/5620#issuecomment-1223984957
> Hey @allenhaozi You can, but it is highly discouraged. The HadoopCatalog relies on atomic renames that HDFS provides, and this isn't supported by object storage like S3. Therefore using a catalog is the recommended way of doing this.
thank you @Fokko
Is there a sample code for Java here? I am new to Java.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org
[GitHub] [iceberg] Fokko commented on issue #5620: Can use HadoopCatalog to create Iceberg on S3?
Posted by GitBox <gi...@apache.org>.
Fokko commented on issue #5620:
URL: https://github.com/apache/iceberg/issues/5620#issuecomment-1224004476
Depends on what you're trying to achieve. In the case you're new to Java, you could create Iceberg tables using Spark SQL: https://iceberg.apache.org/docs/latest/getting-started/
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org
[GitHub] [iceberg] allenhaozi closed issue #5620: Can use HadoopCatalog to create Iceberg on S3?
Posted by GitBox <gi...@apache.org>.
allenhaozi closed issue #5620: Can use HadoopCatalog to create Iceberg on S3?
URL: https://github.com/apache/iceberg/issues/5620
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org