You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@iceberg.apache.org by "nastra (via GitHub)" <gi...@apache.org> on 2023/08/08 10:51:23 UTC

[GitHub] [iceberg] nastra commented on issue #8085: Default Table properties do not work with spark catalog

nastra commented on issue #8085:
URL: https://github.com/apache/iceberg/issues/8085#issuecomment-1669386052

   @ignaski I took a look at this.The issue here is that you're specifying the `table-default.xyz` property not at the **catalog level** (see https://iceberg.apache.org/docs/latest/spark-configuration/#catalog-configuration) and so it doesn't take any effect. In your case this would look similar to 
   ```
   spark-sql --packages org.apache.iceberg:iceberg-spark-runtime-3.4_2.12:1.3.1\
       --conf spark.sql.extensions=org.apache.iceberg.spark.extensions.IcebergSparkSessionExtensions \
       --conf spark.sql.catalog.local=org.apache.iceberg.spark.SparkCatalog \
       --conf spark.sql.catalog.local.type=hadoop \
       --conf spark.sql.catalog.local.warehouse=$PWD/warehouse \
       --conf spark.sql.defaultCatalog=local
       --conf spark.sql.catalog.local.table-default.write.metadata.delete-after-commit.enabled=true
   ```


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org