[GitHub] [iceberg] tvamsikalyan commented on issue #5625: Structured Streaming writes to iceberg table with non-identity partition spec breaks with spark extensions enabled

[GitBox <gi...@apache.org>]

tvamsikalyan commented on issue #5625:
URL: https://github.com/apache/iceberg/issues/5625#issuecomment-1331642092

   one workaround to avoid the problematic code is to set option **use-table-distribution-and-ordering** to **false**.
   For example following worked with above repro steps:
   
   `df.writeStream \
   .format("iceberg") \
   .outputMode("append") \
   .trigger(processingTime='5 seconds') \
   .option("path", "local.db.table") \
   .option("checkpointLocation", "/tmp/warehouse/checkpoints") \
   .option("use-table-distribution-and-ordering", "false") \
   .start()`


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org