You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@iceberg.apache.org by "zhaomin1423 (via GitHub)" <gi...@apache.org> on 2023/05/08 00:16:08 UTC

[GitHub] [iceberg] zhaomin1423 opened a new issue, #7550: When transforming partition values exists, writing using upsert mode failed

zhaomin1423 opened a new issue, #7550:
URL: https://github.com/apache/iceberg/issues/7550

   ### Apache Iceberg version
   
   1.2.1 (latest release)
   
   ### Query engine
   
   Flink
   
   ### Please describe the bug 🐞
   
   Spark DDL:
   
   ```
   CREATE TABLE spark_catalog.db.demo (
       id bigint,
       data string,
       category string,
       ts bigint)
   USING iceberg
   PARTITIONED BY (bucket(16, id), category)
   TBLPROPERTIES ('format-version'='2');
   ```
   Exception information:
   ```
   java.lang.IllegalStateException: In UPSERT mode, partition field '1000: id_bucket: bucket[16](1)' should be included in equality fields: '[category]'
   
   	at org.apache.iceberg.relocated.com.google.common.base.Preconditions.checkState(Preconditions.java:821)
   	at org.apache.iceberg.flink.sink.FlinkSink$Builder.appendWriter(FlinkSink.java:455)
   	at org.apache.iceberg.flink.sink.FlinkSink$Builder.chainIcebergOperators(FlinkSink.java:358)
   	at org.apache.iceberg.flink.sink.FlinkSink$Builder.append(FlinkSink.java:374)
   ```
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org


[GitHub] [iceberg] pvary commented on issue #7550: When transforming partition values exists, writing using upsert mode failed

Posted by "pvary (via GitHub)" <gi...@apache.org>.
pvary commented on issue #7550:
URL: https://github.com/apache/iceberg/issues/7550#issuecomment-1541390577

   Isn't the issue is the other way around? Shouldn't the Identity columns contain the `id` column?


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org


[GitHub] [iceberg] zhaomin1423 closed issue #7550: When transforming partition values exists, writing using upsert mode failed

Posted by "zhaomin1423 (via GitHub)" <gi...@apache.org>.
zhaomin1423 closed issue #7550: When transforming partition values exists, writing using upsert mode failed
URL: https://github.com/apache/iceberg/issues/7550


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org


[GitHub] [iceberg] zhaomin1423 commented on issue #7550: When transforming partition values exists, writing using upsert mode failed

Posted by "zhaomin1423 (via GitHub)" <gi...@apache.org>.
zhaomin1423 commented on issue #7550:
URL: https://github.com/apache/iceberg/issues/7550#issuecomment-1541410499

   > Isn't the issue is the other way around? Shouldn't the Identity columns contain the `id` column?
   
   Thank you, it was my mistake that caused it.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org