You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@iceberg.apache.org by GitBox <gi...@apache.org> on 2022/11/23 09:32:06 UTC
[GitHub] [iceberg] sun-help opened a new issue, #6255: Use the Spark engine to delete from the error
sun-help opened a new issue, #6255:
URL: https://github.com/apache/iceberg/issues/6255
### Query engine
spark
### Question
When deleting, my partition field value is a, but the error is that there is a problem with the parquet file of b
Operator:delete from
Under what circumstances does this place run abnormally
![image](https://user-images.githubusercontent.com/52409450/203512692-49bba666-bf8d-4636-87c0-1bfc02e07daf.png)
Caused by: org.apache.iceberg.exceptions.ValidationException: Cannot delete file where some, but not all, rows match filter (((ref(hhh="xxx") == 1 and ref(name="name") == "a") and ref(www="xxx") == "v1.0.0") and ref(name="ccc") == "1233213"): /******/00450-720-00b3d396-982f-4ad0-94fc-b6db3a71fac1-00001.parquet
at org.apache.iceberg.exceptions.ValidationException.check(ValidationException.java:46)
at org.apache.iceberg.ManifestFilterManager.manifestHasDeletedFiles(ManifestFilterManager.java:358)
at org.apache.iceberg.ManifestFilterManager.filterManifest(ManifestFilterManager.java:302)
at org.apache.iceberg.ManifestFilterManager.lambda$filterManifests$0(ManifestFilterManager.java:186)
at org.apache.iceberg.util.Tasks$Builder.runTaskWithRetry(Tasks.java:404)
at org.apache.iceberg.util.Tasks$Builder.access$300(Tasks.java:70)
at org.apache.iceberg.util.Tasks$Builder$1.run(Tasks.java:310)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org
[GitHub] [iceberg] languageoflove commented on issue #6255: Use the Spark engine to delete from the error
Posted by "languageoflove (via GitHub)" <gi...@apache.org>.
languageoflove commented on issue #6255:
URL: https://github.com/apache/iceberg/issues/6255#issuecomment-1552792541
Hello, I also encountered the same problem, how did you finally solve?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org