You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@iceberg.apache.org by GitBox <gi...@apache.org> on 2022/11/23 09:32:06 UTC

[GitHub] [iceberg] sun-help opened a new issue, #6255: Use the Spark engine to delete from the error

sun-help opened a new issue, #6255:
URL: https://github.com/apache/iceberg/issues/6255

   ### Query engine
   
   spark
   
   ### Question
   
   When deleting, my partition field value is a, but the error is that there is a problem with the parquet file of b
   
   Operator:delete from
   
   Under what circumstances does this place run abnormally
   
   ![image](https://user-images.githubusercontent.com/52409450/203512692-49bba666-bf8d-4636-87c0-1bfc02e07daf.png)
   
   
   Caused by: org.apache.iceberg.exceptions.ValidationException: Cannot delete file where some, but not all, rows match filter (((ref(hhh="xxx") == 1 and ref(name="name") == "a") and ref(www="xxx") == "v1.0.0") and ref(name="ccc") == "1233213"): /******/00450-720-00b3d396-982f-4ad0-94fc-b6db3a71fac1-00001.parquet
     at org.apache.iceberg.exceptions.ValidationException.check(ValidationException.java:46)
     at org.apache.iceberg.ManifestFilterManager.manifestHasDeletedFiles(ManifestFilterManager.java:358)
     at org.apache.iceberg.ManifestFilterManager.filterManifest(ManifestFilterManager.java:302)
     at org.apache.iceberg.ManifestFilterManager.lambda$filterManifests$0(ManifestFilterManager.java:186)
     at org.apache.iceberg.util.Tasks$Builder.runTaskWithRetry(Tasks.java:404)
     at org.apache.iceberg.util.Tasks$Builder.access$300(Tasks.java:70)
     at org.apache.iceberg.util.Tasks$Builder$1.run(Tasks.java:310)
     at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
     at java.util.concurrent.FutureTask.run(FutureTask.java:266)
     at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
     at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
     at java.lang.Thread.run(Thread.java:750)


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org


[GitHub] [iceberg] languageoflove commented on issue #6255: Use the Spark engine to delete from the error

Posted by "languageoflove (via GitHub)" <gi...@apache.org>.
languageoflove commented on issue #6255:
URL: https://github.com/apache/iceberg/issues/6255#issuecomment-1552792541

   Hello, I also encountered the same problem, how did you finally solve?


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org