[GitHub] [iceberg] RussellSpitzer commented on pull request #3876: ⚡ Speed up TableMigration By collect the DafaFile In parallel

[GitBox <gi...@apache.org>]

RussellSpitzer commented on pull request #3876:
URL: https://github.com/apache/iceberg/pull/3876#issuecomment-1019646429


   Looks like some tests are failing, 
   
   ```
   org.apache.iceberg.spark.extensions.TestAddFilesProcedure > addOrcFileWithDoubleAndFloatColumns[catalogName = testhadoop, implementation = org.apache.iceberg.spark.SparkCatalog, config = {type=hadoop}] FAILED
   426
       org.apache.spark.SparkException: Job aborted due to stage failure: Task 0 in stage 513.0 failed 1 times, most recent failure: Lost task 0.0 in stage 513.0 (TID 931) (localhost executor driver): org.apache.iceberg.exceptions.RuntimeIOException: Failed to open file: file:/tmp/junit5159181195255838438/test.orc
   427
       	at org.apache.iceberg.avro.AvroIterable.newFileReader(AvroIterable.java:103)
   428
       	at org.apache.iceberg.avro.AvroIterable.iterator(AvroIterable.java:77)
   429
       	at org.apache.iceberg.avro.AvroIterable.iterator(AvroIterable.java:37)
   430
       	at org.apache.iceberg.util.Filter.lambda$filter$0(Filter.java:35)
   431
   ```


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org