You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@iceberg.apache.org by "qinghui-xu (via GitHub)" <gi...@apache.org> on 2025/10/01 19:20:19 UTC

[I] Avro version incompatible with Spark 3.5/3.4 [iceberg]

qinghui-xu opened a new issue, #14232:
URL: https://github.com/apache/iceberg/issues/14232

   ### Apache Iceberg version
   
   1.10.0 (latest release)
   
   ### Query engine
   
   Spark
   
   ### Please describe the bug 🐞
   
   Spark 3.5/3.4 is using avro 1.11.
   Iceberg is using avro 1.12 API such as `org.apache.avro.LogicalTypes.timestampNanos` which does not exist in avro 1.11. In runtime:
   ```
   java.lang.NoSuchMethodError: 'org.apache.avro.LogicalTypes$TimestampNanos org.apache.avro.LogicalTypes.timestampNanos()'
     at org.apache.iceberg.avro.TypeToSchema.<clinit>(TypeToSchema.java:50)
     at org.apache.iceberg.avro.AvroSchemaUtil.convert(AvroSchemaUtil.java:64)
     at org.apache.iceberg.avro.AvroSchemaUtil.convert(AvroSchemaUtil.java:59)
     at org.apache.iceberg.GenericManifestFile.<clinit>(GenericManifestFile.java:42)
     at java.base/jdk.internal.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
     at java.base/jdk.internal.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62)
     at java.base/jdk.internal.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
     at java.base/java.lang.reflect.Constructor.newInstance(Constructor.java:490)
     at org.apache.iceberg.common.DynConstructors$Ctor.newInstanceChecked(DynConstructors.java:51)
     at org.apache.iceberg.common.DynConstructors$Ctor.newInstance(DynConstructors.java:64)
     at org.apache.iceberg.avro.InternalReaders$PlannedStructLikeReader.reuseOrCreate(InternalReaders.java:67)
     at org.apache.iceberg.avro.InternalReaders$PlannedStructLikeReader.reuseOrCreate(InternalReaders.java:42)
     at org.apache.iceberg.avro.ValueReaders$PlannedStructReader.read(ValueReaders.java:1025)
     at org.apache.iceberg.avro.InternalReader.read(InternalReader.java:107)
     at org.apache.iceberg.avro.NameMappingDatumReader.read(NameMappingDatumReader.java:57)
     at org.apache.avro.file.DataFileStream.next(DataFileStream.java:263)
     at org.apache.avro.file.DataFileStream.next(DataFileStream.java:248)
     at org.apache.iceberg.io.CloseableIterator$1.next(CloseableIterator.java:55)
     at org.apache.iceberg.relocated.com.google.common.collect.Iterators.addAll(Iterators.java:370)
     at org.apache.iceberg.relocated.com.google.common.collect.Iterables.addAll(Iterables.java:332)
     at org.apache.iceberg.relocated.com.google.common.collect.Lists.newLinkedList(Lists.java:261)
     at org.apache.iceberg.ManifestLists.read(ManifestLists.java:42)
     at org.apache.iceberg.BaseSnapshot.cacheManifests(BaseSnapshot.java:185)
     at org.apache.iceberg.BaseSnapshot.dataManifests(BaseSnapshot.java:211)
     at org.apache.iceberg.DataTableScan.doPlanFiles(DataTableScan.java:68)
     at org.apache.iceberg.SnapshotScan.planFiles(SnapshotScan.java:139)
     at org.apache.iceberg.spark.source.SparkTable.canDeleteUsingMetadata(SparkTable.java:359)
     at org.apache.iceberg.spark.source.SparkTable.canDeleteWhere(SparkTable.java:336)
     at org.apache.spark.sql.execution.datasources.v2.OptimizeMetadataOnlyDeleteFromTable$$anonfun$apply$1.applyOrElse(OptimizeMetadataOnlyDeleteFromTable.scala:47)
     at org.apache.spark.sql.execution.datasources.v2.OptimizeMetadataOnlyDeleteFromTable$$anonfun$apply$1.applyOrElse(OptimizeMetadataOnlyDeleteFromTable.scala:39)
     at org.apache.spark.sql.catalyst.trees.TreeNode.$anonfun$transformDownWithPruning$1(TreeNode.scala:461)
     at org.apache.spark.sql.catalyst.trees.CurrentOrigin$.withOrigin(origin.scala:76)
     at org.apache.spark.sql.catalyst.trees.TreeNode.transformDownWithPruning(TreeNode.scala:461)
     at org.apache.spark.sql.catalyst.plans.logical.LogicalPlan.org$apache$spark$sql$catalyst$plans$logical$AnalysisHelper$$super$transformDownWithPruning(LogicalPlan.scala:32)
     at org.apache.spark.sql.catalyst.plans.logical.AnalysisHelper.transformDownWithPruning(AnalysisHelper.scala:267)
     at org.apache.spark.sql.catalyst.plans.logical.AnalysisHelper.transformDownWithPruning$(AnalysisHelper.scala:263)
     at org.apache.spark.sql.catalyst.plans.logical.LogicalPlan.transformDownWithPruning(LogicalPlan.scala:32)
     at org.apache.spark.sql.catalyst.plans.logical.LogicalPlan.transformDownWithPruning(LogicalPlan.scala:32)
     at org.apache.spark.sql.catalyst.trees.TreeNode.transformDown(TreeNode.scala:437)
     at org.apache.spark.sql.catalyst.trees.TreeNode.transform(TreeNode.scala:405)
     at org.apache.spark.sql.execution.datasources.v2.OptimizeMetadataOnlyDeleteFromTable$.apply(OptimizeMetadataOnlyDeleteFromTable.scala:39)
     at org.apache.spark.sql.execution.datasources.v2.OptimizeMetadataOnlyDeleteFromTable$.apply(OptimizeMetadataOnlyDeleteFromTable.scala:37)
     at org.apache.spark.sql.catalyst.rules.RuleExecutor.$anonfun$execute$2(RuleExecutor.scala:222)
     at scala.collection.LinearSeqOptimized.foldLeft(LinearSeqOptimized.scala:126)
     at scala.collection.LinearSeqOptimized.foldLeft$(LinearSeqOptimized.scala:122)
     at scala.collection.immutable.List.foldLeft(List.scala:91)
     at org.apache.spark.sql.catalyst.rules.RuleExecutor.$anonfun$execute$1(RuleExecutor.scala:219)
     at org.apache.spark.sql.catalyst.rules.RuleExecutor.$anonfun$execute$1$adapted(RuleExecutor.scala:211)
     at scala.collection.immutable.List.foreach(List.scala:431)
     at org.apache.spark.sql.catalyst.rules.RuleExecutor.execute(RuleExecutor.scala:211)
     at org.apache.spark.sql.catalyst.rules.RuleExecutor.$anonfun$executeAndTrack$1(RuleExecutor.scala:182)
     at org.apache.spark.sql.catalyst.QueryPlanningTracker$.withTracker(QueryPlanningTracker.scala:89)
     at org.apache.spark.sql.catalyst.rules.RuleExecutor.executeAndTrack(RuleExecutor.scala:182)
     at org.apache.spark.sql.execution.QueryExecution.$anonfun$optimizedPlan$1(QueryExecution.scala:152)
     at org.apache.spark.sql.catalyst.QueryPlanningTracker.measurePhase(QueryPlanningTracker.scala:138)
     at org.apache.spark.sql.execution.QueryExecution.$anonfun$executePhase$2(QueryExecution.scala:219)
     at org.apache.spark.sql.execution.QueryExecution$.withInternalError(QueryExecution.scala:546)
     at org.apache.spark.sql.execution.QueryExecution.$anonfun$executePhase$1(QueryExecution.scala:219)
     at org.apache.spark.sql.SparkSession.withActive(SparkSession.scala:900)
     at org.apache.spark.sql.execution.QueryExecution.executePhase(QueryExecution.scala:218)
     at org.apache.spark.sql.execution.QueryExecution.optimizedPlan$lzycompute(QueryExecution.scala:148)
     at org.apache.spark.sql.execution.QueryExecution.optimizedPlan(QueryExecution.scala:144)
     at org.apache.spark.sql.execution.QueryExecution.assertOptimized(QueryExecution.scala:162)
     at org.apache.spark.sql.execution.QueryExecution.executedPlan$lzycompute(QueryExecution.scala:182)
     at org.apache.spark.sql.execution.QueryExecution.executedPlan(QueryExecution.scala:179)
     at org.apache.spark.sql.execution.QueryExecution.simpleString(QueryExecution.scala:238)
     at org.apache.spark.sql.execution.QueryExecution.org$apache$spark$sql$execution$QueryExecution$$explainString(QueryExecution.scala:284)
     at org.apache.spark.sql.execution.QueryExecution.explainString(QueryExecution.scala:252)
     at org.apache.spark.sql.execution.SQLExecution$.$anonfun$withNewExecutionId$6(SQLExecution.scala:117)
     at org.apache.spark.sql.execution.SQLExecution$.withSQLConfPropagated(SQLExecution.scala:201)
     at org.apache.spark.sql.execution.SQLExecution$.$anonfun$withNewExecutionId$1(SQLExecution.scala:108)
     at org.apache.spark.sql.SparkSession.withActive(SparkSession.scala:900)
     at org.apache.spark.sql.execution.SQLExecution$.withNewExecutionId(SQLExecution.scala:66)
     at org.apache.spark.sql.execution.QueryExecution$$anonfun$eagerlyExecuteCommands$1.applyOrElse(QueryExecution.scala:107)
     at org.apache.spark.sql.execution.QueryExecution$$anonfun$eagerlyExecuteCommands$1.applyOrElse(QueryExecution.scala:98)
     at org.apache.spark.sql.catalyst.trees.TreeNode.$anonfun$transformDownWithPruning$1(TreeNode.scala:461)
     at org.apache.spark.sql.catalyst.trees.CurrentOrigin$.withOrigin(origin.scala:76)
     at org.apache.spark.sql.catalyst.trees.TreeNode.transformDownWithPruning(TreeNode.scala:461)
     at org.apache.spark.sql.catalyst.plans.logical.LogicalPlan.org$apache$spark$sql$catalyst$plans$logical$AnalysisHelper$$super$transformDownWithPruning(LogicalPlan.scala:32)
     at org.apache.spark.sql.catalyst.plans.logical.AnalysisHelper.transformDownWithPruning(AnalysisHelper.scala:267)
     at org.apache.spark.sql.catalyst.plans.logical.AnalysisHelper.transformDownWithPruning$(AnalysisHelper.scala:263)
     at org.apache.spark.sql.catalyst.plans.logical.LogicalPlan.transformDownWithPruning(LogicalPlan.scala:32)
     at org.apache.spark.sql.catalyst.plans.logical.LogicalPlan.transformDownWithPruning(LogicalPlan.scala:32)
     at org.apache.spark.sql.catalyst.trees.TreeNode.transformDown(TreeNode.scala:437)
     at org.apache.spark.sql.execution.QueryExecution.eagerlyExecuteCommands(QueryExecution.scala:98)
     at org.apache.spark.sql.execution.QueryExecution.commandExecuted$lzycompute(QueryExecution.scala:85)
     at org.apache.spark.sql.execution.QueryExecution.commandExecuted(QueryExecution.scala:83)
     at org.apache.spark.sql.Dataset.<init>(Dataset.scala:220)
     at org.apache.spark.sql.Dataset$.$anonfun$ofRows$2(Dataset.scala:100)
     at org.apache.spark.sql.SparkSession.withActive(SparkSession.scala:900)
     at org.apache.spark.sql.Dataset$.ofRows(Dataset.scala:97)
     at org.apache.spark.sql.SparkSession.$anonfun$sql$4(SparkSession.scala:691)
     at org.apache.spark.sql.SparkSession.withActive(SparkSession.scala:900)
     at org.apache.spark.sql.SparkSession.sql(SparkSession.scala:682)
     at org.apache.spark.sql.SparkSession.sql(SparkSession.scala:713)
     at org.apache.spark.sql.SparkSession.sql(SparkSession.scala:744)
     ... 47 elided
   ```
   
   ### Willingness to contribute
   
   - [ ] I can contribute a fix for this bug independently
   - [x] I would be willing to contribute a fix for this bug with guidance from the Iceberg community
   - [ ] I cannot contribute a fix for this bug at this time


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org


Re: [I] Avro version incompatible with Spark 3.5/3.4 [iceberg]

Posted by "qinghui-xu (via GitHub)" <gi...@apache.org>.
qinghui-xu commented on issue #14232:
URL: https://github.com/apache/iceberg/issues/14232#issuecomment-3363045480

   Hello @nastra 
   I can provide a trivial example for simplicity, which results in an error of the same kind
   ```
   $ spark-shell --deploy-mode client --jars path/to/iceberg.jar --conf spark.sql.catalog.iceberg=org.apache.iceberg.spark.SparkCatalog --conf spark.sql.catalog.iceberg.warehouse=/path/to/dwh/root --conf spark.sql.catalog.iceberg.type=hadoop
   
   scala> spark.sql("create table iceberg.test (uname STRING, create_date INT, uid INT) TBLPROPERTIES ('format' = 'iceberg/parquet', 'format-version' = '2',  'identifier-fields' = '[uid]', 'bwrite.distribution-mode' = 'hash', 'write.upsert.enabled' = 'true')")
   
   scala> spark.sql("select * from iceberg.test").show()
   +-----+-----------+---+
   |uname|create_date|uid|
   +-----+-----------+---+
   +-----+-----------+---+
   
   scala> spark.sql("delete from iceberg.test where uid = 0")
   java.lang.NoSuchMethodError: 'org.apache.avro.LogicalTypes$TimestampNanos org.apache.avro.LogicalTypes.timestampNanos()'
     at org.apache.iceberg.avro.TypeToSchema.<clinit>(TypeToSchema.java:50)
     at org.apache.iceberg.avro.AvroSchemaUtil.convert(AvroSchemaUtil.java:64)
     at org.apache.iceberg.avro.AvroSchemaUtil.convert(AvroSchemaUtil.java:59)
     at org.apache.iceberg.avro.Avro$WriteBuilder.build(Avro.java:211)
     at org.apache.iceberg.ManifestListWriter$V2Writer.newAppender(ManifestListWriter.java:219)
     at org.apache.iceberg.ManifestListWriter.<init>(ManifestListWriter.java:34)
     at org.apache.iceberg.ManifestListWriter$V2Writer.<init>(ManifestListWriter.java:196)
     at org.apache.iceberg.ManifestLists.write(ManifestLists.java:65)
     at org.apache.iceberg.SnapshotProducer.apply(SnapshotProducer.java:266)
     at org.apache.iceberg.StreamingDelete.apply(StreamingDelete.java:24)
     at org.apache.iceberg.SnapshotProducer.lambda$commit$2(SnapshotProducer.java:440)
     at org.apache.iceberg.util.Tasks$Builder.runTaskWithRetry(Tasks.java:413)
     at org.apache.iceberg.util.Tasks$Builder.runSingleThreaded(Tasks.java:219)
     at org.apache.iceberg.util.Tasks$Builder.run(Tasks.java:203)
     at org.apache.iceberg.util.Tasks$Builder.run(Tasks.java:196)
     at org.apache.iceberg.SnapshotProducer.commit(SnapshotProducer.java:438)
     at org.apache.iceberg.StreamingDelete.commit(StreamingDelete.java:24)
     at org.apache.iceberg.spark.source.SparkTable.deleteWhere(SparkTable.java:411)
     at org.apache.spark.sql.execution.datasources.v2.DeleteFromTableExec.run(DeleteFromTableExec.scala:31)
     at org.apache.spark.sql.execution.datasources.v2.V2CommandExec.result$lzycompute(V2CommandExec.scala:43)
     at org.apache.spark.sql.execution.datasources.v2.V2CommandExec.result(V2CommandExec.scala:43)
     at org.apache.spark.sql.execution.datasources.v2.V2CommandExec.executeCollect(V2CommandExec.scala:49)
     at org.apache.spark.sql.execution.QueryExecution$$anonfun$eagerlyExecuteCommands$1.$anonfun$applyOrElse$1(QueryExecution.scala:107)
     at org.apache.spark.sql.execution.SQLExecution$.$anonfun$withNewExecutionId$6(SQLExecution.scala:125)
     at org.apache.spark.sql.execution.SQLExecution$.withSQLConfPropagated(SQLExecution.scala:201)
     at org.apache.spark.sql.execution.SQLExecution$.$anonfun$withNewExecutionId$1(SQLExecution.scala:108)
     at org.apache.spark.sql.SparkSession.withActive(SparkSession.scala:900)
     at org.apache.spark.sql.execution.SQLExecution$.withNewExecutionId(SQLExecution.scala:66)
     at org.apache.spark.sql.execution.QueryExecution$$anonfun$eagerlyExecuteCommands$1.applyOrElse(QueryExecution.scala:107)
     at org.apache.spark.sql.execution.QueryExecution$$anonfun$eagerlyExecuteCommands$1.applyOrElse(QueryExecution.scala:98)
     at org.apache.spark.sql.catalyst.trees.TreeNode.$anonfun$transformDownWithPruning$1(TreeNode.scala:461)
     at org.apache.spark.sql.catalyst.trees.CurrentOrigin$.withOrigin(origin.scala:76)
     at org.apache.spark.sql.catalyst.trees.TreeNode.transformDownWithPruning(TreeNode.scala:461)
     at org.apache.spark.sql.catalyst.plans.logical.LogicalPlan.org$apache$spark$sql$catalyst$plans$logical$AnalysisHelper$$super$transformDownWithPruning(LogicalPlan.scala:32)
     at org.apache.spark.sql.catalyst.plans.logical.AnalysisHelper.transformDownWithPruning(AnalysisHelper.scala:267)
     at org.apache.spark.sql.catalyst.plans.logical.AnalysisHelper.transformDownWithPruning$(AnalysisHelper.scala:263)
     at org.apache.spark.sql.catalyst.plans.logical.LogicalPlan.transformDownWithPruning(LogicalPlan.scala:32)
     at org.apache.spark.sql.catalyst.plans.logical.LogicalPlan.transformDownWithPruning(LogicalPlan.scala:32)
     at org.apache.spark.sql.catalyst.trees.TreeNode.transformDown(TreeNode.scala:437)
     at org.apache.spark.sql.execution.QueryExecution.eagerlyExecuteCommands(QueryExecution.scala:98)
     at org.apache.spark.sql.execution.QueryExecution.commandExecuted$lzycompute(QueryExecution.scala:85)
     at org.apache.spark.sql.execution.QueryExecution.commandExecuted(QueryExecution.scala:83)
     at org.apache.spark.sql.Dataset.<init>(Dataset.scala:220)
     at org.apache.spark.sql.Dataset$.$anonfun$ofRows$2(Dataset.scala:100)
     at org.apache.spark.sql.SparkSession.withActive(SparkSession.scala:900)
     at org.apache.spark.sql.Dataset$.ofRows(Dataset.scala:97)
     at org.apache.spark.sql.SparkSession.$anonfun$sql$4(SparkSession.scala:691)
     at org.apache.spark.sql.SparkSession.withActive(SparkSession.scala:900)
     at org.apache.spark.sql.SparkSession.sql(SparkSession.scala:682)
     at org.apache.spark.sql.SparkSession.sql(SparkSession.scala:713)
     at org.apache.spark.sql.SparkSession.sql(SparkSession.scala:744)
     ... 47 elided
   ```
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org


Re: [I] Avro version incompatible with Spark 3.5/3.4 [iceberg]

Posted by "nastra (via GitHub)" <gi...@apache.org>.
nastra commented on issue #14232:
URL: https://github.com/apache/iceberg/issues/14232#issuecomment-3361311770

   @qinghui-xu do you have a simple reproducible example?


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org


Re: [I] Avro version incompatible with Spark 3.5/3.4 [iceberg]

Posted by "qinghui-xu (via GitHub)" <gi...@apache.org>.
qinghui-xu commented on issue #14232:
URL: https://github.com/apache/iceberg/issues/14232#issuecomment-3370429227

   I confirm that removing `iceberg-parquet` from my uberjar fixes the problem. I'll propose some doc changes to the README, or do you think there's better places for it?
   Btw, this looks like to be the same situation for flink as well.
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org


Re: [I] Avro version incompatible with Spark 3.5/3.4 [iceberg]

Posted by "qinghui-xu (via GitHub)" <gi...@apache.org>.
qinghui-xu commented on issue #14232:
URL: https://github.com/apache/iceberg/issues/14232#issuecomment-3365813781

   Sure. It's just not very clear to me what's included in the `iceberg-spark-runtime`, maybe all the modules?


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org


Re: [I] Avro version incompatible with Spark 3.5/3.4 [iceberg]

Posted by "nastra (via GitHub)" <gi...@apache.org>.
nastra closed issue #14232: Avro version incompatible with Spark 3.5/3.4
URL: https://github.com/apache/iceberg/issues/14232


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org


Re: [I] Avro version incompatible with Spark 3.5/3.4 [iceberg]

Posted by "qinghui-xu (via GitHub)" <gi...@apache.org>.
qinghui-xu commented on issue #14232:
URL: https://github.com/apache/iceberg/issues/14232#issuecomment-3363052188

   My workaround is to relocate the avro in my uberjar, not sure if this is something we want to do in the project?


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org


Re: [I] Avro version incompatible with Spark 3.5/3.4 [iceberg]

Posted by "qinghui-xu (via GitHub)" <gi...@apache.org>.
qinghui-xu commented on issue #14232:
URL: https://github.com/apache/iceberg/issues/14232#issuecomment-3365534539

   Maybe this is the issue: I included `iceberg-parquet` into the classpath (alongside `iceberg-spark-runtime`). But I don't see contraindication in the doc of doing this.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org


Re: [I] Avro version incompatible with Spark 3.5/3.4 [iceberg]

Posted by "RussellSpitzer (via GitHub)" <gi...@apache.org>.
RussellSpitzer commented on issue #14232:
URL: https://github.com/apache/iceberg/issues/14232#issuecomment-3365655560

   Generally you should not re-include repackaged libraries when using an Uber jar. We could add this explicitly to the docs but this is a general Java principle since reflection can get weird...


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org