You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@iceberg.apache.org by "raphaelauv (via GitHub)" <gi...@apache.org> on 2025/07/07 09:58:21 UTC

[I] Kafka-connect 1.9.1 - avro timestampNanos NoSuchMethodError [iceberg]

raphaelauv opened a new issue, #13481:
URL: https://github.com/apache/iceberg/issues/13481

   ### Apache Iceberg version
   
   None
   
   ### Query engine
   
   None
   
   ### Please describe the bug 🐞
   
   Using iceberg kafka connector 1.9.1 I have this bug ( that I do not have with 1.7.1 )
   
   
   ```log
   Exception in thread "iceberg-coord" java.lang.NoSuchMethodError: 'org.apache.avro.LogicalTypes$TimestampNanos org.apache.avro.LogicalTypes.timestampNanos()'
   2025-07-07T09:55:17.895296127Z 	at org.apache.iceberg.avro.TypeToSchema.<clinit>(TypeToSchema.java:50)
   2025-07-07T09:55:17.895301918Z 	at org.apache.iceberg.avro.AvroSchemaUtil.convert(AvroSchemaUtil.java:81)
   2025-07-07T09:55:17.895307210Z 	at org.apache.iceberg.connect.events.AvroUtil.convert(AvroUtil.java:80)
   2025-07-07T09:55:17.895309335Z 	at org.apache.iceberg.connect.events.AvroUtil.convert(AvroUtil.java:73)
   2025-07-07T09:55:17.895311293Z 	at org.apache.iceberg.connect.events.StartCommit.<clinit>(StartCommit.java:41)
   2025-07-07T09:55:17.895429460Z 	at org.apache.iceberg.connect.channel.Coordinator.process(Coordinator.java:103)
   2025-07-07T09:55:17.895457043Z 	at org.apache.iceberg.connect.channel.CoordinatorThread.run(CoordinatorThread.java:47)
   ```
   
   I'm also using the jar confluentinc/kafka-connect-avro-converter:7.9.2
   for
   
   ```json
   {
       "key.converter": "io.confluent.connect.avro.AvroConverter",
       "value.converter": "io.confluent.connect.avro.AvroConverter",
       "key.converter.schema.registry.url": "http://confluent-schema-registry-local:8081",
       "value.converter.schema.registry.url": "http://confluent-schema-registry-local:8081",
   }
   ```
   
   ### Willingness to contribute
   
   - [ ] I can contribute a fix for this bug independently
   - [ ] I would be willing to contribute a fix for this bug with guidance from the Iceberg community
   - [ ] I cannot contribute a fix for this bug at this time


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org


Re: [I] iceberg Kafka-connect - 1.9.1 - avro timestampNanos NoSuchMethodError [iceberg]

Posted by "lkindere (via GitHub)" <gi...@apache.org>.
lkindere commented on issue #13481:
URL: https://github.com/apache/iceberg/issues/13481#issuecomment-3078256998

   I'm also having the same issue, any luck finding a solution so far?


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org


Re: [I] iceberg Kafka-connect - 1.9.1 - avro timestampNanos NoSuchMethodError [iceberg]

Posted by "ccfelius (via GitHub)" <gi...@apache.org>.
ccfelius commented on issue #13481:
URL: https://github.com/apache/iceberg/issues/13481#issuecomment-3213333671

   I'm also running into this issue but for the Iceberg Java api. Like @lkindere, shading avro 1.12.0 solved the issue for me too.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org


Re: [I] iceberg Kafka-connect - 1.9.1 - avro timestampNanos NoSuchMethodError [iceberg]

Posted by "paolo-cristofanelli (via GitHub)" <gi...@apache.org>.
paolo-cristofanelli commented on issue #13481:
URL: https://github.com/apache/iceberg/issues/13481#issuecomment-3062177184

   Could it be that kafka-connect-avro-converter 7.9.2 uses avro-11.4 ( I am looking [here](https://mvnrepository.com/artifact/io.confluent/kafka-connect-avro-converter/7.9.2) ) whereas iceberg-1.9.1 uses avro-12.0 (that introduced that type)? 


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org


Re: [I] iceberg Kafka-connect - 1.9.1 / 1.10.0 - avro timestampNanos NoSuchMethodError [iceberg]

Posted by "ccfelius (via GitHub)" <gi...@apache.org>.
ccfelius commented on issue #13481:
URL: https://github.com/apache/iceberg/issues/13481#issuecomment-3577542792

   @raphaelauv I do not think you should close this issue, because this bug is not Kafka specific and should be resolved properly imho


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org


Re: [I] iceberg Kafka-connect - 1.9.1 / 1.10.0 - avro timestampNanos NoSuchMethodError [iceberg]

Posted by "raphaelauv (via GitHub)" <gi...@apache.org>.
raphaelauv commented on issue #13481:
URL: https://github.com/apache/iceberg/issues/13481#issuecomment-3576625305

   yes doing 
   
   ```Dockerfile
   RUN rm /opt/kafka/libs/avro-1.11.4.jar
   RUN wget --progress=dot:giga https://repo1.maven.org/maven2/org/apache/avro/avro/1.12.1/avro-1.12.1.jar \
       -P /opt/kafka/libs/
   ```
   
   make it works


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org


Re: [I] iceberg Kafka-connect - 1.9.1 - avro timestampNanos NoSuchMethodError [iceberg]

Posted by "raphaelauv (via GitHub)" <gi...@apache.org>.
raphaelauv commented on issue #13481:
URL: https://github.com/apache/iceberg/issues/13481#issuecomment-3062572183

   that was also my firt idea but iceberg 1.8.1 is already using the version 1.12.0 of avro https://github.com/apache/iceberg/blob/9ce0fcf0af7becf25ad9fc996c3bad2afdcfd33d/gradle/libs.versions.toml#L29


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org


Re: [I] iceberg Kafka-connect - 1.9.1 / 1.10.0 - avro timestampNanos NoSuchMethodError [iceberg]

Posted by "raphaelauv (via GitHub)" <gi...@apache.org>.
raphaelauv closed issue #13481: iceberg Kafka-connect - 1.9.1 / 1.10.0 - avro timestampNanos NoSuchMethodError
URL: https://github.com/apache/iceberg/issues/13481


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org