You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@iceberg.apache.org by "yassinedeeb (via GitHub)" <gi...@apache.org> on 2026/03/30 10:35:09 UTC

Re: [I] Kafka Connect sink fails to write snapshot when using dynamic routing with SMTs [iceberg]

yassinedeeb commented on issue #13457:
URL: https://github.com/apache/iceberg/issues/13457#issuecomment-4153976238

   the same issue here with 1.10.1
   
   ```
   apiVersion: kafka.strimzi.io/v1
   kind: KafkaConnector
   metadata:
     name: iceberg-sink-connector-rest
     labels:
       strimzi.io/cluster: wdc-kafka-connect-cluster
   spec:
     class: org.apache.iceberg.connect.IcebergSinkConnector 
     tasksMax: 1
     config:
       topics.regex: "server1.DB_USER.*"
       key.converter: "org.apache.kafka.connect.json.JsonConverter"
       key.converter.schemas.enable: "true"
       value.converter: "org.apache.kafka.connect.json.JsonConverter"
       value.converter.schemas.enable: "true"
       iceberg.control.commit.interval.ms: "60000"    
       iceberg.tables.auto-create-enabled: "true"     
       iceberg.tables.evolve-schema-enabled: "true" 
   
       iceberg.tables.dynamic-enabled: "true"
       iceberg.tables.route-field: "_kafka_metadata_topic"
       
       iceberg.tables.cdc-field: "_cdc.op"
      
       transforms: "debezium,routeRecords,kafkaMetadata"
       
       transforms.debezium.type: "org.apache.iceberg.connect.transforms.DebeziumTransform"
   
       transforms.routeRecords.type: "org.apache.kafka.connect.transforms.RegexRouter"
       transforms.routeRecords.regex: "^server1\\.DB_USER\\.(.*)$"
       transforms.routeRecords.replacement: "oracle.$1"
   
       transforms.kafkaMetadata.type: "org.apache.iceberg.connect.transforms.KafkaMetadataTransform"
   
       iceberg.catalog: iceberg
       iceberg.catalog.type: rest
       iceberg.catalog.uri: "http://xxxxxxx:19120/iceberg"
       iceberg.catalog.io-impl: org.apache.iceberg.aws.s3.S3FileIO
       iceberg.catalog.s3.endpoint: "http://xxxxxxxx/"
       iceberg.catalog.warehouse: s3://xxxxxx
   
       iceberg.catalog.s3.path-style-access: "true" 
       iceberg.catalog.s3.access-key-id: "xxxxxx"
       iceberg.catalog.s3.secret-access-key: "xxxxxx"
       iceberg.catalog.client.region: "us-east-1"
       iceberg.catalog.s3.force-path-style: "true"
   
   ```
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org