You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@iceberg.apache.org by "hguercan (via GitHub)" <gi...@apache.org> on 2025/08/07 19:39:17 UTC
[I] Duplicate file path found in Iceberg metadata snapshot [iceberg]
hguercan opened a new issue, #13763:
URL: https://github.com/apache/iceberg/issues/13763
### Apache Iceberg version
None
### Query engine
None
### Please describe the bug 🐞
Hello everyone,
Our Architecture is to stream data via kafka and ingest the data via kafka-connect with the iceberg-sink-connector with iceberg 1.9.2 to our Azure Blob Storage against Polaris Catalog in version 1.0.0-incubating. Maintenance is done via DBX Spark in version 3.5.2 also with iceberg version 3.5.2 with partial-progress.enabled. We recently changed that spark option to true before we did not see the issue.
When working with Spark there is no issue but when we import the data into Snowflake the error message pops up.
`SQL execution error: Duplicate file path found in the Iceberg metadata snapshot. Please check that your Iceberg metadata generation is producing valid manifest files and refresh to a newer snapshot once fixed. File path: '<irrelevant-prefix>created_at_day=2025-08-06/country_code=<counry_code>/entity_number=<irrelevant>/00001-xxxxxxxxx*-.parquet`.
When going down from the snapshot to the manifest file we really see a duplicate entry for the file.
`
{"status":0,"snapshot_id":{"long":7127004696002716753},"sequence_number":{"long":59331},"file_sequence_number":{"long":59331},"data_file":{"content":0,"file_path":"abfss://<masked-path-prefix>/xxxx/xxx/<table-name>/data/created_at_day=2025-08-05/country_code=<country_code>/entity_number=<irrelevant>/00001-1754381332739-c55fd420-b673-45ec-be45-35408bf4e650-00001.parquet","file_format":"PARQUET","partition":{"created_at_day":{"int":20305},"country_code":{"string":"<country_code>"},"entity_number":{"string":"<irrelevant>"}},"record_count":307,"file_size_in_bytes":25282,"column_sizes":{"array":[]},"value_counts":{"array":[]},"null_value_counts":{"array":[]},"nan_value_counts":{"array":[]},"lower_bounds":{"array":[]},"upper_bounds":{"array":[]},"key_metadata":null,"split_offsets":{"array":[4]},"equality_ids":null,"sort_order_id":{"int":0},"referenced_data_file":null}}
{"status":0,"snapshot_id":{"long":1026760103416329420},"sequence_number":{"long":59330},"file_sequence_number":{"long":59330},"data_file":{"content":0,"file_path":"abfss://<masked-path-prefix>/xxxx/xxx/<table-name>/data/created_at_day=2025-08-05/country_code=<country_code>/entity_number=<irrelevant>/00001-1754381332739-c55fd420-b673-45ec-be45-35408bf4e650-00001.parquet","file_format":"PARQUET","partition":{"created_at_day":{"int":20305},"country_code":{"string":"<country_code>"},"entity_number":{"string":"<irrelevant>"}},"record_count":307,"file_size_in_bytes":25282,"column_sizes":{"array":[]},"value_counts":{"array":[]},"null_value_counts":{"array":[]},"nan_value_counts":{"array":[]},"lower_bounds":{"array":[]},"upper_bounds":{"array":[]},"key_metadata":null,"split_offsets":{"array":[4]},"equality_ids":null,"sort_order_id":{"int":0},"referenced_data_file":null}}
`
I masked some parts but relevant is that the path location, record_count and file_size_in_bytes is same.
What differs is the snapshot_id, sequence_number and file_in_sequence_number.
Running our maintenance job again with manifest_rewrite but partial-progress.enabled true was not solving the issue. By disabling it and running the manifest_rewrite a first try solved the issue.
### Willingness to contribute
- [ ] I can contribute a fix for this bug independently
- [x] I would be willing to contribute a fix for this bug with guidance from the Iceberg community
- [ ] I cannot contribute a fix for this bug at this time
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org
Re: [I] Duplicate file path found in Iceberg metadata snapshot [iceberg]
Posted by "kumarpritam863 (via GitHub)" <gi...@apache.org>.
kumarpritam863 commented on issue #13763:
URL: https://github.com/apache/iceberg/issues/13763#issuecomment-3266104677
@lkindere are you seeing duplicates with the 1.8.1 iceberg sink connector version?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org
Re: [I] Duplicate file path found in Iceberg metadata snapshot [iceberg]
Posted by "hguercan (via GitHub)" <gi...@apache.org>.
hguercan commented on issue #13763:
URL: https://github.com/apache/iceberg/issues/13763#issuecomment-3455608829
Hi @kumarpritam863 is there any update from your side?
The latest changes of https://github.com/apache/iceberg/pull/13461 could be a hot candidate as its the only change from 1.9.1 to 1.9.2
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org
Re: [I] Duplicate file path found in Iceberg metadata snapshot [iceberg]
Posted by "kumarpritam863 (via GitHub)" <gi...@apache.org>.
kumarpritam863 commented on issue #13763:
URL: https://github.com/apache/iceberg/issues/13763#issuecomment-3461984904
@hguercan sorry I mis-read your message. Yes these rest changes are causing theses issues and I think even a PR has been created to address this issue.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org
Re: [I] Duplicate file path found in Iceberg metadata snapshot [iceberg]
Posted by "kumarpritam863 (via GitHub)" <gi...@apache.org>.
kumarpritam863 commented on issue #13763:
URL: https://github.com/apache/iceberg/issues/13763#issuecomment-3461970919
@hguercan It was already discussed last time that this issue even occurs in the 1.8.2 version and the change that was made in rest catalog in 1.9 version was causing this issue.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org
Re: [I] Duplicate file path found in Iceberg metadata snapshot [iceberg]
Posted by "goktugkose (via GitHub)" <gi...@apache.org>.
goktugkose commented on issue #13763:
URL: https://github.com/apache/iceberg/issues/13763#issuecomment-3190729865
> > We have encountered the same issue when rewriting data files. Similar to [@hguercan](https://github.com/hguercan)'s approach, we wrote a Spark SQL query to check whether different snapshots use the same data file. Also, we have noticed that pausing the Sink Connector does not stop all processes that belong to the sink tasks since INFO-level logs are still produced by those tasks. It seems that [@kumarpritam863](https://github.com/kumarpritam863) addressed these two items in [#13756](https://github.com/apache/iceberg/pull/13756).
> > Thanks for your effort 🚀
> > ```
> > df= spark.sql(
> > f"""
> > SELECT
> > data_file.file_path AS file_path,
> > COUNT(DISTINCT snapshot_id) AS distinct_snapshots
> > FROM `{CATALOG}`.`{DATASET}`.`{TABLE_NAME}`.entries e
> > GROUP BY data_file.file_path
> > HAVING COUNT(DISTINCT snapshot_id) > 1;
> > """
> > )
> > ```
>
> By any chance are you using CFK for controlling the connectors? I could see the same behaviour today on our dev cluster where i had a lot of logs from connectors that i already had "deleted". Only restarting the connect cluster lead to an expected state.
>
> EDIT: The reason i am pointing this out is probably the issues we are seeing are based on a connector still is "working" in parallel although it should be deleted and the Connect Cluster is not recognizing?!
We are using [this](https://hub.docker.com/layers/confluentinc/cp-kafka-connect-base/6.2.2/images/sha256-772eba973eafeae3b4eee9bae536e726f1a951efc45cc33a3be87344c759fe57) image in our stage environments. Even though it was not the expected case, you're also pointing out the same behavior that I've mentioned before. Somehow, the connector does not comply with the Connect cluster.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org
Re: [I] Duplicate file path found in Iceberg metadata snapshot [iceberg]
Posted by "kumarpritam863 (via GitHub)" <gi...@apache.org>.
kumarpritam863 commented on issue #13763:
URL: https://github.com/apache/iceberg/issues/13763#issuecomment-3168003619
But still just to be sure there is no issue with the iceberg sink, I will double check and update if I can find anything on this.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org
Re: [I] Duplicate file path found in Iceberg metadata snapshot [iceberg]
Posted by "kumarpritam863 (via GitHub)" <gi...@apache.org>.
kumarpritam863 commented on issue #13763:
URL: https://github.com/apache/iceberg/issues/13763#issuecomment-3258534845
@lkindere I do not see 1.8.2 version. Did you mean 1.8.1 version and also are you using rest catalog?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org
Re: [I] Duplicate file path found in Iceberg metadata snapshot [iceberg]
Posted by "tongwai-wong-appier (via GitHub)" <gi...@apache.org>.
tongwai-wong-appier commented on issue #13763:
URL: https://github.com/apache/iceberg/issues/13763#issuecomment-4426850286
We opened #16282 for what appears to be the same symptom, but with a more specific trigger path on the Kafka Connect sink side.
In our case, the issue happens during coordinator switchover after a Kafka timeout: the old coordinator can successfully commit file `X`, but before the control-topic offset is advanced, a new coordinator may re-consume stale `DATA_WRITTEN(file X)` and commit the same file again.
The key reason this can still happen is:
- Iceberg commit and control-topic offset advancement are not atomic
- the append path does not check whether `file_path` is already registered in the table
So from our investigation, #13756 may help reduce zombie coordinator behavior, but it does not fully prevent duplicate file re-registration in the append-only case.
Linking here for visibility: #16282
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org
Re: [I] Duplicate file path found in Iceberg metadata snapshot [iceberg]
Posted by "kumarpritam863 (via GitHub)" <gi...@apache.org>.
kumarpritam863 commented on issue #13763:
URL: https://github.com/apache/iceberg/issues/13763#issuecomment-4442414832
That is what I am saying a worker cannot do this. As soon as a start commit is recieved a file is flushed, record metadata is written to control topic and offsets are committed in the same transaction.
Can you check if the version you are using has these fixes
https://github.com/apache/iceberg/pull/14525 and https://github.com/apache/iceberg/pull/14510
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org
Re: [I] Duplicate file path found in Iceberg metadata snapshot [iceberg]
Posted by "hguercan (via GitHub)" <gi...@apache.org>.
hguercan commented on issue #13763:
URL: https://github.com/apache/iceberg/issues/13763#issuecomment-3210443481
Thanks to @yogevyuval he put our attention to the high number of "added-data-files" where the duplicate file path references are happening. We checked the commits before and the number is insanely high. For the other commits its mostly two to three digits and occasionally some thousands but never that huge as "46015" or "236825". Accordingly it behaves the same with the "added-records" and "added-files-size".
We are not sure how this could be explained by having such a big number. The operation-type we are seeing before that failure/duplicate containing commits were maintenance jobs (replace type).
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org
Re: [I] Duplicate file path found in Iceberg metadata snapshot [iceberg]
Posted by "yogevyuval (via GitHub)" <gi...@apache.org>.
yogevyuval commented on issue #13763:
URL: https://github.com/apache/iceberg/issues/13763#issuecomment-3165547838
@hguercan This potentially is an issue with the sink connector. One validation to do is to figure out in which snapshot did this file originate (was it append or replace), to identify if it came from ingestion / other services.
Similar bug occured in other ingestion platforms, where retrying the same file caused this
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org
Re: [I] Duplicate file path found in Iceberg metadata snapshot [iceberg]
Posted by "hguercan (via GitHub)" <gi...@apache.org>.
hguercan commented on issue #13763:
URL: https://github.com/apache/iceberg/issues/13763#issuecomment-3179462162
> Also, we have noticed that pausing the Sink Connector does not stop all processes that belong to the sink tasks since INFO-level logs are still produced by those tasks.
Could this explain one of the sink tasks is not checking for the latest snapshot and putting the duplicate or both are having the same state (so retrieved latest snapshot) and a commit happens almost in parallel ?!
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org
Re: [I] Duplicate file path found in Iceberg metadata snapshot [iceberg]
Posted by "kumarpritam863 (via GitHub)" <gi...@apache.org>.
kumarpritam863 commented on issue #13763:
URL: https://github.com/apache/iceberg/issues/13763#issuecomment-3167998809
@hguercan I do not think this can happen with sink because of the following two reasons:
1. File metadata commit and offset commit are tied up in a transaction. So either file are written along with the offset commit or nothing will happen. Even the coordinator before committing metadata checks for the control offsets being written, even if coordinator commits metadata and could not commit it's kafka offset then in that case it will just sips those as it would compare and it will find that it has already written those to the table.
2. Iceberg does not allow this and you initial spark query would itself fail giving error.
3. If you see this thread on [slack](https://apache-iceberg.slack.com/archives/C025PH0G1D4/p1698676018510089), they are writing data with spark streaming and still facing this issue.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org
Re: [I] Duplicate file path found in Iceberg metadata snapshot [iceberg]
Posted by "goktugkose (via GitHub)" <gi...@apache.org>.
goktugkose commented on issue #13763:
URL: https://github.com/apache/iceberg/issues/13763#issuecomment-3175870315
We have encountered the same issue when rewriting data files. Similar to @hguercan's approach, we wrote a Spark SQL query to check whether different snapshots use the same data file. Also, we have noticed that pausing the Sink Connector does not stop all processes that belong to the sink tasks since INFO-level logs are still produced by those tasks. It seems that @kumarpritam863 addressed these two items in #13756.
Thanks for your effort 🚀
```
df= spark.sql(
f"""
SELECT
data_file.file_path AS file_path,
COUNT(DISTINCT snapshot_id) AS distinct_snapshots
FROM `{CATALOG}`.`{DATASET}`.`{TABLE_NAME}`.entries e
GROUP BY data_file.file_path
HAVING COUNT(DISTINCT snapshot_id) > 1;
"""
)
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org
Re: [I] Duplicate file path found in Iceberg metadata snapshot [iceberg]
Posted by "lkindere (via GitHub)" <gi...@apache.org>.
lkindere commented on issue #13763:
URL: https://github.com/apache/iceberg/issues/13763#issuecomment-3266271854
@kumarpritam863 yes, it occurs even with 1.8.1 iceberg sink, as long as the iceberg core used for writing is 1.9.2
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org
Re: [I] Duplicate file path found in Iceberg metadata snapshot [iceberg]
Posted by "hguercan (via GitHub)" <gi...@apache.org>.
hguercan commented on issue #13763:
URL: https://github.com/apache/iceberg/issues/13763#issuecomment-3183511355
> Do you have access to the table's `metadata.json` file? If so, can you share the snapshot summary of the snapshots with `snapshot-sequence` `59331` and `59330`? These are the sequences of the snapshots in which the file you mentioned was seemingly added according to the values in `file_sequence_number` (in a regular situation, there should be only one as you say).
>
> They can be found, if not expired, in the `snapshots` key which contains an array of snapshots.
>
> If they no longer exist in this array, perhaps an older `metadata.json` which does still have this information still exists.
>
> I am asking because this connector utilizes snapshot properties for some of the consistency guarantee mechanisms, and this could help pointing in the right direction (or away from the wrong direction).
Unfortunately, I dont have access to that snapshot and its metadata anymore but I have a fresh case where i did the same analysis and can share the statistics for the corresponding snapshot-ids
`
{
"sequence-number": 54478,
"snapshot-id": 6176209833558056528,
"parent-snapshot-id": 2306737064233706627,
"timestamp-ms": 1755016698301,
"summary": {
"operation": "append",
"kafka.connect.commit-id": "ec688e95-d729-41ce-86ce-a3ed1ce89ffb",
"kafka.connect.offsets.wawi.iceberg-control-<my-table-name>-sink-iceberg": "{\"0\":5501096}",
"added-data-files": "46015",
"added-records": "13656877",
"added-files-size": "904639986",
"changed-partition-count": "4230",
"total-records": "784700226",
"total-files-size": "17779462489",
"total-data-files": "90567",
"total-delete-files": "0",
"total-position-deletes": "0",
"total-equality-deletes": "0",
"iceberg-version": "Apache Iceberg 1.9.2 (commit 071d5606bc6199a0be9b3f274ec7fbf111d88821)"
},
"manifest-list": "abfss://<irrelevant-path>/metadata/snap-6176209833558056528-1-3be0fa19-154c-47fb-995a-631988706f20.avro",
"schema-id": 3
},
{
"sequence-number": 54479,
"snapshot-id": 7322125787317837392,
"parent-snapshot-id": 6176209833558056528,
"timestamp-ms": 1755017224903,
"summary": {
"operation": "append",
"kafka.connect.commit-id": "48b912ad-cb3e-40ca-be7f-81fbb6724b0e",
"kafka.connect.offsets.wawi.iceberg-control-<my-table-name>-sink-iceberg": "{\"0\":5708861}",
"added-data-files": "236825",
"added-records": "80701320",
"added-files-size": "4926359306",
"changed-partition-count": "8828",
"total-records": "865401546",
"total-files-size": "22705821795",
"total-data-files": "327392",
"total-delete-files": "0",
"total-position-deletes": "0",
"total-equality-deletes": "0",
"iceberg-version": "Apache Iceberg 1.9.2 (commit 071d5606bc6199a0be9b3f274ec7fbf111d88821)"
},
"manifest-list": "abfss://<irrelevant-path>/metadata/snap-7322125787317837392-1-2ac3f8c4-c119-479e-80a6-38c65bfdc7f5.avro",
"schema-id": 3
},
`
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org
Re: [I] Duplicate file path found in Iceberg metadata snapshot [iceberg]
Posted by "lkindere (via GitHub)" <gi...@apache.org>.
lkindere commented on issue #13763:
URL: https://github.com/apache/iceberg/issues/13763#issuecomment-3258355131
Any updates about this issue? Seems this is still occurring and is caused by the IcebergSinkConnector
Currently Using 1.8.2 Kafka connect with 1.9.1 Iceberg core (as 1.9.1 Kafka connect seems unstable, and Iceberg core 1.9.1 is required for OAuth)
Example if we query table.entries for the specific file path we get an error for (<prefix>00001-1756997337361-a7efb760-7ff6-43f2-a4a7-0ba2720ce11c-00002.parquet):
```json
[
{
"status": 0,
"snapshot_id": 4343445114214793138,
"sequence_number": 39188,
"file_sequence_number": 39188,
"data_file": {
"content": 0,
"file_path": "<prefix>00001-1756997337361-a7efb760-7ff6-43f2-a4a7-0ba2720ce11c-00002.parquet",
"file_format": "PARQUET",
"spec_id": 0,
"partition": {
"country_code": "<cc>",
"entity_number": "<en>"
},
"record_count": 5,
"file_size_in_bytes": 11302,
"column_sizes": {},
"value_counts": {},
"null_value_counts": {},
"nan_value_counts": {},
"lower_bounds": {},
"upper_bounds": {},
"split_offsets": [
4
],
"sort_order_id": 0
},
"readable_metrics": {
"C440_BOX": {},
"C440_DD": {},
"C440_EP": {},
"C440_FORMDATE": {},
"C440_FORMNO": {},
"C440_ID": {},
"C440_LINE": {},
"C440_MODDATE": {},
"C440_MODUSER": {},
"C440_STATUS": {},
"C440_STORENAME": {},
"C440_STORENO": {},
"__kafka_metadata.__kafka_insert_time": {},
"__kafka_metadata.__kafka_offset": {},
"__kafka_metadata.__kafka_partition": {},
"__kafka_metadata.__kafka_topic": {},
"__md5": {},
"country_code": {},
"created_at": {},
"current_ts": {},
"db_name": {},
"entity_number": {},
"ingested_at": {},
"op_ts": {},
"op_type": {},
"pos": {},
"primary_keys.element": {},
"scn": {},
"table": {},
"table_name": {},
"updated_at": {}
}
},
{
"status": 0,
"snapshot_id": 2368336716243636983,
"sequence_number": 39187,
"file_sequence_number": 39187,
"data_file": {
"content": 0,
"file_path": "<prefix>00001-1756997337361-a7efb760-7ff6-43f2-a4a7-0ba2720ce11c-00002.parquet",
"file_format": "PARQUET",
"spec_id": 0,
"partition": {
"country_code": "<cc>",
"entity_number": "<en>"
},
"record_count": 5,
"file_size_in_bytes": 11302,
"column_sizes": {},
"value_counts": {},
"null_value_counts": {},
"nan_value_counts": {},
"lower_bounds": {},
"upper_bounds": {},
"split_offsets": [
4
],
"sort_order_id": 0
},
"readable_metrics": {
"C440_BOX": {},
"C440_DD": {},
"C440_EP": {},
"C440_FORMDATE": {},
"C440_FORMNO": {},
"C440_ID": {},
"C440_LINE": {},
"C440_MODDATE": {},
"C440_MODUSER": {},
"C440_STATUS": {},
"C440_STORENAME": {},
"C440_STORENO": {},
"__kafka_metadata.__kafka_insert_time": {},
"__kafka_metadata.__kafka_offset": {},
"__kafka_metadata.__kafka_partition": {},
"__kafka_metadata.__kafka_topic": {},
"__md5": {},
"country_code": {},
"created_at": {},
"current_ts": {},
"db_name": {},
"entity_number": {},
"ingested_at": {},
"op_ts": {},
"op_type": {},
"pos": {},
"primary_keys.element": {},
"scn": {},
"table": {},
"table_name": {},
"updated_at": {}
}
}
]
```
We can see these 2 snapshots both reference it:
```json
[
{
"committed_at": "2025-09-04T14:57:35.853Z",
"snapshot_id": 2368336716243636983,
"parent_id": 1965811163510447977,
"operation": "append",
"manifest_list": " <prefix>snap-2368336716243636983-1-344ffdba-5b08-4ff0-a1ba-490de9e49e73.avro",
"summary": {
"kafka.connect.commit-id": "f7a3a2b1-ecf3-4e10-ace3-178d0d1ddda8",
"kafka.connect.offsets.wawi.iceberg-control-small_12.connect-small-12-sink-iceberg": "{\"0\":2519423}",
"added-data-files": "2",
"added-records": "8",
"added-files-size": "22558",
"changed-partition-count": "2",
"total-records": "1879575",
"total-files-size": "75751857",
"total-data-files": "283",
"total-delete-files": "0",
"total-position-deletes": "0",
"total-equality-deletes": "0",
"iceberg-version": "Apache Iceberg 1.9.2 (commit 071d5606bc6199a0be9b3f274ec7fbf111d88821)"
}
},
{
"committed_at": "2025-09-04T15:00:25.774Z",
"snapshot_id": 4343445114214793138,
"parent_id": 2368336716243636983,
"operation": "append",
"manifest_list": " <prefix>snap-4343445114214793138-1-edf12025-d320-48af-8186-73032c7f6138.avro",
"summary": {
"kafka.connect.commit-id": "745a6aaa-a827-46cb-9066-1f96d280437c",
"kafka.connect.offsets.wawi.iceberg-control-small_12.connect-small-12-sink-iceberg": "{\"0\":2519418}",
"added-data-files": "2",
"added-records": "8",
"added-files-size": "22558",
"changed-partition-count": "2",
"total-records": "1879583",
"total-files-size": "75774415",
"total-data-files": "285",
"total-delete-files": "0",
"total-position-deletes": "0",
"total-equality-deletes": "0",
"iceberg-version": "Apache Iceberg 1.9.2 (commit 071d5606bc6199a0be9b3f274ec7fbf111d88821)"
}
}
]
```
It seems possibly to be caused by the connector tasks restarting, for example here are partial Kafka logs for when this occurred:
```diff
[2025-09-04 14:55:00,864] INFO [Consumer clientId=connector-consumer-table-small-12-sink-iceberg-0, groupId=connect-table-small-12-sink-iceberg] Error sending fetch request (sessionId=1432530602, epoch=INITIAL) to node 3: (org.apache.kafka.clients.FetchSessionHandler:618)
[2025-09-04 14:55:00,864] INFO [Consumer clientId=connector-consumer-table-small-12-sink-iceberg-0, groupId=connect-table-small-12-sink-iceberg] Error sending fetch request (sessionId=1849102486, epoch=INITIAL) to node 0: (org.apache.kafka.clients.FetchSessionHandler:618)
[2025-09-04 14:55:00,864] INFO [Consumer clientId=connector-consumer-table-small-12-sink-iceberg-0, groupId=connect-table-small-12-sink-iceberg] Error sending fetch request (sessionId=1937322821, epoch=INITIAL) to node 5: (org.apache.kafka.clients.FetchSessionHandler:618)
[2025-09-04 14:55:00,864] INFO [Consumer clientId=connector-consumer-table-small-12-sink-iceberg-0, groupId=connect-table-small-12-sink-iceberg] Error sending fetch request (sessionId=INVALID, epoch=INITIAL) to node 2: (org.apache.kafka.clients.FetchSessionHandler:618)
[2025-09-04 14:55:13,230] INFO [Consumer clientId=connector-consumer-table-small-12-sink-iceberg-0, groupId=connect-table-small-12-sink-iceberg] Disconnecting from node 5 due to socket connection setup timeout. The timeout value is 30000 ms. (org.apache.kafka.clients.NetworkClient:1046)
[2025-09-04 14:55:18,353] INFO [Consumer clientId=54adfc40-66fd-4773-9dd9-7899b4fa28d1, groupId=connect-table-small-12-sink-iceberg-coord] Finished assignment for group at generation 322: {54adfc40-66fd-4773-9dd9-7899b4fa28d1-6e308fd6-be02-4a17-bad1-68591a67292f=Assignment(partitions=[ <prefix>.iceberg-control-small_12-0])} (org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:664)
[2025-09-04 14:55:18,353] INFO [Consumer clientId=54adfc40-66fd-4773-9dd9-7899b4fa28d1, groupId=connect-table-small-12-sink-iceberg-coord] Successfully joined group with generation Generation{generationId=322, memberId='54adfc40-66fd-4773-9dd9-7899b4fa28d1-6e308fd6-be02-4a17-bad1-68591a67292f', protocol='range'} (org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:666)
[2025-09-04 14:55:18,357] INFO [Consumer clientId=54adfc40-66fd-4773-9dd9-7899b4fa28d1, groupId=connect-table-small-12-sink-iceberg-coord] Adding newly assigned partitions: <prefix>.iceberg-control-small_12-0 (org.apache.kafka.clients.consumer.internals.ConsumerRebalanceListenerInvoker:58)
[2025-09-04 14:55:18,357] INFO [Consumer clientId=54adfc40-66fd-4773-9dd9-7899b4fa28d1, groupId=connect-table-small-12-sink-iceberg-coord] Notifying assignor about the new Assignment(partitions=[ <prefix>.iceberg-control-small_12-0]) (org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:324)
[2025-09-04 14:55:18,357] INFO [Consumer clientId=54adfc40-66fd-4773-9dd9-7899b4fa28d1, groupId=connect-table-small-12-sink-iceberg-coord] Successfully synced group in generation Generation{generationId=322, memberId='54adfc40-66fd-4773-9dd9-7899b4fa28d1-6e308fd6-be02-4a17-bad1-68591a67292f', protocol='range'} (org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:843)
[2025-09-04 14:55:25,743] INFO [Consumer clientId=e1f2b595-2264-49d7-b82f-3840d8659dd8, groupId=connect-table-small-12-sink-iceberg-coord] Request joining group due to: group is already rebalancing (org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:1103)
[2025-09-04 14:55:32,026] INFO [Producer clientId=connector-dlq-producer-table-small-12-sink-iceberg-1] Node 2 disconnected. (org.apache.kafka.clients.NetworkClient:1191)
[2025-09-04 14:55:34,639] INFO [table-small-12-sink-iceberg|task-1] [Consumer clientId=connector-consumer-table-small-12-sink-iceberg-1, groupId=connect-table-small-12-sink-iceberg] Cancelled in-flight FETCH request with correlation id 1230 due to node 1 being disconnected (elapsed time since creation: 60001ms, elapsed time since send: 60001ms, throttle time: 0ms, request timeout: 60000ms) (org.apache.kafka.clients.NetworkClient:480)
[2025-09-04 14:55:34,639] INFO [table-small-12-sink-iceberg|task-1] [Consumer clientId=connector-consumer-table-small-12-sink-iceberg-1, groupId=connect-table-small-12-sink-iceberg] Cancelled in-flight FETCH request with correlation id 1228 due to node 2 being disconnected (elapsed time since creation: 60001ms, elapsed time since send: 60001ms, throttle time: 0ms, request timeout: 60000ms) (org.apache.kafka.clients.NetworkClient:480)
[2025-09-04 14:55:34,639] INFO [table-small-12-sink-iceberg|task-1] [Consumer clientId=connector-consumer-table-small-12-sink-iceberg-1, groupId=connect-table-small-12-sink-iceberg] Cancelled in-flight FETCH request with correlation id 1227 due to node 3 being disconnected (elapsed time since creation: 60001ms, elapsed time since send: 60001ms, throttle time: 0ms, request timeout: 60000ms) (org.apache.kafka.clients.NetworkClient:480)
[2025-09-04 14:55:34,639] INFO [table-small-12-sink-iceberg|task-1] [Consumer clientId=connector-consumer-table-small-12-sink-iceberg-1, groupId=connect-table-small-12-sink-iceberg] Cancelled in-flight FETCH request with correlation id 1232 due to node 4 being disconnected (elapsed time since creation: 60001ms, elapsed time since send: 60001ms, throttle time: 0ms, request timeout: 60000ms) (org.apache.kafka.clients.NetworkClient:480)
[2025-09-04 14:55:34,639] INFO [table-small-12-sink-iceberg|task-1] [Consumer clientId=connector-consumer-table-small-12-sink-iceberg-1, groupId=connect-table-small-12-sink-iceberg] Cancelled in-flight FETCH request with correlation id 1231 due to node 5 being disconnected (elapsed time since creation: 60001ms, elapsed time since send: 60001ms, throttle time: 0ms, request timeout: 60000ms) (org.apache.kafka.clients.NetworkClient:480)
[2025-09-04 14:55:34,639] INFO [table-small-12-sink-iceberg|task-1] [Consumer clientId=connector-consumer-table-small-12-sink-iceberg-1, groupId=connect-table-small-12-sink-iceberg] Disconnecting from node 1 due to request timeout. (org.apache.kafka.clients.NetworkClient:1024)
[2025-09-04 14:55:34,639] INFO [table-small-12-sink-iceberg|task-1] [Consumer clientId=connector-consumer-table-small-12-sink-iceberg-1, groupId=connect-table-small-12-sink-iceberg] Disconnecting from node 2 due to request timeout. (org.apache.kafka.clients.NetworkClient:1024)
[2025-09-04 14:55:34,639] INFO [table-small-12-sink-iceberg|task-1] [Consumer clientId=connector-consumer-table-small-12-sink-iceberg-1, groupId=connect-table-small-12-sink-iceberg] Disconnecting from node 3 due to request timeout. (org.apache.kafka.clients.NetworkClient:1024)
[2025-09-04 14:55:34,639] INFO [table-small-12-sink-iceberg|task-1] [Consumer clientId=connector-consumer-table-small-12-sink-iceberg-1, groupId=connect-table-small-12-sink-iceberg] Disconnecting from node 4 due to request timeout. (org.apache.kafka.clients.NetworkClient:1024)
[2025-09-04 14:55:34,639] INFO [table-small-12-sink-iceberg|task-1] [Consumer clientId=connector-consumer-table-small-12-sink-iceberg-1, groupId=connect-table-small-12-sink-iceberg] Disconnecting from node 5 due to request timeout. (org.apache.kafka.clients.NetworkClient:1024)
[2025-09-04 14:55:34,639] INFO [table-small-12-sink-iceberg|task-1] [Consumer clientId=connector-consumer-table-small-12-sink-iceberg-1, groupId=connect-table-small-12-sink-iceberg] Error sending fetch request (sessionId=661248138, epoch=10) to node 1: (org.apache.kafka.clients.FetchSessionHandler:618)
[2025-09-04 14:55:34,640] INFO [Consumer clientId=connector-consumer-table-small-12-sink-iceberg-1, groupId=connect-table-small-12-sink-iceberg] Error sending fetch request (sessionId=1574004371, epoch=38) to node 2: (org.apache.kafka.clients.FetchSessionHandler:618)
[2025-09-04 14:55:34,640] INFO [table-small-12-sink-iceberg|task-1] [Consumer clientId=connector-consumer-table-small-12-sink-iceberg-1, groupId=connect-table-small-12-sink-iceberg] Error sending fetch request (sessionId=1777106785, epoch=34) to node 4: (org.apache.kafka.clients.FetchSessionHandler:618)
[2025-09-04 14:55:34,640] INFO [table-small-12-sink-iceberg|task-1] [Consumer clientId=connector-consumer-table-small-12-sink-iceberg-1, groupId=connect-table-small-12-sink-iceberg] Error sending fetch request (sessionId=INVALID, epoch=INITIAL) to node 3: (org.apache.kafka.clients.FetchSessionHandler:618)
[2025-09-04 14:55:34,640] INFO [table-small-12-sink-iceberg|task-1] [Consumer clientId=connector-consumer-table-small-12-sink-iceberg-1, groupId=connect-table-small-12-sink-iceberg] Error sending fetch request (sessionId=INVALID, epoch=INITIAL) to node 5: (org.apache.kafka.clients.FetchSessionHandler:618)
[2025-09-04 14:55:34,723] INFO [table-small-12-sink-iceberg|task-1] Loading custom FileIO implementation: org.apache.iceberg.azure.adlsv2.ADLSFileIO (org.apache.iceberg.CatalogUtil:376)
[2025-09-04 14:56:03,091] INFO [Consumer clientId=e1f2b595-2264-49d7-b82f-3840d8659dd8, groupId=connect-table-small-12-sink-iceberg-coord] Attempt to heartbeat with Generation{generationId=321, memberId='e1f2b595-2264-49d7-b82f-3840d8659dd8-ee13b369-a385-45e7-84b1-2fc57c62efb5', protocol='range'} and group instance id Optional.empty failed due to UNKNOWN_MEMBER_ID, resetting generation (org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:1267)
[2025-09-04 14:56:03,091] INFO [Consumer clientId=e1f2b595-2264-49d7-b82f-3840d8659dd8, groupId=connect-table-small-12-sink-iceberg-coord] Group coordinator <coord>.azure.confluent.cloud:9092 (id: 2147483647 rack: null isFenced: false) is unavailable or invalid due to cause: session timed out without receiving a heartbeat response. isDisconnected: false. Rediscovery will be attempted. (org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:1000)
[2025-09-04 14:56:03,091] INFO [Consumer clientId=e1f2b595-2264-49d7-b82f-3840d8659dd8, groupId=connect-table-small-12-sink-iceberg-coord] Request joining group due to: encountered UNKNOWN_MEMBER_ID from HEARTBEAT response (org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:1103)
[2025-09-04 14:56:03,091] INFO [Consumer clientId=e1f2b595-2264-49d7-b82f-3840d8659dd8, groupId=connect-table-small-12-sink-iceberg-coord] Requesting disconnect from last known coordinator <coord>.azure.confluent.cloud:9092 (id: 2147483647 rack: null isFenced: false) (org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:1013)
[2025-09-04 14:56:03,091] INFO [Consumer clientId=e1f2b595-2264-49d7-b82f-3840d8659dd8, groupId=connect-table-small-12-sink-iceberg-coord] Resetting generation and member id due to: encountered UNKNOWN_MEMBER_ID from HEARTBEAT response (org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:1056)
[2025-09-04 14:56:15,611] INFO [Consumer clientId=connector-consumer-table-small-12-sink-iceberg-0, groupId=connect-table-small-12-sink-iceberg] Disconnecting from node 4 due to socket connection setup timeout. The timeout value is 29140 ms. (org.apache.kafka.clients.NetworkClient:1046)
[2025-09-04 14:56:34,763] INFO [table-small-12-sink-iceberg|task-1] [Consumer clientId=connector-consumer-table-small-12-sink-iceberg-1, groupId=connect-table-small-12-sink-iceberg] Cancelled in-flight FETCH request with correlation id 1254 due to node 3 being disconnected (elapsed time since creation: 60015ms, elapsed time since send: 60002ms, throttle time: 0ms, request timeout: 60000ms) (org.apache.kafka.clients.NetworkClient:480)
[2025-09-04 14:56:34,763] INFO [table-small-12-sink-iceberg|task-1] [Consumer clientId=connector-consumer-table-small-12-sink-iceberg-1, groupId=connect-table-small-12-sink-iceberg] Disconnecting from node 3 due to request timeout. (org.apache.kafka.clients.NetworkClient:1024)
[2025-09-04 14:56:34,763] INFO [table-small-12-sink-iceberg|task-1] [Consumer clientId=connector-consumer-table-small-12-sink-iceberg-1, groupId=connect-table-small-12-sink-iceberg] Error sending fetch request (sessionId=INVALID, epoch=INITIAL) to node 3: (org.apache.kafka.clients.FetchSessionHandler:618)
[2025-09-04 14:56:34,771] INFO [table-small-12-sink-iceberg|task-1] [Consumer clientId=connector-consumer-table-small-12-sink-iceberg-1, groupId=connect-table-small-12-sink-iceberg] Cancelled in-flight FETCH request with correlation id 1258 due to node 4 being disconnected (elapsed time since creation: 60023ms, elapsed time since send: 60002ms, throttle time: 0ms, request timeout: 60000ms) (org.apache.kafka.clients.NetworkClient:480)
[2025-09-04 14:56:34,771] INFO [table-small-12-sink-iceberg|task-1] [Consumer clientId=connector-consumer-table-small-12-sink-iceberg-1, groupId=connect-table-small-12-sink-iceberg] Cancelled in-flight FETCH request with correlation id 1257 due to node 5 being disconnected (elapsed time since creation: 60023ms, elapsed time since send: 60002ms, throttle time: 0ms, request timeout: 60000ms) (org.apache.kafka.clients.NetworkClient:480)
[2025-09-04 14:56:34,771] INFO [table-small-12-sink-iceberg|task-1] [Consumer clientId=connector-consumer-table-small-12-sink-iceberg-1, groupId=connect-table-small-12-sink-iceberg] Cancelled in-flight METADATA request with correlation id 1286 due to node 4 being disconnected (elapsed time since creation: 7ms, elapsed time since send: 7ms, throttle time: 0ms, request timeout: 60000ms) (org.apache.kafka.clients.NetworkClient:480)
[2025-09-04 14:56:34,771] INFO [table-small-12-sink-iceberg|task-1] [Consumer clientId=connector-consumer-table-small-12-sink-iceberg-1, groupId=connect-table-small-12-sink-iceberg] Disconnecting from node 4 due to request timeout. (org.apache.kafka.clients.NetworkClient:1024)
[2025-09-04 14:56:34,771] INFO [table-small-12-sink-iceberg|task-1] [Consumer clientId=connector-consumer-table-small-12-sink-iceberg-1, groupId=connect-table-small-12-sink-iceberg] Disconnecting from node 5 due to request timeout. (org.apache.kafka.clients.NetworkClient:1024)
[2025-09-04 14:56:34,771] INFO [table-small-12-sink-iceberg|task-1] [Consumer clientId=connector-consumer-table-small-12-sink-iceberg-1, groupId=connect-table-small-12-sink-iceberg] Error sending fetch request (sessionId=1777106785, epoch=INITIAL) to node 4: (org.apache.kafka.clients.FetchSessionHandler:618)
[2025-09-04 14:56:34,772] INFO [table-small-12-sink-iceberg|task-1] [Consumer clientId=connector-consumer-table-small-12-sink-iceberg-1, groupId=connect-table-small-12-sink-iceberg] Cancelled in-flight FETCH request with correlation id 1256 due to node 1 being disconnected (elapsed time since creation: 60024ms, elapsed time since send: 60001ms, throttle time: 0ms, request timeout: 60000ms) (org.apache.kafka.clients.NetworkClient:480)
[2025-09-04 14:56:34,772] INFO [table-small-12-sink-iceberg|task-1] [Consumer clientId=connector-consumer-table-small-12-sink-iceberg-1, groupId=connect-table-small-12-sink-iceberg] Disconnecting from node 1 due to request timeout. (org.apache.kafka.clients.NetworkClient:1024)
[2025-09-04 14:56:34,772] INFO [table-small-12-sink-iceberg|task-1] [Consumer clientId=connector-consumer-table-small-12-sink-iceberg-1, groupId=connect-table-small-12-sink-iceberg] Error sending fetch request (sessionId=661248138, epoch=INITIAL) to node 1: (org.apache.kafka.clients.FetchSessionHandler:618)
[2025-09-04 14:56:34,772] INFO [table-small-12-sink-iceberg|task-1] [Consumer clientId=connector-consumer-table-small-12-sink-iceberg-1, groupId=connect-table-small-12-sink-iceberg] Error sending fetch request (sessionId=INVALID, epoch=INITIAL) to node 5: (org.apache.kafka.clients.FetchSessionHandler:618)
[2025-09-04 14:56:34,779] INFO [table-small-12-sink-iceberg|task-1] [Consumer clientId=connector-consumer-table-small-12-sink-iceberg-1, groupId=connect-table-small-12-sink-iceberg] Cancelled in-flight FETCH request with correlation id 1255 due to node 2 being disconnected (elapsed time since creation: 60031ms, elapsed time since send: 60002ms, throttle time: 0ms, request timeout: 60000ms) (org.apache.kafka.clients.NetworkClient:480)
[2025-09-04 14:56:34,779] INFO [table-small-12-sink-iceberg|task-1] [Consumer clientId=connector-consumer-table-small-12-sink-iceberg-1, groupId=connect-table-small-12-sink-iceberg] Disconnecting from node 2 due to request timeout. (org.apache.kafka.clients.NetworkClient:1024)
[2025-09-04 14:56:34,780] INFO [table-small-12-sink-iceberg|task-1] [Consumer clientId=connector-consumer-table-small-12-sink-iceberg-1, groupId=connect-table-small-12-sink-iceberg] Error sending fetch request (sessionId=1574004371, epoch=INITIAL) to node 2: (org.apache.kafka.clients.FetchSessionHandler:618)
[2025-09-04 14:56:40,624] INFO [Producer clientId=connector-dlq-producer-table-small-12-sink-iceberg-0] Node 5 disconnected. (org.apache.kafka.clients.NetworkClient:1191)
[2025-09-04 14:56:40,626] INFO [Consumer clientId=connector-consumer-table-small-12-sink-iceberg-0, groupId=connect-table-small-12-sink-iceberg] Disconnecting from node 1 due to client rebootstrap. (org.apache.kafka.clients.NetworkClient:1242)
[2025-09-04 14:56:40,628] INFO [Consumer clientId=connector-consumer-table-small-12-sink-iceberg-0, groupId=connect-table-small-12-sink-iceberg] Rebootstrapping with [<cluster>.azure.confluent.cloud/10.1.0.29:9092] (org.apache.kafka.clients.Metadata:315)
[2025-09-04 14:57:05,850] INFO [table-small-12-sink-iceberg|task-0] [Consumer clientId=7a6ff60d-921d-4c34-aaf5-db36b0d84ae6, groupId=cg-control-4c0a0f91-e567-44ba-a37a-db5e33bd4f15] Client requested disconnect from node 2147483646 (org.apache.kafka.clients.NetworkClient:460)
[2025-09-04 14:57:05,857] INFO [table-small-12-sink-iceberg|task-0] [Consumer clientId=7a6ff60d-921d-4c34-aaf5-db36b0d84ae6, groupId=cg-control-4c0a0f91-e567-44ba-a37a-db5e33bd4f15] Discovered group coordinator <coord>.azure.confluent.cloud:9092 (id: 2147483646 rack: null isFenced: false) (org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:937)
[2025-09-04 14:57:05,858] INFO [table-small-12-sink-iceberg|task-0] [Consumer clientId=7a6ff60d-921d-4c34-aaf5-db36b0d84ae6, groupId=cg-control-4c0a0f91-e567-44ba-a37a-db5e33bd4f15] Group coordinator <coord>.azure.confluent.cloud:9092 (id: 2147483646 rack: null isFenced: false) is unavailable or invalid due to cause: coordinator unavailable. isDisconnected: false. Rediscovery will be attempted. (org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:1000)
[2025-09-04 14:57:05,861] INFO [table-small-12-sink-iceberg|task-0] [Consumer clientId=7a6ff60d-921d-4c34-aaf5-db36b0d84ae6, groupId=cg-control-4c0a0f91-e567-44ba-a37a-db5e33bd4f15] Requesting disconnect from last known coordinator <coord>.azure.confluent.cloud:9092 (id: 2147483646 rack: null isFenced: false) (org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:1013)
[2025-09-04 14:57:18,386] INFO [Producer clientId=connector-dlq-producer-table-small-12-sink-iceberg-0] Disconnecting from node 2 due to socket connection setup timeout. The timeout value is 9445 ms. (org.apache.kafka.clients.NetworkClient:1046)
[2025-09-04 14:57:34,949] INFO [table-small-12-sink-iceberg|task-1] Sending event of type: DATA_COMPLETE (org.apache.iceberg.connect.channel.Channel:88)
[2025-09-04 14:57:34,949] INFO [table-small-12-sink-iceberg|task-1] Sending event of type: DATA_WRITTEN (org.apache.iceberg.connect.channel.Channel:88)
[2025-09-04 14:57:34,976] INFO [Consumer clientId=connector-consumer-table-small-12-sink-iceberg-1, groupId=connect-table-small-12-sink-iceberg] Cancelled in-flight FETCH request with correlation id 1287 due to node 3 being disconnected (elapsed time since creation: 60098ms, elapsed time since send: 60086ms, throttle time: 0ms, request timeout: 60000ms) (org.apache.kafka.clients.NetworkClient:480)
[2025-09-04 14:57:34,976] INFO [Consumer clientId=connector-consumer-table-small-12-sink-iceberg-1, groupId=connect-table-small-12-sink-iceberg] Cancelled in-flight FETCH request with correlation id 1288 due to node 2 being disconnected (elapsed time since creation: 60098ms, elapsed time since send: 60060ms, throttle time: 0ms, request timeout: 60000ms) (org.apache.kafka.clients.NetworkClient:480)
[2025-09-04 14:57:34,976] INFO [Consumer clientId=connector-consumer-table-small-12-sink-iceberg-1, groupId=connect-table-small-12-sink-iceberg] Cancelled in-flight FETCH request with correlation id 1290 due to node 5 being disconnected (elapsed time since creation: 60098ms, elapsed time since send: 60077ms, throttle time: 0ms, request timeout: 60000ms) (org.apache.kafka.clients.NetworkClient:480)
[2025-09-04 14:57:34,976] INFO [Consumer clientId=connector-consumer-table-small-12-sink-iceberg-1, groupId=connect-table-small-12-sink-iceberg] Cancelled in-flight FETCH request with correlation id 1291 due to node 4 being disconnected (elapsed time since creation: 60098ms, elapsed time since send: 60077ms, throttle time: 0ms, request timeout: 60000ms) (org.apache.kafka.clients.NetworkClient:480)
[2025-09-04 14:57:34,976] INFO [Consumer clientId=connector-consumer-table-small-12-sink-iceberg-1, groupId=connect-table-small-12-sink-iceberg] Disconnecting from node 2 due to request timeout. (org.apache.kafka.clients.NetworkClient:1024)
[2025-09-04 14:57:34,976] INFO [Consumer clientId=connector-consumer-table-small-12-sink-iceberg-1, groupId=connect-table-small-12-sink-iceberg] Disconnecting from node 3 due to request timeout. (org.apache.kafka.clients.NetworkClient:1024)
[2025-09-04 14:57:34,976] INFO [Consumer clientId=connector-consumer-table-small-12-sink-iceberg-1, groupId=connect-table-small-12-sink-iceberg] Disconnecting from node 4 due to request timeout. (org.apache.kafka.clients.NetworkClient:1024)
[2025-09-04 14:57:34,976] INFO [Consumer clientId=connector-consumer-table-small-12-sink-iceberg-1, groupId=connect-table-small-12-sink-iceberg] Disconnecting from node 5 due to request timeout. (org.apache.kafka.clients.NetworkClient:1024)
[2025-09-04 14:57:34,976] INFO [Consumer clientId=connector-consumer-table-small-12-sink-iceberg-1, groupId=connect-table-small-12-sink-iceberg] Error sending fetch request (sessionId=1574004371, epoch=INITIAL) to node 2: (org.apache.kafka.clients.FetchSessionHandler:618)
[2025-09-04 14:57:34,976] INFO [Consumer clientId=connector-consumer-table-small-12-sink-iceberg-1, groupId=connect-table-small-12-sink-iceberg] Error sending fetch request (sessionId=1777106785, epoch=INITIAL) to node 4: (org.apache.kafka.clients.FetchSessionHandler:618)
[2025-09-04 14:57:34,976] INFO [Consumer clientId=connector-consumer-table-small-12-sink-iceberg-1, groupId=connect-table-small-12-sink-iceberg] Error sending fetch request (sessionId=INVALID, epoch=INITIAL) to node 3: (org.apache.kafka.clients.FetchSessionHandler:618)
[2025-09-04 14:57:34,976] INFO [Consumer clientId=connector-consumer-table-small-12-sink-iceberg-1, groupId=connect-table-small-12-sink-iceberg] Error sending fetch request (sessionId=INVALID, epoch=INITIAL) to node 5: (org.apache.kafka.clients.FetchSessionHandler:618)
[2025-09-04 14:57:35,514] INFO [table-small-12-sink-iceberg|task-1] Handled event of type: START_COMMIT (org.apache.iceberg.connect.channel.Channel:133)
[2025-09-04 14:57:35,603] INFO [table-small-12-sink-iceberg|task-1] Loading custom FileIO implementation: org.apache.iceberg.azure.adlsv2.ADLSFileIO (org.apache.iceberg.CatalogUtil:376)
[2025-09-04 14:57:35,685] INFO [table-small-12-sink-iceberg|task-1] Loading custom FileIO implementation: org.apache.iceberg.azure.adlsv2.ADLSFileIO (org.apache.iceberg.CatalogUtil:376)
+ [2025-09-04 14:57:36,044] INFO Committed snapshot 2368336716243636983 (MergeAppend)(org.apache.iceberg.SnapshotProducer:481)
+ [2025-09-04 14:57:36,161] INFO Received metrics report: CommitReport{tableName=polaris.raw.t440_bal_head, snapshotId=2368336716243636983, sequenceNumber=39187, operation=append, commitMetrics=CommitMetricsResult{totalDuration=TimerResult{timeUnit=NANOSECONDS, totalDuration=PT0.4885257S, count=1}, attempts=CounterResult{unit=COUNT, value=1}, addedDataFiles=CounterResult{unit=COUNT, value=2}, removedDataFiles=null, totalDataFiles=CounterResult{unit=COUNT, value=283}, addedDeleteFiles=null, addedEqualityDeleteFiles=null, addedPositionalDeleteFiles=null, addedDVs=null, removedDeleteFiles=null, removedEqualityDeleteFiles=null, removedPositionalDeleteFiles=null, removedDVs=null, totalDeleteFiles=CounterResult{unit=COUNT, value=0}, addedRecords=CounterResult{unit=COUNT, value=8}, removedRecords=null, totalRecords=CounterResult{unit=COUNT, value=1879575}, addedFilesSizeInBytes=CounterResult{unit=BYTES, value=22558}, removedFilesSizeInBytes=null, totalFilesSizeInBytes=CounterResult{unit=
BYTES, value=75751857}, addedPositionalDeletes=null, removedPositionalDeletes=null, totalPositionalDeletes=CounterResult{unit=COUNT, value=0}, addedEqualityDeletes=null, removedEqualityDeletes=null, totalEqualityDeletes=CounterResult{unit=COUNT, value=0}, manifestsCreated=null, manifestsReplaced=null, manifestsKept=null, manifestEntriesProcessed=null}, metadata={iceberg-version=Apache Iceberg 1.9.2 (commit 071d5606bc6199a0be9b3f274ec7fbf111d88821)}} (org.apache.iceberg.metrics.LoggingMetricsReporter:38)
+ [2025-09-04 14:57:36,174] INFO Commit complete to table raw.t440_bal_head, snapshot 2368336716243636983, commit ID f7a3a2b1-ecf3-4e10-ace3-178d0d1ddda8, valid-through null (org.apache.iceberg.connect.channel.Coordinator:266)
[2025-09-04 14:57:55,935] INFO [Producer clientId=connector-dlq-producer-table-small-12-sink-iceberg-0] Disconnecting from node 4 due to socket connection setup timeout. The timeout value is 8448 ms. (org.apache.kafka.clients.NetworkClient:1046)
[2025-09-04 14:58:01,885] INFO [Consumer clientId=54adfc40-66fd-4773-9dd9-7899b4fa28d1, groupId=connect-table-small-12-sink-iceberg-coord] Node -1 disconnected. (org.apache.kafka.clients.NetworkClient:1191)
[2025-09-04 14:58:35,751] INFO [table-small-12-sink-iceberg|task-1] [Consumer clientId=connector-consumer-table-small-12-sink-iceberg-1, groupId=connect-table-small-12-sink-iceberg] Cancelled in-flight FETCH request with correlation id 1320 due to node 3 being disconnected (elapsed time since creation: 60233ms, elapsed time since send: 60001ms, throttle time: 0ms, request timeout: 60000ms) (org.apache.kafka.clients.NetworkClient:480)
[2025-09-04 14:58:35,751] INFO [table-small-12-sink-iceberg|task-1] [Consumer clientId=connector-consumer-table-small-12-sink-iceberg-1, groupId=connect-table-small-12-sink-iceberg] Disconnecting from node 3 due to request timeout. (org.apache.kafka.clients.NetworkClient:1024)
[2025-09-04 14:58:35,751] INFO [table-small-12-sink-iceberg|task-1] [Consumer clientId=connector-consumer-table-small-12-sink-iceberg-1, groupId=connect-table-small-12-sink-iceberg] Error sending fetch request (sessionId=INVALID, epoch=INITIAL) to node 3: (org.apache.kafka.clients.FetchSessionHandler:618)
[2025-09-04 14:58:35,758] INFO [table-small-12-sink-iceberg|task-1] [Consumer clientId=connector-consumer-table-small-12-sink-iceberg-1, groupId=connect-table-small-12-sink-iceberg] Cancelled in-flight FETCH request with correlation id 1321 due to node 2 being disconnected (elapsed time since creation: 60240ms, elapsed time since send: 60002ms, throttle time: 0ms, request timeout: 60000ms) (org.apache.kafka.clients.NetworkClient:480)
[2025-09-04 14:58:35,758] INFO [table-small-12-sink-iceberg|task-1] [Consumer clientId=connector-consumer-table-small-12-sink-iceberg-1, groupId=connect-table-small-12-sink-iceberg] Cancelled in-flight FETCH request with correlation id 1324 due to node 4 being disconnected (elapsed time since creation: 60240ms, elapsed time since send: 60003ms, throttle time: 0ms, request timeout: 60000ms) (org.apache.kafka.clients.NetworkClient:480)
[2025-09-04 14:58:35,758] INFO [table-small-12-sink-iceberg|task-1] [Consumer clientId=connector-consumer-table-small-12-sink-iceberg-1, groupId=connect-table-small-12-sink-iceberg] Cancelled in-flight FETCH request with correlation id 1323 due to node 5 being disconnected (elapsed time since creation: 60240ms, elapsed time since send: 60002ms, throttle time: 0ms, request timeout: 60000ms) (org.apache.kafka.clients.NetworkClient:480)
[2025-09-04 14:58:35,758] INFO [table-small-12-sink-iceberg|task-1] [Consumer clientId=connector-consumer-table-small-12-sink-iceberg-1, groupId=connect-table-small-12-sink-iceberg] Cancelled in-flight METADATA request with correlation id 1351 due to node 2 being disconnected (elapsed time since creation: 135ms, elapsed time since send: 135ms, throttle time: 0ms, request timeout: 60000ms) (org.apache.kafka.clients.NetworkClient:480)
[2025-09-04 14:58:35,758] INFO [table-small-12-sink-iceberg|task-1] [Consumer clientId=connector-consumer-table-small-12-sink-iceberg-1, groupId=connect-table-small-12-sink-iceberg] Disconnecting from node 2 due to request timeout. (org.apache.kafka.clients.NetworkClient:1024)
[2025-09-04 14:58:35,758] INFO [table-small-12-sink-iceberg|task-1] [Consumer clientId=connector-consumer-table-small-12-sink-iceberg-1, groupId=connect-table-small-12-sink-iceberg] Disconnecting from node 4 due to request timeout. (org.apache.kafka.clients.NetworkClient:1024)
[2025-09-04 14:58:35,758] INFO [table-small-12-sink-iceberg|task-1] [Consumer clientId=connector-consumer-table-small-12-sink-iceberg-1, groupId=connect-table-small-12-sink-iceberg] Disconnecting from node 5 due to request timeout. (org.apache.kafka.clients.NetworkClient:1024)
[2025-09-04 14:58:35,758] INFO [table-small-12-sink-iceberg|task-1] [Consumer clientId=connector-consumer-table-small-12-sink-iceberg-1, groupId=connect-table-small-12-sink-iceberg] Error sending fetch request (sessionId=1574004371, epoch=INITIAL) to node 2: (org.apache.kafka.clients.FetchSessionHandler:618)
[2025-09-04 14:58:35,758] INFO [table-small-12-sink-iceberg|task-1] [Consumer clientId=connector-consumer-table-small-12-sink-iceberg-1, groupId=connect-table-small-12-sink-iceberg] Error sending fetch request (sessionId=1777106785, epoch=INITIAL) to node 4: (org.apache.kafka.clients.FetchSessionHandler:618)
[2025-09-04 14:58:35,758] INFO [table-small-12-sink-iceberg|task-1] [Consumer clientId=connector-consumer-table-small-12-sink-iceberg-1, groupId=connect-table-small-12-sink-iceberg] Error sending fetch request (sessionId=INVALID, epoch=INITIAL) to node 5: (org.apache.kafka.clients.FetchSessionHandler:618)
[2025-09-04 14:58:58,405] INFO [Consumer clientId=connector-consumer-table-small-12-sink-iceberg-0, groupId=connect-table-small-12-sink-iceberg] Disconnecting from node -1 due to socket connection setup timeout. The timeout value is 10448 ms. (org.apache.kafka.clients.NetworkClient:1046)
[2025-09-04 14:58:59,873] INFO [Producer clientId=connector-dlq-producer-table-small-12-sink-iceberg-1] Node 5 disconnected. (org.apache.kafka.clients.NetworkClient:1191)
[2025-09-04 14:59:11,005] INFO [Producer clientId=connector-dlq-producer-table-small-12-sink-iceberg-0] Disconnecting from node 0 due to socket connection setup timeout. The timeout value is 8508 ms. (org.apache.kafka.clients.NetworkClient:1046)
[2025-09-04 14:59:23,409] WARN [Consumer clientId=connector-consumer-table-small-12-sink-iceberg-0, groupId=connect-table-small-12-sink-iceberg] Bootstrap broker <cluster>.azure.confluent.cloud:9092 (id: -1 rack: null isFenced: false) disconnected (org.apache.kafka.clients.NetworkClient:1388)
[2025-09-04 14:59:35,863] INFO [table-small-12-sink-iceberg|task-1] [Consumer clientId=connector-consumer-table-small-12-sink-iceberg-1, groupId=connect-table-small-12-sink-iceberg] Disconnecting from node 3 due to request timeout. (org.apache.kafka.clients.NetworkClient:1024)
[2025-09-04 14:59:35,864] INFO [table-small-12-sink-iceberg|task-1] [Consumer clientId=connector-consumer-table-small-12-sink-iceberg-1, groupId=connect-table-small-12-sink-iceberg] Cancelled in-flight FETCH request with correlation id 1352 due to node 3 being disconnected (elapsed time since creation: 60014ms, elapsed time since send: 60001ms, throttle time: 0ms, request timeout: 60000ms) (org.apache.kafka.clients.NetworkClient:480)
[2025-09-04 14:59:35,864] INFO [table-small-12-sink-iceberg|task-1] [Consumer clientId=connector-consumer-table-small-12-sink-iceberg-1, groupId=connect-table-small-12-sink-iceberg] Error sending fetch request (sessionId=INVALID, epoch=INITIAL) to node 3: (org.apache.kafka.clients.FetchSessionHandler:618)
[2025-09-04 14:59:35,874] INFO [table-small-12-sink-iceberg|task-1] [Consumer clientId=connector-consumer-table-small-12-sink-iceberg-1, groupId=connect-table-small-12-sink-iceberg] Cancelled in-flight FETCH request with correlation id 1353 due to node 2 being disconnected (elapsed time since creation: 60024ms, elapsed time since send: 60004ms, throttle time: 0ms, request timeout: 60000ms) (org.apache.kafka.clients.NetworkClient:480)
[2025-09-04 14:59:35,874] INFO [table-small-12-sink-iceberg|task-1] [Consumer clientId=connector-consumer-table-small-12-sink-iceberg-1, groupId=connect-table-small-12-sink-iceberg] Cancelled in-flight FETCH request with correlation id 1355 due to node 4 being disconnected (elapsed time since creation: 60024ms, elapsed time since send: 60002ms, throttle time: 0ms, request timeout: 60000ms) (org.apache.kafka.clients.NetworkClient:480)
[2025-09-04 14:59:35,874] INFO [table-small-12-sink-iceberg|task-1] [Consumer clientId=connector-consumer-table-small-12-sink-iceberg-1, groupId=connect-table-small-12-sink-iceberg] Cancelled in-flight METADATA request with correlation id 1383 due to node 4 being disconnected (elapsed time since creation: 9ms, elapsed time since send: 9ms, throttle time: 0ms, request timeout: 60000ms) (org.apache.kafka.clients.NetworkClient:480)
[2025-09-04 14:59:35,874] INFO [table-small-12-sink-iceberg|task-1] [Consumer clientId=connector-consumer-table-small-12-sink-iceberg-1, groupId=connect-table-small-12-sink-iceberg] Disconnecting from node 2 due to request timeout. (org.apache.kafka.clients.NetworkClient:1024)
[2025-09-04 14:59:35,874] INFO [table-small-12-sink-iceberg|task-1] [Consumer clientId=connector-consumer-table-small-12-sink-iceberg-1, groupId=connect-table-small-12-sink-iceberg] Disconnecting from node 4 due to request timeout. (org.apache.kafka.clients.NetworkClient:1024)
[2025-09-04 14:59:35,874] INFO [table-small-12-sink-iceberg|task-1] [Consumer clientId=connector-consumer-table-small-12-sink-iceberg-1, groupId=connect-table-small-12-sink-iceberg] Error sending fetch request (sessionId=1574004371, epoch=INITIAL) to node 2: (org.apache.kafka.clients.FetchSessionHandler:618)
[2025-09-04 14:59:35,874] INFO [table-small-12-sink-iceberg|task-1] [Consumer clientId=connector-consumer-table-small-12-sink-iceberg-1, groupId=connect-table-small-12-sink-iceberg] Error sending fetch request (sessionId=1777106785, epoch=INITIAL) to node 4: (org.apache.kafka.clients.FetchSessionHandler:618)
[2025-09-04 14:59:35,877] INFO [table-small-12-sink-iceberg|task-1] [Consumer clientId=connector-consumer-table-small-12-sink-iceberg-1, groupId=connect-table-small-12-sink-iceberg] Cancelled in-flight FETCH request with correlation id 1354 due to node 5 being disconnected (elapsed time since creation: 60028ms, elapsed time since send: 60002ms, throttle time: 0ms, request timeout: 60000ms) (org.apache.kafka.clients.NetworkClient:480)
[2025-09-04 14:59:35,877] INFO [table-small-12-sink-iceberg|task-1] [Consumer clientId=connector-consumer-table-small-12-sink-iceberg-1, groupId=connect-table-small-12-sink-iceberg] Disconnecting from node 5 due to request timeout. (org.apache.kafka.clients.NetworkClient:1024)
[2025-09-04 14:59:35,877] INFO [table-small-12-sink-iceberg|task-1] [Consumer clientId=connector-consumer-table-small-12-sink-iceberg-1, groupId=connect-table-small-12-sink-iceberg] Error sending fetch request (sessionId=INVALID, epoch=INITIAL) to node 5: (org.apache.kafka.clients.FetchSessionHandler:618)
[2025-09-04 15:00:00,766] INFO [Producer clientId=connector-dlq-producer-table-small-12-sink-iceberg-0] Disconnecting from node 1 due to socket connection setup timeout. The timeout value is 8989 ms. (org.apache.kafka.clients.NetworkClient:1046)
[2025-09-04 15:00:36,198] INFO [table-small-12-sink-iceberg|task-1] [Consumer clientId=connector-consumer-table-small-12-sink-iceberg-1, groupId=connect-table-small-12-sink-iceberg] Cancelled in-flight FETCH request with correlation id 1380 due to node 0 being disconnected (elapsed time since creation: 61523ms, elapsed time since send: 61523ms, throttle time: 0ms, request timeout: 60000ms) (org.apache.kafka.clients.NetworkClient:480)
[2025-09-04 15:00:36,198] INFO [table-small-12-sink-iceberg|task-1] [Consumer clientId=connector-consumer-table-small-12-sink-iceberg-1, groupId=connect-table-small-12-sink-iceberg] Cancelled in-flight FETCH request with correlation id 1382 due to node 1 being disconnected (elapsed time since creation: 60675ms, elapsed time since send: 60675ms, throttle time: 0ms, request timeout: 60000ms) (org.apache.kafka.clients.NetworkClient:480)
[2025-09-04 15:00:36,198] INFO [table-small-12-sink-iceberg|task-1] [Consumer clientId=connector-consumer-table-small-12-sink-iceberg-1, groupId=connect-table-small-12-sink-iceberg] Cancelled in-flight METADATA request with correlation id 1384 due to node 0 being disconnected (elapsed time since creation: 60234ms, elapsed time since send: 60234ms, throttle time: 0ms, request timeout: 60000ms) (org.apache.kafka.clients.NetworkClient:480)
[2025-09-04 15:00:36,198] INFO [table-small-12-sink-iceberg|task-1] [Consumer clientId=connector-consumer-table-small-12-sink-iceberg-1, groupId=connect-table-small-12-sink-iceberg] Disconnecting from node 0 due to request timeout. (org.apache.kafka.clients.NetworkClient:1024)
[2025-09-04 15:00:36,198] INFO [table-small-12-sink-iceberg|task-1] [Consumer clientId=connector-consumer-table-small-12-sink-iceberg-1, groupId=connect-table-small-12-sink-iceberg] Disconnecting from node 1 due to request timeout. (org.apache.kafka.clients.NetworkClient:1024)
[2025-09-04 15:00:36,199] INFO [table-small-12-sink-iceberg|task-1] [Consumer clientId=connector-consumer-table-small-12-sink-iceberg-1, groupId=connect-table-small-12-sink-iceberg] Disconnecting from node 2 due to request timeout. (org.apache.kafka.clients.NetworkClient:1024)
[2025-09-04 15:00:36,200] INFO [table-small-12-sink-iceberg|task-1] [Consumer clientId=connector-consumer-table-small-12-sink-iceberg-1, groupId=connect-table-small-12-sink-iceberg] Cancelled in-flight FETCH request with correlation id 1386 due to node 2 being disconnected (elapsed time since creation: 60231ms, elapsed time since send: 60209ms, throttle time: 0ms, request timeout: 60000ms) (org.apache.kafka.clients.NetworkClient:480)
[2025-09-04 15:00:36,200] INFO [table-small-12-sink-iceberg|task-1] [Consumer clientId=connector-consumer-table-small-12-sink-iceberg-1, groupId=connect-table-small-12-sink-iceberg] Cancelled in-flight FETCH request with correlation id 1385 due to node 3 being disconnected (elapsed time since creation: 60231ms, elapsed time since send: 60217ms, throttle time: 0ms, request timeout: 60000ms) (org.apache.kafka.clients.NetworkClient:480)
[2025-09-04 15:00:36,200] INFO [table-small-12-sink-iceberg|task-1] [Consumer clientId=connector-consumer-table-small-12-sink-iceberg-1, groupId=connect-table-small-12-sink-iceberg] Cancelled in-flight FETCH request with correlation id 1388 due to node 4 being disconnected (elapsed time since creation: 60231ms, elapsed time since send: 60212ms, throttle time: 0ms, request timeout: 60000ms) (org.apache.kafka.clients.NetworkClient:480)
[2025-09-04 15:00:36,200] INFO [table-small-12-sink-iceberg|task-1] [Consumer clientId=connector-consumer-table-small-12-sink-iceberg-1, groupId=connect-table-small-12-sink-iceberg] Cancelled in-flight FETCH request with correlation id 1387 due to node 5 being disconnected (elapsed time since creation: 60231ms, elapsed time since send: 60214ms, throttle time: 0ms, request timeout: 60000ms) (org.apache.kafka.clients.NetworkClient:480)
[2025-09-04 15:00:36,200] INFO [table-small-12-sink-iceberg|task-1] [Consumer clientId=connector-consumer-table-small-12-sink-iceberg-1, groupId=connect-table-small-12-sink-iceberg] Disconnecting from node 3 due to request timeout. (org.apache.kafka.clients.NetworkClient:1024)
[2025-09-04 15:00:36,200] INFO [table-small-12-sink-iceberg|task-1] [Consumer clientId=connector-consumer-table-small-12-sink-iceberg-1, groupId=connect-table-small-12-sink-iceberg] Disconnecting from node 4 due to request timeout. (org.apache.kafka.clients.NetworkClient:1024)
[2025-09-04 15:00:36,200] INFO [table-small-12-sink-iceberg|task-1] [Consumer clientId=connector-consumer-table-small-12-sink-iceberg-1, groupId=connect-table-small-12-sink-iceberg] Disconnecting from node 5 due to request timeout. (org.apache.kafka.clients.NetworkClient:1024)
[2025-09-04 15:00:36,200] INFO [table-small-12-sink-iceberg|task-1] [Consumer clientId=connector-consumer-table-small-12-sink-iceberg-1, groupId=connect-table-small-12-sink-iceberg] Error sending fetch request (sessionId=720862586, epoch=45) to node 0: (org.apache.kafka.clients.FetchSessionHandler:618)
[2025-09-04 15:00:36,204] INFO [table-small-12-sink-iceberg|task-1] [Consumer clientId=connector-consumer-table-small-12-sink-iceberg-1, groupId=connect-table-small-12-sink-iceberg] Error sending fetch request (sessionId=2264982, epoch=3) to node 1: (org.apache.kafka.clients.FetchSessionHandler:618)
[2025-09-04 15:00:36,205] INFO [Consumer clientId=connector-consumer-table-small-12-sink-iceberg-1, groupId=connect-table-small-12-sink-iceberg] Error sending fetch request (sessionId=1574004371, epoch=INITIAL) to node 2: (org.apache.kafka.clients.FetchSessionHandler:618)
[2025-09-04 15:00:36,205] INFO [table-small-12-sink-iceberg|task-1] [Consumer clientId=connector-consumer-table-small-12-sink-iceberg-1, groupId=connect-table-small-12-sink-iceberg] Error sending fetch request (sessionId=1777106785, epoch=INITIAL) to node 4: (org.apache.kafka.clients.FetchSessionHandler:618)
[2025-09-04 15:00:36,205] INFO [table-small-12-sink-iceberg|task-1] [Consumer clientId=connector-consumer-table-small-12-sink-iceberg-1, groupId=connect-table-small-12-sink-iceberg] Error sending fetch request (sessionId=INVALID, epoch=INITIAL) to node 3: (org.apache.kafka.clients.FetchSessionHandler:618)
[2025-09-04 15:00:36,205] INFO [table-small-12-sink-iceberg|task-1] [Consumer clientId=connector-consumer-table-small-12-sink-iceberg-1, groupId=connect-table-small-12-sink-iceberg] Error sending fetch request (sessionId=INVALID, epoch=INITIAL) to node 5: (org.apache.kafka.clients.FetchSessionHandler:618)
+ TASK RESTARTS HERE
[2025-09-04 15:00:41,749] INFO [table-small-12-sink-iceberg|task-0] Creating task table-small-12-sink-iceberg-0 intial state STARTED (org.apache.kafka.connect.runtime.Worker:816)
[2025-09-04 15:00:41,756] INFO [table-small-12-sink-iceberg|task-0] ConnectorConfig values:
[2025-09-04 15:00:41,757] INFO [table-small-12-sink-iceberg|task-0] EnrichedConnectorConfig values:
[2025-09-04 15:00:41,757] INFO [table-small-12-sink-iceberg|task-0] Instantiated task table-small-12-sink-iceberg-0 with version 1.9.2 of type org.apache.iceberg.connect.IcebergSinkTask (org.apache.kafka.connect.runtime.Worker:837)
[2025-09-04 15:00:41,757] INFO [table-small-12-sink-iceberg|task-0] TaskConfig values:
[2025-09-04 15:00:41,758] INFO [table-small-12-sink-iceberg|task-0] AvroConverterConfig values:
[2025-09-04 15:00:41,759] INFO [table-small-12-sink-iceberg|task-0] KafkaAvroSerializerConfig values:
[2025-09-04 15:00:41,762] INFO [table-small-12-sink-iceberg|task-0] KafkaAvroDeserializerConfig values:
[2025-09-04 15:00:41,766] INFO [table-small-12-sink-iceberg|task-0] AvroConverterConfig values:
[2025-09-04 15:00:41,766] INFO [table-small-12-sink-iceberg|task-0] AvroDataConfig values:
[2025-09-04 15:00:41,767] INFO [table-small-12-sink-iceberg|task-0] KafkaAvroSerializerConfig values:
[2025-09-04 15:00:41,772] INFO [table-small-12-sink-iceberg|task-0] KafkaAvroDeserializerConfig values:
[2025-09-04 15:00:41,826] INFO [table-small-12-sink-iceberg|task-0] AvroDataConfig values:
[2025-09-04 15:00:41,827] INFO [table-small-12-sink-iceberg|task-0] Set up the header converter class org.apache.kafka.connect.storage.SimpleHeaderConverter for task table-small-12-sink-iceberg-0 using the worker config (org.apache.kafka.connect.runtime.Worker:867)
[2025-09-04 15:00:41,827] INFO [table-small-12-sink-iceberg|task-0] Set up the key converter class io.confluent.connect.avro.AvroConverter for task table-small-12-sink-iceberg-0 using the connector config (org.apache.kafka.connect.runtime.Worker:855)
[2025-09-04 15:00:41,827] INFO [table-small-12-sink-iceberg|task-0] Set up the value converter class io.confluent.connect.avro.AvroConverter for task table-small-12-sink-iceberg-0 using the connector config (org.apache.kafka.connect.runtime.Worker:861)
[2025-09-04 15:00:41,828] INFO [table-small-12-sink-iceberg|task-0] Initializing: org.apache.kafka.connect.runtime.TransformationChain{com.confluent.kafka.connect.transforms.TimestampConverter$Value, com.confluent.kafka.connect.transforms.TimestampConverter$Value, com.confluent.kafka.connect.transforms.AddMetadata, com.confluent.kafka.connect.transforms.CopyField, com.confluent.kafka.connect.transforms.CopyField, com.confluent.kafka.connect.transforms.MD5Calculator, com.confluent.kafka.connect.transforms.IngestedAtField} (org.apache.kafka.connect.runtime.Worker:2142)
[2025-09-04 15:00:41,829] INFO [table-small-12-sink-iceberg|task-0] EnrichedConnectorConfig values:
[2025-09-04 15:00:41,829] INFO [table-small-12-sink-iceberg|task-0] SinkConnectorConfig values:
[2025-09-04 15:00:41,830] INFO [table-small-12-sink-iceberg|task-0] ConsumerConfig values:
[2025-09-04 15:00:41,830] INFO [table-small-12-sink-iceberg|task-0] Initializing: org.apache.kafka.connect.runtime.TransformationChain{com.confluent.kafka.connect.transforms.TimestampConverter$Value, com.confluent.kafka.connect.transforms.TimestampConverter$Value, com.confluent.kafka.connect.transforms.AddMetadata, com.confluent.kafka.connect.transforms.CopyField, com.confluent.kafka.connect.transforms.CopyField, com.confluent.kafka.connect.transforms.MD5Calculator, com.confluent.kafka.connect.transforms.IngestedAtField} (org.apache.kafka.connect.runtime.Worker:2204)
[2025-09-04 15:00:41,830] INFO [table-small-12-sink-iceberg|task-0] TracerConfig values:
[2025-09-04 15:00:41,831] INFO [table-small-12-sink-iceberg|task-0] Creating SSL context for keystore : null (org.apache.kafka.common.security.ssl.DefaultSslEngineFactory:249)
[2025-09-04 15:00:41,833] INFO [table-small-12-sink-iceberg|task-0] Kafka commitId: 3dddb42a261b39b6 (org.apache.kafka.common.utils.AppInfoParser:133)
[2025-09-04 15:00:41,833] INFO [table-small-12-sink-iceberg|task-0] Kafka startTimeMs: 1756998041833 (org.apache.kafka.common.utils.AppInfoParser:134)
[2025-09-04 15:00:41,833] INFO [table-small-12-sink-iceberg|task-0] Kafka version: 8.0.0-ce (org.apache.kafka.common.utils.AppInfoParser:132)
[2025-09-04 15:00:41,833] INFO [table-small-12-sink-iceberg|task-0] These configurations '[metrics.context.resource.connector, metrics.context.resource.version, metrics.context.resource.type, metrics.context.resource.commit.id, metrics.context.resource.task, metrics.context.connect.kafka.cluster.id, metrics.context.connect.group.id]' were supplied but are not used yet. (org.apache.kafka.common.config.AbstractConfig:385)
[2025-09-04 15:00:41,838] INFO [table-small-12-sink-iceberg|task-0] AdminClientConfig values:
[2025-09-04 15:00:41,838] INFO [table-small-12-sink-iceberg|task-0] Creating SSL context for keystore : null (org.apache.kafka.common.security.ssl.DefaultSslEngineFactory:249)
[2025-09-04 15:00:41,840] INFO [table-small-12-sink-iceberg|task-0] Kafka commitId: 3dddb42a261b39b6 (org.apache.kafka.common.utils.AppInfoParser:133)
[2025-09-04 15:00:41,840] INFO [table-small-12-sink-iceberg|task-0] Kafka startTimeMs: 1756998041840 (org.apache.kafka.common.utils.AppInfoParser:134)
[2025-09-04 15:00:41,840] INFO [table-small-12-sink-iceberg|task-0] Kafka version: 8.0.0-ce (org.apache.kafka.common.utils.AppInfoParser:132)
[2025-09-04 15:00:41,840] INFO [table-small-12-sink-iceberg|task-0] These configurations '[metrics.context.resource.connector, metrics.context.resource.version, listeners.https.ssl.truststore.password, group.id, metrics.context.resource.type, metrics.context.resource.commit.id, rest.advertised.port, plugin.path, metrics.context.resource.task, rest.extension.classes, confluent.license, listeners.https.ssl.key.password, metrics.context.connect.kafka.cluster.id, confluent.topic.replication.factor, status.storage.replication.factor, config.providers.file.class, offset.storage.topic, rest.advertised.listener, value.converter, session.timeout.ms, key.converter, listeners.https.ssl.enabled.protocols, expose.internal.connect.endpoints, config.storage.topic, listeners, metrics.context.connect.group.id, rest.advertised.host.name, status.storage.topic, listeners.https.ssl.keystore.location, rebalance.timeout.ms, heartbeat.interval.ms, listeners.https.ssl.keystore.password, config.storage.rep
lication.factor, topic.creation.enable, offset.flush.interval.ms, key.converter.schemas.enable, listeners.https.ssl.truststore.location, value.converter.schemas.enable, offset.storage.replication.factor]' were supplied but are not used yet. (org.apache.kafka.common.config.AbstractConfig:385)
[2025-09-04 15:00:41,963] INFO [table-small-12-sink-iceberg|task-0] ProducerConfig values:
[2025-09-04 15:00:41,965] INFO [table-small-12-sink-iceberg|task-0] Creating SSL context for keystore : null (org.apache.kafka.common.security.ssl.DefaultSslEngineFactory:249)
[2025-09-04 15:00:41,967] INFO [table-small-12-sink-iceberg|task-0] [Consumer clientId=connector-consumer-table-small-12-sink-iceberg-0, groupId=connect-table-small-12-sink-iceberg] Subscribed to topic(s): topic_t175_kred_carriers, topic_t177_dblogin, topic_t182_ctw_ <prefix>, topic_t183_splace_gate, topic_t184_sic_opendocs, topic_t186_new_ean, topic_t189_carriers, topic_t230_inv_repheader, topic_t231_inv_repdetail, topic_t239_storage, topic_t240_hazard, topic_t241_ph_value, topic_t255_ars16audit, topic_t300_bookingperiod, topic_t306_spcondsubtype, topic_t307_specialcondit, topic_t370_bo_input_lct, topic_t390_sapintfacetyp, topic_t404_mde_suppliers, topic_t417_order_stock_factors, topic_t419_open_store_restrictions, topic_t427_holiday_rules, topic_t440_bal_head, topic_t441_bal_det, topic_t443_efis_list, topic_t480_tour_picklists, topic_t481_hauliers, topic_t483_rest_palettes, topic_t484_tour_comments, topic_t485_timefactors (org.apache.kafka.clients.consumer.internals.ClassicKafka
Consumer:502)
[2025-09-04 15:00:41,967] INFO [table-small-12-sink-iceberg|task-0] Kafka commitId: 3dddb42a261b39b6 (org.apache.kafka.common.utils.AppInfoParser:133)
[2025-09-04 15:00:41,967] INFO [table-small-12-sink-iceberg|task-0] Kafka startTimeMs: 1756998041967 (org.apache.kafka.common.utils.AppInfoParser:134)
[2025-09-04 15:00:41,967] INFO [table-small-12-sink-iceberg|task-0] Kafka version: 8.0.0-ce (org.apache.kafka.common.utils.AppInfoParser:132)
[2025-09-04 15:00:41,967] INFO [table-small-12-sink-iceberg|task-0] These configurations '[metrics.context.resource.connector, metrics.context.resource.version, metrics.context.connect.group.id, metrics.context.resource.type, metrics.context.resource.commit.id, metrics.context.resource.task, metrics.context.connect.kafka.cluster.id]' were supplied but are not used yet. (org.apache.kafka.common.config.AbstractConfig:385)
[2025-09-04 15:00:41,968] INFO [table-small-12-sink-iceberg|task-0] IcebergSinkConfig values:
[2025-09-04 15:00:41,968] INFO [table-small-12-sink-iceberg|task-0] JsonConverterConfig values:
[2025-09-04 15:00:41,968] INFO [table-small-12-sink-iceberg|task-0] WorkerSinkTask{id=table-small-12-sink-iceberg-0} Executing sink task (org.apache.kafka.connect.runtime.WorkerSinkTask:234)
[2025-09-04 15:00:41,968] INFO [table-small-12-sink-iceberg|task-0] WorkerSinkTask{id=table-small-12-sink-iceberg-0} Sink task finished initialization and start, task thread is 2567 (org.apache.kafka.connect.runtime.WorkerSinkTask:350)
[2025-09-04 15:00:42,036] INFO [table-small-12-sink-iceberg|task-0] [Consumer clientId=connector-consumer-table-small-12-sink-iceberg-0, groupId=connect-table-small-12-sink-iceberg] Cluster ID: <cluster> (org.apache.kafka.clients.Metadata:366)
[2025-09-04 15:00:42,036] INFO [table-small-12-sink-iceberg|task-0] [Consumer clientId=connector-consumer-table-small-12-sink-iceberg-0, groupId=connect-table-small-12-sink-iceberg] Discovered group coordinator <coord>.westeurope.azure.confluent.cloud:9092 (id: 2147483643 rack: null isFenced: false) (org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:937)
[2025-09-04 15:00:42,037] INFO [table-small-12-sink-iceberg|task-0] [Consumer clientId=connector-consumer-table-small-12-sink-iceberg-0, groupId=connect-table-small-12-sink-iceberg] (Re-)joining group (org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:605)
[2025-09-04 15:00:42,050] INFO [Producer clientId=connector-dlq-producer-table-small-12-sink-iceberg-0] Cluster ID: <cluster> (org.apache.kafka.clients.Metadata:366)
[2025-09-04 15:00:42,063] INFO [table-small-12-sink-iceberg|task-0] [Consumer clientId=connector-consumer-table-small-12-sink-iceberg-0, groupId=connect-table-small-12-sink-iceberg] (Re-)joining group (org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:605)
[2025-09-04 15:00:42,063] INFO [table-small-12-sink-iceberg|task-0] [Consumer clientId=connector-consumer-table-small-12-sink-iceberg-0, groupId=connect-table-small-12-sink-iceberg] Request joining group due to: need to re-join with the given member-id: connector-consumer-table-small-12-sink-iceberg-0-48516cb7-2505-41e9-87c5-a517b0788cc9 (org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:1103)
[2025-09-04 15:00:47,662] INFO [Consumer clientId=connector-consumer-table-small-12-sink-iceberg-1, groupId=connect-table-small-12-sink-iceberg] Request joining group due to: group is already rebalancing (org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:1103)
[2025-09-04 15:00:59,267] INFO [table-small-12-sink-iceberg|task-1] Sending event of type: DATA_WRITTEN (org.apache.iceberg.connect.channel.Channel:88)
[2025-09-04 15:00:59,267] INFO [table-small-12-sink-iceberg|task-1] Sending event of type: DATA_WRITTEN (org.apache.iceberg.connect.channel.Channel:88)
[2025-09-04 15:00:59,303] INFO [table-small-12-sink-iceberg|task-1] Sending event of type: DATA_COMPLETE (org.apache.iceberg.connect.channel.Channel:88)
[2025-09-04 15:00:59,354] INFO [Consumer clientId=connector-consumer-table-small-12-sink-iceberg-1, groupId=connect-table-small-12-sink-iceberg] Request joining group due to: group is already rebalancing (org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:1103)
[2025-09-04 15:00:59,371] INFO [table-small-12-sink-iceberg|task-1] Handled event of type: START_COMMIT (org.apache.iceberg.connect.channel.Channel:133)
[2025-09-04 15:00:59,372] INFO [table-small-12-sink-iceberg|task-1] [Consumer clientId=connector-consumer-table-small-12-sink-iceberg-1, groupId=connect-table-small-12-sink-iceberg] Revoke previously assigned partitions topic_t175_kred_carriers-0, topic_t175_kred_carriers-1, topic_t175_kred_carriers-2, topic_t175_kred_carriers-3, topic_t177_dblogin-0, topic_t177_dblogin-1, topic_t177_dblogin-2, topic_t177_dblogin-3, topic_t182_ctw_ <prefix>-0, topic_t182_ctw_ <prefix>-1, topic_t182_ctw_ <prefix>-2, topic_t182_ctw_ <prefix>-3, topic_t183_splace_gate-0, topic_t183_splace_gate-1, topic_t183_splace_gate-2, topic_t183_splace_gate-3, topic_t184_sic_opendocs-0, topic_t184_sic_opendocs-1, topic_t184_sic_opendocs-2, topic_t184_sic_opendocs-3, topic_t186_new_ean-0, topic_t186_new_ean-1, topic_t186_new_ean-2, topic_t186_new_ean-3, topic_t189_carriers-0, topic_t189_carriers-1, topic_t189_carriers-2, topic_t189_carriers-3, topic_t230_inv_repheader-0, topic_t230_inv_repheader-1, topic_t230_inv_
repheader-2, topic_t230_inv_repheader-3, topic_t231_inv_repdetail-0, topic_t231_inv_repdetail-1, topic_t231_inv_repdetail-2, topic_t231_inv_repdetail-3, topic_t239_storage-0, topic_t239_storage-1, topic_t239_storage-2, topic_t239_storage-3, topic_t240_hazard-0, topic_t240_hazard-1, topic_t240_hazard-2, topic_t240_hazard-3, topic_t241_ph_value-0, topic_t241_ph_value-1, topic_t241_ph_value-2, topic_t241_ph_value-3, topic_t255_ars16audit-0, topic_t255_ars16audit-1, topic_t255_ars16audit-2, topic_t255_ars16audit-3, topic_t300_bookingperiod-0, topic_t300_bookingperiod-1, topic_t300_bookingperiod-2, topic_t300_bookingperiod-3, topic_t306_spcondsubtype-0, topic_t306_spcondsubtype-1, topic_t306_spcondsubtype-2, topic_t306_spcondsubtype-3, topic_t307_specialcondit-0, topic_t307_specialcondit-1, topic_t307_specialcondit-2, topic_t307_specialcondit-3, topic_t370_bo_input_lct-0, topic_t370_bo_input_lct-1, topic_t370_bo_input_lct-2, topic_t370_bo_input_lct-3, topic_t390_sapintfacetyp-0, topic_t3
90_sapintfacetyp-1, topic_t390_sapintfacetyp-2, topic_t390_sapintfacetyp-3, topic_t404_mde_suppliers-0, topic_t404_mde_suppliers-1, topic_t404_mde_suppliers-2, topic_t404_mde_suppliers-3, topic_t417_order_stock_factors-0, topic_t417_order_stock_factors-1, topic_t417_order_stock_factors-2, topic_t417_order_stock_factors-3, topic_t419_open_store_restrictions-0, topic_t419_open_store_restrictions-1, topic_t419_open_store_restrictions-2, topic_t419_open_store_restrictions-3, topic_t427_holiday_rules-0, topic_t427_holiday_rules-1, topic_t427_holiday_rules-2, topic_t427_holiday_rules-3, topic_t440_bal_head-0, topic_t440_bal_head-1, topic_t440_bal_head-2, topic_t440_bal_head-3, topic_t441_bal_det-0, topic_t441_bal_det-1, topic_t441_bal_det-2, topic_t441_bal_det-3, topic_t443_efis_list-0, topic_t443_efis_list-1, topic_t443_efis_list-2, topic_t443_efis_list-3, topic_t480_tour_picklists-0, topic_t480_tour_picklists-1, topic_t480_tour_picklists-2, topic_t480_tour_picklists-3, topic_t480_tour_p
icklists-4, topic_t480_tour_picklists-5, topic_t480_tour_picklists-6, topic_t480_tour_picklists-7, topic_t481_hauliers-0, topic_t481_hauliers-1, topic_t481_hauliers-2, topic_t481_hauliers-3, topic_t483_rest_palettes-0, topic_t483_rest_palettes-1, topic_t483_rest_palettes-2, topic_t483_rest_palettes-3, topic_t484_tour_comments-0, topic_t484_tour_comments-1, topic_t484_tour_comments-2, topic_t484_tour_comments-3, topic_t485_timefactors-0, topic_t485_timefactors-1, topic_t485_timefactors-2, topic_t485_timefactors-3 (org.apache.kafka.clients.consumer.internals.ConsumerRebalanceListenerInvoker:80)
[2025-09-04 15:00:59,372] INFO [table-small-12-sink-iceberg|task-1] [Producer clientId=1e74e71a-4a8e-4714-b0c8-9d9510aa5554, transactionalId=worker-txn-3bdb3242-eb09-49cd-b864-044f986e61f3-1] Closing the Kafka producer with timeoutMillis = 9223372036854775807 ms. (org.apache.kafka.clients.producer.KafkaProducer:1368)
[2025-09-04 15:00:59,372] INFO [table-small-12-sink-iceberg|task-1] Channel stopping (org.apache.iceberg.connect.channel.Channel:162)
[2025-09-04 15:00:59,378] INFO [table-small-12-sink-iceberg|task-1] [Consumer clientId=7927bb5f-004e-4561-822d-da6f73d9c5ca, groupId=cg-control-1b067dc2-ea92-42f9-bd0f-17ce9c356945] Member 7927bb5f-004e-4561-822d-da6f73d9c5ca-51faca81-3329-443a-ab2a-c683626384de sending LeaveGroup request to coordinator <coord>.azure.confluent.cloud:9092 (id: 2147483645 rack: null isFenced: false) due to the consumer is being closed (org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:1174)
[2025-09-04 15:00:59,378] INFO [table-small-12-sink-iceberg|task-1] [Consumer clientId=7927bb5f-004e-4561-822d-da6f73d9c5ca, groupId=cg-control-1b067dc2-ea92-42f9-bd0f-17ce9c356945] Revoke previously assigned partitions <prefix>.iceberg-control-small_12-0 (org.apache.kafka.clients.consumer.internals.ConsumerRebalanceListenerInvoker:80)
[2025-09-04 15:00:59,378] INFO [table-small-12-sink-iceberg|task-1] App info kafka.producer for 1e74e71a-4a8e-4714-b0c8-9d9510aa5554 unregistered (org.apache.kafka.common.utils.AppInfoParser:95)
[2025-09-04 15:00:59,379] INFO [table-small-12-sink-iceberg|task-1] [Consumer clientId=7927bb5f-004e-4561-822d-da6f73d9c5ca, groupId=cg-control-1b067dc2-ea92-42f9-bd0f-17ce9c356945] Request joining group due to: consumer pro-actively leaving the group (org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:1103)
[2025-09-04 15:00:59,379] INFO [table-small-12-sink-iceberg|task-1] [Consumer clientId=7927bb5f-004e-4561-822d-da6f73d9c5ca, groupId=cg-control-1b067dc2-ea92-42f9-bd0f-17ce9c356945] Resetting generation and member id due to: consumer pro-actively leaving the group (org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:1056)
[2025-09-04 15:00:59,388] INFO [table-small-12-sink-iceberg|task-1] App info kafka.consumer for 7927bb5f-004e-4561-822d-da6f73d9c5ca unregistered (org.apache.kafka.common.utils.AppInfoParser:95)
[2025-09-04 15:00:59,475] INFO [table-small-12-sink-iceberg|task-1] [Consumer clientId=connector-consumer-table-small-12-sink-iceberg-1, groupId=connect-table-small-12-sink-iceberg] (Re-)joining group (org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:605)
[2025-09-04 15:00:59,479] INFO [table-small-12-sink-iceberg|task-1] [Consumer clientId=connector-consumer-table-small-12-sink-iceberg-1, groupId=connect-table-small-12-sink-iceberg] Successfully joined group with generation Generation{generationId=483, memberId='connector-consumer-table-small-12-sink-iceberg-1-44f4b0fb-21d8-466d-9702-1317a49ecfca', protocol='roundrobin'} (org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:666)
[2025-09-04 15:01:08,821] INFO [table-small-12-sink-iceberg|task-0] [Consumer clientId=connector-consumer-table-small-12-sink-iceberg-0, groupId=connect-table-small-12-sink-iceberg] Successfully joined group with generation Generation{generationId=483, memberId='connector-consumer-table-small-12-sink-iceberg-0-48516cb7-2505-41e9-87c5-a517b0788cc9', protocol='roundrobin'} (org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:666)
[2025-09-04 15:01:10,925] INFO [Consumer clientId=54adfc40-66fd-4773-9dd9-7899b4fa28d1, groupId=connect-table-small-12-sink-iceberg-coord] Revoke previously assigned partitions <prefix>.iceberg-control-small_12-0 (org.apache.kafka.clients.consumer.internals.ConsumerRebalanceListenerInvoker:80)
[2025-09-04 15:01:10,926] INFO [Consumer clientId=54adfc40-66fd-4773-9dd9-7899b4fa28d1, groupId=connect-table-small-12-sink-iceberg-coord] Member 54adfc40-66fd-4773-9dd9-7899b4fa28d1-6e308fd6-be02-4a17-bad1-68591a67292f sending LeaveGroup request to coordinator <coord>.azure.confluent.cloud:9092 (id: 2147483647 rack: null isFenced: false) due to the consumer is being closed (org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:1174)
[2025-09-04 15:01:10,932] INFO [Consumer clientId=54adfc40-66fd-4773-9dd9-7899b4fa28d1, groupId=connect-table-small-12-sink-iceberg-coord] Request joining group due to: consumer pro-actively leaving the group (org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:1103)
[2025-09-04 15:01:10,932] INFO [Consumer clientId=54adfc40-66fd-4773-9dd9-7899b4fa28d1, groupId=connect-table-small-12-sink-iceberg-coord] Resetting generation and member id due to: consumer pro-actively leaving the group (org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:1056)
[2025-09-04 15:01:15,740] INFO [table-small-12-sink-iceberg|task-0] [Consumer clientId=connector-consumer-table-small-12-sink-iceberg-0, groupId=connect-table-small-12-sink-iceberg] Disconnecting from node 0 due to socket connection setup timeout. The timeout value is 30000 ms. (org.apache.kafka.clients.NetworkClient:1046)
[2025-09-04 15:01:15,740] INFO [table-small-12-sink-iceberg|task-0] [Consumer clientId=connector-consumer-table-small-12-sink-iceberg-0, groupId=connect-table-small-12-sink-iceberg] Disconnecting from node 1 due to socket connection setup timeout. The timeout value is 24030 ms. (org.apache.kafka.clients.NetworkClient:1046)
[2025-09-04 15:01:15,740] INFO [table-small-12-sink-iceberg|task-0] [Consumer clientId=connector-consumer-table-small-12-sink-iceberg-0, groupId=connect-table-small-12-sink-iceberg] Disconnecting from node 2 due to socket connection setup timeout. The timeout value is 24395 ms. (org.apache.kafka.clients.NetworkClient:1046)
[2025-09-04 15:01:28,238] INFO [table-small-12-sink-iceberg|task-0] [Consumer clientId=connector-consumer-table-small-12-sink-iceberg-0, groupId=connect-table-small-12-sink-iceberg] Disconnecting from node 3 due to socket connection setup timeout. The timeout value is 25569 ms. (org.apache.kafka.clients.NetworkClient:1046)
[2025-09-04 15:01:28,241] INFO [table-small-12-sink-iceberg|task-0] [Consumer clientId=connector-consumer-table-small-12-sink-iceberg-0, groupId=connect-table-small-12-sink-iceberg] Disconnecting from node -1 due to socket connection setup timeout. The timeout value is 19824 ms. (org.apache.kafka.clients.NetworkClient:1046)
[2025-09-04 15:01:28,241] INFO [table-small-12-sink-iceberg|task-0] [Consumer clientId=connector-consumer-table-small-12-sink-iceberg-0, groupId=connect-table-small-12-sink-iceberg] Disconnecting from node 4 due to socket connection setup timeout. The timeout value is 30000 ms. (org.apache.kafka.clients.NetworkClient:1046)
[2025-09-04 15:01:28,241] INFO [table-small-12-sink-iceberg|task-0] [Consumer clientId=connector-consumer-table-small-12-sink-iceberg-0, groupId=connect-table-small-12-sink-iceberg] Disconnecting from node 5 due to socket connection setup timeout. The timeout value is 30000 ms. (org.apache.kafka.clients.NetworkClient:1046)
[2025-09-04 15:01:28,241] WARN [table-small-12-sink-iceberg|task-0] [Consumer clientId=connector-consumer-table-small-12-sink-iceberg-0, groupId=connect-table-small-12-sink-iceberg] Bootstrap broker <cluster>.azure.confluent.cloud:9092 (id: -1 rack: null isFenced: false) disconnected (org.apache.kafka.clients.NetworkClient:1388)
[2025-09-04 15:01:28,244] INFO [table-small-12-sink-iceberg|task-0] [Consumer clientId=connector-consumer-table-small-12-sink-iceberg-0, groupId=connect-table-small-12-sink-iceberg] Error sending fetch request (sessionId=1432530602, epoch=INITIAL) to node 3: (org.apache.kafka.clients.FetchSessionHandler:618)
[2025-09-04 15:01:28,244] INFO [table-small-12-sink-iceberg|task-0] [Consumer clientId=connector-consumer-table-small-12-sink-iceberg-0, groupId=connect-table-small-12-sink-iceberg] Error sending fetch request (sessionId=1799704029, epoch=INITIAL) to node 1: (org.apache.kafka.clients.FetchSessionHandler:618)
[2025-09-04 15:01:28,244] INFO [table-small-12-sink-iceberg|task-0] [Consumer clientId=connector-consumer-table-small-12-sink-iceberg-0, groupId=connect-table-small-12-sink-iceberg] Error sending fetch request (sessionId=1849102486, epoch=INITIAL) to node 0: (org.apache.kafka.clients.FetchSessionHandler:618)
[2025-09-04 15:01:28,245] INFO [Consumer clientId=connector-consumer-table-small-12-sink-iceberg-0, groupId=connect-table-small-12-sink-iceberg] Error sending fetch request (sessionId=1937322821, epoch=INITIAL) to node 5: (org.apache.kafka.clients.FetchSessionHandler:618)
[2025-09-04 15:01:28,245] INFO [Consumer clientId=connector-consumer-table-small-12-sink-iceberg-0, groupId=connect-table-small-12-sink-iceberg] Error sending fetch request (sessionId=INVALID, epoch=INITIAL) to node 2: (org.apache.kafka.clients.FetchSessionHandler:618)
[2025-09-04 15:01:28,246] INFO [Consumer clientId=connector-consumer-table-small-12-sink-iceberg-0, groupId=connect-table-small-12-sink-iceberg] Error sending fetch request (sessionId=INVALID, epoch=INITIAL) to node 4: (org.apache.kafka.clients.FetchSessionHandler:618)
[2025-09-04 15:01:28,249] INFO [table-small-12-sink-iceberg|task-0] [Consumer clientId=7a6ff60d-921d-4c34-aaf5-db36b0d84ae6, groupId=cg-control-4c0a0f91-e567-44ba-a37a-db5e33bd4f15] Cancelled in-flight METADATA request with correlation id 503 due to node 3 being disconnected (elapsed time since creation: 1ms, elapsed time since send: 1ms, throttle time: 0ms, request timeout: 20000ms) (org.apache.kafka.clients.NetworkClient:480)
[2025-09-04 15:01:28,249] INFO [table-small-12-sink-iceberg|task-0] [Consumer clientId=7a6ff60d-921d-4c34-aaf5-db36b0d84ae6, groupId=cg-control-4c0a0f91-e567-44ba-a37a-db5e33bd4f15] Node 3 disconnected. (org.apache.kafka.clients.NetworkClient:1191)
[2025-09-04 15:01:40,757] INFO [Consumer clientId=connector-consumer-table-small-12-sink-iceberg-0, groupId=connect-table-small-12-sink-iceberg] Disconnecting from node -1 due to client rebootstrap. (org.apache.kafka.clients.NetworkClient:1242)
[2025-09-04 15:01:40,757] INFO [Consumer clientId=connector-consumer-table-small-12-sink-iceberg-0, groupId=connect-table-small-12-sink-iceberg] Rebootstrapping with [<cluster>.azure.confluent.cloud/10.1.0.29:9092] (org.apache.kafka.clients.Metadata:315)
[2025-09-04 15:01:40,757] WARN [Consumer clientId=connector-consumer-table-small-12-sink-iceberg-0, groupId=connect-table-small-12-sink-iceberg] Bootstrap broker <cluster>.azure.confluent.cloud:9092 (id: -1 rack: null isFenced: false) disconnected (org.apache.kafka.clients.NetworkClient:1388)
[2025-09-04 15:01:44,645] INFO [table-small-12-sink-iceberg|task-1] [Consumer clientId=connector-consumer-table-small-12-sink-iceberg-1, groupId=connect-table-small-12-sink-iceberg] Cancelled in-flight FETCH request with correlation id 1404 due to node 1 being disconnected (elapsed time since creation: 68335ms, elapsed time since send: 68277ms, throttle time: 0ms, request timeout: 60000ms) (org.apache.kafka.clients.NetworkClient:480)
[2025-09-04 15:01:44,645] INFO [table-small-12-sink-iceberg|task-1] [Consumer clientId=connector-consumer-table-small-12-sink-iceberg-1, groupId=connect-table-small-12-sink-iceberg] Disconnecting from node 1 due to request timeout. (org.apache.kafka.clients.NetworkClient:1024)
[2025-09-04 15:01:44,659] INFO [table-small-12-sink-iceberg|task-1] [Consumer clientId=connector-consumer-table-small-12-sink-iceberg-1, groupId=connect-table-small-12-sink-iceberg] Cancelled in-flight FETCH request with correlation id 1402 due to node 2 being disconnected (elapsed time since creation: 68335ms, elapsed time since send: 68276ms, throttle time: 0ms, request timeout: 60000ms) (org.apache.kafka.clients.NetworkClient:480)
[2025-09-04 15:01:44,659] INFO [table-small-12-sink-iceberg|task-1] [Consumer clientId=connector-consumer-table-small-12-sink-iceberg-1, groupId=connect-table-small-12-sink-iceberg] Cancelled in-flight FETCH request with correlation id 1401 due to node 3 being disconnected (elapsed time since creation: 68335ms, elapsed time since send: 68281ms, throttle time: 0ms, request timeout: 60000ms) (org.apache.kafka.clients.NetworkClient:480)
[2025-09-04 15:01:44,659] INFO [table-small-12-sink-iceberg|task-1] [Consumer clientId=connector-consumer-table-small-12-sink-iceberg-1, groupId=connect-table-small-12-sink-iceberg] Cancelled in-flight METADATA request with correlation id 1409 due to node 3 being disconnected (elapsed time since creation: 68280ms, elapsed time since send: 68280ms, throttle time: 0ms, request timeout: 60000ms) (org.apache.kafka.clients.NetworkClient:480)
[2025-09-04 15:01:44,659] INFO [table-small-12-sink-iceberg|task-1] [Consumer clientId=connector-consumer-table-small-12-sink-iceberg-1, groupId=connect-table-small-12-sink-iceberg] Disconnecting from node 2 due to request timeout. (org.apache.kafka.clients.NetworkClient:1024)
[2025-09-04 15:01:44,659] INFO [table-small-12-sink-iceberg|task-1] [Consumer clientId=connector-consumer-table-small-12-sink-iceberg-1, groupId=connect-table-small-12-sink-iceberg] Disconnecting from node 3 due to request timeout. (org.apache.kafka.clients.NetworkClient:1024)
[2025-09-04 15:01:44,660] INFO [table-small-12-sink-iceberg|task-1] [Consumer clientId=connector-consumer-table-small-12-sink-iceberg-1, groupId=connect-table-small-12-sink-iceberg] Cancelled in-flight FETCH request with correlation id 1406 due to node 4 being disconnected (elapsed time since creation: 68335ms, elapsed time since send: 68276ms, throttle time: 0ms, request timeout: 60000ms) (org.apache.kafka.clients.NetworkClient:480)
[2025-09-04 15:01:44,660] INFO [table-small-12-sink-iceberg|task-1] [Consumer clientId=connector-consumer-table-small-12-sink-iceberg-1, groupId=connect-table-small-12-sink-iceberg] Cancelled in-flight FETCH request with correlation id 1405 due to node 5 being disconnected (elapsed time since creation: 68335ms, elapsed time since send: 68256ms, throttle time: 0ms, request timeout: 60000ms) (org.apache.kafka.clients.NetworkClient:480)
[2025-09-04 15:01:44,660] INFO [table-small-12-sink-iceberg|task-1] [Consumer clientId=connector-consumer-table-small-12-sink-iceberg-1, groupId=connect-table-small-12-sink-iceberg] Disconnecting from node 4 due to request timeout. (org.apache.kafka.clients.NetworkClient:1024)
[2025-09-04 15:01:44,660] INFO [table-small-12-sink-iceberg|task-1] [Consumer clientId=connector-consumer-table-small-12-sink-iceberg-1, groupId=connect-table-small-12-sink-iceberg] Disconnecting from node 5 due to request timeout. (org.apache.kafka.clients.NetworkClient:1024)
[2025-09-04 15:01:44,660] INFO [table-small-12-sink-iceberg|task-1] [Consumer clientId=connector-consumer-table-small-12-sink-iceberg-1, groupId=connect-table-small-12-sink-iceberg] Error sending fetch request (sessionId=1574004371, epoch=INITIAL) to node 2: (org.apache.kafka.clients.FetchSessionHandler:618)
[2025-09-04 15:01:44,660] INFO [table-small-12-sink-iceberg|task-1] [Consumer clientId=connector-consumer-table-small-12-sink-iceberg-1, groupId=connect-table-small-12-sink-iceberg] Error sending fetch request (sessionId=1777106785, epoch=INITIAL) to node 4: (org.apache.kafka.clients.FetchSessionHandler:618)
[2025-09-04 15:01:44,660] INFO [table-small-12-sink-iceberg|task-1] [Consumer clientId=connector-consumer-table-small-12-sink-iceberg-1, groupId=connect-table-small-12-sink-iceberg] Error sending fetch request (sessionId=2264982, epoch=INITIAL) to node 1: (org.apache.kafka.clients.FetchSessionHandler:618)
[2025-09-04 15:01:44,660] INFO [table-small-12-sink-iceberg|task-1] [Consumer clientId=connector-consumer-table-small-12-sink-iceberg-1, groupId=connect-table-small-12-sink-iceberg] Error sending fetch request (sessionId=INVALID, epoch=INITIAL) to node 3: (org.apache.kafka.clients.FetchSessionHandler:618)
[2025-09-04 15:01:44,660] INFO [table-small-12-sink-iceberg|task-1] [Consumer clientId=connector-consumer-table-small-12-sink-iceberg-1, groupId=connect-table-small-12-sink-iceberg] Error sending fetch request (sessionId=INVALID, epoch=INITIAL) to node 5: (org.apache.kafka.clients.FetchSessionHandler:618)
[2025-09-04 15:01:56,051] INFO [Consumer clientId=connector-consumer-table-small-12-sink-iceberg-0, groupId=connect-table-small-12-sink-iceberg] SyncGroup failed: The group began another rebalance. Need to re-join the group. Sent generation was Generation{generationId=483, memberId='connector-consumer-table-small-12-sink-iceberg-0-48516cb7-2505-41e9-87c5-a517b0788cc9', protocol='roundrobin'} (org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:867)
[2025-09-04 15:01:56,052] INFO [Consumer clientId=connector-consumer-table-small-12-sink-iceberg-0, groupId=connect-table-small-12-sink-iceberg] Group coordinator <coord>.westeurope.azure.confluent.cloud:9092 (id: 2147483643 rack: null isFenced: false) is unavailable or invalid due to cause: session timed out without receiving a heartbeat response. isDisconnected: false. Rediscovery will be attempted. (org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:1000)
[2025-09-04 15:01:56,052] INFO [Consumer clientId=connector-consumer-table-small-12-sink-iceberg-0, groupId=connect-table-small-12-sink-iceberg] Requesting disconnect from last known coordinator <coord>.westeurope.azure.confluent.cloud:9092 (id: 2147483643 rack: null isFenced: false) (org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:1013)
[2025-09-04 15:01:56,058] INFO [table-small-12-sink-iceberg|task-1] [Consumer clientId=connector-consumer-table-small-12-sink-iceberg-1, groupId=connect-table-small-12-sink-iceberg] Finished assignment for group at generation 483: {connector-consumer-table-small-12-sink-iceberg-1-44f4b0fb-21d8-466d-9702-1317a49ecfca=Assignment(partitions=[topic_t175_kred_carriers-1, topic_t175_kred_carriers-3, topic_t177_dblogin-1, topic_t177_dblogin-3, topic_t182_ctw_ <prefix>-1, topic_t182_ctw_ <prefix>-3, topic_t183_splace_gate-1, topic_t183_splace_gate-3, topic_t184_sic_opendocs-1, topic_t184_sic_opendocs-3, topic_t186_new_ean-1, topic_t186_new_ean-3, topic_t189_carriers-1, topic_t189_carriers-3, topic_t230_inv_repheader-1, topic_t230_inv_repheader-3, topic_t231_inv_repdetail-1, topic_t231_inv_repdetail-3, topic_t239_storage-1, topic_t239_storage-3, topic_t240_hazard-1, topic_t240_hazard-3, topic_t241_ph_value-1, topic_t241_ph_value-3, topic_t255_ars16audit-1, topic_t255_ars16audit-3, topic_t3
00_bookingperiod-1, topic_t300_bookingperiod-3, topic_t306_spcondsubtype-1, topic_t306_spcondsubtype-3, topic_t307_specialcondit-1, topic_t307_specialcondit-3, topic_t370_bo_input_lct-1, topic_t370_bo_input_lct-3, topic_t390_sapintfacetyp-1, topic_t390_sapintfacetyp-3, topic_t404_mde_suppliers-1, topic_t404_mde_suppliers-3, topic_t417_order_stock_factors-1, topic_t417_order_stock_factors-3, topic_t419_open_store_restrictions-1, topic_t419_open_store_restrictions-3, topic_t427_holiday_rules-1, topic_t427_holiday_rules-3, topic_t440_bal_head-1, topic_t440_bal_head-3, topic_t441_bal_det-1, topic_t441_bal_det-3, topic_t443_efis_list-1, topic_t443_efis_list-3, topic_t480_tour_picklists-1, topic_t480_tour_picklists-3, topic_t480_tour_picklists-5, topic_t480_tour_picklists-7, topic_t481_hauliers-1, topic_t481_hauliers-3, topic_t483_rest_palettes-1, topic_t483_rest_palettes-3, topic_t484_tour_comments-1, topic_t484_tour_comments-3, topic_t485_timefactors-1, topic_t485_timefactors-3]), conne
ctor-consumer-table-small-12-sink-iceberg-0-48516cb7-2505-41e9-87c5-a517b0788cc9=Assignment(partitions=[topic_t175_kred_carriers-0, topic_t175_kred_carriers-2, topic_t177_dblogin-0, topic_t177_dblogin-2, topic_t182_ctw_ <prefix>-0, topic_t182_ctw_ <prefix>-2, topic_t183_splace_gate-0, topic_t183_splace_gate-2, topic_t184_sic_opendocs-0, topic_t184_sic_opendocs-2, topic_t186_new_ean-0, topic_t186_new_ean-2, topic_t189_carriers-0, topic_t189_carriers-2, topic_t230_inv_repheader-0, topic_t230_inv_repheader-2, topic_t231_inv_repdetail-0, topic_t231_inv_repdetail-2, topic_t239_storage-0, topic_t239_storage-2, topic_t240_hazard-0, topic_t240_hazard-2, topic_t241_ph_value-0, topic_t241_ph_value-2, topic_t255_ars16audit-0, topic_t255_ars16audit-2, topic_t300_bookingperiod-0, topic_t300_bookingperiod-2, topic_t306_spcondsubtype-0, topic_t306_spcondsubtype-2, topic_t307_specialcondit-0, topic_t307_specialcondit-2, topic_t370_bo_input_lct-0, topic_t370_bo_input_lct-2, topic_t390_sapintfacetyp-
0, topic_t390_sapintfacetyp-2, topic_t404_mde_suppliers-0, topic_t404_mde_suppliers-2, topic_t417_order_stock_factors-0, topic_t417_order_stock_factors-2, topic_t419_open_store_restrictions-0, topic_t419_open_store_restrictions-2, topic_t427_holiday_rules-0, topic_t427_holiday_rules-2, topic_t440_bal_head-0, topic_t440_bal_head-2, topic_t441_bal_det-0, topic_t441_bal_det-2, topic_t443_efis_list-0, topic_t443_efis_list-2, topic_t480_tour_picklists-0, topic_t480_tour_picklists-2, topic_t480_tour_picklists-4, topic_t480_tour_picklists-6, topic_t481_hauliers-0, topic_t481_hauliers-2, topic_t483_rest_palettes-0, topic_t483_rest_palettes-2, topic_t484_tour_comments-0, topic_t484_tour_comments-2, topic_t485_timefactors-0, topic_t485_timefactors-2])} (org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:664)
[2025-09-04 15:01:56,060] INFO [table-small-12-sink-iceberg|task-1] [Consumer clientId=connector-consumer-table-small-12-sink-iceberg-1, groupId=connect-table-small-12-sink-iceberg] Request joining group due to: encountered UNKNOWN_MEMBER_ID from SYNC_GROUP response (org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:1103)
[2025-09-04 15:01:56,060] INFO [table-small-12-sink-iceberg|task-1] [Consumer clientId=connector-consumer-table-small-12-sink-iceberg-1, groupId=connect-table-small-12-sink-iceberg] Request joining group due to: rebalance failed due to 'The coordinator is not aware of this member.' (UnknownMemberIdException) (org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:1103)
[2025-09-04 15:01:56,060] INFO [table-small-12-sink-iceberg|task-1] [Consumer clientId=connector-consumer-table-small-12-sink-iceberg-1, groupId=connect-table-small-12-sink-iceberg] Resetting generation and member id due to: encountered UNKNOWN_MEMBER_ID from SYNC_GROUP response (org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:1056)
[2025-09-04 15:01:56,060] INFO [table-small-12-sink-iceberg|task-1] [Consumer clientId=connector-consumer-table-small-12-sink-iceberg-1, groupId=connect-table-small-12-sink-iceberg] SyncGroup failed: The coordinator is not aware of this member. Need to re-join the group. Sent generation was Generation{generationId=483, memberId='connector-consumer-table-small-12-sink-iceberg-1-44f4b0fb-21d8-466d-9702-1317a49ecfca', protocol='roundrobin'} (org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:878)
[2025-09-04 15:01:56,061] INFO [Consumer clientId=connector-consumer-table-small-12-sink-iceberg-0, groupId=connect-table-small-12-sink-iceberg] Client requested disconnect from node 2147483643 (org.apache.kafka.clients.NetworkClient:460)
[2025-09-04 15:01:56,061] INFO [table-small-12-sink-iceberg|task-1] [Consumer clientId=connector-consumer-table-small-12-sink-iceberg-1, groupId=connect-table-small-12-sink-iceberg] (Re-)joining group (org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:605)
[2025-09-04 15:01:56,062] INFO [Consumer clientId=connector-consumer-table-small-12-sink-iceberg-0, groupId=connect-table-small-12-sink-iceberg] Cancelled in-flight HEARTBEAT request with correlation id 10 due to node 2147483643 being disconnected (elapsed time since creation: 13695ms, elapsed time since send: 13695ms, throttle time: 0ms, request timeout: 60000ms) (org.apache.kafka.clients.NetworkClient:480)
[2025-09-04 15:01:56,062] INFO [Consumer clientId=connector-consumer-table-small-12-sink-iceberg-0, groupId=connect-table-small-12-sink-iceberg] Cancelled in-flight HEARTBEAT request with correlation id 7 due to node 2147483643 being disconnected (elapsed time since creation: 34367ms, elapsed time since send: 34367ms, throttle time: 0ms, request timeout: 60000ms) (org.apache.kafka.clients.NetworkClient:480)
[2025-09-04 15:01:56,062] INFO [Consumer clientId=connector-consumer-table-small-12-sink-iceberg-0, groupId=connect-table-small-12-sink-iceberg] Cancelled in-flight HEARTBEAT request with correlation id 8 due to node 2147483643 being disconnected (elapsed time since creation: 19695ms, elapsed time since send: 19695ms, throttle time: 0ms, request timeout: 60000ms) (org.apache.kafka.clients.NetworkClient:480)
[2025-09-04 15:01:56,062] INFO [Consumer clientId=connector-consumer-table-small-12-sink-iceberg-0, groupId=connect-table-small-12-sink-iceberg] Cancelled in-flight HEARTBEAT request with correlation id 9 due to node 2147483643 being disconnected (elapsed time since creation: 16695ms, elapsed time since send: 16695ms, throttle time: 0ms, request timeout: 60000ms) (org.apache.kafka.clients.NetworkClient:480)
[2025-09-04 15:01:56,063] INFO [table-small-12-sink-iceberg|task-1] [Consumer clientId=connector-consumer-table-small-12-sink-iceberg-1, groupId=connect-table-small-12-sink-iceberg] (Re-)joining group (org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:605)
[2025-09-04 15:01:56,063] INFO [table-small-12-sink-iceberg|task-1] [Consumer clientId=connector-consumer-table-small-12-sink-iceberg-1, groupId=connect-table-small-12-sink-iceberg] Request joining group due to: need to re-join with the given member-id: connector-consumer-table-small-12-sink-iceberg-1-26317796-8cba-4a40-91b0-62bc776e9319 (org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:1103)
[2025-09-04 15:01:56,083] INFO [table-small-12-sink-iceberg|task-0] [Consumer clientId=connector-consumer-table-small-12-sink-iceberg-0, groupId=connect-table-small-12-sink-iceberg] Discovered group coordinator <coord>.westeurope.azure.confluent.cloud:9092 (id: 2147483643 rack: null isFenced: false) (org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:937)
[2025-09-04 15:01:56,083] INFO [table-small-12-sink-iceberg|task-0] [Consumer clientId=connector-consumer-table-small-12-sink-iceberg-0, groupId=connect-table-small-12-sink-iceberg] Group coordinator <coord>.westeurope.azure.confluent.cloud:9092 (id: 2147483643 rack: null isFenced: false) is unavailable or invalid due to cause: coordinator unavailable. isDisconnected: false. Rediscovery will be attempted. (org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:1000)
[2025-09-04 15:01:56,083] INFO [table-small-12-sink-iceberg|task-0] [Consumer clientId=connector-consumer-table-small-12-sink-iceberg-0, groupId=connect-table-small-12-sink-iceberg] Requesting disconnect from last known coordinator <coord>.westeurope.azure.confluent.cloud:9092 (id: 2147483643 rack: null isFenced: false) (org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:1013)
[2025-09-04 15:01:56,177] INFO [table-small-12-sink-iceberg|task-0] [Consumer clientId=connector-consumer-table-small-12-sink-iceberg-0, groupId=connect-table-small-12-sink-iceberg] Discovered group coordinator <coord>.westeurope.azure.confluent.cloud:9092 (id: 2147483643 rack: null isFenced: false) (org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:937)
[2025-09-04 15:01:56,178] INFO [table-small-12-sink-iceberg|task-0] [Consumer clientId=connector-consumer-table-small-12-sink-iceberg-0, groupId=connect-table-small-12-sink-iceberg] (Re-)joining group (org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:605)
[2025-09-04 15:01:56,178] INFO [table-small-12-sink-iceberg|task-0] [Consumer clientId=connector-consumer-table-small-12-sink-iceberg-0, groupId=connect-table-small-12-sink-iceberg] Request joining group due to: rebalance failed due to 'The group is rebalancing, so a rejoin is needed.' (RebalanceInProgressException) (org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:1103)
[2025-09-04 15:01:56,188] INFO [table-small-12-sink-iceberg|task-1] [Consumer clientId=connector-consumer-table-small-12-sink-iceberg-1, groupId=connect-table-small-12-sink-iceberg] Successfully joined group with generation Generation{generationId=484, memberId='connector-consumer-table-small-12-sink-iceberg-1-26317796-8cba-4a40-91b0-62bc776e9319', protocol='roundrobin'} (org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:666)
[2025-09-04 15:01:56,193] INFO [table-small-12-sink-iceberg|task-1] [Consumer clientId=connector-consumer-table-small-12-sink-iceberg-1, groupId=connect-table-small-12-sink-iceberg] Adding newly assigned partitions: topic_t175_kred_carriers-1, topic_t175_kred_carriers-3, topic_t177_dblogin-1, topic_t177_dblogin-3, topic_t182_ctw_ <prefix>-1, topic_t182_ctw_ <prefix>-3, topic_t183_splace_gate-1, topic_t183_splace_gate-3, topic_t184_sic_opendocs-1, topic_t184_sic_opendocs-3, topic_t186_new_ean-1, topic_t186_new_ean-3, topic_t189_carriers-1, topic_t189_carriers-3, topic_t230_inv_repheader-1, topic_t230_inv_repheader-3, topic_t231_inv_repdetail-1, topic_t231_inv_repdetail-3, topic_t239_storage-1, topic_t239_storage-3, topic_t240_hazard-1, topic_t240_hazard-3, topic_t241_ph_value-1, topic_t241_ph_value-3, topic_t255_ars16audit-1, topic_t255_ars16audit-3, topic_t300_bookingperiod-1, topic_t300_bookingperiod-3, topic_t306_spcondsubtype-1, topic_t306_spcondsubtype-3, topic_t307_specialcon
dit-1, topic_t307_specialcondit-3, topic_t370_bo_input_lct-1, topic_t370_bo_input_lct-3, topic_t390_sapintfacetyp-1, topic_t390_sapintfacetyp-3, topic_t404_mde_suppliers-1, topic_t404_mde_suppliers-3, topic_t417_order_stock_factors-1, topic_t417_order_stock_factors-3, topic_t419_open_store_restrictions-1, topic_t419_open_store_restrictions-3, topic_t427_holiday_rules-1, topic_t427_holiday_rules-3, topic_t440_bal_head-1, topic_t440_bal_head-3, topic_t441_bal_det-1, topic_t441_bal_det-3, topic_t443_efis_list-1, topic_t443_efis_list-3, topic_t480_tour_picklists-1, topic_t480_tour_picklists-3, topic_t480_tour_picklists-5, topic_t480_tour_picklists-7, topic_t481_hauliers-1, topic_t481_hauliers-3, topic_t483_rest_palettes-1, topic_t483_rest_palettes-3, topic_t484_tour_comments-1, topic_t484_tour_comments-3, topic_t485_timefactors-1, topic_t485_timefactors-3 (org.apache.kafka.clients.consumer.internals.ConsumerRebalanceListenerInvoker:58)
[2025-09-04 15:01:56,193] INFO [table-small-12-sink-iceberg|task-1] [Consumer clientId=connector-consumer-table-small-12-sink-iceberg-1, groupId=connect-table-small-12-sink-iceberg] Notifying assignor about the new Assignment(partitions=[topic_t175_kred_carriers-1, topic_t175_kred_carriers-3, topic_t177_dblogin-1, topic_t177_dblogin-3, topic_t182_ctw_ <prefix>-1, topic_t182_ctw_ <prefix>-3, topic_t183_splace_gate-1, topic_t183_splace_gate-3, topic_t184_sic_opendocs-1, topic_t184_sic_opendocs-3, topic_t186_new_ean-1, topic_t186_new_ean-3, topic_t189_carriers-1, topic_t189_carriers-3, topic_t230_inv_repheader-1, topic_t230_inv_repheader-3, topic_t231_inv_repdetail-1, topic_t231_inv_repdetail-3, topic_t239_storage-1, topic_t239_storage-3, topic_t240_hazard-1, topic_t240_hazard-3, topic_t241_ph_value-1, topic_t241_ph_value-3, topic_t255_ars16audit-1, topic_t255_ars16audit-3, topic_t300_bookingperiod-1, topic_t300_bookingperiod-3, topic_t306_spcondsubtype-1, topic_t306_spcondsubtype-3,
topic_t307_specialcondit-1, topic_t307_specialcondit-3, topic_t370_bo_input_lct-1, topic_t370_bo_input_lct-3, topic_t390_sapintfacetyp-1, topic_t390_sapintfacetyp-3, topic_t404_mde_suppliers-1, topic_t404_mde_suppliers-3, topic_t417_order_stock_factors-1, topic_t417_order_stock_factors-3, topic_t419_open_store_restrictions-1, topic_t419_open_store_restrictions-3, topic_t427_holiday_rules-1, topic_t427_holiday_rules-3, topic_t440_bal_head-1, topic_t440_bal_head-3, topic_t441_bal_det-1, topic_t441_bal_det-3, topic_t443_efis_list-1, topic_t443_efis_list-3, topic_t480_tour_picklists-1, topic_t480_tour_picklists-3, topic_t480_tour_picklists-5, topic_t480_tour_picklists-7, topic_t481_hauliers-1, topic_t481_hauliers-3, topic_t483_rest_palettes-1, topic_t483_rest_palettes-3, topic_t484_tour_comments-1, topic_t484_tour_comments-3, topic_t485_timefactors-1, topic_t485_timefactors-3]) (org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:324)
[2025-09-04 15:01:56,193] INFO [table-small-12-sink-iceberg|task-1] [Consumer clientId=connector-consumer-table-small-12-sink-iceberg-1, groupId=connect-table-small-12-sink-iceberg] Successfully synced group in generation Generation{generationId=484, memberId='connector-consumer-table-small-12-sink-iceberg-1-26317796-8cba-4a40-91b0-62bc776e9319', protocol='roundrobin'} (org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:843)
[2025-09-04 15:01:56,195] INFO [table-small-12-sink-iceberg|task-0] [Consumer clientId=connector-consumer-table-small-12-sink-iceberg-0, groupId=connect-table-small-12-sink-iceberg] Finished assignment for group at generation 484: {connector-consumer-table-small-12-sink-iceberg-1-26317796-8cba-4a40-91b0-62bc776e9319=Assignment(partitions=[topic_t175_kred_carriers-1, topic_t175_kred_carriers-3, topic_t177_dblogin-1, topic_t177_dblogin-3, topic_t182_ctw_ <prefix>-1, topic_t182_ctw_ <prefix>-3, topic_t183_splace_gate-1, topic_t183_splace_gate-3, topic_t184_sic_opendocs-1, topic_t184_sic_opendocs-3, topic_t186_new_ean-1, topic_t186_new_ean-3, topic_t189_carriers-1, topic_t189_carriers-3, topic_t230_inv_repheader-1, topic_t230_inv_repheader-3, topic_t231_inv_repdetail-1, topic_t231_inv_repdetail-3, topic_t239_storage-1, topic_t239_storage-3, topic_t240_hazard-1, topic_t240_hazard-3, topic_t241_ph_value-1, topic_t241_ph_value-3, topic_t255_ars16audit-1, topic_t255_ars16audit-3, topic_t3
00_bookingperiod-1, topic_t300_bookingperiod-3, topic_t306_spcondsubtype-1, topic_t306_spcondsubtype-3, topic_t307_specialcondit-1, topic_t307_specialcondit-3, topic_t370_bo_input_lct-1, topic_t370_bo_input_lct-3, topic_t390_sapintfacetyp-1, topic_t390_sapintfacetyp-3, topic_t404_mde_suppliers-1, topic_t404_mde_suppliers-3, topic_t417_order_stock_factors-1, topic_t417_order_stock_factors-3, topic_t419_open_store_restrictions-1, topic_t419_open_store_restrictions-3, topic_t427_holiday_rules-1, topic_t427_holiday_rules-3, topic_t440_bal_head-1, topic_t440_bal_head-3, topic_t441_bal_det-1, topic_t441_bal_det-3, topic_t443_efis_list-1, topic_t443_efis_list-3, topic_t480_tour_picklists-1, topic_t480_tour_picklists-3, topic_t480_tour_picklists-5, topic_t480_tour_picklists-7, topic_t481_hauliers-1, topic_t481_hauliers-3, topic_t483_rest_palettes-1, topic_t483_rest_palettes-3, topic_t484_tour_comments-1, topic_t484_tour_comments-3, topic_t485_timefactors-1, topic_t485_timefactors-3]), conne
ctor-consumer-table-small-12-sink-iceberg-0-48516cb7-2505-41e9-87c5-a517b0788cc9=Assignment(partitions=[topic_t175_kred_carriers-0, topic_t175_kred_carriers-2, topic_t177_dblogin-0, topic_t177_dblogin-2, topic_t182_ctw_ <prefix>-0, topic_t182_ctw_ <prefix>-2, topic_t183_splace_gate-0, topic_t183_splace_gate-2, topic_t184_sic_opendocs-0, topic_t184_sic_opendocs-2, topic_t186_new_ean-0, topic_t186_new_ean-2, topic_t189_carriers-0, topic_t189_carriers-2, topic_t230_inv_repheader-0, topic_t230_inv_repheader-2, topic_t231_inv_repdetail-0, topic_t231_inv_repdetail-2, topic_t239_storage-0, topic_t239_storage-2, topic_t240_hazard-0, topic_t240_hazard-2, topic_t241_ph_value-0, topic_t241_ph_value-2, topic_t255_ars16audit-0, topic_t255_ars16audit-2, topic_t300_bookingperiod-0, topic_t300_bookingperiod-2, topic_t306_spcondsubtype-0, topic_t306_spcondsubtype-2, topic_t307_specialcondit-0, topic_t307_specialcondit-2, topic_t370_bo_input_lct-0, topic_t370_bo_input_lct-2, topic_t390_sapintfacetyp-
0, topic_t390_sapintfacetyp-2, topic_t404_mde_suppliers-0, topic_t404_mde_suppliers-2, topic_t417_order_stock_factors-0, topic_t417_order_stock_factors-2, topic_t419_open_store_restrictions-0, topic_t419_open_store_restrictions-2, topic_t427_holiday_rules-0, topic_t427_holiday_rules-2, topic_t440_bal_head-0, topic_t440_bal_head-2, topic_t441_bal_det-0, topic_t441_bal_det-2, topic_t443_efis_list-0, topic_t443_efis_list-2, topic_t480_tour_picklists-0, topic_t480_tour_picklists-2, topic_t480_tour_picklists-4, topic_t480_tour_picklists-6, topic_t481_hauliers-0, topic_t481_hauliers-2, topic_t483_rest_palettes-0, topic_t483_rest_palettes-2, topic_t484_tour_comments-0, topic_t484_tour_comments-2, topic_t485_timefactors-0, topic_t485_timefactors-2])} (org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:664)
[2025-09-04 15:01:56,195] INFO [table-small-12-sink-iceberg|task-0] [Consumer clientId=connector-consumer-table-small-12-sink-iceberg-0, groupId=connect-table-small-12-sink-iceberg] Successfully joined group with generation Generation{generationId=484, memberId='connector-consumer-table-small-12-sink-iceberg-0-48516cb7-2505-41e9-87c5-a517b0788cc9', protocol='roundrobin'} (org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:666)
[2025-09-04 15:01:56,197] INFO [table-small-12-sink-iceberg|task-1] [Consumer clientId=connector-consumer-table-small-12-sink-iceberg-1, groupId=connect-table-small-12-sink-iceberg] Found no committed offset for partition topic_t241_ph_value-1 (org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:1508)
[2025-09-04 15:01:56,197] INFO [table-small-12-sink-iceberg|task-1] [Consumer clientId=connector-consumer-table-small-12-sink-iceberg-1, groupId=connect-table-small-12-sink-iceberg] Found no committed offset for partition topic_t390_sapintfacetyp-3 (org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:1508)
[2025-09-04 15:01:56,197] INFO [table-small-12-sink-iceberg|task-1] [Consumer clientId=connector-consumer-table-small-12-sink-iceberg-1, groupId=connect-table-small-12-sink-iceberg] Found no committed offset for partition topic_t255_ars16audit-1 (org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:1508)
[2025-09-04 15:01:56,197] INFO [table-small-12-sink-iceberg|task-1] [Consumer clientId=connector-consumer-table-small-12-sink-iceberg-1, groupId=connect-table-small-12-sink-iceberg] Found no committed offset for partition topic_t307_specialcondit-3 (org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:1508)
[2025-09-04 15:01:56,197] INFO [table-small-12-sink-iceberg|task-1] [Consumer clientId=connector-consumer-table-small-12-sink-iceberg-1, groupId=connect-table-small-12-sink-iceberg] Found no committed offset for partition topic_t404_mde_suppliers-1 (org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:1508)
[2025-09-04 15:01:56,197] INFO [table-small-12-sink-iceberg|task-1] [Consumer clientId=connector-consumer-table-small-12-sink-iceberg-1, groupId=connect-table-small-12-sink-iceberg] Found no committed offset for partition topic_t239_storage-1 (org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:1508)
[2025-09-04 15:01:56,197] INFO [table-small-12-sink-iceberg|task-1] [Consumer clientId=connector-consumer-table-small-12-sink-iceberg-1, groupId=connect-table-small-12-sink-iceberg] Found no committed offset for partition topic_t485_timefactors-1 (org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:1508)
[2025-09-04 15:01:56,197] INFO [table-small-12-sink-iceberg|task-1] [Consumer clientId=connector-consumer-table-small-12-sink-iceberg-1, groupId=connect-table-small-12-sink-iceberg] Found no committed offset for partition topic_t186_new_ean-3 (org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:1508)
[2025-09-04 15:01:56,197] INFO [table-small-12-sink-iceberg|task-1] [Consumer clientId=connector-consumer-table-small-12-sink-iceberg-1, groupId=connect-table-small-12-sink-iceberg] Found no committed offset for partition topic_t481_hauliers-1 (org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:1508)
[2025-09-04 15:01:56,197] INFO [table-small-12-sink-iceberg|task-1] [Consumer clientId=connector-consumer-table-small-12-sink-iceberg-1, groupId=connect-table-small-12-sink-iceberg] Found no committed offset for partition topic_t370_bo_input_lct-3 (org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:1508)
[2025-09-04 15:01:56,197] INFO [table-small-12-sink-iceberg|task-1] [Consumer clientId=connector-consumer-table-small-12-sink-iceberg-1, groupId=connect-table-small-12-sink-iceberg] Found no committed offset for partition topic_t484_tour_comments-3 (org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:1508)
[2025-09-04 15:01:56,197] INFO [table-small-12-sink-iceberg|task-1] [Consumer clientId=connector-consumer-table-small-12-sink-iceberg-1, groupId=connect-table-small-12-sink-iceberg] Found no committed offset for partition topic_t427_holiday_rules-1 (org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:1508)
[2025-09-04 15:01:56,197] INFO [table-small-12-sink-iceberg|task-1] [Consumer clientId=connector-consumer-table-small-12-sink-iceberg-1, groupId=connect-table-small-12-sink-iceberg] Found no committed offset for partition topic_t419_open_store_restrictions-1 (org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:1508)
[2025-09-04 15:01:56,198] INFO [table-small-12-sink-iceberg|task-1] [Consumer clientId=connector-consumer-table-small-12-sink-iceberg-1, groupId=connect-table-small-12-sink-iceberg] Found no committed offset for partition topic_t240_hazard-3 (org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:1508)
[2025-09-04 15:01:56,198] INFO [table-small-12-sink-iceberg|task-1] [Consumer clientId=connector-consumer-table-small-12-sink-iceberg-1, groupId=connect-table-small-12-sink-iceberg] Found no committed offset for partition topic_t306_spcondsubtype-3 (org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:1508)
[2025-09-04 15:01:56,198] INFO [table-small-12-sink-iceberg|task-1] [Consumer clientId=connector-consumer-table-small-12-sink-iceberg-1, groupId=connect-table-small-12-sink-iceberg] Found no committed offset for partition topic_t241_ph_value-3 (org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:1508)
[2025-09-04 15:01:56,198] INFO [table-small-12-sink-iceberg|task-1] [Consumer clientId=connector-consumer-table-small-12-sink-iceberg-1, groupId=connect-table-small-12-sink-iceberg] Found no committed offset for partition topic_t255_ars16audit-3 (org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:1508)
[2025-09-04 15:01:56,198] INFO [table-small-12-sink-iceberg|task-1] [Consumer clientId=connector-consumer-table-small-12-sink-iceberg-1, groupId=connect-table-small-12-sink-iceberg] Found no committed offset for partition topic_t307_specialcondit-1 (org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:1508)
[2025-09-04 15:01:56,198] INFO [table-small-12-sink-iceberg|task-1] [Consumer clientId=connector-consumer-table-small-12-sink-iceberg-1, groupId=connect-table-small-12-sink-iceberg] Found no committed offset for partition topic_t404_mde_suppliers-3 (org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:1508)
[2025-09-04 15:01:56,198] INFO [table-small-12-sink-iceberg|task-1] [Consumer clientId=connector-consumer-table-small-12-sink-iceberg-1, groupId=connect-table-small-12-sink-iceberg] Found no committed offset for partition topic_t390_sapintfacetyp-1 (org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:1508)
[2025-09-04 15:01:56,198] INFO [table-small-12-sink-iceberg|task-1] [Consumer clientId=connector-consumer-table-small-12-sink-iceberg-1, groupId=connect-table-small-12-sink-iceberg] Found no committed offset for partition topic_t186_new_ean-1 (org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:1508)
[2025-09-04 15:01:56,198] INFO [table-small-12-sink-iceberg|task-1] [Consumer clientId=connector-consumer-table-small-12-sink-iceberg-1, groupId=connect-table-small-12-sink-iceberg] Found no committed offset for partition topic_t370_bo_input_lct-1 (org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:1508)
[2025-09-04 15:01:56,198] INFO [table-small-12-sink-iceberg|task-1] [Consumer clientId=connector-consumer-table-small-12-sink-iceberg-1, groupId=connect-table-small-12-sink-iceberg] Found no committed offset for partition topic_t239_storage-3 (org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:1508)
[2025-09-04 15:01:56,198] INFO [table-small-12-sink-iceberg|task-1] [Consumer clientId=connector-consumer-table-small-12-sink-iceberg-1, groupId=connect-table-small-12-sink-iceberg] Found no committed offset for partition topic_t485_timefactors-3 (org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:1508)
[2025-09-04 15:01:56,198] INFO [table-small-12-sink-iceberg|task-1] [Consumer clientId=connector-consumer-table-small-12-sink-iceberg-1, groupId=connect-table-small-12-sink-iceberg] Found no committed offset for partition topic_t484_tour_comments-1 (org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:1508)
[2025-09-04 15:01:56,198] INFO [table-small-12-sink-iceberg|task-1] [Consumer clientId=connector-consumer-table-small-12-sink-iceberg-1, groupId=connect-table-small-12-sink-iceberg] Found no committed offset for partition topic_t481_hauliers-3 (org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:1508)
[2025-09-04 15:01:56,198] INFO [table-small-12-sink-iceberg|task-1] [Consumer clientId=connector-consumer-table-small-12-sink-iceberg-1, groupId=connect-table-small-12-sink-iceberg] Found no committed offset for partition topic_t240_hazard-1 (org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:1508)
[2025-09-04 15:01:56,198] INFO [table-small-12-sink-iceberg|task-1] [Consumer clientId=connector-consumer-table-small-12-sink-iceberg-1, groupId=connect-table-small-12-sink-iceberg] Found no committed offset for partition topic_t306_spcondsubtype-1 (org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:1508)
[2025-09-04 15:01:56,198] INFO [table-small-12-sink-iceberg|task-1] [Consumer clientId=connector-consumer-table-small-12-sink-iceberg-1, groupId=connect-table-small-12-sink-iceberg] Found no committed offset for partition topic_t427_holiday_rules-3 (org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:1508)
[2025-09-04 15:01:56,198] INFO [table-small-12-sink-iceberg|task-1] [Consumer clientId=connector-consumer-table-small-12-sink-iceberg-1, groupId=connect-table-small-12-sink-iceberg] Found no committed offset for partition topic_t419_open_store_restrictions-3 (org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:1508)
[2025-09-04 15:01:56,198] INFO [table-small-12-sink-iceberg|task-1] Setting offset for partition topic_t175_kred_carriers-1 to the committed offset FetchPosition{offset=208248, offsetEpoch=Optional.empty, currentLeader=LeaderAndEpoch{leader=Optional[<coord>.azure.confluent.cloud:9092 (id: 5 rack: 2 isFenced: false)], epoch=27}} (org.apache.kafka.clients.consumer.internals.ConsumerUtils:209)
[2025-09-04 15:01:56,198] INFO [table-small-12-sink-iceberg|task-1] Setting offset for partition topic_t175_kred_carriers-3 to the committed offset FetchPosition{offset=275699, offsetEpoch=Optional.empty, currentLeader=LeaderAndEpoch{leader=Optional[<coord>.azure.confluent.cloud:9092 (id: 0 rack: 0 isFenced: false)], epoch=62}} (org.apache.kafka.clients.consumer.internals.ConsumerUtils:209)
[2025-09-04 15:01:56,198] INFO [table-small-12-sink-iceberg|task-1] Setting offset for partition topic_t177_dblogin-1 to the committed offset FetchPosition{offset=11, offsetEpoch=Optional.empty, currentLeader=LeaderAndEpoch{leader=Optional[<coord>.azure.confluent.cloud:9092 (id: 2 rack: 2 isFenced: false)], epoch=29}} (org.apache.kafka.clients.consumer.internals.ConsumerUtils:209)
[2025-09-04 15:01:56,198] INFO [table-small-12-sink-iceberg|task-1] Setting offset for partition topic_t177_dblogin-3 to the committed offset FetchPosition{offset=6, offsetEpoch=Optional.empty, currentLeader=LeaderAndEpoch{leader=Optional[<coord>.azure.confluent.cloud:9092 (id: 3 rack: 0 isFenced: false)], epoch=30}} (org.apache.kafka.clients.consumer.internals.ConsumerUtils:209)
[2025-09-04 15:01:56,198] INFO [table-small-12-sink-iceberg|task-1] Setting offset for partition topic_t182_ctw_ <prefix>-1 to the committed offset FetchPosition{offset=98439, offsetEpoch=Optional.empty, currentLeader=LeaderAndEpoch{leader=Optional[<coord>.westeurope.azure.confluent.cloud:9092 (id: 4 rack: 1 isFenced: false)], epoch=29}} (org.apache.kafka.clients.consumer.internals.ConsumerUtils:209)
[2025-09-04 15:01:56,198] INFO [table-small-12-sink-iceberg|task-1] Setting offset for partition topic_t182_ctw_ <prefix>-3 to the committed offset FetchPosition{offset=97242, offsetEpoch=Optional.empty, currentLeader=LeaderAndEpoch{leader=Optional[<coord>.azure.confluent.cloud:9092 (id: 5 rack: 2 isFenced: false)], epoch=67}} (org.apache.kafka.clients.consumer.internals.ConsumerUtils:209)
[2025-09-04 15:01:56,198] INFO [table-small-12-sink-iceberg|task-1] Setting offset for partition topic_t183_splace_gate-1 to the committed offset FetchPosition{offset=105, offsetEpoch=Optional.empty, currentLeader=LeaderAndEpoch{leader=Optional[<coord>.westeurope.azure.confluent.cloud:9092 (id: 4 rack: 1 isFenced: false)], epoch=34}} (org.apache.kafka.clients.consumer.internals.ConsumerUtils:209)
[2025-09-04 15:01:56,198] INFO [table-small-12-sink-iceberg|task-1] Setting offset for partition topic_t183_splace_gate-3 to the committed offset FetchPosition{offset=203, offsetEpoch=Optional.empty, currentLeader=LeaderAndEpoch{leader=Optional[<coord>.azure.confluent.cloud:9092 (id: 3 rack: 0 isFenced: false)], epoch=32}} (org.apache.kafka.clients.consumer.internals.ConsumerUtils:209)
[2025-09-04 15:01:56,198] INFO [table-small-12-sink-iceberg|task-1] Setting offset for partition topic_t184_sic_opendocs-1 to the committed offset FetchPosition{offset=1, offsetEpoch=Optional.empty, currentLeader=LeaderAndEpoch{leader=Optional[<coord>.azure.confluent.cloud:9092 (id: 1 rack: 1 isFenced: false)], epoch=28}} (org.apache.kafka.clients.consumer.internals.ConsumerUtils:209)
[2025-09-04 15:01:56,198] INFO [table-small-12-sink-iceberg|task-1] Setting offset for partition topic_t184_sic_opendocs-3 to the committed offset FetchPosition{offset=6, offsetEpoch=Optional.empty, currentLeader=LeaderAndEpoch{leader=Optional[<coord>.azure.confluent.cloud:9092 (id: 3 rack: 0 isFenced: false)], epoch=30}} (org.apache.kafka.clients.consumer.internals.ConsumerUtils:209)
[2025-09-04 15:01:56,198] INFO [table-small-12-sink-iceberg|task-1] Setting offset for partition topic_t189_carriers-1 to the committed offset FetchPosition{offset=3066, offsetEpoch=Optional.empty, currentLeader=LeaderAndEpoch{leader=Optional[<coord>.azure.confluent.cloud:9092 (id: 1 rack: 1 isFenced: false)], epoch=29}} (org.apache.kafka.clients.consumer.internals.ConsumerUtils:209)
[2025-09-04 15:01:56,198] INFO [table-small-12-sink-iceberg|task-1] Setting offset for partition topic_t189_carriers-3 to the committed offset FetchPosition{offset=3090, offsetEpoch=Optional.empty, currentLeader=LeaderAndEpoch{leader=Optional[<coord>.azure.confluent.cloud:9092 (id: 3 rack: 0 isFenced: false)], epoch=30}} (org.apache.kafka.clients.consumer.internals.ConsumerUtils:209)
[2025-09-04 15:01:56,198] INFO [table-small-12-sink-iceberg|task-1] Setting offset for partition topic_t230_inv_repheader-1 to the committed offset FetchPosition{offset=32, offsetEpoch=Optional.empty, currentLeader=LeaderAndEpoch{leader=Optional[<coord>.westeurope.azure.confluent.cloud:9092 (id: 4 rack: 1 isFenced: false)], epoch=28}} (org.apache.kafka.clients.consumer.internals.ConsumerUtils:209)
[2025-09-04 15:01:56,198] INFO [table-small-12-sink-iceberg|task-1] Setting offset for partition topic_t230_inv_repheader-3 to the committed offset FetchPosition{offset=30, offsetEpoch=Optional.empty, currentLeader=LeaderAndEpoch{leader=Optional[<coord>.azure.confluent.cloud:9092 (id: 5 rack: 2 isFenced: false)], epoch=26}} (org.apache.kafka.clients.consumer.internals.ConsumerUtils:209)
[2025-09-04 15:01:56,198] INFO [table-small-12-sink-iceberg|task-1] Setting offset for partition topic_t231_inv_repdetail-1 to the committed offset FetchPosition{offset=347168, offsetEpoch=Optional.empty, currentLeader=LeaderAndEpoch{leader=Optional[<coord>.azure.confluent.cloud:9092 (id: 3 rack: 0 isFenced: false)], epoch=32}} (org.apache.kafka.clients.consumer.internals.ConsumerUtils:209)
[2025-09-04 15:01:56,198] INFO [table-small-12-sink-iceberg|task-1] Setting offset for partition topic_t231_inv_repdetail-3 to the committed offset FetchPosition{offset=347841, offsetEpoch=Optional.empty, currentLeader=LeaderAndEpoch{leader=Optional[<coord>.azure.confluent.cloud:9092 (id: 5 rack: 2 isFenced: false)], epoch=32}} (org.apache.kafka.clients.consumer.internals.ConsumerUtils:209)
[2025-09-04 15:01:56,198] INFO [table-small-12-sink-iceberg|task-1] Setting offset for partition topic_t300_bookingperiod-1 to the committed offset FetchPosition{offset=149, offsetEpoch=Optional.empty, currentLeader=LeaderAndEpoch{leader=Optional[<coord>.azure.confluent.cloud:9092 (id: 0 rack: 0 isFenced: false)], epoch=33}} (org.apache.kafka.clients.consumer.internals.ConsumerUtils:209)
[2025-09-04 15:01:56,198] INFO [table-small-12-sink-iceberg|task-1] Setting offset for partition topic_t300_bookingperiod-3 to the committed offset FetchPosition{offset=82, offsetEpoch=Optional.empty, currentLeader=LeaderAndEpoch{leader=Optional[<coord>.azure.confluent.cloud:9092 (id: 3 rack: 0 isFenced: false)], epoch=31}} (org.apache.kafka.clients.consumer.internals.ConsumerUtils:209)
[2025-09-04 15:01:56,198] INFO [table-small-12-sink-iceberg|task-1] Setting offset for partition topic_t417_order_stock_factors-1 to the committed offset FetchPosition{offset=74, offsetEpoch=Optional.empty, currentLeader=LeaderAndEpoch{leader=Optional[<coord>.azure.confluent.cloud:9092 (id: 1 rack: 1 isFenced: false)], epoch=34}} (org.apache.kafka.clients.consumer.internals.ConsumerUtils:209)
[2025-09-04 15:01:56,198] INFO [table-small-12-sink-iceberg|task-1] Setting offset for partition topic_t417_order_stock_factors-3 to the committed offset FetchPosition{offset=79, offsetEpoch=Optional.empty, currentLeader=LeaderAndEpoch{leader=Optional[<coord>.azure.confluent.cloud:9092 (id: 3 rack: 0 isFenced: false)], epoch=29}} (org.apache.kafka.clients.consumer.internals.ConsumerUtils:209)
[2025-09-04 15:01:56,198] INFO [table-small-12-sink-iceberg|task-1] Setting offset for partition topic_t440_bal_head-1 to the committed offset FetchPosition{offset=39688, offsetEpoch=Optional.empty, currentLeader=LeaderAndEpoch{leader=Optional[<coord>.azure.confluent.cloud:9092 (id: 2 rack: 2 isFenced: false)], epoch=33}} (org.apache.kafka.clients.consumer.internals.ConsumerUtils:209)
[2025-09-04 15:01:56,198] INFO [table-small-12-sink-iceberg|task-1] Setting offset for partition topic_t440_bal_head-3 to the committed offset FetchPosition{offset=39611, offsetEpoch=Optional.empty, currentLeader=LeaderAndEpoch{leader=Optional[<coord>.azure.confluent.cloud:9092 (id: 3 rack: 0 isFenced: false)], epoch=31}} (org.apache.kafka.clients.consumer.internals.ConsumerUtils:209)
[2025-09-04 15:01:56,198] INFO [table-small-12-sink-iceberg|task-1] Setting offset for partition topic_t441_bal_det-1 to the committed offset FetchPosition{offset=112713, offsetEpoch=Optional.empty, currentLeader=LeaderAndEpoch{leader=Optional[<coord>.westeurope.azure.confluent.cloud:9092 (id: 4 rack: 1 isFenced: false)], epoch=28}} (org.apache.kafka.clients.consumer.internals.ConsumerUtils:209)
[2025-09-04 15:01:56,198] INFO [table-small-12-sink-iceberg|task-1] Setting offset for partition topic_t441_bal_det-3 to the committed offset FetchPosition{offset=111453, offsetEpoch=Optional.empty, currentLeader=LeaderAndEpoch{leader=Optional[<coord>.azure.confluent.cloud:9092 (id: 5 rack: 2 isFenced: false)], epoch=26}} (org.apache.kafka.clients.consumer.internals.ConsumerUtils:209)
[2025-09-04 15:01:56,198] INFO [table-small-12-sink-iceberg|task-1] Setting offset for partition topic_t443_efis_list-1 to the committed offset FetchPosition{offset=8720, offsetEpoch=Optional.empty, currentLeader=LeaderAndEpoch{leader=Optional[<coord>.azure.confluent.cloud:9092 (id: 5 rack: 2 isFenced: false)], epoch=31}} (org.apache.kafka.clients.consumer.internals.ConsumerUtils:209)
[2025-09-04 15:01:56,198] INFO [table-small-12-sink-iceberg|task-1] Setting offset for partition topic_t443_efis_list-3 to the committed offset FetchPosition{offset=13640, offsetEpoch=Optional.empty, currentLeader=LeaderAndEpoch{leader=Optional[<coord>.azure.confluent.cloud:9092 (id: 3 rack: 0 isFenced: false)], epoch=29}} (org.apache.kafka.clients.consumer.internals.ConsumerUtils:209)
[2025-09-04 15:01:56,198] INFO [table-small-12-sink-iceberg|task-1] Setting offset for partition topic_t480_tour_picklists-1 to the committed offset FetchPosition{offset=37768, offsetEpoch=Optional.empty, currentLeader=LeaderAndEpoch{leader=Optional[<coord>.azure.confluent.cloud:9092 (id: 1 rack: 1 isFenced: false)], epoch=28}} (org.apache.kafka.clients.consumer.internals.ConsumerUtils:209)
[2025-09-04 15:01:56,198] INFO [table-small-12-sink-iceberg|task-1] Setting offset for partition topic_t480_tour_picklists-3 to the committed offset FetchPosition{offset=37938, offsetEpoch=Optional.empty, currentLeader=LeaderAndEpoch{leader=Optional[<coord>.azure.confluent.cloud:9092 (id: 3 rack: 0 isFenced: false)], epoch=30}} (org.apache.kafka.clients.consumer.internals.ConsumerUtils:209)
[2025-09-04 15:01:56,198] INFO [table-small-12-sink-iceberg|task-1] Setting offset for partition topic_t480_tour_picklists-5 to the committed offset FetchPosition{offset=37597, offsetEpoch=Optional.empty, currentLeader=LeaderAndEpoch{leader=Optional[<coord>.azure.confluent.cloud:9092 (id: 5 rack: 2 isFenced: false)], epoch=26}} (org.apache.kafka.clients.consumer.internals.ConsumerUtils:209)
[2025-09-04 15:01:56,198] INFO [table-small-12-sink-iceberg|task-1] Setting offset for partition topic_t480_tour_picklists-7 to the committed offset FetchPosition{offset=37860, offsetEpoch=Optional.empty, currentLeader=LeaderAndEpoch{leader=Optional[<coord>.azure.confluent.cloud:9092 (id: 1 rack: 1 isFenced: false)], epoch=28}} (org.apache.kafka.clients.consumer.internals.ConsumerUtils:209)
[2025-09-04 15:01:56,198] INFO [table-small-12-sink-iceberg|task-1] Setting offset for partition topic_t483_rest_palettes-1 to the committed offset FetchPosition{offset=180, offsetEpoch=Optional.empty, currentLeader=LeaderAndEpoch{leader=Optional[<coord>.azure.confluent.cloud:9092 (id: 5 rack: 2 isFenced: false)], epoch=29}} (org.apache.kafka.clients.consumer.internals.ConsumerUtils:209)
[2025-09-04 15:01:56,198] INFO [table-small-12-sink-iceberg|task-1] Setting offset for partition topic_t483_rest_palettes-3 to the committed offset FetchPosition{offset=161, offsetEpoch=Optional.empty, currentLeader=LeaderAndEpoch{leader=Optional[<coord>.azure.confluent.cloud:9092 (id: 3 rack: 0 isFenced: false)], epoch=32}} (org.apache.kafka.clients.consumer.internals.ConsumerUtils:209)
[2025-09-04 15:01:56,199] INFO [table-small-12-sink-iceberg|task-0] [Consumer clientId=connector-consumer-table-small-12-sink-iceberg-0, groupId=connect-table-small-12-sink-iceberg] Successfully synced group in generation Generation{generationId=484, memberId='connector-consumer-table-small-12-sink-iceberg-0-48516cb7-2505-41e9-87c5-a517b0788cc9', protocol='roundrobin'} (org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:843)
[2025-09-04 15:01:56,200] INFO [table-small-12-sink-iceberg|task-0] [Consumer clientId=connector-consumer-table-small-12-sink-iceberg-0, groupId=connect-table-small-12-sink-iceberg] Adding newly assigned partitions: topic_t175_kred_carriers-0, topic_t175_kred_carriers-2, topic_t177_dblogin-0, topic_t177_dblogin-2, topic_t182_ctw_ <prefix>-0, topic_t182_ctw_ <prefix>-2, topic_t183_splace_gate-0, topic_t183_splace_gate-2, topic_t184_sic_opendocs-0, topic_t184_sic_opendocs-2, topic_t186_new_ean-0, topic_t186_new_ean-2, topic_t189_carriers-0, topic_t189_carriers-2, topic_t230_inv_repheader-0, topic_t230_inv_repheader-2, topic_t231_inv_repdetail-0, topic_t231_inv_repdetail-2, topic_t239_storage-0, topic_t239_storage-2, topic_t240_hazard-0, topic_t240_hazard-2, topic_t241_ph_value-0, topic_t241_ph_value-2, topic_t255_ars16audit-0, topic_t255_ars16audit-2, topic_t300_bookingperiod-0, topic_t300_bookingperiod-2, topic_t306_spcondsubtype-0, topic_t306_spcondsubtype-2, topic_t307_specialcon
dit-0, topic_t307_specialcondit-2, topic_t370_bo_input_lct-0, topic_t370_bo_input_lct-2, topic_t390_sapintfacetyp-0, topic_t390_sapintfacetyp-2, topic_t404_mde_suppliers-0, topic_t404_mde_suppliers-2, topic_t417_order_stock_factors-0, topic_t417_order_stock_factors-2, topic_t419_open_store_restrictions-0, topic_t419_open_store_restrictions-2, topic_t427_holiday_rules-0, topic_t427_holiday_rules-2, topic_t440_bal_head-0, topic_t440_bal_head-2, topic_t441_bal_det-0, topic_t441_bal_det-2, topic_t443_efis_list-0, topic_t443_efis_list-2, topic_t480_tour_picklists-0, topic_t480_tour_picklists-2, topic_t480_tour_picklists-4, topic_t480_tour_picklists-6, topic_t481_hauliers-0, topic_t481_hauliers-2, topic_t483_rest_palettes-0, topic_t483_rest_palettes-2, topic_t484_tour_comments-0, topic_t484_tour_comments-2, topic_t485_timefactors-0, topic_t485_timefactors-2 (org.apache.kafka.clients.consumer.internals.ConsumerRebalanceListenerInvoker:58)
[2025-09-04 15:01:56,200] INFO [table-small-12-sink-iceberg|task-0] [Consumer clientId=connector-consumer-table-small-12-sink-iceberg-0, groupId=connect-table-small-12-sink-iceberg] Notifying assignor about the new Assignment(partitions=[topic_t175_kred_carriers-0, topic_t175_kred_carriers-2, topic_t177_dblogin-0, topic_t177_dblogin-2, topic_t182_ctw_ <prefix>-0, topic_t182_ctw_ <prefix>-2, topic_t183_splace_gate-0, topic_t183_splace_gate-2, topic_t184_sic_opendocs-0, topic_t184_sic_opendocs-2, topic_t186_new_ean-0, topic_t186_new_ean-2, topic_t189_carriers-0, topic_t189_carriers-2, topic_t230_inv_repheader-0, topic_t230_inv_repheader-2, topic_t231_inv_repdetail-0, topic_t231_inv_repdetail-2, topic_t239_storage-0, topic_t239_storage-2, topic_t240_hazard-0, topic_t240_hazard-2, topic_t241_ph_value-0, topic_t241_ph_value-2, topic_t255_ars16audit-0, topic_t255_ars16audit-2, topic_t300_bookingperiod-0, topic_t300_bookingperiod-2, topic_t306_spcondsubtype-0, topic_t306_spcondsubtype-2,
topic_t307_specialcondit-0, topic_t307_specialcondit-2, topic_t370_bo_input_lct-0, topic_t370_bo_input_lct-2, topic_t390_sapintfacetyp-0, topic_t390_sapintfacetyp-2, topic_t404_mde_suppliers-0, topic_t404_mde_suppliers-2, topic_t417_order_stock_factors-0, topic_t417_order_stock_factors-2, topic_t419_open_store_restrictions-0, topic_t419_open_store_restrictions-2, topic_t427_holiday_rules-0, topic_t427_holiday_rules-2, topic_t440_bal_head-0, topic_t440_bal_head-2, topic_t441_bal_det-0, topic_t441_bal_det-2, topic_t443_efis_list-0, topic_t443_efis_list-2, topic_t480_tour_picklists-0, topic_t480_tour_picklists-2, topic_t480_tour_picklists-4, topic_t480_tour_picklists-6, topic_t481_hauliers-0, topic_t481_hauliers-2, topic_t483_rest_palettes-0, topic_t483_rest_palettes-2, topic_t484_tour_comments-0, topic_t484_tour_comments-2, topic_t485_timefactors-0, topic_t485_timefactors-2]) (org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:324)
[2025-09-04 15:01:56,204] INFO [table-small-12-sink-iceberg|task-0] [Consumer clientId=connector-consumer-table-small-12-sink-iceberg-0, groupId=connect-table-small-12-sink-iceberg] Found no committed offset for partition topic_t239_storage-2 (org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:1508)
[2025-09-04 15:01:56,204] INFO [table-small-12-sink-iceberg|task-0] [Consumer clientId=connector-consumer-table-small-12-sink-iceberg-0, groupId=connect-table-small-12-sink-iceberg] Found no committed offset for partition topic_t485_timefactors-2 (org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:1508)
[2025-09-04 15:01:56,204] INFO [table-small-12-sink-iceberg|task-0] [Consumer clientId=connector-consumer-table-small-12-sink-iceberg-0, groupId=connect-table-small-12-sink-iceberg] Found no committed offset for partition topic_t186_new_ean-2 (org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:1508)
[2025-09-04 15:01:56,204] INFO [table-small-12-sink-iceberg|task-0] [Consumer clientId=connector-consumer-table-small-12-sink-iceberg-0, groupId=connect-table-small-12-sink-iceberg] Found no committed offset for partition topic_t481_hauliers-2 (org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:1508)
[2025-09-04 15:01:56,204] INFO [table-small-12-sink-iceberg|task-0] [Consumer clientId=connector-consumer-table-small-12-sink-iceberg-0, groupId=connect-table-small-12-sink-iceberg] Found no committed offset for partition topic_t370_bo_input_lct-2 (org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:1508)
[2025-09-04 15:01:56,204] INFO [table-small-12-sink-iceberg|task-0] [Consumer clientId=connector-consumer-table-small-12-sink-iceberg-0, groupId=connect-table-small-12-sink-iceberg] Found no committed offset for partition topic_t484_tour_comments-2 (org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:1508)
[2025-09-04 15:01:56,204] INFO [table-small-12-sink-iceberg|task-0] [Consumer clientId=connector-consumer-table-small-12-sink-iceberg-0, groupId=connect-table-small-12-sink-iceberg] Found no committed offset for partition topic_t419_open_store_restrictions-0 (org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:1508)
[2025-09-04 15:01:56,204] INFO [table-small-12-sink-iceberg|task-0] [Consumer clientId=connector-consumer-table-small-12-sink-iceberg-0, groupId=connect-table-small-12-sink-iceberg] Found no committed offset for partition topic_t240_hazard-0 (org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:1508)
[2025-09-04 15:01:56,204] INFO [table-small-12-sink-iceberg|task-0] [Consumer clientId=connector-consumer-table-small-12-sink-iceberg-0, groupId=connect-table-small-12-sink-iceberg] Found no committed offset for partition topic_t306_spcondsubtype-0 (org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:1508)
[2025-09-04 15:01:56,204] INFO [table-small-12-sink-iceberg|task-0] [Consumer clientId=connector-consumer-table-small-12-sink-iceberg-0, groupId=connect-table-small-12-sink-iceberg] Found no committed offset for partition topic_t427_holiday_rules-2 (org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:1508)
[2025-09-04 15:01:56,204] INFO [table-small-12-sink-iceberg|task-0] [Consumer clientId=connector-consumer-table-small-12-sink-iceberg-0, groupId=connect-table-small-12-sink-iceberg] Found no committed offset for partition topic_t241_ph_value-2 (org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:1508)
[2025-09-04 15:01:56,204] INFO [table-small-12-sink-iceberg|task-0] [Consumer clientId=connector-consumer-table-small-12-sink-iceberg-0, groupId=connect-table-small-12-sink-iceberg] Found no committed offset for partition topic_t255_ars16audit-2 (org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:1508)
[2025-09-04 15:01:56,204] INFO [table-small-12-sink-iceberg|task-0] [Consumer clientId=connector-consumer-table-small-12-sink-iceberg-0, groupId=connect-table-small-12-sink-iceberg] Found no committed offset for partition topic_t307_specialcondit-0 (org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:1508)
[2025-09-04 15:01:56,204] INFO [table-small-12-sink-iceberg|task-0] [Consumer clientId=connector-consumer-table-small-12-sink-iceberg-0, groupId=connect-table-small-12-sink-iceberg] Found no committed offset for partition topic_t390_sapintfacetyp-2 (org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:1508)
[2025-09-04 15:01:56,204] INFO [table-small-12-sink-iceberg|task-0] [Consumer clientId=connector-consumer-table-small-12-sink-iceberg-0, groupId=connect-table-small-12-sink-iceberg] Found no committed offset for partition topic_t186_new_ean-0 (org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:1508)
[2025-09-04 15:01:56,204] INFO [table-small-12-sink-iceberg|task-0] [Consumer clientId=connector-consumer-table-small-12-sink-iceberg-0, groupId=connect-table-small-12-sink-iceberg] Found no committed offset for partition topic_t239_storage-0 (org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:1508)
[2025-09-04 15:01:56,204] INFO [table-small-12-sink-iceberg|task-0] [Consumer clientId=connector-consumer-table-small-12-sink-iceberg-0, groupId=connect-table-small-12-sink-iceberg] Found no committed offset for partition topic_t485_timefactors-0 (org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:1508)
[2025-09-04 15:01:56,204] INFO [table-small-12-sink-iceberg|task-0] [Consumer clientId=connector-consumer-table-small-12-sink-iceberg-0, groupId=connect-table-small-12-sink-iceberg] Found no committed offset for partition topic_t370_bo_input_lct-0 (org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:1508)
[2025-09-04 15:01:56,204] INFO [table-small-12-sink-iceberg|task-0] [Consumer clientId=connector-consumer-table-small-12-sink-iceberg-0, groupId=connect-table-small-12-sink-iceberg] Found no committed offset for partition topic_t481_hauliers-0 (org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:1508)
[2025-09-04 15:01:56,204] INFO [table-small-12-sink-iceberg|task-0] [Consumer clientId=connector-consumer-table-small-12-sink-iceberg-0, groupId=connect-table-small-12-sink-iceberg] Found no committed offset for partition topic_t484_tour_comments-0 (org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:1508)
[2025-09-04 15:01:56,204] INFO [table-small-12-sink-iceberg|task-0] [Consumer clientId=connector-consumer-table-small-12-sink-iceberg-0, groupId=connect-table-small-12-sink-iceberg] Found no committed offset for partition topic_t427_holiday_rules-0 (org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:1508)
[2025-09-04 15:01:56,204] INFO [table-small-12-sink-iceberg|task-0] [Consumer clientId=connector-consumer-table-small-12-sink-iceberg-0, groupId=connect-table-small-12-sink-iceberg] Found no committed offset for partition topic_t240_hazard-2 (org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:1508)
[2025-09-04 15:01:56,204] INFO [table-small-12-sink-iceberg|task-0] [Consumer clientId=connector-consumer-table-small-12-sink-iceberg-0, groupId=connect-table-small-12-sink-iceberg] Found no committed offset for partition topic_t306_spcondsubtype-2 (org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:1508)
[2025-09-04 15:01:56,204] INFO [table-small-12-sink-iceberg|task-0] [Consumer clientId=connector-consumer-table-small-12-sink-iceberg-0, groupId=connect-table-small-12-sink-iceberg] Found no committed offset for partition topic_t419_open_store_restrictions-2 (org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:1508)
[2025-09-04 15:01:56,204] INFO [table-small-12-sink-iceberg|task-0] [Consumer clientId=connector-consumer-table-small-12-sink-iceberg-0, groupId=connect-table-small-12-sink-iceberg] Found no committed offset for partition topic_t241_ph_value-0 (org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:1508)
[2025-09-04 15:01:56,205] INFO [table-small-12-sink-iceberg|task-0] [Consumer clientId=connector-consumer-table-small-12-sink-iceberg-0, groupId=connect-table-small-12-sink-iceberg] Found no committed offset for partition topic_t255_ars16audit-0 (org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:1508)
[2025-09-04 15:01:56,205] INFO [table-small-12-sink-iceberg|task-0] [Consumer clientId=connector-consumer-table-small-12-sink-iceberg-0, groupId=connect-table-small-12-sink-iceberg] Found no committed offset for partition topic_t307_specialcondit-2 (org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:1508)
[2025-09-04 15:01:56,205] INFO [table-small-12-sink-iceberg|task-0] [Consumer clientId=connector-consumer-table-small-12-sink-iceberg-0, groupId=connect-table-small-12-sink-iceberg] Found no committed offset for partition topic_t390_sapintfacetyp-0 (org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:1508)
[2025-09-04 15:01:56,205] INFO [table-small-12-sink-iceberg|task-0] Setting offset for partition topic_t175_kred_carriers-0 to the committed offset FetchPosition{offset=216866, offsetEpoch=Optional.empty, currentLeader=LeaderAndEpoch{leader=Optional[<coord>.azure.confluent.cloud:9092 (id: 3 rack: 0 isFenced: false)], epoch=30}} (org.apache.kafka.clients.consumer.internals.ConsumerUtils:209)
[2025-09-04 15:01:56,205] INFO [table-small-12-sink-iceberg|task-0] Setting offset for partition topic_t175_kred_carriers-2 to the committed offset FetchPosition{offset=211397, offsetEpoch=Optional.empty, currentLeader=LeaderAndEpoch{leader=Optional[<coord>.azure.confluent.cloud:9092 (id: 1 rack: 1 isFenced: false)], epoch=28}} (org.apache.kafka.clients.consumer.internals.ConsumerUtils:209)
[2025-09-04 15:01:56,205] INFO [table-small-12-sink-iceberg|task-0] Setting offset for partition topic_t177_dblogin-2 to the committed offset FetchPosition{offset=10, offsetEpoch=Optional.empty, currentLeader=LeaderAndEpoch{leader=Optional[<coord>.azure.confluent.cloud:9092 (id: 2 rack: 2 isFenced: false)], epoch=27}} (org.apache.kafka.clients.consumer.internals.ConsumerUtils:209)
[2025-09-04 15:01:56,205] INFO [table-small-12-sink-iceberg|task-0] Setting offset for partition topic_t182_ctw_ <prefix>-0 to the committed offset FetchPosition{offset=99808, offsetEpoch=Optional.empty, currentLeader=LeaderAndEpoch{leader=Optional[<coord>.azure.confluent.cloud:9092 (id: 3 rack: 0 isFenced: false)], epoch=30}} (org.apache.kafka.clients.consumer.internals.ConsumerUtils:209)
[2025-09-04 15:01:56,205] INFO [table-small-12-sink-iceberg|task-0] Setting offset for partition topic_t183_splace_gate-0 to the committed offset FetchPosition{offset=63, offsetEpoch=Optional.empty, currentLeader=LeaderAndEpoch{leader=Optional[<coord>.azure.confluent.cloud:9092 (id: 5 rack: 2 isFenced: false)], epoch=33}} (org.apache.kafka.clients.consumer.internals.ConsumerUtils:209)
[2025-09-04 15:01:56,205] INFO [table-small-12-sink-iceberg|task-0] Setting offset for partition topic_t183_splace_gate-2 to the committed offset FetchPosition{offset=65, offsetEpoch=Optional.empty, currentLeader=LeaderAndEpoch{leader=Optional[<coord>.azure.confluent.cloud:9092 (id: 2 rack: 2 isFenced: false)], epoch=27}} (org.apache.kafka.clients.consumer.internals.ConsumerUtils:209)
[2025-09-04 15:01:56,205] INFO [table-small-12-sink-iceberg|task-0] Setting offset for partition topic_t184_sic_opendocs-0 to the committed offset FetchPosition{offset=9, offsetEpoch=Optional.empty, currentLeader=LeaderAndEpoch{leader=Optional[<coord>.azure.confluent.cloud:9092 (id: 0 rack: 0 isFenced: false)], epoch=66}} (org.apache.kafka.clients.consumer.internals.ConsumerUtils:209)
[2025-09-04 15:01:56,205] INFO [table-small-12-sink-iceberg|task-0] Setting offset for partition topic_t184_sic_opendocs-2 to the committed offset FetchPosition{offset=5, offsetEpoch=Optional.empty, currentLeader=LeaderAndEpoch{leader=Optional[<coord>.azure.confluent.cloud:9092 (id: 5 rack: 2 isFenced: false)], epoch=27}} (org.apache.kafka.clients.consumer.internals.ConsumerUtils:209)
[2025-09-04 15:01:56,205] INFO [table-small-12-sink-iceberg|task-0] Setting offset for partition topic_t189_carriers-0 to the committed offset FetchPosition{offset=2886, offsetEpoch=Optional.empty, currentLeader=LeaderAndEpoch{leader=Optional[<coord>.westeurope.azure.confluent.cloud:9092 (id: 4 rack: 1 isFenced: false)], epoch=32}} (org.apache.kafka.clients.consumer.internals.ConsumerUtils:209)
[2025-09-04 15:01:56,205] INFO [table-small-12-sink-iceberg|task-0] Setting offset for partition topic_t189_carriers-2 to the committed offset FetchPosition{offset=2793, offsetEpoch=Optional.empty, currentLeader=LeaderAndEpoch{leader=Optional[<coord>.azure.confluent.cloud:9092 (id: 5 rack: 2 isFenced: false)], epoch=27}} (org.apache.kafka.clients.consumer.internals.ConsumerUtils:209)
[2025-09-04 15:01:56,205] INFO [table-small-12-sink-iceberg|task-0] Setting offset for partition topic_t230_inv_repheader-2 to the committed offset FetchPosition{offset=36, offsetEpoch=Optional.empty, currentLeader=LeaderAndEpoch{leader=Optional[<coord>.azure.confluent.cloud:9092 (id: 3 rack: 0 isFenced: false)], epoch=30}} (org.apache.kafka.clients.consumer.internals.ConsumerUtils:209)
[2025-09-04 15:01:56,205] INFO [table-small-12-sink-iceberg|task-0] Setting offset for partition topic_t231_inv_repdetail-0 to the committed offset FetchPosition{offset=350296, offsetEpoch=Optional.empty, currentLeader=LeaderAndEpoch{leader=Optional[<coord>.azure.confluent.cloud:9092 (id: 2 rack: 2 isFenced: false)], epoch=35}} (org.apache.kafka.clients.consumer.internals.ConsumerUtils:209)
[2025-09-04 15:01:56,205] INFO [table-small-12-sink-iceberg|task-0] Setting offset for partition topic_t231_inv_repdetail-2 to the committed offset FetchPosition{offset=348821, offsetEpoch=Optional.empty, currentLeader=LeaderAndEpoch{leader=Optional[<coord>.westeurope.azure.confluent.cloud:9092 (id: 4 rack: 1 isFenced: false)], epoch=30}} (org.apache.kafka.clients.consumer.internals.ConsumerUtils:209)
[2025-09-04 15:01:56,205] INFO [table-small-12-sink-iceberg|task-0] Setting offset for partition topic_t300_bookingperiod-0 to the committed offset FetchPosition{offset=93, offsetEpoch=Optional.empty, currentLeader=LeaderAndEpoch{leader=Optional[<coord>.azure.confluent.cloud:9092 (id: 0 rack: 0 isFenced: false)], epoch=60}} (org.apache.kafka.clients.consumer.internals.ConsumerUtils:209)
[2025-09-04 15:01:56,205] INFO [table-small-12-sink-iceberg|task-0] Setting offset for partition topic_t300_bookingperiod-2 to the committed offset FetchPosition{offset=112, offsetEpoch=Optional.empty, currentLeader=LeaderAndEpoch{leader=Optional[<coord>.azure.confluent.cloud:9092 (id: 5 rack: 2 isFenced: false)], epoch=33}} (org.apache.kafka.clients.consumer.internals.ConsumerUtils:209)
[2025-09-04 15:01:56,205] INFO [table-small-12-sink-iceberg|task-0] Setting offset for partition topic_t404_mde_suppliers-2 to the committed offset FetchPosition{offset=3, offsetEpoch=Optional.empty, currentLeader=LeaderAndEpoch{leader=Optional[<coord>.azure.confluent.cloud:9092 (id: 3 rack: 0 isFenced: false)], epoch=32}} (org.apache.kafka.clients.consumer.internals.ConsumerUtils:209)
[2025-09-04 15:01:56,205] INFO [table-small-12-sink-iceberg|task-0] Setting offset for partition topic_t417_order_stock_factors-2 to the committed offset FetchPosition{offset=85, offsetEpoch=Optional.empty, currentLeader=LeaderAndEpoch{leader=Optional[<coord>.azure.confluent.cloud:9092 (id: 5 rack: 2 isFenced: false)], epoch=26}} (org.apache.kafka.clients.consumer.internals.ConsumerUtils:209)
[2025-09-04 15:01:56,205] INFO [table-small-12-sink-iceberg|task-0] Setting offset for partition topic_t440_bal_head-2 to the committed offset FetchPosition{offset=41760, offsetEpoch=Optional.empty, currentLeader=LeaderAndEpoch{leader=Optional[<coord>.azure.confluent.cloud:9092 (id: 5 rack: 2 isFenced: false)], epoch=27}} (org.apache.kafka.clients.consumer.internals.ConsumerUtils:209)
[2025-09-04 15:01:56,205] INFO [table-small-12-sink-iceberg|task-0] Setting offset for partition topic_t441_bal_det-0 to the committed offset FetchPosition{offset=111709, offsetEpoch=Optional.empty, currentLeader=LeaderAndEpoch{leader=Optional[<coord>.azure.confluent.cloud:9092 (id: 2 rack: 2 isFenced: false)], epoch=26}} (org.apache.kafka.clients.consumer.internals.ConsumerUtils:209)
[2025-09-04 15:01:56,205] INFO [table-small-12-sink-iceberg|task-0] Setting offset for partition topic_t443_efis_list-0 to the committed offset FetchPosition{offset=10877, offsetEpoch=Optional.empty, currentLeader=LeaderAndEpoch{leader=Optional[<coord>.azure.confluent.cloud:9092 (id: 2 rack: 2 isFenced: false)], epoch=38}} (org.apache.kafka.clients.consumer.internals.ConsumerUtils:209)
[2025-09-04 15:01:56,205] INFO [table-small-12-sink-iceberg|task-0] Setting offset for partition topic_t443_efis_list-2 to the committed offset FetchPosition{offset=11971, offsetEpoch=Optional.empty, currentLeader=LeaderAndEpoch{leader=Optional[<coord>.westeurope.azure.confluent.cloud:9092 (id: 4 rack: 1 isFenced: false)], epoch=37}} (org.apache.kafka.clients.consumer.internals.ConsumerUtils:209)
[2025-09-04 15:01:56,205] INFO [table-small-12-sink-iceberg|task-0] Setting offset for partition topic_t480_tour_picklists-0 to the committed offset FetchPosition{offset=37680, offsetEpoch=Optional.empty, currentLeader=LeaderAndEpoch{leader=Optional[<coord>.azure.confluent.cloud:9092 (id: 0 rack: 0 isFenced: false)], epoch=68}} (org.apache.kafka.clients.consumer.internals.ConsumerUtils:209)
[2025-09-04 15:01:56,205] INFO [table-small-12-sink-iceberg|task-0] Setting offset for partition topic_t480_tour_picklists-2 to the committed offset FetchPosition{offset=37686, offsetEpoch=Optional.empty, currentLeader=LeaderAndEpoch{leader=Optional[<coord>.azure.confluent.cloud:9092 (id: 2 rack: 2 isFenced: false)], epoch=26}} (org.apache.kafka.clients.consumer.internals.ConsumerUtils:209)
[2025-09-04 15:01:56,205] INFO [table-small-12-sink-iceberg|task-0] Setting offset for partition topic_t480_tour_picklists-6 to the committed offset FetchPosition{offset=37979, offsetEpoch=Optional.empty, currentLeader=LeaderAndEpoch{leader=Optional[<coord>.westeurope.azure.confluent.cloud:9092 (id: 4 rack: 1 isFenced: false)], epoch=65}} (org.apache.kafka.clients.consumer.internals.ConsumerUtils:209)
[2025-09-04 15:01:56,205] INFO [table-small-12-sink-iceberg|task-0] Setting offset for partition topic_t483_rest_palettes-0 to the committed offset FetchPosition{offset=179, offsetEpoch=Optional.empty, currentLeader=LeaderAndEpoch{leader=Optional[<coord>.azure.confluent.cloud:9092 (id: 2 rack: 2 isFenced: false)], epoch=33}} (org.apache.kafka.clients.consumer.internals.ConsumerUtils:209)
[2025-09-04 15:01:56,206] INFO [table-small-12-sink-iceberg|task-0] Setting offset for partition topic_t177_dblogin-0 to the committed offset FetchPosition{offset=15, offsetEpoch=Optional.empty, currentLeader=LeaderAndEpoch{leader=Optional[<coord>.azure.confluent.cloud:9092 (id: 5 rack: 2 isFenced: false)], epoch=38}} (org.apache.kafka.clients.consumer.internals.ConsumerUtils:209)
[2025-09-04 15:01:56,206] INFO [table-small-12-sink-iceberg|task-0] Setting offset for partition topic_t182_ctw_ <prefix>-2 to the committed offset FetchPosition{offset=98444, offsetEpoch=Optional.empty, currentLeader=LeaderAndEpoch{leader=Optional[<coord>.azure.confluent.cloud:9092 (id: 1 rack: 1 isFenced: false)], epoch=28}} (org.apache.kafka.clients.consumer.internals.ConsumerUtils:209)
[2025-09-04 15:01:56,206] INFO [table-small-12-sink-iceberg|task-0] Setting offset for partition topic_t230_inv_repheader-0 to the committed offset FetchPosition{offset=20, offsetEpoch=Optional.empty, currentLeader=LeaderAndEpoch{leader=Optional[<coord>.azure.confluent.cloud:9092 (id: 2 rack: 2 isFenced: false)], epoch=26}} (org.apache.kafka.clients.consumer.internals.ConsumerUtils:209)
[2025-09-04 15:01:56,206] INFO [table-small-12-sink-iceberg|task-0] Setting offset for partition topic_t404_mde_suppliers-0 to the committed offset FetchPosition{offset=3, offsetEpoch=Optional.empty, currentLeader=LeaderAndEpoch{leader=Optional[<coord>.azure.confluent.cloud:9092 (id: 2 rack: 2 isFenced: false)], epoch=31}} (org.apache.kafka.clients.consumer.internals.ConsumerUtils:209)
[2025-09-04 15:01:56,206] INFO [table-small-12-sink-iceberg|task-0] Setting offset for partition topic_t417_order_stock_factors-0 to the committed offset FetchPosition{offset=72, offsetEpoch=Optional.empty, currentLeader=LeaderAndEpoch{leader=Optional[<coord>.westeurope.azure.confluent.cloud:9092 (id: 4 rack: 1 isFenced: false)], epoch=28}} (org.apache.kafka.clients.consumer.internals.ConsumerUtils:209)
[2025-09-04 15:01:56,206] INFO [table-small-12-sink-iceberg|task-0] Setting offset for partition topic_t440_bal_head-0 to the committed offset FetchPosition{offset=39304, offsetEpoch=Optional.empty, currentLeader=LeaderAndEpoch{leader=Optional[<coord>.westeurope.azure.confluent.cloud:9092 (id: 4 rack: 1 isFenced: false)], epoch=28}} (org.apache.kafka.clients.consumer.internals.ConsumerUtils:209)
[2025-09-04 15:01:56,206] INFO [table-small-12-sink-iceberg|task-0] Setting offset for partition topic_t441_bal_det-2 to the committed offset FetchPosition{offset=113208, offsetEpoch=Optional.empty, currentLeader=LeaderAndEpoch{leader=Optional[<coord>.azure.confluent.cloud:9092 (id: 3 rack: 0 isFenced: false)], epoch=30}} (org.apache.kafka.clients.consumer.internals.ConsumerUtils:209)
[2025-09-04 15:01:56,206] INFO [table-small-12-sink-iceberg|task-0] Setting offset for partition topic_t480_tour_picklists-4 to the committed offset FetchPosition{offset=37697, offsetEpoch=Optional.empty, currentLeader=LeaderAndEpoch{leader=Optional[<coord>.azure.confluent.cloud:9092 (id: 3 rack: 0 isFenced: false)], epoch=31}} (org.apache.kafka.clients.consumer.internals.ConsumerUtils:209)
[2025-09-04 15:01:56,206] INFO [table-small-12-sink-iceberg|task-0] Setting offset for partition topic_t483_rest_palettes-2 to the committed offset FetchPosition{offset=142, offsetEpoch=Optional.empty, currentLeader=LeaderAndEpoch{leader=Optional[<coord>.azure.confluent.cloud:9092 (id: 1 rack: 1 isFenced: false)], epoch=35}} (org.apache.kafka.clients.consumer.internals.ConsumerUtils:209)
[2025-09-04 15:01:56,230] INFO [table-small-12-sink-iceberg|task-0] Hadoop config initialized: org.apache.hadoop.hdfs.HdfsConfiguration (org.apache.iceberg.connect.CatalogUtils:88)
[2025-09-04 15:01:56,231] INFO [table-small-12-sink-iceberg|task-0] Loading AuthManager implementation: org.apache.iceberg.rest.auth.OAuth2Manager (org.apache.iceberg.rest.auth.AuthManagers:105)
[2025-09-04 15:01:56,233] INFO [table-small-12-sink-iceberg|task-0] Using overriden client-credential refresh AuthSession (org.apache.iceberg.rest.auth.OAuth2Util$AuthSession:472)
[2025-09-04 15:01:56,405] INFO [table-small-12-sink-iceberg|task-0] Using overriden client-credential refresh AuthSession (org.apache.iceberg.rest.auth.OAuth2Util$AuthSession:472)
[2025-09-04 15:01:56,415] INFO [table-small-12-sink-iceberg|task-0] Loading custom FileIO implementation: org.apache.iceberg.azure.adlsv2.ADLSFileIO (org.apache.iceberg.CatalogUtil:376)
[2025-09-04 15:01:56,415] INFO [table-small-12-sink-iceberg|task-0] Using overriden client-credential refresh AuthSession (org.apache.iceberg.rest.auth.OAuth2Util$AuthSession:472)
[2025-09-04 15:01:56,415] INFO [table-small-12-sink-iceberg|task-0] Using overriden client-credential refresh AuthSession (org.apache.iceberg.rest.auth.OAuth2Util$AuthSession:472)
[2025-09-04 15:01:56,416] INFO [table-small-12-sink-iceberg|task-0] AdminClientConfig values:
[2025-09-04 15:01:56,416] INFO [table-small-12-sink-iceberg|task-0] Creating SSL context for keystore : null (org.apache.kafka.common.security.ssl.DefaultSslEngineFactory:249)
[2025-09-04 15:01:56,417] INFO [table-small-12-sink-iceberg|task-0] Kafka commitId: 3dddb42a261b39b6 (org.apache.kafka.common.utils.AppInfoParser:133)
[2025-09-04 15:01:56,417] INFO [table-small-12-sink-iceberg|task-0] Kafka startTimeMs: 1756998116417 (org.apache.kafka.common.utils.AppInfoParser:134)
[2025-09-04 15:01:56,417] INFO [table-small-12-sink-iceberg|task-0] Kafka version: 8.0.0-ce (org.apache.kafka.common.utils.AppInfoParser:132)
[2025-09-04 15:01:56,417] INFO [table-small-12-sink-iceberg|task-0] These configurations '[listeners.https.ssl.truststore.password, consumer.sasl.mechanism, config.providers, rest.extension.classes, listeners.https.ssl.key.password, confluent.topic.replication.factor, status.storage.replication.factor, config.providers.file.class, consumer.security.protocol, offset.storage.topic, rest.advertised.listener, key.converter, listeners.https.ssl.enabled.protocols, consumer.sasl.jaas.config, config.storage.topic, rest.advertised.host.name, heartbeat.interval.ms, consumer.bootstrap.servers, config.storage.replication.factor, topic.creation.enable, key.converter.schemas.enable, value.converter.schemas.enable, admin.sasl.jaas.config, admin.bootstrap.servers, producer.sasl.jaas.config, producer.bootstrap.servers, group.id, rest.advertised.port, plugin.path, admin.security.protocol, confluent.license, admin.sasl.mechanism, value.converter, session.timeout.ms, producer.security.protocol, liste
ners, status.storage.topic, listeners.https.ssl.keystore.location, rebalance.timeout.ms, listeners.https.ssl.keystore.password, producer.sasl.mechanism, offset.flush.interval.ms, listeners.https.ssl.truststore.location, offset.storage.replication.factor]' were supplied but are not used yet. (org.apache.kafka.common.config.AbstractConfig:385)
[2025-09-04 15:01:56,977] INFO [table-small-12-sink-iceberg|task-0] initializing Kafka metrics collector (org.apache.kafka.common.telemetry.internals.KafkaMetricsCollector:270)
[2025-09-04 15:01:56,977] INFO [table-small-12-sink-iceberg|task-0] ProducerConfig values:
[2025-09-04 15:01:56,977] INFO [table-small-12-sink-iceberg|task-0] Task elected leader, starting commit coordinator (org.apache.iceberg.connect.channel.CommitterImpl:72)
[2025-09-04 15:01:56,978] INFO [table-small-12-sink-iceberg|task-0] [Producer clientId=c2ff3650-e1d8-4d7e-a80b-f507ac3b4d0d, transactionalId=coordinator-txn-3bdb3242-eb09-49cd-b864-044f986e61f3-0] Instantiated a transactional producer. (org.apache.kafka.clients.producer.KafkaProducer:609)
[2025-09-04 15:01:56,978] INFO [table-small-12-sink-iceberg|task-0] Creating SSL context for keystore : null (org.apache.kafka.common.security.ssl.DefaultSslEngineFactory:249)
[2025-09-04 15:01:56,980] INFO [table-small-12-sink-iceberg|task-0] [Producer clientId=c2ff3650-e1d8-4d7e-a80b-f507ac3b4d0d, transactionalId=coordinator-txn-3bdb3242-eb09-49cd-b864-044f986e61f3-0] Invoking InitProducerId for the first time in order to acquire a producer ID (org.apache.kafka.clients.producer.internals.TransactionManager:294)
[2025-09-04 15:01:56,980] INFO [table-small-12-sink-iceberg|task-0] Kafka commitId: 3dddb42a261b39b6 (org.apache.kafka.common.utils.AppInfoParser:133)
[2025-09-04 15:01:56,980] INFO [table-small-12-sink-iceberg|task-0] Kafka startTimeMs: 1756998116980 (org.apache.kafka.common.utils.AppInfoParser:134)
[2025-09-04 15:01:56,980] INFO [table-small-12-sink-iceberg|task-0] Kafka version: 8.0.0-ce (org.apache.kafka.common.utils.AppInfoParser:132)
[2025-09-04 15:01:56,980] INFO [table-small-12-sink-iceberg|task-0] These configurations '[listeners.https.ssl.truststore.password, consumer.sasl.mechanism, config.providers, rest.extension.classes, listeners.https.ssl.key.password, confluent.topic.replication.factor, status.storage.replication.factor, config.providers.file.class, consumer.security.protocol, offset.storage.topic, rest.advertised.listener, key.converter, listeners.https.ssl.enabled.protocols, consumer.sasl.jaas.config, config.storage.topic, rest.advertised.host.name, heartbeat.interval.ms, consumer.bootstrap.servers, config.storage.replication.factor, topic.creation.enable, key.converter.schemas.enable, value.converter.schemas.enable, admin.sasl.jaas.config, admin.bootstrap.servers, producer.sasl.jaas.config, producer.bootstrap.servers, group.id, rest.advertised.port, plugin.path, admin.security.protocol, confluent.license, admin.sasl.mechanism, value.converter, session.timeout.ms, producer.security.protocol, liste
ners, status.storage.topic, listeners.https.ssl.keystore.location, rebalance.timeout.ms, listeners.https.ssl.keystore.password, producer.sasl.mechanism, offset.flush.interval.ms, listeners.https.ssl.truststore.location, offset.storage.replication.factor]' were supplied but are not used yet. (org.apache.kafka.common.config.AbstractConfig:385)
[2025-09-04 15:01:57,523] INFO [table-small-12-sink-iceberg|task-0] ConsumerConfig values:
[2025-09-04 15:01:57,523] INFO [table-small-12-sink-iceberg|task-0] initializing Kafka metrics collector (org.apache.kafka.common.telemetry.internals.KafkaMetricsCollector:270)
[2025-09-04 15:01:57,524] INFO [table-small-12-sink-iceberg|task-0] Creating SSL context for keystore : null (org.apache.kafka.common.security.ssl.DefaultSslEngineFactory:249)
[2025-09-04 15:01:57,526] INFO [table-small-12-sink-iceberg|task-0] AdminClientConfig values:
[2025-09-04 15:01:57,526] INFO [table-small-12-sink-iceberg|task-0] Kafka commitId: 3dddb42a261b39b6 (org.apache.kafka.common.utils.AppInfoParser:133)
[2025-09-04 15:01:57,526] INFO [table-small-12-sink-iceberg|task-0] Kafka startTimeMs: 1756998117526 (org.apache.kafka.common.utils.AppInfoParser:134)
[2025-09-04 15:01:57,526] INFO [table-small-12-sink-iceberg|task-0] Kafka version: 8.0.0-ce (org.apache.kafka.common.utils.AppInfoParser:132)
[2025-09-04 15:01:57,526] INFO [table-small-12-sink-iceberg|task-0] These configurations '[listeners.https.ssl.truststore.password, consumer.sasl.mechanism, config.providers, rest.extension.classes, listeners.https.ssl.key.password, confluent.topic.replication.factor, status.storage.replication.factor, config.providers.file.class, consumer.security.protocol, offset.storage.topic, rest.advertised.listener, key.converter, listeners.https.ssl.enabled.protocols, consumer.sasl.jaas.config, config.storage.topic, rest.advertised.host.name, consumer.bootstrap.servers, config.storage.replication.factor, topic.creation.enable, key.converter.schemas.enable, value.converter.schemas.enable, admin.sasl.jaas.config, admin.bootstrap.servers, producer.sasl.jaas.config, producer.bootstrap.servers, rest.advertised.port, plugin.path, admin.security.protocol, confluent.license, admin.sasl.mechanism, value.converter, producer.security.protocol, listeners, status.storage.topic, listeners.https.ssl.keyst
ore.location, rebalance.timeout.ms, listeners.https.ssl.keystore.password, producer.sasl.mechanism, offset.flush.interval.ms, listeners.https.ssl.truststore.location, offset.storage.replication.factor]' were supplied but are not used yet. (org.apache.kafka.common.config.AbstractConfig:385)
[2025-09-04 15:01:57,527] INFO [table-small-12-sink-iceberg|task-0] Creating SSL context for keystore : null (org.apache.kafka.common.security.ssl.DefaultSslEngineFactory:249)
[2025-09-04 15:01:57,528] INFO [table-small-12-sink-iceberg|task-0] Kafka commitId: 3dddb42a261b39b6 (org.apache.kafka.common.utils.AppInfoParser:133)
[2025-09-04 15:01:57,528] INFO [table-small-12-sink-iceberg|task-0] Kafka startTimeMs: 1756998117528 (org.apache.kafka.common.utils.AppInfoParser:134)
[2025-09-04 15:01:57,528] INFO [table-small-12-sink-iceberg|task-0] Kafka version: 8.0.0-ce (org.apache.kafka.common.utils.AppInfoParser:132)
[2025-09-04 15:01:57,528] INFO [table-small-12-sink-iceberg|task-0] These configurations '[listeners.https.ssl.truststore.password, consumer.sasl.mechanism, config.providers, rest.extension.classes, listeners.https.ssl.key.password, confluent.topic.replication.factor, status.storage.replication.factor, config.providers.file.class, consumer.security.protocol, offset.storage.topic, rest.advertised.listener, key.converter, listeners.https.ssl.enabled.protocols, consumer.sasl.jaas.config, config.storage.topic, rest.advertised.host.name, heartbeat.interval.ms, consumer.bootstrap.servers, config.storage.replication.factor, topic.creation.enable, key.converter.schemas.enable, value.converter.schemas.enable, admin.sasl.jaas.config, admin.bootstrap.servers, producer.sasl.jaas.config, producer.bootstrap.servers, group.id, rest.advertised.port, plugin.path, admin.security.protocol, confluent.license, admin.sasl.mechanism, value.converter, session.timeout.ms, producer.security.protocol, liste
ners, status.storage.topic, listeners.https.ssl.keystore.location, rebalance.timeout.ms, listeners.https.ssl.keystore.password, producer.sasl.mechanism, offset.flush.interval.ms, listeners.https.ssl.truststore.location, offset.storage.replication.factor]' were supplied but are not used yet. (org.apache.kafka.common.config.AbstractConfig:385)
[2025-09-04 15:01:57,529] INFO [Consumer clientId=f98b462d-c6fa-4cfb-bf96-1b0683cf3c81, groupId=connect-table-small-12-sink-iceberg-coord] Subscribed to topic(s): <prefix>.iceberg-control-small_12 (org.apache.kafka.clients.consumer.internals.ClassicKafkaConsumer:502)
[2025-09-04 15:01:57,529] INFO [table-small-12-sink-iceberg|task-0] initializing Kafka metrics collector (org.apache.kafka.common.telemetry.internals.KafkaMetricsCollector:270)
[2025-09-04 15:01:57,529] INFO [table-small-12-sink-iceberg|task-0] ProducerConfig values:
[2025-09-04 15:01:57,529] INFO [table-small-12-sink-iceberg|task-0] Starting commit worker (org.apache.iceberg.connect.channel.CommitterImpl:79)
[2025-09-04 15:01:57,530] INFO [table-small-12-sink-iceberg|task-0] [Producer clientId=62ab858b-df91-4911-a386-2563ce441263, transactionalId=worker-txn-3bdb3242-eb09-49cd-b864-044f986e61f3-0] Instantiated a transactional producer. (org.apache.kafka.clients.producer.KafkaProducer:609)
[2025-09-04 15:01:57,530] INFO [table-small-12-sink-iceberg|task-0] Creating SSL context for keystore : null (org.apache.kafka.common.security.ssl.DefaultSslEngineFactory:249)
[2025-09-04 15:01:57,532] INFO [table-small-12-sink-iceberg|task-0] Kafka commitId: 3dddb42a261b39b6 (org.apache.kafka.common.utils.AppInfoParser:133)
[2025-09-04 15:01:57,532] INFO [table-small-12-sink-iceberg|task-0] Kafka startTimeMs: 1756998117532 (org.apache.kafka.common.utils.AppInfoParser:134)
[2025-09-04 15:01:57,532] INFO [table-small-12-sink-iceberg|task-0] Kafka version: 8.0.0-ce (org.apache.kafka.common.utils.AppInfoParser:132)
[2025-09-04 15:01:57,532] INFO [table-small-12-sink-iceberg|task-0] These configurations '[listeners.https.ssl.truststore.password, consumer.sasl.mechanism, config.providers, rest.extension.classes, listeners.https.ssl.key.password, confluent.topic.replication.factor, status.storage.replication.factor, config.providers.file.class, consumer.security.protocol, offset.storage.topic, rest.advertised.listener, key.converter, listeners.https.ssl.enabled.protocols, consumer.sasl.jaas.config, config.storage.topic, rest.advertised.host.name, heartbeat.interval.ms, consumer.bootstrap.servers, config.storage.replication.factor, topic.creation.enable, key.converter.schemas.enable, value.converter.schemas.enable, admin.sasl.jaas.config, admin.bootstrap.servers, producer.sasl.jaas.config, producer.bootstrap.servers, group.id, rest.advertised.port, plugin.path, admin.security.protocol, confluent.license, admin.sasl.mechanism, value.converter, session.timeout.ms, producer.security.protocol, liste
ners, status.storage.topic, listeners.https.ssl.keystore.location, rebalance.timeout.ms, listeners.https.ssl.keystore.password, producer.sasl.mechanism, offset.flush.interval.ms, listeners.https.ssl.truststore.location, offset.storage.replication.factor]' were supplied but are not used yet. (org.apache.kafka.common.config.AbstractConfig:385)
[2025-09-04 15:01:57,533] INFO [table-small-12-sink-iceberg|task-0] [Producer clientId=62ab858b-df91-4911-a386-2563ce441263, transactionalId=worker-txn-3bdb3242-eb09-49cd-b864-044f986e61f3-0] Invoking InitProducerId for the first time in order to acquire a producer ID (org.apache.kafka.clients.producer.internals.TransactionManager:294)
[2025-09-04 15:01:57,555] INFO [Consumer clientId=f98b462d-c6fa-4cfb-bf96-1b0683cf3c81, groupId=connect-table-small-12-sink-iceberg-coord] Cluster ID: <cluster> (org.apache.kafka.clients.Metadata:366)
[2025-09-04 15:01:57,556] INFO [Consumer clientId=f98b462d-c6fa-4cfb-bf96-1b0683cf3c81, groupId=connect-table-small-12-sink-iceberg-coord] (Re-)joining group (org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:605)
[2025-09-04 15:01:57,556] INFO [Consumer clientId=f98b462d-c6fa-4cfb-bf96-1b0683cf3c81, groupId=connect-table-small-12-sink-iceberg-coord] Discovered group coordinator <coord>.azure.confluent.cloud:9092 (id: 2147483647 rack: null isFenced: false) (org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:937)
[2025-09-04 15:01:57,577] INFO [Consumer clientId=f98b462d-c6fa-4cfb-bf96-1b0683cf3c81, groupId=connect-table-small-12-sink-iceberg-coord] (Re-)joining group (org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:605)
[2025-09-04 15:01:57,577] INFO [Consumer clientId=f98b462d-c6fa-4cfb-bf96-1b0683cf3c81, groupId=connect-table-small-12-sink-iceberg-coord] Request joining group due to: need to re-join with the given member-id: f98b462d-c6fa-4cfb-bf96-1b0683cf3c81-194ecd23-af3b-4ac5-a12c-f22c5e8af216 (org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:1103)
[2025-09-04 15:01:57,578] INFO [Consumer clientId=f98b462d-c6fa-4cfb-bf96-1b0683cf3c81, groupId=connect-table-small-12-sink-iceberg-coord] Finished assignment for group at generation 324: {f98b462d-c6fa-4cfb-bf96-1b0683cf3c81-194ecd23-af3b-4ac5-a12c-f22c5e8af216=Assignment(partitions=[ <prefix>.iceberg-control-small_12-0])} (org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:664)
[2025-09-04 15:01:57,578] INFO [Consumer clientId=f98b462d-c6fa-4cfb-bf96-1b0683cf3c81, groupId=connect-table-small-12-sink-iceberg-coord] Successfully joined group with generation Generation{generationId=324, memberId='f98b462d-c6fa-4cfb-bf96-1b0683cf3c81-194ecd23-af3b-4ac5-a12c-f22c5e8af216', protocol='range'} (org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:666)
[2025-09-04 15:01:57,581] INFO [Consumer clientId=f98b462d-c6fa-4cfb-bf96-1b0683cf3c81, groupId=connect-table-small-12-sink-iceberg-coord] Adding newly assigned partitions: <prefix>.iceberg-control-small_12-0 (org.apache.kafka.clients.consumer.internals.ConsumerRebalanceListenerInvoker:58)
[2025-09-04 15:01:57,581] INFO [Consumer clientId=f98b462d-c6fa-4cfb-bf96-1b0683cf3c81, groupId=connect-table-small-12-sink-iceberg-coord] Notifying assignor about the new Assignment(partitions=[ <prefix>.iceberg-control-small_12-0]) (org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:324)
[2025-09-04 15:01:57,581] INFO [Consumer clientId=f98b462d-c6fa-4cfb-bf96-1b0683cf3c81, groupId=connect-table-small-12-sink-iceberg-coord] Successfully synced group in generation Generation{generationId=324, memberId='f98b462d-c6fa-4cfb-bf96-1b0683cf3c81-194ecd23-af3b-4ac5-a12c-f22c5e8af216', protocol='range'} (org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:843)
[2025-09-04 15:01:58,082] INFO [table-small-12-sink-iceberg|task-0] ConsumerConfig values:
[2025-09-04 15:01:58,083] INFO [table-small-12-sink-iceberg|task-0] initializing Kafka metrics collector (org.apache.kafka.common.telemetry.internals.KafkaMetricsCollector:270)
[2025-09-04 15:01:58,084] INFO [table-small-12-sink-iceberg|task-0] Creating SSL context for keystore : null (org.apache.kafka.common.security.ssl.DefaultSslEngineFactory:249)
[2025-09-04 15:01:58,086] INFO [table-small-12-sink-iceberg|task-0] Kafka commitId: 3dddb42a261b39b6 (org.apache.kafka.common.utils.AppInfoParser:133)
[2025-09-04 15:01:58,086] INFO [table-small-12-sink-iceberg|task-0] Kafka startTimeMs: 1756998118086 (org.apache.kafka.common.utils.AppInfoParser:134)
[2025-09-04 15:01:58,086] INFO [table-small-12-sink-iceberg|task-0] Kafka version: 8.0.0-ce (org.apache.kafka.common.utils.AppInfoParser:132)
[2025-09-04 15:01:58,086] INFO [table-small-12-sink-iceberg|task-0] These configurations '[listeners.https.ssl.truststore.password, consumer.sasl.mechanism, config.providers, rest.extension.classes, listeners.https.ssl.key.password, confluent.topic.replication.factor, status.storage.replication.factor, config.providers.file.class, consumer.security.protocol, offset.storage.topic, rest.advertised.listener, key.converter, listeners.https.ssl.enabled.protocols, consumer.sasl.jaas.config, config.storage.topic, rest.advertised.host.name, consumer.bootstrap.servers, config.storage.replication.factor, topic.creation.enable, key.converter.schemas.enable, value.converter.schemas.enable, admin.sasl.jaas.config, admin.bootstrap.servers, producer.sasl.jaas.config, producer.bootstrap.servers, rest.advertised.port, plugin.path, admin.security.protocol, confluent.license, admin.sasl.mechanism, value.converter, producer.security.protocol, listeners, status.storage.topic, listeners.https.ssl.keyst
ore.location, rebalance.timeout.ms, listeners.https.ssl.keystore.password, producer.sasl.mechanism, offset.flush.interval.ms, listeners.https.ssl.truststore.location, offset.storage.replication.factor]' were supplied but are not used yet. (org.apache.kafka.common.config.AbstractConfig:385)
[2025-09-04 15:01:58,087] INFO [table-small-12-sink-iceberg|task-0] AdminClientConfig values:
[2025-09-04 15:01:58,088] INFO [table-small-12-sink-iceberg|task-0] Creating SSL context for keystore : null (org.apache.kafka.common.security.ssl.DefaultSslEngineFactory:249)
[2025-09-04 15:01:58,089] INFO [table-small-12-sink-iceberg|task-0] [Consumer clientId=312b4c5c-26d6-4978-b088-c0fa96b21187, groupId=cg-control-872e2449-ebcd-4714-962b-69c499759dc1] Subscribed to topic(s): <prefix>.iceberg-control-small_12 (org.apache.kafka.clients.consumer.internals.ClassicKafkaConsumer:502)
[2025-09-04 15:01:58,089] INFO [table-small-12-sink-iceberg|task-0] Kafka commitId: 3dddb42a261b39b6 (org.apache.kafka.common.utils.AppInfoParser:133)
[2025-09-04 15:01:58,089] INFO [table-small-12-sink-iceberg|task-0] Kafka startTimeMs: 1756998118089 (org.apache.kafka.common.utils.AppInfoParser:134)
[2025-09-04 15:01:58,089] INFO [table-small-12-sink-iceberg|task-0] Kafka version: 8.0.0-ce (org.apache.kafka.common.utils.AppInfoParser:132)
[2025-09-04 15:01:58,089] INFO [table-small-12-sink-iceberg|task-0] These configurations '[listeners.https.ssl.truststore.password, consumer.sasl.mechanism, config.providers, rest.extension.classes, listeners.https.ssl.key.password, confluent.topic.replication.factor, status.storage.replication.factor, config.providers.file.class, consumer.security.protocol, offset.storage.topic, rest.advertised.listener, key.converter, listeners.https.ssl.enabled.protocols, consumer.sasl.jaas.config, config.storage.topic, rest.advertised.host.name, heartbeat.interval.ms, consumer.bootstrap.servers, config.storage.replication.factor, topic.creation.enable, key.converter.schemas.enable, value.converter.schemas.enable, admin.sasl.jaas.config, admin.bootstrap.servers, producer.sasl.jaas.config, producer.bootstrap.servers, group.id, rest.advertised.port, plugin.path, admin.security.protocol, confluent.license, admin.sasl.mechanism, value.converter, session.timeout.ms, producer.security.protocol, liste
ners, status.storage.topic, listeners.https.ssl.keystore.location, rebalance.timeout.ms, listeners.https.ssl.keystore.password, producer.sasl.mechanism, offset.flush.interval.ms, listeners.https.ssl.truststore.location, offset.storage.replication.factor]' were supplied but are not used yet. (org.apache.kafka.common.config.AbstractConfig:385)
[2025-09-04 15:01:58,100] INFO [table-small-12-sink-iceberg|task-0] [Consumer clientId=312b4c5c-26d6-4978-b088-c0fa96b21187, groupId=cg-control-872e2449-ebcd-4714-962b-69c499759dc1] Cluster ID: <cluster> (org.apache.kafka.clients.Metadata:366)
[2025-09-04 15:01:58,101] INFO [table-small-12-sink-iceberg|task-0] [Consumer clientId=312b4c5c-26d6-4978-b088-c0fa96b21187, groupId=cg-control-872e2449-ebcd-4714-962b-69c499759dc1] (Re-)joining group (org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:605)
[2025-09-04 15:01:58,101] INFO [table-small-12-sink-iceberg|task-0] [Consumer clientId=312b4c5c-26d6-4978-b088-c0fa96b21187, groupId=cg-control-872e2449-ebcd-4714-962b-69c499759dc1] Discovered group coordinator <coord>.azure.confluent.cloud:9092 (id: 2147483642 rack: null isFenced: false) (org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:937)
[2025-09-04 15:01:58,102] INFO [table-small-12-sink-iceberg|task-0] Client telemetry registered with client instance id: IykVKPGmTmycKcw2k3ZJkg (org.apache.kafka.common.telemetry.internals.ClientTelemetryReporter:481)
[2025-09-04 15:01:58,122] INFO [table-small-12-sink-iceberg|task-0] [Consumer clientId=312b4c5c-26d6-4978-b088-c0fa96b21187, groupId=cg-control-872e2449-ebcd-4714-962b-69c499759dc1] (Re-)joining group (org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:605)
[2025-09-04 15:01:58,122] INFO [table-small-12-sink-iceberg|task-0] [Consumer clientId=312b4c5c-26d6-4978-b088-c0fa96b21187, groupId=cg-control-872e2449-ebcd-4714-962b-69c499759dc1] Request joining group due to: need to re-join with the given member-id: 312b4c5c-26d6-4978-b088-c0fa96b21187-06c06248-d3ae-41be-b2d4-91696b2c1967 (org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:1103)
[2025-09-04 15:01:58,125] INFO [table-small-12-sink-iceberg|task-0] [Consumer clientId=312b4c5c-26d6-4978-b088-c0fa96b21187, groupId=cg-control-872e2449-ebcd-4714-962b-69c499759dc1] Finished assignment for group at generation 1: {312b4c5c-26d6-4978-b088-c0fa96b21187-06c06248-d3ae-41be-b2d4-91696b2c1967=Assignment(partitions=[ <prefix>.iceberg-control-small_12-0])} (org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:664)
[2025-09-04 15:01:58,125] INFO [table-small-12-sink-iceberg|task-0] [Consumer clientId=312b4c5c-26d6-4978-b088-c0fa96b21187, groupId=cg-control-872e2449-ebcd-4714-962b-69c499759dc1] Successfully joined group with generation Generation{generationId=1, memberId='312b4c5c-26d6-4978-b088-c0fa96b21187-06c06248-d3ae-41be-b2d4-91696b2c1967', protocol='range'} (org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:666)
[2025-09-04 15:01:58,129] INFO [table-small-12-sink-iceberg|task-0] [Consumer clientId=312b4c5c-26d6-4978-b088-c0fa96b21187, groupId=cg-control-872e2449-ebcd-4714-962b-69c499759dc1] Adding newly assigned partitions: <prefix>.iceberg-control-small_12-0 (org.apache.kafka.clients.consumer.internals.ConsumerRebalanceListenerInvoker:58)
[2025-09-04 15:01:58,129] INFO [table-small-12-sink-iceberg|task-0] [Consumer clientId=312b4c5c-26d6-4978-b088-c0fa96b21187, groupId=cg-control-872e2449-ebcd-4714-962b-69c499759dc1] Notifying assignor about the new Assignment(partitions=[ <prefix>.iceberg-control-small_12-0]) (org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:324)
[2025-09-04 15:01:58,129] INFO [table-small-12-sink-iceberg|task-0] [Consumer clientId=312b4c5c-26d6-4978-b088-c0fa96b21187, groupId=cg-control-872e2449-ebcd-4714-962b-69c499759dc1] Successfully synced group in generation Generation{generationId=1, memberId='312b4c5c-26d6-4978-b088-c0fa96b21187-06c06248-d3ae-41be-b2d4-91696b2c1967', protocol='range'} (org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:843)
[2025-09-04 15:01:58,131] INFO [table-small-12-sink-iceberg|task-0] [Consumer clientId=312b4c5c-26d6-4978-b088-c0fa96b21187, groupId=cg-control-872e2449-ebcd-4714-962b-69c499759dc1] Found no committed offset for partition <prefix>.iceberg-control-small_12-0 (org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:1508)
[2025-09-04 15:02:07,296] INFO [table-small-12-sink-iceberg|task-1] [Consumer clientId=connector-consumer-table-small-12-sink-iceberg-1, groupId=connect-table-small-12-sink-iceberg] Disconnecting from node 1 due to socket connection setup timeout. The timeout value is 10955 ms. (org.apache.kafka.clients.NetworkClient:1046)
[2025-09-04 15:02:07,296] INFO [table-small-12-sink-iceberg|task-1] [Consumer clientId=connector-consumer-table-small-12-sink-iceberg-1, groupId=connect-table-small-12-sink-iceberg] Disconnecting from node 3 due to socket connection setup timeout. The timeout value is 9130 ms. (org.apache.kafka.clients.NetworkClient:1046)
[2025-09-04 15:02:07,296] INFO [table-small-12-sink-iceberg|task-1] [Consumer clientId=connector-consumer-table-small-12-sink-iceberg-1, groupId=connect-table-small-12-sink-iceberg] Disconnecting from node 4 due to socket connection setup timeout. The timeout value is 8136 ms. (org.apache.kafka.clients.NetworkClient:1046)
[2025-09-04 15:02:07,296] INFO [table-small-12-sink-iceberg|task-1] [Consumer clientId=connector-consumer-table-small-12-sink-iceberg-1, groupId=connect-table-small-12-sink-iceberg] Disconnecting from node 5 due to socket connection setup timeout. The timeout value is 8315 ms. (org.apache.kafka.clients.NetworkClient:1046)
[2025-09-04 15:02:18,779] INFO [table-small-12-sink-iceberg|task-1] Hadoop config initialized: org.apache.hadoop.hdfs.HdfsConfiguration (org.apache.iceberg.connect.CatalogUtils:88)
[2025-09-04 15:02:18,782] INFO [table-small-12-sink-iceberg|task-1] Loading AuthManager implementation: org.apache.iceberg.rest.auth.OAuth2Manager (org.apache.iceberg.rest.auth.AuthManagers:105)
[2025-09-04 15:02:18,785] INFO [table-small-12-sink-iceberg|task-1] Using overriden client-credential refresh AuthSession (org.apache.iceberg.rest.auth.OAuth2Util$AuthSession:472)
[2025-09-04 15:02:29,954] INFO [Producer clientId=connector-dlq-producer-table-small-12-sink-iceberg-1] Node 0 disconnected. (org.apache.kafka.clients.NetworkClient:1191)
[2025-09-04 15:02:29,954] INFO [table-small-12-sink-iceberg|task-1] Using overriden client-credential refresh AuthSession (org.apache.iceberg.rest.auth.OAuth2Util$AuthSession:472)
[2025-09-04 15:02:29,990] INFO [table-small-12-sink-iceberg|task-1] Loading custom FileIO implementation: org.apache.iceberg.azure.adlsv2.ADLSFileIO (org.apache.iceberg.CatalogUtil:376)
[2025-09-04 15:02:29,990] INFO [table-small-12-sink-iceberg|task-1] Using overriden client-credential refresh AuthSession (org.apache.iceberg.rest.auth.OAuth2Util$AuthSession:472)
[2025-09-04 15:02:29,990] INFO [table-small-12-sink-iceberg|task-1] Using overriden client-credential refresh AuthSession (org.apache.iceberg.rest.auth.OAuth2Util$AuthSession:472)
[2025-09-04 15:02:29,991] INFO [table-small-12-sink-iceberg|task-1] AdminClientConfig values:
[2025-09-04 15:02:29,992] INFO [table-small-12-sink-iceberg|task-1] Creating SSL context for keystore : null (org.apache.kafka.common.security.ssl.DefaultSslEngineFactory:249)
[2025-09-04 15:02:29,994] INFO [table-small-12-sink-iceberg|task-1] Kafka commitId: 3dddb42a261b39b6 (org.apache.kafka.common.utils.AppInfoParser:133)
[2025-09-04 15:02:29,994] INFO [table-small-12-sink-iceberg|task-1] Kafka startTimeMs: 1756998149994 (org.apache.kafka.common.utils.AppInfoParser:134)
[2025-09-04 15:02:29,994] INFO [table-small-12-sink-iceberg|task-1] Kafka version: 8.0.0-ce (org.apache.kafka.common.utils.AppInfoParser:132)
[2025-09-04 15:02:29,994] INFO [table-small-12-sink-iceberg|task-1] These configurations '[listeners.https.ssl.truststore.password, consumer.sasl.mechanism, config.providers, rest.extension.classes, listeners.https.ssl.key.password, confluent.topic.replication.factor, status.storage.replication.factor, config.providers.file.class, consumer.security.protocol, offset.storage.topic, rest.advertised.listener, key.converter, listeners.https.ssl.enabled.protocols, consumer.sasl.jaas.config, config.storage.topic, rest.advertised.host.name, heartbeat.interval.ms, consumer.bootstrap.servers, config.storage.replication.factor, topic.creation.enable, key.converter.schemas.enable, value.converter.schemas.enable, admin.sasl.jaas.config, admin.bootstrap.servers, producer.sasl.jaas.config, producer.bootstrap.servers, group.id, rest.advertised.port, plugin.path, admin.security.protocol, confluent.license, admin.sasl.mechanism, value.converter, session.timeout.ms, producer.security.protocol, liste
ners, status.storage.topic, listeners.https.ssl.keystore.location, rebalance.timeout.ms, listeners.https.ssl.keystore.password, producer.sasl.mechanism, offset.flush.interval.ms, listeners.https.ssl.truststore.location, offset.storage.replication.factor]' were supplied but are not used yet. (org.apache.kafka.common.config.AbstractConfig:385)
+ [2025-09-04 15:02:43,745] INFO Committed snapshot 4343445114214793138 (MergeAppend) (org.apache.iceberg.SnapshotProducer:481)**
[2025-09-04 15:02:52,999] INFO [table-small-12-sink-iceberg|task-1] Starting commit worker (org.apache.iceberg.connect.channel.CommitterImpl:79)
[2025-09-04 15:02:53,000] INFO [table-small-12-sink-iceberg|task-1] initializing Kafka metrics collector (org.apache.kafka.common.telemetry.internals.KafkaMetricsCollector:270)
[2025-09-04 15:02:53,000] INFO [table-small-12-sink-iceberg|task-1] ProducerConfig values:
[2025-09-04 15:02:53,001] INFO [table-small-12-sink-iceberg|task-1] [Producer clientId=f5fe3389-bf7f-489e-a336-0bde5eb178ca, transactionalId=worker-txn-3bdb3242-eb09-49cd-b864-044f986e61f3-1] Instantiated a transactional producer. (org.apache.kafka.clients.producer.KafkaProducer:609)
[2025-09-04 15:02:53,008] INFO [table-small-12-sink-iceberg|task-1] Creating SSL context for keystore : null (org.apache.kafka.common.security.ssl.DefaultSslEngineFactory:249)
[2025-09-04 15:02:53,020] INFO [table-small-12-sink-iceberg|task-1] Kafka commitId: 3dddb42a261b39b6 (org.apache.kafka.common.utils.AppInfoParser:133)
[2025-09-04 15:02:53,020] INFO [table-small-12-sink-iceberg|task-1] Kafka startTimeMs: 1756998173020 (org.apache.kafka.common.utils.AppInfoParser:134)
[2025-09-04 15:02:53,020] INFO [table-small-12-sink-iceberg|task-1] Kafka version: 8.0.0-ce (org.apache.kafka.common.utils.AppInfoParser:132)
[2025-09-04 15:02:53,020] INFO [table-small-12-sink-iceberg|task-1] These configurations '[listeners.https.ssl.truststore.password, consumer.sasl.mechanism, config.providers, rest.extension.classes, listeners.https.ssl.key.password, confluent.topic.replication.factor, status.storage.replication.factor, config.providers.file.class, consumer.security.protocol, offset.storage.topic, rest.advertised.listener, key.converter, listeners.https.ssl.enabled.protocols, consumer.sasl.jaas.config, config.storage.topic, rest.advertised.host.name, heartbeat.interval.ms, consumer.bootstrap.servers, config.storage.replication.factor, topic.creation.enable, key.converter.schemas.enable, value.converter.schemas.enable, admin.sasl.jaas.config, admin.bootstrap.servers, producer.sasl.jaas.config, producer.bootstrap.servers, group.id, rest.advertised.port, plugin.path, admin.security.protocol, confluent.license, admin.sasl.mechanism, value.converter, session.timeout.ms, producer.security.protocol, liste
ners, status.storage.topic, listeners.https.ssl.keystore.location, rebalance.timeout.ms, listeners.https.ssl.keystore.password, producer.sasl.mechanism, offset.flush.interval.ms, listeners.https.ssl.truststore.location, offset.storage.replication.factor]' were supplied but are not used yet. (org.apache.kafka.common.config.AbstractConfig:385)
[2025-09-04 15:02:53,025] INFO [table-small-12-sink-iceberg|task-1] [Producer clientId=f5fe3389-bf7f-489e-a336-0bde5eb178ca, transactionalId=worker-txn-3bdb3242-eb09-49cd-b864-044f986e61f3-1] Invoking InitProducerId for the first time in order to acquire a producer ID (org.apache.kafka.clients.producer.internals.TransactionManager:294)
[2025-09-04 15:02:59,100] INFO [Consumer clientId=connector-consumer-table-small-12-sink-iceberg-0, groupId=connect-table-small-12-sink-iceberg] Cancelled in-flight FETCH request with correlation id 30 due to node 2 being disconnected (elapsed time since creation: 60009ms, elapsed time since send: 60009ms, throttle time: 0ms, request timeout: 60000ms) (org.apache.kafka.clients.NetworkClient:480)
[2025-09-04 15:02:59,100] INFO [Consumer clientId=connector-consumer-table-small-12-sink-iceberg-0, groupId=connect-table-small-12-sink-iceberg] Disconnecting from node 2 due to request timeout. (org.apache.kafka.clients.NetworkClient:1024)
[2025-09-04 15:02:59,101] INFO [Consumer clientId=connector-consumer-table-small-12-sink-iceberg-0, groupId=connect-table-small-12-sink-iceberg] Error sending fetch request (sessionId=INVALID, epoch=INITIAL) to node 2: (org.apache.kafka.clients.FetchSessionHandler:618)
[2025-09-04 15:02:59,661] INFO [table-small-12-sink-iceberg|task-0] Loading custom FileIO implementation: org.apache.iceberg.azure.adlsv2.ADLSFileIO (org.apache.iceberg.CatalogUtil:376)
[2025-09-04 15:02:59,862] INFO [table-small-12-sink-iceberg|task-0] Loading custom FileIO implementation: org.apache.iceberg.azure.adlsv2.ADLSFileIO (org.apache.iceberg.CatalogUtil:376)
[2025-09-04 15:03:04,305] INFO [table-small-12-sink-iceberg|task-1] ConsumerConfig values:
[2025-09-04 15:03:04,316] INFO [table-small-12-sink-iceberg|task-1] initializing Kafka metrics collector (org.apache.kafka.common.telemetry.internals.KafkaMetricsCollector:270)
[2025-09-04 15:03:04,319] INFO [table-small-12-sink-iceberg|task-1] Creating SSL context for keystore : null (org.apache.kafka.common.security.ssl.DefaultSslEngineFactory:249)
[2025-09-04 15:03:04,338] INFO [table-small-12-sink-iceberg|task-1] Kafka commitId: 3dddb42a261b39b6 (org.apache.kafka.common.utils.AppInfoParser:133)
[2025-09-04 15:03:04,338] INFO [table-small-12-sink-iceberg|task-1] Kafka startTimeMs: 1756998184338 (org.apache.kafka.common.utils.AppInfoParser:134)
[2025-09-04 15:03:04,338] INFO [table-small-12-sink-iceberg|task-1] Kafka version: 8.0.0-ce (org.apache.kafka.common.utils.AppInfoParser:132)
[2025-09-04 15:03:04,338] INFO [table-small-12-sink-iceberg|task-1] These configurations '[listeners.https.ssl.truststore.password, consumer.sasl.mechanism, config.providers, rest.extension.classes, listeners.https.ssl.key.password, confluent.topic.replication.factor, status.storage.replication.factor, config.providers.file.class, consumer.security.protocol, offset.storage.topic, rest.advertised.listener, key.converter, listeners.https.ssl.enabled.protocols, consumer.sasl.jaas.config, config.storage.topic, rest.advertised.host.name, consumer.bootstrap.servers, config.storage.replication.factor, topic.creation.enable, key.converter.schemas.enable, value.converter.schemas.enable, admin.sasl.jaas.config, admin.bootstrap.servers, producer.sasl.jaas.config, producer.bootstrap.servers, rest.advertised.port, plugin.path, admin.security.protocol, confluent.license, admin.sasl.mechanism, value.converter, producer.security.protocol, listeners, status.storage.topic, listeners.https.ssl.keyst
ore.location, rebalance.timeout.ms, listeners.https.ssl.keystore.password, producer.sasl.mechanism, offset.flush.interval.ms, listeners.https.ssl.truststore.location, offset.storage.replication.factor]' were supplied but are not used yet. (org.apache.kafka.common.config.AbstractConfig:385)
[2025-09-04 15:03:04,339] INFO [table-small-12-sink-iceberg|task-1] AdminClientConfig values:
[2025-09-04 15:03:04,340] INFO [table-small-12-sink-iceberg|task-1] Creating SSL context for keystore : null (org.apache.kafka.common.security.ssl.DefaultSslEngineFactory:249)
[2025-09-04 15:03:04,343] INFO [table-small-12-sink-iceberg|task-1] Kafka version: 8.0.0-ce (org.apache.kafka.common.utils.AppInfoParser:132)
[2025-09-04 15:03:04,343] INFO [table-small-12-sink-iceberg|task-1] These configurations '[listeners.https.ssl.truststore.password, consumer.sasl.mechanism, config.providers, rest.extension.classes, listeners.https.ssl.key.password, confluent.topic.replication.factor, status.storage.replication.factor, config.providers.file.class, consumer.security.protocol, offset.storage.topic, rest.advertised.listener, key.converter, listeners.https.ssl.enabled.protocols, consumer.sasl.jaas.config, config.storage.topic, rest.advertised.host.name, heartbeat.interval.ms, consumer.bootstrap.servers, config.storage.replication.factor, topic.creation.enable, key.converter.schemas.enable, value.converter.schemas.enable, admin.sasl.jaas.config, admin.bootstrap.servers, producer.sasl.jaas.config, producer.bootstrap.servers, group.id, rest.advertised.port, plugin.path, admin.security.protocol, confluent.license, admin.sasl.mechanism, value.converter, session.timeout.ms, producer.security.protocol, liste
ners, status.storage.topic, listeners.https.ssl.keystore.location, rebalance.timeout.ms, listeners.https.ssl.keystore.password, producer.sasl.mechanism, offset.flush.interval.ms, listeners.https.ssl.truststore.location, offset.storage.replication.factor]' were supplied but are not used yet. (org.apache.kafka.common.config.AbstractConfig:385)
[2025-09-04 15:03:04,344] INFO [table-small-12-sink-iceberg|task-1] Kafka commitId: 3dddb42a261b39b6 (org.apache.kafka.common.utils.AppInfoParser:133)
[2025-09-04 15:03:04,344] INFO [table-small-12-sink-iceberg|task-1] Kafka startTimeMs: 1756998184343 (org.apache.kafka.common.utils.AppInfoParser:134)
[2025-09-04 15:03:04,349] INFO [table-small-12-sink-iceberg|task-1] [Consumer clientId=f0f6a38c-77b2-4ed8-bd8b-1c6671b0027f, groupId=cg-control-867bd890-e373-4fcd-8b23-e0f44b67412d] Subscribed to topic(s): <prefix>.iceberg-control-small_12 (org.apache.kafka.clients.consumer.internals.ClassicKafkaConsumer:502)
[2025-09-04 15:03:04,374] INFO [table-small-12-sink-iceberg|task-1] [Consumer clientId=f0f6a38c-77b2-4ed8-bd8b-1c6671b0027f, groupId=cg-control-867bd890-e373-4fcd-8b23-e0f44b67412d] Cluster ID: <cluster> (org.apache.kafka.clients.Metadata:366)
[2025-09-04 15:03:04,374] INFO [table-small-12-sink-iceberg|task-1] [Consumer clientId=f0f6a38c-77b2-4ed8-bd8b-1c6671b0027f, groupId=cg-control-867bd890-e373-4fcd-8b23-e0f44b67412d] Discovered group coordinator <coord>.azure.confluent.cloud:9092 (id: 2147483642 rack: null isFenced: false) (org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:937)
[2025-09-04 15:03:04,375] INFO [table-small-12-sink-iceberg|task-1] [Consumer clientId=f0f6a38c-77b2-4ed8-bd8b-1c6671b0027f, groupId=cg-control-867bd890-e373-4fcd-8b23-e0f44b67412d] (Re-)joining group (org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:605)
[2025-09-04 15:03:04,375] INFO [table-small-12-sink-iceberg|task-1] Client telemetry registered with client instance id: g8kan9WjR_OR_fsCtRCQ0Q (org.apache.kafka.common.telemetry.internals.ClientTelemetryReporter:481)
[2025-09-04 15:03:04,394] INFO [table-small-12-sink-iceberg|task-1] [Consumer clientId=f0f6a38c-77b2-4ed8-bd8b-1c6671b0027f, groupId=cg-control-867bd890-e373-4fcd-8b23-e0f44b67412d] (Re-)joining group (org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:605)
[2025-09-04 15:03:04,394] INFO [table-small-12-sink-iceberg|task-1] [Consumer clientId=f0f6a38c-77b2-4ed8-bd8b-1c6671b0027f, groupId=cg-control-867bd890-e373-4fcd-8b23-e0f44b67412d] Request joining group due to: need to re-join with the given member-id: f0f6a38c-77b2-4ed8-bd8b-1c6671b0027f-bb41be29-a65f-400d-972c-44ab7aa3f35b (org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:1103)
[2025-09-04 15:03:04,396] INFO [table-small-12-sink-iceberg|task-1] [Consumer clientId=f0f6a38c-77b2-4ed8-bd8b-1c6671b0027f, groupId=cg-control-867bd890-e373-4fcd-8b23-e0f44b67412d] Finished assignment for group at generation 1: {f0f6a38c-77b2-4ed8-bd8b-1c6671b0027f-bb41be29-a65f-400d-972c-44ab7aa3f35b=Assignment(partitions=[ <prefix>.iceberg-control-small_12-0])} (org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:664)
[2025-09-04 15:03:04,396] INFO [table-small-12-sink-iceberg|task-1] [Consumer clientId=f0f6a38c-77b2-4ed8-bd8b-1c6671b0027f, groupId=cg-control-867bd890-e373-4fcd-8b23-e0f44b67412d] Successfully joined group with generation Generation{generationId=1, memberId='f0f6a38c-77b2-4ed8-bd8b-1c6671b0027f-bb41be29-a65f-400d-972c-44ab7aa3f35b', protocol='range'} (org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:666)
[2025-09-04 15:03:04,400] INFO [table-small-12-sink-iceberg|task-1] [Consumer clientId=f0f6a38c-77b2-4ed8-bd8b-1c6671b0027f, groupId=cg-control-867bd890-e373-4fcd-8b23-e0f44b67412d] Notifying assignor about the new Assignment(partitions=[ <prefix>.iceberg-control-small_12-0]) (org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:324)
[2025-09-04 15:03:04,400] INFO [table-small-12-sink-iceberg|task-1] [Consumer clientId=f0f6a38c-77b2-4ed8-bd8b-1c6671b0027f, groupId=cg-control-867bd890-e373-4fcd-8b23-e0f44b67412d] Successfully synced group in generation Generation{generationId=1, memberId='f0f6a38c-77b2-4ed8-bd8b-1c6671b0027f-bb41be29-a65f-400d-972c-44ab7aa3f35b', protocol='range'} (org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:843)
[2025-09-04 15:03:04,401] INFO [table-small-12-sink-iceberg|task-1] [Consumer clientId=f0f6a38c-77b2-4ed8-bd8b-1c6671b0027f, groupId=cg-control-867bd890-e373-4fcd-8b23-e0f44b67412d] Adding newly assigned partitions: <prefix>.iceberg-control-small_12-0 (org.apache.kafka.clients.consumer.internals.ConsumerRebalanceListenerInvoker:58)
[2025-09-04 15:03:04,403] INFO [table-small-12-sink-iceberg|task-1] [Consumer clientId=f0f6a38c-77b2-4ed8-bd8b-1c6671b0027f, groupId=cg-control-867bd890-e373-4fcd-8b23-e0f44b67412d] Found no committed offset for partition <prefix>.iceberg-control-small_12-0 (org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:1508)
[2025-09-04 15:03:06,785] INFO [table-small-12-sink-iceberg|task-0] Loading custom FileIO implementation: org.apache.iceberg.azure.adlsv2.ADLSFileIO (org.apache.iceberg.CatalogUtil:376)
[2025-09-04 15:03:06,895] INFO [table-small-12-sink-iceberg|task-0] Loading custom FileIO implementation: org.apache.iceberg.azure.adlsv2.ADLSFileIO (org.apache.iceberg.CatalogUtil:376)
[2025-09-04 15:03:07,160] INFO [table-small-12-sink-iceberg|task-0] Loading custom FileIO implementation: org.apache.iceberg.azure.adlsv2.ADLSFileIO (org.apache.iceberg.CatalogUtil:376)
[2025-09-04 15:03:07,282] INFO [table-small-12-sink-iceberg|task-0] Loading custom FileIO implementation: org.apache.iceberg.azure.adlsv2.ADLSFileIO (org.apache.iceberg.CatalogUtil:376)
[2025-09-04 15:04:00,211] INFO [table-small-12-sink-iceberg|task-0] [Consumer clientId=connector-consumer-table-small-12-sink-iceberg-0, groupId=connect-table-small-12-sink-iceberg] Cancelled in-flight FETCH request with correlation id 52 due to node 2 being disconnected (elapsed time since creation: 60325ms, elapsed time since send: 60007ms, throttle time: 0ms, request timeout: 60000ms) (org.apache.kafka.clients.NetworkClient:480)
[2025-09-04 15:04:00,211] INFO [table-small-12-sink-iceberg|task-0] [Consumer clientId=connector-consumer-table-small-12-sink-iceberg-0, groupId=connect-table-small-12-sink-iceberg] Disconnecting from node 2 due to request timeout. (org.apache.kafka.clients.NetworkClient:1024)
[2025-09-04 15:04:00,211] INFO [table-small-12-sink-iceberg|task-0] [Consumer clientId=connector-consumer-table-small-12-sink-iceberg-0, groupId=connect-table-small-12-sink-iceberg] Error sending fetch request (sessionId=INVALID, epoch=INITIAL) to node 2: (org.apache.kafka.clients.FetchSessionHandler:618)
[2025-09-04 15:04:02,425] INFO [table-small-12-sink-iceberg|task-0] [Consumer clientId=connector-consumer-table-small-12-sink-iceberg-0, groupId=connect-table-small-12-sink-iceberg] Cancelled in-flight FETCH request with correlation id 56 due to node 0 being disconnected (elapsed time since creation: 60002ms, elapsed time since send: 60002ms, throttle time: 0ms, request timeout: 60000ms) (org.apache.kafka.clients.NetworkClient:480)
[2025-09-04 15:04:02,425] INFO [table-small-12-sink-iceberg|task-0] [Consumer clientId=connector-consumer-table-small-12-sink-iceberg-0, groupId=connect-table-small-12-sink-iceberg] Cancelled in-flight FETCH request with correlation id 57 due to node 1 being disconnected (elapsed time since creation: 60002ms, elapsed time since send: 60002ms, throttle time: 0ms, request timeout: 60000ms) (org.apache.kafka.clients.NetworkClient:480)
[2025-09-04 15:04:02,425] INFO [table-small-12-sink-iceberg|task-0] [Consumer clientId=connector-consumer-table-small-12-sink-iceberg-0, groupId=connect-table-small-12-sink-iceberg] Disconnecting from node 0 due to request timeout. (org.apache.kafka.clients.NetworkClient:1024)
[2025-09-04 15:04:02,425] INFO [table-small-12-sink-iceberg|task-0] [Consumer clientId=connector-consumer-table-small-12-sink-iceberg-0, groupId=connect-table-small-12-sink-iceberg] Disconnecting from node 1 due to request timeout. (org.apache.kafka.clients.NetworkClient:1024)
[2025-09-04 15:04:02,426] INFO [Consumer clientId=connector-consumer-table-small-12-sink-iceberg-0, groupId=connect-table-small-12-sink-iceberg] Error sending fetch request (sessionId=2006748031, epoch=1) to node 1: (org.apache.kafka.clients.FetchSessionHandler:618)
[2025-09-04 15:04:02,426] INFO [table-small-12-sink-iceberg|task-0] [Consumer clientId=connector-consumer-table-small-12-sink-iceberg-0, groupId=connect-table-small-12-sink-iceberg] Cancelled in-flight FETCH request with correlation id 59 due to node 4 being disconnected (elapsed time since creation: 60002ms, elapsed time since send: 60002ms, throttle time: 0ms, request timeout: 60000ms) (org.apache.kafka.clients.NetworkClient:480)
[2025-09-04 15:04:02,426] INFO [table-small-12-sink-iceberg|task-0] [Consumer clientId=connector-consumer-table-small-12-sink-iceberg-0, groupId=connect-table-small-12-sink-iceberg] Cancelled in-flight FETCH request with correlation id 58 due to node 5 being disconnected (elapsed time since creation: 60002ms, elapsed time since send: 60002ms, throttle time: 0ms, request timeout: 60000ms) (org.apache.kafka.clients.NetworkClient:480)
[2025-09-04 15:04:02,426] INFO [table-small-12-sink-iceberg|task-0] [Consumer clientId=connector-consumer-table-small-12-sink-iceberg-0, groupId=connect-table-small-12-sink-iceberg] Cancelled in-flight METADATA request with correlation id 76 due to node 5 being disconnected (elapsed time since creation: 3498ms, elapsed time since send: 3498ms, throttle time: 0ms, request timeout: 60000ms) (org.apache.kafka.clients.NetworkClient:480)
[2025-09-04 15:04:02,426] INFO [table-small-12-sink-iceberg|task-0] [Consumer clientId=connector-consumer-table-small-12-sink-iceberg-0, groupId=connect-table-small-12-sink-iceberg] Disconnecting from node 4 due to request timeout. (org.apache.kafka.clients.NetworkClient:1024)
[2025-09-04 15:04:02,426] INFO [table-small-12-sink-iceberg|task-0] [Consumer clientId=connector-consumer-table-small-12-sink-iceberg-0, groupId=connect-table-small-12-sink-iceberg] Disconnecting from node 5 due to request timeout. (org.apache.kafka.clients.NetworkClient:1024)
[2025-09-04 15:04:02,426] INFO [table-small-12-sink-iceberg|task-0] [Consumer clientId=connector-consumer-table-small-12-sink-iceberg-0, groupId=connect-table-small-12-sink-iceberg] Error sending fetch request (sessionId=1163553054, epoch=1) to node 4: (org.apache.kafka.clients.FetchSessionHandler:618)
[2025-09-04 15:04:02,426] INFO [table-small-12-sink-iceberg|task-0] [Consumer clientId=connector-consumer-table-small-12-sink-iceberg-0, groupId=connect-table-small-12-sink-iceberg] Error sending fetch request (sessionId=1375755910, epoch=1) to node 5: (org.apache.kafka.clients.FetchSessionHandler:618)
[2025-09-04 15:04:02,426] INFO [table-small-12-sink-iceberg|task-0] [Consumer clientId=connector-consumer-table-small-12-sink-iceberg-0, groupId=connect-table-small-12-sink-iceberg] Error sending fetch request (sessionId=141207895, epoch=1) to node 0: (org.apache.kafka.clients.FetchSessionHandler:618)
[2025-09-04 15:04:09,471] INFO [table-small-12-sink-iceberg|task-0] [Consumer clientId=connector-consumer-table-small-12-sink-iceberg-0, groupId=connect-table-small-12-sink-iceberg] Node -1 disconnected. (org.apache.kafka.clients.NetworkClient:1191)
[2025-09-04 15:04:11,965] INFO [Producer clientId=connector-dlq-producer-table-small-12-sink-iceberg-0] Node -1 disconnected. (org.apache.kafka.clients.NetworkClient:1191)
[2025-09-04 15:04:17,581] INFO [Consumer clientId=connector-consumer-table-small-12-sink-iceberg-0, groupId=connect-table-small-12-sink-iceberg] Disconnecting from node -1 due to socket connection setup timeout. The timeout value is 24337 ms. (org.apache.kafka.clients.NetworkClient:1046)
[2025-09-04 15:04:17,582] WARN [Consumer clientId=connector-consumer-table-small-12-sink-iceberg-0, groupId=connect-table-small-12-sink-iceberg] Bootstrap broker <cluster>.azure.confluent.cloud:9092 (id: -1 rack: null isFenced: false) disconnected (org.apache.kafka.clients.NetworkClient:1388)
[2025-09-04 15:04:17,583] INFO [Producer clientId=connector-dlq-producer-table-small-12-sink-iceberg-0] Disconnecting from node 3 due to socket connection setup timeout. The timeout value is 23833 ms. (org.apache.kafka.clients.NetworkClient:1046)
[2025-09-04 15:04:17,587] INFO [Producer clientId=connector-dlq-producer-table-small-12-sink-iceberg-0] Rebootstrapping with [<cluster>.azure.confluent.cloud/10.1.0.29:9092] (org.apache.kafka.clients.Metadata:315)
[2025-09-04 15:04:23,730] INFO [table-small-12-sink-iceberg|task-1] [Consumer clientId=connector-consumer-table-small-12-sink-iceberg-1, groupId=connect-table-small-12-sink-iceberg] Disconnecting from node 0 due to request timeout. (org.apache.kafka.clients.NetworkClient:1024)
[2025-09-04 15:04:23,740] INFO [table-small-12-sink-iceberg|task-1] [Consumer clientId=connector-consumer-table-small-12-sink-iceberg-1, groupId=connect-table-small-12-sink-iceberg] Cancelled in-flight FETCH request with correlation id 1448 due to node 0 being disconnected (elapsed time since creation: 68018ms, elapsed time since send: 68018ms, throttle time: 0ms, request timeout: 60000ms) (org.apache.kafka.clients.NetworkClient:480)
[2025-09-04 15:04:23,740] INFO [table-small-12-sink-iceberg|task-1] [Consumer clientId=connector-consumer-table-small-12-sink-iceberg-1, groupId=connect-table-small-12-sink-iceberg] Cancelled in-flight FETCH request with correlation id 1449 due to node 1 being disconnected (elapsed time since creation: 68018ms, elapsed time since send: 68018ms, throttle time: 0ms, request timeout: 60000ms) (org.apache.kafka.clients.NetworkClient:480)
[2025-09-04 15:04:23,740] INFO [table-small-12-sink-iceberg|task-1] [Consumer clientId=connector-consumer-table-small-12-sink-iceberg-1, groupId=connect-table-small-12-sink-iceberg] Cancelled in-flight FETCH request with correlation id 1447 due to node 2 being disconnected (elapsed time since creation: 68018ms, elapsed time since send: 68018ms, throttle time: 0ms, request timeout: 60000ms) (org.apache.kafka.clients.NetworkClient:480)
[2025-09-04 15:04:23,740] INFO [table-small-12-sink-iceberg|task-1] [Consumer clientId=connector-consumer-table-small-12-sink-iceberg-1, groupId=connect-table-small-12-sink-iceberg] Cancelled in-flight FETCH request with correlation id 1446 due to node 3 being disconnected (elapsed time since creation: 68018ms, elapsed time since send: 68018ms, throttle time: 0ms, request timeout: 60000ms) (org.apache.kafka.clients.NetworkClient:480)
[2025-09-04 15:04:23,740] INFO [table-small-12-sink-iceberg|task-1] [Consumer clientId=connector-consumer-table-small-12-sink-iceberg-1, groupId=connect-table-small-12-sink-iceberg] Cancelled in-flight FETCH request with correlation id 1451 due to node 4 being disconnected (elapsed time since creation: 68018ms, elapsed time since send: 68018ms, throttle time: 0ms, request timeout: 60000ms) (org.apache.kafka.clients.NetworkClient:480)
[2025-09-04 15:04:23,740] INFO [table-small-12-sink-iceberg|task-1] [Consumer clientId=connector-consumer-table-small-12-sink-iceberg-1, groupId=connect-table-small-12-sink-iceberg] Disconnecting from node 1 due to request timeout. (org.apache.kafka.clients.NetworkClient:1024)
[2025-09-04 15:04:23,740] INFO [table-small-12-sink-iceberg|task-1] [Consumer clientId=connector-consumer-table-small-12-sink-iceberg-1, groupId=connect-table-small-12-sink-iceberg] Disconnecting from node 2 due to request timeout. (org.apache.kafka.clients.NetworkClient:1024)
[2025-09-04 15:04:23,740] INFO [table-small-12-sink-iceberg|task-1] [Consumer clientId=connector-consumer-table-small-12-sink-iceberg-1, groupId=connect-table-small-12-sink-iceberg] Disconnecting from node 3 due to request timeout. (org.apache.kafka.clients.NetworkClient:1024)
[2025-09-04 15:04:23,740] INFO [table-small-12-sink-iceberg|task-1] [Consumer clientId=connector-consumer-table-small-12-sink-iceberg-1, groupId=connect-table-small-12-sink-iceberg] Disconnecting from node 4 due to request timeout. (org.apache.kafka.clients.NetworkClient:1024)
[2025-09-04 15:04:23,741] INFO [table-small-12-sink-iceberg|task-1] [Consumer clientId=connector-consumer-table-small-12-sink-iceberg-1, groupId=connect-table-small-12-sink-iceberg] Cancelled in-flight FETCH request with correlation id 1450 due to node 5 being disconnected (elapsed time since creation: 68018ms, elapsed time since send: 68018ms, throttle time: 0ms, request timeout: 60000ms) (org.apache.kafka.clients.NetworkClient:480)
[2025-09-04 15:04:23,741] INFO [table-small-12-sink-iceberg|task-1] [Consumer clientId=connector-consumer-table-small-12-sink-iceberg-1, groupId=connect-table-small-12-sink-iceberg] Disconnecting from node 5 due to request timeout. (org.apache.kafka.clients.NetworkClient:1024)
[2025-09-04 15:04:23,741] INFO [table-small-12-sink-iceberg|task-1] [Consumer clientId=connector-consumer-table-small-12-sink-iceberg-1, groupId=connect-table-small-12-sink-iceberg] Error sending fetch request (sessionId=1574004371, epoch=INITIAL) to node 2: (org.apache.kafka.clients.FetchSessionHandler:618)
[2025-09-04 15:04:23,741] INFO [table-small-12-sink-iceberg|task-1] [Consumer clientId=connector-consumer-table-small-12-sink-iceberg-1, groupId=connect-table-small-12-sink-iceberg] Error sending fetch request (sessionId=1777106785, epoch=INITIAL) to node 4: (org.apache.kafka.clients.FetchSessionHandler:618)
[2025-09-04 15:04:23,741] INFO [table-small-12-sink-iceberg|task-1] [Consumer clientId=connector-consumer-table-small-12-sink-iceberg-1, groupId=connect-table-small-12-sink-iceberg] Error sending fetch request (sessionId=514490741, epoch=1) to node 0: (org.apache.kafka.clients.FetchSessionHandler:618)
[2025-09-04 15:04:23,741] INFO [table-small-12-sink-iceberg|task-1] [Consumer clientId=connector-consumer-table-small-12-sink-iceberg-1, groupId=connect-table-small-12-sink-iceberg] Error sending fetch request (sessionId=INVALID, epoch=INITIAL) to node 3: (org.apache.kafka.clients.FetchSessionHandler:618)
[2025-09-04 15:04:23,741] INFO [table-small-12-sink-iceberg|task-1] [Consumer clientId=connector-consumer-table-small-12-sink-iceberg-1, groupId=connect-table-small-12-sink-iceberg] Error sending fetch request (sessionId=INVALID, epoch=INITIAL) to node 5: (org.apache.kafka.clients.FetchSessionHandler:618)
[2025-09-04 15:04:23,742] INFO [Consumer clientId=connector-consumer-table-small-12-sink-iceberg-1, groupId=connect-table-small-12-sink-iceberg] Error sending fetch request (sessionId=2264982, epoch=INITIAL) to node 1: (org.apache.kafka.clients.FetchSessionHandler:618)
+ [2025-09-04 15:04:55,247] INFO Received metrics report: CommitReport{tableName=polaris.raw.t440_bal_head, snapshotId=4343445114214793138, sequenceNumber=39188, operation=append, commitMetrics=CommitMetricsResult{totalDuration=TimerResult{timeUnit=NANOSECONDS, totalDuration=PT7M11.811166357S, count=1}, attempts=CounterResult{unit=COUNT, value=1}, addedDataFiles=CounterResult{unit=COUNT, value=2}, removedDataFiles=null, totalDataFiles=CounterResult{unit=COUNT, value=285}, addedDeleteFiles=null, addedEqualityDeleteFiles=null, addedPositionalDeleteFiles=null, addedDVs=null, removedDeleteFiles=null, removedEqualityDeleteFiles=null, removedPositionalDeleteFiles=null, removedDVs=null, totalDeleteFiles=CounterResult{unit=COUNT, value=0}, addedRecords=CounterResult{unit=COUNT, value=8}, removedRecords=null, totalRecords=CounterResult{unit=COUNT, value=1879583}, addedFilesSizeInBytes=CounterResult{unit=BYTES, value=22558}, removedFilesSizeInBytes=null, totalFilesSizeInBytes=CounterResult{
unit=BYTES, value=75774415}, addedPositionalDeletes=null, removedPositionalDeletes=null, totalPositionalDeletes=CounterResult{unit=COUNT, value=0}, addedEqualityDeletes=null, removedEqualityDeletes=null, totalEqualityDeletes=CounterResult{unit=COUNT, value=0}, manifestsCreated=null, manifestsReplaced=null, manifestsKept=null, manifestEntriesProcessed=null}, metadata={iceberg-version=Apache Iceberg 1.9.2 (commit 071d5606bc6199a0be9b3f274ec7fbf111d88821)}} (org.apache.iceberg.metrics.LoggingMetricsReporter:38)
[2025-09-04 15:04:55,252] INFO [Producer clientId=connector-dlq-producer-table-small-12-sink-iceberg-0] Disconnecting from node -1 due to socket connection setup timeout. The timeout value is 8744 ms. (org.apache.kafka.clients.NetworkClient:1046)
[2025-09-04 15:04:55,253] WARN [Producer clientId=connector-dlq-producer-table-small-12-sink-iceberg-0] Bootstrap broker <cluster>.azure.confluent.cloud:9092 (id: -1 rack: null isFenced: false) disconnected (org.apache.kafka.clients.NetworkClient:1388)
[2025-09-04 15:05:01,902] INFO [table-small-12-sink-iceberg|task-0] [Consumer clientId=connector-consumer-table-small-12-sink-iceberg-0, groupId=connect-table-small-12-sink-iceberg] Cancelled in-flight FETCH request with correlation id 78 due to node 2 being disconnected (elapsed time since creation: 60074ms, elapsed time since send: 60054ms, throttle time: 0ms, request timeout: 60000ms) (org.apache.kafka.clients.NetworkClient:480)
[2025-09-04 15:05:01,902] INFO [table-small-12-sink-iceberg|task-0] [Consumer clientId=connector-consumer-table-small-12-sink-iceberg-0, groupId=connect-table-small-12-sink-iceberg] Disconnecting from node 2 due to request timeout. (org.apache.kafka.clients.NetworkClient:1024)
[2025-09-04 15:05:01,902] INFO [table-small-12-sink-iceberg|task-0] [Consumer clientId=connector-consumer-table-small-12-sink-iceberg-0, groupId=connect-table-small-12-sink-iceberg] Error sending fetch request (sessionId=INVALID, epoch=INITIAL) to node 2: (org.apache.kafka.clients.FetchSessionHandler:618)
[2025-09-04 15:05:02,427] INFO [table-small-12-sink-iceberg|task-0] [Consumer clientId=connector-consumer-table-small-12-sink-iceberg-0, groupId=connect-table-small-12-sink-iceberg] Cancelled in-flight FETCH request with correlation id 80 due to node 3 being disconnected (elapsed time since creation: 60001ms, elapsed time since send: 60001ms, throttle time: 0ms, request timeout: 60000ms) (org.apache.kafka.clients.NetworkClient:480)
[2025-09-04 15:05:02,427] INFO [table-small-12-sink-iceberg|task-0] [Consumer clientId=connector-consumer-table-small-12-sink-iceberg-0, groupId=connect-table-small-12-sink-iceberg] Cancelled in-flight METADATA request with correlation id 85 due to node 3 being disconnected (elapsed time since creation: 59889ms, elapsed time since send: 59889ms, throttle time: 0ms, request timeout: 60000ms) (org.apache.kafka.clients.NetworkClient:480)
[2025-09-04 15:05:02,427] INFO [table-small-12-sink-iceberg|task-0] [Consumer clientId=connector-consumer-table-small-12-sink-iceberg-0, groupId=connect-table-small-12-sink-iceberg] Disconnecting from node 3 due to request timeout. (org.apache.kafka.clients.NetworkClient:1024)
[2025-09-04 15:05:02,427] INFO [table-small-12-sink-iceberg|task-0] [Consumer clientId=connector-consumer-table-small-12-sink-iceberg-0, groupId=connect-table-small-12-sink-iceberg] Error sending fetch request (sessionId=1529764225, epoch=2) to node 3: (org.apache.kafka.clients.FetchSessionHandler:618)
[2025-09-04 15:05:02,567] INFO [table-small-12-sink-iceberg|task-0] [Consumer clientId=connector-consumer-table-small-12-sink-iceberg-0, groupId=connect-table-small-12-sink-iceberg] Cancelled in-flight FETCH request with correlation id 82 due to node 1 being disconnected (elapsed time since creation: 60029ms, elapsed time since send: 60003ms, throttle time: 0ms, request timeout: 60000ms) (org.apache.kafka.clients.NetworkClient:480)
[2025-09-04 15:05:02,567] INFO [table-small-12-sink-iceberg|task-0] [Consumer clientId=connector-consumer-table-small-12-sink-iceberg-0, groupId=connect-table-small-12-sink-iceberg] Disconnecting from node 1 due to request timeout. (org.apache.kafka.clients.NetworkClient:1024)
[2025-09-04 15:05:02,567] INFO [table-small-12-sink-iceberg|task-0] [Consumer clientId=connector-consumer-table-small-12-sink-iceberg-0, groupId=connect-table-small-12-sink-iceberg] Error sending fetch request (sessionId=2006748031, epoch=INITIAL) to node 1: (org.apache.kafka.clients.FetchSessionHandler:618)
[2025-09-04 15:05:02,580] INFO [table-small-12-sink-iceberg|task-0] [Consumer clientId=connector-consumer-table-small-12-sink-iceberg-0, groupId=connect-table-small-12-sink-iceberg] Cancelled in-flight FETCH request with correlation id 84 due to node 4 being disconnected (elapsed time since creation: 60042ms, elapsed time since send: 60002ms, throttle time: 0ms, request timeout: 60000ms) (org.apache.kafka.clients.NetworkClient:480)
[2025-09-04 15:05:02,580] INFO [table-small-12-sink-iceberg|task-0] [Consumer clientId=connector-consumer-table-small-12-sink-iceberg-0, groupId=connect-table-small-12-sink-iceberg] Disconnecting from node 4 due to request timeout. (org.apache.kafka.clients.NetworkClient:1024)
[2025-09-04 15:05:02,580] INFO [table-small-12-sink-iceberg|task-0] [Consumer clientId=connector-consumer-table-small-12-sink-iceberg-0, groupId=connect-table-small-12-sink-iceberg] Error sending fetch request (sessionId=1163553054, epoch=INITIAL) to node 4: (org.apache.kafka.clients.FetchSessionHandler:618)
[2025-09-04 15:05:07,727] INFO [Consumer clientId=connector-consumer-table-small-12-sink-iceberg-0, groupId=connect-table-small-12-sink-iceberg] Disconnecting from node -1 due to socket connection setup timeout. The timeout value is 30000 ms. (org.apache.kafka.clients.NetworkClient:1046)
[2025-09-04 15:05:07,727] WARN [Consumer clientId=connector-consumer-table-small-12-sink-iceberg-0, groupId=connect-table-small-12-sink-iceberg] Bootstrap broker <cluster>.azure.confluent.cloud:9092 (id: -1 rack: null isFenced: false) disconnected (org.apache.kafka.clients.NetworkClient:1388)
[2025-09-04 15:05:14,267] INFO [table-small-12-sink-iceberg|task-0] Sending event of type: DATA_WRITTEN (org.apache.iceberg.connect.channel.Channel:88)
[2025-09-04 15:05:14,267] INFO [table-small-12-sink-iceberg|task-0] Sending event of type: DATA_WRITTEN (org.apache.iceberg.connect.channel.Channel:88)
[2025-09-04 15:05:14,267] INFO [table-small-12-sink-iceberg|task-0] Sending event of type: DATA_WRITTEN (org.apache.iceberg.connect.channel.Channel:88)
[2025-09-04 15:05:14,268] INFO [table-small-12-sink-iceberg|task-0] Sending event of type: DATA_COMPLETE (org.apache.iceberg.connect.channel.Channel:88)
[2025-09-04 15:05:14,268] INFO [table-small-12-sink-iceberg|task-0] Sending event of type: DATA_WRITTEN (org.apache.iceberg.connect.channel.Channel:88)
[2025-09-04 15:05:14,268] INFO [table-small-12-sink-iceberg|task-0] Sending event of type: DATA_WRITTEN (org.apache.iceberg.connect.channel.Channel:88)
[2025-09-04 15:05:14,268] INFO [table-small-12-sink-iceberg|task-0] Sending event of type: DATA_WRITTEN (org.apache.iceberg.connect.channel.Channel:88)
[2025-09-04 15:05:14,814] INFO [table-small-12-sink-iceberg|task-0] Handled event of type: START_COMMIT (org.apache.iceberg.connect.channel.Channel:133)
[2025-09-04 15:05:20,388] INFO [table-small-12-sink-iceberg|task-1] Sending event of type: DATA_COMPLETE (org.apache.iceberg.connect.channel.Channel:88)
[2025-09-04 15:05:20,418] INFO [table-small-12-sink-iceberg|task-1] Handled event of type: START_COMMIT (org.apache.iceberg.connect.channel.Channel:133)
+ This is now an entirely different Snapshot than the duplicate 2 just a few seconds after the duplicate snapshot was committed
[2025-09-04 15:05:21,189] INFO Received metrics report: CommitReport{tableName=polaris.raw.t440_bal_head, snapshotId=2509078283058136613, sequenceNumber=39189, operation=append, commitMetrics=CommitMetricsResult{totalDuration=TimerResult{timeUnit=NANOSECONDS, totalDuration=PT0.595580864S, count=1}, attempts=CounterResult{unit=COUNT, value=1}, addedDataFiles=CounterResult{unit=COUNT, value=8}, removedDataFiles=null, totalDataFiles=CounterResult{unit=COUNT, value=293}, addedDeleteFiles=null, addedEqualityDeleteFiles=null, addedPositionalDeleteFiles=null, addedDVs=null, removedDeleteFiles=null, removedEqualityDeleteFiles=null, removedPositionalDeleteFiles=null, removedDVs=null, totalDeleteFiles=CounterResult{unit=COUNT, value=0}, addedRecords=CounterResult{unit=COUNT, value=105}, removedRecords=null, totalRecords=CounterResult{unit=COUNT, value=1879688}, addedFilesSizeInBytes=CounterResult{unit=BYTES, value=94898}, removedFilesSizeInBytes=null, totalFilesSizeInBytes=CounterResult{uni
t=BYTES, value=75869313}, addedPositionalDeletes=null, removedPositionalDeletes=null, totalPositionalDeletes=CounterResult{unit=COUNT, value=0}, addedEqualityDeletes=null, removedEqualityDeletes=null, totalEqualityDeletes=CounterResult{unit=COUNT, value=0}, manifestsCreated=null, manifestsReplaced=null, manifestsKept=null, manifestEntriesProcessed=null}, metadata={iceberg-version=Apache Iceberg 1.9.2 (commit 071d5606bc6199a0be9b3f274ec7fbf111d88821)}} (org.apache.iceberg.metrics.LoggingMetricsReporter:38)
[2025-09-04 15:05:21,202] INFO Commit complete to table raw.t440_bal_head, snapshot 2509078283058136613, commit ID b63a5266-3dd1-4a53-9888-396110938031, valid-through null (org.apache.iceberg.connect.channel.Coordinator:266)
[2025-09-04 15:05:25,541] INFO [Consumer clientId=f98b462d-c6fa-4cfb-bf96-1b0683cf3c81, groupId=connect-table-small-12-sink-iceberg-coord] Node -1 disconnected. (org.apache.kafka.clients.NetworkClient:1191)
[2025-09-04 15:05:31,799] INFO [table-small-12-sink-iceberg|task-1] [Consumer clientId=connector-consumer-table-small-12-sink-iceberg-1, groupId=connect-table-small-12-sink-iceberg] Cancelled in-flight FETCH request with correlation id 1460 due to node 0 being disconnected (elapsed time since creation: 67946ms, elapsed time since send: 67928ms, throttle time: 0ms, request timeout: 60000ms) (org.apache.kafka.clients.NetworkClient:480)
[2025-09-04 15:05:31,799] INFO [table-small-12-sink-iceberg|task-1] [Consumer clientId=connector-consumer-table-small-12-sink-iceberg-1, groupId=connect-table-small-12-sink-iceberg] Cancelled in-flight FETCH request with correlation id 1461 due to node 1 being disconnected (elapsed time since creation: 67946ms, elapsed time since send: 67922ms, throttle time: 0ms, request timeout: 60000ms) (org.apache.kafka.clients.NetworkClient:480)
[2025-09-04 15:05:31,799] INFO [table-small-12-sink-iceberg|task-1] [Consumer clientId=connector-consumer-table-small-12-sink-iceberg-1, groupId=connect-table-small-12-sink-iceberg] Disconnecting from node 0 due to request timeout. (org.apache.kafka.clients.NetworkClient:1024)
[2025-09-04 15:05:31,799] INFO [table-small-12-sink-iceberg|task-1] [Consumer clientId=connector-consumer-table-small-12-sink-iceberg-1, groupId=connect-table-small-12-sink-iceberg] Disconnecting from node 1 due to request timeout. (org.apache.kafka.clients.NetworkClient:1024)
[2025-09-04 15:05:31,800] INFO [table-small-12-sink-iceberg|task-1] [Consumer clientId=connector-consumer-table-small-12-sink-iceberg-1, groupId=connect-table-small-12-sink-iceberg] Cancelled in-flight FETCH request with correlation id 1459 due to node 2 being disconnected (elapsed time since creation: 67946ms, elapsed time since send: 67922ms, throttle time: 0ms, request timeout: 60000ms) (org.apache.kafka.clients.NetworkClient:480)
[2025-09-04 15:05:31,800] INFO [table-small-12-sink-iceberg|task-1] [Consumer clientId=connector-consumer-table-small-12-sink-iceberg-1, groupId=connect-table-small-12-sink-iceberg] Cancelled in-flight FETCH request with correlation id 1458 due to node 3 being disconnected (elapsed time since creation: 67946ms, elapsed time since send: 67928ms, throttle time: 0ms, request timeout: 60000ms) (org.apache.kafka.clients.NetworkClient:480)
[2025-09-04 15:05:31,800] INFO [table-small-12-sink-iceberg|task-1] [Consumer clientId=connector-consumer-table-small-12-sink-iceberg-1, groupId=connect-table-small-12-sink-iceberg] Cancelled in-flight FETCH request with correlation id 1463 due to node 4 being disconnected (elapsed time since creation: 67946ms, elapsed time since send: 67923ms, throttle time: 0ms, request timeout: 60000ms) (org.apache.kafka.clients.NetworkClient:480)
[2025-09-04 15:05:31,800] INFO [table-small-12-sink-iceberg|task-1] [Consumer clientId=connector-consumer-table-small-12-sink-iceberg-1, groupId=connect-table-small-12-sink-iceberg] Cancelled in-flight FETCH request with correlation id 1462 due to node 5 being disconnected (elapsed time since creation: 67946ms, elapsed time since send: 67924ms, throttle time: 0ms, request timeout: 60000ms) (org.apache.kafka.clients.NetworkClient:480)
[2025-09-04 15:05:31,800] INFO [table-small-12-sink-iceberg|task-1] [Consumer clientId=connector-consumer-table-small-12-sink-iceberg-1, groupId=connect-table-small-12-sink-iceberg] Disconnecting from node 2 due to request timeout. (org.apache.kafka.clients.NetworkClient:1024)
[2025-09-04 15:05:31,800] INFO [table-small-12-sink-iceberg|task-1] [Consumer clientId=connector-consumer-table-small-12-sink-iceberg-1, groupId=connect-table-small-12-sink-iceberg] Disconnecting from node 3 due to request timeout. (org.apache.kafka.clients.NetworkClient:1024)
[2025-09-04 15:05:31,800] INFO [table-small-12-sink-iceberg|task-1] [Consumer clientId=connector-consumer-table-small-12-sink-iceberg-1, groupId=connect-table-small-12-sink-iceberg] Disconnecting from node 4 due to request timeout. (org.apache.kafka.clients.NetworkClient:1024)
[2025-09-04 15:05:31,800] INFO [table-small-12-sink-iceberg|task-1] [Consumer clientId=connector-consumer-table-small-12-sink-iceberg-1, groupId=connect-table-small-12-sink-iceberg] Disconnecting from node 5 due to request timeout. (org.apache.kafka.clients.NetworkClient:1024)
[2025-09-04 15:05:31,800] INFO [table-small-12-sink-iceberg|task-1] [Consumer clientId=connector-consumer-table-small-12-sink-iceberg-1, groupId=connect-table-small-12-sink-iceberg] Error sending fetch request (sessionId=1574004371, epoch=INITIAL) to node 2: (org.apache.kafka.clients.FetchSessionHandler:618)
[2025-09-04 15:05:31,800] INFO [table-small-12-sink-iceberg|task-1] [Consumer clientId=connector-consumer-table-small-12-sink-iceberg-1, groupId=connect-table-small-12-sink-iceberg] Error sending fetch request (sessionId=1777106785, epoch=INITIAL) to node 4: (org.apache.kafka.clients.FetchSessionHandler:618)
[2025-09-04 15:05:31,800] INFO [table-small-12-sink-iceberg|task-1] [Consumer clientId=connector-consumer-table-small-12-sink-iceberg-1, groupId=connect-table-small-12-sink-iceberg] Error sending fetch request (sessionId=2264982, epoch=INITIAL) to node 1: (org.apache.kafka.clients.FetchSessionHandler:618)
[2025-09-04 15:05:31,800] INFO [table-small-12-sink-iceberg|task-1] [Consumer clientId=connector-consumer-table-small-12-sink-iceberg-1, groupId=connect-table-small-12-sink-iceberg] Error sending fetch request (sessionId=514490741, epoch=INITIAL) to node 0: (org.apache.kafka.clients.FetchSessionHandler:618)
[2025-09-04 15:05:31,801] INFO [table-small-12-sink-iceberg|task-1] [Consumer clientId=connector-consumer-table-small-12-sink-iceberg-1, groupId=connect-table-small-12-sink-iceberg] Error sending fetch request (sessionId=INVALID, epoch=INITIAL) to node 5: (org.apache.kafka.clients.FetchSessionHandler:618)
[2025-09-04 15:05:31,802] INFO [Consumer clientId=connector-consumer-table-small-12-sink-iceberg-1, groupId=connect-table-small-12-sink-iceberg] Error sending fetch request (sessionId=INVALID, epoch=INITIAL) to node 3: (org.apache.kafka.clients.FetchSessionHandler:618)
[2025-09-04 15:05:32,825] INFO [Producer clientId=connector-dlq-producer-table-small-12-sink-iceberg-0] Cluster ID: <cluster> (org.apache.kafka.clients.Metadata:366)
[2025-09-04 15:05:57,971] INFO [Consumer clientId=connector-consumer-table-small-12-sink-iceberg-0, groupId=connect-table-small-12-sink-iceberg] Disconnecting from node -1 due to socket connection setup timeout. The timeout value is 29467 ms. (org.apache.kafka.clients.NetworkClient:1046)
[2025-09-04 15:05:57,973] WARN [Consumer clientId=connector-consumer-table-small-12-sink-iceberg-0, groupId=connect-table-small-12-sink-iceberg] Bootstrap broker <cluster>.azure.confluent.cloud:9092 (id: -1 rack: null isFenced: false) disconnected (org.apache.kafka.clients.NetworkClient:1388)
```
What seems odd is that if you search for snapshot ID 2368336716243636983 there are 3 logs (one of them being commit complete to table from Coordinator), but if you search snapshot ID 4343445114214793138 there are only 2 logs. Not sure how to interpret this but it seems it may be creating the Snapshot outside of Coordinator's logic and the Coordinator is actually not aware of this Snapshot being produced?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org
Re: [I] Duplicate file path found in Iceberg metadata snapshot [iceberg]
Posted by "kumarpritam863 (via GitHub)" <gi...@apache.org>.
kumarpritam863 commented on issue #13763:
URL: https://github.com/apache/iceberg/issues/13763#issuecomment-3266625377
Investigating Iceberg core 1.9.2 changes.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org
Re: [I] Duplicate file path found in Iceberg metadata snapshot [iceberg]
Posted by "hguercan (via GitHub)" <gi...@apache.org>.
hguercan commented on issue #13763:
URL: https://github.com/apache/iceberg/issues/13763#issuecomment-3167942774
We traveled down to the earliest manifest file where it started to happen. Its coming with the commit of the iceberg-sink-connector. All following up commits are keeping it.
@kumarpritam863 could the issue referenced in
* https://github.com/apache/iceberg/issues/13752
* https://github.com/apache/iceberg/issues/13593
Correspond that with this issue?!
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org
Re: [I] Duplicate file path found in Iceberg metadata snapshot [iceberg]
Posted by "hguercan (via GitHub)" <gi...@apache.org>.
hguercan commented on issue #13763:
URL: https://github.com/apache/iceberg/issues/13763#issuecomment-3168029637
Thank you for your responses.
We have two possible writers in our Architecture and we are not using spark streaming. These are the iceberg-sink-connector and spark as maintenance for data-rewrite, manifest-rewrite, snapshot-expiry and orphan-deletion. With our investigation today to the earliest possible snapshot with duplicated entries we could confirm the first time it occurs, its coming from the iceberg-sink-connector however.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org
Re: [I] Duplicate file path found in Iceberg metadata snapshot [iceberg]
Posted by "hguercan (via GitHub)" <gi...@apache.org>.
hguercan commented on issue #13763:
URL: https://github.com/apache/iceberg/issues/13763#issuecomment-3462022555
No worries, would it be possible to link that PR in this thread so i can check if its already in one of the released versions or keep track at least?
For general interest: We are currently running with iceberg-core 1.9.1 and for connect with a version 1.8.1.
This leads to run into that issue just rarely. For that rare cases @lkindere wrote a script that will remove the duplicate file entries by identyfing them and removing that snapshots via the API.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org
Re: [I] Duplicate file path found in Iceberg metadata snapshot [iceberg]
Posted by "lkindere (via GitHub)" <gi...@apache.org>.
lkindere commented on issue #13763:
URL: https://github.com/apache/iceberg/issues/13763#issuecomment-3264007116
@kumarpritam863
Sorry, I confused 1.9.2 and 1.8.1, we are currently using 1.8.1 Kafka connect built with 1.9.2 iceberg core, catalog is-self hosted Polaris based on 1.0.0 release, so it's a REST catalog.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org
Re: [I] Duplicate file path found in Iceberg metadata snapshot [iceberg]
Posted by "tongwai-wong-appier (via GitHub)" <gi...@apache.org>.
tongwai-wong-appier commented on issue #13763:
URL: https://github.com/apache/iceberg/issues/13763#issuecomment-4438421059
@kumarpritam863 Thanks for the explanation. That helps clarify the current offset-validation path, especially for what I would call the "stale replay" case.
To make sure I understand the guarantees correctly, would it be reasonable to separate the situations into these three cases?
1. **Case 1: the exact same `DATA_WRITTEN(file X)` control-topic record is replayed**
- same control-topic offset
- replayed after recovery / coordinator switchover
- from reading current `main`, this appears to be covered by:
- filtering against committed control-topic offsets before `commitToTable()`
- plus `SnapshotAncestryValidator`
2. **Case 2: two distinct `DATA_WRITTEN(file X)` records are buffered, but both land in the same commit**
- from reading current `main`, this appears to be covered by
`distinctByKey(ContentFile::location)` inside `commitToTable()`
3. **Case 3: two distinct `DATA_WRITTEN(file X)` records are produced across two different commit cycles / snapshots**
- for example:
- commit A already appends file `X` into snapshot `S1`
- then a later `StartCommit` causes a new `DATA_WRITTEN(file X)` event to be emitted again
- that later event has a new control-topic offset and may belong to a new commitId
- then commit B attempts to append the same physical file `X` into snapshot `S2`
Our current suspicion is that our incident may be closer to **Case 3**, not Case 1.
So the question I want to confirm is:
> Does current `main` also guarantee deduplication / rejection for **Case 3**?
>
> In other words, if the second `DATA_WRITTEN(file X)` is not a replay of the old control-topic record, but a newly produced control-topic event with a newer offset, which part of the current logic prevents `file X` from being appended again into a later snapshot?
The reason I am asking is that the current protections seem clearly tied to:
- stale control-topic offset replay, and
- concurrent commit validation
but I am not yet seeing an obvious cross-snapshot file-level idempotency check for the "same physical file, new control-topic event" case.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org
Re: [I] Duplicate file path found in Iceberg metadata snapshot [iceberg]
Posted by "kumarpritam863 (via GitHub)" <gi...@apache.org>.
kumarpritam863 commented on issue #13763:
URL: https://github.com/apache/iceberg/issues/13763#issuecomment-4439313278
Can you please explain a scenario where the workers will emit the same file across different DATA_WRITTEn events as on the worker side the offset commit and control topic event production runs in the same transaction.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org
Re: [I] Duplicate file path found in Iceberg metadata snapshot [iceberg]
Posted by "akomisarek (via GitHub)" <gi...@apache.org>.
akomisarek commented on issue #13763:
URL: https://github.com/apache/iceberg/issues/13763#issuecomment-4342854114
Any updates on permanent resolution of this problem? Could workaround to repairManifest be implemented to in main Iceberg as acceptable workaround? We have encountered the same problem also, and not sure how to best to recover :(
Writing to glue as Iceberg catalog -> Federating to Unity, and not being able to query in Databricks.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org
Re: [I] Duplicate file path found in Iceberg metadata snapshot [iceberg]
Posted by "omerhadari (via GitHub)" <gi...@apache.org>.
omerhadari commented on issue #13763:
URL: https://github.com/apache/iceberg/issues/13763#issuecomment-3168425975
Do you have access to the table's `metadata.json` file? If so, can you share the snapshot summary of the snapshots with `snapshot-sequence` `59331` and `59330`? These are the sequences of the snapshots in which the file you mentioned was seemingly added according to the values in `file_sequence_number` (in a regular situation, there should be only one as you say).
They can be found, if not expired, in the `snapshots` key which contains an array of snapshots.
If they no longer exist in this array, perhaps an older `metadata.json` which does still have this information still exists.
I am asking because this connector utilizes snapshot properties for some of the consistency guarantee mechanisms, and this could help pointing in the right direction (or away from the wrong direction).
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org
Re: [I] Duplicate file path found in Iceberg metadata snapshot [iceberg]
Posted by "kumarpritam863 (via GitHub)" <gi...@apache.org>.
kumarpritam863 commented on issue #13763:
URL: https://github.com/apache/iceberg/issues/13763#issuecomment-3175990743
@goktugkose Can you share the config of the job and the worker properties you are using.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org
Re: [I] Duplicate file path found in Iceberg metadata snapshot [iceberg]
Posted by "goktugkose (via GitHub)" <gi...@apache.org>.
goktugkose commented on issue #13763:
URL: https://github.com/apache/iceberg/issues/13763#issuecomment-3176146464
@kumarpritam863 Of course, you can see the connector configuration below. We do not use anything special when it comes to worker configuration. Is there any special setting that you seek? We're using v1.9.1 with Google BigQuery Metastore as a catalog.
```
{
"config.providers": "file",
"config.providers.file.class": "org.apache.kafka.common.config.provider.FileConfigProvider",
"connector.class": "org.apache.iceberg.connect.IcebergSinkConnector",
"consumer.override.auto.offset.reset": "earliest",
"consumer.override.bootstrap.servers": "***",
"consumer.override.sasl.jaas.config": "***",
"consumer.override.sasl.mechanism": "SCRAM-SHA-512",
"consumer.override.security.protocol": "SASL_SSL",
"consumer.override.ssl.ca.location": "***",
"consumer.override.ssl.truststore.location": "***",
"consumer.override.ssl.truststore.password": "***",
"errors.retry.timeout": "30000",
"iceberg.catalog.catalog-impl": "org.apache.iceberg.gcp.bigquery.BigQueryMetastoreCatalog",
"iceberg.catalog.gcp.bigquery.location": "***",
"iceberg.catalog.gcp.bigquery.project-id": "***",
"iceberg.catalog.warehouse": "gs://***",
"iceberg.control.commit.interval-ms": "120000",
"iceberg.control.topic": "***",
"iceberg.coordinator.transactional.prefix": "***",
"iceberg.kafka.bootstrap.servers": "***",
"iceberg.kafka.sasl.jaas.config": "***",
"iceberg.kafka.sasl.mechanism": "SCRAM-SHA-512",
"iceberg.kafka.security.protocol": "SASL_SSL",
"iceberg.kafka.ssl.ca.location": "***",
"iceberg.kafka.ssl.truststore.location": "***",
"iceberg.kafka.ssl.truststore.password": "***",
"iceberg.tables": "dataset.table",
"iceberg.tables.auto-create-enabled": "true",
"iceberg.tables.evolve-schema-enabled": "true",
"iceberg.tables.schema-case-insensitive": "false",
"key.converter": "org.apache.kafka.connect.storage.StringConverter",
"key.converter.schemas.enable": "false",
"tasks.max": "1",
"topics": "***",
"transforms": "InsertTimestamp,InsertOffset,InsertPartition,TimestampConverter",
"transforms.InsertOffset.type": "org.apache.kafka.connect.transforms.InsertField$Value",
"transforms.InsertPartition.partition.field": "_kafka_partition",
"transforms.InsertPartition.type": "org.apache.kafka.connect.transforms.InsertField$Value",
"transforms.InsertTimestamp.timestamp.field": "_kafka_ts",
"transforms.InsertTimestamp.type": "org.apache.kafka.connect.transforms.InsertField$Value",
"transforms.TimestampConverter.field": "_kafka_ts",
"transforms.TimestampConverter.format": "yyyy-MM-dd'T'HH:mm:ss.SSS",
"value.converter": "org.apache.kafka.connect.json.JsonConverter",
"value.converter.schemas.enable": "false"
}
```
fyi @oykuaslan
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org
Re: [I] Duplicate file path found in Iceberg metadata snapshot [iceberg]
Posted by "hguercan (via GitHub)" <gi...@apache.org>.
hguercan commented on issue #13763:
URL: https://github.com/apache/iceberg/issues/13763#issuecomment-3188574500
> We have encountered the same issue when rewriting data files. Similar to [@hguercan](https://github.com/hguercan)'s approach, we wrote a Spark SQL query to check whether different snapshots use the same data file. Also, we have noticed that pausing the Sink Connector does not stop all processes that belong to the sink tasks since INFO-level logs are still produced by those tasks. It seems that [@kumarpritam863](https://github.com/kumarpritam863) addressed these two items in [#13756](https://github.com/apache/iceberg/pull/13756).
>
> Thanks for your effort 🚀
>
> ```
> df= spark.sql(
> f"""
> SELECT
> data_file.file_path AS file_path,
> COUNT(DISTINCT snapshot_id) AS distinct_snapshots
> FROM `{CATALOG}`.`{DATASET}`.`{TABLE_NAME}`.entries e
> GROUP BY data_file.file_path
> HAVING COUNT(DISTINCT snapshot_id) > 1;
> """
> )
> ```
By any chance are you using CFK for controlling the connectors? I could see the same behaviour today on our dev cluster where i had a lot of logs from connectors that i already had "deleted". Only restarting the connect cluster lead to an expected state.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org
Re: [I] Duplicate file path found in Iceberg metadata snapshot [iceberg]
Posted by "ariel-wnwd (via GitHub)" <gi...@apache.org>.
ariel-wnwd commented on issue #13763:
URL: https://github.com/apache/iceberg/issues/13763#issuecomment-3737100506
> No worries, would it be possible to link that PR in this thread so i can check if its already in one of the released versions or keep track at least?
>
> For general interest: We are currently running with iceberg-core 1.9.1 and for connect with a version 1.8.1.
> This leads to run into that issue just rarely. For that rare cases @lkindere wrote a script that will remove the duplicate file entries by identyfing them and removing that snapshots via the API.
>
> EDIT: Thank you for all your support so far @kumarpritam863
Could you please share the script?
@hguercan @lkindere
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org
Re: [I] Duplicate file path found in Iceberg metadata snapshot [iceberg]
Posted by "tongwai-wong-appier (via GitHub)" <gi...@apache.org>.
tongwai-wong-appier commented on issue #13763:
URL: https://github.com/apache/iceberg/issues/13763#issuecomment-4441008721
We observed the following in production.
- We observed repeated broker/client disconnects in the same window, and one of the tasks eventually hit an unrecoverable `Connection timed out` error. So the connector was clearly operating under unstable Kafka connectivity at the time.
- Apparently triggered by a network-related condition, we saw two overlapping commit cycles within about 10 seconds. Each cycle sent a `START_COMMIT`, and the workers emitted a `DATA_WRITTEN` event for what appears to be the same physical file path.
```
13:10:00 Sending event of type: START_COMMIT
13:10:00 Commit 667b23e7-431f-4159-ba0d-4baec79d9496 initiated
13:10:01 Sending event of type: DATA_WRITTEN
13:10:02 Commit 667b23e7-431f-4159-ba0d-4baec79d9496 not ready, received responses for 1 of 2 partitions, waiting for more
13:10:08 Sending event of type: START_COMMIT
13:10:08 Commit 5f8a12a1-deee-4710-b397-e0344965a61a initiated
13:10:09 Sending event of type: DATA_WRITTEN
13:10:09 Commit 5f8a12a1-deee-4710-b397-e0344965a61a not ready, received responses for 1 of 2 partitions, waiting for more
13:10:39 Commit 667b23e7-431f-4159-ba0d-4baec79d9496 complete, committed to 1 table(s), valid-through null
13:10:47 Commit 5f8a12a1-deee-4710-b397-e0344965a61a complete, committed to 1 table(s), valid-through null
```
Separately, when we inspect the resulting manifests, the same `file_path` appears under two different snapshots.
So this looks closer to the Case 3 scenario we discussed: a second `START_COMMIT` leading to a new `DATA_WRITTEN` for the same file path, rather than a replay of the same control-topic record.
My question is whether current `main` is expected to dedup this case as well.
- If yes, which layer is responsible for cross-commit file-path deduplication?
- If not, then this seems to be a gap beyond offset validation / stale-event filtering.
Or, more concretely, how should overlapping coordinators avoid producing duplicate `DATA_WRITTEN` events for the same physical file path?
[connect-stg-logs-1310-1345.log](https://github.com/user-attachments/files/27702939/connect-stg-logs-1310-1345.log)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org
Re: [I] Duplicate file path found in Iceberg metadata snapshot [iceberg]
Posted by "kumarpritam863 (via GitHub)" <gi...@apache.org>.
kumarpritam863 commented on issue #13763:
URL: https://github.com/apache/iceberg/issues/13763#issuecomment-4436811811
Hi @tongwai-wong-appier the de-duplication is not only controlled by the control topic offsets commit by the coordinator but also the coordinator puts the control topic offset in the table.
So there are three guarantees that are providing exactly once:
1. Workers commit the file metadata and offset in the same transaction and coordinator uses read_committed to read from the control topic.
2. Iceberg guarantees that now two writers write the same snapshot, even if both of them see the sanpshotId = 100 and try to make it 101, one is bound to fail and retry.
3. Coordinator when commits the data to iceberg, it also puts the control topic offsets as a metadata in the snapshot.
So even if during coordinator switchover after a Kafka timeout: the old coordinator can successfully commit file X, but before the control-topic offset is advanced, if new coordinator re-consume stale DATA_WRITTEN(file X) and try to commit there will be two scenarios:
1. Layer 1 — Offset Validation (Kafka Connect level):
The coordinator attaches a SnapshotAncestryValidator to every append/row-delta operation that checks committed offsets stored in the snapshot summary. If Coordinator A commits first, Coordinator B's validator sees the offsets already advanced and raises a
ValidationException. This is not retried — it's a logical conflict, not a transient failure.
2.Layer 2 — Metadata Version Check (Iceberg Core level):
BaseMetastoreTableOperations.commit() compares the base metadata pointer against the current one. If another commit changed the table metadata, it throws CommitFailedException. This is retried up to 4 times with exponential backoff (100ms → 5s total).
There were some issues with this offset validation which were fixed in these two PR's. Make sure you are using a version which has these changes
https://github.com/apache/iceberg/pull/14525 and https://github.com/apache/iceberg/pull/14510
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org
Re: [I] Duplicate file path found in Iceberg metadata snapshot [iceberg]
Posted by "tongwai-wong-appier (via GitHub)" <gi...@apache.org>.
tongwai-wong-appier commented on issue #13763:
URL: https://github.com/apache/iceberg/issues/13763#issuecomment-4922110838
Following up on my earlier comment and #16282 — this still reproduces, now on **Iceberg 1.11.0** (previously 1.10.1), JDBC catalog + GCS, append-only table. Same symptom (one physical parquet registered in two adjacent snapshots), and this incident gave us more detail on the trigger.
**What we observed**
Two adjacent snapshots (~68s apart), committed by the **same** coordinator task, with an **identical** `kafka.connect.valid-through-ts`:
```
snapshot A commit-id 25210aa1… +47 data files
snapshot B commit-id deb2cf2b… +185 data files
→ 45 file_paths are byte-identical across A and B (~4.6M rows double-counted)
```
Decoding the control topic for that window:
- the 45 duplicated files appear as `DATA_WRITTEN` **exactly once**, under commit-id **A**;
- they do **not** appear under commit-id **B** at all.
So this looks like **coordinator-side re-registration**, not a worker re-sending the file.
We also confirmed the coordinator task never lost leadership and its `iceberg-coord` thread never restarted (continuous consumer client-id). What we did see at that moment was a plain **`-coord` consumer-group rebalance mid commit-cycle** (control-topic partition revoke → re-join → re-add; the group had a second, 0-partition member at the time), followed by ~90 `received … when no commit in progress` log lines for commit-id **A**.
**Our reading of how the replay becomes a duplicate (hypothesis, not fully proven)**
We haven't nailed the exact millisecond ordering, but from the code the following seems consistent with what we saw:
- On re-join, the control consumer resumes from the **last committed offset**; since the in-flight commit hadn't committed yet, that boundary is the *previous* cycle, so the round's events get **replayed**.
- `CommitState.isCommitReady()` sums `assignments().size()` over `readyBuffer` with no dedup / no distinct-partition tracking, so replayed `DATA_COMPLETE` may inflate the count and let the commit fire early (snapshot A) while the round is still being re-delivered.
- The re-delivered tail (`DATA_WRITTEN`) then arrives after that commit ended (`currentCommitId == null`); `addResponse()` buffers it unconditionally and nothing resets `commitBuffer` on the rebalance (the control consumer `subscribe()` has no `ConsumerRebalanceListener`), so those events get swept into the next commit (snapshot B).
If that reading is right, then on top of the non-atomic offset advancement from #16282, there also seems to be an in-cluster asymmetry: a rebalance rewinds the consumer position but does not reset the coordinator's in-memory `CommitState`.
Would appreciate any thoughts on whether this matches your understanding, or points to a different root cause. Happy to share the decoded control-topic events, snapshot manifests, and coordinator logs.
Refs (Iceberg 1.11.0, `org.apache.iceberg.connect.channel`): `CommitState.isCommitReady` / `addReady` / `addResponse`; `Channel.commitConsumerOffsets` + `subscribe`; `Coordinator.commitToTable`.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org