You are viewing a plain text version of this content. The canonical link for it is here.
Posted to github@beam.apache.org by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/08/01 10:10:19 UTC
[I] The IcebergIO Managed Integration Tests on Dataflow job is flaky [beam]
github-actions[bot] opened a new issue, #34809:
URL: https://github.com/apache/beam/issues/34809
The IcebergIO Managed Integration Tests on Dataflow is failing over 50% of the time.
Please visit https://github.com/apache/beam/actions/workflows/IO_Iceberg_Managed_Integration_Tests_Dataflow.yml?query=is%3Afailure+branch%3Amaster to see all failed workflow runs.
See also Grafana statistics: http://metrics.beam.apache.org/d/CTYdoxP4z/ga-post-commits-status?orgId=1&viewPanel=11&var-Workflow=IcebergIO%20Managed%20Integration%20Tests%20on%20Dataflow
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@beam.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] The IcebergIO Managed Integration Tests on Dataflow job is flaky [beam]
Posted by "ahmedabu98 (via GitHub)" <gi...@apache.org>.
ahmedabu98 commented on issue #34809:
URL: https://github.com/apache/beam/issues/34809#issuecomment-5163061397
Correct it's due to #39344. Normal Dataflow tests are passing normally: https://github.com/apache/beam/actions/workflows/IO_Iceberg_Integration_Tests_Dataflow.yml
Managed Dataflow tests are failing because the internal Managed image still hasn't updated to include the new Timestamp proto change. @chamikaramj do we need to update the Managed image manually?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@beam.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] The IcebergIO Managed Integration Tests on Dataflow job is flaky [beam]
Posted by "Abacn (via GitHub)" <gi...@apache.org>.
Abacn closed issue #34809: The IcebergIO Managed Integration Tests on Dataflow job is flaky
URL: https://github.com/apache/beam/issues/34809
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@beam.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] The IcebergIO Managed Integration Tests on Dataflow job is flaky [beam]
Posted by "aIbrahiim (via GitHub)" <gi...@apache.org>.
aIbrahiim commented on issue #34809:
URL: https://github.com/apache/beam/issues/34809#issuecomment-4229289383
I think the changes in this commit https://github.com/apache/beam/commit/c1e44fb0258 probably causes this job flakiness as it makes SqlTypes.DATE depend more heavily on correct schema portable round trip, any runner path that still normalizes that field to bare INT64 (while values stay epoch-day longs) can surface as Iceberg tables created with long instead of date, which then fails schema assertions that expect SqlTypes.DATE when reading the table back @ahmedabu98
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@beam.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] The IcebergIO Managed Integration Tests on Dataflow job is flaky [beam]
Posted by "Amar3tto (via GitHub)" <gi...@apache.org>.
Amar3tto commented on issue #34809:
URL: https://github.com/apache/beam/issues/34809#issuecomment-5201242710
@chamikaramj PTAL
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@beam.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] The IcebergIO Managed Integration Tests on Dataflow job is flaky [beam]
Posted by "Amar3tto (via GitHub)" <gi...@apache.org>.
Amar3tto commented on issue #34809:
URL: https://github.com/apache/beam/issues/34809#issuecomment-5709432161
Stabilized
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@beam.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] The IcebergIO Managed Integration Tests on Dataflow job is flaky [beam]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on issue #34809:
URL: https://github.com/apache/beam/issues/34809#issuecomment-4533748331
Reopening since the workflow is still flaky
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@beam.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] The IcebergIO Managed Integration Tests on Dataflow job is flaky [beam]
Posted by "ahmedabu98 (via GitHub)" <gi...@apache.org>.
ahmedabu98 commented on issue #34809:
URL: https://github.com/apache/beam/issues/34809#issuecomment-4247603962
Thanks @aIbrahiim, seems like it's indeed due to #38077.
I ran it on a snapshot version of Google's internal Dataflow Managed service and it passed just fine. This test will continue failing until 2.73.0 gets released and Dataflow Managed service bumps to 2.73.0
cc @chamikaramj
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@beam.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] The IcebergIO Managed Integration Tests on Dataflow job is flaky [beam]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on issue #34809:
URL: https://github.com/apache/beam/issues/34809#issuecomment-5150968031
Reopening since the workflow is still flaky
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@beam.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] The IcebergIO Managed Integration Tests on Dataflow job is flaky [beam]
Posted by "Amar3tto (via GitHub)" <gi...@apache.org>.
Amar3tto commented on issue #34809:
URL: https://github.com/apache/beam/issues/34809#issuecomment-5526342186
@ahmedabu98 Are we good to proceed with this?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@beam.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] The IcebergIO Managed Integration Tests on Dataflow job is flaky [beam]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on issue #34809:
URL: https://github.com/apache/beam/issues/34809#issuecomment-4200414837
Reopening since the workflow is still flaky
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@beam.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] The IcebergIO Managed Integration Tests on Dataflow job is flaky [beam]
Posted by "Amar3tto (via GitHub)" <gi...@apache.org>.
Amar3tto closed issue #34809: The IcebergIO Managed Integration Tests on Dataflow job is flaky
URL: https://github.com/apache/beam/issues/34809
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@beam.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] The IcebergIO Managed Integration Tests on Dataflow job is flaky [beam]
Posted by "Amar3tto (via GitHub)" <gi...@apache.org>.
Amar3tto closed issue #34809: The IcebergIO Managed Integration Tests on Dataflow job is flaky
URL: https://github.com/apache/beam/issues/34809
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@beam.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] The IcebergIO Managed Integration Tests on Dataflow job is flaky [beam]
Posted by "Amar3tto (via GitHub)" <gi...@apache.org>.
Amar3tto commented on issue #34809:
URL: https://github.com/apache/beam/issues/34809#issuecomment-4395974348
Stabilized
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@beam.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] The IcebergIO Managed Integration Tests on Dataflow job is flaky [beam]
Posted by "Amar3tto (via GitHub)" <gi...@apache.org>.
Amar3tto commented on issue #34809:
URL: https://github.com/apache/beam/issues/34809#issuecomment-2939347488
Job has been stable for 2 days. Closing as resolved.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@beam.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] The IcebergIO Managed Integration Tests on Dataflow job is flaky [beam]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on issue #34809:
URL: https://github.com/apache/beam/issues/34809#issuecomment-6277953540
Reopening since the workflow is still flaky
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@beam.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] The IcebergIO Managed Integration Tests on Dataflow job is flaky [beam]
Posted by "Amar3tto (via GitHub)" <gi...@apache.org>.
Amar3tto commented on issue #34809:
URL: https://github.com/apache/beam/issues/34809#issuecomment-4389352779
> Thanks [@aIbrahiim](https://github.com/aIbrahiim), seems like it's indeed due to [#38077](https://github.com/apache/beam/pull/38077).
>
> I ran it on a snapshot version of Google's internal Dataflow Managed service and it passed just fine. This test will continue failing until 2.73.0 gets released and Dataflow Managed service bumps to 2.73.0
>
> cc [@chamikaramj](https://github.com/chamikaramj)
Could you please check
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@beam.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] The IcebergIO Managed Integration Tests on Dataflow job is flaky [beam]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on issue #34809:
URL: https://github.com/apache/beam/issues/34809#issuecomment-4447628793
Reopening since the workflow is still flaky
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@beam.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] The IcebergIO Managed Integration Tests on Dataflow job is flaky [beam]
Posted by "Abacn (via GitHub)" <gi...@apache.org>.
Abacn closed issue #34809: The IcebergIO Managed Integration Tests on Dataflow job is flaky
URL: https://github.com/apache/beam/issues/34809
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@beam.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] The IcebergIO Managed Integration Tests on Dataflow job is flaky [beam]
Posted by "chamikaramj (via GitHub)" <gi...@apache.org>.
chamikaramj commented on issue #34809:
URL: https://github.com/apache/beam/issues/34809#issuecomment-5207477840
Thanks @Amar3tto.
@ahmedabu98 is looking into updating release notes for this. I don't think the release tasks should be blocked by this.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@beam.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] The IcebergIO Managed Integration Tests on Dataflow job is flaky [beam]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on issue #34809:
URL: https://github.com/apache/beam/issues/34809#issuecomment-3730159742
Reopening since the workflow is still flaky
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@beam.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] The IcebergIO Managed Integration Tests on Dataflow job is flaky [beam]
Posted by "Amar3tto (via GitHub)" <gi...@apache.org>.
Amar3tto commented on issue #34809:
URL: https://github.com/apache/beam/issues/34809#issuecomment-3765601002
Stabilized
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@beam.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] The IcebergIO Managed Integration Tests on Dataflow job is flaky [beam]
Posted by "Amar3tto (via GitHub)" <gi...@apache.org>.
Amar3tto commented on issue #34809:
URL: https://github.com/apache/beam/issues/34809#issuecomment-4228916477
@ahmedabu98 ptal
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@beam.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] The IcebergIO Managed Integration Tests on Dataflow job is flaky [beam]
Posted by "Amar3tto (via GitHub)" <gi...@apache.org>.
Amar3tto closed issue #34809: The IcebergIO Managed Integration Tests on Dataflow job is flaky
URL: https://github.com/apache/beam/issues/34809
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@beam.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] The IcebergIO Managed Integration Tests on Dataflow job is flaky [beam]
Posted by "aIbrahiim (via GitHub)" <gi...@apache.org>.
aIbrahiim commented on issue #34809:
URL: https://github.com/apache/beam/issues/34809#issuecomment-5156471636
Hi @ahmedabu98 while looking at the failing logs of this issue, it seems related to #39344.
What I see
The Dataflow managed Iceberg ITs started failing.
Direct runner Iceberg ITs still look fine and the failure shows up on Dataflow.
In testWrite, after the job finishes, the table schema does not match the Beam schema:
> expected: datetime_tz as beam:logical_type:timestamp:v1
> actual: datetime_tz as a plain ROW with seconds / subseconds
That suggests the Iceberg table was created with a struct, not timestamptz.
In testRead / related jobs, workers fail with:
> ClassCastException: org.joda.time.Instant cannot be cast to java.time.Instant
> at Timestamp.toBaseType
Probably why this happening is because of :
- On Dataflow/portable pipelines, Timestamp can show up as UnknownLogicalType (a PassThroughLogicalType)
- In IcebergUtils.beamFieldTypeToIcebergFieldType, PassThrough is handled before the Timestamp URN. If that path is taken, the Row base type is used, which becomes an Iceberg struct instead of timestamptz
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@beam.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] The IcebergIO Managed Integration Tests on Dataflow job is flaky [beam]
Posted by "Amar3tto (via GitHub)" <gi...@apache.org>.
Amar3tto closed issue #34809: The IcebergIO Managed Integration Tests on Dataflow job is flaky
URL: https://github.com/apache/beam/issues/34809
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@beam.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] The IcebergIO Managed Integration Tests on Dataflow job is flaky [beam]
Posted by "Amar3tto (via GitHub)" <gi...@apache.org>.
Amar3tto commented on issue #34809:
URL: https://github.com/apache/beam/issues/34809#issuecomment-2847064168
Job has been stable for 1 day. Closing as resolved.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@beam.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] The IcebergIO Managed Integration Tests on Dataflow job is flaky [beam]
Posted by "Amar3tto (via GitHub)" <gi...@apache.org>.
Amar3tto closed issue #34809: The IcebergIO Managed Integration Tests on Dataflow job is flaky
URL: https://github.com/apache/beam/issues/34809
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@beam.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] The IcebergIO Managed Integration Tests on Dataflow job is flaky [beam]
Posted by "ahmedabu98 (via GitHub)" <gi...@apache.org>.
ahmedabu98 closed issue #34809: The IcebergIO Managed Integration Tests on Dataflow job is flaky
URL: https://github.com/apache/beam/issues/34809
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@beam.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org