You are viewing a plain text version of this content. The canonical link for it is here.
Posted to github@beam.apache.org by GitBox <gi...@apache.org> on 2022/06/05 01:25:22 UTC
[GitHub] [beam] damccorm opened a new issue, #21714: PulsarIOTest.testReadFromSimpleTopic is very flaky
damccorm opened a new issue, #21714:
URL: https://github.com/apache/beam/issues/21714
PulsarIOTest uses shared client across all tests [1], which is a race conditions when multiple tests run in parallel. This manifests as frequent test failures.
[1] https://github.com/apache/beam/blob/master/sdks/java/io/pulsar/src/test/java/org/apache/beam/sdk/io/pulsar/PulsarIOTest.java#L62
Imported from Jira [BEAM-14269](https://issues.apache.org/jira/browse/BEAM-14269). Original Jira may contain additional context.
Reported by: SteveNiemitz.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@beam.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [beam] Abacn commented on issue #21714: PulsarIOTest.testReadFromSimpleTopic is very flaky
Posted by GitBox <gi...@apache.org>.
Abacn commented on issue #21714:
URL: https://github.com/apache/beam/issues/21714#issuecomment-1282792948
> hm from #17473 it seems more complex, huh? we'll see what I can do...
That seems right. It indicates issues for the IO connector itself.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@beam.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [beam] kennknowles commented on issue #21714: PulsarIOTest.testReadFromSimpleTopic is very flaky
Posted by GitBox <gi...@apache.org>.
kennknowles commented on issue #21714:
URL: https://github.com/apache/beam/issues/21714#issuecomment-1312289368
Here another occurrence: https://ci-beam.apache.org/job/beam_PreCommit_Java_Commit/24746/
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@beam.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [beam] pabloem commented on issue #21714: PulsarIOTest.testReadFromSimpleTopic is very flaky
Posted by GitBox <gi...@apache.org>.
pabloem commented on issue #21714:
URL: https://github.com/apache/beam/issues/21714#issuecomment-1282803976
gotcha. thanks @MarcoRob !
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@beam.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [beam] MarcoRob commented on issue #21714: PulsarIOTest.testReadFromSimpleTopic is very flaky
Posted by GitBox <gi...@apache.org>.
MarcoRob commented on issue #21714:
URL: https://github.com/apache/beam/issues/21714#issuecomment-1150120289
Hi @damccorm I am unable to self-assign, can you help me assign this issue to me?
Thanks!
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@beam.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [beam] damccorm commented on issue #21714: PulsarIOTest.testReadFromSimpleTopic is very flaky
Posted by GitBox <gi...@apache.org>.
damccorm commented on issue #21714:
URL: https://github.com/apache/beam/issues/21714#issuecomment-1150149084
Sure! As of https://github.com/apache/beam/pull/21719 you should be able to self assign with the command `.take-issue` though, so you should be able to do that going forward! Let me know if you run into any issues with that
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@beam.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [beam] MarcoRob commented on issue #21714: PulsarIOTest.testReadFromSimpleTopic is very flaky
Posted by GitBox <gi...@apache.org>.
MarcoRob commented on issue #21714:
URL: https://github.com/apache/beam/issues/21714#issuecomment-1282800840
> @MarcoRob are you working on this?
Hi @pabloem
Yes I am working on it, just right now I am working on the migration of Github Actions (GA)
I consulted with Pulsar community and seems like the issue comes from the function that `seeks(timestamp)` the message from a timestamp it fails sometimes in retrieving the right message with the correct timestamp, so they advice me to use `seek(MessageId)` instead. So I am working on changing the function, but right now I paused this while GA I finished the migration.
You can see I got some inputs on that issue in this [PR-17473](https://github.com/apache/beam/pull/17473)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@beam.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [beam] kennknowles commented on issue #21714: PulsarIOTest.testReadFromSimpleTopic is very flaky
Posted by "kennknowles (via GitHub)" <gi...@apache.org>.
kennknowles commented on issue #21714:
URL: https://github.com/apache/beam/issues/21714#issuecomment-1526084923
I'm going to unassign this for now, then. Feel free to comment or grab it again.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@beam.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [beam] Abacn commented on issue #21714: PulsarIOTest.testReadFromSimpleTopic is very flaky
Posted by GitBox <gi...@apache.org>.
Abacn commented on issue #21714:
URL: https://github.com/apache/beam/issues/21714#issuecomment-1282785180
@pabloem There was a draft PR #17473 seems not having updates for a while.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@beam.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [beam] apilloud commented on issue #21714: PulsarIOTest.testReadFromSimpleTopic is very flaky
Posted by GitBox <gi...@apache.org>.
apilloud commented on issue #21714:
URL: https://github.com/apache/beam/issues/21714#issuecomment-1329871074
Still happening: https://ci-beam.apache.org/job/beam_PreCommit_Java_Phrase/5782/consoleFull
```
14:56:31 > Task :sdks:java:io:pulsar:test
14:56:31
14:56:31 org.apache.beam.sdk.io.pulsar.PulsarIOTest > testReadFromSimpleTopic FAILED
14:56:31 org.apache.beam.sdk.Pipeline$PipelineExecutionException at PulsarIOTest.java:178
14:56:31 Caused by: java.lang.IllegalArgumentException at Preconditions.java:440
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@beam.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [beam] pabloem commented on issue #21714: PulsarIOTest.testReadFromSimpleTopic is very flaky
Posted by GitBox <gi...@apache.org>.
pabloem commented on issue #21714:
URL: https://github.com/apache/beam/issues/21714#issuecomment-1282791143
hm from #17473 it seems more complex, huh? we'll see what I can do...
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@beam.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [beam] pabloem commented on issue #21714: PulsarIOTest.testReadFromSimpleTopic is very flaky
Posted by GitBox <gi...@apache.org>.
pabloem commented on issue #21714:
URL: https://github.com/apache/beam/issues/21714#issuecomment-1282767630
@MarcoRob are you working on this?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@beam.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [beam] damccorm commented on issue #21714: PulsarIOTest.testReadFromSimpleTopic is very flaky
Posted by GitBox <gi...@apache.org>.
damccorm commented on issue #21714:
URL: https://github.com/apache/beam/issues/21714#issuecomment-1146718677
Unable to assign user @MarcoRob. If able, self-assign, otherwise tag @damccorm so that he can assign you. Because of GitHub's spam prevention system, your activity is required to enable assignment in this repo.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@beam.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [beam] kennknowles commented on issue #21714: PulsarIOTest.testReadFromSimpleTopic is very flaky
Posted by "kennknowles (via GitHub)" <gi...@apache.org>.
kennknowles commented on issue #21714:
URL: https://github.com/apache/beam/issues/21714#issuecomment-1428719862
@MarcoRob are you no longer working on this?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@beam.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org