You are viewing a plain text version of this content. The canonical link for it is here.

Posted to github@beam.apache.org by GitBox <gi...@apache.org> on 2023/01/08 22:52:26 UTC

[GitHub] [beam] Abacn commented on issue #22303: [Task]: Add tests to Kafka SDF and fix known and discovered issues

Abacn commented on issue #22303:
URL: https://github.com/apache/beam/issues/22303#issuecomment-1374949407

   Apparently Kafka performance test is failing again after #24879 in. This is because we removed `shuffle=appliance` there and then read from shuffle becomes faster. There are some reports that runner v2 is putting more pressure on kafka, and resulting in higher error rate. Now kafka server is overwhelmed with write requests and making write pipeline fail.
   
   This reveals real issue of the code.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org