You are viewing a plain text version of this content. The canonical link for it is here.

Posted to github@beam.apache.org by GitBox <gi...@apache.org> on 2022/11/07 21:41:47 UTC

[GitHub] [beam] Abacn commented on pull request #23305: [CdapIO] Add integration tests for SparkReceiverIO

Abacn commented on PR #23305:
URL: https://github.com/apache/beam/pull/23305#issuecomment-1306235934

   Hi, it looks like the new SparkReceiverIO performance test adds a persistent rabbitMQ server to the io-datastore k8s cluster in the test infrastructure. Then both rabbitmq and kafkaIO requests ~1 GB RAM and Kafka workload fails to initialize since Nov 3 (SparkReceiverIO performance test also fails since then).
   
   Can we make rabbitmq server deployment transcient and cleanup in integration test cleanup, as the kafka performance test is doing? If not we should bump the machine type for the k8s cluster. 


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org