[GitHub] [streampipes] tenthe added a comment to the discussion: Automatically validating version updates in the release process

[GitBox <gi...@apache.org>]

GitHub user tenthe added a comment to the discussion: Automatically validating version updates in the release process


> I guess this is sometimes hard to achieve, but it's definetely a great aim which I'd like to follow. Daily tests would also provide direct feedback to applied changes and we can tackle them immediately. If we only run these tests as part of the release process, e.g., we might need to fix a lot of issues at once and it might get very complex.

I totally agree, I am not sure if it will be possible, but I think we should try to achieve this. 
We can also start with a small step into this direction.

> Well this sounds reasonable, could be realized as a GitHub workflow But is it that easy as it sounds?

I think that should be possible. If you look at the nightly cypress validation action [1]. There we start StreamPipes with the command `docker-compose up --build -d`.

Now the workflow for the new validation could look something like this:
1. Start old StreamPipes version with `docker-compose up` (use last Release version)
2. Trigger Cypress tests to setup some StreamPipes resources
3. Stop StreamPipes (`docker-compose down`)
4. Start latest StreamPipes version with `docker-compose up --build -d`
5. Trigger cypress tests to validate all resources are still there and functional.

I'd suggest that we do this in two steps. First, we need to implement the cypress tests. Therefore, we can use a similar setup as in [2]. Once the tests work we run them in an action.

[1] https://github.com/apache/streampipes/blob/dev/.github/workflows/cypress-test.yml
[2] https://github.com/apache/streampipes/tree/dev/ui/cypress/tests/experimental


GitHub link: https://github.com/apache/streampipes/discussions/1193#discussioncomment-4850462

----
This is an automatically sent email for dev@streampipes.apache.org.
To unsubscribe, please send an email to: dev-unsubscribe@streampipes.apache.org