Re: Plugin CI: Updates to OS/versions

[Jan Piotrowski <pi...@gmail.com>]

The work on https://github.com/apache/cordova-paramedic continued and
we settled on a set of OS/version combinations to test.
I rewrote the script so that is can be mostly just copied over to the
plugins, making it unnecessary to maintain different versions for
paramedic and the plugins.

The first repository where this was rolled out as release preparation was:
https://github.com/apache/cordova-plugin-splashscreen
That release is currently in vote.

Today I rolled out the new paramedic travis.yml to the remaining plugins.


These plugins all pass:

https://github.com/apache/cordova-plugin-vibration/pull/80
https://github.com/apache/cordova-plugin-battery-status/pull/75
https://github.com/apache/cordova-plugin-device/pull/97
https://github.com/apache/cordova-plugin-dialogs/pull/127
https://github.com/apache/cordova-plugin-network-information/pull/89
https://github.com/apache/cordova-plugin-screen-orientation/pull/47
https://github.com/apache/cordova-plugin-statusbar/pull/139
https://github.com/apache/cordova-plugin-media-capture/pull/134

Please review the PRs so these can be merged.


Unfortunately the remaining plugins do not pass CI right now:

https://github.com/apache/cordova-plugin-inappbrowser/pull/478
iOS 12 and 12.2 fail when running tests on SauceLabs: "Remote debugger
error with code '-32601': 'Page' domain was not found"
(Probably something to do with the webview of InAppBrowser not being accessible)
Problem is tracked at https://github.com/apache/cordova-paramedic/issues/149

https://github.com/apache/cordova-plugin-file/pull/314
Chrome and iOS 11.3 and 12 fail, with some individual test failures.
(All 3 platforms were not tested before)

https://github.com/apache/cordova-plugin-geolocation/pull/154
Fails in Firefox, Safari and Edge - and local iOS 10 and browser with
individual failures.
(All platform were not tested before)

https://github.com/apache/cordova-plugin-media/pull/227
Local iOS 10 and browser fail (both was not tested before)

https://github.com/apache/cordova-plugin-camera/pull/455
Local iOS 10 fails - this might be a bug in paramedic that is tracked
in https://github.com/apache/cordova-paramedic/issues/142
All iOS and Android Appium tests fail. First investigation at
https://github.com/apache/cordova-paramedic/issues/145
This is one of only 2 plugins that have Appium tests (the other is
deprecated contacts plugin), so clearly something is wrong with Appium
tests.

https://github.com/apache/cordova-plugin-wkwebview-engine/pull/93
Local iOS 10 and normal iOS 12.2 tests are failing for different
reasons (iOS 12.2 is similar to InAppBrowser plugin mentioned above)

For all these, we will have to investigate and fix - or remove the CI
builds where appropriate (e.g. testing on browsers where the Browser
platform is not even supported).


I am still quite happy with the success rate, 9 success vs. 6 fail is
better than I expected.

Best,
Jan


Am Mi., 24. Apr. 2019 um 17:27 Uhr schrieb Jan Piotrowski
<pi...@gmail.com>:
>
> We (@erisu and me) now got this working for paramedic on all the
> mentioned platforms, and have a green build again:
> https://github.com/apache/cordova-paramedic
>
> First adaptations to plugin repos can be seen here:
> https://github.com/apache/cordova-plugin-inappbrowser/pull/465 (@erisu)
> https://github.com/apache/cordova-plugin-vibration/pull/76 (@timbru31)
>
> If you have any feedback, _now_ is the time to give it before be
> continue with this.
>
> (I got a private inquiry why we did not add Android 9.0 to the list of
> platforms. Unfortunately SauceLabs does not support Android 9 yet)
>
> -J
>
> Am Mo., 15. Apr. 2019 um 14:08 Uhr schrieb Jan Piotrowski
> <pi...@gmail.com>:
> >
> > Hi,
> >
> > in the last few days I have been working on fixing and updating the CI
> > configuration of our plugins, so they actually work with Cordova CLI 9
> > and are tested on all relevant OS versions via SauceLabs.
> >
> > You might know that our plugin tests are run via cordova-paramedic,
> > which means that the CI configuration of our plugins are actually just
> > copies of the CI configuration of paramedic itself - so that is where
> > we started - updating Paramedic's CI configuration.
> >
> > This is where we ended up:
> > (OS/version that were already tested are marked with *)
> >
> > iOS 10.0 *
> > iOS 11.3
> > iOS 12.0
> > iOS 12.2
> >
> > Android 4.4
> > Android 5.1
> > Android 6.0,
> > Android 7.0 *
> > Android 7.1
> > Android 8.0
> > Android 8.1
> >
> > Chrome *
> > Safari
> > Firefox
> > Edge
> >
> > Any relevant OS/versions missing?
> > Any OS/version not useful to test on?
> >
> > Along the way I rewrote the .travis.yml to hopefully be a lot more
> > maintainable by moving all version stuff (Android SDK and tools...) to
> > the top. Tim Brust helped me to fix a bug in Paramedic that popped up
> > with newer iOS versions.
> >
> > Best,
> > Jan

---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@cordova.apache.org
For additional commands, e-mail: dev-help@cordova.apache.org