You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@cordova.apache.org by Filip Maj <ma...@gmail.com> on 2017/01/05 21:01:04 UTC
Platform Version support/coverage
Hi!
TL;DR: what OS versions should we be running our tests on? What
versions should we be testing against in our CI?
Recently, I received an email from Sauce Labs, letting me know that
support for test runs on Android 4.3 and below has officially ended.
This reminded me that our current Android CI in cloudapp (which uses
Sauce Labs) tests against Android 4.4 and 5.1, so we are starting to
cut it pretty close with which versions of Android we are testing
against.
In general, I wanted to start a discussion around what OS versions of
our platforms we intend to support, and which ones we would want CI
coverage on?
I think we probably want to have some test coverage on newer versions
of Android than 5.1. Unfortunately, at this time Sauce Labs does not
have support for Android 6 (let alone 7!), so our hands are tied there
until Sauce catches up a bit.
On iOS, cloudapp currently tests against iOS 9.3. Sauce Labs _does_
have support for iOS 10, though, so we could update our CI to get that
coverage if we wanted.
Our CI also includes coverage for "Windows 10 Store", which, based on
some CI output [1], runs on the following environment:
Windows OS: installed Windows 10
MSBuild Tools: installed 12.0
Visual Studio: installed 14.0
Windows SDK: installed 8.1
Windows Phone SDK: installed 8.1
What do y'all think?
[1] http://cordova-ci.cloudapp.net:8080/view/Pull%20requests/job/cordova-plugin-camera-pr/115/PLATFORM=windows-10-store/console
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@cordova.apache.org
For additional commands, e-mail: dev-help@cordova.apache.org
Re: Platform Version support/coverage
Posted by Filip Maj <ma...@gmail.com>.
Awesome Alex!
I think we might need to do some ironing of some of the tests. iOS 10
forces a move to a newer UI automation framework (XCUITest) as opposed
to the one that's been in place until iOS 9.3 (UIAutomation). I have
made some tweaks to the Appium tests to support both, but it wouldn't
surprise me if we possibly hit some other snags.
Let me know how it goes and if I can assist with anything.
On Mon, Jan 9, 2017 at 4:36 AM, Alexander Sorokin (Akvelon)
<v-...@microsoft.com> wrote:
> I say let's do this!
>
> Going to add the iOS 10 builds this week. Will keep you informed.
>
> -----Original Message-----
> From: Filip Maj [mailto:maj.fil@gmail.com]
> Sent: Friday, January 6, 2017 2:19 AM
> To: dev@cordova.apache.org
> Subject: Re: Platform Version support/coverage
>
> Thanks Shaz. If we want to make that happen, then I think that Alex will need to tweak our cloudapp jenkins instance to run the ios tests against both iOS 9.3 and 10. Shouldn't be too difficult, as Alex already has the dual-OS-version setup in place for Android (which is how we test both 4.4 and 5.1 currently).
>
> What say you, Alex?
>
> On Thu, Jan 5, 2017 at 2:58 PM, Shazron <sh...@gmail.com> wrote:
>> For iOS, we usually test on the current iOS version and the one
>> previous, so that would be iOS 10 and iOS 9. It follows what
>> cordova-ios currently supports, which with cordova-ios@4.4.0 we would
>> increase the minimum deployment target to iOS 9 (previously discussed in a thread in this list).
>>
>> On Thu, Jan 5, 2017 at 1:01 PM, Filip Maj <ma...@gmail.com> wrote:
>>
>>> Hi!
>>>
>>> TL;DR: what OS versions should we be running our tests on? What
>>> versions should we be testing against in our CI?
>>>
>>> Recently, I received an email from Sauce Labs, letting me know that
>>> support for test runs on Android 4.3 and below has officially ended.
>>> This reminded me that our current Android CI in cloudapp (which uses
>>> Sauce Labs) tests against Android 4.4 and 5.1, so we are starting to
>>> cut it pretty close with which versions of Android we are testing
>>> against.
>>>
>>> In general, I wanted to start a discussion around what OS versions of
>>> our platforms we intend to support, and which ones we would want CI
>>> coverage on?
>>>
>>> I think we probably want to have some test coverage on newer versions
>>> of Android than 5.1. Unfortunately, at this time Sauce Labs does not
>>> have support for Android 6 (let alone 7!), so our hands are tied
>>> there until Sauce catches up a bit.
>>>
>>> On iOS, cloudapp currently tests against iOS 9.3. Sauce Labs _does_
>>> have support for iOS 10, though, so we could update our CI to get
>>> that coverage if we wanted.
>>>
>>> Our CI also includes coverage for "Windows 10 Store", which, based on
>>> some CI output [1], runs on the following environment:
>>>
>>> Windows OS: installed Windows 10
>>> MSBuild Tools: installed 12.0
>>> Visual Studio: installed 14.0
>>> Windows SDK: installed 8.1
>>> Windows Phone SDK: installed 8.1
>>>
>>> What do y'all think?
>>>
>>> [1]
>>> https://na01.safelinks.protection.outlook.com/?url=http%3A%2F%2Fcordo
>>> va-ci.cloudapp.net%3A8080%2Fview%2FPull%2520requests%2F&data=02%7C01%
>>> 7Cv-alsoro%40microsoft.com%7C846b538123ff473a856208d435c14103%7C72f98
>>> 8bf86f141af91ab2d7cd011db47%7C1%7C0%7C636192551514435865&sdata=RFQsHn
>>> %2BnbajwIq6oSEfMa9Bf7mjodpl3C07HOjC%2B5R8%3D&reserved=0
>>> job/cordova-plugin-camera-pr/115/PLATFORM=windows-10-store/console
>>>
>>> ---------------------------------------------------------------------
>>> To unsubscribe, e-mail: dev-unsubscribe@cordova.apache.org
>>> For additional commands, e-mail: dev-help@cordova.apache.org
>>>
>>>
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: dev-unsubscribe@cordova.apache.org
> For additional commands, e-mail: dev-help@cordova.apache.org
>
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@cordova.apache.org
For additional commands, e-mail: dev-help@cordova.apache.org
RE: Platform Version support/coverage
Posted by "Alexander Sorokin (Akvelon)" <v-...@microsoft.com>.
Per-PR Jobs run time should increase by ~5 minutes, periodic job run time is expected to increase by ~1.5 hours.
-----Original Message-----
From: Filip Maj [mailto:maj.fil@gmail.com]
Sent: Sunday, January 22, 2017 3:58 AM
To: dev@cordova.apache.org
Subject: Re: Platform Version support/coverage
Awesome!!! Thanks so much for setting that up Alex.
Any idea on the impact this had on our test suite run times?
Now we wait for when Sauce Labs lands support for Android 6...
On Fri, Jan 20, 2017 at 8:42 AM, Alexander Sorokin (Akvelon) <v-...@microsoft.com> wrote:
> Hey guys,
>
> iOS 10 builds for periodic and per-PR jobs are up and running on Jenkins.
> I had some trouble with permission dialogs busting, but now everything seems to be in order.
> Woo!
>
> https://na01.safelinks.protection.outlook.com/?url=http%3A%2F%2Fcordov
> a-ci.cloudapp.net%3A8080%2Fview%2FPeriodic%2520builds%2Fjob%2Fcordova-
> periodic-build%2F293%2F&data=02%7C01%7Cv-alsoro%40microsoft.com%7C7319
> 59a22d084bc8716508d44261d602%7C72f988bf86f141af91ab2d7cd011db47%7C1%7C
> 0%7C636206435367621007&sdata=8dvLFbZKa4OGDCrUji%2BfOi3z5siT2PNOO5ao325
> f%2F90%3D&reserved=0
>
> --Alex
>
> -----Original Message-----
> From: Alexander Sorokin (Akvelon) [mailto:v-alsoro@microsoft.com]
> Sent: Monday, January 9, 2017 1:36 PM
> To: dev@cordova.apache.org
> Subject: RE: Platform Version support/coverage
>
> I say let's do this!
>
> Going to add the iOS 10 builds this week. Will keep you informed.
>
> -----Original Message-----
> From: Filip Maj [mailto:maj.fil@gmail.com]
> Sent: Friday, January 6, 2017 2:19 AM
> To: dev@cordova.apache.org
> Subject: Re: Platform Version support/coverage
>
> Thanks Shaz. If we want to make that happen, then I think that Alex will need to tweak our cloudapp jenkins instance to run the ios tests against both iOS 9.3 and 10. Shouldn't be too difficult, as Alex already has the dual-OS-version setup in place for Android (which is how we test both 4.4 and 5.1 currently).
>
> What say you, Alex?
>
> On Thu, Jan 5, 2017 at 2:58 PM, Shazron <sh...@gmail.com> wrote:
>> For iOS, we usually test on the current iOS version and the one
>> previous, so that would be iOS 10 and iOS 9. It follows what
>> cordova-ios currently supports, which with cordova-ios@4.4.0 we would
>> increase the minimum deployment target to iOS 9 (previously discussed in a thread in this list).
>>
>> On Thu, Jan 5, 2017 at 1:01 PM, Filip Maj <ma...@gmail.com> wrote:
>>
>>> Hi!
>>>
>>> TL;DR: what OS versions should we be running our tests on? What
>>> versions should we be testing against in our CI?
>>>
>>> Recently, I received an email from Sauce Labs, letting me know that
>>> support for test runs on Android 4.3 and below has officially ended.
>>> This reminded me that our current Android CI in cloudapp (which uses
>>> Sauce Labs) tests against Android 4.4 and 5.1, so we are starting to
>>> cut it pretty close with which versions of Android we are testing
>>> against.
>>>
>>> In general, I wanted to start a discussion around what OS versions
>>> of our platforms we intend to support, and which ones we would want
>>> CI coverage on?
>>>
>>> I think we probably want to have some test coverage on newer
>>> versions of Android than 5.1. Unfortunately, at this time Sauce Labs
>>> does not have support for Android 6 (let alone 7!), so our hands are
>>> tied there until Sauce catches up a bit.
>>>
>>> On iOS, cloudapp currently tests against iOS 9.3. Sauce Labs _does_
>>> have support for iOS 10, though, so we could update our CI to get
>>> that coverage if we wanted.
>>>
>>> Our CI also includes coverage for "Windows 10 Store", which, based
>>> on some CI output [1], runs on the following environment:
>>>
>>> Windows OS: installed Windows 10
>>> MSBuild Tools: installed 12.0
>>> Visual Studio: installed 14.0
>>> Windows SDK: installed 8.1
>>> Windows Phone SDK: installed 8.1
>>>
>>> What do y'all think?
>>>
>>> [1]
>>> https://na01.safelinks.protection.outlook.com/?url=http%3A%2F%2Fcord
>>> o
>>> va-ci.cloudapp.net%3A8080%2Fview%2FPull%2520requests%2F&data=02%7C01
>>> %
>>> 7Cv-alsoro%40microsoft.com%7C846b538123ff473a856208d435c14103%7C72f9
>>> 8
>>> 8bf86f141af91ab2d7cd011db47%7C1%7C0%7C636192551514435865&sdata=RFQsH
>>> n
>>> %2BnbajwIq6oSEfMa9Bf7mjodpl3C07HOjC%2B5R8%3D&reserved=0
>>> job/cordova-plugin-camera-pr/115/PLATFORM=windows-10-store/console
>>>
>>> --------------------------------------------------------------------
>>> - To unsubscribe, e-mail: dev-unsubscribe@cordova.apache.org
>>> For additional commands, e-mail: dev-help@cordova.apache.org
>>>
>>>
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: dev-unsubscribe@cordova.apache.org
> For additional commands, e-mail: dev-help@cordova.apache.org
>
> B KKKKKKKKKKKKKKKKKKKKKKKKKKKKKKKKKKKKKKKKKKKKKKKKKKKKKKKKKKKKKKKKKKKKCB [ X ܚX K K[XZ[
> ] ][ X ܚX P ܙ ݘK \ X K ܙ B ܈ Y ] [ۘ[ [X[ K[XZ[
> ] Z [ ܙ ݘK \ X K ܙ B
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@cordova.apache.org
For additional commands, e-mail: dev-help@cordova.apache.org
Re: Platform Version support/coverage
Posted by Filip Maj <ma...@gmail.com>.
Awesome!!! Thanks so much for setting that up Alex.
Any idea on the impact this had on our test suite run times?
Now we wait for when Sauce Labs lands support for Android 6...
On Fri, Jan 20, 2017 at 8:42 AM, Alexander Sorokin (Akvelon)
<v-...@microsoft.com> wrote:
> Hey guys,
>
> iOS 10 builds for periodic and per-PR jobs are up and running on Jenkins.
> I had some trouble with permission dialogs busting, but now everything seems to be in order.
> Woo!
>
> http://cordova-ci.cloudapp.net:8080/view/Periodic%20builds/job/cordova-periodic-build/293/
>
> --Alex
>
> -----Original Message-----
> From: Alexander Sorokin (Akvelon) [mailto:v-alsoro@microsoft.com]
> Sent: Monday, January 9, 2017 1:36 PM
> To: dev@cordova.apache.org
> Subject: RE: Platform Version support/coverage
>
> I say let's do this!
>
> Going to add the iOS 10 builds this week. Will keep you informed.
>
> -----Original Message-----
> From: Filip Maj [mailto:maj.fil@gmail.com]
> Sent: Friday, January 6, 2017 2:19 AM
> To: dev@cordova.apache.org
> Subject: Re: Platform Version support/coverage
>
> Thanks Shaz. If we want to make that happen, then I think that Alex will need to tweak our cloudapp jenkins instance to run the ios tests against both iOS 9.3 and 10. Shouldn't be too difficult, as Alex already has the dual-OS-version setup in place for Android (which is how we test both 4.4 and 5.1 currently).
>
> What say you, Alex?
>
> On Thu, Jan 5, 2017 at 2:58 PM, Shazron <sh...@gmail.com> wrote:
>> For iOS, we usually test on the current iOS version and the one
>> previous, so that would be iOS 10 and iOS 9. It follows what
>> cordova-ios currently supports, which with cordova-ios@4.4.0 we would
>> increase the minimum deployment target to iOS 9 (previously discussed in a thread in this list).
>>
>> On Thu, Jan 5, 2017 at 1:01 PM, Filip Maj <ma...@gmail.com> wrote:
>>
>>> Hi!
>>>
>>> TL;DR: what OS versions should we be running our tests on? What
>>> versions should we be testing against in our CI?
>>>
>>> Recently, I received an email from Sauce Labs, letting me know that
>>> support for test runs on Android 4.3 and below has officially ended.
>>> This reminded me that our current Android CI in cloudapp (which uses
>>> Sauce Labs) tests against Android 4.4 and 5.1, so we are starting to
>>> cut it pretty close with which versions of Android we are testing
>>> against.
>>>
>>> In general, I wanted to start a discussion around what OS versions of
>>> our platforms we intend to support, and which ones we would want CI
>>> coverage on?
>>>
>>> I think we probably want to have some test coverage on newer versions
>>> of Android than 5.1. Unfortunately, at this time Sauce Labs does not
>>> have support for Android 6 (let alone 7!), so our hands are tied
>>> there until Sauce catches up a bit.
>>>
>>> On iOS, cloudapp currently tests against iOS 9.3. Sauce Labs _does_
>>> have support for iOS 10, though, so we could update our CI to get
>>> that coverage if we wanted.
>>>
>>> Our CI also includes coverage for "Windows 10 Store", which, based on
>>> some CI output [1], runs on the following environment:
>>>
>>> Windows OS: installed Windows 10
>>> MSBuild Tools: installed 12.0
>>> Visual Studio: installed 14.0
>>> Windows SDK: installed 8.1
>>> Windows Phone SDK: installed 8.1
>>>
>>> What do y'all think?
>>>
>>> [1]
>>> https://na01.safelinks.protection.outlook.com/?url=http%3A%2F%2Fcordo
>>> va-ci.cloudapp.net%3A8080%2Fview%2FPull%2520requests%2F&data=02%7C01%
>>> 7Cv-alsoro%40microsoft.com%7C846b538123ff473a856208d435c14103%7C72f98
>>> 8bf86f141af91ab2d7cd011db47%7C1%7C0%7C636192551514435865&sdata=RFQsHn
>>> %2BnbajwIq6oSEfMa9Bf7mjodpl3C07HOjC%2B5R8%3D&reserved=0
>>> job/cordova-plugin-camera-pr/115/PLATFORM=windows-10-store/console
>>>
>>> ---------------------------------------------------------------------
>>> To unsubscribe, e-mail: dev-unsubscribe@cordova.apache.org
>>> For additional commands, e-mail: dev-help@cordova.apache.org
>>>
>>>
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: dev-unsubscribe@cordova.apache.org
> For additional commands, e-mail: dev-help@cordova.apache.org
>
> B KKKKKKKKKKKKKKKKKKKKKKKKKKKKKKKKKKKKKKKKKKKKKKKKKKKKKKKKKKKKKKKKKKKKCB [ X ܚX K K[XZ[
> ] ][ X ܚX P ܙ ݘK \ X K ܙ B ܈ Y ] [ۘ[ [X[ K[XZ[
> ] Z [ ܙ ݘK \ X K ܙ B
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@cordova.apache.org
For additional commands, e-mail: dev-help@cordova.apache.org
RE: Platform Version support/coverage
Posted by "Alexander Sorokin (Akvelon)" <v-...@microsoft.com>.
Hey guys,
iOS 10 builds for periodic and per-PR jobs are up and running on Jenkins.
I had some trouble with permission dialogs busting, but now everything seems to be in order.
Woo!
http://cordova-ci.cloudapp.net:8080/view/Periodic%20builds/job/cordova-periodic-build/293/
--Alex
-----Original Message-----
From: Alexander Sorokin (Akvelon) [mailto:v-alsoro@microsoft.com]
Sent: Monday, January 9, 2017 1:36 PM
To: dev@cordova.apache.org
Subject: RE: Platform Version support/coverage
I say let's do this!
Going to add the iOS 10 builds this week. Will keep you informed.
-----Original Message-----
From: Filip Maj [mailto:maj.fil@gmail.com]
Sent: Friday, January 6, 2017 2:19 AM
To: dev@cordova.apache.org
Subject: Re: Platform Version support/coverage
Thanks Shaz. If we want to make that happen, then I think that Alex will need to tweak our cloudapp jenkins instance to run the ios tests against both iOS 9.3 and 10. Shouldn't be too difficult, as Alex already has the dual-OS-version setup in place for Android (which is how we test both 4.4 and 5.1 currently).
What say you, Alex?
On Thu, Jan 5, 2017 at 2:58 PM, Shazron <sh...@gmail.com> wrote:
> For iOS, we usually test on the current iOS version and the one
> previous, so that would be iOS 10 and iOS 9. It follows what
> cordova-ios currently supports, which with cordova-ios@4.4.0 we would
> increase the minimum deployment target to iOS 9 (previously discussed in a thread in this list).
>
> On Thu, Jan 5, 2017 at 1:01 PM, Filip Maj <ma...@gmail.com> wrote:
>
>> Hi!
>>
>> TL;DR: what OS versions should we be running our tests on? What
>> versions should we be testing against in our CI?
>>
>> Recently, I received an email from Sauce Labs, letting me know that
>> support for test runs on Android 4.3 and below has officially ended.
>> This reminded me that our current Android CI in cloudapp (which uses
>> Sauce Labs) tests against Android 4.4 and 5.1, so we are starting to
>> cut it pretty close with which versions of Android we are testing
>> against.
>>
>> In general, I wanted to start a discussion around what OS versions of
>> our platforms we intend to support, and which ones we would want CI
>> coverage on?
>>
>> I think we probably want to have some test coverage on newer versions
>> of Android than 5.1. Unfortunately, at this time Sauce Labs does not
>> have support for Android 6 (let alone 7!), so our hands are tied
>> there until Sauce catches up a bit.
>>
>> On iOS, cloudapp currently tests against iOS 9.3. Sauce Labs _does_
>> have support for iOS 10, though, so we could update our CI to get
>> that coverage if we wanted.
>>
>> Our CI also includes coverage for "Windows 10 Store", which, based on
>> some CI output [1], runs on the following environment:
>>
>> Windows OS: installed Windows 10
>> MSBuild Tools: installed 12.0
>> Visual Studio: installed 14.0
>> Windows SDK: installed 8.1
>> Windows Phone SDK: installed 8.1
>>
>> What do y'all think?
>>
>> [1]
>> https://na01.safelinks.protection.outlook.com/?url=http%3A%2F%2Fcordo
>> va-ci.cloudapp.net%3A8080%2Fview%2FPull%2520requests%2F&data=02%7C01%
>> 7Cv-alsoro%40microsoft.com%7C846b538123ff473a856208d435c14103%7C72f98
>> 8bf86f141af91ab2d7cd011db47%7C1%7C0%7C636192551514435865&sdata=RFQsHn
>> %2BnbajwIq6oSEfMa9Bf7mjodpl3C07HOjC%2B5R8%3D&reserved=0
>> job/cordova-plugin-camera-pr/115/PLATFORM=windows-10-store/console
>>
>> ---------------------------------------------------------------------
>> To unsubscribe, e-mail: dev-unsubscribe@cordova.apache.org
>> For additional commands, e-mail: dev-help@cordova.apache.org
>>
>>
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@cordova.apache.org
For additional commands, e-mail: dev-help@cordova.apache.org
B KKKKKKKKKKKKKKKKKKKKKKKKKKKKKKKKKKKKKKKKKKKKKKKKKKKKKKKKKKKKKKKKKKKKCB [ X ܚX KK[XZ[
] ][ X ܚX P ܙݘK \X K ܙ B ܈Y][ۘ[ [X[ K[XZ[
] Z[ ܙݘK \X K ܙ B
RE: Platform Version support/coverage
Posted by "Alexander Sorokin (Akvelon)" <v-...@microsoft.com>.
I say let's do this!
Going to add the iOS 10 builds this week. Will keep you informed.
-----Original Message-----
From: Filip Maj [mailto:maj.fil@gmail.com]
Sent: Friday, January 6, 2017 2:19 AM
To: dev@cordova.apache.org
Subject: Re: Platform Version support/coverage
Thanks Shaz. If we want to make that happen, then I think that Alex will need to tweak our cloudapp jenkins instance to run the ios tests against both iOS 9.3 and 10. Shouldn't be too difficult, as Alex already has the dual-OS-version setup in place for Android (which is how we test both 4.4 and 5.1 currently).
What say you, Alex?
On Thu, Jan 5, 2017 at 2:58 PM, Shazron <sh...@gmail.com> wrote:
> For iOS, we usually test on the current iOS version and the one
> previous, so that would be iOS 10 and iOS 9. It follows what
> cordova-ios currently supports, which with cordova-ios@4.4.0 we would
> increase the minimum deployment target to iOS 9 (previously discussed in a thread in this list).
>
> On Thu, Jan 5, 2017 at 1:01 PM, Filip Maj <ma...@gmail.com> wrote:
>
>> Hi!
>>
>> TL;DR: what OS versions should we be running our tests on? What
>> versions should we be testing against in our CI?
>>
>> Recently, I received an email from Sauce Labs, letting me know that
>> support for test runs on Android 4.3 and below has officially ended.
>> This reminded me that our current Android CI in cloudapp (which uses
>> Sauce Labs) tests against Android 4.4 and 5.1, so we are starting to
>> cut it pretty close with which versions of Android we are testing
>> against.
>>
>> In general, I wanted to start a discussion around what OS versions of
>> our platforms we intend to support, and which ones we would want CI
>> coverage on?
>>
>> I think we probably want to have some test coverage on newer versions
>> of Android than 5.1. Unfortunately, at this time Sauce Labs does not
>> have support for Android 6 (let alone 7!), so our hands are tied
>> there until Sauce catches up a bit.
>>
>> On iOS, cloudapp currently tests against iOS 9.3. Sauce Labs _does_
>> have support for iOS 10, though, so we could update our CI to get
>> that coverage if we wanted.
>>
>> Our CI also includes coverage for "Windows 10 Store", which, based on
>> some CI output [1], runs on the following environment:
>>
>> Windows OS: installed Windows 10
>> MSBuild Tools: installed 12.0
>> Visual Studio: installed 14.0
>> Windows SDK: installed 8.1
>> Windows Phone SDK: installed 8.1
>>
>> What do y'all think?
>>
>> [1]
>> https://na01.safelinks.protection.outlook.com/?url=http%3A%2F%2Fcordo
>> va-ci.cloudapp.net%3A8080%2Fview%2FPull%2520requests%2F&data=02%7C01%
>> 7Cv-alsoro%40microsoft.com%7C846b538123ff473a856208d435c14103%7C72f98
>> 8bf86f141af91ab2d7cd011db47%7C1%7C0%7C636192551514435865&sdata=RFQsHn
>> %2BnbajwIq6oSEfMa9Bf7mjodpl3C07HOjC%2B5R8%3D&reserved=0
>> job/cordova-plugin-camera-pr/115/PLATFORM=windows-10-store/console
>>
>> ---------------------------------------------------------------------
>> To unsubscribe, e-mail: dev-unsubscribe@cordova.apache.org
>> For additional commands, e-mail: dev-help@cordova.apache.org
>>
>>
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@cordova.apache.org
For additional commands, e-mail: dev-help@cordova.apache.org
Re: Platform Version support/coverage
Posted by Filip Maj <ma...@gmail.com>.
Thanks Shaz. If we want to make that happen, then I think that Alex
will need to tweak our cloudapp jenkins instance to run the ios tests
against both iOS 9.3 and 10. Shouldn't be too difficult, as Alex
already has the dual-OS-version setup in place for Android (which is
how we test both 4.4 and 5.1 currently).
What say you, Alex?
On Thu, Jan 5, 2017 at 2:58 PM, Shazron <sh...@gmail.com> wrote:
> For iOS, we usually test on the current iOS version and the one previous,
> so that would be iOS 10 and iOS 9. It follows what cordova-ios currently
> supports, which with cordova-ios@4.4.0 we would increase the minimum
> deployment target to iOS 9 (previously discussed in a thread in this list).
>
> On Thu, Jan 5, 2017 at 1:01 PM, Filip Maj <ma...@gmail.com> wrote:
>
>> Hi!
>>
>> TL;DR: what OS versions should we be running our tests on? What
>> versions should we be testing against in our CI?
>>
>> Recently, I received an email from Sauce Labs, letting me know that
>> support for test runs on Android 4.3 and below has officially ended.
>> This reminded me that our current Android CI in cloudapp (which uses
>> Sauce Labs) tests against Android 4.4 and 5.1, so we are starting to
>> cut it pretty close with which versions of Android we are testing
>> against.
>>
>> In general, I wanted to start a discussion around what OS versions of
>> our platforms we intend to support, and which ones we would want CI
>> coverage on?
>>
>> I think we probably want to have some test coverage on newer versions
>> of Android than 5.1. Unfortunately, at this time Sauce Labs does not
>> have support for Android 6 (let alone 7!), so our hands are tied there
>> until Sauce catches up a bit.
>>
>> On iOS, cloudapp currently tests against iOS 9.3. Sauce Labs _does_
>> have support for iOS 10, though, so we could update our CI to get that
>> coverage if we wanted.
>>
>> Our CI also includes coverage for "Windows 10 Store", which, based on
>> some CI output [1], runs on the following environment:
>>
>> Windows OS: installed Windows 10
>> MSBuild Tools: installed 12.0
>> Visual Studio: installed 14.0
>> Windows SDK: installed 8.1
>> Windows Phone SDK: installed 8.1
>>
>> What do y'all think?
>>
>> [1] http://cordova-ci.cloudapp.net:8080/view/Pull%20requests/
>> job/cordova-plugin-camera-pr/115/PLATFORM=windows-10-store/console
>>
>> ---------------------------------------------------------------------
>> To unsubscribe, e-mail: dev-unsubscribe@cordova.apache.org
>> For additional commands, e-mail: dev-help@cordova.apache.org
>>
>>
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@cordova.apache.org
For additional commands, e-mail: dev-help@cordova.apache.org
Re: Platform Version support/coverage
Posted by Shazron <sh...@gmail.com>.
For iOS, we usually test on the current iOS version and the one previous,
so that would be iOS 10 and iOS 9. It follows what cordova-ios currently
supports, which with cordova-ios@4.4.0 we would increase the minimum
deployment target to iOS 9 (previously discussed in a thread in this list).
On Thu, Jan 5, 2017 at 1:01 PM, Filip Maj <ma...@gmail.com> wrote:
> Hi!
>
> TL;DR: what OS versions should we be running our tests on? What
> versions should we be testing against in our CI?
>
> Recently, I received an email from Sauce Labs, letting me know that
> support for test runs on Android 4.3 and below has officially ended.
> This reminded me that our current Android CI in cloudapp (which uses
> Sauce Labs) tests against Android 4.4 and 5.1, so we are starting to
> cut it pretty close with which versions of Android we are testing
> against.
>
> In general, I wanted to start a discussion around what OS versions of
> our platforms we intend to support, and which ones we would want CI
> coverage on?
>
> I think we probably want to have some test coverage on newer versions
> of Android than 5.1. Unfortunately, at this time Sauce Labs does not
> have support for Android 6 (let alone 7!), so our hands are tied there
> until Sauce catches up a bit.
>
> On iOS, cloudapp currently tests against iOS 9.3. Sauce Labs _does_
> have support for iOS 10, though, so we could update our CI to get that
> coverage if we wanted.
>
> Our CI also includes coverage for "Windows 10 Store", which, based on
> some CI output [1], runs on the following environment:
>
> Windows OS: installed Windows 10
> MSBuild Tools: installed 12.0
> Visual Studio: installed 14.0
> Windows SDK: installed 8.1
> Windows Phone SDK: installed 8.1
>
> What do y'all think?
>
> [1] http://cordova-ci.cloudapp.net:8080/view/Pull%20requests/
> job/cordova-plugin-camera-pr/115/PLATFORM=windows-10-store/console
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: dev-unsubscribe@cordova.apache.org
> For additional commands, e-mail: dev-help@cordova.apache.org
>
>