You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@cordova.apache.org by Ian Clelland <ic...@chromium.org> on 2014/08/27 17:40:22 UTC
iOS mobile-spec failures (was: Re: [Testing] No content to speak of)
No, it appears that something is up with Jasmine on ios -- the custom
matchers aren't being attached in all cases, so I am seeing errors in the
console like:
TypeError: 'undefined' is not a function (evaluating
'expect(fileEntry.name).toCanonicallyMatch(fileName)')
because .toCanonicallyMatch is not present. It's odd, because it is present
in previous tests, so I don't know why it would be failing after a certain
point.
On Wed, Aug 27, 2014 at 11:03 AM, Ian Clelland <ic...@chromium.org>
wrote:
> I'll check that out; the file changes could be related to my commits
> yesterday
>
>
> On Wed, Aug 27, 2014 at 10:58 AM, Edna Y Morales <ey...@us.ibm.com>
> wrote:
>
>> I'm seeing many many failing iOS tests. They are seen across file,
>> file-transfer, globalization, geolocation, and media with timeout and
>> reference errors mostly. Can anyone else verify this or is it just me?
>>
>> Thanks,
>> Edna Morales
>>
>> [image: Inactive hide details for "Sergey Grebnov (Akvelon)"
>> ---08/27/2014 09:39:45 AM---Vladimir Kotikov and me will join this testing]"Sergey
>> Grebnov (Akvelon)" ---08/27/2014 09:39:45 AM---Vladimir Kotikov and me will
>> join this testing party soon and help with the testing and necessary im
>>
>> From: "Sergey Grebnov (Akvelon)" <v-...@microsoft.com>
>> To: "dev@cordova.apache.org" <de...@cordova.apache.org>
>> Date: 08/27/2014 09:39 AM
>> Subject: RE: [Testing] No content to speak of
>> ------------------------------
>>
>>
>>
>> Vladimir Kotikov and me will join this testing party soon and help with
>> the testing and necessary improvements(if any). Currently we see some
>> problem with dynamic manual tests generation (at least in Camera tests) on
>> Windows due to special unsafe html restrictions on this platform, Vladimir
>> will send details and workaround.
>>
>> Thx!
>> Sergey
>> -----Original Message-----
>> From: Martin Gonzalez [mailto:martin.c.glez.glez@gmail.com
>> <ma...@gmail.com>]
>> Sent: Wednesday, August 27, 2014 5:12 PM
>> To: dev@cordova.apache.org
>> Subject: Re: [Testing] No content to speak of
>>
>> Agree, over android it looks good, however running the tests over Windows
>> Phone, the final count is 13 new fails.
>> Specs failing: 9, 9.5, 10, 11, 15, 24, 82, 110, 116, 121, 122, 123, 124.
>>
>>
>>
>> 2014-08-26 11:20 GMT-05:00 Marcel Kinard <cm...@gmail.com>:
>>
>> > Thanks, Ian! On Android 4.4, I'm now getting no failures with the all
>> > the automatic tests (new-style plugin tests and old-style non-plugin
>> tests).
>> >
>> > Now to start poking at the manual tests...
>> >
>> > On Aug 26, 2014, at 11:27 AM, Ian Clelland <ic...@chromium.org>
>> wrote:
>> >
>> > > The other issue should be resolved now, but if someone with a WP8
>> > > device can test it out as well, it'd be appreciated.
>> >
>> >
>>
>>
>> --
>> Regards,
>> Martin Gonzalez
>>
>>
>
Re: iOS mobile-spec failures (was: Re: [Testing] No content to speak of)
Posted by Edna Y Morales <ey...@us.ibm.com>.
Yes no problem. I have created a Jira issue (CB-7423).
Thanks,
Edna Morales
From: Marcel Kinard <cm...@gmail.com>
To: dev@cordova.apache.org
Date: 08/28/2014 05:48 PM
Subject: Re: iOS mobile-spec failures (was: Re: [Testing] No content to
speak of)
Edna, could you post the specific failures here or in a Jira item? (Not all
40 when run in aggregate since there are lots of false failures, but the
few true failures when run in isolation.) Would be nice to get these fixed
before 3.6.0 is cut. Thanks!
On Aug 28, 2014, at 4:58 PM, Edna Y Morales <ey...@us.ibm.com> wrote:
> So I was still getting 40 or so failures on iOS when running mobilespec,
even after updating jasmine. I ran the automatic tests for each plugin
individually and doing that I get 3 file-transfer failures. For file, I get
2 copyTo failures only after running the tests a second time. I will update
with the results of the plugin manual tests.
>
> For the native auto tests, I am seeing 1 whitelist failure.
>
Re: iOS mobile-spec failures (was: Re: [Testing] No content to speak of)
Posted by Marcel Kinard <cm...@gmail.com>.
Edna, could you post the specific failures here or in a Jira item? (Not all 40 when run in aggregate since there are lots of false failures, but the few true failures when run in isolation.) Would be nice to get these fixed before 3.6.0 is cut. Thanks!
On Aug 28, 2014, at 4:58 PM, Edna Y Morales <ey...@us.ibm.com> wrote:
> So I was still getting 40 or so failures on iOS when running mobilespec, even after updating jasmine. I ran the automatic tests for each plugin individually and doing that I get 3 file-transfer failures. For file, I get 2 copyTo failures only after running the tests a second time. I will update with the results of the plugin manual tests.
>
> For the native auto tests, I am seeing 1 whitelist failure.
>
Re: iOS mobile-spec failures (was: Re: [Testing] No content to speak of)
Posted by Edna Y Morales <ey...@us.ibm.com>.
So I was still getting 40 or so failures on iOS when running mobilespec,
even after updating jasmine. I ran the automatic tests for each plugin
individually and doing that I get 3 file-transfer failures. For file, I get
2 copyTo failures only after running the tests a second time. I will update
with the results of the plugin manual tests.
For the native auto tests, I am seeing 1 whitelist failure.
Thanks,
Edna Morales
From: Carlos Santana <cs...@gmail.com>
To: "dev@cordova.apache.org" <de...@cordova.apache.org>
Date: 08/28/2014 12:34 PM
Subject: Re: iOS mobile-spec failures (was: Re: [Testing] No content to
speak of)
Is the Google team switching to the new style tests for their Medic CI
environment?
On Thu, Aug 28, 2014 at 6:37 AM, Marcel Kinard <cm...@gmail.com> wrote:
> Very good news.
>
> I'm still left wondering why these failures are being discovered just
now.
> Are we all lacking that much discipline in running tests as we make
commits?
>
> On Aug 27, 2014, at 9:24 PM, Michal Mocny <mm...@chromium.org> wrote:
>
> > Awesome :P Sometimes you get lucky ;)
> >
> >
> > On Wed, Aug 27, 2014 at 8:50 PM, Edna Y Morales <ey...@us.ibm.com>
> wrote:
> >
> >> Running only the file plugin tests, updating the version of jasmine in
> the
> >> assets brought the failures down from 16 to 0. Thanks for the
suggestion
> >> Michal!
>
>
--
Carlos Santana
<cs...@gmail.com>
Re: iOS mobile-spec failures (was: Re: [Testing] No content to speak of)
Posted by Carlos Santana <cs...@gmail.com>.
Is the Google team switching to the new style tests for their Medic CI
environment?
On Thu, Aug 28, 2014 at 6:37 AM, Marcel Kinard <cm...@gmail.com> wrote:
> Very good news.
>
> I'm still left wondering why these failures are being discovered just now.
> Are we all lacking that much discipline in running tests as we make commits?
>
> On Aug 27, 2014, at 9:24 PM, Michal Mocny <mm...@chromium.org> wrote:
>
> > Awesome :P Sometimes you get lucky ;)
> >
> >
> > On Wed, Aug 27, 2014 at 8:50 PM, Edna Y Morales <ey...@us.ibm.com>
> wrote:
> >
> >> Running only the file plugin tests, updating the version of jasmine in
> the
> >> assets brought the failures down from 16 to 0. Thanks for the suggestion
> >> Michal!
>
>
--
Carlos Santana
<cs...@gmail.com>
Re: iOS mobile-spec failures (was: Re: [Testing] No content to speak of)
Posted by Marcel Kinard <cm...@gmail.com>.
Very good news.
I'm still left wondering why these failures are being discovered just now. Are we all lacking that much discipline in running tests as we make commits?
On Aug 27, 2014, at 9:24 PM, Michal Mocny <mm...@chromium.org> wrote:
> Awesome :P Sometimes you get lucky ;)
>
>
> On Wed, Aug 27, 2014 at 8:50 PM, Edna Y Morales <ey...@us.ibm.com> wrote:
>
>> Running only the file plugin tests, updating the version of jasmine in the
>> assets brought the failures down from 16 to 0. Thanks for the suggestion
>> Michal!
Re: iOS mobile-spec failures (was: Re: [Testing] No content to speak of)
Posted by Michal Mocny <mm...@chromium.org>.
Awesome :P Sometimes you get lucky ;)
On Wed, Aug 27, 2014 at 8:50 PM, Edna Y Morales <ey...@us.ibm.com> wrote:
> Running only the file plugin tests, updating the version of jasmine in the
> assets brought the failures down from 16 to 0. Thanks for the suggestion
> Michal!
> I will see what the results are for the rest of the plugins with the
> updated version of jasmine tomorrow.
>
> Thanks,
> Edna Morales
>
> [image: Inactive hide details for Michal Mocny ---08/27/2014 04:48:52
> PM---One quick thing to try is to update the version of jasmine u]Michal
> Mocny ---08/27/2014 04:48:52 PM---One quick thing to try is to update the
> version of jasmine used by the harness app. 2.0 is new and
>
> From: Michal Mocny <mm...@chromium.org>
> To: dev <de...@cordova.apache.org>
> Date: 08/27/2014 04:48 PM
>
> Subject: Re: iOS mobile-spec failures (was: Re: [Testing] No content to
> speak of)
> Sent by: mmocny@google.com
> ------------------------------
>
>
>
> One quick thing to try is to update the version of jasmine used by the
> harness app. 2.0 is new and its been a while since the assets were
> updated.
>
> -Michal
>
>
> On Wed, Aug 27, 2014 at 1:14 PM, Edna Y Morales <ey...@us.ibm.com>
> wrote:
>
> > Yeah I can confirm that behavior. I was seeing it this morning when I
> > noticed that some specs were showing up as failing twice?
> >
> > Thanks,
> > Edna Morales
> >
> > [image: Inactive hide details for Martin Gonzalez ---08/27/2014 01:06:06
> > PM---During testing, sometimes a callback is reached more than]Martin
> > Gonzalez ---08/27/2014 01:06:06 PM---During testing, sometimes a callback
> > is reached more than one time, this strange behavior I've faced
> >
> > From: Martin Gonzalez <ma...@gmail.com>
> > To: dev@cordova.apache.org
> > Date: 08/27/2014 01:06 PM
> > Subject: Re: iOS mobile-spec failures (was: Re: [Testing] No content to
> > speak of)
> > ------------------------------
>
> >
> >
> >
> > During testing, sometimes a callback is reached more than one time, this
> > strange behavior I've faced over Windows phone with the Media tests,
> > creating a loop. Then Edna test it out over iOS a few weeks ago and I
> > recall that some of the callbacks were reached more than once, which is
> > unusual.
> > Options: Fix that behavior over iOS, and also set some routine over the
> > file.tests to detect that kind of behavior, fail the test and move on
> with
> > the next, this would avoid that kind of loop.
> >
> > Could you guys confirm that kind of behavior?
> >
> >
> > 2014-08-27 11:47 GMT-05:00 Ian Clelland <ic...@chromium.org>:
> >
> > > Something strange is definitely going on in the file tests; in the
> > vicinity
> > > of spec.109. Custom matchers are not being added after that spec, but
> if
> > I
> > > remove it, then the tests simply stop at that point.
> > >
> > >
> > >
> > > On Wed, Aug 27, 2014 at 11:40 AM, Ian Clelland <iclelland@chromium.org
> >
> > > wrote:
> > >
> > > > No, it appears that something is up with Jasmine on ios -- the custom
> > > > matchers aren't being attached in all cases, so I am seeing errors in
> > the
> > > > console like:
> > > >
> > > > TypeError: 'undefined' is not a function (evaluating
> > > > 'expect(fileEntry.name).toCanonicallyMatch(fileName)')
> > > >
> > > > because .toCanonicallyMatch is not present. It's odd, because it is
> > > > present in previous tests, so I don't know why it would be failing
> > after
> > > a
> > > > certain point.
> > > >
> > > >
> > > > On Wed, Aug 27, 2014 at 11:03 AM, Ian Clelland <
> iclelland@chromium.org
> > >
> > > > wrote:
> > > >
> > > >> I'll check that out; the file changes could be related to my commits
> > > >> yesterday
> > > >>
> > > >>
> > > >> On Wed, Aug 27, 2014 at 10:58 AM, Edna Y Morales <
> eymorale@us.ibm.com
> > >
> > > >> wrote:
> > > >>
> > > >>> I'm seeing many many failing iOS tests. They are seen across file,
> > > >>> file-transfer, globalization, geolocation, and media with timeout
> and
> > > >>> reference errors mostly. Can anyone else verify this or is it just
> > me?
> > > >>>
> > > >>> Thanks,
> > > >>> Edna Morales
> > > >>>
> > > >>> [image: Inactive hide details for "Sergey Grebnov (Akvelon)"
> > > >>> ---08/27/2014 09:39:45 AM---Vladimir Kotikov and me will join this
> > > testing]"Sergey
> > > >>> Grebnov (Akvelon)" ---08/27/2014 09:39:45 AM---Vladimir Kotikov and
> > me
> > > will
> > > >>> join this testing party soon and help with the testing and
> necessary
> > im
> > > >>>
> > > >>> From: "Sergey Grebnov (Akvelon)" <v-...@microsoft.com>
> > > >>> To: "dev@cordova.apache.org" <de...@cordova.apache.org>
> > > >>> Date: 08/27/2014 09:39 AM
> > > >>> Subject: RE: [Testing] No content to speak of
> > > >>> ------------------------------
> > > >>>
> > > >>>
> > > >>>
> > > >>> Vladimir Kotikov and me will join this testing party soon and help
> > with
> > > >>> the testing and necessary improvements(if any). Currently we see
> some
> > > >>> problem with dynamic manual tests generation (at least in Camera
> > > tests) on
> > > >>> Windows due to special unsafe html restrictions on this platform,
> > > Vladimir
> > > >>> will send details and workaround.
> > > >>>
> > > >>> Thx!
> > > >>> Sergey
> > > >>> -----Original Message-----
> > > >>> From: Martin Gonzalez [
> mailto:martin.c.glez.glez@gmail.com <ma...@gmail.com>
>
> > <ma...@gmail.com>
> > > >>> <ma...@gmail.com>]
> > > >>> Sent: Wednesday, August 27, 2014 5:12 PM
> > > >>> To: dev@cordova.apache.org
> > > >>> Subject: Re: [Testing] No content to speak of
> > > >>>
> > > >>> Agree, over android it looks good, however running the tests over
> > > >>> Windows Phone, the final count is 13 new fails.
> > > >>> Specs failing: 9, 9.5, 10, 11, 15, 24, 82, 110, 116, 121, 122, 123,
> > > 124.
> > > >>>
> > > >>>
> > > >>>
> > > >>> 2014-08-26 11:20 GMT-05:00 Marcel Kinard <cm...@gmail.com>:
> > > >>>
> > > >>> > Thanks, Ian! On Android 4.4, I'm now getting no failures with the
> > all
> > > >>> > the automatic tests (new-style plugin tests and old-style
> > non-plugin
> > > >>> tests).
> > > >>> >
> > > >>> > Now to start poking at the manual tests...
> > > >>> >
> > > >>> > On Aug 26, 2014, at 11:27 AM, Ian Clelland <
> iclelland@chromium.org
> > >
> > > >>> wrote:
> > > >>> >
> > > >>> > > The other issue should be resolved now, but if someone with a
> WP8
> > > >>> > > device can test it out as well, it'd be appreciated.
> > > >>> >
> > > >>> >
> > > >>>
> > > >>>
> > > >>> --
> > > >>> Regards,
> > > >>> Martin Gonzalez
> > > >>>
> > > >>>
> > > >>
> > > >
> > >
> >
> >
> >
> > --
> > Regards,
> > Martin Gonzalez
> >
> >
>
>
Re: iOS mobile-spec failures (was: Re: [Testing] No content to speak of)
Posted by Edna Y Morales <ey...@us.ibm.com>.
Running only the file plugin tests, updating the version of jasmine in the
assets brought the failures down from 16 to 0. Thanks for the suggestion
Michal!
I will see what the results are for the rest of the plugins with the
updated version of jasmine tomorrow.
Thanks,
Edna Morales
From: Michal Mocny <mm...@chromium.org>
To: dev <de...@cordova.apache.org>
Date: 08/27/2014 04:48 PM
Subject: Re: iOS mobile-spec failures (was: Re: [Testing] No content to
speak of)
Sent by: mmocny@google.com
One quick thing to try is to update the version of jasmine used by the
harness app. 2.0 is new and its been a while since the assets were
updated.
-Michal
On Wed, Aug 27, 2014 at 1:14 PM, Edna Y Morales <ey...@us.ibm.com>
wrote:
> Yeah I can confirm that behavior. I was seeing it this morning when I
> noticed that some specs were showing up as failing twice?
>
> Thanks,
> Edna Morales
>
> [image: Inactive hide details for Martin Gonzalez ---08/27/2014 01:06:06
> PM---During testing, sometimes a callback is reached more than]Martin
> Gonzalez ---08/27/2014 01:06:06 PM---During testing, sometimes a callback
> is reached more than one time, this strange behavior I've faced
>
> From: Martin Gonzalez <ma...@gmail.com>
> To: dev@cordova.apache.org
> Date: 08/27/2014 01:06 PM
> Subject: Re: iOS mobile-spec failures (was: Re: [Testing] No content to
> speak of)
> ------------------------------
>
>
>
> During testing, sometimes a callback is reached more than one time, this
> strange behavior I've faced over Windows phone with the Media tests,
> creating a loop. Then Edna test it out over iOS a few weeks ago and I
> recall that some of the callbacks were reached more than once, which is
> unusual.
> Options: Fix that behavior over iOS, and also set some routine over the
> file.tests to detect that kind of behavior, fail the test and move on
with
> the next, this would avoid that kind of loop.
>
> Could you guys confirm that kind of behavior?
>
>
> 2014-08-27 11:47 GMT-05:00 Ian Clelland <ic...@chromium.org>:
>
> > Something strange is definitely going on in the file tests; in the
> vicinity
> > of spec.109. Custom matchers are not being added after that spec, but
if
> I
> > remove it, then the tests simply stop at that point.
> >
> >
> >
> > On Wed, Aug 27, 2014 at 11:40 AM, Ian Clelland <ic...@chromium.org>
> > wrote:
> >
> > > No, it appears that something is up with Jasmine on ios -- the custom
> > > matchers aren't being attached in all cases, so I am seeing errors in
> the
> > > console like:
> > >
> > > TypeError: 'undefined' is not a function (evaluating
> > > 'expect(fileEntry.name).toCanonicallyMatch(fileName)')
> > >
> > > because .toCanonicallyMatch is not present. It's odd, because it is
> > > present in previous tests, so I don't know why it would be failing
> after
> > a
> > > certain point.
> > >
> > >
> > > On Wed, Aug 27, 2014 at 11:03 AM, Ian Clelland
<iclelland@chromium.org
> >
> > > wrote:
> > >
> > >> I'll check that out; the file changes could be related to my commits
> > >> yesterday
> > >>
> > >>
> > >> On Wed, Aug 27, 2014 at 10:58 AM, Edna Y Morales
<eymorale@us.ibm.com
> >
> > >> wrote:
> > >>
> > >>> I'm seeing many many failing iOS tests. They are seen across file,
> > >>> file-transfer, globalization, geolocation, and media with timeout
and
> > >>> reference errors mostly. Can anyone else verify this or is it just
> me?
> > >>>
> > >>> Thanks,
> > >>> Edna Morales
> > >>>
> > >>> [image: Inactive hide details for "Sergey Grebnov (Akvelon)"
> > >>> ---08/27/2014 09:39:45 AM---Vladimir Kotikov and me will join this
> > testing]"Sergey
> > >>> Grebnov (Akvelon)" ---08/27/2014 09:39:45 AM---Vladimir Kotikov and
> me
> > will
> > >>> join this testing party soon and help with the testing and
necessary
> im
> > >>>
> > >>> From: "Sergey Grebnov (Akvelon)" <v-...@microsoft.com>
> > >>> To: "dev@cordova.apache.org" <de...@cordova.apache.org>
> > >>> Date: 08/27/2014 09:39 AM
> > >>> Subject: RE: [Testing] No content to speak of
> > >>> ------------------------------
> > >>>
> > >>>
> > >>>
> > >>> Vladimir Kotikov and me will join this testing party soon and help
> with
> > >>> the testing and necessary improvements(if any). Currently we see
some
> > >>> problem with dynamic manual tests generation (at least in Camera
> > tests) on
> > >>> Windows due to special unsafe html restrictions on this platform,
> > Vladimir
> > >>> will send details and workaround.
> > >>>
> > >>> Thx!
> > >>> Sergey
> > >>> -----Original Message-----
> > >>> From: Martin Gonzalez [mailto:martin.c.glez.glez@gmail.com
> <ma...@gmail.com>
> > >>> <ma...@gmail.com>]
> > >>> Sent: Wednesday, August 27, 2014 5:12 PM
> > >>> To: dev@cordova.apache.org
> > >>> Subject: Re: [Testing] No content to speak of
> > >>>
> > >>> Agree, over android it looks good, however running the tests over
> > >>> Windows Phone, the final count is 13 new fails.
> > >>> Specs failing: 9, 9.5, 10, 11, 15, 24, 82, 110, 116, 121, 122, 123,
> > 124.
> > >>>
> > >>>
> > >>>
> > >>> 2014-08-26 11:20 GMT-05:00 Marcel Kinard <cm...@gmail.com>:
> > >>>
> > >>> > Thanks, Ian! On Android 4.4, I'm now getting no failures with the
> all
> > >>> > the automatic tests (new-style plugin tests and old-style
> non-plugin
> > >>> tests).
> > >>> >
> > >>> > Now to start poking at the manual tests...
> > >>> >
> > >>> > On Aug 26, 2014, at 11:27 AM, Ian Clelland
<iclelland@chromium.org
> >
> > >>> wrote:
> > >>> >
> > >>> > > The other issue should be resolved now, but if someone with a
WP8
> > >>> > > device can test it out as well, it'd be appreciated.
> > >>> >
> > >>> >
> > >>>
> > >>>
> > >>> --
> > >>> Regards,
> > >>> Martin Gonzalez
> > >>>
> > >>>
> > >>
> > >
> >
>
>
>
> --
> Regards,
> Martin Gonzalez
>
>
Re: iOS mobile-spec failures (was: Re: [Testing] No content to speak of)
Posted by Michal Mocny <mm...@chromium.org>.
One quick thing to try is to update the version of jasmine used by the
harness app. 2.0 is new and its been a while since the assets were updated.
-Michal
On Wed, Aug 27, 2014 at 1:14 PM, Edna Y Morales <ey...@us.ibm.com> wrote:
> Yeah I can confirm that behavior. I was seeing it this morning when I
> noticed that some specs were showing up as failing twice?
>
> Thanks,
> Edna Morales
>
> [image: Inactive hide details for Martin Gonzalez ---08/27/2014 01:06:06
> PM---During testing, sometimes a callback is reached more than]Martin
> Gonzalez ---08/27/2014 01:06:06 PM---During testing, sometimes a callback
> is reached more than one time, this strange behavior I've faced
>
> From: Martin Gonzalez <ma...@gmail.com>
> To: dev@cordova.apache.org
> Date: 08/27/2014 01:06 PM
> Subject: Re: iOS mobile-spec failures (was: Re: [Testing] No content to
> speak of)
> ------------------------------
>
>
>
> During testing, sometimes a callback is reached more than one time, this
> strange behavior I've faced over Windows phone with the Media tests,
> creating a loop. Then Edna test it out over iOS a few weeks ago and I
> recall that some of the callbacks were reached more than once, which is
> unusual.
> Options: Fix that behavior over iOS, and also set some routine over the
> file.tests to detect that kind of behavior, fail the test and move on with
> the next, this would avoid that kind of loop.
>
> Could you guys confirm that kind of behavior?
>
>
> 2014-08-27 11:47 GMT-05:00 Ian Clelland <ic...@chromium.org>:
>
> > Something strange is definitely going on in the file tests; in the
> vicinity
> > of spec.109. Custom matchers are not being added after that spec, but if
> I
> > remove it, then the tests simply stop at that point.
> >
> >
> >
> > On Wed, Aug 27, 2014 at 11:40 AM, Ian Clelland <ic...@chromium.org>
> > wrote:
> >
> > > No, it appears that something is up with Jasmine on ios -- the custom
> > > matchers aren't being attached in all cases, so I am seeing errors in
> the
> > > console like:
> > >
> > > TypeError: 'undefined' is not a function (evaluating
> > > 'expect(fileEntry.name).toCanonicallyMatch(fileName)')
> > >
> > > because .toCanonicallyMatch is not present. It's odd, because it is
> > > present in previous tests, so I don't know why it would be failing
> after
> > a
> > > certain point.
> > >
> > >
> > > On Wed, Aug 27, 2014 at 11:03 AM, Ian Clelland <iclelland@chromium.org
> >
> > > wrote:
> > >
> > >> I'll check that out; the file changes could be related to my commits
> > >> yesterday
> > >>
> > >>
> > >> On Wed, Aug 27, 2014 at 10:58 AM, Edna Y Morales <eymorale@us.ibm.com
> >
> > >> wrote:
> > >>
> > >>> I'm seeing many many failing iOS tests. They are seen across file,
> > >>> file-transfer, globalization, geolocation, and media with timeout and
> > >>> reference errors mostly. Can anyone else verify this or is it just
> me?
> > >>>
> > >>> Thanks,
> > >>> Edna Morales
> > >>>
> > >>> [image: Inactive hide details for "Sergey Grebnov (Akvelon)"
> > >>> ---08/27/2014 09:39:45 AM---Vladimir Kotikov and me will join this
> > testing]"Sergey
> > >>> Grebnov (Akvelon)" ---08/27/2014 09:39:45 AM---Vladimir Kotikov and
> me
> > will
> > >>> join this testing party soon and help with the testing and necessary
> im
> > >>>
> > >>> From: "Sergey Grebnov (Akvelon)" <v-...@microsoft.com>
> > >>> To: "dev@cordova.apache.org" <de...@cordova.apache.org>
> > >>> Date: 08/27/2014 09:39 AM
> > >>> Subject: RE: [Testing] No content to speak of
> > >>> ------------------------------
> > >>>
> > >>>
> > >>>
> > >>> Vladimir Kotikov and me will join this testing party soon and help
> with
> > >>> the testing and necessary improvements(if any). Currently we see some
> > >>> problem with dynamic manual tests generation (at least in Camera
> > tests) on
> > >>> Windows due to special unsafe html restrictions on this platform,
> > Vladimir
> > >>> will send details and workaround.
> > >>>
> > >>> Thx!
> > >>> Sergey
> > >>> -----Original Message-----
> > >>> From: Martin Gonzalez [mailto:martin.c.glez.glez@gmail.com
> <ma...@gmail.com>
> > >>> <ma...@gmail.com>]
> > >>> Sent: Wednesday, August 27, 2014 5:12 PM
> > >>> To: dev@cordova.apache.org
> > >>> Subject: Re: [Testing] No content to speak of
> > >>>
> > >>> Agree, over android it looks good, however running the tests over
> > >>> Windows Phone, the final count is 13 new fails.
> > >>> Specs failing: 9, 9.5, 10, 11, 15, 24, 82, 110, 116, 121, 122, 123,
> > 124.
> > >>>
> > >>>
> > >>>
> > >>> 2014-08-26 11:20 GMT-05:00 Marcel Kinard <cm...@gmail.com>:
> > >>>
> > >>> > Thanks, Ian! On Android 4.4, I'm now getting no failures with the
> all
> > >>> > the automatic tests (new-style plugin tests and old-style
> non-plugin
> > >>> tests).
> > >>> >
> > >>> > Now to start poking at the manual tests...
> > >>> >
> > >>> > On Aug 26, 2014, at 11:27 AM, Ian Clelland <iclelland@chromium.org
> >
> > >>> wrote:
> > >>> >
> > >>> > > The other issue should be resolved now, but if someone with a WP8
> > >>> > > device can test it out as well, it'd be appreciated.
> > >>> >
> > >>> >
> > >>>
> > >>>
> > >>> --
> > >>> Regards,
> > >>> Martin Gonzalez
> > >>>
> > >>>
> > >>
> > >
> >
>
>
>
> --
> Regards,
> Martin Gonzalez
>
>
Re: iOS mobile-spec failures (was: Re: [Testing] No content to speak of)
Posted by Edna Y Morales <ey...@us.ibm.com>.
Yeah I can confirm that behavior. I was seeing it this morning when I
noticed that some specs were showing up as failing twice?
Thanks,
Edna Morales
From: Martin Gonzalez <ma...@gmail.com>
To: dev@cordova.apache.org
Date: 08/27/2014 01:06 PM
Subject: Re: iOS mobile-spec failures (was: Re: [Testing] No content to
speak of)
During testing, sometimes a callback is reached more than one time, this
strange behavior I've faced over Windows phone with the Media tests,
creating a loop. Then Edna test it out over iOS a few weeks ago and I
recall that some of the callbacks were reached more than once, which is
unusual.
Options: Fix that behavior over iOS, and also set some routine over the
file.tests to detect that kind of behavior, fail the test and move on with
the next, this would avoid that kind of loop.
Could you guys confirm that kind of behavior?
2014-08-27 11:47 GMT-05:00 Ian Clelland <ic...@chromium.org>:
> Something strange is definitely going on in the file tests; in the
vicinity
> of spec.109. Custom matchers are not being added after that spec, but if
I
> remove it, then the tests simply stop at that point.
>
>
>
> On Wed, Aug 27, 2014 at 11:40 AM, Ian Clelland <ic...@chromium.org>
> wrote:
>
> > No, it appears that something is up with Jasmine on ios -- the custom
> > matchers aren't being attached in all cases, so I am seeing errors in
the
> > console like:
> >
> > TypeError: 'undefined' is not a function (evaluating
> > 'expect(fileEntry.name).toCanonicallyMatch(fileName)')
> >
> > because .toCanonicallyMatch is not present. It's odd, because it is
> > present in previous tests, so I don't know why it would be failing
after
> a
> > certain point.
> >
> >
> > On Wed, Aug 27, 2014 at 11:03 AM, Ian Clelland <ic...@chromium.org>
> > wrote:
> >
> >> I'll check that out; the file changes could be related to my commits
> >> yesterday
> >>
> >>
> >> On Wed, Aug 27, 2014 at 10:58 AM, Edna Y Morales <ey...@us.ibm.com>
> >> wrote:
> >>
> >>> I'm seeing many many failing iOS tests. They are seen across file,
> >>> file-transfer, globalization, geolocation, and media with timeout and
> >>> reference errors mostly. Can anyone else verify this or is it just
me?
> >>>
> >>> Thanks,
> >>> Edna Morales
> >>>
> >>> [image: Inactive hide details for "Sergey Grebnov (Akvelon)"
> >>> ---08/27/2014 09:39:45 AM---Vladimir Kotikov and me will join this
> testing]"Sergey
> >>> Grebnov (Akvelon)" ---08/27/2014 09:39:45 AM---Vladimir Kotikov and
me
> will
> >>> join this testing party soon and help with the testing and necessary
im
> >>>
> >>> From: "Sergey Grebnov (Akvelon)" <v-...@microsoft.com>
> >>> To: "dev@cordova.apache.org" <de...@cordova.apache.org>
> >>> Date: 08/27/2014 09:39 AM
> >>> Subject: RE: [Testing] No content to speak of
> >>> ------------------------------
> >>>
> >>>
> >>>
> >>> Vladimir Kotikov and me will join this testing party soon and help
with
> >>> the testing and necessary improvements(if any). Currently we see some
> >>> problem with dynamic manual tests generation (at least in Camera
> tests) on
> >>> Windows due to special unsafe html restrictions on this platform,
> Vladimir
> >>> will send details and workaround.
> >>>
> >>> Thx!
> >>> Sergey
> >>> -----Original Message-----
> >>> From: Martin Gonzalez [mailto:martin.c.glez.glez@gmail.com
> >>> <ma...@gmail.com>]
> >>> Sent: Wednesday, August 27, 2014 5:12 PM
> >>> To: dev@cordova.apache.org
> >>> Subject: Re: [Testing] No content to speak of
> >>>
> >>> Agree, over android it looks good, however running the tests over
> >>> Windows Phone, the final count is 13 new fails.
> >>> Specs failing: 9, 9.5, 10, 11, 15, 24, 82, 110, 116, 121, 122, 123,
> 124.
> >>>
> >>>
> >>>
> >>> 2014-08-26 11:20 GMT-05:00 Marcel Kinard <cm...@gmail.com>:
> >>>
> >>> > Thanks, Ian! On Android 4.4, I'm now getting no failures with the
all
> >>> > the automatic tests (new-style plugin tests and old-style
non-plugin
> >>> tests).
> >>> >
> >>> > Now to start poking at the manual tests...
> >>> >
> >>> > On Aug 26, 2014, at 11:27 AM, Ian Clelland <ic...@chromium.org>
> >>> wrote:
> >>> >
> >>> > > The other issue should be resolved now, but if someone with a WP8
> >>> > > device can test it out as well, it'd be appreciated.
> >>> >
> >>> >
> >>>
> >>>
> >>> --
> >>> Regards,
> >>> Martin Gonzalez
> >>>
> >>>
> >>
> >
>
--
Regards,
Martin Gonzalez
Re: iOS mobile-spec failures (was: Re: [Testing] No content to speak of)
Posted by Martin Gonzalez <ma...@gmail.com>.
During testing, sometimes a callback is reached more than one time, this
strange behavior I've faced over Windows phone with the Media tests,
creating a loop. Then Edna test it out over iOS a few weeks ago and I
recall that some of the callbacks were reached more than once, which is
unusual.
Options: Fix that behavior over iOS, and also set some routine over the
file.tests to detect that kind of behavior, fail the test and move on with
the next, this would avoid that kind of loop.
Could you guys confirm that kind of behavior?
2014-08-27 11:47 GMT-05:00 Ian Clelland <ic...@chromium.org>:
> Something strange is definitely going on in the file tests; in the vicinity
> of spec.109. Custom matchers are not being added after that spec, but if I
> remove it, then the tests simply stop at that point.
>
>
>
> On Wed, Aug 27, 2014 at 11:40 AM, Ian Clelland <ic...@chromium.org>
> wrote:
>
> > No, it appears that something is up with Jasmine on ios -- the custom
> > matchers aren't being attached in all cases, so I am seeing errors in the
> > console like:
> >
> > TypeError: 'undefined' is not a function (evaluating
> > 'expect(fileEntry.name).toCanonicallyMatch(fileName)')
> >
> > because .toCanonicallyMatch is not present. It's odd, because it is
> > present in previous tests, so I don't know why it would be failing after
> a
> > certain point.
> >
> >
> > On Wed, Aug 27, 2014 at 11:03 AM, Ian Clelland <ic...@chromium.org>
> > wrote:
> >
> >> I'll check that out; the file changes could be related to my commits
> >> yesterday
> >>
> >>
> >> On Wed, Aug 27, 2014 at 10:58 AM, Edna Y Morales <ey...@us.ibm.com>
> >> wrote:
> >>
> >>> I'm seeing many many failing iOS tests. They are seen across file,
> >>> file-transfer, globalization, geolocation, and media with timeout and
> >>> reference errors mostly. Can anyone else verify this or is it just me?
> >>>
> >>> Thanks,
> >>> Edna Morales
> >>>
> >>> [image: Inactive hide details for "Sergey Grebnov (Akvelon)"
> >>> ---08/27/2014 09:39:45 AM---Vladimir Kotikov and me will join this
> testing]"Sergey
> >>> Grebnov (Akvelon)" ---08/27/2014 09:39:45 AM---Vladimir Kotikov and me
> will
> >>> join this testing party soon and help with the testing and necessary im
> >>>
> >>> From: "Sergey Grebnov (Akvelon)" <v-...@microsoft.com>
> >>> To: "dev@cordova.apache.org" <de...@cordova.apache.org>
> >>> Date: 08/27/2014 09:39 AM
> >>> Subject: RE: [Testing] No content to speak of
> >>> ------------------------------
> >>>
> >>>
> >>>
> >>> Vladimir Kotikov and me will join this testing party soon and help with
> >>> the testing and necessary improvements(if any). Currently we see some
> >>> problem with dynamic manual tests generation (at least in Camera
> tests) on
> >>> Windows due to special unsafe html restrictions on this platform,
> Vladimir
> >>> will send details and workaround.
> >>>
> >>> Thx!
> >>> Sergey
> >>> -----Original Message-----
> >>> From: Martin Gonzalez [mailto:martin.c.glez.glez@gmail.com
> >>> <ma...@gmail.com>]
> >>> Sent: Wednesday, August 27, 2014 5:12 PM
> >>> To: dev@cordova.apache.org
> >>> Subject: Re: [Testing] No content to speak of
> >>>
> >>> Agree, over android it looks good, however running the tests over
> >>> Windows Phone, the final count is 13 new fails.
> >>> Specs failing: 9, 9.5, 10, 11, 15, 24, 82, 110, 116, 121, 122, 123,
> 124.
> >>>
> >>>
> >>>
> >>> 2014-08-26 11:20 GMT-05:00 Marcel Kinard <cm...@gmail.com>:
> >>>
> >>> > Thanks, Ian! On Android 4.4, I'm now getting no failures with the all
> >>> > the automatic tests (new-style plugin tests and old-style non-plugin
> >>> tests).
> >>> >
> >>> > Now to start poking at the manual tests...
> >>> >
> >>> > On Aug 26, 2014, at 11:27 AM, Ian Clelland <ic...@chromium.org>
> >>> wrote:
> >>> >
> >>> > > The other issue should be resolved now, but if someone with a WP8
> >>> > > device can test it out as well, it'd be appreciated.
> >>> >
> >>> >
> >>>
> >>>
> >>> --
> >>> Regards,
> >>> Martin Gonzalez
> >>>
> >>>
> >>
> >
>
--
Regards,
Martin Gonzalez
Re: iOS mobile-spec failures (was: Re: [Testing] No content to speak of)
Posted by Ian Clelland <ic...@chromium.org>.
Something strange is definitely going on in the file tests; in the vicinity
of spec.109. Custom matchers are not being added after that spec, but if I
remove it, then the tests simply stop at that point.
On Wed, Aug 27, 2014 at 11:40 AM, Ian Clelland <ic...@chromium.org>
wrote:
> No, it appears that something is up with Jasmine on ios -- the custom
> matchers aren't being attached in all cases, so I am seeing errors in the
> console like:
>
> TypeError: 'undefined' is not a function (evaluating
> 'expect(fileEntry.name).toCanonicallyMatch(fileName)')
>
> because .toCanonicallyMatch is not present. It's odd, because it is
> present in previous tests, so I don't know why it would be failing after a
> certain point.
>
>
> On Wed, Aug 27, 2014 at 11:03 AM, Ian Clelland <ic...@chromium.org>
> wrote:
>
>> I'll check that out; the file changes could be related to my commits
>> yesterday
>>
>>
>> On Wed, Aug 27, 2014 at 10:58 AM, Edna Y Morales <ey...@us.ibm.com>
>> wrote:
>>
>>> I'm seeing many many failing iOS tests. They are seen across file,
>>> file-transfer, globalization, geolocation, and media with timeout and
>>> reference errors mostly. Can anyone else verify this or is it just me?
>>>
>>> Thanks,
>>> Edna Morales
>>>
>>> [image: Inactive hide details for "Sergey Grebnov (Akvelon)"
>>> ---08/27/2014 09:39:45 AM---Vladimir Kotikov and me will join this testing]"Sergey
>>> Grebnov (Akvelon)" ---08/27/2014 09:39:45 AM---Vladimir Kotikov and me will
>>> join this testing party soon and help with the testing and necessary im
>>>
>>> From: "Sergey Grebnov (Akvelon)" <v-...@microsoft.com>
>>> To: "dev@cordova.apache.org" <de...@cordova.apache.org>
>>> Date: 08/27/2014 09:39 AM
>>> Subject: RE: [Testing] No content to speak of
>>> ------------------------------
>>>
>>>
>>>
>>> Vladimir Kotikov and me will join this testing party soon and help with
>>> the testing and necessary improvements(if any). Currently we see some
>>> problem with dynamic manual tests generation (at least in Camera tests) on
>>> Windows due to special unsafe html restrictions on this platform, Vladimir
>>> will send details and workaround.
>>>
>>> Thx!
>>> Sergey
>>> -----Original Message-----
>>> From: Martin Gonzalez [mailto:martin.c.glez.glez@gmail.com
>>> <ma...@gmail.com>]
>>> Sent: Wednesday, August 27, 2014 5:12 PM
>>> To: dev@cordova.apache.org
>>> Subject: Re: [Testing] No content to speak of
>>>
>>> Agree, over android it looks good, however running the tests over
>>> Windows Phone, the final count is 13 new fails.
>>> Specs failing: 9, 9.5, 10, 11, 15, 24, 82, 110, 116, 121, 122, 123, 124.
>>>
>>>
>>>
>>> 2014-08-26 11:20 GMT-05:00 Marcel Kinard <cm...@gmail.com>:
>>>
>>> > Thanks, Ian! On Android 4.4, I'm now getting no failures with the all
>>> > the automatic tests (new-style plugin tests and old-style non-plugin
>>> tests).
>>> >
>>> > Now to start poking at the manual tests...
>>> >
>>> > On Aug 26, 2014, at 11:27 AM, Ian Clelland <ic...@chromium.org>
>>> wrote:
>>> >
>>> > > The other issue should be resolved now, but if someone with a WP8
>>> > > device can test it out as well, it'd be appreciated.
>>> >
>>> >
>>>
>>>
>>> --
>>> Regards,
>>> Martin Gonzalez
>>>
>>>
>>
>