You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@climate.apache.org by Cameron Goodale <go...@apache.org> on 2013/06/28 09:16:07 UTC
DISCUSS - Limit the Metric Selection options
Hey Folks,
While running through testing of the rcmet.py code that asks all the
Question & Answers at the command line a user is presented with the
following list of Metric Options:
Metric options
> [0] Bias: mean bias across full time range
> [1] Mean Absolute Error: across full time range
> [2] Spatial Pattern Correlation: results in a time series of spatial
> correlation coeff
> [3] Temporal Correlation: results in 2-d array of temporal correlation
> coefficient
> [4] Spatial Pattern Correlation between averaged fields: results in a
> single correlation coeff
> [5] RMSE in time: results in a 2-d array of RMSE over two time series
> [6] TODO: Probability Distribution Function similarity score
> Please make a selection from the options above
Options 2 & 4 from the list do not work.
So I would like to hear from the community is we should either repair these
two options, or just remove them from the list, or some other option.
If you want to repeat what I am seeing, just grab a copy of the trunk (
apply Kyo and Alex's Patch to metrics.py if not applied yet) and run:
$ python rcmet.py
Thanks,
-Cameron
Re: DISCUSS - Limit the Metric Selection options
Posted by Cameron Goodale <go...@apache.org>.
Chris,
I have created https://issues.apache.org/jira/browse/CLIMATE-177 to track
this change. Once I have this function tuned up I will re-test and if all
goes well we should have a new release candidate.
Thanks for the feedback,
-Cameron
On Fri, Jun 28, 2013 at 11:39 AM, Mattmann, Chris A (398J) <
chris.a.mattmann@jpl.nasa.gov> wrote:
> +1 to removing them from the list, but documenting them as a TODO
> in the code, or on the wiki.
>
> Cheers,
> Chris
>
> ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
> Chris Mattmann, Ph.D.
> Senior Computer Scientist
> NASA Jet Propulsion Laboratory Pasadena, CA 91109 USA
> Office: 171-266B, Mailstop: 171-246
> Email: chris.a.mattmann@nasa.gov
> WWW: http://sunset.usc.edu/~mattmann/
> ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
> Adjunct Assistant Professor, Computer Science Department
> University of Southern California, Los Angeles, CA 90089 USA
> ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
>
>
>
>
>
>
> -----Original Message-----
> From: Cameron Goodale <go...@apache.org>
> Reply-To: "dev@climate.incubator.apache.org"
> <de...@climate.incubator.apache.org>
> Date: Friday, June 28, 2013 12:16 AM
> To: "dev@climate.incubator.apache.org" <de...@climate.incubator.apache.org>
> Subject: DISCUSS - Limit the Metric Selection options
>
> >Hey Folks,
> >
> >While running through testing of the rcmet.py code that asks all the
> >Question & Answers at the command line a user is presented with the
> >following list of Metric Options:
> >
> >Metric options
> >> [0] Bias: mean bias across full time range
> >> [1] Mean Absolute Error: across full time range
> >> [2] Spatial Pattern Correlation: results in a time series of spatial
> >> correlation coeff
> >> [3] Temporal Correlation: results in 2-d array of temporal correlation
> >> coefficient
> >> [4] Spatial Pattern Correlation between averaged fields: results in a
> >> single correlation coeff
> >> [5] RMSE in time: results in a 2-d array of RMSE over two time series
> >> [6] TODO: Probability Distribution Function similarity score
> >> Please make a selection from the options above
> >
> >
> >Options 2 & 4 from the list do not work.
> >
> >So I would like to hear from the community is we should either repair
> >these
> >two options, or just remove them from the list, or some other option.
> >
> >If you want to repeat what I am seeing, just grab a copy of the trunk (
> >apply Kyo and Alex's Patch to metrics.py if not applied yet) and run:
> >
> >$ python rcmet.py
> >
> >
> >Thanks,
> >
> >
> >-Cameron
>
>
Re: DISCUSS - Limit the Metric Selection options
Posted by "Mattmann, Chris A (398J)" <ch...@jpl.nasa.gov>.
+1 to removing them from the list, but documenting them as a TODO
in the code, or on the wiki.
Cheers,
Chris
++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
Chris Mattmann, Ph.D.
Senior Computer Scientist
NASA Jet Propulsion Laboratory Pasadena, CA 91109 USA
Office: 171-266B, Mailstop: 171-246
Email: chris.a.mattmann@nasa.gov
WWW: http://sunset.usc.edu/~mattmann/
++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
Adjunct Assistant Professor, Computer Science Department
University of Southern California, Los Angeles, CA 90089 USA
++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
-----Original Message-----
From: Cameron Goodale <go...@apache.org>
Reply-To: "dev@climate.incubator.apache.org"
<de...@climate.incubator.apache.org>
Date: Friday, June 28, 2013 12:16 AM
To: "dev@climate.incubator.apache.org" <de...@climate.incubator.apache.org>
Subject: DISCUSS - Limit the Metric Selection options
>Hey Folks,
>
>While running through testing of the rcmet.py code that asks all the
>Question & Answers at the command line a user is presented with the
>following list of Metric Options:
>
>Metric options
>> [0] Bias: mean bias across full time range
>> [1] Mean Absolute Error: across full time range
>> [2] Spatial Pattern Correlation: results in a time series of spatial
>> correlation coeff
>> [3] Temporal Correlation: results in 2-d array of temporal correlation
>> coefficient
>> [4] Spatial Pattern Correlation between averaged fields: results in a
>> single correlation coeff
>> [5] RMSE in time: results in a 2-d array of RMSE over two time series
>> [6] TODO: Probability Distribution Function similarity score
>> Please make a selection from the options above
>
>
>Options 2 & 4 from the list do not work.
>
>So I would like to hear from the community is we should either repair
>these
>two options, or just remove them from the list, or some other option.
>
>If you want to repeat what I am seeing, just grab a copy of the trunk (
>apply Kyo and Alex's Patch to metrics.py if not applied yet) and run:
>
>$ python rcmet.py
>
>
>Thanks,
>
>
>-Cameron