You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@commons.apache.org by Patrick Meyer <me...@gmail.com> on 2011/09/02 14:46:00 UTC
[math] psychometrics
Hi All,
I have been developing an pure Java application that does a variety of
psychometric methods. I use the commons math library as much as I can
but I've also had to develop my own library. I'd like to combine the two
libraries by donating as much of my code to commons math as I can. My
library includes features for measurement reliability, test scaling,
test equating, polychoric correlations, histogram computations, kernel
regression, etc. Most of these feature are specialized to psychometrics,
but is there any interest in adding them to commons math? Are these
methods too specialized for commons math?
If you're interested in seeing the application in action, you can
download the full program from www.ItemAnalysis.com. You'll notice that
it also uses an Apache derby database for data management.
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@commons.apache.org
For additional commands, e-mail: dev-help@commons.apache.org
Re: [math] psychometrics
Posted by Phil Steitz <ph...@gmail.com>.
On 9/3/11 1:45 PM, Greg Sterijevski wrote:
> I've got you covered here. Phil, if you don't mind, I will float a few ideas
> for multivariate interfaces. Then I will push a few examples of MVN?
I think Patrick wants to do it, but is just being polite ;)
Seriously, go for it, Greg. Start by proposing some API ideas and
then we can work on implementation.
Phil
>
> -Greg
>
> On Sat, Sep 3, 2011 at 3:32 PM, Patrick Meyer <me...@gmail.com> wrote:
>
>> Ha ha... I was really hoping someone else would do all the hard work and
>> write the MVN distribution function for me.
>>
>>
>> On 9/3/2011 1:53 PM, Phil Steitz wrote:
>>
>>> On 9/3/11 10:37 AM, Patrick Meyer wrote:
>>>
>>>> No, I have written very few tests. Until I recently discovered
>>>> jUnit, I was using a very crude way of testing my code. I plan to
>>>> add more tests over the coming year.
>>>>
>>>> If you are registered with java.net, you can view the source code
>>>> at http://java.net/projects/**psychometrics<http://java.net/projects/psychometrics>.
>>>> I have requested that
>>>> the project be made public but I don't know how long that will take.
>>>>
>>>> There is one dependency in the polychoric correlation package
>>>> (com.itemanalysis.polycor) that could be problematic. The maximum
>>>> likelihood estimator requires a multivariate normal (or at least
>>>> bivariate normal) CDF. I use the one from
>>>> http://vadim.kutsyy.com/java/**javadoc/com/kutsyy/util/**
>>>> package-summary.html<http://vadim.kutsyy.com/java/javadoc/com/kutsyy/util/package-summary.html>
>>>> Are there plans to add a multivaraite normal CDF function to
>>>> commons math?
>>>>
>>> Patches welcome :)
>>>
>>> Phil
>>>
>>>> Patrick
>>>>
>>>>
>>>>
>>>> On 9/3/2011 12:36 PM, Greg Sterijevski wrote:
>>>>
>>>>> Do you have unit tests written for the different components?
>>>>>
>>>>> On Sat, Sep 3, 2011 at 10:48 AM, Patrick
>>>>> Meyer<me...@gmail.com> wrote:
>>>>>
>>>>> Sounds good. Separating the general purpose stats from the
>>>>>> psychometric
>>>>>> specific stats seems like a natural way to distinguish the two
>>>>>> libraries.
>>>>>> I'll send a link to the source code soon. Hopefully, you will
>>>>>> see the good
>>>>>> ideas in the code.
>>>>>>
>>>>>>
>>>>>> On 9/3/2011 12:57 AM, Phil Steitz wrote:
>>>>>>
>>>>>> On 9/2/11 7:19 AM, Patrick Meyer wrote:
>>>>>>> Yes, the math code is separate from the GUI and database for the
>>>>>>>> most part. I'd be happy to share the code and documentation,
>>>>>>>> but I
>>>>>>>> need a few days to add it to a repository and get it online.
>>>>>>>>
>>>>>>>> There are parts of my library that can be transferred to math
>>>>>>>> with
>>>>>>>> very few changes but other parts that need more work to make it
>>>>>>>> more object oriented in style and less procedural. In any case,
>>>>>>>> I'll send information about the code once I have it online.
>>>>>>>>
>>>>>>>> Don't worry too much about making things beautiful. Bad code +
>>>>>>> good
>>>>>>> ideas is the combination that works [1]. The thing to think about
>>>>>>> is what portions of your code are really general purpose math.
>>>>>>> Most
>>>>>>> likely kernel regression, polycor, histograms, etc., maybe not so
>>>>>>> much test scaling for example. Luc may have some good advice
>>>>>>> having done this already with an space dynamics library (or maybe
>>>>>>> Luc is so smart that there was no refactoring necessary :)
>>>>>>>
>>>>>>> What tends to work best is to bring things in incrementally,
>>>>>>> talking
>>>>>>> about the fit and how to integrate.
>>>>>>>
>>>>>>> Phil
>>>>>>>
>>>>>>> [1] http://s.apache.org/hZ
>>>>>>>
>>>>>>> Patrick
>>>>>>>> On 9/2/2011 9:26 AM, Gilles Sadowski wrote:
>>>>>>>>
>>>>>>>> Hello.
>>>>>>>>> I have been developing an pure Java application that does a
>>>>>>>>> variety
>>>>>>>>>
>>>>>>>>>> of psychometric methods. I use the commons math library as much
>>>>>>>>>> as I
>>>>>>>>>> can but I've also had to develop my own library. I'd like to
>>>>>>>>>> combine
>>>>>>>>>> the two libraries by donating as much of my code to commons
>>>>>>>>>> math as
>>>>>>>>>> I can. My library includes features for measurement
>>>>>>>>>> reliability,
>>>>>>>>>> test scaling, test equating, polychoric correlations, histogram
>>>>>>>>>> computations, kernel regression, etc. Most of these feature are
>>>>>>>>>> specialized to psychometrics, but is there any interest in
>>>>>>>>>> adding
>>>>>>>>>> them to commons math? Are these methods too specialized for
>>>>>>>>>> commons
>>>>>>>>>> math?
>>>>>>>>>>
>>>>>>>>>> Can we have a look at the code and documentation?
>>>>>>>>> If you're interested in seeing the application in action,
>>>>>>>>> you can
>>>>>>>>>
>>>>>>>>>> download the full program from www.ItemAnalysis.com. You'll
>>>>>>>>>> notice
>>>>>>>>>> that it also uses an Apache derby database for data management.
>>>>>>>>>>
>>>>>>>>>> Is the math code separate from GUI and data management?
>>>>>>>>>
>>>>>>>>> Regards,
>>>>>>>>> Gilles
>>>>>>>>>
>>>>>>>>> ------------------------------****----------------------------**
>>>>>>>>> --**
>>>>>>>>> ---------
>>>>>>>>>
>>>>>>>>> To unsubscribe, e-mail:
>>>>>>>>> dev-unsubscribe@commons.**apac**he.org <http://apache.org><
>>>>>>>>> dev-unsubscribe@**commons.apache.org<de...@commons.apache.org>
>>>>>>>>> For additional commands, e-mail: dev-help@commons.apache.org
>>>>>>>>>
>>>>>>>>>
>>>>>>>>> ------------------------------****----------------------------**
>>>>>>>>> --**
>>>>>>>>>
>>>>>>>> ---------
>>>>>>>> To unsubscribe, e-mail:
>>>>>>>> dev-unsubscribe@commons.**apac**he.org <http://apache.org><
>>>>>>>> dev-unsubscribe@**commons.apache.org<de...@commons.apache.org>
>>>>>>>> For additional commands, e-mail: dev-help@commons.apache.org
>>>>>>>>
>>>>>>>>
>>>>>>>>
>>>>>>>> ------------------------------****----------------------------**
>>>>>>> --**---------
>>>>>>>
>>>>>>> To unsubscribe, e-mail:
>>>>>>> dev-unsubscribe@commons.**apac**he.org <http://apache.org><
>>>>>>> dev-unsubscribe@**commons.apache.org<de...@commons.apache.org>
>>>>>>> For additional commands, e-mail: dev-help@commons.apache.org
>>>>>>>
>>>>>>>
>>>>>>> ------------------------------****----------------------------**
>>>>>> --**---------
>>>>>>
>>>>>> To unsubscribe, e-mail:
>>>>>> dev-unsubscribe@commons.**apac**he.org <http://apache.org><
>>>>>> dev-unsubscribe@**commons.apache.org<de...@commons.apache.org>
>>>>>> For additional commands, e-mail: dev-help@commons.apache.org
>>>>>>
>>>>>>
>>>>>> ------------------------------**------------------------------**
>>>> ---------
>>>> To unsubscribe, e-mail: dev-unsubscribe@commons.**apache.org<de...@commons.apache.org>
>>>> For additional commands, e-mail: dev-help@commons.apache.org
>>>>
>>>>
>>>>
>>> ------------------------------**------------------------------**---------
>>> To unsubscribe, e-mail: dev-unsubscribe@commons.**apache.org<de...@commons.apache.org>
>>> For additional commands, e-mail: dev-help@commons.apache.org
>>>
>>>
>> ------------------------------**------------------------------**---------
>> To unsubscribe, e-mail: dev-unsubscribe@commons.**apache.org<de...@commons.apache.org>
>> For additional commands, e-mail: dev-help@commons.apache.org
>>
>>
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@commons.apache.org
For additional commands, e-mail: dev-help@commons.apache.org
Re: [math] psychometrics
Posted by Greg Sterijevski <gs...@gmail.com>.
I've got you covered here. Phil, if you don't mind, I will float a few ideas
for multivariate interfaces. Then I will push a few examples of MVN?
-Greg
On Sat, Sep 3, 2011 at 3:32 PM, Patrick Meyer <me...@gmail.com> wrote:
> Ha ha... I was really hoping someone else would do all the hard work and
> write the MVN distribution function for me.
>
>
> On 9/3/2011 1:53 PM, Phil Steitz wrote:
>
>> On 9/3/11 10:37 AM, Patrick Meyer wrote:
>>
>>> No, I have written very few tests. Until I recently discovered
>>> jUnit, I was using a very crude way of testing my code. I plan to
>>> add more tests over the coming year.
>>>
>>> If you are registered with java.net, you can view the source code
>>> at http://java.net/projects/**psychometrics<http://java.net/projects/psychometrics>.
>>> I have requested that
>>> the project be made public but I don't know how long that will take.
>>>
>>> There is one dependency in the polychoric correlation package
>>> (com.itemanalysis.polycor) that could be problematic. The maximum
>>> likelihood estimator requires a multivariate normal (or at least
>>> bivariate normal) CDF. I use the one from
>>> http://vadim.kutsyy.com/java/**javadoc/com/kutsyy/util/**
>>> package-summary.html<http://vadim.kutsyy.com/java/javadoc/com/kutsyy/util/package-summary.html>
>>> Are there plans to add a multivaraite normal CDF function to
>>> commons math?
>>>
>> Patches welcome :)
>>
>> Phil
>>
>>> Patrick
>>>
>>>
>>>
>>> On 9/3/2011 12:36 PM, Greg Sterijevski wrote:
>>>
>>>> Do you have unit tests written for the different components?
>>>>
>>>> On Sat, Sep 3, 2011 at 10:48 AM, Patrick
>>>> Meyer<me...@gmail.com> wrote:
>>>>
>>>> Sounds good. Separating the general purpose stats from the
>>>>> psychometric
>>>>> specific stats seems like a natural way to distinguish the two
>>>>> libraries.
>>>>> I'll send a link to the source code soon. Hopefully, you will
>>>>> see the good
>>>>> ideas in the code.
>>>>>
>>>>>
>>>>> On 9/3/2011 12:57 AM, Phil Steitz wrote:
>>>>>
>>>>> On 9/2/11 7:19 AM, Patrick Meyer wrote:
>>>>>>
>>>>>> Yes, the math code is separate from the GUI and database for the
>>>>>>> most part. I'd be happy to share the code and documentation,
>>>>>>> but I
>>>>>>> need a few days to add it to a repository and get it online.
>>>>>>>
>>>>>>> There are parts of my library that can be transferred to math
>>>>>>> with
>>>>>>> very few changes but other parts that need more work to make it
>>>>>>> more object oriented in style and less procedural. In any case,
>>>>>>> I'll send information about the code once I have it online.
>>>>>>>
>>>>>>> Don't worry too much about making things beautiful. Bad code +
>>>>>> good
>>>>>> ideas is the combination that works [1]. The thing to think about
>>>>>> is what portions of your code are really general purpose math.
>>>>>> Most
>>>>>> likely kernel regression, polycor, histograms, etc., maybe not so
>>>>>> much test scaling for example. Luc may have some good advice
>>>>>> having done this already with an space dynamics library (or maybe
>>>>>> Luc is so smart that there was no refactoring necessary :)
>>>>>>
>>>>>> What tends to work best is to bring things in incrementally,
>>>>>> talking
>>>>>> about the fit and how to integrate.
>>>>>>
>>>>>> Phil
>>>>>>
>>>>>> [1] http://s.apache.org/hZ
>>>>>>
>>>>>> Patrick
>>>>>>>
>>>>>>> On 9/2/2011 9:26 AM, Gilles Sadowski wrote:
>>>>>>>
>>>>>>> Hello.
>>>>>>>>
>>>>>>>> I have been developing an pure Java application that does a
>>>>>>>> variety
>>>>>>>>
>>>>>>>>> of psychometric methods. I use the commons math library as much
>>>>>>>>> as I
>>>>>>>>> can but I've also had to develop my own library. I'd like to
>>>>>>>>> combine
>>>>>>>>> the two libraries by donating as much of my code to commons
>>>>>>>>> math as
>>>>>>>>> I can. My library includes features for measurement
>>>>>>>>> reliability,
>>>>>>>>> test scaling, test equating, polychoric correlations, histogram
>>>>>>>>> computations, kernel regression, etc. Most of these feature are
>>>>>>>>> specialized to psychometrics, but is there any interest in
>>>>>>>>> adding
>>>>>>>>> them to commons math? Are these methods too specialized for
>>>>>>>>> commons
>>>>>>>>> math?
>>>>>>>>>
>>>>>>>>> Can we have a look at the code and documentation?
>>>>>>>>
>>>>>>>> If you're interested in seeing the application in action,
>>>>>>>> you can
>>>>>>>>
>>>>>>>>> download the full program from www.ItemAnalysis.com. You'll
>>>>>>>>> notice
>>>>>>>>> that it also uses an Apache derby database for data management.
>>>>>>>>>
>>>>>>>>> Is the math code separate from GUI and data management?
>>>>>>>>
>>>>>>>>
>>>>>>>> Regards,
>>>>>>>> Gilles
>>>>>>>>
>>>>>>>> ------------------------------****----------------------------**
>>>>>>>> --**
>>>>>>>> ---------
>>>>>>>>
>>>>>>>> To unsubscribe, e-mail:
>>>>>>>> dev-unsubscribe@commons.**apac**he.org <http://apache.org><
>>>>>>>> dev-unsubscribe@**commons.apache.org<de...@commons.apache.org>
>>>>>>>> >
>>>>>>>> For additional commands, e-mail: dev-help@commons.apache.org
>>>>>>>>
>>>>>>>>
>>>>>>>> ------------------------------****----------------------------**
>>>>>>>> --**
>>>>>>>>
>>>>>>> ---------
>>>>>>> To unsubscribe, e-mail:
>>>>>>> dev-unsubscribe@commons.**apac**he.org <http://apache.org><
>>>>>>> dev-unsubscribe@**commons.apache.org<de...@commons.apache.org>
>>>>>>> >
>>>>>>> For additional commands, e-mail: dev-help@commons.apache.org
>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>> ------------------------------****----------------------------**
>>>>>> --**---------
>>>>>>
>>>>>> To unsubscribe, e-mail:
>>>>>> dev-unsubscribe@commons.**apac**he.org <http://apache.org><
>>>>>> dev-unsubscribe@**commons.apache.org<de...@commons.apache.org>
>>>>>> >
>>>>>> For additional commands, e-mail: dev-help@commons.apache.org
>>>>>>
>>>>>>
>>>>>> ------------------------------****----------------------------**
>>>>> --**---------
>>>>>
>>>>> To unsubscribe, e-mail:
>>>>> dev-unsubscribe@commons.**apac**he.org <http://apache.org><
>>>>> dev-unsubscribe@**commons.apache.org<de...@commons.apache.org>
>>>>> >
>>>>> For additional commands, e-mail: dev-help@commons.apache.org
>>>>>
>>>>>
>>>>> ------------------------------**------------------------------**
>>> ---------
>>> To unsubscribe, e-mail: dev-unsubscribe@commons.**apache.org<de...@commons.apache.org>
>>> For additional commands, e-mail: dev-help@commons.apache.org
>>>
>>>
>>>
>> ------------------------------**------------------------------**---------
>> To unsubscribe, e-mail: dev-unsubscribe@commons.**apache.org<de...@commons.apache.org>
>> For additional commands, e-mail: dev-help@commons.apache.org
>>
>>
> ------------------------------**------------------------------**---------
> To unsubscribe, e-mail: dev-unsubscribe@commons.**apache.org<de...@commons.apache.org>
> For additional commands, e-mail: dev-help@commons.apache.org
>
>
Re: [math] psychometrics
Posted by Patrick Meyer <me...@gmail.com>.
Ha ha... I was really hoping someone else would do all the hard work and
write the MVN distribution function for me.
On 9/3/2011 1:53 PM, Phil Steitz wrote:
> On 9/3/11 10:37 AM, Patrick Meyer wrote:
>> No, I have written very few tests. Until I recently discovered
>> jUnit, I was using a very crude way of testing my code. I plan to
>> add more tests over the coming year.
>>
>> If you are registered with java.net, you can view the source code
>> at http://java.net/projects/psychometrics. I have requested that
>> the project be made public but I don't know how long that will take.
>>
>> There is one dependency in the polychoric correlation package
>> (com.itemanalysis.polycor) that could be problematic. The maximum
>> likelihood estimator requires a multivariate normal (or at least
>> bivariate normal) CDF. I use the one from
>> http://vadim.kutsyy.com/java/javadoc/com/kutsyy/util/package-summary.html
>> Are there plans to add a multivaraite normal CDF function to
>> commons math?
> Patches welcome :)
>
> Phil
>> Patrick
>>
>>
>>
>> On 9/3/2011 12:36 PM, Greg Sterijevski wrote:
>>> Do you have unit tests written for the different components?
>>>
>>> On Sat, Sep 3, 2011 at 10:48 AM, Patrick
>>> Meyer<me...@gmail.com> wrote:
>>>
>>>> Sounds good. Separating the general purpose stats from the
>>>> psychometric
>>>> specific stats seems like a natural way to distinguish the two
>>>> libraries.
>>>> I'll send a link to the source code soon. Hopefully, you will
>>>> see the good
>>>> ideas in the code.
>>>>
>>>>
>>>> On 9/3/2011 12:57 AM, Phil Steitz wrote:
>>>>
>>>>> On 9/2/11 7:19 AM, Patrick Meyer wrote:
>>>>>
>>>>>> Yes, the math code is separate from the GUI and database for the
>>>>>> most part. I'd be happy to share the code and documentation,
>>>>>> but I
>>>>>> need a few days to add it to a repository and get it online.
>>>>>>
>>>>>> There are parts of my library that can be transferred to math
>>>>>> with
>>>>>> very few changes but other parts that need more work to make it
>>>>>> more object oriented in style and less procedural. In any case,
>>>>>> I'll send information about the code once I have it online.
>>>>>>
>>>>> Don't worry too much about making things beautiful. Bad code +
>>>>> good
>>>>> ideas is the combination that works [1]. The thing to think about
>>>>> is what portions of your code are really general purpose math.
>>>>> Most
>>>>> likely kernel regression, polycor, histograms, etc., maybe not so
>>>>> much test scaling for example. Luc may have some good advice
>>>>> having done this already with an space dynamics library (or maybe
>>>>> Luc is so smart that there was no refactoring necessary :)
>>>>>
>>>>> What tends to work best is to bring things in incrementally,
>>>>> talking
>>>>> about the fit and how to integrate.
>>>>>
>>>>> Phil
>>>>>
>>>>> [1] http://s.apache.org/hZ
>>>>>
>>>>>> Patrick
>>>>>>
>>>>>> On 9/2/2011 9:26 AM, Gilles Sadowski wrote:
>>>>>>
>>>>>>> Hello.
>>>>>>>
>>>>>>> I have been developing an pure Java application that does a
>>>>>>> variety
>>>>>>>> of psychometric methods. I use the commons math library as much
>>>>>>>> as I
>>>>>>>> can but I've also had to develop my own library. I'd like to
>>>>>>>> combine
>>>>>>>> the two libraries by donating as much of my code to commons
>>>>>>>> math as
>>>>>>>> I can. My library includes features for measurement
>>>>>>>> reliability,
>>>>>>>> test scaling, test equating, polychoric correlations, histogram
>>>>>>>> computations, kernel regression, etc. Most of these feature are
>>>>>>>> specialized to psychometrics, but is there any interest in
>>>>>>>> adding
>>>>>>>> them to commons math? Are these methods too specialized for
>>>>>>>> commons
>>>>>>>> math?
>>>>>>>>
>>>>>>> Can we have a look at the code and documentation?
>>>>>>>
>>>>>>> If you're interested in seeing the application in action,
>>>>>>> you can
>>>>>>>> download the full program from www.ItemAnalysis.com. You'll
>>>>>>>> notice
>>>>>>>> that it also uses an Apache derby database for data management.
>>>>>>>>
>>>>>>> Is the math code separate from GUI and data management?
>>>>>>>
>>>>>>>
>>>>>>> Regards,
>>>>>>> Gilles
>>>>>>>
>>>>>>> ------------------------------**------------------------------**
>>>>>>> ---------
>>>>>>>
>>>>>>> To unsubscribe, e-mail:
>>>>>>> dev-unsubscribe@commons.**apache.org<de...@commons.apache.org>
>>>>>>> For additional commands, e-mail: dev-help@commons.apache.org
>>>>>>>
>>>>>>>
>>>>>>> ------------------------------**------------------------------**
>>>>>> ---------
>>>>>> To unsubscribe, e-mail:
>>>>>> dev-unsubscribe@commons.**apache.org<de...@commons.apache.org>
>>>>>> For additional commands, e-mail: dev-help@commons.apache.org
>>>>>>
>>>>>>
>>>>>>
>>>>> ------------------------------**------------------------------**---------
>>>>>
>>>>> To unsubscribe, e-mail:
>>>>> dev-unsubscribe@commons.**apache.org<de...@commons.apache.org>
>>>>> For additional commands, e-mail: dev-help@commons.apache.org
>>>>>
>>>>>
>>>> ------------------------------**------------------------------**---------
>>>>
>>>> To unsubscribe, e-mail:
>>>> dev-unsubscribe@commons.**apache.org<de...@commons.apache.org>
>>>> For additional commands, e-mail: dev-help@commons.apache.org
>>>>
>>>>
>> ---------------------------------------------------------------------
>> To unsubscribe, e-mail: dev-unsubscribe@commons.apache.org
>> For additional commands, e-mail: dev-help@commons.apache.org
>>
>>
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: dev-unsubscribe@commons.apache.org
> For additional commands, e-mail: dev-help@commons.apache.org
>
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@commons.apache.org
For additional commands, e-mail: dev-help@commons.apache.org
Re: [math] psychometrics
Posted by Phil Steitz <ph...@gmail.com>.
On 9/3/11 10:37 AM, Patrick Meyer wrote:
> No, I have written very few tests. Until I recently discovered
> jUnit, I was using a very crude way of testing my code. I plan to
> add more tests over the coming year.
>
> If you are registered with java.net, you can view the source code
> at http://java.net/projects/psychometrics. I have requested that
> the project be made public but I don't know how long that will take.
>
> There is one dependency in the polychoric correlation package
> (com.itemanalysis.polycor) that could be problematic. The maximum
> likelihood estimator requires a multivariate normal (or at least
> bivariate normal) CDF. I use the one from
> http://vadim.kutsyy.com/java/javadoc/com/kutsyy/util/package-summary.html
> Are there plans to add a multivaraite normal CDF function to
> commons math?
Patches welcome :)
Phil
>
> Patrick
>
>
>
> On 9/3/2011 12:36 PM, Greg Sterijevski wrote:
>> Do you have unit tests written for the different components?
>>
>> On Sat, Sep 3, 2011 at 10:48 AM, Patrick
>> Meyer<me...@gmail.com> wrote:
>>
>>> Sounds good. Separating the general purpose stats from the
>>> psychometric
>>> specific stats seems like a natural way to distinguish the two
>>> libraries.
>>> I'll send a link to the source code soon. Hopefully, you will
>>> see the good
>>> ideas in the code.
>>>
>>>
>>> On 9/3/2011 12:57 AM, Phil Steitz wrote:
>>>
>>>> On 9/2/11 7:19 AM, Patrick Meyer wrote:
>>>>
>>>>> Yes, the math code is separate from the GUI and database for the
>>>>> most part. I'd be happy to share the code and documentation,
>>>>> but I
>>>>> need a few days to add it to a repository and get it online.
>>>>>
>>>>> There are parts of my library that can be transferred to math
>>>>> with
>>>>> very few changes but other parts that need more work to make it
>>>>> more object oriented in style and less procedural. In any case,
>>>>> I'll send information about the code once I have it online.
>>>>>
>>>> Don't worry too much about making things beautiful. Bad code +
>>>> good
>>>> ideas is the combination that works [1]. The thing to think about
>>>> is what portions of your code are really general purpose math.
>>>> Most
>>>> likely kernel regression, polycor, histograms, etc., maybe not so
>>>> much test scaling for example. Luc may have some good advice
>>>> having done this already with an space dynamics library (or maybe
>>>> Luc is so smart that there was no refactoring necessary :)
>>>>
>>>> What tends to work best is to bring things in incrementally,
>>>> talking
>>>> about the fit and how to integrate.
>>>>
>>>> Phil
>>>>
>>>> [1] http://s.apache.org/hZ
>>>>
>>>>> Patrick
>>>>>
>>>>> On 9/2/2011 9:26 AM, Gilles Sadowski wrote:
>>>>>
>>>>>> Hello.
>>>>>>
>>>>>> I have been developing an pure Java application that does a
>>>>>> variety
>>>>>>> of psychometric methods. I use the commons math library as much
>>>>>>> as I
>>>>>>> can but I've also had to develop my own library. I'd like to
>>>>>>> combine
>>>>>>> the two libraries by donating as much of my code to commons
>>>>>>> math as
>>>>>>> I can. My library includes features for measurement
>>>>>>> reliability,
>>>>>>> test scaling, test equating, polychoric correlations, histogram
>>>>>>> computations, kernel regression, etc. Most of these feature are
>>>>>>> specialized to psychometrics, but is there any interest in
>>>>>>> adding
>>>>>>> them to commons math? Are these methods too specialized for
>>>>>>> commons
>>>>>>> math?
>>>>>>>
>>>>>> Can we have a look at the code and documentation?
>>>>>>
>>>>>> If you're interested in seeing the application in action,
>>>>>> you can
>>>>>>> download the full program from www.ItemAnalysis.com. You'll
>>>>>>> notice
>>>>>>> that it also uses an Apache derby database for data management.
>>>>>>>
>>>>>> Is the math code separate from GUI and data management?
>>>>>>
>>>>>>
>>>>>> Regards,
>>>>>> Gilles
>>>>>>
>>>>>> ------------------------------**------------------------------**
>>>>>> ---------
>>>>>>
>>>>>> To unsubscribe, e-mail:
>>>>>> dev-unsubscribe@commons.**apache.org<de...@commons.apache.org>
>>>>>> For additional commands, e-mail: dev-help@commons.apache.org
>>>>>>
>>>>>>
>>>>>> ------------------------------**------------------------------**
>>>>> ---------
>>>>> To unsubscribe, e-mail:
>>>>> dev-unsubscribe@commons.**apache.org<de...@commons.apache.org>
>>>>> For additional commands, e-mail: dev-help@commons.apache.org
>>>>>
>>>>>
>>>>>
>>>> ------------------------------**------------------------------**---------
>>>>
>>>> To unsubscribe, e-mail:
>>>> dev-unsubscribe@commons.**apache.org<de...@commons.apache.org>
>>>> For additional commands, e-mail: dev-help@commons.apache.org
>>>>
>>>>
>>> ------------------------------**------------------------------**---------
>>>
>>> To unsubscribe, e-mail:
>>> dev-unsubscribe@commons.**apache.org<de...@commons.apache.org>
>>> For additional commands, e-mail: dev-help@commons.apache.org
>>>
>>>
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: dev-unsubscribe@commons.apache.org
> For additional commands, e-mail: dev-help@commons.apache.org
>
>
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@commons.apache.org
For additional commands, e-mail: dev-help@commons.apache.org
Re: [math] psychometrics
Posted by Patrick Meyer <me...@gmail.com>.
No, I have written very few tests. Until I recently discovered jUnit, I
was using a very crude way of testing my code. I plan to add more tests
over the coming year.
If you are registered with java.net, you can view the source code at
http://java.net/projects/psychometrics. I have requested that the
project be made public but I don't know how long that will take.
There is one dependency in the polychoric correlation package
(com.itemanalysis.polycor) that could be problematic. The maximum
likelihood estimator requires a multivariate normal (or at least
bivariate normal) CDF. I use the one from
http://vadim.kutsyy.com/java/javadoc/com/kutsyy/util/package-summary.html Are
there plans to add a multivaraite normal CDF function to commons math?
Patrick
On 9/3/2011 12:36 PM, Greg Sterijevski wrote:
> Do you have unit tests written for the different components?
>
> On Sat, Sep 3, 2011 at 10:48 AM, Patrick Meyer<me...@gmail.com> wrote:
>
>> Sounds good. Separating the general purpose stats from the psychometric
>> specific stats seems like a natural way to distinguish the two libraries.
>> I'll send a link to the source code soon. Hopefully, you will see the good
>> ideas in the code.
>>
>>
>> On 9/3/2011 12:57 AM, Phil Steitz wrote:
>>
>>> On 9/2/11 7:19 AM, Patrick Meyer wrote:
>>>
>>>> Yes, the math code is separate from the GUI and database for the
>>>> most part. I'd be happy to share the code and documentation, but I
>>>> need a few days to add it to a repository and get it online.
>>>>
>>>> There are parts of my library that can be transferred to math with
>>>> very few changes but other parts that need more work to make it
>>>> more object oriented in style and less procedural. In any case,
>>>> I'll send information about the code once I have it online.
>>>>
>>> Don't worry too much about making things beautiful. Bad code + good
>>> ideas is the combination that works [1]. The thing to think about
>>> is what portions of your code are really general purpose math. Most
>>> likely kernel regression, polycor, histograms, etc., maybe not so
>>> much test scaling for example. Luc may have some good advice
>>> having done this already with an space dynamics library (or maybe
>>> Luc is so smart that there was no refactoring necessary :)
>>>
>>> What tends to work best is to bring things in incrementally, talking
>>> about the fit and how to integrate.
>>>
>>> Phil
>>>
>>> [1] http://s.apache.org/hZ
>>>
>>>> Patrick
>>>>
>>>> On 9/2/2011 9:26 AM, Gilles Sadowski wrote:
>>>>
>>>>> Hello.
>>>>>
>>>>> I have been developing an pure Java application that does a variety
>>>>>> of psychometric methods. I use the commons math library as much
>>>>>> as I
>>>>>> can but I've also had to develop my own library. I'd like to
>>>>>> combine
>>>>>> the two libraries by donating as much of my code to commons math as
>>>>>> I can. My library includes features for measurement reliability,
>>>>>> test scaling, test equating, polychoric correlations, histogram
>>>>>> computations, kernel regression, etc. Most of these feature are
>>>>>> specialized to psychometrics, but is there any interest in adding
>>>>>> them to commons math? Are these methods too specialized for commons
>>>>>> math?
>>>>>>
>>>>> Can we have a look at the code and documentation?
>>>>>
>>>>> If you're interested in seeing the application in action, you can
>>>>>> download the full program from www.ItemAnalysis.com. You'll notice
>>>>>> that it also uses an Apache derby database for data management.
>>>>>>
>>>>> Is the math code separate from GUI and data management?
>>>>>
>>>>>
>>>>> Regards,
>>>>> Gilles
>>>>>
>>>>> ------------------------------**------------------------------**
>>>>> ---------
>>>>>
>>>>> To unsubscribe, e-mail: dev-unsubscribe@commons.**apache.org<de...@commons.apache.org>
>>>>> For additional commands, e-mail: dev-help@commons.apache.org
>>>>>
>>>>> ------------------------------**------------------------------**
>>>> ---------
>>>> To unsubscribe, e-mail: dev-unsubscribe@commons.**apache.org<de...@commons.apache.org>
>>>> For additional commands, e-mail: dev-help@commons.apache.org
>>>>
>>>>
>>>>
>>> ------------------------------**------------------------------**---------
>>> To unsubscribe, e-mail: dev-unsubscribe@commons.**apache.org<de...@commons.apache.org>
>>> For additional commands, e-mail: dev-help@commons.apache.org
>>>
>>>
>> ------------------------------**------------------------------**---------
>> To unsubscribe, e-mail: dev-unsubscribe@commons.**apache.org<de...@commons.apache.org>
>> For additional commands, e-mail: dev-help@commons.apache.org
>>
>>
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@commons.apache.org
For additional commands, e-mail: dev-help@commons.apache.org
Re: [math] psychometrics
Posted by Greg Sterijevski <gs...@gmail.com>.
Do you have unit tests written for the different components?
On Sat, Sep 3, 2011 at 10:48 AM, Patrick Meyer <me...@gmail.com> wrote:
> Sounds good. Separating the general purpose stats from the psychometric
> specific stats seems like a natural way to distinguish the two libraries.
> I'll send a link to the source code soon. Hopefully, you will see the good
> ideas in the code.
>
>
> On 9/3/2011 12:57 AM, Phil Steitz wrote:
>
>> On 9/2/11 7:19 AM, Patrick Meyer wrote:
>>
>>> Yes, the math code is separate from the GUI and database for the
>>> most part. I'd be happy to share the code and documentation, but I
>>> need a few days to add it to a repository and get it online.
>>>
>>> There are parts of my library that can be transferred to math with
>>> very few changes but other parts that need more work to make it
>>> more object oriented in style and less procedural. In any case,
>>> I'll send information about the code once I have it online.
>>>
>> Don't worry too much about making things beautiful. Bad code + good
>> ideas is the combination that works [1]. The thing to think about
>> is what portions of your code are really general purpose math. Most
>> likely kernel regression, polycor, histograms, etc., maybe not so
>> much test scaling for example. Luc may have some good advice
>> having done this already with an space dynamics library (or maybe
>> Luc is so smart that there was no refactoring necessary :)
>>
>> What tends to work best is to bring things in incrementally, talking
>> about the fit and how to integrate.
>>
>> Phil
>>
>> [1] http://s.apache.org/hZ
>>
>>> Patrick
>>>
>>> On 9/2/2011 9:26 AM, Gilles Sadowski wrote:
>>>
>>>> Hello.
>>>>
>>>> I have been developing an pure Java application that does a variety
>>>>> of psychometric methods. I use the commons math library as much
>>>>> as I
>>>>> can but I've also had to develop my own library. I'd like to
>>>>> combine
>>>>> the two libraries by donating as much of my code to commons math as
>>>>> I can. My library includes features for measurement reliability,
>>>>> test scaling, test equating, polychoric correlations, histogram
>>>>> computations, kernel regression, etc. Most of these feature are
>>>>> specialized to psychometrics, but is there any interest in adding
>>>>> them to commons math? Are these methods too specialized for commons
>>>>> math?
>>>>>
>>>> Can we have a look at the code and documentation?
>>>>
>>>> If you're interested in seeing the application in action, you can
>>>>> download the full program from www.ItemAnalysis.com. You'll notice
>>>>> that it also uses an Apache derby database for data management.
>>>>>
>>>> Is the math code separate from GUI and data management?
>>>>
>>>>
>>>> Regards,
>>>> Gilles
>>>>
>>>> ------------------------------**------------------------------**
>>>> ---------
>>>>
>>>> To unsubscribe, e-mail: dev-unsubscribe@commons.**apache.org<de...@commons.apache.org>
>>>> For additional commands, e-mail: dev-help@commons.apache.org
>>>>
>>>> ------------------------------**------------------------------**
>>> ---------
>>> To unsubscribe, e-mail: dev-unsubscribe@commons.**apache.org<de...@commons.apache.org>
>>> For additional commands, e-mail: dev-help@commons.apache.org
>>>
>>>
>>>
>> ------------------------------**------------------------------**---------
>> To unsubscribe, e-mail: dev-unsubscribe@commons.**apache.org<de...@commons.apache.org>
>> For additional commands, e-mail: dev-help@commons.apache.org
>>
>>
> ------------------------------**------------------------------**---------
> To unsubscribe, e-mail: dev-unsubscribe@commons.**apache.org<de...@commons.apache.org>
> For additional commands, e-mail: dev-help@commons.apache.org
>
>
Re: [math] psychometrics
Posted by Patrick Meyer <me...@gmail.com>.
Sounds good. Separating the general purpose stats from the psychometric
specific stats seems like a natural way to distinguish the two
libraries. I'll send a link to the source code soon. Hopefully, you will
see the good ideas in the code.
On 9/3/2011 12:57 AM, Phil Steitz wrote:
> On 9/2/11 7:19 AM, Patrick Meyer wrote:
>> Yes, the math code is separate from the GUI and database for the
>> most part. I'd be happy to share the code and documentation, but I
>> need a few days to add it to a repository and get it online.
>>
>> There are parts of my library that can be transferred to math with
>> very few changes but other parts that need more work to make it
>> more object oriented in style and less procedural. In any case,
>> I'll send information about the code once I have it online.
> Don't worry too much about making things beautiful. Bad code + good
> ideas is the combination that works [1]. The thing to think about
> is what portions of your code are really general purpose math. Most
> likely kernel regression, polycor, histograms, etc., maybe not so
> much test scaling for example. Luc may have some good advice
> having done this already with an space dynamics library (or maybe
> Luc is so smart that there was no refactoring necessary :)
>
> What tends to work best is to bring things in incrementally, talking
> about the fit and how to integrate.
>
> Phil
>
> [1] http://s.apache.org/hZ
>> Patrick
>>
>> On 9/2/2011 9:26 AM, Gilles Sadowski wrote:
>>> Hello.
>>>
>>>> I have been developing an pure Java application that does a variety
>>>> of psychometric methods. I use the commons math library as much
>>>> as I
>>>> can but I've also had to develop my own library. I'd like to
>>>> combine
>>>> the two libraries by donating as much of my code to commons math as
>>>> I can. My library includes features for measurement reliability,
>>>> test scaling, test equating, polychoric correlations, histogram
>>>> computations, kernel regression, etc. Most of these feature are
>>>> specialized to psychometrics, but is there any interest in adding
>>>> them to commons math? Are these methods too specialized for commons
>>>> math?
>>> Can we have a look at the code and documentation?
>>>
>>>> If you're interested in seeing the application in action, you can
>>>> download the full program from www.ItemAnalysis.com. You'll notice
>>>> that it also uses an Apache derby database for data management.
>>> Is the math code separate from GUI and data management?
>>>
>>>
>>> Regards,
>>> Gilles
>>>
>>> ---------------------------------------------------------------------
>>>
>>> To unsubscribe, e-mail: dev-unsubscribe@commons.apache.org
>>> For additional commands, e-mail: dev-help@commons.apache.org
>>>
>> ---------------------------------------------------------------------
>> To unsubscribe, e-mail: dev-unsubscribe@commons.apache.org
>> For additional commands, e-mail: dev-help@commons.apache.org
>>
>>
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: dev-unsubscribe@commons.apache.org
> For additional commands, e-mail: dev-help@commons.apache.org
>
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@commons.apache.org
For additional commands, e-mail: dev-help@commons.apache.org
Re: [math] psychometrics
Posted by Phil Steitz <ph...@gmail.com>.
On 9/2/11 7:19 AM, Patrick Meyer wrote:
> Yes, the math code is separate from the GUI and database for the
> most part. I'd be happy to share the code and documentation, but I
> need a few days to add it to a repository and get it online.
>
> There are parts of my library that can be transferred to math with
> very few changes but other parts that need more work to make it
> more object oriented in style and less procedural. In any case,
> I'll send information about the code once I have it online.
Don't worry too much about making things beautiful. Bad code + good
ideas is the combination that works [1]. The thing to think about
is what portions of your code are really general purpose math. Most
likely kernel regression, polycor, histograms, etc., maybe not so
much test scaling for example. Luc may have some good advice
having done this already with an space dynamics library (or maybe
Luc is so smart that there was no refactoring necessary :)
What tends to work best is to bring things in incrementally, talking
about the fit and how to integrate.
Phil
[1] http://s.apache.org/hZ
>
> Patrick
>
> On 9/2/2011 9:26 AM, Gilles Sadowski wrote:
>> Hello.
>>
>>> I have been developing an pure Java application that does a variety
>>> of psychometric methods. I use the commons math library as much
>>> as I
>>> can but I've also had to develop my own library. I'd like to
>>> combine
>>> the two libraries by donating as much of my code to commons math as
>>> I can. My library includes features for measurement reliability,
>>> test scaling, test equating, polychoric correlations, histogram
>>> computations, kernel regression, etc. Most of these feature are
>>> specialized to psychometrics, but is there any interest in adding
>>> them to commons math? Are these methods too specialized for commons
>>> math?
>> Can we have a look at the code and documentation?
>>
>>> If you're interested in seeing the application in action, you can
>>> download the full program from www.ItemAnalysis.com. You'll notice
>>> that it also uses an Apache derby database for data management.
>> Is the math code separate from GUI and data management?
>>
>>
>> Regards,
>> Gilles
>>
>> ---------------------------------------------------------------------
>>
>> To unsubscribe, e-mail: dev-unsubscribe@commons.apache.org
>> For additional commands, e-mail: dev-help@commons.apache.org
>>
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: dev-unsubscribe@commons.apache.org
> For additional commands, e-mail: dev-help@commons.apache.org
>
>
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@commons.apache.org
For additional commands, e-mail: dev-help@commons.apache.org
Re: [math] psychometrics
Posted by Patrick Meyer <me...@gmail.com>.
Yes, the math code is separate from the GUI and database for the most
part. I'd be happy to share the code and documentation, but I need a few
days to add it to a repository and get it online.
There are parts of my library that can be transferred to math with very
few changes but other parts that need more work to make it more object
oriented in style and less procedural. In any case, I'll send
information about the code once I have it online.
Patrick
On 9/2/2011 9:26 AM, Gilles Sadowski wrote:
> Hello.
>
>> I have been developing an pure Java application that does a variety
>> of psychometric methods. I use the commons math library as much as I
>> can but I've also had to develop my own library. I'd like to combine
>> the two libraries by donating as much of my code to commons math as
>> I can. My library includes features for measurement reliability,
>> test scaling, test equating, polychoric correlations, histogram
>> computations, kernel regression, etc. Most of these feature are
>> specialized to psychometrics, but is there any interest in adding
>> them to commons math? Are these methods too specialized for commons
>> math?
> Can we have a look at the code and documentation?
>
>> If you're interested in seeing the application in action, you can
>> download the full program from www.ItemAnalysis.com. You'll notice
>> that it also uses an Apache derby database for data management.
> Is the math code separate from GUI and data management?
>
>
> Regards,
> Gilles
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: dev-unsubscribe@commons.apache.org
> For additional commands, e-mail: dev-help@commons.apache.org
>
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@commons.apache.org
For additional commands, e-mail: dev-help@commons.apache.org
Re: [math] psychometrics
Posted by Gilles Sadowski <gi...@harfang.homelinux.org>.
Hello.
>
> I have been developing an pure Java application that does a variety
> of psychometric methods. I use the commons math library as much as I
> can but I've also had to develop my own library. I'd like to combine
> the two libraries by donating as much of my code to commons math as
> I can. My library includes features for measurement reliability,
> test scaling, test equating, polychoric correlations, histogram
> computations, kernel regression, etc. Most of these feature are
> specialized to psychometrics, but is there any interest in adding
> them to commons math? Are these methods too specialized for commons
> math?
Can we have a look at the code and documentation?
> If you're interested in seeing the application in action, you can
> download the full program from www.ItemAnalysis.com. You'll notice
> that it also uses an Apache derby database for data management.
Is the math code separate from GUI and data management?
Regards,
Gilles
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@commons.apache.org
For additional commands, e-mail: dev-help@commons.apache.org