You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@mahout.apache.org by "Stuart Smith (Created) (JIRA)" <ji...@apache.org> on 2012/01/19 21:16:41 UTC
[jira] [Created] (MAHOUT-952) ARFFVectorIterable/MapBackedArffModel
doesn't handle question mark '?', other ARFF issues
ARFFVectorIterable/MapBackedArffModel doesn't handle question mark '?', other ARFF issues
-----------------------------------------------------------------------------------------
Key: MAHOUT-952
URL: https://issues.apache.org/jira/browse/MAHOUT-952
Project: Mahout
Issue Type: Bug
Components: Integration
Affects Versions: 0.6
Environment: Latest SVN on ubuntu
Reporter: Stuart Smith
Priority: Minor
Whatever is parsing the ARFF file for the ARFFVectorIterable (As far as I can tell, it's the class itself) doesn't handle '?' as a marker for unknown value. See: http://www.cs.waikato.ac.nz/~ml/weka/arff.html
I just started looking at Mahout classifiers this week, so I'm not sure how to handle this yet. If I figure it out, I'll post a patch, but until then, guidance would be helpful!
Off topic, but I'm also having some issue were the labels populated in the map apparently aren't coming from the Attribute Header at the top of the file. I have very sparse vectors (1800+ attributes, only a few hundred set for any given before).. and I keep getting IndexOutOfBounds or mismatched cardinality issues, depending on whether I use full ARFF or sparse ARFF. Either way, when I dump the Labels from getModel(), it doesn't have them all.. even if I parse the ARFF myself, and call setLabel() (Apparently just throws that away). Looks like the DenseVectors keep thinking the cardinality is 534, when it should be 1800+.... when I know more, I'll create a new issue
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAHOUT-952)
ARFFVectorIterable/MapBackedArffModel doesn't handle question mark '?',
other ARFF issues
Posted by "Dave Kor (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAHOUT-952?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13216228#comment-13216228 ]
Dave Kor commented on MAHOUT-952:
---------------------------------
Yes, I am using DenseInstance since my dataset have data values 99.9% of the time. On a related note, I just found another bug with ArffVectorIterable breaking down when the .arff file contain instance weights. I will open a new issue for this.
> ARFFVectorIterable/MapBackedArffModel doesn't handle question mark '?', other ARFF issues
> -----------------------------------------------------------------------------------------
>
> Key: MAHOUT-952
> URL: https://issues.apache.org/jira/browse/MAHOUT-952
> Project: Mahout
> Issue Type: Bug
> Components: Integration
> Affects Versions: 0.6
> Environment: Latest SVN on ubuntu
> Reporter: Stuart Smith
> Priority: Minor
> Labels: ARFF
> Attachments: MAHOUT-952.patch
>
>
> Whatever is parsing the ARFF file for the ARFFVectorIterable (As far as I can tell, it's the class itself) doesn't handle '?' as a marker for unknown value. See: http://www.cs.waikato.ac.nz/~ml/weka/arff.html
> I just started looking at Mahout classifiers this week, so I'm not sure how to handle this yet. If I figure it out, I'll post a patch, but until then, guidance would be helpful!
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAHOUT-952)
ARFFVectorIterable/MapBackedArffModel doesn't handle question mark '?',
other ARFF issues
Posted by "Dave Kor (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAHOUT-952?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13211682#comment-13211682 ]
Dave Kor commented on MAHOUT-952:
---------------------------------
I am facing a similar issue here. Assuming the missing values aren't very important, you can create a .arff that does not contain missing values using Weka's ReplaceMissingValues filter to replace missing values with the attribute's mean.
> ARFFVectorIterable/MapBackedArffModel doesn't handle question mark '?', other ARFF issues
> -----------------------------------------------------------------------------------------
>
> Key: MAHOUT-952
> URL: https://issues.apache.org/jira/browse/MAHOUT-952
> Project: Mahout
> Issue Type: Bug
> Components: Integration
> Affects Versions: 0.6
> Environment: Latest SVN on ubuntu
> Reporter: Stuart Smith
> Priority: Minor
> Labels: ARFF
>
> Whatever is parsing the ARFF file for the ARFFVectorIterable (As far as I can tell, it's the class itself) doesn't handle '?' as a marker for unknown value. See: http://www.cs.waikato.ac.nz/~ml/weka/arff.html
> I just started looking at Mahout classifiers this week, so I'm not sure how to handle this yet. If I figure it out, I'll post a patch, but until then, guidance would be helpful!
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Issue Comment Edited] (MAHOUT-952)
ARFFVectorIterable/MapBackedArffModel doesn't handle question mark '?',
other ARFF issues
Posted by "Dave Kor (Issue Comment Edited) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAHOUT-952?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13216228#comment-13216228 ]
Dave Kor edited comment on MAHOUT-952 at 2/25/12 2:57 AM:
----------------------------------------------------------
Yes, I am using weka's DenseInstance since my dataset have data values 99.9% of the time.
I had a look at your patch and may I kindly suggest that instead of testing every single string for '?', a better fix would be to add a try-catch block in MapBackedArffModel.processNumeric. If I am not wrong (can I could be), only missing numeric values are encoded as '?' so it makes sense to only do something when the parsing in processNumeric fails.
was (Author: davekor):
Yes, I am using weka's DenseInstance since my dataset have data values 99.9% of the time.
I had a look at your patch and may I kindly suggest that a better fix would be to add a try-catch block in MapBackedArffModel.processNumeric since, if I am not wrong (can I could be), only missing numeric values are encoded as '?'.
> ARFFVectorIterable/MapBackedArffModel doesn't handle question mark '?', other ARFF issues
> -----------------------------------------------------------------------------------------
>
> Key: MAHOUT-952
> URL: https://issues.apache.org/jira/browse/MAHOUT-952
> Project: Mahout
> Issue Type: Bug
> Components: Integration
> Affects Versions: 0.6
> Environment: Latest SVN on ubuntu
> Reporter: Stuart Smith
> Priority: Minor
> Labels: ARFF
> Attachments: MAHOUT-952.patch
>
>
> Whatever is parsing the ARFF file for the ARFFVectorIterable (As far as I can tell, it's the class itself) doesn't handle '?' as a marker for unknown value. See: http://www.cs.waikato.ac.nz/~ml/weka/arff.html
> I just started looking at Mahout classifiers this week, so I'm not sure how to handle this yet. If I figure it out, I'll post a patch, but until then, guidance would be helpful!
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAHOUT-952)
ARFFVectorIterable/MapBackedArffModel doesn't handle question mark '?',
other ARFF issues
Posted by "Dave Kor (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAHOUT-952?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13216713#comment-13216713 ]
Dave Kor commented on MAHOUT-952:
---------------------------------
I really can't say as my datasets uses purely numeric attributes. I have no idea how missing values are represented for other datatypes, sorry.
> ARFFVectorIterable/MapBackedArffModel doesn't handle question mark '?', other ARFF issues
> -----------------------------------------------------------------------------------------
>
> Key: MAHOUT-952
> URL: https://issues.apache.org/jira/browse/MAHOUT-952
> Project: Mahout
> Issue Type: Bug
> Components: Integration
> Affects Versions: 0.6
> Environment: Latest SVN on ubuntu
> Reporter: Stuart Smith
> Priority: Minor
> Labels: ARFF
> Attachments: MAHOUT-952.patch
>
>
> Whatever is parsing the ARFF file for the ARFFVectorIterable (As far as I can tell, it's the class itself) doesn't handle '?' as a marker for unknown value. See: http://www.cs.waikato.ac.nz/~ml/weka/arff.html
> I just started looking at Mahout classifiers this week, so I'm not sure how to handle this yet. If I figure it out, I'll post a patch, but until then, guidance would be helpful!
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Issue Comment Edited] (MAHOUT-952)
ARFFVectorIterable/MapBackedArffModel doesn't handle question mark '?',
other ARFF issues
Posted by "Dave Kor (Issue Comment Edited) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAHOUT-952?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13216228#comment-13216228 ]
Dave Kor edited comment on MAHOUT-952 at 2/25/12 2:59 AM:
----------------------------------------------------------
Yes, I am using weka's DenseInstance since my dataset have data values 99.9% of the time.
I had a look at your patch and may I kindly suggest that instead of testing every single string for '?', a better fix would be to add a try-catch block in MapBackedArffModel.processNumeric. If I am not wrong (can I could be), only missing numeric values are encoded as '?' so it makes sense to only do something when the Double.parseDouble(...) in processNumeric throws an exception.
was (Author: davekor):
Yes, I am using weka's DenseInstance since my dataset have data values 99.9% of the time.
I had a look at your patch and may I kindly suggest that instead of testing every single string for '?', a better fix would be to add a try-catch block in MapBackedArffModel.processNumeric. If I am not wrong (can I could be), only missing numeric values are encoded as '?' so it makes sense to only do something when the parsing in processNumeric fails.
> ARFFVectorIterable/MapBackedArffModel doesn't handle question mark '?', other ARFF issues
> -----------------------------------------------------------------------------------------
>
> Key: MAHOUT-952
> URL: https://issues.apache.org/jira/browse/MAHOUT-952
> Project: Mahout
> Issue Type: Bug
> Components: Integration
> Affects Versions: 0.6
> Environment: Latest SVN on ubuntu
> Reporter: Stuart Smith
> Priority: Minor
> Labels: ARFF
> Attachments: MAHOUT-952.patch
>
>
> Whatever is parsing the ARFF file for the ARFFVectorIterable (As far as I can tell, it's the class itself) doesn't handle '?' as a marker for unknown value. See: http://www.cs.waikato.ac.nz/~ml/weka/arff.html
> I just started looking at Mahout classifiers this week, so I'm not sure how to handle this yet. If I figure it out, I'll post a patch, but until then, guidance would be helpful!
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Issue Comment Edited] (MAHOUT-952)
ARFFVectorIterable/MapBackedArffModel doesn't handle question mark '?',
other ARFF issues
Posted by "Dave Kor (Issue Comment Edited) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAHOUT-952?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13216228#comment-13216228 ]
Dave Kor edited comment on MAHOUT-952 at 2/25/12 2:52 AM:
----------------------------------------------------------
Yes, I am using weka's DenseInstance since my dataset have data values 99.9% of the time.
I had a look at your patch and may I kindly suggest that a better fix would be to add a try-catch block in MapBackedArffModel.processNumeric since, if I am not wrong (can I could be), only missing numeric values are encoded as '?'.
was (Author: davekor):
Yes, I am using DenseInstance since my dataset have data values 99.9% of the time. I had a look at your patch and may I kindly suggest that a better fix would be to add a try-catch block in MapBackedArffModel.processNumeric since, if I am not wrong (can I could be), only missing numeric values are encoded as '?'.
> ARFFVectorIterable/MapBackedArffModel doesn't handle question mark '?', other ARFF issues
> -----------------------------------------------------------------------------------------
>
> Key: MAHOUT-952
> URL: https://issues.apache.org/jira/browse/MAHOUT-952
> Project: Mahout
> Issue Type: Bug
> Components: Integration
> Affects Versions: 0.6
> Environment: Latest SVN on ubuntu
> Reporter: Stuart Smith
> Priority: Minor
> Labels: ARFF
> Attachments: MAHOUT-952.patch
>
>
> Whatever is parsing the ARFF file for the ARFFVectorIterable (As far as I can tell, it's the class itself) doesn't handle '?' as a marker for unknown value. See: http://www.cs.waikato.ac.nz/~ml/weka/arff.html
> I just started looking at Mahout classifiers this week, so I'm not sure how to handle this yet. If I figure it out, I'll post a patch, but until then, guidance would be helpful!
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Issue Comment Edited] (MAHOUT-952)
ARFFVectorIterable/MapBackedArffModel doesn't handle question mark '?',
other ARFF issues
Posted by "Dave Kor (Issue Comment Edited) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAHOUT-952?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13216228#comment-13216228 ]
Dave Kor edited comment on MAHOUT-952 at 2/25/12 2:51 AM:
----------------------------------------------------------
Yes, I am using DenseInstance since my dataset have data values 99.9% of the time. I had a look at your patch and may I kindly suggest that a better fix would be to add a try-catch block in MapBackedArffModel.processNumeric since, if I am not wrong (can I could be), only missing numeric values are encoded as '?'.
was (Author: davekor):
Yes, I am using DenseInstance since my dataset have data values 99.9% of the time. On a related note, I just found another bug with ArffVectorIterable breaking down when the .arff file contain instance weights. I will open a new issue for this.
> ARFFVectorIterable/MapBackedArffModel doesn't handle question mark '?', other ARFF issues
> -----------------------------------------------------------------------------------------
>
> Key: MAHOUT-952
> URL: https://issues.apache.org/jira/browse/MAHOUT-952
> Project: Mahout
> Issue Type: Bug
> Components: Integration
> Affects Versions: 0.6
> Environment: Latest SVN on ubuntu
> Reporter: Stuart Smith
> Priority: Minor
> Labels: ARFF
> Attachments: MAHOUT-952.patch
>
>
> Whatever is parsing the ARFF file for the ARFFVectorIterable (As far as I can tell, it's the class itself) doesn't handle '?' as a marker for unknown value. See: http://www.cs.waikato.ac.nz/~ml/weka/arff.html
> I just started looking at Mahout classifiers this week, so I'm not sure how to handle this yet. If I figure it out, I'll post a patch, but until then, guidance would be helpful!
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAHOUT-952)
ARFFVectorIterable/MapBackedArffModel doesn't handle question mark '?',
other ARFF issues
Posted by "Joe Prasanna Kumar (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAHOUT-952?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13217015#comment-13217015 ]
Joe Prasanna Kumar commented on MAHOUT-952:
-------------------------------------------
sure. I'll upload a patch with a fix for handling "?" in sparse ARFF files and also modify the test cases to reflect the "?" cases
> ARFFVectorIterable/MapBackedArffModel doesn't handle question mark '?', other ARFF issues
> -----------------------------------------------------------------------------------------
>
> Key: MAHOUT-952
> URL: https://issues.apache.org/jira/browse/MAHOUT-952
> Project: Mahout
> Issue Type: Bug
> Components: Integration
> Affects Versions: 0.6
> Environment: Latest SVN on ubuntu
> Reporter: Stuart Smith
> Priority: Minor
> Labels: ARFF
> Attachments: MAHOUT-952.patch
>
>
> Whatever is parsing the ARFF file for the ARFFVectorIterable (As far as I can tell, it's the class itself) doesn't handle '?' as a marker for unknown value. See: http://www.cs.waikato.ac.nz/~ml/weka/arff.html
> I just started looking at Mahout classifiers this week, so I'm not sure how to handle this yet. If I figure it out, I'll post a patch, but until then, guidance would be helpful!
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAHOUT-952) ARFFVectorIterable/MapBackedArffModel
doesn't handle question mark '?', other ARFF issues
Posted by "Stuart Smith (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAHOUT-952?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Stuart Smith updated MAHOUT-952:
--------------------------------
Description:
Whatever is parsing the ARFF file for the ARFFVectorIterable (As far as I can tell, it's the class itself) doesn't handle '?' as a marker for unknown value. See: http://www.cs.waikato.ac.nz/~ml/weka/arff.html
I just started looking at Mahout classifiers this week, so I'm not sure how to handle this yet. If I figure it out, I'll post a patch, but until then, guidance would be helpful!
was:
Whatever is parsing the ARFF file for the ARFFVectorIterable (As far as I can tell, it's the class itself) doesn't handle '?' as a marker for unknown value. See: http://www.cs.waikato.ac.nz/~ml/weka/arff.html
I just started looking at Mahout classifiers this week, so I'm not sure how to handle this yet. If I figure it out, I'll post a patch, but until then, guidance would be helpful!
Off topic, but I'm also having some issue were the labels populated in the map apparently aren't coming from the Attribute Header at the top of the file. I have very sparse vectors (1800+ attributes, only a few hundred set for any given before).. and I keep getting IndexOutOfBounds or mismatched cardinality issues, depending on whether I use full ARFF or sparse ARFF. Either way, when I dump the Labels from getModel(), it doesn't have them all.. even if I parse the ARFF myself, and call setLabel() (Apparently just throws that away). Looks like the DenseVectors keep thinking the cardinality is 534, when it should be 1800+.... when I know more, I'll create a new issue
> ARFFVectorIterable/MapBackedArffModel doesn't handle question mark '?', other ARFF issues
> -----------------------------------------------------------------------------------------
>
> Key: MAHOUT-952
> URL: https://issues.apache.org/jira/browse/MAHOUT-952
> Project: Mahout
> Issue Type: Bug
> Components: Integration
> Affects Versions: 0.6
> Environment: Latest SVN on ubuntu
> Reporter: Stuart Smith
> Priority: Minor
> Labels: ARFF
>
> Whatever is parsing the ARFF file for the ARFFVectorIterable (As far as I can tell, it's the class itself) doesn't handle '?' as a marker for unknown value. See: http://www.cs.waikato.ac.nz/~ml/weka/arff.html
> I just started looking at Mahout classifiers this week, so I'm not sure how to handle this yet. If I figure it out, I'll post a patch, but until then, guidance would be helpful!
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAHOUT-952)
ARFFVectorIterable/MapBackedArffModel doesn't handle question mark '?',
other ARFF issues
Posted by "Joe Prasanna Kumar (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAHOUT-952?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13216601#comment-13216601 ]
Joe Prasanna Kumar commented on MAHOUT-952:
-------------------------------------------
Dave,
Thanks for your suggestion.
I was going over http://www.cs.waikato.ac.nz/~ml/weka/arff.html and see that there is no specific reference of using ? for missing numeric values. It says "Missing values are represented by a single question mark" so it might be safe to assume that missing string / date / nominal attributes could be indicated with a ? So instead of adding the condition to each of the processString / processDate etc, I thought it might be better to add in ARFFIterator.
Also I see a reference of using ? in Sparse ARFF files. So I guess it might be better to handle Sparse ARFF files. let me know your thoughts.
> ARFFVectorIterable/MapBackedArffModel doesn't handle question mark '?', other ARFF issues
> -----------------------------------------------------------------------------------------
>
> Key: MAHOUT-952
> URL: https://issues.apache.org/jira/browse/MAHOUT-952
> Project: Mahout
> Issue Type: Bug
> Components: Integration
> Affects Versions: 0.6
> Environment: Latest SVN on ubuntu
> Reporter: Stuart Smith
> Priority: Minor
> Labels: ARFF
> Attachments: MAHOUT-952.patch
>
>
> Whatever is parsing the ARFF file for the ARFFVectorIterable (As far as I can tell, it's the class itself) doesn't handle '?' as a marker for unknown value. See: http://www.cs.waikato.ac.nz/~ml/weka/arff.html
> I just started looking at Mahout classifiers this week, so I'm not sure how to handle this yet. If I figure it out, I'll post a patch, but until then, guidance would be helpful!
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAHOUT-952)
ARFFVectorIterable/MapBackedArffModel doesn't handle question mark '?',
other ARFF issues
Posted by "Joe Prasanna Kumar (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAHOUT-952?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13211697#comment-13211697 ]
Joe Prasanna Kumar commented on MAHOUT-952:
-------------------------------------------
Dave / Stuart,
I am assuming that you face this issue with dense ARFF files. If so, I can upload a patch. please try it out and let me know if you still hit this issue. If you have seen sparse ARFF files using "?" (that kinda defeats the purpose of sparse ARFF files) let me know your thoughts, i'll add a fix for that as well.
reg
Joe.
> ARFFVectorIterable/MapBackedArffModel doesn't handle question mark '?', other ARFF issues
> -----------------------------------------------------------------------------------------
>
> Key: MAHOUT-952
> URL: https://issues.apache.org/jira/browse/MAHOUT-952
> Project: Mahout
> Issue Type: Bug
> Components: Integration
> Affects Versions: 0.6
> Environment: Latest SVN on ubuntu
> Reporter: Stuart Smith
> Priority: Minor
> Labels: ARFF
>
> Whatever is parsing the ARFF file for the ARFFVectorIterable (As far as I can tell, it's the class itself) doesn't handle '?' as a marker for unknown value. See: http://www.cs.waikato.ac.nz/~ml/weka/arff.html
> I just started looking at Mahout classifiers this week, so I'm not sure how to handle this yet. If I figure it out, I'll post a patch, but until then, guidance would be helpful!
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Issue Comment Edited] (MAHOUT-952)
ARFFVectorIterable/MapBackedArffModel doesn't handle question mark '?',
other ARFF issues
Posted by "Joe Prasanna Kumar (Issue Comment Edited) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAHOUT-952?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13211699#comment-13211699 ]
Joe Prasanna Kumar edited comment on MAHOUT-952 at 2/20/12 7:00 AM:
--------------------------------------------------------------------
the attached patch addresses the "?" issue for the case of dense arff files
was (Author: joekumar):
address the "?" issue for the case of dense arff files
> ARFFVectorIterable/MapBackedArffModel doesn't handle question mark '?', other ARFF issues
> -----------------------------------------------------------------------------------------
>
> Key: MAHOUT-952
> URL: https://issues.apache.org/jira/browse/MAHOUT-952
> Project: Mahout
> Issue Type: Bug
> Components: Integration
> Affects Versions: 0.6
> Environment: Latest SVN on ubuntu
> Reporter: Stuart Smith
> Priority: Minor
> Labels: ARFF
> Attachments: MAHOUT-952.patch
>
>
> Whatever is parsing the ARFF file for the ARFFVectorIterable (As far as I can tell, it's the class itself) doesn't handle '?' as a marker for unknown value. See: http://www.cs.waikato.ac.nz/~ml/weka/arff.html
> I just started looking at Mahout classifiers this week, so I'm not sure how to handle this yet. If I figure it out, I'll post a patch, but until then, guidance would be helpful!
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAHOUT-952) ARFFVectorIterable/MapBackedArffModel
doesn't handle question mark '?', other ARFF issues
Posted by "Joe Prasanna Kumar (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAHOUT-952?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Joe Prasanna Kumar updated MAHOUT-952:
--------------------------------------
Attachment: MAHOUT-952.patch
address the "?" issue for the case of dense arff files
> ARFFVectorIterable/MapBackedArffModel doesn't handle question mark '?', other ARFF issues
> -----------------------------------------------------------------------------------------
>
> Key: MAHOUT-952
> URL: https://issues.apache.org/jira/browse/MAHOUT-952
> Project: Mahout
> Issue Type: Bug
> Components: Integration
> Affects Versions: 0.6
> Environment: Latest SVN on ubuntu
> Reporter: Stuart Smith
> Priority: Minor
> Labels: ARFF
> Attachments: MAHOUT-952.patch
>
>
> Whatever is parsing the ARFF file for the ARFFVectorIterable (As far as I can tell, it's the class itself) doesn't handle '?' as a marker for unknown value. See: http://www.cs.waikato.ac.nz/~ml/weka/arff.html
> I just started looking at Mahout classifiers this week, so I'm not sure how to handle this yet. If I figure it out, I'll post a patch, but until then, guidance would be helpful!
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira