You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@mahout.apache.org by "Deneche A. Hakim (JIRA)" <ji...@apache.org> on 2010/10/16 17:50:22 UTC
[jira] Created: (MAHOUT-526) Infinite Recursion in
DefaultTreeBuilder
Infinite Recursion in DefaultTreeBuilder
----------------------------------------
Key: MAHOUT-526
URL: https://issues.apache.org/jira/browse/MAHOUT-526
Project: Mahout
Issue Type: Bug
Components: Classification
Reporter: Deneche A. Hakim
Assignee: Deneche A. Hakim
In some cases, building a random forest with a dataset that contains many numerical attributes, the DefaultTreeBuilder enters in an infinite recursion and throws a StackOverflowError.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (MAHOUT-526) Infinite Recursion in
DefaultTreeBuilder
Posted by "Deneche A. Hakim (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAHOUT-526?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Deneche A. Hakim updated MAHOUT-526:
------------------------------------
Attachment: mahout-526.patch
This patch adds both a unit test and a fix to the StackOverflowError problem
> Infinite Recursion in DefaultTreeBuilder
> ----------------------------------------
>
> Key: MAHOUT-526
> URL: https://issues.apache.org/jira/browse/MAHOUT-526
> Project: Mahout
> Issue Type: Bug
> Components: Classification
> Reporter: Deneche A. Hakim
> Assignee: Deneche A. Hakim
> Attachments: decision_tree_data, mahout-526.patch
>
>
> In some cases, building a random forest with a dataset that contains many numerical attributes, the DefaultTreeBuilder enters in an infinite recursion and throws a StackOverflowError.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (MAHOUT-526) Infinite Recursion in
DefaultTreeBuilder
Posted by "Deneche A. Hakim (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAHOUT-526?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Deneche A. Hakim updated MAHOUT-526:
------------------------------------
Attachment: decision_tree_data
Trying to build a forest using the attached dataset will throw an Exception. Thanks to Andrey Gusev who kindly shared this dataset.
> Infinite Recursion in DefaultTreeBuilder
> ----------------------------------------
>
> Key: MAHOUT-526
> URL: https://issues.apache.org/jira/browse/MAHOUT-526
> Project: Mahout
> Issue Type: Bug
> Components: Classification
> Reporter: Deneche A. Hakim
> Assignee: Deneche A. Hakim
> Attachments: decision_tree_data
>
>
> In some cases, building a random forest with a dataset that contains many numerical attributes, the DefaultTreeBuilder enters in an infinite recursion and throws a StackOverflowError.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (MAHOUT-526) Infinite Recursion in
DefaultTreeBuilder
Posted by "Deneche A. Hakim (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAHOUT-526?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12922607#action_12922607 ]
Deneche A. Hakim commented on MAHOUT-526:
-----------------------------------------
I was able to find the smallest subset of the dataset, that makes the Builder throw a StackOverflowError. It's the following four instances:
{noformat}0.25, 0.0, 0.0, 5.143998668220409E-4, 0.019847102289905324, 3.5216524641879855E-4, 0.0, 0.6225857142857143, 4
0.25, 0.0, 0.0, 0.0010504411519893459, 0.005462138323171171, 0.0026130744829756746, 0.0, 0.4964857142857143, 3
0.25, 0.0, 0.0, 0.0010504411519893459, 0.005462138323171171, 0.0026130744829756746, 0.0, 0.4964857142857143, 4
0.25, 0.0, 0.0, 5.143998668220409E-4, 0.019847102289905324, 3.5216524641879855E-4, 0.0, 0.6225857142857143, 3{noformat}
Now I will be able to debug and see what's causing this and how to prevent it.
> Infinite Recursion in DefaultTreeBuilder
> ----------------------------------------
>
> Key: MAHOUT-526
> URL: https://issues.apache.org/jira/browse/MAHOUT-526
> Project: Mahout
> Issue Type: Bug
> Components: Classification
> Reporter: Deneche A. Hakim
> Assignee: Deneche A. Hakim
> Attachments: decision_tree_data
>
>
> In some cases, building a random forest with a dataset that contains many numerical attributes, the DefaultTreeBuilder enters in an infinite recursion and throws a StackOverflowError.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (MAHOUT-526) Infinite Recursion in
DefaultTreeBuilder
Posted by "Deneche A. Hakim (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAHOUT-526?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Deneche A. Hakim updated MAHOUT-526:
------------------------------------
Resolution: Fixed
Status: Resolved (was: Patch Available)
committed the patch
> Infinite Recursion in DefaultTreeBuilder
> ----------------------------------------
>
> Key: MAHOUT-526
> URL: https://issues.apache.org/jira/browse/MAHOUT-526
> Project: Mahout
> Issue Type: Bug
> Components: Classification
> Affects Versions: 0.5
> Reporter: Deneche A. Hakim
> Assignee: Deneche A. Hakim
> Fix For: 0.5
>
> Attachments: decision_tree_data, mahout-526.patch
>
>
> In some cases, building a random forest with a dataset that contains many numerical attributes, the DefaultTreeBuilder enters in an infinite recursion and throws a StackOverflowError.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (MAHOUT-526) Infinite Recursion in
DefaultTreeBuilder
Posted by "Hudson (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAHOUT-526?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12927221#action_12927221 ]
Hudson commented on MAHOUT-526:
-------------------------------
Integrated in Mahout-Quality #442 (See [https://hudson.apache.org/hudson/job/Mahout-Quality/442/])
> Infinite Recursion in DefaultTreeBuilder
> ----------------------------------------
>
> Key: MAHOUT-526
> URL: https://issues.apache.org/jira/browse/MAHOUT-526
> Project: Mahout
> Issue Type: Bug
> Components: Classification
> Affects Versions: 0.5
> Reporter: Deneche A. Hakim
> Assignee: Deneche A. Hakim
> Fix For: 0.5
>
> Attachments: decision_tree_data, mahout-526.patch
>
>
> In some cases, building a random forest with a dataset that contains many numerical attributes, the DefaultTreeBuilder enters in an infinite recursion and throws a StackOverflowError.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (MAHOUT-526) Infinite Recursion in
DefaultTreeBuilder
Posted by "Deneche A. Hakim (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAHOUT-526?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Deneche A. Hakim updated MAHOUT-526:
------------------------------------
Fix Version/s: 0.5
Affects Version/s: 0.5
Status: Patch Available (was: Open)
I will need to test this patch on previous datasets and see if the results are the same. Then I should be able to commit it as soon as the "code freeze" ends
> Infinite Recursion in DefaultTreeBuilder
> ----------------------------------------
>
> Key: MAHOUT-526
> URL: https://issues.apache.org/jira/browse/MAHOUT-526
> Project: Mahout
> Issue Type: Bug
> Components: Classification
> Affects Versions: 0.5
> Reporter: Deneche A. Hakim
> Assignee: Deneche A. Hakim
> Fix For: 0.5
>
> Attachments: decision_tree_data, mahout-526.patch
>
>
> In some cases, building a random forest with a dataset that contains many numerical attributes, the DefaultTreeBuilder enters in an infinite recursion and throws a StackOverflowError.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.