You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@mahout.apache.org by "Hector Yee (JIRA)" <ji...@apache.org> on 2011/06/01 03:32:47 UTC
[jira] [Created] (MAHOUT-716) Implement Boosting
Implement Boosting
------------------
Key: MAHOUT-716
URL: https://issues.apache.org/jira/browse/MAHOUT-716
Project: Mahout
Issue Type: New Feature
Components: Classification
Affects Versions: 0.6
Reporter: Hector Yee
Priority: Minor
Implement boosting (grad boost variant) with l1-regularization and induction.
The gradient part is scalable and parallel and the induction part allows stochastic hypothesis generation for speed.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
Re: [jira] [Commented] (MAHOUT-716) Implement Boosting
Posted by Ted Dunning <te...@gmail.com>.
I am still only intermittent.
On Tue, Jun 14, 2011 at 1:41 AM, Hector Yee (JIRA) <ji...@apache.org> wrote:
>
> [
> https://issues.apache.org/jira/browse/MAHOUT-716?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13048887#comment-13048887]
>
> Hector Yee commented on MAHOUT-716:
> -----------------------------------
>
> Nope, waiting on Ted's feedback.
>
> > Implement Boosting
> > ------------------
> >
> > Key: MAHOUT-716
> > URL: https://issues.apache.org/jira/browse/MAHOUT-716
> > Project: Mahout
> > Issue Type: New Feature
> > Components: Classification
> > Affects Versions: 0.6
> > Reporter: Hector Yee
> > Assignee: Ted Dunning
> > Priority: Minor
> > Labels: features
> > Fix For: 0.6
> >
> > Attachments: MAHOUT-716.patch, MAHOUT-716.patch
> >
> > Original Estimate: 72h
> > Remaining Estimate: 72h
> >
> > Implement boosting (grad boost variant) with l1-regularization and
> induction.
> > The gradient part is scalable and parallel and the induction part allows
> stochastic hypothesis generation for speed.
>
> --
> This message is automatically generated by JIRA.
> For more information on JIRA, see: http://www.atlassian.com/software/jira
>
>
>
Re: [jira] [Assigned] (MAHOUT-716) Implement Boosting
Posted by Hector Yee <he...@gmail.com>.
I have the full version of intellij, would be happy to have a copy of the
ruleset you have
On Sat, Jun 4, 2011 at 1:15 PM, Sean Owen (JIRA) <ji...@apache.org> wrote:
>
> [
> https://issues.apache.org/jira/browse/MAHOUT-716?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel]
>
> Sean Owen reassigned MAHOUT-716:
> --------------------------------
>
> Assignee: Ted Dunning
>
> Let me let Ted comment on this, but more small-scale feedback. This patch
> definitely needs a fair bit more scrub and I will post my version of it.
>
> - java.util.Vector is so 2000. Definitely want to use List/ArrayList
> - You definitely don't want to build strings by new String() and
> concatentation -- try StringBuilder
> - equals() must take Object as a param or it is not actually implemented.
> If you use @Override, the compiler will flag this sort of error.
> - You absolutely must implement hashCode() when implementing equals()
> - Use Java 5 foreach where you can
> - Avoid non-private fields; use protected getters if you want
> - 0 is an int, 0.0 is a double, and while Java silently converts I
> personally prefer being explicit about intent by using 0.0 where a double
> value is meant
> - There are a load of unused imports, including weird ones like the
> JavacCompiler
> - Don't catch Exception
>
> I strongly encourage anyone to just go get the free version of IntelliJ.
> Turn on every one of its code inspection settings. Every source file will
> have like 100 things flagged. Slowly turn off the rules you don't like or
> that don't apply. You will be left with a rule set that flags all of this
> stuff instantly as you look at a file. It's just like night and day to have
> all this stuff literally jump out at you and be fixable with one click
>
> (I am happy to share my personal ruleset which is pretty standard)
>
> > Implement Boosting
> > ------------------
> >
> > Key: MAHOUT-716
> > URL: https://issues.apache.org/jira/browse/MAHOUT-716
> > Project: Mahout
> > Issue Type: New Feature
> > Components: Classification
> > Affects Versions: 0.6
> > Reporter: Hector Yee
> > Assignee: Ted Dunning
> > Priority: Minor
> > Labels: features
> > Fix For: 0.6
> >
> > Attachments: MAHOUT-716.patch, MAHOUT-716.patch
> >
> > Original Estimate: 72h
> > Remaining Estimate: 72h
> >
> > Implement boosting (grad boost variant) with l1-regularization and
> induction.
> > The gradient part is scalable and parallel and the induction part allows
> stochastic hypothesis generation for speed.
>
> --
> This message is automatically generated by JIRA.
> For more information on JIRA, see: http://www.atlassian.com/software/jira
>
--
Yee Yang Li Hector
http://hectorgon.blogspot.com/ (tech + travel)
http://hectorgon.com (book reviews)
Re: [jira] [Updated] (MAHOUT-716) Implement Boosting
Posted by Ted Dunning <te...@gmail.com>.
Not very.
Sent from my iPhone
On Mar 15, 2012, at 7:36 PM, Hector Yee <he...@gmail.com> wrote:
> Is this still alive?
> On Aug 21, 2011 1:55 PM, "Ted Dunning" <te...@gmail.com> wrote:
>
>> I will take a look.
>>
>> On Sun, Aug 21, 2011 at 12:44 PM, Sean Owen (JIRA) <ji...@apache.org>
>> wrote:
>>
>>>
>>> [
>>>
>> https://issues.apache.org/jira/browse/MAHOUT-716?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
>> ]
>>>
>>> Sean Owen updated MAHOUT-716:
>>> -----------------------------
>>>
>>> Affects Version/s: (was: 0.6)
>>> 0.5
>>> Fix Version/s: (was: 0.6)
>>>
>>> Not sure what has happened here -- Ted it was waiting on you?
>>>
>>>> Implement Boosting
>>>> ------------------
>>>>
>>>> Key: MAHOUT-716
>>>> URL: https://issues.apache.org/jira/browse/MAHOUT-716
>>>> Project: Mahout
>>>> Issue Type: New Feature
>>>> Components: Classification
>>>> Affects Versions: 0.5
>>>> Reporter: Hector Yee
>>>> Assignee: Ted Dunning
>>>> Priority: Minor
>>>> Labels: features
>>>> Attachments: MAHOUT-716.patch, MAHOUT-716.patch
>>>>
>>>> Original Estimate: 72h
>>>> Remaining Estimate: 72h
>>>>
>>>> Implement boosting (grad boost variant) with l1-regularization and
>>> induction.
>>>> The gradient part is scalable and parallel and the induction part
>> allows
>>> stochastic hypothesis generation for speed.
>>>
>>> --
>>> This message is automatically generated by JIRA.
>>> For more information on JIRA, see:
>> http://www.atlassian.com/software/jira
>>>
>>>
>>>
>>
Re: [jira] [Updated] (MAHOUT-716) Implement Boosting
Posted by Hector Yee <he...@gmail.com>.
Is this still alive?
On Aug 21, 2011 1:55 PM, "Ted Dunning" <te...@gmail.com> wrote:
> I will take a look.
>
> On Sun, Aug 21, 2011 at 12:44 PM, Sean Owen (JIRA) <ji...@apache.org>
> wrote:
>
> >
> > [
> >
> https://issues.apache.org/jira/browse/MAHOUT-716?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
> ]
> >
> > Sean Owen updated MAHOUT-716:
> > -----------------------------
> >
> > Affects Version/s: (was: 0.6)
> > 0.5
> > Fix Version/s: (was: 0.6)
> >
> > Not sure what has happened here -- Ted it was waiting on you?
> >
> > > Implement Boosting
> > > ------------------
> > >
> > > Key: MAHOUT-716
> > > URL: https://issues.apache.org/jira/browse/MAHOUT-716
> > > Project: Mahout
> > > Issue Type: New Feature
> > > Components: Classification
> > > Affects Versions: 0.5
> > > Reporter: Hector Yee
> > > Assignee: Ted Dunning
> > > Priority: Minor
> > > Labels: features
> > > Attachments: MAHOUT-716.patch, MAHOUT-716.patch
> > >
> > > Original Estimate: 72h
> > > Remaining Estimate: 72h
> > >
> > > Implement boosting (grad boost variant) with l1-regularization and
> > induction.
> > > The gradient part is scalable and parallel and the induction part
> allows
> > stochastic hypothesis generation for speed.
> >
> > --
> > This message is automatically generated by JIRA.
> > For more information on JIRA, see:
> http://www.atlassian.com/software/jira
> >
> >
> >
>
Re: [jira] [Updated] (MAHOUT-716) Implement Boosting
Posted by Ted Dunning <te...@gmail.com>.
I will take a look.
On Sun, Aug 21, 2011 at 12:44 PM, Sean Owen (JIRA) <ji...@apache.org> wrote:
>
> [
> https://issues.apache.org/jira/browse/MAHOUT-716?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel]
>
> Sean Owen updated MAHOUT-716:
> -----------------------------
>
> Affects Version/s: (was: 0.6)
> 0.5
> Fix Version/s: (was: 0.6)
>
> Not sure what has happened here -- Ted it was waiting on you?
>
> > Implement Boosting
> > ------------------
> >
> > Key: MAHOUT-716
> > URL: https://issues.apache.org/jira/browse/MAHOUT-716
> > Project: Mahout
> > Issue Type: New Feature
> > Components: Classification
> > Affects Versions: 0.5
> > Reporter: Hector Yee
> > Assignee: Ted Dunning
> > Priority: Minor
> > Labels: features
> > Attachments: MAHOUT-716.patch, MAHOUT-716.patch
> >
> > Original Estimate: 72h
> > Remaining Estimate: 72h
> >
> > Implement boosting (grad boost variant) with l1-regularization and
> induction.
> > The gradient part is scalable and parallel and the induction part allows
> stochastic hypothesis generation for speed.
>
> --
> This message is automatically generated by JIRA.
> For more information on JIRA, see: http://www.atlassian.com/software/jira
>
>
>
[jira] [Commented] (MAHOUT-716) Implement Boosting
Posted by "Ted Dunning (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAHOUT-716?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13044777#comment-13044777 ]
Ted Dunning commented on MAHOUT-716:
------------------------------------
Hector, I can't get to this right now because of other issues (traveling, at a conference and so on).
Don't let me slow you down. Clone a git repo and go forward assuming success. We will fix up the patches
progressively and you can rebase later developments against trunk as things go along.
You should be able to make progress at full speed this way and the only delays will be a slight delay in adoption
of improvements by others. The uptake of new methods are bounded by social factors in any case and will not happen
on the same time scale in any case.
> Implement Boosting
> ------------------
>
> Key: MAHOUT-716
> URL: https://issues.apache.org/jira/browse/MAHOUT-716
> Project: Mahout
> Issue Type: New Feature
> Components: Classification
> Affects Versions: 0.6
> Reporter: Hector Yee
> Assignee: Ted Dunning
> Priority: Minor
> Labels: features
> Fix For: 0.6
>
> Attachments: MAHOUT-716.patch, MAHOUT-716.patch
>
> Original Estimate: 72h
> Remaining Estimate: 72h
>
> Implement boosting (grad boost variant) with l1-regularization and induction.
> The gradient part is scalable and parallel and the induction part allows stochastic hypothesis generation for speed.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAHOUT-716) Implement Boosting
Posted by "Hector Yee (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAHOUT-716?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13044919#comment-13044919 ]
Hector Yee commented on MAHOUT-716:
-----------------------------------
Yeah I forked a git repo on git hub, it should be much easier to manage than Subversion.
> Implement Boosting
> ------------------
>
> Key: MAHOUT-716
> URL: https://issues.apache.org/jira/browse/MAHOUT-716
> Project: Mahout
> Issue Type: New Feature
> Components: Classification
> Affects Versions: 0.6
> Reporter: Hector Yee
> Assignee: Ted Dunning
> Priority: Minor
> Labels: features
> Fix For: 0.6
>
> Attachments: MAHOUT-716.patch, MAHOUT-716.patch
>
> Original Estimate: 72h
> Remaining Estimate: 72h
>
> Implement boosting (grad boost variant) with l1-regularization and induction.
> The gradient part is scalable and parallel and the induction part allows stochastic hypothesis generation for speed.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAHOUT-716) Implement Boosting
Posted by "Hector Yee (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAHOUT-716?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Hector Yee updated MAHOUT-716:
------------------------------
Fix Version/s: 0.6
> Implement Boosting
> ------------------
>
> Key: MAHOUT-716
> URL: https://issues.apache.org/jira/browse/MAHOUT-716
> Project: Mahout
> Issue Type: New Feature
> Components: Classification
> Affects Versions: 0.6
> Reporter: Hector Yee
> Priority: Minor
> Labels: features
> Fix For: 0.6
>
> Attachments: MAHOUT-716.patch
>
> Original Estimate: 72h
> Remaining Estimate: 72h
>
> Implement boosting (grad boost variant) with l1-regularization and induction.
> The gradient part is scalable and parallel and the induction part allows stochastic hypothesis generation for speed.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAHOUT-716) Implement Boosting
Posted by "Hector Yee (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAHOUT-716?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13048754#comment-13048754 ]
Hector Yee commented on MAHOUT-716:
-----------------------------------
Any news on this patch?
> Implement Boosting
> ------------------
>
> Key: MAHOUT-716
> URL: https://issues.apache.org/jira/browse/MAHOUT-716
> Project: Mahout
> Issue Type: New Feature
> Components: Classification
> Affects Versions: 0.6
> Reporter: Hector Yee
> Assignee: Ted Dunning
> Priority: Minor
> Labels: features
> Fix For: 0.6
>
> Attachments: MAHOUT-716.patch, MAHOUT-716.patch
>
> Original Estimate: 72h
> Remaining Estimate: 72h
>
> Implement boosting (grad boost variant) with l1-regularization and induction.
> The gradient part is scalable and parallel and the induction part allows stochastic hypothesis generation for speed.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAHOUT-716) Implement Boosting
Posted by "Hector Yee (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAHOUT-716?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13043986#comment-13043986 ]
Hector Yee commented on MAHOUT-716:
-----------------------------------
Any feedback on this? I am planning to build more stuff on this that is specific to adaboost such as a debugging tool for the stumps, tools to plot PR curves etc.
> Implement Boosting
> ------------------
>
> Key: MAHOUT-716
> URL: https://issues.apache.org/jira/browse/MAHOUT-716
> Project: Mahout
> Issue Type: New Feature
> Components: Classification
> Affects Versions: 0.6
> Reporter: Hector Yee
> Priority: Minor
> Labels: features
> Fix For: 0.6
>
> Attachments: MAHOUT-716.patch
>
> Original Estimate: 72h
> Remaining Estimate: 72h
>
> Implement boosting (grad boost variant) with l1-regularization and induction.
> The gradient part is scalable and parallel and the induction part allows stochastic hypothesis generation for speed.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAHOUT-716) Implement Boosting
Posted by "Sean Owen (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAHOUT-716?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Sean Owen updated MAHOUT-716:
-----------------------------
Attachment: MAHOUT-716.patch
> Implement Boosting
> ------------------
>
> Key: MAHOUT-716
> URL: https://issues.apache.org/jira/browse/MAHOUT-716
> Project: Mahout
> Issue Type: New Feature
> Components: Classification
> Affects Versions: 0.6
> Reporter: Hector Yee
> Assignee: Ted Dunning
> Priority: Minor
> Labels: features
> Fix For: 0.6
>
> Attachments: MAHOUT-716.patch, MAHOUT-716.patch
>
> Original Estimate: 72h
> Remaining Estimate: 72h
>
> Implement boosting (grad boost variant) with l1-regularization and induction.
> The gradient part is scalable and parallel and the induction part allows stochastic hypothesis generation for speed.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAHOUT-716) Implement Boosting
Posted by "Hector Yee (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAHOUT-716?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13234013#comment-13234013 ]
Hector Yee commented on MAHOUT-716:
-----------------------------------
Thanks for the review Isabel.
The git used to be at https://github.com/klout/mahout_delete
The paper it is based on is here: http://www.cs.berkeley.edu/~jduchi/projects/DuchiSi09_boost.html
I'm hesitant to make changes to it as now I would have to get google's approval to re-submit
> Implement Boosting
> ------------------
>
> Key: MAHOUT-716
> URL: https://issues.apache.org/jira/browse/MAHOUT-716
> Project: Mahout
> Issue Type: New Feature
> Components: Classification
> Affects Versions: 0.5
> Reporter: Hector Yee
> Assignee: Ted Dunning
> Priority: Minor
> Labels: features
> Attachments: MAHOUT-716.patch, MAHOUT-716.patch
>
> Original Estimate: 72h
> Remaining Estimate: 72h
>
> Implement boosting (grad boost variant) with l1-regularization and induction.
> The gradient part is scalable and parallel and the induction part allows stochastic hypothesis generation for speed.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAHOUT-716) Implement Boosting
Posted by "Hector Yee (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAHOUT-716?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13044396#comment-13044396 ]
Hector Yee commented on MAHOUT-716:
-----------------------------------
Thanks for cleaning it up! I'm just starting to re-learn java so this is neat!
> Implement Boosting
> ------------------
>
> Key: MAHOUT-716
> URL: https://issues.apache.org/jira/browse/MAHOUT-716
> Project: Mahout
> Issue Type: New Feature
> Components: Classification
> Affects Versions: 0.6
> Reporter: Hector Yee
> Assignee: Ted Dunning
> Priority: Minor
> Labels: features
> Fix For: 0.6
>
> Attachments: MAHOUT-716.patch, MAHOUT-716.patch
>
> Original Estimate: 72h
> Remaining Estimate: 72h
>
> Implement boosting (grad boost variant) with l1-regularization and induction.
> The gradient part is scalable and parallel and the induction part allows stochastic hypothesis generation for speed.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Assigned] (MAHOUT-716) Implement Boosting
Posted by "Sean Owen (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAHOUT-716?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Sean Owen reassigned MAHOUT-716:
--------------------------------
Assignee: Ted Dunning
Let me let Ted comment on this, but more small-scale feedback. This patch definitely needs a fair bit more scrub and I will post my version of it.
- java.util.Vector is so 2000. Definitely want to use List/ArrayList
- You definitely don't want to build strings by new String() and concatentation -- try StringBuilder
- equals() must take Object as a param or it is not actually implemented. If you use @Override, the compiler will flag this sort of error.
- You absolutely must implement hashCode() when implementing equals()
- Use Java 5 foreach where you can
- Avoid non-private fields; use protected getters if you want
- 0 is an int, 0.0 is a double, and while Java silently converts I personally prefer being explicit about intent by using 0.0 where a double value is meant
- There are a load of unused imports, including weird ones like the JavacCompiler
- Don't catch Exception
I strongly encourage anyone to just go get the free version of IntelliJ. Turn on every one of its code inspection settings. Every source file will have like 100 things flagged. Slowly turn off the rules you don't like or that don't apply. You will be left with a rule set that flags all of this stuff instantly as you look at a file. It's just like night and day to have all this stuff literally jump out at you and be fixable with one click
(I am happy to share my personal ruleset which is pretty standard)
> Implement Boosting
> ------------------
>
> Key: MAHOUT-716
> URL: https://issues.apache.org/jira/browse/MAHOUT-716
> Project: Mahout
> Issue Type: New Feature
> Components: Classification
> Affects Versions: 0.6
> Reporter: Hector Yee
> Assignee: Ted Dunning
> Priority: Minor
> Labels: features
> Fix For: 0.6
>
> Attachments: MAHOUT-716.patch, MAHOUT-716.patch
>
> Original Estimate: 72h
> Remaining Estimate: 72h
>
> Implement boosting (grad boost variant) with l1-regularization and induction.
> The gradient part is scalable and parallel and the induction part allows stochastic hypothesis generation for speed.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAHOUT-716) Implement Boosting
Posted by "Sean Owen (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAHOUT-716?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Sean Owen updated MAHOUT-716:
-----------------------------
Affects Version/s: (was: 0.6)
0.5
Fix Version/s: (was: 0.6)
Not sure what has happened here -- Ted it was waiting on you?
> Implement Boosting
> ------------------
>
> Key: MAHOUT-716
> URL: https://issues.apache.org/jira/browse/MAHOUT-716
> Project: Mahout
> Issue Type: New Feature
> Components: Classification
> Affects Versions: 0.5
> Reporter: Hector Yee
> Assignee: Ted Dunning
> Priority: Minor
> Labels: features
> Attachments: MAHOUT-716.patch, MAHOUT-716.patch
>
> Original Estimate: 72h
> Remaining Estimate: 72h
>
> Implement boosting (grad boost variant) with l1-regularization and induction.
> The gradient part is scalable and parallel and the induction part allows stochastic hypothesis generation for speed.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAHOUT-716) Implement Boosting
Posted by "Hector Yee (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAHOUT-716?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Hector Yee updated MAHOUT-716:
------------------------------
Attachment: MAHOUT-716.patch
> Implement Boosting
> ------------------
>
> Key: MAHOUT-716
> URL: https://issues.apache.org/jira/browse/MAHOUT-716
> Project: Mahout
> Issue Type: New Feature
> Components: Classification
> Affects Versions: 0.6
> Reporter: Hector Yee
> Priority: Minor
> Labels: features
> Attachments: MAHOUT-716.patch
>
> Original Estimate: 72h
> Remaining Estimate: 72h
>
> Implement boosting (grad boost variant) with l1-regularization and induction.
> The gradient part is scalable and parallel and the induction part allows stochastic hypothesis generation for speed.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAHOUT-716) Implement Boosting
Posted by "Hector Yee (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAHOUT-716?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13048887#comment-13048887 ]
Hector Yee commented on MAHOUT-716:
-----------------------------------
Nope, waiting on Ted's feedback.
> Implement Boosting
> ------------------
>
> Key: MAHOUT-716
> URL: https://issues.apache.org/jira/browse/MAHOUT-716
> Project: Mahout
> Issue Type: New Feature
> Components: Classification
> Affects Versions: 0.6
> Reporter: Hector Yee
> Assignee: Ted Dunning
> Priority: Minor
> Labels: features
> Fix For: 0.6
>
> Attachments: MAHOUT-716.patch, MAHOUT-716.patch
>
> Original Estimate: 72h
> Remaining Estimate: 72h
>
> Implement boosting (grad boost variant) with l1-regularization and induction.
> The gradient part is scalable and parallel and the induction part allows stochastic hypothesis generation for speed.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAHOUT-716) Implement Boosting
Posted by "Sean Owen (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAHOUT-716?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13048847#comment-13048847 ]
Sean Owen commented on MAHOUT-716:
----------------------------------
Last we left, I had sent over my version of the patch. Do you have a further update?
I think it's down to Ted being able to take a look then.
> Implement Boosting
> ------------------
>
> Key: MAHOUT-716
> URL: https://issues.apache.org/jira/browse/MAHOUT-716
> Project: Mahout
> Issue Type: New Feature
> Components: Classification
> Affects Versions: 0.6
> Reporter: Hector Yee
> Assignee: Ted Dunning
> Priority: Minor
> Labels: features
> Fix For: 0.6
>
> Attachments: MAHOUT-716.patch, MAHOUT-716.patch
>
> Original Estimate: 72h
> Remaining Estimate: 72h
>
> Implement boosting (grad boost variant) with l1-regularization and induction.
> The gradient part is scalable and parallel and the induction part allows stochastic hypothesis generation for speed.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAHOUT-716) Implement Boosting
Posted by "Isabel Drost (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAHOUT-716?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13233818#comment-13233818 ]
Isabel Drost commented on MAHOUT-716:
-------------------------------------
After not much activity - took a brief look at the patch. Some comments (to be taken with a grain of salt after I didn't have the cycles to follow the project as closely as I would have liked in the past months):
You mentioned a forked git repo on github - is it still online?
So far looks like a rather isolated change. Would it make sense to integrate it with existing classification APIs e.g. org.apache.mahout.classifier.AbstractVectorClassifier?
Also some more documentation and a usage example for the un-initiated would be great: In addition to links to one or two publications the implementation is based on it's always great to have some information on the strengths and weaknesses of the implemented solution (yes, I know we are doing pretty badly along these lines with other bits and pieces we have - still would be nice to have).
> Implement Boosting
> ------------------
>
> Key: MAHOUT-716
> URL: https://issues.apache.org/jira/browse/MAHOUT-716
> Project: Mahout
> Issue Type: New Feature
> Components: Classification
> Affects Versions: 0.5
> Reporter: Hector Yee
> Assignee: Ted Dunning
> Priority: Minor
> Labels: features
> Attachments: MAHOUT-716.patch, MAHOUT-716.patch
>
> Original Estimate: 72h
> Remaining Estimate: 72h
>
> Implement boosting (grad boost variant) with l1-regularization and induction.
> The gradient part is scalable and parallel and the induction part allows stochastic hypothesis generation for speed.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAHOUT-716) Implement Boosting
Posted by "Hector Yee (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAHOUT-716?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Hector Yee updated MAHOUT-716:
------------------------------
Status: Patch Available (was: Open)
Implement boosting with decision stumps trained by Gradboost. For technical details see "Boosting with structural sparsity" by Duchi and Singer.
> Implement Boosting
> ------------------
>
> Key: MAHOUT-716
> URL: https://issues.apache.org/jira/browse/MAHOUT-716
> Project: Mahout
> Issue Type: New Feature
> Components: Classification
> Affects Versions: 0.6
> Reporter: Hector Yee
> Priority: Minor
> Labels: features
> Original Estimate: 72h
> Remaining Estimate: 72h
>
> Implement boosting (grad boost variant) with l1-regularization and induction.
> The gradient part is scalable and parallel and the induction part allows stochastic hypothesis generation for speed.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira