You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@spark.apache.org by "Joseph K. Bradley (JIRA)" <ji...@apache.org> on 2018/03/19 21:12:00 UTC

[jira] [Created] (SPARK-23740) Add FPGrowth Param for filtering out very common items

Joseph K. Bradley created SPARK-23740:
-----------------------------------------

             Summary: Add FPGrowth Param for filtering out very common items
                 Key: SPARK-23740
                 URL: https://issues.apache.org/jira/browse/SPARK-23740
             Project: Spark
          Issue Type: Improvement
          Components: ML
    Affects Versions: 2.3.0
            Reporter: Joseph K. Bradley


It would be handy to have a Param in FPGrowth for filtering out very common items.  This is from a use case where the dataset had items appearing in 99.9%+ of the rows.  These common items were useless, but they caused the algorithm to generate many unnecessary itemsets.  Filtering useless common items beforehand can make the algorithm much faster.




--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org