You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@spark.apache.org by "yuhao yang (JIRA)" <ji...@apache.org> on 2016/02/06 09:24:39 UTC

[jira] [Created] (SPARK-13223) Add stratified sampling to ML feature engineering

yuhao yang created SPARK-13223:
----------------------------------

             Summary: Add stratified sampling to ML feature engineering
                 Key: SPARK-13223
                 URL: https://issues.apache.org/jira/browse/SPARK-13223
             Project: Spark
          Issue Type: New Feature
          Components: ML
            Reporter: yuhao yang
            Priority: Minor


I found it useful to add an sampling transformer during a case of fraud detection. It can be used in resampling or overSampling, which in turn is required by ensemble and unbalanced data processing.

Internally, it invoke the sampleByKey in Pair RDD operation.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org