You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@spark.apache.org by sr...@apache.org on 2019/07/30 15:25:00 UTC
[spark] branch master updated (70910e6 -> 44c28d7)
This is an automated email from the ASF dual-hosted git repository.
srowen pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/spark.git.
from 70910e6 [SPARK-26755][SCHEDULER] : Optimize Spark Scheduler to dequeue speculative tasks…
add 44c28d7 [SPARK-28399][ML][PYTHON] implement RobustScaler
No new revisions were added by this update.
Summary of changes:
docs/ml-features.md | 45 ++++
...erExample.java => JavaRobustScalerExample.java} | 22 +-
..._scaler_example.py => robust_scaler_example.py} | 13 +-
...alerExample.scala => RobustScalerExample.scala} | 18 +-
.../org/apache/spark/ml/feature/RobustScaler.scala | 288 +++++++++++++++++++++
.../apache/spark/ml/feature/StandardScaler.scala | 131 +++++++---
.../spark/mllib/feature/StandardScaler.scala | 116 ++++-----
.../spark/ml/feature/RobustScalerSuite.scala | 209 +++++++++++++++
.../spark/ml/feature/StandardScalerSuite.scala | 4 +-
python/pyspark/ml/feature.py | 162 ++++++++++++
10 files changed, 878 insertions(+), 130 deletions(-)
copy examples/src/main/java/org/apache/spark/examples/ml/{JavaStandardScalerExample.java => JavaRobustScalerExample.java} (73%)
copy examples/src/main/python/ml/{standard_scaler_example.py => robust_scaler_example.py} (75%)
copy examples/src/main/scala/org/apache/spark/examples/ml/{StandardScalerExample.scala => RobustScalerExample.scala} (79%)
create mode 100644 mllib/src/main/scala/org/apache/spark/ml/feature/RobustScaler.scala
create mode 100644 mllib/src/test/scala/org/apache/spark/ml/feature/RobustScalerSuite.scala
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@spark.apache.org
For additional commands, e-mail: commits-help@spark.apache.org