You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Hyukjin Kwon (JIRA)" <ji...@apache.org> on 2019/05/21 04:00:33 UTC
[jira] [Updated] (SPARK-19071) Optimizations for ML Pipeline Tuning
[ https://issues.apache.org/jira/browse/SPARK-19071?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Hyukjin Kwon updated SPARK-19071:
---------------------------------
Labels: bulk-closed (was: )
> Optimizations for ML Pipeline Tuning
> ------------------------------------
>
> Key: SPARK-19071
> URL: https://issues.apache.org/jira/browse/SPARK-19071
> Project: Spark
> Issue Type: Improvement
> Components: ML
> Reporter: Bryan Cutler
> Priority: Major
> Labels: bulk-closed
>
> This is a parent task to plan the addition of optimizations in ML tuning for parallel model evaluation and more efficiency with pipelines. They will benefit Crossvalidator and TrainValidationSplit when performing a parameter grid search. The proposal can be broken into 3 steps in order of simplicity:
> 1. Add ability to evaluate models in parallel.
> 2. Optimize param grid for pipelines, as described in SPARK-5844
> 3. Add parallel model evaluation to the optimized pipelines from step 2
> See the linked design document for details on the proposed implementation.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org