You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Joseph K. Bradley (JIRA)" <ji...@apache.org> on 2017/02/23 19:41:45 UTC
[jira] [Commented] (SPARK-15571) Pipeline unit test improvements
for 2.2
[ https://issues.apache.org/jira/browse/SPARK-15571?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15881102#comment-15881102 ]
Joseph K. Bradley commented on SPARK-15571:
-------------------------------------------
[~rowanv] Thanks, and sorry for the long delay! That sounds like a good subtask. If you'd still like to work on it or another task, could you please create a subtask and describe the plans there for discussion?
> Pipeline unit test improvements for 2.2
> ---------------------------------------
>
> Key: SPARK-15571
> URL: https://issues.apache.org/jira/browse/SPARK-15571
> Project: Spark
> Issue Type: Test
> Components: ML, PySpark
> Reporter: Joseph K. Bradley
>
> Issue:
> * There are several pieces of standard functionality shared by all algorithms: Params, UIDs, fit/transform/save/load, etc. Currently, these pieces are generally tested in ad hoc tests for each algorithm.
> * This has led to inconsistent coverage, especially within the Python API.
> Goal:
> * Standardize unit tests for Scala and Python to improve and consolidate test coverage for Params, persistence, and other common functionality.
> * Eliminate duplicate code. Improve test coverage. Simplify adding these standard unit tests for future algorithms and APIs.
> This will require several subtasks. If you identify an issue, please create a subtask, or comment below if the issue needs to be discussed first.
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org