You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Amir Kadivar (Jira)" <ji...@apache.org> on 2022/01/03 04:47:00 UTC

[jira] [Commented] (SPARK-37425) Inline type hints for python/pyspark/mllib/recommendation.py

    [ https://issues.apache.org/jira/browse/SPARK-37425?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17467778#comment-17467778 ] 

Amir Kadivar commented on SPARK-37425:
--------------------------------------

[~zero323] First time spark contributor here.

I've worked on this as a starting point to help with other issues in SPARK-37425 (mllib type hints). I can submit a PR but my understanding as per [this comment|https://github.com/apache/spark/pull/34680#issuecomment-975397090] of yours is that you'd like to wait for core type hints (ie SPARK-37094) to be done first, which makes sense!

Also, if I understand correctly everything in SPARK-37094 (core type hints) is either resolved or in progress. Most notable remaining dependency that bleeds everywhere in mllib is rdd.py and it seems like [~byronhsu] is working on it in SPARK-37154.

All this seems reasonable to me, just wanted to confirm the plan and voice that I'll have a PR for this ticket pending on [~byronhsu]'s work on rdd.py

> Inline type hints for python/pyspark/mllib/recommendation.py
> ------------------------------------------------------------
>
>                 Key: SPARK-37425
>                 URL: https://issues.apache.org/jira/browse/SPARK-37425
>             Project: Spark
>          Issue Type: Sub-task
>          Components: MLlib, PySpark
>    Affects Versions: 3.3.0
>            Reporter: Maciej Szymkiewicz
>            Priority: Major
>
> Inline type hints from python/pyspark/mlib/recommendation.pyi to python/pyspark/mllib/recommendation.py



--
This message was sent by Atlassian Jira
(v8.20.1#820001)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org