[jira] [Updated] (SPARK-37183) pyspark.pandas.DataFrame.map() should support .fillna()

["Hyukjin Kwon (Jira)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/SPARK-37183?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Hyukjin Kwon updated SPARK-37183:
---------------------------------
        Parent: SPARK-37197
    Issue Type: Sub-task  (was: Improvement)

> pyspark.pandas.DataFrame.map() should support .fillna()
> -------------------------------------------------------
>
>                 Key: SPARK-37183
>                 URL: https://issues.apache.org/jira/browse/SPARK-37183
>             Project: Spark
>          Issue Type: Sub-task
>          Components: PySpark
>    Affects Versions: 3.2.0
>            Reporter: Chuck Connell
>            Priority: Major
>
> In regular pandas you can say 
> {quote}DF["new_column"] = DF["column"].map(some_map).fillna(DF["column"])
> {quote}
> In order to use the existing value if the mapping key is not found.
> But this does not work in pyspark.pandas.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org