You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Xiangrui Meng (Jira)" <ji...@apache.org> on 2020/05/20 17:46:00 UTC

[jira] [Created] (SPARK-31776) Literal lit() supports lists and numpy arrays

Xiangrui Meng created SPARK-31776:
-------------------------------------

             Summary: Literal lit() supports lists and numpy arrays
                 Key: SPARK-31776
                 URL: https://issues.apache.org/jira/browse/SPARK-31776
             Project: Spark
          Issue Type: New Feature
          Components: SQL
    Affects Versions: 3.1.0
            Reporter: Xiangrui Meng


In ML workload, it is common to replace null feature vectors with some default value. However, lit() does not support Python list and numpy arrays at input. Users cannot simply use fillna() to get the job done.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org