You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@spark.apache.org by "koert kuipers (Jira)" <ji...@apache.org> on 2021/07/19 14:18:00 UTC

[jira] [Created] (SPARK-36210) Preserve column insertion order in Dataset.withColumns

koert kuipers created SPARK-36210:
-------------------------------------

             Summary: Preserve column insertion order in Dataset.withColumns
                 Key: SPARK-36210
                 URL: https://issues.apache.org/jira/browse/SPARK-36210
             Project: Spark
          Issue Type: Bug
          Components: SQL
    Affects Versions: 3.1.2
            Reporter: koert kuipers


Dataset.withColumns uses a Map (columnMap) to store the mapping of column name to column. however this loses the order of the columns. also none of the operations used on the Map (find and filter) benefits from the map's lookup features. so it seems simpler to use a Seq instead, which also preserves the insertion order.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org