You are viewing a plain text version of this content. The canonical link for it is here.

Posted to user@spark.apache.org by Ewan Leith <ew...@realitymine.com> on 2015/08/13 16:44:10 UTC

Create column in nested structure?

Has anyone used withColumn (or another method) to add a column to an existing nested dataframe?

If I call:

    df.withColumn("nested.newcolumn", df("oldcolumn"))

then it just creates the new column with a "." In it's name, not under the "nested" structure.

Thanks,
Ewan