[Spark Connect ] Date Data type formatting issue

[Ilango <el...@gmail.com>]

Hi all,

I am experiencing a date field formatting issue when loading data from an
Hive table in Spark via Spark Connect (On AWS EMR cluster) using R sparklyr
package. The date field is converted to a char type, where as the same
field is loaded as a date type when using our On-Premise Spark with YARN
connected to the same On-Premise Hive table.

Could you please advise on how to ensure that the date fields are loaded in
their native date type format when using Spark Connect?

Thanks,
Elango