You are viewing a plain text version of this content. The canonical link for it is here.

Posted to user@spark.apache.org by Sumit Khanna <su...@askme.in> on 2016/08/07 05:03:37 UTC

spark df schema to hive schema converter func

Hi,

was wondering if we have something like that takes as an argument a spark
df type e.g DecimalType(12,5) and converts it into the corresponding hive
schema type. Double / Decimal / String ?

Any ideas.

Thanks,

Re: spark df schema to hive schema converter func

Posted by Sumit Khanna <su...@askme.in>.

wrt https://issues.apache.org/jira/browse/SPARK-5236. How do I also,
usually convert something of type DecimalType to int/ string/ etc etc.

Thanks,

On Sun, Aug 7, 2016 at 10:33 AM, Sumit Khanna <su...@askme.in> wrote:

> Hi,
>
> was wondering if we have something like that takes as an argument a spark
> df type e.g DecimalType(12,5) and converts it into the corresponding hive
> schema type. Double / Decimal / String ?
>
> Any ideas.
>
> Thanks,
>