You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Michael Armbrust (JIRA)" <ji...@apache.org> on 2014/07/24 21:52:38 UTC

[jira] [Assigned] (SPARK-2674) Add date and time types to inferSchema

     [ https://issues.apache.org/jira/browse/SPARK-2674?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Michael Armbrust reassigned SPARK-2674:
---------------------------------------

    Assignee: Michael Armbrust

> Add date and time types to inferSchema
> --------------------------------------
>
>                 Key: SPARK-2674
>                 URL: https://issues.apache.org/jira/browse/SPARK-2674
>             Project: Spark
>          Issue Type: New Feature
>          Components: SQL
>    Affects Versions: 1.0.0
>            Reporter: Hossein Falaki
>            Assignee: Michael Armbrust
>
> When I try inferSchema in PySpark on an RDD of dictionary that contains a datatime.datetime object, I get the following exception:
> {code}
> Object of type java.util.GregorianCalendar[time=?,areFieldsSet=false,areAllFieldsSet=false,lenient=true,zone=sun.util.calendar.ZoneInfo[id="Etc/UTC",offset=0,dstSavings=0,useDaylight=false,transitions=0,lastRule=null],firstDayOfWeek=1,minimalDaysInFirstWeek=1,ERA=?,YEAR=2014,MONTH=3,WEEK_OF_YEAR=?,WEEK_OF_MONTH=?,DAY_OF_MONTH=22,DAY_OF_YEAR=?,DAY_OF_WEEK=?,DAY_OF_WEEK_IN_MONTH=?,AM_PM=0,HOUR=0,HOUR_OF_DAY=0,MINUTE=0,SECOND=0,MILLISECOND=4,ZONE_OFFSET=?,DST_OFFSET=?] cannot be used
> {code}



--
This message was sent by Atlassian JIRA
(v6.2#6252)