You are viewing a plain text version of this content. The canonical link for it is here.

Posted to reviews@spark.apache.org by edlee123 <gi...@git.apache.org> on 2018/04/15 15:29:06 UTC

[GitHub] spark issue #18378: [SPARK-21163][SQL] DataFrame.toPandas should respect the...

Github user edlee123 commented on the issue:

    https://github.com/apache/spark/pull/18378
  
    Ok I see, I can see part of the rationale is performance (from discussion of astype above) and consistency with pyarrow   https://arrow.apache.org/docs/python/pandas.html
    
    I guess without knowing much about the work with Arrow I was expecting it to be consistent with how pandas converts python types e.g in Spark 2.2 
    
    What happens with Double and DateType?
    



---

---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org