[GitHub] [spark] BryanCutler edited a comment on issue #24298: [SPARK-27276][PYTHON][SQL] Increase minimum version of pyarrow to 0.12.1 and remove prior workarounds

[GitBox <gi...@apache.org>]

BryanCutler edited a comment on issue #24298: [SPARK-27276][PYTHON][SQL] Increase minimum version of pyarrow to 0.12.1 and remove prior workarounds
URL: https://github.com/apache/spark/pull/24298#issuecomment-480388163
 
 
   @shaneknapp are you going to leave Pandas at version 0.19.2 or is that being upgraded as well for the python 3.6 env?
   
   Since pyarrow 0.12.1 requires numpy >= 1.14, I'm not sure if older versions of Pandas will work
   
   Conda doesn't like it, maybe have to manually override
   ```
   UnsatisfiableError: The following specifications were found to be in conflict:
     - pandas=0.19.2
     - pyarrow=0.12.1 -> arrow-cpp[version='>=0.12.1,<0.13.0a0,>=0.12.1,<1.0a0'] -> numpy[version='>=1.14,<2.0a0'] -> numpy-base==1.16.2=py36hde5b4d6_0
   ```

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


With regards,
Apache Git Services

---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org