[GitHub] [spark] shaneknapp edited a comment on issue #24298: [SPARK-27276][PYTHON][SQL] Increase minimum version of pyarrow to 0.12.1 and remove prior workarounds

[GitBox <gi...@apache.org>]

shaneknapp edited a comment on issue #24298: [SPARK-27276][PYTHON][SQL] Increase minimum version of pyarrow to 0.12.1 and remove prior workarounds
URL: https://github.com/apache/spark/pull/24298#issuecomment-484997518
 
 
   > From the test output, it passed all pyarrow tests on Python 3.6 with pyarrow 0.12.1, so I think this is good to go! It looks like pyarrow 0.8.0 is installed in the Python 2.7 environment, which shows tests skipped messages. This isn't a problem since we do Arrow testing with Python 3, so the old version of pyarrow can be uninstalled sometime later to clean up the test output. Let's test this one more time and I'll merge later if no more comments.
   
   if i'm not mistaken, you're either looking at the `Running PySpark packaging tests` section and seeing the 2.7/arrow tests being skipped, or perhaps tests running w/pypy (`Skipped tests in pyspark.sql.tests.test_arrow with pypy:`)?
   
   could you copy/pasta the skipped message you're seeing so that we can ascertain if we're indeed looking at the same thing?

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


With regards,
Apache Git Services

---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org