You are viewing a plain text version of this content. The canonical link for it is here.
Posted to reviews@spark.apache.org by cclauss <gi...@git.apache.org> on 2018/08/29 09:24:48 UTC
[GitHub] spark pull request #22265: Undefined name: from pyspark.util import _excepti...
GitHub user cclauss opened a pull request:
https://github.com/apache/spark/pull/22265
Undefined name: from pyspark.util import _exception_message
[flake8](http://flake8.pycqa.org) testing of https://github.com/apache/spark on Python 3.7.0
$ __flake8 . --count --select=E901,E999,F821,F822,F823 --show-source --statistics__
```
./python/pyspark/java_gateway.py:172:20: F821 undefined name '_exception_message'
emsg = _exception_message(e)
^
1 F821 undefined name '_exception_message'
1
```
@HyukjinKwon
## What changes were proposed in this pull request?
(Please fill in changes proposed in this fix)
## How was this patch tested?
(Please explain how this patch was tested. E.g. unit tests, integration tests, manual tests)
(If this patch involves UI changes, please attach a screenshot; otherwise, remove this)
Please review http://spark.apache.org/contributing.html before opening a pull request.
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/cclauss/spark patch-2
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/spark/pull/22265.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #22265
----
commit 197ef63b57f089bc69c08ccffff9b975df79a73d
Author: cclauss <cc...@...>
Date: 2018-08-29T09:24:38Z
Undefined name: from pyspark.util import _exception_message
[flake8](http://flake8.pycqa.org) testing of https://github.com/apache/spark on Python 3.7.0
$ __flake8 . --count --select=E901,E999,F821,F822,F823 --show-source --statistics__
```
./python/pyspark/java_gateway.py:172:20: F821 undefined name '_exception_message'
emsg = _exception_message(e)
^
1 F821 undefined name '_exception_message'
1
```
@HyukjinKwon
----
---
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] spark issue #22265: Undefined name: from pyspark.util import _exception_mess...
Posted by HyukjinKwon <gi...@git.apache.org>.
Github user HyukjinKwon commented on the issue:
https://github.com/apache/spark/pull/22265
Let's format PR description as well
---
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] spark issue #22265: Undefined name: from pyspark.util import _exception_mess...
Posted by HyukjinKwon <gi...@git.apache.org>.
Github user HyukjinKwon commented on the issue:
https://github.com/apache/spark/pull/22265
Can you fix the PR title prefix to `[SPARK-25253][PYSPARK][FOLLOWUP] ...`
---
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] spark issue #22265: Undefined name: from pyspark.util import _exception_mess...
Posted by AmplabJenkins <gi...@git.apache.org>.
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22265
Merged build finished. Test PASSed.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] spark pull request #22265: [SPARK-25253][PYSPARK][FOLLOWUP] Undefined name: ...
Posted by asfgit <gi...@git.apache.org>.
Github user asfgit closed the pull request at:
https://github.com/apache/spark/pull/22265
---
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] spark issue #22265: Undefined name: from pyspark.util import _exception_mess...
Posted by AmplabJenkins <gi...@git.apache.org>.
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22265
Can one of the admins verify this patch?
---
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] spark issue #22265: Undefined name: from pyspark.util import _exception_mess...
Posted by HyukjinKwon <gi...@git.apache.org>.
Github user HyukjinKwon commented on the issue:
https://github.com/apache/spark/pull/22265
ok to test
---
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] spark issue #22265: [SPARK-25253][PYSPARK][FOLLOWUP] Undefined name: from py...
Posted by squito <gi...@git.apache.org>.
Github user squito commented on the issue:
https://github.com/apache/spark/pull/22265
ah, of course, `_exception_message` is only used in the exception handling, so we never get an error about an undefined name in any of the tests. Ok, thanks for the explanations, I appreciate it!
---
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] spark issue #22265: Undefined name: from pyspark.util import _exception_mess...
Posted by AmplabJenkins <gi...@git.apache.org>.
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22265
Can one of the admins verify this patch?
---
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] spark issue #22265: Undefined name: from pyspark.util import _exception_mess...
Posted by AmplabJenkins <gi...@git.apache.org>.
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22265
Can one of the admins verify this patch?
---
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] spark issue #22265: Undefined name: from pyspark.util import _exception_mess...
Posted by SparkQA <gi...@git.apache.org>.
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22265
**[Test build #95412 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/95412/testReport)** for PR 22265 at commit [`197ef63`](https://github.com/apache/spark/commit/197ef63b57f089bc69c08ccffff9b975df79a73d).
* This patch passes all tests.
* This patch merges cleanly.
* This patch adds no public classes.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] spark issue #22265: Undefined name: from pyspark.util import _exception_mess...
Posted by AmplabJenkins <gi...@git.apache.org>.
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22265
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/95412/
Test PASSed.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] spark issue #22265: Undefined name: from pyspark.util import _exception_mess...
Posted by SparkQA <gi...@git.apache.org>.
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22265
**[Test build #95412 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/95412/testReport)** for PR 22265 at commit [`197ef63`](https://github.com/apache/spark/commit/197ef63b57f089bc69c08ccffff9b975df79a73d).
---
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] spark issue #22265: [SPARK-25253][PYSPARK][FOLLOWUP] Undefined name: from py...
Posted by HyukjinKwon <gi...@git.apache.org>.
Github user HyukjinKwon commented on the issue:
https://github.com/apache/spark/pull/22265
I think we should really start to setup the Jenkins for Python coverage report site .... FYI @shaneknapp
---
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] spark issue #22265: [SPARK-25253][PYSPARK][FOLLOWUP] Undefined name: from py...
Posted by HyukjinKwon <gi...@git.apache.org>.
Github user HyukjinKwon commented on the issue:
https://github.com/apache/spark/pull/22265
Merged to master.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] spark issue #22265: [SPARK-25253][PYSPARK][FOLLOWUP] Undefined name: from py...
Posted by squito <gi...@git.apache.org>.
Github user squito commented on the issue:
https://github.com/apache/spark/pull/22265
thanks, lgtm
btw @HyukjinKwon I had expected jenkins testing to catch this ... but are there no tests run on python 3? is python 3 testing still manual from the contributor & reviewer?
---
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] spark issue #22265: [SPARK-25253][PYSPARK][FOLLOWUP] Undefined name: from py...
Posted by HyukjinKwon <gi...@git.apache.org>.
Github user HyukjinKwon commented on the issue:
https://github.com/apache/spark/pull/22265
Eh, I think Python 3 is used in Jenkins tests ..
```
========================================================================
Running PySpark tests
========================================================================
Running PySpark tests. Output is in /home/jenkins/workspace/SparkPullRequestBuilder@2/python/unit-tests.log
Will test against the following Python executables: ['python2.7', 'python3.4', 'pypy']
Will test the following Python modules: ['pyspark-core', 'pyspark-sql', 'pyspark-streaming', 'pyspark-mllib', 'pyspark-ml']
Starting test(pypy): pyspark.streaming.tests
Starting test(python2.7): pyspark.mllib.tests
Starting test(pypy): pyspark.sql.tests
Starting test(pypy): pyspark.tests
Finished test(pypy): pyspark.streaming.tests (126s)
Starting test(python2.7): pyspark.sql.tests
Finished test(pypy): pyspark.tests (204s) ... 2 tests were skipped
Starting test(python2.7): pyspark.streaming.tests
Finished test(python2.7): pyspark.mllib.tests (234s)
Starting test(python2.7): pyspark.tests
Finished test(python2.7): pyspark.streaming.tests (125s)
Starting test(python3.4): pyspark.mllib.tests
Finished test(pypy): pyspark.sql.tests (332s) ... 109 tests were skipped
Starting test(python3.4): pyspark.sql.tests
Finished test(python2.7): pyspark.tests (201s)
Starting test(python3.4): pyspark.streaming.tests
Finished test(python2.7): pyspark.sql.tests (344s) ... 109 tests were skipped
Starting test(python3.4): pyspark.tests
Finished test(python3.4): pyspark.streaming.tests (130s)
Starting test(pypy): pyspark.accumulators
Finished test(pypy): pyspark.accumulators (9s)
Starting test(pypy): pyspark.broadcast
Finished test(pypy): pyspark.broadcast (7s)
Starting test(pypy): pyspark.conf
Finished test(pypy): pyspark.conf (5s)
Starting test(pypy): pyspark.context
Finished test(pypy): pyspark.context (22s)
Starting test(pypy): pyspark.profiler
Finished test(python3.4): pyspark.mllib.tests (286s)
Starting test(pypy): pyspark.rdd
Finished test(pypy): pyspark.profiler (9s)
Starting test(pypy): pyspark.serializers
Finished test(pypy): pyspark.serializers (12s)
Starting test(pypy): pyspark.shuffle
Finished test(pypy): pyspark.shuffle (2s)
Starting test(pypy): pyspark.sql.catalog
Finished test(pypy): pyspark.sql.catalog (11s)
Starting test(pypy): pyspark.sql.column
Finished test(pypy): pyspark.rdd (34s)
Starting test(pypy): pyspark.sql.conf
Finished test(pypy): pyspark.sql.conf (5s)
Starting test(pypy): pyspark.sql.context
Finished test(pypy): pyspark.sql.column (19s)
Starting test(pypy): pyspark.sql.dataframe
Finished test(pypy): pyspark.sql.context (15s)
Starting test(pypy): pyspark.sql.functions
Finished test(python3.4): pyspark.tests (211s) ... 3 tests were skipped
Starting test(pypy): pyspark.sql.group
Finished test(pypy): pyspark.sql.group (20s)
Starting test(pypy): pyspark.sql.readwriter
Finished test(pypy): pyspark.sql.dataframe (40s)
Starting test(pypy): pyspark.sql.session
Finished test(pypy): pyspark.sql.functions (40s)
Starting test(pypy): pyspark.sql.streaming
Finished test(pypy): pyspark.sql.readwriter (17s)
Starting test(pypy): pyspark.sql.types
Finished test(pypy): pyspark.sql.session (15s)
Starting test(pypy): pyspark.sql.udf
Finished test(pypy): pyspark.sql.streaming (12s)
Starting test(pypy): pyspark.sql.window
Finished test(pypy): pyspark.sql.types (5s)
Starting test(pypy): pyspark.streaming.util
Finished test(pypy): pyspark.streaming.util (1s)
Starting test(pypy): pyspark.util
Finished test(pypy): pyspark.util (1s)
Starting test(python2.7): pyspark.accumulators
Finished test(python2.7): pyspark.accumulators (5s)
Starting test(python2.7): pyspark.broadcast
Finished test(pypy): pyspark.sql.udf (13s)
Starting test(python2.7): pyspark.conf
Finished test(pypy): pyspark.sql.window (11s)
Starting test(python2.7): pyspark.context
Finished test(python2.7): pyspark.broadcast (5s)
Starting test(python2.7): pyspark.ml.classification
Finished test(python2.7): pyspark.conf (3s)
Starting test(python2.7): pyspark.ml.clustering
Finished test(python2.7): pyspark.context (19s)
Starting test(python2.7): pyspark.ml.evaluation
Finished test(python2.7): pyspark.ml.evaluation (14s)
Starting test(python2.7): pyspark.ml.feature
Finished test(python2.7): pyspark.ml.clustering (31s)
Starting test(python2.7): pyspark.ml.fpm
Finished test(python2.7): pyspark.ml.fpm (0s)
Starting test(python2.7): pyspark.ml.image
Finished test(python2.7): pyspark.ml.image (9s)
Starting test(python2.7): pyspark.ml.linalg.__init__
Finished test(python2.7): pyspark.ml.linalg.__init__ (0s)
Starting test(python2.7): pyspark.ml.recommendation
Finished test(python2.7): pyspark.ml.classification (50s)
Starting test(python2.7): pyspark.ml.regression
Finished test(python2.7): pyspark.ml.regression (32s)
Starting test(python2.7): pyspark.ml.stat
Finished test(python2.7): pyspark.ml.feature (59s)
Starting test(python2.7): pyspark.ml.tests
Finished test(python2.7): pyspark.ml.recommendation (53s)
Starting test(python2.7): pyspark.ml.tuning
Finished test(python2.7): pyspark.ml.stat (15s)
Starting test(python2.7): pyspark.mllib.classification
Finished test(python2.7): pyspark.ml.tuning (17s)
Starting test(python2.7): pyspark.mllib.clustering
Finished test(python2.7): pyspark.mllib.classification (25s)
Starting test(python2.7): pyspark.mllib.evaluation
Finished test(python3.4): pyspark.sql.tests (536s) ... 3 tests were skipped
Starting test(python2.7): pyspark.mllib.feature
Finished test(python2.7): pyspark.mllib.evaluation (13s)
Starting test(python2.7): pyspark.mllib.fpm
Finished test(python2.7): pyspark.mllib.feature (18s)
Starting test(python2.7): pyspark.mllib.linalg.__init__
Finished test(python2.7): pyspark.mllib.linalg.__init__ (0s)
Starting test(python2.7): pyspark.mllib.linalg.distributed
Finished test(python2.7): pyspark.mllib.fpm (15s)
Starting test(python2.7): pyspark.mllib.random
Finished test(python2.7): pyspark.mllib.clustering (41s)
Starting test(python2.7): pyspark.mllib.recommendation
Finished test(python2.7): pyspark.mllib.random (7s)
Starting test(python2.7): pyspark.mllib.regression
Finished test(python2.7): pyspark.mllib.recommendation (26s)
Starting test(python2.7): pyspark.mllib.stat.KernelDensity
Finished test(python2.7): pyspark.mllib.stat.KernelDensity (0s)
Starting test(python2.7): pyspark.mllib.stat._statistics
Finished test(python2.7): pyspark.mllib.regression (22s)
Starting test(python2.7): pyspark.mllib.tree
Finished test(python2.7): pyspark.mllib.linalg.distributed (35s)
Starting test(python2.7): pyspark.mllib.util
Finished test(python2.7): pyspark.mllib.stat._statistics (11s)
Starting test(python2.7): pyspark.profiler
Finished test(python2.7): pyspark.mllib.util (13s)
Starting test(python2.7): pyspark.rdd
Finished test(python2.7): pyspark.mllib.tree (15s)
Starting test(python2.7): pyspark.serializers
Finished test(python2.7): pyspark.profiler (5s)
Starting test(python2.7): pyspark.shuffle
Finished test(python2.7): pyspark.shuffle (0s)
Starting test(python2.7): pyspark.sql.catalog
Finished test(python2.7): pyspark.serializers (7s)
Starting test(python2.7): pyspark.sql.column
Finished test(python2.7): pyspark.sql.catalog (10s)
Starting test(python2.7): pyspark.sql.conf
Finished test(python2.7): pyspark.sql.conf (4s)
Starting test(python2.7): pyspark.sql.context
Finished test(python2.7): pyspark.rdd (26s)
Starting test(python2.7): pyspark.sql.dataframe
Finished test(python2.7): pyspark.sql.column (18s)
Starting test(python2.7): pyspark.sql.functions
Finished test(python2.7): pyspark.sql.context (13s)
Starting test(python2.7): pyspark.sql.group
Finished test(python2.7): pyspark.sql.group (17s)
Starting test(python2.7): pyspark.sql.readwriter
Finished test(python2.7): pyspark.sql.readwriter (15s)
Starting test(python2.7): pyspark.sql.session
Finished test(python2.7): pyspark.sql.dataframe (37s)
Starting test(python2.7): pyspark.sql.streaming
Finished test(python2.7): pyspark.sql.functions (37s)
Starting test(python2.7): pyspark.sql.types
Finished test(python2.7): pyspark.sql.types (4s)
Starting test(python2.7): pyspark.sql.udf
Finished test(python2.7): pyspark.sql.streaming (10s)
Starting test(python2.7): pyspark.sql.window
Finished test(python2.7): pyspark.sql.session (13s)
Starting test(python2.7): pyspark.streaming.util
Finished test(python2.7): pyspark.streaming.util (0s)
Starting test(python2.7): pyspark.util
Finished test(python2.7): pyspark.util (0s)
Starting test(python3.4): pyspark.accumulators
Finished test(python2.7): pyspark.ml.tests (188s)
Starting test(python3.4): pyspark.broadcast
Finished test(python2.7): pyspark.sql.udf (11s)
Starting test(python3.4): pyspark.conf
Finished test(python3.4): pyspark.accumulators (5s)
Starting test(python3.4): pyspark.context
Finished test(python3.4): pyspark.conf (4s)
Starting test(python3.4): pyspark.ml.classification
Finished test(python2.7): pyspark.sql.window (11s)
Starting test(python3.4): pyspark.ml.clustering
Finished test(python3.4): pyspark.broadcast (5s)
Starting test(python3.4): pyspark.ml.evaluation
Finished test(python3.4): pyspark.ml.evaluation (14s)
Starting test(python3.4): pyspark.ml.feature
Finished test(python3.4): pyspark.context (20s)
Starting test(python3.4): pyspark.ml.fpm
Finished test(python3.4): pyspark.ml.fpm (0s)
Starting test(python3.4): pyspark.ml.image
Finished test(python3.4): pyspark.ml.image (9s)
Starting test(python3.4): pyspark.ml.linalg.__init__
Finished test(python3.4): pyspark.ml.linalg.__init__ (0s)
Starting test(python3.4): pyspark.ml.recommendation
Finished test(python3.4): pyspark.ml.clustering (31s)
Starting test(python3.4): pyspark.ml.regression
Finished test(python3.4): pyspark.ml.classification (52s)
Starting test(python3.4): pyspark.ml.stat
Finished test(python3.4): pyspark.ml.regression (29s)
Starting test(python3.4): pyspark.ml.tests
Finished test(python3.4): pyspark.ml.stat (20s)
Starting test(python3.4): pyspark.ml.tuning
Finished test(python3.4): pyspark.ml.feature (65s)
Starting test(python3.4): pyspark.mllib.classification
Finished test(python3.4): pyspark.ml.recommendation (58s)
Starting test(python3.4): pyspark.mllib.clustering
Finished test(python3.4): pyspark.ml.tuning (18s)
Starting test(python3.4): pyspark.mllib.evaluation
Finished test(python3.4): pyspark.mllib.evaluation (14s)
Starting test(python3.4): pyspark.mllib.feature
Finished test(python3.4): pyspark.mllib.classification (29s)
Starting test(python3.4): pyspark.mllib.fpm
Finished test(python3.4): pyspark.mllib.fpm (15s)
Starting test(python3.4): pyspark.mllib.linalg.__init__
Finished test(python3.4): pyspark.mllib.feature (19s)
Starting test(python3.4): pyspark.mllib.linalg.distributed
Finished test(python3.4): pyspark.mllib.linalg.__init__ (0s)
Starting test(python3.4): pyspark.mllib.random
Finished test(python3.4): pyspark.mllib.clustering (42s)
Starting test(python3.4): pyspark.mllib.recommendation
Finished test(python3.4): pyspark.mllib.random (8s)
Starting test(python3.4): pyspark.mllib.regression
Finished test(python3.4): pyspark.mllib.regression (23s)
Starting test(python3.4): pyspark.mllib.stat.KernelDensity
Finished test(python3.4): pyspark.mllib.stat.KernelDensity (0s)
Starting test(python3.4): pyspark.mllib.stat._statistics
Finished test(python3.4): pyspark.mllib.recommendation (31s)
Starting test(python3.4): pyspark.mllib.tree
Finished test(python3.4): pyspark.mllib.linalg.distributed (45s)
Starting test(python3.4): pyspark.mllib.util
Finished test(python3.4): pyspark.mllib.stat._statistics (13s)
Starting test(python3.4): pyspark.profiler
Finished test(python3.4): pyspark.profiler (6s)
Starting test(python3.4): pyspark.rdd
Finished test(python3.4): pyspark.mllib.tree (17s)
Starting test(python3.4): pyspark.serializers
Finished test(python3.4): pyspark.mllib.util (14s)
Starting test(python3.4): pyspark.shuffle
Finished test(python3.4): pyspark.shuffle (0s)
Starting test(python3.4): pyspark.sql.catalog
Finished test(python3.4): pyspark.serializers (8s)
Starting test(python3.4): pyspark.sql.column
Finished test(python3.4): pyspark.sql.catalog (11s)
Starting test(python3.4): pyspark.sql.conf
Finished test(python3.4): pyspark.sql.conf (4s)
Starting test(python3.4): pyspark.sql.context
Finished test(python3.4): pyspark.rdd (28s)
Starting test(python3.4): pyspark.sql.dataframe
Finished test(python3.4): pyspark.sql.column (18s)
Starting test(python3.4): pyspark.sql.functions
Finished test(python3.4): pyspark.sql.context (14s)
Starting test(python3.4): pyspark.sql.group
Finished test(python3.4): pyspark.sql.group (19s)
Starting test(python3.4): pyspark.sql.readwriter
Finished test(python3.4): pyspark.sql.dataframe (39s)
Starting test(python3.4): pyspark.sql.session
Finished test(python3.4): pyspark.sql.functions (39s)
Starting test(python3.4): pyspark.sql.streaming
Finished test(python3.4): pyspark.sql.readwriter (17s)
Starting test(python3.4): pyspark.sql.types
Finished test(python3.4): pyspark.sql.streaming (13s)
Starting test(python3.4): pyspark.sql.udf
Finished test(python3.4): pyspark.sql.types (5s)
Starting test(python3.4): pyspark.sql.window
Finished test(python3.4): pyspark.sql.session (14s)
Starting test(python3.4): pyspark.streaming.util
Finished test(python3.4): pyspark.streaming.util (0s)
Starting test(python3.4): pyspark.util
Finished test(python3.4): pyspark.util (0s)
Finished test(python3.4): pyspark.ml.tests (206s)
Finished test(python3.4): pyspark.sql.window (12s)
Finished test(python3.4): pyspark.sql.udf (13s)
Tests passed in 1295 seconds
Skipped tests in pyspark.sql.tests with pypy:
test_createDataFrame_column_name_encoding (pyspark.sql.tests.ArrowTests) ... skipped 'Pandas >= 0.19.2 must be installed; however, it was not found.'
test_createDataFrame_does_not_modify_input (pyspark.sql.tests.ArrowTests) ... skipped 'Pandas >= 0.19.2 must be installed; however, it was not found.'
test_createDataFrame_fallback_disabled (pyspark.sql.tests.ArrowTests) ... skipped 'Pandas >= 0.19.2 must be installed; however, it was not found.'
test_createDataFrame_fallback_enabled (pyspark.sql.tests.ArrowTests) ... skipped 'Pandas >= 0.19.2 must be installed; however, it was not found.'
test_createDataFrame_respect_session_timezone (pyspark.sql.tests.ArrowTests) ... skipped 'Pandas >= 0.19.2 must be installed; however, it was not found.'
test_createDataFrame_toggle (pyspark.sql.tests.ArrowTests) ... skipped 'Pandas >= 0.19.2 must be installed; however, it was not found.'
test_createDataFrame_with_array_type (pyspark.sql.tests.ArrowTests) ... skipped 'Pandas >= 0.19.2 must be installed; however, it was not found.'
test_createDataFrame_with_incorrect_schema (pyspark.sql.tests.ArrowTests) ... skipped 'Pandas >= 0.19.2 must be installed; however, it was not found.'
test_createDataFrame_with_int_col_names (pyspark.sql.tests.ArrowTests) ... skipped 'Pandas >= 0.19.2 must be installed; however, it was not found.'
test_createDataFrame_with_names (pyspark.sql.tests.ArrowTests) ... skipped 'Pandas >= 0.19.2 must be installed; however, it was not found.'
test_createDataFrame_with_schema (pyspark.sql.tests.ArrowTests) ... skipped 'Pandas >= 0.19.2 must be installed; however, it was not found.'
test_createDataFrame_with_single_data_type (pyspark.sql.tests.ArrowTests) ... skipped 'Pandas >= 0.19.2 must be installed; however, it was not found.'
test_filtered_frame (pyspark.sql.tests.ArrowTests) ... skipped 'Pandas >= 0.19.2 must be installed; however, it was not found.'
test_null_conversion (pyspark.sql.tests.ArrowTests) ... skipped 'Pandas >= 0.19.2 must be installed; however, it was not found.'
test_pandas_round_trip (pyspark.sql.tests.ArrowTests) ... skipped 'Pandas >= 0.19.2 must be installed; however, it was not found.'
test_schema_conversion_roundtrip (pyspark.sql.tests.ArrowTests) ... skipped 'Pandas >= 0.19.2 must be installed; however, it was not found.'
test_timestamp_dst (pyspark.sql.tests.ArrowTests) ... skipped 'Pandas >= 0.19.2 must be installed; however, it was not found.'
test_toPandas_arrow_toggle (pyspark.sql.tests.ArrowTests) ... skipped 'Pandas >= 0.19.2 must be installed; however, it was not found.'
test_toPandas_fallback_disabled (pyspark.sql.tests.ArrowTests) ... skipped 'Pandas >= 0.19.2 must be installed; however, it was not found.'
test_toPandas_fallback_enabled (pyspark.sql.tests.ArrowTests) ... skipped 'Pandas >= 0.19.2 must be installed; however, it was not found.'
test_toPandas_respect_session_timezone (pyspark.sql.tests.ArrowTests) ... skipped 'Pandas >= 0.19.2 must be installed; however, it was not found.'
test_toPandas_with_array_type (pyspark.sql.tests.ArrowTests) ... skipped 'Pandas >= 0.19.2 must be installed; however, it was not found.'
test_alias (pyspark.sql.tests.GroupedAggPandasUDFTests) ... skipped 'Pandas >= 0.19.2 must be installed; however, it was not found.'
test_array_type (pyspark.sql.tests.GroupedAggPandasUDFTests) ... skipped 'Pandas >= 0.19.2 must be installed; however, it was not found.'
test_basic (pyspark.sql.tests.GroupedAggPandasUDFTests) ... skipped 'Pandas >= 0.19.2 must be installed; however, it was not found.'
test_complex_expressions (pyspark.sql.tests.GroupedAggPandasUDFTests) ... skipped 'Pandas >= 0.19.2 must be installed; however, it was not found.'
test_complex_groupby (pyspark.sql.tests.GroupedAggPandasUDFTests) ... skipped 'Pandas >= 0.19.2 must be installed; however, it was not found.'
test_invalid_args (pyspark.sql.tests.GroupedAggPandasUDFTests) ... skipped 'Pandas >= 0.19.2 must be installed; however, it was not found.'
test_manual (pyspark.sql.tests.GroupedAggPandasUDFTests) ... skipped 'Pandas >= 0.19.2 must be installed; however, it was not found.'
test_mixed_sql (pyspark.sql.tests.GroupedAggPandasUDFTests) ... skipped 'Pandas >= 0.19.2 must be installed; however, it was not found.'
test_mixed_udfs (pyspark.sql.tests.GroupedAggPandasUDFTests) ... skipped 'Pandas >= 0.19.2 must be installed; however, it was not found.'
test_multiple_udfs (pyspark.sql.tests.GroupedAggPandasUDFTests) ... skipped 'Pandas >= 0.19.2 must be installed; however, it was not found.'
test_retain_group_columns (pyspark.sql.tests.GroupedAggPandasUDFTests) ... skipped 'Pandas >= 0.19.2 must be installed; however, it was not found.'
test_unsupported_types (pyspark.sql.tests.GroupedAggPandasUDFTests) ... skipped 'Pandas >= 0.19.2 must be installed; however, it was not found.'
test_array_type_correct (pyspark.sql.tests.GroupedMapPandasUDFTests) ... skipped 'Pandas >= 0.19.2 must be installed; however, it was not found.'
test_coerce (pyspark.sql.tests.GroupedMapPandasUDFTests) ... skipped 'Pandas >= 0.19.2 must be installed; however, it was not found.'
test_column_order (pyspark.sql.tests.GroupedMapPandasUDFTests) ... skipped 'Pandas >= 0.19.2 must be installed; however, it was not found.'
test_complex_groupby (pyspark.sql.tests.GroupedMapPandasUDFTests) ... skipped 'Pandas >= 0.19.2 must be installed; however, it was not found.'
test_datatype_string (pyspark.sql.tests.GroupedMapPandasUDFTests) ... skipped 'Pandas >= 0.19.2 must be installed; however, it was not found.'
test_decorator (pyspark.sql.tests.GroupedMapPandasUDFTests) ... skipped 'Pandas >= 0.19.2 must be installed; however, it was not found.'
test_empty_groupby (pyspark.sql.tests.GroupedMapPandasUDFTests) ... skipped 'Pandas >= 0.19.2 must be installed; however, it was not found.'
test_mixed_scalar_udfs_followed_by_grouby_apply (pyspark.sql.tests.GroupedMapPandasUDFTests) ... skipped 'Pandas >= 0.19.2 must be installed; however, it was not found.'
test_positional_assignment_conf (pyspark.sql.tests.GroupedMapPandasUDFTests) ... skipped 'Pandas >= 0.19.2 must be installed; however, it was not found.'
test_register_grouped_map_udf (pyspark.sql.tests.GroupedMapPandasUDFTests) ... skipped 'Pandas >= 0.19.2 must be installed; however, it was not found.'
test_self_join_with_pandas (pyspark.sql.tests.GroupedMapPandasUDFTests) ... skipped 'Pandas >= 0.19.2 must be installed; however, it was not found.'
test_supported_types (pyspark.sql.tests.GroupedMapPandasUDFTests) ... skipped 'Pandas >= 0.19.2 must be installed; however, it was not found.'
test_timestamp_dst (pyspark.sql.tests.GroupedMapPandasUDFTests) ... skipped 'Pandas >= 0.19.2 must be installed; however, it was not found.'
test_udf_with_key (pyspark.sql.tests.GroupedMapPandasUDFTests) ... skipped 'Pandas >= 0.19.2 must be installed; however, it was not found.'
test_unsupported_types (pyspark.sql.tests.GroupedMapPandasUDFTests) ... skipped 'Pandas >= 0.19.2 must be installed; however, it was not found.'
test_wrong_args (pyspark.sql.tests.GroupedMapPandasUDFTests) ... skipped 'Pandas >= 0.19.2 must be installed; however, it was not found.'
test_wrong_return_type (pyspark.sql.tests.GroupedMapPandasUDFTests) ... skipped 'Pandas >= 0.19.2 must be installed; however, it was not found.'
test_unbounded_frames (pyspark.sql.tests.HiveContextSQLTests) ... skipped "Unittest < 3.3 doesn't support mocking"
test_pandas_udf_basic (pyspark.sql.tests.PandasUDFTests) ... skipped 'Pandas >= 0.19.2 must be installed; however, it was not found.'
test_pandas_udf_decorator (pyspark.sql.tests.PandasUDFTests) ... skipped 'Pandas >= 0.19.2 must be installed; however, it was not found.'
test_stopiteration_in_udf (pyspark.sql.tests.PandasUDFTests) ... skipped 'Pandas >= 0.19.2 must be installed; however, it was not found.'
test_udf_wrong_arg (pyspark.sql.tests.PandasUDFTests) ... skipped 'Pandas >= 0.19.2 must be installed; however, it was not found.'
test_query_execution_listener_on_collect_with_arrow (pyspark.sql.tests.QueryExecutionListenerTests) ... skipped 'Pandas >= 0.19.2 must be installed; however, it was not found.'
test_create_dataframe_from_pandas_with_timestamp (pyspark.sql.tests.SQLTests) ... skipped 'Pandas >= 0.19.2 must be installed; however, it was not found.'
test_create_dateframe_from_pandas_with_dst (pyspark.sql.tests.SQLTests) ... skipped 'Pandas >= 0.19.2 must be installed; however, it was not found.'
test_to_pandas (pyspark.sql.tests.SQLTests) ... skipped 'Pandas >= 0.19.2 must be installed; however, it was not found.'
test_to_pandas_avoid_astype (pyspark.sql.tests.SQLTests) ... skipped 'Pandas >= 0.19.2 must be installed; however, it was not found.'
test_datasource_with_udf (pyspark.sql.tests.ScalarPandasUDFTests) ... skipped 'Pandas >= 0.19.2 must be installed; however, it was not found.'
test_mixed_udf (pyspark.sql.tests.ScalarPandasUDFTests) ... skipped 'Pandas >= 0.19.2 must be installed; however, it was not found.'
test_mixed_udf_and_sql (pyspark.sql.tests.ScalarPandasUDFTests) ... skipped 'Pandas >= 0.19.2 must be installed; however, it was not found.'
test_nondeterministic_vectorized_udf (pyspark.sql.tests.ScalarPandasUDFTests) ... skipped 'Pandas >= 0.19.2 must be installed; however, it was not found.'
test_nondeterministic_vectorized_udf_in_aggregate (pyspark.sql.tests.ScalarPandasUDFTests) ... skipped 'Pandas >= 0.19.2 must be installed; however, it was not found.'
test_register_nondeterministic_vectorized_udf_basic (pyspark.sql.tests.ScalarPandasUDFTests) ... skipped 'Pandas >= 0.19.2 must be installed; however, it was not found.'
test_register_vectorized_udf_basic (pyspark.sql.tests.ScalarPandasUDFTests) ... skipped 'Pandas >= 0.19.2 must be installed; however, it was not found.'
test_timestamp_dst (pyspark.sql.tests.ScalarPandasUDFTests) ... skipped 'Pandas >= 0.19.2 must be installed; however, it was not found.'
test_type_annotation (pyspark.sql.tests.ScalarPandasUDFTests) ... skipped 'Pandas >= 0.19.2 must be installed; however, it was not found.'
test_vectorized_udf_array_type (pyspark.sql.tests.ScalarPandasUDFTests) ... skipped 'Pandas >= 0.19.2 must be installed; however, it was not found.'
test_vectorized_udf_basic (pyspark.sql.tests.ScalarPandasUDFTests) ... skipped 'Pandas >= 0.19.2 must be installed; however, it was not found.'
test_vectorized_udf_chained (pyspark.sql.tests.ScalarPandasUDFTests) ... skipped 'Pandas >= 0.19.2 must be installed; however, it was not found.'
test_vectorized_udf_check_config (pyspark.sql.tests.ScalarPandasUDFTests) ... skipped 'Pandas >= 0.19.2 must be installed; however, it was not found.'
test_vectorized_udf_complex (pyspark.sql.tests.ScalarPandasUDFTests) ... skipped 'Pandas >= 0.19.2 must be installed; however, it was not found.'
test_vectorized_udf_datatype_string (pyspark.sql.tests.ScalarPandasUDFTests) ... skipped 'Pandas >= 0.19.2 must be installed; however, it was not found.'
test_vectorized_udf_dates (pyspark.sql.tests.ScalarPandasUDFTests) ... skipped 'Pandas >= 0.19.2 must be installed; however, it was not found.'
test_vectorized_udf_decorator (pyspark.sql.tests.ScalarPandasUDFTests) ... skipped 'Pandas >= 0.19.2 must be installed; however, it was not found.'
test_vectorized_udf_empty_partition (pyspark.sql.tests.ScalarPandasUDFTests) ... skipped 'Pandas >= 0.19.2 must be installed; however, it was not found.'
test_vectorized_udf_exception (pyspark.sql.tests.ScalarPandasUDFTests) ... skipped 'Pandas >= 0.19.2 must be installed; however, it was not found.'
test_vectorized_udf_invalid_length (pyspark.sql.tests.ScalarPandasUDFTests) ... skipped 'Pandas >= 0.19.2 must be installed; however, it was not found.'
test_vectorized_udf_null_array (pyspark.sql.tests.ScalarPandasUDFTests) ... skipped 'Pandas >= 0.19.2 must be installed; however, it was not found.'
test_vectorized_udf_null_binary (pyspark.sql.tests.ScalarPandasUDFTests) ... skipped 'Pandas >= 0.19.2 must be installed; however, it was not found.'
test_vectorized_udf_null_boolean (pyspark.sql.tests.ScalarPandasUDFTests) ... skipped 'Pandas >= 0.19.2 must be installed; however, it was not found.'
test_vectorized_udf_null_byte (pyspark.sql.tests.ScalarPandasUDFTests) ... skipped 'Pandas >= 0.19.2 must be installed; however, it was not found.'
test_vectorized_udf_null_decimal (pyspark.sql.tests.ScalarPandasUDFTests) ... skipped 'Pandas >= 0.19.2 must be installed; however, it was not found.'
test_vectorized_udf_null_double (pyspark.sql.tests.ScalarPandasUDFTests) ... skipped 'Pandas >= 0.19.2 must be installed; however, it was not found.'
test_vectorized_udf_null_float (pyspark.sql.tests.ScalarPandasUDFTests) ... skipped 'Pandas >= 0.19.2 must be installed; however, it was not found.'
test_vectorized_udf_null_int (pyspark.sql.tests.ScalarPandasUDFTests) ... skipped 'Pandas >= 0.19.2 must be installed; however, it was not found.'
test_vectorized_udf_null_long (pyspark.sql.tests.ScalarPandasUDFTests) ... skipped 'Pandas >= 0.19.2 must be installed; however, it was not found.'
test_vectorized_udf_null_short (pyspark.sql.tests.ScalarPandasUDFTests) ... skipped 'Pandas >= 0.19.2 must be installed; however, it was not found.'
test_vectorized_udf_null_string (pyspark.sql.tests.ScalarPandasUDFTests) ... skipped 'Pandas >= 0.19.2 must be installed; however, it was not found.'
test_vectorized_udf_return_scalar (pyspark.sql.tests.ScalarPandasUDFTests) ... skipped 'Pandas >= 0.19.2 must be installed; however, it was not found.'
test_vectorized_udf_return_timestamp_tz (pyspark.sql.tests.ScalarPandasUDFTests) ... skipped 'Pandas >= 0.19.2 must be installed; however, it was not found.'
test_vectorized_udf_string_in_udf (pyspark.sql.tests.ScalarPandasUDFTests) ... skipped 'Pandas >= 0.19.2 must be installed; however, it was not found.'
test_vectorized_udf_timestamps (pyspark.sql.tests.ScalarPandasUDFTests) ... skipped 'Pandas >= 0.19.2 must be installed; however, it was not found.'
test_vectorized_udf_timestamps_respect_session_timezone (pyspark.sql.tests.ScalarPandasUDFTests) ... skipped 'Pandas >= 0.19.2 must be installed; however, it was not found.'
test_vectorized_udf_unsupported_types (pyspark.sql.tests.ScalarPandasUDFTests) ... skipped 'Pandas >= 0.19.2 must be installed; however, it was not found.'
test_vectorized_udf_varargs (pyspark.sql.tests.ScalarPandasUDFTests) ... skipped 'Pandas >= 0.19.2 must be installed; however, it was not found.'
test_vectorized_udf_wrong_return_type (pyspark.sql.tests.ScalarPandasUDFTests) ... skipped 'Pandas >= 0.19.2 must be installed; however, it was not found.'
test_array_type (pyspark.sql.tests.WindowPandasUDFTests) ... skipped 'Pandas >= 0.19.2 must be installed; however, it was not found.'
test_invalid_args (pyspark.sql.tests.WindowPandasUDFTests) ... skipped 'Pandas >= 0.19.2 must be installed; however, it was not found.'
test_mixed_sql (pyspark.sql.tests.WindowPandasUDFTests) ... skipped 'Pandas >= 0.19.2 must be installed; however, it was not found.'
test_mixed_sql_and_udf (pyspark.sql.tests.WindowPandasUDFTests) ... skipped 'Pandas >= 0.19.2 must be installed; however, it was not found.'
test_mixed_udf (pyspark.sql.tests.WindowPandasUDFTests) ... skipped 'Pandas >= 0.19.2 must be installed; however, it was not found.'
test_multiple_udfs (pyspark.sql.tests.WindowPandasUDFTests) ... skipped 'Pandas >= 0.19.2 must be installed; however, it was not found.'
test_replace_existing (pyspark.sql.tests.WindowPandasUDFTests) ... skipped 'Pandas >= 0.19.2 must be installed; however, it was not found.'
test_simple (pyspark.sql.tests.WindowPandasUDFTests) ... skipped 'Pandas >= 0.19.2 must be installed; however, it was not found.'
test_without_partitionBy (pyspark.sql.tests.WindowPandasUDFTests) ... skipped 'Pandas >= 0.19.2 must be installed; however, it was not found.'
Skipped tests in pyspark.tests with pypy:
test_statcounter_array (pyspark.tests.NumPyTests) ... skipped 'NumPy not installed'
test_serialize (pyspark.tests.SciPyTests) ... skipped 'SciPy not installed'
Skipped tests in pyspark.sql.tests with python2.7:
test_createDataFrame_column_name_encoding (pyspark.sql.tests.ArrowTests) ... skipped 'Pandas >= 0.19.2 must be installed; however, your version was 0.16.0.'
test_createDataFrame_does_not_modify_input (pyspark.sql.tests.ArrowTests) ... skipped 'Pandas >= 0.19.2 must be installed; however, your version was 0.16.0.'
test_createDataFrame_fallback_disabled (pyspark.sql.tests.ArrowTests) ... skipped 'Pandas >= 0.19.2 must be installed; however, your version was 0.16.0.'
test_createDataFrame_fallback_enabled (pyspark.sql.tests.ArrowTests) ... skipped 'Pandas >= 0.19.2 must be installed; however, your version was 0.16.0.'
test_createDataFrame_respect_session_timezone (pyspark.sql.tests.ArrowTests) ... skipped 'Pandas >= 0.19.2 must be installed; however, your version was 0.16.0.'
test_createDataFrame_toggle (pyspark.sql.tests.ArrowTests) ... skipped 'Pandas >= 0.19.2 must be installed; however, your version was 0.16.0.'
test_createDataFrame_with_array_type (pyspark.sql.tests.ArrowTests) ... skipped 'Pandas >= 0.19.2 must be installed; however, your version was 0.16.0.'
test_createDataFrame_with_incorrect_schema (pyspark.sql.tests.ArrowTests) ... skipped 'Pandas >= 0.19.2 must be installed; however, your version was 0.16.0.'
test_createDataFrame_with_int_col_names (pyspark.sql.tests.ArrowTests) ... skipped 'Pandas >= 0.19.2 must be installed; however, your version was 0.16.0.'
test_createDataFrame_with_names (pyspark.sql.tests.ArrowTests) ... skipped 'Pandas >= 0.19.2 must be installed; however, your version was 0.16.0.'
test_createDataFrame_with_schema (pyspark.sql.tests.ArrowTests) ... skipped 'Pandas >= 0.19.2 must be installed; however, your version was 0.16.0.'
test_createDataFrame_with_single_data_type (pyspark.sql.tests.ArrowTests) ... skipped 'Pandas >= 0.19.2 must be installed; however, your version was 0.16.0.'
test_filtered_frame (pyspark.sql.tests.ArrowTests) ... skipped 'Pandas >= 0.19.2 must be installed; however, your version was 0.16.0.'
test_null_conversion (pyspark.sql.tests.ArrowTests) ... skipped 'Pandas >= 0.19.2 must be installed; however, your version was 0.16.0.'
test_pandas_round_trip (pyspark.sql.tests.ArrowTests) ... skipped 'Pandas >= 0.19.2 must be installed; however, your version was 0.16.0.'
test_schema_conversion_roundtrip (pyspark.sql.tests.ArrowTests) ... skipped 'Pandas >= 0.19.2 must be installed; however, your version was 0.16.0.'
test_timestamp_dst (pyspark.sql.tests.ArrowTests) ... skipped 'Pandas >= 0.19.2 must be installed; however, your version was 0.16.0.'
test_toPandas_arrow_toggle (pyspark.sql.tests.ArrowTests) ... skipped 'Pandas >= 0.19.2 must be installed; however, your version was 0.16.0.'
test_toPandas_fallback_disabled (pyspark.sql.tests.ArrowTests) ... skipped 'Pandas >= 0.19.2 must be installed; however, your version was 0.16.0.'
test_toPandas_fallback_enabled (pyspark.sql.tests.ArrowTests) ... skipped 'Pandas >= 0.19.2 must be installed; however, your version was 0.16.0.'
test_toPandas_respect_session_timezone (pyspark.sql.tests.ArrowTests) ... skipped 'Pandas >= 0.19.2 must be installed; however, your version was 0.16.0.'
test_toPandas_with_array_type (pyspark.sql.tests.ArrowTests) ... skipped 'Pandas >= 0.19.2 must be installed; however, your version was 0.16.0.'
test_alias (pyspark.sql.tests.GroupedAggPandasUDFTests) ... skipped 'Pandas >= 0.19.2 must be installed; however, your version was 0.16.0.'
test_array_type (pyspark.sql.tests.GroupedAggPandasUDFTests) ... skipped 'Pandas >= 0.19.2 must be installed; however, your version was 0.16.0.'
test_basic (pyspark.sql.tests.GroupedAggPandasUDFTests) ... skipped 'Pandas >= 0.19.2 must be installed; however, your version was 0.16.0.'
test_complex_expressions (pyspark.sql.tests.GroupedAggPandasUDFTests) ... skipped 'Pandas >= 0.19.2 must be installed; however, your version was 0.16.0.'
test_complex_groupby (pyspark.sql.tests.GroupedAggPandasUDFTests) ... skipped 'Pandas >= 0.19.2 must be installed; however, your version was 0.16.0.'
test_invalid_args (pyspark.sql.tests.GroupedAggPandasUDFTests) ... skipped 'Pandas >= 0.19.2 must be installed; however, your version was 0.16.0.'
test_manual (pyspark.sql.tests.GroupedAggPandasUDFTests) ... skipped 'Pandas >= 0.19.2 must be installed; however, your version was 0.16.0.'
test_mixed_sql (pyspark.sql.tests.GroupedAggPandasUDFTests) ... skipped 'Pandas >= 0.19.2 must be installed; however, your version was 0.16.0.'
test_mixed_udfs (pyspark.sql.tests.GroupedAggPandasUDFTests) ... skipped 'Pandas >= 0.19.2 must be installed; however, your version was 0.16.0.'
test_multiple_udfs (pyspark.sql.tests.GroupedAggPandasUDFTests) ... skipped 'Pandas >= 0.19.2 must be installed; however, your version was 0.16.0.'
test_retain_group_columns (pyspark.sql.tests.GroupedAggPandasUDFTests) ... skipped 'Pandas >= 0.19.2 must be installed; however, your version was 0.16.0.'
test_unsupported_types (pyspark.sql.tests.GroupedAggPandasUDFTests) ... skipped 'Pandas >= 0.19.2 must be installed; however, your version was 0.16.0.'
test_array_type_correct (pyspark.sql.tests.GroupedMapPandasUDFTests) ... skipped 'Pandas >= 0.19.2 must be installed; however, your version was 0.16.0.'
test_coerce (pyspark.sql.tests.GroupedMapPandasUDFTests) ... skipped 'Pandas >= 0.19.2 must be installed; however, your version was 0.16.0.'
test_column_order (pyspark.sql.tests.GroupedMapPandasUDFTests) ... skipped 'Pandas >= 0.19.2 must be installed; however, your version was 0.16.0.'
test_complex_groupby (pyspark.sql.tests.GroupedMapPandasUDFTests) ... skipped 'Pandas >= 0.19.2 must be installed; however, your version was 0.16.0.'
test_datatype_string (pyspark.sql.tests.GroupedMapPandasUDFTests) ... skipped 'Pandas >= 0.19.2 must be installed; however, your version was 0.16.0.'
test_decorator (pyspark.sql.tests.GroupedMapPandasUDFTests) ... skipped 'Pandas >= 0.19.2 must be installed; however, your version was 0.16.0.'
test_empty_groupby (pyspark.sql.tests.GroupedMapPandasUDFTests) ... skipped 'Pandas >= 0.19.2 must be installed; however, your version was 0.16.0.'
test_mixed_scalar_udfs_followed_by_grouby_apply (pyspark.sql.tests.GroupedMapPandasUDFTests) ... skipped 'Pandas >= 0.19.2 must be installed; however, your version was 0.16.0.'
test_positional_assignment_conf (pyspark.sql.tests.GroupedMapPandasUDFTests) ... skipped 'Pandas >= 0.19.2 must be installed; however, your version was 0.16.0.'
test_register_grouped_map_udf (pyspark.sql.tests.GroupedMapPandasUDFTests) ... skipped 'Pandas >= 0.19.2 must be installed; however, your version was 0.16.0.'
test_self_join_with_pandas (pyspark.sql.tests.GroupedMapPandasUDFTests) ... skipped 'Pandas >= 0.19.2 must be installed; however, your version was 0.16.0.'
test_supported_types (pyspark.sql.tests.GroupedMapPandasUDFTests) ... skipped 'Pandas >= 0.19.2 must be installed; however, your version was 0.16.0.'
test_timestamp_dst (pyspark.sql.tests.GroupedMapPandasUDFTests) ... skipped 'Pandas >= 0.19.2 must be installed; however, your version was 0.16.0.'
test_udf_with_key (pyspark.sql.tests.GroupedMapPandasUDFTests) ... skipped 'Pandas >= 0.19.2 must be installed; however, your version was 0.16.0.'
test_unsupported_types (pyspark.sql.tests.GroupedMapPandasUDFTests) ... skipped 'Pandas >= 0.19.2 must be installed; however, your version was 0.16.0.'
test_wrong_args (pyspark.sql.tests.GroupedMapPandasUDFTests) ... skipped 'Pandas >= 0.19.2 must be installed; however, your version was 0.16.0.'
test_wrong_return_type (pyspark.sql.tests.GroupedMapPandasUDFTests) ... skipped 'Pandas >= 0.19.2 must be installed; however, your version was 0.16.0.'
test_unbounded_frames (pyspark.sql.tests.HiveContextSQLTests) ... skipped "Unittest < 3.3 doesn't support mocking"
test_pandas_udf_basic (pyspark.sql.tests.PandasUDFTests) ... skipped 'Pandas >= 0.19.2 must be installed; however, your version was 0.16.0.'
test_pandas_udf_decorator (pyspark.sql.tests.PandasUDFTests) ... skipped 'Pandas >= 0.19.2 must be installed; however, your version was 0.16.0.'
test_stopiteration_in_udf (pyspark.sql.tests.PandasUDFTests) ... skipped 'Pandas >= 0.19.2 must be installed; however, your version was 0.16.0.'
test_udf_wrong_arg (pyspark.sql.tests.PandasUDFTests) ... skipped 'Pandas >= 0.19.2 must be installed; however, your version was 0.16.0.'
test_query_execution_listener_on_collect_with_arrow (pyspark.sql.tests.QueryExecutionListenerTests) ... skipped 'Pandas >= 0.19.2 must be installed; however, your version was 0.16.0.'
test_create_dataframe_from_pandas_with_timestamp (pyspark.sql.tests.SQLTests) ... skipped 'Pandas >= 0.19.2 must be installed; however, your version was 0.16.0.'
test_create_dateframe_from_pandas_with_dst (pyspark.sql.tests.SQLTests) ... skipped 'Pandas >= 0.19.2 must be installed; however, your version was 0.16.0.'
test_to_pandas (pyspark.sql.tests.SQLTests) ... skipped 'Pandas >= 0.19.2 must be installed; however, your version was 0.16.0.'
test_to_pandas_avoid_astype (pyspark.sql.tests.SQLTests) ... skipped 'Pandas >= 0.19.2 must be installed; however, your version was 0.16.0.'
test_datasource_with_udf (pyspark.sql.tests.ScalarPandasUDFTests) ... skipped 'Pandas >= 0.19.2 must be installed; however, your version was 0.16.0.'
test_mixed_udf (pyspark.sql.tests.ScalarPandasUDFTests) ... skipped 'Pandas >= 0.19.2 must be installed; however, your version was 0.16.0.'
test_mixed_udf_and_sql (pyspark.sql.tests.ScalarPandasUDFTests) ... skipped 'Pandas >= 0.19.2 must be installed; however, your version was 0.16.0.'
test_nondeterministic_vectorized_udf (pyspark.sql.tests.ScalarPandasUDFTests) ... skipped 'Pandas >= 0.19.2 must be installed; however, your version was 0.16.0.'
test_nondeterministic_vectorized_udf_in_aggregate (pyspark.sql.tests.ScalarPandasUDFTests) ... skipped 'Pandas >= 0.19.2 must be installed; however, your version was 0.16.0.'
test_register_nondeterministic_vectorized_udf_basic (pyspark.sql.tests.ScalarPandasUDFTests) ... skipped 'Pandas >= 0.19.2 must be installed; however, your version was 0.16.0.'
test_register_vectorized_udf_basic (pyspark.sql.tests.ScalarPandasUDFTests) ... skipped 'Pandas >= 0.19.2 must be installed; however, your version was 0.16.0.'
test_timestamp_dst (pyspark.sql.tests.ScalarPandasUDFTests) ... skipped 'Pandas >= 0.19.2 must be installed; however, your version was 0.16.0.'
test_type_annotation (pyspark.sql.tests.ScalarPandasUDFTests) ... skipped 'Pandas >= 0.19.2 must be installed; however, your version was 0.16.0.'
test_vectorized_udf_array_type (pyspark.sql.tests.ScalarPandasUDFTests) ... skipped 'Pandas >= 0.19.2 must be installed; however, your version was 0.16.0.'
test_vectorized_udf_basic (pyspark.sql.tests.ScalarPandasUDFTests) ... skipped 'Pandas >= 0.19.2 must be installed; however, your version was 0.16.0.'
test_vectorized_udf_chained (pyspark.sql.tests.ScalarPandasUDFTests) ... skipped 'Pandas >= 0.19.2 must be installed; however, your version was 0.16.0.'
test_vectorized_udf_check_config (pyspark.sql.tests.ScalarPandasUDFTests) ... skipped 'Pandas >= 0.19.2 must be installed; however, your version was 0.16.0.'
test_vectorized_udf_complex (pyspark.sql.tests.ScalarPandasUDFTests) ... skipped 'Pandas >= 0.19.2 must be installed; however, your version was 0.16.0.'
test_vectorized_udf_datatype_string (pyspark.sql.tests.ScalarPandasUDFTests) ... skipped 'Pandas >= 0.19.2 must be installed; however, your version was 0.16.0.'
test_vectorized_udf_dates (pyspark.sql.tests.ScalarPandasUDFTests) ... skipped 'Pandas >= 0.19.2 must be installed; however, your version was 0.16.0.'
test_vectorized_udf_decorator (pyspark.sql.tests.ScalarPandasUDFTests) ... skipped 'Pandas >= 0.19.2 must be installed; however, your version was 0.16.0.'
test_vectorized_udf_empty_partition (pyspark.sql.tests.ScalarPandasUDFTests) ... skipped 'Pandas >= 0.19.2 must be installed; however, your version was 0.16.0.'
test_vectorized_udf_exception (pyspark.sql.tests.ScalarPandasUDFTests) ... skipped 'Pandas >= 0.19.2 must be installed; however, your version was 0.16.0.'
test_vectorized_udf_invalid_length (pyspark.sql.tests.ScalarPandasUDFTests) ... skipped 'Pandas >= 0.19.2 must be installed; however, your version was 0.16.0.'
test_vectorized_udf_null_array (pyspark.sql.tests.ScalarPandasUDFTests) ... skipped 'Pandas >= 0.19.2 must be installed; however, your version was 0.16.0.'
test_vectorized_udf_null_binary (pyspark.sql.tests.ScalarPandasUDFTests) ... skipped 'Pandas >= 0.19.2 must be installed; however, your version was 0.16.0.'
test_vectorized_udf_null_boolean (pyspark.sql.tests.ScalarPandasUDFTests) ... skipped 'Pandas >= 0.19.2 must be installed; however, your version was 0.16.0.'
test_vectorized_udf_null_byte (pyspark.sql.tests.ScalarPandasUDFTests) ... skipped 'Pandas >= 0.19.2 must be installed; however, your version was 0.16.0.'
test_vectorized_udf_null_decimal (pyspark.sql.tests.ScalarPandasUDFTests) ... skipped 'Pandas >= 0.19.2 must be installed; however, your version was 0.16.0.'
test_vectorized_udf_null_double (pyspark.sql.tests.ScalarPandasUDFTests) ... skipped 'Pandas >= 0.19.2 must be installed; however, your version was 0.16.0.'
test_vectorized_udf_null_float (pyspark.sql.tests.ScalarPandasUDFTests) ... skipped 'Pandas >= 0.19.2 must be installed; however, your version was 0.16.0.'
test_vectorized_udf_null_int (pyspark.sql.tests.ScalarPandasUDFTests) ... skipped 'Pandas >= 0.19.2 must be installed; however, your version was 0.16.0.'
test_vectorized_udf_null_long (pyspark.sql.tests.ScalarPandasUDFTests) ... skipped 'Pandas >= 0.19.2 must be installed; however, your version was 0.16.0.'
test_vectorized_udf_null_short (pyspark.sql.tests.ScalarPandasUDFTests) ... skipped 'Pandas >= 0.19.2 must be installed; however, your version was 0.16.0.'
test_vectorized_udf_null_string (pyspark.sql.tests.ScalarPandasUDFTests) ... skipped 'Pandas >= 0.19.2 must be installed; however, your version was 0.16.0.'
test_vectorized_udf_return_scalar (pyspark.sql.tests.ScalarPandasUDFTests) ... skipped 'Pandas >= 0.19.2 must be installed; however, your version was 0.16.0.'
test_vectorized_udf_return_timestamp_tz (pyspark.sql.tests.ScalarPandasUDFTests) ... skipped 'Pandas >= 0.19.2 must be installed; however, your version was 0.16.0.'
test_vectorized_udf_string_in_udf (pyspark.sql.tests.ScalarPandasUDFTests) ... skipped 'Pandas >= 0.19.2 must be installed; however, your version was 0.16.0.'
test_vectorized_udf_timestamps (pyspark.sql.tests.ScalarPandasUDFTests) ... skipped 'Pandas >= 0.19.2 must be installed; however, your version was 0.16.0.'
test_vectorized_udf_timestamps_respect_session_timezone (pyspark.sql.tests.ScalarPandasUDFTests) ... skipped 'Pandas >= 0.19.2 must be installed; however, your version was 0.16.0.'
test_vectorized_udf_unsupported_types (pyspark.sql.tests.ScalarPandasUDFTests) ... skipped 'Pandas >= 0.19.2 must be installed; however, your version was 0.16.0.'
test_vectorized_udf_varargs (pyspark.sql.tests.ScalarPandasUDFTests) ... skipped 'Pandas >= 0.19.2 must be installed; however, your version was 0.16.0.'
test_vectorized_udf_wrong_return_type (pyspark.sql.tests.ScalarPandasUDFTests) ... skipped 'Pandas >= 0.19.2 must be installed; however, your version was 0.16.0.'
test_array_type (pyspark.sql.tests.WindowPandasUDFTests) ... skipped 'Pandas >= 0.19.2 must be installed; however, your version was 0.16.0.'
test_invalid_args (pyspark.sql.tests.WindowPandasUDFTests) ... skipped 'Pandas >= 0.19.2 must be installed; however, your version was 0.16.0.'
test_mixed_sql (pyspark.sql.tests.WindowPandasUDFTests) ... skipped 'Pandas >= 0.19.2 must be installed; however, your version was 0.16.0.'
test_mixed_sql_and_udf (pyspark.sql.tests.WindowPandasUDFTests) ... skipped 'Pandas >= 0.19.2 must be installed; however, your version was 0.16.0.'
test_mixed_udf (pyspark.sql.tests.WindowPandasUDFTests) ... skipped 'Pandas >= 0.19.2 must be installed; however, your version was 0.16.0.'
test_multiple_udfs (pyspark.sql.tests.WindowPandasUDFTests) ... skipped 'Pandas >= 0.19.2 must be installed; however, your version was 0.16.0.'
test_replace_existing (pyspark.sql.tests.WindowPandasUDFTests) ... skipped 'Pandas >= 0.19.2 must be installed; however, your version was 0.16.0.'
test_simple (pyspark.sql.tests.WindowPandasUDFTests) ... skipped 'Pandas >= 0.19.2 must be installed; however, your version was 0.16.0.'
test_without_partitionBy (pyspark.sql.tests.WindowPandasUDFTests) ... skipped 'Pandas >= 0.19.2 must be installed; however, your version was 0.16.0.'
Skipped tests in pyspark.sql.tests with python3.4:
test_create_dataframe_required_pandas_not_found (pyspark.sql.tests.SQLTests) ... skipped 'Required Pandas was found.'
test_to_pandas_required_pandas_not_found (pyspark.sql.tests.SQLTests) ... skipped 'Required Pandas was found.'
test_type_annotation (pyspark.sql.tests.ScalarPandasUDFTests) ... skipped 'Type hints are supported from Python 3.5.'
Skipped tests in pyspark.tests with python3.4:
test_sequencefiles (pyspark.tests.InputFormatTests) ... skipped 'serialize array of byte'
test_newhadoop_with_array (pyspark.tests.OutputFormatTests) ... skipped 'serialize of array'
test_sequencefiles (pyspark.tests.OutputFormatTests) ... skipped 'serialize array of byte'
```
`flake8` @cclauss used here is a kind of linter which is not yet automatically ran in Jenkins.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org