You are viewing a plain text version of this content. The canonical link for it is here.
Posted to reviews@spark.apache.org by damnMeddlingKid <gi...@git.apache.org> on 2015/10/28 23:15:44 UTC
[GitHub] spark pull request: Update spark
GitHub user damnMeddlingKid opened a pull request:
https://github.com/apache/spark/pull/9341
Update spark
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/Shopify/spark update_spark
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/spark/pull/9341.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #9341
----
commit 4639372eb9325f466b78d074bfc24d8d5a93322e
Author: Alex Angelini <al...@gmail.com>
Date: 2015-10-19T17:07:39Z
[SPARK-9643] Upgrade pyrolite to 4.9
Includes: https://github.com/irmen/Pyrolite/pull/23 which fixes datetimes with timezones.
JoshRosen
https://issues.apache.org/jira/browse/SPARK-9643
Author: Alex Angelini <al...@gmail.com>
Closes #7950 from angelini/upgrade_pyrolite_up.
commit 7b4cd3da570c098da5adef82d394c84d3df8d602
Author: Holden Karau <ho...@pigscanfly.ca>
Date: 2015-10-20T17:52:49Z
[SPARK-10447][SPARK-3842][PYSPARK] upgrade pyspark to py4j0.9
Upgrade to Py4j0.9
Author: Holden Karau <ho...@pigscanfly.ca>
Author: Holden Karau <ho...@us.ibm.com>
Closes #8615 from holdenk/SPARK-10447-upgrade-pyspark-to-py4j0.9.
commit 56c6e7846e00c7deacf8349a93e517c7ed496ee5
Author: Nick Evans <me...@nicolasevans.org>
Date: 2015-10-27T08:29:06Z
[SPARK-11270][STREAMING] Add improved equality testing for TopicAndPartition from the Kafka Streaming API
jerryshao tdas
I know this is kind of minor, and I know you all are busy, but this brings this class in line with the `OffsetRange` class, and makes tests a little more concise.
Instead of doing something like:
```
assert topic_and_partition_instance._topic == "foo"
assert topic_and_partition_instance._partition == 0
```
You can do something like:
```
assert topic_and_partition_instance == TopicAndPartition("foo", 0)
```
Before:
```
>>> from pyspark.streaming.kafka import TopicAndPartition
>>> TopicAndPartition("foo", 0) == TopicAndPartition("foo", 0)
False
```
After:
```
>>> from pyspark.streaming.kafka import TopicAndPartition
>>> TopicAndPartition("foo", 0) == TopicAndPartition("foo", 0)
True
```
I couldn't find any tests - am I missing something?
Author: Nick Evans <me...@nicolasevans.org>
Closes #9236 from manygrams/topic_and_partition_equality.
----
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] spark pull request: Update spark
Posted by AmplabJenkins <gi...@git.apache.org>.
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/9341#issuecomment-152014835
Can one of the admins verify this patch?
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] spark pull request: Update spark
Posted by damnMeddlingKid <gi...@git.apache.org>.
Github user damnMeddlingKid closed the pull request at:
https://github.com/apache/spark/pull/9341
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org