You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@beam.apache.org by "ASF GitHub Bot (JIRA)" <ji...@apache.org> on 2017/11/05 07:10:00 UTC
[jira] [Commented] (BEAM-3141) Make coders & streams work in Python
3
[ https://issues.apache.org/jira/browse/BEAM-3141?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16239426#comment-16239426 ]
ASF GitHub Bot commented on BEAM-3141:
--------------------------------------
GitHub user holdenk opened a pull request:
https://github.com/apache/beam/pull/4078
[BEAM-3141][WIP] Support the coders in Python 3
This adds support for the coders in Python 3 as well as fixes some other issues that were blocking `GameStatsTest`/
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/holdenk/beam BEAM-3141-coder-py3-support-r2
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/beam/pull/4078.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #4078
----
commit f3dd6257e3765bf9117207fa8173027f92b64c60
Author: Holden Karau <ho...@google.com>
Date: 2017-11-03T18:18:26Z
Fix unicode imports and NoneType
commit 6f7f8aa6ea9b42f7ed39af68ccd806bc16173b1c
Author: Holden Karau <ho...@google.com>
Date: 2017-11-03T18:31:06Z
Swap the avroio over to BytesIO
commit 32f39f1e9023faea87a23c4bf9bd31897d9b2f8f
Author: Holden Karau <ho...@google.com>
Date: 2017-11-03T18:31:24Z
Swithc apiclinet to io StringIO from StringIO StringIO
commit 630d40d74eec5e3af693e5ab0fba3e4b3163ba62
Author: Holden Karau <ho...@google.com>
Date: 2017-11-03T18:39:31Z
Switch required packages based on Python version (currently only impacting avro) and add future geq 0.16.0
commit 9bd4e7f20770d6276ea16b58dfdb041210ae1a15
Author: Holden Karau <ho...@google.com>
Date: 2017-11-03T23:07:27Z
Rewrite lambda with expansion
commit f58668416f3f451166dbe644ab56581c4902d6b6
Author: Holden Karau <ho...@google.com>
Date: 2017-11-03T23:07:42Z
Fix items and builtin import and a long import
commit da9ebb7667df4992512177d1d0e8b9ce4cafc62e
Author: Holden Karau <ho...@us.ibm.com>
Date: 2017-08-20T21:11:07Z
Rich comparisions requirement
commit dfc4e9057acb417e261a5e59399e5e943861cc3d
Author: Holden Karau <ho...@us.ibm.com>
Date: 2017-08-20T21:42:33Z
Add __hash__ methods in places where needed (in progress)
commit ca1f224d080ea37fd0de3582e9a7a5847f476f34
Author: Holden Karau <ho...@us.ibm.com>
Date: 2017-08-21T09:03:52Z
Provide eq/hashing/sorting for TimestampedValue
commit ea502b5a95b42ded289a97bc59a3cfbd2b9e05d8
Author: Holden Karau <ho...@us.ibm.com>
Date: 2017-08-21T18:44:37Z
If we are passed in bytes for the lookup in pipeline_context do the lookup as a string
commit fee6a65eaef0b85386fa42cd02ef45da8e370d51
Author: Holden Karau <ho...@us.ibm.com>
Date: 2017-08-21T19:08:44Z
Provide a base ne using eq for windows
commit 099e115f190d86352cc9b01a0b4feb48b3442192
Author: Holden Karau <ho...@google.com>
Date: 2017-11-03T23:11:29Z
Switch filesystem to io.StringIO
commit b0c7cda8626b90a7bd260077f54da5c07ba2b3c4
Author: Holden Karau <ho...@google.com>
Date: 2017-11-03T23:47:13Z
Fix cirular dep introduced through Py3 import changes for CreatePTransformOverride.
commit b0af9cca420d97b9037be91ddba9719a01a272ad
Author: Holden Karau <ho...@google.com>
Date: 2017-11-04T00:00:34Z
Change slow_stream to bytes
commit 5890721770aca710d5f8f5194ade7a9f2a19fbc5
Author: Holden Karau <ho...@google.com>
Date: 2017-11-04T04:40:17Z
Handle slow_stream in py2 again
commit bc30732264463b12a49f445e0f369e361e5fb823
Author: Holden Karau <ho...@google.com>
Date: 2017-11-04T04:58:44Z
Selective fixes while running through apache_beam.examples.complete.game.game_stats_test.GameStatsTest, fix some rethrows. lambda expansion, imports, and metaclass
commit b2424e790e01d1a758458f052f37648850719705
Author: Holden Karau <ho...@google.com>
Date: 2017-11-04T05:00:14Z
metaclass rewrite rule
commit fb63800079b3b44e4b6ec59844c20813b1ba449a
Author: Holden Karau <ho...@google.com>
Date: 2017-11-04T06:36:00Z
Apply futurize on gen_protos
commit 767c1cc30d32edf21edf1916a47a8f5c779512fd
Author: Holden Karau <ho...@google.com>
Date: 2017-11-04T07:16:12Z
queue and raise rewrites
commit e8e40ac46097fd3b4ecc7f40383031755a0b265f
Author: Holden Karau <ho...@google.com>
Date: 2017-11-04T07:18:10Z
futurize -wn -f libfuturize.fixes.fix_future_standard_library_urllib ./apache_beam
commit fe278de3039ceaae7af819cb119bb31f25d679fa
Author: Holden Karau <ho...@google.com>
Date: 2017-11-04T08:04:59Z
Finish up getting apache_beam.examples.complete.game.game_stats_test.GameStatsTest to run, fix serialized values map over, switch some exception re-throws, iteritems, and handle peaking at the eval context.
commit f2c78e6f0b66b11292035eac224914dc439d175c
Author: Holden Karau <ho...@google.com>
Date: 2017-11-04T08:21:04Z
Fix the write_byte on slow stream to just use bytes rather than encode
commit 8dbf4e72cdb5a4bf6a4280f472acca85ef3c991c
Author: Holden Karau <ho...@google.com>
Date: 2017-11-04T08:25:14Z
Fix some bytes coders tests to use bytes in py3
commit d43b70419c883ad30183893d967456a78595f11d
Author: Holden Karau <ho...@google.com>
Date: 2017-11-04T08:25:38Z
Change the fall through for encoding a bit and update past imports
commit 5c102b70cce3ad49c635d4ea52432356ddf00f50
Author: Holden Karau <ho...@google.com>
Date: 2017-11-04T08:25:57Z
Only wrap in bytes for py3
commit 669c3f90c1b71cc34f89c9b3e52e95ac385b1333
Author: Holden Karau <ho...@google.com>
Date: 2017-11-05T04:09:21Z
Fix remaining coder issues accross py2/3
----
> Make coders & streams work in Python 3
> --------------------------------------
>
> Key: BEAM-3141
> URL: https://issues.apache.org/jira/browse/BEAM-3141
> Project: Beam
> Issue Type: Sub-task
> Components: sdk-py-core
> Reporter: holdenk
> Assignee: Ahmet Altay
>
> Fix coders & streams support in Python 3.
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)