You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@beam.apache.org by katsiapis <gi...@git.apache.org> on 2016/10/05 02:45:47 UTC
[GitHub] incubator-beam pull request #1053: [BEAM-570] Title of the pull request
GitHub user katsiapis opened a pull request:
https://github.com/apache/incubator-beam/pull/1053
[BEAM-570] Title of the pull request
- Getting rid of CompressionTypes.ZLIB and CompressionTypes.NO_COMPRESSION.
- Introducing BZIP2 compression in analogy to Dataflow Java's BZIP2, towards resolution of https://issues.apache.org/jira/browse/BEAM-570.
- Introducing SNAPPY codec support for AVRO conciseness and in order to fully resolve https://issues.apache.org/jira/browse/BEAM-570.
- Moving avroio from compression_type to codec as per various discussions.
- A few cleanups in avroio.
- Making textio more DRY and doing a few cleanups.
- Raising exceptions when splitting is requested for compressed source since that should never happen (guaranteed by the service for the supported compression types).
- Using cStringIO instead of StringIO in various places as decided in some other discussions.
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/katsiapis/incubator-beam bz2
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/incubator-beam/pull/1053.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #1053
----
commit bd44e76b80e4edf4f922b9a26f7b359c4ede2008
Author: Gus Katsiapis <ka...@katsiapis-linux.mtv.corp.google.com>
Date: 2016-10-05T02:41:07Z
Several enhancements to Dataflow (part 2 of 2).
----
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---
[GitHub] incubator-beam pull request #1053: [BEAM-570] Several enhancements and depre...
Posted by katsiapis <gi...@git.apache.org>.
Github user katsiapis closed the pull request at:
https://github.com/apache/incubator-beam/pull/1053
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---