You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@beam.apache.org by pabloem <gi...@git.apache.org> on 2016/11/22 22:33:03 UTC
[GitHub] incubator-beam pull request #1419: [BEAM-147] Adding Metrics API to Python S...
GitHub user pabloem opened a pull request:
https://github.com/apache/incubator-beam/pull/1419
[BEAM-147] Adding Metrics API to Python SDK
Be sure to do all of the following to help us incorporate your contribution
quickly and easily:
- [x] Make sure the PR title is formatted like:
`[BEAM-<Jira issue #>] Description of pull request`
- [ ] Make sure tests pass via `mvn clean verify`. (Even better, enable
Travis-CI on your fork and ensure the whole test matrix passes).
- [x] Replace `<Jira issue #>` in the title with the actual Jira issue
number, if there is one.
- [ ] If this contribution is large, please file an Apache
[Individual Contributor License Agreement](https://www.apache.org/licenses/icla.txt).
---
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/pabloem/incubator-beam metrics-api
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/incubator-beam/pull/1419.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #1419
----
commit 937cf69e958d4a82fb274f311de248930298db69
Author: Robert Bradshaw <ro...@google.com>
Date: 2016-07-22T21:32:33Z
Fix multi-input named PTransforms.
Now delegate the __ror__ logic entirely for the naming wrapper.
commit 031c4cce0b9eae0d50a49f43ffeced1edbfd2f8f
Author: Robert Bradshaw <ro...@google.com>
Date: 2016-07-22T21:34:58Z
Move names out of transform constructors.
sed -i -r 's/[|] (\S+)[(](["'"'"'][^"'"'"']+.)(, +|([)]))/| \2 >> \1(\4/g'
Small number of tests will need to be fixed by hand.
commit 7c186ce4ce18c98cf3979b6f0f07c72a47b42ec9
Author: Robert Bradshaw <ro...@google.com>
Date: 2016-07-22T22:55:26Z
Fix error messages for externally named PTransforms.
commit 362f2e9e4398662d55a2a4e6399f43155c58ed24
Author: Ahmet Altay <al...@google.com>
Date: 2016-07-22T23:03:08Z
fix pipeline test
commit 2ff5630be06034e25d60e105bbe1a718ae06b4d6
Author: Chamikara Jayalath <ch...@google.com>
Date: 2016-07-22T23:04:29Z
Fixes examples
commit 01830510bded3c22ddd96937f5d83547702a4385
Author: Robert Bradshaw <ro...@google.com>
Date: 2016-07-22T23:05:23Z
Cleanup and fix combiners_test.
commit 2a59a121441a003bad949ae6a23d58a9cf2b3059
Author: Robert Bradshaw <ro...@google.com>
Date: 2016-07-22T23:24:48Z
Fix label-sensitive test.
commit b15d35ca6e585e75153e05d96403336889cc6894
Author: Robert Bradshaw <ro...@google.com>
Date: 2016-07-23T01:35:22Z
Lint fixes.
commit c5b5b14d35fc7f6b0a576f0fca19b730015e1282
Author: Robert Bradshaw <ro...@google.com>
Date: 2016-07-23T08:07:44Z
fixup: failing tests expecting name
commit e3c078fe28553b7e7317316b6df51b4c570573ba
Author: Robert Bradshaw <ro...@google.com>
Date: 2016-07-23T08:32:23Z
Final cleanup pass.
commit 38d9dea2e62af280e4b9c258cedee70d6bcaa8ca
Author: Robert Bradshaw <ro...@gmail.com>
Date: 2016-07-23T23:43:47Z
Closes #718
commit ac3249fe51e9674149ae9cccd48c7290aa8bf34d
Author: Robert Bradshaw <ro...@google.com>
Date: 2016-07-23T00:33:57Z
Make DoFnRunner a Receiver.
commit d20cf64287fdd22b1efa1a3afe346a0a1d5cf924
Author: Robert Bradshaw <ro...@google.com>
Date: 2016-07-23T07:37:42Z
Receiver and LoggingContext adapters.
This allows for cdef calls iff the right type is passed in.
commit de35f28294dfb4f47b429635eff843b38279e240
Author: Robert Bradshaw <ro...@google.com>
Date: 2016-07-23T07:54:11Z
Allow passing logging context directly.
This is better than passing a logger module with a specific class.
commit 153916fe9f641f5fe5e8d473caef67f449ee6bca
Author: Robert Bradshaw <ro...@google.com>
Date: 2016-07-25T19:02:02Z
Closes #721
commit 8a7bc71dee1e3f9f17c29e5e558870a6bc5f4880
Author: Charles Chen <cc...@google.com>
Date: 2016-07-26T01:22:08Z
Fix SDK name and version sent to the Cloud Dataflow service
commit 76f3864b61ad9e2ac9a2e81e7a0d5993db5fde6c
Author: Charles Chen <cc...@google.com>
Date: 2016-07-26T01:36:45Z
Update docstring.
commit 26ff6579531d598e91b220fa21ec9bd7f9220f78
Author: Robert Bradshaw <ro...@gmail.com>
Date: 2016-07-26T04:11:31Z
Closes #730
commit 2f4054ba37da1c1100f45a572d96e7a6e2e60152
Author: Charles Chen <cc...@google.com>
Date: 2016-07-25T18:44:22Z
Make TextFileReader observable
This allows future implementation of size tracking for elements in side input sources.
commit 53ab635c75e4b94b3930a601911a717ddc499efe
Author: Robert Bradshaw <ro...@gmail.com>
Date: 2016-07-28T18:05:56Z
Closes #726
commit adb3ed93053c83b4e28e7baa879e9aee82f02785
Author: Robert Bradshaw <ro...@gmail.com>
Date: 2016-07-27T17:09:49Z
Better top implementation.
When selecting the top k of n, it is common that k << n.
Using a heap is O(n log k) while select algorithms can
achieve O(n + k log k).
This also avoids the ugliness that heapq does not take the
comparator as an argument, resulting in _HeapItem classes that
were cumbersome and expensive to serialize.
commit 866a09d6c5c4c1c3c39d3a1f2e7b4cb7ec319f6f
Author: Robert Bradshaw <ro...@gmail.com>
Date: 2016-07-27T19:23:02Z
Allow Top operations to take key argument rather than compare.
Also support ordering by the natural ordering if neither is specified,
and a reverse option. This is both an API and performance improvement.
commit b4716d9dcf9c3f198fc72e181adc0bae8b6fa818
Author: Robert Bradshaw <ro...@gmail.com>
Date: 2016-07-28T18:08:06Z
Closes #741
commit 7d2fb1f88d1a2370dd4053f3a1738cbb9838cc2f
Author: Robert Bradshaw <ro...@google.com>
Date: 2016-07-28T01:29:59Z
Optimize Map and Flatmap when there are no side inputs.
varargs and kwargs are expensive, even when they're empty.
This is especially true for otherwise one-argument Python calls
which are special cased in CPython.
commit 351c3831de1bdcfcb19b2f24f9f0b6a19e77e421
Author: Robert Bradshaw <ro...@gmail.com>
Date: 2016-07-28T18:09:49Z
Closes #748
commit a1f1fa06ee8683273182548e7eb2d6612040d2bf
Author: Marian Dvorsky <ma...@google.com>
Date: 2016-07-28T20:02:15Z
Increased the GCS buffer size from 1MB to 8MB and introduced a 128kB buffer for the pipe.
commit c155ef0ebc88ac34a3681b8bff6152e1857da847
Author: Robert Bradshaw <ro...@gmail.com>
Date: 2016-07-29T01:17:43Z
Closes #752
commit 889f700d4568773743ef0cfe0ca0fd8d55e56c99
Author: Ahmet Altay <al...@google.com>
Date: 2016-07-29T20:45:57Z
Fix typo in combiners test.
commit 5541c0305c4129741579fbbed54b3194f00e3cf6
Author: Dan Halperin <dh...@google.com>
Date: 2016-07-29T20:55:22Z
Closes #760
commit 7d50d8040585e0cea5bc02de4cb199f29c1472fc
Author: Chamikara Jayalath <ch...@google.com>
Date: 2016-07-29T22:40:39Z
Deletes some code that is not used by SDK.
Also deletes corresponding tests.
----
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---
[GitHub] incubator-beam pull request #1419: [BEAM-147] Adding Metrics API to Python S...
Posted by pabloem <gi...@git.apache.org>.
Github user pabloem closed the pull request at:
https://github.com/apache/incubator-beam/pull/1419
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---