You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@beam.apache.org by peihe <gi...@git.apache.org> on 2017/04/25 10:22:35 UTC
[GitHub] beam pull request #2672: Merge branch 'master' upto commit 686b774 into jsto...
GitHub user peihe opened a pull request:
https://github.com/apache/beam/pull/2672
Merge branch 'master' upto commit 686b774 into jstorm-runner
Be sure to do all of the following to help us incorporate your contribution
quickly and easily:
- [ ] Make sure the PR title is formatted like:
`[BEAM-<Jira issue #>] Description of pull request`
- [ ] Make sure tests pass via `mvn clean verify`. (Even better, enable
Travis-CI on your fork and ensure the whole test matrix passes).
- [ ] Replace `<Jira issue #>` in the title with the actual Jira issue
number, if there is one.
- [ ] If this contribution is large, please file an Apache
[Individual Contributor License Agreement](https://www.apache.org/licenses/icla.pdf).
---
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/peihe/incubator-beam jstorm-runner
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/beam/pull/2672.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #2672
----
commit 5b1d73fee3994784fd826aea1a7fc81c261d093f
Author: mdshalda <md...@gmail.com>
Date: 2017-04-06T05:23:00Z
BEAM-1851: Update documentation for for fixedSizeGlobally to be clear about memory constraints.
commit e0df45850f8e7dc3d905afbca011c492a68b492f
Author: Davor Bonaci <da...@google.com>
Date: 2017-04-07T15:12:15Z
This closes #2451
commit aac8b03289a296011a976b1edc0f66991e13013a
Author: Robert Bradshaw <ro...@gmail.com>
Date: 2017-04-05T18:55:20Z
Use absolute import for dataflow iobase test.
commit 661c06652da5d853904a74c5313ae978a29a60b7
Author: Ahmet Altay <al...@google.com>
Date: 2017-04-07T17:57:57Z
This closes #2437
commit aaae9d776e958d6d891c2d2c635d0164f07132a1
Author: Sourabh Bajaj <so...@google.com>
Date: 2017-04-06T23:23:33Z
[BEAM-778] Fix the Compressed file seek tests on windows
commit 0a8ac352834521eadb0ed30dec2ca28ff3b87785
Author: chamikara@google.com <ch...@google.com>
Date: 2017-04-07T18:11:06Z
This closes #2456
commit e05e60117f03fbcb1ba99fd5205b04cd37a917da
Author: Ahmet Altay <al...@google.com>
Date: 2017-04-07T18:21:17Z
Clean up in textio and tfrecordio
commit 82c5e89ca07972f36e255a2dbb1258cabb6ec8fa
Author: Ahmet Altay <al...@google.com>
Date: 2017-04-07T18:47:03Z
This closes #2461
commit ef344ee4b34abc19f27ec84a2b56f906009db23d
Author: Mark Liu <ma...@google.com>
Date: 2017-04-07T21:30:44Z
[BEAM-1823] Improve ValidatesRunner Test Log
commit 4fd8dc401b5cb995fea150204fd77a3f48150ee2
Author: Ahmet Altay <al...@google.com>
Date: 2017-04-07T22:02:46Z
This closes #2464
commit 03a99b4df18ceeb7cd61953c461c4cca377a37ae
Author: Eugene Kirpichov <ki...@google.com>
Date: 2017-04-07T19:09:47Z
[BEAM-65] Adds HasDefaultTracker for RestrictionTracker inference
Allows a restriction type to implement HasDefaultTracker,
in that case the splittable DoFn itself does not need to
implement NewTracker - only ProcessElement and GetInitialRestriction.
commit 8179d8c8af9f3afaa785755b13822d2bd508f789
Author: Eugene Kirpichov <ki...@google.com>
Date: 2017-04-07T22:54:03Z
Cleanup: removes two unused constants
commit 4a694cebb5deaf4f0d24bea18fa2194798a8ac0f
Author: Eugene Kirpichov <ki...@google.com>
Date: 2017-04-07T22:55:43Z
This closes #2462
commit dad7ace2b6143850fac0ca5359d9f56f5f0df2c1
Author: Eugene Kirpichov <ki...@google.com>
Date: 2017-04-06T22:07:05Z
Fixes SDF issues re: watermarks and stop/resume
See detailed discussion in document:
https://docs.google.com/document/d/1BGc8pM1GOvZhwR9SARSVte-20XEoBUxrGJ5gTWXdv3c/edit
commit 29c280211c2431f29c5552c35bd3435c65e4975b
Author: Eugene Kirpichov <ki...@google.com>
Date: 2017-04-07T21:00:05Z
Adds tests for the watermark hold (previously untested)
commit 19f407c9497c911ca3cb61d989aa5a78c84896cf
Author: Eugene Kirpichov <ki...@google.com>
Date: 2017-04-08T00:00:39Z
Clarifies doc of ProcessElement re: HasDefaultTracker
commit 1594849da972f5b4dcfc52eb3991d1df083d6719
Author: Eugene Kirpichov <ki...@google.com>
Date: 2017-04-08T00:08:54Z
This closes #2455
commit 8484ef9168940cf929648fd53982acc6740c5107
Author: Thomas Weise <th...@apache.org>
Date: 2017-04-04T07:33:35Z
BEAM-1887 Switch Apex ParDo to new DoFn.
commit 7f55746ce3eb2a0b6ee2f6372d6f7127835cbb34
Author: Eugene Kirpichov <ki...@google.com>
Date: 2017-04-08T01:26:15Z
This closes #2450
commit 042b28a681d1ee0c8942a0ec61df014c23a0fdaf
Author: Dan Halperin <dh...@google.com>
Date: 2017-04-07T21:56:09Z
TestDataflowRunner: better error handling
1. There was a race in which pipelines without PAsserts might
erroneously pass because they would be canceled, which would
in turn cause the watermarks to reach max infinity, which
would in turn (because there are no PAsserts) cause the main
streaming poll loop think the pipeline succeeded.
Fix this by making the error presence available to the main
polling loop, and only canceling from there.
2. The fact we were canceling from two places meant we could
get double-cancelations that led to test failures.
Fix both these issues (I hope).
commit 0c3dc0051a5e6ef4034df83b0d09467e7c55c1f0
Author: Dan Halperin <dh...@google.com>
Date: 2017-04-08T01:48:52Z
This closes #2465
commit 42f63342be667649eff5ea65dd9714c8b2f75cff
Author: rjoshi2 <re...@gmail.com>
Date: 2017-04-08T01:12:09Z
Fix for potentially unclosed streams in ApexYarnLauncher
commit 810db7f990a9e39179f3613347ab5cde7e7c650c
Author: Thomas Weise <th...@apache.org>
Date: 2017-04-08T04:56:11Z
This closes #2469
commit 9e294dc05c1f1ac2aa2ac15f364394698a2767a7
Author: Amit Sela <am...@gmail.com>
Date: 2017-04-04T08:46:38Z
[BEAM-1737] Implement a Single-output ParDo as a Multi-output ParDo with a single output.
remove use of EvaluationContext in DStream lambda, it is not serializable and also redundant in this
case.
implement pardo as multido.
cache only if this is an actual MultiDo.
commit a0cfccda4f1fd08ae04aef41c1cc0bc14f00e112
Author: Amit Sela <am...@gmail.com>
Date: 2017-04-09T07:06:08Z
This closes #2420
commit d958796b525861764318f0c022e4987aa64ac300
Author: Aviem Zur <av...@gmail.com>
Date: 2017-02-17T10:35:49Z
[BEAM-1294] Long running UnboundedSource Readers
commit efd785f881d2c231f202c5031d6aeeb042177850
Author: Aviem Zur <av...@gmail.com>
Date: 2017-04-09T19:47:03Z
This closes #2033
commit 6da0b27aa56e8a133e206b5eb84b9ab937a2b17e
Author: mingmxu <mi...@ebay.com>
Date: 2017-04-09T18:34:26Z
[BEAM-1921] Expose connection properties in JdbcIO
commit 713701ddc43c3987e261ecd08b34131ea80c3999
Author: Jean-Baptiste Onofr� <jb...@apache.org>
Date: 2017-04-09T20:16:17Z
[BEAM-1921] This closes #2477
commit 6b2659cff9a7cc3283a8172ef87f589e887cf6f2
Author: Uwe Jugel <uw...@lovoo.com>
Date: 2017-04-10T12:24:44Z
better log message for bigquery temp tables
----
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---
[GitHub] beam pull request #2672: Merge branch 'master' upto commit 686b774 into jsto...
Posted by asfgit <gi...@git.apache.org>.
Github user asfgit closed the pull request at:
https://github.com/apache/beam/pull/2672
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---