You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@beam.apache.org by amitsela <gi...@git.apache.org> on 2016/07/03 16:20:37 UTC
[GitHub] incubator-beam pull request #585: Merge master into runners-spark2 branch to...
GitHub user amitsela opened a pull request:
https://github.com/apache/incubator-beam/pull/585
Merge master into runners-spark2 branch to keep up-to-date
Be sure to do all of the following to help us incorporate your contribution
quickly and easily:
- [ ] Make sure the PR title is formatted like:
`[BEAM-<Jira issue #>] Description of pull request`
- [ ] Make sure tests pass via `mvn clean verify`. (Even better, enable
Travis-CI on your fork and ensure the whole test matrix passes).
- [ ] Replace `<Jira issue #>` in the title with the actual Jira issue
number, if there is one.
- [ ] If this contribution is large, please file an Apache
[Individual Contributor License Agreement](https://www.apache.org/licenses/icla.txt).
---
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/amitsela/incubator-beam merge-master
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/incubator-beam/pull/585.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #585
----
commit 4254749bf103c4bb6f68e316768c0aa46d9f7df0
Author: Kenneth Knowles <kl...@google.com>
Date: 2016-05-05T22:11:07Z
Configure RunnableOnService tests for Spark runner, batch mode
commit c4684bffc39ca3c40d2ef333502e0dd08d310591
Author: Pei He <pe...@google.com>
Date: 2016-06-16T18:38:51Z
Remove the beam.examples dependency from flink.
commit da324bf522bdef7b990f79cd30fa6566029a748f
Author: Davor Bonaci <da...@google.com>
Date: 2016-06-17T18:40:54Z
This closes #478
commit c666d4eedf9b0b85a24445bbe8bc69a0f26686f5
Author: Thomas Groh <tg...@google.com>
Date: 2016-06-17T17:25:44Z
Remove last vestige of the words DirectPipeline
commit 336ae2e7e3aba43e16a32f0b6b4dabbf92e8ff02
Author: Davor Bonaci <da...@google.com>
Date: 2016-06-17T18:45:49Z
This closes #484
commit cdfab9ba95c3d0b32a8a46aa24b4895a9d261904
Author: Pei He <pe...@google.com>
Date: 2016-06-17T20:02:58Z
Remove references to javax.servlet.
commit 47dd61a553a0440125eb2994a514904d739677cd
Author: Davor Bonaci <da...@google.com>
Date: 2016-06-17T20:53:59Z
This closes #486
commit 6ebc8abe83b2417df9abe11c691a4f6cec4e66b6
Author: Thomas Groh <tg...@google.com>
Date: 2016-06-17T20:22:26Z
Finish removing DirectPipelineRunner references
commit 81dcd527888be7bcfde09e47a3f512aeafd4a962
Author: Dan Halperin <dh...@google.com>
Date: 2016-06-17T22:11:01Z
Closes #490
commit 3841f41133219272e1e88d6ba56b0d158d6bd59d
Author: Thomas Groh <tg...@google.com>
Date: 2016-06-17T18:42:19Z
Rename DataflowPipelineRunner to DataflowRunner
commit 8a9dcc71f08aa72a008344b75c30949703e7f6f5
Author: Dan Halperin <dh...@google.com>
Date: 2016-06-17T22:13:39Z
Closes #487
commit 95308fbbfa3accc5a1be5c87db729bcc41255156
Author: Pei He <pe...@google.com>
Date: 2016-06-16T22:50:21Z
Turn on failOnWarning and ignore unused runners modules in example.
commit 69a4141a5a0176fdcada1917ba752e278a7f9e11
Author: Davor Bonaci <da...@google.com>
Date: 2016-06-17T22:26:52Z
This closes #482
commit 916bf3a84776c45f679bc27dfbaa6e7eec205ef7
Author: Thomas Groh <tg...@google.com>
Date: 2016-06-17T23:06:37Z
Run Pipelines in tests that expect them
commit 93ca508bbdf558772e909df099148a9d03a1e6d4
Author: Aljoscha Krettek <al...@gmail.com>
Date: 2016-06-01T09:56:18Z
[BEAM-321] Fix Flink Comparators
KvCoderComparator and CoderComparator were hashing the key directly
while doing comparisons on the encoded form. This lead to
inconsistencies in GroupByKey results with large numbers of elements per
key.
This changes the comparators to hash on the encoded form and also adds
tests to verify the correct behavior.
commit 0e4d0a9ae0250863d7144ffdcc6c4e9cc099611f
Author: Aljoscha Krettek <al...@gmail.com>
Date: 2016-06-19T09:35:19Z
This closes #409
commit 380c1a83a82aa8b151d309cba82df3e2fb9398ec
Author: Thomas Groh <tg...@google.com>
Date: 2016-06-17T23:36:22Z
Remove Pipeline from TestDataflowPipelineRunner
commit d9cdcadf5b4b3aa931e14a3889a05cab69d71e09
Author: Dan Halperin <dh...@google.com>
Date: 2016-06-20T16:27:49Z
Closes #493
commit 1a200a65de1c48bb63b5bfa3e320e29f243fa902
Author: Kenneth Knowles <kl...@google.com>
Date: 2016-06-20T17:03:51Z
This closes #294
commit e471ced41d3092a7af6b9f5ad4cb5a4cd9dc2e81
Author: Dan Halperin <dh...@google.com>
Date: 2016-06-16T15:57:18Z
DataflowPipelineJob: Retry messages, metrics, and status polls
At some point in the past, we decided to use a rawDataflowClient that
does not do retries when checking job status, because it was best-effort
reporting to users. The purported goal was to not clutter the log with
networking errors.
However, since that time, we have:
* Added the ability to suppress logs (emit only at DEBUG level or not at
all) when retrying.
* Increased reliability of the job checking status so that these errors
are less frequent and more indicative of quota or other issues.
* Started using the metrics in tests, where we do need to retry
transient issues (BEAM-350).
So let's drop the raw transport client and just use the one that
retries.
commit c71502dc94c71b527480db72d3410ffdae2e94d1
Author: Dan Halperin <dh...@google.com>
Date: 2016-06-20T17:25:58Z
Closes #476
commit c8d57429cb0b39ce4e9c6ff249fa12a5982a769a
Author: Thomas Groh <tg...@google.com>
Date: 2016-06-17T16:57:25Z
Rename FlinkPipelineRunner to FlinkRunner
commit 6f52ff940718c93508bf57e3e56f335ec6ae41b9
Author: Dan Halperin <dh...@google.com>
Date: 2016-06-20T17:49:35Z
Closes #489
commit 071d9c7ee8ed3a9628924de624d4e3cb03c5f20b
Author: Thomas Groh <tg...@google.com>
Date: 2016-06-20T16:40:31Z
Make JAXBCoder Thread Safe
JAXB Marshaller and Unmarshaller are not thread safe, but coders are
required to be.
Create context only once, and create Marshaller and Unmarshaller locally
on-demand.
commit 682a19c4e67512a912fd12c591d1ff0b73252984
Author: Dan Halperin <dh...@google.com>
Date: 2016-06-20T18:26:32Z
Closes #497
commit 278a76e096ced0ba51b5ed0ae8205bbd32491c77
Author: Dan Halperin <dh...@google.com>
Date: 2016-06-20T22:44:54Z
[BEAM-363] Return false for non-AUTO compression mode
commit 2b9906e8d97c254706656ac68eec85f29f946627
Author: Dan Halperin <dh...@google.com>
Date: 2016-06-20T23:21:45Z
Closes #504
commit b52688f4e41e0130ac5947e7771ad8606aa9913c
Author: Kenneth Knowles <kl...@google.com>
Date: 2016-06-20T22:05:59Z
Set runtime scope for Dataflow runner dep on runners-core
commit 2d563795b9ec3ec70f53980afa5bb2a50fd24518
Author: Kenneth Knowles <kl...@google.com>
Date: 2016-06-21T17:21:34Z
Remove temporary GroupAlsoByWindowViaWindowSetDoFn shim
commit 96ffc42972010c9b027e826d6d610555ab0c055a
Author: Thomas Groh <tg...@google.com>
Date: 2016-06-17T17:45:09Z
Rename SparkPipelineRunner to SparkRunner
----
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---
[GitHub] incubator-beam pull request #585: Merge master into runners-spark2 branch to...
Posted by amitsela <gi...@git.apache.org>.
Github user amitsela closed the pull request at:
https://github.com/apache/incubator-beam/pull/585
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---