You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@beam.apache.org by jeremiele <gi...@git.apache.org> on 2016/09/17 01:14:51 UTC
[GitHub] incubator-beam pull request #968: [BEAM-597] Added public where method to sp...
GitHub user jeremiele opened a pull request:
https://github.com/apache/incubator-beam/pull/968
[BEAM-597] Added public where method to specify parameter types.
Be sure to do all of the following to help us incorporate your contribution
quickly and easily:
- [ ] Make sure the PR title is formatted like:
`[BEAM-<Jira issue #>] Description of pull request`
- [ ] Make sure tests pass via `mvn clean verify`. (Even better, enable
Travis-CI on your fork and ensure the whole test matrix passes).
- [ ] Replace `<Jira issue #>` in the title with the actual Jira issue
number, if there is one.
- [ ] If this contribution is large, please file an Apache
[Individual Contributor License Agreement](https://www.apache.org/licenses/icla.txt).
---
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/jeremiele/incubator-beam add_where_to_type_descriptor
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/incubator-beam/pull/968.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #968
----
commit 9ab876f2a2d37ac0142103e1f3509a9bac900ad1
Author: Jeremie Lenfant-Engelmann <je...@google.com>
Date: 2016-08-17T22:52:50Z
Added a where method on TypeDescriptor to allow substituting a type parameter
with a TypeDescriptor. In the process introduced a TypeParameter class which
represents the parameter type.
This is useful when having a type such as Set<T> to be able to specify
what T is as part of the TypeDescriptor information.
commit 6dd324ec418b1f9e8bc7c01ce4654b3309bedb30
Author: Aljoscha Krettek <al...@gmail.com>
Date: 2016-06-11T08:55:55Z
Fix Emission in startBundle/finishBundle in Flink Wrappers
commit 42e9649e588cd1ad5cb004d61daca785beb39552
Author: Aljoscha Krettek <al...@gmail.com>
Date: 2016-06-11T09:42:12Z
[BEAM-253] Unify Flink-Streaming Operator Wrappers
This also replaces the custom Flink StateInternals by proper Flink
Partitioned StateInternals.
commit eaba203c5fa283923150c692321350bd37aefa56
Author: Aljoscha Krettek <al...@gmail.com>
Date: 2016-07-10T15:01:38Z
Fix Checkstyle Errors in FlinkStreamingTransformTranslators
commit f3f52b0500f59054c6b701bcd9b0a35e30e6d524
Author: Aljoscha Krettek <al...@gmail.com>
Date: 2016-07-11T12:08:35Z
[BEAM-102] Add Side Inputs in Flink Streaming Runner
This adds a generic SideInputHandler in runners-core that is only used
by the Flink runner right now but can be used by other runner
implementations.
commit 4c6e3a3b761d76e9a1b51be36ab47520ac93de9b
Author: Aljoscha Krettek <al...@gmail.com>
Date: 2016-07-23T08:48:42Z
Allow DoFn Reuse in ParDoTest.TestDoFnWithContext
commit 1cfbaeec29b468a46f9b07ba6c7168fdd177352a
Author: Aljoscha Krettek <al...@gmail.com>
Date: 2016-07-24T10:04:28Z
Don't Suppress Throwable in PAssert in Streaming Mode
commit c36e9bd8eb3d3a305d995b9982b872f356cf9618
Author: Aljoscha Krettek <al...@gmail.com>
Date: 2016-07-26T12:02:00Z
Enable Flink Streaming Runner RunnableOnService tests
commit 17ee0a21e8751b6f8dc15966347db3a99ae5de72
Author: Thomas Groh <tg...@google.com>
Date: 2016-07-27T16:04:06Z
Fix combine tests with Accumulation Mode
These tests were not written in such a way as to succeed if the trigger
fired multiple times.
commit d9dc86e84bf096804c88381722069c21c734a78e
Author: Kenneth Knowles <kl...@google.com>
Date: 2016-07-27T21:23:15Z
Replace ParDo with simpler transforms where possible
There are a number of places in the Java SDK where we use
ParDo.of(DoFn) when MapElements or other higher-level
composites are applicable and readable. This change
alters a number of those.
commit 00f0ff732217ae0411be75e3cadd6ca2107c50de
Author: Thomas Groh <tg...@google.com>
Date: 2016-07-28T15:26:43Z
Use AllPanes as the PaneExtractor in IterableAssert
This ensures that tests with triggering in the global window which assert
on the entire PCollection (not a singleton iterable) will succeed over the
entire PCollection
commit 491d1cb8b5de558e31184cf8c602a2065367ff06
Author: Thomas Groh <tg...@google.com>
Date: 2016-08-11T22:46:10Z
Add inEarlyPanesInGlobalWindow as a PAssert Extractor
This is for use in asserting the contents of speculative panes in the
global window.
commit bbdb1f04adfd3504c7544bb6e878cebfbf9ac362
Author: Dan Halperin <dh...@google.com>
Date: 2016-08-15T06:08:21Z
FileBasedSink: improve parallelism in GCS copy/remove
commit c87be95e9f30e84cd2f844ff288c0880e22c7221
Author: Pei He <pe...@google.com>
Date: 2016-08-15T19:22:11Z
Set Gcs upload buffer size to 1M in streaming mode in DataflowRunner
commit 18f80acf7b459ae74bb392060ff7e276d83aa2e8
Author: Vikas Kedigehalli <vi...@google.com>
Date: 2016-08-15T22:28:07Z
DatastoreIO Sink as ParDo
commit 75dd2761635584117a1db2d89824261d4a63d272
Author: Pei He <pe...@google.com>
Date: 2016-08-16T00:23:20Z
Fix NPE in BigQueryIO.TransformingReader
commit f527831924089962c16ad99c0673f99b244db0fc
Author: Thomas Groh <tg...@google.com>
Date: 2016-08-16T02:43:28Z
Add TestStream to the Testing package
This is a source suitable for use with tests that have interesting
triggering behavior. It is an Unbounded source that emits elements in
bundles, and advances the watermark and processing time appropriately.
commit 2825cc1a7c9987bf21a9ffa6893e3351f9fc7c0a
Author: Thomas Groh <tg...@google.com>
Date: 2016-08-16T02:45:58Z
Implement TestStream in the DirectRunner
commit 6f2a384e562efcafd1a888c3c7151eb30a1ef677
Author: Frank Yellin <fy...@fyellin.com>
Date: 2016-08-16T21:40:41Z
Change name of result returned by BigQueryIO.Read
commit 2fa01c7d4e7ff169f45553b273af2e89de922b69
Author: Pei He <pe...@google.com>
Date: 2016-08-17T20:56:37Z
addressed feedback
commit 88ac5b7fe57d5694b90762fe74a8fbf6946b7077
Author: Pei He <pe...@google.com>
Date: 2016-08-17T21:30:23Z
fix unused imports
commit 5f74ba2fbddb0830c66f441b3976ade852f19980
Author: Vikas Kedigehalli <vi...@google.com>
Date: 2016-08-18T01:19:52Z
Datastore Sink support for writing Mutations
This generalizes Write to Write and Delete cleanly.
commit 263d9e03a9b3b3467e3ed6de205da92f6633abb7
Author: Luke Cwik <lc...@google.com>
Date: 2016-08-18T23:35:33Z
Modify example dependencies to only add runners as optional dependencies.
Also support excluding runners by disabling the include-runners profile.
Tested ITs
BQ and WordCount pass on Dataflow
WordCount passes on Flink and Spark
commit 38c30ce43053efa0d1e7868c5a3e67b6108d2a08
Author: sammcveety <sa...@gmail.com>
Date: 2016-08-18T22:02:06Z
Incorporate private IP option for Dataflow runner
commit edc0f790d4babc31da40f578a9afcfb92ec06547
Author: Thomas Groh <tg...@google.com>
Date: 2016-08-19T17:24:00Z
Mark JAXBContext as Volatile in JAXBCoder
This corrects the double-checked locking and lazy intialization
commit 051848b694ed23442dcd719ba689faef979c64e9
Author: Vikas Kedigehalli <vi...@google.com>
Date: 2016-08-19T23:18:37Z
DatastoreIO v1beta3 to v1
commit b6d48a33b2f635548ba820d4a672eb23b97d469f
Author: Aljoscha Krettek <al...@gmail.com>
Date: 2016-08-20T08:23:06Z
Make ParDoLifecycleTest Serializable to Fix Test with TupleTag
commit a74aa6763f201aae835730e26eb3eb20af3032e4
Author: Aljoscha Krettek <al...@gmail.com>
Date: 2016-08-20T08:37:42Z
Fix Exception Unwrapping in TestFlinkRunner
commit dc72b08fae12460a530af07fbbc02dcaee999099
Author: Aljoscha Krettek <al...@gmail.com>
Date: 2016-08-20T08:42:39Z
Fix Flink Runner Pom for Batch RunnableOnService tests
commit 1035fad9b1eedad0d45e0e97e400067cab029ccd
Author: Thomas Groh <tg...@google.com>
Date: 2016-08-22T16:23:57Z
Remove unused constant in ExecutorServiceParallelExecutor
----
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---
[GitHub] incubator-beam pull request #968: [BEAM-597] Added public where method to sp...
Posted by asfgit <gi...@git.apache.org>.
Github user asfgit closed the pull request at:
https://github.com/apache/incubator-beam/pull/968
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---