You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@beam.apache.org by "ASF GitHub Bot (JIRA)" <ji...@apache.org> on 2017/07/26 23:39:00 UTC
[jira] [Commented] (BEAM-2672) test merge in BeamSqlUdaf
[ https://issues.apache.org/jira/browse/BEAM-2672?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16102472#comment-16102472 ]
ASF GitHub Bot commented on BEAM-2672:
--------------------------------------
GitHub user XuMingmin opened a pull request:
https://github.com/apache/beam/pull/3648
sync-up from master branch
BEAM-2672 requires a new function added in #3628
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/apache/beam master
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/beam/pull/3648.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #3648
----
commit 4192ac6c72765e8c55480eec66c499ef0798ecf3
Author: Stephen Sisk <si...@google.com>
Date: 2017-06-14T16:57:35Z
Add maven support for invoking perfkit benchmarker to run IO ITs
commit 2f9cbec803791fd4e17fb28ec5590649aabb9622
Author: Stephen Sisk <si...@google.com>
Date: 2017-07-20T18:38:40Z
io-it-suite-local independent of io-it-suite, k8s properties -> root pom
commit 7e63d2cf6c0ea0da4ce68b72536522f68b4a5272
Author: Thomas Groh <tg...@google.com>
Date: 2017-07-20T20:34:49Z
This closes #3588
commit c52a908cba7765e120a94909ab02c548d1a124ad
Author: Eugene Kirpichov <ki...@google.com>
Date: 2017-07-18T20:40:52Z
Minor changes to AvroSource in preparation for refactoring
commit d4026da1ad1fa0864052b85a66c4af5975327e9f
Author: Eugene Kirpichov <ki...@google.com>
Date: 2017-07-18T21:09:03Z
Gets rid of opening Avro files in createForSubrangeOfFile codepath
commit 1d9160fa3337704b9fbdc423796925be78b0087e
Author: Eugene Kirpichov <ki...@google.com>
Date: 2017-07-20T23:59:27Z
This closes #3590: [BEAM-2628] Makes AvroSource not open files while splitting
commit cfadecb56c64aa155c8b5fd0d8a6654ceb918eba
Author: Kenneth Knowles <kl...@google.com>
Date: 2017-07-18T05:03:09Z
Uniquify application nodes in TextIOReadTest and only run pipeline once
- These nodes have never had stable unique names, but we have always mutated
the pipeline before running it so they got lucky.
- A pipeline can also be mutated when run() so it should be considered dead
after run() is called.
This fixes both issues by uniquifying the names and running a given pipeline
only once.
commit c2110c97d530b8e90387bf99b3ac7d36201d85c7
Author: Thomas Groh <tg...@google.com>
Date: 2017-07-19T17:55:33Z
Register a PTransformTranslator for Combine
Include the Combine Payload in the Runner API Graph.
Add getCombineFn(AppliedPTransform) to extract the CombineFn from an
arbitrary transform.
Update Pipeline Translation tests to include accumulator coders.
commit b6f126dc6000ceba410d5074fd65af141b7ab3c6
Author: Thomas Groh <tg...@google.com>
Date: 2017-07-21T17:03:30Z
This closes #3597
commit 01492e69d1b1eedb99931f7071a9dae9d60d25fe
Author: Kenneth Knowles <kl...@google.com>
Date: 2017-07-20T03:58:36Z
Use RehydratedComponents for memoized rehydration
commit f870bf5164b00a1379f1e33a5ef27b3701a87c08
Author: Kenneth Knowles <kl...@google.com>
Date: 2017-07-21T18:06:02Z
This closes #3601: Use RehydratedComponents for memoized rehydration
commit e38dc5fbe1f45fe282b4cd96b858631db73130e9
Author: Kenneth Knowles <kl...@google.com>
Date: 2017-06-07T20:58:11Z
Use dehydration-insensitive APIs in WindowEvaluatorFactory
commit 8bd64759616a2f262f60ce2998b98f0dd1dd2000
Author: Kenneth Knowles <kl...@google.com>
Date: 2017-07-21T18:36:46Z
This closes #3609: Use dehydration-insensitive APIs in WindowEvaluatorFactory
commit fa3a5abbc94db629feae8d7d73a31e7dda06bf76
Author: Kenneth Knowles <kl...@google.com>
Date: 2017-06-07T21:35:09Z
Use dehydration-insensitive APIs in ParDoEvaluatorFactory
commit 4b355844a4920bc9faba75f7cd61008bedebaf29
Author: Kenneth Knowles <kl...@google.com>
Date: 2017-07-21T18:50:48Z
This closes #3610: Use dehydration-insensitive APIs in ParDoEvaluatorFactory
commit 81c2e90f3a9d109121b686c25b642cc9f16ced43
Author: Kenneth Knowles <kl...@google.com>
Date: 2017-07-21T19:21:05Z
This closes #3608: Uniquify application nodes in TextIOReadTest and only run pipeline once
commit 4f7d0b4ed70b40443aede1ce28d0939f08b1d04f
Author: Eugene Kirpichov <ki...@google.com>
Date: 2017-07-22T01:01:14Z
Unbreaks AvroSource compatibility with Dataflow worker
commit f39874860027832fdeff957afdc5cc8326de6d30
Author: Eugene Kirpichov <ki...@google.com>
Date: 2017-07-22T01:23:48Z
This closes #3616: Unbreaks AvroSource compatibility with Dataflow worker
commit a7c18495f91c9d7537271c9595b3ac4d24003ece
Author: Luke Cwik <lc...@google.com>
Date: 2017-07-23T21:00:17Z
[BEAM-2662] Fix Java quickstart for Spark to include Spark version
commit b1adbfbcf0a949a92a022c86b061ba3b64b69c9b
Author: Pei He <pe...@apache.org>
Date: 2017-07-19T12:38:49Z
ReshuffleTest: replace Iterable equal tests with matchers.
commit 49d4cf4de48f121f583ddf7e2b7d0e56370a735c
Author: Pei He <pe...@apache.org>
Date: 2017-07-24T02:53:27Z
This closes #3593
commit 5f1d1365ba73aeac5a76a31c64ead2d7e94e4040
Author: Jean-Baptiste Onofré <jb...@apache.org>
Date: 2017-07-24T04:57:27Z
[BEAM-2662] This closes #3620
commit b03c4f0790fa639d739f7f3fdeaa4a703fadb8fa
Author: Aljoscha Krettek <al...@gmail.com>
Date: 2017-07-12T12:39:58Z
[BEAM-2571] Clarify pushedback variable name in DoFnOperator
commit 8449931708338dd854ba90b8d6f769fe42b81493
Author: Aljoscha Krettek <al...@gmail.com>
Date: 2017-07-12T12:42:37Z
[BEAM-2571] Change DoFnOperator to use Long.MAX_VALUE as max watermark
This is in line with what Flink does and what BoundedSourceWrapper and
UnboundedSourceWrapper do.
commit 18250878552ede370e90b89e66f17664edaf2c7e
Author: Aljoscha Krettek <al...@gmail.com>
Date: 2017-07-12T13:38:06Z
[BEAM-2571] Respect watermark contract in Flink DoFnOperator
In Flink, a watermark T specifies that there will be no elements with a
timestamp <= T in the future. In Beam, a watermark T specifies that
there will not be element with a timestamp < T in the future. This leads
to problems when the watermark is exactly "on the timer timestamp", most
prominently, this happened with Triggers, where Flink would fire the
Trigger too early and the Trigger would determine (based on the
watermark) that it is not yet time to fire the window while Flink
thought it was time.
This also adds a test that specifially tests the edge case.
commit f54072a1b156176624db5b666ed9c308f24bc2f9
Author: Aljoscha Krettek <al...@gmail.com>
Date: 2017-07-24T08:03:39Z
This closes #3600
commit dfa983ce4adb85d211497460254b6a95944ce869
Author: Etienne Chauchot <ec...@gmail.com>
Date: 2017-05-29T10:05:51Z
[BEAM-2314] Add ValidatesRunner test for merging custom windows
commit 0064fb37ad13a10fc510e567d21873403a42340a
Author: Aviem Zur <av...@gmail.com>
Date: 2017-07-24T15:22:42Z
This closes #3286
commit efe2dc17af2a66c5c33076467cb46f73bb7fb9ab
Author: Kenneth Knowles <kl...@google.com>
Date: 2017-07-20T03:09:52Z
Add stub DisplayDataTranslation
commit 12c277f31b2b8a295e0a41cab3290943a3eff7cd
Author: Kenneth Knowles <kl...@google.com>
Date: 2017-07-22T03:32:20Z
Fix tests that passed invalid input to DynamicDestinations
----
> test merge in BeamSqlUdaf
> -------------------------
>
> Key: BEAM-2672
> URL: https://issues.apache.org/jira/browse/BEAM-2672
> Project: Beam
> Issue Type: Test
> Components: dsl-sql
> Reporter: Xu Mingmin
> Assignee: Xu Mingmin
> Labels: dsl_sql_merge
>
> The integration test with {{DirectRunner}} cannot cover method {{merge}} in {{BeamSqlUdaf}}.
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)