You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@beam.apache.org by gi...@apache.org on 2020/08/05 02:49:04 UTC
[beam] tag nightly-master updated (d5a6c2f -> e0f02ea)
This is an automated email from the ASF dual-hosted git repository.
github-bot pushed a change to tag nightly-master
in repository https://gitbox.apache.org/repos/asf/beam.git.
*** WARNING: tag nightly-master was modified! ***
from d5a6c2f (commit)
to e0f02ea (commit)
from d5a6c2f Merge pull request #12304 from Borzoo/beam-10499-nicer-tostring
add d201a51 [BEAM-10622] Prefix Gradle paths with a colon for user-facing output
add 1d7c52e Merge pull request #12449: [BEAM-10622] Prefix Gradle paths with a colon for user-facing output
add fb26c57 [BEAM-7632] Add Python quickstart instructions for Flink and Spark.
add 1bf60b9 Merge pull request #12397: [BEAM-7632] Add Python quickstart instructions for Flink and Spark.
add 7620e6c Fix add field method in SQL walkthrough
add 51c95d8 Merge pull request #12463 from iht/fix_sql_doc
add c551a8c [BEAM-7390] Add sample code snippets
add 5ded4ae Merge pull request #12462 from davidcavazos/sample-docs
add c8fa5dc fixing the IOException handling
add aecad35 change getErrorInfo into seperate method
add 5ba2dcb delete unused import
add 47c6fee delete empty line in import
add 7da0400 spotless change
add dd3777e naming change
add d2763c4 change to vendored gauva class
add 5ae8915 add unit test
add 498ed60 remove redundent code
add e05dce1 further simplifies getErrorInfo
add 02dd0b7 spotless fix
add 010b40b update
add 5b264be spotless
add 3f26008 add comment
add a0ea500 Merge branch 'master' into BEAM-9792
add 1a43bb9 Merge branch 'BEAM-9792' of https://github.com/danielxjd/beam into BEAM-9792
add 2498143 change test names
add 3818b42 spotless
add 4840dbd Merge branch 'master' into BEAM-9792
add 166ebe03 Merge branch 'BEAM-9792' of https://github.com/danielxjd/beam into BEAM-9792
add 2881829 style change
add d7e6469 add failure
add a64c492 change exception handling
add 41be03c add jira issue
add 5e0e798 Merge pull request #12106: [BEAM-9792] Fixing the IOException handling in InsertAll for BigQuery
add 3471c46 Merge pull request #12203 from [BEAM-6928] Make Python SDK custom Sink the default Sink for BigQuery
add 0a25b7a Add ElementLimiters which allows the cache to prematurely based on read elements.
add e27c45d Remove start_secs parameter.
add 9dc1bf7 Merge pull request #12411: [BEAM-10603] Add ElementLimiters which allows the cache to prematurely based on read elements.
add b28433c [BEAM-10470] Handle null state from waitUntilFinish
add 2f35988 Merge pull request #12441: [BEAM-10470] Handle null state from waitUntilFinish
add 6612b24 [BEAM-10618] subprocess_server.py: Fallback to AF_INET6 family when finding free port (#12438)
add fe5f9c2 [BEAM-10629] Added KnownBuilderInstances to ExternalTransformRegistrar (#12454)
add 0cc2955 [BEAM-10635] Fix forward the google-api-core version
add eb26aef Merge pull request #12466 from KevinGG/fix_forward
add a805977 [BEAM-10637] fix: test stream service start/stop (#12464)
add be5e419 [BEAM-10289] Go Dynamic splitting full implementation.
add f5c9f71 [BEAM-10289] Avoiding blocking when dynamic splitting in Go.
add c710ecc Merge pull request #12350: [BEAM-10289] Dynamic splitting implementation.
add e0f02ea Migrate shared tag from tfx-bsl (#12468)
No new revisions were added by this update.
Summary of changes:
CHANGES.md | 3 +
.../apache/beam/runners/direct/DirectRunner.java | 40 +-
.../beam/runners/direct/DirectRunnerTest.java | 5 +-
sdks/go/pkg/beam/core/runtime/exec/datasource.go | 127 ++++--
.../pkg/beam/core/runtime/exec/datasource_test.go | 188 ++++++++-
.../go/pkg/beam/core/runtime/exec/dynsplit_test.go | 456 +++++++++++++++++++++
sdks/go/pkg/beam/core/runtime/exec/plan.go | 23 +-
sdks/go/pkg/beam/core/runtime/exec/sdf.go | 168 ++++++--
.../beam/core/runtime/exec/sdf_invokers_test.go | 3 +-
sdks/go/pkg/beam/core/runtime/exec/sdf_test.go | 146 ++++++-
sdks/go/pkg/beam/core/runtime/exec/translate.go | 22 +-
sdks/go/pkg/beam/core/runtime/harness/harness.go | 22 +-
sdks/go/pkg/beam/core/sdf/sdf.go | 9 +-
.../beam/io/rtrackers/offsetrange/offsetrange.go | 35 +-
.../sdk/expansion/ExternalTransformRegistrar.java | 44 +-
.../sdk/expansion/service/ExpansionService.java | 45 +-
.../sdk/io/gcp/bigquery/BigQueryServicesImpl.java | 27 ++
.../io/gcp/bigquery/BigQueryServicesImplTest.java | 63 ++-
.../io/gcp/big_query_query_to_table_it_test.py | 7 +-
sdks/python/apache_beam/io/gcp/bigquery.py | 4 +-
.../apache_beam/io/gcp/bigquery_file_loads_test.py | 10 +-
sdks/python/apache_beam/io/gcp/bigquery_test.py | 14 +-
.../apache_beam/io/gcp/bigquery_write_it_test.py | 3 +-
.../runners/dataflow/dataflow_runner.py | 4 +-
.../runners/dataflow/dataflow_runner_test.py | 6 +-
.../runners/dataflow/ptransform_overrides.py | 10 +-
.../interactive/options/capture_limiters.py | 69 ++++
.../interactive/options/capture_limiters_test.py | 53 +++
.../runners/portability/flink_runner.py | 2 +-
.../runners/portability/flink_runner_test.py | 2 +-
.../portability/flink_uber_jar_job_server.py | 2 +-
.../runners/portability/spark_runner.py | 2 +-
.../runners/portability/spark_runner_test.py | 2 +-
.../portability/spark_uber_jar_job_server.py | 2 +-
.../apache_beam/testing/test_stream_service.py | 11 +
.../testing/test_stream_service_test.py | 81 ++++
sdks/python/apache_beam/utils/shared.py | 24 +-
sdks/python/apache_beam/utils/shared_test.py | 22 +
sdks/python/apache_beam/utils/subprocess_server.py | 15 +-
.../apache_beam/utils/subprocess_server_test.py | 8 +-
sdks/python/container/base_image_requirements.txt | 2 +-
.../en/documentation/dsls/sql/walkthrough.md | 2 +-
.../transforms/python/aggregation/sample.md | 64 ++-
.../site/content/en/get-started/quickstart-py.md | 17 +-
.../content/en/get-started/wordcount-example.md | 14 +-
45 files changed, 1621 insertions(+), 257 deletions(-)
create mode 100644 sdks/go/pkg/beam/core/runtime/exec/dynsplit_test.go
create mode 100644 sdks/python/apache_beam/runners/interactive/options/capture_limiters_test.py