You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@beam.apache.org by gi...@apache.org on 2022/09/13 20:29:47 UTC
[beam] branch dependabot/go_modules/sdks/github.com/google/go-cmp-0.5.9 updated (a7b996bb6f9 -> 522f81dc987)
This is an automated email from the ASF dual-hosted git repository.
github-bot pushed a change to branch dependabot/go_modules/sdks/github.com/google/go-cmp-0.5.9
in repository https://gitbox.apache.org/repos/asf/beam.git
discard a7b996bb6f9 Bump github.com/google/go-cmp from 0.5.8 to 0.5.9 in /sdks
add 134648f0764 [TPC-DS] Store metrics into BigQuery and InfluxDB (#22545)
add 139ef904f6f [Website] add table-container-wrapper #22896
add 7ab04666da0 Merge pull request #22915: [Website] Update from-spark page table content overflow
add bc929ee694c [Website] add paddings to pillars-item, change styles of footer logos
add 5734d3e3af6 Merge pull request #2281: [Website] update homepage mobile styles
add 98f1f75459e Use a ClassLoadingStrategy that is compatible with Java 17+
add ef0bb6d1cbf Merge pull request #23055 from cushon/b243697303
add ec4aaa434bc [Website] update case-studies logo images #22799 (#22793)
add 88036d9b3b9 [Website] change media-query max-width variable to ak-breakpoint-xl #22521 (#22498)
add 80284ef58f7 [Website] add overflow to code tags #22888 (#22427)
add 8c6dcaeceb0 Clean up Kafka Cluster and pubsub topic in rc validation script (#23021)
add a75f115d20d Fix assertions in the Spanner IO IT tests (#23098)
add ce80ee33c5f [Website] update shortcode languages from duplicate go to typescript #23004
add 733b0568fe7 Merge pull request #22275: [Website] update shortcode languages
add 973475fde19 Use existing pickle_library flag in expansion service. (#23111)
add 07439a0ab8a Assert pipeline results in performance tests (#23027)
add d17914862da Consolidate Samza TranslationContext and PortableTranslationContext (#23072)
add 1526ca8c4cc Improvements to SchemaTransform implementations for BQ and Kafka (#23045)
add b1f23fd066b [TPC-DS] Use common queries argument for Jenkins jobs (#23139)
add 5515f7a35d7 pubsublite: Reduce commit logspam (#22762)
add 2113ffcac3f Added documentation in ACTIONS.md file (#23159)
add f7073818a9e Bump dataflow java fnapi container version to beam-master-20220830 (#23183)
add f31b277c0ec [Issue#23071] Fix AfterProcessingTime for Python to behave like Java (#23100)
add d9405959199 Don't depend on java 11 docker container for go test (#23197)
add d635d44ad3d Properly close Spark (streaming) context if Pipeline translation fails (fixes #23203)
add bee135e12e9 Merge pull request #23204: Properly close Spark (streaming) context if Pipeline translation fails
add 111878505e6 Annotate stateful VR test in TestStreamTest with UsesStatefulParDo (related to #22472)
add ebacef90771 Merge pull request #23202: Annotate stateful VR test in TestStreamTest with UsesStatefulParDo (related to #22472)
add c654e41cb40 [Playground] [Backend] Datastore queries and mappers to get precompiled objects (#22868)
add 66d1af8beef Open Allow and test pyarrow 8.x and 9.x (#22997)
add 634dbfd470e (BQ Python) Pass project field from options or parameter when writing with dynamic destinations (#23011)
add e2e7265356a Update python-machine-learning.md (#23209)
add 2a9327dd433 Pin the version of cloudpickle to 2.1.x (#23120)
add 6f25fba3fea Add streaming test for Write API sink (#21903)
add abdaa6bd69c [Go SDK] Proto changes for timer param (#23216)
add 6d50a333beb Bump github.com/testcontainers/testcontainers-go in /sdks (#23201)
add 522f81dc987 Bump github.com/google/go-cmp from 0.5.8 to 0.5.9 in /sdks
This update added new revisions after undoing existing revisions.
That is to say, some revisions that were in the old version of the
branch are not in the new version. This situation occurs
when a user --force pushes a change and generates a repository
containing something like this:
* -- * -- B -- O -- O -- O (a7b996bb6f9)
\
N -- N -- N refs/heads/dependabot/go_modules/sdks/github.com/google/go-cmp-0.5.9 (522f81dc987)
You should already have received notification emails for all of the O
revisions, and so the following emails describe only the N revisions
from the common base, B.
Any revisions marked "omit" are not gone; other references still
refer to them. Any revisions marked "discard" are gone forever.
No new revisions were added by this update.
Summary of changes:
.github/ACTIONS.md | 73 +++-
...rties.groovy => TpcdsDatabaseProperties.groovy} | 18 +-
.../jenkins/job_PerformanceTests_KafkaIO_IT.groovy | 29 +-
.../job_PostCommit_Java_Tpcds_Dataflow.groovy | 21 +-
.../jenkins/job_PostCommit_Java_Tpcds_Flink.groovy | 16 +-
.../jenkins/job_PostCommit_Java_Tpcds_Spark.groovy | 110 ++----
...assic_New_SQL.json => TPC-DS_Dataflow_SQL.json} | 279 ++++++++-------
..._Classic_New_SQL.json => TPC-DS_Flink_SQL.json} | 279 ++++++++-------
...dard.json => TPC-DS_Spark_Classic_New_SQL.json} | 224 ++++++------
.../backend/internal/db/datastore/datastore_db.go | 210 ++++++++++++
.../internal/db/datastore/datastore_db_test.go | 369 +++++++++++++++++++-
playground/backend/internal/db/db.go | 12 +
.../internal/db/entity/{id_meta.go => common.go} | 4 +
playground/backend/internal/db/mapper/mapper.go | 2 +
.../db/mapper/precompiled_object_mapper.go | 32 ++
.../db/mapper/precompiled_object_mapper_test.go | 95 ++++++
.../db/schema/migration/migration_v001_test.go | 1 +
release/src/main/scripts/run_rc_validation.sh | 16 +-
runners/google-cloud-dataflow-java/build.gradle | 2 +-
.../samza/translation/GroupByKeyTranslator.java | 2 +-
.../translation/ParDoBoundMultiTranslator.java | 2 +-
.../translation/PortableTranslationContext.java | 51 +--
.../samza/translation/ReshuffleTranslator.java | 2 +-
.../SamzaPortablePipelineTranslator.java | 8 +-
.../samza/translation/TranslationContext.java | 15 +-
.../SparkRunnerStreamingContextFactory.java | 24 +-
sdks/go.mod | 35 +-
sdks/go.sum | 379 +++++++++++++++++++--
sdks/go/pkg/beam/core/runtime/graphx/v1/v1.pb.go | 296 ++++++++--------
sdks/go/pkg/beam/core/runtime/graphx/v1/v1.proto | 2 +
sdks/go/test/build.gradle | 4 -
.../reflect/ByteBuddyDoFnInvokerFactory.java | 29 +-
.../apache/beam/sdk/testing/TestStreamTest.java | 7 +-
.../extensions/python/PythonExternalTransform.java | 3 +-
.../provider/bigquery/BigQueryIOPushDownIT.java | 13 +-
.../beam/sdk/bigqueryioperftests/BigQueryIOIT.java | 10 +-
.../java/org/apache/beam/sdk/io/cdap/CdapIOIT.java | 5 +-
.../java/org/apache/beam/sdk/io/avro/AvroIOIT.java | 5 +-
.../apache/beam/sdk/io/parquet/ParquetIOIT.java | 5 +-
.../java/org/apache/beam/sdk/io/text/TextIOIT.java | 5 +-
.../apache/beam/sdk/io/tfrecord/TFRecordIOIT.java | 8 +-
.../java/org/apache/beam/sdk/io/xml/XmlIOIT.java | 5 +-
.../io/gcp/bigquery/BigQuerySchemaIOProvider.java | 20 +-
.../pubsublite/internal/CheckpointMarkImpl.java | 7 +-
.../gcp/pubsublite/internal/CloserReference.java | 68 ++++
.../pubsublite/internal/UnboundedReaderImpl.java | 6 +-
.../pubsublite/internal/UnboundedSourceImpl.java | 2 +-
.../io/gcp/bigquery/BigQueryIOStorageWriteIT.java | 55 ++-
.../internal/CheckpointMarkImplTest.java | 2 +-
.../internal/UnboundedReaderImplTest.java | 5 +-
.../sdk/io/hadoop/format/HadoopFormatIOIT.java | 8 +-
.../java/org/apache/beam/sdk/io/jdbc/JdbcIOIT.java | 8 +-
.../KafkaSchemaTransformReadConfiguration.java | 170 ++-------
.../io/kafka/KafkaSchemaTransformReadProvider.java | 167 +++++++++
.../org/apache/beam/sdk/io/kafka/KafkaIOIT.java | 14 +-
.../KafkaSchemaTransformReadProviderTest.java | 124 +++++++
.../apache/beam/sdk/io/mongodb/MongoDBIOIT.java | 9 +-
sdks/java/testing/tpcds/build.gradle | 3 +
.../apache/beam/sdk/tpcds/SqlTransformRunner.java | 102 +++++-
.../org/apache/beam/sdk/tpcds/TpcdsOptions.java | 64 ++++
.../java/org/apache/beam/sdk/tpcds/TpcdsRun.java | 5 +
.../org/apache/beam/sdk/tpcds/TpcdsRunResult.java | 4 +-
.../java/org/apache/beam/sdk/tpcds/TpcdsUtils.java | 12 +
sdks/python/apache_beam/io/gcp/bigquery.py | 1 +
.../apache_beam/io/gcp/bigquery_file_loads.py | 20 +-
.../io/gcp/experimental/spannerio_read_it_test.py | 15 +-
.../runners/portability/expansion_service_main.py | 9 +-
sdks/python/apache_beam/transforms/trigger.py | 11 +-
sdks/python/apache_beam/transforms/trigger_test.py | 83 +++++
sdks/python/setup.py | 8 +-
sdks/python/test-suites/tox/py38/build.gradle | 8 +
sdks/python/tox.ini | 4 +-
website/www/site/assets/scss/_case_study.scss | 7 +-
website/www/site/assets/scss/_ctas.sass | 2 +-
website/www/site/assets/scss/_footer.sass | 4 +
website/www/site/assets/scss/_global.sass | 7 +
website/www/site/assets/scss/_pillars.scss | 4 +
website/www/site/content/en/case-studies/hop.md | 2 +-
website/www/site/content/en/case-studies/lyft.md | 2 +-
.../content/en/documentation/programming-guide.md | 6 +-
.../documentation/sdks/python-machine-learning.md | 2 +-
.../www/site/content/en/get-started/from-spark.md | 4 +
82 files changed, 2741 insertions(+), 1020 deletions(-)
copy .test-infra/jenkins/{NexmarkDatabaseProperties.groovy => TpcdsDatabaseProperties.groovy} (75%)
copy .test-infra/metrics/grafana/dashboards/perftests_metrics/{Nexmark_Spark_Classic_New_SQL.json => TPC-DS_Dataflow_SQL.json} (65%)
copy .test-infra/metrics/grafana/dashboards/perftests_metrics/{Nexmark_Spark_Classic_New_SQL.json => TPC-DS_Flink_SQL.json} (65%)
copy .test-infra/metrics/grafana/dashboards/perftests_metrics/{Nexmark_Spark_Classic_New_Standard.json => TPC-DS_Spark_Classic_New_SQL.json} (71%)
rename playground/backend/internal/db/entity/{id_meta.go => common.go} (92%)
create mode 100644 sdks/java/io/google-cloud-platform/src/main/java/org/apache/beam/sdk/io/gcp/pubsublite/internal/CloserReference.java
create mode 100644 sdks/java/io/kafka/src/main/java/org/apache/beam/sdk/io/kafka/KafkaSchemaTransformReadProvider.java
create mode 100644 sdks/java/io/kafka/src/test/java/org/apache/beam/sdk/io/kafka/KafkaSchemaTransformReadProviderTest.java