You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@beam.apache.org by gi...@apache.org on 2022/11/05 05:06:47 UTC

[beam] branch nightly-refs/heads/master updated (7da182a8d1d -> ddb4f2d5353)

This is an automated email from the ASF dual-hosted git repository.

github-bot pushed a change to branch nightly-refs/heads/master
in repository https://gitbox.apache.org/repos/asf/beam.git


    from 7da182a8d1d Make BatchConverter inference errors more helpful (#23965)
     add e04f3d6fdb3 Add basic counter setting and getting to the typescript SDK.
     add e4e606a8f26 Support metrics over the portability API.
     add 89c8dd5ca23 Add distribution metric type.
     add e3987b5435d old prettier change
     add 64abcbe4a3a Only report counters that were actually used.
     add 1563b9721b4 Improve Iterator error message (#23972)
     add 30b26171b40 Update watermark during periodic sequence/impulse (#23507)
     add 16852518861 TFX image classification example (#23456)
     add 7dba78d6110 Immediately truncate full restriction on drain of periodic impulse (#23765)
     add 058c56af735 [Task]: PR Bot will push commits only if they are non-empty (#23937)
     add 97628802fe4 Bump cloud.google.com/go/datastore from 1.8.0 to 1.9.0 in /sdks (#23916)
     add d3a173cf163 Move logging to its own module.
     add 1daa9c373ac Cleanup worker logging.
     add 1807c307aa1 Remove obsolete TODO.
     add aa178f82522 Merge pull request #23976 Correctly capture log levels and attach stage information.
     add 2496a0d1e0f Merge branch 'master' into javascript-metrics
     add 8617b86fd79 Merge pull request #23978 Add basic counter support to the typescript SDK.
     add 1cfdb127983 Add custom inference fn suport to the sklearn model handlers (#23642)
     add d10b4a28fff removed trailing whitespace (#23987)
     add 1a643d16112 Beam starter projects blog post (#23964)
     add 6d42219ff54 Enable more portable-runner requiring tests. (#23970)
     add ddb4f2d5353 Website add and update logos (#23899)

No new revisions were added by this update.

Summary of changes:
 .github/workflows/typescript_tests.yml             |   2 +-
 build.gradle.kts                                   |   4 +-
 scripts/ci/pr-bot/shared/persistentState.ts        |   4 +-
 sdks/go.mod                                        |   2 +-
 sdks/go.sum                                        |  12 +-
 .../examples/inference/tfx_bsl}/__init__.py        |   0
 .../inference/tfx_bsl/build_tensorflow_model.py    | 147 ++++++++++
 .../examples/inference/tfx_bsl/requirements.txt    |  19 ++
 .../tfx_bsl/tensorflow_image_classification.py     | 194 +++++++++++++
 .../inference/tfx_bsl/tfx_bsl_inference_it_test.py |  99 +++++++
 .../kfp/components/ingestion/src/ingest.py         |   2 +-
 .../apache_beam/ml/inference/sklearn_inference.py  |  55 +++-
 .../ml/inference/sklearn_inference_test.py         |  65 +++++
 sdks/python/apache_beam/transforms/core.py         |   4 +-
 .../apache_beam/transforms/periodicsequence.py     |  13 +-
 .../transforms/periodicsequence_it_test.py         |  89 ++++++
 sdks/python/pytest.ini                             |   1 +
 sdks/python/test-suites/direct/common.gradle       |  31 +-
 sdks/typescript/src/apache_beam/pvalue.ts          |   8 +-
 .../src/apache_beam/runners/direct_runner.ts       |  27 +-
 .../apache_beam/runners/portable_runner/runner.ts  |  20 +-
 sdks/typescript/src/apache_beam/runners/runner.ts  |  42 ++-
 .../apache_beam/testing/proto_printing_runner.ts   |   8 +-
 .../typescript/src/apache_beam/transforms/pardo.ts | 103 ++++++-
 .../src/apache_beam/transforms/windowings.ts       |   1 -
 sdks/typescript/src/apache_beam/utils/service.ts   |   6 +-
 sdks/typescript/src/apache_beam/worker/data.ts     |   2 +-
 .../apache_beam/worker/external_worker_service.ts  |   9 +-
 sdks/typescript/src/apache_beam/worker/logging.ts  | 155 ++++++++++
 sdks/typescript/src/apache_beam/worker/metrics.ts  | 321 +++++++++++++++++++++
 .../typescript/src/apache_beam/worker/operators.ts |  71 +++--
 .../src/apache_beam/worker/pardo_context.ts        |  25 +-
 sdks/typescript/src/apache_beam/worker/worker.ts   |  85 +++++-
 .../src/apache_beam/worker/worker_main.ts          |  54 +---
 sdks/typescript/test/docs/programming_guide.ts     |  28 +-
 sdks/typescript/test/io_test.ts                    |   5 +-
 sdks/typescript/test/primitives_test.ts            | 123 ++++++--
 sdks/typescript/test/worker_test.ts                |   4 +-
 .../site/content/en/blog/beam-starter-projects.md  |  77 +++++
 website/www/site/content/en/case-studies/Amazon.md |   1 +
 website/www/site/content/en/case-studies/ML6.md    |   1 +
 website/www/site/content/en/case-studies/Strivr.md |   1 +
 .../www/site/content/en/case-studies/TrustPilot.md |   1 +
 .../www/site/content/en/case-studies/Twitter.md    |   1 +
 .../www/site/content/en/case-studies/Wayfair.md    |   1 +
 .../www/site/content/en/case-studies/Wizeline.md   |   1 +
 .../www/site/content/en/case-studies/dataflow.md   |   1 +
 .../en/case-studies/{TrustPilot.md => linkedin.md} |   6 +-
 .../en/case-studies/{TrustPilot.md => liveramp.md} |   6 +-
 .../en/case-studies/{TrustPilot.md => neo4j.md}    |   6 +-
 .../en/case-studies/{TrustPilot.md => orange.md}   |   6 +-
 website/www/site/content/en/case-studies/scio.md   |   1 +
 .../case-studies/{TrustPilot.md => snowflake.md}   |   6 +-
 .../en/case-studies/{TrustPilot.md => spotify.md}  |   5 +-
 .../en/case-studies/{TrustPilot.md => talend.md}   |   5 +-
 website/www/site/content/en/case-studies/tfx.md    |   1 +
 .../en/case-studies/{TrustPilot.md => yahoo.md}    |   6 +-
 .../en/case-studies/{TrustPilot.md => zillow.md}   |   6 +-
 website/www/site/data/authors.yml                  |   3 +
 .../static/images/logos/powered-by/linkedin.png    | Bin 0 -> 5823 bytes
 .../static/images/logos/powered-by/liveramp.png    | Bin 0 -> 9653 bytes
 .../site/static/images/logos/powered-by/neo4j.svg  |  19 ++
 .../site/static/images/logos/powered-by/orange.png | Bin 0 -> 36293 bytes
 .../static/images/logos/powered-by/snowflake.png   | Bin 0 -> 3258 bytes
 .../static/images/logos/powered-by/spotify.svg     |  17 ++
 .../site/static/images/logos/powered-by/talend.svg | 121 ++++++++
 .../site/static/images/logos/powered-by/yahoo.png  | Bin 0 -> 4704 bytes
 .../site/static/images/logos/powered-by/zillow.png | Bin 0 -> 26095 bytes
 68 files changed, 1924 insertions(+), 215 deletions(-)
 copy {.test-infra/jenkins/dependency_check => sdks/python/apache_beam/examples/inference/tfx_bsl}/__init__.py (100%)
 create mode 100644 sdks/python/apache_beam/examples/inference/tfx_bsl/build_tensorflow_model.py
 create mode 100644 sdks/python/apache_beam/examples/inference/tfx_bsl/requirements.txt
 create mode 100644 sdks/python/apache_beam/examples/inference/tfx_bsl/tensorflow_image_classification.py
 create mode 100644 sdks/python/apache_beam/examples/inference/tfx_bsl/tfx_bsl_inference_it_test.py
 create mode 100644 sdks/python/apache_beam/transforms/periodicsequence_it_test.py
 create mode 100644 sdks/typescript/src/apache_beam/worker/logging.ts
 create mode 100644 sdks/typescript/src/apache_beam/worker/metrics.ts
 create mode 100644 website/www/site/content/en/blog/beam-starter-projects.md
 copy website/www/site/content/en/case-studies/{TrustPilot.md => linkedin.md} (74%)
 copy website/www/site/content/en/case-studies/{TrustPilot.md => liveramp.md} (83%)
 copy website/www/site/content/en/case-studies/{TrustPilot.md => neo4j.md} (75%)
 copy website/www/site/content/en/case-studies/{TrustPilot.md => orange.md} (75%)
 copy website/www/site/content/en/case-studies/{TrustPilot.md => snowflake.md} (78%)
 copy website/www/site/content/en/case-studies/{TrustPilot.md => spotify.md} (76%)
 copy website/www/site/content/en/case-studies/{TrustPilot.md => talend.md} (76%)
 copy website/www/site/content/en/case-studies/{TrustPilot.md => yahoo.md} (83%)
 copy website/www/site/content/en/case-studies/{TrustPilot.md => zillow.md} (83%)
 create mode 100644 website/www/site/static/images/logos/powered-by/linkedin.png
 create mode 100644 website/www/site/static/images/logos/powered-by/liveramp.png
 create mode 100644 website/www/site/static/images/logos/powered-by/neo4j.svg
 create mode 100644 website/www/site/static/images/logos/powered-by/orange.png
 create mode 100644 website/www/site/static/images/logos/powered-by/snowflake.png
 create mode 100644 website/www/site/static/images/logos/powered-by/spotify.svg
 create mode 100644 website/www/site/static/images/logos/powered-by/talend.svg
 create mode 100644 website/www/site/static/images/logos/powered-by/yahoo.png
 create mode 100644 website/www/site/static/images/logos/powered-by/zillow.png