You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@beam.apache.org by gi...@apache.org on 2021/03/18 04:45:25 UTC
[beam] tag nightly-master updated (4ff08fe -> 15c89fd)
This is an automated email from the ASF dual-hosted git repository.
github-bot pushed a change to tag nightly-master
in repository https://gitbox.apache.org/repos/asf/beam.git.
*** WARNING: tag nightly-master was modified! ***
from 4ff08fe (commit)
to 15c89fd (commit)
from 4ff08fe Merge pull request #14235 from ibzib/udf-test
add ee62cbe Merge pull request #14252 from Add types to FileMatching
add 93d0be0 [BEAM-11969] Adds an option for setting row-group size in ParquetIO (#14227)
add 4565a31 [BEAM-11659] Add new schema types to Pub/Sub SQL (#13980)
add 3014959 [BEAM-11628] Switch to pd.testing.assert* in transforms_test (#14256)
add d559544 [BEAM-10708] Clean up pipeline instrument (#14176)
add 9e09977 [BEAM-9615] Embedded structs and Deterministic map encoding, and Logical Types. (#14192)
add e8f9c68 [BEAM-10937] Tour of Beam: Reading and writing data notebook (#14045)
add 99a1b3a Keep dev/SNAPSHOT version on release branch; set to non-SNAPSHOT version only for RCs
add 58eab9e Update instructions for cutting release branch
add 8a91ca3 Merge pull request #14239: Update script and instructions for cutting release branch
add e3a7c26 Add script to tag a commit for building RC
add b817a1c Adjust build_release_candidate.sh to use existing tag
add cf4bbf3 Update instructions to include tagging an RC commit
add d04319d Merge pull request #14213: Add release script to choose a commit for an RC
add ab79451 Add example of Spark rest URL.
add 15c89fd Merge pull request #14221: Add example of Spark rest URL.
No new revisions were added by this update.
Summary of changes:
.../notebooks/tour-of-beam/getting-started.ipynb | 29 +-
.../tour-of-beam/reading-and-writing-data.ipynb | 941 +++++++++++++++++++++
.../src/main/scripts/build_release_candidate.sh | 34 +-
release/src/main/scripts/choose_rc_commit.sh | 139 +++
release/src/main/scripts/cut_release_branch.sh | 13 +-
sdks/go/pkg/beam/core/graph/coder/map.go | 30 +-
sdks/go/pkg/beam/core/graph/coder/map_test.go | 27 +-
sdks/go/pkg/beam/core/graph/coder/row_decoder.go | 43 +-
sdks/go/pkg/beam/core/graph/coder/row_encoder.go | 40 +-
sdks/go/pkg/beam/core/graph/coder/row_test.go | 60 +-
sdks/go/pkg/beam/core/runtime/graphx/coder_test.go | 4 +
.../core/runtime/graphx/schema/logicaltypes.go | 3 +
.../pkg/beam/core/runtime/graphx/schema/schema.go | 328 ++++---
.../beam/core/runtime/graphx/schema/schema_test.go | 315 ++++++-
.../provider/pubsub/PubsubTableProviderIT.java | 156 +++-
...bsubMessage.java => AddTimestampAttribute.java} | 39 +-
.../beam/sdk/io/gcp/pubsub/NestedRowToMessage.java | 91 ++
.../beam/sdk/io/gcp/pubsub/PubsubMessage.java | 55 +-
.../beam/sdk/io/gcp/pubsub/PubsubMessageToRow.java | 50 +-
.../sdk/io/gcp/pubsub/PubsubSchemaIOProvider.java | 87 +-
.../sdk/io/gcp/pubsub/NestedRowToMessageTest.java | 106 +++
.../sdk/io/gcp/pubsub/PubsubMessageToRowTest.java | 58 +-
.../org/apache/beam/sdk/io/parquet/ParquetIO.java | 17 +-
.../apache/beam/sdk/io/parquet/ParquetIOTest.java | 18 +
.../apache_beam/dataframe/transforms_test.py | 27 +-
sdks/python/apache_beam/io/fileio.py | 64 +-
.../python/apache_beam/options/pipeline_options.py | 3 +-
.../runners/interactive/background_caching_job.py | 1 +
.../runners/interactive/caching/cacheable.py | 78 ++
.../runners/interactive/caching/streaming_cache.py | 4 +-
.../interactive/caching/streaming_cache_test.py | 2 +-
.../runners/interactive/interactive_runner.py | 2 +-
.../runners/interactive/pipeline_instrument.py | 119 +--
.../interactive/pipeline_instrument_test.py | 4 +
.../container/license_scripts/dep_urls_py.yaml | 2 +
sdks/python/setup.py | 4 +
.../site/content/en/contribute/release-guide.md | 116 +--
.../site/content/en/get-started/tour-of-beam.md | 9 +
.../www/site/static/images/cut-release-branch.png | Bin 0 -> 34625 bytes
website/www/site/static/images/tag-rc-commit.png | Bin 0 -> 24964 bytes
40 files changed, 2593 insertions(+), 525 deletions(-)
create mode 100644 examples/notebooks/tour-of-beam/reading-and-writing-data.ipynb
create mode 100644 release/src/main/scripts/choose_rc_commit.sh
rename sdks/java/io/google-cloud-platform/src/main/java/org/apache/beam/sdk/io/gcp/pubsub/{RowToPubsubMessage.java => AddTimestampAttribute.java} (58%)
create mode 100644 sdks/java/io/google-cloud-platform/src/main/java/org/apache/beam/sdk/io/gcp/pubsub/NestedRowToMessage.java
create mode 100644 sdks/java/io/google-cloud-platform/src/test/java/org/apache/beam/sdk/io/gcp/pubsub/NestedRowToMessageTest.java
create mode 100644 sdks/python/apache_beam/runners/interactive/caching/cacheable.py
create mode 100644 website/www/site/static/images/cut-release-branch.png
create mode 100644 website/www/site/static/images/tag-rc-commit.png