You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@beam.apache.org by ah...@apache.org on 2025/08/10 16:56:46 UTC
(beam) branch master updated: Added NewFeatures Line to Changes.Md (#35798)
This is an automated email from the ASF dual-hosted git repository.
ahmedabualsaud pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/beam.git
The following commit(s) were added to refs/heads/master by this push:
new 64625a753ee Added NewFeatures Line to Changes.Md (#35798)
64625a753ee is described below
commit 64625a753eefa578d8d4a413278100886267a819
Author: arnavarora2004 <ar...@google.com>
AuthorDate: Sun Aug 10 12:56:40 2025 -0400
Added NewFeatures Line to Changes.Md (#35798)
* Refactored BigTableReadSchemaTransformConfiguration
* changed scope, working on buffer class for making BigTable yaml fully connected and actually look good on user end for mutations
* Finished up a bit of standard_io.yaml
* Finished up a bit of standard_io.yaml
* Added bigTable test
* changed some tests for BigTable
* Added new IT file for simpleWrite and also made changes integration test debugging
* Added new IT file for simpleWrite and also made changes integration test debugging
* SetCell mutation test works, I want to see if this draft PR works CI test wise
* Fixed a slight error
* Added way more changes to integrations test.py, BigTableSimpleWriteSchemaTransformProviderIT, and testing out new mutations etc
* BigTableSimpleWriteSchemaTransformProviderIT finished changes to mutated new user input, all mutations work correctly, put demo code for it
* Update sdks/java/io/google-cloud-platform/src/main/java/org/apache/beam/sdk/io/gcp/bigtable/BigtableSimpleWriteSchemaTransformProvider.java
Co-authored-by: Derrick Williams <my...@gmail.com>
* Update sdks/java/io/google-cloud-platform/src/main/java/org/apache/beam/sdk/io/gcp/bigtable/BigtableSimpleWriteSchemaTransformProvider.java
Co-authored-by: Derrick Williams <my...@gmail.com>
* Update sdks/java/io/google-cloud-platform/src/main/java/org/apache/beam/sdk/io/gcp/bigtable/BigtableSimpleWriteSchemaTransformProvider.java
Co-authored-by: Derrick Williams <my...@gmail.com>
* Update sdks/java/io/google-cloud-platform/src/main/java/org/apache/beam/sdk/io/gcp/bigtable/BigtableSimpleWriteSchemaTransformProvider.java
Co-authored-by: Derrick Williams <my...@gmail.com>
* Update sdks/java/io/google-cloud-platform/src/test/java/org/apache/beam/sdk/io/gcp/bigtable/BigtableSimpleWriteSchemaTransformProviderIT.java
Co-authored-by: Derrick Williams <my...@gmail.com>
* changed comments
* Added changes from derrick comments
* Added default schema maybe fixes the issues
* Added schema to every test specificly, will run tests to see if it works
* Added default schema maybe fixes the issues
* Following formatting tests
* Following formatting tests
* Following checkstyle tests
* Made schema and test changes
* Made schema and test changes
* Made schema and test changes
* Made schema and test changes
* Made schema and test changes
* Added final test
* changed timestamp values
* added all mutations test
* added all mutations test
* pushed changes to format errors
* pushed changes to format errors
* Delete 4
* pushed changes to format errors
* pushed changes to format errors
* pushed changes to format errors
* pushed changes to debugging errors
* pushed changes to debugging errors
* to see internal error added print(will remove)
* to see internal error added print(will remove)
* to see internal error added print(will remove)
* import fixes
* import fixes
* import fixes
* import fixes
* import fixes
* import fixes
* pushed changes to debugging errors
* pushed changes to debugging errors
* pushed changes to debugging errors, added pulls from other beam
* made changes to allMutations test
* made changes to allMutations test
* pushed changes to debugging errors, added pulls from other beam
* pushed changes to debugging errors, added pulls from other beam
* pushed changes to debugging errors, added pulls from other beam
* pushed changes to debugging errors, added pulls from other beam
* pushed changes to debugging errors, added pulls from other beam
* new read errors fixed
* pushed changes to debugging errors, added pulls from other beam
* consolidated schema transform files, fixed small issues and bugs
* consolidated schema transform files, fixed small issues and bugs
* consolidated schema transform files, fixed small issues and bugs
* consolidated schema transform files, fixed small issues and bugs
* pushed changes to debugging errors, added pulls from other beam
* pushed changes from ahmed
* pushed changes from ahmed
* pushed changes from ahmed
* pushed changes from ahmed
* pushed changes from ahmed
* pushed changes from ahmed
* pushed changes from ahmed
* pushed changes from ahmed
* Following checkstyle tests
* Following checkstyle tests
* pushed new changes to BigTableRead, making it work with new functionality feature of allowing flatten (defaulted to true)
* pushed new changes to BigTableRead, making it work with new functionality feature of allowing flatten (defaulted to true) and added a new test in IT and fixed formatting stuff
* pushed new changes to BigTableRead, making it work with new functionality feature of allowing flatten (defaulted to true) and added a new test in IT and fixed formatting stuff
* Update sdks/java/io/google-cloud-platform/src/main/java/org/apache/beam/sdk/io/gcp/bigtable/BigtableReadSchemaTransformProvider.java
Co-authored-by: Ahmed Abualsaud <65...@users.noreply.github.com>
* pushed new changes to BigTableRead, making it work with new functionality feature of allowing flatten (defaulted to true) and added a new test in IT and fixed formatting stuff
* pushed new changes to BigTableRead, making it work with new functionality feature of allowing flatten (defaulted to true) and added a new test in IT and fixed formatting stuff
* pushed new changes to BigTableRead, making it work with new functionality feature of allowing flatten (defaulted to true) and added a new test in IT and fixed formatting stuff
* pushed new changes to BigTableRead, making it work with new functionality feature of allowing flatten (defaulted to true) and added a new test in IT and fixed formatting stuff
* new mongo files in branch
* fixed family_name to string
* fixed family_name to string
* fixed family_name to string
* fixed family_name to string
* fixed family_name to string
* fixed family_name to string
* fixed family_name to string
* fixed family_name to string
* fixed cmmit issues
* commented assert test, everything should work now
* added feature changes to changes.md
* Update CHANGES.md
Co-authored-by: Ahmed Abualsaud <65...@users.noreply.github.com>
* added feature changes to changes.md
---------
Co-authored-by: Derrick Williams <my...@gmail.com>
Co-authored-by: Ahmed Abualsaud <65...@users.noreply.github.com>
---
CHANGES.md | 3 +++
1 file changed, 3 insertions(+)
diff --git a/CHANGES.md b/CHANGES.md
index 45f49db7a34..e763b7d290d 100644
--- a/CHANGES.md
+++ b/CHANGES.md
@@ -73,6 +73,7 @@
## New Features / Improvements
* X feature added (Java/Python) ([#X](https://github.com/apache/beam/issues/X)).
+* BigtableRead Connector for BeamYaml added with new Config Param ([#35696](https://github.com/apache/beam/pull/35696))
## Breaking Changes
@@ -129,6 +130,8 @@
and hybrid search operations.
* [Beam SQL] Add support for DATABASEs, with an implementation for Iceberg ([]())
* Respect BatchSize and MaxBufferingDuration when using `JdbcIO.WriteWithResults`. Previously, these settings were ignored ([#35669](https://github.com/apache/beam/pull/35669)).
+* BigTableWrite Connector for BeamYaml added with mutation feature ([#35435](https://github.com/apache/beam/pull/35435))
+
## Breaking Changes