You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@beam.apache.org by jr...@apache.org on 2024/06/12 16:04:27 UTC

(beam) branch master updated: Update documentation for new TFT Transforms (#31565)

This is an automated email from the ASF dual-hosted git repository.

jrmccluskey pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/beam.git


The following commit(s) were added to refs/heads/master by this push:
     new 9c80b81fd47 Update documentation for new TFT Transforms (#31565)
9c80b81fd47 is described below

commit 9c80b81fd47a2b8f13db65cbc9dde8cf007af5e8
Author: Jack McCluskey <34...@users.noreply.github.com>
AuthorDate: Wed Jun 12 12:04:20 2024 -0400

    Update documentation for new TFT Transforms (#31565)
    
    * Update documentation for new TFT Transforms
    
    * narrow versioning scope
---
 sdks/python/apache_beam/ml/transforms/tft.py                    | 4 ++++
 website/www/site/content/en/documentation/ml/preprocess-data.md | 7 ++++++-
 2 files changed, 10 insertions(+), 1 deletion(-)

diff --git a/sdks/python/apache_beam/ml/transforms/tft.py b/sdks/python/apache_beam/ml/transforms/tft.py
index e03d52214c9..6903cca8941 100644
--- a/sdks/python/apache_beam/ml/transforms/tft.py
+++ b/sdks/python/apache_beam/ml/transforms/tft.py
@@ -52,13 +52,17 @@ __all__ = [
     'ComputeAndApplyVocabulary',
     'ScaleToZScore',
     'ScaleTo01',
+    'ScaleToGaussian',
     'ApplyBuckets',
+    'ApplyBucketsWithInterpolation',
     'Bucketize',
     'TFIDF',
     'TFTOperation',
     'ScaleByMinMax',
     'NGrams',
     'BagOfWords',
+    'HashStrings',
+    'DeduplicateTensorPerRow',
 ]
 
 # Register the expected input types for each operation
diff --git a/website/www/site/content/en/documentation/ml/preprocess-data.md b/website/www/site/content/en/documentation/ml/preprocess-data.md
index 1365926d3cc..fb21cc8928b 100644
--- a/website/www/site/content/en/documentation/ml/preprocess-data.md
+++ b/website/www/site/content/en/documentation/ml/preprocess-data.md
@@ -43,7 +43,7 @@ available transforms, see the [Transforms](#transforms) section on this page.
 ## Support and limitations {#support}
 
 -   Available in the Apache Beam Python SDK versions 2.53.0 and later.
--   Supports Python 3.8, 3.9, and 3.10.
+-   Supports Python 3.8, 3.9, 3.10, and 3.11
 -   Only available for pipelines that use [default windows](/documentation/programming-guide/#single-global-window).
 
 ## Transforms {#transforms}
@@ -74,11 +74,16 @@ TensorFlow documentation.
 | Transform name | Description |
 | ------- | ---------------|
 | ApplyBuckets | See [`tft.apply_buckets`](https://www.tensorflow.org/tfx/transform/api_docs/python/tft/apply_buckets) in the TensorFlow documentation. |
+| ApplyBucketsWithInterpolation | See [`tft.apply_buckets_with_interpolation`](https://www.tensorflow.org/tfx/transform/api_docs/python/tft/apply_buckets_with_interpolation) in the TensorFlow documentation. |
+| BagOfWords | See [`tft.bag_of_words`](https://www.tensorflow.org/tfx/transform/api_docs/python/tft/bag_of_words) in the TensorFlow documentation. |
 | Bucketize | See [`tft.bucketize`](https://www.tensorflow.org/tfx/transform/api_docs/python/tft/bucketize) in the TensorFlow documentation. |
 | ComputeAndApplyVocabulary | See [`tft.compute_and_apply_vocabulary`](https://www.tensorflow.org/tfx/transform/api_docs/python/tft/compute_and_apply_vocabulary) in the TensorFlow documentation. |
+| DeduplicateTensorPerRow | See [`tft.deduplicate_tensor_per_row`](https://www.tensorflow.org/tfx/transform/api_docs/python/tft/deduplicate_tensor_per_row) in the TensorFlow documentation. |
+| HashStrings | See [`tft.hash_strings`](https://www.tensorflow.org/tfx/transform/api_docs/python/tft/hash_strings) in the TensorFlow documentation. |
 | NGrams | See [`tft.ngrams`](https://www.tensorflow.org/tfx/transform/api_docs/python/tft/ngrams) in the TensorFlow documentation. |
 | ScaleByMinMax | See [`tft.scale_by_min_max`](https://www.tensorflow.org/tfx/transform/api_docs/python/tft/scale_by_min_max) in the TensorFlow documentation. |
 | ScaleTo01 | See [`tft.scale_to_0_1`](https://www.tensorflow.org/tfx/transform/api_docs/python/tft/scale_to_0_1) in the TensorFlow documentation. |
+| ScaleToGaussian | See [`tft.scale_to_gaussian`](https://www.tensorflow.org/tfx/transform/api_docs/python/tft/scale_to_gaussian) in the TensorFlow documentation. |
 | ScaleToZScore | See [`tft.scale_to_z_score`](https://www.tensorflow.org/tfx/transform/api_docs/python/tft/scale_to_z_score) in the TensorFlow documentation. |
 | TFIDF | See [`tft.tfidf`](https://www.tensorflow.org/tfx/transform/api_docs/python/tft/tfidf) in the TensorFlow documentation. |:
 {{< /table >}}