You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@beam.apache.org by jr...@apache.org on 2024/06/12 16:04:27 UTC
(beam) branch master updated: Update documentation for new TFT Transforms (#31565)
This is an automated email from the ASF dual-hosted git repository.
jrmccluskey pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/beam.git
The following commit(s) were added to refs/heads/master by this push:
new 9c80b81fd47 Update documentation for new TFT Transforms (#31565)
9c80b81fd47 is described below
commit 9c80b81fd47a2b8f13db65cbc9dde8cf007af5e8
Author: Jack McCluskey <34...@users.noreply.github.com>
AuthorDate: Wed Jun 12 12:04:20 2024 -0400
Update documentation for new TFT Transforms (#31565)
* Update documentation for new TFT Transforms
* narrow versioning scope
---
sdks/python/apache_beam/ml/transforms/tft.py | 4 ++++
website/www/site/content/en/documentation/ml/preprocess-data.md | 7 ++++++-
2 files changed, 10 insertions(+), 1 deletion(-)
diff --git a/sdks/python/apache_beam/ml/transforms/tft.py b/sdks/python/apache_beam/ml/transforms/tft.py
index e03d52214c9..6903cca8941 100644
--- a/sdks/python/apache_beam/ml/transforms/tft.py
+++ b/sdks/python/apache_beam/ml/transforms/tft.py
@@ -52,13 +52,17 @@ __all__ = [
'ComputeAndApplyVocabulary',
'ScaleToZScore',
'ScaleTo01',
+ 'ScaleToGaussian',
'ApplyBuckets',
+ 'ApplyBucketsWithInterpolation',
'Bucketize',
'TFIDF',
'TFTOperation',
'ScaleByMinMax',
'NGrams',
'BagOfWords',
+ 'HashStrings',
+ 'DeduplicateTensorPerRow',
]
# Register the expected input types for each operation
diff --git a/website/www/site/content/en/documentation/ml/preprocess-data.md b/website/www/site/content/en/documentation/ml/preprocess-data.md
index 1365926d3cc..fb21cc8928b 100644
--- a/website/www/site/content/en/documentation/ml/preprocess-data.md
+++ b/website/www/site/content/en/documentation/ml/preprocess-data.md
@@ -43,7 +43,7 @@ available transforms, see the [Transforms](#transforms) section on this page.
## Support and limitations {#support}
- Available in the Apache Beam Python SDK versions 2.53.0 and later.
-- Supports Python 3.8, 3.9, and 3.10.
+- Supports Python 3.8, 3.9, 3.10, and 3.11
- Only available for pipelines that use [default windows](/documentation/programming-guide/#single-global-window).
## Transforms {#transforms}
@@ -74,11 +74,16 @@ TensorFlow documentation.
| Transform name | Description |
| ------- | ---------------|
| ApplyBuckets | See [`tft.apply_buckets`](https://www.tensorflow.org/tfx/transform/api_docs/python/tft/apply_buckets) in the TensorFlow documentation. |
+| ApplyBucketsWithInterpolation | See [`tft.apply_buckets_with_interpolation`](https://www.tensorflow.org/tfx/transform/api_docs/python/tft/apply_buckets_with_interpolation) in the TensorFlow documentation. |
+| BagOfWords | See [`tft.bag_of_words`](https://www.tensorflow.org/tfx/transform/api_docs/python/tft/bag_of_words) in the TensorFlow documentation. |
| Bucketize | See [`tft.bucketize`](https://www.tensorflow.org/tfx/transform/api_docs/python/tft/bucketize) in the TensorFlow documentation. |
| ComputeAndApplyVocabulary | See [`tft.compute_and_apply_vocabulary`](https://www.tensorflow.org/tfx/transform/api_docs/python/tft/compute_and_apply_vocabulary) in the TensorFlow documentation. |
+| DeduplicateTensorPerRow | See [`tft.deduplicate_tensor_per_row`](https://www.tensorflow.org/tfx/transform/api_docs/python/tft/deduplicate_tensor_per_row) in the TensorFlow documentation. |
+| HashStrings | See [`tft.hash_strings`](https://www.tensorflow.org/tfx/transform/api_docs/python/tft/hash_strings) in the TensorFlow documentation. |
| NGrams | See [`tft.ngrams`](https://www.tensorflow.org/tfx/transform/api_docs/python/tft/ngrams) in the TensorFlow documentation. |
| ScaleByMinMax | See [`tft.scale_by_min_max`](https://www.tensorflow.org/tfx/transform/api_docs/python/tft/scale_by_min_max) in the TensorFlow documentation. |
| ScaleTo01 | See [`tft.scale_to_0_1`](https://www.tensorflow.org/tfx/transform/api_docs/python/tft/scale_to_0_1) in the TensorFlow documentation. |
+| ScaleToGaussian | See [`tft.scale_to_gaussian`](https://www.tensorflow.org/tfx/transform/api_docs/python/tft/scale_to_gaussian) in the TensorFlow documentation. |
| ScaleToZScore | See [`tft.scale_to_z_score`](https://www.tensorflow.org/tfx/transform/api_docs/python/tft/scale_to_z_score) in the TensorFlow documentation. |
| TFIDF | See [`tft.tfidf`](https://www.tensorflow.org/tfx/transform/api_docs/python/tft/tfidf) in the TensorFlow documentation. |:
{{< /table >}}