You are viewing a plain text version of this content. The canonical link for it is here.
Posted to github@beam.apache.org by GitBox <gi...@apache.org> on 2022/10/20 15:46:43 UTC
[GitHub] [beam] yeandy opened a new issue, #23756: [Bug]: TensorFlow RunInference signature dtype issue
yeandy opened a new issue, #23756:
URL: https://github.com/apache/beam/issues/23756
### What happened?
I am trying to use the TensorFlow MobileNet v2 320x320 [model](https://github.com/tensorflow/models/blob/master/research/object_detection/g3doc/tf2_detection_zoo.md) model in RunInference using the [API from tfx_bsl](https://github.com/tensorflow/tfx-bsl/blob/master/tfx_bsl/public/beam/run_inference.py).
But I'm running into this error. Please see this [PR](https://github.com/apache/beam/pull/23754). Looks like a signature dtype issue, where the expected type is a string (which has the enum value of `7`), but the `dtype` of the MobileNet model is `uint8` (which corresponds to the enum value of `4`)
```
2022-10-20 11:40:58.577845: I tensorflow/core/platform/cpu_feature_guard.cc:193] This TensorFlow binary is optimized with oneAPI Deep Neural Network Library (oneDNN) to use the following CPU instructions in performance-critical operations: AVX2 FMA
To enable them in other operations, rebuild TensorFlow with the appropriate compiler flags.
Traceback (most recent call last):
File "/Users/yeandy/.pyenv/versions/3.8.9/lib/python3.8/runpy.py", line 194, in _run_module_as_main
return _run_code(code, main_globals, None,
File "/Users/yeandy/.pyenv/versions/3.8.9/lib/python3.8/runpy.py", line 87, in _run_code
exec(code, run_globals)
File "/Users/yeandy/projects/beam/sdks/python/apache_beam/examples/inference/tensorflow_object_detection.py", line 260, in <module>
run()
File "/Users/yeandy/projects/beam/sdks/python/apache_beam/examples/inference/tensorflow_object_detection.py", line 233, in run
tf_model_handler = CreateModelHandler(inference_spec_type)
File "/Users/yeandy/.pyenv/versions/mypy-pytorch3.8/lib/python3.8/site-packages/tfx_bsl/public/beam/run_inference.py", line 281, in CreateModelHandler
return run_inference.create_model_handler(inference_spec_type, None, None)
File "/Users/yeandy/.pyenv/versions/mypy-pytorch3.8/lib/python3.8/site-packages/tfx_bsl/beam/run_inference.py", line 125, in create_model_handler
return _get_saved_model_handler(inference_spec_type, load_override_fn)
File "/Users/yeandy/.pyenv/versions/mypy-pytorch3.8/lib/python3.8/site-packages/tfx_bsl/beam/run_inference.py", line 243, in _get_saved_model_handler
return _PredictModelHandler(inference_spec_type, load_override_fn)
File "/Users/yeandy/.pyenv/versions/mypy-pytorch3.8/lib/python3.8/site-packages/tfx_bsl/beam/run_inference.py", line 586, in __init__
self._io_tensor_spec = self._make_io_tensor_spec()
File "/Users/yeandy/.pyenv/versions/mypy-pytorch3.8/lib/python3.8/site-packages/tfx_bsl/beam/run_inference.py", line 626, in _make_io_tensor_spec
raise ValueError(
ValueError: Input dtype is expected to be 7, got 4
```
Original command:
```
python -m apache_beam.examples.inference.tensorflow_object_detection \
--input gs://apache-beam-ml/testing/inputs/tensorrt_image_file_names.txt \
--output tf_predictions_val2017.txt \
--model_path gs://apache-beam-testing-yeandy/tfx-inference/model/ssd_mobilenet_v2_320x320_coco17_tpu-8/
```
### Issue Priority
Priority: 2
### Issue Component
Component: run-inference
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@beam.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [beam] yeandy commented on issue #23756: [Bug]: TensorFlow RunInference signature dtype issue
Posted by GitBox <gi...@apache.org>.
yeandy commented on issue #23756:
URL: https://github.com/apache/beam/issues/23756#issuecomment-1286148258
Thanks for the info. This confirms what I was seeing. @AnandInguva also pointed me to his PR https://github.com/apache/beam/pull/23456 that introduces a helper function to assist with this conversion.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@beam.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [beam] damccorm commented on issue #23756: [Bug]: TensorFlow RunInference signature dtype issue
Posted by GitBox <gi...@apache.org>.
damccorm commented on issue #23756:
URL: https://github.com/apache/beam/issues/23756#issuecomment-1286114527
This is related to https://github.com/apache/beam/issues/23584 which is caused by https://github.com/tensorflow/tfx-bsl/blob/49baf317527cc53d2dfb7d6c37b59757cd6d83a8/tfx_bsl/beam/run_inference.py#L626 - basically tfx-bsl's implementation of their model handler requires a string
You can workaround it by adding a tf.function like we do in our notebook to convert from string records to uint8 records, and then convert your input types to string tf.examples - https://github.com/apache/beam/blob/master/examples/notebooks/beam-ml/run_inference_tensorflow.ipynb - its ugly, but should be workable
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@beam.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [beam] AnandInguva commented on issue #23756: [Bug]: TensorFlow RunInference signature dtype issue
Posted by GitBox <gi...@apache.org>.
AnandInguva commented on issue #23756:
URL: https://github.com/apache/beam/issues/23756#issuecomment-1315358682
I think we can close this issue. Please reopen it if there is anything else.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@beam.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [beam] yeandy commented on issue #23756: [Bug]: TensorFlow RunInference signature dtype issue
Posted by GitBox <gi...@apache.org>.
yeandy commented on issue #23756:
URL: https://github.com/apache/beam/issues/23756#issuecomment-1289016185
To fix this, use the function below https://github.com/apache/beam/blob/8f85a6cdf8d0d71218137fbec149d13ae6fc595b/sdks/python/apache_beam/examples/inference/tfx_bsl/build_tensorflow_model.py#L71
You can pull the PR, or just copy the code directly.
Make sure you have the saved_model of the TF model. Then run the following in your Python shell
```
import tensorflow as tf
from apache_beam.examples.inference.tfx_bsl.build_tensorflow_model import save_tf_model
path = '/my_path/ssd_mobilenet_v2_320x320_coco17_tpu-8/saved_model'
ssd_mobilenet = tf.saved_model.load(path)
save_tf_model_with_signature('/my_path/ssd_mobilenet_v2_320x320_coco17_tpu-8_string_signature', ssd_mobilenet, input_dtype=tf.uint8)
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@beam.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [beam] github-actions[bot] closed issue #23756: [Bug]: TensorFlow RunInference signature dtype issue
Posted by GitBox <gi...@apache.org>.
github-actions[bot] closed issue #23756: [Bug]: TensorFlow RunInference signature dtype issue
URL: https://github.com/apache/beam/issues/23756
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@beam.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [beam] AnandInguva commented on issue #23756: [Bug]: TensorFlow RunInference signature dtype issue
Posted by GitBox <gi...@apache.org>.
AnandInguva commented on issue #23756:
URL: https://github.com/apache/beam/issues/23756#issuecomment-1315358858
.close-issue
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@beam.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org