You are viewing a plain text version of this content. The canonical link for it is here.
Posted to github@beam.apache.org by GitBox <gi...@apache.org> on 2022/07/26 17:16:28 UTC
[GitHub] [beam] tvalentyn opened a new issue, #22454: [Bug]: Spanner ITs are failing in Py37 PostCommits
tvalentyn opened a new issue, #22454:
URL: https://github.com/apache/beam/issues/22454
### What happened?
https://ci-beam.apache.org/job/beam_PostCommit_Python37/5516/testReport/junit/apache_beam.io.gcp.experimental.spannerio_read_it_test/SpannerReadIntegrationTest/test_table_metrics_error_call/
```
Error Message
test setup failure
Stacktrace
cls = <class 'apache_beam.io.gcp.experimental.spannerio_read_it_test.SpannerReadIntegrationTest'>
@classmethod
def setUpClass(cls):
_LOGGER.info(".... PyVersion ---> %s" % str(sys.version))
_LOGGER.info(".... Setting up!")
cls.test_pipeline = TestPipeline(is_integration_test=True)
cls.args = cls.test_pipeline.get_full_options_as_args()
cls.runner_name = type(cls.test_pipeline.runner).__name__
cls.project = cls.test_pipeline.get_option('project')
cls.instance = (
cls.test_pipeline.get_option('instance') or _TEST_INSTANCE_ID)
_ = cls._generate_table_name()
spanner_client = cls._SPANNER_CLIENT = spanner.Client()
_LOGGER.info(".... Spanner Client created!")
cls._SPANNER_INSTANCE = spanner_client.instance(cls.instance)
cls._create_database()
> cls._add_dummy_entries()
apache_beam/io/gcp/experimental/spannerio_read_it_test.py:105:
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _
apache_beam/io/gcp/experimental/spannerio_read_it_test.py:87: in _add_dummy_entries
with database.batch() as batch:
../../build/gradleenv/-1734967052/lib/python3.7/site-packages/google/cloud/spanner_v1/database.py:611: in __enter__
session = self._session = self._database._pool.get()
../../build/gradleenv/-1734967052/lib/python3.7/site-packages/google/cloud/spanner_v1/pool.py:273: in get
session.create()
../../build/gradleenv/-1734967052/lib/python3.7/site-packages/google/cloud/spanner_v1/session.py:113: in create
api = self._database.spanner_api
../../build/gradleenv/-1734967052/lib/python3.7/site-packages/google/cloud/spanner_v1/database.py:235: in spanner_api
client_options=client_options,
../../build/gradleenv/-1734967052/lib/python3.7/site-packages/google/cloud/spanner_v1/gapic/spanner_client.py:194: in __init__
address=api_endpoint, channel=channel, credentials=credentials
../../build/gradleenv/-1734967052/lib/python3.7/site-packages/google/cloud/spanner_v1/gapic/transports/spanner_grpc_transport.py:77: in __init__
"grpc.keepalive_time_ms": _GRPC_KEEPALIVE_MS,
../../build/gradleenv/-1734967052/lib/python3.7/site-packages/google/cloud/spanner_v1/gapic/transports/spanner_grpc_transport.py:114: in create_channel
address, credentials=credentials, scopes=cls._OAUTH_SCOPES, **kwargs
../../build/gradleenv/-1734967052/lib/python3.7/site-packages/google/api_core/grpc_helpers.py:297: in create_channel
return grpc.secure_channel(target, composite_credentials, **kwargs)
../../build/gradleenv/-1734967052/lib/python3.7/site-packages/grpc/__init__.py:2005: in secure_channel
credentials._credentials, compression)
../../build/gradleenv/-1734967052/lib/python3.7/site-packages/grpc/_channel.py:1480: in __init__
credentials)
src/python/grpcio/grpc/_cython/_cygrpc/channel.pyx.pxi:454: in grpc._cython.cygrpc.Channel.__cinit__
???
src/python/grpcio/grpc/_cython/_cygrpc/arguments.pyx.pxi:76: in grpc._cython.cygrpc._ChannelArgs.__cinit__
???
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _
> ???
E TypeError: Expected int, bytes, or behavior, got <class 'grpc_gcp_pb2.ApiConfig'>
```
### Issue Priority
Priority: 1
### Issue Component
Component: dependencies
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@beam.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [beam] kileys commented on issue #22454: [Bug]: Spanner ITs are failing in Py37 PostCommits
Posted by GitBox <gi...@apache.org>.
kileys commented on issue #22454:
URL: https://github.com/apache/beam/issues/22454#issuecomment-1198748154
This can be re-closed right?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@beam.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [beam] tvalentyn commented on issue #22454: [Bug]: Spanner ITs are failing in Py37 PostCommits
Posted by GitBox <gi...@apache.org>.
tvalentyn commented on issue #22454:
URL: https://github.com/apache/beam/issues/22454#issuecomment-1196051357
cc: @BjornPrime
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@beam.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [beam] tvalentyn closed issue #22454: [Bug]: Spanner ITs are failing in Py37 PostCommits
Posted by GitBox <gi...@apache.org>.
tvalentyn closed issue #22454: [Bug]: Spanner ITs are failing in Py37 PostCommits
URL: https://github.com/apache/beam/issues/22454
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@beam.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [beam] tvalentyn closed issue #22454: [Bug]: Spanner ITs are failing in Py37 PostCommits
Posted by GitBox <gi...@apache.org>.
tvalentyn closed issue #22454: [Bug]: Spanner ITs are failing in Py37 PostCommits
URL: https://github.com/apache/beam/issues/22454
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@beam.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [beam] tvalentyn commented on issue #22454: [Bug]: Spanner ITs are failing in Py37 PostCommits
Posted by GitBox <gi...@apache.org>.
tvalentyn commented on issue #22454:
URL: https://github.com/apache/beam/issues/22454#issuecomment-1198756900
right.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@beam.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [beam] tvalentyn commented on issue #22454: [Bug]: Spanner ITs are failing in Py37 PostCommits
Posted by GitBox <gi...@apache.org>.
tvalentyn commented on issue #22454:
URL: https://github.com/apache/beam/issues/22454#issuecomment-1197043316
The error happens only with google-api-core==2.8.2 and not reproducible with google-api-core==2.8.1.
Bisection within google-api-core repo points to
[5b5e77563229687c901d77b5fdecc18168b535e6](https://github.com/googleapis/python-api-core/commit/5b5e77563229687c901d77b5fdecc18168b535e6) as first bad commit (which just changes the version, but no other changes...). Not sure how to interpret this.
cc: @parthea
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@beam.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [beam] tvalentyn commented on issue #22454: [Bug]: Spanner ITs are failing in Py37 PostCommits
Posted by GitBox <gi...@apache.org>.
tvalentyn commented on issue #22454:
URL: https://github.com/apache/beam/issues/22454#issuecomment-1196048005
most likely an incompatibility between
```
google-api-core==2.8.2
google-cloud-spanner==1.19.3
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@beam.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [beam] tvalentyn commented on issue #22454: [Bug]: Spanner ITs are failing in Py37 PostCommits
Posted by GitBox <gi...@apache.org>.
tvalentyn commented on issue #22454:
URL: https://github.com/apache/beam/issues/22454#issuecomment-1196136553
Confirmed that the ```E TypeError: Expected int, bytes, or behavior, got <class 'grpc_gcp_pb2.ApiConfig'>``` error goes away after:
```
pip install "google-api-core<2" --no-deps
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@beam.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [beam] tvalentyn commented on issue #22454: [Bug]: Spanner ITs are failing in Py37 PostCommits
Posted by GitBox <gi...@apache.org>.
tvalentyn commented on issue #22454:
URL: https://github.com/apache/beam/issues/22454#issuecomment-1196047280
Repro:
```
python -m pytest -rsx -o log_cli=True -o log_level=Info apache_beam/io/gcp/experimental/spannerio_read_it_test.py::SpannerReadIntegrationTest::test_table_metrics_error_call --test-pipeline-options='--runner=DirectRunner'
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@beam.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [beam] tvalentyn commented on issue #22454: [Bug]: Spanner ITs are failing in Py37 PostCommits
Posted by GitBox <gi...@apache.org>.
tvalentyn commented on issue #22454:
URL: https://github.com/apache/beam/issues/22454#issuecomment-1196123573
Note that the version google-cloud-spanner==1.19.1 requires google-api-core<2, see:
https://github.com/googleapis/python-spanner/blob/release-v1.19.1/setup.py#L32
The 1.19.3 release was released just recently (June 9): https://pypi.org/project/google-cloud-spanner/1.19.3/
Although I didn't find sources, I think it might be relaxing just that requirement, while not actually maintaining compatibility with the newer versions of google-api-core.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@beam.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [beam] tvalentyn commented on issue #22454: [Bug]: Spanner ITs are failing in Py37 PostCommits
Posted by GitBox <gi...@apache.org>.
tvalentyn commented on issue #22454:
URL: https://github.com/apache/beam/issues/22454#issuecomment-1198493752
per feedback from @parthea , it is better to exclude google-api-core==2.8.2 explicitly, and they guarantee to add support of grpcio-gcp to the next version of google-api-core.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@beam.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [beam] tvalentyn commented on issue #22454: [Bug]: Spanner ITs are failing in Py37 PostCommits
Posted by GitBox <gi...@apache.org>.
tvalentyn commented on issue #22454:
URL: https://github.com/apache/beam/issues/22454#issuecomment-1196069854
Bumping up google-cloud-spanner to >= shows errors, suggesting incompatibility b/w Spanner IO and new dependency
```
apache_beam/runners/common.py:1571: in apache_beam.runners.common._OutputHandler.handle_process_outputs
for result in results:
apache_beam/io/gcp/experimental/spannerio.py:1185: in process
mg_info = element.info
apache_beam/io/gcp/experimental/spannerio.py:914: in info
bytes += m.byte_size
apache_beam/io/gcp/experimental/spannerio.py:901: in byte_size
return self.mutation.ByteSize()
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@beam.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org