You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@heron.apache.org by GitBox <gi...@apache.org> on 2022/10/14 16:41:43 UTC
[GitHub] [incubator-heron] nicknezis opened a new issue, #3850: Heron Tracker crashes when running topologies with Zookeeper state manager
nicknezis opened a new issue, #3850:
URL: https://github.com/apache/incubator-heron/issues/3850
With our major rewrite to Python 3, we introduced a bug which wasn't noticed until now. When storing the `SchedulerLocation` Protobuf message in the state manager repo, such as Zookeeper, we are storing `job_page_link` as a `repeated string` which produces a Python `List` and not a `str`. ([Protobuf field](https://github.com/apache/incubator-heron/blob/41e098862f5d10a39738fe5e1139649d1c47c151/heron/proto/scheduler.proto#L33)).
When running the Heron Tracker, we experience crashes at [this point](https://github.com/apache/incubator-heron/blob/41e098862f5d10a39738fe5e1139649d1c47c151/heron/tools/tracker/src/python/topology.py#L570
) in the codebase.
This is because Python 3 is now using the new type hint system. The returned `TopologyInfoSchedulerLocation` is expecting `job_page_link` to be a `str`.
A simple fix would be to extract the first string from the Protobuf [`RepeatedScalarFieldContainer`](https://googleapis.dev/python/protobuf/latest/google/protobuf/internal/containers.html#google.protobuf.internal.containers.RepeatedScalarFieldContainer).
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@heron.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-heron] nicknezis closed issue #3850: Heron Tracker crashes when running topologies with Zookeeper state manager
Posted by GitBox <gi...@apache.org>.
nicknezis closed issue #3850: Heron Tracker crashes when running topologies with Zookeeper state manager
URL: https://github.com/apache/incubator-heron/issues/3850
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@heron.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org