You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@arrow.apache.org by "benibus (via GitHub)" <gi...@apache.org> on 2024/02/01 20:55:56 UTC
[I] [C++] Add support for OpenTelemetry logging [arrow]
benibus opened a new issue, #39898:
URL: https://github.com/apache/arrow/issues/39898
### Describe the enhancement requested
This request stems from some ongoing discussions on how to enhance Flight/FlightSQL's telemetry and improve users' debugging experience. I believe that utilizing [OpenTelemetry's logging facilities](https://opentelemetry.io/docs/specs/otel/logs/sdk/) would be a step in the right direction as the emitted logs can be associated with existing traces/spans.
A couple things to note:
- The `opentelemetry-cpp` logging SDK was [marked stable in v1.11.0](https://github.com/open-telemetry/opentelemetry-cpp/commit/8c82d24c2073dbe01f38988a226e2e24a6a49fa4), so we'd probably want to bump our version from 1.8.1.
- I'm not necessarily suggesting that the OTel systems should integrate with `ARROW_LOG` and whatnot. I'd imagine we'd provide an independent API here.
FWIW I've done some experimentation using the (unstable) v1.8.1 SDK and I was happy with the results.
### Component(s)
C++, FlightRPC
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@arrow.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [C++] Add support for OpenTelemetry logging [arrow]
Posted by "jorisvandenbossche (via GitHub)" <gi...@apache.org>.
jorisvandenbossche commented on issue #39898:
URL: https://github.com/apache/arrow/issues/39898#issuecomment-1933690269
For clarity, this issue is specifically for Flight? (as we already support OpenTelemetry in Arrow C++ in some places AFAIK?)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [C++] Add support for OpenTelemetry logging [arrow]
Posted by "benibus (via GitHub)" <gi...@apache.org>.
benibus commented on issue #39898:
URL: https://github.com/apache/arrow/issues/39898#issuecomment-1934491002
Not necessarily just for Flight, although it would be most useful there. We do already support OpenTelemetry in Arrow, but we only really use it to create traces/spans, which indirectly serve as "logs" in their own way.
However, OTel (as of recently) provides additional tools for detailed logging within traces, where the emitted logs can be linked to the appropriate `span_id`/`trace_id` and exported along with everything else.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [C++] Add support for OpenTelemetry logging [arrow]
Posted by "zeroshade (via GitHub)" <gi...@apache.org>.
zeroshade closed issue #39898: [C++] Add support for OpenTelemetry logging
URL: https://github.com/apache/arrow/issues/39898
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org