You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
{{ message }}
Repository navigation
Make OpenAITelemetryPlugin record report metrics only if 'recording' is on #1440
The OpenAITelemetryPlugin should only record some report metrics when the 'recording' state is active.
Currently, all records are collected and compiled into a report after recoding is stopped.
We chose to send metrics without recording because we're sending them live, as we're intercepting requests. Is there a reason why you'd want to capture metrics only while recording?
changed the title [-]Make OpenAITelemetryPlugin record metrics only if 'recording' is on[/-][+]Make OpenAITelemetryPlugin record report metrics only if 'recording' is on[/+]on Nov 13, 2025
We chose to send metrics without recording because we're sending them live, as we're intercepting requests. Is there a reason why you'd want to capture metrics only while recording?
This concern is unrelated to OTel metrics exporting.
The plugin generates reports using data collected over the entire period between its startup and the moment the recording is stopped. If a user generates a metrics report after the plugin has been running for a substantial period, they may be surprised by the unexpectedly large amount of historical data. This behavior is confusing.
Alternatively, we could implement a fix assuming the goal is to continuously collect all metrics data while the plugin is running. This approach would require removing the step that resets the collected data when a recording session is stopped. The generated report would then reflect the entire history of collected metrics.
Ah, understood. Yeah, that makes sense. Rather than recording the usage for the report as we're intercepting requests, we could do it only based on the requests we recorded. You're right. Thanks for pointing it out.
Activity
waldekmastykarz commentedon Nov 13, 2025
We chose to send metrics without recording because we're sending them live, as we're intercepting requests. Is there a reason why you'd want to capture metrics only while recording?
[-]Make OpenAITelemetryPlugin record metrics only if 'recording' is on[/-][+]Make OpenAITelemetryPlugin record report metrics only if 'recording' is on[/+]bartizan commentedon Nov 13, 2025
@waldekmastykarz
This concern is unrelated to OTel metrics exporting.
The plugin generates reports using data collected over the entire period between its startup and the moment the recording is stopped. If a user generates a metrics report after the plugin has been running for a substantial period, they may be surprised by the unexpectedly large amount of historical data. This behavior is confusing.
Alternatively, we could implement a fix assuming the goal is to continuously collect all metrics data while the plugin is running. This approach would require removing the step that resets the collected data when a recording session is stopped. The generated report would then reflect the entire history of collected metrics.
waldekmastykarz commentedon Nov 14, 2025
Ah, understood. Yeah, that makes sense. Rather than recording the usage for the report as we're intercepting requests, we could do it only based on the requests we recorded. You're right. Thanks for pointing it out.
bartizan commentedon Nov 14, 2025
I'm on it