Add supportsUsageInStreaming compat flag for OpenAI-compatible providers
Renamed from supportsStreamOptions to clarify this controls stream_options: { include_usage: true }.
Defaults to true (no behavioral change for existing providers).
Providers like gatewayz.ai that reject this parameter can set supportsUsageInStreaming: false in model config.
Based on #596 by @XesGaDeus
This commit is contained in:
Binary file not shown.
|
Before Width: | Height: | Size: 321 B After Width: | Height: | Size: 321 B |
Reference in New Issue
Block a user