Mario Zechner bc8d994a7b Fix token statistics on abort for Anthropic provider ...

- Add handling for message_start event to capture initial token usage
- Fix message_delta to use assignment (=) instead of addition (+=)
  since Anthropic sends cumulative token counts, not incremental
- Add comprehensive tests for all providers (Google, OpenAI Completions,
  OpenAI Responses, Anthropic)
- Document OpenAI limitation: token stats only available at stream end

Fixes issue where aborted streams had zero token counts despite
Anthropic sending input tokens in the initial message_start event.

2025-10-26 21:22:24 +01:00

2.7 KiB

Raw Blame History

View Raw