Commit Graph

6 Commits

Author SHA1 Message Date
extio-de
b7c1e90dc7 feat: Update model profile and statistics tracking
- Updated model profile to support new cost parameters: costPerCachedInToken and costPerReasoningOutToken.
- Enhanced AgentRequestStatistic to track cached input tokens and reasoning output tokens.
- Modified CompletionStatistics to include cached input tokens and reasoning output tokens.
- Updated AzureAiClient, CachedClient, and other clients to handle new statistics fields.
- Introduced Timings class to capture detailed timing metrics for requests.
- Adjusted Usage class to include input and output token details.
- Updated properties files to include new cost parameters for cached and reasoning tokens.
2025-11-30 18:19:01 +01:00
extio-de
d77c11e809 chore: Bump version to 1.6.19 and refactor AgentRequestStatistic for improved instantiation and duration handling 2025-09-27 08:48:02 +02:00
extio-de
47ef9ba436 Refactored llm clients, removed maxContinuations feature, exposed finishReason instead; 2025-06-27 20:43:04 +02:00
(no author)
3c412077bb lm-lib: Merged with tp fork;
git-svn-id: svn://home0/lm-lib@3723 71dcc7fd-b1f2-4e5d-bb8e-274146e81173
2025-02-23 19:08:49 +00:00
(no author)
cb2c1c02da Calculate effective duration and tps;
git-svn-id: svn://home0/lm-lib@3652 71dcc7fd-b1f2-4e5d-bb8e-274146e81173
2024-12-22 12:34:07 +00:00
(no author)
c1a283305d lm-lib first commit;
git-svn-id: svn://home0/lm-lib@3603 71dcc7fd-b1f2-4e5d-bb8e-274146e81173
2024-12-16 20:58:04 +00:00