feat: Update model profile and statistics tracking
- Updated model profile to support new cost parameters: costPerCachedInToken and costPerReasoningOutToken. - Enhanced AgentRequestStatistic to track cached input tokens and reasoning output tokens. - Modified CompletionStatistics to include cached input tokens and reasoning output tokens. - Updated AzureAiClient, CachedClient, and other clients to handle new statistics fields. - Introduced Timings class to capture detailed timing metrics for requests. - Adjusted Usage class to include input and output token details. - Updated properties files to include new cost parameters for cached and reasoning tokens.
This commit is contained in:
@@ -14,7 +14,9 @@ public record ModelProfile(
|
||||
String url,
|
||||
String apiKey,
|
||||
BigDecimal costPerInToken,
|
||||
BigDecimal costPerCachedInToken,
|
||||
BigDecimal costPerOutToken,
|
||||
BigDecimal costPerReasoningOutToken,
|
||||
String reasoningEffort,
|
||||
String reasoningSummaryDetails,
|
||||
String category) {
|
||||
|
||||
Reference in New Issue
Block a user