Commit Graph

12 Commits

Author SHA1 Message Date
extio-de
4ff231227e feat: Support OLLAMA provider
- Added OllamaClient to handle conversations with the Ollama API.
- Introduced OllamaDialect for managing thinking modes.
- Created data classes: OllamaFunctionCall, OllamaListedModel, OllamaMessage, OllamaShowRequest, OllamaShowResponse, OllamaTagsResponse, OllamaToolCall, OllamaToolDefinition, and OllamaToolFunction for structured API communication.
- Developed unit tests for OllamaClient to validate model listing, chat completion, streaming responses, and tool calling capabilities.
- Configured test properties for local Ollama instance.
2026-05-09 17:47:28 +02:00
Stephan Birkl
244aa2574b feat: Introduce OpenAiProviderDialect for flexible request shaping and remove reasoning properties from ModelProfile
- Added OpenAiProviderDialect to manage request features for OpenAI-compatible providers.
- Refactored ChatCompletionClient and TextCompletionClient to utilize the new dialect for handling reasoning and usage settings.
- Removed reasoningEffort and reasoningSummaryDetails from ModelProfile and related services.
- Updated README to reflect changes in request shaping and dialect usage.
2026-05-07 17:57:59 +02:00
extio-de
b4d1a44d93 feat: Implement tokenizer resolver and fallback tokenizer; update model profiles and README 2026-04-03 18:40:53 +02:00
extio-de
4c0c30974e refactor: Remove Azure AI client implementation and related configuration 2025-12-19 11:45:33 +01:00
extio-de
b7c1e90dc7 feat: Update model profile and statistics tracking
- Updated model profile to support new cost parameters: costPerCachedInToken and costPerReasoningOutToken.
- Enhanced AgentRequestStatistic to track cached input tokens and reasoning output tokens.
- Modified CompletionStatistics to include cached input tokens and reasoning output tokens.
- Updated AzureAiClient, CachedClient, and other clients to handle new statistics fields.
- Introduced Timings class to capture detailed timing metrics for requests.
- Adjusted Usage class to include input and output token details.
- Updated properties files to include new cost parameters for cached and reasoning tokens.
2025-11-30 18:19:01 +01:00
extio-de
bd37a143f6 refactor: Update ModelProfile to use costPerInToken and costPerOutToken for better clarity and accuracy 2025-10-31 16:15:37 +01:00
extio-de
304924e223 feat: Enhance agent functionality with ModelProfile integration
- Added ModelProfile to the Agent record to allow for more detailed model configurations.
- Updated AgentExecutorService to utilize ModelProfile when fetching clients.
- Modified BaseAgent interface to include a default modelProfile method.
- Adjusted Client interface and implementations to support ModelProfile in conversation and streaming methods.
- Enhanced ClientService to retrieve clients based on ModelProfile.
- Updated CompletionInterceptor to work with ModelProfile instead of ModelCategory.
- Refactored AzureAiClient and other client implementations to handle ModelProfile correctly.
- Changed CachedClient to cache responses based on ModelProfile.
- Updated ModelCategory to a record type for better validation and immutability.
- Enhanced ModelProfile with validation checks for its fields.
- Updated ModelProfileService to support fetching profiles based on ModelCategory.
- Adjusted tests to accommodate changes in Agent and ModelProfile.
- Updated properties files to include category information for model profiles.
2025-10-29 12:07:36 +01:00
extio-de
514dad1c7f feat: Introduce reasoning capabilities in chat and text completion
- Added AbstractCompletionRequest and AbstractCompletionResponse classes to standardize request and response structures.
- Implemented StreamOptions for streaming responses in chat completions.
- Enhanced ChatCompletionClient and TextCompletionClient to support reasoning content in responses.
- Updated ModelProfile to include reasoning effort and summary details.
- Created GptOssPromptStrategy to handle specific prompt formatting and reasoning extraction.
- Modified existing tests to validate reasoning content in completions.
- Updated configuration properties for reasoning settings in local properties files.
2025-10-01 19:05:15 +02:00
extio-de
2350740136 Introduced OpenAI chat completion client; 2025-06-27 23:39:17 +02:00
extio-de
47ef9ba436 Refactored llm clients, removed maxContinuations feature, exposed finishReason instead; 2025-06-27 20:43:04 +02:00
(no author)
3c412077bb lm-lib: Merged with tp fork;
git-svn-id: svn://home0/lm-lib@3723 71dcc7fd-b1f2-4e5d-bb8e-274146e81173
2025-02-23 19:08:49 +00:00
(no author)
f01309526a lm-lib refactoring;
git-svn-id: svn://home0/lm-lib@3610 71dcc7fd-b1f2-4e5d-bb8e-274146e81173
2024-12-18 18:58:27 +00:00