Commit Graph

27 Commits

Author SHA1 Message Date
extio-de
d0b1eeae75 fix: Update cache key generation to use shortName for ModelCategory 2025-10-29 12:50:33 +01:00
extio-de
304924e223 feat: Enhance agent functionality with ModelProfile integration
- Added ModelProfile to the Agent record to allow for more detailed model configurations.
- Updated AgentExecutorService to utilize ModelProfile when fetching clients.
- Modified BaseAgent interface to include a default modelProfile method.
- Adjusted Client interface and implementations to support ModelProfile in conversation and streaming methods.
- Enhanced ClientService to retrieve clients based on ModelProfile.
- Updated CompletionInterceptor to work with ModelProfile instead of ModelCategory.
- Refactored AzureAiClient and other client implementations to handle ModelProfile correctly.
- Changed CachedClient to cache responses based on ModelProfile.
- Updated ModelCategory to a record type for better validation and immutability.
- Enhanced ModelProfile with validation checks for its fields.
- Updated ModelProfileService to support fetching profiles based on ModelCategory.
- Adjusted tests to accommodate changes in Agent and ModelProfile.
- Updated properties files to include category information for model profiles.
2025-10-29 12:07:36 +01:00
extio-de
11d6d7ce28 refactor: Update README to remove optional dependency on commons-lang3 and increment version to 1.7.1; enhance AzureAiClient with proxy settings and refactor conversation methods; add AnswerGrader class for answer evaluation; improve TextUtils with new methods for string manipulation and regex matching; introduce comprehensive tests for TextUtils functionality. 2025-10-03 21:37:44 +02:00
extio-de
514dad1c7f feat: Introduce reasoning capabilities in chat and text completion
- Added AbstractCompletionRequest and AbstractCompletionResponse classes to standardize request and response structures.
- Implemented StreamOptions for streaming responses in chat completions.
- Enhanced ChatCompletionClient and TextCompletionClient to support reasoning content in responses.
- Updated ModelProfile to include reasoning effort and summary details.
- Created GptOssPromptStrategy to handle specific prompt formatting and reasoning extraction.
- Modified existing tests to validate reasoning content in completions.
- Updated configuration properties for reasoning settings in local properties files.
2025-10-01 19:05:15 +02:00
extio-de
70f7a06da8 refactor: Remove unused import for Value annotation in AzureAiClientAutoConfiguration 2025-07-13 10:34:11 +02:00
extio-de
d0b256502b Use netty client for Azure, remove proxy configuration 2025-07-13 10:33:17 +02:00
extio-de
365043b5a0 Streaming Client 2025-06-28 14:36:26 +02:00
extio-de
2350740136 Introduced OpenAI chat completion client; 2025-06-27 23:39:17 +02:00
extio-de
eee37a5648 Rename oai client package 2025-06-27 21:49:30 +02:00
extio-de
a555d00f74 Get token usage from OpenAI Api if available 2025-06-27 21:19:26 +02:00
extio-de
47ef9ba436 Refactored llm clients, removed maxContinuations feature, exposed finishReason instead; 2025-06-27 20:43:04 +02:00
extio-de
bef3ef1468 Deprecated Client#completion and removed redundant question parameter 2025-06-27 17:35:48 +02:00
extio-de
5b5f56fa15 Combined unnecessary dual prompt template parameters instruction and text to user 2025-06-27 17:17:27 +02:00
extio-de
4e52c1c4ce Code cleanup 2025-06-27 16:59:52 +02:00
extio-de
60bdc54f96 Moved oai client dtos to domain packages 2025-06-27 16:49:37 +02:00
extio-de
11a4ab1271 Moved oai client packages 2025-06-27 16:46:56 +02:00
extio-de
6595075846 Fix AzureAi Auto Config - Port default value 2025-06-27 16:46:29 +02:00
extio-de
94894aee85 Merged with tp lmlib 2025-06-27 16:36:46 +02:00
extio-de
dc455165c8 Agent: skipNextCompletion; Better cache keys; XL category; Fix ModelProfileService concurrency; 2025-06-22 13:28:22 +02:00
(no author)
04cde2558a Merged lm-lib
git-svn-id: svn://home0/lm-lib@3737 71dcc7fd-b1f2-4e5d-bb8e-274146e81173
2025-04-15 17:51:39 +00:00
(no author)
776ab01e85 lm-lib: Merged with tp fork;
git-svn-id: svn://home0/lm-lib@3725 71dcc7fd-b1f2-4e5d-bb8e-274146e81173
2025-02-23 20:22:10 +00:00
(no author)
3c412077bb lm-lib: Merged with tp fork;
git-svn-id: svn://home0/lm-lib@3723 71dcc7fd-b1f2-4e5d-bb8e-274146e81173
2025-02-23 19:08:49 +00:00
(no author)
cb2c1c02da Calculate effective duration and tps;
git-svn-id: svn://home0/lm-lib@3652 71dcc7fd-b1f2-4e5d-bb8e-274146e81173
2024-12-22 12:34:07 +00:00
(no author)
f01309526a lm-lib refactoring;
git-svn-id: svn://home0/lm-lib@3610 71dcc7fd-b1f2-4e5d-bb8e-274146e81173
2024-12-18 18:58:27 +00:00
(no author)
35b59043e1 lm-lib fixes;
git-svn-id: svn://home0/lm-lib@3609 71dcc7fd-b1f2-4e5d-bb8e-274146e81173
2024-12-18 18:39:04 +00:00
(no author)
d3797e4d6d Fixes;
git-svn-id: svn://home0/lm-lib@3605 71dcc7fd-b1f2-4e5d-bb8e-274146e81173
2024-12-16 23:30:01 +00:00
(no author)
c1a283305d lm-lib first commit;
git-svn-id: svn://home0/lm-lib@3603 71dcc7fd-b1f2-4e5d-bb8e-274146e81173
2024-12-16 20:58:04 +00:00