Commit Graph

40 Commits

Author SHA1 Message Date
extio-de
f753a7bdd7 chore: Bump version to 2.5.2 in pom.xml and remove redundant response validation in ChatCompletionClient 2026-03-23 22:50:36 +01:00
extio-de
dce82a98cd feat: Enhance chat completion with tool calling capabilities
- Added support for tools in ChatCompletionRequest, including tool choice and parallel tool calls.
- Introduced ChatCompletionTool and ChatCompletionFunction classes to define tool specifications.
- Updated ChatMessage to include tool calls and tool call IDs.
- Created ChatToolCall and ChatToolFunction classes for managing tool call details.
- Modified TextCompletionClient to support tool calling.
- Updated Grader and Grader2 classes to handle new tool-related logic.
- Enhanced Agent and AgentTest classes to incorporate tool calling in agent workflows.
- Added tests for tool calling functionality in CachedClientTest and CompletionClientTest.
2026-03-22 18:09:10 +01:00
extio-de
117eeabc9c fix: Ensure thread-safe access to conversation list in getConversation method 2026-03-14 21:16:56 +01:00
extio-de
1e5adefd13 feat: Implement skipCache functionality across conversation handling 2026-03-14 14:27:39 +01:00
extio-de
d5898e35f5 feat: Add Spring Boot auto-configuration for lm-lib modules
- Introduced auto-configuration classes for profile, client, agent, and prompt modules.
- Updated README to reflect new modular architecture and configuration properties.
- Added selective enabling/disabling of modules via application properties.
- Refactored existing services and strategies to remove unnecessary Spring annotations.
- Enhanced test configurations to utilize auto-configuration.
- Updated META-INF imports to include new auto-configuration classes.
2026-01-05 21:58:12 +01:00
extio-de
4ebb8640c7 Version 2.0
Java 25, Spring Boot 4, Use RestClient with JDK client backend
2025-12-19 17:58:56 +01:00
extio-de
4c0c30974e refactor: Remove Azure AI client implementation and related configuration 2025-12-19 11:45:33 +01:00
extio-de
d2f5c46847 Convert spaces to tabs 2025-12-13 15:26:38 +01:00
extio-de
b7c1e90dc7 feat: Update model profile and statistics tracking
- Updated model profile to support new cost parameters: costPerCachedInToken and costPerReasoningOutToken.
- Enhanced AgentRequestStatistic to track cached input tokens and reasoning output tokens.
- Modified CompletionStatistics to include cached input tokens and reasoning output tokens.
- Updated AzureAiClient, CachedClient, and other clients to handle new statistics fields.
- Introduced Timings class to capture detailed timing metrics for requests.
- Adjusted Usage class to include input and output token details.
- Updated properties files to include new cost parameters for cached and reasoning tokens.
2025-11-30 18:19:01 +01:00
extio-de
a6087a0613 bump version to 1.8.8 in pom.xml and update CompletionInterceptor interface to include conversation parameter in after method 2025-11-30 15:14:34 +01:00
extio-de
01dbd5c4db bump version to 1.8.7 in pom.xml and add rewindTurn method to Conversation class 2025-11-23 21:52:23 +01:00
extio-de
bd37a143f6 refactor: Update ModelProfile to use costPerInToken and costPerOutToken for better clarity and accuracy 2025-10-31 16:15:37 +01:00
extio-de
179755df45 refactor: Simplify model name loading and update ModelNameSupplier to use ModelProfile 2025-10-29 13:02:14 +01:00
extio-de
d0b1eeae75 fix: Update cache key generation to use shortName for ModelCategory 2025-10-29 12:50:33 +01:00
extio-de
304924e223 feat: Enhance agent functionality with ModelProfile integration
- Added ModelProfile to the Agent record to allow for more detailed model configurations.
- Updated AgentExecutorService to utilize ModelProfile when fetching clients.
- Modified BaseAgent interface to include a default modelProfile method.
- Adjusted Client interface and implementations to support ModelProfile in conversation and streaming methods.
- Enhanced ClientService to retrieve clients based on ModelProfile.
- Updated CompletionInterceptor to work with ModelProfile instead of ModelCategory.
- Refactored AzureAiClient and other client implementations to handle ModelProfile correctly.
- Changed CachedClient to cache responses based on ModelProfile.
- Updated ModelCategory to a record type for better validation and immutability.
- Enhanced ModelProfile with validation checks for its fields.
- Updated ModelProfileService to support fetching profiles based on ModelCategory.
- Adjusted tests to accommodate changes in Agent and ModelProfile.
- Updated properties files to include category information for model profiles.
2025-10-29 12:07:36 +01:00
extio-de
11d6d7ce28 refactor: Update README to remove optional dependency on commons-lang3 and increment version to 1.7.1; enhance AzureAiClient with proxy settings and refactor conversation methods; add AnswerGrader class for answer evaluation; improve TextUtils with new methods for string manipulation and regex matching; introduce comprehensive tests for TextUtils functionality. 2025-10-03 21:37:44 +02:00
extio-de
514dad1c7f feat: Introduce reasoning capabilities in chat and text completion
- Added AbstractCompletionRequest and AbstractCompletionResponse classes to standardize request and response structures.
- Implemented StreamOptions for streaming responses in chat completions.
- Enhanced ChatCompletionClient and TextCompletionClient to support reasoning content in responses.
- Updated ModelProfile to include reasoning effort and summary details.
- Created GptOssPromptStrategy to handle specific prompt formatting and reasoning extraction.
- Modified existing tests to validate reasoning content in completions.
- Updated configuration properties for reasoning settings in local properties files.
2025-10-01 19:05:15 +02:00
extio-de
70f7a06da8 refactor: Remove unused import for Value annotation in AzureAiClientAutoConfiguration 2025-07-13 10:34:11 +02:00
extio-de
d0b256502b Use netty client for Azure, remove proxy configuration 2025-07-13 10:33:17 +02:00
extio-de
365043b5a0 Streaming Client 2025-06-28 14:36:26 +02:00
extio-de
2350740136 Introduced OpenAI chat completion client; 2025-06-27 23:39:17 +02:00
extio-de
eee37a5648 Rename oai client package 2025-06-27 21:49:30 +02:00
extio-de
a555d00f74 Get token usage from OpenAI Api if available 2025-06-27 21:19:26 +02:00
extio-de
47ef9ba436 Refactored llm clients, removed maxContinuations feature, exposed finishReason instead; 2025-06-27 20:43:04 +02:00
extio-de
bef3ef1468 Deprecated Client#completion and removed redundant question parameter 2025-06-27 17:35:48 +02:00
extio-de
5b5f56fa15 Combined unnecessary dual prompt template parameters instruction and text to user 2025-06-27 17:17:27 +02:00
extio-de
4e52c1c4ce Code cleanup 2025-06-27 16:59:52 +02:00
extio-de
60bdc54f96 Moved oai client dtos to domain packages 2025-06-27 16:49:37 +02:00
extio-de
11a4ab1271 Moved oai client packages 2025-06-27 16:46:56 +02:00
extio-de
6595075846 Fix AzureAi Auto Config - Port default value 2025-06-27 16:46:29 +02:00
extio-de
94894aee85 Merged with tp lmlib 2025-06-27 16:36:46 +02:00
extio-de
dc455165c8 Agent: skipNextCompletion; Better cache keys; XL category; Fix ModelProfileService concurrency; 2025-06-22 13:28:22 +02:00
(no author)
04cde2558a Merged lm-lib
git-svn-id: svn://home0/lm-lib@3737 71dcc7fd-b1f2-4e5d-bb8e-274146e81173
2025-04-15 17:51:39 +00:00
(no author)
776ab01e85 lm-lib: Merged with tp fork;
git-svn-id: svn://home0/lm-lib@3725 71dcc7fd-b1f2-4e5d-bb8e-274146e81173
2025-02-23 20:22:10 +00:00
(no author)
3c412077bb lm-lib: Merged with tp fork;
git-svn-id: svn://home0/lm-lib@3723 71dcc7fd-b1f2-4e5d-bb8e-274146e81173
2025-02-23 19:08:49 +00:00
(no author)
cb2c1c02da Calculate effective duration and tps;
git-svn-id: svn://home0/lm-lib@3652 71dcc7fd-b1f2-4e5d-bb8e-274146e81173
2024-12-22 12:34:07 +00:00
(no author)
f01309526a lm-lib refactoring;
git-svn-id: svn://home0/lm-lib@3610 71dcc7fd-b1f2-4e5d-bb8e-274146e81173
2024-12-18 18:58:27 +00:00
(no author)
35b59043e1 lm-lib fixes;
git-svn-id: svn://home0/lm-lib@3609 71dcc7fd-b1f2-4e5d-bb8e-274146e81173
2024-12-18 18:39:04 +00:00
(no author)
d3797e4d6d Fixes;
git-svn-id: svn://home0/lm-lib@3605 71dcc7fd-b1f2-4e5d-bb8e-274146e81173
2024-12-16 23:30:01 +00:00
(no author)
c1a283305d lm-lib first commit;
git-svn-id: svn://home0/lm-lib@3603 71dcc7fd-b1f2-4e5d-bb8e-274146e81173
2024-12-16 20:58:04 +00:00