feat: Implement OpenRouter model discovery and endpoints
- Added OpenRouterModelDiscovery class for managing model listings and metadata resolution. - Introduced OpenRouterModelEndpointsResponse and OpenRouterModelsResponse classes for handling API responses. - Created OpenRouterModelQuery class to encapsulate query parameters for model listing. - Updated ModelProfile to include OPENROUTER as a model provider. - Enhanced ModelProfileService to handle default values for maxTokens and maxContextLength. - Added OpenRouterClientTest for testing model discovery and chat completion functionalities. - Configured application-test.properties and local-openrouter-chatcompletion.properties for OpenRouter integration.
This commit is contained in:
@@ -7,6 +7,7 @@ profile.model.cold=local-chatcompletion
|
||||
profile.model.textcompletion=local-completion
|
||||
profile.model.chatcompletion=local-chatcompletion
|
||||
profile.model.ollama=local-ollama-chatcompletion
|
||||
profile.model.openrouter=local-openrouter-chatcompletion
|
||||
#profile.model.azure=llama3.3-70b-azure
|
||||
|
||||
agent.threads=2
|
||||
|
||||
@@ -0,0 +1,16 @@
|
||||
category=OPENROUTER
|
||||
prompts=
|
||||
tokenizer=fallback
|
||||
tokenEncoding=cl100k_base
|
||||
maxTokens=2500
|
||||
maxContextLength=32768
|
||||
temperature=0.5
|
||||
topP=0.95
|
||||
modelProvider=OPENROUTER
|
||||
modelName=
|
||||
url=
|
||||
apiKey=${OPENROUTER_API_KEY:}
|
||||
cost1MInTokens=0
|
||||
cost1MCachedInTokens=0
|
||||
cost1MOutTokens=0
|
||||
cost1MReasoningOutTokens=0
|
||||
Reference in New Issue
Block a user