github/ollama_proxy_server
1
1
Fork 0
mirror of https://github.com/ParisNeo/ollama_proxy_server.git synced 2026-01-12 01:28:24 -05:00
Code Issues 11 Packages Projects Releases Wiki Activity

Does not see models on secondary server #3

New Issue
Open
opened 2025-07-08 08:36:36 -04:00 by AtHeartEngineer · 0 comments
AtHeartEngineer commented 2025-07-08 08:36:36 -04:00
Owner
Copy Link

Originally created by @dmishra-nxt on 4/22/2025

I have two instances running ollama behind an ollama proxy server. I am using openWebUI as the frontend which is configured with the URL of ollama proxy server. Both Ollama instances have different models. But when I check in openwebui settings, it only lists models on the first instance. How to enable listing models on secondary node as well?

#config.ini

[server0]
url = http://llm-instance-01:11434

[server1]
url = http://llm-instance-02:11434
*Originally created by @dmishra-nxt on 4/22/2025* I have two instances running ollama behind an ollama proxy server. I am using openWebUI as the frontend which is configured with the URL of ollama proxy server. Both Ollama instances have different models. But when I check in openwebui settings, it only lists models on the first instance. How to enable listing models on secondary node as well? ``` #config.ini [server0] url = http://llm-instance-01:11434 [server1] url = http://llm-instance-02:11434
Sign in to join this conversation.
No Branch/Tag Specified
Branches Tags
Labels
Clear labels
dependencies
No Label
Milestone
No items
No Milestone
Projects
Clear projects
No project
Assignees
Clear assignees
AtHeartEngineer
No Assignees
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: github/ollama_proxy_server#3
Delete Branch "%!s()"

Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?