More verbose errors/logs? #14

New Issue

AtHeartEngineer · 2025-07-08T08:36:44-04:00

AtHeartEngineer commented

2025-07-08 08:36:44 -04:00

Originally created by @MarcoMeter on 7/23/2024

Hi! Thanks for making this available!

I'm currently debugging this issue: curl: (52) Empty reply from server, which is the response from running the example:
curl -X POST -H "Authorization: Bearer user1:key1" http://my_hostname:8080/api/generate --data '{'model':'gemma2,'prompt': "Once apon a time,","stream":false,"temperature": 0.3,"max_tokens": 1024}'

This is what's logged by the ollama-proxy-server:

[23/Jul/2024 16:47:19] "POST /api/generate HTTP/1.1" - -

When checking the logs of the ollama container, there is no incoming traffic.
Originally, I had this working and then it stopped working. Sometimes it only worked from the same server and not from any other machine on WAN. So I fiddled around with binding the ip addresses of the ollama container and adapting the proxy's config.ini.

How could I get a more expressive log of the ollama-proxy-server to get more information to debug this?

*Originally created by @MarcoMeter on 7/23/2024* Hi! Thanks for making this available! I'm currently debugging this issue: `curl: (52) Empty reply from server`, which is the response from running the example: `curl -X POST -H "Authorization: Bearer user1:key1" http://my_hostname:8080/api/generate --data '{'model':'gemma2,'prompt': "Once apon a time,","stream":false,"temperature": 0.3,"max_tokens": 1024}'` This is what's logged by the ollama-proxy-server: `[23/Jul/2024 16:47:19] "POST /api/generate HTTP/1.1" - -` When checking the logs of the ollama container, there is no incoming traffic. Originally, I had this working and then it stopped working. Sometimes it only worked from the same server and not from any other machine on WAN. So I fiddled around with binding the ip addresses of the ollama container and adapting the proxy's config.ini. How could I get a more expressive log of the ollama-proxy-server to get more information to debug this?

AtHeartEngineer closed this issue

2025-07-08 08:36:44 -04:00

Sign in to join this conversation.

1 Participants

Notifications

Due Date

No due date set.

Dependencies

No dependencies set.

Reference: github/ollama_proxy_server#14