[Bug] Streaming doesn't work #22

Open
opened 2025-07-08 08:36:51 -04:00 by AtHeartEngineer · 0 comments

Originally created by @short-circuit on 2/29/2024

Using this proxy with continuedev does not stream the responses.
The server answers correctly but the response is only output once the generation is totally complete

*Originally created by @short-circuit on 2/29/2024* Using this proxy with continuedev does not stream the responses. The server answers correctly but the response is only output once the generation is totally complete
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: github/ollama_proxy_server#22