github/autogen
1
1
Fork 0
mirror of https://github.com/microsoft/autogen.git synced 2026-02-10 17:15:16 -05:00
Code Issues Packages Projects Releases Wiki Activity

Update index.mdx (#696)

Browse Source
This commit is contained in:
Haotian Zheng
2023-11-16 23:02:25 +08:00
committed by GitHub
parent a730a63e30
commit 4e3723dd54
1 changed files with 1 additions and 1 deletions
Download Patch File Download Diff File Expand all files Collapse all files

2
website/blog/2023-07-14-Local-LLMs/index.mdx
View File

@@ -47,7 +47,7 @@ Finally, launch the RESTful API server
python -m fastchat.serve.openai_api_server --host localhost --port 8000
```
Normally this will work. However, if you encounter error like [this](https://github.com/lm-sys/FastChat/issues/1641), commenting out all the lines containing `finish_reason` in `fastchat/protocol/api_protocal.py` and `fastchat/protocol/openai_api_protocol.py` will fix the problem. The modified code looks like:
Normally this will work. However, if you encounter error like [this](https://github.com/lm-sys/FastChat/issues/1641), commenting out all the lines containing `finish_reason` in `fastchat/protocol/api_protocol.py` and `fastchat/protocol/openai_api_protocol.py` will fix the problem. The modified code looks like:
```python
class CompletionResponseChoice(BaseModel):