Kate Silverstein 62c420e26f feat(forge/llm): Add LlamafileProvider (#7091) ...

* Add minimal implementation of `LlamafileProvider`, a new `ChatModelProvider` for llamafiles. It extends `BaseOpenAIProvider` and only overrides methods that are necessary to get the system to work at a basic level.

* Add support for `mistral-7b-instruct-v0.2`. This is the only model currently supported by `LlamafileProvider` because this is the only model I tested anything with.

* Add instructions to use AutoGPT with llamafile in the docs at `autogpt/setup/index.md`
* Add helper script to get it running quickly at `scripts/llamafile/serve.py`

---------

Co-authored-by: Reinier van der Leer <pwuts@agpt.co>

2024-07-17 15:56:55 +02:00

..

_javascript

Fix CI/CD for Auto-GPT + docs site deployment

2023-09-06 17:33:08 +02:00

content

feat(forge/llm): Add LlamafileProvider (#7091)

2024-07-17 15:56:55 +02:00

overrides

Restructuring The Docs (#5441)

2023-11-15 18:54:29 +01:00

favicon.png

Fix docs deployment: Electric Boogaloo

2023-09-06 17:42:07 +02:00

mkdocs.yml

tweak(docs): Replace all instances of "Node" with "Block". (#7416)

2024-07-13 22:04:24 +01:00

netlify.toml

ci(docs): Fix Netlify build ignore check

2024-03-20 11:49:41 +01:00

requirements.txt

Fix docs deployment

2023-09-06 17:36:51 +02:00