github/home-llm
1
1
Fork 0
mirror of https://github.com/acon96/home-llm.git synced 2026-01-09 21:58:00 -05:00
Code Issues Packages Projects Releases Wiki Activity

update x86 wheel

Browse Source
This commit is contained in:
Alex O'Connell
2024-01-06 18:14:51 -05:00
parent 46042ad99e
commit 35e609108c
6 changed files with 27 additions and 8 deletions
Download Patch File Download Diff File Expand all files Collapse all files

3
TODO.md
View File

@@ -21,4 +21,5 @@
- "context request" from above to initiate a RAG search
[x] make llama-cpp-python wheels for "llama-cpp-python>=0.2.24"
[ ] prime kv cache with current "state" so that requests are faster
[ ] make a proper evaluation framework to run. not just loss. should test accuracy on the function calling
[ ] make a proper evaluation framework to run. not just loss. should test accuracy on the function calling
[ ] add LocalAI backend