start re-working training to use axlotl instead of the custom script

This commit is contained in:
Alex O'Connell
2025-11-30 22:29:08 -05:00
parent 04a5909214
commit 55f254149a
14 changed files with 280 additions and 1309 deletions

View File

@@ -6,7 +6,7 @@
- [ ] vision support for local backend (llama.cpp + llava)
- [ ] move llamacpp to a separate process because of all the crashing
- [ ] optional sampling parameters in options panel (don't pass to backend if not set)
- [ ] update dataset so new models will work with the Assist API
- [x] update dataset so new models will work with the Assist API
- [ ] make ICL examples into conversation turns
- [ ] translate ICL examples + make better ones
- [ ] figure out DPO to improve response quality