From b10ede765e87c94dedfb87b08481bffdefce226a Mon Sep 17 00:00:00 2001 From: Alex O'Connell Date: Wed, 5 Jun 2024 23:37:05 -0400 Subject: [PATCH] update readme and todo --- README.md | 2 ++ TODO.md | 13 +++++++------ 2 files changed, 9 insertions(+), 6 deletions(-) diff --git a/README.md b/README.md index 1c76757..e5cdc0d 100644 --- a/README.md +++ b/README.md @@ -1,6 +1,8 @@ # Home LLM This project provides the required "glue" components to control your Home Assistant installation with a **completely local** Large Language Model acting as a personal assistant. The goal is to provide a drop in solution to be used as a "conversation agent" component by Home Assistant. The 2 main pieces of this solution are the Home LLM model and Local LLM Conversation integration. +NOTE: This integration has **NOT** been updated yet to support the new LLM API changes in Home Assistant `2024.6.0`. + ## Quick Start Please see the [Setup Guide](./docs/Setup.md) for more information on installation. diff --git a/TODO.md b/TODO.md index 482c6a7..555bd9e 100644 --- a/TODO.md +++ b/TODO.md @@ -3,16 +3,14 @@ - rewrite how services are called - handle no API selected - rewrite prompts + service block formats + - implement new LLM API that has `HassCallService` so old models can still work - update dataset so new models will work with the API - [ ] make ICL examples into conversation turns - [ ] translate ICL examples + make better ones - [ ] areas/room support -- [ ] convert requests to aiohttp -- [x] detection/mitigation of too many entities being exposed & blowing out the context length -- [ ] figure out DPO to improve response quality -- [ ] train the model to respond to house events - - present the model with an event + a "prompt" from the user of what you want it to do (i.e. turn on the lights when I get home = the model turns on lights when your entity presence triggers as being home) - - basically lets you write automations in plain english +- [ ] convert requests to aiohttp +- [x] detection/mitigation of too many entities being exposed & blowing out the context length +- [ ] figure out DPO to improve response quality - [x] setup github actions to build wheels that are optimized for RPIs - [x] mixtral + prompting (no fine tuning) - add in context learning variables to sys prompt template @@ -53,3 +51,6 @@ - set up vectordb - ingest home assistant docs - "context request" from above to initiate a RAG search +- [ ] train the model to respond to house events + - present the model with an event + a "prompt" from the user of what you want it to do (i.e. turn on the lights when I get home = the model turns on lights when your entity presence triggers as being home) + - basically lets you write automations in plain english \ No newline at end of file