github/home-llm
1
1
Fork 0
mirror of https://github.com/acon96/home-llm.git synced 2026-01-08 21:28:05 -05:00
Code Issues Packages Projects Releases Wiki Activity

Merge branch 'develop' into feature/dataset-customization

Browse Source
This commit is contained in:
Alex O'Connell
2024-02-13 20:23:25 -05:00
parent 411276408b 73c2934e20
commit 4e873a873c
17 changed files with 67 additions and 30 deletions
Download Patch File Download Diff File Expand all files Collapse all files

2
docs/Backend Configuration.md
View File

@@ -11,6 +11,8 @@ There are multiple backends to choose for running the model that the Home Assist
| Additional attribute to expose in the context | Extra attributes that will be exposed to the model via the `{{ devices }}` template variable | |
| Service Call Regex | The regular expression used to extract service calls from the model response; should contain 1 repeated capture group | |
| Refresh System Prompt Every Turn | Flag to update the system prompt with updated device states on every chat turn. Disabling can significantly improve agent response times when using a backend that supports prefix caching (Llama.cpp) | Enabled |
| Remember conversation | Flag to remember the conversation history (excluding system prompt) in the model context. | Enabled |
| Number of past interactions to remember | If `Remember conversation` is enabled, number of user-assistant interaction pairs to keep in history. | |
# Llama.cpp
For details about the sampling parameters, see here: https://github.com/oobabooga/text-generation-webui/wiki/03-%E2%80%90-Parameters-Tab#parameters-description

4
docs/Model Prompting.md
View File

@@ -5,7 +5,7 @@ This integration allows for full customization of the system prompt using Home A
## System Prompt Template
The default system prompt is:
```
You are 'Al', a helpful AI Assistant that controls the devices in a house. Complete the following task ask instructed with the information provided only.
You are 'Al', a helpful AI Assistant that controls the devices in a house. Complete the following task as instructed with the information provided only.
Services: {{ services }}
Devices:
{{ devices }}
@@ -23,4 +23,4 @@ Currently supported prompt formats are:
2. Vicuna
3. Alpaca
4. Mistral
5. None (useful for foundation models)
5. None (useful for foundation models)