github/home-llm
1
1
Fork 0
mirror of https://github.com/acon96/home-llm.git synced 2026-01-10 06:07:58 -05:00
Code Issues Packages Projects Releases Wiki Activity

fix generation script

Browse Source
This commit is contained in:
Alex O'Connell
2023-12-19 22:14:48 -05:00
parent d429e37378
commit 168acf8fad
2 changed files with 3 additions and 2 deletions
Download Patch File Download Diff File Expand all files Collapse all files

3
.gitignore vendored
View File

@@ -4,4 +4,5 @@ core/
config/
.DS_Store
data/*.json
*.pyc
*.pyc
main.log

2
generate.sh Normal file → Executable file
View File

@@ -9,4 +9,4 @@ if [[ ! -d "./models/$MODEL_NAME" ]]; then
fi
PROMPT=$(cat $PROMPT_SRC)
$LLAMA_CPP/build/bin/main --model "./models/$MODEL_NAME/$MODEL_NAME.$QUANT_TYPE.gguf" --chatml --prompt "$PROMPT"
$LLAMA_CPP/build/bin/main --model "./models/$MODEL_NAME/$MODEL_NAME.$QUANT_TYPE.gguf" --temp 0.1 --ctx-size 2048 --prompt "$PROMPT" # --chatml