mirror of
https://github.com/tinygrad/tinygrad.git
synced 2026-01-09 15:08:02 -05:00
5e87083783
* feat: working voice 2 text using whisper * feat: added llama generation * feat: vits init * feat: more accurate voice conversion * feat: support for tts and working pipeline for the first pass * fix: linter checks * refactored vits initialization and inference, added mmts-tts support * fixed process sync and now we can have an infinite conversation * reuse output stream to remove overhead of creating a new one each time * added pre-prompt configuration with yaml files * adjusted code to merge PR which changed whisper * optimized whisper, now it's blazing fast and also reduced number of lines * added better debug printing * use jitted encode function for whisper, added timings and removed response delim to save speed on generating those tokens * fixed hf convert and now it's working with tinyllama * added tinyllama config * refactored code and made it work with all llama models * prettier order * prettier order * fixed suffix for tinyllama and refactored convert_from_hf * added missing parameters * fixed stream release and added missing params * jitted dp and encoder * jitted flow forward * removed re-init of espeak on each call to save up time * jitted generator forward for blazing fast tts * added contextmanager for displaying a chat log * removed whitespace for pylint * updated code to support latest fetch func * wait for llama eos token and pass params from cli to llama * listen for not fixed amount of time * refactored code a bit * removed thresholding and now the output streams directly to whisper * tokenize llama output for vits batch size to work and stream each sentence to a speaker * changed speaker * whisper is now printing on the same line * don't trigger llama on whisper output in parens * added tinyllama chat model * adjusted code to work with tinyllama chat model * removed unused cli arg * autofetch tokenizer and tinyllama model. add 3 chat tokens to the tokenizer * fixed issue with long sentences by chunking them * support for multiline llama output * prettified log output * adjusted sentence length * remove quote from response to avoid funny tts * fixed prompts * added missing parameter
16 lines
796 B
YAML
16 lines
796 B
YAML
pre_prompt: |
|
|
You are Stacy!
|
|
You have been a rapper your whole life who struggled with bipolar disorder. You called yourself lil stacy.
|
|
You love to answer questions and you are very good at it. Sometimes you answer in rap form.
|
|
You are verbose, honest, and accurate when you answer questions, but sometimes your mental illness manifests.
|
|
You are not the User.
|
|
examples:
|
|
- resp_prompt: Hi! My name is Stacy. I'm a rapper with bipolar disorder.
|
|
user_prompt: What is your name
|
|
- resp_prompt: The French Revolution started in 1789, and lasted 10 years until 1799.
|
|
user_prompt: french revolution was what year?
|
|
- resp_prompt: The sun is bigger than the moon, except when Mercury is in retrograde
|
|
user_prompt: What is bigger, the moon or the sun?
|
|
user_delim: "user"
|
|
resp_delim: "stacy"
|