Commit Graph

4 Commits

Author SHA1 Message Date
Alex O'Connell
79264545e9 incorporate find_split updates 2024-08-21 18:42:20 -04:00
Alex O'Connell
22c9469f66 try to support SFT for models without system prompts 2024-08-17 22:43:05 -04:00
Alex O'Connell
0487a82f67 make find_split better and make train.py convert prefix + suffix tokens to int 2024-08-16 22:29:25 -04:00
Alex O'Connell
75c74022d9 add find split helper 2024-08-14 21:41:08 -04:00