start working on dpo trainer + add s3 upload callback

This commit is contained in:
Alex O'Connell
2024-04-15 17:39:41 -04:00
committed by Alex O'Connell
parent aaa3ac0cf8
commit 90ca37c6ed
4 changed files with 308 additions and 227 deletions

1
.gitignore vendored
View File

@@ -10,3 +10,4 @@ main.log
.venv
*.xlsx
notes.txt
runpod_bootstrap.sh