github/tinygrad
1
1
Fork 0
mirror of https://github.com/tinygrad/tinygrad.git synced 2026-04-29 03:00:14 -04:00
Code Issues Packages Projects Releases Wiki Activity

dropout after eval step (#4351)

Browse Source
This commit is contained in:
Elias Wahl
2024-04-29 21:47:21 +02:00
committed by GitHub
parent 27613dd881
commit 71ff68b445
1 changed files with 1 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

1
examples/mlperf/model_train.py
View File

@@ -460,6 +460,7 @@ def train_bert():
eval_times.append(et - st)
eval_step.reset()
Tensor.training = True
total_lm_loss = sum(pair[0] for pair in eval_loss) / len(eval_loss)
total_clsf_loss = sum(pair[1] for pair in eval_loss) / len(eval_loss)
total_lm_accuracy = sum(pair[0] for pair in eval_accuracy) / len(eval_accuracy)