github/tinygrad
1
1
Fork 0
mirror of https://github.com/tinygrad/tinygrad.git synced 2026-04-29 03:00:14 -04:00
Code Issues Packages Projects Releases Wiki Activity

do not realize when sharding model weights

Browse Source
This commit is contained in:
Francis Lata
2025-01-21 13:45:35 -08:00
parent 7f331d8836
commit d1bc4aef94
1 changed files with 1 additions and 1 deletions
Download Patch File Download Diff File Expand all files Collapse all files

2
examples/mlperf/model_train.py
View File

@@ -433,7 +433,7 @@ def train_retinanet():
model = RetinaNet(backbone, num_classes=NUM_CLASSES)
params = get_parameters(model)
for p in params: p.realize().to_(GPUS)
for p in params: p.to_(GPUS)
# ** optimizer **
optim = Adam(params, lr=lr)