Skip to content

Commit 6cc8caa

Browse files
committed
restore comment
1 parent da611e4 commit 6cc8caa

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

torchtitan/train.py

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -244,7 +244,7 @@ def __init__(self, job_config: JobConfig):
244244
# confirm that user will be able to view loss metrics on the console
245245
ensure_pp_loss_visible(parallel_dims, job_config, color)
246246
else:
247-
# apply Autoparallel
247+
# apply PT-D Tensor Parallel, activation checkpointing, torch.compile, Data Parallel
248248
model = self.train_spec.parallelize_fn(model, parallel_dims, job_config)
249249

250250
model.to_empty(device=init_device)

0 commit comments

Comments
 (0)