Skip to content

Commit 14be342

Browse files
committed
update custom parallel plan doc
Signed-off-by: Yuki Huang <[email protected]>
1 parent 85b1726 commit 14be342

File tree

1 file changed

+2
-2
lines changed

1 file changed

+2
-2
lines changed

docs/design-docs/fsdp2-parallel-plan.md

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -20,11 +20,11 @@ The Hugging Face tensor parallel plan is the default. It's available for most mo
2020

2121
## Custom Parallel Plan Example
2222

23-
A custom parallel plan should be defined in a separate file, such as the example provided in `examples/custom_parallel.py`.
23+
A custom parallel plan should be defined in a separate file, such as the example provided in `examples/custom_parallel/custom_parallel.py`.
2424

2525
To implement the custom parallel plan, either update the value of `custom_parallel_plan` in the `yaml` file directly, or pass the override via the command line. For example:
2626

2727
```bash
2828
uv run examples/run_grpo_math.py \
29-
policy.dtensor_cfg.custom_parallel_plan=examples.custom_parallel.custom_parallel_plan
29+
policy.dtensor_cfg.custom_parallel_plan=examples.custom_parallel.custom_parallel.custom_parallel_plan
3030
```

0 commit comments

Comments
 (0)