Skip to content

Commit d31f7d0

Browse files
committed
fix, test=document_fix
1 parent 2adc9ec commit d31f7d0

File tree

1 file changed

+3
-3
lines changed

1 file changed

+3
-3
lines changed

paddle/fluid/framework/ir/graph_helper.cc

Lines changed: 3 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -547,12 +547,12 @@ void ReplaceAllReduceOp(const Node &node,
547547
// ### v1 = op1(grad1)
548548
// It is converted to:
549549
// ### fused_grad = check_memory_continue(grad0, grad1, grad2, ...)
550-
// ### fused_grad = c_sum_allreduce(fused_grad)
550+
// ### fused_grad = all_reduce(fused_grad)
551551
// ### v0 = op0(grad0)
552552
// ### v1 = op1(grad1)
553553
// We should add the following dependency to ensure that op0 and op1 both run
554-
// after c_sum_allreduce:
555-
// ### grad0 = depend(grad0, fused_grad)
554+
// after all_reduce(sum):
555+
// ### grad0 = depend(grad0, fused_grad)
556556
// ### grad1 = depend(grad1, fused_grad)
557557
if (is_fused) {
558558
for (const auto &in : in_var_handles) {

0 commit comments

Comments
 (0)