Skip to content

Commit d8f420b

Browse files
authored
use default router for migration replica selection (meta-pytorch#579)
1 parent a074e36 commit d8f420b

File tree

1 file changed

+2
-2
lines changed

1 file changed

+2
-2
lines changed

src/forge/controller/service/service.py

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -285,8 +285,8 @@ async def _migrate_remaining_requests(self, failed_replica: Replica):
285285
return
286286

287287
# Distribute requests among healthy replicas
288-
for i, request in enumerate(migrated_requests):
289-
target_replica = healthy_replicas[i % len(healthy_replicas)]
288+
for request in migrated_requests:
289+
target_replica = self._default_router.get_replica(healthy_replicas)
290290
await target_replica.enqueue_request(request)
291291

292292
# Update session mapping if needed

0 commit comments

Comments
 (0)