Skip to content

[feat][train] Enable new inference codepath by default#1480

Draft
SumanthRH wants to merge 3 commits intogpu-ci-migrationfrom
switch-to-new-inference
Draft

[feat][train] Enable new inference codepath by default#1480
SumanthRH wants to merge 3 commits intogpu-ci-migrationfrom
switch-to-new-inference

Conversation

@SumanthRH
Copy link
Copy Markdown
Member

What does this PR do?

  • Flip _SKYRL_USE_NEW_INFERENCE default from "0" to "1" so the new RemoteInferenceClient HTTP-based inference layer is active unless explicitly opted out.
  • Update conftest.py to import the flag from skyrl.env_vars instead of re-reading os.environ with a stale default, and update the docstring to reflect the new default.

SumanthRH and others added 3 commits April 8, 2026 21:22
Flip _SKYRL_USE_NEW_INFERENCE default from "0" to "1" so the new
RemoteInferenceClient HTTP-based inference layer is active unless
explicitly opted out. Update conftest.py to import the flag from
skyrl.env_vars instead of re-reading os.environ with a stale default,
and update the docstring to reflect the new default.

Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
…erence default

Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant