Skip to content

Conversation

@chtruong814
Copy link
Contributor

@chtruong814 chtruong814 commented Oct 31, 2025

What does this PR do ?

Ensure automodel has deepep and TE

Tested with these steps:

  • Start with RL nightly container
  • Checkout this branch
  • source /opt/nemo_rl_venv/bin/activate
  • uv sync --link-mode symlink --locked --extra automodel
  • hf download moonshotai/Moonlight-16B-A3B
  • cd 3rdparty/Automodel-workspace/Automodel/
  • torchrun --nproc-per-node 8 examples/llm_finetune/finetune.py --config examples/llm_finetune/moonlight/moonlight_16b_te.yaml --model.backend.enable_deepep True

Issues

List issues that this PR closes (syntax):

Usage

  • You can potentially add a usage example below
# Add a code snippet demonstrating how to use this

Before your PR is "Ready for review"

Pre checks:

  • Make sure you read and followed Contributor guidelines
  • Did you write any new necessary tests?
  • Did you run the unit tests and functional tests locally? Visit our Testing Guide for how to run tests
  • Did you add or update any necessary documentation? Visit our Document Development Guide for how to write, build and test the docs.

Additional Information

  • ...

@chtruong814 chtruong814 requested a review from a team as a code owner October 31, 2025 22:42
@chtruong814 chtruong814 requested review from adil-a and hemildesai and removed request for a team October 31, 2025 22:42
@chtruong814 chtruong814 changed the title Ensure automodel has deepep and TE build: Ensure automodel has deepep and TE Oct 31, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants