Skip to content

Conversation

@EmilienM
Copy link

Purpose

We were installing a non-released version of xformers for CUDA:
0.0.33+5d4b92a5.d20251029

5d4b92a5 is actually the commit for 0.0.32.post2 tag, so this PR just
replace the version so it's cleaner and we now consumed a stable tag
(which by the way is the latest).

We were installing a non-released version of xformers for CUDA:
0.0.33+5d4b92a5.d20251029

5d4b92a5 is actually the commit for 0.0.32.post2 tag, so this PR just
replace the version so it's cleaner and we now consumed a stable tag
(which by the way is the latest).

Signed-off-by: Emilien Macchi <[email protected]>
Copy link
Contributor

@gemini-code-assist gemini-code-assist bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Code Review

This pull request updates the xformers dependency from a development version to the stable 0.0.32.post2 tag. This is a good practice as it improves dependency stability and reproducibility. Based on the description, the commit hash used for the previous development version corresponds to this new stable tag, so this change should be functionally equivalent and is primarily for clarity and correctness in dependency management. The change is sound and I have no issues to report.

Copy link
Collaborator

@NickLucche NickLucche left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I think the plan it's actually to get rid of xformers cc @ywang96.
I stil couldn't find a torch2.9 built wheel with this PR (though I suppose this wasn't the intent):

VLLM_USE_PRECOMPILED=1 uv pip install -e  .
  × No solution found when resolving dependencies:
  ╰─▶ Because xformers==0.0.32.post2 depends on torch==2.8.0 and vllm==0.11.1rc7.dev72+g074b03cb5.precompiled depends on torch==2.9.0, we..

@mgoin
Copy link
Member

mgoin commented Nov 12, 2025

I thought we still have to have a torch 2.9 compatible wheel at least for the release - what is the status of that?

@EmilienM
Copy link
Author

https://github.com/facebookresearch/xformers/releases/tag/v0.0.33 came out, I wonder if you're going to use that in v0.11.1 or get rid of xformers at all.
I'm not sure how we were able to build torch 2.9 + xformers 0.0.32.post2 + vllm 0.11.1rc6 successfully, but I can tell we did.

@huydhn
Copy link
Contributor

huydhn commented Nov 12, 2025

This version won't work because it's built with PyTorch 2.8. That's the reason why we have a custom xformers wheel hosted on PyTorch side built with PyTorch 2.9. xformers team has finally published 0.0.33 today built for PyTorch 2.9, and we should use that version instead, #28600 or reuse this PR.

@EmilienM
Copy link
Author

I'll close my PR in favor of #28600

@EmilienM EmilienM closed this Nov 13, 2025
@github-project-automation github-project-automation bot moved this to Done in NVIDIA Nov 13, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

Status: Done

Development

Successfully merging this pull request may close these issues.

5 participants