How to install with CUDA 12.2 ?

[tresorama]

I'm in Google Colab, trying to run ComfyUI
CUDA: 12.2

This is my ComfyUI installation process (created by merging the example Jupyter book in the ComfyUi home page and the installation instruction for Linux+Nvidia of Comfy )

# install machine deps
!apt update && apt upgrade
!apt install -y wget git python3 python3-venv libgl1 libglib2.0-0

# show python version
!python --version # 3.10.12
!python3 --version # 3.10.12

# clone comfy
!git clone http....

# install comfy python deps
!pip install xformers!=0.0.18 torch torchvision torchaudio -r requirements.txt --extra-index-url https://download.pytorch.org/whl/cu124 --extra-index-url https://download.pytorch.org/whl/cu121 --extra-index-url https://download.pytorch.org/whl/cu118 --extra-index-url https://download.pytorch.org/whl/cu117

I checked and these are my python packages installed

torch          2.5.1+cu121
torchaudio     2.5.1+cu121
torchsummary   1.5.1
torchvision    0.20.1+cu121
xformers       0.0.29.post1

Now when i run comfy I get this xformers error

pytorch version: 2.5.1+cu121
WARNING[XFORMERS]: xFormers can't load C++/CUDA extensions. xFormers was built for:
    PyTorch 2.5.1+cu118 with CUDA 1108 (you have 2.5.1+cu121)
    Python  3.10.16 (you have 3.10.12)
  Please reinstall xformers (see https://github.com/facebookresearch/xformers#installing-xformers)
  Memory-efficient attention, SwiGLU, sparse and more won't be available.
  Set XFORMERS_MORE_DETAILS=1 for more details

I'm new to this, so my assumption is that xformers wants pytorch2.5.1+cu118, but my machine has installed 2.5.1+cu121.

My CUDA version is 12.2. So my guesses are the following:

• because cuda is 12.2 I need pytorch2.5.1+cu122. But in the Installing Docs of this repo i cannot find a version for cuda 12.2 (only 12.1 or 12.4)

# [linux only] cuda 11.8 version
pip3 install -U xformers --index-url https://download.pytorch.org/whl/cu118
# [linux only] cuda 12.1 version
pip3 install -U xformers --index-url https://download.pytorch.org/whl/cu121
# [linux & win] cuda 12.4 version
pip3 install -U xformers --index-url https://download.pytorch.org/whl/cu124

• or use pytorch2.5.1+cu118, but i don't know if this can cause problem with cuda
  Someone can help me ?

[lw]

xFormers only supports the same versions of CUDA that PyTorch supports. As you can see in your logs, your version of PyTorch is 2.5.1+cu121, hence uses CUDA 12.1. You should use that same version when installing xFormers.