Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[WIP] Using pyproject.toml to install different versions of torch #588

Open
wants to merge 2 commits into
base: main
Choose a base branch
from
Open

[WIP] Using pyproject.toml to install different versions of torch #588

wants to merge 2 commits into from

Conversation

SamuelLarkin
Copy link
Collaborator

@SamuelLarkin SamuelLarkin commented Nov 19, 2024 •
edited
Loading

PR Goal?

Have a unified way of installing EveryVoice by using exclusively pyproject.toml and removing requirements.torch.txt.

Fixes?

Feedback sought?

NONE FOR NOW

Priority?

low

Tests added?

How to test?

Confidence?

Version change?

Related PRs?

@semanticdiff-com SemanticDiff.com
Copy link

Review changes with  SemanticDiff

@SamuelLarkin
Copy link
Collaborator Author

SamuelLarkin commented Nov 19, 2024 •
edited
Loading

Reference Installation Logs from dbc2282

grep torch log.make-everyvoice-env.dbc2282a3 | grep -v 'from torch==2.1.0'

Please make sure the CUDA version installed on your system matches CUDA_VERSION=11.8.
Creating EveryVoice conda environment called "EveryVoice" for CUDA 11.8 using Python 3.10.
...
  libopenvino-pytor~ conda-forge/linux-64::libopenvino-pytorch-frontend-2024.4.0-h5888daf_2
$ pip install lit --find-links https://download.pytorch.org/whl/torch_stable.html
Looking in links: https://download.pytorch.org/whl/torch_stable.html
$ CUDA_TAG=cu118 pip install -r requirements.torch.txt --find-links https://download.pytorch.org/whl/torch_stable.html
Looking in links: https://download.pytorch.org/whl/torch_stable.html
Ignoring torch: markers 'sys_platform == "darwin"' don't match your environment
Ignoring torchaudio: markers 'sys_platform == "darwin"' don't match your environment
Collecting torch==2.1.0+cu118 (from -r requirements.torch.txt (line 5))
  Using cached https://download.pytorch.org/whl/cu118/torch-2.1.0%2Bcu118-cp310-cp310-linux_x86_64.whl (2325.9 MB)
Collecting torchaudio==2.1.0+cu118 (from -r requirements.torch.txt (line 6))
  Using cached https://download.pytorch.org/whl/cu118/torchaudio-2.1.0%2Bcu118-cp310-cp310-linux_x86_64.whl (3.2 MB)
Requirement already satisfied: MarkupSafe>=2.0 in /gpfs/fs3c/nrc/dt/sam037/.local/lib/python3.10/site-packages (from jinja2->torch==2.1.0+cu118->-r requirements.torch.txt (line 5)) (2.1.3)
Collecting mpmath<1.4,>=1.1.0 (from sympy->torch==2.1.0+cu118->-r requirements.torch.txt (line 5))
Installing collected packages: mpmath, typing-extensions, sympy, jinja2, fsspec, filelock, triton, torch, torchaudio
Successfully installed filelock-3.16.1 fsspec-2024.10.0 jinja2-3.1.4 mpmath-1.3.0 sympy-1.13.3 torch-2.1.0+cu118 torchaudio-2.1.0+cu118 triton-2.1.0 typing-extensions-4.12.2
Requirement already satisfied: torch==2.1.0 in /gpfs/fs3c/nrc/ict/nrc_collab_ilt/u/sam037/.conda/envs/EveryVoice/lib/python3.10/site-packages (from EveryVoice==0.2.0a0) (2.1.0+cu118)
Requirement already satisfied: torchaudio==2.1.0 in /gpfs/fs3c/nrc/ict/nrc_collab_ilt/u/sam037/.conda/envs/EveryVoice/lib/python3.10/site-packages (from EveryVoice==0.2.0a0) (2.1.0+cu118)
Collecting torchinfo==1.8.0 (from EveryVoice==0.2.0a0)
  Using cached torchinfo-1.8.0-py3-none-any.whl.metadata (21 kB)
Collecting torchmetrics<3.0,>=0.7.0 (from lightning>=2.0.0->EveryVoice==0.2.0a0)
  Using cached torchmetrics-1.6.0-py3-none-any.whl.metadata (20 kB)
Collecting pytorch-lightning (from lightning>=2.0.0->EveryVoice==0.2.0a0)
  Using cached pytorch_lightning-2.4.0-py3-none-any.whl.metadata (21 kB)
Requirement already satisfied: mpmath<1.4,>=1.1.0 in /gpfs/fs3c/nrc/ict/nrc_collab_ilt/u/sam037/.conda/envs/EveryVoice/lib/python3.10/site-packages (from sympy->torch==2.1.0->EveryVoice==0.2.0a0) (1.3.0)
Using cached torchinfo-1.8.0-py3-none-any.whl (23 kB)
Using cached torchmetrics-1.6.0-py3-none-any.whl (926 kB)
Using cached pytorch_lightning-2.4.0-py3-none-any.whl (815 kB)
Installing collected packages: wcwidth, pytz, pydub, ipatok, grapheme, yaspin, websockets, urllib3, tzdata, torchinfo, tomlkit, tomli, tabulate, sniffio, six, setuptools, semantic-version, ruff, pyyaml, python-multipart, pyparsing, pydantic-core, pycparser, protobuf, propcache, prompt_toolkit, pluggy, platformdirs, pillow, orjson, orderly-set, numpy, markdown-it-py, markdown, llvmlite, kiwisolver, iniconfig, idna, fonttools, ffmpy, et-xmlfile, dnspython, decorator, cycler, coloredlogs, click, certifi, attrs, aiosignal, aiohappyeyeballs, aiofiles, yarl, uvicorn, tensorboard, rich, python-dateutil, pydantic, openpyxl, numba, nltk, lightning-utilities, httpcore, email-validator, deepdiff, contourpy, cffi, anytree, anyio, typer, torchmetrics, starlette, scikit-learn, pysdtw, pandas, matplotlib, huggingface-hub, httpx, g2p, aiohttp, safehttpx, librosa, gradio-client, fastapi, clipdetect, pytorch-lightning, gradio, lightning, EveryVoice
Successfully installed EveryVoice-0.2.0a0 aiofiles-23.2.1 aiohappyeyeballs-2.4.3 aiohttp-3.11.2 aiosignal-1.3.1 anyio-4.6.2.post1 anytree-2.12.1 attrs-24.2.0 certifi-2024.8.30 cffi-1.17.1 click-8.1.7 clipdetect-0.1.4 coloredlogs-15.0.1 contourpy-1.3.1 cycler-0.12.1 decorator-5.1.1 deepdiff-8.0.1 dnspython-2.7.0 email-validator-2.2.0 et-xmlfile-2.0.0 fastapi-0.115.5 ffmpy-0.4.0 fonttools-4.55.0 g2p-2.2.0 gradio-5.5.0 gradio-client-1.4.2 grapheme-0.6.0 httpcore-1.0.7 httpx-0.27.2 huggingface-hub-0.26.2 idna-3.10 iniconfig-2.0.0 ipatok-0.4.2 kiwisolver-1.4.7 librosa-0.9.2 lightning-2.4.0 lightning-utilities-0.11.8 llvmlite-0.43.0 markdown-3.7 markdown-it-py-3.0.0 matplotlib-3.9.2 nltk-3.9.1 numba-0.60.0 numpy-1.26.4 openpyxl-3.1.5 orderly-set-5.2.2 orjson-3.10.11 pandas-2.2.3 pillow-11.0.0 platformdirs-4.3.6 pluggy-1.5.0 prompt_toolkit-3.0.48 propcache-0.2.0 protobuf-4.25.5 pycparser-2.22 pydantic-2.7.4 pydantic-core-2.18.4 pydub-0.25.1 pyparsing-3.2.0 pysdtw-0.0.5 python-dateutil-2.9.0.post0 python-multipart-0.0.12 pytorch-lightning-2.4.0 pytz-2024.2 pyyaml-6.0.2 rich-13.9.4 ruff-0.7.4 safehttpx-0.1.1 scikit-learn-1.5.2 semantic-version-2.10.0 setuptools-75.4.0 six-1.16.0 sniffio-1.3.1 starlette-0.41.2 tabulate-0.9.0 tensorboard-2.18.0 tomli-2.1.0 tomlkit-0.12.0 torchinfo-1.8.0 torchmetrics-1.6.0 typer-0.13.0 tzdata-2024.2 urllib3-2.2.3 uvicorn-0.32.0 wcwidth-0.2.13 websockets-12.0 yarl-1.17.1 yaspin-3.1.0
Requirement already satisfied: torch==2.1.0 in /gpfs/fs3c/nrc/ict/nrc_collab_ilt/u/sam037/.conda/envs/EveryVoice/lib/python3.10/site-packages (from EveryVoice==0.2.0a0) (2.1.0+cu118)
Requirement already satisfied: torchaudio==2.1.0 in /gpfs/fs3c/nrc/ict/nrc_collab_ilt/u/sam037/.conda/envs/EveryVoice/lib/python3.10/site-packages (from EveryVoice==0.2.0a0) (2.1.0+cu118)
Requirement already satisfied: torchinfo==1.8.0 in /gpfs/fs3c/nrc/ict/nrc_collab_ilt/u/sam037/.conda/envs/EveryVoice/lib/python3.10/site-packages (from EveryVoice==0.2.0a0) (1.8.0)
Requirement already satisfied: torchmetrics<3.0,>=0.7.0 in /gpfs/fs3c/nrc/ict/nrc_collab_ilt/u/sam037/.conda/envs/EveryVoice/lib/python3.10/site-packages (from lightning>=2.0.0->EveryVoice==0.2.0a0) (1.6.0)
Requirement already satisfied: pytorch-lightning in /gpfs/fs3c/nrc/ict/nrc_collab_ilt/u/sam037/.conda/envs/EveryVoice/lib/python3.10/site-packages (from lightning>=2.0.0->EveryVoice==0.2.0a0) (2.4.0)
Requirement already satisfied: mpmath<1.4,>=1.1.0 in /gpfs/fs3c/nrc/ict/nrc_collab_ilt/u/sam037/.conda/envs/EveryVoice/lib/python3.10/site-packages (from sympy->torch==2.1.0->EveryVoice==0.2.0a0) (1.3.0)

Note that we don't see any mention of rocm

grep -c rocm log.make-everyvoice-env.dbc2282a3
0
pip list | grep 'nvidia\|torch'
nvidia-cublas-cu12         12.1.3.1
nvidia-cuda-cupti-cu12     12.1.105
nvidia-cuda-nvrtc-cu12     12.1.105
nvidia-cuda-runtime-cu12   12.1.105
nvidia-cufft-cu12          11.0.2.54
nvidia-curand-cu12         10.3.2.106
nvidia-cusparse-cu12       12.1.0.106
nvidia-nvjitlink-cu12      12.2.140
nvidia-nvtx-cu12           12.1.105
pytorch-lightning          2.4.0
torch                      2.1.0+cu118
torchaudio                 2.1.0+cu118
torchinfo                  1.8.0
torchmetrics               1.6.0

Installation's Logs with New pyproject.toml

But when installing with the new pyproject.toml, we see that a rocm version is installed.

grep rocm log.make-everyvoice-env.no_CUDA_TAG
  Using cached https://download.pytorch.org/whl/rocm5.6/torch-2.1.0%2Brocm5.6-cp310-cp310-linux_x86_64.whl (1590.3 MB)
  Using cached https://download.pytorch.org/whl/rocm5.6/torchaudio-2.1.0%2Brocm5.6-cp310-cp310-linux_x86_64.whl (1.6 MB)
Collecting pytorch-triton-rocm==2.1.0 (from torch==2.1.0->EveryVoice==0.2.0a0)
  Using cached pytorch_triton_rocm-2.1.0-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (1.1 kB)
Collecting cmake>=3.20 (from pytorch-triton-rocm==2.1.0->torch==2.1.0->EveryVoice==0.2.0a0)
Requirement already satisfied: lit in /gpfs/fs3c/nrc/ict/nrc_collab_ilt/u/sam037/.conda/envs/EveryVoice.sl.no_CUDA_TAG/lib/python3.10/site-packages (from pytorch-triton-rocm==2.1.0->torch==2.1.0->EveryVoice==0.2.0a0) (18.1.8)
Please make sure the CUDA version installed on your system matches CUDA_VERSION=11.8.
Creating EveryVoice conda environment called "EveryVoice.sl.no_CUDA_TAG" for CUDA 11.8 using Python 3.10.
...
  libopenvino-pytor~ conda-forge/linux-64::libopenvino-pytorch-frontend-2024.4.0-h5888daf_2
$ pip install lit --find-links https://download.pytorch.org/whl/torch_stable.html
Looking in links: https://download.pytorch.org/whl/torch_stable.html
$ pip install .[cu118] --find-links https://download.pytorch.org/whl/torch_stable.html
Looking in links: https://download.pytorch.org/whl/torch_stable.html
Collecting torch==2.1.0 (from EveryVoice==0.2.0a0)
  Using cached https://download.pytorch.org/whl/rocm5.6/torch-2.1.0%2Brocm5.6-cp310-cp310-linux_x86_64.whl (1590.3 MB)
Collecting torchaudio==2.1.0 (from EveryVoice==0.2.0a0)
  Using cached https://download.pytorch.org/whl/rocm5.6/torchaudio-2.1.0%2Brocm5.6-cp310-cp310-linux_x86_64.whl (1.6 MB)
Collecting torchinfo==1.8.0 (from EveryVoice==0.2.0a0)
  Using cached torchinfo-1.8.0-py3-none-any.whl.metadata (21 kB)
  Using cached pytorch_triton_rocm-2.1.0-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (1.1 kB)
Collecting cmake>=3.20 (from pytorch-triton-rocm==2.1.0->torch==2.1.0->EveryVoice==0.2.0a0)
Requirement already satisfied: lit in /gpfs/fs3c/nrc/ict/nrc_collab_ilt/u/sam037/.conda/envs/EveryVoice.sl.no_CUDA_TAG/lib/python3.10/site-packages (from pytorch-triton-rocm==2.1.0->torch==2.1.0->EveryV
oice==0.2.0a0) (18.1.8)
Collecting torch==2.1.0 (from EveryVoice==0.2.0a0)
  Using cached https://download.pytorch.org/whl/cu118/torch-2.1.0%2Bcu118-cp310-cp310-linux_x86_64.whl (2325.9 MB)
Collecting torchaudio==2.1.0 (from EveryVoice==0.2.0a0)
  Using cached https://download.pytorch.org/whl/cu118/torchaudio-2.1.0%2Bcu118-cp310-cp310-linux_x86_64.whl (3.2 MB)
Collecting torchmetrics<3.0,>=0.7.0 (from lightning>=2.0.0->EveryVoice==0.2.0a0)
  Using cached torchmetrics-1.6.0-py3-none-any.whl.metadata (20 kB)
Collecting pytorch-lightning (from lightning>=2.0.0->EveryVoice==0.2.0a0)
  Using cached pytorch_lightning-2.4.0-py3-none-any.whl.metadata (21 kB)
Collecting mpmath<1.4,>=1.1.0 (from sympy->torch==2.1.0->EveryVoice==0.2.0a0)
Using cached torchinfo-1.8.0-py3-none-any.whl (23 kB)
Using cached torchmetrics-1.6.0-py3-none-any.whl (926 kB)
Using cached pytorch_lightning-2.4.0-py3-none-any.whl (815 kB)
Installing collected packages: wcwidth, pytz, pydub, mpmath, ipatok, grapheme, yaspin, websockets, urllib3, tzdata, typing-extensions, torchinfo, tomlkit, tomli, tabulate, sympy, sniffio, six, setuptool
s, semantic-version, ruff, pyyaml, python-multipart, pyparsing, pycparser, protobuf, propcache, prompt_toolkit, pluggy, platformdirs, pillow, orjson, orderly-set, numpy, markdown-it-py, markdown, llvmli
te, kiwisolver, jinja2, iniconfig, idna, fsspec, fonttools, filelock, ffmpy, et-xmlfile, dnspython, decorator, cython, cycler, coloredlogs, click, certifi, attrs, aiosignal, aiohappyeyeballs, aiofiles,
yarl, uvicorn, triton, tensorboard, rich, python-dateutil, pydantic-core, openpyxl, numba, nltk, lightning-utilities, httpcore, email-validator, deepdiff, contourpy, cffi, anytree, anyio, typer, torch,
starlette, scikit-learn, pydantic, pandas, matplotlib, huggingface-hub, httpx, aiohttp, torchmetrics, torchaudio, safehttpx, pysdtw, librosa, gradio-client, g2p, fastapi, clipdetect, pytorch-lightning,
gradio, lightning, EveryVoice
Successfully installed EveryVoice-0.2.0a0 aiofiles-23.2.1 aiohappyeyeballs-2.4.3 aiohttp-3.11.2 aiosignal-1.3.1 anyio-4.6.2.post1 anytree-2.12.1 attrs-24.2.0 certifi-2024.8.30 cffi-1.17.1 click-8.1.7 cl
ipdetect-0.1.4 coloredlogs-15.0.1 contourpy-1.3.1 cycler-0.12.1 cython-3.0.11 decorator-5.1.1 deepdiff-8.0.1 dnspython-2.7.0 email-validator-2.2.0 et-xmlfile-2.0.0 fastapi-0.115.5 ffmpy-0.4.0 filelock-3
.16.1 fonttools-4.55.0 fsspec-2024.10.0 g2p-2.2.0 gradio-5.5.0 gradio-client-1.4.2 grapheme-0.6.0 httpcore-1.0.7 httpx-0.27.2 huggingface-hub-0.26.2 idna-3.10 iniconfig-2.0.0 ipatok-0.4.2 jinja2-3.1.4 k
iwisolver-1.4.7 librosa-0.9.2 lightning-2.4.0 lightning-utilities-0.11.8 llvmlite-0.43.0 markdown-3.7 markdown-it-py-3.0.0 matplotlib-3.9.2 mpmath-1.3.0 nltk-3.9.1 numba-0.60.0 numpy-1.26.4 openpyxl-3.1
.5 orderly-set-5.2.2 orjson-3.10.11 pandas-2.2.3 pillow-11.0.0 platformdirs-4.3.6 pluggy-1.5.0 prompt_toolkit-3.0.48 propcache-0.2.0 protobuf-4.25.5 pycparser-2.22 pydantic-2.7.4 pydantic-core-2.18.4 py
dub-0.25.1 pyparsing-3.2.0 pysdtw-0.0.5 python-dateutil-2.9.0.post0 python-multipart-0.0.12 pytorch-lightning-2.4.0 pytz-2024.2 pyyaml-6.0.2 rich-13.9.4 ruff-0.7.4 safehttpx-0.1.1 scikit-learn-1.5.2 sem
antic-version-2.10.0 setuptools-75.4.0 six-1.16.0 sniffio-1.3.1 starlette-0.41.2 sympy-1.13.3 tabulate-0.9.0 tensorboard-2.18.0 tomli-2.1.0 tomlkit-0.12.0 torch-2.1.0+cu118 torchaudio-2.1.0+cu118 torchi
nfo-1.8.0 torchmetrics-1.6.0 triton-2.1.0 typer-0.13.0 typing-extensions-4.12.2 tzdata-2024.2 urllib3-2.2.3 uvicorn-0.32.0 wcwidth-0.2.13 websockets-12.0 yarl-1.17.1 yaspin-3.1.0
Requirement already satisfied: torch==2.1.0 in /gpfs/fs3c/nrc/ict/nrc_collab_ilt/u/sam037/.conda/envs/EveryVoice.sl.no_CUDA_TAG/lib/python3.10/site-packages (from EveryVoice==0.2.0a0) (2.1.0+cu118)
Requirement already satisfied: torchaudio==2.1.0 in /gpfs/fs3c/nrc/ict/nrc_collab_ilt/u/sam037/.conda/envs/EveryVoice.sl.no_CUDA_TAG/lib/python3.10/site-packages (from EveryVoice==0.2.0a0) (2.1.0+cu118)
Requirement already satisfied: torchinfo==1.8.0 in /gpfs/fs3c/nrc/ict/nrc_collab_ilt/u/sam037/.conda/envs/EveryVoice.sl.no_CUDA_TAG/lib/python3.10/site-packages (from EveryVoice==0.2.0a0) (1.8.0)
Requirement already satisfied: torchmetrics<3.0,>=0.7.0 in /gpfs/fs3c/nrc/ict/nrc_collab_ilt/u/sam037/.conda/envs/EveryVoice.sl.no_CUDA_TAG/lib/python3.10/site-packages (from lightning>=2.0.0->EveryVoic
e==0.2.0a0) (1.6.0)
Requirement already satisfied: pytorch-lightning in /gpfs/fs3c/nrc/ict/nrc_collab_ilt/u/sam037/.conda/envs/EveryVoice.sl.no_CUDA_TAG/lib/python3.10/site-packages (from lightning>=2.0.0->EveryVoice==0.2.
0a0) (2.4.0)
Requirement already satisfied: mpmath<1.4,>=1.1.0 in /gpfs/fs3c/nrc/ict/nrc_collab_ilt/u/sam037/.conda/envs/EveryVoice.sl.no_CUDA_TAG/lib/python3.10/site-packages (from sympy->torch==2.1.0->EveryVoice==
0.2.0a0) (1.3.0)
Requirement already satisfied: torch==2.1.0 in /gpfs/fs3c/nrc/ict/nrc_collab_ilt/u/sam037/.conda/envs/EveryVoice.sl.no_CUDA_TAG/lib/python3.10/site-packages (from EveryVoice==0.2.0a0) (2.1.0+cu118)
Requirement already satisfied: torchaudio==2.1.0 in /gpfs/fs3c/nrc/ict/nrc_collab_ilt/u/sam037/.conda/envs/EveryVoice.sl.no_CUDA_TAG/lib/python3.10/site-packages (from EveryVoice==0.2.0a0) (2.1.0+cu118)
Requirement already satisfied: torchinfo==1.8.0 in /gpfs/fs3c/nrc/ict/nrc_collab_ilt/u/sam037/.conda/envs/EveryVoice.sl.no_CUDA_TAG/lib/python3.10/site-packages (from EveryVoice==0.2.0a0) (1.8.0)
Requirement already satisfied: torchmetrics<3.0,>=0.7.0 in /gpfs/fs3c/nrc/ict/nrc_collab_ilt/u/sam037/.conda/envs/EveryVoice.sl.no_CUDA_TAG/lib/python3.10/site-packages (from lightning>=2.0.0->EveryVoic
e==0.2.0a0) (1.6.0)
Requirement already satisfied: pytorch-lightning in /gpfs/fs3c/nrc/ict/nrc_collab_ilt/u/sam037/.conda/envs/EveryVoice.sl.no_CUDA_TAG/lib/python3.10/site-packages (from lightning>=2.0.0->EveryVoice==0.2.
0a0) (2.4.0)
Requirement already satisfied: mpmath<1.4,>=1.1.0 in /gpfs/fs3c/nrc/ict/nrc_collab_ilt/u/sam037/.conda/envs/EveryVoice.sl.no_CUDA_TAG/lib/python3.10/site-packages (from sympy->torch==2.1.0->EveryVoice==
0.2.0a0) (1.3.0)
Requirement already satisfied: torch==2.1.0 in /gpfs/fs3c/nrc/ict/nrc_collab_ilt/u/sam037/.conda/envs/EveryVoice.sl.no_CUDA_TAG/lib/python3.10/site-packages (from EveryVoice==0.2.0a0) (2.1.0+cu118)
Requirement already satisfied: torchaudio==2.1.0 in /gpfs/fs3c/nrc/ict/nrc_collab_ilt/u/sam037/.conda/envs/EveryVoice.sl.no_CUDA_TAG/lib/python3.10/site-packages (from EveryVoice==0.2.0a0) (2.1.0+cu118)
Requirement already satisfied: torchinfo==1.8.0 in /gpfs/fs3c/nrc/ict/nrc_collab_ilt/u/sam037/.conda/envs/EveryVoice.sl.no_CUDA_TAG/lib/python3.10/site-packages (from EveryVoice==0.2.0a0) (1.8.0)
Requirement already satisfied: torchmetrics<3.0,>=0.7.0 in /gpfs/fs3c/nrc/ict/nrc_collab_ilt/u/sam037/.conda/envs/EveryVoice.sl.no_CUDA_TAG/lib/python3.10/site-packages (from lightning>=2.0.0->EveryVoic
e==0.2.0a0) (1.6.0)
Requirement already satisfied: pytorch-lightning in /gpfs/fs3c/nrc/ict/nrc_collab_ilt/u/sam037/.conda/envs/EveryVoice.sl.no_CUDA_TAG/lib/python3.10/site-packages (from lightning>=2.0.0->EveryVoice==0.2.
0a0) (2.4.0)
Requirement already satisfied: mpmath<1.4,>=1.1.0 in /gpfs/fs3c/nrc/ict/nrc_collab_ilt/u/sam037/.conda/envs/EveryVoice.sl.no_CUDA_TAG/lib/python3.10/site-packages (from sympy->torch==2.1.0->EveryVoice==
0.2.0a0) (1.3.0)

Looking at what got installed, we see that torch==2.1.0+cu118 managed to install along side with nvidia-*cu12. Isn't a bit strange that we ask for cu118 and some nvidia cu12 stuff gets installed?

pip list | grep 'nvidia\|torch'
nvidia-cublas-cu12         12.1.3.1
nvidia-cuda-cupti-cu12     12.1.105
nvidia-cuda-nvrtc-cu12     12.1.105
nvidia-cuda-runtime-cu12   12.1.105
nvidia-cufft-cu12          11.0.2.54
nvidia-curand-cu12         10.3.2.106
nvidia-cusparse-cu12       12.1.0.106
nvidia-nvjitlink-cu12      12.2.140
nvidia-nvtx-cu12           12.1.105
pytorch-lightning          2.4.0
torch                      2.1.0+cu118
torchaudio                 2.1.0+cu118
torchinfo                  1.8.0
torchmetrics               1.6.0

@SamuelLarkin SamuelLarkin force-pushed the dev.sl/no_CUDA_TAG branch 2 times, most recently from a2dcc34 to d71236f Compare November 19, 2024 21:25
@github-actions GitHub Actions
Copy link
Contributor

github-actions bot commented Nov 19, 2024 •
edited
Loading 

CLI load time: 0:00.30
Pull Request HEAD: 61db7059f8ef2c8f96cd096ff33cdc98433ab997
Imports that take more than 0.1 s:
import time: self [us] | cumulative | imported package
import time:      1112 |     101723 |     typer.main
import time:       346 |     129934 |   typer
import time:      6557 |     252203 | everyvoice.cli

@codecov Codecov
Copy link

codecov bot commented Nov 19, 2024 •
edited
Loading

Codecov Report

All modified and coverable lines are covered by tests ✅

Project coverage is 76.59%. Comparing base (32ee7e9) to head (61db705).

Additional details and impacted files 
@@           Coverage Diff           @@
##             main     #588   +/-   ##
=======================================
  Coverage   76.59%   76.59%           
=======================================
  Files          46       46           
  Lines        3452     3452           
  Branches      470      470           
=======================================
  Hits         2644     2644           
  Misses        706      706           
  Partials      102      102

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
1 participant
@SamuelLarkin