Skip to content
/ Fuser Public

A Fusion Code Generator for NVIDIA GPUs (commonly known as "nvFuser")

License

Notifications You must be signed in to change notification settings

NVIDIA/Fuser

This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.

Folders and files

NameName
Last commit message
Last commit date

Latest commit

Nov 2, 2024
62f1cba · Nov 2, 2024
Oct 30, 2024
Oct 30, 2024
Feb 20, 2024
Nov 2, 2024
Oct 30, 2024
Oct 2, 2024
Jul 16, 2024
Nov 1, 2024
Oct 22, 2024
Nov 1, 2024
Mar 1, 2024
Oct 31, 2024
Jun 5, 2023
Nov 21, 2023
Mar 13, 2023
Apr 15, 2024
Apr 6, 2023
Jul 16, 2024
Nov 2, 2024
Mar 13, 2023
Aug 14, 2024
Aug 26, 2024
Mar 13, 2023
Apr 8, 2023
Oct 3, 2024
Oct 29, 2024

Repository files navigation

Fuser

A Fusion Code Generator for NVIDIA GPUs (commonly known as "nvFuser")

Installation

We publish nightly wheel packages on https://pypi.nvidia.com, while build against stable torch version on https://pypi.org.

built-env cuda 12.1
torch 2.3 nvfuser-cu121-torch23
torch 2.4 nvfuser-cu121-torch24
torch nightly wheel nvfuser-cu121

Note that nvfuser built against stable torch version isn't compatible with nightly pytorch wheel, so ensure you pick the right version suiting your environment.

nightly nvfuser pip wheel

You can instll a nightly nvfuser pip package built against torch nightly code base with pip install --pre nvfuser-cu121 --extra-index-url https://pypi.nvidia.com

As we build against nightly torch wheel and there's no compatibility promised on nightly wheels, we have explicitly marked the nightly torch wheel as an optinoal dependency. You can choose to install the torch wheel along with nvfuser package. e.g. pip install --pre "nvfuser-cu121[torch]" --extra-index-url https://pypi.nvidia.com. Note that this may uninstall your local pytorch installation and install the compatible nightly pytorch.

nvfuser pip wheel against pytorch stable release

nvfuser pip wheel built against stable torch releases is published on pypi.org. Pick the right cuda toolkit version to match your torch installation. e.g. pip install nvfuser-cu121-torch24

PyPI: https://pypi.org/project/nvfuser/

Developer

Docs: https://github.com/NVIDIA/Fuser/wiki

Supported compilers:

GCC:

We support all "supported releases" of gcc as specified in the official site. As of 6/20/2024, they are:

  • gcc 11.4
  • gcc 12.4
  • gcc 13.2
  • gcc 14.1

Clang:

  • clang 14+

Supported C++ standard:

  • C++17
  • C++20

We are actively considering dropping C++17 support