Skip to content
Change the repository type filter

All

    Repositories list

    • vllm-fork

      Public
      A high-throughput and memory-efficient inference and serving engine for LLMs
      Python
      Apache License 2.0
      4.9k442345Updated Dec 23, 2024Dec 23, 2024
    • Python
      Apache License 2.0
      13308Updated Dec 20, 2024Dec 20, 2024
    • Easy and lightning fast training of 🤗 Transformers on Habana Gaudi processor (HPU)
      Python
      Apache License 2.0
      219304Updated Dec 20, 2024Dec 20, 2024
    • Setup and Installation Instructions for Habana binaries, docker image creation
      Python
      Apache License 2.0
      132455Updated Dec 19, 2024Dec 19, 2024
    • SOTA low-bit LLM quantization (INT8/FP8/INT4/FP4/NF4) & sparsity; leading model compression techniques on TensorFlow, PyTorch, and ONNX Runtime
      Python
      Apache License 2.0
      258001Updated Dec 19, 2024Dec 19, 2024
    • Reference models for Intel(R) Gaudi(R) AI Accelerator
      Jupyter Notebook
      8215675Updated Dec 19, 2024Dec 19, 2024
    • DeepSpeed

      Public
      DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.
      Python
      Apache License 2.0
      4.2k1202Updated Dec 19, 2024Dec 19, 2024
    • Ongoing research training transformer models at scale
      Python
      Other
      2.4k500Updated Dec 19, 2024Dec 19, 2024
    • Intel Gaudi's Megatron DeepSpeed Large Language Models for training
      Python
      Other
      2.4k1301Updated Dec 19, 2024Dec 19, 2024
    • C
      Other
      0100Updated Dec 16, 2024Dec 16, 2024
    • TOWL

      Public
      HTML
      Apache License 2.0
      2300Updated Dec 12, 2024Dec 12, 2024
    • Tutorials for running models on First-gen Gaudi and Gaudi2 for Training and Inference. The source files for the tutorials on https://developer.habana.ai/
      Jupyter Notebook
      375732Updated Dec 11, 2024Dec 11, 2024
    • hccl_demo

      Public
      C++
      Apache License 2.0
      101802Updated Dec 10, 2024Dec 10, 2024
    • C++
      BSD 3-Clause "New" or "Revised" License
      1200Updated Dec 9, 2024Dec 9, 2024
    • Provides the examples to write and build Habana custom kernels using the HabanaTools
      C++
      221832Updated Dec 3, 2024Dec 3, 2024
    • Full End-to-End examples showing how to use First-gen Gaudi and Gaudi2 in common use cases
      Jupyter Notebook
      Apache License 2.0
      61000Updated Dec 2, 2024Dec 2, 2024
    • AutoGPTQ

      Public
      An easy-to-use LLMs quantization package with user-friendly apis, based on GPTQ algorithm.
      Python
      MIT License
      491002Updated Nov 19, 2024Nov 19, 2024
    • Fairseq

      Public
      Python
      MIT License
      1300Updated Nov 18, 2024Nov 18, 2024
    • NIC drivers (Ethernet, IBverbs and common) for the NIC IP that is inside Intel's data-center GPU
      C
      Other
      2000Updated Nov 12, 2024Nov 12, 2024
    • Intel® Gaudi® Software is an implementation of the runtime and graph compiler for Gaudi3
      C++
      Other
      3510Updated Nov 11, 2024Nov 11, 2024
    • Tensors and Dynamic neural networks in Python with strong GPU acceleration
      Python
      Other
      23k104Updated Nov 11, 2024Nov 11, 2024
    • tpc_llvm

      Public
      TPC-CLANG compiler that compiles a TPC C programming language which is used in HabanaLabs Deep-Learning Accelerators
      52623Updated Nov 11, 2024Nov 11, 2024
    • HABANA device plugin for Kubernetes
      Go
      Apache License 2.0
      3405Updated Nov 11, 2024Nov 11, 2024
    • Python
      MIT License
      3603Updated Nov 11, 2024Nov 11, 2024
    • HCL

      Public
      C++
      3900Updated Oct 13, 2024Oct 13, 2024
    • slurm

      Public
      Slurm: A Highly Scalable Workload Manager
      C
      Other
      673201Updated Sep 29, 2024Sep 29, 2024
    • rdma-core

      Public
      RDMA core userspace libraries and daemons
      C
      Other
      702100Updated Jul 24, 2024Jul 24, 2024
    • papers

      Public
      Academic papers by Habana research team
      2100Updated Jul 20, 2024Jul 20, 2024
    • Jupyter Notebook
      Apache License 2.0
      3801Updated Jul 17, 2024Jul 17, 2024
    • Thunk library for HabanaLabs kernel driver
      C
      Other
      8500Updated Jun 16, 2024Jun 16, 2024