Skip to content
@mbzuai-oryx

ORYX

A Library for Large Vision-Language Models

Popular repositories Loading

  1. Video-ChatGPT Video-ChatGPT Public

    [ACL 2024 🔥] Video-ChatGPT is a video conversation model capable of generating meaningful conversation about videos. It combines the capabilities of LLMs with a pretrained visual encoder adapted fo…

    Python 1.2k 110

  2. LLaVA-pp LLaVA-pp Public

    🔥🔥 LLaVA++: Extending LLaVA with Phi-3 and LLaMA-3 (LLaVA LLaMA-3, LLaVA Phi-3)

    Python 816 61

  3. groundingLMM groundingLMM Public

    [CVPR 2024 🔥] Grounding Large Multimodal Model (GLaMM), the first-of-its-kind model capable of generating natural language responses that are seamlessly integrated with object segmentation masks.

    Python 796 37

  4. MobiLlama MobiLlama Public

    MobiLlama : Small Language Model tailored for edge devices

    Python 604 47

  5. XrayGPT XrayGPT Public

    [BIONLP@ACL 2024] XrayGPT: Chest Radiographs Summarization using Medical Vision-Language Models.

    Python 476 56

  6. GeoChat GeoChat Public

    [CVPR 2024 🔥] GeoChat, the first grounded Large Vision Language Model for Remote Sensing

    Python 463 38

Repositories

Showing 10 of 17 repositories
  • BiMediX2 Public

    Bio-Medical EXpert LMM with English and Arabic Language Capabilities

    mbzuai-oryx/BiMediX2’s past year of commit activity
    4 0 0 0 Updated Dec 11, 2024
  • Camel-Bench Public

    CAMEL-Bench is an Arabic benchmark for evaluating multimodal models across eight domains with 29,000 questions.

    mbzuai-oryx/Camel-Bench’s past year of commit activity
    Python 20 MIT 1 0 0 Updated Dec 7, 2024
  • ALM-Bench Public

    🔥 ALM-Bench is a multilingual multi-modal diverse cultural benchmark for 100 languages across 19 categories. It assesses the next generation of LMMs on cultural inclusitivity.

    mbzuai-oryx/ALM-Bench’s past year of commit activity
    Python 26 1 0 0 Updated Nov 29, 2024
  • GeoChat Public

    [CVPR 2024 🔥] GeoChat, the first grounded Large Vision Language Model for Remote Sensing

    mbzuai-oryx/GeoChat’s past year of commit activity
    Python 463 38 31 1 Updated Nov 28, 2024
  • BiMediX Public

    Bilingual Medical Mixture of Experts LLM

    mbzuai-oryx/BiMediX’s past year of commit activity
    26 1 1 0 Updated Nov 23, 2024
  • groundingLMM Public

    [CVPR 2024 🔥] Grounding Large Multimodal Model (GLaMM), the first-of-its-kind model capable of generating natural language responses that are seamlessly integrated with object segmentation masks.

    mbzuai-oryx/groundingLMM’s past year of commit activity
    Python 796 37 25 0 Updated Nov 23, 2024
  • VideoGLaMM Public

    A Large Multimodal Model for Pixel-Level Visual Grounding in Videos

    mbzuai-oryx/VideoGLaMM’s past year of commit activity
    36 0 3 0 Updated Nov 8, 2024
  • ClimateGPT Public

    [EMNLP'23] ClimateGPT: a specialized LLM for conversations related to Climate Change and Sustainability topics in both English and Arabic languages.

    mbzuai-oryx/ClimateGPT’s past year of commit activity
    Python 78 9 0 0 Updated Sep 24, 2024
  • PALO Public

    (WACV 2025) Vision-language conversation in 10 languages including English, Chinese, French, Spanish, Russian, Japanese, Arabic, Hindi, Bengali and Urdu.

    mbzuai-oryx/PALO’s past year of commit activity
    Python 81 Apache-2.0 5 5 0 Updated Sep 10, 2024
  • Video-ChatGPT Public

    [ACL 2024 🔥] Video-ChatGPT is a video conversation model capable of generating meaningful conversation about videos. It combines the capabilities of LLMs with a pretrained visual encoder adapted for spatiotemporal video representation. We also introduce a rigorous 'Quantitative Evaluation Benchmarking' for video-based conversational models.

    mbzuai-oryx/Video-ChatGPT’s past year of commit activity
    Python 1,239 CC-BY-4.0 110 20 0 Updated Aug 27, 2024
View all repositories

Top languages

Python

Most used topics

Loading…