#

sparsely-gated-mixture-of-experts

Here is 1 public repository matching this topic...

davidmrau / mixture-of-experts

PyTorch Re-Implementation of "The Sparsely-Gated Mixture-of-Experts Layer" by Noam Shazeer et al. https://arxiv.org/abs/1701.06538

pytorch moe re-implementation mixture-of-experts sparsely-gated-mixture-of-experts

Updated Apr 19, 2024
Python

Improve this page

Add a description, image, and links to the sparsely-gated-mixture-of-experts topic page so that developers can more easily learn about it.

Curate this topic

Add this topic to your repo

To associate your repository with the sparsely-gated-mixture-of-experts topic, visit your repo's landing page and select "manage topics."