EPFL Machine Learning and Optimization Laboratory
- 342 followers
- Lausanne, Switzerland
- http://mlo.epfl.ch
Popular repositories Loading
-
OptML_course
OptML_course PublicEPFL Course - Optimization for Machine Learning - CS-439
-
attention-cnn
attention-cnn PublicSource code for "On the Relationship between Self-Attention and Convolutional Layers"
-
landmark-attention
landmark-attention PublicLandmark Attention: Random-Access Infinite Context Length for Transformers
Repositories
Showing 10 of 59 repositories
- getting-started Public
epfml/getting-started’s past year of commit activity - schedules-and-scaling Public
Code for NeurIPS 2024 Spotlight: "Scaling Laws and Compute-Optimal Training Beyond Fixed Training Durations"
epfml/schedules-and-scaling’s past year of commit activity - personalized-collaborative-llms Public
Exploration on-device self-supervised collaborative fine-tuning of large language models with limited local data availability, using Low-Rank Adaptation (LoRA). We introduce three distinct trust-weighted gradient aggregation schemes: weight similarity-based, prediction similarity-based and validation performance-based.
epfml/personalized-collaborative-llms’s past year of commit activity