New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[32] Barlow Twins: Self-Supervised Learning via Redundancy Reduction #32

Open

Dongwoo-Im opened this issue Apr 22, 2023 · 1 comment

Assignees

Labels

ICML '21 Self-supervised Learning Spotlight

Contributor

Dongwoo-Im commented Apr 22, 2023 •

edited

Loading

Links

Paper : https://arxiv.org/abs/2103.03230
Github : https://github.com/facebookresearch/barlowtwins

한 줄 요약

SSL 학습에서 embedding vector 간 redundancy reduction을 수행하는 objective를 적용하면 collapsing 방지를 위한 trick들을 적용할 필요가 없다는 인사이트를 바탕으로, Barlow Twins를 제안합니다.

선택 이유

얀 르쿤님이 참여한 self-supervised learning 논문들을 읽어보기 위해 (아마 그 중 처음으로 보이는) barlow twins 논문을 선정했다. 이후 VICReg, VICRegL를 비롯하여 다양한 논문들을 작성하셨다.

Dongwoo-Im added Self-supervised Learning ICML '21 Spotlight labels

Dongwoo-Im self-assigned this

Contributor Author

Dongwoo-Im commented Apr 25, 2023

https://dongwoo-im.github.io/papers/review/2023-04-24-BarlowTwins/

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment