New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Decoder Loss #22

Open

hundredeuk2 opened this issue Jan 26, 2023 · 0 comments

Assignees

Contributor

hundredeuk2 commented Jan 26, 2023

목표

Encoder Pooler 태우기 전 last hidden state를 Decoder input_ids와 feeding된걸 확인한 수 나오는 logit값에 대한 loss를 선정해야함.

세부사항

어떻게 해야할지 선행연구와 guide code를 확인하고 논의를 해야함

hundredeuk2 assigned kimkeunhyeong

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment