Code

Yann/length correction#258

Code

Merged

YannDubs merged 26 commits intomaintatsu-lab/alpaca_eval:mainfrom yann/length_correctiontatsu-lab/alpaca_eval:yann/length_correctionCopy head branch name to clipboardMar 20, 2024

+5,272-6,924

Commits

Commits on Mar 17, 2024

• [ENH] update codebase to use lenth corrected alpacaeval

  YannDubs

  committed
  bbbd596

• [ENH] update codebase to use lenth corrected alpacaeval

  YannDubs

  committed
  db79dee

• scikit-learn insteall

  YannDubs

  committed
  b8923f9

• get_length_controlled_winrate only for AE2

  YannDubs

  committed
  3ebaa8e

• pass tests

  YannDubs

  committed
  b7a67f9

• pass tests

  YannDubs

  committed
  e291c26

• pass doctests

  YannDubs

  committed
  8fdbd1c

• update added models

  YannDubs

  committed
  adc2822

• add claude and mistral annotators

  YannDubs

  committed
  4c3b107

• update website

  YannDubs

  committed
  33e24c9

• update website

  YannDubs

  committed
  4b91f0c

• add logging of extreme changes

  YannDubs

  committed
  4a29d0d

• [WIP] readme update

  YannDubs

  committed
  c23dfd3

• [WIP] readme update

  YannDubs

  committed
  c94549d

• finish updating the readme

  YannDubs

  committed
  b36d2fe

• push benchmark analysis

  YannDubs

  committed
  bcf67b6

• merge new models

  YannDubs

  committed
  504190d

• Add all the figures for length gameability

  YannDubs

  committed
  1020da2

Commits on Mar 18, 2024

• all figures for the paper

  YannDubs

  committed
  74fd3fe

• add all the weights

  YannDubs

  committed
  6b58ab1

Commits on Mar 20, 2024

• change turbo to preview

  YannDubs

  committed
  bcb3097

• test doc formatting

  YannDubs

  committed
  4cf0990

• path to correlation figure

  YannDubs

  committed
  2d6d996

• smaller figure

  YannDubs

  committed
  db0430a

• no ae figure

  YannDubs

  committed
  96754ad

• figure notebook

  YannDubs

  committed
  a453b9f