Skip to content

v0.1.0 - Support for T5, local models, integrated gradients, Captum integrations, and beam search decoding

Compare
Choose a tag to compare
@jalammar jalammar released this 29 Dec 10:27
· 40 commits to main since this release

Big update to Ecco! Massive contributions from @JoaoLages and @SSamDav.

  • Added support of encoder-decoder models like T5
  • Using Captum for feature attribution adds support to these new methods: (IntegratedGradients, Saliency, InputXGradient, DeepLift, DeepLiftShap, GuidedBackprop, GuidedGradCam, Deconvolution, LRP). This replaces the previous implementation within Ecco for Saliency and InputXGradients.
  • Added support for Beam Search generation
  • Added support for importing local models. Very useful for analyzing finetuned models.
  • Added better support for various tokenizers in visualizations. Some more work needed on this front, still.