Skip to content

v1.3: Stable Diffusion and Wav2Vec2

Compare
Choose a tag to compare
@regisss regisss released this 01 Dec 10:32
· 7 commits to v1.3-release since this release

Stable Diffusion

This release adds a new interface for the 🤗 Diffusers library which enables to support the Stable Diffusion pipeline for inference. Thus, you can now generate images from text on Gaudi relying on the user-friendliness of 🤗 Diffusers.

  • Add support for Stable Diffusion #131

Check out the documentation and this example for more information.

Wav2Vec2

After text and image models, a third modality is now supported with the addition of Wav2Vec2.

  • Add suport for Wav2Vec2 #120

Check out the audio classification and speech recognition examples to see how to use it.

SynapseAI 1.7

This release is fully compatible with SynapseAI 1.7.0, which is the latest version. Check out Habana's documentation for more information about the new features.

Memory stats

Memory stats are now logged every logging_steps steps to give more information about the memory consumption of HPUs.

  • Memory stats #89

DeepSpeed demo notebook with GPT2-XL

This repository now has a notebook displaying how to use DeepSpeed to pre-train/fine-tune GPT2-XL on GAUDI. You can find it here.

  • Add DeepSpeed demo notebook #112

Fix gradient checkpointing for BERT/RoBERTa/ALBERT

An error used to be raised by PyTorch when running BERT-like models with gradient checkpointing. This has been fixed.

  • Fix gradient checkpointing for BERT/RoBERTa/ALBERT #118