v1.3: Stable Diffusion and Wav2Vec2
Stable Diffusion
This release adds a new interface for the 🤗 Diffusers library which enables to support the Stable Diffusion pipeline for inference. Thus, you can now generate images from text on Gaudi relying on the user-friendliness of 🤗 Diffusers.
- Add support for Stable Diffusion #131
Check out the documentation and this example for more information.
Wav2Vec2
After text and image models, a third modality is now supported with the addition of Wav2Vec2.
- Add suport for Wav2Vec2 #120
Check out the audio classification and speech recognition examples to see how to use it.
SynapseAI 1.7
This release is fully compatible with SynapseAI 1.7.0, which is the latest version. Check out Habana's documentation for more information about the new features.
Memory stats
Memory stats are now logged every logging_steps
steps to give more information about the memory consumption of HPUs.
- Memory stats #89
DeepSpeed demo notebook with GPT2-XL
This repository now has a notebook displaying how to use DeepSpeed to pre-train/fine-tune GPT2-XL on GAUDI. You can find it here.
- Add DeepSpeed demo notebook #112
Fix gradient checkpointing for BERT/RoBERTa/ALBERT
An error used to be raised by PyTorch when running BERT-like models with gradient checkpointing. This has been fixed.
- Fix gradient checkpointing for BERT/RoBERTa/ALBERT #118