I don't know what I was thinking with that last release. Now, there's a new file (allauth_settings.py) which can be copied, edited, then mounted inside your docker container (or otherwise kept outside the application) to configure allauth providers separately from the main settings.py.
This should actually work.