Add logging in the admin to see outgoing requests/responses

[joeribekker]

Thema / Theme

Admin

Omschrijving / Description

By far, most discussions arises who sends what to where. Therefore, we should log ALL outgoing requests and make them viewable in the admin. This includes the full URL, headers and body. For now, it's also not needed to link these logs to specific actions in Open Forms. They are mostly used for testing purposes and can be related based on date and time!

To tackle the basic privacy and security concernns: There should be a (Django) permission for viewing logs AND logs should be cleaned up with a regular interval. Other concerns can be tackled in other issues and are not part of this ticket.

I prefer to have a library added for this if it exists, otherwise a library can created for this.
See: https://github.com/maykinmedia/django-log-outgoing-requests

Added value / Toegevoegde waarde

Shorten the time to analyse and fix issues with external systems.

Aanvullende opmerkingen / Additional context

Additional requests I made on the library that didn't make it into the initial version, and thus are tasks for us:

• Can we make it so this (meaning: save or not save to the database) can be enabled / disabled from the admin (singleton class)?
• Can we add an autoclean command/task so that entries are deleted after X days (default=7, so I can call clean_request_logs --keep=3)
• I really prefer a view of the raw request and response (so simply what goes over the line), in addition to the formatted/table view
• In the list view, I basically want to see 3 things: the request URL, the http response code and the timestamp. The URL can be limited to 100 chars maybe with elipises right after the domain name.
• List view: Filter on http status code, http method, time hierarchy
• Logging post body opt in? Just do it

You currently have:

LOG_OUTGOING_REQUESTS_DB_SAVE

Can we change this to have:

LOG_OUTGOING_REQUESTS_ALWAYS_LOG_TO_DB = None  # True, False -both mean ignore admin-, None -use admin setting-

LOG_OUTGOING_REQUESTS_LOG_BODY_TO_DB = True  # only has effect when saving to db

LOG_OUTGOING_REQUESTS_LOG_BODY_TO_STDOUT = False

[alextreme]

PyPI: https://pypi.org/project/django-log-outgoing-requests/

Might be good to align Joeri's requests together with @LaurensBurger as the goal of both is the same, but the wishes are different: maykinmedia/django-log-outgoing-requests#2