The cache is shared between tests and when using Redis, even between
parallel test processes. Certain global configuration options can
affect other tests.

Backport-of: 2e7a6119e6cf0f93e75f3af5ab5792d055008da3