Move tolerate fixture to separate repository

[AnesBenmerzoug]

With the changes in #529, we no longer use the tolerate fixture and we should therefore remove it from the repository. However I think it is useful and there may be other uses for it beyond pyDVL. Therefore I suggest we move it a separate repository and open-source it.

All the related code can be found in tests/tolerate.py and tests/conftest.py.

We should refer to pytest's documentation for instructions on how to create a plugin.

It turns out that there is a similar plugin called pytest-repeat that allows repeating tests on failure. However our implementation allows setting the number of repetitions inside a test's function. We could contribute that change to that other plugin but that would take longer and would involve a lot more communication overhead.

[AnesBenmerzoug]

After a bit of search I found that there already exists a pytest plugin call pytest-rerunfailures that reruns tests on failure. We should perhaps removing our code and use that instead.

[mdbenito]

Rerunfailures is pretty neat. As soon as we move to 3.8 we should integrate it for the stochastic tests

…

On Mon, May 27, 2024, 13:22 Anes Benmerzoug ***@***.***> wrote: After a bit of search I found that there already exists a pytest plugin call pytest-rerunfailures <https://github.com/pytest-dev/pytest-rerunfailures> that reruns tests on failure. We should perhaps removing our code and use that instead. — Reply to this email directly, view it on GitHub <#539 (comment)>, or unsubscribe <https://github.com/notifications/unsubscribe-auth/AAL2AJZYD3PJUVJORX6QI7LZEMJO3AVCNFSM6AAAAABFE5OLSCVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDCMZTGI3DKMJSGU> . You are receiving this because you are subscribed to this thread.Message ID: ***@***.***>