Remove unnecessary dependencies pytest, flaky and pytest-benchmark

Remove unnecessary dependencies pytest, flaky and pytest-benchmark #3941