Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

pytest-split test collection is not compatible with pytest-testmon #93

Open
marcodicro-dp opened this issue May 14, 2024 · 1 comment
Open

Comments

@marcodicro-dp
Copy link

Is pytest-split compatible with pytest-testmon?

I want ro run all tests in groups (using pytest-split) and then use testmon to run only the affected tests inside those groups.
Testmon said no files have changed (no affected tests) but is pytest-split is running all tests anyways:

testmon: changed files: 0, unchanged files: 456, environment: default
rootdir: /Users/marcodicro/src/repo
configfile: test/project/pytest.ini
plugins: flaky-3.8.1, testmon-2.1.1, split-0.8.2
collecting 5771 items

[pytest-split] Splitting tests with algorithm: duration_based_chunks
[pytest-split] Running group 1/25 (estimated duration: 231.00s)

collected 5772 items / 5541 deselected / 231 selected

@marcodicro-dp
Copy link
Author

This issue is still happening, now happened to me while trying to build testmon db running my tests in sequential groups using pytest-split:

pytest tests --testmon-noselect --splits 25 --group 1 -v --ignore=tests/analytics_es_tests/ --rootdir=/__w/sample_repo/sample_repo/test/app/../..

Groups were wrong, tests were repeated between the groups.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant