Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

CI: Fix regression test not using main branch code #248

Merged
merged 5 commits into from
Nov 22, 2024
Merged

Conversation

siddharth-krishna
Copy link
Collaborator

@siddharth-krishna siddharth-krishna commented Nov 22, 2024

As noticed by @olejandro in #240 (comment), the CI's regression test seems to not be working, reporting 0 changes even when there should be.

The bug was introduced in 0cb35dc which installed xl2times in CI using the built wheel instead of using the editable install, in order to test that the built package works. Unfortunately, this means that when the regression tester switches to the main branch, it still uses the code from the built package, instead of the main branch.

This PR fixes it by testing the built package, and then reinstalling it in an editable way, so that the regression tests uses whatever code is in the folder.

To check that the regression tests work again, I introduced an intentional regression on this PR's branch, and checked that the regressions are caught in: ce8c853

To check that no regressions were introduced in main in the meantime, I ran the tests on the commit before the bug was introduced, c000f23, and compared it to the results on the latest commit 4ddec68:
image

@siddharth-krishna siddharth-krishna changed the title Test if CI regression test works CI: Fix regression test not using main branch code Nov 22, 2024
@siddharth-krishna siddharth-krishna marked this pull request as ready for review November 22, 2024 08:46
@olejandro
Copy link
Member

Wow! This was an extensive investigative work. Thanks @siddharth-krishna!

@olejandro olejandro merged commit 6efc03f into main Nov 22, 2024
2 checks passed
@olejandro olejandro deleted the sid/test-ci branch November 22, 2024 09:03
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants