Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

ci: speedup ci for feature branches #183

Merged
merged 5 commits into from
Nov 24, 2023
Merged

ci: speedup ci for feature branches #183

merged 5 commits into from
Nov 24, 2023

Conversation

Hyxogen
Copy link
Contributor

@Hyxogen Hyxogen commented Nov 23, 2023

Merge this PR after #182

This PR has a few optimizations to the ci on feature branches, speeding it up to about 30 minutes total.

These are mostly low hanging fruit like:

  • Disabling macos/windows builds on feature branches
  • Doing shallow clones for jobs that run on feature branches
  • Running tests in parallel

There's still some other low hanging fruit out there, like:

  • Using zstd instead of bzip2 for compression (a quick local test show that it will probably save up to 2 minutes of the total ci time)
  • Even more parallelization of the tests (primarily the llvm ones)

I thought circleci's caching worked by exact matching the cache key,
however, after seeing the ci not updating the cache I learned that the
key is prefix matched. Changed so that it appends the time to the cache
for unique cache keys.

I've also added the branch name to the cache to avoid cache trashing.
.circleci/config.yml Outdated Show resolved Hide resolved
.circleci/config.yml Show resolved Hide resolved
Apparently, the working directory is different for when running check
and check-llvm, thus try both possible locations for test1.ll.

This change will make the ci run about ~50 tests less than when running
with all tests with the "check" rule. These tests are for llvm-lit.
@yuri91
Copy link
Member

yuri91 commented Nov 24, 2023

Is this ready now?
also, this includes the other ci PR about the cache right?

@Hyxogen
Copy link
Contributor Author

Hyxogen commented Nov 24, 2023

@yuri91 If all passes then it should be good. And yes, it contains the PR about the cache

@yuri91 yuri91 merged commit 2255fff into master Nov 24, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants