Skip to content

Commit

Permalink
Adjust cron
Browse files Browse the repository at this point in the history
  • Loading branch information
triceo committed Oct 3, 2024
1 parent 62cdf76 commit 813d171
Show file tree
Hide file tree
Showing 2 changed files with 13 additions and 4 deletions.
14 changes: 12 additions & 2 deletions .github/workflows/nightly_performance_score_director.yml
Original file line number Diff line number Diff line change
Expand Up @@ -2,13 +2,23 @@ name: Schedule a nightly run of the Score Director performance benchmark

on:
schedule:
- cron: '0 0 * * *' # Every day at the start of the day
- cron: '59 23 * * 1-5' # Every workday at the end of the day.

jobs:
trigger:
runs-on: ubuntu-latest
steps:
- name: Checkout timefold-solver
uses: actions/checkout@v4
with:
repository: TimefoldAI/timefold-solver
- name: Schedule the other workflow
shell: bash
run: |
echo '{}' | gh workflow run performance_score_director.yml --json
if git log --since="24 hours ago" --oneline | grep -q .; then
echo '{}' | gh workflow run performance_score_director.yml --json
echo "Launched nightly perf tests." >> $GITHUB_STEP_SUMMARY
else
# Don't waste money.
echo "No commits in the past 24 hours." >> $GITHUB_STEP_SUMMARY
fi
3 changes: 1 addition & 2 deletions .github/workflows/performance_score_director.yml
Original file line number Diff line number Diff line change
Expand Up @@ -2,8 +2,7 @@
# - The baseline is established first, then the branch under test is measured.
# - Each benchmark gives a 99.9 % confidence interval.
# - The confidence intervals are compared to determine if the branch under test is a regression or an improvement.
# - The error threshold is expected to be below +/- 2.5 %,
# but sometimes it gets higher due to the nature of public GitHub runners.
# - The error threshold is expected to be below +/- 2.5 %.
# We have yet to see an error of over +/- 4 %.
# With the error so high, the impact is that small regressions are not considered statistically significant.
name: Performance Regression Test - Score Director
Expand Down

0 comments on commit 813d171

Please sign in to comment.