Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Rebase oss-fuzz onto master #4593

Open
wants to merge 78 commits into
base: master
Choose a base branch
from
Open
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
78 commits
Select commit Hold shift + click to select a range
0136b91
[oss-fuzz] Run every preprocess in preprocess pool (#4435)
jonathanmetzman Nov 26, 2024
1ed1f33
Merge master into oss-fuzz (#4449)
jonathanmetzman Nov 26, 2024
cffa277
Fix issue scheduling tasks on preprocess queue (#4451)
jonathanmetzman Nov 26, 2024
e996e23
Support multiple regions in batch (#4453)
jonathanmetzman Nov 26, 2024
4553b7c
Increase fuzz tasks scheduled from 1250->2000 every 5 minutes (#4450)
jonathanmetzman Nov 26, 2024
d220483
Fix bug in schedule_fuzz (#4454)
jonathanmetzman Nov 27, 2024
02bc46d
Make subconfigs weighted (#4456)
jonathanmetzman Nov 27, 2024
c8a1809
Increase fuzzing on batch (#4457)
jonathanmetzman Nov 27, 2024
9d80b52
Increase scheduled fuzz tasks to 6000 (#4460)
jonathanmetzman Nov 28, 2024
2e4d029
Improve throughput of utask_main scheduling (#4461)
jonathanmetzman Nov 28, 2024
afc41b6
Optimize corpus signing by 6-8% (#4462)
jonathanmetzman Nov 28, 2024
25b1452
Try to bunch tasks on batch more efficiently (#4464)
jonathanmetzman Nov 28, 2024
3f87c5d
Bunch more aggressively, but schedule less tasks (#4465)
jonathanmetzman Nov 28, 2024
ecdd32a
Delete trusted_host implementation of corpus pruning. (#4466)
jonathanmetzman Dec 1, 2024
d96fd52
Schedule more fuzzing jobs in us-east4 to test new batch limit (#4470)
jonathanmetzman Dec 2, 2024
8cf9ef0
End experiment saturating fuzzing (#4471)
jonathanmetzman Dec 3, 2024
1dd0028
Delete trusted_host implementation of minimize (#4469)
jonathanmetzman Dec 6, 2024
bf00a26
Fix case when tasks received
jonathanmetzman Dec 6, 2024
af513f8
Fix putting tasks on queue (#4477)
jonathanmetzman Dec 7, 2024
48deb2a
undo accidental change
jonathanmetzman Dec 7, 2024
eec1947
Increase fuzz task scheduling
jonathanmetzman Dec 16, 2024
f2c1504
Fix task retrying
jonathanmetzman Dec 16, 2024
272f205
Fix off by one error in assertion (#4520)
jonathanmetzman Dec 18, 2024
ca66a42
Reduce number of scheduled fuzz tasks.
jonathanmetzman Dec 18, 2024
78374cb
Support multiple regions for schedule_fuzz_task.py (#4525)
jonathanmetzman Dec 19, 2024
024062d
Try scheduling as much as available (#4528)
jonathanmetzman Dec 20, 2024
05c9173
Mitigate https://github.com/google/oss-fuzz/issues/12519
jonathanmetzman Dec 22, 2024
9f18052
Mitigate https://github.com/google/oss-fuzz/issues/12519
jonathanmetzman Dec 22, 2024
233d773
Fix lint error (#4552)
jonathanmetzman Dec 26, 2024
8636f73
Fix failing unittest (#4557)
jonathanmetzman Dec 26, 2024
6ee8cff
Run postprocess on tworkers (#4556)
jonathanmetzman Dec 26, 2024
d60d9dc
Delete OSSFuzzClustersManager (#4553)
jonathanmetzman Dec 26, 2024
5e63821
Bound preprocess and parallel signing calls (#4564)
jonathanmetzman Dec 27, 2024
a192ff0
Revert 4564 and 4528 (#4568)
vitorguidi Dec 28, 2024
34f675f
Correctly fetch batch regions in fuzz task (#4569)
vitorguidi Dec 28, 2024
9e9c4c7
Reland #4565 and #4528 and fix issues. (#4570)
jonathanmetzman Dec 30, 2024
538828c
Log exceptions in cron jobs. (#4571)
jonathanmetzman Jan 2, 2025
5157e6e
Ensure we don't rerun utaks on expired signed URLs for uworker_input.…
jonathanmetzman Jan 2, 2025
358b2d8
Fix catching of own exception (#4574)
jonathanmetzman Jan 2, 2025
c53e10a
Fix error checking (#4576)
jonathanmetzman Jan 2, 2025
fe92691
Make schedule_fuzz conform to cronjob API. (#4577)
jonathanmetzman Jan 2, 2025
619bbd9
Fix counting batch jobs (#4578)
jonathanmetzman Jan 2, 2025
607f8c4
Log time series that failed to upload (#4584)
vitorguidi Jan 7, 2025
45c2161
Allow scheduling more fuzz tasks at one time. (#4585)
jonathanmetzman Jan 8, 2025
ab184b0
[schedule_fuzz] Handle cases where no tasks waiting on queue (#4589)
jonathanmetzman Jan 8, 2025
4077b7f
[Monitoring] Adding a metric for task outcome (#4458)
vitorguidi Dec 10, 2024
270ee86
[Monitoring] Add logging to understand stuck testcases (#4489)
vitorguidi Dec 11, 2024
8c575e4
Logging successful task executions in utask _MetricRecorder (#4492)
vitorguidi Dec 11, 2024
94763ad
[Monitoring] Fix untriaged testcase age oversampling, add untriaged t…
vitorguidi Dec 12, 2024
4ecbd36
[Monitoring] Remove granularity for stuck testcases metric (#4496)
vitorguidi Dec 12, 2024
d4b7c81
[Monitoring] Enable job and status granularity in UNTRIAGED_TESTCASE_…
vitorguidi Dec 13, 2024
1138b48
[Monitoring] Fix bad metric value for UNTRIAGED_TESTCASE_COUNT (#4502)
vitorguidi Dec 13, 2024
11fec77
[Monitoring] Partition uworker_output.ErrorType conditions into succe…
vitorguidi Dec 16, 2024
7db9425
[Monitoring] Extend TESTCASE_UPLOAD_TRIAGE_DURATION to account for fu…
vitorguidi Dec 16, 2024
70b2fd3
Revert #4499 (#4512)
vitorguidi Dec 17, 2024
fec83a5
Add Fuzzilli cases to the test-input archive (#4504)
mi-ac Dec 17, 2024
c2641c8
Allow configuring default corpora bucket location. (#4479)
letitz Dec 17, 2024
fa765db
Fix fetching paginated results with a filter. (#4511)
jonathanmetzman Dec 17, 2024
24ed1ff
Modify get_fastboot_path() to allow for custom binaries (#4518)
marktefftech Dec 18, 2024
b4e5892
Don't allow Friday deploys in Chrome. (#4513)
jonathanmetzman Dec 18, 2024
737766b
Enable skipping minimization with an env var (#4526)
mi-ac Dec 20, 2024
4e9615e
Fix archiving Fuzzilli test cases (#4531)
mi-ac Dec 20, 2024
5024aef
[Monitoring] Partition UTask outcomes correctly into success and erro…
vitorguidi Dec 23, 2024
644928f
[Monitoring] Enrich UNTRIAGED_TESTCASE_AGE metric to track testcases …
vitorguidi Dec 23, 2024
073244c
Close old non reproducible bugs (#4530)
pgrace-google Dec 26, 2024
e93e028
Remove unused reload gesture (#4207)
jonathanmetzman Dec 26, 2024
407d0a8
[NFC] Modernize string formatting in fuzz_task.py (#3811)
jonathanmetzman Dec 26, 2024
4ac4b43
[Monitoring] Create a dashboard for overall clusterfuzz health (#4497)
vitorguidi Dec 26, 2024
08e5035
Revert #4497 (#4560)
vitorguidi Dec 26, 2024
12d72ef
[Monitoring] Restore dashboard terraform definition (#4561)
vitorguidi Dec 26, 2024
0abc06d
[Monitoring] Make monitoring reference the secondary project (#4565)
vitorguidi Dec 27, 2024
95df754
[Monitoring] Make appengine crons emit metrics (#4572)
vitorguidi Jan 2, 2025
d0784a3
Fix metrics on GAE cron (#4582)
vitorguidi Jan 7, 2025
2fdb5f6
Add detection for Chromium NOTREACHED()s (#4579)
pbos Jan 8, 2025
7a882f2
Fix trimmed labels being used in other metrics, due to shallow copy (…
vitorguidi Jan 8, 2025
0762939
Reduce bug filing threshold for libfuzzer-based Android crashes (#4474)
AashutoshMurthy Jan 8, 2025
5d87a9f
Fix dashboard escape for $ character in promql queries (#4591)
vitorguidi Jan 8, 2025
e30e60a
Handle null bot name correctly when trying to find region in monitori…
vitorguidi Jan 8, 2025
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
54 changes: 38 additions & 16 deletions configs/test/batch/batch.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -20,10 +20,13 @@ mapping:
disk_size_gb: 110
disk_type: pd-standard
service_account_email: test-clusterfuzz-service-account-email
gce_region: 'gce-region'
gce_zone: 'gce-zone'
network: 'projects/google.com:clusterfuzz/global/networks/networkname'
subnetwork: 'projects/google.com:clusterfuzz/regions/gce-region/subnetworks/subnetworkname'
subconfigs:
-
name: central1-network1
weight: .5
-
name: central1-network2
weight: .5
preemptible: false
machine_type: n1-standard-1
LINUX-NONPREEMPTIBLE-UNPRIVILEGED:
Expand All @@ -33,37 +36,56 @@ mapping:
disk_size_gb: 110
disk_type: pd-standard
service_account_email: test-unpriv-clusterfuzz-service-account-email
gce_region: 'gce-region'
gce_zone: 'gce-zone'
network: 'projects/google.com:clusterfuzz/global/networks/networkname'
subnetwork: 'projects/google.com:clusterfuzz/regions/gce-region/subnetworks/subnetworkname'
preemptible: false
machine_type: n1-standard-1
retry: true
subconfigs:
-
name: central1-network1
weight: .2
-
name: central1-network2
weight: .3
-
name: east4-network2
weight: .5
LINUX-PREEMPTIBLE:
clusterfuzz_release: 'prod'
docker_image: 'gcr.io/clusterfuzz-images/base:a2f4dd6-202202070654'
user_data: 'file://linux-init.yaml'
disk_size_gb: 75
disk_type: pd-standard
service_account_email: test-clusterfuzz-service-account-email
gce_region: 'gce-region'
gce_zone: 'gce-zone'
network: 'projects/google.com:clusterfuzz/global/networks/networkname'
subnetwork: 'projects/google.com:clusterfuzz/regions/gce-region/subnetworks/subnetworkname'
preemptible: true
machine_type: n1-standard-1
subconfigs:
-
name: east4-network2
weight: 1
LINUX-PREEMPTIBLE-UNPRIVILEGED:
clusterfuzz_release: 'prod'
docker_image: 'gcr.io/clusterfuzz-images/base:a2f4dd6-202202070654'
user_data: 'file://linux-init.yaml'
disk_size_gb: 75
disk_type: pd-standard
service_account_email: test-unpriv-clusterfuzz-service-account-email
gce_region: 'gce-region'
gce_zone: 'gce-zone'
network: 'projects/google.com:clusterfuzz/global/networks/networkname'
subnetwork: 'projects/google.com:clusterfuzz/regions/gce-region/subnetworks/subnetworkname'
preemptible: true
machine_type: n1-standard-1
subconfigs:
-
name: east4-network2
weight: 1
project: 'test-clusterfuzz'
subconfigs:
central1-network1:
region: 'us-central1'
network: 'projects/project_name/global/networks/networkname'
subnetwork: 'projects/project_name/regions/us-central1/subnetworks/subnetworkname'
central1-network2:
region: 'us-central1'
network: 'projects/project_name/global/networks/networkname2'
subnetwork: 'projects/project_name/regions/us-central1/subnetworks/subnetworkname2'
east4-network2:
region: 'us-east4'
network: 'projects/project_name/global/networks/networkname2'
subnetwork: 'projects/project_name/regions/us-east4/subnetworks/subnetworkname2'
Loading
Loading