GSoC 2023 Term: AQAvit Assessment and Prioritization

Related to Measure the effectiveness and efficiency of our testing issue and one of the key criteria in the AQAvit manifesto (particularly Section 2.3.3 Codecov & Other Metrics), we want to select Key Performance Indicators (KPI) and metrics that allow us to assess and edit AQvit in order to keep it vital and relevant to those who use it.

This project proposal would have a GSoC intern look at various ways that we assess the test material that we include. This project aims to provide us with tools and ways to help answer the question: "how effective is this test at finding defects?".

This project is proposed to be 350 hrs.

Part 1: KPIs

Determine an initial set of KPIs to use within the scope of this project

Part 2: Assess state of the art

Investigate the current state of the art and available open-source tools that could potentially be used

Part 3: Integrate and Create Tools

Integrate open-source tooling and/or create scripts/tools that collect and compare the KPIs and generate standard form of report (and can be scheduled to run regularly)

Part 4: Document

Document the outcomes of the project

Mentors: Lan Xia, Renfei Wang, Shelley Lambert

Additional consultant mentors: Sophia Guo