(Please read a supplementary description here: https://gtdir.wordpress.com/2016/03/02/fuzz-testing/)
To isolate errors through identifying groups of parameter combinations that cause them.
Tests all possible combinations of argument values for any function to produce test statistics and graphs to help identify and fix defects faster than by using more traditional approaches. The key feature of the package is its ability to present multiple test results in a very compact form.
Every run automatically creates data for unit testing. Simply compare saved "reference" results against the ongoing development results. For now, one can check them by loading data files with test results and checking whether exit status is identical for all combinations of input parameters. (Timestamped data is saved in a current work directory after every test.)
- To arrange axes on a parallel plot automatically based on a relative influence of a particular parameter to make the visual analysis faster.
- To enable automatic comparison and visualization of a current test against saved reference data.
- To report "incremental" "PASS/FAIL" i.e. only differences between the current test and previously recorded reference data.
Below are a several demo test graphs showing parameter settings leading to function failures (in color). Axes are used only to order and group tests by cardinal_numbers of argument parameters.
PASS Results Only
FAIL Results Only
