Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Run system-tests scenarios related to RASP #7947

Merged
merged 3 commits into from
Nov 22, 2024
Merged

Run system-tests scenarios related to RASP #7947

merged 3 commits into from
Nov 22, 2024

Conversation

smola
Copy link
Member

@smola smola commented Nov 13, 2024 •
edited
Loading

What Does This Do

Add the following system-tests scenarios relevant to the upcoming GA release of Exploit Prevention (aka RASP):

  • APPSEC_RASP
  • APPSEC_RUNTIME_ACTIVATION
  • REMOTE_CONFIG_MOCKED_BACKEND_ASM_DD

And the following related to blocking:

  • APPSEC_BLOCKING
  • APPSEC_REQUEST_BLOCKING.

Motivation

Additional Notes

Contributor Checklist

Jira ticket: APPSEC-55833

@smola smola added comp: testing Testing tag: no release notes Changes to exclude from release notes comp: asm waf Application Security Management (WAF) labels Nov 13, 2024
@pr-commenter
Copy link

pr-commenter bot commented Nov 13, 2024 •
edited
Loading

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master smola/rasp-system-tests
git_commit_date 1732203227 1732204506
git_commit_sha 603ef41 75f2943
release_version 1.43.0-SNAPSHOT~603ef416b6 1.43.0-SNAPSHOT~75f2943c24
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1732206816 1732206816
ci_job_id 715642132 715642132
ci_pipeline_id 49623721 49623721
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
module Agent Agent
parent None None
variant iast iast

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 54 metrics, 9 unstable metrics.

Startup time reports for petclinic 
gantt
    title petclinic - global startup overhead: candidate=1.43.0-SNAPSHOT~75f2943c24, baseline=1.43.0-SNAPSHOT~603ef416b6

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.105 s) : 0, 1104703
Total [baseline] (10.511 s) : 0, 10510937
Agent [candidate] (1.091 s) : 0, 1091389
Total [candidate] (10.484 s) : 0, 10483766
section appsec
Agent [baseline] (1.23 s) : 0, 1229913
Total [baseline] (10.775 s) : 0, 10775104
Agent [candidate] (1.223 s) : 0, 1223129
Total [candidate] (10.744 s) : 0, 10744073
section iast
Agent [baseline] (1.215 s) : 0, 1215202
Total [baseline] (10.915 s) : 0, 10915406
Agent [candidate] (1.216 s) : 0, 1216091
Total [candidate] (10.892 s) : 0, 10891838
section profiling
Agent [baseline] (1.286 s) : 0, 1285636
Total [baseline] (10.799 s) : 0, 10799484
Agent [candidate] (1.286 s) : 0, 1285931
Total [candidate] (10.776 s) : 0, 10776414
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.105 s -
Agent appsec 1.23 s 125.209 ms (11.3%)
Agent iast 1.215 s 110.499 ms (10.0%)
Agent profiling 1.286 s 180.932 ms (16.4%)
Total tracing 10.511 s -
Total appsec 10.775 s 264.168 ms (2.5%)
Total iast 10.915 s 404.469 ms (3.8%)
Total profiling 10.799 s 288.547 ms (2.7%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.091 s -
Agent appsec 1.223 s 131.741 ms (12.1%)
Agent iast 1.216 s 124.703 ms (11.4%)
Agent profiling 1.286 s 194.543 ms (17.8%)
Total tracing 10.484 s -
Total appsec 10.744 s 260.307 ms (2.5%)
Total iast 10.892 s 408.072 ms (3.9%)
Total profiling 10.776 s 292.648 ms (2.8%) 
gantt
    title petclinic - break down per module: candidate=1.43.0-SNAPSHOT~75f2943c24, baseline=1.43.0-SNAPSHOT~603ef416b6

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (702.62 ms) : 0, 702620
BytebuddyAgent [candidate] (692.392 ms) : 0, 692392
GlobalTracer [baseline] (321.0 ms) : 0, 321000
GlobalTracer [candidate] (318.74 ms) : 0, 318740
AppSec [baseline] (55.696 ms) : 0, 55696
AppSec [candidate] (55.038 ms) : 0, 55038
Remote Config [baseline] (697.448 µs) : 0, 697
Remote Config [candidate] (692.1 µs) : 0, 692
Telemetry [baseline] (10.826 ms) : 0, 10826
Telemetry [candidate] (10.829 ms) : 0, 10829
section appsec
BytebuddyAgent [baseline] (713.88 ms) : 0, 713880
BytebuddyAgent [candidate] (710.47 ms) : 0, 710470
GlobalTracer [baseline] (315.552 ms) : 0, 315552
GlobalTracer [candidate] (313.711 ms) : 0, 313711
AppSec [baseline] (167.392 ms) : 0, 167392
AppSec [candidate] (166.389 ms) : 0, 166389
Remote Config [baseline] (657.856 µs) : 0, 658
Remote Config [candidate] (649.939 µs) : 0, 650
Telemetry [baseline] (8.364 ms) : 0, 8364
Telemetry [candidate] (7.881 ms) : 0, 7881
IAST [baseline] (20.574 ms) : 0, 20574
IAST [candidate] (20.663 ms) : 0, 20663
section iast
BytebuddyAgent [baseline] (808.48 ms) : 0, 808480
BytebuddyAgent [candidate] (808.943 ms) : 0, 808943
GlobalTracer [baseline] (306.137 ms) : 0, 306137
GlobalTracer [candidate] (306.329 ms) : 0, 306329
AppSec [baseline] (57.203 ms) : 0, 57203
AppSec [candidate] (57.307 ms) : 0, 57307
Remote Config [baseline] (609.575 µs) : 0, 610
Remote Config [candidate] (632.401 µs) : 0, 632
Telemetry [baseline] (7.458 ms) : 0, 7458
Telemetry [candidate] (7.481 ms) : 0, 7481
IAST [baseline] (21.625 ms) : 0, 21625
IAST [candidate] (21.705 ms) : 0, 21705
section profiling
BytebuddyAgent [baseline] (685.731 ms) : 0, 685731
BytebuddyAgent [candidate] (686.133 ms) : 0, 686133
GlobalTracer [baseline] (400.252 ms) : 0, 400252
GlobalTracer [candidate] (399.978 ms) : 0, 399978
AppSec [baseline] (55.249 ms) : 0, 55249
AppSec [candidate] (55.148 ms) : 0, 55148
Remote Config [baseline] (690.06 µs) : 0, 690
Remote Config [candidate] (667.079 µs) : 0, 667
Telemetry [baseline] (12.818 ms) : 0, 12818
Telemetry [candidate] (10.73 ms) : 0, 10730
ProfilingAgent [baseline] (91.94 ms) : 0, 91940
ProfilingAgent [candidate] (94.3 ms) : 0, 94300
Profiling [baseline] (91.963 ms) : 0, 91963
Profiling [candidate] (94.325 ms) : 0, 94325
Loading
Startup time reports for insecure-bank 
gantt
    title insecure-bank - global startup overhead: candidate=1.43.0-SNAPSHOT~75f2943c24, baseline=1.43.0-SNAPSHOT~603ef416b6

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.094 s) : 0, 1094014
Total [baseline] (8.672 s) : 0, 8671994
Agent [candidate] (1.089 s) : 0, 1089175
Total [candidate] (8.655 s) : 0, 8655083
section iast
Agent [baseline] (1.217 s) : 0, 1216599
Total [baseline] (9.166 s) : 0, 9166200
Agent [candidate] (1.219 s) : 0, 1219048
Total [candidate] (9.177 s) : 0, 9176675
section iast_HARDCODED_SECRET_DISABLED
Agent [baseline] (1.223 s) : 0, 1223432
Total [baseline] (9.161 s) : 0, 9160698
Agent [candidate] (1.216 s) : 0, 1216095
Total [candidate] (9.136 s) : 0, 9136203
section iast_TELEMETRY_OFF
Agent [baseline] (1.222 s) : 0, 1222150
Total [baseline] (9.233 s) : 0, 9233390
Agent [candidate] (1.211 s) : 0, 1211392
Total [candidate] (9.168 s) : 0, 9167857
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.094 s -
Agent iast 1.217 s 122.585 ms (11.2%)
Agent iast_HARDCODED_SECRET_DISABLED 1.223 s 129.418 ms (11.8%)
Agent iast_TELEMETRY_OFF 1.222 s 128.136 ms (11.7%)
Total tracing 8.672 s -
Total iast 9.166 s 494.206 ms (5.7%)
Total iast_HARDCODED_SECRET_DISABLED 9.161 s 488.704 ms (5.6%)
Total iast_TELEMETRY_OFF 9.233 s 561.396 ms (6.5%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.089 s -
Agent iast 1.219 s 129.873 ms (11.9%)
Agent iast_HARDCODED_SECRET_DISABLED 1.216 s 126.92 ms (11.7%)
Agent iast_TELEMETRY_OFF 1.211 s 122.217 ms (11.2%)
Total tracing 8.655 s -
Total iast 9.177 s 521.592 ms (6.0%)
Total iast_HARDCODED_SECRET_DISABLED 9.136 s 481.12 ms (5.6%)
Total iast_TELEMETRY_OFF 9.168 s 512.774 ms (5.9%) 
gantt
    title insecure-bank - break down per module: candidate=1.43.0-SNAPSHOT~75f2943c24, baseline=1.43.0-SNAPSHOT~603ef416b6

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (696.859 ms) : 0, 696859
BytebuddyAgent [candidate] (693.191 ms) : 0, 693191
GlobalTracer [baseline] (318.282 ms) : 0, 318282
GlobalTracer [candidate] (317.173 ms) : 0, 317173
AppSec [baseline] (55.063 ms) : 0, 55063
AppSec [candidate] (55.005 ms) : 0, 55005
Remote Config [baseline] (684.708 µs) : 0, 685
Remote Config [candidate] (691.744 µs) : 0, 692
Telemetry [baseline] (9.305 ms) : 0, 9305
Telemetry [candidate] (9.358 ms) : 0, 9358
section iast
BytebuddyAgent [baseline] (810.155 ms) : 0, 810155
BytebuddyAgent [candidate] (810.798 ms) : 0, 810798
GlobalTracer [baseline] (305.908 ms) : 0, 305908
GlobalTracer [candidate] (307.973 ms) : 0, 307973
AppSec [baseline] (58.137 ms) : 0, 58137
AppSec [candidate] (57.863 ms) : 0, 57863
IAST [baseline] (20.67 ms) : 0, 20670
IAST [candidate] (20.687 ms) : 0, 20687
Remote Config [baseline] (610.251 µs) : 0, 610
Remote Config [candidate] (612.91 µs) : 0, 613
Telemetry [baseline] (7.427 ms) : 0, 7427
Telemetry [candidate] (7.42 ms) : 0, 7420
section iast_HARDCODED_SECRET_DISABLED
BytebuddyAgent [baseline] (814.289 ms) : 0, 814289
BytebuddyAgent [candidate] (808.636 ms) : 0, 808636
GlobalTracer [baseline] (308.071 ms) : 0, 308071
GlobalTracer [candidate] (306.551 ms) : 0, 306551
AppSec [baseline] (57.433 ms) : 0, 57433
AppSec [candidate] (57.238 ms) : 0, 57238
IAST [baseline] (21.639 ms) : 0, 21639
IAST [candidate] (21.769 ms) : 0, 21769
Remote Config [baseline] (620.869 µs) : 0, 621
Remote Config [candidate] (629.621 µs) : 0, 630
Telemetry [baseline] (7.552 ms) : 0, 7552
Telemetry [candidate] (7.545 ms) : 0, 7545
section iast_TELEMETRY_OFF
BytebuddyAgent [baseline] (811.477 ms) : 0, 811477
BytebuddyAgent [candidate] (805.789 ms) : 0, 805789
GlobalTracer [baseline] (309.477 ms) : 0, 309477
GlobalTracer [candidate] (305.587 ms) : 0, 305587
AppSec [baseline] (57.821 ms) : 0, 57821
AppSec [candidate] (57.867 ms) : 0, 57867
IAST [baseline] (21.566 ms) : 0, 21566
IAST [candidate] (20.376 ms) : 0, 20376
Remote Config [baseline] (629.429 µs) : 0, 629
Remote Config [candidate] (634.236 µs) : 0, 634
Telemetry [baseline] (7.483 ms) : 0, 7483
Telemetry [candidate] (7.424 ms) : 0, 7424
Loading

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
end_time 2024-11-21T16:03:48 2024-11-21T16:10:45
git_branch master smola/rasp-system-tests
git_commit_date 1732203227 1732204506
git_commit_sha 603ef41 75f2943
release_version 1.43.0-SNAPSHOT~603ef416b6 1.43.0-SNAPSHOT~75f2943c24
start_time 2024-11-21T16:03:35 2024-11-21T16:10:31
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1732205795 1732205795
ci_job_id 715642134 715642134
ci_pipeline_id 49623721 49623721
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
variant iast iast

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 17 unstable metrics.

Request duration reports for petclinic 
gantt
    title petclinic - request duration [CI 0.99] : candidate=1.43.0-SNAPSHOT~75f2943c24, baseline=1.43.0-SNAPSHOT~603ef416b6
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.359 ms) : 1340, 1379
.   : milestone, 1359,
appsec (1.725 ms) : 1702, 1748
.   : milestone, 1725,
appsec_no_iast (1.769 ms) : 1745, 1793
.   : milestone, 1769,
iast (1.516 ms) : 1494, 1538
.   : milestone, 1516,
profiling (1.496 ms) : 1474, 1519
.   : milestone, 1496,
tracing (1.475 ms) : 1450, 1500
.   : milestone, 1475,
section candidate
no_agent (1.353 ms) : 1333, 1372
.   : milestone, 1353,
appsec (1.733 ms) : 1708, 1758
.   : milestone, 1733,
appsec_no_iast (1.731 ms) : 1705, 1757
.   : milestone, 1731,
iast (1.497 ms) : 1474, 1519
.   : milestone, 1497,
profiling (1.49 ms) : 1466, 1514
.   : milestone, 1490,
tracing (1.47 ms) : 1445, 1495
.   : milestone, 1470,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.359 ms [1.34 ms, 1.379 ms] -
appsec 1.725 ms [1.702 ms, 1.748 ms] 365.472 µs (26.9%)
appsec_no_iast 1.769 ms [1.745 ms, 1.793 ms] 409.442 µs (30.1%)
iast 1.516 ms [1.494 ms, 1.538 ms] 156.133 µs (11.5%)
profiling 1.496 ms [1.474 ms, 1.519 ms] 136.869 µs (10.1%)
tracing 1.475 ms [1.45 ms, 1.5 ms] 115.238 µs (8.5%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.353 ms [1.333 ms, 1.372 ms] -
appsec 1.733 ms [1.708 ms, 1.758 ms] 380.168 µs (28.1%)
appsec_no_iast 1.731 ms [1.705 ms, 1.757 ms] 378.205 µs (28.0%)
iast 1.497 ms [1.474 ms, 1.519 ms] 144.016 µs (10.6%)
profiling 1.49 ms [1.466 ms, 1.514 ms] 137.098 µs (10.1%)
tracing 1.47 ms [1.445 ms, 1.495 ms] 117.443 µs (8.7%)
Request duration reports for insecure-bank 
gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.43.0-SNAPSHOT~75f2943c24, baseline=1.43.0-SNAPSHOT~603ef416b6
    dateFormat X
    axisFormat %s
section baseline
no_agent (368.602 µs) : 349, 389
.   : milestone, 369,
iast (483.146 µs) : 462, 505
.   : milestone, 483,
iast_FULL (646.897 µs) : 625, 668
.   : milestone, 647,
iast_GLOBAL (510.448 µs) : 489, 532
.   : milestone, 510,
iast_HARDCODED_SECRET_DISABLED (484.849 µs) : 464, 506
.   : milestone, 485,
iast_INACTIVE (447.192 µs) : 426, 468
.   : milestone, 447,
iast_TELEMETRY_OFF (483.513 µs) : 461, 506
.   : milestone, 484,
tracing (439.128 µs) : 419, 460
.   : milestone, 439,
section candidate
no_agent (369.588 µs) : 350, 389
.   : milestone, 370,
iast (482.893 µs) : 461, 505
.   : milestone, 483,
iast_FULL (648.767 µs) : 627, 670
.   : milestone, 649,
iast_GLOBAL (518.875 µs) : 496, 541
.   : milestone, 519,
iast_HARDCODED_SECRET_DISABLED (489.971 µs) : 468, 512
.   : milestone, 490,
iast_INACTIVE (443.151 µs) : 422, 464
.   : milestone, 443,
iast_TELEMETRY_OFF (476.478 µs) : 455, 498
.   : milestone, 476,
tracing (440.607 µs) : 420, 461
.   : milestone, 441,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 368.602 µs [348.67 µs, 388.534 µs] -
iast 483.146 µs [461.544 µs, 504.748 µs] 114.544 µs (31.1%)
iast_FULL 646.897 µs [625.449 µs, 668.344 µs] 278.294 µs (75.5%)
iast_GLOBAL 510.448 µs [488.914 µs, 531.983 µs] 141.846 µs (38.5%)
iast_HARDCODED_SECRET_DISABLED 484.849 µs [463.616 µs, 506.081 µs] 116.247 µs (31.5%)
iast_INACTIVE 447.192 µs [426.157 µs, 468.227 µs] 78.59 µs (21.3%)
iast_TELEMETRY_OFF 483.513 µs [461.056 µs, 505.969 µs] 114.91 µs (31.2%)
tracing 439.128 µs [418.574 µs, 459.683 µs] 70.526 µs (19.1%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 369.588 µs [349.947 µs, 389.228 µs] -
iast 482.893 µs [461.119 µs, 504.667 µs] 113.305 µs (30.7%)
iast_FULL 648.767 µs [627.116 µs, 670.418 µs] 279.179 µs (75.5%)
iast_GLOBAL 518.875 µs [496.281 µs, 541.47 µs] 149.288 µs (40.4%)
iast_HARDCODED_SECRET_DISABLED 489.971 µs [468.367 µs, 511.575 µs] 120.383 µs (32.6%)
iast_INACTIVE 443.151 µs [422.392 µs, 463.91 µs] 73.564 µs (19.9%)
iast_TELEMETRY_OFF 476.478 µs [455.044 µs, 497.911 µs] 106.89 µs (28.9%)
tracing 440.607 µs [419.845 µs, 461.368 µs] 71.019 µs (19.2%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master smola/rasp-system-tests
git_commit_date 1732203227 1732204506
git_commit_sha 603ef41 75f2943
release_version 1.43.0-SNAPSHOT~603ef416b6 1.43.0-SNAPSHOT~75f2943c24
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1732206331 1732206331
ci_job_id 715642136 715642136
ci_pipeline_id 49623721 49623721
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
variant appsec appsec

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 12 metrics, 0 unstable metrics.

Execution time for biojava 
gantt
    title biojava - execution time [CI 0.99] : candidate=1.43.0-SNAPSHOT~75f2943c24, baseline=1.43.0-SNAPSHOT~603ef416b6
    dateFormat X
    axisFormat %s
section baseline
no_agent (15.483 s) : 15483000, 15483000
.   : milestone, 15483000,
appsec (15.087 s) : 15087000, 15087000
.   : milestone, 15087000,
iast (18.792 s) : 18792000, 18792000
.   : milestone, 18792000,
iast_GLOBAL (17.736 s) : 17736000, 17736000
.   : milestone, 17736000,
profiling (14.899 s) : 14899000, 14899000
.   : milestone, 14899000,
tracing (15.131 s) : 15131000, 15131000
.   : milestone, 15131000,
section candidate
no_agent (15.436 s) : 15436000, 15436000
.   : milestone, 15436000,
appsec (14.881 s) : 14881000, 14881000
.   : milestone, 14881000,
iast (18.458 s) : 18458000, 18458000
.   : milestone, 18458000,
iast_GLOBAL (18.161 s) : 18161000, 18161000
.   : milestone, 18161000,
profiling (14.833 s) : 14833000, 14833000
.   : milestone, 14833000,
tracing (14.843 s) : 14843000, 14843000
.   : milestone, 14843000,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.483 s [15.483 s, 15.483 s] -
appsec 15.087 s [15.087 s, 15.087 s] -396.0 ms (-2.6%)
iast 18.792 s [18.792 s, 18.792 s] 3.309 s (21.4%)
iast_GLOBAL 17.736 s [17.736 s, 17.736 s] 2.253 s (14.6%)
profiling 14.899 s [14.899 s, 14.899 s] -584.0 ms (-3.8%)
tracing 15.131 s [15.131 s, 15.131 s] -352.0 ms (-2.3%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.436 s [15.436 s, 15.436 s] -
appsec 14.881 s [14.881 s, 14.881 s] -555.0 ms (-3.6%)
iast 18.458 s [18.458 s, 18.458 s] 3.022 s (19.6%)
iast_GLOBAL 18.161 s [18.161 s, 18.161 s] 2.725 s (17.7%)
profiling 14.833 s [14.833 s, 14.833 s] -603.0 ms (-3.9%)
tracing 14.843 s [14.843 s, 14.843 s] -593.0 ms (-3.8%)
Execution time for tomcat 
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.43.0-SNAPSHOT~75f2943c24, baseline=1.43.0-SNAPSHOT~603ef416b6
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.463 ms) : 1452, 1475
.   : milestone, 1463,
appsec (2.322 ms) : 2282, 2363
.   : milestone, 2322,
iast (2.069 ms) : 2018, 2121
.   : milestone, 2069,
iast_GLOBAL (2.106 ms) : 2053, 2158
.   : milestone, 2106,
profiling (1.962 ms) : 1919, 2006
.   : milestone, 1962,
tracing (1.917 ms) : 1877, 1957
.   : milestone, 1917,
section candidate
no_agent (1.459 ms) : 1448, 1471
.   : milestone, 1459,
appsec (2.329 ms) : 2288, 2370
.   : milestone, 2329,
iast (2.074 ms) : 2022, 2126
.   : milestone, 2074,
iast_GLOBAL (2.112 ms) : 2060, 2164
.   : milestone, 2112,
profiling (1.959 ms) : 1916, 2002
.   : milestone, 1959,
tracing (1.917 ms) : 1877, 1957
.   : milestone, 1917,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.463 ms [1.452 ms, 1.475 ms] -
appsec 2.322 ms [2.282 ms, 2.363 ms] 859.26 µs (58.7%)
iast 2.069 ms [2.018 ms, 2.121 ms] 606.278 µs (41.4%)
iast_GLOBAL 2.106 ms [2.053 ms, 2.158 ms] 642.43 µs (43.9%)
profiling 1.962 ms [1.919 ms, 2.006 ms] 499.3 µs (34.1%)
tracing 1.917 ms [1.877 ms, 1.957 ms] 454.21 µs (31.0%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.459 ms [1.448 ms, 1.471 ms] -
appsec 2.329 ms [2.288 ms, 2.37 ms] 869.21 µs (59.6%)
iast 2.074 ms [2.022 ms, 2.126 ms] 614.206 µs (42.1%)
iast_GLOBAL 2.112 ms [2.06 ms, 2.164 ms] 652.426 µs (44.7%)
profiling 1.959 ms [1.916 ms, 2.002 ms] 499.578 µs (34.2%)
tracing 1.917 ms [1.877 ms, 1.957 ms] 457.576 µs (31.4%)

@smola smola force-pushed the smola/rasp-system-tests branch 4 times, most recently from cba1807 to 4fff3d5 Compare November 15, 2024 07:29
@smola smola marked this pull request as ready for review November 21, 2024 15:30
@smola smola requested a review from a team as a code owner November 21, 2024 15:30
@smola smola requested a review from mcculls November 21, 2024 15:30
@smola smola merged commit c5cda3f into master Nov 22, 2024
102 checks passed
@smola smola deleted the smola/rasp-system-tests branch November 22, 2024 09:45
@github-actions github-actions bot added this to the 1.43.0 milestone Nov 22, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@jandro996 jandro996 jandro996 approved these changes

@ValentinZakharov ValentinZakharov ValentinZakharov approved these changes

@mcculls mcculls Awaiting requested review from mcculls mcculls is a code owner automatically assigned from DataDog/apm-java

Assignees
No one assigned
Labels
comp: asm waf Application Security Management (WAF) comp: testing Testing tag: no release notes Changes to exclude from release notes
Projects
None yet
Milestone
1.43.0
Development

Successfully merging this pull request may close these issues.
3 participants
@smola @ValentinZakharov @jandro996