Skip to content

Muzzle assertions as junit report, upload to Test Optimization #10591

Open
bric3 wants to merge 5 commits intomasterfrom
bdu/reports-muzzle-assertions-as-junit
Open

Muzzle assertions as junit report, upload to Test Optimization #10591
bric3 wants to merge 5 commits intomasterfrom
bdu/reports-muzzle-assertions-as-junit

Conversation

@bric3
Copy link
Contributor

@bric3 bric3 commented Feb 13, 2026 •
edited
Loading

What Does This Do

This creates a proper JUnit report of muzzle assertions, the reports are properly saved in the job artifacts, and uploaded to the Test Optimization.

image image

Motivation

Observability on our muzzle checks.

Additional Notes

The legacy format which emit shallow reports in the root project appear unused, and I'm debating removing it.

Contributor Checklist

Jira ticket: [PROJ-IDENT]

Note: Once your PR is ready to merge, add it to the merge queue by commenting /merge. /merge -c cancels the queue request. /merge -f --reason "reason" skips all merge queue checks; please use this judiciously, as some checks do not run at the PR-level. For more information, see this doc.

@bric3 bric3 requested review from a team as code owners February 13, 2026 17:11
@bric3 bric3 requested review from PerfectSlayer and TonyCTHsu and removed request for a team February 13, 2026 17:11
@bric3 bric3 added type: enhancement Enhancements and improvements tag: no release notes Changes to exclude from release notes comp: tooling Build & Tooling labels Feb 13, 2026
@bric3 bric3 marked this pull request as draft February 13, 2026 17:12
@pr-commenter
Copy link

pr-commenter bot commented Feb 13, 2026 •
edited
Loading

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master bdu/reports-muzzle-assertions-as-junit
git_commit_date 1771000776 1771063397
git_commit_sha c8216b5 857f6ad
release_version 1.60.0-SNAPSHOT~c8216b560d 1.60.0-SNAPSHOT~857f6addfc
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1771065313 1771065313
ci_job_id 1427119741 1427119741
ci_pipeline_id 96595168 96595168
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-ocq8xzez 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-ocq8xzez 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module Agent Agent
parent None None

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 64 metrics, 7 unstable metrics.

Startup time reports for insecure-bank 
gantt
    title insecure-bank - global startup overhead: candidate=1.60.0-SNAPSHOT~857f6addfc, baseline=1.60.0-SNAPSHOT~c8216b560d

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.06 s) : 0, 1060414
Total [baseline] (8.73 s) : 0, 8729562
Agent [candidate] (1.064 s) : 0, 1063911
Total [candidate] (8.717 s) : 0, 8716546
section iast
Agent [baseline] (1.231 s) : 0, 1231030
Total [baseline] (9.376 s) : 0, 9375601
Agent [candidate] (1.232 s) : 0, 1231818
Total [candidate] (9.318 s) : 0, 9317926
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.06 s -
Agent iast 1.231 s 170.616 ms (16.1%)
Total tracing 8.73 s -
Total iast 9.376 s 646.039 ms (7.4%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.064 s -
Agent iast 1.232 s 167.907 ms (15.8%)
Total tracing 8.717 s -
Total iast 9.318 s 601.38 ms (6.9%) 
gantt
    title insecure-bank - break down per module: candidate=1.60.0-SNAPSHOT~857f6addfc, baseline=1.60.0-SNAPSHOT~c8216b560d

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.188 ms) : 0, 1188
crashtracking [candidate] (1.183 ms) : 0, 1183
BytebuddyAgent [baseline] (627.218 ms) : 0, 627218
BytebuddyAgent [candidate] (628.488 ms) : 0, 628488
AgentMeter [baseline] (28.886 ms) : 0, 28886
AgentMeter [candidate] (28.865 ms) : 0, 28865
GlobalTracer [baseline] (256.477 ms) : 0, 256477
GlobalTracer [candidate] (257.497 ms) : 0, 257497
AppSec [baseline] (32.823 ms) : 0, 32823
AppSec [candidate] (32.721 ms) : 0, 32721
Debugger [baseline] (60.6 ms) : 0, 60600
Debugger [candidate] (61.846 ms) : 0, 61846
Remote Config [baseline] (621.069 µs) : 0, 621
Remote Config [candidate] (630.486 µs) : 0, 630
Telemetry [baseline] (12.09 ms) : 0, 12090
Telemetry [candidate] (12.122 ms) : 0, 12122
Flare Poller [baseline] (5.324 ms) : 0, 5324
Flare Poller [candidate] (5.296 ms) : 0, 5296
section iast
crashtracking [baseline] (1.171 ms) : 0, 1171
crashtracking [candidate] (1.193 ms) : 0, 1193
BytebuddyAgent [baseline] (796.064 ms) : 0, 796064
BytebuddyAgent [candidate] (796.449 ms) : 0, 796449
AgentMeter [baseline] (11.256 ms) : 0, 11256
AgentMeter [candidate] (11.293 ms) : 0, 11293
GlobalTracer [baseline] (247.922 ms) : 0, 247922
GlobalTracer [candidate] (248.355 ms) : 0, 248355
AppSec [baseline] (34.707 ms) : 0, 34707
AppSec [candidate] (35.602 ms) : 0, 35602
Debugger [baseline] (64.873 ms) : 0, 64873
Debugger [candidate] (64.031 ms) : 0, 64031
Remote Config [baseline] (548.417 µs) : 0, 548
Remote Config [candidate] (536.319 µs) : 0, 536
Telemetry [baseline] (8.639 ms) : 0, 8639
Telemetry [candidate] (8.616 ms) : 0, 8616
Flare Poller [baseline] (3.558 ms) : 0, 3558
Flare Poller [candidate] (3.529 ms) : 0, 3529
IAST [baseline] (27.047 ms) : 0, 27047
IAST [candidate] (27.011 ms) : 0, 27011
Loading
Startup time reports for petclinic 
gantt
    title petclinic - global startup overhead: candidate=1.60.0-SNAPSHOT~857f6addfc, baseline=1.60.0-SNAPSHOT~c8216b560d

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.061 s) : 0, 1061234
Total [baseline] (10.893 s) : 0, 10893167
Agent [candidate] (1.068 s) : 0, 1067629
Total [candidate] (10.969 s) : 0, 10968894
section appsec
Agent [baseline] (1.245 s) : 0, 1245317
Total [baseline] (11.136 s) : 0, 11135506
Agent [candidate] (1.239 s) : 0, 1239283
Total [candidate] (10.992 s) : 0, 10992132
section iast
Agent [baseline] (1.231 s) : 0, 1231439
Total [baseline] (11.225 s) : 0, 11225418
Agent [candidate] (1.243 s) : 0, 1243488
Total [candidate] (11.141 s) : 0, 11141401
section profiling
Agent [baseline] (1.19 s) : 0, 1189735
Total [baseline] (10.92 s) : 0, 10920281
Agent [candidate] (1.206 s) : 0, 1206130
Total [candidate] (11.07 s) : 0, 11070324
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.061 s -
Agent appsec 1.245 s 184.083 ms (17.3%)
Agent iast 1.231 s 170.206 ms (16.0%)
Agent profiling 1.19 s 128.502 ms (12.1%)
Total tracing 10.893 s -
Total appsec 11.136 s 242.339 ms (2.2%)
Total iast 11.225 s 332.251 ms (3.1%)
Total profiling 10.92 s 27.114 ms (0.2%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.068 s -
Agent appsec 1.239 s 171.654 ms (16.1%)
Agent iast 1.243 s 175.859 ms (16.5%)
Agent profiling 1.206 s 138.501 ms (13.0%)
Total tracing 10.969 s -
Total appsec 10.992 s 23.238 ms (0.2%)
Total iast 11.141 s 172.507 ms (1.6%)
Total profiling 11.07 s 101.431 ms (0.9%) 
gantt
    title petclinic - break down per module: candidate=1.60.0-SNAPSHOT~857f6addfc, baseline=1.60.0-SNAPSHOT~c8216b560d

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.178 ms) : 0, 1178
crashtracking [candidate] (1.185 ms) : 0, 1185
BytebuddyAgent [baseline] (627.081 ms) : 0, 627081
BytebuddyAgent [candidate] (628.886 ms) : 0, 628886
AgentMeter [baseline] (28.752 ms) : 0, 28752
AgentMeter [candidate] (29.192 ms) : 0, 29192
GlobalTracer [baseline] (256.772 ms) : 0, 256772
GlobalTracer [candidate] (258.596 ms) : 0, 258596
AppSec [baseline] (32.729 ms) : 0, 32729
AppSec [candidate] (32.816 ms) : 0, 32816
Debugger [baseline] (62.018 ms) : 0, 62018
Debugger [candidate] (62.194 ms) : 0, 62194
Remote Config [baseline] (630.33 µs) : 0, 630
Remote Config [candidate] (621.184 µs) : 0, 621
Telemetry [baseline] (11.582 ms) : 0, 11582
Telemetry [candidate] (11.527 ms) : 0, 11527
Flare Poller [baseline] (5.318 ms) : 0, 5318
Flare Poller [candidate] (7.195 ms) : 0, 7195
section appsec
crashtracking [baseline] (1.184 ms) : 0, 1184
crashtracking [candidate] (1.182 ms) : 0, 1182
BytebuddyAgent [baseline] (661.529 ms) : 0, 661529
BytebuddyAgent [candidate] (658.755 ms) : 0, 658755
AgentMeter [baseline] (12.061 ms) : 0, 12061
AgentMeter [candidate] (12.013 ms) : 0, 12013
GlobalTracer [baseline] (259.138 ms) : 0, 259138
GlobalTracer [candidate] (258.357 ms) : 0, 258357
AppSec [baseline] (169.107 ms) : 0, 169107
AppSec [candidate] (167.684 ms) : 0, 167684
Debugger [baseline] (67.274 ms) : 0, 67274
Debugger [candidate] (66.833 ms) : 0, 66833
Remote Config [baseline] (659.993 µs) : 0, 660
Remote Config [candidate] (654.274 µs) : 0, 654
Telemetry [baseline] (9.758 ms) : 0, 9758
Telemetry [candidate] (9.651 ms) : 0, 9651
Flare Poller [baseline] (3.863 ms) : 0, 3863
Flare Poller [candidate] (3.69 ms) : 0, 3690
IAST [baseline] (25.309 ms) : 0, 25309
IAST [candidate] (25.181 ms) : 0, 25181
section iast
crashtracking [baseline] (1.173 ms) : 0, 1173
crashtracking [candidate] (1.197 ms) : 0, 1197
BytebuddyAgent [baseline] (795.458 ms) : 0, 795458
BytebuddyAgent [candidate] (803.806 ms) : 0, 803806
AgentMeter [baseline] (11.224 ms) : 0, 11224
AgentMeter [candidate] (11.54 ms) : 0, 11540
GlobalTracer [baseline] (248.354 ms) : 0, 248354
GlobalTracer [candidate] (250.332 ms) : 0, 250332
AppSec [baseline] (33.659 ms) : 0, 33659
AppSec [candidate] (32.409 ms) : 0, 32409
Debugger [baseline] (66.602 ms) : 0, 66602
Debugger [candidate] (68.913 ms) : 0, 68913
Remote Config [baseline] (540.319 µs) : 0, 540
Remote Config [candidate] (542.282 µs) : 0, 542
Telemetry [baseline] (8.661 ms) : 0, 8661
Telemetry [candidate] (8.667 ms) : 0, 8667
Flare Poller [baseline] (3.492 ms) : 0, 3492
Flare Poller [candidate] (3.548 ms) : 0, 3548
IAST [baseline] (27.068 ms) : 0, 27068
IAST [candidate] (27.178 ms) : 0, 27178
section profiling
ProfilingAgent [baseline] (98.972 ms) : 0, 98972
ProfilingAgent [candidate] (99.725 ms) : 0, 99725
crashtracking [baseline] (1.212 ms) : 0, 1212
crashtracking [candidate] (1.225 ms) : 0, 1225
BytebuddyAgent [baseline] (682.458 ms) : 0, 682458
BytebuddyAgent [candidate] (692.431 ms) : 0, 692431
AgentMeter [baseline] (8.645 ms) : 0, 8645
AgentMeter [candidate] (8.691 ms) : 0, 8691
GlobalTracer [baseline] (215.548 ms) : 0, 215548
GlobalTracer [candidate] (218.531 ms) : 0, 218531
AppSec [baseline] (32.586 ms) : 0, 32586
AppSec [candidate] (33.235 ms) : 0, 33235
Debugger [baseline] (67.227 ms) : 0, 67227
Debugger [candidate] (68.131 ms) : 0, 68131
Remote Config [baseline] (623.477 µs) : 0, 623
Remote Config [candidate] (639.926 µs) : 0, 640
Telemetry [baseline] (8.855 ms) : 0, 8855
Telemetry [candidate] (8.979 ms) : 0, 8979
Flare Poller [baseline] (3.757 ms) : 0, 3757
Flare Poller [candidate] (3.778 ms) : 0, 3778
Profiling [baseline] (99.543 ms) : 0, 99543
Profiling [candidate] (100.315 ms) : 0, 100315
Loading

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master bdu/reports-muzzle-assertions-as-junit
git_commit_date 1771000776 1771063397
git_commit_sha c8216b5 857f6ad
release_version 1.60.0-SNAPSHOT~c8216b560d 1.60.0-SNAPSHOT~857f6addfc
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1771065948 1771065948
ci_job_id 1427119742 1427119742
ci_pipeline_id 96595168 96595168
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-720uoxdi 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-720uoxdi 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 1 performance improvements and 0 performance regressions! Performance is the same for 19 metrics, 16 unstable metrics.

scenario Δ mean agg_http_req_duration_p50 Δ mean agg_http_req_duration_p95 Δ mean throughput candidate mean agg_http_req_duration_p50 candidate mean agg_http_req_duration_p95 candidate mean throughput baseline mean agg_http_req_duration_p50 baseline mean agg_http_req_duration_p95 baseline mean throughput
scenario:load:insecure-bank:profiling:high_load better
[-159.280µs; -35.106µs] or [-9.478%; -2.089%]		 unstable
[-1112.284µs; -284.180µs] or [-22.315%; -5.701%]		 unstable
[-42.572op/s; +442.135op/s] or [-1.973%; +20.487%]		 1.583ms 4.286ms 2357.906op/s 1.680ms 4.984ms 2158.125op/s
Request duration reports for insecure-bank 
gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.60.0-SNAPSHOT~857f6addfc, baseline=1.60.0-SNAPSHOT~c8216b560d
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.187 ms) : 1176, 1198
.   : milestone, 1187,
iast (3.137 ms) : 3094, 3180
.   : milestone, 3137,
iast_FULL (5.692 ms) : 5636, 5748
.   : milestone, 5692,
iast_GLOBAL (3.582 ms) : 3527, 3637
.   : milestone, 3582,
profiling (2.095 ms) : 2076, 2114
.   : milestone, 2095,
tracing (1.766 ms) : 1751, 1781
.   : milestone, 1766,
section candidate
no_agent (1.182 ms) : 1171, 1194
.   : milestone, 1182,
iast (3.184 ms) : 3138, 3229
.   : milestone, 3184,
iast_FULL (5.753 ms) : 5696, 5811
.   : milestone, 5753,
iast_GLOBAL (3.477 ms) : 3427, 3527
.   : milestone, 3477,
profiling (1.911 ms) : 1895, 1926
.   : milestone, 1911,
tracing (1.77 ms) : 1756, 1785
.   : milestone, 1770,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.187 ms [1.176 ms, 1.198 ms] -
iast 3.137 ms [3.094 ms, 3.18 ms] 1.95 ms (164.3%)
iast_FULL 5.692 ms [5.636 ms, 5.748 ms] 4.505 ms (379.5%)
iast_GLOBAL 3.582 ms [3.527 ms, 3.637 ms] 2.395 ms (201.8%)
profiling 2.095 ms [2.076 ms, 2.114 ms] 907.919 µs (76.5%)
tracing 1.766 ms [1.751 ms, 1.781 ms] 578.898 µs (48.8%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.182 ms [1.171 ms, 1.194 ms] -
iast 3.184 ms [3.138 ms, 3.229 ms] 2.001 ms (169.3%)
iast_FULL 5.753 ms [5.696 ms, 5.811 ms] 4.571 ms (386.6%)
iast_GLOBAL 3.477 ms [3.427 ms, 3.527 ms] 2.295 ms (194.1%)
profiling 1.911 ms [1.895 ms, 1.926 ms] 728.266 µs (61.6%)
tracing 1.77 ms [1.756 ms, 1.785 ms] 587.988 µs (49.7%)
Request duration reports for petclinic 
gantt
    title petclinic - request duration [CI 0.99] : candidate=1.60.0-SNAPSHOT~857f6addfc, baseline=1.60.0-SNAPSHOT~c8216b560d
    dateFormat X
    axisFormat %s
section baseline
no_agent (17.274 ms) : 17102, 17446
.   : milestone, 17274,
appsec (18.563 ms) : 18373, 18753
.   : milestone, 18563,
code_origins (17.591 ms) : 17418, 17764
.   : milestone, 17591,
iast (17.886 ms) : 17708, 18065
.   : milestone, 17886,
profiling (18.496 ms) : 18312, 18680
.   : milestone, 18496,
tracing (17.469 ms) : 17296, 17642
.   : milestone, 17469,
section candidate
no_agent (18.126 ms) : 17941, 18311
.   : milestone, 18126,
appsec (18.505 ms) : 18316, 18695
.   : milestone, 18505,
code_origins (17.936 ms) : 17759, 18114
.   : milestone, 17936,
iast (17.413 ms) : 17240, 17586
.   : milestone, 17413,
profiling (18.539 ms) : 18351, 18726
.   : milestone, 18539,
tracing (17.352 ms) : 17182, 17523
.   : milestone, 17352,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 17.274 ms [17.102 ms, 17.446 ms] -
appsec 18.563 ms [18.373 ms, 18.753 ms] 1.29 ms (7.5%)
code_origins 17.591 ms [17.418 ms, 17.764 ms] 317.278 µs (1.8%)
iast 17.886 ms [17.708 ms, 18.065 ms] 612.517 µs (3.5%)
profiling 18.496 ms [18.312 ms, 18.68 ms] 1.222 ms (7.1%)
tracing 17.469 ms [17.296 ms, 17.642 ms] 195.265 µs (1.1%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 18.126 ms [17.941 ms, 18.311 ms] -
appsec 18.505 ms [18.316 ms, 18.695 ms] 379.164 µs (2.1%)
code_origins 17.936 ms [17.759 ms, 18.114 ms] -189.673 µs (-1.0%)
iast 17.413 ms [17.24 ms, 17.586 ms] -712.894 µs (-3.9%)
profiling 18.539 ms [18.351 ms, 18.726 ms] 412.664 µs (2.3%)
tracing 17.352 ms [17.182 ms, 17.523 ms] -773.651 µs (-4.3%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master bdu/reports-muzzle-assertions-as-junit
git_commit_date 1771000776 1771063397
git_commit_sha c8216b5 857f6ad
release_version 1.60.0-SNAPSHOT~c8216b560d 1.60.0-SNAPSHOT~857f6addfc
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1771065512 1771065512
ci_job_id 1427119743 1427119743
ci_pipeline_id 96595168 96595168
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-3nkbnib5 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-3nkbnib5 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 1 unstable metrics.

Execution time for biojava 
gantt
    title biojava - execution time [CI 0.99] : candidate=1.60.0-SNAPSHOT~857f6addfc, baseline=1.60.0-SNAPSHOT~c8216b560d
    dateFormat X
    axisFormat %s
section baseline
no_agent (15.054 s) : 15054000, 15054000
.   : milestone, 15054000,
appsec (14.963 s) : 14963000, 14963000
.   : milestone, 14963000,
iast (18.461 s) : 18461000, 18461000
.   : milestone, 18461000,
iast_GLOBAL (17.778 s) : 17778000, 17778000
.   : milestone, 17778000,
profiling (14.8 s) : 14800000, 14800000
.   : milestone, 14800000,
tracing (14.918 s) : 14918000, 14918000
.   : milestone, 14918000,
section candidate
no_agent (14.898 s) : 14898000, 14898000
.   : milestone, 14898000,
appsec (15.353 s) : 15353000, 15353000
.   : milestone, 15353000,
iast (18.599 s) : 18599000, 18599000
.   : milestone, 18599000,
iast_GLOBAL (17.695 s) : 17695000, 17695000
.   : milestone, 17695000,
profiling (14.65 s) : 14650000, 14650000
.   : milestone, 14650000,
tracing (14.836 s) : 14836000, 14836000
.   : milestone, 14836000,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.054 s [15.054 s, 15.054 s] -
appsec 14.963 s [14.963 s, 14.963 s] -91.0 ms (-0.6%)
iast 18.461 s [18.461 s, 18.461 s] 3.407 s (22.6%)
iast_GLOBAL 17.778 s [17.778 s, 17.778 s] 2.724 s (18.1%)
profiling 14.8 s [14.8 s, 14.8 s] -254.0 ms (-1.7%)
tracing 14.918 s [14.918 s, 14.918 s] -136.0 ms (-0.9%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 14.898 s [14.898 s, 14.898 s] -
appsec 15.353 s [15.353 s, 15.353 s] 455.0 ms (3.1%)
iast 18.599 s [18.599 s, 18.599 s] 3.701 s (24.8%)
iast_GLOBAL 17.695 s [17.695 s, 17.695 s] 2.797 s (18.8%)
profiling 14.65 s [14.65 s, 14.65 s] -248.0 ms (-1.7%)
tracing 14.836 s [14.836 s, 14.836 s] -62.0 ms (-0.4%)
Execution time for tomcat 
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.60.0-SNAPSHOT~857f6addfc, baseline=1.60.0-SNAPSHOT~c8216b560d
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.483 ms) : 1471, 1494
.   : milestone, 1483,
appsec (3.819 ms) : 3595, 4043
.   : milestone, 3819,
iast (2.269 ms) : 2199, 2339
.   : milestone, 2269,
iast_GLOBAL (2.317 ms) : 2247, 2388
.   : milestone, 2317,
profiling (2.105 ms) : 2050, 2161
.   : milestone, 2105,
tracing (2.077 ms) : 2023, 2131
.   : milestone, 2077,
section candidate
no_agent (1.475 ms) : 1463, 1486
.   : milestone, 1475,
appsec (3.824 ms) : 3602, 4046
.   : milestone, 3824,
iast (2.282 ms) : 2211, 2352
.   : milestone, 2282,
iast_GLOBAL (2.32 ms) : 2250, 2390
.   : milestone, 2320,
profiling (2.132 ms) : 2075, 2189
.   : milestone, 2132,
tracing (2.086 ms) : 2031, 2140
.   : milestone, 2086,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.483 ms [1.471 ms, 1.494 ms] -
appsec 3.819 ms [3.595 ms, 4.043 ms] 2.336 ms (157.5%)
iast 2.269 ms [2.199 ms, 2.339 ms] 786.324 µs (53.0%)
iast_GLOBAL 2.317 ms [2.247 ms, 2.388 ms] 834.417 µs (56.3%)
profiling 2.105 ms [2.05 ms, 2.161 ms] 622.28 µs (42.0%)
tracing 2.077 ms [2.023 ms, 2.131 ms] 593.965 µs (40.1%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.475 ms [1.463 ms, 1.486 ms] -
appsec 3.824 ms [3.602 ms, 4.046 ms] 2.35 ms (159.3%)
iast 2.282 ms [2.211 ms, 2.352 ms] 806.729 µs (54.7%)
iast_GLOBAL 2.32 ms [2.25 ms, 2.39 ms] 845.294 µs (57.3%)
profiling 2.132 ms [2.075 ms, 2.189 ms] 657.0 µs (44.5%)
tracing 2.086 ms [2.031 ms, 2.14 ms] 610.909 µs (41.4%)

@bric3 bric3 marked this pull request as ready for review February 14, 2026 10:05
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@TonyCTHsu TonyCTHsu Awaiting requested review from TonyCTHsu TonyCTHsu is a code owner automatically assigned from DataDog/apm-release-platform

@PerfectSlayer PerfectSlayer Awaiting requested review from PerfectSlayer PerfectSlayer is a code owner automatically assigned from DataDog/apm-java

At least 1 approving review is required to merge this pull request.

Assignees

No one assigned

Labels

comp: tooling Build & Tooling tag: no release notes Changes to exclude from release notes type: enhancement Enhancements and improvements

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

1 participant

@bric3