Skip to content

Stabilize new CICS test #10508

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Open
mcculls wants to merge 1 commit into
base: master
Choose a base branch
from
Open

Stabilize new CICS test #10508

mcculls wants to merge 1 commit into from

Conversation

@mcculls
Copy link
Contributor

@mcculls mcculls commented Feb 2, 2026 •
edited
Loading

Motivation

Adjust test expectations to avoid flakiness seen in Test Optimization Dashboard

Contributor Checklist

Jira ticket: [PROJ-IDENT]

@mcculls mcculls added type: bug Bug report and fix inst: others All other instrumentations tag: no release notes Changes to exclude from release notes labels Feb 2, 2026
@mcculls mcculls changed the title WIP: stabilize new CICS test Stabilize new CICS test Feb 2, 2026
@mcculls mcculls marked this pull request as ready for review February 2, 2026 22:24
@mcculls mcculls force-pushed the mcculls/stabilize-cics-test branch from 8d9de77 to 249c5d4 Compare February 2, 2026 22:24
@mcculls mcculls requested review from a team as code owners February 2, 2026 22:24
@pr-commenter
Copy link

pr-commenter bot commented Feb 2, 2026

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master mcculls/stabilize-cics-test
git_commit_date 1770062618 1770071069
git_commit_sha ab02a41 249c5d4
release_version 1.60.0-SNAPSHOT~ab02a41bfc 1.60.0-SNAPSHOT~249c5d407c
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1770072835 1770072835
ci_job_id 1395645360 1395645360
ci_pipeline_id 94225190 94225190
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-fv7wcpmu 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-fv7wcpmu 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module Agent Agent
parent None None

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 57 metrics, 14 unstable metrics.

Startup time reports for petclinic 
gantt
    title petclinic - global startup overhead: candidate=1.60.0-SNAPSHOT~249c5d407c, baseline=1.60.0-SNAPSHOT~ab02a41bfc

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.07 s) : 0, 1069849
Total [baseline] (10.883 s) : 0, 10882910
Agent [candidate] (1.079 s) : 0, 1078645
Total [candidate] (10.954 s) : 0, 10953733
section appsec
Agent [baseline] (1.255 s) : 0, 1255147
Total [baseline] (11.084 s) : 0, 11084474
Agent [candidate] (1.24 s) : 0, 1240402
Total [candidate] (11.146 s) : 0, 11145679
section iast
Agent [baseline] (1.241 s) : 0, 1241355
Total [baseline] (11.131 s) : 0, 11131002
Agent [candidate] (1.233 s) : 0, 1233298
Total [candidate] (11.164 s) : 0, 11164487
section profiling
Agent [baseline] (1.191 s) : 0, 1191090
Total [baseline] (10.982 s) : 0, 10982269
Agent [candidate] (1.191 s) : 0, 1190920
Total [candidate] (10.96 s) : 0, 10960290
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.07 s -
Agent appsec 1.255 s 185.297 ms (17.3%)
Agent iast 1.241 s 171.505 ms (16.0%)
Agent profiling 1.191 s 121.241 ms (11.3%)
Total tracing 10.883 s -
Total appsec 11.084 s 201.564 ms (1.9%)
Total iast 11.131 s 248.092 ms (2.3%)
Total profiling 10.982 s 99.359 ms (0.9%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.079 s -
Agent appsec 1.24 s 161.758 ms (15.0%)
Agent iast 1.233 s 154.653 ms (14.3%)
Agent profiling 1.191 s 112.276 ms (10.4%)
Total tracing 10.954 s -
Total appsec 11.146 s 191.946 ms (1.8%)
Total iast 11.164 s 210.754 ms (1.9%)
Total profiling 10.96 s 6.557 ms (0.1%) 
gantt
    title petclinic - break down per module: candidate=1.60.0-SNAPSHOT~249c5d407c, baseline=1.60.0-SNAPSHOT~ab02a41bfc

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.191 ms) : 0, 1191
crashtracking [candidate] (1.215 ms) : 0, 1215
BytebuddyAgent [baseline] (631.77 ms) : 0, 631770
BytebuddyAgent [candidate] (636.597 ms) : 0, 636597
AgentMeter [baseline] (28.958 ms) : 0, 28958
AgentMeter [candidate] (29.103 ms) : 0, 29103
GlobalTracer [baseline] (259.227 ms) : 0, 259227
GlobalTracer [candidate] (260.694 ms) : 0, 260694
AppSec [baseline] (33.079 ms) : 0, 33079
AppSec [candidate] (33.458 ms) : 0, 33458
Debugger [baseline] (62.632 ms) : 0, 62632
Debugger [candidate] (63.118 ms) : 0, 63118
Remote Config [baseline] (628.646 µs) : 0, 629
Remote Config [candidate] (634.873 µs) : 0, 635
Telemetry [baseline] (11.508 ms) : 0, 11508
Telemetry [candidate] (14.113 ms) : 0, 14113
Flare Poller [baseline] (5.373 ms) : 0, 5373
Flare Poller [candidate] (3.878 ms) : 0, 3878
section appsec
crashtracking [baseline] (1.211 ms) : 0, 1211
crashtracking [candidate] (1.184 ms) : 0, 1184
BytebuddyAgent [baseline] (667.908 ms) : 0, 667908
BytebuddyAgent [candidate] (658.529 ms) : 0, 658529
AgentMeter [baseline] (11.937 ms) : 0, 11937
AgentMeter [candidate] (11.73 ms) : 0, 11730
GlobalTracer [baseline] (261.808 ms) : 0, 261808
GlobalTracer [candidate] (259.035 ms) : 0, 259035
IAST [baseline] (25.852 ms) : 0, 25852
IAST [candidate] (25.404 ms) : 0, 25404
AppSec [baseline] (169.146 ms) : 0, 169146
AppSec [candidate] (168.169 ms) : 0, 168169
Debugger [baseline] (67.871 ms) : 0, 67871
Debugger [candidate] (67.493 ms) : 0, 67493
Remote Config [baseline] (693.905 µs) : 0, 694
Remote Config [candidate] (691.047 µs) : 0, 691
Telemetry [baseline] (9.263 ms) : 0, 9263
Telemetry [candidate] (9.145 ms) : 0, 9145
Flare Poller [baseline] (3.666 ms) : 0, 3666
Flare Poller [candidate] (3.652 ms) : 0, 3652
section iast
crashtracking [baseline] (1.218 ms) : 0, 1218
crashtracking [candidate] (1.204 ms) : 0, 1204
BytebuddyAgent [baseline] (803.433 ms) : 0, 803433
BytebuddyAgent [candidate] (796.023 ms) : 0, 796023
AgentMeter [baseline] (11.434 ms) : 0, 11434
AgentMeter [candidate] (11.15 ms) : 0, 11150
GlobalTracer [baseline] (249.84 ms) : 0, 249840
GlobalTracer [candidate] (248.831 ms) : 0, 248831
IAST [baseline] (27.025 ms) : 0, 27025
IAST [candidate] (26.982 ms) : 0, 26982
AppSec [baseline] (32.303 ms) : 0, 32303
AppSec [candidate] (31.296 ms) : 0, 31296
Debugger [baseline] (67.886 ms) : 0, 67886
Debugger [candidate] (69.71 ms) : 0, 69710
Remote Config [baseline] (540.528 µs) : 0, 541
Remote Config [candidate] (551.066 µs) : 0, 551
Telemetry [baseline] (8.671 ms) : 0, 8671
Telemetry [candidate] (8.755 ms) : 0, 8755
Flare Poller [baseline] (3.431 ms) : 0, 3431
Flare Poller [candidate] (3.483 ms) : 0, 3483
section profiling
crashtracking [baseline] (1.224 ms) : 0, 1224
crashtracking [candidate] (1.211 ms) : 0, 1211
BytebuddyAgent [baseline] (682.492 ms) : 0, 682492
BytebuddyAgent [candidate] (682.241 ms) : 0, 682241
AgentMeter [baseline] (8.682 ms) : 0, 8682
AgentMeter [candidate] (8.635 ms) : 0, 8635
GlobalTracer [baseline] (216.301 ms) : 0, 216301
GlobalTracer [candidate] (216.365 ms) : 0, 216365
AppSec [baseline] (32.487 ms) : 0, 32487
AppSec [candidate] (32.347 ms) : 0, 32347
Debugger [baseline] (67.387 ms) : 0, 67387
Debugger [candidate] (67.611 ms) : 0, 67611
Remote Config [baseline] (590.405 µs) : 0, 590
Remote Config [candidate] (613.331 µs) : 0, 613
Telemetry [baseline] (8.859 ms) : 0, 8859
Telemetry [candidate] (8.889 ms) : 0, 8889
Flare Poller [baseline] (3.76 ms) : 0, 3760
Flare Poller [candidate] (3.753 ms) : 0, 3753
ProfilingAgent [baseline] (99.333 ms) : 0, 99333
ProfilingAgent [candidate] (99.346 ms) : 0, 99346
Profiling [baseline] (99.902 ms) : 0, 99902
Profiling [candidate] (99.907 ms) : 0, 99907
Loading
Startup time reports for insecure-bank 
gantt
    title insecure-bank - global startup overhead: candidate=1.60.0-SNAPSHOT~249c5d407c, baseline=1.60.0-SNAPSHOT~ab02a41bfc

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.072 s) : 0, 1072410
Total [baseline] (8.738 s) : 0, 8737576
Agent [candidate] (1.072 s) : 0, 1071959
Total [candidate] (8.75 s) : 0, 8750229
section iast
Agent [baseline] (1.235 s) : 0, 1234975
Total [baseline] (9.382 s) : 0, 9381733
Agent [candidate] (1.237 s) : 0, 1236893
Total [candidate] (9.381 s) : 0, 9381026
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.072 s -
Agent iast 1.235 s 162.565 ms (15.2%)
Total tracing 8.738 s -
Total iast 9.382 s 644.157 ms (7.4%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.072 s -
Agent iast 1.237 s 164.933 ms (15.4%)
Total tracing 8.75 s -
Total iast 9.381 s 630.798 ms (7.2%) 
gantt
    title insecure-bank - break down per module: candidate=1.60.0-SNAPSHOT~249c5d407c, baseline=1.60.0-SNAPSHOT~ab02a41bfc

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.21 ms) : 0, 1210
crashtracking [candidate] (1.194 ms) : 0, 1194
BytebuddyAgent [baseline] (633.091 ms) : 0, 633091
BytebuddyAgent [candidate] (633.254 ms) : 0, 633254
AgentMeter [baseline] (28.974 ms) : 0, 28974
AgentMeter [candidate] (28.97 ms) : 0, 28970
GlobalTracer [baseline] (259.779 ms) : 0, 259779
GlobalTracer [candidate] (259.862 ms) : 0, 259862
AppSec [baseline] (33.313 ms) : 0, 33313
AppSec [candidate] (33.21 ms) : 0, 33210
Debugger [baseline] (61.84 ms) : 0, 61840
Debugger [candidate] (60.936 ms) : 0, 60936
Remote Config [baseline] (626.692 µs) : 0, 627
Remote Config [candidate] (623.886 µs) : 0, 624
Telemetry [baseline] (11.754 ms) : 0, 11754
Telemetry [candidate] (13.017 ms) : 0, 13017
Flare Poller [baseline] (6.192 ms) : 0, 6192
Flare Poller [candidate] (5.379 ms) : 0, 5379
section iast
crashtracking [baseline] (1.193 ms) : 0, 1193
crashtracking [candidate] (1.194 ms) : 0, 1194
BytebuddyAgent [baseline] (799.548 ms) : 0, 799548
BytebuddyAgent [candidate] (800.867 ms) : 0, 800867
AgentMeter [baseline] (11.188 ms) : 0, 11188
AgentMeter [candidate] (11.382 ms) : 0, 11382
GlobalTracer [baseline] (247.957 ms) : 0, 247957
GlobalTracer [candidate] (248.753 ms) : 0, 248753
IAST [baseline] (27.134 ms) : 0, 27134
IAST [candidate] (27.009 ms) : 0, 27009
AppSec [baseline] (33.891 ms) : 0, 33891
AppSec [candidate] (33.695 ms) : 0, 33695
Debugger [baseline] (65.832 ms) : 0, 65832
Debugger [candidate] (65.931 ms) : 0, 65931
Remote Config [baseline] (552.712 µs) : 0, 553
Remote Config [candidate] (541.501 µs) : 0, 542
Telemetry [baseline] (8.732 ms) : 0, 8732
Telemetry [candidate] (8.656 ms) : 0, 8656
Flare Poller [baseline] (3.495 ms) : 0, 3495
Flare Poller [candidate] (3.418 ms) : 0, 3418
Loading

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master mcculls/stabilize-cics-test
git_commit_date 1770062618 1770071069
git_commit_sha ab02a41 249c5d4
release_version 1.60.0-SNAPSHOT~ab02a41bfc 1.60.0-SNAPSHOT~249c5d407c
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1770073328 1770073328
ci_job_id 1395645363 1395645363
ci_pipeline_id 94225190 94225190
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-a8e7gv1v 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-a8e7gv1v 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 1 performance improvements and 2 performance regressions! Performance is the same for 16 metrics, 17 unstable metrics.

scenario Δ mean agg_http_req_duration_p50 Δ mean agg_http_req_duration_p95 Δ mean throughput candidate mean agg_http_req_duration_p50 candidate mean agg_http_req_duration_p95 candidate mean throughput baseline mean agg_http_req_duration_p50 baseline mean agg_http_req_duration_p95 baseline mean throughput
scenario:load:insecure-bank:iast_GLOBAL:high_load worse
[+62.299µs; +219.906µs] or [+2.289%; +8.081%]		 unsure
[+86.884µs; +502.673µs] or [+1.119%; +6.471%]		 unstable
[-167.327op/s; +97.202op/s] or [-12.790%; +7.430%]		 2.862ms 8.062ms 1273.219op/s 2.721ms 7.768ms 1308.281op/s
scenario:load:petclinic:appsec:high_load better
[-1286.611µs; -495.146µs] or [-6.784%; -2.611%]		 same
[-1375.726µs; +98.171µs] or [-4.506%; +0.322%]		 unstable
[-17.669op/s; +37.919op/s] or [-7.305%; +15.677%]		 18.074ms 29.889ms 252.000op/s 18.965ms 30.528ms 241.875op/s
scenario:load:petclinic:iast:high_load worse
[+532.898µs; +1442.260µs] or [+3.082%; +8.341%]		 same
[-60.219µs; +1522.732µs] or [-0.213%; +5.390%]		 unstable
[-40.604op/s; +17.854op/s] or [-15.377%; +6.761%]		 18.278ms 28.981ms 252.688op/s 17.290ms 28.250ms 264.062op/s
Request duration reports for petclinic 
gantt
    title petclinic - request duration [CI 0.99] : candidate=1.60.0-SNAPSHOT~249c5d407c, baseline=1.60.0-SNAPSHOT~ab02a41bfc
    dateFormat X
    axisFormat %s
section baseline
no_agent (17.043 ms) : 16875, 17211
.   : milestone, 17043,
appsec (19.298 ms) : 19104, 19492
.   : milestone, 19298,
code_origins (17.551 ms) : 17375, 17726
.   : milestone, 17551,
iast (17.673 ms) : 17498, 17847
.   : milestone, 17673,
profiling (18.402 ms) : 18222, 18581
.   : milestone, 18402,
tracing (17.911 ms) : 17734, 18088
.   : milestone, 17911,
section candidate
no_agent (19.428 ms) : 19228, 19627
.   : milestone, 19428,
appsec (18.519 ms) : 18334, 18704
.   : milestone, 18519,
code_origins (17.506 ms) : 17333, 17679
.   : milestone, 17506,
iast (18.467 ms) : 18284, 18650
.   : milestone, 18467,
profiling (18.895 ms) : 18708, 19081
.   : milestone, 18895,
tracing (17.459 ms) : 17288, 17631
.   : milestone, 17459,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 17.043 ms [16.875 ms, 17.211 ms] -
appsec 19.298 ms [19.104 ms, 19.492 ms] 2.255 ms (13.2%)
code_origins 17.551 ms [17.375 ms, 17.726 ms] 507.723 µs (3.0%)
iast 17.673 ms [17.498 ms, 17.847 ms] 629.648 µs (3.7%)
profiling 18.402 ms [18.222 ms, 18.581 ms] 1.359 ms (8.0%)
tracing 17.911 ms [17.734 ms, 18.088 ms] 868.09 µs (5.1%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 19.428 ms [19.228 ms, 19.627 ms] -
appsec 18.519 ms [18.334 ms, 18.704 ms] -908.708 µs (-4.7%)
code_origins 17.506 ms [17.333 ms, 17.679 ms] -1.921 ms (-9.9%)
iast 18.467 ms [18.284 ms, 18.65 ms] -960.486 µs (-4.9%)
profiling 18.895 ms [18.708 ms, 19.081 ms] -533.216 µs (-2.7%)
tracing 17.459 ms [17.288 ms, 17.631 ms] -1.968 ms (-10.1%)
Request duration reports for insecure-bank 
gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.60.0-SNAPSHOT~249c5d407c, baseline=1.60.0-SNAPSHOT~ab02a41bfc
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.187 ms) : 1176, 1199
.   : milestone, 1187,
iast (3.225 ms) : 3180, 3270
.   : milestone, 3225,
iast_FULL (5.709 ms) : 5653, 5765
.   : milestone, 5709,
iast_GLOBAL (3.504 ms) : 3443, 3564
.   : milestone, 3504,
profiling (2.032 ms) : 2012, 2051
.   : milestone, 2032,
tracing (1.795 ms) : 1779, 1811
.   : milestone, 1795,
section candidate
no_agent (1.177 ms) : 1166, 1188
.   : milestone, 1177,
iast (3.105 ms) : 3069, 3141
.   : milestone, 3105,
iast_FULL (5.812 ms) : 5753, 5870
.   : milestone, 5812,
iast_GLOBAL (3.601 ms) : 3553, 3649
.   : milestone, 3601,
profiling (2.109 ms) : 2090, 2128
.   : milestone, 2109,
tracing (1.798 ms) : 1782, 1813
.   : milestone, 1798,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.187 ms [1.176 ms, 1.199 ms] -
iast 3.225 ms [3.18 ms, 3.27 ms] 2.038 ms (171.6%)
iast_FULL 5.709 ms [5.653 ms, 5.765 ms] 4.521 ms (380.8%)
iast_GLOBAL 3.504 ms [3.443 ms, 3.564 ms] 2.316 ms (195.1%)
profiling 2.032 ms [2.012 ms, 2.051 ms] 844.53 µs (71.1%)
tracing 1.795 ms [1.779 ms, 1.811 ms] 607.621 µs (51.2%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.177 ms [1.166 ms, 1.188 ms] -
iast 3.105 ms [3.069 ms, 3.141 ms] 1.928 ms (163.8%)
iast_FULL 5.812 ms [5.753 ms, 5.87 ms] 4.635 ms (393.8%)
iast_GLOBAL 3.601 ms [3.553 ms, 3.649 ms] 2.424 ms (205.9%)
profiling 2.109 ms [2.09 ms, 2.128 ms] 932.041 µs (79.2%)
tracing 1.798 ms [1.782 ms, 1.813 ms] 620.634 µs (52.7%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master mcculls/stabilize-cics-test
git_commit_date 1770062618 1770071069
git_commit_sha ab02a41 249c5d4
release_version 1.60.0-SNAPSHOT~ab02a41bfc 1.60.0-SNAPSHOT~249c5d407c
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1770073002 1770073002
ci_job_id 1395645366 1395645366
ci_pipeline_id 94225190 94225190
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-tokzhfc5 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-tokzhfc5 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 1 unstable metrics.

Execution time for biojava 
gantt
    title biojava - execution time [CI 0.99] : candidate=1.60.0-SNAPSHOT~249c5d407c, baseline=1.60.0-SNAPSHOT~ab02a41bfc
    dateFormat X
    axisFormat %s
section baseline
no_agent (15.051 s) : 15051000, 15051000
.   : milestone, 15051000,
appsec (14.918 s) : 14918000, 14918000
.   : milestone, 14918000,
iast (18.196 s) : 18196000, 18196000
.   : milestone, 18196000,
iast_GLOBAL (18.078 s) : 18078000, 18078000
.   : milestone, 18078000,
profiling (14.946 s) : 14946000, 14946000
.   : milestone, 14946000,
tracing (14.705 s) : 14705000, 14705000
.   : milestone, 14705000,
section candidate
no_agent (15.294 s) : 15294000, 15294000
.   : milestone, 15294000,
appsec (14.733 s) : 14733000, 14733000
.   : milestone, 14733000,
iast (18.17 s) : 18170000, 18170000
.   : milestone, 18170000,
iast_GLOBAL (17.811 s) : 17811000, 17811000
.   : milestone, 17811000,
profiling (14.676 s) : 14676000, 14676000
.   : milestone, 14676000,
tracing (15.024 s) : 15024000, 15024000
.   : milestone, 15024000,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.051 s [15.051 s, 15.051 s] -
appsec 14.918 s [14.918 s, 14.918 s] -133.0 ms (-0.9%)
iast 18.196 s [18.196 s, 18.196 s] 3.145 s (20.9%)
iast_GLOBAL 18.078 s [18.078 s, 18.078 s] 3.027 s (20.1%)
profiling 14.946 s [14.946 s, 14.946 s] -105.0 ms (-0.7%)
tracing 14.705 s [14.705 s, 14.705 s] -346.0 ms (-2.3%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.294 s [15.294 s, 15.294 s] -
appsec 14.733 s [14.733 s, 14.733 s] -561.0 ms (-3.7%)
iast 18.17 s [18.17 s, 18.17 s] 2.876 s (18.8%)
iast_GLOBAL 17.811 s [17.811 s, 17.811 s] 2.517 s (16.5%)
profiling 14.676 s [14.676 s, 14.676 s] -618.0 ms (-4.0%)
tracing 15.024 s [15.024 s, 15.024 s] -270.0 ms (-1.8%)
Execution time for tomcat 
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.60.0-SNAPSHOT~249c5d407c, baseline=1.60.0-SNAPSHOT~ab02a41bfc
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.473 ms) : 1461, 1484
.   : milestone, 1473,
appsec (3.751 ms) : 3531, 3971
.   : milestone, 3751,
iast (2.26 ms) : 2191, 2329
.   : milestone, 2260,
iast_GLOBAL (2.297 ms) : 2228, 2367
.   : milestone, 2297,
profiling (2.091 ms) : 2035, 2147
.   : milestone, 2091,
tracing (2.053 ms) : 2000, 2106
.   : milestone, 2053,
section candidate
no_agent (1.471 ms) : 1460, 1483
.   : milestone, 1471,
appsec (3.753 ms) : 3533, 3973
.   : milestone, 3753,
iast (2.258 ms) : 2189, 2327
.   : milestone, 2258,
iast_GLOBAL (2.303 ms) : 2233, 2372
.   : milestone, 2303,
profiling (2.103 ms) : 2047, 2159
.   : milestone, 2103,
tracing (2.052 ms) : 1999, 2105
.   : milestone, 2052,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.473 ms [1.461 ms, 1.484 ms] -
appsec 3.751 ms [3.531 ms, 3.971 ms] 2.279 ms (154.7%)
iast 2.26 ms [2.191 ms, 2.329 ms] 787.193 µs (53.5%)
iast_GLOBAL 2.297 ms [2.228 ms, 2.367 ms] 824.623 µs (56.0%)
profiling 2.091 ms [2.035 ms, 2.147 ms] 618.819 µs (42.0%)
tracing 2.053 ms [2.0 ms, 2.106 ms] 580.242 µs (39.4%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.471 ms [1.46 ms, 1.483 ms] -
appsec 3.753 ms [3.533 ms, 3.973 ms] 2.281 ms (155.1%)
iast 2.258 ms [2.189 ms, 2.327 ms] 786.74 µs (53.5%)
iast_GLOBAL 2.303 ms [2.233 ms, 2.372 ms] 831.515 µs (56.5%)
profiling 2.103 ms [2.047 ms, 2.159 ms] 631.319 µs (42.9%)
tracing 2.052 ms [1.999 ms, 2.105 ms] 580.835 µs (39.5%)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

No reviews

Assignees

No one assigned

Labels

inst: others All other instrumentations tag: no release notes Changes to exclude from release notes type: bug Bug report and fix

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

2 participants

@mcculls