Skip to content

Fix OTel activation tests#10621

Open
mcculls wants to merge 1 commit intomasterfrom
mcculls/fix-otel-activation-tests
Open

Fix OTel activation tests#10621
mcculls wants to merge 1 commit intomasterfrom
mcculls/fix-otel-activation-tests

Conversation

@mcculls
Copy link
Contributor

@mcculls mcculls commented Feb 18, 2026

Noticed that the OTel activation tests weren't actually asserting properly - after fixing this I also fixed some copy-paste errors :)

Contributor Checklist

Jira ticket: [PROJ-IDENT]

Note: Once your PR is ready to merge, add it to the merge queue by commenting /merge. /merge -c cancels the queue request. /merge -f --reason "reason" skips all merge queue checks; please use this judiciously, as some checks do not run at the PR-level. For more information, see this doc.

@mcculls mcculls requested a review from a team as a code owner February 18, 2026 13:19
@mcculls mcculls added type: bug Bug report and fix comp: testing Testing tag: no release notes Changes to exclude from release notes labels Feb 18, 2026
@pr-commenter
Copy link

pr-commenter bot commented Feb 18, 2026

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master mcculls/fix-otel-activation-tests
git_commit_date 1771408718 1771420684
git_commit_sha 36ff528 28720cb
release_version 1.60.0-SNAPSHOT~36ff528d76 1.60.0-SNAPSHOT~28720cb69b
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1771422477 1771422477
ci_job_id 1435168357 1435168357
ci_pipeline_id 97199509 97199509
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-zrl59ya3 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-zrl59ya3 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module Agent Agent
parent None None

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 65 metrics, 6 unstable metrics.

Startup time reports for insecure-bank
gantt
    title insecure-bank - global startup overhead: candidate=1.60.0-SNAPSHOT~28720cb69b, baseline=1.60.0-SNAPSHOT~36ff528d76

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.074 s) : 0, 1073849
Total [baseline] (8.806 s) : 0, 8805830
Agent [candidate] (1.064 s) : 0, 1064274
Total [candidate] (8.735 s) : 0, 8735082
section iast
Agent [baseline] (1.238 s) : 0, 1238451
Total [baseline] (9.371 s) : 0, 9371138
Agent [candidate] (1.231 s) : 0, 1231180
Total [candidate] (9.371 s) : 0, 9371261
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.074 s -
Agent iast 1.238 s 164.602 ms (15.3%)
Total tracing 8.806 s -
Total iast 9.371 s 565.308 ms (6.4%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.064 s -
Agent iast 1.231 s 166.905 ms (15.7%)
Total tracing 8.735 s -
Total iast 9.371 s 636.179 ms (7.3%)
gantt
    title insecure-bank - break down per module: candidate=1.60.0-SNAPSHOT~28720cb69b, baseline=1.60.0-SNAPSHOT~36ff528d76

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.19 ms) : 0, 1190
crashtracking [candidate] (1.184 ms) : 0, 1184
BytebuddyAgent [baseline] (631.343 ms) : 0, 631343
BytebuddyAgent [candidate] (629.731 ms) : 0, 629731
AgentMeter [baseline] (29.527 ms) : 0, 29527
AgentMeter [candidate] (28.87 ms) : 0, 28870
GlobalTracer [baseline] (260.818 ms) : 0, 260818
GlobalTracer [candidate] (256.912 ms) : 0, 256912
AppSec [baseline] (33.502 ms) : 0, 33502
AppSec [candidate] (32.816 ms) : 0, 32816
Debugger [baseline] (62.21 ms) : 0, 62210
Debugger [candidate] (62.005 ms) : 0, 62005
Remote Config [baseline] (637.039 µs) : 0, 637
Remote Config [candidate] (613.828 µs) : 0, 614
Telemetry [baseline] (13.815 ms) : 0, 13815
Telemetry [candidate] (12.241 ms) : 0, 12241
Flare Poller [baseline] (5.474 ms) : 0, 5474
Flare Poller [candidate] (4.498 ms) : 0, 4498
section iast
crashtracking [baseline] (1.191 ms) : 0, 1191
crashtracking [candidate] (1.178 ms) : 0, 1178
BytebuddyAgent [baseline] (803.045 ms) : 0, 803045
BytebuddyAgent [candidate] (796.096 ms) : 0, 796096
AgentMeter [baseline] (11.426 ms) : 0, 11426
AgentMeter [candidate] (11.231 ms) : 0, 11231
GlobalTracer [baseline] (248.727 ms) : 0, 248727
GlobalTracer [candidate] (248.22 ms) : 0, 248220
AppSec [baseline] (33.626 ms) : 0, 33626
AppSec [candidate] (33.799 ms) : 0, 33799
Debugger [baseline] (65.486 ms) : 0, 65486
Debugger [candidate] (65.706 ms) : 0, 65706
Remote Config [baseline] (526.033 µs) : 0, 526
Remote Config [candidate] (537.283 µs) : 0, 537
Telemetry [baseline] (8.597 ms) : 0, 8597
Telemetry [candidate] (8.643 ms) : 0, 8643
Flare Poller [baseline] (3.425 ms) : 0, 3425
Flare Poller [candidate] (3.457 ms) : 0, 3457
IAST [baseline] (27.02 ms) : 0, 27020
IAST [candidate] (27.047 ms) : 0, 27047
Loading
Startup time reports for petclinic
gantt
    title petclinic - global startup overhead: candidate=1.60.0-SNAPSHOT~28720cb69b, baseline=1.60.0-SNAPSHOT~36ff528d76

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.063 s) : 0, 1063484
Total [baseline] (10.848 s) : 0, 10847956
Agent [candidate] (1.066 s) : 0, 1066135
Total [candidate] (10.847 s) : 0, 10847481
section appsec
Agent [baseline] (1.239 s) : 0, 1239152
Total [baseline] (10.922 s) : 0, 10921702
Agent [candidate] (1.239 s) : 0, 1239017
Total [candidate] (11.035 s) : 0, 11035340
section iast
Agent [baseline] (1.232 s) : 0, 1231990
Total [baseline] (11.183 s) : 0, 11182997
Agent [candidate] (1.233 s) : 0, 1233263
Total [candidate] (11.226 s) : 0, 11226321
section profiling
Agent [baseline] (1.188 s) : 0, 1187790
Total [baseline] (10.921 s) : 0, 10921271
Agent [candidate] (1.193 s) : 0, 1192565
Total [candidate] (10.964 s) : 0, 10964146
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.063 s -
Agent appsec 1.239 s 175.668 ms (16.5%)
Agent iast 1.232 s 168.506 ms (15.8%)
Agent profiling 1.188 s 124.305 ms (11.7%)
Total tracing 10.848 s -
Total appsec 10.922 s 73.746 ms (0.7%)
Total iast 11.183 s 335.041 ms (3.1%)
Total profiling 10.921 s 73.315 ms (0.7%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.066 s -
Agent appsec 1.239 s 172.882 ms (16.2%)
Agent iast 1.233 s 167.128 ms (15.7%)
Agent profiling 1.193 s 126.43 ms (11.9%)
Total tracing 10.847 s -
Total appsec 11.035 s 187.858 ms (1.7%)
Total iast 11.226 s 378.84 ms (3.5%)
Total profiling 10.964 s 116.665 ms (1.1%)
gantt
    title petclinic - break down per module: candidate=1.60.0-SNAPSHOT~28720cb69b, baseline=1.60.0-SNAPSHOT~36ff528d76

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.177 ms) : 0, 1177
crashtracking [candidate] (1.181 ms) : 0, 1181
BytebuddyAgent [baseline] (629.021 ms) : 0, 629021
BytebuddyAgent [candidate] (628.57 ms) : 0, 628570
AgentMeter [baseline] (28.875 ms) : 0, 28875
AgentMeter [candidate] (28.855 ms) : 0, 28855
GlobalTracer [baseline] (257.101 ms) : 0, 257101
GlobalTracer [candidate] (257.408 ms) : 0, 257408
AppSec [baseline] (32.934 ms) : 0, 32934
AppSec [candidate] (32.843 ms) : 0, 32843
Debugger [baseline] (62.461 ms) : 0, 62461
Debugger [candidate] (64.609 ms) : 0, 64609
Remote Config [baseline] (627.094 µs) : 0, 627
Remote Config [candidate] (609.116 µs) : 0, 609
Telemetry [baseline] (10.801 ms) : 0, 10801
Telemetry [candidate] (12.066 ms) : 0, 12066
Flare Poller [baseline] (5.298 ms) : 0, 5298
Flare Poller [candidate] (4.679 ms) : 0, 4679
section appsec
crashtracking [baseline] (1.185 ms) : 0, 1185
crashtracking [candidate] (1.18 ms) : 0, 1180
BytebuddyAgent [baseline] (658.292 ms) : 0, 658292
BytebuddyAgent [candidate] (658.0 ms) : 0, 658000
AgentMeter [baseline] (11.983 ms) : 0, 11983
AgentMeter [candidate] (12.019 ms) : 0, 12019
GlobalTracer [baseline] (258.041 ms) : 0, 258041
GlobalTracer [candidate] (258.148 ms) : 0, 258148
AppSec [baseline] (168.015 ms) : 0, 168015
AppSec [candidate] (168.826 ms) : 0, 168826
Debugger [baseline] (67.031 ms) : 0, 67031
Debugger [candidate] (66.323 ms) : 0, 66323
Remote Config [baseline] (658.173 µs) : 0, 658
Remote Config [candidate] (653.972 µs) : 0, 654
Telemetry [baseline] (9.618 ms) : 0, 9618
Telemetry [candidate] (9.726 ms) : 0, 9726
Flare Poller [baseline] (3.67 ms) : 0, 3670
Flare Poller [candidate] (3.692 ms) : 0, 3692
IAST [baseline] (25.329 ms) : 0, 25329
IAST [candidate] (25.147 ms) : 0, 25147
section iast
crashtracking [baseline] (1.177 ms) : 0, 1177
crashtracking [candidate] (1.178 ms) : 0, 1178
BytebuddyAgent [baseline] (795.972 ms) : 0, 795972
BytebuddyAgent [candidate] (797.183 ms) : 0, 797183
AgentMeter [baseline] (11.236 ms) : 0, 11236
AgentMeter [candidate] (11.256 ms) : 0, 11256
GlobalTracer [baseline] (247.749 ms) : 0, 247749
GlobalTracer [candidate] (248.263 ms) : 0, 248263
AppSec [baseline] (35.693 ms) : 0, 35693
AppSec [candidate] (34.443 ms) : 0, 34443
Debugger [baseline] (65.223 ms) : 0, 65223
Debugger [candidate] (65.905 ms) : 0, 65905
Remote Config [baseline] (535.883 µs) : 0, 536
Remote Config [candidate] (542.206 µs) : 0, 542
Telemetry [baseline] (8.536 ms) : 0, 8536
Telemetry [candidate] (8.693 ms) : 0, 8693
Flare Poller [baseline] (3.527 ms) : 0, 3527
Flare Poller [candidate] (3.471 ms) : 0, 3471
IAST [baseline] (27.065 ms) : 0, 27065
IAST [candidate] (27.08 ms) : 0, 27080
section profiling
crashtracking [baseline] (1.221 ms) : 0, 1221
crashtracking [candidate] (1.224 ms) : 0, 1224
BytebuddyAgent [baseline] (680.979 ms) : 0, 680979
BytebuddyAgent [candidate] (683.778 ms) : 0, 683778
AgentMeter [baseline] (8.632 ms) : 0, 8632
AgentMeter [candidate] (8.621 ms) : 0, 8621
GlobalTracer [baseline] (215.443 ms) : 0, 215443
GlobalTracer [candidate] (216.038 ms) : 0, 216038
AppSec [baseline] (32.517 ms) : 0, 32517
AppSec [candidate] (32.747 ms) : 0, 32747
Debugger [baseline] (67.143 ms) : 0, 67143
Debugger [candidate] (67.259 ms) : 0, 67259
Remote Config [baseline] (631.961 µs) : 0, 632
Remote Config [candidate] (635.189 µs) : 0, 635
Telemetry [baseline] (8.947 ms) : 0, 8947
Telemetry [candidate] (8.986 ms) : 0, 8986
Flare Poller [baseline] (3.766 ms) : 0, 3766
Flare Poller [candidate] (3.768 ms) : 0, 3768
ProfilingAgent [baseline] (98.746 ms) : 0, 98746
ProfilingAgent [candidate] (99.586 ms) : 0, 99586
Profiling [baseline] (99.314 ms) : 0, 99314
Profiling [candidate] (100.189 ms) : 0, 100189
Loading

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master mcculls/fix-otel-activation-tests
git_commit_date 1771408718 1771420684
git_commit_sha 36ff528 28720cb
release_version 1.60.0-SNAPSHOT~36ff528d76 1.60.0-SNAPSHOT~28720cb69b
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1771423063 1771423063
ci_job_id 1435168358 1435168358
ci_pipeline_id 97199509 97199509
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-g10tpv8u 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-g10tpv8u 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 1 performance improvements and 1 performance regressions! Performance is the same for 17 metrics, 17 unstable metrics.

scenario Δ mean agg_http_req_duration_p50 Δ mean agg_http_req_duration_p95 Δ mean throughput candidate mean agg_http_req_duration_p50 candidate mean agg_http_req_duration_p95 candidate mean throughput baseline mean agg_http_req_duration_p50 baseline mean agg_http_req_duration_p95 baseline mean throughput
scenario:load:insecure-bank:iast_GLOBAL:high_load worse
[+67.810µs; +175.619µs] or [+2.465%; +6.385%]
unsure
[+97.008µs; +518.462µs] or [+1.264%; +6.756%]
unstable
[-195.439op/s; +85.002op/s] or [-14.829%; +6.450%]
2.872ms 7.982ms 1262.719op/s 2.751ms 7.674ms 1317.938op/s
scenario:load:petclinic:appsec:high_load better
[-778.599µs; -376.869µs] or [-4.171%; -2.019%]
same
[-810.623µs; +372.385µs] or [-2.677%; +1.230%]
unstable
[-19.768op/s; +30.643op/s] or [-8.025%; +12.439%]
18.087ms 30.065ms 251.781op/s 18.665ms 30.284ms 246.344op/s
Request duration reports for petclinic
gantt
    title petclinic - request duration [CI 0.99] : candidate=1.60.0-SNAPSHOT~28720cb69b, baseline=1.60.0-SNAPSHOT~36ff528d76
    dateFormat X
    axisFormat %s
section baseline
no_agent (18.435 ms) : 18246, 18625
.   : milestone, 18435,
appsec (18.946 ms) : 18753, 19139
.   : milestone, 18946,
code_origins (17.777 ms) : 17599, 17955
.   : milestone, 17777,
iast (17.754 ms) : 17577, 17932
.   : milestone, 17754,
profiling (18.628 ms) : 18441, 18815
.   : milestone, 18628,
tracing (17.661 ms) : 17488, 17833
.   : milestone, 17661,
section candidate
no_agent (17.783 ms) : 17604, 17963
.   : milestone, 17783,
appsec (18.537 ms) : 18349, 18725
.   : milestone, 18537,
code_origins (17.796 ms) : 17617, 17976
.   : milestone, 17796,
iast (17.657 ms) : 17481, 17833
.   : milestone, 17657,
profiling (18.693 ms) : 18507, 18879
.   : milestone, 18693,
tracing (18.017 ms) : 17837, 18197
.   : milestone, 18017,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 18.435 ms [18.246 ms, 18.625 ms] -
appsec 18.946 ms [18.753 ms, 19.139 ms] 510.666 µs (2.8%)
code_origins 17.777 ms [17.599 ms, 17.955 ms] -658.277 µs (-3.6%)
iast 17.754 ms [17.577 ms, 17.932 ms] -680.955 µs (-3.7%)
profiling 18.628 ms [18.441 ms, 18.815 ms] 192.973 µs (1.0%)
tracing 17.661 ms [17.488 ms, 17.833 ms] -774.542 µs (-4.2%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 17.783 ms [17.604 ms, 17.963 ms] -
appsec 18.537 ms [18.349 ms, 18.725 ms] 753.437 µs (4.2%)
code_origins 17.796 ms [17.617 ms, 17.976 ms] 12.996 µs (0.1%)
iast 17.657 ms [17.481 ms, 17.833 ms] -126.306 µs (-0.7%)
profiling 18.693 ms [18.507 ms, 18.879 ms] 909.365 µs (5.1%)
tracing 18.017 ms [17.837 ms, 18.197 ms] 233.493 µs (1.3%)
Request duration reports for insecure-bank
gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.60.0-SNAPSHOT~28720cb69b, baseline=1.60.0-SNAPSHOT~36ff528d76
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.216 ms) : 1204, 1228
.   : milestone, 1216,
iast (3.113 ms) : 3073, 3154
.   : milestone, 3113,
iast_FULL (5.613 ms) : 5556, 5670
.   : milestone, 5613,
iast_GLOBAL (3.477 ms) : 3426, 3529
.   : milestone, 3477,
profiling (1.956 ms) : 1938, 1973
.   : milestone, 1956,
tracing (1.782 ms) : 1767, 1797
.   : milestone, 1782,
section candidate
no_agent (1.173 ms) : 1162, 1185
.   : milestone, 1173,
iast (3.149 ms) : 3109, 3189
.   : milestone, 3149,
iast_FULL (5.521 ms) : 5467, 5575
.   : milestone, 5521,
iast_GLOBAL (3.633 ms) : 3572, 3693
.   : milestone, 3633,
profiling (2.013 ms) : 1995, 2030
.   : milestone, 2013,
tracing (1.776 ms) : 1761, 1790
.   : milestone, 1776,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.216 ms [1.204 ms, 1.228 ms] -
iast 3.113 ms [3.073 ms, 3.154 ms] 1.897 ms (156.0%)
iast_FULL 5.613 ms [5.556 ms, 5.67 ms] 4.397 ms (361.5%)
iast_GLOBAL 3.477 ms [3.426 ms, 3.529 ms] 2.261 ms (185.9%)
profiling 1.956 ms [1.938 ms, 1.973 ms] 739.367 µs (60.8%)
tracing 1.782 ms [1.767 ms, 1.797 ms] 566.073 µs (46.5%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.173 ms [1.162 ms, 1.185 ms] -
iast 3.149 ms [3.109 ms, 3.189 ms] 1.975 ms (168.4%)
iast_FULL 5.521 ms [5.467 ms, 5.575 ms] 4.348 ms (370.6%)
iast_GLOBAL 3.633 ms [3.572 ms, 3.693 ms] 2.459 ms (209.6%)
profiling 2.013 ms [1.995 ms, 2.03 ms] 839.606 µs (71.6%)
tracing 1.776 ms [1.761 ms, 1.79 ms] 602.548 µs (51.4%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master mcculls/fix-otel-activation-tests
git_commit_date 1771408718 1771420684
git_commit_sha 36ff528 28720cb
release_version 1.60.0-SNAPSHOT~36ff528d76 1.60.0-SNAPSHOT~28720cb69b
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1771422915 1771422915
ci_job_id 1435168360 1435168360
ci_pipeline_id 97199509 97199509
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-wqi5y1a6 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-wqi5y1a6 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 1 unstable metrics.

Execution time for biojava
gantt
    title biojava - execution time [CI 0.99] : candidate=1.60.0-SNAPSHOT~28720cb69b, baseline=1.60.0-SNAPSHOT~36ff528d76
    dateFormat X
    axisFormat %s
section baseline
no_agent (15.547 s) : 15547000, 15547000
.   : milestone, 15547000,
appsec (14.941 s) : 14941000, 14941000
.   : milestone, 14941000,
iast (18.05 s) : 18050000, 18050000
.   : milestone, 18050000,
iast_GLOBAL (17.732 s) : 17732000, 17732000
.   : milestone, 17732000,
profiling (14.921 s) : 14921000, 14921000
.   : milestone, 14921000,
tracing (14.789 s) : 14789000, 14789000
.   : milestone, 14789000,
section candidate
no_agent (14.995 s) : 14995000, 14995000
.   : milestone, 14995000,
appsec (14.766 s) : 14766000, 14766000
.   : milestone, 14766000,
iast (18.252 s) : 18252000, 18252000
.   : milestone, 18252000,
iast_GLOBAL (17.684 s) : 17684000, 17684000
.   : milestone, 17684000,
profiling (15.132 s) : 15132000, 15132000
.   : milestone, 15132000,
tracing (14.909 s) : 14909000, 14909000
.   : milestone, 14909000,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.547 s [15.547 s, 15.547 s] -
appsec 14.941 s [14.941 s, 14.941 s] -606.0 ms (-3.9%)
iast 18.05 s [18.05 s, 18.05 s] 2.503 s (16.1%)
iast_GLOBAL 17.732 s [17.732 s, 17.732 s] 2.185 s (14.1%)
profiling 14.921 s [14.921 s, 14.921 s] -626.0 ms (-4.0%)
tracing 14.789 s [14.789 s, 14.789 s] -758.0 ms (-4.9%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 14.995 s [14.995 s, 14.995 s] -
appsec 14.766 s [14.766 s, 14.766 s] -229.0 ms (-1.5%)
iast 18.252 s [18.252 s, 18.252 s] 3.257 s (21.7%)
iast_GLOBAL 17.684 s [17.684 s, 17.684 s] 2.689 s (17.9%)
profiling 15.132 s [15.132 s, 15.132 s] 137.0 ms (0.9%)
tracing 14.909 s [14.909 s, 14.909 s] -86.0 ms (-0.6%)
Execution time for tomcat
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.60.0-SNAPSHOT~28720cb69b, baseline=1.60.0-SNAPSHOT~36ff528d76
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.47 ms) : 1459, 1482
.   : milestone, 1470,
appsec (3.798 ms) : 3575, 4021
.   : milestone, 3798,
iast (2.246 ms) : 2177, 2315
.   : milestone, 2246,
iast_GLOBAL (2.298 ms) : 2229, 2368
.   : milestone, 2298,
profiling (2.083 ms) : 2029, 2138
.   : milestone, 2083,
tracing (2.054 ms) : 2001, 2108
.   : milestone, 2054,
section candidate
no_agent (1.476 ms) : 1465, 1488
.   : milestone, 1476,
appsec (3.762 ms) : 3541, 3982
.   : milestone, 3762,
iast (2.249 ms) : 2180, 2319
.   : milestone, 2249,
iast_GLOBAL (2.298 ms) : 2228, 2367
.   : milestone, 2298,
profiling (2.111 ms) : 2054, 2168
.   : milestone, 2111,
tracing (2.061 ms) : 2008, 2115
.   : milestone, 2061,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.47 ms [1.459 ms, 1.482 ms] -
appsec 3.798 ms [3.575 ms, 4.021 ms] 2.328 ms (158.3%)
iast 2.246 ms [2.177 ms, 2.315 ms] 775.584 µs (52.8%)
iast_GLOBAL 2.298 ms [2.229 ms, 2.368 ms] 828.15 µs (56.3%)
profiling 2.083 ms [2.029 ms, 2.138 ms] 613.147 µs (41.7%)
tracing 2.054 ms [2.001 ms, 2.108 ms] 584.116 µs (39.7%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.476 ms [1.465 ms, 1.488 ms] -
appsec 3.762 ms [3.541 ms, 3.982 ms] 2.285 ms (154.8%)
iast 2.249 ms [2.18 ms, 2.319 ms] 773.105 µs (52.4%)
iast_GLOBAL 2.298 ms [2.228 ms, 2.367 ms] 821.42 µs (55.6%)
profiling 2.111 ms [2.054 ms, 2.168 ms] 634.714 µs (43.0%)
tracing 2.061 ms [2.008 ms, 2.115 ms] 585.064 µs (39.6%)

@mcculls mcculls requested a review from amarziali February 18, 2026 20:13
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

comp: testing Testing tag: no release notes Changes to exclude from release notes type: bug Bug report and fix

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant

Comments