Tweak CI for better resources utilization.#10612
Draft
AlexeyKuznetsov-DD wants to merge 23 commits intomasterfrom
Draft
Tweak CI for better resources utilization.#10612AlexeyKuznetsov-DD wants to merge 23 commits intomasterfrom
AlexeyKuznetsov-DD wants to merge 23 commits intomasterfrom
Conversation
# Conflicts: # .gitlab-ci.yml
BenchmarksStartupParameters
See matching parameters
SummaryFound 0 performance improvements and 0 performance regressions! Performance is the same for 62 metrics, 9 unstable metrics. Startup time reports for petclinicgantt
title petclinic - global startup overhead: candidate=1.59.0-SNAPSHOT~57a0cc7003, baseline=1.60.0-SNAPSHOT~2fa3c0c243
dateFormat X
axisFormat %s
section tracing
Agent [baseline] (1.07 s) : 0, 1069905
Total [baseline] (11.002 s) : 0, 11001568
Agent [candidate] (1.068 s) : 0, 1068397
Total [candidate] (10.785 s) : 0, 10785013
section appsec
Agent [baseline] (1.239 s) : 0, 1239303
Total [baseline] (10.982 s) : 0, 10982409
Agent [candidate] (1.238 s) : 0, 1238091
Total [candidate] (11.046 s) : 0, 11045556
section iast
Agent [baseline] (1.245 s) : 0, 1244914
Total [baseline] (11.18 s) : 0, 11179992
Agent [candidate] (1.24 s) : 0, 1240112
Total [candidate] (11.189 s) : 0, 11189305
section profiling
Agent [baseline] (1.191 s) : 0, 1190570
Total [baseline] (10.949 s) : 0, 10949032
Agent [candidate] (1.191 s) : 0, 1190860
Total [candidate] (10.974 s) : 0, 10974047
gantt
title petclinic - break down per module: candidate=1.59.0-SNAPSHOT~57a0cc7003, baseline=1.60.0-SNAPSHOT~2fa3c0c243
dateFormat X
axisFormat %s
section tracing
crashtracking [baseline] (1.183 ms) : 0, 1183
crashtracking [candidate] (1.202 ms) : 0, 1202
BytebuddyAgent [baseline] (627.846 ms) : 0, 627846
BytebuddyAgent [candidate] (630.144 ms) : 0, 630144
AgentMeter [baseline] (29.311 ms) : 0, 29311
AgentMeter [candidate] (28.943 ms) : 0, 28943
GlobalTracer [baseline] (258.751 ms) : 0, 258751
GlobalTracer [candidate] (257.149 ms) : 0, 257149
AppSec [baseline] (33.688 ms) : 0, 33688
AppSec [candidate] (32.91 ms) : 0, 32910
Debugger [baseline] (64.738 ms) : 0, 64738
Debugger [candidate] (66.814 ms) : 0, 66814
Remote Config [baseline] (620.443 µs) : 0, 620
Remote Config [candidate] (597.168 µs) : 0, 597
Telemetry [baseline] (12.373 ms) : 0, 12373
Telemetry [candidate] (9.831 ms) : 0, 9831
Flare Poller [baseline] (5.293 ms) : 0, 5293
Flare Poller [candidate] (4.572 ms) : 0, 4572
section appsec
crashtracking [baseline] (1.19 ms) : 0, 1190
crashtracking [candidate] (1.188 ms) : 0, 1188
BytebuddyAgent [baseline] (657.964 ms) : 0, 657964
BytebuddyAgent [candidate] (657.302 ms) : 0, 657302
AgentMeter [baseline] (11.939 ms) : 0, 11939
AgentMeter [candidate] (11.987 ms) : 0, 11987
GlobalTracer [baseline] (257.677 ms) : 0, 257677
GlobalTracer [candidate] (257.744 ms) : 0, 257744
IAST [baseline] (25.371 ms) : 0, 25371
IAST [candidate] (25.349 ms) : 0, 25349
AppSec [baseline] (168.471 ms) : 0, 168471
AppSec [candidate] (167.653 ms) : 0, 167653
Debugger [baseline] (66.927 ms) : 0, 66927
Debugger [candidate] (66.93 ms) : 0, 66930
Remote Config [baseline] (651.744 µs) : 0, 652
Remote Config [candidate] (647.785 µs) : 0, 648
Telemetry [baseline] (9.416 ms) : 0, 9416
Telemetry [candidate] (9.559 ms) : 0, 9559
Flare Poller [baseline] (3.68 ms) : 0, 3680
Flare Poller [candidate] (3.799 ms) : 0, 3799
section iast
crashtracking [baseline] (1.205 ms) : 0, 1205
crashtracking [candidate] (1.22 ms) : 0, 1220
BytebuddyAgent [baseline] (805.537 ms) : 0, 805537
BytebuddyAgent [candidate] (801.489 ms) : 0, 801489
AgentMeter [baseline] (11.795 ms) : 0, 11795
AgentMeter [candidate] (11.442 ms) : 0, 11442
GlobalTracer [baseline] (249.568 ms) : 0, 249568
GlobalTracer [candidate] (249.203 ms) : 0, 249203
IAST [baseline] (27.604 ms) : 0, 27604
IAST [candidate] (27.395 ms) : 0, 27395
AppSec [baseline] (33.294 ms) : 0, 33294
AppSec [candidate] (35.048 ms) : 0, 35048
Debugger [baseline] (67.274 ms) : 0, 67274
Debugger [candidate] (65.577 ms) : 0, 65577
Remote Config [baseline] (537.017 µs) : 0, 537
Remote Config [candidate] (522.564 µs) : 0, 523
Telemetry [baseline] (8.554 ms) : 0, 8554
Telemetry [candidate] (8.553 ms) : 0, 8553
Flare Poller [baseline] (3.421 ms) : 0, 3421
Flare Poller [candidate] (3.429 ms) : 0, 3429
section profiling
crashtracking [baseline] (1.182 ms) : 0, 1182
crashtracking [candidate] (1.18 ms) : 0, 1180
BytebuddyAgent [baseline] (681.708 ms) : 0, 681708
BytebuddyAgent [candidate] (682.026 ms) : 0, 682026
AgentMeter [baseline] (8.549 ms) : 0, 8549
AgentMeter [candidate] (8.561 ms) : 0, 8561
GlobalTracer [baseline] (215.861 ms) : 0, 215861
GlobalTracer [candidate] (216.161 ms) : 0, 216161
AppSec [baseline] (32.528 ms) : 0, 32528
AppSec [candidate] (32.553 ms) : 0, 32553
Debugger [baseline] (66.89 ms) : 0, 66890
Debugger [candidate] (67.368 ms) : 0, 67368
Remote Config [baseline] (627.866 µs) : 0, 628
Remote Config [candidate] (636.157 µs) : 0, 636
Telemetry [baseline] (9.081 ms) : 0, 9081
Telemetry [candidate] (9.02 ms) : 0, 9020
Flare Poller [baseline] (3.844 ms) : 0, 3844
Flare Poller [candidate] (3.73 ms) : 0, 3730
ProfilingAgent [baseline] (99.631 ms) : 0, 99631
ProfilingAgent [candidate] (98.966 ms) : 0, 98966
Profiling [baseline] (100.208 ms) : 0, 100208
Profiling [candidate] (99.532 ms) : 0, 99532
Startup time reports for insecure-bankgantt
title insecure-bank - global startup overhead: candidate=1.59.0-SNAPSHOT~57a0cc7003, baseline=1.60.0-SNAPSHOT~2fa3c0c243
dateFormat X
axisFormat %s
section tracing
Agent [baseline] (1.062 s) : 0, 1061534
Total [baseline] (8.769 s) : 0, 8768746
Agent [candidate] (1.06 s) : 0, 1059544
Total [candidate] (8.694 s) : 0, 8693818
section iast
Agent [baseline] (1.226 s) : 0, 1226044
Total [baseline] (9.389 s) : 0, 9388622
Agent [candidate] (1.238 s) : 0, 1237524
Total [candidate] (9.496 s) : 0, 9496004
gantt
title insecure-bank - break down per module: candidate=1.59.0-SNAPSHOT~57a0cc7003, baseline=1.60.0-SNAPSHOT~2fa3c0c243
dateFormat X
axisFormat %s
section tracing
crashtracking [baseline] (1.207 ms) : 0, 1207
crashtracking [candidate] (1.192 ms) : 0, 1192
BytebuddyAgent [baseline] (625.274 ms) : 0, 625274
BytebuddyAgent [candidate] (624.054 ms) : 0, 624054
AgentMeter [baseline] (29.014 ms) : 0, 29014
AgentMeter [candidate] (28.81 ms) : 0, 28810
GlobalTracer [baseline] (256.614 ms) : 0, 256614
GlobalTracer [candidate] (256.547 ms) : 0, 256547
AppSec [baseline] (32.973 ms) : 0, 32973
AppSec [candidate] (32.704 ms) : 0, 32704
Debugger [baseline] (63.77 ms) : 0, 63770
Debugger [candidate] (64.582 ms) : 0, 64582
Remote Config [baseline] (620.089 µs) : 0, 620
Remote Config [candidate] (603.838 µs) : 0, 604
Telemetry [baseline] (12.243 ms) : 0, 12243
Telemetry [candidate] (11.385 ms) : 0, 11385
Flare Poller [baseline] (3.801 ms) : 0, 3801
Flare Poller [candidate] (3.721 ms) : 0, 3721
section iast
crashtracking [baseline] (1.195 ms) : 0, 1195
crashtracking [candidate] (1.202 ms) : 0, 1202
BytebuddyAgent [baseline] (792.106 ms) : 0, 792106
BytebuddyAgent [candidate] (799.936 ms) : 0, 799936
AgentMeter [baseline] (11.253 ms) : 0, 11253
AgentMeter [candidate] (11.532 ms) : 0, 11532
GlobalTracer [baseline] (246.687 ms) : 0, 246687
GlobalTracer [candidate] (248.707 ms) : 0, 248707
IAST [baseline] (26.919 ms) : 0, 26919
IAST [candidate] (27.01 ms) : 0, 27010
AppSec [baseline] (32.939 ms) : 0, 32939
AppSec [candidate] (30.83 ms) : 0, 30830
Debugger [baseline] (66.409 ms) : 0, 66409
Debugger [candidate] (69.436 ms) : 0, 69436
Remote Config [baseline] (538.746 µs) : 0, 539
Remote Config [candidate] (556.61 µs) : 0, 557
Telemetry [baseline] (8.59 ms) : 0, 8590
Telemetry [candidate] (8.716 ms) : 0, 8716
Flare Poller [baseline] (3.46 ms) : 0, 3460
Flare Poller [candidate] (3.578 ms) : 0, 3578
LoadParameters
See matching parameters
SummaryFound 2 performance improvements and 4 performance regressions! Performance is the same for 14 metrics, 16 unstable metrics.
Request duration reports for insecure-bankgantt
title insecure-bank - request duration [CI 0.99] : candidate=1.59.0-SNAPSHOT~57a0cc7003, baseline=1.60.0-SNAPSHOT~2fa3c0c243
dateFormat X
axisFormat %s
section baseline
no_agent (1.171 ms) : 1160, 1182
. : milestone, 1171,
iast (3.157 ms) : 3115, 3200
. : milestone, 3157,
iast_FULL (5.676 ms) : 5620, 5732
. : milestone, 5676,
iast_GLOBAL (3.575 ms) : 3524, 3627
. : milestone, 3575,
profiling (2.114 ms) : 2095, 2133
. : milestone, 2114,
tracing (1.797 ms) : 1782, 1812
. : milestone, 1797,
section candidate
no_agent (1.176 ms) : 1164, 1187
. : milestone, 1176,
iast (3.192 ms) : 3150, 3233
. : milestone, 3192,
iast_FULL (6.221 ms) : 6156, 6285
. : milestone, 6221,
iast_GLOBAL (3.693 ms) : 3632, 3754
. : milestone, 3693,
profiling (2.033 ms) : 2015, 2051
. : milestone, 2033,
tracing (1.768 ms) : 1754, 1782
. : milestone, 1768,
Request duration reports for petclinicgantt
title petclinic - request duration [CI 0.99] : candidate=1.59.0-SNAPSHOT~57a0cc7003, baseline=1.60.0-SNAPSHOT~2fa3c0c243
dateFormat X
axisFormat %s
section baseline
no_agent (18.289 ms) : 18097, 18482
. : milestone, 18289,
appsec (18.811 ms) : 18614, 19008
. : milestone, 18811,
code_origins (18.107 ms) : 17925, 18288
. : milestone, 18107,
iast (17.607 ms) : 17432, 17782
. : milestone, 17607,
profiling (20.082 ms) : 19874, 20290
. : milestone, 20082,
tracing (17.391 ms) : 17224, 17558
. : milestone, 17391,
section candidate
no_agent (17.287 ms) : 17113, 17461
. : milestone, 17287,
appsec (19.073 ms) : 18879, 19268
. : milestone, 19073,
code_origins (17.577 ms) : 17402, 17751
. : milestone, 17577,
iast (17.688 ms) : 17514, 17861
. : milestone, 17688,
profiling (18.906 ms) : 18711, 19101
. : milestone, 18906,
tracing (18.892 ms) : 18705, 19079
. : milestone, 18892,
DacapoParameters
See matching parameters
SummaryFound 0 performance improvements and 0 performance regressions! Performance is the same for 10 metrics, 2 unstable metrics. Execution time for tomcatgantt
title tomcat - execution time [CI 0.99] : candidate=1.59.0-SNAPSHOT~57a0cc7003, baseline=1.60.0-SNAPSHOT~2fa3c0c243
dateFormat X
axisFormat %s
section baseline
no_agent (1.468 ms) : 1457, 1480
. : milestone, 1468,
appsec (3.756 ms) : 3535, 3977
. : milestone, 3756,
iast (2.246 ms) : 2177, 2315
. : milestone, 2246,
iast_GLOBAL (2.283 ms) : 2214, 2352
. : milestone, 2283,
profiling (2.501 ms) : 2339, 2664
. : milestone, 2501,
tracing (2.042 ms) : 1989, 2095
. : milestone, 2042,
section candidate
no_agent (1.468 ms) : 1457, 1480
. : milestone, 1468,
appsec (3.714 ms) : 3498, 3931
. : milestone, 3714,
iast (2.248 ms) : 2179, 2317
. : milestone, 2248,
iast_GLOBAL (2.287 ms) : 2218, 2357
. : milestone, 2287,
profiling (2.065 ms) : 2011, 2119
. : milestone, 2065,
tracing (2.053 ms) : 2000, 2107
. : milestone, 2053,
Execution time for biojavagantt
title biojava - execution time [CI 0.99] : candidate=1.59.0-SNAPSHOT~57a0cc7003, baseline=1.60.0-SNAPSHOT~2fa3c0c243
dateFormat X
axisFormat %s
section baseline
no_agent (15.195 s) : 15195000, 15195000
. : milestone, 15195000,
appsec (14.849 s) : 14849000, 14849000
. : milestone, 14849000,
iast (18.08 s) : 18080000, 18080000
. : milestone, 18080000,
iast_GLOBAL (17.875 s) : 17875000, 17875000
. : milestone, 17875000,
profiling (14.895 s) : 14895000, 14895000
. : milestone, 14895000,
tracing (14.801 s) : 14801000, 14801000
. : milestone, 14801000,
section candidate
no_agent (14.951 s) : 14951000, 14951000
. : milestone, 14951000,
appsec (14.771 s) : 14771000, 14771000
. : milestone, 14771000,
iast (18.089 s) : 18089000, 18089000
. : milestone, 18089000,
iast_GLOBAL (18.033 s) : 18033000, 18033000
. : milestone, 18033000,
profiling (14.93 s) : 14930000, 14930000
. : milestone, 14930000,
tracing (14.681 s) : 14681000, 14681000
. : milestone, 14681000,
|
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
What Does This Do
TODO, DO NOT MERGE
Motivation
Additional Notes