Implement OpenTelemetry Observable Metrics API#10631
Open
Conversation
BenchmarksStartupParameters
See matching parameters
SummaryFound 0 performance improvements and 0 performance regressions! Performance is the same for 61 metrics, 10 unstable metrics. Startup time reports for insecure-bankgantt
title insecure-bank - global startup overhead: candidate=1.60.0-SNAPSHOT~9b76ed76a1, baseline=1.60.0-SNAPSHOT~36ff528d76
dateFormat X
axisFormat %s
section tracing
Agent [baseline] (1.067 s) : 0, 1067321
Total [baseline] (8.806 s) : 0, 8805622
Agent [candidate] (1.065 s) : 0, 1065371
Total [candidate] (8.736 s) : 0, 8735690
section iast
Agent [baseline] (1.235 s) : 0, 1235144
Total [baseline] (9.375 s) : 0, 9375316
Agent [candidate] (1.234 s) : 0, 1233611
Total [candidate] (9.358 s) : 0, 9357691
gantt
title insecure-bank - break down per module: candidate=1.60.0-SNAPSHOT~9b76ed76a1, baseline=1.60.0-SNAPSHOT~36ff528d76
dateFormat X
axisFormat %s
section tracing
crashtracking [baseline] (1.189 ms) : 0, 1189
crashtracking [candidate] (1.183 ms) : 0, 1183
BytebuddyAgent [baseline] (630.91 ms) : 0, 630910
BytebuddyAgent [candidate] (628.617 ms) : 0, 628617
AgentMeter [baseline] (29.052 ms) : 0, 29052
AgentMeter [candidate] (28.91 ms) : 0, 28910
GlobalTracer [baseline] (258.096 ms) : 0, 258096
GlobalTracer [candidate] (257.579 ms) : 0, 257579
AppSec [baseline] (33.075 ms) : 0, 33075
AppSec [candidate] (32.986 ms) : 0, 32986
Debugger [baseline] (61.395 ms) : 0, 61395
Debugger [candidate] (60.765 ms) : 0, 60765
Remote Config [baseline] (645.287 µs) : 0, 645
Remote Config [candidate] (638.395 µs) : 0, 638
Telemetry [baseline] (12.293 ms) : 0, 12293
Telemetry [candidate] (14.108 ms) : 0, 14108
Flare Poller [baseline] (5.314 ms) : 0, 5314
Flare Poller [candidate] (5.388 ms) : 0, 5388
section iast
crashtracking [baseline] (1.183 ms) : 0, 1183
crashtracking [candidate] (1.174 ms) : 0, 1174
BytebuddyAgent [baseline] (799.672 ms) : 0, 799672
BytebuddyAgent [candidate] (798.017 ms) : 0, 798017
AgentMeter [baseline] (11.247 ms) : 0, 11247
AgentMeter [candidate] (11.255 ms) : 0, 11255
GlobalTracer [baseline] (248.039 ms) : 0, 248039
GlobalTracer [candidate] (248.815 ms) : 0, 248815
AppSec [baseline] (34.155 ms) : 0, 34155
AppSec [candidate] (32.965 ms) : 0, 32965
Debugger [baseline] (65.944 ms) : 0, 65944
Debugger [candidate] (66.613 ms) : 0, 66613
Remote Config [baseline] (530.283 µs) : 0, 530
Remote Config [candidate] (546.039 µs) : 0, 546
Telemetry [baseline] (8.668 ms) : 0, 8668
Telemetry [candidate] (8.558 ms) : 0, 8558
Flare Poller [baseline] (3.472 ms) : 0, 3472
Flare Poller [candidate] (3.482 ms) : 0, 3482
IAST [baseline] (26.889 ms) : 0, 26889
IAST [candidate] (26.953 ms) : 0, 26953
Startup time reports for petclinicgantt
title petclinic - global startup overhead: candidate=1.60.0-SNAPSHOT~9b76ed76a1, baseline=1.60.0-SNAPSHOT~36ff528d76
dateFormat X
axisFormat %s
section tracing
Agent [baseline] (1.066 s) : 0, 1065818
Total [baseline] (10.813 s) : 0, 10812956
Agent [candidate] (1.069 s) : 0, 1069105
Total [candidate] (10.923 s) : 0, 10923093
section appsec
Agent [baseline] (1.238 s) : 0, 1237621
Total [baseline] (11.077 s) : 0, 11076778
Agent [candidate] (1.237 s) : 0, 1237460
Total [candidate] (10.976 s) : 0, 10975936
section iast
Agent [baseline] (1.235 s) : 0, 1234558
Total [baseline] (11.301 s) : 0, 11301059
Agent [candidate] (1.233 s) : 0, 1232926
Total [candidate] (11.229 s) : 0, 11229437
section profiling
Agent [baseline] (1.191 s) : 0, 1191198
Total [baseline] (10.958 s) : 0, 10957571
Agent [candidate] (1.197 s) : 0, 1196964
Total [candidate] (11.051 s) : 0, 11051357
gantt
title petclinic - break down per module: candidate=1.60.0-SNAPSHOT~9b76ed76a1, baseline=1.60.0-SNAPSHOT~36ff528d76
dateFormat X
axisFormat %s
section tracing
crashtracking [baseline] (1.175 ms) : 0, 1175
crashtracking [candidate] (1.18 ms) : 0, 1180
BytebuddyAgent [baseline] (628.682 ms) : 0, 628682
BytebuddyAgent [candidate] (630.556 ms) : 0, 630556
AgentMeter [baseline] (28.899 ms) : 0, 28899
AgentMeter [candidate] (29.044 ms) : 0, 29044
GlobalTracer [baseline] (257.439 ms) : 0, 257439
GlobalTracer [candidate] (258.001 ms) : 0, 258001
AppSec [baseline] (32.723 ms) : 0, 32723
AppSec [candidate] (33.052 ms) : 0, 33052
Debugger [baseline] (64.372 ms) : 0, 64372
Debugger [candidate] (62.596 ms) : 0, 62596
Remote Config [baseline] (614.827 µs) : 0, 615
Remote Config [candidate] (628.73 µs) : 0, 629
Telemetry [baseline] (12.213 ms) : 0, 12213
Telemetry [candidate] (12.562 ms) : 0, 12562
Flare Poller [baseline] (4.538 ms) : 0, 4538
Flare Poller [candidate] (6.124 ms) : 0, 6124
section appsec
crashtracking [baseline] (1.172 ms) : 0, 1172
crashtracking [candidate] (1.195 ms) : 0, 1195
BytebuddyAgent [baseline] (657.479 ms) : 0, 657479
BytebuddyAgent [candidate] (658.124 ms) : 0, 658124
AgentMeter [baseline] (11.944 ms) : 0, 11944
AgentMeter [candidate] (11.943 ms) : 0, 11943
GlobalTracer [baseline] (257.907 ms) : 0, 257907
GlobalTracer [candidate] (257.649 ms) : 0, 257649
AppSec [baseline] (167.421 ms) : 0, 167421
AppSec [candidate] (168.184 ms) : 0, 168184
Debugger [baseline] (67.074 ms) : 0, 67074
Debugger [candidate] (65.998 ms) : 0, 65998
Remote Config [baseline] (640.927 µs) : 0, 641
Remote Config [candidate] (656.0 µs) : 0, 656
Telemetry [baseline] (9.735 ms) : 0, 9735
Telemetry [candidate] (9.495 ms) : 0, 9495
Flare Poller [baseline] (3.71 ms) : 0, 3710
Flare Poller [candidate] (3.625 ms) : 0, 3625
IAST [baseline] (25.376 ms) : 0, 25376
IAST [candidate] (25.309 ms) : 0, 25309
section iast
crashtracking [baseline] (1.176 ms) : 0, 1176
crashtracking [candidate] (1.204 ms) : 0, 1204
BytebuddyAgent [baseline] (796.838 ms) : 0, 796838
BytebuddyAgent [candidate] (797.399 ms) : 0, 797399
AgentMeter [baseline] (11.278 ms) : 0, 11278
AgentMeter [candidate] (11.233 ms) : 0, 11233
GlobalTracer [baseline] (248.816 ms) : 0, 248816
GlobalTracer [candidate] (248.247 ms) : 0, 248247
AppSec [baseline] (32.309 ms) : 0, 32309
AppSec [candidate] (32.686 ms) : 0, 32686
Debugger [baseline] (68.874 ms) : 0, 68874
Debugger [candidate] (67.226 ms) : 0, 67226
Remote Config [baseline] (542.968 µs) : 0, 543
Remote Config [candidate] (542.351 µs) : 0, 542
Telemetry [baseline] (8.613 ms) : 0, 8613
Telemetry [candidate] (8.568 ms) : 0, 8568
Flare Poller [baseline] (3.436 ms) : 0, 3436
Flare Poller [candidate] (3.411 ms) : 0, 3411
IAST [baseline] (27.219 ms) : 0, 27219
IAST [candidate] (27.209 ms) : 0, 27209
section profiling
crashtracking [baseline] (1.236 ms) : 0, 1236
crashtracking [candidate] (1.223 ms) : 0, 1223
BytebuddyAgent [baseline] (683.113 ms) : 0, 683113
BytebuddyAgent [candidate] (686.676 ms) : 0, 686676
AgentMeter [baseline] (8.617 ms) : 0, 8617
AgentMeter [candidate] (8.704 ms) : 0, 8704
GlobalTracer [baseline] (215.815 ms) : 0, 215815
GlobalTracer [candidate] (216.977 ms) : 0, 216977
AppSec [baseline] (32.618 ms) : 0, 32618
AppSec [candidate] (32.844 ms) : 0, 32844
Debugger [baseline] (67.521 ms) : 0, 67521
Debugger [candidate] (67.529 ms) : 0, 67529
Remote Config [baseline] (617.406 µs) : 0, 617
Remote Config [candidate] (634.691 µs) : 0, 635
Telemetry [baseline] (8.854 ms) : 0, 8854
Telemetry [candidate] (8.934 ms) : 0, 8934
Flare Poller [baseline] (3.789 ms) : 0, 3789
Flare Poller [candidate] (3.838 ms) : 0, 3838
ProfilingAgent [baseline] (99.21 ms) : 0, 99210
ProfilingAgent [candidate] (99.545 ms) : 0, 99545
Profiling [baseline] (99.78 ms) : 0, 99780
Profiling [candidate] (100.118 ms) : 0, 100118
LoadParameters
See matching parameters
SummaryFound 2 performance improvements and 3 performance regressions! Performance is the same for 14 metrics, 17 unstable metrics.
Request duration reports for insecure-bankgantt
title insecure-bank - request duration [CI 0.99] : candidate=1.60.0-SNAPSHOT~9b76ed76a1, baseline=1.60.0-SNAPSHOT~36ff528d76
dateFormat X
axisFormat %s
section baseline
no_agent (1.216 ms) : 1204, 1228
. : milestone, 1216,
iast (3.154 ms) : 3118, 3190
. : milestone, 3154,
iast_FULL (5.794 ms) : 5736, 5852
. : milestone, 5794,
iast_GLOBAL (3.471 ms) : 3419, 3522
. : milestone, 3471,
profiling (2.329 ms) : 2307, 2350
. : milestone, 2329,
tracing (1.854 ms) : 1837, 1871
. : milestone, 1854,
section candidate
no_agent (1.182 ms) : 1171, 1193
. : milestone, 1182,
iast (2.993 ms) : 2952, 3033
. : milestone, 2993,
iast_FULL (5.67 ms) : 5614, 5726
. : milestone, 5670,
iast_GLOBAL (3.458 ms) : 3410, 3506
. : milestone, 3458,
profiling (2.361 ms) : 2336, 2386
. : milestone, 2361,
tracing (1.787 ms) : 1771, 1803
. : milestone, 1787,
Request duration reports for petclinicgantt
title petclinic - request duration [CI 0.99] : candidate=1.60.0-SNAPSHOT~9b76ed76a1, baseline=1.60.0-SNAPSHOT~36ff528d76
dateFormat X
axisFormat %s
section baseline
no_agent (17.92 ms) : 17741, 18099
. : milestone, 17920,
appsec (18.778 ms) : 18586, 18970
. : milestone, 18778,
code_origins (17.521 ms) : 17349, 17693
. : milestone, 17521,
iast (17.682 ms) : 17508, 17855
. : milestone, 17682,
profiling (18.6 ms) : 18415, 18785
. : milestone, 18600,
tracing (17.829 ms) : 17651, 18006
. : milestone, 17829,
section candidate
no_agent (18.2 ms) : 18013, 18388
. : milestone, 18200,
appsec (20.054 ms) : 19847, 20260
. : milestone, 20054,
code_origins (17.506 ms) : 17334, 17679
. : milestone, 17506,
iast (17.584 ms) : 17409, 17759
. : milestone, 17584,
profiling (18.533 ms) : 18348, 18718
. : milestone, 18533,
tracing (18.711 ms) : 18522, 18900
. : milestone, 18711,
DacapoParameters
See matching parameters
SummaryFound 0 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 1 unstable metrics. Execution time for biojavagantt
title biojava - execution time [CI 0.99] : candidate=1.60.0-SNAPSHOT~9b76ed76a1, baseline=1.60.0-SNAPSHOT~36ff528d76
dateFormat X
axisFormat %s
section baseline
no_agent (14.779 s) : 14779000, 14779000
. : milestone, 14779000,
appsec (14.989 s) : 14989000, 14989000
. : milestone, 14989000,
iast (18.473 s) : 18473000, 18473000
. : milestone, 18473000,
iast_GLOBAL (18.124 s) : 18124000, 18124000
. : milestone, 18124000,
profiling (15.283 s) : 15283000, 15283000
. : milestone, 15283000,
tracing (14.954 s) : 14954000, 14954000
. : milestone, 14954000,
section candidate
no_agent (15.084 s) : 15084000, 15084000
. : milestone, 15084000,
appsec (14.86 s) : 14860000, 14860000
. : milestone, 14860000,
iast (18.048 s) : 18048000, 18048000
. : milestone, 18048000,
iast_GLOBAL (17.93 s) : 17930000, 17930000
. : milestone, 17930000,
profiling (14.679 s) : 14679000, 14679000
. : milestone, 14679000,
tracing (14.787 s) : 14787000, 14787000
. : milestone, 14787000,
Execution time for tomcatgantt
title tomcat - execution time [CI 0.99] : candidate=1.60.0-SNAPSHOT~9b76ed76a1, baseline=1.60.0-SNAPSHOT~36ff528d76
dateFormat X
axisFormat %s
section baseline
no_agent (1.482 ms) : 1470, 1493
. : milestone, 1482,
appsec (3.807 ms) : 3585, 4028
. : milestone, 3807,
iast (2.266 ms) : 2197, 2334
. : milestone, 2266,
iast_GLOBAL (2.304 ms) : 2235, 2373
. : milestone, 2304,
profiling (2.098 ms) : 2042, 2154
. : milestone, 2098,
tracing (2.068 ms) : 2014, 2121
. : milestone, 2068,
section candidate
no_agent (1.484 ms) : 1472, 1495
. : milestone, 1484,
appsec (3.829 ms) : 3605, 4052
. : milestone, 3829,
iast (2.267 ms) : 2198, 2336
. : milestone, 2267,
iast_GLOBAL (2.303 ms) : 2234, 2372
. : milestone, 2303,
profiling (2.118 ms) : 2062, 2174
. : milestone, 2118,
tracing (2.083 ms) : 2029, 2136
. : milestone, 2083,
|
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Additional Notes
Also add tests to exercise both the observable and plain metrics API.
Contributor Checklist
type:and (comp:orinst:) labels in addition to any other useful labelsclose,fix, or any linking keywords when referencing an issueUse
solvesinstead, and assign the PR milestone to the issueJira ticket: [PROJ-IDENT]
Note: Once your PR is ready to merge, add it to the merge queue by commenting
/merge./merge -ccancels the queue request./merge -f --reason "reason"skips all merge queue checks; please use this judiciously, as some checks do not run at the PR-level. For more information, see this doc.