-
-
Notifications
You must be signed in to change notification settings - Fork 9
Benchmark framing the bundled KrakenD schema #2207
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Conversation
Signed-off-by: Juan Cruz Viotti <jv@jviotti.com>
🤖 Augment PR SummarySummary: Adds a new benchmark for framing the bundled KrakenD schema using Changes: Loads 🤖 Was this summary useful? React with 👍 or 👎 |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Review completed. No suggestions at this time.
Comment augment review to trigger a new review at any time.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Benchmark (linux/llvm)
Details
| Benchmark suite | Current: 0aa4ac3 | Previous: 6db6600 | Ratio |
|---|---|---|---|
Regex_Lower_S_Or_Upper_S_Asterisk |
3.112012746252755 ns/iter |
3.1075224148178306 ns/iter |
1.00 |
Regex_Caret_Lower_S_Or_Upper_S_Asterisk_Dollar |
3.107823579009217 ns/iter |
3.1082685707637885 ns/iter |
1.00 |
Regex_Period_Asterisk |
3.1077953781996555 ns/iter |
3.107441724895895 ns/iter |
1.00 |
Regex_Group_Period_Asterisk_Group |
3.109477041643031 ns/iter |
3.1066548795626683 ns/iter |
1.00 |
Regex_Period_Plus |
3.1100822750991077 ns/iter |
3.108063760131278 ns/iter |
1.00 |
Regex_Period |
3.108246244258069 ns/iter |
3.112318041386355 ns/iter |
1.00 |
Regex_Caret_Period_Plus_Dollar |
3.1094314179561486 ns/iter |
3.1175095606129752 ns/iter |
1.00 |
Regex_Caret_Group_Period_Plus_Group_Dollar |
3.1094329098601086 ns/iter |
3.1073652342215 ns/iter |
1.00 |
Regex_Caret_Period_Asterisk_Dollar |
3.372661049424293 ns/iter |
3.1071862839349906 ns/iter |
1.09 |
Regex_Caret_Group_Period_Asterisk_Group_Dollar |
3.1082334109745733 ns/iter |
3.1061651167501565 ns/iter |
1.00 |
Regex_Caret_X_Hyphen |
10.258301633941965 ns/iter |
12.433776275314546 ns/iter |
0.83 |
Regex_Period_Md_Dollar |
27.504279429438956 ns/iter |
28.714947918035143 ns/iter |
0.96 |
Regex_Caret_Slash_Period_Asterisk |
6.530578663098478 ns/iter |
6.217250295762543 ns/iter |
1.05 |
Regex_Caret_Period_Range_Dollar |
4.040150784797208 ns/iter |
4.0408436557378655 ns/iter |
1.00 |
Regex_Nested_Backtrack |
48.86319090420954 ns/iter |
50.063328596579325 ns/iter |
0.98 |
JSON_Array_Of_Objects_Unique |
465.5769789959318 ns/iter |
439.81418249757706 ns/iter |
1.06 |
JSON_Parse_1 |
29454.426552965662 ns/iter |
29832.949334480283 ns/iter |
0.99 |
JSON_Parse_Real |
38104.19750996245 ns/iter |
37978.1640277607 ns/iter |
1.00 |
JSON_Parse_Decimal |
129735.28877796975 ns/iter |
131843.83057228327 ns/iter |
0.98 |
JSON_Parse_Schema_ISO_Language |
22501033.354838878 ns/iter |
22214985.161290023 ns/iter |
1.01 |
JSON_Fast_Hash_Helm_Chart_Lock |
55.6414197470096 ns/iter |
62.444761463336455 ns/iter |
0.89 |
JSON_Equality_Helm_Chart_Lock |
164.7943180262858 ns/iter |
166.6520037554533 ns/iter |
0.99 |
JSON_String_Equal/10 |
6.533363752390097 ns/iter |
6.536755085098246 ns/iter |
1.00 |
JSON_String_Equal/100 |
7.15349978895102 ns/iter |
7.162771608275207 ns/iter |
1.00 |
JSON_String_Equal_Small_By_Perfect_Hash/10 |
0.9346279117870663 ns/iter |
0.9347105326587264 ns/iter |
1.00 |
JSON_String_Equal_Small_By_Runtime_Perfect_Hash/10 |
10.26222012771141 ns/iter |
14.783906750417065 ns/iter |
0.69 |
JSON_String_Fast_Hash/10 |
2.488924319453025 ns/iter |
2.4854650985222633 ns/iter |
1.00 |
JSON_String_Fast_Hash/100 |
2.489372480778239 ns/iter |
2.494080531172734 ns/iter |
1.00 |
JSON_String_Key_Hash/10 |
2.1791750002645136 ns/iter |
2.7118703545137053 ns/iter |
0.80 |
JSON_String_Key_Hash/100 |
6.529203625231483 ns/iter |
9.011738609973978 ns/iter |
0.72 |
JSON_Object_Defines_Miss_Same_Length |
3.7343603041964544 ns/iter |
3.733141607460632 ns/iter |
1.00 |
JSON_Object_Defines_Miss_Too_Small |
3.7346098361135986 ns/iter |
3.7339791156894373 ns/iter |
1.00 |
JSON_Object_Defines_Miss_Too_Large |
3.736212915583425 ns/iter |
3.7314640789755034 ns/iter |
1.00 |
Pointer_Object_Traverse |
44.14268496838212 ns/iter |
44.36800102230992 ns/iter |
0.99 |
Pointer_Object_Try_Traverse |
52.74636716748428 ns/iter |
53.227797753590494 ns/iter |
0.99 |
Pointer_Push_Back_Pointer_To_Weak_Pointer |
358.27768245965996 ns/iter |
319.9797437845392 ns/iter |
1.12 |
Pointer_Walker_Schema_ISO_Language |
3151632.84375026 ns/iter |
3131303.986547189 ns/iter |
1.01 |
Schema_Frame_WoT_References |
6023357.709401764 ns/iter |
5941715.342104496 ns/iter |
1.01 |
Schema_Frame_OMC_References |
29747612.958331615 ns/iter |
28741769.54166785 ns/iter |
1.03 |
Schema_Frame_OMC_Locations |
27236061.807688937 ns/iter |
27050868.76923045 ns/iter |
1.01 |
Schema_Frame_ISO_Language_Locations |
132380629.99998875 ns/iter |
128515554.79999205 ns/iter |
1.03 |
Schema_Frame_KrakenD_References |
53924946.69230858 ns/iter |
||
Schema_Iterator_ISO_Language |
2382435.117056808 ns/iter |
2383939.4377103844 ns/iter |
1.00 |
Schema_Frame_ISO_Language_Locations_To_JSON |
132165783.25000228 ns/iter |
136716458.99998453 ns/iter |
0.97 |
Schema_Tracker_ISO_Language |
45769452.5333333 ns/iter |
47075984.66666241 ns/iter |
0.97 |
Schema_Tracker_ISO_Language_To_JSON |
22876452.16129095 ns/iter |
24101755.55172404 ns/iter |
0.95 |
Schema_Format_ISO_Language_To_JSON |
137510980.60001823 ns/iter |
136075570.00002545 ns/iter |
1.01 |
Schema_Bundle_Meta_2020_12 |
2208792.97476468 ns/iter |
2193392.3228833685 ns/iter |
1.01 |
Schema_Frame_Many_Resources_References |
267550073.49999005 ns/iter |
267843268.6666762 ns/iter |
1.00 |
Alterschema_Check_Readibility_ISO_Language_Set_3 |
248813248.99998465 ns/iter |
239022537.33331236 ns/iter |
1.04 |
Alterschema_Check_Readibility_OMC |
34179938.59999911 ns/iter |
33134268.42857141 ns/iter |
1.03 |
Alterschema_Apply_Readibility_KrakenD |
10806845768.000017 ns/iter |
10905372575.99999 ns/iter |
0.99 |
EditorSchema_ForEditor_EmbeddedResources |
14487539.375004133 ns/iter |
14618432.250003366 ns/iter |
0.99 |
URITemplateRouter_Create |
16002.991119823746 ns/iter |
16442.16896438994 ns/iter |
0.97 |
URITemplateRouter_Match |
171.25750197083676 ns/iter |
169.4958939857486 ns/iter |
1.01 |
URITemplateRouterView_Restore |
8281.369618320476 ns/iter |
8289.787566600231 ns/iter |
1.00 |
URITemplateRouterView_Match |
121.31665747701611 ns/iter |
119.4193085426879 ns/iter |
1.02 |
This comment was automatically generated by workflow using github-action-benchmark.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Benchmark (macos/llvm)
Details
| Benchmark suite | Current: 0aa4ac3 | Previous: 6db6600 | Ratio |
|---|---|---|---|
Regex_Lower_S_Or_Upper_S_Asterisk |
1.7272730337708877 ns/iter |
2.2341602084841945 ns/iter |
0.77 |
Regex_Caret_Lower_S_Or_Upper_S_Asterisk_Dollar |
1.7923456269909799 ns/iter |
1.972709488927327 ns/iter |
0.91 |
Regex_Period_Asterisk |
1.776595091214974 ns/iter |
2.4200002582486024 ns/iter |
0.73 |
Regex_Group_Period_Asterisk_Group |
1.825792789134483 ns/iter |
2.727312533021872 ns/iter |
0.67 |
Regex_Period_Plus |
2.195107641189031 ns/iter |
2.7885741492929377 ns/iter |
0.79 |
Regex_Period |
2.1555954645631816 ns/iter |
2.668899657803774 ns/iter |
0.81 |
Regex_Caret_Period_Plus_Dollar |
2.834669534176093 ns/iter |
2.8080191777102916 ns/iter |
1.01 |
Regex_Caret_Group_Period_Plus_Group_Dollar |
2.8151477220584913 ns/iter |
2.648709267116381 ns/iter |
1.06 |
Regex_Caret_Period_Asterisk_Dollar |
2.2777463229470603 ns/iter |
2.3365963444872286 ns/iter |
0.97 |
Regex_Caret_Group_Period_Asterisk_Group_Dollar |
2.387374435913202 ns/iter |
2.2401161603137596 ns/iter |
1.07 |
Regex_Caret_X_Hyphen |
8.756559880774793 ns/iter |
8.393546131872908 ns/iter |
1.04 |
Regex_Period_Md_Dollar |
30.133961800287473 ns/iter |
27.50420295012774 ns/iter |
1.10 |
Regex_Caret_Slash_Period_Asterisk |
7.306888594854205 ns/iter |
6.776302738803366 ns/iter |
1.08 |
Regex_Caret_Period_Range_Dollar |
2.570234354891122 ns/iter |
2.3482463819964607 ns/iter |
1.09 |
Regex_Nested_Backtrack |
44.79718563642126 ns/iter |
31.436876549300568 ns/iter |
1.42 |
JSON_Array_Of_Objects_Unique |
547.0856892914233 ns/iter |
425.2456423914565 ns/iter |
1.29 |
JSON_Parse_1 |
37775.736601198165 ns/iter |
24241.95541967625 ns/iter |
1.56 |
JSON_Parse_Real |
38451.131154460345 ns/iter |
26563.218120175672 ns/iter |
1.45 |
JSON_Parse_Decimal |
394074.1161616211 ns/iter |
276330.0119760472 ns/iter |
1.43 |
JSON_Parse_Schema_ISO_Language |
28822648.14814806 ns/iter |
18957888.525000043 ns/iter |
1.52 |
JSON_Fast_Hash_Helm_Chart_Lock |
106.93081851314274 ns/iter |
66.48658042547571 ns/iter |
1.61 |
JSON_Equality_Helm_Chart_Lock |
217.0110386219895 ns/iter |
191.09658641337074 ns/iter |
1.14 |
JSON_String_Equal/10 |
10.122886909791408 ns/iter |
9.883102663979745 ns/iter |
1.02 |
JSON_String_Equal/100 |
9.57872376690948 ns/iter |
10.203403761130586 ns/iter |
0.94 |
JSON_String_Equal_Small_By_Perfect_Hash/10 |
0.4531264328983395 ns/iter |
0.4403831594455364 ns/iter |
1.03 |
JSON_String_Equal_Small_By_Runtime_Perfect_Hash/10 |
5.469036849012609 ns/iter |
4.578718815109914 ns/iter |
1.19 |
JSON_String_Fast_Hash/10 |
3.59120172751863 ns/iter |
3.037570831263561 ns/iter |
1.18 |
JSON_String_Fast_Hash/100 |
3.218621140382221 ns/iter |
2.6953277587125704 ns/iter |
1.19 |
JSON_String_Key_Hash/10 |
2.4930561736687737 ns/iter |
1.959151084289111 ns/iter |
1.27 |
JSON_String_Key_Hash/100 |
4.742296754033229 ns/iter |
3.0406530679032127 ns/iter |
1.56 |
JSON_Object_Defines_Miss_Same_Length |
5.958332258274692 ns/iter |
3.962989396659095 ns/iter |
1.50 |
JSON_Object_Defines_Miss_Too_Small |
4.712605060573535 ns/iter |
3.6560747267067986 ns/iter |
1.29 |
JSON_Object_Defines_Miss_Too_Large |
4.791211276587914 ns/iter |
3.962523483250848 ns/iter |
1.21 |
Pointer_Object_Traverse |
26.2298620883597 ns/iter |
23.719276307248162 ns/iter |
1.11 |
Pointer_Object_Try_Traverse |
38.96117127292089 ns/iter |
34.231657545857246 ns/iter |
1.14 |
Pointer_Push_Back_Pointer_To_Weak_Pointer |
245.04793649932964 ns/iter |
238.78400469649537 ns/iter |
1.03 |
Pointer_Walker_Schema_ISO_Language |
9416331.144734614 ns/iter |
6662880.70526542 ns/iter |
1.41 |
Schema_Frame_WoT_References |
10002766.891891558 ns/iter |
8207081.4137923345 ns/iter |
1.22 |
Schema_Frame_OMC_References |
54488104.19998153 ns/iter |
51973935.846158035 ns/iter |
1.05 |
Schema_Frame_OMC_Locations |
56127154.71428536 ns/iter |
51491512.76922427 ns/iter |
1.09 |
Schema_Frame_ISO_Language_Locations |
153663218.75001177 ns/iter |
159958000.00001737 ns/iter |
0.96 |
Schema_Frame_KrakenD_References |
87822520.74999519 ns/iter |
||
Schema_Iterator_ISO_Language |
3382606.3668346885 ns/iter |
3479313.175116009 ns/iter |
0.97 |
Schema_Frame_ISO_Language_Locations_To_JSON |
171519322.99998406 ns/iter |
167898801.99996787 ns/iter |
1.02 |
Schema_Tracker_ISO_Language |
65542708.33334562 ns/iter |
69917439.0769293 ns/iter |
0.94 |
Schema_Tracker_ISO_Language_To_JSON |
20502981.61765006 ns/iter |
23618711.13333412 ns/iter |
0.87 |
Schema_Format_ISO_Language_To_JSON |
138834408.5999961 ns/iter |
170248374.99997148 ns/iter |
0.82 |
Schema_Bundle_Meta_2020_12 |
3072934.2401697766 ns/iter |
2724864.4204576067 ns/iter |
1.13 |
Schema_Frame_Many_Resources_References |
355401583.49999726 ns/iter |
367267145.99990374 ns/iter |
0.97 |
Alterschema_Check_Readibility_ISO_Language_Set_3 |
240616249.9999785 ns/iter |
291071958.3333806 ns/iter |
0.83 |
Alterschema_Check_Readibility_OMC |
48547666.62499799 ns/iter |
58602920.45454943 ns/iter |
0.83 |
Alterschema_Apply_Readibility_KrakenD |
15944626790.999792 ns/iter |
15681026499.000154 ns/iter |
1.02 |
EditorSchema_ForEditor_EmbeddedResources |
13460187.111119617 ns/iter |
18734374.071414094 ns/iter |
0.72 |
URITemplateRouter_Create |
20207.701828452493 ns/iter |
21786.722167746302 ns/iter |
0.93 |
URITemplateRouter_Match |
188.71577522436363 ns/iter |
221.6376988320077 ns/iter |
0.85 |
URITemplateRouterView_Restore |
11656.69284850875 ns/iter |
13445.081444256346 ns/iter |
0.87 |
URITemplateRouterView_Match |
135.26996880975256 ns/iter |
138.16920530692286 ns/iter |
0.98 |
This comment was automatically generated by workflow using github-action-benchmark.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Benchmark (linux/gcc)
Details
| Benchmark suite | Current: 0aa4ac3 | Previous: 6db6600 | Ratio |
|---|---|---|---|
URITemplateRouter_Create |
15664.88736441012 ns/iter |
14707.15286919019 ns/iter |
1.07 |
URITemplateRouter_Match |
160.3421711102661 ns/iter |
153.45734029421988 ns/iter |
1.04 |
URITemplateRouterView_Restore |
8135.643677355212 ns/iter |
8164.57563993037 ns/iter |
1.00 |
URITemplateRouterView_Match |
143.09443743767682 ns/iter |
113.66300028776722 ns/iter |
1.26 |
EditorSchema_ForEditor_EmbeddedResources |
15622672.511133512 ns/iter |
15592350.599990824 ns/iter |
1.00 |
Alterschema_Check_Readibility_ISO_Language_Set_3 |
235407471.33332238 ns/iter |
232786463.66664663 ns/iter |
1.01 |
Alterschema_Check_Readibility_OMC |
35633096.05000313 ns/iter |
35117527.14999829 ns/iter |
1.01 |
Alterschema_Apply_Readibility_KrakenD |
11155040924.000105 ns/iter |
10985319811.999943 ns/iter |
1.02 |
Schema_Frame_WoT_References |
6513589.52777796 ns/iter |
6491422.401869581 ns/iter |
1.00 |
Schema_Frame_OMC_References |
30060918.91304253 ns/iter |
29787256.000001132 ns/iter |
1.01 |
Schema_Frame_OMC_Locations |
28407919.040000707 ns/iter |
28211299.87999484 ns/iter |
1.01 |
Schema_Frame_ISO_Language_Locations |
129150889.59998684 ns/iter |
127993938.83331807 ns/iter |
1.01 |
Schema_Frame_KrakenD_References |
53976606.84614563 ns/iter |
||
Schema_Iterator_ISO_Language |
2603045.332089333 ns/iter |
2653899.482758224 ns/iter |
0.98 |
Schema_Frame_ISO_Language_Locations_To_JSON |
298132720.66667193 ns/iter |
292459439.6667241 ns/iter |
1.02 |
Schema_Tracker_ISO_Language |
47743531.60000828 ns/iter |
46499610.800007455 ns/iter |
1.03 |
Schema_Tracker_ISO_Language_To_JSON |
32282586.857144497 ns/iter |
30934570.478265136 ns/iter |
1.04 |
Schema_Format_ISO_Language_To_JSON |
137091767.0000381 ns/iter |
133042282.79994278 ns/iter |
1.03 |
Schema_Bundle_Meta_2020_12 |
2437517.850171468 ns/iter |
2408619.1065313006 ns/iter |
1.01 |
Schema_Frame_Many_Resources_References |
278993044.9999929 ns/iter |
274471573.000028 ns/iter |
1.02 |
Pointer_Object_Traverse |
48.780436694112595 ns/iter |
48.957897289063226 ns/iter |
1.00 |
Pointer_Object_Try_Traverse |
24.45628146484298 ns/iter |
25.24884598433682 ns/iter |
0.97 |
Pointer_Push_Back_Pointer_To_Weak_Pointer |
175.70008908199648 ns/iter |
167.02768748896838 ns/iter |
1.05 |
Pointer_Walker_Schema_ISO_Language |
3541521.532664244 ns/iter |
3429314.741463425 ns/iter |
1.03 |
JSON_Array_Of_Objects_Unique |
418.38860986295276 ns/iter |
433.3328080490224 ns/iter |
0.97 |
JSON_Parse_1 |
33274.09408908932 ns/iter |
33250.95333746357 ns/iter |
1.00 |
JSON_Parse_Real |
43169.37307169651 ns/iter |
43583.68485981234 ns/iter |
0.99 |
JSON_Parse_Decimal |
155405.0609973384 ns/iter |
155660.8545535826 ns/iter |
1.00 |
JSON_Parse_Schema_ISO_Language |
22626267.32258175 ns/iter |
22567494.548389554 ns/iter |
1.00 |
JSON_Fast_Hash_Helm_Chart_Lock |
63.285999927449794 ns/iter |
69.08778901769561 ns/iter |
0.92 |
JSON_Equality_Helm_Chart_Lock |
168.0173077332975 ns/iter |
167.86452227235762 ns/iter |
1.00 |
JSON_String_Equal/10 |
6.88565635919844 ns/iter |
6.8874939720673565 ns/iter |
1.00 |
JSON_String_Equal/100 |
7.510266571494983 ns/iter |
7.515016455719427 ns/iter |
1.00 |
JSON_String_Equal_Small_By_Perfect_Hash/10 |
0.9353826324242742 ns/iter |
0.9334182328620492 ns/iter |
1.00 |
JSON_String_Equal_Small_By_Runtime_Perfect_Hash/10 |
14.916904119051123 ns/iter |
15.109762862953001 ns/iter |
0.99 |
JSON_String_Fast_Hash/10 |
1.9432033749955806 ns/iter |
1.9437594100748241 ns/iter |
1.00 |
JSON_String_Fast_Hash/100 |
1.9444845321054038 ns/iter |
1.9440549929018307 ns/iter |
1.00 |
JSON_String_Key_Hash/10 |
1.2454761617994108 ns/iter |
1.2494985146409139 ns/iter |
1.00 |
JSON_String_Key_Hash/100 |
12.433493710431238 ns/iter |
12.425107301932487 ns/iter |
1.00 |
JSON_Object_Defines_Miss_Same_Length |
2.7995808467166694 ns/iter |
2.7989056317889096 ns/iter |
1.00 |
JSON_Object_Defines_Miss_Too_Small |
2.7986056408510978 ns/iter |
2.806003225178046 ns/iter |
1.00 |
JSON_Object_Defines_Miss_Too_Large |
2.797681437587597 ns/iter |
2.7982167915899585 ns/iter |
1.00 |
Regex_Lower_S_Or_Upper_S_Asterisk |
3.1095168128844826 ns/iter |
3.110628345380766 ns/iter |
1.00 |
Regex_Caret_Lower_S_Or_Upper_S_Asterisk_Dollar |
3.112140639800904 ns/iter |
3.119012935189537 ns/iter |
1.00 |
Regex_Period_Asterisk |
3.1099999936143505 ns/iter |
3.1091029233859326 ns/iter |
1.00 |
Regex_Group_Period_Asterisk_Group |
3.1264186785835597 ns/iter |
3.1117154896993218 ns/iter |
1.00 |
Regex_Period_Plus |
2.8004909753068206 ns/iter |
2.7980032181121217 ns/iter |
1.00 |
Regex_Period |
2.7989561368300104 ns/iter |
2.8474172373289113 ns/iter |
0.98 |
Regex_Caret_Period_Plus_Dollar |
2.800675473237344 ns/iter |
2.797040484458302 ns/iter |
1.00 |
Regex_Caret_Group_Period_Plus_Group_Dollar |
2.798069762592057 ns/iter |
2.798688457054511 ns/iter |
1.00 |
Regex_Caret_Period_Asterisk_Dollar |
4.042251058387837 ns/iter |
3.109061609897863 ns/iter |
1.30 |
Regex_Caret_Group_Period_Asterisk_Group_Dollar |
3.7018679803675125 ns/iter |
3.1085595297105235 ns/iter |
1.19 |
Regex_Caret_X_Hyphen |
13.06233729202591 ns/iter |
13.67794205856124 ns/iter |
0.95 |
Regex_Period_Md_Dollar |
35.842256295460714 ns/iter |
48.540795218800895 ns/iter |
0.74 |
Regex_Caret_Slash_Period_Asterisk |
8.39353730095282 ns/iter |
8.39222726978885 ns/iter |
1.00 |
Regex_Caret_Period_Range_Dollar |
4.043482763585662 ns/iter |
4.045167966525501 ns/iter |
1.00 |
Regex_Nested_Backtrack |
58.0920657439837 ns/iter |
62.957294249152994 ns/iter |
0.92 |
This comment was automatically generated by workflow using github-action-benchmark.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Benchmark (windows/msvc)
Details
| Benchmark suite | Current: 0aa4ac3 | Previous: 6db6600 | Ratio |
|---|---|---|---|
Regex_Lower_S_Or_Upper_S_Asterisk |
3.865083252889195 ns/iter |
4.197166270446894 ns/iter |
0.92 |
Regex_Caret_Lower_S_Or_Upper_S_Asterisk_Dollar |
3.7943716517853585 ns/iter |
4.364258301622701 ns/iter |
0.87 |
Regex_Period_Asterisk |
4.116177819850777 ns/iter |
4.867699576981943 ns/iter |
0.85 |
Regex_Group_Period_Asterisk_Group |
3.8040524553561994 ns/iter |
4.451472499999909 ns/iter |
0.85 |
Regex_Period_Plus |
4.1054518508459115 ns/iter |
5.159045535711877 ns/iter |
0.80 |
Regex_Period |
4.108825275194682 ns/iter |
5.03740199999811 ns/iter |
0.82 |
Regex_Caret_Period_Plus_Dollar |
3.7847148437502347 ns/iter |
4.884967644833293 ns/iter |
0.77 |
Regex_Caret_Group_Period_Plus_Group_Dollar |
3.7960468749988405 ns/iter |
4.4053031250001595 ns/iter |
0.86 |
Regex_Caret_Period_Asterisk_Dollar |
3.7921210646569192 ns/iter |
4.459724375001883 ns/iter |
0.85 |
Regex_Caret_Group_Period_Asterisk_Group_Dollar |
3.793934151785956 ns/iter |
4.108028580597788 ns/iter |
0.92 |
Regex_Caret_X_Hyphen |
7.763445535713589 ns/iter |
7.547370535715255 ns/iter |
1.03 |
Regex_Period_Md_Dollar |
35.60116670716528 ns/iter |
34.72338213354466 ns/iter |
1.03 |
Regex_Caret_Slash_Period_Asterisk |
7.268688616071423 ns/iter |
7.223541294644673 ns/iter |
1.01 |
Regex_Caret_Period_Range_Dollar |
4.13323335559442 ns/iter |
4.102510176740177 ns/iter |
1.01 |
Regex_Nested_Backtrack |
96.16000000001179 ns/iter |
98.6981093749506 ns/iter |
0.97 |
JSON_Array_Of_Objects_Unique |
467.78689013096755 ns/iter |
523.8319000000047 ns/iter |
0.89 |
JSON_Parse_1 |
74212.29464284806 ns/iter |
77860.30133927519 ns/iter |
0.95 |
JSON_Parse_Real |
95986.51562498616 ns/iter |
99091.05357142574 ns/iter |
0.97 |
JSON_Parse_Decimal |
344091.6011787389 ns/iter |
347553.3880902574 ns/iter |
0.99 |
JSON_Parse_Schema_ISO_Language |
59305772.72726044 ns/iter |
58889727.27271638 ns/iter |
1.01 |
JSON_Fast_Hash_Helm_Chart_Lock |
53.57622000001356 ns/iter |
74.02843865942222 ns/iter |
0.72 |
JSON_Equality_Helm_Chart_Lock |
264.8336390550825 ns/iter |
312.6808482142402 ns/iter |
0.85 |
JSON_String_Equal/10 |
12.881539285712863 ns/iter |
13.893074937973903 ns/iter |
0.93 |
JSON_String_Equal/100 |
14.355423819842505 ns/iter |
14.380584821428297 ns/iter |
1.00 |
JSON_String_Equal_Small_By_Perfect_Hash/10 |
1.8978064302659328 ns/iter |
2.2416381671402243 ns/iter |
0.85 |
JSON_String_Equal_Small_By_Runtime_Perfect_Hash/10 |
12.920183928571305 ns/iter |
12.668339285718437 ns/iter |
1.02 |
JSON_String_Fast_Hash/10 |
3.160817857143172 ns/iter |
4.027360980342767 ns/iter |
0.78 |
JSON_String_Fast_Hash/100 |
3.1678535714283793 ns/iter |
3.9940468821317934 ns/iter |
0.79 |
JSON_String_Key_Hash/10 |
3.7847103794635166 ns/iter |
3.9815267857130316 ns/iter |
0.95 |
JSON_String_Key_Hash/100 |
13.849005072101082 ns/iter |
16.710723548814997 ns/iter |
0.83 |
JSON_Object_Defines_Miss_Same_Length |
3.8336188616077442 ns/iter |
5.30543200000011 ns/iter |
0.72 |
JSON_Object_Defines_Miss_Too_Small |
4.75432607249059 ns/iter |
4.023932953614286 ns/iter |
1.18 |
JSON_Object_Defines_Miss_Too_Large |
3.813273186005989 ns/iter |
4.867934844836971 ns/iter |
0.78 |
Pointer_Object_Traverse |
49.01187832616277 ns/iter |
52.792035714292396 ns/iter |
0.93 |
Pointer_Object_Try_Traverse |
67.16220535713953 ns/iter |
77.30455357141912 ns/iter |
0.87 |
Pointer_Push_Back_Pointer_To_Weak_Pointer |
161.15752232142964 ns/iter |
171.137422174412 ns/iter |
0.94 |
Pointer_Walker_Schema_ISO_Language |
10139354.687503044 ns/iter |
13097157.142859876 ns/iter |
0.77 |
Schema_Frame_WoT_References |
11508656.250001082 ns/iter |
12736614.285716185 ns/iter |
0.90 |
Schema_Frame_OMC_References |
58508354.545438126 ns/iter |
62025599.99999059 ns/iter |
0.94 |
Schema_Frame_OMC_Locations |
54718739.999998435 ns/iter |
56578700.000004165 ns/iter |
0.97 |
Schema_Frame_ISO_Language_Locations |
257182766.66664982 ns/iter |
268759299.9999045 ns/iter |
0.96 |
Schema_Frame_KrakenD_References |
118067999.99999385 ns/iter |
||
Schema_Iterator_ISO_Language |
4209632.530120531 ns/iter |
4589074.675325943 ns/iter |
0.92 |
Schema_Frame_ISO_Language_Locations_To_JSON |
264795066.66661716 ns/iter |
263626033.33336663 ns/iter |
1.00 |
Schema_Tracker_ISO_Language |
101882916.66664402 ns/iter |
103600099.9999942 ns/iter |
0.98 |
Schema_Tracker_ISO_Language_To_JSON |
55937919.99999666 ns/iter |
62910820.00002462 ns/iter |
0.89 |
Schema_Format_ISO_Language_To_JSON |
254659566.66660833 ns/iter |
279134533.3333387 ns/iter |
0.91 |
Schema_Bundle_Meta_2020_12 |
4263696.385531871 ns/iter |
4305384.337349864 ns/iter |
0.99 |
Schema_Frame_Many_Resources_References |
538283000.0000923 ns/iter |
556253199.9999009 ns/iter |
0.97 |
Alterschema_Check_Readibility_ISO_Language_Set_3 |
386682700.0000512 ns/iter |
411315150.000064 ns/iter |
0.94 |
Alterschema_Check_Readibility_OMC |
67559481.81818315 ns/iter |
71730644.4444148 ns/iter |
0.94 |
Alterschema_Apply_Readibility_KrakenD |
22815605600.00025 ns/iter |
24187593199.99981 ns/iter |
0.94 |
EditorSchema_ForEditor_EmbeddedResources |
28121240.909110222 ns/iter |
28832030.76923844 ns/iter |
0.98 |
URITemplateRouter_Create |
22746.887869560356 ns/iter |
22515.299999994906 ns/iter |
1.01 |
URITemplateRouter_Match |
215.1694999999876 ns/iter |
212.57979184910664 ns/iter |
1.01 |
URITemplateRouterView_Restore |
32241.426045962446 ns/iter |
33701.326583240385 ns/iter |
0.96 |
URITemplateRouterView_Match |
150.4480513192719 ns/iter |
148.84633264073298 ns/iter |
1.01 |
This comment was automatically generated by workflow using github-action-benchmark.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Benchmark (macos/gcc)
Details
| Benchmark suite | Current: 0aa4ac3 | Previous: 421f999 | Ratio |
|---|---|---|---|
Regex_Lower_S_Or_Upper_S_Asterisk |
3.0767060960626362 ns/iter |
2.538362235765262 ns/iter |
1.21 |
Regex_Caret_Lower_S_Or_Upper_S_Asterisk_Dollar |
3.0955999222170396 ns/iter |
2.3946393064418747 ns/iter |
1.29 |
Regex_Period_Asterisk |
3.1574634271912654 ns/iter |
2.6373503701602763 ns/iter |
1.20 |
Regex_Group_Period_Asterisk_Group |
3.420097848117406 ns/iter |
2.2355415855381873 ns/iter |
1.53 |
Regex_Period_Plus |
2.9847232588151495 ns/iter |
2.638563477600102 ns/iter |
1.13 |
Regex_Period |
3.487536070422035 ns/iter |
2.334657118975744 ns/iter |
1.49 |
Regex_Caret_Period_Plus_Dollar |
3.177455480243036 ns/iter |
2.340092872355974 ns/iter |
1.36 |
Regex_Caret_Group_Period_Plus_Group_Dollar |
2.872714011521941 ns/iter |
2.3260780120922133 ns/iter |
1.24 |
Regex_Caret_Period_Asterisk_Dollar |
2.6973772090061265 ns/iter |
2.2488886886498167 ns/iter |
1.20 |
Regex_Caret_Group_Period_Asterisk_Group_Dollar |
2.736574165440185 ns/iter |
2.34145592817321 ns/iter |
1.17 |
Regex_Caret_X_Hyphen |
9.276481385251001 ns/iter |
6.954024997335592 ns/iter |
1.33 |
Regex_Period_Md_Dollar |
36.13538490306807 ns/iter |
23.261094848264516 ns/iter |
1.55 |
Regex_Caret_Slash_Period_Asterisk |
7.673070134350408 ns/iter |
5.127719672787364 ns/iter |
1.50 |
Regex_Caret_Period_Range_Dollar |
3.579712368170628 ns/iter |
2.338978989968072 ns/iter |
1.53 |
Regex_Nested_Backtrack |
70.79633804052267 ns/iter |
47.69833702241328 ns/iter |
1.48 |
JSON_Array_Of_Objects_Unique |
411.91456323310194 ns/iter |
309.6954863481747 ns/iter |
1.33 |
JSON_Parse_1 |
44893.70737807939 ns/iter |
27733.28243880694 ns/iter |
1.62 |
JSON_Parse_Real |
39355.19060039934 ns/iter |
26856.506406400935 ns/iter |
1.47 |
JSON_Parse_Decimal |
394514.68750911497 ns/iter |
269207.2711115809 ns/iter |
1.47 |
JSON_Parse_Schema_ISO_Language |
27495965.9576416 ns/iter |
20245972.801657286 ns/iter |
1.36 |
JSON_Fast_Hash_Helm_Chart_Lock |
44.35544063152272 ns/iter |
35.875933928451026 ns/iter |
1.24 |
JSON_Equality_Helm_Chart_Lock |
183.66373809196054 ns/iter |
132.2263530967478 ns/iter |
1.39 |
JSON_String_Equal/10 |
8.061459853382637 ns/iter |
6.009171209220074 ns/iter |
1.34 |
JSON_String_Equal/100 |
7.857733629015905 ns/iter |
5.680361160300968 ns/iter |
1.38 |
JSON_String_Equal_Small_By_Perfect_Hash/10 |
1.0532258255593046 ns/iter |
0.8175030413037673 ns/iter |
1.29 |
JSON_String_Equal_Small_By_Runtime_Perfect_Hash/10 |
5.144152641296387 ns/iter |
3.776201617885875 ns/iter |
1.36 |
JSON_String_Fast_Hash/10 |
2.471872873777845 ns/iter |
2.152367828602675 ns/iter |
1.15 |
JSON_String_Fast_Hash/100 |
2.4546836188638967 ns/iter |
2.1764255863029067 ns/iter |
1.13 |
JSON_String_Key_Hash/10 |
2.2520170316094172 ns/iter |
1.6123980532016906 ns/iter |
1.40 |
JSON_String_Key_Hash/100 |
3.8381092712770144 ns/iter |
2.8541286832070902 ns/iter |
1.34 |
JSON_Object_Defines_Miss_Same_Length |
2.8190927479672316 ns/iter |
1.9840349451820272 ns/iter |
1.42 |
JSON_Object_Defines_Miss_Too_Small |
2.885116772163012 ns/iter |
1.959337613670754 ns/iter |
1.47 |
JSON_Object_Defines_Miss_Too_Large |
2.7224655961253212 ns/iter |
1.933320995054789 ns/iter |
1.41 |
Pointer_Object_Traverse |
78.67219543326746 ns/iter |
54.49620030379024 ns/iter |
1.44 |
Pointer_Object_Try_Traverse |
68.1553840637207 ns/iter |
40.94331347776082 ns/iter |
1.66 |
Pointer_Push_Back_Pointer_To_Weak_Pointer |
218.73108289567483 ns/iter |
165.20322169548302 ns/iter |
1.32 |
Pointer_Walker_Schema_ISO_Language |
5980181.694030762 ns/iter |
4237843.884362115 ns/iter |
1.41 |
Schema_Frame_WoT_References |
7817823.592930624 ns/iter |
5382371.671272047 ns/iter |
1.45 |
Schema_Frame_OMC_References |
49426005.43682392 ns/iter |
36011377.9703776 ns/iter |
1.37 |
Schema_Frame_OMC_Locations |
42671456.05648265 ns/iter |
38267737.940738074 ns/iter |
1.12 |
Schema_Frame_ISO_Language_Locations |
167295515.53726196 ns/iter |
135039806.3659668 ns/iter |
1.24 |
Schema_Frame_KrakenD_References |
87033033.37097168 ns/iter |
||
Schema_Iterator_ISO_Language |
3790756.280276938 ns/iter |
2404935.8983193673 ns/iter |
1.58 |
Schema_Frame_ISO_Language_Locations_To_JSON |
260153373.08247885 ns/iter |
206788380.94075522 ns/iter |
1.26 |
Schema_Tracker_ISO_Language |
51241207.122802734 ns/iter |
54850084.441048756 ns/iter |
0.93 |
Schema_Tracker_ISO_Language_To_JSON |
36004926.84737496 ns/iter |
32003684.4773726 ns/iter |
1.13 |
Schema_Format_ISO_Language_To_JSON |
165963828.5636902 ns/iter |
152595579.62417603 ns/iter |
1.09 |
Schema_Bundle_Meta_2020_12 |
2282255.7103020065 ns/iter |
2118266.6034818445 ns/iter |
1.08 |
Schema_Frame_Many_Resources_References |
454509496.6888428 ns/iter |
633919000.6256104 ns/iter |
0.72 |
Alterschema_Check_Readibility_ISO_Language_Set_3 |
256202300.38960776 ns/iter |
237718164.92080688 ns/iter |
1.08 |
Alterschema_Check_Readibility_OMC |
42193308.47263336 ns/iter |
38215994.8348999 ns/iter |
1.10 |
Alterschema_Apply_Readibility_KrakenD |
15368688106.536865 ns/iter |
||
EditorSchema_ForEditor_EmbeddedResources |
17458289.861679077 ns/iter |
12670243.779818216 ns/iter |
1.38 |
URITemplateRouter_Create |
21275.75030761946 ns/iter |
14657.953810934467 ns/iter |
1.45 |
URITemplateRouter_Match |
248.61201203828688 ns/iter |
187.30550185196535 ns/iter |
1.33 |
URITemplateRouterView_Restore |
15593.739808636754 ns/iter |
10376.514858740718 ns/iter |
1.50 |
URITemplateRouterView_Match |
156.4600182433189 ns/iter |
111.30023612586493 ns/iter |
1.41 |
This comment was automatically generated by workflow using github-action-benchmark.
Signed-off-by: Juan Cruz Viotti jv@jviotti.com