fluencelabs/aquavm
1
0
Fork 0
mirror of https://github.com/fluencelabs/aquavm synced 2025-03-15 20:40:50 +00:00
Code Issues Projects Releases Wiki Activity
aquavm/benches/PERFORMANCE.txt
Ivan Boldyrev 93c6899429
feat(aquavm-air-cli,performance_metering): memory size in performance report (#600) 
* chore(bench): update benchmark data

After recent data format changes.

* feat(aquavm-air-cli): send memory size to logger

* feat(performance_metering): report memory size

`performance_metering` collects memory sizes reported by `air run` and
reports minimal and maximal values.
2023-06-08 20:22:11 +07:00

486 lines
24 KiB
Plaintext
Raw Blame History

Machine 05b76e53f793eceba4cb1e947eecaedf581b236317d6c24d5fba40ce9350735f:
Platform: Linux-5.10.136-x86_64-AMD_Ryzen_9_5950X_16-Core_Processor-with-glibc2.36
Timestamp: 2023-02-14 07:53:57.703442+00:00
AquaVM version: 0.35.1
Benches:
big_values_data (7.05ms): Loading a trace with huge values
air::runner::execute_air: 7.05ms
farewell_step::outcome::from_success_result: 2.77ms
populate_outcome_from_contexts: 2.74ms
to_vec(call_results): 9.00µs
to_vec(data): 2.21ms
preparation_step::preparation::prepare: 4.21ms
air::preparation_step::preparation::make_exec_ctx: 12.00µs
air_interpreter_data::interpreter_data::serde_json::from_slice: 4.14ms
air_parser::parser::air_parser::parse: 15.00µs
runner::execute: 6.00µs
dashboard (45.83ms): big dashboard test
air::runner::execute_air: 45.83ms
farewell_step::outcome::from_success_result: 224.00µs
populate_outcome_from_contexts: 200.00µs
to_vec(call_results): 13.00µs
to_vec(data): 102.00µs
preparation_step::preparation::prepare: 448.00µs
air::preparation_step::preparation::make_exec_ctx: 19.00µs
air_interpreter_data::interpreter_data::serde_json::from_slice: 275.00µs
air_parser::parser::air_parser::parse: 95.00µs
runner::execute: 45.09ms
execute: 40.68ms
execute: 4.10ms
instructions::call::resolved_call::prepare_request_params: 337.00µs
instructions::call::resolved_call::serde_json::to_string(tetraplets): 14.00µs
resolver::resolve::resolve_ast_variable: 216.00µs
resolve_variable: 70.00µs
resolver::resolve::resolve_ast_variable: 572.00µs
resolve_variable: 184.00µs
new: 26.91ms
resolve_ast_scalar: 20.17ms
resolve_ast_variable: 12.53ms
resolve_variable: 4.08ms
long_data (2.05ms): Long data trace
air::runner::execute_air: 2.05ms
farewell_step::outcome::from_success_result: 597.00µs
populate_outcome_from_contexts: 573.00µs
to_vec(call_results): 9.00µs
to_vec(data): 300.00µs
preparation_step::preparation::prepare: 1.39ms
air::preparation_step::preparation::make_exec_ctx: 22.00µs
air_interpreter_data::interpreter_data::serde_json::from_slice: 1.30ms
air_parser::parser::air_parser::parse: 14.00µs
runner::execute: 6.00µs
network_explore (3.52ms): 5 peers of network are discovered
air::runner::execute_air: 3.52ms
farewell_step::outcome::from_success_result: 100.00µs
populate_outcome_from_contexts: 79.00µs
to_vec(call_results): 8.00µs
to_vec(data): 25.00µs
preparation_step::preparation::prepare: 191.00µs
air::preparation_step::preparation::make_exec_ctx: 14.00µs
air_interpreter_data::interpreter_data::serde_json::from_slice: 70.00µs
air_parser::parser::air_parser::parse: 52.00µs
runner::execute: 3.17ms
execute: 2.83ms
execute: 470.00µs
resolve_ast_variable: 189.00µs
resolve_variable: 61.00µs
new: 1.69ms
resolve_ast_scalar: 1.25ms
resolve_ast_variable: 780.00µs
resolve_variable: 258.00µs
parser_10000_100 (17.82ms): Running very long AIR script with lot of variables and assignments
air::runner::execute_air: 17.82ms
farewell_step::outcome::from_success_result: 77.00µs
populate_outcome_from_contexts: 58.00µs
to_vec(call_results): 8.00µs
to_vec(data): 14.00µs
preparation_step::preparation::prepare: 16.93ms
air::preparation_step::preparation::make_exec_ctx: 12.00µs
air_parser::parser::air_parser::parse: 16.87ms
runner::execute: 95.00µs
execute: 65.00µs
execute: 11.00µs
new: 13.00µs
Machine 0dfa4f098d7a6ef0d77a7bbc028ccf65fd6dc8d37be8a466ab3933a1a4a8e113:
Platform: macOS-11.7.3-x86_64-i386-64bit
Timestamp: 2023-02-14 04:31:01.303450+00:00
AquaVM version: 0.35.1
Benches:
big_values_data (14.17ms): Loading a trace with huge values
air::runner::execute_air: 14.17ms
farewell_step::outcome::from_success_result: 6.08ms
populate_outcome_from_contexts: 6.00ms
to_vec(call_results): 17.00µs
to_vec(data): 4.95ms
preparation_step::preparation::prepare: 7.87ms
air::preparation_step::preparation::make_exec_ctx: 40.00µs
air_interpreter_data::interpreter_data::serde_json::from_slice: 7.61ms
air_parser::parser::air_parser::parse: 66.00µs
runner::execute: 18.00µs
dashboard (89.32ms): big dashboard test
air::runner::execute_air: 89.32ms
farewell_step::outcome::from_success_result: 469.00µs
populate_outcome_from_contexts: 415.00µs
to_vec(call_results): 33.00µs
to_vec(data): 215.00µs
preparation_step::preparation::prepare: 1.06ms
air::preparation_step::preparation::make_exec_ctx: 56.00µs
air_interpreter_data::interpreter_data::serde_json::from_slice: 589.00µs
air_parser::parser::air_parser::parse: 233.00µs
runner::execute: 87.58ms
execute: 78.38ms
execute: 7.91ms
instructions::call::resolved_call::prepare_request_params: 678.00µs
instructions::call::resolved_call::serde_json::to_string(tetraplets): 36.00µs
resolver::resolve::resolve_ast_variable: 416.00µs
resolve_variable: 131.00µs
resolver::resolve::resolve_ast_variable: 1.09ms
resolve_variable: 362.00µs
new: 50.99ms
resolve_ast_scalar: 37.72ms
resolve_ast_variable: 23.15ms
resolve_variable: 7.40ms
long_data (4.44ms): Long data trace
air::runner::execute_air: 4.44ms
farewell_step::outcome::from_success_result: 1.32ms
populate_outcome_from_contexts: 1.24ms
to_vec(call_results): 23.00µs
to_vec(data): 672.00µs
preparation_step::preparation::prepare: 2.88ms
air::preparation_step::preparation::make_exec_ctx: 64.00µs
air_interpreter_data::interpreter_data::serde_json::from_slice: 2.59ms
air_parser::parser::air_parser::parse: 63.00µs
runner::execute: 22.00µs
network_explore (8.09ms): 5 peers of network are discovered
air::runner::execute_air: 8.09ms
farewell_step::outcome::from_success_result: 256.00µs
populate_outcome_from_contexts: 198.00µs
to_vec(call_results): 21.00µs
to_vec(data): 62.00µs
preparation_step::preparation::prepare: 661.00µs
air::preparation_step::preparation::make_exec_ctx: 60.00µs
air_interpreter_data::interpreter_data::serde_json::from_slice: 244.00µs
air_parser::parser::air_parser::parse: 174.00µs
runner::execute: 6.94ms
execute: 6.12ms
execute: 1.02ms
resolve_ast_variable: 393.00µs
resolve_variable: 124.00µs
new: 3.57ms
resolve_ast_scalar: 2.61ms
resolve_ast_variable: 1.60ms
resolve_variable: 517.00µs
parser_10000_100 (32.25ms): Running very long AIR script with lot of variables and assignments
air::runner::execute_air: 32.25ms
farewell_step::outcome::from_success_result: 202.00µs
populate_outcome_from_contexts: 152.00µs
to_vec(call_results): 17.00µs
to_vec(data): 45.00µs
preparation_step::preparation::prepare: 29.95ms
air::preparation_step::preparation::make_exec_ctx: 49.00µs
air_parser::parser::air_parser::parse: 29.74ms
runner::execute: 264.00µs
execute: 169.00µs
execute: 29.00µs
new: 40.00µs
Machine 5fce753d17dde8b439ef04cdbce135789eb44646c753548ad79a37b88cf17f0a:
Platform: macOS-12.3.1-arm64-arm-64bit
Timestamp: 2023-02-13 16:59:20.507375+00:00
AquaVM version: 0.35.1
Benches:
big_values_data (31.97ms): Loading a trace with huge values
air::runner::execute_air: 31.97ms
farewell_step::outcome::from_success_result: 10.56ms
populate_outcome_from_contexts: 8.69ms
to_vec(call_results): 108.00µs
to_vec(data): 5.66ms
preparation_step::preparation::prepare: 17.47ms
air::preparation_step::preparation::make_exec_ctx: 1.40ms
air_interpreter_data::interpreter_data::serde_json::from_slice: 10.68ms
air_parser::parser::air_parser::parse: 1.86ms
runner::execute: 126.00µs
dashboard (103.60ms): big dashboard test
air::runner::execute_air: 103.60ms
farewell_step::outcome::from_success_result: 4.71ms
populate_outcome_from_contexts: 3.70ms
to_vec(call_results): 162.00µs
to_vec(data): 1.87ms
preparation_step::preparation::prepare: 16.17ms
air::preparation_step::preparation::make_exec_ctx: 1.61ms
air_interpreter_data::interpreter_data::serde_json::from_slice: 5.50ms
air_parser::parser::air_parser::parse: 6.11ms
runner::execute: 78.68ms
execute: 66.40ms
execute: 9.37ms
instructions::call::resolved_call::prepare_request_params: 1.43ms
instructions::call::resolved_call::serde_json::to_string(tetraplets): 398.00µs
resolver::resolve::resolve_ast_variable: 335.00µs
resolve_variable: 105.00µs
resolver::resolve::resolve_ast_variable: 946.00µs
resolve_variable: 277.00µs
new: 40.53ms
resolve_ast_scalar: 29.73ms
resolve_ast_variable: 18.24ms
resolve_variable: 5.84ms
long_data (24.35ms): Long data trace
air::runner::execute_air: 24.35ms
farewell_step::outcome::from_success_result: 6.79ms
populate_outcome_from_contexts: 5.07ms
to_vec(call_results): 108.00µs
to_vec(data): 2.23ms
preparation_step::preparation::prepare: 13.54ms
air::preparation_step::preparation::make_exec_ctx: 1.75ms
air_interpreter_data::interpreter_data::serde_json::from_slice: 6.77ms
air_parser::parser::air_parser::parse: 1.84ms
runner::execute: 130.00µs
network_explore (46.01ms): 5 peers of network are discovered
air::runner::execute_air: 46.01ms
farewell_step::outcome::from_success_result: 5.48ms
populate_outcome_from_contexts: 4.50ms
to_vec(call_results): 105.00µs
to_vec(data): 2.25ms
preparation_step::preparation::prepare: 18.74ms
air::preparation_step::preparation::make_exec_ctx: 1.98ms
air_interpreter_data::interpreter_data::serde_json::from_slice: 7.05ms
air_parser::parser::air_parser::parse: 6.74ms
runner::execute: 17.86ms
execute: 9.97ms
execute: 3.17ms
resolve_ast_variable: 339.00µs
resolve_variable: 94.00µs
new: 4.10ms
resolve_ast_scalar: 2.65ms
resolve_ast_variable: 1.67ms
resolve_variable: 547.00µs
parser_10000_100 (48.47ms): Running very long AIR script with lot of variables and assignments
air::runner::execute_air: 48.47ms
farewell_step::outcome::from_success_result: 4.70ms
populate_outcome_from_contexts: 3.48ms
to_vec(call_results): 105.00µs
to_vec(data): 1.60ms
preparation_step::preparation::prepare: 34.34ms
air::preparation_step::preparation::make_exec_ctx: 1.41ms
air_parser::parser::air_parser::parse: 29.66ms
runner::execute: 4.39ms
execute: 2.00ms
execute: 483.00µs
new: 471.00µs
Machine 62dabcde478dc58760ebbe71ef6047299144a5f63990c6c3d826ebf30175adfc:
Platform: Linux-5.15.0-60-generic-x86_64-with-glibc2.35
Timestamp: 2023-02-14 10:33:54.321822+00:00
AquaVM version: 0.35.1
Benches:
big_values_data (12.75ms): Loading a trace with huge values
air::runner::execute_air: 12.75ms
farewell_step::outcome::from_success_result: 5.85ms
populate_outcome_from_contexts: 5.78ms
to_vec(call_results): 18.00µs
to_vec(data): 4.51ms
preparation_step::preparation::prepare: 6.78ms
air::preparation_step::preparation::make_exec_ctx: 29.00µs
air_interpreter_data::interpreter_data::serde_json::from_slice: 6.62ms
air_parser::parser::air_parser::parse: 22.00µs
runner::execute: 11.00µs
dashboard (146.20ms): big dashboard test
air::runner::execute_air: 146.20ms
farewell_step::outcome::from_success_result: 522.00µs
populate_outcome_from_contexts: 441.00µs
to_vec(call_results): 39.00µs
to_vec(data): 212.00µs
preparation_step::preparation::prepare: 697.00µs
air::preparation_step::preparation::make_exec_ctx: 27.00µs
air_interpreter_data::interpreter_data::serde_json::from_slice: 402.00µs
air_parser::parser::air_parser::parse: 121.00µs
runner::execute: 145.10ms
execute: 131.22ms
execute: 13.68ms
instructions::call::resolved_call::prepare_request_params: 959.00µs
instructions::call::resolved_call::serde_json::to_string(tetraplets): 41.00µs
resolver::resolve::resolve_ast_variable: 610.00µs
resolve_variable: 199.00µs
resolver::resolve::resolve_ast_variable: 1.75ms
resolve_variable: 555.00µs
new: 83.94ms
resolve_ast_scalar: 60.95ms
resolve_ast_variable: 36.93ms
resolve_variable: 11.76ms
long_data (3.41ms): Long data trace
air::runner::execute_air: 3.41ms
farewell_step::outcome::from_success_result: 1.07ms
populate_outcome_from_contexts: 1.00ms
to_vec(call_results): 20.00µs
to_vec(data): 540.00µs
preparation_step::preparation::prepare: 2.21ms
air::preparation_step::preparation::make_exec_ctx: 50.00µs
air_interpreter_data::interpreter_data::serde_json::from_slice: 2.03ms
air_parser::parser::air_parser::parse: 21.00µs
runner::execute: 10.00µs
network_explore (11.17ms): 5 peers of network are discovered
air::runner::execute_air: 11.17ms
farewell_step::outcome::from_success_result: 306.00µs
populate_outcome_from_contexts: 228.00µs
to_vec(call_results): 32.00µs
to_vec(data): 62.00µs
preparation_step::preparation::prepare: 345.00µs
air::preparation_step::preparation::make_exec_ctx: 22.00µs
air_interpreter_data::interpreter_data::serde_json::from_slice: 102.00µs
air_parser::parser::air_parser::parse: 74.00µs
runner::execute: 10.35ms
execute: 9.32ms
execute: 1.55ms
resolve_ast_variable: 592.00µs
resolve_variable: 189.00µs
new: 5.43ms
resolve_ast_scalar: 3.93ms
resolve_ast_variable: 2.38ms
resolve_variable: 766.00µs
parser_10000_100 (26.83ms): Running very long AIR script with lot of variables and assignments
air::runner::execute_air: 26.83ms
farewell_step::outcome::from_success_result: 205.00µs
populate_outcome_from_contexts: 149.00µs
to_vec(call_results): 28.00µs
to_vec(data): 33.00µs
preparation_step::preparation::prepare: 24.70ms
air::preparation_step::preparation::make_exec_ctx: 26.00µs
air_parser::parser::air_parser::parse: 24.55ms
runner::execute: 270.00µs
execute: 197.00µs
execute: 42.00µs
new: 42.00µs
Machine c1f3ea5950db0a10b44da931c25774d64ab25084f47d504f72f311e694550ff1:
Platform: macOS-12.0.1-x86_64-i386-64bit
Timestamp: 2023-02-13 13:19:34.106863+00:00
AquaVM version: 0.35.1
Benches:
big_values_data (16.56ms): Loading a trace with huge values
air::runner::execute_air: 16.56ms
farewell_step::outcome::from_success_result: 7.35ms
populate_outcome_from_contexts: 7.27ms
to_vec(call_results): 22.00µs
to_vec(data): 5.96ms
preparation_step::preparation::prepare: 8.97ms
air::preparation_step::preparation::make_exec_ctx: 46.00µs
air_interpreter_data::interpreter_data::serde_json::from_slice: 8.65ms
air_parser::parser::air_parser::parse: 78.00µs
runner::execute: 19.00µs
dashboard (105.40ms): big dashboard test
air::runner::execute_air: 105.40ms
farewell_step::outcome::from_success_result: 549.00µs
populate_outcome_from_contexts: 488.00µs
to_vec(call_results): 43.00µs
to_vec(data): 234.00µs
preparation_step::preparation::prepare: 1.31ms
air::preparation_step::preparation::make_exec_ctx: 64.00µs
air_interpreter_data::interpreter_data::serde_json::from_slice: 737.00µs
air_parser::parser::air_parser::parse: 276.00µs
runner::execute: 103.00ms
execute: 92.47ms
execute: 9.52ms
instructions::call::resolved_call::prepare_request_params: 799.00µs
instructions::call::resolved_call::serde_json::to_string(tetraplets): 51.00µs
resolver::resolve::resolve_ast_variable: 460.00µs
resolve_variable: 145.00µs
resolver::resolve::resolve_ast_variable: 1.42ms
resolve_variable: 477.00µs
new: 59.93ms
resolve_ast_scalar: 44.46ms
resolve_ast_variable: 27.31ms
resolve_variable: 8.72ms
long_data (4.47ms): Long data trace
air::runner::execute_air: 4.47ms
farewell_step::outcome::from_success_result: 1.38ms
populate_outcome_from_contexts: 1.27ms
to_vec(call_results): 20.00µs
to_vec(data): 652.00µs
preparation_step::preparation::prepare: 2.82ms
air::preparation_step::preparation::make_exec_ctx: 64.00µs
air_interpreter_data::interpreter_data::serde_json::from_slice: 2.53ms
air_parser::parser::air_parser::parse: 63.00µs
runner::execute: 25.00µs
network_explore (9.70ms): 5 peers of network are discovered
air::runner::execute_air: 9.70ms
farewell_step::outcome::from_success_result: 291.00µs
populate_outcome_from_contexts: 230.00µs
to_vec(call_results): 26.00µs
to_vec(data): 79.00µs
preparation_step::preparation::prepare: 847.00µs
air::preparation_step::preparation::make_exec_ctx: 64.00µs
air_interpreter_data::interpreter_data::serde_json::from_slice: 315.00µs
air_parser::parser::air_parser::parse: 206.00µs
runner::execute: 8.29ms
execute: 7.28ms
execute: 1.28ms
resolve_ast_variable: 497.00µs
resolve_variable: 155.00µs
new: 4.24ms
resolve_ast_scalar: 2.99ms
resolve_ast_variable: 1.81ms
resolve_variable: 569.00µs
parser_10000_100 (33.06ms): Running very long AIR script with lot of variables and assignments
air::runner::execute_air: 33.06ms
farewell_step::outcome::from_success_result: 207.00µs
populate_outcome_from_contexts: 158.00µs
to_vec(call_results): 18.00µs
to_vec(data): 47.00µs
preparation_step::preparation::prepare: 30.52ms
air::preparation_step::preparation::make_exec_ctx: 63.00µs
air_parser::parser::air_parser::parse: 30.28ms
runner::execute: 270.00µs
execute: 167.00µs
execute: 29.00µs
new: 38.00µs
Machine d77ebe8481884bc3b2778c8083f1bf459e548e929edd87041beb14f6b868d35f:
Platform: macOS-13.3.1-arm64-arm-64bit
Timestamp: 2023-05-19 12:28:41.064880+00:00
AquaVM version: 0.39.0
Benches:
big_values_data (8.88ms; 58.000 MiB, 58.000 MiB): Loading a trace with huge values
air::runner::execute_air: 8.88ms
preparation_step::preparation::prepare: 4.82ms
air::preparation_step::preparation::make_exec_ctx: 22.00µs
air_interpreter_data::interpreter_data::serde_json::from_slice: 4.70ms
air_parser::parser::air_parser::parse: 26.00µs
runner::execute: 16.00µs
runner::farewell: 3.81ms
from_success_result: 3.79ms
populate_outcome_from_contexts: 3.75ms
to_vec(call_results): 12.00µs
to_vec(data): 2.54ms
dashboard (28.45ms; 51.750 MiB, 51.750 MiB): big dashboard test
air::runner::execute_air: 28.45ms
preparation_step::preparation::prepare: 852.00µs
air::preparation_step::preparation::make_exec_ctx: 42.00µs
air_interpreter_data::interpreter_data::serde_json::from_slice: 574.00µs
air_parser::parser::air_parser::parse: 158.00µs
runner::execute: 26.83ms
execute: 21.17ms
execute: 4.35ms
prepare_request_params: 62.00µs
to_string(tetraplets): 18.00µs
new: 3.90ms
runner::farewell: 505.00µs
from_success_result: 485.00µs
populate_outcome_from_contexts: 435.00µs
to_vec(call_results): 16.00µs
to_vec(data): 172.00µs
long_data (3.13ms; 52.875 MiB, 52.875 MiB): Long data trace
air::runner::execute_air: 3.13ms
preparation_step::preparation::prepare: 1.78ms
air::preparation_step::preparation::make_exec_ctx: 40.00µs
air_interpreter_data::interpreter_data::serde_json::from_slice: 1.64ms
air_parser::parser::air_parser::parse: 26.00µs
runner::execute: 16.00µs
runner::farewell: 1.11ms
from_success_result: 1.09ms
populate_outcome_from_contexts: 1.05ms
to_vec(call_results): 12.00µs
to_vec(data): 462.00µs
network_explore (2.92ms; 51.500 MiB, 51.500 MiB): 5 peers of network are discovered
air::runner::execute_air: 2.92ms
preparation_step::preparation::prepare: 352.00µs
air::preparation_step::preparation::make_exec_ctx: 27.00µs
air_interpreter_data::interpreter_data::serde_json::from_slice: 165.00µs
air_parser::parser::air_parser::parse: 78.00µs
runner::execute: 2.05ms
execute: 1.57ms
execute: 339.00µs
new: 290.00µs
runner::farewell: 282.00µs
from_success_result: 263.00µs
populate_outcome_from_contexts: 226.00µs
to_vec(call_results): 12.00µs
to_vec(data): 47.00µs
parser_10000_100 (22.29ms; 56.812 MiB, 56.812 MiB): Running very long AIR script with lot of variables and assignments
air::runner::execute_air: 22.29ms
preparation_step::preparation::prepare: 20.70ms
air::preparation_step::preparation::make_exec_ctx: 22.00µs
air_parser::parser::air_parser::parse: 20.64ms
runner::execute: 158.00µs
execute: 108.00µs
execute: 32.00µs
new: 22.00µs
runner::farewell: 256.00µs
from_success_result: 236.00µs
populate_outcome_from_contexts: 203.00µs
to_vec(call_results): 12.00µs
to_vec(data): 28.00µs
Reference in New Issue View Git Blame Copy Permalink