run benchmarks

tests/end_to_end/candid_rpc/functional_syntax/audio_recorder/benchmarks.json

@@ -0,0 +1,35 @@
+{
+    "audio_recorder": {
+        "previous": { "version": "0.25.0", "benchmarks": [] },
+        "current": {
+            "version": "0.25.0",
+            "benchmarks": [
+                {
+                    "instructions": { "__bigint__": "14173119" },
+                    "method_name": "createUser",
+                    "timestamp": { "__bigint__": "1730238474240973091" }
+                },
+                {
+                    "instructions": { "__bigint__": "34642331" },
+                    "method_name": "createRecording",
+                    "timestamp": { "__bigint__": "1730238476388691423" }
+                },
+                {
+                    "instructions": { "__bigint__": "48510538" },
+                    "method_name": "deleteRecording",
+                    "timestamp": { "__bigint__": "1730238478398934311" }
+                },
+                {
+                    "instructions": { "__bigint__": "34435848" },
+                    "method_name": "createRecording",
+                    "timestamp": { "__bigint__": "1730238480509177559" }
+                },
+                {
+                    "instructions": { "__bigint__": "34124394" },
+                    "method_name": "deleteUser",
+                    "timestamp": { "__bigint__": "1730238482687412095" }
+                }
+            ]
+        }
+    }
+}

tests/end_to_end/candid_rpc/functional_syntax/audio_recorder/benchmarks.md

@@ -0,0 +1,28 @@
+# Benchmarks for audio_recorder
+
+## Current benchmarks Azle version: 0.25.0
+
+| Id  | Method Name     | Instructions | Cycles     | USD           | USD/Million Calls |
+| --- | --------------- | ------------ | ---------- | ------------- | ----------------- |
+| 0   | createUser      | 14_173_119   | 6_259_247  | $0.0000083227 | $8.32             |
+| 1   | createRecording | 34_642_331   | 14_446_932 | $0.0000192097 | $19.20            |
+| 2   | deleteRecording | 48_510_538   | 19_994_215 | $0.0000265857 | $26.58            |
+| 3   | createRecording | 34_435_848   | 14_364_339 | $0.0000190998 | $19.09            |
+| 4   | deleteUser      | 34_124_394   | 14_239_757 | $0.0000189342 | $18.93            |
+
+## Baseline benchmarks Azle version: 0.25.0
+
+No benchmarks reported
+
+---
+
+**Note on calculations:**
+
+-   Cycles are calculated using the formula: base_fee + (per_instruction_fee \* number_of_instructions) + (additional_fee_per_billion \* floor(number_of_instructions / 1_000_000_000))
+-   base_fee: 590_000 cycles
+-   per_instruction_fee: 0.4 cycles
+-   additional_fee_per_billion: 400_000_000 cycles per billion instructions
+-   USD value is derived from the total cycles, where 1 trillion cycles = 1 XDR, and 1 XDR = $1.329670 (as of October 24, 2024)
+
+For the most up-to-date XDR to USD conversion rate, please refer to the [IMF website](https://www.imf.org/external/np/fin/data/rms_sdrv.aspx).
+For the most current fee information, please check the [official documentation](https://internetcomputer.org/docs/current/developer-docs/gas-cost#execution).

tests/end_to_end/candid_rpc/functional_syntax/blob_array/benchmarks.json

@@ -0,0 +1,6 @@
+{
+    "blob_array": {
+        "previous": { "version": "0.25.0", "benchmarks": [] },
+        "current": { "version": "0.25.0", "benchmarks": [] }
+    }
+}

tests/end_to_end/candid_rpc/functional_syntax/blob_array/benchmarks.md

@@ -0,0 +1,22 @@
+# Benchmarks for blob_array
+
+## Current benchmarks Azle version: 0.25.0
+
+No benchmarks reported
+
+## Baseline benchmarks Azle version: 0.25.0
+
+No benchmarks reported
+
+---
+
+**Note on calculations:**
+
+-   Cycles are calculated using the formula: base_fee + (per_instruction_fee \* number_of_instructions) + (additional_fee_per_billion \* floor(number_of_instructions / 1_000_000_000))
+-   base_fee: 590_000 cycles
+-   per_instruction_fee: 0.4 cycles
+-   additional_fee_per_billion: 400_000_000 cycles per billion instructions
+-   USD value is derived from the total cycles, where 1 trillion cycles = 1 XDR, and 1 XDR = $1.329670 (as of October 24, 2024)
+
+For the most up-to-date XDR to USD conversion rate, please refer to the [IMF website](https://www.imf.org/external/np/fin/data/rms_sdrv.aspx).
+For the most current fee information, please check the [official documentation](https://internetcomputer.org/docs/current/developer-docs/gas-cost#execution).

tests/end_to_end/candid_rpc/functional_syntax/call_raw/benchmarks.json

@@ -0,0 +1,20 @@
+{
+    "call_raw": {
+        "previous": { "version": "0.25.0", "benchmarks": [] },
+        "current": {
+            "version": "0.25.0",
+            "benchmarks": [
+                {
+                    "instructions": { "__bigint__": "1461529" },
+                    "method_name": "executeCallRaw",
+                    "timestamp": { "__bigint__": "1730238472455247194" }
+                },
+                {
+                    "instructions": { "__bigint__": "1969233" },
+                    "method_name": "executeCallRaw",
+                    "timestamp": { "__bigint__": "1730238474351129174" }
+                }
+            ]
+        }
+    }
+}

tests/end_to_end/candid_rpc/functional_syntax/call_raw/benchmarks.md

@@ -0,0 +1,25 @@
+# Benchmarks for call_raw
+
+## Current benchmarks Azle version: 0.25.0
+
+| Id  | Method Name    | Instructions | Cycles    | USD           | USD/Million Calls |
+| --- | -------------- | ------------ | --------- | ------------- | ----------------- |
+| 0   | executeCallRaw | 1_461_529    | 1_174_611 | $0.0000015618 | $1.56             |
+| 1   | executeCallRaw | 1_969_233    | 1_377_693 | $0.0000018319 | $1.83             |
+
+## Baseline benchmarks Azle version: 0.25.0
+
+No benchmarks reported
+
+---
+
+**Note on calculations:**
+
+-   Cycles are calculated using the formula: base_fee + (per_instruction_fee \* number_of_instructions) + (additional_fee_per_billion \* floor(number_of_instructions / 1_000_000_000))
+-   base_fee: 590_000 cycles
+-   per_instruction_fee: 0.4 cycles
+-   additional_fee_per_billion: 400_000_000 cycles per billion instructions
+-   USD value is derived from the total cycles, where 1 trillion cycles = 1 XDR, and 1 XDR = $1.329670 (as of October 24, 2024)
+
+For the most up-to-date XDR to USD conversion rate, please refer to the [IMF website](https://www.imf.org/external/np/fin/data/rms_sdrv.aspx).
+For the most current fee information, please check the [official documentation](https://internetcomputer.org/docs/current/developer-docs/gas-cost#execution).

tests/end_to_end/candid_rpc/functional_syntax/candid_keywords/benchmarks.json

@@ -0,0 +1,6 @@
+{
+    "candid_keywords": {
+        "previous": { "version": "0.25.0", "benchmarks": [] },
+        "current": { "version": "0.25.0", "benchmarks": [] }
+    }
+}

tests/end_to_end/candid_rpc/functional_syntax/candid_keywords/benchmarks.md

@@ -0,0 +1,22 @@
+# Benchmarks for candid_keywords
+
+## Current benchmarks Azle version: 0.25.0
+
+No benchmarks reported
+
+## Baseline benchmarks Azle version: 0.25.0
+
+No benchmarks reported
+
+---
+
+**Note on calculations:**
+
+-   Cycles are calculated using the formula: base_fee + (per_instruction_fee \* number_of_instructions) + (additional_fee_per_billion \* floor(number_of_instructions / 1_000_000_000))
+-   base_fee: 590_000 cycles
+-   per_instruction_fee: 0.4 cycles
+-   additional_fee_per_billion: 400_000_000 cycles per billion instructions
+-   USD value is derived from the total cycles, where 1 trillion cycles = 1 XDR, and 1 XDR = $1.329670 (as of October 24, 2024)
+
+For the most up-to-date XDR to USD conversion rate, please refer to the [IMF website](https://www.imf.org/external/np/fin/data/rms_sdrv.aspx).
+For the most current fee information, please check the [official documentation](https://internetcomputer.org/docs/current/developer-docs/gas-cost#execution).

tests/end_to_end/candid_rpc/functional_syntax/complex_types/benchmarks.json

@@ -0,0 +1,30 @@
+{
+    "complex_types": {
+        "previous": { "version": "0.25.0", "benchmarks": [] },
+        "current": {
+            "version": "0.25.0",
+            "benchmarks": [
+                {
+                    "instructions": { "__bigint__": "80582078" },
+                    "method_name": "createUser",
+                    "timestamp": { "__bigint__": "1730238462163868272" }
+                },
+                {
+                    "instructions": { "__bigint__": "164270619" },
+                    "method_name": "createThread",
+                    "timestamp": { "__bigint__": "1730238464335475487" }
+                },
+                {
+                    "instructions": { "__bigint__": "86867411" },
+                    "method_name": "createPost",
+                    "timestamp": { "__bigint__": "1730238466209860344" }
+                },
+                {
+                    "instructions": { "__bigint__": "173117467" },
+                    "method_name": "createReaction",
+                    "timestamp": { "__bigint__": "1730238468310092773" }
+                }
+            ]
+        }
+    }
+}

tests/end_to_end/candid_rpc/functional_syntax/complex_types/benchmarks.md

@@ -0,0 +1,27 @@
+# Benchmarks for complex_types
+
+## Current benchmarks Azle version: 0.25.0
+
+| Id  | Method Name    | Instructions | Cycles     | USD           | USD/Million Calls |
+| --- | -------------- | ------------ | ---------- | ------------- | ----------------- |
+| 0   | createUser     | 80_582_078   | 32_822_831 | $0.0000436435 | $43.64            |
+| 1   | createThread   | 164_270_619  | 66_298_247 | $0.0000881548 | $88.15            |
+| 2   | createPost     | 86_867_411   | 35_336_964 | $0.0000469865 | $46.98            |
+| 3   | createReaction | 173_117_467  | 69_836_986 | $0.0000928601 | $92.86            |
+
+## Baseline benchmarks Azle version: 0.25.0
+
+No benchmarks reported
+
+---
+
+**Note on calculations:**
+
+-   Cycles are calculated using the formula: base_fee + (per_instruction_fee \* number_of_instructions) + (additional_fee_per_billion \* floor(number_of_instructions / 1_000_000_000))
+-   base_fee: 590_000 cycles
+-   per_instruction_fee: 0.4 cycles
+-   additional_fee_per_billion: 400_000_000 cycles per billion instructions
+-   USD value is derived from the total cycles, where 1 trillion cycles = 1 XDR, and 1 XDR = $1.329670 (as of October 24, 2024)
+
+For the most up-to-date XDR to USD conversion rate, please refer to the [IMF website](https://www.imf.org/external/np/fin/data/rms_sdrv.aspx).
+For the most current fee information, please check the [official documentation](https://internetcomputer.org/docs/current/developer-docs/gas-cost#execution).

tests/end_to_end/candid_rpc/functional_syntax/counter/benchmarks.json

@@ -0,0 +1,25 @@
+{
+    "counter": {
+        "previous": { "version": "0.25.0", "benchmarks": [] },
+        "current": {
+            "version": "0.25.0",
+            "benchmarks": [
+                {
+                    "instructions": { "__bigint__": "1481635" },
+                    "method_name": "incrementCount",
+                    "timestamp": { "__bigint__": "1730238465545805121" }
+                },
+                {
+                    "instructions": { "__bigint__": "1455012" },
+                    "method_name": "incrementCount",
+                    "timestamp": { "__bigint__": "1730238467454494763" }
+                },
+                {
+                    "instructions": { "__bigint__": "1454315" },
+                    "method_name": "incrementCount",
+                    "timestamp": { "__bigint__": "1730238469634024056" }
+                }
+            ]
+        }
+    }
+}

tests/end_to_end/candid_rpc/functional_syntax/counter/benchmarks.md

@@ -0,0 +1,26 @@
+# Benchmarks for counter
+
+## Current benchmarks Azle version: 0.25.0
+
+| Id  | Method Name    | Instructions | Cycles    | USD           | USD/Million Calls |
+| --- | -------------- | ------------ | --------- | ------------- | ----------------- |
+| 0   | incrementCount | 1_481_635    | 1_182_654 | $0.0000015725 | $1.57             |
+| 1   | incrementCount | 1_455_012    | 1_172_004 | $0.0000015584 | $1.55             |
+| 2   | incrementCount | 1_454_315    | 1_171_726 | $0.0000015580 | $1.55             |
+
+## Baseline benchmarks Azle version: 0.25.0
+
+No benchmarks reported
+
+---
+
+**Note on calculations:**
+
+-   Cycles are calculated using the formula: base_fee + (per_instruction_fee \* number_of_instructions) + (additional_fee_per_billion \* floor(number_of_instructions / 1_000_000_000))
+-   base_fee: 590_000 cycles
+-   per_instruction_fee: 0.4 cycles
+-   additional_fee_per_billion: 400_000_000 cycles per billion instructions
+-   USD value is derived from the total cycles, where 1 trillion cycles = 1 XDR, and 1 XDR = $1.329670 (as of October 24, 2024)
+
+For the most up-to-date XDR to USD conversion rate, please refer to the [IMF website](https://www.imf.org/external/np/fin/data/rms_sdrv.aspx).
+For the most current fee information, please check the [official documentation](https://internetcomputer.org/docs/current/developer-docs/gas-cost#execution).

tests/end_to_end/candid_rpc/functional_syntax/date/benchmarks.json

@@ -0,0 +1,6 @@
+{
+    "date": {
+        "previous": { "version": "0.25.0", "benchmarks": [] },
+        "current": { "version": "0.25.0", "benchmarks": [] }
+    }
+}

tests/end_to_end/candid_rpc/functional_syntax/date/benchmarks.md

@@ -0,0 +1,22 @@
+# Benchmarks for date
+
+## Current benchmarks Azle version: 0.25.0
+
+No benchmarks reported
+
+## Baseline benchmarks Azle version: 0.25.0
+
+No benchmarks reported
+
+---
+
+**Note on calculations:**
+
+-   Cycles are calculated using the formula: base_fee + (per_instruction_fee \* number_of_instructions) + (additional_fee_per_billion \* floor(number_of_instructions / 1_000_000_000))
+-   base_fee: 590_000 cycles
+-   per_instruction_fee: 0.4 cycles
+-   additional_fee_per_billion: 400_000_000 cycles per billion instructions
+-   USD value is derived from the total cycles, where 1 trillion cycles = 1 XDR, and 1 XDR = $1.329670 (as of October 24, 2024)
+
+For the most up-to-date XDR to USD conversion rate, please refer to the [IMF website](https://www.imf.org/external/np/fin/data/rms_sdrv.aspx).
+For the most current fee information, please check the [official documentation](https://internetcomputer.org/docs/current/developer-docs/gas-cost#execution).

tests/end_to_end/candid_rpc/functional_syntax/imports/benchmarks.json

@@ -0,0 +1,6 @@
+{
+    "imports": {
+        "previous": { "version": "0.25.0", "benchmarks": [] },
+        "current": { "version": "0.25.0", "benchmarks": [] }
+    }
+}

tests/end_to_end/candid_rpc/functional_syntax/imports/benchmarks.md

@@ -0,0 +1,22 @@
+# Benchmarks for imports
+
+## Current benchmarks Azle version: 0.25.0
+
+No benchmarks reported
+
+## Baseline benchmarks Azle version: 0.25.0
+
+No benchmarks reported
+
+---
+
+**Note on calculations:**
+
+-   Cycles are calculated using the formula: base_fee + (per_instruction_fee \* number_of_instructions) + (additional_fee_per_billion \* floor(number_of_instructions / 1_000_000_000))
+-   base_fee: 590_000 cycles
+-   per_instruction_fee: 0.4 cycles
+-   additional_fee_per_billion: 400_000_000 cycles per billion instructions
+-   USD value is derived from the total cycles, where 1 trillion cycles = 1 XDR, and 1 XDR = $1.329670 (as of October 24, 2024)
+
+For the most up-to-date XDR to USD conversion rate, please refer to the [IMF website](https://www.imf.org/external/np/fin/data/rms_sdrv.aspx).
+For the most current fee information, please check the [official documentation](https://internetcomputer.org/docs/current/developer-docs/gas-cost#execution).

tests/end_to_end/candid_rpc/functional_syntax/init/benchmarks.json

@@ -0,0 +1,15 @@
+{
+    "init": {
+        "previous": { "version": "0.25.0", "benchmarks": [] },
+        "current": {
+            "version": "0.25.0",
+            "benchmarks": [
+                {
+                    "instructions": { "__bigint__": "5358645869" },
+                    "method_name": "init",
+                    "timestamp": { "__bigint__": "1730238454716344381" }
+                }
+            ]
+        }
+    }
+}

tests/end_to_end/candid_rpc/functional_syntax/init/benchmarks.md

@@ -0,0 +1,24 @@
+# Benchmarks for init
+
+## Current benchmarks Azle version: 0.25.0
+
+| Id  | Method Name | Instructions  | Cycles        | USD           | USD/Million Calls |
+| --- | ----------- | ------------- | ------------- | ------------- | ----------------- |
+| 0   | init        | 5_358_645_869 | 4_144_048_347 | $0.0055102168 | $5_510.21         |
+
+## Baseline benchmarks Azle version: 0.25.0
+
+No benchmarks reported
+
+---
+
+**Note on calculations:**
+
+-   Cycles are calculated using the formula: base_fee + (per_instruction_fee \* number_of_instructions) + (additional_fee_per_billion \* floor(number_of_instructions / 1_000_000_000))
+-   base_fee: 590_000 cycles
+-   per_instruction_fee: 0.4 cycles
+-   additional_fee_per_billion: 400_000_000 cycles per billion instructions
+-   USD value is derived from the total cycles, where 1 trillion cycles = 1 XDR, and 1 XDR = $1.329670 (as of October 24, 2024)
+
+For the most up-to-date XDR to USD conversion rate, please refer to the [IMF website](https://www.imf.org/external/np/fin/data/rms_sdrv.aspx).
+For the most current fee information, please check the [official documentation](https://internetcomputer.org/docs/current/developer-docs/gas-cost#execution).