ALPHA: wire is a tool to deploy nixos systems
wire.althaea.zone/
althaea.zone
1# Bench
2
3This directory contains a little tool to run hyperfine against wire and colmena, deploying the exact same hive.
4
5The hive can be found in `default.nix`.
6
7Run the test with `nix run .#checks.x86_64-linux.bench.driverInteractive -vvv -L
8--show-trace --impure`
9
10Then run `test_script()`
11
12No idea why running the test directly breaks it....
13
14You can adjust the number of nodes in `num-nodes.nix`
15
16The hive has around 20 nodes and 200 keys each. 80% of the keys are pre-activation, 20% post-activation.
17
18| Command | Mean [s] | Min [s] | Max [s] | Relative |
19| :----------------------- | --------------: | ------: | ------: | ----------: |
20| `wire@HEAD - flake` | 89.825 ± 22.941 | 78.190 | 130.831 | 1.00 |
21| `wire@stable - flake` | 133.664 ± 0.303 | 133.219 | 134.044 | 1.49 ± 0.38 |
22| `colmena@pinned - flake` | 131.544 ± 1.076 | 130.330 | 133.211 | 1.46 ± 0.37 |
23| `wire@stable - hive.nix` | 133.070 ± 0.805 | 132.166 | 134.209 | 1.48 ± 0.38 |
24| `wire@HEAD - hive.nix` | 130.287 ± 1.456 | 128.980 | 132.699 | 1.45 ± 0.37 |