chore: add benchmarks history tracking

[cdc-as81]

No description provided.

[github-actions]

Benchmark Results

Hyperfine

Command	Mean [ms]	Min [ms]	Max [ms]	Relative
large_sir::baseline	2.3 ± 0.1	2.2	2.8	1.00
large_sir::entities	9.9 ± 0.1	9.8	10.5	4.28 ± 0.19

Criterion

Regressions:
  Group                                  Bench                                                              Change  CI Lower  CI Upper
  -------------------------------------  ----------------------------------------------------------------  -------  --------  --------
  sampling                               sampling_multiple_known_length_entities                            1.102%    1.011%    1.178%
  indexing                               query_people_multiple_individually_indexed_properties_entities     4.787%    4.672%    4.892%
  indexing                               query_people_count_multiple_individually_indexed_properties_enti   1.356%    1.269%    1.451%
  large_dataset                          bench_query_population_indexed_property_entities                   2.378%    2.061%    2.867%
  large_dataset                          bench_query_population_derived_property_entities                  12.208%   11.683%   12.723%
  large_dataset                          bench_match_entity                                                15.638%   15.406%   15.886%
  sample_entity_whole_population         10000                                                              0.475%    0.187%    0.748%
  sample_entity_whole_population         100000                                                             0.683%    0.441%    0.915%
  sample_entity_multi_property_indexed   10000                                                              2.536%    2.196%    3.094%
  sample_entity_multi_property_indexed   100000                                                             2.029%    1.462%    2.642%
  sample_entity_multi_property_indexed   1000                                                               1.873%    1.408%    2.196%

Improvements:
  Group                                  Bench                                                              Change  CI Lower  CI Upper
  -------------------------------------  ----------------------------------------------------------------  -------  --------  --------
  sampling                               sampling_multiple_l_reservoir_entities                            -2.811%   -2.851%   -2.773%
  sampling                               sampling_single_known_length_entities                             -1.270%   -1.722%   -0.836%
  sampling                               sampling_single_l_reservoir_entities                              -4.600%   -4.710%   -4.516%
  sample_entity_single_property_indexed  10000                                                             -2.463%   -3.048%   -1.834%
  sample_entity_single_property_indexed  100000                                                            -0.990%   -1.492%   -0.631%
  sample_entity_single_property_indexed  1000                                                              -2.866%   -3.058%   -2.701%
  indexing                               with_query_results_indexed_multi-property_entities                -6.991%   -7.254%   -6.528%
  indexing                               with_query_results_multiple_individually_indexed_properties_enti  -0.230%   -0.333%   -0.125%
  indexing                               query_people_single_indexed_property_entities                     -5.271%   -5.381%   -5.176%
  indexing                               query_people_count_indexed_multi-property_entities                -8.901%   -9.071%   -8.700%
  indexing                               query_people_indexed_multi-property_entities                      -7.598%   -7.696%   -7.485%
  indexing                               with_query_results_single_indexed_property_entities               -2.443%   -3.127%   -1.763%
  large_dataset                          bench_query_population_property_entities                          -2.297%   -2.561%   -1.975%
  large_dataset                          bench_query_population_multi_indexed_entities                     -2.438%   -2.760%   -1.933%
  large_dataset                          bench_query_population_multi_unindexed_entities                   -9.781%  -10.682%   -9.025%

Unchanged:
  Group                                  Bench                                                              Change  CI Lower  CI Upper
  -------------------------------------  ----------------------------------------------------------------  -------  --------  --------
  indexing                               query_people_count_single_indexed_property_entities               -0.896%   -1.481%    0.111%
  large_dataset                          bench_filter_indexed_entity                                        4.260%   -5.489%   14.573%
  large_dataset                          bench_filter_unindexed_entity                                      0.885%   -1.836%    3.573%
  sample_entity_whole_population         1000                                                               0.303%   -0.449%    0.842%

[github-actions]

Benchmark Results

Hyperfine

Command	Mean [ms]	Min [ms]	Max [ms]	Relative
large_sir::baseline	2.9 ± 0.0	2.8	3.1	1.00
large_sir::entities	13.5 ± 0.2	13.3	14.2	4.61 ± 0.11

Criterion

Regressions:
  Group                                  Bench                                                               Change  CI Lower  CI Upper
  -------------------------------------  ----------------------------------------------------------------  --------  --------  --------
  sampling                               sampling_multiple_l_reservoir_entities                              3.691%    3.494%    3.876%
  sampling                               sampling_multiple_known_length_entities                             0.114%    0.010%    0.229%
  sample_entity_single_property_indexed  10000                                                               2.650%    2.396%    3.020%
  sample_entity_single_property_indexed  100000                                                              1.099%    0.551%    1.528%
  sample_entity_single_property_indexed  1000                                                                1.816%    1.361%    2.289%
  indexing                               query_people_multiple_individually_indexed_properties_entities      0.374%    0.274%    0.472%
  indexing                               query_people_count_multiple_individually_indexed_properties_enti    3.292%    3.172%    3.401%
  indexing                               with_query_results_multiple_individually_indexed_properties_enti    4.993%    4.641%    5.351%
  indexing                               query_people_single_indexed_property_entities                       7.707%    4.683%   10.920%
  large_dataset                          bench_query_population_property_entities                            4.218%    2.174%    6.478%
  large_dataset                          bench_query_population_indexed_property_entities                   12.570%   12.116%   12.946%
  large_dataset                          bench_query_population_derived_property_entities                    0.646%    0.262%    1.041%
  large_dataset                          bench_query_population_multi_indexed_entities                       7.287%    7.079%    7.511%
  large_dataset                          bench_match_entity                                                 11.413%   11.159%   11.846%
  sample_entity_whole_population         1000                                                                1.392%    1.082%    1.910%
  sample_entity_multi_property_indexed   10000                                                               0.430%    0.144%    0.851%
  sample_entity_multi_property_indexed   100000                                                              0.469%    0.176%    0.777%
  sample_entity_multi_property_indexed   1000                                                                0.840%    0.528%    1.217%

Improvements:
  Group                                  Bench                                                               Change  CI Lower  CI Upper
  -------------------------------------  ----------------------------------------------------------------  --------  --------  --------
  sampling                               sampling_single_known_length_entities                              -0.295%   -0.600%   -0.039%
  sampling                               sampling_single_l_reservoir_entities                               -5.126%   -5.355%   -4.900%
  indexing                               with_query_results_indexed_multi-property_entities                 -3.752%   -3.948%   -3.542%
  indexing                               query_people_count_indexed_multi-property_entities                 -5.871%   -6.223%   -5.411%
  indexing                               query_people_indexed_multi-property_entities                      -20.441%  -20.572%  -20.313%
  large_dataset                          bench_query_population_multi_unindexed_entities                    -5.222%   -6.458%   -4.117%
  sample_entity_whole_population         10000                                                              -3.105%   -3.622%   -2.485%
  sample_entity_whole_population         100000                                                             -2.043%   -2.466%   -1.641%

Unchanged:
  Group                                  Bench                                                               Change  CI Lower  CI Upper
  -------------------------------------  ----------------------------------------------------------------  --------  --------  --------
  indexing                               query_people_count_single_indexed_property_entities                -0.232%   -0.612%    0.021%
  indexing                               with_query_results_single_indexed_property_entities                 0.093%   -0.215%    0.326%
  large_dataset                          bench_filter_indexed_entity                                        -1.033%  -12.047%   11.510%
  large_dataset                          bench_filter_unindexed_entity                                      -3.964%   -8.578%    0.957%

[k88hudson-cfa]

There are some security issues here I'm concerned about, if this is the approach you're taking it's critical to maintain principle of least privilege on giving the action permissions. In terms of the artifacts, you could consider this: https://docs.github.com/en/actions/tutorials/store-and-share-data

[github-actions]

Benchmark Results

Hyperfine

Command	Mean [ms]	Min [ms]	Max [ms]	Relative
large_sir::baseline	2.9 ± 0.1	2.8	3.1	1.00
large_sir::entities	13.2 ± 0.2	12.9	13.7	4.59 ± 0.10

Criterion

Regressions:
  Group                                  Bench                                                               Change  CI Lower  CI Upper
  -------------------------------------  ----------------------------------------------------------------  --------  --------  --------
  sampling                               sampling_multiple_l_reservoir_entities                              2.530%    2.266%    2.716%
  sampling                               sampling_single_known_length_entities                               0.552%    0.186%    0.946%
  sampling                               sampling_single_l_reservoir_entities                                3.151%    2.937%    3.306%
  sampling                               sampling_multiple_known_length_entities                             0.234%    0.152%    0.304%
  sample_entity_single_property_indexed  100000                                                              4.720%    4.421%    5.121%
  indexing                               query_people_multiple_individually_indexed_properties_entities      2.006%    1.909%    2.130%
  indexing                               query_people_count_multiple_individually_indexed_properties_enti    1.387%    1.261%    1.505%
  indexing                               with_query_results_multiple_individually_indexed_properties_enti    1.518%    1.335%    1.653%
  indexing                               query_people_count_indexed_multi-property_entities                  0.713%    0.297%    1.320%
  large_dataset                          bench_query_population_derived_property_entities                    4.075%    3.713%    4.469%
  large_dataset                          bench_match_entity                                                  8.159%    7.747%    8.453%
  sample_entity_whole_population         1000                                                                0.378%    0.214%    0.555%
  sample_entity_multi_property_indexed   10000                                                               1.398%    1.242%    1.561%

Improvements:
  Group                                  Bench                                                               Change  CI Lower  CI Upper
  -------------------------------------  ----------------------------------------------------------------  --------  --------  --------
  sample_entity_single_property_indexed  10000                                                              -0.520%   -0.711%   -0.347%
  sample_entity_single_property_indexed  1000                                                               -0.774%   -1.100%   -0.528%
  indexing                               with_query_results_indexed_multi-property_entities                 -2.421%   -2.756%   -2.148%
  indexing                               query_people_single_indexed_property_entities                     -15.960%  -18.085%  -13.685%
  indexing                               query_people_indexed_multi-property_entities                       -7.486%   -8.735%   -6.212%
  large_dataset                          bench_query_population_property_entities                           -1.733%   -2.063%   -1.262%
  large_dataset                          bench_query_population_indexed_property_entities                   -0.590%   -1.093%   -0.123%
  large_dataset                          bench_query_population_multi_unindexed_entities                    -7.215%   -7.394%   -7.027%
  sample_entity_whole_population         10000                                                              -1.995%   -2.375%   -1.705%
  sample_entity_whole_population         100000                                                             -0.577%   -0.962%   -0.299%

Unchanged:
  Group                                  Bench                                                               Change  CI Lower  CI Upper
  -------------------------------------  ----------------------------------------------------------------  --------  --------  --------
  indexing                               query_people_count_single_indexed_property_entities                 0.107%   -0.211%    0.364%
  indexing                               with_query_results_single_indexed_property_entities                -0.035%   -0.179%    0.108%
  large_dataset                          bench_filter_indexed_entity                                        -0.377%  -11.167%   13.015%
  large_dataset                          bench_query_population_multi_indexed_entities                      -0.269%   -0.623%    0.017%
  large_dataset                          bench_filter_unindexed_entity                                      -0.844%   -5.397%    4.210%
  sample_entity_multi_property_indexed   100000                                                              0.834%   -0.108%    1.535%
  sample_entity_multi_property_indexed   1000                                                                0.306%   -0.086%    0.617%

[github-actions]

Benchmark Results

Hyperfine

Command	Mean [ms]	Min [ms]	Max [ms]	Relative
large_sir::baseline	3.0 ± 0.1	2.9	3.1	1.00
large_sir::entities	14.4 ± 0.2	14.1	15.1	4.88 ± 0.11

Criterion

Regressions:
  Group                                  Bench                                                               Change  CI Lower  CI Upper
  -------------------------------------  ----------------------------------------------------------------  --------  --------  --------
  sampling                               sampling_multiple_l_reservoir_entities                             11.749%   10.819%   12.861%
  sampling                               sampling_single_l_reservoir_entities                                5.973%    5.070%    7.075%
  sampling                               sampling_multiple_known_length_entities                             0.240%    0.088%    0.427%
  indexing                               query_people_multiple_individually_indexed_properties_entities      2.922%    2.126%    3.938%
  indexing                               query_people_count_multiple_individually_indexed_properties_enti    4.580%    4.190%    5.051%
  large_dataset                          bench_query_population_derived_property_entities                    1.696%    1.242%    2.284%
  large_dataset                          bench_query_population_multi_unindexed_entities                     2.253%    0.424%    4.066%
  large_dataset                          bench_match_entity                                                  8.825%    8.097%    9.691%
  sample_entity_whole_population         1000                                                                0.417%    0.024%    0.862%
  sample_entity_multi_property_indexed   10000                                                               1.700%    1.242%    2.263%
  sample_entity_multi_property_indexed   100000                                                              1.223%    0.162%    2.457%
  sample_entity_multi_property_indexed   1000                                                                0.685%    0.031%    1.305%

Improvements:
  Group                                  Bench                                                               Change  CI Lower  CI Upper
  -------------------------------------  ----------------------------------------------------------------  --------  --------  --------
  sampling                               sampling_single_known_length_entities                              -8.536%   -9.024%   -7.990%
  sample_entity_single_property_indexed  10000                                                              -3.344%   -3.632%   -2.918%
  sample_entity_single_property_indexed  100000                                                             -4.899%   -6.044%   -4.034%
  sample_entity_single_property_indexed  1000                                                               -3.458%   -3.936%   -2.753%
  indexing                               with_query_results_indexed_multi-property_entities                 -0.631%   -1.016%   -0.161%
  indexing                               with_query_results_multiple_individually_indexed_properties_enti   -0.672%   -1.184%   -0.179%
  indexing                               query_people_single_indexed_property_entities                      -4.350%   -6.708%   -2.019%
  indexing                               query_people_indexed_multi-property_entities                      -13.837%  -14.208%  -13.427%
  large_dataset                          bench_query_population_property_entities                           -2.057%   -3.990%   -0.087%
  large_dataset                          bench_query_population_indexed_property_entities                   -0.666%   -1.182%   -0.269%
  large_dataset                          bench_query_population_multi_indexed_entities                      -8.164%   -9.250%   -7.069%
  sample_entity_whole_population         10000                                                              -0.821%   -0.991%   -0.650%

Unchanged:
  Group                                  Bench                                                               Change  CI Lower  CI Upper
  -------------------------------------  ----------------------------------------------------------------  --------  --------  --------
  indexing                               query_people_count_indexed_multi-property_entities                  0.090%   -1.077%    1.425%
  indexing                               query_people_count_single_indexed_property_entities                -0.416%   -1.454%    0.422%
  indexing                               with_query_results_single_indexed_property_entities                 0.704%   -0.291%    1.489%
  large_dataset                          bench_filter_indexed_entity                                        10.820%   -2.581%   24.847%
  large_dataset                          bench_filter_unindexed_entity                                       4.388%   -0.923%    9.797%
  sample_entity_whole_population         100000                                                             -0.312%   -0.767%    0.189%