Add a bash script to run some benchmarks on AWS #43

jaja360 · 2025-06-24T02:51:06Z

This PR:

Adds scripts/aws_tests.bash which launches multiple AWS instances, runs the existing generate_multiple_tables.py on each of them, and pull back the generated tables locally.
Fixes an issue with the uniform_all generator (now called logscall_all).

- It always produced 'inf' because the range was greater than mt19937_64's limit - It makes more sense to use a logscale to better cover the range of possible floating values: uniform_all -> logspace_all

scripts/aws_tests.bash

lemire

Great work.

My comments are non-blocking, just superficial comments.

Principally, this PR: - makes security_group and ssh_key configurable via env variables - generates them automatically if unspecified - adds some checks and comments - adds x86 instances.

jaja360 added 5 commits June 23, 2025 18:01

Fix the uniform_all random generator

95637f8

- It always produced 'inf' because the range was greater than mt19937_64's limit - It makes more sense to use a logscale to better cover the range of possible floating values: uniform_all -> logspace_all

add bash script to run tests on AWS instances

1ba42e8

make all AWS instances run in parallel

845697e

fix missing cd and remove warning in AWS script

b9f7b61

fix perf permissions in AWS script

4f8e13c

jaja360 requested a review from lemire June 24, 2025 02:51

jaja360 added 4 commits June 23, 2025 23:28

use lscpu instead of /proc/cpuinfo

0b6d473

make the tests run also with clang++ builds

7f54162

save CPU, g++ and clang++ info on files

7847a34

fix typo in rsync folder path

0861e27