- pytest >= 6.1.1
- pytest-benchmark >= 3.4.1
pytest benchmarks/ --benchmark-json=results.jsonRunning tests and saving the current run into STORAGE, see [1]
pytest benchmarks/ --benchmark-json=results.json --benchmark-autosavepytest-benchmark compare results.json --csv=results.csv --group-by='name'Note: make sure that pytest-benchmark[histogram] installed
# example
pip install pytest-benchmark[histogram]
pytest -vv benchmarks/ --benchmark-autosave --benchmark-histogram
pytest-benchmark compare .benchmarks/Linux-CPython-3.7-64bit/* --histogrampytest benchmarks/ --benchmark-columns='min, max, mean, stddev, median, rounds, iterations' --benchmark-json=results.json --benchmark-autosave
pytest-benchmark compare results.json --csv=results.csv --group-by='name'
[1] https://pytest-benchmark.readthedocs.io/en/latest/usage.html