Why should you care?
Automated benchmarking or scientific testing ensures maintaining the accuracy of the methods when changes to the codebase happen.
Different benchmarks can have different goals
- Ensure that software improves over time
- Ensure that software performance doesn’t degrade over time