It is hard to evaluate a code change if we can't compare not only the code but their speed (and memory) requirements.
Of course, there is the benchmark directory already, but we need to make sure to run it after every relevant change (let's define this as "every chance in the code").