This is done by asv run anyway and for some reason aborts the build.
Hopefully, the last change for benchmark setup