Caches are not completely cleaned before CI tests.

Job #90994 failed for af4dd6e7:

The failure was due to existing caches of a loopy kernel. This should not happen, since according to the logs, .cache/ was removed prior to running tests.

The tests passed after setting SUMPY_NO_CACHE=True in CI settings and rerunning.