Pin build-time numpy versions for Python 3.10 and 3.11

This avoid errors when trying to use with a numpy version that's older
than the one that was newest when pycuda was built. See
https://github.com/inducer/pycuda/issues/271 for background on why this
is useful.