Pytest is a test-requirement not a runtime requirement

Installing pycuda shouldn't bring in a test runtime, only
when you are planning to run the test suite of pycuda should
this be brought in.