Ensure that CL objects can continue to be cleaned up even when PyOpenCL is already half-deleted