Make type inference deterministic

dtype.isbuiltin can apparently be both True and False for simple types
like np.int32, depending on how the dtype is constructed. That makes it
unsuited to detect user-created dtypes.