NumPy has a global setting where instead of returning NaN, one can throw a RuntimeError.
https://docs.scipy.org/doc/numpy/reference/generated/numpy.seterr.html

We should have something like this in pytorch (maybe).
This task is to scope out that work, or reject the feature request.