Proposed new feature or change:

assert_allclose with verbose=True shows the max absolute and relative differences on failure. It would be helpful for debugging issues if, for each of those, it would also show the index and the pair of values producing the difference.