See also #19049 (comment) and the followup comments.
Clang (since 10 or 11, the documentation and release notes disagree), has the -ffp-exception-behavior=strict which we should be using (since we care about floating point error flags).
However, it seems that the monkeypatching maze in numpy.distutils ends up not using the option as modified in gh-19049.