Like categorization (#1774) this is another very useful concept we can steal from Rust, see rustc_errors::Applicability.

Ideally users would be able to choose how much they want to risk when applying lints.

I think for rule applicability is even more relevant for Python than for Rust since pretty much all of the behavior of Python types can be overriden by implementing custom __dunder__ methods.