Since we were able to get System.Buffers to succeed, let's add a new CI leg to see how the rest of the suites hold up.

I would recommend starting the work out as a draft PR as there will likely be many hiccups.