Especially given how long the CI takes, we have may PRs that run the CI on multiple commits at once when they are pushed close to one another.

Implement the actions concurrency feature (described here) to prevent this. Also see this SO.