We're currently signaling the Dart garbage collector to collect when the animator/engine is notifying idle. To avoid one isolate signaling idle and causing a garbage collection which would jank another rendering isolate, alter the logic to let the garbage collection only occur when all isolates are idle.

#71253 partly related.