Steps to reproduce

1. have some scrollback
2. enable highlight all matches
3. find a term that exists at the top of the scrollback
4. enter some input
5. 🐛 scroll happens and reveals the found term

Initially reported microsoft/vscode#147602