Questions about measuring relative performance of different rendering approaches come up frequently:

• rendering layer-by-layer vs tile-by-tile
• tesselation strategy
• fill-outline vs separate layers

How can we accurately and repeatably measure rendering performance, so that we can make data-driven decisions about different possible rendering approaches?

Desiderata:

• Use real-world data
• Use real-world styles
• In browser
• Multiple browsers (Chrome + FF at least)
• Multiple OS/graphics card?
• Something automatable, that could be run in CI and flag performance regressions, would be a huge plus