While #47760 (comment) was a start in reorganizing the patterns, it seems I missed a few that are bundled into Core. Let's use this issue to discuss how best to order the remaining categories over time as they are added to the pattern directory: https://github.com/WordPress/wordpress-develop/blob/trunk/src/wp-includes/block-patterns.php#L39-L158

Here's one proposed order:

Featured
Posts
Text
Gallery
Media
Call to Action
About
Banners
Contact
Portfolio
Services
Team
Testimonial
Headers
Footers

Leaving out Columns and Buttons since afaik those were adapted to Text and Call to Action respectively. @WordPress/gutenberg-design for more thoughts along with @richtabor