Current mypy plugin system is practically ready for better support for this. Ideally we would want python/mypy#6259 implemented.

First thing here would be to infer Column[str] for users.c.name instead of just Column[Any].