When on the frontend the theme could overwrite some basic CSS that makes the whole adminbar UI weird.
However, the frontend only supports the default WP theme so I can add some frontend only CSS to overwrite any theme CSS.