After debugging all weekend, I finally figured out that my rigid body physics textbook had a typographical error in the quaternion multiplication formula (some "-"s where there should have been "+"s).
I've implemented proper friction and bounciness, as well as scaling.
