Despite you claiming that your matrices are column major, they're row-major. You might want to mention that somewhere.