The k bias is always zero in code. Is there any reason for this? This is different from the normal implement.

In my test. when finetune, k bias has little affect on performance. But I do not have a test on pretrain.