Turns out everyone's been initializing LoRA weights suboptimally.

We find that by using the singular value decomposition (SVD) of the weight matrix to determine both the frozen weights and LoRA initialization, we can achieve faster convergence in RL training.

See the full post below on our extension of PiSSA