In this video we talk about merging LoRAs - the difficulties with a naive approach and the benefits of the new "ZipLoRA' technique.
Paper: arxiv.org/abs/2311.13600
Colab shown in the video: colab.research.google.com/drive/1lo5OTSzsj1KCwfw8l…
ziplora-pytorch implementation: github.com/mkshing/ziplora-pytorch/tree/main
コメント