LoRA or LoRA Base? #514
Answered
by
LostRuins
StripedPuppy
asked this question in
Q&A
-
In the models tab, what is the difference between LoRA and LoRA Base for LoRA models? I've noticed I can run 7b and 13b LoRA's under LoRA Base, but not LoRA due to insufficient extra RAM. |
Beta Was this translation helpful? Give feedback.
Answered by
LostRuins
Nov 5, 2023
Replies: 1 comment
-
lora base is intended to select the original f16 model weights (a higher quality model to use as a base for the layers modified by the adapter.) |
Beta Was this translation helpful? Give feedback.
0 replies
Answer selected by
StripedPuppy
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
lora base is intended to select the original f16 model weights (a higher quality model to use as a base for the layers modified by the adapter.)