What is Parameter-Efficient Fine-Tuning.
08 Jul 2023, 12:38
What is Parameter-Efficient Fine-Tuning?
Fine-tuning Large models with trillions of parameters becomes infeasible on local devices. PEFT is a new technique to fine-tune large models by training some (small) model parameters and freezing most of them
Same news in other sources
108 Jul 2023, 12:38
PEFT comes with several advantages:
1. Reduced computational and storage costs
2. Overcomes the issue of catastrophic forgetting
3. Easy model portability as the model checkpoints get really small
PEFT comes with several advantages:. Reduced computational and storage costs. Overcomes the issue of catastrophic forgetting.
PEFT comes with several advantages:
1. Reduced computational and storage costs
2. Overcomes the issue of catastrophic forgetting
3. Easy model portability as the model checkpoints get really small