Model Adaptation
Model adaptation adjusts pre-trained models to specific tasks and deployment scenarios, encompassing techniques such as fine-tuning and model compression.
Contents:
- Fine-tuning — Full-parameter fine-tuning, LoRA, Adapter, Prefix Tuning
- Model Compression — Knowledge distillation, pruning, quantization