09/27/2026
What happens when you compare few-shot PEFT against few-shot ICL? In this 2022 study, T-Few's 11B model achieved 72.4% accuracy vs. 66.6% for GPT-3 175B ICL, while the authors estimated roughly three orders of magnitude fewer FLOPs per inference.
Liu et al., Few-Shot Parameter-Efficient Fine-Tuning is Better and Cheaper than In-Context Learning, NeurIPS 2022. NeurIPS-2022-few-shot-parameter…