Small Models are Enough
- Small models are good enough, often for repetitive or low-intelligence tasks. (
small_good_enough
, 19) - A fine-tuned small model can be better than a big generalist untuned model. (
small_fine_tuned
, 3) - Some think and prefer that small models have less “alignment” than larger models (
small_less_alignment
, 2) - If you break a task into chunks, small models can become very efficient. Related to Model Optimization Strategies. (
small_chunk_work
, 2)