Categories
Machine Learning
SLMs: Achieving 700-Fold Reduction in Model Size, Without Compromising (much) on Performance
Instead of a petabyte-scale data dump, they trained their first model, phi-1, on a tiny, curated dataset. It was composed of two things: heavily…
Read More