What is a small language model SLM?
Small Language Models SLMs: The Next Frontier For The Enterprise For example, with a parameter budget of approximately one billion parameters, OpenELM exhibits a 2.36% improvement in accuracy compared to OLMo while requiring 2 times fewer pre-training tokens. As