Small Language ModelsSmall Language Models: The Cheapest AI Win Most Teams Skip
We were paying a frontier model to answer a yes-or-no question 6,000 times a day. Moving it to a small model cut the cost by 90% and one point of accuracy.
Read MoreThoughts, tutorials and notes on backend engineering & the cloud.
1 article in Small Language Models · Clear filters
Small Language ModelsWe were paying a frontier model to answer a yes-or-no question 6,000 times a day. Moving it to a small model cut the cost by 90% and one point of accuracy.
Read More