Definition
Fine-tuning is training an existing language model further on a set of examples, usually pairs of inputs and the outputs the business wants, so that the model becomes more likely to produce outputs like them. It builds on the model's original training rather than replacing it: the general ability to write stays, and the examples shift its tendencies towards a style, a structure or a task.
The comparison of retrieval and fine-tuning states the limit plainly: fine-tuning changes the model's tendencies; it does not give it a reliable store of facts. A detail the examples mentioned is held the way everything else the model learned is held, as a compressed pattern.
In practice: style and format learned, facts only as impressions
What fine-tuning is good at follows from what it changes.
- Stable, distinctive style at volume, where prompts and examples have been tried and measured and still fall short.
- Consistent format, such as a fixed set of fields or a house pattern for titles that prompt instructions keep slipping on.
- Shorter prompts at scale, where long instructions in every request add cost or delay.
- Specialised classification into the business's own categories, with many labelled examples available.
What it is poor at is equally predictable. Prices, stock, offers and policies change, and a tuned model goes on reproducing the old version until it is tuned again. It cannot point to a source for an answer. And removing something it has learned, such as a discontinued product, generally means re-tuning rather than deleting a document.
Fine-tuning versus retrieval for brand knowledge
Both approaches aim to make a general model useful for one business. With retrieval, the business's knowledge stays in its documents and is fetched fresh for each answer; with fine-tuning, it is absorbed into the model. The AI foundations hub therefore sends facts that change to retrieval from maintained documents, and the comparison considers fine-tuning only for stable form once retrieval and good prompts have been tried and measured. Most tuned setups still use retrieval for facts.
Vendor language blurs the line. "Trained on your brand", "learns your voice" and "your own AI" can describe retrieval over uploaded documents, a fine-tuned model, saved instructions and examples, or a mix. The guide to choosing and evaluating marketing tools asks which mechanism is meant and what leaving would involve, and the guide to AI disclosure and data privacy adds what the contract should say about how the material supplied is stored, used and deleted. The AI marketing hub places this comparison among the decisions a team makes before relying on a tool.
An estate agency chooses retrieval over a model tuned on old listings
Keyfallow Estate Agents was offered a model fine-tuned on its 2,600 property descriptions from the previous two years. In a trial, the tuned model wrote in the agency's house style far better than the general tool: short openings, room-by-room order, the same closing line. But asked to describe current homes, it echoed asking prices and features from similar past listings, and in 9 of 30 trial descriptions it gave a price band the agency no longer used. The agency chose a retrieval tool that reads each current listing's details from its property system, added 12 approved descriptions as style examples in the instructions, and kept a negotiator's sign-off on every description before it goes live.
Related terms
A Language ModelAn AI system trained on large amounts of text that writes by predicting which piece of text is likely to come next. is what fine-tuning starts from and adjusts. GroundingMaking a language model answer from specified material, such as documents retrieved for the question, rather than from what it absorbed in training. is the alternative for knowledge: it supplies facts at the moment of answering instead of training them in, and it can cite them. Brand VoiceThe consistent personality a brand expresses in its words across channels, with tone adjusting to the situation and the audience. is the most common reason marketers consider fine-tuning, and the voice guide and approved examples are usually tried as instructions first. An EmbeddingA list of numbers that represents a piece of text so that texts with similar meaning sit close together, used for search, retrieval and clustering. is unrelated to training: it represents text by meaning so that retrieval can find the passages a grounded model answers from.
Common confusions
- Fine-tuning teaches the model our facts. It teaches patterns; facts come out as impressions that can be plausible and wrong.
- A tuned model updates itself. Changes need another round of tuning and testing.
- "Trained on your brand" always means fine-tuning. It may mean retrieval, stored instructions or a mix; ask.
- Fine-tuning replaces prompts and review. A tuned model still needs clear requests, and its output still needs checking.
- Fine-tuning and retrieval are rivals. Many setups use tuning for form and retrieval for facts.
