SOFT CAT.ai
FIND SOMETHING USEFUL
← Glossary

Zero-Shot

Asking a model to do something without any examples in the prompt.

Zero-shot means asking a model to perform a task without providing any examples in the prompt. You just describe what you want and let the model figure it out from its training. “Classify this review as positive or negative” with no examples is a zero-shot prompt. If you add a few examples first, it becomes few-shot.

Why it matters: Zero-shot performance can be a useful baseline for the system as configured. It shows what the system does without examples in the current prompt. It does not prove where that ability came from. Pre-training, fine-tuning, system instructions, tools, retrieval and earlier task-specific development may all contribute.

When it works: Modern large models handle common tasks well in zero-shot mode: sentiment analysis, summarisation, translation, simple classification, and general question answering. The tasks they struggle with zero-shot tend to be ones requiring specific formats, unusual reasoning patterns, or domain-specific knowledge.

Check what is zero-shot: The term can describe a prompt, a task, an object or an environment. A system may be zero-shot for the evaluation setting while still being fine-tuned for the task. Figure’s Helix 2.5 evaluation, for example, withheld the 30 homes and their objects but adapted the model to three named behaviours using data collected elsewhere. Read the evaluation definition before comparing results.

When to add examples: If zero-shot output is inconsistent or wrong, adding examples (few-shot) is the first thing to try. Even one or two well-chosen examples can dramatically improve results. Think of zero-shot as the starting point and few-shot as the first upgrade when you need better performance.

Editorial review, 5 October 2026: clarified that zero-shot describes the examples withheld from the current prompt, not proof that an ability came only from pre-training. The original publication date is preserved.

Related terms