Question · Voice and AI
Do longer prompts get better AI answers?
Often, yes, but only when the extra words add something the model needs, such as background, constraints or an example. Repetition and filler do not help, and very long inputs can lose accuracy, especially when the key detail sits in the middle.
Updated October 17, 20263 min read6 cited facts, each traced to its source
Often, yes, but only when the extra words add something the model needs. Background, constraints and examples help. Repetition and filler do not. Very long inputs can also lose accuracy, especially when the key detail sits in the middle, so length helps only up to a point.
Longer prompts help when they add information the model needs
A 2025 study of domain-specific tasks found that longer prompts generally improved model performance, while shorter prompts could make it worse 1. The longer versions added background knowledge. Even with that knowledge, the models still struggled with challenging domain-specific tasks 2. Background is useful, but it does not turn a hard task into an easy one.
The useful additions are the ones a capable person would need before doing the job well: who the answer is for, what you have already tried, what a good result looks like, and what must not change. Each one is a fact or a constraint the model cannot guess.
Padding adds words without adding information
The study's result is about background knowledge, not word count. A prompt that restates the request three times, or ends with "please make sure it is really good," has more words and no more facts. Anthropic's guidance for Claude says the more precisely you explain what you want, the better the result 3. Precision is the goal, and length is only a side effect of it when the precise detail is long.
Very long inputs can bury the detail that matters
Length has a cost. In tests on long inputs, language model accuracy was highest when the relevant information sat at the start or the end of the input, and dropped significantly when it sat in the middle 4. A 2025 technical report from the company Chroma found that, across all its experiments, model performance consistently degrades with increasing input length 5. That report uses simple tasks, not chat prompts, so read it as a warning about long input rather than a measure of how much a typical prompt will lose.
Layout changes the answer as well
In few-shot prompts that differed only in formatting, LLaMA-2-13B's accuracy varied by up to 76 accuracy points 6. That study used an open-source model with worked examples, so the size of the effect will not carry over to every chat. The lesson still holds: the same request can get a different answer when the layout changes, so a clear structure is worth a few extra words.
It depends on what the extra words do
| Addition | Does it help? | Why |
|---|---|---|
| Background the model lacks, such as the audience or the project history | Usually | Longer, background-rich prompts generally improved performance in the 2025 domain study |
| Constraints and the output format | Usually | Precise instructions give better results, according to Anthropic's guidance |
| Restated requests and filler phrases | No | They add words but no facts |
| A long pasted document with one question | Depends on placement | Put the question at the start or the end, not buried in the middle |
The table covers the cases the studies address. We found no study that tests whether a short factual question gets a better answer from a longer version, so treat that case as open.
What to do with a long prompt
- Add the facts the model cannot know: the audience, the purpose, what you already tried and what done looks like.
- Cut restatements and filler. Read the prompt once and delete any sentence that adds no fact or constraint.
- Put the question first. When you paste long material, state the question before the material, and repeat it at the end if the answer depends on it. Our suggestion, based on the placement results above.
- Name the output format, such as a list, a table or a word limit.
If your prompt is spoken, the same advice applies, plus a check of the transcript. For the order to say things in, see how to dictate a good prompt. For what happens when a spoken prompt has errors in it, see do AI chatbots understand dictation errors. For the terms used here, see AI prompt and large language model. The wider picture is in our guide to speech to text for AI and our overview of speech to text and AI.
Evidence
Every number on this page, with where it comes from. Open a fact to see the exact words in its source.
- 1.
- 2.
- 3.
- 4.In tests on long inputs, language model accuracy was highest when the relevant information sat at the start or end of the input, and dropped significantly when it sat in the middle.
Nelson F. Liu et al., arXiv (accepted to Transactions of the Association for Computational Linguistics), 2023 · Original
- 5.
- 6.
Go deeper
Related questions
- Can you talk to ChatGPT with voice dictation instead of voice mode?
- Do AI chatbots understand prompts with dictation errors?
- How do you dictate a good prompt for ChatGPT or Claude?
- Are AI summaries of voice recordings accurate?
- Are smart speakers still popular?
- Can AI detectors flag dictated text?
- Can AI dictation run entirely on your own computer?
- Can ChatGPT summarize a voice memo?