AI Model Rankings

We measured every AI model on cleaning up real dictation — quality, speed, and which ones to actually pick.

VivaDicta lets you point AI processing at a lot of different models, and a model name on its own tells you very little about whether it is any good at cleaning up dictation. So we measured them: every model below was sent the same real transcripts through the app's own prompt, and graded on what came back.

The short version: almost any current model is good enough. The top twenty score between 9.2 and 9.7, which is close enough to be a tie. What actually separates them is speed, and whether they quietly do something wrong.

Our picks

gemini-3.8-flash - the best results of anything measured, 9.7 quality at 0.9s.

gpt-5.4-mini - the same 9.7 at 0.9s, and one of the cheaper models OpenAI sells. Pick whichever account you already have.

grok-4.20-non-reasoning - 9.6 at 0.8s. With reasoning off there is no thinking pause before the text comes back, so it feels immediate even on long dictation.

qwen-3.8-27b on Cerebras - the quickest thing here, 9.2 at 0.3s, and what VivaDicta now selects by default on Cerebras. It replaces gemma-4-31b, which scored higher (9.6 at 0.29s) but which Cerebras retired from its public endpoints in September 2026, so it has been dropped from the table below. Cerebras asks for an account with a payment method before it hands out an API key, but you can delete the card again straight after signing up, so nothing can ever be charged - and the $5 signup credit it gives you lasts a very long time at dictation-sized requests.

mistral-medium-latest - free with nothing but an account: no card, no credit to spend down. 9.4 at 0.4s, which makes it the easiest of the free picks to get running.

gemma4:31b on Ollama Cloud - another free option. 9.4 at 0.6s.

claude-haiku-4-5 or gemini-3.1-flash-lite - if you already have credit with Anthropic or Google, both are sub-second and score 9.4-9.5.

How this was measured

Each model was given five raw dictation transcripts through the exact prompt VivaDicta sends, and graded on four things: whether it returned only cleaned text (rather than answering a question it was asked to clean up), whether every name and number survived, how well it removed fillers and stutters, and formatting. Obedience is weighted hardest - a model that replies to your dictation instead of tidying it is useless here, however good it sounds.

The cases deliberately target the hard parts: a speaker correcting themselves mid-sentence, a transcript that is entirely a question, technical terms and numbers, a spoken list, and non-English text.

Speed is the median of three runs. Value combines quality and speed as (2 × quality + speed) / 3, with speed on a curve - under a second is indistinguishable while you wait, and past about eight seconds you have already given up. Cost is not part of the score.

Full ranking

60 models, sorted by value - tap Quality, Speed or Value to re-sort. Graded by claude-opus-5 over 5 cases. Latest batch added October 3, 2026; older rows may have been measured earlier.

One row per model. Where a gateway resells weights already listed - the same claude-haiku-4.5 through Vercel AI Gateway and OpenRouter as well as Anthropic - only the best-scoring row is kept, so a long table is a list of things to choose between rather than the same model billed three ways. Two providers running the same open weights on their own hardware, like Cerebras and Groq with Qwen, both keep a row: those are separate measurements.

#ProviderModel
1Geminigemini-3.8-flash9.70.9s9.8
2OpenAIgpt-5.4-mini9.70.9s9.8
3OpenAIgpt-4.1-mini9.60.7s9.7
4Anthropicclaude-haiku-4-59.50.7s9.7
5Grok (xAI)grok-4.20-non-reasoning9.60.8s9.7
6OpenAIgpt-5.49.50.8s9.7
7Geminigemini-3.7-flash9.50.9s9.7
8Geminigemini-3.5-flash9.60.9s9.7
9Mistralmistral-medium-latestFree tier9.40.4s9.6
10Ollama Cloudgemma4:31bFree tier9.40.6s9.6
11Geminigemini-3.5-flash-lite9.40.7s9.6
12Geminigemini-3.1-flash-lite9.40.9s9.6
13OpenAIgpt-5.59.40.9s9.6
14Cerebrasqwen-3.8-27bFree tier9.20.3s9.5
15OpenAIgpt-5.6-terra9.20.9s9.5
16OpenAIgpt-5.6-luna9.30.9s9.5
17OpenAIgpt-5.6-sol9.41.1s9.5
18OpenAIgpt-6-sol9.51.1s9.5
19Anthropicclaude-opus-4-79.51.1s9.5
20Ollama Clouddeepseek-v4-pro:08139.71.2s9.5
21Anthropicclaude-sonnet-4-69.61.2s9.5
22Groqqwen/qwen3.8-27bFree tier9.10.3s9.4
23HuggingFaceopenai/gpt-oss-120bFree tier9.10.5s9.4
24OpenAIgpt-4o-mini9.10.8s9.4
25Groqopenai/gpt-oss-20bFree tier8.90.4s9.3
26Geminigemini-3.6-flash9.21.1s9.3
27OpenCode Goglm-5.3-flash9.51.3s9.3
28Groqopenai/gpt-oss-120bFree tier8.80.5s9.2
29Cerebrasgpt-oss-120bFree tier8.70.3s9.1
30Ollama Cloudgpt-oss:120bFree tier8.70.8s9.1
31OpenAIgpt-6-luna9.41.5s9.1
32Anthropicclaude-opus-59.61.7s9.1
33OpenAIgpt-6.1-sol9.61.7s9.1
34Ollama Cloudkimi-k2.7-code9.31.5s9.0
35Ollama Clouddeepseek-v4-flash:07319.72.0s9.0
36Mistralmistral-small-latestFree tier8.40.5s8.9
37Anthropicclaude-sonnet-59.52.0s8.9
38Grok (xAI)grok-4.39.82.5s8.9
39Ollama Cloudglm-5.3-flash9.21.8s8.8
40Ollama Cloudglm-5.29.62.3s8.8
41OpenCode Goglm-5.39.72.4s8.8
42Anthropicclaude-opus-5-59.62.4s8.8
43Grok (xAI)grok-4.79.72.5s8.8
44Ollama Cloudgpt-oss:20bFree tier8.91.6s8.7
45Ollama Cloudmistral-large-3:675b7.90.9s8.6
46Ollama Cloudnemotron-3-nano:30bFree tier8.71.6s8.5
47Ollama Cloudnemotron-3-superFree tier8.41.5s8.4
48OpenCode Gominimax-m39.32.7s8.4
49OpenAIgpt-5.4-nano7.40.9s8.3
50OpenCode Gokimi-k39.74.3s8.2
51Ollama Cloudminimax-m2.79.23.3s8.1
52OpenCode Goqwen3.8-max9.74.5s8.1
53Ollama Cloudminimax-m3Free tier8.82.9s8.0
54Ollama Cloudkimi-k39.75.1s8.0
55Geminigemini-2.5-pro9.55.5s7.7
56Grok (xAI)grok-4.69.76.6s7.6
57Geminigemini-2.5-flash-lite6.20.8s7.5
58Ollama Cloudglm-5.19.78.0s7.3
59Ollama Cloudkimi-k2.69.69.7s6.8
60Ollama Cloudnemotron-3-ultraFree tier9.140.0s6.1

Tap a column heading to re-sort. Free tier marks models you can run without paying, though the terms differ: Groq is free forever with rate limits, Mistral and HuggingFace give you a monthly allowance, Cerebras gives $5 of credit but needs a card on file first, and on Ollama Cloud only some models are free — those we verified against a free key rather than trusting the vendor's tier list.

What the numbers do not tell you

These are 60 models measured for VivaDicta, not every model the apps offer. Newly measured models may appear here before an app update makes them selectable. A model missing from this table was either not measured or is the same weights as a row above, reached through a different gateway - neither is a verdict on it.

Scores within about 0.3 of each other are ties. Five cases graded by a single model is enough to separate good from broken, not enough to rank 9.6 above 9.5 with a straight face.

Speed depends on where you are. These were measured from one machine on one network. The ordering held up across runs; the exact seconds will not match what you see.

Two things models get wrong regardless of score. Several ignore the instruction to avoid the Russian letter "ё", and several use em-dashes despite being told not to. Both show up in models that otherwise score well.

Where this runs in the app

Pick a model under AI Providers - on macOS a shortlist is listed there directly: the best model from each provider, so the list shows what you could set up rather than repeating one you have already seen. Once a provider is configured you can set a different model per Viva Mode, so a fast cheap model can handle everyday dictation while something stronger handles the work that needs it.