AI Productivity · Level 3 · Advanced

Choose the Right LLM for the Task

How language models differ in reasoning, coding, speed, context and openness — and how to test two or three of them on your own task.

By 12 min read
How language models differ in reasoning, coding, speed, context and openness — and how to test two or three of them on your own task.

Most people use one AI assistant with its default model for everything: emails, research, spreadsheet formulas, long reports. That works well enough until a task needs more. A model that is excellent at hard analysis can be slow for a quick reply. A fast model can stumble over a tricky calculation. And the model at the top of a ranking may be one that your company does not allow you to use.

This is part 1 of Level 3 in our AI Productivity learning path. Level 3 is about building AI into your work and measuring the results. Here you learn the six ways in which language models differ and how to read our LLM database and its ranking. Then you match tasks to model strengths and test two or three models on your own work. If you want to refresh the basics first, Level 0 explains what a large language model is.

Six ways language models differ

All large language models (LLMs) do the same basic thing: they predict text, piece by piece. Still, they differ in ways that matter for your work. Six differences decide most choices.

Six cards: general capability, reasoning, coding, speed, context window, and open or closed weights, each with a short explanation
Six ways language models differ. Which of them matter depends on your task.

  • General capability. How well a model handles many different kinds of tasks. An overall index sums this up in one number — more on that below.
  • Reasoning. Many current models can reason before they answer. They first work through intermediate steps, often hidden from you, and then write the answer. This takes longer and uses more tokens, but it helps with analysis, planning, math and code. Many assistants let you switch on such a “thinking” mode.
  • Coding. Some models are much better than others at writing and fixing code, spreadsheet formulas and scripts.
  • Speed. Large models are often slower. Many vendors offer a large model plus lighter, faster versions; names like Flash, Mini or Haiku usually mark the lighter ones. If you connect to a model through an API (an interface for software), you pay per token. Lighter versions usually cost less per token.
  • Context window. The amount of text a model can take in at once, counted in tokens — small pieces of words. It decides whether a long report fits in one go. Level 4 shows how to work with long documents.
  • Open or closed weights. A model with open weights can be downloaded and run on your own servers. A closed model can only be used through its maker’s apps or interfaces. This decides where your data goes.

The skill is not to find the one “best” model. It is to know which of these six matter for your task — and to accept a weaker score where it does not matter.

How to read our LLM database and ranking

Our LLM database lists 343 language models, from GPT-2 to today’s models. Each row shows who built the model, when it came out and whether its weights are open. It also shows the overall index, the model’s rank and the number of benchmarks with results. You can filter by organization, year and access and sort by date or index. Tick two to four models to see all their results side by side. From the start page, two more views are one click away. The ranking puts all models with an index on one scale. The benchmark page shows the record results of each test over time.

The overall index is the Epoch Capabilities Index (ECI). It comes from Epoch AI, the research organization whose data our LLM pages use. The ECI combines many benchmark results into one number per model. These eight models lead it right now:

Epoch Capabilities Index: the top 8 models
#ModelReleasedResult
1Claude Opus 5.5 AnthropicSep 22, 2026166.8
2GPT-6 Astra OpenAISep 3, 2026166.4
3GPT-6.1 Sol OpenAISep 29, 2026166.3
4Claude Fable 5.1 AnthropicSep 1, 2026164.7
5Gemini 4 Argon Google DeepMindSep 30, 2026164.6
6Claude Sonnet 5.5 AnthropicSep 28, 2026164.4
7Claude Opus 5 AnthropicJul 24, 2026162.6
8GPT-6 Sol OpenAISep 22, 2026162.6

Combines the results of more than 50 benchmarks into one number per model, so that models can be compared even if they were never tested on the same benchmarks. It is an index, not a percentage: Epoch AI scales it so that Claude 3.5 Sonnet stands at 130 and GPT-5 at 150. Data: Epoch AI, retrieved on October 17, 2026, licensed CC BY 4.0. All models: LLM database.

Read such a list with three questions. How big is the gap? The index is an estimate with a margin of error. Our ranking notes that differences of one or two points are within that margin. When was the model released? A very new model may not have results on every test yet. Can you use it? A top model does not help if your company has not approved it or if it is too slow for your task.

The columns of the database tell you more than the rank:

Choose the Right LLM for the Task
ColumnWhat it tells youWatch out for
ReleasedWhen the model came outVery new models may still lack results on some tests
AccessOpen weights or closed (API or app)Open weights can come with license limits
ECI and rankOverall capability on one scaleGaps of one or two points are within the margin of error
BenchmarksOn how many of our tests the model has resultsA low count means less evidence, not a weaker model
Side-by-side comparisonAll results of two to four modelsCompare scores only within the same benchmark

Match the task to the model’s strengths

The overall index is a good first filter, but it is an average. For a specific task, look at the test that comes closest to it. The table maps common office tasks to what matters most and to the place in our data where you can check it.

Choose the Right LLM for the Task (2)
Your taskWhat matters mostWhere to look in our dataA good place to start
Emails, summaries, rewritesSpeed, tone, your languageNo test fits well — your own test decidesA fast, light model
Analysis, planning, tricky questionsReasoningGPQA Diamond, Humanity’s Last ExamA large model or a thinking mode
Facts and researchCorrect facts, real sourcesSimpleQA Verified (answered without web search)An assistant with web search that shows its sources
Formulas, scripts, codeCodingSWE-bench Verified, Aider PolyglotA model that does well on these tests
CalculationsMulti-step mathFrontierMath, MATH Level 5A thinking mode — then check the numbers
Long documentsContext windowNot in our data — see the vendor’s documentationA model with a large window
Long tasks with many stepsWorking on its ownMETR Time HorizonA top model, with close supervision

For hard expert questions, GPQA Diamond is a good guide. These five models lead it:

GPQA Diamond: the top 5 models
#ModelReleasedResult
1Gemini 4 Argon (high) Google DeepMindSep 30, 202696.4%
2GPT-6 Astra (max) OpenAISep 3, 202695.8%
3Claude Sonnet 5.5 (max) AnthropicSep 28, 202695.6%
4Gemini 3.8 Flash (high) Google DeepMindSep 2, 202695.4%
5GPT-6.1 Sol (max) OpenAISep 29, 202695.4%

198 multiple-choice questions in biology, physics and chemistry at graduate level, written so that non-experts fail even with web access. Guessing gives 25%. Data: Epoch AI, retrieved on October 17, 2026, licensed CC BY 4.0. All models: LLM database.

Compare this list with the overall index above: the order is not the same. Labels such as “(high)” or “(max)” after a name mark the setting of the test run — usually more thinking time. So check which setting you will actually use: a result with maximum thinking time says little about the same model in a quick mode. The figure shows the leaders of six of our tests side by side.

Six tasks, each with the matching benchmark and its current top model, organization and release date: overall, expert questions, facts without web search, math, fixing code and long tasks
The top model on six benchmarks in our LLM database. Data: Epoch AI, CC BY 4.0.

The model at the top of the overall index does not win every test. Some leaders may be older models. That does not always mean the newer ones are weaker. They may simply not have results on that test yet. The Level 4 part on reading benchmarks like an expert explains this and other traps in detail.

Open or closed weights: where your data goes

With a closed model, your prompts and files go to servers run by the vendor or by a cloud provider that offers the model. With an open-weights model, you decide where it runs: on your own servers or with a hosting provider you choose. That is why “open or closed?” is often a question about data protection, not only about quality.

In our database, 172 models have open weights and 160 are closed; for the rest, the access is unknown. The left chart shows how many models of each kind came out per year. The right chart shows the overall index of the strongest open and the strongest closed model of each year.

Left: bar chart of open-weights and closed models per release year in our LLM database. Right: the highest overall index (ECI) of an open and of a closed model per year
Open and closed models per year, and the best overall index of each kind. Models with unknown access are left out. Data: Epoch AI, CC BY 4.0.

The gap between the two points of a year shows roughly how much overall capability you give up when you need open weights. Keep in mind that the database only lists models with benchmark results, so it is not a full count of all models. Here are two closed models from the top of the index next to two strong open-weights models:

Models from our LLM database
ModelReleasedWeightsECIRank
Claude Opus 5.5 AnthropicSep 22, 2026closed166.81
GPT-6 Astra OpenAISep 3, 2026closed166.42
Kimi K3 MoonshotJul 16, 2026open157.417
DeepSeek V4 Pro 0813 DeepSeekAug 13, 2026open155.332

ECI = Epoch Capabilities Index, one overall score across many benchmarks; rank among all models with an ECI. Data: Epoch AI, retrieved on October 17, 2026, licensed CC BY 4.0. All models: LLM database.

Open weights bring more than privacy. The copy you run stays the same: the vendor cannot change or retire it. You can also adapt it to your own data. The costs are real, too: you need suitable hardware, people who can run the model and time for updates. And open weights do not always mean free use: some licenses forbid commercial use or set other limits. Read the license before you build on a model.

Where a model runs also decides who can see your data. In practice, you will meet three ways to use a model:

Three columns: a personal account in an app, a business plan or API, and open weights on your own servers — each with where the data goes and what to check
Three ways to use a language model. Your data decides which one fits, not a ranking.

Test two or three models on your own task

Benchmarks narrow the field; your own test decides. You do not need a lab for that. An afternoon and a shared document are enough.

Four steps: pick one task and five to ten real inputs, run the same prompt on two or three models, score the answers blind, decide and note the date
A model test in four steps. The fastest model that passes is often the best choice.

  1. Pick one real task and five to ten inputs. Choose a task that comes back every week, such as answering one type of customer email. Remove names, numbers and anything confidential from the inputs.
  2. Run the same prompt on two or three models. Keep everything else equal: the same files, the same instructions, the same mode — all with or all without thinking.
  3. Score blind. Copy the answers into a document, label them A, B and C in random order, and judge them before you check which model wrote which. Note the mistakes, the minutes you needed to fix each answer and how long you waited.
  4. Decide and note the date. Vendors update and retire models. When your model changes, run the same test again.

One rule makes the decision easier: take the fastest model that passes your test, not automatically the strongest one. You can run a first test in assistants you may already use. Each runs on its maker’s own models, but each also adds its own instructions and tools, such as web search. So you compare products, not only models.

Short descriptions from our tool comparison, based on the vendors' information — not tested by ABXK.

Level 4 turns this into a full method with a test set, a scoring rubric and repeat tests after every change: test and evaluate your prompts.

Common mistakes when choosing a model

Choose the Right LLM for the Task (3)
MistakeWhy it hurtsBetter
Using the top model of the ranking for everythingSlower, often more expensive and more energy-hungry than needed for simple tasksStart with a fast model; move up only if it fails your test
Choosing by a single benchmarkEach test measures one skillLook at the test closest to your task, and at several
Testing with one exampleOne good answer can be luckUse five to ten real inputs
Knowing which model wrote which answerYou favor the name you expect to winScore blind, then reveal
Checking data rules lastThe best model is useless if you may not use itCheck approval and hosting first
Never testing againVendors update and retire modelsRepeat your test when the model changes

Keep your test inputs, the prompt and your scores in one place. When the next model comes out, you can repeat the test in an hour instead of starting from scratch.

A smaller model that passes your test is also the better choice for the environment: it needs less computing power for every answer. Level 0 shows how large the energy and water footprint of AI has become: what AI can do for your everyday work.