DavidGadyan

AI Engineering

Which LLM Should You Use? GPT, Claude, Gemini, Grok, Qwen, DeepSeek

By David Gadyan · Published · 20 min read

Eight logo tiles, OpenAI, Claude, Gemini, Grok, Mistral, Meta, Qwen and DeepSeek, on a dark grid with the title "Which LLM should you use? Nine model families, one job each"

There is no best LLM, only the right model for each workload. This post compares the nine model families that matter in November 2026, OpenAI, Anthropic, Google, xAI, Meta, Mistral, Alibaba Qwen, DeepSeek and Microsoft Decision-1, in thirteen tables: flagships and cheaper tiers, prices, context windows, open weights, the use cases each one fits, proprietary API against self-hosted weights, dense, mixture-of-experts, reasoning and decision architectures, and a router that sends every task to the cheapest model that does it well.

A client asked me last month which model their new assistant should call: GPT, Claude, Gemini, or "one of the open ones". The honest answer is a table, not a name. Every family on the market is optimised for a different workload, and the cheapest way to build a good system is to understand which model to use for which job, how to combine them, and when self-hosting beats an API.

This post is the comparison I wish I had on that call. It covers the nine families that matter in November 2026: OpenAI GPT, Anthropic Claude, Google Gemini, xAI Grok, Meta (Llama and now Muse), Mistral, Alibaba Qwen, DeepSeek, and Microsoft Decision-1, a new kind of model that deserves its own post. It continues the series that started with Snowflake vs Databricks and Azure, Fabric, Databricks or Foundry, and it ends with the routing code I actually use.

The short answer

Pick by job, not by brand. For general agents and tool calling, start with GPT or Claude. For software engineering agents, Claude first. For images, video and very large document sets, Gemini. For real-time social and market signals, Grok. For anything that must stay on your own hardware, Qwen, DeepSeek, Llama or Mistral on vLLM. For classification, routing and grading at volume, Microsoft Decision-1. Then benchmark two candidates on your own data, because every claim below is a vendor's claim until your evaluation set says otherwise.

Everything here was checked on 6 November 2026 against the vendors' model pages and the AI Board research report of 26 October 2026, which lists a vendor source per line. Prices are public list prices per million tokens, input then output, excluding volume discounts and batch rates.

Why is there no single best LLM?

Because the families are optimised for different things. Some lead at complex reasoning and mathematics; some at reading and editing large codebases; some at video, audio and million-token documents; some at being cheap and fast for high-volume production work; and some publish their weights so you can run them on a GPU you control. A model that tops one of those lists is rarely first on the others, and the price spread between the top and the mid tier is five to ten times.

There are three kinds of provider, and the distinction matters more than any benchmark:

CategoryProvidersWhat you get
Proprietary, commercial APIOpenAI, Google, Anthropic, xAI, MicrosoftManaged inference, the strongest models, tool calling, no hardware to run
Open-weightAlibaba Qwen, DeepSeek, Meta, Mistral, OpenAI gpt-oss, NVIDIA NemotronWeights you download and serve yourself; customisation and data control
Enterprise platformsMicrosoft Foundry, Amazon Bedrock, Gemini Enterprise Agent PlatformOne contract and one identity system for several vendors' models, plus evaluation and governance

Open-weight does not mean open-source. Qwen and DeepSeek publish weights, but the licence, the training data and the commercial-use conditions differ per release, and some families publish only their smaller models.

Which flagship models are current in November 2026?

One flagship per lab, as the labs describe them. The EU column says whether the vendor documents a route to processing inside the European Union, which decides the question for many of my clients before quality does.

LabFlagshipReleasedContext windowOpen weightsList price (in / out, per 1M)EU route
OpenAIGPT-6 Astra3 Sep 20261,050,000No$10 / $50Yes, OpenAI EU processing with MAM or ZDR approved
AnthropicClaude Fable 5.11 Sep 20261,000,000No$10 / $50Yes, Google Cloud eu multi-region
GoogleGemini 4 Argon13 Oct 20261,048,576No$2 / $10 (introductory)Yes, Google Cloud eu multi-region
xAIGrok 4.721 Sep 2026500,000No$2 / $6No documented EU endpoint
MetaMuse Wonder12 Oct 20261,000,000No$4 / $20No documented EU residency
DeepSeekDeepSeek-V4-Pro13 Aug 20261,000,000Yes, MIT$1.32 / $3.96 (peak; half off-peak)Self-hosted or EU GPU rental
Mistral AIMistral Medium 3.528 Apr 2026256,000Yes, modified MIT$1.50 / $7.50Yes, Mistral Regional Endpoints in Europe
AlibabaQwen3.8-Max3 Aug 20261,000,000Open build under a custom licence$2 / $6Alibaba Cloud Model Studio, Frankfurt
MicrosoftMicrosoft Decision-1 (decision model, not an LLM)9 Oct 202632,768 inputNo$0.042 / freeThrough Microsoft Foundry; check the deployment regions

Three things to read off that table. The million-token window is now the norm at the top: six of the eight language-model flagships publish one million tokens or more. The price gap between the two most expensive flagships and DeepSeek is about eight times. And the newest OpenAI flagship reached a documented EU route only in late October, with conditions, while its previous generation had been in nine European Azure regions for months: the residency rule narrows your model choice, so check the specific model, not the vendor.

Which cheaper tiers sit under each flagship?

Most production traffic should not run on a flagship. These are the tiers I evaluate first, with their published prices.

FamilyMid tierSmall and fastNotes
OpenAIGPT-6.1 Terra, $1 / $5, 1,050,000 tokens (26 Oct 2026); GPT-6 SolGPT-5.6 Luna, $0.20 / $1.20Terra is priced at half of GPT-5.6 Terra; Luna is the fast tier for drafting and summarising
AnthropicClaude Opus 5.5, $4 / $20 (22 Sep); Claude Sonnet 5.5, $2 / $10 (28 Sep)Claude Haiku 5.5 (7 Oct)Anthropic names Opus 5.5 the starting point for most workloads and Sonnet 5.5 the successor to Sonnet 4.5
GoogleGemini 3.8 Flash, $0.75 / $3.75 introductory until 31 Dec 2026, then $1.50 / $7.50Gemini 3.5 Flash-Lite, $0.30 / $2.50Budget for the post-January price
xAIGrok 4.6, $2 / $6Grok 4.3, $1.25 / $2.50Above 200K tokens the Grok rate doubles
MetaMuse Spark 1.3, $1.25 / $4.25Muse Glimmer 30B, open weights, Apache-2.0Muse Spark Open (15 Oct 2026) adds open weights to the Spark line; Llama 4 stays downloadable
DeepSeekDeepSeek-V4-Flash, $0.44 / $1.32; V4.1-Flash (10 Sep 2026)Same model, off-peak at half priceMIT weights for both V4 sizes
Mistral AIMistral Large 3, $0.50 / $1.50, Apache-2.0; Mistral Large 4 in public preview since 6 Oct 2026Mistral Small 4, $0.15 / $0.60, Apache-2.0Large 3 is cheaper than Medium 3.5 despite the name
AlibabaQwen3.8-Flash, $0.15 / $0.47Qwen3.8-27B, open weights, Apache-2.0, 262,144 tokens nativeThe 27B is the most practical open model for a single data-centre GPU

What is each model family best at?

This is positioning from my own projects and reading, not a measured ranking. Treat every row as the first candidate to evaluate, not the winner.

FamilyStrongest atTypical use cases
OpenAI GPTGeneral-purpose reasoning, tool calling, multimodal input, the broadest ecosystemAI agents, RAG, coding assistants, financial analysis, document processing, workflow automation
Anthropic ClaudeSoftware engineering on large codebases, following long instructions, document analysisCoding agents, code review, architecture analysis, legal documents, complex business workflows
Google GeminiVideo, audio and image understanding, million-token documents, Google Cloud and BigQuery integrationVideo analysis, OCR pipelines, document intelligence, multimodal RAG, large-scale data analysis
xAI GrokReal-time information from the X ecosystem, current discussions and trendsSocial sentiment, cryptocurrency and market monitoring, breaking-news analysis, trend detection
Alibaba QwenThe widest open-weight line: sizes from 0.6B to 2.4T, coder, vision, omni, embedding and reranker variantsPrivate RAG, custom chatbots, local inference, document extraction, fine-tuned domain models
DeepSeekCost-efficient reasoning and coding; mixture-of-experts at frontier scale with MIT weightsCode generation, mathematical reasoning, data analysis, autonomous agents, private inference
Meta Llama and MuseSelf-hosting and fine-tuning (Llama 4, Muse Glimmer 30B, Muse Spark Open); Muse Wonder through the Meta Model APIPrivate deployments, internal chatbots, fine-tuned enterprise models
Mistral AIEfficient European models with EU endpoints; Codestral and Devstral for code, Pixtral for vision, Mistral OCR for documentsEuropean enterprise AI, coding agents, document extraction, sovereignty-first deployments
Microsoft Decision-1Fast, calibrated decisions over fixed options; not a chatbotAgent routing, classification, prioritisation, grading AI answers, workflow control

Other families worth knowing: Moonshot Kimi K3 (reasoning and agents, 1,048,576-token window), Zhipu GLM-5.3 (reasoning and coding, MIT weights on GLM-5.2), Cohere Command A+ (Apache-2.0 weights, strong embeddings and rerankers for enterprise RAG), NVIDIA Nemotron 3 Ultra (open weights for enterprise inference) and Amazon Nova (the AWS native line, the only models in the AWS European Sovereign Cloud at the September 2026 check).

Proprietary API or self-hosted open weights?

This is the biggest architectural decision, bigger than the choice of model. Figure 1 shows both routes and the multi-model stack that combines them; tap a layer to read what it does.

Your code calls OpenAI, Anthropic, Google or xAI directly, or the same models through Microsoft Foundry, Amazon Bedrock or Gemini Enterprise Agent Platform. The provider runs the GPUs.

Typical use: Most products: fastest to ship, strongest models, no hardware to run; you pay per token and your data leaves your network under a contract.

Tap a layer to read what that technology does in this stack.

Proprietary API. Your code calls OpenAI, Anthropic, Google or xAI directly, or the same models through Microsoft Foundry, Amazon Bedrock or Gemini Enterprise Agent Platform. The provider runs the GPUs. Typical use: Most products: fastest to ship, strongest models, no hardware to run; you pay per token and your data leaves your network under a contract.
LayerTechnologyWhat it does
Your applicationNext.js, FastAPIThe product the user sees and the API that serves it.
OrchestrationLangGraph, MCP toolsAgent loops, tool calling and state live in your code, whichever model answers.
ModelsGPT-6 Astra, Claude Fable 5.1, Gemini 4 Argon, Grok 4.7The current flagships of OpenAI, Anthropic, Google and xAI as of 6 November 2026, each behind its own API; cheaper tiers sit under each one.
Enterprise platform (optional)Microsoft Foundry, Amazon Bedrock, Gemini Enterprise Agent PlatformOne contract, one bill and one identity system for several vendors’ models, plus evaluation and governance.
RetrievalPostgreSQL + pgvector, Azure AI SearchThe documents the model is allowed to read, chunked, embedded and indexed on your side.
InfrastructureProvider GPUs, Your containersNo GPUs of your own: you run the application containers, the vendor runs inference.
EvaluationMLflow, Golden test setThe same questions and documents run against every candidate model before and after each vendor release.
Security and dataAPI keys in a vault, Data processing agreementZero data retention or regional processing is a contract setting, not a default: ask for it in writing.
Self-hosted open weights. You download published weights and serve them on GPUs you control, with vLLM, SGLang or Ollama. No per-token bill, full control of the data path, and all the operations. Typical use: Private or regulated data, fine-tuned models, predictable high volume, or a residency rule that no vendor endpoint meets.
LayerTechnologyWhat it does
Your applicationNext.js, FastAPIUnchanged: the application talks to an OpenAI-compatible endpoint that happens to be yours.
OrchestrationLangGraph, MCP toolsSame agent code as the API route; only the base URL changes.
Inference servervLLM, SGLang, OllamaBatching, KV cache, quantisation and an OpenAI-compatible API; Ollama for a laptop or a single box, vLLM or SGLang for production throughput.
Open-weight modelsQwen3.8-27B, DeepSeek-V4-Flash, Llama 4, Mistral Medium 3.5, gpt-ossWeights you can download: Apache-2.0 (Qwen3.8-27B), MIT (DeepSeek V4), the Llama 4 community licence, Mistral’s modified MIT. Read the licence before the model card.
GPUsNVIDIA GPUs, AWS / Azure / GCP GPU instances, On-premisesRented GPU instances in a region you choose, or your own servers; capacity planning becomes your job.
RetrievalPostgreSQL + pgvector, Open embedding model (bge-m3)Embeddings also run locally, so no document ever leaves the network.
EvaluationMLflow, Golden test setFine-tunes (LoRA, QLoRA) are only worth it if this test set says so.
OperationsKubernetes, Monitoring, Patching and upgradesScaling, monitoring, security patches and model upgrades: the hidden cost of the no-token-bill route.
Multi-model routing. One application, several models: a cheap decision model classifies and routes, a reasoning model handles the hard steps, a multimodal model reads images, open weights serve the private parts. Typical use: An enterprise assistant that reads documents, answers customers, runs workflows and has to stay cheap at volume.
LayerTechnologyWhat it does
RequestCustomer, employee or APIEvery request enters through the same door, whatever it needs.
Decision and routingMicrosoft Decision-1Intent, priority and the route, as calibrated probabilities over fixed options, in one cheap single-pass call; a low top probability sends the case to a person.
Reasoning and codeClaude Opus 5.5, GPT-6 SolMulti-step analysis, planning and code generation, where the expensive tokens earn their keep.
Images, video and documentsGemini 4 Argon, Azure AI Document IntelligenceScanned invoices, screenshots and video go to a multimodal model or a document service, not to the text router.
Private inferenceQwen3.8-27B on vLLM, DeepSeek-V4-FlashSensitive fields and bulk extraction stay on your GPUs.
Real-time signalsGrok 4.7Social and market chatter when the use case needs what is happening now.
Retrieval and toolsVector store, SQL, CRM / ERP APIsFacts come from your systems; the models only read and act on them.
VerificationMicrosoft Decision-1, LLM judgeApprove, reject or escalate each generated answer or action against a rubric before anything is executed.
ExecutionWorkflow (n8n, queue), Human approvalUpdate the CRM, send the notification, create the report; writes that matter wait for a person.
Figure 1. Three ways to put a model behind an application: a proprietary API, self-hosted open weights, and the multi-model routing stack that uses both. The application and the orchestration layers are identical; only the base URL changes.
QuestionProprietary APISelf-hosted open weights
HardwareNone of yours; the vendor runs the GPUsNVIDIA GPUs you rent or own, sized by you
Cost modelPer token; flagships $2 to $10 per million inputGPU hours plus operations; no per-token bill from a vendor
Model qualityThe strongest modelsA generation behind at the top, equal in the mid tier (Qwen3.8-27B, DeepSeek-V4-Flash, Mistral Medium 3.5)
Data pathLeaves your network under a data processing agreement; zero retention and regional processing are contract settingsNever leaves your VPC; embeddings run locally too
CustomisationPrompting, structured outputs, limited fine-tuningFull fine-tuning (LoRA, QLoRA), custom serving, quantisation
OperationsRate limits and provider availability are theirsScaling, batching, monitoring, patching and upgrades are yours
Switching costLow behind an abstraction layerLow too: vLLM and SGLang expose OpenAI-compatible endpoints

What can you run on a 16 GB GPU?

A rule of thumb for a laptop with 16 GB of GPU memory, before production sizing. Memory depends on quantisation, context length, KV cache and architecture, so treat these as orders of magnitude.

Model sizeOn a 16 GB GPU
1B to 3BVery comfortable, full precision
7B to 8BPractical at 16-bit, roomy at 8-bit
14BPractical with 4-bit quantisation and a modest context
32BSignificant quantisation or CPU offloading compromises
70B and aboveNot practical in GPU memory; use a server or an API

For production you would not use a laptop anyway: vLLM or SGLang on dedicated GPU instances, with batching and the KV cache tuned for your context lengths.

Dense, mixture of experts, reasoning or decision model?

Not every model works the same way, and the architecture decides memory, latency and what the model is good for. Figure 2 puts the four kinds side by side.

Four kinds of model: dense, mixture of experts, reasoning, decision Dense All parameters work on every token. Simple to serve and to fine-tune. Qwen3.8-27B Mistral Medium 3.5 (128B) Mixture of experts A router sends each token to a few experts. Huge total size, small active size per token. DeepSeek-V4-Pro: 1.6T total, 49B active per token Reasoning Works through the problem before answering. Built into every 2026 flagship; effort is a dial. GPT-6 Astra, Fable 5.1, Gemini 4 Argon, Grok 4.7 Decision model Scores a fixed set of options with calibrated probabilities. No text, one pass, cents per million. Microsoft Decision-1 (post-trained Qwen3.5-9B) The categories overlap: DeepSeek-V4-Pro is a mixture of experts and a reasoning model. Open weights or proprietary API is a separate axis: any of the four can be either. Sizes from the vendors' model cards on Hugging Face and Microsoft Learn, read on 6 November 2026.
Figure 2. Four kinds of model. A dense model activates every parameter per token; a mixture of experts routes each token to a few experts; a reasoning model works through the problem before answering; a decision model scores fixed options with calibrated probabilities and writes no text.
ArchitectureWhat happens per tokenMemory and latencyBest application
DenseEvery parameter participates; a 27B model computes 27B weights per tokenMemory equals the parameter count; latency grows with sizeGeneral inference, simple serving, fine-tuning (Qwen3.8-27B, Mistral Medium 3.5)
Mixture of experts (MoE)A router activates a few experts; DeepSeek-V4-Pro has 1.6T parameters in total and 49B active per tokenAll experts must still be loaded, so memory stays large while compute per token stays smallEfficient frontier-scale models (DeepSeek V4, Qwen3.8-Max, Mistral Large 3)
ReasoningThe model spends extra computation working through the problem before the answerHigher latency and cost per answer; effort is adjustable on the 2026 flagshipsMathematics, complex coding, planning, multi-step analysis, agent workflows
DecisionThe model scores a fixed set of options in one pass and returns a probability per optionMilliseconds, no output tokensClassification, routing, prioritisation, grading (Microsoft Decision-1)

The categories overlap: DeepSeek-V4-Pro is a mixture of experts and a reasoning model, and Decision-1 is post-trained from a dense 9B Qwen model.

Which model should you evaluate first for each project?

Starting candidates, not guaranteed winners. The right-hand column is the reason the candidate is on the list.

ProjectFirst models to evaluateWhy
Advanced AI agentsGPT-6 Sol, Claude Opus 5.5Reasoning, tool calling, multi-step execution
Software development agentsClaude Sonnet 5.5 or Opus 5.5, GPT-6.1 Terra, Qwen3-CoderCodebase understanding, editing and refactoring
RAG applicationsClaude Sonnet 5.5, GPT-6.1 Terra, Gemini 3.8 Flash, Qwen3.8-FlashGrounded answers over retrieved passages at mid-tier prices
Video understandingGemini 4 ArgonNative multimodal video processing
Financial analysisGPT-6, Claude Opus 5.5, DeepSeek-V4-ProReasoning and numerical analysis
Cryptocurrency and market intelligenceGrok 4.7, GPT-6, DeepSeekCurrent information plus analytical reasoning
Document processingGemini, GPT-6, Claude, plus Azure AI Document Intelligence or Mistral OCRMultimodal extraction with a document service in front
Private enterprise AIQwen3.8-27B, DeepSeek-V4-Flash, Llama 4, Mistral Medium 3.5Self-hosting and customisation
Customer supportGPT-6.1 Terra, Gemini 3.8 Flash, QwenClassification, response generation, automation
High-volume classificationMicrosoft Decision-1, a small QwenLow-cost structured decisions
Multilingual chatbotGPT, Gemini, QwenMultilingual understanding and generation
Computer-use agentsGPT-6.1 Terra, ClaudeInteracting with software interfaces

How do you route between models in production?

Do not hard-code one model into every feature. A routing layer selects the model per task, and the task type is only the first signal. Mine looks like this in its simplest form:

class ModelRouter:
    """Picks the model per task; the strings are deployment names in Foundry or vLLM."""

    def select_model(self, task: str) -> str:
        if task == "classification":
            return "microsoft-decision-1"
        if task == "complex_reasoning":
            return "gpt-6-sol"
        if task == "coding":
            return "claude-sonnet-5-5"
        if task == "multimodal":
            return "gemini-4-argon"
        if task == "private_inference":
            return "qwen3.8-27b"
        if task == "social_intelligence":
            return "grok-4.7"
        if task == "cost_efficient_reasoning":
            return "deepseek-v4-flash"
        return "gpt-6.1-terra"

In production the router weighs more than the task type:

  1. Expected quality on that task, from your own evaluation set, not a leaderboard.
  2. Price per million tokens, input and output, including cached-input rates where the vendor publishes one.
  3. Token counts of the request: a 300K-token prompt rules out Grok's standard rate and Decision-1's 32K input limit.
  4. Latency requirements: a decision model answers in milliseconds, a flagship reasoning model in seconds.
  5. Context window and whether the usable window is as long as the advertised one.
  6. Data sensitivity: private fields go to the self-hosted route; the rest may use an API under the agreed terms.
  7. Availability of each provider, with a fallback model and a retry policy.
  8. Retirement dates of each model name, so a shutdown becomes a one-line change.

Example: a multi-model invoice pipeline

An accounting application that receives 10,000 invoices a month does not need a flagship for every step. The benefit of a multi-model design is that expensive tokens go only where they earn their keep, and arithmetic goes to Python.

StageModel or toolResponsibility
Document ingestionAzure AI Document Intelligence or Google Document AIOCR and structured extraction
Document understandingGemini 4 Argon or GPT-6.1 TerraUnusual invoice layouts the extraction service missed
Data validationPython and SQLAmounts, VAT and invoice numbers, deterministically
Classification and prioritisationMicrosoft Decision-1Which exceptions need a person, in what order
Complex financial reasoningClaude Opus 5.5 or GPT-6 SolInvestigating unusual transactions
Private processingQwen3.8-27B or DeepSeek-V4-Flash on vLLMSensitive fields that must not leave the network
Final approvalA person, or a controlled workflowAny financial decision that matters

What changed in September and October 2026?

New models arrive every week, and every so often an old one is switched off. These are the releases of the eight language-model labs plus Microsoft between 10 September and 26 October 2026, as listed by the AI Board report of 26 October with a vendor source per line.

DateLabModelWhat it is
26 Oct 2026OpenAIGPT-6.1 TerraFast, efficient model for visual reasoning, computer use and writing; $1 / $5
15 Oct 2026MetaMuse Spark OpenOpen weights, downloadable from Hugging Face, Google Cloud and Microsoft Foundry
13 Oct 2026GoogleGemini 4 ArgonFlagship reasoning model, generally available
12 Oct 2026MetaMuse WonderMeta's most capable Muse model on the Meta Model API
9 Oct 2026MicrosoftMicrosoft-Decision-1Decision-scoring model, generally available in Foundry
7 Oct 2026AnthropicClaude Haiku 5.5The fastest Claude tier
6 Oct 2026MistralMistral Large 4Public preview; open weights announced to follow
29 Sep 2026OpenAIGPT-6.1 SolComplex coding and professional work at a lower cost than GPT-6 Astra
28 Sep 2026AnthropicClaude Sonnet 5.5Successor to Sonnet 4.5; $2 / $10
22 Sep 2026AnthropicClaude Opus 5.5Long-running coding and knowledge work; $4 / $20
21 Sep 2026xAIGrok 4.7Flagship for coding, agents and knowledge work; 500,000 tokens
10 Sep 2026DeepSeekDeepSeek-V4.1-FlashSmallest model of the new generation, reads images; updated 17 Oct

Which models are retiring, and when?

A model is deprecated when the vendor announces an end date and still answers; it is retired on the day every call fails. The notice period is the only window in which a migration is cheap: OpenAI promises at least six months for generally available models, Anthropic at least 60 days, Google Cloud at least 45 days for short-lived models.

DateLabModelsReplacement named by the vendor
23 Oct 2026 (done)OpenAIGPT-4, GPT-4 Turbo, GPT-3.5 Turbo, o1, o1-pro, o3-mini, o4-mini, GPT-4.1 nanoGPT-5.6 Sol, Terra or Luna, per model
30 Nov 2026AnthropicClaude Sonnet 4.5 on Anthropic's own platformsClaude Sonnet 5.5
11 Dec 2026OpenAIgpt-5, gpt-5-mini, gpt-5-nano, gpt-5-pro, o3, o3-proGPT-5.6 Sol, Terra or Luna, per model
14 Jan 2027OpenAIGPT-4o, GPT-4o mini, GPT-4.1, GPT-4.1 miniGPT-6 Luna
1 Apr 2027OpenAIgpt-5.1, gpt-5.3-codex, gpt-5.4-nanoGPT-6 Sol and GPT-6 Luna

Named production models have run twelve to twenty-two months before shutdown. Plan for six to eighteen months of useful life per model version, and keep the evaluation set that chose the model so you can rerun it on the successor.

Which model should you choose?

Figure 3 is the decision flow I walk through with clients. Four questions cover most cases; the footnote covers the rest.

Which model first: a decision flow A fixed set of answers: classify, route, grade? Microsoft Decision-1 a probability per option, cents per million yes no Must the data stay on hardware you control? Open weights on vLLM or Ollama Qwen3.8-27B, DeepSeek-V4, Llama 4, Mistral yes no Images, video or very large document sets? Gemini 4 Argon multimodal; 1,048,576-token window yes no Long agentic coding or hard multi-step reasoning? Claude Opus 5.5 or Fable 5.1, GPT-6 Astra flagship reasoning; try the mid tier first yes no Otherwise: a mid tier. Claude Sonnet 5.5, GPT-6.1 Terra, Gemini 3.8 Flash or Qwen3.8-Flash a fifth of the flagship price or less; the same window as the flagships in most cases Real-time social and market signals: Grok 4.7. Whatever the branch, run one golden set on two candidates first. Model names and prices as published by the vendors on 6 November 2026; they change monthly.
Figure 3. Which model first. Fixed answers go to a decision model; data that cannot leave your hardware goes to open weights; images, video and huge document sets go to Gemini; long agentic coding and hard reasoning go to a flagship; everything else starts on the mid tier.

When not to switch:

  • A new model is rarely a reason to switch. The successor gives different answers on your documents even when it is better; rerun the evaluation set before moving.
  • Do not write "always the latest model" into a policy. The flagship of September 2026 costs eight times more per million input tokens than the flagship of a year earlier.
  • Do not pay for reasoning on grounded summarising. Reasoning helps on open problems and can hurt on tasks where the answer is in the retrieved passage; only your own test tells you which case you are in.
  • Do not send a fixed-option decision to a flagship. A decision model or a small open model does it in milliseconds for cents.

What should an AI architect learn?

The skill is combining models, not calling one API. This is the order I would study in.

SkillWhat to understand
LLM APIsThe OpenAI, Anthropic, Gemini, xAI and DeepSeek APIs, and the Decisions API in Microsoft Foundry
Model servingvLLM, SGLang, Ollama; batching, KV cache, quantisation
Model routingChoosing per task from quality, cost, latency, context, sensitivity and availability
Fine-tuningLoRA, QLoRA, supervised fine-tuning, and when not to bother
RAGEmbeddings, hybrid search, reranking, vector databases, golden test sets
AI agentsLangGraph, tool calling, MCP, human approval gates
EvaluationAccuracy, hallucination, latency and cost per task, tracked per model version
GPU infrastructureCUDA, batching, quantisation, memory planning
Enterprise securityData isolation, access control, governance, residency
Cloud AI platformsMicrosoft Foundry, Amazon Bedrock, Gemini Enterprise Agent Platform

The practical project that teaches all of it: a multi-model enterprise platform with Microsoft Foundry as the model management layer, GPT, Claude and Gemini as external providers, Qwen and DeepSeek on vLLM, Microsoft Decision-1 for routing and classification, LangGraph for orchestration, PostgreSQL with pgvector for retrieval, Redis for caching, FastAPI for the API, Docker and Kubernetes for deployment, and MLflow for evaluation. That is an enterprise architecture, not another chatbot.

Sources

  • AI Board, AI Models for Executives 2026, research report published 8 September 2026 and updated 26 October 2026: the flagship table, the release and retirement lists, prices, context windows and EU routes, each line with the vendor's own source. Read on 6 November 2026.
  • Microsoft Learn, Foundry Models sold by Azure (page dated 21 September 2026, updated 29 October 2026): the Microsoft-Decision-1 entry, and Use the Azure OpenAI Decisions API (21 October 2026).
  • Microsoft, Microsoft-Decision-1: Our model for fast decision-making, announcement of 9 October 2026: base model, price, latency and accuracy claims.
  • Vendor model pages read on 6 November 2026 for the September and October releases: OpenAI (GPT-6.1 Terra), Anthropic (Claude Opus 5.5, Sonnet 5.5, Haiku 5.5), Google (Gemini 4 Argon), xAI (Grok 4.7), Meta (Muse Wonder, Muse Spark Open), DeepSeek (V4.1-Flash), Mistral (Large 4 preview), Alibaba (Qwen3.8-Max, Qwen3.8-27B), with the model cards on Hugging Face for the open-weight sizes and licences.
  • My own study notes of November 2026 on use-case positioning, the routing signals, the invoice pipeline and the learning path, written from the projects on this site. Positioning is my reading, not a measurement; prices and availability change monthly and the vendors' pages are the source of truth.

Questions this answers

Which LLM is the best in 2026?

None is best for everything. As of 6 November 2026 the flagships are GPT-6 Astra (OpenAI), Claude Fable 5.1 (Anthropic), Gemini 4 Argon (Google), Grok 4.7 (xAI), Muse Wonder (Meta), DeepSeek-V4-Pro, Mistral Medium 3.5 and Qwen3.8-Max. The right one depends on the task, the data residency rule, the budget and your own evaluation on your own documents.

What is the difference between an open-weight and an open-source model?

An open-weight model publishes the trained weights so you can download and run it; the training data and code usually stay closed, and the licence may limit commercial use. Qwen3.8-27B and Muse Glimmer 30B are Apache-2.0, DeepSeek-V4 is MIT, Mistral Medium 3.5 uses a modified MIT licence with revenue exceptions, Qwen3.8-Max a custom licence.

Which model is best for coding agents?

Claude is the family most teams start with for agentic software work (Claude Opus 5.5 and Sonnet 5.5), with GPT-6 Sol and GPT-6.1 Terra as the usual second candidate and DeepSeek or Qwen3-Coder when the code must stay on your own GPUs.

Which model should I use for RAG?

Any current mid-tier model answers well over retrieved passages: Claude Sonnet 5.5, GPT-6.1 Terra, Gemini 3.8 Flash or Qwen3.8-Flash. The retrieval quality matters more than the model, so build the golden test set first and compare two candidates on it.

Can I run an LLM on a laptop with a 16 GB GPU?

Models up to about 8 billion parameters run comfortably; 14 billion works with 4-bit quantisation and a modest context; 32 billion needs heavy quantisation or CPU offloading; 70 billion does not fit in GPU memory. Production inference belongs on dedicated GPU servers with vLLM or SGLang.

What is Microsoft Decision-1 and is it an LLM?

It is a decision-scoring model Microsoft announced on 9 October 2026, post-trained from Qwen3.5-9B. It does not generate text: you give it a text and a fixed set of options and it returns a calibrated probability per option, at $0.042 per million input tokens with free output. Use it for classification, routing, prioritisation and grading, not for writing.

Should I use a proprietary API or self-host open weights?

Start with an API unless a rule forbids it: no GPUs to run, the strongest models, easy switching behind an abstraction layer. Self-host when the data must stay on hardware you control, when you fine-tune, or when volume is high and predictable enough that renting GPUs beats the token bill. Many systems do both.

How do I avoid being broken by a model retirement?

Keep a list of every model name your code calls with an owner per name, subscribe those owners to the deprecation pages of OpenAI, Anthropic and Google Cloud, rerun your evaluation set on the successor before the shutdown date, and route through one abstraction so a model name is changed in one place.

Why did Meta replace Llama with Muse?

In spring 2026 Meta shipped Muse Spark as its first frontier model without open weights, then Muse Wonder on 12 October 2026 and, on 15 October, Muse Spark Open with open weights. Llama 4 weights remain downloadable under the Llama 4 community licence; the Llama line is still the one most self-hosted deployments run.

Tags:llmopenaiclaudegeminigrokqwendeepseekllamamistralmicrosoft decision-1ai agentsmodel routing

Related projects

Need something like this built? See my Services · Portfolio

← All articles