Model comparison

Amazon Nova Micro vs Devstral Small 2505

Devstral Small 2505 is the stronger model overall, scoring 34.3 to 30.4 on the Noometry Index. Amazon Nova Micro costs 2.4× less per token, which makes it the better buy when Devstral Small 2505's lead doesn't matter for your workload.

Last verified . 0 shared benchmarks.

Amazon Nova Micro Amazon

30.4

Rank #294 Confirmed

Devstral Small 2505 Mistral AI

34.3

Rank #233 Reported

Summary

  • The widest gap is in coding, where Devstral Small 2505 leads 38.9 to 30.5.
  • Amazon Nova Micro is cheaper at $0.035 / $0.14 per million input/output tokens, against $0.10 / $0.30 for Devstral Small 2505.
  • Devstral Small 2505 has downloadable open weights; the other is API-only.

Side by side

Amazon Nova Micro and Devstral Small 2505 specifications
Amazon Nova MicroDevstral Small 2505
ProviderAmazonMistral AI
Noometry Index30.434.3
Released2024-12-032025-05-07
WeightsProprietaryOpen
Context window128K128K
Max output10K128K
Input $ / M tokens$0.035$0.10
Output $ / M tokens$0.14$0.30
Results tracked324

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Devstral Small 2505 leads

Amazon Nova Micro: 30.5 (#295), Devstral Small 2505: 38.9 (#166)

Coding benchmarks
BenchmarkAmazon Nova MicroDevstral Small 2505
SWE-bench Verified (bash only)—56.4%
SciCode—28.8%
LiveBench Coding20.2%—
LMArena Coding1218—

Agentic & Tool Use Not comparable

Amazon Nova Micro: 22.1 (#132), Devstral Small 2505: —

Agentic & Tool Use benchmarks
BenchmarkAmazon Nova MicroDevstral Small 2505
Berkeley Function Calling Leaderboard22.3%—

Reasoning Devstral Small 2505 leads

Amazon Nova Micro: 17.4 (#294), Devstral Small 2505: 19.7 (#252)

Reasoning benchmarks
BenchmarkAmazon Nova MicroDevstral Small 2505
Kagi LLM Benchmark—37.7%
CritPt—0%
LiveBench Reasoning25.1%—
LMArena Hard Prompts1191—
LiveBench Data Analysis34%—
LiveBench29.6%—

Math Not comparable

Amazon Nova Micro: 26.9 (#254), Devstral Small 2505: —

Math benchmarks
BenchmarkAmazon Nova MicroDevstral Small 2505
Omni-MATH21.4%—
LiveBench Math34.5%—
LMArena Math1206—

Knowledge Not comparable

Amazon Nova Micro: 29.6 (#237), Devstral Small 2505: —

Knowledge benchmarks
BenchmarkAmazon Nova MicroDevstral Small 2505
MMLU-Pro51.1%—
Vectara Hallucination Rate5.5%—
GPQA (HELM)38.3%—
LMArena Expert1184—
MMLU70.8%—

Multilingual Not comparable

Amazon Nova Micro: 36.5 (#239), Devstral Small 2505: —

Multilingual benchmarks
BenchmarkAmazon Nova MicroDevstral Small 2505
LMArena Non-English1186—
LMArena Chinese1209—
LMArena French1238—
LMArena German1192—
LMArena Japanese1154—
LMArena Korean1150—
LMArena Russian1185—
LMArena Spanish1225—

Instruction Following Not comparable

Amazon Nova Micro: 56.3 (#272), Devstral Small 2505: —

Instruction Following benchmarks
BenchmarkAmazon Nova MicroDevstral Small 2505
LiveBench Instruction Following48%—
IFEval76%—
LMArena Instruction Following1174—

Long Context Not comparable

Amazon Nova Micro: 36.5 (#229), Devstral Small 2505: —

Long Context benchmarks
BenchmarkAmazon Nova MicroDevstral Small 2505
LMArena Longer Query1205—

Writing & Preference Not comparable

Amazon Nova Micro: 39.5 (#247), Devstral Small 2505: —

Writing & Preference benchmarks
BenchmarkAmazon Nova MicroDevstral Small 2505
LMArena Text1208—
LMArena Creative Writing1172—
WildBench74.3%—
LMArena Multi-Turn1178—
LiveBench Language15.8%—

Frequently asked questions

Is Amazon Nova Micro better than Devstral Small 2505?

Devstral Small 2505 is the stronger model overall, scoring 34.3 to 30.4 on the Noometry Index. Amazon Nova Micro costs 2.4× less per token, which makes it the better buy when Devstral Small 2505's lead doesn't matter for your workload.

Which is cheaper, Amazon Nova Micro or Devstral Small 2505?

Amazon Nova Micro is cheaper. It lists at $0.035 per million input tokens and $0.14 per million output tokens; Devstral Small 2505 lists at $0.10 and $0.30.

Is Amazon Nova Micro or Devstral Small 2505 better for coding?

Devstral Small 2505 scores higher on coding benchmarks: 38.9 versus 30.5 in the Noometry coding category.

Which has the bigger context window?

Both accept 128K tokens.

How many benchmarks do Amazon Nova Micro and Devstral Small 2505 share?

0 benchmarks have published results for both models. Amazon Nova Micro has 32 scored results on Noometry and Devstral Small 2505 has 4.

Related comparisons

Go deeper