# Amazon Nova Experimental Chat 26 01 10 vs Llama 3.1 Nemotron Ultra 253b v1

> Amazon Nova Experimental Chat 26 01 10 is the stronger model overall, scoring 42.8 to 36.7 on the Noometry Index.

- Canonical page: https://noometry.com/compare/amazon-nova-experimental-chat-26-01-10-vs-llama-3-1-nemotron-ultra-253b-v1
- Last updated: 2026-10-10
- Shared benchmarks: 10

## Summary

- They share 10 benchmarks with published results for both. Amazon Nova Experimental Chat 26 01 10 scores higher in 7 categories and Llama 3.1 Nemotron Ultra 253b v1 in 0 categories; 7 gaps are clear of the uncertainty.
- The widest gap is in multilingual, where Amazon Nova Experimental Chat 26 01 10 leads 50.2 to 43.1.
- Llama 3.1 Nemotron Ultra 253b v1 has downloadable open weights; the other is API-only.

## Snapshot

| | Amazon Nova Experimental Chat 26 01 10 | Llama 3.1 Nemotron Ultra 253b v1 |
|---|---|---|
| Provider | Amazon | NVIDIA |
| Noometry Index | 42.8 | 36.7 |
| Rank | 107 | 213 |
| Context | — | — |
| Input $/M | — | — |
| Output $/M | — | — |
| Weights | Proprietary | Open |

## Coding

- Amazon Nova Experimental Chat 26 01 10: 42.7 (#96)
- Llama 3.1 Nemotron Ultra 253b v1: 38.4 (#177)

| Benchmark | Amazon Nova Experimental Chat 26 01 10 | Llama 3.1 Nemotron Ultra 253b v1 |
|---|---|---|
| LMArena Coding | 1447 | 1312 |

## Agentic & Tool Use

- Amazon Nova Experimental Chat 26 01 10: —
- Llama 3.1 Nemotron Ultra 253b v1: 15.7 (#149)

| Benchmark | Amazon Nova Experimental Chat 26 01 10 | Llama 3.1 Nemotron Ultra 253b v1 |
|---|---|---|
| Berkeley Function Calling Leaderboard | — | 10% |

## Reasoning

- Amazon Nova Experimental Chat 26 01 10: 28.9 (#98)
- Llama 3.1 Nemotron Ultra 253b v1: 26.3 (#134)

| Benchmark | Amazon Nova Experimental Chat 26 01 10 | Llama 3.1 Nemotron Ultra 253b v1 |
|---|---|---|
| LMArena Hard Prompts | 1415 | 1316 |

## Math

- Amazon Nova Experimental Chat 26 01 10: 38.5 (#136)
- Llama 3.1 Nemotron Ultra 253b v1: 37.5 (#152)

| Benchmark | Amazon Nova Experimental Chat 26 01 10 | Llama 3.1 Nemotron Ultra 253b v1 |
|---|---|---|
| LMArena Math | 1404 | 1360 |

## Knowledge

- Amazon Nova Experimental Chat 26 01 10: 40.3 (#120)
- Llama 3.1 Nemotron Ultra 253b v1: —

| Benchmark | Amazon Nova Experimental Chat 26 01 10 | Llama 3.1 Nemotron Ultra 253b v1 |
|---|---|---|
| LMArena Expert | 1444 | — |

## Multilingual

- Amazon Nova Experimental Chat 26 01 10: 50.2 (#126)
- Llama 3.1 Nemotron Ultra 253b v1: 43.1 (#187)

| Benchmark | Amazon Nova Experimental Chat 26 01 10 | Llama 3.1 Nemotron Ultra 253b v1 |
|---|---|---|
| LMArena Non-English | 1381 | 1282 |
| LMArena Russian | 1391 | 1284 |
| LMArena Chinese | 1372 | — |
| LMArena Spanish | 1390 | — |

## Instruction Following

- Amazon Nova Experimental Chat 26 01 10: 72.9 (#126)
- Llama 3.1 Nemotron Ultra 253b v1: 69.0 (#178)

| Benchmark | Amazon Nova Experimental Chat 26 01 10 | Llama 3.1 Nemotron Ultra 253b v1 |
|---|---|---|
| LMArena Instruction Following | 1381 | 1308 |

## Long Context

- Amazon Nova Experimental Chat 26 01 10: 42.7 (#119)
- Llama 3.1 Nemotron Ultra 253b v1: 39.5 (#177)

| Benchmark | Amazon Nova Experimental Chat 26 01 10 | Llama 3.1 Nemotron Ultra 253b v1 |
|---|---|---|
| LMArena Longer Query | 1400 | 1299 |

## Writing & Preference

- Amazon Nova Experimental Chat 26 01 10: 57.4 (#129)
- Llama 3.1 Nemotron Ultra 253b v1: 52.2 (#175)

| Benchmark | Amazon Nova Experimental Chat 26 01 10 | Llama 3.1 Nemotron Ultra 253b v1 |
|---|---|---|
| LMArena Text | 1396 | 1320 |
| LMArena Creative Writing | 1331 | 1314 |
| LMArena Multi-Turn | 1380 | 1317 |

## FAQ

### Is Amazon Nova Experimental Chat 26 01 10 better than Llama 3.1 Nemotron Ultra 253b v1?

Amazon Nova Experimental Chat 26 01 10 is the stronger model overall, scoring 42.8 to 36.7 on the Noometry Index.

### Is Amazon Nova Experimental Chat 26 01 10 or Llama 3.1 Nemotron Ultra 253b v1 better for coding?

Amazon Nova Experimental Chat 26 01 10 scores higher on coding benchmarks: 42.7 versus 38.4 in the Noometry coding category.

### How many benchmarks do Amazon Nova Experimental Chat 26 01 10 and Llama 3.1 Nemotron Ultra 253b v1 share?

10 benchmarks have published results for both models. Amazon Nova Experimental Chat 26 01 10 has 13 scored results on Noometry and Llama 3.1 Nemotron Ultra 253b v1 has 11.