Gemini 1.0 (Ultra, Pro, Nano)
First Gemini family, natively multimodal, with Ultra, Pro and Nano models; Ultra reported 90.0% on MMLU with CoT@32, beating GPT-4's reported score.
Trained multimodal from the start rather than stitching models. Pro shipped in Bard immediately and via API on 2023-12-13; Nano ran on-device on Pixel 8 Pro; Ultra followed in Feb 2024. Ultra's 90.0% MMLU relied on a new CoT@32 protocol, which drew criticism.
- Date
- Wednesday, 6 December 2023
- Lab
- Google DeepMind
- Kind
- model
- Access
- closed API
Figures
| Measure | Value | Measured by |
|---|---|---|
| MMLU (Ultra, CoT@32) | 90.0% company-claimed, new prompting protocol | company |
| MMMU (Ultra) | 59.4% state of the art at launch | company |
Technical report arXiv 2312.11805 v1 2023-12-19. The 90.0% MMLU used a new CoT@32 prompting approach instead of the standard 5-shot setup. Ultra became available in Gemini Advanced on 2024-02-08.
Sources
This record was checked against its sources on 6 October 2026. How we check