Coconut (Chain of Continuous Thought)
Reasons by feeding the last hidden state back as the next input instead of emitting tokens, enabling breadth-first-style exploration in latent space.
Replaces textual chain-of-thought steps with continuous 'thought' vectors. Gains on planning-heavy logic tasks and fewer thinking tokens. Opened the research line on latent or recurrent reasoning later revisited by Huginn, HRM/TRM and opaque-recurrence systems.
- Date
- Monday, 9 December 2024
- Lab
- Meta FAIR / UCSD
- Kind
- paper
- Access
- paper only
Accepted to COLM 2025. Authors incl. Shibo Hao, Sainbayar Sukhbaatar, Yuandong Tian, Jason Weston. Latent reasoning is a monitorability concern because thoughts are no longer readable text.
Sources
This record was checked against its sources on 6 October 2026. How we check