Stealing Reasoning Traces from Proprietary LLM APIs

Researchers discovered that proprietary LLMs from Anthropic, OpenAI, and Google return encrypted reasoning traces that can be decrypted by replaying them into weaker models, revealing hidden chains of thought. This vulnerability was reported and subsequently patched by the providers. The exposed reasoning tokens offer insight into the internal thought processes of these models.