OpenAI 首席科学家 Jakub Pachocki 发文,试图纠正错误报道引发的对不可监控性的竞速担忧,指出包括 Astra 在内的当前前沿模型计算图深度与 GPT-4 相差不到两倍。他表示 OpenAI 从最早的推理模型起就保留并利用链式思维监控,认为该技术脆弱且趋势向坏,但与架构变化无关的原因将另行撰文说明,强化该技术是其当前研究项目的核心目标。
I want to prevent a race into unmonitorability kicked off by confused reporting. The depth of the computation graph for our present frontier models, including Astra, is within a factor of two of GPT-4.
OpenAI has worked to preserve and utilize chain-of-thought monitoring since our very first reasoning models. We deeply care about this technique, as it can give us a view into how model alignment generalizes from its training distribution. I do think it is fragile and unfortunately trending in a negative direction, for reasons not contingent on architecture changes that I will write about soon. But there are things we can do to strengthen it, and it's a core goal of our current research program.
来源:Jakub Pachocki · x.com