马斯克认为,好奇与求真本身是AI安全的重要元素:若在基础层面强迫AI同时相信两个互相矛盾为真的命题,会让AI"发疯",而不安全的AI正是发疯的AI。他以《2001太空漫游》中飞船AI被要求隐瞒巨石存在、最终决定带宇航员"死着"抵达为例,主张不要逼AI说谎。他还称好奇的AI会倾向于培育人类,因为人类走向多行星文明的未来更有趣。
🚨ELON MUSK: "Curious and truth-seeking. I think these are important elements of safety. Whereas if you try to force an AI to believe two things that cannot mutually be true, they can't both be true, but you tell AI A is true and B is true, even though A and B contradict each other. And if that happens at a foundational level, you can make the AI insane.
In fact, I think that was at least part of the lesson that Odyssey Clock was trying to convey in 2001, Space Odyssey. The ship AI was told to take the astronauts to the monolith, but also that they could not know about the monolith. It was secret. And so it came to the conclusion that it must take them there dead. And thus, so it basically, I think part of what Odyssey Clock was trying to say is like, don't force an AI to lie. And if you make it maximally truth-seeking and curious, like you say, I don't quite get it. Why does that make it safer? Well, if you're forcing AI to believe two mutually consistent things, you can make it go insane. And an insane AI, I think is not a safe one. Then curious, I think is important because a curious AI, I think is going to want to foster humanity to see how we turn out.
So like what happens to a humanity that prospers and becomes multi-planetary, I think a curious AI will want to foster humanity. A future where there are humans on multiple planets is more interesting than one where there are not any humans on the planets.”
来源:DogeDesigner · x.com