据 Fortune 报道,OpenAI 正在测试其模型回答是否符合战争法,因为这些模型将进入美国军方使用。OpenAI 设立了首个人权与负责任部署岗位,由 6 月加入、此前从事军事问题 30 年的 Sarah Yager 出任;国际专家向模型输入高风险战斗提示词,工程师再根据回答与日内瓦公约的差距调整模型,Yager 称这种反向微调步骤此前从未有过。
Fortune: OpenAI now tests whether its models' answers obey the laws of war, because those models are going to the U.S. military.
OpenAI created its first human rights and responsible deployment role, Sarah Yager, who spent 30 years on military issues before joining in June, described her method.
International experts entered high-stakes combat prompts into OpenAI models, and then engineers changed the models based on how the answers measured up against the Geneva Conventions.
This is kind of backward finetuning step Yager said had never been taken before.
来源:Rohan Paul · x.com