Sentient Foundation 发布 Fingerprinting Leaderboard,一个免费开源基准,用于测试证明 AI 模型归属的指纹方法。研究者提交在模型内嵌入所有权标记的方法,Sentient 将标记植入自己的测试模型并尝试移除,再按抗移除性、验证可靠性和技能损失公开排名,测试代码 mlprints 一并开源。
Good news for anyone trying to prove a model is theirs.
Sentient Foundation released the Fingerprinting Leaderboard, a free, open source benchmark that tests fingerprinting methods, meant to prove an AI model was copied from yours.
Researchers submit a method for hiding an ownership mark inside a model, and Sentient puts that mark into its own test models, tries to strip it out, then ranks the method on a public website.
The code that runs these tests, called mlprints, is released too.
A fingerprint trains a model to return unlikely answers to secret prompts, so an owner can test a suspected copy through its API alone.
But a fingerprint that survives every attack is still useless if the owner can’t read it back reliably.
Sentient Foundation’s Fingerprinting Leaderboard scores that verification step directly, alongside how well the mark resists removal and how much model skill it costs.
Sentient’s Perinucleus method embedded 24,576 fingerprints in Llama-3.1-8B without degrading utility, is also competing on the leaderboard, and the fingerprints survived standard fine-tuning.
Models cost millions to train and minutes to copy. Fine-tuning and distillation can erase where they came from. Introducing the Fingerprinting Leaderboard, an open benchmark for model provenance — built so the proof lives in the weights, not the paperwork. https://fingerprint.sentient.foundation在 X 查看被引用的帖子
来源:Rohan Paul · x.com