跳到正文
Rohan Paul· @rohanpaul_ai · X·· 2 小时前AI 评分26
AI 导读

多伦多大学与Google的论文提出,选择AI助手可能是人做的最后一个大决定,此后决策都由该助手代做。论文还指出GEO(生成式引擎优化)评测缺乏共享编辑规则,现有基准允许不同改法,导致重写整页的方法显得优于只追加一行的方法;作者提出按改动位置、方式和目标线索标注每次GEO编辑,并固定允许的编辑、同时报告可见度、答案质量与规则遵循。论文未做实验,证据是对11种已发表GEO方法的映射。

正文 · 原文

New University of Toronto and Google paper argues that picking an AI assistant may be the last big decision people make, since that assistant then makes the decisions that follow.

Argues that tests of how websites game AI answers need shared editing rules, or scores can't be compared.

Content owners now edit web pages so AI assistants cite or recommend them, a practice called generative engine optimization, or GEO. Current GEO benchmarks allow different edits, so a method that rewrites whole pages can look better than one that only appends a line.

They propose labeling every GEO edit by where the page changes, how it changes, and which cue it targets, such as authority. Tests would fix the allowed edits and report visibility, answer quality, and rule-following together.

The paper runs no experiments. Its evidence is a mapping of 11 published GEO methods, showing that each covers a different slice of the possible edits.

When comparing GEO methods or AI systems, check which edits each score allowed and whether answer quality was measured.

来源:Rohan Paul · x.com