跳到正文
TypeSafe AI· @typesafeai · X·· 2 小时前AI 评分44
AI 导读

说真的,cookie 弹窗横幅就是个糟糕的设计 接下来该把什么自动化掉? --- 说明:主推文本身信息量极低(只是一句吐槽加一个提问),按“引用式 teaser 例外”处理,body_zh 改为概括引用推文的核心要点: Lightpanda 把 Jev 放进 Lightpanda 二进制中,并在其上构建了 judge()。不再需要把整个页面发给 LLM 只为判断它是不是 cookie 横幅。被拦截页面、CAPTCHA、cookie 墙、登录页、付费墙、错误页、空搜索结果和仍在加载的页面都可能返回 HTTP 200;judge() 通过一组预定义问题判断页面是否有真实内容,以及内容类型(文章、列表、产品还是文档)。一次调用约 0.2 秒。视频中演示了 30 个网站、总计约 14 秒;Lightpanda 在遇到限流时会退避,接受 cookie 墙,并保留或跳过每个页面。

正文 · 原文

let's be real, cookie banners were a terrible idea

what should get automated away next?

引用Lightpanda@lightpanda_io
We put Jev inside the Lightpanda binary and built judge() on top of it. @typesafeai No more sending a whole page to an LLM just to find out it's a cookie banner. > Blocked pages, CAPTCHAs, cookie walls, logins, paywalls, error pages, empty searches and pages still loading can all return an HTTP 200 > judge() asks a set of predefined questions and tells you if the page has real content, and what kind: article, listing, product or docs > One call, ~0.2s In the video: > 30 sites, ~14s total > Lightpanda backs off when rate-limited, accepts cookie walls, and keeps or skips each page
在 X 查看被引用的帖子

来源:TypeSafe AI · x.com