跳到正文

#多模态

今日 32 条
9月24日周四
  1. NVIDIA Technical Blog(开发者技术博客 · RSS)39

    NVIDIA 推出 NV-Reason-CT Open 3D CT VLM,面向放射科医生链式推理

    NVIDIA 发布 NV-Reason-CT Open,这是一个面向 3D CT 体积影像的开放视觉语言模型,支持放射科医生的链式推理(Chain-of-Thought)。现有前沿通用模型在体积影像上表现不佳,多数开放医疗 AI 模型也缺乏相应能力,而 3D CT 是临床信息最丰富、数据最密集的模态之一,此前一直未被现代 VLM 充分覆盖。

  2. Karina38

    当@jakubzeg和我在OpenAI相遇时,我们反复回到同一个困惑:太多AI产品都从一个空白聊天框开始。你几乎可以做任何事,但你必须决定从哪里开始,这让人不知所措。 有了ACTx486,我们从一段已经有故事的媒体出发,让你在观看的同时与之互动。这也让技术更加通用。 我们在这里写了更多关于这一选择的思考:https://www.actx486.com/

    引用Rehan Sheikh@rehan_shei

    interactive media will be huge in the next year or two! this is incredible

9月23日周三
  1. Google DeepMind:Blog(RSS)71

    Google DeepMind 发布 Gemini 3.8 Flash TTS 与 Flash-Lite TTS

    Google DeepMind 推出 Gemini 3.8 Flash TTS 和 Gemini 3.8 Flash-Lite TTS 两款文本转语音模型,前者面向角色设计与深度创作控制,后者面向高并发、低成本的配音与语音智能体场景。

    推荐理由:两款 TTS 模型给出语音克隆、逐行导演与多语言覆盖的具体能力,可据此判断语音生成工作流的变化。

  2. elsewhere:文章(RSS)50

    千问办公发布「企业上下文」与 QwenNote A2,要把企业内部连接起来

    千问办公发布「企业上下文」,把群聊、文档、知识库等分散信息整理成结构化上下文,供 Agent 提取任务所需信息,思路是「连接与压缩」。同时推出由钉钉 A1 升级而来的 QwenNote A2 录音卡,默认不录音、云端 ASR 转写后永久删除音频,并上线多人协作功能。企业上下文依赖新模型 Qwen3.8-Omni-Flash,千问办公此前已与模型团队定制 Qwen 3.8 Flash。

9月22日周二
  1. MeshyAI23

    Meshy 🤝 chrona 让你的 3D 创意尽情释放 🤩

    引用Chrona@chronaworld

    What if Tech Week wasn’t a calendar, but a city you could actually enter and play? We made a SF TECH WEEK CITY — rebuilding San Francisco as a 3D world with Tech Week events placed at their real venues. RSVP activity, trending events, and busy areas become part of the world itself. The birds flying above the city represent real community members, so you can see where people are heading and explore alongside them. Built with AI coding and published on Chrona. A small experiment in turning real-world data into a place worth entering. @MeshyAI @ChronaWorld #MeshyxChrona #TechWeek

  2. OpenBMB40

    太棒了!用 Pi Zero 跑完整感知栈,实时喂给 MiniCPM-o4.5,这是个非常酷的用例。很喜欢看到与个人机器人的实时交互!

    引用Mr Goodman@mrgoodmantweets

    I gave eyes and ears to my robot. I hooked up a Raspberry Pi Zero W2 (webcam + ambient mic), streaming real-time audio/video back and forth to MiniCPM-o 4.5 @OpenBMB open source model running locally on my PC. Zero cloud APIs, full duplex interaction. Project on my git

  3. Xiaomi MiMo66

    小米 MiMo 发布 MiMo-V2.6 Pro 与 Flash 两款全模态模型,通过规模化强化学习训练。官方称 Pro 在多数 agent 基准上与 Claude Opus 5 和 GPT-5.6 Sol 相当,Artificial Analysis Intelligence Index 得分 46,为开源模型中最高;能力覆盖编码、computer use、3D 推理和创作。

    推荐理由:原文给出 Pro 与 Claude Opus 5、GPT-5.6 Sol 的 agent 基准对比和开源范围,可据此评估其相对位置。

9月21日周一
9月20日周日
9月19日周六
9月18日周五
  1. Gemini Notebook47

    播客好友 @stevenbjohnson 展示了他最喜欢的 Notebook 移动应用用法之一 🤯

    引用Steven Johnson@stevenbjohnson

    The camera feature in the @Gemini_Notebook mobile app is so transformative for on-the-go research. I was up in the Sierras working on a new project, and I just took photos of everything, like this museum display. Then I asked for a detailed report of all the info in the image. The text below is what I got back. (I fact-checked it myself and it was 99% accurate -- and some of the text it transcribed is so blurry in the image that it was hard for me to read it.) Next step is to generate documents like this for all the photos I took, and then ask Notebook to highlight all the information that adds something new to the existing knowledge base of sources I've already collected, or is particularly relevant to my latest writing and outline for the project. Truly magical. Mariposa Museum Exhibit Reference: Mariposa in 1859 & Gold Rush Era This reference document consolidates all text, photographic captions, historical statistics, newspaper clippings, and exhibit overlays displayed on the Mariposa Museum exhibit panel regarding Mariposa during and after the Gold Rush. 1. Exhibit Overview & Key Headlines Main Title: "THIS WAS MARIPOSA IN 1859 – ONLY 10 YEARS AFTER THE GOLD RUSH BEGAN." Historical Context Sub-headline: "PORTIONS OF THE TOWN HAD BEEN REBUILT AFTER THE FIRE OF 1858.. & PARTS OF IT WERE DOOMED TO BE DESTROYED IN 1866" Display Overview: The exhibit centers on a large 1850s panoramic photograph of Mariposa, annotated with street names, landmark locations, and population statistics, flanked by contemporary hotel advertisements, fire reports, medical artifacts, and photographs of civic buildings. 2. Demographic & Real Estate Statistics (1850s vs. Present) MetricHistorical Value (1850s Gold Rush Peak)Modern Value Town Population~3,000 residents~1,800 estimated Entire Mariposa Diggings Area~15,000 residents— Commercial Establishments15 to 20 stores & saloons, plus hotels— Town Lot Prices00 to 00 per lot— 3. Background Photograph & Civic Infrastructure Background Photo Date: Taken in the 1850s, capturing the rapid growth of the settlement following the initial gold strike. 1854 Mariposa County Courthouse: Shown in the background panorama prior to the construction of its iconic clock tower. A separate framed photograph depicts the completed white wood-frame courthouse with a white picket fence and clock tower. Clock Tower History: The clock mechanism was imported from England and is an 8-day, manually wound instrument. It remains operational today, maintained by the Mariposa Public Works Department. Annotated Overlay Locations on Panorama: 1854 Courthouse: Located at the upper edge of town on Jones Street. Jones Street & Bullion Street: Upper residential and civic thoroughfares. Charles Street (Main Street): Primary commercial artery running through the center of the valley floor. Schlageter Hotel Site: Positioned along Main Street. Mariposa Creek: Flowing along the foreground basin of the town diggings. 4. The Fire of 1866: Mariposa's Second Great Conflagration Below is the complete transcript of the Mariposa Gazette report featured on the panel regarding the disaster of August 25, 1866 (following the earlier destructive fire of 1858): Article Text: "FIRE! MARIPOSA'S SECOND GREAT FIRE" A few minutes after 6 p.m. on Saturday, August 25, 1866 Mariposa was again ruined by a disastrous fire (first in 1858). According to the Gazette (the building was damaged but not destroyed), the fire was believed to have started when "a recently imported printer stepped inside the Free Press office and lighted a cigar. The match had evidently been dropped carelessly amongst the papers on the floor. The Free Press office was located near the corner of Main and 7th Streets and by ten minutes the fire had spread through two blocks. The fire crossed Main Street to the Odd Fellows building and the Methodist Church and soon the buildings on the block between 6th and 7th Streets were burning like so much chaff." Seven full blocks, except for four fire-proof buildings, were totally destroyed. "In one hour about 60 buildings and 77,000 worth of property were destroyed." By early Monday morning the men were clearing away debris and by press time the following Saturday, the Gazette reported that several temporary business structures had already been erected and were open for business. Inventory of Buildings Destroyed in the 1866 Fire: Residential & Civic: 14 Dwellings, 1 Church, 1 Odd Fellows and Masons Hall. Media & Printing: 1 Newspaper Office (Free Press), 1 Newspaper Depot. Hospitality & Retail: 3 Hotels, 5 Retail Stores, 1 Saddlery Shop, 9 Liquor Saloons (several equipped with billiard tables). Services & Trades: 2 Livery Stables, 3 Law Offices, 1 Drug Store, 3 Blacksmith Shops, 2 Carpenter Shops, 2 Shoemaker Shops, 1 Tailor Shop, 2 Butchering Establishments. Outbuildings: Numerous outhouses, private stables, and auxiliary structures. 5. Commercial Hotels & Lodging Gallison Hotel (1887 Advertisement) Location: Main Street, Mariposa (center of business district, opposite Odd Fellows' Hall). Proprietor: Winslow Gallison. Management: Mrs. Gallison individually superintended all internal departments of the hotel. Amenities: Newly furnished rooms, first-class table dining. Mariposa Hotel (1887 Card) Location: Corner of Main and Fifth Streets. Proprietor: Charles A. Schlageter. Target Market: Accommodated general travelers as well as Yosemite tourists on short notice. Amenities: Family rooms, well-lighted parlors, good table, and bath facilities. The Schlageter Hotel Date Built: Built in the 1850s. Architecture: Prominent two-story wooden structure featuring full upper and lower covered verandas. 6. Medical Artifacts & 19th-Century Therapeutics Old Mariposa Hospital A framed historical photograph depicts a two-story wood-frame hospital building with a prominent front porch and side wing (annotated "from Chic Allingham"). Dr. D. Jayne's Family Medicines (1880 Display Broadside) 1. Jayne's Specific for Tape-Worm Diagnosis: Describes tapeworm infections as widespread, noting that discharging white or yellowish segments ("resembling gourd seeds") is the only positive diagnostic proof. Pricing & Ordering: .00 per dose, shipped nationwide via mail from 242 Chestnut Street, Philadelphia. Usage Instructions: Dissolve powder in a pint of boiling water, drink in three equal hourly doses on an empty stomach. Follow with Cathartic medicines if bowels do not operate in three hours. 2. Dr. D. Jayne's Sanative Pills Formulation: Concentrated, sugar-coated pills. Sold in 50-pill boxes (-bash.25) or 15-pill specimen packets (-bash.10). Prescribed Ailments: Advertised for liver complaints, gout, jaundice, dyspepsia, rheumatism, kidney affections, fevers, nervousness, skin diseases, melancholy, sick headache, and costiveness (constipation). 3. Exhibit Commentary Note A small museum card mounted below the broadside reads: "A man advertises for 'a competent person to undertake the sale of a new medicine' and adds innocently 'It will prove profitable to the undertaker.'"

  2. Josh Woodward43

    如果你还没在手机上用 @Gemini_Notebook,那你可错过太多了。这真是个超酷的故事!

    引用Steven Johnson@stevenbjohnson

    The camera feature in the @Gemini_Notebook mobile app is so transformative for on-the-go research. I was up in the Sierras working on a new project, and I just took photos of everything, like this museum display. Then I asked for a detailed report of all the info in the image. The text below is what I got back. (I fact-checked it myself and it was 99% accurate -- and some of the text it transcribed is so blurry in the image that it was hard for me to read it.) Next step is to generate documents like this for all the photos I took, and then ask Notebook to highlight all the information that adds something new to the existing knowledge base of sources I've already collected, or is particularly relevant to my latest writing and outline for the project. Truly magical. Mariposa Museum Exhibit Reference: Mariposa in 1859 & Gold Rush Era This reference document consolidates all text, photographic captions, historical statistics, newspaper clippings, and exhibit overlays displayed on the Mariposa Museum exhibit panel regarding Mariposa during and after the Gold Rush. 1. Exhibit Overview & Key Headlines Main Title: "THIS WAS MARIPOSA IN 1859 – ONLY 10 YEARS AFTER THE GOLD RUSH BEGAN." Historical Context Sub-headline: "PORTIONS OF THE TOWN HAD BEEN REBUILT AFTER THE FIRE OF 1858.. & PARTS OF IT WERE DOOMED TO BE DESTROYED IN 1866" Display Overview: The exhibit centers on a large 1850s panoramic photograph of Mariposa, annotated with street names, landmark locations, and population statistics, flanked by contemporary hotel advertisements, fire reports, medical artifacts, and photographs of civic buildings. 2. Demographic & Real Estate Statistics (1850s vs. Present) MetricHistorical Value (1850s Gold Rush Peak)Modern Value Town Population~3,000 residents~1,800 estimated Entire Mariposa Diggings Area~15,000 residents— Commercial Establishments15 to 20 stores & saloons, plus hotels— Town Lot Prices00 to 00 per lot— 3. Background Photograph & Civic Infrastructure Background Photo Date: Taken in the 1850s, capturing the rapid growth of the settlement following the initial gold strike. 1854 Mariposa County Courthouse: Shown in the background panorama prior to the construction of its iconic clock tower. A separate framed photograph depicts the completed white wood-frame courthouse with a white picket fence and clock tower. Clock Tower History: The clock mechanism was imported from England and is an 8-day, manually wound instrument. It remains operational today, maintained by the Mariposa Public Works Department. Annotated Overlay Locations on Panorama: 1854 Courthouse: Located at the upper edge of town on Jones Street. Jones Street & Bullion Street: Upper residential and civic thoroughfares. Charles Street (Main Street): Primary commercial artery running through the center of the valley floor. Schlageter Hotel Site: Positioned along Main Street. Mariposa Creek: Flowing along the foreground basin of the town diggings. 4. The Fire of 1866: Mariposa's Second Great Conflagration Below is the complete transcript of the Mariposa Gazette report featured on the panel regarding the disaster of August 25, 1866 (following the earlier destructive fire of 1858): Article Text: "FIRE! MARIPOSA'S SECOND GREAT FIRE" A few minutes after 6 p.m. on Saturday, August 25, 1866 Mariposa was again ruined by a disastrous fire (first in 1858). According to the Gazette (the building was damaged but not destroyed), the fire was believed to have started when "a recently imported printer stepped inside the Free Press office and lighted a cigar. The match had evidently been dropped carelessly amongst the papers on the floor. The Free Press office was located near the corner of Main and 7th Streets and by ten minutes the fire had spread through two blocks. The fire crossed Main Street to the Odd Fellows building and the Methodist Church and soon the buildings on the block between 6th and 7th Streets were burning like so much chaff." Seven full blocks, except for four fire-proof buildings, were totally destroyed. "In one hour about 60 buildings and 77,000 worth of property were destroyed." By early Monday morning the men were clearing away debris and by press time the following Saturday, the Gazette reported that several temporary business structures had already been erected and were open for business. Inventory of Buildings Destroyed in the 1866 Fire: Residential & Civic: 14 Dwellings, 1 Church, 1 Odd Fellows and Masons Hall. Media & Printing: 1 Newspaper Office (Free Press), 1 Newspaper Depot. Hospitality & Retail: 3 Hotels, 5 Retail Stores, 1 Saddlery Shop, 9 Liquor Saloons (several equipped with billiard tables). Services & Trades: 2 Livery Stables, 3 Law Offices, 1 Drug Store, 3 Blacksmith Shops, 2 Carpenter Shops, 2 Shoemaker Shops, 1 Tailor Shop, 2 Butchering Establishments. Outbuildings: Numerous outhouses, private stables, and auxiliary structures. 5. Commercial Hotels & Lodging Gallison Hotel (1887 Advertisement) Location: Main Street, Mariposa (center of business district, opposite Odd Fellows' Hall). Proprietor: Winslow Gallison. Management: Mrs. Gallison individually superintended all internal departments of the hotel. Amenities: Newly furnished rooms, first-class table dining. Mariposa Hotel (1887 Card) Location: Corner of Main and Fifth Streets. Proprietor: Charles A. Schlageter. Target Market: Accommodated general travelers as well as Yosemite tourists on short notice. Amenities: Family rooms, well-lighted parlors, good table, and bath facilities. The Schlageter Hotel Date Built: Built in the 1850s. Architecture: Prominent two-story wooden structure featuring full upper and lower covered verandas. 6. Medical Artifacts & 19th-Century Therapeutics Old Mariposa Hospital A framed historical photograph depicts a two-story wood-frame hospital building with a prominent front porch and side wing (annotated "from Chic Allingham"). Dr. D. Jayne's Family Medicines (1880 Display Broadside) 1. Jayne's Specific for Tape-Worm Diagnosis: Describes tapeworm infections as widespread, noting that discharging white or yellowish segments ("resembling gourd seeds") is the only positive diagnostic proof. Pricing & Ordering: .00 per dose, shipped nationwide via mail from 242 Chestnut Street, Philadelphia. Usage Instructions: Dissolve powder in a pint of boiling water, drink in three equal hourly doses on an empty stomach. Follow with Cathartic medicines if bowels do not operate in three hours. 2. Dr. D. Jayne's Sanative Pills Formulation: Concentrated, sugar-coated pills. Sold in 50-pill boxes (-bash.25) or 15-pill specimen packets (-bash.10). Prescribed Ailments: Advertised for liver complaints, gout, jaundice, dyspepsia, rheumatism, kidney affections, fevers, nervousness, skin diseases, melancholy, sick headache, and costiveness (constipation). 3. Exhibit Commentary Note A small museum card mounted below the broadside reads: "A man advertises for 'a competent person to undertake the sale of a new medicine' and adds innocently 'It will prove profitable to the undertaker.'"

9月17日周四
9月16日周三
  1. 蚂蚁 inclusionAI:HuggingFace 新模型62

    蚂蚁 inclusionAI 开源 Realtime-Venus 9B 全双工音视频交互系统

    蚂蚁 inclusionAI 发布 Realtime-Venus,一个支持主动音视频交互、异步委托和可打断全双工对话的开源系统,包含 Realtime-Venus-Omni 和 Realtime-Venus-Audio 两个 9B 检查点。

    推荐理由:模型卡给出了 Realtime-Venus 的架构组成、全双工与异步委托能力及完整用法,读者可以据此评估它在实时音视频交互场景的可用性。