2026-07-07

389 篇
From Fixed to Free Cameras: Calibration-Free View-Robust Vision-Language-Action Model Figure 1
2026-07-07cs.CV

From Fixed to Free Cameras: Calibration-Free View-Robust Vision-Language-Action Model

Wenhao Li, Xueying Jiang, Quanhao Qian, Deli Zhao, Shijian Lu, Gongjie Zhang, Ran Xu

Nanyang Technological University, DAMO Academy, Alibaba Group, HuPan Lab

2026-07-07视觉语言视觉感知安全鲁棒

针对VLA在训练相机视角稍变就失效、而现有鲁棒方法又依赖已知外参的问题,本文提出CamVLA:从单目RGB和语言指令同时预测相机坐标系下的末端动作与6-DoF手眼矩阵,再用确定性几何变换转到机器人基座坐标。仿真和真实机器人实验显示,其在未见相机配置下较π0、GR00T等基线取得更高成功率,但极端视角和高精度任务仍受手眼回归误差限制。

SynCity 3000: Bootstrapping Scene-Scale 3D Diffusion Figure 1
2026-07-07cs.CV

SynCity 3000: Bootstrapping Scene-Scale 3D Diffusion

Paul Engstler, Iro Laina, Christian Rupprecht, Andrea Vedaldi

Visual Geometry Group, University of Oxford

2026-07-07生成模型三维

针对现有文本到三维方法多停留在单物体或拼块式场景、容易出现网格痕迹和全局不连贯的问题,SynCity 3000 将二维模板生成与三维重建解耦:先用重叠窗口扩散生成可控的 dimetric 场景图,再将 TRELLIS 微调为可卷积滑窗推理,并用程序化合成数据弥补场景训练数据不足。实验显示其在多种提示和布局下生成更大、更连贯且细节更丰富的 3D Gaussian Splat 场景,优于 SynCity 等基线。

Deform360: A Massive Multi-view Visuotactile Dataset for Deformable World Models Figure 1
2026-07-07cs.RO

Deform360: A Massive Multi-view Visuotactile Dataset for Deformable World Models

Hongyu Li, Wanjia Fu, Xiaoyan Cong, Zekun Li, Binghao Huang, Hanxiao Jiang, Xintong He, Yiqing Liang, Rao Fu, Tao Lu, Srinath Sridhar, Kevin A. Smith, George Konidaris, Yunzhu Li

2026-07-07强化学习数据集/基准

面向可变形物体操作中动力学难预测、真实多模态数据不足的问题,Deform360 构建了含198类日常物体、1980段交互、41视角与双手触觉夹爪的视觉-触觉数据集,并用无标记3D跟踪生成几何/粒子标注。实验将接触预测、2D视频世界模型与3D粒子模型、MPC规划放在同一基准下比较,显示3D模型在低数据下受益于结构先验,而2D模型在大数据下泛化更强,部分优势可能主要来自 scaling/data。

InFlux++: Real and Synthetic Data for Estimating Dynamic Camera Intrinsics Figure 1
2026-07-07cs.CV

InFlux++: Real and Synthetic Data for Estimating Dynamic Camera Intrinsics

Erich Liang, Caleb Kha-Uong, Chinmaya Saran, Sreemanti Dey, David W. Liu, Junhan Ouyang, Benjamin Zhou, Jia Deng

2026-07-07视觉感知

该文针对真实视频中变焦、对焦导致相机内参随帧变化、进而破坏3D重建和机器人视觉假设的问题,提出InFlux++数据套件:用程序生成的Synth提供44.1万帧动态内参及部分深度/位姿/法线标注,并用Real扩展到51.4万帧更复杂真实场景与运动。实验显示,用Synth微调AnyCalib可在InFlux++ Real和InFlux上提升焦距估计,说明收益可能主要来自更大规模、更丰富的数据监督。

Search Beyond What Can Be Taught: Evolving the Knowledge Boundary in Agentic Visual Generation Figure 1
2026-07-07cs.CV

Search Beyond What Can Be Taught: Evolving the Knowledge Boundary in Agentic Visual Generation

Haozhe Wang, Weijia Feng, Jinpeng Yu, Che Liu, Ping Nie, Fangzhen Lin, Jiaming Liu, Ruihua Huang, Jimmy Lin, Wenhu Chen, Cong Wei

Hong Kong University of Science and Technology 2 University of Waterloo, Qwen Applications 4 Imperial College London

2026-07-07学习理论

本文针对图像生成器在新实体、长尾文化与训练截止后事件上“会画但不知道”的世界知识瓶颈,指出盲目搜索会引入噪声,关键在于发现随生成器能力变化的知识边界。作者构建 SearchGen-20K/Bench,并提出门控-过滤-整合的搜索推理器与生成器协同训练;结果显示开放生成器在该基准仅得21–28分,而自适应搜索相较无搜索和盲搜取得单调提升。

Cortex: A Bidirectionally Aligned Embodied Agent Framework for Long-horizon Manipulation Figure 1
2026-07-07cs.RO

Cortex: A Bidirectionally Aligned Embodied Agent Framework for Long-horizon Manipulation

Jiaqi Peng, Xiqian Yu, Delin Feng, Yuqiang Yang, Wenzhe Cai, Jing Xiong, Ganlin Yang, Jinliang Zheng, Jiafei Cao, Xueyuan Wei, Jiangmiao Pang, Yuan Shen, Tai Wang

Tsinghua University, Shanghai AI Laboratory, Peking University

2026-07-07机器人

长程机器人操作中,端到端 VLA 容易因缺少进度记忆而重复或漂移,传统分层方法又存在规划语义与执行运动学脱节。Cortex 的核心是用 32 类可执行技能原语、语义记忆和可达性约束把 VLM 规划与 VLA 执行双向对齐,并结合大规模视频标注与仿真数据训练。实验显示其在 Libero-long 和 RoboTwin 分别提升 3.1% 与 4.1%,且能零样本完成部分真实多阶段任务,但增益可能部分来自数据规模与接口工程。

MV-Forcing: Long Multi-View Video Generation via 4D-Grounded Spatio-Temporal Self-Forcing Figure 1
2026-07-07cs.CV

MV-Forcing: Long Multi-View Video Generation via 4D-Grounded Spatio-Temporal Self-Forcing

Gal Fiebelman, Hadar Averbuch-Elor, Sagie Benaim

2026-07-07视觉感知

这篇论文针对现有方法只能做长单视角或短多视角视频、难以同时保持长时序与跨视角几何一致的问题,提出 MV-Forcing:用自回归 4D/3D 重建模型在已生成视角和下一视角之间渲染几何先验,并结合联合去噪、DMD 与时空 Self-Forcing 缓解推理漂移。实验表明其在合成和真实数据上可生成任意时长、任意视角数的动态场景多视角视频,并比单视角长视频或短多视角基线更能维持相机与几何一致性。

PixWorld: Unifying 3D Scene Generation and Reconstruction in Pixel Space Figure 1
2026-07-07cs.CV

PixWorld: Unifying 3D Scene Generation and Reconstruction in Pixel Space

Sensen Gao, Zhaoqing Wang, Qihang Cao, Dongdong Yu, Changhu Wang, Jia-Wang Bian

Nanyang Technological University

2026-07-07强化学习三维

针对三维重建依赖像素回归、三维生成依赖潜空间扩散而难以统一且会损失细节的问题,PixWorld将两者改写为像素空间扩散:直接在多视角渲染图上做流匹配,端到端监督像素对齐3D Gaussian,并加入基于3D基础模型特征的几何感知损失。实验显示其生成优于既有潜空间方法,重建性能接近或匹配SOTA。

ReCal3R: Reliability-Calibrated Learning Rates for Streaming 3D Reconstruction Figure 1
2026-07-07cs.CV

ReCal3R: Reliability-Calibrated Learning Rates for Streaming 3D Reconstruction

Xinze Li, Yiyuan Wang, Pengxu Chen, Wentao Fan, Weifeng Su, Weisi Lin, Wentao Cheng

Beijing Normal-Hong Kong Baptist University, Hong Kong Baptist University, Jilin University, Guangdong Provincial Key Laboratory of Interdisciplinary Research and Application for Data Science, Nanyang Technological University

2026-07-07三维

面向机器人、AR/VR 等长时在线感知,论文指出 CUT3R 类紧凑循环状态会在反复写入中被噪声观测污染,导致历史几何漂移。ReCal3R 的核心是先由 token 对齐、重建残差和近期更新压力得到候选学习率,再用状态 token 自身可靠性进行校准,避免不可靠记忆被激进改写;该规则无需训练、可直接叠加到 CUT3R。实验显示其在长序列位姿、深度和重建上更稳定,ScanNet 1000 帧 ATE 相比 CUT3R 降低 3.7 倍,运行时间和显存基本相当。

Geometric Reciprocity: Unlocking Self-Supervision for Stereoscopic Video Generation Figure 1
2026-07-07cs.CV

Geometric Reciprocity: Unlocking Self-Supervision for Stereoscopic Video Generation

Jingyi Lu, Kai Han

2026-07-07视觉感知

这篇论文针对单目视频转立体视频中遮挡显露区域难以补全、训练数据依赖稀缺真实双目或有域差合成数据的问题,提出几何互易定理:在最近邻 DIBR 下,目标视图的补洞掩码等价于反向 warp 时丢失的像素,从而可用任意单目视频解析构造自监督训练数据。实验称其在训练自由和监督方法之上取得更好质量与一致性,但具体增益仍可能部分来自更大规模真实数据。

Multiplayer Interactive World Models with Representation Autoencoders Figure 1
2026-07-07cs.CV

Multiplayer Interactive World Models with Representation Autoencoders

Anthony Hu, Václav Volhejn, Adrien Ramanana Rahary, Chris Mulder, Aditya Makkar, Amélie Royer, Manu Orsini, Alyx Liao, Adam Jelley, Eloi Alonso, Florian Laurent, Fredrik Norén, James Swingos, Jan Hünermann, Kent Rollins, Lucas Hosseini, Matthieu Le Cauchois, Maxim Peter, Pim de Witte, Tim Brown, Vincent Micheli, Moritz Böhle, Gabriel de Marmiesse, Viktoriia Sharmanska, Lucia Specia, Michael Black, Patrick Pérez

tightly coupled dynamics. Trained on 10,000 hours of gameplay collected with publicly available bots, Once learned, the world model can act as a controllable simulator (Ha and Schmidhuber, 2018

2026-07-07强化学习

这篇论文针对多智能体场景中单玩家世界模型无法显式控制其他参与者、难以用于自博弈和反事实评估的问题,提出 MIRA:在表示自编码器潜空间中,以四名玩家的视角和动作流共同条件化的扩散世界模型。其关键洞察是多视角与多动作流能减少未来不确定性并帮助正确归因交互。模型用 1 万小时 Rocket League 数据训练,5B 参数可在单张 B200 上实时生成 20fps 四人比赛,长程 rollout 在 5 分钟评测内保持稳定,并开源数据、代码与演示。

Beyond Isolated Objects: Relationship-aware Open Vocabulary Scene Understanding via 3D Scene Graph Analysis Figure 1
2026-07-07cs.CV

Beyond Isolated Objects: Relationship-aware Open Vocabulary Scene Understanding via 3D Scene Graph Analysis

Xianhao Chen, Jiarui Hu, Yuanbo Yang, Xiyu Zhang, Tengyue Wang, Hujun Bao, Guofeng Zhang, Zhaopeng Cui

2026-07-07三维

这篇论文针对开放词汇3D场景理解中物体常被孤立识别、缺少关系上下文的问题,提出 RelGraphOV:从多视角观测自动构建3D场景图,用视觉语言推理补全关系并过滤几何不合理边,再通过双流门控GAT分别处理密集几何特征与CLIP语义特征,降低特征干扰。实验显示其在 ScanNetV2、ScanNet200 及 ScanNet++、Replica 零样本评测中优于多种基线,说明关系上下文对长尾和跨域类别识别有实际增益。

WildSplat: Feedforward Gaussian Splatting from Unposed In-the-Wild Images Figure 1
2026-07-07cs.CV

WildSplat: Feedforward Gaussian Splatting from Unposed In-the-Wild Images

Xiyu Zhang, Jingyu Zhuang, Hongjia Zhai, Zizheng Yan, Jinwei Chen, Guofeng Zhang, Qingnan Fan

2026-07-07视觉感知三维

面向互联网图像常见的光照、天气和曝光不一致问题,WildSplat试图摆脱传统NeRF/3DGS依赖已知位姿、密集视图和逐场景优化的限制。其核心是双分支前馈3D高斯框架:几何分支联合估计位姿并提取外观不变结构,外观分支用参考图经预调制交叉注意力注入目标风格,并用多参考训练减弱几何与外观纠缠。实验显示其在稀疏、无位姿in-the-wild新视角合成和外观编辑上优于优化式与前馈基线。

CenSynCMB: Centre Maps and Physics-Guided Synthesis for Microbleed Detection Figure 1
2026-07-07cs.CV

CenSynCMB: Centre Maps and Physics-Guided Synthesis for Microbleed Detection

Lucas He, Hanyuan Zhang, Krinos Li, Adama Fatima Saccoh, Silvia Ingala, Rafael Rehwald, Marleen de Bruijne, Frederik Barkhof, Rhodri Davies, Carole H. Sudre

2026-07-07视觉感知

这篇工作面向脑微出血在大规模 MRI 队列中难以自动检出的痛点:病灶小而稀疏,且易与血管、钙化样低信号和伪影混淆。CenSynCMB 将 3D Attention U-Net 与中心图监督、假阴性重加权及物理引导的正例/困难负例合成结合,使训练目标更贴近质心级检测并显式学习相似干扰物。在 VALDO 上病灶级 F1 达 74.3%,在外部 AIBL SWI 上召回率 88.5%、F1 65.0%,但个体负荷估计仍需队列校准和假阳性控制。

Steering Optimisation Trajectories in Diffusion Representation Learning Figure 1
2026-07-07cs.CV

Steering Optimisation Trajectories in Diffusion Representation Learning

Rajat Rasal, Avinash Kori, Tian Xia, Ben Glocker

Imperial College London

2026-07-07生成模型

本文关注扩散自编码器在重建质量相近时却学到差异很大的潜在表示这一问题,指出关键在早期优化轨迹会落入“重建优先”或“解耦渐进”两种机制。作者提出 SteeringDRL,通过门控残差 U-Net 限制捷径通路,并用 log-SNR 噪声暴露课程调控训练早期动态。实验显示其在属性解耦与目标中心空间解耦任务上提升表示和分割质量,并降低随机种子敏感性。

Topological Shape Representation for Aneurysm -- Bifurcation Detection Figure 1
2026-07-07cs.CV

Topological Shape Representation for Aneurysm -- Bifurcation Detection

Akshay Gokhale (1), Mansi Dhamne (1) ((1) Sardar Patel Institute of Technology, Mumbai)

Sardar Patel Institute of Technology

2026-07-07视觉感知

本文针对CTA动脉瘤检测中CNN易把小型囊状动脉瘤误判为健康血管分叉、导致高假阳性的问题,提出作为下游假阳性过滤器的方向性拓扑形状表示SECT,用全局3D几何不变量替代局部强度纹理。其在RSNA 2025分层CTA补丁上AUC达0.943,明显优于PI/PL等非方向持久同调表示;在<3 mm病例和跨扫描仪留一验证中仍保持较高AUC与敏感性。

Deep Learning for Semen Analysis in Male Infertility: Computer Vision, Multimodal Fusion, and Clinical Translation Figure 1
2026-07-07cs.CV

Deep Learning for Semen Analysis in Male Infertility: Computer Vision, Multimodal Fusion, and Clinical Translation

Runwei Guan, Shaofeng Liang, Jiacheng Weng, Xiaoyi Gu, Jia Weng, Daizong Liu, Duo Pan, Qingxin Zhang, Xiao Liang, Weiping Ding, Suoyu Zhu, Ming Yuan, Yanhua Fei

2026-07-07视觉语言视觉感知

针对传统精液分析依赖人工、中心间差异大且难以整合形态、运动、DNA完整性和临床信息的问题,本文综述深度学习在检测计数、跟踪活力、分割、形态缺陷与功能评估中的进展,并将核心洞察提升为多模态融合与可信临床转化框架。主要结果是梳理数据集、指标和部署障碍,提出从标准化、多中心验证到监管和上市后监测的分阶段路线图,而非报告单一模型性能增益。

Air Quality Downscaling with Station-Guided Pseudo-Supervision Figure 1
2026-07-07cs.LG

Air Quality Downscaling with Station-Guided Pseudo-Supervision

Guorun Wang, Simone Foti, Andreas D. Demou, Leonidas Kotoulas, Theodoros Christoudias, Alexandros Koliousis, Mihalis Nicolaou, Stefanos Zafeiriou

2026-07-07视觉感知

针对CAMS等大气场分辨率粗、且与稀疏地面站点观测空间支撑不匹配的问题,论文将欧洲PM2.5估计表述为单时刻的联合下采样与偏差校正任务。核心做法是用OpenAQ站点观测经高斯核传播生成伪监督,并结合人类活动、土地覆盖、地形、AOD和风场等多源信息训练多尺度SegFormer。实验显示STARQ能从约40 km提升到约1 km,恢复更细空间结构,并在未见时间和站点上优于CAMS与S-MESH。

ChatImage: Navigating Long-Form LLM Answers through Interactive Images Figure 1
2026-07-07cs.CV

ChatImage: Navigating Long-Form LLM Answers through Interactive Images

Wencan Jiang, Jiangning Zhang, Yong Liu

2026-07-07视觉感知

ChatImage针对长篇LLM回答以线性文本呈现、难以定位与回访细节的问题,将回答结构化为视觉模块并生成图像,再通过渲染后的视觉 grounding 而非预设坐标放置可点击热点,支持区域解释和局部追问。论文给出参考实现与30题基准,报告交互闭环完成、严格视觉对齐门控和SAM掩码完整性诊断,但具体量化增益文中未充分说明。

Erasing Without Collateral Damage: Precise Concept Removal in Diffusion Models Figure 1
2026-07-07cs.CV

Erasing Without Collateral Damage: Precise Concept Removal in Diffusion Models

Parth Upman, Nishita Jain, Shreyank N Gowda

2026-07-07生成模型

这篇论文针对扩散模型概念擦除中“删目标也伤相近概念”的问题,指出既有 value-space 方法把目标身份与共享视觉结构混在同一方向上移除。作者提出 CARE,用保留概念锚点的协方差估计保留子空间感知的擦除方向,并以闭式算子直接作用于交叉注意力 value,无需微调。实验显示其在实例、风格和名人概念擦除中能保持相近非目标概念更稳定,同时维持相当的擦除效果。

Is the Geometry Doing the Work? An Operating-Point Audit of Hierarchy in Hyperbolic Vision-Language Models Figure 1
2026-07-07cs.CV

Is the Geometry Doing the Work? An Operating-Point Audit of Hierarchy in Hyperbolic Vision-Language Models

Jaeyoung Kim, Eunseok Kim, Dongsuk Jang

2026-07-07视觉语言视觉感知

本文追问双曲视觉语言模型的层级能力是否真由几何机制产生,而非普通对齐或监督带来的表象增益。作者提出以无量纲工作点、径向排序、蕴含锥活性和遍历鲁棒性为核心的审计框架,检查 MERU、HyCoCLIP、PHyCLIP。结果显示已发布模型多处于近欧式区域,曲率和锥机制基本未被有效使用,所谓层级相关性主要由角度相似或数据监督解释。

SteelBench: Evaluating Vision-Language Models in Real-World Industrial Environments Figure 1
2026-07-07cs.CV

SteelBench: Evaluating Vision-Language Models in Real-World Industrial Environments

Suryanarayana Reddy Yarrabothula, Manisha Chawla, Kunal Sinha, Gagan Raj Gupta, Sashank Lekkala, Ashirvadhan Dosapati, Saikamal Nannuri, Katragadda Ajay RamaSwamy Chowdary Gowtham

Indian Institute of Technology Bhilai

2026-07-07视觉语言视觉感知强化学习

论文针对现有视频评测多停留在清晰、受控或模拟场景,难以反映真实钢厂 CCTV 中远距离、粉尘、遮挡和多人并行动作的问题,提出 SteelBench:含 149 小时素材筛出的 1,345 段密集标注工业监控片段,并引入标注来源审计以识别 VLM 预填标签带来的评测偏差。结果显示,未审计的同族模型标签可高估准确率达 17 个百分点,9 个 VLM 最佳动作准确率仅 42.6%,显著低于 84.6% 的人类基准,且安全判断仍大量出错。

Learning Probabilistic Embeddings for Unsupervised Action Segmentation Figure 1
2026-07-07cs.CV

Learning Probabilistic Embeddings for Unsupervised Action Segmentation

Shuai Li, Duc Manh Vu, Juergen Gall

University of Bonn, Germany Lamarr Institute for Machine Learning and Artificial Intelligence, Germany

2026-07-07视觉感知

本文针对无监督长视频动作分割中,基于最优传输生成伪标签的确定性帧嵌入容易过拟合错误伪标签并陷入局部最优的问题,提出用高斯分布建模帧级概率嵌入,并在采样特征上进行OT伪标签估计。方法可嵌入ASOT、VASOT等框架,在Breakfast、50Salads等四个基准上稳定提升,MoF最高增20.7%、F1最高增19.0%,显示不确定性建模对分割鲁棒性有实际贡献。

FlowMark: Mask-Guided Video Watermarking Figure 1
2026-07-07cs.CV

FlowMark: Mask-Guided Video Watermarking

Vishal Asnani, Shruti Agarwal, John Collomosse

2026-07-07视觉感知生成模型

生成视频普及使仅靠可移除元数据难以支撑溯源,视频水印又易受压缩、平台转码和时序编辑影响并产生闪烁。FlowMark的关键在于用轻量Mask Predictor自动选择内容/运动感知的嵌入区域,结合暗区残差调制、时序一致性约束和分阶段噪声训练,在保持高感知质量的同时提升鲁棒性。实验显示其可嵌入128-bit逐帧信息,最高约50.08 dB PSNR,并在社交平台重编码和帧交换、插删、重采样等编辑下保持较可靠恢复。

Shifting from Discrete to Continuous Reference Data: QSM-Derived Horizontal Tree Biomass Distribution for Deep Learning Biomass Estimation Figure 1
2026-07-07cs.CV

Shifting from Discrete to Continuous Reference Data: QSM-Derived Horizontal Tree Biomass Distribution for Deep Learning Biomass Estimation

Nils Griese, Christoph Kleinn, Nils Nölke

Department of Forest Inventory and Remote Sensing, University of Göttingen, Göttingen, Germany, However, they are labor-intensive and costly, which, center point of the plot. However, this ignores the actual, dataset37. The dataset includes 3,386 species-labeled, were filtered using the validation labels provided with

2026-07-07视觉感知

这篇论文针对 LiDAR 生物量估计中传统样地级清查标签易受边界效应影响、尤其小样地噪声大的问题,将 QSM 推导的水平生物量分布作为连续监督信号,并用稀疏 3D U-Net 从 ULS 点云预测生物量图。实验显示,QSM/HBD 参考在小样地上明显优于传统 FI 聚合标签;100 m² 样地中 HBD 使 RRMSE 降低 16.84±4.37%,R² 提高 0.22±0.05,说明增益主要来自更合理的空间化参考数据。

Repurposing CLIP to Localize at Pixel Level Figure 1
2026-07-07cs.CV

Repurposing CLIP to Localize at Pixel Level

Jiaxiang Fang, Shiqiang Ma, Jing Wang, Siyu Chen, Fei Guo, Shengfeng He

2026-07-07视觉感知

这篇论文针对 CLIP 具备开放词汇图像级定位能力、但受全局特征偏置影响难以直接用于像素级分割的问题,提出 CLIPix:从 CLIP 分类过程和视觉-语言 logits 回溯类别相关响应,将其转化为定位线索,并用抗噪校正与定位嵌入缓解伪响应、补充细节。实验在 PASCAL 和 COCO 上报告优于已有方法,说明无需依赖闭集分割器也能较好保持 CLIP 泛化性。

Vision Pretraining for Dense Spatial Perception Figure 1
2026-07-07cs.CV

Vision Pretraining for Dense Spatial Perception

Zelin Fu, Bin Tan, Changjiang Sun, Shaohui Liu, Kecheng Zheng, Yinghao Xu, Xing Zhu, Yujun Shen, Nan Xue

2026-07-07视觉感知

这篇论文针对现有视觉基础模型偏重语义不变性、削弱精细空间感知的问题,将边界和形状不连续从下游输出提升为自监督预训练信号。其核心是 masked boundary modeling:由教师在线发现边界 token,并强制学生在遮挡视图中重建,同时用分类化边界场稳定训练。结果显示,1B LingBot-Vision 在深度、分割、视频跟踪等密集任务上可匹敌或超过更大的 DINOv3,并推动 LingBot-Depth 2.0 在 14 个深度补全基准取得领先;但部分增益可能主要来自 scaling / data。

GUSH3R: Everyone Everywhere All at Once as Gaussians Figure 1
2026-07-07cs.CV

GUSH3R: Everyone Everywhere All at Once as Gaussians

Keito Abe, Kaede Shiohara, Takashi Otonari, Toshihiko Yamasaki

The University of Tokyo

2026-07-07三维

GUSH3R面向单目视频中的动态人—场景重建,针对现有前馈方法难以同时处理非刚性人体与照片级可渲染表示的问题,将人体先验、几何先验与SMPL-X结合,统一提升为静态场景和动态人体的3D Gaussian表示。实验显示其在新视角合成质量上接近优化式和分解式基线,同时显著降低推理开销,但具体增益中各模块贡献仍需结合消融判断。

A Multimodal Reasoning Typology for Grounding Chart-Image Coherence in Science Communication Figure 1
2026-07-07cs.CV

A Multimodal Reasoning Typology for Grounding Chart-Image Coherence in Science Communication

Avina Nakarmi, Sohom Sen, Xun Song, Sreyashi Samaddar, Aritra Dasgupta

Department of Data Science, New Jersey Institute of Technology, Department of Electrical & Computer Engineering, Department of Computer Science, Department of Biology, Brooklyn College

2026-07-07视觉语言视觉感知

本文关注科学论文中图表、图像与说明文字如何共同承载结论这一常被忽略的问题。核心创新是从创伤性脑损伤论文中归纳出R1到R5的多模态推理缺口类型学,用“共同基础”解释读者所需的解释负担。基于79篇论文、人工验证的57组图文关系及VLM描述评判实验,结果显示该层级能预测专家与非专家理解何时一致或分歧。

Probing Geospatial SSL Representations with Environmental Signals Figure 1
2026-07-07cs.CV

Probing Geospatial SSL Representations with Environmental Signals

Rohita Mocharla, Vishal M. Patel

Johns Hopkins Applied Physics Laboratory, Johns Hopkins University

2026-07-07视觉感知

本文针对地理空间自监督模型只靠下游任务评测难以解释表征内容的问题,提出用共址 ERA5 环境变量探测与表征几何指标联合评估。结果显示,DINO、MAE、MoCo 即使下游表现相近,也编码不同程度的环境信号;ERA5 线性可解码性与农业、灾害等环境相关任务表现更相关,而与分布外鲁棒性的关系较弱。

An event-driven framework for fly-inspired visual motion detection Figure 1
2026-07-07cs.CV

An event-driven framework for fly-inspired visual motion detection

Qinbing Fu, Jingyu Huang, Yan Xie, Jigen Peng, Yuchao Tang

2026-07-07视觉感知

针对事件相机虽低延迟、高动态范围但易受噪声影响,且与生物启发运动模型结合不足的问题,论文将 HATS 时间表面编码接入果蝇视叶启发的免训练前馈网络,并加入自底向上注意力抑制背景运动。在 DAVIS 车辆序列中,该框架相比帧式基线在白天和低照夜间都给出更稳定的运动方向响应,也能与对比最大化方法一致识别主导右向运动。

Causal-RetiGraph: Cross-Cohort Retinal Support and Same-Subject Pathway Analysis for Diabetic Retinopathy Figure 1
2026-07-07cs.CV

Causal-RetiGraph: Cross-Cohort Retinal Support and Same-Subject Pathway Analysis for Diabetic Retinopathy

Inam Ullah, Imran Razzak, Shoaib Jameel

2026-07-07视觉感知

针对糖尿病视网膜病变中“影像分级准确但难解释其与全身微血管通路关系”的问题,论文提出 Causal-RetiGraph,将血管、病灶、图像嵌入与 AutoMorph 生物标志物融合为可解释视网膜图表型,并用 NHANES 区分跨队列支持与同受试者通路分析。模型二分类准确率 0.9055、AUROC 0.9711,分级 QWK 0.8312,并指向糖代谢-肾脏和糖代谢-血流动力学通路。

VLM-CASE: Vision-Language Model Enabled Context-Adaptive Safety Envelopes for Anticipatory Safe Autonomous Driving Figure 1
2026-07-07cs.RO

VLM-CASE: Vision-Language Model Enabled Context-Adaptive Safety Envelopes for Anticipatory Safe Autonomous Driving

Tianjia Yang, Ke Li, Ruwen Qin, Xianbiao Hu

2026-07-07视觉语言视觉感知安全鲁棒

面向雨雪、夜间等恶劣工况下自动驾驶既“看不清”又“控不住”的问题,VLM-CASE用经LoRA微调的视觉语言模型从前视图像识别路面与能见度,并将其转化为自适应安全包络,而非只调控制决策;该包络把RSS安全约束与摩擦预算结合,联动限制制动和转向,异步接入MPC以避免阻塞实时控制。CARLA闭环实验中,VLM-CASE-MPC完成全部试验,优于固定包络MPC、普通MPC和VLM-MPC,消融显示摩擦与能见度自适应贡献互补。

FSDC-DETR: A Frequency-Spatial Domain Collaborative DETR for Small Object Detection Figure 1
2026-07-07cs.CV

FSDC-DETR: A Frequency-Spatial Domain Collaborative DETR for Small Object Detection

Aiwen Liu, Chengguang Zhu, Gang Wang, Dandan Zhu, Haodong Lin, Yan Wang, Huiyu Zhou, Zhiyi Pan

2026-07-07视觉感知

该文针对小目标在多尺度聚合和下采样中易丢失高频细节、产生频域混叠的问题,提出 FSDC-DETR,将空间表征与频域表征显式协同建模;其核心在于双分支频空自适应融合、编码器内频空跨尺度交互,以及基于可学习小波的动态下采样来保留高频信息。在 VisDrone-DET2019 和 AITODv2 上分别提升 AP 6.4/6.6,小目标 AP 提升 6.8/6.9。

Claim-Level Rubric Rewards for Video Caption Reinforcement Learning Figure 1
2026-07-07cs.CV

Claim-Level Rubric Rewards for Video Caption Reinforcement Learning

Mingqi Gao, Hongyuan Dong, Yifei Chen, Zhisheng Zhong, Zheng Ruan, Wenjin Hou, Yu Chen, Han Hu, Yansong Tang

Tsinghua Shenzhen International Graduate School, Tsinghua University, University of Chinese Academy of Sciences, LLM Department, Tencent

2026-07-07视觉语言视觉感知强化学习

本文针对密集视频描述中强化学习奖励难设计的问题:整体打分易被风格投机利用,参考文本匹配又过于僵硬。作者提出 CuRe,将描述拆成按视觉类别组织的原子 claim,并用参考 claim 作显著性锚点、视觉验证作事实依据,对参考外但可见的细节给有限奖励。结合 GRPO 后,30B-A3B captioner 在描述准确性、完整性、重描述和 caption-to-QA 评测上优于同规模模型,并超过部分更大开源基线。

Fully Rotation-Equivariant Spectral-Spatial Learning for Multispectral Object Detection Figure 1
2026-07-07cs.CV

Fully Rotation-Equivariant Spectral-Spatial Learning for Multispectral Object Detection

Peng Zhang, Tingfa Xu, Shuaihao Han, Jianan Li

2026-07-07视觉感知

针对多光谱检测中光谱维度被离散处理、金字塔各层光谱/空间线索可靠性变化以及旋转目标缺少显式几何先验的问题,FressDet将连续有序的光谱隐式重采样、可靠性自适应的谱空融合和无参数复制的方向感知头统一到全旋转等变框架中。三组公开基准显示其达到SOTA,并较前一最佳方法减少约93%参数,在旋转扰动下鲁棒性更强。

UNIVERSE: Unified Video Action Models for Autonomous Driving with Flexible Mask-Modulated Modality Generation Figure 1
2026-07-07cs.CV

UNIVERSE: Unified Video Action Models for Autonomous Driving with Flexible Mask-Modulated Modality Generation

Mengmeng Liu, Diankun Zhang, Jiuming Liu, Jianfeng Cui, Hongwei Xie, Guang Chen, Hangjun Ye, Francesco Nex, Hao Cheng, Michael Ying Yang

University of Twente, University of Cambridge, University of Bath

2026-07-07视觉感知

针对自动驾驶世界动作模型中视频预测与轨迹生成分离、导致动态先验难以迁移到规划的问题,UNIVERSE用单个带掩码调制的DiT共同去噪未来视频潜变量和自车轨迹,并用模态解耦可见性掩码阻断未来视频与轨迹互看,从而兼顾共享参数学习与轨迹单独推理。其在NAVSIM达91.0 PDMS,优于Two-DiT的89.6,并在nuScenes、Bench2Drive零样本测试中降低L2误差和碰撞率,轨迹-only推理提速4.3倍。

ASSEMCAD: Production-Ready CAD Assembly Generation from Natural Language Figure 1
2026-07-07cs.AI

ASSEMCAD: Production-Ready CAD Assembly Generation from Natural Language

Yurui Dong, Shu Zou, Siqi Li, Nianchen Deng, Hongbin Zhou, Xuemeng Yang, Pinlong Cai, Licheng Wen, Xinyu Cai, Botian Shi

2026-07-07视觉感知

这篇论文针对自然语言到CAD仍多停留在单零件或静态几何、难以生成可执行机械装配的问题,提出AssemCAD:先用带工程公理的装配规格表达零件、几何端口和配合关系,再通过端口/配合库、按需参数化部件合成与确定性几何验证生成装配。实验称其在AssemBench上相比代码中心基线显著提升装配结构保持和物理有效性,并能跨不同基础模型泛化。

Green for Go, Red for No: Visual Grounding via Semantic Segmentation for VLA Navigation Policies Figure 1
2026-07-07cs.CV

Green for Go, Red for No: Visual Grounding via Semantic Segmentation for VLA Navigation Policies

Adrian Szvoren, Dimitrios Kanoulas, Nilufer Tuptuk

2026-07-07机器人视觉语言视觉感知

这篇论文针对 VLA 导航在复杂视觉场景中易受干扰、难以判断可通行区域的问题,评估一种无需重训的语义分割视觉 grounding:用 SegFormer 将可通行区域标绿、不可通行区域标红,并比较仅增强观测与同时增强目标两种设置。在 OmniVLA 与 Grand Tour 数据集上,该方法使最远路点平均误差下降 27%–44%,长指令收益更明显,但对图像目标帮助有限;归一化分析显示增益更多来自缩短预测轨迹、类似路径长度正则化,而非真正提升单位距离推理能力。

Semantic Video Communication via Multi-Scale Convolution and Dynamic Routing for Next-Generation Networks Figure 1
2026-07-07cs.CV

Semantic Video Communication via Multi-Scale Convolution and Dynamic Routing for Next-Generation Networks

Gengtian Shi, Jinze Yu, Chenhao Wu, Shaofei Wang, Eiji Fukuzawa, Junjie Tang, Hiroshi Onoda, Jiang Liu

2026-07-07视觉感知

面向下一代网络中视频流量过高、边缘设备难以传输完整视频的问题,论文把语义视频通信转化为视频—文本时序定位:用多尺度一维时序卷积以 O(T) 复杂度建模不同粒度动作,再用胶囊动态路由处理非单调、多对多的片段—查询对齐,并联合优化边界回归、跨模态对齐和胶囊多样性。在 ActivityNet Captions 上报告 Recall@0.5 为 42.9%、mIoU 为 41.1%,同时强调计算效率适合边缘部署。

Be Indiscrete: The Benefits of Learning Continuous Spine Degeneration Severity Scores Figure 1
2026-07-07cs.CV

Be Indiscrete: The Benefits of Learning Continuous Spine Degeneration Severity Scores

Maria Monzon, Andrew Zisserman, Robin Y. Park, Catherine R. Jutzeler, Amir Jamaludin

2026-07-07视觉感知

本文针对腰椎 MRI 退变本质连续、却常被硬切成离散等级的问题,提出 SpineRankNet,用成对排序损失学习 0–10 连续严重度分数,再映射回临床等级。结果显示其在 11 个 Genodisc 分级任务上保持接近分类模型的判别能力,同时提升 QWK、降低 MAE,尤其减少跨远等级误判;但外部队列和纵向临床效用仍文中未充分验证。

TimeThink: Reasoning with Time for Video LLMs Figure 1
2026-07-07cs.CV

TimeThink: Reasoning with Time for Video LLMs

Handong Li, Longteng Guo, Zikang Liu, Dongze Hao, Yepeng Tang, Zijia Zhao, Jie Jiang, Zhiwei Jin, Chen Chen, Haonan Lu, Jing Liu

2026-07-07视觉感知

这篇论文针对长视频推理中模型只凭最终答案奖励学习、难以定位关键时间证据的问题,提出 TimeThink:把推理拆成带时间区间引用的“时间线索步骤”,并用逐步时间过程奖励结合最终结果奖励进行强化学习。作者还构建 TimeThink-RFT-20K 自动证据段数据集;实验称其在视频推理、时间定位和通用视频理解基准上均提升表现,并在开源视频 RL 模型中达到较优结果。

RADIANCE: Relative Adaptive Denoising with IP-Adapter for Novel Concept Enhancement Figure 1
2026-07-07cs.CV

RADIANCE: Relative Adaptive Denoising with IP-Adapter for Novel Concept Enhancement

Zi-Xiang Ni, Bo-Lun Huang, Teng-Fang Hsiao, Bo-Kai Ruan, Hong-Han Shuai

2026-07-07视觉感知

本文针对文本到图像模型在“罕见属性—对象”组合中易遗漏属性或语义漂移的问题,提出无需训练的 RADIANCE,将扩散采样视为闭环反馈:用 CLIP 监测中间潜变量中的对象与属性显现,再通过正负 IP-Adapter scaling 动态增强弱概念、抑制强概念,并扩展到多对象场景。RareBench 和 T2I-CompBench 结果显示其提升组合对齐、罕见属性保真度与感知质量,但整体空间布局仍受骨干模型先验限制。

LangLoc: "Tell Me What You See" Figure 1
2026-07-07cs.CV

LangLoc: "Tell Me What You See"

Shaurya Kishore Panwar, Roham Zendehdel Nobari, Shirley Feng Yi Lau, Abu Bakr Rahman Shaik, Manuel Günther, Marc Pollefeys, Daniel Barath

2026-07-07视觉感知

LangLoc针对室内定位依赖图像带来的带宽、隐私和取景限制,探索仅用自然语言描述恢复已知3D环境中的位置与朝向。其核心是先用融合CLIP语义的双分支GATv2做场景检索,再以物体可见性射线投影在地面网格上评分,并通过贝叶斯是/否对话消除歧义。实验显示检索Top-1较既有方法提升约8个百分点,细粒度定位中位误差约0.95米,对话后在ScanNet上可降至厘米级。

Consistent and Editable: A Balanced Framework for Text-Guided Video Editing Figure 1
2026-07-07cs.CV

Consistent and Editable: A Balanced Framework for Text-Guided Video Editing

Tao Jin, Li Xiao

2026-07-07视觉感知

本文针对文本引导视频编辑中“改得动”与时序一致性难以兼得的问题,提出一站式微调框架 EquiEdit:用带四向时序感知扫描的 Temporal Mamba 建模跨帧关系,并通过傅里叶域约束的噪声注入提升可编辑性同时保留结构。实验与消融显示其在一致性、文本对齐和输入保真之间取得更好平衡,但具体增益幅度依赖文中基准设置。

RUFNet: Query-Guided Support Mask Refinement and Uncertainty Fusion based on Hybrid Mamba for Few-Shot Brain Tumor Segmentation Figure 1
2026-07-07cs.CV

RUFNet: Query-Guided Support Mask Refinement and Uncertainty Fusion based on Hybrid Mamba for Few-Shot Brain Tumor Segmentation

Dongyi He, Xiangkai Wang, Binbing Xu, Bin Jiang, Hongjie Yan, Weixiang Liu, Wai Ting Siok, Nizhuan Wang

Department of Language Science and Technology, The Hong Kong Polytechnic University, Hong Kong SAR, China, School of Artificial Intelligence, Chongqing University of Technology, Chongqing, China, Affiliated Lianyungang Hospital of Xuzhou Medical University, Lianyungang, China, College of Mechatronics and Control Engineering, Shenzhen University, Shenzhen, China

2026-07-07视觉感知安全鲁棒

该文针对少样本脑肿瘤分割中支持掩码噪声、跨患者差异和缺少像素级置信度的问题,提出 RUFNet:用 Hybrid Mamba 低成本建模支持-查询长程依赖,并以查询引导细化支持掩码,再用不确定性后验融合调节模糊区域预测。在 BraTS 2020 上,1-shot/5-shot Dice 达 84.3%/86.1%,优于对比方法。

Beyond Modality Fusion: Deep Ensembles for Multimodal Classification Figure 1
2026-07-07cs.LG

Beyond Modality Fusion: Deep Ensembles for Multimodal Classification

Ilya Burenko, Dmitry Vetrov

Constructor University

2026-07-07视觉语言

针对多模态分类中强弱模态不均衡会使后期融合反而弱于最佳单模态的问题,论文提出不显式做模态融合,而是训练单模态深度集成,并给出按模态分配模型数量的启发式。结果显示在相同参数量下,该方法持续优于多种处理不均衡的后期/中期融合和混合方法;极端不均衡、小集成时只用强模态更好,规模增大后弱模态才带来收益。

Comparison of Loss Functions for Robust Deep Learning-based Echocardiography Segmentation when Learning with Partially Labelled Data from Multiple Domains Figure 1
2026-07-07cs.CV

Comparison of Loss Functions for Robust Deep Learning-based Echocardiography Segmentation when Learning with Partially Labelled Data from Multiple Domains

Iman Islam, Esther Puyol-Antón, Bram Ruijsink, Andrew J. Reader, Andrew P. King

2026-07-07视觉感知安全鲁棒

针对多来源超声心动图数据常存在结构标注不完整、直接合并训练会产生前景/背景监督冲突的问题,论文系统比较 aCCE、marginal loss 与 aBCE 在部分标注分割中的鲁棒性。核心洞察是损失函数选择取决于域偏移和缺失标签数量:同域内三者均接近全标注训练;跨域且单标签缺失时 aBCE 与 marginal 更稳,多标签缺失时 marginal loss 表现最佳。

Unsupervised Pixel-Level Semantic Left-Right Understanding of In-the-Wild Images Figure 1
2026-07-07cs.CV

Unsupervised Pixel-Level Semantic Left-Right Understanding of In-the-Wild Images

Weikang Wang, Tobias Weißberg, Florian Bernard

2026-07-07视觉感知

这篇论文针对单目野外图像中因缺少3D信息、遮挡、姿态变化和局部可见而难以做像素级语义左右判断的问题,提出Pix2LR无监督框架:把3D形状上的逐顶点左右语义迁移到图像训练中,并结合有限类别3D数据与更广泛图像数据,通过逐顶点预测聚合保持一致性。结果显示其在渲染和真实图像上优于现有方法,并能泛化到汽车、火车等未见类别。

Geometry-aware Depth-guided Representation Learning for Structure-preserving Low-light Image Enhancement Figure 1
2026-07-07cs.CV

Geometry-aware Depth-guided Representation Learning for Structure-preserving Low-light Image Enhancement

Fang Gao, Jiongkai Qin, Jiabao Wang, Jingfeng Tang, Ming Cheng, Hanbo Zheng, Qingbao Huang, Cheng Wu

a School of Electrical Engineering, Guangxi University, Nanning, Guangxi 530004, China, b School of Rail Transportation, Soochow University, Suzhou, Jiangsu 215500, China

2026-07-07视觉感知

低照度增强常提升亮度却破坏边缘、纹理和场景结构,影响后续视觉感知。本文将LLIE视为几何一致的表征恢复问题,提出DMSA-Net:先用Retinex分解获得较抗光照的反射分量以估计深度,再在编码器中以多尺度深度注意力融合几何与外观特征,并构建LOL-D数据集。实验称其在多个基准上提升复原质量和结构保持,但具体增益中深度先验与数据扩展的贡献仍需进一步拆分说明。

Virtual Category-Guided Continual Generalized Category Discovery Figure 1
2026-07-07cs.CV

Virtual Category-Guided Continual Generalized Category Discovery

Jiahui Xiong, Qiuxia Lai, Hongsong Wang

2026-07-07视觉感知

面向机器人等开放环境中的持续视觉感知,本文关注无标注数据流里旧类、新类与边界样本混杂导致伪标签误差累积的问题。核心做法是把不确定样本暂放入临时“虚拟类别”,避免过早硬分配,并结合扩展邻域对比学习拉开新旧类别表征间隔。实验在 CIFAR-100、Tiny ImageNet 和 ImageNet-100 上优于现有 C-GCD 方法,表现为更好的整体识别、未知类发现和遗忘缓解。

Qantara: Bridge-Flow Training for Multi-Paradigm JEPA Control Figure 1
2026-07-07cs.LG

Qantara: Bridge-Flow Training for Multi-Paradigm JEPA Control

Ruslan Rakhimov, George Bredis, Yuriy Maksyuta, Daniil Gavrilov

2026-07-07生成模型规划控制

Qantara针对像素控制中JEPA世界模型训练时被迫绑定规划或行为克隆范式的问题,提出在状态轴用Brownian bridge、动作轴用flow matching,并把噪声采样集中到推理会查询的边与角,使单个约2100万参数checkpoint可同时做潜变量规划、动作采样和视频-逆动力学。实验在LeWM suite平均达91.2 SR,OGBench-Cube较DINO-WM高7.7 SR,低成本BC/逆动力学路径也在Push-T和Cube取得较强成功率。

MemPose: Category-level Object Pose Estimation with Memory Figure 1
2026-07-07cs.CV

MemPose: Category-level Object Pose Estimation with Memory

Xiao Lin, Minghao Zhu, Yun Peng, Liuyi Wang, Qiyi Wang, Chengju Liu, Qijun Chen

2026-07-07三维

MemPose针对类别级物体位姿估计中过度依赖固定形状先验或静态网络参数、难以覆盖类内差异的问题,提出把几何经验显式存入可动态更新的外部记忆。其核心是用记忆缓冲区保存历史实例的结构特征,并通过相似性token合并与注意力检索,将相关类别级几何信息融合到当前RGB-D关键点表示中以预测9-DoF位姿。实验在REAL275、CAMERA25、Housecat6D和Wild6D上优于既有方法;与AG-Pose相比参数和速度开销很小,替换为同参MLP后性能下降,说明增益主要来自记忆机制。

UniSpine-GS: An Efficient Physics-Aware Gaussian Framework for Cross-Modality Multi-view Spine Image Synthesis Figure 1
2026-07-07cs.CV

UniSpine-GS: An Efficient Physics-Aware Gaussian Framework for Cross-Modality Multi-view Spine Image Synthesis

Qiuhua Chen, Changning Yu, Na Huang, Chao Sun, Bo Du

2026-07-07视觉感知三维

针对三维脊柱评估依赖昂贵设备、跨X射线/超声模态外观差异导致多视图一致性差的问题,UniSpine-GS用显式3D高斯结合可微DRR前向算子学习几何感知表示,并用SPWM重加权突出椎骨边界与纹理区域。在CTSpine3D和新建FeSpine3D上,其多项指标优于现有方法,但超声物理仅采用投影代理,真实声学建模能力文中未充分说明。

Efficient Perception in Automotive Detection and Tracking Using Neuromorphic Computing Figure 1
2026-07-07cs.CV

Efficient Perception in Automotive Detection and Tracking Using Neuromorphic Computing

Manish Kolachalam, Rani Malhotra

Applied Research Center for Autonomous Machines, Infosys Center for Emerging Technologies, Bangalore

2026-07-07视觉感知

面向自动驾驶边缘感知的高算力与能耗压力,本文将脉冲神经网络与 SpikeYOLO 迁移学习用于真实车载多目标检测与跟踪,核心洞察是事件驱动的 SNN 有望在保持精度的同时适配神经形态硬件。实验在 KITTI 上检测 mAP 达 0.937、BDD100K MOT2020 达 0.771,跟踪 HOTA 分别为 0.701 和 0.445,显示其已接近传统 ANN 基线,但能效收益尚未在专用硬件上实测。

Graph Representation Learning of Longitudinal Medical Imaging Trajectories for Treatment Response Prediction Figure 1
2026-07-07cs.CV

Graph Representation Learning of Longitudinal Medical Imaging Trajectories for Treatment Response Prediction

Johannes Kiechle, Richard Osuala, Daniel M. Lang, Stefan M. Fischer, Ivana Janíčková, Karim Lekadir, Julia A. Schnabel, Jan C. Peeken

2026-07-07视觉感知

针对乳腺癌新辅助化疗中仅靠单时点影像难以捕捉疗效演变的问题,论文将多时点3D DCE-MRI特征组织为有向无环图,用GraphSAGE建模时间关系,并设计响应感知的群体对齐、患者去相关和时间一致性自监督目标。在585例ISPY-2数据上,该方法较视觉与自监督基线在多项pCR分类指标上更优,消融也支持GNN关系建模和各损失项的贡献。

3DMPE: 3D Multi-Perspective Embedding Figure 1
2026-07-07cs.CV

3DMPE: 3D Multi-Perspective Embedding

Vahan Huroyan, Md Rahat-uz-Zaman, Stephen Kobourov

2026-07-07三维

这篇论文针对多视角2D观测中常见的遮挡、缺点和距离信息不完整问题,研究在已知跨视角点对应与可见性后如何恢复一致的3D点云。核心做法是将多视角同步嵌入扩展为3DMPE,用显式可见性约束处理缺失点,并支持已知或联合估计投影。ShapeNet和Pix3D实验显示,在多数点能被多个视角看到时重建较准确,但方法依赖可靠对应关系,尚非端到端图像重建。

ProCon: Projection-Consistency Memory for Training-Free Anomaly Detection Figure 1
2026-07-07cs.CV

ProCon: Projection-Consistency Memory for Training-Free Anomaly Detection

Joongwon Chae, Lihui Luo, Yang Liu, Dongmei Yu, Peiwu Qin, Runming Wang, Ilmoon Chae

2026-07-07视觉感知

ProCon针对记忆库异常检测中过度依赖最近邻匹配、易把缺陷误判为正常的问题,提出将正常记忆从查表器改为无训练的软投影算子:用局部正常邻域重构测试patch,并以投影残差作为异常证据,再通过多种子记忆中位数和多层DINOv2残差共识稳定结果。其在MVTec-AD、VisA、Real-IAD上取得99.8%、99.2%、93.2%图像AUROC,并通过消融表明增益主要来自软投影残差与共识机制,而非单纯扩大记忆库。

HunyuanOCR-1.5: Making Lightweight OCR VLMs Faster and Better Figure 1
2026-07-07cs.CV

HunyuanOCR-1.5: Making Lightweight OCR VLMs Faster and Better

Gengluo Li, Xingyu Wan, Shangpin Peng, Weinong Wang, Hao Feng, Yongkun Du, Binghong Wu, Zheng Ruan, Zhiqiong Lu, Liang Wu, Pengyuan Lyu, Huawen Shen, Zibin Lin, Shijing Hu, Jieneng Yang, Hongbing Wen, Guanghua Yu, Hong Liu, Bochao Wang, Can Ma, Han Hu, Chengquan Zhang, Yu Zhou

Institute of Information Engineering, Chinese Academy of Sciences, Large Language Model Department, Tencent, Nankai University

2026-07-07视觉语言

面向真实 OCR 不止文档转 Markdown、且长结构化输出解码慢的问题,HunyuanOCR-1.5在保持轻量端到端架构基本不变的基础上,引入 DFlash 投机解码加速,并用 Agentic Data Flow 针对低资源、多图问答、古文字、表格图表等短板构造数据,配合4K输入、128K上下文和训练配方升级。结果显示其在 Transformers/vLLM 下分别获得6.37×/2.14×推理加速,并在 OmniDocBench v1.6及多类长尾 OCR 任务上达到领先表现;部分能力增益可能主要来自 data 与训练扩展。

Unsupervised Detection of Underground Tunnels in Ground-Penetrating Radar Using Depth-Restricted Reconstruction Scoring Figure 1
2026-07-07cs.CV

Unsupervised Detection of Underground Tunnels in Ground-Penetrating Radar Using Depth-Restricted Reconstruction Scoring

Muhammad Junaid, Shoab A. Khan, Nisar Ahmed

2026-07-07视觉感知三维

面向油气管线下方非法隧道难以及早发现、且真实隧道标注稀缺的问题,本文用仅由正常GPR雷达图训练的去噪卷积自编码器做无监督异常检测;关键洞察是不要全图平均重建误差,而是在隧道物理可能出现的深度带内取top-k误差。该深度受限评分将AUC由0.986提高到0.994,漏检从634个隧道窗口中的74个降至17个,最终在1600个野外窗口上达到F1 0.975、召回0.973。

EventCoT: Event-centric Video Chain-of-thought for Reasoning Temporal Localization Figure 1
2026-07-07cs.CV

EventCoT: Event-centric Video Chain-of-thought for Reasoning Temporal Localization

Youngkil Song, Yoonjae Baek, Dongwon Kim, Inho Kim, Dongkeun Kim, Suha Kwak

Pohang University of Science and Technology, Pohang, South Korea, Korea Advanced Institute of Science and Technology, Daejeon, South Korea, Handong Global University, Pohang, South Korea

2026-07-07视觉感知

针对视频问答中推理答案与支持时间段需同时生成、而均匀采样带来冗余且离散时间 token 会纠缠定位与生成的问题,EventCoT 将视频先压缩为事件 token,按问题选择相关事件,再用占位符与视觉嵌入匹配来定位起止时间。在 ActivityNet-RTL 上取得 SOTA,并在 ReXTime 上有较强零样本表现,同时显著减少视觉 token 和推理开销。

PAGE: Towards Practical Human-level Gaze Target Estimation Figure 1
2026-07-07cs.CV

PAGE: Towards Practical Human-level Gaze Target Estimation

Zhoutong Ye, Chengwen Zhang, Zhaibin Cui, Mingze Sun, Jiaqi Liu, Xiangwu Li, Qingyang Wan, Chang Liu, Xutong Wang, Huan-ang Gao, Yu Mei, Chun Yu, Yuanchun Shi

Tsinghua University 2 Jinan University † Corresponding Author ∗ Equal Contribution

2026-07-07视觉感知

这篇论文针对凝视目标估计在机器人和人机交互中需要同时理解场景语义与头部/眼部空间线索、现有模型仍低于人类的问题,提出 PaGE:用场景-头部交互模块以交叉注意力显式融合双分支特征,并结合冻结骨干训练、全模型微调和大规模无标注特征蒸馏。结果显示其在 GazeFollow、VAT、ChildPlay 等任务上达到 SOTA,9 项指标中 7 项超过人类,学生模型以约 10% FLOPs 保留多数性能,具备部署潜力。

TGRIP: A Text-Guided Approach to Vehicle Instance Prediction in Autonomous Driving Figure 1
2026-07-07cs.CV

TGRIP: A Text-Guided Approach to Vehicle Instance Prediction in Autonomous Driving

Miguel Antunes-García, Santiago Montiel-Marín, Fabio Sánchez-García, Rodrigo Gutiérrez-Moreno, Rafael Barea, Luis M. Bergasa

2026-07-07视觉感知

针对BEV端到端车辆实例预测过度依赖占用、光流等几何监督、难以区分交互场景中不同车辆语义的问题,TGRIP用视觉语言基础模型从多相机图像生成语义增强BEV图,作为训练期教师监督注入时空表示。论文称这是将开放词汇语义引导用于未来实例预测的早期尝试,并在nuScenes上超过现有方法,显示语义先验有助于实例关联和运动预测。

Hybrid Deep Learning for Traceability and Classification of Industrial Slate Tiles Figure 1
2026-07-07cs.CV

Hybrid Deep Learning for Traceability and Classification of Industrial Slate Tiles

Soren Antebi, Stefan Eickeler, Sandra Halscheidt, Rene Schmitz, Michael Muellers, Dirk Hecker, Rafet Sifa

2026-07-07视觉感知

面向板岩瓦生产中人工判别矿源和单片追踪成本高、易受自然纹理差异影响的问题,论文将 XFeat+LightGlue 的局部匹配分支与 MobileNetV3 分类分支融合,兼顾实例重识别和产地分类。新建 2610 张工业图像数据集上,匹配 AUC 较 XFeat 提升约 15.4%,分类准确率较标准 MobileNetV3 提升 10.9%。

LILAC: Layer-Wise Independent LoRAs and Cascaded Conditioning for Multi-Concept Customization of Diffusion Models Figure 1
2026-07-07cs.CV

LILAC: Layer-Wise Independent LoRAs and Cascaded Conditioning for Multi-Concept Customization of Diffusion Models

Marian Lupascu, Sebastian Ripa, Mihai Trascau, Mariana-Iuliana Georgescu, Ionut Mironica

2026-07-07生成模型

多主体个性化扩散生成的难点在于多个独立 LoRA 合并到同一权重空间时会产生身份混淆和风格串扰。LILAC 的核心洞察是改用分层合成:推理时按顺序生成主体,每次只启用一个概念 LoRA,并以上一步冻结合成为条件,从结构上避免参数级干扰且无需联合训练。实验在 Orthogonal Adaptation 协议下,Qwen-Image-Edit+Layered 配置的 ArcFace 检测率达 0.861,高于原设定 0.745,但代价是随主体数线性增加采样时间,复杂接触遮挡仍受限。

DGSeg: Dynamic Gating of Semantic-Spatial Guided Predictions for Reasoning Segmentation Figure 1
2026-07-07cs.CV

DGSeg: Dynamic Gating of Semantic-Spatial Guided Predictions for Reasoning Segmentation

Ruizhe Zeng, Siyu Cao, Lu Zhang, Zhiyong Liu

2026-07-07视觉感知

DGSeg面向复杂语言指令下的推理分割,动机是现有MLLM把推理压缩成点、框等稀疏提示时易引入歧义,影响机器人/具身场景所需的精确定位。其核心洞察是将语义“是什么”和空间“在哪里”分支解耦,再用动态门控按像素融合并抑制噪声提示。实验显示其在多个指代表达与推理分割基准优于强基线,在ReasonSeg验证/测试集达到69.6%和67.3% gIoU。

SLAM: Structured and Localized Analytic Manifold Adaptation for Lifelong VPR Figure 1
2026-07-07cs.RO

SLAM: Structured and Localized Analytic Manifold Adaptation for Lifelong VPR

Kenta Tsukahara, Kanji Tanaka, Rai Hisada

2026-07-07视觉感知

面向长期部署中的视觉地点识别,论文针对连续新环境带来的灾难性遗忘、噪声过拟合和多模态分布漂移,提出 SLAM:把解析增量学习与状态估计类比,结合 Unscented 扰动平滑、GMM 局部拓扑划分和 H∞ 鲁棒界的闭式递归更新。NCLT 10 任务、100 类实验显示,U+G 组合取得最高 27.5% 准确率;完整 H∞ 版本略低但提供精度—鲁棒性权衡。

DeGenseGS: Geometrically and Semantically Decoupled Surgical Scene Understanding in 4D Gaussian Splatting Figure 1
2026-07-07cs.CV

DeGenseGS: Geometrically and Semantically Decoupled Surgical Scene Understanding in 4D Gaussian Splatting

Yimo Wang, Bin Kang, Shuojue Yang, Yueming Jin

2026-07-07三维

面向自主手术中动态解剖既要4D重建又要可文本查询语义的问题,DeGenseGS指出现有4DGS把语义特征与几何形变刚性绑定,易在烧灼等外观突变场景引入虚假几何扭曲。其用HexPlane共享运动潜变量但分支解码几何与语义,并结合栅格化原生语义提取和角度对齐蒸馏;在CholecSeg8k与EndoVis18上报告达到SOTA,提升几何完整性和语义-解剖对齐。

Continual Model Merging with Test-Time Adaptation for Whole-Slide Image Analysis Figure 1
2026-07-07cs.CV

Continual Model Merging with Test-Time Adaptation for Whole-Slide Image Analysis

Duc-Thanh Le, Doanh C. Bui, Maï K. Nguyen, Khang Nguyen

2026-07-07视觉感知

针对WSI癌症分类中任务持续增加、历史切片难以保存且微调易遗忘的问题,论文将AdaMerging、AdaRank、Hi-Vec等测试时自适应模型合并方法系统迁移到无回放持续学习场景,并在六个TCGA队列评测。结果显示,该思路能提升当前任务表现并在部分设置中优于传统持续学习的知识保持,但对任务顺序和仅依赖当前无标签测试分布的适应非常敏感。

FM-ChangeNet: Learning Change through Pathwise Feature Transport Figure 1
2026-07-07cs.AI

FM-ChangeNet: Learning Change through Pathwise Feature Transport

Roie Kazoom, George Leifman, Genady Beryozkin

2026-07-07视觉感知

针对遥感双时相变化检测中端点特征差分容易混淆光照、错位与真实结构变化的问题,FM-ChangeNet 将变化建模为特征空间中的连续传输路径,并用时间条件速度场监督中间状态;速度幅值同时作为可解释的局部变化线索。结合跨时相对齐和多尺度解码后,文中报告其在遥感基准上达到最优或竞争性能,但对强分布偏移和大规模效率的验证仍不足。

MergeSurv: Merging-Based Continual Learning for Survival Analysis on Whole-Slide Images Figure 1
2026-07-07cs.CV

MergeSurv: Merging-Based Continual Learning for Survival Analysis on Whole-Slide Images

Vu Minh Tran, Doanh C. Bui, Maï K. Nguyen, Khang Nguyen

2026-07-07视觉感知

针对全切片病理图像生存预测在新增癌种/队列时需反复训练、存储成本高且有隐私风险的问题,MergeSurv将各任务上微调的TITAN病理基础模型参数顺序合并为统一模型,并比较单头OFA与多专家投票VEA推理。四个TCGA队列实验显示,其较朴素微调、正则化和回放式持续学习能降低灾难性遗忘,VEA风险分层表现更稳。

Trajectory-Anchor Optimization for Overconfident Thermal Visual Place Recognition: Zero-Leakage OOD Auditing and Kidnapped-Robot Recovery Figure 1
2026-07-07cs.RO

Trajectory-Anchor Optimization for Overconfident Thermal Visual Place Recognition: Zero-Leakage OOD Auditing and Kidnapped-Robot Recovery

Zhiyuan Lu, Kanji Tanaka

2026-07-07机器人视觉感知规划控制优化算法

本文针对热红外视觉地点识别在未建图/OOD场景中“高置信误匹配”会污染SLAM后端的问题,提出TAO:将多假设时序验证压缩为批量SE(2) Procrustes对齐和一次SVD,避免MHT树扩展开销。结果显示其在5米微尺度难以区分一致性幻觉,但在10米级大范围失配中AUC最高0.991,可作为有边界的轻量故障过滤器。

DriftST: One-Step Generative Inference of Spatial Transcriptomics from H\&E Histology Figure 1
2026-07-07cs.CV

DriftST: One-Step Generative Inference of Spatial Transcriptomics from H\&E Histology

Yuhang Yang, Yonggan Bu, Shengyuan Zhou, Yiming Luo, Kai Zhang

University of Science and Technology of China, Hefei, China, Peking University Cancer Hospital, Beijing, China

2026-07-07生成模型

DriftST针对空间转录组成本高、H&E到基因表达预测中回归过平滑而生成模型推理慢的问题,提出Cellular Drifting以一步生成表达分布,并用STransformer建模基因共表达依赖与基因重要性差异。文中称其可统一处理spot级和cell级数据,并在多组织、多平台实验中达到SOTA;但摘要片段未充分说明具体增益幅度与数据规模影响。

SparseOcc++: Geometry-Aware Sparse Latent Representation for Semantic Occupancy Prediction Figure 1
2026-07-07cs.CV

SparseOcc++: Geometry-Aware Sparse Latent Representation for Semantic Occupancy Prediction

Pin Tang, Zhongdao Wang, Guoqing Wang, Xiangxuan Ren, Chao Ma

2026-07-07视觉感知

面向自动驾驶的视觉 3D 语义占据预测,论文针对稠密体素计算冗余、BEV/TPV 损失细粒度结构,以及既有稀疏方法将几何补全与语义分类耦合导致空区域激活过多的问题,提出 SparseOcc++。核心做法是用稀疏锚点上的 Scene Completion Field 将场景补全改写为边界距离回归,并通过正交分解、离散学习和几何引导传播,只在几何确认区域做语义预测。实验称其在 nuScenes 上 IoU 较 SparseOcc 提升 2.3% 且快 3.9 倍,在 SemanticKITTI 上较 OccFormer 快 5.9 倍。

When Does High-CFG Diffusion Inversion Fail? A Controlled Study of Prompt--Latent Interactions Figure 1
2026-07-07cs.CV

When Does High-CFG Diffusion Inversion Fail? A Controlled Study of Prompt--Latent Interactions

Yan Zeng, Yusuke Hosoya, Huyen T. T. Tran, Takayuki Okatani

2026-07-07生成模型规划控制

本文关注图像编辑中高 CFG 生成轨迹为何难以被反演:低 CFG 反演虽常用,却会与高 CFG 编辑产生轨迹错配。作者在已知初始 latent 与去噪轨迹的受控生成—反演—重建实验中发现,提示词存在易、难和依赖 prompt–latent 配对的中间三类;提出“prompt pressure”解释粗粒度难度但不足以预测中间失败。局部不稳定步降低 guidance 的轨迹一致性干预能改善重建和 Prompt-to-Prompt 编辑,说明失败更依赖局部轨迹而非单一提示词或种子因素。

Dashboard2Code: Evaluating Multimodal Models on Reconstructing Interactive Dashboards Figure 1
2026-07-07cs.SE

Dashboard2Code: Evaluating Multimodal Models on Reconstructing Interactive Dashboards

Tianhao Niu, Ziyu Han, Qiguang Chen, Shiqi Zhou, Baocai Shan, Hengjie Fang, Qingfu Zhu, Wanxiang Che

Research Center for Social Computing and Interactive Robotics, Harbin Institute of Technology, China

2026-07-07视觉语言

这篇论文针对现有可视化生成多停留在静态图表、难以评估模型主动理解交互式仪表盘的问题,提出 Dashboard2Code 任务与 DashboardMimic 基准,要求模型通过点击、筛选等探索反馈生成可复现视觉和交互逻辑的 Dash 代码,并结合语义分析与动态交互测试自动评估。实验显示,最强闭源模型在复杂仪表盘上仍明显退化,开源模型差距更大,瓶颈主要在主动探索、细粒度视觉细节和复杂回调逻辑复现。

Reference-Induced Consensus for Selective Posed-Reference Visual Localization Figure 1
2026-07-07cs.CV

Reference-Induced Consensus for Selective Posed-Reference Visual Localization

Wonseok Kang, Jaehyun Kim, Jeongmin Lee, Tae-Wan Kim

2026-07-07三维

这篇工作针对视觉定位中“给错姿态比不返回更危险”的问题,提出 RIC-Loc:用已知位姿参考图和冻结 VGGT 生成每个参考诱导的查询位姿假设,再做鲁棒共识,并保留假设分歧与轨迹条件协方差作为拒识置信度。结果显示其无需场景训练、SfM 点图或 PnP,室内精度可接近结构化定位,且失败检测 AUROC 明显优于检索分数间隔,低纹理场景中协方差分数更有效。

Learning Probabilistic Prompt for Continual Learning Figure 1
2026-07-07cs.CV

Learning Probabilistic Prompt for Continual Learning

Hyekang Park, Sanghoon Lee, Geon Lee, Jongyoun Noh, Bumsub Ham

2026-07-07视觉感知

本文针对基于提示的持续学习中“prompt collapse”问题:固定提示向量会彼此趋同,难以覆盖任务内与任务间多样视觉分布。作者将每个提示建模为概率分布,并用混合分布采样多样提示,同时加入分布正则以稳定跨任务更新。实验在 ImageNet-R、CIFAR-100、CUB-200 上提升 FAA/CAA,消融显示概率化、混合建模与正则项均有贡献。

Hierarchical Scaffolding Enables Human-Like Cognitive Selectivity under Data Scarcity Figure 1
2026-07-07cs.LG

Hierarchical Scaffolding Enables Human-Like Cognitive Selectivity under Data Scarcity

Juhyoung Park, Jaehyuk Bae, Hyeonbo Yang, Se-Bum Paik

School of Computing, Department of Brain and Cognitive Sciences, Korea Advanced Institute of Science and Technology, Daejeon, Republic of Korea

2026-07-07视觉感知

针对小样本视觉识别中平面标签难以同时学习粗粒度语义与细粒度差异的问题,论文提出 SCALA,将类别标签显式组织为从粗到细的层级脚手架,并通过聚合细类 logits 进行阶段式监督。实验显示该方法在数据稀缺下提升分类准确率,使表征更紧凑可分,且增强对未见类别的高层泛化与新类适应;但具体增益对人工层级设计的依赖仍需进一步验证。

Probe-EM: Targeted Neuron Tracing via Training-Free Semantic Verification Figure 1
2026-07-07cs.CV

Probe-EM: Targeted Neuron Tracing via Training-Free Semantic Verification

Liuyun Jiang, Yanchao Zhang, Jinyue Guo, Chuanyue Chen, Haiyang Yan, Ye Yuan, Jing Liu, Hua Han

2026-07-07视觉感知

针对大规模电镜连接组重建中过分割导致的高昂人工校对成本,Probe-EM将神经元追踪改写为从用户种子段出发的局部检索问题,用骨架端点引导启发式空间搜索,并结合基于NeuroSAM 2的免训练维度感知语义验证处理片内与片间断裂。实验称其优于监督式基线,并将人工校对时间减少33.4%。

Solve the Missing First Step: Can VLMs Standardize Raw Heterogeneous Medical Data? Figure 1
2026-07-07cs.CV

Solve the Missing First Step: Can VLMs Standardize Raw Heterogeneous Medical Data?

Xin Chen, Dongliang Xu, Cunhao Zhu, Xudong Luo, Haoyang Lyu, Xiaoxiao Sun, Serena Yeung-Levy, Yue Yao

Shandong University, Stanford University

2026-07-07视觉语言

论文指出医疗 VLM 评测常默认输入已被清洗,但真实临床数据往往分散在异构文件、标注和元数据中,前置标准化才是缺失环节。作者构建 MDS-Bench,将原始数据夹到图像-JSON 的源对齐转换作为任务,覆盖 1939 个样本和多种模态/任务,并用 11 项指标评估。实验显示最佳 Gemini 3 Flash 端到端成功率仅 48.6%,说明瓶颈主要在内容忠实、语义对齐和全流程一致性,而非单纯 schema 生成。

From Open Loop to Closed Loop: A Test-Time Iterative Optimization Framework for Reference-Consistent Image Generation Figure 1
2026-07-07cs.CV

From Open Loop to Closed Loop: A Test-Time Iterative Optimization Framework for Reference-Consistent Image Generation

Baixuan Zhao, Xinyu Zhang, Huayu Zheng, Shuaicheng Liu, Xiongkuo Min, Guangtao Zhai, Xiaohong Liu

Shanghai Jiao Tong University, Shanghai, China, Shanghai Innovation Institute, Shanghai, China, University of Electronic Science and Technology of China, Chengdu, Sichuan, China

2026-07-07视觉感知优化算法

针对可控图像生成中参考条件只前馈注入、缺少误差校正而导致身份、姿态或深度漂移的问题,论文把生成过程改写为测试时闭环跟踪:复用预训练模块作编码器和传感器,用改进 PID 迭代更新潜在控制信号,无需训练且可包裹现有扩散管线。实验在身份保持、姿态和深度控制上优于计算量匹配的开环基线,最高带来 25.36% 人脸相似度增益,并分别降低 27.71% 姿态误差和 28.50% 深度误差。

A Reliable Context-Aware and Temporal Planning Framework for Autonomous Driving Figure 1
2026-07-07cs.RO

A Reliable Context-Aware and Temporal Planning Framework for Autonomous Driving

Argho Dey, Yunfei Yin, Swachha Ray, Md Minhazul Islam, Zheng Yuan, Sijing Xiong, Hongyu Liu, Zhiqiu Huang

Funding of SUGON Industrial Control and Security Center under Grant CUIT-, Sijing Xiong, Hongyu Liu, and Zhiqiu Huang are with the College of Computer, Science, Chongqing University, Chongqing 400044

2026-07-07规划控制

该文针对端到端自动驾驶在遮挡、模糊、光照变化和噪声下盲目融合历史 BEV 特征导致规划不稳的问题,提出 RCT-AD:用可靠性评分与质量门控 FILO 记忆保留可信上下文、重建退化观测,并结合 LSTM 时序轨迹规划和检测/分割语义约束。nuScenes 上报告 NDS 61.5、mAP 52.9、mIoU 52.3,称在感知、预测与规划上优于近期基线且效率具备实时性。

TubeLite: Lightweight Multi-Actor Spatio-Temporal Action Detection Figure 1
2026-07-07cs.CV

TubeLite: Lightweight Multi-Actor Spatio-Temporal Action Detection

Ali Soltaninezhad, Melissa Cote, Alejandro Rico Espinosa, Tunai Porto Marques, Alexandra Branzan Albu

2026-07-07视觉感知

TubeLite针对时空动作检测中帧级检测易抖动、动作管断裂且重型Transformer或光流方案成本高的问题,强调稳定演员管而非堆叠全局时空计算。其核心是用轻量ConvNeXt/CenterNet检测、带运动线索的高斯ROI令牌化、演员级GRU传播和边界感知时序头共同约束空间与语义一致性。在MultiSports和UCF101-24上,Video-mAP@0.5分别较最佳对比方法提升4.5和7.1个百分点,同时参数量和FLOPs更低。

Does It Fail to See or Fail to Know? Attributing Errors in Vision-Language Models Figure 1
2026-07-07cs.CV

Does It Fail to See or Fail to Know? Attributing Errors in Vision-Language Models

Khang Nhat Hoang Vo, Artem Vazhentsev, Artem Shelmanov, Timothy Baldwin, Yova Kementchedjhieva

The University of Melbourne, • We construct a scalable labeling procedure, -label and post-generation alternatives., classifier to label images with distinct degradation

2026-07-07视觉语言视觉感知

这篇论文关注知识密集型视觉问答中 VLM 出错后“看不见、认不出,还是不知道”的归因问题,动机是单纯拒答或二分类可靠性无法指导修复。作者提出归因树与可扩展标注流程,将错误拆成视觉证据、实体识别、事实回忆和缺失知识等来源,并用生成前内部表征预测失败类型。结果显示,识别相关错误更依赖视觉 token 表征,实体已识别后的事实错误更依赖提示条件 hidden states,且可在解码前路由到图像修复、识别辅助或检索等干预。

AnyStyle: A Single LoRA is Sufficient for Image-Guided Style Transfer Figure 1
2026-07-07cs.CV

AnyStyle: A Single LoRA is Sufficient for Image-Guided Style Transfer

Yongwen Lai, Chaoqun Wang

School of Artificial Intelligence, South China Normal University, Guangzhou, China, Corresponding author.School of Artificial Intelligence, South China Normal University, Guangzhou, China

2026-07-07视觉感知

本文针对图像引导风格迁移中双 LoRA 难以解耦内容与风格、融合系数敏感且推理控制不稳定的问题,提出 AnyStyle:只微调一个用于捕获风格的 LoRA,并在推理时利用预训练模型内部注意力提取内容图的免训练结构引导。作者的核心洞察是内容保持不必依赖专门的 content LoRA,后者反而增加开销并降低结构保真。实验显示该方法在定量指标上具竞争力,并在感知质量、内容保持与风格一致性上优于多适配器融合方案。

ICME 2026 Grand Challenge on Cross-Scenario Defect Detection and Fine-Grained Severity Grading for High-Precision Manufacturing Figure 1
2026-07-07cs.CV

ICME 2026 Grand Challenge on Cross-Scenario Defect Detection and Fine-Grained Severity Grading for High-Precision Manufacturing

Wei Sun, Weixia Zhang, Linhan Cao, Mingkai Lu, Xiongkuo Min, Xiaoping Zhang, Patrick Le Callet, Guangtao Zhai, Hongxing Chen, Wenqi Wu, Zhenhao Hu, Shanshan Lin, Guanjie Huang, Kai Xie, Rui Xin, Zilong Zhao, Runmin Cong, Ningjing Li, Siqi Ma, Yi Jin Ong, Tianfei Zhou, Shunzhou Wang, Zhiyang Chen, Hao Fang, Chen Zhang, Tze-Hsiang Tang, Dikai Li, Xianjin Wu, Avinash Kumar Sharma, Zhaoyang Wang, Haiyong Chen, Binyi Su, Atik Shahariar

2026-07-07视觉感知

面向高精制造中跨产线泛化差和缺陷严重度被忽视的问题,论文组织 IDA 2026 挑战赛,将晶圆显微缺陷检测拆成跨场景定位分类与四级严重度评估两条赛道,并构建含七类缺陷、实例标注与等级标签的数据集。结果显示该基准吸引 86 名注册参与者、130 次提交,最终有效评测中 Track 1 最优综合分 0.806,证明跨域检测与风险分级仍是工业视觉落地的关键瓶颈。

Video Generation Models Are Inherent Lighting Estimators Figure 1
2026-07-07cs.CV

Video Generation Models Are Inherent Lighting Estimators

Ziqi Cai, Shuchen Weng, Kaiqi Liu, Zifeng Wang, Zhiquan Zhang, Minggui Teng, Han Jiang, Boxin Shi

2026-07-07视觉感知

本文针对单目野外视频中动态 HDR 环境光难以恢复的问题,提出 V-LITE:把光照估计改写为在视频中补全虚拟镀铬球的 inpainting 任务,利用视频扩散模型的时空生成先验推断反射,并通过 HDR-aware VAE 与 LoRA 微调适配 HDR 表示。实验显示其能生成时间一致的 HDR 环境图,用于虚拟物体插入等渲染任务,但具体增益中模型先验、HDR 适配与新数据集的相对贡献仍需进一步拆分说明。

GlaKG: A Biomarker-Centric Fundus Knowledge Graph for Explainable Glaucoma Diagnosis and Risk Assessment Figure 1
2026-07-07cs.CV

GlaKG: A Biomarker-Centric Fundus Knowledge Graph for Explainable Glaucoma Diagnosis and Risk Assessment

Cheng Huang, Jia Zhang, Yi Jiang, Yang Liu, Karanjit Kooner, Yadi Liu, Tsengdar Lee, Yang Xie, Wenqi Shi, Guanghua Xiao

2026-07-07安全鲁棒

针对青光眼筛查模型难以解释、临床规则未被显式利用的问题,GlaKG将眼底结构生物标志物、ISNT/CDR等规则和ResNet50图像特征分离建模,并用后处理融合生成可追溯推理链。实验在AI标注数据上达到二分类F1 0.9953、四级风险准确率0.930,但作者也说明标志物与标签高度相关,结果更像结构化标志物条件下的上界而非无泄漏图像性能。

DiCE-CIR: Direct Composition Learning for Efficient Zero-Shot Composed Image Retrieval Figure 1
2026-07-07cs.CV

DiCE-CIR: Direct Composition Learning for Efficient Zero-Shot Composed Image Retrieval

Gwang-Ho Na, Ho-Joong Kim, Seong-Whan Lee

2026-07-07视觉感知三维

DiCE-CIR针对零样本组合图像检索中伪词投影方法训练链路长、需重编码且训练目标与推理检索不一致的问题,改为直接组合参考图像表征与编辑文本来预测查询表示,并用LLM从大规模图文对自动构造组合监督。实验显示其在CIRCO达到SOTA、在CIRR具竞争力,同时训练效率显著提升;但收益可能部分来自数据构造与规模化监督。

Targeted Structure Completion for Sparse-View 3D Reconstruction in Autonomous Driving Figure 1
2026-07-07cs.CV

Targeted Structure Completion for Sparse-View 3D Reconstruction in Autonomous Driving

Guoqing Wang, Pin Tang, Xiangxuan Ren, Liping Hou, Chao Ma

2026-07-07三维

面向自动驾驶稀疏、低重叠视角下的3D重建,论文指出全局体素高斯补全虽能处理遮挡但大量计算浪费在道路、天空等确定区域。FocusGS的核心洞察是只在深度不连续和遮挡边界等几何歧义流形上初始化并优化连续高斯查询,实现定向结构补全。实验称其在nuScenes等基准上保持或提升重建质量,同时高斯数量减少约74%、渲染时间降低约34%。

Enhancing Video Physical Consistency via Role-aware Joint Training and Modality-decoupled Denoising Figure 1
2026-07-07cs.CV

Enhancing Video Physical Consistency via Role-aware Joint Training and Modality-decoupled Denoising

Guangting Zheng, Haojing Chen, Hao Li, Jingtao Zhang, Zhen Yang, Xiaosong Jia, Xue Yang, Shaofeng Zhang, Yanyong Zhang

University of Science and Technology of China, University of Electronic Science and Technology of China, Fudan University, Georgia Institute of Technology, Shanghai Jiao Tong University

2026-07-07视觉感知

针对视频扩散模型画质强但长程物理一致性不足、现有光流联合训练又会忽略实体角色并引入容量冲突和推理误差累积的问题,论文提出 VPT 微调框架:用角色感知信号区分施动者、受控物、被动物体和背景,并通过模态解耦去噪、辅助损失衰减与跨步自引导让物理先验成为软约束。实验显示其在 Wan2.1-T2V-1.3B 上提升 VideoPhy 的 SA/PC,并在 VideoPhy-2 保持一致增益,同时尽量保留视觉质量。

Learning Flexible Generalization in Video Quality Assessment by Bringing Device and Viewing Condition Distributions Figure 1
2026-07-07cs.CV

Learning Flexible Generalization in Video Quality Assessment by Bringing Device and Viewing Condition Distributions

Nikolay Safonov, Dmitriy S. Vatolin

2026-07-07视觉感知学习理论

这篇论文针对现有视频质量评估默认单一观看环境、难以适配真实移动端设备差异的问题,构建了覆盖300余台Android设备、含亮度/环境光/屏幕属性等元数据的大规模成对主观数据集,并用条件化的投票聚合与模型适配方法学习设备相关质量分数。结果显示,引入设备和观看条件可提升排序一致性与跨场景预测鲁棒性,但具体增益在多大程度来自数据规模仍需进一步拆分说明。

Learning Structured Visual Compositional Representations for Weakly Supervised Referring Expression Comprehension Figure 1
2026-07-07cs.CV

Learning Structured Visual Compositional Representations for Weakly Supervised Referring Expression Comprehension

Lian Xu, Mohammed Bennamoun, Farid Boussaid, Hamid Laga, Yulan Guo, Dan Xu

2026-07-07视觉感知

本文针对弱监督指代表达理解中仅依赖单一 anchor 表征、难以显式对齐语言中属性与关系结构的问题,提出 SVCR:将视觉空间拆为一元对象表示和成对关系表示,并用组合式对齐分别匹配名词主体与整句关系语义。在 RefCOCO、RefCOCO+、RefCOCOg 上取得 SOTA,说明显式结构化视觉表征能改善复杂关系描述的定位。

PixelPilot: Scalable Vision-Language-Action Models for End-to-End Autonomous Driving Figure 1
2026-07-07cs.CV

PixelPilot: Scalable Vision-Language-Action Models for End-to-End Autonomous Driving

Pin Tang, Guoqing Wang, Xiangxuan Ren, Zhongdao Wang, Guodongfang Zhao, Bailan, Chao Ma

2026-07-07视觉语言视觉感知

PixelPilot针对自动驾驶VLA直接从2D图像回归3D轨迹时与相机参数强耦合、难以混合多源数据且易依赖自车状态而非视觉理解的问题,提出“2D图像平面规划、推理时再按标定提升到3D”的解耦范式,并用带中间密集奖励的GRPO强化感知到规划的因果链。实验称其在开环和闭环评测中达到SOTA,优势主要来自更易扩展的异构数据训练和更强视觉推理。

Enhancing Large Multimodal Models in Key Information Extraction via Scene-Aware Document Synthesis Figure 1
2026-07-07cs.CV

Enhancing Large Multimodal Models in Key Information Extraction via Scene-Aware Document Synthesis

Zhipeng Xu, Zulong Chen, Qing Liu, Junhao Ji, Jinxin Hu, Yipeng Yu, Jianqiang Wan, Jun Tang, Zhao Li

♢ Taobao and Tmall Group, Alibaba ♣ Zhejiang University

2026-07-07视觉语言

面向企业文档 KIE 中小型本地多模态模型缺少高质量监督、依赖云端大模型成本高的问题,论文提出 Sayre:从少量样例学习类别内容与版式规律,自动生成文档- schema-标注三元组,并将真实失败案例扩展为困难样本。实验显示其在受限与开放类别 KIE 上持续提升 Qwen3-VL,尤其利好小模型和开放场景;错误分析表明改进主要来自更好的 schema 对齐与复杂版式字段抽取。

Aperture-aware Dispersion 5-D Light-field Imaging Spectrometer Figure 1
2026-07-07cs.CV

Aperture-aware Dispersion 5-D Light-field Imaging Spectrometer

Chenglong Huang, Tao Lv, Jianing Yang, Chongde Zi, Linsen Chen, Xun Cao

2026-07-07视觉感知

针对5D光谱光场成像中相机阵列笨重、单探测器又常以空间分辨率换角度/光谱信息的问题,论文提出ADLIS:在孔径面用低成本石英双折射相位板进行角度-光谱联合编码,并与重建网络端到端优化,使每个像素融合所有视角信息。仿真和真实原型实验显示其在保持2448×2048全空间分辨率下重建3×3视角光谱光场,SIE达100%,且较彩色编码方案有更高PSNR和抗噪性。

Hierarchical Evidence-Driven Reasoning for Long Document Understanding Figure 1
2026-07-07cs.CV

Hierarchical Evidence-Driven Reasoning for Long Document Understanding

Junyu Xiong, Yonghui Wang, Rongjian Gu, Chenyu Liu, Bing Yin, Wengang Zhou, Houqiang Li

University of Science and Technology of China

2026-07-07视觉感知

这篇论文针对长文档多模态 RAG 中“相似但无答案”的干扰页和一次检索失败导致级联错误的问题,提出 HiEvi-RAG:先分解复杂问题,再粗检索页面,并用经 GRPO 训练的 EviAgent 做跨页证据验证,最后通过显式记忆进行多轮生成。四个基准上相较最强已报告基线平均准确率提升 8.05%,但具体增益在多大程度来自验证器训练、流程设计或底座能力仍需更多拆解。

StructuredEdit: Constraint-Aware Graphic Design Editing via Differentiable Parameter Propagation Figure 1
2026-07-07cs.GR

StructuredEdit: Constraint-Aware Graphic Design Editing via Differentiable Parameter Propagation

Veeramanohar Avudaiappan, Ritwik Murali

Department of Electrical and Electronics Engineering, Amrita School of Engineering, Coimbatore, Amrita Vishwa Vidyapeetham, Department of Computer Science and Engineering, Amrita School of Computing, Coimbatore, Amrita Vishwa Vidyapeetham, Department of Electrical and Electronics Engineering, Amrita School of Engineering, Coimbatore, Amrita Vishwa Vidyapeetham India, Department of Computer Science and Engineering, Amrita School of Computing, Coimbatore, Amrita Vishwa Vidyapeetham India

2026-07-07优化算法

针对现有视觉语言模型以像素方式编辑海报时难以满足对齐、重叠、可读性和字体等硬约束的问题,StructuredEdit将设计编辑转为结构化图层参数补丁预测,并用可微光栅化把像素级约束损失反传进微调。结合12.5万条人机筛选编辑数据,系统约束满足率达89%,高于GPT-4V的52%,元素IoU为0.82,字体Top-1准确率76%,用户研究中编辑时间减少33%、返工轮次减少44%。

Integrated Forward-Inverse Network for Lensless Image Reconstruction Figure 1
2026-07-07cs.CV

Integrated Forward-Inverse Network for Lensless Image Reconstruction

Donggeon Bae, Jaewoo Jung, Yong Guk Kang, Kyung Chul Lee, Taeyoung Kim, Jongho Kim, Sangjun Byun, Joonsik Park, Seung Ah Lee

2026-07-07视觉感知三维

本文针对无透镜成像中大范围 PSF 导致观测高度混叠、反演病态且易受标定误差影响的问题,提出 IFIN:在编码器—解码器各尺度交替引入可微前向投影与可学习逆更新,并联合学习空间变化 PSF,使测量域与图像域持续互相校验。实验显示其在 DiffuserCam、WiderCam 和 MultiWienerNet 三个基准上分别提升 PSNR 1.63、0.65、2.58 dB,并在去模糊和内联全息重建中保持竞争力。

G2VD: Generalizable AI-Generated Video Detection via Counterfactual Intervention and Causal Disentanglement Figure 1
2026-07-07cs.CV

G2VD: Generalizable AI-Generated Video Detection via Counterfactual Intervention and Causal Disentanglement

Meng Du, Hongchang Chen, Ran Li, Junjie Zhang, Qi Ouyang, Shuxin Liu

2026-07-07视觉感知

本文针对生成视频检测在未见生成器上易因学习生成器指纹、风格等捷径而失效的问题,提出 G2VD:用 VAE 重构结合频域/像素对齐构造反事实样本,并以双分支因果解耦和 HSIC 约束分离伪造因果线索与域偏置。四个公开数据集上跨域表现优于匹配骨干,在 GenVidBench 中准确率超过 90%、AUC 接近 0.95,且仅用 10% 训练数据。

CompressedVQA-AEV: Full-Reference and No-Reference Quality Assessment Models for Asymmetric Encoded Videos Figure 1
2026-07-07eess.IV

CompressedVQA-AEV: Full-Reference and No-Reference Quality Assessment Models for Asymmetric Encoded Videos

Wei Sun, Xingwei Liu, Dandan Zhu, Xiangyang Zhu, Weixia Zhang, Guangtao Zhai

East China Normal University, 2 Shanghai Jiao Tong University, Shanghai Artificial Intelligence Laboratory

2026-07-07视觉感知

针对 ROI/非对称编码视频中不同区域失真不均、传统 VMAF 等指标可靠性不足的问题,本文分别构建全参考与无参考 VQA 模型:前者用 Swin-B 多阶段特征计算纹理/结构相似度,后者融合 SigLIP2 与 Swin-B 帧级表征并做跨折集成。在 QoMEX 挑战中,全参考赛道第一、无参考赛道第四;但报告性质较强,性能增益中集成与预训练 scaling 的贡献占比文中未充分说明。

Do All Visual Tokens Matter Equally? Object-Evidence Preserving Token Merging for Vision-Language Retrieval Figure 1
2026-07-07cs.IR

Do All Visual Tokens Matter Equally? Object-Evidence Preserving Token Merging for Vision-Language Retrieval

Suhyeong Park, Junha Jung, Jungwoo Park, Jaewoo Kang

2026-07-07视觉语言视觉感知

本文针对多向量视觉语言检索中图像 token 过多导致存储和 MaxSim 评分昂贵、而简单剪枝/合并又会丢失对象级证据的问题,提出 SaMer:用训练期对象标注作为合并先验,抑制跨实例混合,推理时无需框或检测器,仅适配投影层。结果显示在 K=64 时移除超 93% 图像 token、ColPali 存储降 16.09 倍,并在 Flickr30K、MSCOCO 的 R@1 上提升且短语级 grounding 更强。

LCPNet: Latent Consistent Proximal Unfolding Network for Infrared Small Target Detection Figure 1
2026-07-07cs.CV

LCPNet: Latent Consistent Proximal Unfolding Network for Infrared Small Target Detection

Tianfang Zhang, Fengyi Wu, Lei Li, Chang Liu, Zhenming Peng, Huaping Zhang, Xiangyang Ji

2026-07-07视觉感知

针对红外小目标在复杂背景中像素少、易被云边缘和噪声诱发虚警的问题,LCPNet把低秩-稀疏分解从图像域搬到潜表示中展开,保持物理约束同时减少反复压缩;其LCP求解器直接沿历史潜变量演化,并用共享优化记忆协调背景、目标和噪声更新。四个公开基准上报告优于现有方法,兼具较低虚警和较好效率,但具体增益中架构设计与训练规模的贡献仍需进一步拆分。

Displacement Preserving Relational Distillation for Robust Medical Segmentation Figure 1
2026-07-07cs.CV

Displacement Preserving Relational Distillation for Robust Medical Segmentation

Zhicheng Ding, Xinyu Chu, Jung Im Choi, Qing Tian, Tianyu Shi, Xiaoqian Jiang, Lijing Zhu, Qizhen Lan

2026-07-07视觉感知安全鲁棒

这篇论文针对3D医学分割中大模型计算开销高、跨设备成像漂移和背景体素淹没蒸馏信号的问题,提出DPRD:不直接匹配体素特征,而是在ROI掩蔽的病例级嵌入上对齐教师与学生的成对位移向量,并做尺度归一化以保留解剖关系。实验显示其在ISLES和AMOS上优于Logits KD、FitNet、RKD、CIRKD,AMOS Dice达85.46%,以约5%参数和3% FLOPs接近或超过MedNeXt教师并降低边界误差。

TORINO: Token Reduction via Interpretable Concept Overlap in Vision-Language Models Figure 1
2026-07-07cs.CV

TORINO: Token Reduction via Interpretable Concept Overlap in Vision-Language Models

Riccardo Renzulli, Gabriele Spadaro, Shruthi Gowda, Alaa Eddine Mazouz, Van-Tam Nguyen

University of Turin, Italy, Eindhoven University of Technology, The Netherlands

2026-07-07视觉语言视觉感知强化学习

这篇论文针对 VLM 推理中视觉 token 数量过多导致的延迟和显存瓶颈,提出 TORINO:用预训练稀疏自编码器把图像 patch 投到可解释概念空间,按共享概念激活分组后剪枝或合并,实现随图像复杂度自适应压缩且无需微调。实验在 LLaVA-1.5 7B/13B 的九个基准上显示,中等压缩区间优于注意力或相似度方法,约 62% 减 token 时保留 98.7% 相对分数,约 78% 时仍有 97.1%;极端压缩下略逊于 PruneSID。

RAF: Reliability-Aware Fusion of Camera, LiDAR, and 4D RADAR for Robust 3D Object Detection in Adverse Weather Figure 1
2026-07-07cs.CV

RAF: Reliability-Aware Fusion of Camera, LiDAR, and 4D RADAR for Robust 3D Object Detection in Adverse Weather

Heejun Park, Jaeseok Jeong, Kuk-Jin Yoon

2026-07-07视觉感知三维安全鲁棒

恶劣天气下 LiDAR 与 4D RADAR 回波会变稀疏,而相机虽能补充语义也会被雨雪局部污染。RAF 的核心是显式监督逐像素可靠性图,并用 CALM 缓解跨模态投影误差,在冻结既有 LiDAR-RADAR 主干的基础上做模块化融合。K-Radar 与 VoD 实验显示其相对基线最高提升 +6.5 APBEV、+7.4 AP3D。

QSVideo: Query-Conditioned Semantic Temporal Retrieval for Video Understanding Figure 1
2026-07-07cs.CV

QSVideo: Query-Conditioned Semantic Temporal Retrieval for Video Understanding

Wei Ao, Lan Wang, Vishnu Naresh Boddeti

2026-07-07视觉感知

长视频理解中,VLM容易被与问题无关的片段干扰,简单增加帧数又带来高开销。QSVideo的核心是把任意问题改写为适合检索的查询,并按物体、动作、位置估计帧相关性,再在检索时同时约束相关性、多样性和时间覆盖,分别适配长视频与流式视频。实验显示,在8/16/32帧预算下,它在StreamingBench达到强结果,并在LVBench相对骨干VLM提升约6.9–7.1个百分点。

Explainable Novel Category Discovery in Semantic Concept Space Figure 1
2026-07-07cs.CV

Explainable Novel Category Discovery in Semantic Concept Space

Ifrat Ikhtear Uddin, Yang Zhou, KC Santosh, Longwei Wang

Department of Computer Science, University of South Dakota, USA, Department of Computer Science and Software Engineering, Auburn University, USA

2026-07-07视觉感知

针对新类别发现虽能聚类未知类却难解释“为何成类”的问题,论文提出 xNCD,将表示学习、伪标签与分类约束放到语义概念空间中,通过视觉语言先验学习无标注概念瓶颈,使簇级和样本级证据可读。实验在 CIFAR-10 接近 UNO,在 CIFAR-100 从 73.2% 提升到 76.45%,并提供同类方法缺少的可解释性。

Mask2Real-WM: Segmentation Masks as a Sim-to-Real Bridge for Controllable Dexterous World Models Figure 1
2026-07-07cs.RO

Mask2Real-WM: Segmentation Masks as a Sim-to-Real Bridge for Controllable Dexterous World Models

Riccardo O. Feingold, Davide Liconti, Chenyu Yang, Robert K. Katzschmann

Soft Robotic Lab, Department of Mechanical and Process Engineering

2026-07-07视觉感知强化学习规划控制

面向灵巧手世界模型中23自由度动作维度高、真实数据稀缺且指物接触易被视频模型模糊的问题,论文将像素预测拆成“掩码动力学+RGB渲染”:先在分割掩码空间用50小时仿真预训练并以少于2.5小时真实演示微调,再用ControlNet-SVD渲染外观。实验显示该桥接显著提升逐自由度可控性,ID从0.68升至0.95、OOD从0.51升至0.87,优于单体RGB基线的细粒度动作响应。

CRISP: A Spatiotemporal Camera-Radar Backbone for Driving via Forecasting-Based World-Model Pretraining Figure 1
2026-07-07cs.CV

CRISP: A Spatiotemporal Camera-Radar Backbone for Driving via Forecasting-Based World-Model Pretraining

Jingyu Song, Yi Liu, Katherine A. Skinner

2026-07-07强化学习

该文针对自动驾驶中相机-雷达方案成本低但多依赖任务监督、可迁移表征不足的问题,提出CRISP:用历史多视角图像和雷达扫描预测未来LiDAR点云,在预训练阶段借助LiDAR特权监督学习时空BEV骨干,部署时仍只需相机和雷达。其关键在于强化雷达编码、雷达增强时序注意力和带门控的多模态渲染,以利用距离与多普勒运动线索。nuScenes结果显示,CRISP提升长时域点云预测,并迁移到检测、跟踪、地图、运动预测、占据和规划等任务。

SceneFrom3D: Geometry-Conditioned Outdoor 3D Scene Generation via View Scheduling with Object-Level Control Figure 1
2026-07-07cs.GR

SceneFrom3D: Geometry-Conditioned Outdoor 3D Scene Generation via View Scheduling with Object-Level Control

Geonung Kim, Jeongeun Park, Nuri Ryu, Di Liu, Sunghyun Cho

Meta Reality Labs, Meta Reality Labs United States of America

2026-07-07规划控制三维

面向户外几何条件三维场景生成,论文针对大尺度、无边界几何中相机视角难以人工规划的问题,提出 SceneFrom3D:从输入几何自动构建含锚点视角、插值轨迹和生成顺序的有向生成图,并加入对象级外观图像与几何贴合强度控制。实验显示其在复杂户外场景中生成更高质量的 3DGS,且支持对象外观与几何遵循度调节。

A non-invasive video-based method for individual identification of wildlife using gait dynamics Figure 1
2026-07-07cs.CV

A non-invasive video-based method for individual identification of wildlife using gait dynamics

Muhammad Aamir, Matthew Wijers, Sangyun Shin, Andrew Loveridge, Andrew Markham

2026-07-07视觉感知

针对野外个体识别依赖项圈、标记等侵入式手段且难以规模化的问题,论文提出用视频步态作为动物“行为生物特征”:先以 SAM3 分割动物轮廓,再用 ResNet18 与 VideoPrism 学习空间形态和时序运动嵌入,并用余弦相似度聚类。多物种实验显示同一个体相似度约 0.91–0.99、跨个体多低于 0.80,平均轮廓系数 0.78,但数据规模与泛化边界文中未充分说明。

Geographic Diversity Beats Data Volume for Cross-Domain Generalization in Zero-Label JEPA Driving World Models Figure 1
2026-07-07cs.CV

Geographic Diversity Beats Data Volume for Cross-Domain Generalization in Zero-Label JEPA Driving World Models

Santosh Jaiswal

2026-07-07强化学习学习理论

这篇论文关注自动驾驶世界模型在跨城市、跨数据集时是否仍能用无标签“惊讶分数”刻画场景复杂度。作者用JEPA潜在预测模型做受控迁移实验,核心洞察是地理多样性比单纯扩大同域数据量更关键:在同为6.3万场景时,混合nuPlan与AV2训练使AV2验证集平均惊讶分数较nuPlan-only下降16.5%,且优于20万AV2-only单域训练。

UniSkip-Mamba: A Frequency-Aware State Space Model for Audio-Visual Temporal Forgery Localization Figure 1
2026-07-07cs.CV

UniSkip-Mamba: A Frequency-Aware State Space Model for Audio-Visual Temporal Forgery Localization

Cangjin Qiu, Quan Zhang, Dan Jiang, Ke Zhang

2026-07-07视觉感知

本文针对音视频伪造定位中 Transformer 计算开销大、通道拼接难处理异步伪造且易受高频噪声干扰的问题,提出 UniSkip-Mamba。核心洞察是伪造判别信息主要集中在 0–0.15 低中频,因而用统一音视频序列保留跨模态相位关系,并通过 Skip-Scanning/Group-Scan-Merge 做频率感知正则。实验在 LAV-DF 和 AV-Deepfake1M 上达到 63.4% AP@0.95、63.58% mAP,并报告约 6 倍推理加速。

Enhancing Facial Expression Recognition in Head-Mounted Displays with Synthetic Data Figure 1
2026-07-07cs.CV

Enhancing Facial Expression Recognition in Head-Mounted Displays with Synthetic Data

Jianing Deng, Qiang Zhou, Jingtong Hu

University of Pittsburgh

2026-07-07视觉感知

本文针对头显内置相机视角下表情识别数据稀缺、正脸数据难以直接迁移的问题,提出 SynHMC:先从正脸图像重建带纹理 3D 人脸,再用可配置虚拟头显相机渲染 HMC 视角,并用 TSAN 在纹理空间校正采样误差以保留皱纹等细粒度表情线索。实验显示,用合成数据训练的模型在模拟和真实 HMC 数据上优于直接使用现有数据训练,并在不同相机配置间泛化更好。

LeukocyteCount: Automatic Identification and Counting for leukocytes using Deep Learning Figure 1
2026-07-07cs.LG

LeukocyteCount: Automatic Identification and Counting for leukocytes using Deep Learning

Ahmed M. Sayed (1), Sondos A. Refaat (1), Abdallah M. Mostafa (1), Mariam S. El-Rahmany (1), Ensaf Hussein Mohamed (1 and 2) ((1) Faculty of Computers and Artificial Intelligence, Helwan University, Cairo, Egypt, (2) School of Information Technology and Computer Science (ITCS), Nile University, Giza, Egypt)

2026-07-07视觉感知

针对白细胞人工计数耗时且易受主观误差影响的问题,论文提出三阶段混合流程:先用YOLOv5检测血细胞并统计,再以微调的MobileNetV2提取白细胞特征,最后用逻辑回归分类四类WBC。作者在BCCD数据集上报告WBC检测准确率98%、分类准确率99.04%,RBC检测F1达99.73%;但泛化到真实临床多中心样本的证据文中未充分说明。

TrustCLIP: Learning Private Visual Features via Adversarial Reconstruction Figure 1
2026-07-07cs.CV

TrustCLIP: Learning Private Visual Features via Adversarial Reconstruction

Nikos Athanasiou, Ilya A. Petrov, Angela Yao, Shugao Ma, Eric Sauser, Edoardo Remelli, Shreyas Hampali, Johannes Schönberger, Fadime Sener, Bugra Tekin

2026-07-07三维

这篇论文针对 CLIP/VLM 特征可被扩散模型反演出原图、从而泄露人脸和场景隐私的问题,提出 TrustCLIP:在冻结视觉编码器与下游模块之间加入轻量投影,并把特征条件生成器作为显式对手进行对抗训练。其核心洞察是重建所需的细粒度身份/纹理信息与分类、VQA 所需语义并不完全重合。实验显示,该方法能显著降低生成式反演保真度,同时在分类和 LLaVA 类多模态任务上基本保持性能;但评估主要围绕 CLIP 与 IP-Adapter,跨编码器泛化仍需验证。

PulmoSight-XAI: An Explainable Multi-View Attention Ensemble with Gradient Boosting Meta-Learning for Multi-Label Chest X-Ray Classification Figure 1
2026-07-07cs.CV

PulmoSight-XAI: An Explainable Multi-View Attention Ensemble with Gradient Boosting Meta-Learning for Multi-Label Chest X-Ray Classification

Moshiur Rahman, Shafqat Alam, Tasnia Binte Mamun

Department of Biomedical Engineering, Bangladesh University of Engineering and Technology (BUET)

2026-07-07优化算法

本文针对胸片多标签诊断中的类别不均衡、共病标签混杂以及全局池化丢失局部病灶线索问题,提出按正侧位分别训练的多CNN集成框架,引入多尺度特征融合、CBAM注意力、ASL与自适应Focal混合损失,并用TTA、不确定性特征和XGBoost/LightGBM/CatBoost分层堆叠替代简单平均。在CheXpert风格数据上,正位和侧位宏平均AUROC分别达0.9319和0.9154,解释性热图显示较好的解剖一致性,但具体增益在各组件间的归因仍需看消融是否充分。

EVAS: Efficient Multimodal Temporal Forgery Localization via Audio-Visual Synergy and Steered Boundary Calibration Figure 1
2026-07-07cs.CV

EVAS: Efficient Multimodal Temporal Forgery Localization via Audio-Visual Synergy and Steered Boundary Calibration

Shen Shen, Quan Zhang, Dan Jiang, Ke Zhang

Soochow University, Tsinghua University, Soochow University Suzhou China, Tsinghua University Beijing China

2026-07-07视觉语言学习理论

针对长视频中伪造片段稀疏、音画线索弱且边界难以精确定位的问题,EVAS从早期就进行多阶段音视频协同交互,以捕捉微小同步异常,并用边界感知细化与无效帧掩码减少级联误差;同时以HourglassFFN降低开销。实验称其在LAV-DF、AV-Deepfake1M和TVIL上取得平均定位精度与召回率的领先结果,但具体增益来源仍需结合消融进一步判断。

Flash-BoN: Instant Drafts for Inference-Time Scaling in Diffusion Models Figure 1
2026-07-07cs.CV

Flash-BoN: Instant Drafts for Inference-Time Scaling in Diffusion Models

Ruchit Rawal, Reza Shirkavand, Sayak Paul, Yuxin Wen, Heng Huang, Yizheng Chen, Tom Goldstein, Gowthami Somepalli

2026-07-07生成模型

本文针对扩散文生图推理期扩展中常用 NFE 指标忽略验证器开销、导致方法效率排序失真的问题,提出 Flash-BoN:用时间步截断、层跳过和激活代理快速生成大量草稿,再经多阶段验证选择候选并全质量精修。结果显示在固定真实耗时下优于引导搜索和普通 BoN,跨模型与基准提升随规模增大,并可叠加反思式提示优化。

Spatial Graph Representation and Morphometric Analysis of the Pulmonary Vascular Tree From Computed Tomography Using Multi-Scale Hessian-Based Filter Fusion and TEASAR Skeletonization Figure 1
2026-07-07cs.CV

Spatial Graph Representation and Morphometric Analysis of the Pulmonary Vascular Tree From Computed Tomography Using Multi-Scale Hessian-Based Filter Fusion and TEASAR Skeletonization

Piotr Mackiewicz, Jakub Kołyska, Radoslaw Roszczyk

Warsaw University of Technology, refinement. Vascular centerlines are then extracted with the, cessed independently for each lung. Centerline extraction is, around each accepted path, producing a loop-free centerline, strongly favoring centerline routes. The invalidation radius

2026-07-07视觉感知

这篇论文针对临床 CT 中肺血管尺度跨度大、噪声和分辨率限制导致形态量化困难的问题,提出无需训练的可解释重建流程:融合多尺度 Frangi/Sato Hessian 血管增强,并用 TEASAR 提取左右肺血管图。单例低分辨率 CT 上,融合图节点和分叉多于单滤波器,体积分形维数约 2.26、Murray 指数和 Horton 比总体落在文献合理范围;但验证仅基于一例, distal 血管截断明显,泛化性文中未充分说明。

CCFM: Collision-Constrained Flow Matching for Safety-Critical Scenario Generation Figure 1
2026-07-07cs.CV

CCFM: Collision-Constrained Flow Matching for Safety-Critical Scenario Generation

Ke Li, Kaidi Liang, Yuxin Ding, Debojyoti Biswas, Xianbiao Hu, Ruwen Qin

Stony Brook University, Stony Brook, NY 11794, USA Pennsylvania State University, University Park, PA 16802, USA

2026-07-07生成模型安全鲁棒

面向自动驾驶闭环仿真中稀有且高风险的碰撞场景难以可控生成的问题,CCFM将场景生成改写为带硬碰撞约束的流匹配采样:先启发式选择最可行的对抗车辆与碰撞类型,再用接触点、航向和严重度约束及Gauss-Newton流形投影保证可解释控制。实验在nuScenes和nuPlan上分别达到最高46.4%和83.1%碰撞率,同时保持较真实驾驶行为。

Fields of the Planet: Field Boundary Mapping Beyond 10m Figure 1
2026-07-07cs.CV

Fields of the Planet: Field Boundary Mapping Beyond 10m

Isaac Corley, Caleb Robinson, Jennifer Marcus, Hannah Kerner

Microsoft AI for Good Research Lab, Arizona State University

2026-07-07学习理论

小农地块常只有几十米宽,10米 Sentinel-2 会把相邻田块栅格化成连通斑块,限制边界恢复。本文构建与 FTW 对齐的 3米 PlanetScope 数据集 FTP,并强调以矢量化后的地块恢复而非像素重叠评估。相同模型下,PQ 从 21.0 提升到 35.5,小于0.5公顷地块 PQ 从 5.8 到 15.7,匹配边界误差由18.6米降至7.4米。

Wan-Streamer v0.2: Higher Resolution, Same Latency Figure 1
2026-07-07cs.CV

Wan-Streamer v0.2: Higher Resolution, Same Latency

Lianghua Huang, Zhi-Fan Wu, Yupeng Shi, Wei Wang, Mengyang Feng, Junjie He, Chen-Wei Xie, Yu Liu, Jingren Zhou, Ang Wang, Bang Zhang, Baole Ai, Chen Liang, Cheng Yu, Chongyang Zhong, Jinwei Qi, Kai Zhu, Pandeng Li, Peng Zhang, Wenyuan Zhang, Xinhua Cheng, Yitong Huang, Yun Zheng, Yuxiang Bao, Yuzheng Wang, Zoubin Bi

2026-07-07视觉感知

这篇论文针对实时音视频交互中高分辨率输出会拉高延迟的问题,在保持 Wan-Streamer v0.1 原生流式因果建模不变的前提下,将视频从 192×336 提升到 640×368。核心做法是把低延迟感知、状态更新和解码保留在单 GPU thinker 中,将高成本视频 latent 生成迁移到多 GPU Ulysses 式上下文并行 performer,并用预分片 K/V cache 降低通信负担。结果是在 25 FPS 下仍维持约 200 ms 模型侧延迟、约 550 ms 远程交互延迟,同时支持更清晰的近景与可读姿态、手部和场景的中景数字人。

ResearchStudio-Reel: Automate the Last Mile of Research from Paper to Poster, Video, and Blog Figure 1
2026-07-07cs.CV

ResearchStudio-Reel: Automate the Last Mile of Research from Paper to Poster, Video, and Blog

Lingao Xiao, Yalun Dai, Yangyu Huang, Qihao Zhao, Wenshan Wu, Hugo He, Ruishuo Chen, Jin Jiang, Qianli Ma, Jiahuan Zhang, Xin Zhang, Ying Xin, Yang Ou, Yan Xia, Scarlett Li, Longbo Huang, Zhipeng Zhang, Yang He, Yap Kim Hui, Yan Lu

National University of Singapore, Nanyang Technological University, Tsinghua University, Peking University, Shanghai Jiao Tong University, Westlake University

2026-07-07视觉感知

这篇论文针对论文录用后制作海报、讲解视频和博客仍高度依赖人工的问题,提出将“传播最后一公里”视为可组合的技能系统:先用 Paper2Assets 统一抽取论文资产,再生成可在 PowerPoint/Word 中继续编辑的海报、视频和双语博客,并由 Paper2Reel 对齐为交互式页面。结果显示,其海报在 Paper2Poster 基准上优于既有自动系统和单轮前沿 LLM,整体胜率达 84%–93%,但视频与博客收益更多以能力审计呈现。

RoboDojo: A Unified Sim-and-Real Benchmark for Comprehensive Evaluation of Generalist Robot Manipulation Policies Figure 1
2026-07-07cs.RO

RoboDojo: A Unified Sim-and-Real Benchmark for Comprehensive Evaluation of Generalist Robot Manipulation Policies

Tianxing Chen, Yue Chen, Zixuan Li, Junyuan Tang, Kailun Su, Weijie Wan, Baijun Chen, Haoran Lu, Haowen Yan, Honghao Su, Zhiyang Dou, Kaixuan Wang, Dandan Zhang, Yunze Liu, Yan Qin, Qiwei Liang, Qiwei Wu, Zijian Lin, Wenwei Lin, Yuran Wang, Minghua He, Tianshu Wu, Ruihai Wu, Jingquan Zhou, Kai-Chong Lei, Haibao Yu, Yuanfeng Ji, Weiyang Jin, Guanyu Lin, Xiaofan Li, Qi Xiong, Renjing Xu, Zhongyu Li, Wenhao Chai, Enze Xie, Ziwei Wang, Yao Mu, Hao Dong, Wojciech Matusik, Mingyu Ding, Wenbo Ding, Ping Luo, Masayoshi Tomizuka

2026-07-07机器人数据集/基准

针对现有机器人操作基准任务偏短、能力覆盖窄且仿真与真实评测割裂的问题,RoboDojo构建了统一的仿真—真实评测体系:42个仿真任务覆盖泛化、记忆、精度、长程执行和开放词汇指令,18个真实任务通过标准化硬件、重置流程和远程RealEval提升可复现性,并用XPolicyLab接入30个策略建立排行榜;结果主要给出系统性能力诊断,具体性能增益来源文中未充分说明。

On Pairwise Quantile Regression -- Statistical Guarantees and Applications Figure 1
2026-07-07stat.ML

On Pairwise Quantile Regression -- Statistical Guarantees and Applications

Romain Thérézien, Stephan Clémençon, Fantin Girard, Hamza El-Abdouni

2026-07-07视觉感知

针对均值回归难以刻画高离散相似度分布的问题,论文将分位数回归扩展到成对样本,用基于 U 统计量的 pairwise pinball loss 学习条件相似度分位数,并给出泛化界与温和条件下 O(1/n) 快速率。仿真验证理论趋势,面部识别实验显示该方法可揭示年龄差、图像质量、发长等因素对高置信相似度错误的影响。

UI-MOPD: Multi-Platform On-Policy Distillation for Continual GUI Agent Learning Figure 1
2026-07-07cs.CL

UI-MOPD: Multi-Platform On-Policy Distillation for Continual GUI Agent Learning

Niu Lian, Alan Chen, Zhehao Yu, Chengzhen Duan, Fazhan Liu, Hui Liu, Pei Fu, Jian Luan, Yaowei Wang, Shu-Tao Xia, Jinpeng Wang

2026-07-07强化学习

论文针对跨桌面与移动端 GUI 智能体在持续学习中易混淆平台操作习惯、遗忘既有能力且缺少高质量轨迹的问题,构建 Uni-GUI 数据集,并提出按环境路由到平台专属教师的 on-policy 多教师蒸馏,使共享策略保留平台行为先验。实验在 OSWorld、MobileWorld 上成功率达 38.2% 和 12.0%,相对基座提升 12.7% 与 55.8%。

Transferability Between Understanding and Generation in Unified Multimodal Models Figure 1
2026-07-07cs.CV

Transferability Between Understanding and Generation in Unified Multimodal Models

Jiwon Kang, Heeji Yoon, Jaewoo Jung, Jaewon Min, Minkyeong Jeon, Biyeon Hwang, Sangwon Jung, Seungryong Kim

2026-07-07视觉语言

本文关注统一多模态模型中图像理解与生成是否真正共享能力,而非只看综合榜单增益。核心洞察是用“同一能力跨任务迁移”作为可控分析信号,发现迁移强弱高度依赖架构:共享 Transformer 主干与统一视觉编码器更容易产生迁移,松耦合设计较弱。实验显示,在计数、空间关系和文字相关任务上,先训练理解能力可提升对应生成能力,并较直接生成微调更少破坏视觉质量。

MambaRefine-CD: MambaVision with Region-Boundary Temporal Refinement Figure 1
2026-07-07eess.IV

MambaRefine-CD: MambaVision with Region-Boundary Temporal Refinement

Dineth Perera, Thaariq Firdous, Oshadha Samarakoon, Roshan Godaliyadda, Parakrama Ekanayake, Vijitha Herath

University of Peradeniya

2026-07-07视觉感知学习理论

这篇论文针对遥感二值变化检测中“区域能检出但边界易偏移、破碎或过平滑”的问题,提出基于共享 MambaVision 编码器的 MambaRefine-CD。其关键思路不是单纯扩大骨干,而是用 D-RBI 同时利用配对特征、绝对差和有符号差,并分离区域流与 Sobel 条件边界流,再用受限残差头只在边界附近修正粗预测。在 DSIFN-CD 和 WHU-CD 上,文中报告变化类 F1 与 IoU 表现较强,消融显示有符号时序证据和区域—边界细化流程均有贡献。

The Good, the Bad, and the Brittle: Benchmarking Robustness and Generalisation of Histopathology Foundation Models Figure 1
2026-07-07cs.CV

The Good, the Bad, and the Brittle: Benchmarking Robustness and Generalisation of Histopathology Foundation Models

Dhyey Yajnik, Amina Asif, Fayyaz Minhas

2026-07-07数据集/基准安全鲁棒

本文关注病理基础模型在真实临床扰动和跨中心分布偏移下是否可靠,而非仅看常规测试集精度。作者用REET构造11类染色、压缩、模糊、几何等扰动,并结合NR-Kfold制造特征空间不相似划分,提出PPI汇总鲁棒性。结果显示PFM整体强于ResNet,但相似性被打破时性能下降且波动增大;更大的模型并不总更稳,中等规模UNI2、Virchow-2等已接近或超过巨型模型,提示后续增益可能主要来自数据质量、多模态和域对齐而非单纯scaling。

Event Detection in Videos: A Framework for the Development of New Methods Figure 1
2026-07-07cs.CV

Event Detection in Videos: A Framework for the Development of New Methods

Anastasia Zakharova, Thierry Bouwmans, Anthony Cioppa, Adrien Deliège, Antonio Greco, Anaïs Halin, Kamil Jeziorek, Meghna Kapoor, Tomasz Kryjak, Islam Osman, Sébastien Piérard, Carlo Sansone, Mohamed S. Shehata, Renaud Vandeghen, Marc Van Droogenbroeck, Bruno Vento

2026-07-07视觉感知

这篇论文针对视频事件检测中事件定义含糊、数据集异构和评测不严导致方法难以公平比较的问题,提出以数据集、性能评估和部署场景为三支柱的开发框架;核心在于按采集环境分层组织视频并用标签描述内容与困难,同时引入FSD真实数据和SUC合成数据及概率化评测流程。主要结果是形成一套可用于方法定位、数据选择和场景化比较的规范,但文中未充分说明相对现有方法的量化增益。

HASSL: Hierarchy-Aware Self-Supervised Learning Framework for Single Cell Microscopy Figure 1
2026-07-07cs.CV

HASSL: Hierarchy-Aware Self-Supervised Learning Framework for Single Cell Microscopy

Julius Riel, Vishwa Mohan Singh, Sai Anirudh Aryasomayajula, Anuun Chinbat, Hannes Leonhard, Moritz Ladenburger, Frederik Alexander, Vishisht Choudhary, Fabio Laredo, Giacomo Masserdotti, Thorben Prein, Carsten Marr, Amirhossein Kardoost

2026-07-07视觉感知

该文针对单细胞显微图像中SSL表征易被成像模态、批次等粗粒度因素主导、掩盖细胞形态细分结构的问题,提出HASSL:用分割掩码教师增强形态感知,并以HDBSCAN层级聚类构造无标签对比目标,约束父子簇与相近亚型边界。在20个数据集、239万细胞上,相比基线提升Top-K检索约2.8%,深层级Top-9检索提升6.3%,药物扰动分类F1提升7.8%。

Last-Meter Precision Navigation for UAVs: A Diffusion-Refined Aerial Visual Servoing Approach Figure 1
2026-07-07cs.CV

Last-Meter Precision Navigation for UAVs: A Diffusion-Refined Aerial Visual Servoing Approach

Yaxuan Li, Jiarui Zeng, Shaofei Huang, Zhedong Zheng

FST and ICI, University of Macau

2026-07-07机器人生成模型

本文瞄准无人机最后10米内因GNSS精度不足、尺度歧义和角度周期性导致的精细对准难题,提出DreamNav:先用正余弦参数化稳定回归航向与距离,再借助预训练世界模型生成候选动作后的视觉结果,以目标图像一致性做扩散式精修。作者同时构建PairUAV大规模评测集;实验显示其在未见场景中较视觉伺服和基础模型基线有更低角度、距离误差和更好成功率,但增益可能部分来自数据规模。

IRIS: An Intelligent Vision-Language System for Ocular Surface Diseases via Topic Tree and Scene-Driven VQA Generation Figure 1
2026-07-07cs.CV

IRIS: An Intelligent Vision-Language System for Ocular Surface Diseases via Topic Tree and Scene-Driven VQA Generation

Hao Wei, Wenjin Qi, Dasen Dai, Minqing Zhang, Wu Yuan

2026-07-07视觉语言视觉感知

针对眼表疾病筛查中外眼照片数据稀缺、通用视觉语言模型缺乏解剖定位和临床推理的问题,IRIS构建IRIS-120K数据集,并用Topic Finding Tree把病灶与10类眼部区域层级绑定,结合面向医生、患者和学生的场景式VQA生成注入临床先验。论文称4B模型在相关评测中超过最高34B的通用及医学VLM,说明收益可能主要来自结构化数据与知识注入而非参数规模。

How to Build Digital Humans? From Priors to Photorealistic Avatars Figure 1
2026-07-07cs.GR

How to Build Digital Humans? From Priors to Photorealistic Avatars

Wojciech Zielonka, Tobias Kirschstein, Timo Bolkart, Simon Giebenhain, Vanessa Sklyarova, Xiang Deng, Donglai Xiang, Shunsuke Saito, Yebin Liu, Matthias Niessner, Justus Thies

Technical University of Munich, Tsinghua University, Max Planck Institute for Intelligent Systems, Technical University of Darmstadt, This state-of-the-art report provides an overview of controllable 3D human avatar creation. We describe current 3D avatar, (VR/AR, telepresence, online collaboration), people need human-, centered representations that preserve identity, expression, and so-, to 2025, as well as preprints available on arXiv. The papers, of-the-art report lies on reconstructing controllable human avatars, art reports on controllable video generation [MFH∗25], as well as

2026-07-07视觉感知

面向VR/AR、远程协作和具身AI中对可控、视角一致数字人的需求,本文将3D数字人构建归纳为先验学习、个性化建模与动画驱动流程,重点梳理前两阶段。核心洞察是用统一头像系统定义和按身体区域、表示、先验、输入与控制信号组织分类,覆盖头部、头发、手、服装到全身整合。主要结果是一份2021—2025年相关工作的系统路线图,并指出效率、行为建模、空间感知与伦理风险仍未解决。

Agent-driven Long-tail Simulation for Autonomous Driving Figure 1
2026-07-07cs.RO

Agent-driven Long-tail Simulation for Autonomous Driving

Junru Gu, Lijin Yang, Jianing Huang, Shu Liu, Zhongzhan Huang, Hang Zhao

\phantom{}{}^{1} IIIS, Tsinghua University

2026-07-07视觉感知

针对自动驾驶闭环评测中回放与规则智能体交互性弱、难覆盖长尾行为的问题,论文提出由遵循语言指令的LLM道路参与者驱动仿真,并用结构化动作接口约束其物理可行性;同时构建SemanticPlan,在真实nuPlan场景中加入多智能体语义任务。实验显示现有规划器在这些长尾交互场景下仍难稳定安全完成任务。

Framework and Multi-modal Dataset for Roadwork Zone Detection and Geo-localization Figure 1
2026-07-07cs.CV

Framework and Multi-modal Dataset for Roadwork Zone Detection and Geo-localization

Zhiran Yan, Yutong Xin, S Shyam Shenoi, Rui Song, Gordon Elger

Institute of Innovative Mobility (IIMo), Technical University Ingolstadt of Applied Sciences, Ingolstadt, 85049, Germany., Fraunhofer Institute for Transportation and Infrastructure Systems IVI, Ingolstadt, 85051, Germany., Technical University of Munich, Garching, 85748, Germany.

2026-07-07视觉感知数据集/基准

针对自动驾驶高精地图难以及时反映临时道路施工区的问题,论文发布RZDG多模态数据集,覆盖真实与CARLA仿真场景,含相机、LiDAR、GPS/IMU及分割、3D框和全局坐标标注,并基于AB3DMOT构建检测与地理定位流水线。以1米内为真阳性,真实/仿真数据F1分别为0.597/0.665,召回较高但精度仍有限。

Aura: Consistent Multi-Subject Video Generation via VLM-Grounded Semantic Alignment Figure 1
2026-07-07cs.CV

Aura: Consistent Multi-Subject Video Generation via VLM-Grounded Semantic Alignment

Zixiang Zhou, Zhentao Yu, Yifeng Ma, Hongmei Wang, Wenqing Yu, Cong Wang, Zilin Yang, Rui Chen, Jiarong Ou, Yezhou Liu, Yuan Zhou, Qinglin Lu

2026-07-07视觉语言视觉感知

Aura针对参考图驱动视频中身份漂移、多主体绑定错误与“复制粘贴”伪影问题,提出以VLM语义特征对齐DiT的统一框架:用导演级密集字幕、T5/Qwen2.5-VL双分支注入、两阶段/课程式对齐、主体感知RoPE与类别token强化多参考区分,并配合AIGC数据管线和Progressive-APG推理。实验称其在单主体与多元素生成上达到SOTA,但具体增益中数据规模与模型设计的相对贡献仍可能不完全清晰。

SAD-LoRA: Spectral Alignment for Low-Rank Knowledge Distillation Figure 1
2026-07-07cs.LG

SAD-LoRA: Spectral Alignment for Low-Rank Knowledge Distillation

Omer Tariq, Syed Muhammad Raza, Jeongbae Son

2026-07-07视觉感知

论文针对 LoRA 知识蒸馏中仅优化输出可能导致低秩适配器子空间偏离教师更新、浪费秩预算的问题,提出 SAD-LoRA:从数据加权的教师更新中提取目标奇异子空间,并用主角度损失在训练中持续对齐。作者还给出误差分解,区分子空间错位、系数不匹配和不可约残差;合成实验显示错位项几乎被消除,GLUE 上在低秩设置提升秩效率,尤其 STS-B、CoLA 较明显。

Road-Aware Anomaly Segmentation with Query-Guided Polygons and CLIP in Autonomous Driving Figure 1
2026-07-07cs.CV

Road-Aware Anomaly Segmentation with Query-Guided Polygons and CLIP in Autonomous Driving

Zhiran Yan, Gordon Elger

Institute of Innovative Mobility (IIMo), Technical University Ingolstadt, Fraunhofer Institute for Transportation and Infrastructure Systems IVI, Ingolstadt, 85051, Germany.

2026-07-07视觉感知

面向自动驾驶开放道路中未知障碍易被闭集语义分割漏检的问题,本文提出无需重训练和OOD数据的后处理框架:利用Mask2Former查询置信度构建道路多边形先验,在可行驶区域内找缺口候选,再用CLIP零样本提示过滤语义上合理的ID目标。其在Fishyscapes、SMIYC、RoadAnomaly上整体优于训练自由基线Maskomaly,并在Fishyscapes LostAndFound取得最高AP。

AquaStereo: Enabling Underwater Stereo Matching via Depth-Conditioned Diffusion and Geometry Self-Distillation Figure 1
2026-07-07cs.CV

AquaStereo: Enabling Underwater Stereo Matching via Depth-Conditioned Diffusion and Geometry Self-Distillation

Qizhe Wei, Yingping Liang, Shaodi You, Ying Fu

2026-07-07生成模型

AquaStereo针对水下双目匹配中真实标注稀缺、散射与浑浊导致左右一致性和纹理特征失效的问题,提出用深度条件扩散生成保持几何一致的水下立体对,并结合物理提示池、左右一致性约束、跨域自蒸馏和感知增强特征来缩小陆地到水下域差。实验显示其在困难水下场景的鲁棒性与零样泛化优于现有训练策略,但具体增益中生成数据、蒸馏和特征增强的相对贡献仍需看消融。

EMPURPLE: A Free Lunch for Diffusion Distillation based on the Information Bottleneck Figure 1
2026-07-07cs.CV

EMPURPLE: A Free Lunch for Diffusion Distillation based on the Information Bottleneck

Zilai Li, Lujia Bai

2026-07-07生成模型

本文针对扩散蒸馏虽能减少采样步数却常损害 FID 和覆盖度的问题,指出早期强行预测高细节潜变量会放大学习难度与训练—推理分布错配。EMPURPLE 无需训练,缓存并复用原始模型的中间噪声潜变量,使蒸馏采样从更接近分布内的状态开始;在 DMD2、Hyper-SD、FlashSD、SDXL-Lightning 上报告 FID 提升 7%–20%,但 CLIP 分数略降。

AdaptiveSplat:Texture Aware Controllable 3D Gaussian Allocation for Feed-Forward Reconstruction Figure 1
2026-07-07cs.CV

AdaptiveSplat:Texture Aware Controllable 3D Gaussian Allocation for Feed-Forward Reconstruction

Badrinath Singhal, Srihari K G, Sreehari Iyer, Ankit Dhiman, Venkatesh Babu Radhakrishnan

2026-07-07规划控制三维

AdaptiveSplat针对前馈3D重建中像素对齐高斯数量冗余、直接剪枝易产生空洞和伪影的问题,提出按局部纹理复杂度分配高斯预算:低纹理区域更激进剪枝,高频细节区域保留更多,并用自适应高斯头重预测保留基元属性以补偿稀疏化。实验覆盖RE10K、ACID、DL3DV、Tanks and Temples和DTU,表明其在可控减少高斯数量时较好维持重建质量。

Beyond Random Sampling: Distribution-Aware Alignment for Semi-Supervised Medical Image Segmentation Figure 1
2026-07-07cs.CV

Beyond Random Sampling: Distribution-Aware Alignment for Semi-Supervised Medical Image Segmentation

Weihao Yan, Yeqiang Qian, Yi Dong, Ming Yang

2026-07-07视觉感知

针对半监督医学分割在低标注比例下随机抽样易造成代表性偏差、伪标签噪声放大的问题,论文把标注/未标注划分视为分布对齐任务:先用视觉基础模型特征和 Density-K-Center 选择更具代表性的标注锚点,再用带前景/背景记忆库的 MCP 进行渐进式 Copy-Paste 对齐。六个2D/3D数据集实验显示其在1/16等极低标注场景下优于多种SSMIS方法,推理阶段无额外开销。

HeartVolMesh: Cardiac Volumetric Mesh Reconstruction via Covariance-Guided Graph Deformation Figure 1
2026-07-07cs.CV

HeartVolMesh: Cardiac Volumetric Mesh Reconstruction via Covariance-Guided Graph Deformation

Fengming Lin, Arezoo Zakeri, Haoran Dou, Zherui Zhou, Shaokun Lan, Jinming Duan, Alejandro Frangi

2026-07-07三维

本文针对心脏数字孪生中“分割后四面体化”易丢失薄壁细节、且跨病例网格对应性差的问题,提出 HeartVolMesh:用 3D CNN-GNN 将模板顶点建模为带各向异性协方差的高斯核,并以协方差感知 NLL 监督变形;再通过模板四面体网格到重建表面的配准和形变传播生成体网格。实验显示其相较变形式基线提升表面精度和体网格质量,并保持 24 个心脏结构的对应关系。

Hierarchical Multi-to-Single-Modal Knowledge Distillation for Disruption Prediction in EAST Figure 1
2026-07-07cs.CV

Hierarchical Multi-to-Single-Modal Knowledge Distillation for Disruption Prediction in EAST

Qiang Chen, Xiao Wang, Hao Si, Qingquan Yang, Meiwen Chen, Jianhua Yang, Xiaofeng Han, Yunhu Jia, Ran Chen, Liang Wang, Jin Tang, Guosheng Xu

School of Computer Science and Technology, Anhui University, Hefei 230031, China, Institute of Plasma Physics, Chinese Academy of Sciences, Hefei 230031, China, State Key Laboratory of Opto-Electronic Information Acquisition and Protection Technology, Anhui University, Hefei 230039, China

2026-07-07视觉感知

这篇论文针对 EAST 托卡马克破裂预测中多模态模型精度高但推理成本重的问题,提出训练阶段融合可见光图像与时序诊断信号、推理阶段仅保留时序学生模型的分层多到单模态蒸馏框架,并在图结构、表征和决策层传递知识。结果显示,学生模型在 640 炮数据上保持 91.66% TPR、97.88% AUC,推理仅 3.75 ms,同时相较教师模型加速 2.16 倍并显著减少 FLOPs 与参数量。

SoftVTBench: A Safety-Aware Visuo-Tactile Benchmark for Physically Constrained Robotic Manipulation of Deformable Objects Figure 1
2026-07-07cs.RO

SoftVTBench: A Safety-Aware Visuo-Tactile Benchmark for Physically Constrained Robotic Manipulation of Deformable Objects

Bowen Jing, Mingxin Wang, Ruiyang Hao, Chenchen Ge, Hanwen Shen, Junjie He, Yang Cui, Yiming Hou, Weitao Zhou, Jiawei Wang, Minglei Li, Dandan Zhang, Ding Zhao, Houde Liu, Xiaofan Li, Si Liu, Ping Luo, Haibao Yu

2026-07-07机器人数据集/基准安全鲁棒

SoftVTBench针对柔性物体操作中“完成任务但接触不安全”的评测缺口,构建Isaac Sim/FEM驱动的视触觉基准,将Goal Success与无掉落、低形变约束下的Safety Success分开统计。实验显示仅看成功率会高估策略表现;加入触觉后,柔性物体任务安全成功率如21.4%提升到35.6%,且形变更小。

Topology-Driven Transferability Estimation for 3D Medical Vision Foundation Models Figure 1
2026-07-07cs.CV

Topology-Driven Transferability Estimation for 3D Medical Vision Foundation Models

Jiaqi Tang, Shaoyang Zhang, Fandong Zhang, Shu Zhang, Yang Liu, Qingchao Chen

National Institute of Health Data Science, Peking University, Beijing, China, Institute of Medical Technology, Peking University, Beijing, China, Deepwise Co., Ltd., State Key Laboratory of General Artificial Intelligence, Peking University, Beijing, China, Wangxuan Institute of Computer Technology, Peking University, Beijing, China

2026-07-07视觉感知三维

针对3D医学视觉基础模型下游分割任务中模型选择依赖逐一微调、代价高且现有迁移性指标忽视体素空间结构的问题,本文提出基于最小生成树的非参数拓扑估计框架,用特征图与语义标签图的对齐来评估可迁移性,并以LBTC刻画局部边界泄漏、GRTD刻画全局解剖布局,再用任务自适应门控融合。作者还论证随机初始化解码器可作为保持拓扑的空间投影以稳定全局评估。在覆盖11.4万3D医学体数据和多解剖/模态分割任务的实验中,该方法较最佳基线加权Kendall’s τ提高0.36,并将评估加速56倍。

CritiqueDriveVLM: From Verifier-Guided Reinforcement Learning to Latent Thought Distillation for Autonomous Driving Figure 1
2026-07-07cs.CV

CritiqueDriveVLM: From Verifier-Guided Reinforcement Learning to Latent Thought Distillation for Autonomous Driving

Zhaohong Liu, Hao Ye, Xianlin Zhang, Mengshi Qi

2026-07-07视觉语言强化学习

面向自动驾驶 VLM 中 SFT 易产生推理幻觉、CoT/工具调用又难实时部署的问题,论文提出 CritiqueDriveVLM:先用多维验证器引导多轮强化学习训练高精度 Teacher,再将其收敛推理状态蒸馏到 Student 的隐空间,实现无 CoT 快速决策。在 DriveLMM-o1 上,MCQ 从 55.54% 提升到 76.54%,Student 平均仅生成 28 tokens,延迟由 3482 ms 降至 416 ms。

SeeMe: Mitigating Hallucinations in Large Vision-Language Models through Effective Visual Token Engineering Figure 1
2026-07-07cs.CV

SeeMe: Mitigating Hallucinations in Large Vision-Language Models through Effective Visual Token Engineering

Kai Tang, Jinhao You, Bohua Zhang, Yichen Guo, Yiding Sun, Dongxu Zhang, Chenxi Li, Xiande Huang, Shanghang Zhang

2026-07-07视觉语言视觉感知

针对大视觉语言模型常因冗余、噪声视觉 token 被送入解码器而产生幻觉的问题,SeeMe 将传统特征工程思想用于视觉 token 处理,采用先按跨模态注意力筛选、再语义合并、最后结合语言上下文重选的免训练流程,在不改模型结构和不再训练的情况下,在 MME、POPE、AMBER 及四个 LVLM 上稳定降低幻觉并提升输出一致性。

FedProIn: Mitigating Client Drift for Learnable Prototypes in Federated Medical Imaging Figure 1
2026-07-07eess.IV

FedProIn: Mitigating Client Drift for Learnable Prototypes in Federated Medical Imaging

Harsh Kumar, Tarun Kumar Garg, Vaanathi Sundaresan

2026-07-07视觉感知

针对医疗联邦学习中因扫描设备、协议和人群差异导致的非 IID 客户端漂移,FedProIn 将类别原型设为可学习的多原型参数,并把漂移拆成特征漂移与原型漂移,分别用特征发散损失和原型对比损失约束,再用归一化影响力聚合削弱偏置客户端更新。在 HAM10000 与 Matek-19 上,IID/非 IID 准确率分别达 83.5/81.1% 和 96.2/95.8%,优于对比方法。

Perceiving Better Moments: Cover Frame Reselection and Enhancement for Live Photos with the Live2K Dataset Figure 1
2026-07-07cs.CV

Perceiving Better Moments: Cover Frame Reselection and Enhancement for Live Photos with the Live2K Dataset

Junyu Lou, Kai Chen, Weiyi You, Hui Zeng, Lei Zhang, Shuhang Gu

2026-07-07数据集/基准

针对 Live Photo 中高质量封面照与低质量视频帧由不同成像流水线造成的分辨率、色彩和动态范围落差,论文提出 LPRE 任务:用原封面作结构/颜色参考、邻近视频帧作时序线索来增强用户重选帧。其核心贡献是构建含 2042 个真实 Live Photos 的 Live2K 数据集,并给出融合多帧、引导色彩增强和超分的一阶段基线;实验表明该基线在重选封面增强上有效,为该新任务建立首个基准。

Beyond Scene Priors: Fine-Grained Traffic Scene Reasoning with Benchmarking and Query-Guided Small-Object Focus Figure 1
2026-07-07cs.CV

Beyond Scene Priors: Fine-Grained Traffic Scene Reasoning with Benchmarking and Query-Guided Small-Object Focus

Waikit Xiu, Qiang Lu, Zian Wang, Xinjie Yang, Zhiwei Chen, Chen Sun, Xiying Li

The University of Hong Kong, Sun Yat-Sen University, The Hong Kong University of Science and Technology (Guangzhou)

2026-07-07数据集/基准

该文针对交通场景中小标志、路面标记等关键局部证据易被背景淹没的问题,指出现有VQA基准难暴露这种“关键证据稀释”。作者构建FGTR-Bench,并在Qwen3-VL-4B上加入查询引导的TG-SOF稀疏视觉token增强,无需外部检测器。结果显示TSR-MLLM在FGTR-Bench达74.1%,较最强4B基线提升2.1点,并在证据局部任务上增益更明显。

HCSU: A Dataset and Benchmark for Fine-Grained Historical Calligraphy Style Understanding Figure 1
2026-07-07cs.CV

HCSU: A Dataset and Benchmark for Fine-Grained Historical Calligraphy Style Understanding

Yinsheng Yao, Yan Liu, Chen Ye

2026-07-07数据集/基准

这篇论文针对历史书法风格理解中多模态混杂与标签过粗的问题,提出 HCSU 数据集与基准,收集 10 个朝代、49 位书家的 39,307 张字图,并区分墨迹、碑拓和野外图像,同时加入专家层级审美描述。其核心洞察是书法风格识别不能只靠字形或书家标签,而要将内容与笔法、结体、墨色等细粒度视觉证据解耦。实验显示现有 LVLM 虽具备一定书法知识,但仍易受字形、文本和来源线索干扰,难以把审美判断可靠落到笔触证据上。

Binary Iterative Method for Non-targeted Adversarial Attack Figure 1
2026-07-07cs.LG

Binary Iterative Method for Non-targeted Adversarial Attack

Naman Goyal, Milan Chaudhari

2026-07-07视觉感知

本文针对非定向对抗攻击中步长与扰动搜索难以优化的问题,提出 Binary Iterative Method,在 BIM 基础上用二分/分治思想动态缩小迭代步长,以近似寻找局部最优扰动。实验在 ImageNet 随机 1000 张图和 Inception、ResNet 等预训练分类器上比较 FGSM、BIM、VAM,报告该方法能更高置信度诱导误分类,并将真实类别概率降至接近 0;但其理论收敛性与增益来源文中未充分说明。

Real-Time LiDAR Gaussian Splatting SLAM Figure 1
2026-07-07cs.CV

Real-Time LiDAR Gaussian Splatting SLAM

Seungjun Tak, Yewon Jeon, Jaeik Hwang, SukMin Hwang, Seongbo Ha, Hyeonwoo Yu

2026-07-07三维

这篇论文针对传统 LiDAR SLAM 地图稀疏、3D Gaussian Splatting 在线建图易膨胀且误差会长期反馈的问题,提出将 G-ICP 跟踪与球面 2D 高斯稠密建图紧耦合:复用局部协方差初始化尺度和法向,并用几何复杂度做剪枝/增密,同时把可靠性线索反馈给配准。结果在 Newer College 上以纯在线轨迹达到 86.78% F-score 和超过 20 FPS,并在 KITTI、Oxford Spires 等数据上显示较好的稳定性与可扩展性。

FRFDet: Efficient UAV Small Object Detection with Symmetric Sampling and Scalable Fusion Figure 1
2026-07-07cs.CV

FRFDet: Efficient UAV Small Object Detection with Symmetric Sampling and Scalable Fusion

Yunzhong Si, Huiying Xu, Xinzhong Zhu, Yang Liu, Yao Dong, Wenhao Zhang, Hongbo Li

2026-07-07视觉感知

面向无人机图像中小目标易被下采样淹没、背景冗余强且多尺度语义错位的问题,FRFDet在轻量单阶段检测器中引入对称的IBS采样以保留细节并重建空间一致性,同时用SFRCF按模型规模选择乘法或加法跨组融合。实验覆盖VisDrone、UAVDT、HazyDet和MS COCO,显示其在轻量检测器中以较低参数量、计算量和延迟取得领先精度,适合机载实时感知。

SOV-CAD: Stepwise Orthographic Views Guided CAD Modeling Sequence Reconstruction Figure 1
2026-07-07cs.CV

SOV-CAD: Stepwise Orthographic Views Guided CAD Modeling Sequence Reconstruction

Zhaopeng Feng, Chen Zhi, Xuhong Zhang, Zhengwen Feng, Xinkui Zhao

2026-07-07三维

SOV-CAD针对现有CAD重建方法一次性生成完整建模序列、缺少中间反馈而难以保留可编辑设计意图的问题,将CAD恢复建模为逐步决策过程。其核心是在每一步引入目标与当前模型的三视图正投影、活动草图和几何一致性奖励,并用离线强化学习的Decision Transformer预测后续操作。实验称其在CAD序列重建上优于已有方法且数据效率更高,但具体增益中各视觉监督与RL设计的独立贡献仍需结合消融判断。

GlacierCastAI: Predicting Glacier Retreat from Multi-Modal Satellite Imagery and Climate Signals Figure 1
2026-07-07cs.LG

GlacierCastAI: Predicting Glacier Retreat from Multi-Modal Satellite Imagery and Climate Signals

Arunkumar Ramachandran

2026-07-07视觉感知

这篇论文针对现有冰川遥感多停留在“当前边界制图”、难以提前预警退缩的问题,将任务改写为多模态时空预测:融合多时相 Landsat、ERA5 季节气候和 DEM,并用 ResNet50、ConvLSTM 与气候交叉注意力建模。结果显示,加入 ERA5 后 IoU 从 0.326 提升到 0.337,深度模型明显优于持久性和线性趋势基线;气候-only MLP 已接近影像模型表现,提示退缩信号可能先体现在气候变量中,但单次训练和小冰川表现差使结论仍需更多验证。

DynaVieW: Schema-Guided World Modeling for Understanding Hierarchical Visual Dynamics Figure 1
2026-07-07cs.LG

DynaVieW: Schema-Guided World Modeling for Understanding Hierarchical Visual Dynamics

Silin Gao, Hao Zhao, Zeming Chen, Sepideh Mamooler, Antara Raaghavi Bhattacharya, Qiyu Wu, Hiromi Wakaki, Yuki Mitsufuji, Li Mi, Syrielle Montariol, Antoine Bosselut

2026-07-07强化学习

本文针对多模态大模型难以稳定理解视频/多图中的层级视觉动态,提出 DynaVieW:用视频关键帧作为状态、层级 JSON 描述作为转移,联合学习转移预测与下一状态生成,并结合混合专家、跨专家选择注意力和 schema token 重加权损失。实验显示其在视觉叙事生成中提升跨场景一致性与可控性,在 LEGO 世界模拟上也优于 BAGEL,说明显式建模状态—转移有助于减少长程生成误差。

The Multipath Blind Spot: $K$-Agnostic Robust Calibration for Sparse-Anchor Metric Depth from Frozen Foundations Figure 1
2026-07-07cs.CV

The Multipath Blind Spot: $K$-Agnostic Robust Calibration for Sparse-Anchor Metric Depth from Frozen Foundations

Sohag Roy, Rajesh Misra, Swami Shastravidyananda, Tamal Maharaj

The authors are with the Department of Computer Science, Ramakrishna Mission Vivekananda Educational and Research Institute (RKMVERI)

2026-07-07安全鲁棒

这篇论文针对单目深度基础模型用少量测距锚点恢复绝对尺度时默认锚点干净的问题,指出真实 ToF/LiDAR 的多径、混合像素等“有值但错误”离群点会使 VI-Depth 等校准方法失效。核心做法 MRAC 不训练新参数,而是用基础模型相对深度与锚点之间的 Theil–Sen 鲁棒拟合和 MAD 门控先剔除不一致锚点,再调用原校准头。实验在 320 个鲁棒性设置中显示其相对同骨干控制赢得 84% 单元,并将 KITTI 多径 AbsRel 从 0.489 降至 0.151。

Sparse4D-Radar: An Efficient and Robust Framework for Surround-View 3D Object Detection via 4D Radar-Camera Fusion Figure 1
2026-07-07cs.CV

Sparse4D-Radar: An Efficient and Robust Framework for Surround-View 3D Object Detection via 4D Radar-Camera Fusion

Fuyuan Ai, Yuchen Tan, Jiehui Chen, Zhiwei Xu, Chunyi Song

2026-07-07视觉感知三维安全鲁棒

该文针对现有4D雷达-相机融合多停留在前视、扩展到360°又计算开销过高的问题,提出Sparse4D-Radar,用稀疏查询框架结合可变形融合对齐雷达空间线索与图像语义,并用速度一致性采样抑制鬼影噪声、自适应模态门控调节传感器可靠性。在OmniHD-Scenes上,Base达47.01% mAP、57.25% ODS和11.5 FPS,Acc提升到47.57% mAP、58.35% ODS,在恶劣场景也保持较强鲁棒性。

Seeing Once is Enough? Online Geometry-Aware Token Pruning for 3D Question Answering Figure 1
2026-07-07cs.CV

Seeing Once is Enough? Online Geometry-Aware Token Pruning for 3D Question Answering

Ruei-Chi Lai, Bolivar Solarte, Chin-Hsuan Wu, Yi-Hsuan Tsai, Min Sun

National Tsing Hua University, Industrial Technology Research Institute ITRI, University of Toronto

2026-07-07三维

针对3D问答需要多视角输入、推理时视觉token和显存成本高,且既有帧选择/压缩多依赖离线全序列预处理的问题,论文提出无需训练的在线几何感知token剪枝:用深度和相机位姿把逐帧RGB-D投到共享体素空间,识别跨帧重叠区域并在进入VLM前删去冗余图像token。方法接入Qwen2.5-VL-7B和Qwen3-VL-8B,在ScanQA、SQA3D、OpenEQA-HM3D上最多减少约50% token,并报告LLM-Match最高提升+5.1。

Enhancing Implicit Neural Representations with Image Feature Embedding for Unsupervised Cardiac Cine MRI Reconstruction Figure 1
2026-07-07cs.CV

Enhancing Implicit Neural Representations with Image Feature Embedding for Unsupervised Cardiac Cine MRI Reconstruction

Donghang Lyu, Marius Staring, Yiming Dong, Keupp Jochen, Hildo J. Lamb, Mariya Doneva

Division of Image Processing, Department of Radiology, Leiden University, Center, Department of Radiology, Leiden University

2026-07-07视觉感知三维

针对心脏电影 MRI 高倍欠采样下缺少全采样监督数据、传统 k 空间 INR 难以建模全局分布且易引入伪影的问题,论文提出图像域双分支 I-FP-INR,用坐标分支结合零填充图像提取的特征嵌入,并通过交替推理阶段逐步细化输入特征。在 CMRxRecon2024 和院内数据上,方法在 4×、8×及多种采样掩码下较基线稳定提升重建质量。

PreSIST: Vision-Language-Informed Object Persistence Prediction in Open-World Scenes Figure 1
2026-07-07cs.CV

PreSIST: Vision-Language-Informed Object Persistence Prediction in Open-World Scenes

Amanda Adkins, Tarunvidyut Ravisankar, Joydeep Biswas

2026-07-07视觉语言视觉感知强化学习

这篇论文针对长期运行机器人在动态环境中不能只靠事后观测更新地图的问题,提出用场景上下文主动预测物体在原位持续存在的概率。核心洞察是同类物体的持久性取决于用途和场景,PreSIST以VLM生成实例级生存先验,并用视觉模型蒸馏以便部署,再与概率持久性滤波结合。作者在新标注的开放场景数据集上显示,PreSIST-Lang和PreSIST-Vis优于同等效率基线。

SiamJEPA: On the Role of Siamese Student Encoders in JEPA Figure 1
2026-07-07cs.CV

SiamJEPA: On the Role of Siamese Student Encoders in JEPA

Makoto Yamada

Okinawa Institute of Science and Technology

2026-07-07视觉感知

本文针对现有 JEPA 多采用单学生编码器、暹罗学生编码器作用缺乏系统验证的问题,提出 SiamJEPA:用两路独立掩码视图和 EMA 教师在潜空间做预测,并用可调正则项统一单编码器情形。ImageNet 线性探测显示,暹罗结构更像有效归纳偏置/正则器,可提升表征可分性、加速早期收敛,在有限训练预算下优于单编码器 JEPA 变体和更长训练的 MAE。

Paired Uterine Whole-Slide Images and Pathology Reports for Multimodal Computational Pathology Figure 1
2026-07-07cs.CV

Paired Uterine Whole-Slide Images and Pathology Reports for Multimodal Computational Pathology

Han Li, Jingsong Liu, Ayako Ura, Junlin Hou, Zhengyang Xu, Azar Kazemi, Oskar Thaeter, Christian Grashei, Fabian Gülhan, Reza Nasirigerdeh, Xun Ma, Rui Yan, Hao Chen, S. Kevin Zhou, Nassir Navab, Carolin Mogler, Peter Schüffler

Institute of Pathology, Technical University of Munich, Munich, Germany, Computer Aided Medical Procedures (CAMP), Technical University of Munich, Munich, Germany, Munich Center for Machine Learning (MCML), Munich, Germany, Department of Human Pathology, Juntendo University Graduate School of Medicine, Tokyo, Japan, The Hong Kong University of Science and Technology, Hong Kong, China, Munich Data Science Institute (MDSI), Munich, Germany, School of Biomedical Engineering, University of Science and Technology of China, Hefei, China

2026-07-07视觉语言视觉感知

面向多模态计算病理中缺少真实全切片图像与诊断报告配对数据的问题,本文发布 TUM-Uteria 数据集,将子宫病理 WSI 与病例级、切片级报告系统对齐,并通过翻译校正、匿名化、LLM 辅助抽取和病理专家多阶段质控建立配对。数据包含 216 个临床病例、455 个切片级 WSI-报告对,覆盖常规诊疗中的良恶性及炎症等病变,可用于 WSI 分析、视觉语言建模和自动报告生成。

SAGE: Synchronized Action-Gaze Recognition and Anticipation for Human Behavior Understanding Figure 1
2026-07-07cs.CV

SAGE: Synchronized Action-Gaze Recognition and Anticipation for Human Behavior Understanding

Chenyi Kuang, Nakul Agarwal

2026-07-07视觉感知

这篇论文针对现有方法将人-物交互、注视识别与未来预测割裂建模的问题,提出 SAGE,用 gaze-conditioned 空间注意力和时间预测模块在同一 Transformer 框架中联合识别并预测动作与注视,且兼容第一、第三人称视角。作者还构建 Exo-Cook 以补足第三人称联合评测空白;在 VidHOI、EGTEA Gaze+ 和 Exo-Cook 上,联合建模整体达到或超过多种专用模型。

Full Glyph Images Beat Token Embeddings: A Controlled Study for Transformers Figure 1
2026-07-07cs.CV

Full Glyph Images Beat Token Embeddings: A Controlled Study for Transformers

Shuyang Xiang, Hao Guan

Institute of Software, Chinese Academy of Sciences.

2026-07-07视觉感知规划控制

这篇论文质疑中文语言模型必须依赖离散 token 嵌入的默认做法,改用整段汉字序列的栅格字形图像作为输入,并在共享解码器、训练目标和数据流程的双分支框架中控制比较。核心洞察是,汉字的二维空间布局、笔画与部首结构可由 ResNet+浅层 ViT 的视觉编码器转化为有效语言表示。实验中视觉模型在多个解码器上优于索引嵌入,峰值 Acc@1 为 0.429 对 0.355,约提升 21%,且收敛更快、对中等字符扰动更稳健;但英文实验未复现该优势,说明结论可能主要限于汉字等表意文字场景。

InSpace: Structure-Aware 3D Indoor Scene Generation from a Single 360° Image Figure 1
2026-07-07cs.CV

InSpace: Structure-Aware 3D Indoor Scene Generation from a Single 360° Image

Gwanhyeong Koo, Hyunsu Kim, Youngji Kim, Taejae Lee, Siwoo Lim, Sunjae Yoon, Suyong Yeon, Chang D. Yoo

2026-07-07视觉感知三维

这篇工作针对单图到3D方法只生成物体、缺少墙地等结构布局而导致室内场景漂浮和错位的问题,改用360° ERP全景作为输入,并以深度反投影先验、视角选择交叉注意力和全局-局部混合注意力分阶段生成结构、资产与纹理。作者还构建ERP-FRONT配对数据集;实验显示其在3D几何与2D渲染指标上优于现有方法,并可泛化到真实全景数据。

BanglaMemeEvidence: A Multimodal Benchmark Dataset for Explanatory Evidence Detection in Bengali Memes Figure 1
2026-07-07cs.CL

BanglaMemeEvidence: A Multimodal Benchmark Dataset for Explanatory Evidence Detection in Bengali Memes

Fatema Tuj Johora Faria, Mukaffi Bin Moin, Md. Mahfuzur Rahman, Pronay Debnath, Asif Iftekher Fahim, Faisal Muhammad Shah

2026-07-07视觉语言视觉感知数据集/基准

针对孟加拉语表情包常依赖社会、政治和文化背景、现有多模态研究多停留在情感或有害性分类的问题,论文提出 MemeEvidenceDetect 任务,并构建含 2917 个表情包、OCR、上下文、证据句和三级相关性标注的 BanglaMemeEvidence 基准;同时给出融合文本与视觉特征的 BengaliMemeEvidenceNet,实验 F1 达 0.74,但模型增益相对数据与融合设计的来源文中未充分说明。

Scalable Semantic Steering of Embedding Projections Figure 1
2026-07-07cs.HC

Scalable Semantic Steering of Embedding Projections

Wei Liu, Eric Krokos, Kirsten Whitley, Rebecca Faust, Chris North

Department of Defense, Tulane University

2026-07-07视觉感知

低维嵌入投影常难符合分析者想看的语义结构,而逐项调用 LLM 做语义 steering 成本随数据量线性增长。本文的关键洞察是把意图建模从单个样本移到用户分组:一次 LLM 生成组级语义画像,并与种子中心融合成混合原型,再用嵌入空间软分配和重投影传播意图。在 5K LitCovid 文本上,其全局对齐接近逐项 LLM 方法,但调用量降到常数级、成本降低超三数量级;图像案例表明该机制也可迁移到多模态嵌入。

DS-SAC: Density Search for Sample Consensus Figure 1
2026-07-07cs.CV

DS-SAC: Density Search for Sample Consensus

Suraj Thapa, Muhammad Aminul Islam

\orgdiv Tagliatela College of Engineering, \orgname University of New Haven, \orgaddress \street 300 Boston Post Rd, \city West Haven, \postcode 06516, \state CT, \country USA

2026-07-07视觉感知

本文针对RANSAC类几何模型估计在高外点率下依赖随机最小采样、迭代开销大的问题,提出DS-SAC:先用全部点初始化模型,再通过残差空间的前向/后向密度搜索与带符号残差递归划分,确定性寻找高一致性区域。实验覆盖单应、基础矩阵和本质矩阵估计,显示其相较RANSAC、MAGSAC、LO-RANSAC、GC-RANSAC通常取得更高AUC、相当或更低位姿误差,并提升运行速度。

Reward Lightning: Fast Video Generation via Homologous Preference Distillation Figure 1
2026-07-07cs.CV

Reward Lightning: Fast Video Generation via Homologous Preference Distillation

Jiaxiang Cheng, Bing Ma, Xuhua Ren, Kai Yu, Peng Zhang, Tianxiang Zheng, Qinglin Lu

2026-07-07视觉感知强化学习

视频扩散模型的少步蒸馏常会破坏人类偏好,而把像素奖励与潜空间蒸馏硬拼又会带来梯度冲突。Reward Lightning 的核心洞察是让偏好对齐和蒸馏在同一潜特征与共享奖励骨干上“同源”优化,并用 LRM 与 HPD 联合训练。实验显示 LRM 偏好准确率较像素/潜空间基线高 11.0%/14.7%,1–4 步生成下 VBench 平均提升 2.1%,文本对齐、运动和视觉质量领先。

Cross-Modal Fusion of OCT and OCT angiography enface for Improved Diagnostics of Diabetic Retinopathy Figure 1
2026-07-07eess.IV

Cross-Modal Fusion of OCT and OCT angiography enface for Improved Diagnostics of Diabetic Retinopathy

Rashadul Hasan Badhon, Atalie Carina Thompson, Jennifer I. Lim, Theodore Leng, Minhaj Nur Alam

Most of the commercially available devices produce OCT slices and OCTA enface. Not to mention that OCTA, requires additional expensive hardware which is not always affordable or available at the local clinics. Hence, for, additional vascular information present in OCTA, combining it with the already available OCT, disease prognosis

2026-07-07视觉感知

该文针对糖尿病视网膜病变筛查中单用OCT缺少血管信息、OCTA硬件成本较高的问题,提出用双向跨模态注意力融合OCT B-scan与单通道enface OCTA,并进一步评估由OCT生成的翻译OCTA。结果显示,在OCT500与UIC的同域、合并和跨域设置中,融合方法整体优于ConvNeXt V2的OCT单模态基线,翻译OCTA在多数场景接近或超过真实OCTA,尤其提升敏感性与跨数据集泛化。

TESSERA v2: Scaling Pixel-wise Earth Foundation Models Figure 1
2026-07-07cs.CV

TESSERA v2: Scaling Pixel-wise Earth Foundation Models

Zhengpeng Feng, Sadiq Jaffer, Ira Shokar, Jovana Knezevic, Mark Elvers, Clement Atzberger, Robin Young, Aneesh Naik, Niall Robinson, Andrew Blake, David Coomes, Anil Madhavapeddy, Srinivasan Keshav

University of Cambridge, dClimate Labs

2026-07-07视觉感知

这篇工作针对地球观测基础模型预训练预算如何分配不清的问题,做了395次受控缩放实验,指出预训练损失几乎不能预测下游效果,应按下游任务选择模型,并将算力主要投向编码器和数据规模、固定投影头。基于该规则训练大教师并蒸馏为可部署学生模型,21M参数版本在29项任务上超过多种开放和闭源基线,16维前缀以1/8存储保留约92%性能。

A Large-Scale Dataset and a New Method for RemoteSensing Traffic Object Segmentation Figure 1
2026-07-07cs.CV

A Large-Scale Dataset and a New Method for RemoteSensing Traffic Object Segmentation

Zhigang Yang, Huiguang Yao, Linmao Tian, Qiang Li, Qi Wang

2026-07-07视觉感知数据集/基准

针对遥感交通目标分割中类别覆盖少、场景单一且影像过旧的问题,论文构建了 NWPU-Traffic 数据集,覆盖49城7国的汽车、飞机、船舶和火车,并给出实例级标注与基准;方法上引入空间-通道保持的多尺度特征交互和自适应局部-全局解码器,以缓解尺度变化和边界模糊。实验和消融表明该框架优于多种常用分割网络,但具体增益中数据扩展与模型设计的相对贡献仍需结合完整结果判断。

EgoInertia-MI: A Multimodal Egocentric Vision and IMU Benchmark for Motor Impairment Assessment Figure 1
2026-07-07cs.CV

EgoInertia-MI: A Multimodal Egocentric Vision and IMU Benchmark for Motor Impairment Assessment

Fatemah Alhamdoosh, Pietro Pala, Abduallah Mohamed, DK Arvind

2026-07-07视觉语言视觉感知数据集/基准

这篇论文针对临床运动障碍评估间歇性强、第三人称视频隐私和场景约束大的问题,提出 EgoInertia-MI,将胸前第一视角视频与可穿戴 IMU 同步采集,覆盖19类上下肢活动和无、轻、重三档模拟障碍,并设定动作识别与严重程度估计基准。结果显示第一视角视频本身已有有效线索,多模态融合最好,严重程度估计 Macro-F1 为0.78,动作识别为0.93;但数据来自健康志愿者模拟,临床泛化仍需验证。

GLOW-FDG: Generalized cancer LesiOn Whole-body segmentation model for $^{18}$F-FDG-PET/CT Figure 1
2026-07-07eess.IV

GLOW-FDG: Generalized cancer LesiOn Whole-body segmentation model for $^{18}$F-FDG-PET/CT

Maksym Fritsak, Maximilian Rokuss, Hubert S. Gabryś, Yannick Kirchhoff, Benjamin Hamm, Sebastian M. Christ, Nicolas Martz, Isabelle Opitz, Rolf Stahel, Martin Hüllner, Matthias Guckenberger, Klaus Maier-Hein, Stephanie Tanadini-Lang

2026-07-07视觉感知

针对全身FDG-PET/CT肿瘤病灶手工勾画耗时且跨癌种泛化差的问题,GLOW-FDG用1563例多癌种数据训练开源分割模型,并结合PET/CT错位增强、器官多任务监督和损失调整来降低假阳性。其在185例外部多机构扫描上,跨乳腺癌、肺癌、头颈癌和黑色素瘤的检测F1普遍优于AutoPET等公开模型,肿瘤负荷与TLG量化也较稳健,表现接近专家间差异。

NavEYE: Vision-Centered Multi-Sensor Fusion-Based Situational Awareness System for Intelligent Surface Vehicles Figure 1
2026-07-07cs.CV

NavEYE: Vision-Centered Multi-Sensor Fusion-Based Situational Awareness System for Intelligent Surface Vehicles

Ryan Wen Liua, Junxiong Lianga, Haoyu Wanga, Mengwei Baoa

2026-07-07视觉感知

面向智能水面航行器在复杂海况中依赖单一传感器易丢失身份、距离或语义信息的问题,NavEYE以视觉为中心融合AIS、雷达与相机,提出AIS-雷达多约束关联、距离自适应加权与时效衰减拼接,并用方位和距离双约束完成视觉跨模态关联。实船多源数据实验显示,其在轨迹连续性、关联精度和态势展示上优于对比方法,但具体泛化边界仍需更多场景验证。

USE: A Unified Self-Ensembling Framework for Test-Time Prompt Tuning Figure 1
2026-07-07cs.CV

USE: A Unified Self-Ensembling Framework for Test-Time Prompt Tuning

Siru Jiang, Jian Liang, Ran He, Tieniu Tan

2026-07-07视觉感知

这篇论文针对 CLIP 测试时提示调优在分布偏移下依赖多视图增强、且优化与推理目标不一致的问题,指出 TPT 的熵最小化可视为从自生成伪标签学习。作者提出 USE,在优化和推理阶段都用自集成策略自适应强调原始/弱增强视图,并融合强增强以获得更可靠预测;实验显示 SE 可作为免优化 TTA 方法提升性能,USE 在多数据集上优于对应基线,且 SE 接入其他 TTA 方法也带来稳定增益。

DICT: Data Injection and Contrastive Trajectory Refinement for Conditional Image Generation with Diffusion Models Figure 1
2026-07-07cs.CV

DICT: Data Injection and Contrastive Trajectory Refinement for Conditional Image Generation with Diffusion Models

Chunnan Shang, Xin Zhang, Zhizhong Wang, Hongwei Wang

2026-07-07视觉感知生成模型规划控制

本文针对条件扩散生成中任务专用设计泛化差、推理时损失引导把高维条件压成标量而造成信息瓶颈和轨迹误差累积的问题,提出无需训练的 DICT:在早期去噪注入加噪条件信号以保留空间细节,并用相邻去噪状态的对比轨迹目标约束逐步改进。实验覆盖风格迁移、超分和去模糊,报告相较任务专用与损失引导基线在保真度和感知质量上有稳定提升。

BAT3R: Bootstrapping Articulated 3D Reconstruction from 2D Image Collections Figure 1
2026-07-07cs.CV

BAT3R: Bootstrapping Articulated 3D Reconstruction from 2D Image Collections

Jakub Zadrozny, Oisin Mac Aodha, Hakan Bilen

University of Edinburgh

2026-07-07视觉感知三维

BAT3R针对铰接/可变形物体三维重建高度依赖人工制作多姿态3D资产的问题,提出只用每类一个带骨架的标准姿态网格和未标注2D图像集来启动训练。其关键思路是先用标准姿态渲染训练弱预测器,再反复从点图预测中拟合相机与关节姿态,生成更丰富的合成监督数据。实验显示,在四足动物等类别上可接近依赖人工铰接数据的DualPM表现,但具体增益在多大程度来自迭代数据扩充仍需结合完整实验细节判断。

SGF-CDNet: A Consistency-Discrepancy Graph Network over Semantic-Geometric Fused Nodes for Face Forgery Detection Figure 1
2026-07-07cs.CV

SGF-CDNet: A Consistency-Discrepancy Graph Network over Semantic-Geometric Fused Nodes for Face Forgery Detection

Jiayao Jiang, Bin Liu, Nenghai Yu

School of Cyber Science and Technology, University of Science and Technology of China, China, Anhui Province Key Laboratory of Digital Security, China

2026-07-07视觉感知

针对深伪人脸在局部伪迹不明显时仍会破坏五官区域协调性的现象,论文提出 SGF-CDNet:先融合人脸解析的语义区域与关键点几何信息构造图节点,再用一致性/差异性双路径 GNN 同时建模自然结构规律和伪造引入的冲突关系,并将图推理结果门控回多尺度特征。文中称其在公开数据集上优于现有方法,消融实验支持语义-几何融合与双路径推理的有效性。

MACRO: Training-free Multi-plane Attention for Closeup Render Optimization Figure 1
2026-07-07cs.CV

MACRO: Training-free Multi-plane Attention for Closeup Render Optimization

Nitzan Hodos, Roy Amoyal, Lior Fritz, Ianir Ideses, Sagie Benaim, Netalee Efrat

Technion, Israel Institute of Technology, Ben Gurion University, Hebrew University of Jerusalem

2026-07-07优化算法

针对3DGS在训练相机之外的近距离渲染易模糊、扩散增强又因目标与参考视图尺度不一致而拷贝错误纹理的问题,MACRO指出VAE/U-Net特征不具尺度不变性且无法在潜空间修正,因而利用场景深度将近景分解为多平面,在图像空间裁剪缩放参考图并用深度感知注意力匹配尺度。方法无需训练或改结构,在两个新近景基准上取得最佳感知指标,并保持有竞争力的重建分数。

SharpSplat: Edge-Regularized 3D Gaussian Splatting for High Fidelity Urban Building Reconstruction from UAV images Figure 1
2026-07-07cs.CV

SharpSplat: Edge-Regularized 3D Gaussian Splatting for High Fidelity Urban Building Reconstruction from UAV images

Porus Vaid, Shivam Chopra, Vaibhav Kumar

2026-07-07视觉感知三维

这篇工作针对无人机图像重建城市建筑时,标准 3DGS 容易把立面、屋顶角点和建筑边界抹平的问题,提出用 SAM3 文本分割得到建筑掩码,再结合 Sobel 边缘提取构造语义边缘监督,在训练中对齐渲染梯度与真实建筑边缘,而不改动 3DGS 架构。实验覆盖校园、密集城区和住宅数据,显示边缘清晰度提升且适应多类建筑,但效果依赖 SAM3 分割质量,损失权重仍需按场景调参。

GeoSelect: Spatial-Program Execution for Training-Free Referring Remote Sensing Image Segmentation Figure 1
2026-07-07cs.CV

GeoSelect: Spatial-Program Execution for Training-Free Referring Remote Sensing Image Segmentation

Yuhang Jiang, Guohui Deng, Miaozhong Xu, Chao Ruan, Jinling Zhao, Linsheng Huang

Yuhang Jiang, Guohui Deng, Chao Ruan, Jinling Zhao, and Linsheng Huang are with the School of, Internet, Anhui University, Hefei, China. Guohui Deng is also with the National Engineering, Research Center for Agro-Ecological Big Data Analysis & Application, Anhui University, Hefei, China.Miaozhong Xu is with the State Key Laboratory of Information Engineering in Surveying

2026-07-07视觉感知

针对遥感指代表达分割中同类目标拥挤、空间/比较/序关系难以由隐式视觉语言匹配可靠解析的问题,GeoSelect将自然语言转成可检查的类型化空间程序,并用几何场与集合/排序算子显式执行选择,无需指代表达监督。其在RRSIS-D与RISBench上分别达到58.86和55.27 mIoU,显著超过既有训练免费方法;消融显示主要增益来自显式空间执行而非骨干模型。

Ghosts Beneath Textures: Texture-Relation Cues for Cross-Paradigm AI-Generated Image Detection Figure 1
2026-07-07cs.CV

Ghosts Beneath Textures: Texture-Relation Cues for Cross-Paradigm AI-Generated Image Detection

Haoyu Wang, Yiming Qin, Zhongjie Ba, Ziping Dong, Jishen Zeng, Peng Cheng, Kui Ren

2026-07-07视觉感知

本文针对现有 AI 图像检测器多在文生图/噪声生成范式下验证、难以迁移到图像条件生成的问题,构建 ConImageGen 跨范式基准,并指出可泛化线索不在显式伪影本身,而在与语义弱相关的局部—全局纹理关系。基于此提出 DTS-Det,通过纹理关系编码与注意机制提升检测泛化性,在 ConImageGen 达到 99.6% 准确率,并在 PicoBanana、RAID 及攻击场景下优于基线。

PRISM3D: Probabilistic Refinement and Robust Initialization for Physically Consistent Scene Modeling under Extreme Motion Blur Figure 1
2026-07-07cs.CV

PRISM3D: Probabilistic Refinement and Robust Initialization for Physically Consistent Scene Modeling under Extreme Motion Blur

Gopi Raju Matta, Reddypalli Trisha, Vemunuri Divya Madhuri, Kaushik Mitra

2026-07-07三维安全鲁棒

PRISM3D面向机器人和手持成像中极端运动模糊导致SfM失效、进而难以重建3D场景的问题。其关键洞察是把深度SfM提供的稀疏全局拓扑、MCMC概率化高斯增密,以及连续Bézier相机轨迹的物理成像模型耦合起来,并扩展到事件相机辅助的PRISM3D-E。实验显示该RGB管线及多模态版本在强模糊重建中优于既有方法,但动态场景能力仍文中未充分说明。

CogRad: A Cognitively-Inspired Multi-Agent Framework for Radiology Report Generation Figure 1
2026-07-07cs.CV

CogRad: A Cognitively-Inspired Multi-Agent Framework for Radiology Report Generation

Saif Ur Rehman Khan, Hasaan Maqsood, Sebastian Vollmer, Andreas Dengel, Muhammad Nabeel Asim

2026-07-07视觉感知

本文针对放射报告生成中常见的单次前向生成缺乏图像核验、易遗漏或幻觉的问题,提出模拟放射科医生读片流程的 CogRad:由 Scout、Investigator、Writer、Verifier 四类智能体依次完成全局筛查、可疑区域细查、LLM 报告生成与逐句视觉蕴含验证,并可重生成弱 grounding 句子。在 CheXpert Plus 与 IU X-Ray 上,BLEU-4/CIDEr 等指标优于对比方法,并结合 RadGraph、CheXbert、幻觉分析和可视化评估临床一致性。

ContiStain: Cross-Domain Relation-Preserving Distillation for Continual Multi-Domain Virtual IHC Staining Figure 1
2026-07-07cs.CV

ContiStain: Cross-Domain Relation-Preserving Distillation for Continual Multi-Domain Virtual IHC Staining

Fuqiang Chen, Yifeng Wang, Hongpeng Wang, Yongbing Zhang

2026-07-07视觉感知

这篇论文针对临床中新增 IHC 生物标志物按时间陆续到来时,统一虚拟染色模型微调会遗忘旧标志物的问题。核心思路不是只约束输出,而是在 MoE 构造的域感知潜空间中保持跨标志物 token 相似关系,从而减少表示漂移。四域 MIST 连续染色实验中,相比顺序微调 FID 和 ConchFID 分别降低 11.1 和 60.9,说明其主要收益来自跨域结构关系蒸馏带来的稳定性。

When Simpler Is Better: Evaluating Translation Pipelines for Medieval Latin Manuscripts Figure 1
2026-07-07cs.CV

When Simpler Is Better: Evaluating Translation Pipelines for Medieval Latin Manuscripts

Nguyen Kim Hai Bui, Md. Easin Arafat, Tamás Gábor Orosz, Mufti Mahmud

Eötvös Loránd University, King Fahd University of Petroleum and Minerals

2026-07-07视觉感知

针对中世纪拉丁手稿中缩写、连字和纸张退化导致通用 VLM 难以直接识别与翻译的问题,论文构建从图像到译文的评测框架,并发布含 1383 条图像、转写和专家译文的 IPC 数据集。核心洞察是领域专用 OCR 的古文字先验比模型规模更关键:小型 TrOCR 类模型 CER 可比大型通用 OCR/VLM 低最高 4.3 倍;同时,最简单的专用 OCR 接 VLM 管线反而优于加入 RAG 或纠错的复杂方案,后者受提示饱和和错误传播影响。

How Do Diffusion Classifiers Decide? A Bias-Centric Evaluation Figure 1
2026-07-07cs.CV

How Do Diffusion Classifiers Decide? A Bias-Centric Evaluation

Saba Fathi, Fardin Ayar, Maryam Abdolali, Ehsan Javanmardi, Manabu Tsukada, Mahdi Javanmardi

K. N. Toosi University of Technology, Tehran, Iran, Amirkabir University of Technology, Tehran, Iran, The University of Tokyo, Tokyo, Japan

2026-07-07生成模型数据集/基准

本文关注扩散模型被用作零样本分类器后,其决策依据仍不透明的问题。作者提出 ASOB-Bench,从属性绑定、尺寸/词序偏置和背景依赖三类机制性探针评估重建误差打分,并结合误差热图与 U-Net 交叉注意力定位原因。结果显示,扩散分类器比 OpenCLIP 更少属性错绑,但更容易受大物体、提示词顺序和背景捷径影响,说明其偏置结构与传统视觉语言模型明显不同。

Q-TriM: Question-Guided Tri-Modal Attention for Audio-Visual Question Answering Figure 1
2026-07-07cs.CV

Q-TriM: Question-Guided Tri-Modal Attention for Audio-Visual Question Answering

SungHun Kim, SeungJun Baek

Korea University

2026-07-07视觉感知

针对音视频问答中深层串行跨模态注意力可能逐层丢失细粒度线索、累积融合误差的问题,Q-TriM将文本、视频、音频的交互改为浅层并行融合:在问题条件下构造音视频联合分布,推导出Query、Key、Value可来自不同模态的Tri-Modal Attention,并配合问题引导的token过滤与模态混合。实验称其在三个AVQA基准达到SOTA,尤其在MUSIC-AVQA-R上有明显提升,显示较强鲁棒性。

FDR-Occ: Factorized Dense Routing for Full-Spectrum 3D Occupancy Prediction Figure 1
2026-07-07cs.CV

FDR-Occ: Factorized Dense Routing for Full-Spectrum 3D Occupancy Prediction

Dubing Chen, Huan Zheng, Tianyi Yan, Yucheng Zhou, Runzhou Tao, Zhongying Qiu, Jianfei Yang, Jianbing Shen

2026-07-07三维

本文针对视觉三维占据预测中传统相机射线投影感受野局部、依赖精确外参的问题,将2D到3D视角变换重新表述为全局稠密路由,并用分解式张量收缩实现可计算的全局混合;同时以FDR负责宏观拓扑、LSS保留局部几何精度,缓解分辨率与上下文冲突。在Occ3D-nuScenes和Occ3D-Waymo上取得SOTA,并在无外参设定下表现出更强结构鲁棒性。

TRISTAR: Triple-Signal Stair Recognition and Vision-Only Indoor Navigation for Search-and-Rescue Micro-UAVs Figure 1
2026-07-07cs.CV

TRISTAR: Triple-Signal Stair Recognition and Vision-Only Indoor Navigation for Search-and-Rescue Micro-UAVs

Octavian Gîngu, Stelian Spînu

International Student Conference, Military Technical Academy, Bucharest, Romania.

2026-07-07机器人视觉感知

面向GNSS缺失、昂贵测距硬件不易部署的室内搜救场景,论文把低成本DJI Tello的单目视频尽量转化为导航信号:用Depth Anything V2做深度校准,结合几何开门检测、OCR和目标/危险识别,并提出TRISTAR融合Sobel结构、Gabor纹理和单目深度识别楼梯。真实楼内飞行显示,深度相对误差由27.4%降至10%以内,门检测F1达0.91,融合式楼梯识别较单一信号更稳,但低光、反光和玻璃仍是主要限制。

Global Logic and Local Search: Dual-Stream Multimodal In-Context Learning for Verifiable Industrial Anomaly Detection Figure 1
2026-07-07cs.CV

Global Logic and Local Search: Dual-Stream Multimodal In-Context Learning for Verifiable Industrial Anomaly Detection

Runzhi Deng, Yundi Hu, Yiming Zhong, Zhao Wang, Xixi Liu, Hongsong Wang, Caifeng Shan, Fang Zhao

2026-07-07视觉语言视觉感知

面向冷启动工业质检中缺陷样本少、细小异常难看清且文本规范难落到像素证据的问题,论文提出无需训练的 GLLS:用 PVLA 组织规格与正常参考,并将 SAM 3 支撑的全局逻辑检查与 MCTS 预算化局部搜索结合,使大模型按可追溯证据审计图像。实验称其在 MMAD-QA 及 MPDD、DTD、DAGM 等数据集上优于匹配和通用基线,主要结果强调性能提升与诊断链可验证性。

TestMate: Test-Time Domain Adaptation Aided by Lightweight Vision Foundation Model Figure 1
2026-07-07cs.CV

TestMate: Test-Time Domain Adaptation Aided by Lightweight Vision Foundation Model

Dimitrios Fotiou, Vasileios Mygdalis, Ioannis Pitas

Aristotle University of Thessaloniki

2026-07-07视觉感知

针对语义分割在测试时域适应中需实时处理无标签流数据、且现有熵最小化易遗忘、记忆库收敛慢的问题,TestMate用轻量级视觉基础模型生成多尺度掩码,并以无需反传和参数的尺寸排序竞争融合来细化小目标与边界。文中称其可首帧生效,并在两个基准的TTDA、SFDA和online-TTDA设置下达到或提升SOTA表现。

CineMobile: On-Device Image-to-Video Diffusion for Cinematic Camera Motion Generation Figure 1
2026-07-07cs.CV

CineMobile: On-Device Image-to-Video Diffusion for Cinematic Camera Motion Generation

Xuyao Huang, Zelai Deng, Xu Wang, Xizhong Xiao, Zhijie Deng

Shanghai Jiao Tong University, Nankai University

2026-07-07视觉感知生成模型

CineMobile针对手机端图生视频中DiT模型过大、去噪步数多而难以生成电影化运镜的问题,选择将任务收窄到子弹时间、滑动变焦和慢动作等结构化运动。其核心是对Wan系I2V DiT做蒸馏引导的结构化剪枝、4步扩散蒸馏结合GRPO强化学习细化,并用FFN 4-bit/其余8-bit混合量化压到1GB内。实验显示其相对Wan2.1教师模型约40倍加速,49帧480p在H200上单步0.6秒、天玑8400平台单步约20秒,VBench与人工评价保持接近教师的视觉质量和一致性。

Foundations of Equivariant Deep Learning: Unifying Graph and Sheaf Neural Networks Figure 1
2026-07-07cs.LG

Foundations of Equivariant Deep Learning: Unifying Graph and Sheaf Neural Networks

Yoshihiro Maruyama

2026-07-07视觉感知

论文针对图、单纯复形、胞腔复形等数据中仅靠群或置换等变性难以表达层级关联的问题,提出以偏序集/面偏序上的等变向量丛来统一图消息传递与sheaf神经网络的OENN框架。核心创新是刻画所有线性序等变映射,并构造保持稳定子作用的非线性层与成对轨道聚合。主要结果包括证明连续序等变映射的通用逼近定理,并指出普通匿名消息传递一般不具备普适性,sheaf网络情形下的UAT也是新增理论结果。

Probabilistic Robustness in Medical Image Classification Figure 1
2026-07-07cs.CV

Probabilistic Robustness in Medical Image Classification

Yi Zhang, Siddartha Khastgir, Xingyu Zhao

2026-07-07视觉感知安全鲁棒

面向医疗影像分类在临床安全场景中受自然扰动影响而可能误诊的问题,论文将鲁棒性评估从最坏情况对抗样本转向概率鲁棒性,构建了适配医学图像的自然腐蚀测试,并在 MedMNIST v2/PathMNIST 上评估 ResNet-18/50。结果显示两者虽有较高干净 ACC/AUC,但在亮度、散焦和运动模糊下 PR 明显下降,且更高干净性能不必然带来更强鲁棒性。

InfraNet: Quality-Aware RGB Guidance for Efficient Infrared Object Detection Figure 1
2026-07-07cs.CV

InfraNet: Quality-Aware RGB Guidance for Efficient Infrared Object Detection

Zichao Feng, Haodong Zhu, Jingying Yang, Sheng Xu, Yangyang Ren, Yuguang Yang, Xuhui Liu, Juan Zhang, Tian Wang, Linlin Yang, Baochang Zhang

2026-07-07视觉感知

InfraNet针对低光、恶劣天气下RGB模态易退化、传统RGB-IR融合反而把噪声注入红外特征的问题,提出以红外为主的质量感知框架:训练时用QualGate按任务相关可靠性调节RGB指导,抑制负迁移并补偿IR特征,同时支持IR-only或RGB-IR部署。其在LLVIP、FLIR-Aligned、M3FD和DroneVehicle上取得有竞争力或更优检测精度,尤其强调IR-only推理的效率与鲁棒性。

From Region Arrival to Instance-Level Grounding in Vision-and-Language Navigation Figure 1
2026-07-07cs.RO

From Region Arrival to Instance-Level Grounding in Vision-and-Language Navigation

Xiangyu Shi, Ruoxi Yang, Wei Tao, Jiwen Zhang, Yanyuan Qiao, Qi Wu

Australian Institute for Machine Learning, Adelaide University, Fudan University, Swiss Federal Institute of

2026-07-07机器人视觉语言视觉感知

本文指出现有VLN评测只要求到达目标3米范围,忽略朝向与目标可见性,导致“到区域”不等于能定位实例。作者提出Last-3-Meter Grounding Gap、ONS/GS/OracleGS指标,以及可插拔REALM模块和REVERIE-AIM短程数据集,用可见性感知停止细化最后接近阶段。在四类VLN骨干上,REALM显著提升实例邻近与最终视角可见性,如ETPNav-ZS的ONS@0.1m翻倍,实机实验也显示成功率提升。

G$^2$TAM: Geometry Grounded Track Anything Model Figure 1
2026-07-07cs.CV

G$^2$TAM: Geometry Grounded Track Anything Model

Chenming Zhu, Peizhou Cao, Jingli Lin, Wenbo Hu, Yunlong Ran, Jiangmiao Pang, Tai Wang, Xihui Liu

2026-07-07视觉感知

G²TAM针对现有视频分割依赖外观记忆、在大视角变化和长遮挡下易丢失身份的问题,提出把空间对齐的几何表征作为隐式记忆,并用跨模态空间编码器将点框或文本提示融入同一几何语义空间,实现重建与实例一致掩码联合预测。论文还构建InsTrack/PIST基准,报告实例空间跟踪达74.3 S-mIoU,显著高于SAM2的47.6,并提升跨视角一致性与视频目标分割表现。

Rethinking Depth Pruning for Vision Transformers: A Heterogeneity-Aware Perspective Figure 1
2026-07-07cs.CV

Rethinking Depth Pruning for Vision Transformers: A Heterogeneity-Aware Perspective

Zhenfeng Su, Kang Zhao, Han Bao, Tao Yuan, Zhongzhe Hu, Xianzhi Yu, Wenxuan Wang

2026-07-07视觉感知

针对ViT深度剪枝虽更易带来真实加速却常导致精度难恢复的问题,论文指出瓶颈不只是剪枝粒度粗,而是忽视注意力层、激活层等异构层的梯度尺度差异与恢复不对称;提出HetDPT,通过剪除FFN中的激活函数以避免维度不匹配,并用两阶段预算分配和重要性估计处理异构性。在ImageNet、CIFAR、COCO、ADE20K上,HetDPT在DeiT-B上约1.58倍加速且保持精度,结合宽度剪枝的HetDPT+将极端压缩加速从4.24倍提升到5.19倍且近乎无损。

City-Level 3D Surface Reconstruction with Viewpoint Orientation Partitioning and Scene Completion Figure 1
2026-07-07cs.CV

City-Level 3D Surface Reconstruction with Viewpoint Orientation Partitioning and Scene Completion

Liang Han, Wenyuan Zhang, Junsheng Zhou, Yu-Shen Liu, Zhizhong Han

2026-07-07三维

面向城市级多视角表面重建,论文针对3DGS在大场景中受空间分块边界、遮挡、显存与稀疏点云缺洞影响而几何不稳的问题,提出按相机朝向为主、位置为辅的视角分组,使重叠更高的视图共同优化深度,并用场景补全修复初始点云缺失区域。在GauU-Scene、MatrixCity和UrbanScene3D上,其表面重建质量优于现有大规模方法。

Self-Improving Diffusion Classifiers with Minority Preference Optimization Figure 1
2026-07-07cs.CV

Self-Improving Diffusion Classifiers with Minority Preference Optimization

Hyunsoo Kim, Jungmyung Wi, Soobin Um, Donghyun Kim, Suhyun Kim

2026-07-07生成模型优化算法

论文关注扩散分类器在零样本识别中偏向高密度多数样本、低密度少数概念识别较差的问题,提出 MiPO:仅用任意文本提示生成候选样本,以少数偏好奖励配合 LoRA 与 GRPO 微调扩散模型,扩大少数区域的生成覆盖并转化为感知能力提升。实验在 CIFAR10、CIFAR10-C、ImageNet-Tiny、Caltech、SUN09 等数据集上总体提升,最高约 3.8%,少数样本收益更明显。

GALOSH: Blind, Training-Free Denoising of Raw Bayer and sRGB Images by Parallel-Friendly Local Shrinkage Figure 1
2026-07-07eess.IV

GALOSH: Blind, Training-Free Denoising of Raw Bayer and sRGB Images by Parallel-Friendly Local Shrinkage

Yoshiro Sato

2026-07-07视觉感知

这篇论文针对 BM3D/NLM 依赖内容搜索、难并行且需噪声先验,以及深度去噪依赖训练域和 GPU 的问题,提出 GALOSH:用单图盲估计 Poisson-Gaussian 噪声、GAT 稳定方差、局部 Walsh-Hadamard 两阶段亮度收缩和亮度引导色度回归,完全去除搜索并统一处理 raw Bayer 与 sRGB。实验显示其在 SIDD、RawNIND 等真实噪声基准上优于测试的盲训练无关方法,甚至超过给定 oracle 噪声的经典基线;速度较深度基线快 7–650 倍,并可在 CPU 与 INT16 定点实现中实际运行。

Sparse-View Surface Reconstruction using Gaussian Splatting through High-Confidence Depth Propagation with Normal Priors Figure 1
2026-07-07cs.CV

Sparse-View Surface Reconstruction using Gaussian Splatting through High-Confidence Depth Propagation with Normal Priors

Liang Han, Bangcai Wei, Junsheng Zhou, Yu-Shen Liu, Zhizhong Han

2026-07-07三维

这篇论文针对稀疏视角下3DGS虽能高效渲染但几何线索不足、离散高斯易导致深度错误和表面破碎的问题,提出以多视图几何与光度一致性筛选高置信深度,再借助法线先验向低置信区域传播深度约束,并用异常深度边缘感知平滑抑制不连续。实验在DTU和Tanks-and-Temples上显示其稀疏视角表面重建优于现有方法。

Deep Learning-Based Characterization of Detonation-Cell Size Distributions in Soot-Foil Records Figure 1
2026-07-07eess.IV

Deep Learning-Based Characterization of Detonation-Cell Size Distributions in Soot-Foil Records

Mingyang Bu, Robson A. Schneider, Karl P. Chatelain, Mhedine Alicherif, Yingchen Shi, Andrés Z. Mendiburu, Deanna A. Lacoste, Bing Wang

School of Aerospace Engineering, Tsinghua University, Beijing 100084, China., Mechanical Engineering Department, Federal University of Rio Grande do Sul, Abdullah University of Science and Technology (KAUST), Thuwal, 23955-6900, Institute for Aero Engine, Tsinghua University, Beijing 100084, China.

2026-07-07视觉感知

针对爆轰烟熏箔细胞尺寸人工测量耗时且在噪声、边界模糊和重叠条件下易失准的问题,论文将 Mask R-CNN 实例分割与仿真/实验异构数据、迁移学习结合,用于单个细胞的像素级识别和高阶几何统计。结果显示平均尺寸与人工测量误差在规则工况低于 2%、不规则工况低于 3.5%,并可追踪传播方向上的尺寸演化及 RI、偏转角标准差等规律性指标。

GeoSAM-Lite: A Lightweight Foundation Model for Onboard Remote Sensing Segmentation Figure 1
2026-07-07cs.CV

GeoSAM-Lite: A Lightweight Foundation Model for Onboard Remote Sensing Segmentation

Yongcong Wang, Jie Zhang, Rui Jiang, Xubing Yang, Ting Yun, Li Zhang

2026-07-07视觉感知

这篇论文针对 SAM 等基础分割模型难以上星载、机载部署,以及自然图像到遥感图像存在域偏移的问题,提出 GeoSAM-Lite。其核心是先用遥感专家模型 RSAM-Seg 进行 Geo-Init 蒸馏和遮蔽特征对齐,再通过空间与频域特征融合层恢复轻量骨干丢失的边界细节。实验主要在云检测等遥感分割场景中验证,报告称相对 RSAM-Seg 参数减少 92.8%,同时保持有竞争力的精度。

Exploring SAM Supervision for Fine-Grained UAV Target Segmentation under Data Scarcity Figure 1
2026-07-07cs.CV

Exploring SAM Supervision for Fine-Grained UAV Target Segmentation under Data Scarcity

Le-Anh Tran

2026-07-07视觉感知

面向小目标、背景杂乱且像素标注稀缺的无人机目标分割,论文把 SAM3 用作离线伪标注源,而非直接部署大模型;核心做法是先用文本提示生成粗掩码,再裁剪候选区域二次分割以细化边界,并训练轻量 IPS-Seg。实验表明,两阶段伪标注能稳定提升低标注场景表现,IPS-Seg 在精度、参数量与计算量之间取得较好折中。

EmCom-Diffusion: Probing Visual Reflection in Emergent Languages via Image Generation Figure 1
2026-07-07cs.CV

EmCom-Diffusion: Probing Visual Reflection in Emergent Languages via Image Generation

Haruumi Omoto, Tadahiro Taniguchi

2026-07-07视觉感知生成模型

论文关注涌现语言是否真正保留视觉输入信息这一评估难题,指出现有概念、字幕、结构相关或任务成功率指标都只是代理。EmCom-Diffusion通过用涌现消息微调文本到图像扩散模型,再比较生成图与原图的感知相似度来直接衡量“视觉反映”。在MS-COCO指称游戏中,该方法能区分真实消息与随机/固定基线,并揭示CBM、翻译、TopSim和R@1会漏判或误判的视觉内容。

Triple-Phase Multimodal Knowledge Aggregation Framework for Microbial Keratitis Subtype Diagnosis on Slit-Lamp Photography Figure 1
2026-07-07q-bio.QM

Triple-Phase Multimodal Knowledge Aggregation Framework for Microbial Keratitis Subtype Diagnosis on Slit-Lamp Photography

Yiqing Wang, Maria A. Woodward, Ziyun Yang, N. Venkatesh Prajna, Chunming He, Leslie M. Niziol, Mercy Pawar, Ming-Chen Lu, Guillermo Amescua, Rachel Wozniak, Sejal Amin, Abinaya Krishnan, Prabhleen Kochar, Sina Farsiu

Department of Biomedical Engineering, Duke University, Durham, NC, USA., Kellogg Eye Center, Department of Ophthalmology and Visual Sciences, University of Michigan, Department of Cornea and Refractive Surgery Services, Aravind Eye Care System, Madurai, Bascom Palmer Eye Institute, Department of Ophthalmology, University of Miami Miller School, Flaum Eye Institute, Department of Ophthalmology, University of Rochester Medical Center, Department of Ophthalmology, Henry Ford Hospital, Detroit, MI, USA., Duke Eye Center, Duke University School of Medicine, Durham, NC, USA., framework on a multicenter dataset of 1,645 patients and 17,158 images from India and the United, code will be released and dataset access will be provided subject to University of Michigan data-, are unavailable. The inability to pinpoint the causative organism often leads to non-specific and, clinical applicability, as they are typically developed using data from a single medical center, and, center data for training18,23 may lead to overly optimistic performance estimates, as it can introduce

2026-07-07视觉语言

微生物性角膜炎亟需比培养/PCR更快的病原分型工具,以指导细菌或真菌感染用药。本文提出三阶段多模态框架:先用同一患者不同裂隙灯照明图像做跨模态对比学习,再分别微调蓝光、巩膜散射、白光模型,最后融合图像嵌入与临床元数据,并用分中心评估揭示 pooled 指标偏乐观。其在1645名患者、17158张图像上达到85.84%准确率、84.46%平均F1和0.885 AUC。

Attending to Multimodal Generation One Token at a Time Figure 1
2026-07-07cs.CV

Attending to Multimodal Generation One Token at a Time

Varun Gupta, Vineet Gandhi, Makarand Tapaswi

2026-07-07视觉语言

本文关注多模态大模型生成时“何时”调用视觉、文本、指令与已生成内容这一较少被解释的问题。作者提出 OTaT,按输出 token 追踪并干预注意力流,发现视觉答案处图像注意力峰值、任务切换时回看指令、后续生成更依赖历史输出;阻断验证其因果作用,定向增强相关模态注意力可提升多模态任务表现。

ProxyUp: Training-Free Proxy-Conditioned Video Generation for Controllable Dynamics Figure 1
2026-07-07cs.CV

ProxyUp: Training-Free Proxy-Conditioned Video Generation for Controllable Dynamics

Zanwei Zhou, Jiazhong Cen, Jiemin Fang, Yumeng He, Chen Yang, Sikuang Li, Fanpeng Meng, Zhikuan Bao, Wei Shen, Qi Tian

Shanghai Jiao Tong University, Huawei Inc.

2026-07-07视觉感知规划控制

论文针对文本提示难以精确约束复杂运动和交互的问题,提出“代理视频”作为动态载体:用仿真或真实粗视频提供运动线索,文本负责外观与场景生成。ProxyUp无需训练,通过ODE反演、区域潜变量加噪和随机流松弛,在保留关键运动的同时缓解潜空间拼接带来的分布错配与前景背景耦合不足。实验显示其在仿真和真实代理上,相比视频编辑与运动迁移基线提升了动态一致性和文本对齐。

Leveraging Pathology Co-occurrence for Test-Time Adaptation in Chest X-Ray Diagnosis Figure 1
2026-07-07cs.CV

Leveraging Pathology Co-occurrence for Test-Time Adaptation in Chest X-Ray Diagnosis

Woojin Jeong, Yujin Choi, Dongbin Kim, Soyeon Park, Jaewook Lee

2026-07-07视觉感知

这篇论文针对胸片模型跨医院部署时因设备、协议和人群差异导致性能下降的问题,指出常规测试时自适应忽略多标签疾病共现关系,可能放大不可靠预测。作者提出 CoWA,从目标域预测中在线估计病灶共现矩阵,并用结构一致性为样本加权做熵最小化。实验在 MIMIC-CXR、CheXpert、VinDr-CXR、NIH 等跨域设置中显示,CoWA 相比 AdaBN、TENT、EATA、RoTTA 等基线总体更稳,尤其减少低患病率类别的严重退化。

IPDiff: Diffusion-driven ORSI Salient Object Detection with Information Reconstruction and Multi-Prior Guidance Figure 1
2026-07-07cs.CV

IPDiff: Diffusion-driven ORSI Salient Object Detection with Information Reconstruction and Multi-Prior Guidance

Gongyang Li, Zhen Bai, Runmin Cong, Dan Zeng, Weisi Lin, Xiao-Ping Zhang

2026-07-07视觉感知生成模型三维

针对光学遥感显著目标检测中一次性静态推理难以修正错误掩码的问题,IPDiff将任务改写为条件扩散生成:先用信息重构注意力提取位置、细节与语义多重先验,再在去噪网络中随时间步迭代优化显著图,并以空域/谱域混合损失训练。作者在ORSSD、EORSSD和ORSI-4199上对比46种方法取得最佳结果,但计算开销与增益中各先验贡献仍需结合消融判断。

Phase-Preserving Trimodal Transformer for Tropical Forest Biomass Estimation Using Optical and PolInSAR Data Figure 1
2026-07-07cs.LG

Phase-Preserving Trimodal Transformer for Tropical Forest Biomass Estimation Using Optical and PolInSAR Data

Luiz Felipe Parente Santiago (1 and 2), Rosiane Rodrigues de Freitas (1), Daniel Rodrigues dos Santos (3), Felipe Ferrari (3) ((1) Institute of Computing (IComp), Federal University of Amazonas (UFAM), Manaus, Brazil, (2) Brazilian Army Research Institute in the Amazon (IPEAM), (3) Military Institute of Engineering (IME), Rio de Janeiro, Brazil)

Institute of Computing (IComp), Federal University of Amazonas (UFAM), Manaus, Brazil, Brazilian Army Research Institute in the Amazon (IPEAM), Manaus, Brazil, Military Institute of Engineering (IME), Rio de Janeiro, Brazil

2026-07-07视觉感知

针对热带成熟森林中光学影像受云遮挡、SAR 在高生物量区信号饱和导致地上生物量估计不准的问题,论文提出 TCCT,将 Landsat-5 与 P/L 波段复值 PolInSAR 融合,用复值编码保留相位相干性,并以协同注意力按像素调节传感器权重。实验中经交叉验证和局部微调,CHM RMSE 达 3.78 m,密林 AGB rRMSE 为 4.51%,优于 RF、CNN 和 ViT 基线。

From Geometric Labels to Semantic Understanding of Indoor Building Components Using Multimodal Large Language Models Figure 1
2026-07-07cs.CV

From Geometric Labels to Semantic Understanding of Indoor Building Components Using Multimodal Large Language Models

Shuju Jing, Chao Yin

From Geometric Labels to Semantic Understanding of Indoor Building, aSchool of Qilu Transportation, Shandong University, Jinan, 250002, China, bGuangzhou Institute of Geography, Guangdong Academy of Sciences, 100 Xianlie Middle, crete labels without explaining component functions or natural language interactions. This paper, proposes Building-MLLM, a point cloud-centered multimodal large language model (MLLM) for, whose outputs are usually limited to discrete class labels and therefore cannot provide engineers, alizing this capability would facilitate language-centered human–computer interaction, knowledge, indoor building component point clouds, and to promote a transition from geometry-based labels

2026-07-07视觉语言

面向设施运维中点云模型只能给出离散类别、难以支持工程问答的问题,论文提出 Building-MLLM,将室内建筑构件点云与指令式语言建模结合,并通过点信息增强、几何保持正则、固定领域前缀和多维 LoRA 缓解专业域语义集中与几何退化;同时构建含 4198 个对象、37782 条指令的合成数据集。实验在识别、描述和工程 QA 上分别达到 88.00%、65.10%、68.14%,显示其可从几何标签推进到语言化构件理解。

ViPo-MLLM: Visual-Pose Multimodal LLM for Gloss-Free Sign Language Translation Figure 1
2026-07-07cs.CV

ViPo-MLLM: Visual-Pose Multimodal LLM for Gloss-Free Sign Language Translation

Ahmed Abul Hasanaath, Bicheng Xu, Mir Rayat Imtiaz Hossain, Leonid Sigal, Hamzah Luqman

2026-07-07视觉语言三维

这篇论文针对无 gloss 手语翻译中标注昂贵、仅用 RGB 或弱融合难以捕捉手部/身体/面部细粒度线索的问题,提出 ViPo-MLLM:用 USTM 提取时空视觉特征、OpenPose 提取姿态特征,并通过模态内时序建模与跨模态注意力融合后接入 LLM。实验在 PHOENIX14T 和 CSL-Daily 上报告达到新的 SOTA,并接近部分 gloss-based 方法,说明姿态线索和显式跨模态时序交互是主要增益来源。

ClinOCR-Bench: A Comprehensive Clinical Scanned Document Dataset for Optical Character Recognition Model Evaluation Figure 1
2026-07-07cs.CV

ClinOCR-Bench: A Comprehensive Clinical Scanned Document Dataset for Optical Character Recognition Model Evaluation

Enshuo Hsu, Jin Zhou, Kirk Roberts

McWilliams School of Biomedical Informatics, University of Texas Health Science Center, Enterprise Development & Integration, University of Texas MD Anderson Cancer Center, laboratory reports and manually filled forms, there are few publicly available datasets for, we release a publicly available, realistic-, The dataset and documentation are available, to 2018, a single clinical department, single type of laboratory test 3. The high-, laboratory reports, 3) manually filled forms, laboratory reports 3,8. OCR engines often fail, external lab or pathology reports 2. OCR

2026-07-07视觉感知数据集/基准

临床 EHR 中大量扫描件因手写、表格、低质扫描和旋转等伪影难以被 OCR 稳定解析,而现有公开医疗 OCR 数据集多模板单一且缺少真实扫描挑战。ClinOCR-Bench 用合成但 PHI-free 的方式构建 384 张、6 类伪影、12 类文档和 16 个模板的基准,并设计模板感知 one-shot 划分;测试集 328 张可给出较窄 WER 置信区间,支持开源与专有 VLM/OCR 系统评测,但具体模型增益文中未充分说明。

Do Medical Vision Language Models Actually See? A Counterfactual Grounding Framework and Hard-Negative Contrastive Training for Visually-Reliant Medical VLMs Figure 1
2026-07-07cs.CV

Do Medical Vision Language Models Actually See? A Counterfactual Grounding Framework and Hard-Negative Contrastive Training for Visually-Reliant Medical VLMs

Anas Zafar, Leema Krishna Murali, Siddhant Bharadwaj, Ashish Vashist, Jia Wu

The University of Texas MD Anderson Cancer Center, Eisai Inc., Cohere Labs Community

2026-07-07视觉语言视觉感知

这篇论文针对医学视觉语言模型“高准确率但未必看图”的风险,提出用空白、打乱、无图和 CLIP 硬负样本替换图像的反事实评估,并设计 VRS、VHR 等指标量化视觉依赖。进一步用 CGO 训练 CORAL,惩罚硬负图像下答案不变。结果显示医学任务中换图仅造成很小性能下降,暴露强文本捷径;CORAL 相比 Qwen2.5-VL-7B 准确率提升 6.7pp、VHR 降低 8.0pp,但训练/评测重叠等限制仍需注意。

Moonstone: A Multimodal Foundation Model and Benchmark for Lunar Remote Sensing Figure 1
2026-07-07cs.CV

Moonstone: A Multimodal Foundation Model and Benchmark for Lunar Remote Sensing

Ayush Prasad, Swarnalee Mazumder

2026-07-07视觉语言数据集/基准

Moonstone针对月球遥感数据分散、模态覆盖不均且缺少统一评测的问题,构建28通道全球预训练数据与六项下游基准,并提出按物理模态分组的MG-MAE,通过缺失模态注意力掩码、覆盖自适应遮蔽和光谱连续性约束处理月球数据的稀疏异质性。实验显示其在地质分类、成分回归、撞击坑分割等任务上均优于从零训练、ImageNet和地球观测预训练基线,最大提升达地质分类+16.2%和撞击坑mIoU+14.7。

Model Confidence-Guided Multi-Image Fusion of Fundus Images for Diabetic Retinopathy Diagnosis Figure 1
2026-07-07eess.IV

Model Confidence-Guided Multi-Image Fusion of Fundus Images for Diabetic Retinopathy Diagnosis

Ananya Raghu, Anisha Raghu, Alice S. Tang, Yannis M. Paulus, Tyson N. Kim, Tomiko T. Oskotsky

Massachusetts Institute of Technology, Cambridge, MA, USA, Wilmer Eye Institute, Department of Ophthalmology, Johns Hopkins University, Baltimore, MD, Department of Biomedical Engineering, Johns Hopkins University, Baltimore, MD, USA, Bakar Computational Health Sciences Institute, University of California San Francisco, San, Department of Ophthalmology, University of California San Francisco, San Francisco, CA, USA, Division of Clinical Informatics and Digital Transformation, University of California San

2026-07-07视觉感知

面向低资源场景中的糖尿病视网膜病变早筛,论文指出人工图像质量标签与诊断可靠性关联较弱,提出用模型置信度替代显式质控,并融合多张眼底图像形成患者级预测、低置信时提示重拍。在 mBRSET 和 BRSET 上,70% 覆盖率下平衡准确率达 91% 和 97%,较质量级联约提升 12% 和 6%;50% 覆盖率下敏感性也升至 94% 和 96%。

Probing Identity-Specific Motion Signatures: A Controlled Diagnostic Study Figure 1
2026-07-07cs.CV

Probing Identity-Specific Motion Signatures: A Controlled Diagnostic Study

Yingtie Lei, Fangxun Liu, Baicheng Wu, Colin Lee, Ziheng Zhang, Junke Yang, Zhiyuan Tao, Xuyan Huang, Shuheng Wang, William Koran, Kyle Park, Elijah H Buckwalter, Cheng-Hsuan Chiang, Tejas Naik, Daniel Yi, Wei-Lun Chao

The Ohio State University, Boston University, tion cues are available., mation available to silhouettes and skeletons, this contrast

2026-07-07规划控制

本文关注身份识别中视频模型究竟依赖外观还是个体运动模式这一诊断问题,构建 BALLER120 自由投篮基准,用同一多阶段动作和轮廓/骨架输入压制球衣、脸部等静态捷径。结果显示,RGB 模型虽准确但易看外观,外观被抑制后仍有竞争性识别率,并更能关注脚步、肘部等稳定微运动,对外观变化更鲁棒。

RADIO1D: Elastic Representations for Condensed Vision Modeling Figure 1
2026-07-07cs.CV

RADIO1D: Elastic Representations for Condensed Vision Modeling

Greg Heinrich, Mike Ranzinger, Collin McCarthy, Natan Bagrov, Eugene Khvedchenya, Bryan Catanzaro, Jan Kautz, Andrew Tao, Pavlo Molchanov

2026-07-07视觉感知

论文针对 VLM 视觉编码器通常依赖固定二维 patch token、计算开销高且未必保留空间结构的问题,指出微调会使特征更抽象、空间一致性下降,而少数全局 token 已能承担图像摘要功能。RADIO1D 以多教师蒸馏和训练期自编码器将图像压缩为可变长度一维 token,并让早期 token 优先承载全局语义。实验显示其在低 token 数下仍能保持场景理解和组合检索能力,接入 Nemotron VL 后在多模态基准上以更低开销取得有竞争力甚至更好的精度,但 OCR 等细粒度任务仍需要较高 token 预算。

A Vision Based System for Guided and Collaborative Reconstruction of Fragmented Documents Figure 1
2026-07-07cs.CV

A Vision Based System for Guided and Collaborative Reconstruction of Fragmented Documents

Oliver Krumpek, Diana Leo

2026-07-07视觉感知三维

面向文化遗产中破损纸质文档的高重复、低损伤重建需求,论文构建了相机感知、投影引导与协作机器人结合的辅助系统,并设计可手持或装在机器人末端的真空吸附工具。系统支持人工按视觉提示摆放或由机器人自动定位;实验比较 SIFT、SuperPoint+SuperGlue 与 SE2-LoFTR,显示后者在旋转、尺度和损伤条件下更稳健,吸附件对 8cm² 碎片达到 0.57mm 重复定位精度。

IDEAL-Bench: Indoor Dataset and Evaluation suite for Analyzing 3D Layout reasoning Figure 1
2026-07-07cs.CV

IDEAL-Bench: Indoor Dataset and Evaluation suite for Analyzing 3D Layout reasoning

Yuening Cai, Junwei Zhou, Youran Qu, Yu-Wing Tai

Department of Computer Science, Dartmouth College

2026-07-07数据集/基准三维

本文针对现有VLM空间评测多依赖问答、难以检验全局一致3D布局的问题,提出IDEAL-Bench与IDEAL-Scenes:让模型从单张室内图像预测所有可见物体的类别、位置、尺度和朝向,并结合数值指标与重渲染感知比较评估。对15个VLM的结果显示任务仍远未解决,最佳仅62.1/100,模型普遍能识别物体但几何回归薄弱,说明当前能力更偏“描述场景”而非精确测量空间。

SAF3R: Dynamic Sparse Attention for Feed-Forward 3D Reconstruction Transformers Figure 1
2026-07-07cs.CV

SAF3R: Dynamic Sparse Attention for Feed-Forward 3D Reconstruction Transformers

Jianing Deng, Yuanzhe Li, Jialu Wang, Song Wang, Tianlong Chen, Huanrui Yang, Jingtong Hu

2026-07-07三维

SAF3R针对前馈式三维重建 Transformer 在长序列中跨视角全局注意力计算呈二次增长、限制实时部署的问题,指出不同层和注意力头的全局注意力高度异质、动态且稀疏。其核心是训练无关的动态稀疏注意力框架,通过离线逐头画像选择稀疏模式,并在推理时用轻量近似与索引缓存自适应更新 Top-K 等模式。实验显示其在保持相机位姿估计和点云重建质量的同时,在长序列上最高实现约 7 倍端到端加速。

A Step Towards Robust Unsupervised Domain Adaptation via Fine-Tuning and Reinforcement Learning Figure 1
2026-07-07cs.CV

A Step Towards Robust Unsupervised Domain Adaptation via Fine-Tuning and Reinforcement Learning

Sushant Dagaji Desale, Rahul Mishra, Ashutosh Kumar Sinha

Indian Institute of Technology Patna

2026-07-07强化学习安全鲁棒

针对CLIP等视觉语言模型在无监督域适应中易受PGD扰动、伪标签噪声会放大跨域错配的问题,论文提出SFT+RL:先在有标注源域做对抗微调并仅部分解冻投影层,再用递减置信阈值筛选目标域伪标签,形成跨模态课程式自训练。OfficeHome、PACS、VisDA上报告平均干净准确率提升10.2%、鲁棒性提升15.8%,但“RL”相对普通自训练的独立增益来源仍不够清晰。

Token-Based Affordance Grounding with Large Vision-Language Models Figure 1
2026-07-07cs.CV

Token-Based Affordance Grounding with Large Vision-Language Models

Seung Il Lee, Qinqian Lei, Daguang Xu, Dong Yang, Robby T. Tan, Yixin Chen, Bo Wang

2026-07-07视觉语言视觉感知

这篇论文针对弱监督可供性定位在多动作共现、相似动作区分上易混淆的问题,提出 TokAG:不训练新模型,而是从大视觉语言模型输出 token 的跨注意力中筛选最聚焦目标物体的 token,并聚合层/头得到动作相关热图。实验显示其零样本方法在 AGD20K unseen 上 NSS 提升 10.7%,在 HICO-IIF 上提升 29.7%,但失败分析表明主要瓶颈仍是 token 选择。

An Interpretable Deep Learning Framework for Discovery and Clinical Validation of Deep Radiomic Signatures in Tumor Classification Figure 1
2026-07-07eess.IV

An Interpretable Deep Learning Framework for Discovery and Clinical Validation of Deep Radiomic Signatures in Tumor Classification

Chengkun Sun, Jinqian Pan, Renjie Liang, Zhengkang Fan, Xin Miao, Yi Guo, Mei Liu, Muxuan Liang, Russell Terry, Jie Xu

* Department of Health Outcomes and Biomedical Informatics, University of, Department of Biostatistics, MD Anderson Cancer Center, Houston, 77030, Department of Urology, University of Florida, Gainesville, 32611, FL, USA, scalable clinical decision-support systems [13]. Traditionally, tumor characterization has

2026-07-07视觉感知

针对深度学习肿瘤影像分类虽准确但缺乏可解释生物标志物的问题,本文把分割、Grad-CAM 注意区域、互信息自适应阈值和放射组学/SHAP 串成统一流程,将模型关注的局部肿瘤区域转化为可量化深度放射组学签名。作者在乳腺超声、肾脏 CT、脑肿瘤及私有肾 CT 队列上验证,报告其相较全肿瘤放射组学有更好区分性能和解释性,但具体增益来源仍需更多消融支撑。

Responsibility Distribution Estimation in Ego-View Accident Videos with Multimodal Large Language Models Figure 1
2026-07-07cs.CV

Responsibility Distribution Estimation in Ego-View Accident Videos with Multimodal Large Language Models

Ryosei Tamura, Andrew Shin

Keio University

2026-07-07视觉语言视觉感知

针对现有事故理解多依赖路侧/卫星视角、难以刻画驾驶员实际可见信息的问题,本文把行车记录仪事故视频建模为多主体责任比例估计任务,并用 LLM 辅助生成责任分布标签,比较原始帧、分割增强与文本输入下的多模态大模型微调。实验给出该任务首个基准,显示 MLLM 能完成受约束的责任分配推理,但标签并非法定真值,可靠性仍取决于自动标注质量。

Vision Non-Causal Trapezoidal Mamba: Eliminating Directional Scanning in Vision SSMs with Second-Order Dynamics Figure 1
2026-07-07cs.CV

Vision Non-Causal Trapezoidal Mamba: Eliminating Directional Scanning in Vision SSMs with Second-Order Dynamics

Anvitha Ramachandran, Dhruv Parikh, Haoyang Fan, Rajgopal Kannan, Viktor Prasanna

University of Southern California

2026-07-07视觉感知

这篇论文针对视觉 SSM 将图像强行串行扫描带来的方向偏置、旋转/翻转敏感和多次扫描延迟问题,提出 VNCT:把 Mamba-3 的二阶指数-梯形动力学改写为非因果全局聚合,并用低秩 MIMO 同时建模空间与通道交互。实验显示其在 ImageNet、COCO、ADE20K 上优于扫描式 SSM 和一阶非因果 VSSD,单图延迟更低或相当,且 Boundary IoU 最高提升 3.7 点。

PLGSA-Transformer: Periocular Landmark-Guided Attention with Occlusion-Adaptive Cosine Thresholding for Cross-Modal Masked and Unmasked Face Recognition Figure 1
2026-07-07cs.CV

PLGSA-Transformer: Periocular Landmark-Guided Attention with Occlusion-Adaptive Cosine Thresholding for Cross-Modal Masked and Unmasked Face Recognition

Dana A Abdullah

Faculty of Engineering and Computer Science, Qaiwan International University, Sulaymaniyah, KRG, Iraq., Department of Information and Communication Technology Center (ICTC)-System Information, Ministry of Higher, regions are occluded, creating a fundamental gap between laboratory performance and real-, decision boundaries, yields a robust and scalable solution for cross-modal masked and

2026-07-07视觉感知

针对口罩遮挡使传统人脸识别阈值固定、下半脸特征缺失的问题,论文提出 PLGSA-Transformer:用 MediaPipe 眼周/眉额关键点热图引导 EfficientNetB3 注意力,再接入轻量 Transformer 建模全局关系,并按预测遮挡程度自适应调整余弦阈值。在858张混合来源图像上报告97.22%验证准确率和1.0000 AUC,但数据规模较小,泛化增益来源仍需更充分说明。

When Geometry Aligns: Dihedral Hidden-State Transformations in UNet, ViT, and DiT Architectures Figure 1
2026-07-07cs.LG

When Geometry Aligns: Dihedral Hidden-State Transformations in UNet, ViT, and DiT Architectures

Mojtaba Faramarzi, Alex Lamb, Irina Rish

University of Montreal, Canada, Mila - Quebec AI Institute, Tsinghua University

2026-07-07视觉感知

这篇论文关注扩散与视觉模型中间表征被几何扰动后为何有时稳定、有时失配的问题。作者把水平、垂直和对角翻转作为隐藏状态干预,提出“几何一致性”原则,并用 SCS、AMS、Drift 等诊断 UNet、ViT、DiT。结果显示,在 Stable Diffusion 2.1 U-Net 等实验中,一致干预可提升特征稳定性并大体保持图像质量,不一致干预会产生可预测的架构相关漂移。

Motion Estimation Techniques for Volumetric Video Attribute Compression Figure 1
2026-07-07eess.IV

Motion Estimation Techniques for Volumetric Video Attribute Compression

Haoran Hong, Eduardo Pavez, Antonio Ortega, Ryosuke Watanabe, Keisuke Nonaka

Haoran Hong, Eduardo Pavez and Antonio Ortega are with the University of Southern California, 3740 McClintock Ave.

2026-07-07视觉感知

这篇论文针对动态实体点云中颜色等属性的时间冗余难以被G-PCC充分利用的问题,提出体素域属性帧间编码:用颜色与几何联合匹配的图正则整数运动估计保持块间运动平滑,再用无需显式插值的分数体素估计提升精度。实验在MPEG点云数据上显示,损失几何条件下相对G-PCC、GeS-TM和V-PCC平均节码约55.3%、42.3%和16.5%。

EPRA U-Net: An Efficient Pyramid Residual Attention Framework for Accurate Infarct Segmentation in Diffusion-Weighted MRI Figure 1
2026-07-07cs.CV

EPRA U-Net: An Efficient Pyramid Residual Attention Framework for Accurate Infarct Segmentation in Diffusion-Weighted MRI

Hasan Ulutas, Muhammet Emin Sahin, Mustafa Fatih Erkoc, Esra Yuce, Turker Tuncer, Sengul Dogan, Serkan Kiranyaz

Yozgat Bozok University, Department of Computer Engineering, Yozgat, Turkey, Izmir Bakircay University, Department of Computer Engineering, Izmir, Turkey, Queen Mary’s Digital Environment Research Institute (DERI), London, UK, Yozgat Bozok University, Department of Radiology, Faculty of Medicine, Yozgat, Turkey, Firat University, Department of Digital Forensics Engineering, Technology Faculty, Elazig, Turkey, Qatar University, Department of Electrical Engineering, Doha, Qatar, state-of-the-art models, specifically UNet++, DeepLabV3+, and TransUNet. The experimental results suggest that, when compared with UNet++, DeepLabV3+, and TransUNet, respectively. Additionally, a comprehensive, DeepLabv3+, Atrous Spatial Pyramid Pooling (ASPP) provided receptive field extension using dilated

2026-07-07视觉感知生成模型

针对 DWI 脑梗死灶人工勾画耗时且小病灶易漏检的问题,论文提出 EPRA U-Net,将 EfficientNet 编码器、R2 模块、ASPP 多尺度上下文和双注意力结合,并用偏重召回的 Tversky loss 训练。在 167 名患者、4895 张切片上,相比 UNet++、DeepLabV3+、TransUNet 取得更高 Dice/IoU,漏检率分别降低 16%、25%、29%,但数据为院内集,泛化性仍需外部验证。

XPlainVerse: A Million-Scale Benchmark for Explainable Deepfake Detection Figure 1
2026-07-07cs.CV

XPlainVerse: A Million-Scale Benchmark for Explainable Deepfake Detection

Abhijeet Narang, Kartik Kuckreja, Shreya Ghosh, Muhammad Haris Khan, Jianfei Cai, Abhinav Dhall

Monash University, The University of Queensland, detection and human-centered explanation. XPlainVerse comprises one million real, support scalable research on trustworthy, interpretable models., in scale [6, 9–11] is that scaling reasoning annotation automatically introduces substantial label, User needs further compound the problem. Research in human-centered XAI shows that different

2026-07-07视觉感知数据集/基准

针对深伪检测中“能判别但解释不落地”的问题,XPlainVerse构建了百万级可解释基准:用12类生成/编辑模型产生伪造图像,并通过Edit-Check过滤编辑不匹配样本,同时提供面向专家与普通用户的双层解释和EntityScore、EvidenceScore评估。结果显示零样本模型表现较弱,微调后对未见生成器泛化仍有限,表面语义指标会掩盖视觉证据不充分的问题,改进可能主要来自scaling / data。

Latent Clarity: Bridging World-Model Kinematics to Semantic Manifolds for Video Anomaly Anticipation Figure 1
2026-07-07cs.CV

Latent Clarity: Bridging World-Model Kinematics to Semantic Manifolds for Video Anomaly Anticipation

Abu Anas Ibn Samad

2026-07-07视觉感知强化学习

针对视频异常检测常依赖MIL事后给出无语义分数的问题,论文提出PULS:用KSD Bridge将V-JEPA2运动潜变量蒸馏到Qwen语义球面,并用ASP利用“未来潜变量更清晰”的洞察做提前预测。实验称无需MIL在UCF-Crime达0.8994 AUROC、XD-Violence达0.8162,零样本VQA较观测基线提升9.6个百分点,提前0.5秒有8.9个百分点优势;但结果主要来自单篇预印本设定,独立复现仍待验证。

iVISION-2DCD: A Long-Term Change Detection Dataset for Large-Scale Outdoor Construction Monitoring Figure 1
2026-07-07cs.CV

iVISION-2DCD: A Long-Term Change Detection Dataset for Large-Scale Outdoor Construction Monitoring

Dayou Mao, Yuchen Lin, Ashkan Ebadi, John Zelek, Alexander Wong, Yuhao Chen

University of Waterloo, Waterloo, ON, Canada

2026-07-07视觉感知数据集/基准

面向大型户外工地长期进度监测,论文指出现有2D变化检测数据缺少长时序、多视角和真实施工复杂性。iVISION-2DCD利用无人机RGB/LiDAR采集的密集点云进行新视角合成,生成双时相对齐图像与半自动变化标注,覆盖一年、50余次采集和32.3K平方米场地。基准实验显示现有2DCD方法在该数据上仍面临明显挑战,主要贡献可能来自数据规模与场景复杂度。

Perceptual Flow Matching for Few-Step Generative Modeling Figure 1
2026-07-07cs.CV

Perceptual Flow Matching for Few-Step Generative Modeling

Chuyang Zhao, Yifei Song, Hongfa Wang, Jianlong Yuan, Yuan Zhang, Siming Fu, Zhineng Chen, Huilin Deng, Haoyang Huang, Nan Duan

Joy Future Academy, Fudan University, Tsinghua University

2026-07-07生成模型

针对流匹配生成模型推理需数十步、部署成本高的问题,论文提出 PFM:不再在 VAE 潜空间回归速度,而是在解码样本的预训练感知特征空间中监督流匹配。其核心洞察是感知空间会把高噪声下的均值化回归转向更接近数据流形的模式选择,从而适合粗步长积分。实验显示在图像生成、编辑和视频生成中可将采样降至 4–8 步,COCO 8 步结果达到 FID 33.93、CLIP 31.70,并较蒸馏方法减少伪影。

Mixture-of-Gaussians-Guided Schedule Design for Brownian Bridge Diffusion Models Figure 1
2026-07-07cs.LG

Mixture-of-Gaussians-Guided Schedule Design for Brownian Bridge Diffusion Models

Ron Levi, Michael Elad

Department of Computer Science

2026-07-07生成模型三维

本文针对 BBDM 在图像复原/线性逆问题中桥接 schedule 多依赖启发式、缺少可解释设计准则的问题,提出以高斯混合先验分析反向动力学,并用固定组件标签的 surrogate 得到可解析重建律。核心洞察是 schedule 本质上塑造后验协方差,MSE 与 Wasserstein 目标对应失真和感知质量且存在内在权衡;在 MoG 仿真与 FFHQ 修复、去模糊、超分任务中,所设计的通用 schedule 与理论趋势一致并带来可用的质量取舍。

Flex-Forcing: Towards a Unified Autoregressive and Bidirectional Video Diffusion Model Figure 1
2026-07-07cs.CV

Flex-Forcing: Towards a Unified Autoregressive and Bidirectional Video Diffusion Model

Xinyin Ma, Julius Berner, Chao Liu, Arash Vahdat, Weili Nie, Xinchao Wang

2026-07-07视觉感知生成模型

这篇论文针对视频生成中双向扩散质量高但慢、自回归高效但易漂移的问题,提出 Flex-Forcing,将因果与非因果生成视为可调推理维度。核心是沿时间帧与去噪步联合做 flexible chunking,并用表示对齐缓解不同噪声上下文差异,使单一模型可在双向、自回归和混合模式间切换。实验显示其在多项视频基准上相较刚性调度和 Self-Forcing 获得更好的质量—速度折中、长视频稳定性和更快推理。

Towards Standardized Light Field Quality Assessment: Hybrid Subjective Benchmarking and Objective Metric Evaluation Figure 1
2026-07-07cs.CV

Towards Standardized Light Field Quality Assessment: Hybrid Subjective Benchmarking and Objective Metric Evaluation

Saeed Mahmoudpour, Mylene C. Q. Farias, Gi-Mun Um, Myllena A. Prado, Ismael Seidel, Leonardo de Sousa Marques, Leonardo Andrade, Shengyang Zhao, Carla L Pagliari

2026-07-07数据集/基准

面向 JPEG Pleno 等标准化场景,论文针对光场压缩/重建质量评估缺少可复现主观基准与稳健客观指标的问题,构建包含编码、视图合成和重建失真的评测流程,并用“参考锚定评分+模糊区间成对比较”的混合主观方法细化标注。结果显示,现有指标在纯编码失真上相关性较好,但遇到视图合成类失真时明显退化,提示未来光场质量指标需更重视跨视图池化与角度一致性。

Learning to Generate Multiple Objects from Dense and Occluded Layouts Figure 1
2026-07-07cs.CV

Learning to Generate Multiple Objects from Dense and Occluded Layouts

Bach-Hoang Ngo, Si-Tri Ngo, Hieu Le, Trung-Nghia Le

University of Science, Ho Chi Minh City, Vietnam

2026-07-07视觉感知

本文关注文本到图像模型在密集、遮挡布局中常把多个实例融合、导致计数错误的问题,指出根因是重叠区域注意力串扰与遮挡实例监督不足。方法用布局感知注意力维护实例归属,并以AIBL按非模态/可见面积比重加权损失。作者构建OverlapDepth-45K评测,报告相对布局基线RMSE从9.26降至5.99,同时基本保持图像质量。

PhysMirror: Physics-Aware Mirror Object Generation Figure 1
2026-07-07cs.CV

PhysMirror: Physics-Aware Mirror Object Generation

Xuan-Bach Mai, Duy-Phuc Nguyen, Quoc-Van Le, Tam V. Nguyen, Thanh-Toan Do, Huu Le, Duong-Van Nguyen, Minh-Triet Tran, Trung-Nghia Le

2026-07-07视觉感知

PhysMirror瞄准扩散模型生成镜面场景时常出现缺反射、姿态错配等几何幻觉,影响机器人感知训练数据可靠性。其核心做法是先由文本生成3D物体并构建显式镜面场景,再渲染深度、分割等条件图约束T2I生成,同时提出无需参考标注的MCS评估投影一致性。在MirrOB基准上,方法相较FLUX.1-dev、SDXL等提升反射准确性和物理真实感,并保持较好的文本语义对齐。

WorldBagel: Uncovering the Power of Unified Multimodal Models for Vision-Language-Action-World Modeling Figure 1
2026-07-07cs.CV

WorldBagel: Uncovering the Power of Unified Multimodal Models for Vision-Language-Action-World Modeling

Zelin Zhao, Min Shi, Bo Yuan, Haotian Xue, Jialuo Li, Lama Moukheiber, Humphrey Shi, Yongxin Chen

2026-07-07视觉语言视觉感知强化学习

论文针对现有世界模型偏视觉动态、VLA模型偏动作预测而缺少统一建模的问题,提出基于BAGEL的WorldBagel,将视觉、语言、动作与未来帧生成放入共享自回归框架,并用傅里叶动作tokenizer/decoder和序列计划训练对齐连续控制。LIBERO、Language Table和Franka实验显示,其多任务操作表现优于任务专用基线,动作表征更结构化,在动作分布变化下预测更稳定,但具体增益中数据重加权与模型统一各自贡献仍需进一步拆分。

Handwriting Trajectory Recovery with Diffusion Models Figure 1
2026-07-07cs.CV

Handwriting Trajectory Recovery with Diffusion Models

Hiroki Nagamatsu, Shoji Toyota, Seiichi Uchida

2026-07-07生成模型规划控制

本文针对离线手写图像难以还原真实书写顺序的问题,将笔迹恢复建模为图像条件的一维轨迹扩散生成,并用多尺度条件逐步注入从全局字形到局部笔画的证据。实验在 CASIA-OLHWDB 上相较 PEN-Net、Cross-VAE 改善 DTW/LDTW 与 AIoU,且显示训练类别增多会提升未见汉字与部分拉丁字母的笔顺恢复,增益可能主要来自更大规模数据带来的书写规律学习。

Efficient bias mitigation in T2I diffusion models using Concept Graphs Figure 1
2026-07-07cs.AI

Efficient bias mitigation in T2I diffusion models using Concept Graphs

Mansi, Avinash Kori, Francesco Leofante

Department of Computing, Imperial College London

2026-07-07生成模型

本文针对文生图扩散模型中偏见被编码为文本编码器与去噪器之间结构性概念关联的问题,指出单独修正一侧会带来语义崩塌或残余偏见。核心创新是 CO-ALIGN:抽取并对齐两部分内部概念图,使弱代表属性与目标概念关系更均衡。实验称其较现有方法公平性提升 30%,FID 改善 11.4,语义不一致输出减少 88%,并提升概念遗忘的鲁棒性。

TemporalGS: Training-Free Plug-and-Play Acceleration for 3D Gaussian Splatting Rendering via Temporal Priors Figure 1
2026-07-07cs.CV

TemporalGS: Training-Free Plug-and-Play Acceleration for 3D Gaussian Splatting Rendering via Temporal Priors

Yuhongze Zhou, Zihao Yang, Xinxin Zuo, Juwei Lu

2026-07-07三维

TemporalGS针对3D Gaussian Splatting在大规模场景中高帧率、低延迟渲染仍受预处理、排序和光栅化开销限制的问题,利用相邻帧贡献高斯高度重叠的时间先验,引入几何/外观缓冲、时序动态剔除与选择性tile渲染,无需再训练或后处理即可即插即用加速。实验显示其在多种3DGS管线中最高约1.48倍提速,并保持接近原始渲染质量;但快速相机运动下帧间相似性不足,可能导致误差累积和闪烁。

Present but Not Remembered: Auditing How Frozen VLAs Encode, Deploy, and Steer Visual History Figure 1
2026-07-07cs.CV

Present but Not Remembered: Auditing How Frozen VLAs Encode, Deploy, and Steer Visual History

Chih-Ting Liao, Xin Cao

University of New South Wales

2026-07-07视觉感知

这篇论文针对“给VLA加记忆”前缺少诊断的问题,审计冻结视觉语言动作模型如何编码和调用历史帧。作者用逐层线性探针与激活互换干预区分“可解码的过去”和“真正独立的过去信息”,发现历史内容虽在各层可读出,但几乎只是当前帧的冗余副本;只有在当前画面近乎完全缺失时才被因果用于动作,且中层后读出被切断。不同架构编码相似,却呈现fallback与standing两种部署/可控性模式,提示有效记忆应注入过去独有信息。

Brand-as-Memory: Vision-Language Models Encode Causal, Mechanistically Localizable Credibility Priors for News Sources Figure 1
2026-07-07cs.CV

Brand-as-Memory: Vision-Language Models Encode Causal, Mechanistically Localizable Credibility Priors for News Sources

Chih-Ting Liao, Xin Cao

University of New South Wales

2026-07-07视觉语言视觉感知

这篇论文关注 VLM 在阅读新闻截图时是否依据内容证据,还是被媒体品牌身份牵引。作者提出 CueTrust 和 Source-Override Index,系统比较七个 VLM、五类来源线索,并进一步用探针、激活替换和 SAE 将“品牌即记忆”的可信度先验定位到约第 19–21 层。结果显示,媒体名、Logo 或域名会显著覆盖文章内容,可信度变化与专业媒体评级高度相关,定向 steering 可将覆盖效应降低约 41%。

Pathways of Visual Information Flow in Vision-Language Models Figure 1
2026-07-07cs.CV

Pathways of Visual Information Flow in Vision-Language Models

Israfel Salazar, Stella Frank, Dan Oneata, Desmond Elliott, Constanza Fierro

University of Copenhagen, Technical University of Denmark

2026-07-07视觉语言视觉感知生成模型

论文关注视觉语言模型在生成答案时如何把图像信息传入语言模型这一可解释性问题。作者用因果 patching、注意力 knockout 和反事实样本区分模型“实际使用”与“可被迫使用”的信息通路,提出直接读取图像 token 与经查询文本中介两类路径。结果显示路径选择随任务、数据分布和提示变化:识别多走直接路径,空间关系多走文本中介,且直接路径受扰时模型可切换到中介路径维持性能,提示常规消融可能误判机制。

Efficient Decentralized Multi-task Dataset Valuation via Model Merging Figure 1
2026-07-07cs.CL

Efficient Decentralized Multi-task Dataset Valuation via Model Merging

Mohammadsajad Alipour, Mohammad Mohammadi Amiri

Department of Computer Science, Rensselaer Polytechnic Institute

2026-07-07数据集/基准

针对多数据卖方场景中传统 Shapley 或重训练式估值计算昂贵、依赖集中数据且多局限于单任务的问题,论文提出 DMVM:用共享初始化下各卖方微调模型的任务向量合并来近似多任务联合训练效用,并结合安全聚合避免暴露数据和模型参数。理论上给出与真实多任务边际贡献的误差界,实验在视觉和 NLP 任务上显示估值较稳定且显著降低重训练成本。

GrowFields: Compositional 4D Neural Fields for Topology-Changing Plant Growth Figure 1
2026-07-07cs.CV

GrowFields: Compositional 4D Neural Fields for Topology-Changing Plant Growth

Joaquin Gajardo, Michele Volpi, Marko Mihajlovic, Siyu Tang, Lukas Roth, Sergey Prokudin

2026-07-07视觉感知

本文面向稀疏纵向3D点云中的植物生长建模问题,动机是传统动态重建难以处理叶片等器官异步生长、拓扑变化和缺失对应关系。GrowFields将植物按器官分解并规范化到各自坐标系,用共享的连续神经形变场结合器官潜变量建模4D轨迹。实验在四类植物上显示,其在几何拟合、叶尖跟踪、时间一致性和形态保真度上优于多种现有表示。

Beyond Post-Quantization: Native Hash Learning with a Dedicated HASH Token Figure 1
2026-07-07cs.CV

Beyond Post-Quantization: Native Hash Learning with a Dedicated HASH Token

Xinze Liu, Ding Wang, Hengjie Zhu, Dayan Wu

2026-07-07视觉感知

本文针对深度哈希中先学连续特征、再末端量化成二值码导致的特征空间与汉明空间不一致问题,提出 HashViT:在 ViT 内加入专用 HASH token,并拆分为 Hash Register 与 Semantic Workspace,再用轻量 HRA 逐层细化二值寄存器。实验显示其在三个图像检索基准上达到 SOTA 或有竞争力表现,同时保持紧凑汉明码效率。

From General Actions to Domain-Specific Monitoring: Prior-Adaptive Transfer for Skeleton-Based Action Recognition Figure 1
2026-07-07cs.CV

From General Actions to Domain-Specific Monitoring: Prior-Adaptive Transfer for Skeleton-Based Action Recognition

Hao Wang, Di Yang, Jiangtao Wang

2026-07-07视觉感知

本文针对骨架动作识别模型从通用动作迁移到医疗监测等小样本领域时,易保留无关运动先验、增加干扰和计算成本的问题,提出 PATS:在 AlphaPose/InfoGCN 管线基础上,用迭代块剪枝与补偿微调将模型压缩视为任务相关先验选择。实验在阿尔茨海默检测和跌倒检测上优于既有方法,并同时降低参数量与推理延迟,但具体增益在多大程度来自剪枝准则而非微调策略仍需更多说明。

LBTCap: A Lightweight Bilateral Transformer for Real-Time Remote Sensing Image Change Captioning Figure 1
2026-07-07cs.CV

LBTCap: A Lightweight Bilateral Transformer for Real-Time Remote Sensing Image Change Captioning

Licheng Zhang, Siew-Kei Lam, Naveed Akhtar

2026-07-07视觉语言视觉感知

面向遥感变化描述在城市规划、灾害响应等场景中的实时部署需求,LBTCap将轻量化作为主要目标,提出双边Transformer注意力:两期图像分别生成查询和键、拼接形成值,并用可学习双边权重融合注意力图,避免固定差分偏置。实验显示其在LEVIR-CC和Dubai-CC上接近或匹配SOTA精度,同时参数更少、推理更快;但效率增益很大一部分来自截断骨干和分组查询注意力。

Piecewise Dynamic Diffusion Regularization for Reconstruction of Cardiac Cine MRI Figure 1
2026-07-07eess.IV

Piecewise Dynamic Diffusion Regularization for Reconstruction of Cardiac Cine MRI

Florian Fürnrohr, Reinhard Heckel

2026-07-07生成模型三维

本文针对自由呼吸实时心脏 cine MRI 中每帧采样极少、运动强且长序列难以用扩散先验重建的问题,提出 PDDR:把学习自门控 cine 数据的时空扩散模型嵌入变分重建,并以分段方式对长视频正则化,从而兼顾解剖先验、心动时序和计算开销。回顾加速、模拟与前瞻实时实验显示,其质量优于或匹配 L+S、FMLP、T-DIP、DPS、dSTDM,并将相对 DPS 的运行时间和显存显著降低。

Defending from GeoLocalization through Adversarial Road Trips Figure 1
2026-07-07cs.CV

Defending from GeoLocalization through Adversarial Road Trips

Niccolò Niccoli, Federico Becattini, Lorenzo Seidenari

2026-07-07视觉感知

本文针对图像地理定位模型可从单张照片推断位置带来的隐私与安全风险,提出 RoadTrip Attack:不直接把图像推向目标地点,而是利用地理空间结构,用 beam search 选择一串中间“诱饵地点”逐步优化扰动。实验显示,该方法在白盒与黑盒迁移设置下均优于 PGD、FGSM、C&W 和 GeoShield,尤其在低扰动预算下能以更不显眼的噪声显著提高攻击成功率。

OmniLayout: A Schematic-Coupled Multimodal Benchmark for Constraint-Aware Geometric Reasoning in PCB Layout Figure 1
2026-07-07cs.CV

OmniLayout: A Schematic-Coupled Multimodal Benchmark for Constraint-Aware Geometric Reasoning in PCB Layout

Taiting Lu, Kaiyuan Lin, Mingjia Wang, Haolin Ye, Runze Liu, Yuxin Tian, Vahe Melkonyan, Haoyu Wang, Muchuan Wang, Chufan Hong, Yifan Yang, Sung-Liang Chen, Yi-Chao Chen, Yicheng Jin, Mahanth Gowda

Pennsylvania State University, Shanghai Jiao Tong University, Binghamton University

2026-07-07视觉语言优化算法数据集/基准

针对现有多模态模型在密集 PCB 元件摆放中难以同时满足几何、布线与电气约束的问题,OmniLayout 构建了首个原理图耦合的真实 PCB 布局基准,含 1681 个工业级设计,并设置几何合法性、可布线性、电气功能与工具增强推理任务。实验显示当前 LMM 仍频繁产生重叠、布线优化差且连接功能保持不稳定。

A Decomposable Probe for Few-Step Diffusion Models: Prompt, Latent, and Score Selectivity across Backbone Families and Distillation Paradigms Figure 1
2026-07-07cs.CV

A Decomposable Probe for Few-Step Diffusion Models: Prompt, Latent, and Score Selectivity across Backbone Families and Distillation Paradigms

Patrick Mu Haojie

2026-07-07生成模型

本文针对少步蒸馏扩散模型常被单一 FID/CLIP 指标概括、难以定位质量差异来源的问题,提出训练无关的可分解探针,在提示、潜变量和 score 三层注入受控扰动并计算选择性比值。实验覆盖 23 个文生图模型,发现提示层主要是 sanity check,潜变量层几乎可二分类识别 rectified-flow,且经 ADD 蒸馏仍保留;score 层则反映蒸馏目标差异,如 4 步 ADD-vs-rest 对比和轨迹 rollout 的早期强度峰。

Semantic Segmentation-Driven Image-Level Diagnosis of Liver Cancers in Hematoxylin and Eosin Histopathology Images Figure 1
2026-07-07cs.CV

Semantic Segmentation-Driven Image-Level Diagnosis of Liver Cancers in Hematoxylin and Eosin Histopathology Images

Ivica Kopriva, Dario Sitnik, Arijana Pacic, Karolina Krstanac, Irena Veliki Dalic, Marijana Popovic Hadzija

aDivision of Computing and Data Science, Ruđer Bošković Institute, Bijenička cesta 54, cDepartment of Pathology and Cytology, Dubrava University Hospital, Avenija Gojka Šuška, dClinical Division for Pathology and Cytology, Clinical Hospital Center Zagreb, Kišpatićeva, eDivision of Molecular Medicine, Ruđer Bošković Institute, Bijenička cesta 54, 10000, level label in the segmentation output. To ensure clinical relevance, we adopt the nnU-Net, architecture and train it on a publicly available dataset collected in our study with pixel-level, majority voting with at least two out of four pathologists had to agree on cancer label. Inter-, available

2026-07-07视觉感知

针对 H&E 肝癌切片受染色/扫描差异和像素标注噪声影响、三类肝癌自动鉴别研究不足的问题,论文将 nnU-Net 语义分割结果按主导像素标签聚合为图像级诊断,并结合染色归一化。其在 HCC、CCA、CMA 五折交叉验证中平衡准确率达 0.975、0.950、1.000,外部术中 CMA 样本达 0.947,显示较补丁级分类更稳健。

Learning to Suppress SPAD-based LiDAR Flare Figure 1
2026-07-07cs.CV

Learning to Suppress SPAD-based LiDAR Flare

Xuanya Zhu, Linghao Shen

Work done during an internship at Advanced Technology Center, Sony (China) Ltd.

2026-07-07视觉感知

这篇论文针对 SPAD LiDAR 在强反射或 pile-up 下产生 flare、导致点云虚假结构和测距失真的问题,将抑制任务改写为语义分割。核心洞察是常规流程只保留第一回波会丢失可区分 flare 的第二回波信息,因此提出 PILF,把第一/第二回波与环境光作为多模态输入并融合几何、光度线索。在 FLARE 真实场景数据上,PILF 优于多种分割基线,最高达到 79.32% mIoU。

OpenGlass: A Sensing-Computing Split Architecture for Local MLLM-Driven Real-Time Visual Assistance Figure 1
2026-07-07cs.CV

OpenGlass: A Sensing-Computing Split Architecture for Local MLLM-Driven Real-Time Visual Assistance

Mengzhang Li, Yuan Yao

Shanghai Qizhi Institute, College of AI, Tsinghua University

2026-07-07视觉感知

OpenGlass针对云端多模态视觉助手在盲低视力场景中延迟高、隐私暴露大,而眼镜端算力不足的问题,提出“眼镜感知、近端设备计算”的本地优先架构,并用流式生成到语音缩短首响时间、用安全拒答和日志降低幻觉风险。实测ESP32 Wi-Fi采集下,缩放图像首音频中位延迟993ms,原始720p为1625ms,分别有97.5%和93.3%试验低于2秒。

Fast 3D Foundation Model Initialized Gaussian Splatting Figure 1
2026-07-07cs.CV

Fast 3D Foundation Model Initialized Gaussian Splatting

Anurag Dalal, Daniel Hagen, Kjell G. Robbersmyr, Kristian Muri Knausgård

2026-07-07三维

该文针对传统3DGS依赖COLMAP等SfM导致耗时高、低纹理或稀疏视角下不稳的问题,提出用VGGT-X等3D基础模型初始化相机位姿、深度和点云,并结合3R-GS式位姿—高斯联合优化、MLP位姿细化与深度引导损失。实验在Mip-NeRF 360、Tanks and Temples和RobustNeRF上达到23.61 dB PSNR、0.19 LPIPS,单场景约3分钟完成训练,但高畸变广角相机场景仍表现受限。

Seeing Through WiFi: Lightweight Human Pose Estimation with Dynamic Kernel Attention Figure 1
2026-07-07cs.CV

Seeing Through WiFi: Lightweight Human Pose Estimation with Dynamic Kernel Attention

Toan D. Gian, Van-Dinh Nguyen, Vo Phi Son, Nhan Thanh Nguyen, Dinh Thai Hoang, Diep N. Nguyen, Nguyen Cong Luong, Symeon Chatzinotas

2026-07-07三维

这篇论文针对摄像头隐私、可穿戴不便以及现有 WiFi 姿态估计硬件/模型过重的问题,提出 WiLHPE:训练时用视觉教师生成姿态监督,测试时仅用原始 CSI,并以通道-频率动态卷积和注意力提升高维 WiFi 特征利用效率。实验在 MM-Fi 与 WiPose 上分别达到 PCK50 85.96% 和 94.27%,噪声下仍约 80%,但真实开放环境泛化仍需更多验证。

BVS: Bayesian Visual Search with Multimodal Large Language Model for Fine-grained Perception Figure 1
2026-07-07cs.CV

BVS: Bayesian Visual Search with Multimodal Large Language Model for Fine-grained Perception

Geng Li, Yuxin Peng

2026-07-07视觉语言

这篇论文针对超高分辨率、杂乱场景中小目标细粒度感知困难的问题,指出现有视觉搜索要么无先验而低效,要么依赖静态先验且难以纠偏。BVS 将搜索建模为连续空间-尺度流形上的贝叶斯优化,用 MLLM 早停注意力 rollout 构造含推理信息的先验,再结合尺度感知非平稳核与 GP-UCB 迭代更新后验。实验显示其在精度与效率权衡上优于现有方法,并给出次线性 regret 理论保证。

FairFlow: Demystifying and Mitigating Stereotype Bias in Text-to-Image Diffusion Transformers Figure 1
2026-07-07cs.CV

FairFlow: Demystifying and Mitigating Stereotype Bias in Text-to-Image Diffusion Transformers

Chen Chen, Yuanmin Huang, Zhenfei Zhang, Mi Zhang, Xiaohan Zhang, Yun Xiong, Xiaoyu You, Min Yang

Fudan University, East China University of Science and Technology, Fudan University Shanghai China, East China University of Science and Technology Shanghai China

2026-07-07视觉感知生成模型

针对文本到图像 MM-DiT 在普通提示下仍会放大性别、种族等刻板偏见、且既有 U-Net 去偏方法难迁移的问题,论文通过机制分析指出偏见集中在少量“语义绑定枢纽”层,并呈早中晚阶段传播;据此提出 FairFlow,在推理时仅向这些枢纽注入属性特定公平方向。FLUX.1-dev 和 SD3 实验显示其可改善人口属性多样性,同时基本保持语义一致性、图像质量与低开销。

Rethinking Brain Decoding with CLIP: The Role of Adversarial Robustness Figure 1
2026-07-07cs.CV

Rethinking Brain Decoding with CLIP: The Role of Adversarial Robustness

Byeongseo Bok, Futa Waseda, Jun Liu, Isao Echizen

The Graduate University for Advanced Studies (SOKENDAI), Kanagawa, Japan, National Institute of Informatics, Tokyo, Japan, The University of Tokyo, Tokyo, Japan

2026-07-07安全鲁棒

本文关注 fMRI 脑解码中直接对齐标准 CLIP 表征效果受限的问题,核心洞察是把“目标表征是否具备对抗鲁棒性”作为选择准则,而非改解码器或生成器。作者固定线性 fMRI 解码器,仅替换为 FARE、TeCoA 等鲁棒 CLIP,在 NSD 与 GOD 上提升图像检索、零样本分类及 Pearson、余弦、RSA 等对齐指标;归因分析显示鲁棒模型使用的视觉线索更集中且不同于标准 CLIP,但增益是否完全来自鲁棒性仍需更多消融支持。

DistillH-Mamba: A Hypergraph-Mamba-Based Knowledge Distillation Model for Efficient Impact Fall Detection Figure 1
2026-07-07cs.CV

DistillH-Mamba: A Hypergraph-Mamba-Based Knowledge Distillation Model for Efficient Impact Fall Detection

Tresor Y. Koffi, Youssef Mourchid, Mohammed Hindawi, Yohan Dupuis

2026-07-07视觉感知

本文针对跌倒事件中“触地冲击瞬间”难以准确且实时识别的问题,提出 DistillH-Mamba:用双重超图建模多关节高阶关系,并结合 Mamba 线性时序建模与关系知识蒸馏压缩学生模型。其在 UP-Fall 与 UMAFall 骨架数据上报告 97.38% 冲击检测准确率,较教师模型推理时间降低 73.8%,但真实老人自然场景验证仍未充分说明。

CuBAS: Information Geometric Curvature-Based Adaptive Sampling for Supervised Classification Figure 1
2026-07-07cs.LG

CuBAS: Information Geometric Curvature-Based Adaptive Sampling for Supervised Classification

Alexandre L. M. Levada

Federal University of São Carlos

2026-07-07视觉感知

该文针对监督分类中训练样本冗余、边界样本难以识别的问题,提出 CuBAS:把带标签数据构成 kNN 图,并用 Potts MRF 下 Fisher 信息一二阶比值估计局部曲率,以同时抽取低曲率原型点和高曲率决策边界点。实验报告在多类表格、图像、生物数据上优于随机与不确定性采样,低预算下提升明显,但数据集数量表述前后不完全一致。

Text as Partial Constraint: Core-Residual Alignment for Robust Vision-Language Learning Figure 1
2026-07-07cs.CV

Text as Partial Constraint: Core-Residual Alignment for Robust Vision-Language Learning

Chengzhen Yu, Canran Xiao, Siyuan Ma, Yang Liu

Nanyang Technological University (NTU), Shenzhen Campus of Sun Yat-sen University

2026-07-07视觉语言视觉感知优化算法安全鲁棒

针对自然图文监督中描述常常不完整、导致视觉语言模型对改写和遗漏细节过度自信的问题,论文提出 TPC:把多视角 caption 视为部分约束,提取共享语义核心、抑制“未说出”残差,并用视角分歧调节对比学习置信度。实验显示其在 ImageNet clean/robust、Avg-14 迁移以及 LLaVA 下 POPE、OKVQA 上均有提升,但具体增益与数据构造的关系仍需进一步核验。

A Multi-Task Deep Learning Framework for Real-Time Intelligent Video Surveillance with Temporal Event Validation Figure 1
2026-07-07cs.CV

A Multi-Task Deep Learning Framework for Real-Time Intelligent Video Surveillance with Temporal Event Validation

Estera Dumitru, Stelian Spînu

2026-07-07视觉感知

针对多路监控视频超出人工值守能力、商业系统封闭难调的问题,论文将人脸授权、车牌、武器、火烟和行为识别整合到共享 GPU 的实时多任务管线,并用多帧确认、置信度投票和级联过滤把帧级检测转为事件。其亮点在于补充武器检测器和自建破坏行为数据集;结果显示武器 mAP@0.5 达 0.947,行为识别 94.33%,火烟误报率由 52% 降至 4%,车牌视频精确匹配由 66.7% 升至 81.8%,单帧延迟低于 100 ms。

Vidu S1: A Real-Time Interactive Video Generation Model Figure 1
2026-07-07cs.CV

Vidu S1: A Real-Time Interactive Video Generation Model

Jintao Zhang, Kai Jiang, Jintao Chen, Xu Wang, Yang Luo, Yuji Wang, Dechuang Chen, Jungang Li, Chengyang Ye, Marco Chen, Hongzhou Zhu, Min Zhao, Yuxuan Jiang, Zhengkun Huang, Chendong Xiang, Kaiwen Zheng, Haoxu Wang, Xiaohang Wang, Qi Jia, Xin Chen, Yimin Chen, Youhe Jiang, Fangcheng Fu, Zhijie Deng, Fan Bao, Jianfei Chen, Jun Zhu

Tsinghua University, Shengshu Technology, requirements. A playable online demo is available at https://vidu.com/vidu-stream.

2026-07-07视觉感知

论文瞄准离线视频生成无法实时响应用户、长时自回归易漂移且部署成本高的问题,提出 Vidu S1:将语音作为显式未来控制信号,并结合流式生成、数据过滤流程与 TurboDiffusion/TurboServe 推理服务栈,实现可持续交互的数字角色视频。实验称其在 540p 下可达 42 FPS,并在 Vidu-StreamBench 与 HDTF 上取得最佳 CSIM、Sync-D、DOVER;但具体增益在模型、数据和系统优化间的拆分文中未充分说明。

ExpoMotion: A Large-Scale Benchmark and A Householder Projection Network for Multi-Exposure Fusion Figure 1
2026-07-07cs.CV

ExpoMotion: A Large-Scale Benchmark and A Householder Projection Network for Multi-Exposure Fusion

Yao Liu, Lishen Qu, Shihao Zhou, Jie Liang, Hui Zeng, Yabin Peng, Huipeng Lin, Lei Zhang, Jufeng Yang

2026-07-07数据集/基准

这篇论文针对动态场景多曝光融合中缺少可靠基准、运动易产生鬼影的问题,构建了含1738组曝光序列和专家筛选GT的ExpoMotion数据集;方法上提出HOP,将曝光预对齐与鬼影过滤解耦,用全局照明先验校正亮度差异,并以Householder正交注意力把错位伪影视作可投影剔除的扰动。实验显示该基准提升泛化评测能力,HOP在定量指标和感知质量上优于现有方法。

Observable- and Positional-Encoding-Dependent Symmetry Readout from Neural Network Weights Figure 1
2026-07-07cs.LG

Observable- and Positional-Encoding-Dependent Symmetry Readout from Neural Network Weights

Naoya Chiba, Satoshi Sugiyama, Yuki Uranishi

D3 Center, The Unversity of Osaka

2026-07-07视觉感知

本文追问非等变神经场的几何对称性能否从训练权重中事后读出,核心洞察是可见的不是目标函数真实对称群,而是由位置编码、权重与Gram等读出观测共同限制的“可观测对称集”。作者给出精确可观测层级,并在2D SDF MLP实验中验证:DyadicAxisPE更易读出D4、抑制D3,TriAxisPE改变D3/D6响应,随机傅里叶特征主要呈现π旋转响应。

SNR-Adaptive Unified Diffusion for Multi-Task Medical Image Segmentation Figure 1
2026-07-07cs.CV

SNR-Adaptive Unified Diffusion for Multi-Task Medical Image Segmentation

Jiahao Liu, Hang Wei, Shuai Wu

School of Telecommunications Engineering, Xidian University, School of Computer Science and Technology, Xidian University

2026-07-07视觉感知生成模型

本文针对心脏医学图像分割中不同数据集、模态和标注语义导致的“一任务一模型”成本高与联合训练负迁移问题,提出 UniT-Diff:用 11 通道任务隔离标签空间消除语义冲突,并通过随扩散步 SNR 调节任务 token、按任务类型丢弃条件来平衡 UDA 与 DG 的需求。在 LA、MMWHS、MNMS 三项任务上,单一参数模型分别较独立 DiffVNet 提升 0.87%、1.77%、0.88%,但动态通道路由等限制仍待解决。

Robustness Meets Uncertainty: Evidential Adversarial Training for Robust Selective Classification Figure 1
2026-07-07cs.LG

Robustness Meets Uncertainty: Evidential Adversarial Training for Robust Selective Classification

Nicolas Sournac, Ahmed Baha Ben Jmaa, Bertrand Braeckeveldt

Multitel Research & Innovation Center, Artificial Intelligence Department, Belgium, TRAIL – Trusted AI Labs, Belgium, ial training methods. Our source code is publicly available at https://

2026-07-07安全鲁棒

这篇论文关注安全场景中“抗攻击但不知何时拒答”的风险,指出常规对抗训练虽提升鲁棒精度,却可能破坏不确定性排序,导致选择性分类失效。作者提出 EV-AT,用 Dirichlet 证据分布建模预测,并在对抗样本间对齐 log-Dirichlet 参数。实验在干净、AutoAttack 与常见腐蚀设置下显示,其将鲁棒性—不确定性 Pareto 前沿推向优于多种对抗训练基线的位置。

Attention-Guided Efficientnet Architecture For Precise Criminal Identification in Surveillance Images Figure 1
2026-07-07cs.CV

Attention-Guided Efficientnet Architecture For Precise Criminal Identification in Surveillance Images

Savitha N J, Lata B T

Research Scholar, Department of Computer Science and Engineering, University Visvesvaraya, College of Engineering (UVCE), Bangalore University, CMR Institute of Technology, Bengaluru, Department of Computer Science and Engineering, University Visvesvaraya College of, Engineering (UVCE), Bangalore University, Bengaluru, India, experimentally evaluated using the Labeled Faces in the Wild (LFW) and SCFace datasets., The proposed framework is experimentally evaluated using the Labeled Faces in the Wild (LFW)

2026-07-07视觉感知

面向监控图像低分辨率、模糊、遮挡和光照变化导致的人脸识别不稳问题,论文将 EfficientNet-B0 与 CBAM 注意力、多尺度特征融合及 Softmax-Triplet 损失结合,用于强化局部纹理与身份语义表征。在 LFW 和 SCFace 上报告 98.2% 准确率、0.99 ROC-AUC,优于多种 CNN 基线;但摘要外对数据划分与泛化验证细节有限,增益来源仍需谨慎判断。

SafeGuard: A Multi-Agent Perception-Reasoning Framework for Social-Risk AI-Generated Video Detection Figure 1
2026-07-07cs.CV

SafeGuard: A Multi-Agent Perception-Reasoning Framework for Social-Risk AI-Generated Video Detection

Wenlin Wu, Sheng Zhou, Peipei Song, Wenhao Wang, Junbin Xiao, Xun Yang

2026-07-07视觉感知安全鲁棒

面向全场景生成视频在暴力、谣言等社会风险语境下更难靠低层伪迹判别的问题,SafeGuard将分层感知取证工具与自反思语义验证器组成多智能体闭环,用显式证据链同时检查物理可行性、结构一致性与社会逻辑。论文还构建20K规模SafeVid基准;实验称在SafeVid准确率提升18.7%,并在四个公开视频检测基准上优于既有方法。

PixCon: Clean-Positive Contrastive Learning for Foundation-Model Semi-Supervised Segmentation Figure 1
2026-07-07cs.CV

PixCon: Clean-Positive Contrastive Learning for Foundation-Model Semi-Supervised Segmentation

Ebenezer Tarubinga

2026-07-07视觉感知

论文指出在 DINOv2 等基础模型用于半监督语义分割后,伪标签阈值已能得到较干净样本,瓶颈转向像素嵌入空间的类别结构。PixCon 只把有标注且被学生模型判对的像素写入类别记忆库,构造零污染正样本对,并用梯度分析解释错误正样本的影响。实验在 Pascal VOC、Cityscapes、ADE20K 上与 UniMatch V2 持平或略优,Pascal 1/8 三种子均提升,约 +0.2 mIoU,且无推理开销;但作者也承认主要增益可能来自正确性筛选带来的正样本监督,而非污染移除本身。

Lightweight Polyp Segmentation via a Gain-Aware Prediction-Space Recursive Controller Figure 1
2026-07-07cs.CV

Lightweight Polyp Segmentation via a Gain-Aware Prediction-Space Recursive Controller

Jiachi Zhang, Zhuoyu Wu, Quanjun Wang, Wenhui Ou, Wenqi Fang

Shenzhen Institutes of Advanced Technology, Chinese Academy of Sciences, Shenzhen, China, CyPhi( Ψ ​ Φ \Psi\Phi ) AI Research Lab, School of IT, Monash University Malaysia, South China University of Technology, Guangzhou, China, Department of Electronic & Computer Engineering, The Hong Kong University of Science and Technology

2026-07-07视觉感知规划控制

针对轻量息肉分割常靠更强编码器、复杂解码器或重型细化分支提升而难以归因的问题,论文把细化转为预测空间递归控制:在固定迭代预算内基于logits差异与不确定性更新增益感知状态,并施加残差校正。七种轻量骨干、Kvasir训练及三组迁移测试显示源域Dice/IoU普遍提升,跨域收益有选择性,参数和GMACs几乎不增。

RIGS-Refiner: Risk-Guided Recursive Refinement in Prediction Space for Colonoscopy Polyp Segmentation Figure 1
2026-07-07cs.CV

RIGS-Refiner: Risk-Guided Recursive Refinement in Prediction Space for Colonoscopy Polyp Segmentation

Jiachi Zhang, Zhuoyu Wu, Wenqi Fang

Shenzhen Institutes of Advanced Technology, Chinese Academy of Sciences, Shenzhen, China, South China University of Technology, Guangzhou, China, CyPhi( Ψ ​ Φ \Psi\Phi ) AI Research Lab, School of IT, Monash University Malaysia

2026-07-07视觉感知安全鲁棒

本文针对结肠镜息肉分割中“整体预测已可用、错误集中在边界和局部难例”的场景,提出 RIGS-Refiner:在冻结主模型输出的预测空间内,用图像先验、预测可靠性线索和风险引导的递归残差写回做轻量后处理,而非重新解码整幅掩码。实验在 PraNet 与 SegFormer-B0、Kvasir/ClinicDB/ColonDB/ETIS 上均带来一致改进,仅增加 519 个参数和 0.631 GFLOPs,显示其优势主要在低开销局部修正与部署友好性。

OmniFocus: Query-Guided Modality-Balanced Token Compression for Omni-Modal Large Language Models Figure 1
2026-07-07cs.LG

OmniFocus: Query-Guided Modality-Balanced Token Compression for Omni-Modal Large Language Models

Shijie Cao, Qingyu Zhang, Boxi Yu, Yuzhong Zhang, Boxi Cao, Yaojie Lu, Hongyu Lin, Xianpei Han, Le Sun

School of Advanced Interdisciplinary Sciences, University of Chinese Academy of Sciences, Chinese Information Processing Laboratory, Institute of Software, Chinese Academy of Sciences, University of Limerick

2026-07-07视觉感知

OmniFocus针对全模态大模型处理长音视频时 token 数量过大、推理成本高的问题,指出单一音频或视频引导压缩会造成模态偏置并忽略查询相关证据的时间局部性。其核心是在无需训练的情况下分别估计音频与视频块对查询的重要性,再结合跨模态关联和模态内峰值保留关键信息。基于 Qwen2.5-Omni 的四个音视频基准实验显示,在 25% token 保留率下仍保持较好性能,DailyOmni 上达到 59.40 准确率并带来约 1.38× prefill 加速。

Text-to-Image Generation for Projector-Camera System Registration Figure 1
2026-07-07cs.CV

Text-to-Image Generation for Projector-Camera System Registration

Xinyu Chen, Yuqi Li, Jiabao Li, Pinyan Tang, Chong Wang, Aditi Majumder

Ningbo University, University of California, Irvine, Ningbo University Ningbo China, University of California, Irvine United States

2026-07-07视觉感知

该文针对投影-相机注册中结构光需多帧且破坏观看体验、普通自然图像特征分布不足的问题,提出由文本生成单张语义自然但局部特征丰富的投影图,并训练网络从投影/相机图像对预测像素对应关系。方法用合成数据模拟几何与光照扰动,实验显示在多种配置下提升注册精度,并在用户研究中改善自然性与可用性。

CURE: Controllable Unified Image Restoration for Complex Degradations Figure 1
2026-07-07cs.CV

CURE: Controllable Unified Image Restoration for Complex Degradations

Boseong Kim, Donghyeon Cho

Department of Computer Science, Hanyang University, Seoul, South Korea, Corresponding author.Department of Computer Science, Hanyang University, Seoul, South Korea

2026-07-07视觉感知规划控制

针对真实视觉系统中雨、雪、雾、低照等复合退化相互耦合、难以按需去除的问题,CURE不改网络结构,而通过身份嵌入、比例控制、中间监督和置换不变损失训练可解耦表征,使用户能选择性或连续调节各类退化的恢复强度。实验称其在复合退化基准上达到SOTA,并提升顺序无关性与可控性。

Natural Language Camera Movement Understanding Figure 1
2026-07-07cs.CV

Natural Language Camera Movement Understanding

Yuwen Tan, Joey Huang, Jin Huang, Haoxiang Li, Boqing Gong

2026-07-07视觉感知

为解决视频生成中镜头运动提示的训练数据筛选与结果评测需求,论文将自然语言镜头运动理解单独定义为任务,提出覆盖17类运动的两级电影学 taxonomy,并构建含真实与合成视频的原子化基准及多源增强训练集。实验揭示现有VLM常混淆平移/旋转、方向、变焦/推拉和物体/相机运动;微调Qwen3-VL-8B在真实、合成基准上分别较Gemini 3.1 Pro相对提升10%和11%,但仍明显落后人类。

OmniDS: Dual-Stream Context Fusion for Omnidirectional Depth from Fisheye Cameras Figure 1
2026-07-07cs.CV

OmniDS: Dual-Stream Context Fusion for Omnidirectional Depth from Fisheye Cameras

Chaesong Park, Jihyeon Hwang, Muyeol Sung, Jongwoo Lim

2026-07-07视觉感知

OmniDS针对多鱼眼相机做360°深度时,宽基线遮挡和自遮挡会让固定ERP投影下的跨视角特征互相冲突,尤其影响薄结构和边界。其核心是用CNN几何细节与冻结DINOv3语义先验组成双流表示,并通过学习视角权重、可变形跨注意力和多视角共识体替代刚性聚合。实验称在OmniThings、OmniHouse、Sunny等基准达到SOTA,蒸馏到MobileNet后仍保持接近精度并约10 FPS,但评测主要限于合成数据和固定四相机配置。

$C^3$ASD: Multi-Level Consistency-Driven Representation Learning Figure 1
2026-07-07cs.CV

$C^3$ASD: Multi-Level Consistency-Driven Representation Learning

Jin Hong, Jisoo Park, Junseok Kwon

2026-07-07视觉感知

这篇论文针对主动说话人检测在噪声、遮挡及音视频同时退化时易失效的问题,指出现有融合模型缺少显式一致性约束,容易学习模态特定捷径。C³ASD通过说话帧音视频嵌入对齐、模态内说话/非说话聚类分离,以及多/单模态预测蒸馏来正则化表示。实验称其在AVA-ActiveSpeaker和WASD的多类退化设置下提升鲁棒性,且无需额外标注或腐化训练数据。

MambaLIE: Scene Light Intensity-Boosted Low-Light Image Enhancement with State Space Model Figure 1
2026-07-07cs.CV

MambaLIE: Scene Light Intensity-Boosted Low-Light Image Enhancement with State Space Model

Wanshu Fan, Xiangyu Li, Cong Wang, Kin-man Lam, Xin Yang, Haiyan Zhang, Dongsheng Zhou

2026-07-07视觉感知

低照度图像会削弱移动拍摄、监控及下游视觉任务,而CNN难建模全局光照、Transformer成本较高。MambaLIE用场景光强先验与输入门控引导增强,并在LESSM中结合双向状态空间分支和局部增强分支,以线性复杂度兼顾全局照明与细节恢复。实验称其在4个合成和5个真实基准上较CNN/Transformer方法在精度、速度和模型规模上更优,适合资源受限部署。

HyperVAttention: Efficient Sparse Attention with Spatio-Temporal Clustering for Video Diffusion Figure 1
2026-07-07cs.CV

HyperVAttention: Efficient Sparse Attention with Spatio-Temporal Clustering for Video Diffusion

Dongyeun Lee, Amir Zandieh, Vahab Mirrokni, Junmo Kim, Insu Han

2026-07-07视觉感知生成模型

视频扩散 Transformer 的长视频生成受全局时空自注意力二次复杂度限制,已有聚类稀疏注意力又被聚类开销和 GPU CTA 利用率不足拖慢。HyperVAttention 通过 3D 局部窗口聚类、跨去噪步的混合更新,以及面向硬件 tile 的簇合并,减少冗余计算并填充空闲执行容量。在文本到视频实验中,它相对既有免训练稀疏注意力取得更优速度—质量折中,端到端延迟最高降低约 2.13 倍且保真度更好。

PosterHarness: Turning Scientific Poster Generation into an Auditable Instruction-Following Benchmark Figure 1
2026-07-07cs.CV

PosterHarness: Turning Scientific Poster Generation into an Auditable Instruction-Following Benchmark

Tianyi Yang, Dawei Fu, Youpeng Wu, Zixun Kou, Linrui Chen, Ruobing Jiang, Zijian Wang, Qiang Li

School of Physics, Peking University

2026-07-07数据集/基准

这篇论文针对科学海报生成中难以审计模型是否遵守版式、可读性和不伪造科学图表的问题,提出 PosterHarness:用“先占位、后确定性替换”的合同把视觉设计与真实图表来源分离,并记录失败类型。在 12 篇论文试验中,占位约束将 VLM 计数的合成科学图从 34 降到 0;相比 Paper2Poster,它画面分辨率、更少留白和视觉偏好更好,但信息保留略低且速度更慢。

REAL-OW: Rehearsal-free Open World Object Detection with Low-Rank Adaptation and Dual-Stage Objectness Modeling Figure 1
2026-07-07cs.CV

REAL-OW: Rehearsal-free Open World Object Detection with Low-Rank Adaptation and Dual-Stage Objectness Modeling

Huazhong Zhang, Xiaowen Fu, Yang Zhang, Linlin Shen, Jinbao Wang

Shenzhen University, Shenzhen, China, Corresponding author.Shenzhen University, Shenzhen, China

2026-07-07视觉感知强化学习

针对开放世界目标检测依赖样本回放带来的隐私、存储和持续学习负担,REAL-OW尝试完全无回放训练:用LoRA式通用/专用适配器分离跨任务表征与任务知识,并以双阶段objectness建模和CG-NLL缓解特征漂移、维持已知/未知边界。实验称其在检测精度和未知发现上超过多种回放方法,但具体增益在多大程度来自适配器结构仍需更多消融支撑。

CONFLUX: A Latent Diusion Model for 3D Chest-CT Synthesis with RL Post-Training Figure 1
2026-07-07cs.CV

CONFLUX: A Latent Diusion Model for 3D Chest-CT Synthesis with RL Post-Training

Max Van Puyvelde, Halil Ibrahim Gulluk, Wim Van Criekinge, Olivier Gevaert

2026-07-07强化学习三维

为解决3D胸部CT生成中“逼真但不一定符合指定病灶”的问题,CONFLUX用3D VAE压缩体数据、潜空间rectified-flow Transformer按18类异常及人口学/扫描元数据条件生成,并以GRPO按分类器反馈后训练强化属性一致性。实验在CT-RATE上优于MAISI和GenerateCT,三平面FID为32.3,独立判别器显示RL消除了相对真实扫描可靠性差距的47%,但奖励依赖NLP标签与分类器,临床真实性仍需谨慎解读。

VISTA: Auditing Semantic Divergence in Vision-Language Models Figure 1
2026-07-07cs.CV

VISTA: Auditing Semantic Divergence in Vision-Language Models

Junchi Liao, Jiawen Deng, Fuji Ren

University of Electronic Science and Technology of China

2026-07-07视觉语言视觉感知

这篇论文关注视觉语言模型在遇到人口特征、品牌标识或意识形态符号等视觉概念时,可能产生同一模型内高度一致、却与同伴模型明显不同的语义偏向。作者提出黑盒审计框架 VISTA,用多图多提示查询、双向蕴含聚类、语义熵与分布差异联合打分来定位模型特异异常。实验中,小规模偏置微调能被检出;对6个VLM、19类主题审计发现142个高疑似案例,并揭示视觉模态中特有的选择性拒答现象。

GuideMe: Multi-Domain Task Guidance and Intervention in Streaming Video Figure 1
2026-07-07cs.CV

GuideMe: Multi-Domain Task Guidance and Intervention in Streaming Video

Fang Liu, Jinpeng Chen, Ke Xu, Yuhao Liu, Huankang Guan, Xudong Lu, Bo Yang, Gerhard Hancke, Rui Liu, Rynson W.H. Lau

2026-07-07视觉感知

本文关注多模态大模型能否从离线视频理解走向实时“程序教练”,在用户执行任务时监控、发现错误并纠正。GuideMe 构建了首个多领域流式闭环指导基准,覆盖烹饪、物体操作、日常指导和健身,并用时间语义匹配、干预行为分类与 LLM 评审评估模型。实验显示现有模型会给步骤说明,但在错误检测和纠偏反馈上明显失效,尚不能可靠完成 instruct-observe-correct 循环。

Cross-device Collaborative Test-time Adaptation with Zeroth-order Optimization and Model Merging Figure 1
2026-07-07cs.CV

Cross-device Collaborative Test-time Adaptation with Zeroth-order Optimization and Model Merging

Yu Mitsuzumi, Akisato Kimura, Yasuhiro Fujiwara, Hisashi Kashima

{}^{\text{1}} NTT, Inc., {}^{\text{2}} Kyoto University

2026-07-07优化算法

针对边缘设备在测试时自适应中难以承受反向传播内存开销的问题,论文在跨设备协作框架下把零阶优化与模型合并结合起来,只优化少量合并系数而非全模型参数,并通过权重裁剪与低秩近似减少无效和冗余信息。实验在多种图像腐蚀与风格迁移基准上显示,该方法显著降低内存占用,同时提升普通和量化模型的适应精度。

RePos: Relative-to-Absolute Output Factorization for Cross-Environment WiFi-Based 3D Human Pose Estimation Figure 1
2026-07-07cs.CV

RePos: Relative-to-Absolute Output Factorization for Cross-Environment WiFi-Based 3D Human Pose Estimation

Zhangcheng Hou, Tomoaki Ohtsuki

2026-07-07三维

该文针对 WiFi CSI 三维人体姿态在跨房间部署时易把身体结构与环境位置线索纠缠、导致泛化差的问题,提出 RePos 将输出分解为根相对姿态与根位置两支:前者用身体部位潜变量和骨架图注意力建模,后者用仅基于幅度的 ASPN 做粗定位。结果显示 RePos-D 在单环境 Person-in-WiFi-3D 达 86.9mm MPJPE,而跨环境 MM-Fi 上 RePos 将 MPJPE 降至 254.4–296.1mm,较 WiFi 基线降低约 10–21%。

Awakening Diffusion Transformers: Eliciting Stronger Generation and Understanding via Massive Activation Modulation Figure 1
2026-07-07cs.CV

Awakening Diffusion Transformers: Eliciting Stronger Generation and Understanding via Massive Activation Modulation

Chaofan Gan, Zicheng Zhao, Yuanpeng Tu, Xi Chen, Ziran Qin, Tieyuan Chen, Supavadee Aramvith, Mehrtash Harandi, Weiyao Lin

2026-07-07生成模型

论文针对扩散 Transformer 中“大激活”机制尚不清楚的问题,发现其跨空间 token 分布但集中于少数固定通道,并主要受去噪时间步和 AdaLN 调制影响。作者据此提出免训练 EMA:生成时通过抑制 MA 构造缺细节反事实分支来增强纹理,理解时用 MREP 降低方向支配并保留空间线索。实验显示其在图像/视频生成、局部细化和密集理解任务上均有提升。

Parallelized Autoregressive Decoding for Omni-Modal Dense Video Captioning Figure 1
2026-07-07cs.CV

Parallelized Autoregressive Decoding for Omni-Modal Dense Video Captioning

Wenzheng Zeng, Siyi Jiao, Chen Gao, Hwee Tou Ng, Mike Zheng Shou

National University of Singapore, Singapore

2026-07-07视觉语言视觉感知

这篇论文针对密集视频字幕中 Video-LLM 逐 token 自回归解码在长视频、多事件场景下延迟高的问题,提出 PadCaptioner:先用潜在全局事件 token 学习事件级结构和跨事件因果,再将不同事件的字幕子链并行解码、事件内仍保持顺序生成。实验显示其在全模态事件定位与字幕质量上超过既有方法,并报告约 3.8 倍实际解码加速。

Overloading Large Vision-Language Models for Jailbreaking Figure 1
2026-07-07cs.CV

Overloading Large Vision-Language Models for Jailbreaking

Haoyu Zhang, Yangyang Guo, Mohan Kankanhalli

National University of Singapore, Hangzhou International Innovation Institute, Beihang University

2026-07-07视觉语言视觉感知强化学习

针对现有视觉语言模型越狱多依赖短文本或 OOD 图像、跨架构迁移性减弱的问题,论文提出“信息过载”视角:用长文本规则、图像排版文字和递归布局提升跨模态处理负担,从而削弱拒答机制。实验覆盖开源与 Gemini、GPT-4.1 等商业 LVLM,报告平均 ASR 分别达 88.6% 和 84.0%,且在黑盒迁移中仍保持较高成功率,提示复杂多模态输入是实际部署中的安全风险。

Incentivizing Vision Language Models to Search for Long Video Question Answering Figure 1
2026-07-07cs.CV

Incentivizing Vision Language Models to Search for Long Video Question Answering

Harsh Goel, S P Sharan, Sahil Shah, Minkyu Choi, Joungbin An, Kristen Grauman, Sandeep P. Chinchali

The University of Texas at Austin, Austin, TX, USA

2026-07-07视觉感知

长视频问答中,均匀抽帧容易错过与问题相关的稀疏片段,且仅用最终答案监督难以训练模型主动找证据。论文提出 VSeek,将视觉语言模型改造成多轮自然语言视频搜索代理,并用 VETL 把问题编译为含视觉原语与时序关系的“可验证清单”,作为强化学习的密集奖励。实验显示,相比基座模型,Pass@1 最高提升 8%,Pass@4 提升 15%。

ReLo-IRR: Reflection-Guided LoRA Framework for Image Reflection Removal Figure 1
2026-07-07cs.CV

ReLo-IRR: Reflection-Guided LoRA Framework for Image Reflection Removal

Chaoqun Wang, Yuehuan Wei, Haoxiang Cao, Shaobo Min

2026-07-07视觉感知

这篇工作针对单图去反射中扩散模型“同一强度处理所有图像”的问题:强反射易残留、弱反射易损细节。ReLo-IRR的核心是用轻量反射强度估计器生成图像级先验,并与时间步嵌入联合调制LoRA,使修复强度随反射程度和去噪阶段变化。实验声称在多个挑战基准上优于现有方法并具备更好泛化,但具体增益中模型规模与数据因素仍需进一步拆分验证。

MORE: A Multilingual Document Parsing Benchmark and Evaluation Figure 1
2026-07-07cs.CV

MORE: A Multilingual Document Parsing Benchmark and Evaluation

Long Xu, Binghong Wu, Tinghao Yu, Hao Feng, Zhenyu Huang, Haoqing Jiang, Yunhao Wang, Shuo Huang, Feng Zhang

2026-07-07数据集/基准

这篇论文针对多语种文档解析评测长期偏向英中、难以验证长尾语言能力的问题,提出 MORE 基准:从真实 PDF 构建覆盖 149 种语言、含文本/公式/表格/代码/目录/阅读顺序等结构标注的数据集,并用模型辅助加人工精修保证标注。实验评测多种先进 VLM/OCR 模型,给出长尾语言基线并显示不同语言上赢家分散,说明现有模型的“多语支持”仍需细粒度实证检验。

Pooling-Based Context Modeling for Convolution-Free Deep Image Prior Figure 1
2026-07-07cs.CV

Pooling-Based Context Modeling for Convolution-Free Deep Image Prior

Gihyun Kim, Jong-Seok Lee

2026-07-07视觉感知

针对传统 Deep Image Prior 依赖过参数卷积结构、优化中易拟合噪声的问题,本文提出无卷积的 Pool-DIP,用多尺度局部对比池化在少参数下建模邻域上下文。实验显示其在合成与真实去噪数据上达到有竞争力表现,参数量较近期 DIP 架构减少约 32%,并通过频谱分析说明其可抑制错误高频增长,且可迁移到超分辨率和修复任务。

MatPhaseBench: A Semantics-Guided Benchmark for Materials Phase Diagrams Understanding Figure 1
2026-07-07cs.CV

MatPhaseBench: A Semantics-Guided Benchmark for Materials Phase Diagrams Understanding

Hanwen Wang, Sihan Liang, Zhiwei Liu, Yangang Wang, Wei Yan, Yuqin Liu, Zongguo Wang

Computer Network Information Center, Chinese Academy of Sciences, University of Chinese Academy of Sciences, University of Manchester, Institute of Metal Research, China University of Geosciences

2026-07-07数据集/基准

论文针对现有科学 VLM 基准难以检验材料相图这类高语义密度、需热力学机制推理的复杂图像理解问题,提出 MatPhaseBench:从 3681 篇材料论文中筛选 200 个经人工校验的相图-文本样本,覆盖 189 个材料体系,并通过直接与关联匹配保留更完整语境。对 13 个 VLM 的评测显示,最佳模型 BERTScore Recall 仅 0.407,模型多停留在表层识别,缺乏相边界、相变路径和机理层面的专家推理能力。

CL-Anomaly: Layer-Adaptive Mixture-of-Experts with Multimodal Large Language Model for Continual Learning in Anomaly Detection Figure 1
2026-07-07cs.CV

CL-Anomaly: Layer-Adaptive Mixture-of-Experts with Multimodal Large Language Model for Continual Learning in Anomaly Detection

Wen Dong, Zhao Wang, Shuangqing Zhang, Kai Sun, Ben Li, Guo-Sen Xie, Caifeng Shan, Fang Zhao

2026-07-07视觉语言视觉感知

面向工业与医疗等异常检测任务持续涌现、全量重训成本高且旧数据受限的问题,CL-Anomaly 将 MLLM 的持续学习引入异常检测,用任务私有 PrivLoRA 隔离异质异常知识,同时以层自适应共享专家和动量式知识迁移保留各层关键专家,缓解共享冲突与纯隔离无迁移的矛盾;在类别增量、跨域、跨模态三类场景中均优于现有方法并减轻遗忘。

Modeling the Impact of Visual Brand Language on Attention, Object Recognition, and Memory Retrieval Figure 1
2026-07-07q-bio.NC

Modeling the Impact of Visual Brand Language on Attention, Object Recognition, and Memory Retrieval

Rachel F. Heaton, John E. Hummel

University of Illinois Urbana-Champaign, information explicitly available independent of the other properties of the object [11

2026-07-07视觉感知

本文关注视觉品牌语言是否会占用认知资源、干扰人对物体功能的识别与使用理解。作者将品牌线索显式加入基于 JIM 物体识别与 LISA 类比推理的认知模型,模拟注意分配、功能类别识别和记忆检索过程。结果显示,品牌信息会优先捕获注意并延缓功能识别,且品牌越强影响越大,即使熟悉物体也可能持续造成分心。

VideoSearcher: Empowering Video Deep Research with Multi-Tool Agentic Reasoning via Reinforcement Learning Figure 1
2026-07-07cs.CV

VideoSearcher: Empowering Video Deep Research with Multi-Tool Agentic Reasoning via Reinforcement Learning

Zhenkun Gao, Yicheng Bao, Jinlong Peng, Xueheng Li, Theo Huang, Bangwei Liu, Kunquan Li, Zhenye Gan, Tao Hu, Chengjun Xie, Mingqian Yang, Xuanhua He, Zhizhong Zhang, Xin Tan, Chengjie Wang, Yuan Xie

2026-07-07视觉感知强化学习

该文针对视频问答从封闭视频理解走向开放网页取证时,现有方法难以同时保留时序线索、局部视觉细节与外部检索证据的问题,提出 VideoSearcher:用选帧、定位、放大、网页/图像搜索等工具组成闭环推理轨迹,并以 BiSPO 将答案正确性与工具调用策略分支优化。作者还构建 VideoSearch-QA,实验显示其在 VideoDR、VSQA 及多模态搜索/视频理解基准上优于开源智能体基线。

STAC: Selective Spatiotemporal Aggregation and Compression for Video Reasoning Segmentation Figure 1
2026-07-07cs.CV

STAC: Selective Spatiotemporal Aggregation and Compression for Video Reasoning Segmentation

Syed Ariff Syed Hesham, Yun Liu, Guolei Sun, Jing Yang, Henghui Ding, Xue Geng, Xudong Jiang

2026-07-07视觉感知

STAC针对长视频推理分割中密集时空token导致注意力成本过高、压缩又常在缺乏上下文的编码特征上过早决策的问题,利用SSM线性递归先形成可感知冗余的时空表征,再以解耦的双向空间扫描和因果时间扫描结合层级自适应压缩,并让分割目标反向约束保留策略。文中报告在零样本、可流式设置下减少约85% token、带来1.8倍加速,同时超过无压缩基线。

R3D: Quantitative 3D Spatial Reasoning for Egocentric Wearables Figure 1
2026-07-07cs.CV

R3D: Quantitative 3D Spatial Reasoning for Egocentric Wearables

Maxwell Horton, Wei Lu, Quan Tran, Yury Astashonok, Kirmani Ahmed, Babak Damavandi, Anuj Kumar, Xiao Zhang, Seungwhan Moon

Meta Reality Labs

2026-07-07三维

面向具备 RGB-D 与位姿的可穿戴助手,论文指出现有基准缺少自然第一视角视频中的定量三维问答。作者构建含 57 段 ADT 视频、3033 个距离/体积/比较问题的 R3D-Bench,并提出无需训练的 R3D:用 SAM3/SAM3D 分割并提升到三维场景,再让 LLM 调用空间工具推理。R3D+Qwen3-VL 235B 达到 73.5% 平均相对准确率,高于 CuTR+Tools 的 61.9% 和 Gemini 3 Flash 的 46.5%。

Harmonic-Aware Transformer for Real-Time Catheter Localization in Interventional Procedures of Magnetic Particle Imaging Figure 1
2026-07-07cs.AI

Harmonic-Aware Transformer for Real-Time Catheter Localization in Interventional Procedures of Magnetic Particle Imaging

Abuobaida M. Khair, Wenjing Jiang, Xiaoli Yang, Moritz Wildgruber, Xiaopeng Ma

School of Control Science and Engineering, Shandong University, Jinan 250061, China, Department of Medical Physics, Al-Neelain University, Khartoum, Sudan, Weifang Xinli Superconducting Magnet Technology Co., Ltd, Weifang 261005, China, Department of Radiology, University Hospital, LMU Munich, Munich 81337, Germany, potential of harmonic-aware transformer models as efficient and scalable solutions for, MPI and force control, while Griese et al (2017) localized fiducial markers using center-of-mass, estimation.Herz et al (2018) enabled real-time visualization of labeled guidewires and balloons, and

2026-07-07视觉感知

面向介入式磁粒子成像中导管尖端需低延迟、无辐射定位的问题,论文将任务从图像重建改为由原始MPI电压信号直接回归3D坐标,并通过提取第2–8次驱动场谐波提升信噪比,再用Transformer建模三轴频域时空相关。模拟训练、真实体外数据测试显示其在多种运动下达到亚毫米误差,MAE约0.165–0.655 mm,推理延迟0.55 ms/帧,支持实时跟踪。

See the Emotion: A Facial Emoji Proxy Modeling for EEG Emotion Recognition Figure 1
2026-07-07cs.CV

See the Emotion: A Facial Emoji Proxy Modeling for EEG Emotion Recognition

Jingjing Hu, Guo Dan, Haofan Cheng, Ying Zeng, Zhan Si, Jinxing Zhou, Meng Wang

2026-07-07视觉感知

针对 EEG 情感识别虽准确但难解释的问题,论文将解释从通道/时间点归因转向“行为可视化”,提出把 EEG 翻译为去身份化面部 emoji 的 Facial Emoji Proxy Modeling。其 FMENet 建模与表情相关的空间协同和多尺度时序,FELB 用 emoji 重建约束情感表征。实验称在 EAV、MMER 上达到 EEG-only 最优,并能生成语义一致的动态表情,零样本 SEED 也有一定迁移性。

Learning Taxonomic Trees with Hierarchical Representation Regularization for Large Multimodal Models Figure 1
2026-07-07cs.CV

Learning Taxonomic Trees with Hierarchical Representation Regularization for Large Multimodal Models

Hulingxiao He, Zhi Tan, Yuxin Peng

2026-07-07视觉语言

论文针对大多模态模型微调时只依赖语言建模损失、缺少显式层级分类知识而导致层级视觉识别不一致的问题,提出无需新增可学习参数的 HiR² 正则化:用文本引导从中间表征构建粗到细视觉树,并结合 Lorentz 双曲蕴含损失与角度分散损失同时约束父子关系和相近类别区分。实验显示该方法在 Qwen、InternVL、LLaVA 等模型及 SFT/DFT 设置下,于 iNat21、CUB 等层级数据集上带来一致提升。

Holo-Captioning: Toward the Text Equivalent of 3D Scenes Figure 1
2026-07-07cs.CV

Holo-Captioning: Toward the Text Equivalent of 3D Scenes

Kun-Yu Lin, Chengke Bu, Zhenguo Li, Kai Han

2026-07-07视觉语言三维

现有3D场景描述多停留在粗粒度物体标注,难以支撑机器人导航与操作所需的细致空间理解。论文提出holo-captioning,将三维场景转为含语义、位置、属性和关系的结构化文本,并构建HoloEngine/HoloScan、HoloScore与实例解耦的HoloScribe。结果显示其优于3D dense captioner和3D LLM,在MultiScan零样本检测及移动机器人目标导航中也取得更高表现。

ProLaViT: Learning Progressive Latent Visual Thoughts in Structured Latent Space Figure 1
2026-07-07cs.CV

ProLaViT: Learning Progressive Latent Visual Thoughts in Structured Latent Space

Peiming Li, Yifan Wang, Xiaotian Zhang, Zhiyuan Hu, Shiyu Li, Zheng Wei, Yang Tang

2026-07-07视觉感知

ProLaViT针对多模态大模型在复杂视觉推理中依赖文本CoT易丢失空间细节、显式生成又成本高的问题,提出在结构化连续潜空间中逐步形成“视觉思维”。其核心是用模型自身视觉编码器进行内生自蒸馏,并以程序合成轨迹训练粗到细和辩证推理链,再用距离加权多样性损失抑制潜表示坍缩。实验称其在视觉中心基准上优于基线,兼顾准确率、可解释性和效率,但具体增益来源仍需看完整实验拆解。

PPE-Bench: A Benchmark for Evaluating MLLM Unlearning under Private-Public Entanglement Figure 1
2026-07-07cs.CR

PPE-Bench: A Benchmark for Evaluating MLLM Unlearning under Private-Public Entanglement

Xianren Zhang, Delvin Ce Zhang, Dongwon Lee, Suhang Wang

The Pennsylvania State University, University of Sheffield

2026-07-07数据集/基准

论文关注多模态大模型遗忘中的现实隐私场景:私人目标常与公众人物、地标等公共信息同图纠缠,现有基准难评估“忘私不伤公”。PPE-Bench将待遗忘个体与需保留的公共上下文放入同一图像,并设置遗忘、保留和相邻公共信息评测。实验显示现有遗忘方法虽能降低隐私泄露,却会显著损害相邻公共知识,且公共信息微调后私有知识可能重新出现。

SPLIT: Training-Free AI-Generated and Partially Edited Video Detection via Spatial Patch-Level Incoherence and Temporal Roughness Figure 1
2026-07-07cs.CV

SPLIT: Training-Free AI-Generated and Partially Edited Video Detection via Spatial Patch-Level Incoherence and Temporal Roughness

Jongyeop Hyun, Hyounghun Kim

2026-07-07视觉感知

面向真实平台中“误杀真实视频”代价很高的场景,论文指出AUROC不足以反映超低FPR下的检测能力。SPLIT无需训练,直接在冻结视觉编码器的patch token上度量两步时间粗糙度和局部空间运动不一致性,以保留局部篡改证据。在FakeParts、GenVideo和ViF-Bench上,它在FPR=0.1%等严格阈值下取得最高假视频召回,并对后处理保持稳健。

E-TraMamba: A New Paradigm for Efficient Long-Term 3D Feature Tracking with Event Cameras Figure 1
2026-07-07cs.CV

E-TraMamba: A New Paradigm for Efficient Long-Term 3D Feature Tracking with Event Cameras

Juwei Shen, Yujie Wu, Changwen Chen

Department of Computing, FCMS, The Hong Kong Polytechnic University, at quadratic cost, restricting scalability for high-frequency, dependencies, achieving scalable and stable 3D tracking

2026-07-07视觉感知三维

这篇论文针对事件相机三维特征跟踪中稀疏噪声事件流难以长程建模、Transformer 代价过高的问题,提出首个基于 Mamba 状态空间模型的 E-TraMamba,以线性复杂度融合事件局部补丁、相关图、位置与深度/视差信息,并用轻量仿射预测提升遮挡和模糊下稳定性。作者还构建 EvD-PointOdyssey 数据集;实验显示其在严格 0.1m 阈值下特征寿命超过基线 2 倍,跟踪比例更高、RMSE 更低。

Cancelable Biometric Template Protection Based on Multi-Instance Fusion: A Contralateral Iris Approach Figure 1
2026-07-07cs.CV

Cancelable Biometric Template Protection Based on Multi-Instance Fusion: A Contralateral Iris Approach

Jittarin Chaivong, Nicha Vikromrotjananan, Teekatat Piriyapittaya, Waree Kongprawechnon, Suradej Duangpummet

\IEEEauthorblockA \IEEEauthorrefmark 1 Sirindhorn International Institute of Technology , Thammasat University, Thailand

2026-07-07视觉感知

这篇论文针对虹膜模板一旦泄露难以重置、而现有可撤销方案常依赖外部 token 的风险,提出无 token 的双眼虹膜保护方法:每眼三次注册样本多数投票融合,选取稳定 ROI 后用盐置乱左右虹膜码,再通过异侧 XOR 生成单一受保护模板。其关键洞察是左右虹膜统计独立,可同时提高攻击门槛和匹配鲁棒性;在多个 CASIA 数据集上 EER 为 0.36% 至 10.80%,整体优于未保护基线,但跨设备场景仍明显退化。

Prior Bias in Vision Language Models on UML Diagram Interpretation Figure 1
2026-07-07cs.CV

Prior Bias in Vision Language Models on UML Diagram Interpretation

Zaiyu Cheng, Khai-Nguyen Nguyen, Antonio Mastropaolo

is available at https://anonymous.4open., opaque labels, separating knowledge priors from, VLMs can read UML labels but report uneven re-

2026-07-07视觉感知

这篇论文关注 VLM 在软件工程图形理解中是否真正读取 UML 箭头,而非依赖类名常识先验。作者构造了成对的受控 UML 基准,仅翻转关系箭头并保持名称与布局不变,以隔离视觉证据和知识先验。结果显示,开源模型在箭头反转后关系方向准确率平均下降 33.48%,三类图下降 45.28%;GPT-5.4 系列虽缓解两类场景错误,但在更复杂图中仍有明显先验覆盖视觉的问题。

Differential Amplifier-Inspired AmpAttention for Multi-View Robotic Manipulation Figure 1
2026-07-07cs.RO

Differential Amplifier-Inspired AmpAttention for Multi-View Robotic Manipulation

Jin Yang, Ping Wei, Nanning Zheng

National Key Laboratory of Human-Machine Hybrid

2026-07-07机器人

多视角机器人操作虽高效,但视图冗余、遮挡和视角依赖会造成注意力漂移。论文借鉴差分放大器提出 AmpAttention,用差分/共模建模与 CMRR 损失抑制噪声,并在 RVAF 中分别做视内与视间融合,RVAF++进一步接入 SAM2 视觉先验。结果显示其在 18 个 RLBench 任务上平均成功率优于既有方法且训练时间减少约 33.3%,高精度插桩任务达 91%,并展示了少量真实示教下的泛化与鲁棒性。

CLEAR: Closed-Loop Reinforcement Learning at Scale for End-to-End Autonomous Driving Figure 1
2026-07-07cs.RO

CLEAR: Closed-Loop Reinforcement Learning at Scale for End-to-End Autonomous Driving

Yunxiao Shi, Hong Cai, Mohammad Ghavamzadeh, Fatih Porikli

2026-07-07强化学习

CLEAR针对端到端自动驾驶中模仿学习“开环训练、闭环部署”带来的分布偏移,提出在预训练VLA航点先验周围学习残差航点策略,并用PPO进行闭环强化学习微调;同时将CARLA仿真与VLA学习器部署在异构计算组以扩大并行环境规模。论文报告其在CARLA longest6 v2、Bench2Drive及nuScenes上取得领先或有竞争力结果,增益可能部分来自大规模闭环采样与训练规模。

Vision Token Manipulation Attacks on Cloud-Edge Inference of Large Vision-Language Models Figure 1
2026-07-07cs.CR

Vision Token Manipulation Attacks on Cloud-Edge Inference of Large Vision-Language Models

Zikai Zhang, Rui Hu, Olivera Kotevska, Jiahao Xu

2026-07-07机器人视觉语言视觉感知

论文关注云边协同部署大视觉语言模型时,视觉 token 需经通信链路上传云端所暴露的中间表示攻击面。作者提出黑盒中间人场景下的 VTM-Attack,比较置换、掩码、高斯扰动、符号翻转,并用自注意力破坏与范数正则选择脆弱 token。实验覆盖 6 个 3B–72B 模型和 4 类基准,显示仅操纵 10% 视觉 token 即可使准确率最高下降 88.31%,提示机器人等边缘视觉感知系统需保护 token 传输链路。

Conversational Human Audio-visual Talking Dialogue Generation Figure 1
2026-07-07cs.CV

Conversational Human Audio-visual Talking Dialogue Generation

Junhao Song, Lluis Guasch, Xilin He, Zhongyu Yang, Yingfang Yuan, Weicheng Xie, Linlin Shen, Haijun Lin, Shizhe Liu, Wei Pang, Siyang Song

2026-07-07视觉感知

针对真实双人音视频对话数据采集成本高、隐私伦理敏感且多样性不足的问题,本文提出 DIADG 任务与 CHAT 框架,从单一文本提示生成成对语音、人脸身份与相互响应的表情行为,并通过音频与面部交互细化提升同步和互动性。实验显示其在客观指标和用户研究中优于相关 talking-face/反应生成方法,合成的 CHAT-AVD-50k 还可预训练下游交互头部生成模型并提升 REACT 2024 表现。

Track the Noise, Move the World:3D-Grounded Motion-Consistent Noise for Controllable Video Generation Figure 1
2026-07-07cs.CV

Track the Noise, Move the World:3D-Grounded Motion-Consistent Noise for Controllable Video Generation

Long Vu, Tan Ngo, Animesh Karnewar, Amir Habibian, Binh-Son Hua, Hung Bui, Minh Hoai Nguyen, Phong Nguyen-Ha

2026-07-07视觉感知强化学习规划控制三维

该文针对视频扩散模型难以同时精确控制物体运动与相机运动的问题,提出 UniCaMo:不在生成中后期加控制分支,而是直接构造带三维约束的初始噪声,用稀疏 3D 点轨迹局部扭曲物体噪声,并用球面噪声为相机运动中新显露区域提供一致采样。方法无需改动主干,仅配合轻量 LoRA,在 MoveBench 等基准上提升运动可控性与视频质量。

Biomechanics-aware Multi-view Markerless Motion Capture of Dexterous Hand Movements Figure 1
2026-07-07cs.CV

Biomechanics-aware Multi-view Markerless Motion Capture of Dexterous Hand Movements

Pouyan Firouzabadi, J.D. Peiffer, Kunal Shah, Anton Sobinov, Lee E. Miller, R. James Cotton, Wendy M. Murray

end method suggests that it is more effective in utilizing the available, vision and pose estimation to algorithmically label anatomical, “This work was supported by Northwestern University (NIH R01, NS131953), the Restore Center P2C (NIH P2CHD101913), and the Research, Accelerator Program of the Shirley Ryan AbilityLab”., Biomedical Engineering Department, Northwestern University, Chicago, Shirley Ryan AbilityLab, Chicago, IL, US, Department of Organismal Biology and Anatomy, University of Chicago, Department of Physical Medicine and Rehabilitation, Northwestern, University, Evanston, IL., [3], [4], [5], [6], [7]. MMC uses these digital labels, referred to, landmarks of interest can be labeled inconsistently across

2026-07-07强化学习

该文针对无标记运动捕捉在灵巧手部动作中易受关键点误检、遮挡和解剖约束不一致影响的问题,比较端到端生物力学模型优化与传统“2D关键点三角化后逆运动学”流程。核心洞察是将模型缩放、姿态和运动轨迹放入同一可微优化环节,可更充分利用多视角2D信息。实验在6名受试者、121段含手势与物体操作的视频上显示,该方法全部收敛,而两阶段法约15%失败,并产生更合理、抗遮挡更强的手部运动学结果。

Pretreatment MRI reveals a latent, molecular-subtype-independent structural phenotype that organizes treatment trajectories and recurrence risk Figure 1
2026-07-07eess.IV

Pretreatment MRI reveals a latent, molecular-subtype-independent structural phenotype that organizes treatment trajectories and recurrence risk

Dattatreya Kantha, Murray H. Loew

Affiliation: ¹ Medical Imaging & Image Analysis Laboratory, Department of Biomedical Engineering, George Washington, University, Science and Engineering Hall, 800 22nd St., NW, Suite 5000, Washington, DC 20052, USA, size-adjusted ρ = −0.262), a volumetric deception invisible to endpoint labels. External analyses in UCSF, I-SPY1, commensurability assessment showed why feature-name matching is insufficient: the same label can fail, transport, different structural histories into the same favourable label: one tumour may enter therapy with organised, low-, structure organising how tumours move through treatment, independent of any outcome label. Discovering that, invisible to endpoint labels. (6) We test, across three external cohorts — UCSF, I-SPY1, and Duke — where the, all modelling decisions were finalized. No outcome labels were used during manifold construction.

2026-07-07生成模型安全鲁棒

论文针对乳腺癌新辅助治疗中“肿瘤缩小不等于结构性好转”的问题,提出用治疗前 DCE-MRI 构建无结局监督的纵向影像流形,挖掘独立于分子分型的结构表型。核心发现是基线结构熵能恢复临床与基因组变量无法解释的主要响应轴,并在治疗中保持稳定;外部队列显示其与复发风险有关,但跨队列有效性依赖特征表示是否可比。

Signal from Space: Detecting Schools and Towers to Bridge the Digital Divide Figure 1
2026-07-07cs.CV

Signal from Space: Detecting Schools and Towers to Bridge the Digital Divide

Zakarya Elmimouni, Sandor Farkas, Fares Fourati, Vladimir Daigele, Walid Mathlouthi, Mohamed-Slim Alouini

2026-07-07视觉感知

面向发展中地区学校联网规划中学校位置和通信基础设施数据稀缺、噪声大的问题,本文用高分辨率卫星图像和迁移学习同时检测学校与蜂窝塔,并结合 ITU CPP 的地形感知视距分析评估可连接性。在莱索托实验中,微调后的学校检测器 mAP@50 达 0.913、召回率 0.951,明显优于零样本模型,可用于区分潜在可连接与难连接学校。

Provable Pruning for Efficient 3D Gaussian Splatting via Coresets Figure 1
2026-07-07cs.CV

Provable Pruning for Efficient 3D Gaussian Splatting via Coresets

Waseem Mousa, Alaa Maalouf

Department of Computer Science, University of Haifa

2026-07-07三维

针对3D Gaussian Splatting 场景动辄包含数百万高斯、现有剪枝多依赖启发式和后续微调的问题,论文从 coreset 角度给出一个关键界限:无限制查询下不存在非平凡乘法保证,但在给定渲染分辨率或代表视角集合时,可按敏感度采样构造带权子集,并在稳定透射等假设下转化为渲染保证。实验显示该方法在无微调或极短微调、尤其高压缩率场景下优于常见剪枝启发式。

GRCD: Grounded Region Change Detection for Multi-Finding Chest X-Ray Pairs Figure 1
2026-07-07cs.CV

GRCD: Grounded Region Change Detection for Multi-Finding Chest X-Ray Pairs

OFM Riaz Rahman Aranya, Peyman Najafirad, Kevin Desai

2026-07-07视觉感知

针对胸片随访报告需同时判断多处病灶的变化方向并定位区域、而既有方法常缺少时序或空间 grounding 的问题,GRCD清洗Chest ImaGenome/MIMIC-CXR时间配对数据,并用区域级变化token结合空间前缀与门控交叉注意力生成多发现报告。结果显示其在BLEU-4、CheXbert F1、RadGraph F1及变化检测上优于TRACE等基线,但收益也部分依赖严格数据清洗。

Diagnosing Aerial-View Object Detectors with Foundational Image Generative Models Figure 1
2026-07-07cs.CV

Diagnosing Aerial-View Object Detectors with Foundational Image Generative Models

Stanislav Panev, Minhyek Jeon, Vaishnavi Khindkar, Ahish Deshpande, Celso M de Melo, Shuowen Hu, Shayok Chakraborty, Fernando De la Torre

2026-07-07视觉感知生成模型

这篇论文针对航拍车辆检测中真实数据场景偏斜、弱点难以被总体指标暴露的问题,提出用基础图像生成模型构造可控的合成诊断集,通过文本生成、属性编辑与多模态属性校验隔离场景、季节、天气等因素。实验显示,合成集上的分场景性能趋势能对应真实数据中的失效模式,并据此补充少量弱类真实样本,最高带来约13% AP50提升。

Global Pose Control for Generative View Synthesis in Normalized Object Coordinate Space Figure 1
2026-07-07cs.CV

Global Pose Control for Generative View Synthesis in Normalized Object Coordinate Space

Zhibing Li, Amogh Gupta, Behnoosh Parsa, Dan Casas

2026-07-07生成模型规划控制三维

这篇论文针对新视角生成难以按物体全局坐标精确控制相机姿态的问题,将任务改写为基于图像编辑模型的 NOCS 绝对位姿条件生成:用 Plücker raymap 相机 token、区域注意力和文本定义的规范朝向共同消解坐标歧义。实验显示,该方法可从单张或少量无位姿图像生成朝向一致、细节质量较高的新视角,并优于相对位姿或三维生成基线。

RayTun3R: Online Camera Adaptation in 3D Foundation Models Figure 1
2026-07-07cs.CV

RayTun3R: Online Camera Adaptation in 3D Foundation Models

Daniil Sinitsyn, Nikita Araslanov, Daniel Cremers

Munich Center for Machine Learning, University of Oxford

2026-07-07三维

本文针对 DUSt3R、VGGT、Depth Anything 3 等三维基础模型在鱼眼相机上因针孔相机位置编码偏置而深度和位姿退化的问题,提出 RayTun3R:冻结主干,仅在线学习与 token 位置和相机射线相关的轻量 PE/RoPE 残差,并配合无参数的网格与分块校正。其只需约 1.08 万参数、短序列自监督适配,推理几乎无额外开销,在多种 110°–200° 鱼眼数据上将旋转误差相对未适配模型降低约 2–12 倍,并优于 LoRA、CalTok 等基线。

When Does Resolution Help a Frozen Backbone? Global Attention at Resolution Predicts Scalable Adaptation for Camouflaged and Marine Animal Segmentation Figure 1
2026-07-07cs.CV

When Does Resolution Help a Frozen Backbone? Global Attention at Resolution Predicts Scalable Adaptation for Camouflaged and Marine Animal Segmentation

Tyler Rust, Chandra Kambhamettu

University of Delaware, University of South Florida

2026-07-07视觉感知

本文关注冻结视觉基础模型在伪装与海洋动物细粒度分割中何时能从更高输入分辨率获益。核心洞察是,低秩适配能否随分辨率扩展,主要取决于骨干是否在高分辨率 token 上执行全局注意力,而非模型规模或预训练来源;SALT 固定管线下,各向同性 ViT 持续提升,层级骨干约在 512px 饱和,并在 MAS3K 等海洋分割基准取得新的最优结果。

VLRC: Vision-Language Reprojection Consistency as a scalable signal for better feed-forward 3D pretraining Figure 1
2026-07-07cs.CV

VLRC: Vision-Language Reprojection Consistency as a scalable signal for better feed-forward 3D pretraining

Marwane Hariat, David Filliat, Antoine Manzanera

2026-07-07视觉语言视觉感知三维

本文针对前馈3D预训练依赖昂贵几何标注或易受光照、纹理影响的光度自监督这一瓶颈,提出VLRC:用冻结视觉语言模型的密集特征做跨视角重投影一致性约束,把语义不一致转化为可扩展训练信号。该目标无需额外3D标注,可接入SS3D及VGGT/SelfEvo式无标注适配,在室内外基准上提升深度、相机估计和重建精度,并改善零样本开放词汇3D语义分割。

Aircraft Detection in Satellite Imagery using Deep Learning Object Detectors Figure 1
2026-07-07cs.CV

Aircraft Detection in Satellite Imagery using Deep Learning Object Detectors

Mujahir Hussain Abbasi (Department of Information Technology Maulana Abul Kalam Azad University of Technology, Kolkata, West Bengal, India), S. Beghin (Bose School of Computational and Physical Sciences Kristu Jayanti, Bengaluru, Karnataka), A. T. R. Krishna Priya (AB Technologies Nagercoil, Kanyakumari, Tamil Nadu, P. Jamuna (Department of Electrical and Electronics Engineering Nandha Engineering College, Erode, G. Anandhakumari (Department of Physics Erode Sengunthar Engineering College, Perundurai, S. Jaanaa Rubavathy (Department of Electrical and Electronics Engineering Saveetha School of Engineering, Saveetha University, Chennai

Department of Information Technology, Maulana Abul Kalam Azad University of, School of Computational and Physical, Kristu Jayanti (Deemed to be University), Department of Electrical and Electronics, Nandha Engineering College, Department of Physics, Erode Sengunthar Engineering College, Saveetha School of Engineering, Saveetha, Institute of Medical and Technical Sciences, Saveetha University

2026-07-07视觉感知

面向卫星图像中飞机目标小、背景复杂、光照和噪声变化大的检测难题,论文将 Gabor 滤波增强、归一化预处理与 YOLOv11 检测器串联,用以突出机翼/机身纹理并提升鲁棒性。在 Aircraft Detection 数据集上报告 mAP@50 为95%、Precision 97%、Recall 85%、F1 91%,高于列举的 YOLOv5/YOLOv7 Tiny;但数据集规模较小,YOLOv11改动细节和增益来源未充分说明。

Property-Constrained 3D Porous Media Reconstruction from 2D Images via Conditional Generative Adversarial Networks Figure 1
2026-07-07cs.CV

Property-Constrained 3D Porous Media Reconstruction from 2D Images via Conditional Generative Adversarial Networks

Ali Sadeghkhani, Brandon Bennett, Arash Rabbani

School of Computer Science, University of Leeds, Leeds, UK

2026-07-07视觉感知生成模型三维

针对微 CT 等三维孔隙成像成本高、样本少,而二维薄片难以直接约束三维孔网的问题,本文提出仅用二维图像训练的属性条件 cGAN:3D 生成器按目标孔隙度生成体数据,2D 判别器通过多轴切片学习结构一致性,并用 U-Net 提取孔隙度标签。在两类碳酸盐样本上,模型能复现硬石膏夹杂和细晶纹理,孔隙度控制达到 R²=0.93,MAE 为 0.019/0.010。

An Automated Multimodal Glaucoma Detection Framework Using ViT and a Stacking-Based Ensemble Figure 1
2026-07-07cs.CV

An Automated Multimodal Glaucoma Detection Framework Using ViT and a Stacking-Based Ensemble

Ishrat Jahan, Muhammad E.H Chowdhury, Murugappan Murugappan, Kanchon Kanti Podder, Tawsifur Rahman, Shrestha Datta, Md Sakib Abrar Hossain, Md Mosarrof Hossen, Yosra Magdi Salih Mekki, Sanjiban Sekhar Roy

Department of Computer Science and Engineering, Shahjalal University of Science and Technology, Department of Electrical Engineering, Qatar University, Doha, Qatar, Department of Electronics and Communication Engineering, Kuwait College of Science and, Department of Interdisciplinary Engineering, Kennesaw State University, United States, Department of Biomedical Engineering, School of Medicine, Johns Hopkins University, United, Department of Bioinformatics University of Regina, Canada, Department of Biomedical Engineering, University of Oxford, United Kingdom, Department of Computer Science and Engineering, Vellore Institute of Technology, India, interpretation, limiting their scalability for large-scale screening. In this study, glaucoma detection is, employed to optimize performance. Experiments conducted on the publicly available PAPILA dataset

2026-07-07视觉语言视觉感知

青光眼早筛依赖专家判读且难以规模化,本文将眼底图像与临床指标联合建模:用 ViT 提取视觉特征,再以传统分类器和三模型 stacking 集成完成样本级与患者级诊断。PAPILA 上多模态样本级准确率 97.47%、F1 97.50%,患者级准确率与 F1 均为 98.97%,并实现网页端筛查系统;但相对单模态的具体增益来源仍需结合消融细节判断。

S-EMBER: A Large-Scale Benchmark for Streaming Egocentric Memory Retrieval Figure 1
2026-07-07cs.CV

S-EMBER: A Large-Scale Benchmark for Streaming Egocentric Memory Retrieval

Xiaodong Wang, Xuanyi Zhao, Pedro Rodriguez, Devendra Singh Sachan, Barlas Oguz, Seungwhan Moon, Shang-Wen Li, Gargi Ghosh, Xin Dong, Wen-Tau Yih

2026-07-07数据集/基准

面向智能眼镜等可穿戴设备中的长期第一视角记忆检索,S-EMBER将传统离线VideoQA改为流式、因果触发的情景记忆评测,提供388小时真实眼镜视频、9448个带人工时间证据的问答及多粒度答案。实验显示,大模型语义回答随规模提升,但时间定位几乎不随参数、分辨率或帧密度改善,并随记忆间隔拉长明显衰减,揭示当前多模态模型的时间索引瓶颈。

K9-Bench: Evaluating Multimodal LLMs on Canine-Centric Videos Figure 1
2026-07-07cs.CV

K9-Bench: Evaluating Multimodal LLMs on Canine-Centric Videos

Khush Attarde, Yusuf Ali, Megha Thukral, Divye Bhutani, Thomas Ploetz, Zsolt Kira

Ogmen Robotics Inc., Massachusetts, USA, Georgia Institute of Technology, Atlanta, USA, in MLLMs. To create this dataset, we propose a scalable, VLM/LLM-powered, links to the dataset and evaluation suite, is available here., evaluations remain predominantly human-centric, with tasks and data centered on human actions, beyond short, isolated clips or single-label classification toward fine-grained, multi-hop reasoning, • We present a scalable dataset generation pipeline that leverages VLMs and LLMs to auto-

2026-07-07视觉语言视觉感知

面向家庭机器人、宠物安全与伴侣系统,论文指出现有视频多模态评测过于以人为中心,难以衡量模型对犬类姿态、互动和长时序行为的理解。K9-Bench用907段真实犬类视频构建4744个跨5类任务的问答,并提出VLM/LLM自动挖掘、生成与去偏流程。实验显示闭源模型优于开源模型,但前沿MLLM仍难以处理细微姿态线索和长程组合推理,通用CoT增益有限。

EmoteGPT: 3D Human Facial Expressions from Natural Language Descriptions Figure 1
2026-07-07cs.CV

EmoteGPT: 3D Human Facial Expressions from Natural Language Descriptions

Haoran Wang, Mohit Mendiratta, Christian Theobalt, Adam Kortylewski

2026-07-07三维

论文瞄准文本控制三维表情时身份、纹理与表情纠缠、细粒度语言缺少对应3D参数的问题,将生成改写为3DMM表情空间中的回归任务。其核心是构建含显式面部细节与隐式情境描述的Txt2Emote数据集,并用带<Expr>标记的MLLM解码表情参数;结果显示在情绪识别和主观表现力上优于CLIP/扩散基线,但增益可能主要来自数据与多模态监督。

EVA-Client: A Unified Data Collection, Inference, and Deployment Framework for Embodied Policies on Real Robots Figure 1
2026-07-07cs.RO

EVA-Client: A Unified Data Collection, Inference, and Deployment Framework for Embodied Policies on Real Robots

Heqing Yang, Yang Yi, Liyao Wang, Linqing Zhong, Donglin Yang, Ruipu Wu, Zitong Bai, Fengjiao Chen, Manyuan Zhang, Linjiang Huang, Si Liu

CoLab, Beihang University

2026-07-07机器人

论文针对具身策略训练框架逐渐成熟、但真实机器人部署仍依赖零散脚本的问题,提出 EVA-Client 作为模型无关的客户端层,把机器人接入、实时推理调度、调试、数据采集与物理评测统一起来。其核心在于解耦信号源、机器人后端和传输中间件,并将同步/异步执行、时间集成和 Real-Time Chunking 放到同一配置接口下比较;结果显示它可支持多种机械臂与工作流,使每次评测同时产出可回流训练的数据,但文中更像系统报告,量化性能增益与来源未充分说明。

BiSLW: Bi-Spectral Latent Watermarking for Generative Diffusion Models Figure 1
2026-07-07cs.CV

BiSLW: Bi-Spectral Latent Watermarking for Generative Diffusion Models

Aryan Pandit

2026-07-07生成模型

本文针对扩散生成图像难以溯源、现有像素域或单一潜空间水印易被再生成和失真削弱的问题,提出 BiSLW:将扩散 latent 按低频语义与高频纹理分解,在双频带中用学习式编码器嵌入同一身份水印,并用跨频带一致性约束和双解码器恢复。实验称其相比既有 latent 水印方法 PSNR 提升超过 3 dB,在再生成、压缩和几何扰动下仍保持接近完美比特准确率,且额外开销很小。

CLABTOOLKIT: An Open-Source Toolkit for Routine Processing, Manipulation, and Visualization of Neuroimaging Data Figure 1
2026-07-07cs.CV

CLABTOOLKIT: An Open-Source Toolkit for Routine Processing, Manipulation, and Visualization of Neuroimaging Data

Yasser Alemán-Gómez, Nino Hervé, Patric Hagmann

Connectomics Lab, Department of Radiology, Lausanne University Hospital (CHUV), Lausanne, Switzerland, University of Lausanne (UNIL), Lausanne, Switzerland

2026-07-07机器人

本文针对神经影像流程中体数据、皮层表面、纤维束和连接矩阵被不同工具割裂、重复胶水代码多且易出错的问题,提出 CLABTOOLKIT,将分区、表面、注释分区、纤维束和连接组封装为可互操作 Python 对象,并整合 BIDS、FreeSurfer、扩散 MRI、形态测量和 GPU 可视化等模块。主要结果是形成含 19 个模块、13 个类、234 个方法和 207 个函数的开源工具包,可跨 NIfTI、GIFTI、TCK/TRK 等格式完成常规处理与导出;论文侧重软件架构与用例,未充分说明相对现有工具的定量效率或可靠性增益。

Federated Learning for Object Detection: Enabling Collaborative Drone Learning Without Centralizing Data Figure 1
2026-07-07cs.LG

Federated Learning for Object Detection: Enabling Collaborative Drone Learning Without Centralizing Data

Daniel M. Jimenez-Gutierrez, Enrique Zuazua, Georgios Kellaris, Joaquin del Rio, Oleksii Sliusarenko, Xabi Uribe-Etxebarria

2026-07-07视觉感知

本文面向无人机视觉中原始航拍数据难以集中汇聚的隐私、带宽与治理约束,评估用联邦学习训练目标检测器是否能替代集中式多机训练。其核心不是提出新检测器,而是在 KIIT-MiTA 的非 IID 四节点设置下比较单机、集中式与联邦 YOLO nano 模型。结果显示联邦训练接近集中式,并较单机显著提升,最佳 YOLO26 nano 在 mAP@0.50 和 mAP@0.50:0.95 上相对增益为 52.89% 和 67.80%,但增益可能主要来自跨节点数据规模与多样性。

SE-UNet: Singular Equivariant Imaging for Real-World Constrained Generation Figure 1
2026-07-07cs.CV

SE-UNet: Singular Equivariant Imaging for Real-World Constrained Generation

Kanishk Awadhiya

2026-07-07强化学习

本文针对扩散模型在真实逆问题中依赖大规模训练数据、难以满足物理约束的问题,提出 SE-UNet,将生成过程改写为零样本优化,并在 U-Net 中加入奇异值门控与 D4 旋转/翻转等变自监督,以抑制噪声过拟合并增强几何一致性。在 CIFAR-10 80% 缺失像素修复中,方法达到 25.34 dB PSNR、0.82 SSIM,较 DIP 高约 4 dB,但验证主要限于小规模图像修复,泛化到更复杂真实场景文中未充分说明。

Fusion: A Framework for Unified Sequential Token AdaptatIon in VisiOn TraNsformers Figure 1
2026-07-07cs.CV

Fusion: A Framework for Unified Sequential Token AdaptatIon in VisiOn TraNsformers

Aravind Pradeep, Samira Nazari, Mahdi Taheri, Christian Herglotz

Brandenburg University of Technology Cottbus-Senftenberg, Germany, University of Zanjan, Iran, Humboldt University, Berlin, Germany, Tallinn University of Technology, Tallinn, Estonia

2026-07-07视觉感知

这篇论文针对 ViT 对所有图像 token 近乎等量计算、而简单叠加剪枝/合并/早退会相互干扰的问题,提出按“先合并、再判断早退、最后对继续样本剪枝”的 Fusion 顺序框架,并用轻量路由器按输入调节合并强度、推理时切换精度-延迟档位。实验称其在 ImageNet-1k 等数据集上以 DeiT-S/ViT-Tiny 达到或优于同类自适应方法,校准误差最高降约 4 倍、能耗降 48%。

Privacy-Preserving Industrial Ergonomics: mmWave-Based Automated REBA Scoring and Pose Estimation Figure 1
2026-07-07cs.CV

Privacy-Preserving Industrial Ergonomics: mmWave-Based Automated REBA Scoring and Pose Estimation

Xuhan Zhang, Zhuangzhuang Dai, Luis J. Mans, Victor Chang

2026-07-07三维

这篇论文面向工业场景中人工 REBA 评估成本高、视觉方案有隐私与遮挡光照问题的痛点,提出用毫米波雷达点云端到端估计 3D 骨架并回归 REBA 风险分数。核心思路是将姿态重建作为可解释的生物力学中间层,并用关节约束、时间平滑和高风险样本过采样缓解雷达点云稀疏与类别不均衡。MMFi 实验中分类准确率为 77.78%,推理延迟 5.70 ms,高风险 REBA MAE 达 0.93,优于直接回归和两阶段管线;但评估数据和真实工业动作覆盖仍有限。

Latent Visual Cache for Video Reasoning Figure 1
2026-07-07cs.CV

Latent Visual Cache for Video Reasoning

Yongheng Zhang, Zhipeng Xu, Hao Wu, Yinghui Li, Di Yin, Xing Sun, Philip S. Yu

Tencent Youtu Lab, Tsinghua University, University of Illinois at Chicago

2026-07-07视觉感知

本文针对视频大模型在长链生成中逐渐脱离视觉证据的 Visual Anchoring Decay 问题,提出在解码器内加入 Latent Video Cache,用潜在缓存持续保存关键时空语义,并通过对比式缓存对齐与视觉约束 GRPO 训练。基于 Qwen3.5-9B 的实验显示,其在六个视频理解与推理基准上优于 CoT 和 SFT+GRPO,尤其长视频与强 grounding 任务提升更明显,且回答更短。

DynaWM: A Base-VLA-Guided World Foundation Model for Moving-Object Manipulation Figure 1
2026-07-07cs.CV

DynaWM: A Base-VLA-Guided World Foundation Model for Moving-Object Manipulation

Chongkei Chang, Zhidong Deng

2026-07-07机器人强化学习

本文针对现有 VLA 多面向静态目标、难以在不破坏预训练能力的情况下处理独立运动物体的问题,提出冻结基座 VLA、以其动作 chunk 作为语义条件,再结合多视角历史和本体状态由流匹配 DiT 重生成拦截轨迹的 DynaWM。其洞察是不同 VLA 的输出动作共享物理含义,可作为跨模型世界模型接口;在 DynaGrasp-32 上对 8 类基座检查点均提升成功率,细调模型增益 1.88%–45.31%,粗调模型增益 26.13%–44.06%。

CV-DCLR: Causal-Visual Dynamic Label Refinement for Robust Zero-Shot Learning Figure 1
2026-07-07cs.CV

CV-DCLR: Causal-Visual Dynamic Label Refinement for Robust Zero-Shot Learning

Can Wang, Jiangnan Li, Mingyu Li, Yining Song, Kangrui Ren, Min Gan, Jinfu Fan

School of Computer Science and Technology, Qingdao University, School of Software Engineering, Tongji University, School of Computer Science and Technology, Qingdao University Qingdao China, School of Software Engineering, Tongji University Shanghai China

2026-07-07安全鲁棒

本文针对零样本学习中视觉相似类别导致的语义纠缠问题,指出单纯最大化视觉—语义相关性会放大狼/哈士奇等混淆类的伪相关。CV-DCLR用视觉似然流找候选,再以反事实遮蔽原型估计结构必要性,并通过自适应门控融合两路信号。实验在CUB、SUN、AWA2及语义纠缠注入设置下显示,其在高歧义场景较现有方法更稳健,但具体增益是否依赖构造的干扰协议仍需结合完整实验细节判断。

Evaluating Agentic Harness Systems for Autonomous Computational Pathology Figure 1
2026-07-07cs.CV

Evaluating Agentic Harness Systems for Autonomous Computational Pathology

Jie Lin, Zongyi Chen, Qiaoling Zheng, Liuyi Wang, Hengyi Jiang, Jiabao Chen, Xiang Liu, Yinghong Yang, Liansheng Wang

2026-07-07视觉感知

本文针对计算病理中“报告看似完整但流程证据不足”的评估缺口,提出 ACP-Bench,将病理任务拆解为可审计的规划、工具执行、诊断结果、证据绑定与临床边界对齐。其评测 41 个任务、9 个模型和 3 类 harness 共 369 条轨迹,发现系统已能较好启动任务和生成诊断文本,但工具执行、结果绑定和反思修正薄弱,仅 10 条达到形式化通过阈值,临床过度声称与证据不足仍常见。

CIPHER: Causal Intervention Pathways for Healthcare Equity and Robustness Figure 1
2026-07-07cs.CV

CIPHER: Causal Intervention Pathways for Healthcare Equity and Robustness

Xinyu Jia, Weidong Guo, Wangyuan Zhao, Yi Guo, Zeju Li, Yuanyuan Wang

2026-07-07安全鲁棒

医疗影像模型常在性别、种族等敏感亚群上出现公平性与分布外鲁棒性缺口。CIPHER 的核心是用结构因果模型把敏感属性影响图像的机制拆成四条路径,并用带 classifier-free guidance 与 null-text inversion 的扩散生成进行全路径干预和反事实增强。在胸片与皮肤镜任务中,相比疾病条件合成基线,最差群体差距平均降低 35.8%,同时提升总体诊断准确率。

An automated method of identifying incorrectly labelled images based on the sequences of loss functions of deep learning networks Figure 1
2026-07-07cs.CV

An automated method of identifying incorrectly labelled images based on the sequences of loss functions of deep learning networks

Zhipeng Zhang, Wenhui Shou, Wengting Ma, Dongjia Xing, Qingqing Xu, Li-Qun Xu, Qingxia Fan, Ling Xu

An automated method of identifying incorrectly labelled, China Mobile Research Institute, Beijing 100032, China, tasks. Since the labelled medical images are the foundation of the training, vali-, dation, and test of deep learning classification models, the quality of labelling, estimated that up to ten percent of manually labelled medical images may be in-, correctly labelled. In this paper, by utilizing the sequences of loss functions of, tomated method of identifying incorrectly labelled medical images was pro-, posed. For those identified images, their labels could be further reviewed and, of labelled medical image datasets, as well as the performance of the deep, accurately identify the incorrectly labelled samples from the whole labelled da-, gold-standard labels (5394 non- referable diabetic retinopathy samples and, referable diabetic retinopathy samples), the labels of a small part (6%

2026-07-07视觉感知

针对医学图像人工标注中常见的漏判、边界模糊和主观差异问题,论文提出利用样本在多轮训练中的损失函数序列来刻画异常标注:错标样本往往不呈现正常下降趋势,再用特征提取与聚类筛出待复核图像。在糖尿病视网膜病变眼底数据上,方法找回75.31%的人工翻转错标,仅误报4.85%正确样本;复核9.1%数据后,模型准确率由95.93%升至96.50%,接近无错标训练的96.57%。

Token-level Response-visual Attention Guidance for Multimodal LLMs Knowledge Distillation Figure 1
2026-07-07cs.CV

Token-level Response-visual Attention Guidance for Multimodal LLMs Knowledge Distillation

Jaehyun Jang, Eunseop Yoon, Hee Suk Yoon, SooHwan Eom, Mark A. Hasegawa-Johnson, Chang D. Yoo

2026-07-07视觉语言

这篇论文针对多模态大模型压缩中仅蒸馏输出分布难以传递视觉 grounding 的问题,指出真正与下游性能相关的是生成阶段的 response-to-vision 注意力,而非以往常用的 prompt-to-vision 注意力。作者提出 TRAG,按响应 token 提取师生视觉注意力,并依据教师注意力熵自适应混合正反向 KL,使不同 token 分别偏向覆盖或精确聚焦。多基准实验显示其较既有蒸馏方法取得更好性能和注意力一致性。

H-OPD: Confidence Aware Heterogeneous Multi-Teacher Multimodal On-policy Distillation Figure 1
2026-07-07cs.CV

H-OPD: Confidence Aware Heterogeneous Multi-Teacher Multimodal On-policy Distillation

Qixiang Yin, Huanjin Yao, Yuchen Cai, Jianghao Chen, Ziyi Wang, Min Yang, Fei Su, Zhicheng Zhao

Beijing University of Posts and Telecommunications, Beijing Key Laboratory of Network System and Network Culture, Key Laboratory of Interactive Technology and Experience System, Ministry of Culture and Tourism, Zhongguancun Academy, Beijing, China

2026-07-07视觉语言强化学习

针对多模态推理中现有 OPD 按任务或样本静态选择单一教师、难以同时覆盖视觉定位与抽象推理的问题,H-OPD 将异构视觉语言教师和纯文本教师放到同一学生轨迹上,并通过图像转文本描述与基于预测熵的 token 级置信仲裁动态分配监督。实验覆盖 11 个多模态推理基准,显示其相较标准 OPD 和 GRPO 取得更高准确率与更好 token 效率,消融与可视化也支持两类教师存在互补分工。

CPR: Chained Perceptual Refinement for Coarse-to-Fine Medical Image Classification Figure 1
2026-07-07cs.CV

CPR: Chained Perceptual Refinement for Coarse-to-Fine Medical Image Classification

Si-Yuan Lu, Hanruo Zhu, Ziquan Zhu, Gaojie Jin, Zeyu Fu, Lu Yin, Ke Li, Lu Liu, Tianjin Huang

2026-07-07视觉感知

高分辨率医学图像的诊断线索细小且稀疏,直接全图处理代价高、下采样又易丢失细节。CPR将分类建模为由全局到局部的序贯感知细化过程,在固定骨干输入尺寸下动态预测裁剪位置与尺度,并把原图高分辨率证据逐步融合到全局状态中。五个数据集和多种骨干上的结果显示,其较现有固定分辨率、多尺度与AdaptiveNN基线最高提升2.27%,同等精度下GFLOPs最多降低19.6倍。

Homer: Understanding Long-form Videos with Hierarchical Memory and Agentic Reasoning Figure 1
2026-07-07cs.CV

Homer: Understanding Long-form Videos with Hierarchical Memory and Agentic Reasoning

Yixin Ji, Fanghua Ye, Juntao Li, Bo Zhao, Zexuan Qiu, Zhaopeng Tu, Liefeng Bo, Min Zhang

Soochow University, Tencent Hunyuan Multimodal Department

2026-07-07视觉感知

这篇论文针对在线长视频理解中“记不下、找不准、难以做多跳因果推理”的问题,提出 Homer:用感知缓冲、实体图和带时序/因果边的事件图分层组织视频记忆,再由带验证纠错与自进化技能的 agent 多轮检索证据。实验显示其在 M3-Bench-robot、M3-Bench-web 和 Video-MME-Long 上较此前最佳 agent 方法分别提升 5.5、10.8 和 4.4 分,表明收益主要来自结构化记忆与检索推理机制。

Reliability-Aware CT-MRI Registration: A Quality Engineering Framework with Stability Analysis and Risk Classification Figure 1
2026-07-07cs.CV

Reliability-Aware CT-MRI Registration: A Quality Engineering Framework with Stability Analysis and Risk Classification

Nisreen Albzour

School of Systems Science and Industrial Engineering, Binghamton University, Binghamton, NY, registration is itself an estimation problem with no ground truth available at deployment time, and

2026-07-07安全鲁棒

这篇论文针对 CT–MRI 配准在临床部署中缺少逐例可靠性信号的问题,提出把质量提升、Dice 重叠、重复初始化稳定性和正反向一致性合成为可靠性分数,并用训练集阈值划分绿/黄/红风险。结果显示仿射配准优于刚性配准,绿色自动接受比例为 44% 对 33%,可靠性筛选后各指标均优于未筛选方法;但样本仅 18 例,阈值仍属统计验证而非临床验证。

RotateAttention: RoPE-Aware Rotation and Range Rectification for INT4 Quantized Attention in Video Generation Figure 1
2026-07-07cs.CV

RotateAttention: RoPE-Aware Rotation and Range Rectification for INT4 Quantized Attention in Video Generation

Yaofu Liu, Wanli Lan, Jinxi Li, Binhang Yuan, Harry Yang

2026-07-07视觉感知

该文面向3D RoPE视频DiT中长序列注意力的INT4加速瓶颈,指出现有量化忽视RoPE导致的Q/K离群分布变化,以及非负注意力概率用对称量化会浪费一半动态范围。RotateAttention通过可并入RoPE或低开销的旋转抑制Q/K离群,并用固定scale与zero-point优化P矩阵量化,辅以敏感层/步的FP16回退;实验称视频质量接近全精度,同时端到端最高加速1.68倍、核级加速2.2倍。

Evaluating Intellectual Property Guardrails of Generative Image Models: A Technical Report Figure 1
2026-07-07cs.CV

Evaluating Intellectual Property Guardrails of Generative Image Models: A Technical Report

Austin T. Hoag, Apostolos Modas, Yunhao Ba, Julienne M. LaChance, Jinru Xue, Wiebke Hutiri, Jan Simson, Tiffany Georgievski, Alex Towli, Joseph Smith, Yuki Mitsufuji, Alice Xiang

2026-07-07视觉感知生成模型

本文针对生成图像模型可能复现角色、名人肖像和商业标志等受保护 IP 的风险,构建覆盖多类实体与直接/间接提示的基准,并用自动化 VLM 判别流程评估 14 个文生图系统的 IP 护栏。核心洞察是护栏触发高度不均:私有模型虽均有不同程度拒绝,但类别、提示是否点名和实体属性会显著影响结果;商业标志最少被拒且最易生成,所有被测模型在 2026 年 3 月仍能生成可识别 IP。

Classroom Behavior Monitoring with YOLO An Empirical Study in Higher Education Settings Figure 1
2026-07-07cs.CV

Classroom Behavior Monitoring with YOLO An Empirical Study in Higher Education Settings

Sinh Vu Trong, Dung Nguyen Manh, Hieu Hoang Minh, Hieu Pham Trung, Thu Pham Ha, Nhu Le Hoang

subjective and lack scalability. This study introduces a real-world dataset of classroom, videos collected at the Banking Academy of Vietnam (BAV-Classroom dataset), annotated, interpretation, which can lead to bias and limit the scalability of its application [2]. To address, behaviors to be monitored in the classroom, which serve as the basis for object labels in the, . We provide initial recommendations for the Banking Academy of Vietnam on the potential, departments can refine teaching strategies, enhance student management, and better address, Data collection and labeling

2026-07-07视觉感知

本文针对高校课堂观察依赖人工、主观且难以规模化的问题,采集越南银行学院真实课堂摄像头数据,构建含9类学习/分心/中性行为标注的BAV-Classroom数据集,并比较多种视觉检测模型。结果显示YOLOv11表现最佳,且课堂后段学生专注度明显下降,说明基于摄像头的自动化课堂质量监测具备可行性。

Criterion-Conditional In-Context Learning: Evaluating Criterion-Shift Adaptation in Vision-Language Models Figure 1
2026-07-07cs.CV

Criterion-Conditional In-Context Learning: Evaluating Criterion-Shift Adaptation in Vision-Language Models

Kaiyun Yang, Ruilin Yang, Zhimin Yao, J. Wang, Wei Ge

2026-07-07视觉语言视觉感知

这篇论文关注视觉语言模型在少样本上下文中不仅要识别任务,还要随应用要求调整判定标准的问题。作者提出 CC-ICL 设置、Criterion Sensitivity/Invariance 指标和多域 CC-Bench,揭示现有模型普遍存在“刚性边界”偏差:能保持部分不变样本一致,却难按上下文改变临界判断。简单多标准训练显著提升 7B 模型的标准敏感性,并在若干领域超过闭源模型。

Symmetry-Structured Neural Completion of Islamic Geometric Patterns from Sparse Control Geometry Figure 1
2026-07-07cs.CV

Symmetry-Structured Neural Completion of Islamic Geometric Patterns from Sparse Control Geometry

Hassan Ugail, Irfan Mehmood

Centre for Visual Computing and Intelligent Systems, University of Bradford

2026-07-07规划控制

本文关注伊斯兰几何纹样补全中“看起来对称”但无法保证严格有效的问题,将旋转对称、锚点和候选边轨道作为显式几何知识嵌入图神经补全,而非完全交给数据学习。核心洞察是学习负责预测 plausibility,轨道约束或投影负责保证结构合法。实验在程序生成图案上显示,结构化解码在干净输入下几乎不损失边级保真度,在缺失控制几何时仍保持零对称违规;但结果未用历史语料验证,风格泛化仍受限。

Additive Causal Construction for Transferable and Reconfigurable Cross-System Learning in Multi-Source Image Fusion Figure 1
2026-07-07cs.CV

Additive Causal Construction for Transferable and Reconfigurable Cross-System Learning in Multi-Source Image Fusion

Zhizhong Fu, Wei Zhou, Zhaoyang Jiang, Yulong Lin, Yifu Hou, Xiaorong Ding, Qiang Yan, Yifan Chen

2026-07-07视觉感知

本文针对多源图像融合在跨中心、跨区域等机制异质场景下易出现跨系统差异和纠缠、导致 OOD 退化的问题,提出 ACC 框架,将融合视为可重构的因果结构构造:用干预一致性建立共享因果锚点,并用结构不确定性门控不可靠路径。其实例 ACC-CRL 在 ColorMNIST 与多中心 MVI 预测中提升 OOD 泛化且基本保持 ID 表现,但具体增益相对各模块的来源仍需更多消融支撑。

Dual-Adaptive SAM3: Hierarchical Routing over Low-Rank Expert Layers for Parameter-Efficient Medical Image Segmentation Figure 1
2026-07-07cs.CV

Dual-Adaptive SAM3: Hierarchical Routing over Low-Rank Expert Layers for Parameter-Efficient Medical Image Segmentation

Ying Chen, Jinyue Li, Kun Wang, Qiankun Li, Yang Liu

2026-07-07视觉感知

这篇论文针对 SAM3 直接用于医学分割时全量微调成本高、普通 MoE 参数和显存开销大的问题,提出 DA-SAM3:在融合模块中用层级化低秩专家替换部分 FFN,并通过视觉-文本联合的动态路由按输入选择专家,实现从粗对齐到语义识别再到边界细化的适配。实验称在多个公开医学分割基准上优于全量微调和标准 MoE,较现有方法约提升 5%,同时将 MoE 参数开销降低 80% 以上。

Uncertainty-Aware Last-Layer Adaptation of RETFound for Referable Diabetic Retinopathy Screening Under Dataset Shift Figure 1
2026-07-07cs.CV

Uncertainty-Aware Last-Layer Adaptation of RETFound for Referable Diabetic Retinopathy Screening Under Dataset Shift

Karim Mardhani

University of Colorado Boulder

2026-07-07数据集/基准安全鲁棒

这篇论文关注糖尿病视网膜病变筛查中比总体准确率更关键的漏诊风险与人工复核负担,采用冻结 RETFound 特征,仅比较最后一层的 softmax、温度缩放、贝叶斯、Laplace 与 SNGP 式不确定性头。结果显示,APTOS 上不确定性感知与选择性转诊可在约拒诊 20% 样本时将已接收病例漏诊降为零,但阈值调整也能以高假阳性代价减少漏诊,增益并非贝叶斯独有;DDR 外部验证中效果减弱,APTOS 训练的 SNGP 迁移较差,说明需显式评估安全性–覆盖率权衡和数据集偏移。

MAGE: View-guided Point Cloud Completion with Efficient Modality Alignment and Adaptive Geometry Enhancement Figure 1
2026-07-07cs.CV

MAGE: View-guided Point Cloud Completion with Efficient Modality Alignment and Adaptive Geometry Enhancement

Weize Quan, Zhengwei Wu, Kai Wang, Dong-Ming Yan

2026-07-07三维

MAGE针对单视图图像引导的点云补全过程中跨模态对齐弱、几何细节易被注意力平滑的问题,提出共享ViT与跨模态重建监督来约束图像和点云进入一致的几何潜空间,并结合锚点细化、图像交叉注意力和自适应几何自注意力同时建模局部邻域与全局结构。实验称其在合成和真实数据上优于XMFnet、EGIInet等方法,尤其改善完整形状与细薄结构恢复。

Coordinate Singularities Break Conformal Coverage for Gaze and Head Pose Figure 1
2026-07-07cs.CV

Coordinate Singularities Break Conformal Coverage for Gaze and Head Pose

Mohammadreza Jamalifard, Yaxiong Lei, Parastoo Azizinezhad, Javier Andreu-Perez

2026-07-07三维

本文关注凝视与头姿等三维视觉输出的保形预测可靠性:这些输出位于球面或 SO(3),若用 yaw–pitch/Euler 等平面坐标残差打分,会在极点或万向节锁附近产生几何畸变。论文的核心洞察是失效来自坐标图形状而非尺度,标量自适应阈值无法修正;用黎曼体积密度可诊断风险,用坐标无关的测地打分可直接替代。四个数据集上,名义 90% 覆盖在奇异区域降至约 39%–58%,而测地打分基本恢复覆盖且无需重训、开销很小。

From Raw Segmentations to Simulation-Ready Cardiac Meshes: An Automated Framework for Anatomical Reconstruction and Virtual Cohort Generation Figure 1
2026-07-07cs.CV

From Raw Segmentations to Simulation-Ready Cardiac Meshes: An Automated Framework for Anatomical Reconstruction and Virtual Cohort Generation

Francesco Fabbri, Martino Andrea Scarpolini, Paolo Ciancarella, Francesco Tudisco, Roberto Verzicco, Alessandro Ricci, Francesco Viola

2026-07-07视觉感知三维

这篇论文针对医学图像分割结果常含孔洞、断裂和拓扑错误,难以直接用于心脏多物理仿真的问题,提出从CT分割到仿真可用心脏网格的半自动流程。核心做法是用高质量模板进行基于Chamfer距离的多腔室非刚性配准,在贴合个体解剖的同时强制保持水密、同拓扑和点对应关系。作者在58例健康心脏CT上验证,并进一步构建统计形状模型与合成虚拟队列,展示其可支持不确定性分析和大规模体内仿真研究。

Attention Dynamics in Diffusion Models: A Visual Analytics Framework for Human-AI Collaboration Figure 1
2026-07-07cs.CV

Attention Dynamics in Diffusion Models: A Visual Analytics Framework for Human-AI Collaboration

Yiran Xiao, George Legrady

University of California, Santa Barbara

2026-07-07生成模型

这篇论文针对文本到图像扩散模型中语义结构何时形成、注意力如何在空间中迁移难以解释的问题,提出基于 DAAM 的逐步去噪注意力可视分析框架,将 token 级跨注意力轨迹、阶段划分、集中度、重叠与差分竞争视图联动展示。在 60 个结构化提示词和 Stable Diffusion v1.5 案例中,作者观察到语义定位稳定化、token 共享或分离空间等可解释模式,但结果主要是案例与试点证据,非严格统计评测。

Entropy-Coded MS-VQ-VAE with Learned Priors for Ultra-Low Bitrate Video Compression Figure 1
2026-07-07cs.CV

Entropy-Coded MS-VQ-VAE with Learned Priors for Ultra-Low Bitrate Video Compression

Manikanta Kotthapalli, Banafsheh Rekabdar

Portland State University, Portland State University Department of Computer Science Portland OR USA

2026-07-07视觉感知生成模型

这篇论文针对连续潜变量视频 codec 在 0.1 bpp 以下缺少稳定率控信号、难以保持语义质量的问题,提出用多尺度 VQ-VAE 的离散码本大小作为硬信息上限,并用自回归先验做熵编码;关键洞察是码本索引呈幂律分布,EMA 更新和 dead-code 重启可避免小码本崩塌。在 UCF101 64×64 视频上,模型达到 0.043–0.064 bpp,比 H.264/H.265 实用下限低数倍,且在 LPIPS 上优于 H.265 CRF36,但评估仍限于低分辨率和少量传统 codec 对比。

Double-Helix Active Geometry: LiDAR-Anchored Multi-View Depth with Selective Abstention Figure 1
2026-07-07cs.CV

Double-Helix Active Geometry: LiDAR-Anchored Multi-View Depth with Selective Abstention

Jinwen Wen

2026-07-07视觉感知

这篇论文针对移动设备/机器人短距 LiDAR 量程有限、远处或反光表面常缺深度的问题,提出 DH-Active:把近场 LiDAR 回波当作“米尺度尺子”来估计两视图位姿,再对可跟踪的远场点三角化,并用视差/重投影门控主动放弃不可靠估计。结果显示其 CPU 核心前端约 1.11 ms、零训练参数,在受控 ARKitScenes 远场协议中达到 64.2% 覆盖率和 13.4% 相对误差,但精度仍不及经尺度对齐的大模型。

Inpainting U-Net for seamless pedestrian-level wind prediction across urban morphologies Figure 1
2026-07-07cs.CV

Inpainting U-Net for seamless pedestrian-level wind prediction across urban morphologies

Jingzi Huang, Claire E. Heaney, Tao Li, Xinzhe Li, Graham O. Hughes, Maarten van Reeuwijk

2026-07-07视觉感知

面向城市设计中行人高度风场快速评估的需求,论文针对LES/CFD成本高、patch式U-Net拼接易产生边界不连续的问题,提出两阶段框架:先由M1按建筑高度与来流信息逐块预测,再用带邻域上下文的inpainting U-Net M2迭代修补全场。结果显示该方法能较好恢复平均风速和空间变化,并显著减弱拼接伪影,但高风速峰值仍被低估。

How many labels do you need? A decision framework for cross-habitat marine species recognition Figure 1
2026-07-07cs.CV

How many labels do you need? A decision framework for cross-habitat marine species recognition

Alzayat Saleh, Mostafa Rahimi Azghadi

College of Science and Engineering, James Cook University, Townsville, QLD, Australia, Centre for AI and Data Science Innovation, James Cook University, Townsville, QLD, Australia

2026-07-07视觉感知

针对海洋生态监测中跨地点部署自动物种识别需大量重标注、却缺少标注预算依据的问题,论文构建跨三大洋五个海洋数据集的评测框架,比较基础模型与多种适配策略。核心洞察是冻结的 DINOv2 线性探针比全量微调 CNN 更少依赖栖息地捷径,能学习更稳健的物种诊断特征;结果显示每个物种仅需约 10–20 张目标地点标注图像即可达到可靠识别,显著降低标注成本。

Do Diabetic Foot Ulcer Segmentation Models Generalize? A Cross-Dataset Benchmark of CNN and Transformer Architectures Figure 1
2026-07-07cs.CV

Do Diabetic Foot Ulcer Segmentation Models Generalize? A Cross-Dataset Benchmark of CNN and Transformer Architectures

Abderrahmane Benfatah

2026-07-07视觉感知数据集/基准

针对糖尿病足溃疡分割模型常在同源数据上报高分、但跨医院泛化未知的问题,本文在去泄漏的数据审计后,用统一协议比较 U-Net、DeepLabV3+ 与 SegFormer-B2。结果显示三者域内 Dice 接近 0.80–0.83,但外部数据显著下降;SegFormer-B2 在 DFUC2022 和 Medetec 上均最佳,且灾难失败更少,提示架构家族比模型复杂度更影响跨数据集鲁棒性。

Reliability-Aware Monocular Depth Supervision for Sparse-View Neural Reconstruction Figure 1
2026-07-07cs.CV

Reliability-Aware Monocular Depth Supervision for Sparse-View Neural Reconstruction

Wei-Teng Chu, Yashasvini Gopalan, Changju Yuan

Stanford University

2026-07-07视觉感知三维

面向自动驾驶等前向稀疏视角场景,论文关注单目深度先验虽能补几何约束但区域可靠性不均的问题。其核心做法是将 Depth Anything V2 预测经尺度平移对齐后,仅在 RGB-only 基线光度误差较低的区域施加深度监督。结果显示该策略对 Splatfacto 更有效,KITTISeq02 上 PSNR 从 14.903 提升到 15.932、RMSE 从 0.542 降到 0.100;对 Mip-NeRF-360 增益弱且不稳,强多视角场景还可能牺牲渲染质量。

Interpretable machine learning predicts Parkinson's disease severity using motion-corrected QSM MRI and multiband multiecho fMRI features Figure 1
2026-07-07cs.CV

Interpretable machine learning predicts Parkinson's disease severity using motion-corrected QSM MRI and multiband multiecho fMRI features

Aixa X. Andrade

Lyda Hill Department of Bioinformatics, Department of Biomedical Engineering, University of Texas Southwestern Medical Center, Dallas, Texas, USA

2026-07-07视觉感知

本文针对帕金森运动严重度仅靠临床量表难以反映脑部病理差异的问题,将运动校正 QSM 与多带多回波静息态 fMRI 的 ReHo 特征结合,并用可解释机器学习比较多种特征组合。结果显示影像特征本身有预测信号,完整 fMRI+QSM+临床变量可解释 45.4% 方差;精选 QSM+临床变量在 ±5 分内预测达 75%,SHAP 指向小脑、丘脑、纹状体等合理脑区,但样本仅 28 人,泛化仍需验证。

DELTAVID: Enhancing Fine-Grained Spatiotemporal Perception with Cross-Video Differences Figure 1
2026-07-07cs.CV

DELTAVID: Enhancing Fine-Grained Spatiotemporal Perception with Cross-Video Differences

Yankai Yang, Yancheng Long, Bin Wen, Fan Yang, Tingting Gao, Han Li, Shuo Yang

2026-07-07视觉感知

这篇论文针对 Video MLLM 擅长全局语义却常漏掉短时、小区域差异的问题,提出 DeltaVid:把相似视频“找不同”转化为可验证代理训练信号,并用可控扰动构造 DeltaVid-10K/Bench,联合 Grounding 与 MCQ 奖励学习时间边界和空间证据。实验显示其在跨视频差异理解上优于同尺度与更大基线,并能迁移提升多个通用视频理解基准,但自然语义差异仍是局限。

Learning 3D Affordances for Blade Insertion in Cluttered Stowing Figure 1
2026-07-07cs.CV

Learning 3D Affordances for Blade Insertion in Cluttered Stowing

Tianyu Li, Harpreet Sawhney, Minju Jung, Aditya Mehrotra, Kunal Mehrotra, Mudit Agrawal

2026-07-07三维

这篇论文针对仓储机器人在杂乱软箱中插入刚性 blade 时,传统用 SE(3) 位姿分布学习会被单一示教策略限制、难以发现其他可行空隙的问题。核心洞察是把 blade 可供性视为三维自由空间中的占据区域,用 3D occupancy masked autoencoder 从场景几何重建 blade 占据,再后处理成位姿。10K 真实生产数据上,VulcanVoxel 的 top-5 覆盖率达 0.89,高于最佳位姿基线 0.71,RGB 蒸馏模型可在 30ms 推理。

Direct Time-of-Flight Measurement Accuracy Improvement With Perimeter-Gated SPADs Figure 1
2026-07-07cs.CV

Direct Time-of-Flight Measurement Accuracy Improvement With Perimeter-Gated SPADs

Md Sakibur Sajal, Hunter Guthrie, Zexi Liu, Marc Dandin

Department of Electrical and Computer Engineering, Carnegie Mellon University

2026-07-07视觉感知

这篇论文面向直接飞行时间测距中由SPAD暗噪声引起的检测抖动问题,指出在低回波或低重复次数下探测器噪声会主导测距不确定性。作者将周边栅控SPAD与片上计数式TDC结合,建立系统、线路和器件级抖动估计框架,并实测不同栅压影响。结果显示周边栅控可降低暗噪声概率,从而在自由运行和时间门控模式下提升dToF直方图峰值稳定性与测量精度。

iFLYTEK-Embodied-Omni Technical Report Figure 1
2026-07-07cs.AI

iFLYTEK-Embodied-Omni Technical Report

Yuan Zhang, Jingfei Ni, Guanchen Lu, Shiqi Zhang, Qingshan Xu, Chi Liu, Xin Nie, Wenjie Xu, Lin Gao, Zhiyuan Cheng, Mingxin Zhou, Jiajia Wu, Diyuan Liu, Jia Pan, Chao Ji

iFLYTEK, 2LindenBot, 3University of Science and Technology of China, self-attention. This design establishes brain–cerebellum collaboration: the vision-language model, Clean and 89.0% Rand, demonstrating the strong capabilities of the brain–cerebrum collaborativ, capabilities of the brain–cerebrum collaborative architecture in multi-stage planning, future-state anticipation, • We establish a brain–cerebellum collaborative architecture within the unified model. The VLM and

2026-07-07视觉感知

面向长程机器人操作中语义理解、世界动态预测与动作生成割裂的问题,论文提出 iFLYTEK-Embodied-Omni,将 VLM、视频生成模型和动作生成模型以共享多模态自注意力连接成“脑—小脑”架构,并用多源数据与四阶段训练对齐。其在 zero-shot LIBERO-Plus 达到 89.6% 成功率,在 RoboTwin 2.0 Clean/Rand 达到 93.68%/93.16%,但部分增益可能主要来自 scaling / data。

MedMambaLite: Hardware-Aware Mamba for Medical Image Classification Figure 1
2026-07-07eess.IV

MedMambaLite: Hardware-Aware Mamba for Medical Image Classification

Romina Aalishah, Mozhgan Navardi, Tinoosh Mohsenin

Department of Electrical and Computer Engineering, Johns Hopkins University, Baltimore, MD, USA

2026-07-07视觉感知

面向边缘医疗设备实时图像分类的算力、内存与能耗约束,MedMambaLite从MedMamba出发重构轻量Mamba结构:用Lite-Conv-SSM分支同时建模局部与长程特征,并在LiteSS2D中共享多方向扫描参数,再通过知识蒸馏压缩学生模型。实验称其在10个MedMNIST数据集达94.5%总体准确率,参数较MedMamba减少22.8倍,在Jetson Orin Nano上达到35.6 GOPS/J、能效提升63%。

2026-07-03

155 篇
WorldDirector: Building Controllable World Simulators with Persistent Dynamic Memory Figure 1
2026-07-03cs.CV

WorldDirector: Building Controllable World Simulators with Persistent Dynamic Memory

Hanlin Wang, Hao Ouyang, Qiuyu Wang, Wen Wang, Qingyan Bai, Ka Leong Cheng, Yue Yu, Yixuan Li, Yihao Meng, Zichen Liu, Yanhong Zeng, Yujun Shen, Qifeng Chen

2026-07-03强化学习规划控制

WorldDirector针对现有视频世界模型在物体离开视野后易冻结、消失或身份漂移的问题,将动态物体运动规划与像素生成解耦:由LLM编排3D物体与相机轨迹,再投影为2D条件,并结合外观绑定与空间注意力维持身份一致。实验显示其能生成更长、更可控的多实体动态场景,并在长时间遮挡后保持物体位置演化和外观稳定。

Alignment Is All You Need For X-to-4D Generation Figure 1
2026-07-03cs.CV

Alignment Is All You Need For X-to-4D Generation

Qiaowei Miao, Kehan Li, Yawei Luo, Yi Yang

2026-07-03视觉感知

针对现有4D生成多依赖单一输入、难以同时保证运动真实与几何一致的问题,论文提出Align4D,将任意模态输入先转为视频-3D对,再通过对象距离对齐、运动-几何联合对齐和异步优化来统一视频运动先验与3D结构先验。实验在X4D与Consistent4D上显示其生成质量和一致性优于对比方法,但效果部分依赖预训练视频与3D生成模型。

PointDiT: Pixel-Space Diffusion for Monocular Geometry Estimation Figure 1
2026-07-03cs.CV

PointDiT: Pixel-Space Diffusion for Monocular Geometry Estimation

Haofei Xu, Rundi Wu, Philipp Henzler, Nikolai Kalischek, Michael Oechsle, Fabian Manhardt, Marc Pollefeys, Andreas Geiger, Federico Tombari, Michael Niemeyer

2026-07-03生成模型

本文针对单目点图估计中确定性回归易过平滑、潜空间扩散受 VAE 压缩损失限制的问题,提出直接在原始 3D point map 像素空间训练的 PointDiT:用朴素 ViT 做扩散骨干,并以 DINOv3 图像 token 条件化,采用 x-prediction 避免点图 tokenizer。实验显示其在保持结构更简单的同时优于潜空间扩散和复杂混合回归模型,尤其能恢复更锐利的几何边界、细薄结构,并在透明物体等歧义区域更稳健。

From SRA to Self-Flow: Data Augmentation or Self-Supervision? Figure 1
2026-07-03cs.CV

From SRA to Self-Flow: Data Augmentation or Self-Supervision?

Dengyang Jiang, Mengmeng Wang, Harry Yang, Jingdong Wang

The Hong Kong University of Science and Technology, Zhejiang University of Technology, Baidu Inc.

2026-07-03视觉感知生成模型

本文针对 SRA 到 Self-Flow 的性能提升机制展开质疑:增益是否真来自不同噪声 token 间的自监督交互并不清楚。作者提出 Attention Separation,在保留双时间步输入的同时阻断跨噪声注意力,发现性能不降反升,说明提升可能主要来自噪声维度的数据增强;结合双时间步与注意力分离后,在 ImageNet 256/512 生成上优于多数自对齐基线,并接近或匹敌外部编码器对齐方法。

Reasoning LLM Improves Speaker Recognition in Long-form TV Dramas Figure 1
2026-07-03cs.CL

Reasoning LLM Improves Speaker Recognition in Long-form TV Dramas

Yuxuan Li, Lingxi Xie, Xinyue Huo, Jihao Qiu, Jiacheng Shao, Pengfei Chen, Jiannan Ge, Kaiwen Duan, Qi Tian

2026-07-03视觉感知

长篇电视剧中说话人识别常受角色众多、短句声纹不稳、离屏发声和称谓关系影响,论文据此构建含532K对白的DramaSR-532K,并将任务从单纯声纹匹配扩展为融合语音、画面描述和人物关系的推理式归因。DramaSR-LRM用工具调用和SFT/RL细化标签,在11部剧上将基线准确率由85.49%提升至87.79%,极短对白增益达9.20%,但部分收益可能也来自数据与工具链规模。

Embodied.cpp: A Portable Inference Runtime of Embodied AI Models on Heterogeneous Robots Figure 1
2026-07-03cs.RO

Embodied.cpp: A Portable Inference Runtime of Embodied AI Models on Heterogeneous Robots

Ling Xu, Chuyu Han, Borui Li, Hao Wu, Shiqi Jiang, Ting Cao, Chuanyou Li, Sheng Zhong, Shuai Wang

Southeast University, Nanjing University, Institute for AI Industry Research (AIR), Tsinghua University

2026-07-03机器人

这篇论文针对具身模型落地时依赖模型专属 Python 栈、后端假设和机器人胶水代码的问题,提出 C++ 推理运行时 Embodied.cpp,洞察是 VLA 与 WAM 可抽象为共享执行路径,并将差异收敛到可插拔头部、预测模块和 I/O 适配。系统支持多速率闭环执行、面向 batch-1 低延迟的融合推理及异构后端抽象;在 HY-VLA、pi0.5 上分别达到 100.0% 和 91.0% 任务成功率,WAM 块内存从 312.2 MiB 降至 88.1 MiB。

Seek to Segment: Active Perception for Panoramic Referring Segmentation Figure 1
2026-07-03cs.CV

Seek to Segment: Active Perception for Panoramic Referring Segmentation

Song Tang, Shuming Hu, Xincheng Shuai, Henghui Ding, Yu-Gang Jiang

Fudan University, China

2026-07-03视觉感知

这篇论文针对现有指代表达分割只能处理固定视角图像、难以服务具身智能在360度环境中主动找物的问题,提出APRS任务与基准,并设计带EgoSphere空间视觉记忆的PanoSeeker,使VLM能整合连续局部观测、规划非冗余搜索并在发现目标后对齐视角完成分割。作者还构建专家轨迹数据并用SFT与RL优化探索效率;实验显示其在新基准上搜索效率和分割精度均优于改造后的现有方法。

Towards Robustness against Typographic Attack with Training-free Concept Localization Figure 1
2026-07-03cs.CV

Towards Robustness against Typographic Attack with Training-free Concept Localization

Bohan Liu, Wenqian Ye, Guangzhi Xiong, Zhenghao He, Sanchit Sinha, Aidong Zhang

2026-07-03安全鲁棒

针对CLIP/LVLM视觉编码器容易被图像中文字误导的Typographic Attack问题,论文提出无需训练的概念定位方法:在ViT多头注意力子空间中随机采样概念方向,并用梯度归因排序找出偏向词义的“有害电路”。随后通过测试时注意力重加权或消融这些电路提升鲁棒性;实验显示其在CLIP目标分类和RIO-Bench上多种LVLM的受干扰VQA中优于既有监督与免训练防御。

Visually Grounded Self-Reflection for Vision-Language Models via Reinforcement Learning Figure 1
2026-07-03cs.CL

Visually Grounded Self-Reflection for Vision-Language Models via Reinforcement Learning

Liyan Tang, Fangcong Yin, Greg Durrett

♠ The University of Texas at Austin ♢ New York University

2026-07-03视觉语言视觉感知强化学习

这篇论文针对视觉语言模型在自我反思时常忽视视觉证据、难以在分布外图像中纠错的问题,提出 VRRL 强化学习框架:通过随机遮蔽轨迹前缀和从失败经验缓冲区 roll-in,专门训练模型从错误中基于视觉反馈恢复。实验覆盖表格/图表视觉定位与空间导航,显示其相较零样本、SFT、标准 RL 和反思微调基线显著提升 OOD 准确率。

GeoMix: Descriptor-Free Visual Localization via Global Context and Multi-Detector Training Figure 1
2026-07-03cs.CV

GeoMix: Descriptor-Free Visual Localization via Global Context and Multi-Detector Training

Yejun Zhang, Xinjue Wang, Zihan Wang, Esa Rahtu, Juho Kannala

2026-07-03视觉感知

GeoMix针对无描述子视觉定位虽省存储、利隐私和地图维护却精度不足的问题,指出瓶颈在几何匹配判别性不够。方法用方向/距离嵌入强化局部几何,以可学习全局上下文节点缓解重复结构歧义,并利用无描述子空间的探测器无关性做多探测器 Mix-Training。实验在四个基准上刷新无描述子方法,75分位旋转误差降89%、平移误差最高降90%,但与描述子方法仍有差距。

Combating Textual Noise and Redundancy: Entropy-Aware Dense Visual Token Pruning Figure 1
2026-07-03cs.CV

Combating Textual Noise and Redundancy: Entropy-Aware Dense Visual Token Pruning

Xuehui Wang, Xuankun Yang, Wei Shen

Shanghai Jiao Tong University, Shanghai, China, Codes: https://github.com/SJTU-DeepVisionLab/EADP

2026-07-03视觉感知

这篇论文针对VLM在高分辨率视觉输入下视觉token过多、剪枝易丢失细粒度线索的问题,指出瓶颈来自文本噪声的分散相似度和Top-K选择的局部冗余。EADP用熵过滤高噪声文本token,并将选择建模为带空间先验的子模优化,以获得更完整的视觉覆盖;实验称在严格token预算下提升准确率-效率权衡,并在多模态基准上达到SoTA。

EAGLE-360: Embodied Active Global-to-Local Exploration in 360$^\circ$ Figure 1
2026-07-03cs.CV

EAGLE-360: Embodied Active Global-to-Local Exploration in 360$^\circ$

Jingtao Xu, Zizhuo Lin, Jianwen Sun, Yi Yang, Yawei Luo

Zhejiang University, Central China Normal University

2026-07-03视觉感知

这篇论文针对全景主动视觉搜索中 MLLM 难以处理极区畸变、边界连续性和局部视角初始化导致的短视探索问题,提出 EAGLE-360 的全局到局部框架:先利用完整 360° 场景估计目标方位,再通过投影工具迭代收缩视野,并用 RoPE Rolling 建模环绕拓扑。作者还构建 1.4 万张 4K 全景和多轮 CoT 数据,结合 SFT 与 GRPO 训练;实验显示其在自建基准上准确率达 64.44%,较基座模型近 8 倍提升,并在 H*Bench 上有较好零样本迁移。

Interpretation-Oriented Cloud Removal via Observation-Anchored Residual Flow with Geo-Contextual Alignment Figure 1
2026-07-03cs.CV

Interpretation-Oriented Cloud Removal via Observation-Anchored Residual Flow with Geo-Contextual Alignment

Ziyao Wang, Maonan Wang, Yucheng He, Xianping Ma, Ziyi Wang, Hongyang Zhang, Yirong Cheng, Man-on Pun

2026-07-03生成模型

这篇论文针对遥感去云方法偏重视觉逼真、却可能破坏下游语义解释的问题,提出 GACR:用以含云观测为锚点的残差流替代纯噪声生成起点,并借助 VFM 语义先验约束地理上下文一致性。实验覆盖 6 个去云数据集和 12 个下游任务,报告最高约 3.3 dB PSNR、3.1 mIoU 提升及约 5 倍更快收敛,但具体增益中 VFM 与数据构造贡献仍需进一步拆分说明。

OrbitQuant: Data-Agnostic Quantization for Image and Video Diffusion Transformers Figure 1
2026-07-03cs.CV

OrbitQuant: Data-Agnostic Quantization for Image and Video Diffusion Transformers

Donghyun Lee, Jitesh Chavan, Duy Nguyen, Sam Huang, Liming Jiang, Priyadarshini Panda, Timo Mertens, Saurabh Shukla

Cantina Labs, 2 University of Southern California, 3 University of Illinois Urbana-Champaign, Work done during an internship at Cantina Labs.

2026-07-03视觉感知生成模型

本文针对扩散 Transformer 推理中多步采样昂贵、激活随时间步和提示漂移导致 PTQ 需反复校准的问题,提出 OrbitQuant:用随机置换块 Hadamard 旋转把归一化权重与激活映射到固定边际分布,并用共享 Lloyd–Max 码本完成无数据量化。该方法在 FLUX.1、Z-Image-Turbo、Wan 2.1、CogVideoX 上低比特 PTQ 达到领先结果,且在 W2A4 下仍保持可用生成质量。

MARVEL: Margin-Aware Robust von Mises-Fischer Expert Learning for Long-Tailed Out-of-Distribution Detection Figure 1
2026-07-03cs.CV

MARVEL: Margin-Aware Robust von Mises-Fischer Expert Learning for Long-Tailed Out-of-Distribution Detection

A.S. Anudeep, Vaanathi Sundaresan

2026-07-03视觉感知安全鲁棒

面向医疗影像中长尾类别与未知分布样本并存的安全诊断问题,MARVEL认为尾类易与OOD混淆,提出非线性vMF分类器、按头/均衡/尾先验分工的margin-aware多专家,以及显式区分ID/OOD的异常专家。在RFMiD、ISIC2019和NCTCRC上,平均FPR95较强基线分别降低8.45%、13.02%和36.90%,并通过消融支持各模块贡献。

Self-Auditing Residual Drifting for Pathology-Preserving Accelerated Knee MRI Figure 1
2026-07-03eess.IV

Self-Auditing Residual Drifting for Pathology-Preserving Accelerated Knee MRI

Qing Lyu, Jianxu Wang, Mohammad Kawas, Ge Wang, Christopher T. Whitlow

the Department of Biomedical Engineering, Rensselaer Polytechnic Institute, Troy, NY

2026-07-03视觉感知

针对加速膝关节 MRI 重建易模糊小病灶、全局指标难发现失败的问题,本文提出 SA-RDM-DC,将残差生成漂移、双域残差校正、硬 k-space 数据一致性与自审计误差/风险预测结合。实验在 fastMRI 多加速率上取得最高 SSIM、亚秒级推理,并在病灶区域保真和半月板预测稳定性上优于多类基线;跨协议 SKM-TEA 中审计信号仅部分迁移,仍需重新校准。

Learning to Evolve Scenes: Reasoning about Human Activities with Scene Graphs Figure 1
2026-07-03cs.CV

Learning to Evolve Scenes: Reasoning about Human Activities with Scene Graphs

Francesca Pistilli, Simone Alberto Peirone, Giuseppe Averta

2026-07-03视觉感知

论文针对第一视角视频中动作如何改变环境难以被隐式视觉特征解释的问题,主张用可编辑的时空场景图显式建模人—物关系演化。其核心贡献是构建 SG-Ego 标注集,提出 GLEN 进行图—语言对齐与动作条件图编辑预测,并定义 A-GEF 任务。实验显示该表示在 EgoMCQ、EgoCVR 等检索任务接近或优于视频基线,在 EXPLORE-Bench 和 A-GEF 等推理任务表现突出,但具体增益中数据标注规模的贡献仍需区分。

Wavelet-Guided Semantic Signal Compensation for Inversion-Free Image Editing Figure 1
2026-07-03cs.CV

Wavelet-Guided Semantic Signal Compensation for Inversion-Free Image Editing

Anqi Tang, Wenhao Sun, Zhaoqiang Liu

2026-07-03视觉感知

本文针对 FlowEdit 等无反演图像编辑在高噪声早期容易被流形寻优主导、全局颜色/属性变化不足的问题,提出同点语义探测并用 Haar 小波只提取低频语义补偿,在早期增强目标提示方向、抑制高频扰动。实验称其在定量指标、用户研究和频域分析中提升全局编辑一致性,同时较好保持背景结构。

LIME: Learning Intent-aware Camera Motion from Egocentric Video Figure 1
2026-07-03cs.RO

LIME: Learning Intent-aware Camera Motion from Egocentric Video

Boyang Sun, Jiajie Li, Yung-Hsu Yang, Chenyangguang Zhang, Tim Engelbracht, Sunghwan Hong, Cesar Cadena, Marc Pollefeys, Hermann Blum

University of Bonn

2026-07-03视觉感知

这篇论文针对机器人在操作或问答前常需先调整视角、但现有 VLN/VLA 多把相机运动附属于导航或执行的问题,提出将语言条件相机运动作为独立能力。LIME 从人类第一视角视频中挖掘意图、观测增益描述与相对 SE(3) 位姿监督,用 VLM 生成观测增益并以 flow-matching 预测多模态目标视角。在视角预测、下游具身任务和 Spot 实机中,模型优于多类基线并能支持遮挡揭示、目标接近和视角切换。

Text-Driven 3D Indoor Scene Synthesis in Non-Manhattan Environments Figure 1
2026-07-03cs.AI

Text-Driven 3D Indoor Scene Synthesis in Non-Manhattan Environments

Xianhui Meng, Zirui Song, Yuchen Zhang, Li Zhang, Yongxuan Lv, Xiuying Chen, Kun Wang, Yan Luo, Kai Chen, Hangjun Ye, Long Chen, Jun Liu, Xiaoshuai Hao

2026-07-03三维

本文针对现有文本驱动3D室内生成过度依赖曼哈顿假设、难以处理斜墙与不规则边界导致碰撞和语义布局失配的问题,提出SPG-Layout:用物体-边界、物体-物体统计空间先验作为强化学习奖励,并采用先放大件家具的层次化布局策略。作者还构建500个非曼哈顿场景基准,实验显示其在曼哈顿与非曼哈顿环境中均优于现有方法,主要提升体现在物理可行性和布局一致性。

Object-centric LeJEPA Figure 1
2026-07-03cs.CV

Object-centric LeJEPA

Jakob Geusen, Ender Konukoglu

2026-07-03视觉感知

这篇论文针对图像级自监督预训练数据需求大、随机裁剪会混淆不同物体的问题,提出用训练时的廉价 SAM 掩码把 LeJEPA 从整图对齐改为物体级对齐,并加入同图物体互为负样本的实例分离损失。实验显示,在 COCO 10–100% 数据和两种模型规模下,Object-centric LeJEPA 在 DAVIS 跟踪、ImageNet 分类、ADE20k 分割和 NAVI 重识别上优于图像级 LeJEPA,且约用 10% 数据达到其全量表现。

ACID: Action Consistency via Inverse Dynamics for Planning with World Models Figure 1
2026-07-03cs.RO

ACID: Action Consistency via Inverse Dynamics for Planning with World Models

Gawon Seo, Dongwon Kim, Suha Kwak

2026-07-03强化学习规划控制

本文针对动作条件世界模型在决策时规划中只看终点相似度、忽略中间转移是否可由候选动作真实实现的问题,提出 ACID:用逆动力学模型反推每步预测转移对应动作,并将其与原动作的循环一致性残差加入规划代价。该方法不改动世界模型,作为决策时验证器适配多类模型;在四种世界模型和六个操控、导航任务上稳定提升规划效果,并以更少规划计算达到基线精度。

Show Me Examples: Inferring Visual Concepts from Image Sets Figure 1
2026-07-03cs.CV

Show Me Examples: Inferring Visual Concepts from Image Sets

Nick Stracke, Kolja Bauer, Stefan Andreas Baumann, Miguel Angel Bautista, Josh Susskind, Björn Ommer

2026-07-03视觉感知

本文关注现有视觉语言模型虽能执行文本指令,却难以仅凭一组图像样例推断共同视觉概念的问题。作者提出 VICIS 任务,并用 ImageNet/WordNet 等弱监督分组构造训练样本,学习从上下文图像集抽取概念并约束查询图像生成。实验显示该模型在合成与真实层级数据上比通用 VLM 和任务基线更准确、多样,并能泛化到未见类别和草图模态。

Transformer Geometry Observatory TGO-II: Representational Similarity Observatory Figure 1
2026-07-03cs.CV

Transformer Geometry Observatory TGO-II: Representational Similarity Observatory

Kaustubh Kapil, Kishor P. Upla

2026-07-03视觉感知

这篇论文针对ViT训练过程中内部表征几何如何演化这一少被直接刻画的问题,提出TGO-II观测框架,用CKA、SVCCA、TwoNN-ID和token协方差分析层间相似性、流形复杂度与token耦合。结果显示训练中层间表征相似性下降、内在维度先升后稳,但token间强耦合持续存在,说明复杂度增长更可能来自高耦合token系统上的更丰富变换,而非逐步token独立。

Representation Distribution Matching for One-Step Visual Generation Figure 1
2026-07-03cs.CV

Representation Distribution Matching for One-Step Visual Generation

Lan Feng, Wuyang Li, Eloi Zablocki, Matthieu Cord, Alexandre Alahi

2026-07-03视觉感知

这篇论文针对一步图像生成质量不足、依赖教师或多步采样的问题,将其统一为冻结编码器特征空间中的表示分布匹配。核心洞察是MMD并非无效,而是需要全数据Nyström参考、大批量生成样本、联合图文匹配,并用多编码器约束避免单一表示被“刷分”。所得iRDM在ImageNet一步生成上达到SWr14 1.30,并将四步FLUX.2后训练为一步模型,在GenEval和PickScore上反超原四步版本。

Learning Spectral and Polarimetric Clues for One-to-Multimodal Novel View Synthesis Figure 1
2026-07-03cs.CV

Learning Spectral and Polarimetric Clues for One-to-Multimodal Novel View Synthesis

Federico Lincetto, Gianluca Agresti, Mattia Rossi, Piergiorgio Sartor, Pietro Zanuttigh

MEDIA Lab, University of Padova, Padova, Italy

2026-07-03视觉语言

这篇论文针对多光谱、近红外和偏振新视角合成依赖昂贵传感器与逐场景标定采集的问题,提出 SPoILeR:先在多场景多模态数据上学习共享潜空间和各模态解码器,再用仅 RGB 或少量模态的新场景微调来补全缺失辐射信息,并用专门正则保持跨模态知识。实验表明,即使目标场景没有对应传感器输入,也能生成多视角一致的红外、偏振和多光谱结果。

VisionAId: An Offline-First Multimodal Android Assistant for People with Visual Impairment, Featuring Personalized Object Retrieval Figure 1
2026-07-03cs.CV

VisionAId: An Offline-First Multimodal Android Assistant for People with Visual Impairment, Featuring Personalized Object Retrieval

Cristian-Gabriel Florea, Stelian Spînu

International Student Conference, Military Technical Academy, Bucharest, Romania.The source code and documentation are publicly available at

2026-07-03视觉语言视觉感知

VisionAId面向视障用户在避障、找个人物品、认人和识别现金时对联网服务或专用硬件的依赖,提出离线优先的安卓多模态助手。其核心是将深度估计、分割、视觉/人脸嵌入和纸币检测等模型本地化,并用少样本流程学习用户私人物品,再结合AR、空间音频和触觉引导检索。实验显示,深度模型INT8量化后延迟由约1200 ms降至491 ms,罗马尼亚纸币检测mAP@50达0.986,3米内深度校准误差低于1 cm。

GAP-GDRNet: Geometry-Aware Monocular Visual Pose Sensing on a Single-Target Synthetic Spacecraft Dataset Figure 1
2026-07-03cs.CV

GAP-GDRNet: Geometry-Aware Monocular Visual Pose Sensing on a Single-Target Synthetic Spacecraft Dataset

Yonglong Zhang, Yang Liu

2026-07-03数据集/基准三维

这篇论文面向非合作航天器单目6D位姿估计中弱纹理、细长结构、光照变化和遮挡导致几何证据稀疏的问题,在GDR-Net框架中加入AFR以同时强化全局结构与局部轮廓/弱纹理线索,并在Patch-PnP中加入PGSA建模几何patch关系。其单目标合成航天器数据集由Blender生成密集监督;结果显示旋转误差1.96°、平移误差0.0165 m、ADD@0.02 m为95.16%,较复现GDR-Net提升3.88个百分点,推理约35.97 FPS,但真实航天器泛化未充分说明。

The Moving Eye: Enhancing VLA Spatial Generalization via Hybrid Dynamic Data Collection Figure 1
2026-07-03cs.RO

The Moving Eye: Enhancing VLA Spatial Generalization via Hybrid Dynamic Data Collection

Jincheng Tang, Yilong Zhu, Zhengyuan Xie, Jiang-Jiang Liu, Jiaxing Zhang

2026-07-03学习理论

本文针对VLA机器人策略在相机姿态或物体布局轻微变化下易失效的问题,指出关键不是视角数量不足,而是模型学到相机-基座、相机-物体和物体位置的捷径相关。作者用双臂系统让一臂充当移动环境相机,比较固定、多固定和连续移动视角,并提出静态多视角与动态视角混合的数据采集策略。实验显示该策略比单纯增加静态视角更能提升未见相机位姿和物体配置下的泛化,且对ACT、Diffusion、Pi0、Gr00t等模型均有效。

NEvo: Neural-Guided Evolutionary Video Synthesis for Dynamic Visual Selectivity Figure 1
2026-07-03cs.CV

NEvo: Neural-Guided Evolutionary Video Synthesis for Dynamic Visual Selectivity

Yingtian Tang, Sogand Salehi, Ming Zhou, Amir Zamir, Leyla Isik, Martin Schrimpf

Johns Hopkins University

2026-07-03视觉感知

这篇论文针对以往脑编码与最优刺激合成多停留在静态图像、难以解释动态视觉选择性的问题,提出 NEvo:用动态脑编码模型评估视频对目标皮层 ROI 的预测激活,并在可解释的语义、运动和事件提示空间中做进化搜索。结果显示,合成视频在腹侧、背侧和外侧视觉通路中超过手工 localizer 与检索基线,恢复已知选择性,并揭示外侧通路从运动到社会互动特征的复杂度梯度。

InvSplat: Inverse Feed-Forward Scene Splatting Figure 1
2026-07-03cs.CV

InvSplat: Inverse Feed-Forward Scene Splatting

Polina Karpikova, Wenjing Bian, Haofei Xu, Hendrik Lensch, Andreas Geiger

2026-07-03视觉感知

InvSplat针对逆渲染中优化法逐场景拟合昂贵、2D前馈/扩散方法多视角不一致且难以稳定新视角渲染的问题,提出从有位姿多视图一次前向预测带法线、透明度、反照率、金属度和粗糙度的3D高斯表示,将材质估计先验并入3D重建骨干。实验显示其在合成与真实数据上提升多视角一致性、材质恢复和新视角渲染稳定性,并支持基于物理的重光照。

Search-based Testing of Vision Language Models for In-Car Scene Understanding Figure 1
2026-07-03cs.CV

Search-based Testing of Vision Language Models for In-Car Scene Understanding

Lev Sorokin, Chen Yang, Ken E. Friedl, Andrea Stocco

BMW Group, Technical University of Munich, Technical University of Munich, Technical University of Munich, fortiss GmbH, BMW Group, Technical University of Munich Munich Germany, Technical University of Munich Munich Germany, Technical University of Munich, fortiss GmbH Munich Germany

2026-07-03视觉感知

面向座舱监控中VLM可能误判驾驶员状态、物体与安全事件且真实数据难获取的问题,本文提出ISU-Test:用可控渲染参数化人物、物体、座椅安全带和光照,并以搜索优化主动寻找失败场景,同时为VQA和开放式caption设计适配的fitness与oracle。实验覆盖工业原型和开源VLM,相比随机生成最高带来10倍失败率、3.6倍失败覆盖提升。

Dual-Selective Network for Domain-Incremental Change Detection Figure 1
2026-07-03cs.CV

Dual-Selective Network for Domain-Incremental Change Detection

Yuzhi He, Junxi Huang, Haorui Wu, Jiahui Qu

2026-07-03视觉感知

本文针对域增量变化检测中“标签空间固定、地理域持续漂移”导致的灾难性遗忘与空间表征混淆,提出基于视觉状态空间模型的 DSINet:用选择性空间状态单元过滤域特有噪声、保留通用变化结构,并以浓度平衡蒸馏稳定跨域知识迁移。实验称其在长域序列上能更好保留历史知识、保持边界清晰,同时维持线性计算效率。

Real-Time Visual Intelligence on Low-Cost UAVs: A Modular Approach for Tracking, Scanning, and Navigation Figure 1
2026-07-03cs.RO

Real-Time Visual Intelligence on Low-Cost UAVs: A Modular Approach for Tracking, Scanning, and Navigation

Andrei-Marian Ungureanu, Stelian Spînu

A. M. UNGUREANU is with the Military Technical Academy “Ferdinand, S. SPÎNU is with the Military Technical Academy “Ferdinand I”, AI models and tangible applications, offering a scalable, publicly available at the following GitHub repository:, keeping the person centered within the video frame, even as, center of the image. As shown in Fig. 1, when the detected, face is outside the center zone, this positional offset is used, Figure 1. Face outside the center zone

2026-07-03机器人视觉感知

面向低成本无人机在室内、GPS 受限等场景中难以实时感知与自主控制的问题,本文基于 DJI Tello 构建模块化视觉系统,将 YuNet 人脸检测、FaceNet 识别、单目深度估计与 PID 控制、网页监控界面集成。实验展示了跟随人物、室内扫描和虚拟传感器循线等功能可在受限硬件上运行,但量化对比与鲁棒性边界文中未充分说明。

Optimizing Visual Generative Models via Distribution-wise Rewards Figure 1
2026-07-03cs.LG

Optimizing Visual Generative Models via Distribution-wise Rewards

Ruihang Li, Mengde Xu, Shuyang Gu, Leigang Qu, Fuli Feng, Han Hu, Wenjie Wang

2026-07-03生成模型强化学习

本文针对视觉生成模型中样本级奖励易导致 reward hacking、模式坍塌和伪影的问题,提出用 FID 等分布级奖励进行强化学习微调,并用 subset-replace 降低估计成本、为 rollout 提供密集信号;同时将奖励用于搜索 post-hoc 模型合并系数以缓解 SDE 训练与 ODE 推理不一致。实验显示 SiT 的 FID-50K 从 8.30 降至 5.77,EDM2 从 3.74 降至 3.52,且定性结果表明画质提升同时保持多样性。

DisciplineGen-1M: A Large-Scale Dataset for Multidisciplinary Visual Generation and Editing Figure 1
2026-07-03cs.CV

DisciplineGen-1M: A Large-Scale Dataset for Multidisciplinary Visual Generation and Editing

Zhaokai Wang, Mingxin Liu, Zirun Zhu, Ziqian Fan, Yiguo He, Mohan Zhang, Leyao Gu, Xiangyu Zhao, Ning Liao, Shaofeng Zhang, Xuanhe Zhou, Zhihang Zhong, Junchi Yan, Xue Yang

2026-07-03数据集/基准

本文针对现有生成/编辑模型在公式、图表、分子结构等知识密集型学术视觉中易出现符号、结构和空间关系错误的问题,构建 DisciplineGen-1M:覆盖十个学科、含 120 万样本的生成与编辑数据集,并结合矢量渲染、OCR 编辑、程序合成和大规模过滤提供结构化监督。基于该数据训练的 Qwen 系模型在 GenExam、GRADE 上优于开源基线,并在 WISE、RISE 显示迁移收益,但增益可能主要来自 scaling / data。

FlowCIR: Semantic Transport via Flow Matching for Zero-Shot Composed Image Retrieval Figure 1
2026-07-03cs.CV

FlowCIR: Semantic Transport via Flow Matching for Zero-Shot Composed Image Retrieval

Zhenqi He, Ziqi Jiang, Yuanpei Liu, Yanghao Wang, Teng Wang, Long Chen

2026-07-03视觉感知生成模型三维

针对零样本组合图像检索中,文本反演把参考图压缩成少量伪词、易丢失细粒度视觉语义且训练开销大的问题,FlowCIR将图文组合改写为VLM嵌入空间中的条件语义传输,用流匹配学习轻量速度场,把指令表示在参考图条件下推向目标查询嵌入;同时用推理期多负向引导缓解CLIP对否定/移除语义混淆。实验显示其在CIRR、CIRCO等基准上取得有竞争力或更强结果,并可约单卡一小时训练完成。

AGVBench: A Reliability-Oriented Benchmark of Data Augmentation for Vein Recognition Figure 1
2026-07-03cs.CV

AGVBench: A Reliability-Oriented Benchmark of Data Augmentation for Vein Recognition

Haiyang Li, Yuming Fu, Qun Song, Hongchao Liao, Jing Chen, Mounim A.EI-Yacoubi, Xin Jin

H. Liao is with the Guangzhou College of Applied Science and Technology, Guangzhou, Guangdong Province, China.

2026-07-03视觉感知数据集/基准

针对静脉识别小样本与成像变化下常直接套用自然图像增强、可能破坏血管拓扑的问题,AGVBench构建面向可靠性的增强基准,统一评测30种方法、5个掌/指静脉数据集和7类骨干,并纳入校准、腐蚀、对抗、遮挡与效率等维度。结果显示MixUp、PuzzleMix等多图混合通常提升识别性能,但校准差且对抗脆弱;强几何变换常损害性能,说明仅看准确率不足。

AnyGroundBench: A Specialized-Domain Benchmark for Video Grounding in Vision-Language Models Figure 1
2026-07-03cs.CV

AnyGroundBench: A Specialized-Domain Benchmark for Video Grounding in Vision-Language Models

Rintaro Otsubo, Ryo Fujii, Reina Ishikawa, Taiki Kanaya, Kanta Sawafuji, Hiroki Kajita, Shigeki Sakai, Hideo Saito, Ryo Hachiuma

Keio University, Keio AI Research Center, Keio University School of Medicine

2026-07-03视觉语言视觉感知数据集/基准

这篇论文针对现有视频时空定位评测过度依赖日常场景零样本测试、难以反映专业领域部署的问题,提出 AnyGroundBench:覆盖动物、工业、体育、手术和公共安全五类场景,包含专门训练子集与高密度时空框标注,用于评估领域适应能力。对15个VLM的实验显示,当前模型在专业域零样本和ICL适应下均表现不足,主要瓶颈在空间定位,少样本示例对时序有时有益但对定位精度不稳定。

ArcAD: Anomaly-Rectified Calibration for Cold-Start Supervised Anomaly Detection Figure 1
2026-07-03cs.CV

ArcAD: Anomaly-Rectified Calibration for Cold-Start Supervised Anomaly Detection

Ningning Han, Lei Fan, Jia Guo, Yunkang Cao, Xiu Su, Feng Cao, Donglin Di, Tonghua Su

2026-07-03视觉感知

本文针对工业异常检测冷启动中正常样本覆盖不足、少量缺陷又易导致监督方法过拟合的问题,提出可插入重建式基线的 ArcAD。其关键做法是在超球面上用 Sinkhorn 原型建模压紧正常簇,并结合受原型约束的伪异常与真实缺陷进行对比校准,从而收紧正常边界。实验覆盖 MVTec-AD、VisA、Real-IAD 和 MANTA,在单类与多类冷启动设置下均优于多种监督和无监督基线。

When Token Compression Breaks: Structural Pruning vs. Token Reduction for Robust ViT Segmentation under High Compression Figure 1
2026-07-03cs.CV

When Token Compression Breaks: Structural Pruning vs. Token Reduction for Robust ViT Segmentation under High Compression

Tien-Phat Nguyen, Ngai-Man Cheung

2026-07-03视觉感知安全鲁棒

这篇论文关注 ViT 语义分割在高压缩部署时的可靠性问题,指出仅看低中等压缩和干净精度会掩盖鲁棒性风险。作者在匹配 FLOPs 下统一比较 token 压缩与结构剪枝,并纳入 ADE20K/Cityscapes 及腐蚀版本;结果显示 token 压缩轻度有效但高压缩下精度和鲁棒性急剧下降,结构剪枝退化更平滑,适度剪枝后再合并 token 可在高压缩预算下取得更好的精度-鲁棒性折中。

Efficient Waste Sorting for Circular Economy: A Confidence-guided comparison between One-Vs-All and One-Vs-Rest Classification Strategies with Human-in-the-Loop for Automated Waste Sorting Figure 1
2026-07-03cs.CV

Efficient Waste Sorting for Circular Economy: A Confidence-guided comparison between One-Vs-All and One-Vs-Rest Classification Strategies with Human-in-the-Loop for Automated Waste Sorting

Mohammed Fahad Ali, Dominique Briechle, Marit Briechle-Mathiszig, Tobias Geger, Andreas Rausch

2026-07-03视觉感知

论文面向德国市政垃圾分类规则差异大、居民易误投的问题,比较可配置废弃物识别中 OvA 与 OvR 两种分类策略,并用置信度阈值把不确定样本交给人工复核。结果显示 OvA 总体准确率略高、少错 5 张图,但 OvR 更能定位高风险样本:复核不足 10% 样本可覆盖 80% 以上误分类,体现其在人机协同和规则适配上的实用价值。

DetailAnywhere: Fashion Detail Generation via Cross-Modal Feature Alignment Distillation Figure 1
2026-07-03cs.CV

DetailAnywhere: Fashion Detail Generation via Cross-Modal Feature Alignment Distillation

Zijun Li, Yimin Zhou, Jia Sun, Honglie Wang, Pengcheng Wei, Junlong Wu, Yongrui Heng, Jiyuan Wang, Huan Ouyang, Boheng Zhang, Huaiqing Wang, Dewen Fan, Qianqian Gan, Fan Yang, Tingting Gao

AIM for Health Lab, Monash University

2026-07-03视觉感知

这篇论文针对电商服装中用户想查看领口、袖口、面料纹理等局部细节而现有生成/编辑方法缺少自由聚焦能力的问题,定义Fashion Detail Generation并构建FDBench。核心做法是用DINOv3视图桥接教师完成框选参考图与细节图的语义对齐,再蒸馏到MMDiT双分支,并用一致性奖励RL强化身份保持。实验显示DetailAnywhere在自动指标和人工评测上优于开源基线,接近专有模型,但跨品类泛化仍未充分说明。

MedSaab-US: A Backpropagation-Free Multi-Scale Wavelet-Saab Framework for Thyroid Nodule Segmentation in Ultrasound Images Figure 1
2026-07-03cs.CV

MedSaab-US: A Backpropagation-Free Multi-Scale Wavelet-Saab Framework for Thyroid Nodule Segmentation in Ultrasound Images

Mohammad Amanour Rahman

2026-07-03视觉感知

本文针对深度模型在甲状腺超声结节分割中参数多、依赖 GPU 反向传播且可解释性弱的问题,提出 MedSaab-US:用多级小波分解结合多尺度 Saab 解析特征、LAG 选特征,再由 XGBoost 做像素分类。其价值在于提供一个无反传、轻量且 CPU 可运行的非深度学习基线;但在 TN3K 上 Dice 仅 0.4784,明显低于主流深度方法,主要结果更偏向部署友好与可解释探索,而非精度领先。

RadiomicNet: A Hybrid Radiomics-Guided Lightweight Architecture for Interpretable Medical Image Segmentation Figure 1
2026-07-03cs.CV

RadiomicNet: A Hybrid Radiomics-Guided Lightweight Architecture for Interpretable Medical Image Segmentation

Mohammad Amanour Rahman

2026-07-03视觉感知

这篇论文针对医学图像分割中模型庞大、决策难解释和校准不足的问题,提出 RadiomicNet:用 MobileNetV2 编解码器结合手工放射组学特征,并通过 RAG 将 GLCM、LBP 等纹理线索注入跳连注意力,同时用一致性损失约束纹理复杂度与不确定性。实验在 BUSI 和 Kvasir-SEG 上分别达到 0.763、0.854 DSC,较 U-KAN 小幅提升且仅 3.27M 参数,但增益幅度不大,仍需关注数据划分与实现细节。

Efficient PEFT Methods with Adaptive Checkpointing for Vision Models and VLMs on Resource Constrained Consumer-GPUs Figure 1
2026-07-03cs.CV

Efficient PEFT Methods with Adaptive Checkpointing for Vision Models and VLMs on Resource Constrained Consumer-GPUs

Altay Toktassyn, Jurn-Gyu Park

A. Toktassyn and J. G. Park are with the Department of Computer Science, Nazarbayev University, Astana 010000, Kazakhstan

2026-07-03视觉语言视觉感知

面向2–8GB显存消费级GPU/边缘设备上视觉模型微调易OOM且能耗受限的问题,本文系统比较ViT/TinyViT与Vim/MambaVision上的Full FT、LoRA、AdaLoRA、QLoRA、BitFit,并提出按运行时显存预算选择性重计算的自适应checkpointing及部署感知NetScore指标。结果显示QLoRA、BitFit以1–2%精度损失换来20–30%能耗下降,自适应checkpointing降峰值显存43–79%但增加9–30%能耗;DINOv2在CIFAR-100上以更低能耗超过微调模型,小型自回归VLM不具竞争力。

Patient-Specific Articulated Digital Twins from a Single Full-Body CT Scan Figure 1
2026-07-03cs.CV

Patient-Specific Articulated Digital Twins from a Single Full-Body CT Scan

Han Zhang, Boyang Zhao, Mathias Unberath

2026-07-03视觉感知

针对单次 CT 重建只能保持扫描姿态、难以模拟患者重新摆位后 X 光外观的问题,本文将 SMPL 作为运动学骨架,绑定 CT 分割出的骨骼和器官,构建可关节化的个体数字孪生。三例全身 CT 上,骨架拟合 Chamfer 距离为 15.8±4.0 mm,骨骼包围率约 95.9%,重组 DRR 的 SSIM 为 0.872,未见姿态下仍保持约 94.4% 骨骼包围率,但验证规模较小且软组织变形建模有限。

SAMoR: Motion Modelling for Articulated Objects of Any Skeleton and Topology Figure 1
2026-07-03cs.CV

SAMoR: Motion Modelling for Articulated Objects of Any Skeleton and Topology

Yuhao Zhang, Gerard Pons-Moll, Tolga Birdal

Imperial College London, University of Tübingen, Tübingen AI Center

2026-07-03视觉感知

针对现有运动生成多绑定固定人体骨架、难以在不同关节数和拓扑间共享表示的问题,SAMoR将跨物种/角色的对应关系提升到“功能关节组”层面,用图Transformer融合关节运动、骨架结构和关节名,并压缩为8个共享部件token及离散码本。注意力监督和关节名dropout缓解查询坍缩与标签依赖。实验显示其在未见骨架跨拓扑重建上达到2.75×10^-2 normalized MPJPE,较最强可变关节tokenizer低5.8倍,并支持运动迁移、文本生成和局部编辑。

Predicting Early Stages Of Alzheimer's Disease And Identifying Key Biomarkers Using Deep Artificial Neural Network And Ensemble Of Machine Learning Methodologies Figure 1
2026-07-03cs.LG

Predicting Early Stages Of Alzheimer's Disease And Identifying Key Biomarkers Using Deep Artificial Neural Network And Ensemble Of Machine Learning Methodologies

Debopriya Ghosh

dementia. At present, no drugs are available to prevent this disease, but some symptom-delaying, drugs are available that can slow the disease's progression to some extent. Therefore, an

2026-07-03强化学习

这项研究面向阿尔茨海默病早期症状易被误判、干预窗口有限的问题,使用ADNI临床、神经心理与影像指标构建自动分期诊断流程。其核心在于将迭代缺失值填补、SVM-SMOTE类平衡、多种特征选择与Stacking集成及ANN对比结合,同时尝试提取关键生物标志物。文中说明以precision、recall、F1和AUC-ROC比较模型,但具体最优数值与增益来源未充分说明,可能主要来自预处理、特征筛选和数据划分。

AdaCount: Training-Free Similarity-Guided Spatial and Feature Adaptation for Zero-Shot Object Counting Figure 1
2026-07-03cs.CV

AdaCount: Training-Free Similarity-Guided Spatial and Feature Adaptation for Zero-Shot Object Counting

Muhammad Ibraheem Siddiqui, Muhammad Haris Khan

Mohamed Bin Zayed University of Artificial Intelligence

2026-07-03视觉感知

AdaCount针对SAM3在密集小目标零样本计数中因分辨率不足和目标区域关注不够而漏检的问题,提出无需训练的相似度引导适配:先用原型相似图定位目标相关区域,再同时进行空间扭曲以重分配图像分辨率、特征调制以增强目标表征。相比依赖多次分块推理的SAM3Count,它仅需两次SAM3推理,并在六个计数基准上达到训练自由ZOC方法的新SOTA。

AbsoluteDegradation: A Physics-Inspired Synthetic Film-Degradation Pipeline and Archival Film Restoration Benchmark Figure 1
2026-07-03cs.CV

AbsoluteDegradation: A Physics-Inspired Synthetic Film-Degradation Pipeline and Archival Film Restoration Benchmark

Mikołaj Jastrzębski, Dawid Glinkowski, Dawid Zieliński, Daniel Borkowski, Wojciech Kozłowski, Kamil Adamczewski

Wrocław University of Science and Technology

2026-07-03数据集/基准

针对老电影修复缺少真实成对数据和统一评测的问题,论文提出 AbsoluteDegradation:按模拟胶片到数字化链路组合信号相关蓝噪声颗粒、参数化划痕、gate-weave 抖动等时序一致退化,并发布 81,576 帧真实档案胶片基准。实验显示,用该合成管线训练的多种模型在真实素材上泛化更好,同时基准揭示常用无参考指标会偏好过平滑或不真实的幻觉修复。

Population-Scale Segmentation of Penile Tissue in DIXON MRI using Deep Learning for Quantitative Phenotyping in Male Reproductive Health Figure 1
2026-07-03eess.IV

Population-Scale Segmentation of Penile Tissue in DIXON MRI using Deep Learning for Quantitative Phenotyping in Male Reproductive Health

Jan Ernsting, Gunnar Paul Kordes, Nils Johannaber, Lynn Ogoniak, Wolfgang Roll, Tim Hahn, Alexander Siegfried Busch, Benjamin Risse

University of Münster

2026-07-03视觉感知

针对传统阴茎长度/周径测量难以标准化且无法覆盖内部组织的问题,本文将多通道 DIXON MRI 中的全阴茎组织分割建模为可规模化表型提取任务,构建专家标注数据和双专家测试集并优化 3D nnU-Net。模型在独立测试集达到 Dice 0.92、Hausdorff 3.58,并部署到 34,412 名 UK Biobank 参与者,纵向复测相关 r=0.87。

X-Splat: Gaussian Splatting for 3D CBCT Generation from Single Panoramic Radiograph Figure 1
2026-07-03cs.CV

X-Splat: Gaussian Splatting for 3D CBCT Generation from Single Panoramic Radiograph

Tomasz Szczepański, Szymon Płotka, Michal K. Grzeszczyk, Tomasz Trzciński, Arkadiusz Sitek

Sano Centre for Computational Medicine, Poland, Jagiellonian University, Poland, Warsaw University of Technology, Poland, Research Institute IDEAS, Poland, Harvard Medical School, USA

2026-07-03三维

针对单张全景牙片生成3D CBCT高度欠定、易产生平滑或解剖幻觉的问题,X-Splat把已知全景成像射线作为几何脚手架,在射线路径上初始化可学习各向异性3D高斯,并用Beer–Lambert重投影、多视角DRR监督和轻量残差细化约束体生成。实验显示其优于NeRF和GAN基线,更好恢复牙根、皮质边界、牙槽结构及下颌管;但训练依赖合成PXR–CBCT配对,真实域泛化仍需进一步验证。

WBMM: Windowed Batch Matrix Multiplication for Efficient Large Receptive Field Convolution Figure 1
2026-07-03cs.CV

WBMM: Windowed Batch Matrix Multiplication for Efficient Large Receptive Field Convolution

Wan Song, Wei Zhou, Rui Wang, Jun Yu, Toru Kurihara, Jiajia Xu, Shu Zhan

2026-07-03视觉感知

这篇论文针对大核深度卷积随核尺寸增大而因离散 gather 访存变慢、且 LKA 在大特征图上失效的问题,提出 WBMM:把输入切成连续窗口,用相对位置表构造通道权重矩阵,再用批量矩阵乘法计算,从“遍历数据”转为“遍历参数”。结果显示其在 14×14 窗口下速度可超过 5×5 深度卷积且感受野更大,并在 ImageNet、COCO、ADE20K 上取得相近或更高精度与 1.31–1.88× 训练加速。

LongEgoRefer: A Benchmark for Long-Form Egocentric Video Referring Expression Comprehension Figure 1
2026-07-03cs.CV

LongEgoRefer: A Benchmark for Long-Form Egocentric Video Referring Expression Comprehension

Shunya Kato, Taiki Miyanishi, Shuhei Kurita, Mahiro Ukai, Nakamasa Inoue, Chenhui Chu

2026-07-03视觉感知数据集/基准

针对现有第一视角 Video REC 基准多为短片段、目标密集且交互简单,LongEgoRefer 用 Ego4D 长视频与 EgoTracks 标注构建平均 45 分钟、1498 条描述的长程指代表达基准,强调稀疏目标、复杂人-物交互和更细粒度语言消歧。实验显示滑窗式现有模型缺乏全局时序理解,两阶段 VLM+Grounded SAM2 又受时间定位误差传播限制,即使强闭源模型表现也仍有限。

Multimodal Fusion for Fine-Grained Classification of Breast Fibroadenoma and Phyllodes Tumors Figure 1
2026-07-03cs.CV

Multimodal Fusion for Fine-Grained Classification of Breast Fibroadenoma and Phyllodes Tumors

Chuxi Nan, Di Wu, Hongming Guo, Ning Cao, Xiaohui Zhu, Zhaoting Shi, Jiawei Li

School of Integrated Circuits, Wuxi Vocational College of Science and Technology, School of Advanced Technology, Xi’an Jiaotong-Liverpool University, Shanghai Gem Science and Technology Co., Ltd., Department of Oncology, Shanghai Medical College, Fudan University, Department of Medical Ultrasound, Fudan University Shanghai Cancer Center

2026-07-03视觉语言

针对乳腺纤维腺瘤与叶状肿瘤在B超中高度相似、术前易误判的问题,论文构建了含910例病理确认病例的FAPT-M多模态数据集,并融合超声图像、诊断文本和临床变量,通过临床条件调制与跨模态Transformer增强细粒度判别;五折验证达到77.64%准确率、73.38% F1和89.74% AUC,优于多类CNN、Transformer和视觉语言基线。

TCG-AR: Real-Time Multi-View Augmented Reality for Trading Card Game Streaming Figure 1
2026-07-03cs.CV

TCG-AR: Real-Time Multi-View Augmented Reality for Trading Card Game Streaming

Anthony Cioppa, Antoine Verdonck, Maxim Henry, Marc Van Droogenbroeck, Raphaël La Rocca

Equal contributions. Code: https://github.com/ULiege-VIULab/tcg-ar

2026-07-03视觉感知

面向线上集换式卡牌直播画面扁平、现有 AR 方案依赖芯片或专用桌面的痛点,TCG-AR 用普通 RGB 多视角相机完成卡牌检测、朝向估计、身份识别与跨视角注册,并用自动合成数据训练以减少人工标注。论文在真实宝可梦卡牌数据上评估 Sim2Real 与吞吐,显示检测和 ArcFace 识别可支撑实时增强直播,但自动配准、遮挡下时序跟踪和 2D 渲染仍是主要限制。

ESC: Emotional Self-Correction for Reliable Vision-Language Models Figure 1
2026-07-03cs.CV

ESC: Emotional Self-Correction for Reliable Vision-Language Models

Tien-Huy Nguyen, Minh-Nhat Nguyen, Nguyen Nhat Huy, Hung Viet Nguyen, Huy Nguyen Minh Nhat, Thanh-Huy Nguyen, Cuong Tuan Nguyen, Hoang M. Le, Dat Nguyen, Phat Kim Huynh, Min Xu, Ulas Bagci

2026-07-03视觉语言视觉感知

这篇论文针对视觉语言模型在幻觉、安全与多模态推理中易给出不可靠答案、而现有自纠错常需后训练或复杂反馈的问题,提出ESC:用外部验证器识别可疑初答,并在推理时注入情绪化反馈促使模型放慢、反思并修正。核心洞察是情绪可作为触发潜在自纠错能力的控制信号。实验显示ESC在安全、幻觉、视觉感知和推理基准上稳定提升可靠性,同时基本保持模型通用能力。

DeepGaze3.5-VL: Modeling Scanpaths via Autoregressive Token Prediction Figure 1
2026-07-03cs.CV

DeepGaze3.5-VL: Modeling Scanpaths via Autoregressive Token Prediction

Susmit Agrawal, Matthias Bethge, Matthias Kümmerer

2026-07-03视觉感知

本文针对传统扫视路径模型依赖手工几何先验、难以灵活加入任务或个体条件的问题,将人眼注视坐标离散为自回归 token,用 LoRA 微调视觉语言模型生成扫描序列,并把信息增益与下一 token 似然直接对齐。结果显示 DeepGaze3.5-VL 在 MIT1003 达到 2.18 bits IG,较匹配骨干的 DeepGaze III 提升 46%,且可通过提示建模个体、任务和注视时长干预。

HandsOnWorld: Unconstrained Egocentric Video Generation with Camera-Disentangled Hand Control Figure 1
2026-07-03cs.CV

HandsOnWorld: Unconstrained Egocentric Video Generation with Camera-Disentangled Hand Control

Yushuo Chen, Xiaoyu Shi, Xiaoshi Wu, Xintao Wang, Pengfei Wan, Yebin Liu

Tsinghua University, Chinese University of Hong Kong

2026-07-03视觉感知强化学习规划控制

HandsOnWorld针对第一视角视频生成中“手部可控但训练数据受限”的问题:精细3D手标注通常依赖多视角或动捕,导致方法局限在桌面/实验室场景。论文用单目重建从野外自我中心视频中筛出主角手轨迹,构建EgoVid-Pro,并提出Plücker Hand Map在世界坐标中同时表达相机与手表面射线,以解耦大幅头部运动和手部动作。实验显示其在重建保真度、控制精度和跨日常场景泛化上优于既有手控生成方法。

Comprehensive Robustness Analysis of LiDAR-based 3D Object Detection in Autonomous Driving Figure 1
2026-07-03cs.CV

Comprehensive Robustness Analysis of LiDAR-based 3D Object Detection in Autonomous Driving

Adwait Chandorkar, Kai Krink, Yerdana Maulenbay, Hasan Tercan, Tobias Meisen

2026-07-03视觉感知三维安全鲁棒

本文针对自动驾驶中 LiDAR 3D 检测“干净数据精度高但对抗鲁棒性未知”的问题,提出不只看 mAP 的综合评测框架,将点云密度、点云定位与误分类、框定位误差、距自车距离等因素分开分析。实验覆盖 nuScenes、Waymo、现代与传统检测器及多种 LiDAR 专用攻击,发现新一代模型并未显著摆脱脆弱性:高容量体素模型更易受结构化坐标扰动影响,非 anchor 检测头鲁棒性较差,说明现有架构改进主要提升常规精度而非安全鲁棒性。

Beyond the Performance Illusion: Structure-Aware Stratified Partitioning and Curriculum Distributionally Robust Optimization for Spatially Correlated Domains Figure 1
2026-07-03cs.LG

Beyond the Performance Illusion: Structure-Aware Stratified Partitioning and Curriculum Distributionally Robust Optimization for Spatially Correlated Domains

Prathamesh Patil, Arpit Jain, Aswanth Krishnan

QpiAI India Pvt. Ltd.

2026-07-03优化算法安全鲁棒

这篇论文针对空间/时间相关数据中随机划分会造成近重复样本泄漏、并掩盖少数子群失败的问题,提出将评测划分与训练联合处理:SASP在保持类别均衡的同时构造结构上更独立的验证集,CDRO再以课程式鲁棒优化稳定困难子群训练。实验称在航拍、农业和医学影像基准上可降低虚高性能、改善泛化与置信校准,但具体增益来源仍需结合实现细节判断。

Embracing Intra-Class Heterogeneity for Semi-Supervised Medical Image Segmentation: From Diversity to Precision Figure 1
2026-07-03cs.CV

Embracing Intra-Class Heterogeneity for Semi-Supervised Medical Image Segmentation: From Diversity to Precision

Yuqi Liu, Yufei Chen, Wei Fu, Xiaodong Yue, Shuo Li

2026-07-03视觉感知

针对半监督医学图像分割中标注稀缺且同一解剖结构存在强烈类内强度异质性的问题,论文提出 MPCL:用与强度分布对齐的多原型生成刻画亮/灰/暗等子区域,再通过原型空间优化和双分支知识对齐把异质性知识传给分割网络。三组异质性医学数据实验显示其优于现有方法,尤其在极少标注场景下更明显。

PWM-ArtGen: Part World Model for Articulated Object Generation Figure 1
2026-07-03cs.CV

PWM-ArtGen: Part World Model for Articulated Object Generation

Wentao Zheng, Ancong Wu

2026-07-03强化学习

本文面向单张静态图像难以可靠推断铰接物体运动结构的问题,指出视觉动态与关节参数应联合建模而非分步估计。PWM-ArtGen 将动作扩散与图像扩散耦合为部件世界模型,并用独立扩散步支持无标注视觉分支共训练,同时引入视觉动态正则和 19.7k photorealistic 图像对数据。实验称其在静止状态生成和零样本 OOD 物体上优于基线,但部分增益可能主要来自 data scaling。

Hierarchical Anti-Aesthetics: Protecting Facial Privacy against Customized Diffusion Models Figure 1
2026-07-03cs.CV

Hierarchical Anti-Aesthetics: Protecting Facial Privacy against Customized Diffusion Models

Songping Wang, Yueming Lyu, Shiqi Liu, Chen Zhao, Ziyuan Chen, Ning Li, Jing Dong, Caifeng Shan

2026-07-03生成模型

针对个性化扩散模型可被少量人脸图像恶意微调并生成深伪内容的问题,论文从“审美偏好”切入,提出 HAA:同时用全局反审美奖励降低整体生成质量、用局部反审美损失破坏脸部细节与身份线索。实验称其在多数据集和生成模型上比 Mist、ASPL、CAAT 等方法更能去除身份并减少隐私泄露。

ComplexMimic: Human-Scene Interaction Imitation in Complex 3D Environments Figure 1
2026-07-03cs.CV

ComplexMimic: Human-Scene Interaction Imitation in Complex 3D Environments

Lu Pan, Hongwei Zhao

2026-07-03模仿学习三维

这篇论文针对复杂三维场景中人形体模仿既要贴合 MoCap 轨迹又要避免碰撞的矛盾,指出早停阈值会形成可行性—忠实度权衡。ComplexMimic 先训练追踪专家与场景交互专家,再用难度感知蒸馏统一策略,按失败统计优先学习困难轨迹。在 TRUMANS、LINGO 和 GIMO 等数据集上,相比基线提升成功率并降低全局 MPJPE,显示复杂 HSI 下更好的泛化与物理可行性。

Evaluating Vision-Language Models as a Zero-Shot Learning Alternative to You Only Look Once and Optical Character Recognition for Nigerian License Plate Recognition Figure 1
2026-07-03cs.CV

Evaluating Vision-Language Models as a Zero-Shot Learning Alternative to You Only Look Once and Optical Character Recognition for Nigerian License Plate Recognition

Ismail Ismail Tijjani, Ahmad Abubakar Mustapaha, Sunusi Ibrahim Muhammad, Muhammad Bashir Aliyu

-20 November 2025, Ahmadu Bello University, Zaria, Nigeria, department of Mechatronics, Bayero University Kano(BUK)., School of Computer Science and, department of Petroleum, Aliko Dangote University of, This paradigm is labor-intensive, time-consuming and also

2026-07-03视觉语言视觉感知

针对尼日利亚车牌识别中 YOLO+OCR 依赖标注、训练和多阶段部署且在低清晰度、遮挡、角度复杂场景下不稳的问题,论文将 VLM 作为零样本、一提示完成检测与字符读取的替代方案,在 88 张真实困难图像上比较五个模型。以 CER 衡量,Gemini 2.0 Flash Exp 与 Qwen2.5-VL-7B-Instruct 明显优于 GPT-4o、Claude 4 Sonnet 和 Llama 3.2 Vision 90B,但数据规模较小,泛化结论仍需谨慎。

Spatio-Temporal and Clinical Conditioning for Fine-Grained Radiology Report Retrieval Figure 1
2026-07-03cs.CV

Spatio-Temporal and Clinical Conditioning for Fine-Grained Radiology Report Retrieval

P. Sloan, E. Simpson, M. Mirmehdi

2026-07-03视觉感知

针对检索式放射报告生成依赖整份相似报告、缺少解剖定位、忽略既往影像和临床指征的问题,论文提出 STAR3:用检测器提取胸片解剖区域,在当前/既往检查的区域变化与临床指征条件下检索句子,并以半监督对比学习和解剖 dropout 约束检索空间。MIMIC-CXR 实验显示其在检索、NLP 与临床指标上优于现有检索基线,消融支持时空与临床条件化的贡献。

UnderOneFacade: Worldwide Facade Semantic Segmentation Benchmark Dataset Figure 1
2026-07-03cs.CV

UnderOneFacade: Worldwide Facade Semantic Segmentation Benchmark Dataset

Yi Wang, Fan Wang, Prabin Gyawali, Ziyang Xu, Anna Klimkowska, Yixiong Jing, Wanru Yang, Filip Biljecki, Christoph Holst, Benjamin Busam, Brian Sheil, Olaf Wysocki

2026-07-03视觉感知强化学习数据集/基准

面向语义数字孪生和城市三维理解,现有立面分割数据集地域窄、语义不统一且精度不足,限制跨域泛化评估。UnderOneFacade 提供跨洲厘米级三维立面点云、统一分层建筑语义与 27 亿标注点,并系统评测点、图和 Transformer 方法。结果显示细粒度 LoFG3 最佳仅约 33 mIoU,说明当前模型对长尾小构件和跨地区风格迁移仍明显不足,增益可能主要来自 scaling / data。

Mirror Illusion Art Figure 1
2026-07-03cs.CV

Mirror Illusion Art

Xiaopei Zhu, Zeyuan Li, Jun Zhu, Xiaolin Hu

Department of Computer Science and Technology, BNRist, Tsinghua University, Huazhong University of Science and Technology, IDG/McGovern Institute for Brain Research, Tsinghua University, Chinese Institute for Brain Research (CIBR)

2026-07-03视觉感知

这篇论文面向镜面错觉艺术的自动化设计:传统拓扑或阴影方法依赖人工、通常只优化形状,难以得到平滑且可打印的彩色物体。作者提出 AutoMIA,将正面与镜中两张目标图反求为同时含几何和纹理的 3D 对象,并用 PAC、PWA、IVP、SCD 分别抑制表面噪声、背景噪声、内部断裂和形色失衡。实验展示其能生成字母、汉字、图标等多类实物作品,单 RTX 3090 平均约 76 秒、2.6GB 内存完成设计。

EduArt: An educational-level benchmark for evaluating art history knowledge in large language models Figure 1
2026-07-03cs.CL

EduArt: An educational-level benchmark for evaluating art history knowledge in large language models

Gianmarco Spinaci, Lukas Klic, Giovanni Colavizza

Department of Classical Philology and Italian Studies, University of Bologna, Bologna, Italy, Villa i Tatti – The Harvard University Center for Italian Renaissance Studies, Firenze, Italy, Center for Computational and Digital Humanities, University of Copenhagen, Copenhagen, Denmark

2026-07-03数据集/基准

针对通用基准难以诊断单一学科能力、艺术史评测多依赖合成题的问题,EduArt构建了871道来自真实教学与AP考试的双语多格式题,评估12个多模态LLM。结果显示基准区分度较强,但多选题已接近饱和;开放补全、错误识别等生成/操作型题显著拉开差距,说明艺术史知识与可部署能力并不等同,要求解释还常使准确率下降。

A Stereo Visual SLAM System Using Object-Level Motion Estimation and Geometric Filtering Based on Cross Disparity Figure 1
2026-07-03cs.RO

A Stereo Visual SLAM System Using Object-Level Motion Estimation and Geometric Filtering Based on Cross Disparity

Sujan Kumar Dhali, Bhaskar Dasgupta

S. K. Dhali is with Department of Mechanical Engineering, Indian Institute of Technology Kanpur, Kanpur 208016, India

2026-07-03视觉感知

针对动态场景中传统视觉 SLAM 依赖静态世界假设、易受运动物体干扰的问题,论文提出基于 ORB-SLAM2 的 OCD SLAM:一方面用 SMOKE 3D 检测与卡尔曼跟踪做对象级运动分类,另一方面引入“交叉视差”从时序与双目不一致中筛除漏检的动态特征并加权静态点。KITTI Odometry 与 Raw 实验显示其轨迹精度优于 ORB-SLAM2 和多种动态 SLAM,消融表明交叉视差能补足仅靠目标检测的缺口。

Training-free Controllable Human Motion Generation under Heterogeneous Constraints Figure 1
2026-07-03cs.CV

Training-free Controllable Human Motion Generation under Heterogeneous Constraints

Xiaofei Hui, Bo Yan, Haoxuan Qu, Hossein Rahmani, Jun Liu

2026-07-03规划控制优化算法

本文针对现有免训练运动控制方法依赖可微目标、难以处理安全规则、仿真可行性等稀疏或黑盒约束的问题,提出 MIC,将扩散式人体运动生成视为随机控制过程,用统一的逐步控制律接入目标型与判据型约束,并通过反馈调节与控制分配协调多约束强弱和作用范围。实验显示其在多类异构约束场景下能提升约束满足度并保持运动自然性。

Understanding Geometric Representations in Self-Supervised Vision Transformers via Subspace Intervention Figure 1
2026-07-03cs.CV

Understanding Geometric Representations in Self-Supervised Vision Transformers via Subspace Intervention

Weichen Zhou, Yawen Zou, Chunzhi Gu, Ran Dong, Haoran Xie, Chao Zhang

2026-07-03视觉感知

本文关注自监督 ViT 虽具备单目几何能力却难解释其特征如何组织的问题,提出对收敛线性探针权重做 SVD 的受控子空间干预,用低秩任务子空间分析几何信号可读性。结果显示 DINOv2 将几何更集中地编码在线性可取的低秩方向,MAE 更分散且依赖更大空间上下文;几何精度在中层达到峰值,末层随语义抽象增强而下降。

Liquid Latent State Dynamics for Interpretable Turbofan Degradation Modeling Figure 1
2026-07-03cs.LG

Liquid Latent State Dynamics for Interpretable Turbofan Degradation Modeling

Weizhi Nie, Weijie Wang, Yuting Su

Tianjin University

2026-07-03视觉感知

针对涡扇发动机预测维护中传感器变化同时混合退化与工况、隐藏状态难解释的问题,论文将液态神经网络作为潜在动力学转移,并把状态拆成退化与工况两部分,用RUL、单调风险和去相关约束塑造可检查的健康轨迹。在C-MAPSS四个子集上,传感器预测RMSE由GRU的0.2438降至0.2266,多工况场景收益更明显,但直接RUL回归仍弱于GRU,说明其价值主要在可解释退化世界模型而非寿命标定。

Do Newer Lightweight CNNs Perform Better Under Resource Constraints? A Controlled Multigenerational Study of Architecture, Initialization, Training Budget, and Efficiency Figure 1
2026-07-03cs.LG

Do Newer Lightweight CNNs Perform Better Under Resource Constraints? A Controlled Multigenerational Study of Architecture, Initialization, Training Budget, and Efficiency

Tasnim Shahriar

2026-07-03规划控制优化算法

这篇论文关注轻量 CNN 在真实资源约束下是否“越新越好”,用统一下游训练、评估和延迟/内存测量比较九个跨代模型,并用 Pareto 前沿分析精度-资源权衡。结果显示新架构只带来选择性增益:EfficientNetV2-S 领先 CIFAR,RepViT-M1.0 领先 Tiny ImageNet,但 EfficientNet-B0 是最稳定的中等预算选择,严苛资源下 MobileNetV3-Small 反而优于 MobileNetV4-Conv-S。

Open-Weather Robust 3D Detection via Dual-Critic Diffusion Alignment Figure 1
2026-07-03cs.CV

Open-Weather Robust 3D Detection via Dual-Critic Diffusion Alignment

Shuyao Li, Chuanxing Geng, Heyang Sun, Qiang Zhou, Jingjing Gu

2026-07-03视觉感知生成模型三维安全鲁棒

论文针对自动驾驶三维检测在未见天气类型与强度下显著退化的问题,指出现有 LiDAR-4D 雷达融合仍依赖闭集天气假设。其核心是 DCDA:用 4D 雷达条件扩散将受损 LiDAR BEV 特征拉回晴天特征流形,并以冻结晴天检测器和天气对抗判别器分别约束检测语义与分布一致性,无需天气标签或成对数据。在 K-Radar 开放天气基准上,相比较强基线在类型、强度及组合开放设置下分别提升约 5.2、3.0、1.8 个 3D AP 百分点。

MolSight: A Graph-Aware Vision-Language Model for Unified Chemical Image Understanding Figure 1
2026-07-03cs.CV

MolSight: A Graph-Aware Vision-Language Model for Unified Chemical Image Understanding

Wenda Wang, Yihan Tong, Yuwei Hu, Zhewei Wei

Renmin University of China

2026-07-03视觉语言视觉感知

这篇论文针对分子图像中视觉 token 难以保留原子—化学键拓扑、导致 VLM 在 SMILES 识别和性质推理上弱于专用工具的问题,提出 MolSight:用 SVG 作为结构监督,并通过拓扑模块注入键邻接关系、 grounding 模块对齐视觉与符号语义。实验称其在四类化学视觉理解任务上超过通用 VLM、分子 VLM 和部分 OCSR 工具,但具体增益与数据规模的关系仍需结合完整实验细节判断。

Multimodal Knowledge Edit-Scoped Generalization for Online Recursive MLLM Editing Figure 1
2026-07-03cs.AI

Multimodal Knowledge Edit-Scoped Generalization for Online Recursive MLLM Editing

Siyuan Li, Youyuan Zhang, Ruitong Liu, Junxi Wang, Jing Li

2026-07-03视觉语言学习理论

论文针对在线多模态知识编辑中“改对原样本”却不能控制传播边界的问题,指出可靠编辑仍可能对同义跨模态输入欠泛化或向无关输入泄漏。作者提出 ScopeEdit,将更新拆为模态局部吸收分支与证据门控共享泛化分支,并用正交低秩空间和递归预条件保持在线开销。实验显示其在多基准、长编辑流和不同 MLLM 上改善域内跨模态迁移与域外局部性权衡,同时维持可靠性、稳定性和效率。

Assessing VLM Reliability for Medical Image Quality Evaluation Under Corruption and Bias Figure 1
2026-07-03cs.CV

Assessing VLM Reliability for Medical Image Quality Evaluation Under Corruption and Bias

Sofiane Ouaari, Kevin Vorwalder, Nico Pfeifer

2026-07-03视觉语言视觉感知数据集/基准

本文关注VLM被用于医学图像质量自动评估时的可靠性问题:临床部署不仅要求识别退化图像,还要避免提示中的机构、设备和人口学信息影响判断。作者在MediMeta-C上零样本评测16个VLM、7类模态和多级腐蚀,并结合嵌入空间位移分析失效模式。结果显示像素化使评分平均下降20.58%,亮度影响很小;同族模型相关性较高但仍会给腐蚀图像加分,机构声望可使评分升高17.15%、设备老化使评分降低14.7%,说明当前VLM质量评估仍受隐私变换和文本偏置显著干扰。

NeoMap: Training-free Novel-View Synthesis from Single Images and Videos Figure 1
2026-07-03cs.CV

NeoMap: Training-free Novel-View Synthesis from Single Images and Videos

Jinxi Li, Tianyi Zhang, Yafei Yang, Zihui Zhang, Peng Huang, Koon Wing Macgyver Lin, Bo Yang

2026-07-03视觉感知

NeoMap针对单图或单目视频新视角合成中遮挡、深度歧义以及现有相机条件微调/硬引导易产生伪影的问题,提出无需训练的思路:预训练视频模型的数据流形中已包含可行的新视角解,关键是搜索对应初始噪声。方法通过深度 warping 构造几何先验,并在锚定流形投影与像素约束投影间迭代,兼顾语义补全和视角对齐。实验称其在 Tanks-and-Temples、LLFF、DAVIS 上超过现有方法,提升生成保真度并保持较强几何一致性。

Personalized 4D Whole-Heart Mesh Reconstruction from Cine MRI via Multi-Scale Temporal Modeling and Differentiable Contour Rendering Figure 1
2026-07-03cs.CV

Personalized 4D Whole-Heart Mesh Reconstruction from Cine MRI via Multi-Scale Temporal Modeling and Differentiable Contour Rendering

Xiaoyue Liu, Dongcheng Cang, Xiaohan Yuan, Mark YY Chan, Ching-Hui Sia, Lei Li

Department of Biomedical Engineering, National University of Singapore, Singapore, School of Automation, Southeast University, Nanjing, China, Department of Medicine, National University of Singapore, Singapore, Department of Cardiology, National University Heart Centre Singapore, Singapore

2026-07-03三维

该文面向稀疏 cine MRI 难以生成可用于心脏数字孪生的动态全心网格这一问题,提出端到端图像到网格框架,以 Beer-Lambert 启发的可微轮廓渲染约束多视角2D轮廓,并用多尺度时间建模同时保持全周期运动与帧间平滑。实验报告全心 MAE 为 1.68±0.31 mm、运动抖动 0.77±0.17 mm/frame³,优于对比方法,并展示了电生理仿真的可行性,但仍依赖较准确分割且泛化病种有限。

LiZAD: A Lightweight Zero-Shot Anomaly Detection Framework for Industrial Manufacturing Figure 1
2026-07-03cs.CV

LiZAD: A Lightweight Zero-Shot Anomaly Detection Framework for Industrial Manufacturing

Uzair Khan, Luigi Capogrosso, Muhammad Aqeel, Francesco Setti, Michele Magno, Marco Cristani

2026-07-03视觉感知

LiZAD面向产线频繁换型、难以为每类产品采集标注数据且边缘设备算力受限的问题,将DINOv3的密集空间视觉特征与MobileCLIP2的轻量文本嵌入通过低内存投影头对齐,用于零样本缺陷检测与定位。在VisA、BTAD、MPDD、MVTec-AD上相较六个ZSAD方法平均降内存61.5%、参数74.6%、延迟加速3.02倍,P-AUROC仅较最佳基线低6.4%,并在Jetson与真实产线验证部署。

PhysMani: Physics-principled 3D World Model for Dynamic Object Manipulation Figure 1
2026-07-03cs.RO

PhysMani: Physics-principled 3D World Model for Dynamic Object Manipulation

Peng Yun, Shouwang Huang, Hao Li, Jinxi Li, Jianan Wang, Bo Yang

2026-07-03机器人强化学习三维

面向高速运动目标和开放三维场景中的动态操作,PhysMani指出现有VLA/视频世界模型缺少显式3D几何、物理一致预测且延迟偏高。其核心是用在线优化的无散度3D Gaussian速度场预测未来动力学,并通过可学习token交叉注意力注入策略网络。在16任务PhysMani-Bench及真实机器人实验中,成功率和效率均优于3D策略与VLA基线。

Sparse-Aware Vector Quantization for Bandwidth-Efficient Collaborative 3D Semantic Occupancy Prediction Figure 1
2026-07-03cs.CV

Sparse-Aware Vector Quantization for Bandwidth-Efficient Collaborative 3D Semantic Occupancy Prediction

Feng Li, Chaokun Zhang, Gong Chen

2026-07-03三维

这篇论文针对协同3D语义占用预测中细粒度体素特征难以在带宽受限V2X场景传输的问题,提出VQSOP:利用场景稀疏性只量化并传输关键信息区域的码本索引,再用双分支自适应空间细化融合局部几何细节与全局语义上下文。实验显示其在单车和协同设置下均超过现有方法,协同mIoU提升4.10%、IoU提升0.92%,通信量最高降低82倍。

Robust Image Processing Techniques for Construction Environment Monitoring Using Underwater Robots Figure 1
2026-07-03cs.CV

Robust Image Processing Techniques for Construction Environment Monitoring Using Underwater Robots

Seunghee Yun, Geonmo Yang, Juhui Lee, Changbeom Park, Jeahyung Choi, Younggun Cho

Journal of Institute of Control, Robotics and Systems (20xx) 30(x):000-000, Department of Electrical and Computer Engineering, Inha University, Hyundai Engineering & Construction Co., Ltd, Department of Electrical and Electronic Engineering, Inha University, ※ This research was supported by the Korea Heritage Service and the National Research Institute of Cultural Heritage in 2026 (Project No.: RS-2026-25518173), by the, Institute of Information & Communications Technology Planning & Evaluation (IITP) grant funded by the Korea government (MSIT) (No. 2022-0-00448/RS-2022-, underwater working environments and the controllability of the data

2026-07-03机器人视觉感知安全鲁棒

面向水下机器人在近海施工监测中图像受前向散射、海雪颗粒和低对比度影响的问题,论文将深度相关模糊与真实颗粒分布分阶段合成,并在不改 Joint-ID 架构下用更贴近实海的合成数据重训,再配合轻量后处理。韩国沿海实采数据上视觉质量和 UIQM 均有提升,说明收益主要来自更真实、可控的数据退化建模。

Towards Real-World Ultrasound Understanding: Large Vision-Language Models from Multi-Image Examinations with Long-Form Reports Figure 1
2026-07-03cs.CV

Towards Real-World Ultrasound Understanding: Large Vision-Language Models from Multi-Image Examinations with Long-Form Reports

Bingcong Yan, Chunlei Li, Jingliang Hu, Yilei Shi, Xiao Xiang Zhu, Lichao Mou

2026-07-03视觉语言视觉感知强化学习

针对超声 LVLM 常停留在单图或单器官、难匹配真实检查流程的问题,本文提出把多张检查图像与长篇临床报告按 examination-level 对齐,构建约 150 万例、1770 万张图像的数据集,并仅用 LoRA 微调标准 LVLM。结果显示 LUMI 在报告生成与临床 F1 等指标上优于通用和医学模型,增益可能主要来自大规模超声数据与临床一致的数据组织。

Population-Based Multi-Objective Training of Discriminators for Semi-Supervised GANs Figure 1
2026-07-03cs.LG

Population-Based Multi-Objective Training of Discriminators for Semi-Supervised GANs

Francisco Sedeño, Francisco Chicano, Jamal Toutouh

2026-07-03生成模型

针对半监督 GAN 中判别器同时承担分类与真假判别、单一加权损失易导致训练不稳的问题,论文将判别器训练改写为监督/无监督双目标优化,并用种群与 Pareto 选择保留不同权衡解。MNIST 少标签实验显示其较 SSL-GAN、CE-SSL-GAN 更稳,μ=1 也有显著增益,精英变体分类准确率最高,但验证范围仍较窄。

SFKD: Spatial--Frequency Joint-Aware Heterogeneous Knowledge Distillation via Multi-Level Wavelet Spectral Interaction Figure 1
2026-07-03cs.CV

SFKD: Spatial--Frequency Joint-Aware Heterogeneous Knowledge Distillation via Multi-Level Wavelet Spectral Interaction

Cuipeng Wang, Haipeng Wang

Key Laboratory for Information Science of Electromagnetic Waves, Ministry of Education, Fudan University, Shanghai, China, Discipline and Technology Center of Microwave Vision Intelligent Sensing, Fudan University, Shanghai, China, Corresponding author.Key Laboratory for Information Science of Electromagnetic Waves

2026-07-03视觉感知

SFKD针对异构教师—学生模型因归纳偏置不同导致特征空间分布不一致、传统蒸馏常削弱空间信息的问题,提出用多级离散小波分解拆分低频结构语义与高频局部细节,再经双流双阶段模块细化学生子带,并用高斯滤波频域损失做全局能量对齐。实验显示其在多种同构与异构蒸馏设置下优于已有方法,且异构Swin-T教师蒸馏ResNet18可超过同构ResNet34教师。

Rethinking Post-Hoc Calibration in Semantic Segmentation Figure 1
2026-07-03cs.CV

Rethinking Post-Hoc Calibration in Semantic Segmentation

Tristan Kirscher (ICube), Kim-Celine Kahl (DKFZ), Balint Kovacs (DKFZ), Maximilian R. Rokuss (DKFZ), Klaus Maier-Hein (DKFZ), Xavier Coubez, Philippe Meyer (ICube), Sylvain Faisan (ICube)

ICube Laboratory, CNRS UMR 7357, University of Strasbourg, Strasbourg, France, German Cancer Research Center (DKFZ), Division of Medical Image Computing, Heidelberg, Germany, Faculty of Mathematics and Computer Science, University of Heidelberg, Germany, Medical Faculty Heidelberg, Heidelberg University, Heidelberg, Germany, Pattern Analysis and Learning Group, Dept. of Radiation Oncology, Heidelberg University Hospital, Germany

2026-07-03视觉感知

这篇论文关注语义分割后验校准中被忽视的结构问题:logit 加常数不改变 softmax,却会让部分校准器输出不一致;同时交叉熵校准可能改变 argmax,损害 Dice。作者提出平移不变校准与保持决策的类条件仿射校准框架。实验覆盖自然图像、医学分割及协变量偏移,显示 TI 变体通常改善校准指标,决策保持约束可避免分割性能下降并保留较强校准效果。

FoundDP: Revisiting Weak Disparity Observability in Dual-Pixel Depth Estimation Figure 1
2026-07-03cs.CV

FoundDP: Revisiting Weak Disparity Observability in Dual-Pixel Depth Estimation

Fengchen He, Hao Xu, Dayang Zhao, Tingwei Quan, Shaoqun Zeng

2026-07-03视觉感知

论文针对双像素深度估计中基线极小导致弱视差区域纹理缺失、低对比或下采样时结构崩坏的问题,提出 FoundDP:用 DP 网络保留度量尺度,再引入单目深度基础模型的 ViT 全局结构先验,并通过散焦模糊下的 ViT 特征对齐稳定引导。实验显示其在合成与真实 DP 基准、弱视差区域和下采样鲁棒性上均优于既有 DP 方法,结构一致性和度量精度提升更明显。

Diversity-aware View Partitioning for Scalable VGGT Figure 1
2026-07-03cs.CV

Diversity-aware View Partitioning for Scalable VGGT

Jinsoo Park, Donggyu Choi, Ahyun Seo, Minsu cho, Jeany Son

2026-07-03视觉感知

这篇论文针对 VGGT 在多视角数量增大时因全局注意力开销和视角冗余导致重建反而变差的问题,指出关键不只是处理更多图像,而是组织更有几何互补性的视角。方法无需训练,通过视觉差异与近似空间分散度做图划分,并用少量种子帧的软位姿传播估计空间关系,将输入拆成多样且均衡的块。实验显示其在相机位姿、深度和三维重建上优于 vanilla VGGT 及若干高效变体,同时降低显存和推理延迟。

SAB-LVLM: Significance-Aware Binarization for Large Vision-Language Models Figure 1
2026-07-03cs.CV

SAB-LVLM: Significance-Aware Binarization for Large Vision-Language Models

Qi Lyu, Jiahua Dong, Baichen Liu, Xudong Wang, Mingfei Han, Yulun Zhang, Fahad Shahbaz Khan, Salman Khan, Lianqing Liu, Zhi Han

State Key Laboratory of Robotics and Intelligent Systems, Shenyang Institute of Automation, Chinese Academy of Sciences, University of Chinese Academy of Sciences, Mohamed bin Zayed University of Artificial Intelligence, Shanghai Jiao Tong University

2026-07-03视觉语言视觉感知

针对大视觉语言模型在边缘设备部署时内存与延迟过高、现有二值化忽视层间和模态间权重重要性差异的问题,SAB-LVLM用文本/视觉校准数据构建Hessian并生成空间显著性图,将跨模态显著性作为量化误差重加权项,再交替更新二值权重;在约1-bit约束下,其在多项LVLM基准上优于已有二值PTQ方法。

Descriptor: LYNRED Mobility Dataset Multimodal Detection Subset (LYNRED-MDS) Figure 1
2026-07-03cs.CV

Descriptor: LYNRED Mobility Dataset Multimodal Detection Subset (LYNRED-MDS)

Loïc Arbez (Thoth), Jessy Matias, Xavier Brenière, Jocelyn Chanussot (Thoth), Ronald Phlypo (GIPSA-VIBS)

INRIA center at University Grenoble Alpes, 38330 Montbonnot-Saint-Martin, France, Univ Grenoble Alpes, CNRS, Grenoble INP, GIPSA-lab, 38000 Grenoble, France, imaging. While available RGB-infrared datasets such as FLIR ADAS and LLVIP are good benchmarks, Published in 2015 by the Korean Advanced Institute of

2026-07-03视觉语言视觉感知数据集/基准

面向夜间、雾天等低能见度下ADAS对远距离行人/弱势道路使用者的提前检测需求,论文发布LYNRED-MDS:4000对法国格勒诺布尔周边采集的RGB-红外图像,覆盖城市、乡村、山地和多天气光照,并提供独立标注、遮挡标签及COCO格式。YOLOv8n跨数据集热红外实验显示其对行人检测有较好泛化潜力,但结论仍主要基于单一模型与有限指标。

QWERTY: Training-Free Motion Control via Query-Warped Video Diffusion Transformers Figure 1
2026-07-03cs.CV

QWERTY: Training-Free Motion Control via Query-Warped Video Diffusion Transformers

Kyobin Choo, Youngmin Kim, Hyunkyung Han, Geunrip Park, Chanyoung Kim, Sunyoung Jung, Seong Jae Hwang

2026-07-03视觉感知生成模型规划控制

针对视频 DiT 主要依赖文本提示、难以精确控制物体或相机运动的问题,QWERTY 提出无需训练的推理时控制:只扭曲查询中的帧不变语义子空间,并用语义-时间通道分解避免 RoPE 带来的帧间不一致,再以扭曲查询产生的噪声做潜变量自引导。实验显示其在近期图像到视频 DiT 上优于现有免训练方法,效果接近需微调的控制方法。

DL-SLAM: Enabling High-Fidelity Gaussian Splatting SLAM in Dynamic Environments based on Dual-Level Probability Figure 1
2026-07-03cs.RO

DL-SLAM: Enabling High-Fidelity Gaussian Splatting SLAM in Dynamic Environments based on Dual-Level Probability

Ziheng Xu, Qingfeng Li, Xuefeng Liu, Chen Chen, Jianwei Niu

2026-07-03三维

DL-SLAM针对动态场景中3DGS SLAM要么粗暴剔除动态类、要么把暂时静止物体错误融入地图的问题,提出像素级与对象级联动的双层动态概率框架:用语义与光流估计像素概率辅助跟踪,再提升到3D按实例聚合并剪除动态高斯,同时由净化静态地图反向修正概率。实验称在三类动态数据集上跟踪精度最高提升13%,并生成更少伪影的语义静态地图。

Geometric Foundation Model Distillation for Efficient Lunar 3D Reconstruction Figure 1
2026-07-03cs.CV

Geometric Foundation Model Distillation for Efficient Lunar 3D Reconstruction

Clémentine Grethen, Florient Chouteau, Géraldine Morin, Simone Gasparini

2026-07-03三维

针对月面探测中算力、功耗和时延受限而大型三维基础模型难以上机的问题,论文将经月球数据微调的 MASt3R 教师蒸馏为轻量学生,并提出用 SVD 投影初始化压缩解码器、结合特征级监督的方案。实验显示 ViT 学生可将参数量压缩约 4.4–7.3 倍、推理约提速 2 倍,最佳模型 Chamfer 误差仅比教师高约 15%,且优于直接用稀疏真值训练的基线;同时提示保留编码器能力比维持大解码器更关键,CNN 学生表现较弱但可能受预训练差异影响。

C2E: Boosting Ego-Only 3D Object Detection via Multi-Teacher Contrastive Knowledge Distillation Figure 1
2026-07-03cs.CV

C2E: Boosting Ego-Only 3D Object Detection via Multi-Teacher Contrastive Knowledge Distillation

Jinlong Wang, Xun Huang, Qiming Xia, Shijia Zhao, Chenglu Wen

2026-07-03视觉感知三维

论文针对单车 LiDAR 3D 检测受遮挡和视角限制、协同感知又有通信与位姿误差的问题,提出 C2E 思路:训练时用多智能体协同模型作为多教师,将知识蒸馏到仅用自车输入的学生模型。其 M2S 框架结合多层特征增强、辅助点云重建和多教师对比蒸馏来缓解单/多车域差异。在 V2XSet、V2V4Real、DAIR-V2X 上可为多种检测器带来最高 8.64% 3D mAP 提升,推理阶段不增加通信成本。

Rethinking Conditional Generation for Underwater Salient Object Detection Figure 1
2026-07-03cs.CV

Rethinking Conditional Generation for Underwater Salient Object Detection

Hua Li, Yongjie Weng, Yutong Li, Zhiyuan Li, Runmin Cong, Sam Kwong

(Corresponding author: Runmin Cong.)Hua Li, Yongjie Weng, Yutong Li, and Zhiyuan Li are with the School of Computer Science and Technology, Hainan University, Haikou 570228, China

2026-07-03视觉感知

针对水下机器人感知中显著目标易受低对比度、色偏和散射模糊影响的问题,论文指出扩散式USOD的关键不只是生成掩码,而是条件特征可靠性。DCGNet用多粒度结构、伪深度物理先验和空间高斯先验先净化并约束条件特征,再由轻量DiT随时间步细化。多数据集实验称其优于现有SOTA,但具体增益在多模块间的归因仍需看消融细节。

MMBench-Live: A Continuously Evolving Benchmark for Multimodal Models Figure 1
2026-07-03cs.CV

MMBench-Live: A Continuously Evolving Benchmark for Multimodal Models

Yuanzhi Liu, Shousheng Zhao, Bo Zhou, Kongming Liang, Zhanyu Ma

2026-07-03视觉语言数据集/基准

针对多模态基准长期静态化导致的时效过期、训练污染和维护成本高问题,MMBench-Live将基准更新建模为任务引导的数据构建:从原MMBench抽取任务层级与视觉模式,结合反馈控制的实时数据获取和带可执行推理验证的QA生成,以尽量保持跨版本可比性。实例化后生成5.9K条新样本,人工答案正确率96.06%,单次更新约1–2小时、成本约30美元,并在开放VLM评测中保持模型排序稳定、语义分布对齐且记忆污染信号更弱。

PixGS: Pixel-Space Diffusion for Direct 3D Gaussian Splat Generation Figure 1
2026-07-03cs.CV

PixGS: Pixel-Space Diffusion for Direct 3D Gaussian Splat Generation

Duy Cao, Phong Nguyen-Ha

Qualcomm AI Research 1 1 1 Qualcomm AI Research is an initiative of Qualcomm Technologies, Inc.

2026-07-03生成模型三维

PixGS针对现有3DGS生成依赖多阶段重建或潜空间扩散、易累积视角不一致与压缩伪影的问题,改用像素空间扩散直接在高斯属性张量上去噪,并结合深度、法线与LoG高频监督及三阶段训练。实验称其优于现有方法,同时在单张A100上约1秒生成,但具体增益中各监督与数据规模的贡献仍需结合消融判断。

SpaceEra++: A Unified Framework Towards 3D Spatial Reasoning in Video Figure 1
2026-07-03cs.CV

SpaceEra++: A Unified Framework Towards 3D Spatial Reasoning in Video

Weili Guan, Haoyu Zhang, Meng Liu, Qianlong Xiang, Yaowei Wang, Liqiang Nie

2026-07-03视觉感知三维

该文面向机器人导航与具身交互中从扫描视频进行三维空间推理的需求,指出现有VLM受限于2D观测不确定、数据稀缺、长视频输入不足和仅重坐标的偏置优化。SpaceEra++在原有合成QA与结构化CoT基础上,引入兼顾空间覆盖和物体语义的ScenePick采帧,以及联合绝对坐标与相对关系约束的SpaceAlign强化学习。多基准实验显示其相对强基线稳定提升,消融支持各组件具有独立且互补贡献。

LLM-Empowered Multimodal Fusion Framework for Autonomous Driving: Semantic Enhancement and Channel-Adaptive Design Figure 1
2026-07-03cs.CV

LLM-Empowered Multimodal Fusion Framework for Autonomous Driving: Semantic Enhancement and Channel-Adaptive Design

Wen Wang, Yaping Sun, Yejun He, Hao Chen, Zhiyong Chen, Xiaodong Xu, Nan Ma, Shuguang Cui

2026-07-03视觉语言

这篇论文针对协同自动驾驶中外部雷达经 V2X 链路传输后质量随遮挡、噪声和 SNR 波动而变化、传统固定融合易失效的问题,提出 LM-SCIP:用链路指标生成 Channel Prompt,经 CASM 门控雷达特征,并由 LoRA 调优 LLM 与 H-MoE 在语义层动态分配视觉与雷达信任。实验在 nuScenes 和 VIRAT 上显示定位、预测均有收益,如 nuScenes 相比纯视觉定位 RMSE 降低 40.0%,但真实部署与增益在多大程度来自 LLM 推理仍需进一步验证。

JointHOI: Jointly Generating Contact Maps Enhances Hand Object Interaction Generation Figure 1
2026-07-03cs.CV

JointHOI: Jointly Generating Contact Maps Enhances Hand Object Interaction Generation

Mingyeong Song, Jungbin Cho, Jisoo Kim, Ananya Bal, Kartik Sharma, Youngjae Yu, Laszlo A. Jeni, Junhyug Noh

2026-07-03视觉感知

本文针对文本驱动手-物交互生成中接触误差导致的悬空、穿模和抓握不稳问题,提出 JointHOI:在单阶段扩散模型中把动态、距离型接触图作为“内在模态”与双手和物体运动联合生成,并在推理时用 Contact Inner Guidance 约束预测接触与几何接触一致。GRAB 和 ARCTIC 实验显示其在文本一致性、运动自然度和物理合理性上优于多阶段或隐式交互基线。

ProCal: Inference-Time Proposal Calibration for Open-Vocabulary Object Detection Figure 1
2026-07-03cs.CV

ProCal: Inference-Time Proposal Calibration for Open-Vocabulary Object Detection

Jae-Ryung Hong, Ho-Joong Kim, Seong-Whan Lee

2026-07-03视觉感知

这篇论文针对开放词汇检测中两阶段检测器偏向基类、常把新类目标排到背景或低质量框之后的问题,提出推理时的 ProCal 校准。核心洞察是冻结 VLM 的类别无关提示能提供前景定位与背景抑制信号,并据此重排新类 proposal,无需再训练。实验中在 CLIPSelf ViT-L/14 上使 OV-LVIS 新类 APr 提升 2.5,分析显示主要改善来自抑制背景误激活和提升真新类框排序。

DL-VINS-Factory: A Modular Framework for Learned Visual Front-Ends in Visual-Inertial SLAM Figure 1
2026-07-03cs.CV

DL-VINS-Factory: A Modular Framework for Learned Visual Front-Ends in Visual-Inertial SLAM

Shoon Kit Lim, Melissa Jia Ying Chong, Ting Yang Ling

University of Southampton Malaysia, Iskandar Puteri, Johor, Malaysia

2026-07-03视觉感知

本文针对学习型视觉前端在紧耦合 VI-SLAM 中难以公平比较、回环又常依赖特定 BoW 词典的问题,提出 DL-VINS-Factory,将 ALIKED、RaCo、SuperPoint、XFeat 与 LK 或 LightGlue 模块化接入同一 VINS-Fusion/Ceres 后端,并用 AnyLoc DINOv2-VLAD 做前端无关回环。实验显示学习特征可在 Jetson 上实时运行,但并非总优于经典跟踪:ALIKED+LG 在 EuRoC、NTU-VIRAL 有 5%–12% ATE 改善,植物园场景中 LK 仍更稳,AnyLoc 有效回环数约为 BRIEF+DBoW2 的 2–7 倍。

ProSAC-CT: Progressive Spectral-Anatomical Co-Guided Multi-Stage Diffusion Model for Low-Dose CT Denoising Figure 1
2026-07-03cs.CV

ProSAC-CT: Progressive Spectral-Anatomical Co-Guided Multi-Stage Diffusion Model for Low-Dose CT Denoising

Xuepeng Liu, Zetong Liu, Renyiming Li, Yan Li, Ruiyu Li, Ruili Li, Jiayi Ding, Eichi Takaya

2026-07-03生成模型

低剂量CT虽能降低辐射,但噪声、条纹伪影和纹理退化会削弱解剖边界,现有扩散去噪又常缺少结构引导并把反向过程视为均一轨迹。ProSAC-CT的核心是在扩散框架中联合解剖先验、频域分解和按时间步分段的解码器,让不同阶段分别侧重全局结构、边界与细节恢复。文中在四个LDCT退化基准及Mayo-2020下游解剖区域分类上优于CNN、GAN、Transformer和扩散基线,显示其不仅提升图像指标,也更保留任务相关结构信息。

The Turning Point of 3D Plant Phenotyping: 3D Foundation Models Enable Minute-to-Second Cross-Crop Reconstruction and Beyond Figure 1
2026-07-03cs.CV

The Turning Point of 3D Plant Phenotyping: 3D Foundation Models Enable Minute-to-Second Cross-Crop Reconstruction and Beyond

Hanyue Jia, Wei Zhou, Wenbo Zhou, Yanan Li, Hao Lu, Tingting Wu

2026-07-03三维

面向低成本、高通量三维植物表型中多视角采集繁琐、COLMAP/SfM 初始化脆弱且耗时的问题,本文用 3D 基础模型做前馈几何恢复,并结合几何约束 3DGS、少视角迭代视图合成、2D 到 3D 语义迁移与尺度恢复,形成跨作物测量流程。在 26 个手机采集序列上,平均重建时间由 6.52 分钟降至 1.58 秒,同时保持较高重建质量和表型精度。

MedStreamBench: A Time-Aware Benchmark for Streaming and Proactive Medical Video Understanding Figure 1
2026-07-03cs.CV

MedStreamBench: A Time-Aware Benchmark for Streaming and Proactive Medical Video Understanding

Yuan Wang, Shujian Gao, Songtao Jiang, Zhengyu Hu, Zuozhu Liu

2026-07-03视觉感知数据集/基准

这篇论文针对医学视频模型只评“答对没”、少评“何时该答”的落地缺口,提出 MedStreamBench:整合 22 个医学视频/序列数据集和 5,419 个 QA,按回顾、当前、未来、主动预警四类时间任务限制证据窗口,考察回答、延迟、不确定与告警时机。实验显示,现有通用和医学视觉语言模型在离线识别之外,进入流式和主动场景后性能明显下降,说明时间约束下的临床决策能力仍不足。

RTE-FM-Dehazer: Radiative Transfer Equation Inspired Flow Matching for Real-World Image Dehazing Figure 1
2026-07-03cs.CV

RTE-FM-Dehazer: Radiative Transfer Equation Inspired Flow Matching for Real-World Image Dehazing

Chenfeng Wei, Chun Wang, Boyang Zhao, Si Zuo, Shenhong Wang, Chenguang Yang

2026-07-03视觉感知生成模型强化学习

针对真实雾天图像中非均匀、多重散射使传统大气散射模型易残雾和偏色、且真实成对数据稀缺的问题,论文将辐射传输方程的扩散-吸收结构引入流匹配,约束去雾轨迹,并用视觉语言模型构建5万对P-HAZE数据。实验称仅用该数据训练即可在五个真实去雾基准上取得领先表现,减少残雾与色漂,但增益可能同时来自模型先验与数据规模。

InterCMDM: Block-Causal Diffusion for Autoregressive Human Interaction Generation Figure 1
2026-07-03cs.CV

InterCMDM: Block-Causal Diffusion for Autoregressive Human Interaction Generation

Qing Yu, Kent Fujiwara

2026-07-03生成模型

面向文本驱动的双人交互生成,论文针对全序列双向扩散缺乏因果性、难以流式长程生成,以及自回归方法易漂移的问题,提出 InterCMDM:在时序 VAE 潜空间中按块扩散,并用双流因果 DiT 与多任务注意力掩码统一建模个人时间因果和跨人协同,可通过掩码控制同步、反应和主从等关系。在 InterHuman 与 Inter-X 上报告达到 SOTA,提升文本对齐、真实感和长程连续性。

ReQuest: Rethinking-based Question-Aware Frame Selection for Long-Form Video QA Figure 1
2026-07-03cs.CV

ReQuest: Rethinking-based Question-Aware Frame Selection for Long-Form Video QA

Minkuk Kim, Suyong Yun, Young Tae Kim, Jinyoung Moon, Jinwoo Choi, Seong Tae Kim

Kyung Hee University, Republic of Korea, Electronics and Telecommunications Research Institute (ETRI), Republic of Korea, ments in medium and long video regimes. The code is available at

2026-07-03视觉感知

长视频问答受固定视觉 token 预算限制,均匀采样容易漏掉关键证据,单纯图文相似度也难处理隐含线索。ReQuest 的核心是用 MLLM 响应蒸馏轻量级问题感知帧选择器,并在模型不确定时触发再思考检索,再用自适应 NMS 保持时间多样性。实验显示其在 Video-MME、MLVU、LongVideoBench 上稳定提升,尤其利于中长视频,且无需微调底层 MLLM。

Quantum-Inspired Vision: Leveraging Wave-Particle Duality for Low-Illumination Enhancement Figure 1
2026-07-03eess.IV

Quantum-Inspired Vision: Leveraging Wave-Particle Duality for Low-Illumination Enhancement

Yiquan Gao

2026-07-03视觉感知

低照度增强常把光照不确定性当作固定标签,容易过曝、欠曝并受噪声标签放大偏差。本文把 DRU 解释为“波函数—叠加—测量坍缩”的概率框架,用状态概率加权损失来校准样本贡献,并提出 BRISQUE/NIMA 统一分析指标。实验在 ASD 及噪声版本上显示 DRU 变体优于确定性模型、噪声下更稳,但量化增益主要依赖既有 DRU 与有限对比设置,泛化性文中未充分说明。

Beyond Pixel Diffs: Benchmarking Image Change Captioning for Web UI Visual Regression Testing Figure 1
2026-07-03cs.CV

Beyond Pixel Diffs: Benchmarking Image Change Captioning for Web UI Visual Regression Testing

Licheng Zhang, Bach Le, Pengtao Zhao, Naveed Akhtar

2026-07-03视觉语言视觉感知数据集/基准

这篇论文针对 Web UI 视觉回归测试中过度依赖像素差分、误报多且缺少可解释描述的问题,提出 Web UI Image Change Captioning 任务,并构建 WUICC-bench:用 LLM 控制 HTML 单原子变更,覆盖 37 类规则,得到 9906 个经人工验证的图像对与变化描述。实验显示,现有 IDC 与通用 LLM 在文本密集、布局细粒度的 UI 场景仍明显吃力,但训练式方法已能比像素比较更有选择地抑制非语义噪声。

Consistent Scene Understanding in 3D Gaussian Splatting via Multi-Cue Mask Refinement Figure 1
2026-07-03cs.CV

Consistent Scene Understanding in 3D Gaussian Splatting via Multi-Cue Mask Refinement

Hyunjoon Park, Donghyeon Cho

2026-07-03三维

这篇论文针对SAM等2D分割先验在3DGS中常出现的过分割、跨视角身份不一致问题,提出用DINOv2语义、单目深度和LoG边缘共同约束的掩码合并,并通过跨视角匹配与多视图投票把稳定ID提升到高斯基元。实验在LERF、Replica和真实场景中显示,其能减少错误碎片与ID漂移,提升实例分割一致性,同时基本保持3DGS的照片级重建质量。

LASER: A Corrective Lens for LVLMs via Visual Attention Preservation and Sink Suppression Figure 1
2026-07-03cs.CV

LASER: A Corrective Lens for LVLMs via Visual Attention Preservation and Sink Suppression

Bowen Yuan, Zijian Wang, Yadan Luo, Shijie Wang, Zi Huang

2026-07-03视觉语言

本文针对LVLM长链视觉推理中的“视觉遗忘”:模型生成越久越偏离图像证据。核心洞察是问题不只发生在后期注意力衰减,还源于早期视觉 grounding 受损,以及注意力集中到无关的视觉 sink token。LASER在GRPO后训练中加入视觉保持与sink抑制奖励,调控注意力轨迹和分布;八个基准上优于强基线,视觉推理与感知分别提升1.9%和5.7%。

Structure-Aware Gaussian Splatting for Large-Scale Scene Reconstruction Figure 1
2026-07-03cs.CV

Structure-Aware Gaussian Splatting for Large-Scale Scene Reconstruction

Weiyi Xue, Fan Lu, Chi Zhang, Tianhang Wang, Sanqing Qu, Zehan Zheng, Boyuan Zheng, Junqiao Zhao, Guang Chen

Tongji University, 2 Shanghai Innovation Institute, 3 Shanghai Westwell Technology Co., Ltd, Beijing University of Technology, Johns Hopkins University

2026-07-03三维

这篇论文针对大规模场景中 3D Gaussian Splatting 在稀疏观测区域易过度增密、产生冗余与 floaters 的问题,提出从信号结构恢复角度统一调度图像分辨率与高斯增密:用场景频率收敛判断何时升分辨率,并用球约束高斯保留点云结构先验。实验称在多个基准上提升约 0.9 dB PSNR,并实现每块约 1.5× 训练加速。

ICDepth: Taming Video Diffusion Models for Video Depth Estimation via In-Context Conditioning Figure 1
2026-07-03cs.CV

ICDepth: Taming Video Diffusion Models for Video Depth Estimation via In-Context Conditioning

Xuanhua He, Jiaxin Xie, Mingzhe Zheng, Qifeng Chen

2026-07-03视觉感知生成模型

ICDepth针对视频深度估计中时序一致性、几何精度与跨域泛化难以兼顾的问题,将预训练文生视频DiT通过上下文条件化迁移到深度预测;其关键在于用SAND-Attention阻断噪声深度对RGB条件的反向污染,并用DINOv2与分辨率先验补足几何和尺度感知。模型仅用0.8M帧训练,却在多项基准达到SOTA,并展示较强零样本泛化与1080p适配能力。

HistoSeg++: Delving deeper with attention and multiscale feature fusion for biomarker segmentation Figure 1
2026-07-03cs.CV

HistoSeg++: Delving deeper with attention and multiscale feature fusion for biomarker segmentation

Saad Wazir, Rao Faizan, Daeyoung Kim

School of Computing, KAIST, Kyung Hee University (Global Campus), School of Computing, KAIST Daejeon Republic of Korea, Kyung Hee University (Global Campus) Yongin-si Republic of Korea

2026-07-03视觉感知

针对生物标志物医学图像分割中尺度差异大、边界模糊且跨数据集泛化不足的问题,HistoSeg++在Nested-UNet框架中嵌入内外注意力、SE通道重标定与边缘感知损失,以强化多尺度上下文融合和上采样聚焦。在MoNuSeg、DSB和电镜数据集上,其IoU/Dice总体优于多种UNet及Transformer基线,但部分边界指标并非最优,增益主要归因于结构组合。

Temporal and Cross-Modal Alignment for Enhanced Audiovisual Video Captioning Figure 1
2026-07-03cs.CV

Temporal and Cross-Modal Alignment for Enhanced Audiovisual Video Captioning

Chen Zhao, Jiajun Ma, Qilong Huang, Tiehan Fan, Hongyu Li, Zhuoliang Kang, Xiaoming Wei, Jian Yang, Ying Tai

2026-07-03视觉语言视觉感知

这篇论文针对音视频字幕中常见的“声音与画面各说各话”和时序因果错配问题,提出 TCA-Captioner:用 Observer-Checker-Corrector 迭代生成更可靠的对齐训练数据,并构建高密度人类交互数据与 TCA-Bench 解耦评测音画绑定和时间关系。实验显示其在同步、连贯的音视频叙述上优于现有模型,但具体增益有多少来自数据规模与标注流程仍需进一步拆分说明。

Unified Panoramic-Gaussian Representation for Monocular 4D Scene Synthesis Figure 1
2026-07-03cs.CV

Unified Panoramic-Gaussian Representation for Monocular 4D Scene Synthesis

Yuankun Yang, Yi Wei, Wenyang Zhou, Li Zhang

2026-07-03三维

本文针对单目动态场景重建只能在已观测轨迹内插值、难以补全大视角未见区域的问题,提出 PanoGaussian:先用全景坐标和渐进扩展约束视频生成的相机轨迹,再将生成视图蒸馏到动态 Gaussian 表示,以缓解全景投影对运动物体的形变。实验显示其在大视角变化下比现有动态重建和相机条件视频生成方法更能保持几何一致性,但仍依赖扩散先验和逐场景优化。

Teaching Vision-Language-Action Models What to See and Where to Look Figure 1
2026-07-03cs.CV

Teaching Vision-Language-Action Models What to See and Where to Look

Yuguang Yang, Canyu Chen, Zhewen Tan, Yizhi Wang, Zichao Feng, Chunyang Liu, Kehua Sheng, Juan Zhang, Linlin Yang, Baochang Zhang, Yan Wang, Bo Zhang, Xianbin Cao

School of Electronic Information Engineering, Beihang University, National College for Excellent Engineers, Beihang University, Institute for AI Industry Research (AIR), Tsinghua University, State Key Laboratory of Media Convergence and Communication, Communication University of China, School of Computer Science and Engineering, Beihang University, School of Cyber Science and Technology, Beihang University, School of Artificial Intelligence, Beihang University, the-art performance on NAVSIM and nuScenes. Our code is available at:, modules. While this structure offers interpretability and controllability, it suffers

2026-07-03视觉语言视觉感知

这篇论文针对自动驾驶 VLA 过度依赖 VQA/CoT 文本监督、注意力缺少空间落点的问题,提出 DriveTeach-VLA:用驾驶感知视觉蒸馏让编码器学会关注关键交通对象,再用投影到图像平面的 2D 轨迹提示引导规划器“看向”可行驶区域,并结合 SFT 与 GRPO 训练。实验称其在 NAVSIM 和 nuScenes 上达到 SOTA,消融也支持视觉空间提示对轨迹预测的贡献,但双模型设计带来额外运行开销。

Domain Generalization via Text-Anchored Information Bottleneck Figure 1
2026-07-03cs.CV

Domain Generalization via Text-Anchored Information Bottleneck

Eunyi Lyou, Yunjeong Choi, Junho Lee, Joonseok Lee

2026-07-03学习理论

这篇论文针对域泛化中视觉模型在新环境下容易学习训练域伪相关的问题,质疑保留 CLIP 等视觉表征一定提升鲁棒性的假设。作者提出以文本嵌入作为稳定语义锚点,并用类条件信息瓶颈约束图像特征,只保留跨模态共享的核心语义、抑制风格等域特异信息。实验称在多种 DG 基准和骨干上达到 SOTA,并显示更清晰的类别分离,但固定文本锚点的上下文不足与数据泄漏影响仍被作者列为限制。

Plug-and-Play Volumetric Reconstruction for Compressive Sensing Light-Sheet Microscopy Figure 1
2026-07-03cs.CV

Plug-and-Play Volumetric Reconstruction for Compressive Sensing Light-Sheet Microscopy

Jianqing Jia, Yi Gong, Xinyuan Zhang, Jichen Chai, Yichen Ding, Yifei Lou

School of Data and Information Sciences, The University of North Carolina at Chapel Hill, Chapel Hill, NC 27599, USA ()., Department of Mathematics, The University of North Carolina at Chapel Hill, Chapel Hill, NC 27599, USA (). Jia and Gong contributed equally to this work., Department of Bioengineering, The University of Texas at Dallas, Richardson, TX 75080, USA (, , )., Department of Mathematics, School of Data and Information Sciences, The University of North Carolina at Chapel Hill, Chapel Hill, NC 27599, USA ().

2026-07-03三维

这篇论文面向压缩感知光片显微中多轴向切片被单次曝光混合后难以重建的问题,提出可插拔 PnP-ADMM 体重建框架,并在逐切片模型上加入轴向耦合以利用相邻切片相关性;同时用 Woodbury 更新和 Gauss-Seidel 去噪提升计算效率。作者给出弱凸先验下的子序列收敛分析,并在合成与真实斑马鱼心脏数据上显示可恢复细胞结构、轴向连续性优于逐切片方案。

Boosting Ultrasound Image Classification via Attribute-Guided Dual-Branch Framework Figure 1
2026-07-03cs.CV

Boosting Ultrasound Image Classification via Attribute-Guided Dual-Branch Framework

Bo Zhao, Yapeng Li, Juhua Liu, Bo Du

2026-07-03视觉感知

针对超声分类中黑箱模型易受噪声、设备差异影响且缺乏临床可解释性的问题,论文提出可插拔的 AttrGuide 双分支框架:在原分类分支外,引入由 CLIP 文本属性原型和类别-属性矩阵构成的医学先验分支,并用自适应决策融合校正预测。多项超声任务显示其可接入不同骨干和 SOTA 方法,带来稳定精度提升与可解释属性证据,额外训练开销低于 5%。

Multi-Resolution Flow Matching: Training-Free Diffusion Acceleration via Staged Sampling Figure 1
2026-07-03cs.CV

Multi-Resolution Flow Matching: Training-Free Diffusion Acceleration via Staged Sampling

Xingyu Zheng, Xianglong Liu, Yifu Ding, Weilun Feng, Junqing Lin, Jinyang Guo, Haotong Qin

State Key Laboratory of Complex & Critical Software Environment, Beihang University, School of Computer Science and Engineering, Beihang University, Nanyang Technological University, State Key Laboratory of AI Safety, Institute of Computing Technology, Chinese Academy of Sciences, University of Chinese Academy of Sciences, University of Science and Technology of China, School of Artificial Intelligence, Beihang University

2026-07-03生成模型

本文针对文本到图像流匹配/扩散模型推理昂贵、现有免训练多分辨率方法易因潜空间上采样产生模糊和伪影的问题,提出 MrFlow:先低分辨率快速生成结构,再在像素空间用轻量 GAN 超分辨率放大,注入低强度噪声以重采样高频细节,最后少步高分辨率精修。实验在 FLUX.1-dev 和 Qwen-Image 上显示,其可实现约 10× 端到端加速且 OneIG 损失控制在 1% 内,并可与时间步蒸馏叠加达到约 25×。

Bridging 3D Gaussians and Semantic Occupancy for Comprehensive Open-Vocabulary Scene Understanding from Unposed Images Figure 1
2026-07-03cs.CV

Bridging 3D Gaussians and Semantic Occupancy for Comprehensive Open-Vocabulary Scene Understanding from Unposed Images

Hu Zhu, Bohan Li, Xianda Guo, Yanlun Peng, Zheng Zhu, Xin Jin, Wenjun Zeng, Chang Wen Chen

Yanlun Peng is with Great Wall Motor, China. Zheng Zhu is with Tsinghua University, Beijing, China.

2026-07-03视觉感知三维

这篇论文针对稀疏、无位姿图像下的三维场景理解:现有语义 3D Gaussian 多靠图像空间监督,能渲染但难约束未观测区域的空闲/占用结构。COVScene 的核心是把语义高斯在训练图中可微提升为稠密语义占用场,用体素正则反向约束透明度、几何和语义特征,并结合几何蒸馏与占用熵约束。在 ScanNet/ScanNet++ 上,它保持相近渲染质量,同时提升开放词汇分割和无体素标注的语义占用预测。

DRDN: Decoupled Representation Dynamic Network for From-Scratch ViT Class-Incremental Learning Figure 1
2026-07-03cs.CV

DRDN: Decoupled Representation Dynamic Network for From-Scratch ViT Class-Incremental Learning

Bingchen Huang, Yifu Chen, Zhiling Wang, Yuanchao Du

2026-07-03视觉感知

本文针对从零训练 ViT 的类增量学习中,动态扩展方法虽能保护任务特定知识、却易产生跨任务混淆并弱化共享骨干表示的问题。DRDN 的核心洞察是解耦优化路径:用持续 MIM 仅更新骨干以维持通用视觉结构,同时在各层扩展隔离注意力的任务 token。实验显示其在 CIFAR100-B0 10 步达 77.19% 平均准确率,优于 DKT 1.36 点、DyTox 3.53 点,且无推理开销。

Online Segment 3D Gaussians via Launching Virtual Drones Figure 1
2026-07-03cs.CV

Online Segment 3D Gaussians via Launching Virtual Drones

Liwei Liao, Rongjie Wang, Ronggang Wang

2026-07-03三维

本文针对交互式 3D Gaussian 分割在新场景中需预处理多视角掩码、提升或蒸馏特征而难以在线使用的问题,提出 SAGO:把分割过程类比为虚拟无人机的 Next-Best-View 规划,在 Markov 状态中逐步渲染新视角、调用 2D 分割并裁剪背景 Gaussians。实验显示其无需场景级 setup,单次交互约 0.3–1 秒,较既有 setup-free 方法快 50 倍以上,同时保持或超过部分离线方法的分割质量。

Multi-THuMBS: Multi-person Tracking of 3D Human Meshes Beyond Video Shots Figure 1
2026-07-03cs.CV

Multi-THuMBS: Multi-person Tracking of 3D Human Meshes Beyond Video Shots

Jeongwan On, Muhammad Salman Ali, Muneeb A. Khan, Sunwoo Park, Inwoong Moon, Hyung Jin Chang, Jaekwang Kim, Seong Jong Ha, Seungryul Baek

2026-07-03视觉感知三维

该文针对真实视频中频繁切镜导致多人体三维网格轨迹断裂、身份混淆和相机位姿不连续的问题,提出 Multi-THuMBS:用 VGGT 等三维场景先验在切镜边界构建共享 3D 空间,将相邻镜头的人体网格对齐,并结合外观、姿态与三维距离做重识别,再通过全局平滑和跨相机重投影约束维持一致轨迹。实验显示其在多基准上提升人体网格恢复、相机估计和身份跟踪表现。

VLAFlow: A Unified Training Framework for Vision-Language-Action Models via Co-training and Future Latent Alignment Figure 1
2026-07-03cs.CV

VLAFlow: A Unified Training Framework for Vision-Language-Action Models via Co-training and Future Latent Alignment

Guoyang Xia, Fengfa Li, Hongjin Ji, Lei Ren, Fangxiang Feng, Kun Zhan, Yan Xie

2026-07-03视觉语言视觉感知生成模型

这篇论文针对VLA预训练中架构、数据和评测不统一导致范式难比较的问题,提出VLAFlow作为受控训练框架,在同一π0式结构、14维动作空间和约5000小时异构机器人数据上比较动作预测、语言协同训练、未来潜特征对齐及其组合。核心洞察是语言意图与未来状态表征可作为“元动作”中间约束,缓解异构动作监督的不稳定。实验显示动作-only预训练易负迁移,而MindLWPI在LIBERO、LIBERO-Plus和SimplerEnv上整体迁移最稳。

MVFusion-GS: Motion-Variance Guided Temporal Attention for High-Quality Dynamic Gaussian Splatting Figure 1
2026-07-03cs.CV

MVFusion-GS: Motion-Variance Guided Temporal Attention for High-Quality Dynamic Gaussian Splatting

Jianwei Hu, Tingxuan Huang, Hengyu Zhou, Ningna Wang, Xiaohu Guo Jinshan Lai, Bin Wang

2026-07-03三维

MVFusion-GS针对动态3D Gaussian Splatting中形变网络缺乏显式运动感知的问题:弱运动或短暂前景易被误分到静态分支,污染背景并削弱前景重建。其核心是在形变特征中注入跨时间的高斯运动方差统计,并用邻近时刻的Transformer注意力建模局部时序一致性。实验显示该插件式设计在动态场景重建和去干扰静态背景重建上均取得SOTA或稳定提升,但在复杂遮挡和初始形变欠拟合时仍可能残留伪静态伪影。

Mind the Gap: Standard 3DGS Evaluation Primarily Measures Near-Trajectory Interpolation Figure 1
2026-07-03cs.CV

Mind the Gap: Standard 3DGS Evaluation Primarily Measures Near-Trajectory Interpolation

Gaoxiang Jia, Vikram Appia

Advanced Micro Devices, Inc.

2026-07-03规划控制数据集/基准三维

这篇论文针对3DGS常用每隔N帧留一帧的评测协议提出质疑:该设置多在相邻训练视角之间插值,不能代表机器人、仿真或AR中需要的空间泛化。作者设计训练图像数量匹配的插值/扇区外推对照,并在16个场景、多种3DGS与NeRF表示上发现3–12 dB的稳定差距,甚至可改变方法排名;视角到最近训练视角的角距离可作为零成本诊断和采集规划信号。

Boosting Infrared Small Target Detection via Logit-Domain Contrast and Adaptive Shape Refinement Figure 1
2026-07-03cs.CV

Boosting Infrared Small Target Detection via Logit-Domain Contrast and Adaptive Shape Refinement

Handong Zeng, Zhengeng Yang, Shuai Zhang, Shikai Chen, Hongshan Yu

2026-07-03视觉感知

本文针对红外小目标检测中弱目标与强杂波在概率域难以拉开、以及热扩散导致边界光晕的问题,提出在训练损失而非推理网络上改造监督:用logit域目标-困难背景成对间隔约束增强可分性,并以自适应环形边界惩罚和假警焦点损失压制光晕与高置信误报。基于MSHNet的实验显示,在IRSTD-1k和NUDT-SIRST上提升IoU与检测率、降低虚警,且不增加推理开销。

Hidden-Shot: Towards One-Shot Task Generalization for Low-Level Vision Generalist Models Figure 1
2026-07-03cs.CV

Hidden-Shot: Towards One-Shot Task Generalization for Low-Level Vision Generalist Models

Shao-Jun Xia, Xianzheng Ma, Zichong Meng

2026-07-03视觉感知学习理论

论文针对低层视觉通用模型在未见任务上一/少样本泛化缺乏系统验证的问题,提出 Hidden-Shot:从示例中提取隐式视觉任务信息,结合全局任务感知文本提示,并以轻量方式注入解码器以适配新任务。作者还设计 C/U 评测框架,在 3C4U 与 3C7U 设置的七/十个数据集上优于现有通用模型,同时基本保持已见任务性能。

Disentangling Pictorial Cue Understanding from Language Bias in VLMs via Depth Ordering Task Figure 1
2026-07-03cs.CV

Disentangling Pictorial Cue Understanding from Language Bias in VLMs via Depth Ordering Task

Yiqian Liu, Iuliia Kotseruba, John K. Tsotsos

2026-07-03视觉语言

本文针对VLM深度评测中视觉线索与语言偏置难以区分的问题,构建O3-D奇异项深度排序任务,通过可控合成/真实场景隔离9类图像深度线索,并用指代表达清晰度和新指标衡量语言影响。12个模型在37K图像、147K问答上准确率仅47%–56%、均未超越机会水平,且答案呈强语言偏置,CoT和ICL也无明显改善。

Anti-Prompt: Image Protection against Text-Guided Image-to-Video Generation Figure 1
2026-07-03cs.CV

Anti-Prompt: Image Protection against Text-Guided Image-to-Video Generation

Yeonghwan Song, Chanhui Lee, Jinsoo Park, Jeany Son

2026-07-03视觉感知

这篇论文针对公开图片可被文本引导 I2V 模型随意动画化所带来的版权与隐私风险,提出 Anti-Prompt:在图片中加入不可察觉扰动,利用模型对文本引导的依赖,削弱去噪中的文本条件交互并增强视觉路径,使生成视频出现主体、结构和时序失真。实验覆盖全注意力与交叉注意力架构,显示其在保护效果、不可感知性、效率和跨模型迁移上优于 I2VGuard,并引入 Video-LLM 辅助评估来定位失败模式。

Boundary-Aware Quantization: Finite-Scale Decision Geometry of Neural Classifiers Figure 1
2026-07-03math.OC

Boundary-Aware Quantization: Finite-Scale Decision Geometry of Neural Classifiers

O.M. Kiselev

2026-07-03学习理论

论文关注神经网络量化部署中仅看准确率会掩盖决策边界漂移的问题,提出用有限尺度的边界审计指标,如局部边界位移、切片边界 Jaccard、多类交汇点和低 margin 区翻转,来决定量化停止。实验显示,8/6/4 bit 量化可在准确率几乎不变时显著改变边界;边界感知停止在 digits、MNIST、Fashion-MNIST 和 CIFAR-10 上降低翻转率与边界差异,但固定比特边界正则在低比特下增益有限。

A Cost-Aware, Paired Protocol for Auditing Dynamic Tool Synthesis in Agentic Video Question Answering Figure 1
2026-07-03cs.CV

A Cost-Aware, Paired Protocol for Auditing Dynamic Tool Synthesis in Agentic Video Question Answering

Aseel Mohamed, Rama AlHamidi, Mohamed Rayan Barhdadi, Rasul Khanbayov, Erchin Serpedin, Hasan Kurban

Texas A&M University, Hamad Bin Khalifa University

2026-07-03视觉感知

这篇论文针对智能体 VideoQA 中工具库固定、重复流程每题都要重建且单看准确率无法衡量推理代价的问题,提出成本感知的配对审计协议,并以 Dynamic-SAGE 离线合成、验证和复用组合工具作为测试床。结果显示其在 SAGE-Bench 上准确率提升约 7.5 个百分点,推理轮次和可见工具调用降约 28%,但 token 用量和费用分别上升 34% 与 26%,说明工具合成带来的是成本结构迁移而非全面降本。

From Forgeries to Foundation Models: A Systematic Survey of Identity Document Attack and Detection Figure 1
2026-07-03cs.CR

From Forgeries to Foundation Models: A Systematic Survey of Identity Document Attack and Detection

Gourab Das, Pavan Kumar C, Raghavendra Ramachandra

Indian Institute of Information Technology Dharwad (IIIT Dharwad), SAFE Center, Norwegian University of Science and Technology (NTNU), Indian Institute of Information Technology Dharwad (IIIT Dharwad) India, SAFE Center, Norwegian University of Science and Technology (NTNU) Gjшvik Norway

2026-07-03视觉感知

针对生成式 AI 让低门槛、高逼真身份证件伪造快速扩散,而现有检测基准难以覆盖真实攻击面的动机,本文系统统一了实体展示攻击、数字注入攻击与 GenAI 合成伪造的威胁模型,并审视 2019–2025 数据集的 Reality Gap。主要结果显示,非拉丁文字修补存在 SDGI 等可利用失真,且最强公开模型在未见合成证件零样本测试中 APCER 仍高于 25%,跨域泛化明显不足。

How Much Future Helps? A Controlled Study of Future-Privileged Supervision for Causal Egocentric Gaze Estimation Figure 1
2026-07-03cs.CV

How Much Future Helps? A Controlled Study of Future-Privileged Supervision for Causal Egocentric Gaze Estimation

Jia Li, Wenjie Zhao, Fnu Atisri, Sanskriti Aripineni, Shijian Deng, Jon E. Froehlich, Yuhang Zhao, Yapeng Tian

The University of Texas at Dallas, University of Washington, University of Wisconsin–Madison

2026-07-03视觉感知规划控制

这篇论文针对第一视角凝视估计中“离线模型可看未来帧、真实系统必须因果在线”的错配,设计训练期可调未来视野、推理期丢弃的未来特权分支,以隔离未来信息的作用。实验表明,未来监督能提升轻量因果模型,但收益并非随视野增长单调增加,而是在约1.7–3.3秒内达到最佳,EGTEA Gaze+和Ego4D的F1分别由44.7升至45.9、40.7升至42.7。

Sign in the Air to Unlock: An Interface for authentication in Virtual and Augmented Reality Powered by Point-Voxel Cross-Attention Network Figure 1
2026-07-03cs.CV

Sign in the Air to Unlock: An Interface for authentication in Virtual and Augmented Reality Powered by Point-Voxel Cross-Attention Network

Neda Abdolrahimi, Thiru Siddharth, Frank Sicongchen, Vir V Phoha

NEDA ABDOLRAHIMI∗, Syracuse University, USA, THIRU SIDDHARTH, Syracuse University, USA, FRANK SICONG CHEN, Syracuse University, USA, VIR V PHOHA, Syracuse University, USA, • Human-centered computing →Mixed / augmented reality, facilitate system entry and interaction in an integrated, user-centered manner. Unlike camera-based approaches, our

2026-07-03视觉感知

面向共享式 VR/AR 头显中密码、PIN 或外部设备登录会打断沉浸体验的问题,论文提出“空中签名”认证界面,并用 PV-Net 将轨迹的点级局部运动与体素级全局结构通过交叉注意力融合。实验在 DeepAirSig 上达到 2.5% EER,较基线错误率降 54.5%,在自采 Meta Quest 2 的 ImmAirSig 上分类准确率为 76%,但沉浸场景下握持、朝向和空间漂移仍带来性能波动。

MultAttnAttrib: Training-Free Multimodal Attribution in Long Document Question Answering Figure 1
2026-07-03cs.CL

MultAttnAttrib: Training-Free Multimodal Attribution in Long Document Question Answering

Dang Quang Thien Tran, Quang V. Dang, Vinamra Tyagi, Sai Soorya Rao Veeravalli, Trang Nguyen, Ryan A. Rossi, Franck Dernoncourt, Nedim Lipka, Koustava Goswami, Samyadeep Basu

2026-07-03视觉语言

长文档问答中,答案若不能精确回溯到文本、图像或二者组合证据,会削弱可信度与安全性。本文提出 MultAttnAttrib,不经训练地利用模型预填充阶段的注意力头、跨模态检索头筛选与阈值校准,在单次前向中定位证据,并构建 MultAttrEval 评测细粒度多模态归因。实验显示其优于多种提示、caption 与 RAG 基线,接近 GPT-5.4,同时延迟约为同骨干提示法的七分之一。

Beyond Heatmaps: Unsupervised Concept-Graph Reasoning for Interpretable Visual Explanation Figure 1
2026-07-03cs.CV

Beyond Heatmaps: Unsupervised Concept-Graph Reasoning for Interpretable Visual Explanation

Md Mohasin Hossain (1 and 2), Anar Amirli (4), Robert Leist (1), Md Abdul Kadir (1 and 3), Daniel Sonntag (1 and 3) ((1) German Research Center for Artificial Intelligence (DFKI), Saarbrücken, Germany, (2) Saarland University, (3) Oldenburg University, Oldenburg, (4) BEGO GmbH & Co. KG, Bremen, Germany)

Work performed while affiliated with Saarland University., German Research Center for Artificial Intelligence (DFKI), Saarbrücken, Germany, Saarland University, Saarbrücken, Germany, Oldenburg University, Oldenburg, Germany

2026-07-03视觉感知

论文针对热力图只给位置、传统概念瓶颈依赖人工概念且缺少空间落地和概念关系建模的问题,提出 G-CBM:用 NMF 无监督发现视觉概念,将图像区域匹配到概念节点,并用 GAT 推理概念间依赖,同时通过阈值过滤弱证据。实验覆盖 ImageNet 与三类皮肤镜数据,较 ResNet-50 平均 AUC 相对提升 3.7%,PH2 仅用 2/10 个概念达 0.96 AUC,删除/插入实验显示概念排序与预测较一致。

NeuroBridge: Bridging Multi-Task MRI Knowledge for Neurodegenerative Disease Diagnosis Figure 1
2026-07-03cs.LG

NeuroBridge: Bridging Multi-Task MRI Knowledge for Neurodegenerative Disease Diagnosis

Mengyu Li, Guoyao Shen, Chad W. Farris, Xin Zhang

Department of Mechanical Engineering, Boston University, Boston, MA 02215, The Photonics Center, Boston University, Boston, MA 02215, United States, Rafik B. Hariri Institute for Computing and Computational Science & Engineering, Boston University, Boston, MA, 02215, United States, Department of Radiology, Boston University Chobanian & Avedisian School of, Department of Radiology, Boston Medical Center, Boston, MA 02118, United States, Department of Electrical and Computer Engineering, Boston University, Boston, MA, Department of Biomedical Engineering, Boston University, Boston, MA 02215, Division of Materials Science and Engineering, Boston University, Boston, MA, Prof. Xin Zhang, Department of Mechanical Engineering, Boston University, Boston, Dr. Chad Farris, Department of Radiology, Boston University Chobanian & Avedisian, School of Medicine, Boston, MA 02118, United States

2026-07-03生成模型

针对 AD、MCI 等神经退行性疾病在 MRI 上结构改变细微且异质、单任务模型难以整合临床多线索的问题,NeuroBridge 将大规模 MAE 自监督预训练与海马分割、海马萎缩分类和重建任务结合,并用门控融合形成统一诊断表征。在 ADNI/OASIS 上其 AD vs CN 准确率达 88.17%/82.78%,对 MCI 和混合诊断任务增益更明显,并展示了跨队列泛化与概率化机会筛查潜力。

Computer Vision for Wildlife Monitoring: Detecting Brown Howler Monkeys using YOLO Figure 1
2026-07-03cs.CV

Computer Vision for Wildlife Monitoring: Detecting Brown Howler Monkeys using YOLO

Gabriel Ferri Schneider, Guido Luis Glufke Mainardi, Paulo Ricardo Knob, Patrícia Dias, Márcia Jardim, Júlio César Bicca-Marques, Soraia Raupp Musse

2026-07-03视觉感知

为降低树冠桥相机陷阱监测中大量误触发视频的人工筛查成本,论文将真实棕吼猴影像与 Unity 生成的合成数据混合,用 YOLOv10 微调检测模型,并比较不同比例辅助数据的作用。核心洞察是合成数据可缓解野生动物标注数据瓶颈,但给定文本未展示完整实验数值,主要结果和增益幅度文中未充分说明。

Rethinking Generic Object Tracking Toward Human-Level Perceptual Intelligence Figure 1
2026-07-03cs.CV

Rethinking Generic Object Tracking Toward Human-Level Perceptual Intelligence

Shih-Fang Chen

2026-07-03视觉感知

本文针对通用目标跟踪在开放类别、遮挡、干扰物和场景突变下难以稳定在线适应的问题,主张向人类视觉的连续感知靠拢。核心创新是结合基础模型自动视觉提示、面向测试时的在线适应学习,以及融合几何与语义的跨模态在线模型编辑,以增强目标判别、遮挡感知和空间推理。论文称这些机制提升了复杂动态视频中的泛化与鲁棒跟踪能力,但具体实验增益与来源在给定文本中未充分说明。

MIBE: Multi-subject Interaction Benchmark and Evaluator for Personalized Image Generation Figure 1
2026-07-03cs.CV

MIBE: Multi-subject Interaction Benchmark and Evaluator for Personalized Image Generation

Zhihan Chen, Yuhuan Zhao, Yijie Zhu, Xinyu Yao, Mengcong Ren, Suwen Wang, Qiuyang Yin, Yuchen Sun, Qin Wang, Lu Xin

University of California, Los Angeles, University of Southern California, DeerLab LLC, Carnegie Mellon University, Clemson University, San Jose State University, University of Illinois at Urbana-Champaign

2026-07-03视觉感知数据集/基准

该文关注多主体个性化图像生成中的“绑定”失败:模型常漏掉主体、混淆外观或把交互关系分配错,而传统 CLIP/DINO 或偏好指标随主体数增加接近随机。MIBE 将基准 MIB 与评估器 MIE 结合,用分层多主体交互任务、60K VLM 银标和 4K 人类金标训练参考条件评估器,并显式诊断存在、外观、交互错误。结果显示 MIE 在金标上与人类偏好达到 0.922 配对准确率,未见生成器也有 0.884,说明收益主要来自带诊断标签的数据与参考条件评估设计。

MapDreamer: Aerial Imagery Conditioned Latent Diffusion for Lane-Level Map Generation Figure 1
2026-07-03cs.CV

MapDreamer: Aerial Imagery Conditioned Latent Diffusion for Lane-Level Map Generation

Julian Brandes, Philipp Crocoll, Wolfram Burgard

2026-07-03视觉感知生成模型

面向自动驾驶高精地图制作成本高、航拍图到车道级拓扑图转换困难的问题,MapDreamer 将车道中心线及连接关系压缩到 VAE 潜空间,并用航拍特征条件化的 Transformer 扩散模型生成图结构;车道数量模块、ghost latents 与滑窗拼接用于处理可变车道数和城市级连续性。在 UrbanLaneGraph/Argoverse 2 实验中,其几何精度和拓扑连通性优于非生成式基线。

Multi-modal Rail Crossing Safety Analysis Figure 1
2026-07-03cs.LG

Multi-modal Rail Crossing Safety Analysis

Paimon Goulart, Chansong Lim, Nícolas Roque dos Santos, Yue Dong, Sheldon Peterson, Jia Chen, Evangelos E. Papalexakis

University of California, Riverside, University of California, Riverside Riverside California USA

2026-07-03安全鲁棒

针对铁路平交道口风险评估依赖结构化统计变量、难覆盖驾驶员视角视觉隐患的问题,论文提出结合街景图像序列、FRA事故记录与官方APS评分的多模态VLM流程,并加入风险分组路由与LoRA微调。结果显示其高低风险分类macro F1为0.757,连续安全分数预测RMSE为0.078、相关性0.492,且能在雨夜等增强场景中识别部分可视风险因素。

Spatial-Temporal Expert Learning for Video-based Person Re-identification Figure 1
2026-07-03cs.CV

Spatial-Temporal Expert Learning for Video-based Person Re-identification

Xiaofei Hui, Pengfei Wang, Evan Ling, Dezhao Huang, Keng Teck Ma, Minhoe Hur, Jun Liu

2026-07-03视觉感知

针对视频行人重识别中外观相似身份难以仅靠全局特征区分的问题,论文提出输入感知、可扩展的专家模块:相似样本动态激活同一类专家以学习局部细粒度差异,并在专家内按通道选择空间或时间线索,从而适配鞋、包、发型或步态等判别信息。方法在 MARS 和 LS-VID 两个大规模数据集上取得突出性能,但摘要片段未给出具体数值增益。

KathaTrace: Diagnosing Semantic Trajectory Collapse in Generated Visual Narratives Figure 1
2026-07-03cs.CV

KathaTrace: Diagnosing Semantic Trajectory Collapse in Generated Visual Narratives

Jamuna S. Murthy, Amin Karimi Monsefi, Rajiv Ramnath

Ramaiah Institute of Technology, The Ohio State University

2026-07-03规划控制

这篇论文针对视觉故事生成中“画面连贯但转场语义丢失”的问题,提出 KathaTrace 以文本、图像和联合证据评估转场可恢复性,并用 STG 衡量可视化造成的语义轨迹塌缩。作者构建 KathaBench-25K,覆盖 5000 个经典叙事和近 2.9 万个问答;实验显示多种生成器仍有显著 STG(约 23.5±1.3),Semantic Compass 可将其降至 21.4,说明转场级规划与修复比单纯提升画质更关键。

CPG-PAD: Concept-Informed Prompts Guided Presentation Attack Detection Figure 1
2026-07-03cs.CV

CPG-PAD: Concept-Informed Prompts Guided Presentation Attack Detection

Haoyuan Zhang, Xiangyu Zhu, Li Gao, Ajian Liu, Siran Peng, Zhen Lei

Haoyuan Zhang is with the School of Artificial Intelligence, University of Chinese Academy of Sciences, Beijing 100049, China, the School of Artificial Intelligence, University of Chinese Academy of Sciences, Beijing 100049, China, the Centre for Artificial Intelligence and Robotics, Hong Kong Institute of Science and Innovation, Chinese Academy of Sciences, Hong Kong, China

2026-07-03视觉感知

本文针对人脸呈现攻击检测在传感器、光照和攻击材料变化下泛化差的问题,指出现有 CLIP 式方法仅用类别监督学习提示,容易贴合域内伪迹而非可迁移攻击线索。CPG-PAD 的核心是用 XAI 从预训练 VLM 中发现与 PAD 相关的视觉概念,并以概念热图监督提示学习,通过 VCE、PCI 和 VPD 将模型内部概念注入 prompt 空间。实验覆盖 9 个基准,在多源、少源和单源跨域设置下均达到或超过 SOTA,且消融显示概念映射与视觉-提示交互带来主要增益。

AnchorSplat: Fast and Structure Consistent Detail Synthesis for Gaussian Splatting Figure 1
2026-07-03cs.CV

AnchorSplat: Fast and Structure Consistent Detail Synthesis for Gaussian Splatting

Dexu Zhu, Jiangnan Shao, Xiaofeng Wang, Junxian Duan, Jie Cao, Zheng Zhu, Huaibo Huang

2026-07-03三维

本文针对低质量 3D Gaussian Splatting 资产常见的细节缺失、纹理噪声,以及现有 2D 超分再重建流程带来的多视角不一致、耗时和依赖原始图像问题,提出直接在 3DGS 结构上工作的 AnchorSplat。其关键是用点锚机制将新细节限制在局部几何附近,并以单次乘法生成替代迭代增密。实验在新建 3DGS-SR 基准上达到 SOTA,吞吐最高较优化法快 10^5 倍,并能零样本增强生成资产和真实扫描。

Benchmarking Federated Learning and Knowledge Distillation for Point Cloud Classification Figure 1
2026-07-03cs.GR

Benchmarking Federated Learning and Knowledge Distillation for Point Cloud Classification

Aizierjiang Aiersilan

University of Macau

2026-07-03数据集/基准三维

面向隐私敏感且算力受限的三维点云部署,论文构建了联邦学习与知识蒸馏联合基准,覆盖13种FL算法、10种KD目标及完整组合。结果显示极端非IID标签偏斜下FL显著退化且无通用最优;KD可将学生模型缩小约74.5%、推理约加速一倍。但含硬标签交叉熵的蒸馏会掩盖崩溃教师的失败,学生高精度主要来自代理标签,因此作者建议采用无标签蒸馏评估FL-KD。

2026-07-02

160 篇
Ink3D: Sculpting 3D Assets with Extremely Complex Textures via Video Generative Models Figure 1
2026-07-02cs.CV

Ink3D: Sculpting 3D Assets with Extremely Complex Textures via Video Generative Models

Yue Han, Chong Li, Zhening Liu, Cong Huang, Fang Deng, Yong Liu, Fangyun Wei, Yan Lu

2026-07-02视觉感知生成模型三维

Ink3D针对现有3D生成模型几何已较成熟、但受限于高质量3D纹理数据稀缺而难以还原文字、织物和高频装饰等复杂外观的问题,将几何与纹理解耦:先生成白模,再用条件视频模型生成水平与垂直360度环绕视图,并通过TextureOptimizer把密集多视角观测稳健烘焙到几何上。文中结果显示,其纹理细节、覆盖完整性和跨视角一致性优于稀疏多视图方案,但增益可能主要来自大规模视频先验与更密集视角覆盖。

Linkify: Learning from Interface-Augmented Assembly Graphs Figure 1
2026-07-02cs.CV

Linkify: Learning from Interface-Augmented Assembly Graphs

Anushrut Jignasu, Daniele Grandi

Iowa State University, Iowa State University USA

2026-07-02视觉感知

这篇论文针对CAD装配中现有零件检索多依赖整体形状或文本、难以回答“此处应放什么零件”的问题,提出将零件接触界面显式编码到装配图边上的 Linkify。其核心洞察是功能约束主要体现在局部接触几何,而非单个零件形状;作者重算 Fusion 360 装配接触并用 GATv2 做遮挡零件预测。结果显示其在Top-K与F1上优于非图基线,消融表明准确接触、边属性和动态注意力均有贡献,但绝对Top-1仍较低。

World from Motion: Generative Dynamic Gaussian Reconstruction from Monocular Video Figure 1
2026-07-02cs.CV

World from Motion: Generative Dynamic Gaussian Reconstruction from Monocular Video

Liyuan Zhu, Shengyu Huang, Amrita Mazumdar, Tianye Li, Zan Gojcic, Gordon Wetzstein, Iro Armeni, Shalini De Mello, Alex Trevithick

Stanford University

2026-07-02视觉感知生成模型强化学习三维

单目视频4D重建常在几何一致性与生成补全之间取舍,尤其难恢复未观测动态区域。World from Motion的核心洞察是把动态3D Gaussian作为可微世界表示,渲染外观、几何和3D运动等密集条件来约束视频生成,再将新视角与新运动蒸馏回统一3DGS。文中报告其在DyCheck感知质量和运动估计上达到新SOTA,并能泛化到大视角变化的野外视频。

Perceive-to-Reason: Decoupling Perception and Reasoning for Fine-Grained Visual Reasoning Figure 1
2026-07-02cs.CV

Perceive-to-Reason: Decoupling Perception and Reasoning for Fine-Grained Visual Reasoning

Hongxing Li, Xiufeng Huang, Dingming Li, Wenjing Jiang, Zixuan Wang, Haolei Xu, Hanrong Zhang, Haiwen Hong, Longtao Huang, Hui Xue, Weiming Lu, Jun Xiao, Yueting Zhuang, Yongliang Shen

Zhejiang University

2026-07-02视觉感知

这篇论文针对高分辨率图像中细小关键线索难以定位、导致细粒度视觉推理失败的问题,提出 P2R 将“看哪里”的感知与“如何答”的推理解耦:先生成相关框和裁剪区域,再基于标注图推理,并用 PRA-GRPO 在仅有最终答案监督下交替优化两种角色。基于 Qwen3-VL,P2R 在 V-Star、HR-Bench-4K/8K 上显著超过对应骨干,4B 模型分别达到 93.2%、81.9%、80.5%。

High-dimensional Embedding Prior for Noisy K-space Domain MRIReconstruction Figure 1
2026-07-02cs.CV

High-dimensional Embedding Prior for Noisy K-space Domain MRIReconstruction

Yu Guan, Tianjia Huang, Qinrong Cai, Qiuyun Fan, Dong Liang, Qiegen Liu

2026-07-02三维

该文针对实际 MRI 加速采集中欠采样与噪声共同导致的 k-space 重建不稳定问题,指出扩散式重建不应只改采样器或数据一致性,还应改造变量表示;提出 HEP 高维嵌入先验,将 k-space 提升到更具表达力的表示空间,并可即插即用接入多种扩散逆问题求解器。实验覆盖不同噪声、欠采样率和轨迹,在院内与公开数据上均提升重建质量,高噪声场景增益最大。

Structured 4D Latent Predictive Model for Robot Planning Figure 1
2026-07-02cs.RO

Structured 4D Latent Predictive Model for Robot Planning

Zhiyi Li, Peilin Wu, Xiaoshen Han, Ruojin Cai, Yilun Du

2026-07-02机器人规划控制

这篇论文针对视频式机器人规划缺乏三维几何一致性、在遮挡和视角变化下易失效的问题,提出在稀疏体素结构化3D潜空间中预测随时间演化的4D场景,并用文本指令条件化生成未来三维目标,再由目标条件逆动力学转成动作。实验显示其相较视频规划器具备更好的多视角一致性和3D一致性,在复杂操作、视觉变化泛化及真实机器人任务上表现更优。

EquiSteer: Cross-Attention Steering Towards a Fairer Text-Guided Image Generation Figure 1
2026-07-02cs.CV

EquiSteer: Cross-Attention Steering Towards a Fairer Text-Guided Image Generation

Tatiana Gaintseva, Akshit Achara, Gregory Slabaugh, Jiankang Deng, Ismail Elezi

Gregory Slabaugh

2026-07-02视觉感知

针对文生图模型在“护士”“CEO”等中性职业提示下放大性别、种族、年龄偏差的问题,EquiSteer将去偏从训练或批量约束转向推理期交叉注意力激活控制:用对比提示预计算属性 steering 向量,并通过提示感知门控保留显式属性提示,对中性提示先正交移除既有属性信号再注入目标属性。在SD-1.5、SD-2.1、SDXL和SANA上,平均公平性差距最高降低87%,且图像质量与文本对齐影响较小。

Relation-Centric Open-Vocabulary 3D Gaussian Segmentation Figure 1
2026-07-02cs.CV

Relation-Centric Open-Vocabulary 3D Gaussian Segmentation

Eunsung Cha, Hyunjoon Lee, Jaesik Park

Seoul National University, Republic of Korea

2026-07-02视觉感知三维

本文针对开放词汇 3D Gaussian 分割中语言查询灵活性与实例边界一致性难以兼顾的问题,提出 PairGS,将分割转化为高斯之间的成对关系建模。其洞察是 3DGS 的视角贡献、可见性与多视图掩码已包含同实例亲和信息,可用两阶段稀疏图构建和 TreeDBSCAN 形成层级聚类,支持多粒度查询。实验称在相关基准达到 SOTA,快速版较优化实例特征方法快 50 倍。

SD-RouteFusion: Ego-Trajectory Prediction with SD-Map Route Conditioning Figure 1
2026-07-02cs.CV

SD-RouteFusion: Ego-Trajectory Prediction with SD-Map Route Conditioning

Sviatoslav Voloshyn, Bruno K. W. Martens, Wangxin Liu, Jakob Vinkås, Junsheng Fu

2026-07-02规划控制

这篇工作针对自动驾驶自车轨迹预测中过度依赖昂贵 HD 地图、难以规模化部署的问题,提出用可广泛获得的 SD 地图导航路线作为长时域意图先验,并与前视相机和车辆运动学端到端融合。核心设计是路线主导与图像主导的双假设加门控分类器,使路线可靠时利用其消歧,路线错误或视觉不确定时保持鲁棒。在 48 万真实驾驶场景上,SD 路线条件带来 10.5% ADE 降低,完整融合在 8 秒预测上降低 16.9%。

Towards Metric-Agnostic Trajectory Forecasting Figure 1
2026-07-02cs.CV

Towards Metric-Agnostic Trajectory Forecasting

Markus Knoche, Daan de Geus, Bastian Leibe

2026-07-02规划控制

本文针对轨迹预测模型过度绑定 Argoverse、Waymo 等评测指标的问题,主张先用与指标无关的概率目标学习校准的预测分布,再通过 TraDiE 后处理策略按 minFDE、soft mAP、miss rate 等指标抽取 K 条轨迹。作者将 DONUT 改为 NLL 训练的 DONUT-NLL,并比较不同位置分布,结果在 Waymo 多项指标达到 SOTA,同时显示单一模型可适配多种指标,但推理开销增加且 Argoverse 泛化仍有限。

Autonomous Scientific Discovery via Iterative Meta-Reflection Figure 1
2026-07-02cs.CV

Autonomous Scientific Discovery via Iterative Meta-Reflection

Bingchen Zhao, Sara Beery, Oisin Mac Aodha

University of Edinburgh, Massachusetts Institute of Technology

2026-07-02视觉感知

这篇论文针对现有自动科学发现系统依赖预设问题、搜索空间受限且缺少跨发现反思的问题,提出 DiscoPER:让 LLM 生成可执行统计分析,并用 Propose-Evaluate-Reflect 循环把已验证/被拒发现作为“经验数据”进行二阶反思,继续引导开放式多模态探索。在 iNatDisco 生态 benchmark 上恢复 8/9 个已知模式,假设支持率 72.7%,优于因果发现和 LLM 基线;消融显示反思与更多数据均有增益。

MoHallBench: A Benchmark for Motion Hallucination in Video Large Language Models Figure 1
2026-07-02cs.CV

MoHallBench: A Benchmark for Motion Hallucination in Video Large Language Models

Jiale Li, Sihan Chen, Mengyuan Liu

Xiamen University, South China University of Technology, Peking University, Xiamen University Xiamen China, South China University of Technology Guangzhou China, Peking University Beijing China

2026-07-02视觉感知数据集/基准

这篇论文针对 VideoLLM 容易把未出现的人体动作“脑补”出来的问题,提出 MoHallBench 专门评测运动幻觉,而非仅看物体幻觉或粗粒度动作识别。其创新在于把误判来源拆成共现先验、顺序推断和相似动作混淆,并构造 11306 个视频、40493 个问答及双向提问指标以抑制肯定偏置。实验显示,动作识别强不等于抗幻觉强,尤其在截断视频引发的顺序推断场景中,模型最容易根据部分线索过度推断结果。

CPDDNet: Color-Polarization Denoising and Demosaicking Network Figure 1
2026-07-02cs.CV

CPDDNet: Color-Polarization Denoising and Demosaicking Network

Qihang Zhang, Yusuke Monno, Masayuki Tanaka, Masatoshi Okutomi

2026-07-02视觉感知

本文针对彩色偏振滤波阵列在低光、短曝光下同时存在噪声和马赛克缺失的问题,指出传统先去噪后去马赛克或相反的串联流程会传播噪声或抹平结构。CPDDNet以DN-to-DM为主干,引入特征融合模块,把原始带噪CPFA特征与去噪特征在去马赛克阶段桥接起来,以减少信息损失。实验证明其在真实数据集上提升图像质量和偏振参数精度,优于现有基线与分离式方法。

LongVQUBench: Benchmarking Long-Term Video Quality Understanding of Vision-Language Models Figure 1
2026-07-02cs.CV

LongVQUBench: Benchmarking Long-Term Video Quality Understanding of Vision-Language Models

Arpita Nema, Hanwei Zhu, Xi Zhang, Weisi Lin

2026-07-02视觉语言视觉感知数据集/基准

长视频质量理解需要模型在较长时间内追踪画质退化、时序一致性和累积失真,但现有基准多停留在短片段。LongVQUBench构建1200余公开视频和1500个问答,按局部、跨事件、全局三层评估,并加入稀疏“针尖”失真检测。对14个LVLM的零样本实验显示,视频越长、推理层级越深性能越明显下降,暴露其长程时序整合和失真归因能力不足。

Human-Centric Transferable Tactile Pre-Training for Dexterous Robotic Manipulation Figure 1
2026-07-02cs.RO

Human-Centric Transferable Tactile Pre-Training for Dexterous Robotic Manipulation

Chi Zhang, Penglin Cai, Ziheng Xi, Haoqi Yuan, Hao Luo, Wanpeng Zhang, Sipeng Zheng, Chaoyi Xu, Zongqing Lu

Peking University, Tsinghua University

2026-07-02机器人

针对机器人触觉数据难采集、现有 VLA 多依赖视觉而难处理接触密集操作的问题,本文提出 H-Tac 人类第一视角触觉-动作数据集,并用统一触觉/动作空间进行 TTP 预训练与机器人后训练,引入触觉专家预测未来触觉以建模接触动力学。仿真和真实机器人实验显示其优于无预训练或无触觉基线,在精细操作、泛化和跨形态迁移上更稳健,但具体增益中数据规模贡献可能较大。

GeoSearcher: Anchor-Guided Progressive Reasoning for Remote Sensing Visual Grounding with Process Supervision Figure 1
2026-07-02cs.CV

GeoSearcher: Anchor-Guided Progressive Reasoning for Remote Sensing Visual Grounding with Process Supervision

Dianyu Wang, Yidan Zhang, Peirong Zhang, Xuyang Li, Xiaoxuan Liu, Lei Wang

This work was supported in part by Key Program of Chinese Academy of Sciences under Grant KGFZD-145-25-38 and RCJJ-145-24-13

2026-07-02视觉语言视觉感知

针对遥感视觉定位中目标小、干扰物多且查询依赖参考物和空间关系的问题,GeoSearcher不再一次性生成框,而是把已验证参考物坐标作为锚点,引导模型逐步缩小搜索区域;并通过ACR-SFT与带过程奖励和样本选择的PF-GRPO监督推理过程。实验显示其在DIOR-RSVG、OPT-RSVG和VRS-Bench上超过现有方法,尤其利于多线索小目标定位。

GenAU: Language-Grounded Industrial Anomaly Understanding with Vision-Language Models Figure 1
2026-07-02cs.CV

GenAU: Language-Grounded Industrial Anomaly Understanding with Vision-Language Models

Hongkuan Zhou, Tristan Rehm, Nadeem Nazer, Lavdim Halilaj, Jingcheng Wu, Steffen Staab

Institute for Artificial Intelligence University of Stuttgart, Stuttgart, Germany, Otto-von-Guericke-University Magdeburg, Magdeburg, Germany, University of Southampton, Southampton, UK

2026-07-02视觉语言视觉感知

论文针对工业质检中“是否异常、在哪、何种缺陷、为何异常”难以由单一模型同时回答的问题,提出 GenAU,在指令式 VLM 中加入 [SEG_defect]/[SEG_normal] 作为语言锚点,将解码隐藏状态与多尺度视觉特征对齐生成异常图,并联合文本与分割训练。跨数据集实验显示其在 VisA、Real-IAD 的零样本图像级检测优于多数 CLIP 基线,同时具备多类型识别和缺陷解释能力,但分割仍未超过专用 CLIP 方法,存在推理能力与定位性能的权衡。

EchoRisk: A Multicentre Echocardiography Dataset and Benchmark for Cardio-Oncology Figure 1
2026-07-02cs.CV

EchoRisk: A Multicentre Echocardiography Dataset and Benchmark for Cardio-Oncology

Grigorios Kalliatakis, Georgia Karanasiou, Georgios Manikis, Manolis Tsiknakis, Dimitrios Fotiadis, Dorothea Tsekoura, Kalliopi Keramida, Vasileios Bouratzis, Lampros Lakkas, Katerina Naka, Andri Papakonstantinou, Anastasia Constantinidou, Kostas Marias

2026-07-02数据集/基准安全鲁棒

针对乳腺癌治疗相关心脏毒性难以及早从常规超声中自动分层的问题,EchoRisk提供首个多中心、纵向且带明确心毒性标签的超声心动图数据集与MICCAI 2026基准,覆盖LVEF估计、纵向左室功能障碍分类和治疗前风险预测三项任务。R(2+1)D+LSTM基线在功能评估和障碍分类上表现较强,但仅凭治疗前视频预测未来心毒性仍是主要瓶颈。

Reading Order Inference for Complex Document Layouts Figure 1
2026-07-02cs.CL

Reading Order Inference for Complex Document Layouts

Iddo Hakim, Sharva Gogawale, Omer Ventura, Gal Grudka, Daria Vasyutinsky-Shapira, Berat Kurar-Barakat, Nachum Dershowitz

2026-07-02视觉感知

复杂历史文档常含多条交织阅读流,几何邻近难以判定真实顺序。本文将 OCR 行建成候选转移图,用轻量语言模型的连贯性信号为边打分,并以最大后悔规则求受度约束的路径覆盖,避免贪心“抢边”。在 Glossa 环绕布局上继承边准确率约 95%(XY-cut 50%),OmniDocBench 多栏子集达 88%,优于 XY-cut 和迁移不佳的 LayoutReader。

SuperFlex: Deformable Superquadrics for Point Cloud Decomposition Figure 1
2026-07-02cs.CV

SuperFlex: Deformable Superquadrics for Point Cloud Decomposition

Gabriel Tavernini, Elisabetta Fedele, Tiago Novello, Leonidas Guibas, Marc Pollefeys, Francis Engelmann

2026-07-02三维

SuperFlex针对超二次曲面分解在三维物体表示中虽紧凑可解释、但重建精度不足、只能表达刚性对称部件且难处理真实遮挡点云的问题,提出新的训练损失,并将弯曲与锥化变形纳入学习式超二次曲面预测,再用高质量完整分解监督部分点云输入。实验在ShapeNet和Aria合成环境上显示,其相较优化式与学习式基线显著提升重建精度,同时保持少量参数的紧凑表示,并能从部分观测恢复较完整的原语结构。

Foundation Models vs. Radiomics for Lung Computed Tomography: A Benchmark of Feature Extractors, Classification Heads, and Segmentation Choices Figure 1
2026-07-02cs.CV

Foundation Models vs. Radiomics for Lung Computed Tomography: A Benchmark of Feature Extractors, Classification Heads, and Segmentation Choices

Nils Neukirch, Martin Maurer, Nils Strodthoff

2026-07-02视觉感知数据集/基准

这篇论文针对肺部 CT 中放射组学与基础模型比较常被固定分割、分类头且缺少外部验证的问题,构建了覆盖特征提取器、分类头、分割方案和多任务的因子化基准。结果显示关键因素随任务变化:体积和分期主要受分割影响,生存、组织学和年龄更依赖分类头;放射组学在体积、分期和生存上仍有竞争力,Curia 系列在部分任务接近最优,DINOv3略弱,默认推荐为肿瘤分割下 Curia+CatBoost。

AVSR-Diff: Scale-Agnostic Diffusion Priors for Temporally Consistent Arbitrary-Scale Video Super-Resolution Figure 1
2026-07-02cs.CV

AVSR-Diff: Scale-Agnostic Diffusion Priors for Temporally Consistent Arbitrary-Scale Video Super-Resolution

Geunhyuk Youk, Jeonghyeok Do, Dayeon Kim, Jihyong Oh, Munchurl Kim

2026-07-02视觉感知生成模型

针对扩散视频超分多固定倍率、任意尺度方法在大倍率下过平滑且易闪烁的问题,AVSR-Diff将低分辨率潜空间去噪与连续坐标渲染解耦,用TGFR对齐跨帧扩散先验,并以SAFR按目标尺度调制频率细节。实验显示其在多尺度上兼顾高频纹理与时间稳定性,优于任意尺度基线,且在4×上超过部分固定尺度生成式方法。

QCA: Query- and Content-Aware Keyframe Selection for Long Video Understanding Figure 1
2026-07-02cs.CV

QCA: Query- and Content-Aware Keyframe Selection for Long Video Understanding

Jun Peng, Baiyang Song, Jie Li, Hui Li, Yiyi Zhou, Rongrong Ji, Yonghong Tian

2026-07-02视觉感知

长视频送入 Video-LLM 时受冗余帧和 token 预算限制,均匀采样或只看查询相似度容易漏掉关键片段或选到重复内容。QCA 的核心是同时利用查询相关性与内容偏离度,先按时间段估计信息贡献并自适应分配帧预算,再在段内以最相关帧为锚点贪心选择兼具相关性和多样性的关键帧,且无需额外训练。实验显示其在 LongVideoBench、Video-MME 等基准上优于多种采样策略,并在 LLaVA-Video、Qwen3-VL 上带来约 4%–4.78% 平均增益。

Privacy-Preserving Depth-Only Open-Vocabulary 3D Semantic Segmentation Via Uncertainty-Guided Test-Time Optimization Figure 1
2026-07-02cs.CV

Privacy-Preserving Depth-Only Open-Vocabulary 3D Semantic Segmentation Via Uncertainty-Guided Test-Time Optimization

Xuying Huang, Sicong Pan, Maren Bennewitz

2026-07-02视觉感知优化算法三维安全鲁棒

这篇论文面向室内机器人在家庭、医院等隐私敏感场景中的开放词汇3D语义分割,指出依赖RGB会泄露视觉信息,而仅用深度几何又会显著增加语义不确定性。作者提出UTTO,在测试时用增强一致性估计逐点不确定性,只优化类别分布,并结合文本去偏与特征语义一致性先验,保留稳定区域、细化不可靠区域。ScanNet20/40/200实验显示其在无RGB、无额外训练条件下稳定优于代表性基线。

TRCGL-Net: A Long-Tailed Multi-Label Chest X-Ray Classification Framework with Generative Data Augmentation and Label Co-Occurrence Modeling Figure 1
2026-07-02cs.CV

TRCGL-Net: A Long-Tailed Multi-Label Chest X-Ray Classification Framework with Generative Data Augmentation and Label Co-Occurrence Modeling

Tong Shao, Hongshun Ling, Li Zhang, Jinjing Wu, Junke Wang, Yuan Gao, Fang Wang

2026-07-02生成模型

这篇论文针对胸片多标签分类中的极端长尾问题:稀有病灶样本少、特征易被解剖背景淹没,且标签共现建模常被高频类别主导。TRCGL-Net用文本引导条件扩散生成尾类样本,并结合通道/类别注意力与标签共现GCN增强尾类表征。在PadChest上尾类mAP达0.4904、整体mAP 0.4408、mAUC 0.8989,但主要增益可能较多来自生成式数据扩增。

QuaMoE-DRF: Proactive Beam and Rate Adaptation via Multimodal Dynamic Radio Map Forecasting in ISAC Networks Figure 1
2026-07-02cs.IT

QuaMoE-DRF: Proactive Beam and Rate Adaptation via Multimodal Dynamic Radio Map Forecasting in ISAC Networks

Zhihan Zeng, Kaihe Wang, Zhongpei Zhang, Chongwen Huang

Engineering, Zhejiang University, Hangzhou 310027, China, Provincial Key Laboratory of Multi-Modal Communication Networks and, and also with the National Key Laboratory

2026-07-02视觉语言

面向6G ISAC中车辆等移动遮挡导致的毫米波链路突变,论文认为单纯预测波束索引会丢失SINR裕量、MCS阈值和基站备选信息,提出以未来beam-SINR场为中间表征的QuaMoE-DRF,并用质量感知MoE融合静态几何、运动事件、结构化感知和无线历史。在动态多基站城市基准上,有效率达402.5 Mbps、 outage为0.0417,相比最强基线速率提升5.67%、中断降低8.35%;但验证主要依赖简化阻塞/路径损耗仿真标签。

Slope-Guided Mamba and Angular-Refined Transformer for Light Field Super-Resolution Figure 1
2026-07-02cs.CV

Slope-Guided Mamba and Angular-Refined Transformer for Light Field Super-Resolution

Li Jin, Jian Huang, Junde Lu, Shuai Wang, Hao Sheng, Jie Wu

2026-07-02视觉感知

本文针对光场超分中空间—角度建模割裂、Mamba规则扫描与EPI斜线几何不匹配的问题,提出SMART混合网络:用角度调制空间注意力增强跨视角约束,并以估计EPI斜率引导Mamba沿几何一致轨迹聚合特征。五个基准上达到SOTA,PSNR较既有方法提升0.42 dB,伪影更少。

GaussianEmoTalker: Real-Time Emotional Talking Head Synthesis with Audio-Driven and Blendshape-Based 3D Gaussian Splatting Figure 1
2026-07-02cs.CV

GaussianEmoTalker: Real-Time Emotional Talking Head Synthesis with Audio-Driven and Blendshape-Based 3D Gaussian Splatting

Haijie Yang, Zhenyu Zhang, Yixuan Dong, Jianjun Qian, Jian Yang

2026-07-02三维

这篇论文针对情感说话头在唇形同步、表情强度可控与实时性之间难以兼顾的问题,将生成过程拆成“中性说话空间+情感残差形变”:先用 GaussianBlendshapes 建立身份相关的高保真中性 3D Gaussian 表示,再融合网格位移、音频、情感类别和强度,通过空间-音频-情感注意力预测 Gaussian 属性偏移。实验显示其在视频质量、唇同步、情感强度控制和实时渲染上优于或接近近期方法。

Learning Cardiac Motion Priors for Implicit Neural Representations Figure 1
2026-07-02cs.CV

Learning Cardiac Motion Priors for Implicit Neural Representations

Andrew Bell, George Webber, Andrew P King, Steffen E Petersen, Muhummad Sohaib Nazir, Alistair Young

2026-07-02视觉感知

针对每个病例单独优化心脏运动 INR 耗时且易受初始化轨迹影响的问题,本文系统比较了群体先验、权重平均共识先验、auto-decoder 与元学习四类心脏运动先验。结果显示,学习先验在少步适配中均显著优于随机初始化,将平均位移误差由 3.45 mm 降至 1.66–1.85 mm;auto-decoder 更快恢复大形变,元学习在 50 步适配中保持最佳优化轨迹。

Dataset Biases and Shortcut Learning in Motion-Based AI-Generated Video Detection Figure 1
2026-07-02cs.CV

Dataset Biases and Shortcut Learning in Motion-Based AI-Generated Video Detection

Joren Michels, Lode Jorissen, Nick Michiels

Digital Future Lab, Flanders Make, Hasselt University

2026-07-02视觉感知数据集/基准

针对通用 AI 生成视频检测日益依赖运动线索的问题,本文重新评估 D3、ReStraV、Over-Coherence、NSG-VD 等运动型检测器,核心洞察是其高分很大程度来自采样、预处理和数据集运动分布偏差,而非稳健捕捉生成视频本质缺陷。作者通过去偏、时间重平衡和简单空间增强发现,多数方法性能降至接近随机或显著退化;相比之下,频域检测器 WaveRep 在多数据集上更稳定,提示未来基准需更重视无偏数据与评测协议。

Post-Training Pruning for Diffusion Transformers Figure 1
2026-07-02cs.CV

Post-Training Pruning for Diffusion Transformers

Chengzhi Hu, Xuewen Liu, Jing Zhang, Mengjuan Chen, Zhikai Li, Qingyi Gu

2026-07-02生成模型

本文针对 DiT 图像生成模型推理成本高、现有 LLM 剪枝准则迁移后因权重尺度更大而误判重要性的痛点,提出 DiT-Pruning:用能量视角重新平衡权重与激活的显著性,并依据二维权重空间中的聚类结构自适应选择层级/通道级剪枝粒度。实验显示其在高稀疏率下更能保持生成质量,FLUX.1-dev 在 MJHQ 512×512、50% 稀疏时 CLIP 分数仅下降 0.001。

GMO-E$^2$DIT: Grounded Multi-Operation Editing for E-Commerce Images Figure 1
2026-07-02cs.CV

GMO-E$^2$DIT: Grounded Multi-Operation Editing for E-Commerce Images

Zipeng Guo, Xiaoan Liu, Lichen Ma, Cheng Wang, Yu He, Xiaolong Fu, Jingling Fu, Xinyuan Shan, Shaojie Guo, Luohang Liu, Junshi Huang, Yan Li

Wuhan University, Xi’an Jiaotong University, Sun Yat-sen University

2026-07-02视觉感知

面向电商图像中贴纸、标签、Logo 等局部元素的多步编辑需求,论文指出一次性编辑器容易把意图理解、区域定位和生成混在一起,导致漏改或误改。GMO-E²DIT 将任务改写为可审计的多操作完成过程:VLM 先生成带区域与操作类型的编辑议程,再由掩码条件编辑器执行,并用反思循环判断成功、继续或回滚。作者还构建数据流水线和 EComEditBench;实验显示其在指令遵循、区域保真和未编辑区域保持上优于开源及部分闭源基线。

Condensing Large-Scale Datasets Directly with Minimal Information Loss Figure 1
2026-07-02cs.CV

Condensing Large-Scale Datasets Directly with Minimal Information Loss

Xinyi Shang, Peng Sun, Bei Shi, Zixuan Wang, Tao Lin

2026-07-02数据集/基准

针对大规模数据集蒸馏中 Squeeze-Recover-Relabel 流程计算开销高、跨架构泛化弱的问题,论文指出根因是数据到模型再回到图像的双重压缩造成信息损失与分布偏移,使重标注不再可靠。作者提出 CIM,直接度量并最小化真实与合成数据的信息差以保持分布对齐;在 ImageNet-1K、IPC=10 上用单张 RTX-4090 约 80 分钟蒸馏,ResNet-18 Top-1 达 48.7%,较 NRR-DD 和 DELT 分别高 2.6 和 2.9 个百分点。

MG-RWKV: Multi-Grained Context-Aware RWKV for Temporal Forgery Localization Figure 1
2026-07-02cs.CV

MG-RWKV: Multi-Grained Context-Aware RWKV for Temporal Forgery Localization

Jingchen Ni, Cangjin Yu, Dan Jiang, Quan Zhang, Keyu Lv, Shannan Yan, Linyue Pan, Ke Zhang, Chun Yuan

2026-07-02视觉感知

针对长视频时序伪造定位中 CNN 难建模全局、Transformer 成本高、线性模型又易忽略突变边界的问题,MG-RWKV 将双向 RWKV 用于全序列线性建模,并用多粒度 MoE 选择显式时间感受野、用跨粒度一致性抑制真实片段误报。在 Lav-DF、TVIL、Psynd 等数据集取得 SOTA,Lav-DF mAP 为 87.29%,严格边界指标提升明显且计算复杂度保持 O(T)。

DeWorldSG: Depth-Aware 3D Semantic Scene Graph Generation via World-Model Priors Figure 1
2026-07-02cs.CV

DeWorldSG: Depth-Aware 3D Semantic Scene Graph Generation via World-Model Priors

Seok-Young Kim, Abdelrahman Elskhawy, Taewook Ha, Dooyoung Kim, Eunjae Shin, Benjamin Busam, Woontack Woo

2026-07-02强化学习三维

DeWorldSG针对RGB-D序列生成3D语义场景图时物体几何不稳定、逐帧关系推理易漏边的问题,将物体表示为由深度过滤得到的实例级概率3D高斯节点,并跨帧聚合关系证据,引入V-JEPA 2世界模型先验补全上下文关系。在3DSSG和ReplicaSSG上取得SOTA,较既有方法三元组召回提升77.4%、谓词召回提升23.2%,显示其对机器人操作和AR场景理解更可靠。

Geometry-Aware Cross-Height Channel Knowledge Map Prediction for UAV-Assisted Communications With Uncertainty-Guided 3D Sensing Figure 1
2026-07-02cs.CV

Geometry-Aware Cross-Height Channel Knowledge Map Prediction for UAV-Assisted Communications With Uncertainty-Guided 3D Sensing

Zhihan Zeng, Amir Hussain, Yue Xiu, Phee Lep Yeoh, Lu Chen, Zhongpei Zhang, Guan Gui

2026-07-02三维安全鲁棒

面向无人机在陌生城市中只能稀疏测量少数高度、却需推断未测高度信道图的需求,论文将问题明确为高度条件化的跨高度 CKM 预测。核心做法是用 FPN-Transformer 融合城市几何先验、多高度稀疏观测与目标高度描述,并加入不确定性头指导带运动和安全约束的在线感知。实验显示其在未见场景零样本 RMSE 为 5.347 dB,优于 3D-RadioDiff 的 6.937 dB;10-shot 适配降至 3.518 dB,主动感知预算 40 时降至 4.79 dB。

Beyond Pixel Overlap: A Framework for Decomposing Segmentation Evaluation Metrics Figure 1
2026-07-02cs.CV

Beyond Pixel Overlap: A Framework for Decomposing Segmentation Evaluation Metrics

Youwei Pang, Xiaoqi Zhao

Nanyang Technological University

2026-07-02视觉感知强化学习数据集/基准

针对二值目标分割中 IoU、像素误差等指标难以解释结构、边界、目标尺寸公平性和任务语义差异的问题,本文将评价指标拆成预测表示、目标提取、目标匹配、得分计算和结果报告五个阶段。核心洞察是把指标视为模块组合而非孤立公式,从而显式暴露阈值、粒度、匹配和聚合假设。主要结果是用该框架梳理多类代表性指标,说明新指标往往是在特定阶段修补旧协议局限,并给出更可复现、任务感知的评价设计空间。

Improving Sparse-View 3DGS Generalization via Flat Minima Optimization Figure 1
2026-07-02cs.CV

Improving Sparse-View 3DGS Generalization via Flat Minima Optimization

Kangmin Seo, Sangeek Hyun, MinKyu Lee, Jae-Pil Heo

2026-07-02优化算法学习理论三维

本文针对稀疏视角下 3D Gaussian Splatting 易过拟合输入图像、 novel view 泛化差的问题,将其解释为落入对参数扰动敏感的尖锐极小值,并把平坦极小值优化引入 3DGS。核心做法是按高斯各向异性尺度进行随机位置扰动,配合训练进度调度和非位置参数周期性重初始化,以在不改网络结构和不依赖外部先验的情况下增强鲁棒性。实验在 LLFF、Mip-NeRF360 及附录多个数据集上显示 PSNR/SSIM/LPIPS 多数提升,重建更稳定清晰,但高视角数场景增益会减弱。

OmniView-Space: Reinforcing Spatial Reasoning via Multi-Perspective Spatial Mapping Figure 1
2026-07-02cs.CV

OmniView-Space: Reinforcing Spatial Reasoning via Multi-Perspective Spatial Mapping

Xudong Li, Mengdan Zhang, Peixian Chen, Jiaxi Tan, Zihao Huang, Jingyuan Zheng, Yan Zhang, Xiawu Zheng, Xing Sun, Rongrong Ji

Key Laboratory of Multimedia Trusted Perception and Efficient Computing, Ministry of Education of China, Xiamen University, 361005, P.R. China, Tencent Youtu Lab, Beijing Institute of Technology

2026-07-02视觉感知

本文针对MLLM在空间问答中常因系统坐标与问题指定的相机、物体或方向自我视角不一致而累积推理错误的问题,提出OmniView-Space:用多视角空间映射生成查询对齐的BEV认知图和文本空间图,并通过工具调用策略与认知图蒸馏让模型学会选择锚点、重建自我视角证据。实验显示其在单图和多图空间推理基准上达到SOTA,蒸馏版还能减少对外部几何流水线的依赖。

EFlow: Learning Evidence Flow for Long-Video Reasoning with Adaptive Reflection Figure 1
2026-07-02cs.CV

EFlow: Learning Evidence Flow for Long-Video Reasoning with Adaptive Reflection

Wenhao Zhang, Kuanwei Lin, Xuyi Yang, Wei Gao, Ge Li

School of Electronic and Computer Engineering, Peking University, The Hong Kong University of Science and Technology

2026-07-02视觉感知生成模型

长视频推理的瓶颈在于模型常先形成答案假设再去裁剪证据,导致“过早语义承诺”和错误定位。EFlow的核心是把时间定位与答案推理解耦:先用T-CoT检索证据片段,再用R-CoT推理,并以低置信度logit margin触发全视频重读。基于Qwen3-VL经SFT、RL和RFT训练后,在VideoMME、LVBench、LongVideoBench、NextGQA等五个基准上均提升,说明显式证据流能改善长视频推理稳定性。

TrajLoc: Trajectory-Attention Localization for Multi-Object Motion Control Figure 1
2026-07-02cs.CV

TrajLoc: Trajectory-Attention Localization for Multi-Object Motion Control

Omer Sela, Inbar Huberman-Spiegelglas, Michael Rotman, Sagie Benaim, Avi Ben-Cohen

Tel Aviv University

2026-07-02规划控制

TrajLoc针对多目标视频生成中轨迹交叉、遮挡导致身份混淆和运动漂移的问题,认为稀疏轨迹无需扩展成密集控制张量,而可直接注入注意力与文本条件空间:用目标位置高斯热图替换每个对象 token 的交叉注意力权重,并以专用 token 编码轨迹、深度和首帧外观。在六个数据集、最多20个对象及两类骨干上,较最强基线平均提升4.3 dB PSNR,并将轨迹终点误差降低51%。

MoVA: Learning Asymmetric Dual Projections for Modular Long Video-Text Alignment Figure 1
2026-07-02cs.CV

MoVA: Learning Asymmetric Dual Projections for Modular Long Video-Text Alignment

Peiyuan Zhu, Shaoan Xie, Zijian Li, Yifan Shen, Namrata Deka, Harsh Shrivastava, Guangyi Chen, Kun Zhang

2026-07-02视觉感知

这篇论文针对 CLIP 式视频文本预训练在长视频中容易出现的时间错位与语义纠缠问题,指出帧级视觉细节与文本概念之间本身是稀疏且非对称相关的。MoVA 将对齐建模为潜变量识别问题,并引入文本侧帧感知概念选择与视频侧文本相关概念解耦的双非对称投影,在帧级做模块化对比学习。实验显示其在长短视频检索、文本到视频生成和概念可视化等任务上优于现有方法。

Mirror-Fusion Attention for Reflection-Aware Self-Supervised Representation Learning Figure 1
2026-07-02cs.CV

Mirror-Fusion Attention for Reflection-Aware Self-Supervised Representation Learning

Ruixin Li, Jin Liu, Yuling Shi, Stefano Lodi

2026-07-02视觉感知

这篇论文针对标准自监督学习把翻转当作不变增强、可能抹平医学影像和人脸中有用左右差异的问题,提出 MFASSL:在 ViT 预训练中构造镜像配对视图,用轻量 Mirror-Fusion Attention 在对应 token 间自适应交互,并加入反射一致性与中层对齐损失。实验在 CheXpert、BraTS、CelebA-HQ、WFLW 上相较 MoCo-v3、DINO、MAE 和若干等变 SSL 提升下游性能、校准与反射鲁棒性,额外参数约 2.7%。

Rethinking Multi-Label Image Classification With Deep Learning: Taxonomy, Challenge, and Outlook Figure 1
2026-07-02cs.CV

Rethinking Multi-Label Image Classification With Deep Learning: Taxonomy, Challenge, and Outlook

Xuelin Zhu, Xiu-Shen Wei, Jiawei Ge, Shuai Xu, Bing Wang

2026-07-02视觉感知

这篇综述针对多标签图像分类在深度学习时代文献分散、旧有综述停留在统计学习阶段的问题,系统梳理问题定义、数据集、骨干与指标,并提出按区域、标签、架构、表征、学习和数据六类组织的方法谱系。核心洞察是将MLIC中的视觉区域、标签语义与数据偏差视为相互制衡的学习博弈;主要结果是总结近十年方法演进、开放挑战及VLP/LLM背景下的未来方向,而非提出新的模型性能增益。

Pano2World: End-to-End 3D Generation via Unified Multi-View Sequences Figure 1
2026-07-02cs.CV

Pano2World: End-to-End 3D Generation via Unified Multi-View Sequences

Zhenjia Li, Jinrang Jia, Yifeng Shi

Ke Holdings Inc.

2026-07-02强化学习三维

针对单张室内全景图只能原地环视、难以支持自由走动的问题,Pano2World将场景扩展改写为多目标位姿的联合生成:先构建粗3DGS代理并渲染几何引导全景,再用带View-Aware Attention Routing的PanoDiT联合补全多视图,并通过Latent Feature Adapter直接把扩散隐特征转为3D高斯场景。实验显示其在多位置全景新视角合成中优于迭代补全和视频到3D流程,同时提升一致性与生成效率。

Stitched Embeddings: A Unified Latent Space for 3D Garments and 2D Patterns Figure 1
2026-07-02cs.CV

Stitched Embeddings: A Unified Latent Space for 3D Garments and 2D Patterns

Andrea Sanchietti, Riccardo Marin, Bharat Lal Bhatnagar, Yuanlu Xu, Gerard Pons-Moll

2026-07-02三维

服装建模既需要三维几何的拓扑灵活性,又需要二维纸样的可制造语义,但传统二者转换依赖慢且难端到端优化的物理仿真。本文提出 StEm-Net,用 BoxMesh 将纸样面片放入规范三维配置,并借助预训练 3D 基础模型学习 3D 服装与 2D 纸样共享潜空间,实现无仿真、可微的双向映射。实验在两个数据集上用于三维点云到纸样预测,相比最接近方法最高降低约 15% 误差,并支持测试时适配和纸样编辑传播到三维服装;但细节服饰、多层材料等仍受数据稀缺限制。

Training-Free Debiasing of Diffusion Models via CLIP-Guided Denoising Optimization Figure 1
2026-07-02cs.CV

Training-Free Debiasing of Diffusion Models via CLIP-Guided Denoising Optimization

Dain Kim, Jinseo Kim, Sungyong Baik

Dept. of Artificial Intelligence, Hanyang University, South Korea, Dept. of Data Science, Hanyang University, South Korea

2026-07-02生成模型优化算法

本文针对文本到图像扩散模型在中性职业提示下仍产生性别、种族刻板偏差的问题,提出无需训练的 TES:在采样过程中直接优化条件文本嵌入,先在早期去噪阶段校准全局生成方向,再用 CLIP 对中间干净图估计进行反馈细化。Stable Diffusion 实验显示,该方法较现有训练免费基线更能降低人口属性偏差,同时基本保持图像质量与语义一致性。

Towards High-Resolution Visual Perception via Hierarchical Entity Exploration Figure 1
2026-07-02cs.CV

Towards High-Resolution Visual Perception via Hierarchical Entity Exploration

Ziyu Ma, Shidong Yang, Yuxiang Ji, Yiming Hu, Tongwen Huang, Yong Wang, Jianfei Cai, Xiangxiang Chu

2026-07-02视觉感知

本文针对高分辨率图像在多模态大模型中被整体缩放后细节丢失、几何切块又会割裂目标并引入背景干扰的问题,提出训练无关、模型无关的 HEE。核心洞察是裁剪收益很大程度来自去除背景而非单纯放大目标,因此用冻结检测器按实体构建层级搜索,结合双重评分与置信度回溯。实验在 Visual Probe、HR-Bench 和 MME-RealWorld 上优于 ZoomEye、RAP,并在 Qwen2.5-VL、LLaVA-OneVision 等模型上提升准确率且降低开销。

Spotted: Location-informed Reidentification of Hyenas and Leopards in Camera Trap Surveys Figure 1
2026-07-02cs.CV

Spotted: Location-informed Reidentification of Hyenas and Leopards in Camera Trap Surveys

Halil Sina Kelebek, Julia Hindel, Kobus Hoffman, Lauren Hoffman, Andrew Loveridge, Bob Mandinyenya, Kudakwashe Ncube, Justin Seymour-Smith, Andrea Sibanda, Abhinav Valada, Matthew Wijers, Daniele De Martini

Oxford Robotics Institute, University of Oxford, Oxford, UK, Department of Computer Science, University of Freiburg, Germany, Wildlife Conservation Research Unit, Department of Biology, University of Oxford, Oxford, UK, Oxford e-Research Centre, University of Oxford, Oxford, UK

2026-07-02视觉感知

相机陷阱中的动物重识别受低画质、视角光照变化和个体样本不均衡影响,纯视觉模型难以支撑全自动生态监测。Spotted 的核心洞察是利用相机位置与时间戳构造基于最低移动速度的时空可行性先验,并将其用于伪监督适配视觉特征、融合匹配分数和主动抽样人工复核。三套鬣狗与豹数据集上,top-5 准确率较最佳基线提升 2–9 个百分点,并在等效正匹配下最多减少 69 个百分点的人工查询。

ClinRAG-GRAPH: Clinical-prior Retrieval-Augmented Graph Model with Domain Adversarial Learning for Breast pCR Prediction Figure 1
2026-07-02cs.CV

ClinRAG-GRAPH: Clinical-prior Retrieval-Augmented Graph Model with Domain Adversarial Learning for Breast pCR Prediction

Yaofei Duan, Yuhao Huang, Tianyu Zhang, Yuan Gao, Luyi Han, Xin Wang, Xinyu Xie, Xinglong Liang, Chunyao Lu, Muzhen He, Patrick Pang, Yue Sun, Ning Mao, Tao Tan, Ritse Mann

2026-07-02视觉感知

这篇论文针对乳腺癌新辅助化疗前pCR预测中多模态关系建模不足、跨中心MRI协议偏差和解释性弱的问题,提出ClinRAG-GRAPH:用临床先验构建患者内图,以关系感知GCN融合DCE-MRI、临床变量和病理标志物,并结合域对抗学习与LLM驱动的相似病例子图RAG。多中心验证显示其内部测试AUC为0.815,两个外部测试集为0.774/0.712,说明跨中心鲁棒性有所提升,但RAG与对抗分支的独立增益仍需看消融细节确认。

LeVLJEPA: End-to-End Vision-Language Pretraining Without Negatives Figure 1
2026-07-02cs.CV

LeVLJEPA: End-to-End Vision-Language Pretraining Without Negatives

Lukas Kuhn, Giuseppe Serra, Randall Balestriero, Florian Buettner

2026-07-02视觉语言视觉感知

这篇论文针对视觉语言编码器从零样本分类转向机器人、VLM 与密集预测中冻结视觉骨干的现实需求,指出传统对比学习主要优化 pooled 对齐,未必产出优质 patch 级特征。LeVLJEPA 用跨模态预测、stop-gradient 与单模态 SIGReg 替代负样本和温度项,在 CC12M/Datacomp-L 上保持线性探测接近 CLIP/SigLIP,虽大规模零样本较弱,但在语义分割及 GQA、VQAv2、POPE 冻结骨干评测中更强。

SpiralFovea: Input-Adaptive Foveated Tokenization as a Third Lever of Resource-Adaptive Inference Figure 1
2026-07-02cs.CV

SpiralFovea: Input-Adaptive Foveated Tokenization as a Third Lever of Resource-Adaptive Inference

Kyan Mahajan, Mohammad Saqlain

2026-07-02视觉感知

论文指出现有自适应推理多在网络深度或注意力上省算力,却仍先生成固定 ViT 网格 token。SpiralFovea 将输入 token 集合本身作为第三杠杆,用无参数局部熵找热点并生成多尺度螺旋式 foveated patch,在进入冻结骨干前丢弃低信息区域。四个细粒度基准上其以约60%更少输入 token 获得+1.7至+2.1个百分点精度、每层注意力 FLOPs 降84%、吞吐提升18–29%,但优势主要集中在全图位置先验较弱的自监督骨干。

Soft Mixture-of-Recursions: Going Deeper with Recursive Vision Transformers Figure 1
2026-07-02cs.CV

Soft Mixture-of-Recursions: Going Deeper with Recursive Vision Transformers

Sang In Lee, Jihun Park

Chungnam National University

2026-07-02视觉感知

这篇论文针对ViT靠堆叠独立层扩容带来的参数与计算成本,提出用递归共享模块增加有效深度,并用SoftMoR按token学习权重融合所有递归步输出,避免只取最终层或硬选择深度导致中间表征浪费。SR-ViT在分类、检测、分割上随递归深度稳定提升,ImageNet-1K中T=1到4使SR-ViT-S从79.83%升至82.48%,仅增加1.7M参数。

Decoupled Guidance: Disentangling Subject and Context Pathways in Text-to-Image Personalization Figure 1
2026-07-02cs.CV

Decoupled Guidance: Disentangling Subject and Context Pathways in Text-to-Image Personalization

Seongmin Kim, Kyucheol Shin, Heesun Jung, Jinseo Kim, Sungyong Baik

Dept. of Artificial Intelligence, Hanyang University, South Korea, Dept. of Data Science, Hanyang University, South Korea

2026-07-02视觉感知

本文针对文本到图像个性化中主体保真与场景可编辑性相互牵制的问题,指出根因是主体身份和上下文共用同一条件通路并竞争注意力资源,导致 attention collapse。作者提出 DeGu,将主体与场景拆成独立引导流,并用 CAE、DGM 与 TCAM 做空间融合;实验显示其可插入多类个性化方法和 SD/DiT 骨干,在不改模型权重的情况下提升整体表现,并支持推理时调节保真—可编辑性平衡。

GKDT: General Keypoint Detection Transformer Figure 1
2026-07-02cs.CV

GKDT: General Keypoint Detection Transformer

Changsheng Lu, Yuxin Chen, Haokun Gui, Rong Wang, Jie Yang, Harry Yang, Anton van den Hengel, Jiaya Jia

Hong Kong University of Science and Technology, Hong Kong, China

2026-07-02视觉感知

本文针对现有关键点检测模型多为封闭类别、难以迁移到机器人等开放场景的问题,构建含29个数据源、130万实例的统一数据集MegaKPT,并提出基于DINOv3的GKDT,用视觉/文本提示生成关键点卷积核进行非参数检测。22个测试集上,多数类别PCK@0.1超过90%,但效果可能主要来自大规模数据与基础模型scaling。

FrameONE: Hierarchical Motion Modeling for Universal Multi-View Echocardiographic Keyframe Detection Figure 1
2026-07-02cs.CV

FrameONE: Hierarchical Motion Modeling for Universal Multi-View Echocardiographic Keyframe Detection

Rusi Chen, Yuhao Huang, Hongyuan Zhang, Chao Tian, Shunan Ji, Yuhan Zhang, Dong Ni

2026-07-02视觉感知

这篇论文针对超声心动图ES/ED关键帧检测长期依赖单视图设计、额外标注或光流等重视觉建模的问题,提出FrameONE用分层运动建模统一处理A4C、A2C、PLAX、PSAX四种视图:视图内多任务学习抑制外观偏差,视图间模块将共享心动节律与视图特异运动解耦。在25,872段视频上的实验显示其多数指标优于既有方法,并具备较强跨视图泛化能力。

Active Learning for Cascaded Object Detection: Balancing Coverage and Uncertainty in Table Extraction Pipelines Figure 1
2026-07-02cs.CV

Active Learning for Cascaded Object Detection: Balancing Coverage and Uncertainty in Table Extraction Pipelines

Eliott Thomas, Mickael Coustaty, Aurelie Joseph, Gaspar Deloin, Vincent Poulain d'Andecy, Jean-Marc Ogier

2026-07-02视觉感知安全鲁棒

面向业务文档表格抽取中 TD→TSR 级联标注昂贵且误差会下游传播的问题,本文将平衡覆盖与不确定性的 UHerding 首次改造到双阶段检测流程,并提出 RankFusion 与 CAPA 显式利用检测、结构两类表征及阶段瓶颈信号。四个数据集、71–500 文档预算实验显示 UHerding 已优于基线;RankFusion 期望收益更高但方差较大,CAPA 在四个数据集中三个超过标准 UHerding,说明主动学习策略选择主要受流水线瓶颈位置影响。

GaussianFusion: Unified 3D Gaussian Representation for Multi-Modal Fusion Perception Figure 1
2026-07-02cs.CV

GaussianFusion: Unified 3D Gaussian Representation for Multi-Modal Fusion Perception

Xiao Zhao, Chang Liu, Mingxu Zhu, Zheyuan Zhang, Linna Song, Qingliang Luo, Chufan Guo, Kuifeng Su

Tencent, Autonomous Driving Lab

2026-07-02三维

这篇论文针对自动驾驶多模态感知中 BEV 离散网格易丢失细节、跨模态对齐和交互受限的问题,提出用连续 3D Gaussian 作为统一表征,在量化到 BEV/体素前完成相机与 LiDAR 特征融合。核心设计包括前向投影的高斯初始化、共享跨模态高斯编码器和高斯混合融合,使不确定性与边界细节可被迭代建模。nuScenes 上较 BEVFusion 提升 2.6 NDS,占用预测较 GaussFormer 提升 1.55 mIoU,并以更少高斯获得显著加速。

Foundation Model-driven Key Anatomy Frame Selection for Blind-sweep Ultrasound Fetal Birth Weight Estimation Figure 1
2026-07-02cs.CV

Foundation Model-driven Key Anatomy Frame Selection for Blind-sweep Ultrasound Fetal Birth Weight Estimation

Le Ou, Xiliang Zhu, Huanwen Liang, Wenxiong Pan, Yuhao Huang, Yuxiang Deng, Xuan Sheng, Hong Yin, Juhua Xiao, Xin Zhou, Dong Ni

2026-07-02视觉感知

本文针对临产前胎儿体重估计依赖标准切面和熟练超声操作者的问题,改用盲扫超声视频,并以胎儿视觉语言基础模型按解剖先验筛选关键帧,再用冗余感知压缩与注意力回归聚合信息。其核心价值在于把标准平面检测弱化为解剖相关帧选择,在839名患者前瞻数据上达到161.3g MAE,10%误差内占90.23%,优于Hadlock和多种对比方法。

Prototype Memory-Guided Training-Free Anomaly Classification and Localization in Prenatal Ultrasound Figure 1
2026-07-02cs.CV

Prototype Memory-Guided Training-Free Anomaly Classification and Localization in Prenatal Ultrasound

Huanwen Liang, Yuhao Huang, Xiliang Zhu, Yuanji Zhang, Xuedong Deng, Xinru Gao, Guowei Tao, Yuhan Zhang, Dong Ni

2026-07-02视觉感知

针对产前超声异常样本稀缺、类别异质且临床难以为新病种反复微调的问题,论文提出基于DINOv3视觉基础模型的免训练少样本框架,用类级与病灶级多粒度原型记忆库进行分类,并通过原型驱动软合并定位异常区域、再用类别一致性细化预测。在含1,149例、2,357张图像、9类异常的多中心数据上优于对比方法,但临床泛化验证仍文中未充分说明。

Towards Robust Driving Perception: A Flexible Scale-Driven Family for Self-Supervised Monocular Depth Estimation Figure 1
2026-07-02cs.CV

Towards Robust Driving Perception: A Flexible Scale-Driven Family for Self-Supervised Monocular Depth Estimation

Zhaowen Zhu, Li Zhang, Yujie Chen, Tian Zhang, Yingjie Wang, Mingxia Zhan

2026-07-02安全鲁棒

这篇论文针对自动驾驶中自监督单目深度估计在动态交通场景易失效、轻量模型又难保边界细节的问题,提出 FlexDepth 系列:用尺度驱动解码器按模型规模选择融合组件,并通过静态/动态两阶段解耦训练分别评估背景与运动物体置信度。实验称其在 KITTI 等驾驶基准上无需辅助信息达到同尺度 SOTA,Flex-Nano 仅 0.7 GFLOPs、移动端 37.6 FPS,但具体增益中 scaling 与训练策略的相对贡献仍需看消融。

ConRTF: Edge-Constrained Boundary Distribution Refinement for Realtime TransFormer Table Structure Recognition Figure 1
2026-07-02cs.CV

ConRTF: Edge-Constrained Boundary Distribution Refinement for Realtime TransFormer Table Structure Recognition

Eliott Thomas, Tri-Cong Pham, Mickael Coustaty, Aurelie Joseph, Gaspar Deloin, Vincent Poulain d'Andecy, Jean-Marc Ogier, Antoine Doucet

2026-07-02视觉感知学习理论

该文针对表格结构识别中行列边界微小误差会放大为单元格归属错误的问题,认为通用检测器忽略了行、列边界重要性不对称。ConRTF在D-FINE式分布边界细化上加入训练期EFL损失,强化行的水平边、列的垂直边且不增加推理开销。在PubTables-1M和两个私有集上,相比优化基线及RT-DETRv2、YOLOv10/11等实时检测器稳定提升,最高约+1.6 GriTS,并在2k–3k标注表格下仍保持较好效果。

AV-SyncBench: Decoupled Benchmarking of Temporal and Semantic Audio-Visual Synchronization Figure 1
2026-07-02cs.CV

AV-SyncBench: Decoupled Benchmarking of Temporal and Semantic Audio-Visual Synchronization

Tianhong Zhou, Mingyang Han, Boyu Li, Yuxuan Jiang, Jiaxin Ye, Dongxiao Wang, Haoxiang Shi, Kunpeng Wang, Jun Song, Cheng Yu, Bo Zheng

Tsinghua University, Beijing, China, Fudan University, Shanghai, China

2026-07-02数据集/基准

现有音视频特征评测常把语义匹配与时间同步混在一起,难以判断模型究竟擅长哪一维。AV-SyncBench用野外视频构建3269段、38390个样本,将全局偏移、局部抖动、变速等时间扰动,与音色/声源替换等保持节奏的语义扰动解耦评测。论文评测5类代表模型,显示不同模型在语义一致性和细粒度时间敏感性上存在明显取舍,具体增益来源文中未充分说明。

Partial Skeleton Visibility for Action Recognition: A Constrained Field-of-View Approach Figure 1
2026-07-02cs.CV

Partial Skeleton Visibility for Action Recognition: A Constrained Field-of-View Approach

Yingjie Dai, Tianyang Xu, Yanglin Deng, Xiao-Jun Wu, Josef Kittler

2026-07-02视觉感知

这篇论文针对机器人、穿戴和拥挤监控等场景中视野受限导致骨架关节大量缺失的问题,提出 PartialVisGraph:用可学习虚拟超边建模多关节高阶关系,并在样本自适应 Transformer 中加入可见性先验以抑制不可见关节干扰。在 NTU RGB+D 60/120 的受限 FoV 模拟评测中,方法在严重视野受限子集上较强基线最高提升 68.8%,完整视野下也保持优势。

Towards Memory-Efficient Autoregressive Video Generation via Instance-Specific Parametric Absorption Figure 1
2026-07-02cs.CV

Towards Memory-Efficient Autoregressive Video Generation via Instance-Specific Parametric Absorption

Xiaomeng Fu, Jia Li, Yiming Hu, Yong Wang, Hayden Kwok-Hay So, Jiao Dai, Xiangxiang Chu, Jizhong Han

2026-07-02视觉感知

这篇论文针对自回归长视频生成中 KV cache 随历史线性增长、导致显存与吞吐瓶颈的问题,提出 ISPA:不再简单丢弃历史 token,而是在短暂预热后将全局与局部注意力差异通过闭式最小二乘吸收到实例特定的权重调制中,使部分层转为局部注意力。实验覆盖 1.3B 到 14B 模型,最多移除 50% KV cache,视觉质量近乎无损,并结合 W8A8 量化达到 1.86× 推理加速。

Creating Impactful Autonomous Driving Datasets: A Strategic Guide from Research Gap to Benchmark Figure 1
2026-07-02cs.CV

Creating Impactful Autonomous Driving Datasets: A Strategic Guide from Research Gap to Benchmark

Richard Schwarzkopf, Jonas Merkert, Frank Bieder, Annika Bätz, Alexander Blumberg, Carlos Fernandez, Felix Hauser, Fabian Immel, Christian Kinzig, Hendrik Königshof, Fabian Konstantinidis, Martin Lauer, Willi Poh, Nils Rack, Kevin Rösch, Yinzhe Shen, Marlon Steiner, Gleb Stepanov, Dominik Strutz, Ömer Şahin Taş, Julian Truetsch, Kaiwen Wang, Royden Wagner, Jan-Hendrik Pauls, Christoph Stiller

2026-07-02数据集/基准

这篇论文针对自动驾驶数据集建设常停留在“收了什么”而缺少“为何这样设计”的问题,提出先诊断研究受限于训练数据还是评测能力,再选择能闭合缺口的最低成本数据操作,将重新标注、合并、合成置于新采集之前。作者用既有数据集演化和 KITScenes 案例说明该框架可指导传感器、标注与规模取舍,主要结果是形成一套面向中小团队的基准设计策略,而非报告新模型性能提升。

Imprint: Online Memory Compression for Long-Horizon Egocentric QA Figure 1
2026-07-02cs.CV

Imprint: Online Memory Compression for Long-Horizon Egocentric QA

Kousik Das, Debaditya Roy

2026-07-02视觉感知

针对长时程第一视角问答中,层级文本摘要会抹平重复交互、难以跨天聚合证据的问题,Imprint 将记忆建模为在线压缩而非事后总结:把观察解析为人-动作-物体-时间的交互记录,并按复现、近因和独特性选择性巩固为可检索记忆。在 EgoLifeQA 七天场景中,相同 LLM 下准确率由 31.0% 提升到 35.8%,证据扎实回答增加 6 倍,同时内存降 2.3 倍、检索延迟降 11.8 倍。

LUMA: Benchmarking Segmentation via a Lightweight Universal Mask Adapter Figure 1
2026-07-02cs.CV

LUMA: Benchmarking Segmentation via a Lightweight Universal Mask Adapter

Tobias Christian Nauen, Anosh Billimoria, Federico Raue, Stanislav Frolov, Brian B. Moser, Andreas Dengel

RPTU University Kaiserslautern-Landau, Kaiserslautern, Germany, German Research Center for Artificial Intelligence (DFKI), Kaiserslautern, Germany

2026-07-02视觉感知数据集/基准

这篇论文针对分割骨干比较常被解码器、训练配方和预训练差异混淆的问题,提出轻量通用掩码适配器 LUMA,用外部低成本交叉注意力让查询读取任意骨干特征,从而固定同一分割头公平评测。结果显示 LUMA 以更低或相近成本匹配 EoMT,并在 20 个骨干、11 种预训练上发现所谓高效 token mixer 并未带来吞吐优势,普通 ViT 仍在 Pareto 前沿,分割质量更多由预训练目标和规模决定。

ABot-M0.5: Unified Mobility-and-Manipulation World Action Model Figure 1
2026-07-02cs.CV

ABot-M0.5: Unified Mobility-and-Manipulation World Action Model

Ronghan Chen, Yandan Yang, Zuojin Tang, Dongjie Huo, Tong Lin, Haoning Wu, Haoyun Liu, Yuzhi Chen, Lulu Zheng, Botai Yuan, Tianlun Li, Mingxin Wang, Dekang Qi, Bin Hu, Wei Mei, Yuze Xuan, Haolong Yang, Yanqing Zhu, Mu Xu, Zhiheng Ma, Xinyuan Chang

AMAP CV Lab

2026-07-02机器人强化学习

ABot-M0.5针对移动操作中视频世界模型粒度粗、导航与机械臂动作耦合、训练条件与自回归部署不一致的问题,提出视频→潜在动作→控制的中间表示、双层Mixture-of-Transformers解耦不同动作子空间,并用Dream Forcing让逆动力学在自生成视频上训练。实验显示其在长时程移动操作成功率和细粒度控制精度上优于已有方法,但具体增益仍需结合消融判断。

DART: Difficulty-Adaptive Routing for Zero-Shot Video Temporal Grounding Figure 1
2026-07-02cs.CV

DART: Difficulty-Adaptive Routing for Zero-Shot Video Temporal Grounding

Zhengbo Zhang, Mark He Huang, Zhigang Tu, Ming-Hsuan Yang

2026-07-02视觉语言视觉感知

零样本视频时序定位中,逐帧图文匹配难处理包含先后顺序、因果关系的复杂事件。DART的核心洞察是用查询条件DPP同时选取相关且多样的关键帧,并以谱熵估计难度:简单查询走快速直接预测,复杂查询走带事件分析、帧角色标注和边界抽取的结构化推理。在Charades-STA与ActivityNet Captions的IID和多种OOD设置下,DART达到零样本SOTA,mIoU最高提升约3.5点且用帧数少7倍以上。

Domain Arithmetic: One-Shot VLA Adaptation under Environmental Shifts Figure 1
2026-07-02cs.RO

Domain Arithmetic: One-Shot VLA Adaptation under Environmental Shifts

Taewook Kang, Taeheon Kim, Donghyun Shin, Jonghyun Choi

2026-07-02视觉感知

论文关注VLA模型在相机位姿、传感器标定或机器人本体变化后性能骤降且目标域示教昂贵的问题。核心洞察是一次微调产生的权重更新中,任务方向与域方向近似可加分解;DART通过源/目标一次示教更新向量做类比式权重运算,并用子空间过滤与缩放抑制噪声,提取可迁移的域向量。实验显示其在仿真和真实场景、视觉与本体迁移的一次适配中优于既有方法,但具体增益对scaling的依赖仍需更多消融支撑。

Linguistic Relative Policy Optimization for Video Anomaly Reasoning Figure 1
2026-07-02cs.CV

Linguistic Relative Policy Optimization for Video Anomaly Reasoning

Jiaxu Leng, Jiankang Zheng, Mengjingcheng Mo, Zhanjie Wu, Haosheng Chen, Ji Gan, Xinbo Gao

2026-07-02视觉感知强化学习优化算法

本文针对视频异常检测中指令微调依赖大量细粒度标注、免训练方法又依赖专家规则的问题,提出 LRPO:不更新模型参数,而从多条推理轨迹的相对奖励中提炼可语言化的异常经验,并结合通用经验与场景经验注入上下文,引导模型按人类风险偏好和时间证据推理。在 XD-Violence、UCF-Crime、UBnormal 上,该方法在 tuning-free 设置下超过现有方法。

Not All Prediction Targets Keep Training-Free Diffusion Guidance on the Manifold Figure 1
2026-07-02cs.CV

Not All Prediction Targets Keep Training-Free Diffusion Guidance on the Manifold

Yunsung Lee, Hyeongmin Lee

2026-07-02生成模型

本文关注免训练扩散引导在强引导下易偏离数据流形的问题,指出关键不只在引导算法,而在扩散模型的预测目标:ε/v 预测需从噪声态反推干净图像并放大误差,x 预测则直接给出干净图像。作者用误差放大理论、Child FID 与细粒度鸟类基准验证该层级,结果显示 x 预测在同等分类有效性下 C-FID 更好,并能显著减少崩坏和模式集中。

Uncertainty-aware tree height change regression Figure 1
2026-07-02cs.CV

Uncertainty-aware tree height change regression

Max Gaber, Dimitri Gominski, Jaime C. Revenga, Stefan Oehmcke, Rasmus Fensholt, Martin Brandt

2026-07-02安全鲁棒

论文针对森林冠层高度变化常被简化为二分类、且忽略标注不确定性的问题,提出 CHC 数据集与“不确定性感知变化回归”任务:用西班牙 2018/2023 年机载 LiDAR 构建 3 m 连续高度增减标签和像素级不确定性,并配对 6 年 PlanetScope 时序影像。实验用于评测地理基础模型,表明该基准能暴露连续树高变化估计中的时序推理、跨传感器迁移和噪声标签鲁棒性挑战;具体性能增益和最优模型结论在给定文本中未充分说明。

Learning to Watch: Active Video Anomaly Understanding via Interleaved Policy Optimization Figure 1
2026-07-02cs.CV

Learning to Watch: Active Video Anomaly Understanding via Interleaved Policy Optimization

Mengjingcheng Mo, Jiaxu Leng, Xinbo Gao

2026-07-02视觉感知强化学习优化算法

针对视频异常理解中异常线索稀疏、固定采样易漏证据且弱监督难以学习取证策略的问题,论文将任务改写为闭环序列决策,提出 Anom-π 交替执行思考、回溯/扩展/细采样和终止,并用 AEI 引导的 iDPO 做轨迹级偏好优化。实验称 2B 模型在多数据集复杂场景中优于更大规模 VAU 方法,但具体增益与数据、工具设计的关系仍需细看。

Identifying Latent Concepts and Structures for Generalized Category Discovery Figure 1
2026-07-02cs.CV

Identifying Latent Concepts and Structures for Generalized Category Discovery

Boyang Dai, Chaoqi Chen, Yizhou Yu

2026-07-02视觉感知

论文针对广义类别发现中过度依赖聚类头、而忽视视觉骨干输出高秩且纠缠的 token 表征这一瓶颈,提出可插入骨干与发现头之间的 CPF-GCD,用有限可学习视觉原语及其空间分配场重写 patch token,使已知与未知类别都表现为共享原语的组合模式。实验显示该模块在多类 GCD 基线和数据集上稳定提升已知/新类识别、类别数估计且计算开销较小。

Diffusion-Based Multi-Class Normality for OOD Detection: An Application to CDP Authentication Figure 1
2026-07-02cs.CV

Diffusion-Based Multi-Class Normality for OOD Detection: An Application to CDP Authentication

Bolutife Atoki (imagine, LIRIS), Iuliia Tkachenko (imagine, Bertrand Kerautret (imagine, Carlos Crispim-Junior (imagine

critical scalability limitation, as each requires training separate models per printer type, making them impractical for production, may be unavailable and cannot anticipate evolving attacks. These limitations motivate reconceptualizing CDP authentication, for multi-class evaluation. Our implementation and models are available at our public repository 2, Repository URL is available at https://gitlab.liris.cnrs.fr/anr-trustit/cdp-multiclass-normality.git

2026-07-02视觉感知生成模型

针对多打印设备场景下 CDP 真伪样本外观极其相似、传统相似度或单类生成模型难以扩展的问题,论文将认证重构为多类正常性 OOD 检测:仅用真实样本训练一个类条件 ControlNet,并用双模板遮蔽只评估被隐藏像素的重建误差,以弱化二值结构捷径、突出 P&D 签名差异。在 Indigo 1×1 Base 上,该方法优于传统和改造的生成式基线,且不依赖伪造样本训练或阈值校准。

Retrieved Images as Visual Thought: Training-Free Multimodal In-Context Learning for the Open-vs-Closed Gap Figure 1
2026-07-02cs.CV

Retrieved Images as Visual Thought: Training-Free Multimodal In-Context Learning for the Open-vs-Closed Gap

Bingchen Huang, Zhiling Wang, Yifu Chen, Yuanchao Du

2026-07-02视觉语言视觉感知

论文针对“用图像思考”方法依赖工具、代码生成或训练成本高的问题,提出免训练的 ReVisIT:把检索到的带标签示例图像作为视觉思维单元,以多轮上下文注入并结合结构化定义做预测。结果显示,Qwen3-VL-30B 在 VL-ICL 4-shot 达 98.5%,接近 72B SOTA;在 Bongard 与 MAAC-Bench 也有明显增益,消融表明主要收益来自高质量检索与多轮示例格式。

Semantic-Guided Reading Order Reconstruction in Historical Armenian Newspapers with LLMs Figure 1
2026-07-02cs.CV

Semantic-Guided Reading Order Reconstruction in Historical Armenian Newspapers with LLMs

Chahan Vidal-Gorène (CJM, LIPN), Nadi Tomeh (LIPN), Victoria Khurshudyan (Inalco, SeDyL)

Laboratoire d’Informatique Paris Nord

2026-07-02三维

针对历史亚美尼亚报纸多栏、跨页续文和低资源语言导致的阅读顺序重建困难,论文构建66页标注数据集,并将语义区域检测与生成式LLM结合,用作人工标注加速而非生产流水线。实验显示该混合方法在单页与跨页任务中误差最低,相比最强几何基线Kendall τ最多降低76%,且在预测框和噪声OCR下仍较稳健。

GADA: Geometry-Aware Deformable Aggregation for Image-Based Gaussian Splatting Figure 1
2026-07-02cs.CV

GADA: Geometry-Aware Deformable Aggregation for Image-Based Gaussian Splatting

Siwoo Lim, Sunjae Yoon, Gwanhyeong Koo, Chang D. Yoo

2026-07-02视觉感知三维

这篇论文针对基于图像变形的 3D Gaussian Splatting 受几何不确定性影响、在细结构和高频区域产生像素错位与模糊的问题,提出 GADA:将被可见性阈值丢弃的像素视为局部位移的有效线索,通过可学习的几何感知 deformable offset 迭代对齐,并用置信度加权融合多视角证据。实验显示其能保留更多有效像素、恢复更锐利细节,并相比既有变形式 GS 方法取得更好质量和 2.13 倍 FPS。

Active Spatial Guidance: Eliminating Injected Positional Mechanisms in Vision Transformers Figure 1
2026-07-02cs.CV

Active Spatial Guidance: Eliminating Injected Positional Mechanisms in Vision Transformers

Cong Liu, Xiaofang Li, Simon X. Yang

2026-07-02视觉感知

论文针对ViT依赖显式位置编码而在分辨率迁移和密集预测中受限的问题,提出Active Spatial Guidance:训练时去掉位置注入,仅用辅助头让最终patch token回归二维坐标,推理时移除该头。实验显示其在ImageNet-100、ADE20K和Hypersim上优于无位置编码基线,并可超过AbsPE、RoPE等强基线,同时提升分辨率鲁棒性。

EPO: Boosting 3D Foundation Models with Edge-based Pose Optimization Figure 1
2026-07-02cs.CV

EPO: Boosting 3D Foundation Models with Edge-based Pose Optimization

Mattia D'Urso, Christian Sormann, Mattia Rossi, Friedrich Fraundorfer

Graz University of Technology

2026-07-02优化算法三维

这篇论文针对3D基础模型虽能快速生成SfM重建、但几何精度弱于传统BA且后处理需重建特征轨迹的问题,提出EPO:用2D边缘图与距离变换构造可微重投影损失,直接优化相机位姿和半稠密深度,绕开显式匹配与track。实验覆盖TerraSky3D、ScanNet++、Mip-NeRF 360等,显示其精度可持平或超过BA式细化,同时显著降低时间和显存,因而可在消费级硬件运行。

Caption Bottleneck Models Figure 1
2026-07-02cs.CV

Caption Bottleneck Models

Seref Baris Cagliyan, Umut Ozdemir, Merve Tapli, Emre Akbas

2026-07-02视觉语言

这篇论文针对概念瓶颈模型中概念集难以预先定义、且软瓶颈易发生信息泄漏的问题,提出用冻结多模态大模型生成多样化图像描述,再仅基于文本训练分类器的 Caption Bottleneck。其关键洞察是把瓶颈从固定概念向量换成自然语言,并通过类别词审查和后验文本分析自动抽取数据相关概念。实验称在细粒度与粗粒度识别上保持有竞争力的准确率,同时提升解释的可控性与无预定义概念依赖。

BrainFIBRE: A Foundation Model via Information Decomposition for Brain Microstructure Figure 1
2026-07-02cs.CV

BrainFIBRE: A Foundation Model via Information Decomposition for Brain Microstructure

Zijian Dong, Yi Lin, Ji Fang, Jianxiong Zhou, Kwun Kei Ng, Juan Helen Zhou

2026-07-02视觉感知

针对NODDI脑微结构三类图谱在融合时易混淆各自生物物理含义的问题,BrainFIBRE在5.6万名UK Biobank样本上预训练,并用自监督部分信息分解与反事实模态丢弃/交换,让MoE区分独有、冗余和协同信息。实验显示其在脑龄、性别、脑血管/神经退行性标志物和认知预测上优于对比方法,并给出可解释的微结构交互模式。

EgoGapBench: Benchmarking Egocentric Action Selection in Multi-Agent Scenes Figure 1
2026-07-02cs.CV

EgoGapBench: Benchmarking Egocentric Action Selection in Multi-Agent Scenes

Jihyeok Jung (1), Jeewu Lee (2), Sanghyeop Kim (2), Chanhee Han (3), Seong Joon Oh (1) ((1) KAIST AI, (2) Sogang University, (3) Ministry of Science and ICT)

Sogang University

2026-07-02数据集/基准

这篇论文针对现有第一视角基准常依赖可见身体线索、难以单独评估自我中心视角理解的问题,提出 EgoGapBench,将“自我中心动作选择”从第一视角图像理解中分离出来,在无身体线索的多智能体场景中用不可复制的他人动作作为干扰项。实验显示,人类表现稳定,而开源和闭源 MLLM 明显落后,且常复制可见他人的动作;常规自我中心数据微调不能弥合差距,专门数据微调虽有提升但仍未达人体水平。

ECoSim: Data Efficient Fine-Tuning for Controllable Traffic Simulation Figure 1
2026-07-02cs.CV

ECoSim: Data Efficient Fine-Tuning for Controllable Traffic Simulation

Yu-Hsiang Chen, Wei-Jer Chang, Yi-Ting Chen, Masayoshi Tomizuka

2026-07-02规划控制

面向自动驾驶测试中对可控、反事实交通场景的需求,ECoSim关注现有方法依赖大规模配对标注和重复训练的问题。其核心是在冻结扩散或自回归交通生成模型的基础上,用身份初始化的 FiLM 轻量适配器注入轨迹草图、行为潜变量和文本控制,并通过上下文感知条件迁移生成长尾场景。在 WOSAC 闭环评测中,方法用不足 1% 配对数据将控制误差最高降低 83%,Meta 分数提升约 0.02–0.03,同时保持较好的真实感与安全性。

GEAR-Seg: A Grounded Explainable Agent for Reasoning Segmentation and Data Engine Figure 1
2026-07-02cs.CV

GEAR-Seg: A Grounded Explainable Agent for Reasoning Segmentation and Data Engine

Yanan Wang, Wen Li, Yibin Ying, Zhenghao Fei

2026-07-02视觉感知

本文针对推理分割中视觉感知与语言推理被端到端黑箱耦合、难解释且依赖人工标注的问题,提出 GEAR-Seg:先用 SAM 2 生成区域,再由 DAM 将每个 mask 转成属性化文本,最后交给 LLM 做显式逻辑推断。该框架在零样本推理/指代表达分割上表现有竞争力,并作为数据引擎生成 GEAR-131K;蒸馏实验显示,仅用自动数据训练的学生模型可接近人工标注上界,但部分增益可能主要来自 scaling / data。

Flow-Map GRPO: Reinforcement Learning for Few-Step Flow-Map Generators via Anchored Stochastic Composition Figure 1
2026-07-02cs.LG

Flow-Map GRPO: Reinforcement Learning for Few-Step Flow-Map Generators via Anchored Stochastic Composition

Zhiqi Li, Wen Zhang, Bo Zhu

2026-07-02生成模型强化学习

本文针对少步 flow-map 生成器(如 MeanFlow、sCM)虽推理快但确定性强、难以用需随机轨迹和似然比的 RL 后训练对齐的问题,提出 Flow-Map GRPO。核心是 ASFMC:用锚点条件重采样在长程 flow map 层面引入随机性,同时保持原概率路径,并推导单时刻/双时刻形式的 GRPO 目标。实验在少步 FLUX 文生图模型上显示,相比预训练检查点在奖励、感知和任务指标上均有提升。

NoPA: Non-Parametric Online 3D Scene Graph Generation Figure 1
2026-07-02cs.CV

NoPA: Non-Parametric Online 3D Scene Graph Generation

Qi Xun Yeo, Seungjun Lee, Yan Li, Gim Hee Lee

2026-07-02三维

NoPA面向流式RGB-D下的在线3D场景图生成,动机是避免SLAM/点云重建开销,同时修正FROSS用单高斯表示物体导致几何细节丢失、跨视角合并不稳的问题。其核心是用固定粒子集刻画非参数物体分布,并以KDE上的MMD做候选合并,再按高亲和对象传播关系以补边。实验称在多个在线3D SSG基准上优于现有方法,且基本保持实时推理速度。

SPECSIA: Stylization Dataset for Novel-View Enhancement in Drawing-based 3D Animation Figure 1
2026-07-02cs.CV

SPECSIA: Stylization Dataset for Novel-View Enhancement in Drawing-based 3D Animation

Kyuwon Kim, Sunjae Yoon, Chang D. Yoo

2026-07-02数据集/基准三维

这篇论文针对单张手绘角色经3D重建与投影生成动画时,在新视角下容易出现轮廓缺失、斑点和时序不稳的问题,指出逐样本2D对齐会过拟合正面输入视角。核心贡献是构建SPECSIA-15K成对风格化数据集,并训练轻量级DraViE后处理模块,用数据级先验修复投影伪影。实验显示其在新视角保真度和时间一致性上优于DSU、OSF等基线,且单角色适配成本更低。

Restore3D: Breathing Life into Broken Objects with Shape and Texture Restoration Figure 1
2026-07-02cs.CV

Restore3D: Breathing Life into Broken Objects with Shape and Texture Restoration

Xiaolong Shen, Zongxin Yang, Yi Yang

2026-07-02三维

本文针对破损三维物体修复中只补几何、忽略纹理且容易改动完好区域的问题,提出 Restore3D:用自动合成的破损-完整配对数据训练多视图修复框架,并通过 Mask Self-Perceiver 与深度感知掩码校正自动定位应补区域,再结合图像增强和粗到细重建恢复带纹理网格。实验在合成与真实破损物体上显示,其多视图修复一致性和纹理网格质量优于多类修补、补全和重建基线。

Cross4D-JEPA: Dense Cross-modal Correspondence Distillation for 4D Point Cloud Representation Learning Figure 1
2026-07-02cs.CV

Cross4D-JEPA: Dense Cross-modal Correspondence Distillation for 4D Point Cloud Representation Learning

Trung Thanh Nguyen, Hai Nguyen-Truong, Tu Vo, Hoang M. Truong, Tuan-Anh Vu

Nagoya University, Japan, Northeastern University, USA, KC Machine Learning Lab, Korea, University of Science, Vietnam National University Ho Chi Minh City, Vietnam, University of California, Los Angeles, USA

2026-07-02三维

面向机器人与具身感知中的动态4D点云,论文关注密集标注昂贵且现有自监督多局限于点云内部、跨模态方法又只用全局视频嵌入的问题。Cross4D-JEPA通过渲染建立遮挡感知的2D补丁到3D点的密集对应,将冻结DINOv2或V-JEPA2的特征逐点蒸馏到4D点编码器,无需掩码、负样本或解码器。四个基准上其优于内模态和全局跨模态基线,并提升迁移与标签效率;分析认为主要增益来自逐点对应粒度,而非教师模态。

AnF-DiffPET: Anatomy- and Frequency-Guided Diffusion for PET/CT Denoising Figure 1
2026-07-02cs.CV

AnF-DiffPET: Anatomy- and Frequency-Guided Diffusion for PET/CT Denoising

Xuepeng Liu, Ruili Li, Zetong Liu, Renyiming Li, Yan Li, Yin Dai, Chao Li, Yueyang Teng

2026-07-02生成模型

针对低剂量或短采集 PET 噪声强、摄取量化不稳定的问题,AnF-DiffPET 将配准 CT 解剖先验和频域约束引入扩散去噪,通过 AFG、MSCTR 与 FCHM 减少结构漂移和噪声频率传播。四个 PET/CT 数据集上相较 CNN、GAN、Transformer 和扩散基线提升图像保真、解剖一致性与定量保真,但代码与模型尚待接收后发布。

Closed-loop coupling of personalised and foundation models for real-time treatment guidance with MRI Figure 1
2026-07-02cs.CV

Closed-loop coupling of personalised and foundation models for real-time treatment guidance with MRI

James Grover, Emily A. Hewson, Andrew Phair, Michael Ferraro, Hilary L. Byrne, Paul Keall, Michael G. Jameson, David E.J. Waddington

Image X Institute, Sydney School of Health Sciences, Faculty of Medicine and Health, The University, School of Clinical Medicine, Medicine & Health, University of New South Wales, Sydney, Australia, Centre for Medical Radiation Physics, School of Mathematics and Physics, University of Wollongong, centres

2026-07-02视觉感知

本文针对 MRI 引导治疗中 300–400 ms 成像延迟导致的解剖位置错配问题,提出将患者个体化时序预测模型与基础分割模型闭环耦合:CAFOP 预测未来多平面 MRI,MedSAM2 实时分割反馈并在线更新预测器。数字体模和临床 MRI-linac 数据显示,400 ms 预测下该方法优于 ConvLSTM、SwinLSTM、SimVP,并降低病灶跟踪误差与剂量学 gamma 失败率。

Prior-Anchored Debiasing for Long-Tailed Multi-Organ Pathology Report Generation Figure 1
2026-07-02cs.CV

Prior-Anchored Debiasing for Long-Tailed Multi-Organ Pathology Report Generation

Feng Yang, Jie Liu, Yubo Pang, Peilin Chen, Xinheng Lyu, Shiqi Wang, Howard Leung, Ping Chen

2026-07-02生成模型

本文关注多器官病理报告生成中器官类别长尾导致的头部器官偏置:视觉编码器忽视尾部器官判别线索,文本解码器套用头部器官叙述。作者提出 PriOrGen,以视觉原型锚定瓶颈筛选诊断相关 WSI patch,并用器官级元报告库提供文本先验。ML-Path 实验显示整体及头、中、尾类均优于基线,尾类提升最明显,消融支持两模块分别缓解视觉与解码偏置。

Robust 3D Alignment of Generative Reconstructions via Partial Monocular Observations Figure 1
2026-07-02cs.CV

Robust 3D Alignment of Generative Reconstructions via Partial Monocular Observations

Yuchen Zhang, Luanyuan Dai, Yiwei Wang, Xiwei Xu, Jianing Zhang, Johnny.r.zhang, Xianhui Meng, Yanbiao Ma, Jiayi Ma, Xiaoshuai Hao

2026-07-02生成模型三维安全鲁棒

面向机器人操作中单目观测稀疏、噪声大,而生成式三维重建缺少真实尺度并可能产生幻觉几何的问题,论文提出免训练的 Sim(3) 对齐框架,显式估计尺度与位姿,结合几何感知描述子粗到细初始化、闭式细化和幻觉过滤。作者还构建 GenPMOAlign–Where2Place 基准,实验显示其在极端部分观测下较传统配准和学习式方法更稳定准确。

HieDG: A Hierarchical Discrete Geometry-Guided Framework for Multi-Animal Tracking Figure 1
2026-07-02cs.CV

HieDG: A Hierarchical Discrete Geometry-Guided Framework for Multi-Animal Tracking

Chenxun Deng, Zhongde Zhang, Ye Yuan, Chengyang Zhang, Yifan Zhang, Bohao Chen, Hongying Yan, Hang Zhou, Hua Han, Xi Chen

2026-07-02视觉感知

针对多动物跟踪中同类外观相近、密集遮挡和运动不规则导致身份关联不稳的问题,HieDG的核心洞察是连续几何特征在注意力中会放大微小扰动,因此用两级残差码本将位置、尺度、速度离散化为稳定几何 token,并融入查询式跟踪器。实验在 AnimalTrack、BFT、BuckTales 上提升 HOTA、AssA、IDF1,在 DanceTrack、SportsMOT 上也具备一定泛化性。

GenSP: Consistent Spherical Parameterization via Learning Shape Generative Models Figure 1
2026-07-02cs.CV

GenSP: Consistent Spherical Parameterization via Learning Shape Generative Models

Sai Karthikey Pentapati, Shashank Gupta, Rajesh Sureddi, Yuezhi Yang, Alan C. Bovik, Qixing Huang

2026-07-02生成模型

针对逐个形状做球面参数化会在相似 genus-0 形状间产生不一致映射的问题,GenSP 将参数化转化为学习从单位球到形状集合的连续生成变形,并用中间形状扩充、潜空间生成树传播对应关系和变形正则来初始化与约束模型。在 ShapeNet 实验中,相比现有球面参数化方法同时降低几何畸变并提升跨形状一致性。

MindEdit-Bench: Benchmarking Object-Level Counterfactual Spatial Reasoning in VLMs from In-the-Wild Photos Figure 1
2026-07-02cs.CV

MindEdit-Bench: Benchmarking Object-Level Counterfactual Spatial Reasoning in VLMs from In-the-Wild Photos

Leyuan Yu, Xiao Tang, Minghao Liu, Xinyuan Li, Xiaokai Bai, Sheng Zhou, Qunshu Lin, Weihao Xuan, Naoto Yokoya

Zhejiang University, Tongji University, The University of Tokyo

2026-07-02视觉语言数据集/基准

这篇论文针对现有VLM空间推理基准多停留在“看见什么说什么”、缺少物体级反事实操作评测的问题,提出MindEdit-Bench:用三张野外手机室内照片重建物体中心3D场景图,并设计包含空间编辑与跨视角可见性编辑的六类任务。结果显示15个VLM在1003道人审题上仅8%–31%,显著低于人类81%–97%,暴露其难以稳定维护和操纵3D场景表征。

PAPA: Online Personalized Active Preference Alignment Figure 1
2026-07-02cs.LG

PAPA: Online Personalized Active Preference Alignment

Anindya Sarkar, Nasik Muhammad Nafi, Isaac Lyngaas, Muralikrishnan Gopalakrishnan Meena, Yevgeniy Vorobeychik

Washington University in St. Louis, Oak Ridge National Laboratory

2026-07-02视觉感知

PAPA关注个性化推荐、图像生成等场景中用户偏好稀缺且需在线获取的问题,目标是在不训练独立奖励模型的情况下对扩散模型做偏好对齐。其核心是用实时反馈直接优化生成分布,并以变分推断视角设计反馈高效的探索—利用机制;进一步提出EPAPA,通过低噪声阶段复用预训练模型、剪枝式微调降低计算。实验显示其在类别条件和细粒度偏好任务上比既有方法更快适配,并能较好保持样本质量与多样性。

Predicting Lethal Outcome (Cause) And Understanding Key Biomarkers Linked With Acute Myocardial Infarction Using Deep Artificial Neural Network And Ensemble Of Machine Learning Methodologies Figure 1
2026-07-02eess.IV

Predicting Lethal Outcome (Cause) And Understanding Key Biomarkers Linked With Acute Myocardial Infarction Using Deep Artificial Neural Network And Ensemble Of Machine Learning Methodologies

Sagnik Ghosh

2026-07-02视觉感知

针对急性心肌梗死致死风险早期识别依赖医生经验、耗时且一致性不足的问题,本文构建了包含缺失值填补、类别不平衡处理、特征选择、集成学习与 ANN 的自动化预测流程,并试图从筛选特征中解释关键生物标志物。主要结果是用精确率、召回率等指标比较多类模型以支持临床筛选,但具体性能数值和相对增益在给定文本中未充分说明,增益来源可能主要来自 scaling / data。

StochasT: Learning with Stochastic Turn Depth for Visual Instruction Tuning Figure 1
2026-07-02cs.CV

StochasT: Learning with Stochastic Turn Depth for Visual Instruction Tuning

Yuan Qing, Chengzhi Mao, Boqing Gong

2026-07-02视觉感知

本文针对视觉指令微调常用多轮训练、而基准多为单轮评测的不匹配,指出模型会出现视觉注意衰减和上下文过拟合。StochasT 随机改变同图问答的轮深组合,在不丢数据、几乎不增算力的情况下扩展上下文分布,并用 Balanced Latin Square 评估上下文鲁棒性。实验在 LLaVA 与 Qwen2.5-VL 上显示,其单轮和多轮表现均优于标准 multiT,平均带来约 3%–9% 增益。

Multimodal Continuous Reasoning via Asymmetric Mutual Variational Learning Figure 1
2026-07-02cs.CV

Multimodal Continuous Reasoning via Asymmetric Mutual Variational Learning

Shijie Li, Yilin Gao, Siyuan Yang, Tieyuan Chen, Chaofan Gan, Zhihao He, Zicheng Zhao, Yuyu Guo, Weiyao Lin, Hang Yu

Shanghai Jiao Tong University

2026-07-02视觉语言

这篇论文针对多模态大模型在复杂视觉推理中被离散语言链路限制、以及连续潜变量训练时后验可偷看答案导致训练—推理不匹配的问题,提出 AMVL:用前向 KL 让先验学习后验推理状态,同时用反向 KL 约束后验远离推理不可用区域。实验称其在 BLINK 等复杂多模态基准上优于离散和潜变量推理基线,平均提升 +10.83,单项最高 +32.00。

VideoSearch-R1: Iterative Video Retrieval and Reasoning via Soft Query Refinement Figure 1
2026-07-02cs.CV

VideoSearch-R1: Iterative Video Retrieval and Reasoning via Soft Query Refinement

Seohyun Lee, Seoung Choi, Dohwan Ko, Jongha Kim, Hyunwoo J. Kim

2026-07-02视觉感知

这篇论文针对大规模视频库中“先检索、再理解”的割裂流程:一旦首轮检索失败,后续时间定位也会失效。VideoSearch-R1把视频搜索引擎纳入多轮智能体循环,并用连续潜空间的软查询细化替代文本改写,通过GRPO以检索和下游任务奖励联合训练。在ActivityNet-FIG、Charades-FIG、DiDeMo-FIG的VCMR任务上提升视频检索与时刻定位表现,并显示软查询比显式改写更省生成token。

Information-Regularized Attention for Visual-Centric Reasoning Figure 1
2026-07-02cs.CV

Information-Regularized Attention for Visual-Centric Reasoning

Guohao Sun, Xiaofang Wang, Yash Patel, Mengchen Liu, Zhiqiang Tao, Praveen Krishnan

2026-07-02视觉感知

该文针对视觉语言模型在指令微调后仍易物体幻觉、视觉 grounding 弱和遗忘的问题,认为根因是视觉表征只被 next-token 目标被动优化。作者提出 Information-Regularized Attention,在中间层以随机、信息瓶颈式噪声调控注入的视觉信息,而非只改注意力权重。实验显示 IRA 可改善下游表现、降低 attention sink,并使层间表征曲率更平滑;但验证规模仅到 8B,更大模型结论文中未充分说明。

HyFL-CLIP: Hyperbolic Fine-Tuning of CLIP for Robust Long-Context Understanding Figure 1
2026-07-02cs.CV

HyFL-CLIP: Hyperbolic Fine-Tuning of CLIP for Robust Long-Context Understanding

Ji Ha Jang, Hayeon Kim, Chulwon Lee, Junghun James Kim, Se Young Chun

Seoul National University, Republic of Korea

2026-07-02安全鲁棒

针对 CLIP 在超过 77 token 的长文本中对句序变化、删词和摘要扰动过于敏感的问题,HyFL-CLIP 将预训练 CLIP 的欧氏图文对齐蒸馏到双曲空间,用跨流形相似度蒸馏、测地对比学习和双曲蕴含损失显式建模长描述与短语成分、图像之间的层级/部分-整体关系。实验显示其在长上下文跨模态检索、扰动鲁棒性、模态内检索和短文本检索上优于已有长文本 CLIP 方法,扰动场景最高提升 19.5%,并可接入 SDXL。

EO-VGGT: Orbital Ray-Conditioned 3D Foundation Models for Satellite Multi-View Reconstruction Figure 1
2026-07-02cs.CV

EO-VGGT: Orbital Ray-Conditioned 3D Foundation Models for Satellite Multi-View Reconstruction

Qiyan Luo, Yingdong Pi, Lekang Wen, Jie Yang, Xiaoyu Wang, Haiming Zhang, Mi Wang

2026-07-02三维

这篇论文针对卫星多视角重建中透视相机先验与轨道推扫成像几何不匹配、且多时相视图质量差异大的问题,提出 EO-VGGT:先用几何-辐射一致性筛选视图,再把 RFM/RPC 推导的像素级传感器射线编码为几何 token,并通过轻量适配器注入冻结 VGGT。US3D 实验显示其在保持稠密覆盖的同时,相比最强替代方法 MAE 降低 18.0%、P95 绝对残差降低 18.6%,说明显式轨道几何条件化是关键增益来源。

DroneIQA-VLE: Multi-Task Drone Image Quality Assessment via Vision-Language Ensemble Figure 1
2026-07-02cs.CV

DroneIQA-VLE: Multi-Task Drone Image Quality Assessment via Vision-Language Ensemble

Wei Sun, Weixia Zhang, Hongjian Zhan, Mingkai Lu, Yixuan Gao, Guangtao Zhai

East China Normal University, 2 Shanghai Jiao Tong University

2026-07-02视觉语言视觉感知

针对低空无人机图像中视角多变、小目标和背景干扰导致传统无参考质量评价难以只靠全局分数建模的问题,本文将目标与背景质量作为辅助任务,并集成 SigLIP2 多任务视觉回归器与 LoRA 微调的 Qwen3.5-9B 多模态回归器,利用空间退化特征与语义感知的互补性。方法在 ICME 2026 Drone-IQA 挑战中取得第 2 名,但各组件和集成带来的独立增益文中未充分说明。

MindAU: EEG-Conditioned Facial Action Unit Editing via Dual-Stream Manifold Alignment Figure 1
2026-07-02cs.CV

MindAU: EEG-Conditioned Facial Action Unit Editing via Dual-Stream Manifold Alignment

Zhenhang Li, Xin Zhou, Hao Deng, Lijun Yin

Binghamton University, Harvard Medical School

2026-07-02视觉感知

MindAU关注从被动“看见什么”的脑解码转向用EEG驱动可控面部动作编辑,动机是为细粒度表情控制和潜在辅助表达建立脑信号到AU的映射。其核心在于用AU感知EEG编码、双流流形对齐,将噪声EEG同时对齐到AU文本语义和去身份化视觉位移轨迹,再接入扩散编辑器保持身份。文中构建E-CAFE基准,并报告相对EEG生图与文本管线基线更好,但临床有效性和多AU动态场景仍未充分说明。

MedCAGD: Context-Aware Gated Decoder for Efficient Medical Image Segmentation Figure 1
2026-07-02cs.CV

MedCAGD: Context-Aware Gated Decoder for Efficient Medical Image Segmentation

Saad Wazir, Patrick Dominique Vibild, Dinh Phu Tran, Seongah Kim, Daeyoung Kim

2026-07-02视觉感知

论文动机是,在强预训练编码器已较成熟的情况下,医学分割误差仍常来自解码阶段的跨尺度错位、上下文整合不足和边界保持不稳。MedCAGD将改进重点放在解码器,引入多尺度通道重校准、带空间竞争的门控跳连融合,以及向中间解码层注入全局编码器语义的上下文聚合机制。实验覆盖11个医学分割基准,报告其相对CNN、Transformer、Mamba、SAM及近期解码器基线取得稳定提升,同时保持约30.6M参数、5.0GFLOPs的实用复杂度。

The Illusion of High Utility in Safety Alignment of Text-to-Image Diffusion Models Figure 1
2026-07-02cs.CV

The Illusion of High Utility in Safety Alignment of Text-to-Image Diffusion Models

Adeel Yousaf, Soumik Ghosh, James Beetham, Amrit Singh Bedi, Mubarak Shah

2026-07-02视觉感知生成模型安全鲁棒

本文指出文本到图像扩散模型的安全对齐看似兼顾效用,主要是因为FID、CLIPScore等粗粒度指标掩盖了计数、属性和关系等细粒度语义退化。作者将问题归因于文本编码器嵌入空间的“语义塌缩”,并提出SAGE以保持嵌入分布和局部相似结构;实验显示其在维持安全性的同时,TIFA较既有最优提升约5.0%。

DriveVer: Lightweight Trajectory Evaluator as Test-Time Verifier for Autonomous Driving Figure 1
2026-07-02cs.CV

DriveVer: Lightweight Trajectory Evaluator as Test-Time Verifier for Autonomous Driving

Chong He, Yuechen Luo, Fang Li, Shaoqing Xu, Fuxi Wen

Tsinghua University, University of Macau*Equal contribution. ✉ Corresponding author.

2026-07-02规划控制

针对端到端自动驾驶规划器“一次生成即执行”、难以在推理时发现并修正不安全轨迹的问题,DriveVer提出轻量级测试时验证器:基于NAVSIM构造条件聚类的轨迹监督数据,融合候选轨迹、多视角视觉和自车运动状态,同时输出安全评分与几何修正。实验显示其可作为34M参数的即插即用模块提升多种基础规划模型表现,并保持较小推理开销。

MalariAI: A Label-Resilient Decoupled Framework for Universal Cell Segmentation and Explainable Stage Classification in Dense Malaria Blood Smears Figure 1
2026-07-02eess.IV

MalariAI: A Label-Resilient Decoupled Framework for Universal Cell Segmentation and Explainable Stage Classification in Dense Malaria Blood Smears

Kaysarul Anas Apurba, Md Hasibul Hasan, Mohammed Ali, Tanzilur Rahman

Department of Electrical and Computer Engineering, North South University, Dhaka 1229, Bangladesh, Department of Computer Science and Engineering, International University of Business Agriculture and Technology (IUBAT)

2026-07-02视觉感知

面向资源受限地区疟疾血涂片诊断,论文指出端到端检测受漏标、密集细胞 NMS 抑制和缺少逐细胞证据限制。MalariAI 将细胞定位与分期分类解耦:先用无需标注的距离变换分水岭分割整幅图,再用 EfficientNet-B0+Focal Loss 分类并生成 Grad-CAM++。在 BBBC041 上定位召回 75.95%,分类准确率 98.36%,稀有阶段表现优于 Faster R-CNN 基线。

Vitality-Aware Compression for Efficient Image-to-Shape Diffusion Transformers Figure 1
2026-07-02cs.CV

Vitality-Aware Compression for Efficient Image-to-Shape Diffusion Transformers

Jaeah Lee, Hyunjin Kim, Jaewoong Cho, Gihyun Kwon

2026-07-02视觉感知生成模型

这篇论文针对图像到3D形状生成中DiT骨干模型过大、难以部署的问题,指出2D扩散压缩方法会破坏几何一致性。其核心是用点云EMD逐层评估“vitality”,区分双块与单块的重要性,再指导结构化剪枝、混合精度量化和选择性微调。实验在Step1X-3D、Hunyuan3D等模型上最多压缩约66%,形状保真度仅小幅下降。

Attribute-Prompted Kernel Hashing for Unsupervised Data-Efficient Cross-Modal Retrieval Figure 1
2026-07-02cs.IR

Attribute-Prompted Kernel Hashing for Unsupervised Data-Efficient Cross-Modal Retrieval

Runhao Li, Xiaoxu Ma, Zhenyu Weng, Yue Zhang, Guibo Luo, Huiping Zhuang, Zhiping Lin, Yap-Peng Tan

2026-07-02视觉感知

这篇论文针对无监督跨模态哈希在图文配对稀缺时易过拟合、难泛化到未见类别的问题,提出 APKH:借助 CLIP 的属性先验,用提示学习生成属性核并以 RBF 核响应替代传统双流哈希映射,同时用核平滑对比对齐把少量配对样本建模为连续分布。实验称其在四个数据集的数据受限、seen-to-unseen 检索设置下优于现有哈希方法。

Radial Interaction Tomography: Recognizing Non-Transitive Evolutionary Games from One Range-Expansion Image Figure 1
2026-07-02cs.CV

Radial Interaction Tomography: Recognizing Non-Transitive Evolutionary Games from One Range-Expansion Image

Faruk Alpay, Baris Basaran

Department of Computer Engineering, Bahçeşehir University, Istanbul, Türkiye

2026-07-02视觉感知

针对单张微生物扩张终点图像能否识别非传递竞争这一问题,论文把彩色扇区边界视为径向沉积时间中的几何信号,提出从对数极坐标边界流恢复成对交互历史,并用图分解区分标量适应度层级与循环残差。主要结果包括可观测性与不可辨识边界、四类型完全接触需至少八条边界的设计定理,以及确定性像素级基准中对循环相互作用的检测;但生物机制和真实物理时间仍需额外校准。

LIST3R: Long-sequence Instance-aware 3D Reconstruction Figure 1
2026-07-02cs.CV

LIST3R: Long-sequence Instance-aware 3D Reconstruction

Jing Gao, Wei Wang, Feiran Wang, Yan Yan

Beijing Jiaotong University, University of Illinois Chicago

2026-07-02三维

长序列三维重建容易因分段处理或流式记忆而丢失远距离关联,导致回环和全局一致性不稳。LIST3R的核心洞察是把可识别物体实例作为持久锚点,为每个子序列建立局部实例库,并用语义与几何证据匹配重访区域、约束片段对齐,最终合并为全局3D实例库。实验显示其在长序列基准上提升相机轨迹精度和点云重建质量,说明稳定实例锚点能有效补足纯几何或隐式记忆方法的长期关联能力。

Learning to Compose: Revisiting Proxy Task Design for Zero-Shot Composed Image Retrieval Figure 1
2026-07-02cs.CV

Learning to Compose: Revisiting Proxy Task Design for Zero-Shot Composed Image Retrieval

Jingjing Zhang, Lei Zhang, Zheren Fu, Zhendong Mao

2026-07-02视觉感知三维

本文针对零样本组合图像检索中现有代理任务只适配固定组合规则、难以学习细粒度语义修改的问题,提出 FoCo 将组合过程拆为“先聚焦、再补全”:用局部 caption 引导视觉聚合,再结合上下文完成目标语义,并配合跨实例对比学习抑制捷径。实验称其在四个 ZS-CIR 基准上达到 SOTA 且泛化更好,但具体增益中 caption 分解与训练目标的相对贡献仍需消融进一步说明。

MEPA: Multi-Scale Representation Alignment for Visual Autoregressive Modeling with Mixture of Experts Figure 1
2026-07-02cs.CV

MEPA: Multi-Scale Representation Alignment for Visual Autoregressive Modeling with Mixture of Experts

Nuoyan Zhou, Zhijun Tu, Lei Yu, Kun Cheng, Jie Hu, Nannan Wang, Xinghao Chen

2026-07-02视觉感知

MEPA针对VAR在多尺度生成中共用Transformer导致尺度间优化冲突、早期语义错误会沿粗到细过程放大的问题,提出尺度感知的token路由MoE以分离不同尺度表征学习,并用自监督特征和残差聚合加强早期语义对齐。ImageNet 256×256上,它在更小参数量、约一半训练轮数下取得优于dense VAR的FID,单轮训练开销仅小幅增加,但推理时间有所上升。

SFDATrack: Generalized Source-Free Domain Adaptive Tracking Under Adverse Weather Conditions Figure 1
2026-07-02cs.CV

SFDATrack: Generalized Source-Free Domain Adaptive Tracking Under Adverse Weather Conditions

Siyuan Yao, Ziqi Wang, Ruiqi Yu, Junqi Huang, Wenqi Ren, Xiaochun Cao

2026-07-02视觉感知

这篇论文针对恶劣天气下视觉目标跟踪的域偏移问题,指出现有自适应方法依赖源域视频,在隐私、存储或带宽受限场景不现实。SFDATrack只用无标注目标域数据,通过mean-teacher框架、Dual Interactive Mamba提取抗天气扰动的目标token,并用超球面原型投影同时约束域特有与域不变表征。实验称其在多个跟踪基准上优于现有方法,但具体增益的分项来源仍需结合完整消融判断。

Personalized Object Identification and Localization via In-Context Inference with Vision-Language Models Figure 1
2026-07-02cs.CV

Personalized Object Identification and Localization via In-Context Inference with Vision-Language Models

Kensuke Nakamura, Byung-Woo Hong

Artificial Intelligence Department, Chung-Ang University, Seoul, 06974, Korea

2026-07-02视觉语言视觉感知

这篇论文针对 IPLoc 默认查询图中一定存在目标、因而在检索和视频 grounding 等场景易产生假阳性的问题,提出 POIL 任务,要求既定位参考实例又能拒绝负样本。核心方法 IPLoc-ID 将先生成候选框、再通过自提问进行实例级 Yes/No 验证串成同一自回归序列,并构建含正负样本的数据集。实验显示其显著压低负查询误检,同时保持接近 IPLoc 的定位性能。

DroneFINE: Domain-Aware Parameter-Efficient Fine-Tuning of Vision-Language Detectors for Drone Images Figure 1
2026-07-02cs.CV

DroneFINE: Domain-Aware Parameter-Efficient Fine-Tuning of Vision-Language Detectors for Drone Images

Ke Wu, Yanan Zhang, Yingjie Gao, Wenhao Li, Chenyu Zhou, XinZhu Ma, Jiaxin Chen, Di Huang

2026-07-02视觉语言视觉感知

本文针对无人机航拍图像与通用视觉语言检测器预训练数据之间的视角、尺度和背景占比差异,指出常规低秩 PEFT 难以适配小目标、强背景噪声场景。DroneFINE 通过前景感知的 HyperAdapter 动态生成多路径卷积,并用 SemanticGate 借助背景词表抑制无关区域响应。在 VisDrone、UAVDT 上,其性能显著优于现有 PEFT,接近全量微调且微调参数更少。

CORGI: Consistency-Aware 3D Dog Reconstruction from a Single Image in the Wild Figure 1
2026-07-02cs.CV

CORGI: Consistency-Aware 3D Dog Reconstruction from a Single Image in the Wild

Yuxiao Wu, Weile Li, Boyi Zhu, Yumeng Liu, Youcheng Cai, Ligang Liu

2026-07-02视觉感知三维

针对野外单张狗图像难以获得多视角和3D监督、生成视角又常不一致的问题,CORGI采用“生成再重建”思路:先用CDOG规范姿态并合成360度伪多视角,再以D-SMAL约束的可变形3DGS显式吸收视角误差,最后用变形条件扩散修复细节。实验显示其在多犬种上优于现有方法,可生成几何较准、外观连贯且可动画的3D资产。

Typography-Based Monocular Distance Estimation for Advanced Driver-Assistance Systems Figure 1
2026-07-02cs.CV

Typography-Based Monocular Distance Estimation for Advanced Driver-Assistance Systems

Manognya Lokesh Reddy, Zheng Liu

University of Michigan-Dearborn

2026-07-02视觉感知

面向ADAS中低成本、冗余的前车测距需求,论文提出利用美国车牌字符高度、笔画宽度、字符间距和安装孔等受法规约束的“印刷尺度”,从单目相机恢复距离,并结合州别识别、姿态校正、深度网络与卡尔曼平滑。58段实车/停车数据中检测率约99%,通道一致性误差约1.12%,报告中位不确定度0.128 m,但缺少逐帧外部真值,绝对精度仍需受控实验验证。

RetailSMV: Exocentric vs. Egocentric Adaptation of Foundation Video World Models in Retail Figure 1
2026-07-02cs.CV

RetailSMV: Exocentric vs. Egocentric Adaptation of Foundation Video World Models in Retail

Amirreza Rouhi, Rajat Aggarwal, Parikshit Sakurikar, Anoop M. Namboodiri, Sashi P. Reddi

retail scenes: when synchronized egocentric and exocentric video of the same activity are available, arranging, weighing and labelling produce, carrying crates, pushing supply carts, scanning items at the

2026-07-02视觉感知强化学习

该文针对通用视频世界模型在零售等具身部署场景中易偏离领域视觉与行为规律的问题,构建含3.2万段同步第一/第三人称店员作业视频的 RetailSMV,并以 LoRA 控制比较视角数据。结果显示,三种适配均优于基座模型,但仅用第三人称数据训练在7项指标中6项不弱于混合训练,且在 LPIPS、PSNR、DreamSim 上显著更好,提示增益主要来自更稳定的外部视角而非简单数据量扩张。

Wake up for Touch! Mask-isolated Tactile Alignment Learning in MLLMs Figure 1
2026-07-02cs.CV

Wake up for Touch! Mask-isolated Tactile Alignment Learning in MLLMs

Yoonhyung Park, Minji Kim, Sungwon Moon, Jiyoung Lee

2026-07-02视觉感知

面向边缘机器人触觉推理,小型多模态 LLM 在接入触觉时容易牺牲原有视觉语言能力。Splash 的核心做法是用视觉相对重要性评估参数,将关键子空间冻结为锚点,只更新“休眠”子空间和轻量触觉前端,从而以单阶段训练完成触觉对齐。实验在 SSVTP、TVL、TacQuad 上达到 SOTA,3B 模型超过部分 7B 方法,并在通用 VL 基准上基本保持原能力。

Learning When to Listen: Gated Affect Fusion for Human Motion Prediction Figure 1
2026-07-02cs.CV

Learning When to Listen: Gated Affect Fusion for Human Motion Prediction

Jingni Huang

University of Oxford

2026-07-02视觉感知

这篇论文关注真实视频中人体运动预测是否应引入面部情感线索:表情可能预示交流意图,但也容易带来噪声。作者提出 Gated Affect Transformer,用可学习门控在姿态轨迹与 HSEmotion 情感特征间动态调节信息流。实验显示,简单拼接情感会低于纯姿态基线,而门控能抑制随机或错配情感噪声;情感增益主要局限于短中期预测,长期运动仍由运动学连续性主导。

Rosetta: Composable Native Multimodal Pretraining Figure 1
2026-07-02cs.CV

Rosetta: Composable Native Multimodal Pretraining

Xiangyue Liu, Zijian Zhang, Miles Yang, Zhao Zhong, Liefeng Bo, Ping Tan

2026-07-02视觉语言

Rosetta针对统一多模态预训练中连续图像生成梯度会覆盖离散语言/视觉理解能力的问题,提出可组合专家结构:共享全局专家保留基础语义,模态专属专家负责扩展,并用MAOP借优化器动量投影冲突梯度以避免额外显存。实验在同等活跃参数下显示,相比MoE/MoT可显著缓解灾难性遗忘,同时提升图像生成与跨模态协同。

OnPoint: Offline-to-Online Multi-Level Distillation for Point-Supervised Online Temporal Action Localization Figure 1
2026-07-02cs.CV

OnPoint: Offline-to-Online Multi-Level Distillation for Point-Supervised Online Temporal Action Localization

Sakib Reza, Gauri Jagatap, Mohsen Moghaddam, Octavia Camps, Andrea Fanelli

Work primarily done during an internship at Dolby Laboratories.

2026-07-02视觉感知

这篇论文面向流式视频中的时序动作定位:真实应用既不能等待完整视频,又难以获得精确起止边界标注。作者提出POTAL设定,并用离线点监督教师向在线学生蒸馏伪片段、帧级激活和未来窗口线索,同时加入点标注监督与actionness校准解码。五个数据集上相对强基线持续提升,说明点标注也可支撑较可靠的在线定位。

What's Hidden Matters: Identifying Planning-Critical Occluded Agents using Vision-Language Models Figure 1
2026-07-02cs.RO

What's Hidden Matters: Identifying Planning-Critical Occluded Agents using Vision-Language Models

Amirhosein Chahe, Tyler Naes, Jovin D'sa, Faizan M. Tariq, Sangjae Bae, Lifeng Zhou, David Isele

Honda Research Institute (HRI), San Jose, CA 95134, USA., Drexel University, Philadelphia, PA 19104, USA., prompt (center left) containing the ground-truth agent class and task instructions. GPT-5 operates as a semantic annotator

2026-07-02视觉语言视觉感知规划控制

针对自动驾驶中过度保守地处理所有遮挡、或盲目补全隐藏区域的问题,论文用规划 KL 散度衡量隐藏体对自车轨迹的影响,筛选规划关键遮挡体,并借助 GPT-5 生成结构化语义标注来训练 VLM。nuScenes 实验显示,PKL 引导数据微调显著提升各类模型,数据选择较随机采样约提升 30%,小模型微调后可超过更大的零样本模型。

AEGIS: A Multi-Task Joint-Embedding Predictive Architecture for Mammography Figure 1
2026-07-02cs.CV

AEGIS: A Multi-Task Joint-Embedding Predictive Architecture for Mammography

Scott Chase Waggener, Sai Karthik Navuluru, Lakshman Tamil

Department of Electrical and Computer Engineering, University of Texas at Dallas, effective path to leverage abundant unlabeled clinical data [18].

2026-07-02视觉感知

针对乳腺筛查中癌症分诊与乳腺密度评估依赖放射科医生且一致性有限的问题,AEGIS将JEPA自监督预训练引入高分辨率乳腺X光ViT,并用多任务头联合处理分诊、病灶检测和密度分类。其ViT-L在785例测试集上分诊AUC达0.949,集成后0.952;二分类密度AUC为0.953,VinDr-Mammo零样本AUC为0.871,但部分增益可能主要来自模型规模和数据。

MVDGC: Joint 3D and 2D Multi-view Pedestrian Detection via Dual Geometric Constraints Figure 1
2026-07-02cs.CV

MVDGC: Joint 3D and 2D Multi-view Pedestrian Detection via Dual Geometric Constraints

Thinh Phan, Hao Vo, Khoa Vo, Thanh Ngo, Cuong Pham, Ngan Le

AICV Lab, EECS Department, University of Arkansas, University of Information Technology, Posts and Telecommunications Institute of Technology (PTIT), Vietnam

2026-07-02视觉感知优化算法三维

这篇论文针对多视角行人检测中 BEV 投影带来的几何畸变、密集遮挡下定位模糊,以及 2D 框与地面点关系未被联合利用的问题,提出 MVDGC:用稀疏 3D 垂直圆柱查询表示行人,通过相机投影直接从原始多视角图像特征采样,并把 BEV 位置与各视角 2D 框统一为圆柱位置和形状细化。实验显示其在 WildTrack、MultiViewX 上达到 SOTA,在 GMVD 上取得最高 MODP 和 precision,表明对未见相机布局也有一定泛化性。

Multi-Hypothesis Test-Time Adaptation to Mitigate Underspecification Figure 1
2026-07-02cs.CV

Multi-Hypothesis Test-Time Adaptation to Mitigate Underspecification

Afshar Shamsi, Xiao-Yu Guo, Hamid Alinejad-Rokny, Arash Mohammadi, Damien Teney, Ehsan Abbasnejad

2026-07-02视觉感知

这篇论文针对无标签测试时自适应中熵最小化欠约束的问题:多个低熵更新可能对应不同且不可靠的决策边界。作者将 TTA 视为多假设后验探索,维护多个只更新归一化参数的粒子,并在输出、参数、优化器和输入层面做多样化后聚合预测。实验在 ImageNet-C 等混合扰动、单样本批量和标签偏移场景下较 Tent、SAR、DeYO 稳定提升约 1–4%。

Leveraging Phase Information to Boost Unrolled Network Learning for Image Deblurring Figure 1
2026-07-02cs.CV

Leveraging Phase Information to Boost Unrolled Network Learning for Image Deblurring

Samira Malek, Haichuan Zhang, Chul Lee, Vishal Monga

2026-07-02视觉感知

针对传统去模糊多在图像域直接复原、对相位中结构信息利用不足的问题,论文将模糊观测分解为幅度与相位,推导二者的 LMMSE 估计并展开为端到端可训练的 UPADNet。实验称其在 GoPro、RealBlur、COCO 上优于多种深度与展开网络,且在高噪声和少数据训练场景增益更明显。

LV-ROVER: Multi-Stream Tesseract Voting for Maltese Paragraph OCR Figure 1
2026-07-02cs.CL

LV-ROVER: Multi-Stream Tesseract Voting for Maltese Paragraph OCR

Adam Darmanin

2026-07-02视觉感知

本文面向马耳他语档案 OCR 标注数据极少、变音符和连字符易混淆的问题,提出合成段落训练管线与 5 路 Tesseract LV-ROVER 投票,并用双 CER 区分识别增益和标签规范化收益。在 422 段基准上,识别本身将 CER 从 0.0234 降至 0.01317,完整后处理后降至 0.00700;但作者也指出 70% 降幅部分来自标点和标签约定对齐。

Does Your ViT Still Need U-Net for Segmentation? Figure 1
2026-07-02cs.CV

Does Your ViT Still Need U-Net for Segmentation?

Xin Li, Wenhui Zhu, Xuanzhao Dong, Xiwen Chen, Yanxi Chen, Yujian Xiong, Hao Wang, Oana M. Dumitrascu, Yalin Wang

Arizona State University, Tempe, AZ, USA, Clemson University, Clemson, SC, USA

2026-07-02视觉感知

本文针对医学分割中 ViT 仍沿用 U-Net 解码器的惯性,考察强预训练 ViT 是否已足以直接做 dense prediction。作者提出 EoSeg,用查询式 encoder-only 结构、跨层查询建模与可学习块融合替代传统解码器。七个 CT、MRI、病理、内镜和皮肤镜数据集上取得有竞争力结果,如 Synapse mDice 85.50%、ACDC 91.73%、GlaS 93.27%,但部分增益可能主要来自更强预训练与 scaling。

EgoSafetyBench: A Diagnostic Egocentric Video Benchmark for Evaluating Embodied VLMs as Runtime Safety Guards Figure 1
2026-07-02cs.CV

EgoSafetyBench: A Diagnostic Egocentric Video Benchmark for Evaluating Embodied VLMs as Runtime Safety Guards

Siddhant Panpatil, Arth Singh, Mijin Koo, Chaeyun Kim, Haon Park, Dasol Choi

Seoul National University

2026-07-02视觉语言视觉感知数据集/基准安全鲁棒

这篇论文针对具身机器人运行时安全守卫的评测缺口:现有二分类基准难区分漏检真实风险与对可疑但安全场景的过度干预。作者提出 EgoSafetyBench,用第一视角视频、半秒级标注、情境四分类与误导性场景文字双轴评测,并用对比梯控制单一关键线索。十个 VLM 的结果显示,模型能判断视频含危险,却常定位不到具体危险时刻;误导文字会使部分开源模型漏检、使强闭源模型过度报警,说明表面鲁棒性并不等于物理安全推理。

Trust the Prior (or Not): Uncertainty-Aware Abdominal Aortic Aneurysm Segmentation Figure 1
2026-07-02cs.CV

Trust the Prior (or Not): Uncertainty-Aware Abdominal Aortic Aneurysm Segmentation

Erich Robbi, Daniele Ravanelli, Andrea Passerini

Department of Computer Science, University of Trento

2026-07-02视觉感知安全鲁棒

这篇论文面向腹主动脉瘤 CTA 中血栓边界低对比、跨中心扫描协议导致分布偏移的问题,提出患者级强度归一化与不确定性门控解剖注意力:只在先验可信时利用管腔、钙化等空间线索,低置信时回退到图像特征。实验称在同分布测试集达到 SOTA,并在多中心 OOD 数据上明显优于现有方法,同时可分解视觉与解剖证据以增强可解释性。

HydraCollab: Adaptive Collaborative-Perception for Distributed Autonomous Systems Figure 1
2026-07-02cs.RO

HydraCollab: Adaptive Collaborative-Perception for Distributed Autonomous Systems

Luke Chen, Cheng-Ju Wu, David R. Martin, Qilin Ye, Pramod Khargonekar, Mohammad Abdullah Al Faruque

Department of Electrical Engineering and Computer Science, University of California, Irvine, USA.

2026-07-02视觉感知

HydraCollab面向多机器人协同感知中精度与通信带宽的矛盾,指出盲目融合所有传感器或在所有区域做中间特征通信会引入噪声和浪费带宽。其核心是用协作感知相关的传感器门控选择可靠特征,并依据空间置信图在重叠高置信区域做中间协作、其余区域转向后期结果协作。V2X-R、V2X-Radar和UAV3D-mini实验显示,相比Where2comm仅用41%和26%带宽仍分别提升0.78%和0.75%。

VOCA: Visual Odometry with Codec Awareness Figure 1
2026-07-02cs.CV

VOCA: Visual Odometry with Codec Awareness

Nouri Alexander Hilscher, Mateo de Mayo, Dominik Muhle, Christoph Otten genannt Hermes, Daniel Cremers

2026-07-02视觉感知

这篇论文针对实际机器人/空间计算中视频常被 H.264 等编码压缩、而传统 VO/SLAM 多假设未压缩图像导致跟踪退化的问题,提出 VOCA:在 Basalt 式因果双目视觉里程计中显式利用编码器运动向量等 codec 信息,为稀疏光流前端提供更好的初始化。实验显示,在最高约 100 倍压缩的视频流上,VOCA 相比 Basalt、ORB-SLAM3、OKVIS2 等获得更稳定轨迹,并在因果 VO 的相对/绝对轨迹误差和效率上达到领先结果。

DriftScope: Measuring The Hidden Effects of Diffusion Model Adaptation Figure 1
2026-07-02cs.CV

DriftScope: Measuring The Hidden Effects of Diffusion Model Adaptation

Héctor Laria, Yiping Han, Julian D. Santamaria, Kai Wang, Bogdan Raducanu, Joost van de Weijer, Alexandra Gomez-Villa

2026-07-02生成模型

本文关注扩散模型在 DreamBooth 定制或概念遗忘后,标准 FID/KID 只看整体质量而掩盖无关概念受损的问题。核心洞察是权重级适配会产生系统性“隐性漂移”,并提出 DriftScope,通过比较两个检查点的交叉注意力差异,为提示词中的 token 排序定位受影响概念。实验用稀疏自编码器和零样本分类显示,整体指标近乎不变时,特定类别准确率最高可降 18.9 个点,且漂移会扩散到非目标概念。

PRISM-VO: Scale-Aware Visual Odometry Using Photometric Plenoptic Bundle Adjustment Figure 1
2026-07-02cs.CV

PRISM-VO: Scale-Aware Visual Odometry Using Photometric Plenoptic Bundle Adjustment

Aymeric Fleith, Julian Zirbel, Daniel Cremers, Niclas Zeller

Technical University of Munich, Munich, Germany, Karlsruhe University of Applied Sciences, Karlsruhe, Germany

2026-07-02视觉感知

这篇论文针对单目视觉里绝对尺度不可观、而传统深度传感或双目受基线和量程限制的问题,利用聚焦光场相机同时记录空间与角度信息。PRISM-VO的关键在于把光场投影模型直接嵌入前端跟踪和滑窗光度束调整,联合优化位姿与逆深度,并用单帧微图像视差提供尺度先验、时序多视图约束抑制漂移。实验显示其在室内外序列上优于既有光场VO,并接近或超过部分优化式和学习式单目方法,同时能稳定恢复米制尺度。

Steal the Patch Size: Adversarially Manipulate Vision-Language Models Figure 1
2026-07-02cs.CV

Steal the Patch Size: Adversarially Manipulate Vision-Language Models

Kai Hu, Akash Bharadwaj, Weichen Yu, Matt Fredrikson

2026-07-02视觉语言视觉感知

针对黑盒视觉语言模型隐藏的视觉 tokenizer 与预处理配置可能影响鲁棒性却不透明的问题,论文发现 ViT patchification 会在网格边界与隐含 patch 网格对齐时造成周期性计数崩溃,并将其作为任务级侧信道来反推 patch size、动态/固定分辨率策略和目标 resize 分辨率。实验在 Qwen-VL、GPT、Claude 等模型上能较稳定恢复相关参数,并进一步提升预处理感知的迁移攻击与模型定向对抗操控效果。

Identifying and Resolving Pitfalls of Knowledge-Based VQA Benchmarks: Auditing, Repairing, and Augmenting Figure 1
2026-07-02cs.CL

Identifying and Resolving Pitfalls of Knowledge-Based VQA Benchmarks: Auditing, Repairing, and Augmenting

Qian Ma, S M Rayeed, Charles V. Stewart, Qiong Wu, Yao Ma

2026-07-02数据集/基准

本文针对知识型 VQA 基准中“答对即代表知识推理”的评估假设提出质疑,指出 InfoSeek、E-VQA 等存在答案与证据不一致、问题约束不足、图像场景过于单实体化等缺陷。核心贡献是给出审计修复流程,并构造多实体干扰增强来检验真实视觉 grounding 与检索推理能力。重评显示,修复数据会改变模型排名,增强后检索召回和端到端准确率显著下降,说明现有成绩可能高估了模型能力。

Progressive Pose-Guided 4D Animal Reconstruction from Monocular Video Figure 1
2026-07-02cs.CV

Progressive Pose-Guided 4D Animal Reconstruction from Monocular Video

Siyuan Li, Weiying Chen, Yilin Wang, Xinxin Zuo, Xingyu Li, Li Cheng

2026-07-02视觉感知三维

本文针对单目野外视频中动物种类差异大、关节运动复杂且可靠模板缺乏的问题,提出基于3D Gaussian Splatting的渐进式测试时优化框架。核心洞察是粗糙形状先验若配合姿态与非刚性形变解耦即可持续修正;方法用对称感知时序编码缓解相机漂移,并以可学习部件锚点和蒙皮场联通姿态估计与局部形变。实验显示其在多物种场景下较基线提升几何精度、时序一致性和视觉保真度。

3D Point World Models: Point Completion Enables More Accurate Dynamics Learning Figure 1
2026-07-02cs.RO

3D Point World Models: Point Completion Enables More Accurate Dynamics Learning

Skand Peri, Hung Nguyen, Chanho Kim, Li Fuxin, Stefan Lee

Oregon State University

2026-07-02强化学习三维

这篇论文针对视频或局部点云世界模型在遮挡场景中几何不一致、长时域滚动误差累积的问题,提出先从单视角 RGB-D 补全物体点云,再在完整 3D 几何上学习动作条件动力学的 3DPWM。核心洞察是完整点云能让模型更稳定地推理重心、接触和代价函数。实验显示其在多种桌面操作与不同机器人上支持 100–300+ 步滚动、开闭环规划、未见任务适应和仿真到真实迁移,但失败仍受分割、点云补全和规划延迟影响。

A Mechanism-Driven Theory of Phase Transitions in Active Learning Figure 1
2026-07-02cs.CV

A Mechanism-Driven Theory of Phase Transitions in Active Learning

Julia Machnio, Mads Nielsen, Mostafa Mehdipour Ghazi

2026-07-02学习理论

本文针对主动学习中“早中晚预算”依赖经验标签数、难以跨数据集和模型泛化的问题,提出用主导泛化机制的切换来解释阶段变化。其核心洞察是将风险分解中的经验风险、分布偏差、模型复杂度和置信项视为随标注过程动态竞争的瓶颈,并用代理指标与分段回归识别数据驱动、过渡、模型驱动三阶段。实验显示代表性、覆盖性和不确定性策略分别在不同阶段更有效,且自监督表征会使阶段转移提前。

MG-SpaIR: Multi-grade Sparse-guided Implicit Representation for Training-Data-Free Image Restoration Figure 1
2026-07-02cs.CV

MG-SpaIR: Multi-grade Sparse-guided Implicit Representation for Training-Data-Free Image Restoration

Jianmin Liao, Lei Huang, Ronglong Fang, Ashley Prater-Bennette, Lixin Shen, Yuesheng Xu

2026-07-02视觉感知

针对单张观测同时受模糊、降采样、噪声和缺失像素破坏时,纯 INR 容易受频谱偏置限制并产生振铃、棋盘格等伪影的问题,MG-SpaIR 将多级粗到细残差隐式表示与高分辨率图像域的 ℓ0 型稀疏近端正则结合,并用交替优化求解且给出收敛分析。实验显示其在混合退化恢复中稳定优于 DIP 等无需训练数据的基线,但具体增益在不同退化和正则项间的来源仍需结合完整消融判断。

A Synthetic-Driven Vision System for Assembly Step Recognition Figure 1
2026-07-02cs.CV

A Synthetic-Driven Vision System for Assembly Step Recognition

Hui Zhang, Xuanang Lei, Rui Wang, Julian Ferchow, Mirko Meboldt

2026-07-02视觉感知

面向高混合低批量装配中真实数据采集和标注成本高、人工操作差异与遮挡严重的问题,论文提出用CAD模型和步骤描述自动生成装配序列:结合物理手物交互运动、域随机化真实感渲染和YOLO检测加时序规则做步骤识别。系统仅用合成数据训练,在真空泵真实装配上达到92.4%准确率,并展示可在约一小时内迁移到新任务,但复杂灵巧动作和细粒度姿态错误仍受限。

Decompose, Compare, and Decide: Multimodal LLMs are Implicit Few-Shot Learners Figure 1
2026-07-02cs.CV

Decompose, Compare, and Decide: Multimodal LLMs are Implicit Few-Shot Learners

Yunhan Wang, Eshika Khandelwal, Edson Araujo, Walid Bousselham, Nina Shvetsova, Hilde Kuehne

2026-07-02视觉语言三维

这篇论文关注现成多模态大模型在少样本图像分类中难以真正利用支持样本、容易依赖类别语义先验的问题。作者提出 DeCoDe,将多类分类拆成查询图与支持图的二元同类判断,用“Yes” token 的 logit 排序决策,并可加入数据域提示。实验覆盖标准与新构建的域外数据集,在匿名标签设置下仍显著优于常规上下文提示和多种免训练基线,说明成对视觉比较比直接读类别名更能激发少样本适应能力。

Segmenting, Fast and Slow: Real-Time Open-Vocabulary Video Instance Segmentation with Dual-Path Processing Figure 1
2026-07-02cs.CV

Segmenting, Fast and Slow: Real-Time Open-Vocabulary Video Instance Segmentation with Dual-Path Processing

Luca Barsellotti, Martin Sundermeyer, Mattia Segu, Nikita Araslanov, Muhammad Ferjad Naeem, Marcella Cornia, Yongqin Xian, Maxim Berman

2026-07-02视觉感知

这篇论文针对开放词汇视频实例分割在移动端实时运行的瓶颈:特征增强器和对象解码器随帧执行成本过高。SegFS 的关键洞察是骨干特征已含足够定位信息,因此只在稀疏关键帧用慢路径提取开放词汇实例语义,并投影回特征空间,快路径在后续帧轻量重定位和分割。实验显示其相对 MOBIUS-Mini-M 最高降低 14× 延迟,摊销帧率超过 30 FPS,同时标准基准 AP 损失控制在约 1 以内。

PixelEyes: Decoupling Perception and Reasoning for Pinpoint Visual Evidence Seeking Figure 1
2026-07-02cs.CV

PixelEyes: Decoupling Perception and Reasoning for Pinpoint Visual Evidence Seeking

Dengxian Gong, Yuanzheng Wu, Haobo Yuan, Zhengdong Hu, Tao Zhang, Yikang Zhou, Shihao Chen, Quanzhu Niu, Kai Wang, Jason Li, Haochen Wang, Lu Qi, Shunping Ji, Ming-Hsuan Yang

Wuhan University

2026-07-02视觉感知

PixelEyes针对多轮视觉搜索中同一MLLM同时推理与定位导致小目标找不准、轨迹冗长和“看见但没认出”的问题,将高层推理与SAMTok等专用分割感知工具解耦,并用掩码裁剪、语义区域BFS和可切换工具减少无效深挖;作者还构建PixelEyes-6K和零提示Pinpoint-Bench。实验显示其在多个视觉搜索基准上较既有主动感知代理取得更高准确率与更少交互轮次。

Lost in the Tail: Addressing Geographic Imbalance in Urban Visual Place Recognition Figure 1
2026-07-02cs.CV

Lost in the Tail: Addressing Geographic Imbalance in Urban Visual Place Recognition

Zhiyao Shu, Jiacheng Yang, Yang Lu, Waishan Qiu, Chuan Li, Da Chen

2026-07-02视觉感知

本文关注城市视觉地点识别中被忽视的地理长尾:街景数据更偏向主干道和热门区域,导致模型在低访问、但常是机器人巡逻等应用重点的区域失效。作者提出模型无关的 DAPR,通过低访问偏置损失重平衡头尾类梯度,并在分类-检索流程中用多尺度分布距离补偿类内紧致度差异。SF-XL 上较混合检索基线 R@1 提升 18.3%/6.7%,且在 MSLS、Pitts30k 和多种 VPR 方法上有一致增益。

Synergistic Perception-Reasoning Governance: Grounding Medical MLLMs with Verifiable Anatomical Evidence Figure 1
2026-07-02cs.CV

Synergistic Perception-Reasoning Governance: Grounding Medical MLLMs with Verifiable Anatomical Evidence

Rui Hao, Qiankun Li, Junyuan Mao, Linghao Meng, Dirui Xie, Dayu Tan, Zhigang Zeng

2026-07-02视觉语言

针对医学多模态大模型在VQA和报告生成中容易给出与影像证据不一致结论的问题,论文提出无需训练的SPRG框架:用MedSAM提取ROI解剖先验,一方面调制视觉token激活,另一方面把区域坐标与标签写入文本提示,并由任务路由器选择干预方式。跨2类任务、5个数据集和6个MLLM评测显示,闭式准确率最高提升约6%,开放式幻觉最多降低约35%。

Joint Medical Image Enhancement and Segmentation with Diffusion-based Symbiotic Information Interaction Figure 1
2026-07-02cs.CV

Joint Medical Image Enhancement and Segmentation with Diffusion-based Symbiotic Information Interaction

Ying Chen, Jinyue Li, Qiankun Li

Shenzhen Research Institute, The Chinese University of Hong Kong, University of Science and Technology of China, Imperial Global Singapore, Imperial College London

2026-07-02视觉感知生成模型

针对低质 MRI、CT、超声图像中增强与分割被割裂处理、语义结构难以同时保真的问题,论文提出 DiSIINet:以 DDIM 构建增强与分割双分支,并通过 SII 交叉注意力在反扩散过程中双向交换特征,使两任务迭代互助。多模态医学数据实验显示其优于顺序式或独立处理方案。

Enhancing Oracle Bone Inscription Recognition via Multi-Scale Layer Attention Figure 1
2026-07-02cs.CV

Enhancing Oracle Bone Inscription Recognition via Multi-Scale Layer Attention

Chaowen Yan, Kaishen Wang, Yong Wang, Jianlong Xiong, Tao He

2026-07-02视觉感知

针对甲骨文形态残缺、笔画细微差异难以由常规注意力捕捉的问题,论文提出多尺度层注意力 MSLA,指出现有层注意力跨层 token 过少是瓶颈,并用全局/局部多尺度 token 与逐层累积增强跨层交互。实验称其在大规模甲骨文数据集上优于多种注意力机制且保持计算效率,但具体增益来源仍需结合完整消融判断。

Vertigo Vertigo: Reconstructing a Cinematic Ideal through its Predictive AI Double Figure 1
2026-07-02cs.MM

Vertigo Vertigo: Reconstructing a Cinematic Ideal through its Predictive AI Double

Adam Cole, Mick Grierson

University of the Arts London, [15]. These systems enable controllable pipelines via text-to-video

2026-07-02视觉感知

本文动机是借《迷魂记》本身关于“重构理想形象”的主题,检验生成式视频模型是否内化了经典电影的视觉规范。其创新在于仅用原片2.78%关键帧驱动14B扩散模型做全片首尾帧插值,并以原片与“预测阴影”的偏差作为审美与计算分析对象。结果显示73.1%帧仍可辨认为合理《迷魂记》重构,仅3.6%严重失败,但情感、对白和异常段落仍暴露模型局限。

Learning Dexterous Manipulation Using Contact Wrench Guidance From Human Demonstration Figure 1
2026-07-02cs.RO

Learning Dexterous Manipulation Using Contact Wrench Guidance From Human Demonstration

Xinghao Zhu, Zixi Liu, Shalin Jain, Chenran Li, Milad Noori, Huihua Zhao, John Welsh, Michael Andres Lin, Wei Liu, Tingwu Wang, Xingye Da, Zhengyi Luo, Vishal Kulkarni, Naema Bhatti, Yuke Zhu, Linxi Fan, Bowen Wen, Danfei Xu, Soha Pouya, Yan Chang

2026-07-02机器人模仿学习

针对人类示范难以直接迁移到灵巧手、接触位置匹配易受形态差异影响的问题,CHORD把人和机器人的接触统一到以物体为中心的力/力矩扳手空间,用“能诱导的物体运动”来指导强化学习。论文构建4739个双手任务基准,在1831个任务上平均成功率82.12%,全身操作达90.77%,并展示了仿真到真实机器人的迁移。

Towards an automated AI-based framework for floor plan compliance checks for residential buildings Figure 1
2026-07-02cs.CY

Towards an automated AI-based framework for floor plan compliance checks for residential buildings

Subash Gautam, Debaditya Acharya, Alexandra Kleeman, Sarah Foster

aSchool of Global Urban and Social Studies, RMIT University, Melbourne, Australia, bDepartment of Mathematical and Geospatial Sciences, RMIT University, Melbourne, Australia, evolving policies limit scalability for large-scale assessments across thousands of apartments. Existing automated, framework offers a scalable, consistent, and transparent approach to automated compliance checking across jurisdic-, guidance on minimum design quality standards for apartments (NSW Department of Planning and Environment, (Apartments) in 2019 (updated in 2024) (State of Victoria Department of Environment Land Water and Planning, WA Department of Planning Lands and Heritage, 2024)., codes, which are typically available as texts describing the design standards. A relevant example is the High Life, assessing policy implementation has been highly labour- and time-intensive, relying on manual interpretation and, efficiency, consistency, and scalability. The floor plans are often distributed and archived as raster images in PDF, Motivated by the widespread availability of floorplan images, image-based approaches have gained popularity., some may include well-labelled text indicating functional areas or furniture locations, whereas others may lack this

2026-07-02视觉感知

该文针对澳大利亚公寓设计合规审查依赖人工量测、难以随政策更新扩展的问题,提出将楼层平面图视觉解析、建筑图结构表示与LLM规则引擎结合的多单元住宅审查框架。核心洞察是把文本规范转成可解释规则,并用房间、墙体、符号及拓扑关系支撑自动判定;但论文主要是概念性方案,实证性能和相对人工流程的量化增益文中未充分说明。

Surfacing Variations to Calibrate Perceived Reliability of MLLM-generated Image Descriptions Figure 1
2026-07-02cs.HC

Surfacing Variations to Calibrate Perceived Reliability of MLLM-generated Image Descriptions

Meng Chen, Akhil Iyer, Amy Pavel

The University of Texas at Austin, University of California, Berkeley, The University of Texas at Austin Austin Texas USA, University of California, Berkeley Berkeley California USA

2026-07-02视觉感知

这篇论文关注盲人和低视力用户难以核验 MLLM 图像描述错误的问题,提出通过系统呈现多次生成结果中的一致、分歧和独有信息来校准信任,而非依赖不可得的模型置信度。原型包含多描述列表、变异感知描述和变异摘要;15 名用户研究显示,该方法使识别不可靠陈述能力较单一描述提升 4.9 倍,并降低了对模型回答的过度信任。

2026-07-01

169 篇
FaceMoE: Mixture of Experts for Low-Resolution Face Recognition Figure 1
2026-07-01cs.CV

FaceMoE: Mixture of Experts for Low-Resolution Face Recognition

Kartik Narayan, Vishal M. Patel

2026-07-01视觉感知

低分辨率人脸识别受探针图像退化、HR图库与LR探针域差异及微调遗忘影响,单一编码器难以兼顾两域。FaceMoE将Transformer中的FFN替换为稀疏激活的多专家,并用top-k路由按分辨率和面部语义区域分配token,以保留预训练知识并提取更稳健特征。文中在11个HR、混合质量和LR数据集上报告优于现有方法。

GEAR: Guided End-to-End AutoRegression for Image Synthesis Figure 1
2026-07-01cs.CV

GEAR: Guided End-to-End AutoRegression for Image Synthesis

Bin Lin, Zheyuan Liu, Chenguo Lin, Sixiang Chen, Yunyang Ge, Yunlong Lin, Jianwei Zhang, Miles Yang, Zhao Zhong, Liefeng Bo, Li Yuan

2026-07-01视觉感知

本文针对视觉生成中“先训 tokenizer、再冻结训练生成器”导致离散潜空间未必易于自回归建模的问题,提出 GEAR:用硬分支保持真实 VQ token 的下一词预测训练,用可微软分支仅通过表征对齐反向引导 tokenizer,避免 STE 端到端训练造成码本坍塌。结果显示其在 ImageNet 上相对 LlamaGen-REPA 最高可加速约 10 倍 gFID 收敛,并在不同模型规模、VQVAE/LFQ/IBQ 量化器和文生图设置中保持改进。

PointSplat: Compact Gaussian Splatting via Human-Centric Prediction Figure 1
2026-07-01cs.CV

PointSplat: Compact Gaussian Splatting via Human-Centric Prediction

Yujie Guo, Yudong Jin, Lingteng Qiu, Zehong Shen, Zhen Xu, Jing Zhang, Xianchao Shen, Hujun Bao, Sida Peng, Xiaowei Zhou

2026-07-01三维

面向沉浸式直播/全息通信中带宽和算力受限的实时人体三维重建,PointSplat指出逐视角预测会重复编码同一人体,造成高斯数量和传输冗余;其改为在人体中心的3D点集上预测高斯,结合粗几何代理、光线投射删去内部点并建立2D-3D对应,再用Point-Image Transformer融合外观与几何。实验显示其在多个人体数据集上以约三分之一高斯数量取得更好的新视角质量,并对视角数和分辨率变化更稳健。

SpheRoPE: Zero-Shot Optimization-Free 360 Panorama Generation with Spherical RoPE Figure 1
2026-07-01cs.CV

SpheRoPE: Zero-Shot Optimization-Free 360 Panorama Generation with Spherical RoPE

Or Hirschorn, Aaron Olender, Eli Alshan, Ianir Ideses, Lior Fritz, Sagie Benaim

Tel-Aviv University, Hebrew University of Jerusalem

2026-07-01优化算法

针对VR与机器人仿真等场景需要无缝360°环境、而现有方法依赖全景数据微调或慢速推理优化的问题,SpheRoPE的关键洞察是预训练DiT已有部分全景先验,只需在推理时把RoPE改为球面几何编码,并用语义畸变CFG约束ERP拓扑。实验显示其在Flux、LTX等图像/视频骨干上无需训练即可获得更好的接缝一致性、人类偏好和多项竞争性指标。

FLORA: A deep learning approach to predict forest attributes from heterogeneous LiDAR data Figure 1
2026-07-01cs.CV

FLORA: A deep learning approach to predict forest attributes from heterogeneous LiDAR data

Emilie Vautier, Clément Mallet, Cédric Vega

2026-07-01视觉感知

针对国家尺度森林清查中 LiDAR 采集季节、传感器与飞行条件不一致导致模型难迁移的问题,FLORA 用八叉树点云骨干直接学习三维结构,并通过后融合门控引入生态与时空变量。法国 32052 个样地实验显示,多季节联合训练比季节专用模型更稳健;辅助变量总体增益有限但利于树种体积分解,优势高 R²约0.88、总蓄积 R²约0.74。

Cross-Space Distillation: Teaching One-Step Students with Modern Diffusion Teachers Figure 1
2026-07-01cs.CV

Cross-Space Distillation: Teaching One-Step Students with Modern Diffusion Teachers

Anh Nguyen, Ngan Nguyen, Duc Vu, Trung Dao, Viet Nguyen, Quan Dao, Kien Nguyen, Chi Tran, Phong Nguyen, Khoi Nguyen, Cuong Pham, Dimitris Metaxas, Vishal M. Patel, Anh Tran

University of Wisconsin–Madison, Johns Hopkins University, Rutgers University, † Qualcomm AI Research is an initiative of Qualcomm Technologies, Inc.

2026-07-01生成模型

针对一阶扩散蒸馏默认师生共享潜空间、因分辨率和 VAE 不匹配而难以把 SD3.5/Flux 等大教师迁移到 SD1.5 等轻量学生的问题,论文提出 Cross-Space Distillation,并用轻量 Bridge 将学生 latent 对齐到教师空间,无需改学生骨干。实验显示 SD1.5 的 HPSv3 从 5.4 提升到 9.4,同时保持一阶推理和部署兼容性。

Automated Background Swapping for Robustness against Spurious Backgrounds Figure 1
2026-07-01cs.CV

Automated Background Swapping for Robustness against Spurious Backgrounds

Cesar Roder, Kajetan Schweighofer

Johannes Kepler University Linz, Austria, Cognizant AI Lab, USA, Work partly done while at Johannes Kepler University Linz, Austria

2026-07-01安全鲁棒

这篇论文针对图像分类模型容易把类别与背景的伪相关当作捷径、在背景分布变化时失效的问题,提出 AutoBackSwap:用少量块级前景标注训练辅助分割器,补全背景后随机重组前景与背景做数据增强。核心洞察是无需训练集中出现打破伪相关的样本,也能通过自动背景交换削弱背景依赖;实验显示在多种含伪背景基准上优于既有方法,且几百个标注样本和简单补全策略已基本够用。

CoMet: Context and Multiplicity Decomposition for Multimodal Uncertainty Estimation Figure 1
2026-07-01cs.LG

CoMet: Context and Multiplicity Decomposition for Multimodal Uncertainty Estimation

Sanghyuk Chun, William Yang, Amaya Dharmasiri, Olga Russakovsky

Princeton University

2026-07-01视觉语言安全鲁棒

本文针对多模态大模型在开放式视觉语言任务中难以可靠估计“不知道什么”的问题,指出不确定性既来自提示/任务定义的答案空间,也来自输入与多个可行答案的语义匹配。CoMet引入匹配变量,将不确定性分解为上下文项和多重性项,并用轻量后置模块在推理时免生成、免采样地估计。实验覆盖开放式VQA、幻觉检测和多选VQA,显示其较现有置信度与采样式方法更稳定且高效。

CoLT: Teaching Multi-Modal Models to Think with Chain of Latent Thoughts Figure 1
2026-07-01cs.CV

CoLT: Teaching Multi-Modal Models to Think with Chain of Latent Thoughts

Lianyu Hu, Shengqian Qin, Zeqin Liao, Qing Guo, Liang Wan, Wei Feng, Yang Liu

2026-07-01视觉感知

这篇论文针对多模态大模型使用文本 CoT 推理时延迟高、长链条易累积错误的问题,提出 CoLT:将中间推理压缩为少量连续“潜在思维”步骤,并用轻量外部解码器做前向/后向逐步监督,再配合内部转移监督稳定训练;推理时移除监督模块以保效率。八个多模态基准上,CoLT 优于 CODI、SIM-CoT 等潜在推理方法,并相较文本 CoT 将总体推理时间降至约 1/10、文本解码时间降至约 1/22。

ERA: Entropy-Guided Visual Token Pruning with Rectified Attention for Efficient MLLMs Figure 1
2026-07-01cs.CV

ERA: Entropy-Guided Visual Token Pruning with Rectified Attention for Efficient MLLMs

Yuhao Wang, Mu Qiao, Haiwen Diao, Yunzhi Zhuge, Pingping Zhang, Xindong Zhang, Lei Zhang, Huchuan Lu

2026-07-01视觉感知

针对多模态大模型视觉 token 过长导致推理成本高、现有训练无关剪枝会削弱视觉注意力的问题,ERA指出“Attention Logit Collapse”源于用单个中心近似簇内累计注意力,并用头级熵选择锚点、回收被剪 token、向注意力 logit 注入偏置来校正分布。实验覆盖单图、多图和视频,在多种 MLLM 与 vLLM 部署中保持性能并降低 FLOPs、延迟、prefill 与缓存开销。

LUNA: Learning Universal 3D Human Animation Beyond Skinning Figure 1
2026-07-01cs.CV

LUNA: Learning Universal 3D Human Animation Beyond Skinning

Peng Li, Rawal Khirodkar, Junxuan Li, Yuan Dong, Chen Cao, Yuan Liu, Wenhan Luo, Yike Guo, Shunsuke Saito

2026-07-01三维

LUNA针对单目三维人体动画仍依赖LBS和参数化人体模型、易受拟合误差与姿态抖动影响的问题,提出直接从RGB图、2D关键点、草图或跨身份角色等2D驱动信号预测3D Gaussian形变的无LBS框架。其关键在于用Transformer解耦全局刚体运动与局部非刚性动态,并以LBS教师作软结构先验结合未标注视频训练。实验显示其在视觉质量上接近LBS方法,同时具备更自然运动、较少抖动和零样本跨身份驱动能力。

Planar-SfM: Camera Pose Estimation via Homography Graph Embeddings Figure 1
2026-07-01cs.CV

Planar-SfM: Camera Pose Estimation via Homography Graph Embeddings

Gabi Pragier, Matan Karklinsky, David Ungarish, Avi Ben-Cohen

2026-07-01三维

这篇论文针对传统 SfM 在单一或强平面场景中因极线几何退化而难以估计相机位姿的问题,提出将平面从“退化源”转为几何约束来源:由多对图像的单应性分解生成位姿图,再用基于几何与视觉一致性的谱嵌入筛除不可靠边,并抽取一致生成树恢复位姿。实验显示其在篮球场等平面主导场景显著优于既有方法,在 IMC Phototourism 等一般户外场景也达到或超过当前方法。

MECoBench: A Systematic Study of Multimodal Agent Collaboration in Embodied Environments Figure 1
2026-07-01cs.MA

MECoBench: A Systematic Study of Multimodal Agent Collaboration in Embodied Environments

Qingyun Liu, Jiwen Zhang, Jingyi Hu, Siyuan Wang, Zhongyu Wei

Fudan University, Shanghai Innovation Institute, The Chinese University of Hong Kong

2026-07-01视觉语言

论文针对现有具身多智能体评测多依赖文本或符号状态、难以刻画视觉观察下协作机制的问题,提出 MECoBench,在 VirtualHome 中覆盖多类家务任务、并行/顺序结构、1–5 个智能体及集中/去中心化等模式。实验显示,协作通常提升完成率,但团队扩大后因协调开销呈倒 U 型;通信是主要增益来源,且在噪声先验和探索条件下能增强鲁棒性。

AnyBokeh: Physics-Guided Any-to-Any Bokeh Editing with Optical Fingerprint Transfer Figure 1
2026-07-01cs.CV

AnyBokeh: Physics-Guided Any-to-Any Bokeh Editing with Optical Fingerprint Transfer

Xinyu Hou, Xiaoming Li, Zongsheng Yue, Chen Change Loy

S-Lab, College of Computing & Data Science, Nanyang Technological University

2026-07-01视觉感知

本文针对单张照片后期景深/焦外编辑常受限于全清晰输入、强制去模糊会丢失源图虚化线索的问题,提出 AnyBokeh:用有符号 CoC 与视差估计源图“光学指纹”,再迁移到目标焦距/光圈,并以源/目标 CoC 双条件生成相对虚化变化。实验显示其在任意到任意虚化、全清晰转虚化和离焦去模糊上更可控,且减少全清晰重建与测试时标定依赖。

DEMUN: Fast and accurate discovery of music notation in very large collections Figure 1
2026-07-01cs.DL

DEMUN: Fast and accurate discovery of music notation in very large collections

Vojtěch Dvořák, Filip Bím, Jiří Mayer, Martina Dvořáková, Markéta Herzanová Vlková, Pavel Pecina, Petr Žabička, Jan Hajič jr

2026-07-01视觉感知

这篇论文针对大型图书馆中未被元数据标注的乐谱页难以被 OMR 系统发现的问题,提出 DEMUN:用两阶段轻量图像分类先快速预筛、再精筛,以适应数千万页规模和极低阳性率场景。系统将网络与计算负载显著降低,在摩拉维亚图书馆 400 万张图像测试中发现约 1500 页乐谱,假阳性率为 0.015%,并估计全馆仍有 2–3 万页相关材料可挖掘。

World Narrative Model for Highly Controllable Video Generation: A Paradigm Shift from Pixel Sampling to Physical World Orchestration Figure 1
2026-07-01cs.CV

World Narrative Model for Highly Controllable Video Generation: A Paradigm Shift from Pixel Sampling to Physical World Orchestration

Ye Chen, Xuanhong Chen, Yupeng Zhu, Liming Tan, Zhewen Wan, Yuxuan Xiong, Tielong Wang, Jinfan Liu, Wuze Zhang, Xiongzhen Zhang, Feifei Li, Xianglin Luo, Zhehan Zhao, Zhifan Zhang, Laisheng Kou, Zhujing Liang, Yugang Chen, Muchun Chen, Xu Miao, Yijing Zhang, Xiaojie Sheng, Qiang Hu, Jialiang Chen, Weimin Zhang, Wenjun Zhang, Bingbing Ni

2026-07-01视觉感知强化学习规划控制

论文针对视频生成在专业制作中难以精确控制几何、动作、镜头和光照、反复抽卡成本高的问题,提出 World Narrative Model:先由协同智能体把文本、参考视频等转成可编辑的 3D+T 物理叙事蓝图,再驱动冻结或轻量适配的视频模型渲染。实验称该范式能显著减少随机试错,使空间布局、角色运动和摄影更贴合创作者意图,但具体增益来源仍需更多独立验证。

FlexViT: A Flexible FPGA-based Accelerator for Edge Vision Transformers Figure 1
2026-07-01cs.AR

FlexViT: A Flexible FPGA-based Accelerator for Edge Vision Transformers

Hubert Dymarkowski, Xingjian Fu, Rappy Saha, Jude Haris, José Cano

School of Computing Science, University of Glasgow, Scotland, UK

2026-07-01视觉感知

面向边缘设备部署标准与混合 ViT 时,FC/卷积混合、张量形状变化大和 FPGA 资源受限会削弱固定加速器效率。FlexViT 将 FC 与卷积经运行时 im2col 统一映射到 INT8 GEMM 引擎,并用可重构双模式数据流和深度优先分块减少片外部分和传输。在 PYNQ-Z2 上,其卸载层加速 1.77–2.74 倍,端到端最高较 CPU 提升 1.40 倍。

No Place to Hide: Benchmarking Video Hallucination with Background-Controlled Pairs Figure 1
2026-07-01cs.CV

No Place to Hide: Benchmarking Video Hallucination with Background-Controlled Pairs

Haojian Huang, Harold Haodong Chen, Meng Luo, Junjia Du, Shanqing Xu, Ziheng Chen, Yanxiang Huang, Yinchuan Li, Ying-Cong Chen

The Hong Kong University of Science and Technology (Guangzhou), Guangzhou, China, The Hong Kong Polytechnic University, Hong Kong SAR, China, National University of Singapore, Singapore, Nanyang Technological University, Singapore, Huazhong University of Science and Technology, Wuhan, China, University of Illinois Urbana-Champaign, Urbana, IL, United States, code and data are available at the project page., is labor-intensive, as fixed storylines and spatio-temporal dependencies require

2026-07-01视觉感知规划控制数据集/基准

针对现有视频幻觉评测常把语言诱导、背景变化与前景语义混在一起的问题,本文提出 PairFlow,用生成式流程构造背景高度一致、前景语义相反的视频对,并发布 VidPair-Halluc,含 1K 对视频和 11K 个时空问答,覆盖 10 类语义。实验显示主流大视频模型及现有缓解方法在这种受控细粒度设置下仍明显不稳,说明错误更可能来自真实视觉 grounding 不足。

InstanceControl: Controllable Complex Image Generation without Instance Labeling Figure 1
2026-07-01cs.CV

InstanceControl: Controllable Complex Image Generation without Instance Labeling

Xiaoyu Liu, Huan Wang, Fan Li, Zhixin Wang, Jiaqi Xu, Ming Liu, Wangmeng Zuo

2026-07-01视觉感知规划控制

本文针对 ControlNet 类方法在复杂多实例场景中容易把属性分配到错误对象、而现有改进依赖人工实例标注的问题,提出 InstanceControl。其核心洞察是失败主要来自文本实例与视觉条件区域无法自动对齐,因此引入 VLM 解析实例描述并预测对应掩码,再在生成过程中用自适应掩码细化修正噪声。实验在边缘、深度、HED 等条件上优于 FLUX ControlNet 及多种需标注方法,显示更好的实例级保真与控制精度。

MVP-Nav: Multi-layer Value Map Planner Navigator Figure 1
2026-07-01cs.RO

MVP-Nav: Multi-layer Value Map Planner Navigator

Wenyuan Xie, Shaokai Wu, Yijin Zhou, Yanbiao Ji, Guodong Zhang, Bayram Bayramli, Qiuchang Li, Xunchu Zhou, Yue Ding, Hongtao Lu

Shanghai Jiao Tong University

2026-07-01视觉感知

MVP-Nav面向无深度传感器的零样本目标导航,针对RGB-only方法容易语义可行但物理不安全的问题,利用3D基础模型把2D语义实例重投影为3D有向包围盒,并以全局空间语义列表和多层价值图统一语义优先级与几何占据约束。实验称其在零样本ObjectNav基准上显著优于现有depth-free方法,说明结构化物理先验可部分弥补缺失深度信息。

DriveWeaver: Point-Conditioned Video Inpainting for Controllable Vehicle Insertion in Autonomous Driving Simulation Figure 1
2026-07-01cs.CV

DriveWeaver: Point-Conditioned Video Inpainting for Controllable Vehicle Insertion in Autonomous Driving Simulation

Junzhe Jiang, Zipei Ma, Zijie Pan, Li Zhang

2026-07-01视觉感知规划控制

面向自动驾驶仿真中构造长尾风险场景,DriveWeaver针对传统插入车辆依赖3D资产、易出现光照风格不一致且难规模化的问题,将车辆插入改写为点云条件视频修复:用点云渲染提供几何约束,并通过全局到局部层级生成保持长时身份一致,再蒸馏为3D Gaussian以支持实时渲染。实验在Waymo和PandaSet上显示其相较基线提升视觉真实感与几何一致性。

Attend, Transform, or Silence: Operator-Level Visual Skipping for Efficient Multimodal LLM Inference Figure 1
2026-07-01cs.CV

Attend, Transform, or Silence: Operator-Level Visual Skipping for Efficient Multimodal LLM Inference

Zhaoyang Luo, Runmin Dong, Miao Yang, Fan Wei, Yushan Lai, Bin Luo, Haohuan Fu

Tsinghua Shenzhen International Graduate School, Shenzhen, China, Sun Yat-sen University, Zhuhai, China, National Supercomputing Center in Shenzhen, Shenzhen, China, Tsinghua University, Beijing, China

2026-07-01视觉语言

针对多模态大模型高分辨率视觉 token 使推理预填充开销上升的问题,论文指出后层视觉状态虽仍大幅更新,却常难以影响答案表征,存在“答案静默”冗余;据此将层内 attention 与 FFN 分开评估并按算子跳过冗余视觉计算,同时保留完整视觉序列。三类 MLLM、10 个 VQA 基准上,Qwen3-VL 可降 33.7% TFLOPs,保持约 99.5% 原模型性能。

RESOLVE: A Multi-Resolution and Multi-Modal Dataset for Roadside Cooperative Perception Figure 1
2026-07-01cs.CV

RESOLVE: A Multi-Resolution and Multi-Modal Dataset for Roadside Cooperative Perception

Shaozu Ding, Linan Song, Marco De Vincenzi, Dajiang Suo

2026-07-01数据集/基准

面向路侧协同感知中 LiDAR 分辨率、距离导致点云稀疏且现有数据集难以隔离评估的问题,RESOLVE 提供真实路口同步相机与三档分辨率 LiDAR 数据、22 万个 3D 标注及检测/跟踪基准。其核心价值在于控制环境变量比较单模态与融合模型,实验显示相机-LiDAR 融合可在低分辨率或远距离稀疏点云下部分补偿性能下降,但场景仍限于单一路口。

Harnessing Textual Refusal Directions for Multimodal Safety Figure 1
2026-07-01cs.AI

Harnessing Textual Refusal Directions for Multimodal Safety

Moreno D'Incà, Massimiliano Mancini, Nicu Sebe

University of Trento

2026-07-01视觉语言安全鲁棒

针对多模态大模型难以收集不安全图像/视频数据、主要依赖语言骨干安全性的瓶颈,本文发现文本拒答方向可跨模态迁移,但受层选择、强度和模态错位影响;提出免训练的 MARS,通过激活重居中、信任域内自适应 steering 与层选择增强拒答。五个模型和多类安全、效用、视频 jailbreak 基准上,MARS 在保持效用的同时稳定提升安全性,如 Qwen3-VL 视频拒答率提升 59.4%。

SENSE-VAD: Sentient and Semantic Video Anomaly Detection for Autonomous Driving Figure 1
2026-07-01cs.CV

SENSE-VAD: Sentient and Semantic Video Anomaly Detection for Autonomous Driving

Nghia T. Nguyen, Lokman Bekit, Yasin Yilmaz

University of South Florida, tated with per-frame binary labels. A key design principle, publicly available.1, with a child near an elementary school [36]. The pattern, labels, yielding 108 annotated clips in total (Table 4)., mark with per-frame labels, built across three CARLA, supervised methods exploit video-level anomaly labels un-, vised methods derive pseudo-labels from feature statistics, is a surveillance dataset recorded at a university crosswalk, error, or crime-category labels rather than social context.

2026-07-01视觉感知

面向自动驾驶中“危险来自社会关系而非运动异常”的长尾场景,SENSE-VAD构建了首个以社会复杂异常为核心的合成VAD基准:用CARLA/UE生成15类、6大类、54万帧逐帧标注视频,并加入真实片段检验迁移。对11种现有方法的评测显示最高帧级AUC仅57.2%,说明依赖轨迹、外观或通用VLM推理的检测器仍难识别这类关系型风险。

Towards Voxel Spacing Consistency for Medical Image Segmentation Figure 1
2026-07-01cs.CV

Towards Voxel Spacing Consistency for Medical Image Segmentation

Xin You, Runze Yang, Minghui Zhang, Hanxiao Zhang, Han Li, Yi Yu, Jie Yang, Nassir Navab, Yun Gu

Park Oriental Huaxia Cardiovascular Health Research Institute (GUSU2023002). (Corresponding authors: Yun Gu, Yi Yu.)X. You, R. Yang, M. Zhang, H. Zhang, J. Yang and Y. Gu are with the Institute of Medical Robotics, Shanghai Jiao Tong University

2026-07-01视觉感知

论文关注医学体数据分割中常被当作预处理细节的轴向体素间距不一致问题,指出线性重采样难以处理层间形变和语义边界。作者提出 Consispace,将 ODE 层间连续插值、预训练视觉特征构建的层内语义相关性与 INR 任意尺度重采样结合,使重采样更贴合解剖与类别结构。多数据集实验显示其重建质量、层间平滑性和作为 nnU-Net、Swin UNETR、MedSAM-2 预处理时的分割表现均优于标准线性插值。

Real-Time Source-Free Object Detection Figure 1
2026-07-01cs.CV

Real-Time Source-Free Object Detection

Sairam VCR, Varun Gopal, Poornima Jain, Vineeth N Balasubramanian, Muhammad Haris Khan

2026-07-01视觉感知

面向自动驾驶、监控和机器人等实时场景,论文指出现有无源域目标检测多依赖重型检测器,难以兼顾延迟和模型大小。作者基于 YOLOv10 提出 RT-SFOD,用双头伪标签融合提升召回并抑制噪声,用多尺度表示多样化缓解域偏移下特征退化;模块仅训练时使用。实验称在多域偏移基准上较前沿方法提升 1.4–3.5% mAP,吞吐约高 1.3 倍、参数约少一半。

PriorEye: Geospatial Visual Priors for End-to-End Autonomous Driving Figure 1
2026-07-01cs.CV

PriorEye: Geospatial Visual Priors for End-to-End Autonomous Driving

Kyuhwan Yeon, Benjamin Ramtoula, Daniele De Martini

Mobile Robotics Group, University of Oxford, United Kingdom, selves become unreliable. Our project page is available at https://ori-, due to its scalability and conceptual simplicity, directly mapping raw sensor ob-

2026-07-01视觉感知

这篇论文针对端到端自动驾驶过度依赖瞬时车载感知、缺乏类似人类驾驶记忆的前瞻性这一问题,提出将沿规划路线离线采集的街景视觉嵌入作为地理空间视觉先验,并通过双记忆与自适应门控模块注入现有规划器,在先验错配时可回退。NAVSIM-v2结果显示,该方法能稳定提升多种端到端基线,并在传感器退化场景下增强鲁棒性。

Breaking Failure Cascades: Step-Aware Reinforcement Learning for Medical Multimodal Reasoning Figure 1
2026-07-01cs.CV

Breaking Failure Cascades: Step-Aware Reinforcement Learning for Medical Multimodal Reasoning

Junha Jung, Minbyul Jeong, Suhyeon Lim, Sungwook Jung, Jaehoon Yun, Taeyun Roh, Mujeen Sung, Jaewoo Kang

Korea University, Kyung Hee University, Hanyang University College of Medicine

2026-07-01视觉语言强化学习

本文针对医疗多模态 VQA 中只按最终答案给奖励导致的稀疏信用分配问题,指出早期推理错误会持续放大并造成失败级联。作者提出 MRPO,在 GRPO 框架中引入逐步推理奖励,并对最终答错样本的更早无效步骤施加指数级更强惩罚。实验显示其在三个 MLLM 骨干上优于 GRPO 和 GDPO,Qwen3-VL-8B 还超过 HuatuoGPT-Vision-34B 2.79 分,早期失败率从 64.0% 降至 13.0%。

Absorption-Feature-Guided Distance-Decoupled Estimation and Band Selection for LWIR Hyperspectral Passive Ranging Figure 1
2026-07-01cs.CV

Absorption-Feature-Guided Distance-Decoupled Estimation and Band Selection for LWIR Hyperspectral Passive Ranging

Shuo Liu, Chen Fan, Zhihe Chen, Xiaolin Huang, Lilian Zhang

2026-07-01视觉感知

针对长波红外高光谱被动测距中距离吸收特征与温度、发射率、路径辐射强耦合且全波段联合优化昂贵的问题,论文提出ADER:用B样条平滑发射率抑制对尖锐大气吸收的过拟合,并按臭氧吸收线索区分发射/反射主导像素,再结合面向距离Fisher信息的贪心选带。真实场景中其全波段和20波段结果均与LiDAR结构一致,较公开全波段方法精度更好且约快两个数量级。

Generative Lane Topology Reasoning via Autoregressive Model with Geometry Prior Figure 1
2026-07-01cs.CV

Generative Lane Topology Reasoning via Autoregressive Model with Geometry Prior

Jiahui Fu, Zehao Huang, Han Li, Naiyan Wang, Si Liu

2026-07-01生成模型

本文针对车道拓扑推理中“先检测再关联”导致的端点不一致和遮挡下漏检问题,提出 TopoGPT:将车道图序列化为离散 token,用 330 万地图场景预训练自回归模型学习道路几何先验,再通过感知适配器迁移到多视角图像 BEV 特征。OpenLane-V2 上相较既有方法车道级平均提升 6.4、点级平均提升 11.6,生成的车道图更连续完整,但自回归解码带来延迟和误差累积风险。

MuSViT: A Foundation Vision Model for Sheet Music Representation Figure 1
2026-07-01cs.CV

MuSViT: A Foundation Vision Model for Sheet Music Representation

Carlos Penarrubia, Antonio Rios-Vila, Eliseo Fuentes-Martinez, Juan C. Martinez-Sevilla, Francisco J. Castellanos, María Alfaro-Contreras, Jorge Calvo-Zaragoza

2026-07-01视觉感知

针对海量乐谱仍停留在图像、传统 OMR 难以跨版式和噪声泛化的问题,MuSViT 将乐谱视为具有符号结构的专门视觉域,用 970 万页 IMSLP 乐谱通过 MAE 和“合成预热到真实数据”的课程训练 ViT。结果显示,其冻结特征优于通用视觉编码器,微调后在四类乐谱识别、检测和难度分类任务上总体达到或超过专门方法,并且嵌入空间更贴近音乐转写内容。

Self-Supervised Temporal Regularization for Landmark-Based Cardiac Segmentation with Automatic AHA Regional Mapping Figure 1
2026-07-01cs.CV

Self-Supervised Temporal Regularization for Landmark-Based Cardiac Segmentation with Automatic AHA Regional Mapping

David Montalvo-García, Nicolás Gaggion, María J. Ledesma-Carbayo, Enzo Ferrante

2026-07-01视觉感知

这篇论文针对基于 landmark 的心脏超声分割逐帧处理导致的边界抖动和运动不连续问题,在已学习解剖对应关系的图模型上加入后训练自监督时间正则,通过惩罚相邻帧速度与加速度突变提升时序一致性,并利用 landmark 自动映射到 AHA 17 分区。CAMUS 验证显示该组合可支持更稳定的分割、运动估计和区域性异常分析,但具体定量增益幅度文中片段未充分说明。

SpikeLogBERT: Energy-Efficient Log Parsing Using Spiking Transformer Networks Figure 1
2026-07-01cs.CV

SpikeLogBERT: Energy-Efficient Log Parsing Using Spiking Transformer Networks

Thuan Bui, Duong Do, Tung Vu, Duc-Tho Mai, Cong-Kha Pham

Swinburne Vietnam, FPT University, Posts and Telecommunications Institute of Technology, Academy of Cryptography Techniques, The University of Electro-Communications

2026-07-01视觉感知

该文针对持续日志解析中神经模型计算与能耗偏高的问题,提出用脉冲 Transformer 结合 BERT 教师蒸馏来保留日志语义表示,同时利用稀疏脉冲降低推理操作量。实验仅在 HDFS 日志集上报告,SpikeLogBERT 达到 99.997% 解析准确率,理论 45nm CMOS 能耗约 0.82 mJ,相比 ANN 基线最高低 62.6 倍;但评估范围较窄,实际硬件增益仍需进一步验证。

Mesh BDF: Barycentric Dominance Field for 3D Native Mesh Generation Figure 1
2026-07-01cs.CV

Mesh BDF: Barycentric Dominance Field for 3D Native Mesh Generation

Gaochao Song, Haohan Weng, Luo Zhang, Zibo Zhao, Shenghua Gao

HKU, 2 Shenzhen Loop Area Institute, 3 Tencent Hunyuan 3D, 4 NTU

2026-07-01三维

这篇论文针对自回归原生网格生成受序列长度、顶点量化和材质属性支持限制的问题,提出将三角面片上的最大重心坐标定义为 Barycentric Dominance Field,把离散拓扑转成类似纹理的连续表面信号,从而可直接接入现有 3D VAE/扩散框架并与 PBR 纹理统一生成。实验称其相比自回归方法在网格质量、可扩展性和鲁棒性上更好,但具体增益中 scaling / data 的贡献仍需进一步辨析。

NURBS Splatting: A Unified Differentiable Rendering Framework for Vector Graphics Figure 1
2026-07-01cs.GR

NURBS Splatting: A Unified Differentiable Rendering Framework for Vector Graphics

Jingye Qiu, Shizhe Zhou

2026-07-01视觉感知

这篇论文针对现有可微矢量渲染多局限于 Bézier/B 样条、难以支持 CAD 中常用 NURBS 及其有理权重和非均匀节点的问题,提出将 NURBS 曲线与闭合区域表示为连续高斯场,并用 splatting 实现稳定可微渲染。实验显示其在书法重建、emoji 矢量化和长样条抽象中优于 DiffVG/LIVE 等基线,重建质量更高且通常更快,但区域填充策略仍偏启发式。

Estimating Velocity of Spheres from Rolling-Shutter Image(s) Figure 1
2026-07-01cs.CV

Estimating Velocity of Spheres from Rolling-Shutter Image(s)

Wenjie Xue, Jun Yang, Jingmin Wang, Limin Shang

2026-07-01视觉感知

这篇论文针对高速球体速度与旋转估计依赖高速全局快门、事件相机或雷达的问题,反过来把普通滚动快门相机的畸变当作时间线索。核心做法是将图像特征反投影为3D射线,并利用球体几何把平移和角速度解耦为两阶段优化,减少对显式2D-3D对应和纹理的依赖。实验覆盖仿真与真实高尔夫发射监测原型,显示在高速条件下可较稳定地恢复运动参数。

JL1-CC&QA: Extending the JL1-CD Benchmark with Change Captioning and Question Answering Figure 1
2026-07-01cs.CV

JL1-CC&QA: Extending the JL1-CD Benchmark with Change Captioning and Question Answering

Ziyuan Liu, Ruifei Zhu, Ouqiao Ma, Yuantao Gu

Ruifei Zhu is with Chang Guang Satellite Technology Co., Ltd. (CGSTL), Ouqiao Ma is with the College of Communications, Engineering, Army Engineering University of PLA, Nanjing 210007

2026-07-01视觉语言数据集/基准

这篇论文针对遥感变化检测只给出像素级“哪里变了”、缺少“变成什么/为何变化”的语义缺口,将 JL1-CD 扩展为统一包含二值变化掩码、变化描述和变化问答的多任务基准。核心创新在于用多模态 LLM 生成、视觉证据判别与专家复核构建 17,021 条 caption 和 20,060 个八类 QA。主要结果是发布覆盖 5,000 对吉林一号双时相影像的 JL1-CC&QA 数据集;模型增益未充分说明,贡献主要来自数据与标注体系。

Rhythm-Structured Predictive Learning for Remote Photoplethysmography Figure 1
2026-07-01cs.CV

Rhythm-Structured Predictive Learning for Remote Photoplethysmography

Ba-Thinh Nguyen, Huu-Dung Nguyen, Thi-Duyen Ngo, Thanh-Ha Le

VNU University of Engineering and Technology, Hanoi, Vietnam

2026-07-01视觉感知

本文针对自监督 rPPG 容易学到人脸外观、Mamba 时序建模只按时间扫描而忽略脉搏准周期结构的问题,提出 RhythmJEPA:用联合嵌入预测替代像素重建,并通过 CRSP 解码潜在生理相位、DOM 同时按时间与节律状态扫描,配合轻量 SPM 提取脉搏敏感 token。在 PURE、UBFC-rPPG、MMPD 上取得相对代表方法有竞争力的结果,但具体增益幅度和来源需结合完整实验表进一步判断。

MemLearner: Learning to Query Context memory for Video World Models Figure 1
2026-07-01cs.CV

MemLearner: Learning to Query Context memory for Video World Models

Jiwen Yu, Jianxiong Gao, Jianhong Bai, Yiran Qin, Kaiyi Huang, Quande Liu, Xintao Wang, Pengfei Wan, Kun Gai, Xihui Liu

2026-07-01视觉感知强化学习

MemLearner针对视频世界模型长时生成中因上下文窗口有限导致的场景遗忘与不一致问题,指出基于视场重叠或点云匹配的规则检索难以处理遮挡和动态物体。其核心是引入查询 token,让生成模型自身在上下文、查询与预测 token 间学习自适应取用历史记忆,并结合含遮挡/动态物体的渲染数据与真实视频联合训练。实验显示其在场景一致性和记忆能力上优于既有方法,尤其在复杂遮挡和动态场景中更明显。

UniCoder: Unified Visual-to-Code Generation via Symbolic Rewards and Reference-Guided Code Optimization Figure 1
2026-07-01cs.CV

UniCoder: Unified Visual-to-Code Generation via Symbolic Rewards and Reference-Guided Code Optimization

Yaozhi Zheng, Yilei Jiang, Manyuan Zhang, Yuxuan Wan, Kaituo Feng, Tianshuo Peng, Bo Zhang, Xiangyu Yue

The Chinese University of Hong Kong, Shanghai Artificial Intelligence Laboratory

2026-07-01强化学习优化算法

UniCoder针对视觉到代码任务中SFT难以实现像素级对齐、RL奖励过粗且探索易停滞的问题,提出统一强化学习框架:用辅助LLM解析代码中的颜色、坐标等符号属性以构造细粒度奖励,并在低表现rollout中注入参考代码引导优化。实验覆盖图表、SVG、网页和屏幕基准,8B模型超过开源基线并接近闭源模型,但具体增益在多大程度来自数据或训练规模仍需进一步拆分说明。

Semantic-Aware Multiple Access via Spatial Redundancy Exploitation for Uplink-Dominant 6G Use Cases Figure 1
2026-07-01cs.NI

Semantic-Aware Multiple Access via Spatial Redundancy Exploitation for Uplink-Dominant 6G Use Cases

Hamidreza Mazandarani, Masoud Shokrnezhad, Tarik Taleb, Onur Günlü

2026-07-01视觉感知

面向车联网等上行占优的 6G 视觉业务,论文指出现有语义通信多按用户独立选取内容,忽略相邻车辆视野重叠带来的跨用户冗余。其核心做法是把多址接入改写为感知与传输联合控制:车辆先经 V2V 交换部分图像块估计空间冗余,再只向基站上传语义重要且非冗余的块,并借助邻车视角重建。仿真显示,在密集城市场景中,高保真重建用户比例提升,但具体绝对增益和重建模型细节仍文中未充分说明。

WIDER-FAIR: An Annotated Version of the WIDER-FACE Dataset for Fairness Evaluation Figure 1
2026-07-01cs.CV

WIDER-FAIR: An Annotated Version of the WIDER-FACE Dataset for Fairness Evaluation

Maxime Moussi, Benoît Ronval, Siegfried Nijssen, Félicien Schiltz

2026-07-01数据集/基准

面向人脸检测落地中的群体公平性评估,论文指出现有基准缺少敏感属性标注,因而在 WIDER-FACE 子集上人工补充感知族裔与性别标签,形成 WIDER-FAIR。作者用嵌入、KNN 与 t-SNE 检查标注一致性,并以 YOLOv5 做消融,发现黑人面孔检测性能更低,且移除该群体训练会带来最大的公平性差距。

Phantom: A Unified Face-Swap Deepfake Protection Framework with Latent and Spatial Constraints Figure 1
2026-07-01cs.CV

Phantom: A Unified Face-Swap Deepfake Protection Framework with Latent and Spatial Constraints

Jungkon Kim, Cheolseung Jung, Jong-Min Choi, Juseong Lee

Samsung Electronics, AI Platform Center

2026-07-01优化算法

本文针对换脸深伪中未经授权的身份操纵,指出现有对抗保护常用固定/随机目标且扰动覆盖过广,难以在换脸模型的身份—风格解耦下保留有效信号。Phantom通过自适应合成“身份偏移但属性保持”的目标来约束潜空间方向,并用语义人脸掩码限制扰动区域。实验显示其在UniFace、INSwapper、SimSwap的dodging保护成功率分别提升27.8%、25.6%、16.6%,最高达98.2%,同时改善感知质量。

Look But Don't Touch with Sparse Autoencoders for Unlearning in Diffusion Models Figure 1
2026-07-01cs.CV

Look But Don't Touch with Sparse Autoencoders for Unlearning in Diffusion Models

Enrico Cassano, Riccardo Renzulli, Rayyan Ahmed, Marco Grangetto, Stephan Alaniz

2026-07-01生成模型

本文针对扩散模型概念遗忘中 SAE 可解释但直接操控易失真的问题,指出稀疏/单义特征更适合作为检测器而非控制旋钮。作者提出 PER:用 SAE 定位含目标概念的图像区域,再以同一特征图中的无概念 patch embedding 替换,保持激活分布。结果在 UnlearnCanvas 对象遗忘平均达 95.33%,较 SAE 类 SOTA 提升 3.82%,并减少伪影与调参成本。

Intrinsically Stable Spiking Neural Networks: Overcoming the Performance Barrier in the Absence of Batch Normalization Figure 1
2026-07-01cs.CV

Intrinsically Stable Spiking Neural Networks: Overcoming the Performance Barrier in the Absence of Batch Normalization

Ruichen Ma, Xiaoyang Zhang, Jian Bai, Guanchao Qiao, Liwei Meng, Ning Ning, Yang Liu, Shaogang Hu

University of Electronic Science and Technology of China (UESTC) Beijing Institute of Remote-Sensing Equipment Shenzhen Institute for Advanced Study, UESTC

2026-07-01视觉感知

这篇论文针对深层脉冲神经网络依赖动态批归一化、从而削弱神经形态硬件加法式推理优势的问题,指出无归一化训练失败的关键在于灾难性发放率衰减。作者提出 IS-SNN,用拓扑感知权重标准化和改造残差连接维持信号稳态,并将标准化离线折叠进静态权重。实验显示其在 VGG、ResNet 和 Transformer SNN 上接近或超过动态 BN,ImageNet 达 68.05%,且 FPGA 神经元 LUT 消耗降低 96.4%。

RCT: A Robot-Collected Touch-Vision-Language Dataset for Tactile Generalization Figure 1
2026-07-01cs.RO

RCT: A Robot-Collected Touch-Vision-Language Dataset for Tactile Generalization

Jingbo He, Michael Färber, Roberto Calandra

LASR Lab, TU Dresden, Project page: https://faerber-lab.github.io/RCT/, Code: https://github.com/faerber-lab/RCT

2026-07-01机器人视觉语言视觉感知学习理论数据集/基准

面向机器人在开放环境中触摸未见材料时的泛化问题,论文提出RCT触觉-视觉-语言数据集,保留完整机器人按压接触序列而非打散帧,并据此揭示随机帧划分会引入近重复泄漏。实验显示去除接触序列重叠使触觉到文本Recall@1下降17.7个百分点,进一步留出材料后仅为25.1±6.1%,说明新材料触觉泛化仍是关键瓶颈。

Semantic Occupancy Prediction with Dual Range-Voxel Representation Figure 1
2026-07-01cs.CV

Semantic Occupancy Prediction with Dual Range-Voxel Representation

Sitao Chen, Zhuangwei Zhuang, Hui Luo, Lizhao Liu, Qingyao Wu, Mingkui Tan

2026-07-01视觉感知

这篇论文针对激光雷达语义占据预测依赖多帧点云带来的计算开销和位姿噪声问题,提出用单帧点云同时构建 range-view 的紧凑上下文与 voxel-view 的几何结构,并通过双向 range-voxel 融合互补语义和空间信息。在 nuScenes-Occupancy、SemanticKITTI、SemanticPOSS 上验证有效,尤其单帧方法相较多帧基线在 nuScenes 上 mIoU 提升 5.4%,速度提升 2.1 倍。

Histogram-constrained Image Generation Figure 1
2026-07-01cs.CV

Histogram-constrained Image Generation

Haoming Liu, Yuanhe Guo, Yijia Cao, Shenji Wan, Hongyi Wen

2026-07-01视觉感知

这篇论文针对扩散生成中“文本控制过粗、ControlNet 等结构控制过细”的空档,提出 HIG:在采样过程中用最优传输把中间图像精确匹配到用户指定的颜色或潜变量直方图。方法无需训练、可与现有控制模块组合,实验展示了精确颜色分布控制、潜变量直方图约束和高容量信息嵌入,同时保持较好视觉质量;但信息隐藏也带来潜在滥用风险。

ShellMaker: Language-Guided Exterior Completion under Structural Constraints Figure 1
2026-07-01cs.CV

ShellMaker: Language-Guided Exterior Completion under Structural Constraints

Ruiqi Xu, Daniel Aliaga

2026-07-01优化算法

ShellMaker瞄准室内生成器只产出墙体与开口、缺少可用建筑外立面的断点,强调外观生成必须严格保持足迹、墙边界和门窗语义。其核心做法是把脚手架约束、参数化屋顶、LLM部件级提示、墙顶材质联合检索与几何感知装配串联起来,在不改动结构的前提下补全带PBR材质的外立面。实验覆盖200多个脚手架、500多种纹理和60个风格提示,相比检索式和无约束生成基线提升了建筑一致性、材质协调性与约束满足度。

Practical High-Fidelity Novel-View Synthesis of Mounted Lepidoptera Figure 1
2026-07-01cs.GR

Practical High-Fidelity Novel-View Synthesis of Mounted Lepidoptera

Kristof Overdulve, Lode Jorissen, Nick Michiels

Digital Future Lab, Flanders Make, Hasselt University

2026-07-01视觉感知

针对钉装蝴蝶等脆弱标本难以在微距浅景深下拍清细节、且无法直接拍摄腹面的数字化难题,论文提出结合手持焦点堆叠、非接触一表面镜采集和免分割镜面感知 3D Gaussian Splatting 的端到端流程。其核心洞察是先获得全清晰多视图并用点云对称性估计镜面,再统一重建真实与镜中腹面;在四个标本上得到可全方位浏览的照片级模型,并显示焦点堆叠优于直接用景深感知 3DGS 处理严重离焦输入。

REDI: Corpus Aware Patch Ranking for DINOv3 Token Reduction Figure 1
2026-07-01cs.CV

REDI: Corpus Aware Patch Ranking for DINOv3 Token Reduction

Chanjong Im, Sebastian Diem, Thomas Mandl

University of Magdeburg, University of Hildesheim

2026-07-01视觉感知

这篇论文针对 ViT token 裁剪中“固定预算该保留哪些 patch”的问题,把 DINOv3 最终层 patch 聚类成视觉词,并用类别条件 TF-IDF 与图像自身注意力相乘来排序,再通过保留、合并、压缩分配 token。实验在 ImageNet-1K 上将序列从 201 降到 107,Top-1 达 84.706%,高于 dense 基线 83.514% 和单独注意力/TF-IDF;但方法依赖真值类别和 dense attention,更像离线监督参考而非直接部署方案。

WorldRoamBench: An Open-World Benchmark for Long-Horizon Stability of Interactive World Models Figure 1
2026-07-01cs.CV

WorldRoamBench: An Open-World Benchmark for Long-Horizon Stability of Interactive World Models

Ting-Bing Xu, Jiacheng Sui, Zhe Gao, Kewei Shi, Wenjin Yang, Zhicheng Liu, Zhaoxu Sun, Mingchao Sun, Hongyu Pan, Fan Jiang, Mu Xu, Qi Fan, Yong Li, Baoquan Chen

AMAP CV Lab, Alibaba Group, Nanjing University, Tsinghua University, Peking University

2026-07-01强化学习数据集/基准

WorldRoamBench针对交互式世界模型在长时间开放探索中易出现动作漂移、画面退化、物理违背和重访失忆的问题,提出覆盖动作、视觉、物理、记忆四维的基准:用逐帧按键指标、分段漂移、可控性门控物理评估和轨迹解耦记忆测试揭示短片段/轨迹级评测的盲区。600+用例、10余个开闭源模型结果显示暂无模型能稳定兼顾各维度,即使最佳模型也仅达中等水平。

SAMBA: A Scatter-Guided Masked Bidirectional Mamba Foundation Model for SAR Target Recognition Figure 1
2026-07-01cs.CV

SAMBA: A Scatter-Guided Masked Bidirectional Mamba Foundation Model for SAR Target Recognition

Ke Wang, Xiaoyi Pan, Zhaoyu Gu, Xiaofeng Ai, Zhiming Xu, Feng Zhao, Shunping Xiao

2026-07-01视觉感知

这篇论文针对 SAR 目标识别中标注稀缺、Transformer 预训练计算开销高且通用遮罩忽视电磁散射先验的问题,提出 SAMBA:用线性复杂度双向 Mamba 编码器、散射引导的层级 MAE 遮罩和 SpatialMix 融合模块进行自监督预训练。实验称其在七个分类与检测数据集上多数指标达到 SOTA,并以更少参数提升少样本迁移能力。

Sparsity-Inducing Divergence Losses for Biometric Verification Figure 1
2026-07-01cs.CV

Sparsity-Inducing Divergence Losses for Biometric Verification

Dimitrios Koutsianos, Ladislav Mošner, Yannis Panagakis, Themos Stafylakis

2026-07-01视觉感知

本文针对 CosFace、ArcFace 等几何 margin 难以自然扩展到 α-divergence 稀疏概率框架的问题,提出 Q-Margin:不再改 logits,而是通过下调目标类参考测度来引入概率化 margin,并在 α→1 时退化为 CosFace。实验在 IJB-B/IJB-C、VoxCeleb 上显示其相对 ArcFace/CosFace 在低 FAR 场景更稳,且稀疏后验有助于大规模身份训练的精确与省内存计算。

DynFly: Dynamic-Aware Continuous Trajectory Generation for UAV Vision-Language Navigation in Urban Environments Figure 1
2026-07-01cs.RO

DynFly: Dynamic-Aware Continuous Trajectory Generation for UAV Vision-Language Navigation in Urban Environments

Wen Jiang, Hanfang Liang, Li Wang, Kangyao Huang, Wang Xu, Wei Fan, Jinyuan Liu, Shaoyu Liu, Hongwei Duan, Bin Xu, Xiangyang Ji, Huaping Liu

2026-07-01机器人视觉语言视觉感知规划控制

DynFly关注UAV视觉语言导航中“语义决策到可执行飞行”之间的运动接口缺口:现有方法多输出离散动作或稀疏航点,难以保证轨迹连续性与动力学可跟踪性。其核心是在保留原VLN推理管线的基础上,用B样条控制点表示轨迹,并以Spline-DiT和flow matching生成连续3D轨迹,同时加入速度、加速度、朝向和目标对齐监督。OpenUAV实验显示其同时提升导航指标和轨迹质量,在Test Unseen Full上较强基线提高NDTW 4.69、SDTW 2.40、SR 2.14点,并降低NE 4.51米。

Technical Report of RoboSpatial Challenge at CVPR 2026: Selective Reasoning Activation and Reference-Frame Disambiguation for Embodied Spatial Reasoning Figure 1
2026-07-01cs.CV

Technical Report of RoboSpatial Challenge at CVPR 2026: Selective Reasoning Activation and Reference-Frame Disambiguation for Embodied Spatial Reasoning

Yuxiang Xie, Qi Lv, Jianming Xing, Zijian Hong, Xiang Deng, Weili Guan, Liqiang Nie

Harbin Institute of Technology, Shenzhen, 2 Ruoyu Technology

2026-07-01视觉感知

本文针对具身任务中视觉语言模型空间推理不足、且常混淆相机中心与物体中心参照系的问题,提出 RoboSpatialBrain:按任务选择性触发 <think> 与后置提示,仅用于需要推理的空位与尺寸兼容判断,并用显式参照系重定向处理方向歧义。实验显示该策略在 RoboSpatial-Home 上取得 80.9% 总成功率并获挑战第一,其中兼容任务由 40.0% 提升到 83.8%;微调虽在弱提示下有益,但与最佳提示组合叠加反而下降。

LiteMatch: Lightweight Zero-Shot Stereo Matching via Cost Volume Stabilization Figure 1
2026-07-01cs.CV

LiteMatch: Lightweight Zero-Shot Stereo Matching via Cost Volume Stabilization

Md Raqib Khan, Santosh Kumar Vipparthi, Subrahmanyam Murala

CVPR Lab, Trinity College Dublin, The University of Dublin, Dublin, Ireland CVPR Lab, Indian Institute of Technology Ropar, Rupnagar, Punjab, India

2026-07-01视觉感知

LiteMatch针对立体匹配中早期特征匹配和代价体不稳定导致依赖重型3D卷积、迭代细化或大模型先验的问题,主张从源头稳定代价分布。方法结合跨视图对应编码器与FFT高频编码器,并用CVC-Loss约束视差概率更尖锐单峰,再配轻量细化模块。实验显示其在3.36M至9.58M参数下,在Scene Flow、KITTI、Middlebury、ETH3D和DrivingStereo上取得有竞争力的EPE/D1与较强零样本跨域泛化。

PrISM-IQA: Image Quality Assessment Made Practical for Smartphone Photography Figure 1
2026-07-01cs.CV

PrISM-IQA: Image Quality Assessment Made Practical for Smartphone Photography

Shuyan Zhai, Jiaqi He, Weixia Zhang, Liang Wang, Zhenjie Lee, Zufeng Zhang, Kede Ma

Department of Computer Science, City University of Hong Kong, School of Computer Science, Institute of AI, Shanghai Jiao Tong University, OPPO Research Institute, School of Vehicle and Mobility, Tsinghua University

2026-07-01视觉感知

针对传统手机图像质量评估只给单一 MOS、难以指导 ISP 调参的问题,PrISM-IQA 将任务改为 53 类 ISP 相关缺陷的有序严重度诊断,并用累积序数编码结合结构化推理约束标签的层级与互斥关系。实验在重标注 SPAQ 和专家数据上显示其能做细粒度缺陷识别,线性探测表明表征仍保留整体感知质量信息,并可为 OpenISP 调参提供可操作反馈。

Robust Autonomous UAV Landing on Maritime Platforms via Multimodal Agentic AI and Active Wave Compensation Figure 1
2026-07-01cs.CV

Robust Autonomous UAV Landing on Maritime Platforms via Multimodal Agentic AI and Active Wave Compensation

Francisco S. Neves, Pedro N. Pereira, Raul D.S.G. Campilho, Andry M. Pinto

2026-07-01视觉语言安全鲁棒

面向海上风电、油气平台巡检中无人机受电量限制且难以在浪涌甲板安全降落的问题,论文提出将USV主动稳平台与UAV自主进近解耦的双智能体框架:SAC控制3-RPU甲板补偿波浪,多模态RL融合视觉、热成像和LiDAR应对感知遮挡。高保真仿真15次试验实现100%降落成功,平均稳态效率87.8%,粗海况下96%时间保持甲板水平误差小于1°;但真实海试验证仍未充分说明。

What Memory Do GUI Agents Really Need? From Passive Records to Active Task-Driving States Figure 1
2026-07-01cs.CV

What Memory Do GUI Agents Really Need? From Passive Records to Active Task-Driving States

Chen Liu, Ling Chen, Hanzhang Zhou, Xu Zhang, Quyu Kong, Panrong Tong, Wenhao Wang, Xin Yu, Steven Hoi, Yue Wang

2026-07-01视觉感知

这篇论文针对长程移动 GUI 任务中传统记忆只保存历史、难以判断数据当前角色而导致漏做、重复或越界操作的问题,提出 ATMem,将任务相关值、来源、约束和完成状态维护为可更新的执行状态,并用 STR-GRPO 学习何时使用记忆。实验显示 ATMem-UI 在 AndroidWorld、MobileWorld 和 DataScope 上提升长程执行,8B 模型在 AndroidWorld 达到 76.6% 成功率,超过更大或同规模基线。

Learning Structurally Consistent Representations for Multi-View Radar Semantic Segmentation Figure 1
2026-07-01cs.CV

Learning Structurally Consistent Representations for Multi-View Radar Semantic Segmentation

Ali Zia, Muhammad Umer Ramzan, Abdelwahed Khamis, Usman Ali, Abdul Rehman

2026-07-01视觉感知

本文针对雷达语义分割中回波稀疏、噪声大且多视图密度不一致的问题,提出 HyperRadar:用可学习超图建模同一物体多回波的高阶关系,并以非平衡最优传输做无对应跨视图对齐,再用注意力融合 RA/RD/AD 特征。在 CARRADA 与 RADIal 上分别达到 63.8% 和 83.4% mIoU,较此前最佳提升 1.7 和 2.3 点。

Preserve the Hard, Regenerate the Rest: Uncertainty-Guided Synthetic Training Data Augmentation with Diffusion Models Figure 1
2026-07-01cs.CV

Preserve the Hard, Regenerate the Rest: Uncertainty-Guided Synthetic Training Data Augmentation with Diffusion Models

Nikolai Röhrich, Julian Gleißner, Ahmed H. A. Ibrahim, Silvan Mertes, Tobias Huber

Zuse School of Excellence in Reliable AI

2026-07-01生成模型安全鲁棒

针对语义分割中稀有类别、小目标和复杂场景标注稀缺的问题,论文指出扩散增强不应按前景/背景粗分,而应保留当前模型最不确定的语义区域,仅重绘其余上下文,并只在原始保留像素上计算损失,从结构上避免标签错配。该方法无需额外控制模型,在 UAVID、Cityscapes、BDD100K 上分别带来 +3.68、+2.64、+1.57 mIoU,收益集中于公交、火车、航拍车辆等困难类别。

Token-Sparse Medical Multimodal Reasoning via Dual-Stream Reinforcement Learning Figure 1
2026-07-01cs.CV

Token-Sparse Medical Multimodal Reasoning via Dual-Stream Reinforcement Learning

Kaitao Chen, Weiqian Zhao, Jiamin Wu, Qihao Zheng, Shangquan Sun, Chunfeng Song, Xiaosong Wang, Mu Zhou, Mianxin Liu

2026-07-01视觉语言强化学习

本文针对医学图像中有效视觉证据稀疏、密集视觉 token 易带来计算冗余和干扰的问题,提出 ViToS 双流强化学习框架,将视觉 token 剪枝建模为受 grounding 引导的策略选择,并用定位分支与稀疏推理分支的交叉反馈顺序优化缓解共享策略训练冲突。在七个医学基准上,方法将视觉 token 降至原序列的 77%,同时在 Lingshu-7B 和 HuatuoGPT-Vision-7B 上取得约 108.27% 与 104.16% 的相对性能。

DPPE: Rethinking Camera-Based Positional Encoding for Scaling Multi-View Transformers Figure 1
2026-07-01cs.CV

DPPE: Rethinking Camera-Based Positional Encoding for Scaling Multi-View Transformers

Shun Kenney, Teppei Suzuki

Keio University

2026-07-01视觉感知

本文针对多视角 Transformer 在放大新视角合成训练时,PRoPE 等相机位置编码后期性能停滞的问题,指出根因可能在于 value 中旋转与平移被耦合到同一维度,导致二者难以独立识别。作者提出 DPPE,将旋转和平移显式解耦并按几何角色注入 Q/K/V。实验显示其在长程训练中更稳定,并在视角数量外推、zoom-in 等场景优于 PRoPE,但简单相机轨迹数据上增益有限。

Localized Conformal Prediction for Image Classification with Vision-Language Models Figure 1
2026-07-01cs.CV

Localized Conformal Prediction for Image Classification with Vision-Language Models

Clément Fuchs, Tim Bary, Benoît Macq

2026-07-01视觉语言视觉感知

这篇论文针对传统保形预测只保证总体覆盖、难以照顾图像分类中局部样本差异的问题,将局部保形预测引入视觉语言模型分类。核心发现是直接用视觉特征余弦相似度加权并不能优于非局部基线,需对相似度做 sigmoid 式非线性变换并用校准集调参。九个自然图像数据集和多种 CLIP 骨干实验显示,该方法在保持边际覆盖保证的同时,能稳定、常显著地减小预测集合大小,但覆盖差距改善有限。

Temperature Field Reconstruction of Tungsten Monoblock Divertor on EAST using Physics-aware Neural Operator Transformer Figure 1
2026-07-01cs.CV

Temperature Field Reconstruction of Tungsten Monoblock Divertor on EAST using Physics-aware Neural Operator Transformer

Zikang Yan, Xiao Wang, Qingquan Yang, Zhendong Yang, Gaoting Chen, Zehua Chen, Bo Jiang, Jin Tang, Guosheng Xu

2026-07-01三维

面向 EAST 偏滤器在高热负荷下需实时重建钨单块三维温度场、而 FEM 计算过慢的问题,论文提出 PNOT,将边界热流建成结构化图,用图注意力和物理感知神经算子刻画局部/全局热扩散关系,并以 Sobolev 梯度约束增强物理一致性。基于有限元数据的实验显示,其较现有神经算子降低重建误差、保持温度梯度,并在未见工况上有更好泛化。

Mitigating Positional Leakage in 3D Masked Autoencoders for Robust Representation Learning Figure 1
2026-07-01cs.CV

Mitigating Positional Leakage in 3D Masked Autoencoders for Robust Representation Learning

Xu Yan, Huiqun Wang, Chen Wang, Lei Ren, Di Huang

2026-07-01三维安全鲁棒

本文针对3D点云MAE中解码器可直接利用掩码位置坐标进行重建的“位置泄漏”问题,指出现有方法会过度依赖位置嵌入而削弱编码器语义表征。作者提出MPL-MAE,通过重校准位置嵌入抑制绝对坐标信号并保留拓扑结构,再用门控接口动态控制位置注入。实验显示其在ModelNet40、ScanObjectNN等下游任务和噪声扰动下取得更好或更稳健表现,消融表明收益主要来自降低位置依赖。

AugSplat: Radiance Field-Informed Gaussian Splatting for Sparse-View Settings Figure 1
2026-07-01cs.CV

AugSplat: Radiance Field-Informed Gaussian Splatting for Sparse-View Settings

Lorenzo Lazzaroni, Riccardo Bollati, Daniel Barath, Michael Niemeyer, Keisuke Tateno

2026-07-01三维

AugSplat针对稀疏视角下3D Gaussian Splatting依赖初始几何、易因点云缺失而退化的问题,提出先用NeRF在少量输入上生成邻近合成视角,再作为辅助监督训练GS的思路,并比较先合成后真实的Staged与真实/合成联合且衰减权重的Dual策略。在mip-NeRF 360稀疏视角实验中,两者均优于标准GS,Staged平均效果最好且保持实时渲染,但方法依赖NeRF先验质量并增加训练复杂度。

DataEvolver: Self-Evolving Multi-Agent Data Construction for Text-Rich Image Generation Figure 1
2026-07-01cs.CV

DataEvolver: Self-Evolving Multi-Agent Data Construction for Text-Rich Image Generation

Siyu Yan, Yizhen Gao, Yilin Wang, Dongxing Mao, Alex Jinpeng Wang

Central South University, The Hong Kong University of Science and Technology

2026-07-01视觉感知

该文关注富文本图像生成中训练数据难以同时保证视觉质量、文字可读性、语义对齐和布局一致的问题,指出传统“爬取—过滤—冻结”流程会浪费被拒样本中的失败信号。DataEvolver 将数据构建改为反馈驱动的多智能体闭环,由检索、验证、批评和生成模块把 OCR 错误、语义错配等拒绝原因转化为下一轮策略和定向补全。在相同数据预算下,其构建的数据用于 PixArt-α 微调时,在 TextScenesHQ 和 LongTextBench 上相较最强基线 OCR-F1 分别提升 85.3% 和 35.3%,且迁移到 Show-o2 仍有效。

MV-GEL: Language-Driven Multi-View Geometric Entity Localization on Meshes Figure 1
2026-07-01cs.CV

MV-GEL: Language-Driven Multi-View Geometric Entity Localization on Meshes

Kartik Bali, Roland Aydin

2026-07-01视觉感知

这篇论文针对 CAD/机器人场景中用自然语言精确定位网格面、边等几何实体的问题,指出难点不只是分割,而是目标在不同视角下可见性差异很大。MV-GEL 的核心是用 GELviews 按提示选择最“可解释”的视角,再由 VLM 分割并通过射线投回网格。实验显示相较普通多视角基线,面级 IoU 最高提升 1.7 倍、边级 F1 提升超过 4.5 倍,尤其改善细薄和视角敏感结构。

Distortion-Corrected Diffusion MRI Using Rotated-View EPI and Joint Field-Map/Image Estimation with Gaussian Primitives Figure 1
2026-07-01eess.IV

Distortion-Corrected Diffusion MRI Using Rotated-View EPI and Joint Field-Map/Image Estimation with Gaussian Primitives

Wenqi Huang, Zhitao Li, Nan Wang, Yimeng Lin, Mengze Gao, Yurui Qian, Sevgi Gokce Kafali, Xiaozhi Cao, Kawin Setsompop, Daniel Rueckert, Congyu Liao

This work was supported in part by the European Research Council (884622), the National Institutes of Health (R01MH116173, R01HD114719, K99EB035178) and TUM Graduate School

2026-07-01视觉感知生成模型三维

针对扩散/功能 MRI 中 EPI 因 B0 场不均产生几何畸变、且传统“先重建再校正”会在高加速和高 b 值下放大伪影的问题,论文提出旋转视角 EPI,并用高斯基元在 k 空间联合估计无畸变图像、场图和逐 shot 相位。体内脑扩散实验显示,该方法相对 TOPUP、BUDA 和哈希网格 INR 在脑边界对齐上更接近结构像,低信噪比高加速场景收益最大,同时细节和噪声表现更稳。

Unsupervised Data-Efficient Cross-Modal Retrieval with Global-Neighborhood Alignment Hashing Figure 1
2026-07-01cs.IR

Unsupervised Data-Efficient Cross-Modal Retrieval with Global-Neighborhood Alignment Hashing

Runhao Li, Xiaoxu Ma, Zhenyu Weng, Yue Zhang, Guibo Luo, Huiping Zhuang, Zhiping Lin, Yap-Peng Tan

2026-07-01视觉感知

该文针对无监督跨模态哈希在少量图文对下容易依赖大规模配对数据、且只把 CLIP 当特征抽取器的问题,提出 GNAH,将 CLIP 连续语义结构迁移到二值汉明空间:用原型锚点保持全局语义,用随机邻域对齐缓解稀疏配对导致的过拟合。实验称其在数据受限设置下优于现有无监督方法,并接近部分监督方法,但具体增益是否主要来自 CLIP 先验仍需结合消融判断。

PRISM: Latent Composition Consistency for Single-Image Reflection Removal Figure 1
2026-07-01cs.CV

PRISM: Latent Composition Consistency for Single-Image Reflection Removal

Junseong Shin, Tae Hyun Kim

2026-07-01视觉感知

针对单图去反射在 sRGB 像素空间中层间纠缠、加性假设不可靠而泛化受限的问题,PRISM 将分解转到预训练 FLUX VAE 潜空间,利用传输与反射低相干的洞察,把任务建模为潜空间近似线性分离,并用流匹配单次前向恢复两层;LCC 通过跨样本反射潜变量交换约束组合一致性,LCS 用局部对比学习促进层语义分离。文中称其在六个基准上显著优于现有方法,并具备较好的野外图像泛化能力。

SimpleSearch-VL: A Simple Recipe for Multimodal Agentic Deep Search Figure 1
2026-07-01cs.CV

SimpleSearch-VL: A Simple Recipe for Multimodal Agentic Deep Search

Ming Dai, Zhihong Lu, Jinjie Gu, Jiedong Zhuang, Yefeng Liu, Wankou Yang, Jian Wang, Chunhua Shen

Southeast University

2026-07-01视觉语言

本文针对多模态深度搜索代理在训练 rollout 长尾、证据易错配、工具链复杂上的痛点,提出 SimpleSearch-VL:用因子化自适应 rollout 将采样预算转向仍缺少奖励对比的难例,并通过缩略图感知的反向图搜和网页自总结显式验证证据。仅用 5K SFT 轨迹和 2K RL 数据,8B/30B-A3B 相比 Qwen3-VL agentic 基线平均提升 15.8/16.0 分,30B-A3B 接近 agentic Gemini-3-Pro。

Fully Automated High-Precision Segmentation of Retinal Atrophy and Ellipsoid Zone Thickness in OCT: A Reliable Tool for Real-World GA Monitoring Figure 1
2026-07-01cs.CV

Fully Automated High-Precision Segmentation of Retinal Atrophy and Ellipsoid Zone Thickness in OCT: A Reliable Tool for Real-World GA Monitoring

Wolf-Dieter Vogl, Hlynur Skulason, Oliver Leingang, Ursula Schmidt-Erfurth, Amir Sadeghipour, Ariadne Whitby

Laboratory of Opthalmic Image Analysis (OPTIMA), Medical University of, Manual segmentation of GA lesions and the quantification of EZ integrity are labor-

2026-07-01视觉感知强化学习

针对GA/AMD随访中RPE萎缩与EZ完整性人工标注耗时且泛化到真实临床数据困难的问题,本文用三个专门的CNN语义分割模型联合估计RPE缺失、EZ边界/中断和Bruch膜,并在覆盖多阶段AMD的SD-OCT数据上训练验证。结果显示RPE/EZ缺失Dice为0.88/0.87,面积相关性>0.99,EZ厚度平均偏差2.15µm、重复性ICC>0.98,说明主要价值在稳定自动量化外层光感受器退化与RPE损伤。

HVPNet: A Bio-Inspired Network for General Salient and Camouflaged Object Detection Figure 1
2026-07-01cs.CV

HVPNet: A Bio-Inspired Network for General Salient and Camouflaged Object Detection

Jiawei Xu, Qiangqiang Zhou, Zhouping Li, Yanjiao Shi, Yugen Yi, Jiacong Yu

2026-07-01视觉感知

本文针对显著目标与伪装目标检测中“重骨干、重融合、重解码”带来的冗余与高开销,提出受人类视觉过程启发的 HVPNet。其核心是用视网膜式分层整合模块按特征层级进行轻量融合,并用皮层式解码器区分高、低层视觉处理。实验覆盖四类模态、七项任务和 22 个数据集,显示其在保持竞争性精度的同时显著降低参数量与 FLOPs,增益主要来自轻量骨干、RIM 与解码器的协同设计。

DrivingDepth: Sparse-Prompted Pixel-wise Scale Correction for Driving Depth Estimation Figure 1
2026-07-01cs.CV

DrivingDepth: Sparse-Prompted Pixel-wise Scale Correction for Driving Depth Estimation

Chi Huang, Wenhao Zhang, Hang Yin, YuAn Wang, Hao Li, Bosheng Wang, Xun Sun, Liang Wang

Baidu Inc.

2026-07-01视觉感知

DrivingDepth针对自动驾驶深度估计中视觉基础模型几何连续但无尺度、投影LiDAR有尺度却稀疏噪声大的矛盾,不再重生成深度,而是冻结DepthAnything3,把LiDAR作为稀疏几何提示学习逐像素残差尺度校正,并用置信度与法向正则抑制错误锚点。在nuScenes四帧环视输入上,AbsRel为11.19、EdgeCR为5.741,优于MapAnything的11.99/1.914,显示其同时改善尺度精度和几何一致性。

One Reflection Is Not Enough: Self-Correcting Autonomous Research via Multi-Hypothesis Failure Attribution Figure 1
2026-07-01cs.AI

One Reflection Is Not Enough: Self-Correcting Autonomous Research via Multi-Hypothesis Failure Attribution

Jie Ma, Binfei Chu, Jie Gao, Jinlu Zhang, Yiwei Ma, Yi Tan, Jiayi Ji, Xiaoshuai Sun, Rongrong Ji

2026-07-01视觉感知

这篇论文针对自治科研代理在实验失败后常把日志压缩成一次自由反思、导致局部试错或粗暴转向的问题,提出 SAGE 与多假设失败归因机制:先生成并评分多个有证据支撑的失败原因,再按根因路由到假设、实验设计或实现层修复,并用数值 grounding 抑制虚构结果。在 12 个跨域主题上,SAGE 将可产出指标的比例由 42% 提升到 92%,artifact 质量从 5.00 提至 6.75/10,并在盲评中略高于 AI-Scientist-v2。

Think While You Map: Asynchronous Vision-Language Agents for Incremental 3D Scene Graphs Figure 1
2026-07-01cs.CV

Think While You Map: Asynchronous Vision-Language Agents for Incremental 3D Scene Graphs

Deniz Bickici, Michael Pabst, Shohei Mori, Dieter Schmalstieg

2026-07-01视觉语言视觉感知三维

本文针对开放词汇3D场景图常需“先重建、后语义增强”而探索中不可查询的问题,提出ThinkGraphs:用概率体素骨干增量维持对象身份,并让Critic与Description等VLM代理异步执行语义闭环、属性补全和多目标帧调度。结果在ScanNet、Replica语义分割上达到或超过现有方法,并在Sr3D+、Nr3D、ScanRefer视觉定位上较SOTA提升15.3至18.8 A@0.25。

AeroVerse-SatAgent: UAV-Satellite Collaborative Spatial Reasoning Inspired by the Dual Visual Pathway Theory of Cognitive Neuroscience Figure 1
2026-07-01cs.CV

AeroVerse-SatAgent: UAV-Satellite Collaborative Spatial Reasoning Inspired by the Dual Visual Pathway Theory of Cognitive Neuroscience

Wenyi Zhang, Fanglong Yao, Youzhi Liu, Peng Hu, Zhengqiu Zhu, Chen Gao, Xian Sun, Kun Fu

Information Research Institute, Chinese Academy of Sciences, Beijing, Sciences, Beijing 100190, China, and with the Key Laboratory of Target Cognition and Application Technology (TCAT), Aerospace Information, Research Institute, Chinese Academy of Sciences, Beijing 100190, China, Academy of Sciences, Beijing 100190, China, and with the Key Laboratory of

2026-07-01学习理论

面向无人机在复杂城市中受遮挡、视角畸变且缺少显式几何建模的问题,论文提出受双视觉通路启发的 SatAgent,将卫星全局语义先验与无人机局部三维几何线索对齐到统一 BEV 空间,并用多视角一致性约束提升尺度和视角鲁棒性;同时构建 SatAgent-SR130K 数据集,实验称相较通用基础模型和专用空间推理模型分别提升 25.91% 和 11.69%,优势主要体现在复杂几何关系推理。

Towards a foundational model for recognising diastematic Gregorian notation Figure 1
2026-07-01cs.CV

Towards a foundational model for recognising diastematic Gregorian notation

Daniel Kurek, Jan Hajič jr

Institute of Formal and Applied Linguistics, Charles University, Prague, Czechia, 24], with some success. However, the available datasets are split across many, pitches, and their alignment to text (usually expressed in terms of syllable and, are available via HuggingFace (upon request).2

2026-07-01视觉感知

格里高利圣咏手稿规模庞大,但现有 OMR 数据集采用不同转写编码,难以合并训练。本文将四个端到端识别数据集统一到基于 S-GABC 的公共编码,并清理近重复样本,支持共享预训练与微调。结果显示,共享模型及其 8 倍梯度累积版本在四个数据集上整体达到或超过既有最优,说明增益可能主要来自 encoding harmonization 与合并数据带来的跨域多样性。

Revising RVL-CDIP: Quantifying Errors and Test-Train Overlap Figure 1
2026-07-01cs.CL

Revising RVL-CDIP: Quantifying Errors and Test-Train Overlap

Stefan Larson, Attila Nagy, Sam Desai, Cyrus Desai, Nicole C. Lima, Yixin Yuan, Siddharth Betala, Kaushal K. Prajapati, Jamiu T. Suleiman, Sharad Duwal, Kevin Leach

Vanderbilt University, University of Michigan

2026-07-01强化学习

论文针对文档分类基准 RVL-CDIP 被长期用于报告高准确率但可能存在标签错误与测试/训练泄漏的问题,进行全量基准审计而非提出新模型。作者人工复核 40 万文档并检测近重复,发现约 12% 标签错误、测试集中约 35% 与训练集重复;清洗标签会提升分类与 OOD 泛化,去除重复则降低原测试准确率,说明既有分数可能被数据质量问题显著扭曲。

Temporal Training Strategies for Left Atrium and Left Atrial Appendage Segmentation in Dynamic Contrast 4DCT Figure 1
2026-07-01cs.CV

Temporal Training Strategies for Left Atrium and Left Atrial Appendage Segmentation in Dynamic Contrast 4DCT

David Montalvo-García, Lauren Severance, Elliot R. McVeigh, María J. Ledesma-Carbayo

Department of Bioengineering, University of California San Diego, La Jolla, CA, USA, Division of Cardiovascular Medicine, University of California San Diego, La Jolla, CA, USA, Department of Radiology, University of California San Diego, La Jolla, CA, USA

2026-07-01视觉感知

面向房颤患者左心房及左心耳血流淤滞评估,论文关注动态增强4DCT中跨时间帧分割受对比剂变化和单帧标注传播噪声影响的问题。其核心洞察是比较不同时间训练集设计及nnUNet前景归一化:全27帧训练在早期低对比阶段最稳,生理选择少量帧在充盈后性能接近全帧,完整数据归一化可改善低对比表现但不能完全替代真实低对比样本。

No Prompt, No Leaks: A Robust Generative Steganography Framework via Prompt-Free Diffusion Figure 1
2026-07-01cs.CV

No Prompt, No Leaks: A Robust Generative Steganography Framework via Prompt-Free Diffusion

Jingwen Cai, Fen Xiao, Shuhua Deng, Xieping Gao

Jingwen Cai, Fen Xiao and Shuhua Deng are with the MOE Key Laboratory of Intelligent Computing and Information Processing, Xiangtan University, Xiangtan 411105

2026-07-01生成模型安全鲁棒

针对扩散生成隐写依赖文本提示带来的提示泄露、语义不稳定和传输扰动下恢复失败问题,论文提出无提示扩散框架:用CACM建立秘密图像到潜变量的确定性双射,并引入ViT提取的风格语义先验及预测-校正反演稳定轨迹。实验显示其在隐写图像真实感、抗隐写分析、秘密图像重建以及高斯噪声/JPEG退化下的恢复质量上优于多种传统与生成式基线。

Temporal Preservation over Processing: Diagnosing and Designing Spatiotemporal Single-Stage Video Detectors Figure 1
2026-07-01cs.CV

Temporal Preservation over Processing: Diagnosing and Designing Spatiotemporal Single-Stage Video Detectors

Karam Tomotaki-Dawoud, Anna Hilsmann, Peter Eisert, Sebastian Bosse

2026-07-01视觉感知

这篇论文针对单阶段视频检测器“看似利用多帧、实则依赖关键单帧”的评估盲区,提出TemporalLens扰动诊断框架,并设计基于YOLOv8的YOLO-3D。核心洞察是保留骨干网络中的时间深度比复杂时序模块更关键;在UCF101-24上32帧设置平均提升3.7个百分点mAP@50,且3D模型在遮挡目标帧时能从早期帧恢复预测,而堆叠2D模型明显崩溃。

Visual Semantic Entropy: Do Vision Language Models Recognize Visual Ambiguity? Figure 1
2026-07-01cs.CV

Visual Semantic Entropy: Do Vision Language Models Recognize Visual Ambiguity?

Ta Duc Huy, Trang Nguyen, Townim Chowdhury, Ankit Yadav, Minh-Son To, Zhibin Liao, Johan W. Verjans, Vu Minh Hieu Phan

2026-07-01视觉感知

这篇论文关注 VLM 在视觉证据含糊时仍给出高置信错误答案的问题,指出传统语义熵依赖采样输出多样性,容易被过度自信的视觉表征压低不确定性,而文本扰动又会混入提示敏感性。作者提出 Visual Semantic Entropy,仅扰动图像、固定问题,并将回答聚成语义原型后计算加权离散度。实验覆盖 5 个 VLM 和 5 个 VQA 基准,显示 VSE 更能捕捉视觉歧义,在不确定性估计上优于文本或图文联合扰动方法。

Resolving superposition in AI for interpretability and cross-modal alignment in patient-neuronal images Figure 1
2026-07-01cs.LG

Resolving superposition in AI for interpretability and cross-modal alignment in patient-neuronal images

Jisung Park, Seohyeon Kang, Daeun Yoo, Eunsu Lee, Seoin Cho, Wooyeop Choi, Ian Choi, James R. Evan, Daesoo Kim, Sonia Gandhi, Minee L. Choi

KAIST, 2 Konyang University, 3 Chang Gung University, UCL Queen Square Institute of Neurology & The Francis Crick Institute

2026-07-01视觉感知

本文针对生物图像模型中概念超位置既削弱可解释性、又扭曲潜空间几何的问题,提出用稀疏自编码器将 CNN 表征解缠为更单义的细胞状态向量,并将单细胞 RNA 分析工具迁移到图像域。作者在帕金森患者来源神经元高内涵图像上显示,SAE 可提升拓扑保真度,并通过 GW-map 与真实 scRNA-seq 无监督对齐,重建钙信号-AIS scaffold 等病理层级通路。

One Video, One World: Turning Monocular Video into Physical 4D Scenes Figure 1
2026-07-01cs.CV

One Video, One World: Turning Monocular Video into Physical 4D Scenes

Junhao Chen, Boran Zhang, Mingjin Chen, Henghaofan Zhang, Saining Zhang, Congcong Zhu, Hao Zhao, Ruqi Huang, Zhihao Li, Yufei Wang

2026-07-01视觉感知强化学习

本文针对现有4D重建“能渲染但难仿真”的问题,提出训练-free的OVOW,从单目视频中分解实例、重建水密网格、恢复尺度与6DoF轨迹,并用直接顶点形变统一表示刚体和非刚体运动,避免类别先验和骨架绑定。实验在静态与4D合成基准上显示其布局、几何、光度和语义误差优于基线,视频处理速度快一到两个数量级,物理仿真也验证了稳定性。

MS-Resampler: Multi-Scope Visual Resampling for Efficient Multimodal LLMs Figure 1
2026-07-01cs.CV

MS-Resampler: Multi-Scope Visual Resampling for Efficient Multimodal LLMs

Zhongyang Li, Yaqian Li, Faming Fang, Rinyoichi Takezoe, Zi-Hao Bo, Cheng Qian, Mo Guang, Guixu Zhang, Kaiwen Long

2026-07-01视觉语言

这篇论文针对多模态大模型视觉投影器在固定 token 预算下常用单一全局重采样、易稀释小目标和局部细节的问题,提出 MS-Resampler:用带空间范围先验的多个 Scoped Resampler 分支分别聚合局部到全局信息,再自适应融合为视觉 token。文中在十个公开多模态基准上报告相较单范围重采样器有稳定提升,且额外计算开销很小。

MAPE: Defending Against Transferable Adversarial Attacks Using Multi-Source Adversarial Perturbations Elimination Figure 1
2026-07-01cs.CV

MAPE: Defending Against Transferable Adversarial Attacks Using Multi-Source Adversarial Perturbations Elimination

Xinlei Liu, Jichao Xie, Tao Hu, Peng Yi, Yuxiang Hu, Shumin Huo, Zhen Zhang

2026-07-01视觉感知

这篇论文针对无需查询目标模型、隐蔽性更强的可迁移对抗攻击,提出在分类器前外挂去扰动模型 MAPE。其核心是用带通道注意力的 U-Net 学习从对抗样本中恢复干净输入,并通过 PPSA 按模型差异与负动量调度多源预训练模型,增加训练扰动多样性。实验中在 ResNet-34 黑盒目标上,CIFAR-10 平均防御率超过 95.1%,Mini-ImageNet 超过 71.5%,但对自适应攻击的效果仍需进一步验证。

Domain Adaptive Object Detection via Dual-Stream Bilevel-Cycle Optimization Figure 1
2026-07-01cs.CV

Domain Adaptive Object Detection via Dual-Stream Bilevel-Cycle Optimization

Yannan Chen, Wenqiang Wang, Ruoyu Chen, Jiancheng Wang, Mingbo Yang, Yaowei Wang, Wei Wang, Xiaochun Cao

2026-07-01视觉感知优化算法

这篇论文针对无监督域自适应目标检测中伪标签同时存在分类错误、定位错误及二者叠加,导致自训练性能受限且CST直接用于检测不稳定的问题,提出DSBCO:在Mean Teacher框架上把循环自训练扩展到分类与回归双流,并用回归归一化抑制坐标尺度带来的损失爆炸。实验覆盖四类跨域检测场景,在FCOS系方法上优于既有方法,相比HT在恶劣天气等场景取得最高14.3%的提升。

Evidence Triangulation for Multimodal Fact-Checking in the Wild Figure 1
2026-07-01cs.MM

Evidence Triangulation for Multimodal Fact-Checking in the Wild

Stefanos-Iordanis Papadopoulos, Zacharias Chrysidis, Christos Koutlis, Symeon Papadopoulos, Panagiotis C. Petrantonakis

Information Technologies Institute, Centre for Research & Technology, Hellas, Greece, Department of Electrical and Computer Engineering, Aristotle University of Thessaloniki, Greece

2026-07-01视觉语言

针对多模态事实核查过度依赖合成/策展数据、难以处理真实社媒图文与外部证据细粒度关系的问题,论文构建了基于 X 社区注释与 VLM 检索新闻证据的 X-POSE,并提出 TRENT,用三路交叉注意力分别建模文本-证据、图像-证据和图文对齐,再以关系融合捕捉蕴含/矛盾。实验显示 TRENT 优于专用模型和商业 VLM,消融表明证据质量与三角化融合均有贡献。

Language-Assisted Super-Resolution from Real-World Low-Resolution Patches Figure 1
2026-07-01cs.CV

Language-Assisted Super-Resolution from Real-World Low-Resolution Patches

Joonkyu Park, Kyoung Mu Lee

Dept. of ECE&ASRI, 2 IPAI, Seoul National University

2026-07-01强化学习

真实低分辨率图像难以获得成对 HR 监督,合成退化又泛化不足;本文的关键洞察是同一高质量图像中远近景可自然形成非配对 LR/HR patch,并用深度估计提取。LA-SR 将非配对超分转为视觉-语言空间对齐,通过内容与质量文本损失约束语义保真和高质感生成,在多类自然图像基准上报告了更好的感知指标与视觉效果。

RCL-Mamba: A Dual-domain State Space Model for Measurement-oriented Image Restoration in Rotational Sparse-View Scanning Computed Laminography Figure 1
2026-07-01cs.CV

RCL-Mamba: A Dual-domain State Space Model for Measurement-oriented Image Restoration in Rotational Sparse-View Scanning Computed Laminography

Xuyang Duan, Genyuan Zhang, Zhenjiang Dong, Chuandong Tan, Zihao Wang, Junyao Wang, Fenglin Liu

a Key Laboratory of Optoelectronic Technology and Systems, Ministry of Education, Chongqing University, Chongqing, 400044, b Engineering Research Center of Industrial CT Nondestructive Testing, Ministry of Education, Chongqing University, Chongqing

2026-07-01视觉感知

面向PCB等大平板构件的高速RCL无损检测,连续稀疏视角会同时带来投影域旋转模糊和重建域稀疏伪影,影响结构测量。RCL-Mamba按成像物理顺序做投影—图像双域级联恢复,并用Mamba-CNN双分支兼顾长程非均匀模糊建模与局部边缘细节。仿真和真实PCB实验显示其在去模糊、伪影抑制和线轮廓结构保持上优于基线,并将扫描视角从512降至64,约提升8倍效率。

Patient-Level Elbow Abnormality Detection: Leakage-Aware Evaluation of Learned Preprocessing, Calibration, and Triage-Oriented Operating Points Figure 1
2026-07-01cs.CV

Patient-Level Elbow Abnormality Detection: Leakage-Aware Evaluation of Learned Preprocessing, Calibration, and Triage-Oriented Operating Points

Ahmed Sallam, Ahmet Kaplan

2026-07-01视觉感知数据集/基准

针对骨科急诊分诊中肘部X光异常检测容易因患者级数据泄漏和概率不可靠而高估性能的问题,本文在MURA肘部子集上固定DenseNet121,系统比较原图、CLAHE、多通道表示及DnCNN学习式预处理,并同时评估AUROC、PR-AUC、校准和高特异性工作点。结果显示,各预处理的判别增益有限且依配置变化,原图基线始终有竞争力;DnCNN可在原图和多通道输入下降低ECE/Brier,但CLAHE+D nCNN未带来稳定校准收益,增益来源不清。

Bridging Video Understanding and Generation in a Unified Framework Figure 1
2026-07-01cs.CV

Bridging Video Understanding and Generation in a Unified Framework

Yuqi Wang, Runyi Li, Ruoyu Feng, Renjie Chen, Wenfeng Lin, Mingyu Guo

2026-07-01视觉感知

该文针对视频理解依赖紧凑语义表示、视频生成需要高密度时空细节这一割裂问题,提出 Vega 统一框架:用共享离散视觉/文本词表连接两类任务,让自回归模块预测关键帧语义 token,再由扩散解码器渲染高保真视频,并以双流 token 选择压缩理解输入。实验显示其在 VBench 生成和 VideoMME 理解上均有较强表现,但当前规模受算力限制。

Accelerated Likelihood Maximization for Diffusion-based Versatile Content Generation Figure 1
2026-07-01cs.CV

Accelerated Likelihood Maximization for Diffusion-based Versatile Content Generation

Hyunsoo Lee, Inwoo Hwang, Young Min Kim

2026-07-01生成模型

本文针对扩散模型在补全、外扩、3D纹理等部分观测生成任务中需反复训练或仅靠启发式同步导致全局不一致的问题,提出训练无关的 ALM,在反向扩散中对未观测区域进行显式基于 score 的似然最大化,并用一步加速近似降低迭代开销。实验覆盖图像、人体运动、网格纹理和视频,显示其相对同步方法及部分训练式基线取得更一致、更高质量的结果。

Wavelet-Optimized Pseudo-3D Accelerated Diffusion Model for Truncated Computed Laminography Figure 1
2026-07-01cs.CV

Wavelet-Optimized Pseudo-3D Accelerated Diffusion Model for Truncated Computed Laminography

Genyuan Zhang, Junyao Wang, Chuandong Tan, Fenglin Liu, Yongning Zhou

2026-07-01生成模型三维

针对计算层析成像中探测器视场不足导致投影截断、重建伪影和有效成像范围受限的问题,论文提出CL-DM:先分析完整/不完整/无数据区域,将目标扩展到可恢复的不完整区域,再用2D扩散切片聚合结合3D MBIR保证数据一致性,并引入z向小波正则、平移不变机制和3D快速采样。仿真与真实实验显示其能更好抑制截断伪影、恢复连续三维结构并提升推理效率。

Deep Spectral Models for Robust Dental Shape Generation Figure 1
2026-07-01cs.CV

Deep Spectral Models for Robust Dental Shape Generation

Tibor Kubík, François Guibault, Michal Španěl, Hervé Lombaert

2026-07-01安全鲁棒

面向数字牙科中小样本、高分辨率且网格连接不一致的牙冠建模难题,论文提出 ToothForge:用同步的 Laplace-Beltrami 谱系数学习低维生成流形,以绕开空间坐标模型的维度压力和特征基不稳定。实验和消融显示,谱同步是高保真重建的关键,纯谱域正则已足够;在多牙类、不同截断模态下,其重建与生成质量达到或超过 PCA、点式 VAE/扩散基线,同时保持紧凑性与几何可解释性。

Editing Everything Everywhere All at Once Figure 1
2026-07-01cs.CV

Editing Everything Everywhere All at Once

Fabio Quattrini, Carmine Zaccagnino, Enis Simsar, Marta Tintoré Gazulla, Rita Cucchiara, Alessio Tonioni, Silvia Cascianelli

2026-07-01视觉感知

针对多对象图像编辑中多条指令相互干扰、属性泄漏且顺序编辑效率低的问题,MICE在无需训练的情况下改写MMDiT联合注意力的加性偏置,利用分割掩码区分实例内、邻域和跨实例 token 交互,以兼顾属性绑定与整体协调。在LoMOE-Bench及更复杂的MICE-Bench上,它较多分支、潜变量优化和注意力正则基线更能保持背景并遵循局部编辑指令。

CLIMB: Centroid-Based Hierarchical Memory for Online Continual Self-Supervised Learning Figure 1
2026-07-01cs.CV

CLIMB: Centroid-Based Hierarchical Memory for Online Continual Self-Supervised Learning

Julien Lefebvre, Stefan Duffner, Mathieu Lefort

2026-07-01视觉感知

CLIMB面向在线连续自监督学习中无标签数据流、未知任务边界和有限记忆下的灾难性遗忘问题。其核心是用严格容量受限的层次化质心记忆组织历史样本,并结合重放样本上的知识蒸馏,以同时保持潜在空间覆盖和抑制表示漂移。在Split CIFAR-100、Split ImageNet-100及不规则任务分布协议上,文中报告其优于现有OCSSL方法,且消融显示质心记忆与蒸馏组合带来主要增益。

Learning from Failure: Inference-Time Self-Improvement for Computer-Use Agents Figure 1
2026-07-01cs.CV

Learning from Failure: Inference-Time Self-Improvement for Computer-Use Agents

Xueqiao Sun, Xiaohan Wang, Ludwig Schmidt, Serena Yeung-Levy, Yuhui Zhang

Stanford University, Stanford, CA 94305, USA, Tsinghua University, Beijing, 100084, China

2026-07-01视觉感知

这篇论文针对计算机使用智能体训练中只利用成功轨迹、丢弃失败轨迹的低效问题,提出在推理时让 LLM 分析失败模式并生成经人工轻量验证的代码补丁,将失败转化为行为改进。其洞察是失败可揭示 grounding、能力、知识和重复循环等缺陷,并对应引入视觉搜索、终端执行、知识支持和重复警告。在 OSWorld 上,OpenCUA-72B 成功率由 42.3% 提升到 48.9%,无需额外训练但有一定推理开销。

WarpHammer: Densifying Scene Warps with 3D Object Priors for Extreme View Synthesis Figure 1
2026-07-01cs.CV

WarpHammer: Densifying Scene Warps with 3D Object Priors for Extreme View Synthesis

Michael Green, Gavriel Habib, Dvir Samuel, Tal Berkovitz Shalev, Issar Tzachor, Rami Ben-Ari, Or Litany

2026-07-01三维

WarpHammer针对投影条件新视角合成在大角度绕物体运动时点云 warp 变稀疏、前景缺面并泄漏背景,导致相机线索和外观约束同时失效的问题。其核心是用对象级3D生成先验补全显式物体几何,并将几何与外观解耦,还可融合无位姿的外部物体参考图作为结构证据。实验在五个基准上显示,相比GEN3C等强基线,单视图PSNR最高提升4.2dB、旋转误差降低约50%,辅助视图设置也接近使用真值位姿的多视图基线。

Decodable Is Not Grounded: A Vision-Ablation Arbiter for VLM Spatial Reasoning Figure 1
2026-07-01cs.CV

Decodable Is Not Grounded: A Vision-Ablation Arbiter for VLM Spatial Reasoning

Chih-Ting Liao, Fei Shen, Xin Cao, Tat-Seng Chua

University of New South Wales, National University of Singapore

2026-07-01视觉语言视觉感知

本文针对VLM空间推理中“线性可解码是否等于视觉落地”的常见推断提出质疑,核心创新是用灰图替换的一步视觉消融仲裁器检验行为是否依赖图像。结果显示,14个VLM中水平轴通常真实落地,垂直轴多是语言/方向先验,深度轴则常出现“看见但符号用反”的倒置,说明探针和steering会高估潜在知识的视觉 grounding。

Rethinking the Role of Feature Engineering and Learning Strategies in Few-Shot Hidden Emotion Recognition Figure 1
2026-07-01cs.CV

Rethinking the Role of Feature Engineering and Learning Strategies in Few-Shot Hidden Emotion Recognition

Xiaochuan Guo, Jihao Gu, Haixu Liu, Yuxin Liu, Qi Wang, Yufei Wang, Fei Wang, Kun Li, Dan Guo

2026-07-01视觉感知

本文面向长视频中隐性情绪线索弱、稀疏且少样本标注不足的问题,提出偏移感知的多模态时序框架,将骨架、表情、视觉基础模型、X-CLIP与Gemini语义先验结合,并用Base-Offset交叉注意力和MIL池化捕捉瞬时微动作。方法在EI-MIGA-IJCAI挑战Track 3取得0.76923测试准确率第一,同时指出DINO类通用视觉特征在微动态任务中可能发生表征坍缩,部分提升存在伪泛化与记忆风险。

HyperVLP: Enhancing Hierarchical Surgical Video-Language Pre-training in Hyperbolic Space Figure 1
2026-07-01cs.CV

HyperVLP: Enhancing Hierarchical Surgical Video-Language Pre-training in Hyperbolic Space

Yaojun Hu, Kun Yuan, Nassir Navab, Haochao Ying, Jian Wu, Nicolas Padoy

2026-07-01视觉感知

这篇论文针对手术视频语言预训练把阶段、步骤、动作等层级知识压成平面嵌入的问题,提出在 Lorentz 双曲空间中对齐视频与文本,并用几何感知对比损失降低结构性假负例、用锥形蕴含约束父子节点一致性。实验在 Cholec80、AutoLaparo 和 MultiBypass140 上显示,零样本与少样本阶段识别均有稳定提升,尤其面向跨流程、跨中心泛化。

UHD-MFF: Shattering Barriers in Multi-Focus Ultra-High-Definition Image Fusion via Learnable Lookup Tables Figure 1
2026-07-01cs.CV

UHD-MFF: Shattering Barriers in Multi-Focus Ultra-High-Definition Image Fusion via Learnable Lookup Tables

Yibing Zhang, Xunpeng Yi, Qinglong Yan, Yeda Wang, Han Xu, Jiayi Ma

2026-07-01视觉感知

面向超高清多焦点图像融合,论文指出现有方法受限于低分辨率数据、模型未适配UHD尺度和部署成本高。作者构建1950对4K近/远焦图像的UHD-MFF数据集,并提出UMF-LUT,用低分辨率C-LUT做区域级焦点决策、高分辨率D-LUT以拉普拉斯线索补边缘细节,避免全分辨率卷积开销。实验显示其在视觉质量和指标上优于SOTA,并可实时处理4K、具备手机部署潜力。

ForgeDrive: Bidirectional Cross-Conditioning for Unified Visual-Action Generation in Autonomous Driving Figure 1
2026-07-01cs.CV

ForgeDrive: Bidirectional Cross-Conditioning for Unified Visual-Action Generation in Autonomous Driving

Xuchang Zhong, He Zheng, Chenxu Zhao, Tianxiong Lv, Hangqi Fan, Bohua Wang, Yushan Liu, Zhihao Liao, Leigang Luo, Congyang Zhao, Yang Cai

2026-07-01视觉感知

ForgeDrive针对自动驾驶世界模型中“先想象再行动”易把视觉生成误差传给规划的问题,提出自回归扩散框架,将未来分解为逐步的图像—动作对,并用双向跨条件训练让动作与视觉互相约束。其关键洞察是推理时先生成动作再生成未来画面,可用较稳定的动作纠正视觉想象。NAVSIM实验显示,该模型在无后训练策略下同时支持仿真、规划和视觉里程计,并优于多种强规划器。

CooperScene: Multi-Modal Cooperative Autonomy Benchmark with C-V2X Communication Characterization Figure 1
2026-07-01cs.CV

CooperScene: Multi-Modal Cooperative Autonomy Benchmark with C-V2X Communication Characterization

Bo Wu, Ruoshen Mo, Justin Yue, Yanyu Zhang, Janice Nguyen, Guoyuan Wu, Amit Roy-Chowdhury, Matthew J. Barth, Hang Qiu

2026-07-01数据集/基准

针对现有协同自动驾驶数据集忽视真实 C-V2X 带宽动态、异构传感器和多智能体扩展的问题,CooperScene 构建了含三车一路侧单元的多模态基准,并同步记录吞吐、时延、丢包等通信特征。数据覆盖路口、匝道和停车场,提供 59K 帧、344K 个全局一致 3D 标注;基准显示不少协同感知方法的通信需求远超现有 C-V2X 能力,部署瓶颈不只在感知精度。

AA: A Multi-view Multimodal Dataset for Screen-based Gaze Estimation Figure 1
2026-07-01cs.CV

AA: A Multi-view Multimodal Dataset for Screen-based Gaze Estimation

Chang Liu, Jiaqi Liu, Zhoutong Ye, Xinjie Shen, Chun Yu, Yuanchun Shi

Tsinghua University 2 Georgia Institute of Technology † Corresponding Author

2026-07-01视觉语言数据集/基准

针对现有屏幕注视数据多依赖单一正面摄像头、难以覆盖视角变化和遮挡的问题,AA构建了一个多视角多模态数据集:用8个屏幕边框相机和2个侧视相机同步采集人脸,并通过透视变换将侧视画面与屏幕坐标标注对齐,同时提供全图、人脸和双眼裁剪及按受试者划分的评测协议。数据包含24名参与者、288个屏幕目标和屏外负样本,约324万原始图像、1296万处理裁剪;论文主要贡献是数据与流程标准化,未报告模型精度增益,实际性能收益文中未充分说明。

AC3S: Adaptive Conditioning for 3D-Aware Synthetic Data Generation Figure 1
2026-07-01cs.CV

AC3S: Adaptive Conditioning for 3D-Aware Synthetic Data Generation

Eric Ji, Qiran Hu, Wufei Ma, Sarthak Jain, Yingying Li, Minh N. Do, Yaoyao Liu

2026-07-01三维

AC3S针对扩散生成合成数据中“3D姿态可控但画面失真”的矛盾,认为CAD边缘等视觉提示直接注入ControlNet会过度约束生成先验。其核心是自监督视觉提示调制器,按样本动态衰减ControlNet强度,并用多智能体VLM生成与几何一致的3D感知文本提示。实验显示相比基线FID提升15.95,使用其百万级合成数据微调可带来最高约7%准确率增益,但部分收益可能主要来自scaling / data。

ExPLoRe: Expert Patch-Level Loss Routing for Multi-Objective Masked Image Modeling Figure 1
2026-07-01cs.CV

ExPLoRe: Expert Patch-Level Loss Routing for Multi-Objective Masked Image Modeling

Konstantinos Georgiou, Maofeng Tang, Hairong Qi

2026-07-01视觉感知

本文针对多目标掩码图像建模中全局损失权重无法适配不同图像区域的问题,提出用 Soft-MoE 的 patch 级 dispatch 权重直接路由各类损失,并让损失梯度反向影响路由器以形成内容相关专门化。实验显示该机制在 ImageNet-1K 上提升 k-NN、线性探测与微调表现,线性探测达 80.6%、微调达 85.3%,下游配合冻结路由、专家 dropout 等策略后可弥合 ADE20K 分割差距。

Distilling Temporal Coherence into 2D Networks for Transrectal Ultrasound Prostate Video Segmentation Figure 1
2026-07-01cs.CV

Distilling Temporal Coherence into 2D Networks for Transrectal Ultrasound Prostate Video Segmentation

Dong Yeong Kim, JunGyu Lee, Jaewon Choi, June Young Seo, Myeongseop Kim, Jinwook Choi, Taek Min Kim, Young-Gon Kim

2026-07-01视觉感知

针对经直肠超声前列腺视频分割中2D模型逐帧抖动、3D模型延迟过高的问题,论文将时间一致性只在训练期蒸馏进2D网络。核心洞察是前列腺几何较稳定而周围声学背景易波动,因此用光流残差加权的时间一致性损失抑制不可靠区域,并结合双尺度原型对齐与伪标签/师生蒸馏减少逐帧标注需求。在新建TRUS-V和SUN-SEG上,方法报告了实时速度下更高分割精度和时间稳定性。

Learning to Deny: Action Denial in Multimodal Large Language Models Figure 1
2026-07-01cs.CV

Learning to Deny: Action Denial in Multimodal Large Language Models

Raiyaan Abdullah, Shehreen Azad, Yogesh Singh Rawat

2026-07-01视觉语言

这篇论文关注多模态大模型在视频动作识别中“会确认、不会否认”的问题:当人物、物体和场景强烈暗示某动作但关键运动缺失时,模型仍倾向于给出肯定判断。作者构建UCF101-AD,将正例与上下文相近的动作否认负例配对,并评测20个MLLM,发现许多模型在原UCF101超过85%,在否认集跌至50%以下。CausalAct用自然语言因果图提示/微调检查动作前提,能降低误报,说明动作否认可被学习。

HealthAgentBench: A Unified Benchmark Suite of Realistic Agentic Healthcare Environments for Challenging Frontier AI Agents Figure 1
2026-07-01cs.AI

HealthAgentBench: A Unified Benchmark Suite of Realistic Agentic Healthcare Environments for Challenging Frontier AI Agents

Qianchu Liu, Sheng Zhang, Guanghui Qin, Jeya Maria Jose Valanarasu, Maximilian Rokuss, Mingyu Lu, Timothy Ossowski, Juan Manuel Zambrano Chaves, Cliff Wong, Peniel Argaw, Yashna Hasija, Mu Wei, Wen-wai Yim, Qin Liu, Zilin Jing, Jason Entenmann, Naoto Usuyama, Tristan Naumann, Hoifung Poon

2026-07-01数据集/基准

医疗智能体评测仍多停留在静态问答或单一任务,难以反映真实临床流程中的多步工具使用与多模态数据处理。HealthAgentBench 将54个任务封装为7类可执行医疗环境,覆盖影像、病理、临床试验匹配和EHR等,并用专家标签或人类表现做二元成功判定。实验显示前沿智能体整体成功率仍低,最强的 Codex GPT-5.5 约42%,医学影像、大搜索空间和组合推理仍是主要瓶颈。

GaussianMap: Learning Gaussian Representation for Multi-Sensor Online HD Map Construction Figure 1
2026-07-01cs.CV

GaussianMap: Learning Gaussian Representation for Multi-Sensor Online HD Map Construction

Hongyu Lyu, Julie Stephany Berrio Perez, Mao Shan, Stewart Worrall

2026-07-01三维

针对在线 HD 地图构建中固定网格 BEV 对稀疏地图元素分配冗余、难以保留精细几何的问题,GaussianMap 将场景表示为 BEV 平面上的自适应高斯基元,并用前馈编码器通过高斯自注意力、相机注意力和可选 LiDAR 注意力逐步细化后再 splat 成 BEV 特征。nuScenes 与 Argoverse 2 实验显示其在纯相机和相机-LiDAR 融合设置下达到当时 SOTA。

HSDF-Lane: Height-Aligned Signed Distance Field with Semantic Lane Prior for 3D Lane Detection Figure 1
2026-07-01cs.CV

HSDF-Lane: Height-Aligned Signed Distance Field with Semantic Lane Prior for 3D Lane Detection

Jiyong Boo, Byeongin Joung, Hyemin Yang, Kuk-Jin Yoon

2026-07-01视觉感知三维

该文针对单目3D车道检测中平地BEV假设会在起伏道路上产生几何错位、稀疏坡度锚点难以精确估计高度的问题,提出在密集3D体中用高度对齐SDF隐式建模路面,并通过可微渲染生成高度图和表面对齐特征;同时用车道存在热图构造语义位置编码引导查询。OpenLane实验显示其在3D车道检测和高度估计上达到SOTA。

Beyond Single Character: Evaluating MLLMs for Sentence-Level Oracle Bone Inscription Understanding Figure 1
2026-07-01cs.CV

Beyond Single Character: Evaluating MLLMs for Sentence-Level Oracle Bone Inscription Understanding

Ziqi Li, Zijian Chen, Tingzhu Chen, Guangtao Zhai

2026-07-01视觉感知

针对甲骨文智能处理长期停留在单字识别、难以评估整句卜辞结构理解的问题,论文提出 S-OBI 基准:用专家校订的 95 条拓片和干净字形替换合成标准化句级图像,并设计语义匹配、语义槽抽取与上下文推理任务。10 个主流 MLLM 测试显示最佳总体仅 33.5%,模型常依赖粗粒度格式规律,难以恢复标点、语义角色和遮挡字,说明句级古文字理解仍受单字视觉识别瓶颈制约。

Seeing Through the Weights: Privacy Leakage in Scene Coordinate Regression Figure 1
2026-07-01cs.CV

Seeing Through the Weights: Privacy Leakage in Scene Coordinate Regression

Oleksii Nasypanyi, Jaemin Cho, Utku Ozbulak, Byungkon Kang, Francois Rameau

2026-07-01视觉感知

这篇论文针对视觉定位中“场景坐标回归模型只存权重因而天然隐私”的假设,指出机器人、AR或室内导航部署在私密空间时仍可能泄露环境信息。作者提出仅用无关代理图像反复查询SCR模型的攻击,通过预测稳定性筛选可靠3D点,并在灰盒/白盒下进一步优化特征、反演外观。实验显示室内外训练场景可被重建出高保真几何和可辨识布局,说明SCR权重本身携带可提取的隐私风险。

Reasoning-aware Speculative Decoding for Efficient Vision-Language-Action Models in Autonomous Driving Figure 1
2026-07-01cs.CV

Reasoning-aware Speculative Decoding for Efficient Vision-Language-Action Models in Autonomous Driving

Anh Dung Dinh, Simon Khan, Flora Salim

School of Computer Science and Engineering, Air Force Research Laboratory

2026-07-01视觉语言视觉感知

针对自动驾驶VLA规划器中链式因果推理自回归生成成为主要延迟瓶颈的问题,论文将推理拆成依赖轨迹历史的快速常规推理器与保留视觉注意力的目标模型,并用投机解码协同验证;关键创新是FlatRoPE引导草稿模型关注轨迹历史,以及AARL用动作质量奖励和静态KL锚后训练。实验在Alpamayo-R1上提升接受长度,报告约3.5–4.3倍理论加速,常规路径可覆盖约80%的CoC token。

Rethinking Foundation Model Collaboration: Enhancing Specialized Models through Proxy Task Reasoning Figure 1
2026-07-01cs.CV

Rethinking Foundation Model Collaboration: Enhancing Specialized Models through Proxy Task Reasoning

Hongyi Lin, Yang Liu, Jinhua Zhao, Xiaobo Qu

School of Vehicle and Mobility, Tsinghua University, Beijing, China, Department of Urban Studies and Planning, Massachusetts Institute of Technology, Cambridge, MA, USA

2026-07-01视觉感知

本文针对具身智能中基础模型直接回归检测框、轨迹或分割掩码时几何精度不足的问题,提出让专用模型先生成有效候选、再由视觉语言模型做选择/验证等代理推理的FAT/ProxySelect框架。实验覆盖2D/3D检测、轨迹预测和语义分割,显示其能稳定提升专用基线,并以更低计算成本优于直接用基础模型回归。

PruneGround: Plug-and-play Spatial Pruning for 3D Visual Grounding Figure 1
2026-07-01cs.CV

PruneGround: Plug-and-play Spatial Pruning for 3D Visual Grounding

Duc Cao Dinh, Khai Le-Duc, Florent Draye, Chris Ngo, Terry Jingchen Zhang, Bernhard Schölkopf, Zhijing Jin

Knovel Engineering Lab, University of Toronto, Vector Institute, ELLIS Institute, Max Planck Institute

2026-07-01视觉语言三维

PruneGround 针对现有 3D 视觉定位模型在整场景中推理导致候选冗余、歧义和计算开销高的问题,提出“先剪枝再定位”的即插即用框架:用冻结 VLM 从多视角图像中筛出语言相关空间区域,并重写复杂描述为更明确的目标—锚点关系,再微调空间 LLM 在裁剪点云内生成目标定位。实验显示其在 ScanRefer 全部设置及 Nr3D/Sr3D 10 项中的 9 项达到 SOTA,但具体增益在剪枝、描述改写与 LLM 适配之间的贡献仍需看消融细节确认。

WaterGen: Decoupling Scene and Medium in Underwater Image Generation Figure 1
2026-07-01cs.CV

WaterGen: Decoupling Scene and Medium in Underwater Image Generation

Jiayi Wu, Tianfu Wang, Tianyi Xiong, Dehao Yuan, Xiaomin Lin, Md Jahidul Islam, Cornelia Fermuller, Christopher Metzler, Yiannis Aloimonos

2026-07-01视觉感知

水下视觉缺少大规模、多样且带可靠标注的数据,限制恢复、分割等任务。WaterGen的核心是把“场景内容生成”和“水体介质退化”在潜扩散框架中解耦:先学习无退化的水下场景潜表示,再用受物理参数控制的多尺度解码加入衰减和散射,从而在不改变结构的情况下调节水况。论文显示其合成数据能提升水下图像恢复和语义分割表现,但具体增益仍可能部分来自 scaling / data。

FROST: Training-Free Few-Shot Segmentation with Frozen Features and Nonparametric Statistics Figure 1
2026-07-01cs.CV

FROST: Training-Free Few-Shot Segmentation with Frozen Features and Nonparametric Statistics

Junghwan Park

2026-07-01视觉感知

针对遥感少样本分割中标注稀缺、跨域训练易失效且原型方法会抹平多模态类别结构的问题,FROST不再学习分割器,而是在冻结DINOv3特征上把前景/背景建模为球面点云分布,用非参数密度比和由支持集确定的阈值、带宽完成判别。实验覆盖17个遥感基准,单样本已领先约5.6 mIoU,支持样本增加时优势扩大;局限是依赖代表性支持样本和骨干特征质量。

MSNN-LINet: Cross-Modal Learning via Continuous Linear Integration Figure 1
2026-07-01cs.CV

MSNN-LINet: Cross-Modal Learning via Continuous Linear Integration

Gabriel Clinger

The George Washington University

2026-07-01视觉感知

本文针对RGB-D场景分类中早期融合过早纠缠、晚期融合缺少特征提取阶段交互的问题,提出三流MSNN架构LINet,用LIConv2d在每层激活前连续整合RGB与深度信号,并指出桥接权重的Kaiming初始化会破坏梯度,需用1/N常数初始化和渐进模态dropout稳定训练。SUN RGB-D上从零训练达到45.2%平均类别准确率,ScanNet预训练后升至49.6%。

SkillSpotter: Pose-Aware Multi-View Skilled Action Detection and Grading in Ego-Exo Videos Figure 1
2026-07-01cs.CV

SkillSpotter: Pose-Aware Multi-View Skilled Action Detection and Grading in Ego-Exo Videos

Björn Braun, Christian Holz

2026-07-01视觉感知三维

面向 AR 教练等场景,论文关注连续 ego-exo 视频中不仅要定位技能动作,还要判断执行好坏的问题。作者发现现有时序动作检测模型评分近随机,提出 SkillSpotter,以自适应时间抑制、门控 3D 姿态融合和双向跨视角注意力联合建模。其在 Ego-Exo4D 上将类特定 mAP 从 12.40 提至 21.82,平衡准确率从 55.99% 提至 60.40%,并在 HoloAssist 上表现出一定泛化。

WildProp: Visual Estimation of Wildlife Body Proportions at Scale Figure 1
2026-07-01cs.CV

WildProp: Visual Estimation of Wildlife Body Proportions at Scale

Mustafa Chasmai, Aaron Sun, Subhransu Maji

2026-07-01视觉感知

针对传统野生动物形态测量依赖标本处理或受控拍摄、难以扩展的问题,WildProp将体比例估计转化为检索驱动的对应匹配:只需一张用户标注的标准姿态图,先用基础模型做姿态感知检索,再进行密集局部匹配、几何过滤和稳健聚合。其核心洞察是海量自然图像中存在足够多近标准姿态样本,可绕开任意视角重建难题;在鸟类和两栖数据集上,中位相对误差约为10–20%。

JacobianAvatar: Temporally Consistent Semi-rigid Avatar Reconstruction from a Monocular Video Figure 1
2026-07-01cs.CV

JacobianAvatar: Temporally Consistent Semi-rigid Avatar Reconstruction from a Monocular Video

Changyeon Won, Min-Gyu Park, Seonghwan Park, Ju Hong Yoon, Hae-Gon Jeon

2026-07-01视觉感知三维

该文面向单目视频重建可驱动真人化身时的自遮挡、不可见表面与衣物动态不稳定问题,提出以层级神经 Jacobian 场建模半刚性形变,并结合带约束的 Poisson 求解、SDF Jacobian 正则和形变引导残差光流损失来抑制边界伪影、补全腋下/大腿等遮挡区域并约束时序一致性。实验显示其在基准与野外视频上较现有方法获得更稳定的几何和渲染效果,但宽松服装与面部表情仍未充分解决。

InfiniVerse: Occupancy Guided Unbounded Scene Generation for Autonomous Driving Figure 1
2026-07-01cs.CV

InfiniVerse: Occupancy Guided Unbounded Scene Generation for Autonomous Driving

Xiaoyu Ye, Leheng Li, Xinyu Ji, Yingjie Cai, Hongda He, Xu Yan, Guanyi Zhao, Ying-Cong Chen, Bingbing Liu, Shuguang Cui, Zhen Li

2026-07-01学习理论

面向自动驾驶中长时域、多视角场景生成易漂移且依赖 HD/BEV 先验的问题,InfiniVerse 从单帧多视角输入重建显式 3D occupancy,并沿任意轨迹自回归扩展,再用视频扩散生成外观;其关键在于将生成视频反投影回 3D,形成 sketch-and-refine 闭环以约束几何与视觉一致性。在 Waymo 和 nuScenes 上报告 FID 6.4、FVD 67.97,长时稳定性和生成质量优于既有方法。

TaxoMIL: Taxonomy-Constrained Learning for Hierarchical Whole Slide Image Analysis Figure 1
2026-07-01cs.CV

TaxoMIL: Taxonomy-Constrained Learning for Hierarchical Whole Slide Image Analysis

Chaeyeon Lee, Khang Nguyen Quoc, Jinsol Song, Yosep Chong, Kwangil Yim, Jin Tae Kwak

2026-07-01视觉感知

这篇论文针对 WSI 病理诊断中常见的“扁平分类”问题:模型忽略诊断标签本身的粗到细层级关系,生成式 VLM 还可能出现父子类别不一致或分类幻觉。TaxoMIL 将 MIL 诊断改写为受临床 taxonomy 约束的多粒度文本生成,用双头 Transformer 分别生成粗、细诊断,并通过层级目标约束标签嵌入和切片表征。三套 WSI 数据集上优于 MIL 分类器和生成式方法,但具体增益中 taxonomy 约束与生成框架各自贡献仍需看消融细节。

Seeing Through Multiple Views: Parameter-Efficient Fine-Tuning via Selective Neurons for Consistent Radiology Report Generation Figure 1
2026-07-01cs.CV

Seeing Through Multiple Views: Parameter-Efficient Fine-Tuning via Selective Neurons for Consistent Radiology Report Generation

Yucheng Chen, Jinjing Zhu, Yang Yu, Yufei Shi, Hane Naghshbandi, Jinhua Liu, Angela S. Koh, Fang Fen, Kian Eng Ong, Si Yong Yeo

2026-07-01视觉感知

本文针对多视角胸片报告生成中,简单特征融合易产生前位与侧位诊断不一致的问题,提出 View-PNDF:先在 Transformer 解码器中检测并验证视角相关“模式神经元”,再只微调这些神经元以保留通用表征,并用 LLM 汇总分视角报告。实验称其在两个医学 RRG 基准上提升视角特异报告质量,同时维持通用视角性能并降低微调成本。

PiLoT v2: Pixel-to-Orthogonal Map Alignment for Free-view UAV Geo-localization Figure 1
2026-07-01cs.CV

PiLoT v2: Pixel-to-Orthogonal Map Alignment for Free-view UAV Geo-localization

Xinyi Liu, Xiaoya Cheng, Rouwan Wu, Zhaochen Wang, Shen Yan, Maojun Zhang, Yu Liu

National University of Defense Technology

2026-07-01视觉感知

本文面向 GNSS 受限下无人机实时无漂移定位,针对 PiLoT 依赖大规模 3D 网格与在线渲染、难以端侧部署的问题,提出用 TDOM/DSM 正射地图裁剪替代 3D 渲染,并通过跨视角特征注册网络、几何标注数据及重力/单点测距先验嵌入 LM 位姿优化来缩小斜视图与正射图差异。实验显示其在合成、真实和长期序列上达到实时定位,精度可比或超过 3D 网格方法,同时显著降低存储与计算成本。

Horizon3D: Sparse Radar-Camera Fusion for Long-Range 3D Perception in Autonomous Driving Figure 1
2026-07-01cs.CV

Horizon3D: Sparse Radar-Camera Fusion for Long-Range 3D Perception in Autonomous Driving

Geonho Bang, Geunju Baek, Dongyoung Lee, Wonjun Jeong, Jun Won Choi

2026-07-01三维

Horizon3D面向高速自动驾驶中150米以上目标稀疏、运动快导致雷达相机融合困难的问题,提出以关键点初始化高斯基元并结合稀疏BEV特征的混合表示,再用双路径时序融合同时累积场景信息和建模单体运动。在TruckScenes验证集上,相比此前最佳雷达相机方法提升3.0 NDS和1.6 mAP,并保持较有竞争力的推理速度。

Do Not Break the Vessels: Structure-Preserving Mean Flow for Vascular Image Translation Figure 1
2026-07-01cs.CV

Do Not Break the Vessels: Structure-Preserving Mean Flow for Vascular Image Translation

Changjin Sun, Zhuo Hu, Kaini Wang, Baixuan Wu, Shuo Gao, Runan Zheng, Cheng Xue, Yudong Zhang, Guangquan Zhou

2026-07-01视觉感知生成模型

面向临床可及的 NIRII 到高分辨 2PF 血管图像转换,论文指出现有方法只约束最终图像,容易产生断裂或伪分支。其核心是把血管拓扑视为生成轨迹中的不变量,在 Brownian-bridge 扩散中用结构梯度正交约束和时间加权损失限制流场,并用原型引导结构细化缓解训练与推理结构差异。在 NIRII–2PF 与眼底数据上,相比现有方法提升结构保真和视觉质量,PSNR 最高达 24.96 dB 与 24.83 dB。

Anchoring on Reality: Breaking the Pseudo-Target Ceiling in Makeup Transfer Figure 1
2026-07-01cs.CV

Anchoring on Reality: Breaking the Pseudo-Target Ceiling in Makeup Transfer

Bo Wei, Xianhui Lin, Yi Dong, Zhongzhong Li, Zonghui Li, Zirui Wang, Jiachen Yang, Xing Liu, Hong Gu, Xiaoming Li, Wangmeng Zuo

Harbin Institute of Technology, Nanjing University, vivo BlueImage Lab, vivo Mobile Communication Co., Ltd, though the ideal transfer target is unavailable, the real reference itself provides

2026-07-01视觉感知

这篇论文针对妆容迁移缺少真实成对监督、现有方法受伪目标伪影和身份漂移限制的问题,提出 ART 两阶段 DiT:先用伪目标学习语义对齐,再通过“现实锚定”循环从卸妆后的参考图重建真实参考妆容,让梯度反向约束迁移结果携带细粒度妆容细节,并用受控噪声瓶颈稳定训练。作者还构建 2K 分辨率 MF2K 数据集;实验显示其在复杂妆容、遮挡和跨性别场景下提升妆容保真、背景稳定与身份保持。

Towards Flexible, Natural, Efficient Interaction for Conversational Talking Face Generation Figure 1
2026-07-01cs.CV

Towards Flexible, Natural, Efficient Interaction for Conversational Talking Face Generation

Baiqin Wang, Sen Chen, Jiankuo Zhao, Xiangyu Liu, Zhen Lei, Xiangyu Zhu

2026-07-01视觉感知

面向多人、多轮对话式 talking face 生成,论文指出现有方法难以同时兼顾角色切换灵活性、听说反馈自然性与实时效率。InterTalk 以运动建模替代重型视频生成,引入响应上下文编码、交互运动生成、跨参与者反馈迭代细化,并将唇形、眨眼、头姿等面部运动解耦以便定向增强;同时构建多人对话数据并用 3D 人脸增强扩充监督。实验称其在交互质量上优于现有方法,并能以 30 FPS 实时生成。

CasaMaestro: Multi-View Panoramas for House-Scale 3D Reconstruction Figure 1
2026-07-01cs.CV

CasaMaestro: Multi-View Panoramas for House-Scale 3D Reconstruction

Yuzhou Ji, Xiaotian Yang, Zhipeng Zhang

2026-07-01三维

CasaMaestro针对家庭具身智能中住宅级三维重建昂贵、针孔相机覆盖低且长序列易漂移的问题,改用20至50张稀疏全景图,采用DINOv2骨干同时预测度量深度和相机位姿,并加入轻量全景位姿解码器与ERP重映射数据增强。实验称其在真实和合成场景的AUC30分别提升84%和119%,未见其对不同数据规模贡献的充分拆分。

Accelerating Merge with Motion Vector Difference via Filter Difference Analysis for VVenC Figure 1
2026-07-01eess.IV

Accelerating Merge with Motion Vector Difference via Filter Difference Analysis for VVenC

Xinmin Feng, Shengyang Xu, Jianhua Chen, Li Li, Dong Liu, Feng Wu

2026-07-01视觉感知

这篇论文针对 VVenC 中 MMVD 逐方向、逐距离穷举搜索带来的编码复杂度,提出用分数像素插值滤波器差分来预判候选收益:将 8-tap 滤波近似为 2-tap,并利用参考块空间梯度与常规 merge 残差的内积判断可跳过方向,同时处理整数采样支撑偏移和二维可分离滤波。实验显示,在 fast 预设下平均 MMVD 搜索比例由 21.07% 降至 11.05%,效率-复杂度指标 η 由 11.79 降至 7.10。

Fleet: Few Shots Lead Effective AI-generated Image Detection Figure 1
2026-07-01cs.CV

Fleet: Few Shots Lead Effective AI-generated Image Detection

Jiaan Wang, Sirui Liu, Yu Li, Kaiyuan Yang, Juan Cao, Sheng Tang

2026-07-01视觉感知

针对现有 AIGI 检测器依赖“静态伪影”而在 SD3、Nano Banana Pro 等新生成器上失效的问题,Fleet 将任务转向少样本动态适配,通过解耦子空间与 avoidance routing 把新 AI 样本从真实图像主导路径中分流到伪造子空间,并构建含 64 个模型、36 万图像的 Treasure 基准;实验显示在 Doubao Seedream 4.0 上仅用 10-shot 可将准确率由 20.4% 提升到 73.1%。

AnyMatch: Supercharging Universal Multi-Modal Image Matching with Large-Scale Single-View Images Figure 1
2026-07-01cs.CV

AnyMatch: Supercharging Universal Multi-Modal Image Matching with Large-Scale Single-View Images

Meng Yang, Zizhuo Li, Linfeng Tang, Fan Fan, Jiayi Ma

2026-07-01视觉感知

AnyMatch针对跨模态图像匹配缺少大规模、几何精确训练数据的问题,提出从普通单视图图像出发,结合单目深度、显式3D重投影、扩散补全和跨模态翻译生成多视角多模态配对及标注。其关键洞察是用可规模化的单图资源替代昂贵多传感器采集,并避免SfM-MVS误差累积。基于Any-syn微调LoFTR、EDM、RoMa等模型后,在多模态匹配基准上取得明显提升,但增益可能主要来自scaling/data。

Hierarchical 3D Scene Graph Construction and Belief-based Planning for Semantic Navigation Figure 1
2026-07-01cs.CV

Hierarchical 3D Scene Graph Construction and Belief-based Planning for Semantic Navigation

Bing Wu, Zuyao Chen, Changwen Chen

2026-07-01机器人规划控制三维

这篇论文针对零样本语义导航中仅依赖局部观测和贪心搜索导致远距离探索低效的问题,提出在线增量构建层次化3D场景图,将对象、区域单元和大区组织成全局语义拓扑,并在其上融合LLM先验与探索证据做信念规划,通过HSG模拟器和POUCT评估宏动作长期收益。实验显示其在多任务、多数据集上优于现有方法,远距离场景SR和SPL平均提升9.4%和5.0%。

Hybrid Unet-Transformer Model for Generating Stress and Strain Fields from Composite Geometrics Figure 1
2026-07-01cs.CV

Hybrid Unet-Transformer Model for Generating Stress and Strain Fields from Composite Geometrics

Shrey Patel

2026-07-01视觉感知

本文针对复合材料微结构设计中 FEM 逐例仿真耗时过高的问题,用混合 UNet-Transformer 直接从几何图像生成应力/应变场,核心在于用卷积编码局部结构、Transformer 建模全局空间关系,并用 Grad-CAM 检查物理关注区域。结果显示多数子数据集精度较高,最佳 R² 达 0.9991、SSIM 达 0.9936,推理低于 1 秒;但在稀疏、不规则方格结构和尖锐应力不连续处明显平滑,S11 仅 R² 0.7735。

Diffusion-Based Material Regularization for Physics-Based Inverse Rendering Figure 1
2026-07-01cs.CV

Diffusion-Based Material Regularization for Physics-Based Inverse Rendering

Jingwang Ling, Lifan Wu, Feng Xu, Shuang Zhao

2026-07-01生成模型

这篇论文针对物理逆渲染中材料与光照强耦合、易把阴影和高光“烘焙”进材质的问题,提出不把扩散模型预测当作直接监督,而将 DiffusionRenderer 的 G-buffer 预测转化为表面相似性核,只在预测近似恒定的区域约束优化材质一致性,同时保留渲染方程拟合输入图像的自由度。该端到端流程联合恢复几何、空间变化材质和照明,在 Synthetic4Relight、Stanford-ORB 与 DTC-Synthetic 上较 Neural-PBIR、MaterialFusion 等提升重建与重光照质量,但依赖扩散预测的局部一致性,失效时可能过度平滑。

Online TT-ALS for Streaming Tensor Decomposition with Incremental Orthogonalization Figure 1
2026-07-01math.NA

Online TT-ALS for Streaming Tensor Decomposition with Incremental Orthogonalization

Hiroki Takeda, Yuto Miyatake, Daisuke Furihata

Department of Pure and Applied Mathematics, The University of Osaka, Japan, D3 Center, The University of Osaka, Japan

2026-07-01视觉感知

面向视频、传感等连续高维数据,批处理 TT 分解精度高但易耗尽内存,现有在线方法又因缺少正交约束而不稳定。论文提出 Online TT-ALS,在流式更新中逐步施加正交规范并精确求解局部核心张量,使单次 sweep 的秩依赖由二次降为线性。实验显示其在重构误差和感知视频质量上优于在线 TT 基线,并相较部分深度流式表示快数个数量级。

ADAPT: Attention Dynamics Alignment with Preference Tuning for Faithful MLLMs Figure 1
2026-07-01cs.CV

ADAPT: Attention Dynamics Alignment with Preference Tuning for Faithful MLLMs

Zhiyuan Yao, Zheren Fu, Zhixiao Zheng, Jiajun Li, Yi Tu, Zhendong Mao

2026-07-01视觉感知

这篇论文针对多模态大模型生成中逐步脱离图像依据而产生幻觉的问题,指出其内部信号是文本到图像跨注意力在解码后期漂移、变散或受位置偏置影响。ADAPT用早期较可靠的跨注意力构造视觉锚点,并在推理时在线纠偏,同时通过视觉注意力引导的DPO强化基于图像的偏好。实验显示该框架在多种幻觉基准和主流骨干上降低约40%–60%幻觉率,且基本保持通用多模态能力。

Learning Video Dynamics with Predictive Differentiable Rendering Figure 1
2026-07-01cs.CV

Learning Video Dynamics with Predictive Differentiable Rendering

Yujin Tang, Tian Zhou, Xin Lin, Cheng Tan, Yifan Hu, Rong Jin, SouYoung Jin, Liang Sun

2026-07-01视觉感知

这篇论文针对确定性视频预测在离散像素空间用 MSE 训练时易产生模糊、细节丢失的问题,提出 PDR:在现有像素预测器后接轻量 PredGS,将预测转为连续 2D 高斯参数并用 CUDA 可微渲染器 predgsplat 重建,可支持任意通道并结合 L1+SSIM 训练。实验在交通、天气与人体视频基准上显示,PDR 以很小参数和 FLOPs 增量提升细节与精度,如 TaxiBJ/WeatherBench 降低 MSE,KTH/Human3.6M 降低感知误差。

TerraDiT-$Ω$: Unified Spatial Control for Satellite Image Synthesis with Any Geospatial Primitive Figure 1
2026-07-01cs.CV

TerraDiT-$Ω$: Unified Spatial Control for Satellite Image Synthesis with Any Geospatial Primitive

Brian Wei, Srikumar Sastry, Daniel Cher, Eric Xing, Nathan Jacobs

2026-07-01视觉感知规划控制

卫星图像生成常需把道路、建筑等矢量地理标注转成栅格或稀疏提示,既损失几何关系又增加标注与流程成本。TerraDiT-Ω的关键在于直接统一接收多边形、折线、框和点,并用Geometry-Aware Local Attention把不同 primitive 的显式几何注入扩散Transformer。实验显示其在多种控制格式下优于稠密/稀疏基线,且用同一模型生成合成数据可提升分割、检测、道路图提取和场景分类。

WarpI2I: Image Warping for Image-to-Image Translation Figure 1
2026-07-01cs.CV

WarpI2I: Image Warping for Image-to-Image Translation

Shen Zheng, Anurag Ghosh, Gaurav Parmar, Srinivasa Narasimhan

Carnegie Mellon University

2026-07-01视觉感知

本文针对轻量潜扩散图像到图像翻译在编码压缩后易丢失人脸、小物体等细节的问题,提出在编码前按显著区域进行内容感知 warp、生成后再 unwarp 的框架,用空间重分配替代提高 latent 分辨率,并配套 FLUX 外扩生成成对重光照数据。实验显示其在人像重光照、驾驶场景重光照及时段/天气翻译中提升结构保持、光照一致性和图像质量,额外开销约 3ms 且无需改模型结构。

Dual Sparse Aggregation Transformer for Multispectral Object Detection Figure 1
2026-07-01cs.CV

Dual Sparse Aggregation Transformer for Multispectral Object Detection

Wencong Wu, Xiuwei Zhang, Hanlin Yin, Hongxi Zhang, Yanning Zhang

2026-07-01视觉感知

本文针对多光谱目标检测中可见光与红外互补信息融合不足的问题,指出现有 Transformer 用全部 token 做跨模态注意力会引入无关区域交互。DSAFormer 通过空间与通道双稀疏交叉注意力保留高相似关系,并结合多尺度特征精炼和可学习加权融合抑制冗余。在 MFAD、FLIR、M3FD、LLVIP 四个数据集上优于已有方法,但具体增益中各模块贡献需结合消融进一步判断。

Dense Structural Priors for Sparse Functional Landmark Localization in Surgical Videos Figure 1
2026-07-01cs.CV

Dense Structural Priors for Sparse Functional Landmark Localization in Surgical Videos

Chenyan Jing, Hao Ding, Lalithkumar Seenivasan, Jacob M. Delgado López, Mathias Unberath

2026-07-01视觉感知

本文针对手术视频中工具尖端与锚点等功能性地标难以在遮挡、烟雾和多器械场景下精确定位的问题,提出用粗定位结果提示 SAM 3 生成非真值器械掩码,并将其作为中间结构先验而非直接热图目标来细化预测。实验覆盖 60 段视频、7867 个片段,在无需人工像素级掩码训练的条件下,tip/anchor 总体 F1 达 72.4%/58.0%,并显示直接加入掩码目标会偏向宽泛工具区域。

Auditing Generalization in AI-Generated Video Detection: A Six-Control Protocol and the VidAudit Toolkit Figure 1
2026-07-01cs.CV

Auditing Generalization in AI-Generated Video Detection: A Six-Control Protocol and the VidAudit Toolkit

Mert Onur Cakiroglu, Zhihe Lu, Mehmet Dalkilic, Hasan Kurban

Luddy School of Informatics, Computing, and Engineering, Indiana University Bloomington, College of Science and Engineering, Hamad Bin Khalifa University, Doha, Qatar

2026-07-01视觉感知规划控制学习理论

针对 AI 生成视频检测榜单可能被片长、编码或数据集身份等混杂因素虚高的问题,论文提出包含重编码、泄漏审计、真实样本一致性、统一训练、多种子置信区间和跨数据集测试的六控制协议,并发布 VidAudit。结果显示,片长分类器从 AUC 0.998 跌至 0.529,CLIP 暴露数据集偏置,WaveRep 在审计后仍达 OOD AUC 0.996;同时 0.1% FPR 下高 AUC 方法召回骤降,说明单一 AUC 不足以衡量泛化。

PhotoQuilt: Training-Free Arbitrary-Resolution Photomosaics via Bootstrapped Tiled Denoising Figure 1
2026-07-01cs.CV

PhotoQuilt: Training-Free Arbitrary-Resolution Photomosaics via Bootstrapped Tiled Denoising

Koorosh Roohi, Javad Rajabi, Andrew Fleet, Babak Taati

University of Toronto, Vector Institute, KITE Research Institute, Queen’s University

2026-07-01视觉感知

这篇论文针对高分辨率照片马赛克生成中“远看要有整体图像、近看每块又要像独立照片”且计算成本高的问题,提出无需训练的 PhotoQuilt:先低分辨率确定全局布局,再在潜空间放大并重新加噪,随后按固定 tile 分块去噪,使局部各自成像同时共享全局结构。实验显示其在全局一致性和局部真实感上优于现有基线,并通过分块生成避免随画布尺寸出现二次注意力开销。

Learning Where to Look: A Reinforcement Learning Framework for Robust Micro-Ultrasound Prostate Cancer Detection Figure 1
2026-07-01cs.CV

Learning Where to Look: A Reinforcement Learning Framework for Robust Micro-Ultrasound Prostate Cancer Detection

Mohammad Mahdi Abootorabi, Sina Namazi, Armin Saadat, Lyuyang Wang, Obed Dzikunu, Paul F. R. Wilson, Zhuoxin Guo, Brian Wodlinger, Parvin Mousavi, Purang Abolmaesumi

The University of British Columbia, Vancouver, BC, Canada, Queen’s University, Kingston, ON, Canada, Vector Institute, Toronto, ON, Canada, ularization to mitigate weak-label noise and encourage sharp localization., evidence alongside quantitative risk predictions. Code is available at:, A central barrier is supervision. In routine biopsy, pathology is available, only at the core level: each acquired core provides a global cancer label, grade, (FM) adaptations that mitigate weak labels and domain shift via self-supervision, labels, where fine-tuning large decoders can amplify spurious regions and de-, sparse, weak core-level labels. On a multi-center retrospective µUS cohort of, We utilized a private multi-center µUS dataset of 6,607 biopsy cores from 693 pa-

2026-07-01视觉感知强化学习安全鲁棒

该文针对微超声前列腺癌识别依赖医生经验、弱标签稀疏且噪声大、类别极不平衡的问题,提出 Prost-RL:在基础模型编码器—解码器中加入轻量强化学习空间策略,先学习“看哪里”,再用注意力软提示进行热图定位和图像级分类,并用 APO 与抗噪损失稳定训练。多中心 6607 个活检核心上,核心级 AUROC 达 79.0,80% 特异性下敏感度 64.6%,较最强基线提升 2.1 AUROC 和 4.5 个敏感度点。

No Adaptation Without Observation: Observability-Constrained Test-Time Prompt Tuning for LiDAR Semantic Segmentation Figure 1
2026-07-01cs.CV

No Adaptation Without Observation: Observability-Constrained Test-Time Prompt Tuning for LiDAR Semantic Segmentation

Linlian Jiang, Wentao Ju, Sadman Rakib Pinon, Jianwei Xian, Zhixiang Chi, Xinxin Zuo, Yang Wang

Concordia University, Mila – Quebec AI Institute, University of Toronto, line using pseudo-label supervision, but directly apply-, Because pseudo-label reliability is spatially heteroscedas-, ditional annotations. Code is available at our project page., LiDAR semantic segmentation assigns semantic labels to, model parameters online using pseudo-label supervision., scene, implicitly assuming that pseudo-labels across spa-, eroscedastic, and pseudo-label reliability becomes spatially, neous pseudo-label supervision, we propose a geometry-, ference without labeled targets, allowing pre-trained mod-

2026-07-01视觉感知

这篇论文针对 LiDAR 语义分割在部署环境变化下难以依赖标注重训、而常规测试时自适应会被稀疏、遮挡等低可靠伪标签扰乱的问题,提出“无观测不自适应”的约束:用光束终止与邻域支撑估计空间可观测性,只在冻结骨干中的轻量 prompt 适配器上进行受门控更新,并用时间平滑原型对齐稳定语义证据。实验称其在标准 LiDAR 基准上提升了适应稳定性和分割性能,且无需额外标注。

GRAPE: Graph-Augmented Prototype Explanations for Interactive Medical Image Diagnosis Figure 1
2026-07-01cs.CV

GRAPE: Graph-Augmented Prototype Explanations for Interactive Medical Image Diagnosis

Rasul Khanbayov, Hasan Kurban

Hamad Bin Khalifa University, ing inside a doctor-drawn region conflicts with the claimed label, catching 85%, clinical text, allowing a new finding to be added from a single labeled image, co-occurrence graph from training labels and refines prototype similarity scores via two, from a single labeled image without modifying any other component., corpus-derived label co-occurrence. GRAPE uses training-label statistics with prototype-similarity

2026-07-01视觉感知

GRAPE面向原型式医学影像诊断的三类落地问题:病灶概念被独立建模、医生框选反馈可能放大错误、新增发现需重训。其核心是在原型相似度上加入标签共现图注意力,并用区域内概念匹配检查拦截可疑交互,再以BioViL-T文本锚支持开放词表原型扩展。实验称在TBX11K上较原型基线提升13.8个宏F1百分点,错误标注检出率85%,定位优于端到端基线且仅增加约1ms延迟。

Knowledge-Driven Dimension Estimation from a Single Image -3D Asset Generation Technology for Digital Twin Construction Figure 1
2026-07-01cs.CV

Knowledge-Driven Dimension Estimation from a Single Image -3D Asset Generation Technology for Digital Twin Construction

Hidenori Sakaniwa, Akihito Akai, Akihiko Hyodo

Data & Knowledge Management Research Department, Digital Infrastructure Innovation Center, Research &, Development Group, Hitachi, Ltd., 1-280, Higashi-koigakubo, Kokubunji-shi, Tokyo, 185-8601, Japan, dimensional information is unavailable or point cloud data, insufficient research focusing on scalability., focus on recognizing the location and class labels of, single image if sufficient geometric features are available, available. However, these methods are not applicable, one image of the object is available., labels to each region. The components to be annotated

2026-07-01视觉感知三维

面向自动驾驶数字孪生中高架交通标志尺度不准会影响车载相机验证的问题,论文提出从单张图像分解标志板、支柱、箭头等部件,并结合部件目录、设计规则和几何关系传播尺度,再重建可编辑3D资产。实验显示部件检测精度约80%以上,能生成更接近真实尺寸的资产;但定量仿真增益和大规模真实数据评估文中未充分说明。

The Label Imitation Game: Turing Test Network for Zero-Shot Pseudo-Label Pruning Figure 1
2026-07-01cs.CV

The Label Imitation Game: Turing Test Network for Zero-Shot Pseudo-Label Pruning

Brent A. Griffin, Jason J. Corso

The Label Imitation Game: Turing Test Network, for Zero-Shot Pseudo-Label Pruning, University of Michigan, Abstract. Foundation model pseudo-labeling—labeling data strictly via, these errors, we introduce the Turing-inspired Label Imitation Game, (LIG), a framework that formalizes pseudo-label pruning as an adversar-, ial interrogation. Rather than filtering labels via isolated thresholds, we, “judge” that evaluates candidate pseudo-labels within a dataset-wide con-, robustness, consistently enhancing label accuracy for three state-of-the-, datasets can effectively prune complex object detection pseudo-labels., and code are available at https://github.com/voxel51/ttn., Keywords: Pseudo-labeling · Label Pruning · Zero-Shot Task Transfer ·

2026-07-01模仿学习

本文针对基础视觉语言模型零样本伪标注中高置信幻觉难以靠阈值过滤的问题,提出 Label Imitation Game,将伪标签裁剪表述为“评审”对候选标签的对抗式辨别,并用轻量 Transformer TTN 在数据集级上下文中判断语义与空间一致性。实验显示,TTN 无需改动原模型或人工监督,可跨四个数据集提升三类 VLM 伪标签质量;仅用分类数据训练也能迁移到检测伪标签裁剪,困难类别 F1 提升 28%,任务微调后达 44%,并帮助下游检测器恢复部分类别零召回。

SyncCache: Exploiting Asymmetric Dynamics for Fast Audio-Driven Portrait Animation Figure 1
2026-07-01cs.CV

SyncCache: Exploiting Asymmetric Dynamics for Fast Audio-Driven Portrait Animation

Juncheng Ma, Yuxuan Du, Yanan Sun, Zhening Xing, Changlin Li, Zhenyu Tang, Bo Li, Peng-Tao Jiang, Li Yuan, Daquan Zhou, Yonghong Tian

2026-07-01视觉感知

针对音频驱动肖像动画中 DiT 推理延迟高、通用扩散缓存易破坏唇形同步或占用显存过大的问题,SyncCache 利用人像区域高频、背景低频以及音频模块轻量但关键的非对称动态:用人体掩码增强缓存误差探测,缓存稳定的跨块残差以跳过重视觉计算,同时持续重算音频块,并用离线动态规划按显存预算选择缓存边界。实验显示其在 HunyuanVideo-Avatar 和 Wan-S2V 上分别最高加速 4.12×、3.75×,同时基本保持视觉质量和音频对齐。

AVTok: 1D Unified Tokenization for Holistic Audio-Video Generation Figure 1
2026-07-01cs.CV

AVTok: 1D Unified Tokenization for Holistic Audio-Video Generation

Kien T. Pham, I Chieh Chen, Qifeng Chen, Long Chen

2026-07-01视觉感知

针对现有音视频生成常用双分支、分模态 tokenizer 带来的表示鸿沟、同步偏差与计算开销,AVTok 将音频和视频共同压缩到统一 1D 离散潜空间,并用共享编解码器、模态特定查询和 VFAL 分层训练缓解信息密度不平衡。实验显示其在音视频重建上接近或优于单模态强基线,并可支持音生视频、视频生音和联合生成。

GaussLite: Online Task-Conditioned 3D Gaussian Splatting for Real-Time Robotic Mapping Figure 1
2026-07-01cs.CV

GaussLite: Online Task-Conditioned 3D Gaussian Splatting for Real-Time Robotic Mapping

Annika Thomas, Mason Peterson, Jonathan P. How

2026-07-01机器人三维

GaussLite针对在线3DGS机器人建图在有限算力下仍均匀分配高斯容量、浪费在任务无关区域的问题,提出由自然语言任务驱动的“视觉凹区”式表示分配:用LLM解析目标与锚点,结合开放词汇检测、分割和3D空间过滤生成相关性掩码,并按相关性调控播种密度、梯度与尺度。结果显示在4Hz实时、同等高斯预算下,Replica和真实场景ROI PSNR分别提升2.72dB和2.23dB,多机器人融合仅共享约7.08%地图仍优于拼接3.42dB。

Off the Rails: Hijacking the Scoring Head in Generative End-to-End Driving Planners with Safety-Violating Adversarial Perturbations Figure 1
2026-07-01cs.RO

Off the Rails: Hijacking the Scoring Head in Generative End-to-End Driving Planners with Safety-Violating Adversarial Perturbations

Halima Bouzidi, Mboutidem Ekemini Mkpong, Haoyu Liu, Mohammad Abdullah Al Faruque

University of California, Irvine, CA, USA

2026-07-01生成模型安全鲁棒

这篇论文关注生成式端到端自动驾驶规划器的安全鲁棒性:许多扩散式或词表式规划器最终都依赖评分头从固定候选轨迹中选最高分,且缺少后置安全过滤。作者提出 Derail,用面向碰撞、越界和急刹等行为级目标的扰动劫持评分头,使安全候选翻转为危险轨迹;在四个 NAVSIM 生成式规划器上攻击成功率达 100%,碰撞率升至 25.8%–60.4%,优于通用损失最大化和特征偏移攻击。

Simple Supervision Is Hard to Beat: A Bitter Lesson from Sparse Target Labels in Domain-Adaptive Object Detection Figure 1
2026-07-01cs.CV

Simple Supervision Is Hard to Beat: A Bitter Lesson from Sparse Target Labels in Domain-Adaptive Object Detection

Lijun Zhang, Ruinian Xu, Mudit Agrawal

A Bitter Lesson from Sparse Target Labels in, trained detector to an unlabeled target domain, typically through teacher-, student self-training with pseudo-labels. We revisit this setting when a, small, uniformly sampled subset of target images is labeled. We intro-, leaving the original unlabeled adaptation branch unchanged. Across eval-, ple adaptation tasks, and target-label budgets from 1% to 10%, RTSM, unlabeled self-training. To this end, we evaluate ten sparse-label feed-, back plugins covering pseudo-label selection, object completion, and op-, RTSM. These results reveal a bitter lesson for sparse-label SFDA-OD:, effective anchor for sparse-label SFDA-OD., a labeled source domain [2, 21]. Source-free domain adaptive object detection, unlabeled target domain without accessing the source data [8].

2026-07-01视觉感知

这篇论文关注源数据不可用的域自适应目标检测中,少量目标域标注究竟应如何使用。作者提出并强调一个简单基线RTSM:将随机抽取的1%至10%目标域标注直接作为监督损失混入原有自训练流程。系统实验显示,RTSM在多种SFDA-OD方法、检测器和迁移任务上稳定提升1.7至18.3 AP50,而利用这些标注去调控伪标签选择、目标补全或优化过程的十类插件增益有限且依赖方法,说明稀疏标注最可靠的价值仍主要来自直接监督。

Unveiling Transferability in Trajectory Prediction via Latent Scene Embeddings Figure 1
2026-07-01cs.CV

Unveiling Transferability in Trajectory Prediction via Latent Scene Embeddings

Theodor Westny, David Axelsson, Björn Olofsson, Erik Frisk

Division of Vehicular Systems, Linköping University, Linköping, Sweden, Department of Automatic Control, Lund University, Lund, Sweden, Abstract. The growing availability of trajectory datasets has fueled, driven by advances in deep-learning methods, increased availability of trajectory, this could be applied to trajectory prediction by pooling all available data., all available data., Implementations are available at https://github.com/westny/transferatlas.

2026-07-01规划控制

针对轨迹预测模型跨数据集泛化不稳定、盲目合并数据可能带来无关或低质样本的问题,论文提出把场景映射到共享潜在空间,并用数据集分布的 KL 散度估计有方向的可迁移性。其核心洞察是潜在行为结构比表层统计更能预示迁移效果;在 24 个数据集、552 个迁移对上,该指标与零样本和微调性能强相关,并揭示了一些低关注数据集可作为有效预训练来源。

Streaming Gaussian Encoding for 4D Panoptic Occupancy Tracking Figure 1
2026-07-01cs.CV

Streaming Gaussian Encoding for 4D Panoptic Occupancy Tracking

Maximilian Luz, Thomas Nürnberg, Yakov Miron, Abhinav Valada

This work was funded by the Bosch Research collaboration on AI-driven automated driving., Department of Computer Science, University of Freiburg, Germany. 2 Bosch Research, Robert Bosch GmbH, Germany. 3 University of Haifa, Israel

2026-07-01视觉感知三维

这篇论文针对相机式4D全景占据跟踪中体素特征每帧重算、遮挡和静态结构下时序几何一致性不足的问题,提出流式高斯编码器:用固定预算的潜在高斯查询维护跨帧场景状态,经自车运动补偿传播,并以深度监督塑造不透明度作为可见性代理,累计置信度来保留稳定结构、刷新失效查询。该方法可嵌入现有mask式4D-POT管线,在Occ3D扩展nuScenes和Waymo上取得新的相机式4D-POT最优结果,并称几乎不增加推理开销。

LUMOS: A Semantic Operating-System Layer for Accessibility-Grounded AI Agents Figure 1
2026-07-01cs.OS

LUMOS: A Semantic Operating-System Layer for Accessibility-Grounded AI Agents

Yogeswar Reddy Thota

2026-07-01视觉感知

论文针对桌面智能体过度依赖截图、OCR和坐标点击导致的高成本与脆弱性,提出 LUMOS 作为操作系统语义层,将 UI Automation、DOM 与无障碍树转成含稳定 ID、角色、名称、边界和动作的语义蓝图,并用可见 UI 的受限 observe-act 循环执行操作。主要结果更偏架构与原型论证:它展示了现有 OS 语义可降低对视觉感知的依赖,但复杂任务评测和量化增益文中未充分说明。

DANTE-W: Diffuse Albedo Neural Texturing in the Wild Figure 1
2026-07-01cs.GR

DANTE-W: Diffuse Albedo Neural Texturing in the Wild

Guangyu Wang, Tianheng Lu, Ruqi Huang, Lu Fang

Tsinghua University, Beijing 100084, China

2026-07-01视觉感知

DANTE-W针对传统网格贴图把光照与阴影烘进纹理、导致野外大场景重光照失真的问题,将扩散模型给出的视角空间反照率先验融合到3D一致的神经纹理中,并用频率分解的物理神经渲染从原图补回高频细节、分离低频光照。在自建GigaLit基准上,其反照率恢复与重光照PSNR、LPIPS均明显优于扩散式渲染基线。

PolyFlow: Continuous Topology Embedding Flow Matching for Artist-style Mesh Generation Figure 1
2026-07-01cs.GR

PolyFlow: Continuous Topology Embedding Flow Matching for Artist-style Mesh Generation

Chunshi Wang, Haohan Weng, Junliang Ye, Biwen Lei, Yang Li, Zibo Zhao, Zeqiang Lai, Kaiyi Zhang, Yunhan Yang, Zhuo Chen, Chunchao Guo, Yawei Luo

controllable in resolution. Retopology remains one of the most time-consuming steps in 3D

2026-07-01生成模型

PolyFlow针对自回归网格生成虽能产生艺术化拓扑但解码慢、连续扩散/flow难处理离散连接的问题,提出将顶点位置、法线与可由时空距离恢复邻接关系的连续拓扑嵌入统一成流匹配状态,并用Transformer并行去噪生成。文中称其可按指定顶点数在数秒内生成干净拓扑,在Toys4K上Chamfer与Hausdorff距离优于自回归基线。

Cross-Modal Hierarchical Fusion for from Multi-Sensor Ground Observation Figure 1
2026-07-01cs.CV

Cross-Modal Hierarchical Fusion for from Multi-Sensor Ground Observation

Xinze Zhang

University of Southern California, Los Angeles, CA 90007, USA, problem, largely because the available measurements are het-

2026-07-01视觉感知

该文针对地基多传感器观测中相机缺深度、雷达/云高仪覆盖窄导致云微物理场难以三维重建的问题,提出 AtmoFuseNet:用分层跨模态注意力融合多视角图像与垂直廓线,再以条件变分和可微前向模型约束重建,并用3D相关体估计逐体素风场。在半干旱站点和合成数据上,LWC MAE约0.02–0.03 g/m³、风速MAE 1.18 m/s,较基线更优,但跨气候场景泛化仍文中未充分说明。

2026-06-30

304 篇
Open-Vocabulary and Referring Segmentation for 3D Gaussians Using 2D Detectors Figure 1
2026-06-30cs.CV

Open-Vocabulary and Referring Segmentation for 3D Gaussians Using 2D Detectors

Jameel Hassan, Yasiru Ranasinghe, Vishal Patel

2026-06-30视觉感知三维

这篇论文针对3D Gaussian Splatting开放词汇理解仍依赖CLIP特征、难处理复杂指代表达的问题,提出GaussDet:先将高斯分成3D实例组,再利用多视角2D开放词汇/指代表达检测器投票,形成视图聚合语义分布以抑制错误分组噪声。实验在LeRF-OVS、ScanNet和Ref-LeRF上优于既有方法,零样本指代表达mIoU提升16.7个百分点。

GROW$^2$: Grounding Which and Where for Robot Tool Use Figure 1
2026-06-30cs.RO

GROW$^2$: Grounding Which and Where for Robot Tool Use

Yuhong Deng, Yuyao Liu, David Hsu

National University of Singapore, Massachusetts Institute of Technology

2026-06-30机器人视觉语言

这篇论文面向机器人在开放场景中“临时找工具并知道用哪里”的问题,避免假设工具已给定或依赖大规模端到端标注。GROW²的关键洞察是用物体部件连接语义功能与几何区域:先由VLM选择工具和相关部件,再用视觉基础模型从单视角RGB-D重建并融合出3D可供性区域。实验显示其在可供性预测、开放类别泛化以及仿真和真实Franka工具使用中均优于基线,但失败仍主要来自VLM选错工具/部件与模型推理延迟。

Reweighting Framewise Attention in Video Transformers for Facial Expression Understanding Figure 1
2026-06-30cs.CV

Reweighting Framewise Attention in Video Transformers for Facial Expression Understanding

Seongro Yoon, Donghyeon Cho, Jinsun Park, François Brémond

2026-06-30视觉感知

面部表情视频中的细微肌肉变化常被头动、相机运动等全局动态淹没,通用视频 ViT 对此不够敏感。论文提出 MiRA,在不增加可训练参数的情况下,利用自注意力中的帧级置信度与帧内集中度重分配注意力,并给出兼容 FlashAttention 的 flashLite 近似。实验显示其在多个视频 FER 基准上相对强 ViT 基线稳定提升,但具体增益来源仍可能与 attention scaling 及预训练设置有关。

UnfoldArt: Zero-Shot Recovery of Full Articulated 3D Objects from Text or Image Figure 1
2026-06-30cs.CV

UnfoldArt: Zero-Shot Recovery of Full Articulated 3D Objects from Text or Image

Mohamed el amine boudjoghra, Ivan Laptev, Angela Dai

Technical University of Munich, Mohamed Bin Zayed University of Artificial Intelligence

2026-06-30视觉感知三维

面向机器人仿真、具身 AI 和虚拟环境中可交互物体难以从单图或文本恢复完整结构的问题,UnfoldArt 将 VLM 的语义/部件推理与冻结视频生成先验组织成两轮代理辩论,用全局-局部分歧和生成运动视频校正关节类型、轴与枢轴,并借运动条件视频补全被遮挡内部几何。结果是可生成带外形、内部结构和运动一致状态的 URDF 式铰接 3D 物体;但片段中定量实验与相对增益来源未充分说明。

Goku: A Million-Scale Universal Dataset and Benchmark for Instruction-Based Video Editing Figure 1
2026-06-30cs.CV

Goku: A Million-Scale Universal Dataset and Benchmark for Instruction-Based Video Editing

Sen Liang, Cong Wang, Zhentao Yu, Fengbin Guan, Zhengguang Zhou, Teng Hu, Youliang Zhang, Yuan Zhou, Xin Li, Qinglin Lu, Zhibo Chen

2026-06-30视觉感知数据集/基准

现有指令式视频编辑数据多停留在单一外观修改,难以覆盖真实创作中的结构变化和多任务组合。Goku的核心贡献是构建200万公开视频编辑对,覆盖主体/相机运动、参考引导与2–5项组合编辑,并用分解式合成流程和Gemini过滤保证语义、时序与真实感;同时提出MLLM文本编码加掩码分支的Goku-Edit,以及含1000例、7项指标的Goku-Bench。实验显示其在指令跟随上较开源模型最高提升约8%,但增益可能主要来自数据规模与任务覆盖扩展。

Towards in-the-wild Egocentric 3D Hand-Object Pose Estimation Figure 1
2026-06-30cs.CV

Towards in-the-wild Egocentric 3D Hand-Object Pose Estimation

Siddhant Bansal, Zhifan Zhu, Shashank Tripathi, Jiahe Zhao, Michael J. Black, Dima Damen

2026-06-30三维

本文针对野外第一视角 RGB 中手-物体三维姿态受遮挡、接触歧义和监督稀缺限制的问题,提出 EPIC-Contact 数据集,用双向三维接触标注优化得到手物体网格,并设计 HOPformer 以手部先验通过交叉注意力增强物体特征、单次预测双手与物体姿态。实验显示其在 ARCTIC 成功率达 82.4%、较 SOTA 提升 6.2 点,在 EPIC-Contact 上成功率近乎翻倍且接触偏差降低 75%。

Learning from Reliable Latent Prompts for Visual Recognition with Missing Modalities Figure 1
2026-06-30cs.CV

Learning from Reliable Latent Prompts for Visual Recognition with Missing Modalities

Taixi Chen, Nancy Guo

School of Computing, State University of New York at Binghamton

2026-06-30视觉感知

面向现实视觉识别中图文等模态缺失导致跨模态对齐失稳的问题,论文指出依赖实例特征生成动态提示会在高缺失率下放大偏置,提出LLP:用与输入解耦的模态特定潜在锚点和双路径交叉注意生成提示,以稳定先验补偿缺失语义。作者在三个基准和最高90%缺失率场景下报告优于现有方法,消融支持潜在锚点设计的贡献。

APRIL-MedSeg: A Modular Medical Image Segmentation Toolbox Embracing Modern Paradigms Figure 1
2026-06-30cs.CV

APRIL-MedSeg: A Modular Medical Image Segmentation Toolbox Embracing Modern Paradigms

Juntao Jiang, Jinsheng Bai, Linxuan Fan, Yali Bi, Jiangning Zhang, Yong Liu

2026-06-30视觉感知

针对现有医学分割框架难以同时支持新型高效架构、现代训练范式和基础模型集成的问题,APRIL-MedSeg提出YAML驱动的模块化2D分割工具箱,将网络拆为编码器、解码器、跳连和瓶颈等可注册组件,并统一半监督、域适应、蒸馏、弱监督和文本引导等范式。文中主要结果是提供130种架构、177个编码器、97种方法、917个配置及数据增强、部署、集成等基础设施;但论文更偏系统描述,实际性能增益来源文中未充分说明。

Beyond 2D Matching: A Unified Single-Stage Framework for Geometry-Aware Cross-View Object Geo-Localization Figure 1
2026-06-30cs.CV

Beyond 2D Matching: A Unified Single-Stage Framework for Geometry-Aware Cross-View Object Geo-Localization

Liyao Wang, Ruipu Wu, Haojun Xu, Lei Shi, Linjiang Huang, Si Liu

2026-06-30视觉感知

本文针对跨视角目标地理定位长期依赖2D外观匹配、缺少几何标注和真实视场数据的问题,构建含22万余地面/无人机-卫星建筑配对、提示与相机位姿的CMA-Loc,并提出基于π³三维先验的单阶段GAGeo,同时预测框、掩码和位姿;以卫星为锚的对比学习支持无三元组的地面到无人机零样本定位,实验在检测、分割和跨域泛化上显著优于现有方法,但增益可能部分来自数据规模。

The Human Creativity Benchmark Figure 1
2026-06-30cs.AI

The Human Creativity Benchmark

Aspen Hopkins, Allison Nulty, Alexandria Minetti, Anoop Pakki, Angad Singh

Massachusetts Institute of Technology, Massachusetts Institute of Technology New York, NY

2026-06-30数据集/基准

论文针对创意类 AI 评测常把专家分歧当作噪声的问题,提出 Human Creativity Benchmark,将创意评价拆成“收敛”的专业共识与“发散”的审美偏好,并在五类创意任务、三个工作阶段收集约 1.5 万条专业判断。结果显示,技术正确性、层级等维度更易形成共识,而审美方向和概念风险更依赖个人品味;没有模型在所有阶段都占优,单一质量分数会掩盖模型应稳定优化与保持可控多样性的差异。

EcoVideo: Entropy-Orchestrated Video Generation Paradigm in Cloud-Edge Dynamics Figure 1
2026-06-30cs.CV

EcoVideo: Entropy-Orchestrated Video Generation Paradigm in Cloud-Edge Dynamics

Jiayu Chen, Hengyi Zhang, Maoliang Li, Minyu Li, Zihao Zheng, Xuanzhe Liu, Guojie Luo, Xiang Chen

2026-06-30视觉感知

EcoVideo针对DiT视频生成逐帧迭代去噪带来的高延迟,以及既有云边协同按去噪步骤静态切分、忽视帧间冗余和系统波动的问题,提出用早期自注意力熵无训练估计帧级信息密度,只让云端大模型生成高熵关键帧,边缘小模型借助运动感知插值与细化补全低熵帧,并随带宽和算力动态调整预算。实验在Wan与CogVideoX等模型上显示质量效率权衡更好,低带宽、边缘算力受限时端到端最高加速2.9倍。

Training Vision-Language-Action Models with Dense Embodied Chain-of-Thought Supervision Figure 1
2026-06-30cs.RO

Training Vision-Language-Action Models with Dense Embodied Chain-of-Thought Supervision

Haoyang Li, Guanlin Li, Youhe Feng, Chen Zhao, Zhuoran Wang, Yang Li, Qizhe Wei, Shifeng Bao, Haitao Shen, Yihan Zhao, Tong Yang, Jing Zhang

Renmin University of China

2026-06-30视觉语言视觉感知

本文针对跨机器人本体训练中低层状态/动作空间难以语义对齐的问题,提出用密集具身思维链监督让VLM学习共享的感知、任务进度、规划与子任务表示,并以DiT动作专家生成连续动作;推理时通过注意力掩码跳过ECoT生成。ZR-0在约6000万帧数据上预训练,在单臂、双臂、人形仿真及xArm实机实验中均表现较强,但具体增益可能也来自数据规模与标注密度。

StereoGS: Sparse-View 3D Gaussian Splatting via Stereo Priors Figure 1
2026-06-30cs.CV

StereoGS: Sparse-View 3D Gaussian Splatting via Stereo Priors

Wenhao Yuan, Yiyuan Ge, Deli Cai

2026-06-30三维

StereoGS针对稀疏视角下3D Gaussian Splatting因几何约束不足而过拟合的问题,核心是用虚拟双目对和基础立体模型提供具有绝对尺度、跨视角一致的深度监督,并结合多视图深度初始化与梯度感知透明度衰减来减少冗余高斯。实验覆盖LLFF、DTU、Mip-NeRF360和Blender,报告在稀疏视角新视角合成中达到SOTA,且推理阶段无额外开销。

Learning from Mistakes: Rollout-Retrieval Lifelong Policy Learning for Autonomous Driving Figure 1
2026-06-30cs.RO

Learning from Mistakes: Rollout-Retrieval Lifelong Policy Learning for Autonomous Driving

Cheng Gong, Haoyang Wang, Chao Lu, Zirui Li, Jianwei Gong

2026-06-30强化学习

论文针对自动驾驶策略在长尾闭环场景中会反复暴露新错误、但传统模仿学习难以利用这些失败经验的问题,提出 R2LPL:从策略自身 rollout 中筛选可恢复的错误状态,检索可行纠正目标,并用回放式终身学习避免遗忘。nuPlan 大规模闭环实验显示,少量迭代即可把中等性能规划器提升到学习式方法 SOTA,尤其在 Test14-hard 等困难长尾场景增益明显。

Orca: The World is in Your Mind Figure 1
2026-06-30cs.CV

Orca: The World is in Your Mind

Yihao Wang, Yuheng Ji, Mingyu Cao, Yanqing Shen, Runze Xiao, Huaihai Lyu, Senwei Xie, Euan Liu, Klara Tian, Tianfeng Long, Yichi Zhang, Zhengliang Cai, Ruike Chen, Jifan Zhao, Ruochuan Shi, Zihan Tang, Jing Lyu, Wenxing Tan, Ningbo Zhang, Yangtao Hu, Yuming Gao, Xiansheng Chen, Junkai Zhao, Congsheng Xu, Boan Zhu, Ziqi Wang, Yupu Feng, Qiongqiong Zhang, Yingli Zhao, Yulong Ao, Shaoxuan Xie, You Liu, Guocai Yao, Leiduo Zhang, Xiaodan Liu, Yunyan Zhang, Yance Jiao, Xinyan Yang, Jiaxing Wei, Xu Liu, Tengfei Pan, Shaokai Nie, Chunlei Men, Sen Cui, Xiaojie Jin, Hongyang Li, Jianlan Luo, Yao Mu, Yunchao Wei, Jun Yan, Hang Zhao, Xiaolong Zheng, Jiaming Li, Yonghua Lin, Tiejun Huang, Zhongyuan Wang, Pengwei Wang

Beijing Academy of Artificial Intelligence

2026-06-30强化学习

Orca针对单一 next-token/frame/action 目标难以支撑通用具身智能的问题,将世界学习表述为 next-state prediction:用视频自监督学习稠密自然状态转移,用语言事件和 VQA 学习稀疏语义转移,并以统一潜空间连接文本、图像和动作读出。论文用 12.5 万小时视频与 1.6 亿事件标注预训练,冻结骨干后仅训练轻量解码器,结果显示随模型和数据扩展读出能力提升,并在同规模下优于专用基线;但具体增益可能主要来自 scaling / data。

$μ$Flow: Leveraging Average Images for Improving Generalisation of Deepfake Faces Detectors Figure 1
2026-06-30cs.CV

$μ$Flow: Leveraging Average Images for Improving Generalisation of Deepfake Faces Detectors

Orazio Pontorno, Mattia Litrico, Luca Guarnera, Mario Valerio Giuffrida, Sebastiano Battiato

2026-06-30视觉感知生成模型

针对深度伪造检测器容易记住已见生成器痕迹、跨 GAN 与扩散模型泛化不足的问题,µFlow 将任务改为仅用真实人脸训练的一类检测。其核心洞察是多图平均会放大生成模型的稳定痕迹,因此用平均图像特征构造更可分的分布,并用归一化流把单图特征对齐到该空间,以似然区分真伪。在 FFHQ 训练、CelebA-HQ 与 WILD 未见生成器测试中,方法显著优于既有检测器,但局限于人脸场景。

HASTE: A Framework for Training-Free, Dynamic, and Steerable Compression of Pre-Trained Convolutional Neural Networks Figure 1
2026-06-30cs.CV

HASTE: A Framework for Training-Free, Dynamic, and Steerable Compression of Pre-Trained Convolutional Neural Networks

Lukas Meiner, Jens Mehnert, Alexandru Paul Condurache

2026-06-30视觉感知

HASTE面向预训练CNN在边缘设备上部署时计算成本高、传统剪枝常需训练或微调且依赖数据的问题,提出可替换卷积模块:推理时用局部敏感哈希按patch识别并合并冗余通道,同时压缩特征与滤波器通道,并用单一超参调节压缩强度。在CIFAR-10和ImageNet多架构实验中,ResNet34在CIFAR-10上可降46.2% FLOPs且精度仅降1.25%,但实际延迟收益与硬件实现效率仍需进一步验证。

3D Scene-Adaptive Trajectory-Controllable Human Image Animation with Camera Movement Figure 1
2026-06-30cs.CV

3D Scene-Adaptive Trajectory-Controllable Human Image Animation with Camera Movement

Deyin Liu, Jicheng Xu, Lin Yuanbo Wu, Xiaowei Zhao, Xiatian Zhu, Zhe Jin, Anjan Dutta

2026-06-30视觉感知规划控制三维

这篇论文针对现有人体图像动画在真实三维场景中难以同时控制人物轨迹与相机运动、易出现悬浮或穿地的问题,提出 3STC-HIA:将动作与重建点云对齐,用地面自适应三维重定向根据地形调整高度和朝向,并通过可见场景掩码的潜空间融合注入几何先验以稳定视角变化。在 RealisDance-Val 和 Trajectory100 上,相比现有方法提升背景一致性、运动平滑度和美学质量,并降低轨迹平移误差。

High-Resolution Flood Mapping With Sentinel-1 and Sentinel-2 via Misalignment-Robust Cross-Sensor Learning and Generative Despeckling Figure 1
2026-06-30cs.CV

High-Resolution Flood Mapping With Sentinel-1 and Sentinel-2 via Misalignment-Robust Cross-Sensor Learning and Generative Despeckling

David Ma, Jeremy Feinstein, Shreya Pandit, Arkaprabha Ganguli, Eugene Yan

2026-06-30生成模型安全鲁棒

针对洪水制图中光学影像受云影和城市干扰、SAR受斑点噪声与跨传感器配准误差影响的问题,论文构建覆盖美国本土的10米级S1/S2水体数据集,并用位移不变损失缓解标签错位、用CVAE生成式去斑保留洪水结构。在UNet/UNet++实验中,S2最高AUPRC达0.956,SAR侧相对传统滤波取得显著提升。

On the Faithfulness of Post-Hoc Concept Bottleneck Models Figure 1
2026-06-30cs.CV

On the Faithfulness of Post-Hoc Concept Bottleneck Models

Laines Schmalwasser, Jan Blunk, Niklas Penzel, Julia Niebling, Joachim Denzler

2026-06-30视觉感知

论文针对事后概念瓶颈模型常以分类准确率证明可解释性的做法提出质疑:随机概念投影也能取得竞争性精度,说明高性能不等于概念忠实。作者从投影本身分析两类失真来源,即辅助概念数据的协变量偏移和视觉语言模型伪标签的系统性噪声,并给出误差界与新评估指标。在 CUB、CIFAR 和合成数据上,这些指标能发现准确率掩盖的不忠实现象。

RBE-Flow: Recurrent Bayesian Estimation on Feature Manifolds for Cross-Modal Registration Figure 1
2026-06-30cs.CV

RBE-Flow: Recurrent Bayesian Estimation on Feature Manifolds for Cross-Modal Registration

Mengzhu Ding, Xin Song, Xiaoke Ding, Hongwei Ding, Xuecong Liu

2026-06-30生成模型

针对光学-SAR、可见光-红外等跨模态配准中辐射差异和形变导致的非凸、易误匹配问题,RBE-Flow把稠密光流估计建模为特征流形上的循环贝叶斯估计:RMO用特征度量最小二乘产生带不确定性的观测,UAPU再用sigma点后验融合并反向调节下一步阻尼。实验在OSdataset、WHU-OPT-SAR和RoadScene上报告优于现有方法,尤其提升严格亚像素指标。

PGE-SAM: Prompt-Guided Feature Enhancement for Interactive Segmentation under Degradation Figure 1
2026-06-30cs.CV

PGE-SAM: Prompt-Guided Feature Enhancement for Interactive Segmentation under Degradation

Tuan-Duc Nguyen, Anh-Tuan Mai, Duc-Trong Le

FPT Software AI Center VNU University of Engineering and Technology

2026-06-30视觉感知

这篇论文针对 SAM 在噪声、模糊、压缩及医学成像伪影下交互式分割明显退化的问题,指出已有方法全局修复特征且忽略多轮提示。PGE-SAM 用提示与上一轮掩码生成空间引导,只强化目标区域,并结合多尺度低层特征与前景重建损失;同时构建退化医学分割基准 DM-Seg。实验显示其在医学和自然图像多种退化强度下优于 RobustSAM、GleSAM 等,并以更少新增参数保持干净图像泛化。

PS-MOT: Cultivating Instance Awareness from Point Seeds for Multi-Object Tracking Figure 1
2026-06-30cs.CV

PS-MOT: Cultivating Instance Awareness from Point Seeds for Multi-Object Tracking

Kai Luo, Fei Teng, Mengfei Duan, Wanjun Jia, Xu Wang, Hao Shi, Kunyu Peng, Zhiyong Li, Kailun Yang

2026-06-30视觉感知

这篇论文针对多目标跟踪对逐帧框标注依赖过重、难以扩展到拥挤或具身场景的问题,提出点监督 PS-MOT。核心思路是用点种子经 TFP 生成时序一致伪标签,PEWA 从频域补足边界线索,UGL 以不确定性建模缓解伪标签噪声。实验覆盖 DanceTrack、EmboTrack、SportsMOT、JRDB,显示其在点监督设定下达到新 SOTA,并将人工标注时间约降 64%。

FR-DETR: Frequency and Recurrent Feature Refinement for Robust Object Detection under Adverse Weather Figure 1
2026-06-30cs.CV

FR-DETR: Frequency and Recurrent Feature Refinement for Robust Object Detection under Adverse Weather

Tuan-Duc Nguyen, Duc-Trong Le

FPT Software AI Center, VNU University of Engineering and Technology

2026-06-30视觉感知安全鲁棒

本文针对雾、雨、雪等恶劣天气下目标检测因图像退化和域偏移而失效的问题,指出先增强图像再检测会重复提取特征、计算开销大且与检测目标不对齐。FR-DETR将增强迁移到检测器特征空间,在RT-DETR中加入频率细化模块分离重加权高低频线索,并用递归聚焦细化模块依据粗预测迭代强化候选区域。实验称其在多基准上较增强式方案取得更高检测精度且显著提升效率。

Cross-Resolution Semantic Transfer for Robust Text-to-Image Retrieval in Low-Resolution Surveillance Figure 1
2026-06-30cs.CV

Cross-Resolution Semantic Transfer for Robust Text-to-Image Retrieval in Low-Resolution Surveillance

Wenjie Qian, Bin Yang, Xiao Wang, Wenke Huang, Ling Mei, Xin Xu, Mang Ye

a School of Computer Science and Technology, Wuhan University of Science and Technology, b School of Computer Science, National Engineering Research Center for Multimedia Software, Wuhan University, c Hubei Province Key Laboratory of Intelligent Information Processing and Real-time Industrial System, Wuhan University of Science and Technology

2026-06-30视觉感知安全鲁棒

面向真实监控中高低分辨率图像混杂导致的文本行人检索失效,论文将问题归纳为低清视觉证据不可靠和排序分布漂移两类,并提出 CRST:用分辨率条件推理抑制受损 token、文本引导细化补回语义线索,再以高分辨率邻域结构约束低分辨率排序。三大 TIPR 数据集上,Ultra-LR 的 Rank-1 和 mAP 平均提升 5.7% 与 5.3%,且基本不牺牲高分辨率性能。

Vision-Language-Action Models: Experimental Insights from a Real-World UR5 Platform Figure 1
2026-06-30cs.RO

Vision-Language-Action Models: Experimental Insights from a Real-World UR5 Platform

Mathilde Hochedel, Marc Lalonde

2026-06-30视觉语言视觉感知强化学习

本文动机是检验开放式视觉-语言-动作模型能否从基准环境迁移到真实UR5e机械臂。作者搭建了采集、RLDS转换、微调与部署流程,并比较OpenVLA/OpenVLA-OFT的实机表现。主要洞察是瓶颈不只在模型能力,而在动作语义、坐标系、时序对齐、图像预处理和数据覆盖等系统一致性;结果显示离线指标虽有希望,但闭环实机执行仍不稳定。

Robust and Efficient Monocular 3D Gaussian SLAM for Kilometer-Scale Outdoor Scenes Figure 1
2026-06-30cs.CV

Robust and Efficient Monocular 3D Gaussian SLAM for Kilometer-Scale Outdoor Scenes

Sicheng Yu, Dongxu Shen, Beizhen Zhao, Guanzhi Ding, Hao Wang

2026-06-30三维安全鲁棒

本文针对单目 3D Gaussian SLAM 在公里级户外场景中易漂移、显存随轨迹膨胀的问题,提出 KiloGS-SLAM:用运动自适应三层跟踪在 Essential、PnP 与按需基础模型间切换,并以生命周期管理的高斯初始化、分块多视图增删控制冗余。实验覆盖 Waymo、KITTI、KITTI-360,显示其在单 GPU 上可处理超万帧序列,并取得更好的位姿精度与渲染质量。

OWMDrive: Causality-Aware End-to-End Autonomous Driving via 4D Occupancy World Model Figure 1
2026-06-30cs.CV

OWMDrive: Causality-Aware End-to-End Autonomous Driving via 4D Occupancy World Model

Junjie Cheng, Ruiqi Song, Ye Wu, Nanxing Zeng, Ximiao Li, Yunfeng Ai

2026-06-30强化学习

OWMDrive针对端到端自动驾驶常只依赖当前/历史静态表征、在遮挡和突发事件下规划不稳或保守的问题,引入4D占用世界模型预测多步未来3D占用,并将其作为条件先验指导扩散式轨迹生成,再用强化学习优化轨迹质量与稳定性。开放环和闭环实验显示,该方法提升了规划可靠性与安全性,尤其在部分可观测和复杂交互场景中更明显;但性能仍依赖世界模型预测精度,长尾不确定场景下误差传播风险文中也承认存在。

Beyond Point Estimates for Glaucoma Visual Field Forecasting with Diffusion Models Figure 1
2026-06-30cs.CV

Beyond Point Estimates for Glaucoma Visual Field Forecasting with Diffusion Models

Marta Colmenar Herrera, Pablo Márquez Neila, Şerife Seda Kucur Ergünay, Martin S. Zinkernagel, Raphael Sznitman

2026-06-30生成模型

青光眼视野进展受个体差异、治疗和测量噪声影响,同样历史可能对应多种未来,单点预测容易掩盖风险。本文将视野预测改写为条件分布建模,用带时间与空间位置编码的条件扩散模型从不规则纵向检查中采样多个未来视野。两套独立队列实验显示,其分布校准较好;取均值作点预测时也优于线性临床基线和既有学习方法。

SA-Homo: Scale Adaptive Homography Estimation for Scale Variation Scenarios Figure 1
2026-06-30cs.CV

SA-Homo: Scale Adaptive Homography Estimation for Scale Variation Scenarios

Shangxuan Xie, Haifeng Wu, Yuhang Wang, Huarong Jia, Wen Li

Huarong Jia is with Beijing Institute of

2026-06-30视觉感知

本文针对尺度差异场景下单应性估计易因大位移、局部外观不一致和外点匹配而退化的问题,提出 SA-Homo:先用较重的 SDBM 结合多尺度线性注意力与跨尺度全局相似矩阵做初始尺度对齐,并用 RANSAC 抑制外点,再由轻量 IHERM 基于局部相关迭代精修。实验称其在 MSCOCO、RGB-NIR 及新建高分辨率多模态卫星 HMSA 数据集上优于现有方法,且在最高 8× 尺度差异下仍保持较高精度。

SADL: What to Ignore? A Benchmark for Subject-Aware Distractor Localization Figure 1
2026-06-30cs.CV

SADL: What to Ignore? A Benchmark for Subject-Aware Distractor Localization

Cao-Tri Nguyen, Nguyen-Khoa Luong, Vinh-Tiep Nguyen, Minh-Triet Tran

University of Science, Vietnam National University Ho Chi Minh City, University of Information Technology, John Von Neumann Institute, Vietnam National University Ho Chi Minh City Ho Chi Minh City Vietnam

2026-06-30数据集/基准

这篇论文针对照片编辑中“删什么”仍需人工判断的问题,指出干扰物应随用户指定主体而变化,不能只靠通用显著性或开放词表检测。作者提出主体感知干扰物定位任务和 SADL 基准,含 1000 张照片、1800 个主体案例及硬负例,并用五类纳入因素、三类排除规则诊断 VLM。结果显示模型会识别潜在干扰物,但常过度触发排除规则而漏掉真干扰物,开放检测还明显受空间 grounding 限制。

RenderFormer++: Scalable and Physically Grounded Feed-Forward Neural Rendering Figure 1
2026-06-30cs.GR

RenderFormer++: Scalable and Physically Grounded Feed-Forward Neural Rendering

Huangsheng Du, Haoran Zhu, Youcheng Cai, Jinyang Meng, Ligang Liu

University of Science and Technology of China, University of Science and Technology of China Hefei China

2026-06-30视觉感知

本文针对基于 Transformer 的前馈神经渲染在三角网格全局光照中物理一致性不足、三角级注意力难以扩展的问题,提出 RenderFormer++:用 PITG 将渲染方程偏置和传输一致性损失注入注意力,并用 HOCT 把三角特征聚合为对象级 token 以降低开销。实验声称在复杂大场景上获得更稳定、可泛化且更高效的全局光照结果,但具体增益来源仍可能受模型规模与数据设置影响。

OmniCoT: A Benchmark for Global and Multi-Step Panoramic Reasoning Figure 1
2026-06-30cs.CV

OmniCoT: A Benchmark for Global and Multi-Step Panoramic Reasoning

Haocong He, Chenfei Liao, Zichen Wen, Zihao Dongfang, Xu Zheng, Bin Ren, Chang Su, Zixin Zhang, Harold Haodong Chen, Hongfei Zhang, Weijia Li, Kailun Yang, Conghui He, Xuming Hu, Nicu Sebe, Linfeng Zhang

2026-06-30数据集/基准

OmniCoT针对现有全景推理基准多停留在局部线索和少步问题、难以检验具身场景中360°全局理解的不足,构建了含评测集、真实子集和带逐步CoT训练集的全景空间推理套件,并以See-Locate-Move组织多跳任务。实验显示,当前MLLM在答案正确率和推理质量上仍有明显短板,真实全景子集暴露出较大Sim-to-Real差距;OmniCoT-R1通过SFT与GRPO提供了更强基线,但具体增益可能部分来自数据与训练规模。

FlowAWR: Online Adaptive Flow Reinforcement via Advantage-Weighted Rectification Figure 1
2026-06-30cs.LG

FlowAWR: Online Adaptive Flow Reinforcement via Advantage-Weighted Rectification

Zheming Fu, Ruizhe He, Wei Shang, Xiaoxiao Ma, Lei Wang, Chang Liu, Siming Fu

Beihang University, 2 Joy Future Academy, 3 Zhongguancun Academy, 4 Zhejiang University, University of Science and Technology of China, Labs et al., 2024

2026-06-30生成模型

这篇论文针对连续流/扩散生成模型做在线强化学习时轨迹似然不可 tractable、SDE 近似带来训练-推理不一致且依赖 CFG 的问题,提出 FlowAWR:从 KL 约束最优策略推导最优速度场,把策略优化转为按组内优势加权的速度场回归。实验在 SD3.5-Medium 上显示其单奖励收敛较 DiffusionNFT 快 2–5 倍,并在多奖励约束下保持较稳定质量。

Set-Inclusive Uncertainty Modeling for Robust Brain Tumor Segmentation Figure 1
2026-06-30cs.CV

Set-Inclusive Uncertainty Modeling for Robust Brain Tumor Segmentation

Seunghun Baek, Jihwan Park, Jaeyoon Sim, Hoseok Lee, Seungjoo Lee, Won Hwa Kim

2026-06-30视觉感知安全鲁棒

针对临床多模态 MRI 常因缺失序列而使脑肿瘤分割过度依赖不可靠“补全”特征的问题,本文将不同模态组合的表征建模为高斯分布,用均值承载任务信息、方差刻画缺失证据的不确定性,并利用子集—超集层级约束让缺失越多不确定性越高。在 BraTS 2018/2020 多种缺模态场景中,方法相较 RFNet、M3AE、DC-Seg 等基线取得更稳健的分割表现。

MUSE: Unlocking Timestep as Native Task Steering for One-Step Dense Prediction Figure 1
2026-06-30cs.CV

MUSE: Unlocking Timestep as Native Task Steering for One-Step Dense Prediction

Shuo Zhou, Zhaoxin Li, Xiujuan Chai

2026-06-30视觉感知

面向单目深度与法线等密集预测的统一建模,MUSE关注现有扩散多任务方法依赖额外适配器、专家或任务 token 带来的冗余。其核心洞察是:一步扩散中固定的 timestep 嵌入可直接作为无参数任务开关,用不同离散时间步引导共享 U-Net/DiT 投向不同任务流形。实验覆盖10个数据集,显示在深度和法线估计上具竞争力,并支持流形解耦解释。

CouCE: A Unified Causal Framework for Debiased Deep Metric Learning Figure 1
2026-06-30cs.CV

CouCE: A Unified Causal Framework for Debiased Deep Metric Learning

Xin Yuan, Zhenyang Niu, Meiqi Wan, Huilin Zhu, Xin Xu, Kui Jiang

Wuhan University of Science and Technology, Harbin Institute of Technology, Wuhan University of Science and Technology Wuhan China, Harbin Institute of Technology Harbin China

2026-06-30视觉感知

本文针对深度度量学习在零样本检索中易依赖背景共现、姿态光照等捷径的问题,提出 CouCE 因果框架,将背景虚假相关与前景非语义扰动区分为两类混杂,并用 ODBA 字典正交调整和 MSRCI 多尺度傅里叶干预联合去偏。其可接入代理损失且推理无结构开销,在 CUB、Cars 和 SOP 上报告达到 SOTA,但具体增益对各模块与训练开销的归因仍需结合消融判断。

ReactiveBFM: Reactive Closed-Loop Motion Planning Towards Universal Humanoid Whole-Body Control Figure 1
2026-06-30cs.RO

ReactiveBFM: Reactive Closed-Loop Motion Planning Towards Universal Humanoid Whole-Body Control

Xiao Chen, Weishuai Zeng, Xiaojie Niu, Zirui Wang, Jianan Li, Huayi Wang, Furui Xu, Jiahe Chen, Weixiang Zhong, Lihe Ding, Kailin Li, Jiangmiao Pang, Tai Wang, Tianfan Xue, Jingbo Wang

The Chinese University of Hong Kong, Shanghai AI Laboratory

2026-06-30机器人规划控制

本文针对人形机器人 BFM 只能跟踪预定义参考、难以应对扰动和任务变化的问题,提出 ReactiveBFM,将自回归运动扩散规划器与全身控制器闭环耦合。关键在于用 scheduled prefix sampling 让规划器从带误差的真实状态中学习恢复,并用异步重规划与轨迹分块缓解生成和控制频率不匹配。Unitree G1 实机实现零样本移动目标到达 90% 成功率,仿真扰动基准达 93.1% 成功率、2.0% 跌倒率。

On the Vulnerability of Parameter-Level Defenses to Model Merging Figure 1
2026-06-30cs.LG

On the Vulnerability of Parameter-Level Defenses to Model Merging

Kuangpu Guo, Qingyan Zheng, Jian Liang, Yongcan Yu, Zilei Wang, Ran He, Tieniu Tan

University of Science and Technology of China, NLPR & MAIS, Institute of Automation, Chinese Academy of Sciences, School of Artificial Intelligence, University of Chinese Academy of Sciences, Nanjing University, ARF effectively defeats the proposed attack. Our code is available at, adversaries can effortlessly aggregate publicly available checkpoints to inherit

2026-06-30视觉感知

针对模型合并让“搭便车者”可未经授权复用专用模型能力的问题,论文指出现有参数级防御依赖线性变换,但受保护任务向量相对预训练权重小两到三个数量级,模型仍被公共预训练锚点主导;据此提出 AGA,通过最小二乘与匈牙利算法解析恢复变换。跨视觉与 NLP 实验显示,AGA 可绕过单一和组合防御,合并性能最高恢复到未保护模型的 97%,并提出 ARF 作为缓解方案。

Residual-Guided Expert Specialization for Incomplete Multimodal Learning Figure 1
2026-06-30cs.CV

Residual-Guided Expert Specialization for Incomplete Multimodal Learning

Seunghun Baek, Jihwan Park, Jaeyoon Sim, Minjae Jeong, Hoseok Lee, Won Hwa Kim

2026-06-30视觉语言

这篇论文针对推理阶段模态缺失导致多模态表征系统性偏离的问题,提出 MARS:训练时用完整与不完整输入表征之差作为“残差信号”指导 MoE 专家分工,并让仅看不完整特征的路由器模仿该决策;同时用差异感知噪声和采样缓解训练/测试路由落差。实验覆盖分类与分割数据集,报告在多种缺失组合下优于 DMRNet、MoMKE、SimMLM 等基线且计算开销较低。

FastPano3D: Feed-Forward Indoor Panoramic 3D Reconstruction from a Single Image Figure 1
2026-06-30cs.CV

FastPano3D: Feed-Forward Indoor Panoramic 3D Reconstruction from a Single Image

Jianqiang Li, Liumei Zhang, Wenjia Guo, Tianlong Feng, Yongzhi Liao, Di Lu, Hanchi Ren, Jingjing Deng

2026-06-30视觉感知三维

针对单张室内全景图重建通常依赖多视角或逐场景优化、难以快速部署的问题,FastPano3D将ERP畸变感知的轻量编码器、自适应高斯采样、点云引导几何细化与cubemap渲染结合,直接前馈生成可渲染3D Gaussian场景。实验称其在数秒内完成重建,相比Pano2Room最高提速156倍且参数约减半,渲染质量接近NeRF/3DGS方法,但具体泛化范围仍需更多验证。

FFAvatar: Feed-Forward 4D Head Avatar Reconstruction from Sparse Portrait Images Figure 1
2026-06-30cs.CV

FFAvatar: Feed-Forward 4D Head Avatar Reconstruction from Sparse Portrait Images

Jianjiang Yao, Ke Xian, Renxiang Dai, Robert Caiming Qiu

2026-06-30视觉感知三维

面向单张或少量肖像下4D头部数字人难以兼顾身份一致性、可驱动性与效率的问题,FFAvatar用Transformer交替注意力聚合可变视角并解耦身份、表情和视角,在FLAME先验上构建统一canonical高斯场,再以稀疏到稠密UV表示补细节,并加入运动细化模块。实验显示其能增量利用更多参考图,生成更高保真、可控且跨表情视角更稳定的头像。

Early Cue Precision Shapes Visual Shortcut Learning in Controlled Cue-Manipulation Benchmarks Figure 1
2026-06-30cs.CV

Early Cue Precision Shapes Visual Shortcut Learning in Controlled Cue-Manipulation Benchmarks

Chanho Park, Woochan Lee, Janyeong Oh, Geongho Gong, Minshu Kim, Yeachan Kwak, Seongim Choi

Gwangju Institute of Science and Technology, Gwangju, Republic of Korea

2026-06-30机器人强化学习规划控制数据集/基准

这篇论文关注视觉模型在匹配分布上准确、却在纹理与目标冲突时依赖捷径的问题,核心洞察是早期低层线索的标签可靠性比单纯输入退化更决定后续纹理偏置。作者通过合成形状-纹理、序列数字、冻结表征和 CIFAR-10 纹理覆盖基准操控 cue precision,发现 cue 越早越可靠,冲突准确率显著下降、纹理选择率上升;即使先低精度训练,后续捷径丰富微调也会迅速抹除收益。

A Classifier-Agnostic Zero-Shot Adversarial Attack Detection via CLIP Figure 1
2026-06-30cs.CV

A Classifier-Agnostic Zero-Shot Adversarial Attack Detection via CLIP

Hodaya Krakover, Meir Yossef Levi, Eyal Gofer, Guy Gilboa

2026-06-30视觉感知

针对现有对抗样本检测常依赖攻击类型、对抗数据或目标分类器的问题,本文提出 A4D:利用 CLIP 对细微非语义扰动敏感且嵌入偏移具有方向性的现象,将图像与一组噪声/篡改提示词的相似度经标准化与 PCA 聚合成检测分数。实验覆盖多种攻击、数据集和分类器,在攻击与架构无关的零样本黑盒设置下取得 SOTA 检测表现。

UniGP: Taming Diffusion Transformer for Prior-Preserved Unified Generation and Perception Figure 1
2026-06-30cs.CV

UniGP: Taming Diffusion Transformer for Prior-Preserved Unified Generation and Perception

Qin Guo, Hao Luo, Dongxu Yue, Weixuan Jin, Xiao Fu, Fan Wang, Dan Xu

The Hong Kong University of Science and Technology, DAMO Academy, Alibaba Group, Zhejiang, China, Hupan Lab, Zhejiang Province, Zhejiang University, Zhejiang, China, Tsinghua University, The Chinese University of Hong Kong, Zeekr Automobile R&D Co., Ltd.

2026-06-30生成模型

UniGP针对扩散模型中可控生成与深度/法线等密集感知长期分开建模、难以互相利用先验的问题,在MMDiT上仅复制图像分支形成DUGP,并用统一数据与二值损失联合训练异构任务。结果显示其在统一模型中同时支持图像-几何联合生成、条件生成和密集预测,优于既有统一方法并接近专用模型;但参数与推理开销明显增加。

Optimizing Image Preparation and Compression for Face Recognition within 1024 Bytes Figure 1
2026-06-30cs.CV

Optimizing Image Preparation and Compression for Face Recognition within 1024 Bytes

Paul Andreas, Torsten Schlett, Christoph Busch

Department of Computer Science, Hochschule Darmstadt, Schöfferstraße 3, 64295, Darmstadt, Germany

2026-06-30视觉感知

这篇论文面向临时旅行证件无法使用 RFID、需把 ICAO 人脸照塞进 2D 条码的场景,研究如何在 1024 字节内兼顾压缩与人脸识别。其核心不是只比较格式,而是联合优化分辨率、灰度/彩色、平滑等预处理和 JPEG AI、AVIF、WebP 等编码参数。结果显示 JPEG AI 综合最好,AVIF/WebP 接近;高质量正脸比对中灰度有利,低质量探针则保留颜色更稳,强压缩造成的识别损失相对较小。

BrainJanus: A Unified Model for Understanding and Generation across Brain, Vision, and Language Figure 1
2026-06-30cs.CV

BrainJanus: A Unified Model for Understanding and Generation across Brain, Vision, and Language

Haitao Wu, Qirui Zhang, Zhouheng Yao, Shangquan Sun, Qihao Zheng, Mianxin Liu, Chi Zhang, Wanli Ouyang, Chunfeng Song, Changqing Zhang, Jiamin Wu

2026-06-30视觉感知

这篇论文针对脑编码与脑解码长期被拆成单向任务、且过度依赖 CLIP/扩散模型等外部先验的问题,提出 BrainJanus:用统一脑 tokenizer 将连续 fMRI 动态离散化,并与视觉、语言 token 对齐到共享 Omni 空间,再用自回归 Transformer 做图像/文本到脑信号及脑信号到图像/文本的任意转换。实验显示其在多类编码、解码基准上优于任务专用模型,并具备零样本泛化和可解释皮层拓扑,但具体增益中 scaling / data 贡献仍需进一步拆分。

Real-Time Underwater Image Enhancement via Frequency-Guided Dual-Path Attention Figure 1
2026-06-30cs.CV

Real-Time Underwater Image Enhancement via Frequency-Guided Dual-Path Attention

Leshen Zhang, Ao Li, Ce Zhu

2026-06-30视觉感知

面向AUV和嵌入式水下视觉对低时延、小模型的需求,论文指出现有重参数化轻量CNN虽快但缺少频域感知,难以处理吸收与散射造成的颜色和纹理退化。方法在训练中用可折叠的固定DCT方向先验增强卷积频谱表达,并用FFT幅值构造双路径注意力进行轻量调制;在UIEB上以4.23K参数达到600+ FPS,并声称优于更大模型。

TRACE: A Concept Bottleneck Model for Longitudinal 3D Glioblastoma Response Assessment Figure 1
2026-06-30cs.CV

TRACE: A Concept Bottleneck Model for Longitudinal 3D Glioblastoma Response Assessment

Alia Tarek, Hamsa Saberr, Hamza Elghonemy, Youssef Afify, Tamer Basha, Omair Shahzad Bhatti, Abdulrahman M. Selim, Hasan Md Tusfiqur Alam Daniel Sonntag

Department of Biomedical and Healthcare Data Engineering, Faculty of Engineering, Cairo University, Giza, Egypt, German Research Center for Artificial Intelligence (DFKI), Saarbrücken, Germany, University of Oldenburg, Oldenburg, Germany

2026-06-30三维

针对胶质母细胞瘤纵向 MRI 疗效评估中需按 RANO 比较细微时序变化、而黑箱模型难以核查的问题,TRACE 将三维孪生视觉编码器与概念瓶颈结合,把肿瘤测量、百分比变化、阈值和新病灶等组织成可干预的 RANO 有向概念图。其在 LUMIERE 五折验证中取得 4 类 macro F1 0.4769、进展二分类 macro F1 0.7085,优于概念瓶颈基线但仍受小样本和类别不平衡限制。

A Point Cloud Transformer for Remote Monitoring and Automated Assessment of Physical Rehabilitation Exercises Figure 1
2026-06-30cs.CV

A Point Cloud Transformer for Remote Monitoring and Automated Assessment of Physical Rehabilitation Exercises

Kazi Rafat, Md. Ismail Hossain, M M Lutfe Elahi, Sifat Momen, Fuad Rahman, Nabeel Mohammed, Shafin Rahman

Department of Electrical and Computer Engineering, North South University, Dhaka, Bangladesh

2026-06-30三维

针对居家康复训练缺少专家监督、人工评估成本高且既有骨架建模易丢失关键时空关系的问题,论文将RGBD关节序列视作三维点云,引入曲线式点云聚合增强关节几何与位置特征,并用轴向注意力降低Transformer建模成本、突出关键关节。实验在Kimore、UI-PRMD和IRDS上报告优于现有方法,同时强调模型较小、推理较快,适合远程自动评分场景。

The Surprising Effectiveness of Video Diffusion Models for Hand Motion Reconstruction Figure 1
2026-06-30cs.CV

The Surprising Effectiveness of Video Diffusion Models for Hand Motion Reconstruction

Yuxi Wang, Chengkai Jin, Yufei Liu, Wenqi Ouyang, Tianyi Wei, Zhiwei Zeng, Siyuan Huang, Zhiqi Shen, Xingang Pan

Nanyang Technological University, Shanghai Jiao Tong University

2026-06-30视觉感知生成模型三维

本文针对第一视角视频中双手在遮挡和交互下难以稳定重建的问题,提出 ViDiHand:将预训练视频扩散模型的时空、几何和遮挡先验,通过手部覆盖渲染任务适配为手感知特征,再用双分支解码器恢复公尺度 4D 手姿态。方法无需检测器、补帧器或测试时优化,在 ARCTIC、HOT3D、HOI4D 上显著优于既有方法,尤其提升遮挡场景下的检测稳定性、运动平滑性和姿态精度。

DreamForge-World 0.1 Preview: A Low-Compute Real-Time Controllable World Model Figure 1
2026-06-30cs.LG

DreamForge-World 0.1 Preview: A Low-Compute Real-Time Controllable World Model

Daniyel Ayupov, Artur Markov-Tsoy

2026-06-30强化学习规划控制

本文关注实时可控世界模型在算力、延迟与长程一致性之间的取舍,目标是在消费级 GPU 上实现可交互预览。核心做法是改造 LongLive/Wan 自回归视频先验,加入 Matrix-Game 风格残差动作通路,并用多模态前缀初始化闭环生成。系统支持键鼠控制、文本/图像/视频进入、中途改提示和第一/第三人称视角,480p 下单 RTX 4090 可达 14–15 FPS;但持久空间记忆、重访一致性和精确物理控制仍不足。

VisReflect: Latent Visual Reflection for Fine-Grained Perception in Long Visual Context Figure 1
2026-06-30cs.CV

VisReflect: Latent Visual Reflection for Fine-Grained Perception in Long Visual Context

Xiaoqian Shen, Mohamed Elhoseiny

2026-06-30视觉感知

VisReflect针对高分辨率图像和长视频中视觉 token 过多导致的注意力沉降、细粒度目标或关键片段难以定位问题,提出不再生成离散框/时间段并二次裁剪,而是在潜空间生成与问题相关的视觉反思表示,引导模型单次前向重聚焦相关区域或帧。实验在BLINK、HRBench、VideoMME等基准上较基线提升图像4.1%、视频1.8%,并较缩放式方法降低约44%视频推理时间。

Intermediate Text Representation Guided Text-to-Image Generation for Enhancing One-and-Only Alignment Figure 1
2026-06-30cs.CV

Intermediate Text Representation Guided Text-to-Image Generation for Enhancing One-and-Only Alignment

Soyoun Won, Aryan Yazdan Parast, Basim Azam, Jean Honorio, Naveed Akhtar

The University of Melbourne, Australia

2026-06-30视觉感知

本文针对文生图模型在地球、蒙娜丽莎等“唯一形态”对象上容易被既有视觉先验压制、难以遵循反事实提示的问题,指出最终文本嵌入会丢失中间层仍保留的概念信息,并提出无需训练的 IR-guided diffusion,在早期去噪注入文本编码器中间表示。作者还构建 OAO-AttackBench,实验显示在四个基准上最高提升 19.1 个百分点 VQAScore,同时基本保持图像质量和人类偏好。

Your Data Manifold is Secretly a Reward Model: Shell-LCC for Text-to-Video Generation Figure 1
2026-06-30cs.CV

Your Data Manifold is Secretly a Reward Model: Shell-LCC for Text-to-Video Generation

Shihao Zhang, Yuguang Yan, Junzhe Zhang, Wei Zhao, Bohan Wang, Hanwang Zhang

2026-06-30视觉感知强化学习

该文针对文本生成视频后训练依赖人工偏好或外部奖励模型、成本高且难改善局部细节的问题,提出将高质量 SFT 数据的时空 patch 流形视为内生奖励。其核心是 Shell-LCC:在 LCC 基础上避免均值回归,把高维数据高密度区域建模为各向同性壳面,并用点到流形的可微几何约束指导生成。实验称该方法在专有和开源 T2V 模型上提升真实感与高频细节,减少过平滑和运动模糊,且不牺牲语义对齐与时序一致性。

Semantic-Driven Scale and Spatial Selection for Efficient Cross-Modal Alignment in Referring Remote Sensing Image Segmentation Figure 1
2026-06-30cs.CV

Semantic-Driven Scale and Spatial Selection for Efficient Cross-Modal Alignment in Referring Remote Sensing Image Segmentation

Kun Li, Shengxi Gui, Francesco Nex, Michael Ying Yang

University of Liverpool, UK, University of Michigan, USA, University of Twente, NL, University of Bath, UK

2026-06-30视觉感知

这篇论文针对遥感指代表达分割中全量微调开销大、易破坏预训练表征且难以处理航拍尺度变化的问题,提出 S4ECA 参数高效框架:用文本适配器提炼语义代理,并以语言引导的多尺度与空间选择筛除冗余背景、强化跨模态对齐。实验称在 RRSIS-D 和 RefSegRS 上仅更新 2.4% 骨干参数即可达到 SOTA,主要贡献在效率与复杂航拍场景定位精度。

From Accuracy to Visual Dependence: Auditing and Filtering Modality Collapse in Traffic VideoQA Figure 1
2026-06-30cs.CV

From Accuracy to Visual Dependence: Auditing and Filtering Modality Collapse in Traffic VideoQA

Sena Korkut, María Alejandra Bravo Sarmiento, Sanghwan Kim, Zeynep Akata

2026-06-30视觉感知

这篇论文针对交通事故 VideoQA 中“高准确率未必使用视觉证据”的评测失真问题,提出 Blind Gap、Visual Gain 和实例级 Shortcut Score 来审计并过滤文本捷径题。结果显示多个 VLM 在无视频时仍表现接近甚至更好,MM-AU 加入视频反而降分;过滤后子集降低文本可解性、提升视觉增益,说明安全关键 VideoQA 需评估视觉依赖而非只看准确率。

Efficient RGB-T Object Detection via Sparse Cross-Modality Fusion Figure 1
2026-06-30cs.CV

Efficient RGB-T Object Detection via Sparse Cross-Modality Fusion

Chao Tian, Zikun Zhou, Chao Yang, Guoqing Zhu, Zhenyu He

2026-06-30视觉感知

针对RGB-T检测常用双主干与全图密集跨模态融合导致计算量过高的问题,论文提出SFEDet:先用轻量单模态检测器高召回筛出候选区域,再仅在稀疏RoI上做跨模态融合、误检过滤与框回归细化,并用Rolling Convolution和去噪训练提升效率与鲁棒性。实验在FLIR、M3FD、LLVIP上显示其以更少参数和更低计算成本取得有竞争力的精度,且对高分辨率图像更具扩展性。

A Multi Center Breast FNAC Whole-Slide Cytology Dataset for AI-Assisted Patch-Wise Classification Using C1 to C5 Reporting Categories Figure 1
2026-06-30cs.CV

A Multi Center Breast FNAC Whole-Slide Cytology Dataset for AI-Assisted Patch-Wise Classification Using C1 to C5 Reporting Categories

Garima Jain, Abhijeet Patil, Surabhi Jain, Sanghamitra Pati, Amit Sethi, Sandeep Mathur, Pulkit Verma, Nishi Halduniya, Jatin Kashyap, Sharat Kumar, Simmi Kharb, Sunita Singh, Sucheta Devi Khuraijam, Sushma Khuraijam, Ratan Konjengbam, Arvind Kumar, Deepali Tirkey, Saurav Banerjee, Shivani Kalhan, Rakesh Kumar Gupta, Ranjana Solanki, Deepika Hemranjani, Shashank Nath Singh, Uma Handa, Manveen Kaur, B. G. Malathi, Yogender P., Niraj Kumari, Shruti Gupta, Indu R. Nair, Vidya C., Basumitra Das, Sunil Kumar Komanapalli, Ravindra Karle, Tanaya Kulkarni, Vandana Raphael, Biswajit Dey, Vaishali Gaikwad, Nilam Adhav

Indian Council of Medical Research-National Institute for Research in Digital Health & Data Science, New Delhi, Department of Electrical Engineering, Indian Institute of Technology Bombay, Mumbai, Department of Pathology, All India Institute of Medical Sciences, New Delhi, Department of Biochemistry, Pt. B.D. Sharma Post Graduate Institute of Medical Sciences, Rohtak, Department of Pathology, Pt. B.D. Sharma Post Graduate Institute of Medical Sciences, Rohtak, Department of Pathology, Regional Institute of Medical Sciences, Imphal, Department of Pathology, Rajendra Institute of Medical Sciences, Ranchi, Government Institute of Medical Sciences, Greater Noida, Department of Pathology, Sawai Man Singh Medical College, Jaipur, Department of Otorhinolaryngology, Sawai Man Singh Medical College, Jaipur, Department of Pathology, Government Medical College and Hospital, Chandigarh, Department of Pathology, Mandya Institute of Medical Sciences, Mandya

2026-06-30数据集/基准

这篇论文面向乳腺细针穿刺细胞学中缺少多中心、可复现 C1–C5 分级基准的问题,发布来自印度多家医疗中心的全玻片数据集:321 名患者、470 张 WSI、7398 个专家核验 patch,并提供 GeoJSON 标注、元数据与复用代码。其主要贡献在于把原始 WSI 与 patch 标签同时开放,支持从局部分类到后续切片级辅助诊断的研究;但论文重点是数据资源建设,未报告模型性能增益。

SHOVIR: A Benchmark for Evaluating Vision Shortcut Learning in Radiology Report Generation Figure 1
2026-06-30cs.CV

SHOVIR: A Benchmark for Evaluating Vision Shortcut Learning in Radiology Report Generation

Filippo Ruffini, Marco Salmé, Rosa Sicilia, Valerio Guarrasi, Paolo Soda

Unit of Artificial Intelligence and Computer Systems, Department of Engineering, Department of Diagnostics and Intervention, Radiation Physics, Biomedical Engineering, Umeå University, Umeå, Sweden, UniCamillus-Saint Camillus International University of Health Sciences, Rome, Italy

2026-06-30视觉感知数据集/基准

现有放射报告生成评测多看文本相似度或整体临床正确性,难以判断诊断是否真正来自影像证据。ShoViR用带病灶框的MIMIC-CXR和PadChest-GR构造区域遮挡基准,区分证据被遮后仍报病的直接捷径与依赖共现病灶的上下文捷径。对8个VLM的评测显示,所有模型都有明显捷径行为,且报告质量高不等于空间 grounding 可靠。

Few-Shot Domain Incremental Learning via Continual Vision-Language Consolidation Figure 1
2026-06-30cs.CV

Few-Shot Domain Incremental Learning via Continual Vision-Language Consolidation

Naeem Paeedeh, Mahardhika Pratama, Wolfgang Mayer, Mukesh Prasad, Weiping Ding, Yew-Soon Ong

School of Computer Science and IT, Adelaide University, Australia., Faculty of Engineering and IT, University of Technology Sydney (UTS), Australia, School of Artificial Intelligence and Computer Science, Nantong University, China, College of Computing and Data Science, Nanyang Technological University, Singapore

2026-06-30视觉语言视觉感知

论文针对域增量学习在新域样本极少时易过拟合和遗忘的问题,提出 FSDIL 设置与 CVLC 方法:在 CLIP 视觉/文本编码器中加入参数高效的双合并投影,并用基域潜空间预留、共享/域特定组件、多模板同义词文本原型及原型校正来兼顾迁移与稳定。实验显示其在 CDDB、CORe50 等基准上较已有方法最高提升约 16%,但具体增益在不同模块间的来源仍需结合消融细看。

DrivenMorph: Bridging Attention Mechanism and Variational Image Registration via Difference Modeling Figure 1
2026-06-30cs.CV

DrivenMorph: Bridging Attention Mechanism and Variational Image Registration via Difference Modeling

Mingke Li, Jianping Zhang, Jinqiu Deng

and in part by the Project of Scientific Research Fund of the Hunan Provincial Science and Technology Department (grant number 2023GK2029)

2026-06-30视觉感知

这篇论文针对深度医学图像配准中精度与可解释性、形变可控性难以兼顾的问题,借鉴经典 Demons 变分配准,将双流特征差异显式建模为“驱动力”,再通过结合交叉注意力与自注意力的 Neural Demons Layer 生成平滑形变场,从而把差异建模与形变解码解耦。实验在多个 3D 脑 MRI 数据集上优于学习式和优化式基线,并用可视化与统计分析表明驱动力与实际形变模式较一致。

HiRes: A Hierarchical Cascaded Method for Resistor Value Identification Figure 1
2026-06-30cs.CV

HiRes: A Hierarchical Cascaded Method for Resistor Value Identification

Rama Y. AlHamidi, Aseel A. Mohamed, Mustafa A. Eltayeb, Osama Hasoneh, Mohammad Shaqfeh

2026-06-30视觉感知

本文面向非受控场景中电阻色环易受光照、姿态、背景和相邻色带干扰而难以自动读值的问题,提出 HiRes 级联流程:先用 YOLOv8n 定位电阻,再以 UNet++ 分割色带,并沿主轴投影排序解码,加入保留间隙的色带分离和 E24 校验。实验在真实图像上取得检测 mAP50 0.9906、分割 mIoU 0.8444、端到端准确率 85.8%,优于 CVResist 和多模态大模型。

Latent Noise Mask for Reducing Visual Redundancy in Multimodal Large Language Models Figure 1
2026-06-30cs.CV

Latent Noise Mask for Reducing Visual Redundancy in Multimodal Large Language Models

Kai Jiang, Ruishu Zhu, Siqi Huang, Hongyuan Zhang, Xuelong Li

School of Artificial Intelligence, OPtics and ElectroNics (iOPEN), Northwestern Polytechnical University, Institute of Artificial Intelligence, China Telecom (TeleAI), Fudan University, The University of Hong Kong

2026-06-30视觉语言

这篇论文针对多模态大模型在细粒度视觉问答和定位中被大量无关图像 token 稀释关键证据的问题,提出 Lens:用临时 Lens Evidence Token 按问题评估视觉 token 相关性,并对低相关 token 注入自适应潜在噪声,而非剪枝或增加推理轨迹。实验显示其在多数 VQA 数据集提升 2.4–6.4 分、定位任务提升 4.1–6.4 分,说明清理视觉证据本身可直接改善推理。

A Dual-domain Refinement Network with FBP-based Jacobian Learning for Sparse-view Dual-Energy CT Material Decomposition Figure 1
2026-06-30cs.CV

A Dual-domain Refinement Network with FBP-based Jacobian Learning for Sparse-view Dual-Energy CT Material Decomposition

Qian Liu, Xiaohong Fan, Ke Chen, Chong Chen, Shuaikang Wang, Jianping Zhang

2026-06-30视觉感知

面向稀疏视角双能 CT 中低剂量采集导致的非线性、病态材料分解问题,论文将任务写成带稀疏正则的非线性最小二乘,并展开为 DECT-DRNet:用 FBP+U-Net 学习近似伴随 Jacobian,再以图像域与傅里叶域残差块联合抑制全局伪影和局部噪声。在 60 视角下,乳腺与腹部 CT 数据集相对传统分解方法分别提升 3.23 dB 和 2.01 dB PSNR。

T2LDM++: A Self-Conditioned Representation Guided Diffusion Model for Realistic Text-to-LiDAR Scene Generation Figure 1
2026-06-30cs.CV

T2LDM++: A Self-Conditioned Representation Guided Diffusion Model for Realistic Text-to-LiDAR Scene Generation

Wentao Qu, Qi Zhang, Chenxu Wang, Guofeng Mei, Yongfei Liu, Xiaoshui Huang, Gim Hee Lee, Liang Xiao

2026-06-30生成模型

本文针对 Text-LiDAR 数据稀缺导致扩散模型生成场景过平滑、可控性弱的问题,提出 T2LDM++:用自条件表示引导在训练中以重建特征约束去噪网络,并构建超 10 万样本的 Text-LiDAR 基准和可控性指标,还加入方向位置先验与多条件控制。结果显示其能生成更真实、细节更丰富且支持多种条件的 LiDAR 场景,但部分增益可能来自新数据规模与标注构造。

FacePlex: Full-Duplex Joint Speech-Facial Motion Generation for Conversational Avatars Figure 1
2026-06-30cs.AI

FacePlex: Full-Duplex Joint Speech-Facial Motion Generation for Conversational Avatars

Habin Lim, Jae-Ho Lee, Hah Min Lew, Ji-Su Kang, Gyeong-Moon Park

Korea University, available audio rather than jointly generating speech and motion online. To bridge

2026-06-30视觉感知

FacePlex针对现有系统要么只能全双工语音、要么只能离线由音频驱动表情的问题,提出全双工联合语音-面部运动生成任务。其核心是用Rolling Flow Matching在流式队列中逐步细化并提交面部帧,再用Rolling Cross-Attention对齐滚动语音与运动上下文。实验、消融和用户研究显示,该方法在在线约束下同时生成语音与面部动作,并提升唇形同步、运动保真度和感知对话质量。

Hyper-Network Neural Functional Maps for Unsupervised Robust 3D Shape Matching Figure 1
2026-06-30cs.CV

Hyper-Network Neural Functional Maps for Unsupervised Robust 3D Shape Matching

Dongliang Cao, Florian Bernard

University of Bonn

2026-06-30三维安全鲁棒

这篇论文针对非刚性三维形状匹配在局部缺失、拓扑噪声和原始点云下失效的问题,指出线性功能映射难以对齐受强内在形变影响的截断谱基。方法用超网络根据标准功能映射动态预测带跳连的 MLP,形成非线性神经功能映射,并以无监督谱对齐损失训练。实验显示其可接入现有无监督深度功能映射流程,在困难场景中显著提升匹配精度。

SciIR: A Large-scale Training Dataset and Benchmark for Scientific Image Reasoning Generation Figure 1
2026-06-30cs.CV

SciIR: A Large-scale Training Dataset and Benchmark for Scientific Image Reasoning Generation

Zhiyuan Ma, Zhengfeng Shi, Yuning An, Peize Li, Jiabao Wei, Ruijie Li, Junhao Xiao, Jianjun Li, Bowen Zhou

2026-06-30视觉感知数据集/基准

本文针对通用文生图模型在科研图像中“看起来合理但违背拓扑、因果或物理规律”的问题,提出 SciIR:用符号三元组将科学图像推理拆为实体结构、科学过程和科学规律,并构建含 8 万余图文对与 Sci-RCoT 标注的 SciIR-82k,以及原子检查表式 SciIR-Bench。实验显示现有模型科学推理明显不足,微调得到的 Qwen-Image-SciIR 将基准得分由 35% 提升到 43%,但增益可能主要来自数据与领域微调。

LETT-NeXt: A Lightweight RECIST-Guided Model for 3D CT Lesion Segmentation Figure 1
2026-06-30cs.CV

LETT-NeXt: A Lightweight RECIST-Guided Model for 3D CT Lesion Segmentation

Sebastian Aas, Elias Stenhede, Arian Ranjbar

2026-06-30视觉感知三维

该文针对RECIST二维径线难以表达肿瘤三维范围、而完整3D标注成本高的问题,提出LETT-NeXt:以RECIST中心裁剪CT区域,将径线和端点编码为提示通道,配合轻量MedNeXt-v2、组件筛选与AutoZoom推理生成病灶掩膜。结果显示隐藏测试DSC为73.9、NSD为67.3,CPU单例约6.9秒、峰值3.6GB;误差仍集中在边界与病灶范围,外部泛化文中未充分说明。

SIR: Structured Image Representations for Explainable Robot Learning Figure 1
2026-06-30cs.RO

SIR: Structured Image Representations for Explainable Robot Learning

Paul Mattes, Jan Schwab, Jens Bosch, Nils Blank, Maximilian Xiling Li, Minh-Trung Tang, Moritz Haberland, Rudolf Lioutikov

Intuitive Robots Lab, Karlsruhe Institute of Technology, Germany 2Robotics Institute Germany, ject labels), geometric cues (e.g., bounding boxes and point, Label, (e.g., symbolic labels, geometric cues, or visual features) af-

2026-06-30机器人视觉感知

这篇论文针对视觉嵌入式机器人策略缺乏显式结构、易受干扰且难解释的问题,提出 SIR:先由图像特征构建全连接场景图,再端到端学习稀疏化为任务相关子图,并用 GNN 作为动作生成器输入。RoboCasa 上稀疏图策略平均成功率 19.5%,高于图像基线 14.81%,且子图可暴露模型关注的干扰物、遗漏关键物体及数据集偏置。

CylindTrack: Depth-Aware Cylindrical Motion Modeling for Panoramic Multi-Object Tracking Figure 1
2026-06-30cs.CV

CylindTrack: Depth-Aware Cylindrical Motion Modeling for Panoramic Multi-Object Tracking

Buyin Deng, Kai Luo, Lingxin Huang, Xinqi Liu, Fei Cheng, Hang Zheng, Liming Yin, Kailun Yang

2026-06-30视觉感知

这篇论文针对全景相机多目标跟踪中水平边界周期性、遮挡和单帧深度不稳定导致的身份断裂问题,提出 CylindTrack:用轨迹级深度时序建模稳定几何线索,并将水平运动提升到连续角度/柱面状态以处理 0°/360°接缝关联。实验在 QuadTrack 和 JRDB 上提升 HOTA、IDF1 与 AssA,同时保持约 28.56/21.34 FPS,说明收益主要来自深度一致性与全景拓扑建模的结合。

One Forward Beats Two: InnerZoom for Accurate and Efficient GUI Grounding Figure 1
2026-06-30cs.CV

One Forward Beats Two: InnerZoom for Accurate and Efficient GUI Grounding

Chen Liu, Ling Chen, Hanzhang Zhou, Liangyu Chen, Chenglin Cai, Xin Yu, Steven Hoi, Yue Wang

2026-06-30视觉语言

这篇论文针对 GUI grounding 中“已在中间层找到目标区域,却在自回归坐标解码时丢失证据”的 Region-to-Point Gap,提出 InnerZoom:在单次前向中提取、压缩并跨层维护目标区域证据,再注入后续解码层指导点击坐标生成,替代 ZoomIn 的裁剪后二次推理。实验显示 InnerZoom-4B 在多个 GUI grounding 基准上达到 SOTA,相比同配置 SFT+RL 平均提升 5.3 点,并较两阶段 ZoomIn 平均高 1.3 点,同时最多降低 31.8% 延迟和约 29% TFLOPs。

Clinical Risk-Aware Multi-Level Grading for Coronary Artery Stenosis through Curved Feature Reconstruction Figure 1
2026-06-30cs.CV

Clinical Risk-Aware Multi-Level Grading for Coronary Artery Stenosis through Curved Feature Reconstruction

Shishuang Zhao, Hongtai Li, Junjie Hou, Yuhang Liu

Yizhun Medical AI Co., Ltd, The First Hospital of China Medical University

2026-06-30三维安全鲁棒

这篇论文面向冠脉狭窄五级分级,动机是单用CCTA难处理弯曲血管、单用3D SCPR又会引入形变,且传统分类/回归未区分跨越临床风险边界的错误。核心做法是用血管中心线先验进行曲面特征重建,对齐融合CCTA与3D SCPR特征,并用临床风险感知损失强调1/2级与3/4/5级边界。在院内数据上,方法优于既有方案,消融也支持CFR与CR Loss的贡献,但泛化到外部数据仍文中未充分说明。

Neural Subspace Reallocation: Continual Learning as Retrieval-Based Subspace Memory Management Figure 1
2026-06-30cs.LG

Neural Subspace Reallocation: Continual Learning as Retrieval-Based Subspace Memory Management

Byeong Hoon Yoon

ing the rest available. Synaptic consolidation: dur-, ing rest, labile memories are compressed into stable

2026-06-30视觉感知

本文针对持续学习中固定容量模型易遗忘、遇到重复任务需重学的问题,将 LoRA 子空间视为可压缩和检索的记忆单元:任务后用 SVD 压缩并存入 TaskKnowledgeBank,再按相似度召回以热启动和重分配子空间。关键洞察是历史记忆而非复杂分配策略决定效果;实验显示 Bank 使循环任务恢复约快 10 倍,NSR-Sim 可匹配或优于 RL 控制器,并在 Split-CIFAR-100 与 5-Datasets 上降低遗忘。

Emergence of a Shared Canonical Object Frame from In-the-Wild Videos Figure 1
2026-06-30cs.CV

Emergence of a Shared Canonical Object Frame from In-the-Wild Videos

Tom Fischer, Martin Sundermeyer, Adam Kortylewski, Eddy Ilg

University of Technology Nuremberg, CISPA Helmholtz Center for Information Security

2026-06-30视觉感知

这篇论文针对跨实例/跨类别物体姿态需要共享规范坐标系、但传统依赖 CAD 对齐或人工姿态标注难以扩展的问题,提出让大量野外物体视频经由同一个粗 canonical mesh 几何瓶颈学习像素到网格的稠密对应,并用 SfM 位姿估计序列级对齐,使共同坐标系在自监督中涌现。方法在约 16 万视频上训练,无类别条件和规范姿态标签,在多项类别级姿态估计基准上达到接近有监督方法的精度,但对对称物体的方向歧义仍有限。

Illuminating Unified Multimodal Model for Free-form Interleaved Text-Image Generation Figure 1
2026-06-30cs.CV

Illuminating Unified Multimodal Model for Free-form Interleaved Text-Image Generation

Chonghuinan Wang, Zhikai Chen, Chunwei Wang, Yecong Wan, Junwei Yang, Zhixin Wang, Wei Zhang, Jiaqi Xu, Renjing Pei, Xiaohe Wu, Fan Li, Wangmeng Zuo

2026-06-30视觉语言视觉感知强化学习

针对统一多模态模型虽能生成图文但难以在任意顺序下稳定产出自由交错图文序列、且缺少专门评测的问题,ILLUME-X从数据、训练和评估三方面改进:构建约10万高质量交错样本,采用渐进式训练与自适应目标处理变长多模态 token,并提出ILScore衡量跨模态连续性与单模态质量。实验显示其在风格迁移、图像分解和故事生成等交错生成任务上优于既有统一模型;但具体增益可能主要来自数据构建与训练流程,消融细节若不足则增益来源仍需谨慎判断。

Bridging the Gap Between Image Restoration and Navigational Safety in Hazy Conditions: A New Visibility Estimation Metric for Maritime Surveillance Figure 1
2026-06-30cs.CV

Bridging the Gap Between Image Restoration and Navigational Safety in Hazy Conditions: A New Visibility Estimation Metric for Maritime Surveillance

Wentao Feng, Guobei Peng, Wengang Mao, Ryan Wen Liu

Sanya Science and Education Innovation Park, Wuhan University of Technology, Sanya 572000, China, School of Navigation, Wuhan University of Technology, Wuhan 430063, China, State Key Laboratory of Maritime Technology and Safety, Wuhan University of Technology, Wuhan 430063, China, Department of Mechanics and Maritime Sciences, Chalmers University of Technology, Göteborg 41296, Sweden

2026-06-30机器人视觉感知安全鲁棒

本文针对海雾下去雾算法虽提升观感、却难对应航行安全可见距离的问题,提出以目标检测性能为中介的可见度评估指标,并用 Unity3D 构建含成对清晰/雾图和距离标注的 MSVD 数据集。实验比较六种去雾方法,显示传统 IQA 难反映有效观测距离,而新指标可较可靠估计可见距离,支持安全限制与通航效率的权衡。

Argus: Metric Panoramic 3D Reconstruction for Indoor Scenes Figure 1
2026-06-30cs.CV

Argus: Metric Panoramic 3D Reconstruction for Indoor Scenes

Xi Li, Linyuan Li, Yan Wu, Tong Rao, Kai Zhang, Xinchen Hui, Cihui Pan

2026-06-30三维

本文针对全景图像的度量级前馈三维重建缺少大规模RGB-D训练数据、且稀疏无序采集易因参考视角选择不当产生位姿漂移的问题,提出Realsee3D数据集与Argus模型。核心做法是用可学习共视关系选择几何上更稳健的世界坐标锚点,并将全景像素到世界坐标映射分解为多步监督以增强几何一致性。实验显示其在Realsee3D上于相机位姿、深度和点云重建均优于现有前馈方法,但增益可能主要来自数据规模与专门全景训练。

Walking in the Implicit: Interactive World Exploration via Neural Scene Representation Figure 1
2026-06-30cs.CV

Walking in the Implicit: Interactive World Exploration via Neural Scene Representation

Zhiqi Li, Chengrui Dong, Zhenhua Du, Hangning Zhou, Cong Qiu, Hailong Qin, Mu Yang, Dongxu Wei, Peidong Liu

2026-06-30强化学习

面向相机控制的交互式世界探索,论文认为逐帧视频潜变量滚动会把状态转移与高频渲染耦合,导致长程一致性和重访稳定性下降。其核心是把滚动变量改为固定长度、可渲染的神经隐式场景 NIS,并用 VAE 学场景 token、DiT 按轨迹和几何检索历史生成下一状态。实验在 Re10K、DL3DV 上显示较好的长程位姿/重访一致性与推理效率,但范围限于静态场景。

Consensus Clustering of Free-Viewing Gaze Data: New Insights into Human-Information Interaction Figure 1
2026-06-30cs.CV

Consensus Clustering of Free-Viewing Gaze Data: New Insights into Human-Information Interaction

Beryl Gnanaraj, Jaya Sreevalsan-Nair, Saqib Alam Ansari, Maanasa Rajaraman

Graphics-Visualization-Computing Lab, International Institute of Information Technology Bangalore, Karnataka 560100, India., PSG College of Technology, Coimbatore, Tamin Nadu, India.

2026-06-30视觉感知

针对自由观看眼动数据中用户行为与图像刺激交互关系缺乏系统分析的问题,本文提出 EnsembleGaze,用固定注视特征统计描述、共关联矩阵与共识投票整合多种聚类,并进一步比较共识子空间聚类和谱双聚类。结果显示,图像刺激分组在方法间较稳定,呈现环境式与焦点式观看差异;用户分组则明显依赖图像语境,MIT1003 与 EMOd 表现出不同模式。

CogSENet: Blind Image Deblurring with Blur-Conditioned Semantic Routing and Explicit Frequency Fusion Figure 1
2026-06-30cs.CV

CogSENet: Blind Image Deblurring with Blur-Conditioned Semantic Routing and Explicit Frequency Fusion

Pan Wang, Yihao Hu, Xiujin Liu

2026-06-30视觉感知

针对盲去模糊中空间变化退化难建模、语义边界与真实纹理易被混淆的问题,CogSENet将恢复过程改为语义对齐的动态重建:用语义路由的状态空间扫描建模长程依赖,以小波高低频分解显式融合结构与细节,并结合连续模糊场和CLIP先验调制深层特征。实验显示其在去模糊质量和结构保真度上优于多种SOTA且参数更少,并可迁移到去雾、去雨和降噪任务。

Cross-Modal Iteration Distillation for Robust IHD Screening: The IDNet Framework and A New Benchmark Figure 1
2026-06-30cs.CV

Cross-Modal Iteration Distillation for Robust IHD Screening: The IDNet Framework and A New Benchmark

Yongchang Gao, Junjie Pang, Shuaiyu Yang, Yusheng Yang, Xichao Jia, Shaojie Li, Hongfei Zhang, Jia Mu

2026-06-30数据集/基准安全鲁棒

本文面向低成本缺血性心脏病筛查,针对眼底图像与少量临床变量难融合、公开基准不足的问题,提出IDNet:用滑窗MIL提取双眼眼底特征,并以可学习查询的CDA顺序蒸馏左右眼和临床信息。作者还构建UK Biobank基准,IDNet优于单模态和常见多模态基线,外部队列AUC达0.8965,但部分增益可能来自数据质量与高分辨率成像。

MuseBench: Benchmarking Intent-Level Audiovisual Arts Understanding in MLLMs Figure 1
2026-06-30cs.CV

MuseBench: Benchmarking Intent-Level Audiovisual Arts Understanding in MLLMs

Yuxuan Fan, Gyusik Seo, Jing Hao, Jaemin Cho, Mohit Bansal, Jaehong Yoon

The University of Hong Kong, Johns Hopkins University

2026-06-30数据集/基准

MuseBench针对现有多模态大模型评测偏重“看见什么”、缺少“为何这样表达”的问题,构建面向影视、静态视觉、舞台表演和游戏艺术的意图级视听艺术理解基准。其创新在于从视频 essay 中抽取专家解读,结合单选与可变多选、对抗干扰项和机会校正/集合式评分来刻画多重合理解释。28个MLLM零样本评测中最佳仅48.29%,显著低于专家87.18%,且在游戏艺术与多选召回上短板明显,说明瓶颈更像艺术语汇和文化先验不足,而非关键帧定位。

IBRSteG: Learning a Generalizable Steganography Framework for 3D Gaussian Splatting Figure 1
2026-06-30cs.CV

IBRSteG: Learning a Generalizable Steganography Framework for 3D Gaussian Splatting

Fanye Kong, Hongyu Xia, Yu Zheng, Boyang Gong, Jie Zhou, Jiwen Lu

2026-06-30生成模型三维

面向3DGS资产公开传输中秘密场景易被拦截、现有方法需按场景优化且泛化差的问题,IBRSteG将3D隐写建模为前馈高斯属性嵌入:用GAS在结构化GAM上把秘密场景属性注入封面场景,避免逐场景微调。实验覆盖DyNeRF、ENeRF、DTU和THuman_MV,显示其在视觉质量、嵌入容量和抗隐写分析安全性上优于既有3DGS隐写方法,但大规模复杂场景表现受底层重建骨干限制。

Uncertainty Estimation in Pathology Foundation Models via Deep Mutual Learning Figure 1
2026-06-30cs.CV

Uncertainty Estimation in Pathology Foundation Models via Deep Mutual Learning

Gbègninougbo Aurel Davy Tchokponhoue, Sevda Öğüt, Ali Idri, Dorina Thanou, Pascal Frossard

2026-06-30安全鲁棒

病理基础模型虽能迁移到全切片分析,但缺少可信置信度且不同模型在任务间表现不稳定。论文提出 DICE,将多个冻结 PFM 作为专家集成,用深度互学习和 Gramian 约束对齐,使残余分歧成为不确定性信号,并给出上界解释。实验在 PANDA、CAMELYON16/17 上显示,其能更好标记易错与 OOD 样本,同时保持或提升分类、校准和弱监督病灶定位表现。

OmniDance: Multimodal Driven Dance Video Generation with Large-scale Internet Data Figure 1
2026-06-30cs.CV

OmniDance: Multimodal Driven Dance Video Generation with Large-scale Internet Data

Kaixing Yang, Jiashu Zhu, Xulong Tang, Ziqiao Peng, Xiangyue Zhang, Chubin Chen, Puwei Wang, Jiahong Wu, Xiangxiang Chu, Hongyan Liu, Jun He

2026-06-30视觉语言视觉感知

针对现有舞蹈视频生成难以同时保证音乐对齐、动作表现力和视觉质量的问题,OmniDance一方面构建含30万片段、400小时以上的CIPE-Dance互联网数据集,另一方面在TI2V视频基础模型中以分层音乐交叉注意力、由易到难课程学习和模态专门CFG注入音乐条件。实验显示其在文本、音乐及二者联合驱动生成上均优于既有方法,但增益可能主要来自数据规模与框架协同。

Monte Carlo Energy Aggregation for Mobile 3D Gaussian Splatting Figure 1
2026-06-30cs.CV

Monte Carlo Energy Aggregation for Mobile 3D Gaussian Splatting

Xiaobiao Du, YuAn Wang, Hao Li, Bosheng Wang, Xun Sun, Xin Yu

2026-06-30强化学习三维

这篇论文针对移动端部署 3D Gaussian Splatting 时高阶球谐带来的存储、带宽和推理开销,以及单视角稠密化产生冗余高斯的问题,提出 Flux-GS:用蒙特卡洛镜面能量聚合将三阶辐射残差压缩到低阶表示,并用属性条件 SH 增强在推理前烘焙细节,同时采用多视角 alpha 引导稠密化与剪枝。实验显示其在接近 3DGS/Mobile-GS 画质下减少参数和高斯数量,并在 Snapdragon 8 Gen 3 与 WebGL 场景中提升移动端帧率。

Shell-Supervised Gaussian Splatting for Urban Real-to-Sim Reconstruction Figure 1
2026-06-30cs.CV

Shell-Supervised Gaussian Splatting for Urban Real-to-Sim Reconstruction

Yuan Yang, Peijun Lu, Fangzhou Lu, Sai Fan, Siqi Yan, Chenyuan Zhang, Haobo Liang, Yichen Wang

Hong Kong Center for Construction Robotics, Tsinghua University

2026-06-30三维

面向具身智能的真实到仿真重建,论文指出城市近景立面虽可被3DGS逼真渲染,但玻璃、反射和弱纹理会导致几何不稳定,影响碰撞与导航。其核心做法是将轻量外立面结构壳对齐到视频重建坐标系,渲染深度、法线和有效掩码,并用掩码门控损失监督Gaussian优化,只约束壳支持区域。实验在匿名立面序列上显示,相比纯照片、单目先验和2DGS,立面朝向与可见表面点云一致性更好,RGB渲染质量基本保持;但未验证下游仿真或导航效果。

SkelEM: Training-Signal Decoupling of Skeleton and Diffusion for Self-supervised Axial Super-Resolution in Volume Microscopy Figure 1
2026-06-30cs.CV

SkelEM: Training-Signal Decoupling of Skeleton and Diffusion for Self-supervised Axial Super-Resolution in Volume Microscopy

Bohao Chen, Yanchao Zhang, Yanan Lv, Chenxun Deng, Hua Han, Xi Chen

2026-06-30生成模型

体显微成像常因轴向分辨率低而产生结构失真,自监督 ASR 又在过平滑、扩散幻觉和推理慢之间摇摆。SkelEM 的关键洞察是先用冻结拓扑网络提供确定性结构骨架,再用与其训练信号解耦的扩散精修器补高频细节,并借真实稀疏切片的循环一致性提取残差先验,将反向扩散截断到不超过 5 步。实验显示其在公开数据和新 BRAVE-ASR 跨仪器基准上取得较好的保真-感知折中、领先的膜分割下游表现,并能零样本迁移到不同显微模态。

GeoEdit: Geometry-Aware Object Editing via Dual-Branch Denoising Figure 1
2026-06-30cs.CV

GeoEdit: Geometry-Aware Object Editing via Dual-Branch Denoising

Yi He, Jiangming Wang, Xinyu Wang, Mark Fong, Songchun Zhang, Yuxuan Xue, Hai-Tao Zheng, Yue Ma

Shenzhen International Graduate School, Tsinghua University, Pengcheng Laboratory, Sun Yat-sen University, Peking University, University of Tübingen

2026-06-30视觉感知

GeoEdit针对单张照片中物体平移、旋转、缩放时易破坏透视、产生残影和背景模糊的问题,将编辑先提升到3D中完成物体与场景解耦、配准和渲染,再用双分支去噪在前景注入方差匹配的几何约束、让背景自由生成。文中在GeoEditBench及人类/VLM评测中显示,其几何准确性、身份保持和背景质量均优于现有2D编辑与部分3D感知方法。

SICAGE: Speaker-Independent Culture-Aware Gesture Generation using TED4C-L Dataset Figure 1
2026-06-30cs.CV

SICAGE: Speaker-Independent Culture-Aware Gesture Generation using TED4C-L Dataset

Ariel Gjaci, Antonio Sgorbissa, Vittorio Murino

2026-06-30数据集/基准

针对共语手势生成常忽视文化差异、且文化效果可能被说话人个人风格混淆的问题,SICAGE将每位说话人视为域,用对抗学习或Fishr学习说话人无关但保留文化判别力的音频/文本嵌入,并接入实时扩散生成器ALaDiT。作者还构建106小时、764人的TED4C-L数据集;实验显示在说话人不重合设置下,方法提升动作真实感、多样性、节拍同步、语义相关性和文化一致性。

Rigel: Self-Distilled Score Adaptation for Image and Video Captioning Evaluation Figure 1
2026-06-30cs.CV

Rigel: Self-Distilled Score Adaptation for Image and Video Captioning Evaluation

Shuitsu Koyama, Kazuki Matsuda, Yuiga Wada, Shinnosuke Hirano, Daichi Yashima, Komei Sugiura

Keio University

2026-06-30视觉语言视觉感知数据集/基准

本文针对图像/视频字幕自动评测与人工判断不一致的问题,指出 LLM-as-a-Judge 用大词表 LM head 预测少量序数分数会引入无关 token 噪声。Rigel 通过自蒸馏得到任务专用评分头,再用人工评分微调骨干,并构建 Vid-Lepus 数据集;多基准上相关性优于现有指标,ActivityNet-Fact 无参考设置提升超过 10 点。

A multi-architecture study of specificity refinement and false-positive mechanism analysis in prostate MRI Figure 1
2026-06-30eess.IV

A multi-architecture study of specificity refinement and false-positive mechanism analysis in prostate MRI

Yongbo Shu, Kewen Chen, Yifeng Yuan, Zirui Xin, Luo Lei, Yang Yang, Xi Chen, Aijing Luo

(1) The Second Xiangya Hospital of Central South University, Changsha, Hunan 410011, China, (2) School of Life Sciences, Central South University, Changsha, Hunan 410013, China, (3) Hunan Provincial Key Laboratory of Medical Information Research (Central South University), (4) Hunan Provincial Clinical Medical Research Center for Cardiovascular Intelligent Medicine, both analyses on Prostate158 [5] and report what works, where center-specific effects limit the claim, This study analyzed de-identified multiparametric prostate MRI from two publicly available, in-

2026-06-30视觉感知

这篇论文针对前列腺 MRI AI 检测高敏感度下假阳性难以处理的问题,分析其是否源于模型伪影,并尝试在冻结检测骨干后加轻量后处理头提升特异性。核心洞察是假阳性在证据表征和 T2/ADC 原始对比上更像真癌灶而非良性组织,跨五种架构均复现,可能主要来自数据层面的影像相似性;轻量 refinement 在 PI-CAI fold-0 将特异性提升 17.2% 且保持敏感度,但五折结果有条件性,外部集增益不明显。

Learning Efficient 4D Gaussian Representations from Monocular Videos with Flow Splatting Figure 1
2026-06-30cs.CV

Learning Efficient 4D Gaussian Representations from Monocular Videos with Flow Splatting

Shengjun Zhang, Jinzhao Li, Xin Fei, Yueqi Duan

Tsinghua University, National University of Singapore

2026-06-30视觉感知生成模型三维

这篇工作针对单目视频动态三维重建中训练慢、渲染慢、4D 表示易退化为逐帧重建的问题,提出 Flow Splatting:从带时变均值和协方差的 4D Gaussian 中构造速度场,并将其 splat 成光流作为稠密运动监督,同时加入初始化与速度一致性约束。实验显示其在 DAVIS、NVIDIA 动态场景上相较已有方法取得更高图像质量、更短训练时间和更快渲染速度。

Variance Reduction on the Camera Axis: Multi-View Score Distillation for 3D Figure 1
2026-06-30cs.CV

Variance Reduction on the Camera Axis: Multi-View Score Distillation for 3D

Marian Lupascu, Mihai Sorin Stupariu, Ionut Mironica

Department of Computer Science, University of Bucharest, Romania

2026-06-30三维

本文针对文本到3D得分蒸馏中单视角梯度方差大、收敛慢且易产生 Janus 视角不一致的问题,提出 MV-SDI:在不重训2D扩散先验、不增加峰值显存的前提下,每步聚合多组反向对跖相机视角梯度,把问题视为相机轴采样方差缩减。43提示基准上,固定1万次UNet调用时 K=2 将 R-Precision 从74.8%提升到83.8%,CLIP从0.297到0.312,并将优化步数减半。

Explainability-Aware Frustum Attack: Exposing Structural Vulnerabilities in LiDAR-Based 3D Object Detectors Figure 1
2026-06-30cs.CV

Explainability-Aware Frustum Attack: Exposing Structural Vulnerabilities in LiDAR-Based 3D Object Detectors

Chengzeng You, Binbin Xu, Soteris Demetriou

2026-06-30三维

本文关注自动驾驶中 LiDAR 三维检测器为何容易被少量空间扰动击穿。作者用 SALL 聚合 Integrated Gradients,构造跨场景、类别级的通用显著性图,并据此提出 EFA 只攻击最关键视锥。KITTI、nuScenes 上对 PointPillars、SECOND 的实验显示,EFA 可使召回下降超过 15 个百分点,同时比非显著性感知基线少扰动 25%–50% 视锥,揭示检测证据集中带来的结构性脆弱性。

Exploiting Local Flatness for Efficient Out-of-Distribution Detection Figure 1
2026-06-30cs.LG

Exploiting Local Flatness for Efficient Out-of-Distribution Detection

Seonghwan Park, Hyunji Jung, Dongyeop Lee, Namhoon Lee

Korea Electronics Technology Institute (KETI), Pohang University of Science and Technology (POSTECH), data, i.e., samples drawn from distributions whose label sets are disjoint from those, modern deep networks. Although several scalable approximations have been proposed

2026-06-30视觉感知

这篇论文针对后验式 OOD 检测中曲率方法计算代价高、且缺少对 ID/OOD 平坦性差异验证的问题,系统观察到 OOD 样本的 Hessian 曲率更大且分布偏移越强差距越明显。作者据此提出 FOLD,用特征 Hessian 与部分特征归一化放大可分性,并用 AUTOFOLD 通过 ID logit masking 自监督调参;实验显示平均 AUROC 提升 1.63%、FPR95 降低 2.30%,计算开销接近一次前向传播。

Scene-aware Prediction of Diverse Human Movement Goals Figure 1
2026-06-30cs.CV

Scene-aware Prediction of Diverse Human Movement Goals

Qiaoyue Yang, Amadeus Weber, Magnus Jung, Ayoub AI-Hamadi, Sven Wachsmuth

2026-06-30视觉感知

面向机器人协作与导航中需要提前避让/配合人的需求,本文关注仅凭当前RGB场景和人体姿态预测人可能走向何处。核心做法是用CVAE建模目标的不确定性,通过潜空间采样生成多个场景一致的未来目标热图/区域,而非依赖语义地图或只预测交互物体。实验在GTA-IM与PROX上显示其多目标样本优于确定性基线,并具备跨场景泛化;但有效采样仍未完全受控。

Seeing Touch from Motion: A Unified Modality-Aware Visuo-Tactile Policy with Tactile Motion Correlation Figure 1
2026-06-30cs.RO

Seeing Touch from Motion: A Unified Modality-Aware Visuo-Tactile Policy with Tactile Motion Correlation

Shengqi Xu, Guojin Zhong, Yang Liu, Fanjie Wang, Hu Luo, Hanyu Zhou, Weiyao Zhang, Ziyi Ye, Zuxuan Wu, Yu-Gang Jiang

Institute of Trustworthy Embodied AI, Fudan University, Shanghai Key Laboratory of Multimodal Embodied AI, 3NeoteAI, School of Computing, National University of Singapore

2026-06-30强化学习

面向精密插入、擦拭等接触丰富操作,论文指出光学触觉的原始图像和累计光流难区分“接触/释放”等细粒度状态。核心洞察是瞬时运动与累计运动的方向相关性可显式表征接触状态与力度,并将其作为TMC表示,结合Mixture-of-Transformers构建保留模态特性的视觉-触觉策略。四个真实操作任务及消融显示,该方法较常见触觉表示和融合方式更稳健,但极端视觉扰动和物体位置变化下泛化仍有限。

Latent-CURE for Breast Cancer Diagnosis Figure 1
2026-06-30cs.CV

Latent-CURE for Breast Cancer Diagnosis

Weiyi Zhao, Xiaoyu Tan, Lu Gan, Liang Liu, Xihe Qiu

2026-06-30视觉感知

针对乳腺超声多模态大模型在良恶性样本失衡下易走捷径、缺乏临床推理的问题,Latent-CURE把开放生成改为潜空间检索,并按BI-RADS描述符构建隐式CoT,再用Dual-ASL保护罕见恶性特征。实验显示其准确率93.78%、特异性97.16%、MCC 87.07%,优于多种LMM和消融基线。

DCGrasp: Distance-aware Controllable Grasp Generation Figure 1
2026-06-30cs.CV

DCGrasp: Distance-aware Controllable Grasp Generation

Hiroyasu Akada, Jesús Pérez, Emre Aksan, Vasileios Choutas, Cristian Romero, Alberto Garcia-Garcia, Vladislav Golyanik, Christian Theobalt, Thabo Beeler

Max Planck Institute for Informatics, SIC

2026-06-30规划控制

面向机器人抓取、AR/VR 等场景中对可控性和跨物体泛化的需求,DCGrasp 将手—物交互抽象为近接触区域的带符号距离 Profile,并用距离感知权重弱化无关远距离区域;再由 Diffusion Transformer 联合生成目标 Profile 与初始手姿,并通过能量优化细化接触。实验显示其在未见物体、尺度变化和极端手形下保持低穿透、稳定接触,并能较准确跟随方向与根距离控制信号。

H-GRPO: Permutation-Invariant Reinforcement Learning for Grounded Visual Reasoning Figure 1
2026-06-30cs.CV

H-GRPO: Permutation-Invariant Reinforcement Learning for Grounded Visual Reasoning

Eric Peh, Debaditya Roy, Basura Fernando

Institute of High-Performance Computing, Agency for Science, Technology and Research, Singapore, Centre for Frontier AI Research, Agency for Science, Technology and Research, Singapore, Department of Computer Science and Engineering, Indian Institute of Technology Kharagpur, India, College of Computing and Data Science, Nanyang Technological University, Singapore

2026-06-30强化学习

这篇论文针对VLM在视觉问答中虽答对却可能依赖捷径、缺乏可验证视觉证据的问题,提出将推理拆成“子问题—子答案—证据框”三元组,并用匈牙利匹配构造置换不变的H-GRPO奖励,避免固定步骤顺序惩罚合理推理。实验显示该方法在定位和空间推理任务、RoboSpatial等OOD基准上提升鲁棒性与可解释性,但在知识密集任务上增益有限,说明过程级 grounding 不能替代模型本身知识能力。

Traffic-CBM: A Structurally Interpretable Multimodal Framework for Encrypted Traffic Classification Figure 1
2026-06-30cs.CV

Traffic-CBM: A Structurally Interpretable Multimodal Framework for Encrypted Traffic Classification

Honglei Jin, Wenshuo Chen, Shaofeng Liang, Haozhe Jia, Menshuo Zhao, Shuxu Jin, Songning Lai, Yutao Yue

Shandong University, Shandong University Qingdao China

2026-06-30视觉语言

针对加密流量分类中多模态特征被黑箱融合、难以判断模型依赖何种证据的问题,Traffic-CBM 将流统计、时序子空间和字节模式组织为层级概念空间,并区分包内与跨包字节概念。实验显示其在六个基准上取得较均衡的 Macro-F1、跨数据集稳定性和模型规模,同时提供概念贡献、交互与充分性分析;但具体相对增益幅度在片段中未充分说明。

StrucTab: A Structured Optimization Framework for Table Parsing Figure 1
2026-06-30cs.CV

StrucTab: A Structured Optimization Framework for Table Parsing

Gengluo Li, Shangpin Peng, Chengquan Zhang, Binghong Wu, Hao Feng, Weinong Wang, Pengyuan Lyu, Huawen Shen, Xingyu Wan, Zhuotao Tian, Han Hu, Can Ma, Yu Zhou

2026-06-30优化算法

针对现有 VLM 表格解析过度依赖最终序列监督、缺少显式结构推理且 RL 奖励不稳定的问题,StrucTab 将解析拆为行列计数、合并单元格分析与 HTML 生成等步骤,并用 Uni-TabRL 的有效性、结构、内容分解奖励优化。论文还构建 TableVerse-5K,实验显示其在公开基准和该新基准上均达到或超过现有方法。

LLM-based Multimodal Personality Recognition via Facial Action Unit-Text Semantic Fusion Figure 1
2026-06-30cs.CV

LLM-based Multimodal Personality Recognition via Facial Action Unit-Text Semantic Fusion

Tianyi Zhang, Wei Shan, Yuan Zong, Tianhua Qi, Wenming Zheng

2026-06-30视觉语言视觉感知

本文针对异步视频面试中仅用文本会忽略非语言线索、用整脸或稀疏帧又易丢失表情时序的问题,提出将面部动作单元序列转成可解释文本,再与回答文本经 LLM 语义融合,并用轻量回归头预测人格分数。AVI-6 实验显示其相较多数基线降低误差、提高与人工评分的相关性,说明 AU 语义能补充受访者文本信息。

Same Concept, Different Directions: Cross-Modal Feature Heterogeneity in Sparse Autoencoders Figure 1
2026-06-30cs.LG

Same Concept, Different Directions: Cross-Modal Feature Heterogeneity in Sparse Autoencoders

Chungpa Lee, Jihoon Kwon, Kyle Min, Jy-yong Sohn

which limits their interpretability and controllabil-, *Equal contribution 1Yonsei University, Korea 2Seoul National, University, Korea 3Oracle, USA. Correspondence to: Jy-yong

2026-06-30视觉感知

本文关注视觉语言模型联合嵌入中,稀疏自编码器为何会把同一概念在图像和文本中分到不同潜变量。核心洞察是“跨模态特征异质性”:语义对应不等于方向一致,强行对齐激活会损害重构。作者改为分别训练图像/文本 SAE,再用共激活后验匹配特征,在多种 VLM 与 MS-COCO 上提升重构、跨模态检索和概念 steering。

Building artificial intelligence virtual tissue (AIVT) for tissue state representation, feature prediction, and dynamic simulation Figure 1
2026-06-30cs.CV

Building artificial intelligence virtual tissue (AIVT) for tissue state representation, feature prediction, and dynamic simulation

Qiqi Lu, Qianjin Feng, Shaoqun Zeng, Shenghua Cheng

School of Biomedical Engineering, Southern Medical University, Guangzhou, China., Guangdong Provincial Key Laboratory of Medical Image Processing, Southern Medical University, Guangdong Province Engineering Laboratory for Medical Imaging and Diagnostic Technology, Southern, Medical University, Guangzhou, China., MOE Key Laboratory for Biomedical Photonics, Wuhan National Laboratory for Optoelectronics, Huazhong University of Science and Technology, Wuhan, China.

2026-06-30视觉感知

为克服传统规则化组织模型难以刻画空间多模态、多尺度组织复杂性的局限,论文提出人工智能虚拟组织 AIVT:以潜在组织状态空间统一表示分子、形态与空间结构,并保持可解码、可操控。其主要结果是系统界定四个基本假设和三类能力,包括组织状态分析、跨模态特征预测及发育、疾病和扰动下的时空动态模拟;但文中以概念框架为主,实证性能与增益来源未充分说明。

IREU: Identity-Related Encoder-Only Unlearning for Customized Portrait Generation Figure 1
2026-06-30cs.CV

IREU: Identity-Related Encoder-Only Unlearning for Customized Portrait Generation

Chaoyi Shi, Shanshan Zhang, Jian Yang

PCA Lab, School of Computer Science and Engineering, Nanjing University of, PCA Lab, School of Intelligence Science and Technology, Nanjing University

2026-06-30视觉感知

本文针对定制人像生成中真实身份被复现带来的隐私与合规风险,研究按用户请求“遗忘”特定身份的问题。核心思路是不微调整个扩散模型,而只更新图像编码器,并通过 Face-Swap 对离线定位身份相关特征维度,仅在这些维度做局部扰动,以避免全局特征扰动损害保留身份的生成质量。实验显示 IREU 在 CelebA-HQ 上比基线和相关身份遗忘方法更好地压制目标身份,同时保持其他身份保真度,且遗忘后的编码器可迁移到共享编码器的不同 CPG 管线。

LWDrive: Layer-Wise World-Model-Guided Vision-Language Model Planning for Autonomous Driving Figure 1
2026-06-30cs.CV

LWDrive: Layer-Wise World-Model-Guided Vision-Language Model Planning for Autonomous Driving

Chen Yang, Yuhao Wei, Ze Xu, Ziheng Zou, Shuang Liang, Delin Ouyang, Lingfeng Qi, Jie Li, Guofa Li

Chongqing University, be made publicly available.

2026-06-30视觉语言视觉感知强化学习规划控制

LWDrive针对VLM直接输出轨迹几何精度不足、缺少未来动态和多视角约束的问题,将VLM轨迹视为意图级粗规划,而非最终控制结果;其核心是用未来帧生成监督增强层级隐藏状态,再通过FCP结合多层VLM特征、历史状态与BEV信息逐步细化候选轨迹。论文在NAVSIM/NAVSIM-v2上分别达到92.0和89.6,但相对增益的具体来源仍需更多消融支撑。

SUMO: Segment and Track Any Motion with Nonlinear State Space Models Figure 1
2026-06-30cs.CV

SUMO: Segment and Track Any Motion with Nonlinear State Space Models

Kexin Tian, Sixu Li, Keshu Wu, Yang Zhou, Zhengzhong Tu

Texas A&M University

2026-06-30视觉感知

这篇论文针对 VOT 与运动目标分割在遮挡、形变和突变运动下仅依赖视觉线索易失稳的问题,将 SAM2 式视频分割与受机器人学启发的非线性状态空间模型结合。核心是提出 Selective Unscented Filter,在无显式传感器观测时融合动力学预测与掩码解码结果,并用联合评分和记忆帧筛选维持时序一致性。实验称 SUMO 在 VOT 和 MOS 多个基准上达到 SOTA,但具体增益来源仍需结合消融细节判断。

RainODE: Continuous-Time Precipitation Forecasting with Latent Neural ODEs Figure 1
2026-06-30cs.CV

RainODE: Continuous-Time Precipitation Forecasting with Latent Neural ODEs

Yeeun Seong, Doyi Kim, Minseok Seo, Changick Kim

2026-06-30视觉感知

这篇论文针对降水预报中固定离散时间步难以兼顾高时间分辨率、长期一致性与计算成本的问题,将雷达降水演化建模为潜空间连续时间动力系统。RainODE用Latent Neural ODE捕捉大尺度平流运动,并以Brownian Bridge随机源模块补偿局地增长、衰减等非平流细节。实验在SEVIR和新RAPID数据集上显示,其在多种时间间隔、降水强度和最长6小时预报中取得更稳定且更清晰的结果。

Efficient Visual Pointing for Embodied AI:Agent-Driven Data Synthesis, Cross-Block Attention, and Iterative Correction Figure 1
2026-06-30cs.CV

Efficient Visual Pointing for Embodied AI:Agent-Driven Data Synthesis, Cross-Block Attention, and Iterative Correction

Zijian Hong, Qi Lv, Yuxiang Xie, Jianming Xing, Xiang Deng, Weili Guan, Liqiang Nie

Harbin Institute of Technology (Shenzhen)

2026-06-30视觉感知

本文针对具身智能中“语言指令到像素点”的视觉指向问题,指出现有 VLM 在可控方向、计数和一次性坐标预测上受数据与状态传播限制。核心做法是用智能体合成语义与锚点相对数据,结合 AttnRes 跨层注意力和 ABC 视觉化坐标纠正,并按类别路由专家模型。系统在 PointArena 2026 达到 77.2% 总准确率、排名第二,但计数和可控指向仍有明显空间。

See Only When Needed: Context-Aware Attention Intervention for Mitigating Hallucinations in LVLMs Figure 1
2026-06-30cs.CV

See Only When Needed: Context-Aware Attention Intervention for Mitigating Hallucinations in LVLMs

Yuqing Lei, Wenbo Lyu, Yingjun Du, Xiantong Zhen, Cees G.M. Snoek, Ling Shao

University of Chinese Academy of Sciences, University of Amsterdam, United Imaging Healthcare Co., Ltd., small tilts. Code is available at https://github.com/Iris1946/CAI.

2026-06-30视觉语言

本文针对 LVLM 在生成中因语言先验压过视觉证据而产生对象幻觉的问题,提出训练无关的 CAI:先用早层表示估计每个 token 该看图像的哪些区域,再只在深层、高熵的不确定 token 上轻量调整注意力,避免全局增强视觉带来的干扰。实验覆盖 LLaVA、InstructBLIP、Qwen-VL 与多项幻觉基准,显示 CAI 在无需对比解码时已稳定优于常规推理和均匀增强方法,加入对比解码还能进一步提升,但对低熵的“自信幻觉”仍可能失效。

Bricker to BRACE: A Bracket Exposure RAW Dataset and Restoration Model for Flicker-Banding Figure 1
2026-06-30cs.CV

Bricker to BRACE: A Bracket Exposure RAW Dataset and Restoration Model for Flicker-Banding

Zihan Zhou, Libo Zhu, Jue Gong, Zhiyi Zhou, Jiezhang Cao, Yong Guo, Yulun Zhang

Shanghai Jiao Tong University

2026-06-30数据集/基准

这篇论文针对手机拍摄屏幕时滚动快门与显示调光耦合导致的闪烁条纹,指出单帧方法难以区分真实纹理与伪影,而不同曝光下条纹形态会变化、内容相对稳定。作者构建合成与真实多曝光 RAW 数据集 Bricker,并提出结合频率先验与跨曝光空间注意力融合的 BRACE,同时引入 SFC 指标;实验显示其在合成和真实基准上优于既有方法,主要价值在于把闪烁条纹去除从单帧建模推进到多曝光 RAW 恢复范式。

Robust Trajectory Distillation: Hybrid Reweighting Meets Teacher-Inspired Targets Figure 1
2026-06-30cs.CV

Robust Trajectory Distillation: Hybrid Reweighting Meets Teacher-Inspired Targets

Kaifeng Chen, Lechao Cheng, Jiyang Li, Shengeng Tang, Fan Zhang, Yantao Pan, Yaxiong Wang, Tuanrui Hui, Zhun Zhong

Hefei University of Technology, Jianghuai Advance Technology Center, Anhui Provincial Key Laboratory of Humanoid Robots, Kaiyang Laboratory, Chery, Zhejiang University of Technology, label remedies (sample selection, loss weighting, label correction) tightly, noise and preserves transferable knowledge without relabeling or clean, representations under noisy supervision. The framework is robust, label-, Keywords: Dataset Distillation · Learning with Noisy Labels · Trajec-, which severely limits their reliability in real-world noisy-label environments., tional noisy-label learning techniques—such as sample selection [23, 28, 51], loss, weighting [24, 45], and label correction [30, 33]—attempt to identify and mitigate

2026-06-30规划控制安全鲁棒

本文针对噪声标签下数据集蒸馏容易把错误关联一并压缩、导致小型合成集鲁棒性下降的问题,提出轨迹匹配式鲁棒蒸馏框架:用SGR结合遗忘模式与KNN邻域一致性重加权教师轨迹,再用TIAT从教师中间动态提取辅助目标补充监督。实验称在对称、非对称和真实噪声设置下均优于现有DD基线,且无需重标注或干净子集。

HomeDiffusion: Zero-Shot Object Customization with Multi-View Representation Learning for Indoor Scenes Figure 1
2026-06-30cs.CV

HomeDiffusion: Zero-Shot Object Customization with Multi-View Representation Learning for Indoor Scenes

Guoqiu Li, Jin Song, Yiyun Fei

2026-06-30生成模型

针对室内电商家具等对象定制中单视角参考难以保持非对称物体细节与场景透视一致的问题,HomeDiffusion用多视角家具/室内数据学习对象表示,结合HD视觉编码器、MORL与BOCL,并在潜空间做像素对齐交叉注意力以保真细节;在自建ZOC-Indoor-Eval和Viton-HD上优于多种零样本/少样本方法,但具体增益与数据规模的关系仍需进一步辨析。

Learning Cross-view Correspondences for Geo-localization on Planetary Surfaces Figure 1
2026-06-30cs.CV

Learning Cross-view Correspondences for Geo-localization on Planetary Surfaces

Hong Minh Nguyen, Marcus Märtens, Tat-Jun Chin

AI for Space Group, Adelaide University, Australia

2026-06-30视觉感知

针对行星表面无 GNSS 且里程计会漂移的问题,论文把地面全景与轨道俯视图匹配建模为跨视角检索,并用 PANGU 基于月球高程模型构建 10438 个合成全景及一对一/瓦片式基准。实验从零训练 TransGeo,显示学习式方法可在模拟月面学到有效对应;但邻近瓦片区分仍难,光照方位变化会显著降准确率,真实图像迁移仍文中未充分说明。

Nemotron-Labs-Diffusion-Image: Advancing Masked Discrete Diffusion for High-Resolution Image Synthesis Figure 1
2026-06-30cs.CV

Nemotron-Labs-Diffusion-Image: Advancing Masked Discrete Diffusion for High-Resolution Image Synthesis

Shufan Li, Greg Heinrich, Hanrong Ye, Yonggan Fu, Aditya Grover, Jan Kautz, Pavlo Molchanov

2026-06-30视觉感知生成模型

该文针对掩码离散扩散在高分辨率文生图中缺乏已生成 token 自纠错能力、且大码本训练信号稀疏的问题,提出 NLD-Image:在训练与采样中加入 token editing,使已解码 token 可被迭代修正,并用分组交叉熵为嵌入空间邻近码字提供辅助监督,另实现融合算子降低显存。实验显示其在 1024px 文生图上达到 GenEval 0.90、DPG 86.9、HPSv3 10.76,GCE 在 ImageNet256 消融中优于 CE/SNCE。

Consistency as Inductive Bias: Learning Cross-View Invariance for Robust Multimodal Reasoning Figure 1
2026-06-30cs.CV

Consistency as Inductive Bias: Learning Cross-View Invariance for Robust Multimodal Reasoning

Xin Zou, Haolin Deng, Yibo Yan, Shuliang Liu, Kening Zheng, Zhiwei Jin, Chen Chen, Haonan Lu, Xuming Hu

HKUST (GZ), 2HKUST, 3OPPO AI Center, 4UIC, while preserving the standard GRPO learning signal when no valid consistent pair is available.

2026-06-30视觉语言安全鲁棒

这篇论文针对多模态大模型在RLVR/GRPO训练中只奖励单视图正确性、忽略等价视觉变换下答案稳定性的问题,提出ConsistRoll:把原图与语义不变变换图放入同一rollout组,并仅在两视图答案均正确且一致时给予联合奖励,从而把跨视图一致性变成在线信用分配信号。实验在14个数学逻辑、通用理解和幻觉评测上验证,Qwen2.5-VL 3B/7B及GRPO、Hint-GRPO设置下均有稳定增益。

Rethinking Forgery Attacks on Semantic Watermarks in Black-Box Settings: A Geometric Distortion Perspective Figure 1
2026-06-30cs.CR

Rethinking Forgery Attacks on Semantic Watermarks in Black-Box Settings: A Geometric Distortion Perspective

Cheng-Yi Lee, Yichi Zhang, Yuchen Yang, Chun-Shien Lu, Jun-Cheng Chen

Midjourney, Inc., 2025)., State University, PA, US. Correspondence to: Jun-Cheng Chen

2026-06-30视觉感知

本文针对语义水印在黑盒伪造攻击下为何成功或失败缺乏理论解释的问题,将攻击建模为潜空间中的率失真权衡,指出代理模型与目标模型不匹配会产生不可消除的失真下界;关键洞察是伪造痕迹并非随机噪声,而是潜流形上的全局漂移与局部形变。基于此,作者提出不依赖具体水印方案的预验证检测方法,实验显示其在多种黑盒伪造场景中能有效区分伪造样本,并保持对常见图像扰动的鲁棒性。

Clearer Sight, Fewer Lies: Oriented Pickup Preference Optimization for Multimodal Hallucination Mitigation Figure 1
2026-06-30cs.CV

Clearer Sight, Fewer Lies: Oriented Pickup Preference Optimization for Multimodal Hallucination Mitigation

Xin Zou, Haolin Deng, Yibo Yan, Shuliang Liu, Zhiwei Jin, Chen Chen, Haonan Lu, Xuming Hu

OPPO AI Center

2026-06-30视觉语言优化算法

本文针对多模态大模型在视觉证据弱或反常时更信语言先验而产生幻觉的问题,提出OPPO:利用模型注意力定位与强化查询相关区域,构造强、锚定、弱证据的有序视觉偏好链,并加入span/token级正则,使可信答案的偏好随证据强度变化。实验称其在幻觉与通用基准上优于DPO等方法,但具体增益与数据构造细节仍需进一步验证。

Concept Removal Guidance: Evidence-Calibrated Negative Guidance for Safe Diffusion Sampling Figure 1
2026-06-30cs.CV

Concept Removal Guidance: Evidence-Calibrated Negative Guidance for Safe Diffusion Sampling

Yoonseok Choi, Chaeyoung Oh, Hyunjun Choi, Seokin Seo, Kee-Eung Kim

†Work done while at KAIST. 1Kim Jaechul Graduate School of, AI, KAIST, Daejeon, Republic of Korea 2Center for Humanoid, ), where labels are discrete and unambiguous, it is less

2026-06-30生成模型安全鲁棒

本文针对文本到图像扩散模型在对抗提示下仍会生成裸露、暴力或特定风格等禁用概念的问题,指出固定负提示容易在安全性与保真度间失衡,而后验动态引导在开放词表场景不稳定。作者提出训练无关的 CRG,从扩散过程中的噪声预测与一步 clean 预测估计目标概念存在度,并用闭式约束更新自适应调节负引导强度。红队实验显示其降低攻击成功率,同时较好保持正常提示的图像质量,并可迁移到艺术家风格和暴力等移除目标。

UniTriSplat: A Unified 3D Gaussian Splatting Framework with Uniform Spherical Rasterization for Universal Cameras Figure 1
2026-06-30cs.CV

UniTriSplat: A Unified 3D Gaussian Splatting Framework with Uniform Spherical Rasterization for Universal Cameras

Yipeng Zhu, Huajian Huang, Tristan Braud, Sai-Kit Yeung

2026-06-30三维

这篇论文针对现有 3DGS 在透视、鱼眼、全景等相机间依赖专用投影与光栅化、导致采样不均和跨相机泛化差的问题,提出在单位球面上用 HEALPix 等面积网格统一表示并直接进行高斯 splatting,同时推导球面域前向/反向传播并设计 HEALPix-aware SSIM。实验显示其在多种相机模型下提升球面重建指标和跨相机一致性,同时保持较有竞争力的平面渲染质量。

OP3DSG: Open-Vocabulary Part-Aware 3D Scene Graph Generation for Real-World Environments Figure 1
2026-06-30cs.CV

OP3DSG: Open-Vocabulary Part-Aware 3D Scene Graph Generation for Real-World Environments

Yirum Kim, Ue-Hwan Kim

2026-06-30强化学习三维

这篇论文针对现有开放词汇3D场景图偏物体级、难以支持机器人精细交互的问题,提出OP3DSG,将物体、可交互部件、空间/功能关系与可供性统一到同一图中。核心做法是用物体-部件知识约束候选检测,结合多视角细粒度3D融合,并以几何先验约束LLM关系 refinement,降低穷举推理和幻觉。作者还构建UniGraph3D基准,实验显示其在部件 grounding、多层关系预测及语言查询、导航、任务规划等下游任务中优于已有方法。

FalconTrack: Photorealistic Auto-Labeled Perception and Physics-Aware Vision-Based Aerial Tracking Figure 1
2026-06-30cs.RO

FalconTrack: Photorealistic Auto-Labeled Perception and Physics-Aware Vision-Based Aerial Tracking

Yan Miao, Karteek Gandiboyina, Noah Giles, Hideki Okamoto, Bardh Hoxha, Georgios Fainekos, Sayan Mitra

2026-06-30视觉感知

FalconTrack面向GPS受限场景中无人机仅靠视觉稳定跟踪多类目标的难题,关键在于用Gaussian Splatting从短视频自动生成逼真且带mask、类别和6-DoF位姿的训练数据,并将多头感知与类别条件动力学EKF结合。实验显示其约20分钟生成1万张标注图,零样本实机类别准确率达96–100%,机载约25Hz闭环跟踪在F1-tenth和门目标上成功率100%,优于仅按mask中心跟踪的基线。

Graph-GSReg: Leveraging 3D Scene Graphs for Gaussian Splatting Registration Figure 1
2026-06-30cs.CV

Graph-GSReg: Leveraging 3D Scene Graphs for Gaussian Splatting Registration

Jaewon Lee, Mangyu Kong, Euntai Kim

2026-06-30三维

面向大规模机器人建图和长期地图维护中多个独立 3DGS 场景难以对齐、直接合并易产生空洞和漂浮物的问题,Graph-GSReg 将 3DGS 渲染与几何语义信息抽象为 3D 场景图,把配准转化为图匹配并用最大团筛除错误对应,再以自监督测试时优化细化合并后的高斯。文中在真实与合成基准上展示了有竞争力的配准精度和更好的合并场景渲染质量。

UrbanCDNet: Appearance-Robust and Boundary-Aware Bitemporal Change Detection for Korean Urban Building Monitoring Figure 1
2026-06-30cs.CV

UrbanCDNet: Appearance-Robust and Boundary-Aware Bitemporal Change Detection for Korean Urban Building Monitoring

Abdirashid Omar, Jonghyuk Park

Department of Data Science, Graduate School of Kookmin University

2026-06-30视觉感知学习理论安全鲁棒

针对韩国城市双时相航拍中建筑变化稀疏、光照外观差异大且需贴合建筑边界的问题,UrbanCDNet采用孪生CNN,将多线索归一化时序比较、中尺度对齐差分、轻量上下文校准与训练期边界监督结合。其在修正AIHub基准上取得0.7511 F1、0.6014 IoU,优于Siamese U-Net和ChangeFormer,增益主要体现在稀疏变化、高光度差和边界定位场景。

TopoAgent: An Agentic Framework for Automated Topology Learning in Medical Imaging Figure 1
2026-06-30cs.CV

TopoAgent: An Agentic Framework for Automated Topology Learning in Medical Imaging

Guangyu Meng, Pengfei Gu, Xueyang Li, Yiyu Shi, Erin Wolf Chambers, Danny Z. Chen

Dept. of Computer Science and Engineering, University of Notre Dame, Notre, Dept. of Computer Science, The University of Texas Rio Grande Valley, Edinburg

2026-06-30视觉感知

医学图像中的拓扑特征依赖描述子选择,现有做法常固定单一描述子,难以适配不同形态且需要专家反复试错。TopoAgent将LLM代理的感知、推理、工具调用与反思闭环用于自动选择并配置拓扑描述子,并用26个数据集蒸馏经验和构建TopoBenchmark。实验报告平均平衡准确率68.21%,较最强基线高9.32%,也明显优于同工具的通用LLM。

MR-IQA: A Unified Margin View of Regression and Ranking for Blind Image Quality Assessment Figure 1
2026-06-30cs.CV

MR-IQA: A Unified Margin View of Regression and Ranking for Blind Image Quality Assessment

Yuan Li, Youyuan Lin, Zitang Sun, Yung-Hao Yang, Kiyofumi Miyoshi, Chenhui Chu, Shin'ya Nishida

Graduate School of Informatics, Kyoto University

2026-06-30视觉感知

针对盲图像质量评价中回归重绝对分数、排序重相对偏好但二者关系缺乏解释的问题,论文提出“质量边际”视角,指出两类监督本质上都在拟合成对质量差,并据此设计基于强化学习的 MR-IQA,直接奖励预测分数差与 MOS 差的一致性。六个 BIQA 基准和受控对比显示,其平均 PLCC/SRCC 优于回归或排序式 RL 基线,但泛化到其他模型族仍文中未充分说明。

LEIQ-Assessor: Multi-dimensional Quality Assessment of Low-light Enhanced Images via Multi-task Learning Figure 1
2026-06-30cs.CV

LEIQ-Assessor: Multi-dimensional Quality Assessment of Low-light Enhanced Images via Multi-task Learning

Wei Sun, Yanwei Jiang, Dandan Zhu, Jinqiu Sang, Jikai Xu, Weixia Zhang, Guangtao Zhai

East China Normal University, 2 Shanghai Jiao Tong University

2026-06-30视觉感知

低光增强虽提升可见度,却常引入噪声放大、偏色、结构破坏和过曝,单一质量分数难以诊断问题。LEIQ-Assessor的核心是用SigLIP2 ViT共享表征,并以多任务方式同时预测MOS及亮度、色彩、噪声、曝光、自然度、内容恢复六项属性,用PLCC损失利用属性相关性。实验显示其在MLE基准上优于现有无参考IQA和手工指标,并获QoMEX 2026挑战赛第二名。

HTC-SGA Former: A Hybrid Transformer-CNN Network with Self-Guided Attention and a New Boundary-Weighted Adaptive Loss for Coronary DSA Vessel Segmentation Figure 1
2026-06-30cs.CV

HTC-SGA Former: A Hybrid Transformer-CNN Network with Self-Guided Attention and a New Boundary-Weighted Adaptive Loss for Coronary DSA Vessel Segmentation

Rayan Merghani Ahmed, Marwa Omer Mohammed Omer, Mohamed Elmanna, Shijie Li, Bin Li, Shoujun Zhoua

2026-06-30视觉感知学习理论

针对冠脉 DSA 中低对比细小血管、边界模糊和前景-背景极不均衡导致的断裂分割问题,本文提出轻量 HTC-SGA Former,用 CNN 编码局部形态、Transformer 解码全局上下文,并以 MS-GLWA、SGFA 和边界加权自适应损失强化弱血管与边界。私有左右冠脉数据上优于 14 种方法,且仅 0.81M 参数;但数据私有,泛化性仍需外部验证。

ScaleAware-JEPA: Latent Representation for Discovery in Multiscale Physical Fields Figure 1
2026-06-30cs.LG

ScaleAware-JEPA: Latent Representation for Discovery in Multiscale Physical Fields

Guang-Xing Li

2026-06-30视觉感知

本文针对连续物理场中结构跨尺度组织、但传统自监督固定图像 patch 预测与物理尺度不匹配的问题,提出 ScaleAware-JEPA:先用 CDD 分解出像素对齐的尺度成分,再让 JEPA 的掩码和预测上下文随扩散尺度变化。实验覆盖 MHD 湍流、星际分子气体和城市夜光,结果显示其可生成可回映到空间形态的稠密潜表示图谱,无需标签或预设分割规则。

AerialMetric: Benchmarking and Adapting UAV Monocular Metric Depth Estimation in the Real World Figure 1
2026-06-30cs.CV

AerialMetric: Benchmarking and Adapting UAV Monocular Metric Depth Estimation in the Real World

Zhongqiang Song, Guanying Chen, Yuqi Zhang, Yin Zou, Chuanyu Fu, Zhiyuan Yuan, Chuan Huang, Shuguang Cui, Xiaochun Cao

Sun Yat-sen University, Shenzhen Campus, Corresponding author. 1 Sun Yat-sen University, Shenzhen Campus

2026-06-30强化学习数据集/基准

这篇论文针对现有单目度量深度模型从街景/室内迁移到无人机航拍时尺度与视角域差明显的问题,提出 AerialMetric 基准:结合真实倾斜摄影、可控采集、合成场景和野外图像,提供约 52K 真实与 16K 合成深度对,并系统拆解俯仰、航高和 FOV 影响。实验显示主流模型在航拍场景鲁棒性不足,而用该数据微调后可显著提升航拍度量深度表现,增益可能主要来自更匹配的数据覆盖与监督。

Accurate Recognition of Pneumonia and COVID-19 by Geometric Shape Normalization of Lung Region using Automatic Landmark Detection and Piecewise Affine Warping Figure 1
2026-06-30cs.CV

Accurate Recognition of Pneumonia and COVID-19 by Geometric Shape Normalization of Lung Region using Automatic Landmark Detection and Piecewise Affine Warping

Salvador E. Ayala-Raggi, Rafael Alejandro Cruz-Ovando, Lauro Reyes-Cocoletzi, Aldrin Barreto-Flores

2026-06-30视觉感知

针对胸片肺炎/COVID-19识别易受体位、尺度和设备伪影影响的问题,论文用ResNet-18自动检测15个肺部标志点,并通过Procrustes标准形、Delaunay网格和分片仿射形变将肺区几何归一化,再分类。标志点平均误差3.61像素,归一化模型在COVID-19 Radiography Database上达98.60±0.26%准确率、98.00%宏F1;虽低于原图模型,但Grad-CAM和裁剪实验表明原图优势可能来自采集伪影,归一化相对更抗伪相关。

UniVAD v2: Unified Visual Anomaly Detection via Support-Conditioned Boundary Construction Figure 1
2026-06-30cs.CV

UniVAD v2: Unified Visual Anomaly Detection via Support-Conditioned Boundary Construction

Zhaopeng Gu, Bingke Zhu, Zhaowen Li, Guibo Zhu, Yingying Chen, Ming Tang, Peng Su, Jinqiao Wang

2026-06-30视觉感知学习理论

本文针对统一视觉异常检测在少样本迁移时难以为未见类别设定可靠、可调决策边界的问题,提出由正常支持集和可选异常参考共同构造边界的 UniVAD v2。其核心在于用最优传输关系建模补足局部检索的全局匹配能力,并自适应融合两类正常侧证据,再用异常参考提供拒绝侧约束。六个跨域数据集上,1N-shot 平均图像 AUC 从 UniVAD 的 83.0% 提升到 84.5%,加入 1 个异常样本后达 85.7%。

GUICrafter: Weakly-Supervised GUI Agent Leveraging Massive Unannotated Screenshots Figure 1
2026-06-30cs.AI

GUICrafter: Weakly-Supervised GUI Agent Leveraging Massive Unannotated Screenshots

Sunqi Fan, Lingshan Chen, Runqi Yin, Qingle Liu, Yongming Rao, Meng-Hao Guo, Shi-Min Hu

2026-06-30视觉感知

针对 GUI 智能体依赖昂贵人工标注、视觉定位和跨设备泛化不足的问题,GUICrafter 将大量未标注网页与移动截图中的可交互信号转化为元任务,并用两阶段课程式 RLVR 先弱监督预训练、再少量高质量数据校准。实验显示其仅用约 UI-TARS 0.1% 的数据即可达到相当或更优表现,并在 Mind2Web、ScreenSpot-Pro、AndroidControl 等基准上超过同规模 GUI-R1。

Early Warning Signals for OpenVLA Failure under Visual Distribution Shift Figure 1
2026-06-30cs.CV

Early Warning Signals for OpenVLA Failure under Visual Distribution Shift

Dipesh Tharu Mahato, Rachel Ren

New York University

2026-06-30强化学习

这篇论文针对视觉分布偏移下 VLA 机器人策略失败难以及时诊断的问题,研究固定 OpenVLA 的内部前馈激活是否已包含临近失败信号。其核心洞察是,不重训策略,仅用轻量线性监测器即可从特定层读出风险;在 LIBERO 遮挡实验中成功率由 57% 降至 17%,第 16 层 logistic probe 预测 15 步内失败达到 AUROC 0.972、AUPRC 0.352,并对相机抖动有有限迁移,但因未证明因果机制、任务外泛化或恢复策略,结论仍限于受控诊断场景。

MF-UAVPose6D: A Model-Free Monocular 6-DoF Pose Estimation Framework for Fixed-Wing UAVs Figure 1
2026-06-30cs.CV

MF-UAVPose6D: A Model-Free Monocular 6-DoF Pose Estimation Framework for Fixed-Wing UAVs

Juanqin Liu, Leonardo Plotegher, Eloy Roura, Shaoming He

2026-06-30三维

面向远距离、非合作固定翼无人机缺少 CAD 模型和关键点先验的问题,论文提出 MF-UAVPose6D,仅用单目 RGB 与相机内参,通过中心热图定位、视线先验建模、动态拓扑采样和位姿解耦解码来缓解小目标结构弱、深度与姿态耦合的困难;同时构建合成 FW-UAV6DPose 数据集,实验显示其在旋转、深度恢复和联合 6DoF 评估上优于对比方法且推理较高效。

Progressive Self-Supervised Learning with Individualized Community Assignment for Brain Network Analysis Figure 1
2026-06-30cs.CV

Progressive Self-Supervised Learning with Individualized Community Assignment for Brain Network Analysis

Hairui Chen, Yanwu Yang, Jianfeng Cao, Hanyang Peng, Chenfei Ye, Ting Ma

2026-06-30视觉感知

该文针对fMRI脑网络自监督学习常忽视个体化功能社区差异的问题,提出BrainPICM:用渐进式非平衡最优传输估计ROI到社区的软分配与置信度,并据此从高置信到低置信区域进行课程式遮蔽,同时提取相对群体模板的社区偏移特征。结果显示其在ABIDE-I、ADHD-200、ADNI三类诊断任务上优于多种监督和自监督基线,但具体增益中各模块贡献仍需结合消融细看。

PoseShield: Neural Collision Fields for Human Self-Collision Resolution Figure 1
2026-06-30cs.CV

PoseShield: Neural Collision Fields for Human Self-Collision Resolution

Zhengyuan Li, Zeyun Deng, Yifan Shen, Liangyan Gui, Miaolan Xie, Joseph Campbell, Xifeng Gao, Kui Wu, Zherong Pan, Aniket Bera

2026-06-30三维

这篇论文针对 SMPL 姿态估计与动作生成中常见的自穿透问题,提出 PoseShield:在低维姿态空间学习神经碰撞约束,并用 Eikonal 正则保证碰撞边界附近梯度不消失,从而让 SLSQP 等约束优化更稳定。方法可作为无需重训生成器的后处理模块扩展到动作序列;在新建 HwC/相关基准上报告 95.8% 修复成功率,优于已有网格空间或启发式惩罚方法。

Evolutionary Hyperparameter Optimization to Find Lightweight CNN Models for Autonomous Steering Figure 1
2026-06-30cs.NE

Evolutionary Hyperparameter Optimization to Find Lightweight CNN Models for Autonomous Steering

Devson Butani, Ryan Kaddis, Chan-Jin Chung

2026-06-30优化算法

面向车载算力受限且标注数据很少的自动转向场景,论文用带 1/5 成功规则的(N+M)进化策略自动搜索 CNN/DNN 架构与超参数,试图直接得到小模型而非依赖蒸馏。实验基于 LTU ACTor 采集的 2957 张图像,结果表明可在显著压缩模型规模的同时保持有竞争力的转向角预测精度,但泛化到更复杂天气和道路条件仍文中未充分说明。

Unlocking the Visual Record of Materials Science: A Large-Scale Multimodal Dataset from Scientific Literature Figure 1
2026-06-30cs.CV

Unlocking the Visual Record of Materials Science: A Large-Scale Multimodal Dataset from Scientific Literature

Subham Ghosh, Shubham Tiwari, Mohammad Ibrahim, Abhishek Tewari

Mehta Family School of Data Science and Artificial Intelligence, Indian Institute of Technology Roorkee, Uttarakhand, India-247667, Department of Metallurgical and Materials Engineering

2026-06-30视觉语言数据集/基准

材料科学论文中的复合图长期难以被可靠转化为图文训练数据,限制了科学视觉语言模型。本文提出 MatMMExtract,将开放获取论文中的图、caption 与正文引用解析后,先做面板级拆分,再用材料学分类体系约束 LLM 生成子标题、类别和摘要,构建 MatSciFig。结果得到 39.2 万个面板级图文对;MaterialScope 上 YOLO12-m 的 mAP50 达 0.9227,检索基线较零样本 CLIP 的 R@1 提升 4.4 倍。

No Figure
2026-06-30cs.CV

Benchmarking Geospatial Foundation Models for Agriculture Applications

Zhuocheng Shang, Sanmay Das, Ahmed Eldawy

University of California, Riverside, University of California, Riverside Riverside USA

2026-06-30数据集/基准

这篇论文针对农业遥感中“地理泛化是否可靠”的问题,构建了一个跨美国四州、训练/验证/测试区域严格分离的基准,评估 Prithvi、SpectralGPT 和 SatMAE 在作物分割与变化检测上的迁移能力。核心洞察是现有 GeoFM 在区域分布偏移下并不稳健,常只预测主流作物、漏检稀有类别;同时统一输入格式会不均等地影响不同模型,使架构优劣比较更复杂。

VIB-AVSR: Variational Information Bottleneck for Noise-Robust LLM-Based Audio-Visual Speech Recognition Figure 1
2026-06-30eess.AS

VIB-AVSR: Variational Information Bottleneck for Noise-Robust LLM-Based Audio-Visual Speech Recognition

Piyush Arora, Navlika Singh, Umberto Cappellazzo, Stavros Petridis, Maja Pantic

♡Imperial College London, UK, Our code is available at, such as AV-HuBERT [5, 6] and large-scale automatic labeling

2026-06-30视觉感知安全鲁棒

这篇论文针对LLM式音视频语音识别在干净语音上表现好、但LLM主干缺少抗噪表示约束的问题,提出在选定LLM层插入变分信息瓶颈,仅压缩音频隐状态以过滤噪声扰动,同时保留视觉唇动与文本上下文。实验在LRS2与多种MUSAN噪声/SNR下显示,相比Llama-AVSR可降低WER,低SNR和极端噪声下收益更明显,且基本不牺牲干净语音表现。

One Scene, Two Depths: Probing Geometric Ambiguity in Monocular Foundation Models Figure 1
2026-06-30cs.CV

One Scene, Two Depths: Probing Geometric Ambiguity in Monocular Foundation Models

Xiaohao Xu, Feng Xue, Xiang Li, Haowei Li, Shusheng Yang, Tianyi Zhang, Matthew Johnson-Roberson, Xiaonan Huang

University of Michigan, Ann Arbor, MI, USA, Carnegie Mellon University, Pittsburgh, PA, USA, New York University, New York, NY, USA, Vanderbilt University, Nashville, TN, USA, depth label into a layer convention shaped by annotation, dataset construction, derived labels may emphasize different physical layers: ultrasound can return the, scene (Fig. 1a). Synthetic labels also encode renderer choices for ray termination

2026-06-30视觉感知

论文指出,透明/分层场景中单目深度的一像素一深度假设会把多种几何有效表面压成数据集约定,影响机器人空间理解。其核心是提出 MD-3k 双层序关系基准,显式度量模型偏好的前景玻璃或背景层,并用无需训练的拉普拉斯视觉提示探测冻结模型是否能切换深度假设。结果显示主流深度基础模型层偏好差异明显,部分模型可被 LVP 调制,DAv2-L 的 RGB/LVP 组合达到 75.5% ML-SRA。

SonoCLIP: Mask-Guided Region-Aware Vision-Language Pretraining for Fetal Ultrasound Analysis Figure 1
2026-06-30cs.CV

SonoCLIP: Mask-Guided Region-Aware Vision-Language Pretraining for Fetal Ultrasound Analysis

Hang Su, Chao Sun, Zhaofan Li, Wei Hu, Juhua Liu, Bo Du

School of Computer Science, Wuhan University, Wuhan, China, Institute of Artificial Intelligence, Wuhan University, Wuhan, China, Department of Ultrasound, Renmin Hospital of Wuhan University, Wuhan, China, National Engineering Research Center for Multimedia Software, Wuhan University, Hubei Key Laboratory of Multimedia and Network Communication Engineering, Wuhan University, Wuhan, China, propose SonoCLIP, the first million-scale region-controllable fetal ultra-, global–local contrastive representation learning. To support scalable re-, standard planes for large-scale pretraining. Extensive cross-center evalu-, controllable and clinically oriented foundation model for fetal ultrasound, analysis. Our code and data are available at: https://github.com/Harrison-, Region-Controllable Learning · Contrastive Alignment.

2026-06-30视觉语言视觉感知

胎儿超声受散斑噪声、采集差异和细微解剖边界影响,单纯全局 CLIP 对齐容易忽略临床关键局部结构。SonoCLIP 将分割掩码作为额外视觉通道,引入区域可控的图文预训练,并用 sigmoid 成对对比损失支撑大规模区域-文本监督;在 1.44M 张、24 标准切面数据上训练后,跨中心零样本 Top-1 从 FetalCLIP 的 39.78% 提升到无掩码 58.38%、有掩码 85.01%,但部分增益可能主要来自 scaling / data。

ScAle: Attention Head Scaling as a Minimal Adapter for Spatial Reasoning in Vision Language Models Figure 1
2026-06-30cs.CV

ScAle: Attention Head Scaling as a Minimal Adapter for Spatial Reasoning in Vision Language Models

Rahul Chowdhury, Timothy A Rupprecht, Xuan Shen, Pu Zhao, Yanzhi Wang

Northeastern University, Boston, USA, EmbodyX Inc., USA, Zhejiang University, China, Code is available at https://github.com/rchowdhubnor/ScAle.git.

2026-06-30视觉感知

这篇论文针对VLM在几何关系、导航和地图理解等空间推理上表现薄弱、而常规PEFT需大量参数的问题,提出ScAle:冻结主干,仅学习少量有界标量,对末token的注意力头及MLP激活进行缩放,以重加权空间相关表示。实验在SpatialEval、What’sUp及真实VQA上显示,约1K可训练参数即可带来最高134.1%相对准确率提升,并基本保持非空间VQA能力;但具体增益中有多少来自scaling机制与训练数据,文中仍未充分说明。

ReMAP-PET: Beyond Visual Understanding -- Learning Region-Guided Metabolic Alignment Semantics from Brain PET Figure 1
2026-06-30cs.CV

ReMAP-PET: Beyond Visual Understanding -- Learning Region-Guided Metabolic Alignment Semantics from Brain PET

Dasen Dai, Yanteng Zhang, Shuoqi Li, Yuxiang Wei, Hongjie Yu, Qingxin Zhang, Qizhen Lan, Jagath C. Rajapakse, Vince D. Calhoun

The Chinese University of Hong Kong, HKSAR, TReNDS Center (Georgia State, Georgia Tech, Emory), Atlanta, USA, ShanghaiTech University, Shanghai, P.R.China, University of California, Berkeley, USA, University of Texas Health Science Center at Houston, USA, Nanyang Technological University, Singapore, cal signals available in PET. A natural question is

2026-06-30视觉感知

该文针对现有3D脑影像基础模型把PET当作普通体数据、忽略区域代谢结构的问题,提出ReMAP-PET,用120脑区SUVR监督部分微调的MedicalNet 3D ResNet-50,并结合SUVR回归与PET-SUVR对比学习,将PET表征约束到可解释的代谢空间。结果显示其在1015对PET-SUVR样本上达到0.070 SUVR MAE和77.8% PET→SUVR Recall@1,并可进一步对齐临床文本、支持报告生成和下游诊断/认知线性探测。

Reliability-Prioritized Fine-Grained Generation in Multimodal Large Figure 1
2026-06-30cs.CV

Reliability-Prioritized Fine-Grained Generation in Multimodal Large

Xiaomeng Fan, Wu Wei, Yuwei Wu, Zhi Gao, Shiyu Luo, Mingyang Gao, Haoyu Zhao, Zhenxin Diao, Yuxuan Ba, Lijia Feng, Yunde Jia, Mehrtash Harandi

Beijing Key Laboratory of Intelligent Information Technology, School of Computer Science & Technology, Beijing Institute of Technology, Guangdong Laboratory of Machine Perception and Intelligent Computing, Shenzhen MSU-BIT University, Department of Electrical and Computer System Engineering, Monash University, Code and data are available here., labelthat is not actually correct., coarse-to-fine hierarchical labels.

2026-06-30视觉语言

这篇论文针对多模态大模型在细粒度视觉描述中“越具体越易错”的问题,提出应优先生成图像可靠支持的最细描述,而非盲目追求细节。作者构建含多物体、层级标签的 GRANFACT,并设计层级感知评测与 RP-DPO,通过惩罚不可靠细粒度断言、奖励可靠具体性来优化模型。实验显示该方法能在保持可靠性的同时提升细粒度生成,但评测集规模和领域覆盖仍有限。

GarmentZoom: Generating Zoomable Images from Garment Listings Figure 1
2026-06-30cs.CV

GarmentZoom: Generating Zoomable Images from Garment Listings

Renjie Zhao, Jingwei Ma, Huy Huynh Cao, Brian Curless, Steven M. Seitz, Ira Kemelmacher-Shlizerman

University of Washington

2026-06-30视觉感知

GarmentZoom针对电商服装图只能在全身视图与局部特写间切换、难以连续查看细节的问题,提出用未对齐特写作为纹理参考来增强全身图的生成式超分辨方案。其核心在于构建真实商品图的可变尺度监督,并用参考条件LoRA在无需空间对齐和单样本微调的情况下适配3–20×缩放。实验显示该方法在10×及最高16×放大下相较基线显著降低LPIPS、DISTS和LSD,质量接近逐例微调但训练成本更低。

MotionAtlas: Detailed Region Captioning for Motion-Centric Videos Figure 1
2026-06-30cs.CV

MotionAtlas: Detailed Region Captioning for Motion-Centric Videos

Weisong Liu, Haochen Wang, Kuan Gao, Yuhao Wang, Yikang Zhou, Zhongwei Ren, Jacky Mai, Anna Wang, Yanwei Li, Jason Li, Zhaoxiang Zhang

Institute of Automation, Chinese Academy of Sciences, Shanghai Jiao Tong University 3Nanyang Technological University, Peking University 5Wuhan University 6Beijing Jiaotong University, benchmark, (2) a scalable, high-quality pipeline to construct training, Second, we design a rigorous and scalable data pipeline that leverages, the red shirt while retreating from the center

2026-06-30视觉语言视觉感知

这篇论文针对现有视频多模态模型难以精细理解局部运动、且全局运动描述难以可靠评测的问题,提出以时空掩码限定目标区域的 MotionAtlas。其核心是结合人工标注的 MotionAtlas-Bench、带自举 refinement 的 159k 区域运动描述数据和定制训练配比,以减少视觉干扰与细粒度幻觉。实验显示,MotionAtlas 在多个运动理解基准上稳定优于 Qwen3-VL 等基线,其中 4B 模型平均提升约 5.2 个百分点。

Scenes as Objects, Not Primitives: Instance-Structured 3D Tokenization from Unposed Views Figure 1
2026-06-30cs.CV

Scenes as Objects, Not Primitives: Instance-Structured 3D Tokenization from Unposed Views

Mijin Yoo, In Cho, Subin Jeon, Jiwoo Lee, Eunbyung Park, Seon Joo Kim

Yonsei University, Seoul National University

2026-06-30三维

针对前馈三维重建常输出无结构点或高斯、对象级信息需事后聚合的问题,论文将场景直接表示为实例化3D token组:实例token负责对象身份与范围,anchor token生成局部几何外观并解码为高斯。该表示用2D可微渲染联合重建与分割监督学习,无需3D标注;在类别无关实例分割上超过逐场景优化基线,视图合成保持竞争力,并支持对象级编辑与开放词汇检索。

Benchmark AUC Is Not Deployable Reliability: A Cross-Dataset Audit of Off-the-Shelf Features for Surveillance Video Anomaly Detection Figure 1
2026-06-30cs.CV

Benchmark AUC Is Not Deployable Reliability: A Cross-Dataset Audit of Off-the-Shelf Features for Surveillance Video Anomaly Detection

Mohammadreza Rashidi

Department of Computer Science, AI and Media Analysis Lab, that the benchmark numbers quoted for surveillance anomaly detection describe a calibrated laboratory setting and, anomaly labels, which is what makes unsupervised normality modelling and frame-level evaluation possible., A separate, weakly supervised paradigm instead trains on video-level normal and anomalous labels [10], Most VAD papers report same-dataset AUC. This number measures a calibrated, same-camera laboratory setting., A. Datasets and labels, each test frame carries a binary label, positive if it contains any annotated, We read labels directly from these files. The ShanghaiTech training and test splits are large, so we build its normality

2026-06-30视觉感知数据集/基准

这篇论文针对监控视频异常检测常用同数据集 AUC 难以代表真实部署的问题,做了一个跨数据集审计而非提出新检测器:用 CLIP、DINOv2 等冻结特征和简单 kNN/马氏距离正常性模型,在四个基准间交叉测试。结果显示同数据集平均 AUC 为 0.704,但跨数据集仅 0.499 接近随机,DINOv2 还出现最大跌幅,且误报率高到不可用,说明现有基准显著高估了部署可靠性。

Empirical Evaluation of Multi-Modal Touch Detection in Over-the-Shoulder Video Surveillance Figure 1
2026-06-30cs.CV

Empirical Evaluation of Multi-Modal Touch Detection in Over-the-Shoulder Video Surveillance

Mohammadreza Rashidi

Department of Computer Science, AI and Media Analysis Lab, • A real-world generalization audit on five public, third-person phone videos using a label-free detection-volume

2026-06-30视觉感知数据集/基准

本文关注肩窥视频中从手指动作推断手机按键的安全风险,评估一个无需训练的 BEHINT 多模态触碰检测管线,将 MediaPipe 手部关键点、肤色、帧差运动和边缘线索映射到键盘布局。核心洞察是经典滤波融合并未带来可靠虚拟键盘记录:在单个标定片段上综合 F1 仅 16.7%、序列相似度 3.0%,到真实公开视频中还会因肤色滤波把整只手当作触点而严重过报。

Learning Where and When: Patch-Based Spatiotemporal Localization in Weakly Supervised Video Anomaly Detection Figure 1
2026-06-30cs.CV

Learning Where and When: Patch-Based Spatiotemporal Localization in Weakly Supervised Video Anomaly Detection

Hamza Karim, Nghia Nguyen, Lokman Bekit, Yasin Yilmaz

University of South Florida, els are trained using only coarse labels such as video-level, tection, where only video-level labels are available during, tiotemporal tube localization, using only video-level labels., annotations are available only for UCF-Crime and Shang-

2026-06-30视觉感知

这篇论文针对弱监督视频异常检测只判断“何时异常”、难以解释“异常在画面何处”的问题,将 MIL 从时间片段扩展到 7×7 patch 级时空网格,并用邻近感知 Top-k 选择聚合时空相邻的高分区域,在无框监督训练下生成细粒度异常热图。作者称其在多个基准上超过现有方法,并额外发布 XD-Violence 与 UBnormal 测试集框标注;但具体增益相对来自 patch 建模、损失设计还是新标注评测,需看完整实验拆分。

Rectifying Mask via Entropy for Distractor-Free 3DGS in Ambiguous Scenarios Figure 1
2026-06-30cs.CV

Rectifying Mask via Entropy for Distractor-Free 3DGS in Ambiguous Scenarios

Wongi Park, Jiyeon Lim, Minjae Lee, Myeongseok Nam, Seongjun Choi, Jungwoo Kim, Soomok Lee, William J. Beksi, SangHyun Lee

Georgia Institute of Technology, Yonsei University, Seoul National University, Kennesaw State University, University of Texas at Arlington

2026-06-30三维

本文关注真实场景 3DGS 中动态物体、遮挡或外观变化与静态背景颜色/语义相近时,传统光度残差或语义特征难以生成可靠 transient mask、还会误导高斯密度控制的问题。RefineSplat 的核心洞察是利用熵信号结合实例掩码识别这些模糊干扰物,并用熵感知的位置梯度调节密度控制以减少高斯错位。作者还构建了含 18 个室内外场景的 Ambiguous wild 数据集,实验显示其在多数据集上优于现有方法,实现更干净的新视角合成。

VCS-SLAM: Geometry-Validated Semantic Evidence Fusion for 3D Gaussian SLAM Figure 1
2026-06-30cs.CV

VCS-SLAM: Geometry-Validated Semantic Evidence Fusion for 3D Gaussian SLAM

Raman Jha, Shuaihang Yuan, Yi Fang

2026-06-30三维

这篇论文针对语义3D Gaussian SLAM中把每帧2D语义标签等权融合的问题:遮挡、无几何支撑的边界和射线歧义会把错误语义固化进全局地图。VCS-SLAM的核心是先用可见性一致性、表面支撑边界证据和冲突感知不确定性评估观测可靠性,再加权优化语义高斯。Replica上语义一致性、边界保持和重建质量提升,ScanNet上跟踪性能保持竞争力,但具体增益幅度需看完整实验。

The Calibrated Deepfake Trust Score (CDTS): Competence-Coupled Trust Degradation Across Deepfake Detectors Figure 1
2026-06-30cs.CR

The Calibrated Deepfake Trust Score (CDTS): Competence-Coupled Trust Degradation Across Deepfake Detectors

Md Anas Biswas

School of Computing, University of Portsmouth, Portsmouth, United Kingdom, coupling flags (its error tracks competence at r = −0.98), and competence is estimable without labels, so a, label-free monitor flags calibration risk on unseen generators and routing source-batches on a reference-free, label-free competence monitor that drives a zero-trust routing policy. The equity audit and explanation-faithfulness analysis are, the coupling and label-free, errors propagate silently: a confidently mislabelled asset is never escalated for review. The reliability of the, without labels), not discriminate in it (degrade evenly across subgroups), and route around it (feed a, and augments it with a label-free competence estimate and a routing policy. Treating the instrument, rather

2026-06-30视觉感知

本文针对深伪检测器在审核、溯源等流程中被当作“可信度概率”使用而非仅作分类器的问题,提出 CDTS 包装器,将任意检测器输出校准为信任分数,并加入无标签能力监测与路由。核心洞察是校准、解释忠实度和公平性退化主要由检测能力下降共同驱动,而非生成器时间演进;32 个配置中能力与校准误差强相关,并在 CNN 与 CLIP ViT、跨数据集和未见生成器上复现,无标签熵信号可提前标记高校准风险。

MAVIN: Multi-Shot Audio-Visual Generation with Narrative Control Figure 1
2026-06-30cs.CV

MAVIN: Multi-Shot Audio-Visual Generation with Narrative Control

Kaiqi Liu, Yunyao Mao, Ziqi Cai, Zheng Geng, Jing Wang, Qiulin Wang, Xintao Wang, Pengfei Wan, Kun Gai, Shuchen Weng, Boxin Shi

2026-06-30规划控制

MAVIN面向多镜头影视生成中音画事件难按时间线对齐、角色外观与声线难持续控制、脚本缺少音频线索的问题,基于OVI引入边界感知注意力、ID感知传播和多智能体分层脚本生成,并构建含80万训练样本与1千人工验证样本的MAVINSet;实验显示其在质量、语义、音画同步和多镜头一致性指标上优于现有联合或级联方法,但实际应用仍限于15秒和最多3个定制角色。

Rank-Aware Hyperbolic Alignment for Vision-Language Dataset Distillation Figure 1
2026-06-30cs.CV

Rank-Aware Hyperbolic Alignment for Vision-Language Dataset Distillation

Jongoh Jeong, Sun-Kyung Lee, Kuk-Jin Yoon

Korea Advanced Institute of Science and Technology (KAIST), Republic of Korea, Electronics and Telecommunications Research Institute (ETRI), Republic of Korea, large paired image–text datasets and scalable contrastive objectives, amplified, scalability

2026-06-30视觉语言视觉感知数据集/基准

这篇论文针对视觉语言数据集蒸馏中全维欧氏对齐过强的问题:图文相关性往往低秩,语义共享只集中在部分方向。作者提出 RAHA,将表示提升到双曲空间,并显式分解共享 range 与残差子空间,只在主语义方向做测地对齐、对残差做正则以保留模态私有信息。实验显示在固定预算下跨模态检索有竞争力,迁移与鲁棒性指标有所改善。

CellDETR: A Detection-Guided Framework for Scalable Cell Representation Learning from Histopathology Images Figure 1
2026-06-30cs.CV

CellDETR: A Detection-Guided Framework for Scalable Cell Representation Learning from Histopathology Images

Shikang Zhang, Guojun Li, Yicong Mao, Chulin Sha

Scalable Cell Representation Learning from, Zhejiang University of Technology, Tianjin University, Hangzhou Institute of Medicine, Chinese Academy of Sciences, a detection-guided framework built on Deformable DETR for scalable cell rep-, learning design, we build a CellDETR-based pretraining model for scalable cell, representation learning from unlabeled WSIs, which improves downstream cell, relevance of the learned cell embeddings. Together, CellDETR provides a scalable, [4] have been developed using large-scale unlabeled whole-slide images (WSIs). These models, data availability. High quality cell-level annotations remain limited, and existing manually annotated, states. The second challenge associates with model design. Currently, most label-free self-supervised, representations from WSIs that are transferable across datasets and scalable through large pretrain

2026-06-30视觉感知

这篇论文针对病理基础模型多停留在 patch/slide 表征、难以支持细胞级解释的问题,提出基于 Deformable DETR 的 CellDETR:先检测可变数量细胞核,再用位置特征解耦和框约束注意力提取细胞嵌入,并扩展到对比式自监督和 Xenium 空间转录组标签预训练。结果显示其在 PanNuke 细胞分类/检测上优于现有方法,预训练进一步提升下游表现并具备跨数据集迁移能力,但部分增益可能来自预训练数据与监督信号。

MIRROR: Aligning Semantic Relations from Language to Image via Gromov--Wasserstein Figure 1
2026-06-30cs.CV

MIRROR: Aligning Semantic Relations from Language to Image via Gromov--Wasserstein

Hong-Han Wang, Yuntao Wang, Hu Ding

University of Science and Technology of China, Hefei, China, “sitting requires the center of gravity above the support surface” or “Huskies dif-

2026-06-30视觉感知

论文针对多模态大模型中“视觉 token 语义对齐了、但概念间关系未迁移”的问题,提出 MIRROR:利用交叉注意力作为文本—视觉耦合,将语言表征中的关系几何通过半逆 Gromov–Wasserstein 正则映射到视觉空间,并给出闭式解与高效计算策略。实验显示其提升关系一致性和多层次视觉关系推理,同时基本保持通用视觉语言任务表现且无额外推理开销。

From Phase to Phenomenon: Self-Supervised Learning of Subsurface Scattering with Minimal Phase-shift Inputs Figure 1
2026-06-30cs.CV

From Phase to Phenomenon: Self-Supervised Learning of Subsurface Scattering with Minimal Phase-shift Inputs

Arjun Majumdar, Raphael Braun, Andreas Engelhardt, Hendrik PA. Lensch

2026-06-30视觉感知

这篇论文针对次表面散射采集成本高、传统逐点或OLAT测量需大量图像的问题,提出用每视角仅8张高频PSP结构光图像进行自监督预训练,学习可迁移的SSS表征;其关键在于面向PSP的物理感知增强、SimSiam编码器预训练,以及针对偏斜各向异性footprint的专用损失和轻量解码器。实验显示方法能在未见物体、材质和视角上重建较高保真的散射footprint并用于重光照,显著减少采集量,但相机—投影仪配置依赖和局部patch半径限制仍存在。

Resonant Brane Splatting for Arbitrary-Scale Super-Resolution Figure 1
2026-06-30cs.CV

Resonant Brane Splatting for Arbitrary-Scale Super-Resolution

Giulio Federico, Giuseppe Amato, Claudio Gennaro, Fabio Carrara, Marco Di Benedetto

University of Pisa, Italy, and collaboration of numerous overlapping splats.

2026-06-30视觉感知

本文针对任意尺度超分中隐式解码逐像素查询慢、标准2D高斯样条又因低通且单色而需大量重叠来表达边缘纹理的问题,提出RBS:在高斯包络内加入Gaussian-Hermite内部模态,并为每个模态预测颜色系数,使单个Brane可表达局部对比、高频纹理与多色结构;同时用基于量子转折点的可微CUDA光栅器裁剪无效区域。实验称其在标准ASR基准上优于隐式和GS基线,并取得更好的速度—质量折中。

The Platonic Defense: Backdoor Defense for Self-Supervised Encoders in the Era of Large Scale Pre-training Figure 1
2026-06-30cs.CV

The Platonic Defense: Backdoor Defense for Self-Supervised Encoders in the Era of Large Scale Pre-training

Tuo Chen, Minjing Dong, Benlei Cui, Jian Liu, Jie Gui

Southeast University, City University of Hong Kong, Purple Mountain Laboratories, box setting because they often require access to labels, attack patterns, or training, across multiple attacks. Code is available here., cious samples into unlabeled training data or by modifying model weights [5, 27]. The compromised, coders, only a few operate in a fully black-box setting. Some studies construct pseudo-labels and, applies to a closed and finite label space. Other methods restrict the defense scope to specific types, without any downstream labels and without access to poisoned samples. We train this energy with

2026-06-30视觉感知

这篇论文针对自监督视觉编码器在大规模预训练后易被后门污染、而现有防御常依赖标签、触发器或训练过程的问题,提出用独立大模型表征应收敛到同一“现实”的洞察作为黑盒测试时安全信号。方法以源编码器和多个可信参考编码器的表征兼容性构建条件能量模型,用 NCE 做检测、去噪 score matching 做表征净化,并给出能量差与互信息相关的理论解释。实验覆盖多种 SSL 编码器和 10 余类攻击,报告在检测与净化上均提升鲁棒性且基本保持干净样本性能。

Miti360: A Comprehensive Dataset for Improved Reforestation Monitoring Figure 1
2026-06-30cs.CV

Miti360: A Comprehensive Dataset for Improved Reforestation Monitoring

Cedric Kiplimo, Samuel Mbatia, Ciira wa Maina, Arthur Sichangi, Dennis Gitundu

Centre for Data Science and Artificial Intelligence (DSAIL), Dedan Kimathi University of Technology, Nyeri, Kenya, Institute of Geomatics, GIS and Remote Sensing (IGGReS), Dedan Kimathi University of Technology, Nyeri, Kenya

2026-06-30数据集/基准

针对非洲可用于机器学习的森林/再造林数据稀缺问题,Miti360在肯尼亚Kieni Forest 770公顷再造林区采集并整理无人机正射影像与树冠框标注、地面单目/双目图像、树种与生物物理参数、GPS及多年天气数据,支持个体树监测、生长建模和森林数字孪生。技术验证显示,该数据可跨三年追踪树冠,并使DeepForest微调后的框精度提升12%、召回提升69%,增益可能主要来自本地化数据适配。

Bridging VideoQA and Video-Guided Agentic Tasks via Generalized Keyframe Extraction Figure 1
2026-06-30cs.CV

Bridging VideoQA and Video-Guided Agentic Tasks via Generalized Keyframe Extraction

Sunqi Fan, Qingle Liu, Runqi Yin, Meng-Hao Guo, Shuojin Yang

2026-06-30视觉感知

这篇论文针对现有 VideoQA 评测偏重浅层感知、难以衡量模型从教程视频迁移程序性知识的问题,提出 VG-GUI-Bench 连接视频问答与视频引导 GUI 任务,并将关键瓶颈归结为任务相关时序信息选择。其 TASKER 以任务相关性和场景动态联合搜索关键帧,在训练-free 设置下提升帧效率与准确率,在 EgoSchema fullset 和 NExT-QA 上分别超过最佳基线 2.0% 与 1.8%。

EvLIR: Learning Illumination Residuals from Ordered Events for Low-Light Image Enhancement Figure 1
2026-06-30cs.CV

EvLIR: Learning Illumination Residuals from Ordered Events for Low-Light Image Enhancement

Haoxian Zhou, Chuanzhi Xu, Langyi Chen, Pengfei Ye, Haodong Chen, Qiang Qu, Ali Anaissi, Weidong Cai

The University of Sydney, Massachusetts Institute of Technology

2026-06-30视觉感知

针对极低照度下单帧图像结构缺失、噪声放大,而既有事件辅助方法常把事件体素当作静态特征的问题,EvLIR保留事件时间 bin 顺序,用轻量 ConvGRU 的 TERM 学习有界照明残差,引导 Retinex 式照明估计与图像-事件融合恢复。在 SDE、SDSD 室内外基准上,文中报告其在 12 个数据集-指标组合中 11 个最佳,平均达到 25.63 dB PSNR、28.30 dB PSNR* 和 0.827 SSIM。

Robust Zero-shot Anomaly Detection under Limited Auxiliary Anomaly Priors Figure 1
2026-06-30cs.CV

Robust Zero-shot Anomaly Detection under Limited Auxiliary Anomaly Priors

Guanyu Lu, Fang Zhou, Cheqing Jin

East China Normal University, Shanghai, China, handling sensitive patient scans in collaborative diagnostics, human expertise and task-specific prompt design, which restricts model scalabil-

2026-06-30视觉感知安全鲁棒

本文关注零样本异常检测在辅助异常样本类型有限时的鲁棒性问题,指出现有 CLIP/VLM 提示调优易过拟合少数异常模式且视觉特征受物体语义干扰。DIVE 通过浅层与深层文本嵌入注入抽象通用异常概念,并用解耦机制分离异常状态与物体语义;同时提出惩罚误检和过分割的 RCPRO 指标。十二个数据集上,在有限异常先验设置下相对 SOTA 分类和分割指标最高分别提升 28.5% 与 47.0%。

Bit-ViP: Leveraging Bit-planes to Preserve Visual Privacy in Images through Obfuscation Figure 1
2026-06-30cs.CV

Bit-ViP: Leveraging Bit-planes to Preserve Visual Privacy in Images through Obfuscation

Vishesh Kumar Tanwar, Ashish Gupta, Sanjay Madria, Sajal K. Das

2026-06-30视觉感知

面向监控、社交媒体等视觉数据上云带来的身份隐私泄露问题,Bit-ViP 将图像划分为块并在比特平面引入混沌扰动,再结合差分隐私噪声,使图像难以逆向恢复但仍可用于识别训练。作者在 UCF101、HMDB51 上评估,报告其在重建、像素频率、熵和相关性攻击下较既有混淆方案更安全,同时识别精度损失较小。

Can Machines Really See Objects in Images? A Study Based on Syntactic Distance and Visual Self-Referential Instances Figure 1
2026-06-30cs.CV

Can Machines Really See Objects in Images? A Study Based on Syntactic Distance and Visual Self-Referential Instances

Xingyu Peng, Junran Wu, Yue Hou, Zhongliang Qiao, Jiaheng Liu, Shangzhe Li, Jichang Zhao, Wenjun Wu, Xianglong Liu, Yongxin Tong, Li Dong, Ke Xu

SKLCCSE, Beihang University, Nanjing University, Central University of Finance and Economics

2026-06-30视觉感知

论文追问视觉模型高准确率是否等于真正“看见”对象,针对依赖局部纹理捷径的局限,提出以句法距离刻画类别可分性,并构造噪声中闭合方框与单像素破损方框的零句法距离自指任务。实验显示 ResNet 与 ViT 在图像尺度超过临界点后准确率坍塌到随机猜测,更多数据和更大模型只延后坍塌,说明当前架构在全局概念识别上存在结构边界。

FiRe: Frequency Reparameterization as a Preconditioner for Periodic Implicit Neural Representations Figure 1
2026-06-30cs.CV

FiRe: Frequency Reparameterization as a Preconditioner for Periodic Implicit Neural Representations

Harinandan Shukla, Rajarshi Verma, Jitin Singla

Department of Computer Science and Engineering, IIT Roorkee, Department of Biosciences and Bioengineering, IIT Roorkee

2026-06-30视觉感知

针对 SIREN/FINER 等周期隐式神经表示给所有神经元使用同一全局频率、难以高效匹配局部高频细节的问题,FiRe 用低秩、输入相关的门控重参数化每个神经元频率,并从 NTK 角度解释其作为隐式预条件器改善初始化优化条件。实验在 2D 图像拟合中显示,参数和实际频率匹配下早期训练 PSNR 最高约提升 1 dB,高频恢复更快;但增益随分辨率和训练时间下降,充分收敛后不具备渐近优势。

Learning to Adaptively Allocate Gaussians for Arbitrary-Scale Image Super-Resolution Figure 1
2026-06-30cs.CV

Learning to Adaptively Allocate Gaussians for Arbitrary-Scale Image Super-Resolution

Giulio Federico, Giuseppe Amato, Claudio Gennaro, Fabio Carrara, Marco Di Benedetto

GIULIO FEDERICO∗, University of Pisa, Italy and ISTI-CNR, Italy, target is unavailable during inference. Therefore, the network must au-

2026-06-30视觉感知三维

本文针对任意尺度超分中固定倍率插值失真、逐像素隐式查询开销大、现有高斯方法均匀分配资源的问题,提出 QuADA-GS:用神经路由按局部复杂度自适应分配全局高斯预算,并以四叉树式非规则拓扑和 O(1) 邻域查找的 HPC 协调特征。实验显示其在多尺度尤其纹理丰富场景取得领先重建与感知指标,推理较刚性 GSASR 更快,但为换取细节通常占用更多显存。

NaLA: A 3D Native LLM Layout Agent for High-quality 3D Scene Generation Figure 1
2026-06-30cs.CV

NaLA: A 3D Native LLM Layout Agent for High-quality 3D Scene Generation

Cheng Wan, Yongsen Mao, Wenzheng Wu, Yuxuan Xie, Chucheng Xiang, Runze Wang, Xiang Zhang, Zhongyuan Liu, Rushi Dai, Yuan Liu

2026-06-30三维

这篇论文针对现有 LLM 3D 布局代理把资产和场景转成文本或图像而丢失几何细节、输出坐标又易出现“数值盲”的问题,提出 NaLA:直接将房间边界与物体点云编码为 LLM 前缀 token,并用离散姿态锚点加连续残差的粗到细机制生成位置和朝向。实验显示其在语义一致性、美观性、复杂/不规则场景鲁棒性和推理效率上优于既有布局代理,消融也支持各模块有效。

Event-VLA: Action-Conditioned Event Fusion for Robust Vision-Language-Action Model Figure 1
2026-06-30cs.CV

Event-VLA: Action-Conditioned Event Fusion for Robust Vision-Language-Action Model

Jiaxin Liu, Xun Xu, Zhenhao Zhang, Hanqing Wang, Ruiqi Chen, Shi Chang, Weiyu Guo, Laurent Kneip

2026-06-30视觉语言视觉感知安全鲁棒

本文针对VLA在低照度、近黑暗等真实操作场景中RGB观测退化导致动作预测不稳的问题,引入事件相机作为抗光照、敏感运动的补充信号。核心洞察是事件信息不应直接混入全局语义 token,而应通过动作查询、门控交叉注意力路由到动作表征,以保留预训练RGB-语言先验。仿真、LIBERO-Cross和Franka实机结果显示,该接口在正常光照下基本保持性能,并显著提升低光鲁棒性。

DR-GS: Physically-Based Deformable and Relightable 2D Gaussians Figure 1
2026-06-30cs.CV

DR-GS: Physically-Based Deformable and Relightable 2D Gaussians

Jiaxin Li, Tong Wu, Yi Wei, Tailin Wu, Li Zhang

Shanghai Innovation Institute, China, Zhejiang University, China, Department of Artificial Intelligence, Westlake University, China, School of Data Science, Fudan University, China, Central Media Technology Institute, Huawei, China, changes via decoupled geometry, lighting, and materials. The project page is available

2026-06-30三维

DR-GS针对可变形高斯表示把光照烘焙进颜色、导致形变和重光照下外观不物理且材质难编辑的问题,提出解耦几何、光照与材质的2D Gaussian框架,结合逆渲染、MIS蒙特卡洛渲染、网格射线追踪与粒子/网格驱动形变。实验显示其在静态重建、动态形变和重光照中能更好保留阴影、反射与高光,并支持后期材质编辑。

SAD-GS: Learning Reliable 3D Semantic Gaussian Fields via Dynamic Geo-Semantic Anchoring Figure 1
2026-06-30cs.CV

SAD-GS: Learning Reliable 3D Semantic Gaussian Fields via Dynamic Geo-Semantic Anchoring

Yufei Zhang, Chenlu Zhan, Gaoang Wang, Hongwei Wang

Zhejiang University

2026-06-30三维

SAD-GS关注开放词表3D Gaussian语义场中多视角2D监督不可靠的问题:同一物体的视觉特征随视角漂移,跟踪掩码又会泄漏或换ID。其核心是把语义身份与空间分配解耦,先用共识文本锚稳定语义,再用几何-语义反馈三门控过滤伪标签。实验在LERF-OVS、3D-OVS和Mip-NeRF360上提升定位与分割,并指出主要增益来自语义锚稳定,GSFL在重叠或锚歧义场景受限。

L2D2-GS: Learning to Densify for Feedforward Dynamic Gaussian Scene Reconstruction Figure 1
2026-06-30cs.CV

L2D2-GS: Learning to Densify for Feedforward Dynamic Gaussian Scene Reconstruction

Zetian Song, Chenming Wu, Junnan Liu, Chitian Sun, Liangliang He, Hangjun Ye, Jiaqi Zhang, Siwei Ma, Wen Gao

2026-06-30三维

面向自动驾驶仿真中的动态城市场景重建,L2D2-GS针对传统3DGS逐场优化慢、前馈方法高分辨率显存大且多视角融合不稳的问题,将一次性回归改为“前馈预测+迭代优化+自适应增密”。其关键在于用重建增益自监督训练增密策略,并以几何重参数化抑制早期退化;在PandaSet和Waymo上报告了更高重建质量、较强零样本泛化且使用更少高斯基元。

SAFE-DiT: Semantics-Aware Fast-path Execution for High-Resolution Diffusion Transformers Figure 1
2026-06-30cs.CV

SAFE-DiT: Semantics-Aware Fast-path Execution for High-Resolution Diffusion Transformers

Xuanhua Yin, Yuxuan Jia, Chuanzhi Xu, Weidong Cai

School of Computer Science, The University of Sydney, Australia

2026-06-30生成模型安全鲁棒

本文针对高分辨率 DiT 推理中空间自适应常用注意力 mask 反而触发慢速 SDPA 路径的问题,提出 SAFE-DiT:只消除经语义判定为等价的图像自注意力冗余 mask,保留文本等有效 mask,并用提示条件分区、敏感区域更新和周期刷新实现无 mask 调度。在 Lumina-Next 上,方法在 1024²/2560² 分别达 2.69×/5.09× 端到端加速,显存从 94.1GB 降至 27.9GB,且视觉质量与密集快路径基线接近。

Dynamic Parsing and Updating Natural Language Specification using VLMs for Robust Vision-Language Tracking Figure 1
2026-06-30cs.CV

Dynamic Parsing and Updating Natural Language Specification using VLMs for Robust Vision-Language Tracking

Xiao Wang, Liye Jin, Dan Xu, Yuehang Li, Lan Chen, Yaowei Wang, Yonghong Tian, Jin Tang

elaborately-designed modules into the baseline framework, our, with the School of Computer Science and Technology, Anhui Univer-, • Lan Chen is with the School of Electronic and Information Engineering, • Yaowei Wang is with Harbin Institute of Technology, Shenzhen, China, • Yonghong Tian is with Peng Cheng Laboratory, Shenzhen, China, School, of Computer Science, Peking University, China, Shenzhen Graduate School

2026-06-30视觉语言视觉感知安全鲁棒

这篇论文针对视觉语言跟踪中静态或整体生成式文本更新易导致目标身份被改写、背景干扰和幻觉描述的问题,提出先用依存解析把语言规格拆成目标、概念与背景,再借助 Qwen-VL 做组件感知的动态更新,并保持目标身份稳定。实验在 TNL2K、LaSOT、TNLLT、OTB-LANG 上显示相对基线有一致提升,说明结构化文本演化能缓解语义-视觉错配。

Fast Enough to Act: Spatio-Temporal Visual Token Merging for Low-Latency Robotic VLMs and VLAs Figure 1
2026-06-30cs.CV

Fast Enough to Act: Spatio-Temporal Visual Token Merging for Low-Latency Robotic VLMs and VLAs

Junzhou Chen, Jindong Wang, Gang Zhou

J. Chen and G. Zhou are with the Department of Computer Science, and, J. Wang is with the Department of Data Science

2026-06-30机器人视觉语言

这篇论文针对机器人 VLM/VLA 在高分辨率、多帧视觉输入下 token 数量过大、难以实时闭环控制的问题,提出无需训练的 ST-Merge,在视觉编码器浅层引入三维时空坐标、多队列匹配、加权聚合与合并后位置校正,以尽早压缩冗余 token 并保持几何一致性。实验显示其在 Qwen2.5-VL 视频问答中约 2 倍加速且精度仅降 1%,在 π0.5 的 1024×1024 VLA 设置下达 8.3 倍加速并保持基线成功率。

W4A4 Quantization for Inference on Wan2.2-I2V-A14B Figure 1
2026-06-30cs.CV

W4A4 Quantization for Inference on Wan2.2-I2V-A14B

Yidong Chen, Chengyu Shi, Jiahao Liu

∗Tsinghua University

2026-06-30视觉感知

本文面向 Wan2.2-I2V-A14B 视频生成推理中 W4A4 量化带来的显存与计算压力,指出 FFN 激活长尾离群值是直接 4bit 舍入的主要误差源。方法将 SmoothQuant 通道平滑、MixQ 式静态离群列高精度分支与分块 HiF4 打包结合,在多数 VBench I2V 指标上距 FP16 约 2–3.5%,并优于约整体下降 5% 的原生 HiFloat4 基线。

Multi-scale Object-Aware Gaze Estimation via Geometric Reasoning Figure 1
2026-06-30cs.CV

Multi-scale Object-Aware Gaze Estimation via Geometric Reasoning

Jiajie Mi, Xinyu Liu, Mengke Song, Chenglizhao Chen

Qingdao Institute of Software & School of Computer Science and Technology, China, University of Petroleum (East China), China, Shandong Key Laboratory of Intelligent Oil & Gas Industrial Software, China

2026-06-30视觉感知

这篇论文针对凝视目标估计常被简化为像素级热图回归、难以稳定表示“看的是哪个物体”的问题,提出对象语义驱动的两阶段层级推理框架:先建模候选凝视物体,再结合多尺度特征融合与头姿/视线几何约束做精细定位。在 GazeFollow、VideoAttentionTarget、ChildPlay 和 GOO-Real 上分别达到 0.961、0.948、0.987、0.977 AUC,且模型仅 7.1M 参数。

HiReFF: High-Resolution Feedforward Human Reconstruction from Uncalibrated Sparse-View Video Figure 1
2026-06-30cs.CV

HiReFF: High-Resolution Feedforward Human Reconstruction from Uncalibrated Sparse-View Video

Yiming Jiang, Hanzhang Tu, Wenfeng Song, Siyou Lin, Liang An, Shuai Li, Aimin Hao, Yebin Liu

Y.Jiang—Work done during an internship at Tsinghua University.

2026-06-30视觉感知三维

HiReFF面向全息通信和AR/VR中未标定稀疏多视角人体视频难以兼顾时序流式重建、前景干净性和高分辨率渲染的问题。方法以VGGT先验预测相机和深度,加入尺度同步相机校准、多视角监督下的高斯级前景掩码,以及在0.5K骨干上注入外观特征的高分辨率side-tuning,实现四个90°未标定视角到2K 360°人体高斯重建;实验报告在单张RTX 4090上3.01 FPS,训练显存较0.5K仅增加34%,并优于现有高分辨率流式体视频方法。

RAGA: Real Time Ray Traced Gaussian Shadow Casting for 3DGS Avatar-Scene Interaction Figure 1
2026-06-30cs.CV

RAGA: Real Time Ray Traced Gaussian Shadow Casting for 3DGS Avatar-Scene Interaction

Aymen Mir, Riza Alp Guler, Jian Wang, Peter Wonka, Bing Zhou, Gerard Pons-Moll

Tübingen AI Center, University of Tübingen, Germany, Max Planck Institute for Informatics, Saarland Informatics Campus, Germany, Imperial College London, UK, King Abdullah University of Science and Technology (KAUST), Saudi Arabia, Snap Inc., USA, *Work partly done as intern at Snap Inc., is available at https://miraymen.github.io/raga/.

2026-06-30三维

RAGA针对3DGS头像插入真实3DGS场景时缺少物理合理阴影、导致人与环境脱离的问题,提出完全在高斯空间中的实时阴影投射:沿光线对遮挡高斯做精确线积分并按理论最大值归一化,以区别掠过和穿透遮挡,同时用稳定的各向同性头像代理降低动态衣物形变带来的闪烁。实验在单人、多人和人-物交互场景中优于改造版3DGRT与RaySplat,阴影更接近伪GT、时序一致性更好,并借助CUDA/OptiX达到约50 FPS。

FDM-MFVT: Few-step Sampling Diffusion Model for Mask-Free Virtual Try-On Figure 1
2026-06-30cs.CV

FDM-MFVT: Few-step Sampling Diffusion Model for Mask-Free Virtual Try-On

Jiaxin Liu, Xiaoye Liang, Lai Jiang, Mai Xu, Jun Liu

School of Electronic Information Engineering, Beihang University, Beijing, China, Zhongguancun Academy, Beijing, China, State Key Laboratory of Virtual Reality Technology and Systems, Beihang, University, Beijing, China, Limited availability of mask-free paired datasets, restricting the development of

2026-06-30生成模型

这篇论文针对扩散式虚拟试衣推理步数多、依赖服装/人体掩码和辅助编码器、缺少无掩码配对数据的问题,提出 FDM-MFVT:用服装感知噪声优化为少步采样提供更好初始状态,并用指令驱动模块仅从人物与服装图生成结果,同时构建 3 万对 MFVT 数据集。实验显示其在 6 步下已接近或超过基线 30 步表现,并在多项指标上优于无掩码和有掩码方法,但数据由预训练试衣模型合成,增益可能部分来自数据构造。

D$^{2}$R$^{2}$OSR: Degradation-Disentangled Representation for Real-World Omnidirectional Image Super-Resolution Figure 1
2026-06-30cs.CV

D$^{2}$R$^{2}$OSR: Degradation-Disentangled Representation for Real-World Omnidirectional Image Super-Resolution

Hongyu An, Xinfeng Zhang, Xu Fan, Shijie Zhao, Li Zhang, Ruiqin Xiong

School of Computer Science and Technology, University of Chinese Academy of, ByteDance Inc., Shenzhen, China, School of Computer Science, Peking University, Beijing, China

2026-06-30视觉感知强化学习

面向VR/全景视觉中低分辨率ODI受鱼眼成像、ERP投影、压缩噪声等混合退化影响的问题,D2R2OSR的核心洞察是将纬度相关几何失真与盲像素退化解耦,并以PPR视角分支结合ERP分支和DSM分别建模补偿。实验称其在真实全景超分上达到SOTA,视觉质量更好且计算效率适合低资源部署。

MirrorPPR: Exemplar-Based Portrait Photo Retouching Figure 1
2026-06-30cs.CV

MirrorPPR: Exemplar-Based Portrait Photo Retouching

Zhihong Liu, Zheng Li, Jiachun Jin, Siqi Kou, Yitao Jian, Fengpei Yu, Zhijie Deng

2026-06-30视觉感知

论文针对文本指令难以精确描述人像五官与身形的细微结构修图问题,提出以“前后对比样例”传达修图意图的 MirrorPPR。其核心是从样例对中提取局部变形操作,并通过连接器与 LoRA 注入预训练 DiT;同时用同步空间增强构造严格对齐训练对,并发布 4700 万级数据集支撑课程学习。实验显示其在修图质量和身份保持上优于现有基线,但增益可能主要来自大规模数据与任务对齐设计。

Occlusion-Robust Multi-Object Decoupling for Physics-Based Interaction Figure 1
2026-06-30cs.CV

Occlusion-Robust Multi-Object Decoupling for Physics-Based Interaction

Xin Dong, Wenfeng Deng, Yansong Tang

Shenzhen International Graduate School, Tsinghua University 2Pengcheng Laboratory, (MLP) is trained to predict the segmentation label for each, Gaussian point based on this feature. This labeling facilitates

2026-06-30安全鲁棒

这篇工作针对机器人操作/交互场景中多物体因遮挡和视角稀疏而难以无损分离的问题,将多物体解耦重写为稀疏视角3D重建任务。其核心是以3D Gaussian为表示,用SAM2得到粗实例划分,再用联合2D/3D SDS扩散先验和物体内外相似性几何正则补全被遮挡的形状与纹理。实验显示MF-MOD无需手工mask即可生成更完整、可用于MPM物理仿真的多物体模型,但多物体顺序处理带来计算开销,光照导致的颜色差异仍未解决。

Pointer-CAD v2: Plan-Then-Construct CAD Generation with Dimension-Aware Parametric Precision Figure 1
2026-06-30cs.CV

Pointer-CAD v2: Plan-Then-Construct CAD Generation with Dimension-Aware Parametric Precision

Dacheng Qi, Chenyu Wang, Jingwei Xu, Yi Ma, Shenghua Gao

The University of Hong Kong, Hong Kong SAR, Shenzhen Loop Area Institute, Shenzhen, China, Monash University, Melbourne, Australia, University of California, Berkeley, USA, for precision-critical engineering applications. Our code is available at

2026-06-30视觉感知

这篇论文针对现有 CAD 生成过度依赖视觉相似度、且命令序列量化参数会破坏工业所需尺寸精度的问题,提出 Pointer-CAD v2:先生成带单位和尺度的结构化设计计划,再用参数字典与指针机制构建命令序列,直接复用连续数值以避免离散化误差。作者还构建带计划标注的数据集,并提出顶点、边、面三级几何精度指标;实验显示其在参数准确性和尺寸一致性上优于基线。

Beyond Trajectory Matching: Reflow with Marginal Distribution Alignment Figure 1
2026-06-30cs.LG

Beyond Trajectory Matching: Reflow with Marginal Distribution Alignment

Chen Wang, Peiran Yun, Pan Xie, Ke Deng

Department of Statistics and Data Science, Tsinghua University, Department of Computer Science and Technology, Tsinghua University

2026-06-30生成模型规划控制

本文针对扩散/连续流模型少步采样中 reflow 蒸馏只匹配轨迹、却可能无法确定学生模型端点边缘分布的问题,指出相同轨迹误差可产生不同生成分布。其核心是在 vanilla reflow 与 PeRFlow 中加入边缘分布对齐正则,通过学生 ODE 的 log-density 跟踪和冻结教师 score 计算,无需额外网络,并给出总变差望远镜界。实验显示在 SD 1.5、SDXL 等骨干上可提升少步生成质量。

ASTAD: Asymmetric Style Transfer for Synthetic-to-Real Adaptation in Autonomous Driving Figure 1
2026-06-30cs.CV

ASTAD: Asymmetric Style Transfer for Synthetic-to-Real Adaptation in Autonomous Driving

Dingyi Yao, Xinqi Zhang, Lihui Peng, Jianming Hu, Danya Yao, Yi Zhang

2026-06-30视觉感知

该文针对自动驾驶中合成数据虽有精确标注、真实风格图却无像素标签的实际不对称,指出现有扩散式风格迁移依赖双侧语义会带来高标注成本或语义污染。作者提出 ASTAD 任务与免训练两阶段 ASTModel,先从无标注真实图提取粗语义先验,再在去噪中动态细化并按类别注入风格。实验显示其在下游感知效用和结构保真度上优于现有方法,并带来约 3.2 倍推理加速。

ScaleErasure: Inference-Time Minimal Intervention for Precise Concept Erasure in Next-Scale Autoregressive Image Generation Figure 1
2026-06-30cs.CV

ScaleErasure: Inference-Time Minimal Intervention for Precise Concept Erasure in Next-Scale Autoregressive Image Generation

Cong Wang, Haiyu Wu, Zhiwei Jiang, Zifeng Cheng, Fei Shen, Yafeng Yin, Qing Gu

2026-06-30视觉感知

本文关注下一尺度自回归图像生成中的概念擦除:早期低分辨率尺度把不安全语义与背景等无关语义压缩到同一 token,直接干预易漏擦或损伤生成能力。ScaleErasure 在推理时增加不安全/安全概念两次前向,并从尺度、token、bit 通道三维选择最相关 logits 进行最小引导。实验显示其较改造基线擦除更精确,同时较好保持通用生成质量。

Enhancing Part-Level Point Grounding for Any Open-Source MLLMs Figure 1
2026-06-30cs.CV

Enhancing Part-Level Point Grounding for Any Open-Source MLLMs

Jin-Cheng Jhang, Fu-En Wang, Xin Yang, Nan Qiao, Lu Xia, Min Sun, Cheng-Hao Kuo

National Tsing Hua University

2026-06-30视觉语言

本文针对现有多模态大模型虽能做物体级定位、却难以精确定位把手、衣领等部件级操作点的问题,提出在冻结原模型参数的前提下利用中间层注意力:通过 Q-Synth 合成与文本目标相关的查询,再由 A2P 解码为点热图,并用 SDF 惩罚增强空间约束。实验显示该框架可接入多种开源 MLLM,在多个数据集上稳定提升部件级点定位精度,同时尽量保留原有推理与对话能力。

Nonlinear mixture model motivated subspace clustering Figure 1
2026-06-30cs.LG

Nonlinear mixture model motivated subspace clustering

Ivica Kopriva

MATLAB implementation of the proposed method is, available at https://github.com/ikopriva/NMMSC., Laplacian constructed from W to assign labels to data.

2026-06-30视觉感知

针对子空间聚类中自表示矩阵后处理依赖未知子空间维度的问题,论文从盲源分离中的非线性混合模型出发,用有限阶泰勒展开推导其与线性子空间并模型的等价关系,指出平滑阶数K对应子空间维度d,且与锚点数、表示稀疏度相联。实验在六个图像/数字基准和五类算法上验证了由该关系估计的维度范围能指导IPD后处理并提升聚类表现,但具体增益仍可能受数据集与既有算法设置影响。

Confidence-feedback-weighted graph matching network: online-offline laser-induced damage site matching under complex interference Figure 1
2026-06-30cs.CV

Confidence-feedback-weighted graph matching network: online-offline laser-induced damage site matching under complex interference

Yueyue Han, Guanhua Chen, Hangcheng Dong, Kang Zhang, Fengdong Chen, Zhitao Peng, Fa Zeng, Qihua Zhu, Guodong Liu

School of Instrumentation Science and Engineering, Harbin Institute of Technology, Harbin 150001, China, Research Center of Laser Fusion, China Academy of Engineering Physics, Mianyang 621900, China, high-quality labels for training online damage recognition

2026-06-30视觉感知

面向高功率激光装置中在线检测伪损伤点干扰真实损伤判定的问题,论文将损伤质心构成图,仅用坐标进行在线—离线匹配。核心做法是从多轮匹配分数估计节点可匹配置信度,并反馈为边特征聚合权重,以抑制无对应干扰点传播;同时加入几何一致性约束和难例挖掘损失。Complex-Scene 数据集上 F1 达 96.36%,平均每对图像 0.7248 秒。

When Does Synthetic CT Transfer? A Label-Free Donor/Host Diagnostic for Medical Vision-Language Model Routing on Real Lung CT Figure 1
2026-06-30cs.CV

When Does Synthetic CT Transfer? A Label-Free Donor/Host Diagnostic for Medical Vision-Language Model Routing on Real Lung CT

Fakrul Islam Tushar

When Does Synthetic CT Transfer? A Label-Free Donor/Host Diagnostic for, Department of Radiology and Imaging Sciences, University of Arizona, if it survives the move to real data, yet the real labels that, ask whether transfer can be predicted in advance, label-, names that boundary before any real label., the finding that transfer itself is predictable, label-free, from, medical images supply exact labels, controlled interven-, on real CT, and the real labels that would confirm this are, tion method: can we know, label-free and in advance, which, ing only the synthetic calibration surface and its free labels, this decomposition flags transfer risk before any real label, ing and no target labels.

2026-06-30视觉语言视觉感知

论文针对合成CT评测难以确认能否迁移到真实CT、而真实标签稀缺的问题,提出无标签的 donor/host 诊断:由结节本身决定的能力更可能迁移,依赖周围解剖的能力风险更高。基于合成CT校准五个VLM的 TrialCouncil 仅做选择、融合或拒答;在七个真实肺CT数据集上,结节存在与大小排序高度迁移(R²≥0.96),肺叶定位不迁移,验证了该边界判断。

Again-Pose: Anchor-Guided Adaptive Inter-Frame Motion Cues Propagating for High-quality Human Pose Reconstruction Figure 1
2026-06-30cs.CV

Again-Pose: Anchor-Guided Adaptive Inter-Frame Motion Cues Propagating for High-quality Human Pose Reconstruction

Shuaikang Zhu, Yiding Sun, Yang Yang

School of Electronic and Information Engineering, Xi’an Jiaotong University, School of Software Engineering, Xi’an Jiaotong University

2026-06-30三维

Again-Pose针对高速运动、遮挡和模糊导致视频3D人体重建特征坍塌的问题,指出隐式时序注意力会把噪声一并聚合;其核心是先筛选清晰锚帧,再用双路径运动建模和差异加权融合,把可靠运动线索传播到退化帧中完成“补全”。实验称其在Human3.6M、3DPW、PoseTrack及FineDiving上优于现有方法,尤其提升极端运动下的鲁棒性和时序稳定性。

Can OCR-VLMs Read Devanagari? A Stress-Test Benchmark and Post-Correction Study Figure 1
2026-06-30cs.CL

Can OCR-VLMs Read Devanagari? A Stress-Test Benchmark and Post-Correction Study

Aditya Pratap Singh

2026-06-30视觉语言数据集/基准

这篇论文针对英文/中文OCR基准无法反映印地文天城文表现的问题,构建多字体、多退化条件及真实扫描的Devanagari压力测试,评估10类OCR/VLM系统,并提出用中位数和灾难率刻画重复崩溃。结果显示干净合成文本几乎拉不开差距,但真实扫描使多数系统大幅下滑;DeepSeek-OCR等专用OCR-VLM在退化下有罕见灾难性重复,Qwen3-VL-8B反而优于GPT-5.5并接近强闭源模型,ByT5后纠错仅在匹配同一引擎误差分布时小幅有效。

Zero-Gated Language-conditioned Human Motion Prediction Figure 1
2026-06-30cs.CV

Zero-Gated Language-conditioned Human Motion Prediction

Guanhui Qiao, Lu Zhou, Ding Jiang, Jinqiao Wang

a Foundation Model Research Center, Institute of Automation, Chinese Academy of Sciences, Beijing 100190, China, b School of Artificial Intelligence, University of Chinese Academy of Sciences, Beijing 100049, China, d Peng Cheng Laboratory, Shenzhen 518066, China

2026-06-30视觉感知

这篇论文针对仅依赖姿态历史的3D人体运动预测缺少高层语义的问题,提出ZGL:先用VLM为已观测骨架生成一句描述,再经冻结CLIP-L投影为少量条件token,通过零初始化门控的跨注意力适配器注入DCT时空Transformer,使模型初始等同于无文本基线、只在有益时利用语言。实验显示其在Human3.6M整体MPJPE优于多种基线,并在CMU-Mocap上保持竞争力。

DTI: Dynamic Trajectory Initialization for Generative Face Video Super-Resolution Figure 1
2026-06-30cs.CV

DTI: Dynamic Trajectory Initialization for Generative Face Video Super-Resolution

Yingwei Tang, Chen Yan, Wendi Liu, Qiang Hu, Xiaoyun Zhang

2026-06-30视觉感知生成模型规划控制

本文针对生成式人脸视频超分将任务当作完整扩散生成导致采样昂贵、保真度不足的问题,提出动态轨迹初始化DTI,把恢复过程改为由低质输入损伤程度驱动的定向修复;通过视觉特征增强注入DiT,并用SNR对齐训练判别式引导器选择起始噪声分布。实验称在多基准和多指标上达到SOTA,同时降低推理步数并改善保真-感知折中,但DG泛化与预训练替代方案文中仍未充分说明。

Anomaly Factory 3D: A Modular Framework for Diverse Pseudo-Anomaly Synthesis in Unsupervised 3D Anomaly Detection Figure 1
2026-06-30cs.CV

Anomaly Factory 3D: A Modular Framework for Diverse Pseudo-Anomaly Synthesis in Unsupervised 3D Anomaly Detection

Ali Balapour, Faraz Hach

University of British Columbia, Vancouver, V6T 1Z4 BC, Canada, Vancouver Prostate Centre, M.H. Mohseni Institute of Urologic Sciences, Department of Urologic Sciences, The University of British Columbia, Vancouver, uses a center-conditioned parametric deformation model defined in local, Code is available at github.com/vpc-ccg/AF3AD., unsupervised setting, where only normal samples are available during training

2026-06-30视觉感知三维

该文针对无监督3D异常检测中真实缺陷稀缺、现有伪异常形态单一的问题,提出AF3AD:用局部PCA坐标、核函数衰减、各向异性、方向门控及法向/切向位移组合生成多类可控几何缺陷。它可接入偏移预测和重建式检测器,在AnomalyShapeNet与Real3D-AD上将对象级O-AUROC提升到91.5%和85.2%,较此前最好结果高5.5和7.1点;但对材质类或高频细裂纹覆盖有限。

Articulating then Matching: Zero-Shot Shape Matching for Uncurated Data Figure 1
2026-06-30cs.CV

Articulating then Matching: Zero-Shot Shape Matching for Uncurated Data

Qilong Liu, Qinfeng Xiao, Chenyuan Yi, Liying Zhang, Kit-lun Yick

Hong Kong Polytechnic University, HK SAR, need for task-specific correspondence training. (2) Scalability to uncurated raw scans: ATM scales robustly to real-world

2026-06-30视觉感知

这篇论文面向真实场景中高分辨率、拓扑损坏且表示形式多样的 3D 形状密集匹配问题,提出 ATM:先用多视角渲染结合视觉基础模型和参数化形状先验,在测试时优化到共享规范空间,再做谱细化匹配,从而绕开对网格连通性的依赖和类别训练数据需求。实验显示其在 TOPKIDS、SMAL 等非等距基准上平均测地误差为 2.4、3.8,并能处理最高约 20 万顶点的原始扫描及 mesh、点云、3DGS。

A Self-Supervised Learning Framework for Video Encoding Complexity Clustering Figure 1
2026-06-30eess.IV

A Self-Supervised Learning Framework for Video Encoding Complexity Clustering

Krishna Srikar Durbha, Hassene Tmar, Ping-Hao Wu, Ioannis Katsavounidis, Alan C. Bovik

The University of Texas at Austin, Meta Platforms, Inc., University of Colorado at Boulder

2026-06-30视觉感知

面向自适应视频流中逐视频构建率失真曲线成本高的问题,论文指出语义类别和常规 IQA/VQA 表征都难以刻画编码复杂度,提出 CECL 用视频受压缩后的“回声”作为自监督对比信号,学习低层时空退化相关表征。实验称其优于现有视觉编码器,并相对固定码率梯带来码率与质量收益,但具体增益大小和来源在给定片段中未充分说明。

Spatially Localized Image Degradation Embeddings for Image Quality Assessment Figure 1
2026-06-30cs.CV

Spatially Localized Image Degradation Embeddings for Image Quality Assessment

Krishna Srikar Durbha, Hassene Tmar, Ping-Hao Wu, Ioannis Katsavounidis, Alan C. Bovik

The University of Texas at Austin, Meta Platforms, Inc., University of Colorado Boulder, based architectures. However, the scalability of these fully supervised models is constrained by their

2026-06-30视觉感知

这篇论文针对无参考图像质量评估中自监督模型只见过全局合成退化、因而对局部和共存伪影不敏感的问题,先用受控线性探针揭示现有编码器的空间盲点,再提出 SLIDE-IQA:在双分支 ViT 的对比预训练中加入空间有界退化,并用阈值有界排除机制处理退化类型与尺度冲突。实验显示,该方法在局部复杂退化检测上明显更敏感,同时在标准 NR-IQA 基准上保持与现有 SSL 方法相当的表现。

GPC: Large-Scale Generative Pretraining for Transferable Motor Control Figure 1
2026-06-30cs.CV

GPC: Large-Scale Generative Pretraining for Transferable Motor Control

Yi Shi, Yifeng Jiang, Chen Tessler, Xue Bin Peng

Simon Fraser University, Simon Fraser University Burnaby British Columbia Canada

2026-06-30生成模型规划控制

本文针对物理角色控制中技能难以大规模复用、连续潜空间易漂移且VQ式离散化训练复杂的问题,提出GPC:用FSQ学习离散运动词表,再以GPT式自回归模型做下一token控制生成,并通过PEFT适配下游任务。模型在600小时以上动作数据上训练,运动复现成功率达99.98%,还能表现出扰动响应和跌倒恢复等自然行为;不过效果增益可能主要来自scaling / data与离散建模的共同作用。

CMTFormer: Marrying Transformer with Hierarchical Information Interaction for RGB-Event Object Detection Figure 1
2026-06-30cs.CV

CMTFormer: Marrying Transformer with Hierarchical Information Interaction for RGB-Event Object Detection

Yu Li, Yuenan Hou, Yingmei Wei, Jiangming Chen, Yanming Guo

aLaboratory for Big Data and Decision, National University of Defense Technology, Changsha, Hunan, China, bShanghai AI Laboratory, Shanghai, Shanghai, China, tion to achieve efficient and stable multimodal collaboration. Specifically, we design a shallow-to-deep information, Codes will be available upon publication.

2026-06-30视觉感知

面向自动驾驶和具身感知中低光、运动模糊等场景,论文指出RGB与事件流的异构性会使单阶段或统一融合产生噪声放大与冗余特征。CMTFormer的核心是按浅中深语义层级设计不同交互:低层轻量对齐,中层用RGB纹理与事件边缘双向增强,深层以可学习权重自适应融合,并加入空间先验改善定位。在DSEC-Detection和PKU-DAVIS-SOD上,方法在单模态和多模态设置下均超过已有检测器,但具体增益对各模块与训练配置的依赖仍需结合完整实验细节判断。

Beyond Backscatter: AlphaEarth Land-Cover Priors for Rapid SAR Flood Segmentation Across Foundation Backbones Figure 1
2026-06-30cs.CV

Beyond Backscatter: AlphaEarth Land-Cover Priors for Rapid SAR Flood Segmentation Across Foundation Backbones

Sanjay Thasma, Yu-Hsuan Ho, Ali Mostafavi

matched pre-event acquisition is unavailable. Using the CONUS, S. Thasma is with the Department of Computer Science and Engineering, Y.-H. Ho and A. Mostafavi are with the Urban Resilience.AI Lab, Department, University, College, models and large embedding products become available for, meaningful and globally available prior on local topography, the post-event scene alone [15], and label-scarce variants of, as confidence-filtered pseudo-labeling [16]. However, it loses, ing a hybrid labeling strategy that combines semi-automatic, data, featuring labels created entirely through manual photo

2026-06-30视觉感知

针对灾后快速制图中光学影像受云遮挡、单时相 SAR 难区分新增洪水与永久水体的问题,论文把洪水分割视为 SAR 观测与稳定地表先验的对齐任务,系统比较 DEM 与 AlphaEarth 土地覆盖嵌入在多种 CNN/ViT 骨干上的作用。结果显示两类先验均优于 SAR-only;AlphaEarth 在更难的 Florence 事件上全面超过 DEM 并取得最佳 IoU,而 DEM 在 Louisiana 更稳且表现竞争,说明学习型与物理先验互补。

When Stopping Fails: Rethinking Minimal Risk Conditions through Human-Interactive Autonomous Driving for Safe Transportation Systems Figure 1
2026-06-30cs.RO

When Stopping Fails: Rethinking Minimal Risk Conditions through Human-Interactive Autonomous Driving for Safe Transportation Systems

Yash Tandon, Giovanni Tapia Lopez, Marcus Blennemann, Mohan Trivedi, Ross Greer

2026-06-30安全鲁棒

本文针对自动驾驶“遇不确定就停车”的最小风险条件在真实城市中可能阻塞急救、交通与无障碍出行的问题,梳理公开事故并按感知、规划、控制缺口归类。核心洞察是安全不应只等同于避撞或静止,而需理解人类权威、多模态指令和社会化交通规则;结果指出应引入人机交互感知、语言/无障碍规划及远程协助控制,推动从被动停车转向协作式自主。

A Deep Multiscale Neural Network for Accurate Neurological Disorder Detection from MRI Scans and Real-Time Web Deployment Figure 1
2026-06-30cs.CV

A Deep Multiscale Neural Network for Accurate Neurological Disorder Detection from MRI Scans and Real-Time Web Deployment

Ali Fatahi, Hoda Zamani, Mohammad H. Nadimi-Shahraki

Department of Computer Engineering, Na.C., Islamic Azad University, Najafabad, 8514143131, Iran, Big Data Research Center, Na. C., Islamic Azad University, Najafabad, 8514143131, Iran, International Graduate School of Artificial Intelligence, National Yunlin University of Science and

2026-06-30视觉感知

针对现有MRI神经疾病识别模型多偏向二分类、难以区分多病种细微解剖差异的问题,论文提出End-Net:以24层卷积和21个优化Inception模块进行多尺度特征提取,并用WGAN-GP过采样与欠采样缓解类别不平衡。实验称其在阿尔茨海默病、脑肿瘤、多发性硬化和健康对照的多分类上优于多种CNN基线,并部署为实时网页推理系统;但具体增益中模型结构与数据平衡策略的贡献边界仍需细看。

BTI-Net: Bidirectional Decoder-Level Task Interaction via Uncertainty-Aware Gating for Multi-Task Medical Image Analysis Figure 1
2026-06-30cs.CV

BTI-Net: Bidirectional Decoder-Level Task Interaction via Uncertainty-Aware Gating for Multi-Task Medical Image Analysis

Abdullah Al Shafi, Md Kawsar Mahmud Khan Zunayed, Safin Ahmmed, Sk Imran Hossain, Engelbert Mephu Nguifo

Khulna University of Engineering & Technology, Bangladesh, University Clermont Auvergne, France, Evaluated on three publicly available benchmarks span-

2026-06-30视觉感知安全鲁棒

针对医学图像多任务中共享编码器后分割与分类解码器相互隔离、边界线索和语义先验难以互补的问题,BTI-Net在各解码层引入双向任务交互,并用不确定性代理门控按样本和层级调节交换强度。三类医学数据集上同时提升分割IoU和分类准确率,消融显示自适应门控较固定交互带来+2.36 IoU,分类最高较强基线提升+2.26个百分点。

TrafficAlign: Aligning Large Language Models for Traffic Scenario Generation Figure 1
2026-06-30cs.CV

TrafficAlign: Aligning Large Language Models for Traffic Scenario Generation

Zhi Tu, Liangkun Niu, Tianyi Zhang

Purdue University

2026-06-30视觉感知

TrafficAlign针对现有LLM生成自动驾驶交通场景时缺乏真实交通分布、地域特征和多样性的问题,提出从真实驾驶视频自动合成场景、用DSL做有效性校验并反馈修正,再用验证后的场景对LLM进行对齐微调的流程。实验显示,其生成场景在SafeBench上比最强基线多发现最高10.8%的碰撞,用于微调PPO、SAC、TD3后碰撞率较原模型最高下降36.1%,且在多地区定性分析中更接近真实交通分布。

HorizonRelight: Relighting Long-horizon Videos Consistently via Diffusion Transformers Figure 1
2026-06-30cs.CV

HorizonRelight: Relighting Long-horizon Videos Consistently via Diffusion Transformers

Jing Yang, Mayoore Jaiswal, Zian Wang, Steven Zeng, Rochelle Pereira, Yajie Zhao, Jianyuan Min

University of Southern California, Abstract. Diffusion-based video relighting enables controllable relighting from, a relit prompt anchor from a controllable generative model, which establishes, at https://research.nvidia.com/labs/sil/projects/horizonrelight/., making controllable relighting possible from a single input video [12,19]. In particular

2026-06-30视觉感知生成模型

针对长视频重光照中扩散模型只能按短片段滑窗推理、易在片段边界产生闪烁和外观漂移的问题,HorizonRelight将任务改写为目标域潜变量的连续传播:跨片段传递重光照潜状态,并用遮蔽自条件训练模型从不完整上下文续写,同时以生成模型给出的重光照锚点热启动首段。实验证明其在野外长视频和合成评测上显著降低边界不一致,G-buffer与最终重光照MSE均优于DiffusionRenderer,但极长链路下仍会损失细节。

From Fog Chamber to Aircraft Window: Pixel-Registered Imaging and Synthetic Fine-Tuning Enable Cross-Domain Defogging Figure 1
2026-06-30cs.CV

From Fog Chamber to Aircraft Window: Pixel-Registered Imaging and Synthetic Fine-Tuning Enable Cross-Domain Defogging

Alexander Ingold, Sabina D. Menon, Manya Yellepeddy, Alec Ikei, John D. Hodges, Jordan Baker, Syed N. Qadri, Rajesh Menon

Department of Electrical and Computer Engineering, University of Utah, Salt Lake City, UT 84112, USA, U.S. Naval Research Laboratory Remote Sensing Division, Washington DC 20375, USA., Abstract: A deep defogging pipeline pretrained on controlled laboratory fog and fine-tuned

2026-06-30视觉感知

针对去雾模型在合成数据、特定相机和场景间迁移差的问题,本文不提新架构,而是构建单相机雾室的5495组像素级配准雾/清图像,结合成对Laplacian难度指标与域随机合成雾微调。结果显示NAFNet在留出集达24.33dB/0.7912 SSIM,并能零目标训练迁移到自由流动雾和飞机舷窗iPhone视频,NIQE由6.22降至4.97,增益可能主要来自数据与训练域覆盖。

Complete virtual unwrapping and reading of a rolled Herculaneum papyrus Figure 1
2026-06-30eess.IV

Complete virtual unwrapping and reading of a rolled Herculaneum papyrus

Giorgio Angelotti, Stephen Parsons, Federica Nicolardi, Youssef Nader, Sean Johnson, David Josey, Paul Henderson, Hendrik Schilling, Johannes Rudolph, Forrest McDonald, Elian Rafael Dal Prá, Paul Tafforeau, Alessandro Mirone, Clifford Seth Parker, Jan Paul Posma, Benjamin Kyles, Claudio Vergara, Alessia Lavorante, Rossella Villa, Maria Chiara Robustelli, Marzia D'Angelo, Gianluca Del Mastro, Michael McOsker, Kilian Fleischer, Christy Chapman, Nat Friedman, William Brent Seales

EduceLab, University of, University of Glasgow, Glasgow, UK, University College London, London, UK, yond isolated demonstrations towards a scalable framework for systematic recovery of, team, academic collaborators and an online distributed community of contributors. That, of competition and collaboration. The 2023 Grand Prize established multi-column reading

2026-06-30视觉感知

这篇论文针对赫库兰尼姆碳化卷轴无法物理展开而长期不可读的问题,构建了从同步辐射相衬 µCT、三维层面重建、虚拟展开到机器学习墨迹增强和纸草学审读的端到端流程。核心进展不是局部识字,而是在明确覆盖与审读标准下完整展开并读取 PHerc.1667,同时在 PHerc. Paris 4 中实现可直接验证的三维墨迹分割,并将 PHerc.139 识别为 Philodemus《论诸神》第八卷。

Low-cost concept-based localized explanations: How far can we get with training-free approaches? Figure 1
2026-06-30cs.AI

Low-cost concept-based localized explanations: How far can we get with training-free approaches?

Darian Fernández-Gutiérrez, Rafael Bello, Marilyn Bello, Natalia Díaz-Rodríguez

assigning labels to bounding-box regions at both object and, large label spaces. Experiments with four MLLMs (7B–32B), tations are often unavailable, so explanations usually remain, Dept. of Computer Science, Central University ”Marta Abreu” of Las, Dept. of Computer Science and Artificial Intelligence, University of, assign semantic labels to localized regions under strict zero-, (bounding box) along with a closed set of candidate labels, small- and mid-scale MLLMs to assign semantic labels, semantic labels to image regions without task-specific fine-, Fine-grained labeling by concept-level naming, cepts are already available but do not address the challenge, of automatically obtaining concept labels at either the object

2026-06-30视觉感知

针对概念式可解释 AI 缺少细粒度区域标注、难以低成本验证的问题,本文评估中小型多模态大模型在零训练条件下为框选区域命名概念的能力,提出闭集 CoNa 与面向大标签空间的 Open-CoNa 协议。实验覆盖 PASCAL-Part、ADE20K、LIP 和 4 个 7B–32B 模型,对象级准确率约 62%–88%,说明其可辅助半自动概念标注,但部件级、幻觉和大词表场景仍是主要限制。

Flow Matching in Feature Space for Stochastic World Modeling Figure 1
2026-06-30cs.CV

Flow Matching in Feature Space for Stochastic World Modeling

Francois Porcher, Nicolas Carion, Karteek Alahari, Shizhe Chen

2026-06-30生成模型强化学习

本文针对视觉世界模型难以同时表达多模态未来和保留感知语义的问题,提出 FlowWM:直接在 DINOv3 等高维预训练特征空间中做 flow matching,并通过架构、时间步调度及可微一步投影加入时序一致性和任务监督。实验在合成随机场景与 Waymo 衍生 FuturePerception 上显示,其相较确定性预测器及 VAE/特征扩散基线提升感知性能、模式覆盖和长时域鲁棒性。

Adaptive Spectrum-Aware Feature Disentangled Network for Small Object Detection Figure 1
2026-06-30cs.CV

Adaptive Spectrum-Aware Feature Disentangled Network for Small Object Detection

Yang Guo, Zihan Yang, Feifei Kou, Yulan Hu, Ran Zhang, Siyuan Yao

Shenzhen Campus of Sun Yat-sen University, Beijing University of Posts and Telecommunications, Beijing, China, Hangzhou International Innovation Institute, Beihang University, Hangzhou, China, Renmin University of China, ing state-of-the-art methods by a large margin. Our code is available at

2026-06-30视觉感知

本文针对小目标像素少、易被多频段背景干扰且同类目标语义关系利用不足的问题,提出 SFDNet:用自适应频谱解耦将特征分为低/中/高频并按频段建模、重加权以抑制干扰,同时通过类级原型蒸馏约束同类小目标表征更紧凑。多项小目标检测基准实验显示其相较现有方法取得明显性能提升,但具体增益是否部分来自骨干或训练配置仍需结合完整消融判断。

Efficient Spatio-Temporal Grounding with Multimodal Large Models via Second-Level Tracking and RL Verification Figure 1
2026-06-30cs.CV

Efficient Spatio-Temporal Grounding with Multimodal Large Models via Second-Level Tracking and RL Verification

Tianshu Zhang, Yan Wang, Ji Qi, Lijie Wen

Tsinghua University, tracking, and video-language reasoning, making it a natural benchmark for language-controllable

2026-06-30视觉语言视觉感知强化学习

这篇论文针对长视频时空定位中逐帧调用多模态大模型代价高、轨迹易抖动的问题,将推理单位从帧改为秒,并用跨秒平滑保持连续性;训练上结合CPT、带真值坐标替换的推理式SFT,以及基于tIoU+mvIoU验证器的强化学习。实验在VidSTG和HC-STVG及多FPS设置下显示,其在计算效率与定位质量之间取得更稳健折中。

Semantic-Aware, Physics-Informed, Geometry-Grounded Weather Video Synthesis Figure 1
2026-06-30cs.CV

Semantic-Aware, Physics-Informed, Geometry-Grounded Weather Video Synthesis

Chenghao Qian, Nedko Savov, Lingdong Kong, Yeying Jin, Rui Song, Wenjing Li, Zhun Zhong, Jiaqi Ma, Gustav Markkula, Luc Van Gool

University of Leeds, UK, INSAIT, Sofia University “St. Kliment Ohridski”, National University of Singapore, Singapore, University of California, Los Angeles, USA, Hefei University of Technology, China

2026-06-30视觉感知

本文针对现有天气视频合成依赖文本提示、难以生成高密度雨雪和可控粒子动态的问题,提出将语义外观锚定、物理粒子模拟与几何深度约束拆成三类条件信号,去激活预训练视频编辑器中的天气先验。实验显示其能生成更多样且时空一致的雨雪效果,并使自动驾驶语义分割在极端天气下最高提升14.5% mIoU。

Mural: Transferring LLM knowledge to image generation via Mixture-of-Transformers Figure 1
2026-06-30cs.CV

Mural: Transferring LLM knowledge to image generation via Mixture-of-Transformers

Achin Jain, Jie An, Siddharth Chaudhary, Davide Modolo

2026-06-30视觉感知

本文关注在不更新大语言模型、且仅使用常规图文对训练时,LLM知识能否真正迁移到文生图。Mural将冻结的推理型LLM与扩散生成分支用MoT共享注意力连接,核心洞察是共享注意力可作为知识接口。实验相对同配方dense基线提升,并在GenEval 0.85、DPG-Bench 86.75、WISE 0.66上表现较强,还出现跨语言、颜色约束、emoji/ASCII到场景及世界知识生成等未显式监督能力。

SciFlow: Semantic Cross Interference for Self-Supervised Optical Flow Domain Generalization Figure 1
2026-06-30cs.CV

SciFlow: Semantic Cross Interference for Self-Supervised Optical Flow Domain Generalization

Jamie Menjay Lin, Jisoo Jeong, Hong Cai, Kai Wang, Fatih Porikli

Qualcomm Technologies, Inc., † Qualcomm AI Research is an initiative of Qualcomm Technologies, Inc., relying solely on labeled synthetic data for optical flow esti-, mation. These approaches aim to leverage unlabeled target-, domain data and small amounts of labeled real-world data, ate augmented, unlabeled image pairs to support semi-, interference and its predictions are compared against the self-supervised labels predicted by the teacher to create the self-supervised loss., the need for real or pseudo optical flow labels, as well as, main shift and label scarcity in open-world scenarios., \lab e l {eq:di s tractflo w_l s elf} \begin {split}, ground truth labels, and a real-world dataset DNGT without

2026-06-30生成模型学习理论

针对光流模型依赖合成标注训练、部署到真实开放场景时域偏移明显的问题,SciFlow提出一种与网络无关的自监督微调策略:把无标注开放世界图像作为语义干扰混入合成帧,并用教师-学生、EMA与几何一致性/置信掩码约束学生预测接近干净样本上的教师伪标签。实验显示该方法在无需真实光流真值的情况下提升KITTI等跨域表现,并改善野外样本鲁棒性;但具体增益中各组件贡献仍需消融进一步厘清。

Learning from Acquisition: Metadata-driven Multimodal Pre-training for Cardiac MRI Figure 1
2026-06-30cs.CV

Learning from Acquisition: Metadata-driven Multimodal Pre-training for Cardiac MRI

Xueyi Fu, Liwei Hu, Zi Wang, Guang Yang

Department of Surgery & Cancer, Imperial College London, London, UK, Bioengineering Department and Imperial-X, Imperial College London, London, UK, National Heart and Lung Institute, Imperial College London, London, UK, Cardiovascular Research Centre, Royal Brompton Hospital, London, UK, School of Biomedical Engineering & Imaging Sciences, King’s College London, primarily on image-only pre-training and leave this naturally available, Their application to CMR is limited by the availability of paired clinical reports

2026-06-30视觉语言

这篇论文针对心脏 MRI 基础模型多依赖图像自监督、忽略扫描过程中天然产生的结构化元数据的问题,提出 MetaCLIP-CMR:把模态、解剖视角、厂商、场强和机型转成文本,用带软标签的 CLIP 式对比学习对齐图像序列与元数据语义。结果显示其在模态和 cine 视角分类上达到 86.8% 与 86.5%,并在 ACDC、M&Ms 短轴分割的全量和 20% 微调设置中优于 ImageNet 与掩码重建初始化;相较大规模图像预训练模型,用不到 1% 的预训练图像量取得接近分割表现。

Evidence-Based Text-Conditioned 3D CT Synthesis for Ovarian Cancer Figure 1
2026-06-30cs.CV

Evidence-Based Text-Conditioned 3D CT Synthesis for Ovarian Cancer

Francesca Pia Panaccione, Eugenio Lomurno, Francesca Fati, Carlotta Pecchiari, Marina Rosanu, Luigi De Vitis, Lucia Ribero, Gabriella Schivardi, Giovanni Damiano Aletti, Nicoletta Colombo, Maria Francesca Spadea, Francesco Multinu, Matteo Matteucci, Elena De Momi

AIRLab, Politecnico di Milano, Milan, Italy, NEARLab, Politecnico di Milano, Milan, Italy, Karlsruhe Institute of Technology, Karlsruhe, Germany, descriptors and routinely available clinical metadata, without accessing any original radiology report, and uses these, available at https://github.com/francescapia/OvESyn., status, are intentionally kept minimal: routinely available

2026-06-30三维

卵巢癌术前 CT 数据稀缺且报告不标准,限制了可控三维合成数据的构建。论文提出 OvESyn,从自动分割得到的影像特征和 FIGO、腹水等临床元数据生成结构化文本,再条件化潜扩散模型,而非依赖配对放射报告。实验表明,生成器微调是跨越胸部到腹盆腔域差异的关键,完整模型取得最佳分布与强度保真度,FID2.5D 为 29.35、Precision 为 0.671。

Self-Evolving Agentic Image Restoration via Deliberate Planning and Intuitive Execution Figure 1
2026-06-30cs.CV

Self-Evolving Agentic Image Restoration via Deliberate Planning and Intuitive Execution

Shuang Cui, Fan Ji, Guanglong Sun, Yufei Guo, Xiongxin Tang, Jiangmeng Li, Fanjiang Xu

Institute of Software, Chinese Academy of Sciences, Beijing, China, University of Chinese Academy of Sciences, Beijing, China, School of Life Sciences, Tsinghua University, Beijing, China, Intelligent Science & Technology Academy of CASIC, Beijing, China

2026-06-30视觉感知规划控制

本文针对真实图像复原中多种退化耦合、工具调用顺序敏感的问题,指出现有智能体过度依赖贪心搜索且会遗忘已探索轨迹。SEAR 将复原建模为序贯决策,结合慢速的剪枝感知 MCTS 规划与快速的情景记忆执行,用无参考奖励和 MLLM 竞赛约束感知质量。实验称其在合成与真实基准上取得更好的感知和定量表现,但具体增益中规划、记忆与工具库各自贡献仍需看消融细节。

Character Recognition of Nepali Number Plate Figure 1
2026-06-30cs.CV

Character Recognition of Nepali Number Plate

Satyasa Khadka, Sandhya Baral, Sudip Tiwari, Sharad Kumar Ghimire

Pulchowk Campus, Institute of Engineering, Lalitpur, Nepal1, available data sets were used that incorporate diverse lighting, fonts, and, formance under real-world conditions and providing a scalable solution, This work utilizes two publicly available datasets from Kaggle, specifically tai-

2026-06-30视觉感知

针对尼泊尔车牌使用天城文、版式多行且字体和间距不统一,通用拉丁字符 ANPR 难以适配的问题,本文构建了车牌检测、字符检测与识别的级联流程:用 YOLO/YOLOv8 定位车牌和字符,再用 CNN 识别 34 类天城文字符,并通过增强及少量外部凸字牌数据补足鲁棒性。系统在公开数据集上报告最高约 93% 识别准确率,凸字牌验证准确率约 88%,但跨国家凸字数据带来的增益来源仍未充分说明。

ExACT: Exemplar-Driven Calibrated Refinement for Training-Free Visual Grounding in Remote Sensing Images Figure 1
2026-06-30cs.CV

ExACT: Exemplar-Driven Calibrated Refinement for Training-Free Visual Grounding in Remote Sensing Images

Zixiao Zhang, Lingling Li, Pei He, Xu Liu, Licheng Jiao

Xidian University

2026-06-30视觉语言视觉感知

这篇论文针对遥感视觉定位中仅靠文本提示容易产生语义歧义、背景高响应和边界漂移的问题,提出训练自由的 ExACT:用一张视觉示例提供细粒度结构约束,结合 VEC 校准冻结 MLLM 的粗注意力先验,再由 SAR 生成正负几何提示驱动 SAM 分割。实验显示其优于现有训练自由和弱监督方法,消融中 SAR、视觉语义融合与视觉校准均带来明显增益,1-shot 已接近多示例效果。

What Color is the Sky (for a non-human) ? Figure 1
2026-06-30cs.CV

What Color is the Sky (for a non-human) ?

Yair Weiss, Ofer Springer

School of Computer Science and Engineering and Edmond and Lili Safra Center for, School of Computer Science and Engineering, Hebrew Univesity of Jerusalem ∗E-mail:

2026-06-30视觉感知

论文追问“天空为何是蓝色”在非人视觉系统中是否仍成立,动机是把物理光谱与观察者光感受器响应区分开。作者提出用任意物种的光谱敏感函数搜索与天空光同色异谱的单色光/白光混合,从而定义主导波长。结果显示,人类约对应蓝光,但蜜蜂、壁虎、鸡等物种的匹配波长可落在约400–480nm,合成系统甚至更宽,说明天空“颜色”主要由感受器决定而非仅由瑞利散射决定。

Projection-based coupling of infrared thermography and stereocorrelation-based digital image correlation Figure 1
2026-06-30cs.CV

Projection-based coupling of infrared thermography and stereocorrelation-based digital image correlation

Jendrik-Alexander Tröger, Lutz Müller-Lohse, Stefan Hartmann

Institute of Applied Mechanics, Clausthal University of Technology

2026-06-30视觉感知

论文面向实验固体力学中 3D-DIC 位移点云与红外热像二维温度难以统一到同一拉格朗日材料点的问题,提出用针孔相机投影矩阵把独立标定的工业 DIC 与 IRT 系统外部耦合,并用时空 RBF 插值求曲面温度梯度和温度率。圆柱半壳与拉扭管实验显示,该方法能在曲面材料点上重建温度场和梯度;温度率结果受红外噪声限制,需进一步平滑或回归处理。

On Test-Time Scaling for Vision-Language Models Figure 1
2026-06-30cs.CV

On Test-Time Scaling for Vision-Language Models

Fawaz Sammani, Tzoulio Chamiti, Nikos Deligiannis

ETRO Department, Vrije Universiteit Brussel, Belgium

2026-06-30视觉语言视觉感知

这篇论文针对LLM测试时扩展方法能否直接迁移到视觉语言模型的问题,系统比较九种推理、采样、聚合与自修正策略在多模型、多基准上的表现。核心洞察是,额外推理计算并非越多越好:小而强的LVLM在推理任务上收益最大,可接近或超过大模型基线,但感知任务会因过度思考而退化;注意力分析还显示视觉信息主要在推理链早期被编码,随后转为文本内推理。

HKVLM: Faithful Reasoning Grounding by Binding Language Queries to a Frozen Detector Figure 1
2026-06-30cs.CV

HKVLM: Faithful Reasoning Grounding by Binding Language Queries to a Frozen Detector

Bo Ma

Auckland University of Technology, the wrong box or label. We argue this is a binding failure: in, return wrong labels or imprecise boxes. We call this the see-, lations, and hypotheses—centered on reasoning and refer-

2026-06-30视觉语言

本文针对推理式视觉定位中 VLM“看对但说错”、检测器又缺乏意图推理的问题,将定位交给冻结的开放词汇检测器,把语言模型产生的指代表征通过轻量 alignment hook 与区域表征绑定,并用感知一致性 veto 抑制无区域支撑的命名。在 RefCOCO 系列和 POPE 上,仅训练 hook 相比未训练跨空间匹配提升 50–90 倍,POPE 准确率升至 0.66–0.76,幻觉显著下降;但绝对定位仍受 proposal recall 限制。

EpiSAM: Character Segmentation in Challenging Stone Inscriptions Figure 1
2026-06-30cs.CV

EpiSAM: Character Segmentation in Challenging Stone Inscriptions

Arnav Sharma, Pratyush Jena, Amal Joseph, Ravi Kiran Sarvadevabhatla

Center for Visual Information Technology, International Institute of Information

2026-06-30视觉感知

石刻铭文因侵蚀、低对比和复杂连字而难以用常规文档 OCR 处理,EpiSAM 将问题前移到字符级实例分割,并在 SAM 式提示分割中显式联合预测目标字符及相邻字符,以邻域上下文缓解边界歧义。论文还补充了字符多边形标注数据集;实验显示其较基线分割精度更高,并具备一定跨脚本、跨风格零样本泛化能力。

Personalizing MLLMs via Reinforced Multimodal Reference Game Figure 1
2026-06-30cs.CV

Personalizing MLLMs via Reinforced Multimodal Reference Game

Deepayan Das, Davide Talon, Yiming Wang, Massimiliano Mancini, Elisa Ricci

University of Trento, Trento, Italy

2026-06-30视觉语言

这篇论文针对 MLLM 个性化中概念描述常混入状态、背景等干扰信息的问题,提出将个性化识别重构为多模态 reference game:同一模型扮演 speaker 与 listener,在 hard positives 和 hard negatives 构成的对比场景中,用可验证胜负奖励经 GRPO 训练生成更具区分性且相对不变的概念描述。实验显示 RRG 在 Yo’LLaVA、MyVLM、PerVA 的 captioning 与 VQA 个性化任务上优于描述式方法和已有 RL 个性化框架,并能泛化到未见领域。

DLGStream: Dynamic Language-embedded Guassian Splatting for Open-vocabulary Enabled Free-viewpoint Video Streaming Figure 1
2026-06-30cs.CV

DLGStream: Dynamic Language-embedded Guassian Splatting for Open-vocabulary Enabled Free-viewpoint Video Streaming

Zhihui Ke, Yuyang Liu, Xiaobo Zhou, Tie Qiu

2026-06-30视觉感知

DLGStream针对3DGS自由视点视频难以同时满足低码率、高帧率与开放词汇交互的问题,将动态语言特征与高斯属性一起流式传输。其关键洞察是颜色与语言特征共享不透明度会相互干扰,因此引入双不透明度,并用时间特征插值的变形场压缩时序冗余、支持帧插值。实验显示其在开放词汇分割上mIOU提升约9%,保持较好重建质量,平均帧大小约43KB。

Ground4D: Consistency-Aware 4D Reconstruction from Monocular Video Figure 1
2026-06-30cs.CV

Ground4D: Consistency-Aware 4D Reconstruction from Monocular Video

Qing Zhao, Weijian Deng, Pengxu Wei, Liang Lin

Qing Zhao, Pengxu Wei, and Liang Lin are with the School of Com-, puter Science and Engineering, Sun Yat-sen University, China. (e-mail:, Weijian Deng is with the Tsinghua Shenzhen International Graduate School

2026-06-30视觉感知三维

Ground4D针对单目动态4D重建中“渲染质量高但几何易漂移、基础模型几何稳但不适合真实感渲染”的矛盾,先用VGGT免训练恢复一致几何与相机位姿初始化动态高斯,再在观测和虚拟视角用同源几何深度约束细化。实验显示其同时提升几何重建精度和动态新视角合成质量,但长视频计算开销仍是限制。

RefGlass-GS: A UAV-Enabled Fusion Framework for Photorealistic, Semantic and Interactive Digitization of Reflective Glass Facades via Gaussian Splatting Figure 1
2026-06-30cs.CV

RefGlass-GS: A UAV-Enabled Fusion Framework for Photorealistic, Semantic and Interactive Digitization of Reflective Glass Facades via Gaussian Splatting

Zhenyu Liang, Xiao Zhang, Boyu Wang, Zhaolun Liang, Ang Li, Jeff Chak Fu Chan, Mingzhu Wang, Jack C.P. Cheng

a Department of Civil and Environmental Engineering, The Hong Kong University of Science and, b Department of Civil and Environmental Engineering, University of Maryland, College Park, Maryland, c Department of the Built Environment, National University of Singapore, Singapore, d Department of Architecture and Civil Engineering, City University of Hong Kong, Hong Kong, China

2026-06-30三维

针对玻璃幕墙反射导致摄影测量/激光重建失真、纹理视角依赖强且难以按面板语义管理的问题,RefGlass-GS把无人机视点规划、基于结构先验的单块玻璃分割、带Reflection MLP的延迟着色GS和对象化数据组织串成端到端流程。真实幕墙实验显示,分割mIoU较SOTA提升0.1927,视点规划使PSNR提升13.15 dB,反射建模较GS基线平均提升5.08 dB。

CoGS: Compositional Dynamic Human-Object Scenes Gaussian Splatting from Monocular Video Figure 1
2026-06-30cs.CV

CoGS: Compositional Dynamic Human-Object Scenes Gaussian Splatting from Monocular Video

Jerrin Bright, John Zelek

Vision and Image Processing Lab, University of Waterloo, Canada

2026-06-30视觉感知三维

这篇论文针对单目视频中人体、被操作物体与背景运动模型不同却共享像素,导致动态重建易发生运动/几何串扰的问题,提出 CoGS:将场景拆成人体、刚体物体和静态背景三条 Gaussian Splatting 分支,并用可见性锚定、物体轮廓/运动约束与六阶段优化逐步融合。实验在 HOSNeRF 和 NeuMan 上显示其提升全帧、人像及人-物重建质量,尤其有利于遮挡和弱观测区域。

ViPSim: Collaborating Visual and Parameter Spaces for Consistent Long-Horizon Embodied World Models Figure 1
2026-06-30cs.CV

ViPSim: Collaborating Visual and Parameter Spaces for Consistent Long-Horizon Embodied World Models

Longyu Chen, Heng Li, Wei Yang, Manqi Zhao, Dongsheng Jiang

2026-06-30强化学习

ViPSim针对具身世界模型在长时序预测中因低维动作与高维视频缺乏几何对应而产生轨迹漂移、接触不一致的问题,提出视觉空间与参数空间协同:前者用末端位姿投影、相机、深度几何和机器人形态掩码提供像素级约束,后者注入动作序列与相机矩阵提供数值驱动。实验显示该方法可跨生成骨干提升轨迹一致性,并在布料等可变形物体、OOD与跨本体场景中保持较稳健表现。

PSP: Harnessing Position and Shape Priors for Cross-Domain Few-Shot Medical Image Segmentation Figure 1
2026-06-30cs.CV

PSP: Harnessing Position and Shape Priors for Cross-Domain Few-Shot Medical Image Segmentation

Bin Xu, Yazhou Zhu, Haofeng Zhang

School of Computer Science and Engineering, Nanjing University of Science and, ods. Code is available at https://github.com/xubin471/PSP.

2026-06-30视觉感知

这篇论文针对少样本医学分割在 MRI、CT 等跨模态场景中因纹理差异导致性能崩塌的问题,提出利用器官位置与几何形状在不同域中相对稳定的先验。PSP 通过位置坐标嵌入、形状原型调制和混合原型预测,减少对域特定纹理的依赖并校准支持/查询特征分布。文中在腹部和心脏公开数据集上报告优于现有方法,但摘要未给出具体数值。

Virtual Ring Try-On Figure 1
2026-06-30cs.CV

Virtual Ring Try-On

Vishnu D. Burkhawala, Zankhana J. Barad, Harshadkumar B. Prajapati, Vipul K. Dabhi

Department of Information Technology, Dharmsinh Desai University

2026-06-30视觉感知

面向线上珠宝购物中试戴不真实、AR/生成式方案依赖高端硬件的问题,本文提出用 MediaPipe 定位手部、YOLOv8 分割戒指,再以向量几何完成旋转、缩放和 alpha 融合的轻量流程。其核心洞察是保留原手部图像并只做角度感知的局部合成,可避免手部被重绘或戒指漂浮;结果显示系统可在普通移动端生成贴合手指的戒指效果,但文中未充分说明量化评测和用户研究。

BREIT: A Framework for Brain Stroke Reconstruction using Multi-Frequency 3D EIT Figure 1
2026-06-30cs.CV

BREIT: A Framework for Brain Stroke Reconstruction using Multi-Frequency 3D EIT

Djahid Abdelmoumene, Ishak Ayad, Maï K. Nguyen, Christian Daveau

ETIS (UMR 8051), CY Cergy Paris University, ENSEA, CNRS, Cergy France, AGM (UMR 8088), CY Cergy Paris University, CNRS, Cergy, France, Paris-Saclay University, CentraleSupélec, Inria, CVN, Gif-sur-Yvette, France, parable CC across noise settings. Code and data are publicly available, and often unavailable for pre-hospital, bedside, or resource-limited use [32]. In

2026-06-30三维

本文针对卒中场景中三维多频 EIT 缺少成对真值数据、仿真与评测流程不统一的问题,提出 BREIT,将 CT/MRI 转为频率相关导纳体、配套 3D CEM 正问题求解器和非均匀电极 3D D-bar 工具,并在此上构建 dFNO-bar 学习散射数据到电导率的映射。合成 UCLH 匹配数据上,其脑区 SSIM 高于 D-bar、Deep D-bar 和 Gauss–Newton,CC 相近,但临床泛化仍待验证。

Stochastic Optimal Control Sampling for Diffusion Inverse Problems Figure 1
2026-06-30cs.CV

Stochastic Optimal Control Sampling for Diffusion Inverse Problems

Jie Zhang, Youmei Qiu, Hanling Tian, Jingyuan Zhang, Xiang Yin, Xiaolin Huang

School of Automation and Intelligent Sensing, Shanghai Jiao Tong University, Shanghai Key Laboratory of Flexible Medical Robotics, Tongren Hospital, Institute, of Medical Robotics, Shanghai Jiao Tong University, Shanghai, China, inverse problems. The key is to controllably steer the sampling trajec-, available at https://github.com/zjqwq01/SOCS-DIP.

2026-06-30生成模型规划控制

本文针对扩散模型求解图像逆问题时“既要满足观测约束、又不能破坏生成先验”的矛盾,将去噪采样视为随机最优控制过程。核心创新是避免全轨迹 iLQR 优化,推导逐步闭式控制更新,把测量一致的干净估计拉回去噪流形,并通过可调控制强度限制过度干预。实验覆盖多类逆问题、VE/VP-SDE 及潜空间扩散/Flow Matching,显示在重建一致性、视觉质量和定量指标上优于多种采样基线。

Multimodal Graph RAG for Long-range Visually Rich Document Understanding Figure 1
2026-06-30cs.IR

Multimodal Graph RAG for Long-range Visually Rich Document Understanding

Yi-Cheng Wang, Chu-Song Chen

Department of Computer Science and Information Engineering, National Taiwan University, FinTech Center, National Taiwan University, Our code is available on https://github.com/AI-, Application-and-Integration-Lab/KG4VD.

2026-06-30视觉语言

论文针对长篇视觉丰富文档中,页级多模态检索难以回答跨页、全局 VQA 的问题,提出 KG4VD:自适应地从文本、图像与版面区域构建可复用多模态知识图,并以页面锚定结合查询自适应 PPR 扩展降低图检索噪声。作者还构建含参考摘要和支撑事实的 DLVQA,用于评估忠实性、完整性与简洁性;实验显示其在多跳 QA/VQA 和 DLVQA 上优于 MMRAG 与图 RAG 基线。

X-Mind: Efficient Visual Chain-of-Thought via Predictive World Model for End-to-End Driving Figure 1
2026-06-30cs.CV

X-Mind: Efficient Visual Chain-of-Thought via Predictive World Model for End-to-End Driving

Bohao Zhao, Chengrui Wei, Guangfeng Jiang, Ruixin Liu, Xuejie Lv, Liu Liang, Sutao Deng, Xiuyang Fan, Pengkun Zheng, Jinyun Zhou, Rui Guo, Hanpeng Liu, Yutong Zheng, Yi Guo, Xinlong Zheng, Qingyu Luo, Zhuangzhuang Ding, Yu Zhang, Hang Zhang, Xianming Liu

PWM Team, XPeng Inc.

2026-06-30强化学习

针对端到端自动驾驶VLA模型多依赖即时感知、缺少预测未来能力的问题,X-Mind将预测世界模型内化为视觉思维链:用融合BEV布局、导航意图和交通规则的抽象草图替代密集视频预测,并以DC-AE压缩到96个token,再用循环块扩散在一次前向中完成未来 rollout。文中称其在大规模真实数据上取得有竞争力的驾驶表现和低延迟部署潜力,但具体增益来源仍需更多消融支撑。

A Physics-Grounded Benchmark for Multi-Agent Dynamics in World Models Figure 1
2026-06-30cs.CV

A Physics-Grounded Benchmark for Multi-Agent Dynamics in World Models

Nuo Chen, Lulin Liu, Zihao Li, Ziyao Zeng, Zihao Zhu, Wenyan Cong, Junyuan Hong, Yunhao Yang, Zhengzhong Tu, Yan Wang, Boris Ivanovic, Marco Pavone, Zhangyang Wang, Yang Zhou, Zhiwen Fan

2026-06-30强化学习数据集/基准

本文针对自动驾驶世界模型常以视觉质量掩盖物理错误的问题,提出 CrashTwin 基准:用 25K 合成碰撞与 12K 真实事故视频,结合免标定重建,从单目 rollout 提取轨迹、速度等 3D 物理量,并评估时空一致性、动量/能量守恒和世界动态完整性。实验显示,现有高感知质量模型在复杂碰撞中仍有明显物理违规,物理指标也比传统视觉指标更贴近人类对真实感的判断。

BLUE: A Stale-Pixel Optical-Flow Compositor for Entropy-Efficient Surveillance Video Encoding Figure 1
2026-06-30eess.IV

BLUE: A Stale-Pixel Optical-Flow Compositor for Entropy-Efficient Surveillance Video Encoding

Shubham Baid, Akash James, Sahil Chachra, Nishant Sinha, Kunal Kislay

KGrpah AI Solutions Pvt. Ltd., Bangalore, India. 560016

2026-06-30视觉感知生成模型

面向固定摄像头监控视频中大量比特反复编码静态背景的问题,BLUE在编码前用光流运动掩码保留前景、以持久种子帧替换背景像素,使标准H.264/H.265更易产生SKIP块且无需改码流或解码器。在VIRAT 308段评测中,CRF28下平均减小文件34.6%/39.4%,前景PSNR在60.7%片段持平或提升,但全帧VMAF中位下降6.75–8.59,需用质量门控选择性启用。

FreqOrtho-SR: Frequency-Guided Orthogonal Expert Learning for Real-World Image Super-Resolution Figure 1
2026-06-30cs.CV

FreqOrtho-SR: Frequency-Guided Orthogonal Expert Learning for Real-World Image Super-Resolution

Minh Son Hoang, Dinh Phu Tran, Quyen Nguyen Duc, Dam Hoang Phuong, Daeyoung Kim

School of Computing, KAIST, Republic of Korea

2026-06-30视觉感知强化学习

这篇论文针对真实图像超分中保真度与感知质量难兼顾、且退化类型多样的问题,提出 FreqOrtho-SR:用 FFT 频域退化特征为不同 LoRA 专家路由,并通过正交梯度投影把语义增强更新限制在像素保真子空间的零空间中,减少目标冲突。实验显示其在多个基准上取得有竞争力的整体表现,在单步扩散推理下保持较好的保真—感知权衡。

CCRC: A Change-Aware Captioning and Reasoning Chain for Image Change Captioning and Segmentation Figure 1
2026-06-30cs.CV

CCRC: A Change-Aware Captioning and Reasoning Chain for Image Change Captioning and Segmentation

Jinhong Hu, Xiaoping Wang, Shuyin Huang, Guojin Zhong, Kaitai Liu, Kai Lu

aCollege of Computer Science and Electronic Engineering, Hunan University, China, bGuangxi Minzu University, China, cNational University of Defense Technology, China, performance. Code is available at https://github.com/user-jinhong/, rather than static object labeling. This makes ICCS more challeng-

2026-06-30视觉语言视觉感知

传统图像变化描述只给文字,容易因目标或颜色歧义而缺少可定位性;本文提出 ICCS 任务,并用 CCRC 双链框架先通过变化感知注意力生成结构化描述与可分割判断,再在需要时利用语义先验细化像素级掩码。作者还为两个基准补充分割标注,实验称在合成与真实变化数据上同时提升描述和分割表现,达到 SOTA。

Mitigating Batch Effects in Histopathology via Language-Mediated Robust Embedding Generation Figure 1
2026-06-30cs.CV

Mitigating Batch Effects in Histopathology via Language-Mediated Robust Embedding Generation

Yishu Zhang, Shushan Wu, Zhenzhong Zhang, Didong Li, Huaxiu Yao, Yun Li, Iain Carmichael, Katherine A. Hoadley, Hongtu Zhu, Di Wu, Daiwei Zhang

University of North Carolina at Chapel Hill, labs and devices in high-stake medical settings [3, 44]. For, main labels from multiple sites to enforce invariance. Re-, state, which is not available for frontier proprietary models., stantially larger visual-token capacity than is available in, scalable by enabling the selection of a manageable subset

2026-06-30安全鲁棒

这篇论文针对病理基础模型易把染色、扫描仪和机构来源等批次效应编码进特征、导致跨中心泛化和安全性下降的问题,提出 GLMP:先用多模态大模型把切片块转成强调细胞形态与组织结构、过滤颜色亮度等伪影的文本,再由文本编码器生成数值嵌入。实验表明其相较常规 PFM 更弱化 TSI 信号、保留生物差异,在下游分析中获得更稳健的跨机构表示。

LogiCo: A Unified Framework for Logical and Structural Anomaly Detection Figure 1
2026-06-30cs.CV

LogiCo: A Unified Framework for Logical and Structural Anomaly Detection

Ximiao Zhang, Min Xu, Xiuzhuang Zhou

School of Intelligent Engineering and Automation, Beijing University of Posts and, College of Information and Engineering, Capital Normal University, Beijing, China, crete component-level feature space and performs collaborative feature, The code is available at https://github.com/cnulab/LogiCo.

2026-06-30视觉感知

这篇论文针对工业视觉中结构缺陷与逻辑异常难以统一检测的问题,指出单纯局部建模缺少长程约束,而全局语义分支又牺牲细粒度定位。LogiCo用组件级离散特征重建来表达部件间逻辑关系,并结合补丁级结构重建与分割图判别器处理数量异常。在MVTec-LOCO、MVTec-AD、VisA和Real-IAD上取得逻辑与结构异常检测的SOTA或可比结果。

SATB-VR: Training Few-Step Video Restoration Diffusion Model using SNR-Aware Trajectory Blending Figure 1
2026-06-30cs.CV

SATB-VR: Training Few-Step Video Restoration Diffusion Model using SNR-Aware Trajectory Blending

Haoran Bai, Xiaoxu Chen, Xiaoyu Liu, Zongsheng Yue, Sibin Deng, Wangmeng Zuo, Ying Chen

Harbin Institute of Technology, Xi’an Jiaotong University

2026-06-30视觉感知生成模型规划控制

这篇论文针对扩散式视频修复依赖数十步去噪、而单步蒸馏又容易丢失纹理和时序稳定性的矛盾,提出用辅助预测器跳过早期低 SNR 阶段,并用 SNR 感知轨迹混合缓解预测器与去噪器联合训练时的训练—推理不一致;同时引入 DDC 特征一致性损失提升初始预测质量。实验显示 SATB-VR 在不超过 5 步推理下,可在合成、真实和 AIGC 视频修复基准上达到或超过若干 50 步方法。

Predicting Metastatic Risk from Primary Tissue Architecture via Distance-Aware Spatial Modeling Figure 1
2026-06-30cs.CV

Predicting Metastatic Risk from Primary Tissue Architecture via Distance-Aware Spatial Modeling

Sandesh Pokhrel, Hamid Manoochehri, Bodong Zhang, Beatrice S Knudsen, Tolga Tasdizen

Department of Electrical and Computer Engineering, University of Utah, Scientific Computing and Imaging Institute, University of Utah, Department of Pathology, University of Utah, to predict a slide-level label. While effective for tasks where the mere presence of

2026-06-30安全鲁棒

这篇论文针对传统WSI多实例学习把切片视为无序patch、难以刻画转移风险所依赖的肿瘤-微环境空间结构的问题,提出DTMf-MIL:先用K-means或CONCH形成表型区域,再以SDF、RBF、多尺度边界梯度和局部统计量显式编码patch到各组织表型的距离关系。结果显示其在VA前列腺转移风险预测上优于现有MIL方法,并在PANDA、Camelyon16和TCGA-NSCLC等任务中带来一致提升。

BackTranslation2.0 -- A Linguistically Motivated Metric to Assess Sign Language Production Figure 1
2026-06-30cs.CV

BackTranslation2.0 -- A Linguistically Motivated Metric to Assess Sign Language Production

Oliver Cory, Maksym Ivashechkin, Karahan Sahin, Oline Ranum, Jianhe Low, Edward Fish, Anton Pelykh, Ozge Mercanoglu Sincan, Richard Bowden

Centre for Vision, Speech and Signal Processing, University of Surrey, Guildford, UK, same quality dimensions, following a protocol developed in collabora-, expert annotation is expensive and time-intensive, limiting scalability [11].

2026-06-30视觉感知

针对手语生成评测长期依赖回译、与聋人评审相关性弱的问题,本文提出 BackTranslation2.0:用确定性 agentic 流水线整合语法、音系、运动流畅度和视觉保真度工具,并由 LLM 做跨工具一致性核查后加权评分。作者构建带人工多维评分的 BSL 数据集,并与六类基线比较,结果显示该指标在各维度上更接近人类判断,强调评测应显式建模手语语言学结构而非只比文本回译。

SemDynReg: Semantics-Guided Deformation Regularization for Dynamic 3D Gaussian Splatting Figure 1
2026-06-30cs.CV

SemDynReg: Semantics-Guided Deformation Regularization for Dynamic 3D Gaussian Splatting

Ruitao Chen, Mozhang Guo, Jinge Li

2026-06-30三维

这篇论文针对动态 3DGS 依赖物体无关形变场、易导致同一物体内高斯形变不一致和跨物体耦合的问题,引入由 SAM/CLIP 语义和对象字典构建的 object-ID 图,并对每个对象像素贡献最大的 top-k 高斯在位置、尺度、旋转上施加一致性正则。实验主要在两组自动驾驶动态场景中验证,车辆边界和细节更稳定,平均 PSNR/SSIM 提升、LPIPS 下降,但场景规模较小,泛化性文中未充分说明。

FedLAS: Feature-Modulated Bidirectional Label Smoothing for Neural Network Calibration Figure 1
2026-06-30cs.CV

FedLAS: Feature-Modulated Bidirectional Label Smoothing for Neural Network Calibration

Thiru Thillai Nadarasar Bahavan, Sachith Seneviratne, Saman Halgamuge

FedLAS: Feature-Modulated Bidirectional Label, The University of Melbourne, Parkville, Australia, correct predictions or under-confident correct predictions. Label smooth-, ground-truth label to the remaining classes. LS, including Margin-based, propose FeDLaS: Feature-Modulated Bidirectional Label Smoothing, a, plug-and-play algorithm for label smoothing-based losses. In FeDLaS, Keywords: Network Calibration · Uncertainty Estimation · Label Smooth-, bels. The use of one-hot encoded labels (Fig. 1(a)) encourages the models to, exhibit overconfidence, even when predictions are incorrect [10]. Label smooth-, training by redistributing the probability mass from the ground-truth label to, calibration methods are implicitly sample-adaptive variants of label smoothing, troduce NCI, a label-free indicator leveraging hidden-layer feature norms.

2026-06-30视觉感知

这篇论文针对常规标签平滑只按固定规则缓解过置信、难以处理欠置信和训练动态变化的问题,提出 FeDLaS:用隐藏层特征范数作为置信指示,并结合双向校准门控逐样本调节平滑强度。实验覆盖 CIFAR、Tiny-ImageNet 和细粒度高分辨率数据集,结果显示其在基本保持 Top-1 准确率的同时降低 ECE 与 Adaptive ECE。

Obliviate: Erasing Concepts from Autoregressive Image Generation Models Figure 1
2026-06-30cs.CV

Obliviate: Erasing Concepts from Autoregressive Image Generation Models

Hossein Shakibania, Jonas Henry Grebe, Tobias Braun, Ege Aktemur, Saleh Aslani, Mehmet Görkem Yiğit, Marcus Rohrbach

2026-06-30视觉感知

自回归文生图模型正被用于统一多模态生成,但扩散模型中较成熟的概念擦除方法难以直接迁移,带来安全缺口。Obliviate 的关键在于用对齐视觉前缀构造稳定的伪无条件分支,并以 KL 监督整段自回归轨迹上的视觉 token 分布,从而避免单步或未对齐更新破坏生成能力。实验覆盖 Liquid、Emu3-Gen、Janus-Pro,在裸露、血腥和品牌擦除上优于现有替代方法,RAB 裸露检出率从 91.58 降至 3.15,同时保持总体效用。

AEGIR: Modeling Area Emitters for Indoor Inverse Rendering using Gaussian Splatting Figure 1
2026-06-30cs.CV

AEGIR: Modeling Area Emitters for Indoor Inverse Rendering using Gaussian Splatting

Mohamed Shawky Sabae, Philipp Langsteiner, Jan-Niklas Dihlmann, Hendrik Lensch

University of Tübingen

2026-06-30三维

AEGIR针对室内逆渲染中环境光图、点光源或隐式光场难以表达近距离真实灯具面积、导致衰减和软阴影错误的问题,在Gaussian Splatting中显式引入可优化的局部面积发光体,并用各向异性尺度、Super-Gaussian角度衰减、可微延迟渲染和正则约束联合恢复几何、PBR材质与光照。实验显示该建模提升了光照重建,并改善新视角合成、可控重照明和虚拟物体插入,尤其适合复杂局部照明场景。

Physics-Grounded Disentangled Flow Modeling for Brain Disease Progression Trajectory Figure 1
2026-06-30cs.CV

Physics-Grounded Disentangled Flow Modeling for Brain Disease Progression Trajectory

Jun Wang, Peirong Liu

Department of Electrical and Computer Engineering, Data Science and AI Institute, Johns Hopkins University, publicly available at https://github.com/jhuldr/PDF.

2026-06-30生成模型规划控制

针对纵向脑部病灶预测中常见的端到端图像翻译难以区分结构形变与信号变化、物理一致性不足的问题,论文提出 PDF,将病程轨迹拆成形态演化和强度演化两条 flow matching,并用 Fisher-KPP 启发的扩散-反应-平流 PDE 正则约束形态速度场。三组公开纵向 MRI 数据上取得优于既有方法的预测表现,并显示更合理的病灶结构演化。

Envisage: Diffusion-Based Rhinoplasty Goal Visualization with Mask-Decomposed Evaluation Figure 1
2026-06-30eess.IV

Envisage: Diffusion-Based Rhinoplasty Goal Visualization with Mask-Decomposed Evaluation

Mudit Agarwal, Amit D. Bhrany

University of Washington, Department of Otolaryngology–Head and Neck Surgery, University of Washington School of Medicine, et al., 2021] unavailable in standard clinics, and full-face diffusion models drift identity across

2026-06-30生成模型数据集/基准三维

针对鼻整形术前沟通中3D设备昂贵、2D草图不真实且全脸生成易漂移身份的问题,Envisage用单张正脸照、手术区域掩膜、深度条件FLUX填充和硬合成,只改鼻部并保留非手术区域;同时提出按掩膜分解的SurgicalScore,指出全脸ArcFace会被复制像素混淆。在211例评测中其ArcFace负差最小、SurgicalScore最高,但所有方法仍未相对术前输入取得正ArcFace增益,说明局部手术编辑更应看区域保真度。

SIGNET: Motion-Level Knowledge Transfer for Cross-Language Sign Language Translation Figure 1
2026-06-30cs.CV

SIGNET: Motion-Level Knowledge Transfer for Cross-Language Sign Language Translation

Sobhan Asasi, Ozge Mercanoglu Sincan, Richard Bowden

CVSSP, University of Surrey, United Kingdom, training data and computation, limiting scalability and making it difficult for

2026-06-30视觉感知

这篇论文针对手语翻译模型常被限定在单一语种/数据集、难以复用跨语种运动知识的问题,提出 SIGNET:把在 ASL、BSL、CSL 等数据上预训练的骨架式手语骨干冻结为视觉专家,用手部先验和门控融合按输入选择专家,并用低秩残差与对比对齐适配新语种。实验称其在 How2Sign、Phoenix14T、CSL-Daily、MeineDGS 上达到最佳翻译表现,并在 WLASL 识别上超过既有方法。

Meshtryoshka: Differentiable Rendering of Real-World Scenes via Mesh Rasterization Figure 1
2026-06-30cs.CV

Meshtryoshka: Differentiable Rendering of Real-World Scenes via Mesh Rasterization

David Charatan, Daniel Xu, Richard Szeliski, George Kopanas, Vincent Sitzmann

Massachusetts Institute of Technology, University of Washington, Massachusetts Institute of Technology Cambridge Massachusetts United States, University of Washington Seattle Washington United States

2026-06-30强化学习

这篇论文针对可微渲染长期依赖体表示或专用渲染器、难以直接产出可移植网格的问题,提出 Meshtryoshka:从 SDF 每步提取多层嵌套网格壳,用普通三角光栅器分别渲染并 alpha 合成,梯度经透明度回传到 SDF 而非顶点位置。结果显示其在物体场景接近表面法,并能扩展到无界真实场景,视图合成质量接近非网格 SOTA,但训练较慢、三角形数量大且会出现浮游伪影。

IMU-HOI: A Symbiotic Framework for Coherent Human-Object Interaction and Motion Capture via Contact-Conscious Inertial Fusion Figure 1
2026-06-30cs.CV

IMU-HOI: A Symbiotic Framework for Coherent Human-Object Interaction and Motion Capture via Contact-Conscious Inertial Fusion

Lizhou Lin, Songpengcheng Xia, Zengyuan Lai, Lan Sun, Jiarui Yang, Ling Pei

Shanghai Jiao Tong University, human–robot collaboration [4, 6, 19, 33, 35, 40, 41]. While, sensors, limiting scalability. A key milestone was sparse, raise privacy and scalability concerns in real-world deploy-

2026-06-30视觉感知

这篇论文针对视觉式人-物交互捕捉易受遮挡、传统稀疏 IMU 又只估人体不估物体的问题,提出 IMU-HOI:在人体和物体上贴 IMU,先从惯性流估计手-物接触概率,再用接触门控在手部正运动学与物体 IMU 积分之间融合,同时优化人体姿态和根平移。实验称其在三个 HOI 基准上降低物体平移与交互误差,并可插入现有稀疏 IMU 姿态骨干;但复杂滑动、多接触和可变形物体仍未充分处理。

Animation2Code: Evaluating Temporal Visual Reasoning in Video-to-Code Generation Figure 1
2026-06-30cs.CV

Animation2Code: Evaluating Temporal Visual Reasoning in Video-to-Code Generation

Anya Ji, Abhijith Varma Mudunuri, David M. Chan, Alane Suhr

University of California, Berkeley, settings. Code and data are available at anya-ji.github.io/animation2code-website.

2026-06-30视觉感知

这篇论文针对现有视觉语言模型在静态图像到代码任务表现较好、但是否真正理解视频运动仍不清楚的问题,提出 Animation2Code:用 1069 个网页动画视频及其 HTML/CSS/JavaScript 代码评测视频到可执行动画代码的反渲染能力,并用外观相似度与时序相似度分离衡量视觉还原和运动对齐。实验显示,多种强模型代码可执行率接近满分、外观相似度最高 0.84,但时序相似度最高仅 0.31,微调和迭代修正也未显著弥合运动推理缺口。

SatSplat: Geometrically-Accurate Gaussian Splatting for Satellite Imagery Figure 1
2026-06-30cs.CV

SatSplat: Geometrically-Accurate Gaussian Splatting for Satellite Imagery

Shuang Song, Jiyong Kim, Rongjun Qin

The Ohio State University, The project page is available at https://gdaosu., commonly available in satellite imaging. We evaluate the

2026-06-30视觉感知三维

SatSplat针对多时相高分辨率卫星影像中光照变化、阴影和初始相机误差导致3DGS几何不稳的问题,将2D Gaussian Splatting改写到仿射卫星相机下,并联合在线相机校正、几何阴影映射、逐相机颜色校正和DSM感知初始化。文中在DFC2019与IARPA2016评测中报告其几何精度优于既有3DGS基线,在处理后的DFC2019上MAE降低11.93%、峰值显存降低31%。

Digitizing Coaching Intelligence: An Agentic Framework for Holistic Athlete Profiling using VLM and RAG Figure 1
2026-06-30cs.CV

Digitizing Coaching Intelligence: An Agentic Framework for Holistic Athlete Profiling using VLM and RAG

Deep Ghosal, Ishani Sen, Wazib Ansar, Amlan Chakrabarti

A.K. Choudhury School of Information Technology, University of Calcutta, inherently subjective and unscalable, or basic computer vision (CV) systems limited to quantitative, tracking and actionable coaching insights, offering a scalable, objective solution for national talent, identification and performance assessment faces a critical bottleneck: scalability versus depth. Organizations such, approach is inherently subjective, labor-intensive, and prone to “observer fatigue,” leading to inconsistencies where, effectively democratizing elite-level sports analytics for scalable, mass-population testing.

2026-06-30视觉语言

本文针对大规模运动员选拔中人工评估主观且难扩展、传统视觉系统只会计数的问题,提出由LangGraph编排的VLM+MediaPipe多智能体框架,将动作几何量化、疲劳/姿态退化等语义判断、LLM自校验与ChromaDB RAG检索结合。实验称3×3 Smart Grid将多模态视频处理开销降低超88%,并把原始生物力学记录转化为可自然语言查询的教练洞察,但具体精度增益与对比细节文中片段未充分说明。

KM-Speaker: Keypoint-Based Style Control for High-Quality Speech-Driven 3D Facial Animation and Dialogue Localization Figure 1
2026-06-30cs.CV

KM-Speaker: Keypoint-Based Style Control for High-Quality Speech-Driven 3D Facial Animation and Dialogue Localization

Arthur Josi, Emeline Got, Abdallah Dib, Luiz Gustavo Hafemann, Rafael M. O. Cruz

2026-06-30规划控制三维

面向影视和游戏中语音驱动三维面部动画难以同时保证真实感与可控性的问题,KM-Speaker用参考表演的稀疏关键点提供全局风格和逐帧上半脸时序控制,并通过流模型、唇部音频驱动/上脸关键点驱动解耦及模态 dropout 保持整脸一致性。实验和用户研究显示,其在高质量小数据设定下优于现有方法,提升唇同步、风格贴合和配音式对白本地化效果。

DataComp-VLM: Improved Open Datasets for Vision-Language Models Figure 1
2026-06-30cs.CV

DataComp-VLM: Improved Open Datasets for Vision-Language Models

Matteo Farina, Vishaal Udandarao, Thao Nguyen, Selim Kuzucu, Maximilian Böther, Andreas Hochlehnert, Adhiraj Ghosh, Marianna Nezhurina, Karsten Roth, Joschka Struber, Yuhui Zhang, Sebastian Dziadzio, Elaine Sui, Soumya Jahagirdar, Dhruba Ghosh, Hasan Hammoud, Thomas De Min, Simone Caldarella, Jehanzeb Mirza, Sedrick Keh, Mehdi Cherti, Hilde Kuehne, Bernt Schiele, Serena Yeung-Levy, Muhammad Ferjad Naeem, Federico Tombari, Ana Klimovic, Elisa Ricci, Matthias Bethge, Sewoong Oh, Ameya Prabhu, Alessio Tonioni, Jenia Jitsev, Massimiliano Mancini, Ludwig Schmidt, Nikhil Parthasarathy

2026-06-30视觉语言视觉感知数据集/基准

这篇论文针对自回归视觉语言模型训练中数据配方不可复现、难以公平比较的问题,提出 DCVLM:汇集160个开放数据源、6T多模态 token,并固定模型与训练流程来评估过滤、混合、采样等策略。核心洞察是,在已被上游清洗的数据池中,继续质量过滤收益有限,数据类型配比尤其指令数据占比更关键。其 DCVLM-Baseline 在8B模型、200B token下达到63.6%,较 FineVision 提高5.4个百分点。

MammoFlow: Multiview Mammogram Synthesis with Anatomically Consistent Flow Matching Figure 1
2026-06-30cs.CV

MammoFlow: Multiview Mammogram Synthesis with Anatomically Consistent Flow Matching

Yuexi Du, Leya Barrientos, Laura Sheiman, John Lewin, Hemant D. Tagare, Nicha C. Dvornek

Department of Biomedical Engineering, Yale University, Department of Radiology & Biomedical Imaging, Yale University

2026-06-30生成模型

针对乳腺钼靶双视图数据稀缺且类别不均衡、单视图生成难以保持临床所需跨视图一致性的问题,MammoFlow将CC/MLO来自同一3D乳腺体积的AP轴组织分布守恒作为约束,在预训练flow matching模型中加入仿射对齐搜索和基于EMD的像素级自一致损失。结果显示其生成质量和放射科评估优于对比方法,并使下游分类AUC提升约5%,但2D仿射近似复杂3D压迫仍是限制。

The Speedup Paradox: Rethinking Inference Speed-Quality Trade-off in Embodied Tasks Figure 1
2026-06-30cs.RO

The Speedup Paradox: Rethinking Inference Speed-Quality Trade-off in Embodied Tasks

Yujin Wang, Junli Chen, Yixuan Li, Shunan Dong, Huazhong Yang, Yongpan Liu, Hongyang Jia

Tsinghua University

2026-06-30视觉感知

本文针对具身模型推理优化常只看单步延迟、忽略闭环执行的问题,提出 TISED 框架,把有损轻量化对每步耗时、rollout 步数、动作滞后和硬件算力的影响分解分析。结果显示,静态任务中单步更快反而可能拉长总完成时间,动态任务中适度降质因观测更新更及时可提升成功率,且最佳轻量化强度会随部署硬件漂移。

Detecting Clinical Hallucinations in LVLMs via Counterfactual Visual Grounding Uncertainty Figure 1
2026-06-30cs.CV

Detecting Clinical Hallucinations in LVLMs via Counterfactual Visual Grounding Uncertainty

Xiao Song, Haonan Qin, Zhaoxu Zhang, Jiong Zhang, Yuqi Fang, Caifeng Shan

School of Intelligent Science and Technology, Nanjing University, Suzhou, China, National Institute of Healthcare Data Science at Nanjing University, Nanjing, University, Nanjing, China, School of Biomedical Engineering, Nanjing University, Suzhou, China, cross-model transferability. Code and dataset are available at https:

2026-06-30视觉语言安全鲁棒

临床 LVLM 容易生成影像中无依据的病灶、部位或属性,且黑盒模型难用内部不确定性审计。本文将幻觉检测转化为视觉证据对齐:抽取回答实体,用医学适配的 Qwen-VL 定位,并构造反事实实体,通过事实/反事实框的置信度与重叠估计不确定性。多模态医学影像和多 LVLM 实验显示,该方法优于近期基线,同时给出可解释定位证据和较好的跨模型迁移性。

CLEAR-MoE: Shared-Basis Expert Extraction from Frozen Vision Transformers via Calibration-Driven Layer Selection Figure 1
2026-06-30cs.CV

CLEAR-MoE: Shared-Basis Expert Extraction from Frozen Vision Transformers via Calibration-Driven Layer Selection

Md Irtiza Hossain, Humaira Ayesha, Junaid Ahmed Sifat

Brac University, by cluster labels, are made about data-center GPUs, distributed setups, or larger, gradient access and sufficient unlabelled data., lightweight routers are fitted on k-means labels

2026-06-30视觉感知

这篇论文针对已有预训练 ViT 难以低成本改造成视觉 MoE 的问题,提出 CLEAR-MoE:用校准数据按稀疏性、可聚类性和敏感度选择 FFN 层,再以共享 SVD 基底加残差专家替换部分层。核心洞察是保精度主要来自共享基底而非路由质量;在 Imagenette 多个 DeiT/ViT 上精度几乎不降,但 GTX 960 上因路由与搬运开销反而慢 1.3–1.7 倍。

Anatomy-Grounded Synthetic Coronary Angiography for Geometry-Informed Multi-View Matching Figure 1
2026-06-30eess.IV

Anatomy-Grounded Synthetic Coronary Angiography for Geometry-Informed Multi-View Matching

In Kyu Lee, Sumin Seo, Jaesik Min

Medipixel, Inc., Seoul, Republic of Korea, University of California San Diego, La Jolla, USA, erates dense, highly accurate 3D-to-2D projection labels by simulating, provides 2D correspondence labels with paired images, allowing human-, ⋆Equal contribution. † Work performed while affiliated with Medipixel, Inc., annotation, which is expensive and yields only sparse labeling. Moreover, due to, labels, entirely eliminating the need for manual annotation., grounded CT-derived DRR dataset with dense 3D-2D correspondence labels

2026-06-30视觉感知

这篇论文针对冠脉造影多视角匹配缺少可规模化真值、影响3D重建与介入导航的问题,提出从患者CCTA生成解剖一致的DRR,并自动给出密集3D-2D对应标签;在此基础上设计GIMM,将C臂视角先验用于粗匹配、极线约束用于细匹配。实验在自建CT衍生基准上以2D/3D误差评估,显示优于多种深度匹配基线,但真实临床数据仍缺少严格定量验证。

DeVAR: Low-Dose CT Denoising via Visual Autoregressive Modeling Figure 1
2026-06-30eess.IV

DeVAR: Low-Dose CT Denoising via Visual Autoregressive Modeling

Xizhuo Zhang, Yannian Gu, Zhongzhen Huang, Shaoting Zhang, Xiaofan Zhang

Shanghai Jiao Tong University, China, Shanghai Innovation Institute, China, and scalability. Inspired by the success of next-scale prediction, we explore the

2026-06-30视觉感知

针对低剂量 CT 在降辐射同时易产生噪声、伪影且细微解剖结构难以保留的问题,DeVAR 将视觉自回归的逐尺度生成引入去噪:用 LDCT 前缀 token 提供全局上下文,预测 NDCT 离散 token,并以残差细化器和双潜变量混合训练弥补量化损失。两套公开数据集结果显示其在 PSNR、SSIM、RMSE 和视觉细节上优于多类现有方法,消融也支持残差细化与混合解码的贡献。

Establishing the Minimal Clinically Important Difference (MCID) for Smartphone-Derived Gait Measures in Multiple Sclerosis Figure 1
2026-06-30q-bio.QM

Establishing the Minimal Clinically Important Difference (MCID) for Smartphone-Derived Gait Measures in Multiple Sclerosis

Mike D Rinderknecht, Bernhard Fehlmann, Dimitar Stanev, Cedric Simillion, Ernst Bos, Letizia Leocani, Agne Kazlauskaite, Gary Cutter, Helmut Butzkueven, Licinio Craveiro

a F.Hoffmann-La Roche Ltd., Basel, Switzerland, b Faculty of Medicine, University Vita-Salute San Raffaele, Milan, Italy, c Scientific Institute IRCCS San Raffaele, Milan, Italy, d Department of Biostatistics, University of Alabama at Birmingham, Birmingham, AL, USA, e Department of Neuroscience, School for Translational Medicine, Monash University, f Department of Neurology, Alfred Health, Melbourne, Australia, mean [SD] EDSS: 4.8 [1.4]) had digital gait data available at baseline and Week 96.

2026-06-30视觉感知

多发性硬化患者的远程步态监测要区分日常波动与真实进展,关键缺口是手机步态指标缺少临床可解释阈值。本文利用 CONSONANCE 研究中 243 名进展型 MS 患者的每日手机 2 分钟步行测试,并以 T25FW、EDSS、步行量表等为锚点估计 MCID。结果给出步速下降 0.16 m/s、步长下降 0.07 m、总步数减少 28、步行距离减少 24 m 等阈值,为数字步态终点进入临床试验和随访提供了可操作标尺。

Measured-Subspace Consistency: A Plug-and-Play Operator for Diffusion Posterior Sampling in Accelerated MRI Reconstruction Figure 1
2026-06-30eess.IV

Measured-Subspace Consistency: A Plug-and-Play Operator for Diffusion Posterior Sampling in Accelerated MRI Reconstruction

Junhyeok Lee, Kyu Sung Choi

Interdisciplinary Program in Cancer Biology, Seoul National University College of Medicine, Department of Radiology, Seoul National University College of Medicine, Seoul National University Hospital, Healthcare AI Research Institute, Seoul National University Hospital

2026-06-30生成模型三维

本文关注加速 MRI 扩散后验采样中的“已测子空间泄漏”:模型虽能重建好图像,却在扫描仪已采集的 k-space 系数上产生不应有的不确定性。作者提出 MSD/USD 指标诊断该问题,并用无需训练的 MSC 末端一致性锁将样本差异限制到未测子空间。六种采样器、脑/膝数据及跨解剖实验显示,MSC 对 Soft 采样器显著降低已测子空间离散度,DPS 中位降幅 16.5 倍且最高约 29 倍,同时基本保持未测多样性与 PSNR/SSIM。

A Zero-Shot Deep Image Prior Framework for Denoising and Deconvolution in Fluorescence Microscopy Figure 1
2026-06-30eess.IV

A Zero-Shot Deep Image Prior Framework for Denoising and Deconvolution in Fluorescence Microscopy

Xiangyu Qian, Jing Liu, Yunqing Tang, Luru Dai, Qiushi Li

Wenzhou Key Laboratory of Biomedical Imaging, Zhejiang Key Laboratory of Soft Matter Biomedical, Materials, Wenzhou Institute, University of Chinese Academy of Sciences, Wenzhou, Zhejiang 325000, China, Postgraduate Training Base Alliance of Wenzhou Medical University, Wenzhou, Zhejiang 325035, China, To mitigate the reliance on clean ground-truth data, increasing attention has been devoted to label-free image restoration, microscopy, where clean references are often unavailable. However, directly applying DIP remains challenging because the, SRDTrans [27], ZS-DeconvNet [16], SN2N [17], and FAST [28] further demonstrate the potential of label-free denoising.

2026-06-30视觉感知

针对荧光显微图像常同时受低光子噪声与PSF模糊影响、而监督复原又难获得配对真值的问题,论文提出零样本分阶段DIP框架SDIP:先用aSeqDIP去噪,再做小波背景校正,并以Richardson–Lucy结果作为物理引导约束稳定DIP反卷积。BioSR多结构实验显示其在多数细胞结构上提升SNR、分辨率和PSNR/SSIM,伪影少于RL和稀疏反卷积,但紧凑结构上稀疏先验仍有优势。

JuZhou 1.0 Technical Report: The First Edge-Native Text-to-Image Foundation Model Trained Entirely on China-Developed AI Accelerators Figure 1
2026-06-30cs.CV

JuZhou 1.0 Technical Report: The First Edge-Native Text-to-Image Foundation Model Trained Entirely on China-Developed AI Accelerators

Ce Chen, Congrui Wang, Yonglin Li, Zhenchen Wan, Mingyang Geng, Junhao Xiao, Zhengpeng Xing, Yaqing Hu, Yao Wu, Zhaoyang Qu, Long Lan, Xinwang Liu, Yingqi Peng, Shijia Li, Zufeng Zhang, Chen Ma, Jingjing Zhou, Xingyu Wang, Qilin Lu, Bin Jiang, Qilin Sun, Shanzhi Gu, Yaoguang Jin, Tongliang Liu, Kede Ma, Yifan Peng

2026-06-30视觉感知

针对文本到图像模型依赖云端算力、难以在移动端离线部署且中文语义支持不足的问题,JuZhou 1.0 采用约0.387B参数轻量生成骨干、Rectified Flow与DMD2蒸馏,将推理压缩到4步,并用900万中文图文对齐数据及曙光K100完成训练。结果显示其28步基座GenEval达0.69,4步分支在手机约1.6秒运行,证明小模型可兼顾中文生成、隐私和端侧效率。

MedDiffuseMix: Preserving Diagnostic Evidence with Saliency-Aware Diffusion Medical Image Data Augmentatio Figure 1
2026-06-30cs.CV

MedDiffuseMix: Preserving Diagnostic Evidence with Saliency-Aware Diffusion Medical Image Data Augmentatio

Teerath Kumar, Raja Vavekanand, Muhammad Turab

School of Computing, Atlantic Technological University, Letterkenny, Ireland., Department of Information Technology, Benazir Bhutto Shaheed University Lyari, School of Computing, Dublin City University, Dublin, Ireland., Limited data availability, class imbalance, and domain variability remain major barriers to reliable, introduce label-inconsistent content. This paper proposes MedDiffuseMix, a saliency-guided diffusion, labelled data collection is constrained by patient, to label-relevant evidence., to address limited labelled data and class imbal-, are usually label-agnostic and anatomy-agnostic., isation by combining images, features, or labels

2026-06-30视觉感知生成模型

这篇论文针对医学影像小样本、类别不平衡下常规增强易破坏病灶证据、生成增强又可能引入标签不一致的问题,提出 MedDiffuseMix:用分类器显著图保护高诊断区域,只在低显著背景中做扩散混合,并用自适应强度、边界平滑和注意力保持约束过滤不可靠样本。在四个放射与病理数据集上,相比 Mixup、SaliencyMix、GenMix 和扩散增强基线提升 accuracy、F1 与 AUROC,消融显示收益主要来自显著性引导和保持约束。

DiffRGD: An Inference-Time Diffusion Guidance Through Riemannian Gradient Descent Figure 1
2026-06-30cs.CV

DiffRGD: An Inference-Time Diffusion Guidance Through Riemannian Gradient Descent

Jia-Wei Liao, Li-Xuan Peng, Mei-Heng Yueh, Min Sun, Cheng-Fu Chou, Jun-Cheng Chen

National Taiwan University, National Tsing Hua University, National Taiwan Normal University, Research Center for Information Technology Innovation, Academia Sinica

2026-06-30生成模型优化算法

本文针对推理时扩散引导中外部梯度容易破坏逐步高斯潜变量分布、导致样本质量下降的问题,提出 DiffRGD。核心洞察是利用 DDIM 每步潜变量的各向同性高斯结构,通过极分解构造分布诱导的球面流形约束,并用黎曼梯度下降求解每步受限优化。实验显示其在图像修复和条件生成任务中多数指标优于 DPS、MPGD 等方法,同时保持免训练、可插拔特性。

AEGIS: A Semantic GAN and Evidential Learning Frameworkfor Robust Adversarial Detection in Vision Sensors Figure 1
2026-06-30cs.CV

AEGIS: A Semantic GAN and Evidential Learning Frameworkfor Robust Adversarial Detection in Vision Sensors

Maher Boughdiri, Mounira Msahli, Albert Bifet

2026-06-30视觉感知生成模型安全鲁棒

面向视觉传感器中对抗样本会导致安全关键识别失误的问题,AEGIS将语义一致性筛查、测试时增强下的预测/特征不稳定性度量,与基于Dirichlet证据学习的不确定性估计串联,用于覆盖像素扰动、补丁、功能和几何攻击。在Tiny ImageNet六类场景中取得AUROC 92.1%、AUPRC 90.2%、准确率90.7%,优于softmax检测器,但泛化到更真实机器人闭环场景仍需验证。

RSGPNet: Geometric Prompting for Remote Sensing Open-Vocabulary Semantic Segmentation Figure 1
2026-06-30cs.CV

RSGPNet: Geometric Prompting for Remote Sensing Open-Vocabulary Semantic Segmentation

Shanwen Wang, Xin Sun, Sirui Wang, Xiao Xiang Zhu

sion task that assigns a semantic label to every pixel in, - International Collaborative Research, Macao SAR (0001/2025/AIJ), Science, Observation, Technical University of Munich (TUM), Germany and also with, the Munich Center for Machine Learning, Munich, Germany., beyond the closed set of training labels [7]–[11]. OVSS mod-

2026-06-30视觉感知

RSGPNet针对遥感开放词汇语义分割中CLIP类方法局部边界不稳、细粒度区域难以对齐的问题,提出免训练的几何提示流程:先由文本生成粗掩码,再把高置信区域转为框提示重新分割,并用粗到细一致性校验抑制错误提示扩散。实验称其在多个遥感数据集上优于OVRS、RSCLIP、SegEarth-OV等方法,尤其改善复杂边界和局部区域分割。

Can AI Draw Science? A Benchmark for Evaluating Scientific Figure Generation by Text-to-Image and Multimodal Models Figure 1
2026-06-30cs.LG

Can AI Draw Science? A Benchmark for Evaluating Scientific Figure Generation by Text-to-Image and Multimodal Models

Davie Chen

2026-06-30视觉语言视觉感知数据集/基准

这篇论文针对通用文生图基准难以衡量科学图可用性的问题,提出 SciDraw-Bench:以任务规格而非参考图评测标签、实体关系、结构与学科绘图惯例。试验显示,领域专用 SciDraw AI 在各图型和维度上优于通用文生图模型,优势主要在语义正确性和惯例遵循;但文字保真仍是所有系统的短板,人工验证仍未完成。

Enhancing Layer Interaction Using Key-Correlated Layer Attention Figure 1
2026-06-30cs.CV

Enhancing Layer Interaction Using Key-Correlated Layer Attention

Jianlong Xiong, ChuanBo Xie, Le Yu, Quansong He, Tao He

The code is publicly available at: https://github.com/bgx666/, the College of Computer Science, Sichuan University, Chengdu, 610065, China. ChuanBo Xie is also with the Department of Ultrasound, Zigong

2026-06-30视觉感知

这篇论文针对层注意力在深层网络中计算随深度二次增长、需缓存历史层且现有 RLA/线性化方法要么更新静态、要么削弱远程跨层依赖的问题,提出 Key-Correlated Layer Attention。核心洞察是不同层的 Key 表征方向高度相关,据此线性近似 Key 并设计 softmax 近似,使其在固定空间和线性复杂度下保持动态更新。实验覆盖图像分类、目标检测和医学分割,显示 KCLA 在精度、显存和计算量之间取得更优折中。

DCSNet: Multiscale Feature Aggregation for Small Medical Object Segmentation with Detection-guided Hierarchical Cropping Figure 1
2026-06-30cs.CV

DCSNet: Multiscale Feature Aggregation for Small Medical Object Segmentation with Detection-guided Hierarchical Cropping

Shanfeng Zhang, Bo Gou, Yue Cao, Lei Zhang, Zhang Yi, Tao He

aCollege of Computer Science, Sichuan University, 610065, Chengdu, China, bSchool of Artificial Intelligence, Sichuan University, 610065, Chengdu, China, cThe First Affiliated Hospital of Chengdu Medical College, School of Clinical Medicine, Chengdu Medical, College, 610065, Chengdu, China

2026-06-30视觉感知

这篇论文针对医学图像中小目标占比低、边界模糊导致全局分割模型漏检和轮廓退化的问题,提出 DCSNet:先用检测引导的层级裁剪把任务收缩到目标区域,再在裁剪特征内做多尺度聚合与像素自适应融合,以兼顾语义上下文和细边界。文中称其在三个医学数据集上优于现有方法,尤其提升边界精度。

Vision-driven Preference Synthesis for Mitigating Hallucinations in VLMs Figure 1
2026-06-30cs.CV

Vision-driven Preference Synthesis for Mitigating Hallucinations in VLMs

Yunhun Nam, Jongheon Jeong

Korea University, of our framework in enhancing the model’s visual capabilities. Code is available at

2026-06-30视觉语言视觉感知

这篇论文针对 VLM 在图像描述中受语言先验驱动而产生幻觉的问题,指出偏好对构造同时存在偏离策略分布和视觉信息利用不足两类缺陷。作者提出 ViPSy:先用自生成描述合成语义相近图像并提取反复出现的对象级视觉线索,再用该线索条件化模型自身 rollout 构造 DPO 偏好对。实验显示其在 AMBER、Object HalBench 上较前 SOTA 分别降低幻觉率 35.7% 和 24.5%,并提升 MMStar、MMVP、CV-Bench 及视觉编码器探测结果。

Meta-learning as a principle for human-like visual representations Figure 1
2026-06-30cs.CV

Meta-learning as a principle for human-like visual representations

Can Demircan, Marcel Binz, Alireza Modirshanechi, Eric Schulz

Max Planck Institute for Biological Cybernetics, T¨ubingen, Germany

2026-06-30视觉感知

这篇论文试图解释为何人类视觉表征能灵活服务于新任务,而不只是追求固定目标。作者用 SAE 从预训练模型中生成高层语义任务,并让因果 Transformer 在少样本情境中元学习这些任务,从而线性重塑冻结视觉特征。结果显示,元学习表征比原始编码器更能预测人类相似性判断、语义规则学习和高级视觉皮层反应,且行为增益依赖解耦的高层概念任务,说明“学会快速学习新语义关系”本身可能是人类式视觉表征的重要组织压力。

Semantic-Aware Generative Image Transmission for Resource-Constrained Visual IoT Systems Figure 1
2026-06-30cs.CV

Semantic-Aware Generative Image Transmission for Resource-Constrained Visual IoT Systems

Chenyang Zhang, Changwang Liu, Jinqi Zhu, Jiayi Chang, Yuxuan Wang, Shuqing He, Jia Guo

C. Zhang, C. Liu, J. Zhu J. Chang, Y. Wang and J. Guo,are with the School, of Computer and Information Engineering, Tianjin Normal University, Tian-, S. He is School of Information Science and Engineering, Linyi University, available

2026-06-30视觉感知生成模型

面向带宽和能耗受限的视觉 IoT,论文关注如何只上传对感知任务关键的图像证据,而非完整压缩图像。其核心做法是在 VQ token 网格上融合可恢复性、局部结构复杂度与实例语义重要性,选择少量关键 token 发送,并由 MaskGIT 在边缘端补全。实验显示该方法在 Kodak、VisDrone 及 AWGN/Rayleigh 信道下提供更低码率的质量折中,0.074 bpp 时仅用 DeepJSCC/WITT 约 44.6% 比特仍达 29.9 dB,且较随机掩码更保留检测相关目标。

CLOSER-VLN: Closed-Loop Self-Verified Retrieval-Augmented Reasoning for Aerial Vision-Language Navigation Figure 1
2026-06-30cs.CV

CLOSER-VLN: Closed-Loop Self-Verified Retrieval-Augmented Reasoning for Aerial Vision-Language Navigation

Shaoxuan Li, Xiangyu Dong, Xiaoguang Ma, Junfeng Chen, Haoran Zhao, Yaoming Zhou

actions based on available information, a multidimensional action, School, University, Northeastern University, Shenyang 110819, China., Shaoxuan Li and Xiaoguang Ma are also with the College of Information, Science and Engineering, Northeastern University, Shenyang 110819, China., Haoran Zhao and Yaoming Zhou are with the School of Aeronautic, Science and Engineering, Beihang University, Beijing 100191, China (e-mail:, expand the context available to the model, but it cannot directly, components work collaboratively, allowing the system to

2026-06-30机器人视觉语言视觉感知

这篇论文针对空中视觉语言导航中大模型“先预测再执行”的开环脆弱性:单步小错会在长航程中放大并导致目标丢失。核心思路是在执行前加入闭环自验证,先由层级推理器生成动作,再用多维验证器检查指令、视觉与路径一致性,失败时才触发多模态检索并修正动作。CityNav 测试未见场景上达到 32.01% SR、21.28% SPL,说明预执行纠错对可靠性有实际帮助。

RadarTwin: Scene-Specific mmWave Radar Simulation and Learning for Mobile Indoor Perception Figure 1
2026-06-30cs.CV

RadarTwin: Scene-Specific mmWave Radar Simulation and Learning for Mobile Indoor Perception

Emily Bejerano, Federico Tondolo, Devang Gupta, Aaron Mano Cherian, Taeyoo Kim, Ayaan Qayyum, Xiaofan Yu, Xiaofan Jiang

Columbia University, University of California, Merced, no real radar labels, and a few labeled examples raise this to 95.3%, and collecting labeled radar data for every new space, object set, CAD scenes and material labels, synthesize scenes without corre-, face materials. These material labels are mapped to electromagnetic, recognizes real objects with no real radar labels, and a few labeled

2026-06-30视觉感知

室内毫米波雷达感知受真实标注数据稀缺、场景多径和材质差异影响,跨环境泛化困难。RadarTwin的核心思路是把手机/机器人等获得的3D场景重建转成雷达数字孪生:用视觉语言模型推断表面材质并映射电磁属性,再用多次反射射线追踪合成原始FMCW雷达数据。实验证明仿真能保留形状与材质判别特征,多径建模是缩小 sim-to-real gap 的关键;仅用仿真训练已达机会水平2.5倍,少量真实标签可将12类识别提升到95.3%。

JASPR: Joint Spatial Representation learning of histology and spatial genomics for improved virtual genomic screening and clinical prognostication Figure 1
2026-06-30cs.CV

JASPR: Joint Spatial Representation learning of histology and spatial genomics for improved virtual genomic screening and clinical prognostication

Marija Pizurica, Eric Zimmermann, Neil Tenenholtz, James Hall, Olivier Gevaert, Ava P. Amini, Lorin Crawford, Kristen A. Severson

Stanford University, CA, United States, flows has transformed these images into a scalable data, structure and is readily available, while the latter resolves, labels, data may be available at either bulk or spatial res-, approaches are limited by irreducible label noise due to the

2026-06-30视觉感知

这篇论文针对病理 HE 图像易得但空间转录组昂贵、现有方法又常忽略组织与基因表达的空间依赖这一问题,提出 JASPR:用 MAE 式跨模态重建在 HE 与 ST 网格上联合预训练,共享注意力捕捉通用空间结构,并用模态专家保留形态和基因特异信息。作者在乳腺癌数据上验证,其表示能提升基于 HE 的 9,248 个基因空间表达预测,并对临床预后任务有额外价值。

GPU-Accelerated Inverse Structural Anastylosis from Block Collapse Dynamics Figure 1
2026-06-30cs.CV

GPU-Accelerated Inverse Structural Anastylosis from Block Collapse Dynamics

L.A. Muñoz

Computational Robotics Lab, School of Engineering and Sciences, ologist judgement and manual block-by-block correspondence, a process that is both labour-intensive, predicts block removal count, per-position removal probabilities, centre-of-mass imbalance, and Ziglar

2026-06-30视觉感知

本文瞄准倒塌文物石块复原中依赖人工经验、组合空间巨大的难题,用积木塔作为可控代理,将形态复原表述为从倒塌图像反推原始结构的逆问题。核心创新是把GPU刚体仿真、Ziglar摩擦/力矩阈值与注入摩擦条件的双流ResNet结合,联合预测移除数量、位置概率、质心失衡和力矩风险,并生成反向重建视频。实验覆盖450次仿真及三档摩擦,显示模型可学习与摩擦和稳定性相关的结构线索,但量化精度和相对基线增益文中未充分说明。

Transition-Aware best-of-N sampling for Longitudinal Chest X-ray Reports Figure 1
2026-06-30cs.CV

Transition-Aware best-of-N sampling for Longitudinal Chest X-ray Reports

Halil Ibrahim Gulluk, Max Van Puyvelde, Wim Van Criekinge, Olivier Gevaert

Department of Electrical Engineering, Stanford University, Stanford, CA, USA, Department of Biomedical Data Science, Stanford University School of Medicine, Department of Mathematical Modelling, Statistics & Bioinformatics, Ghent, University, Ghent, Belgium, publicly available chest X-ray dataset across several vision–language generators

2026-06-30视觉感知

这篇论文针对胸片报告生成常忽略随访语境的问题:真实放射科报告更关心相较上次检查的变化,而非单张图像的孤立描述。作者提出无需训练的 transition-aware best-of-N,在候选报告选择阶段把“既往→当前”报告转成句向量集合间的方向性转移向量,并与训练集中真实转移库匹配打分。实验覆盖三种生成器和三类提示,整体优于随机选择,增益在更强调变化的 Impression 部分最明显。

RADIANT-PET: Reasoning-Augmented PET/CT Lesion Segmentation with Large Language Models and Reinforcement Learning Figure 1
2026-06-30cs.CV

RADIANT-PET: Reasoning-Augmented PET/CT Lesion Segmentation with Large Language Models and Reinforcement Learning

Jiasheng Wang, Tanun Jitwatcharakomol, Piyawadee Jongpradubgiat, Simeng Zhu

Division of Hematology, The Ohio State University Comprehensive Cancer Center, Department of Radiology, Mahidol University, Bangkok, Thailand, Department of Radiology, Mettapracharak Hospital, Thailand, Department of Radiation Oncology, The Ohio State University Comprehensive, Cancer Center, Columbus, OH, USA, available at: https://github.com/jwang-580/RADIANT-PET.

2026-06-30视觉感知强化学习

PET/CT病灶分割常被生理摄取、炎症和伪影干扰,纯图像模型缺少临床判别推理。RADIANT-PET先用高敏阈值或HS-UNet生成候选,再把摄取强度、形态、器官关系和可选报告转成结构化文本,由LLM判别真假病灶,并用GRPO强化学习优化局部模型。AutoPET与OSU测试显示,其较nnUNet等基线提升DSC、PPV并降低MTV误差,报告条件下效果最好。

Few-class Fidelity: Evaluating Explanations of Real-conditions CNN classifiers with Optimized Perturbations Figure 1
2026-06-30cs.CV

Few-class Fidelity: Evaluating Explanations of Real-conditions CNN classifiers with Optimized Perturbations

Wistan Marchadour, Pedro Soto Vega, Franck Vermet, Mathieu Hatt

modalities and number of classes, and present the resulting rankings of a subset of currently available XAI methods.

2026-06-30视觉感知

本文针对真实少类别分类任务中 XAI 保真度评估易受 OoD 扰动和类别不确定性不足影响的问题,重新定义 Few-class Fidelity,并用优化扰动生成更贴近分布且能诱发模型不确定性的样本。实验覆盖 ImageNet 车辆与 CT 对比剂任务,显示不同领域、数据整理和解释方法会显著改变排序:ImageNet 中 EG 配合 SmoothGrad 表现较好,医学任务中 XRAI 或 GradCAM 更占优。

Automated Quality Assessment of Geospatial Vector Data: A GeoAI Approach using Spatial Representation Learning Figure 1
2026-06-30cs.CV

Automated Quality Assessment of Geospatial Vector Data: A GeoAI Approach using Spatial Representation Learning

Hao Li, Chen Chu, Filip Biljecki, Cyrus Shahabi, Wenwen Li

a Department of Geography, National University of Singapore, Singapore, bUniversity of, cDepartment of Architecture, National University of Singapore, dDepartment of Real Estate, National University of Singapore, Singapore, eSchool, of Geographical Sciences and Urban Planning, Arizona State University, USA, (SRL). Specifically, Topo4Vec relax the labor-intensive manual annotation process, from Topo4Vec shed a promising light into a scalable and autonomous GeoAI ap-, made openly available in https://figshare.com/s/612148eeb4bccadbd715.

2026-06-30视觉感知

面对大规模矢量地图中建筑重叠、道路悬挂等拓扑错误,传统规则方法难以适应不同城市形态且标注成本高。论文提出 Topo4Vec,用错误模拟替代大量人工标注,并以空间表征学习和对比学习直接编码原生线、面几何,在潜空间区分异常与正常结构。三城实验中,建筑重叠检测最高准确率达 0.99,但道路 overshoot/undershoot 仅约 0.60,说明方法对面状错误更稳健,跨形态泛化仍有限。

SoccerNet 2026 Player-Centric Ball Action Spotting: Per-Player Attention with Agreement-Based Ensembling Figure 1
2026-06-30cs.CV

SoccerNet 2026 Player-Centric Ball Action Spotting: Per-Player Attention with Agreement-Based Ensembling

Faisal Altawijri, Ismail Mathkour

cluster center, sorted by score descending. (3) For each cluster

2026-06-30视觉感知

该文面向 SoccerNet 球员中心的足球动作定位,动机是基线难以同时利用单个球员的时序演化、场上多人空间关系,并抑制事件误检。方法在 TAAD 中加入时间 Transformer,在 DST 编码器前引入先空间后时间的逐球员注意力,并用基于多模型一致性的事件融合,铲球类作单模型保留例外。结果显示验证 Macro-F1 从 0.541 提升到 0.609,挑战集达到 58.94。

Data Provenance for Image Auto-Regressive Generation Figure 1
2026-06-30cs.CV

Data Provenance for Image Auto-Regressive Generation

Bihe Zhao, Louis Kerner, Michel Meintz, Tameem Bakr, Franziska Boenisch, Adam Dziedzic

CISPA Helmholtz Center for Information Security, available at https://github.com/sprintml/DataProvenanceIAR.

2026-06-30视觉感知

针对自回归图像生成模型产物难以溯源、既有水印需预先嵌入且不适用于已发布无标记内容的问题,本文利用离散 token codebook 量化会留下模型特异伪迹这一洞察,提出后验溯源框架,结合 QuantLoss、逆解码器增强和 EncLoss 等信号判断图像是否由某个 IAR 生成。实验覆盖 VAR、RAR、LlamaGen、Infinity 等模型,报告在 1% FPR 下接近 100% TPR,并在常见后处理下优于基线。

Zero-Label Driving Scenario Complexity Detection via Joint Embedding Predictive Architecture Figure 1
2026-06-30cs.CV

Zero-Label Driving Scenario Complexity Detection via Joint Embedding Predictive Architecture

Santosh Jaiswal

Zero-Label Driving Scenario Complexity Detection, Identifying complex and safety-critical driving scenarios in large unlabelled datasets is an important, scenario. We ask whether a model can discover scenario complexity on its own, with no labels at any stage., access to any ground-truth labels during training or evaluation setup, the model assigns significantly, require labelled training data, which is expensive to collect and biased by the label taxonomy. Human, • We demonstrate that a JEPA model trained on structured driving agent data with no labels produces, labels.

2026-06-30视觉感知

这篇论文面向自动驾驶数据中复杂/安全关键场景难以无标注筛选的问题,提出用结构化智能体状态训练最小 JEPA 世界模型,并以未来潜表示预测误差作为零标签复杂度分数。其洞察是“模型意外”可近似人类驾驶难度;在 nuPlan mini 上,高分集中于无保护转弯、人行横道和行人接近,低分对应车道跟随/静止交通,异常检测 AP 为 0.512,高于 0.436 基线。

Memory-Augmented LSTM Autoencoder for Unsupervised Activity Recognition with IMU Sensor Fusion Figure 1
2026-06-30cs.CV

Memory-Augmented LSTM Autoencoder for Unsupervised Activity Recognition with IMU Sensor Fusion

Saeid Arabzadeh, Farshad Almasganj, Mohammad Mahdi Ahmadi

such as the reliance on large volumes of labeled data, the complexity of fusing information from multiple sensors, and the limited, are especially pronounced in real-world scenarios where sensor data is noisy, activities overlap, and precise labeling is often unavailable., (LSTM-AE), which incorporates historical motion patterns without requiring any activity labels., difficulty of labeling data, scarcity of data across diverse activities, and the high similarity between different movement patterns, 2 and 3 is with the Faculty of Biomedical Engineering, Amirkabir University of Technology (Tehran Polytechnic), Tehran, Iran, training. Their performance also depends on careful layer tuning and accurate labeling, which hinders generalization on real-world, of static features, and (2) updating those features using previously observed data, when available., address several key challenges: the scarcity of labeled data required for training deep supervised models, the need for effective

2026-06-30视觉感知

针对多传感器 IMU 活动识别依赖标注、短窗口下难以同时建模空间融合与时间依赖的问题,论文提出无监督的记忆增强自编码框架:先用堆叠自编码器做传感器内/间静态特征融合,再以序列到序列 LSTM-AE 引入历史运动模式。作者在 DaLiAc 与 PAMAP2 上报告 96.6% 和 98.4% 准确率,并称特征可分性提升最高 9%,但结果仍依赖后续分类评估,真实无监督部署收益需谨慎看待。

GeoISF: Instance Semantic Forest Inspired Large-Scale Cross-View Geo-Localization via Ground LiDAR-to-Satellite Image Figure 1
2026-06-30cs.CV

GeoISF: Instance Semantic Forest Inspired Large-Scale Cross-View Geo-Localization via Ground LiDAR-to-Satellite Image

Di Hu, Xia Yuan, Chunxia Zhao

open-source resource available online for the broader research, Di Hu, Xia Yuan, and Chunxia Zhao are with the School of Computer, Science and Engineering, Nanjing University of Science and Technology, This research was funded by NingXia Academy of Agriculture and, aligning it with structured semantic labels. It allows for a, the relationship among a set of words. With the available, relatedness information between each scene object’s label and, the corresponding 3D scene’s label. Furthermore, they also, textual labels derived from scene semantics within a single, The process commences by transforming the textual labels

2026-06-30视觉感知

GeoISF瞄准大范围卫星图中用地面激光雷达点云定位的难题,核心动机是现有LiDAR-to-image方法受跨模态差距和语义对齐不足限制。方法用WordNet构建实例语义森林,将多帧点云的几何实例语义与卫星图块文本描述作为共享中介,并通过语义蒸馏筛除不匹配区域。KITTI实验报告其R@10较并行LiDAR-to-image基线提升13.22倍,但具体增益来源仍需更多消融支撑。

UniCA: Bi-directional Cross-Attention with Positive Similarity Loss for Robust Multi-Modal Retrieval Figure 1
2026-06-30cs.IR

UniCA: Bi-directional Cross-Attention with Positive Similarity Loss for Robust Multi-Modal Retrieval

Yini Huang, Wenlong Zhang

The Hong Kong University of Science and Technology (Guangzhou), Guangdong, China, Southern Medical University, Guangdong, China, fewer labeled data, which in turn boosted the performance

2026-06-30安全鲁棒

这篇论文针对多模态检索中视觉与文本仅靠拼接后自注意力进行隐式融合、语义对齐不足的问题,提出 UniCA:在拼接前加入双向跨注意力促进图文 token 显式交互,并用 Positive Similarity Loss 拉近查询与正样本的绝对语义距离,同时构建 10% 轻量训练集 UMR-S10。WebQA 实验显示其在 Hybrid 与 Image-Text 任务上优于 VISTA 基线,Hybrid 的 Recall@5、Recall@10、MRR@1 最高分别提升 4.09%、3.28%、3.96%。

PIXELRAG: Web Screenshots Beat Text for Retrieval-Augmented Generation Figure 1
2026-06-30cs.IR

PIXELRAG: Web Screenshots Beat Text for Retrieval-Augmented Generation

Yichuan Wang, Zhifei Li, Zirui Wang, Paul Teiletche, Lesheng Jin, Matei Zaharia, Joseph E. Gonzalez, Sewon Min

Princeton University, Renmin University of China, code is available at https://github.com/StarTrail-org/PixelRAG., AP News, and BBC. While scalable data collection is non-trivial, we build a pipeline that first

2026-06-30视觉感知

本文针对网页 RAG 依赖 HTML 解析、线性化后丢失版式与表格等视觉结构的问题,提出直接以网页截图做检索和阅读的 PIXELRAG:渲染网页、建立视觉索引,并将截图块送入 VLM,避免文本抽取链路。其在 3000 万 Wikipedia 截图片上扩展,并在 NQ、SimpleQA、MMSearch、LiveVQA、MoNaCo 等任务上超过文本 RAG,最高提升 18.1%,低分辨率压缩还可约降 3 倍 token 成本。

MSA-UNet3+: Multi-Scale Attention UNet3+ with New Supervised Prototypical Contrastive Loss for Coronary DSA Image Segmentation Figure 1
2026-06-30eess.IV

MSA-UNet3+: Multi-Scale Attention UNet3+ with New Supervised Prototypical Contrastive Loss for Coronary DSA Image Segmentation

Rayan Merghani Ahmed, Adnan Iltaf, Mohamed Elmanna, Gang Zhao, Hongliang Li, Yue Du, Bin Li, Shoujun Zhou

aShenzhen Institutes of Advanced Technology (SIAT), Chinese Academy of Sciences (CAS), Shenzhen, 518055, China, bUniversity of Chinese Academy of Sciences (UCAS), Beijing, 101408, China, cDepartment of Biomedical Engineering and Systems, Faculty of Engineering, Cairo University, Cairo, 12613, Egypt, dThe Neurosurgery Department, General Hospital of Southern Theater Command, Guangzhou, 510000, China, eThe Department of Biomedical Engineering, Air Force Hospital of Southern Theater Command of PLA, SMAU-Net struggles with class imbalance and fine vessel segmentation. Zhang et al. [12] proposed a Centerline-, Supervision Multi-Task Learning Network, improving U-Net with a Channel Attention Skip module and a Centerline

2026-06-30视觉感知

面向冠脉 DSA 中细小血管低对比、背景结构复杂和前景/背景极不均衡导致的分割困难,论文提出 MSA-UNet3+,在 UNet3+ 中加入多尺度注意力编码器、空洞瓶颈和上下文注意力融合,并用监督原型对比损失约束编码特征,重点推开接近血管原型的难背景样本。私有冠脉 DSA 数据集上其 Dice、F1 最高且 ASD/ACD 更低,但泛化性受私有数据限制。

2026-06-29

105 篇
DexCompose: Reusing Dexterous Policies for Multi-Task Manipulation with a Single Hand Figure 1
2026-06-29cs.RO

DexCompose: Reusing Dexterous Policies for Multi-Task Manipulation with a Single Hand

Dihong Huang, Zhenyu Wei, Zhuxiu Xu, Yunchao Yao, Sikai Li, Mingyu Ding

University of North Carolina at Chapel Hill

2026-06-29机器人三维

这篇论文针对灵巧手多任务操作中“保持已有抓取”和“执行新交互”争用同一手指动作空间的问题,提出 DexCompose:先用释放测试识别维持第一技能所必需的手指,再通过显式手指动作归属和双残差模块组合两个冻结的单任务策略。其核心洞察是把空闲手指自由度视为可复用资源,从而减少策略串联中的破坏性干扰。在 16 个复合任务上,方法达到 77.4% 平均成功率,较直接串联和最强基线分别提升 74.3% 与 15.8%。

PerceptionRubrics: Calibrating Multimodal Evaluation to Human Perception Figure 1
2026-06-29cs.CV

PerceptionRubrics: Calibrating Multimodal Evaluation to Human Perception

Yana Wei, Hongbo Peng, Yanlin Lai, Liang Zhao, Kangheng Lin, En Yu, Keyu Lv, Han Zhou, Yin Tang, Haodong Li, Mitt Huang, Hangyu Guo, Jianjian Sun, Zheng Ge, Xiangyu Zhang, Daxin Jiang, Vishal M. Patel

2026-06-29视觉语言数据集/基准

针对多模态感知榜单高分但真实场景仍脆弱的问题,PerceptionRubrics将图像描述评测改造成原子化审计:用1038张高信息密度图像、循环互评生成的黄金描述和1.2万余条Must-Right/Easy-Wrong准则,并以门控评分惩罚关键事实错误。实验显示其更贴近人类偏好,揭示模型会通过零散事实检查却失败于组合约束,且开源前沿相对闭源仍有约8%感知差距。

StructSplat: Generalizable 3D Gaussian Splatting from Uncalibrated Sparse Views Figure 1
2026-06-29cs.CV

StructSplat: Generalizable 3D Gaussian Splatting from Uncalibrated Sparse Views

Jia-Chen Zhao, Beiqi Chen, Xinyang Chen, Guangcong Wang, Liqiang Nie

Harbin Institute of Technology (Shenzhen), Great Bay University, Guangzhou CloudButterfly Technology Co., Ltd., Code available in: https://github.com/J-C-Zhao/StructSplat

2026-06-29三维

StructSplat针对稀疏未标定视图中依赖SfM/逐场景优化、几何与外观耦合导致泛化和纹理质量受限的问题,提出前馈式3D Gaussian框架,将几何、语义和纹理分工建模,并用像素对齐特征注入提升细节、相机对齐避免目标视图信息泄漏。实验显示其在DL3DV达28.045 PSNR,较AnySplat高5.67 dB,跨数据集在ACID和RealEstate10K也分别提升1.94/1.72 dB。

Learning Topology-Aware Representations via Test-Time Adaptation for Anomaly Segmentation Figure 1
2026-06-29cs.CV

Learning Topology-Aware Representations via Test-Time Adaptation for Anomaly Segmentation

Ali Zia, Usman Ali, Abdul Rehman, Umer Ramzan, Kang Han, Muhammad Faheem, Shahnawaz Qureshi, Wei Xiang

for Artificial Intelligence Pak-Austria Fachhochschule Institute of Applied

2026-06-29视觉感知

针对异常分割在测试时分布偏移下依赖像素阈值、难保持缺陷连通结构的问题,论文提出 TopoTTA:从异常分数图构建 cubical complex,并用多级持久同调滤波生成拓扑伪标签,监督轻量测试时分类器而不更新骨干。实验覆盖 2D/3D 六个基准,报告平均 F1 提升约 15%,复杂几何或结构异常上收益更明显。

RSICCLLM: A Multimodal Large Language Model for Remote Sensing Image Change Captioning Figure 1
2026-06-29cs.CV

RSICCLLM: A Multimodal Large Language Model for Remote Sensing Image Change Captioning

Yelin Wang, Zijia Song, Shuo Ye, Chuanguang Yang, Miaoyu Wang, Yong Xu, Zhulin An, Yongjun Xu, Zitong Yu

2026-06-29视觉语言视觉感知

这篇论文针对遥感双时相图像变化描述中数据稀缺、传统小模型难以细粒度理解真实变化的问题,提出面向 RSICC 的大视觉语言模型后训练框架 RSICCLLM。其核心在于用变化掩码引导生成指令数据 RSICI,并通过差异感知 SFT 与双负样本偏好优化 DNPO 强化时序差异建模。实验称 7B 模型在多项指标上超过更大模型,但部分增益可能主要来自 data 与任务化后训练。

Exposure Bias Can Alleviate Itself via Directional and Frequency Rectification in Flow Matching Figure 1
2026-06-29cs.CV

Exposure Bias Can Alleviate Itself via Directional and Frequency Rectification in Flow Matching

Guanbo Huang, Jingjia Mao, Fanding Huang, Fengkai Liu, Xiangyang Luo, Yaoyuan Liang, Jiasheng Lu, Xiaoe Wang, Pei Liu, Ruiliu Fu, Ruqi Huang, Shao-Lun Huang

2026-06-29生成模型

论文针对 Flow Matching 训练时沿理想路径学习、推理时误差逐步累积导致的 exposure bias,提出将偏差本身作为自校正信号。DEFAR 通过单步推理模拟暴露漂移,用 ADR 学习把偏离状态拉回目标方向,并用 FC 借助偏差中的低频信息补偿高噪声阶段结构缺失。实验在 CIFAR-10、CelebA-64 与 ImageNet-256/512 上较 SiT、IP、SDSS/MDSS 等基线提升 FID/IS,并展示一定的尺度、架构和采样步数鲁棒性。

HAT-4D: Lifting Monocular Video for 4D Multi-Object Interactions via Human-Agent Collaboration Figure 1
2026-06-29cs.CV

HAT-4D: Lifting Monocular Video for 4D Multi-Object Interactions via Human-Agent Collaboration

Jiaxin Li, Yuxiang Wu, Zhenkai Zhang, Xinrui Shi, Haoyuan Wang, Yichen Zhao, Su Linxiang, Chenyang Yu, Mingyu Zhang, Yifan Ding, Boran Wen, Li Zhang, Ruiyang Liu, Yong-Lu Li

2026-06-29视觉感知

HAT-4D针对单目公开视频中多物体交互难以4D重建的问题,试图替代昂贵多相机采集并服务具身AI数据扩展。其核心是用VLM代理构建交互知识图,再结合多级人类反馈协调3D生成、空间组合与4D传播,以处理遮挡、深度歧义和长期一致性。论文同时提出MVOIK-4D基准;实验称多数物理合理性和时序一致性指标达到SOTA,少量人工反馈可提升重建,生成数据微调也能改善基线。

LLawCo: Learning Laws of Cooperation for Modeling Embodied Multi-Agent Behavior Figure 1
2026-06-29cs.LG

LLawCo: Learning Laws of Cooperation for Modeling Embodied Multi-Agent Behavior

Qinhong Zhou, Chuang Gan, Anoop Cherian

2026-06-29视觉感知

这篇论文针对部分可观测多智能体任务中,LLM 代理常与伙伴行为和环境状态不一致的问题,提出 LLawCo:从失败轨迹中归纳“合作法则”,再通过监督微调写入推理链,使策略更可解释、可控且可自我改进。作者还构建 PARTNR-Dialog 基准;在四种 LLM 上,相比开源通信式代理,成功率在 PARTNR-Dialog 平均提升 4.5%,在 TDW-MAT 提升 6.8%。

EchoSonar-R: A Multi-View Reasoning-Enabled Model for Disease Classification and Report Generation in Echocardiography Figure 1
2026-06-29cs.CV

EchoSonar-R: A Multi-View Reasoning-Enabled Model for Disease Classification and Report Generation in Echocardiography

Darya Taratynova, Ahmed Aly, Numan Saeed, Mohammad Yaqub

2026-06-29视觉感知

该文针对超声心动图需跨多个视角整合证据、现有模型缺少可解释诊断推理和直接生成报告的问题,提出 EchoSonar-R:将冻结的视频时空编码器与结构感知心脏检测器结合,把全局运动与解剖区域线索送入语言模型,并用 SFT 加 GRPO 同时优化多标签分类和报告生成。实验显示其在私有多视图数据集宏平衡准确率较最强基线提升 17.1%,在 MIMICEchoQA 提升 6.1%,报告临床一致性 GREEN 得分为 0.800。

Enhanced Neural Video Representation Compression across Extreme Complexity and Quality Scales Figure 1
2026-06-29eess.IV

Enhanced Neural Video Representation Compression across Extreme Complexity and Quality Scales

Ho Man Kwan, Tianhao Peng, Fan Zhang, Mike Nilsson, Andrew Gower, David Bull

2026-06-29视觉感知

针对现有神经视频编码难以同时保持低复杂度、宽码率可扩展性和高压缩效率的问题,论文提出 INR 编码器 NVRC++:用轻量网络结合多尺度高分辨率特征网格、分层式优化与多先验熵模型,把表示能力更多放到网格而非解码网络中。实验显示其在四档固定复杂度下覆盖宽质量范围,实时解码,相比 NVRC 最高快 7.6 倍且压缩性能相近或更优。

Toward Robust In-Context Segmentation via Concept Guidance Figure 1
2026-06-29cs.CV

Toward Robust In-Context Segmentation via Concept Guidance

Zhigang Chen, Xiawu Zheng, Rongrong Ji

Key Laboratory of Multimedia Trusted Perception and Efficient Computing, Ministry of Education of, China, Xiamen University, 361005, P.R. China, mainly focus on selecting the best prompt from an available pool of candidate references. However, such a

2026-06-29视觉感知安全鲁棒

本文针对 in-context segmentation 对参考样本高度敏感、同一查询在不同参考下结果波动大的问题,提出 CG-ICS:先用 MLLM 从参考图与掩码生成候选语义概念,再由 SAM3 打分并通过树搜索筛选可靠文本提示,同时引入查询侧视觉 exemplar 做空间定位。实验显示其在四个 ICS 基准和鲁棒评测中提升精度,并显著降低参考选择带来的方差,使训练-free 分割更稳定。

Monocular Avatar Reconstruction via Cascaded Diffusion Priors and UV-Space Differentiable Shading Figure 1
2026-06-29cs.CV

Monocular Avatar Reconstruction via Cascaded Diffusion Priors and UV-Space Differentiable Shading

Hong Li, Minqi Meng, Yanjun Liang, Chongjie Ye, Houyuan Chen, Weiqing Xiao, Xianda Guo, Guojun Lei, Xuhui Liu, Chaojie Yang, Yanlun Peng, Hao Zhao, Baochang Zhang

Beihang University, China 2 Great Wall Motors, China, Nanjing University, China, Wuhan University, China, Zhejiang University, China, AIR, Tsinghua University, China, lighting and collaboratively synthesize pixel-aligned PBR maps (Albedo

2026-06-29生成模型三维

这篇论文针对单张野外人脸难以重建可重光照高保真 PBR 头像的问题,核心思路是在 UV 空间用级联 LoRA 调用同一预训练扩散先验,依次完成纹理补全、去光照和材质分解,并用跨材质注意力与 UV 空间可微 BRDF 着色约束减少遮挡和烘焙光照伪影。实验称仅用少于 100 个真实 3D 扫描即可生成 4K 几何与多通道材质,重光照真实感和泛化优于现有方法。

Differentiable design of the PIAA-ZWFS: a flexible wavefront sensor that approaches the fundamental limit Figure 1
2026-06-29astro-ph.IM

Differentiable design of the PIAA-ZWFS: a flexible wavefront sensor that approaches the fundamental limit

A. K. Taras, S. Y. Haffert, L. Desdoigts

2026-06-29视觉感知

为让极端自适应光学在更暗目标或更高速闭环下接近光子噪声极限,论文提出 PIAA-ZWFS:用无损 PIAA 光瞳整形把星光集中到焦平面,并用可微仿真/Fisher 信息优化多级相位掩膜与透镜。仿真显示其在孔径、带宽、光子数和扩展星源变化下接近基本灵敏度极限,典型光子受限场景较传统 ZWFS 将差距缩小约 10 倍,且未牺牲动态范围。

Translation as a Bridging Action: Transferring Manipulation Skills from Humans to Robots Figure 1
2026-06-29cs.RO

Translation as a Bridging Action: Transferring Manipulation Skills from Humans to Robots

Sijin Chen, Kaixuan Jiang, Haixin Shi, Yanhui Wang, Weiheng Zhong, Haosheng Li, Bo Jiang, Yuxiao Liu, Xihui Liu

2026-06-29机器人

本文针对人类操作数据便宜但难以迁移到双臂夹爪机器人的问题,指出人手姿态噪声和接触方式差异使6DoF旋转信号不可靠,提出以头戴相机坐标下的相对腕部平移作为人机共享的桥接动作,并用交错动作token与注意力mask统一不同动作成分。实验显示,该表示比 noisy 6DoF 人类动作更能迁移到多种双臂任务,且随大规模人类预训练和少量机器人后训练提升,但对需要精细旋转的任务仍受限。

PhysisForcing: Physics Reinforced World Simulator for Robotic Manipulation Figure 1
2026-06-29cs.CV

PhysisForcing: Physics Reinforced World Simulator for Robotic Manipulation

Peiwen Zhang, Yufan Deng, Shangkun Sun, Juncheng Ma, Duomin Wang, Jonas Du, Zilin Pan, Ye Huang, Hao Liang, Songyan Huang, Ruihua Zhang, Enze Xie, Ming-Yu Liu, Daquan Zhou

Peking University

2026-06-29机器人强化学习

本文针对机器人视频世界模型在接触操作中常出现轨迹不连续、物体穿透和交互关系错误的问题,提出 PhysisForcing:先定位机械臂、物体、接触和运动区域,再用点轨迹约束 DiT 特征的局部运动,并用冻结视频理解编码器对齐区域间语义关系。实验显示其在 R-Bench、PAI-Bench、EZS-Bench 上提升物理合理性,并将 WorldArena 闭环成功率从 16.0% 提高到 24.0%。

Higher-Order Fourier Neural Operator: Explicit Mode Mixer for Nonlinear PDEs Figure 1
2026-06-29cs.CE

Higher-Order Fourier Neural Operator: Explicit Mode Mixer for Nonlinear PDEs

Alex Colagrande, Paul Caillon, Eva Feillet, Alexandre Allauzen

]. Since closed-form solutions are rarely available, these problems typically require numerical

2026-06-29视觉感知

这篇论文针对传统 FNO 在频域中主要对各傅里叶模态独立调制、难以显式表达非线性 PDE 中模态相互作用的问题,提出 Higher-Order Spectral Convolution,在保留傅里叶截断与 FFT 效率的同时进行 n 线性模态混合,并可扩展到球面等几何。实验显示 HO-FNO 在标准 PDE 基准上稳定优于其他谱神经算子,在高非线性任务如多项式强迫 Poisson 方程中收益更明显,单层模型可超过多层 FNO。

BiDeMem: Bidirectional Degradation Memory for Explainable Image Restoration Figure 1
2026-06-29cs.CV

BiDeMem: Bidirectional Degradation Memory for Explainable Image Restoration

Xinrui Wu, Lichen Huang

University of Electronic Science and Technology of China

2026-06-29视觉感知

针对图像复原中退化条件常只以 PSNR 间接验证、难判断是否真具语义先验的问题,BiDeMem 将退化记忆设计为可干预对象:由特征与输入统计检索 top-k 记忆槽,同一槽身份同时用于推理复原和训练期反向退化解释。基于 NAFNet 的多退化实验中,BiRank 达到 29.7529 dB/0.8865,并较校正头、稠密先验和全局先验控制高约 0.26–0.28 dB;错误先验敏感性也显著增强,说明收益不只是额外容量,但外部骨干泛化仍属文中限定范围。

Cross-view Multimodal Vision-Based Assessment Framework for Traditional Chinese Medicine Rehabilitation Training Figure 1
2026-06-29cs.CV

Cross-view Multimodal Vision-Based Assessment Framework for Traditional Chinese Medicine Rehabilitation Training

Francis Xiatian Zhang, Hao Yao, Shengxuan Chen, Hong Zhu, Hongxiao Jia, Sisi Zheng, Hubert P. H. Shum

National Clinical Research Center for Mental Disorders, National Center for Mental Disorders

2026-06-29视觉语言视觉感知

本文针对针灸、推拿等中医康复训练中手部遮挡严重、手—物交互细节难以由单视角骨架数据刻画的问题,提出CME-AQA框架,将视觉与姿态特征注意力融合,并用第一/第三人称双视角训练、单视角推理提升鲁棒性;同时构建两个61人双视角数据集。实验在针深、快速进针等评分上较强基线加权F1相对提升超过10%,定量指标误差也有所降低,并在CPR数据上显示一定迁移性。

OSOR: One-Step Diffusion Inpainting for Effect-Aware Object Removal Figure 1
2026-06-29cs.CV

OSOR: One-Step Diffusion Inpainting for Effect-Aware Object Removal

Qinming Zhou, Chenxi Sun, Deyang Kong, Junhao He, Xiangheng Tang, Peike Yu, Haotian Wu, Leilei Cao, Linfeng Zhang

Shanghai Jiao Tong University, Tsinghua University, Xidian University, Tongji University, University of Electronic Science and Technology of China

2026-06-29生成模型

OSOR针对真实物体移除中阴影/反射等非局部影响、用户掩码不准以及扩散模型推理慢的问题,将移除建模为单步潜空间修复;通过占用率引导判别器强化边界监督、轻量alpha head自动修正移除区域,并用SAVP筛选构建28万对CORNE数据。实验显示其在6个基准上感知质量优于多步扩散基线,推理加速约4到30倍。

Diffusion Model Attribution via Spectral Coupling of Denoiser Responses Figure 1
2026-06-29cs.CV

Diffusion Model Attribution via Spectral Coupling of Denoiser Responses

Pragati Shuddhodhan Meshram, Varun Chandrasekaran

Department of Electrical and Computer Engineering, University of Illinois Urbana-Champaign

2026-06-29生成模型

这篇论文针对生成图像溯源中仅看输出图像难区分相似扩散模型、共享自编码器时反演信号失效的问题,提出 SDS:用频率受控扰动探测去噪器在不同空间频带间的能量耦合,把去噪响应的谱几何作为模型指纹。该方法无需改模型、反演或优化,仅用前向传播;在 8 个扩散模型闭集归因上约 99.9% 准确率,跨域提示仍达 96.2%。

RPM-Distill: Physiology-guided Adaptive Cross-modal Distillation for Robust Remote Physiological Measurement Figure 1
2026-06-29cs.CV

RPM-Distill: Physiology-guided Adaptive Cross-modal Distillation for Robust Remote Physiological Measurement

Jiyao Wang, Qingyong Hu, Duoxun Tang, Xiao Yang, Kaishun Wu, Jiangbo Yu

2026-06-29安全鲁棒

本文针对视频式远程生理测量在光照、肤色和运动变化下不稳、而测试时部署雷达不现实的问题,提出只在训练阶段使用RF雷达教师的跨模态蒸馏。核心洞察是RGB与RF时域形态不同但频域共享生理节律,因此在频谱上约束主峰、背景噪声和形态锐度,并用元学习策略网络按样本选择蒸馏强度以减少负迁移。实验称在困难与跨数据集场景中较单模态基线MAE提升81%、相关性提升21%。

STAG: Spatio-temporal Evolving Structural Representation of Action Units for Micro-expression Recognition Figure 1
2026-06-29cs.CV

STAG: Spatio-temporal Evolving Structural Representation of Action Units for Micro-expression Recognition

Nandani Sharma, Varun Sharma, Dinesh Singh

2026-06-29视觉感知

本文针对微表情动作短暂、幅度弱且跨数据集泛化差的问题,提出 STAG 将光流筛选、ROI 图注意力、全序列 Transformer 与 AU 引导的动态连接结合,并用双向交叉注意力同步建模“哪里动”和“何时动”。在 CASME II、4DME、DFME、NaME、SAMM、SMIC-HS 等数据集上,作者报告其在准确性、鲁棒性、可解释性和计算效率上均优于对比方法。

TextDS: Parameter-Efficient Representation Alignment for Scene Text Detection under Distribution Shifts Figure 1
2026-06-29cs.CV

TextDS: Parameter-Efficient Representation Alignment for Scene Text Detection under Distribution Shifts

Boyuan Chen, Zichen Dang, Chuang Yang, Lap-pui Chau, Yi Wang

2026-06-29视觉感知

本文针对场景文字检测在跨域语言、拍摄场景变化以及雨雾、低照、过曝、低分辨率等退化下鲁棒性不足的问题,提出 TextDS:用 SAM2 与 DINOv3 双编码器替代大规模文字专用预训练,并通过 SWLoRA 动态逐步低秩适配和 CSF 共享子空间融合对齐特征。实验显示其仅需 4.9M 可训练参数,在多域与退化数据上保持有竞争力的检测性能。

ReScene: Structured Indoor Scene Reconstruction from Multi-View Captures Figure 1
2026-06-29cs.CV

ReScene: Structured Indoor Scene Reconstruction from Multi-View Captures

Haoran Xu, Lechao Zhang, Daoguo Dong, Yan Gao, Xin Tan

School of Computer Science and Technology, East China Normal University, Institute of Trustworthy Embodied AI, Fudan University

2026-06-29三维

ReScene面向具身智能中从随手拍室内多视角视频生成可仿真三维场景的瓶颈,指出关键不在单物体重建,而在跨视角关系融合与物理合理装配。其用HierView按语义一致性和3D覆盖度选视角,并将VLM关系、几何与房间先验融合成场景图。ScanNet实验显示CD降17%、LPIPS降26%,且比既有多视角方法最高快10倍,还可生成具身VQA数据提升开源VLM空间推理。

AirGroundBench: Probing Spatial Intelligence in Multimodal Large Models under Heterogeneous Multi-View Embodied Collaboration Figure 1
2026-06-29cs.CV

AirGroundBench: Probing Spatial Intelligence in Multimodal Large Models under Heterogeneous Multi-View Embodied Collaboration

Haotian Li, Yida Wang, Leyuan Wang, Jinshan Lai, Keyang Wang, Zonghao Guo, Qiang Ma, Liuyu Xiang, Jianwei Hu, Zhaofeng He

2026-06-29视觉语言

本文针对现有多模态大模型评测偏重单视角、难以衡量空地协作中几何一致性的问题,提出 AirGroundBench:用同步 UAV–UGV 双视角、跨视角身份与2D/3D度量标注,同时评测静态VQA和闭环导航。结果显示,双视角虽优于单视角,但13个模型在跨视角对齐、坐标变换推理和VLN中明显落后于人类,瓶颈主要在稳定的几何空间表征而非单纯视觉识别。

Mind the Gap: Quantifying the Domain Gap in Cross-Sensor Diffusion Super-Resolution Figure 1
2026-06-29cs.CV

Mind the Gap: Quantifying the Domain Gap in Cross-Sensor Diffusion Super-Resolution

Dawid Kopeć, Katarzyna Jabłońska, Wojciech Kozłowski, Maciej Zięba

2026-06-29生成模型

本文关注卫星超分中“合成退化训练、真实跨传感器测试”的落差:Sentinel-2 到 PlanetScope 并不存在天然配对,导致扩散SR在真实传感器差异下失效。论文构建时空几何对齐数据集,评测五类扩散模型,并提出基于Sentinel-2自监督特征的 LPIPS Sat。主要发现是合成训练模型在真实配对上显著退化,而直接用真实跨传感器数据训练也存在优化困难,说明当前方法需把超分辨率与域适应更明确地解耦。

MLVC: Multi-platform Learned Video Codec for Real-World Deployment Figure 1
2026-06-29eess.IV

MLVC: Multi-platform Learned Video Codec for Real-World Deployment

Tanel Pärnamaa, Martin Lumiste, Ardi Loot, Evgenii Indenbom, Andrei Znobishchev, Ando Saabas

2026-06-29视觉感知强化学习

这篇论文针对神经视频编码难以在真实异构设备部署的问题:跨平台数值差异会破坏熵解码,且算力成本高。MLVC的核心做法是在超先验中显式传输压缩后的尺度索引,以牺牲少量码率换取硬件一致性,并用门控记忆、ReGLU、长期参考恢复和感知训练补回效率。实验显示其在VCD视频会议基准上相对硬件HEVC取得超过70%的MOS BD-rate改进,并在Apple、Intel、Qualcomm NPU上实现约100 FPS编解码。

EMOSH: Expressive Motion and Shape Disentanglement for Human Animation Figure 1
2026-06-29cs.CV

EMOSH: Expressive Motion and Shape Disentanglement for Human Animation

Dongbin Zhang, Hao Liu, Binquan Dai, Kangjie Chen, Chuming Wang, Chen Li, Jing Lyu, Haoqian Wang

2026-06-29视觉感知

EMOSH针对人体动画中2D姿态易泄露驱动者体型、3D先验又难表达表情和手势的矛盾,引入可分离形体与姿态的EHM表示,并配合置信感知运动跟踪、粗到细的网格与关键点混合注入,以及空间对齐条件来减小训练/推理域差。实验显示其在自驱动和跨驱动场景中较既有方法更能保持身份与体型,同时生成更细致的表情和手势。

TempAct: Advancing Temporal Plausibility in Autoregressive Video Generation via Planner-Executor RL Figure 1
2026-06-29cs.CV

TempAct: Advancing Temporal Plausibility in Autoregressive Video Generation via Planner-Executor RL

Jing Wang, Xiangxin Zhou, Jiajun Liang, Kaiqi Liu, Wanyun Pang, Zhenyu Xie, Tianyu Pang, Xiaodan Liang

2026-06-29视觉感知强化学习

本文针对自回归视频生成按块生成时难以明确“当前该发生什么”、步骤提示切换又易滞后或语义混叠的问题,提出 TempAct:用 LLM 规划器生成可执行的时序分解,并通过规划组/执行组的层级强化学习同时优化计划质量与提示切换执行。实验在 Self-Forcing 和 LongLive 上提升 Temporal-Following Score,并基本保持视觉质量。

Curriculum-guided Change Detection Training: Toward Accurate Serac Fall Monitoring Figure 1
2026-06-29cs.CV

Curriculum-guided Change Detection Training: Toward Accurate Serac Fall Monitoring

Arthur Dérédel, Carlos Crispim-Junior, Pierre Lemaire, Johan Berthet, Laure Tougne Rodet

2026-06-29视觉感知

这篇论文针对冰塔崩落监测中的变化检测训练问题:多时相户外图像常因太阳角度、阴影和外观差异产生伪变化,均匀采样会带来噪声梯度。作者将课程学习引入变化检测,用太阳角差SAG和SSIM衡量样本难度,逐步加入更难样本;在SeracFallDet上,像素级和目标级方法均较常规训练稳定提升,并减少误检与重复检测。

HumanMoveVQA: Can Video MLLMs reason about human movement in videos? Figure 1
2026-06-29cs.CV

HumanMoveVQA: Can Video MLLMs reason about human movement in videos?

Pulkit Gera, Faegheh Sardari, Asmar Nadeem, Valentina Bono, Padraig Boulton, Adrian Hilton, Armin Mustafa

2026-06-29视觉感知

本文针对视频 MLLM 常把人体运动压缩成动作标签、难以理解空间轨迹和朝向变化的问题,提出 HumanMoveVQA 基准:以首帧锚定的世界坐标系重建 3D 人体运动轨迹,并生成 1 万余个覆盖存在、排序、比较、计数、轨迹可达性等类别的问答。实验显示闭源模型在零样本轨迹推理上接近机会水平,而用该数据微调 Qwen3-VL 8B 可将机会归一化得分约从 14.3 提升到 43.0,说明能力缺口主要可由针对性的世界一致监督缓解。

Latent Visual Diffusion Reasoning with Monte Carlo Tree Search Figure 1
2026-06-29cs.CV

Latent Visual Diffusion Reasoning with Monte Carlo Tree Search

Xirui Teng, Nan Xi, Junsong Yuan

2026-06-29生成模型强化学习

本文针对动作质量评估中“只给分、不解释”的黑箱问题,将细粒度技能视频的判断过程建模为潜在空间中的扩散式逐步推理,并用关键点引导的蒙特卡洛树搜索寻找对最终评分最关键的时空推理轨迹。该方法在多个体育与手术数据集上取得有竞争力或更好的评分表现,同时输出随时间变化的关键点注意与推理路径,但具体性能增益相对扩散建模、MCTS 与关键点先验的来源仍需进一步拆解。

Parallel Rollout Approximation for Pixel-Space Autoregressive Image Generation Figure 1
2026-06-29cs.CV

Parallel Rollout Approximation for Pixel-Space Autoregressive Image Generation

Jiayi Xu, Di He, Guolin Ke

Peking University

2026-06-29视觉感知

本文针对像素空间自回归图像生成中“高维像素块难预测”和教师强制导致的训练—推理不一致问题,提出 PRA:先生成低维中间状态再解码回像素,并用同一路径并行构造近似 rollout 的像素输入,避免昂贵的顺序采样。在 ImageNet-1K 256×256 上,135M 模型 FID 2.58 已超过既有十亿级像素 AR,511M 模型达 1.94,并提升线性探测精度。

ProMSA:Progressive Multimodal Search Agents for Knowledge-Based Visual Question Answering Figure 1
2026-06-29cs.CV

ProMSA:Progressive Multimodal Search Agents for Knowledge-Based Visual Question Answering

ZhengXian Wu, Hangrui Xu, Kai Shi, Zhuohong Chen, Yunyao Yu, Chuanrui Zhang, Zirui Liao, Jun Yang, Zhenyu Yang, Haonan Lu, Haoqian Wang

2026-06-29视觉语言

ProMSA针对知识型视觉问答中固定RAG流程无法按问题状态调整检索、纠错和构建多跳证据的问题,将模型设计为有工具预算的渐进式多模态搜索代理,可在图像检索、文本检索与停止回答间迭代决策,并用去重避免重复证据。训练上先用拒绝采样SFT学习工具格式,再用按生成长度和工具深度归一化的TN-GSPO稳定优化搜索策略;在E-VQA和InfoSeek上,相比强RAG与代理基线取得更高检索和端到端准确率。

Directing the World: Fast Autoregressive Video Generation with Compositional Human-Camera Control Figure 1
2026-06-29cs.CV

Directing the World: Fast Autoregressive Video Generation with Compositional Human-Camera Control

Haoyuan Wang, Yabo Chen, Haibin Huang, Chi Zhang, Xuelong Li

2026-06-29视觉感知强化学习规划控制

本文面向长时域可控世界模型中人运动与相机轨迹相互干扰、误差累积导致视频漂移的问题,提出基于MMPL的自回归框架,通过人/相机控制解耦训练、Fast-Slow Memory稳定后训练,以及timestep感知SMPL投影和Motion-CFG提升动作对齐。实验显示其在长视频稳定性、人体动作精度、多人物控制和相机探索一致性上优于对比方法,但增益可能也受新构建的大规模标注数据影响。

Understanding How MLLMs Describe Artworks Using Token Activation Maps Figure 1
2026-06-29cs.CV

Understanding How MLLMs Describe Artworks Using Token Activation Maps

Nicola Fanelli, Pasquale De Marinis, Raffaele Scaringi, Eva Cetinic, Gennaro Vessio, Giovanna Castellano

Department of Computer Science, University of Bari Aldo Moro, University of Zurich

2026-06-29视觉感知

这篇论文关注多模态大模型在描述艺术品时是否真正依据画面,而非依赖语言先验。作者用 Token Activation Map 将生成文本逐 token 对应到图像热区,比较物体、风格、元数据、图像志符号和情感表达的 grounding 差异。结果显示具体物体更局部,风格、情绪和作品名等更分散;模型能尝试识别作者和作品,但作者归因优于标题预测,标题幻觉更明显。

Controllable Histopathology Image Synthesis with Training-free Structural Initialization and Textural Modulation Figure 1
2026-06-29cs.CV

Controllable Histopathology Image Synthesis with Training-free Structural Initialization and Textural Modulation

Yuheng Qiu, Jingyi Luo, Chenfei Ye, Ting Ma, Jianfeng Cao

2026-06-29视觉感知规划控制

针对病理图像标注昂贵、现有合成方法仍依赖成对或少量标注约束的问题,CHIS把已在无标注病理图像上训练的扩散模型作为冻结骨干,通过先验细胞掩码的频域相位初始化控制结构,再用小波层级调制粗细纹理以保持参考组织风格。实验显示其在生成保真度、掩码结构一致性和下游分割性能上优于对比方法,但具体增益在不同模块间的贡献仍需看消融细节。

Verifiable Geometry Problem Solving: Solver-Driven Autoformalization and Theorem Proposing Figure 1
2026-06-29cs.AI

Verifiable Geometry Problem Solving: Solver-Driven Autoformalization and Theorem Proposing

Can Li, Ting Zhang, Junbo Zhao, Hua Huang

Beijing Normal University

2026-06-29优化算法

本文针对几何题求解中自动形式化与下游求解器脱节、固定定理库易陷入推理停滞的问题,提出 SD-GPS:用求解器反馈训练多模态形式化器,并让神经代理只提出经符号验证的局部引理。实验在 Geometry3K 与 PGPS9K 的完形、选择和跨模态引用设置下均优于多模态大模型、神经及神经符号基线,说明将感知输出闭环到可执行证明能提升可验证推理。

Home3D 1.0: A High-Fidelity Image-to-3D Asset Generation System for Interior Design Figure 1
2026-06-29cs.CV

Home3D 1.0: A High-Fidelity Image-to-3D Asset Generation System for Interior Design

Yiyun Fei, Guoqiu Li, Jin Song, Chuqiao Wu, Delong Wu, Hong Wu, Ziru Zeng, Haohui Chen, YinDong Kong, Jing Li, Qi Wu, Feng Zhang

2026-06-29视觉感知三维

面向室内设计和电商,论文指出单图三维生成不能只“像某类家具”,还需保持具体商品的形体、纹理、PBR材质与可编辑材料分区。Home3D 1.0将任务拆成几何、纹理、材质和部件四阶段:用粗到细latent SDF/DiT重建水密网格,用多视图反投影与3D纹理场补全外观,并通过MatWeaver分割、检索式PBR烘焙和多头SDF部件生成支持材料级编辑。实验按模块评估,几何在家具基准上优于对比系统,如CD 0.4936、F1@0.01为0.6329;但整体系统增益中私有高质量数据与工程化scaling的贡献文中未充分说明。

Reflect-R1: Evidence-Driven Reflection for Self-Correction in Long Video Understanding Figure 1
2026-06-29cs.CV

Reflect-R1: Evidence-Driven Reflection for Self-Correction in Long Video Understanding

Shuimu Chen, Yuteng Chen, Yuanshen Guan, Zebang Cheng, Zeyu Zhang, Shengqian Qin, Bin Xia, Jiaran Li, Wenming Yang, Fei Ma

2026-06-29视觉感知

长视频多模态模型的自反思常因缺少外部证据而陷入“盲目自信”,甚至把正确答案改错。Reflect-R1将纠错拆成直觉、证据验证和仲裁三阶段,主动检索关键帧并用SD-GRPO分阶段优化,配套12万样本训练数据;在VideoMME、LongVideoBench、MLVU等基准达到SOTA,并提升真实纠错率。

Every Step of the Way: Video-based Parkinsonian Turning Step Counting Figure 1
2026-06-29cs.CV

Every Step of the Way: Video-based Parkinsonian Turning Step Counting

Qiushuo Cheng, Jingjing Liu, Catherine Morgan, Alan Whone, Majid Mirmehdi

2026-06-29视觉感知

这篇论文针对帕金森患者转身步数难以用人工量表或可穿戴设备稳定、便捷测量的问题,提出被动视频式粗到细计数框架:先由3D人体网格生成足部运动信号做初估,再用网格与光流的跨注意力融合捕捉拖步、碎步等细微动态,并以MIL适配不同视频长度。在PD-FOG和家庭Turn-REMAP数据上优于视觉计数和IMU基线,绝对误差由37.7降至15.9。

There and Back Again: A Flexible-Frame Transformer for Multi-Exposure Fusion Figure 1
2026-06-29cs.CV

There and Back Again: A Flexible-Frame Transformer for Multi-Exposure Fusion

Lishen Qu, Yao Liu, Shihao Zhou, Jie Liang, Hui Zeng, Lei Zhang, Jufeng Yang

Nankai International Advanced Research Institute (SHENZHEN·FUTIAN), Peng Cheng Laboratory, College of Computer Science, Nankai University, The Hong Kong Polytechnic University, OPPO Research Institute

2026-06-29视觉感知

本文针对多曝光融合模型通常绑定固定输入帧数、部署时需为不同曝光策略训练多套模型的问题,提出 FreeMEF:先用循环状态空间模块按序聚合任意数量曝光帧,再以全局特征引导基准帧,并通过极值感知混合注意力缓解饱和区域的“相似性悖论”。在三个基准数据集上,方法在定量指标和视觉质量上优于现有方法。

Long-Term Prediction of Local and Global Human Motion with Occlusion Recovery Figure 1
2026-06-29cs.CV

Long-Term Prediction of Local and Global Human Motion with Occlusion Recovery

Qiaoyue Yang, Sven Heutger, Christopher Niemann, Magnus Jung, Ayoub Al-Hamadi, Sven Wachsmuth

This work was done while S. Heutger was with Bielefeld University.

2026-06-29视觉感知

面向机器人协作、自动驾驶等需要提前理解人类动作的场景,论文指出自回归姿态预测易在长时域累积误差且难处理遮挡。其核心是用非自回归时空 Transformer 同时预测局部关节姿态与全局空间运动,并以可学习 token 恢复缺失关节、支持变长历史输入。文中称通过定量、定性和消融验证有效,但具体增益幅度在给定文本中未充分说明。

A Multi-Attribute Latent Space for Visual Analysis of Watches Figure 1
2026-06-29cs.CV

A Multi-Attribute Latent Space for Visual Analysis of Watches

Kai Lawonn, Tobias Günther, Monique Meuschke

with a Vision Transformer, colors are represented through a shared CIELAB reference palette, and dial structure is described with, and novices. The results suggest that the system supports discovery and comparison, while also revealing limitations in scalability, simple projection of all available features is problematic because watch, remains available as interactive filters. To construct the attributes, we, describe color with a shared CIELAB reference palette, and describe, • Kai Lawonn is with Leipzig University and ScaDS.AI Dresden/Leipzig., • Monique Meuschke is with Otto von Guericke University of Magdeburg., neous attributes and combine them using user-controllable weights. We, differs in two ways: the collection combines semantic type labels with, keeps filtering and details available to compensate for the ambiguity of, size [33], and GPU implementations improve scalability [7,23]. Re-, lar guiding role, but it is derived from class labels and decays during

2026-06-29视觉感知

本文针对手表电商/目录检索只能按元数据筛选、难以支持风格探索和相似款比较的问题,提出将表盘颜色、表盘结构与手表类型拆分建模的多属性潜空间。方法用 U-Net、ViT、CIELAB 与 HOG 提取属性,并扩展 UMAP 以融合属性图和类别约束布局,配合交互式地图检索。实验含参数、运行时与小规模专家/新手试用,显示有助于发现和比较,但可扩展性与以图搜图有效性仍文中未充分说明。

OrthoTryOn: Geometric Orthogonalization for Conflict-Free Unified Fashion Generation Figure 1
2026-06-29cs.CV

OrthoTryOn: Geometric Orthogonalization for Conflict-Free Unified Fashion Generation

Zhaotong Yang, Ying Tai, Jiahui Zhan, Yu Zheng, Jianjun Qian, Jian Yang

2026-06-29视觉感知

这篇论文针对统一服装生成中虚拟试穿、服装重建、姿态迁移等任务共享 LoRA 时出现的梯度冲突和负迁移问题,提出在 LoRA 瓶颈中加入任务特定正交旋转的 OSP,以几何去相关方式稳定联合训练,并用基于 Fisher 信息的 FNG 在推理时抑制易混任务干扰。实验显示其避免朴素多任务训练退化,在多个基准上超过独立任务模型且可迁移到不同扩散骨干。

SpatialUAV: Benchmarking Spatial Intelligence for Low-Altitude UAV Perception, Collaboration, and Motion Figure 1
2026-06-29cs.CV

SpatialUAV: Benchmarking Spatial Intelligence for Low-Altitude UAV Perception, Collaboration, and Motion

Haoyu Zhang, Meng Liu, Qianlong Xiang, Kun Wang, Yaowei Wang, Liqiang Nie

2026-06-29数据集/基准

针对现有无人机基准偏重图像识别、单视角理解且难以评估低空场景中的3D空间推理、跨视角协作和运动理解,SpatialUAV构建了含4331个真实样本、14类任务的统一视觉-问题-答案基准,覆盖航拍-航拍、航拍-地面协作及多种输出格式。对18个代表性VLM的评测显示,当前模型与人类水平仍有明显差距,瓶颈集中在跨视角关联、结构化定位、几何推理和时序视角变化理解。

A Unified Framework for Vision Transformers Equivariant to Discrete Subgroups of $\mathrm{O}(2)$ Figure 1
2026-06-29cs.CV

A Unified Framework for Vision Transformers Equivariant to Discrete Subgroups of $\mathrm{O}(2)$

T\=ıkun Ông, Georg Bökman

University of Amsterdam

2026-06-29视觉感知

本文针对标准 ViT 缺少旋转、翻转等平面对称归纳偏置的问题,提出面向 O(2) 任意离散子群的等变 ViT 统一框架,把既有翻转和 D4 等变模型纳入同一表示论构造,并证明子群间模型类嵌入及单头等变注意力的表达性不弱于相应等变普通注意力。实验在低数据 PatternNet 上显示等变性可提升识别率,但大群未必更好,增益可能主要来自 data-scarce 场景。

ScaLe-INR: Scale and Learn Implicit Neural Representations Figure 1
2026-06-29cs.CV

ScaLe-INR: Scale and Learn Implicit Neural Representations

Buwaneka Epakanda, Athulya Ratnayake, Pandula Thennakoon, Mario De Silva, Avishka Ranasinghe, Roshan Godaliyadda, Parakrama Ekanayake

2026-06-29视觉感知

ScaLe-INR针对隐式神经表示在多尺度信号中易受频谱偏置和高低频串扰影响的问题,提出用傅里叶反向缩放思想对坐标做方向性缩放,并以多分支结构分别建模低频结构与方向/联合高频细节,再通过置信融合和边缘引导损失约束分支分工。实验称其在图像重建、去噪、音频和3D重建上超过既有方法,如图像重建提升5.16 dB、去噪提升0.65 dB,但部分增益来源可能主要来自scaling与分支融合设计。

Hippocampus-DETR: An Explicit Memory Object Detection Framework Based on Hippocampus Modeling Figure 1
2026-06-29cs.CV

Hippocampus-DETR: An Explicit Memory Object Detection Framework Based on Hippocampus Modeling

Zhaoning Shi, Bo Ma, Hao Xu, Zepeng Yang, Bo Liang

((1) Beijing institute of Technology), task robustness. The project is available at https://github.com/2186cloud/hipnet.

2026-06-29视觉感知

该文针对DETR类检测器缺少显式记忆、在遮挡和少样本场景中学习效率受限的问题,提出将仿海马结构的HipNet嵌入DETR,分别模拟EC、DG、CA3、CA1和下托,实现模式分离、补全、筛选与整合。实验称其在COCO检测上优于主流方法,并在少样本分类、多模态特征构建和图像修复中表现出更好泛化与数据效率,但具体增益相对结构复杂度的来源仍需进一步验证。

CSD: Content-aware Speculative Decoding for Efficient Image Generation Figure 1
2026-06-29cs.CV

CSD: Content-aware Speculative Decoding for Efficient Image Generation

Mingcheng Wang, Junbo Qiao, Yunchen Li, Lingfu Jiang, Wei Li, Jie Hu, Jiao Xie, Zhou Yu, Xinghao Chen, Guixu Zhang, Shaohui Lin

2026-06-29视觉感知

本文针对自回归图像生成逐 token 解码慢、现有推测解码在图像中接受率低且不感知内容的问题,提出 CSD:用目标模型熵识别平滑/低细节区域并放宽候选 token 接受概率,同时用最优重采样和基于 TV 距离的分布对齐过滤器控制质量偏移。在 Lumina-mGPT 与 Janus-Pro 上,CSD 相比普通 AR 和 SJD/GSD 进一步降低延迟,例如 Janus-Pro 可达约 4.33×加速且 CLIP 下降很小。

Video-MME-Logical: A Controlled Diagnostic Benchmark for Video Temporal-Logical Reasoning Figure 1
2026-06-29cs.CV

Video-MME-Logical: A Controlled Diagnostic Benchmark for Video Temporal-Logical Reasoning

Hohin Kwan, Hongyu Li, Ray Zhang, Manyuan Zhang, Xianghao Kong, Anyi Rao, Jiahao Xie, Si Liu

Colab, Beihang University

2026-06-29视觉感知规划控制数据集/基准

这篇论文针对现有视频基准把时序逻辑能力与场景复杂度、静态识别混在一起的问题,提出可控诊断基准 Video-MME-Logical,将视频推理拆成状态跟踪、顺序计数、时序排序、动态空间关系和结构组合等操作,并用程序生成控制难度与中间状态验证。实验显示强 MLLM 与人类仍有明显差距,500K 样本监督微调虽提升到约 40% 准确率,但增益有限,说明单纯扩大数据仍难解决长时程逻辑推理。

Scalable and Differentiable Point-Cloud Registration Using Maximum Mean Discrepancy Figure 1
2026-06-29cs.CV

Scalable and Differentiable Point-Cloud Registration Using Maximum Mean Discrepancy

Rixon Crane, Fahira Afzal Maken, Nicholas Lawrance, Stanislav Funiak, Kasra Khosoussi, Ming Xu, Russell Tsuchida

2026-06-29视觉感知

针对机器人/自动驾驶中点云配准需同时具备可扩展、抗噪和可微的问题,论文提出 MMD-Reg:用最大均值差异刻画两点云分布差异,并以随机傅里叶特征把目标降为线性复杂度,再通过隐函数定理嵌入神经网络训练。实验显示其在合成、户外及 ModelNet40 部分重叠场景中兼具较快推理和有竞争力精度,但仍定位为依赖粗初始化的局部配准方法。

Text as Illumination: Spatial Contrastive Retinex Learning for Language-guided Medical Image Segmentation Figure 1
2026-06-29cs.CV

Text as Illumination: Spatial Contrastive Retinex Learning for Language-guided Medical Image Segmentation

Jian Shi, Cheng Zhen, Pingping Zhang, Rui Xu, Yanan Lv, Yili Ma, Huan Bi, Haojie Li, Huchuan Lu

2026-06-29视觉感知

针对语言引导医学图像分割中文本与像素预测容易语义错配的问题,论文提出 TIRNet,将文本嵌入视作 Retinex 式“语义照明”,在各解码层用正负照明图强化目标、抑制背景,并以多尺度照明监督约束前景对齐和背景抑制。实验在 MosMedData+ 与 QaTa-COV19 上优于既有 LMIS 方法,但具体增益中各模块贡献仍依赖消融结果判断。

Improving Adversarial Robustness via Activation Amplification and Attenuation Figure 1
2026-06-29cs.CV

Improving Adversarial Robustness via Activation Amplification and Attenuation

Taïga Gonçalves, Yongsong Huang, Tomo Miyazaki, Shinichiro Omachi

2026-06-29安全鲁棒

这篇论文针对对抗样本中非鲁棒特征会误导神经网络的问题,提出轻量插件 A3:用可学习掩码和由原始激活幅值导出的有界 scaling,同时构造“放大”与“衰减”两种激活视图,并把放大视图作为负参照设计对比与排序损失,推理时仅使用衰减特征。实验称其在不同骨干、数据集和对抗训练方法上稳定提升鲁棒精度,且计算与参数开销很小;但增益可能主要来自 scaling 机制与训练损失的共同作用。

MindFlow: Harmonizing Cognitive Semantics and Acoustic Dynamics for Facial Animation Generation in Dyadic Conversations Figure 1
2026-06-29cs.CV

MindFlow: Harmonizing Cognitive Semantics and Acoustic Dynamics for Facial Animation Generation in Dyadic Conversations

Hejia Chen, Haoxian Zhang, Xu He, Xiaoqiang Liu, Pengfei Wan, Shoulong Zhang, Shuai Li

2026-06-29生成模型

MindFlow针对双人对话中虚拟人表情“有反应但缺语义”、说话与聆听动态难以同时精细控制的问题,将生成拆成类脑腹侧语义理解与背侧声学运动生成两路。其关键在于用原始音频块构建连续情绪状态链,并用选择性声学注入在说话/聆听间自适应门控音频特征。实验显示其在语义贴合、表情自然度、唇同步和表达准确性上优于现有方法。

TRUST: Efficient Abdominal Trauma Recognition via Image-to-Ultrasound-Video Transfer Learning Figure 1
2026-06-29cs.CV

TRUST: Efficient Abdominal Trauma Recognition via Image-to-Ultrasound-Video Transfer Learning

Enguang Wang, Hao Zhou, Shuo Gao, Tuo Liu, Guangquan Zhou

2026-06-29视觉感知

腹部创伤超声依赖连续扫查中的细微动态线索,人工判读耗时且受操作者影响。TRUST将参数高效图像到视频迁移用于超声视频,在CLIP式框架中用跨频协同适配器抑制散斑并保留细节,用多粒度运动模块同时建模局部连续性和跨视角跳变,并以视觉查询动态生成文本原型以缓解扫描差异。院内数据上较现有方法提升9.63%,但数据规模与外部泛化文中未充分说明。

ModaFlow: Modality-Aware Flow Matching for High-Fidelity Virtual Try-On Figure 1
2026-06-29cs.CV

ModaFlow: Modality-Aware Flow Matching for High-Fidelity Virtual Try-On

Xiangyu Sai, Meysam Madadi, Sergio Escalera, Yong Xu

2026-06-29生成模型

ModaFlow针对虚拟试衣中服装纹理/文字细节易丢失、人体形变和非配对遮挡下对齐不稳的问题,引入流匹配框架,并区分视觉与文本条件:图像嵌入提供稳定结构约束,文本嵌入用自适应CFG控制语义;再配合随机mask训练和流场正则提升几何一致性。实验报告在配对与非配对基准上达到SOTA,FID分别约降30%和20%。

An Embedded Real-Time License Plate Recognition System for Complex Traffic Scenes Figure 1
2026-06-29cs.CV

An Embedded Real-Time License Plate Recognition System for Complex Traffic Scenes

Anuki Pasqual, Dulan Lokugeegana, Manimohan Thiriloganathan, Nuthya Rathnayake, Kithsiri Samarasinghe, Udaya S. K. P. Miriya Thanthrige

The authors are with the Dept. of Electronic and Telecommunication Engineering, University of Moratuwa, Sri Lanka

2026-06-29视觉感知

面向发展中国家无车道约束、多车型且需低成本边缘部署的复杂交通场景,本文将车牌检测与字符识别拆成两个轻量量化 CNN,并发布含斯里兰卡多车道道路图像的 SL-LPR 数据集,再用 FINN 在 Kria KV260 FPGA 上加速。系统在自建数据集上检测 mAP 达 93.6%、字符识别准确率 87.88%,端到端 11.5 FPS、最高延迟 87 ms,表明其主要贡献在于把复杂多车场景与嵌入式实时部署结合起来。

NormGuard: Reward-Preserving Norm Constraints in Flow-Matching Reinforcement Learning Figure 1
2026-06-29cs.LG

NormGuard: Reward-Preserving Norm Constraints in Flow-Matching Reinforcement Learning

Tianlin Pan, Lianyu Pang, Cheng Da, Huan Yang, Changqian Yu, Kun Gai, Wenhan Luo

2026-06-29生成模型强化学习优化算法

本文针对流匹配生成模型在强化学习后训练中“奖励上升但画质变差”的问题,指出关键漂移并非整体偏离,而是每步速度范数被系统性放大且推理期重归一化无效。NormGuard 以训练期单边 hinge 约束抑制超过参考模型的范数增长,尽量保留方向性奖励信号。实验覆盖两类基座、三种后训练方法和两种奖励代理,显示其能提升感知质量与真实感,并基本保持奖励收益。

PixelU: A U-Shaped Transformer for Efficient End-to-End Pixel Diffusion Figure 1
2026-06-29cs.CV

PixelU: A U-Shaped Transformer for Efficient End-to-End Pixel Diffusion

Zipeng Guo, Lichen Ma, Yu He, Xiaolong Fu, Jingling Fu, Junshi Huang, Yan Li

2026-06-29生成模型

PixelU针对像素空间扩散绕开VAE后难以同时处理低频语义与高频细节、且现有方法依赖昂贵像素解码器的问题,指出这些解码器主要是在补偿v-prediction优化困难;在x-prediction下,单阶段U形Transformer用跳连传递高频信息、恒通道下采样作为低通语义压缩即可。实验在ImageNet 256/512上FID为1.63/1.92,并以约JiT-G三分之一计算量超过该强基线。

Panoramic Scene Analysis: A Survey from Distortion-Aware Engineering to Sphere-Native Foundation Modeling Figure 1
2026-06-29cs.CV

Panoramic Scene Analysis: A Survey from Distortion-Aware Engineering to Sphere-Native Foundation Modeling

Qinfeng Zhu, Lei Fan

University of Liverpool, Xi’an Jiaotong-Liverpool University, University of Liverpool Department of Computer Science Liverpool L69 3BX United Kingdom, Xi’an Jiaotong-Liverpool University Department of Civil Engineering Suzhou 215123 China

2026-06-29视觉感知

该综述针对全景图像虽能提供机器人导航与具身感知所需的全局空间上下文、却因球面到平面投影产生畸变而失配常规视觉模型的问题,提出以“几何承诺”递进组织全景场景分析:从投影适配、畸变感知工程到球面原生建模与基础模型接口适配。主要洞察是严格球面等变性与完整复用透视预训练权重尚难兼得,并指出现有评测缺少球面面积加权、接缝一致性、极区鲁棒性等协议,给出面向通用全景智能的研究路线。

SIFT: Self-Imagination Fine-Tuning for Physically Plausible Motion in Video Diffusion Models Figure 1
2026-06-29cs.CV

SIFT: Self-Imagination Fine-Tuning for Physically Plausible Motion in Video Diffusion Models

Ruoyu Wang, Jialun Liu, Huayang Huang, Haibin Huang, Jiepeng Wang, Chi Zhang, Xuelong Li, Yu Wu

2026-06-29视觉感知生成模型

本文针对视频扩散模型中相机运动与物体运动相互“纠缠”、导致相对运动不符合物理直觉的问题,指出根源在于真实视频数据偏置和去噪重建训练会让模型复制已有运动捷径。SIFT改用自生成视频进行“自想象”微调,结合运动感知判别监督与渐进困难样本回放,从文本语义学习运动解耦。实验显示其提升了运动物理合理性、解耦性和可控性,但具体增益在不同基座模型上的泛化边界仍需看完整实验细节。

Learning 1-Bit LiDAR-based Localization with Auxiliary Objective Figure 1
2026-06-29cs.CV

Learning 1-Bit LiDAR-based Localization with Auxiliary Objective

Kaijie Yin, Zhiyuan Zhang, Tian Gao, Wentao Zhu, Cheng-zhong Xu, Hui Kong

2026-06-29视觉感知

这篇论文针对车载定位模块常驻运行、算力和内存预算受限的问题,尝试把 6DoF LiDAR 绝对位姿回归做成全 1-bit 二值网络。核心洞察是二值化不仅降容量,还会在层间造成任务相关信息流失和梯度不匹配,因此 BiLoc 用信息瓶颈视角引入训练期辅助目标,以全精度模型特征作参考来约束二值编码器保留关键表示,推理时不增加开销。实验称其在大规模室外数据集上优于已有二值定位方法,并在 Oxford Radar RobotCar 上降低平均位置和朝向误差。

Scene and Human in One World: Reconstruction in a Feedforward Pass Figure 1
2026-06-29cs.CV

Scene and Human in One World: Reconstruction in a Feedforward Pass

Boao Shi, Qiao Feng, Yiming Huang, Lingjie Liu

University of Pennsylvania, University of Pennsylvania Philadelphia Pennsylvania USA

2026-06-29强化学习三维

针对单目动态视频中人体与场景分开重建易产生尺度、位置和遮挡不一致的问题,论文提出 SHOW,将人体系数先验、DensePose 辅助监督与 mask prompt 注入前馈场景点图预测,并反向用场景几何约束 SMPL-X 人体恢复,在统一度量空间内联合估计人体、场景与全局位置。实验称其在 3DPW、EMDB、RICH 上提升了局部人体重建、尺度一致性和人景对齐,但真实复杂场景仍存在 sim-to-real 泛化不足。

MASS: Motion-Aligned Selective Scan for Refinement in Flow-Based Video Frame Interpolation Figure 1
2026-06-29cs.CV

MASS: Motion-Aligned Selective Scan for Refinement in Flow-Based Video Frame Interpolation

Jun-Sang Yoo, Seung-Won Jung

2026-06-29视觉感知生成模型

针对基于光流的视频插帧在大位移、遮挡和非线性运动下对应关系不稳,以及现有 SSM 仍按静态网格扫描而与真实运动路径错位的问题,MASS 将特征序列化改为沿每个像素的光流引导轨迹进行,并用可学习残差速度近似弯曲轨迹、按运动幅度自适应调整采样长度和 SSM 步长,再用于细化中间光流与遮挡掩码。实验显示其在标准基准上整体具有竞争力,尤其在大运动、高分辨率和复杂动态场景取得更明显优势。

ZooClaw-FashionSigLIP2: Distilled Fine-tuning for Robust Fashion Retrieval Figure 1
2026-06-29cs.CV

ZooClaw-FashionSigLIP2: Distilled Fine-tuning for Robust Fashion Retrieval

Siqiao Xue, Chunxue Xu

2026-06-29安全鲁棒

本文针对时尚图文检索中“领域微调提升目标集表现却损害泛化”的矛盾,提出在 SigLIP2-base 上进行全量微调、图像端知识蒸馏,并用 WiSE-FT 与基座权重插值,以兼顾短关键词和长描述查询。实验称该配方优于 LoRA、更大骨干和外部数据,并在 ZooClaw-Fashion、H&M 与重评后的 Fashion200k 上领先或持平;但部分收益也依赖其新基准与重标注协议。

Joint Transcription and Decryption of Images of Encrypted Handwritten Documents: A Comparison with the Traditional Pipeline Figure 1
2026-06-29cs.CV

Joint Transcription and Decryption of Images of Encrypted Handwritten Documents: A Comparison with the Traditional Pipeline

Marino Oliveros-Blanco, Lei Kang, Alicia Fornés, Beáta Megyesi

Computer Vision Center, Department of Computer Science, Department of Linguistics, Stockholm University, Sweden

2026-06-29视觉感知

这篇工作针对历史加密手稿“先识别密文符号、再解密”流程中转录错误会级联放大的问题,以 Copiale 密码为案例,提出从手写加密图像直接生成明文的端到端 Direct Image Decryption,并用合成数据扩充训练。结果表明联合图像到明文建模可作为传统流水线的有希望替代方案,但模型仍针对特定替换密码,跨密码泛化能力文中未充分说明。

Class-frequency Guided Noise Schedule for Diffusion Models Figure 1
2026-06-29cs.LG

Class-frequency Guided Noise Schedule for Diffusion Models

Jiequan Cui, Beier Zhu, Qingshan Xu, Xiaojuan Qi, Bei Yu, Hanwang Zhang

2026-06-29生成模型

这篇论文关注长尾数据中扩散模型对低频类别生成质量差的问题,指出统一噪声日程会让低频类仍处于更大低密度区域,且高频类主导 score 空间。核心做法是提出与类别频率负相关的 CFRG 噪声日程,为低频类加入更大尺度噪声以平衡 score 估计。实验在 CIFAR-100-LT、ImageNet-LT 的图像生成、分类增强和文生图上提升 FID 与分类精度。

Two-Stage Cross-Domain Cervical Abnormality Screening with Cytopathological Image Synthesis and Knowledge Distillation Figure 1
2026-06-29cs.CV

Two-Stage Cross-Domain Cervical Abnormality Screening with Cytopathological Image Synthesis and Knowledge Distillation

Jincheng Li, Yuzhi He, Yihui Zhan, Xinmei Zhang, Yifei Sun, Zelin Liu, Lichi Zhang, Minye Shao, Lili Zhao

2026-06-29视觉感知

针对宫颈细胞筛查在不同机构染色和制片差异下泛化差、病变阶段视觉差异细微的问题,论文提出两阶段跨域检测框架:先用空间连续的未配对神经薛定谔桥生成中间域,缓解高分辨率切块翻译的边界伪影;再通过知识蒸馏同时对齐浅层结构与深层语义特征。两套大规模数据实验显示其跨域检测提升明显,最高达到26.9% mAP和45.8% mAP50。

DIM-WAM: World-Action Modeling with Diverse Historical Event Memory Figure 1
2026-06-29cs.RO

DIM-WAM: World-Action Modeling with Diverse Historical Event Memory

Kai Wang, Zhaopeng Gu, Yixiang Chen, Yuan Xu, Qisen Ma, Peng Su, Zhaowen Li, Yan Huang, Liang Wang

2026-06-29强化学习

DiM-WAM针对长时程机器人操作中短历史窗口易遗忘早期关键状态、难判断全局进度的问题,提出多类型历史事件记忆:从真实观测压缩事件信息,分多记忆库独立合并并带时间/库标识读出,同时用进度监督约束记忆表征。在RMBench上将LingBot-VA平均成功率由28.4%提升至69.8%,真实Franka任务全流程成功率由52.5%升至80.0%。

Multi-Modal Conditioned High-Resolution Transformer for Urban Electromagnetic Field Map Prediction Download PDF Figure 1
2026-06-29cs.CV

Multi-Modal Conditioned High-Resolution Transformer for Urban Electromagnetic Field Map Prediction Download PDF

Do-Eon Kim, Dongryul Park, Seungyoung Ahn, Namwoo Kang, Seong-heum Kim, Seongsin Kim

2026-06-29视觉感知

面向城市蜂窝网络规划中射线追踪仿真成本高的问题,论文将建筑布局、天线标量参数与方向图分路径建模:用HRFormer保持高分辨率特征,FiLM调制各阶段,交叉注意力融合辐射模式,并加入发射机相对空间通道与一致性TTA。768个仿真样本上,最佳模型MAE为0.0461,较UNet降25.2%、较仅HRFormer降31.8%,但跨城市、实测泛化文中未充分说明。

Explainable AI for Biodiversity Monitoring and Ecological Image Analysis Figure 1
2026-06-29cs.CV

Explainable AI for Biodiversity Monitoring and Ecological Image Analysis

Brinnae Bent, Holly R. Houliston, Jiayi Zhou, Günel Aghakishiyeva, David W. Johnston

Pratt School of Engineering, Duke University, Department of Applied Mathematics and Theoretical Physics, University of Cambridge, Duke University Division of Marine Science and Conservation, Nicholas School of the, Environment, Duke University Marine Laboratory

2026-06-29视觉感知

本文针对生态图像监测中深度视觉模型虽准确却难以判断是否依赖真实生物线索的问题,主张将可解释 AI 纳入模型验证流程,并围绕分类、检测、分割给出面向生态工作流的 XAI 方法框架。通过港海豹航拍检测和鲸豚解剖分割案例,论文展示解释图可揭示背景、形状、边缘与遮挡导致的误检或分割失败,并指导数据增广、重训和采样改进,但量化增益与统一评估标准文中未充分说明。

MVPruner: Dynamic Token Pruning for Accelerating Multi-view Vision-Language Models in Autonomous Driving Figure 1
2026-06-29cs.CV

MVPruner: Dynamic Token Pruning for Accelerating Multi-view Vision-Language Models in Autonomous Driving

Nan Yang, Zhanwen Liu, Linfeng Zhang, Shangyu Xie, Yang Wang, Wenzhuo Zhou, Xiangmo Zhao

2026-06-29视觉语言视觉感知

本文针对自动驾驶多视角 VLM 因视觉 token 过长导致推理延迟高的问题,指出不同视角贡献随场景和指令变化,且模型在浅层偏全局语义、深层逐步形成任务相关视角先验。MVPruner据此采用两阶段动态剪枝:先按视角信息多样性分配预算并保留跨层稳定贡献 token,再由指令引导任务相关视角和 token 选择。在 DriveLMM-o1、DriveLM、MAPLM、STSnu 等基准上,该方法在仅保留约10%视觉 token 时仍保持较高准确率,DriveLM 上 FLOPs 降低 87.3%、prefill 加速 4.97×且保留 98.5%准确率。

GeoFace: Consistent Multi-View Face Generation with Geometry-Constrained Diffusion Figure 1
2026-06-29cs.CV

GeoFace: Consistent Multi-View Face Generation with Geometry-Constrained Diffusion

Yeji Choi, Jinhyeok Choi, Jaewon Min, Minkyung Kwon, Jin Hyeon Kim, Seungryong Kim

2026-06-29生成模型

针对单张人脸生成多视角图像时常见的跨视角几何漂移与身份结构退化问题,GeoFace将外观生成和3D几何生成放入双流扩散框架,并用FLAME空间的规范UV位置图作为共享约束,通过几何引导的注意力对齐损失监督外观与几何token对应关系。实验在RenderMe-360和NeRSemble上显示,其视觉质量和跨视角几何一致性优于现有多视角扩散方法,并可为后续3D重建提供更好的初始化。

Temporal-Emerged Prompting for Segment Anything in Multiframe Infrared Small Target Detection Figure 1
2026-06-29cs.CV

Temporal-Emerged Prompting for Segment Anything in Multiframe Infrared Small Target Detection

Yinghui Xing, Donghao Chu, Shizhou Zhang, Di Xu

2026-06-29视觉感知

本文针对低信噪比多帧红外小目标在单帧中难以与背景区分、SAM类方法又依赖可靠提示的问题,提出TEP-SAM:显式建模全局背景运动与局部目标运动偏差,将“随时间显现”的线索注入冻结SAM特征,并自动生成时间提示以实现非交互分割。实验称其在多个M-IRSTD基准上优于现有方法,尤其在严重低SNR和复杂动态背景下更稳健。

VLM-Aware Meta-Optic Front-End Design for Frozen Vision-Language Models Figure 1
2026-06-29cs.CV

VLM-Aware Meta-Optic Front-End Design for Frozen Vision-Language Models

Chanik Kang, Raphaël Pestourie, Haejun Chung

2026-06-29视觉语言视觉感知

这篇论文关注紧凑/受限超表面光学前端与冻结视觉语言模型之间的目标错配:传统清晰成像指标未必最利于识别。作者提出 CODA,将冻结 CLIP 的分类损失经可微成像和 Maxwell 伴随梯度直接反传到超光学密度,不加入重建或 ISP。二维仿真中,ImageNet-100 零样本准确率由聚焦基线 53.75% 提升到 65.41%,且无需重优化可迁移到 CLIP、SigLIP、DINOv2 多数据集;但结论受限于线扫描二维仿真,未声称优于干净图像。

CascadeOcc: Rethinking 3D Occupancy World Models with Cascaded VQ Representations Figure 1
2026-06-29cs.CV

CascadeOcc: Rethinking 3D Occupancy World Models with Cascaded VQ Representations

Kyumin Hwang, Wonhyeok Choi, Jaeyeul Kim, Jihun Park, Daehee Park, Sunghoon Im

2026-06-29强化学习三维

针对占用世界模型过度依赖外部模态、LLM或人为拆分潜空间的问题,CascadeOcc强调挖掘3D占用表示自身的层级结构:用多尺度级联VQ/VQVAE-v2在自回归框架中由粗到细生成场景,并以TimeMixer融合长短期时序依赖。文中在Occ3D和nuScenes上报告,相比OccWorld,3D重建IoU/mIoU提升2.24%/4.6%,4D预测提升3.65%/3.2%,且碰撞率更低。

AI-Generated Image Recognition via Fusion of CNNs and Vision Transformers Figure 1
2026-06-29cs.CV

AI-Generated Image Recognition via Fusion of CNNs and Vision Transformers

Xuan-Bach Mai, Hoang-Minh Nguyen-Huu, Quoc-Nghia Nguyen, Hoang-Tung Vu, Minh-Triet Tran, Trung-Nghia Le

2026-06-29视觉感知

针对生成式图像质量提升带来的真假图像鉴别需求,论文将多个CNN与Vision Transformer检测器的输出进行融合,意在结合局部纹理特征与全局语义表征以提升AI生成图像识别。实验主要在CIFAKE数据集上进行,报告最高准确率97.32%;但跨生成器泛化、融合相对单模型的稳定增益及误差来源文中未充分说明。

Denoising ICF Images with Multiplicative Uniform Noise: A Self-Supervised Study Based on the Log-Domain Noisier2Inverse Framework Figure 1
2026-06-29cs.CV

Denoising ICF Images with Multiplicative Uniform Noise: A Self-Supervised Study Based on the Log-Domain Noisier2Inverse Framework

Gyeongha Hwang, Bradley Thomas Wolfe, Naima Naheed

2026-06-29视觉感知

针对惯性约束聚变图像中近零背景、强空间相关且逐图变化的乘性均匀噪声,论文将 Noisier2Inverse 放到对数域,把乘性噪声转为加性噪声,并强调合成噪声需按每张图的参数采样。最佳 Variant B 在无需干净训练图像下达到 21.41 dB PSNR、0.8358 SSIM,较噪声输入提升 19.46 dB,并明显优于 BM3D 与 Noise2Self。

Enhancing Co-packaging Optics Enabled Silicon Photonics Security Assurance Hardware Fingerprinting Figure 1
2026-06-29cs.CV

Enhancing Co-packaging Optics Enabled Silicon Photonics Security Assurance Hardware Fingerprinting

Liton Kumar Biswas, M Shafkat M Khan, Himanandhan Reddy Kottur, Hao Wang, Hamed Dalir, Navid Asadizanjani

Department of Electrical and Computer Engineering, University of Florida, resolution, scalable fingerprint for silicon photonic chips, enabling cost-effective device authentication and, silicon slab) act as optical resonators, creating sharp spectral

2026-06-29视觉感知

面向硅光子芯片在关键供应链中易遭篡改、伪造而传统电子认证不足的问题,论文将原本用于密度控制的填充区改造成二维光子晶体硬件指纹,通过波长、偏振和入射角响应编码身份且不增加工艺步骤。FDTD与样片表征显示,不同柱径/间距可产生可分离窄带共振峰,峰间距多超过40 nm、FWHM低于15 nm,实测与仿真偏差约5–10 nm,支持低成本光学认证。

Qwen-Image-2.0-RL Technical Report Figure 1
2026-06-29cs.CV

Qwen-Image-2.0-RL Technical Report

Yixian Xu, Kaiyuan Gao, Yuxiang Chen, Yilei Chen, Zecheng Tang, Zihao Liu, Zikai Zhou, Deqing Li, Hao Meng, Kuan Cao, Jiahao Li, Jie Zhang, Liang Peng, Lihan Jiang, Ningyuan Tang, Shengming Yin, Tianhe Wu, Xiaoyue Chen, Yan Shu, Yanran Zhang, Yi Wang, Yu Wu, Yujia Wu, Zekai Zhang, Zhendong Wang, Xiao Xu, Kun Yan, Chenfei Wu

tion. Building on this reward system, we develop a scalable GRPO-based RL training, Podell et al., 2024) with scalable Transformer-based, Labs, 2025, Labs et al., . Scalable RL training framework (Sec. 4). We adopt a GRPO-based RL framework with multi-

2026-06-29视觉感知强化学习

本文针对扩散图像模型预训练目标难以直接对齐人类审美、提示遵循和编辑保真度的问题,提出将任务化 VLM 复合奖励、GRPO 强化学习与 on-policy distillation 结合:先分别优化文生图和编辑教师,再用轨迹级速度匹配合并为单一模型。实验显示其在 Qwen-Image-Bench 达到 57.84(较基座 +2.61),文生图和编辑 Arena Elo 分别提升 78 与 93,说明收益主要来自分解式奖励优化和蒸馏避免跨任务冲突。

On the stability of scale-space metrics Figure 1
2026-06-29math.NA

On the stability of scale-space metrics

William Leeb

School of Mathematics, University of Minnesota, Twin Cities

2026-06-29视觉感知

本文面向图像与断层投影比较中对形变、旋转和噪声敏感的问题,研究基于高斯尺度空间的函数距离。核心在于把多尺度平滑后的差异加权成度量,并证明其与 Besov/Wasserstein 相关形式的稳定性,同时构造 SO(2) 旋转不变版本。主要结果包括对几何扰动和投影角变化的误差界、离散采样下对次高斯噪声的鲁棒性,以及 r=2 时 O(n²log n) 的快速计算算法,并用数值实验验证这些性质。

Spectral Subsurface Scattering from RGB via Biophysical Skin Inversion Figure 1
2026-06-29cs.GR

Spectral Subsurface Scattering from RGB via Biophysical Skin Inversion

Carlos Aliaga, Adrian Jarabo

Meta Reality Labs Research

2026-06-29视觉感知

本文针对皮肤次表面散射渲染中仍依赖艺术家手调散射距离和各向异性、且单一均质介质难以匹配真实多层皮肤的问题,提出从单张 RGB 漫反射贴图反演全光谱光学参数。核心是用三组独立介质的加权混合近似多层散射,并训练神经解码器预测各波长的散射半径、反照率和各向异性,可直接接入随机游走路径追踪。结果显示该方法能自动区分 UV 近不透明、NIR 高透光等谱段差异,减少手工调参,但唇部等非典型皮肤区域和角度依赖验证仍有限。

Dismantling Pathological Shortcuts: A Causal Framework for Faithful LVLM Decoding Figure 1
2026-06-29cs.CV

Dismantling Pathological Shortcuts: A Causal Framework for Faithful LVLM Decoding

Liu Yu, Can Chen, Ping Kuang, Zhikun Feng, Fan Zhou, Gillian Dobbie

2026-06-29视觉语言

本文针对LVLM在物体生成中因语言先验绕过视觉证据而产生幻觉的问题,指出关键不在全局视觉注意力强弱,而在决策步骤中少数注意力头形成“病理捷径”。作者提出无需训练的Fox框架,用视觉注意力熵定位风险中介头,并以因果干预和冲突门控解码切断捷径、兼顾流畅性;实验称在CHAIR等指标上优于现有方法,较SID有明显提升。

CoIn: Comprehensive 2D-3D Inpainting with Gaussian Splatting Guidance Figure 1
2026-06-29cs.CV

CoIn: Comprehensive 2D-3D Inpainting with Gaussian Splatting Guidance

Hana Kim, Minje Kim, Tae-Kyun Kim

2026-06-29三维

针对现有3D场景修复依赖精确多视角掩码、且多局限于物体移除的问题,CoIn采用先2D生成再以3D高斯泼溅反向约束的双向流程:Ref-GS提供参考自适应几何,CLG把3D一致性注入扩散去噪,TE-D提升纹理真实感。实验显示其在移除与插入任务上达到SOTA,并支持任意形状掩码。

Beyond Points: Spherical Distributional Part Prototypes for Interpretable Classification Figure 1
2026-06-29cs.CV

Beyond Points: Spherical Distributional Part Prototypes for Interpretable Classification

Duarte Leão, Diogo Pereira Araújo, Catarina Barata, Carlos Santiago

2026-06-29视觉感知

本文针对现代视觉骨干的归一化角度特征中,同一语义部件变化大而点原型易冗余、漂移的问题,提出 vMFProto:用超球面 von Mises-Fisher 混合分布表示类别部件,并为每个原型学习集中度,再结合熵正则 OT 做结构化 patch 分配与两阶段训练。实验显示其在 CUB、Dogs、Cars 上提升解释一致性、稳定性和区分性,同时保持有竞争力的分类准确率。

Distribution-based deep multiple instance learning for tumor proportion scoring in NSCLC Figure 1
2026-06-29cs.CV

Distribution-based deep multiple instance learning for tumor proportion scoring in NSCLC

Krzysztof Pysz, Artur Bartczak, Jarosław Kwiecień, Piotr Krajewski, Witold Dyrka

2026-06-29视觉感知

这篇论文针对NSCLC中PD-L1肿瘤比例评分依赖专家、逐片标注成本高且零表达样本难判的问题,提出先用MobileNetV3提取病理patch特征,再用带门控注意力的MIL预测零膨胀Beta分布参数,将TPS估计与不确定性/零类概率合在一起。实验显示深度MIL明显优于线性和岭回归,ZIBeta在RMSE、零类F1和宏F1上接近或达到最佳,但数据仅162例,增益稳定性仍需更大队列验证。

DeLux: Cross-Modal Local Artifact Restoration in Video Using Neuromorphic Data Figure 1
2026-06-29cs.CV

DeLux: Cross-Modal Local Artifact Restoration in Video Using Neuromorphic Data

Bartosz Stachowiak, Dariusz Brzezinski

Institute of Computing Science, Poznan University of Technology, publicly available to foster future research on cross-modal restoration.

2026-06-29视觉感知

针对强光、眩光、过曝和闪烁会让RGB视频局部信息彻底丢失、且现有方法多按单一伪影分别处理的问题,DeLux提出跨模态局部伪影修复:先用事件相机高动态范围信号重建结构先验,再显式定位退化区域并只在受损像素上融合修复。实验显示其在合成与车载真实场景中优于RGB-only和事件引导HDR基线,平均MS-SSIM超过0.99,真实伪影强度最高降低88%。

Perceptual 3D Simulation With Physical World Modeling Figure 1
2026-06-29cs.CV

Perceptual 3D Simulation With Physical World Modeling

Wanhee Lee, Klemen Kotar, Rahul Mysore Venkatesh, Jared Watrous, Daniel L. K. Yamins

Stanford University

2026-06-29强化学习三维

论文针对真实场景缺少完整几何与动力学信息、局部操作后果不确定的问题,提出 P3Sim:把 RGB、深度、光流等局部变量建模为可任意条件化的概率世界模型,并用几何化模块提供部分 3D 变换线索、持久记忆维持时序一致性。实验覆盖新视角合成、物体操控、动态预测与几何补全,显示其能在不完整感知下生成较一致的 3D 场景演化,但具体量化增益与来源文中片段未充分说明。

Radar Guided Camera Verification for Automatic Emergency Braking Rethinking Object Detection in Radar Camera Fusion Figure 1
2026-06-29cs.CV

Radar Guided Camera Verification for Automatic Emergency Braking Rethinking Object Detection in Radar Camera Fusion

Ram Charan Akula, Sivanathan Kandhasamy, Manikandan Ganesan

2026-06-29视觉感知

这篇论文针对AEB中雷达已完成目标定位后,相机是否仍需运行深度目标检测的问题,提出将相机角色改为雷达ROI内的障碍物验证,并用无需训练和GPU的边缘密度门控实现。实车72次行驶、13.16万帧评估显示,其最多减少98.7%搜索空间,单ROI延迟0.121 ms,AUC 0.898、召回0.994,33个威胁场景无漏刹;但泛化到更多车辆、光照和标定误差下仍需验证。

Understanding Cross-Rig Generalization in Automotive Perception: a Multi-Rig Benchmark and Rig Variation Metrics Figure 1
2026-06-29cs.CV

Understanding Cross-Rig Generalization in Automotive Perception: a Multi-Rig Benchmark and Rig Variation Metrics

Tim Alexander Bader, Tim Dieter Eberhardt, Maximilian Dillitzer, Wilhelm Stork

2026-06-29学习理论数据集/基准

本文关注自动驾驶多摄像头感知在真实车队中因相机位置、朝向、视场和数量变化带来的跨rig泛化问题。作者构建Plentiful CARLA Camera Rigs,在相同场景下渲染14种系统化相机配置,并提出Rig Variance与Rig Contrastive Distance来量化rig内部多样性和跨rig几何差异。实验表明,仅几何观测变化就会造成显著性能波动,且RigCD与多数模型的迁移难度高度相关,可作为排序跨rig退化风险的代理指标。

Beyond MoCap: Scaling Motion Tokenizers with Synthetic Human Motion for Generative Modeling Figure 1
2026-06-29cs.CV

Beyond MoCap: Scaling Motion Tokenizers with Synthetic Human Motion for Generative Modeling

Yiwen Yan, Wanning He, Yu-Wing Tai

Dartmouth College

2026-06-29生成模型

论文针对 MoCap 数据动作类型窄、长尾覆盖不足导致运动 tokenizer 词表受限的问题,提出用大规模合成且物理约束的人体动作扩展训练分布,并同步放大/改造 VQ-VAE 离散码本。核心洞察是生成质量瓶颈更多在表示空间而非下游架构;在不改 MotionGPT 等框架的情况下,重分词后在文本到动作和动作续写中提升多样性、组合性与长尾泛化,但具体增益可能主要来自 synthetic data scaling。

MemoBench: Benchmarking World Modeling in Dynamically Changing Environments Figure 1
2026-06-29cs.CV

MemoBench: Benchmarking World Modeling in Dynamically Changing Environments

Haoyu Chen, Kaichen Zhou, Hang Hua, Kaile Zhang, Jingwen Qian, Wufei Ma, Haonan Chen, Chunjiang Liu, Yizhou Zhao, Xiaoyuan Wang, Weiyue Li, Alan Yuille, Paul Pu Liang, Yilun Du

2026-06-29强化学习数据集/基准

MemoBench关注视频世界模型在部分可观测动态场景中的“物体离开又返回”记忆问题,这对机器人操作、自动驾驶和具身智能都很关键。它构建360段合成与真实视频,要求模型在目标遮挡期间继续推断物理状态,并用自动指标与VQA评估重现质量。实验显示10个先进模型均难以可靠保持对象记忆,ORS均未超过0.4,且无相机条件模型可能靠近静态生成虚高一致性。

Large Language Model Teaches Visual Students: Cross-Modality Transfer of Fine-Grained Conceptual Knowledge Figure 1
2026-06-29cs.CV

Large Language Model Teaches Visual Students: Cross-Modality Transfer of Fine-Grained Conceptual Knowledge

Thomas Shih-Chao Liang, Zhuoran Yu, Yong Jae Lee

2026-06-29视觉感知

这篇论文针对细粒度视觉分类中纯视觉蒸馏易依赖数据集教师、且可能放大背景偏差的问题,提出 LaViD:让语言模型生成区分类别语义差异的选择题,并把各类别在这些问题上的软分布作为概念签名,监督视觉学生模型。实验显示,即使语言教师不看图,LaViD 在六个细粒度基准上普遍优于多模态教师蒸馏和多种传统 KD 方法,并在 Waterbirds 上提升最差组准确率,说明其概念监督有助于抗伪相关。

Tessellating The Earth Figure 1
2026-06-29cs.CV

Tessellating The Earth

Daniel Cher, Hamza Iqbal, Eric Xing, Brian Wei, Nathan Jacobs

2026-06-29视觉感知

这篇论文针对现有地理位置编码器使用固定球面谐波或傅里叶基、把容量均匀浪费在海洋等低信息区域的问题,提出可学习的球面 Voronoi 分区,让站点和嵌入随卫星图像对比预训练迁移到更具判别力的区域,并用全局语义 token 在远距离相似环境间共享语义。实验称其在多项地理分类、回归任务及 iNaturalist-2018 物种分类地理先验中达到最优结果。

Structured-Li-GS: Structured 3D Gaussians Splatting with LiDAR Incorporation and Spatial Constraints Figure 1
2026-06-29cs.CV

Structured-Li-GS: Structured 3D Gaussians Splatting with LiDAR Incorporation and Spatial Constraints

Huaiyuan Weng, Huibin Li, Chul Min Yeum

Department of Civil and Environmental Engineering, University of Waterloo, 200 University Ave W, Waterloo, N2L 3G1

2026-06-29优化算法三维

本文针对传统 3DGS 依赖稀疏 SfM 与高斯增密导致几何约束弱、模型膨胀的问题,引入 LiDAR-惯性-视觉 SLAM 生成的稠密彩色点云,将高斯锚定在下采样点并用局部法线初始化椭球,再结合 RGB、深度、法线等多重损失训练。实验显示其在基准和自建手持扫描数据上以更少高斯取得更高重建质量,但增益可能部分来自更强传感器与数据预处理。

TruEye: Fine-Grained Detection of AI-Generated Human Subjects in Images Figure 1
2026-06-29cs.CV

TruEye: Fine-Grained Detection of AI-Generated Human Subjects in Images

Jay Barot, Dan Lin

2026-06-29视觉感知

面向社交欺诈等场景中难以解释、难泛化且成本高的 AI 人像伪造检测,TruEye 将图像按人物与场景拆成双流 token,并用掩码条件、特征放大和区域门控交叉注意力建模二者一致性,从而区分五类合成组合并输出局部证据。实验称其在 FineSyn 等多数据集上优于 SIDA、LEGION 等基线,对未见生成器泛化更强,且较 LLM 解释式方法推理快百倍以上。

ReWorld: Learning Better Representations for World Action Models Figure 1
2026-06-29cs.CV

ReWorld: Learning Better Representations for World Action Models

Tianze Xia, Lijun Zhou, Kaixin Xiong, Jingfeng Yao, Yu Zhu, Zhenxin Zhu, Bing Wang, Guang Chen, Hangjun Ye, Wenyu Liu, Haiyang Sun, Xinggang Wang

Huazhong University of Science and Technology, 2 Xiaomi EV

2026-06-29强化学习

本文针对自动驾驶世界动作模型只在输出端监督、难以让中间表征真正服务规划的问题,提出 ReWorld:直接优化 Video DiT 与 Action DiT 的中间表示,通过未来预测监督、跨模态世界对齐和安全临界硬负样本约束,使生成知识更有效迁移到规划。实验显示其在 nuScenes 上将 FVD 从 81.3 降至 61.9,在 NAVSIM 上将 PDMS 从 89.1 提升到 90.4,并约加速 2 倍收敛。

Aloe-Vision: Robust Vision-Language Models for Healthcare Figure 1
2026-06-29cs.CV

Aloe-Vision: Robust Vision-Language Models for Healthcare

Jaume Guasch-Martí, Enrique Lopez-Cuena, Martín Suárez-Fernández, Jordi Bayarri-Planas, Anna Arias-Duart, Dario Garcia-Gasulla

2026-06-29视觉语言视觉感知安全鲁棒

医疗视觉语言模型受限于高质量多模态数据稀缺、评测污染和安全鲁棒性不足。Aloe-Vision 通过公开的 Aloe-Vision-Data 训练混合、7B/72B 模型权重与流程,以及低污染的 CareQA-Vision 基准,强调可复现评测。实验显示其在医疗与通用任务上较基线有明显提升并接近同类前沿模型,但对误导和对抗输入仍脆弱,临床可靠性仍未解决。

DMV-Bench: Diagnosing Long-Horizon Multimodal Agents' Visual Memory with Incidental Cue Injection Figure 1
2026-06-29cs.CV

DMV-Bench: Diagnosing Long-Horizon Multimodal Agents' Visual Memory with Incidental Cue Injection

Yujin Tang, Chenming Shang, Ruize Xu, Nikhil Singh

Dartmouth College

2026-06-29视觉语言

本文针对多模态代理长期任务中“看过但未被文字记录”的视觉细节难以评测的问题,构建 DMV-Bench:在电商多会话环境中向商品图像注入唯一偶发视觉线索,并隔离文本泄漏,用召回跨度测量视觉记忆保持。作者还提出并行存储视觉与语言编码的 DualMem。实验显示其在 Gemini 2.5 Flash 和 Qwen2.5-VL-7B、不同链长下均优于字幕记忆和现有多模态记忆系统,且消融表明主要收益来自视觉通道承载线索、文本通道辅助查询落地。

SelectAnyTree: A Promptable Instance Segmentation Model for 3D Forest LiDAR Point Clouds Figure 1
2026-06-29cs.CV

SelectAnyTree: A Promptable Instance Segmentation Model for 3D Forest LiDAR Point Clouds

Trung Thanh Nguyen, Daniel Lusk, Kilian Gerberding, Janusch Vajna-Jehle, Tuan-Anh Vu, Duc Viet Le, Tu Vo, Phi Le Nguyen, Yasutomo Kawanishi, Takahiro Komamizu, Ichiro Ide, Julian Frey, Teja Kattenborn

Nagoya University, Japan, University of Freiburg, Germany, University of California, Los Angeles, USA, University of Twente, the Netherlands, KC Machine Learning Lab, Korea, Hanoi University of Science and Technology, Vietnam, Ritsumeikan University, Japan

2026-06-29视觉感知三维

这篇论文针对森林 LiDAR 单木实例标注成本高、现有方法只能整场自动分割且难以交互纠错的问题,提出 SelectAnyTree:将用户点击的位置、正负属性和局部特征编码成查询,并用冠层高度模型树梢作为免费首个提示,再由线性复杂度状态空间解码器生成目标树掩码。实验覆盖多区域与跨数据集,单次点击达到 78.2 IoU,较最强可提示基线高 24.8 点,并以更少点击、更小模型和更快推理达到各精度目标。

Fine-tuning a multimodal large language model for clinician-grade autism behavioral scoring from short home videos Figure 1
2026-06-29cs.CV

Fine-tuning a multimodal large language model for clinician-grade autism behavioral scoring from short home videos

Mohammadmahdi Honarmand, Parnian Azizian, Aaron Kline, Kae Nurge, Zerin Nasrin Tumpa, Saimourya Surabhi, Kaitlyn Dunlap, Yang Qian, Ali Kargarandehkordi, Sameer Neupane, Peter Washington, Dennis P. Wall

Department of Mechanical Engineering, Stanford University, Stanford, CA 94305, USA, Department of Pediatrics, Stanford University, Stanford, CA 94305, USA, Department of Biomedical Data Science, Stanford University, Stanford, CA 94305, USA, Department of Information and Computer Sciences, University of Hawaii at Manoa, Honolulu, HI 96822, USA, Division of Clinical Informatics and Digital Transformation, Department of Medicine, University of California San Francisco, San Francisco, CA 94158, USA

2026-06-29视觉语言视觉感知

面向自闭症早筛中专业量表评估耗时、难规模化的问题,本文将多模态 Gemini 2.5 Pro 用 400 段临床评分家庭短视频做 LoRA 微调,只监督 30 个行为特征而非诊断标签。结果显示,与临床评分的一致性提升 40%,27/28 个可评估特征改善;未训练的 ASD 直接诊断 F1 也提升 53%,下游分类管线达到 77% 准确率和 86% AUC,说明特征级对齐可让视频语言模型更接近临床可用的行为评分器。

SemCityLoc: Aerial 6DoF Localization Using Semantic 3D City Models Figure 1
2026-06-29cs.CV

SemCityLoc: Aerial 6DoF Localization Using Semantic 3D City Models

Jingfeng Mao, Xuyang Chen, Qilin Zhang, Oussema Dhaouadi, Guangming Wang, Brian Sheil, Daniel Cremers, Yan Xia, Olaf Wysocki

2026-06-29三维

SemCityLoc针对无人机在GNSS受限城市环境中依赖高精度GNSS或稠密纹理三维重建、难以规模化部署的问题,提出用基础模型生成的语义分割与单目深度去对齐标准化LoD语义城市模型,将6DoF定位转化为语义-几何表面对齐。论文还构建SemCityLockeD低空真实基准;实验显示在城市峡谷中召回率最高提升36%,平均位置误差由9.89米降至2.62米。

Not All Relations Rotate Alike: Transformation-Aware Decoupling for Viewpoint-Robust 3D Scene Graph Generation Figure 1
2026-06-29cs.CV

Not All Relations Rotate Alike: Transformation-Aware Decoupling for Viewpoint-Robust 3D Scene Graph Generation

Jingjun Sun, Chaowei Wang, Zhirui Liu, Jiaxu Tian, Ming Yang, Yaoxing Wang, Shan Gao

Northwestern Polytechnical University, Xi’an, Shaanxi, China, ShanghaiTech University, Shanghai, China

2026-06-29三维安全鲁棒

这篇论文针对具身场景中同一3D环境因水平视角旋转导致关系预测不稳定的问题,指出不同谓词的变换行为并不一致:左右前后应随视角变化,而支撑、接触等关系应保持不变。其核心是TAD,将关系推理解耦为视角稳定与方向敏感两类分支,并配合稳定物体编码和辅助监督。实验称在3DSSG上无需旋转增强即可提升偏航视角鲁棒性,同时保持标准基准性能。

RANSAC Scoring Done Right Figure 1
2026-06-29cs.LG

RANSAC Scoring Done Right

James Pritts, Felix Seegräber, Kevin Köser

Kiel University, Germany, (maximizing over latent inlier labels) and MLESAC is the marginal likelihood (summing over labels), reverse the usual elimination order. The scores above first remove the latent inlier/outlier labels, non-informative priors. A single score therefore adapts to data availability without any change to, the algorithm: an empirical-Bayes prior fit from a small validation set when labelled data exists, and, computation via a sort-and-sweep algorithm. Crucially, a is not a relabelled inlier scale: it param-, mixture [22, 20]: a latent label zi ∈{0, 1} marks observation i as inlier (zi=1) or outlier (zi=0) with, and labels z = (z1, . . . , zN) factorizes as, Maximizing (2) over labels classifies z∗, collecting positive labels

2026-06-29视觉感知

本文针对 RANSAC 及 MSAC、MLESAC、MAGSAC++ 等评分仍依赖内点噪声尺度或其阈值代理的问题,提出先在固定内外点划分下用逆伽马先验解析边缘化 σ,再优化划分的无尺度评分,并可用排序扫描以 O(N log N) 计算。实验覆盖近 7 万个图像对和多种两视几何任务,显示该方法在阈值失准时更稳定,少量甚至无需验证对即可接近最优,而基线通常需要更多调参数据。

2026-06-26

125 篇
DanceOPD: On-Policy Generative Field Distillation Figure 1
2026-06-26cs.CV

DanceOPD: On-Policy Generative Field Distillation

Wei Zhou, Xiongwei Zhu, Zelin Xu, Bo Dong, Lixue Gong, Yongyuan Liang, Meng Chu, Leigang Qu, Lingdong Kong, Wei Liu, Tat-Seng Chua

2026-06-26生成模型强化学习

本文针对单一图像生成模型难以同时保持文生图、局部/全局编辑等能力的问题,提出将各能力源视为共享流匹配状态空间中的速度场,并用硬路由、学生自身 rollout 的低噪声状态和简单速度 MSE 做 on-policy 蒸馏。实验显示 DanceOPD 在编辑与 T2I、局部与全局编辑组合,以及真实感场和 CFG 吸收中提升目标能力,同时基本保留锚定生成质量。

Ask, Solve, Generate: Self-Evolving Unified Multimodal Understanding and Generation via Self-Consistency Rewards Figure 1
2026-06-26cs.CV

Ask, Solve, Generate: Self-Evolving Unified Multimodal Understanding and Generation via Self-Consistency Rewards

Ritesh Thawkar, Shravan Venkatraman, Omkar Thawakar, Abdelrahman Shaker, Fahad Khan, Hisham Cholakkal, Salman Khan, Rao Muhammad Anwer

Mohamed bin Zayed University of Artificial Intelligence, Aalto University, Australian National University, Linköping University, preference labels, or external reward models. In this work, we ask: Can a unified LMM autonomously improve, both capabilities using only unlabeled images? To answer this, we propose a self-evolving training framework, built around three collaborating internal roles: a Proposer that generates visual questions, a Solver that answers, signals, requiring no human annotations, preference labels, or task-trained external reward/judge model. To, Most post-training pipelines rely on curated annotations, such as VQA labels for understanding, preference labels, work reports the same fully self-supervised U+G recipe, using only unlabeled images, with consistent gains across, Removing labels entirely introduces two concrete technical challenges. First, reward degeneracy: sample-level self-, trained on a frozen backbone using only unlabeled images. The understanding loop uses prompt-perturbed self-

2026-06-26视觉语言强化学习

这篇论文针对统一多模态模型后训练依赖人工标注、偏好或外部奖励的问题,提出仅用无标注图像的自进化框架:Proposer 出题、Solver 作答并评估、Generator 生成图像,并用 Solver Token Entropy 缓解自一致奖励退化,用 QA 保真与循环 caption 将理解能力反馈到生成评估。在 BLIP3o、BAGEL、VARGPT 三类架构上均带来理解指标提升,GenEval 统一提升约 3 个百分点,BAGEL 上 MMMU 提升 3.5%。

World Action Models Enable Continual Imitation Learning with Recurrent Generative Replays Figure 1
2026-06-26cs.RO

World Action Models Enable Continual Imitation Learning with Recurrent Generative Replays

Manish Kumar Govind, Dominick Reilly, Smit Patel, Hieu Le, Srijan Das

Department of Computer Science, University of North Carolina at Charlotte, United States

2026-06-26生成模型强化学习模仿学习

这篇论文针对机器人连续模仿学习中顺序微调易遗忘、真实历史示范又难以保存或获取的问题,提出 ReGen:利用世界动作模型同时生成动作与未来视觉的能力,递归合成旧任务伪轨迹并与新任务数据一起训练。实验覆盖仿真和真实操作,显示相较朴素顺序微调可将灾难性遗忘降低约 50%,性能接近依赖真实回放数据的方法;但作者也指出长时程视觉退化和动作—观测不一致仍是主要瓶颈。

Paying More Attention to Visual Tokens in Self-Evolving Large Multimodal Models Figure 1
2026-06-26cs.CV

Paying More Attention to Visual Tokens in Self-Evolving Large Multimodal Models

Shravan Venkatraman, Ritesh Thawkar, Omkar Thawakar, Rao Muhammad Anwer, Hisham Cholakkal, Salman Khan, Fahad Khan

Mohamed bin Zayed University of Artificial Intelligence, Aalto University, Australian National University, Linköping University

2026-06-26视觉语言

这篇论文针对自进化多模态模型只优化答案一致性、却可能忽视图像证据的“视觉欠条件化”问题,提出单模型无监督框架 VISE,用几何变换一致性和区域扰动后的语义不变性奖励,直接约束解码器关注视觉 token。实验覆盖18个基准,在 Qwen3-VL-2B 上 COCO 与 TextCaps 分别提升 16.85、19.66 CIDEr,并降低对象幻觉,表明收益主要来自更强的视觉条件化而非多角色自博弈。

DnA: Denoising Attention for Visual Tasks Figure 1
2026-06-26cs.CV

DnA: Denoising Attention for Visual Tasks

Ron Campos, Subhajit Maity, Xin Li, Srijan Das, Aritra Dutta

2026-06-26视觉感知

本文针对视觉 Transformer 中 softmax 注意力易把相关但无关的次要物体一并强化、导致注意力噪声和判别性下降的问题,提出 DnA:用正/负查询分别建模目标特征与近邻干扰特征,并投影到分离子空间以扩大类间主角度。实验显示其在 ViT-B 上较 ImageNet-1K 基线提升 0.8%,在视频 Transformer 与视频 LLM 任务上也有约 1.8% 和 0.5% 增益。

Don't Settle at the Mode! Mitigating Diversity Collapse in Pretrained Flow Models via Feature Self-Guidance Figure 1
2026-06-26cs.CV

Don't Settle at the Mode! Mitigating Diversity Collapse in Pretrained Flow Models via Feature Self-Guidance

Pradhaan S Bhat, Rishubh Parihar, Abhijnya Bhat, R. Venkatesh Babu

2026-06-26生成模型

本文针对预训练 flow 生成模型在同一条件下多次采样易收敛到少数模式的问题,指出输出多样性坍缩与 MMDiT 内部特征坍缩直接相关,并提出无需训练和外部奖励模型的 Feature Self-Guidance:在批量生成时拉开中间特征,同时用流形正则将其拉回有效条件流形。实验显示,该方法在文生图、深度条件和参考图生成中提升结构与风格多样性,基本保持提示一致性,推理开销显著低于基于样本筛选的 Group Inference。

PhysiFormer: Learning to Simulate Mechanics in World Space Figure 1
2026-06-26cs.CV

PhysiFormer: Learning to Simulate Mechanics in World Space

Yiming Chen, Yushi Lan, Andrea Vedaldi

Visual Geometry Group, University of Oxford, code, and models are available at https://yimingc9.github.io/physiformer.

2026-06-26强化学习

论文针对视频世界模型受视角、光照和遮挡影响、难以直接表达物理状态的问题,提出在世界坐标下用3D网格顶点轨迹学习力学演化。PhysiFormer将未来整段运动建模为坐标空间扩散过程,并用时间、空间、对象分解注意力处理多物体刚体/弹性动态。实验显示其在轨迹精度、刚性保持和动量一致性上优于自回归基线,并能泛化到混合材料、未见几何和更多物体,但长时域与接触伪影仍未充分解决。

Error-Conditioned Neural Solvers Figure 1
2026-06-26cs.LG

Error-Conditioned Neural Solvers

Haina Jiang, Liam Wang, Peng-Chen Chen, Min Seop Kwak, Seungryong Kim, Brian Bell, Jeong Joon Park

University of Michigan, Los Alamos National Laboratory

2026-06-26优化算法

论文针对神经 PDE 求解器难以自我纠错、混合方法虽降残差却在病态系统中不一定提升解精度的问题,指出“残差最小化—重构误差”存在缺口;提出 ENS 将当前 PDE 残差场作为网络输入,迭代学习修正而非做显式优化。在四类 PDE、超分辨率、参数外推和跨方程迁移中,ENS 多数设置精度最佳,Kolmogorov 湍流最高约 10 倍增益,同时推理成本低于 PINO、DiffusionPDE、PCFM。

RayPE: Ray-Space Positional Encoding for 3D-Aware Video Generation Figure 1
2026-06-26cs.CV

RayPE: Ray-Space Positional Encoding for 3D-Aware Video Generation

Minghao Yin, Jiahao Lu, Wenbo Hu, Wang Zhao, Shan Ying, Kai Han

The University of Hong Kong, The Hong Kong University of Science and Technology, ARC Lab, Tencent

2026-06-26视觉感知三维

该文针对视频 DiT 的 RoPE 只编码二维采样网格、难以表达跨视角三维对应的问题,提出将每个 token 的 6D Plücker 相机射线以加性方式注入自注意力的 Q/K,使注意力分数同时包含内容、几何及交叉项,并用方向/尺度解耦、门控与 RMSNorm 处理不同数据集的位姿尺度差异。在 Wan2.2-TI2V-5B 上仅增加不足 0.1% 参数,报告提升相机轨迹可控性、跨帧三维一致性和视频质量。

SAM2Matting: Generalized Image and Video Matting Figure 1
2026-06-26cs.CV

SAM2Matting: Generalized Image and Video Matting

Ruiqi Shen, Guangquan Jie, Chang Liu, Henghui Ding

2026-06-26视觉感知

该文针对视频抠图同时需要稳健时序跟踪与细粒度透明度估计、而视频 alpha 标注昂贵且领域狭窄的问题,提出将任务解耦为 VOS 跟踪器与图像级抠图头:保留 SAM2/SAM3 的跟踪能力,用 ROI Detector 找出半透明和细节区域,再由 Progressive Alpha Predictor 粗到细预测 alpha。模型仅用图像抠图数据训练,却在视频抠图零样本评测中达到 SOTA,并支持多种提示;SAM2.1-Tiny 版本据称可在 1080p 视频上约 40 FPS、显存低于 5GB。

RoPEMover: Depth-Aware Object Relocation via Positional Embeddings Figure 1
2026-06-26cs.CV

RoPEMover: Depth-Aware Object Relocation via Positional Embeddings

Ipek Oztas, Duygu Ceylan, Aybars Bugra Aksoy, Aysegul Dundar

Bilkent University, Brown University, Bilkent University

2026-06-26视觉感知

针对单图物体搬移中身份保持、遮挡补全、阴影反射随位置更新等几何一致性难题,RoPEMover 的关键洞察是把扩散 Transformer 的 RoPE 视为可操控空间场,并引入深度感知扩展来控制前后遮挡关系。方法仅用合成数据加少量真实图微调,在标准物体移动基准上据称各项指标达到 SOTA,同时支持更可信的新区域生成和光照阴影传播。

Empowering GUI Agents via Autonomous Experience Exploration and Hindsight Experience Utilization for Task Planning Figure 1
2026-06-26cs.CL

Empowering GUI Agents via Autonomous Experience Exploration and Hindsight Experience Utilization for Task Planning

Tianyi Men, Zhuoran Jin, Pengfei Cao, Yubo Chen, Kang Liu, Jun Zhao

The Key Laboratory of Cognition and Decision Intelligence for Complex Systems, Institute of Automation, Chinese Academy of Sciences, Beijing, China, School of Artificial Intelligence, University of Chinese Academy of Sciences, Beijing, China

2026-06-26规划控制

针对小型开源多模态 GUI Agent 在跨网站任务规划中能力弱、泛化差的问题,论文提出 PEEU:先让模型在网站中自主设定目标并探索,再用 hindsight 将已收集轨迹反向对齐为约束更严格的高层任务数据。其 TDHAF 分析指出,原子操作训练不足以带来高层规划能力,高层经验更利于 OOD 泛化;在真实网站评测中,7B 模型达到 30.6% 准确率,超过更大的 Qwen2.5-VL-32B。

Hallucination in World Models is Predictable and Preventable Figure 1
2026-06-26cs.LG

Hallucination in World Models is Predictable and Preventable

Nicklas Hansen, Xiaolong Wang

2026-06-26强化学习

这篇论文关注视觉世界模型在控制 rollout 中“看似合理但偏离真实动力学”的幻觉问题,指出其根因主要是状态-动作覆盖不足,而非单纯模型架构缺陷。作者构建 MMBench2,并将幻觉拆为感知、动作边缘化和场景发散三类,提出无需额外标注的预测信号用于检测与采样。实验显示覆盖感知训练可同步降低多类失败,用预测器作好奇心奖励时,仅约 50 条真实轨迹即可将预训练模型适配到未见环境;但结论仍局限于 350M 规模模拟任务,迁移到真实机器人尚未充分说明。

Not All Actions Are Equal: Rethinking Conditioning for Dexterous World Model Figure 1
2026-06-26cs.CV

Not All Actions Are Equal: Rethinking Conditioning for Dexterous World Model

Zizhao Yuan, Zhengtu Liang, Taowen Wang, Qiwei Liang, Yichi Wang, Yunheng Wang, Yuetong Fang, Lusong Li, Zecui Zeng, Renjing Xu

The Hong Kong University of Science and Technology (Guangzhou), Shenzhen University, Beijing University of Technology, JD Explore Academy

2026-06-26强化学习

本文针对高自由度灵巧操作中动作维度尺度差异大、传统全局压缩会淹没细微手指信号的问题,提出 DexAC-WM:将动作按维度 token 化并做幅值对齐,再用局部交叉注意力与全局调制联合注入,同时引入 DINOv3 与 VLM 语义分支。EgoDex、EgoVerse 实验显示其在 FID、FVD、PCK 上优于 Wan、IRASim、Cosmos 等基线,说明结构化动作建模能提升视觉时序真实感和动作跟随一致性。

OctoSense: Self-Supervised Learning for Multimodal Robot Perception Figure 1
2026-06-26cs.CV

OctoSense: Self-Supervised Learning for Multimodal Robot Perception

Anthony Bisulco, Jeremy Wang, Kostas Daniilidis, Randall Balestriero, Pratik Chaudhari

General, Robotics, Automation, Sensing and Perception (GRASP) Laboratory, University of Pennsylvania, Computer Science Department, Brown University, SSL has been instrumental in building highly general representations trained on unlabeled data. These

2026-06-26机器人视觉语言

针对真实机器人中单一视觉传感器在弱光、运动、遮挡或丢包下易失效的问题,OctoSense同时贡献开源多传感器硬件与59小时同步驾驶数据,并用模态专属 tokenizer 加共享 MAE 做后融合自监督表征、推理缓存新测量。结果显示其在深度、光流、语义分割和自运动估计上优于图像 SSL 基线,夜间和传感器退化场景增益更明显,但规模仍不足以称为通用基础模型。

ViQ: Text-Aligned Visual Quantized Representations at Any Resolution Figure 1
2026-06-26cs.CV

ViQ: Text-Aligned Visual Quantized Representations at Any Resolution

Xumin Yu, Zuyan Liu, Zhenyu Yang, Yuhao Dong, Shengsheng Qian, Jiwen Lu, Han Hu, Yongming Rao

Tsinghua University, Nanyang Technological University, Chinese Academy of Sciences

2026-06-26视觉感知

ViQ针对多模态模型中视觉连续特征与文本离散 token 不匹配、而现有视觉量化又难兼顾语义和细节的问题,提出先进行文本对齐预训练、再用近端表示学习和位置感知的分头量化逐步离散化,并支持原生任意分辨率输入。实验显示其在9个理解基准上接近或略超主流连续视觉编码器,同时保持较好重建质量,并使多模态训练加速约20%–70%。

See & Sniff: Learning Visuo-Olfactory Representations Figure 1
2026-06-26cs.CV

See & Sniff: Learning Visuo-Olfactory Representations

Seongyu Kim, Seungwoo Lee, Hyeonggon Ryu, Joon Son Chung, Arda Senocak

2026-06-26视觉感知

这篇论文针对嗅觉在多模态学习中因缺少视觉-气味配对数据而长期缺位的问题,提出利用同一语义类别内气味相对不随视觉变化而改变的洞察,将已有嗅觉数据与网络图像合成配对为 SmellNet-V,并用 See & Sniff 通过局部密集对齐学习视觉-嗅觉表征。结果显示其在仅凭气味分类上较 smell-only 基线提升约 7%,并可用于跨模态检索和气味源定位。

Sculpting NeRF Geometry: Human-Preference Fine-Tuning of a 3D-Aware Face GAN Figure 1
2026-06-26cs.CV

Sculpting NeRF Geometry: Human-Preference Fine-Tuning of a 3D-Aware Face GAN

Archer Moore, Mingming Gong, Liam Hodgkinson

School of Mathematics and Statistics, The University of Melbourne, Parkville, VIC 3010, Australia

2026-06-26生成模型三维

针对3D感知人脸GAN虽能生成逼真2D图像、但NeRF几何常有鼻部和侧脸伪影的问题,本文用少量人类偏好训练直接读取密度场的几何奖励模型,并在无文本、无网格先验、无多视图渲染下微调EG3D。密度一致性约束尽量保持外观,代价是FID从4.09升至6.66;用户比较中微调几何获74.4%偏好,但训练偏好主要来自单一标注者,泛化仍需验证。

Exact and Deterministic Patch Descriptor Retrieval via Hierarchical Normalization Figure 1
2026-06-26cs.CV

Exact and Deterministic Patch Descriptor Retrieval via Hierarchical Normalization

Koichi Sato

2026-06-26视觉感知

论文针对大规模局部特征匹配中 ANN 方法近似且不稳定的问题,提出层级归一化:把描述子能量集中到 K 维主前缀,并用次要部分的 α 上界做分支定界,从而只精算少量候选却保持与全量 128 维搜索完全一致。HN-HardNet 在 UBC patch 上实现确定性精确检索,K=8 时约 12.7–13.7 倍加速,推荐 K=16、α=1/8 时仍有 7.2 倍加速且 FPR@95 仅小幅上升。

EO-WM: A Physically Informed World Model for Probabilistic Earth Observation Forecasting Figure 1
2026-06-26cs.AI

EO-WM: A Physically Informed World Model for Probabilistic Earth Observation Forecasting

Junwei Luo, Shuai Yuan, Zhenya Yang, Yansheng Li, Zhe Liu, Hengshuang Zhao

The University of Hong Kong, Wuhan University

2026-06-26强化学习

本文将地球观测预测重新表述为稀疏观测下由天气驱动的概率世界模型问题,动机在于现有方法偏重像素重建,难以刻画不确定性和天气扰动下的真实响应。EO-WM 用视频扩散 Transformer 区分气候基线、天气异常与累积热旱胁迫,并设计极端夏季和季节配对基准检验响应一致性。实验显示其在 NDVI 下降幅度误差上相对降低 5.63%,方向命中率提升 7.80%,同时保持接近的常规重建指标。

CORTEX: A Structured Reasoning Benchmark for Trustworthy 3D Chest CT MLLMs Figure 1
2026-06-26cs.CV

CORTEX: A Structured Reasoning Benchmark for Trustworthy 3D Chest CT MLLMs

Hashmat Shadab Malik, Anees Ur Rehman Hashmi, Numan Saeed, Muzammal Naseer, Salman Khan, Christoph Lippert

2026-06-26数据集/基准三维

该文针对3D胸部CT多模态大模型只给最终答案、推理难验证且缺少病史上下文的问题,提出CORTEX基准:把每个样本组织为任务理解、视觉观察、诊断推理、答案合成四阶段,并用临床参与设计的分阶段rubric和放射科专家审核筛选。基于CT-RATE,最终得到76,177条验证推理轨迹,覆盖开放/封闭VQA与报告生成;但文中主要贡献是数据与评测协议,模型训练增益尚未充分说明。

From Celebrities to Anyone: Characterizing AI Nudification Content, Technology, and Community Dynamics on 4chan Figure 1
2026-06-26cs.CY

From Celebrities to Anyone: Characterizing AI Nudification Content, Technology, and Community Dynamics on 4chan

Chi Cui, Yixin Wu, Yang Zhang

CISPA Helmholtz Center for Information Security

2026-06-26视觉感知

针对生成式 AI 非自愿色情合成从名人事件扩散到普通人的风险,本文对 4chan Adult Requests 进行 41 天大规模实测,创新在于直接观察匿名请求—满足生态而非只看平台或模型库。研究识别 24,105 个 SNEACI 项,发现非名人已占 55.8%,视频占比达 34.0%;生产主要依赖缺乏护栏的开源模型,Stable Diffusion 系列贡献 42.7% 图像、Wan 贡献 66.5% 视频,且少数高活跃生产者通过产出、教程和资源分享维持并放大该生态。

SatSplatDiff: Geometry-preserving generative refinement for high-fidelity satellite Gaussian Splatting Figure 1
2026-06-26cs.CV

SatSplatDiff: Geometry-preserving generative refinement for high-fidelity satellite Gaussian Splatting

Jiyong Kim, Shuang Song, Ronjgun Qin

aDepartment of Civil, Environmental and Geodetic Engineering, The Ohio State University, Columbus, 43210, OH, USA, bDepartment of Electrical and Computer Engineering, The Ohio State University, Columbus, 43210, OH, USA, geometric accuracy throughout the pipeline, it further demonstrates seamless cross-tile consistency and strong scalability for large-, scale reconstruction. Source code is available at https://github.com/GDAOSU/SatSplatDiff, strating scalability for larger area. Our major contributions can

2026-06-26生成模型三维

针对卫星视角近似俯视导致建筑立面监督不足、扩散式视图增强易产生幻觉并破坏几何一致性的问题,SatSplatDiff将摄影测量DSM初始化、单目深度监督、多尺度几何细化与基于阴影图约束的生成式细化结合,用稳定的光照/阴影几何线索控制扩散先验。在IARPA2016和DFC2019上,方法将几何MAEreg最高降低18%,FID-CLIP提升28–45%,并实现最高5倍分辨率增强且跨瓦片一致性较好。

LISA: Likelihood Score Alignment for Visual-condition Controllable Generation Figure 1
2026-06-26cs.CV

LISA: Likelihood Score Alignment for Visual-condition Controllable Generation

Yanghao Wang, Hongxu Chen, Jiazhen Liu, Zhenqi He, Rui Liu, Zhen Wang, Long Chen

The Hong Kong University of Science and Technology

2026-06-26规划控制

本文针对视觉条件可控生成中双分支范式训练效率和侧分支作用不清的问题,从 score-based 视角指出主网络主要提供无条件分数、侧网络应学习条件带来的 likelihood score。LISA 用轻量解码器将侧网络中间特征对齐到近似 likelihood score,作为扩散/flow 训练的正则项;实验覆盖图像、视频、多种条件和架构,显示可加速收敛、提升感知质量与条件一致性,且几乎不增加训练成本、推理零开销。

HarmVideoBench: Benchmarking Harmful Video Understanding in Large Multimodal Models Figure 1
2026-06-26cs.CV

HarmVideoBench: Benchmarking Harmful Video Understanding in Large Multimodal Models

Jiajun Wu, Haoyu Kang, Yining Sun, Jiacheng Hou, Heng Zhang, Danyang Zhang, Zhenjun Zhao, Haochi Zhang, Leixin Sun, Eric Hanchen Jiang, Yushan Li, Ruiyu Li, Mengkai Huang, Yan Gao, Xu Zhang, Guancheng Wan

2026-06-26视觉语言视觉感知数据集/基准

针对现有有害视频评测多停留在二分类且缺少可解释依据的问题,论文提出 HarmVideoBench,将理解拆成可观测证据、片内含义和片外背景推理三层,并构建 1,379 个视频与 4,137 道选择题。对 19 个模型的评测显示,模型在表层线索较强、在隐含语义和文化/历史背景推理上明显不足;其 BCR 方法通过判断推理边界并按需检索上下文,将宏平均从 61.7% 提升到 84.4%。

Safe Autoregressive Image Generation with Iterative Self-Improving Codebooks Figure 1
2026-06-26cs.CV

Safe Autoregressive Image Generation with Iterative Self-Improving Codebooks

Yunqi Xue, Zhijiang Li, Philip Torr, Jindong Gu

2026-06-26视觉感知安全鲁棒

本文关注自回归统一多模态模型的图像安全问题:这类模型依赖离散视觉码本,扩散模型的连续潜空间安全方法难以直接适用。核心做法是让模型自判不安全生成,构造有害空间并迭代修正码本,再在无害空间内自适应微调以保质量。实验覆盖八个有害提示集、五类生成模型和 OOD 数据,显示安全性可迭代提升且较好保留生成能力。

FlameVQA: A Physically-Grounded UAV Wildfire VQA Benchmark with Radiometric Thermal Supervision Figure 1
2026-06-26cs.CV

FlameVQA: A Physically-Grounded UAV Wildfire VQA Benchmark with Radiometric Thermal Supervision

Mobin Habibpour, John Spodnik, Niloufar Alipour Talemi, Fatemeh Afghah

2026-06-26视觉感知数据集/基准

针对无人机野火监测中烟雾遮挡、尺度变化使纯 RGB VQA 难以可靠支撑安全决策的问题,FlameVQA 基于 FLAME 3 构建成对 RGB、热成像 JPEG 与辐射热 TIFF 的多选基准,每图 34 题覆盖检测、定位、覆盖估计、跨模态推理和飞行规划,并用热规则、一致性检查与人工审核生成标签。实验显示模型在显式跨模态线索下表现较好,但在浓烟下存在性判断和覆盖估计上仍明显失效。

Proposal-Conditioned Latent Diffusion for Closed-Loop Traffic Scenario Generation Figure 1
2026-06-26cs.RO

Proposal-Conditioned Latent Diffusion for Closed-Loop Traffic Scenario Generation

Shubham Vaijanath Phoolari, Aleyna Kara, Christoph Lauer, Steven Peters

2026-06-26生成模型

面向自动驾驶验证中“既要逼真又要可控且能闭环重规划”的交通场景生成难题,论文提出以候选轨迹为条件的联合潜空间扩散策略:用实例中心场景编码与多模态边缘 proposal 初始化紧凑动作潜变量,并在测试时加入地图、碰撞和博弈目标引导。Waymo 实验显示,该方法较独立边缘组合更能保持交互一致性,并可在真实性、安全关键性与运行效率之间调节,但强引导会带来一定越界和保真度折衷。

TMP: Tree-structured Mixed-policy Pruning for Large-scale Image Generation and Editing Figure 1
2026-06-26cs.CV

TMP: Tree-structured Mixed-policy Pruning for Large-scale Image Generation and Editing

Peizhen Zhang, Yang Li, Xunsong Li, Songtao Liu, Zewen Liu, Qiangqiang Hu, Guotong Guo, Jupeng Ding, Yifu Sun, coopersli, Jian Zhang, Zhao Zhong, Liefeng Bo

Multimodal Model Department, Tencent

2026-06-26视觉感知强化学习

这篇论文针对大规模图像生成/编辑模型参数和显存成本过高、难以在消费级硬件部署的问题,提出 TMP 结构化剪枝框架:先联合剪枝,再用树状合并的局部特征监督与离/在线混合策略蒸馏缓解层间误差累积。实验将 HunyuanImage-3.0 从 80B 压到 20B,并可在单张 24GB 4090 上推理;Z-Image turbo 从 6B 压到 4B,质量退化较小。

SubdivAR: Autoregressive Next-Scale Prediction for Neural Mesh Subdivision Figure 1
2026-06-26cs.CV

SubdivAR: Autoregressive Next-Scale Prediction for Neural Mesh Subdivision

Huipeng Guo, Zikai Song, Hang Long, Jielei Zhang, Wenbing Li, Junkai Lin, Tianhao Zhao, Jinshen Zhang, Tianle Guo, Wei Yang

Huazhong University of Science and Technology

2026-06-26视觉感知

本文针对传统网格细分易过平滑、现有神经方法偏局部且难处理开放曲面的问题,提出将多级细分网格组织为自回归尺度序列,通过下一尺度坐标偏移预测保持拓扑并补充细节;其混合拓扑感知 Transformer 结合全局语义注意力与局部拓扑聚合,并配套构建 FII-40K 数据集。实验显示相对 SOTA 将 Hausdorff 与 Chamfer 距离分别降低 18.8% 和 14.2%,但部分增益可能来自数据清洗与规模化监督。

Pseudo-Text-Conditioned 3D Grounding DINO for Organ Localization in Abdominal CT Figure 1
2026-06-26cs.CV

Pseudo-Text-Conditioned 3D Grounding DINO for Organ Localization in Abdominal CT

Siqi Chen, Han Gong, Keyi Hou, Jingxuan Yang, Sheethal Bhat, Andreas Maier

2026-06-26视觉语言生成模型三维

面向腹部创伤 CT 中后续损伤分析需要稳定器官空间先验的问题,本文将 Grounding-DINO 式查询检测扩展到 3D,用冻结伪文本类别 token 替代真实文本编码器,并结合 Swin3D、多模态特征增强和跨模态解码预测五类器官框。在 193 例 RSNA/RATIC 体数据上,最佳从零训练多尺度模型 mAP 为 0.5830,粗定位很强(IoU 0.1 AP 0.9649),但严格框对齐仍弱(IoU 0.7 AP 0.1552),伪文本增益相对纯 3D 检测基线仍文中未充分说明。

PanoImager: Geometry-Guided Novel View Synthesis and Reconstruction from Sparse Panoramic Views Figure 1
2026-06-26cs.CV

PanoImager: Geometry-Guided Novel View Synthesis and Reconstruction from Sparse Panoramic Views

Zhisong Xu, Takeshi Oishi

Zhisong XU and Takeshi Oishi are with the Institute of Industrial Science, The University of Tokyo, Tokyo, Japan

2026-06-26视觉感知三维

针对机器人在室内巡检、狭窄空间探索等场景中常见的少量全景图、弱视差或近纯旋转采集,PanoImager绕开易失效的SfM/SLAM初始化,将全景拆成局部透视视图,用前馈姿态/深度先验锚定几何,再以深度和位姿约束的扩散补全视角,并通过可靠性软监督与深度约束3DGS抑制漂浮物和幻觉。多基准实验显示其在极稀疏输入下重建更稳定,适合作为SLAM失败后的离线地图细化组件。

Just how sure are you? Improving Verbalized Uncertainty Calibration in Medical VQA Figure 1
2026-06-26cs.LG

Just how sure are you? Improving Verbalized Uncertainty Calibration in Medical VQA

Eren Senoglu, Federico Toschi, Nicolo Brunello, Andrea Sassella, Mark James Carman

2026-06-26安全鲁棒

本文关注医疗视觉问答中多模态大模型“答错也很自信”的风险,认为仅沿用文本模型的口头置信度校准会忽视图像证据。方法通过图像有无与文本选项扰动构成2×2条件,结合Brier校准、锚定、图文对齐和top-k KL稳定项微调模型,使置信度更反映视觉证据依赖。在三个医疗VQA基准和两种架构上,校准误差降低60%以上、区分能力提升26%以上,且基本保持答题准确率。

On-board Remote-Sensing Foundation Models for Unsupervised Change Detection of Disaster Events Figure 1
2026-06-26cs.CV

On-board Remote-Sensing Foundation Models for Unsupervised Change Detection of Disaster Events

S. Ramírez-Gallego

2026-06-26视觉感知

面向灾害监测中星上算力、下传带宽和标注稀缺的约束,论文提出 UDFPN:用 SSL4EO-L 预训练 ResNet 作为遥感基础模型骨干,叠加未训练冻结 FPN,在单次图像级前向中恢复高分辨率空间嵌入,并以局部余弦距离做无监督变化检测。实验在 Landsat-8 火灾、洪水和滑坡事件上显示,其滑坡检测优于 PANN,并能生成更细粒度变化图;但整体事件规模较小,泛化增益来源仍需更多验证。

Event-Aware Instructed Assistant for Referring Video Segmentation Figure 1
2026-06-26cs.CV

Event-Aware Instructed Assistant for Referring Video Segmentation

Jinyu Liu, Henghui Ding, Shuting He, Yu-Gang Jiang

2026-06-26视觉感知

这篇论文针对指代表达视频分割中将整段视频视为单一事件、易混淆复杂动作和文本关系的问题,提出 EVIS:用文本引导的可学习 Event Query 将视频拆成多个简单事件,并通过 EAFM、事件内/事件间注意力及 Object-Pixel-Hybrid Learning 融合对象与像素线索。实验在 5 个公开视频基准上验证有效性,其中 MeViS 达到 46.8% J&F,显示事件级分解有助于长时目标跟踪与语义对齐。

Unison: Benchmarking Unified Multimodal Models via Synergistic Understanding and Generation Figure 1
2026-06-26cs.CV

Unison: Benchmarking Unified Multimodal Models via Synergistic Understanding and Generation

Jinyu Liu, Xincheng Shuai, Henghui Ding, Yu-Gang Jiang

2026-06-26视觉语言数据集/基准

现有统一多模态模型常被分别考察理解与生成,难以判断二者是否真正协同。Unison提出2169个人工验证样本,从内部一致性、理解引导生成、生成引导理解和相互增强四类任务评测,并配套与人类判断对齐的Unison-Judge及解耦诊断轨道。实验显示,不少在单项理解或生成基准表现强的模型,在联合任务中仍明显受限,提示当前统一建模的协同增益仍不足。

Geometric Gradient Rectification for Safe Open-Set Semi-Supervised Learning Figure 1
2026-06-26cs.CV

Geometric Gradient Rectification for Safe Open-Set Semi-Supervised Learning

Jiahe Chen, Qian Shao, Qiyuan Chen, Jiaying He, Jintai Chen, Jian Wu, Hongxia Xu

2026-06-26优化算法安全鲁棒

这篇论文针对开放集半监督学习中“过滤会丢掉困难类内样本、利用又会引入错误伪标签梯度”的矛盾,提出把问题从样本筛选转向梯度几何控制。其核心是用有标签监督梯度作锚点,将冲突的无标签辅助梯度投影到不反向的安全区域,并用子空间版本缓解小批量噪声。CIFAR 与 ImageNet 实验显示,GGR可作为插件提升多种OSSL基线,在低标签场景下同时改善闭集泛化和开放集鲁棒性。

Computer Vision for MOBA Analytics: A Dataset and Baseline for Visibility Analysis in Dota 2 Figure 1
2026-06-26cs.CV

Computer Vision for MOBA Analytics: A Dataset and Baseline for Visibility Analysis in Dota 2

Ricardo da Rocha Carvalho, Eloísa Oliveira, Luiz Bernardo Martins Kummer, Emerson Cabrera Paraiso, Rayson Laroca

2026-06-26视觉感知数据集/基准

这篇论文针对 MOBA 分析中过度依赖日志、坐标等结构化数据、难以刻画“敌方实际看见了什么”的问题,提出 Dota2-Vis:包含 TI 2025 全部 144 场双视角全高清视频和 2477 张人工标注小地图图像,并用小地图玩家图标检测来估计对手可见的地图存在。实验中 YOLO11l 表现最好,生成的可见性曲线揭示了玩家、英雄、位置和胜负队伍在活动时机、暴露风险与地图压力上的差异,为赛后复盘和战术分析提供了结构化数据难以直接获得的视觉信号。

Einstein World Models Figure 1
2026-06-26cs.AI

Einstein World Models

Munachiso Samuel Nwadike, Zangir Iklassov, Ali Mekky, Zayd M. Kawakibi Zuhri, Kentaro Inui

Tohoku University

2026-06-26强化学习

本文动机是弥补纯文本链式推理难以处理反事实、物理直觉和场景演化的问题。核心洞察是把“视觉思想实验”做成可调用的 world-module:LLM 在推理中少量生成视频式 rollout,并把它作为可检查假设继续推理,而非最终答案。主要结果偏概念框架与训练数据建议,文中未充分说明实证增益。

Look-Before-Move: Narrative-Grounded World Visual Attention in Dynamic 3D Story Worlds Figure 1
2026-06-26cs.AI

Look-Before-Move: Narrative-Grounded World Visual Attention in Dynamic 3D Story Worlds

Jiaming Bian, Bingliang Li, Yuehao Wu, Pichao Wang, Zhi Wang, Hailan Ma, Huadong Mo, Zhenhong Sun

2026-06-26强化学习三维

这篇论文关注动态三维故事世界中的具身视觉规划:相机不应先生成运动再被动观察,而要先根据叙事意图决定该看什么。其核心做法是将意图转成语义观察契约,再用蒙特卡洛视点搜索筛选兼顾叙事与几何可行性的视角,并用轨迹 grounding 生成连续避障运动。在基于 StoryBlender 的 50 个故事、1585 个镜头基准上,方法在主体感知、意图一致性和轨迹质量上优于代表性基线。

Scaling Multi-Reference Image Generation with Dynamic Reward Optimization Figure 1
2026-06-26cs.CV

Scaling Multi-Reference Image Generation with Dynamic Reward Optimization

Wenwang Huang, Yusen Fu, Junjie Wang, Mengfei Huang, Yulin Li, Gan Liu, Jing Cai, Yancheng He, Zhuotao Tian

2026-06-26视觉感知强化学习优化算法

本文针对多参考图像生成在参考类型混杂、数量增多时性能快速退化的问题,提出 OmniRef-Bench 进行更细粒度评测,并用 DyRef 两阶段训练框架结合 SFT、难度感知优势重加权和判别式奖励缩放,将优化重点转向困难样本。实验显示其显著提升开源模型在复杂 MRIG 与单图编辑任务上的表现,部分结果接近闭源模型。

No Figure
2026-06-26cs.CV

TraMP-LLaMA: Generative Interpretability with Decoupled Instruction Tuning for Facial Expression Quality Assessment

Shuchao Duan, Alan Whone, Hossein Rahmani, Jun Liu, Majid Mirmehdi

2026-06-26生成模型

针对帕金森等场景中面部表情质量评估只给严重度分数、缺少可审计运动证据的问题,TraMP-LLaMA在VideoLLaMA3上加入面部关键点轨迹流,并用解耦指令微调阻断文本生成损失对运动编码与融合模块的干扰,同时预测分数和生成结构化报告。作者还构建PFED5+文本标注集;实验显示其报告生成优于VLM基线,联合多表情训练下Spearman相关较竞品至少提升4.39%。

Focusing on What Matters: Saliency-Harnessing Accurate Routing for Diffusion MoE Figure 1
2026-06-26cs.CV

Focusing on What Matters: Saliency-Harnessing Accurate Routing for Diffusion MoE

Haoyou Deng, Keyu Yan, Chaojie Mao, Xiang Wang, Yu Liu, Changxin Gao, Nong Sang

2026-06-26生成模型

本文针对扩散 MoE 中路由器受去噪噪声潜变量干扰、难以把更多专家分配给显著图像区域的问题,提出 SharpMoE:用前一去噪步预测的干净潜变量指导当前路由,并用轨迹路由损失约束整段生成过程的计算分配。实验称其可作为后训练、即插即用增强,用少量更新提升已收敛扩散 MoE,并在视觉生成指标上达到 SOTA。

PortraitGen: Exemplar-Driven GRPO with Dual-Reward Guidance for Photorealistic Portrait Generation Figure 1
2026-06-26cs.CV

PortraitGen: Exemplar-Driven GRPO with Dual-Reward Guidance for Photorealistic Portrait Generation

Xiaomin Li, Qian Liang, Yinan Li, Ying Zhang, Chen Li, Jing Lyu, Huchuan Lu, Xu Jia

2026-06-26强化学习

本文针对现有 T2I 强化学习后训练偏向提升色彩、构图等表层审美,却难以消除人像中的油腻皮肤、AI 痕迹和手指等生物不合理问题。PortraitGen 的关键做法是在 GRPO 采样组中注入真实人像,并用反演获得可优化轨迹,同时结合通用质量 OmniReward 与人像保真 AI-Portrait 双奖励。实验称其在 PortraitBench 上优于 FlowGRPO、DanceGRPO 等基线,更能压制伪影并提升照片真实感。

PhysRAG: Enhancing Physics-Awareness in Video Generation via Retrieval-Augmented Generation Figure 1
2026-06-26cs.CV

PhysRAG: Enhancing Physics-Awareness in Video Generation via Retrieval-Augmented Generation

Kexu Cheng, Zicheng Liu, Mingju Gao, Chunhe Song, Hao Tang

2026-06-26视觉感知

本文针对视频生成模型画面逼真但物理规律一致性不足的问题,提出 PhysRAG:先从 WISA-80K 通过两阶段过滤构建约 7K 高质量物理视频训练集,再检索相关物理视频,用 VideoMAE 特征和可学习查询将外部物理先验注入 DiT。实验在 PhyGenBench、VBench 上显示其在视觉质量和物理规则符合度上优于多种基线,但部分增益可能与数据筛选质量相关。

Neural Texture Compression using Hypernetworks Figure 1
2026-06-26cs.GR

Neural Texture Compression using Hypernetworks

Belcour Laurent

2026-06-26视觉感知

面向实时 PBR 中多张材质贴图带来的存储与带宽压力,本文用单个超网络直接为任意纹理集生成 BC1 潜变量和小型 MLP 解码器参数,替代逐材质梯度优化。结果显示其压缩质量接近现有 BCF1 神经纹理压缩器,并可扩展到多解码器和超分辨率任务;但文中也指出仍有全局色偏,增益更多体现在省去优化流程而非显著提升画质。

Qwen-Image-Agent: Bridging the Context Gap in Real-World Image Generation Figure 1
2026-06-26cs.CV

Qwen-Image-Agent: Bridging the Context Gap in Real-World Image Generation

Zekai Zhang, Jiahao Li, Jie Zhang, Kaiyuan Gao, Kun Yan, Lihan Jiang, Ningyuan Tang, Shengming Yin, Tianhe Wu, Xiaoyue Chen, Xiao Xu, Yan Shu, Yanran Zhang, Yixian Xu, Yuxiang Chen, Zhendong Wang, Zihao Liu, Zikai Zhou, Huishuai Zhang, Dongyan Zhao, Chenfei Wu

2026-06-26视觉感知强化学习

针对真实图像生成请求常常语义不完整、依赖隐含意图或外部新知识的问题,论文将其概括为用户上下文与生成所需上下文之间的“Context Gap”。Qwen-Image-Agent的核心是用规划、推理、搜索、记忆和反馈逐步补全生成上下文,并提出IA-Bench评测计划、推理、搜索、记忆能力;在IA-Bench、MindBench和WISE-Verified上优于强基线,但具体增益中各模块贡献仍需结合消融细看。

Confidence-Aware Tool Orchestration for Robust Video Understanding Figure 1
2026-06-26cs.CV

Confidence-Aware Tool Orchestration for Robust Video Understanding

Yangfan He, Yujin Choi, Jaehong Yoon

University of Minnesota, Twin Cities, trajectory, recognized text, or action label), temporal grounding, and a calibrated re-, no stronger evidence is available, with residual uncertainty explicitly reported in the final answer.

2026-06-26视觉感知安全鲁棒

本文针对视频大模型在运动模糊、眩光、遮挡等真实退化下仍“盲信”所有帧的问题,提出 Robust-TO:先按帧质量与问题相关性筛选可信关键帧,再将子问题路由到合适感知工具,并把工具输出统一为结果、时间定位与置信度,供分层证据推理和 GRPO 训练使用。实验显示其在干净输入上平均准确率达 56.4%,在五类腐蚀下仍有 54.3%,同时减少约 35% 处理帧数和推理时间。

Tractography-Driven Synthetic Data Generation for Fiber Bundle Segmentation in Tracer Histology Figure 1
2026-06-26cs.CV

Tractography-Driven Synthetic Data Generation for Fiber Bundle Segmentation in Tracer Histology

Kyriaki-Margarita Bintsi, Sparsh Makharia, Yaël Balbastre, Joselyn Romero Avila, Julia F. Lehman, Suzanne N. Haber, Anastasia Yendiki

2026-06-26视觉感知

这篇论文针对猕猴示踪组织学中纤维束标注昂贵、跨脑和不同束密度泛化困难的问题,提出用离体 dMRI tractography 作为几何先验生成合成前景,并与 blockface 背景和域随机化混合训练 2D U-Net。结果显示,纯合成数据不足以替代真实监督,但少量真实标注加合成数据可达到接近 SOTA 的分割表现,并将人工标注需求降至约三分之一。

Modeling Local, Global, and Cross-Modal Context in Multimodal 3D MRI Figure 1
2026-06-26cs.CV

Modeling Local, Global, and Cross-Modal Context in Multimodal 3D MRI

Minh Duc Do, Tillmann Rheude, Noel Kronenberg, Roland Eils, Benjamin Wild

Berlin Institute of Health at Charité - Universitätsmedizin Berlin, Health Data Science Unit, Heidelberg University Hospital and BioQuant, Intelligent Medicine Institute, Fudan University, Department of Mathematics and Computer Science, Freie Universität Berlin

2026-06-26视觉语言三维

针对多模态3D脑MRI中局部结构、全脑上下文与跨模态互补信息难以同时建模的问题,论文提出MICViT,将模态内局部/全局注意力与跨模态局部/全局注意力分离组合,以模拟放射科医生的多尺度、多模态推理。其在UK Biobank、SOOP、Cam-CAN脑龄预测中优于3D CNN和Transformer基线,并在加入更多MRI模态时获得更明显增益。

Bridging Vision and Language Concepts through Optimal Transport Semantic Flow Figure 1
2026-06-26cs.CV

Bridging Vision and Language Concepts through Optimal Transport Semantic Flow

Chenyang Zhang, Anqi Dong, Guangming Zhu, Nuoye Xiong, Siyuan Wang, Lin Mei, Liang Zhang

2026-06-26视觉感知生成模型

这篇论文针对视觉语言概念瓶颈模型依赖预对齐嵌入、全局相似度导致细粒度概念定位弱的问题,提出 OTF-CBM:用逆最优传输学习跨模态语义代价,再以非平衡 OT 和流匹配刻画图像区域到文本概念的动态语义流,并用速度一致性激活概念。实验称其在分类准确率、概念忠实度和空间可解释性上优于现有 CBM,但具体增益的消融来源仍需结合完整实验细节判断。

RIS-Assisted Proactive Handover for Reliable mmWave Wireless Networks Figure 1
2026-06-26cs.CV

RIS-Assisted Proactive Handover for Reliable mmWave Wireless Networks

Alaa Adnan, Mohammad Al-Quraan, Ahmed Zoha, M. Majid Butt, Sami Muhaidat, Muhammad Ali Imran, Marco Di Renzo, Lina Mohjazi

and Communication Engineering, Khalifa University, Abu Dhabi 127788

2026-06-26视觉感知

针对毫米波链路易被遮挡且附近未必有可切换基站的问题,本文把视觉辅助的主动切换与RIS反射链路结合,并将RIS配置时延纳入切换准备约束;核心是用离线PSO优化RIS端到端链路和分配单元数,在链路质量、复杂度与能耗间取舍。结果显示,减少12% RIS单元可降低约10%耗散能量且不损失SNR,遮挡区域SNR提升约15–30 dB。

SpatialFlow-GRPO: Where Spatial Credit Drives Image Editing Figure 1
2026-06-26cs.CV

SpatialFlow-GRPO: Where Spatial Credit Drives Image Editing

Yankai Yang, Yancheng Long, Wei Chen, Xingyu Lu, Hongyang Wei, Bin Wen, Fan Yang, Tingting Gao, Han Li, Shuo Yang

2026-06-26视觉感知生成模型

这篇论文针对扩散图像编辑中全图奖励把不同区域成败混在一起的问题,指出 Flow-GRPO 类方法存在“空间信用分配”缺口。SpatialFlow-GRPO 用区域感知奖励模型 SFReward 将语义区域得分转成局部优势,并对齐到潜空间位置更新,同时构建 SFReward-14K 与 MultiEditBench。实验显示其在 OmniGen2、FLUX.2-klein-4B 上优于 Flow-GRPO,尤其提升多区域编辑,但效果仍依赖区域标注和奖励模型可靠性。

Rolling Shutter Relative Pose Estimation Made Practical Figure 1
2026-06-26cs.CV

Rolling Shutter Relative Pose Estimation Made Practical

Daniel Barath

2026-06-26三维

滚动快门相机会因逐行曝光破坏传统恒定本质矩阵假设,使相对位姿估计在RANSAC中因需20个点匹配而难以实用。论文的核心做法是把仿射对应引入滚动快门两视几何,推导考虑行相关本质矩阵与局部扰动耦合的约束,并构造仅需7个仿射对应的线性化代数求解器。实验显示其在TUM-RS上取得最佳位姿和滚动快门参数精度,显著改善平移速度估计,同时在EuRoC全局快门数据上接近5点法表现。

Appearance-Preserving Refinement of Generated 3D Assets for Monochromatic Fabrication Figure 1
2026-06-26cs.GR

Appearance-Preserving Refinement of Generated 3D Assets for Monochromatic Fabrication

Chentao Shen, Chen Jia, Mingjie Huang, Zhuang Zhang, Haisen Zhao, Xiangru Huang

2026-06-26三维

这篇论文针对生成式3D资产在单色3D打印中丢失纹理细节的问题,指出仅保形状不足以保外观。作者提出GenMF后处理框架,将纹理线索转化为几何诱导的灰度阴影,并用可微热应力预测器约束高频扰动以兼顾制造鲁棒性。实验、消融、FEM仿真和实物打印显示,其在单色渲染下保留更多可识别细节,同时降低应力集中。

Liquid Fusion of Heterogeneous Representations Towards General Salient Object Detection Figure 1
2026-06-26cs.CV

Liquid Fusion of Heterogeneous Representations Towards General Salient Object Detection

Ke Chen, Ling Zhou, Guangqi Jiang, Gengshen Wu, Yi Liu, Shoukun Xu

2026-06-26视觉感知

本文针对通用显著目标检测中单一 CNN、SSM 架构存在频谱偏置、难以同时兼顾全局语义与边界细节的问题,提出 LFNet:先用数据集级频谱分析指出 ConvNeXt 与 VMamba 的频率偏好互补,再以液态状态-刺激机制动态融合两类特征,并加入显著性引导上采样抑制伪影。实验覆盖 RGB、RGB-D、RGB-T、视频和 VDT 五类任务,报告达到新 SOTA 且兼顾效率。

Ordinal Neural Collapse as a Representation Prior for Visual Navigation Figure 1
2026-06-26cs.RO

Ordinal Neural Collapse as a Representation Prior for Visual Navigation

E-In Son, Jung-Taak Kim, Seung-Woo Seo

2026-06-26机器人

本文针对端到端视觉导航中编码器只受动作损失间接监督、易学到与控制无关表征的问题,提出 ORION:利用从 Far Left 到 Far Right 的目标相对方向天然有序性,将类别均值压到一条有序判别轴并抑制轴外方差,再接入扩散式导航策略微调。仿真和真实实验显示其较 NoMaD 与普通神经坍缩基线提升成功率和目标进展,在复杂路口等视觉歧义场景收益更明显,最高成功率增益约 26 个百分点。

Identifying the Unknown: Prompt-Free Open Vocabulary Anomaly Recognition for Robot-Object Interaction Figure 1
2026-06-26cs.CV

Identifying the Unknown: Prompt-Free Open Vocabulary Anomaly Recognition for Robot-Object Interaction

Philipp Allgeuer, Jan-Gerrit Habekost, Stefan Wermter

2026-06-26机器人视觉感知

面向机器人在开放环境中遇到未知物体却无法预先给出类别提示的问题,论文提出 AnomNOVIC:先用只见过空工作台的 MAE 以“异常即物体”生成类无关框,再交给 prompt-free 的 NOVIC 做细粒度命名,从而解耦定位与开放词表分类。在 NICOL 桌面场景中达到 47.1% AP、57.5% AP50,给定候选类时升至 59.0% AP、72.5% AP50,并在额外数据上最高取得 82.6% 检测分类准确率,优于 YOLO-World-v2、OWLv2 和 YOLOE。

Learning Adversarial Augmentation Policies for Robust Garlic Seedling Detection Figure 1
2026-06-26cs.CV

Learning Adversarial Augmentation Policies for Robust Garlic Seedling Detection

Soeun Lee, Chanho Kim, Yeji Kang, YoungKi Hong, Byeongkeun Kang

2026-06-26视觉感知强化学习安全鲁棒

面向地面平台在强阴影、过曝和空间不均匀光照下的大蒜幼苗检测,论文构建真实田间数据集,并用强化学习学习输入条件化的对抗增强策略,在训练中制造困难但受结构惩罚约束的扰动,推升检测器鲁棒性且不增加推理开销。实验中 AP50 达 91.6%,较基线提升 0.9 个百分点;缺苗定位精度 75.0%、F1 为 67.0%,分别较基线提升 4.8 和 2.0 个百分点。

Multi-modality Image Fusion under Adverse Weather: Mask-Guided Feature Restoration and Interaction Figure 1
2026-06-26cs.CV

Multi-modality Image Fusion under Adverse Weather: Mask-Guided Feature Restoration and Interaction

Xilai Li, Xiaosong Li, Haishu Tan, Tao Ye, Huafeng Li, Hongbin Wang

2026-06-26视觉感知

这篇论文针对恶劣天气下红外-可见光等多模态图像同时退化与互补信息难以利用的问题,提出 AMG-Fuse:用伪真值降低早期训练难度,再从源图与融合结果关系生成模态贡献掩码,引导跨模态注意力、特征恢复和退化感知学习,以避免只拟合伪目标的静态偏差。实验称其在合成与真实恶劣天气数据上优于现有方法,并提升下游任务表现;但计算量较高,实时应用仍受限。

Improving Vision-Language-Action Model Fine-Tuning with Structured Stage and Keyframe Supervision Figure 1
2026-06-26cs.RO

Improving Vision-Language-Action Model Fine-Tuning with Structured Stage and Keyframe Supervision

Yuan Xu, Yixiang Chen, Kai Wang, Jiabing Yang, Peiyan Li, Qisen Ma, Yan Huang, Liang Wang

2026-06-26视觉语言视觉感知

这篇论文针对 VLA 微调中连续动作损失对所有时刻一视同仁、难以显式学习抓手开合附近阶段转换的问题,提出 StaKe:从演示中的抓手状态自动构造阶段分类和下一关键帧动作预测两个辅助监督,并仅在训练时加入轻量头,不改变推理流程。实验显示其在双臂仿真和 Franka 真机任务上分别带来约 14% 和 56% 相对成功率提升,长程、含更多抓手事件的任务收益更明显。

NaviCache: Test-Time Self-Calibration Caching for Video Generation Figure 1
2026-06-26cs.CV

NaviCache: Test-Time Self-Calibration Caching for Video Generation

Zheqi Lv, Zhibo Zhu, Jinke Wang, Qi Tian, Shengyu Zhang, Zhengyu Chen, Chengxi Zang, Zhou Zhao, Fei Wu

2026-06-26视觉感知

这篇论文面向视频扩散模型推理开销高的问题,指出现有免离线校准缓存方法用零阶近似判断跳步,难以跟踪扩散轨迹中的动态变化。NaviCache将特征演化类比为惯性导航,在线估计输入/输出变化比例及漂移,并用初始对齐、噪声调度和不确定性触发的测量更新来控制计算跳过误差。实验覆盖HunyuanVideo、Wan和Open-Sora,显示其跳步误差判断更准确、综合加速保真表现优于TeaCache、MagCache、EasyCache等基线。

ReasonCLIP-58M: Visually Grounded Commonsense Reasoning Supervision for CLIP Figure 1
2026-06-26cs.CV

ReasonCLIP-58M: Visually Grounded Commonsense Reasoning Supervision for CLIP

Sicheng Zhang, Muzammal Naseer, Binzhu Xie, Naufal Suryanto, Shi Qiu, Jamal Bentahar, Naveed Akhtar, Mubarak Shah

2026-06-26视觉感知

针对CLIP预训练偏重图文描述对齐、难以支撑视觉常识与组合推理的问题,论文提出ReasonCLIP-58M:用ReasonLite-42M逐步注入可视觉验证的推理描述,再用ReasonPro-16M进行五类结构化推理监督,并保持骨干不变。实验显示其在视觉 grounding、结构化推理、零样本检索及作为LLaVA-NeXT视觉编码器时均有稳定提升,但部分增益可能主要来自大规模数据与持续训练。

Event-based Gaze Control System for Accurate Real-time Spin Estimation in Professional Ball Games Figure 1
2026-06-26cs.CV

Event-based Gaze Control System for Accurate Real-time Spin Estimation in Professional Ball Games

Yunpu Hu, Fabian Schilling, Valentina Cavinato, Asude Aydin, Agis Politis, Ricardo Tapiador Morales, Kirk Y.W. Scheper, Peter Dürr, Naoya Takahashi

2026-06-26规划控制

论文面向高速球类比赛中小目标、高线速度与高速旋转导致传统相机难以实时估计旋转的问题,提出事件相机、可调焦长焦镜头与高速振镜组成的主动凝视系统,并用球面化对比度最大化分离旋转信息;离线在多类球上达约2.1%幅值误差和4.0°轴误差,在线乒乓场景实现750Hz、3ms延迟,误差约8.8%和6.4°。

No Figure
2026-06-26cs.CV

LearniBridge: Learnable Calibration of Feature Caching for Diffusion Models Acceleration

Xuyue Huang, Zhe Chen, Wang Shen, Xiao-Ping Zhang

2026-06-26生成模型

本文针对 DiT 图像/视频生成推理中,传统特征缓存只复用历史激活、在高加速比下误差累积严重的问题,提出 LearniBridge。其核心洞察是缓存校正更新在不同提示词间共享低秩子空间,因此可用少量样本训练 LoRA 校准器,在跳过目标 timestep 全量计算时重构未来特征。实验显示其在 FLUX、HunyuanVideo、WAN 2.1 上分别达到最高 5.87×、5.75×、4.10×加速,并在 WAN 2.1 的 4.10×设置下较前 SOTA 提升 VBench 1.28%。

ResilPhase: Plug-and-Play Phase Mapping and Noise-Resilient Macro-Trajectory Extrapolation for Diffusion Acceleration Figure 1
2026-06-26cs.AI

ResilPhase: Plug-and-Play Phase Mapping and Noise-Resilient Macro-Trajectory Extrapolation for Diffusion Acceleration

Qicheng Zhao, Yu Li, Qi Sun, Zheyu Yan

2026-06-26生成模型规划控制

这篇论文针对扩散 Transformer 推理延迟高、现有 cache-then-forecast 在高加速比下失真的问题,指出根因是中间特征外推与连续扩散轨迹不对齐且数值不稳定。ResilPhase 改为预测全局漂移的宏轨迹,用无导数的重心 Lagrange 外推避免高阶导数噪声,并通过 Phase Mapping 抑制 Runge 振荡。实验称在 FLUX.1-dev 与 HunyuanVideo 上约 5× 加速且保持较好保真度。

Anatomy-Guided Residual Motion Diffusion for Controllable 4D Cardiac MRI Synthesis Figure 1
2026-06-26cs.CV

Anatomy-Guided Residual Motion Diffusion for Controllable 4D Cardiac MRI Synthesis

Yiheng Cao, Gustavo Andrade-Miranda, Jiatian Zhang, Lingxiao Zhao, Xin Gao

2026-06-26生成模型规划控制

针对4D心脏MRI标注稀缺、隐私限制和跨设备域偏移导致的模型泛化问题,论文将静态解剖与时间运动解耦:用半监督VAE联合学习图像与分割掩码,再以级联潜空间扩散分别生成受临床先验控制的ED解剖和残差运动轨迹。实验显示解剖控制相关性r>0.8、FVD为288.08,合成数据用于nnU-Net训练后平均Dice提升1.4%、HD降低3.0mm,左心室收益更明显。

Calibrated Harmonic Overlaid Implicit Neural Representations for Multi-Dimensional Data Figure 1
2026-06-26cs.CV

Calibrated Harmonic Overlaid Implicit Neural Representations for Multi-Dimensional Data

Honghang Chen, Xiujun Zhang, Xiaoli Sun, Mingqing Xiao

2026-06-26强化学习

本文针对周期激活 INR 在加深网络时因函数复合导致优化不稳、且固定频率难以匹配自然信号谱分布的问题,提出 CHOIR:用协调谐波叠加替代纯层级复合,并以感知谱校准引入 1/f 功率律先验。实验覆盖多维数据恢复任务,显示其在更深网络下仍能稳定提升 PSNR,并优于 SIREN、FINER、FreSh 等方法。

ProtoKV: Streaming Video Understanding under Delayed Query with Summary-State Memory Figure 1
2026-06-26cs.CV

ProtoKV: Streaming Video Understanding under Delayed Query with Summary-State Memory

Le Tu Ngoc Minh (KAIST), Jinyeong Lim (KAIST), Dongsu Han (KAIST)

2026-06-26视觉感知

这篇论文面向流式视频理解中的延迟查询问题:关键视觉线索可能早已出现,但受固定显存和低延迟约束,传统滑窗或保留少量 token 容易丢失远历史证据。ProtoKV 的核心做法是保留近端精确 KV,同时把远端历史聚合为带残差统计的语义—空间原型,并以伪 token 形式接入标准注意力。实验称在四个 SVU 基准、相近预算下,长延迟场景较 token 保留基线最高提升 12.5 个百分点,且延迟越长优势越明显。

Capacity-Controlled Multi-View Stylization of 3D Gaussian Splatting Figure 1
2026-06-26cs.CV

Capacity-Controlled Multi-View Stylization of 3D Gaussian Splatting

Zhihao Wen, Yixin Yang, Bojian Wu, Yang Zhou, Dani Lischinski, Daniel Cohen-Or, Hui Huang

2026-06-26规划控制三维

本文针对3D Gaussian Splatting风格化中按视角独立匹配导致的纹理重复、风格分配不稳和多视角不一致问题,提出以半平衡最优传输为核心的容量受控特征匹配,通过列容量约束抑制多对一复用,并用跨视角匹配引导约束同一3D内容对应一致风格;实验显示其在保持场景语义结构的同时提升风格多样性、细节表现和视角一致性,但代价是逐场景优化和一定计算开销。

Depth-Semantic Alignment and Affinity-Guided Fusion for Structured Radar Point Cloud Generation Figure 1
2026-06-26cs.CV

Depth-Semantic Alignment and Affinity-Guided Fusion for Structured Radar Point Cloud Generation

Amjad Hussain, Xin Qiu, Fuyuan Ai, Yuchen Tan, Zecheng Li, Chunyi Song, Wenjie Liu

Zhejiang University, China

2026-06-26三维

本文针对毫米波雷达点云稀疏、噪声多且结构不完整的问题,提出视觉-雷达融合生成框架:先用 Hessian 峰值增强抑制雷达噪声,再借助图像深度与语义先验完成跨模态空间对齐,并在 BEV 中融合与图优化补全结构。实验显示生成点云在结构完整性、语义一致性上更好,并提升检测与跟踪鲁棒性;但具体增益相对各模块的来源仍需消融细节支撑。

PressMimic: Pressure-Guided Motion Capture and Control for Humanoid Robot Imitation Figure 1
2026-06-26cs.RO

PressMimic: Pressure-Guided Motion Capture and Control for Humanoid Robot Imitation

Yi Lu, Shenghao Ren, Tianyu Xiong, Zhaoxiang Li, Jiaqi Li, He Zhang, Tao Yu, Qiu Shen, Xun Cao

2026-06-26机器人模仿学习规划控制

PressMimic针对现有人形机器人模仿过度依赖视觉与运动学、忽略足地接触而导致滑步、穿地和不稳定的问题,将压力信号贯穿感知到控制:用RGB+压力的FRAPPE++估计人体姿态与全局运动,并在强化学习控制中加入压力监督PSP。论文还构建MotionPRO数据集,实验显示压力可提升姿态/轨迹估计一致性、任务成功率和运动稳定性。

LiveEdit: Towards Real-Time Diffusion-Based Streaming Video Editing Figure 1
2026-06-26cs.CV

LiveEdit: Towards Real-Time Diffusion-Based Streaming Video Editing

Xinyu Wang, Chongbo Zhao, Fangneng Zhan, Yue Ma

2026-06-26视觉感知生成模型

LiveEdit面向AR和直播等实时场景中视频编辑难以同时保持未编辑区域稳定、低延迟响应的问题,提出从双向DiT到因果流式编辑器的三阶段蒸馏,并用基于编辑掩码的缓存复用自注意力中冗余区域计算。实验显示其在流式基线上取得更好的视觉质量和时序一致性,并将推理提升到12.66 FPS,接近交互式应用需求。

Do Image Editing Models Understand Lighting? Figure 1
2026-06-26cs.CV

Do Image Editing Models Understand Lighting?

Tim Küchler, Johann-Friedrich Feiden, Matthias Nießner, Carsten Rother

Heidelberg University, Technical University of Munich, Zuse School ELIZA

2026-06-26视觉感知

本文针对图像编辑模型是否真正理解真实光照而非只生成“看起来合理”的效果这一问题,提出3DLP基准:采集1K组真实室内HDR开/关灯探针对,并标注阴影、高光、金属等区域,配合可消除白平衡、曝光差异的物理指标评估六类模型。结果显示顶尖模型已能较好匹配真实光传输,Nano Banana Pro领先、Qwen-Image-Edit表现突出,但弱受光区域仍易出错,VLM也不适合像素级光照分析。

Robust Onion: Peeling Open Vocab Object Detectors Under Noise Figure 1
2026-06-26cs.CV

Robust Onion: Peeling Open Vocab Object Detectors Under Noise

Priyank Pathak, Mukilan Karuppasamy, Aaditya Baranwal, Shruti Vyas, Yogesh S Rawat

2026-06-26安全鲁棒

本文关注开放词汇目标检测器在真实噪声和视觉退化下为何失效这一尚不清楚的问题。作者用可控合成噪声逐层分析特征坍缩,指出鲁棒性主要由视觉骨干和图像域决定,预训练、结构细节与语言提示作用有限;并用轻量 NN & TK0 在 BDD-100K、WiderFace、VisDRONE 等真实数据上提升鲁棒性,参数量较端到端训练少 96 倍。

Full spectrum Unlearnable Examples via Spectral Equalization Figure 1
2026-06-26cs.CV

Full spectrum Unlearnable Examples via Spectral Equalization

Jiale Cai, Gezheng Xu, Zhihao Li, Ruiyi Fang, Ruizhi Pu, Di Wu, Qicheng Lao, Charles Ling, Boyu Wang

2026-06-26视觉感知

论文针对现有不可学习样本过度依赖高频扰动、经低通滤波后保护失效的问题,提出 FUSE:在生成器训练中用随机频谱遮蔽迫使不同频带都具备不可学习性,并通过跨频带指导协调低频与高频扰动。实验显示其在多数据集、架构迁移和不同滤波强度下能将测试准确率压到接近随机水平,优于既有方法。

A Latent ODE Approach to Spatiotemporal Modeling of Cine Cardiac MRI Figure 1
2026-06-26cs.AI

A Latent ODE Approach to Spatiotemporal Modeling of Cine Cardiac MRI

David Brüggemann, Ekaterina Krymova, Firat Özdemir, Jochen von Spiczak, Sebastian Kozerke, Samia Mora, Robert Manka, Mathieu Salzmann, Olga V. Demler

2026-06-26视觉感知

这篇论文针对传统心脏 MRI 风险模型只利用少数静态指标、可能遗漏全周期运动异常的问题,提出以双心室网格为输入的 GNN-Transformer 与心率感知 latent ODE 框架,将 cine CMR 建模为连续潜在轨迹,并用协变量条件先验提取偏离正常形态运动的残差表征。在 7.2 万 UK Biobank 样本中,该潜在风险分数将心衰预测 C-index 从 0.704 提升到 0.785,优于常规七项心脏指标,但仍需外部队列验证。

Dual-Prior Guided Null-Space Learning with Mixture-of-Splines for Arbitrary Medical Slice Super-Resolution Figure 1
2026-06-26eess.IV

Dual-Prior Guided Null-Space Learning with Mixture-of-Splines for Arbitrary Medical Slice Super-Resolution

Haofei Song, Siyuan Xu, Xintian Mao, Shaojie Guo, Qingli Li, Yan Wang

2026-06-26视觉感知

针对临床 CT/MRI 各向异性采集导致任意切片超分辨率病态、易篡改已观测切片或产生解剖幻觉的问题,论文将重建改写为双先验约束的零空间学习:MCP 硬性保证原始切片一致,MoS 以多阶 B 样条自适应建模局部连续性,并由 LSCD 增强空间一致性。在三组 CT 和一组 MRI 基准上,DP-NSL 相比现有方法取得更高指标,文中称最高带来 1.07 dB PSNR 提升且保持测量一致。

Extracting Neural Materials from Multi-view Images Figure 1
2026-06-26cs.CV

Extracting Neural Materials from Multi-view Images

Kim Youwang, Jon Hasselgren, Peter Kocsis, Andrea Weidlich, Tae-Hyun Oh, Jacob Munkberg

2026-06-26视觉感知

针对传统 PBR 材质难以表达雾化、清漆、绒毛、散射等复杂高光/次表面效果,本文提出 NeuMatEx,从多视图图像中提取空间变化的神经材质。核心做法是先用大型材质重建模型预测 base color、神经材质 latent 与不确定性,再用不确定性约束的可微路径追踪做测试时优化,缓解神经 latent 空间难优化和光照烘焙问题。合成与真实资产实验显示,其渲染质量和材质分解优于 PBR 方法,PathTrace PSNR 明显提升。

MLFFM-SegDiff: A Multi-Level Feature Fusion Diffusion Model for Skin Lesion Segmentation Figure 1
2026-06-26eess.IV

MLFFM-SegDiff: A Multi-Level Feature Fusion Diffusion Model for Skin Lesion Segmentation

Jingjun Gu, Chaojie Shen, Yifeng Cao, Wei Zhang, Yiliu Li, Aobo Fan

2026-06-26视觉感知生成模型

针对皮肤镜病灶边界模糊、尺度变化大且易受毛发阴影干扰的问题,论文将扩散分割框架用于病灶掩码重建,并在去噪网络中加入双路径 U-Net 编码器、多层特征融合模块和可选边界敏感损失,以加强图像与噪声掩码交互及跨层语义/边界融合。在 ISIC2018、PH2、HAM10000 上相较 DermoSegDiff、U-Net、SwinUNETR 等取得最佳平均指标,平均 Jaccard 为 0.8546、Dice 为 0.9207。

Mask to Concept: Auto-Promptable SAM3 via Efficient Test-Time Concept Embedding Search for Few-Shot Annotation Figure 1
2026-06-26cs.CV

Mask to Concept: Auto-Promptable SAM3 via Efficient Test-Time Concept Embedding Search for Few-Shot Annotation

Quan Zhou, Shaoqing Zhai, Qiang Hu Jia Chen, Qiang Li, Zhiwei Wang

2026-06-26视觉感知

针对医学像素级标注依赖逐图交互、少样本自动标注又常需外部匹配器或辅助网络的问题,本文提出 M2C:在冻结 SAM3 内仅优化可学习概念嵌入,由少量掩码反推可迁移视觉概念,并结合 HUE 不确定性筛选形成人在环迭代。实验称其在 Kvasir-SEG、ISIC-2017 一次样本 Dice 分别较现有方法至少提升 4.2% 和 11.8%,同时提高标注效率。

Intracranial Aneurysm Classification and Segmentation via Tri-Axial ROI and Multi-Task Learning Figure 1
2026-06-26cs.CV

Intracranial Aneurysm Classification and Segmentation via Tri-Axial ROI and Multi-Task Learning

Pengcheng Shi, Kaiyuan Yang, Houjing Huang, Jiawei Chen, Yan Lu, Jiaqi Liu, Murong Xu, Bjoern Menze, Xinglin Zhang

2026-06-26视觉感知

针对颅内动脉瘤自动分析多停留在二分类、难以同时给出解剖位置与精细分割的问题,本文提出两阶段方案:用三轴少量2D切片快速定位ROI,再以3D多任务nnU-Net、双解码器和跨注意力池化联合完成13部位分类、动脉瘤与血管多类分割。方法在RSNA 2025挑战中两折集成获第2名,ROI较3D滑窗平均加速12.7倍;但分割标签主要来自伪标注与人工校正,独立标注验证文中未充分说明。

PhysEditWorld: A Large-Scale Dataset Toward Physics-Editable World Models Figure 1
2026-06-26cs.CV

PhysEditWorld: A Large-Scale Dataset Toward Physics-Editable World Models

Bin Hu, Yanwen Ma, Jiehui Huang, Ziliang Zhang, Haoning Wu, Ruicheng Zhang, Yaokun Li, Zijun Wang, Yuechen Zhang, Chun-Mei Tseng, Hanhui Li, Shengju Qian, Jun Zhou, Kaipeng Zhang, Xiaodan Liang, Jiaya Jia, Xiu Li

Tsinghua Shenzhen International Graduate School, Tsinghua University, Beihang University, The Hong Kong University of Science and Technology, Shanghai Jiao Tong University, Sun Yat-sen University, The Chinese University of Hong Kong

2026-06-26强化学习数据集/基准

本文针对现有游戏世界模型把物理当作隐式统计相关、难以按设计需求编辑的问题,提出 PhysEditWorld 数据集:用 UE5 固定场景、初始状态、动作轨迹、角色控制器和相机策略,仅改变重力并重放,形成可归因的多模态匹配 rollout。实验证明它可用于训练和评估重力条件生成、第一人称世界模型与视频语言重力判断,并揭示当前模型虽能保持视觉真实,却常低估重力敏感运动或混淆重力等级。

DeCoFlow: Structural Decomposition of Normalizing Flows for Continual Anomaly Detection Figure 1
2026-06-26cs.CV

DeCoFlow: Structural Decomposition of Normalizing Flows for Continual Anomaly Detection

Hun Im, Jungi Lee, Subeen Cha, Pilsung Kang

2026-06-26视觉感知生成模型

面向工业产线中新类别持续到来且不能回放旧数据的异常检测问题,DeCoFlow抓住仿射耦合层对子网参数化不敏感、仍保持可逆与精确Jacobian的结构特性,将归一化流子网拆为冻结通用基座和任务低秩适配器,并用TSA、ACL、TAL缓解冻结带来的刚性。文中报告在MVTec-AD和VisA上图像级AUROC达98.40%和93.00%,正确路由下遗忘率为0,每任务仅增2.27M参数。

Disco-LoRA: Disentangled Composition of Content, Style, and Motion for Multi-concept Video Customization Figure 1
2026-06-26cs.CV

Disco-LoRA: Disentangled Composition of Content, Style, and Motion for Multi-concept Video Customization

Xuancheng Xu, Gengyun Jia, Bing-Kun Bao

Nanjing University of Posts and Telecommunications, Hefei University of Technology, Peng Cheng Laboratory

2026-06-26视觉感知

这篇论文针对文本到视频定制中内容、风格与运动难以同时受控的问题,提出多概念视频定制任务与基准,并用 Disco-LoRA 将内容-风格、内容-运动拆成双 LoRA 迭代解耦,再通过 Z-score 约束平衡 LoRA 权重幅值以减少概念干扰。实验显示其在外观保持、风格迁移和运动一致性上优于对比方法,但具体增益仍可能受数据与 scaling 影响。

LayersReg: A Layer-by-Layer Progressive Regressor for Reliable Intraoperative 3D/2D Registration Figure 1
2026-06-26cs.CV

LayersReg: A Layer-by-Layer Progressive Regressor for Reliable Intraoperative 3D/2D Registration

Xiyuan Wang, Zhenchao Wang, Xinran Chen, Junkai Liu, Chuan Chen, Feng Yin

School of Biological Science and Medical Engineering, Southeast University, School of Engineering, College of Engineering and Physical Sciences, University of Birmingham, State Key Laboratory of Digital Medical Engineering

2026-06-26三维

这篇论文针对术中3D/2D配准中传统迭代法易陷局部最优、现有姿态回归器依赖外观记忆且缺少3D解剖先验的问题,提出LayersReg:将CT体特征与2D术中图像交互,用混合自编码器、特征相关残差、Mamba模块和逐层节点式回归,把一次性姿态预测改为受误差信号驱动的渐进配准。实验覆盖多数据集和模态,在大偏移条件下X-ray/CT配准达到0.68°、1.41 mm,切片定位达到0.73°、1.55 mm,优于文中比较方法。

FracEvent: Event-Camera Simulation via Fractional-Relaxation Pixel Dynamics Figure 1
2026-06-26cs.CV

FracEvent: Event-Camera Simulation via Fractional-Relaxation Pixel Dynamics

Langyi Chen, Chuanzhi Xu, Haoxian Zhou, Pengfei Ye, Ziyu Luo, Haodong Chen, Qiang Qu, Xiaoming Chen, Weidong Cai

The University of Sydney, Massachusetts Institute of Technology, Beijing Technology and Business University

2026-06-26视觉感知

事件相机真实数据采集成本高、同步和标注困难,促使从视频或渲染轨迹生成更可信事件流。FracEvent的核心是把传感器侧像素生命周期建模为分数松弛电压记忆:多时间尺度模式驱动电压,连续定位ON/OFF阈值穿越,并在触发后保留残余状态。实验显示其事件时序更接近真实数据,在图像重建和光流迁移中优于多种模拟器基线,但仍受输入亮度轨迹质量限制。

Temporally Consistent Label Interpolation for Robust Surgical Multi-Task Learning under Challenging Conditions Figure 1
2026-06-26cs.CV

Temporally Consistent Label Interpolation for Robust Surgical Multi-Task Learning under Challenging Conditions

Garam Kim, Juyoun Park

2026-06-26安全鲁棒

本文针对手术视频多任务学习中“时序任务密标注、像素级任务稀标注”的监督不均衡问题,提出 FAROS:用光流约束补强 SAM2 等外观传播在遮挡、烟雾、运动模糊下的漂移,生成时间一致的器械掩码与动作伪标签,并接入统一 Transformer 框架。实验在 DAVIS、GraSP、MISAW、AutoLaparo 上显示其提升标签传播稳定性和跨任务表征学习,但具体增益中各模块贡献仍需依赖消融判断。

Position Rebinding Cache Reuse: Replay-Free Visual Revisiting for Interleaved Multimodal Reasoning Figure 1
2026-06-26cs.CV

Position Rebinding Cache Reuse: Replay-Free Visual Revisiting for Interleaved Multimodal Reasoning

Mengzhao Wang, Yanli Ji, Wangmeng Zuo, Peng Ye, Chongjun Tu

Sun Yat-sen University, Shenzhen Loop Area Institute, Harbin Institute of Technology (HIT), Fudan University, Shanghai Artificial Intelligence Laboratory, The Chinese University of Hong Kong

2026-06-26视觉语言强化学习

这篇论文关注交错多模态推理中反复“回看”视觉证据带来的重算开销,指出直接复用历史视觉 KV cache 会因位置绑定失配导致自回归解码崩溃。作者提出 PRCR:保存未加位置编码的原始视觉 KV 及空间坐标,在回看时重分配兼容当前位置并重新绑定 key。实验显示其达到或超过 token replay 精度,平均提升约 2–5%,并将视觉回看计算量降低数个数量级。

TaskTok: Delving into Task Tokens for Task-driven Image Restoration Figure 1
2026-06-26cs.CV

TaskTok: Delving into Task Tokens for Task-driven Image Restoration

Hongjae Lee, Sojung Kang, Jaeseong Yu, Seung-Won Jung

2026-06-26视觉感知

本文针对任务驱动图像复原中全量更新潜变量 token 带来的计算浪费和语义漂移问题,指出一维 tokenizer 的不同索引承载不同任务相关线索,且分类、分割、检测所需 token 子集并不相同。TaskTok 用可学习 token switch 选择需修复的 task-relevant tokens,并以轻量模块精炼它们;实验覆盖分类、语义分割和目标检测,显示在更新更少 token 的情况下提升下游性能并提高效率。

LogicIR: Logic Gate Networks for Image Restoration Figure 1
2026-06-26cs.CV

LogicIR: Logic Gate Networks for Image Restoration

Hongjae Lee, Myungjun Son, Jaeseong Yu, Seung-Won Jung

2026-06-26视觉感知

本文针对图像复原模型计算量高、BNN仍依赖部分全精度运算且LUT受感受野扩展限制的问题,提出首个面向复原的逻辑门网络LogicIR。其核心是用全逻辑门UNet结构建模多尺度特征,并通过可微比特解码层和索引洗牌改善训练与信息传播。在BSD68去噪等基准上,LogicIR-S-4RT以169.3G二值操作达到27.71dB PSNR,显示出较强的效率-精度折中。

DiCoBench: Benchmarking Multi-Image Fine-Grained Perception via Differential and Commonality Visual Cues Figure 1
2026-06-26cs.CV

DiCoBench: Benchmarking Multi-Image Fine-Grained Perception via Differential and Commonality Visual Cues

Geng Li, Yuxin Peng

2026-06-26视觉感知数据集/基准

该文针对现有细粒度感知评测依赖文本提示、分辨率偏低,难以衡量模型自主发现跨图隐含视觉线索的问题,提出 DiCoBench:以差异线索和共性线索为两条主线,构建 765 个近 2K 多图选择题样本,覆盖 8 类任务以减少生成式指标偏差。对 18 个 MLLM 的评测显示,人类准确率 98.3%,而最强闭源模型 Gemini-3-Pro 仅 58.1%,说明当前模型在微小细节捕捉和跨图逻辑感知上仍有明显缺口。

SpaceRipple: Lightweight Semantic Delivery for Mission-Oriented LEO Earth Observation Satellite Networks Figure 1
2026-06-26cs.CV

SpaceRipple: Lightweight Semantic Delivery for Mission-Oriented LEO Earth Observation Satellite Networks

Ziyi Yang, Hao Yuan, Yunxiang Yi, Wenbo Wang, Xing Zhang

2026-06-26视觉感知

针对低轨遥感卫星高分辨率图像下传受带宽与时延限制的问题,SpaceRipple将目标从完整图像传输改为任务语义交付:感知星只做自适应压缩和元数据生成,边缘计算星负责恢复、MoE增强与语义推理。实验显示该协同管线在保持较好重建质量的同时提升语义检测F1并显著提高接触窗口吞吐,但真实链路与多任务场景仍待验证。

Coarse-to-Fine: A Hybrid Self-Supervised Method for Non-rigid 3D Shape Matching Figure 1
2026-06-26cs.CV

Coarse-to-Fine: A Hybrid Self-Supervised Method for Non-rigid 3D Shape Matching

Feifan Luo, Ting Li, Zhao Li, Hongyang Chen

Zhejiang University, China Zhejiang Lab, China Wenzhou University of Technology, China, Corresponding author.Zhejiang University, China Zhejiang Lab, China Wenzhou University of Technology, China

2026-06-26三维

针对非刚性三维形状匹配中现有深度功能映射依赖几何先验、线性求解或推理微调而在复杂形变下效率和精度受限的问题,论文提出粗到细的混合自监督框架,使粗映射与细化对应在空间、谱及联合视角保持一致,并结合拉普拉斯基与弹性基双分支。实验显示其在非等距形变和拓扑噪声等场景取得优于已有方法的精度与运行效率,且对比能量可提升特征判别性。

Perception, Verdict, and Evolution: Hindsight-Driven Self-Refining Forensics Agent for AI-Generated Image Detection Figure 1
2026-06-26cs.CV

Perception, Verdict, and Evolution: Hindsight-Driven Self-Refining Forensics Agent for AI-Generated Image Detection

Yangjun Wu, Keyu Yan, Yu Liu, Jingren Zhou, Fei Huang, Rong Zhang, Zhou Zhao, Fei Wu

2026-06-26视觉感知

针对高真实感 AI 生成图像让传统伪造检测难以捕捉细粒度痕迹、MLLM 方法又依赖昂贵静态合成监督的问题,论文提出 ForeAgent:用感知—裁决架构融合语义、空间与频域证据,并通过带真实标签回看信号的采样—反思—进化循环自生成高质量推理样本进行微调。实验显示其在 Chameleon 达到 82.18% 准确率、较 AIDE 提升 16.41%,在 AIGCDetectBenchmark 16 类生成器上平均准确率为 93.3%。

PhyEditBench: A Real-World Multi-Stage Benchmark for Physics-Aware Image Editing Figure 1
2026-06-26cs.CV

PhyEditBench: A Real-World Multi-Stage Benchmark for Physics-Aware Image Editing

Shengbin Guo, Shaokang He, Chaoyue Meng, Shengpeng Xiao, Xunzhi Xiang, Shaofeng Zhang, Qi Fan

2026-06-26视觉感知强化学习数据集/基准

这篇论文针对现有图像编辑基准偏重空间/语义推理、缺少真实物理动态评测的问题,提出 PhyEditBench:从真实视频构建高分辨率多阶段物理编辑样例,并加入反物理合成样例,覆盖4类12子类物理过程。实验显示当前开闭源编辑模型常产生不符合物理的状态转移;其免训练基线 PhyWorld 将视频生成视为隐式物理推理,并结合测试时 scaling 与潜变量约束取得更好结果,但增益可能主要来自 scaling / data。

From Hallucination to Grounding: Diagnosing Visual Spatial Intelligence via CRISP Figure 1
2026-06-26cs.CV

From Hallucination to Grounding: Diagnosing Visual Spatial Intelligence via CRISP

Zhixing Li, Yinan Yu

2026-06-26视觉语言

这篇论文针对VLM空间评测容易把语言先验误当作真实几何推理的问题,提出CRISP:将问答与度量3D场景图生成绑定,并用跨任务一致性和oracle干预区分感知瓶颈与推理缺陷。结果显示,闭源模型往往具备潜在推理能力但无法准确估计并利用自身结构表征,开源模型则更多受多跳组合推理限制。

The Inattentional Gap: Task-Conditioned Language and Vision Models Omit the Safety-Critical Signals They Can Otherwise Report Figure 1
2026-06-26cs.CL

The Inattentional Gap: Task-Conditioned Language and Vision Models Omit the Safety-Critical Signals They Can Otherwise Report

Kwan Soo Shin

Kwan Soo Shin 1 1 1 PolymathMinds Lab, Seoul, Republic of

2026-06-26视觉感知安全鲁棒

论文关注安全评测只考“被指定风险”而真实事故常来自未被要求报告的信号这一错位,提出 Inattentional Gap:同一模型在开放提示下能报告危险,却在窄任务提示下省略。作者在放射、驾驶文本和胸片视觉任务中验证该现象,发现所有测试模型均出现抑制,且不随规模消失,推理模型也未避免,提示基准高分可与部署安全脱钩。

Forget, Anticipate and Adapt: Test Time Training for Long Videos Figure 1
2026-06-26cs.CV

Forget, Anticipate and Adapt: Test Time Training for Long Videos

Rajat Modi, Sebastian Noel, Xin Liang, Yogesh Singh Rawat

2026-06-26视觉感知

这篇论文针对长视频测试时训练中滑窗重复回传、相邻帧冗余导致算力随窗口和时长膨胀的问题,提出 Frame Forgetting Network:只处理退出帧、当前帧和新进入帧,并用“surprise”度量自适应决定何时扩缩窗口和执行适应。实验覆盖 11 个数据集及新建最长 3 小时 EpicTours,显示其在密集分割、视频分类和深度估计上保持竞争性能,同时更适合多小时视频。

Budget-Aware Keyboardless Interaction Figure 1
2026-06-26cs.HC

Budget-Aware Keyboardless Interaction

Quang-Thang Nguyen, Gia-Phuc Song-Dong, Minh-Triet Tran, Trung-Nghia Le

2026-06-26视觉感知

本文针对虚拟键盘依赖投影仪、AR 头显、多摄像头或标记纸张而成本高、部署繁琐的问题,提出只用普通摄像头和打印键盘纸的无键盘输入方案。其核心是用 YOLOv8 分割/检测键盘与按键,结合单应变换校正视角,并通过指甲颜色变化判断触键。实验中键盘检测 AP 达 92%、按键检测约 70%,但触摸检测准确率仅约 36%,受光照影响明显,实用性仍受限。

DanceDuo: Bridging Human Movement and AI Choreography Figure 1
2026-06-26cs.HC

DanceDuo: Bridging Human Movement and AI Choreography

Gia-Cat Bui-Le, Tuong-Vy Truong-Thuy, Hai-Dang Nguyen, Trung-Nghia Le

2026-06-26视觉感知

针对现有音乐驱动舞蹈生成系统偏重离线合成、缺少练习互动的问题,DanceDuo将DanceFusion扩散式音乐到动作生成、SMPL/Unity可视化与ROMP视频姿态估计结合,支持选曲、角色展示和用户舞蹈对比,并设计鼓励型评分。用户研究显示界面易用,舞蹈对比功能最受认可;但生成质量相对基线的定量增益与评分有效性文中未充分说明。

Active Adversarial Perturbation-driven Associative Memory Retrieval for RGB-Event Visual Object Tracking Figure 1
2026-06-26cs.CV

Active Adversarial Perturbation-driven Associative Memory Retrieval for RGB-Event Visual Object Tracking

Xiao Wang, Xufeng Lou, Zikang Yan, Lan Chen, Sibao Chen, Yaowei Wang, Yonghong Tian, Jin Tang

School of Computer Science, Peking University, China

2026-06-26视觉感知

本文针对RGB-Event跟踪在真实机器人/无人系统场景中常见的传感器失效、低质模态与局部遮挡问题,提出APRTrack:用模态级和空间级对抗扰动分别模拟整模态缺失与目标局部缺失,并通过分层路由避免训练约束叠加导致特征坍塌;同时引入基于Hopfield的历史记忆检索,以置信足迹和通道校准限制补偿范围。实验在FE108、COESOT、VisEvent和FELT上验证了鲁棒性提升,但具体增益幅度在给定片段中未充分说明。

WatchAct: A Benchmark for Behavior-Grounded Robot Manipulation Figure 1
2026-06-26cs.RO

WatchAct: A Benchmark for Behavior-Grounded Robot Manipulation

Baiqi Li, Ce Zhang, Yu Fang, Yue Yang, Shangzhe Li, Mingyu Ding, Gedas Bertasius

University of North Carolina at Chapel Hill

2026-06-26机器人数据集/基准

WatchAct针对现有机器人操作基准多依赖静态图像、难以评估对人类行为历史理解的问题,构建了3,000个由真人动作视频、语言指令和可执行LIBERO任务对齐的长程样例,覆盖事件、流程、意图和情景记忆四类能力,并将视频到计划、给定计划执行和端到端完成分开评测。结果显示当前系统差距显著:最佳组合仿真成功率仅16.3%,真机14.0%,主要瓶颈来自人中心空间推理、长程规划与低层执行。

Revealing Mammographic Phenotypes in Deep Learning Breast Cancer Risk Models Figure 1
2026-06-26eess.IV

Revealing Mammographic Phenotypes in Deep Learning Breast Cancer Risk Models

Ruiyu Jia, Yanqi Xu, Yuxuan Chen, Yiqiu Shen, Laura Heacock

Department of Mathematics, New York University Shanghai, China, Center for Data Science, New York University, USA, Department of Radiology, NYU Langone Health, USA, Perlmutter Cancer Center, NYU Langone Health, New York, USA

2026-06-26安全鲁棒

针对乳腺癌风险模型虽有效但难解释的问题,本文不再依赖单张显著图,而是用 Mirai 的补丁嵌入聚类挖掘人群级乳腺影像表型,并将其与5年风险关联。结果显示,高风险表型对应更复杂、异质的致密组织、微钙化等模式,也包含活检夹等捷径伪影;这些表型随 BI-RADS 密度升高而增加,并与更高年龄显著相关。

Rethinking Training & Inference for Forecasting: Linking Winner-Take-All back to GMMs Figure 1
2026-06-26cs.LG

Rethinking Training & Inference for Forecasting: Linking Winner-Take-All back to GMMs

Qiyuan Wu, Katie Z Luo, Bharath Hariharan, Wei-Lun Chao, Mark Campbell

2026-06-26视觉感知

本文针对自动驾驶轨迹预测中多模态候选虽覆盖充分、但模式概率排序不可靠的问题,指出根因是模型按条件 GMM 推理、却用 WTA 硬分配训练,实际更接近 K-means,导致过分割和概率失真。作者据此提出测试时后验加权合并与一步 EM 软责任更新,无需重训即可在多种 WTA 架构上改善模式概率可解释性,并提升 NuScenes、WOMD 上的位移误差指标。

Methane-Plume Segmentation From Hyperspectral Satellite Imagery Via Multimodal Deep Learning Figure 1
2026-06-26cs.CV

Methane-Plume Segmentation From Hyperspectral Satellite Imagery Via Multimodal Deep Learning

Brayan Quintero, Jeferson Acevedo, Samuel Traslaviña, Hoover Rueda-Chacón

2026-06-26视觉语言视觉感知

针对卫星高光谱甲烷羽流稀疏、低信噪且仅依赖增强图易误检的问题,论文将RGB场景语义与甲烷增强图联合建模,用DINOv3提取多尺度视觉特征,并通过FGME门控把物理相关的甲烷线索注入RGB表示。MPDataset实验显示其较现有方法提升MIoU、精确率和召回率,同时计算开销更低,但具体增益中预训练与架构贡献占比文中未充分说明。

Neural Voxel Dynamics: Learning Implicit 3D Physics via Volumetric Feature Advection Figure 1
2026-06-26cs.CV

Neural Voxel Dynamics: Learning Implicit 3D Physics via Volumetric Feature Advection

Zican Wang, Niloy Mitra

University College London

2026-06-26三维

这篇论文针对视频生成模型缺少三维几何约束、难以保持物体恒存和物理一致性的问题,提出将 V-JEPA 语义特征借助单目深度提升到体素潜空间,并用动作条件的体积特征平流学习隐式三维动力学,而非依赖显式物理引擎。实验称其在 CLEVRER、PhysInOne、PhysGaia 上较二维世界模型有更好的长期结构稳定性和物理合理性,但真实增益与数据、尺度的关系仍需进一步验证。

DinoLink: A Token-Centric Representation Compression Framework for Bandwidth-Constrained Collaborative V2X Perception Figure 1
2026-06-26cs.CV

DinoLink: A Token-Centric Representation Compression Framework for Bandwidth-Constrained Collaborative V2X Perception

Tianle Zhu, Haohua Que, Handong Yao, Hongyi Xu, Zhipeng Bao

2026-06-26视觉感知

DinoLink针对车云协同感知中V2X带宽窄、直接传图像或浮点特征都会造成语义损失或高时延的问题,将DINOv2特征转为可通信的离散语义 token:先用显著性Top-K丢弃背景token,再用RVQ编码为索引并在云端接DETR检测。nuScenes上在相对未压缩特征降低139倍码率时仍达32.8% mAP,窄带仿真中时延加速34.5倍;但泛化到更大数据和多车融合仍待验证。

Staying VIGILant: Mitigating Visual Laziness via Counterfactual Visual Alignment in MLLMs Figure 1
2026-06-26cs.CV

Staying VIGILant: Mitigating Visual Laziness via Counterfactual Visual Alignment in MLLMs

Xi Xiao, Chen Liu, Chih-Ting Liao, Yunbei Zhang, Qizhen Lan, Yuxiang Wei, Lin Zhao, Janet Wang, Jianyang Gu, Muchao Ye, Tianyang Wang, Hao Xu

2026-06-26视觉感知

这篇论文针对 MLLM 虽已编码视觉证据却在生成时依赖语言先验的“视觉懒惰”问题,提出 VIGIL:通过构造屏蔽视觉注意力的反事实盲态,最大化视觉输入与回答之间的信息增益,并惩罚无视觉仍自信的输出。实验称其在幻觉与推理基准上优于近期对齐方法,且用 25% 偏好数据即可匹配强基线全量数据表现,同时不损害纯文本能力,并出现无需框标注的空间 grounding。

What Do Deepfake Benchmarks Measure? An Audit Using Frozen Self-Supervised Representations Figure 1
2026-06-26cs.CV

What Do Deepfake Benchmarks Measure? An Audit Using Frozen Self-Supervised Representations

Samuel Pagon, Yixuan Shen, Vishal Asnani, Feng Liu

Department of Computer Science, Drexel University

2026-06-26数据集/基准

针对深伪检测高分基准难以迁移到真实场景的问题,本文不再提出新检测器,而是用冻结自监督表征加线性探针审计图像、音频、视频基准。核心洞察是:若简单探针接近专用模型,基准可能主要测到通用模态可分性而非取证理解。结果显示三类基准上探针均接近专用检测器,且生成器难度可由表征空间 Fréchet 几何部分解释。

Layer-Specific Prompt Fusion Discovery via Differentiable Search in Vision Foundation Models Figure 1
2026-06-26cs.CV

Layer-Specific Prompt Fusion Discovery via Differentiable Search in Vision Foundation Models

Xi Xiao, Xingjian Li, Yunbei Zhang, Cheng Han, Tianming Liu, Tianyang Wang, Runmin Jiang, Jihun Hamm, Xiao Wang, Min Xu

2026-06-26视觉感知

这篇论文聚焦视觉提示调优中“提示与图像 token 如何融合”这一被固定为拼接或相加的关键设计,提出按 ViT 层搜索融合算子的框架,用可微架构搜索在拼接、相加、仿射变换和交叉注意力间为每层选择混合策略,并与提示参数联合优化。实验覆盖 VTAB-1k、FGVC、HTA 共 34 个数据集,在冻结 ViT 下以约 0.75% 可调参数取得 77.01%、91.6%、92.5% 等均值结果,显示层特异混合融合优于单一融合。

Tailor Made Embeddings for Quantum Machine Learning Figure 1
2026-06-26quant-ph

Tailor Made Embeddings for Quantum Machine Learning

Aldo Lamarre, Dominik Šafránek

Department of Electrical Engineering, KAIST, Daejeon, South Korea, Center for Theoretical Physics of Complex Systems, Institute for Basic Science (IBS), Daejeon - 34126, Korea, Faculty of Mathematics and Physics, Charles University, Ke Karlovu 3, 121 16 Praha 2, Czech Republic, ing on large datasets such as ImageNet [7]. The limited size of both simulable and current hardware, requirement (k) at the cost of increasing the runtime to O(Nd). Data reconcilability assumes that, scalability of state preparation [1], and the difficulty of training variational circuits [15, 4]. Classi-

2026-06-26视觉感知

本文针对量子机器学习在大规模视觉数据上受限于数据嵌入、测量可恢复性和训练初始化的问题,提出用变分自编码器学习任务定制的量子嵌入,使高维图像可压缩到少量量子比特并能经多项式测量重构。实验称 ImageNet 可压到 13 量子比特,MNIST 3/5 分类达 98.5%,显著优于朴素幅度嵌入,并在 IBM 硬件噪声下保持可重构性。

Beyond Aesthetics: Quantifying Information Loss in Turbid Scenes Figure 1
2026-06-26cs.CV

Beyond Aesthetics: Quantifying Information Loss in Turbid Scenes

Vasiliki Ismiroglou, Stefan H. Bengtson, Tasos Benos, Thomas B. Moeslund, Malte Pedersen

2026-06-26视觉感知

论文针对浑浊水下场景中视觉质量下降与模型可用信息损失常被混淆的问题,构建含1320张真实极端浑浊图像和1.6万余实例分割标注的TUB数据集,并提出基于相位一致性的PCD指标,强调结构信息比对比度或色彩更能解释任务性能。实验显示,PCD在真实与合成浑浊图像上均比NIQE、UIQM、SSIM等指标更强相关于MaskRCNN、YOLOv11、Mask2Former的AP50表现,同时表明极端浑浊数据可带来中高浑浊泛化收益,但也可能增加清晰图像上的歧义。

GeMoE: Gating Entropy is All You Need for Uncertainty-aware Adaptive Routing in MoE-based Large Vision-Language Models Figure 1
2026-06-26cs.CV

GeMoE: Gating Entropy is All You Need for Uncertainty-aware Adaptive Routing in MoE-based Large Vision-Language Models

Chaoxiang Cai, Minghe Weng, Jie Li, Yibo Jiang, Longrong Yang, Zequn Qin, Xi Li

2026-06-26视觉语言视觉感知安全鲁棒

针对 MoE 视觉语言模型中固定 Top-k 路由无法按 token 难度分配专家、导致资源浪费或语义欠拟合的问题,GeMoE 将动态路由解释为最小描述长度优化,并用门控熵作为不确定性代理,通过专家分配预测器为高熵 token 激活更多专家、低熵 token 减少计算。实验显示其在多种骨干和基准上保留静态路由 99.5% 平均性能,同时将专家激活稀疏性提升 36.5%。

Beyond Single-Source Cognitive Taskonomy:Multi-Source Task Relations through fMRI Transfer Learning Figure 1
2026-06-26cs.CV

Beyond Single-Source Cognitive Taskonomy:Multi-Source Task Relations through fMRI Transfer Learning

Junfeng Xia, Wendu Li, Mengjiao Zhang, Jie Guo

Department of Biomedical Engineering, Southern University of Science and Technology

2026-06-26视觉感知

本文关注单源 fMRI 任务迁移难以解释多认知成分共同作用的问题,将重建式 cognitive taskonomy 扩展到多源到单目标关系,并用布尔整数规划分析有限监督预算下应优先标注哪些任务。结果显示,运动任务内部迁移紧密但跨范式支持有限,多源效果取决于源任务组合,不能由成对关系简单概括;工作记忆 0-back/2-back 状态在全局分配中反复被选中,提示其覆盖多种感知、注意和执行控制成分。

A multi-task spatiotemporal deep neural network for predicting penetration depth and morphology in laser welding Figure 1
2026-06-26cs.CV

A multi-task spatiotemporal deep neural network for predicting penetration depth and morphology in laser welding

Sen Li, Haichao Cui, Chendong Shao, Yaqi Wang, Xinhua Tang

Shanghai Key Laboratory of Materials Laser Processing and Modification, School of Materials, Science and Engineering, Shanghai Jiao Tong University, Shanghai 200240, PR China.

2026-06-26视觉感知

面向激光深熔焊在线质量控制,论文针对仅靠人工特征或单帧视觉难以稳定判断熔透状态与焊缝形貌的问题,构建融合顶部熔池图像时序特征和焊接参数的多任务CNN/状态空间网络,同时预测熔透状态、熔深和横截面形貌。测试集中熔透状态准确率达99.35%,熔深误差1.79 mm,截面重建准确率95.65%;但相对各模块的消融增益与泛化到更多材料/工况的能力文中仍需进一步说明。

Rendering Novel Views of MRI Using 3D Gaussian Splatting Figure 1
2026-06-26eess.IV

Rendering Novel Views of MRI Using 3D Gaussian Splatting

Robin Y. Park, Mark C. Eid, Rhydian Windsor, Amir Jamaludin, Ana I.L. Namburete, João F. Henriques, Andrew Zisserman

{}^{1}\, Visual Geometry Group, University of Oxford, {}^{2}\, Oxford Machine Learning in NeuroImaging Lab, University of Oxford

2026-06-26三维

本文针对临床脊柱 MRI 轴位切片常因各向异性采样和扫描平面未对齐而漏显椎间盘/狭窄区域的问题,将 3D Gaussian Splatting 改造成可从稀疏非投影式 MRI 重建体数据并渲染解剖对齐新视角。实验显示,GS 重采样虽在 PSNR/SSIM 上不一定优于体素插值,但在 LPIPS 和四类局部狭窄自动分级上更好,说明更贴近诊断特征的视图比单纯结构指标更关键。

Fast LeWorldModel Figure 1
2026-06-26cs.LG

Fast LeWorldModel

Yuntian Gao, Xiangyu Xu

Xi’an Jiaotong University

2026-06-26强化学习

该文针对 LeWorldModel 在视觉规划中逐步自回归展开导致候选动作评估慢、长视野误差累积的问题,提出 Fast-LeWM:将单步潜在转移改为动作前缀预测,用因果编码器和并行预测器一次预测不同前缀对应的未来潜变量,并以密集前缀监督学习多步动作效应。在 LeWM 相同任务协议下,平均成功率由 85.8% 提升到 90.5%,动力学模块加速 3.9 倍,CEM 求解时间约减半,同时降低开环潜在误差及其随视野增长速度。

TaskNPoint: How to Teach Your Humanoid to Hit a Backhand in Minutes Figure 1
2026-06-26cs.RO

TaskNPoint: How to Teach Your Humanoid to Hit a Backhand in Minutes

Blake Werner, Ilona Demler, Pietro Perona, Aaron D. Ames

California Institute of Technology

2026-06-26机器人

论文动机是让人形机器人像人学运动一样,用少量教练示范快速掌握动态操作,而非依赖大规模数据或任务奖励调参。核心洞察是许多技能成败取决于短暂“交互窗口”,TaskNPoint由人指定技能、单次示范、关键窗口和目标,再用仿真RL与随机目标训练补全轨迹。结果显示Unitree G1可在网球、踢球、搬箱中从秒级视频、单GPU一小时内训练并部署,且能零样本泛化到新目标位置。

From Structure to Synergy: A Survey of Vision-Language Perception Paradigm Evolution in Multimodal Large Language Models Figure 1
2026-06-26cs.CL

From Structure to Synergy: A Survey of Vision-Language Perception Paradigm Evolution in Multimodal Large Language Models

Haoxiang Sun, Tao Wang, Li Yuan, Jian Zhao, Jiancheng Lv

2026-06-26视觉语言视觉感知

针对现有多模态大模型综述多按视觉任务或语言推理割裂讨论、难以解释视觉语言感知演化的问题,本文将区域/实例级感知界定为统一能力,提出从编码器优化、解码器优化、动态感知到指令/RL与统一框架的五阶段分类。主要结果是系统梳理代表方法、边界与开放挑战,给出面向感知中心多模态智能的研究路线图;作为综述不报告新的实验增益。

Self-Supervised Tree-level Biomass Estimation in Urban Environments From Airborne LiDAR and Optical Observations Figure 1
2026-06-26cs.CV

Self-Supervised Tree-level Biomass Estimation in Urban Environments From Airborne LiDAR and Optical Observations

Jose Bermudez (1), Zilong Zhong (1), Dominic Cyr (2), Camile Sothe (3), Alemu Gonsamo (1) ((1) McMaster University, Hamilton, Ontario, Canada (2), Environment and Climate Change Canada, Montreal, Quebec, Canada, (3) Planet Labs PBC, San Francisco, California, USA)

McMaster University, 1280 Main Street West, Hamilton, Ontario L8S 4K1, Canada, Planet Labs PBC, 645 Harrison St., Floor 4, San Francisco, California 94107, USA

2026-06-26视觉感知

针对城市树木碳储量难以在单冠尺度、跨城乡异质场景中一致估计的问题,论文用机载 LiDAR 与近红外影像构建无需人工标注的伪标签双流交叉注意力框架,并量化树冠分割对生物量误差的影响;在安大略 810 km² 区域上,语义分割 Dice 为 0.84,AGB 估计 operational R² 为 0.570,显示主要瓶颈仍是树冠 delineation。

LCG: Long-Context Consistent Image Generation with Sparse Relational Attention Figure 1
2026-06-26cs.CV

LCG: Long-Context Consistent Image Generation with Sparse Relational Attention

Zihao Wang, Yijia Xu, Haoze Zheng, Xuran Ma, Haokun Gui, Harry Yang

Huazhong University of Science and Technology, Peking University, Hong Kong University of Science and Technology, Huazhong University of Science and Technology China, Peking University China, Hong Kong University of Science and Technology Hong Kong

2026-06-26视觉感知

这篇论文面向漫画、分镜和视觉叙事中多图生成容易角色漂移、长序列全局注意力成本过高的问题,提出LCG并行去噪框架,用稀疏关系注意力在分支间选择性检索相关区域,再用身份掩码驱动的路由一致性约束对齐角色与结构。作者还构建含60万训练序列的LCCD;实验显示其在长上下文提示对齐、角色一致性和人类偏好上优于多图生成基线,但更长、更拥挤场景的细粒度身份保持仍有限。

Predicting Fruit Quality with a Hybrid Machine Learning and Image Processing Approach Figure 1
2026-06-26cs.CV

Predicting Fruit Quality with a Hybrid Machine Learning and Image Processing Approach

Amir Reza Hashemi, Shahram Amiri

¹ Department of Computer Science, Science and Research Branch, Islamic Azad University, ² Department of Decision and Information Sciences, School of Business Administration, Stetson, University, DeLand, Florida, USA

2026-06-26视觉感知

针对农业分拣中水果腐败检测成本高、实时性要求强的问题,论文将基于颜色阈值的图像处理腐败百分比、CNN二分类结果与逻辑回归融合,并进一步用逻辑回归把百分比映射为实时二分类,从而减少部署时对CNN算力的依赖。在苹果和橙子数据上,CNN准确率98.59%,轻量逻辑回归方案约94.5%、AUC 0.96,但方法依赖白色或透明背景,泛化到复杂场景仍文中未充分说明。

DocArena: Turning Raw Documents into Controllable Training Environments for Document Search Agents Figure 1
2026-06-26cs.CV

DocArena: Turning Raw Documents into Controllable Training Environments for Document Search Agents

Jiamian Wang, Ruiyi Zhang, Tong Yu, Jing Shi, Samyadeep Basu, Rajiv Jain, Zhiqiang Tao, Tong Sun

DocArena: Turning Raw Documents into Controllable, Rochester Institute of Technology, struggle to construct training environments that are controllable, scalable, and, analysis on agent search behaviors confirms the effectiveness and controllability, curation [22, 41] that limits scalability to new domains and large volumes. Third, it, curation pipeline to construct controllable, scalable, and generalizable training en-, which the pipeline produces diverse, scalable reasoning chains through predefined tem-

2026-06-26规划控制

本文针对搜索智能体训练环境多依赖文本、人工构造且难控制的问题,提出 DocArena:用多模态大模型解析原始 PDF、刻画跨页信息分布并自动生成带证据的推理型 QA,再经级联质检形成 DocArena-79K。实验显示,用该数据训练的 Doc-Search 在多模态文档检索与问答上领先,并在部分文本 QA 上泛化较好;但增益可能主要来自数据规模与环境构造质量。

Dot-Flik: A Scalable Edge AI Architecture for Distributed Insect Monitoring Figure 1
2026-06-26cs.NI

Dot-Flik: A Scalable Edge AI Architecture for Distributed Insect Monitoring

Mattia Consani, Denisa-Andreea Constantinescu, Åse Håtveit, Titus Venverloo, Fabio Duarte, Carlo Ratti, David Atienza

Dot-Flik: A Scalable Edge AI Architecture for Distributed Insect, along four axes — real-time performance, network scalability, fication by entomologists is labor-intensive, slow, and suffers, from low spatial resolution, making it unscalable for large-, Massachusetts Institute of Technology (MIT), Cambridge, MA, USA (e-mail:, systems still face a fundamental barrier to scalability. Current, Garden project [22] at Senseable City Lab developed Flik, Nevertheless, fundamental scalability limitations persist., sensing and classification enables scalable and cost-effective, AI and enables scalable distributed insect monitoring., performance, network scalability, hardware cost, and, available

2026-06-26视觉感知

面向昆虫种群下降下的大规模连续监测需求,Dot-Flik针对现有视觉方案成本高、耗能大且依赖集中处理的问题,将低成本Dot节点的运动感知帧过滤与Flik 2.0分类解耦。其核心是用时序差分、伽马增强和块级运动密度在传感端丢弃背景帧,降低传输与中心推理负载。实地结果显示轻风下可减少60–80%帧、维持30 FPS并节省最高22.6%能耗,单中心节点支持5–6路边缘流。

2026-06-24

129 篇
No Figure
2026-06-24cs.CV

DiffusionBench: On Holistic Evaluation of Diffusion Transformers

Xingjian Leng, Jaskirat Singh, Zhanhao Liang, Ethan Smith, Martin Bell, Aninda Saha, Yuhui Yuan, Liang Zheng

Australian National University

2026-06-24生成模型数据集/基准

本文针对 DiT 研究过度依赖 ImageNet-FID、难以判断方法是否真正提升生成能力的问题,提出统一训练评测框架 NanoGen,并据此构建同时覆盖 ImageNet 与文生图的 DiffusionBench。核心洞察是,在近似同一代码和算力设置下,ImageNet 排名与 T2I 指标相关性很弱甚至为负;21 个潜空间模型实验显示,仅报告 ImageNet 可能误导结论,因而应以双任务基准衡量更通用的进展。

BenchX: Benchmarking AI Models for Cancer Detection and Localization with Demographic and Protocol Biases Figure 1
2026-06-24cs.CV

BenchX: Benchmarking AI Models for Cancer Detection and Localization with Demographic and Protocol Biases

Qi Chen, Wenxuan Li, Pedro R. A. S. Bassi, Xinze Zhou, Jakob Wasserthal, Ibrahim Ethem Hamamci, Sezgin Er, Ashwin Kumar, Yiwen Ye, Yuhan Wang, Yuyin Zhou, Akshay S. Chaudhari, Curtis Langlotz, Kang Wang, Yang Yang, Alan L. Yuille, Zongwei Zhou

Johns Hopkins University, German Cancer Research Center, University Hospital Basel, University of Zurich, ETH AI Center, Istanbul Medipol University, Stanford University, Nanyang Technological University, University of California, Santa Cruz, University of California, San Francisco, information from clinical data, which makes the analysis both scalable

2026-06-24视觉感知数据集/基准

BenchX针对医学影像模型在真实临床人群和扫描协议变化下平均指标掩盖失效的问题,构建含85,355例CT、细粒度人口学与增强期标注的开放基准,并用LLM规模化整理临床信息。评测12个肿瘤检测/定位模型发现,年轻患者、少数族裔、非静脉期CT、小肿瘤和胰尾病灶上性能显著下降,动脉/平扫可使F1和敏感性降低15–30%,说明当前SOTA主要优化总体准确率,公平性与协议鲁棒性仍不足。

FLAT: Feedforward Latent Triangle Splatting for Geometrically Accurate Scene Generation Figure 1
2026-06-24cs.CV

FLAT: Feedforward Latent Triangle Splatting for Geometrically Accurate Scene Generation

Orest Kupyn, Goutam Bhat, Philipp Henzler, Fabian Manhardt, Christian Rupprecht, Federico Tombari

University of Oxford, Visual Geometry Group

2026-06-24视觉感知

FLAT面向单图生成可探索3D场景时几何不准、3D Gaussian缺少显式表面且难进仿真/游戏管线的问题,提出从冻结视频扩散模型潜空间一次性解码三角形splat。其关键在于以射线为中心的三角形参数化和改进窗口函数,缓解平面基元方向敏感与梯度不足。实验显示其几何精度显著优于同类前馈基线,视觉质量保持接近,并可经轻量细化转为实时渲染的 opaque 三角表示。

FLUX3D: High-Fidelity 3D Gaussian Generation with Diffusion-Aligned Sparse Representation Figure 1
2026-06-24cs.CV

FLUX3D: High-Fidelity 3D Gaussian Generation with Diffusion-Aligned Sparse Representation

Haorui Ji, Weizhe Liu, Hongdong Li, Hengkai Guo

2026-06-24生成模型三维

FLUX3D针对单图生成3DGS时细节丢失的问题,指出瓶颈不只在模型容量,还在稀疏体素潜变量使用偏语义的2D特征、以及2D图像token与稀疏3D体素缺少结构化对齐。其核心做法是用FLUX扩散特征构建DA-SLAT并直接解码到3DGS,同时以SMDiT和MARoPE强化跨模态对齐。实验称在重建与生成基准上提升外观保真度并优于现有方法,但给定体素布局的设定意味着完整几何生成能力仍需谨慎解读。

IV-CoT: Implicit Visual Chain-of-Thought for Structure-Aware Text-to-Image Generation Figure 1
2026-06-24cs.CV

IV-CoT: Implicit Visual Chain-of-Thought for Structure-Aware Text-to-Image Generation

Zixuan Li, Haokun Lin, Yicheng Xiao, Zhiwei Li, Xinyang Song, Zelong Zheng, Yong He, Heng Yao, Ke Ding, Chao Yu, Chuan Yuan, Qi Li, Zhenan Sun

NLPR, Institute of Automation, Chinese Academy of Sciences, The University of Hong Kong, recoverable and manipulable latent visual plans.

2026-06-24视觉感知

本文针对统一 MLLM 文生图在多对象计数、空间关系和属性绑定上易把结构规划与外观渲染混在同一条件流中的问题,提出 IV-CoT:把视觉查询按结构到语义因果级联组织,并用仅训练阶段的 sketch 监督塑造隐式结构计划,推理时仍只需文本、单次前向且不解码中间图。基于同一 OpenUni-L-1024,GenEval 从 0.86 提升到 0.88,T2I-CompBench 从 0.5448 到 0.5743,并比显式 CoT 低 9–15 倍延迟。

Spherical-to-ERP Epipolar Rectification for Single-Axis Disparity in 360 Stereo Figure 1
2026-06-24cs.CV

Spherical-to-ERP Epipolar Rectification for Single-Axis Disparity in 360 Stereo

Sahereh Obeidavi, Dieter Landes

[1] Faculty of Electrical Engineering and Computer Science, Coburg University of Applied Science, German, [2] Faculty of Electrical Engineering and Computer Science, Coburg University of Applied Science, German

2026-06-24视觉感知

面向360°/鱼眼双目在原始球面中极线弯曲、视差呈二维位移而难以直接套用传统立体匹配的问题,论文主张先做球面到ERP的极线校正,再用RAFT估计光流并通过EACS仅保留与基线一致的分量,将问题恢复为单轴视差。合成鱼眼数据实验显示该模块化流程可得到平滑、结构一致的视差图并具备实时速度,但真实场景和更宽基线下的泛化仍有待验证。

Bridging the Manifold Gap: Riemannian Residual Line Search for One-Step Image Editing Figure 1
2026-06-24cs.CV

Bridging the Manifold Gap: Riemannian Residual Line Search for One-Step Image Editing

Hongzhu Yi, Zhongtian Luo, Tong Li, Yiyan Fan, Jungang Xu

2026-06-24视觉感知

这篇论文针对一步图像编辑中“改得够强”与“保留原图结构”难以兼顾的问题,认为固定更新强度不足以覆盖不同编辑类型。RRLS在能量场传输框架上加入二阶时间曲率校正,并沿源图到强编辑结果构造残差候选,再用CLIP目标对齐选择输出。文中在700个PIE-Bench++样本、10类编辑上报告其相对现有一步方法达到SOTA,同时显著降低多步编辑的运行开销。

GeoT2V-Bench: Benchmarking 3D Consistency in Text-to-Video Models via 3D Reconstruction Figure 1
2026-06-24cs.CV

GeoT2V-Bench: Benchmarking 3D Consistency in Text-to-Video Models via 3D Reconstruction

Chenrui Fan, Paolo Favaro

Computer Vision Group, Institute of, University of Bern, Switzerland, pass/fail label or a single scalar ranking, GEOT2V-BENCH reports a continuous recon-

2026-06-24视觉感知数据集/基准三维

本文针对相机运动提示下的文生视频评测:仅看画质或局部几何不足以判断视频是否真像同一静态场景的多视角采集。GeoT2V-Bench用VGGT估计相机、DeformableGS吸收时变误差,并以MedianGS静态代理形成连续重建画像。3840次重建显示,可见运动、静态渲染误差、流一致性和静动拟合差常不一致,能补充GeCo暴露的全局3D一致性失败。

High-Fidelity Synthetic Transmission Electron Microscopy Image Generation Using Diffusion Probabilistic Models for Data-Limited Semiconductor Metrology Figure 1
2026-06-24cs.CV

High-Fidelity Synthetic Transmission Electron Microscopy Image Generation Using Diffusion Probabilistic Models for Data-Limited Semiconductor Metrology

Johannes Boehm, Bappaditya Dey

Chemnitz University of Technology, Chemnitz, Germany, Interuniversity Microelectronics Centre (imec), Leuven, Belgium, severely limit the availability of diverse datasets needed for, data bottlenecks and providing controllable, domain-consistent, integration of guidance mechanisms for controllable synthesis, microscope parameters, which may not always be available., performance by generating synthetic labeled images. While

2026-06-24视觉感知生成模型

面向先进半导体 TEM 数据因制样破坏、采集慢且昂贵而极度稀缺的问题,本文用 DDPM 从少量真实晶圆图像合成可用于量测与缺陷分析的数据。核心在于渐进式 patch 到全图训练,并结合 TEM 定制增强、跨工艺迁移、分类器引导和 RePaint 式补全,同时复用扩散特征做无监督分割。实验称仅 15 张图即可训练,合成图 MS-SSIM 最高超过 0.98,专家评估也支持其结构相似性。

DDStereo: Efficient Dual Decoder Transformers for Stereo 3D Road Anomaly Detection Figure 1
2026-06-24cs.CV

DDStereo: Efficient Dual Decoder Transformers for Stereo 3D Road Anomaly Detection

Shiyi Mu, Zichong Gu, Zhiqi Ai, Yilin Gao, Shugong Xu

Shanghai University, Xi’an Jiaotong-Liverpool University

2026-06-24视觉感知三维

面向自动驾驶/机器人中双目3D检测难以兼顾实时性与开放集障碍发现的问题,DDStereo将已知类3D属性回归与类别无关前景定位拆成双轻量解码器,并用共享查询对齐两路结果,以几何视差信息估计异常而不依赖文本提示或NMS。实验称其在闭集和开放集双目基准上达到SOTA,并以23.5ms实现接近单目方法的实时速度。

OrbitForge: Text-to-3D Scene Generation via Reconstruction-Anchored Video Synthesis Figure 1
2026-06-24cs.CV

OrbitForge: Text-to-3D Scene Generation via Reconstruction-Anchored Video Synthesis

Chenrui Fan, Paolo Favaro

Computer Vision Group, Institute of Computer Science, University of Bern, Switzerland

2026-06-24视觉感知三维

OrbitForge针对文本生成视频难以直接转成可用3D场景的问题:相机不可控、覆盖不完整且时序不一致。核心洞察是把初次失败的高斯重建当作坐标锚点,渲染规范环轨以定位缺失视角,再仅补全 unsupported 视图并二次重建。300个提示评测中,中位角覆盖达359.0度,弱覆盖区域Q10 ImageReward由8.07升至16.36,但仍受视频先验和补全错误影响。

EG-VQA: Benchmarking Verifiable Video Question Answering with Grounded Temporal Evidence Figure 1
2026-06-24cs.CV

EG-VQA: Benchmarking Verifiable Video Question Answering with Grounded Temporal Evidence

Linpeng Huang, Weixing Chen, Zexin Chen, Yang Liu, Liang Lin

Sun Yat-sen University, Peng Cheng Laboratory, Shenzhen University

2026-06-24视觉感知数据集/基准

这篇论文针对现有 VideoQA 只看答案正确、难以验证模型是否真正依据视频证据推理的问题,提出 EG-VQA 基准,要求开放式回答同时给出时间定位证据,并用 EG-F1 联合衡量时序对齐与语义一致性。实验显示强闭源模型也常出现答案对但证据错的情况;经显式证据监督训练的 EG-Reasoner 在开源模型中达到领先,尤其改善反事实等推理密集问题。

Pocket-SLAM: Rendering-Area-Aware Pruning for Memory-Efficient 3DGS-SLAM Figure 1
2026-06-24cs.CV

Pocket-SLAM: Rendering-Area-Aware Pruning for Memory-Efficient 3DGS-SLAM

Leshu Li, Jie Peng, Yang Zhao

autonomous driving scenarios. Our code is publicly available, at https://github.com/UMN-ZhaoLab/Pocket-SLAM., University of North Carolina at Chapel Hill, USA.

2026-06-24三维

Pocket-SLAM针对大规模户外3DGS-SLAM中高斯点持续累积导致峰值显存过高、难以部署到车载或无人机边缘GPU的问题,提出按有效渲染面积评估高斯贡献并剪枝,同时用tile级预算避免纹理密集区域被过度删除。其洞察是户外场景中道路、天空等大覆盖区域虽梯度或不透明度低,仍提供关键全局约束。EuRoC和KITTI实验显示,在基本保持定位与重建质量的同时,峰值内存降低超过60%,FPS提升超过2倍。

Counting Trees from Satellite Imagery with Noisy Supervision Figure 1
2026-06-24cs.CV

Counting Trees from Satellite Imagery with Noisy Supervision

Dimitri Gominski, Maurice Mugabowindekwe, Qiue Xu, Xiaowei Tong, Martin Brandt, Hieu Le, Rasmus Fensholt, Dimitris Samaras, Loic Landrieu

University of Copenhagen, University of Rwanda, University of Chinese Academy of Sciences, University of North Carolina at Charlotte, Stony Brook University, While scalable supervision can be derived from airborne LiDAR, scale tree counting from satellite imagery. Code, data and models are available at, ways admit a clear object center. They occur in heterogeneous spatial configurations, ranging from, (b) Strong Labels, (c) Weak Labels, labels consisting of manually annotated tree centers (b), and weak labels automatically derived from, pervision alongside sparse high-quality labels, providing a principled solution to heterogeneous an-

2026-06-24视觉感知

这篇论文针对卫星影像中单木计数难题:稀疏树可定位、密林树冠边界却模糊,且大规模人工标注昂贵、LiDAR 弱标注噪声大。作者将计数建模为空间密度匹配,引入非平衡最优传输并用运输残差自校正弱监督,同时发布覆盖三洲三类传感器、含 2.15 亿标注的 TINYTREES。实验显示 TREEMATCH 相比检测、回归和分布匹配基线更稳健,但部分增益可能主要来自 scaling / data。

AerialFusionMapNet: Online HD Map Construction with Aerial-Onboard BEV Fusion Figure 1
2026-06-24cs.CV

AerialFusionMapNet: Online HD Map Construction with Aerial-Onboard BEV Fusion

Daniel Lengerer, Mathias Pechinger, Klaus Bogenberger, Carsten Markgraf

Code and trained models are available at https://github., resulting in high accuracy but limited scalability and costly, University

2026-06-24视觉感知

针对车载相机在线构建高精地图易受遮挡、视野范围和上下文不足限制的问题,AerialFusionMapNet引入离线航拍图像与车载BEV特征融合,并指出关键不在更复杂的航拍编码器,而在两阶段训练:先航拍预训练,再用跨视角监督对齐表示。nuScenes地理划分上最高达到54.7 mAP,较既有航拍-车载融合基线48.8 mAP提升5.9点,且对中等航拍配准偏移保持一定鲁棒性。

Revealing Training Data Exposure in Vision Language Large Models via Parameter Gradients Figure 1
2026-06-24cs.CV

Revealing Training Data Exposure in Vision Language Large Models via Parameter Gradients

Zhihao Zhu, Hongyi Tang, Yi Yang, Ahmed Abbasi

Department of Information Systems, Business Statistics and, Operations Management (ISOM), Hong Kong University of Sci-, ence and Technology, Hong Kong, China. 2Department of IT, An-, alytics, and Operations, University of Notre Dame, Notre Dame, action lawsuit was filed against the University of Chicago, Medical Center for providing thousands of patients’ un-

2026-06-24视觉感知优化算法

针对视觉语言大模型训练数据来源与版权/隐私审计困难,论文提出白盒 GradAudit,不看输出熵等表层信号,而利用训练样本在参数梯度上更稳定、更对齐的特征,并用梯度切片与噪声掩蔽提升可分性。在医疗与通用数据、预训练和微调场景中,其 AUROC 最高约 92.7%,还能区分真实图文配对与打乱配对,Ghibli 案例显示既有方法可能低估数据暴露。

Compact Object-Level Representations with Open-Vocabulary Understanding for Indoor Visual Relocalization Figure 1
2026-06-24cs.CV

Compact Object-Level Representations with Open-Vocabulary Understanding for Indoor Visual Relocalization

Zhaopeng Cui, Jiarui Hu, Jingbo Liu, Boming Zhao, Xiyue Guo, Boyin Feng, Haocheng Peng, Yujun Shen, Hujun Bao, Guofeng Zhang

2026-06-24视觉感知

针对室内重定位长期依赖低层视觉特征、地图臃肿且缺少语义可解释性的问题,OpenReLoc将场景组织为对象级地图,用CLIP开放词汇描述符与全局场景图做2D-3D对象匹配,并以对象参考帧和DIOU检索提供位姿先验,再用双路径2D ICP按物体形状细化位姿。实验在ScanNet、ScanNet++和Habitat合成大场景上报告了更高召回与精度,表明对象级语义表示可兼顾紧凑性、可扩展性和定位性能。

UniDrive: A Unified Vision-Language and Grounding Framework for Interpretable Risk Understanding in Autonomous Driving Figure 1
2026-06-24cs.CV

UniDrive: A Unified Vision-Language and Grounding Framework for Interpretable Risk Understanding in Autonomous Driving

Xiaowei Gao, Pengxiang Li, Yitai Cheng, Ruihan Xu, James Haworth, Stephen Law, Yun Ye

aDepartment of Earth Science & Engineering, Imperial College London, London, SW7 2AZ, United Kingdom, bSpaceTimeLab, Department of Civil, Environmental, and Geomatic Engineering, University College London, London, WC1E 6BT, United, cDepartment of Computing, The Hong Kong Polytechnic University, Hong Kong, China, dTrinity College, University of Oxford, Oxford, OX1 3BH, United Kingdom, eDepartment of Geography, University College London, London, WC1E 6BT, United Kingdom, fCentre for Global Infrastructure Resilience, The Bartlett School of Sustainable Construction, University College London, London, WC1E, is available at https://github.com/pixeli99/unidrive-dev.

2026-06-24视觉语言视觉感知安全鲁棒

自动驾驶风险理解需要同时解释“为什么危险”和定位“危险在哪”,而现有多模态驾驶模型常在时序推理与空间精度间取舍。UniDrive以多帧时序分支结合最新帧高分辨率感知,并用门控交叉注意力融合,联合生成风险描述和目标框。在DRAMA-Reasoning上优于图像/视频基线,并在小目标定位、NuScenes与BDD100K零样本及人工可信度评价中表现更好。

Adaptive Hebbian Memory Routing in Vision Transformers for Few-Shot Learning Figure 1
2026-06-24cs.CV

Adaptive Hebbian Memory Routing in Vision Transformers for Few-Shot Learning

Mohammed Yusuf Mujawar, Noorbakhsh Amiri Golilarz

2026-06-24视觉感知

这篇论文针对少样本视觉识别中 ViT 推理时难以按当前 support set 快速适应的问题,提出用轻量 MLP 路由器按 episode 调节 Hebbian 快权重记忆的启用强度、写入塑性和保留率,而不是固定插入记忆模块。结果显示,在相同 Swin 记忆位置下,自适应塑性将准确率从 96.74% 提至 96.92%,全自适应达 96.94%,且推理时间由 16.51 ms 降至 14.05 ms;CIFAR-FS 与多 shot 设置也有一致增益,但整体提升幅度较小。

BioMedVR: Confusion-Aware Mixture-of-Prompt Experts for Biomedical Visual Reprogramming Figure 1
2026-06-24cs.CV

BioMedVR: Confusion-Aware Mixture-of-Prompt Experts for Biomedical Visual Reprogramming

Jiaxiang Liu, Tianxiang Hu, Juwei Guan, Yujie Wu, Yusong Wang, Yao Mu, Zuozhu Liu, Mingkun Xu

Guangdong Institute of Intelligence Science and Technology, Zhuhai, China, Zhejiang University, Hangzhou, China, Southeast University, Nanjing, China, The Hong Kong Polytechnic University, Hong Kong SAR, China, Institute of Science Tokyo, Tokyo, Japan, Shanghai Jiao Tong University, Shanghai, China, which is optimized using task labels to repurpose frozen models. When applied

2026-06-24视觉感知

BioMedVR针对CLIP等视觉语言模型迁移到医学影像时全量微调昂贵、少样本且相似疾病易混淆的问题,把视觉重编程用于输入空间适配,并用正向专家识别目标类别、负向专家结合LLM生成的混淆属性抑制相近类别,再以门控融合和混淆抑制损失拉开边界。实验覆盖11个生物医学数据集和7个自然图像基准,报告少样本与零样本性能均优于既有提示学习和VR方法,且可训练参数远少于全量微调。

VSANet: View-aware Sparse Attention Network for Light Field Image Denoising Figure 1
2026-06-24cs.CV

VSANet: View-aware Sparse Attention Network for Light Field Image Denoising

Gargi Panda, Soumitra Kundu, Saumik Bhattacharya, Aurobinda Routray

collaborative filtering of similar patches collected from, Gargi Panda and Aurobinda Routray are with the Department of EE, IIT, Soumitra Kundu is with the Rekhi Centre of Excellence for the Science of, Saumik Bhattacharya is with the Department of E&ECE, IIT Kharagpur

2026-06-24视觉感知

光场图像去噪需要利用跨视角内容相关而噪声相对独立的结构,但既有方法常局限于手工先验或分割的二维子空间。VSANet将完整4D光场展成统一空间-角度token,并用LSH稀疏注意力实现近线性复杂度的全局跨视角聚合,再结合空间、角度和极线子空间特征精炼。实验称其在两个基准、三种噪声水平下优于现有SOTA。

SER: Learning to Ground Video Reasoning with Semantic Evidence Rewards Figure 1
2026-06-24cs.CV

SER: Learning to Ground Video Reasoning with Semantic Evidence Rewards

Sheng Xia, Zhengqin Lai, Tianxiang Jiang, Kanghui Tian, Shoujun Zhou, Bin Li, Yi Wang

Nanjing University, Shanghai Innovation Institute, Shanghai AI Laboratory, Harbin Institute of Technology, Shenzhen, Shenzhen Institutes of Advanced Technology, sensitive IoU rewards, and sparse temporal labels can, calization labels (Luo et al., 2025). Such annota-, ization labels are available, existing reinforcement, by overlap with one annotated box or one labeled

2026-06-24视觉感知强化学习

这篇论文针对视频 MLLM 在细粒度时空推理中“答对但证据错”的问题,指出 IoU 等几何奖励对边界扰动敏感且忽略语义有效性。SER 让模型生成对象、框和时间戳组成的证据声明,并用裁判 VLM 从相关性、定位质量与时间对齐进行语义验证,从而减少密集框标注依赖。实验在 V-STAR 上达到 49.6% mLGM,较 Open-o3-Video 提升 3.0 点,同时改善答案准确率和证据 grounding。

Evaluating the Interpretability of Sparse Autoencoders with Concept Annotations Figure 1
2026-06-24cs.CV

Evaluating the Interpretability of Sparse Autoencoders with Concept Annotations

Jonas Klotz, Cassio F. Dantas, Pallavi Jain, Diego Marcos, Begüm Demir

The Berlin Institute for the Foundations of Learning and Data (BIFOLD), yielding the most interpretable SAEs. Code and datasets are available, fore critical for trust, controllability, and scientific analysis of these models [44].

2026-06-24视觉感知

这篇论文针对视觉/视觉语言模型中 SAE 可解释性常被重建误差、稀疏性或案例展示替代评估的问题,提出用人工标注概念来检验稀疏潜变量的语义对齐。核心创新是 FBMP 多对一潜变量-概念匹配、synCUB/synCOCO 单属性扰动数据集,以及验证响应方向和选择性的 TAPAScore。结果显示这些指标能区分训练与未训练 SAE,且过高过完备度会削弱扰动对齐,中等字典规模更可解释。

Agentic Collaborative Cognition for Zero-Shot 3D Understanding Figure 1
2026-06-24cs.CV

Agentic Collaborative Cognition for Zero-Shot 3D Understanding

Wenxin Wang, Bo Zhang, Feng Chen, Zixuan Wang, Wen Li, Changsheng Li, Yinjie Lei

Agentic Collaborative Cognition for Zero-Shot 3D, Sichuan University, 2Adelaide University, University of Electronic Science and Technology of China, Beijing Institute of Technology, per, we propose a collaborative multi-agent framework that assigns a, Through this closed-loop iterative process, two agents collaboratively fig-, Keywords: Zero-Shot 3D Understanding · Collaborative Cognition ·, limits scalability and adaptability to diverse real-world environments [52,56]., In this paper, we propose a collaborative multi-agent framework for zero-shot

2026-06-24三维

本文针对零样本三维理解中依赖视频关键帧导致视角有限、空间认知隐式且不稳定的问题,提出规划代理与感知代理协作:前者按查询主动补充关键视角,后者用跨视角实例一致性维护整体认知图并反馈筛选候选。该闭环在6个基准上达到SOTA,ScanRefer Acc@0.5提升11.1%、3D对话BLEU-1提升14.6、SQA3D EM提升2.1。

ArtiTwinSplat: Interactable Digital Twin Reconstruction via Gaussian Splatting from RGB-D videos Figure 1
2026-06-24cs.RO

ArtiTwinSplat: Interactable Digital Twin Reconstruction via Gaussian Splatting from RGB-D videos

Pranjal Mishra, René Zurbrügg, Max Wilder-Smith, Marco Hutter, Marc Pollefeys, Zuria Bauer, Hermann Blum

ETH Zürich, Zürich, Switzerland. 2 Microsoft, Zürich, Switzerland. 3 University of Bonn, Bonn, Germany.

2026-06-24视觉感知三维

面向机器人在真实家庭环境中操作抽屉、柜门等关节物体时缺少可交互数字孪生的问题,ArtiTwinSplat从手持RGB-D视频自动重建3D Gaussian Splatting模型,并通过外观变化检测、反向SAM2跟踪和4D RANSAC估计关节类型、轴、枢轴与运动范围,再进行关节条件优化。实验证明其可在三类真实Kallax场景中恢复旋转/平移关节并导出Isaac Sim可用URDF,但结果主要为定性展示,量化增益文中未充分说明。

ViTexQA: A Multi-Frame Temporal Perception Dataset for Video Text Question Answering Figure 1
2026-06-24cs.CV

ViTexQA: A Multi-Frame Temporal Perception Dataset for Video Text Question Answering

Zhentao Guo, Chen Duan, Tongkun Guan, Zining Wang, Kai Zhou, Pengfei Yan

2026-06-24视觉感知数据集/基准

这篇论文针对现有视频文本问答基准多可由单帧回答、难以检验跨帧文字理解的问题,构建 ViTexQA:所有问答都要求融合多时间点文本线索,并配套时序 CoT 标注;同时提出 FrameThinker,用 CoT 监督微调和带多帧一致性奖励的强化学习显式训练时序感知。在该基准上,现有 MLLM 与人类仍有明显差距,FrameThinker 相比强基线 ROUGE-L 提升 6.3%。

EERLoss: A Novel Loss Function for Training Deep Biometric Models. A Case Study in Keystroke Dynamics Figure 1
2026-06-24cs.CV

EERLoss: A Novel Loss Function for Training Deep Biometric Models. A Case Study in Keystroke Dynamics

Nahuel Gonzalez, Marta Robledo-Moreno, Ivan DeAndres-Tame, Ruben Vera-Rodriguez, Ruben Tolosana

2026-06-24强化学习

这篇论文针对生物特征验证训练目标与常用 EER 评价指标不一致的问题,提出可次微分、可任意逼近 EER 的 EERLoss,使模型直接优化验证操作点而非仅拉开嵌入距离。在 18.5 万用户级 KVC-onGoing 键击动态基准上,相比多种现有损失收敛更快,并将原 SoTA 相对 EER 降低最高约 30.7%,训练耗时也显著下降。

Jolia: Concept-Level Vision-Language Alignment for 3D CT Contrastive Learning Figure 1
2026-06-24cs.CV

Jolia: Concept-Level Vision-Language Alignment for 3D CT Contrastive Learning

Julien Khlaut, Charles Corbière, Baptiste Callard, Amaury Prat, Leo Butsanets, Antoine Saporta, Théo Danielou, Leo Machado, Korentin Le Floch, Tom Boeken, Pierre Manceron, Corentin Dancette

Department of Vascular and Oncological Interventional Radiology, Imaging Department, Fondation Ophtalmologique Adolphe de Rothschild, Paris, France

2026-06-24视觉语言视觉感知三维

针对3D CT报告按器官组织而CLIP式全局对齐易丢失局部病灶信息的问题,Jolia提出ConQuer:用LLM将报告拆成解剖概念段,并以可学习跨注意力查询从体数据中无分割监督地提取对应区域表征,逐概念做对比学习。基于7.4万胸腹CT-报告预训练后,模型在发现分类、报告生成和跨中心迁移上优于CLIP基线并刷新多项公开基准,但部分增益可能仍受数据规模与骨干选择影响。

Multilevel Stochastic Plug-and-Play for Sparse-View CT Reconstruction Figure 1
2026-06-24cs.CV

Multilevel Stochastic Plug-and-Play for Sparse-View CT Reconstruction

Antoine De Paepe, Alexandre Bousse, Dimitris Visvikis

2026-06-24三维

针对稀疏视角 CT 中投影不足导致的病态重建与 PnP 随机方法迭代开销大问题,论文提出 ML-SPnP:把随机 PnP 的多层加速放到小波多分辨率近似空间中,使跨层先验一致性修正在期望上消失,从而避免多次估计细层随机先验梯度。实验显示其在两类医学 CT 数据上保持接近先进随机 PnP 的重建质量,同时显著缩短运行时间。

PatternGSL: A Structured Specification Language for Template-Free and Simulation-Ready 3D Garments Figure 1
2026-06-24cs.CV

PatternGSL: A Structured Specification Language for Template-Free and Simulation-Ready 3D Garments

Zhenyang Li, Lutao Jiang, Yizhou Zhao, Ying-Cong Chen, Xin Wang, Weikai Chen, Yifan Peng

The University of Hong Kong, The Hong Kong University of Science and Technology (Guangzhou), Carnegie Mellon University, The University of Hong Kong Hong Kong Hong Kong SAR, China, The Hong Kong University of Science and Technology (Guangzhou) Guangzhou Guangzhou, China, Carnegie Mellon University Pittsburgh Pittsburgh, PA, USA

2026-06-24三维

这篇论文针对单图服装重建中“几何形状可恢复但缺少可仿真的缝制结构、程序化方法又依赖模板”的断层,提出 PatternGSL:用统一语言显式编码裁片、参数化边界和缝合拓扑,并训练 VLM 从图像直接生成该规格。配套 30 万样本数据集后,方法在图案精度、缝合恢复和布料 draping 稳定性上优于基线,报告 99.2% 仿真成功率,但部分增益可能主要来自 scaling / data。

Quantum CT via Dynamic Interval Encoding and Prior-Balanced QUBO Reconstruction Figure 1
2026-06-24cs.CV

Quantum CT via Dynamic Interval Encoding and Prior-Balanced QUBO Reconstruction

Ao Wang, Yikuang Yuluo, Yujie Liu, Shuangyang Zhong, Yuwen Zhang, Zihao Wang, Fenglin Liu, Andreas Maier, Haijun Yu, Yixing Huang

2026-06-24三维

本文针对灰度量子 CT 中二进制变量预算限制:全局高比特编码会放大 QUBO 规模,低比特又带来量化误差。核心做法是用动态局部灰度区间逐轮编码,并以边界命中规则调节搜索/细化,同时平衡投影一致性与边缘保持先验。稀疏视角和有限角扇束实验优于多类基线,D-Wave 混合求解器验证了可执行性,但大规模、噪声和真实 CT 仍待验证。

Heterogeneous Knowledge Distillation via Geometry Decoupling and Momentum-Aware Gradient Regulation Figure 1
2026-06-24cs.CV

Heterogeneous Knowledge Distillation via Geometry Decoupling and Momentum-Aware Gradient Regulation

Wuming Yang, Xiang Zhang, Hongmin Zhao

2026-06-24优化算法

论文针对 Transformer 到 CNN 等异构知识蒸馏中训练不稳定的问题,指出根因在于特征范数差异和主任务/蒸馏梯度冲突。方法 SPOFA 用 LayerNorm 投影解耦幅值与方向,并用动量 EMA 调节冲突蒸馏信号。实验称其在 CIFAR-100 和 ImageNet-1K 上优于 OFA、PAT,且训练开销很小、推理无额外成本。

Are Text-to-Image Models Inductivist Turkeys? A Counterfactual Benchmark for Causal Reasoning Figure 1
2026-06-24cs.CV

Are Text-to-Image Models Inductivist Turkeys? A Counterfactual Benchmark for Causal Reasoning

Jiayi Lei, Yuandong Pu, Xingyu Han, Rongpeng Zhu, Jing Xu, Jinyao Wang, Zijian Zhou, Bin Fu, Yuewen Cao, Yihao Liu, Yongsheng Li

Shanghai Jiao Tong University, Shanghai AI Laboratory, The Chinese University of Hong Kong

2026-06-24视觉感知数据集/基准

这篇论文关注文生图模型的“推理”是否只是训练共现的统计归纳。作者提出 CF-World,将同一场景拆成事实、显式反事实和隐式反事实三层,并用 CF-Eval、PRR/RRR 衡量模型抵抗现实先验和保留推理的能力。实验显示开源与闭源模型从事实到反事实均明显退化,说明当前 T2I 更依赖文本-视觉高频绑定,尚难真正解耦规则并生成反事实世界。

PointVG-R: Internalizing Geometric Reasoning in MLLMs for Precise Pointing Localization via Visual Chain of Thought Figure 1
2026-06-24cs.CV

PointVG-R: Internalizing Geometric Reasoning in MLLMs for Precise Pointing Localization via Visual Chain of Thought

Ling Li, Bowen Liu, Zinuo Zhan, Jianhui Zhong, Ziyu Zhu, Bingcai Wei, Kenglun Chang, Zhidong Deng

Tsinghua University, Dalian University of Technology, Northwestern Polytechnical University, Wuhan University, Tsinghua University Beijing Shi China, Dalian University of Technology Dalian Shi China, Northwestern Polytechnical University Xi’an Shi China, Wuhan University Wuhan City China

2026-06-24视觉感知

针对多模态大模型在指向式视觉定位中易忽视手势几何约束、出现显著性偏差和定位幻觉的问题,PointVG-R将手部检测、指尖关键点、指向射线与目标语义串成视觉CoT,并用EgoPoint-CoT、SFT+RL及基于组方差的自适应奖励加权来稳定坐标学习;实验称在第一视角指向定位上达到SOTA,mIoU较基线提升15.86点。

ForensicsTok: Forensics-Guided Tokenized Modeling for Image Tampering Localization Figure 1
2026-06-24cs.CV

ForensicsTok: Forensics-Guided Tokenized Modeling for Image Tampering Localization

Lei Xu, Haowei Wang, Shen Chen, Taiping Yao, Bin Li, Changsheng Chen

Shenzhen University, Tencent Youtu Lab, Shenzhen MSU-BIT University

2026-06-24视觉感知

针对现有 MLLM 图像篡改定位依赖外部分割器、空间信号在拼接管线中被削弱的问题,ForensicsTok 将掩码定位改写为自回归空间 token 生成,并用 TSD 稳定 token 到二值掩码的解码、用 HEF 注入多尺度取证特征。六个基准上,它显著优于 MLLM 基线,并较强取证专家模型有小幅提升,同时在扰动下更稳健。

VisCritic: Visual State Comparison as Process Reward for GUI Agents Figure 1
2026-06-24cs.CV

VisCritic: Visual State Comparison as Process Reward for GUI Agents

Jiachen Qian

City University of Hong Kong, isting trajectories without additional human labels for critic training.

2026-06-24强化学习

这篇论文针对 GUI 智能体长程操作中缺少逐步校验、一次点错会级联失败的问题,提出将动作前后截图的视觉状态差异作为过程奖励信号。VisCritic 用孪生 ViT 提取变化表征,并以动作感知 critic 同时预测成功、进展和错误类型,弱监督数据来自已有轨迹。五个网页、移动和桌面基准显示其可作为即插即用模块,通常提升指标并多数情况下优于文本式 PRM,同时提供变化区域诊断;但细粒度文字变化和动态噪声仍是限制。

What Do Flow-Based Inverse Solvers Approximate? A Posterior-Transport View Figure 1
2026-06-24cs.CV

What Do Flow-Based Inverse Solvers Approximate? A Posterior-Transport View

Jian Xu, Delu Zeng, John Paisley, Qibin Zhao

South China University of Technology, Columbia University

2026-06-24生成模型优化算法

论文针对 FlowDPS、FLOWER、PnP-Flow 等基于流匹配先验的逆问题求解器缺少后验解释的问题,指出确定性流中的贝叶斯条件化应发生在源分布重加权而非轨迹漂移上,并将现有引导项统一为最小动能校正场的不同近似。闭式 2D 实验证明源重加权可贴近真实后验,而轨迹引导误差高出 200–800 倍且易塌缩模态;其轻量速度校正器在图像恢复中质量有竞争力,并能给出与误差相关的不确定性。

GeoIMO: Geometry-Driven Independent Motion Classification for Event Cameras Figure 1
2026-06-24cs.CV

GeoIMO: Geometry-Driven Independent Motion Classification for Event Cameras

Anil Bayram Gogebakan, Filippo Marostica, Alessio Caviglia, Alessandro Savino, Stefano Di Carlo

2026-06-24视觉感知

这篇论文针对事件相机自动驾驶数据集中“有框但不区分是否真正运动”的标注错位问题,提出不依赖学习和人工运动标签的 GeoIMO:用带偏航补偿的 FOE 几何模型估计自车诱导的全局背景运动,再以目标框内局部运动相对预测的尺度不变残差判定独立运动,并做时间稳定化。MVSEC 与 Prophesee 实验显示其在多种驾驶场景下表现稳定,转弯时偏航补偿带来改进,简单平移局部模型在精度与效率间较优。

VistaRef: Boosting Visual Spatial Orientation Awareness for Pointing-to-Object Detection Figure 1
2026-06-24cs.CV

VistaRef: Boosting Visual Spatial Orientation Awareness for Pointing-to-Object Detection

Ling Li, Zhizhen Cai, Xinkun Wu, Ziyu Zhu, Jiaqing Lyu, Bowen Liu, Zhidong Deng

Tsinghua University, Beijing University of Posts and, Graduate School, Dalian University of Technology, AR and human-robot collaboration, providing a basis for seam-, cise physical spatial awareness for high-frequency collaboration in, robot collaboration [29, 39, 50, 61], and human–computer interface

2026-06-24视觉感知

本文关注指向式物体检测中 Transformer 对手指微小方向变化不敏感、易在远距离或密集目标中产生定位漂移的问题。VistaRef 的核心思路是把隐式指向几何显式化:用 LHEM 强化手部/指尖局部姿态建模,用 GRM 建模从手到目标的几何射线,并以 OCAL 约束方向一致性。实验称相对基线 grounding accuracy 绝对提升 14 个百分点,但具体增益在不同模块和数据因素间的归因仍需看完整消融。

RetiSEM: Generalising Causal Models for Fragmented Biomedical Data Figure 1
2026-06-24cs.CV

RetiSEM: Generalising Causal Models for Fragmented Biomedical Data

Inam Ullah, Imran Razzak, Shoaib Jameel

University of Southampton, Southampton, SO18 1PB, Hampshir, United Kingdom, Mohamed bin Zayed University of Artificial Intelligence, United Arab Emirates, available at: https://github.com/Inamullah-Colab/, are rarely available jointly at the participant level [Acosta, clinical and physiological information [National Center for

2026-06-24视觉感知

针对临床、分子与眼底影像常分散且难以联合观测的问题,RetiSEM将变量按生物学先验分块,用禁边约束的结构方程模型恢复因果图,并分解总效应、直接效应和间接效应来检验视网膜表型的通路角色。十组合成基准中其结构误差更低、因果准确率更高;真实碎片化数据表明视网膜特征主要是下游生物标志物,间接中介信号较小但可检测。

Advancing WordArt-Oriented Scene Text Recognition: Datasets and Methods Figure 1
2026-06-24cs.CV

Advancing WordArt-Oriented Scene Text Recognition: Datasets and Methods

Xingsong Ye, Yongkun Du, Jiaxin Zhang, Haojie Zhang, Chong Sun, Chen Li, Jing Lyu, Zhineng Chen

Institute of Trustworthy Embodied AI, Fudan University, Shanghai Key Laboratory of Multimodal Embodied AI, Fudan University, WeChat Vision, Tencent Inc., South China University of Technology, dArt), which provides highly accurate and controllable synthetic Wor-, and data are available at https://github.com/YesianRohn/WATER.

2026-06-24视觉感知数据集/基准

本文针对艺术字场景文本识别中字体、纹理和版式高度不规则、现有STR数据和固定尺寸模型难以覆盖的问题,构建2M规模合成数据WATER-S:一部分由SynthWordArt可控渲染,另一部分用Qwen3-VL挖掘提示并由Z-Image生成以提升真实多样性;同时提出支持任意形状输入、采用RoPE视觉编码和自回归解码的WATERec。在去重后的真实数据WATER-R配合下,WordArt-Bench准确率达90.40%,显著超过通用及OCR专用VLM,但增益可能主要来自data scaling与专用架构共同作用。

MambaRaw: Selective State Space Modeling for Efficient 4K Raw Image Reconstruction Figure 1
2026-06-24cs.CV

MambaRaw: Selective State Space Modeling for Efficient 4K Raw Image Reconstruction

Peize Li, Fanhu Zeng, Tongda Xu, Xingguo Xu, Xinjie Zhang, Xingtong Ge, Haotian Zhang, Yan Wang

Institute for AI Industry Research (AIR), Tsinghua University, King’s College London, Dalian University of Technology, Hong Kong University of Science and Technology, School of Computer Science, Peking University

2026-06-24视觉感知三维

MambaRaw针对4K RAW重建中卷积感受野有限、注意力代价过高的问题,利用相机内JPEG预览作为参考,在元数据式重建框架中引入SSM熵参数估计。其核心是空间-能量耦合上下文建模:TileMambaBlock只扫描信息密集块,EAR按RAW长尾能量分布细化特征。Sony、Olympus、Samsung实验显示其在低元数据码率下较强基线提升约1.2–1.4 dB PSNR,并降低约9%端到端编码延迟。

video-SALMONN-R$^3$: Learning to ReWatch, ReAsk, and ReAnswer for Efficient Video Understanding Figure 1
2026-06-24cs.CV

video-SALMONN-R$^3$: Learning to ReWatch, ReAsk, and ReAnswer for Efficient Video Understanding

Yixuan Li, Guangzhi Sun, Yudong Yang, Wei Li, Zejun MA, Chao Zhang

Tsinghua University, University of Cambridge

2026-06-24视觉感知

这篇工作针对视频 LLM 受算力与显存限制、低帧率/低分辨率易漏掉关键细节的问题,将“先粗看定位、再高保真重看”的范式做成端到端模型。核心创新是不依赖 CoT 冷启动标注,而用强化学习学习重看策略,并通过 re-answer 先答后修正、re-ask 重注入问题来缓解预训练模型行为不匹配和因果注意力限制。实验显示其优于基座模型、QA-SFT 和既有重看方法,且计算成本更低。

Boosting Text-Driven Video Segmentation via Geometry-Aware Distillation Figure 1
2026-06-24cs.CV

Boosting Text-Driven Video Segmentation via Geometry-Aware Distillation

Tianyu Zhu, Yingping Liang, Hesong Li, Ying Fu

Beijing Institute of Technology, Beijing, China, performance across multiple RVOS benchmarks. The code is available at, rely on predefined labels and lack flexibility in open-world scenarios. Recently, cient and scalable manner. Rather than modeling complex temporal dynamics

2026-06-24视觉感知

针对文本驱动视频目标分割常依赖2D预训练和朴素分割损失、难以保持跨帧几何一致的问题,论文提出GeoLaV:先用单图新视角合成做单目几何预训练,再用VGGT/π3等3D教师进行几何感知蒸馏,把结构先验注入视频模型。仅图像训练已在零样本RVOS上明显优于SAMWISE,完整模型在消融中由65.1提升到70.5 J&F,并声称多基准达到SOTA。

Lite Any Stereo V2: Faster and Stronger Efficient Zero-Shot Stereo Matching Figure 1
2026-06-24cs.CV

Lite Any Stereo V2: Faster and Stronger Efficient Zero-Shot Stereo Matching

Junpeng Jing, Ronglai Zuo, Zhelun Shen, Shangchen Zhou, Rolandos Alexandros Potamias, Stefanos Zafeiriou, Krystian Mikolajczyk, Jiankang Deng

world pseudo supervision, we further introduce pseudo-label, available at https://tomtomtommi.github.io/LiteAnyStereoV2/., Mikolajczyk, and J. Deng are with Imperial College London, London SW7, strategy. After supervised training on synthetic labeled data, perturbations. We then exploit real-world unlabeled stereo, introduce a pseudo-label filtering mechanism and an error-, clamping operation, which help suppress noisy labels and

2026-06-24视觉感知

面向机器人、自动驾驶等受算力约束场景,本文试图打破“轻量双目难以零样本泛化”的假设。LAS2用面向真实延迟优化的纯2D代价聚合替代重3D聚合,并结合合成监督、自蒸馏、真实无标注双目的教师蒸馏,以及伪标签过滤和误差截断。结果显示LAS2-M在四个真实基准上优于LAS且在H200/Orin更快,LAS2-H整体超过Fast-FoundationStereo并显著降延迟。

SENTRY: SAM2-Enhanced Neighbor-Aware and Temporally Reasoned Memory for Visual Tracking Figure 1
2026-06-24cs.CV

SENTRY: SAM2-Enhanced Neighbor-Aware and Temporally Reasoned Memory for Visual Tracking

Mohamad Alansari, Yonathan Michael, Hasan AlMarzouqi, Muzammal Naseer, Naoufel Werghi, Sajid Javed

Khalifa University, Abu Dhabi, UAE, University of Western Australia, Australia, source SAM2-based trackers across all available scales and datasets, fill-

2026-06-24视觉感知

这篇论文针对 SAM2 系视觉跟踪在遮挡、快速运动和干扰物下易因“只按置信度写入记忆”而漂移的问题,提出训练-free 的 SENTRY:在写入记忆前对候选掩码做短时回溯、邻域感知匹配和循环一致性验证。结果显示其可插入五个 SAM2 基线,在九个基准上稳定提升,并在 LaSOT、GOT-10k、VOT20/22、DiDi 等取得零样本 SOTA,同时保持实时速度和较小显存开销。

P-MTP: Efficient Document Parsing via Multi-Token Prediction with Progressive Depth Scaling Figure 1
2026-06-24cs.CV

P-MTP: Efficient Document Parsing via Multi-Token Prediction with Progressive Depth Scaling

Le Xiang, Chenxi Zhai, Shu Wei, Jingjing Wu, Qunyi Xie, Xiao Tan, Kunbin Chen, Wei He

Department of Computer Vision Technology (VIS), Baidu Inc., China, Tsinghua University, Shenzhen International Graduate School, China

2026-06-24视觉感知

针对文档解析中 VLM 自回归生成在长文本、密集版面下延迟高的问题,P-MTP 将多 token 预测用于更深前瞻,并用渐进课程损失按路径可靠性和目标一致性抑制远距离预测噪声,推理时再以置信度门控动态决定草稿长度。多基准结果显示其在解析精度几乎不降的情况下最高实现约 5× 加速。

S1-Omni-Image: A Unified Model for Scientific Image Understanding, Generation, and Editing Figure 1
2026-06-24cs.CV

S1-Omni-Image: A Unified Model for Scientific Image Understanding, Generation, and Editing

Qingxiao Li, Zikai Wang, Qingli Wang, Nan Xu

XScience Lab

2026-06-24视觉感知

科学图像不仅要“好看”,还要保持术语、结构关系和任务意图正确,通用生成模型容易在图表、医学分割等场景失真。S1-Omni-Image的核心是让S1-VL-32B先进行任务推理,再把隐藏状态对齐注入MMDiT生成/编辑模块,并用31.4万样本SciGenEdit训练。实验显示其在GenExam、TechImageBench及MSD、cigRockSEM、SynthRAD2025、IXI等编辑基准优于开源基线,同时基本保留科学图像理解能力。

MedPCFM: Improving Medical Point Cloud Completion by Integrating Point Transformers and Flow Matching Figure 1
2026-06-24cs.CV

MedPCFM: Improving Medical Point Cloud Completion by Integrating Point Transformers and Flow Matching

Kamil Kwarciak, Marek Wodzinski

Department of Measurement and Electronics, AGH University of Krakow, Krakow, Sano Centre for Computational Medicine, Krakow, Poland

2026-06-24生成模型三维

这篇论文面向医学三维重建中缺损解剖点云难以唯一补全、扩散采样代价高的问题,提出以 Point Transformer V3 表征条件速度场的流匹配方法 PCFM,并与确定性 PTv3 编码器-解码器、PVCNN/PTv3 扩散基线做匹配比较。结果显示,PCFM 在 SkullFix、SkullBreak 和 Mandibular Defect 上取得最强生成式表现,接近确定性 PTv3,且采样步数更少、速度最高约提升 7 倍;但部分增益可能来自 PTv3 backbone 与点数/模型 scaling。

Transformation Behavior of Images in Latent Space Figure 1
2026-06-24cs.CV

Transformation Behavior of Images in Latent Space

Christian Zöllner (1), Mozzam Motiwala (1), Aysel Ahadova (1), Gerrit Anders (4), Robert Hüneburg (2 and 3), Jacob Nattermann (2 and 3), Matthias Kloor (1) ((1) Department of Applied Tumor Biology Institute of Pathology Heidelberg University Hospital, (2) National Center for Hereditary Tumor Syndromes University Hospital Bonn, (3) Department of Internal Medicine I University Hospital Bonn, (4) Leibniz Institut für Wissensmedien)

aDepartment of Applied Tumor Biology, Institute of Pathology, Heidelberg University, bNational Center for Hereditary Tumor Syndromes, University Hospital, cDepartment of Internal Medicine I, University Hospital Bonn, Venusberg-Campus, There are several encoder networks available, either, rendering networks invariant to label-irrelevant transformations., the latent space, using networks provided by Lunit Inc. and Bioptimus, both, stained sections available in a colorectal tissue dataset and the publicly ac-, sonalized treatment plans. However, the scarcity of labeled data poses a ma-, tion, and embedder networks, which enhance the usability of available data, of training samples Si and corresponding labels Li, a transformation Tj is, i which still matches the original label, cost-intensive effort of labeling: so-called embedder networks are trained

2026-06-24视觉感知

本文关注病理图像编码器在常见增强后是否真正保持潜空间不变,以解释数据增强为何仍有价值。作者直接比较原图、变换图与随机图块的嵌入距离,指出现有编码器仅具鲁棒性而非不变性:变换后嵌入仍发生非零漂移,颜色变换影响大于空间翻转,病理专用模型较 ImageNet 通用模型更稳定,并暴露出特征解耦不足的问题。

EgoSAT: A Comprehensive Benchmark of Egocentric Streaming Interaction Understanding Figure 1
2026-06-24cs.CV

EgoSAT: A Comprehensive Benchmark of Egocentric Streaming Interaction Understanding

Yijia Lei, Jinzhao Li, Yichi Zhang, Jiacheng Hua, Yin Li, Miao Liu

2026-06-24数据集/基准

面向可穿戴/具身助手的实时交互理解,EgoSAT指出仅做离线视频问答难以评估模型在流式场景中对已发生、正在发生和将发生事件的统一推理。其核心是把回溯问答、在线理解和未来预测放入只可访问历史帧的同一协议,并引入可回答性与置信度校准诊断。基于165小时Ego4D视频和约4800个问答,实验显示现有开闭源VLM在前瞻预测和回溯检索上仍弱,流式模型落后离线模型,且常出现高置信错误。

Modality-Aware Out-of-Distribution Detection for Multi-Modal Action Recognition Figure 1
2026-06-24cs.CV

Modality-Aware Out-of-Distribution Detection for Multi-Modal Action Recognition

Lars Doorenbos, Duc Manh Vu, Serdar Ozsoy, Juergen Gall

University of Bonn, Germany, Lamarr Institute for Machine Learning and Artificial Intelligence, Germany

2026-06-24视觉感知

针对多模态动作识别中现有 OOD 检测在推理时仍套用单模态打分、未利用模态关系的问题,论文发现 ID 样本的单模态预测聚合与多模态预测高度相关,而 OOD 会破坏这种关系,并据此构建后验的模态感知混合检测器,结合该关系信号、特征空间离群分数与多模态 logits 归一化。实验在 MultiOOD 五个数据集、14 组设置上平均优于既有方法,Kinetics-600 Far-OOD 上 FPR 较 SOTA 降低 6.2。

Female-RHINO: A Real-Time Scanner-Integrated Framework for Automated Quantitative Uterine MRI Analysis and Structured Reporting Figure 1
2026-06-24eess.IV

Female-RHINO: A Real-Time Scanner-Integrated Framework for Automated Quantitative Uterine MRI Analysis and Structured Reporting

Deepak Bhatia, Saad Ahmad, Smiti Tripathy, Maria Camila Bustos Vivas, Lieselotte Kratzsch, Anika Knupfer, Jordina Aviles Verdera, Susanne Schulz-Heise, Matthias May, Jana Hutter

multi-center datasets spanning diverse protocols, vendors, pleted in under 70 seconds, enabling availability of results, J Aviles Verdera and J Hutter are with School of Biomedical Engineer-, J Aviles Verderas, A Knupfer and J Hutter are with Institute for Infor-, mation Processing, Leibniz University Hannover, Germany and CAIMed, L3S research institute, Hannover, Germany, M May is with Imaging Science Institute, Uniklinik Erlangen, Ulmen-, center MRI examinations spanning heterogeneous acquisition, Protocol I consists of a large publicly available dataset of, Each protocol includes segmentation labels for four clini-, labels are illustrated in Fig. 1C. All segmentation masks, In addition to segmentation labels, a set of anatomically

2026-06-24视觉感知

针对子宫 MRI 定量评估依赖人工、缺少扫描中反馈且报告不标准的问题,Female-RHINO 将 MRI 扫描仪内联通信与 3D 分割、解剖标志点检测结合,自动输出子宫/病灶体积、肌瘤和纳氏囊肿量化及结构化报告。其在 500 余例多中心数据上训练评估,子宫和肌瘤 Dice 分别为 0.82、0.80,标志点误差 3.7 mm,端到端耗时低于 70 秒。

MATCH: Flow Matching for Multi-View Anomaly Detection Figure 1
2026-06-24cs.CV

MATCH: Flow Matching for Multi-View Anomaly Detection

Mathis Kruse, Melissa Schween, Bodo Rosenhahn

2026-06-24视觉感知生成模型

面向复杂工业件单视角难以覆盖缺陷的问题,MATCH 将 Flow Matching 引入多视角异常检测,用 ODE 似然构造对象、图像和像素级异常分数,并利用其架构灵活性处理多尺度特征;同时省略昂贵散度项以提升实时性。实验在 Real-IAD 与 MANTA-Tiny 上取得检测和分割 SOTA,并在消费级 GPU 上约 18.77 FPS,但进一步融合 3D 约束仍留待未来工作。

Structural Kolmogorov-Arnold Convolutions: Learnable Function on the Values or the Filter Shape as Parameter-Efficient Alternative to Per-Edge Convolutional KANs Figure 1
2026-06-24cs.CV

Structural Kolmogorov-Arnold Convolutions: Learnable Function on the Values or the Filter Shape as Parameter-Efficient Alternative to Per-Edge Convolutional KANs

Stefano Mereu, Oleksandr Kuznetsov, Gabriele Marchello, Alessandro Galdelli, Emanuele Frontoni, Adriano Mancini, Ferdinando Cannella

bDepartment of Informatics, Bioengineering, Robotics and Systems Engineering (DIBRIS), University of Genoa, 16145 Genoa, Italy, cDepartment of Theoretical and Applied Sciences (DISTA), eCampus University, Via, dDepartment of Intelligent Software Systems and Technologies, School of Computer, Science and Artificial Intelligence, V. N. Karazin Kharkiv National University, 4 Svobody, eDepartment of Information Engineering, Marche Polytechnic University, 60131 Ancona

2026-06-24视觉感知

针对现有卷积 KAN 为每个卷积核位置配置独立一元函数而参数重、易过拟合的问题,论文提出把可学习函数从“边”移到卷积结构中,并按作用于像素值或滤波器形状组织 SV-KAN、AG-KAN 与 RF-KAN。核心洞察是函数放置位置比函数数量更关键:RF-KAN 用 Morlet 小波岭函数学习滤波器形状并引入内容自适应幅值。四层 CIFAR 实验中,RF-KAN/SV-KAN 以约 0.4M 参数超过普通卷积和多种 per-edge KAN,CIFAR-10 约 88.5%,CIFAR-100 约 64.6%。

SignNet-1M: Large-Scale Multilingual Sign Language Video Dataset with Downstream Benchmarks Figure 1
2026-06-24cs.CV

SignNet-1M: Large-Scale Multilingual Sign Language Video Dataset with Downstream Benchmarks

Zhewen He, Junyi Hu, Haomian Huang, Zhenhua Li, Yu-Shen Liu, Yi Fang

2026-06-24视觉感知数据集/基准

针对现有手语翻译/识别数据多来自固定视角、单一背景和少量签者,模型在真实部署中易受分布偏移影响,SignNet-1M用3DGS新视角渲染、扩散式背景/身份编辑和视频扰动构建约100万多语种增强片段,并配套按视角、背景、身份等因素分层的下游基准。实验显示,用该数据训练可提升跨视角、跨背景、跨身份及后渲染扰动下的泛化,同时基本保持原分布性能;但具体增益可能主要来自更大规模和结构化增强的共同作用。

Open-Vocabulary BEV Segmentation with 3D-Aware Geometric Constraints Figure 1
2026-06-24cs.CV

Open-Vocabulary BEV Segmentation with 3D-Aware Geometric Constraints

Hojun Choi, Seulbin Hwang, Dae Jung Kim, Kisung Kim, Hyunjung Shim, Jinhan Lee

2026-06-24视觉感知优化算法三维

这篇论文针对自动驾驶 BEV 感知长期依赖闭集类别、遇到训练外物体会形成语义盲区的问题,提出开放词汇 BEV 分割任务与 OVBEVSeg。核心洞察是避免把噪声 2D VLM 结果直接反投影到 3D,而用可靠 3D 结构约束语义投影、逐场景优化并蒸馏到在线模型。在 nuScenes 上,方法在未见类别上较闭集方法提升 15.3 mIoU,推理速度为投影式方法的 2.5 倍且显存仅 0.22 倍。

TIGER: Taming Identity, Geometry, and Generative Priors for High-Quality Face Video Restoration Figure 1
2026-06-24cs.CV

TIGER: Taming Identity, Geometry, and Generative Priors for High-Quality Face Video Restoration

Yang Zhou, Wenxue Li, Peng Zhang, Yifei Chen, Fei Wang, Daiguo Zhou

2026-06-24视觉感知生成模型

本文针对人脸视频修复中身份漂移、参考图视角与表情纠缠、一步生成易损失真实感的问题,提出 TIGER:用 ArcFace 身份嵌入锚定主体,以跨源 3D 参数融合生成时序一致的几何法线,并用一步 rectified flow 调用视频生成先验;配合三阶段训练和新构建的 28,491 样本数据集,实验显示其在身份保持、感知质量和时序稳定性上优于现有方法。

Ill-Posed by Design: Probing Evidence Use in VLMs Figure 1
2026-06-24cs.CV

Ill-Posed by Design: Probing Evidence Use in VLMs

Boaz Meivar, Shaked Perek, Shani Shvartzman, Eli Schwartz, Shai Avidan

Tel Aviv University

2026-06-24视觉语言三维

本文动机是指出常规反事实干预在“答案已由多线索充分决定”的任务上难以诊断 VLM 真正用到的证据。作者把单目物体真实尺寸估计设计成先天欠定的诊断任务,构建 Metric VQA 并用六类视觉/语言干预拆解证据来源。结果显示,开放 VLM 在野外场景中甚至落后于纯文本强 LLM,主要依赖目标身份,较少稳定利用像素、上下文和全局几何;LoRA 虽能提升任务表现,但未学会利用场景几何。

UniTranslator: A Unified Multi-modal Framework for End-to-end In-Image Machine Translation Figure 1
2026-06-24cs.CV

UniTranslator: A Unified Multi-modal Framework for End-to-end In-Image Machine Translation

Jiahao Lyu, Pei Fu, Zhenhang Li, Shaojie Zhang, Jiahui Yang, Yu Zhou, Can Ma, Zhenbo Luo, Jian Luan

2026-06-24视觉感知

这篇论文针对图中机器翻译中级联 OCR-MT-编辑易累积错误、统一多模态模型又存在理解与生成语义不一致及文本位置错位的问题,提出 UniTranslator:用 UGAM 对齐翻译理解与渲染表示,并用 SMD 以像素级文本区域监督增强空间控制。实验显示其在 Translatotron-V、IIMT30k、PRIM 等基准上整体提升 BLEU/COMET 与 FID,尤其改善真实场景中的翻译准确性和视觉保真。

REDI-Match: Rotation-Equivariant Distillation for Efficient and Robust Dense Matching Figure 1
2026-06-24cs.CV

REDI-Match: Rotation-Equivariant Distillation for Efficient and Robust Dense Matching

Yinji Ge, Guixu Zheng, Wulong Guo, Qian Feng, Xu Wu, Kai Zhou, Xinyuan Liu, Fei Xing

Tsinghua University, Southern University of Science and Technology, Beihang University, Zhejiang University

2026-06-24安全鲁棒

这篇论文针对稠密匹配在大幅平面旋转下容易失效、而数据增强或纯等变网络难兼顾语义与几何一致性的问题,提出将视觉基础模型语义蒸馏到轻量旋转等变编码器的 REDI,并用熵驱动模块显式选择旋转假设后再细化匹配。实验显示其在多类旋转基准上达到 SOTA,SatAst 位姿精度绝对提升 13.89%,且较 RoMa v2 快 1.9 倍、约 41 FPS。

TrOCR for Medieval HTR: A Systematic Ablation Study with Cross-Dataset Validation Figure 1
2026-06-24cs.CV

TrOCR for Medieval HTR: A Systematic Ablation Study with Cross-Dataset Validation

Sachin Sharma, Michele Flammini, Federico Simonetta

2026-06-24数据集/基准

本文针对中世纪手稿HTR中预训练TrOCR与历史书写域差异大、标注数据少的问题,系统消融对比CLAHE预处理、数据增强和编码器/解码器层冻结,并在Cortonese与READ-16上交叉验证。结果显示最佳CER约8.03%,去除CLAHE仍达7.84%,浅层冻结影响不显著但深度冻结退化,且解码器冻结阈值比编码器更可迁移。

No Figure
2026-06-24cs.CV

MM-TRELLIS: Point-Cloud Guided Multi-Modal 3D Vehicle Generation in Autonomous Driving

Hongli Xiao, Youjian Zhang, Yucai Bai, Chaoyue Wang, Yaohui Jin, Xiaoguang Ren, Wenjing Yang, Long Lan

2026-06-24三维

面向自动驾驶仿真与训练数据生成,论文针对现有车辆重建难以同时利用多视图图像和 LiDAR、且网格质量偏低的问题,提出 MM-TRELLIS:在 TRELLIS 的原生 3D 扩散先验上循环注入多视图条件,并用点云在测试时对齐朝向、约束去噪几何,再以 3DGS 不透明度过滤浮点伪影。Waymo 实验显示其在真实场景车辆生成的几何一致性和网格质量上优于既有方法。

Training-free Cross-domain Few-shot Segmentation via Robust Semantic Representation and Matching Figure 1
2026-06-24cs.CV

Training-free Cross-domain Few-shot Segmentation via Robust Semantic Representation and Matching

Sujun Sun, Mingwu Ren, Haofeng Zhang

2026-06-24视觉感知安全鲁棒

针对跨域少样本分割中现有方法依赖源域训练或目标微调、在引入视觉基础模型后仍易过拟合的问题,本文提出基于 DINOv3 的免训练框架,通过语义感知特征重融合、查询信息增强支持特征,以及全局/区域/像素混合原型匹配来提升跨域语义对齐与鲁棒性。四个目标域实验显示其无需训练即可超过当前 CD-FSS 方法,但具体增益中 DINOv3 scaling 贡献占比仍未充分说明。

Hierarchical Spatial and Channel Aggregation for Cross-domain Few-shot Segmentation Figure 1
2026-06-24cs.CV

Hierarchical Spatial and Channel Aggregation for Cross-domain Few-shot Segmentation

Sujun Sun, Mingwu Ren, Haofeng Zhang

2026-06-24视觉感知

本文针对跨域少样本分割中源域训练导致的语义粒度过对齐和属性过对齐问题,提出 DHANet:分别在空间维做层次区域聚合、在通道维做层次属性聚合,并在测试时用在线概率语义库从高置信查询预测中采样伪原型补充支持信息。实验称在四个目标域数据集上达到 SOTA,但具体增益拆分与失败场景仍需看完整表格验证。

ActiveScope: Actively Seeking and Correcting Perception for MLLMs Figure 1
2026-06-24cs.CV

ActiveScope: Actively Seeking and Correcting Perception for MLLMs

Yajing Wang, Chao Bi, Junshu Sun, Shufan Shen, Zhaobo Qi, Shuhui Wang, Qingming Huang

2026-06-24视觉感知

本文针对高分辨率图像中 MLLM 细粒度感知易被显著干扰物误导、且多目标定位不完整的问题,指出关键瓶颈是上下文支配和语义偏置。ActiveScope 以训练无关方式引入语义锚定位和干扰抑制式迭代校正,分别解耦多目标注意力并遮蔽错误区域重定位;在 V* Bench、HR-Bench 4K/8K 上优于现有训练无关方法,V* Bench 准确率达 96.34%。

AVOC: Enhancing Hour-Level Audio-Video Understanding in Omni-Modal LLMs via Retrieval-Inspired Token Compression Figure 1
2026-06-24cs.CL

AVOC: Enhancing Hour-Level Audio-Video Understanding in Omni-Modal LLMs via Retrieval-Inspired Token Compression

Yijing Chen, Wenhui Tan, Xiaoyi Yu, Yuyue Wang, Xin Cheng, Kaisi Guan, Hao Jiang, Xiangyang Li, Guojie Zhu, Ruihua Song

Gaoling School of Artificial Intelligence, Renmin University of China 2 Huawei Inc.

2026-06-24视觉感知

针对长时音视频理解中上下文窗口受限、原始音视频 token 冗余且稀疏采样易漏关键信息的问题,AVOC 将多模态 token 压缩重述为固定预算下的 top-K 检索,结合查询相关性、跨音视频重要性和时间感知多样性选择信息子集。实验显示其在 OmniVideoBench、LVOmniBench 平均准确率分别领先次优 4.9、5.5 分,并能处理最长一小时的针尖检索任务。

UniRED: Unified RGB-D Video Frame Interpolation with Event Guidance Figure 1
2026-06-24cs.CV

UniRED: Unified RGB-D Video Frame Interpolation with Event Guidance

Yinuo Zhang, Guangshun Wei, Yuanfeng Zhou, Yiran Shen

2026-06-24视觉感知

面向高速运动下 RGB-D 相机帧率不足、仅靠两端帧难以保持外观与几何一致的问题,UniRED 将 RGB、深度和事件流统一用于视频插帧:先融合三模态特征,再用运动基细化 RGB 双向光流、用 Z 轴细化深度,并通过双向 warping 与软融合生成中间 RGB-D 帧。论文还构建 RGB-D-Event 数据集;实验显示其在公开基准和新数据集上提升 RGB 光度质量与深度几何精度,但具体增益中数据贡献占比仍需进一步区分。

MotifGen: Spatiotemporal interpolation of misaligned satellite images via multi-source generative modeling, in an application to tropical cyclones Figure 1
2026-06-24cs.CV

MotifGen: Spatiotemporal interpolation of misaligned satellite images via multi-source generative modeling, in an application to tropical cyclones

Clément Dauvilliers (Inria), Claire Monteleoni (Inria)

2026-06-24视觉感知生成模型

针对热带气旋微波卫星观测重访周期长、不同传感器时间不规则且地理错位的问题,MotifGen将多源微波与红外观测纳入流匹配生成框架,并用随机遮蔽重建的自监督任务训练,以适配可变数量和异构来源。实验显示,自监督和加入红外均降低CRPS;最佳模型的集合均值在RMSE、MAE等指标上与确定性MoTiF基线相当或略优,同时功率谱更接近真实观测,保留更多中高频结构。

3DCarGen: Scalable 3D Car Generation via 3D-consistent Multi-view Synthesis Figure 1
2026-06-24cs.CV

3DCarGen: Scalable 3D Car Generation via 3D-consistent Multi-view Synthesis

Hongli Xiao, Youjian Zhang, Yaohui Jin, Xiaoguang Ren, Wenjing Yang, Long Lan

2026-06-24三维

面向自动驾驶仿真中单张真实车辆图像难以生成高保真三维资产的问题,3DCarGen的关键洞察是先用固定视角生成粗一致多视图,再以3DGS粗几何作为同步条件驱动任意视角扩散生成,并将ISOMER扩展为结合颜色与法线优化的ISOMER+。实验显示其在合成与真实数据上提升了跨视角几何一致性和网格重建质量。

Social Structure Matters in 3D Human-Human Interaction Generation Figure 1
2026-06-24cs.CV

Social Structure Matters in 3D Human-Human Interaction Generation

Zhongju Wang, Beier Wang, Yatao Bian, Pichao Wang, Zhi Wang, Daoyi Dong, Hongdong Li, Huadong Mo, Zhenhong Sun

University of New South Wales, National University of Singapore, Nanjing University, University of Technology Sydney, Australian National University

2026-06-24三维

本文针对文本驱动三维双人交互生成中仅拼接单人动作会导致阶段错位、接触失败和角色不一致的问题,提出把 HHI 建模为“社会结构”规划与落地:LLM 负责分解交互阶段并分配双方角色,Solo-to-Social 执行器用 LoRA、自条件和自我坐标系下的伙伴条件改造单人运动模型。实验称在标准 HHI 基准上提升文本对齐、阶段一致性和伙伴协同,但具体增益来源仍需结合消融进一步判断。

TuringViT: Making SOTA Vision Transformers Accessible to All Figure 1
2026-06-24cs.CV

TuringViT: Making SOTA Vision Transformers Accessible to All

Qiman Wu, Hanlin Chen, Lyujie Chen, Rui Xin, Jianlei Zheng, Mingyuan Wang, Jiahui Hu, Da Zhu, Yuecheng Ma, Yuhua Wei, Yizhao Wang, Hua Zhou, Yuheng Zhang, Anhua Liu, Shaman Tang, Yue He, Pengfei Diao, Shuang Su, Haotong Xin, Weichao Huang, Hang Zhang, Xianming Liu

Foundation Model Team, Xpeng Inc.

2026-06-24视觉感知

这篇论文针对现有视觉编码器在高分辨率、动态分辨率和下游 VLM/VLA 定制中训练成本高、数据依赖重的问题,提出 TuringViT:以 Turing Linear Attention 替代大部分 softmax 注意力,结合 VISTA 图像-视频数据筛选与原生动态分辨率预训练。结果显示其用约 10% 数据超过 SigLIP2 等开源 ViT,在零样本分类、检索和下游多模态任务中更强,并在高分辨率推理延迟上呈更接近线性的扩展。

M^2C-EvDet: Multi-Domain Multi-Order Cross-Modal Knowledge Distillation for Event-based Object Detection Figure 1
2026-06-24cs.CV

M^2C-EvDet: Multi-Domain Multi-Order Cross-Modal Knowledge Distillation for Event-based Object Detection

Wei Bao, Siqi Li, Shouan Pan, Yi Xie, Yue Gao

2026-06-24视觉感知

本文针对事件相机目标检测中事件数据稀疏、语义弱,导致与RGB检测器存在性能差距的问题,提出M²C-EvDet跨模态蒸馏框架。其核心是将RGB教师知识按频域解耦为低/高频语义,并用超图式注意力蒸馏低阶与高阶目标关系,从而超越仅做空间或成对关系蒸馏的方法。在三个RGB-Event检测数据集上验证有效,DSEC-Detection上提升3.6 mAP并刷新SOTA。

Automated Residual Plot Assessment With the R Package autovi and the Shiny Application autovi.web Figure 1
2026-06-24stat.ML

Automated Residual Plot Assessment With the R Package autovi and the Shiny Application autovi.web

Weihao Li, Dianne Cook, Emi Tanaka, Susan VanderPlas, Klaus Ackermann

Monash University, The Australian National University and, University of Nebraska, \addressnum 1 Department of Econometrics and Business, Statistics, Monash University, Wellington Road, VIC 3800, Australia, \addressnum 2 Research School of Finance, Actuarial Studies and, Statistics, The Australian National University, CBE Building 26C, \addressnum 3 Department of Statistics, University of Nebraska, Hardin

2026-06-24视觉感知

这篇论文针对线性模型残差图诊断依赖人工目视判断、难以规模化且分析者间不一致的问题,提出用计算机视觉模型自动预测视觉信号强度(VSS),并封装为 R 包 autovi 与 Shiny 应用 autovi.web。其核心洞察是把残差图中的模型违背模式转化为基于 KL 距离的连续可学习目标,在模拟的非线性、异方差、非正态等场景上训练模型;主要结果是提供可直接用于残差样本评估的工具链,并输出 VSS 及辅助信息以支持模型拟合诊断。

From Open Waters to Enclosed Cabins: ProteusVPR for Cross-Scene Visual Place Recognition in Maritime Perception and Cabin Inspection Figure 1
2026-06-24cs.CV

From Open Waters to Enclosed Cabins: ProteusVPR for Cross-Scene Visual Place Recognition in Maritime Perception and Cabin Inspection

Zexi Chena, Zitai Huang, Qiwen Gu, Zhiqi Li, Shengli Dong, Chenlei Wang, Junqiao Zhao, Hongdong Wang, Bing Han

2026-06-24视觉感知

本文针对船舶机器人在甲板与舱室间切换时,视觉地点识别易受稀疏纹理、光照变化和舱内重复结构干扰的问题,提出ProteusVPR:不替换现有VPR骨干,而在检索后加入融合相邻帧、几何描述、局部仿射坐标和相机方位的位姿细化网络。作者还构建8K全景船载XHZ数据集;实验显示该框架可在多种VPR模型上稳定降低定位误差,平均均值误差降幅超过60%,但部分已较准检索场景的分位误差会轻微退化。

Latent Visual States for Efficient Multimodal Reasoning Figure 1
2026-06-24cs.CV

Latent Visual States for Efficient Multimodal Reasoning

Xiuwei Chen, Wentao Hu, Yongxin Wang, Zisheng Chen, Likui Zhang, Kun Xiang, Jianhua Han, Hui-Ling Zhen, Jingyuan Zou, Hang Xu, Xiaodan Liang

Sun Yat-sen University, The Hong Kong Polytechnic University, Huawei Noah’s Ark Lab, Yinwang Intelligent Technology Co. Ltd

2026-06-24视觉语言

针对多模态模型依赖外部裁剪、检测等离散工具带来的推理中断、不可端到端优化和高延迟问题,论文提出 EVA,让模型生成自适应连续 Latent_slot 作为内部视觉思考,并用显著性加权、三阶段训练和 D-GSPO 稳定潜在/文本联合优化;在多项视觉推理基准上取得一致性能提升,同时较工具调用范式降低推理延迟。

FiCA: Feed-forward instant Gaussian Codec Avatars from a Single Portrait Image Figure 1
2026-06-24cs.CV

FiCA: Feed-forward instant Gaussian Codec Avatars from a Single Portrait Image

Kim Youwang, Zhengyu Yang, Liuhao Ge, Yu Rong, Timur Bagautdinov, Su Zhaoen, Nir Sopher, Jovan Popović, Teng Deng, Tae-Hyun Oh, Chen Cao

Codec Avatars Lab, Meta, School of Computing, KAIST

2026-06-24视觉感知三维

FiCA针对高保真可驱动头像依赖多视角采集、离线跟踪和个体优化的问题,提出从单张人像直接生成Gaussian Codec Avatar的前馈流程。其关键在于用人体视觉基础模型提取局部UV、法线和顶点信息,再由扩散模型补全纹理与几何,并用前馈网格细化保持身份细节,最后经通用先验解码为可实时驱动的3D高斯头像。实验显示其在多身份和表情上视觉与定量结果优于近期单图方法,单图生成约5秒完成。

No Figure
2026-06-24cs.CV

Geometry-Instructed Video Editing

Chirui Chang, Xiaoyang Lyu, Yi-Hua Huang, Haoru Tan, Shizhen Zhao, Yikang Ding, Jianmin Bao, Xin Tao, Pengfei Wan, Xiaojuan Qi

The University of Hong Kong, The University of Hong Kong Hong Kong Hong Kong

2026-06-24视觉感知

这篇论文针对生成式视频编辑中物体平移、旋转、缩放、删除等几何操作难以在时间和视角上精确执行、且阴影反射等次生效果不一致的问题,提出 GIVE:用编辑前后的深度框和朝向框表示物体 3D 状态转移,避免逐视频重建。作者还用 Unreal Engine 构造受控前后配对数据训练与评测;结果显示其在 GIVE-Bench 的 PSNR/SSIM/LPIPS 和真实视频用户偏好上优于基线,但增益可能部分来自合成数据规模与覆盖度。

MorVess: Morphology-Aware Pulmonary Vessel Segmentation Network Figure 1
2026-06-24cs.CV

MorVess: Morphology-Aware Pulmonary Vessel Segmentation Network

Fuyou Mao, Yifei Chen, Beining Wu, Lixin Lin, Jinnan Dai, Zhiling Li, Yilei Chen, Yaqi Wang, Hao Zhang, Yan Tang, Huiyu Zhou, Feiwei Qin

2026-06-24视觉感知

肺血管在 CT 中细小、稀疏且拓扑复杂,常规逐体素掩码监督容易漏分支、断连。MorVess 的核心是把血管距离图、厚度图等可微几何先验与掩码联合预测,并用轻量 2.5D 适配器将 SAM 引入体数据,再通过全局-局部融合强化多尺度结构一致性。文中在两个肺部 CT 基准上报告 Dice、clDice 和 HD95 均优于对比方法,尤其改善小血管恢复与连通性。

Inclusive Interactive Collisions for Multi-View Consistent Compositional 3D Generation Figure 1
2026-06-24cs.CV

Inclusive Interactive Collisions for Multi-View Consistent Compositional 3D Generation

Chang Liu, Mingwen Shao, Xiang Lv, Xinyuan Chen, Lingzhuang Meng, Qiao Zhang, Zhengyi Gong, Jinghao Hu

2026-06-24三维

这篇论文针对现有文本到三维方法偏向单物体、难以生成多物体合理接触关系且多视角优化易产生不一致的问题,提出 I2C-3D:先用 LLM 规划局部—全局三维布局并组合粗场景,再通过“包容式交互碰撞”约束高斯基元集中到合理交互区域,并用多视角自适应 SDS 调制注意力以增强跨视角一致性。实验显示其在组合三维资产质量、交互合理性和多视角一致性上优于对比方法。

Co-occurring associated retained concepts in Diffusion Unlearning Figure 1
2026-06-24cs.CV

Co-occurring associated retained concepts in Diffusion Unlearning

Miso Kim, Georu Lee, Yunji Kim, Hoki Kim, Jinseong Park, Woojin Lee

Dongguk University-Seoul, 2Chung-Ang University, 3Korea Institute for Advanced Study, anchors are commonly obtained from prompts drawn from external label sets (e.g., ImageNet) or

2026-06-24生成模型

这篇论文关注扩散模型概念遗忘中的过度删除问题:擦除裸体、风格或物体时,模型也会压制“人”“星空”“淡水”等无害共现概念。作者提出 CARE 概念与 CARE score,并用 ReCARE 自动构建需保留的共现词表参与训练。实验显示其在裸体、梵高风格、Tench 遗忘任务上兼顾低攻击成功率、较好效用和最高 CARE 保留,训练开销也较低。

Towards Fast and Effective Long Video Understanding of Multimodal Large Language Models via Adaptive Quasi-Gaussian Sampling Figure 1
2026-06-24cs.CV

Towards Fast and Effective Long Video Understanding of Multimodal Large Language Models via Adaptive Quasi-Gaussian Sampling

Kun Zhang, Chenxin Fang, Tao Chen, Baiyang Song, Yunhang Shen, Yiyi Zhou, Rongrong Ji

Key Laboratory of Multimedia Trusted Perception and Efficient Computing, Ministry of Education of China, Xiamen University, 361005, P.R. China

2026-06-24视觉语言视觉感知三维

这篇论文针对长视频输入使多模态大模型推理成本和显存开销过高、而硬关键帧选择又难兼顾局部与全局理解的问题,提出免训练的 AdaQ,将帧选择建模为自适应准高斯采样,并利用帧-查询相似度方差调节 3σ 区间:局部问题收窄采样,全局问题扩大覆盖。实验覆盖4个MLLM和3种嵌入模型,显示其相对默认模型和SOTA选帧方法均有稳定增益,如Qwen3-VL-8B平均提升9.0%,且多数任务仅需1个超参数。

Deep Learning Approaches for 3D Medical Scene Completion: From Geometric Modeling to Generative Paradigms Figure 1
2026-06-24cs.CV

Deep Learning Approaches for 3D Medical Scene Completion: From Geometric Modeling to Generative Paradigms

Afifa Khaled, Said Jadid Abdulkadir, Majdy Mohamed Eltayeb Eltahir

Department of Computing, available at the end of the article, ever, most of the available scene understanding technologies, such as RGB-D cam-

2026-06-24生成模型三维

面向机器人、自动驾驶和医疗/数字孪生等场景中传感器只能获得遮挡、稀疏3D观测的问题,本文系统回顾2016—2026年3D场景补全从体素CNN到点云、隐式场、Transformer、扩散模型与3D Gaussian Splatting的演进,核心洞察是表示能力、内存/速度和生成先验之间的权衡决定方法路线;主要结果是给出方法分类、评测指标与部署挑战综述,并提出面向基础模型、4D补全、不确定性和绿色AI的研究议程,文中未报告新的定量增益。

Zero-Shot Test-Time Canonicalization using Out-of-Distribution Scoring Figure 1
2026-06-24cs.CV

Zero-Shot Test-Time Canonicalization using Out-of-Distribution Scoring

Dominik Lindner, Johann Schmidt, Tom Siegl, Martin Becker, Sebastian Stober

2026-06-24视觉感知

这篇论文针对预训练视觉模型在旋转、缩放、剪切等保持类别不变的仿射扰动下易失效、而重训或改架构成本高的问题,将测试时规范化重新解释为最小化 OOD 分数的零样本搜索。作者系统比较约二十种 OOD 分数和九类搜索策略,发现距离型分数配合随机搜索与局部细化整体最稳,并用门控机制避免已对齐样本被误变换,从而在保持 ID 精度的同时提升扰动输入鲁棒性。

Tri-Efficient Transfer Learning for Point Cloud Videos Figure 1
2026-06-24cs.CV

Tri-Efficient Transfer Learning for Point Cloud Videos

Yiding Sun, Dongxu Zhang, Jihua Zhu, Haozhe Cheng, Zhengqiao Li, Pengcheng Li, Chaowei Fang, Yonghao Dong, Lin Chen

2026-06-24视觉感知三维

本文针对点云视频迁移学习中标注成本高、参数冗余和显存瓶颈并存的问题,提出三重高效框架 PoinTriE:用刚体变换合成伪运动轨迹,并结合文本与2D投影进行几何-运动多模态自监督预训练;微调时冻结主干,仅训练带 LoRA 的时空侧网络并用梯度流掩码降显存。实验在动作识别和语义分割上取得新 SOTA,如 MSR-Action3D 94.37% 准确率、Synthia 4D 84.11% mIoU。

A Dual Edge Spatial Jacobian Image Graph for Interpretable Diabetic Retinopathy Grading Figure 1
2026-06-24eess.IV

A Dual Edge Spatial Jacobian Image Graph for Interpretable Diabetic Retinopathy Grading

Inam Ullah, Imran Razzak, Shoaib Jameel

University of Southampton, Mohamed bin Zayed University of Artificial Intelligence, University of Southampton Southampton United Kingdom, Mohamed bin Zayed University of Artificial Intelligence Abu Dhabi United Arab Emirates

2026-06-24视觉感知

本文针对糖尿病视网膜病变分级中“只给标签、难解释病灶与血管关系”的问题,提出双边空间–Jacobian图:一条边刻画病灶证据相对血管和黄斑区的空间关系,另一条边刻画图像嵌入对AutoMorph血管生物标志物的敏感性,并用轻量注意力融合。在2910张APTOS图像上,五分类QWK为0.8312、相邻等级准确率0.9330,转诊DR AUROC达0.9711;但全文图准确率未超过最强单一嵌入流,增益主要在可解释结构而非性能。

Spectral Evolution-Guided Token Pruning in Multimodal Large Language Models Figure 1
2026-06-24cs.CV

Spectral Evolution-Guided Token Pruning in Multimodal Large Language Models

Bin Chen, Yuxiang Cai, Yadan Luo, Yi Zhang, Jianwei Yin, Zhi Chen

School of Software Technology, Zhejiang University, Ningbo, China, Zhejiang Key Laboratory of Digital-Intelligence Service Technology, China, The University of Queensland, St Lucia, QLD, Australia, Singapore Management University, Singapore, The University of Southern Queensland, Toowoomba, QLD, Australia

2026-06-24视觉语言

针对多模态大模型视觉 token 冗余导致推理延迟高、现有剪枝依赖单层注意力且易受位置偏置影响的问题,论文提出无需训练的 CLSE:从频域刻画视觉 token 跨 Transformer 层由高频结构细节向低频语义抽象的演化强度,并据此保留语义活跃 token。实验覆盖图像和视频基准,显示在激进压缩下可降低 FLOPs、KV cache 和延迟,同时保持或提升精度。

Dual-Branch Cross-Projection Debiasing through Diffusion-based Disentanglement Figure 1
2026-06-24cs.CV

Dual-Branch Cross-Projection Debiasing through Diffusion-based Disentanglement

Xiangqian Zhao, Xinyang Jiang, Zhipeng Xu, Lingfeng He, Zilong Wang, Dongsheng Li, De Cheng, Nannan Wang

Xidian University, Xidian University Shaanxi 710071 China

2026-06-24生成模型

本文针对基础视觉模型在有偏数据上依赖虚假相关、导致少数群体泛化差的问题,提出 D2CP:先用扩散模型解耦出的语义概念挖掘伪偏置属性,再以目标/偏置双分支提示调优和交叉零空间投影削弱偏置信息。四个基准上,其在无群组标注设置取得最优或强竞争的 worst-group accuracy,且仅调优最多 0.22% 参数。

Accelerating Multimodal Large Language Models with Prior-Corrected Token Reduction Figure 1
2026-06-24cs.CV

Accelerating Multimodal Large Language Models with Prior-Corrected Token Reduction

Zengjie Chen, Yuxiang Cai, Jingcai Guo, Taotao Cai, Jianwei Yin, Zhi Chen

School of Software Technology, Zhejiang University, Ningbo, China, Zhejiang Key Laboratory of Digital-Intelligence Service Technology, China, Hong Kong Polytechnic University, Hong Kong SAR, The University of Southern Queensland, Toowoomba, QLD, Australia

2026-06-24视觉语言

这篇论文针对MLLM推理中视觉token过多且现有注意力剪枝易受模型固有先验干扰的问题,指出无指令时模型也会偏向某些区域,导致任务相关证据被误删。PriorTR用空token在单次前向中估计先验,并以先验校正后的任务增量信息选择token,同时物理裁剪隐藏状态和KV缓存。多模型多基准实验显示其在激进token预算下改善精度—效率权衡,并降低延迟、显存和FLOPs。

Differential Unfolding: Efficient Unfolding Reconstruction for Video Snapshot Compressive Imaging Figure 1
2026-06-24cs.CV

Differential Unfolding: Efficient Unfolding Reconstruction for Video Snapshot Compressive Imaging

Muyuan Zhang, Jiancheng Zhang, Haijin Zeng, Yin-ping Zhao

2026-06-24视觉感知三维

本文针对视频快照压缩成像中深度展开网络各阶段重复使用高复杂度先验、后期特征更新趋于停滞而计算冗余的问题,提出 Differential Unfolding:用少量通用阶段做结构锚定,并以轻量差分阶段通过 DRP、DRA 和 DM-FFN 建模跨阶段变化。实验声称在多个 SCI 基准上达到新的 SOTA,同时显著降低参数量和 FLOPs。

Autonomous Video Generation with Counterfactual Controllability for Self-Evolving World Models Figure 1
2026-06-24cs.CV

Autonomous Video Generation with Counterfactual Controllability for Self-Evolving World Models

Xin Wang, Wenxuan Liu, Tongtong Feng, Wenwu Zhu

Department of Computer Science and Technology, Tsinghua University, Beijing, China., Beijing National Research Center for Information Science and Technology, Beijing, China.

2026-06-24视觉感知强化学习规划控制

本文动机是指出视频生成虽能预测逼真画面,却未必具备可干预、可执行的机器人世界模型能力。核心洞察是以“反事实可控性”替代单纯视觉逼真度,提出生成、绑定、验证、蒸馏闭环,并用新颖性、一致性、OOD鲁棒性和效率联合评价。主要结果更像概念框架与指标定义,文中未充分说明实证增益。

Geometry-Aware Style Transfer in 3D Gaussian Splatting Figure 1
2026-06-24cs.CV

Geometry-Aware Style Transfer in 3D Gaussian Splatting

Min Hyeok Bang, Jun Hyeong Kim, Seung-Wook Kim, Se-Ho Lee

2026-06-24三维

这篇论文针对现有 3DGS 风格迁移多停留在颜色/纹理层面、几何改动易破坏场景的问题,提出将颜色参数与几何参数解耦交替优化,并用融合 RGB、深度和边缘的 GCFM 对比特征匹配,把风格图中的结构线索传到高斯基元。实验显示其在视觉保真度和定量指标上优于已有 3DGS 风格化方法,但具体增益在多大程度来自几何优化或多模态特征设计仍需更多消融支撑。

Sat2City v2: Native 3D City Asset Generation from a Single Satellite Image Figure 1
2026-06-24cs.CV

Sat2City v2: Native 3D City Asset Generation from a Single Satellite Image

Tongyan Hua, Dongli Wu, Jinjing Zhu, Yinrui Ren, Zhongcheng Hong, Ying-Cong Chen, Hui Xiong, Wufan Zhao

2026-06-24视觉感知三维

本文面向从单张卫星图生成可复用三维城市资产的问题,动机是现有方法多停留在街景渲染代理,难以得到可编辑的显式纹理网格。核心做法是构建1.6万组真实弱对齐卫星—网格数据,并把网格编码到预训练原生3D潜空间,再微调卫星条件几何流与纹理生成,以减少噪声网格带来的表示学习负担。实验显示其在DSM重建及几何、外观资产生成基准上整体优于对比方法,但增益可能主要来自预训练表示与真实数据规模。

Bengal-HP_RU: A Dataset of Bengal People For Head Pose Estimation Figure 1
2026-06-24cs.CV

Bengal-HP_RU: A Dataset of Bengal People For Head Pose Estimation

Md. Ahanaf Arif Khan, Md. Tawhidur Rahman, Sangeeta Biswas, Md. Iqbal Aziz Khan, Subrata Pramanik, Sanjoy Kumar Chakravarty, Bimal Kumar Pramanik

2026-06-24数据集/基准三维

针对现有头姿估计数据集对南亚、尤其孟加拉人群覆盖不足的问题,本文构建 Bengal-HP_RU:从 Wikimedia Commons 采集真实场景图像,经 YOLOv8-Face 裁剪、MediaPipe/OpenCV 三维几何估计与人工校正生成 yaw/pitch/roll 标签,并按上传者划分避免泄漏。主要结果是公开 12,894 张带连续头姿标注的孟加拉人脸图像,含 10,494 训练和 2,400 测试样本;模型增益文中未充分说明,贡献可能主要来自 data。

Flood Mapping from RGB imagery using a Vision Foundation Model Figure 1
2026-06-24cs.CV

Flood Mapping from RGB imagery using a Vision Foundation Model

Vladyslav Polushko, Tilman Bucher, Ronald Rösch, Thomas März, Markus Rauhut, Andreas Weinmann

2026-06-24视觉感知

本文面向灾后应急中快速获得高分辨率淹水范围的需求,研究将卫星预训练的地球观测视觉基础模型 Prithvi-EO-2.0 接入 UPerNet,并适配到厘米级机载 RGB 水体分割。结果显示,Prithvi-2.0-UPN 在同事件训练时达到或接近现有基线,在 Blessem 到 Neuenahr 的跨洪灾零样本迁移中优于基线,且用少量目标事件标注微调时提升最快,说明其具备一定数据高效迁移能力,但零样本性能仍有改进空间。

An LMM for Precisely Grounding Elements in Documents Figure 1
2026-06-24cs.CV

An LMM for Precisely Grounding Elements in Documents

Yijian Lu, Chuangxin Zhao, Kai Sun, Lei Hou, Juanzi Li, Ji Qi

Department of Computer Science and Technology, Tsinghua University, Institute of Automation, Chinese Academy of Sciences

2026-06-24视觉语言

针对文档图像中文字密集、布局复杂导致现有多模态模型难以精确定位证据的问题,本文提出 PreciseDoc:用两套文档生成流水线构造带细粒度坐标的训练数据,并在文档问答中通过 SFT 到强化学习联合监督答案与中间框,采用匈牙利匹配 IoU 奖励和长度惩罚。实验显示其在文档元素定位上优于基线,PreciseDoc-Reasoner 的证据框更准且问答准确率可接近现代 LMM。

A Benchmark for Hallucination Detection in VLMs for Gastrointestinal Endoscopy Figure 1
2026-06-24cs.CV

A Benchmark for Hallucination Detection in VLMs for Gastrointestinal Endoscopy

Aminu Lawal, Niyoj Oli, Sachin Acharya, Prashnna Gyawali, Maria Carmen Romano, Binod Bhattarai

2026-06-24视觉语言视觉感知数据集/基准

该文针对胃肠内镜场景中 VLM 幻觉检测缺乏系统评测的问题,基于 Gut-VLM 在5个模型上比较9类黑盒、灰盒和白盒方法。核心洞察是放射学基准上的方法迁移不稳,且“自信虚构”会同时击穿一致性和不确定性信号;白盒 ReXTrust 依靠隐藏状态在所有模型上取得最高 AUC,平均领先非白盒方法19.5点,最高达93.0。

DramaDirector: Geometry-Guided Short Drama Generation Figure 1
2026-06-24cs.CV

DramaDirector: Geometry-Guided Short Drama Generation

Hengji Zhou, Sijie Liu, Jianrun Chen, Xingchen Zou, Lianghao Xia, Liqiang Nie

South China University of Technology, The Hong Kong University of Science and Technology (Guangzhou), Harbin Institute of Technology, Shenzhen

2026-06-24视觉感知

本文针对短剧生成中纯文本分镜难以表达快节奏镜头语法和人物空间几何的问题,提出 DramaDirector:将每个镜头拆为静态视觉条件与动态叙事条件,并从真实短剧镜头库检索深度—姿态参考来约束首帧和视频生成,同时用结构化 SFT 与基于文本-视觉对齐奖励的 GRPO 训练规划器。作者还构建 DramaBoard 基准,实验显示其在叙事忠实度、镜头一致性和可控性上优于多智能体与视频生成基线。

NavWM: A Unified Navigation World Model for Foresight-Driven Planning Figure 1
2026-06-24cs.RO

NavWM: A Unified Navigation World Model for Foresight-Driven Planning

Yanghong Mei, Longteng Guo, Ming-Ming Yu, Guiyu Zhao, Xingjian He, Jing Liu

Institute of Automation, Chinese Academy of Sciences, Beihang University, School of Artificial Intelligence, University of Chinese Academy of Sciences

2026-06-24机器人强化学习规划控制

NavWM针对视觉导航中反应式策略短视、单一轨迹导致模式坍缩,以及现有世界模型将感知、生成和控制割裂的问题,提出共享双向 Mamba 主干的统一导航世界模型,用潜在世界 token 注入几何/语义先验,并以锚点式多模态轨迹生成候选,再通过未来视觉模拟做闭环选择。实验显示其提升未来图像生成质量,PSNR由14.17升至17.34,导航成功率由66%升至72%,零样本场景达44%。

Beyond Bayer: Task-Optimal Sensor Co-Design for Robust Autonomous-Driving Segmentation Figure 1
2026-06-24cs.CV

Beyond Bayer: Task-Optimal Sensor Co-Design for Robust Autonomous-Driving Segmentation

Reeshad Khan, John Gauch

University Of Arkansas, Fayetteville AR 72701, USA

2026-06-24视觉感知安全鲁棒

这篇论文把自动驾驶分割的鲁棒性问题前移到相机传感器设计:相比继续放大模型,作者用可微 RAW-to-task 流水线分解 PSF、CFA 与噪声的作用。核心洞察是光学 PSF 对逐像素任务只能损失信息,而可学习 2×2 光谱 CFA 才是有效自由度。实验在 KITTI-360/ACDC 上显示 CFA 带来约 +0.017/+0.023 mIoU,PSF 共设计在匹配物理设置下反而下降约 0.020,大于 2×2 的 CFA tile 也持续变差。

Universal Guideline-Driven Image Clustering via a Hybrid LLM Agent Figure 1
2026-06-24cs.CV

Universal Guideline-Driven Image Clustering via a Hybrid LLM Agent

Wenliang Zhong, Rob Barton, Lucas Goncalves, Kushal Kumar, Feng Jiang, Hehuan Ma, Yuzhi Guo, Vidit Bansal, Karim Bouyarmane, Junzhou Huang

The University of Texas at Arlington, 2 Amazon

2026-06-24视觉感知

这篇论文针对图像聚类在细粒度、长尾、多准则场景中难以统一的问题,提出用自然语言 guideline 驱动的通用聚类代理。核心做法是先用多模态 LLM 生成与准则相关的概念代理文本,再用指令嵌入形成可聚类表示,并通过最小生成树上的选择性 LLM 遍历处理复杂语义合并。实验覆盖四类聚类任务,报告相比专用方法有更好泛化与性能,但具体增益中 LLM 语义推理与表示改进的贡献仍需更多消融支撑。

Progressive Pixel-Neighborhood Deformable Cross-Attention for Multispectral Object Detection Figure 1
2026-06-24cs.CV

Progressive Pixel-Neighborhood Deformable Cross-Attention for Multispectral Object Detection

Tian Qiu, Jifeng Shen, Xin Zuo

School of Electrical and Information Engineering, Jiangsu University, Zhenjiang, 212013, China, School of Computer Science and Engineering, Jiangsu University of Science and Technology, Zhenjiang, 212003, China

2026-06-24视觉感知

针对可见光与红外图像弱配准下的跨模态融合,论文认为错位多集中在目标邻域,没必要做全局交叉注意力。PNAFusion用像素邻域交叉注意力减少冗余匹配,并用自适应可变形对齐学习局部偏移,再迭代细化融合。在FLIR、M3FD、DroneVehicle上取得84.2、90.5、85.5 mAP@0.5,相比ICAFusion显存降33%、FLOPs降至156.4G,但延迟仍受可变形采样影响。

End-to-End Radar and Communication Modulation Recognition with Neuromorphic Computing Figure 1
2026-06-24cs.CV

End-to-End Radar and Communication Modulation Recognition with Neuromorphic Computing

Xiaohu Li, Chongxiao Qu, Caiyong Lin, Chenxiao Dou, Wei Hua

2026-06-24视觉感知

针对自动调制识别在无人机、物联网等受限平台上难以兼顾精度与能耗的问题,本文提出端到端脉冲网络 EMRFormer,用自适应脉冲编码、ILIF 神经元、SSCNN 与 SpikeFormer 直接处理原始 IQ 波形,以减少静态编码信息损失并建模多尺度时序依赖。实验称其在多类雷达/通信数据集上达到领先精度,低 SNR 下更稳健,理论能耗降低超 90%,并在 KA200 类脑芯片上相对 3090 GPU/Orin NX 约降 5 倍功耗。

Fabric Image Demoiréing Benchmark from Synthesis to Restoration Figure 1
2026-06-24cs.CV

Fabric Image Demoiréing Benchmark from Synthesis to Restoration

Pengchao Wei, Xiaojie Guo

2026-06-24视觉感知数据集/基准

本文针对织物细纹与相机采样产生的摩尔纹难以用屏幕摩尔纹方法迁移的问题,指出核心瓶颈在于织物纹理与混叠频谱高度纠缠且真实成对数据难对齐。作者提出 PRISM 物理残差注入合成框架,构建 16,050 张多分辨率配对数据,并设计 FaDeNet 以基底/细节分解和频谱各向异性门控保守修复。实验显示其在 PRISM 的 PSNR、SSIM、LPIPS 上优于代表性基线,并在真实无配对织物图像上具备一定零样本泛化。

ObsGraph: Hierarchical Observation Representation for Embodied Reasoning and Exploration Figure 1
2026-06-24cs.CV

ObsGraph: Hierarchical Observation Representation for Embodied Reasoning and Exploration

Taekbeom Lee, Youngseok Jang, Jeonghwa Heo, Jeongjun Choi, H. Jin Kim

2026-06-24视觉感知

针对机器人在陌生环境中需边探索边判断“还缺什么信息”的问题,ObsGraph将观察组织为房间—视图—物体三层场景图,在保留视觉证据的同时用对象共现和空间层级支持粗到细检索,并把检索到的信息缺口直接映射为房间探索、视角细化或前沿探索。实验显示其在具身推理与探索基准上提升成功率和效率,说明结构化观察记忆有助于更有针对性地采集证据。

Ingredient-Level Food Image Segmentation for Nutrition Awareness Figure 1
2026-06-24cs.CV

Ingredient-Level Food Image Segmentation for Nutrition Awareness

Jonesh Shrestha

Jarvis College of Computing and Digital Media, DePaul University, assigning one dish label to an entire image hides important visual, Nutrition Awareness. Preprint submitted to arXiv. DePaul University, a picture, a model predicts one dish label. That is useful for, contains several visible ingredients. A single label such as "salad", Semantic segmentation means assigning a class label to every, pixel in an image. In this experiment, the labels come from, only one label for the whole image [3]. Later architectures, boundary refinement. DeepLabV3+ is a useful example because it, prediction layer is trained for the FoodSeg103 labels instead of, DeepLabV3+, U-Net, BEiT, or published FoodSeg103 benchmark

2026-06-24视觉感知

本文针对单一菜品分类难以反映多食材结构的问题,将营养感知前移到 FoodSeg103 上的像素级食材分割,并把预测掩码转成可见面积占比,作为非热量、非质量估计的餐盘组成提示。核心比较是在相同训练设置下微调 SegFormer-B0/B1,结果 B1 在测试集上像素准确率达 0.7929、mIoU 达 0.3204,较 B0 的 mIoU 提升 0.0683,增益可能主要来自模型容量 scaling。

VisChronos: Revolutionizing Image Captioning Through Real-Life Events Figure 1
2026-06-24cs.CV

VisChronos: Revolutionizing Image Captioning Through Real-Life Events

Phuc-Tan Nguyen, Hieu Nguyen, Minh-Triet Tran, Trung-Nghia Le

2026-06-24视觉语言视觉感知

传统图像描述多停留在物体和动作层面,难以解释真实事件的时间、地点、人物和意义。VisChronos将密集描述模型与多阶段LLM问答结合,并引入可信新闻事件信息来生成事件增强 caption,同时构建含3140对样本的EventCap。人类评测显示其描述在完整性、连贯性和事件相关信息上接近人工标注,但自动检索与外部事实对齐的可靠性仍需进一步验证。

EPEdit: Redefining Image Editing with Generative AI and User-Centric Design Figure 1
2026-06-24cs.CV

EPEdit: Redefining Image Editing with Generative AI and User-Centric Design

Hoang-Phuc Nguyen, Dinh-Khoi Vo, Trong-Le Do, Hai-Dang Nguyen, Tan-Cong Nguyen, Vinh-Tiep Nguyen, Tam V. Nguyen, Khanh-Duy Le, Minh-Triet Tran, Trung-Nghia Le

2026-06-24视觉感知生成模型

针对传统修图工具门槛高、现有生成式编辑工具控制不足且成本较高的问题,EPEdit将基于Stable Diffusion的零样本编辑算法与面向普通用户的网页交互结合,用文本提示和掩码支持生成、替换、移除、背景与局部编辑及主题设计。用户研究显示其在编辑、主题设计和整体体验上优于对比工具,但具体量化指标与增益来源文中未充分说明。

DriveStack-VLA: Render-Teacher Alignment for BEV-Based DeepStack Vision-Language-Action Model Figure 1
2026-06-24cs.CV

DriveStack-VLA: Render-Teacher Alignment for BEV-Based DeepStack Vision-Language-Action Model

Jingke Wang, Zhenru Zhao, Shuangming Lei, Hao Su, Yuehao Huang, Yijia Xie, Kai Tang, Guanglin Xu, AiXue Ye, Yukai Ma, Yong Liu

2026-06-24视觉语言视觉感知

本文针对自动驾驶 VLA 模型过度依赖透视图像 token 与语言先验、缺少度量几何和俯视结构的问题,提出 DriveStack-VLA:将 BEV 表征以 DeepStack 方式注入 LLM 解码器,并用 Render-Teacher Alignment 对齐真实图与栅格图的规划相关注意力,再通过轻量自评头筛选和修正轨迹。在 NAVSIMv1/v2 与 Bench2Drive 上分别达到 91.6 PDMS、91.0 EPDMS 和 79.49 驾驶分数,显示几何注入与注意力对齐对 VLA 规划有实际收益。

Token-to-Token Alignment of Text Embeddings for Semantic Blending Figure 1
2026-06-24cs.CV

Token-to-Token Alignment of Text Embeddings for Semantic Blending

Saar Huberman, Ron Mokady, Or Patashnik, Daniel Cohen-Or

Tel Aviv University

2026-06-24视觉感知

这篇论文针对文本到图像模型中提示词嵌入直接插值常导致语义纠缠、过渡不连贯的问题,提出 Token-to-Token alignment:先将两端提示改写到共享结构,再按语义相似度对齐 token 嵌入,使线性插值沿对应概念变化。实验显示该方法在连续合成、编辑和语义混合中提升中间状态一致性与结构稳定性,消融表明结构对齐和嵌入对齐需配合使用。

Cyclic Denoising Reveals Ultrastable Memories in Diffusion Models Figure 1
2026-06-24cs.LG

Cyclic Denoising Reveals Ultrastable Memories in Diffusion Models

Rishabh Sharma, Stefano Martiniani

Simons Center for Computational Physical Chemistry, New York University, Center for Soft Matter Research, Department of Physics, New York University, Center for Neural Science, New York University, Courant Institute of Mathematical Sciences, New York University

2026-06-24生成模型

本文关注扩散模型在常规采样下不易暴露的训练数据记忆风险,提出“循环去噪”作为无需提示词、训练集或权重访问的动态审计方法:反复加噪再去噪以寻找长期稳定吸引子。实验在 Stable Diffusion v1.4 和 CIFAR-10 DDPM 中发现,较高噪声幅度会诱导盆地跳跃并恢复可持续数百至数千轮的超稳定图像,其中不少对应库存照片、水印和网页抓取伪影,说明记忆应被视为生成动力学的稳定性问题。

3D Masked Autoencoders are Robust Learners of Volumetric and Multimodal Cellular Representations for Microscopy Figure 1
2026-06-24cs.LG

3D Masked Autoencoders are Robust Learners of Volumetric and Multimodal Cellular Representations for Microscopy

Amirhossein Kardoost, Lion Gleiter, Tingying Peng, Carsten Marr

2026-06-24视觉语言三维安全鲁棒

针对荧光显微单细胞表征常把三维 z-stack 压成二维、丢失深度结构的问题,本文系统比较 2D/3D MAE,并将蛋白序列模型 ESM2 作为跨模态监督引入训练。结果显示原生 3D 建模持续优于最大投影和逐片方案,通道交叉注意力与频域正则有助利用体数据;在蛋白互作 ROC-AUC 达 0.865,蛋白定位 AUC/F1 也达到或超过既有方法。

DivRL: Disentangled Self-Similarity Rewards for Diverse Subject-Driven Generation Figure 1
2026-06-24cs.CV

DivRL: Disentangled Self-Similarity Rewards for Diverse Subject-Driven Generation

Qian Wang, Zhenyu Li, Abdelrahman Eldesokey, Peter Wonka

2026-06-24强化学习

这篇论文针对主体驱动生成中“保身份”会导致姿态/结构僵化、追求多样性又易身份漂移的问题,提出 DivRL 后训练框架:用解耦视觉特征的负自相似度 nSSM 奖励结构变化,并把 VSM 身份相似度改为门控约束,通过 Explore-and-Suppress 的 GRPO 优化只惩罚越过身份阈值的样本。DreamBench++ 上结果显示,它在维持接近基线身份一致性的同时提升结构多样性与提示匹配,但多样性主要限于姿态和视角。

Trustworthy Image Authentication using Forensic Knowledge Graphs Figure 1
2026-06-24cs.CV

Trustworthy Image Authentication using Forensic Knowledge Graphs

Tai D. Nguyen, Matthew C. Stamm

2026-06-24视觉感知

针对生成式编辑让图像伪造更逼真、现有取证模型难解释而 VLM 又缺乏微观取证证据的问题,论文提出 Forensic Knowledge Graphs,将区域来源、压缩/后处理痕迹及语义内容组织成可追溯图结构,并用自监督取证特征、区域提议网络和 ICR 提示生成解释。作者还构建 FKG-50K,实验称在检测、伪造类型识别、定位与取证理由上优于专用检测器和 VLM。

The Professor: Multi-Teacher Unsupervised Prompt Distillation for Vision-Language Models Figure 1
2026-06-24cs.CV

The Professor: Multi-Teacher Unsupervised Prompt Distillation for Vision-Language Models

Ahmad Algadhi, Ahmed Alzuhair, Omar Alkhulaif, Muzammil Behzad

Department of Information and Computer Science, King Fahd University of Petroleum and Minerals

2026-06-24视觉语言视觉感知

论文针对 PromptKD 只依赖单一 CLIP 教师、软标签可能受单一归纳偏置限制的问题,提出 TheProfessor:用 PromptSRC 微调的 ViT-L/14 与零样本 EVA-CLIP-L/14 双教师进行无监督提示蒸馏,并缓存第二教师 logits 以保持推理成本不变。结果显示多教师并非普遍有效,增益主要出现在存在领域偏移且教师互补时,四个数据集上置信度加权平均 HM 提升 1.77 点,EuroSAT 提升最大为 5.78 点。

REALM: A Unified Red-Teaming Benchmark for Physical-World VLMs Figure 1
2026-06-24cs.CV

REALM: A Unified Red-Teaming Benchmark for Physical-World VLMs

Yifei Zhao, Qian Lou, Mengxin Zheng

University of Central Florida

2026-06-24视觉语言强化学习数据集/基准

针对物理世界VLM红队评测长期被数据集、指标和威胁模型割裂、难以区分攻击强弱与模型脆弱性的现状,ReaLM统一纳入12种攻击、3类模型无关防御和13个VLM,并用智能体生成场景化物理攻击目标来对齐比较。结果显示,文本与排版注入最易诱发功能性错误,多模态协同优化在视觉扰动迁移上最强,单次生成攻击接近迭代方法且成本更低,模型规模提升并不能保证鲁棒性。

E-MRL: Cross-view Aligned Evidence-driven Multimodal Reinforcement Learning for Reliable 3D Tumor Analysis Figure 1
2026-06-24eess.IV

E-MRL: Cross-view Aligned Evidence-driven Multimodal Reinforcement Learning for Reliable 3D Tumor Analysis

Sijing Li, Zhongwei Qiu, Zhuoya Wang, Boxiang Yun, Zhenyu Yi, Jianwei Xu, Wenqiao Zhang, Yingda Xia, Ling Zhang

2026-06-24视觉语言强化学习三维

该文针对3D CT肿瘤报告中VLM易依赖语言先验、产生视觉幻觉的问题,提出E-MRL,将生成过程建模为“诊断-定位-验证”的强化学习流程,并要求模型同时给出关键证据切片,通过全局报告与局部切片复查的一致性奖励约束视觉 grounding。实验称其在大规模3D CT肿瘤数据上较SFT和常规RL降低幻觉、提升诊断准确率与证据定位能力。

Mind the Heads: Topological Representation Alignment for Multimodal LLMs Figure 1
2026-06-24cs.CV

Mind the Heads: Topological Representation Alignment for Multimodal LLMs

Davide Caffagni, Alberto Compagnoni, Federico Melis, Sara Sarto, Pier Luigi Dovesi, Mark Granroth-Wilding, Marcella Cornia, Lorenzo Baraldi

University of Modena and Reggio Emilia, University of Pisa, aimagelab.github.io/HeRA

2026-06-24视觉语言

针对多模态大模型在计数、空间关系和密集视觉理解中易受语言先验影响的问题,论文提出 HeRA:不再对齐固定层特征,而是用 MKNN 选择注意力头,并以对比目标保持视觉编码器与语言表征的局部拓扑邻域;一个反直觉发现是对齐最不一致的头收益最大。作者在 LLaVA 系列等模型和 18 个基准上报告视觉中心任务稳定提升,并减少视觉幻觉。

Ground Then Rank: Revisiting Knowledge-Based VQA with Training-Free Entity Identification Figure 1
2026-06-24cs.CL

Ground Then Rank: Revisiting Knowledge-Based VQA with Training-Free Entity Identification

Qian Ma, Qiong Wu, Zhengyi Zhou, Yao Ma

Rensselaer Polytechnic Institute

2026-06-24视觉感知

这篇论文针对知识型视觉问答中“先找对实体、再找证据”被现有MM-RAG重排序混在一起的问题,指出MLLM开放式命名实体不稳,但在候选实体名中做选择会显著更可靠。作者提出无需训练的IBA流程,先用MLLM筛选高置信实体,再用文本重排序器选证据;在E-VQA和InfoSeek上超过微调式多模态重排序基线,并降低训练与推理复杂度。

Machine Learning Modeling for Real-Time Melt Pool Monitoring in Laser Powder Bed Fusion Additive Manufacturing: A Hybrid Approach Figure 1
2026-06-24cs.LG

Machine Learning Modeling for Real-Time Melt Pool Monitoring in Laser Powder Bed Fusion Additive Manufacturing: A Hybrid Approach

Inioluwa Emmanuel, Zhuo Yang, Ho Yeung, Xinyao Zhang

Florida State University, National Institute of, and label-preserving data augmentation to emulate realistic, inspection tasks where labeled training data may be limited [11], frameworks have been proposed to address limited labeled data

2026-06-24视觉感知

针对LPBF金属增材制造中熔池异常需毫秒级监测、而纯深度模型推理较慢的问题,论文比较迁移学习CNN、原始像素随机森林与EfficientNetB0特征加随机森林的混合方案。核心洞察是将预训练视觉特征与轻量集成分类器解耦,可在小数据场景兼顾表征与部署效率;在1200张NIST AMMT图像上,混合模型达到F1 0.9451、AUC 0.9904、约1.15 ms推理,明显快于纯CNN,但泛化仍受单材料单机器数据限制。

HANCLIP: A Family of Hyperbolic Angular Negation Vision Language Models Figure 1
2026-06-24cs.CV

HANCLIP: A Family of Hyperbolic Angular Negation Vision Language Models

Hoang-Bao Le, Aiden Durrant, Thai Son Mai, Binh T. Nguyen, Liting Zhou, Cathal Gurrin

2026-06-24视觉感知

这篇论文针对视觉语言模型难以理解“不是/没有”等否定语义、且直接微调易遗忘原有能力的问题,提出 HANCLIP:用双曲空间建模“图像是什么/不是什么”的层级与非对称关系,并加入角度三元组否定损失分离否定描述。仅用 2 万组样本适配 CLIP、LongCLIP 等模型,在 NegBench 上稳定提升,负向检索平均增益超 4%,多选问答提升近 35%,同时基本保持常规分类与检索表现。

ABACUS: Adapting Unified Foundation Model for Bridging Image Count Understanding and Generation Figure 1
2026-06-24cs.CV

ABACUS: Adapting Unified Foundation Model for Bridging Image Count Understanding and Generation

Anindya Mondal, Sauradip Nag, Anjan Dutta

University of Surrey, 2 Simon Fraser University

2026-06-24视觉感知

针对计数理解与按数量生成长期割裂、统一多模态模型缺乏实例级空间 grounding 的问题,ABACUS在3B统一基础模型上引入密度自适应缩放、由注意力得到的objectness map、边界感知GRPO计数策略,并用冻结理解分支以循环一致GRPO反向约束生成分支。在无需基准专门训练下,文中报告其在7个计数理解、指代表达计数与计数生成基准上超过专用模型和更大通用模型。

From Spatial to Spectral: An Efficient, Frequency-Guided Feature Representation Learner for Small Object Detection Figure 1
2026-06-24cs.CV

From Spatial to Spectral: An Efficient, Frequency-Guided Feature Representation Learner for Small Object Detection

Yuhan Rui, Shihan Qiao, Yibin Lou, Mingxi Yu, Yutong Wan, Yanqiao Chen, Dongsheng Hou, Zhen Cao, Athena Zhuoming Zhong, Qi Hao

2026-06-24视觉感知

本文针对小目标在下采样、特征融合和回归头中高频细节持续丢失的问题,主张从空间补偿转向频谱表征。核心是统一的 DER 分解—增强—重构算子,并以 WDG、LGE、FDHead 分别嵌入骨干、颈部和检测头,显式保留边界与细节频率信息。实验在 VisDrone、UAVDT、TinyPerson、DOTA 等数据集上显示跨 CNN/Transformer 检测器均有增益,DERNet 在同尺度下优于 YOLOv11 且参数约为其六分之一。

Listening makes Vision Clear for VLMs Figure 1
2026-06-24cs.CV

Listening makes Vision Clear for VLMs

Yiyang Chen, Yixin Tan, Binrui Shen

Beijing Normal University

2026-06-24视觉语言视觉感知

本文针对VLM视觉-语言一致性评估中依赖答案侧注意力易受解码漂移和语言先验干扰的问题,提出从固定提示词侧提取Prompt-Vision Token Activation Map,并用结构token去噪过滤模态边界带来的系统偏置;同时以TGR、TDR和MinDist衡量注意力峰值与目标区域的对齐。实验在PartImageNet、RefCOCO及多种VLM上优于或匹配CAM、CP-LRP、Attention Rollout、TAM等基线,表明细粒度对齐信号更可能出现在提示编码阶段。

Performance and Interpretability of Convolutional, Transformer, and Hybrid Deep Learning Models in Colorectal Histology Classification Figure 1
2026-06-24q-bio.QM

Performance and Interpretability of Convolutional, Transformer, and Hybrid Deep Learning Models in Colorectal Histology Classification

Reza Bozorgpour

College of Engineering & Applied Science, Department of Biomedical Engineering, University of

2026-06-24视觉感知

针对结直肠病理多类别识别中 CNN、Transformer 与混合模型缺少统一比较的问题,论文在 Kather 5,000 张八类 H&E 图像上用相同迁移学习流程评测 12 种架构,并结合多指标与可解释性分析。结果显示各模型准确率均较高,EVA-02 最优达 97.1%,ViT-B/16 接近,ResNet34 与 ConvNeXt-Tiny 也具竞争力;复杂间质最难分类,Transformer 略占优但相对强 CNN 的增益不大。

Sol Video Inference Engine: Agent-Native Full-Stack Acceleration Framework for Efficient Video Generation Figure 1
2026-06-24cs.CV

Sol Video Inference Engine: Agent-Native Full-Stack Acceleration Framework for Efficient Video Generation

Yitong Li, Junsong Chen, Haopeng Li, Haozhe Liu, Jincheng Yu, Ligeng Zhu, Ping Luo, Song Han, Enze Xie

2026-06-24视觉感知

这篇论文针对视频扩散模型在不同模型、硬件和推理配置下难以复用同一加速方案的问题,将缓存、稀疏注意力、token 剪枝、量化和 kernel 融合组织成由技能代理局部搜索、集成代理全局组合、人类做质量验证的训练-free 全栈框架。实验覆盖 Cosmos3-Super、LTX-2.3 和 SANA-Video,报告端到端超过 2 倍加速且 VBench 质量近似无损,但最终视觉评估仍依赖人工反馈。

Systematic Exploration of 4-Expert Heterogeneous Mixture-of-Experts via Automated Pipeline Search Figure 1
2026-06-24cs.LG

Systematic Exploration of 4-Expert Heterogeneous Mixture-of-Experts via Automated Pipeline Search

Yashkumar R Lukhi, Harsh Rameshbhai Moradiya, Radu Timofte, Dmitry Ignatov

Computer Vision Lab, CAIDAS & IFI, University of Würzburg, Germany

2026-06-24视觉感知

针对异构4专家MoE组合空间过大、手工设计难以覆盖的问题,本文构建了基于LEMUR的自动代码组装、验证与长周期评测流水线。核心洞察是排序枚举导致搜索完全偏向AirNet,仅覆盖4.8%组合,并提出随机分层修正;在该受限空间内,1021个成功模型中最佳CIFAR-10单epoch准确率达68.0%,ShuffleNet和MobileNetV3更常带来高收益。

A Geometry-Informed Computer Vision Method for Detecting and Examining Overtaking Vehicles From A Bicycle Figure 1
2026-06-24cs.CV

A Geometry-Informed Computer Vision Method for Detecting and Examining Overtaking Vehicles From A Bicycle

Gandhimathi Padmanaban, Rayane Moustafa, Fred Feng

Department of Industrial Manufacturing and Systems Engineering, University of Michigan-Dearborn, vides a scalable foundation for vehicle-bicycle interaction analysis across larger datasets and

2026-06-24视觉感知

这篇论文针对自行车后视视频中超车事件仍需逐帧人工标注的瓶颈,提出将 RT-DETR、ByteTrack 与透视几何约束结合,用方位角趋势、目标变大和空间位置确认完成单目、免标定筛选。在 315 个真实城市超车事件上达到 97.8% 召回且零误报,平均提前 2.44 秒识别,并在 96 个样本上估计横向距离误差约 13–14 厘米。

2026-06-23

358 篇
Lift4D: Harmonizing Single-View 3D Estimation for 4D Reconstruction In-the-Wild Figure 1
2026-06-23cs.CV

Lift4D: Harmonizing Single-View 3D Estimation for 4D Reconstruction In-the-Wild

Yehonathan Litman, Xiaoxuan Ma, Manan Shah, Nicolas Ugrinovic, Kris Kitani, Fernando De la Torre, Shubham Tulsiani

Carnegie Mellon University

2026-06-23三维

Lift4D针对单目野外视频中动态物体只被部分观察、还常有大形变和遮挡,难以恢复完整4D几何与外观的问题。核心思路是把单视图3D先验改造成因果潜变量条件的时序一致逐帧重建,再用可变形3D Gaussian和遮挡感知优化结合视角条件扩散先验补全不可见区域。实验显示其在合成与真实视频上提升新视角质量、语义一致性和运动对齐,尤其适合严重遮挡与非刚体运动场景。

Keep The Essentials: Efficient Reference Conditioned Generation via Token Dropping Figure 1
2026-06-23cs.CV

Keep The Essentials: Efficient Reference Conditioned Generation via Token Dropping

Rishubh Parihar, Ayush Raina, R. Venkatesh Babu, Or Patashnik

Tel Aviv University

2026-06-23视觉感知

这篇论文针对参考图像条件扩散模型在多参考、高分辨率场景中因密集参考 token 导致注意力开销急剧上升的问题,提出 Sparse Context:训练时随机丢弃不同比例参考 token,使模型适应稀疏上下文;推理时按任务选择更有信息量的区域 token。核心洞察是参考 token 存在大量冗余,适度稀疏化仍能保留可控性与细节。实验显示单参考约 2×、多参考约 4×至 5×加速,且空间编辑和主体生成质量基本不降。

Semantic Browsing: Controllable Diversity for Image Generation Figure 1
2026-06-23cs.CV

Semantic Browsing: Controllable Diversity for Image Generation

Sara Dorfman, Maya Vishnevsky, Omer Dahary, Or Patashnik, Daniel Cohen-Or

2026-06-23视觉感知规划控制

本文针对文本到图像模型在高提示遵循下易收敛到单一语义解释、随机采样多样性难以被用户控制的问题,提出“语义浏览”:先用 VLM 将提示扩展为结构化场景 JSON,再通过多智能体工作流沿可解释语义轴生成层级变体,并交给强提示遵循的图像模型渲染。实验显示其相比既有多样化方法能产生更高且可导航的结构化语义多样性,但具体增益中 VLM 规划与底层生成器能力的贡献仍需进一步拆分说明。

AIR: Adaptive Interleaved Reasoning with Code in MLLMs Figure 1
2026-06-23cs.CV

AIR: Adaptive Interleaved Reasoning with Code in MLLMs

Cong Han, Xiaohan Lan, Haibo Qiu, Yujie Zhong

2026-06-23强化学习

AIR针对现有MLLM工具使用偏重视觉操作、难以处理复杂数值计算的问题,让模型在推理过程中自适应调用Python代码。其核心是两阶段冷启动数据构造、Self-Sampled/Prior-Filtered数据筛选,以及带组约束奖励的GRPO,以同时学习何时用工具并稳定长期Agentic RL训练。实验显示平均性能提升6.1个百分点,交错推理样本提升9.9个百分点,工具调用成功率超过95%。

IMAGIN-4D: Image-Guided Controllable Interaction Generation Figure 1
2026-06-23cs.CV

IMAGIN-4D: Image-Guided Controllable Interaction Generation

Sai Kumar Dwivedi, Federica Bogo, Buğra Tekin, Chenhongyi Yang, Nadine Bertsch, Tomas Hodan, Michael J. Black, Dimitrios Tzionas, Shreyas Hampali

2026-06-23视觉感知规划控制

IMAGIN-4D针对文本、物体几何和稀疏轨迹难以指定抓握、接触和人体-物体布局的问题,引入参考图像作为交互快照约束。其核心是将图像条件分解为空间交互状态 token 与逐帧视觉 token,并用角色感知条件融合文本、路标和视觉线索。作者还构建合成渲染数据与 image-adherence 指标;在 FBM 和 BEHAVE 上,相比单全局图像 token 或均匀图像条件,方法提升了细粒度图像遵循性,同时基本保持轨迹跟随、运动质量和接触表现。

GeoFidelity-Bench: Evaluating Segment-Level Geographic Fidelity in Text-to-Image Street-View Generation Figure 1
2026-06-23cs.CV

GeoFidelity-Bench: Evaluating Segment-Level Geographic Fidelity in Text-to-Image Street-View Generation

Kaizhen Tan, Hanzhe Hong, Siru Tao

2026-06-23视觉感知

本文针对街景生成“看起来像某城市但不像指定路段”的评测缺口,提出 GeoFidelity-Bench:用 25 城 109 个 OSM 路段的 Mapillary 参考面板和同城近邻负样本,检验生成图是否能区分目标路段。结果显示,加入街道/社区名使 top-1 准确率较城市提示提升 5.5 个百分点,但与同城最近路段的相似度差几乎为零;错误本地名也保留部分增益,普通文本 GPS 额外帮助不显著,说明当前模型多学到城市/社区风格而非精确路段身份。

PHAST-Net: Attention-Guided, Physics-Informed Network for Unified Estimation of Ideal Time-Frequency Representations Figure 1
2026-06-23eess.AS

PHAST-Net: Attention-Guided, Physics-Informed Network for Unified Estimation of Ideal Time-Frequency Representations

James M. Cozens, Simon J. Godsill

2026-06-23视觉感知

该文针对传统时频分析在多分量、交叉轨迹和含噪信号中难以同时保持高集中度与抑制交叉项的问题,提出 PHAST-Net:用一组按 Cohen 核分析选择的对数频率 CLAWT 作为输入,并加入注意力与物理重投影损失约束变换一致性和能量守恒。实验覆盖语音、音乐与合成基准,显示其在理想时频表示、基频化 Tempogram/Metrogram 和样条重渲染上优于既有方法,但部分增益可能主要来自程序化大规模数据与任务设定。

Lightweight Neural Framework for Robust 3D Volume and Surface Estimation from Multi-View Images Figure 1
2026-06-23cs.CV

Lightweight Neural Framework for Robust 3D Volume and Surface Estimation from Multi-View Images

Diego E. Farchione, Ramzi Idoughi, Peter Wonka

2026-06-23视觉感知三维安全鲁棒

针对多视图图像估计物体体积和表面积常依赖稠密重建、封闭网格与繁重后处理的问题,本文提出前馈式轻量框架,将MapAnything等生成的点云与DINOv3二维特征融合,并用证据回归同时输出尺度归一化几何量和不确定性。实验称其在稀疏视角、噪声点云下优于现有方法,并在珊瑚、食物和人体数据上验证泛化,但绝对尺度恢复仍不在模型能力内。

Pose Anything Anywhere:Model-free Object Poses from Arbitrary References Figure 1
2026-06-23cs.CV

Pose Anything Anywhere:Model-free Object Poses from Arbitrary References

Hongli Xu, Jiaqi Hu, Junwen Huang, Boyang Zhong, Peter KT Yu, Nassir Navab, Benjamin Busam, Slobodan Ilic

2026-06-23三维

这篇论文面向开放世界机器人中缺少 CAD 模型、参考视角稀疏且未标定时的 6D 位姿估计难题,提出 PANY:将多视图几何基础模型改造为物体中心的规范对齐器,并用跨视角一致对应与可选的位姿图注册整合辅助视图,缓解遮挡和大视角差导致的单参考歧义。实验称其在 YCB-V 提升约 12%、LM-O 超过 20%,且同时适用于 RGB/RGB-D 与单/稀疏参考设置。

Hedgementation = Hedgerow Segmentation: A Remote Sensing Benchmark Figure 1
2026-06-23cs.CV

Hedgementation = Hedgerow Segmentation: A Remote Sensing Benchmark

Nathan Senyard, Salem Hamdani, Astrid Zhang, Derek Wang, Evan Shelhamer, Mathias Lécuyer, Joséphine Gantois

Vector Institute

2026-06-23视觉感知数据集/基准

针对树篱在农业生态中重要但大尺度分布数据稀缺、模型跨区域可迁移性不明的问题,Hedgementation整合法国BD Haie标注、Sentinel-2影像与Alpha Earth嵌入,构建10米分辨率全国级树篱分割基准,并专门评估空间距离、气候区和农业区泛化。基线中PASTIS U-TAE最佳,IoU约0.41,近区略优于远区,温带和农业像素表现明显好于亚热带与非农业区域,说明现有方法仍难以可靠精细制图。

Data Selection Through Iterative Self-Filtering for Vision-Language Settings Figure 1
2026-06-23cs.CV

Data Selection Through Iterative Self-Filtering for Vision-Language Settings

Andrei Liviu Nicolicioiu, Sarvjeet Singh Ghotra, Morgane M. Moss, Aaron Courville

The availability of large amounts of clean data is paramount to training neural networks., of learned knowledge with the diversity available in the whole dataset.

2026-06-23视觉语言视觉感知

这篇论文关注大规模图文数据噪声导致 CLIP 训练低效的问题,质疑依赖预训练模型过滤会引入额外知识与偏差。核心方法是 Self-Filtering:训练过程中用当前模型按图文相似度反复筛选高置信样本,并与全量随机样本混合以平衡利用与多样性。实验显示,在不使用额外数据或预训练过滤器的情况下,该策略能提升下游表现,并体现更好的已见样本效率。

Vera: A Layered Diffusion Model for Content-Preserving Video Editing Figure 1
2026-06-23cs.CV

Vera: A Layered Diffusion Model for Content-Preserving Video Editing

Hongkai Zheng, Ta-Ying Cheng, Benjamin Klein, Yisong Yue, Zhuoning Yuan

California Institute of Technology

2026-06-23视觉感知生成模型

Vera针对现有视频扩散编辑会重生成整段视频、导致未编辑人物或背景被意外改动的问题,将编辑内容建模为独立RGBA层和alpha matte,再与源视频合成;其MoT结构用多层DiT通过联合自注意力协调编辑层、遮罩和合成结果,并配套486K帧分层数据训练。实验和人工偏好显示,它在内容保真上优于主流开源视频编辑模型,同时编辑质量保持竞争力。

Discovering Latent Groups for Robust Classification Figure 1
2026-06-23cs.LG

Discovering Latent Groups for Robust Classification

Ankur Garg, Ulrich Aïvodji, Samira Ebrahimi Kahou, Vincent Michalski

2026-06-23安全鲁棒

本文针对模型依赖伪相关导致少数子群性能崩溃且推理时不可解释的问题,提出神经分类树 NCT:用预测正确性作为“易/难”路由信号,迭代形成可保留到推理阶段的树形子群划分,并用无监督准则选择深度。在五个含二分类与多分类伪相关基准上,NCT能把少数/冲突子群集中到 hard 分支,最坏组准确率接近或匹配强基线,同时暴露潜在群组结构。

Autonomous Subsea Cable Search and Tracking with Graph-Optimised Priors and Visual Tracking Figure 1
2026-06-23cs.RO

Autonomous Subsea Cable Search and Tracking with Graph-Optimised Priors and Visual Tracking

Ibrahim Fadhil Djauhari, Adrian Bodenmann, Samuel Simmons, Cailei Liang, David White, Susan Gourvenec, Tom Bennetts, Darryl Newborough, Blair Thornton

2026-06-23视觉感知

面向海底通信电缆易受损且先验路由误差、细小/部分掩埋导致AUV难以连续跟踪的问题,论文将视觉检测与“反向SLAM”式图优化结合,用观测持续修正全局电缆地图,并用悬链线物理模型约束未观测段搜索范围。海试中,Smarty200在故意偏置的初始地图下仍定位电缆,跟踪检查了120米测试电缆最高59%,且能在丢失后恢复。

No Figure
2026-06-23cs.CV

Polycepta: Object-Centric Appearance Estimation for Multi-Object Tracking

Mohamed Nagy, Naoufel Werghi, Jorge Dias, Majid Khonji

2026-06-23视觉感知

本文针对多目标跟踪中外观特征常被静态 ReID 描述子建模、计算开销高且难适应遮挡和视角变化的问题,提出 Polycepta:为每个目标递归维护外观状态,并通过状态擦除训练避免记忆具体对象,从而学习可迁移的外观更新机制。实验显示其接入跟踪-by-detection框架后可减少 ID switch、提升 KITTI/Waymo/MOT17 性能,并以 90.57Hz 在 KITTI 上达到 92.27% MOTA。

Real-Time Multimodal Activity-Aware Error Detection in Robot-Assisted Surgery Figure 1
2026-06-23cs.RO

Real-Time Multimodal Activity-Aware Error Detection in Robot-Assisted Surgery

Seyed Hamid Reza Roodabeh, Zongyu Li, Homa Alemzadeh

(NSF) grants CNS-2146295 and CCF-2402941.The source code and supplementary materials for this paper will be publicly available.

2026-06-23机器人视觉语言视觉感知

面向机器人辅助手术中细微且与患者安全相关的执行性错误,论文指出仅靠视频或预定义手势标签难以利用手术层级上下文。其核心做法是把手势、器械—对象交互和错误定义写成活动提示,并与视频、运动学特征融合;结果在 JIGSAWS 和 SAR-RARP50 上较基线 F1 最高提升 5% 和 16.6%,且提示可接近或优于需额外预训练的活动感知视觉嵌入。

Kamera: Unified Position-Invariant Multimodal KV Cache for Training-Free Reuse Figure 1
2026-06-23cs.DC

Kamera: Unified Position-Invariant Multimodal KV Cache for Training-Free Reuse

Bole Ma, Jan Eitzinger, Harald Koestler, Gerhard Wellein

2026-06-23视觉语言

本文针对多模态智能体反复查看视频帧、截图或文档页时,传统前缀 KV cache 因位置和前文变化而频繁重算的问题。核心洞察是朴素复用主要丢失跨块条件化信息,而非直接读出;Kamera 用精确 RoPE 重旋转处理位置变化,并为每个块保存训练无关的低秩条件补丁。实验显示该方法可恢复多跳跨块任务精度,在 MLA/GQA/MHA 与 SGLang 内核中以较小 KV 开销接近重新 prefill 的效果。

HoloAgent-0: A Unified Embodied Agent Framework with 3D Spatial Memory Figure 1
2026-06-23cs.RO

HoloAgent-0: A Unified Embodied Agent Framework with 3D Spatial Memory

Xiaolin Zhou, Liu Liu, Tingyang Xiao, Wei Feng, Fa Fu, Xinrui Meng, Xinjie Wang, Jialiang Han, Boyang Yu, Yun Du, Wei Sui, Zhizhong Su

Webpage: horizonrobotics.github.io/robot_lab/holoagent, workflow centered on Embodied AgentOS. AgentOS converts natural-language instructions into executable

2026-06-23三维

这篇论文针对物理机器人中语言智能体难以像软件工具那样组合、监控和纠错的问题,提出 HoloAgent-0:以 Embodied AgentOS 为闭环运行时,结合持久 3D 空间/时间记忆和类型化技能接口,把导航、操作、全身运动等异构能力组织成可执行技能图。实机与仿真结果显示,其在长程导航、3D 语义映射上有定量优势,并展示了物体搜索、多机器人协同和移动操作等闭环任务。

Dense Reward for Multi-View 3D Reasoning with Global Maps and Local Views Figure 1
2026-06-23cs.CV

Dense Reward for Multi-View 3D Reasoning with Global Maps and Local Views

Jiho Choi, Seonho Lee, Seojeong Park, Hyunjung Shim

Graduate School of Artificial Intelligence, KAIST, Republic of Korea, Code is available at: https://github.com/kaist-cvml/dr-mv3d, suggest that the core challenge is not merely the availability of visual inputs

2026-06-23强化学习三维

这篇论文针对多视角3D VQA中现有MLLM仅靠答案级稀疏监督而难以保持跨视角一致、视点选择不稳定的问题,提出DR-MV3D:先构建全局认知地图,再按问题规划视角轨迹并做自我中心 grounding;核心在于用冻结3D视觉基础模型生成伪结构目标,提供全局一致性和局部轨迹两类稠密奖励,并用GRPO优化。实验显示其在MindCube、VSI-Bench和BLINK(MV)上均优于强多图基线,MindCube-Tiny较Qwen2.5-3B提升28.7个百分点。

VeriEvol: Scaling Multimodal Mathematical Reasoning via Verifiable Evol-Instruct Figure 1
2026-06-23cs.AI

VeriEvol: Scaling Multimodal Mathematical Reasoning via Verifiable Evol-Instruct

Haoling Li, Kai Zheng, Jie Wu, Can Xu, Qingfeng Sun, Han Hu, Yujiu Yang

2026-06-23视觉语言

本文针对视觉数学推理中“题目变难但答案标签不可靠”会在强化学习中放大噪声的问题,提出 VeriEvol:用按题型路由的 Evol-Instruct 生成更难且图像相关的题目,再用 HTV-Agent 进行离线反驳式多源验证,只有未被证伪的答案进入训练。实验显示,SFT 数据从 10K 扩到 250K 平均准确率由 35.42 提至 54.73;在固定骨干、初始化和 GRPO 配方下,相比未演化 RL 基线总增益为 +3.88,其中演化题目和验证器分别贡献 +1.82、+2.06。

AwakeForest: An Interactive Geospatial Platform for Large-Scale Forest Imagery Figure 1
2026-06-23cs.CV

AwakeForest: An Interactive Geospatial Platform for Large-Scale Forest Imagery

Suraj Prasai, Kangning Cui, Rongkun Zhu, Sarra Alqahtani, Ying Zhang, Victor Paul Pauca, Miles R. Silman, Fan Yang

Wake Forest University, Hong Kong Baptist University

2026-06-23视觉感知

森林遥感分析常需在超大正射影像上同时完成检测、分割、标注与空间统计,现有标注或 GIS 工具难以兼顾地理坐标、云端流式访问和模型接入。AwakeForest 的核心是把 COG/对象存储、PostGIS 空间索引、可插拔 YOLO/SAM 推理与人机协同修正整合为项目化流程。文中在 PALMS 数据集演示了从棕榈检测、分割到分析就绪输出的端到端工作流,但未提供定量精度或效率基准。

LightSTAR: Efficient Visual Document Retrieval via Lightweight Selection with Vision-Adaptive Refinement Figure 1
2026-06-23cs.CV

LightSTAR: Efficient Visual Document Retrieval via Lightweight Selection with Vision-Adaptive Refinement

Tongkun Guan, Haocheng Wang, Wei Shen, Xiaokang Yang

MoE Key Lab of Artificial Intelligence, AI Institute, School of Computer Science, Shanghai Jiao Tong University

2026-06-23视觉感知

本文针对视觉文档检索中对每页都调用多模态大模型导致延迟和成本过高的问题,抓住用户查询往往由可见关键词锚定的现象,提出先用无 LLM 的轻量视觉选择缩小候选页,再在候选上做视觉自适应语义精排,并通过区域特征融合与难负样本对比学习增强区分性。实验显示 LightSTAR 在保持或达到 SOTA 检索精度的同时,将端到端延迟降低数倍。

Scaling State-Space Models from Lines to Paragraphs: An Ablation of Mamba-based OCR Figure 1
2026-06-23cs.CV

Scaling State-Space Models from Lines to Paragraphs: An Ablation of Mamba-based OCR

Merveilles Agbeti-Messan, Pierrick Tranouez, Stéphane Nicolas, Clément Chatelain, Thierry Paquet

2026-06-23视觉感知

本文关注 Transformer 在段落级 OCR 中因注意力二次复杂度带来的效率瓶颈,系统消融 Mamba-OCR 从行到段落的扩展行为。核心发现是长序列精度主要受状态维度和扩展因子影响;在合成段落上 Mamba 与 Transformer 均低于 1% CER 且快 1.4–4.5 倍,但在 IAM 手写数据上明显落后,差距可能主要来自数据稀缺与长序列训练的数据需求。

Arbor: Explicit Geometric Conditioning for Controllable 3D Asset Generation Figure 1
2026-06-23cs.CV

Arbor: Explicit Geometric Conditioning for Controllable 3D Asset Generation

Jan-Niklas Dihlmann, Andreas Engelhardt, Simon Donne, Hendrik P.A. Lensch, Mark Boss

University of Tübingen

2026-06-23规划控制三维

针对文本/图像条件3D生成难以精确表达占用空间、避让区域和接触面的痛点,Arbor把艺术家给定的hull、avoidance、touch约束网格编码为几何token,并通过路由式适配器注入冻结的潜在3D去噪器,使局部约束进入生成过程而非仅采样后修正。实验显示其在自动与人工约束基准上提升约束服从性,同时基本保留物体质量和固定约束下的形状多样性。

UniverSat: Resolution- and Modality-Agnostic Transformers for Earth Observation Figure 1
2026-06-23cs.CV

UniverSat: Resolution- and Modality-Agnostic Transformers for Earth Observation

Yohann Perron, Guillaume Astruc, Nicolas Gonthier, Clement Mallet, Loic Landrieu

and models are available at github.com/gastruc/UniverSat., band counts, temporal sampling, and patch size. When operating on a narrow set of widely available

2026-06-23视觉感知

这篇论文针对遥感场景中传感器模态、空间/光谱/时间分辨率差异巨大,而传统 ViT 固定 patch 投影器依赖重采样或专用编码器的问题,提出 UniverSat:用 Universal Patch Encoder 以共享权重将任意形状观测映射到统一嵌入,并保留可选输出分辨率。模型在 7 个数据集、13 类传感器上自监督训练,在 GeoBench、PANGEABench 和高光谱基准的分类、分割探测中保持竞争力,并展示对未见传感器配置的泛化。

Brain-Adapter: A Dual-Stream Vision-Language MIL Framework for Comprehensive 3D CT Diagnosis of Acute Intracranial Pathologies Figure 1
2026-06-23cs.CV

Brain-Adapter: A Dual-Stream Vision-Language MIL Framework for Comprehensive 3D CT Diagnosis of Acute Intracranial Pathologies

Zhenyu Yi, Zhiyun Song, Yusong Sun, Zelin Liu, Manman Fei, Zhenhao Li, Jiaxuan Zhao, Xu Han, Lichi Zhang

2026-06-23视觉语言视觉感知三维

这篇论文针对3D脑CT急性颅内病变诊断中密集标注昂贵、2D视觉语言模型难以直接迁移到体数据的问题,提出Brain-Adapter:将CT体视为切片包,用文本条件注意力把报告语句对齐到相关切片,同时以LLM抽取的结构化标签监督视觉MIL分支,并用一致性约束与不确定性感知融合处理歧义。实验显示其在真实临床多标签分类中优于3D模型和常规MIL,并在CQ500零样本异常检测上表现出较好泛化。

MeshFlow: Mesh Generation with Equivariant Flow Matching Figure 1
2026-06-23cs.GR

MeshFlow: Mesh Generation with Equivariant Flow Matching

Qi Sun, Kiyohiro Nakayama, Jing Nathan Yan, Qixing Huang, Alexander Rush, Leonidas Guibas, Gordon Wetzstein, Jing Liao, Guandao Yang

City University of Hong Kong, Stanford University, The University of Texas, Austin, City University of Hong Kong Hong Kong, Stanford University USA, The University of Texas, Austin USA

2026-06-23生成模型

MeshFlow针对网格直接生成难以处理面与顶点置换对称、而自回归序列化方法推理慢的问题,将三角网格表示为triangle soup,并用等变最优传输flow matching建模;其改造DiT以保持面置换和三角形顶点循环等变性,再用对称感知的OT配对损失减少错误训练信号。在ShapeNet多类别上,网格质量接近自回归SOTA,单个样本低于1秒生成,约快18倍。

From Reconstruction to Decision: A Post-Encoder Plug-in Adapter for Curvilinear Segmentation Figure 1
2026-06-23cs.CV

From Reconstruction to Decision: A Post-Encoder Plug-in Adapter for Curvilinear Segmentation

Qin Lei, Jiang Zhong, Xin Xiao, Yuming Yang, Hao Wu

2026-06-23视觉感知三维

针对血管、裂缝等细长结构在基础视觉编码器强下采样后易断裂的问题,论文把改进点放在后编码器阶段,提出轻量 PEPA:用目标条件蛇形上采样恢复弯曲细节,并用目标自适应可微阈值校准二值化决策。五个医疗与工业基准显示,在冻结编码器上仅增加约0.26M参数即可稳定提升 IoU 与 clDice,且拓扑连通性收益更明显。

C^2GR: Coupled Comprehensive Generative Replay for a Continually Learnable Universal Segmentation Model Figure 1
2026-06-23cs.CV

C^2GR: Coupled Comprehensive Generative Replay for a Continually Learnable Universal Segmentation Model

Wei Li, Jingyang Zhang, Guoan Wang, Junzhi Ning, Yang Chen, Guang Yang, Lixu Gu

Shanghai Jiao Tong University, Southeast University, Stevens Institute of Technology, Shanghai Artificial Intelligence Laboratory, Imperial College London

2026-06-23视觉感知生成模型

这篇论文针对医疗通用分割模型在任务增量学习中因影像外观与分割目标同时变化而遗忘旧任务的问题,提出 C2GR:用扩散模型回放旧任务的图像-掩码对,并通过贝叶斯联合扩散保持结构对应、用任务关系感知统一提示同步生成器与分割器优化。在跨模态、跨目标的 20 个任务上,其总体性能较联合训练仅下降 2.44%,表明能较有效缓解连续学习遗忘。

MeGAS: Thermomechanical Dynamic Gaussian Splatting for Thermophysical Scene Editing Figure 1
2026-06-23cs.CV

MeGAS: Thermomechanical Dynamic Gaussian Splatting for Thermophysical Scene Editing

Zesong Yang, Yuanhang Lei, Liyuan Cui, Yihang Chen, Jiaer Huang, Boming Zhao, Peter Yichen Chen, Hujun Bao, Zhaopeng Cui

State Key Laboratory of CAD&CG, Zhejiang University, University of British Columbia, trollable synthesis of physically plausible phenomena that faithfully adhere to, Gaussian Splatting, enabling controllable and thermophysically grounded edit-

2026-06-23三维

MeGAS针对现有物理神经渲染多关注机械变形、难以表达温度驱动熔化/凝固的问题,将温度属性加入3D Gaussian Splatting,并耦合热对流扩散、MPM相变本构切换与拓扑自适应渲染,以减少大变形下裂缝和漂浮点。实验显示其在真实和合成场景中能生成更一致的热机械行为,并在用户研究中提升物理真实感、照片真实感和多视角一致性。

Rethinking Object-Centric Representations for Video Dynamics Modeling Figure 1
2026-06-23cs.CV

Rethinking Object-Centric Representations for Video Dynamics Modeling

Amaury Wei, Ismail Nejjar, Olga Fink

2026-06-23视觉感知

这篇论文关注视频中无监督对象中心表示的失效:传统 slot 表征把外观与位置/尺度纠缠在一起,强行做时间一致性会偏向静态背景并导致前景碎片化、身份切换。作者提出 STAITUS,将每个 slot 拆成外观与几何姿态,只在外观空间做时间对齐,并加入空间分离损失与自适应 slot 门控以减少过分割。实验称其在合成和真实视频基准上提升分割质量与跟踪稳定性。

Polynomial Dice Loss for Medical Image Segmentation Figure 1
2026-06-23cs.CV

Polynomial Dice Loss for Medical Image Segmentation

Hiroaki Aizawa

2026-06-23视觉感知

针对医学图像中小病灶、前景稀少导致 Dice 类损失训练不稳定的问题,论文从几何角度将 Dice Loss 分解为尺度项与角度对齐项,并用泰勒展开构造 Polynomial Dice Loss,通过截断阶数和系数调节损失形状。实验与 Dice、Tversky 系列对比显示,其在多种分割设置下具有竞争力,尤其在多类和不均衡小前景场景中可改善表现,但 3D 数据仍以 2D 切片评估。

TooBad: Backdoor Diffusion Models with Ultra-Low Poison Rate and Imperceptible Trigger Figure 1
2026-06-23cs.CR

TooBad: Backdoor Diffusion Models with Ultra-Low Poison Rate and Imperceptible Trigger

Vu Tuan Truong, Long Bao Le

INRS, University of Quebec

2026-06-23生成模型

本文针对扩散模型后门攻击在成功率、隐蔽性、投毒率和训练成本之间的权衡,提出 TooBad:不再手工选择触发器,而是将触发器优化直接嵌入扩散去噪过程,使其更易把生成分布推向目标样本。实验显示,在 CIFAR-10 等基准上仅 0.5% 投毒率即可超过 85% ASR,5% 投毒率下 3–5 个注入 epoch 接近 100% ASR,并能绕过现有防御且保持正常生成质量。

Changing Modalities: Adapting Remote Sensing Models to New Satellites and Sensors Figure 1
2026-06-23cs.CV

Changing Modalities: Adapting Remote Sensing Models to New Satellites and Sensors

Tim G. Zhou, Anthony Fuller, Geoff Pleiss, Evan Shelhamer

University of British Columbia, Vector Institute, Carleton University

2026-06-23视觉感知

这篇论文针对遥感模型随卫星传感器新增、替换或退役而失效的问题,提出“变化模态”设定,并把模态迁移、增加与窥视统一到 DeluluNet 中:用已标注旧模态教师和未标注配对多模态数据,通过模态表征幻觉补全缺失输入。实验覆盖 Sentinel-2 跨波段与 Sentinel-1/2 跨卫星场景,显示无需新模态标签即可在三类适配任务中保持或提升预测能力。

Faithful Grounded Visual Reasoning via Learned Proxy-Tokens Figure 1
2026-06-23cs.CV

Faithful Grounded Visual Reasoning via Learned Proxy-Tokens

Tom Hodemon, Mohamed Chaouch, Aboubacar Tuo, Angelique Loesch

2026-06-23视觉感知

这篇论文针对多模态大模型在视觉问答中虽能给出答案、却常把推理依据与图像证据脱钩的问题,指出文本坐标式 grounding 缺少与视觉特征的可学习语义连接,易产生“看似定位”的幻觉。作者提出 Composer,用 learned proxy-tokens 作为离散指针索引图像潜空间,并构建 ComposerGCoT 评估答案、推理链与定位一致性。实验显示其最终答案准确率与坐标基线基本持平,但整体 IoU 提升 2.7 点,严格 IoU@0.95 提升 9.0 点,说明收益主要体现在更精细、可信的视觉 grounding。

RT-DocLayout: Real-Time End-to-End Document Layout Analysis with Reading Order in the Wild Figure 1
2026-06-23cs.CV

RT-DocLayout: Real-Time End-to-End Document Layout Analysis with Reading Order in the Wild

Cheng Cui, Tingquan Gao, Xueqing Wang, Changda Zhou, Hongen Liu, Ting Sun, Yubo Zhang, Zelun Zhang, Jiaxuan Liu, Manhui Lin, Yue Zhang, Suyin Liang, Yiqing Xiang, Yi Liu

PaddlePaddle Team, Baidu Inc.

2026-06-23视觉感知

针对真实文档解析中版面元素耦合、拍摄/弯曲形变和阅读顺序需多阶段处理而易误差传播的问题,RT-DocLayout基于RT-DETR把分类、检测、像素级分割与阅读顺序关系预测统一到33M参数查询式解码器中,用掩码替代粗框提升OCR输入纯净度。实验称其在OmniDocBench等场景达92.46%综合准确率、132.1 FPS,并在扫描、扭曲、偏斜等扰动下优于对比方法。

VideoAgent: All-in-One Framework for Video Understanding and Editing Figure 1
2026-06-23cs.CV

VideoAgent: All-in-One Framework for Video Understanding and Editing

Hengji Zhou, Lingxuan Huang, Jian Wang, Bing Zhou, Si Wu, Lianghao Xia, Chao Huang

South China University of Technology, The University of Hong Kong, 3 Snap Inc, Harbin Institute of Technology, Shenzhen

2026-06-23视觉感知

这篇论文针对现有自动视频编辑系统只能处理短片段、任务专用且缺乏长视频叙事规划的问题,提出 VideoAgent:用镜头规划代理和跨模态检索生成连贯镜头序列,再由包含 30 多个专用编辑代理的编排框架通过意图过滤与文本梯度图优化组合工作流。实验在 VideoEdit 和公开数据集上报告 87–95% 编排成功率、API 成本降低 60%,人工评分仅比人类作品低约 4%。

Ocean4D: Generative Underwater 4D Reconstruction via Medium-Aware Video Diffusion Figure 1
2026-06-23cs.CV

Ocean4D: Generative Underwater 4D Reconstruction via Medium-Aware Video Diffusion

Yuqiang Huang, Yuxi Wang, Junyu Dong, Zhaoxiang Zhang

2026-06-23视觉感知生成模型三维

面向机器人水下感知与建图中动态水体、吸收和后向散射导致的单目4D重建不稳定问题,Ocean4D用4D-GCC聚合跨帧几何证据以补足遮挡和大视角变化下的条件信息,并在视频扩散去噪中加入深度调制的Medium-Aware Block隐式建模介质效应。论文在动态与静态水下基准上报告了几何一致性和视觉质量的SOTA结果。

Flow6D: Discrete-to-Continuous Flow Matching for Efficient and Accurate Category-Level 6D Pose Estimation Figure 1
2026-06-23cs.CV

Flow6D: Discrete-to-Continuous Flow Matching for Efficient and Accurate Category-Level 6D Pose Estimation

Mingyu Mei, Li Zhang, Zibo Dai, Han Sun, Xinyue Zhao, Huiliang Shen, Zaixing He

2026-06-23生成模型三维

Flow6D针对类别级6D位姿估计中连续回归易受噪声、局部最优和大搜索空间拖累的问题,将旋转与平移先离散成概率bin,用离散流匹配定位高置信潜空间,再以连续流匹配回归局部残差,从而兼顾粗定位与精细修正。方法可扩展到关节物体,在合成和真实数据上优于现有方法,并报告约70 FPS实时推理。

Transfer learning-based method for automated ewaste recycling in smart cities Figure 1
2026-06-23cs.CV

Transfer learning-based method for automated ewaste recycling in smart cities

Nermeen Abou Baker, Paul Szabo-Müller, Uwe Handmann

Ruhr West University of Applied Sciences, Lützowstr. 5, 46236 Bottrop, Germany, automation and reducing the need for labor., are not treated properly [3]. Moreover, when these recyclable

2026-06-23视觉感知

这篇论文面向智慧城市中快速增长的电子废弃物回收压力,关注如何减少人工分拣误差与数据采集成本。其核心做法是将预训练 AlexNet 迁移到手机废弃物识别任务,仅微调输出层,在包含 6 个品牌、12 类的小规模数据集上训练,并通过学习率、优化器和数据增强缓解过拟合。实验称使用 SGDM 与 3e-4 学习率可达到约 98% 准确率,但数据规模较小,实际工业泛化能力文中未充分说明。

BoxCtrl: 3D-Aware Visual Prompting for Geometric Image Editing Figure 1
2026-06-23cs.CV

BoxCtrl: 3D-Aware Visual Prompting for Geometric Image Editing

Feifei Wang, Shiyuan Yang, Xiaoyu Li, Jing Liao

City University of Hong Kong, City University of Hong Kong Hong Kong China

2026-06-23视觉感知强化学习三维

针对文本或粗粒度2D提示难以精确控制物体在3D空间中的平移、缩放和旋转,BoxCtrl将带RGB三正交面的3D包围盒投影到图像中作为视觉提示,用颜色对应解耦几何与外观控制;再以合成配对数据做SFT、无配对真实数据做RL,通过几何精度与视觉保真奖励缩小域差。实验显示其在平移、旋转、缩放及组合编辑上优于对比方法,但部分增益可能来自合成数据规模与RL奖励设计。

Safe Few-Step Generation via Velocity Editing Figure 1
2026-06-23cs.CV

Safe Few-Step Generation via Velocity Editing

Yujin Choi, Jaehong Yoon

2026-06-23安全鲁棒

本文针对少步数 flow matching 文生图模型中安全引导难以累积生效、提示嵌入编辑又受现代文本编码器限制的问题,提出无需训练的 VESFlow:不改 prompt,而是用安全后验的贝叶斯分解直接编辑速度场,并用风险评分跳过良性提示、在 VESFlow+ 中同时远离不安全方向。实验显示,在 4-step MeanFlow 上 NudeNet 攻击成功率降至 Ring-A-Bell 6.3%、MMA-Diffusion 6.8%,同时基本保持良性生成保真度。

No Figure
2026-06-23cs.CV

P-JEPA: Procedural Video Representation Learning via Joint Embedding Predictive Architecture

Felix Tristram, Stefano Gasperini, Benjamin Killeen, Marcel Walch, Christian Benz, Nassir Navab, Ghazal Ghazaei

Technical University of Munich, Munich Center for Machine Learning

2026-06-23视觉感知

这篇论文针对机器人/具身助手在长时序操作中难以仅凭短片段识别步骤语义的问题,提出P-JEPA:先用现有视频骨干提取帧对齐动作特征,再在30分钟级视频上做掩码潜变量预测,以学习程序进度和上下文依赖动作含义。实验显示其在EgoExo4D、EgoProceL、Assembly101上提升线性可分性、流式推理和时序动作分割,并以更少参数、实时速度达到EgoExo4D细粒度分类SOTA。

SteerVTE: Seamless Video Text Editing with Style and Glyph Control Figure 1
2026-06-23cs.CV

SteerVTE: Seamless Video Text Editing with Style and Glyph Control

Kai Zeng, Moran Li, Zhengwei Wang, Yingchen Yu, Yiheng Lin, Ruichuan An, Ming Lu, Qi She, Wentao Zhang

Peking University, 2ByteDance China, 3ByteDance Singapore, requires. Meanwhile, existing controllable video editing methods [3, 9, 26, 36, 60] are tailored for global or, pairs are unavailable. We therefore design an automatic synthesis pipeline with four stages: text configuration

2026-06-23视觉感知规划控制

这篇论文针对视频中文字编辑难以同时保证字符准确、风格一致与跨帧稳定的问题,提出冻结视频 DiT、仅用轻量文本上下文适配器注入区域掩码、原文字体风格与行/字符级字形控制的 SteerVTE。其关键洞察是保留视频生成先验,用 GLAS 损失、三阶段课程和百万级合成/真实数据弥补视频模型弱文字渲染能力;在 VTE-Bench 上相较开源基线和 Seedance 2.0 显著提升文本准确率、风格相似度与时序一致性。

Privacy-Preserving Person Re-Identification from Temporal Sequences with Transformer and Hungarian Optimization Figure 1
2026-06-23cs.CV

Privacy-Preserving Person Re-Identification from Temporal Sequences with Transformer and Hungarian Optimization

Raphaël Delécluse, Hazem Wannous, Laurent Guimas

IMT Nord Europe, University of Lille, CNRS UMR 9189 - CRIStAL, F-59000 Lille, France

2026-06-23优化算法

面向公共空间行人重识别中 RGB 图像易泄露身份且受光照、遮挡影响的问题,论文以顶视深度序列为主,结合 Transformer 编码时序运动模式,并用匈牙利算法做跨视角全局匹配优化;在 TVPR2、GODPR、BIWI RGBD-ID 等数据集上,深度-only 方法在 CMC、mAP 上达到接近现有 RGB-D 方法的竞争性能,同时保留更强隐私属性。

PhysFlow: Frequency Decoupled with Dual-Field Rectified Flow for Remote Photoplethysmography Figure 1
2026-06-23cs.CV

PhysFlow: Frequency Decoupled with Dual-Field Rectified Flow for Remote Photoplethysmography

Zixu Li, jianjun Qian, Hang Shao, Lei Luo, Jian Yang

2026-06-23生成模型

本文针对远程光电容积描记在光照变化、表情和头动下脉搏信号易被扰动淹没的问题,提出 PhysFlow:将真实 rPPG 分解为趋势与幅度成分,并用双条件速度场的 rectified flow 分别生成,减少成分耦合且只需少量 ODE 步完成重建。实验称其在多个基准上同时提升心率估计和波形重建,但具体增益来源仍需结合消融细看。

RS-Gen: A Multi-Stage Agentic Framework for Reasoning and Search-Augmented Image Generation Figure 1
2026-06-23cs.CV

RS-Gen: A Multi-Stage Agentic Framework for Reasoning and Search-Augmented Image Generation

Feifei Bian, Zhimin Zheng, Wei Deng, Daiguo Zhou, Jian Luan

MiLM Plus, Xiaomi Inc.

2026-06-23视觉感知

针对图像生成/编辑模型在隐含意图、多步视觉推理和 OOD 新知识上易失效的问题,RS-Gen 将生成流程改造成免训练、可插拔的多阶段智能体闭环:先识别知识缺口与逻辑障碍,再结合检索、ReAct 规划和生成-审查-修正完成任务。实验显示其在 WISE_Verified 与 RISEBench 上分别为 Qwen-Image 和 Qwen-Image-Edit-2511 带来 0.313、19.70 的绝对增益,并达到开源 SOTA。

Temporally Aware Densification for Dynamic 3D Gaussian Splatting Figure 1
2026-06-23cs.CV

Temporally Aware Densification for Dynamic 3D Gaussian Splatting

Vikram Sandu, Mayurdeep Pathak, Rajiv Soundararajan

2026-06-23三维

本文针对动态 3D Gaussian Splatting 仍沿用静态 densification、导致短生命周期运动区域监督稀疏和重建模糊的问题,提出把时间可见性纳入高斯分裂/克隆决策:用可见性加权梯度、按寿命自适应阈值,并通过时间偏移 warping 增强快速运动附近的形变能力。在 N3DV、Interdigital、VRU 等动态多视角数据上,方法主要提升动态区域的 Masked PSNR/SSIM,同时保持较高渲染速度,VAD 也可作为插件迁移到多种动态 3DGS 框架。

CFPO: Counterfactual Policy Optimization for Multimodal Reasoning Figure 1
2026-06-23cs.CV

CFPO: Counterfactual Policy Optimization for Multimodal Reasoning

Zhangyuan Yu, Wanran Sun, Guangjing Yang, Xiaohu Wu, Qicheng Lao

2026-06-23视觉语言强化学习优化算法

这篇论文针对多模态强化学习只奖励最终答案、易让视觉语言模型依赖语言先验而忽视图像证据的问题,提出 CFPO:在注意力层构造反事实路径,抑制高显著视觉线索,并用事实与反事实预测差异正则化 GRPO/DAPO,以强化跨模态因果一致性。实验显示其在多模态推理任务上较标准 RL 基线提升 3.17%–6.25%,较 PAPO 提升 1.32%–2.13%。

Unmasking LAION-5B: Age, Gender, Race, and Emotion Biases in Large-Scale Image Datasets Figure 1
2026-06-23cs.CV

Unmasking LAION-5B: Age, Gender, Race, and Emotion Biases in Large-Scale Image Datasets

Iris Dominguez-Catena, Daniel Paternain, Mikel Galar

Institute of Smart Cities (ISC), Department of Statistics, Computer Science and Mathematics, Public University of Navarre

2026-06-23视觉感知数据集/基准

针对 LAION-5B 这类网络抓取图文数据可能把人口偏差传递给生成模型的问题,本文在 LAION-2B-en 与 LAION-2B-multi 的百万 URL 样本上,用 FairFace、DeepFace 和 Emo-AffectNet 自动估计人脸的年龄、性别、种族与表情,并用 Ducher’s Z 分析交叉与刻板关联。结果显示两部分都明显偏向 20–39 岁、白人和男性,少数族裔及中老年女性不足,且存在“愤怒-男性”“快乐-女性”等稳定情绪刻板偏差。

NGPS: Structure-Preserving Self-Supervised Denoising via Neighbor-Guided Patch Sampling Figure 1
2026-06-23eess.IV

NGPS: Structure-Preserving Self-Supervised Denoising via Neighbor-Guided Patch Sampling

Jaehyun Cho, YoungJoon Yoo

2026-06-23视觉感知

针对体数据相邻切片自监督去噪中错位会导致伪影、边界模糊,而简单掩码又丢弃高频解剖监督的问题,NGPS将结构匹配与信号取值解耦:用去噪引导图在局部搜索相似补丁,再从原始相邻切片取目标值,无需形变场或重采样。作者在低剂量CT、超低剂量CT和合成Rician MRI上报告了PSNR、SSIM及边缘相关指标的稳定提升,并显示对层厚和掩码阈值较鲁棒。

StreamPPG: Low-Latency rPPG Estimation via Consistent Privileged Learning Figure 1
2026-06-23cs.CV

StreamPPG: Low-Latency rPPG Estimation via Consistent Privileged Learning

Yiming Li, Yihan Yang, Yuguang Chu, Yuanhui Hu, Si-Yuan Cao, Xiaohan Zhang, Xiaokai Bai, Zhe Wu, Hui-Liang Shen

2026-06-23视觉感知

针对传统片段式 rPPG 需先缓存百余帧、带来数秒延迟,而逐帧方法又难建模生理周期的问题,StreamPPG 将逐帧流式推理与一致特权学习结合,训练时用真实 rPPG 信号强化表征并约束推理一致性,配合自适应时序模块关注脉搏区域和长程依赖。多数据集实验显示其在保持边缘设备实时吞吐的同时达到或超过片段式方法精度。

Interpretable Probabilistic Medical Image Segmentation via Gaussian Process with Explicit Modelling of Annotation Bias and Variability Figure 1
2026-06-23cs.CV

Interpretable Probabilistic Medical Image Segmentation via Gaussian Process with Explicit Modelling of Annotation Bias and Variability

Qi Li, Yuliang Huang, Shaheer U. Saeed, Qianye Yang, Vasilis Stavrinides, Zachary M. C. Baum, Dean C. Barratt, J. Alison Noble, Tom Vercauteren, Yipeng Hu

2026-06-23视觉感知三维

针对医学图像分割中多标注者存在系统偏差和不稳定性、但现有概率模型多在隐空间中隐式吸收这些差异的问题,论文提出在 logit 空间用 SVGP 建模图像相关参考分布,并以显式 bias/variance 表示标注者扰动。实验显示其在保持与 Pionono 相近 Dice/HD95 的同时,显著降低 ECE 和 NLL,且学到的参数能反映不同标注者行为。

Koshur Pixel: a large-scale synthetic ocr dataset for kashmiri Figure 1
2026-06-23cs.CV

Koshur Pixel: a large-scale synthetic ocr dataset for kashmiri

Haq Nawaz Malik, Faizan Iqbal, Nahfid Nissar

and rigorously demonstrate how programmatic data generation offers a scalable and cost-effective solution to, of meticulously labeled data, text is largely unavailable, these materials cannot, traditional, labor-intensive data collection paradigm., task of manually labeling noisy real-world scans, we, datasets, and allows for the scalable generation of over

2026-06-23数据集/基准

这篇论文针对克什米尔语 Nastaliq 文字缺乏可训练 OCR 数据、手工标注成本高且主流模型难以处理连写与层叠字形的问题,提出 Koshur Pixel:用 KS-PRET-5M 文本经 SynthOCR-Gen 程序化渲染为多字体、多粒度合成图像,并加入 25+ 类退化增强。主要结果是公开 613,078 对高保真图文样本,作为首个大规模克什米尔语 OCR 训练资源;但文中更侧重数据集构建与定性分析,实际模型精度增益文中未充分说明,可能主要来自 scaling / data。

T-VSS: Test-Time Visual Subspace Steering for Adversarial Robustness of Vision-Language Models Figure 1
2026-06-23cs.CV

T-VSS: Test-Time Visual Subspace Steering for Adversarial Robustness of Vision-Language Models

Jaehyuk Jang, Minseok Seo. Seungju Cho, Kangwook Ko, Changick Kim

School of Electrical Engineering, KAIST

2026-06-23视觉语言视觉感知安全鲁棒

这篇论文针对零样本视觉语言模型在对抗扰动下视觉特征被破坏、而现有测试时提示或像素优化路径间接且昂贵的问题,提出 T-VSS:从同一受攻击图像的多视角特征残差中构建样本特定低秩子空间,并用可靠性加权熵最小化学习共享特征校正。实验显示其在细粒度、ImageNet 与 OOD 基准上提升鲁棒性,同时保持较好干净精度和更低推理开销;但防御感知攻击下仍会明显失效。

Expert Consensus on Criteria for the Automated Assessment of Laparoscopic Camera Navigation Figure 1
2026-06-23cs.CV

Expert Consensus on Criteria for the Automated Assessment of Laparoscopic Camera Navigation

Amir Ebrahimzadeh, Nazila Esmaeili, Michael Ghadimi, Jannis Hagenah

2026-06-23机器人

这篇论文针对腹腔镜摄像导航评价依赖人工打分、难以规模化反馈的问题,提出由14项技能组成的自动评估分类框架,并将其归入构图、清晰度、稳定性、运动和安全意识五类。作者结合23名外科医生问卷与现有计算机视觉能力,构建“临床重要性—技术就绪度”矩阵,发现视野、对焦和居中最受重视,也最适合作为近期自动化评估与训练反馈的优先目标。

Spectral Gating via Damped Oscillations for Adaptive Implicit Neural Representations Figure 1
2026-06-23cs.CV

Spectral Gating via Damped Oscillations for Adaptive Implicit Neural Representations

Alex Costanzino, Pierluigi Zama Ramirez, Giuseppe Lisanti, Luigi Di Stefano

2026-06-23视觉感知

这篇论文针对隐式神经表示中“高频表达易记噪、紧支撑激活又偏低频”的谱选择矛盾,将神经元激活建模为受迫阻尼振子的稳态响应,用可学习的固有频率与阻尼形成训练中的谱门控。其关键洞察是带宽不靠显式正则或手工调参,而由优化动态从窄带逐步放宽,实现由粗到细并更难接纳随机噪声。实验称在多类 INR 重建任务上达到 SOTA 或竞争性能,且无需任务特定超参。

MambaADv2: Evolving Duality-enhanced State Space Model for Unsupervised Anomaly Detection Figure 1
2026-06-23cs.CV

MambaADv2: Evolving Duality-enhanced State Space Model for Unsupervised Anomaly Detection

Xiaobin Hu, Haoyang He, Bo Yin, Yu He, Lei Xie, Jiangning Zhang, Yu-Gang Jiang, Shuicheng Yan

Xiaobin Hu, Haoyang He, Lei Xie and Jiangning Zhang are with Zhejiang University, Hangzhou, China., Xiaobin Hu, Bo Yin, and Shuicheng Yan are with the School of Computing, National University of Singapore, Singapore., Yu He is with College of Computing and Data Science, Nanyang Technological University, Singapore, Yu-Gang Jiang is with the Institute of Trustworthy Embodied AI, Fudan University University, Shanghai, China.

2026-06-23视觉感知

面向工业视觉异常检测中 CNN 难建模长程关系、Transformer 计算开销高且多类别场景效率不足的问题,MambaADv2 将预训练编码器与 Mamba 式解码器结合,在多尺度 DSS 模块中融合 HSS 状态空间建模、频域增强卷积和语义自适应渐进扫描,以兼顾全局依赖、局部纹理与效率。论文在六个异常检测数据集、七项指标上报告优于现有方法的结果,但具体增益中有多少来自模型扩容与更高分辨率仍需结合消融判断。

LUMINA-26: Low-Light Understanding for Modeling and Interpreting Night-time Actions Figure 1
2026-06-23cs.CV

LUMINA-26: Low-Light Understanding for Modeling and Interpreting Night-time Actions

Aman Kumar Pandey, Anil Singh Parihar

2026-06-23视觉感知

该文针对夜间监控等真实低照度场景中动作识别易受噪声、低对比度和运动模糊影响的问题,提出真实采集的 LUMINA-26 数据集,并设计基于光照估计的 Illumi-Net,用 MoE 自适应增强与 VideoMAE 时空建模联合分类。实验在 ELLAR 上达到 Top-1 55.13%,在新数据集上给出 Top-1 75.95% 基线;但增益可能部分来自数据覆盖与模型组合,消融细节仍需进一步核实。

Technical Report for the ICRA 2026 GOOSE 2D Fine-Grained Semantic Segmentation Challenge: Pretraining-Diverse Ensemble of Foundation Vision Encoders for Robust Outdoor Scene Understanding Figure 1
2026-06-23cs.CV

Technical Report for the ICRA 2026 GOOSE 2D Fine-Grained Semantic Segmentation Challenge: Pretraining-Diverse Ensemble of Foundation Vision Encoders for Robust Outdoor Scene Understanding

Boyan Wang, Yongxi Huang, Wenjing Li, Tianrui Hui, Shaofei Huang, Nan Pu, Zhun Zhong

LION Lab, Hefei University of Technology, Hefei, China. 2 University of Macau, Macau, China.

2026-06-23视觉感知安全鲁棒

面向野外机器人在多平台、长尾类别和光照变化下的细粒度语义分割,论文将问题聚焦到感知骨干而非解码器微调。作者固定 Mask2Former,比较不同预训练视觉编码器,指出预训练范式比参数量更决定 GOOSE 表现;再用 DINOv3、SigLIP2、InternImage 做按类别 IoU 加权集成。最终在官方测试集取得 75.40% composite mIoU、挑战第二名。

Compression and Retrieval: Implicit Memory Retrieval for Video World Models Figure 1
2026-06-23cs.CV

Compression and Retrieval: Implicit Memory Retrieval for Video World Models

Zhan Peng, Jie Ma, Huiqiang Sun, Chong Gao, Zhijie Xue, Zhiyu Pan, Zhiguo Cao, Jun Liang, Jing Li

Huazhong University of Science and Technology, Sun Yat-sen University, Huazhong University of Science and Technology China, Sun Yat-sen University China

2026-06-23视觉感知强化学习

这篇论文针对视频世界模型在复杂相机轨迹下难以长期保持场景记忆的问题,提出 CaR:将压缩后的历史上下文与目标视频 token 拼接,并用带相机投影编码的注意力进行隐式检索,同时用轻量压缩网络降低长上下文开销。作者还构建 SceneFly 数据集;实验显示其在视频延展、场景重访和硬切换轨迹中优于全上下文与显式检索基线,并具备一定开放场景泛化能力。

Scene-agnostic ALS boresight self-calibration Figure 1
2026-06-23cs.CV

Scene-agnostic ALS boresight self-calibration

Aurélien Brun, Jan Skaloud

2026-06-23视觉感知

针对传统机载激光扫描 boresight 标定依赖特定航线和含多姿态平面的结构化场景、难以嵌入常规测图任务的问题,论文用重叠航带自动提取的场景无关点对点对应替代平面约束,并给出轻量 Gauss-Helmert 调整与联合 GNSS/惯导原始观测的动态网络两种估计方式。四次飞行、五类惯导实验显示,在轨迹质量足够且有约 3–4 条重叠航带时可无专门场景恢复 boresight;若存在显著时变姿态误差,动态网络更可靠,轻量方法更多起到吸收平均姿态误差、改善点云一致性的作用。

Poisson2Gaussian: Noise Gaussianization to Enhance Image Denoising Figure 1
2026-06-23cs.CV

Poisson2Gaussian: Noise Gaussianization to Enhance Image Denoising

Xirou Zhou, Zijing Xu, Yibo Qu, Qi Zhang, Xiaowan Hu, Xinyang Li

College of AI, Tsinghua University, Beijing, China, Department of Automation, Tsinghua University, Beijing, China, School, of Electronic and Information Engineering, Beihang University, Beijing, China

2026-06-23视觉感知三维

本文针对低光摄影、显微和天文成像中泊松主导噪声的信号相关、异方差和偏斜分布问题,指出这类噪声比独立同分布高斯噪声更难被去噪网络学习。核心创新是用可逆流做 Poisson2Gaussian,通过完整概率密度匹配把残差显式高斯化,并与 Noise2Noise 式无偏训练交替优化下游去噪器,无需干净配对或显式噪声参数。实验显示其在多数据集达到领先表现,在强非高斯场景 PSNR 最高提升 0.75 dB,且可插入多种去噪架构。

Rethinking Prototype-based Similarity Learning for Few-Shot Object Detection Figure 1
2026-06-23cs.CV

Rethinking Prototype-based Similarity Learning for Few-Shot Object Detection

KunHo Heo, Seungjae kim, Wongyu Lee, SuYeon Kim, MyeongAh Cho

2026-06-23视觉感知

这篇论文针对少样本目标检测中原型相似度方法的两个瓶颈:类别间相似度边界塌缩导致混淆,以及相似度分数缺少定位所需的空间细节。作者用文本特征作为语义锚筛选视觉通道,抑制风格噪声,并将 ViT 多层特征按阶段注入自回归框回归过程,实现由粗到细定位。在 COCO 上报告较前一最佳方法提升 10.1 nAP,消融显示两部分均有贡献。

Attention-Spectrum Regularization for Replay-Free Continual Multimodal LLMs Figure 1
2026-06-23cs.CV

Attention-Spectrum Regularization for Replay-Free Continual Multimodal LLMs

Chuangxin Zhao, Canran Xiao, Siyuan Ma, Mengyao Lyu, Yanbiao Ma, Jun Xia, Guiguang Ding, Yang Liu

The Hong Kong University of Science and Technology (Guangzhou), Sun Yat-sen University, Nanyang Technological University, Renmin University of China, Tsinghua University

2026-06-23视觉语言

本文针对多模态大模型在连续适应新视觉域、问题类型和指令时容易遗忘旧能力的问题,提出 ASR:不回放旧样本,而是把跨模态注意力图视为二维信号,保存按技能聚合的频谱原型,并用相位不变正则约束后续训练中的有害漂移。其核心洞察是旧技能遗忘与技能条件化的视觉注意结构漂移相关。实验在 VQA v2、VQACL、CLT-VQA、CoIN、UCIT 等连续 VQA 和多模态指令调优基准上显示,ASR 相比回放、正则化和适配器基线提升最终性能并降低遗忘。

No Figure
2026-06-23cs.GR

VolHuMe: a High-Resolution Large Scale Dataset of Volumetric Human Meshes

Giulia Martinelli, Niccolò Bisagno, Nicola Garau, Esa Rahtu, Nicola Conci

2026-06-23数据集/基准

针对现有4D人体重建数据集难以同时兼顾规模、真实运动、高精细几何与丰富标注的问题,VolHuMe用64个RGB和32个深度相机近距离采集104名受试者,提供高分辨率纹理网格、多视角RGB/深度、点云、SMPL-X/FLAME拟合、服装分割和可绑定网格等真值。论文在3D/4D人体重建、动态网格序列和服装人体动画任务上评测现有方法,结果显示该数据集能暴露当前基准和方法在细节重建上的不足,收益可能主要来自更高质量、更完整的数据。

MotionHalluc: Diagnosing Kinematic Hallucinations in Fine-Grained Motion Reasoning Figure 1
2026-06-23cs.CV

MotionHalluc: Diagnosing Kinematic Hallucinations in Fine-Grained Motion Reasoning

Weile Guo, Shenghong He, Danying Mo, Chengdong Xu, Xuexun Liu, Chao Yu

Sun Yat-Sen University, Shenzhen University

2026-06-23视觉感知

这篇论文针对双视频动作纠错中多模态大模型常把外观、视角或语言先验误当作真实运动差异的问题,提出 MotionHalluc 基准,从方向、归因和时间对齐三类运动幻觉诊断细粒度运动推理,并给出无需训练的 PPV 量化测量验证流程。实验显示现有五类先进模型均易出错,而注入显式运动学证据平均提升 10.6%,说明可靠动作反馈需要可验证的关节/时序测量支撑。

Three-Step Hierarchical Transformer for Multi-Pedestrian Trajectory Prediction Figure 1
2026-06-23cs.CV

Three-Step Hierarchical Transformer for Multi-Pedestrian Trajectory Prediction

Raphaël Delécluse, Hazem Wannous, Laurent Grisoni, Laurent Guimas

2026-06-23规划控制

这篇论文针对多人轨迹预测中时间动态、多模态线索与社会交互常被混在高成本注意力模块里、导致扩展性和可解释性不足的问题,提出三步层次化 Transformer:先按模态编码时间,再用 GRU 摘要和跨模态注意力融合,最后在时间-行人 token 上做社会注意力。实验在 JRDB、Urban 真实数据上达到 SOTA,在 JTA 上具竞争力,消融显示各阶段均有贡献。

Unlimited OCR Works Figure 1
2026-06-23cs.CV

Unlimited OCR Works

Youyang Yin, Huanhuan Liu, YY, Qunyi Xie, Chaorun Liu, Shiqi Yang, Shaohua Wang, Zhanlong Liu, Hao Zou, Jinyue Chen, Shu Wei, Jingjing Wu, Mingxin Huang, Zhen Wu, Guibin Wang, Tengyu Du, Lei Jia

Baidu Inc.

2026-06-23视觉感知

这篇技术报告针对端到端 OCR 在长序列生成中 KV cache 持续膨胀、难以一次解析多页文档的问题,提出 Reference Sliding Window Attention:生成 token 始终关注视觉/提示参考 token,但只保留近邻输出窗口,从而保持恒定缓存并避免视觉状态被递归模糊。基于 DeepSeek OCR 改造后,Unlimited OCR 可在 32K 长度内一次转写数十页,并在 OmniDocBench v1.5 达到 93.23%,较基线提升 6.22 分;但增益可能也受 2M PDF 数据继续训练影响,来源未完全拆清。

UECP: Uncertainty-Enhanced Collaborative Perception Figure 1
2026-06-23cs.CV

UECP: Uncertainty-Enhanced Collaborative Perception

Kang Yang, Tianci Bu, Peng Wang, Deying Li, Wen Jie, Yongcai Wang

2026-06-23安全鲁棒

这篇论文针对自动驾驶协同感知中置信图与检测头耦合、难以可靠抑制协作噪声的问题,提出用 LiDAR 点密度监督的不确定性图作为物理证据,并通过 UAPF 的不确定性加权下采样与残差融合嵌入多尺度 BEV 融合。实验在 DAIR-V2X、V2V4REAL 上优于 HEAL、CoBEVT 等方法,并在噪声条件下保持更强鲁棒性。

SPAR: Semantic-Pixel Self-Alignment and Adaptive Routing for Unified Multimodal Models Figure 1
2026-06-23cs.CV

SPAR: Semantic-Pixel Self-Alignment and Adaptive Routing for Unified Multimodal Models

Hongxiang Li, Hongxu Chen, Chenyang Zhu, Xiaoshuang Huang, Jiayin Cai, Xiaolong Jiang, Yao Hu, Long Chen

2026-06-23视觉语言

论文针对多模态大模型“能理解但难生成”的语义特征与像素重建错位问题,提出 SPAR:用非对称语义/像素双流 tokenizer 保留判别语义并补回高频细节,再让该 tokenizer 作为扩散模型的内部对齐教师,并通过动态 token 路由融合多层 MLLM 特征。实验称其在统一架构下提升重建与生成质量,同时基本保留视觉理解能力。

No Figure
2026-06-23cs.CV

DrivingVoxels: Compositional Sparse Voxel Rasterization for Dynamic Driving Scene Reconstruction

Tania Aguirre, Luis Roldão, Moussab Bennehar, Nathan Piasco, Dzmitry Tsishkou, Simone Rossi, Pietro Michiardi

2026-06-23三维

该文针对自动驾驶动态场景中稀疏体素方法多限于静态、而3DGS动态方案训练慢且内存不稳定的问题,提出DrivingVoxels:用背景八叉树与各刚体目标局部八叉树组合渲染,并通过射线-包围盒排序解决跨体素体的深度合成,结合LiDAR初始化加速几何收敛。在PandaSet上,其感知指标与StreetGS相当,结构重建更好,示例中CD从0.19降至0.06、F1从31.8%升至59.9%,训练时间约从102分钟降至30分钟。

Physics-Guided Spatiotemporal State Space Modeling for Lookahead Molten Pool Segmentation in Laser Wire-Feed Welding Figure 1
2026-06-23cs.CV

Physics-Guided Spatiotemporal State Space Modeling for Lookahead Molten Pool Segmentation in Laser Wire-Feed Welding

Sen Li, Haichao Cui, Changhao Yin, Chendong Shao, Yaqi Wang, Xinhua Tang, Fenggui Lu

Shanghai Key Laboratory of Materials Laser Processing and Modification, School of Materials Science and Engineering, Shanghai Jiao Tong University

2026-06-23视觉感知

面向激光送丝焊闭环控制中的感知、计算和执行延迟,本文将任务从当前熔池分割推进到提前预测关键孔、焊丝与熔池的未来像素布局。其核心是 WeldMamba:把历史同轴灰度图、工艺参数和焊丝电信号共同注入特征归一化与时空状态空间建模,并用预测时域条件、SDF/时序一致性和关键孔运动约束稳定几何。43 段数据上 500 ms 前视达到 74.63% mIoU,消融显示时间历史、patch 级状态空间和关键孔运动建模贡献最大。

Learning Stable Canonical Worlds for Novel View Synthesis and Beyond Figure 1
2026-06-23cs.CV

Learning Stable Canonical Worlds for Novel View Synthesis and Beyond

Xiaoyu Xu, Jian Zou, Sheyang Tang, Zhihua Wang, Jing Liao, Kede Ma

Department of Computer Science, City University of Hong Kong, Department of Electrical and Computer Engineering, University of Waterloo

2026-06-23强化学习

论文针对现有前馈 Gaussian Splatting 在多视角输入增加时仍偏向视角依赖预测、易累积噪声和冗余的问题,提出 CanonicalGS:先从图像估计深度、语义特征与不确定性,再在规范化潜在世界中做可靠性加权融合,最后解码为高斯 primitives。实验显示其在新视角合成上最高提升约 2.5 dB PSNR,并带来 11% 语义分割精度增益,但对姿态、深度质量和动态遮挡仍较敏感。

Boosting Neural Video Codec via Scale-Driven Online Flow Refinement Figure 1
2026-06-23cs.CV

Boosting Neural Video Codec via Scale-Driven Online Flow Refinement

Tiange Zhang, Rongqun Lin, Haocheng Tang, Xiandong Meng, Weijia Jiang, Zhimeng Huang, Siwei Ma

Peking University Shenzhen Graduate School, Pengcheng Laboratory, City University of Hong Kong, School of Computer Science, Peking University, Migu Interactive Entertainment Co., Ltd

2026-06-23视觉感知生成模型

这篇论文针对神经视频编码在测试视频出现复杂、训练外运动时光流估计失准、在线微调又代价高的问题,提出训练无关的 SOFR 插件:在推理时生成粗/细两种尺度光流,并依据 warping 误差与码率模式自适应软融合,同时用可靠性检查抑制无效粗尺度候选。在 USTC-TD 上接入 DCVC-SDD、DCVC-FM、EHVC 均有泛化收益,DCVC-FM 平均 BD-Rate 降低 2.84%(PSNR)和 4.05%(MS-SSIM),编码时间增量很小。

ScalingAttention: Discovering Intrinsic Sparse Attention Topology for Video Diffusion Transformers Figure 1
2026-06-23cs.CV

ScalingAttention: Discovering Intrinsic Sparse Attention Topology for Video Diffusion Transformers

Ruiliang Zhou, Xuecheng Wu, Kang He, Guangyun Han, Bin Liu, Qinqin Chen, Wende Xu, Qingjie Zhao, Chengru Song

2026-06-23视觉感知生成模型

视频扩散 Transformer 的 3D 全注意力带来二次复杂度,动态稀疏开销高、静态启发式又损伤质量。ScalingAttention 的核心洞察是各注意力头的高质量区域会收敛为由权重编码、跨提示稳定且尺度不变的内在稀疏拓扑,并用 WEST 离线提取拓扑、FAST 按扩散阶段调节头级稀疏度,配合块稀疏核实现加速。在 Wan2.1 上最高获得 1.90× 端到端加速,并在相近保真度下优于 SVG/SVG2 的效率—质量权衡。

From Point Estimates to Distributions: GMM Pooling for MIL in Preterm Birth Prediction Figure 1
2026-06-23cs.CV

From Point Estimates to Distributions: GMM Pooling for MIL in Preterm Birth Prediction

Hussain Alasmawi, Numan Saeed, Soha Said, Mohammad Yaqub

2026-06-23视觉感知

这篇论文针对早产预测中常只选单帧经阴道超声、丢失同一患者多图像差异的问题,将患者检查建模为MIL图像包。核心创新是用端到端GMM pooling表示包内特征分布,而非均值、最大或注意力的点估计,并通过可学习探针形成固定嵌入。结果显示PTB任务PR-AUC由0.44升至0.56,在淋巴结MIL基准上也达到0.91 F1和0.89 ROC-AUC,但临床私有数据细节限制了泛化判断。

MotionMAR: Multi-scale Auto-Regressive Human Motion Reconstruction from Sparse Observations Figure 1
2026-06-23cs.CV

MotionMAR: Multi-scale Auto-Regressive Human Motion Reconstruction from Sparse Observations

Yuhua Luo, Junsheng Zhang, Mengyin Liu, Xincheng Lin, Ming Yan, Zhudi Chen, Chenglu Wen, Lan Xu, Siqi Shen, Cheng Wang

*Equal contribution 1Fujian Key Laboratory of Urban Intelli-, gent Sensing and Computing, Xiamen University 2Key Laboratory, istry of Education of China, School of Informatics, Xiamen Univer-, sity 3National Institute for Data Science in Health and Medicine, Xiamen University 4ShanghaiTech University. Correspondence to:

2026-06-23三维

MotionMAR针对VR/AR头手三点等稀疏观测下全身动作重建易漂浮、抖动且长短期细节难兼顾的问题,将人体运动视为由低频全局轨迹到高频局部细节的时间层级过程。其核心是把视觉VAR的next-scale思想改造成时间多尺度自回归:TMT VQ-VAE按时间分辨率离散运动,MAN由粗到细生成索引,SAC把稀疏追踪信号对齐到各尺度,MRN再平滑量化伪影。实验称在AMASS上达到SOTA精度和时间一致性,但片段中主要结果集中在该数据集,真实设备泛化与各模块增益幅度仍需看完整实验。

Black-Box Continual Learning for Vision-Language Models Figure 1
2026-06-23cs.CV

Black-Box Continual Learning for Vision-Language Models

Yuting Li, Weihang Fang, Haoyuan Gao, Linghe Kong, Yexin Li, Lichao Sun, Weiran Huang

Yuting Li is with the School of Computer Science, Shanghai Jiao Tong, School, gent Sensing, Shanghai Jiao Tong University, Shanghai, China (e-mail:, Haoyuan Gao is with the School of Computer Science, Shanghai Jiao Tong, Linghe Kong is with the School of Computer Science, Shanghai Jiao Tong, Yexin Li is with the State Key Laboratory of General Artificial Intelligence, Beijing Institute for General Artificial Intelligence (BIGAI), Beijing, China, Lichao Sun is with the Department of Computer Science and Engineering, Weiran Huang is with the School of Computer Science, Shanghai Jiao, Tong University, and Shanghai Innovation Institute, Shanghai, China (e-mail:, all seen classes in a global label space without a task ora-, crimination across an expanding global universe of labels.

2026-06-23视觉语言视觉感知

本文针对云端或边缘部署的视觉语言模型难以访问权重、结构和梯度的问题,提出更贴近实际的黑盒持续学习基准 Black-CL。核心洞察是仅优化外部文本原型也可缓解增量学习遗忘,方法 BETA 结合语义投影积累、潜在分布回放和测试时原型自适应。在 10 个数据集和多种 VLM 骨干上,BETA 以约 0.05M 可训练参数显著超过现有黑盒调优方法,并接近甚至部分超过白盒持续学习方法。

Can Single-View Mesh Reconstruction Generalize to Robot Camera Rotation? Figure 1
2026-06-23cs.CV

Can Single-View Mesh Reconstruction Generalize to Robot Camera Rotation?

Yu Zhan, Guangcheng Chen, Hanjing Ye, Zhiqin Cheng, Zanjia Tong, Wenjun Xu, Hong Zhang

2026-06-23机器人三维

这篇论文关注机器人腕部、机身等相机旋转时,单视角网格重建是否仍可作为可靠空间感知模块。作者设计按 roll/pitch/yaw 控制旋转的评测,追踪 MDE、规范物体网格、相机坐标布局和物理合理性误差,发现旋转主要破坏深度点图与布局,规范网格相对稳定;两阶段 SAM3D+FoundationPose 比端到端布局更稳,引入重力约束的 GAR 将一阶段布局方向误差降低 47.1%,说明显式重力线索对机器人场景重建很关键。

Subject-Level Unknown-Identity Identification from Leap Motion Controller 2 Hand Landmarks Figure 1
2026-06-23cs.CV

Subject-Level Unknown-Identity Identification from Leap Motion Controller 2 Hand Landmarks

Bahar Moharrer, Susanna Cifani, Marco Raoul Marini, Luigi Cinque, Maria De Marsico

2026-06-23规划控制

本文动机是把原用于手姿态的 ML2HP/LMC2 手部 landmark 数据转化为接触式之外的身份识别与未知身份拒识问题。核心做法是在原始几何特征上加入指尖到掌心距离、掌心归一化指间角度,并用嵌套 LOSO 避免阈值调到真实未知主体。结果显示 Extra Trees 明显优于 MLP 与 OpenMax,开放集准确率约 91.3%、未知召回约 85.1%,说明难点主要在已知/未知分数分离而非闭集分类。

Humanoid-OmniOcc: Stereo-Based Full-View Occupancy Dataset for Embodied AI Figure 1
2026-06-23cs.RO

Humanoid-OmniOcc: Stereo-Based Full-View Occupancy Dataset for Embodied AI

Xianda Guo, Bohao Zhang, Chenwei Huang, Shiyuan Chen, Ruilin Wang, Yiqun Duan, Cong Yang, Qin Zou, Wei Sui

School of Computer Science, Wuhan University, Soochow University

2026-06-23机器人数据集/基准

本文针对现有占据预测数据集偏向自动驾驶、难以覆盖人形机器人室内近场全向感知的问题,提出 Humanoid-OmniOcc:基于 Unitree G1 传感器参数在 Isaac Sim 中构建四向环视双目数据,并用 Real2Sim2Real 流程生成 15 个仿真场景、5 个真实环境的 155K+ 样本。配套 HS2Occ 利用双目深度先验进行 2D 到 3D 提升,实验显示其优于单目基线,并在未见仿真场景和真实采集上有较好泛化。

Concept Alignment Contrast and Long-Short Prompt Memory for Test-Time Adaptation of SAM3 in Medical Image Segmentation Figure 1
2026-06-23cs.CV

Concept Alignment Contrast and Long-Short Prompt Memory for Test-Time Adaptation of SAM3 in Medical Image Segmentation

Yubo Zhou, Jianghao Wu, Ping Ye, Shaoting Zhang, Guotai Wang

2026-06-23视觉感知

这篇论文针对 SAM3 从自然图像迁移到医学分割时域差明显、现有测试时自适应过度依赖图像级不确定性且连续更新不稳定的问题,提出 CM-TTA:用概念对齐对比衡量前景/背景与文本提示的语义一致性来选伪标签视图,并以长短期提示记忆和密集伪监督更新提示。在前列腺与皮肤病灶分割上,Dice 较基线分别平均提升 3.17 和 6.07 个百分点。

The Impact of VAE Design on Latent Pose Representations for Diffusion-based Sign Language Production Figure 1
2026-06-23cs.AI

The Impact of VAE Design on Latent Pose Representations for Diffusion-based Sign Language Production

Guilhem Fauré (MULTISPEECH), Mostafa Sadeghi (MULTISPEECH), Sam Bigeard (MULTISPEECH), Slim Ouni (LORIA)

VAEs are made available online1.

2026-06-23生成模型三维

这篇论文针对扩散式手语生成中“VAE只看重建误差是否足够”的常见假设,系统比较四种手语姿态VAE设计,分析架构与训练目标如何改变潜空间结构及其对下游文本到手语扩散模型的影响。PHOENIX14T实验显示,生成质量的BLEU差异有时比起重建精度,更能由潜空间性质解释,提示VAE设计需面向生成任务而非单纯优化几何重建。

PG-MAP: Joint MAP Optimization for Inference-Time Alignment of Diffusion and Flow-Matching Models Figure 1
2026-06-23cs.LG

PG-MAP: Joint MAP Optimization for Inference-Time Alignment of Diffusion and Flow-Matching Models

Ruolan Sun, Pawel Polak

Stony Brook University

2026-06-23生成模型优化算法

针对扩散与流匹配模型推理期对齐多沿单一控制轴、难以同时处理文本条件与潜变量依赖的问题,PG-MAP将每个去噪步表述为带前向一致性耦合的轨迹级近端MAP优化,按噪声日程自适应联合更新条件嵌入与潜状态,并在流匹配中退化为潜变量更新。实验显示其在SD1.5/SDXL上提升PickScore与美学指标,可与调优CFG叠加;在SD3.5-medium上相对静态基线取得91.9% PickScore、75.7% HPS胜率,人评也偏好该方法。

Evo-RAD: Navigating Rare Retinal Disease Diagnosis via Self-Evolving Agentic Retrieval Figure 1
2026-06-23cs.CV

Evo-RAD: Navigating Rare Retinal Disease Diagnosis via Self-Evolving Agentic Retrieval

Wangding Xia, Ye Du, Jiashi Lin, Meng Wang, Danli Shi, Shujun Wang

2026-06-23视觉感知

针对稀有视网膜病在预训练眼科模型中样本不足、易被常见病近邻误导的问题,Evo-RAD 将检索增强诊断从一次性相似度匹配改为自演化决策过程,用图代理在参考病例集中删除不一致证据、插入病理一致样本并适时终止,并以同质性奖励和 GRPO 训练。实验显示其较视网膜基础模型提升 21.04%,较静态检索与 PEFT 方法提升 3.56%。

ENVS: Environment-Native Verified Search for Long-Horizon GUI Agents Figure 1
2026-06-23cs.AI

ENVS: Environment-Native Verified Search for Long-Horizon GUI Agents

Yincheng Zhou, Athena Zhuoming Zhong, Shijie Zhang, Kevin Zhang, Teresa Xiaotao Shang, Shanghang Zhang

University of Pennsylvania, Peking University

2026-06-23视觉感知

这篇论文针对长程 GUI 代理在真实桌面中反馈稀疏、VM rollout 昂贵且易被中断的问题,提出 ENVS:先在 OSWorld 中对行为差异明显的动作做环境原生搜索,用任务 oracle 验证成功轨迹,再将其整理为全局均衡的逐步监督数据进行 SFT,而非在线 RL。实验显示 ENVS 在 OSWorld 达到 30.3 pass@8、OSWorld-Noisy 达到 29.0,并以更少 GPU 小时超过 ARPO;30% 搜索数据仍达 27.0,说明增益可能主要来自高质量验证数据与数据均衡。

Controllable Texture Tiling with Transformed RoPE-Enhanced Diffusion Models Figure 1
2026-06-23cs.GR

Controllable Texture Tiling with Transformed RoPE-Enhanced Diffusion Models

Junrong Huang, Zhiyuan Zhang, Rui Tang, Hongbo Fu, Jnig Liao

City University of Hong Kong, Manycore Tech Inc., Hong Kong University of Science and Technology, City University of Hong Kong Hong Kong China, Manycore Tech Inc. Hang Zhou China, Hong Kong University of Science and Technology Hong Kong China

2026-06-23生成模型规划控制

该文针对生成式材质/纹理迁移难以按用户指定频率、方向和尺度精确平铺且易损失高频细节的问题,提出在 DiT 中把仿射变换注入 RoPE 坐标而非直接扭曲像素,并用分离注意力掩码减少参考纹理与背景语义泄漏;实验称在合成和真实基准上较现有方法提升控制精度、纹理保真度与视觉融合效果,但部分收益可能受数据集与上游几何/光照估计质量影响。

Evaluating self-supervised echocardiographic representations across downstream extraction strategies for left-ventricular segmentation and ejection fraction estimation Figure 1
2026-06-23cs.CV

Evaluating self-supervised echocardiographic representations across downstream extraction strategies for left-ventricular segmentation and ejection fraction estimation

Sylwia Majchrowska, Philip Teare

2026-06-23视觉感知

这篇论文关注医学影像自监督表征评估中的一个偏差:密集任务性能常被下游探针能力混淆。作者在 EchoNet-Dynamic 上以左心室分割和射血分数估计为例,系统比较启发式提取、线性探针、轻量解码器和部分微调。结果显示,启发式方法显著低估 DINOv3 与 BYOS 表征;冻结轻量解码器可将 Dice 提升到约 0.90,并使 EF 误差接近或优于监督基线,而微调增益有限,说明多策略评估比单一探针更可靠。

Hybrid Compression: Integrating Pruning and Quantization for Optimized Neural Networks Figure 1
2026-06-23cs.CV

Hybrid Compression: Integrating Pruning and Quantization for Optimized Neural Networks

Minh-Loi Nguyen, Long-Bao Nguyen, Van-Hieu Huynh, Minh-Triet Tran, Trung-Nghia Le

2026-06-23视觉感知

面向边缘和嵌入式设备部署时 CNN 计算与存储开销过高的问题,本文将剪枝、量化感知训练与 MoE 路由结合:先用 AGP 等方法压缩多个专家模型,再由门控选择压缩专家以弥补精度损失。在 CIFAR-10 和 BloodMNIST 上报告 FLOPs 降低约 10–11 倍、参数约 10.5 倍,精度仅小幅下降;但 MoE 相对单纯剪枝量化的独立增益来源仍需进一步说明。

BEV-Denoise: Learning Intrinsic Noise for Accurate Bird's-Eye-View Semantic Segmentation Figure 1
2026-06-23cs.CV

BEV-Denoise: Learning Intrinsic Noise for Accurate Bird's-Eye-View Semantic Segmentation

Dooseop Choi, Kyounghwan An, Kyoung-Wook Min

Electronics and Telecommunications Research Institute (ETRI), University of Science and Technology (UST)

2026-06-23视觉感知

该文针对多相机 BEV 语义分割中因未知深度、遮挡和恶劣天气导致的 BEV 特征内生噪声问题,提出 BEV-Denoise:借鉴 DDPM 的噪声估计能力,用 UNet 单次预测并从 BEV 特征中减去噪声;同时借助任务分解和预训练 BEV 地图自编码器获得训练监督。作者将其接入四类代表性 VT 模型,在 nuScenes 上报告了稳定性能提升,但具体增益与网络复杂度的权衡仍需进一步说明。

MythraGen: Two-Stage Retrieval Augmented Art Generation Framework Figure 1
2026-06-23cs.CV

MythraGen: Two-Stage Retrieval Augmented Art Generation Framework

Quang-Khai Le, Cong-Long Nguyen, Minh-Triet Tran, Trung-Nghia Le

2026-06-23视觉感知

本文针对文本到艺术图像生成中仅靠文字难以精确表达画家风格、逐艺术家微调又成本过高的问题,提出 MythraGen:先用 BLIP-2 融合图像与元数据特征,并通过 FAISS 从 WikiArt 检索与提示在内容、流派和风格上相近的作品,再用这些样本以 LoRA 微调 Stable Diffusion。实验和用户研究显示其在提示匹配与艺术风格复现上优于若干开源和商业基线,但具体增益中检索质量、LoRA 微调与数据规模各自贡献仍需更细消融说明。

Each Judge Its Own Yardstick: Discovering Per-VLM Taxonomies for Physical Video Evaluation Figure 1
2026-06-23cs.CV

Each Judge Its Own Yardstick: Discovering Per-VLM Taxonomies for Physical Video Evaluation

Yu Cao, Ziquan Liu, Zhensong Zhang, Jiankang Deng, Shaogang Gong, Jifei Song

Queen Mary University of London, Huawei Darwin Research Center, Imperial College London

2026-06-23视觉语言视觉感知数据集/基准

这篇论文针对视频/世界模型越来越依赖 VLM 当物理一致性裁判、但固定评测维度无法匹配不同 VLM 感知能力的问题,提出 JudgeFit:先让目标 VLM 自述物理错误并聚类成初始分类,再用人类物理常识评分校准、诊断冗余或不可靠维度并迭代修订。作者在 16 个 VLM、8 个模型家族上验证,个性化分类在所有模型上优于全局 schema,平均相对提升约 32%,并揭示了总体排名掩盖的模型特定盲点。

Intend, Reflect, Refine: An Adaptive Multimodal Reflection Framework for Autonomous Driving Figure 1
2026-06-23cs.CV

Intend, Reflect, Refine: An Adaptive Multimodal Reflection Framework for Autonomous Driving

Zisheng Chen, Yuping Qiu, Jianhua Han, Tao Tang, Xiuwei Chen, Likui Zhang, Ying-Cong Chen, Hang Xu, Xiaodan Liang

Sun Yat-sen University, Yinwang Intelligent Technology Co. Ltd.

2026-06-23视觉语言

本文针对端到端自动驾驶VLA模型常一次性生成轨迹、缺少对未来后果检验的问题,提出IRR-Drive:先生成文本驾驶意图,再预测未来语义BEV作为具身反思空间,并按场景复杂度自适应选择直接规划或反思修正;训练上结合反思数据与GSPO奖励以兼顾性能和开销。实验称其在NAVSIM v1/v2的PDMS和EPDMS达到SOTA,说明多模态反思与自适应策略有效,但具体增益中数据构造和强化学习各自贡献仍需细看消融。

Improving Robotic Imitation Learning via Trajectory Standardization Figure 1
2026-06-23cs.RO

Improving Robotic Imitation Learning via Trajectory Standardization

Licheng Yang, Lingfeng Qian, Fei Zheng, Yonghao He, Wei Sui, Shuangshuang Li, Hu Su

2026-06-23机器人模仿学习规划控制

这篇论文针对遥操作示教中速度不均、停顿和冗余点会制造非马尔可夫矛盾并拖累模仿学习的问题,提出离线的 ISR 轨迹重采样:用速度与加速度构造信息强度,在黎曼流形上按近似等信息距离选点,从而压缩低价值片段并保留高曲率、接触前减速等关键阶段。三项真实操作任务中,相比 3× 时间均匀下采样,π0.5 平均成功率由 47.8% 升至 71.8%,VO-DP 由 62.7% 升至 80.2%,同时减少数据量和训练成本。

InteractiveAvatar: Real-Time Streaming Video Generation for Consistent and Intent-Aware Avatars Figure 1
2026-06-23cs.CV

InteractiveAvatar: Real-Time Streaming Video Generation for Consistent and Intent-Aware Avatars

Quanyue Song, Yishan He, Yanfei Zhang, Shihao Cheng, Zhixiang He, Zhizhi Guo, Chi Zhang, Xuelong Li, Caigui Jiang

2026-06-23视觉感知

本文针对实时流式数字人长期生成中易出现视觉漂移、且动作主要受音频驱动而难以体现用户意图的问题,提出 InteractiveAvatar。其核心是在流式扩散框架中加入长短期视觉记忆以压缩并保留历史状态,并用推理-反应模块结合状态循环与缓存切换生成意图对齐的语音和动作。实验显示其在长时一致性和复杂交互场景中优于现有方法,同时保持实时生成能力。

IViT: A Novel Interpretable Visual Transformer for Skin Disease Detection Figure 1
2026-06-23eess.IV

IViT: A Novel Interpretable Visual Transformer for Skin Disease Detection

Haibiao Li, Di Lin, Xue Jiang, Weiwei Wu, Yanxi Li, Yugang Chi

School of Information and Software Engineering, University of, Department of Dermatology, Chongqing Traditional Chinese Medicine, Chongqing Health Center for Women and Children, Chongqing, protection. As a result, available high-quality annotated, models in this field. Section 3 elaborates the overall pipeline, of reasoning controllability in medical scenarios [36]., features of images [40].However, labeled skin disease datasets

2026-06-23视觉感知

针对皮肤病图像中类间相似、医生经验依赖以及ViT黑箱且少样本适应差的问题,论文提出IViT:在预训练迁移基础上,用二次规划约束做可解释特征选择,并结合多目标损失减少冗余、调整激活分布。六个数据集上准确率93.80%,较黑箱ViT仅低0.21%,特征冗余降29.5%,激活区域与临床关注病灶较一致。

PHOEBI: An Open-World Benchmark for Bacterial Identification in Phase-Contrast Microscopy Figure 1
2026-06-23cs.CV

PHOEBI: An Open-World Benchmark for Bacterial Identification in Phase-Contrast Microscopy

Aaditya Baranwal, Md Jahid Hasan, Shruti Vyas

University of Central Florida

2026-06-23强化学习数据集/基准

该文针对相差显微镜下细菌样本常为多菌混合且含未知物种、现有基准缺少开放世界多标签评测的问题,提出PHOEBI:12万张、6种杆菌40种组合的数据集及留组合外协议。结果显示常规梯度聚合器在未见组合上F1下降0.39–0.57,失败主要在聚合而非表征;基于冻结DINOv2瓦片特征的锚点解码器缓解组合崩塌,并用同一重构残差实现开放集拒识AUROC约0.70和新类原型发现。

Full-Body Golf Swing Kinematic Reconstruction From a Smartwatch IMU Figure 1
2026-06-23cs.CV

Full-Body Golf Swing Kinematic Reconstruction From a Smartwatch IMU

Yuanshuo Tan, Kezhe Zhu, Xiujie Sun, Chunping Liang, Shuoyang Zhu, Chenquan Xu, Licheng Zhong, Huiming Pan, Yinri Jin, Chang Liu, Bo Xiao, Shenglong Le, Bryndan W. Lindsey, Peter B. Shull

2026-06-23三维

论文针对高尔夫挥杆量化依赖实验室光学捕捉、摄像机或多 IMU、难以上场使用的问题,提出仅用腕戴智能手表 IMU 的 WIT-KinNet,通过模态嵌入与时序运动学编码学习腕部到全身关节的依赖。36 名不同水平球手、7 类球杆实验中,全身关节角 MAE 为 8.11±1.84°,骨盆/躯干旋转及 X/S-factor 与光学捕捉高度相关,但误差受挥杆幅度、水平和球杆类型显著影响。

FedOT: Ownership Verification and Leakage Tracing via Watermarks for Federated LDMs Figure 1
2026-06-23cs.CV

FedOT: Ownership Verification and Leakage Tracing via Watermarks for Federated LDMs

Wenlong Cheng, Yuan Gan, Yunqiu Xu, Jiaxu Miao

2026-06-23视觉感知

FedOT针对联邦潜扩散模型在共享全局模型时易被恶意客户端转售且难以追责的问题,提出分块水印:前段验证模型归属,后段编码客户端身份;同时用潜向量变换绑定VAE与U-Net,使替换干净VAE会显著破坏生成质量。实验显示其在所有权验证、泄漏追踪及多类去水印攻击下保持较好可靠性。

SingGuard: A Policy-Adaptive Multimodal LLM Guardrail with Dynamic Reasoning Figure 1
2026-06-23cs.CV

SingGuard: A Policy-Adaptive Multimodal LLM Guardrail with Dynamic Reasoning

SingGuard Team

AI Security Lab, Ant Group

2026-06-23视觉语言强化学习

论文针对多模态模型上线后安全策略会随产品、地区和场景变化,而现有护栏多依赖固定分类的问题,提出将自然语言策略作为运行时输入的 SingGuard,按规则逐条匹配内容,并用快/混合/慢三种推理路径兼顾延迟与可审计性,训练中加入快慢解耦强化学习以减弱初始判断锚定。在自建 SingGuard-Bench 的 56,340 个样本、80 多类风险和 35 个数据集上,其六类基准平均 F1 均达 SOTA,动态规则准确率由 0.6465 提升到 0.7415。

Fursee: Hybrid YOLO-DINOv3 Framework for Fursuit Identity Retrieval and Clustering Figure 1
2026-06-23cs.CV

Fursee: Hybrid YOLO-DINOv3 Framework for Fursuit Identity Retrieval and Clustering

Jundi Wu

Shandong University

2026-06-23视觉感知

针对漫展海量兽装照片难以人工归档、且兽装头部差异主要来自颜色纹理而非人脸几何的问题,论文提出 Fursee:先用 YOLO 裁剪拥挤场景中的头部,再以 ArcFace 优化 DINOv3 表征,并用轮廓系数搜索 DBSCAN 聚类参数。实验称其在检索与聚类指标上优于多模态大模型,但数据集规模与泛化范围有限,增益可能部分来自专用数据与检测裁剪。

VideoLatent: Video-Language Learning via Latent Self-Forcing Figure 1
2026-06-23cs.CV

VideoLatent: Video-Language Learning via Latent Self-Forcing

Zi-Yuan Hu, Zicong Tang, Shijia Huang, Yanyang Li, Michael R. Lyu, Liwei Wang

The Chinese University of Hong Kong

2026-06-23视觉感知

这篇论文针对视频多模态模型中显式 CoT 依赖人工推理标注、训练和推理开销高的问题,提出 VideoLatent,用潜在注入模块约束隐式“latent thoughts”不偏离视频与问题,并通过包含对齐与多样性目标的 latent self-forcing,仅用视频-问答三元组训练。实验覆盖 14 个视频理解与复杂推理基准,报告其优于标准与潜在 MLLM,并相较 Video-R1 将训练/推理开销约降至 1/6 与 1/68。

Chains That See, Answers That Don't: A Multi-Aspect Evaluation Recipe for Forced Chain-of-Thought on Video-MME Figure 1
2026-06-23cs.CV

Chains That See, Answers That Don't: A Multi-Aspect Evaluation Recipe for Forced Chain-of-Thought on Video-MME

Zhichao Fan, Yanhang Li, Zexin Zhuang

University of Illinois Urbana-Champaign, Northeastern University, Southern Methodist University, University of Illinois Urbana-Champaign Urbana Illinois USA, Northeastern University Boston Massachusetts USA, Southern Methodist University Dallas Texas USA

2026-06-23视觉感知数据集/基准

这篇论文针对视频问答中“强制思维链会让模型更可靠”的常见假设,提出由配对准确率、视频置换诊断和视觉退化阶梯组成的三探针评估方案,并区分严格/宽松评分。结果显示,Qwen2.5-VL 的 CoT 确实受视频输入影响,但并未提升 Video-MME 多选准确率;7B 模型在严格评分下还出现经校正后显著的下降,说明“看见了”的推理链不等于有用答案。

G-MASt3R-SfM: Graph-based View Pruning and Multi-stage Optimization for Robust SfM Figure 1
2026-06-23cs.CV

G-MASt3R-SfM: Graph-based View Pruning and Multi-stage Optimization for Robust SfM

Toshiki Watanabe, Shintaro Ito, Natsuki Takama, Koichi Ito, Takafumi Aoki

2026-06-23优化算法安全鲁棒

这篇论文针对 MASt3R 用于 SfM 时会给无重叠图像也生成错误匹配、进而破坏全局位姿优化的问题,提出用匹配置信度构建场景图并通过图结构剪除异常视角,再按社区结构从局部到全局进行多阶段 bundle adjustment。ETH3D 实验显示,该流程在相机位姿估计和三维重建上优于 COLMAP、MASt3R-SfM 等基线,消融也表明主要收益来自 GVP 对几何不一致视角的主动过滤。

OrthoMotion:Disentangling Camera and Subject Motion via Geometry Semantics Orthogonal Attention Figure 1
2026-06-23cs.CV

OrthoMotion:Disentangling Camera and Subject Motion via Geometry Semantics Orthogonal Attention

Zijie Meng

Peking University, China

2026-06-23视觉感知

该文面向可控视频生成中相机运动与主体轨迹相互干扰的问题,指出仅靠2D光流条件无法唯一分解二者,因为相机平移与物体运动共享1/Z深度缩放。OrthoMotion将相机控制注入RoPE的保范几何相位,将主体轨迹作为门控语义值注入,并用正交正则压低交叉响应;在Wan2.1等骨干上同时提升相机/主体误差与FVD,交叉干扰降低超过2.4倍,但结论依赖一阶Jacobian估计和刚体场景假设。

Homographic Navigation: Geometry-Driven Camera Guidance for Deterministic Planar Capture Figure 1
2026-06-23cs.CV

Homographic Navigation: Geometry-Driven Camera Guidance for Deterministic Planar Capture

Dominik Kroupa, Marek Vaško, Muh Yuzril Ihza Baharuddin, Adam Herout

Ondokuz Mayıs University

2026-06-23机器人

面向机器人或手持设备对平面目标进行可重复拍摄的需求,论文指出单纯事后估计单应性难以保证采集姿态一致。其核心是把单应性作为导航、训练和评估的组织变量,用单张标注参考图生成合成训练数据,并结合稀疏关键点预测、两阶段推理和 Stable Warp 提升精度。实验显示,在极少监督下可实现较准确的平面定位与对齐,但第二阶段野外视频自训练主要作为未来方向。

DBT-Bleed: Dual-Branch Temporal Modeling with Key-Frame Selection for Surgical Bleeding Detection Figure 1
2026-06-23cs.CV

DBT-Bleed: Dual-Branch Temporal Modeling with Key-Frame Selection for Surgical Bleeding Detection

Sudhanshu Mishra, Jialang Xu, Jensen Ang, Evangelos B. Mazomenos, Beng Ti Ang, Yueming Jin

2026-06-23视觉感知

该文针对术中出血不良事件与残留血外观相似、长视频时序建模成本高的问题,提出基于CLIP的双分支DBT-Bleed,用层级多尺度时序适配器分离出血/正常表征,并以HiRED熵驱动选帧保留关键信息。在MultiBypass上F1、召回、MCC分别提升6.53%、5.62%、9%,在EndoPit-IAE零样本跨术式测试中F1和MCC提升6%与8%。

Policy-as-Data: Learning Generalizable HOI Diffusion Models from Simulated Physics Figure 1
2026-06-23cs.CV

Policy-as-Data: Learning Generalizable HOI Diffusion Models from Simulated Physics

Shujia Li, Jianshu Hu, Haiyu Zhang, Yunpeng Jiang, Haoyuan Jin, Xinyuan Chen, Yaohui Wang, Yutong Ban

2026-06-23生成模型强化学习

该文针对 HOI 生成依赖昂贵 MoCap、难覆盖新物体与长时序且物理接触不稳定的问题,提出把物理仿真中强化学习策略生成的任务轨迹当作数据,并用粗到细重定向弥合低 DoF 刚体与 SMPL 表示差异,再训练条件扩散模型。实验显示 PAD-HOI 在未见物体、百余种几何和长时序多阶段交互上提升泛化、接触稳定性与动态多样性,但具体增益可能主要来自 scaling / data。

CoVStream: Edge-Cloud Collaboration for Understanding of Long Video Streams Figure 1
2026-06-23cs.CV

CoVStream: Edge-Cloud Collaboration for Understanding of Long Video Streams

Xu Liu, Guikun Chen, Zihao Yan, Kanzhi Wu, Wenguan Wang

2026-06-23视觉感知

面向智能眼镜等算力受限设备的长视频理解,论文指出纯云端传原始视频带宽过高、纯端侧又难以承载大模型。Co-VStream 的核心是把端侧作为语义压缩器,并行生成压缩视觉特征与关键帧描述,云端维护实体图和全局上下文,仅在查询时唤醒推理模型。实验称其在 VideoMME-Long、LVBench、RTV-Bench 上以约 87.6% 带宽下降保留 LVBench 云端基线 99.2% 准确率,并在超长流和 24 小时模拟中显著降低内存占用。

Learning Adaptive Dynamical Features via Multi-$τ$ Liquid-Mamba for All-in-one Image Restoration Figure 1
2026-06-23cs.CV

Learning Adaptive Dynamical Features via Multi-$τ$ Liquid-Mamba for All-in-one Image Restoration

Hu Gao, Changshuo Wang, Yulong Chen, Lizhuang Ma

2026-06-23视觉感知

这篇论文针对 all-in-one 图像复原中退化类型和空间区域差异大、现有 Mamba 单一状态演化时间尺度适应性不足的问题,提出 Multi-τ Liquid-Mamba:在不改变 selective scan 主流程的前提下,引入输入条件化的多时间常数液态离散化,并用退化感知门控融合不同动态分支,使模型同时处理局部细节和全局结构。基于该模块的 MLMIR 在多类 all-in-one 与任务对齐复原基准上报告达到或接近 SOTA,但具体增益中模块设计与训练规模、数据配置的相对贡献仍需看消融细节。

Visual Geometry Transformer in the Wild: Distractor-Free 3D Reconstruction Figure 1
2026-06-23cs.CV

Visual Geometry Transformer in the Wild: Distractor-Free 3D Reconstruction

Tianbo Pan, Xingyi Yang, Shizun Wang, Xinchao Wang

National University of Singapore, 2 The Hong Kong Polytechnic University

2026-06-23三维

这篇论文针对端到端多视角三维重建默认场景静态、无干扰物的弱点,指出真实采集中行人、车辆等瞬时遮挡会破坏跨视角一致性。VGTW通过干扰感知训练在注意力中分离并抑制受污染特征,结合辅助掩码头和像素级标注数据,仅用2D监督即可前馈输出更干净的点云。实验称其在多种真实场景中较现有方法更鲁棒并达到SOTA,但数据规模和任务外泛化仍有限。

DE-FIVE: Detecting Malicious Image Prompts via Fourier Features and Image Vector Embeddings Figure 1
2026-06-23cs.CR

DE-FIVE: Detecting Malicious Image Prompts via Fourier Features and Image Vector Embeddings

Xingwei Zhong, Varun Sharma, Kar Wai Fok, Vrizlynn L. L. Thing

2026-06-23视觉感知

本文针对 VLM 中恶意图像提示,尤其是间接提示注入缺少专门、低成本检测的问题,提出无需训练的 DE-FIVE。其核心思路是结合输入图像的傅里叶域特征黑盒检测,以及视觉编码器在扰动下的图像向量嵌入差异白盒检测,仅需少量恶意样例。实验显示混合检测在多种 VLM 和恶意图像提示场景下优于现有基线,但具体增益来源仍需更多消融支撑。

LoCC: Detection and Localization of Lip-Syncing Deepfakes via Counterfactual Frame Consistency Figure 1
2026-06-23cs.CV

LoCC: Detection and Localization of Lip-Syncing Deepfakes via Counterfactual Frame Consistency

Soumyya Kanti Datta, Shan Jia, Siwei Lyu

2026-06-23视觉感知

针对唇形同步伪造常只改动嘴部且可能只覆盖短片段、传统整段或音视同步检测易漏检的问题,LoCC用真实嘴部帧训练扩散重建器,从前后帧反事实预测中间帧,并以重建误差刻画局部时间不一致,再通过段级教师、帧级学生和扩散不一致损失实现定位。实验在FakeAVCeleb、KODF、LAV-DF、AVDF1M上显示较强检测与跨域泛化,但高IoU精确边界仍弱于部分更大模型。

READ More than What You See: Reinforcement Learning for Accurate and Coherent Audio Description Generations Figure 1
2026-06-23cs.CV

READ More than What You See: Reinforcement Learning for Accurate and Coherent Audio Description Generations

Bo Fang, Xinyao Zhang, Yuxin Song, Hui Zhang, Hang Zhou, Antoni B. Chan

City University of Hong Kong, Tsinghua University

2026-06-23强化学习

这篇论文针对音频描述生成中仅靠提示或下一词监督容易产生风格不匹配、内容泛化和上下文不连贯的问题,提出 READ,将音频描述视为序列级强化学习优化任务,结合参考匹配、长度、格式奖励,并用上下文感知的一致性奖励约束叙事连贯性。在 MAD-Eval、CMD-AD 和 TV-AD 上,READ 相比既有训练式与免训练方法在多类指标上取得明显提升,说明 RL 有助于同时优化描述准确性与连贯性。

HERCULES: An Open-Source Simulation Framework for Heterogeneous Multi-Robot SLAM, Collaborative Perception, and Exploration Figure 1
2026-06-23cs.RO

HERCULES: An Open-Source Simulation Framework for Heterogeneous Multi-Robot SLAM, Collaborative Perception, and Exploration

Sandilya Sai Garimella, Daniel Chase Butterfield, Sean Wilson, Lu Gan

1 affiliationmark: Georgia Institute of Technology, USA, 2 affiliationmark: Georgia Tech Research Institute, USA

2026-06-23机器人

面向灾害响应、巡检等需要 UAV–UGV 协同建图、感知与探索的场景,HERCULES 针对现有模拟器难以同时支持大尺度异构空地机器人闭环实验的问题,改造 AirSim/Cosys-AirSim 架构,加入统一航点控制、共享导航栈、多模态传感、动态智能体与环境灾害接口。论文通过异构 SLAM、协同 3D 感知和闭环探索实验展示其可生成同步基准数据并支撑在线协同验证。

RaysUp: Ultra-light Universal Feature Upsampling via Geometry-Aware Ray Representation Figure 1
2026-06-23cs.CV

RaysUp: Ultra-light Universal Feature Upsampling via Geometry-Aware Ray Representation

Yuchuan Ding, Linfei Li, Lin Zhang, Ying Shen

2026-06-23视觉感知

RaysUp针对视觉基础模型特征分辨率低、传统插值丢语义而学习式上采样又依赖特定模型或结构较重的问题,提出任务无关、VFM无关的轻量通用特征上采样框架。其核心是把重建从二维邻域提升到几何感知射线表示,用空间解耦引导编码、任意分辨率交叉注意力、基于6D Plücker坐标的RayPE和几何邻域注意力来兼顾边界结构与语义一致性。实验称其在多种密集预测任务上优于AnyUp,同时参数量约为其16%、推理约快7倍。

Interpretable Uncertainty Routing Separating Emotion Ambiguity from Distribution Shift in Facial Expression Recognition Figure 1
2026-06-23cs.CV

Interpretable Uncertainty Routing Separating Emotion Ambiguity from Distribution Shift in Facial Expression Recognition

Keito Inoshita, Takato Ueno

Faculty of Business and Commerce, Kansai University, Suita, Japan, Data Science and AI Innovation Research Promotion Center, Shiga University, Graduate School of Data Science, Shiga University, Hikone, Japan, a matched out-of-distribution rejection rate. A strong label-distribution-, annotated by multiple workers who provide label distributions rather than defini-, tive ground-truth labels. FERPlus [1] supplies ten votes per image across eight, cyclical SG-MCMC and soft-label learning [14], facial expression recognition is designed and introduced, centred on a novel

2026-06-23视觉感知安全鲁棒

这篇论文针对表情识别中“人类本就意见不一”和“输入已偏离训练分布”都会导致低置信度、但应采取不同处理的问题,提出用 DINOv2 深度集成分解偶然/认知不确定性,并以 UAR 在推理时分别保留模糊样本、拒绝 OOD。结果显示偶然不确定性与标注分歧相关性达 0.66,认知不确定性在强腐蚀下 OOD AUROC 为 0.699,且在相同拒绝率下保留约 1.8 倍更多模糊域内人脸。

Generative Relightable Avatars Figure 1
2026-06-23cs.CV

Generative Relightable Avatars

Kunwar Maheep Singh, Christian Theobalt, Rishabh Dabral

Max Planck Institute for Informatics, combines controllable, physics-grounded relighting with probabilistic re-, line of work comprises deterministic pipelines that reconstruct a controllable, lable, physically grounded intermediate renderings under the target environment

2026-06-23生成模型

该文针对全身数字人在自由视角与任意光照下易过平滑、缺少细节且生成式方法缺乏3D控制的问题,提出GRA:先用可跟踪网格、UV材质与微表面渲染获得物理约束的粗结果,再以RelightNet和带光照交叉注意力的视频扩散模型补全姿态相关纹理、皱褶和长序列一致性。实验显示其感知质量优于既有可重光照avatar基线,并能在未见环境光、OLAT等设置下保持较好效果。

Modular Diffusion Models for Structured Visual Recognition Figure 1
2026-06-23cs.CV

Modular Diffusion Models for Structured Visual Recognition

Siddhesh Khandelwal, Björn Ommer, Leonid Sigal

Department of Compute Science, University of British Columbia, Vector Institute for AI, CompVis, Ludwig Maximilian University of Munich, Munich Center for Machine Learning, Department of Computer Science, University of British Columbia, labels). Experimental results over three distinct structured tasks – object detection, instance, training set. While this shift has led to substantial gains in accuracy and scalability, it has also resulted

2026-06-23视觉感知生成模型

针对检测、分割和场景图等结构化视觉任务常被建模为单一确定性输出、难以表达遮挡和边界歧义的问题,论文提出模块化扩散模型,将异构结构输出分解为类别、位置、关系等条件扩散模块,避免联合加噪破坏组件对齐,并可独立训练、推理时组合。实验覆盖目标检测、实例分割和场景图生成,显示该框架能产生多样且合理的结构预测,并在不确定性刻画与任务指标上优于朴素联合扩散或确定性基线。

SCRUB-FL: Sanitizing and Cleansing Representations via Unlearning of Backdoors Figure 1
2026-06-23cs.LG

SCRUB-FL: Sanitizing and Cleansing Representations via Unlearning of Backdoors

Osama Wehbi, Sarhad Arisdakessian, Omar Abdel Wahab, Azzam Mourad, Hadi Otrok

collaborative, defenses often require large labeled reference datasets, prior, Osama Wehbi is with the Department of Computer and Software En-, Sarhad Arisdakessian is with the Department of Computer and Software, Omar Abdel Wahab is with the Department of Computer and Software, Azzam Mourad is with the Department of Computer Science, Khalifa, Hadi Otrok is with the Department of Computer Science, Khalifa Univer-, enables multiple clients to collaboratively train a shared global, while relabeling them to an attacker-designated target class., explicitly highlighting their applicability to collaborative and, raw client data or a large labelled clean proxy dataset at

2026-06-23视觉感知

联邦学习模型在训练后仍可能保留后门,而服务器通常不知道触发器或恶意客户端,清洗易损伤正常精度。SCRUB-FL的核心思路是在训练中由客户端用谱分析和激活聚类收集可疑样本,并聚合轻量WGAN-GP生成器,收敛后合成近似触发样本,用机器遗忘削弱触发到目标类的关联。在CIFAR-10和GTSRB上,面对三类攻击和最高40%恶意参与者,攻击成功率降至最低3.88%,同时保持超过91%的正常精度。

Catching Lies Without Sending the Video: Privacy-Preserving Multimodal Deception Detection Figure 1
2026-06-23cs.CV

Catching Lies Without Sending the Video: Privacy-Preserving Multimodal Deception Detection

Nikita Sharma, Pranav Sara, Karan Singla

University of California, San Diego, Case Western Reserve University, Ohio

2026-06-23视觉语言视觉感知

这篇论文针对庭审/临床等场景中将人脸与语音视频上传给多模态模型带来的隐私、成本和可质疑性问题,提出在端侧提取转写、情绪、意图、韵律、面部行为等约250个可解释特征,再交给分类器或LLM判断。作者指出既有75%准确率受说话人泄漏影响;在按说话人划分评估下,特征分类器AUC达0.741,Claude基于摘要特征达0.755,并比原始视频少用7.8倍输入token。

NullFlow: One-Step Generative Reconstruction Figure 1
2026-06-23cs.CV

NullFlow: One-Step Generative Reconstruction

Xiao Shi, Edward P. Chandler, Chicago Y. Park, Shirin Shoushtari, Ulugbek S. Kamilov

University of Wisconsin–Madison, Washington University in St. Louis

2026-06-23生成模型三维

针对成像逆问题中扩散/流模型需反复迭代并频繁做数据一致性校正的高成本问题,NullFlow将Mean Flow限制在前向算子的零空间,使生成轨迹始终落在测量一致子空间内,并学习平均速度实现一次网络评估的后验采样。文中在图像修复上显示,单样本可达到接近迭代扩散/流方法的感知质量,100次采样平均还能提升PSNR和SSIM,但实验主要限于修复任务,含噪和变算子场景仍待验证。

SATURN: Symbolic Spatial Reasoning for Multi-Perspective Grounding Figure 1
2026-06-23cs.CV

SATURN: Symbolic Spatial Reasoning for Multi-Perspective Grounding

Danial Kamali, Tanawan Premsri, Shreya Rajpal, Amir Zadeh, Chuan Li, Parisa Kordjamshidi

Michigan State University, Lambda Labs

2026-06-23视觉语言

这篇论文针对机器人/具身指令中“左、前、后”等关系会随相机、代理或物体参考系变化而失效的问题,提出 SATURN:先重建粗略 3D 场景,再生成带不确定性的参考系感知空间谓词,并用免训练 Python 符号执行组合多跳关系。作者还构建 3D FORCE 诊断基准,显示 VLM 和空间微调模型随推理深度、视角复杂度明显退化,而 SATURN 更稳定;在 MindCube 上达到 78.57%,较最强基线高 14 个百分点。

Prompting Diffusion Models for Zero-Shot Instance Segmentation Figure 1
2026-06-23cs.CV

Prompting Diffusion Models for Zero-Shot Instance Segmentation

Irem Zeynep Alagöz, Nils Morbitzer, Andrea Ramazzina, Nassir Navab, Federico Tombari, Stefano Gasperini

Technical University of Munich (TUM), Munich Center of Machine Learning (MCML), discriminative models such as SAM are trained purely on label boundaries and therefore lack, afterthought [2], which makes them less "controllable" than SAM. More specifically, Gen2Seg [2]

2026-06-23视觉感知生成模型

这篇论文针对 SAM 等判别式可提示分割在强纹理、弱边界目标上易过分割,以及既有扩散分割只在后处理使用点击、未真正受用户意图控制的问题,提出 Prompt2Seg:在冻结扩散分割模型上加入空间条件分支,将点击表示为 2D 高斯或置信图直接调制扩散过程。模型仅用受限合成类别微调,却在 COCO、VOC、DRAM、EgoHOS、PIDRay、ZeroWaste 等七个数据集上零样本优于其扩散骨干,显示生成先验加空间提示可提升跨域交互式实例分割。

MaRS: Robust Out-of-Distribution Detection via Mahalanobis Residual Scoring Figure 1
2026-06-23cs.CV

MaRS: Robust Out-of-Distribution Detection via Mahalanobis Residual Scoring

Francesco Di Salvo, Sebastian Doerrich, Christian Ledig

xAILab Bamberg, University of Bamberg, Germany, halanobis Residual Scoring), a label-free OOD detector that learns an, is available at github.com/francescodisalvo05/mars., regularize reliably. Reconstruction- and subspace-based methods offer a label-, reliance on labeled data for backbone fine-tuning, thereby enabling a label-free, – We introduce MaRS (see Figure 1), a plug-and-play, label-free OOD detection

2026-06-23视觉感知安全鲁棒

医学视觉基础模型在患者、设备和采集条件变化下易失效,亟需无需标签的事后 OOD 检测。MaRS 的关键洞察是重建法瓶颈不在重建质量,而在 L2 忽略残差各向异性;它用轻量自编码器学习 ID 流形,并以残差协方差上的 Mahalanobis 距离放大低方差异常方向。实验覆盖三种模态、多类分布偏移和不同骨干规模,整体优于置信度、距离和重建基线。

Learning Entropy Signature for Image Representation and Classification Figure 1
2026-06-23cs.CV

Learning Entropy Signature for Image Representation and Classification

Jan Glaser, Ivo Bukovsky, Noriyasu Homma, Marcel Jirina

Czech Technical University in, University of South Bohemia in, Tohoku University Graduate, School of Medicine, Let’s train MLP to predict the intensity of locally centered, In a simplest case, the target pixels, i.e. locally centered

2026-06-23视觉感知

本文针对图像中哪些局部观测真正驱动学习系统更新的问题,提出从空间学习熵图中选取 K 个最高 LE 位置构成 Learning Entropy Signature,用神经预测器的增量权重变化而非像素/梯度直接描述图像。实验在合成形状、手写数字和人脸上显示,少量高 LE 点即可在低维空间保留可分辨结构差异;但文中也承认尚缺系统分类对比,实际增益来源仍未充分说明。

4DVLT: Dynamic Scene Understanding with Worldline-Centered Vision-Language Tracking Figure 1
2026-06-23cs.CV

4DVLT: Dynamic Scene Understanding with Worldline-Centered Vision-Language Tracking

Chaoyue Li, Boxue Yang, Shengyao Zhou, Haoyang Wu, Rui Qian, Linfeng Zhang

DVLT: Dynamic Scene Understanding with Worldline-Centered, Huazhong University of Science and Technology, Shanghai Jiao Tong University, Zhejiang University, We therefore introduce 4DVLT, a worldline-centered task for instruction-conditioned, that worldline-centered modeling improves both target grounding and recovered worldline quality. The, project page is available at https://github.com/mikubaka88/4DVLT., centered modeling as an effective route to instruction-conditioned 4D dynamic scene understanding.

2026-06-23视觉语言视觉感知强化学习

本文针对现有多模态模型缺少度量时空拓扑、视觉语言跟踪又割裂于2D或3D局部输出的问题,提出以“世界线”统一目标身份、3D运动和多视角2D投影的4DVLT任务,并构建Instruct-4D基准。其4DTrack用对象中心4D状态图、度量路由、双向解码和运动学校准联合求解指令 grounding 与轨迹恢复,在TGATop1上达62.68,较最佳改造VLT基线高19.62点。

DR-Mamba: Automatic Inference-Time Domain Adaptation for Document Image Binarization via Sample-Conditioned Detail-Background Suppression Figure 1
2026-06-23cs.CV

DR-Mamba: Automatic Inference-Time Domain Adaptation for Document Image Binarization via Sample-Conditioned Detail-Background Suppression

Sheng-Wei Chan, Jen-Shiun Chiang

Department of Electrical and Computer Engineering, Tamkang University, New, gates within a single forward pass, requiring no target-domain labels, ing pixel-level labels for every new collection is costly and often impractical, pass, requiring no target-domain labels, no fine-tuning, and no test-time parame-, ter updates. This forward-pass, label-free form of per-sample adaptation falls di-

2026-06-23视觉感知

这篇论文针对退化文档二值化在纸张老化、渗墨、阴影等未见域上前景/背景易混淆的问题,提出 DR-Mamba:把 Mamba 扫描改造成快细节、慢背景双路线,并用输入条件化的 D−βB 减法门在单次前向中自适应抑制背景,无需测试时更新或目标标签;再结合全分辨率细节重建和细笔画监督。留一年 DIBCO/H-DIBCO 评测显示其跨域鲁棒性提升,最难的 2019 fold 表现尤其强,消融称主要增益来自自适应减法抑制。

OmniSpace: Efficient Geometry Awareness for Autonomous Vehicles MLLMs Figure 1
2026-06-23cs.CV

OmniSpace: Efficient Geometry Awareness for Autonomous Vehicles MLLMs

Hao Vo, Phu Loc Nguyen, Khoa Vo, Sieu Tran, Duc Minh Nguyen, Ngo Xuan Cuong, Nghi D. Q. Bui, Anh Nguyen, Duy Minh Ho Nguyen, Ngan Le

University of Arkansas, USA, University of Liverpool, UK, Max Planck Research School for Intelligent Systems

2026-06-23视觉感知

OmniSpace针对自动驾驶MLLM虽能做2D理解、却缺乏深度估计与跨视角对应的问题,先通过诊断实验指出这两项几何能力与下游驾驶表现相关,再用相机位姿注入、极线约束的多视角注意力和训练期3D几何蒸馏,把几何先验内化到模型中,避免推理时依赖外部3D模块。实验显示其在nuScenes、Bench2Drive、nuInstruct、OmniDrive和DriveBench等规划、风险检测、语言与泛化任务上优于现有方法。

Automated sign detection across the Electronic Babylonian Library: A large-scale dataset and end-to-end cuneiform OCR pipeline Figure 1
2026-06-23cs.CV

Automated sign detection across the Electronic Babylonian Library: A large-scale dataset and end-to-end cuneiform OCR pipeline

Wentao Che, Esteban Garcés Arias, Asim Niaz, Andreas Bender, Enrique Jiménez

Institute of Assyriology and Hittite Studies, LMU Munich, Germany, Department of Statistics, LMU Munich, Germany, Munich Center for Machine Learning (MCML), Germany, to tablet damage and layout variability, it provides a scalable and interpretable foundation for, exceeds the ability of a limited number of trained Assyriologists available to analyse it. Furthermore, annotations demands specialist philological expertise, and the labelling effort scales poorly with corpus, vidually annotated signs (Lewenstein et al., 2026). It constitutes the largest publicly available, the sign-by-sign workflow of traditional epigraphy while enabling scalable computational analysis.

2026-06-23视觉感知数据集/基准

针对楔形文字泥板数量巨大、专家标注与释读能力不足的问题,本文将扩展到12.45万符号标注的数据集用于训练可变形DETR,并把检测、自动版面侧面提取、启发式行分组和n-gram文本相似度评估串成端到端OCR流程。在173/106类粒度下,COCO式检测指标较既有工作提升约28–37%,并在eBL的8.77万件残片上生成近290万次符号检测;但系统仍不使用语言先验,受破损和版式变化影响,增益可能主要来自数据规模与workflow适配。

MapReason-OSM: Can Vision-Language Models Make Graph-Verifiable Mobility Decisions from Street Maps ? Figure 1
2026-06-23cs.CV

MapReason-OSM: Can Vision-Language Models Make Graph-Verifiable Mobility Decisions from Street Maps ?

Srinivas Venkatanarayanan (1 and 2), Clement Pakkam Isaac (1 and 3) ((1) NVIDIA, (2) University of Central Florida, (3) University of South Florida)

University of Central Florida, University of South Florida, these models. A model that “reads” a map well (identifying labels, titioners: today’s VLMs can be trusted to read a labeled map but not, Code, data, and the deterministic generator are available at https://github.com/Vi-, zoom scales sharing one center: a mid panel (half-extent 500 m, placement). Because the two panels share a center and the local ex-, marker is placed within a 130 m-radius window of that center (well

2026-06-23视觉语言视觉感知

论文针对VLM在物流、配送和无障碍导航中“能读地图但决策需遵守路网”的落差,提出MapReason-OSM:用自渲染OSM街图、隐藏道路图和精确oracle,将路线、设施选址、停车等结构化输出映射回图上验证合法性、最优性、约束满足与跨缩放一致性。七个模型实验显示,当前VLM能完成简单读图和路线任务,但在图成本推理尤其单设施选点上接近随机,且答案常随缩放变化。

The Power of Light: Improving Synthetic-to-Real Domain Adaptation through Physically-Based Indirect Illumination Figure 1
2026-06-23cs.CV

The Power of Light: Improving Synthetic-to-Real Domain Adaptation through Physically-Based Indirect Illumination

Hooman Tavakoli Ghinani, Tatjana Legler, Martin Ruskowski

While synthetic data generation resolves the manual labeling bottleneck in computer vision, Training OD models requires large-scale annotated datasets, where high-quality labels provide the, costly [7]. The challenge lies not only in producing sufficient labels but also in ensuring that the dataset, datasets. By eliminating the need for manual labeling, synthetic data enables greater control over bias, and labeling accuracy, thereby reducing errors, cost, and labor intensity. Virtual environment–based, ∗German Research Center for Artificial Intelligence (DFKI), Kaiserslautern, Germany, data while minimizing energy consumption in terms of both human labor and computational resources., outperform human-labeled datasets., approach to addressing the bottleneck of limited data availability. Relating to the assumption of a

2026-06-23视觉感知

针对合成数据训练目标检测时仍存在明显 sim-to-real 域差的问题,论文把关注点从常见的直接光随机化转向物理间接光照,基于 Isaac Sim 构建 SmartSDG 和工业数据集 ILLUM INTRUCK,控制光照强度、相机视角与背景复杂度做 18 组 YOLOv12 实验。结果显示,多次反射的间接光和任务相关背景能保留表面纹理、减少高光饱和与误检,使 mAP 和收敛表现优于传统直接光设置。

SeFi-Image: A Text-to-Image Foundation Model with Semantic-First Diffusion Figure 1
2026-06-23cs.CV

SeFi-Image: A Text-to-Image Foundation Model with Semantic-First Diffusion

SeFi-Team

2026-06-23视觉感知生成模型

针对文本到图像基础模型训练成本高、语义引导方法此前多停留在小模型低分辨率数据上的问题,SeFi-Image 将 semantic-first diffusion 扩展到 1B/2B/5B 规模,并结合高保真 VAE 潜空间、双语细粒度标注与文本渲染合成数据。其 5B 模型仅用 125K A800 GPU 小时训练,在 GenEval、DPG、LongTextBench 等基准上达到接近或优于 Qwen-Image、Z-Image 的结果,同时提供少步蒸馏 turbo 版本。

No Figure
2026-06-23cs.CL

Look Light, Think Heavy: What Multimodal Chain-of-Thought Reasoning Can and Cannot Do

Zhuoran Jin, Kejian Zhu, Hongbang Yuan, Yupu Hao, Pengfei Cao, Yubo Chen, Kang Liu, Jun Zhao

The Laboratory of Cognition and Decision Intelligence for Complex Systems, Institute of Automation, Chinese Academy of Sciences, Beijing, China, School of Artificial Intelligence, University of Chinese Academy of Sciences, Beijing, China

2026-06-23视觉语言

本文关注多模态任务中链式思考是否真的有用:作者将12类任务区分为感知与推理,系统比较14个非推理模型和8个推理模型。核心洞察是 CoT 并非免费增益,数学、科学和多图推理受益明显,但视觉定位、计数等感知任务可能退化;开源多模态推理模型整体提升有限,可能因训练过度偏向数学。主要瓶颈在视觉反思,模型呈现“少看、多想”的模式,长推理中逐渐忽视视觉信息。

HiMatch-AD: DINOv3-driven Hierarchical Matching for Training-free Medical Anomaly Detection Figure 1
2026-06-23cs.CV

HiMatch-AD: DINOv3-driven Hierarchical Matching for Training-free Medical Anomaly Detection

Jiayu Huo, Jingyuan Hong, Meng Zhou, Liyun Chen, Le Zhang

Imperial College London, London, UK, King’s College London, London, UK, SonoScape Medical Corp., University of Birmingham, Birmingham, UK, tensive normal data, which limits scalability across modalities and in-, ing and uncertainty-aware fusion for scalable medical anomaly detection., to fully supervised segmentation, anomaly detection offers a more scalable solu-, their scalability across imaging modalities and institutions. In contrast, training-, training, leveraging strong pretrained visual representations to enable scalable

2026-06-23视觉感知

针对医学异常检测依赖任务训练和大量正常数据、跨模态部署受限的问题,HiMatch-AD利用DINOv3做免训练层级匹配:先用CLS与patch双分支检索相近正常参考,再在多层Transformer特征上以聚类正常原型生成异常图,并用不确定性加权融合。BMAD上覆盖脑MRI、肝CT和视网膜OCT,结果优于训练式及DINO系方法,说明多层匹配与可靠性建模对定位和泛化有效。

Mitigating Measurement-Induced Training Instability in Hybrid Quantum Neural Networks for Protein Classification Figure 1
2026-06-23cs.LG

Mitigating Measurement-Induced Training Instability in Hybrid Quantum Neural Networks for Protein Classification

Milton Mondal, Sushovan Chanda, Mohamad Mahdi Alawieh, Brijesh Sukhadiya, Donatus Krah, Clinton Gonsalves, Antonios Ntolkeras, Silvio O. Rizzoli, Ali H. Shaib

aDepartment of Neuro- and Sensory Physiology, University Medical Center Göttingen

2026-06-23视觉感知

本文关注混合量子神经网络分类中常被忽略的测量—损失接口问题:Pauli 测量输出被限制在 [-1,1],直接作为 softmax 交叉熵 logits 会压缩类别间隔并削弱梯度。作者提出可学习的 Quantum Measurement Temperature,在不改变量子线路结构、深度或测量算子的情况下放大量子读出。实验在荧光显微蛋白图像和六类 Fashion-MNIST 上显示,该 scaling 能增强 logit 分离与梯度、降低随机初始化下的训练不稳定,并提升分类准确率。

Training-Free Semantic Correction for Autoregressive Visual Models Figure 1
2026-06-23cs.CV

Training-Free Semantic Correction for Autoregressive Visual Models

Junhao Chen, Chanyu Zhu, Zheqi Lv, Keting Yin, Shengyu Zhang

Zhejiang University, 2Shandong University, Code is available at https://github.com/June-Hall/

2026-06-23视觉感知

这篇论文针对自回归视觉模型按尺度逐步生成时,早期语义错误难以及时发现且会沿后续尺度累积的问题,提出无需训练的 GAZER:在中间尺度生成可读的 rollout 预览,用多模态大模型诊断偏离,再回退到前一尺度并按增强/抑制线索重采样修正轨迹。实验显示,该方法在图像与视频组合生成基准上提升了多种 AVM 的语义对齐和组合准确性,但主要适用于 next-scale 模型及可从中间语义证据识别的错误。

Venice-H1: Failure-Aware Query Re-Ranking with Multi-Scale Grid Signatures for Referring Image Segmentation Figure 1
2026-06-23cs.CV

Venice-H1: Failure-Aware Query Re-Ranking with Multi-Scale Grid Signatures for Referring Image Segmentation

Nicolò Savioli

2026-06-23视觉感知

本文关注指代表达图像分割中多候选掩码“选错查询”的瓶颈:默认置信度排序虽多数有效,但少量失败样本贡献大量误差。Venice-H1用4×4/8×8/16×16多尺度网格签名刻画掩码形状与边界,并以带Failure Gate的Transformer仅在疑似失败时重排。结果显示在DeRIS-L/B的16个分割-骨干组合上失败子集mIoU均稳定提升,医疗零样本也有小幅收益,但全量mIoU增益很有限。

MAPS: Multi-Anchor Projection Similarity for Joint Vision-Language Geo-Localization Figure 1
2026-06-23cs.CV

MAPS: Multi-Anchor Projection Similarity for Joint Vision-Language Geo-Localization

Yutong Hu, Siyuan Tan, Shaocheng Yan, Pengcheng Shi, Qingwu Hu, Jiayuan Li

determining ground position when GNSS is unavailable or, ayuan Li are with the School of Remote Sensing and Information Engineering

2026-06-23视觉语言视觉感知

针对机器人或移动智能体在 GNSS 不可靠时需要同时利用视觉观测与语言线索定位的问题,论文指出传统余弦式点对点对齐会割裂图像与文本的互补约束,提出 UniMAG 与 MAPS,将两种查询特征构成锚平面,并用候选位置到该子空间的投影及方向约束进行检索和对比学习。在 CORE 与 CVG-Text 上,该方法较成对对齐持续提升定位准确率,且额外计算开销较小。

PolicyTrim: Boosting Intrinsic Policy Efficiency of Vision-Language-Action Models Figure 1
2026-06-23cs.CV

PolicyTrim: Boosting Intrinsic Policy Efficiency of Vision-Language-Action Models

Xianghui Wang, Feng Chen, Wenbo Zhang, Hua Yan, Zixuan Wang, Changsheng Li, Yinjie Lei

2026-06-23视觉语言视觉感知强化学习

本文关注VLA机器人部署中被忽视的“策略效率”瓶颈:不仅推理慢,动作块尾部预测不可靠还会导致频繁重规划和冗余物理动作。PolicyTrim用两阶段强化学习后训练,先通过动态执行窗口奖励更长且成功的动作块,再用步数节省奖励与稳定正则压缩多余动作,无需改架构或额外示教。实验覆盖3个基准和3类VLA,动作块利用率提升3倍,物理步数减少51.4%,端到端最高加速5.83倍且成功率基本不降。

NegAS: Negative Label Guided Attention and Scoring for Out-of-Distribution Object Detection with Vision-Language Models Figure 1
2026-06-23cs.CV

NegAS: Negative Label Guided Attention and Scoring for Out-of-Distribution Object Detection with Vision-Language Models

Yingjie Zhang, Shuai Li, Peng Wang

NegAS: Negative Label Guided Attention and, Northwestern Polytechnical University, Xi’An, China, ground with ID labels but treats background uniformly, leaving potential, and (ii) their sigmoid-based multi-label outputs are incom-, tive Label Guided Attention and Scoring (NegAS). To address (i), we, propose a negative label guided attention module (NegA), where LLM-, generated, visually-similar but semantically-different negative labels are, (NegS) that leverages both ID and negative labels, producing strong, · Negative Label Guided Attention and Scoring, MCM [22], GL-MCM [24], NegLabel [12], EOE [2], emphasizes developing im-, Negative label guided Attention (NegA) module that uses curated negative la-, that contradict ID labels or resemble OOD labels. Besides, we design an LLM-

2026-06-23视觉语言视觉感知

本文针对视觉语言检测器在安全场景中遇到未知类别时易把 OOD 目标误判为已知类的问题,指出其 ID 文本注意力忽略潜在 OOD 背景、且 sigmoid 输出不适配传统 softmax OOD 分数。NegAS 用 LLM 生成的负标签引导背景注意力,并设计结合 ID/负标签的 sigmoid 打分;在 YOLO-World 与 Grounding DINO 上均提升 OOD 检测,COCO、OpenImages 的 FPR95 分别较基线降低 11.4% 和 25.5%,且基本保持 ID 精度。

Trajectory Forcing: Structure-First Generation with Controllable Semantic Trajectories Figure 1
2026-06-23cs.CV

Trajectory Forcing: Structure-First Generation with Controllable Semantic Trajectories

Merve Kocabas, Gege Gao, Bernhard Schölkopf, Andreas Geiger

with Controllable Semantic Trajectories, University of Tübingen, Tübingen, Germany, Max Planck Institute for Intelligent Systems, Tübingen, Germany, ELLIS Institute, Tübingen, Germany, Tübingen AI Center, Tübingen, Germany, images, yet their controllability remains largely endpoint-centric: users, measure structural consistency and local controllability beyond endpoint, controllable, trajectory-aware image synthesis.

2026-06-23规划控制

这篇论文针对扩散/flow 生成过程只控制终点、难以干预中间语义路径的问题,提出 Trajectory Forcing:用 DINOv2 特征聚类构造从布局到物体、部件、细节的层级轨迹,并在每层训练层级条件的一步 flow matching,使中间状态可解码、检查和局部编辑。实验在 ImageNet 类条件生成上显示其质量接近常规模型、FID 收敛较快,同时提供更好的结构一致性和跨层编辑能力。

Projection-Volume Fidelity Divergence: Diagnosing and Controlling Optimization Drift in Sparse-View 3D Gaussian Tomography Figure 1
2026-06-23cs.CV

Projection-Volume Fidelity Divergence: Diagnosing and Controlling Optimization Drift in Sparse-View 3D Gaussian Tomography

Yikuang Yuluo, Ao Wang, Shen Kuan, Yujie Liu, Wang Liao, Ying Chen, Shuangyang Zhong, Yixing Huang, Fuquan Wang

Chongqing University, Chongqing, China, Peking University Health Science Center, Beijing, China, evaluation [8, 9, 5]. When only sparse views are available due to dose, time, safety, or acquisition

2026-06-23规划控制优化算法三维

论文针对稀疏视角3D Gaussian CT中“投影越拟合、体重建反而变差”的优化漂移问题,提出PVFD诊断,并用GAI、VCS刻画高斯退化和体密度脆弱性。其LADES通过早期线性退火dropout抑制视角共适应,并按高斯增长饱和停止致密化;实验显示体保真度提升、结构退化减少且训练时间降低,同时保持投影精度。

The Scissors Effect: When Resize-Based Input Diversity Helps or Hurts Transfer Attacks Figure 1
2026-06-23cs.LG

The Scissors Effect: When Resize-Based Input Diversity Helps or Hurts Transfer Attacks

Yuhang Jiang, Xiaojing Chen

University of Trento, Anhui University

2026-06-23视觉感知

论文针对迁移攻击中“输入多样性默认有益”的惯例,发现其效果取决于替代模型的鲁棒性:随机缩放填充对标准模型可提升迁移,却会削弱鲁棒模型,形成“剪刀效应”。作者将原因定位到缩放导致的梯度对齐恶化,并用局部梯度一致性 LGC 判断何时关闭 DI;ImageNet 上盲目启用 DI 使鲁棒源平均攻击成功率下降 10.3%,而 CG-DI 可避免主要损失。

Biological Sex Determination in Cadavers Using Deep Learning Algorithms from Computed Tomography Images of Pelvis and Skull Figure 1
2026-06-23cs.CV

Biological Sex Determination in Cadavers Using Deep Learning Algorithms from Computed Tomography Images of Pelvis and Skull

Giovanna Herculano Tormena, Davi Nascimento Araújo, Germano Coimbra Soares de Carvalho, Gustavo Bruno Centenaro, Rafael Janowski Pozzer, Rodrigo Akira Azevedo Kurosawa, Danilo Aires Alves, Filipe Thiago Xavier de Campos, Pedro Henrique Macedo dos Santos, Pedro Augusto Prado Mota, Ricardo V. Godoy, João Manoel Herrera Pinheiro, Marcelo Becker

São Carlos School of Engineering, University of São Paulo, São Carlos 13566-590, Brazil, Aristoclides Teixeira Institute of Forensic (IMLAT), Goiânia 74.425-030, Brazil, autopsied cadavers from the Forensic Medical Institute of Goiânia-GO, including a broad age range and, validation across multiple centers and scanners is required to assess the generalizability of the proposed, autopsied at the Medical-Legal Institute of Goiânia-GO. The, logical landmarks such as the glabella, supraorbital margin

2026-06-23视觉感知

针对腐败、创伤或碎片化遗骸中传统目测性别鉴定主观且耗时的问题,论文将尸体骨盆和颅骨 CT 三维重建转为标准化二维投影,比较 YOLO、ConvNeXt、EfficientNetV2、ViT 等迁移学习模型。其关键洞察是骨盆投影判别力更稳定,颅骨仍可补充;在141具单中心尸检样本上最佳模型达到95.65%患者级准确率,但跨设备、跨中心泛化仍文中未充分说明。

Benchmarking Vision-Language Models for Microscopic Plant Image Understanding Figure 1
2026-06-23cs.CV

Benchmarking Vision-Language Models for Microscopic Plant Image Understanding

Tianqi Wei, Xin Yu, Zhi Chen, Scott Chapman, Zi Huang

The University of Queensland, 2Adelaide University, 3University of Southern Queensland, sure accurate and consistent labeling. Compared with exist-, like PlantVillage [37] provide clean, laboratory-collected, and model architectures, which limit scalability and gener-, scalability and generalization.

2026-06-23视觉语言视觉感知数据集/基准

本文针对现有植物VLM评测偏重田间宏观图像、缺少显微层级理解的问题,提出PlantMicro基准,整合5210张植物显微图像和9718个专家校订VQA,覆盖模态、染色、宿主、病原、细胞器、定位与计数等10类任务。实验显示,GPT-5、Gemini 2.5等在模态识别较强,但在细粒度生物实体、空间定位和计数上明显退化;RAG可带来稳定提升,说明瓶颈主要是植物显微领域知识不足。

FetSelect: Task-Specific Architectures and Self-Supervised Learning for Automated Fetal Ultrasound Frame Selection Figure 1
2026-06-23cs.CV

FetSelect: Task-Specific Architectures and Self-Supervised Learning for Automated Fetal Ultrasound Frame Selection

Mahmood Alzubaidi, Raden Muaz, Uzair Shah, Mohammed Ammar, Khalid Alyafei, Mowafa Househ, Marco Agus

College of Science and Engineering, Hamad Bin Khalifa University, Doha, Qatar, LIST Laboratory Department of Electrical Systems Engineering, University of, available. We introduce FetSelect, a task-specific framework that pairs, combined via learned fusion. We curate 6,486 expert-labeled frames across, pretraining on 19,019 unlabeled images. On a held-out test set (974, available., unlabeled images, and (ii) a lightweight multi-path head trained on 6,486 multi-

2026-06-23视觉感知

本文针对胎儿超声生物测量前必须人工挑选最佳帧这一上游瓶颈,指出 CRL、NT、鼻骨和标尺的可用帧标准并不相同。FetSelect 将冻结视觉基础模型与任务门控分类头、检测派生质量头及学习融合结合,并用 1.9 万张超声图做 BYOL 自监督适配;在 974 张测试帧上达到平均 AUROC 0.956、质量相关 0.818,外部视频和 CRL 图像也显示任务特异判别能力。

Human and AI collaboration for pulmonary nodule segmentation Figure 1
2026-06-23cs.CV

Human and AI collaboration for pulmonary nodule segmentation

Hongqiao Dong, Wenhao Chi, Ruobing Liang, Xiaokui Yang, Wenhua Liang, Peng Hou, Wenjun Pu, Yipeng Zhao, Ping Chen, Haiping Liu, Jianxing He, Bo Liu

Human and AI collaboration for pulmonary nodule segmentation, State Key Laboratory of Mathematical Sciences, Academy of Mathematics and, Systems Science, Chinese Academy of Sciences, Beijing, China, PET/CT Center, The First Affiliated Hospital of Guangzhou Medical University, Department of Thoracic Surgery and Oncology, The First Affiliated Hospital of, Guangzhou Medical University, Guangzhou, China, Department of Mathematical Science, Tsinghua University, Beijing, China, Yau Mathematical Sciences Center, Tsinghua University, Beijing, China, China State Key Laboratory of Respiratory Disease & National Clinical Research, Centre for Respiratory Disease, Guangzhou, China, School of Mathematical Sciences, University of Chinese Academy of Sciences, National Center for Respiratory Medicine, National Clinical Research Center for

2026-06-23视觉感知

针对肺结节高质量分割标注稀缺、专家人工勾画成本高且单纯依赖自动模型易失效的问题,论文提出基于 SAM 的 Hi-Seg 人在回路流程,让标注者通过正负点击和反馈迭代学习来修正掩膜。其关键洞察是性能提升主要来自人类语义判断与模型快速边界生成的闭环协作,而非一次性提示本身。多中心 CT 验证中平均 Dice 约 85%,优于多种深度模型和 SAM 变体,并可缩短低年资或非医学标注者时间、缩小专家差距。

Physically-guided Image Generation for Multi-Projection Mapping Figure 1
2026-06-23cs.CV

Physically-guided Image Generation for Multi-Projection Mapping

Xingyun Liu, Yuqi Li, Jinhui Xiang, Pinyan Tang, Chong Wang

controllable physically-guided generative multi-projection map-, remains constrained by high time and labor costs. The genera-, Ningbo University, Ningbo, 315211 P.R.China., limits the scalability and widespread deployment of projection, ing user artistic freedom, we propose a unified, Controllable, • We propose a unified, creator-controllable generative

2026-06-23视觉感知

论文针对投影映射中扩散模型生成的理想二维图像难以适配真实三维表面、反射率和多投影仪色域约束的问题,提出 ConPhyG 框架,将内容生成划分为与物体属性协同的模式和通过辐射补偿消除干扰的对抗模式,并引入逐像素色域、深度、边缘等物理先验及有界优化补偿。四投影仪实测结果显示,其在几何对齐、色域利用和语义保真上优于现有方法,并初步扩展到 360 度多视角一致投影。

CVSBench: A Comprehensive Benchmark for Cross-view Spatial Reasoning and Dreaming Figure 1
2026-06-23cs.CV

CVSBench: A Comprehensive Benchmark for Cross-view Spatial Reasoning and Dreaming

Ruixun Liu, Lingyu Zhang, Lanxuan Xue, Kaiyu Li, Bowen Fu, Xiangyong Cao

Faculty of Electronic and Information Engineering, Xi’an Jiaotong University, Ministry of Education Key Laboratory of Intelligent Networks and Network Security

2026-06-23数据集/基准

本文针对现有空间推理基准多局限于简单室内或小视角变化、难以检验VLM跨视角一致性的动机,提出以卫星—街景配对构建CVSBench,覆盖跨视角VQA、定位与grounding等任务,并强调用显式视觉空间表征而非纯文本推理来弥补模型缺口。实验显示主流VLM在剧烈视角变化下仍难保持物体和布局一致;CoT/SFT/RL带来的提升有限,而深度估计与认知地图式3D场景想象能带来更明显增益。

DreamUV: Unwrap Artist-like UV by End-to-End Flow Matching Figure 1
2026-06-23cs.CV

DreamUV: Unwrap Artist-like UV by End-to-End Flow Matching

Quanyuan Ruan, Jiabao Lei, Xingyi Du, Xifeng Gao

South China University of Technology, School of Data Science, The Chinese University of Hong Kong, Shenzhen

2026-06-23生成模型

DreamUV针对传统UV展开只优化几何失真、难以表达艺术家偏好的问题,将UV生成建模为网格条件的Flow Matching,从噪声采样多样化的艺术家式布局,并用边界感知训练和MITL缓解接缝误差与离散采样累积误差。实验显示其边界更直、轴对齐与打包效率更接近专业UV,同时保持较低重叠和可竞争的失真;用户研究也更偏好其结果。

Curvature-aware 3D length estimation of greenhouse cucumbers using RGB-D imaging and cubic spline arc-length integration Figure 1
2026-06-23cs.CV

Curvature-aware 3D length estimation of greenhouse cucumbers using RGB-D imaging and cubic spline arc-length integration

Manveen Kaur, Rajmeet Singh, Saeed Mozaffri, Shahpour Alirezaee

Department of Mechanical Engineering, University of Windsor, Mohamed bin Zayed University of Artificial Intelligence

2026-06-23三维

温室黄瓜按长度分级,人工测量难以支撑采收调度与物流自动化。论文提出 CucumberVision,用 RGB-D、YOLO26/SAM 分割与 3D 中轴三次样条弧长积分来估计弯曲黄瓜长度,并对五类方法做同条件比较;在 48 次采集、7 根黄瓜上,样条中轴法 MAPE 为 4.13%,显著优于 PCA、骨架、关键点等基线,同时指出颜色流内参对齐可避免 12–18% 系统低估。

MMGist: A Comprehensive Multimodal Benchmark for 2027 Figure 1
2026-06-23cs.CV

MMGist: A Comprehensive Multimodal Benchmark for 2027

Wenzhen Yuan, Jiacheng Ruan, Wutao Xiong, Chengping Zhao, Ting Liu, Yuzhuo Fu

2026-06-23视觉语言数据集/基准

针对现有视觉语言基准规模膨胀但题目常缺乏视觉依赖、已饱和或标注异常的问题,MMGist从18个基准的23,250题中用文本消融、跨模型饱和过滤和异常复核筛出7,262题,覆盖七类能力。27个LVLM实验显示,它在保留模型排名一致性(Spearman ρ=0.98)的同时减少69%题量,并将跨模型区分度提升78%,也揭示视觉逻辑仍是当前模型短板。

FlowDec: Temporal Conditional Flow Decorruptor for Robust Continuous Vision-Language Navigation Figure 1
2026-06-23cs.CV

FlowDec: Temporal Conditional Flow Decorruptor for Robust Continuous Vision-Language Navigation

Yufei Zhang, Changhao Chen

The Hong Kong University of Science and Technology (Guangzhou), China

2026-06-23机器人视觉语言视觉感知生成模型安全鲁棒

本文针对连续视觉语言导航中大模型代理默认依赖干净视觉输入、遇到运动模糊/噪声等真实腐蚀会显著失效的问题,提出 FlowDec:用条件流匹配做实时去腐蚀,并结合历史帧混合时序条件与动作质心过滤,使恢复结果更符合导航动作而非单纯追求画质。在 R2R-CE、RxR-CE 六类腐蚀和真实机器人实验中,相对成功率分别提升 25.33% 与 9.38%,且比扩散式 TTA 快 3–8 倍。

Gold Points Sniper: Self-guided Visual Reasoning in VLM for Fine-grained Action Understanding Figure 1
2026-06-23cs.CV

Gold Points Sniper: Self-guided Visual Reasoning in VLM for Fine-grained Action Understanding

Haodi Liu, Xinhang Yang, Kunda Yan, Sen Cui, Zeyu Zhang, Changshui Zhang

assigning predefined labels, and vision-language models (VLMs), ior. For robots to effectively collaborate, assist, and socialize, Beijing National Research Center for Information Science and Tech-, nology (BNRist), Department of Automation, Tsinghua University, Beijing, State Key Laboratory of General Artificial Intelligence, Beijing Institute, [28] with label "person pulls out chair". (a). Action recognition, gives precise but limited labels. (b). VLMs’ outputs are informative, ing predefined action labels [15–18] to visual inputs, as, from coarse video-label matching to fine-grained strategies, and noisy labels. Knowledge distillation methods [6, 7], limited to predefined action labels, hindering fine-grained, by manual labor or proprietary APIs, we bypass these bot-

2026-06-23视觉语言

面向家庭机器人在宽视角、小目标场景中理解人类细粒度动作的需求,论文指出传统开放词表动作识别只给标签、VLM长描述又易幻觉。GPS通过提取动作相关“Gold Points”、选择性自问校验,并用语义蕴含评估事实一致性来训练轻量VLM。基于CAP构建的指令数据实验显示,多种轻量模型在细节丰富度和事实准确性上明显提升,部分接近GPT-4o且幻觉更少。

Multi-cancer detection using a computationally efficient CNN with transfer learning Figure 1
2026-06-23cs.CV

Multi-cancer detection using a computationally efficient CNN with transfer learning

Vasileios E. Papageorgiou, Georgios Petmezas, Dimitrios-Panagiotis Papageorgiou, Leandros Stefanopoulos, Nicos Maglaveras

School of Medicine, Aristotle University of Thessaloniki, Thessaloniki, Greece, Department of Mathematics, Aristotle University of Thessaloniki, Thessaloniki, Greece, Department of Mathematics, National and Kapodistrian University of Athens, Athens, Department of Electrical and Computer Engineering, Northwestern University, Evanston, supervised learning, AI models are trained on labeled data to replicate human expertise, unnaturally and uncontrollably. According to the World Health Organization (WHO)

2026-06-23视觉感知

面向医疗影像中标注数据和算力受限的问题,本文用低复杂度CNN结合跨癌种预训练与只微调分类头,验证轻量模型是否足以迁移到脑MRI、肺/肾CT分类。5折结果显示脑、肺、肾癌准确率分别为90.85%、98.64%、99.92%,微调约20个epoch即可接近从头训练,并优于多种常用预训练骨干;但泛化到更多中心和可解释性仍文中未充分说明。

Curvature-Adaptive Consistency Flow Matching: Autonomous Trajectory Optimization via Reinforcement Learning Figure 1
2026-06-23cs.CV

Curvature-Adaptive Consistency Flow Matching: Autonomous Trajectory Optimization via Reinforcement Learning

Songtao Tian, Guhan Chen, Bohan Li, Jingyi Ma, Zixiong Yu

Tsinghua University

2026-06-23生成模型强化学习规划控制优化算法

本文针对 Flow Matching/扩散模型少步生成中一致性蒸馏仍依赖静态时间采样、难以适应不同轨迹曲率的问题,指出蒸馏难点并非集中在中间步,而是呈边界主导的 U 形分布。其核心做法是用轻量强化学习调度器动态选择高收益子轨迹,并结合 Flow-adapted DMD 与对抗一致性损失。实验称在 FLUX、SDXL 上取得更低 FID 和更好视觉质量,尤其改善极少步生成的结构畸变与高频细节。

Structured Hyperedge Adaptation for Parameter-Efficient Fine-Tuning of Vision Transformers Figure 1
2026-06-23cs.CV

Structured Hyperedge Adaptation for Parameter-Efficient Fine-Tuning of Vision Transformers

Edwin Kwadwo Tenagyei, Lei Wang, Ugochukwu Ejike Akpudo, Jun Zhou, Yongsheng Gao

Griffith University, Nathan QLD 4111, Australia

2026-06-23视觉感知

这篇论文针对 ViT 参数高效微调中适配器按 token 独立更新、忽略图像区域结构关系的问题,提出 HyperAdapter:用原型路由把 patch token 软分配到超边,在超边层聚合、瓶颈适配后再扩散回 token,从而把适配空间从 token 转为结构化群组。实验覆盖 24 个下游视觉任务和多种骨干,在相近参数预算下优于多类 PEFT 基线,结构推理任务增益更明显。

Large Language Model-Assisted Cleaning of Report-Derived Labels in a Large-Scale Chest CT Dataset Figure 1
2026-06-23eess.IV

Large Language Model-Assisted Cleaning of Report-Derived Labels in a Large-Scale Chest CT Dataset

Yosuke Yamagishi, Atsushi Takamatsu, Mototsugu Sato, Tomohiro Kikuchi, Shouhei Hanaoka, Takeharu Yoshikawa, Osamu Abe

Large Language Model–Assisted Cleaning of Report-Derived Labels in a Large-, Division of Radiology and Biomedical Engineering, Graduate School of Medicine, The, University of Tokyo, Tokyo, Japan, Department of Computational Diagnostic Radiology and Preventive Medicine, The, University of Tokyo Hospital, Tokyo, Japan, Department of Radiology, Kanazawa University Hospital, Ishikawa, Japan, Faculty of Medicine, The University of Tokyo, Tokyo, Japan, Department of Radiology, School of Medicine, Jichi Medical University, Tochigi, Japan, Department of Radiology, The University of Tokyo Hospital, Tokyo, Japan, Purpose: To evaluate whether large language model (LLM)–assisted label cleaning can, identify label–report discordance in CT-RATE, a large-scale public chest CT dataset., Microsoft Azure AI Foundry content-safety filtering, leaving 24,434 reports and 439,812 label

2026-06-23数据集/基准

针对公开胸部 CT 数据集 CT-RATE 中报告派生标签可能与原始放射报告不一致、进而影响模型训练和评测的问题,本文用 GPT-5.4 从报告中按 18 类异常重新抽取结构化标签,并结合放射科医师复核与多 LLM 多数投票评估清洗效果。结果显示 GPT-5.4 与原标签总体一致率为 96.4%、κ=0.884,但能发现有临床意义的错配;在抽样不一致案例中,医师更支持 GPT-5.4 标签的比例为 74.2%,淋巴结肿大定向样本达 91.9%,多模型投票在人工参考集上取得最高宏平均 F1 和 κ。

Enhancing Road Safety: An IoT-Based Accident Detection and Prevention Mechanism Figure 1
2026-06-23cs.ET

Enhancing Road Safety: An IoT-Based Accident Detection and Prevention Mechanism

Prabhu Pugalenthi, Pramod Krishnaa Dhanbalan

Prabhu Pugalenthi, MS Computer Science, University of Southern California, Los Angeles, CA, Pramod Krishnaa Dhanbalan, M.Sc. Software Systems, Coimbatore Institute of Technology, Tamil Nadu, India.

2026-06-23视觉感知安全鲁棒

面向超速、酒驾、疲劳驾驶及事故后救援延迟等道路安全问题,论文提出将酒精传感器、摄像头、加速度计、气囊触发按钮、GPS/GSM 与 Blynk 云平台集成到车载 ECU 的 IoT 事故预防与检测系统。其核心在于用多传感器联动实现酒驾阻止、限速/疲劳提醒和碰撞后自动定位告警;小车原型验证了告警流程,疲劳检测 CNN 报告约 91.97% 准确率,但真实道路规模化测试文中未充分说明。

No Figure
2026-06-23cs.CV

Following the Flow: Advection-Consistent Modeling for Event-based Small Object Detection

Wen Guo, Fulong Cai, Wuzhou Quan

2026-06-23视觉感知生成模型

本文针对事件相机小目标响应稀疏、易被噪声打断而难以形成连续轨迹的问题,提出 PACT,将事件演化显式建模为沿局部速度场的平流式特征传输,而非仅做局部时空聚合。其关键洞察是弱目标虽观测间歇但运动连续,噪声难满足同一传输一致性;通过轨迹特征、可微平流算子和重建模块保留弱响应并抑制背景。实验在基准数据集上相较现有方法提升 20.72% IoU 和 15.03% accuracy,计算效率相近。

No Figure
2026-06-23eess.IV

ZeroGVC: Zero-Shot Generative Video Compression with Autoregressive Diffusion Priors

Yixin Gao, Xiaohan Pan, Lin Liu, Xin Li, Zhibo Chen, Qi Tian

University of Science and Technology of China

2026-06-23视觉感知生成模型

针对现有生成式视频压缩多需额外训练、且零样本方案在GOP级多步去噪下延迟较高的问题,ZeroGVC利用预训练自回归扩散先验逐帧重建P帧;关键洞察是用可复现高斯码本的稀疏原子组合和量化系数来压缩并引导少步潜在去噪轨迹,而非传密集残差。实验显示其在超低码率下获得更好的感知重建质量,并可用双向参考减轻误差传播。

Towards Error-Free Long Video Generation Figure 1
2026-06-23cs.CV

Towards Error-Free Long Video Generation

Shuning Chang, Weihua Chen, Jiasheng Tang, Hao Xu, Zeyu Zhang, Hangjie Yuan, Yu Lu, Ruigang Niu, Fan Wang, Bohan Zhuang, Yi Yang

Zhejiang University, due to error accumulation, attribute drift, and the limited availability of

2026-06-23视觉感知

这篇论文针对长视频生成中随时间累积的画质退化、颜色/曝光偏移和身份漂移问题,提出将扩散视频模型与自回归框架结合:片段内保持双向注意力,片段间用因果注意力与KV缓存建模长期上下文,并用基于相关性的片段选择控显存;同时提出T-RFlow,按频率截断整流流以抑制过锐和色偏。实验显示其在分钟级单镜头视频上提升一致性与VBench表现,但具体增益中数据规模与训练细节贡献仍需进一步拆分说明。

ORBIT: Training-Free Multi-Attribute Behavioral Steering via Orthogonal Subspace Rotation Figure 1
2026-06-23cs.CL

ORBIT: Training-Free Multi-Attribute Behavioral Steering via Orthogonal Subspace Rotation

Narges Ghasemi, Amir Ziashahabi, Salman Avestimehr, Jonathan May

Information Sciences Institute, University of Southern California, Department of Electrical and Computer Engineering, University of Southern California

2026-06-23视觉感知

本文针对多属性激活 steering 中向量相加易受范数失衡、方向抵消影响且训练式方法难以动态换属性的问题,提出 ORBIT:先用 SVD 合并各属性 steering 平面为共享正交子空间,再按 token 失配程度门控并在子空间内做保范数旋转。实验在 TraitFactory 与 ToneBank、三类模型上显示,其多属性控制更均衡、成功率更高,并较好保持生成连贯性。

Interest Entanglement: The Hidden Barrier to Blind Super-Resolution Optimization Figure 1
2026-06-23cs.CV

Interest Entanglement: The Hidden Barrier to Blind Super-Resolution Optimization

Junxiong Lin, Xinji Mai, Qianyu Guo, Haoran Wang, Zeng Tao, Xuan Tong, Ivy Pan, Wenqiang Zhang

College of Intelligent Robotics and Advanced Manufacturing, Fudan University, College of Computer Science and Artificial Intelligence, Fudan University, The University of Hong Kong, Shanghai Institute of Virology, Shanghai Jiao Tong University School of Medicine

2026-06-23优化算法

本文针对盲超分中保真度与感知质量难以兼顾的问题,指出回归损失与感知损失在频域关注不同,导致特征层面的“兴趣纠缠”。作者提出 SFR 框架,将不同目标的学习解耦,并用 InfoSqueeze 对共享特征去冗余、对齐空间。五个数据集上的定量、定性和消融实验显示其在 PSNR/SSIM 与 LPIPS 间取得更好折中,但具体增益相对各基线的统计显著性文中未充分说明。

Reliability-Guided Adaptive Ensembling for Robust Test-Time Adaptation Figure 1
2026-06-23cs.LG

Reliability-Guided Adaptive Ensembling for Robust Test-Time Adaptation

Adam Koziak, Yuhong Guo

School of Computer Science, Carleton University, Ottawa, Canada, model online using only unlabeled target-domain test samples [27, 18, 30]. Rep-, resentative methods such as Tent [27], pseudo-label-based adaptation [16], and, harm their own predictions: they can also corrupt the statistics, pseudo-labels, ronments are changing online and source data is unavailable. While adversarial, Code available at https://github.com/AdamKoziak1/RobustTestTimeAdaptation.

2026-06-23安全鲁棒

论文关注测试时自适应在对抗污染在线测试流中会被错误样本持续带偏的问题,提出训练无关的 SAFER 包装器:对每个样本生成随机增强视图,用跨视图特征一致性估计可靠性、丢弃离群视图并加权汇聚预测,同时保留原 TTA 目标。作者在 PACS、VLCS、OfficeHome 的不同 PGD 攻击率下验证,SAFER 可增强多种 TTA 方法的抗攻击稳定性,并基本维持干净数据性能。

Customizing Video Portraits via Identity-ActionDecoupling Figure 1
2026-06-23cs.CV

Customizing Video Portraits via Identity-ActionDecoupling

Junxiong Lin, Haoran Wang, Xinji Mai, Zeng Tao, Xuan Tong, Ivy Pan, Wenqiang Zhang

College of Intelligent Robotics and Advanced Manufacturing, Fudan University, College of Computer Science and Artificial Intelligence, Fudan University, The University of Hong Kong, identity consistency and (2) exhibit rich, controllable expres-, in preserving identity, they overlook controllability of facial, rally fine-grained and controllable dynamic driving of facial, exhibits rich, controllable facial movements and scene varia-

2026-06-23视觉感知

这篇论文针对身份保持文生视频中“保脸”与“表情动作可控”冲突:现有零微调方法把含表情、动作等非身份信息的脸部 embedding 一并注入,易导致动作单调或不听文本。作者提出 IaD,将身份特征与 Facial-Action 特征解耦,并用身份解耦损失和文本对齐损失分别约束身份纯度与动作语义匹配。实验声称在无需针对新身份微调的情况下,相比 ID-Animator、ConsisID 提升身份一致性、文本对齐和视觉真实感,但极端姿态、长视频和多人场景仍未充分解决。

T-IMPACT: A Severity-Aware Benchmark for Contextual Image-Text Manipulation Figure 1
2026-06-23cs.CV

T-IMPACT: A Severity-Aware Benchmark for Contextual Image-Text Manipulation

Gagandeep Singh, Aaditya Yadav, Priyanka Singh

The University of Queensland, labels, and supporting grounding metadata. Starting from a news, Most provide binary authenticity labels, coarse manipulation cate-, severity score and a corresponding coarse low/medium/high label, the low/medium/high labels serve as coarse operating buckets rather, Multi-label detection, Boxes, labels, severity labels, modality and edit-type annotations, and sup-, that multimodal systems still center on truthfulness, support/refute, decisions, or coarse manipulation labels rather than graded impact, labels.

2026-06-23机器人视觉感知数据集/基准

这篇论文针对现有多模态伪造检测多停留在真假或类型标签、难以衡量“改动多大程度改变叙事理解”的问题,提出 T-IMPACT 基准:用语义锚点定位、局部图像编辑与受约束文本改写生成近 9.9 万个新闻图文样本,并提供连续严重度分数、粗粒度等级和 grounding 元数据。实验显示模型能捕捉部分真伪信号,但严重度排序与人类判断仍弱相关,说明上下文影响评估比二分类更难。

EmbodiedUS-FS: Fast Slow Intelligence for Ultrasound Robotics Figure 1
2026-06-23cs.RO

EmbodiedUS-FS: Fast Slow Intelligence for Ultrasound Robotics

Fangzhuo Zhang, Xinyu Wang, Xiao Yang, Jinchang Zhang

2026-06-23机器人

面向真实临床超声机器人中“医生指令需语义规划、扫描执行又需高速闭环适应”的矛盾,论文提出快慢脑分层框架:慢脑结合 API/手册检索、任务图与计划校验生成可执行流程,快脑用图像、位姿/力和患者运动反馈做局部恢复,并加入安全盾与升级机制。实验覆盖规划、动态扰动执行和安全验证,显示任务成功率提升且安全违规减少,但真实临床规模化验证仍有限。

Diffusion Integrated Gradients: Controllable Path Generation for Flexible Feature Attribution Figure 1
2026-06-23cs.LG

Diffusion Integrated Gradients: Controllable Path Generation for Flexible Feature Attribution

Soyeon Kim, Kyowoon Lee, Jaesik Choi

Diffusion Integrated Gradients: Controllable Path, Ajou University, Korea, INEEJI Corp., Korea, controllable Explainable Artificial Intelligence (XAI) methods., controllable guidance (see Sec. 3). (Bottom) Visualization in the image space, where

2026-06-23生成模型规划控制优化算法

本文针对 Integrated Gradients 直线路径在现代 ReLU 网络中易穿越梯度不连续区域、导致归因噪声和失真的问题,提出 DiffIG:用 Stick-Breaking 过程生成路径分布训练扩散模型,并在推理时通过 guided sampling 注入保真度、复杂度等用户约束,生成可控非线性积分路径。实验显示其在定量指标上匹配或优于既有路径归因方法,解释更符合感知且更忠实;但仍依赖固定 baseline,跨模态泛化文中未充分说明。

Specificity- and Calibration-Aware Breast Ultrasound Segmentation via Entropy-Guided Boundary Supervision Figure 1
2026-06-23eess.IV

Specificity- and Calibration-Aware Breast Ultrasound Segmentation via Entropy-Guided Boundary Supervision

Manar Alsaid, Mandip Shrestha, Mohammad Abbas

Department of Computer Science, East Texas A&M University, Texas Woman’s University, and the availability of annotated public datasets. The BUSI, The UDIAT dataset provides multicenter BUS images col-

2026-06-23视觉感知学习理论

本文针对乳腺超声分割中边界模糊导致的轮廓泄漏,以及正常图像中伪病灶高置信误检问题,提出用预测熵和真实边界共同加权的边界监督,使训练更关注模型不确定的病灶边缘,并结合空间温度缩放改善概率校准。在 BUSI 上,病灶图像 Dice 基本不变,但无病灶图像误检由基线的 14/20、标准边界损失的 19/20 降至 5/20,ECE 也由 0.0201 降至 0.0095;结论更偏向提升特异性与校准,而非提升重叠精度。

Towards Accurate and Robust Surveillance Roadside IVD via Trackletized Audio-Visual Reasoning Figure 1
2026-06-23cs.CV

Towards Accurate and Robust Surveillance Roadside IVD via Trackletized Audio-Visual Reasoning

Xiwen Li, Xiaoya Tang, Bodong Zhang, Tolga Tasdizen

Kahlert School of Computing, University of Utah, Scientific Computing and Imaging Institute, University of Utah, Department of Electrical and Computer Engineering, University of Utah, tical and scalable solution for monitoring vehicle idling be-, cues with the last-frame labeling protocol and avoid un-

2026-06-23安全鲁棒

这篇论文针对路侧怠速车辆检测在跨日期、跨地点部署时易依赖背景捷径、音频与单车实例难对齐的问题,提出以车辆轨迹片段为中心的 TAVR:先检测并跟踪车辆,再结合几何约束的音频绑定 MASP 与状态结构化表征 JACE 做逐车判断。实验在原 AVIVD 及新增 AVIVD-LT、AVIVD-M 上均优于既有 IVD、通用音视频模型和音视频 MLLM,显示鲁棒性提升主要来自实例锚定与音频-几何对应。

Efficient Document Tampering Localization with Multi-Level Discrepancy Features and Unified DCT-Quantization Embedding Figure 1
2026-06-23cs.CV

Efficient Document Tampering Localization with Multi-Level Discrepancy Features and Unified DCT-Quantization Embedding

Mohamed Dhouib, Ye Zhu, Sonia Vanier, Aymen Shabou

2026-06-23视觉感知

本文针对文档篡改定位在合成训练到真实/跨域场景中泛化差的问题,提出 DiffNet:用多级零和滤波的幅值差异变换压制内容特征、突出不一致线索,并以频率索引感知的 DCT-量化联合嵌入替代较重的频域头。结果显示其在人为篡改与跨域协议上较既有最佳方法约提升 30%,吞吐最高提升 7 倍。

MultiMem: Measuring and Mitigating Memorization in Multi-Modal Contrastive Learninga Figure 1
2026-06-23cs.CV

MultiMem: Measuring and Mitigating Memorization in Multi-Modal Contrastive Learninga

Wenhao Wang, Franziska Boenisch, Michael Backes, Adam Dziedzic

CISPA Helmholtz Center for Information Security, set, which correspond to mislabeled samples in SL [3, 5], example, based on label prediction in SL [5] or augmen-, pattern, rather than SL models which memorize labels [5]., from label-driven to pattern-driven memorization behavior

2026-06-23视觉感知

这篇论文关注多模态对比学习中训练样本被模型“记住”却缺乏统一度量的问题,提出 MultiMem,用留一训练模型对比来衡量任意数量模态的记忆化。实验显示,全模态记忆与单/子模态不同,跨模态语义错配是最强诱因,文本影响最大;针对高记忆样本做训练中增强或训练后剔除微调,可将记忆化降低最高 20%,并提升检索、零样本和下游分类性能。

Delta-Diffusion: Modeling Longitudinal Brain Amyloid-PET Trajectories via Conditional Poisson Diffusion Bridge Figure 1
2026-06-23eess.IV

Delta-Diffusion: Modeling Longitudinal Brain Amyloid-PET Trajectories via Conditional Poisson Diffusion Bridge

Yongheng Sun, Minhui Yu, Mengqi Wu, Maureen Kohi, Mingxia Liu

University of North Carolina at Chapel Hill

2026-06-23生成模型

针对纵向淀粉样蛋白 PET 随访昂贵、辐射累积且生成模型易复制基线或身份漂移的问题,本文将预测未来 PET 重写为锚定基线扫描的条件泊松扩散桥,并结合 DiT、随访间隔/MRI 调制和 VOI 加权损失以刻画细微进展。在 542 名受试者的 PIB/AV45 两队列上,方法较 SOTA 更能捕捉淀粉样沉积的纵向变化。

Multi4D: High-Fidelity Dynamic Gaussian Splatting via Multi-Level Competitive Allocation Figure 1
2026-06-23cs.CV

Multi4D: High-Fidelity Dynamic Gaussian Splatting via Multi-Level Competitive Allocation

Rui Wang, Quentin Lohmeyer, Siyu Tang, Mirko Meboldt

2026-06-23三维

本文针对动态 3D Gaussian Splatting 中“可跟踪的一致运动”和“高保真瞬态细节”难以兼得的问题,提出 Multi4D:让静态结构、持久动态几何和瞬态外观三类高斯在共享渲染与残差驱动优化中竞争分配建模责任。实验显示其在 Technicolor、Neu3D 等动态新视角合成上提升 PSNR 并达到百 FPS 级渲染,同时以更少动态 primitives 支持更快的 4D 分割。

Resolving Multi-Target Association in OFDM-based ISAC via Vision-aided Multi-Modal Learning Figure 1
2026-06-23cs.CV

Resolving Multi-Target Association in OFDM-based ISAC via Vision-aided Multi-Modal Learning

Meng Hua, Chenghong Bian, Deniz Gunduz

(bounding-box coordinates and class labels) with the DDM, against triangular soft labels centered on the ground-truth, M. Hua and D. G¨und¨uz are with the Department of Electrical and Electronic, Engineering, Imperial College London, London SW7 2AZ, U.K. (e-mail:, C. Bian is with the Department of, Electrical and Computer Engineering, Hong Kong University of Science and, soft labels, a variant of label distribution learning, to

2026-06-23视觉感知

针对OFDM-ISAC在多目标场景中仅靠延迟-多普勒图难以完成目标关联、且同一分辨单元内目标不可分的问题,论文引入车载视觉作为辅助模态:用DeepJSCC传输图像,经YOLOv5提取框和类别,再与DDM及几何信息融合估计位置、时延和速度,并用三角软标签KL损失稳定分类训练。Blender车流测试中达到16 cm定位RMSE、10.8 ns时延RMSE和5.5 m/s速度RMSE;去除视觉后定位误差约恶化60倍,说明收益主要来自视觉提供的目标级语义关联。

Dual-Stream EEG Decoding for 3D Visual Perception Figure 1
2026-06-23cs.CV

Dual-Stream EEG Decoding for 3D Visual Perception

Ninon Lizé Masclef, Taisija Demcenko, Antonella Catanzaro, Nataliya Kosmyna

Massachusetts Institute of Technology

2026-06-23三维

针对现有脑解码模型难以从 EEG 中同时区分 3D 物体类别与视角/朝向的问题,论文借鉴腹侧“是什么”和背侧“在哪里/如何”通路,设计双流解码框架,并结合圆形回归与 EEG 条件多视角扩散生成。结果显示模型可在六类物体上达到最高 68% 分类准确率,角度误差约 10–11°,并能从神经信号重建 3D 物体;可解释性分析还提示解码依赖动态的腹侧、背侧与运动相关通道协同,而非单一腹侧主导。

From Convolution to Transformer: A Comparative Study of U-Net Variants for Brain Tumor and Retinal Vessel Segmentation Figure 1
2026-06-23cs.CV

From Convolution to Transformer: A Comparative Study of U-Net Variants for Brain Tumor and Retinal Vessel Segmentation

Khoa Pham, Sindhuja Penchala, Jiacheng Li, Andy Perkins, Noorbakhsh Amiri Golilarz

Mississippi State University, 2The University of Alabama, experts. However, manual segmentation is time consuming, labor

2026-06-23视觉感知

这篇论文针对传统卷积 U-Net 难以建模长程依赖的问题,比较 3D U-Net、Residual U-Net、Attention U-Net、UNETR 与 Swin UNETR 在脑肿瘤和视网膜血管分割中的表现。核心洞察是不同结构偏置适合不同目标:Transformer 更利于全局上下文,残差学习仍有助于细小血管。结果显示 Swin UNETR 在 BraTS 2023 和 DRIVE 上 Dice 分别达 0.8965、0.8078,整体最佳。

No Figure
2026-06-23cs.CV

Improving Reasoning in Vision-Language Models via Perception Verified Self-Training

Sourabh Sharma, Sonam Gupta, Sadbhawna Thakur

Malaviya National Institute of Technology Jaipur

2026-06-23视觉语言视觉感知

这篇论文针对VLM自训练只按答案正确性筛选样本、容易把视觉幻觉和语言捷径写入CoT监督的问题,提出“感知验证”流程:先用caption-reasoning-conclusion模板拆开感知与推理,再用PerceptEval结合图文对齐和OCR无监督验证caption,并按难度进行两阶段课程学习与caption引导重生成。实验称在多个领域和模型上较标准自训练最高提升约16%,主要价值在于用低成本过滤机制提升多模态推理的视觉扎根性。

Failure Analysis in Transition: An Industry Survey of Challenges, Priorities, and Standardization Needs in Advanced Packaging and Heterogeneous Integration Figure 1
2026-06-23cs.SE

Failure Analysis in Transition: An Industry Survey of Challenges, Priorities, and Standardization Needs in Advanced Packaging and Heterogeneous Integration

Himanandhan Reddy Kottur, Nusra Akter Takia, Mahamudul Hassan Fuad, Istiaq Firoz Shiam, Matthew Walsh, Navid Asadizanjani

*Department of Electrical and Computer Engineering, University of Florida, Gainesville, FL, USA, EDA & tool vendors, failure analysis laboratories, interpret them as evidence of a broader shift in the center of, c) Failure analysis laboratories at 16%

2026-06-23视觉感知

面向异构集成、chiplet、混合键合和背面供电使失效机制转向封装界面与系统耦合的趋势,论文通过约百名产业从业者问卷梳理失效分析瓶颈。核心洞察是难点已从单器件定位扩展到样品制备、三维无损成像、跨工具数据贯通与标准化。结果显示69%受访者聚焦异构/3D产品,封装与HI失效分析重要性最高为7.92/10,混合键合最难分析占54%,无损高分辨成像和数据标准化需求最突出。

SAGE: An Expert-Annotated South Asian GI Endoscopy Dataset for Multimodal Learning and Hallucination Analysis Figure 1
2026-06-23cs.CV

SAGE: An Expert-Annotated South Asian GI Endoscopy Dataset for Multimodal Learning and Hallucination Analysis

Niyoj Oli, Sachin Acharya, Sandesh Pokhrel, Sanjay Bhandari, Ramesh Rana, Nikesh Mani Shrestha, Ram Bahadur Gurung, Yash Raj Shrestha, Prashnna K Gyawali, Binod Bhattarai

Nepal Applied Mathematics and Informatics Institute for Research, Nepal, GastroIntestinal Department, Dhulikhel Hospital, Nepal, University of West Virginia, USA, University of Utah, USA, University of Aberdeen, UK, technical expertise to perform diagnosis. However, almost all open-source, publicly available datasets are predominantly, image captioning, multi-label classification, and visual question answering (VQA) tasks. It consists of 1,300 images, their captions along with hallucination tag, 18 labels and 14,726 question-answer pairs making it well-suited for diverse, population bias in medical AI. The code is publicly available at https://github.com/bhattarailab/SAGE, and the, Table 1: Comparison of publicly available gastrointestinal endoscopy datasets. SAGE is the only dataset collected from, Unlabelled, further extended this landscape with 10,662 labeled images

2026-06-23视觉语言数据集/基准

针对南亚胃肠内镜数据长期缺位、现有模型可能受欧洲数据偏置影响的问题,SAGE提供尼泊尔采集的1300张专家标注图像,覆盖图像描述、多标签分类、VQA与幻觉标注。基准显示,分类模型迁移到南亚数据平均性能下降58%,多模态大模型在解剖定位和异常检测上的GREEN分数也较低,提示地域分布差异会显著削弱医学AI可靠性。

Feed-forward Motion In-betweening for Any 4D Figure 1
2026-06-23cs.CV

Feed-forward Motion In-betweening for Any 4D

Hiroki Nishizawa, Hubert P. H. Shum, Yoshihiro Fukuhara, Hirokatsu Kataoka, Shigeo Morishima

Waseda University, Durham University, controllability, and short-horizon generation often leads to error accu-, controllability on both DyMesh16 and DyMesh32 benchmarks., introduce new limitations that hinder their use as controllable 4D content creation

2026-06-23视觉感知

这篇论文针对任意拓扑4D网格生成中推理慢、文本控制不足和长序列漂移的问题,提出CompletionAny4D:用参考网格锚定形状/拓扑,借助逐帧mesh VAE把关键帧注入潜空间,再用关键帧条件rectified flow补全中间帧。实验在DyMesh16/32上显示其相比现有前馈4D生成具备更好的可控性,并可在短序列训练下生成更长、时空一致性更强的结果。

Surgical Anatomy Recognition with Context Learning using Foundation Representations Figure 1
2026-06-23cs.CV

Surgical Anatomy Recognition with Context Learning using Foundation Representations

Ronald L. P. D. de Jong, Tim J. M. Jaspers, Raf A. H. Vervoort, Aron F. H. A. Bakker, Yiping Li, Jip L. Tolenaar, Jelle P. Ruurda, Willem M. Brinkman, Josien P. W. Pluim, Marcel Breeuwer, Daan de Geus, Fons van der Sommen

2026-06-23视觉感知

针对微创手术中解剖结构识别因标注稀缺、流程差异大而难以泛化的问题,论文同时提出 ATLAS-120k 数据集和 ATLAS 视频分割模型;核心做法是在外科基础模型表征上加入手术类型、阶段与短期时序记忆等上下文查询。实验显示其在 AP、mDice 与视频一致性上优于多类自然图像和内窥镜预训练基线,并可在 H100 上达到 64 FPS,但部分增益可能主要来自数据规模与域内预训练。

Accurate identification and measurement of the precipitate area by two-stage deep neural networks in novel chromium-based alloys Figure 1
2026-06-23cs.CV

Accurate identification and measurement of the precipitate area by two-stage deep neural networks in novel chromium-based alloys

Zeyu Xia, Kan Ma, Sibo Cheng, Thomas Blackburn, Ziling Peng, Kewei Zhu, Weihang Zhang, Dunhui Xiao, Alexander J Knowles, Rossella Arcucci

2026-06-23视觉感知

针对铬基超合金电镜图像中析出相面积与尺寸分布依赖人工阈值、对噪声和材料差异不鲁棒的问题,论文提出两阶段 DT-SegNet:先用 YOLOv5 高效定位候选析出相,再用 SegFormer 精细分割。实验显示其在准确率、精确率、召回率和 F1 等指标上优于 Weka、ilastik,有助于高通量合金开发中的显微组织测量。

OphthaDT: Generative Digital Twins for Forecasting Visual Acuity Trajectories in Ophthalmology Figure 1
2026-06-23cs.LG

OphthaDT: Generative Digital Twins for Forecasting Visual Acuity Trajectories in Ophthalmology

Pietro Belligoli, Nikita Makarov, Sayedali Shetab Boushehri, Fabian Schmich, Raul Rodriguez-Esteban, Michael Menden

ences Center of Excellence, Roche, Penzberg, Germany 2Technical, University of Munich, Munich, Germany 3Computational Health, Center, Helmholtz Munich, Munich, Germany 4Department of, Biology, Ludwig Maximilian University of Munich, Munich, Germany 5Computational Sciences Center of Excellence, Roche, Basel, Switzerland 6Department of Biochemistry and Pharmacol-, ogy, Bio21 Molecular Science and Biotechnology Institute, The, University of Melbourne, Parkville, Australia. Correspondence to:

2026-06-23生成模型

这篇论文针对眼科精准治疗中多模态、非规则随访数据难以预测长期视力变化的问题,提出 OphthaDT:将 3220 名临床试验患者的病史、检查、治疗等纵向记录序列化为结构化文本,并微调 LLM 预测 BCVA 轨迹。结果显示其在 nAMD 上较基线平均 MAE 降低 6.0%,在 DME 上与强基线相当,提示 LLM 数字孪生的优势主要出现在轨迹更复杂、波动更大的疾病中。

Cross-View Yaw Estimation in Location Uncertainty with Line-Aligning Yaw Scoring Figure 1
2026-06-23cs.CV

Cross-View Yaw Estimation in Location Uncertainty with Line-Aligning Yaw Scoring

Taeho Kang, Nairan Zhang, Yelin Kim, Yujiao Shi, Youngki Lee

Seoul National University, ShanghaiTech University

2026-06-23安全鲁棒

这篇论文针对地面图像与鸟瞰图跨视角定位中,偏航角在位置有噪声、视角未知时难以稳定估计的问题。核心洞察是将地面图像列特征与 BEV 中径向线对齐,利用同一径向方向上候选位置诱导相同 yaw 的不变性,通过三维投票把正确匹配聚成峰值,从而摆脱高度和精确位置假设。在 Mapillary、Ford、KITTI、VIGOR 上,LAYS 在未知 yaw 尤其普通 FoV 场景取得约 28–45 个百分点提升,并可作为下游 3-DoF 定位的 yaw 先验。

BAC-JEPA: Label-Efficient Breast Arterial Calcification Segmentation via Synthetic Mammography-Guided Supervision Figure 1
2026-06-23cs.CV

BAC-JEPA: Label-Efficient Breast Arterial Calcification Segmentation via Synthetic Mammography-Guided Supervision

Scott Chase Waggener, Lakshman Tamil

BAC-JEPA: Label-Efficient Breast Arterial, Department of Computer Engineering, University of Texas at Dallas, We present BAC-JEPA, a label-efficient segmentation frame-, labeled BacSeg synthetic two-dimensional mammograms derived, commonly relies on clinical and laboratory variables rather, positive labels using morphology- and physics-informed rules, evaluation on corrected labels [6]., These challenges motivate label-efficient approaches that, labeled images with scalable exact masks for dense BAC, nal validation on the public human-labeled BacSeg dataset, independent human-labeled synthetic two-dimensional mam-

2026-06-23视觉感知

这篇论文针对乳腺动脉钙化分割中像素级标注昂贵、且BAC形态细长易与高亮伪影混淆的问题,提出用真实乳腺X线背景合成带精确掩码的BAC,并结合JEPA预训练ViT与高分辨率解码器训练分割模型。结果显示ViT-B在合成验证集IoU为0.5325、Dice为0.6357,在BacSeg上由分割概率图做图像级判别AUROC达0.8719;但真实乳腺片的像素级临床验证仍未完成,泛化能力仍需专家标注校准。

Morphology-Aware Multimodal Representation Learning for Insect Phylogenetic Reconstruction Figure 1
2026-06-23cs.CV

Morphology-Aware Multimodal Representation Learning for Insect Phylogenetic Reconstruction

Zixuan Liu, Kaijie Yu, Chun He, Xiaoxu Cai, Xinhai Ye, Haishuai Wang, Gongyin Ye, Jiajun Bu

incomplete, unavailable, or difficult to obtain [2]. It also, Key Lab of Accessible Perception and Intelligent Systems, Zhejiang, Kaijie Yu, Chun He, Gongyin Ye are with the State Key Laboratory of, Laboratory of Molecular Biology of Crop Pathogens and Insects, Institute of, Insect Sciences, Zhejiang University, Hangzhou 310058, China., Xiaoxu Cai is with the Rural Development Academy, Zhejiang University, Xinhai Ye is with the College of Advanced Agriculture Science, Zhejiang, A&F University, Hangzhou 311300, China., The source code, data, and implementation details are publicly available at, morphological matrices are labor-intensive and can vary with, Image-derived morphological traits provide a scalable

2026-06-23视觉语言三维

这篇论文针对昆虫系统发育中人工形态编码难扩展、纯视觉特征缺少形态语义约束的问题,提出将标本图像与整理后的属级形态描述对齐:用 LoRA 和监督对比学习适配自监督 ViT,再把图像嵌入作为连续性状用于贝叶斯建树。Rove-Tree-11 上,多骨干和消融结果显示图文对齐比原始或仅图像微调特征更接近参考树,注意力分析也显示模型更关注形态相关区域。

Learning Cross-View Semantic Priors for Single-Reference Unseen Object Pose Estimation Figure 1
2026-06-23cs.CV

Learning Cross-View Semantic Priors for Single-Reference Unseen Object Pose Estimation

Jiahong Chen, Jinghao Wang, Ziwen Wang, Zi Wang, Banglei Guan, Qifeng Yu

will be available at chenjiahongbq.github.io/LCVSP., of National University of Defense Technology under Grant ZK24-31, and, and Qifeng Yu are with the College of Aerospace Science and Engi-, neering, National University of Defense Technology, Changsha 410073, China, and also with the Hunan Provincial Key Laboratory of Im-, available as the reference. A common solution is to follow a

2026-06-23三维

这篇论文面向单参考视角下的未知物体6D位姿估计,动机是现有方法把VFM特征当作各视角独立描述子,难以应对大视角差和噪声掩码。核心做法是在几何解码前引入跨视角语义交互,并用IVSP保持token结构、RAGC约束3D一致性。实验在六个基准和困难视角配对协议上达到SOTA且速度相近。

A Controlled Study of CLIP-Based Body-Scene Fusion for Emotion Recognition in Context Figure 1
2026-06-23cs.CV

A Controlled Study of CLIP-Based Body-Scene Fusion for Emotion Recognition in Context

Zubair Abbas, Muhammad Umair, Muqaddas Hameed

Department of Computer Science, University of Central Punjab, Lahore, Pakistan, the full image. The fused feature predicts 26 categorical emotion labels and the continuous valence, arousal, and dominance values., the next step should focus on label relationships and finer subject-context interaction., Index Terms—Emotion recognition, affective computing, EMOTIC, context-aware recognition, CLIP, multi-label classification., categories as the main weakness, motivating label-, expression is weak or unavailable [9].

2026-06-23视觉感知规划控制

本文针对自然图像中面部不可见或表情中性时情绪识别依赖身体姿态与场景语义的问题,构建ResNet-18人体裁剪分支与CLIP ViT-B/16全图场景分支的轻量双流模型,并在同一流程下检验简化去偏、反事实和稀有类训练策略。结果显示干净基线在EMOTIC测试集达到34.52% mAP,所有附加变体均未提升,说明CLIP已提供较强全局语义,后续瓶颈更可能在标签关系和细粒度主体-场景交互。

When Does a Video-Language Model Stop Watching? Reward Strength Controls the Formation and Reversal of Visual Shortcuts in Multimodal RLVR Figure 1
2026-06-23cs.AI

When Does a Video-Language Model Stop Watching? Reward Strength Controls the Formation and Reversal of Visual Shortcuts in Multimodal RLVR

Zekun Xu

2026-06-23视觉语言视觉感知强化学习规划控制

本文关注多模态 RLVR 中视频语言模型为优化结果奖励而“停止看视频”、转向语言先验的视觉捷径问题。作者把 grounding penalty 强度 λ 作为可控变量,并用扰动式 VHS 指标沿训练过程追踪捷径形成与逆转。结果显示,捷径会在窄训练窗口内突发且跨随机种子稳定;增大 λ 可单调压低捷径平台,中等强度会先形成再逆转;惩罚必须在形成前或临界期介入,事后补救效果明显较弱。

IDAG-Edit: Multi-Object Video Editing via Instance-Decoupled Attention and Guidance Figure 1
2026-06-23cs.CV

IDAG-Edit: Multi-Object Video Editing via Instance-Decoupled Attention and Guidance

Yuan-Zhih Lin, Huu-Thang Nguyen, Huu-Phu Do, Hong-Han Shuai, Ching-Chun Huang

Department of Computer Science, National Yang Ming Chiao Tung University, Taiwan, improves temporal stability and multi-object controllability, multi-object controllability.

2026-06-23视觉感知

针对扩散式视频编辑在多对象场景中易出现注意力泄漏、属性纠缠、身份漂移和时间闪烁的问题,IDAG-Edit在无需训练的框架中引入布局引导交叉注意力、实例级时空解耦引导和实例解耦自注意力,用掩码将各对象的语义、运动与特征交互分开约束。实验显示其相较VideoDirector、VideoGrain等方法提升了多对象可控性和时间稳定性。

Topological summaries of fingerprint ridge patterns carry identity information Figure 1
2026-06-23cs.CV

Topological summaries of fingerprint ridge patterns carry identity information

Chad M. Topaz, Niny Arcila-Maya, Elizabeth Munch, Zofia Stanley, Lori Ziegelmeier

aWilliams College, Williamstown, MA 01267, bQSIDE Institute, Williamstown, MA 01267, cUniversity of Colorado Boulder, Boulder, CO 80309, dSan Francisco State University, San Francisco, CA 94132, eMichigan State University, East Lansing, MI 48824, fMacalester College, Saint Paul, MN 55105

2026-06-23视觉感知

论文针对指纹验证过度依赖细节点提取、骨架化和专有匹配流程的问题,改用拓扑数据分析直接概括脊线/谷线整体形状:在距离变换场上计算持久同调,用多尺度环结构表征身份信息。FVC2000 DB1 上,简单拓扑摘要已明显优于像素几何基线,学习模型 AUC 达 0.91;局部最优传输在低误接受率下更强,二者融合在严格 FAR 阈值下表现最佳,说明拓扑特征可作为细节点系统的透明补充。

One-Shot Data Selection for Medical Image Classification via Graph Coverage Figure 1
2026-06-23cs.CV

One-Shot Data Selection for Medical Image Classification via Graph Coverage

Zahiriddin Rustamov, Nadia Badawi, Rafat Damseh, Nazar Zaki

Department of Computer Science and Software Engineering, United Arab Emirates, University, Al Ain, United Arab Emirates, Department of Computer Science, KU Leuven, Leuven, Belgium, equally, yet acquiring expert labels is expensive. Active learning reduces, training during selection. Code is available at https://github.com/, label, but which samples to label., the most informative unlabeled samples are selected, and an expert annotates, The availability of foundation models pretrained on large-scale medical image

2026-06-23视觉感知

针对医学图像标注昂贵、主动学习需多轮训练和反复专家介入的问题,论文提出在冻结基础模型嵌入上构建全局 kNN 图,用一阶与二阶邻接近似热扩散覆盖核,再以带类别预算的贪心 facility location 一次性选样。核心洞察是局部图结构比完整谱扩散更关键,且跨类别全局图能捕捉边界信息。五个 MedMNIST 数据集上,该方法在 10 个数据集-比例设置中的 9 个取得最高 balanced accuracy,类不均衡场景增益更明显。

From Driving Videos to Simulatable Scenarios Figure 1
2026-06-23cs.SE

From Driving Videos to Simulatable Scenarios

Alexandre Levy, Ernest Valveny Llobet, Antonio Manuel López

it is crucial to reproduce these scenarios in a controllable, repeatable, and scalable manner, with simulation playing a, in a controllable and scalable manner is needed. Thus, Computer Vision Center (CVC), UAB, language [2], chosen for its open-source availability, high-, metrics and human judgment through elaborated surveys on

2026-06-23视觉感知

面向自动驾驶安全评测中“从真实事件到可重复仿真场景”依赖人工编程、成本高的问题,论文提出 D-V2S:先用带提示的 VLM 将行车视频解析为可编辑的自然语言场景描述,再由上下文约束的 LLM 生成 SCENIC/CARLA 可执行场景。实验显示生成场景平均保留约 90% 相关语义元素,DRA 中 GPT-4o 明显优于 LLaVA/Qwen-VL,SG 相比 LCTGen、ChatScene 获得 0.93 的语义保持分和 75% 人类偏好,但增益可能部分来自模型 scaling。

CoDMD: Copula-aware Distribution Matching Distillation for Fast Video Generation Figure 1
2026-06-23cs.CV

CoDMD: Copula-aware Distribution Matching Distillation for Fast Video Generation

Wenhu Zhang, Kun Cheng, Changyuan Wang, Shiyao Li, Yuechen Zhang, Wenbo Li, Jiajun Zha, Jingyi Zhang, Kang Zhao, Jiaya Jia

2026-06-23视觉感知

该文针对视频扩散模型少步蒸馏中 DMD 在 4 步预算下易出现布局不稳、过饱和和运动崩塌的问题,指出其只匹配样本内分布、缺少对帧间与样本间 copula 关系约束。CoDMD 复用教师和在线模型已有 score,构造批间与帧间关系矩阵并对齐,无需额外网络或采样轨迹。在 Wan-2.1-T2V 1.3B/14B 上将 50 步蒸馏为 4 步,约 25 倍加速,VBench 达 84.46/84.87,优于 DMD 与 rCM。

Integrating Facial Generation into Full-Duplex Spoken Dialogue Systems Figure 1
2026-06-23cs.HC

Integrating Facial Generation into Full-Duplex Spoken Dialogue Systems

Jingjing Jiang, Atsumoto Ohashi, Ryuichiro Higashinaka

Graduate School of Informatics, Nagoya University, Japan

2026-06-23视觉感知

该文针对全双工语音对话虽低延迟却缺少面对面交流中表情、唇动和头动的问题,提出 Moshi-Face:用 VQ-VAE 将 3D 面部运动离散为与音频同频率的 face tokens,并在 Moshi 中加入非自回归 Face Transformer 同步生成语音与面部运动。基于 180 小时视听对话数据的实验显示,其能在低延迟下保持较好音画对齐,同时基本保留原音频模型的对话质量;但真实感仍缺少人工评价验证。

No Figure
2026-06-23cs.CV

Look Before You Zoom: Adaptive Routing for the Resolution-Context Trade-off in Visual RAG

Oanh N. Tran, Thanh Quoc Hung Le, Oscar Chew, Kuan-Hao Huang, Khoa D. Doan

VinUni-Illinois Smart Health Center, VinUniversity, Texas A&M University

2026-06-23视觉感知

本文针对视觉问答中“小目标需放大、但盲目裁剪会破坏大目标上下文且增加延迟”的矛盾,提出 ViRGo 将视觉检索改写为自适应路由问题:利用 VLM 初次前向中的定位头、语义置信度和图像尺度,选择全局感知、注意力裁剪或 patch 检索。实验显示其在多类 VQA 和不同骨干上改善准确率—效率权衡,小目标接近检索方法,大目标更多保留上下文并减少不必要计算。

Denoising-Enhanced Coarse-to-Fine Infrared Small Target Detection with Attention Prior-Guided Knowledge Distillation Figure 1
2026-06-23cs.CV

Denoising-Enhanced Coarse-to-Fine Infrared Small Target Detection with Attention Prior-Guided Knowledge Distillation

Houzhang Fang, Ruixuan Huang, Qiuhuan Chen, Xiaolin Wang, Yi Chang, Luxin Yan

Xidian University, Xi’an, China, Huazhong University of Science and Technology, Wuhan, China

2026-06-23视觉感知

这篇论文针对高分辨率红外小目标检测中目标弱、背景干扰强且全图计算冗余的问题,提出 ECFNet:先用网格化多尺度区域二分类筛出含上下文的候选区,并通过带噪 GT 掩码重建训练提升抗背景干扰能力;再在局部候选区上用轻量检测器,并以教师-学生交叉注意力先验做知识蒸馏。实验在三个真实红外数据集上优于单阶段和两阶段方法,同时保持较高实时效率。

CapRiCorn-1K: A Comprehensive Benchmark for Video Captioning and Subject Referential Consistency Across Temporal Scales Figure 1
2026-06-23cs.CV

CapRiCorn-1K: A Comprehensive Benchmark for Video Captioning and Subject Referential Consistency Across Temporal Scales

Xinlong Chen, Jiafu Tang, Yue Ding, Yizhuo Jia, Bozhou Li, Bohan Zeng, Yang Shi, Shihao Li, Yiyan Ji, Qiang Liu, Weihong Lin, Yuanxing Zhang, Pengfei Wan, Liang Wang, Tieniu Tan

2026-06-23视觉语言视觉感知数据集/基准

现有视频字幕基准多偏短、场景单一且少有转场,难以暴露长视频中同一主体指代漂移对理解与生成任务的影响。CapRiCorn-1K收集1000个含动态转场、最长600秒的视频,并同时评估字幕质量与主体指代一致性,支持视听和纯视觉设置。实验显示当前模型在准确、完整描述和保持主体一致方面仍明显不足,且视频越长性能下降越明显;其指标还与下游智能体理解和视频重建表现强相关。

ScalePredictor: Instance-aware Scale Learning for Accurate Quantization of Vision Transformers Figure 1
2026-06-23cs.CV

ScalePredictor: Instance-aware Scale Learning for Accurate Quantization of Vision Transformers

Changjun Li, Runqing Jiang, Lian Xu, Ye Zhang, Qingyong Hu, Yulan Guo

2026-06-23视觉感知

这篇论文针对ViT在边缘部署中PTQ静态量化忽略样本间激活差异、动态量化又需逐层运行时归约的问题,提出ScalePredictor。核心洞察是浅层patch embedding的稳健激活范围与深层最优量化scale存在相关性,因此用一次范围提取加Taylor启发的多项式投影预测全层实例级scale。ImageNet实验显示其在多种量化设置下优于既有PTQ,并以很小额外开销获得更好的精度—效率权衡。

Artic-O: End-to-End Articulated Object Reconstruction via Latent Geometry Learning Figure 1
2026-06-23cs.CV

Artic-O: End-to-End Articulated Object Reconstruction via Latent Geometry Learning

Xuyang Wang, Zhenyu Li, Jian Ding, Habib Slim, Peter Wonka, Hongdong Li, Mohamed Elhoseiny

XUYANG WANG∗, Australian National University and KAUST, HONGDONG LI, Australian National University, limit geometric fidelity, scalability, or adherence to the input im-, towards scalable image-based articulated object reconstruction by, cability when only sparse images are available. Image-conditioned

2026-06-23三维

针对稀疏多状态图像重建铰接物体时几何、部件与运动参数分阶段估计导致不一致且推理慢的问题,Artic-O 将观测映射到预训练冻结的几何潜空间,并结合图像特征做部件分割与关节预测,端到端生成可动画资产。在 PartNet-Mobility 上较 LARM 降低 CD、F-score 提至 95.4%,运动范围准确率升至 93.5%,推理从约 9 分钟降至 0.32 秒。

CoSA: Correlation-Guided Change Attention with Learnable Residual Gating for Remote Sensing Change Detection Figure 1
2026-06-23cs.CV

CoSA: Correlation-Guided Change Attention with Learnable Residual Gating for Remote Sensing Change Detection

Abdirashid Omar, Jonghyuk Park

Department of Data Science, Graduate School of Kookmin University, under sparse changes, noisy labels, and appearance variations. In this paper, we propose Context Sampling

2026-06-23视觉感知

针对遥感双时相变化检测中稀疏变化易被噪声、光照和配准误差干扰的问题,CoSA将同位置双时相特征相关性显式转为变化门控,在1/8与1/16解码尺度用可学习残差注入强化低相关区域,而不引入全局注意力开销。在LEVIR-CD、S2Looking、DSIFN和CLCD上,changed-class F1相对受控基线提升约1.5–2.6个百分点,消融显示多尺度放置和残差scaling是主要贡献。

GTA-Net: Cooperative Game Theory for Vision-Language Alignment in Chest X-Ray Report Generation Figure 1
2026-06-23cs.CV

GTA-Net: Cooperative Game Theory for Vision-Language Alignment in Chest X-Ray Report Generation

Saif ur Rehman Khan, Imad Ahmed Waqar, Sebastian Vollmer, Muhammad Nabeel Asim

Department of Computer Science, Rhineland-Palatinate Technical University of, German Research Center for Artificial Intelligence (DFKI), Kaiserslautern 67663, Department of Core Informatics, Graduate School of Informatics ,Osaka, Metropolitan University, Saka, 599-8531, Japan

2026-06-23视觉语言视觉感知学习理论

本文针对胸片报告生成中视觉区域、文本词语与疾病语义常靠隐式注意力耦合、缺乏可解释对齐的问题,提出 GTA-Net,将跨模态对齐建模为合作博弈:用二元博弈刻画区域—词对齐,并用疾病感知三元对齐约束图像、报告和14类疾病概念的一致性,结合 Swin 与 LoRA 微调的 LLaMA 端到端训练。在 CheXpertPlus 和 IU-XRay 上,文中报告其在常规生成指标和临床一致性上达到或超过现有方法,但具体增益有多少来自博弈对齐而非骨干模型或数据规模仍需看消融细节。

Rethinking the Adaptation of Vision Foundation Models for Efficient Cell Segmentation Figure 1
2026-06-23cs.CV

Rethinking the Adaptation of Vision Foundation Models for Efficient Cell Segmentation

Qing Xu, Xiangjian He, Wenting Duan, Jiebo Luo, Zhen Chen

2026-06-23视觉感知

针对细胞分割中视觉基础模型适配依赖重训大编码器、标注和算力成本高的问题,论文提出 EffiCell-Seg:冻结 VFM,利用其 CLS 全局显著性与空间 token 局部形态先验,经 CSP-Encoder 生成结构提示,并由 SM-Decoder 联合预测距离场和语义图。实验称其在多种细胞成像模态上优于现有方法,仅约 5M 可训练参数,比全量微调少 130 倍以上。

Fidelity- and Perception-Aware Local Implicit Attention for Arbitrary-Scale Image Super-Resolution Figure 1
2026-06-23cs.CV

Fidelity- and Perception-Aware Local Implicit Attention for Arbitrary-Scale Image Super-Resolution

Yu-Syuan Xu, Hao-Lun Sun, Hao-Wei Chen, Hsien-Kai Kuo, Chun-Yi Lee

National Taiwan University, MediaTek Inc.

2026-06-23视觉感知

本文针对任意尺度超分中回归方法保真但平滑、扩散方法逼真却易幻觉的矛盾,提出 FPLIA:用 FPAM 在保真特征与感知特征间做自注意力和非对称交叉注意力,再由 FPSM结合内容与倍率逐像素选择候选表示。实验覆盖多数据集和整数/非整数倍率,显示其在保持重建精度的同时提升感知质量,并处于保真度-感知质量帕累托前沿。

Mesh2GS: White-Box 3DGS Construction via Plenoptic Sampling Figure 1
2026-06-23cs.GR

Mesh2GS: White-Box 3DGS Construction via Plenoptic Sampling

Haoran Zhu, Youcheng Cai, Huangsheng Du, Jingyang Meng, Ligang Liu

University of Science and Technology of China

2026-06-23三维

Mesh2GS关注从已有网格直接构建3D Gaussian以缓存全局光照,动机是替代依赖试错的网格绑定式3DGS方案并服务实时多用户渲染。其核心是用全光采样理论推导视角最低采样率和高斯分布,并结合反照率-阴影分解更新与NIE模块处理高光等非朗伯效应。实验称其在质量和实时共享渲染中优于启发式基线,但代码尚待发布,具体泛化边界仍需进一步验证。

AgroSense 2.0: Cross-Modal Transformer Fusion with Geospatial Raster Integration and Interpretable Multi-Task Learning for Precision Crop Recommendation Figure 1
2026-06-23cs.LG

AgroSense 2.0: Cross-Modal Transformer Fusion with Geospatial Raster Integration and Interpretable Multi-Task Learning for Precision Crop Recommendation

Vishal Pandey, Rishav Tewari, Ruzina Haque Laskar

Centre for Development of Telematics, trees [4, 5]. While effective on clean, laboratory-sourced data, these approaches are fundamentally limited by their

2026-06-23视觉感知

本文针对作物推荐中视觉土壤、养分表格与空间分布割裂的问题,提出 AgroSense 2.0:引入覆盖印度的七波段土壤栅格补充地理上下文,用跨模态 Transformer 让养分特征注意图像表示,并以多任务学习联合土壤分类和作物推荐。结果展示了 TreeSHAP 揭示的作物条件敏感性,如降雨和 pH 全局最重要、咖啡受钾和温度驱动;但相对基线的定量增益文中片段未充分说明。

Prompt-Calibrated SAM 3 for Open-Vocabulary Remote Sensing Semantic Segmentation Figure 1
2026-06-23cs.CV

Prompt-Calibrated SAM 3 for Open-Vocabulary Remote Sensing Semantic Segmentation

Yanghui Song, Nanqing Liu, Haonan Yin, Yingjie Gao, Chengfu Yang, Qi Ming

label space. Recent SAM 3-based methods provide a promising, available at https://github.com/YanghuiSong/ProC-SAM3., School, Information Science and Technology, Yunnan Normal University, Kunming, Science and Engineering, Beihang University, Beijing, China., Science, Beijing University of Technology, Beijing, China., wise semantic labels ˆY

2026-06-23视觉感知

本文针对遥感开放词汇语义分割中 SAM 3 依赖单一类名提示、扩展提示带来重复编码、以及多提示融合易引入噪声的问题,提出 ProC-SAM3:用多模态大模型离线生成并约束提示池,缓存文本嵌入,并以存在性与置信度门控残差融合保留小目标响应。在 8 个基准上平均 mIoU 达 56.1%,较此前最佳训练自由方法提升 3.9 个百分点。

Zero-Shot Vision-Language Models for Classroom Engagement Recognition: A Benchmark Study of Prompt Sensitivity and Cross-Dataset Generalization Figure 1
2026-06-23cs.CV

Zero-Shot Vision-Language Models for Classroom Engagement Recognition: A Benchmark Study of Prompt Sensitivity and Cross-Dataset Generalization

Aman Goyal, Kshama Nitin Shah, Kemmannu Vineet Venkatesh Rao

Carnegie Mellon University, University of Michigan, Ann Arbor

2026-06-23视觉语言视觉感知学习理论数据集/基准

论文关注课堂参与度自动识别中,零样本视觉语言模型是否可直接替代人工观察这一问题。作者在 DAiSEE 个体视频帧与 SCB 场景图像上系统比较 CLIP、BLIP、GPT-4o、LLaVA、Qwen,并把提示词敏感性作为基准维度。结果显示个体级识别近随机、κ≤0.10且常发生类别坍缩;场景级更可行,CLIP/GPT-4o 在行为化 rubric 下 κ约0.60,但提示改写可导致最高32个百分点波动,部署可靠性仍不足。

Beyond Flat Labels: Level-Restricted Contrastive Learning for Hierarchical Fine-Grained Vision Classification Figure 1
2026-06-23cs.CV

Beyond Flat Labels: Level-Restricted Contrastive Learning for Hierarchical Fine-Grained Vision Classification

Zhiyuan Tao, Srikumar Sastry, Matthew J Thompson, Elizabeth G Campolongo, Net Zhang, Ziheng Zhang, Hilmar Lapp, Yu Su, Tanya Berger-Wolf, Nathan Jacobs, Wei-Lun Chao, Jianyang Gu

Beyond Flat Labels: Level-Restricted Contrastive Learning for, The Ohio State University, Washington University in St. Louis, Boston University, However, in hierarchically structured label spaces, exist-, its simultaneously predicted higher-level label. By analysis, the issue originates from false negative labels when con-, That is, the predicted fine-grained label does not belong to, CLIP-style contrastive learning adopts a flat-label assump-, tion and treats all non-matching text labels as equal nega-, tives [19]. When applied to label spaces with hierarchical, false negatives. While treating ancestor–descendant labels

2026-06-23视觉感知

这篇论文针对 CLIP 式对比学习在层级细粒度分类中把不同层级的相关标签误当负样本、导致上下位预测不一致的问题,提出只在同一分类层级内做对比,并用组均衡监督避免训练偏向粗层级。基于 BioCLIP 和 TreeOfLife-10M 微调后,在 iNat21 等生物分类基准上同时提升层级一致性与准确率,iNat21 跨层级平均准确率较基线提升约 30.47%。

RAPID: A Reproducible Multi-Agent Pipeline for Interpretable Disaster Damage Assessment from Satellite and Street-View Imagery Figure 1
2026-06-23cs.CV

RAPID: A Reproducible Multi-Agent Pipeline for Interpretable Disaster Damage Assessment from Satellite and Street-View Imagery

Yifan Yang, Wenjing Gong, Kaili Zhang, Lei Zou, Zhengzhong Tu, Hao Li, Zongrong Li, Xinyue Ye

Texas A&M University, National University of Singapore, The University of Alabama, Texas A&M University College Station Texas USA, National University of Singapore Singapore Singapore, The University of Alabama Tuscaloosa Alabama USA

2026-06-23视觉感知

面向灾后快速评估中标注昂贵、跨灾种泛化弱和单一视角信息不足的问题,RAPID将卫星与街景图像接入由灾害感知、图像恢复、损伤识别和地理推理组成的多智能体流程,在无需任务微调下输出可解释损伤等级与处置建议。实验覆盖飓风、洪水、山火和地震,多灾种分类准确率达0.92,跨视角损伤严重度预测最高为0.627,但相对传统监督模型的增益来源仍需进一步拆解。

Rotation-Aware Point-Cloud Embeddings for Vision-Based In-Hand Reorientation Figure 1
2026-06-23cs.RO

Rotation-Aware Point-Cloud Embeddings for Vision-Based In-Hand Reorientation

Yashom Dighe, Karthik Dantu

University at Buffalo

2026-06-23视觉感知

论文针对手内重定向中点云目标难以直接用于控制的问题:原始点集受无序采样、遮挡和对应不稳定影响,使当前—目标差异不等同于旋转误差。核心做法是用度量学习训练旋转感知点云编码器,使潜空间欧氏距离对齐 SO(3) 测地误差,再供 PPO 策略比较当前与目标点云。实验显示其无需显式位姿、配准、稠密 flow 或教师动作监督,性能接近特权状态和蒸馏基线;但仍主要在仿真和单物体策略设定下验证。

Motion-Aware Reinforcement Learning For Object Localization Figure 1
2026-06-23cs.CV

Motion-Aware Reinforcement Learning For Object Localization

Prithvi Raj Singh, Satyendra Singh

McNeese State University, Louisiana Tech University

2026-06-23强化学习

本文针对检测器一次性框回归难以修正定位误差的问题,把目标框细化建模为PPO序列决策,并在状态中加入恒速运动先验、在奖励中加入动作平滑惩罚。关键洞察是运动惩罚与绝对IoU奖励会导致触发器坍塌,而平滑动作可稳定训练;同时共享骨干的crop特征细化存在表示上限。实验在VOC和VisDrone上主要提升SR@0.5,最高分别约+0.011和+0.007,但mAP未超过原检测器。

From Gradient Clipping to Structural Refinement: Improving DPSGD for Medical Image Segmentation Figure 1
2026-06-23cs.CV

From Gradient Clipping to Structural Refinement: Improving DPSGD for Medical Image Segmentation

Shiva Parsarad, Parth Shandilya, Isabel Wagner

University of Basel

2026-06-23视觉感知优化算法

这篇论文针对医学分割中DPSGD因梯度裁剪与加噪导致效用下降的问题,系统比较Auto-S、NSGD、PSAC在二分类与多分类分割中的表现,并分析梯度对齐,指出分类任务中的假设尤其是PSAC优势并不稳定迁移。作者进一步将裁剪策略与DP-Morph形态学细化结合,提出按类别自适应的结构修正,在OCT与CT数据上使隐私约束下分割质量提升,Dice约有1–2%增益。

Scaling up fine-grained intracranial vessel annotations in computed tomography angiography Figure 1
2026-06-23eess.IV

Scaling up fine-grained intracranial vessel annotations in computed tomography angiography

Chu-Hsuan Lin, Alberto Mario Ceballos-Arroyo, Jisoo Kim, Shrikanth M. Yadav, Huaizu Jiang, Lei Qin, Geoffrey S. Young

Harvard Medical School, \addr Khoury College of Computer Sciences, Northeastern University, \addr Washington University in St. Louis, \addr Dana-Farber Cancer Institute

2026-06-23视觉感知

针对CTA中颅内血管精细标注成本高、既有数据多忽略远端小血管且偏向MRA的问题,本文构建SemanticVessel,利用4D-CTA多期相对动静脉的天然区分,通过区域生长、专家细化和跨期复用扩大标注,并将未细分小动脉设为通用动脉类。实验显示,显式处理未标注血管和加入通用动脉监督可提升细粒度分割,左右坐标信息也带来明显增益。

Scene-Level Heterogeneous Physics Simulation with 3D Gaussian Splats Figure 1
2026-06-23cs.GR

Scene-Level Heterogeneous Physics Simulation with 3D Gaussian Splats

Xiaoyang Liu, Shangzhe Wu, Kai Han

The University of Hong Kong, University of Cambridge

2026-06-23三维

这篇论文针对 3D Gaussian Splatting 资产只能高保真渲染、难以进入真实物理引擎交互的问题,提出表示抽象框架:把 3DGS、网格、流体和静态场景边界统一转成物理粒子/碰撞表示,再将仿真结果映射回各自视觉表示。结果展示了软体 3DGS 与流体、网格及复杂捕获场景的双向耦合,并接入 UE5 渲染;但定量评测和鲁棒性细节文中未充分说明。

Configurable Algorithms for Histopathologic Cancer Detection on Quantum Hardware Figure 1
2026-06-23eess.IV

Configurable Algorithms for Histopathologic Cancer Detection on Quantum Hardware

Nandika Goyal, Glen Uehara, Andreas Spanias

SenSIP Center, School of ECEE, Arizona State University, is further complicated by limited labeled data and image, and statevector readout is not available on hardware. Hybrid

2026-06-23视觉感知

本文针对病理癌症图像中染色差异、组织形态细微且现有量子边缘检测难以落到真实 QPU 的问题,提出局部 Ry 编码的双梯度 SWAP/破坏式 SWAP 等价电路,用 shot 测量生成边缘图,并配合读出校正、偏置扣除和斜率回归降噪。方法在五个量子处理器上验证,跨平台相关约 0.93–0.94,单像素 MSE 降约 8 倍,PCam 单 ResNet-50 准确率 79.80%,Lite 版提速 17 倍但损失 2.59% 准确率。

Quantile Adaptive Temperature Scaling for Confidence Calibration Figure 1
2026-06-23cs.CV

Quantile Adaptive Temperature Scaling for Confidence Calibration

Omprakash Chakraborty, Leo Fillioux, Ismail Ben Ayed, Jose Dolz

2026-06-23视觉感知

这篇论文针对深度模型置信度校准中过度自信且误差在不同置信度区间分布不均的问题,指出全局温度缩放难以修正这种异质性。其核心是按经验置信度分位数学习单调的样本级温度函数,在分位空间重参数化 ECE,从而有针对性地软化或锐化预测且不改变类别结果。实验覆盖视觉、医学、文本、分割、长尾与分布偏移场景,显示 QaTS 相比多种后验校准方法更稳定地降低校准误差。

Adversarial Domain Prompt Tuning and Generation for Single Domain Generalization Figure 1
2026-06-23cs.CV

Adversarial Domain Prompt Tuning and Generation for Single Domain Generalization

Zhipeng Xu, De Cheng, Xinyang Jiang, Nannan Wang, Dongsheng Li, Xinbo Gao

Xidian University, 2Microsoft Research Asia, 3Chongqing University of Posts and Telecommunications, mains while there is only one single domain available for, proaches. Code is available in the supplementary materials., SDG aims to train a model on a labeled source domain, are usually unseen/out-of-distribution and unavailable dur-

2026-06-23学习理论

针对单源域训练难以覆盖未知域、手写扩散模型提示又难以描述抽象风格的问题,论文提出 PAPT:为文本到图像扩散模型分别学习类别不变提示和域风格提示,并通过渐进对抗训练维护域提示池,在扩大生成域多样性的同时保留类别语义。实验称其在多个主流单域泛化数据集上优于现有方法,但具体增益可能部分来自预训练 T2I 模型带来的生成数据能力。

HPP: Hierarchical Programmatic Probing for Long Video Understanding by Decoupling Perception and Reasoning Figure 1
2026-06-23cs.CV

HPP: Hierarchical Programmatic Probing for Long Video Understanding by Decoupling Perception and Reasoning

Awais Rauf, Ahmed Hasssan, Greg Slabaugh

Queen’s University Belfast, Greg Slabaugh, Queen Mary University of London

2026-06-23视觉感知

这篇论文针对长视频中感知信息稀疏、时序推理跨度长,而单次前向的VLM容易把感知与规划混在潜空间中处理的问题,提出HPP:让具备编码能力的LLM在REPL中按层级视频结构编程式搜索、采样和调用小型VLM做局部感知。核心洞察是将语义感知与高阶推理解耦,并用信息密度分段、后期交互检索和结构化探针降低长视频探索成本。实验在LongVideoBench、EgoSchema、VideoMME和MLVU上显示明显提升,且更强感知模型和更强编码LLM都能带来收益。

Adaptive Beam Selection for Efficient Scanning Probe Tomography Figure 1
2026-06-23cs.CV

Adaptive Beam Selection for Efficient Scanning Probe Tomography

San Dinh, Zichao Wendy Di, Matt Menickelly

Mathematics and Computer Science Division, Argonne National Laboratory, Lemont, IL, 60439, USA, reconstructing the sample based on available measurements., conventional laboratory Computed Tomography systems., This work was supported in part by the U.S. Department of Energy, Of-, distances from the center outside this interval do not intersect

2026-06-23视觉感知

针对同步辐射扫描探针断层成像中全角度采集耗时、剂量高且易损伤样品的问题,本文把自适应设计从“选角度后整行扫描”推进到同时选择角度与束位置。核心做法是在 sinogram 上用高斯过程估计未测束值和不确定性,并结合边缘对齐启发式构造采集函数,绕过中间重建以降低计算和重建误差影响。数值实验显示,在相同测量数下相比均匀采样可获得更好重建质量,但独立束定位的硬件开销仍待解决。

Structural Assessment for Understanding and Guiding Dataset Distillation in Discrete Token Space Figure 1
2026-06-23cs.CV

Structural Assessment for Understanding and Guiding Dataset Distillation in Discrete Token Space

Yue Cao, Jianyang Gu, Vyacheslav Kungurtsev, Yu Hu, Jozsef Hamari, Zheng Liu, Mohsen Zardadi

The University of British Columbia, The Ohio State University, Czech Technical University in Prague

2026-06-23数据集/基准

本文针对数据集蒸馏中“相似原数据却不一定好用”的问题,提出用离散视觉 tokenizer 分析语义 token 组合,而非只看连续分布匹配。核心是由 JSD、HHI、覆盖率构成免训练 structural score,发现 token 使用更均衡与验证精度更相关,并据此选择锚点指导扩散式蒸馏。实验显示该分数能预测 ImageWoof/ImageNette 等替代集质量,在 EuroSAT 上保持相对排序,TGDD 在 ImageWoof 上较强基线提升 5.4%。

VT-DUDA: Visual Token Conditioning for Diffusion-guided Unsupervised Domain Adaptation Figure 1
2026-06-23cs.CV

VT-DUDA: Visual Token Conditioning for Diffusion-guided Unsupervised Domain Adaptation

Xuan Qi, Daniele Berardini, Dario Serez, Vito Paolo Pastore, Vittorio Murino

DITEN, University of Genoa, MaLGa, DIBRIS, University of Genoa, Department of Computer Science, University of Verona, beled source data and unlabeled target data under distribution shift. Recent diffusion-based, UDA methods approach this problem by synthesizing labeled target-style images and train-, style data. The project page is available at https://xuanqi99.github.io/VT-DUDA/., Unsupervised domain adaptation (UDA) aims to learn a target-domain classifier from labeled source data, and unlabeled target data under distribution shift. Classical UDA methods address this problem primarily, directly, they adapt a generative model to synthesize labeled target-style images and then train a classifier, text signal. That is, on the source side, multiple labeled source images from the same class are typically, target labels are unavailable, the text condition may be reduced to a generic prompt such as “an image.”, On the source side, the visual tokens are paired with class prompts, so that different labeled source instances

2026-06-23生成模型

这篇论文针对扩散式无监督域适应中过度依赖类别文本提示、缺少实例级约束的问题,提出将源/目标图像编码为视觉 token,并与文本嵌入拼接进潜在扩散模型的 cross-attention,在不改动骨干和扩散目标的前提下生成更有用的目标风格训练样本。实验在 Office-31、Office-Home 和 VisDA-2017 上相较判别式与扩散式基线提升平均目标域分类准确率,并显示 token 选择、强度调节及 DDIM 翻译组合可带来额外收益。

No Figure
2026-06-23cs.CV

Enlight: Fast Low-Light Image Enhancement via Multi-Objective Optimization and Shadow-Aware Refinement

Nirjhor Datta, M. Sohel Rahman

2026-06-23视觉感知优化算法

低照度图像增强常在亮度提升、结构保真与噪声放大之间失衡,且深度方法依赖训练数据、可解释性较弱。ENLIGHT将增强转为少量亮度、对比度、伽马参数的多目标推理时优化,并加入由全局到局部的阴影感知细化,兼顾暗区提亮与过曝抑制。在BAID、Backlit300、LIME等数据集上,其MUSIQ、NIQE、BRISQUE感知质量具竞争力,推理显著更快,Ultrafast约0.10–0.23秒/图,但目标函数和阈值选择仍偏经验。

UnityShots: Memory-Driven Multi-Shot Audio-Video Generation with Boundary-Aware Gating Figure 1
2026-06-23cs.CV

UnityShots: Memory-Driven Multi-Shot Audio-Video Generation with Boundary-Aware Gating

Jiehui Huang, Yuechen Zhang, Bin Xia, Jiahao Wang, Xu He, Zhenchao Tang, Meng Chu, Xin Tao, Pengfei Wan, Jiaya Jia

The Hong Kong University of Science and Technology, The Chinese University of Hong Kong, Tsinghua University, Sun Yat-sen University

2026-06-23视觉感知学习理论

该文针对多镜头音视频生成中人物外观、场景与说话人音色跨剪辑易漂移、长序列上下文成本高的问题,提出 UnityShots:用固定大小的长短期视频记忆槽分别锚定首镜头与前一镜头尾部,并以视觉切换概率和音乐节拍共同驱动边界门控,同时用说话人参考 token 保持音色。实验在 I2V/T2V/R2V 与多文化 200 序列基准上显示,其跨镜头一致性整体优于开源基线,并在多镜头指标上接近最强闭源系统。

Chehre: An Emoji-Prompted Video Dataset for Perceptually Diverse Facial Expression Recognition Figure 1
2026-06-23cs.CV

Chehre: An Emoji-Prompted Video Dataset for Perceptually Diverse Facial Expression Recognition

Bita Azari, Zoe Stanley, Avneet Batra, Poorvi Bhatia, Hali Kil, Manolis Savva, Angelica Lim

Simon Fraser University, Canada, and label annotations, resulting in 2,111 high, cover the top human-rated labels, and distri-, percentage of annotators who selected each label as top-, from the candidate set of labels for each video., many benchmarks assume a single definitive label, human perception, both in selecting the top labels, cannot accurately predict the top two labels

2026-06-23视觉感知数据集/基准

现有表情识别基准多依赖静态图像、基础情绪和单一标签,难以评估具身智能对动态非语言信号及人类感知分歧的理解。Chehre 用 40 个 emoji 诱发表情视频,并通过人脸重演匿名化,构建含 203 名表演者、902 名标注者的分布式标注数据集,提出主导表情与分布式表情识别两项任务。实验显示当前 VLM 表现有限,最佳 Top-1 仅 32.5%,且远未复现人类响应分布。

PaaF: Raising the perceived quality of INR-Based Image Compression Figure 1
2026-06-23eess.IV

PaaF: Raising the perceived quality of INR-Based Image Compression

Lorenzo Catania, Dario Allegra

• Availability of the codec as open-source. The full, ciency and computational scalability.

2026-06-23视觉感知

这篇论文针对纯 INR 图像压缩编码慢、PSNR 与感知质量落后于成熟 codec 的问题,提出 PaaF:将图像表示为坐标到颜色的函数,并结合 YCbCr/均值位移、指数式网络配置、细粒度自适应量化搜索和熵编码打包来改善率失真。实验称其相对既有 INR 压缩方法在定量指标与视觉伪影上都有稳定提升,但主要比较限定在 INR 系列内,与传统/学习式 codec 的整体差距仍文中未充分说明。

A DVDrive Approach for doScenes Instructed Driving Challenge Figure 1
2026-06-23cs.CV

A DVDrive Approach for doScenes Instructed Driving Challenge

Zijian Fu, Xiangyang Chu, Mengshi Qi, Huadong Ma, Guanghao Zhang, Wei Li

Team MIC Lab, Beijing University of Posts and Telecommunications, 2 Xiaomi EV, code is publicly available at: https://github.com/, ego-vehicle planning, the future intention is often available

2026-06-23视觉感知

本文面向 doScenes 中“按自然语言指令预测自车未来轨迹”的需求,动机是减少仅依赖视觉和历史运动时的意图歧义。方法在 OmniDrive 上加入指令条件训练,将监督扩展到 6 秒 12 个路点,并引入 DVDrive 分视角感知,用局部可见性注意力降低跨视角干扰。论文称该设计有助于语言与局部驾驶证据对齐,但未给出充分可核验的量化结果,实际增益来源仍不清。

Cross-Modal Corroboration for Annotation-Free Wildlife Monitoring Figure 1
2026-06-23cs.CV

Cross-Modal Corroboration for Annotation-Free Wildlife Monitoring

Bharath Pillai, Varun Viswapriyan, Christopher Stewart, Tanya Berger-Wolf, Jenna Kline

The Ohio State University

2026-06-23视觉感知

这篇论文针对濒危野生动物监测中标注稀缺、人工评估昂贵的问题,提出用视觉与声学两条独立管线得到的小时活动曲线,并与既有动物行为学先验相互印证,作为免标注可靠性信号。方法结合 BioCLIP 2 零样本相机陷阱识别、SAHI 小目标检测、几何定位和微调声学分类器;在麋鹿数据上,两种模态均恢复出与已知昼夜活动规律一致的模式,但绝对定位精度和更广泛物种泛化仍文中未充分说明。

CurvSegFlow: Time-Conditioned Flow Matching for Robust Segmentation of Curvilinear Structures in Noisy Biomedical Images Figure 1
2026-06-23cs.CV

CurvSegFlow: Time-Conditioned Flow Matching for Robust Segmentation of Curvilinear Structures in Noisy Biomedical Images

Sidi Mohamed Sid'El Moctar, Achraf Ait Laydi, Alexandre Beber, Marcus Braun, Zdenek Lansky, Yousef El Mourabit, Helene Bouvrais

aCNRS, Univ. Rennes, Institute of Genetics and Development of Rennes (IGDR), Rennes, France, bTIAD Laboratory, Sciences and Technology Faculty, Sultan Moulay Slimane Univ, Beni Mellal, Morocco, cInstitute of Biotechnology, Czech Academy of Sciences, Vestec, Czech Republic

2026-06-23视觉感知生成模型安全鲁棒

针对显微、眼底等生物医学图像中细长曲线结构易受噪声、低对比度和断裂影响的问题,CurvSegFlow将分割从一次性掩码预测改为时间条件的流匹配迭代细化,用U-Net、时间嵌入和三项损失学习从噪声初始化到目标掩码的速度场。实验覆盖微管、视网膜血管、角膜神经和冠脉数据,结果显示在低信噪比下精度与结构连续性更稳,且无需改架构即可跨模态泛化。

T-MOR: Learning Motion-Aware Skeleton Representations for Human Action Recognition Figure 1
2026-06-23cs.CV

T-MOR: Learning Motion-Aware Skeleton Representations for Human Action Recognition

Di Yang, Mahmoud Ali, Quan Kong, Gianpiero Francesca, Francois Bremond

Suzhou Institute for Advanced Research, University of Science and Technology of China, Suzhou, China, Inria Center at Universit´e Cˆote d’Azur, Valbonne, France, tions are fine-grained, temporally dense, and multi-label, their, Action Labels, ing action label. ViCLIP [11] is a general video foundation

2026-06-23视觉感知

这篇论文针对视觉语言模型偏重外观语义、缺少显式人体运动建模的问题,提出 T-MOR:以骨架序列为推理输入,在预训练中用视频和文本嵌入作语义锚点,并加入聚类引导的多模态对比学习来提升可迁移的运动表征。作者还构建 PoseCap-1M 三元组数据集;在 Toyota Smarthome、UAV-Human、Penn Action、TSU、Charades 等分类和帧级检测任务上均有提升,并展示少样本、零样本泛化能力。

$μ$Match: Foundation Models for Semi-supervised Learning and Domain Adaptation in EM Figure 1
2026-06-23cs.CV

$μ$Match: Foundation Models for Semi-supervised Learning and Domain Adaptation in EM

Marei Freitag, Olesia Korchevaia, Luca Freckmann, Anwai Archit, Constantin Pape

Life and Medical Sciences Institute (LIMES), University of Bonn, Germany, Institute of Computer Science, Georg-August-University Göttingen, Germany, tation tasks, particularly across different organelles, and the limited availability, Fig. 1: µMatch overview: a) we study SSL, training on data with a small labeled, part (green box), and DA, pre-training on a labeled source followed by training on, the unlabeled (UDA) or partially labeled (SSDA) target. The student teacher uses, loss Lsup on labeled samples. We implement three different methods: Mean Teacher, comprehensive foundation model for organelles remains unavailable and would

2026-06-23视觉感知

这篇论文针对电镜分割高度依赖像素级标注、基础模型在 EM 中尚未系统落地的问题,提出 µMatch,将 SAM/µSAM/DINO 等初始化与 Mean Teacher、FixMatch、UniMatch v2 等学生—教师式半监督和域适应方法统一评测于细胞核、线粒体、神经突分割。结果显示 SAM 系初始化显著提升监督训练,半监督学习在多数任务稳定优于强基线;Mean Teacher 更稳健,UniMatch v2 在资源充足时常更优,而 DINO 与大域迁移下的 UDA/SSDA收益有限。

Deep Unrolled Networks in Representation Space Applied to MRI Reconstruction Figure 1
2026-06-23eess.IV

Deep Unrolled Networks in Representation Space Applied to MRI Reconstruction

Efe Ilıcak, Baris Imre, Chloé Najac, Ruben van den Broek, Beatrice Lena, Andrew Webb, Marius Staring

Department of Radiology, Leiden University Medical Center, Leiden, Netherlands, quisitions. The code will be available upon publication at https://

2026-06-23三维

这篇论文针对传统深度展开网络在图像域反复压缩特征、而已有表示空间方法又用启发式数据一致性导致物理测量约束变弱的问题,提出 DUNE:用链式法则和 VJP 将测量残差精确反传到特征/潜空间,并使编码器仅用于初始化,从而可接入预训练模型。在低场单通道和临床多通道 MRI 重建中,DUNE 相比图像域、启发式表示空间及若干基线获得更高 PSNR、SSIM 和 HaarPSI,说明主要收益来自更精确的数据一致性梯度与表示空间优化。

$ϕ$-Scene: Physically Grounded Image-to-3D Scene Reconstruction Figure 1
2026-06-23cs.CV

$ϕ$-Scene: Physically Grounded Image-to-3D Scene Reconstruction

Haodong Li, Lulu Shao, Haolin Lu, Yu Fu, Yen-Ru Chen, Seemandhar Jain, Manmohan Chandraker

HAODONG LI, University of California San Diego, USA, LULU SHAO, University of California San Diego, USA, HAOLIN LU, University of California San Diego, USA, YU FU, University of California San Diego, USA, YEN-RU CHEN, University of California San Diego, USA, SEEMANDHAR JAIN, University of California San Diego, USA, MANMOHAN CHANDRAKER, University of California San Diego, USA, explicitly optimized. 𝜙-Scene instead places physical grounding at the center of 3D scene reconstruction by formulating it as a physics-aware assembly process:, ucsd.edu, University of California San Diego, USA, University of California San Diego, USA, ucsd.edu, University of California San Diego, USA., grounding at the center of image-to-3D scene reconstruction: it

2026-06-23视觉感知三维

本文针对单图到组合三维场景重建中常见的物体悬空、穿透和接触不稳定问题,提出将场景视为受支撑关系约束的物理系统。ϕ-Scene 先用三维基础模型恢复物体与初始姿态,再按推断的支撑拓扑逐个通过 SDF 去穿透和刚体仿真沉降。实验显示其在 3D-Front 上优于其他域外方法,并在人工/VLM评价及静态接触、动态漂移指标上显著提升物理合理性。

Boundary-by-Mask: Few-Shot Instance Segmentation with Mask-Conditioned Boundary Learning for Texture-Poor Industrial Parts Figure 1
2026-06-23cs.CV

Boundary-by-Mask: Few-Shot Instance Segmentation with Mask-Conditioned Boundary Learning for Texture-Poor Industrial Parts

Yutaka Yoshinaga, Naoya Chiba, Koichi Hashimoto

Yutaka Yoshinaga is with the Graduate School of Information Sciences, Tohoku University, Sendai, Japan.

2026-06-23视觉感知学习理论

这篇论文面向工业零件少样本实例分割:纹理弱、上下文少且“实例”定义随装配或检测任务变化,使通用分割模型和外观匹配式 FSIS 不可靠。核心做法是用参考 RGB-mask 条件化目标定义,在冻结基础编码器特征上训练轻量像素 MLP 预测 SDF 边界,再由 SDF 重建掩码,从内部外观转向轮廓监督。实验显示在工业件和边界模糊食品上具备较稳的低样本泛化、边界分离和粒度切换能力,但真实产线杂乱、遮挡和光照下的有效性文中仍未充分说明。

Radial Basis Function Networks as Projection Heads in Self-Supervised Learning Figure 1
2026-06-23cs.CV

Radial Basis Function Networks as Projection Heads in Self-Supervised Learning

Andreas Schliebitz, Heiko Tapken, Martin Atzmueller

Osnabrück University of Applied Sciences, Osnabrück University, Semantic Information Systems Group, German Research Center for Artificial Intelligence (DFKI), bone quality is assessed via costly linear probing on labeled data. We, with a radial basis function network (RBFN), whose interpretable center, without labels or a separate classifier. To this end, we introduce Scale-, Normalized Separation (SNS), a novel label-free quality metric derived, solely from the kernel centers and shapes learned during training. Across, The results of this paper can be reproduced using the code available in the following, sparsely labeled data. Common SSL architectures [8,10,12,13,21] consist of two, model is evaluated by training a linear classifier [10, 21, 34] on the labeled test, without the need for a labeled test split and by extension a linear classifier. The

2026-06-23视觉感知

论文针对自监督视觉学习中投影头训练后被丢弃、骨干质量仍需有标签线性探测评估的浪费问题,提出用可解释的径向基函数网络替代常规 MLP 投影头,并从其学习到的中心与尺度参数构造无标签 SNS 指标。实验覆盖 MoCo、SimCLR、BYOL、SwAV、SimSiam 和四个图像数据集,显示三层 Gaussian RBFN 基本可作为即插即用替代,SNS 与逻辑回归评估强相关,但实际性能增益并非主要结论。

Unsupervised Susceptibility Distortion Correction of EPI without Calibration Scans via Image Translation-Based Registration Figure 1
2026-06-23eess.IV

Unsupervised Susceptibility Distortion Correction of EPI without Calibration Scans via Image Translation-Based Registration

Wooseung Kim, Sung-Hong Park

2026-06-23视觉感知

针对fMRI中EPI易受磁场不均匀影响而产生相位编码方向几何畸变、且许多数据缺少场图或反向PE校准扫描的问题,论文提出SACRED:用T1w与单向PE BOLD,通过可逆网络做解剖到伪BOLD的图像翻译,并以MIND-SSC约束结构一致性,再进行无监督配准和测试时自适应。实验在一个ID和两个OOD数据集上优于多种免校准校正方法,显示对扫描仪和人群分布变化更稳健。

No Figure
2026-06-23cs.CV

The Unreasonable Effectiveness of VLMs for Zero-shot Procedural Mistake Detection

Serdar Ozsoy, Lars Doorenbos, Federico Spurio, Gianpiero Francesca, Juergen Gall

University of Bonn, Lamarr Institute for Machine Learning and Artificial Intelligence

2026-06-23视觉语言视觉感知

这篇论文针对现有流程错误检测依赖监督时序分割、错误判别等多模块训练、难以迁移的问题,提出零样本设定下的 ZeProM:仅用任务说明驱动单个预训练 VLM 同时完成动作分割、错误检测和解释。实验在 EgoPER 与 CaptainCook4D 上显示,其无需训练即可接近甚至超过强监督方法,在 EgoPER 段级错误上平均 EDA 提升 4.4、F1@.5 提升 2.0,说明 VLM 的通用视频推理能力足以替代部分专用管线。

A Smart Classroom Behavior Analysis Framework with a New Highly Congested Classroom Dataset Figure 1
2026-06-23cs.CV

A Smart Classroom Behavior Analysis Framework with a New Highly Congested Classroom Dataset

Wei Xu, Maoxiang Chu, Yuelong Fan, Guanghao Liao, Yinxiang Yu, Zhi Chen, Haotian Wang, Yutian Zhu

2026-06-23数据集/基准

本文针对真实大班课堂中学生目标密集、前后排遮挡、尺度断裂和远距离细粒度行为线索退化的问题,构建HCCB数据集,含796张高分辨率图像与50,229个七类行为实例;同时提出YOLO系ODER-HSFNet,通过遮挡边界校正、高阶跨尺度关系融合和候选框置信度校准提升检测。在HCCB与SCB-D3-S上分别达到60.60/80.12和57.36/74.65的mAP50:95/mAP50,优于主流YOLO基线。

Compressing Observation History into Agent Memory: Distilling Transformers into Recurrent Transformers Figure 1
2026-06-23cs.CV

Compressing Observation History into Agent Memory: Distilling Transformers into Recurrent Transformers

Philippe Weinzaepfel, Christian Wolf, Bülent Mert Sariyildiz, Guillaume Bono, Gianluca Monaci

Naver Labs Europe, Meylan, France

2026-06-23视觉感知

面向长时序流式视觉与机器人任务,论文指出循环 Transformer 落后于全历史 Transformer 的关键不在架构容量,而在其必须在线决定记忆保留内容、压缩学习更难。作者提出 Chimera:先训练带固定瓶颈的历史 Transformer 教师,再将其瓶颈表示蒸馏到循环模型记忆中。实验在无地图姿态估计上显示,该方法保持随时间线性/常数级推理开销,并显著缩小与全历史模型的性能差距。

LOGOS: LiDAR-Only Gaussian Elevation Splatting for Unified Tiny Obstacle Segmentation Figure 1
2026-06-23cs.RO

LOGOS: LiDAR-Only Gaussian Elevation Splatting for Unified Tiny Obstacle Segmentation

Nan Ming, Yeqiang Qian, Chunxiang Wang, Ming Yang

School of Automation and Intelligent Sensing, Shanghai Jiao Tong University, Key Laboratory of System Control and Information

2026-06-23视觉感知三维

LOGOS针对路沿、碎石、坑洼等微小正负障碍在地形起伏、遮挡和稀疏激光点云中易被误判的问题,将路面表示为连续的二维高斯基元混合,并用无反传的自由空间初始化与法向感知高程 splatting 估计逐点有符号距离。实验覆盖城市与矿区越野、多种雷达和密度变化,显示其在退化区域和复杂越野场景中优于现有分类或网格/参数化路面建模方法,同时保持实时性。

A Skin-Tone-Aware Dual-Representation Remote Photoplethysmography Framework for Contactless Respiratory Rate Estimation Figure 1
2026-06-23eess.IV

A Skin-Tone-Aware Dual-Representation Remote Photoplethysmography Framework for Contactless Respiratory Rate Estimation

Trishna Saikia, Anup Kumar Gupta, Puneet Gupta, Pasi Liljeberg

2026-06-23视觉感知

本文针对接触式呼吸率测量不便、现有 rPPG 方法多沿用心率估计中的固定 RGB 投影且难适应肤色差异的问题,提出 ELITE-RR:用肤色感知的动态投影提取 Eulerian 颜色信号,并为 Lagrangian 运动信号加入去噪网络,再通过相位无关对比学习融合两类表征。作者还构建印度人群 RR-rPPG 数据集;在 RR-rPPG 与 COHFACE 上,相比基线最高降低 42.1% MAE。

Decoupling the Declarative from the Procedural in Vision-Language-Action Models Figure 1
2026-06-23cs.RO

Decoupling the Declarative from the Procedural in Vision-Language-Action Models

Nikolaos Tsagkas, Andreas Sochopoulos, Chris Xiaoxuan Lu, Oisin Mac Aodha, Alexandros Kouris

University of Edinburgh, Samsung AI Center - Cambridge, UK

2026-06-23视觉语言视觉感知

本文针对现有 VLA 在少量示教后易把“技能”和“对象”绑定、难以零样本迁移的问题,提出 w2VLA:冻结 VLM 表征,并将目标位置的 declarative “where” 与动作技能的 procedural “what” 分离,按模块调制机器人状态而非混合所有 token。实验显示其在已见任务上保持与 π0.5、OTTER 相近表现,同时能将已学技能迁移到不同乃至未见物体,而基线在该设置下明显失效。

Semi-Supervised Vision-Language-Action Model Figure 1
2026-06-23cs.CV

Semi-Supervised Vision-Language-Action Model

Hongyang He, Jiuming Liu, Victor Sanchez

University of Warwick, 2University of Cambridge, 3Manifolda.Ai, costly action-labeled demonstrations. To reduce this dependence, we study semi-supervised VLA, actions and the remaining trajectories provide action-unlabeled vision-language observations. Unlike, pseudo-actions on unlabeled trajectories. SemiVLA introduces a VLA-specific reliability controller to, strategies across LIBERO and CALVIN. Under 10% labeled trajectories, SemiVLA with Selective, to new robots, new environments, and new task distributions still heavily depends on action-labeled robot, A natural way to reduce this cost is to exploit unlabeled or weakly labeled robot data. In many robotic, scenarios, visual observations and language instructions are easier to obtain than dense action labels. For, semi-supervised learning (SSL), where a model learns from a small labeled set and a large unlabeled set. SSL, of average performance on LIBERO and SIMPLER-ENV under 10% labeled trajectories. SemiVLA consistently, has been widely studied in visual recognition, where pseudo-labeling, teacher-student learning, and consistency, regularization are commonly used to improve learning under limited labels [16, 17, 21, 23]. However, directly

2026-06-23视觉语言视觉感知

这篇论文针对VLA模型迁移到新环境时仍依赖昂贵动作标注的问题,提出半监督适配框架SemiVLA:用教师-学生自蒸馏从无动作标注的视觉语言轨迹中筛选可靠伪动作,并以视觉语言对齐、动作可行性和时序一致性控制噪声反馈。以OpenVLA为骨干,在LIBERO和CALVIN上提升多种PEFT策略;10%标注下Selective LoRA在LIBERO达89.0%成功率,比监督LoRA高8.0点且无额外推理成本。

ASCII Art Turns LLMs into VLA Controllers Figure 1
2026-06-23cs.RO

ASCII Art Turns LLMs into VLA Controllers

Yitao Jiang, Roy Xing, Luyang Zhao, Brian Plancher, Muhao Chen, Devin Balkcom

2026-06-23规划控制

论文针对传统 VLA 依赖多模态骨干、大规模示教和较高算力的问题,提出将视觉观测渲染为 ASCII 文本,让纯文本 LLM 直接条件化状态、指令并输出受约束动作。方法用程序生成 2D 操作场景、规划器教师与 DAgger 训练,并在仿真和 7 自由度真实机械臂上验证;结果显示模型可识别关键实体、判断不可达并规划可执行序列,部分 2D 任务中文本模型优于对应视觉模型。

Native space based pipelines outperform template space based pipeline in subcortical segmentation Figure 1
2026-06-23cs.CV

Native space based pipelines outperform template space based pipeline in subcortical segmentation

Tomás Lima, Daniel Novák, Eduard Bakštein

Department of Cybernetics, Czech Technical University in Prague, Prague, Czech Republic, National Institute of Mental Health, Klecany, Czech Republic, against manual labels. We further investigated the effect of the template resolution., Neurological Institute Space (MNI) [13]. This step allows for consistent anatomical refer-, available 7T data., available, these were also collected. 7T images were collected from the Open Science CBS

2026-06-23视觉感知

针对丘脑底核等小型皮层下结构在手术规划中需保持患者原生解剖精度的问题,本文比较了基于 nnUNet 的原生空间与 MNI 模板空间分割流程。核心洞察是,往返配准到模板空间会损害细粒度边界,且提高模板分辨率并不能弥补。7T 留出集上原生流程在 STN、RN、SN 均更优,STN Dice 为 0.775 对 0.713、HD95 为 0.79mm 对 1.17mm;迁移到 3T 时性能明显下降,合成 3T 数据仅带来有限增益。

Technical Report for ICRA 2026 GOOSE 2D Fine-Grained Semantic Segmentation Challenge: Exploring Query-Based Segmentation and Increased Spatial Context for Outdoor Scene Understanding Figure 1
2026-06-23cs.CV

Technical Report for ICRA 2026 GOOSE 2D Fine-Grained Semantic Segmentation Challenge: Exploring Query-Based Segmentation and Increased Spatial Context for Outdoor Scene Understanding

David Pascual-Hernández, Roberto Calvo-Palomino, Inmaculada Mora-Jiménez, Jose María Cañas-Plaza

2026-06-23视觉感知

面向野外机器人导航中细粒度地形与障碍物难区分、类别长尾和跨平台泛化的问题,本文在 GOOSE/GOOSE-Ex 挑战中比较 SegFormer 与基于查询的 Mask2Former,并重点验证更大训练裁剪带来的空间上下文作用。结果显示 Mask2Former 在粗细粒度指标上均优于基线,扩大 crop 与 TTA 进一步提升表现,最终测试集 mIoU_comp 达 69.6%、排名第 5;但部分增益可能主要来自模型规模、预训练与测试时增强的组合。

Precision Recall Controllable Radiology Report Generation via Hybrid Natural Language and Clinical Reward Learning Figure 1
2026-06-23cs.CL

Precision Recall Controllable Radiology Report Generation via Hybrid Natural Language and Clinical Reward Learning

Ling Chen, Ruinan Jin, Jun Luo, Hanliang Chen, Quirin Strotzer, Rongkai Yan, Yuan Xue, Luciano Prevedello, Dufan Wu

Precision Recall Controllable Radiology Report, The Ohio State University, Columbus, OH 43221, USA, University Medical Center Regensburg, Regensburg, Germany, recall controllable RRG, where a control parameter explicitly adjusts the, recall controllable RRG for chest X-rays, in which a continuous control pa-, Precision Recall Controllable Reinforcement Learning

2026-06-23强化学习规划控制

本文针对放射报告生成中“语言流畅但临床发现不准或漏报、且无法按场景调节精确率/召回率”的问题,提出在强化学习框架中引入连续控制参数λ,并同时作用于解码表示的自适应层归一化和临床奖励,以生成偏高精确率或高召回率的报告;再结合NLG奖励、临床效能奖励和组内相对归一化降低训练方差。MIMIC-CXR实验显示其在语言指标和临床效能指标上优于既有方法,并能形成可解释的精确率-召回率控制。

Synergistic Dual-Branch Adaptation for Multi-modal Generalized Category Discovery Figure 1
2026-06-23cs.CV

Synergistic Dual-Branch Adaptation for Multi-modal Generalized Category Discovery

Yuxun Qu, Minyu Zhou, Yongqiang Tang, Chenyang Zhang, Wensheng Zhang

classify old categories and discover new ones from unlabeled, different baselines validate the broad scalability of the proposed, exploiting unlabeled images. However, SSL assumes a closed-, world setting where the unlabeled data shares the same label, space as the labeled set [3], limiting its applicability when, unlabeled dataset contains new categories absent from the, labeled set. The goal of GCD is not only to classify old, Yuxun Qu and Minyu Zhou are with the College of Computer Science, Yongqiang Tang and Chenyang Zhang are with the State Key Lab-, oratory of Multimodal Artificial Intelligence Systems, Institute of Au-, tomation, Chinese Academy of Sciences, Beijing 101408, China. (e-mail:, Wensheng Zhang is with the College of Computer Science, Nankai Uni-

2026-06-23视觉感知

这篇论文针对多模态广义类别发现中双分支方法协同不足的问题:检索或生成文本含噪,却与视觉分支独立编码,且互学习只对齐全局类锚。作者提出 SDBA,在冻结骨干上加入轻量适配器,并逐层把视觉类表示注入文本分支,同时用局部邻域分布的双向 KL 约束替代粗粒度锚对齐。六个基准上达到或提升 SOTA,并在 GET、TextGCD 等基线上的一致增益表明其更像可插拔增强模块。

MIRCaps: A Large-Scale Mixed-Domain Dataset with Image-Level and Region-Level Captions for Fine-Grained Vision-Language Learning Figure 1
2026-06-23cs.CV

MIRCaps: A Large-Scale Mixed-Domain Dataset with Image-Level and Region-Level Captions for Fine-Grained Vision-Language Learning

Arlindo Luciano Tulumba Roberto, Hyungjoon Kim

Changwon National University

2026-06-23视觉语言视觉感知数据集/基准

针对通用与 CCTV 场景中细粒度图文数据不足的问题,MIRCaps 汇集 14.1 万图像、近百万图像级描述、174 万区域级描述和 139 万框标注,用多视角场景描述与对象中心属性描述强化类别、颜色、动作、状态和环境对齐。实验显示 SmolVLM、BLIP/BLIP2、Qwen2.5-VL 等轻量 VLM 可通过该数据提升图像描述质量,并辅助检测评估;但区域级微调不足,检测增益受原始框覆盖不完整限制。

2D Versus 3D Diffusion for In Silico Training of Interventional X-ray AI Models Figure 1
2026-06-23eess.IV

2D Versus 3D Diffusion for In Silico Training of Interventional X-ray AI Models

Sampath Rapuri, Jeremy Ko, Benjamin D. Killeen, Russell H. Taylor, Mathias Unberath

2026-06-23生成模型三维

针对介入式 X 光 AI 缺少带标注真实数据、传统 DRR 又依赖高质量真实 CT 的瓶颈,论文比较了两条纯合成训练路线:3D 扩散生成 CT 再投影 DRR,以及按视角和分割条件直接生成 2D X 光。受控骨盆 landmark 检测实验显示,2D DiffXray 迁移到真实 X 光的误差为 4.84 mm,接近 RealCT-DRR 的 4.37 mm;3D DiffCT-DRR 在高置信预测下也可比,但低置信时下降较快。

Robot Self-Improvement via Human-Video Dynamics Models Figure 1
2026-06-23cs.RO

Robot Self-Improvement via Human-Video Dynamics Models

Hanzhi Chen, Anran Zhang, Simon Schaefer, Kejia Chen, Shi Chen, Daniel Cremers, Oier Mees, Stefan Leutenegger

Technical University of Munich

2026-06-23机器人视觉感知

这篇论文针对机器人部署后仍会遇到具身差异和失败、但人工纠错难以扩展的问题,提出从人类视频中学习与具体机器人无关的动作、动力学和值表示,并用 DGAC 将失败状态转化为可排序的纠正动作监督。真实操作实验覆盖两类机器人和七个任务,平均成功率由 40% 提升到 81%,在 π0.5 上也从 62.7% 提升到 88.0%。

VLA-FAIL: Efficient Task Failure Detection for Finetuned Vision-Language-Action Models Figure 1
2026-06-23cs.LG

VLA-FAIL: Efficient Task Failure Detection for Finetuned Vision-Language-Action Models

Florian Seligmann, Emiliyan Gospodinov, Enes Ulas Dincer, Gerhard Neumann

Autonomous Learning Robots Lab, Karlsruhe Institute of Technology

2026-06-23视觉语言视觉感知

这篇论文针对微调后视觉语言动作模型在真实部署中仍会因分布外状态或动作生成不一致而失败、且现有检测器依赖失败数据或多次采样开销过高的问题,提出 VLA-FAIL:用最后层特征的逐 token 马氏距离捕捉内部表征偏移,并用重叠动作块的一致性捕捉执行计划抖动,同时以 AUCPDT 衡量准确性与提前量。实机和 LIBERO-Plus 实验显示,两类信号互补,组合方法常优于更昂贵基线且仅带来很小延迟。

No Figure
2026-06-23cs.CV

EnTrust: Modeling Inter-Modal Conflict for Trustworthy Multimodal Medical Image Analysis

Dwarikanath Mahapatra, Abhijit Das, Behzad Bozorgtabar, Zongyuan Ge, Sudipta Roy, Deepak Nayak, Mauricio Reyes, Imran Razzak

2026-06-23视觉语言视觉感知

该文针对多模态医学分割中不同成像模态在病灶边界常相互矛盾、传统融合会抹平冲突且事后不确定性难解释的问题,提出 EnTrust,将模态一致信息、单模态特有线索和空间冲突显式解耦,并用冲突条件化扩散分割与 TrustMap 生成可校准像素级不确定性。四个脑、心脏、病灶和肿瘤基准上报告分割精度最优,校准误差较最强基线降低约 40%,且单模型超过 5 模型集成并减少内存。

OSOG: A Differentiable, Physics-Informed Synthetic Data Engine for Micro-Optical Environments Figure 1
2026-06-23cs.CV

OSOG: A Differentiable, Physics-Informed Synthetic Data Engine for Micro-Optical Environments

Caio Silva

Department of Physics, Massachusetts Institute of Technology, Cambridge, Massachusetts 02139, USA∗, particles in under 50 milliseconds ( 20 FPS). By providing a fast, scalable, and physically grounded, dense, overlapping suspensions is not only labor-intensive, architecture and scope, introducing a highly scalable SoA

2026-06-23视觉感知

论文针对显微成像中密集标注稀缺、传统几何渲染难以刻画衍射与相位效应的问题,提出 PyTorch 原生、可微且物理约束的 OSOG 合成数据引擎,用 SoA 张量化管线生成波光学显微图像并支持 DiffOSOG 反向校准。实验显示,仅用合成数据训练的 YOLOv11-OBB 可零样本检测真实重叠溶菌酶晶体,且可在 50ms 内合成 4 万粒子;但检测结果以定性展示为主,真实标注指标文中未充分说明。

No Figure
2026-06-23cs.CV

FLM-Occ: Feed-forward Likelihood Maximization for Efficient Indoor Occupancy Prediction

Guangcheng Chen, Lihuang Fang, Huaqi Tao, Yicheng He, Li He, Hong Zhang

2026-06-23视觉感知

该文针对室内单目占据预测中高斯/超二次曲面原语常滞留在空区域、造成表示和计算浪费的问题,指出根因是体素分类损失只提供局部监督、难以驱动远距离重定位。FLM 将任务改写为占据体素分布估计,用前馈最大似然训练混合模型,并以归一化原语体积作为权重实现端到端体素化。FLM-Occ 在 Occ-ScanNet 上仅用 32 个超二次曲面、约为前 SOTA 原语数的 2.7%,取得更高精度且推理快 3.7 倍。

No Figure
2026-06-23cs.CV

Graph-of-Differences: Anatomy-Structured Difference Alignment for Medical Image Re-Identification

Nichula Wasalathilaka, Abhijit Das, Imran Razzak, Dwarikanath Mahapatra

2026-06-23视觉感知

这篇论文针对医学图像重识别中模型可能依赖设备伪影、且难以让临床医生核查“比较了哪些解剖结构”的问题,提出 Graph-of-Differences:把每张图表示为具名解剖节点图,在图像对之间建立软对应,并只在匹配解剖结构上计算差异,再与全局特征差异对齐。结果显示,在眼底和胸片内部基准上 Rank-1 分别较冻结 MaMI 提升 7.1 和 3.1 个百分点,外部零样本也有增益,同时提供节点级可审计解释。

LEViL: Label-Efficient Video Learning via Zero-Shot Distillation over VLM-Generated Pseudo-Label Spaces Figure 1
2026-06-23cs.CV

LEViL: Label-Efficient Video Learning via Zero-Shot Distillation over VLM-Generated Pseudo-Label Spaces

Aslı Çelik

LEViL: Label-Efficient Video Learning via, Pseudo-Label Spaces, Department of Electronics and Communications Engineering, Kocaeli University, performance. However, it requires large-scale labeled source, domains. Constructing such labeled pretraining datasets for, these limitations, this study proposes a label-efficient video learn-, with target-label-set-aware fine-tuning. During pretraining, a, unlabeled videos, which are processed to construct an inter-, pretable semantic pseudo-label space. A frozen video-language, downstream adaptation, target-label-set-aware fine-tuning com-, bines supervised learning from labeled target videos with zero-

2026-06-23视觉语言视觉感知

这篇论文针对视频动作识别中有标注源数据昂贵、且传统预训练受固定类别和域差异限制的问题,提出用VLM为未标注视频生成描述并构建语义伪标签空间,再由冻结视频语言模型进行零样本软蒸馏,结合面向目标标签集的微调。实验在UCF101和HMDB51的低标注设置下优于对比半监督方法,且可作为全量微调初始化;但结果主要集中在常见动作识别数据集,跨域泛化边界文中未充分说明。

WildBox: A Dataset and Benchmark for Aerial Monocular 3D Detection of African Savanna Wildlife Figure 1
2026-06-23cs.CV

WildBox: A Dataset and Benchmark for Aerial Monocular 3D Detection of African Savanna Wildlife

Vandita Shukla, Kilian Meier, Lucie Laporte-Devylder, Camille Rondeau Saint-Jean, Jenna M. Kline, Blair R. Costelloe, Devis Tuia, Fabio Remondino, Benjamin Risse

Computer Vision and Machine Learning Systems group, Institute for Geoinformatics, University of, School of Civil, Aerospace and Design Engineering, University of Bristol, Bristol, UK, Department of Biology, University of Southern Denmark, Odense, Denmark, The Ohio State University, Columbus, Ohio, USA, Department of Collective Behavior, Max Planck Institute of Animal Behavior University of, Centre for the Advanced Study of Collective Behaviour, University of Konstanz, Konstanz, Germany, Department of Biology, University of Konstanz, Konstanz, Germany, Environmental Computational Science and Earth Observation Laboratory, EPFL, Sion, Switzerland, pseudo-3D labels, motivated by the high deployment cost of LiDAR and other 3D sensors. Similarly, LabelAny3D [52] produces pseudo 3D bounding-box annotations for arbitrary categories on in-the-, coverage of existing 3D datasets and the labour cost of manual 3D annotation. Together, these works, show that scalable 3D supervision is becoming practical for in-the-wild RGB data, but also confirm

2026-06-23视觉感知数据集/基准三维

面向生态无人机监测中缺少真实单目航拍三维动物标注、现有3D检测偏向车载/地面场景的问题,WildBox提供非洲草原多物种视频的23.8万个人审3D框、实例轨迹与KITTI/Omni3D兼容基准。实验显示2D开放词表定位尚可,但零样本3D提升即使给真值2D框也为0;微调后恢复到13.17宏AP3D,误差主要来自单目航拍深度估计。

A Test-time Actor-Critic Approach to News Images Generation Figure 1
2026-06-23cs.CV

A Test-time Actor-Critic Approach to News Images Generation

Damianos Galanopoulos, Vasileios Mezaris

Information Technologies Institute (ITI), Centre of Research and Technology Hellas (CERTH), Thessaloniki, Greece, The code is available at https://github.com/IDT-ITI/actor-critic-image-generation.

2026-06-23视觉感知

面向仅凭新闻标题生成配图时语义对齐不足、一次性提示难以稳定的问题,论文提出无需训练的测试时 Actor-Critic 流程:VLM 生成提示,扩散模型出图,另一 VLM 评分并把历史反馈给 Actor 迭代改写。结果显示带评分历史的迭代版本普遍优于单次生成,单一轻量 Z-Image-Turbo 配置在官方评测中取得最佳平均评分且计算成本更低。

SCOPE: Scale-Consistent One-Pass Estimation of 3D Geometry Figure 1
2026-06-23cs.CV

SCOPE: Scale-Consistent One-Pass Estimation of 3D Geometry

Zheng Zhang, Lihe Yang, Tianyu Yang, Chaohui Yu, Yixing Lao, Xiaoyang Guo, Biao Gong, Fan Wang, Hengshuang Zhao

ZHENG ZHANG, The University of Hong Kong, Hong Kong, LIHE YANG, The University of Hong Kong, Hong Kong, YIXING LAO, The University of Hong Kong, Hong Kong, HENGSHUANG ZHAO, The University of Hong Kong, Hong Kong, Authors’ Contact Information: Zheng Zhang, The University of Hong Kong, Hong, Lihe Yang, The University of Hong, Yixing Lao, The University of Hong, alibaba-inc.com, Hengshuang Zhao, The University of Hong Kong, Hong Kong, Hong

2026-06-23三维

SCOPE针对单目长视频三维重建中几何精度与跨数百帧尺度一致性难以兼顾的问题,预测共享尺度/平移参数的仿射不变点图。其核心是将多视角几何对齐到统一参考系,结合跨指数时间尺度的一致性监督和NTK调制RoPE外推长序列。实验显示其在ScanNet上相对点图误差降低24.2%、时间对齐误差降低34.9%,并能单次前向处理复杂轨迹与光照变化。

Lightweight 3D Feature Pretraining by Bayesian Inversion of 2D Foundation Models Figure 1
2026-06-23cs.CV

Lightweight 3D Feature Pretraining by Bayesian Inversion of 2D Foundation Models

Marwane Hariat, Gianni Franchi, David Filliat, Antoine Manzanera

semantic state from all available views. This posterior formulation naturally distinguishes between

2026-06-23三维

论文针对将CLIP、DINO等2D基础模型特征直接平均提升到3D时容易受视角、遮挡和噪声影响的问题,提出把每个3D点的语义表示视为不可观测潜变量,将多视角2D特征视为带位姿条件的噪声观测,并用集合式变分模型通过预测留出视角来学习后验。实验显示Casper3D在开放词汇3D语义分割中比简单多视角池化更稳定、鲁棒,尤其在歧义和噪声场景下更明显。

NoduLoCC2026: Lung Nodule Localization and Classification Contest from Chest X-Ray Images Figure 1
2026-06-23cs.CV

NoduLoCC2026: Lung Nodule Localization and Classification Contest from Chest X-Ray Images

Adnan Mustafic, Halim Benhabiles, Adnane Cabani, Kristhian André Oliveira Aguilar, Romain Amigon, Clément Bardin, Chiara Bentifece, Marin Boehm, Kévin Bouchard, Laura Burattini, Diedre Carmo, Fahima Idiri, Matthis Lahargoue, Ilaria Marcantoni, Hicham Messaoudi, Cyril Meyer, Farid Meziane, Léon Morales, Letícia Rittner, Agnese Sbrollini, Léonard Zipper, Karim Hammoudi

IMT Nord Europe, Institut Mines-T´el´ecom, Universit´e de Lille, Center for Digital Systems, Universit´e de Bejaia, Facult´e des Sciences Exactes, Laboratoire d’Informatique M´edicale et, University of Derby, Derby, United Kingdom, than the first one. The challenge website is available, Institute for Health Metrics and Evaluation, based, using a more easily scalable paradigm than transform-, institutes, or industry labs of which at least one mem-, Label, multi-class and multi-label, we filtered the images, or explicitly labeled as containing nodules without, the highest quality available from the source., CT scans. Nodule center point annotations are

2026-06-23视觉感知

针对胸片中肺结节比 CT 更便宜但受二维投影和结构重叠影响、自动检测与定位更难的问题,论文组织 NoduLoCC2026 竞赛,构建含 NIH ChestX-ray14、LIDC-IDRI 训练集与 JSRT 外部测试集的分类/定位评测。结果显示分类尚可,最佳平衡准确率 0.72、AUC 0.79;定位明显受限,最佳仅在 53% 图像上预测正确结节数,中位误差 12.83mm。

Unsupervised Domain Adaptation for Sim-to-Real Object Pose Estimation with Contrastive Alignment and Pseudo-Label Refinement Figure 1
2026-06-23cs.CV

Unsupervised Domain Adaptation for Sim-to-Real Object Pose Estimation with Contrastive Alignment and Pseudo-Label Refinement

Nidhal Eddine Chenni, Arunkumar Rathinam, Djamila Aouada

Estimation with Contrastive Alignment and Pseudo-Label Refinement, ments while exploiting a subset of unlabeled target data to, Pseudo-Label Refinement to improve reliability by encouraging, The authors are associated with SnT, University of Luxembourg. Contact, is often impractical given the cost, labor, and scalability, Adaptation (UDA) [3] leverages unlabeled real data (tar-, get) alongside labeled synthetic data (source) to train DL, pseudo labels. Multi-view consistency approaches [10], [11], pseudo labels in the target domain remain reliable despite, Pseudo-Label Refinement. wiith the following key contri-, a consistency-based pseudo-label refinement scheme that, UDA aims to transfer knowledge from a labeled source

2026-06-23三维

本文针对仅用合成数据训练的物体位姿估计在真实场景中因外观与几何域差异而退化的问题,提出 CAPLR:先用中间特征无监督匹配姿态相近的源/目标图像,再在局部 patch 上对齐骨干特征与任务输出,并用增强一致性细化伪标签,以避免全局对齐破坏关键几何线索。实验称其在多个位姿估计基准上达到 SOTA,并通过消融验证各组件有效。

Beyond Damage Assessment: Recyclable Material Detection in Aerial Disaster Imagery Using a Lightweight Patch-Based Framework Figure 1
2026-06-23cs.CV

Beyond Damage Assessment: Recyclable Material Detection in Aerial Disaster Imagery Using a Lightweight Patch-Based Framework

Mahmoud Hazem, Karim Hammoudi

Beyond Damage Assessment: Recyclable Material, efficient detection of recyclable material. Experimental results, recyclable materials. Accordingly, we provide a rare dataset, of material images that we labeled towards supporting the, development of recyclable material detectors. The dataset of, labeled material images is publicly available at: anonymous., ment, Recyclable Material Detection, Patch-Based Classifica-, vision [4]–[7] with the goal of identifying recyclable materials, lously prepared and labeled manually (546 images) is, provided towards training recyclable material detectors, terial overlay maps potentially representing recyclable, quantity of potentially recyclable material per regions of

2026-06-23视觉感知

本文关注灾后航拍图像中受损区域不仅要评估破坏程度,还可识别可回收建材以支持清理与资源回收。核心做法是构建手工标注的 RecyMat 小数据集,并用轻量 MobileNetV2 对 64×64 破片进行木材、砖、瓷砖和其他分类,再生成材料覆盖图和区域占比。模型在验证/测试上约 93.8% 准确率与宏 F1,在 AIDER 外部图像人工评估约 71%,但跨场景尺度变化和未见材料会显著降性能。

Non-line-of-sight imaging with arbitrary relay surface geometries via 3D Gaussian Transient Rendering Figure 1
2026-06-23cs.CV

Non-line-of-sight imaging with arbitrary relay surface geometries via 3D Gaussian Transient Rendering

Yi Wang, Ziyu Zhan, Yuran Wang, Hao Wang, Qiang Liu, Zuoqiang Shi, Lingyun Qiu, Xing Fu

YI WANG∗, Department of Precise Instrument, Tsinghua University, China, ZIYU ZHAN∗, Department of Precise Instrument, Tsinghua University, China, YURAN WANG, Department of Precise Instrument, Tsinghua University, China, HAO WANG, Department of Electrical Engineering, City University of Hong Kong, China, QIANG LIU, Department of Precise Instrument, Tsinghua University, China, ZUOQIANG SHI, Yau Mathematical Science Center, Tsinghua University, China, LINGYUN QIU, Yau Mathematical Science Center, Tsinghua University, China, XING FU†, Department of Precise Instrument, Tsinghua University, China, of Precise Instrument, Tsinghua University, Beijing, China, tsinghua.edu.cn, Department of Precise Instrument, Tsinghua University, Beijing, China, Tsinghua University, Beijing, China, of Electrical Engineering, City University of Hong Kong, Hong Kong, China

2026-06-23三维

这篇论文针对实际 NLOS 成像中中继面常为空间受限、非平面且采样稀疏,导致传统平面墙假设失效的问题,提出由可见 LOS 测量估计中继面几何,并用 3D Gaussian 表示隐藏场景、结合可微瞬态渲染端到端优化的 3D-GTR。实验覆盖公开数据和自建系统,在共焦/非共焦及任意中继面几何下均优于 NeTF、CC-SOCR 等方法,尤其提升复杂不规则中继面上的重建鲁棒性。

Few-Shot Hyperspectral Aphid Detection via FastGAN Synthetic Data Generation, Transformer-Based Classification and Explainable AI Figure 1
2026-06-23cs.CV

Few-Shot Hyperspectral Aphid Detection via FastGAN Synthetic Data Generation, Transformer-Based Classification and Explainable AI

Ali Saeidan

Lancaster Medical School, Faculty of Health and Medicine, Lancaster University, Lancaster LA1 4YG, United Kingdom, yields and quality. Conventional detection methods rely on visual inspection or chemical analyses, which are labor-intensive, time-consuming, HSI data is the limited size of available datasets (Ma et al., 2019, transformers (ViTs) require large volumes of labeled data to achieve generalizable performance (Dosovitskiy et al., 2021, fidelity. These characteristics make FastGAN particularly suitable for generating synthetic hyperspectral SID images, where the availability of, labeled data is limited but high spectral detail is essential. In our study, FastGAN was trained on the real SID dataset to produce 10,000 synthetic

2026-06-23视觉感知生成模型

针对高光谱蚜虫检测标注样本少、深度模型易过拟合的问题,本文用 FastGAN 扩增蚕豆叶 SID 图像并比较 VGG16、ResNet-50、EfficientNet 与 ViT。结果显示合成数据提升分类稳健性、减少漏检,ViT 准确率和 F1 最优;但增益可能主要来自 data scaling,合成样本对真实泛化的贡献仍需更严格验证。

Spectral GS-SLAM: Observability-Aware, Degeneracy-Robust Tracking for Real-Time 3D Gaussian Splatting SLAM Figure 1
2026-06-23cs.RO

Spectral GS-SLAM: Observability-Aware, Degeneracy-Robust Tracking for Real-Time 3D Gaussian Splatting SLAM

Edward Beng Wai Tan, Siew-Kei Lam, Dongshuo Zhang

College of Computing and Data Science, Nanyang Technological University, Singapore. ∗ Corresponding author.

2026-06-23视觉感知三维安全鲁棒

这篇论文针对实时 3DGS-SLAM 中轻量跟踪的互补失效:特征法怕低纹理,ICP 在几何退化场景中病态。核心做法是用 Hessian 谱分析和高斯协方差中的平面性统计识别不可观方向,并只在退化子空间注入稀疏特征约束。TUM RGB-D 实验显示其在无纹理和结构退化序列中保持轨迹稳定,同时达到约 40.14 FPS。

A Neurosymbolic Framework for Interpretable Skeleton-Based Seizure Detection via Concept-Driven Logical Reasoning Figure 1
2026-06-23cs.CV

A Neurosymbolic Framework for Interpretable Skeleton-Based Seizure Detection via Concept-Driven Logical Reasoning

Talha Ilyas, Deval Mehta, Zongyuan Ge

Department of ECSE, Faculty of Engineering, Monash University, Australia, AIM for Health Lab, Faculty of IT, Monash University, Australia, Department of DSAI, Faculty of IT, Monash University, Australia

2026-06-23视觉感知

针对视频癫痫检测虽性能提升但缺乏临床可解释性、且二分类易把正常剧烈动作误报为发作的问题,本文把患者骨架提取、ILAE运动半定量概念瓶颈和可微逻辑规则结合,并细分非发作活动提供监督。在SAHZU和IEEE上分别达到89.78%/85.27%敏感性,误报降至0.06/0.09次每小时,同时给出概念、规则和贡献度三级解释。

ACE-GS: Acing the Trade-off with Accurate, Compact and Efficient 3D Gaussian Splatting Figure 1
2026-06-23cs.CV

ACE-GS: Acing the Trade-off with Accurate, Compact and Efficient 3D Gaussian Splatting

Jijian Zhao

2026-06-23三维

ACE-GS针对3D Gaussian Splatting在快速训练、模型紧凑与高保真之间的冲突,核心洞察是精细管理高斯基元而非粗暴裁剪:用动量一致性约束增密到真实几何流形,结合统计敏感度在线稀疏化,并用残差频率补偿恢复高频细节。实验称其3–5分钟收敛,相比Speedy-Splat最高加速3.7倍,且PSNR较原始3DGS最高提升0.89 dB。

No Figure
2026-06-23cs.CR

DIPBox: A Multi-scale Testing Framework for Tracking Dataset Regeneration

Tian Dong, Yan Meng, Shaofeng Li, Guoxing Chen, Yuling Chen, Zhen Liu, Haojin Zhu, Hao Chen

∗ Shanghai Jiao Tong University, China † Southeast University, China ‡ Guizhou University, China § The University of Hong Kong, China

2026-06-23视觉感知数据集/基准

针对训练数据集被改写、重组或生成式复刻后难以追踪的问题,DIPBox的核心洞察是只要再生数据仍保持模型效用,就会在样本、集合与分布多尺度上留下可测相似性;论文据此设计四类指标和自适应测试流程。实验覆盖16个视觉/文本数据集、320个再生集和590个模型,显示其TPR较既有方法至少提升25%,但黑盒且无数据访问时仍受限。

Context-Aware Autoregressive Diffusion for Gloss-Wise Sign Language Production Figure 1
2026-06-23cs.CV

Context-Aware Autoregressive Diffusion for Gloss-Wise Sign Language Production

JungHoon Sung, Boeun Kim, Chu Xin, Hyung Jin Chang, ChangHo Kim, Sang-Il Choi, Younggeun Choi

Dankook University, University of Birmingham

2026-06-23生成模型

这篇论文针对句级手语生成中长序列易漂移、手部细节模糊且难以逐词控制的问题,提出按 gloss 自回归生成的扩散模型 GARD,将当前/历史语义与上一段运动上下文共同作为条件,并用跨 gloss 边界引导和全局运动协调器处理协同发音与过渡连续性。实验在 Phoenix-T 和 CSL-Daily 上显示其在语言准确性和运动相似度上优于已有 SLP 方法。

Arc-Length Parameterized Interpolating Splines Figure 1
2026-06-23cs.CG

Arc-Length Parameterized Interpolating Splines

Dafna K. Matsegora, Stephen M. Watt

Cheriton School of Computer Science, University of Waterloo, generally available. Importantly, our problem is one of interpolation: the curve

2026-06-23视觉感知

面向路径规划、CAD、手写识别等需要按真实弧长稳定评估曲线的场景,论文针对固定采样点插值样条难以同时保持过点与弧长参数化的问题,提出从弦长初始化、反复重建插值样条并用数值积分更新节点弧长的迭代方法。实验显示多数平面曲线约两次迭代即可获得较低误差,可扩展到任意维度;但收敛性、唯一性及噪声下实际收益文中未充分说明。

Real-time pedestrian attribute recognition with YOLOv8 and ResNet18 Figure 1
2026-06-23cs.CV

Real-time pedestrian attribute recognition with YOLOv8 and ResNet18

Houssam El Mir

College of Computer Science and Technology, Zhejiang University of Technology, Pedestrian attribute recognition (PAR) assigns semantic labels to detected pedestrians, and is useful in surveillance, video retrieval, and human-centred graphics applications. This, Multi-label classification, transportation analytics, human-computer interaction, and human-centred graphics applica-, labels are multi-valued, • A dataset preparation strategy that maps PA-100K labels into the PETA 61-attribute, tion and joint multi-label learning. Recent work explores attention mechanisms [15], multi-task, Modern PAR models usually share visual features across attributes because many labels are, labels can often be inferred from overlapping image regions. This motivates the ResNet18-based, and multi-label attribute prediction., creates a combined PAR dataset by mapping PA-100K labels into the PETA attribute space

2026-06-23视觉感知

面向监控与视频检索中实时行人语义标注需求,论文将 YOLOv8n 行人检测与 ResNet18 任务头串成检测到属性识别流水线,并通过语义映射合并 PETA 与 PA-100K,保留 61 个属性空间。结果显示性别准确率 99.89%、年龄 MAE 4.23 年、多属性准确率 89.96%,RTX 5060 上达 25–30 FPS;但宏 F1 仅 36.32%,说明性能增益可能主要来自数据整合与轻量工程集成,稀有属性仍未解决。

Extraction and Analysis of Multimodal Concepts in Vision Language Models through Sparse Autoencoders Figure 1
2026-06-23cs.CV

Extraction and Analysis of Multimodal Concepts in Vision Language Models through Sparse Autoencoders

Sergio Lanza, Jae Hee Lee, Stefan Wermter

2026-06-23视觉语言视觉感知

这篇论文针对VLM内部概念难解释、现有SAE方法常将视觉与文本概念割裂且忽略多模态概念的问题,提出统一框架:按SAE神经元分别收集强激活的图像patch和文本token,用外部VLM生成候选概念,再用CLIP/ALIGN相似度判定其视觉、文本或多模态属性。在LLaVA-NeXT的VQA实验中,视觉概念描述质量相对既有SAE方法最高提升45%,同时保持文本概念质量并实现多模态概念的系统识别。

MEDLAYXPLAIN: Benchmarking the Expert-Lay Gap in Medical Vision-Language Models Figure 1
2026-06-23cs.CV

MEDLAYXPLAIN: Benchmarking the Expert-Lay Gap in Medical Vision-Language Models

Han Jang, Junhyeok Lee, Songsoo Kim, Chae Young Lim, Hyeonjin Goh, Heeseong Eum, Kyu Sung Choi

Seoul National University, Seoul National University Hospital, Seoul National University College of Medicine, Sungkyunkwan University School of Medicine

2026-06-23视觉语言视觉感知数据集/基准

针对患者直接获取影像结果后难以理解专业报告的问题,本文提出 MedLayXPlain-122K:一个覆盖 8 类医学影像、带 ROI grounding、UMLS 本体锚定的专家—通俗描述基准,并用 HOVER 与轻量 MedLayEval 约束语义一致和可读性。对 33 个 VLM 的评测显示,医学 VLM 擅长专业描述但通俗化退化明显,通用 VLM 更易懂却临床精度不足,揭示当前模型尚难同时满足患者沟通需求。

Anatomically Consistent TMJ Disc Segmentation via Semantic Anchoring and Clinical Priors Figure 1
2026-06-23eess.IV

Anatomically Consistent TMJ Disc Segmentation via Semantic Anchoring and Clinical Priors

Dayun Ju, Chanyoung Kim, Sunyoung Jung, Hyo-Jung Jung, Chena Lee, Younjung Park, Seong Jae Hwang

2026-06-23视觉感知

这篇论文针对TMJ关节盘在MRI中极小、低对比且病变时形态/位置变化大,导致通用分割模型易漏检、误分和边界不稳定的问题。TISC用相邻切片的MedDINOv3特征构建原型语义锚点定位关节盘,并引入口张受限MOL作为临床先验调制点级边界细化。在1300例、2488个PD MRI体数据上,较UNet、nnUNet、SwinUNETR等基线最高提升约4.96 Dice,并改善HD95等边界指标。

HERO: Hypothesis-Driven Evidence Retrieval from Omics for Multi-Task Breast Cancer Analysis Figure 1
2026-06-23cs.CV

HERO: Hypothesis-Driven Evidence Retrieval from Omics for Multi-Task Breast Cancer Analysis

Xiangyu Li, Ran Su

College of Intelligence and Computing, Tianjin University, Tianjin 300072, China, ] aggregates patches under slide-level labels, Fig. 1. (A) MIL relies on slide-level labels

2026-06-23视觉感知

HERO针对乳腺癌全切片中异质性强、传统MIL或VLM容易检索到非诊断区域的问题,将DNA甲基化和miRNA先映射为可审计的形态学假设,再用结构化caption的TF-IDF检索与一致性门控修复证据不足区域。在TCGA-BRCA上,方法在ER、PR、HER2、分型和风险预测均优于多模态融合与VLM基线,HER2和风险增益最明显。

No Figure
2026-06-23cs.CV

BadDreamer: Transferable Backdoor Attacks against Video World Models for Autonomous Driving

Zhe Shuai, Xiaopeng Xie, Yikun Zeng

Shanghai Jiao Tong University

2026-06-23视觉感知强化学习

本文关注自动驾驶视频世界模型在感知到规划链路中的训练期后门风险:上游未来表征一旦被污染,即使轨迹监督干净也会误导下游动作。BadDreamer通过“触发物只出现在观测帧、未来帧保持干净”的擦除式投毒,让模型在看到黄色骑手时预测其消失并形成清路幻觉。实验在VaViM/VaVAM上显示,5%投毒即可在保持干净生成与动作性能的同时达到92.5%世界模型攻击成功率、90.3%动作攻击成功率和86.2%端到端成功率。

PIAvatar: Physically Interactive Avatars via Deformation Gradient Decoupling Figure 1
2026-06-23cs.GR

PIAvatar: Physically Interactive Avatars via Deformation Gradient Decoupling

Sang-Hun Han, Min-Gyu Park, Jisu Shin, Seunghyun Shin, Jin-Hwi Park, Hae-Gon Jeon

2026-06-23优化算法

PIAvatar针对现有3D人体头像虽外观逼真但缺乏与物体、他人双向物理交互及软体形变的问题,基于MPM提出将运动学速度从形变梯度更新中解耦,避免控制动作诱发多余应力,并嵌入骨架以闭式估计受力后的姿态。实验展示了不同质量、材料和人-物/人-人接触下可产生一致的轨迹变化与非刚性身体形变。

Contrastive and Adaptive Multi-modal Masked Autoencoder for Spatial Transcriptomics Figure 1
2026-06-23cs.CV

Contrastive and Adaptive Multi-modal Masked Autoencoder for Spatial Transcriptomics

Joohyeok Kim, Taejin Jeong, Jinyeong Kim, Seong Jae Hwang

2026-06-23视觉感知

这篇论文针对仅凭 H&E 形态预测空间转录组信息不足、临床 ST 成本高的问题,将任务改写为空间插补:用少量实测基因表达作为锚点。核心创新是以 bio-saliency 和排序学习自适应选择连续高信息区域,并用多模态 MAE 与对比学习融合图像和基因锚点。实验称其在纯图像预测和插补任务上均优于既有方法,且仅用约 10% 转录组覆盖即可进一步提升精度。

ChronoLock: Protecting Videos from Unauthorized Text-to-Video Personalization Figure 1
2026-06-23cs.CV

ChronoLock: Protecting Videos from Unauthorized Text-to-Video Personalization

Jiaming He, Jiashu Zhang, Guanyu Hou, Shuhan Ye, Hanwei Zhu, Yi Yu, Xudong Jiang

2026-06-23视觉感知

这篇论文关注公开视频被少量样本用于未授权文本到视频个性化微调的风险,指出现有“保护扰动”多针对静态外观,难以破坏视频模型学习运动的时间去噪证据。ChronoLock 的核心是把视频切块,在扰动预算内同时放大块内时间适配误差和块间边界不连续,并用变换采样增强鲁棒性。实验在 UCF Sports、HMDB51 及 ZeroScope、ModelScope 上显示,它能显著降低运动模仿质量,人评偏好从 Clean 的 67.68% 降至 32.32%。

No Figure
2026-06-23cs.CV

SEED: Simple ViT and Evolving Harness for Explainable Text Forgery Detection

Kahim Wong, Kemou Li, Yiming Chen, Haiwei Wu, Jiantao Zhou

State Key Laboratory of Internet of Things for Smart City, Department of Computer and Information Science, University of Macau, School of Information and Software Engineering, University of Electronic Science and Technology of China

2026-06-23视觉感知

面向AI图像编辑带来的票据、证件等文本型文档伪造风险,SEED将任务从单纯检测扩展到“检测—像素定位—自然语言解释”的结构化取证报告生成。其核心是用相似性引导合成伪造数据与干净/伪造配对训练增强判别,再以DINOv3 ViT+LoRA+EoMT统一检测和定位,并用Meta-Harness迭代优化MLLM报告生成。系统在ACM MM 2026 GenText-Forensics挑战中获得第3名;具体各模块独立增益文中未充分说明。

Odoriko: A Shape-Aware Multimodal Diffusion Framework for Human Motion Figure 1
2026-06-23cs.CV

Odoriko: A Shape-Aware Multimodal Diffusion Framework for Human Motion

Dongseok Shim, Julian Tanke, Kengo Uchida, Christian Simon, Koichi Saito, Takashi Shibuya, Shusuke Takahashi, Yuki Mitsufuji

2026-06-23视觉语言生成模型

Odoriko针对现有统一人体运动生成框架忽略性别、体型等形态差异的问题,将SMPL形状参数与多模态条件共同注入扩散式Shape-Aware Motion Transformer,在文本到动作、音乐到舞蹈、视频/关键点到姿态估计间共享模型,并可在缺少形态输入时联合估计体型。实验显示其在多项标准指标上达到或超过专用模型,同时在新引入的形态一致性评测中更能保持主体相关的运动差异。

MammoExpert: Benchmarking Chain-of-Thought Reasoning in Mammography Diagnosis Figure 1
2026-06-23cs.CV

MammoExpert: Benchmarking Chain-of-Thought Reasoning in Mammography Diagnosis

Di Dai, Bo Liu, Youcheng Li, Haojun Yu, Zhouhang Bian, Quanlin Wu, Dong Wang, Sichen Meng, Hongye Xuan, Zijie Lan, Shenda Hong, Liwei Wang

State Key Laboratory of General Artificial Intelligence, School of Intelligence Science and Technology, Peking University, School of Computer Science and Engineer, Beijing University of Aeronautics and Astronautics, Center for Data Science, Peking University, Yizhun co. ltd, International School, Beijing University of Post and Telecommunications, School of Public Health, University of Michigan, Ann Arbor, Future Technology College, Xi’an Jiaotong University, Peking University, State Key Laboratory of General Artificial Intelligence, School of Intelligence Science and Technology, Peking University Beijing China, School of Computer Science and Engineer, Beijing University of Aeronautics and Astronautics Beijing China, Center for Data Science, Peking University Beijing China, Yizhun co. ltd Beijing China

2026-06-23数据集/基准

针对乳腺X线AI多停留在端到端识别、缺少可解释诊断推理标注的问题,MammoExpert构建了含2379张图像、67类WHO病理亚型和42项影像特征的基准,并用三阶段CoT模拟放射科医生从观察到综合判断的流程。实验显示,加入该数据较CBIS-DDSM训练提升7.1%准确率,显式学习CoT在本测试集再增4%,在INBreast和Vindr也有约6.9%与6.7%增益。

ConnectomeBench2: A Unified Benchmark for Automated Connectomic Proofreading Figure 1
2026-06-23cs.CV

ConnectomeBench2: A Unified Benchmark for Automated Connectomic Proofreading

Jeff Brown, Tim Farkas, Gleb Razgar, Edward S. Boyden

The Open University, Mindspan Institute, McGovern Institute, MIT Departments of Brain and Cognitive Sciences and Biological Engineering

2026-06-23数据集/基准

这篇论文瞄准连接组重建中人工校对耗时、限制全脑突触级图谱生成的问题,提出 ConnectomeBench2:从鼠、人、斑马鱼和果蝇四类公开连接组中统一整理分裂与合并错误校对任务,形成大规模专家标注基准。作者用共享网格几何与电镜图像编码器的单一 ViT 进行多物种、多任务训练,达到接近人类的分裂校正和合并错误识别准确率,并展示性能随数据规模、多模态输入提升;校准、分布偏移度量、预训练和主动学习实验表明其可用于评估跨物种泛化与降低新数据标注成本,但部分增益可能主要来自 scaling / data。

MS-rPPG: Multi-spectral State Space Model for Remote Photoplethysmography in Driver Monitoring Systems Figure 1
2026-06-23cs.CV

MS-rPPG: Multi-spectral State Space Model for Remote Photoplethysmography in Driver Monitoring Systems

Jiho Choi, Sang Jun Lee

2026-06-23视觉感知

面向车载驾驶员健康监测中光照剧烈变化和头部运动导致的 rPPG 失准问题,论文提出 MS-rPPG,将 RGB 与近红外人脸视频结合,并用频域先验驱动的跨光谱线性调制融合脉搏信息,再以 MS-Mamba 线性复杂度建模长时序和跨通道依赖。作者还采集 50 人真实驾驶 MS-Drive 数据,并在 MR-NIRP Car 与 MS-Drive 上报告心率估计优于既有方法。

Object-Centric Dataset Resources for Constrained-Data Image Generation and Augmentation Figure 1
2026-06-23cs.CV

Object-Centric Dataset Resources for Constrained-Data Image Generation and Augmentation

Vasile Marian, Yong-Bin Kang, Alexander Buddery

The University of Queensland, Swinburne University of Technology, The University of Queensland Brisbane Australia, Swinburne University of Technology Melbourne Australia

2026-06-23视觉感知数据集/基准

这篇论文针对低数据场景下目标中心生成缺少统一、可复现数据资源的问题,整理并发布 Cityscapes 行人、TrafficSigns 与 COCO 盆栽三类 256×256 裁剪、框标注、清单、脚本和校验文件,覆盖遮挡行人、清晰标志与复杂背景物体。主要价值在于标准化受限数据生成与增强评测接口;已有 YOLOv11 用例显示合成增强在 Cityscapes 行人和 COCO 盆栽上分别带来 +7.6% 与 +30.6% 提升,TrafficSigns 增益较小。

SARIF: Segment Anything for Robust Image Forensics Figure 1
2026-06-23cs.CV

SARIF: Segment Anything for Robust Image Forensics

Dong-Hyun Moon, Ju-Hyeon Nam, Sang-Chul Lee

2026-06-23视觉感知安全鲁棒

针对图像篡改定位在跨域与常见退化下不稳、SAM类方法又依赖人工提示的问题,SARIF将SAM改造成自动取证框架:用冻结/适配双编码器的残差提取篡改特异线索,并与上一轮掩码融合进行反馈式解码细化。实验显示其在标准篡改定位基准上取得较强平均跨数据集表现,并对JPEG压缩、噪声和模糊更鲁棒。

ShuffleFlow: Scalable Posterior Inference for Bayesian Inverse Imaging Figure 1
2026-06-23cs.CV

ShuffleFlow: Scalable Posterior Inference for Bayesian Inverse Imaging

Tianao Li, Tjitske Starkenburg, Yu Sun, Emma Alexander

T. Li and E. Alexander are with the Department of Computer Science, Northwestern University, Evanston, IL 60208., T. Li, E. Alexander, and T. Starkenburg are also with the NSF-Simons AI Institute for the Sky (SkAI), Chicago, IL 60611., Y. Sun is with the Department of Electrical and Computer Engineering, Johns Hopkins University, Baltimore, MD 21218., Project website: https://nubivlab.github.io/ShuffleFlow/ .

2026-06-23生成模型

本文针对贝叶斯逆成像中变分推断虽能高效生成后验样本、但标准归一化流随图像维度扩展代价过高的问题,提出 ShuffleFlow:用 pixel-unshuffling 将大图分解为子图栈,由神经场编码采样坐标特征,并用共享条件归一化流建模子图联合后验。实验覆盖线性与非线性逆问题,显示其在重建质量和不确定性估计上优于既有 VI 分解策略,并能比扩散采样更快生成大量后验样本。

How Should a Robot Configure Its Laser Scanner for Inspection? Figure 1
2026-06-23cs.RO

How Should a Robot Configure Its Laser Scanner for Inspection?

Zhiling Chen, David Gorsich, Matthew P. Castanier, Yang Zhang, Jiong Tang, Farhad Imani

2026-06-23机器人

这篇论文关注机器人激光检测中常被忽略的传感器参数配置问题:固定或人工调参会因几何、反光和任务意图变化导致漏扫或细节退化。作者提出 SenseHD,将曝光、量程等参数视为离散“感知动作”,用视觉预扫描与检测指令构成超维表示并在关联记忆中检索稳定配置。真实机器人实验显示其相较规则、DNN 和多模态大模型基线具备更高配置准确性、数据效率和低延迟,提升检测可靠性。

Neural Architecture Distributions: A New Paradigm for Stochastic Segmentation Figure 1
2026-06-23cs.CV

Neural Architecture Distributions: A New Paradigm for Stochastic Segmentation

Conghui Li, Junhao Huang, Chern Hong Lim, Bing Xue, Mengjie Zhang

School of Information Technology, Monash University Malaysia, Selangor, Malaysia, Centre for Data Science and Artificial Intelligence, School of Engineering and Computer Science, Victoria University of Wellington, Wellington, New Zealand

2026-06-23视觉感知

这篇论文针对多标注者分割中单一预测易产生“平均掩码”、且潜变量或扩散随机源难以审计的问题,提出把随机性放到离散神经架构分布中:按输入采样不同算子路径生成多种掩码,并用进化搜索构建候选算子库、以能量距离式集合监督防止坍缩。实验称在 LIDC-IDRI 上取得最佳 GED 与 HM-IoU,并在两个扩展任务有效,但候选库搜索带来额外训练成本。

MoECodec: Image Compression for joint human and machine perception via Mixture-of-Experts Figure 1
2026-06-23eess.IV

MoECodec: Image Compression for joint human and machine perception via Mixture-of-Experts

Jiancheng Zhao, Xiang Ji, Yifan Zhan, Zunian Wan, Yinqiang Zheng

2026-06-23视觉感知

这篇论文针对机器视觉场景中图像压缩难以同时兼顾人类重建质量与分类、检测、分割等下游任务的问题,提出在 Transformer 学习式压缩器中用 token 级 MoE 替换 FFN,使不同区域按内容和任务目标动态分配专家计算。为避免路由碎片化和参数暴涨,作者采用 expert-choice 路由、空间总变差正则与 Group Shuffle MLP。实验显示,在 TIC、TinyLIC、TCM 上重建 BD-Rate 分别提升 11.54%、8.12%、6.42%,并在分类、检测、实例分割上相对 Full Finetune-TIC 进一步降低 BD-Rate。

FlowCodec: One-Step Flow Prior for Generative Image Compression Figure 1
2026-06-23eess.IV

FlowCodec: One-Step Flow Prior for Generative Image Compression

Yinhuan Huang, Hao Cao, Pu chen, Wenqi Guo, Zhijin Qin

Tsinghua University

2026-06-23视觉感知生成模型

本文针对超低码率图像压缩中生成先验适配成本高、常需额外条件或分支的问题,提出将压缩视为从受限噪声潜变量到干净潜变量的单步流式传输。FlowCodec把潜变量压缩与预训练文生图先验的Latent Transport解耦,仅用轻量LoRA适配即可支持多码率。实验显示其在低于0.05 bpp时提升感知质量,Qwen版在LPIPS/DISTS上优于既有方法,并保持较高PSNR和更快编码。

Self-Supervised Dual-Frequency Phase Decomposition for Single-Shot Composite Fringe Projection Profilometry Figure 1
2026-06-23cs.CV

Self-Supervised Dual-Frequency Phase Decomposition for Single-Shot Composite Fringe Projection Profilometry

Jin-Hyuk Seok, Yatong An, Jae-Sang Hyun

2026-06-23视觉感知

针对单次复合条纹投影轮廓术中低/高频相位难分离、传统变换法需调参且监督学习依赖昂贵标签的问题,论文提出自监督双频相位精炼,利用两种频率相位梯度的尺度与方向一致性,并加入软边缘一致性保结构。实验中深度 MAE/RMSE 达 0.367/1.804 mm,优于最佳变换基线 0.402/2.785 mm,有效像素率从 84.75% 提升到 95.07%。

Sparse Point-Guided Fusion of Supervised and Self-Supervised Learning Model for Seaweed Segmentation Figure 1
2026-06-23cs.CV

Sparse Point-Guided Fusion of Supervised and Self-Supervised Learning Model for Seaweed Segmentation

Tatsuya Suzuki, Kazuya Ijuin, Hideki Tomimori, Megumi Chikano, Katsushi Sakai

and self-supervised learning (unable to assign class labels), approach allows automatic class label assignment and mitigates, using ground truth data (images and labels indicating what each, of available ground truth data. Particularly, when the training, generating training signals from large-scale unlabeled image, class labels, such as identifying the species of seaweed within, addition to the input underwater image, sparse point labels, segmentation masks through label propagation. In this research, Coral, a label propagation technique that utilizes these features., combined with HIL-Coral for efficient label propagation

2026-06-23视觉感知

面向海洋数字孪生中的蓝碳核算,论文针对水下海藻小目标、类别多样和标注稀缺导致的分割困难,提出用USIS-SAM提供类别与稀疏点位置,再由DINOv2/HIL-Coral传播细粒度区域并用MaskFusion合并实例掩码的两阶段融合方法。在山口县水下图像上,SSL.Prop.+MF较USIS-SAM提升0.068 mIoU,尤其改善小型海藻分割,但跨海域泛化仍文中未充分说明。

CheXpercept: A Benchmark for Evaluating Expert-Level Lesion Perception in Chest X-rays Figure 1
2026-06-23cs.CV

CheXpercept: A Benchmark for Evaluating Expert-Level Lesion Perception in Chest X-rays

Geon Choi, Hangyul Yoon, Nalee Kim, Jeong Yun Jang, Hyunju Shin, Hyunki Park, Sang Hoon Seo, Edward Choi

KAIST 2 Samsung Medical Center 3 Konkuk University Medical Center

2026-06-23数据集/基准

现有胸片 VLM 评测多停留在疾病有无判断,难以验证临床所需的病灶级视觉感知。CheXpercept 将放射科医生流程拆成粗粒度检测、轮廓评估与修订、语义属性抽取,并用 2,100 张胸片生成 10,400 个专家复核 QA。对 14 个通用和医学 VLM 的测试显示,模型只在粗层级尚可,细粒度和语义任务显著退化,医学模型也未体现稳定优势。

Robusto-2: Benchmarking Humans & VLMs for Autonomous Driving in Lima & New York City Figure 1
2026-06-23cs.CV

Robusto-2: Benchmarking Humans & VLMs for Autonomous Driving in Lima & New York City

Adrian Cespedes, Marcelo Chincha, Dunant Cusipuma, Victor Flores-Benites, David Ortega, Arturo Deza

due to their high out-of-distribution nature. Our dataset is available at

2026-06-23视觉语言数据集/基准安全鲁棒

本文关注自动驾驶向复杂新城市扩展时,作为VLA认知骨干的VLM能否在真实OOD路况中可靠泛化。作者构建Robusto-2,用利马和纽约行车视频、两地人类司机与10个VLM做全因子VQA比较,并按模型回答方差筛选高分歧片段。结果显示,人类与VLM的认知回答差异明显且受问题类型影响,但地理来源对人类或模型回答模式影响不强,两地人类表现相近。

UNITY: Attention Flow Networks for Adaptive Conditioning in Diffusion Figure 1
2026-06-23cs.CV

UNITY: Attention Flow Networks for Adaptive Conditioning in Diffusion

Aryan Das, Koushik Biswas, Moloud Abdar, Vinay Kumar Verma

The University of Queensland, Australia, efficient and scalable composite conditioning in diffusion-based image, scalability of existing conditioning frame-

2026-06-23生成模型

针对多条件扩散生成中为每种控制信号单独训练适配器、显存和推理开销随模态数线性增长的问题,UNITY提出先跨模态联合学习共享语义、再按模态专化的两阶段适配器,并用MAF可学习流场做空间对齐。实验在SD1.5和SDXL的Canny、Depth、Sketch、Segmentation上报告更低FID和更高CLIP,同时以固定参数和24GB单卡训练降低多条件成本。

CogniRoute: Learning to Route Social Evidence in Omni-Modal Models Figure 1
2026-06-23cs.CV

CogniRoute: Learning to Route Social Evidence in Omni-Modal Models

Yifan Shen, Pei Tian, Xinzhuo Li, Bowen Fang, Shujun Xia, Bingxuan Li, Ana Jojic, Wenming Ye, Xu Cao, James Matthew Rehg, Ismini Lourentzou

University of Illinois Urbana-Champaign, 2Columbia University, 3Google, reasoning traces, schema labels, temporal evidence spans, and a manually verified evaluation split. CogniRoute, schema labels, grounded reasoning, routing-related annotations, and temporal evidence spans, providing, pipeline that first extracts observation-level visual and audio evidence, then assigns schema labels and

2026-06-23视觉感知

针对全模态模型虽能接入视频、音频和文本却常未使用正确社会线索的问题,CogniRoute用训练期认知模式标注跨模态关系、推理需求和时间范围,并以路由对齐与强化学习约束MoE专家分配。其构建OmniSocialBench,报告平均准确率59.38%,较最强闭源基线高15.33个百分点,优势集中在音视协调、冲突消解和时间扎根社会推理。

Scaling Diverse Language Generation for 3D Visual Grounding Figure 1
2026-06-23cs.CL

Scaling Diverse Language Generation for 3D Visual Grounding

Austin T. Wang, Dongchen Yang, Angel X. Chang

Simon Fraser University

2026-06-23视觉语言三维

这篇论文针对3D视觉定位数据规模化后语言模式单一、难以训练机器人理解复杂空间指称的问题,提出ViGiL3D++:先从场景图采样多样约束并用交叉引用保持相似物体属性表述一致,再交给LLM改写为查询。实验显示其生成数据在语言模式覆盖和有效性上优于多种自动基线,并能提升多个3DVG基准表现,但也指出VLM在场景图生成和空间表述上仍有明显局限。

ELDiff: When Evidential Learning Meets Text-to-Image Diffusion Figure 1
2026-06-23cs.CV

ELDiff: When Evidential Learning Meets Text-to-Image Diffusion

Qingtao Pan, Kai Ye, Zhihao Dou, Bing Ji, Shuo Li

2026-06-23视觉感知生成模型

ELDiff针对多对象文生图中,基于分割图的token级监督容易受SAM掩码偏差和语义重叠冲突影响的问题,将证据学习引入扩散微调:用像素证据损失建模注意力的不确定性,避免对错误标签过度自信,并用Dempster-Shafer冲突度约束不同名词token的空间竞争。实验显示其在SD v1.4/v2.1、SDXL、SD v3.5和Qwen-Image上优于训练式与免训练方法,且不增加推理操作。

GIM-ENDO: A Multimodal Endoscopic Image and Video Dataset for Gastric Intestinal Metaplasia Morphology and Pathology Figure 1
2026-06-23cs.CV

GIM-ENDO: A Multimodal Endoscopic Image and Video Dataset for Gastric Intestinal Metaplasia Morphology and Pathology

Mojgan Forootan, Mahziar Setayeshfar, Ali Darvishi, Mohammad Tashakoripour, Hamidreza Bolhasani

2026-06-23视觉语言视觉感知数据集/基准

针对胃肠上皮化生早筛 AI 缺少公开、病理验证且带细粒度内镜标注的数据瓶颈,GIM-ENDO整合24例患者的WLE/NBI/M-NBI图像与视频、病理亚型、OLGA/OLGIM及幽门螺杆菌等结构化信息,并标注LBC、MTB、WOS等形态征象。主要结果是发布约98张图像和39段视频的多模态基准,可支持GIM检测、亚型分类和活检靶向研究,但规模小、正常对照少,性能增益仍需更大队列验证。

PROTON: Prototype-Based Test-Time Online OOD Detection for Medical VLMs Figure 1
2026-06-23cs.CV

PROTON: Prototype-Based Test-Time Online OOD Detection for Medical VLMs

Abhijit Das, Nichula Wasalathilaka, Yifan Lu, Adinath Dukre, Dwarikanath Mahapatra, Shadab Khan, Imran Razzak

2026-06-23视觉语言视觉感知

这篇论文针对医疗视觉语言模型部署时 OOD 检测在协变量偏移上失效的问题,指出软最大置信度会混淆 ID 与偏移样本,而嵌入空间仍保留可分几何。PROTON 在测试流中用高置信预测维护在线类别原型,并按 MCM 方差自适应融合原型距离与 MCM,无需训练数据、改模型或提示工程。在眼科基准上相对 MCM 分别提升语义、协变量、远域 AUROC 8.8、23.9、8.1 点,并可迁移到放射和病理任务。

BELDE: Building a Large-scale Earth-observation Land-cover Dataset for Europe Figure 1
2026-06-23cs.CV

BELDE: Building a Large-scale Earth-observation Land-cover Dataset for Europe

Ümit Mert Çağlar, Alptekin Temizel

2026-06-23数据集/基准

针对现有土地覆盖分割数据集在地域覆盖、规模和可获得性上的不足,BELDE用Sentinel-2 RGB影像与ESA WorldCover标注构建了覆盖欧洲的百万级训练就绪数据集,并提供韩国、美国加州-内华达OOD评测集和可复现流水线。基线显示欧洲域内F1为83.0%,跨域降至66.4%和58.3%,说明主要价值在于大规模RGB基准与地理域移评测,性能增益可能主要来自scaling/data。

Go-with-the-Track: Video Compositing and Motion Control with Point Tracking Figure 1
2026-06-23cs.CV

Go-with-the-Track: Video Compositing and Motion Control with Point Tracking

Koichi Namekata, Yash Kant, Zhizheng Liu, Ryan D Burgert, Yuancheng Xu, Kuan Heng Lin, Emmett Steven, Julien Philip, Li Ma, Andrea Vedaldi, Paul Debevec, Ning Yu

Eyeline Labs, University of Oxford, University of California, Los Angeles, Stony Brook University, Columbia University, Eyeline Labs USA, University of Oxford Oxford United Kingdom, Eyeline Labs Los Angeles USA, University of California, Los Angeles Los Angeles USA, Stony Brook University USA, Columbia University USA, Eyeline Labs United Kingdom

2026-06-23视觉感知规划控制

本文针对视频生成中“参考外观一致性”和“精确时空运动控制”长期分离的问题,提出用锚定到多张参考图的点轨迹统一描述元素从哪里来、何时出现以及如何运动。核心创新是空间感知点轨迹嵌入与轻量适配器,使大量轨迹可注入视频扩散 Transformer,并结合动态、静态和合成数据训练。实验显示其在多参考合成、点轨迹驱动运动控制和静/动态场景相机控制上优于既有方法。

Fine-grained Human Motion Understanding with Language Models Figure 1
2026-06-23cs.CV

Fine-grained Human Motion Understanding with Language Models

Thomas Markhorst, Zhi-Yi Lin, Jouh Yeong Chew, Jan van Gemert, Xucong Zhang

Delft University of Technology, Honda Research Institute Japan

2026-06-23视觉感知

本文针对视频输入计算开销大、隐私敏感且难以保留精细时序的问题,提出 FiGMo:将人体运动表示为带显式时间戳的 2D/3D 骨架姿态序列,并用统一姿态编码器接入 LLM。核心洞察是细粒度运动理解更依赖姿态与运动层级的多样监督,分阶段训练增益较小。实验在 BABEL-QA、HuMMan-QA、CompMo、NTU-RGB+D、QEVD-Coach 等基准达到 SOTA,且仅用 2D 骨架也超过部分 3D 方法。

Toward Parking Spot Occupancy Recognition: A Self-Supervised Approach Figure 1
2026-06-23cs.CV

Toward Parking Spot Occupancy Recognition: A Self-Supervised Approach

Luan Marko Kujavski, Rayson Laroca, Paulo Lisboa de Almeida

2026-06-23视觉感知

面向停车场占用识别中目标场景标注成本高、跨环境精度下降的问题,本文将 SimCLR/ResNet-50 扩展为“通用无标注预训练—停车场无标注自监督微调—通用有标注微调”的流程,并在部署初期继续收集目标场景无标注图像训练专用模型。三数据集留一环境实验显示,强通用模型平均准确率达 97.2%,两阶段部署提升至 97.8%,但增益来源可能主要来自目标无标注数据适配。

FOCA: Future-Oriented Conditioning for Data-Efficient Vision-Language-Action Adaptation Figure 1
2026-06-23cs.CV

FOCA: Future-Oriented Conditioning for Data-Efficient Vision-Language-Action Adaptation

Duc Minh Nguyen, Nghiem Tuong Diep, Binh Gia Nguyen, Trong-Bao Ho, Doanh Le, Tan Q. Nguyen, Thien-Loc Ha, Nhiem Tran, Bao Thach, Nhat X. Tran, Tuan A. Tran, Artur Habuda, Philip Lund Møller, Tran Nguyen Le, Daniel Sonntag, Matthias Niepert, Khoa D. Doan, Vu Duong, Hung Ngo, Minh N. Vu, Duy M. H. Nguyen, An Thai Le, Ngo Anh Vien

adaptation. Our code is available at this link., Center for AI Research, VinUniversity, University of Utah, USA, German Research Center for, Technical University of Denmark, University of Oldenburg, Germany, University of, Max Planck Research School for Intelligent, enabling scalable robotic control across tasks, embodiments, only by the number of action-labeled trajectories, but also, labels (Eysenbach et al., 2021).

2026-06-23视觉语言视觉感知

本文针对VLA模型在10–30条示范下适应性能急剧下降的问题,提出FOCA:不再只做逐步行为克隆,而是利用示范中的未来帧,在潜空间显式预测任务相关的机器人—物体交互嵌入,并隐式对齐未来目标观测,还可用无动作合成视频协训。实验显示其在LIBERO 20示范达95.7%成功率,在RoboCasa提升7–12%,真实机器人最高绝对提升26%。

Stochastic Signed Distance Processes Figure 1
2026-06-23cs.CV

Stochastic Signed Distance Processes

Hiroki Sakuma, Masatoshi Okutomi

Department of Systems and Control Engineering, Institute of Science Tokyo

2026-06-23视觉感知

本文针对 NeuS/VolSDF 将 SDF 映射为局部衰减系数时难以刻画空间相关几何与历史可见性依赖的问题,提出将沿射线的 SDF 建模为随机过程 SSDP,用首次穿越时间分布重写概率表面渲染,并用贝叶斯滤波及可并行近似计算区间命中概率。实验在 DTU 与 MobileBrick 上显示其重建质量和不确定性估计优于基线,同时说明 NeuS 可视为该框架特例。

Translating Inference-Time Control to Radiology Vision-Language Models: Activation Steering for Pneumonia Classification on Chest X-rays Figure 1
2026-06-23cs.CV

Translating Inference-Time Control to Radiology Vision-Language Models: Activation Steering for Pneumonia Classification on Chest X-rays

Eduardo Moreno Judice de Mattos Farina, Mateus A. Esmeraldo, Felipe Akio Matsuoka, Paulo Eduardo de Aguiar Kuriki, Felipe Campos Kitamura

Department of Radiology, Stanford University School of Medicine, University of Texas Southwestern Medical Center (UTSW)

2026-06-23视觉语言视觉感知规划控制

这篇论文针对医学视觉语言模型在胸片肺炎判断中受提示与阈值影响较大的问题,考察无需微调的推理时激活转向是否能作为操作点控制手段。作者用CAA构造文本、图像条件和答案偏置向量,并加入阈值校准与反向/随机控制,指出固定阈值F1提升并不等同诊断改进;主要有效结果集中在NV-Reason-CXR-3B,校准F1由0.7692升至最高0.8727,其他模型增益有限或置信区间不稳。

From Uncertainty to Stability and Fidelity: Guiding Sparse-View 3D Gaussian Splatting with Fisher Information Figure 1
2026-06-23cs.CV

From Uncertainty to Stability and Fidelity: Guiding Sparse-View 3D Gaussian Splatting with Fisher Information

Junbao Zhou, Qingshan Xu, Yuan Zhou, Xiaolong Shen, Beier Zhu, Kesen Zhao, Yiming Zeng, Chen Bai, Cheng Lu, Hanwang Zhang

2026-06-23三维安全鲁棒

针对稀疏视角下 3D Gaussian Splatting 易过拟合、深度增强和 Dropout 依赖随机策略导致优化不稳定的问题,本文用 Fisher Information 为训练过程提供定量指导:一方面主动选择信息量更高的支撑视角生成更可靠的伪真值,另一方面按每个 Gaussian 的不确定性自适应调整 dropout 概率并引入 soft-scale dropout。实验在 LLFF、Mip-NeRF 360、DTU 等基准上报告达到稀疏视角新视角合成的 SOTA,并显示 PSNR 方差下降、平均质量提升。

NeoLoc-68: End-to-end 68-point neonatal facial landmark localisation in neonatal clinical environments Figure 1
2026-06-23cs.CV

NeoLoc-68: End-to-end 68-point neonatal facial landmark localisation in neonatal clinical environments

Abdullah Bin-Obaid, Maria M. Cobo, Rebeccah Slater, Lionel Tarassenko, Mauricio Villarroel

Institute of Biomedical Engineering, Department of Engineering Science, University of Oxford, Oxford, United Kingdom, Department of Paediatrics, University of Oxford, Oxford, United Kingdom

2026-06-23视觉感知

面向新生儿疼痛评估等非接触监测,论文指出成人/儿童人脸关键点模型在NICU中受遮挡、姿态和模糊影响明显失效。NeoLoc-68将多源公开人脸数据统一到68点标注,并加入临床新生儿帧,以预训练新生儿人脸检测器初始化YOLO关键点回归,实现端到端全帧定位。结果显示其在公开集达到最佳总体指标,在临床集微调后检测失败率降至1.77%,但精度仍受领域差异和遮挡限制。

GroundShot: Visually Consistent Multi-Shot Long Video Generation via Entity-Grounded Shot Scheduling Figure 1
2026-06-23cs.CV

GroundShot: Visually Consistent Multi-Shot Long Video Generation via Entity-Grounded Shot Scheduling

Yixuan Lai, Tianjia Shao, Kun Zhou, Weijia Dou, Siyu Zhu, Jingdong Wang

State Key Lab of CAD&CG, Zhejiang University, Fudan University

2026-06-23视觉感知

这篇论文针对长视频多镜头生成中角色、物体和场景随镜头累积漂移的问题,提出关键洞察:观众通常以实体首次清晰出现作为“规范参考”。GroundShot不改模型、不训练新模块,而是按实体建立视觉记忆,优先生成更适合作为参考的镜头,并通过实体定位、质量筛选和参考检索来约束后续镜头。作者还提出GroundBench做实体级一致性评测,实验显示其相较现有多镜头方法提升一致性,但具体增益幅度在给定片段中未充分说明。

World Action Models: A Survey Figure 1
2026-06-23cs.RO

World Action Models: A Survey

Qiuhong Shen, Shihua Zhang, Yue Liao, Qi Li, Zhenxiong Tan, Shizun Wang, Shuicheng Yan, Xinchao Wang

National University of Singapore

2026-06-23强化学习

针对具身智能中 VLA 只做观察到动作映射、缺少对自身干预后果建模的问题,本文将 World Action Models 界定为“预测未来并服务动作”的模型族,并用生成到像素、潜空间预测、无视频生成三类设计及四轴组件分解统一整理文献。主要洞察是 WAM 不是给视频生成器加动作头,而是在未来表征丰富度与算力、延迟、动作标注成本之间取舍;领域趋势是少生成未来,但保留控制所需信息。

TriMotion: Modality-Agnostic Camera Control for Video Generation Figure 1
2026-06-23cs.CV

TriMotion: Modality-Agnostic Camera Control for Video Generation

Seunghyun Shin, Jifei Song, Wooseok Jeon, Hae-Gon Jeon, Jiankang Deng

2026-06-23视觉感知规划控制

针对现有相机可控视频生成通常绑定单一输入形式、难以兼顾易用性与几何精度的问题,TriMotion 将视频、相机位姿和文本轨迹对齐到共享运动嵌入空间,并用由外参生成描述的 Motion Triplet Dataset 监督跨模态一致性;其潜空间运动一致性约束避免反复像素解码。实验显示模型在三种输入下都能更准确跟随目标相机运动,并支持顺序运动组合与跨模态插值。

UniSLAD: A Unified Framework for Structural and Logical Industrial Visual Anomaly Detection Figure 1
2026-06-23cs.CV

UniSLAD: A Unified Framework for Structural and Logical Industrial Visual Anomaly Detection

Changyi Li, Chao Yang, Yu Xiao, Kari Tammi

2026-06-23视觉感知

工业视觉检测中结构缺陷与逻辑异常常同时出现,但前者依赖局部纹理、后者需要全局关系理解,单一 CNN 或 Transformer 难以兼顾。UniSLAD 将 ResNet 与 ViT 组成双特征提取器,并在 patch 级用 Mahalanobis 变换增强记忆库、在图像级用 LUM-PMP 聚合构建分布表示,以无额外训练方式融合两类证据。在 MVTec AD 和 LOCO AD 上分别达到 99.4% 与 93.1% AUROC,消融显示各模块有效。

One Image is All You Need: Agentic One-Shot Image Generation via Text-Based World Models for Long-Tail Spatial Perception Figure 1
2026-06-23cs.CV

One Image is All You Need: Agentic One-Shot Image Generation via Text-Based World Models for Long-Tail Spatial Perception

Keqin Zeng, Shuting Su, Shihao Lin, Ziyue Li, Rui Zhao

2026-06-23视觉感知强化学习

这篇论文针对自动驾驶、海事监控等空间感知中罕见场景数据稀缺导致检测器长尾失效的问题,提出 WMGen-v1:从单张参考图像中由 LVLM 抽取几何、语义和空间约束,再由 LLM 在物理常识约束下扩展场景,最后驱动扩散模型生成训练样本。实验显示其在 ROADWork、LaRS 和内部数据上优于常规合成基线,纯合成数据训练的检测器在总体指标上接近真实数据训练,但具体增益来源仍可能与生成规模和筛选策略有关。

Mirage: a Clean-Label Backdoor against LiDAR 3D Object Detection Figure 1
2026-06-23cs.CV

Mirage: a Clean-Label Backdoor against LiDAR 3D Object Detection

Ziba Parsons, Ang Li

2026-06-23视觉感知三维

面向自动驾驶/机器人中依赖 LiDAR 3D 检测的安全风险,论文指出现有后门多需改标签或白盒能力,低估了数据采集阶段的攻击面。Mirage 通过少量标签一致点云投毒,在黑盒设定下学习触发器到目标类别的关联,可将行人/骑行者定向误判为车。实验称仅 0.5% 投毒率即可达到 73% 误分类成功率,且正常检测性能接近干净模型。

An approach with Visual and Tabular Mamba to multimodal medical data using Mixed Fusion Figure 1
2026-06-23cs.CV

An approach with Visual and Tabular Mamba to multimodal medical data using Mixed Fusion

Matheus B. Rocha, Gustavo B. Dettogni, Renato A. Krohling

Labcin - Nature Inspired Computing Lab, Federal University of Espírito Santo, PPGI - Graduate Program in Computer Science, Federal University of Espírito, tection. In Brazil, recent estimates from the National Cancer Institute (INCA)

2026-06-23视觉语言

针对医学多模态癌症诊断中图像、临床/人口学数据融合常牺牲可解释性的问题,本文将视觉 Mamba 与表格 Mamba 串接进 Mixed Fusion:先由图像模型输出类别概率,再与表格特征共同判别,并可用 SHAP 解释。实验在皮肤与口腔癌数据集上显示,PAD-UFES-20 的 balanced accuracy 略低于 Transformer 基线,NDB-UFES 表现更好,召回率有明显提升,但具体增益来源仍不完全清楚。

No Figure
2026-06-23cs.CV

REKEY: Metadata-Grounded Visual-Key Regeneration for Contamination-Resilient VQA Evaluation

Tengjie Lin, Yutao Sun, Jingwei Ni, Shuhan Ge, Hao-Xuan Ma, Yanting Miao, Wangyue Lu, Mingshuai Chen, Tiancheng Zhao, Jianwei Yin

Zhejiang University, Nanjing University of Science and Technology, Nanjing University, University of Waterloo, Binjiang Institute of Zhejiang University

2026-06-23数据集/基准

这篇论文针对静态 VQA 基准泄漏后分数混入记忆而非真实视觉搜索能力的问题,提出 ReKey:只在真实图像中重新生成决定答案的局部“视觉钥匙”,由人工一次标注可编辑槽位,并用生成元数据直接构造标签,以兼顾新答案、难度保持和标签可靠性。在 V*Bench 上,8 个前沿 VLM 在原题上的准确率比重生成版本高 9.5–18.8 个百分点,显示原基准存在明显污染增益。

Robust Zero-Shot Generalization for Open-Vocabulary Action Recognition via Task Arithmetic Figure 1
2026-06-23cs.CV

Robust Zero-Shot Generalization for Open-Vocabulary Action Recognition via Task Arithmetic

Francesca Morandi, Omayma Moussadek, Federico Venturini, Mauro Suardi, Alessandro Banzatti, Francesco Cannarile, Angelo Porrello, Simone Calderara

University of Modena and Reggio Emilia, University of Pisa, trained base model. Code is available at https://github.com/, and scalable approach for open-vocabulary action recogni-, available datasets [9]–[12], from which we extract the corre-, fully merge models fine-tuned on diverse, publicly available

2026-06-23视觉感知学习理论安全鲁棒

这篇论文针对开放词汇动作识别在真实场景中常需敏感域内视频微调的问题,提出不采集目标域数据,而是从多个公开数据集微调模型中提取任务向量,并用任务算术/模型合并重组已有知识。实验显示,合并后的模型在OOD零样本设置下优于预训练基线,说明参数空间聚合可带来一定鲁棒泛化,但具体增益可能受源数据多样性与缩放策略影响。

XmoPipe: A Pipeline for Large-Scale In-the-Wild Human Motion Dataset Construction Figure 1
2026-06-23cs.CV

XmoPipe: A Pipeline for Large-Scale In-the-Wild Human Motion Dataset Construction

Nathan Salazar, Emmanuel Dellandréa, Mathieu Lefort, Alexandre Meyer

2026-06-23数据集/基准

针对传统 MoCap 数据昂贵、规模和场景多样性不足的问题,XmoPipe提出从少量关键词出发自动检索公开视频、筛选分段,并用单目重建与视频语言模型生成带文本描述的SMPL-X人体/面部运动数据。其洞察在于用可定制流水线把野外视频转为可训练的伪GT运动语料,支持多人和语义丰富场景。实验显示,该数据与MoCap结合可提升重建泛化,训练MDM的文本到运动生成质量接近MoCap数据且覆盖更广动作,但增益可能主要来自scaling/data。

VTOS: Learning to Orchestrate Vision Tools by Co-Searching Solutions and Observers Figure 1
2026-06-23cs.CV

VTOS: Learning to Orchestrate Vision Tools by Co-Searching Solutions and Observers

Jinchao Ge, Lingqiao Liu, Shuwen Zhao, Lei Wang

University of Wollongong, Adelaide University, Tianjin University of Technology

2026-06-23视觉感知

这篇论文针对视觉基础工具虽强但依赖人工/固定编排、在密集目标、遮挡、小病斑和域外场景中易失效的问题,提出 VTOS:同时搜索可执行的工具调用方案和用于诊断失败的观察器,并把经验写入 VisionThoughts 知识库迭代改进。实验在 LVIS-Count 密集计数和 PlantSeg-OOD 零样本病害分割上优于静态流水线与视觉编程基线,说明主要收益来自可审计的闭环诊断与参数/流程自适应。

How Well Can Your Video Model Remember? Measuring Memory-Budget Trade-offs in Long Video Understanding Figure 1
2026-06-23cs.CV

How Well Can Your Video Model Remember? Measuring Memory-Budget Trade-offs in Long Video Understanding

Yixian Tian

Fudan University, Beijing University of Posts and Telecommunications

2026-06-23视觉感知

长视频模型在固定帧预算下常需回忆很久以前的事件,但现有评测难以区分“帧数不够”和“时间太远”的影响。本文提出用预算指数 α(D) 描述额外帧在不同时间距离上的边际价值,并在约15.5万次预测上拟合预算—距离经验律。结果显示,StreamingVLM 在1000秒回忆距离上的预算有效性约为最佳基础模型的7.4倍,10倍帧预算带来约29个百分点提升,而采样策略的收益随模型和距离变化。

D2HDMap: Non-visible Driveline Map Prior for Online Vectorized HD Map Prediction Figure 1
2026-06-23cs.CV

D2HDMap: Non-visible Driveline Map Prior for Online Vectorized HD Map Prediction

Seojun Shon, Chikao Tsuchiya, Dhaval Bhanderi, David Ilstrup, Hsinmin Cheng, Christopher Ostafew

2026-06-23视觉感知

本文针对自动驾驶中完整高精地图维护成本高、纯在线建图又易受远距感知与遮挡限制的问题,提出 D2HDMap:用轻量的非可见车道中心线/行驶线先验替代完整可见地图先验,引导车道线、边界和人行横道等矢量化预测,并通过位姿噪声训练增强定位误差鲁棒性。在 nuScenes 与 Argoverse 2 消融中,模型在缺少先验时仍能保持性能,地理分离划分上达到 44.8 mAP,超过近期方法。

Evaluation of Medical Vision Language Models HuluMed and MedGemma, and general purpose chatbots Gemma 3, ChatGPT Plus, and Claude Pro on real previously unseen wound images Figure 1
2026-06-23cs.CV

Evaluation of Medical Vision Language Models HuluMed and MedGemma, and general purpose chatbots Gemma 3, ChatGPT Plus, and Claude Pro on real previously unseen wound images

Yunzhe Xue, Mohammed Saim Ahmed Quadri, Neal Panse, Justin W. Ady, Usman Roshan

∗ Department of Computer Science, New Jersey Institute of Technology, Newark, NJ, USA, ‡ Department of Data Science, New Jersey Institute of Technology, Newark, NJ, USA, from real patients by the collaborating medical team

2026-06-23视觉感知数据集/基准三维

慢性伤口评估依赖医生经验且管理决策差异大,本文用20例真实、此前未见的多类型伤口图像和12项临床问题,比较医学专用与通用VLM在诊断和处置推理上的可靠性。核心洞察是医学微调并未带来优势,通用前沿模型更强:ChatGPT达72.50%,Claude为62.08%,而最佳开源/医学模型HuluMed仅40.00%,提示当前系统仍不适合自主临床决策。

Multimodal Image Colorization: Quantifying the Impact of Text-Conditioned Guidance on Grayscale-to-Color Translation Figure 1
2026-06-23cs.GR

Multimodal Image Colorization: Quantifying the Impact of Text-Conditioned Guidance on Grayscale-to-Color Translation

Colten Reissmann, Hugo Garrido-Lestache Belinchon

2026-06-23视觉语言视觉感知

本文针对灰度图上色存在多解、难以仅凭亮度确定语义颜色的问题,做了较干净的受控消融:在 U-Net 与 Stable Diffusion 1.5 两个尺度中只改变是否加入 CLIP 文本条件。结果显示文本条件在两类模型上均提升 PSNR/SSIM 和感知质量,U-Net 色彩丰富度增益更大,说明文本主要缓解颜色歧义,且对缺少预训练视觉先验的模型更关键。

MIRAGE: Stealthy Visual Prompt Injection for Vulnerability Detection in Web Agents Figure 1
2026-06-23cs.CV

MIRAGE: Stealthy Visual Prompt Injection for Vulnerability Detection in Web Agents

Xuelong Dai, Jianyu Ma, Boyang Ma, Biwei Yan, Yijun Yang, Yue Zhang

2026-06-23视觉感知

本文关注截图驱动的多模态网页代理在受信任网站中被第三方视觉区域诱导的风险:攻击者仅能控制广告位、商品图等局部区域。MIRAGE 的核心是将注入限制在掩码内,用扩散先验生成自然图像,并结合曲率感知引导与稀疏暗像素残差实现定向下一步动作劫持。实验在 SeeAct、OpenClaw 上显示其比现有截图或文本注入基线更隐蔽且更有效,但仍依赖白盒梯度,黑盒迁移性文中未充分说明。

CDER-SME: A Cross-Device Event-RGB Micro-Expression Dataset under Multi-Level Stress Induction Figure 1
2026-06-23cs.CV

CDER-SME: A Cross-Device Event-RGB Micro-Expression Dataset under Multi-Level Stress Induction

Jingting Li, Hui Sha, Su-Jing Wang

2026-06-23数据集/基准

微表情识别在真实高压场景中受限于RGB帧率、实验诱发不自然和跨设备标定困难。CDER-SME用认知与社交多级压力诱发自发微表情,并构建解耦Event-RGB采集、时空对齐流程和三层数据集;包含92名受试者、1963个专家标注样本,其中790对Event-RGB与210对高精度对齐样本。基线显示跨模态融合优于单模态,说明事件动态与RGB外观具有互补性。

Video2Code: Generating Interactive Webpages from UI Videos via Action-Aware Revisit Figure 1
2026-06-23cs.CV

Video2Code: Generating Interactive Webpages from UI Videos via Action-Aware Revisit

Mingde Xu, Zhen Yang, Yan Wang, Yu Wang, Xijun Liu, Zijun Dou, Wenyi Hong, Xiaotao Gu, Bin Xu, Jie Tang

University of Waterloo, Tsinghua University, Beihang University

2026-06-23视觉感知

这篇论文针对 UI 视频生成可交互网页时,稀疏采样易漏掉点击、滚动等短暂动作边界,导致状态转移与代码行为不一致的问题。核心思路是把任务重定义为可执行状态转移恢复,并提出 Action-Aware Revisit:先粗看全视频定位关键动作片段,再高时间分辨率回看这些片段后生成 HTML/CSS/JS。实验表明,相比直接视频观察,Video2Code 在功能正确性和交互覆盖上更好,尤其适合多步密集交互场景。

TeleStyle V2: Beyond Content-Preserving Style Transfer with Self-Distillation and Distribution-Matching-Distillation Figure 1
2026-06-23cs.CV

TeleStyle V2: Beyond Content-Preserving Style Transfer with Self-Distillation and Distribution-Matching-Distillation

Shiwen Zhang, Yifan Xu, Haibin Huang, Chi Zhang, Xuelong Li

2026-06-23视觉感知

TeleStyle V2针对V1只能处理“真实内容+艺术风格”、难以应对风格化内容或真实风格且会混淆参考图顺序的问题,利用V1自蒸馏构造RnR/RnS/SnR/SnS四类内容-风格-目标三元组,并用DMD缓解SFT导致的内容一致性退化、保留通用图像编辑能力,再以VLM提示增强解决顺序混淆。实验称其风格迁移接近Gemini 3 Pro Image Preview,通用编辑与Qwen-Image-Edit-DMD相当。

GEOPHYS: The Geometry of Physical Plausibility Figure 1
2026-06-23cs.CV

GEOPHYS: The Geometry of Physical Plausibility

Christian Internò, Alexander Pondaven, Habon Issa, Fabio Pizzati, Francesco Pinto, Markus Olhofer, Ivan Laptev, Philip Torr, Eero P. Simoncelli, Barbara Hammer, David Klindt

Bielefeld University, University of Oxford, Cold Spring Harbor Laboratory, Honda Research Institute EU, New York University, Flatiron Institute, Simons Foundation

2026-06-23视觉感知

这篇论文针对现有视频物理合理性检测依赖多模态大模型、视频预训练或专门训练、成本高的问题,提出无需训练的 GeoPhys:用冻结图像编码器逐帧特征轨迹的速度、曲率、加速度和预测残差等几何统计来评分。结果显示该信号与人类 EEG 中物体恒存违背反应相关,并在 LikePhys、IntPhys2 上达到 98.3%/93.3%,还可作为生成视频的 best-of-N 验证器提升 PhysicsIQ 表现且更省算力。

MotionPyramid: Hierarchical Motion Representation and Residual Interfaces Figure 1
2026-06-23cs.CV

MotionPyramid: Hierarchical Motion Representation and Residual Interfaces

Gao Zhu, Zaishuo Xia, Yubei Chen

2026-06-23视觉感知

论文动机是解决人形机器人控制中单一动作接口难以兼顾粗粒度探索效率与细粒度反馈精度的问题。MotionPyramid 从运动跟踪教师中预训练递归潜变量解码层级,将高层潜变量展开为较长运动片段、低层保留即时控制,并通过残差接口让下游策略同时使用粗上下文和细修正。实验显示粗层提升早期学习与动作平滑性,细层保持最终精度,但评估仅限少量仿真任务,统计稳定性文中未充分说明。

No Figure
2026-06-23cs.CV

Robust Image-Driven Phenotyping of Ovarian Tumor Cells using Optimized Dynamic Features in Hyperbolic Channels

Hong-Fei Li, Xi-Lin Gao, Yi-Juan Xiang, Shu-Song Huang, Yi-lin Wang, Chun-Dong Xue, Zhuo Yang, Yong-Jiang Li, Xu-Qu Hu

Cancer Hospital of Dalian University of Technology, Dalian University of Technology, Shenyang 110000, China, Faculty of Medicine, Dalian University of Technology, Dalian 116024, China, The Queen’s University of Belfast Joint College, China Medical University, Shenyang 110122, China

2026-06-23视觉感知安全鲁棒

该文针对双曲微流道中细胞动态图像特征易受流速扰动、导致分类边界混入水动力伪差的问题,提出跨流速稳定性筛选框架,从93维形态、运动和胞内光密度轨迹中选出任务相关鲁棒特征。结果显示二分类压缩为20维、癌症亚型为25维,亚型任务主成分中的流速方差占比由69.9%降至9.3%,并在多种机器学习模型和受限采样下保持诊断性能。

Beyond Templates: Revisiting Zero-Shot Remote Sensing through Meta-Prompting Figure 1
2026-06-23cs.CV

Beyond Templates: Revisiting Zero-Shot Remote Sensing through Meta-Prompting

Eirini Baltzi, Dionysis Christopoulos, Sotiris Spanos, Valsamis Ntouskos, Konstantinos Karantzalos

Remote Sensing Lab, National Technical University of Athens, Department of Engineering and Sciences, calibration · centering · retrieval · scene classification, and text-side centering, analyzing their asymmetric impact on classification and text-to-image retrieval., • Embedding calibration analysis. We study simple embedding-centering strategies and show task-dependent, effects: image centering consistently benefits classification, while text centering is more effective for retrieval.

2026-06-23视觉感知

针对遥感零样本识别中提示词对VLM表现影响大、通用模板难以描述俯视场景的问题,本文系统比较12个数据集、17种VLM和多种LLM元提示。核心洞察是,LLM生成的丰富类别描述并不稳定优于领域模板,反而可能在文本嵌入空间引入噪声;简单的查询嵌入中心化校准更可靠,图像侧中心化提升分类,文本侧中心化更利于检索,且遥感适配VLM整体优于通用模型。

AEF-Econ: Toward Plug-and-Play Socioeconomic Foundation Embeddings from AlphaEarth for Urban Remote Sensing Figure 1
2026-06-23cs.CV

AEF-Econ: Toward Plug-and-Play Socioeconomic Foundation Embeddings from AlphaEarth for Urban Remote Sensing

Shuyang Hou, Ziqi Liu, Haoyue Jiao, Lutong Xie, Yaxian Qing, Xiaopu Zhang, Qingyang Xu, Zhangyan Xu, Xuefeng Guan, Huayi Wu

*a. State Key Laboratory of Information Engineering in Surveying, Mapping, and Remote Sensing, Wuhan University, Wuhan, China, CHN-Econ, a socioeconomic benchmark with 16 labels in three categories. We conduct 31, .693, and restores collapsed labels from negative R² to a stable range. Using CAR, we infer 14.4

2026-06-23视觉感知

本文针对 AlphaEarth Foundations 偏重物理地表表征、在城市社会经济任务中即插即用能力不足的问题,融合 AEF、人口、夜光、POI、形态与跨语言文本等七类数据,构建 CHN-Econ,并指出共享重建会压制低维语义流。其 CAR 机制用分流解码和流级损失缓解容量竞争,使跨区域 R² 从 AEF 单独的 0.301 提升到 0.848,跨层级从 0.160 提升到 0.693。

Spatio-Temporal Wildfire Spread Prediction in Canada using a Video Swin-Hybrid-U-Net and Satellite Imagery Figure 1
2026-06-23cs.CV

Spatio-Temporal Wildfire Spread Prediction in Canada using a Video Swin-Hybrid-U-Net and Satellite Imagery

Maulik Srivastava, Esha Saha, Hao Wang

Faculty of Science, University of Alberta, Interdisciplinary Lab for Mathematical Ecology & Epidemiology (ILMEE), University of Alberta, Department of Mathematical and Statistical Sciences, University of Alberta

2026-06-23视觉感知

加拿大野火规模和风险上升,但既有模型常难同时适配本地生态、捕捉短时天气变化且可复现性不足。本文将三天火点、气象、土壤、地形、植被等公开遥感数据建模为视频到图像分割任务,用 Video Swin 编码器结合 U-Net 解码器学习时空依赖,预测次日火灾分布。结果显示模型能较好生成空间显式的火情图,但具体相对基线增益与误差来源文中未充分说明。

NeoJaundice-AI: Smartphone-Based Neonatal Jaundice Detection Using Dual-Input Deep Learning and Synthetic Augmentation Figure 1
2026-06-23cs.CV

NeoJaundice-AI: Smartphone-Based Neonatal Jaundice Detection Using Dual-Input Deep Learning and Synthetic Augmentation

Rahul Patel, Nirjala Jarpula

2026-06-23视觉感知

面向印度农村新生儿黄疸筛查中抽血检测昂贵、深肤色样本不足的问题,本文提出手机端离线系统,用皮肤与巩膜双输入 EfficientNet-B0 融合 YCbCr 颜色特征,并用合成黄疸增强缓解严重病例和深肤色数据稀缺。报告四级分类准确率91.8%、临床敏感度93.5%、胆红素MAE 1.4 mg/dL,量化后8.3MB、3秒内推理;但临床前瞻验证仍文中未充分说明。

ARGUSTRACK: A Multi-View Annotation System for Multi-Object Tracking Figure 1
2026-06-23cs.CV

ARGUSTRACK: A Multi-View Annotation System for Multi-Object Tracking

Hao Vo, Duc Nguyen, Ngan Le

AICV Lab, University of Arkansas, USA

2026-06-23视觉感知

多相机多目标跟踪受限于跨视角标注成本和身份一致性维护,尤其在动物监测等仅用相机的场景中。ArgusTrack 的核心做法是把标注从单视角图像转到标定后的 BEV 平面,一次地面点标注自动投影到各相机,并结合时间传播与检测器辅助生成候选位置。肉鸡多相机试验显示,其相较传统单相机流程显著缩短标注时间,消融中从 150s 降至 113s、102s。

Shear-Free Viewport Magnification for 360-Degree via Spherical Mobius Boosts Figure 1
2026-06-23cs.CV

Shear-Free Viewport Magnification for 360-Degree via Spherical Mobius Boosts

Boyang Li, Hezhao Xu

Peking University

2026-06-23视觉感知

这篇论文针对360度图像在固定采样预算下难以同时提升视口清晰度并避免形变的问题,提出用球面Möbius boost将样本共形地集中到预测视口,核心洞察是其可放大局部但保持角度、无剪切。实验在SUN360的216个目标上显示,C1相对优化offset cubemap视口PSNR中位提升约3.26 dB,但代价是全景WS-PSNR下降,适用于预测准确的注视区域而非通用布局。

Open Annotations and Synthetic Data for Field Localisation in Indian Bank Cheques Figure 1
2026-06-23cs.CV

Open Annotations and Synthetic Data for Field Localisation in Indian Bank Cheques

Jaganadh Gopinadhan

2026-06-23视觉感知

面向印度支票自动处理中的字段定位缺少公开标注和可再分发数据的问题,论文为112张IDRBT支票补充六类字段框,并用剪贴式流程生成295张合成支票,同时给出ResNet-50直接回归基线。关键结果反而是否定性的:固定版式下,仅预测训练集平均框已达0.691 mIoU和80% IoU≥0.5准确率;控制随机种子和计算量后,合成数据相对真实数据无可测增益,提示此类文档更需要布局变化而非外观增强。

A UAV-Based Multi-Modal Vision System for Automated Sideslope Deformation Monitoring and Hazard Detection Figure 1
2026-06-23cs.CV

A UAV-Based Multi-Modal Vision System for Automated Sideslope Deformation Monitoring and Hazard Detection

Jingfeng Zhang, Yi Li, Xianchong Liang, Huan Yang

aSouth China Normal University, Foshan, Guangdong, China, capacity, the flexibility and rapid deployability of UAVs have revealed strong potential to replace labor-intensive, processing unordered 3D point clouds. RandLA-Net further improved the scalability (Hu et al., 2020) of point-cloud

2026-06-23视觉感知

针对高速公路边坡人工巡检低效、危险且难以发现植被覆盖下厘米级早期变形的问题,论文构建了无人机载 LiDAR 端到端流程:先提取地表点云,再用 RandLA-Net 做单次观测隐患筛查,并用多期网格高程差分监测变形。实地、受控形变与仿真实验显示,该流程可在植被场景获得可用地表点云、定位潜在滑坡/落石/侵蚀区域,并量化厘米级高程变化。

Beyond ROC-AUC: Operating-Point Performance Reporting for Biometric Verification Figure 1
2026-06-23cs.CV

Beyond ROC-AUC: Operating-Point Performance Reporting for Biometric Verification

Ajan Ahmed, Masudul H. Imtiaz

2026-06-23视觉感知

本文针对生物特征验证常用 ROC-AUC/EER 难以反映部署阈值的问题,强调应按 ISO/IEC 19795-1 报告低误匹配率下的 DET 曲线、固定 FMR 的 FNMR/TMR 及置信区间。作者在脸、声纹、虹膜、指纹七个预训练匹配器上验证,发现全 AUC 更高的系统在 FMR=10^-3 时可能显著更差,FaceNet 与 ArcFace 的排序甚至反转。

MemoryVAM: Integrating Memory into Video Action Model for Robot Manipulation Figure 1
2026-06-23cs.RO

MemoryVAM: Integrating Memory into Video Action Model for Robot Manipulation

Yuxin Jiang, Chang Yu, Yunuo Chen, Xiang Feng, Yin Yang, Nishank Gite, Chenfanfu Jiang

University of California, Los Angeles, 2 Nirvana Robotics, University of California, San Diego, 4 University of Utah

2026-06-23机器人视觉感知

MemoryVAM针对视频世界模型策略只看短时观测、在计数/顺序/遮挡等长程操作中无法区分相似状态的问题,引入情节记忆:用Recap-Cue模块把历史CLIP特征压缩为记忆token,并同时注入视频预测骨干和动作解码器,使“想象未来”和执行动作共享任务进度。在LIBERO-Mem上平均成功率由5%升至42.5%,真实机器人在计数、空间回忆和顺序跟踪任务上约75%–80%成功。

Democratizing and accelerating AI-driven pathology research through agentic intelligence Figure 1
2026-06-23cs.AI

Democratizing and accelerating AI-driven pathology research through agentic intelligence

Jiabo Ma, Cheng Jin, Yihui Wang, Hao Jiang, Ling Liang, Yingxue Xu, Junlin Hou, Zhengrui Guo, Zhengyu Zhang, Yifei Xia, Hongyi Wang, Fengtao Zhou, Zhe Xu, Huajun Zhou, Jiarui Ouyang, Qian Zeng, On Ki Tang, Eunhyang Park, Carolyn Glass, Ronald Cheong Kin Chan, Li Liang, Hao Chen

Department of Computer Science and Engineering, Hong Kong University of Science and Technology, Hong Kong SAR, China, Department of Pathology, Nanfang Hospital, School of Basic Medical Sciences, Southern Medical University, Guangzhou, China, Guangdong Province Key Laboratory of Molecular Tumor Pathology, Guangzhou, China, Jinfeng Laboratory, Chongqing, China, Department of Anatomical and Cellular Pathology, The Chinese University of Hong Kong, Hong Kong SAR, China, Pathology Artificial Intelligence Development and Assessment Laboratory, State Key Laboratory of Translational, Oncology, The Chinese University of Hong Kong, Hong Kong SAR, China, Department of Pathology, Severance Hospital, Yonsei University College of Medicine, Seoul, South Korea, Department of Pathology, Duke University Medical Center, Durham NC, USA, Department of Chemical and Biological Engineering, Hong Kong University of Science and Technology, Hong Kong SAR, China, Division of Life Science, Hong Kong University of Science and Technology, Hong Kong SAR, China, HKUST Shenzhen-Hong Kong Collaborative Innovation Research Institute, Futian, Shenzhen, China

2026-06-23视觉感知

病理AI虽受基础模型推动,但临床专家仍难将研究设想落成可执行流程,瓶颈在多阶段管线与软件割裂。本文提出 PathLab,用智能体把自然语言目标组合为含预处理、建模、评估和解释的可验证工作流,并检查语义有效性。其在12个公开数据集、四类任务上相对专家管线达到非劣性能,用户研究显示可显著缩短生成可执行分析流程的时间。

Jury Duty: Calibration and Orientation Failures in MLLM-as-a-Judge Under Cultural Ambiguity Figure 1
2026-06-23cs.CV

Jury Duty: Calibration and Orientation Failures in MLLM-as-a-Judge Under Cultural Ambiguity

Daniel Lee, Harsh Sharma, Eunkyu Park, Pranav Narayanan Venkit, Jeonghwan Kim, Kah Mun Chia, Andreas Vlachos, Shafiq Joty

University of Cambridge, University of Colorado Boulder, Carnegie Mellon University

2026-06-23视觉感知

针对多模态模型充当评审时“与人类一致”却未说明代表谁的判断这一问题,论文构建 VOIR DIRE,用中美文化配对图文与双参考人群检验文化歧义下的评审偏向。结果显示六个 MLLM 存在低分不用的正向校准地板和默认文化取向残差,人设提示只能部分校准,示例反而加深偏向,说明应分别报告不同文化池的对齐。

NeuroShield: A Device-Agnostic Foundation Model for EEG Authentication Figure 1
2026-06-23cs.LG

NeuroShield: A Device-Agnostic Foundation Model for EEG Authentication

Matin Fallahi, Patricia Arias-Cabarcos, Thorsten Strufe

2026-06-23视觉感知

针对 EEG 认证模型常被固定头显、通道布局和时间窗绑定、难以跨设备复用的问题,NeuroShield 用双阶段 Transformer 与时空位置编码处理变通道、变长度 EEG,并在 3 个公开数据集上预训练为身份表征模型。迁移到两个未见数据集后,微调相较基线将等错误率降低 0.44–8.06 个百分点,并能适应更长片段、新通道布局及约 10%–30% 通道缺失。

A Projection-Based Surrogate Gradient Interpretation for Neural Codec Wrappers Figure 1
2026-06-23cs.CV

A Projection-Based Surrogate Gradient Interpretation for Neural Codec Wrappers

Esteban Pesnel, Julien Le Tanou, Michael Ropert, Aline Roumy (COMPACT), Thomas Maugey (COMPACT)

2026-06-23优化算法

针对传统视频编解码器中量化、模式选择等离散步骤导致神经前后处理 wrapper 难以端到端训练的问题,本文把 SCALED 替代梯度重新解释为满足近似幂等、强度平移不变和非零压缩误差均值等性质的局部一阶线性投影,而不只是重参数化技巧。实验显示该梯度可从下采样扩展到完整前后处理训练,并在 x264、VVenC、多质量和多缩放设置下相对标准重采样取得最高约 -23.59% 与 -20.07% BD-Rate(PSNR)增益。

SPARC: A Multi-Agent System for Electrical Circuit Question Answering Figure 1
2026-06-23cs.AI

SPARC: A Multi-Agent System for Electrical Circuit Question Answering

Mushtari Sadia, Zhenning Yang, Umme Habiba Lamia, Nishat Shawrin, Ang Chen, Amrita Roy Chowdhury

+University of Michigan, Ann Arbor, ∗Bangladesh University of Engineering and Technology, able faster design cycles, scalable verification, and, Both our datasets and code are publicly available at:, Labels:

2026-06-23视觉感知

电路图问答需要从视觉符号、拓扑连接和物理定律中推导可计算关系,普通多模态 LLM 难以保证推理可靠性。SPARC 的核心思路不是让 LLM 端到端作答,而是由多智能体拆解问题、生成并修复 SPICE 仿真程序,再用仿真日志计算答案,从而把数学推理落到可执行工具上。实验显示其准确率达 83%,相对基线最高提升 58 个百分点,并能按流水线阶段定位错误来源。

A Viscosity Semigroup Framework for Stable Image Reconstruction Figure 1
2026-06-23cs.CV

A Viscosity Semigroup Framework for Stable Image Reconstruction

Arina Oberoi

2026-06-23视觉感知三维

针对医学图像重建中纯学习逆映射缺乏扰动稳定性保证的问题,本文用黏性解与尺度空间半群框架解释“神经重建器后接非线性扩散”的混合算子,核心洞察是连续扩散阶段可由比较原理带来唯一性、非扩张和上确界范数收缩。CT间皮瘤分类实验中AUC约0.875且跨epoch波动很小,优于不稳定基线,但离散实现与性能增益来源仍文中未充分说明。

CourseBlueprint: A Structured Pipeline for Adaptive Pedagogical Video Generation Grounded in Course Corpora Figure 1
2026-06-23cs.CY

CourseBlueprint: A Structured Pipeline for Adaptive Pedagogical Video Generation Grounded in Course Corpora

Md Zabirul Islam, Md Motaleb Hossen Manik, Ge Wang

M. Z. Islam and M. M. H. Manik are with the Department of Computer, Science, Rensselaer Polytechnic Institute, Troy, NY 12180, USA (e-mail:, Rensselaer Polytechnic Institute, Troy, NY 12180, USA (e-mail:

2026-06-23视觉感知

本文针对现有文生视频系统“看起来像教学”但缺少先修顺序、学习者适配和认知参与的问题,提出 CourseBlueprint:用类型化教学契约和课程检索替代自由提示链,生成概念脚手架、风格控制、参与式讲稿,并在高置信检索时直接复用课程幻灯片。五主题消融显示,去掉参与契约会使参与分从 5.00 降至 1.20、适配分从 4.80 降至 3.40;幻灯片覆盖将匹配从 0/9 提升到 9/10。

TIDY: Thermal Infrared Image Denoising via Wavelet Domain Entropy and Directional Stripe Index Figure 1
2026-06-23cs.RO

TIDY: Thermal Infrared Image Denoising via Wavelet Domain Entropy and Directional Stripe Index

Tai Hyoung Rhee, Dong-Guw Lee, Ayoung Kim

2026-06-23视觉感知

TIDY针对室内热红外图像低热对比下随机噪声和固定条纹会破坏机器人估计、而现有方法依赖合成噪声且难以兼顾实时性的痛点,将去噪转到小波域以分离结构与噪声,并提出小波熵和方向条纹指数作为度量与损失。文中称其基于真实成对SCaN-TIR数据训练,可约34Hz运行,在严重退化、零样本场景及热惯性里程计、单目深度等下游任务中带来一致改进。

2026-06-19

124 篇
JanusMesh: Fast and Zero-Shot 3D Visual Illusion Generation via Cross-Space Denoising Figure 1
2026-06-19cs.CV

JanusMesh: Fast and Zero-Shot 3D Visual Illusion Generation via Cross-Space Denoising

Siang-Ling Zhang, Huai-Hsun Cheng, Tsung-Ju Yang, Yu-Lun Liu

2026-06-19三维

本文针对3D视觉错觉生成中SDS优化慢、颜色过饱和,以及简单拼接导致几何接缝和语义泄漏的问题,提出训练-free的JanusMesh。核心思路是在TRELLIS三维潜空间与体素/SDF空间间交替去噪,用CLIP引导视角对齐和SDF融合保证几何连续,再用视角条件纹理合成注入不同语义。实验显示其可在3–5分钟生成双语义网格,并在几何完整性、语义可辨性和效率上优于基线。

TimeProVe: Propose, then Verify for Efficient Long Video Temporal Reasoning in Activities of Daily Living Figure 1
2026-06-19cs.CV

TimeProVe: Propose, then Verify for Efficient Long Video Temporal Reasoning in Activities of Daily Living

Arkaprava Sinha, Dominick Reilly, Siddharth Krishnan, Hieu Le, Srijan Das

University of North Carolina, Charlotte

2026-06-19视觉感知三维

长时 ADL 视频问答的关键证据常只出现在少数细粒度动作片段中,直接用 VLM 全量处理成本高,而稀疏字幕又易丢失时序和手物交互线索。TimeProVe 的核心是先用轻量动作检测与 LLM 生成答案—证据候选,再仅让强 VLM 验证短片段。其在 OTB 上较最强基线提升 7.3%,同时减少 75% VLM 调用和 93% 推理成本,并在 CHARADES-STA 上具备较好泛化。

UNIEGO: Proxies as Mediators for Unified Egocentric Video Representation Learning Figure 1
2026-06-19cs.CV

UNIEGO: Proxies as Mediators for Unified Egocentric Video Representation Learning

Wenhao Chi, Arkaprava Sinha, Dominick Reilly, Hieu Le, Srijan Das

University of North Carolina at Charlotte

2026-06-19视觉感知

该文针对第一视角视频视野窄、遮挡多且难以同时利用外视角、深度、骨架和基础模型知识的问题,提出UNIEGO:先用各类教师训练同构的代理模型,再按样本选择预测正确且置信的代理进行蒸馏,并用代理参数凸组合初始化统一编码器。实验称其在动作识别、视频检索和动作分割的三个ego-exo基准上优于直接多教师蒸馏和既有方法。

Thinking in Boxes: 3D Editing in Real Images Made Easy Figure 1
2026-06-19cs.CV

Thinking in Boxes: 3D Editing in Real Images Made Easy

Pradhaan S Bhat, Naveen Chandra R, Rishubh Parihar, Vaibhav Vavilala, R. Venkatesh Babu, D.A. Forsyth, Anand Bhattad

Indian Institute of Science, Johns Hopkins University

2026-06-19视觉感知三维

针对文本或2D框难以精确表达真实图像中大幅3D位移、旋转和视角变化的问题,论文把用户编辑定义为输入/目标3D盒之间的几何变换,并用带深度线索的平面地面提供全局参照,使扩散编辑模型能统一处理物体运动、遮挡显露和相机变化。模型经合成多物体场景与少量Objectron视频两阶段训练,在真实野外照片的大幅3D编辑上优于近期方法,但相似物体造成的指代歧义和背景细微扰动仍未解决。

The Token Is a Group Element: On Lie-Algebra Attention over Matrix Lie Groups Figure 1
2026-06-19cs.LG

The Token Is a Group Element: On Lie-Algebra Attention over Matrix Lie Groups

Przemyslaw Musialski

New Jersey Institute of Technology

2026-06-19视觉感知

这篇论文针对空间推理中等变注意力依赖向量特征与外部群表示、难覆盖仿射尺度和剪切的问题,提出把 token 直接定义为矩阵李群元素,并用相对位姿的李代数对数范数作为闭式注意力分数。该构造使等变性和相对位姿一致性由群结构自动给出,无需 irrep、球谐或学习核;在 SE(2)、SO(3)、Aff(2) 序列补全中,闭式分数匹配或优于 MLP 核且参数少 50–80 倍,向量 token 基线则显著破坏不变性。

Current World Models Lack a Persistent State Core Figure 1
2026-06-19cs.CV

Current World Models Lack a Persistent State Core

Jinpeng Lu, Dexu Zhu, Haoyuan Shi, Linghan Cai, Guo Tang, Yinda Chen, Jie Cao, Duyu Tang, Yi Zhang, Yong Dai, Xiaozhu Ju

2026-06-19强化学习

本文针对现有视频世界模型只评估画质、运动和相机控制,却不检验遮挡/离视后物体状态是否继续演化的问题,提出 WRBench,将相机运动视为可观测性干预,并用人类校准的分层指标区分控制失败、再观察缺失与状态不一致。对 23 个模型、9600 段视频的评测显示,当前模型常在目标重新出现时停留在离视前状态,问题不随更大参数、更强几何先验或更好可见一致性自然解决。

SSD: Spatially Speculative Decoding Accelerates Autoregressive Image Generation Figure 1
2026-06-19cs.CV

SSD: Spatially Speculative Decoding Accelerates Autoregressive Image Generation

Shilong Xiang, Zirui Zhang, Lijun Yu, Chengzhi Mao

Rutgers University

2026-06-19视觉感知

这篇论文针对自回归图像生成把二维图像展平成一维 token 后推理步数过多、受 memory wall 限制的问题,提出 Spatially Speculative Decoding:利用图像水平与垂直邻域同样可预测的洞察,用轻量头在连续隐空间同时草拟横向和下方 token/块,并通过验证修正。方法无需改动预训练 backbone,在 Lumina-mGPT、Janus-Pro、Emu3 上实现最高约 13.3 倍墙钟加速,同时在 DPG-Bench、GenEval 上保持生成质量。

CalTennis: Large Multi-View Tennis Video Dataset and Benchmark of Monocular-to-3D Pose Estimation Figure 1
2026-06-19cs.CV

CalTennis: Large Multi-View Tennis Video Dataset and Benchmark of Monocular-to-3D Pose Estimation

Ilona Demler, Xinran Xie, Blake Werner, Anna Szczuka, Pietro Perona

California Institute of Technology

2026-06-19视觉感知数据集/基准三维

该文瞄准单目视频到三维人体姿态在真实运动场景中缺少大规模、低成本评测的问题,构建 CalTennis:包含40名网球选手、51小时、1100万帧、2–6个同步视角的视频数据,并用多视角一致性替代昂贵 MOCAP 作为无标注评测信号。核心洞察是标准关节角指标不足以暴露实用误差,因此加入深度稳定性、脚步/足接触和体型一致性等指标。对五种现有方法的基准显示,关节角恢复相对可用,但深度、足接触和体型估计仍明显不稳定。

The FID Lottery: Quantifying Hidden Randomness in Generative-Model Evaluation Figure 1
2026-06-19cs.CV

The FID Lottery: Quantifying Hidden Randomness in Generative-Model Evaluation

Nicolas Dufour, Alexei A. Efros, Patrick Pérez

2026-06-19生成模型数据集/基准

本文针对生成模型论文常以单次训练、单个采样种子报告 FID 的可复现性问题,把 FID 建模为训练种子与生成种子两轴上的随机变量。作者在数百个 ImageNet 条件 SiT 模型上量化方差,发现重新训练造成的 FID 波动约为重采样的 3.2 倍,主要来自初始化、数据顺序和训练噪声;增大模型或算力难以消除 1–2% 噪声底,因而建议多训练种子报告误差条,并将约 1.3% 以下差距视为不确定。

VisDom: Sparse Novel View Synthesis with Visible Domain Constraint Figure 1
2026-06-19cs.CV

VisDom: Sparse Novel View Synthesis with Visible Domain Constraint

Mariia Gladkova*, Tarun Yenamandra*, Edmond Boyer, Robert Maier, Tony Tung, Daniel Cremers

2026-06-19优化算法

稀疏视角新视图合成中,NeRF/3DGS容易因几何不适定产生漂浮物,单纯轮廓约束又会保留过大的视觉外壳。VisDom的核心洞察是只允许至少被K个视角共同可见的三维区域参与重建,用无学习参数的可见域约束收紧轮廓几何,并分别限制NeRF采样和引导高斯放置。实验显示其在三类数据和多种框架上稳定提升,4张图即可改善物体重建,并在结合GaussianObject时以约22倍更低训练成本达到或超过其效果。

StylisticBias: A Few Human Visual Cues Drive Most Social Biases in MLLMs Figure 1
2026-06-19cs.CL

StylisticBias: A Few Human Visual Cues Drive Most Social Biases in MLLMs

Shaghayegh Kolli, Timo Cavelius, Nafiseh Nikeghbal, Samantha Dalal, Jana Diesner

Technical University of Munich, Munich Center for Machine Learning, Princeton Center for Information and Technology Policy

2026-06-19视觉感知

本文关注 MLLM 在招聘、司法等高风险场景中如何被人物外观线索影响。作者提出 StylisticBias,用固定身份、单属性编辑的 2.5 万张合成脸来隔离视觉属性效应。结果显示,偏差集中在少数线索上:年龄和体型主导身份层面差异,时尚风格等自我呈现线索带来最大属性级偏移,约 15 个属性解释近 80% 变化,且财富、时尚等与外观语义对齐的判断最敏感。

SARLO-80: Worldwide Slant SAR Language Optic Dataset 80cm Figure 1
2026-06-19cs.CV

SARLO-80: Worldwide Slant SAR Language Optic Dataset 80cm

Solène Debuysère, Nicolas Trouvé, Nathan Letheule, Elise Colin, Georgia Channing

DEMR-ONERA – The French Aerospace Lab, Université Paris-Saclay, Palaiseau, France, DTIS-ONERA – The French Aerospace Lab, Université Paris-Saclay, Palaiseau, France

2026-06-19强化学习数据集/基准

该文针对现有 SAR-光学数据多依赖低分辨率、强度型 GRD 产品,难以保留相位与斜距几何的问题,构建 SARLO-80:将约2500个 Umbra VHR SLC 场景重采样到80厘米斜距网格,并配准高分辨率光学图像与三种文本描述。数据集含119,566个三模态样本,覆盖72国257地点,并提供划分、预处理和基线代码,用于跨模态检索与条件生成基准;性能增益可能主要来自数据规模与物理几何保留。

HumanScale: Egocentric Human Video Can Outperform Real-Robot Data for Embodied Pretraining Figure 1
2026-06-19cs.CV

HumanScale: Egocentric Human Video Can Outperform Real-Robot Data for Embodied Pretraining

Juncheng Ma, Jianxin Bi, Yufan Deng, Xuanran Zhai, Kewei Zhang, Ye Huang, Bo Liang, Shukai Gong, Jiankai Tu, Xiaotian Tang, Jiaxin Li, Kaiqi Chen, Duomin Wang, Yuqi Wang, Bingyi Kang, Eric Huang, Zhiyang Dou, Zhen Dong, Enze Xie, Wojciech Matusik, Tat-Seng Chua, Daquan Zhou

scalability is limited by high collection cost, acquisition difficulty, and low behavioral and environ-, mental diversity. These limitations have sparked interest in egocentric human video as a scalable, designed filtering and labeling pipeline, is not merely a viable substitute for model pretraining but, execution, respectively. This finding verifies a scalable paradigm for embodied foundation models:, amount of labeled real-robot data for action-space alignment. We hope this study encourages broader, diversity, but provides only pseudo action labels from human hand retargeting. Teleoperated robot data provides, precise action labels yet is limited in scale (∼104 public hours), costly to collect, and limited scene diversity. Middle:

2026-06-19机器人视觉感知

针对机器人预训练受限于遥操作数据成本高、规模小且场景多样性不足的问题,HumanScale系统比较第一视角人类视频与等规模真实机器人轨迹。核心洞察是,经筛选和伪动作标注的人类视频虽缺少精确机器人动作,却能提供更丰富的开放世界交互先验;在相同后训练协议下,其真实机器人动作预测验证损失降低24%,真实执行中ID/OOD成功率分别提升52.5%和90%。

S-Agent: Spatial Tool-Use Elicits Reasoning for Spatial Intelligence Figure 1
2026-06-19cs.CV

S-Agent: Spatial Tool-Use Elicits Reasoning for Spatial Intelligence

Yalun Dai, Hao Li, Shulin Tian, Runmao Yao, Yuhao Dong, Fangzhou Hong, Zhaoxi Chen, Fangfu Liu, Baoliang Tian, Dingwen Zhang, Tao Wang, Kim-Hui Yap, Ziwei Liu

2026-06-19视觉感知

本文针对现有 VLM 空间推理多停留在静态单帧、难以维持连续 3D 场景状态的问题,提出 S-Agent:让 VLM 充当语义规划器,调用分层空间工具完成 2D 定位、3D 几何提升与关系/测量等聚合,并用场景记忆和智能体记忆跨视角、跨时间累积证据。实验显示该框架可训练自由提升开闭源 VLM;由其轨迹构造的 S-300K 微调出 S-Agent-8B,在多项多视图和视频空间推理基准上超过同规模基线,接近部分闭源模型。

FreeStyle: Free Control of Style-Content Dual-Reference Generation from Community LoRA Mining Figure 1
2026-06-19cs.CV

FreeStyle: Free Control of Style-Content Dual-Reference Generation from Community LoRA Mining

Jinghong Lan, Wei Cheng, Yunuo Chen, Ziqi Ye, Peng Xing, Yixiao Fang, Rui Wang, Yufeng Yang, Xuanyang Zhang, Xianfang Zeng, Difan Zou, Gang Yu, Chi Zhang

Fudan University, Westlake University, University of Hong Kong, multiple base models, artistic styles, and subject categories. 3 FreeStyle enables both style transfer and style-subject controllable image, we propose FreeStyle, a scalable dual-reference generation, paradigm for controllable visual synthesis, built upon the, this work, we propose FreeStyle, a scalable framework for, • We propose FreeStyle, a scalable dual-reference genera-

2026-06-19规划控制

FreeStyle针对双参考图像生成中内容保真、风格对齐与风格图语义泄漏难以兼顾的问题,提出从社区 LoRA 挖掘风格/内容锚点来构造大规模三元组,并用两阶段训练分别抑制注意力过度分配和高频 RoPE 位置复制导致的泄漏。实验显示其在风格相似、内容保持、审美和 VLM 验证上取得更均衡表现;但效果可能主要来自数据规模与筛选质量,跨基座泛化仍受限。

Fast Human Attention Prediction for Fixation-guided Active Perception in Autonomous Navigation Figure 1
2026-06-19cs.RO

Fast Human Attention Prediction for Fixation-guided Active Perception in Autonomous Navigation

Fatma Youssef Mohammed, Grzegorz Malczyk, Kostas Alexis

2026-06-19机器人

面向自主导航中全视野高分辨率感知成本过高的问题,论文提出用 MobileNetV3 特征提取与液态神经网络递归模块组成的 GazeLNN,自回归预测人类注视序列,并将其接入强化学习主动相机控制。模型在 MIT Low Resolution 上以 0.61 GFLOPs 达到 0.47 ScanMatch,较循环基线显著降算力和提速;实机无人机实验中,相比固定相机增加近 50% 地图体素并提升显著区域观测约 8 倍。

How Fragile Are Training-Free AI-Generated Image Detectors? A Controlled Audit of Score Direction, Preprocessing, and Compression Figure 1
2026-06-19cs.CV

How Fragile Are Training-Free AI-Generated Image Detectors? A Controlled Audit of Score Direction, Preprocessing, and Compression

Jingwen Zhou, Mingzhe Wang

2026-06-19视觉感知规划控制

本文关注免训练 AI 图像检测器在统一评测下是否可靠,动机是现有结果常被数据源、预处理和实现细节混淆。作者不提出新检测器,而是受控审计 AEROBLADE、RIGID 与 kNN 基线,发现 LPIPS 骨干可带来 0.085 AUROC 差异,分辨率策略可使单生成器结论相差最高 0.38,RIGID 分数方向还会随噪声强度反转;JPEG 格式偏差会虚高鲁棒性,简单融合也未超过最佳单项。

Scalable Training of Spatially Grounded 2D Vision-Language Models for Radiology Figure 1
2026-06-19cs.CV

Scalable Training of Spatially Grounded 2D Vision-Language Models for Radiology

Yusuf Salcan (1 and 4), Simon Ging (1 and 2), Robin Schirrmeister (3), Philipp Arnold (3), Elmar Kotter (3), Behzad Bozorgtabar (2), Thomas Brox (1) ((1) Computer Vision Group, University of Freiburg, Germany, (2) Adaptive & Agentic AI (A3) Lab, Aarhus University, Denmark, (3) Department of Radiology, Medical Center -- University of Freiburg, (4) CRIION-AI Lab, Freiburg, Germany)

2026-06-19视觉语言视觉感知

针对放射科 VLM 难以把文本结论定位到 CT/MRI 图像区域、从而影响可验证性的问题,本文构建 RefRad2D:由临床报告经 LLM 清洗/翻译、TotalSegmentator 自动生成空间标签的 120 万双语 2D 图文数据,并训练 PaliGemma2 式 RadGrounder 同时做报告、VQA 与框/掩码 grounding。结果显示其在 Slake、VQA-RAD 上接近专用医学 VLM,临床数据提升开放式 VQA,且加入 grounding 不损害语言质量;但数据单中心、定位主要是解剖结构而非病灶。

PCFootprint: A Large-Scale Dataset and Benchmark for Vectorized Building Footprint Extraction from Aerial LiDAR Point Clouds Figure 1
2026-06-19cs.CV

PCFootprint: A Large-Scale Dataset and Benchmark for Vectorized Building Footprint Extraction from Aerial LiDAR Point Clouds

Haoyuan Shen, Kuihao Wang, Ruisheng Wang, Yujun Liu

2026-06-19数据集/基准三维

针对光学影像足迹提取易受遮挡、透视形变且缺少高程信息的问题,PCFootprint转向航空LiDAR点云,构建33,000个128×128瓦片、227,264个矢量建筑标注及3,000瓦片跨域测试集。论文同时评测主流方法,结果显示点云足迹提取仍受类内差异、数据不均衡和噪声显著制约,基准价值可能主要来自大规模公开数据与标准化评测。

InfantFace: Detecting infant faces in neonatal clinical environments Figure 1
2026-06-19cs.CV

InfantFace: Detecting infant faces in neonatal clinical environments

Abdullah Bin-Obaid, Maria M. Cobo, Rebeccah Slater, Lionel Tarassenko, Mauricio Villarroel

Institute of Biomedical Engineering, Department of Engineering Science, University of Oxford, Oxford, UK, Department of Paediatrics, University of Oxford, Oxford, UK, neonatal clinical environments. We combined multiple publicly available datasets (VGGFace2, the lack of publicly available neonatal datasets. Prioritising the creation of such datasets

2026-06-19视觉感知

新生儿临床场景中遮挡、弱光和设备干扰使通用人脸检测器难以稳定服务于疼痛评估与非接触生命体征监测。InfantFace以YOLOv11m为一阶段检测框架,先用大规模公开人脸数据训练,再用113名婴儿的临床视频做领域适配,并强调标准AP评估与标注释放。结果显示未适配时在新生儿数据AP50达0.87,优于MTCNN、SCRFD、DSFD;适配后AP50升至0.96,但增益可能主要来自数据/领域微调。

Spectral Query-Key Product Weight Steering for Training-Free VLM Hallucination Mitigation Figure 1
2026-06-19cs.CV

Spectral Query-Key Product Weight Steering for Training-Free VLM Hallucination Mitigation

Karn Tiwari, Varnith Chordia, Prathosh A P

Indian Institute of Science, Bengaluru

2026-06-19视觉语言

本文针对VLM在图像描述中依赖语言先验、生成不存在物体的问题,提出无需数据和训练的QK Product Steering:直接抑制中层注意力QK乘积的少数主导奇异模,并用仅更新query权重的闭式投影兼容GQA。实验在三种VLM上使CHAIRs平均相对下降4.0%,随机模对照几乎无效;分解分析显示幻觉信号主要集中在对称互注意通道。

On the Redundancy of Timestep Embeddings in Diffusion Models Figure 1
2026-06-19cs.LG

On the Redundancy of Timestep Embeddings in Diffusion Models

José A. Chávez

2026-06-19生成模型

本文针对扩散模型长期默认依赖时间步嵌入的问题,检验其是否真有必要。作者在 U-Net 与 DiT 中移除显式时间条件,并给出在特定分布假设下模型可从带噪输入隐式恢复噪声尺度的理论解释。CelebA 与 CIFAR-10 实验显示无时间步版本仍保持结构质量,部分 FID、精度和召回优于原模型且采样更快,但增益是否可推广到更大规模数据与复杂条件生成文中未充分说明。

FlowBender: Feedback-Aware Training for Self-Correcting Conditional Flows Figure 1
2026-06-19cs.CV

FlowBender: Feedback-Aware Training for Self-Correcting Conditional Flows

Daniel Gilo, Sven Elflein, Ido Sobol, Or Litany

University of Toronto, Vector Institute

2026-06-19生成模型

本文针对条件扩散/流模型在采样中偏离深度、边缘、几何等约束的问题,指出关键缺口是模型从未学习利用自身对齐误差。FlowBender把前向算子计算的偏差信号作为闭环反馈输入,通过二次修正预测学习非线性纠偏,并支持不可微算子的零阶版本与低成本快捷采样。实验显示其在图像翻译、JPEG修复和3D纹理生成中同时提升条件一致性与FID等真实性指标,优于监督微调、对齐损失和推理时引导。

Geometry-Aware Superpixel Graph Transformer with Metadata for Skin Lesion Classification Figure 1
2026-06-19cs.CV

Geometry-Aware Superpixel Graph Transformer with Metadata for Skin Lesion Classification

Muhammad Azeem, Tanveer Hussain, Amr Ahmed, Ardhendu Behera

2026-06-19视觉感知

本文针对皮肤镜病灶结构异质、局部区域关系难以由传统 CNN/ViT 或后期元数据融合充分建模的问题,提出 GeoMeta-GT:将冻结 CNN 特征上的 SLIC 超像素作为图节点,用距离与方向编码区域几何边,并把年龄、性别等元数据作为上下文节点参与消息传递。实验称其在四个公开基准上较现有方法取得稳定提升,但摘要未给出具体幅度,增益来源仍需结合消融细节判断。

Reliability-Aware Prototype Calibration for Frozen Pose-Flow Video Anomaly Detection Figure 1
2026-06-19cs.CV

Reliability-Aware Prototype Calibration for Frozen Pose-Flow Video Anomaly Detection

Ning Dong, Yingna Su, Xin Dong, Ziyun Jiao, Xinnian Guo, Zhuangzhuang Pan

School of Information Engineering, Suqian University, School of Electronic & Information Engineering, Nanjing University of Information, School of Computer Science and Engineering, University of Electronic Science, Institute for Advanced Studies

2026-06-19视觉感知生成模型三维

针对冻结 pose-flow 视频异常检测中单一似然分数难以表达多模态正常行为、且易受姿态噪声影响的问题,论文提出 RPC:在冻结潜空间中引入最近正常原型偏差,并用关键点置信度仅门控该几何证据,而不把低置信度直接当异常。结果显示其在两种骨干、四个数据集的八组设置中均提升帧级 AUROC,平均增益约 2.03 个百分点,主要收益来自原型偏差。

Through the PRISM: Preference Representation in Intermediate States of Video Diffusion Models Figure 1
2026-06-19cs.CV

Through the PRISM: Preference Representation in Intermediate States of Video Diffusion Models

Haoxuan Wu, Lai Man Po, Mengyang Liu, Kun Li, Hongzheng Yang, Wei Liu

2026-06-19视觉感知生成模型

本文针对现有视频奖励模型只能在干净像素域评估、与扩散去噪过程脱节且需高成本 VAE 解码的问题,提出 PRISM:冻结视频扩散骨干,仅用轻量 Query 聚合头从噪声 latent 中解码偏好信号。核心洞察是生成骨干的时空先验本身具备评估能力,且与生成性能正相关。实验称其在偏好基准达 SOTA,并能在高噪声早期进行 Best-of-N 筛选以降低推理成本。

GEN-Guard: Correcting Generalization Failures for Deployable Federated Surgical AI Figure 1
2026-06-19cs.CV

GEN-Guard: Correcting Generalization Failures for Deployable Federated Surgical AI

Julia Alekseenko, Pietro Mascagni, AI4SafeChole Consortium, Nicolas Padoy

University of Strasbourg, CNRS, INSERM, ICube, UMR7357, Strasbourg, France, Bioimage Analysis Center, Fondazione Policlinico Universitario Agostino Gemelli IRCCS, Rome, Italy, Fondazione IRCCS Ca’ Granda Ospedale Maggiore Policlinico di Milano, University of Milan, Milan, Italy

2026-06-19学习理论

这篇论文针对联邦手术视频 AI 中常被忽视的部署风险:仅用参与医院验证集选模型会产生“性能泄漏”,导致未见机构泛化失败。作者提出后处理框架 GEN-Guard,用客户端阻塞评估发现模型选择失败,并用分歧感知蒸馏做特征级校正。实验覆盖胆囊切除阶段识别和结肠镜息肉分割,标准评估下失败率超过 80%,校正后内部 F1 最高提升 2 点、外部机构最高提升 3 点、最差机构提升 3–9 点。

CUPID: Reconstructing UV Texture Maps for Interpretable Person-of-Interest Deepfake Detection Figure 1
2026-06-19cs.CV

CUPID: Reconstructing UV Texture Maps for Interpretable Person-of-Interest Deepfake Detection

Giovanni Affatato, Sara Mandelli, Edoardo Daniele Cannas, Paolo Bestagini, Stefano Tubaro

This work was supported by the FOSTERER project, funded by the Italian Ministry of Education, University, and Research within the PRIN 2022 program.

2026-06-19视觉感知

针对名人等特定对象深度伪造检测难以同时兼顾鲁棒性、效率与可解释性的问题,CUPID将3D人脸重建得到的UV纹理图作为统一语义空间输入,用仅真实视频训练的MAE学习身份表征,测试时与该对象公开视频参考集比对,并可用残差图定位异常面部区域。四个数据集实验显示其多数场景优于现有方法,对压缩和降采样更稳健,推理也更快。

CMDS-AD: Cross-Modal Dual-Stream Decoupling for Few-Shot Anomaly Detection Figure 1
2026-06-19cs.CV

CMDS-AD: Cross-Modal Dual-Stream Decoupling for Few-Shot Anomaly Detection

Junhao Cai, Deyu Zeng, Junhao Pang, Junyu Chen, Qiwei Liang, Xiaopin Zhong, Zongze Wu

2026-06-19视觉感知

本文针对少样本多模态异常检测中正常样本稀缺、2D/3D 模态错位和误报高的问题,提出 CMDS-AD:用 LoRA 扩散生成补充 RGB 数据,并将预训练扩散几何估计器视作非线性低通滤波器,构建低频估计流辅助真实流分离微小缺陷;再通过坐标感知层级映射和跨模态乘性打分抑制单模态噪声。在 1-shot 下,MVTec 3D-AD 的 I-AUROC/AUPRO 分别提升 5.7/2.0 个百分点,EyeCandies 提升 7.7/5.6 个百分点。

Integrating national forest inventory, airborne lidar, and satellite imagery for wall-to-wall mapping of forest structure with computer vision Figure 1
2026-06-19cs.LG

Integrating national forest inventory, airborne lidar, and satellite imagery for wall-to-wall mapping of forest structure with computer vision

Luke J. Zachmann, David D. Diaz, Vincent A. Landau, Chelsey Walden-Schreiner, Tony Chang, Nathan E. Rutenbeck, Katharyn A. Duffy, Kiarie Ndegwa, Andreas Gros, Scott Conway, Guy Bayes

2026-06-19视觉感知

面向森林经营和野火风险规划中多源数据年代、精度不一致导致的决策伪影,论文提出 VibrantForests:以国家森林清查和机载 lidar 生成训练样本,用 Sentinel-2 等卫星影像训练多任务视觉模型,在美国本土以 10 米、年度尺度联合估计冠层覆盖、高度、生物量、断面积和平均胸径。结果显示其在稀疏到高密森林条件下均能预测,并缓解被动传感模型常见的饱和与回归均值偏差;具体相对增益幅度文中片段未充分说明。

U$^2$Mamba: A Two-level Nested U-structure Mamba for Salient Object Detection Figure 1
2026-06-19cs.CV

U$^2$Mamba: A Two-level Nested U-structure Mamba for Salient Object Detection

Junhui Li, Jialu Li, Youshan Zhang

2026-06-19视觉感知

针对显著目标检测中全局上下文建模与边界细节保留难以兼顾的问题,U²Mamba将Mamba状态空间机制嵌入两级嵌套U形结构,提出多尺度Mamba U块以在下采样特征上高效建模长程依赖,并用层级监督约束多尺度预测。实验显示其在多个SOD基准上达到有竞争力的效果,但具体增益与模型规模、训练设置的关系文中未充分说明。

Efficiently Linking Real Scenes with Synthetic Data Generation for AI-based Cognitive Robotics and Computer Vision Applications Figure 1
2026-06-19cs.RO

Efficiently Linking Real Scenes with Synthetic Data Generation for AI-based Cognitive Robotics and Computer Vision Applications

Paul Koch, Vivek Chavan, André Sers, Adem Karakurt, Paul Hofmann, Mohamad Zaher Ziadeh, Jörg Krüger

2026-06-19机器人视觉感知

面向认知机器人中的视觉感知、6D 位姿与抓取任务,论文指出当前模型受限于真实标注数据成本高、仿真到真实域差距和物理知识不足。核心洞察是把真实场景与仿真数据生成闭环连接,用真实场景约束合成并迭代缩小 sim2real 差距,为多模态、物理扎根的机器人模型提供训练基础。主要结果仍是趋势梳理与工作中方案,文中未充分说明定量增益。

Single-Stage Hierarchical Rectification for Weakly Supervised Histopathology Segmentation Figure 1
2026-06-19cs.CV

Single-Stage Hierarchical Rectification for Weakly Supervised Histopathology Segmentation

Duc T. Nguyen, Hoang-Long Nguyen, Thanh-Ha DO, Huy-Hieu Pham

2026-06-19视觉感知

针对病理弱监督分割中传统 CAM 生成、伪标签离线细化、再训练的多阶段流程成本高且会放大浅层纹理误检的问题,论文提出单阶段 SSHR,在前向传播中用 HFRM 以深层全局语义约束浅层特征,并结合空间同质化直接净化激活图。其在 LUAD-HistoSeg 和 BCSS 上优于多阶段方法,训练时间减少约 2–5 倍。

SPOT-E: Test-Time Entropy Shaping with Visual Spotlights for Frozen VLMs Figure 1
2026-06-19cs.CV

SPOT-E: Test-Time Entropy Shaping with Visual Spotlights for Frozen VLMs

Bo Yin, Xiaobin Hu, Chengming Xu, Ruolin Shen, Mo Yang, Jiangning Zhang, Peng-Tao Jiang, Cheng Tan, Shuicheng YAN

2026-06-19视觉语言

本文针对冻结视觉语言模型在图表、文档等证据密集任务中容易忽略小而局部关键视觉证据的问题,提出用答案片段熵作为测试时反馈,但指出单纯降熵会导致自信错误捷径。SPOT-E通过低熵锚点约束和问题条件视觉聚光模块,在每个样本上用GRPO轻量优化聚光LoRA,既降低不确定性又保持基线高置信token稳定。实验显示其在多类开源/闭源VLM和多基准上带来一致提升,并增强视觉扰动鲁棒性。

BAFIS: Dataset + Framework to assess occupational Bias and Human Preference in modern Text-to-image Models Figure 1
2026-06-19cs.CV

BAFIS: Dataset + Framework to assess occupational Bias and Human Preference in modern Text-to-image Models

Thomas Klassert, Adrian Ulges, Biying Fu

RheinMain University of Applied Sciences, Wiesbaden, Germany

2026-06-19视觉感知数据集/基准

该文关注文本到图像模型在职业人物生成中延续性别、族裔偏见的问题,尤其考察语言提示如何放大或改变偏差。作者提出 BAFIS 静态对战平台,并构建 2.1 万张德英职业提示合成图像,将自动指标、人类偏好和德国就业统计对齐比较。结果显示五个主流模型均存在系统性偏差,自动指标只与主观评价部分相关,说明公平性评估需要纳入人类感知反馈。

Cinematic Compositing Using Character-Environment-Harmonized Video Generation Models Figure 1
2026-06-19cs.CV

Cinematic Compositing Using Character-Environment-Harmonized Video Generation Models

Tianyi Xiang, Mingming He, Li Ma, Jing Liao

City University of Hong Kong

2026-06-19视觉感知

这篇论文针对绿幕角色合成中前景与新环境缺乏物理接触、遮挡响应和光照一致性的问题,将任务重构为角色到环境的物理交互与环境到角色的光照协调。方法用三重掩码、RGB-D联合去噪和参考条件视频扩散统一处理背景生成、道具保留/替换/生成及重光照,并用生成先验构建多光照训练对。实验显示其在美学、前景/背景相似度等指标和消融中优于VACE、级联重光照等基线,但部分增益可能主要来自数据构造与扩散模型能力。

DeepForestVisionV2: Ecology-Driven Taxonomy Expansion for Camera-Trap Monitoring in African Tropical Forests Figure 1
2026-06-19cs.CV

DeepForestVisionV2: Ecology-Driven Taxonomy Expansion for Camera-Trap Monitoring in African Tropical Forests

Hugo Magaldi, Theau d'Audiffret, Etienne Francois Akomo-Okoue, Bala Amarasekaran, Naomi Anderson, Claire Auger, Noemie Cappelle, Daniel Cornelis, Raphael Cornette, Tobias Deschner, Gabriel Dubus, Davy Fonteyn, Rosa M. Garriga, Jennifer Hatlauf, Innocent Kasekendi, Raymond Katumba, Aram Kazandjian, Alfred Ngomanda, Stephan Ntie, Simone Pika, Xavier Rufray, Harold Rugonge, John Justice Tibesigwa, Peter van Lunteren, Hadrien Vanthomme, Joeri A. Zwerts, Sabrina Krief

2026-06-19视觉感知

针对非洲热带森林相机陷阱从闭冠林地扩展到河岸、空旷地和公园边缘后,原 DeepForestVision 35 类标签过粗的问题,本文按垂直分层、开放场景和人类活动界面扩展到 64 类,并保持离线照片/视频工作流。模型用多国大规模数据训练,在跨国验证集达 0.86 准确率、0.82 macro-F1;在乌干达视频基准中保持或提升准确率,增加可识别类群,并将边缘场景误报从 11 降至 0。

Evaluation of Image Matching for Art Skills Assessment Figure 1
2026-06-19cs.CV

Evaluation of Image Matching for Art Skills Assessment

Asaad Alghamdi, Michael Poor, Trung-Nghia Le, Tam V. Nguyen

2026-06-19视觉感知数据集/基准

这篇论文针对绘画技能评估依赖人工主观打分、流程繁琐的问题,将手绘稿与模板图像做视觉匹配,比较传统 SIFT 关键点与基于 VGG16 的 Siamese 网络相似度评估。其主要洞察是,在小规模卡通模板与120名参与者草图数据上,局部关键点匹配反而比深度匹配更适合区分绘画水平;但数据规模、专家评分细节和泛化能力文中未充分说明。

Distill Once, Adapt Life-Long: Exploring Dataset Distillation for Continual Test-Time Adaptation Figure 1
2026-06-19cs.CV

Distill Once, Adapt Life-Long: Exploring Dataset Distillation for Continual Test-Time Adaptation

Hyun-Kurl Jang, Jihun Kim, Hyeokjun Kweon, Kuk-Jin Yoon

2026-06-19数据集/基准

这篇论文针对持续测试时自适应中无法保留源数据、长期在线更新易累积伪标签错误并遗忘源知识的问题,提出 DO-ALL:部署前用数据集蒸馏生成少量源域合成锚点,部署时按语义匹配为目标样本提供回放、表征对齐和平滑正则。其作为即插即用稳定层可接入多种 CTTA 方法,在 CIFAR100-C、ImageNet-C 和 CCC 上提升长期鲁棒性;增益与蒸馏锚点质量相关。

HilDA: Hierarchical Distillation with Diffusion for Advancing Self-Supervised LiDAR Pre-trainin Figure 1
2026-06-19cs.CV

HilDA: Hierarchical Distillation with Diffusion for Advancing Self-Supervised LiDAR Pre-trainin

Maciej Wozniak, Jesper Ericsson, Hariprasath Govindarajan, Truls Nyberg, Thomas Gustafsson, Patric Jensfelt, Olov Andersson

2026-06-19生成模型

HilDA针对自动驾驶LiDAR预训练中标注不足、现有相机到LiDAR蒸馏只对齐VFM最终层且缺少时序几何约束的问题,提出分层蒸馏:利用多层特征和CLS全局语义指导3D骨干,并加入时间占据扩散任务强化运动与空间一致性。实验显示其在跨模态蒸馏、3D检测、场景流和语义占据预测上优于既有蒸馏方法,消融也表明扩散与分层蒸馏存在互补增益。

Evaluating and Enhancing Negation Comprehension in Remote Sensing MLLMs Figure 1
2026-06-19cs.CV

Evaluating and Enhancing Negation Comprehension in Remote Sensing MLLMs

Haochen Han, Jue Wang, Alex Jinpeng Wang, Fangming Liu

2026-06-19视觉感知

这篇论文针对遥感多模态大模型在“没有、非、未覆盖”等否定表达上易误判的问题,构建了首个遥感否定理解基准 RS-Neg,覆盖 VQA、选择题、定位和场景分类等 2.2 万余样本,并用 LLM 生成否定查询、动态视觉聚焦验证缺失概念。实验显示现有遥感 MLLM 在否定条件下明显退化且易幻觉;其 NeFo 测试时学习方法仅用少量无标注测试样本和约 250 万可训练参数,就能显著提升多模型表现并泛化到未见任务。

ARTEMIS: Agent-guided Reliability-aware Temporal Mask Evolution for Imperfectly Supervised Video Polyp Segmentation Figure 1
2026-06-19cs.CV

ARTEMIS: Agent-guided Reliability-aware Temporal Mask Evolution for Imperfectly Supervised Video Polyp Segmentation

Tong Wang, Siwen Wang, Yaolei Qi, Jinxing Zhou, Yuting He, Guanyu Yang, Yutong Xie

2026-06-19视觉感知

本文针对结肠镜视频息肉分割中密集标注昂贵、点/涂鸦或少量帧标注易导致伪标签漏边界、时序漂移和噪声监督的问题,提出 ARTEMIS:先用 SAM2 将不完整监督补成粗掩码,再由辩论-裁决式视觉语言 agent 选择可靠时序锚点并双向传播,最后通过可靠性引导参考选择、RPTM 和鲁棒损失训练分割器。实验在 SUN-SEG 与 CVC-ClinicDB-612 的弱监督和半监督设置下报告达到 SOTA。

NAMESAKES: Probing Identity Memorization in Text-to-Image Models Figure 1
2026-06-19cs.CV

NAMESAKES: Probing Identity Memorization in Text-to-Image Models

Morris Alper, Vasudha Varadarajan, Moran Yanuka, Angelina Wang, Hadar Averbuch-Elor

Carnegie Mellon University, Tel Aviv University, Cornell University

2026-06-19视觉感知

本文关注文本到图像模型在输入人名时可能复现真实人物长相带来的隐私审计问题。核心创新是提出无需参考照片、训练数据或白盒访问的黑盒行为探针,并构建含1269名维基公众人物、名气梯度和扰动姓名的Namesakes基准。实验显示该探针能较好预测身份记忆并区分真实记忆姓名与未识别/伪造姓名,同时揭示不同T2I模型家族的记忆范围差异。

HEad and neCK TumOR (HECKTOR) 2025: Benchmark of Segmentation, Diagnosis, and Prognosis in Multimodal PET/CT Figure 1
2026-06-19cs.CV

HEad and neCK TumOR (HECKTOR) 2025: Benchmark of Segmentation, Diagnosis, and Prognosis in Multimodal PET/CT

Numan Saeed, Salma Hassan, Shahad Hardan, Lishan Cai, Xinglong Liang, Moona Mazher, Abdul Qayyum, Yansong Bu, Mengye Lyu, Yue Lin, Mingyuan Meng, Chuanyi Huang, Lisheng Wang, Dalal Chamseddine, Shamimeh Ahrari, Beining Wu, Yifei Chen, Fuyou Mao, Hao Zhang, Baixiang Zhao, Surajit Ray, Muzi Guo, Lei Xiang, Jakob Dexl, Michael Ingrisch, Adrien Depeursinge, Arman Rahmim, Mathieu Hatt, Vincent Andrearczyk, Mohammad Yaqub

2026-06-19视觉语言视觉感知数据集/基准

头颈癌 PET/CT 中肿瘤勾画耗时且主观,复发风险和 HPV 状态也难从影像稳定预测。HECKTOR 2025 将 10 个中心 1100 余例 PET/CT、临床变量与电子病历整合为多任务基准,同时评估原发灶/淋巴结分割、RFS 预测和 HPV 分类。15 个最终提交中,最佳结果约为分割 Dice 0.75、预后 C-index 0.66、HPV 平衡准确率 0.56,显示分割较成熟,而预后与分子诊断仍受限,增益可能主要来自 scaling / data。

SA-VIS: Sparse frame Annotations for training Video Instance Segmentation Figure 1
2026-06-19cs.CV

SA-VIS: Sparse frame Annotations for training Video Instance Segmentation

Edoardo Mello Rella, Ajad Chhatkuli, Shipra Jain, Ender Konukoglu, Luc Van Gool

2026-06-19视觉感知

SA-VIS针对视频实例分割训练依赖密集逐帧标注、计算和显存成本高的问题,提出用未标注历史帧的低维编码特征做Past-frames Feature Propagation,并结合帧特定实例查询,让在线模型在稀疏标注下仍学习时序关联与更准掩码。实验在YouTube-VIS 2019/2021/2022和OVIS上优于基线,在仅用1/5帧标注时相比密集训练仅下降0.4%,有限标注场景AP超过既有方法1%以上。

TriFlow: Generating Artist-Like 3D Mesh Topology via Nearest-Vertex Vector Fields Figure 1
2026-06-19cs.CV

TriFlow: Generating Artist-Like 3D Mesh Topology via Nearest-Vertex Vector Fields

Haoxuan Li, Ziya Erkoç, Daniele Sirigatti, Vladislav Rosov, Lei Li, Angela Dai, Matthias Nießner

2026-06-19生成模型三维

针对隐式3D生成或扫描结果通常需经Marching Cubes得到过密、杂乱网格,而自回归网格生成又慢且易累积错误的问题,TriFlow将三角网格拓扑改写为表面上的最近顶点向量场,并用条件潜在流匹配生成该场,再结合watershed聚类与约束QEM抽取紧凑、类艺术家拓扑。实验显示其相较学习式基线泛化更稳,Chamfer Distance降低约90%,单样本推理约8倍加速。

SAM3 Self-Distillation for Fine-Grained GOOSE 2D Semantic Segmentation Figure 1
2026-06-19cs.CV

SAM3 Self-Distillation for Fine-Grained GOOSE 2D Semantic Segmentation

Xuesong Wang

X. Wang conducted this work at Wayne State University

2026-06-19视觉感知

面向越野地面机器人在 GOOSE 细粒度语义分割中长尾类别、相近植被/地形类别和跨平台成像差异带来的感知难题,论文以 SAM3 图像编码器加轻量 FPN 解码器为主干,提出用带真值框提示的 SAM3 仅在其优于学生模型的 22 类上做自蒸馏,并用图像级多尺度测试增强绕过固定输入限制;最终在 ICRA 2026 GOOSE 2D 测试集上取得 69.73% composite mIoU、排名第 4,最大增益主要来自强光度扰动而非蒸馏本身。

When Calibration Fails the Vulnerable Hospital: Federated Conformal Risk Control via Risk-Curve Shrinkage Figure 1
2026-06-19cs.LG

When Calibration Fails the Vulnerable Hospital: Federated Conformal Risk Control via Risk-Curve Shrinkage

Nafis Fuad Shahid

2026-06-19规划控制安全鲁棒

这篇论文关注联邦医疗分割中“平均校准掩盖弱势医院失效”的风险:简单汇总各医院校准数据虽满足边际 CRC 保证,却会让部分机构漏检率超标。作者提出只上传每站点经验风险曲线、再做风险曲线 shrinkage 的联邦 CRC,为站点级阈值提供覆盖率与预测集大小的折中。FeTS-2022 上,朴素 pooled CRC 有 8/20 医院违规、最差 FNR 0.178;局部 CRC 虽稳但预测集膨胀 83 倍;所提方法在 LOSO 选取 n0=19 时约 2.7/20 违规且 stretch 降至 2.0 倍。

Pixel-Level Residual Diffusion Transformer: Scalable 3D CT Volume Generation Figure 1
2026-06-19cs.CV

Pixel-Level Residual Diffusion Transformer: Scalable 3D CT Volume Generation

Zhenkai Zhang, Markus Hiller, Krista A. Ehinger, Tom Drummond

School of Computing and Information Systems, The University of Melbourne

2026-06-19生成模型三维

针对高分辨率3D CT生成中计算开销大、全局结构与局部细节难兼顾的问题,论文提出PRDiT:先用MLP局部去噪器从重叠3D块估计低频结构,再用带高效注意力的全局残差DiT建模高频残差,并复用低分辨率预训练骨干扩展到更高分辨率。实验在LIDC-IDRI和RAD-ChestCT上较HA-GAN、3D LDM、WDM-3D降低3D FID、MMD和Wasserstein距离,但具体增益中scaling与数据因素占比仍不清。

FrozenDrive: Zero-Shot Text-Guided Driving Scene Generation and Data Augmentation with Parameter-Free Frozen Diffusion Model Figure 1
2026-06-19cs.CV

FrozenDrive: Zero-Shot Text-Guided Driving Scene Generation and Data Augmentation with Parameter-Free Frozen Diffusion Model

Yuhwan Jeong, Hyeonseong Kim, Daehyun We, Seonkyu Song, Jinnyeong Yang, Hyun-Kurl Jang, Youngho Yoon, Kuk-Jin Yoon

Equal contribution.KAIST, Visual Intelligence Lab, KAIST, Visual Intelligence Lab

2026-06-19生成模型

面向自动驾驶长尾场景数据稀缺与现有扩散生成方法微调后削弱文本对齐的问题,FrozenDrive主张冻结预训练扩散骨干、不引入额外参数,通过多视角膨胀自注意力和时间参考自注意力在单次生成中保持跨相机与时序一致,并用面向稀有目标的约束提升物体保真度。实验称其可零样本文本生成雨夜、雪天等少见组合,在nuScenes上优于既有生成基线,并使UniAD等下游模型在夜间和雨天更鲁棒。

EFIQA: Explainable Fundus Image Quality Assessment via Anatomical Priors Figure 1
2026-06-19cs.CV

EFIQA: Explainable Fundus Image Quality Assessment via Anatomical Priors

Pengwei Wang, José Morano, Qian Wan, Hrvoje Bogunović

2026-06-19视觉感知

本文针对眼底图像质量评估依赖数据集标签、跨标准泛化差且缺少局部解释的问题,提出用解剖先验定义质量:通过血管遮挡补全学习“应当可见的结构”,再蒸馏到冻结基础模型特征上生成质量热图。外部数据集实验显示,该无质量标签方法在不同评判标准下优于监督基线,并能定位退化区域。

Geometry-Preserving in 3D Gaussian Splatting for LiDAR-Camera Extrinsic Calibration Figure 1
2026-06-19cs.CV

Geometry-Preserving in 3D Gaussian Splatting for LiDAR-Camera Extrinsic Calibration

Kyoleen Kwak, Daeho Kim, Jeong Woon Lee, Hyoseok Hwang

2026-06-19三维

这篇论文针对无靶 LiDAR-相机外参标定中 3DGS 代理几何会被光度重建目标“拉偏”的问题,提出 GeoP-Calib:用多视角 LiDAR 聚合形成稠密深度锚定,并通过体积软掩码处理遮挡,同时阻断光度梯度更新高斯位置与协方差。其核心洞察是标定更依赖度量几何保真而非渲染质量;在 KITTI odometry 和 KITTI-360 上相较现有无靶方法取得更高标定精度,平移估计提升尤为明显。

WeGenBench: A Multidimensional Diagnostic Benchmark towards Text-to-Image Model Optimization Figure 1
2026-06-19cs.CV

WeGenBench: A Multidimensional Diagnostic Benchmark towards Text-to-Image Model Optimization

Qian Liang, Xiaomin Li, Ying Zhang, Jia Xu, Lihao Ni, Hongrui Li, Jingjing Li, Jing Lyu, Chen Li

University of Electronic Science and Technology of China, Dalian University of Technology

2026-06-19视觉感知优化算法数据集/基准

针对现有文生图基准多偏英语、评测维度粗或场景单一,WeGenBench构建了中英各2000条、带宏观场景与多维标签的诊断式提示集,并用VLM、OCR等从语义对齐、美学质量和视觉文字渲染三方面给出可解释评分。文中对多种主流模型做系统评测,显示该基准能定位模型在双语文字、复杂语义和特定子类上的短板,但具体优化增益来源仍需后续模型改进实验验证。

Stitching and dimensionality effects on large artificially generated volume datasets Figure 1
2026-06-19cs.CV

Stitching and dimensionality effects on large artificially generated volume datasets

Lucas von Chamier, Jan Philipp Albrecht, Dagmar Kainmüller

Max Delbrück Center for Molecular Medicine in the Helmholtz Association, University of Potsdam

2026-06-19数据集/基准

这篇论文关注大体积科学图像生成中因显存限制必须切块推理、再拼接而产生的接缝伪影问题,并比较 CycleGAN 在冷冻电镜数据上的三种拼接策略与 2D/3D patch。核心洞察是 FID 难以发现会显著损害线粒体分割的细微接缝;无伪影 3D 仅小幅优于 2D,成本收益有限,而 2D 因更大 batch 训练更稳定,三正交方向集成也只改善低质量体数据。

MakeupMirror: Improving Facial Attribute Preservation in Diffusion Models for Makeup Transfer Figure 1
2026-06-19cs.CV

MakeupMirror: Improving Facial Attribute Preservation in Diffusion Models for Makeup Transfer

Nefeli Andreou, Angel Martínez-González, Sabine Sternig, Matthieu Guillaumin, Epameinondas Antonakos, Michael Opitz

2026-06-19生成模型

本文针对扩散式妆容迁移在虚拟试妆中常改变身份特征和肤色的问题,提出 MakeupMirror:在 Stable-Makeup 上加入深度与边缘 ControlNet 约束面部几何,按皮肤、眼唇区域调节迁移强度,并依据源/参考肤色差自适应抑制肤色漂移,同时用 LM Langevin 采样加速。实验显示相对人脸相似度提升 60%,肤色差降低 50%,延迟约 0.7 秒,专家通过率 94%。

EventVLA: Event-Driven Visual Evidence Memory for Long-Horizon Vision-Language-Action Policies Figure 1
2026-06-19cs.CV

EventVLA: Event-Driven Visual Evidence Memory for Long-Horizon Vision-Language-Action Policies

Ganlin Yang, Zhangzheng Tu, Yuqiang Yang, Sitong Mao, Junyi Dong, Tianxing Chen, Jiaqi Peng, Jing Xiong, Jiafei Cao, Jifeng Dai, Wengang Zhou, Yao Mu, Tai Wang

University of Science and Technology of China, Shanghai AI Laboratory, Shanghai Jiao Tong University, Dalian University of Technology, Huawei Technologies Co., Ltd., The University of Hong Kong, Tsinghua University, Peking University

2026-06-19视觉语言视觉感知

长时程机器人操作中,关键线索常在交互后被遮挡,传统 VLA 的马尔可夫假设和粗放历史缓存都会失效或带来冗余。EventVLA 的核心洞察是只保留稀疏视觉证据:用初始帧与短期窗口作基础锚点,并通过 KEM 从策略隐表示预测未来关键帧,主动写入转瞬即逝的事件记忆。实验在 17 个仿真记忆任务和 4 个真实双臂任务上较现有记忆 VLA 平均提升约 40%,并提出 RoboTwin-MeM 检验非马尔可夫记忆能力。

Holo-World: Unified Camera, Object and Weather Control for Video World Model Figure 1
2026-06-19cs.CV

Holo-World: Unified Camera, Object and Weather Control for Video World Model

Xiangchen Yin, Wenzhang Sun, Jiahui Yuan, Zijie Liu, Yinda Chen, Wei Li, Dachun Kai, Chunfeng Wang, Xiaoyan Sun

University of Science and Technology of China, Institute of Artificial Intelligence, Hefei Comprehensive National Science Center, controllable camera and object motion while allowing its environmental state to, duce Holo-World, a unified controllable video world model that jointly controls, generating dynamic and controllable worlds via structured conditions. A controllable video world, the world is in. Yet controllability in current video generation is often developed along separate, generation within the same controllable video model., The data obstacle follows from the separation of existing controllable video methods. Existing, vision. We introduce Holo-World, a unified controllable video world model that jointly controls

2026-06-19视觉感知强化学习规划控制

这篇论文针对现有视频世界模型将相机、物体运动与天气状态分开控制的问题,提出从单张首帧出发的统一状态控制设定。核心做法是构建 HoloStateData,并用 UniSA 将世界保持与天气迁移拆到不同残差子空间,再用分解式 CFG 分别引导场景和天气。实验显示其在保持结构、相机与物体控制精度的同时,可生成雨雪雾云等天气,优于视频到视频天气编辑基线。

The Hidden Evolution of Disguised Visual Context inside the VLM Figure 1
2026-06-19cs.CV

The Hidden Evolution of Disguised Visual Context inside the VLM

Wish Suharitdamrong, Tony Alex, Muhammad Awais, Sara Atito

2026-06-19视觉语言

这篇论文针对 VLM 中视觉 token 如何被 LLM 消化的问题,控制训练条件比较输入端 in-context 注入与中间层 layer-wise 注入。核心洞察是视觉信息进入时像“伪装上下文”,会随层深按不同范式演化并偏向不同频率特征;性能差异不仅取决于注意力分配,更取决于各层视觉表征质量,因而在单图、多图、视频及 OCR 等任务上呈现不同优势。

Variable-Length Tokenization via Learnable Global Merging for Diffusion Transformers Figure 1
2026-06-19cs.CV

Variable-Length Tokenization via Learnable Global Merging for Diffusion Transformers

Dong Hoon Lee, Seunghoon Hong

2026-06-19生成模型

本文针对潜扩散模型中固定压缩率限制质量—算力权衡、传统可变长度 tokenizer 通过截断导致跨长度表征分布漂移的问题,提出以 token 合并调节长度,并用可学习的全局合并模式让生成时也可获得合并结构,从而增强不同 token 数下的表征对齐。实验在 ImageNet 256×256 上显示,该 tokenizer 结合扩散 Transformer 相比既有可变长度方法取得更好的 gFID—计算量权衡。

See-and-Reach: Precise Vision-Language Navigation for UAVs within the Field of View Figure 1
2026-06-19cs.CV

See-and-Reach: Precise Vision-Language Navigation for UAVs within the Field of View

Fanfu Xue, En Yu, Yantian Shen, Zhikun Hu, Hongjun Wang, Yang Yang, Xindi Wang, Jiande Sun

2026-06-19机器人视觉语言视觉感知

本文针对现有 UAV-VLN 将远程搜索与末端抵达混合评测、难以诊断可见目标精确接近能力的问题,提出 UAV-VLN-FOV 任务与更严格的 10 米成功标准。核心创新是 3DG-VLN:利用高分辨率前视/下视观测保留细粒度几何信息,并在线更新目标相对 3D 方向以减少闭环导航漂移。作者构建含 2717 条轨迹的基准,实验显示成功率较竞争基线提升 13.82%,并给出真实场景试验验证其实用潜力。

FUSE: Frequency-domain Unification and Spectral Energy Alignment for Multi-modal Object Re-Identification Figure 1
2026-06-19cs.CV

FUSE: Frequency-domain Unification and Spectral Energy Alignment for Multi-modal Object Re-Identification

Xuanhao Qi, Tom H. Luan, Yukang Zhang, Jinkai Zheng, Zhou Su, Shuwei Li, Lei Tan

2026-06-19视觉感知

这篇论文针对多模态重识别中过度依赖颜色、光照等低频线索,导致跨 RGB/NIR/TIR 对齐不稳的问题,提出 FUSE 将融合转到频域:用 SDM 自适应拆分低/中/高频特征,再用 CAM 对齐各模态谱能量并保持子空间互补。实验在 RGBNT201、RGBNT100、MSVR310 上报告提升,其中 RGBNT201 mAP 提高 9.1%、Rank-1 提高 9.5%。

PU-UNet: Stable Multiplicative Interactions for Medical Image Segmentation Figure 1
2026-06-19cs.CV

PU-UNet: Stable Multiplicative Interactions for Medical Image Segmentation

Ziyuan Li, Osamah Sufyan, Uwe Jaekel, Babette Dellen

2026-06-19视觉感知

这篇论文针对 U-Net 类医学分割主要依赖加性卷积、难以显式建模纹理/边界/对比度等高阶交互的问题,提出在低分辨率语义层插入稳定 Product Unit 残差块,并用 softplus 正值映射与 log 域裁剪缓解乘性单元数值不稳定。实验在 ISIC 2018、Kvasir-SEG、BUSI 上较匹配 Residual U-Net 稳定提升 Dice/IoU,计算量和延迟几乎不变,BUSI 正常病例假阳性率降至 0。

ReA-OVCD: Reliability-Aware Open-Vocabulary Change Detection via Semantic and Spatial Refinement Figure 1
2026-06-19cs.CV

ReA-OVCD: Reliability-Aware Open-Vocabulary Change Detection via Semantic and Spatial Refinement

Hongming Zhu, Huaji Chen, Bowen Du, Sicong Liu, Qin Liu

Hongming Zhu, Huaji Chen, Bowen Du, and Qin Liu are with the School of Computer Science and Technology, Tongji University, Shanghai 200092, China, Sicong Liu is with the College of Surveying and Geo-Informatics, Tongji University, Shanghai 200092, China

2026-06-19视觉感知

针对开放词汇遥感变化检测中实例匹配难捕捉局部语义变化、像素比较又易受语义歧义和边界错位影响的问题,ReA-OVCD在无需训练的框架下先用像素语义差异生成候选变化,再通过语义变化推理和边界感知细化评估变化可靠性。实验在LEVIR-CD、WHU-CD、DSIFN、SECOND上较现有方法提升F1C约2.13%至9.75%,并报告更高计算效率。

QG-MIL: A Gated Transformer Aggregator for Domain-Agnostic Multiple Instance Learning in Medical Imaging Figure 1
2026-06-19cs.CV

QG-MIL: A Gated Transformer Aggregator for Domain-Agnostic Multiple Instance Learning in Medical Imaging

Luca Zedda, Davide Antonio Mura, Cecilia Di Ruberto, Maurizio Atzori, Muhammed Furkan Dasdelen, Carsten Marr, Andrea Loddo

Department of Mathematics and Computer Science, University of Cagliari, Cagliari, Italy, Institute of AI for Health, Helmholtz Munich, Neuherberg, Germany

2026-06-19视觉感知

针对医学影像多实例学习中注意力常集中到少数实例、导致过度自信和跨域泛化不稳的问题,QG-MIL将RMSNorm预归一化、逐头QK归一化、注意力输出门控和SwiGLU前馈集成到Transformer聚合器中,试图从结构上抑制注意力塌缩而非依赖额外正则。六个病理与血液学基准上,其最佳变体均超过主流基线,平均提升约6.1个macro F1点,并显示更分散的注意力分布。

Tri-Info: Generalizable, Interpretable Failure Prediction for VLA Models via Information Theory Figure 1
2026-06-19cs.RO

Tri-Info: Generalizable, Interpretable Failure Prediction for VLA Models via Information Theory

Jinghan Yang, Yunchao Zhang, Wang Yuan, Haolun Wan, Jiaming Zhang, Zhengyang Hu, Yanchao Yang

InfoBodied AI Lab, The University of Hong Kong

2026-06-19学习理论

这篇论文关注 VLA 机器人在分布外场景中“静默失败”且代价不可逆的问题,提出用动作熵、动作时序互信息和状态转移—动作互信息三类信息论信号刻画失败前兆,而非依赖模型内部 embedding。其核心洞察是不同失败模式会改变闭环感知—动作信息流,从而兼具可迁移性和诊断性。实验覆盖六个 VLA 与仿真/真实任务,Tri-Info 域内接近最强基线,跨模型和 sim-to-real 无需重训仍保持较高准确率,真实任务约 83%。

Vision-Reasoning-Guided Occlusion Removal from Light Fields Figure 1
2026-06-19cs.CV

Vision-Reasoning-Guided Occlusion Removal from Light Fields

Mohamed Youssef, Oliver Bimber

2026-06-19视觉感知

针对植被等严重遮挡下机器人/野外感知容易失效的问题,本文将光场多视角积分的物理可观测性与视觉语言模型的语义补全能力结合:先用 LFI 抑制前景遮挡,再以 VLM 作为条件先验恢复结构细节,并通过多样本融合降低幻觉。实验在合成与真实光场数据上取得较高 SSIM,且对结构化/非结构化采集有一定泛化,但具体增益中 VLM、融合与数据规模的相对贡献仍需进一步拆分。

CrossFlow: One-Step Generation Across Latent and Pixel Spaces Figure 1
2026-06-19cs.CV

CrossFlow: One-Step Generation Across Latent and Pixel Spaces

Xiyuan Wang, Xiao Zhang, Yang Li, Ruoxi Jiang, Zhao Zhong, Liefeng Bo, Muhan Zhang

Institute for Artificial Intelligence, Peking University, Fudan University

2026-06-19生成模型

本文针对潜空间扩散中“生成器预测 latent、独立解码器负责出图”带来的分布错配与弱像素监督问题,提出 CrossFlow:用潜空间轨迹定义扰动,但去掉速度预测目标,让 ViT 模型一步从噪声 latent 直接生成像素图像,并可替代 VAE 解码器。ImageNet-1k 256×256 上 CrossFlow-XL 单次函数评估达到 1.62 FID,消融显示 latent 表征及感知、对抗损失对保真度关键。

Semantic-Anchored Evidential Fusion for Domain-Robust Whole-Slide Survival Analysis Figure 1
2026-06-19cs.CV

Semantic-Anchored Evidential Fusion for Domain-Robust Whole-Slide Survival Analysis

Yucheng Xing, Ling Huang, Pei Liu, Jingying Ma, Jiaqing Xu, Kai He, Mengling Feng

2026-06-19安全鲁棒

论文针对全切片生存分析在跨医院部署时受染色、扫描仪等域偏移影响而失效的问题,提出 SAEFS:用病理 VQA 自动抽取肿瘤分级、微环境等高层语义锚点,并通过双流 MIL、主观逻辑不确定性建模和谨慎证据融合降低相关模态的过度自信。在仅用 TCGA 训练、四个外部中心零样本测试中,平均 C-index 提升约 10.2%,且校准指标同步改善。

ROSE: Benchmarking the Perception-to-Action Gap in Multimodal Models Figure 1
2026-06-19cs.CV

ROSE: Benchmarking the Perception-to-Action Gap in Multimodal Models

Yihao Wang, Zijian He, Jie Ren, Keze Wang

Sun Yat-sen University, Shaanxi Normal University

2026-06-19视觉语言数据集/基准

ROSE关注多模态模型从“看懂”到“按当前任务行动”的断层:同一网格场景保持不变,只改变区域约束与符号输出,要求模型先推断多数参照物再定位异常并执行计数或坐标点击。该基准用1,512个场景和配对任务分离计数、定位、上下文选择与格式错误。九个MLLM中,人类达98.8%,但模型从计数到区域动作最高下降44.5个百分点,说明瓶颈不只是坐标 grounding,而是将共享视觉证据重新绑定到任务上下文。

Addressing Detail Bottlenecks in Latent Diffusion for RGB-to-SWIR Image Translation Figure 1
2026-06-19cs.CV

Addressing Detail Bottlenecks in Latent Diffusion for RGB-to-SWIR Image Translation

Kaili Wang, Martin Dimitrievski, Jose Maria Salvador, Ben Stoffelen, David Van Hamme, Lore Goetschalckx

2026-06-19视觉感知生成模型

这篇论文关注RGB到SWIR翻译中潜扩散虽高效却丢失小目标细节、进而影响自动驾驶感知的问题。作者将瓶颈拆为自编码器压缩和条件信号下采样,提出SCAE用源图高分辨率特征跳连辅助解码,LGE用可学习编码替代朴素下采样,且不依赖特定去噪骨干。在U-Net和DiT上,方法使检测mAP较潜扩散基线最高提升2倍,小目标最高提升3.4倍,并取得较优FID,同时指出FID与检测性能相关性弱。

SketchKeyAnime: Reference-anchored Sparse Key-Sketch Animation Synthesis Figure 1
2026-06-19cs.CV

SketchKeyAnime: Reference-anchored Sparse Key-Sketch Animation Synthesis

Meixi Li, Xianlin Zhang, Yue Zhang, Xueming Li

Beijing University of Posts and Telecommunications

2026-06-19视觉感知

这篇论文面向低成本动画制作中“只有一张彩色参考图和少量关键草图”的场景,试图减少逐帧绘制与上色负担。其核心是把稀疏草图拆成空间控制与语义时序建模两路,并用带门控的交叉注意力平衡参考外观和草图结构,再用自适应损失强化关键帧线稿监督。在 Sakuga-42M Aesthetic 子集上,相比最佳基线 EDMD 降低 31.9%、FVD 降低 9.5%,显示出更好的结构贴合与时序一致性。

Confidence Calibration for Multimodal LLMs: An Empirical Study through Medical VQA Figure 1
2026-06-19cs.CV

Confidence Calibration for Multimodal LLMs: An Empirical Study through Medical VQA

Yuetian Du, Yucheng Wang, Ming Kong, Tian Liang, Qiang Long, Bingdi Chen, Qiang Zhu

2026-06-19视觉语言

本文关注医疗视觉问答中多模态大模型“自报置信度”与真实正确率不匹配的问题,动机在于过度自信可能误导临床决策。核心做法是用MS-FBI多策略追问结合专家LLM评估,在惩罚、挑战和解释等交互中重新校准置信度。实验在三个Medical VQA数据集上使ECE平均降低约40%,但效率成本与更广泛医疗模型的泛化仍需进一步说明。

Timage: A Generative Text-in-Image Paradigm for Fine-Tuning Vision-Language Models Figure 1
2026-06-19cs.CV

Timage: A Generative Text-in-Image Paradigm for Fine-Tuning Vision-Language Models

Yifeng Wu, Huimin Huang, Ruiluo Wu, Chunyi Lin, Guanhua Chen, Xian Wu, Wang Song, Ruize Han

2026-06-19视觉语言视觉感知生成模型

针对多模态大模型在细粒度空间推理中难以把文本查询锚定到正确图像区域的问题,Timage不改模型参数,而是用受约束 Schrödinger Bridge 将查询以可读文字叠加到图像中,并通过区域搜索与字形预算避免遮挡、保持可读性。文中报告其在 VMCBench 上以7B骨干达到87.7%平均准确率,超过GPT-4o、Qwen2-VL-72B及全量微调基线,显示输入重构可能比参数适配更有效。

DiffMath: Symbol- and Graph-Aware Latent Diffusion Transformer for Handwritten Mathematical Expression Generation Figure 1
2026-06-19cs.CV

DiffMath: Symbol- and Graph-Aware Latent Diffusion Transformer for Handwritten Mathematical Expression Generation

Wei Pan, Xuhan Zheng, Yilin Shi, Huiguo He, Hiuyi Cheng, Dezhi Peng, Minghui Liao, Lianwen Jin

2026-06-19生成模型

针对手写数学公式生成中二维布局复杂、长程结构依赖强且以往方法依赖符号框等昂贵位置标注的问题,DiffMath 将 LaTeX/MathML 的层级结构转化为含符号、空间关系和深度的 RelAST 三元组,并在结构保持的 MathVAE 潜空间中用 MathDiT 扩散生成,另以符号计数通过 AdaLN 提供全局约束。实验显示其在 MathWriting 上优于原始 LaTeX 与 MathML AST 条件,RelAST 达到更高 ExpRate 和更低 FID,并可用合成数据提升下游 OCR,但具体泛化边界仍需更多验证。

Triangular Consistency as a Universal Constraint for Learning Optical Flow Figure 1
2026-06-19cs.CV

Triangular Consistency as a Universal Constraint for Learning Optical Flow

Yi Xiao, Carlos Rodriguez Coronel, Jing Zhan, Haniyeh Ehsani Oskouie, Alex Wong, Dong Lao

2026-06-19生成模型优化算法

论文针对光流学习长期偏重两帧预测、未充分利用真实运动可组合性的缺口,提出“三角一致性”:两段光流复合应与首尾帧直接光流一致,并将循环一致性、视频时序链式监督和仿射增强伪标签统一到同一约束中。该方法无需改网络或额外标注,实验显示在自监督适配、无监督训练和有监督跨数据集泛化中均有提升,单轮适配最高约18.1%,监督跨域最高约23.1%。

Speeding up the annotation process in semantic segmentation industrial applications Figure 1
2026-06-19cs.CV

Speeding up the annotation process in semantic segmentation industrial applications

Marta Fernandez-Moreno, Margarita Guerrero, Rosalia Rementeria, Pablo Mesejo, Raul Moreno

ArcelorMittal Global R&D, SLab—Steel Labs, Calle Marineros 4, 33490, Avilés, Spain, Department of Computer Science and Automatic Control, National Distance Education University (UNED), Juan del Rosal 16, Madrid 28040, Spain

2026-06-19视觉感知

面向工业材料语义分割中高分辨率图像逐像素标注耗时、易出错的问题,论文将无监督分割作为专家标注前的预标注步骤,并直接比较从零标注与“算法预标注+人工修正”的时间成本。结果显示,在钢微结构数据集上标注时间由170小时降至37小时,约减少78%,同时发布82张全标注MicroSteel数据集并训练部署基准模型;但该加速幅度主要针对该冶金场景,跨领域收益文中提示需谨慎外推。

Spatial-Aware Reduction Framework: Towards Efficient and Faithful Visual State Space Models Figure 1
2026-06-19cs.CV

Spatial-Aware Reduction Framework: Towards Efficient and Faithful Visual State Space Models

Jindi Lv, Aoyu Li, Yuhao Zhou, Zheng Zhu, Xiaofeng Wang, Qing Ye, Yueqi Duan, Wentao Feng, Jiancheng Lv

2026-06-19视觉感知

本文针对视觉 Mamba 在剪枝/合并等 token reduction 后,尤其是 VMamba 等依赖 2D selective scan 的结构化变体出现性能崩塌的问题,指出根因不是单纯 token 重要性估计不足,而是展平压缩破坏了二维网格拓扑和邻域语义。作者提出免训练插件 STORM,将压缩约束在行列空间单元和局部窗口内,保持全局布局与局部一致性;实验显示其在多种 Mamba 骨干上显著恢复精度,VMamba 上最高较既有方法提升 63.3% top-1,PlainMamba 仅下降 1.0%。

CARE: Competence-Aware Reward Shaping for Adaptive Reasoning Length in Video-MLLMs Figure 1
2026-06-19cs.CV

CARE: Competence-Aware Reward Shaping for Adaptive Reasoning Length in Video-MLLMs

Chengwen Liu, Hao Peng, Jisheng Dang, Hong Peng, Bin Hu, Tat-Seng Chua

School of Information Science and Engineering, Lanzhou University, Lanzhou, China, School of Medical Technology, Beijing Institute of Technology, Beijing, China, School of Computing, National University of Singapore, Singapore

2026-06-19视觉感知强化学习

这篇论文针对视频多模态推理中固定推理长度奖励与模型能力变化不匹配的问题:早期可能压制探索,后期又鼓励冗长推理。CARE用通过率滑动平均估计能力,在GRPO中奖励从长链探索逐步转向简洁高效,并结合批内长度归一化与困难样本后验放大。实验显示其在多个视频理解/推理基准上提升准确率、稳定训练并减少推理token,且无需推理时额外控制器。

SpatialSV: Internalizing Interpretable 3D Spatial Awareness in MLLMs via Task-Oriented Visual Supervision Figure 1
2026-06-19cs.CV

SpatialSV: Internalizing Interpretable 3D Spatial Awareness in MLLMs via Task-Oriented Visual Supervision

Jiayu Tang, Yuchen Zhou, Chao Gou

School of Intelligent Systems Engineering, Sun Yat-sen University

2026-06-19视觉感知三维

SpatialSV针对MLLM依赖2D图文训练、缺乏内生3D空间表征且外部空间工具推理开销大的问题,提出用任务导向视觉监督把视觉特征显式提升为深度图、相机位姿和点云,并以此作为可解释探针。实验显示该方法在多模型、多基准上提升空间智能,并在半监督场景中接近全量文本监督效果。

Gaussian Process Prior Variational Autoencoder for Endoscopic Videos Figure 1
2026-06-19cs.CV

Gaussian Process Prior Variational Autoencoder for Endoscopic Videos

Ivan De Boi, Xinxing Shi, Xiaoyu Jiang, Tim J.M. Jaspers, Francisco Caetano, Mauricio A. Alvarez, Fons van der Sommen, Sam Van der Jeught

Department of Electromechanics, InViLab, University of Antwerp, Antwerp, Belgium, Department of Computer Science, University of Manchester, Manchester, United Kingdom, Department of Electrical Engineering, Eindhoven University of Technology

2026-06-19视觉感知三维

针对内窥镜视频中高光、运动伪影和缺帧破坏时序连续性、进而影响三维重建与导航的问题,论文将 VAE 的独立潜变量先验替换为时间高斯过程先验,并结合内窥镜编码器与高光掩膜,实现带不确定性的缺帧/缺像素恢复。在 C3VDv2 上,最佳 GPVAE 相比匹配 VAE 平均降低重建 RMSE 21.9%、轨迹 RMSE 12.7%,但验证主要基于受控数据,临床泛化仍需进一步说明。

Linear Recurrent Unit with Semantic Modulation for Image Super-Resolution Figure 1
2026-06-19cs.CV

Linear Recurrent Unit with Semantic Modulation for Image Super-Resolution

Mingyu Choi, Woo Kyoung Han, Sunghoon Im, Kyong Hwan Jin

Korea University

2026-06-19视觉感知

本文针对图像超分中 Mamba/Transformer 类模型虽能建模长程依赖但计算和动态扫描较复杂、而原始 LRU 静态扫描难适应二维空间语义的问题,提出 LSM:以稳定高效的线性循环单元为骨干,引入语义调制单元用 learned prototype 做像素类别划分、LRU 转移调制和特征增强。实验显示其在相近计算复杂度下超过近期超分方法,说明主要增益来自语义驱动的静态递归增强与容量分配。

SurgVista: Long-Horizon Surgical World Modeling with Plausible Instrument-Tissue Dynamics Figure 1
2026-06-19cs.CV

SurgVista: Long-Horizon Surgical World Modeling with Plausible Instrument-Tissue Dynamics

Wentao Pan, Wuyang Li, Shengyuan Liu, Xinyu Liu, Hengyu Liu, Yixuan Yuan

The Chinese University of Hong Kong, Imperial College London

2026-06-19强化学习

面向自主手术中真实交互数据昂贵且体内探索风险高的问题,SurgVista将手术世界模型聚焦到长时域器械-组织动力学,针对接触后组织形变不一致和自回归漂移两类失效,提出基于场景点轨迹的形变一致性正则与在线残差/光度扰动的漂移适应训练,并构建SurgWorld-Bench分离评估器械运动和组织响应;实验显示其在视觉质量、时序一致性和交互保真度上优于现有方法,且预测时域越长优势越明显。

Multimodal Concept Bottleneck Models Figure 1
2026-06-19cs.CV

Multimodal Concept Bottleneck Models

Tongqing Shi, Ge Yan, Tuomas Oikarinen, Tsui-Wei Weng

2026-06-19视觉语言

针对传统概念瓶颈模型只能处理固定类别、且线性分类头可能绕过概念层造成信息泄漏的问题,本文将 CBM 扩展到 CLIP,提出图像与文本双概念瓶颈,使任意文本标签和图像都映射到同一可解释概念空间,并以概念响应相似度完成预测。实验显示其在四个基准上较既有 CBM 平均最高提升 51.26%,同时精度距黑盒模型约 5% 内。

MMD-SLAM: Structure-Enhanced Multi-Meta Gaussian Distribution-Guided Visual SLAM Figure 1
2026-06-19cs.RO

MMD-SLAM: Structure-Enhanced Multi-Meta Gaussian Distribution-Guided Visual SLAM

Fan Zhu, Ziyu Chen, Peichen Liu, Yifan Zhao, Zhisong Xu, Hui Zhu, Hongxing Zhou, Sixun Liu, Chunmao Jiang

2026-06-19三维

这篇论文针对现有 3DGS-SLAM 对室内结构先验利用不足、易导致渲染模糊和地图不一致的问题,提出 MMD-SLAM:在跟踪中融合点线特征约束位姿,在建图中用 Atlanta World 假设引导点、线、面三类 Multi-Meta Gaussian 及其演化优化。实验显示其在 ScanNet 上较 MonoGS 降低 48.56% ATE RMSE,在 Replica 上提升 5.71% PSNR。

PSCT-Net: Geometry-Aware Pediatric Skull CT Reconstruction via Differentiable Back-Projection and Attention-Guided Refinement Figure 1
2026-06-19cs.CV

PSCT-Net: Geometry-Aware Pediatric Skull CT Reconstruction via Differentiable Back-Projection and Attention-Guided Refinement

Dong Yeong Kim, Jaewon Choi, Youmin Shin, Jungyu Lee, Myeongseop Kim, Jinwook Choi, Joo Whan Kim, Young-Gon Kim

2026-06-19三维

该文针对儿童颅面诊断中 CT 辐射高、双平面 X 光又缺乏深度信息的问题,提出 PSCT-Net:用可微反投影显式注入成像几何,结合注意力引导 2D-3D 对应和 BiM-3D 建模长程体素依赖,以减少深度歧义和骨缝等细节丢失。作者还构建 982 例私有儿童颅骨数据集,并称在三个公开基准和该队列上优于扩散等方法且推理更高效。

ViCoStream: Streaming VideoLLMs Can Run Beyond 100 FPS with Stage-Wise Coordinated Inference Figure 1
2026-06-19cs.CV

ViCoStream: Streaming VideoLLMs Can Run Beyond 100 FPS with Stage-Wise Coordinated Inference

Yang Tan, Junlong Tong, Linan Yue, Hao Wu, Pengfei Fang, Xiaoyu Shen

Southeast University, Eastern Institute of Technology, Ningbo, Shanghai Jiao Tong University

2026-06-19视觉感知

本文针对流式 VideoLLM 在长视频中难以同时保持高吞吐和低首 token 延迟的问题,指出单独加速编码、剪枝或缓存压缩会导致瓶颈迁移。ViCoStream 将预处理、ViT 编码、token dropping 与 LLM 推理组织为分阶段流水线,并结合 chunk 执行、CUDA 重叠、有界视觉注意力和查询侧检索来限制每块计算与显存。实验显示其在单张 A100 上达到 134 FPS、TTFT 低于 50ms,精度接近全历史基线。

OTCHA: Optimal Transport-driven Confidence-aware Latent Hub Alignment for Multi-View Medical Image Classification Figure 1
2026-06-19cs.CV

OTCHA: Optimal Transport-driven Confidence-aware Latent Hub Alignment for Multi-View Medical Image Classification

Jiwoong Yang, Haejun Chung, Ikbeom Jang

2026-06-19视觉感知

该文针对多视角医学图像未配准、背景和视角特异伪影会污染直接融合特征的问题,提出 OTCHA:先用可学习 latent hub 作为跨视角中介,通过结合特征与几何代价的最优传输及 dustbin 机制筛掉低置信 token,再以置信度门控消息传递和 OTRA 损失稳定对齐。三类多视角医学数据集上相对现有融合方法取得一致提升,且参数开销较小,但仍局限于固定视角设置。

World Engine: Towards the Era of Post-Training for Autonomous Driving Figure 1
2026-06-19cs.RO

World Engine: Towards the Era of Post-Training for Autonomous Driving

Tianyu Li, Li Chen, Caojun Wang, Haochen Liu, Kashyap Chitta, Zhenjie Yang, Yuhang Lu, Naisheng Ye, Yihang Qiu, Yufei Wang, Luoxi Zou, Jiaxin Peng, Jin Pan, Zhaoyu Su, Andrei Bursuc, Shengbo Eben Li, Andreas Geiger, Peng Su, Hongyang Li

2026-06-19强化学习

针对自动驾驶长尾安全事件稀缺、仅扩大真实数据收益递减的问题,World Engine从真实日志中发现失败场景,重建高保真交互仿真并生成交通变体,用强化学习对端到端驾驶策略后训练。nuPlan闭环长尾基准上失败显著减少,收益超过单纯加倍预训练数据;在量产系统中仿真碰撞率最高降45.5%,200公里路测零接管。

Neural Events: Discrete Asynchronous Autoencoders for Event-Based Vision Figure 1
2026-06-19cs.CV

Neural Events: Discrete Asynchronous Autoencoders for Event-Based Vision

Roberto Pellerito, Daniel Gehrig, Shintaro Shiba, Davide Scaramuzza

Robotics and Perception Group, University of Zurich, University of Pennsylvania, The University of Tokyo, Keio University

2026-06-19视觉感知

事件相机原始事件时间精度高但单个语义弱,现有同步表征损失稀疏性,异步 SNN/GNN 又难扩展。论文提出离散异步编码器,将局部时空事件序列映射到可学习码本,只有码字翻转时才触发“神经事件”,并用重建与时间平滑预训练抑制冗余触发。在检测和分类中,其事件率约降至原来的 1/2,性能持平或优于多种基线,编码计算量也低于既有异步编码器。

3D-PLOT-LLM: Part-Level Object Tokens for 3D Large Language Models Figure 1
2026-06-19cs.CV

3D-PLOT-LLM: Part-Level Object Tokens for 3D Large Language Models

Jintang Xue, Xinyu Wang, Yixing Wu, Jingwen Chen, C.-C. Jay Kuo

University of Southern California, Ohio State University

2026-06-19三维

这篇论文针对现有3D多模态大模型只能整体描述物体、难以命名和推理局部部件的问题,提出把点云patch划分为固定几何区域,并为每个区域引入可读写的<part_k>词表标记,再用MSR结合空间统计和邻接关系细化区域表示。其关键洞察是将部件理解转化为LLM词表级寻址,而非依赖分割解码器或框预测头。实验显示,在少于100万新增参数下,模型在PartVerse-QA、3DCoMPaT-GrIn和Objaverse captioning上均优于多项基线,但粒度仍受固定K槽限制,不能替代点级分割。

CSWinUNETR: Segmentation of Thin Anatomical Structures in Medical Images Figure 1
2026-06-19cs.CV

CSWinUNETR: Segmentation of Thin Anatomical Structures in Medical Images

Junho Moon, Haejun Chung, Ikbeom Jang

2026-06-19视觉感知

本文针对视网膜血管、脑血管和皱纹等细长弯曲结构易低对比、断裂和类别不平衡的问题,提出通用2D/3D分割骨干CSWinUNETR。核心思路是用带循环移位的十字条带注意力建模轴向长程依赖,再结合细节增强多尺度注意力与稀疏控制动态蛇形卷积,使特征沿弯曲轨迹聚合。四个跨眼科、神经血管和皮肤影像基准显示其优于代表性方法,且不依赖任务特定后处理或拓扑损失。

Training-Free Metrics for Synthetic Object Detection Data: A Proxy for Detector Performance Figure 1
2026-06-19cs.CV

Training-Free Metrics for Synthetic Object Detection Data: A Proxy for Detector Performance

Myeongseok Nam, Donghoon Yeo, Seungwook Kim

2026-06-19视觉感知

这篇论文关注合成数据用于目标检测时“先训练再评估”成本高的问题,指出 FID/KID/MMD 等全局特征距离忽略目标数量、尺度、类别组成等会影响检测 mAP 的元数据。作者提出无需训练的 CCDM 指标族,按图像元数据分层后同时衡量层内外观匹配与层间组成差异。在 VisDrone-DET 上,CCDM-MMD_CLIP 对五个候选训练集的排序与 YOLOv8 mAP 完全一致,Spearman 相关为 1.0,但验证范围仍限于单数据集和单检测器。

ParaScale: Scale-Calibrated Camera-Motion Transfer via a Gauge-Invariant Parallax Number Figure 1
2026-06-19cs.CV

ParaScale: Scale-Calibrated Camera-Motion Transfer via a Gauge-Invariant Parallax Number

Zijie Meng

Peking University, China

2026-06-19视觉感知

这篇论文针对参考视频相机运动迁移中的尺度失配问题:同一轨迹用于星空或桌面场景会导致运动过弱或过强。核心洞察是平移感知强度由基线与场景深度之比决定,提出尺度规不变的 Parallax Number,并用 ParaScale 在推理时按目标深度逐帧重标定平移、保留旋转。实验称其在四个尺度量级和多种生成骨干上将 PCE 较未校准迁移降低超过 3 倍,且基本不损失视觉质量。

HypOProto: Hyperbolic Ordinal Prototypes for Left Ventricular Filling Pressure Classification Figure 1
2026-06-19cs.CV

HypOProto: Hyperbolic Ordinal Prototypes for Left Ventricular Filling Pressure Classification

Victoria Wu, Nima Hashemi, Hooman Vaseli, Christina Luong, Purang Abolmaesumi, Teresa S. M. Tsang

2026-06-19视觉感知

这篇论文针对传统 LVFP 依赖多普勒 E/e′ 测量、受操作者和资源限制影响且深度模型难解释的问题,提出 HypOProto:用冻结 DINOv3 超声表征、双曲空间序数原型和 HyperPAS 损失,把接近阈值的模糊病例放在双曲根部、确定病例外移。私有大规模心超数据上,其 cine 级 bACC 达 82.57、study 级平均 F1 达 0.79,优于多数基线并保留原型可视化解释性。

Flow Map Denoisers: Traversing the Distortion-Perception Plane for Inverse Problems Figure 1
2026-06-19cs.LG

Flow Map Denoisers: Traversing the Distortion-Perception Plane for Inverse Problems

Nicolas Zilberstein, Morteza Mardani, Santiago Segarra

Rice University, NVIDIA Inc.

2026-06-19生成模型

针对图像逆问题中低失真常导致模糊、强感知质量又牺牲保真度的矛盾,论文指出 flow map 的 lookahead 参数天然对应一族“平均去噪器”,可在单个模型内连续调节 DP 权衡。作者证明高斯情形下可精确恢复最优 DP 前沿,并将其嵌入 PnP 求解器;在 CelebA、AFHQ 的修复、去模糊、超分等任务上,该方法能覆盖两端及中间操作点,部分匹配或超过专门基线。

Occ-VLM: Occupancy Grounded Vision Language Model for Indoor Scene Understanding Figure 1
2026-06-19cs.CV

Occ-VLM: Occupancy Grounded Vision Language Model for Indoor Scene Understanding

Jianing Li, Zhou Fang, Yijiang Liu, Li Du

2026-06-19视觉语言视觉感知

该文针对现有3D视觉语言模型依赖点云/RGB-D或额外几何编码器、导致RGB场景理解复杂且割裂的问题,提出Occ-VLM:用单一2D视觉编码器从带位姿RGB图像预测语义占据,并以占据作为2D token与3D空间对齐的桥梁。核心洞察是2D预训练语义可反哺3D几何,几何占据又提升空间推理。实验显示其在多视角占据预测达SOTA,在3D VQA和稠密描述上接近显式3D输入模型。

Contour-Constrained Deformable Registration with Parameter Characterization for Head and Neck Surgical Guidance Figure 1
2026-06-19eess.IV

Contour-Constrained Deformable Registration with Parameter Characterization for Head and Neck Surgical Guidance

Qingyun Yang, Jon S. Heiselman, Ayberk Acar, Morgan J. Ringel, Michael I. Miga, Matthieu Chabanas, Michael C. Topf, Jie Ying Wu

Vanderbilt University, Department of Computer Science, 2301 Vanderbilt Pl, Nashville, United States, Vanderbilt University, Department of Biomedical Engineering, 2301 Vanderbilt Pl, Nashville, United States, Vanderbilt University Medical Center, Department of Otolaryngology-Head and Neck Surgery, 1211 Medical Center Drive, Nashville, United States

2026-06-19视觉感知

这篇论文面向头颈癌术中切缘复定位难题:切除标本会因收缩和软组织变形而难以与切除床对齐。作者在基于 Kelvinlet 的生物力学可变形配准中加入边界轮廓约束,并系统分析表面、标志点、轮廓和应变正则权重。9 个标本实验中,目标配准误差由刚性配准的 11.11 mm 降至 5.62 mm,较无轮廓约束方案也明显改善,舌部样本收益最大。

VFACamou: View-Fused Adversarial Camouflage for Environment-Adaptive Physical Evasion Figure 1
2026-06-19cs.CV

VFACamou: View-Fused Adversarial Camouflage for Environment-Adaptive Physical Evasion

Shihui Yan, Hu Liu, Junyu Shi, Zihui Zhu, Ziqi Zhou, Yufei Song, Youming Geng, Minghui Li, Shengshan Hu

State Key Laboratory of Intelligent Vehicle Safety Technology, School of Cyber Science and Engineering, Huazhong University of Science and Technology, School of Computer Science and Technology, Huazhong University of Science and Technology, School of Software Engineering, Huazhong University of Science and Technology, Hebei Energy College of Vocation And Technology

2026-06-19视觉感知

面向无人机侦察中视角、尺度、姿态与光照持续变化导致物理对抗伪装失效的问题,VFACamou将UV体渲染、扩散纹理生成、光照/主色估计与多尺度动态训练结合,在兼顾环境融合和检测规避的同时生成可穿戴纹理。文中称其在8类主流检测器和多视角物理测试中较既有方法显著降低人体检出率,并保持更自然的视觉外观。

GLARE: A Natural Language Interface for Querying Global Explanations Figure 1
2026-06-19cs.AI

GLARE: A Natural Language Interface for Querying Global Explanations

Bhavan Vasu, Rajesh Mangannavar

2026-06-19视觉感知

GLARE针对全局解释规模大、规则复杂导致用户难以定位问题的痛点,将视觉分类器的概念式局部解释整理为可查询数据库,并用微调LLM把自然语言问题映射到受模板约束的SQL,再返回统计、局部证据和可视化。实验显示,在ADE20K上微调模型结果匹配率约95%,对拼写和同义改写较正则更稳,并能零样本迁移到PASCAL VOC;但评估主要围绕查询解析,真实用户收益仍需进一步验证。

QueryGaussian: Scalable and Training-Free Open-Vocabulary 3D Instance Retrieval Figure 1
2026-06-19cs.CV

QueryGaussian: Scalable and Training-Free Open-Vocabulary 3D Instance Retrieval

Xiuyuan Zhu, Ke Lu, Zijie Yang, Chao Yue, Jian Xue, Dongming Zhang

2026-06-19三维

QueryGaussian针对大规模3DGS场景中开放词汇实例检索的内存与预处理瓶颈,避开把语义特征蒸馏进每个高斯的场景级嵌入范式,改为按查询调用预训练2D视觉模型生成掩码,并通过最大权重关联提升到3D,再用跨视角时序融合和多阶段密度聚类去噪。实验显示其精度接近现有方法,同时GPU显存降低70%以上、推理最高加速180倍,可在消费级硬件上处理千万级高斯城市场景。

One-Shot Novel View and Pose Human Image Synthesis via 3D Prior Guided Diffusion Model Figure 1
2026-06-19cs.CV

One-Shot Novel View and Pose Human Image Synthesis via 3D Prior Guided Diffusion Model

Shenjian Gong, Kangkan Wang, Shanshan Zhang, Jian Yang

aPCA Lab, Key Lab of Intelligent Perception and Systems for High-Dimensional Information of Ministry, of Education, and Jiangsu Key Lab of Image and Video Understanding for Social Security, School of, Computer Science and Engineering, Nanjing University of Science and Technology, Nanjing, 210094, bAdvanced Laser Technology Laboratory of Anhui Province, Electronic Engineering Institute, National, University of Defense Technology, and Jianghuai Advance Technology Center, Hefei 230037, China, generalization ability across datasets. The code will be made publicly available at

2026-06-19视觉感知生成模型三维

本文针对单张参考图在新视角与新姿态下合成人体时,2D姿态条件歧义、NeRF难恢复遮挡区域的问题,提出以扩散模型为生成框架,并引入SMPL驱动的3D法线图与颜色提示分别约束几何和外观,再用自重建式个性化微调增强未知人物细节。实验显示其在RenderPeople和THuman上优于既有方法,并具备更好的跨数据集泛化。

Efficient Neural Network Model Selection for Few-Class Application Datasets Figure 1
2026-06-19cs.LG

Efficient Neural Network Model Selection for Few-Class Application Datasets

Bryan Bo Cao, Abhinav Sharma, Lawrence O'Gorman, Michael Coss, Shubham Jain

Department of Computer Science, Stony Brook University, Nokia Bell Labs, Part of the rapid progress of neural network technology is due to the public availability

2026-06-19数据集/基准

针对许多实际应用只有少数类别、却常按 ImageNet/COCO 等多类基准选模型导致冗余的问题,论文提出用类别数、类内/类间相似度等数据侧属性估计分类难度,并指出“少类可区分性”会改变精度—规模关系。该指标可比反复训练测试快 6–29 倍;结合向更小尺度扩展的模型族,在移动机器人、无人机和 IoT 场景中取得相近精度下更小模型,如机器人任务中比 YOLOv5-nano 小最多 42%。

NEST: Narrative Event Structures in Time for Long Video Understanding Figure 1
2026-06-19cs.CV

NEST: Narrative Event Structures in Time for Long Video Understanding

Ali Asgarov, Kaushik Narasimhan, Najibul Haque Sarker, Hani Alomari, Chia-Wei Tang, Anushka Sivakumar, Zaber Ibn Abdul Hakim, Shaurya Mallampati, Chris Thomas

Department of Computer Science, Virginia Tech

2026-06-19视觉感知

NEST针对长视频模型“能读长上下文但不懂叙事结构”的问题,构建1005部完整电影、平均约98分钟的多模态事件基准,将视觉、对白、音频中的叙事事件与时间顺序、层级组成和长程依赖关系连接起来,并设置触发检测、定位、论元抽取和关系抽取任务。结果显示现有模型在事件发现上很弱,ETD低于8%、EL低于6%、EAE低于11%,但给定事件后的关系抽取相对可做,微调后F1达44.42%。

Exploring Multi-Modal Large Language Models and Two-Stage Fine-Tuning for Fashion Image Retrieval Figure 1
2026-06-19cs.CV

Exploring Multi-Modal Large Language Models and Two-Stage Fine-Tuning for Fashion Image Retrieval

Nguyen Cao Hoang, Hoang Bui Le, Nam Vo Hoang, Trung-Nghia Le

2026-06-19视觉感知

该文针对时尚组合图像检索中细粒度属性难识别、标注三元组稀缺和随机负样本过弱的问题,引入 LLaVA 生成颜色、纹理、款式等属性感知描述与合成三元组,并用两阶段微调结合粗对齐和硬负样本对比学习。实验在 FashionIQ 上显示组合推理和细粒度检索有所改善,但文中对具体增益来源拆分仍不够充分,可能部分来自数据扩增与负样本 scaling。

Vortex: Multi-Modal Fusion System for Intelligent Video Retrieval Figure 1
2026-06-19cs.CV

Vortex: Multi-Modal Fusion System for Intelligent Video Retrieval

Duc-Tho Nguyen, Hieu-Hoc Tran-Minh, Khanh-Hoa Lam, Hoang-Nhut Ly, Huu-Phuc Huynh, Thanh-Tien Tran, Trung-Nghia Le

2026-06-19视觉感知

面向大规模视频库中自然语言、视频片段、问答与时序事件检索的需求,Vortex将自适应关键帧抽取、多模态元数据生成与交互式检索整合到统一系统中,核心在于用CLIP捕获全局语义、SigLIP2补充细粒度线索,并以RRF融合排序,同时加入Rocchio反馈和多阶段时序对齐。系统在AIC’25预赛取得79.6/88(90.5%),决赛总体为Excellent,QA任务达到Outstanding。

TeleMorpher: Toward Robust Simultaneous Motion-Location Editing Figure 1
2026-06-19cs.CV

TeleMorpher: Toward Robust Simultaneous Motion-Location Editing

Haengbok Chung

2026-06-19安全鲁棒

针对现有视频运动编辑难以同时改变人物动作与位置、且易出现闪烁和外观漂移的问题,TeleMorpher将人物与背景分离,利用可控3D/合成运动先验生成目标运动引导,并通过免训练姿态变形注入基线编辑器以缩小源目标运动差距。文中还提出基于LPIPS的背景一致性和骨架对齐指标;在野外视频、合成视频与TaiChi数据集上,定量指标和真人评测均优于对比方法。

Learning When to Denoise: Optimizing Asynchronous Schedules for Latent Diffusion Figure 1
2026-06-19cs.CV

Learning When to Denoise: Optimizing Asynchronous Schedules for Latent Diffusion

Bingshuo Qian, Xiang Cheng

Department of Electrical and Computer Engineering, Duke University, FID 2.14 at 600 epochs. Code is available at https://github.com/bsq532087/LWD.

2026-06-19生成模型

多表示扩散中,语义与纹理潜变量何时去噪会显著影响结构形成和细节恢复,手工异步调度难以适配模型与表示。本文把语义领先的时间表作为可学习对象,提出带局部时间权重校正的异步 flow matching、凸单调参数化与低开销联合探测。ImageNet 256 上,675M XL 在 AutoGuidance 下 200 epoch 达 FID 1.05,600 epoch 达 1.02,并优于更大 SFD-XXL。

BrainG3N: A Dual-Purpose Tokenizer for Controllable 3D Brain MRI Generation Figure 1
2026-06-19cs.AI

BrainG3N: A Dual-Purpose Tokenizer for Controllable 3D Brain MRI Generation

Max Van Puyvelde, Ibrahim Gulluk, Wim Van Criekinge, Olivier Gevaert

Department of Biomedical Data Science, Stanford University School of Medicine, Department of Mathematical Modelling, Statistics & Bioinformatics, Ghent University, Department of Electrical Engineering, Stanford University

2026-06-19规划控制三维

本文针对3D脑MRI潜空间生成中“可重建”和“含临床语义”难以兼得的问题,提出冻结3D MAE编码器、另接线性投影与CNN解码器的双用途tokenizer,并在其嵌入上训练条件DiT。模型用3.5万例多队列MRI预训练,在23个线性探测任务中21项达到或超过现有基线,并支持六类条件生成与纵向预测;但跨队列混杂仍明显,部分增益可能来自数据规模与分布覆盖。

SAFE-Cascade: Cost-Adaptive Vision-Language Routing for Chart Question Answering Figure 1
2026-06-19cs.IR

SAFE-Cascade: Cost-Adaptive Vision-Language Routing for Chart Question Answering

Ayush Dwivedi, Qixin Wang, Ashvi Soni, Ruoteng Wang, Han Li, Animesh Mahapatra, Neeraj Agrawal, Xintao Wu

University of Arkansas, University of Arkansas USA

2026-06-19视觉语言视觉感知安全鲁棒

这篇论文针对图表问答中“每题都调用VLM”带来的成本浪费,提出SAFE-Cascade:先用OCR与文本模型生成答案,再由随机森林路由器判断是否升级到视觉语言模型,并把证据、概率、成本和阈值暴露给用户。ChartQA测试中其准确率69.1%,与全VLM的67.7%统计上相当,同时减少26.9%的VLM调用和9.3%估算成本。

Scaling Self-Play for End-to-End Driving Figure 1
2026-06-19cs.RO

Scaling Self-Play for End-to-End Driving

Luke Rowe, Roger Girgis, Rodrigue de Schaetzen, Daphne Cornelisse, Alaap Grandhi, Felix Heide, Eugene Vinitsky, Christopher Pal, Liam Paull

NYU Tandon School of Engineering, 6 McMaster University, 7 Princeton University

2026-06-19视觉感知

针对端到端自动驾驶依赖人类日志、缺少闭环反馈而易累积误差的问题,论文提出在简化像素级仿真器 Gigapixel 中进行大规模自博弈,并用特权 RL 教师通过 self-play DAgger 蒸馏像素策略,再做轻量感知适配迁移到真实传感器。结果显示该方法无需人类轨迹监督,在 HUGSIM 和 NAVSIM-v2 上达到有竞争力表现,且性能随自博弈训练规模提升而增长。

GB-LSR: A Fast Local Spectral Image Representation with a Single Global Bandwidth for Continuous Reconstruction and Super-Resolution Figure 1
2026-06-19cs.CV

GB-LSR: A Fast Local Spectral Image Representation with a Single Global Bandwidth for Continuous Reconstruction and Super-Resolution

Max Shad, Naeem Khoshnevis

Kempner Institute for the Study of Natural, Harvard University

2026-06-19视觉感知三维

针对连续图像重建和任意尺度超分中,坐标 MLP 表达力与逐点推理成本难兼顾的问题,GB-LSR 将图像划分为局部 patch,用共享卷积特征预测截断傅里叶系数,并以单个全局可训练带宽控制所有局部谱基。结果显示,在匹配预算重建基准上较 LIIF/LTE/WIRE 提升 2.8–3.6 dB PSNR、降低 LPIPS,推理约为最慢基线 0.247 倍;超分扩展也更快,但结论严格限于其设定协议。

Language-Instructed Vision Embeddings for Controllable and Generalizable Perception Figure 1
2026-06-19cs.CV

Language-Instructed Vision Embeddings for Controllable and Generalizable Perception

Chengzhi Mao, Xudong Lin, Wen-Sheng Chu

CONTROLLABLE AND GENERALIZABLE PERCEPTION, relevant aspects of the input, yielding more controllable and generalizable represen-, reliance on descriptive text rather than true instructions, limiting their versatility and controllability., generalizable, and controllable visual perception. More details and training data are available at our

2026-06-19视觉感知规划控制

现有视觉基础模型多生成静态特征,任务适配依赖下游大模型,容易丢失细粒度线索并产生幻觉。LIVE 的核心洞察是把语言指令直接注入视觉编码器,在推理时生成任务相关嵌入,并用 LLM 合成的图像-指令-答案三元组训练。实验显示其在 MMVP 上提升 34 分、GQA 超过更大 VLM 约 7 分,且能泛化到未见指令,但效果也可能主要受合成数据质量影响。

FrequencyFormer: A Co-Designed Sensor-to-Processor Pipeline for Frequency-Domain Vision Transformer Inference Figure 1
2026-06-19eess.IV

FrequencyFormer: A Co-Designed Sensor-to-Processor Pipeline for Frequency-Domain Vision Transformer Inference

Chengwei Zhou, Ovishake Sen, Xuming Chen, Rishith Paramasivam, Shaahin Angizi, Swarup Bhunia, Baibhab Chatterjee, Gourav Datta

Case Western Reserve University, USA, University of Florida, USA, New Jersey Institute of Technology, USA, foundation for scalable in-sensor ViT deployment., memory (CiM) fabric [13], as well as scalable neural accelerators

2026-06-19视觉感知

本文针对边缘视觉系统中 ViT 推理的传感器到处理器传输能耗与带宽瓶颈,提出在近传感器端用多尺度 DCT 将图像转为紧凑频域 token,并以 LUT 硬件和低功耗 MIPI 链路协同实现。其核心洞察是频域低频系数可保留主要视觉信息且便于固定系数硬件化;实验称数据量最高降 128×,通信能耗约降 230×,传感器侧总能耗降 2.22×,精度仅小幅下降。

Mix-QVLA: Task-Evidence-Aware Mixed-Precision Quantization of Vision-Language-Action Models Figure 1
2026-06-19cs.CV

Mix-QVLA: Task-Evidence-Aware Mixed-Precision Quantization of Vision-Language-Action Models

Navin Ranjan, Andreas Savakis

Rochester Institute of Technology

2026-06-19视觉语言视觉感知

这篇论文针对VLA模型难以部署到资源受限机器人上的问题,指出仅用最终动作偏差评估量化敏感性会忽略内部任务证据是否被破坏。Mix-QVLA用全精度动作决策作锚点,在视觉、跨模态推理和动作形成等边界比较梯度加权证据图,并结合时间敏感性分配混合精度。LIBERO实验中,OpenVLA-OFT显存由15.4GB降至4.1GB,成功率96.3%接近BF16的97.1%,推理加速1.52倍。

PerceptionDLM: Parallel Region Perception with Multimodal Diffusion Language Models Figure 1
2026-06-19cs.CV

PerceptionDLM: Parallel Region Perception with Multimodal Diffusion Language Models

Yueyi Sun, Yuhao Wang, Jason Li, Ye Tian, Tao Zhang, Jacky Mai, Yihan Wang, Haochen Wang, Jinbin Bai, Ling Yang, Yunhai Tong

Peking University MSALab, ByteDance

2026-06-19视觉语言生成模型

这篇论文针对多区域视觉感知中自回归MLLM需逐区域、逐token生成导致延迟随区域数线性增长的问题,提出基于扩散语言模型的PerceptionDLM,通过区域感知mask嵌入、结构化注意力与并行去噪,在一次生成中同时描述多个区域。实验显示其在ParaDLC-Bench上较LLaDA-V准确率显著更高,并在密集区域场景获得约3.5倍吞吐提升。

ImageWAM: Do World Action Models Really Need Video Generation, or Just Image Editing? Figure 1
2026-06-19cs.CV

ImageWAM: Do World Action Models Really Need Video Generation, or Just Image Editing?

Yuyang Zhang, Wenyao Zhang, Zekun Qi, He Zhang, Haitao Lin, Jingbo Zhang, Yao Mu, Xiaokang Yang, Wenjun Zeng, Xin Jin

2026-06-19视觉感知强化学习

论文针对视频生成式世界动作模型推理昂贵、易建模无关外观细节且长时预测误差会误导控制的问题,提出用预训练图像编辑模型替代未来视频生成:不解码目标图,而利用编辑去噪过程的 KV cache 作为紧凑的动作上下文,并接入 flow-matching 动作专家。实验显示 ImageWAM 在仿真和真实任务上优于标准 VLA 与竞争性 WAM,同时将 FLOPs 降至视频式 WAM 的 1/6、延迟降至 1/4。

LooseControlVideo: Directorial Video Control using Spatial Blocking Figure 1
2026-06-19cs.CV

LooseControlVideo: Directorial Video Control using Spatial Blocking

Shariq Farooq Bhat, Niloy J. Mitra, Kalyan Sunkavalli

2026-06-19视觉感知规划控制

本文针对文本到视频中多物体轨迹、遮挡和交互难以精确导演的问题,提出用稀疏有朝向的 3D 包围盒作为电影“走位”控制,并以 DNOCS 编码尺寸、朝向和深度遮挡来微调 Wan 2.2。实验在 nuScenes、HO-3D、BEHAVE 上显示,相比 2D 框和光流等控制,轨迹误差降低约 1.2–3 倍,刚体运动一致性提升约 2 倍,遮挡准确率提升约 1.5–2 倍。

LEAP: Layer-skipping Efficiency via Adaptive Progression for Vision Transformer Distillation Figure 1
2026-06-19cs.CV

LEAP: Layer-skipping Efficiency via Adaptive Progression for Vision Transformer Distillation

Jiaqi Zhang, Ashton Lee, Anthony Wong, John Zou, Sami BuGhanem, Randall Balestriero

2026-06-19视觉感知

LEAP针对大规模ViT教师与小学生模型之间的表征能力落差,认为直接模仿最终层会导致训练不稳、收敛慢。其核心做法是把教师中间层按由浅到深作为课程目标,并用在线CKA相似度自适应决定何时跳到更深层,避免手工层匹配。实验显示ViT-S在ImageNet-100达90.1%,较基线提升12.24%,在Oxford/Paris检索分别提升3.84%和7.75%,并节省25.1%训练FLOPs与21%时间。

Scaling Generative Foundation Models for Chest Radiography with Rectified Flow Transformers Figure 1
2026-06-19cs.CV

Scaling Generative Foundation Models for Chest Radiography with Rectified Flow Transformers

Fabio De Sousa Ribeiro, Emma A.M. Stanley, Charles Jones, Tian Xia, Dominic C. Marshall, Laurent Renard Triché, Christopher V. Cosgriff, Panagiotis Dimitrakopoulos, Sotirios A. Tsaftaris, Ben Glocker

Imperial College London, Causality in Healthcare AI Hub, 3 University of Edinburgh, Department of Perioperative Medicine, CHU Clermont-Ferrand, Department of Medicine, Massachusetts General Hospital, 7 Broad Institute of MIT and Harvard

2026-06-19生成模型

针对胸片数据难共享、分布偏倚和现有生成模型在保真度、可控性及跨人群泛化上的不足,论文构建CXR7-1M数据集,并从零训练最高1.3B参数的Rectified Flow Transformer,引入临床因果图控制人口学、体位和病灶属性。RadiT XL在CheXGenBench上较既有方法显著降低FDD/KDD,专家实验称合成片与真实片难以区分,但增益可能主要来自scaling / data。

3D-DLP: Self-Supervised 3D Object-Centric Scene Representation Learning Figure 1
2026-06-19cs.LG

3D-DLP: Self-Supervised 3D Object-Centric Scene Representation Learning

Ellina Zhang, Madhaven Iyengar, Amir Zadeh, Chuan Li, Deepak Pathak, David Held, Tal Daniel

2026-06-19三维

面向机器人操作中3D观测高维、稀疏且难以直接用于控制的问题,3D-DLP将DLP扩展到RGB-D和彩色/占据体素,以自监督重构学习把场景分解为带3D关键点、尺度和外观的潜在粒子,并引入外观感知K-means先验与色度重构损失。实验显示其分解可解释且可编辑,在重构上优于非物体中心AE/VAE,并在MimicGen与RLBench操作任务中相对2D粒子或体素基线取得更高成功率。

3D Scene Graphs: Open Challenges and Future Directions Figure 1
2026-06-19cs.RO

3D Scene Graphs: Open Challenges and Future Directions

Dennis Rotondi, Francesco Argenziano, Sebastian Koch, Nathan Hughes, Martin Buechner, Johanna Wald, Lukas Rosenberger Schmid, Daniele Nardi, Abhinav Valada, Liam Paull, Federico Tombari, Luca Carlone, Kai O. Arras

University of Stuttgart, Sapienza University of Rome, University of Freiburg, University of Montreal, be exhaustive and included all available relevant works in, ric grounding, and scalability to large scenes. Subsequently

2026-06-19三维

面向机器人在真实三维环境中同时需要几何精度、语义理解和可查询记忆的问题,本文系统梳理3D场景图这一表示。核心洞察是用统一定义连接节点/边属性、层级、动态性与可供性,并比较从传感数据构建、下游规划/导航/操作应用及评测协议。主要结果是指出领域仍被术语、管线和基准割裂,现有指标难以反映任务级表现,并发布持续更新的3DSG论文检索网站。

Full-Self Diagnostics (FSD): Physics-Grounded Visual Biomarker Inference from Smartphone Video via Inverse Problems and Operator Learning Figure 1
2026-06-19eess.IV

Full-Self Diagnostics (FSD): Physics-Grounded Visual Biomarker Inference from Smartphone Video via Inverse Problems and Operator Learning

Jonathan Thomas, Harsh Thaker

Algomash® (Algorithmic Mashup Inc.)

2026-06-19视觉感知

本文动机是摆脱专用传感器,用普通手机9秒面部视频推断血糖等生理指标。核心洞察是把皮肤光传输、色素吸收、rPPG、眼动和行为时序视作多通道可观测信号,并用逆问题与算子学习融合。主要结果为59人38812次配对扫描中,作者自测MARD 29.86%,最佳个体约17%;但临床有效性与增益是否主要来自个体数据 scaling 仍需更严格验证。

ProMUSE: Progressive Multi-modal Uncertainty-guided Staged Evidential Alzheimer Disease Classification Figure 1
2026-06-19cs.LG

ProMUSE: Progressive Multi-modal Uncertainty-guided Staged Evidential Alzheimer Disease Classification

Long Doan, Branden Chen, Ethan Litton, Huan Huang, Jiajing Huang, Yixin Xie, Weihua Zhou, Nandakumar Narayanan, Chen Zhao

2,3,4,9Department of Computer Science, Kennesaw State University, Department of Data Science and Analytics, Kennesaw State University, Department of Information Technology, Kennesaw State University, Department of Applied Computing, Michigan Technological University, Department of Neurology, University of Iowa, and they typically assume that all modalities are readily available at inference time. Under this, modality availability, they overlook the practical constraints of cost and accessibility in real-world

2026-06-19安全鲁棒

这篇论文针对阿尔茨海默病筛查中全量采集 MRI/PET 成本高、可及性差的问题,提出 ProMUSE:先用低成本临床数据做证据分类,并以 Dirichlet 主观逻辑估计不确定性;仅在不确定时逐步引入 MRI/PET,再用 Dempster–Shafer 融合多模态信念。ADNI、AIBL、OASIS 上的 CN–AD、CN–MCI、MCI–AD 实验显示,其准确率接近或优于全模态基线,同时减少约 50–90% 的影像使用。

Human Universal Grasping Figure 1
2026-06-19cs.RO

Human Universal Grasping

Kevin Yuanbo Wu, Tianxing Zhou, Isaac Tu, Billy Yan, Irmak Guzey, David Fouhey, Dandan Shan, Lerrel Pinto

New York University, Tsinghua University, University of Michigan

2026-06-19视觉感知

面向多指机器人抓取泛化受限于仿真数据和遥操作成本的问题,HUG 的核心洞察是直接学习人类日常抓取分布:用智能眼镜采集 1M 帧自我中心 RGB-D 与 MANO 手姿态,训练流匹配模型生成可重定向的人手抓取。在 HUG-Bench 真实 30 物体测试中,桌面成功率 66.7%,较基线提升 23 和 34 个百分点,并能零样本迁移到不同相机、手型和家庭环境。

2026-06-18

100 篇
Native Active Perception as Reasoning for Omni-Modal Understanding Figure 1
2026-06-18cs.CV

Native Active Perception as Reasoning for Omni-Modal Understanding

Zhenghao Xing, Ruiyang Xu, Yuxuan Wang, Jinzheng He, Ziyang Ma, Qize Yang, Yunfei Chu, Jin Xu, Junyang Lin, Chi-Wing Fu, Pheng-Ann Heng

2026-06-18视觉感知

长视频/全模态理解中,被动“全看一遍”使计算随时长增长,交互式方法也常依赖全局预扫描。OmniAgent 将感知建模为 POMDP 下的观察-思考-行动循环,按查询主动读取帧、音频和片段并压缩为文本记忆,再用 Agentic SFT 与带 TAURA 的 RL 训练。实验在十个基准达到开源 SOTA,7B 模型在 LVBench 超过 Qwen2.5-VL-72B,并呈现推理轮数增加带来性能提升。

Beyond the Current Observation: Evaluating Multimodal Large Language Models in Controllable Non-Markov Games Figure 1
2026-06-18cs.CV

Beyond the Current Observation: Evaluating Multimodal Large Language Models in Controllable Non-Markov Games

Shengyuan Ding, Xilin Wei, Xinyu Fang, Haodong Duan, Dahua Lin, Jiaqi Wang, Yuhang Zang

Fudan University, Shanghai Innovation Institute, Shanghai Artificial Intelligence Laboratory, Zhejiang University, The Chinese University of Hong Kong

2026-06-18视觉语言规划控制

论文针对多模态模型在闭环控制中必须依据“已不可见”的历史观察行动的问题,提出 RNG-Bench,用配对卡牌和 3D 迷宫隔离非马尔可夫状态重建能力,并用可控难度、对战协议和 Memory Gap 区分遗忘与决策错误。结果显示前沿 MLLM 在最长约 128K token、350 图像情境下仍远未饱和,主要误差来自遗忘;基于最优轨迹和筛选示范微调 Qwen3.5-9B 可提升并具一定迁移。

Do as I Do: Dexterous Manipulation Data from Everyday Human Videos Figure 1
2026-06-18cs.RO

Do as I Do: Dexterous Manipulation Data from Everyday Human Videos

Bhawna Paliwal, Haritheja Etukuru, William Liang, Pieter Abbeel, Nur Muhammad Mahi Shafiullah, Jitendra Malik

2026-06-18机器人视觉感知

这篇论文瞄准灵巧操作数据获取成本高、远程操作和仿真探索难以规模化的问题,提出 Do as I Do:从日常单目 RGB 人类视频重建手—物体 4D 交互,并通过带物理仿真的采样优化重定向到多指机器人手臂。其关键在于放宽对视角、物体类别和数据来源的限制,支持互联网、第一/第三人称甚至生成视频。实验显示其手物重建和轨迹提取优于已有方法,且生成数据可在真实灵巧手上回放,但仍依赖刚体物体、单目深度和近似物理模型。

Reference-Driven Multi-Speaker Audio Scene Generation from In-the-Wild Priors Figure 1
2026-06-18cs.SD

Reference-Driven Multi-Speaker Audio Scene Generation from In-the-Wild Priors

Michael Finkelson, Daniel Segal, Eitan Richardson, Shahar Armon, Nani Goldring, Poriya Panet, Nir Zabari, Benjamin Brazowski, Or Patashnik, Yoav HaCohen

Tel Aviv University

2026-06-18视觉感知

针对现有多说话人语音系统依赖轮次标签、说话人嵌入且缺少真实环境声的问题,论文提出 ScenA:将多段参考声直接拼入流匹配文本到音频基础模型,并用自由文本完成说话人绑定。关键洞察是发现“参考捷径”,即训练时模型会靠带噪目标与参考声相似性绕过文本,作者用偏高噪声的时间步分布迫使模型学习文本绑定。在 CoVoMix2-Dialogue 上,ScenA 在说话人绑定指标上达到或超过现有方法,并能生成重叠说话、笑声等副语言事件和环境声。

NeuMesh++: Towards Versatile and Efficient Volumetric Editing with Disentangled Neural Mesh-based Implicit Field Figure 1
2026-06-18cs.CV

NeuMesh++: Towards Versatile and Efficient Volumetric Editing with Disentangled Neural Mesh-based Implicit Field

Chong Bao, Yuan Li, Bangbang Yang, Yujun Shen, Hujun Bao, Zhaopeng Cui, Yinda Zhang, Guofeng Zhang

2026-06-18视觉感知

针对 NeRF/神经隐式场难以像传统网格那样进行精细非刚性变形、局部纹理修改和语义选择的问题,NeuMesh++ 将辐射场绑定到网格顶点,并解耦几何、纹理与语义代码,配合局部空间参数化、顶点可学习修改颜色和空间感知优化,实现网格驱动变形、纹理交换/填充/绘制及单击式语义编辑。真实与合成数据实验显示其在渲染质量、训练稳定性和可编辑性上优于对比方法,但复杂光照、流体和缺失网格结构仍受限。

Confidence is Not Reliability: Rethinking MC Dropout in Brain Tumour Segmentation Figure 1
2026-06-18cs.CV

Confidence is Not Reliability: Rethinking MC Dropout in Brain Tumour Segmentation

Xin Ci Wong, Duygu Sarikaya, Kieran Zucker, Marc De Kamps, Nishant Ravikumar

2026-06-18视觉感知

论文关注脑肿瘤分割中模型在关键亚区“静默失败”的临床风险,质疑常用 MC Dropout 置信度能否等同可靠性。作者比较 SegResNet 与 UNet-Res,指出高不确定性-错误排序 AUROC 约 0.97 仍可掩盖增强肿瘤区严重失准;UNet-Res 在 ET 上熵近零、ECE 达 0.915、Dice 仅 0.714。结果表明应按肿瘤亚区报告校准,并可用熵做患者级复核分流。

A Unified Framework for Efficient Remote Sensing Visual Question Answering: Adapting Dual, Hybrid, and Encoder-Decoder Architectures Figure 1
2026-06-18cs.CV

A Unified Framework for Efficient Remote Sensing Visual Question Answering: Adapting Dual, Hybrid, and Encoder-Decoder Architectures

Timothy Agboada, Shikha Chandel, Yadav Raj Ghimire, Leila Hashemi-Beni

2026-06-18视觉感知

面向灾害评估、城市监测等场景中遥感影像高分辨率、目标小且标注稀缺导致通用VLM难以低成本迁移的问题,论文将RSAdapter扩展到RS-VQA,在冻结的CLIP、BLIP、FLAVA注意力与MLP层中注入轻量瓶颈适配器,训练参数低于5%。在RSVQAx上三类模型均可收敛,其中混合架构FLAVA在多模态推理与检索之间表现最佳,但具体相对增益幅度文中未充分说明。

A Multi-Domain Benchmark for Detecting AI-Generated Text-Rich Images from GPT-Image-2 Figure 1
2026-06-18cs.CV

A Multi-Domain Benchmark for Detecting AI-Generated Text-Rich Images from GPT-Image-2

Yijin Wang, Shuyi Wang, Wenhan Zhang, Yuqi Ouyang

College of Computer Science, Sichuan University

2026-06-18视觉感知数据集/基准

针对 GPT-Image-2 已能生成带可读文字和复杂版式的票据、表格、海报、UI 等图像,现有偏物体图像的检测基准难以评估其真实性风险。论文构建 8602 张、六类文本密集图像的多域基准,并用隐私保护的提示合成流程控制生成。零样本评测显示,现有检测器强烈依赖类别,JPEG 压缩下鲁棒性明显下降;多模态模型有提升但在结构化格式上仍不可靠。

CABLE: Cloud-Assisted Bandwidth-efficient LMM-based Encoding for V2X Systems Figure 1
2026-06-18cs.CV

CABLE: Cloud-Assisted Bandwidth-efficient LMM-based Encoding for V2X Systems

Haohua Que, Zhipeng Bao, Qianyi Wu, Handong Yao

All authors are with the College of Engineering, University of Georgia, Athens, GA 30602, USA.

2026-06-18视觉感知

CABLE面向V2X中云端LMM感知的带宽与预填充延迟瓶颈,利用交通场景目标区域的时空稀疏性,在边缘端用上一帧云端分割掩码结合自车运动补偿、残差运动与走廊包络生成ROI,只上传遮罩图像并将云端结果反馈到下一帧。五个自动驾驶数据集上,其ROI像素覆盖减少73%–87%,估计LMM预填充加速5–8倍,但相对全帧推理存在一定检测质量折衷。

OneCanvas: 3D Scene Understanding via Panoramic Reprojection Figure 1
2026-06-18cs.CV

OneCanvas: 3D Scene Understanding via Panoramic Reprojection

Bartłomiej Baranowski, Dave Zhenyu Chen, Matthias Nießner

Technical University of Munich

2026-06-18三维

面向机器人/具身场景中需要从特定视角判断距离、方向和可见性的3D理解问题,OneCanvas避免为VLM另接复杂几何编码器,而是把多视角RGB-D patch按深度和位姿反投影到统一全景画布,并补充度量3D位置嵌入,使预训练VLM像读单图一样进行空间推理;再配合可控的合成空间预训练课程,在SQA3D、VSI-Bench和零样本SPBench上达到领先结果,且训练算力低于强基线约一个数量级。

Transformer Geometry Observatory TGO-I: Spectral Geometry Observatory Figure 1
2026-06-18cs.CV

Transformer Geometry Observatory TGO-I: Spectral Geometry Observatory

Kaustubh Kapil, Kishor P. Upla

2026-06-18视觉感知

针对 ViT 训练过程中表征维度与几何演化缺乏系统观测的问题,本文提出 Transformer Geometry Observatory 的首个谱几何观测器 TGO-I,通过协方差谱、有效秩、参与率、谱熵和各向异性等指标跟踪各层与 CLS token。实验显示,训练并未把信息压缩到少数主方向,而是使方差更均匀分布、维度利用率上升、各向异性下降,最终 CLS 表征最明显;但因框架偏观察性,具体因果机制文中未充分说明。

Seeing Through Occlusion: Deterministic Arm Kinematic Correction for Robot Teleoperation Figure 1
2026-06-18cs.RO

Seeing Through Occlusion: Deterministic Arm Kinematic Correction for Robot Teleoperation

Thomas M. Kwok, Nicholas Koenig, Yue Hu

2026-06-18机器人

面向远程护理等机器人遥操作场景,单 RGB-D 无标记动捕虽低成本、少侵入,但上肢自遮挡会使肘肩等关节深度失真并破坏臂长一致性。论文提出 AKC 后处理,用固定上/前臂长度和勾股几何从腕部位置确定被遮挡关节深度,无需概率模型或调参。与 Vicon 对比及仿真、实体机器人遥操作实验显示,其在静态和动态动作中降低误差、保持解剖一致性,并在长时间严重自遮挡下提升稳定性。

No Figure
2026-06-18cs.CV

GUMP-Net: An interpretable model-data-driven intelligent algorithm for multi-class pelvic segmentation

Liheng Wang, Yinghui Zhang, Licheng Zhang, Hailin Xu, Qiyong Cao, Chong Chen

State Key Laboratory of Mathematical Sciences, Academy of Mathematics and Systems Science, Chinese Academy of Sciences, Beijing 100190, China, University of Chinese Academy of Sciences, Beijing 100190, China., State Key Laboratory of Mathematical Sciences, Academy of Mathematics and Systems Science, Chinese Academy of Sciences, Beijing 100190, China., Department of Orthopedics, The Fourth Medical Center of Chinese PLA General Hospital, Beijing 100048, China, National Clinical Research Center for Orthopedics, Sports Medicine and Rehabilitation, Beijing 100048, China., Department of Trauma and Orthopedics, People’s Hospital Peking University, Beijing 100044, China., Department of Orthopedics and Traumatology, Beijing Jishuitan Hospital, Capital Medical University, Beijing 100035, China

2026-06-18视觉感知

面向骨盆骨折诊疗、术前规划和导航中对精确且可解释多类别骨盆分割的需求,GUMP-Net 将改进测地活动轮廓与深度网络做算法展开:用检测模块初始化水平集、边缘模块学习解剖感知边缘函数、迭代模块执行可训练的水平集演化。实验显示其在骨盆数据上较现有方法更准确、鲁棒,尤其小样本下更稳定,并在踝关节数据上展示一定泛化潜力。

ROSA-TFormer: A Radar-Optical Sensor-Aware Temporal Transformer for Pinus sylvestris Plantation Classification in Northern Shaanxi Using GEE-Derived Sentinel-1/2 Time Series Figure 1
2026-06-18cs.CV

ROSA-TFormer: A Radar-Optical Sensor-Aware Temporal Transformer for Pinus sylvestris Plantation Classification in Northern Shaanxi Using GEE-Derived Sentinel-1/2 Time Series

Nengbo Zhang, Chang sheng

2026-06-18视觉感知

针对陕北半干旱防护林中樟子松与裸地、建设用地和其他植被混杂、单靠光学影像易受云和物候混淆的问题,论文将GEE合成的Sentinel-1/2年时间序列建模为雷达-光学分类任务,提出分离SAR/光学嵌入、传感器门控与时间注意力池化的ROSA-TFormer。在半月数据上点级验证达99.67% OA、99.56%宏F1,空间划分仍有99.34% OA,但未超过最强1D-CNN,且仍需面状制图验证。

Moebius: 0.2B Lightweight Image Inpainting Framework with 10B-Level Performance Figure 1
2026-06-18cs.CV

Moebius: 0.2B Lightweight Image Inpainting Framework with 10B-Level Performance

Kangsheng Duan, Ziyang Xu, Wenyu Liu, Xiaohu Ruan, Xiaoxin Chen, Xinggang Wang

2026-06-18视觉感知

针对10B级图像修复基础模型计算与显存成本过高、难以部署的问题,Moebius将扩散U-Net重构为0.22B轻量专家模型,核心是用Local-λ与Interactive-λ组成的LλMI块,以固定大小线性矩阵压缩局部空间上下文和全局语义先验,并结合仅在潜空间进行的自适应多粒度蒸馏缓解表示瓶颈。实验显示其在自然场景和人像修复上接近或超过FLUX.1-Fill-Dev,参数少于2%,总推理加速超过15倍。

When AUC Misleads: Polarization-Aware Evaluation of Deepfake Detectors under Domain Shift Figure 1
2026-06-18cs.CV

When AUC Misleads: Polarization-Aware Evaluation of Deepfake Detectors under Domain Shift

Dat Nguyen, Cosmin Radoi, Romain Hermary, Marcella Astrid, Nesryne Mejri, Enjie Ghorbel, Djamila Aouada

2026-06-18数据集/基准

论文指出深伪检测常用的逐数据集平均 AUC 会在域偏移下高估泛化,因为真实部署面对混合来源与不同伪造痕迹。作者提出 Cross-AUC,将各域 AUC 与基于正负类分数分布 Wasserstein 距离的预测极化程度结合,以解释性能下降。七个基准上的实验显示,平均 AUC 相比合并测试 AUC普遍偏高,Cross-AUC更接近合并 AUC,并揭示 LAA-Net、ForensicsAdapter在跨域场景下更稳健。

The Reward Was in Your Data All Along: Correcting Flow Matching with Discriminator-Guided RL Figure 1
2026-06-18cs.LG

The Reward Was in Your Data All Along: Correcting Flow Matching with Discriminator-Guided RL

Nicolas Beltran-Velez, Felix Friedrich, Zhang Xiaofeng, Reyhane Askari-Hemmat, Xiaochuang Han, Adriana Romero-Soriano, Michal Drozdzal

FAIR at Meta, 2Columbia University, 3Mila – Québec AI Institute, 4McGill University, 5Université

2026-06-18生成模型强化学习

论文关注流/分数匹配模型为何仍需RL恢复数据中已有的真实感与结构一致性,指出训练时边际上的L2场回归与推理样本质量存在结构错配。其核心是DRL:在自监督表征空间训练判别器区分真实数据与基模型样本,用logit近似密度比作为KL正则RL奖励,避免人工偏好。实验在SiT、JiT、REPA、RAE上显著降低无引导FID与语义FD,并改善后续偏好RL的保真度—奖励前沿。

Hand-4DGS: Feed-Forward 3D Gaussian Splatting for 4D Hand Reconstruction from Egocentric Videos Figure 1
2026-06-18cs.CV

Hand-4DGS: Feed-Forward 3D Gaussian Splatting for 4D Hand Reconstruction from Egocentric Videos

Jeongmin Bae, Seoha Kim, Marc Pollefeys, Mahdi Rad, Youngjung Uh, Taein Kwon

2026-06-18视觉感知三维

面向 AR/VR、AI 眼镜与机器人遥操作中自我视角手部快速运动、遮挡和单目深度歧义问题,Hand-4DGS 用前馈网络直接从视频预测网格引导的 3D Gaussian,并加入顶点锚定位置编码与时间卷积来约束结构和动态,无需推理时手姿态估计器或逐视频优化。在 H2O、ARCTIC 上相较改造的 HUGS、EVA 提升 4D 手重建与手姿态精度,并达到约 60 FPS。

The Market in the Model: Latent Diffusion as Neural Economy Figure 1
2026-06-18cs.CY

The Market in the Model: Latent Diffusion as Neural Economy

Eryk Salvaggio

Cambridge Digital Humanities, University of Cambridge, Machine Visual Culture Research Group, Max Planck Institute

2026-06-18生成模型

本文动机是补足仅从数据集或版权讨论生成图像模型的不足,转而拆解潜在扩散模型内部组件的历史任务与自动化决策。核心洞察是将 LDM 解释为“神经经济”:把社会交流压缩为可交换向量,并服务于平台与注意力经济。主要结果是一套组件级批判框架,指出生成图像的价值逻辑来自模型管线对社会交换的抽象与商品化,而非单纯数据偏差。

Urdu Katib Handwritten Dataset: A Historical Document Dataset for Offline Urdu Handwritten Text Recognition with CRNN-Based Baseline Evaluation Figure 1
2026-06-18cs.CV

Urdu Katib Handwritten Dataset: A Historical Document Dataset for Offline Urdu Handwritten Text Recognition with CRNN-Based Baseline Evaluation

Ramza Basharat, Muhammad Usman Ali

Department of Computer Science, University of Gujrat, Department of Computer Science, University of Gujrat Gujrat Punjab Pakistan

2026-06-18视觉感知数据集/基准

针对乌尔都语连写、Nastalique 斜基线与历史 Katib 手稿缺少标准数据的问题,论文构建 UKHD:面向离线手写文本行识别的真实历史文档数据集,覆盖平头笔书写变化,并以多种 CRNN 混合模型建立基线。实验显示 CNN-BGRU-CTC 在字符错误率和词错误率上最稳健,但具体数据规模与相对增益在给定文本中未充分说明。

Seeing Before Reasoning: Decoupling Perception and Reasoning for Shortcut-Resilient Multimodal On-Policy Self-Distillation Figure 1
2026-06-18cs.LG

Seeing Before Reasoning: Decoupling Perception and Reasoning for Shortcut-Resilient Multimodal On-Policy Self-Distillation

Sihan Wang, Xiyao Liu, Lianqing Liu, Zhi Han

State Key Laboratory of Robotics and Intelligent Systems, Shenyang Institute of Automation, Chinese Academy of Sciences, University of Chinese Academy of Sciences

2026-06-18视觉语言强化学习

论文关注将 on-policy 自蒸馏直接用于多模态模型时的“答案泄漏”捷径:教师因看到参考答案,可能先塑造推理而非促使模型看图。ViGOS 将轨迹拆成视觉描述与推理回答,前者由仅看图的感知教师监督,后者再由带答案的推理教师监督。实验覆盖通用视觉语言、视觉数学、空间定位和语言先验压力测试,显示其保留 OPSD 的常规收益,并在需依赖图像的场景提升稳健性。

ProductConsistency: Improving Product Identity Preservation in Instruction-Based Image Editing via SFT and RL Figure 1
2026-06-18cs.CV

ProductConsistency: Improving Product Identity Preservation in Instruction-Based Image Editing via SFT and RL

Mukund Khanna, Raj Singh Yadav, Kunal Singh

2026-06-18视觉感知强化学习

本文针对商品图像指令编辑中常见的品牌、几何和包装文字被篡改问题,构建了带可验证文本的 ProductConsistency 合成数据、SFT/RL 训练集与基准,并用基于编辑后图像 caption 相似度的循环一致性奖励约束商品身份。微调 Qwen-Image-Edit-2511 和 Flux 后,OCR、感知指标及 MLLM 评测均提升,其中 Qwen 字符错误率约降至原来的五分之一;增益可能主要来自数据与奖励共同作用。

AMALIA-VL: A Native European Portuguese Open-Source Vision and Language Model Figure 1
2026-06-18cs.CV

AMALIA-VL: A Native European Portuguese Open-Source Vision and Language Model

Diogo Glória-Silva, João Cardeira, Manuel Letras da Luz, Afonso Simplício, Gonçalo Vinagre, Diogo Tavares, Rafael Ferreira, Inês Calvo, Inês Vieira, David Semedo, João Magalhães

2026-06-18视觉感知

针对欧葡在开源多模态模型中常被巴葡混同且缺少评测资源的问题,AMALIA-VL以LLaVA-NeXT式高分辨率视觉编码、动态切图和欧葡优化LLM为骨架,配合视觉语言对齐、指令微调、偏好优化三阶段训练,并构建欧葡中心数据与翻译基准。实验显示其在全开放pt-PT LVLM中形成有竞争力基线,OCR、字幕和空间定位较强,但复杂视觉推理仍弱,部分增益可能主要来自定制数据。

DVANet: Degradation-aware Visual-prior Alignment Network for Image Restoration Figure 1
2026-06-18cs.CV

DVANet: Degradation-aware Visual-prior Alignment Network for Image Restoration

Yanjie Tu, Qingsen Yan, Axi Niu, Tao Hu, Haokui Zhang, Jiantao Zhou

2026-06-18视觉感知

针对统一图像复原在多种退化、复合退化和局部结构缺失下难以兼顾可解释性与泛化的问题,DVANet将HQS深度展开为双分支过程:一支学习全局/局部退化表示以约束观测一致性,另一支引入冻结DINOv3层级视觉先验补足结构细节。实验显示其在单一退化、夜间复杂退化、复合退化及跨域任务上达到优于或相当的结果,但视觉先验带来的额外计算开销仍是限制。

PorTEXTO: A European Portuguese Benchmark for Visual Text Extraction Figure 1
2026-06-18cs.CV

PorTEXTO: A European Portuguese Benchmark for Visual Text Extraction

João Cardeira, Diogo Glória-Silva, Manuel Letras da Luz, Rafael Ferreira, Diogo Tavares, David Semedo, João Magalhães

2026-06-18数据集/基准

针对欧洲葡萄牙语在现代 OCR 基准中长期缺位、既有数据多偏历史文献的问题,PorTEXTO 构建了面向当代场景的图像文字抽取基准,覆盖手写笔记、真实照片/截图/票据表单和合成文本,并以 LVLM 预标注加本地母语者全面复核保证标注质量。实验显示,多数模型从合成样本到真实与手写样本性能显著下降,模型规模和分辨率预算并非主要瓶颈,表现更可能主要来自专门的多语种/pt-PT OCR 数据。

No Figure
2026-06-18cs.CV

Taming I2V models for Image HOI Editing: A Cognitive Benchmark and Agentic Self-Correcting Framework

Jiayi Gao, Qingchao Chen, Yuxin Peng, Yang Liu

2026-06-18视觉感知数据集/基准

针对现有图像编辑擅长静态属性、难以保持既有人物与物体并生成合理交互的问题,论文提出 HOI-Edit 三层认知基准与基于成对区域的 HOI-Eval,用 VLM 评估交互、空间和因果物理合理性;同时利用 I2V 生成过程可诊断失败的洞察,设计 SCPE 通过视频分析—评论器—Playbook 迭代改写提示。实验显示其在开源模型中总体领先,交互指标可与 Nano Banana 竞争甚至更优。

Sensor Configuration Matters: A Systematic Evaluation of Multimodal SLAM on Quadruped Robots Figure 1
2026-06-18cs.RO

Sensor Configuration Matters: A Systematic Evaluation of Multimodal SLAM on Quadruped Robots

Roberto Corlito, Fabian Schmidt, Nils Seibert, Markus Enzweiler, Abhinav Valada, Arne Roennau

Machine Intelligence and Robotics Lab, Karlsruhe Institute of Technology (KIT), Germany., Institute for Intelligent Systems, Esslingen University of Applied Sciences, Germany. 3 Department of Computer Science, University of Freiburg, Germany.

2026-06-18机器人视觉语言数据集/基准

针对四足机器人步态冲击、振动和快速转动会破坏常规 SLAM 假设的问题,论文利用 ANYmal D 的 GrandTour 数据集系统改变相机模态、快门类型和 IMU 档次,评估视觉、视觉惯性与激光-视觉惯性 SLAM。主要发现是硬件配置显著影响鲁棒性:双目优于单目和 RGB-D,全局快门明显减少运动导致的跟踪失败,而在剧烈腿式运动下,标准惯性融合反而可能削弱 ORB-SLAM3、RTAB-Map 等以视觉为主方法的表现。

DREAM: Extending Vision-Language Models with Dual-Objective Encoding for Cross-Modal Retrieval Figure 1
2026-06-18cs.CV

DREAM: Extending Vision-Language Models with Dual-Objective Encoding for Cross-Modal Retrieval

Kaleem Ullah, Altaf Hussain, Muhammad Munsif, Sung Wook Baik

2026-06-18视觉语言视觉感知

针对文本检索视频时难以同时建模细粒度时序变化与复杂语言结构的问题,DREAM在CLIP式视觉语言框架上加入双目标文本编码,将MLM与PLM结合以覆盖局部依赖和全局句法;视觉端采用层次化编码器与级联分组注意力逐步融合空时信息。在MSR-VTT、MSVD和LSMDC上R@1分别达到49.4%、49.7%和27.3%,报告为新SOTA。

Benchmarking Large Vision-Language Models on Fine-Grained Image Tasks: From Evaluation to Diagnosis Figure 1
2026-06-18cs.CV

Benchmarking Large Vision-Language Models on Fine-Grained Image Tasks: From Evaluation to Diagnosis

Hong-Tao Yu, Chen-Wei Xie, Yuxin Peng, Serge Belongie, Xiu-Shen Wei

Yuxin Peng is with the Wangxuan Institute of Computer Technology, National

2026-06-18视觉语言视觉感知数据集/基准

针对现有 LVLM 基准难以刻画细粒度图像理解边界的问题,本文提出 FG-BMK,覆盖 28 万图像与 101 万问题,并同时从对话语义识别和特征级判别性诊断模型失效来源。实验显示,当前 LVLM 仍不是可靠的细粒度识别器,瓶颈交织于视觉表征、视觉-语义 grounding、模态对齐和类别知识;对比式训练、合适粒度的图文对齐与数据设计更有助于提升细粒度能力。

Low-Rank Tensor Completion Based on Fractional Regularization with Ky Fan p-k Norm Figure 1
2026-06-18cs.CV

Low-Rank Tensor Completion Based on Fractional Regularization with Ky Fan p-k Norm

Shan Fan, Feng Zhang, Jianjun Wang, Xi-Le Zhao, Tingwen Huang

in part by the Graduate Research and Innovation Project of Southwest University under Grant SWUS26072, with the School of Mathematics and Statistics, Southwest University, Chongqing 400715, China (e-mail:, Xi-Le Zhao is with the School of Mathematical Sciences/Research Center for Image and Vision Computing, Tingwen Huang is with the Faculty of Computer Science and Control Engineering, Shenzhen University of Advanced Technology, Shenzhen 518055

2026-06-18视觉感知

针对图像、MRI 等高维数据在采集传输中缺失时,传统张量核范数会均等惩罚奇异值、导致低秩估计偏差的问题,论文提出以张量核范数与 Ky Fan p-k 范数之比构造尺度不变的非凸分式正则,更灵活逼近 tubal rank;并给出 NSP 下局部最优性、近端算子和带收敛保证的 ADMM。合成与真实数据实验显示其补全效果优于多种现有低秩张量补全方法。

FlowObject: Flow Steering for Bridging Generative Priors and Reconstruction Fidelity Figure 1
2026-06-18cs.CV

FlowObject: Flow Steering for Bridging Generative Priors and Reconstruction Fidelity

Yuchen Rao, Xuqian Ren, Yinyu Nie, Sayan Deb Sarkar, Biao Zhang, Vincent Lepetit, Friedrich Fraundorfer

2026-06-18生成模型三维

FlowObject针对少量随手拍RGB-D图像难以同时获得完整几何与观测一致性的对象重建问题,将稀疏视角重建表述为无需训练的引导式逆问题,通过潜空间对齐与观测空间一致性双重引导来操控Flow-Matching ODE轨迹,并接入3DGS细化外观。实验显示其在合成与真实数据上相较生成式和优化式基线,同时提升遮挡区域补全、实例几何一致性和视角相关外观保真度。

Show, Don't Ask: Generative Visual Disambiguation for Composed Image Retrieval with Turn-Valid Coverage Figure 1
2026-06-18cs.CV

Show, Don't Ask: Generative Visual Disambiguation for Composed Image Retrieval with Turn-Valid Coverage

Amsisan Tran, Baogh Le, Tuan Kiet Pham, Sui Yang Guang

2026-06-18视觉感知生成模型三维

论文针对组合图像检索中“文本+参考图”常对应一片候选区域而非唯一目标的问题,指出既有交互式 conformal 方法在多轮追问后覆盖率失效,且文本澄清难表达细粒度外观/视角差异。CLARA 改为生成候选模式的视觉原型面板供用户选择,并用选择诱导似然比重加权校准以保证逐轮覆盖。实验显示其单轮性能接近 SOTA,多轮维持标称覆盖率,并比最强文本追问策略更快命中目标。

Visual-OPSD: Cross-Modal On-Policy Self-Distillation for Efficient Unified Multimodal Reasoning Figure 1
2026-06-18cs.CV

Visual-OPSD: Cross-Modal On-Policy Self-Distillation for Efficient Unified Multimodal Reasoning

Pengyu Li, Zhitao Gao, Lingling Zhang, Muye Huang, Yuanming Li, Fangzhi Xu, Jun Liu

2026-06-18视觉语言强化学习

这篇论文针对统一多模态模型在视觉链式思考中生成“视觉想法”需多步扩散、推理代价高的问题,发现渲染出的中间图像本身贡献有限,但生成路径会改变后续文本分布。作者提出 Visual-OPSD,用同权重、不同上下文的教师/学生做在线 JSD 自蒸馏,把含 VT 的推理信号迁移到纯文本推理。九个基准上平均比生成式教师高 3.40 个百分点,并将单样本延迟从 142.8s 降到 10.0s。

A Controlled Benchmark of Quantum-Latent GAN Augmentation for Brain MRI Figure 1
2026-06-18cs.LG

A Controlled Benchmark of Quantum-Latent GAN Augmentation for Brain MRI

Syed Mujtaba Haider, Silvia Figini

2026-06-18生成模型规划控制数据集/基准

针对医学影像小样本场景中量子 GAN 增广常被单次实验和不匹配容量夸大效果的问题,本文构建参数近似匹配的量子/经典潜空间 WGAN-GP 基准,并在 5%–100%标注比例、8 个随机种子下检验脑 MRI 分类。结果显示两类增广均未显著优于仅用真实数据,量子与经典生成器统计上无差异;低数据下的微弱收益更像正则化,且样本明显离分布并模式坍塌。

Mem-World: Memory-Augmented Action-Conditioned World Models for Persistent Robot Manipulation Figure 1
2026-06-18cs.CV

Mem-World: Memory-Augmented Action-Conditioned World Models for Persistent Robot Manipulation

Zirui Zheng, Jiaqian Yu, Xiongfeng Peng, jun shi, Mingyi Li, Chao Zhang, Weiming Li, Dong Wang, Huchuan Lu, Xu Jia

2026-06-18机器人强化学习

针对机器人操作中腕部相机快速运动、遮挡导致动作条件世界模型在长时序 rollout 中遗忘或幻觉历史物体的问题,Mem-World 引入以腕视角为中心的 4D surfel 索引记忆 W-VMem,将历史观测锚定到动态表面元素,并按未来动作几何检索相关帧作为条件。实验显示其提升时序一致性,策略评估与真实表现的 Pearson 相关性较 Ctrl-World 提高 14.5%,合成数据使长程任务成功率从 58% 升至 72%。

Motion-Focused Latent Action Enables Cross-Embodiment VLA Training from Human EgoVideos Figure 1
2026-06-18cs.CV

Motion-Focused Latent Action Enables Cross-Embodiment VLA Training from Human EgoVideos

Runze Xu, Yiluo Zhang, Jian Wang, Yu Wang, Jincheng Yu

2026-06-18视觉感知

这篇论文针对通用 VLA 训练过度依赖大规模带动作标注机器人数据的问题,尝试从无标注第一视角人类操作视频中提取可迁移动作先验。核心做法是用物理 mask 引导的混合解耦 VQ-VAE 将运动动态与背景变化分离,构建跨本体离散动作码本,并在适配阶段解耦意图预测与状态感知以减少动作幻觉。实验显示,仅用人类视频预训练后约 50 条机器人轨迹即可适配,在仿真和真实场景中接近大量标注数据训练的 VLA。

No Figure
2026-06-18cs.CV

SP-TransientBench: A Real-Captured Single Photon Perception Benchmark

Hongzhou Dong, Zili Zhang, Ziting Wen, Yiheng Qiang, Runrong Deng, Wenle Dong, Ziwen Jiang, Xinyang Li, Rui Lu, Shuoyao Sun, Wenyu Wang, Ziyi Xia, Haitao Zheng, Guodong Shi, Xiaoqiang Ren

2026-06-18数据集/基准

该文针对单光子 LiDAR 研究长期依赖仿真或小规模受控采集、难以评估真实噪声与多回波瞬态的问题,提出 SP-TransientBench。其核心是发布真实采集的多任务基准,含 10 个场景、约 1.03 万视角、完整 ToF 直方图、标定多视角位姿及部分 13 类 3D 语义标注,并给出深度估计、多视图重建和语义分割的统一划分与评测协议;主要结果是补齐真实 SPL 感知评测资源,但算法性能增益并非本文重点。

Physics-IQ Verified Figure 1
2026-06-18cs.CV

Physics-IQ Verified

Tim Rädsch, Yuki M Asano, Hilde Kuehne, Stefan Bauer, Priyank Jaini, Robert Geirhos, Carsten T. Lüth

Anates Labs, Technical University of Munich, University of Technology Nuremberg, Tuebingen AI Center, University of Tuebingen

2026-06-18视觉感知

面向将视频生成模型用作世界模型(含机器人任务)时“是否真正理解物理”的评测需求,本文系统审计 Physics-IQ,指出原基准受提示歧义、参考视频伪激活和数据集级聚合偏置影响。作者提出 Physics-IQ Verified:改写/模板化提示、清理非物理伪影,并引入样本级等权评分。结果显示其修改了 57.6% 样本、改进 34.8% 提示;在 6 个图生视频模型上带来有意义的排名变化(Kendall τ=0.46)。

No Figure
2026-06-18cs.CV

BindEdit: Taming Attention Leakage for Precise Multi-Object Image Editing

Chaewon Park, Soyoon Lee, Naeun Lee, Minjung Shin, Seogkyu Jeon, Kibeom Hong

Sookmyung Women’s University, Yonsei University

2026-06-18视觉感知

面向真实图像中多目标同时编辑易出现语义混合、目标缺失或源类别残留的问题,论文将根因归结为编辑 token 与区域错配、源对象注意力压制两类 attention leakage。BindEdit在单次扩散轨迹中用掩码约束交叉/自注意力、重平衡目标与源 token,并加入区域一致性约束;新多目标基准上的实验显示其在单目标和多目标编辑中均优于既有方法。

No Figure
2026-06-18cs.CV

Automatic ply-specific analyses of CFRP micrographs using shortest-path-based ply distinction

Jonas Naumann, Jonas P. Appels, Julius Biermann, Christopher Gorsky, Timo de Wolff, Christoph Brauer

Jonas Naumann, German Aerospace Center (DLR), Institute of Lightweight Systems, Composite Process Technologies, Ottenbecker Damm 12, 21682 Stade, Germany, Jonas P. Appels, German Aerospace Center (DLR), Institute of Lightweight Systems, Composite Process Technologies, Ottenbecker Damm 12, 21682 Stade, Germany, Julius Biermann, German Aerospace Center (DLR), Institute of Lightweight Systems, Composite Process Technologies, Ottenbecker Damm 12, 21682 Stade, Germany, Christopher Gorsky, German Aerospace Center (DLR), Institute of Lightweight Systems, Structural Mechanics, Lilienthalplatz 7, 38108 Braunschweig, Germany, Timo de Wolff, Technische Universität Braunschweig, Institute of Analysis and Algebra, Applied Algebra, Universitätsplatz 2, 38106 Braunschweig, Germany, Christoph Brauer, German Aerospace Center (DLR), Institute of Lightweight Systems, Composite Process Technologies, Ottenbecker Damm 12, 21682 Stade, Germany

2026-06-18视觉感知

针对CFRP高分辨率显微图中铺层级质量评估仍依赖人工、语义分割难以区分具体铺层的问题,论文将分割掩码像素建图,用最短路径寻找铺层分隔线,从而把语义分割转为铺层实例分析。方法在含间隙、波曲、不同铺层序列和贯穿裂纹的样本上可用,并支持逐铺层纤维体积分数、铺层厚度与夹层厚度的自动量化。

DINO-Med3D: Bridging Dimension and Domain Gaps in Volumetric Segmentation via Progressive Adaptation Figure 1
2026-06-18cs.CV

DINO-Med3D: Bridging Dimension and Domain Gaps in Volumetric Segmentation via Progressive Adaptation

Haoyu Hu, Xiyao Ma, Shiqi Liu, Linsen Zhang, Xiaoliang Xie, Xiaohu Zhou, Zeng-Guang Hou

2026-06-18视觉感知三维

该文针对2D自然图像预训练的DINOv3直接用于3D医学体数据分割时存在维度断裂与领域偏移的问题,提出两阶段渐进适配:先用跨切片ICE嵌入和分割代理任务对齐,再冻结骨干加入3D adapter、LoRA及细节恢复流强化层间连续性和边界纹理。五个公开数据集上优于SOTA,但第一阶段全量微调带来计算负担,细节流增益受数据纹理影响。

LARE: Low-Attention Region Encoding for Text-Image Retrieval Figure 1
2026-06-18cs.CV

LARE: Low-Attention Region Encoding for Text-Image Retrieval

Abdulmalik Alquwayfili, Faisal Almeshal, Jumanah Almajnouni, Leena Alotaibi, Faisal Alhajari, Mohammed Alkhrashi, Alreem Almuhrij, Abdullah Aldwyish, Raied Aljadaany, Huda Alamri, Muhammad Kamran J. Khan

2026-06-18视觉感知

本文针对拥挤场景图文检索中全局视觉嵌入偏向显著物体、忽略小目标和低显著区域的问题,提出无需训练的 LARE:利用视觉 Transformer 注意力图定位低关注区域,并与整图并行编码,再通过置信门控融合相似度。作者还构建强调密集场景与稀有物体的 Dense-Set;实验显示该方法在密集检索上稳定提升,同时基本保持标准基准排序行为。

Performance Gap Analysis between Latin and Arabic Scripts HTR Figure 1
2026-06-18cs.CV

Performance Gap Analysis between Latin and Arabic Scripts HTR

Sana Al-azzawi, Elisa Barney, Marcus Liwicki

Luleå University of Technology, Department of Computer Science, Electrical and Space Engineering, matters, as many datasets contain labeling errors. Cleaning reduces er-

2026-06-18视觉感知

针对阿拉伯系手写文本识别长期落后于拉丁文字但缺少受控比较的问题,本文用统一的行级 CRNN 在九个多语种数据集和不同训练规模下分析性能差距。核心洞察是差距不只来自模型或数据量,还与标注噪声、阿拉伯文字形随位置变化、点/附加符号混淆及长尾字符分布有关。结果显示低资源时差距最大,数据增多后缩小但全量仍约有 5–7 个 CER 点差;清洗标注可降低错误但不能消除差距,阿拉伯数据中约 30% 替换错误来自视觉相似字符混淆。

Test-Time Adaptation in Optical Coherence Tomography Using Trajectory-Aligned Time-Independent Flow Figure 1
2026-06-18cs.CV

Test-Time Adaptation in Optical Coherence Tomography Using Trajectory-Aligned Time-Independent Flow

Veit Hucke, Thomas Pinetz, Gregor Reiter, Ursula Schmidt-Erfurth, Hrvoje Bogunović

Institute of Artificial Intelligence, Center for Medical Data Science, Medical, University of Vienna, Austria, Comprehensive Center for Artificial Intelligence in Medicine, Medical University of, Department of Ophthalmology and Optometry, Medical University of Vienna, Laboratory for Ophthalmic Image Analysis, Medical University of Vienna, Austria, (AMD). Code is available here: https://github.com/Veit21/tta-flow., pseudo-labels via augmentations and thresholding (e.g., COTTA [25]). However

2026-06-18生成模型规划控制

低成本 OCT 设备噪声和域偏移会削弱病灶分割模型。本文提出 TTA-Flow:用流匹配重建高质量替代图像,并将测试图像直方图对齐到生成的参考轨迹,同时去掉时间条件以适应未知真实噪声。实验在两类 AMD 生物标志物、两种低成本设备的 3D/2D 分割中优于多种 TTA 和生成式基线,消融显示主要增益来自直方图对齐与无时间条件设计。

Bridging Single Distortion Artifacts and Mmultifactorial Clinical Quality: Few-shot Biparametric MRI Quality Assessment via Distortion-trained Prototypical Networks Figure 1
2026-06-18cs.CV

Bridging Single Distortion Artifacts and Mmultifactorial Clinical Quality: Few-shot Biparametric MRI Quality Assessment via Distortion-trained Prototypical Networks

Yuheng Tang, Alexander Ng, Wen Yan, Natasha Thorley, Pawel Rajwa, Yipei Wang, Aqua Asif, Clare Allen, Louise Dickinson, Francesco Giganti, Shonit Punwani, Daniel Alexander, Veeru Kasivisvanathan, Yipeng Hu

2026-06-18视觉感知

针对前列腺MRI质量评估中低质量样本少、PI-QUAL标注主观且类别失衡的问题,本文将较易获得的DWI几何畸变标签作为元训练任务,提出融合T2WI/DWI的双分支3D ResNet原型网络,并用FiLM与GRL处理不同b值带来的域偏移。模型仅需每类5个样本即可适配PI-QUAL评分,在两个数据集上优于少样本基线,但支持集选择仍是潜在敏感因素。

Learning to Distort: Weakly-Supervised Image Quality Transfer for Prostate DWI Correction Figure 1
2026-06-18cs.CV

Learning to Distort: Weakly-Supervised Image Quality Transfer for Prostate DWI Correction

YuCheng Tang, Wen Yan, Alexander Ng, Natasha Thorley, Pawel Rajwa, Yipei Wang, Aqua Asif, Clare Allen, Louise Dickinson, Francesco Giganti, David Atkinson, Shonit Punwani, Daniel Alexander, Shaheer Ullah Saeed, Veeru Kasivisvanathan, Yipeng Hu

2026-06-18视觉感知

该文针对前列腺 DWI 常见几何畸变且临床缺少成对畸变/无畸变扫描的问题,提出先“学会加畸变”再监督去畸变的弱监督 IQT 框架:用图像级质量标签训练 IQA 特征与质量原型,并以原型约束 flow matching 生成逼真伪畸变配对数据。实验显示合成畸变会显著干扰 PI-RADS 与 Gleason 分类,且由此训练的校正模型在真实 DWI 上优于 CycleGAN、UNIT-DDPM、OT-FM 等未配对方案。

URDF Synthesis from RGB-D Sequences via Differentiable Joint Inference and Energy-Consistent Verification Figure 1
2026-06-18cs.CV

URDF Synthesis from RGB-D Sequences via Differentiable Joint Inference and Energy-Consistent Verification

Xinze Zhang

aUniversity of Southern California, Los Angeles, CA 90007, USA, pipeline Articulate-Anything [20] on the per-axis metrics where comparable numbers are available. Long-horizon

2026-06-18视觉感知

这篇论文面向从 RGB-D 序列自动生成可仿真的关节物体 URDF,动机是现有方法常将部件重建与运动学估计割裂,且缺少能量一致性验证,导致仿真漂移。作者提出 KinemaForge,用软约束关节图、可微螺旋轴求解和能量残差把视觉重建与刚体动力学闭环优化。实验中关节轴误差降至 2.83°,50 秒仿真漂移较 PARIS 降低 64%,闭环操作成功率较 Ditto 提升 14.6 个百分点。

Quantification of Uncertainty with Adversarial Models in Medical Image Segmentation Figure 1
2026-06-18cs.CV

Quantification of Uncertainty with Adversarial Models in Medical Image Segmentation

Hana Jebril, Thomas Pinetz, Günter Klambauer, Hrvoje Bogunović

2026-06-18视觉感知安全鲁棒

面向医疗分割中边界和病灶区域过度自信、影响临床监测的问题,论文提出后处理框架 QUAM-SM:用定向对抗搜索寻找容易被翻转的“脆弱像素”,并分解认知与偶然不确定性。两组多专家标注公开数据实验显示,其可靠性、边界敏感性及与标注者差异的一致性优于常见不确定性估计方法,但方法依赖训练分布访问。

From Bounding Boxes to Visual Reasoning: An On-Policy Data Annotation Tool for Vision-Language Models Figure 1
2026-06-18cs.CV

From Bounding Boxes to Visual Reasoning: An On-Policy Data Annotation Tool for Vision-Language Models

Like Zhang, Runliang Niu, Shiqi Wang, Xiyu Hu, Qianli Xing, Pan Wang, Qingzu He, Qi Wang

School of Artificial Intelligence, Jilin University, College of Computer Science, Jilin University

2026-06-18视觉语言视觉感知强化学习学习理论

面向 GUI 理解、流程图解析等需要坐标、文本、属性和关系联合监督的 VLM 推理任务,论文指出传统标注工具仍停留在闭集检测范式,难以复用且与训练脱节。作者提出开源 ScreenAnnotator,以统一标注原子、在线人机共演训练循环、贝叶斯标注验证器和模板化多任务合成,把一次标注转成多类推理数据。实验中流程图标注接受率接近 100%、GUI 为 77%,单图耗时随数据积累下降;流程图 QA 微调后平均准确率达 76.1%,较基座提升 35.1 个百分点。

Rethinking Air-Ground Collaboration: A Progressive Cross-Task Benchmark and Socialized Learning Framework Figure 1
2026-06-18cs.CV

Rethinking Air-Ground Collaboration: A Progressive Cross-Task Benchmark and Socialized Learning Framework

Zhoupeng Guo, Yunqi Zhu, Zhihe Fan, Xinjie Yao, Ruipu Zhao, Boan Tao, Yiming Sun, Zhen Wang, Pengfei Zhu

2026-06-18数据集/基准

论文针对现有空地协同多停留在单任务跨视角融合、难以处理定位、关联与解析依赖且易受视角异质性负迁移影响的问题,提出AGPC渐进式跨任务基准,并设计SCP框架以粗到细串联空中全局定位、地面目标关联和身份感知解析,DLR选择性路由跨视角/跨任务信息。实验报告3.73%协同演化增益和7.86%下游平均提升,说明任务条件化交互优于统一特征共享。

Semantic Robustness Certification for Vision-Language Models Figure 1
2026-06-18cs.LG

Semantic Robustness Certification for Vision-Language Models

Peiyu Yang, Paul Montague, Feng Liu, Andrew C. Cullen, Amardeep Kaur, Christopher Leckie, Sarah M. Erfani

Code is available at https://github.com/, School of Computing & Information Systems, Univer-, dataset via similarity to the transformed embedding (φ = 1) as visual references, with labels and similarities shown.

2026-06-18视觉语言视觉感知安全鲁棒

现实应用中的 VLM 容易因形状、风格、背景等语义变化产生预测漂移,而传统鲁棒认证多停留在像素或几何扰动。本文将认证转到图文共享嵌入空间,用文本提示作为源/目标语义代理,在二维语义子空间中参数化变化强度,并利用闭式决策边界给出预测不变区间。合成与真实数据实验显示,该方法能较好刻画多类语义变化下的类别切换,且无需为每种变化额外收集训练数据。

EDoF-NeRF: extended depth-of-field neural radiance fields using a coded aperture camera Figure 1
2026-06-18cs.CV

EDoF-NeRF: extended depth-of-field neural radiance fields using a coded aperture camera

Yoshiyuki Shirasaki, Ryoichi Horisaki

2026-06-18三维

本文针对传统相机在进光量与景深之间的权衡会传递到 NeRF、导致浅景深输入难以合成清晰新视角的问题,引入位于光瞳的编码孔径,并将其 PSF/散焦成像模型嵌入 NeRF,使网络可直接利用编码图像恢复扩展景深结果。仿真与光学实验显示,EDoF-NeRF 相比 NeRF 和 DoF-NeRF 在新视角图像与深度估计的 PSNR、SSIM 上更优。

DreamReg: Belief-Driven World Model for 2D-3D Ultrasound Registration Figure 1
2026-06-18cs.CV

DreamReg: Belief-Driven World Model for 2D-3D Ultrasound Registration

Luoyao Kang, Yuelin Zhang, Jiwei Shan, Haifan Gong, Qingpeng Ding, Shing Shin Cheng

2026-06-18强化学习三维

针对术中2D超声切片与术前3D体数据配准中视野不完整、斑点噪声和探头运动耦合导致的一次性回归不稳问题,DreamReg将6DoF刚体配准建模为部分可观测下的序贯信念更新,引入动作条件世界模型和想象 rollout 来模拟候选探头运动并迭代细化位姿。在CAMUS与μ-RegPro上,其几何精度和图像相似性较现有方法更稳健,但真实组织形变场景仍未充分覆盖。

Where Will They Go? Modelling Multimodal Pedestrian Manoeuvres from Ego-centric Videos Figure 1
2026-06-18cs.CV

Where Will They Go? Modelling Multimodal Pedestrian Manoeuvres from Ego-centric Videos

Yuxuan Xie, Nicolas Pugeault, Chongfeng Wei, Hubert P. H. Shum, Edmond S. L. Ho

School of Computing Science, University of Glasgow, Glasgow, United, James Watt School of Engineering, University of Glasgow, Glasgow, Department of Computer Science, Durham University, Durham, United, the ground truth action labels, i.e. crossing or non-crossing, availability in the dataset.

2026-06-18视觉语言视觉感知

针对车载视角下行人未来轨迹一对多、单一随机分布易生成不真实“混合模式”轨迹的问题,论文提出 MMPM:用 PIM 融合行人注视、头/手势、车辆与场景交互,再以 CVAE 式 MTP 按过街/不过街分别建模轨迹分布并用查询解码保持模式一致。在 PIE 与 JAAD 上优于现有方法,MTP 还能接入 BiTrap-NP、SGNet-ED,数据驱动验证中帧级位移误差最高降低 4.73%。

Fuzzy-Geometric Branch-Point Modeling for Structure-Aware Augmentation of Handwritten Chinese Characters Figure 1
2026-06-18cs.CV

Fuzzy-Geometric Branch-Point Modeling for Structure-Aware Augmentation of Handwritten Chinese Characters

Dongbin Jiao, Yibo Lyu, Qiulu Wei, Fuxiang Lu, Shengcai Liu, Shi Yan

2026-06-18视觉感知

面向高安全手写中文识别/签名验证中样本稀缺与复杂笔画交叉易被增强破坏的问题,论文提出 FGSA:将骨架分支点建模为模糊集合,融合邻域拓扑证据与方向场散度,并用无监督代理目标自适应调参,再通过三次 Bézier 重建和扰动生成结构保持样本。在 CASIA-HWDB1.1、ChiSig 与新建 LZUSig 上,方法降低词级错误率,并在识别增益、结构保真和判别特征保留间取得较好折中。

HandwritingAgent: Language-Driven Handwriting Synthesis in Scalable Vector Space Figure 1
2026-06-18cs.CV

HandwritingAgent: Language-Driven Handwriting Synthesis in Scalable Vector Space

Jaward Sesay, Yue Yu, Börje F. Karlsson

Beijing Institute of Technology, Beijing Academy of Artificial Intelligence

2026-06-18视觉感知

现有手写合成多依赖大规模训练和栅格图像,难以按自然语言细粒度控制笔画并迁移到新字体或脚本。HandwritingAgent 将任务改写为语言模型在离散画布中基于参考样式进行几何推理和自回归 SVG 笔画生成,无需特定风格训练,输出可编辑、可解释。论文在风格模仿、识别、多语言和数学/科学表达式生成中称达到或超过现有生成模型,但具体增益来源仍需结合完整实验细节判断。

Learned Radius Estimation for UDF-Based Point Cloud Reconstruction Figure 1
2026-06-18cs.CV

Learned Radius Estimation for UDF-Based Point Cloud Reconstruction

Eito Ogawa, Hiroshi Watanabe

Graduate School of FSE, Waseda University, label. These cached target radii are used only during training

2026-06-18三维

面向消费级点云重建中采样不均、局部稀疏导致固定或曲率启发式支持半径不稳的问题,论文在冻结 LoSF-UDF 上加入轻量逐查询半径选择器,用缓存 UDF 误差曲线的抛物线插值得到连续监督半径。该插件无需重训主干,80 个训练形状即可泛化到 ScanNet;相对 GeoLA,ScanNet F1@0.005 从 0.645 提升到 0.691,CD 也从 0.795 降至 0.692。

SCR-Guided Difficulty-Aware Optimization for Infrared Small Target Detection Figure 1
2026-06-18cs.CV

SCR-Guided Difficulty-Aware Optimization for Infrared Small Target Detection

Yunus Sevim, Behçet Uğur Töreyin

Istanbul Technical University, The code is available at https://github., false alarms [22], while single-point supervision and label-

2026-06-18视觉感知优化算法

针对红外小目标常处于低对比、强杂波中,单纯 IoU/Dice 等几何重叠损失难以反映真实可见性的痛点,论文提出 REEM:训练时用标注区域计算局部 SCR,并以可微权重调制 soft-IoU,使低 SCR 难样本获得更大优化权重,同时不改网络结构、参数和推理流程。集成到 MSHNet 后,在 IRSTD-1k 等实验中提升 IoU 与检测概率,并显著降低虚警,低可见目标收益更明显。

SAMA: Semantic Anchor-aligned Augmentation for Unified Low-Resource Multimodal Information Extraction Figure 1
2026-06-18cs.CV

SAMA: Semantic Anchor-aligned Augmentation for Unified Low-Resource Multimodal Information Extraction

Quanjiang Guo, Chong Mu, Jiazhou Pan, Ming Jia, Ling Tian, Hui Gao, Zhao Kang

The source code and datasets are available at https://github.com/UESTC-GQJ/SAMA .

2026-06-18视觉语言

针对多模态信息抽取在低资源下标注稀缺、文本图像增强易语义漂移且各任务割裂的问题,SAMA将标签重编码为“语义锚”,统一约束多专家MLLM生成文本,并用保锚扩散生成图像,再以跨模态一致性和锚保真过滤样本。实验覆盖MNER、MRE、MEE,在低资源和全监督设置均优于现有增强基线。

SpectralDiT: Timestep-Conditioned Spectral Residual Correction for Flow-Matching DiTs Figure 1
2026-06-18cs.CV

SpectralDiT: Timestep-Conditioned Spectral Residual Correction for Flow-Matching DiTs

Jiayu Tian

Peking University, . We evaluate the scalability of our method on Ima­, paths between noise and data [2], and scalable interpolant, Label

2026-06-18生成模型

该文针对 flow-matching DiT 在不同时刻生成过程的频率需求不同、但残差更新对频谱一视同仁的问题,提出在 MLP 残差支路加入零初始化的时间步条件频谱校正,将 token 网格残差分解为低/高频并门控加回,初始化等同基线。实验显示其以约 0.6% FLOPs、1.36% 参数开销,在 CIFAR-10 将 FID 从 20.78 降至 19.71,并在 ImageNet-100 潜空间 CFG 下取得 8.7% 相对 FID 降低。

SMART: A Flexible, Interpretable, and Scalable Spatio-temporal Brain Atlas from High-Resolution Imaging Data Figure 1
2026-06-18cs.CV

SMART: A Flexible, Interpretable, and Scalable Spatio-temporal Brain Atlas from High-Resolution Imaging Data

John Kalkhof, Boris Gutman (IIT), Emile d'Angremont (Amsterdam UMC), Daniel C. Alexander (UCL), Marco Lorenzi

SMART: A Flexible, Interpretable, and Scalable Spatio-temporal Brain Atlas, Inria Center at University Cˆote d’Azur, Illinois Institute of Technology, Amsterdam University Medical Center, University College London, ble, interpretable, and scalable spatio-temporal brain atlas, scalable multi-scale Neural Cellular Automata. Evaluated, paradigm for flexible, interpretable, and scalable modeling, ity: flexibility, interpretability, and scalability. In practice, high dimensionality of 3D brain images raises scalability, ible, interpretable, and scalable representation of disease-

2026-06-18视觉感知

针对纵向高分辨率3D脑MRI中疾病时间线不一致、生成式预测难解释且难扩展的问题,SMART将阿尔茨海默病进展建模为连续时空脑图谱:用区域微分方程刻画群体级病程轨迹,再以多尺度NCA生成个体化微分同胚形变。其在五个MRI队列、1357名受试者上优于GAN、扩散和VoxelMorph基线,并以更少参数提升预测精度与时间一致性。

Toward Training-Free Zero-Shot Anomaly Detection in 3D Medical Images: A Batch-Based Approach Using 2D Foundation Models Figure 1
2026-06-18cs.CV

Toward Training-Free Zero-Shot Anomaly Detection in 3D Medical Images: A Batch-Based Approach Using 2D Foundation Models

Tai Le-Gia

aDepartment of Mathematics, Chungnam National University, Daejeon, Republic of Korea, annotated training data may be unavailable. Most existing zero-shot anomaly detection methods, limited by the availability and diversity of pathological, ical images using readily available 2D foundation models, unavailable in a single orientation, the token construction

2026-06-18视觉感知三维

针对三维医学影像中异常标注和正常训练集难获取、3D基础模型不足的问题,论文提出CS3F:用冻结2D ViT按三轴切片提特征,经深度池化构成体素token,并以跨受试者最近邻相似性给异常打分;再用随机投影和粗到细token化缓解计算量与小病灶信号稀释。实验覆盖脑MRI多病种和肺CT,显示其优于CLIP式零样本基线,并可接近重建式UAD,但细粒度增益受病灶对比度和模态影响。

Low-Cost Neuromorphic Fall Detection Using Synthetic Event Data and Hybrid SNNs Figure 1
2026-06-18cs.LG

Low-Cost Neuromorphic Fall Detection Using Synthetic Event Data and Hybrid SNNs

Guillermo Rojas, Gonzalo Soto, Daniel Yunge

School of Electrical Engineering, NFDD SNN, is available as a Kaggle repository [11]. The

2026-06-18视觉感知

面向养老/辅助生活中的低功耗、隐私友好跌倒检测,论文用普通手机视频经 v2e 合成 DVS 事件流,构建 NFDD 数据集,并训练 CNN+SNN 混合模型以替代昂贵事件相机。模型先在 DVS128Gesture 上达到 91.4% 准确率,再迁移到行走、坐下、跌倒三类任务;文中称效率显著提升且精度未明显牺牲,但 NFDD 的完整量化结果和增益来源未充分说明。

Clinically Aligned Geometry Constraints for Robust IVUS Vessel Boundary Segmentation Figure 1
2026-06-18cs.CV

Clinically Aligned Geometry Constraints for Robust IVUS Vessel Boundary Segmentation

Yunshu Chen, Litao Yang, Giuseppe Di Giovanni, Jordan Tan, Deval Mehta, Andrew Lin, Derek Chew, Masasi Fujino, Julie Butters, Stephen Nicholls, Zongyuan Ge, Kyung Hoon Cho

2026-06-18视觉感知优化算法学习理论安全鲁棒

针对 IVUS 管腔与外弹力膜分割中高 Dice 仍可能带来边界漂移、拓扑错误和临床几何测量偏差的问题,论文提出 GeoCat:用 5 帧时序输入、笛卡尔/极坐标双编码器交叉注意力,并在极坐标域加入可微几何一致性损失直接约束直径、角度和面积。在 146 名患者 12,242 帧上,Dice 达 0.93,95HD 降至 0.14 mm,拓扑违规率 1.0%,直径误差约 0.13–0.16 mm。

Rethinking the Pointer Loss in Table Structure Recognition: Geometry-Aware Pointer Loss for Spatial Locality Figure 1
2026-06-18cs.CV

Rethinking the Pointer Loss in Table Structure Recognition: Geometry-Aware Pointer Loss for Spatial Locality

Hong-Jun Choi, Jongho Lee, Jaeyoung Kim

Teamreboott Inc., South Korea, Our code is available at https://github.com/teamreboott/GAP

2026-06-18视觉感知

本文针对表格结构识别中指针网络常把单元格对齐到相邻格的问题,指出79.6%的指针错误发生在曼哈顿距离≤2的邻近位置,而标准交叉熵对所有负样本等权。作者提出GAP Loss,按与真值的几何距离重加权指针损失,将梯度集中到易混淆邻格,不改模型且无额外推理开销;在PubTabNet和SynthTabNet上减少相邻格错误并达到新的SOTA。

PEFT-MedSAM: Efficient Fine-Tuning of Medical Foundation Models for Explainable Skin Lesion Segmentation Figure 1
2026-06-18cs.CV

PEFT-MedSAM: Efficient Fine-Tuning of Medical Foundation Models for Explainable Skin Lesion Segmentation

Asad Channa, Abdullah Khan, Asghar Ali Chandio, Aamir Akbar, Shahzad Memon, Aqib Hussain, Ameer Hamza

Department of Computer Science, Quaid-e-Awam University of Engineering, Sciences &, Department of Artificial Intelligence, Quaid-e-Awam University of Engineering, Sciences &, Department of Computer Science, Sindh Madressatul Islam University, City Campus, Karachi, Department of Computer Science and Digital Technologies, School of Architecture, Computing and, normally be detected. However, most deep learning methods available do not perform well., The International Skin Imaging Collaboration (ISIC) challenges have set a high benchmark

2026-06-18视觉感知

针对皮肤镜病灶分割中标注成本高、从头训练模型泛化和临床可解释性不足的问题,论文提出 PEFT-MedSAM:冻结 MedSAM 的图像与提示编码器,仅微调轻量 mask decoder(约 4.3% 参数)。在 ISIC 2018 上 Dice 达 0.9411、IoU 0.8918,优于 U-Net 和零样本 MedSAM;PH2 外部验证 Dice 为 0.9467±0.0310,并用 Grad-CAM/Pointing Game 补充解释性评估。

UniTemp: Unlocking Video Generation in Any Temporal Order via Bidirectional Distillation Figure 1
2026-06-18cs.CV

UniTemp: Unlocking Video Generation in Any Temporal Order via Bidirectional Distillation

Lin Zhang, Sicheng Mo, Zefan Cai, Jinhong Lin, Zihao Lin, Jiuxiang Gu, Krishna Kumar Singh, Yuheng Li, Yin Li

2026-06-18视觉感知

现有自回归视频扩散模型多只能按时间正向生成,难以支持倒序扩展、首尾补帧等创作流程。UniTemp通过双向蒸馏训练单一学生模型,并指出反向生成的块间闪烁源于Causal 3D VAE缺失过去上下文,进而引入blockwise anchor latents补足边界上下文。实验显示其在短/长视频生成上接近正向专用方法,同时支持双向扩展、inbetween、循环、场景过渡和视觉故事生成。

Spatially Stratified Distillation for Heterogeneous Radar Place Recognition Figure 1
2026-06-18cs.CV

Spatially Stratified Distillation for Heterogeneous Radar Place Recognition

Sagun Singh Shrestha, Samuel Harding, Abdelwahed Khamis, Saimunur Rahman, Peyman Moghadam

CSIRO Robotics, Brisbane, Australia 2 University of Queensland, Brisbane, Australia

2026-06-18视觉感知

面向低成本4D车载雷达查询与高密度旋转雷达地图匹配,本文针对4D雷达稀疏、视场窄导致跨会话地点识别退化的问题,提出空间分层蒸馏:对双方共同观测区域强对齐,对仅教师可见结构施加折扣监督,避免逼迫学生“幻觉”不可观测内容。在HeRCULES上,异构AR@1从0.722提升至0.766,同构4D检索从0.905提升至0.954。

Multi-Class Brain Tumor Classification Using Advanced Deep Learning Models: A Comparative Study Figure 1
2026-06-18cs.CV

Multi-Class Brain Tumor Classification Using Advanced Deep Learning Models: A Comparative Study

Asad Channa, Asghar Ali Chandio, Akhtar Hussain Jalbani, Mehwish Leghari, Shahzad Memon

Department of Computer Science, Quaid-e-Awam University of Engineering, Sciences &, Department of Artificial Intelligence, Quaid-e-Awam University of Engineering, Sciences &, Department of Data Science, Quaid-e-Awam University of Engineering, Sciences & Technology, Department of Computer Science and Digital Technologies, School of Architecture, Computing and, [15]), are then fine-tuned to better classify medical images on smaller, labeled datasets [16,17]. The

2026-06-18视觉感知

针对脑肿瘤 MRI 多分类中人工阅片耗时且不同 CNN 难以公平比较的问题,论文在约 1 万张四类 MRI 上统一评测自建 CNN、VGG16/19、DenseNet121 与 EfficientNetB0。核心洞察是模型效率可能比单纯加深更关键:EfficientNetB0 以 95% 准确率最佳,并将脑膜瘤召回率由基线约 20% 提升到 89%;但增益可能主要来自预训练架构与数据规模,外部泛化仍需进一步验证。

Moving Beyond Diversity: Visual Token Pruning as Subspace Reconstruction for Efficient VLMs Figure 1
2026-06-18cs.CV

Moving Beyond Diversity: Visual Token Pruning as Subspace Reconstruction for Efficient VLMs

Jaeyeon Lee, Shunjie Wen, Dong-Wan Choi

Inha University

2026-06-18视觉语言三维

这篇论文针对VLM中大量视觉token带来的推理开销,指出现有多样性剪枝依赖归一化余弦相似度会丢失幅值信息,难以重构原始视觉表征。作者提出SPARE,将token剪枝建模为列子集选择,通过投影残差和RRQR式贪心选择保留子空间结构,并发现低图文相关token反而有助于保留上下文。实验显示其免训练、即插即用,在LLaVA上最多剪掉94%视觉token仍保持约95%基线性能,并在多技能组合推理任务上优于已有方法。

InTrain: Intrinsic Trainability for Zero-Cost Neural Architecture Search Figure 1
2026-06-18cs.LG

InTrain: Intrinsic Trainability for Zero-Cost Neural Architecture Search

Qinqin Zhou, Fuhai Chen, Jipeng Wu, Zhiwei Chen, Zhikai Hu, Weiwei Cai

School of Computer and Data Science, Fuzhou University, School of Computer and Data Science, Minjiang University, School of Artificial Intelligence, Nanchang University, Department of Computer Science, Hong Kong Baptist University, School of Interdisciplinary Medicine and Engineering, Harbin Medical University

2026-06-18视觉感知

针对零成本 NAS 代理多依赖割裂启发式、难解释“架构为何可训练”的问题,本文提出 InTrain,将可训练性视为由前向表示几何容量与反向优化韧性共同决定的架构不变量,分别用激活协方差参与率和累积梯度健康度度量,并以尺度不变乘法耦合。实验在 NAS-Bench-101/201 和 MobileNetv2 空间中显示,其排序相关性接近集成代理,优于多数单指标方法。

BrainFusionNet: a deep learning and XAI model to understand local, global, and sequential features of MRI images for improved brain tumour detection Figure 1
2026-06-18cs.CV

BrainFusionNet: a deep learning and XAI model to understand local, global, and sequential features of MRI images for improved brain tumour detection

Md Taimur Ahad, Bo Song, Yan Li

School of Mathematics, Physics and Computing, University of Southern, School of Engineering, University of Southern Queensland, Toowoomba, evaluated on two publicly available MRI datasets. K-fold validation suggests 98% accuracy on both datasets. The

2026-06-18视觉感知

针对 MRI 噪声、肿瘤边界模糊及深层网络中特征消失导致的脑肿瘤识别困难,论文提出 BrainFusionNet,将 CNN 的局部/层级特征、ViT 的上下文建模与 GRU 的序列关系学习融合,并用 SHAP、LIME、Grad-CAM解释判别区域,还分析像素强度对分类的影响。在两个公开 MRI 数据集上,K 折验证准确率均约 98%,高于文中对比的最佳 CNN/迁移学习结果约 96%,但具体增益来源仍可能混合来自架构融合与数据设置。

LandslideAgent with Multimodal LandslideBench: A Domain-Rule-Augmented Agent for Autonomous Landslide Identification and Analysis Figure 1
2026-06-18cs.CV

LandslideAgent with Multimodal LandslideBench: A Domain-Rule-Augmented Agent for Autonomous Landslide Identification and Analysis

Chengfu Liu, Dongyang Hou, Junwu Xiang, Cheng Yang, Xuezhi Cui, Zeyuan Wang, Liangtian Liu, Zelang Miao

2026-06-18视觉语言

针对现有滑坡遥感方法偏重视觉定位、缺少地学语义推理且通用 VLM 易产生领域幻觉的问题,论文构建含七类细粒度标签、掩膜与文本描述的 LandslideBench,并用 LoRA 训练 LandslideVLM,再以领域规则约束的 LandslideAgent 调度工具完成识别分析。实验显示其在滑坡判别、细分类和语义描述上分别提升 10.96%、32.87%、15.91%,并支持多源空间数据的自动推理。

On-Manifold Variational Learning with Heat-Kernel Priors Figure 1
2026-06-18cs.CV

On-Manifold Variational Learning with Heat-Kernel Priors

Jiarui Xing, Tal Zeevi, Nian Wu, Jian Wang

Yale School of Medicine, New Haven CT, 06510, USA, University of Virginia, Charlottesville, VA, 22903, USA, Harvard Medical School, Boston MA, 02115, USA, cohorts can reveal clinically meaningful prototypes without expert labels, sub-population uncertainty score enables label-free quality assessment., assume that expert-provided labels faithfully delineate these groups. In practice, however, diagnostic labels across a wide range of clinical domains are unreliable, beyond label noise alone., Code and implementation details are available at https://github.com/jr-xing/, with poorly reproducible delineation [18]. In neuroimaging, the diagnostic labels, chiatric neuroimaging [21]. Label noise is well-recognized, paradigms simultaneously addresses label-free representation learning, manifold-

2026-06-18视觉感知

这篇论文针对医学影像无监督分群中标签不可靠、VAE/GMM 原型由欧氏均值导致偏离潜在流形和组件退化的问题,提出热核加权潜在图上的流形锚定变分学习:EM 的 M 步用扩散中心性最高的图 medoid 作为子群原型,并以 Dirichlet 能量保持潜在空间平滑,同时给出子群不确定性。实验在心肌瘢痕与脑 MRI 等数据上优于 VAE-GMM、Diffusion-GMM,原型更清晰且大 K 下更稳定。

Intrinsic 4D Gaussian Segmentation from Scene Cues Figure 1
2026-06-18cs.CV

Intrinsic 4D Gaussian Segmentation from Scene Cues

Hasan Yazar, Mohamed Rayan Barhdadi, Erchin Serpedin, Mehmet Tuncel, Hasan Kurban

Istanbul Technical University, Texas A&M University, Hamad Bin Khalifa University, Project Page: kurbanintelligencelab.github.io/intrinsic-gs/

2026-06-18视觉感知三维

针对4D Gaussian场景分割依赖SAM等2D掩码、在多视角多帧动态场景中成本高且一致性受限的问题,论文提出Intrinsic-GS:直接利用高斯元的外观、尺度、朝向、形变轨迹和渲染边界构建稀疏亲和图,并用Leiden聚类,无需训练和外部掩码。结果显示其在Neu3D/HyperNeRF达0.746/0.575 mIoU,Neu3D几何-only变体达0.902并匹配SAM监督TRASE,且在HyperNeRF相关阶段快12.5倍。

SC3-Eval: Evaluating Robot Foundation Models via Self-Consistent Video Generation Figure 1
2026-06-18cs.RO

SC3-Eval: Evaluating Robot Foundation Models via Self-Consistent Video Generation

Wei-Cheng Tseng, Gashon Hussein, Yuzhu Dong, Allen Z. Ren, Lucy X. Shi, XuDong Wang, Sergey Levine, Zhaoshuo Li, Jinwei Gu, Florian Shkurti, Ming-Yu Liu, Quan Vuong

University of Toronto, Vector Institute, Stanford University, Allen Institute for AI

2026-06-18机器人视觉感知

针对真实机器人操作评测成本高、视频世界模型长时滚动易漂移且多视角不一致的问题,SC3-Eval将预训练视频基础模型改造成闭环评测器,通过前向-逆动力学一致性、跨视角补全一致性和测试时逆动力学不确定性早停来约束生成轨迹。其在381小时桌面清理数据上评测7个VLA策略,闭环Pearson达0.929、MMRV为0.119,优于Ctrl-World等基线,并能复现真实失败模式。

Hallucination Detection and Correction in Medical VLMs via Counter-Evidence Verification Figure 1
2026-06-18cs.CV

Hallucination Detection and Correction in Medical VLMs via Counter-Evidence Verification

Nan Zhou, Ke Zou, Meng Liu, Linchao He, Jiaqi Zhu, Yi Zhang, Hu Chen, Huazhu Fu

2026-06-18视觉语言视觉感知

医疗VLM在报告生成和问答中常出现缺乏影像依据的幻觉,现有相似度或注意力方法难以验证“说法是否真由对应区域支持”。本文提出无需训练的CoEV,通过遮挡诊断相关区域构造反证探针,并用文本事实性与视觉依赖性四象限定位、修正可疑陈述。在四个医疗数据集上,检测PR-AUC/ROC-AUC平均提升3.0/3.9个百分点,纠错Micro-F1最高提升12.5%,报告幻觉率下降超过11.9%。

Bridging Creative Intent and Visual Quality: Creator-Driven Recurrent Video Generation with Agentic Feedback Loops Figure 1
2026-06-18cs.CV

Bridging Creative Intent and Visual Quality: Creator-Driven Recurrent Video Generation with Agentic Feedback Loops

Denis Savytski, Aiden Lei, Heding Liu, Warren Yang, Sihan Liang, Alexander Liu, Zhe Zhao

2026-06-18视觉感知

针对长视频生成虽有视觉质量但常缺乏叙事连贯和创作者意图的问题,论文提出 CHIEF:以创作者为中心的迭代视频生成框架,用人格化多模态 LLM 模拟不同观众观看并给出主观反馈,再由翻译/细化代理转成提示更新。实验包括 1 分钟短片自迭代和学生制作 10 分钟短片,现场观众评分从基线 2.4/5 提升到 4.1/5,但评价规模与增益来源仍需更充分说明。

No Figure
2026-06-18cs.DC

Splaxel: Efficient Distributed Training of 3D Gaussian Splatting for Large-scale Scene Reconstruction via Pixel-level Communication

Wenqi Jia, Zhewen Hu, Ying Huang, Yu Gong, Stavros Kalafatis, Yuke Wang, Wei Niu, Chengming Zhang, Ang Li, Sheng Di, Yuede Ji, Bo Fang, Miao Yin

Texas A&M University, Rice University, University of Georgia, University of Houston, University of Washington, Argonne National Labs

2026-06-18三维

本文针对大规模 3D Gaussian Splatting 分布式训练中,高斯级 all-to-all 交换随场景规模迅速放大并主导迭代时间的问题,提出 Splaxel:各 GPU 仅渲染本地高斯并交换部分像素,再做全局合成,以像素级通信保持一致性且使通信量基本不随高斯数增长;同时用几何/透射率可见性预测削减冗余,并通过无冲突视角调度提升利用率。在最高 1.2 亿高斯的大场景上,相比现有分布式 3DGS 框架最高提速 7.6 倍且重建质量基本保持。

APT: Atomic Physical Transitions for Causal Video-Language Understanding Figure 1
2026-06-18cs.CV

APT: Atomic Physical Transitions for Causal Video-Language Understanding

Shang Wu, Haoran Lu, Songling Liu, Chenwei Xu, Lie Lu, Pranav Maneriker, Fan Du, Manling Li, Zhaoran Wang, Han Liu

Northwestern University, Dolby Laboratories

2026-06-18视觉感知

论文针对现有视频物理理解多停留在片段级事件标签、难解释“为什么发生”的问题,提出原子物理转变 APT,将视频表示为带时间戳的因果状态变化链,并构建含 14 类、2.73 万实例的混合数据。实验显示现有 VLM 零样本召回仅约 10–14%;APT-Tune 用少量 LoRA 参数将召回提升到 38.1%,同时改善事件级迁移,说明转变级监督可补足物理因果理解。

No Figure
2026-06-18cs.CV

Aerial-ground LiDAR place recognition with patch-level self-supervised learning and expanded reciprocal re-ranking

Yandi Yang, Xianghong Zou, Jianping Li, Haofeng Xie, Saurav Uprety, Hongzhou Yang, Naser El-Sheimy

2026-06-18视觉感知

面向城市峡谷中 GNSS/视觉不可靠、地面先验地图需预采且覆盖不足的问题,论文将公开 ALS 航空点云作为先验,处理航地 LiDAR 的视角/密度域差与初检误匹配。方法把多尺度 patch 级自监督语义一致性并入场景级检索,并利用 ALS 空间结构做扩展互惠重排序。新建 CS-Urban-Scenes 后,检索网络在 Recall@1 上较 SOTA 平均提升 9.8%,ER 重排序无需训练再提升 10.2%。

Technical Report for ICRA 2026 GOOSE 2D Fine-Grained Semantic Segmentation Challenge: Leveraging DINOv3 for Robust Outdoor Scene Understanding in Field Robotics Figure 1
2026-06-18cs.CV

Technical Report for ICRA 2026 GOOSE 2D Fine-Grained Semantic Segmentation Challenge: Leveraging DINOv3 for Robust Outdoor Scene Understanding in Field Robotics

Jaeil Park, Hyobin Choi, Sangjin Lee, Hyungtae Lim, Sung-Hoon Yoon

∗ Co-advised this work. 1 Multimodal Intelligence and Perception Laboratory (MIP), Department of Electrical Engineering and Computer Science, Daegu Gyeongbuk Institute of Science and Technology (DGIST), Massachusetts Institute of Technology (MIT)

2026-06-18机器人视觉感知安全鲁棒

面向野外机器人在非结构化户外场景中遇到的长尾细粒度类别、局部纹理歧义与多平台视角变化,本文给出 GOOSE 2D 挑战冠军方案。方法并未提出全新架构,而是将 DINOv3 ViT-L/16、ViT-Adapter 与 Mask2Former 结合,并在全局 [CLS] token 上加入粗类别多标签辅助损失,推理时使用多尺度/翻转 TTA 和前三检查点集成。最终在隐藏测试集取得 76.57% 综合分、69.32% 细类 mIoU 和 83.81% 粗类 mIoU,排名第一。

Multi-Modal Hyper-Graph Fusion for Low-Light Crowd Counting Figure 1
2026-06-18cs.CV

Multi-Modal Hyper-Graph Fusion for Low-Light Crowd Counting

Hao-Yuan Ma, Li Zhang, Yushi Qiu, Jie Gao, Yan Zhang, Bangjun Wang

School of Computer Science and, Technology, Soochow University, Crowd Dataset), where the synthetic ones provide controllable, based methods directly predict head centers or point sets through

2026-06-18视觉感知

本文针对夜间监控、集会等场景中低照度导致 RGB 人群计数失效的问题,将任务从 Retinex 视角表述为特征级反射率重校准。核心做法是用由图像获得的深度与 Canny 边缘作为几何/结构先验,并通过多模态超图融合建模高阶互补关系,再用可变形矩形稀疏注意力聚焦前景区域。作者还构建 SHA_Dark、SHB_Dark 与 LC-Crowd 三个基准,实验显示 LCNet 在三者上整体优于现有 SOTA,但运行时稀疏算子仍是限制。

Experimental Analysis of Neural Network-Based Image Classification on the CIFAR-10 Dataset Figure 1
2026-06-18cs.CV

Experimental Analysis of Neural Network-Based Image Classification on the CIFAR-10 Dataset

Necati Kagan Erkek, Emre Balci, Berkin Halay

2026-06-18视觉感知数据集/基准

本文以 CIFAR-10 低分辨率图像分类为动机,系统复现实验流程来说明 MLP 展平输入与 CNN 保留空间局部性的差异。核心洞察不是提出新模型,而是用学习曲线展示表示学习与记忆化的分界:六层卷积、三次池化的 CNN 在 Adam、10 轮训练下验证准确率最高约 74.77%,但中后期验证损失上升,提示需早停、正则化或数据增强。

MolmoMotion: Forecasting Point Trajectories in 3D with Language Instruction Figure 1
2026-06-18cs.CV

MolmoMotion: Forecasting Point Trajectories in 3D with Language Instruction

Jianing Zhang, Chenhao Zheng, Yajun Yang, Max Argus, Rustin Soraki, Winson Han, Taira Anderson, Chun-Liang Li, Shuo Liu, Jiafei Duan, Zhongzheng Ren, Jieyu Zhang, Ranjay Krishna

2026-06-18三维

面向机器人规划和视频生成中“预测未来物体运动”的需求,MolmoMotion主张用世界坐标系下的物体附着3D点轨迹替代像素、2D轨迹或类别模板,以获得跨视角、跨类别且可直接用于下游的运动表示。论文构建了从116万公开视频自动标注的MolmoMotion-1M、人工验证的PointMotionBench,并训练支持自回归坐标预测与flow matching生成的语言条件模型。实验显示其在基准上显著优于既有运动预测方法,并能提升机器人操作样本效率与泛化、为视频生成提供更真实的运动引导。

Rethinking Text-to-Image as Semantic-Aware Data Augmentation for Indoor Scene Recognition Figure 1
2026-06-18cs.CV

Rethinking Text-to-Image as Semantic-Aware Data Augmentation for Indoor Scene Recognition

Trong-Vu Hoang, Quang-Binh Nguyen, Dinh-Khoi Vo, Hoai-Danh Vo, Minh-Triet Tran, Trung-Nghia Le

University of Science, VNU-HCM, Vietnam, Vietnam National University, Ho Chi Minh City, Vietnam, these advancements centre around two dominant approaches:

2026-06-18视觉感知

室内场景识别常受真实标注数据不足、光照遮挡和物体布局复杂影响,限制机器人等应用的感知鲁棒性。论文将 Stable Diffusion 作为语义感知数据增强工具,通过图像描述生成提示、合成室内图像并去除重复与离群样本,同时用 DIRE 表征检测合成图像滥用。在 MIT Indoor Scene 上,合成增强使 EfficientNetV2 达到 84.2% 准确率;MobileNetV3 基于 DIRE 可 100% 识别 SD 生成图像。

Forged Calamity: Benchmark for Cross-Domain Synthetic Disaster Detection in the Age of Diffusion Figure 1
2026-06-18cs.CV

Forged Calamity: Benchmark for Cross-Domain Synthetic Disaster Detection in the Age of Diffusion

Duc-Manh Phan, Quoc-Duy Tran, Duy-Khang Do, Anh-Tuan Vo, Hai-Dang Nguyen, Trong Le Do, Mai-Khiem Tran, Vinh-Tiep Nguyen, Tam V. Nguyen, Isao Echizen, Minh-Triet Tran, Trung-Nghia Le

University of Science, VNU-HCM, Ho Chi Minh, Vietnam, Vietnam National University, Ho Chi Minh, Vietnam, University of Information technology, VNU-HCM, Ho Chi Minh, Vietnam, University of Dayton, Ohio, United States, National Institute of Informatics, Tokyo, Japan

2026-06-18视觉感知生成模型数据集/基准

扩散模型已能伪造逼真的火灾、洪水、地震等灾害图像,可能误导舆情与应急响应;论文提出 Forged Calamity 基准,汇集 6000 张真实图像和由四种扩散模型生成的 24000 张合成图像,专门考察跨灾种、跨生成器检测泛化。实验显示检测器在域内表现好,但遇到未见生成器或灾害类型时准确率最高下降约 50%,零样本方法也不稳定,说明现有取证模型明显依赖生成器指纹而非通用真实性线索。

Hierarchical Multi-Modal Retrieval for Knowledge-Grounded News Image Captioning Figure 1
2026-06-18cs.CV

Hierarchical Multi-Modal Retrieval for Knowledge-Grounded News Image Captioning

Minh-Loi Nguyen, Xuan-Vu Le, Long-Bao Nguyen, Hoang-Bach Ngo, Trung-Nghia Le

University of Science, VNU-HCM, Ho Chi Minh City, Vietnam, Vietnam National University, Ho Chi Minh City, Vietnam

2026-06-18视觉语言视觉感知

面向新闻图像中人物、事件时间地点等难以仅由视觉判断的信息缺口,论文提出层次化多模态检索增强 captioning:按标题、正文、图注和视觉位置对新闻文章加权检索,并结合内容-视觉、视觉-视觉与语篇位置相似度;随后用 VLM 生成视觉上下文、抽取相关文章句子,再由 LLM 合成描述。在 OpenEvent-V1 私测集的 EVENTA 2025 挑战中排名第 5,总分 0.2824。

A Prototypical Signature Approach for Writer-Independent Offline Signature Verification Figure 1
2026-06-18cs.CV

A Prototypical Signature Approach for Writer-Independent Offline Signature Verification

Kecia G. de Moura, Robert Sabourin, Rafael M. O. Cruz

natures using static images. Since real forgeries are rarely available, negative samples are, scalability and computational efficiency., Implementation of the method is available at, Writer-independent system, Biometrics, Scalability, [21]. However, these samples are not always available during the training stage [7], forcing systems, more informative training samples to improve performance, efficiency, and scalability. Yet, identi-, scalable real-world deployment.

2026-06-18视觉感知

论文针对离线签名验证中真实伪造样本稀缺、随机负样本冗余且对熟练伪造不够“难”的问题,提出先对签名特征做数据驱动聚类摘要,生成非可识别的原型签名,再按与用户真签名中心的距离选择更有信息量的负样本。实验在 GPDS Synthetic、CEDAR、MCYT-75 上验证了该策略可提升熟练伪造检测,并对不同特征骨干较稳健;结合原始形式线性 SVM 时,还显著降低存储与计算成本,具备更好的扩展性。

DART: A design-aware microfluidic chip paradigm for real-time live-cell image analysis Figure 1
2026-06-18q-bio.QM

DART: A design-aware microfluidic chip paradigm for real-time live-cell image analysis

Johannes Seiffarth, Matthias Pesch, Lukas Scholtes, Dietrich Kohlheyer, Hanno Scharr, Katharina Nöh

Institute for Bio- and Geosciences, IBG-1: Biotechnology, Forschungszentrum J¨ulich, J¨ulich, Computational Systems Biotechnology (AVT.CSB), RWTH Aachen University, Aachen, Institute for Advanced Simulation, IAS-8: Data Analytics and Machine Learning, throughput-dependent setup burden limits the practical scalability of modern high-density chip, the structural knowledge already available in the chip design is generally not used during the

2026-06-18视觉感知

针对高通量微流控活细胞成像中 RoI 逐个定位、结构遮罩与离线分析随通量线性变慢的问题,DART 将芯片 CAD 蓝图通过嵌入式基准标记和深度学习检测对齐到实体芯片,使图像处理直接利用设计语义而非为每种几何重新训练。在含 8 类 RoI、1164 个位置的 SAK 芯片上,系统 5 分钟定位全部 RoI,40 ms 去除微流控结构,并在每图低于 1.1 s 完成含细胞分割的自动分析。

Architectural Bias in Face Presentation Attack Detection: A Comparative Study of Vision Transformers and Convolutional Neural Networks Figure 1
2026-06-18cs.CV

Architectural Bias in Face Presentation Attack Detection: A Comparative Study of Vision Transformers and Convolutional Neural Networks

Ngela Landon Ntung, Floride Tuyisenge, Jema David Ndibwile

College of Engineering, Carnegie Mellon University Africa, Kigali, Rwanda

2026-06-18视觉感知

针对人脸活体检测在深肤色群体上误拒更高的问题,本文比较 ViT 与 CNN 的架构偏置,核心洞察是全局自注意力可能弱化 CNN 的局部纹理/肤色反射依赖。在 CeFA 上,预训练 DeiT-S 达到 97.27% 准确率、0.86% EER,非洲与东亚 ACER 差距降至 0.13%,零样本中亚 BPCER 为 2.89% 而 ResNet18 为 10.44%;但增益来源不清,可能是注意力架构与 ImageNet 预训练共同作用。

Neural Phase Correlation Figure 1
2026-06-18cs.CV

Neural Phase Correlation

Cole Reynolds

Weyl Labs

2026-06-18视觉感知

论文针对现有稠密对应方法把图像各自编码、缺少显式变换表示的问题,将相位相关从固定傅里叶基推广为可学习的成对滤波基,把局部变换分解为二维子空间旋转,并用闭式残差筛选满足结构假设的子空间。该框架在 ACDC 心脏 MRI 配准上达到或超过已发表基线,在 CAMUS 上匹配最强结果,并能从量子波函数观测对中恢复本征态与能级。

Vines-DB: An RGB image dataset for multi-species ornamental vine segmentation Figure 1
2026-06-18cs.CV

Vines-DB: An RGB image dataset for multi-species ornamental vine segmentation

Saroj Burlakoti, Utsav Bhandari, Aaron Etienne, Shital Poudyal (Utah State University)

a Department of Plants, Soils and Climate, Utah State University, Utah, 84322, USA, b Department of Applied Sciences, Technology and Education, Utah State University, Utah, 84322, applications such as automated canopy cover estimation, species identification, and scalable field, Utah State University, Logan, Utah, United States of America, development of advanced models requiring high-quality labeled data., which are labor-intensive and difficult to scale for structurally complex species such as ornamental

2026-06-18视觉感知数据集/基准

针对观赏藤本冠层重叠、形态复杂导致人工测量和传统阈值分割难以规模化的问题,Vines-DB提供7个物种、168株植株的1218张田间高分辨率RGB图像及多边形实例标注,并保留跨月份重复成像以刻画季节变化。经预处理和增强后形成2307张训练/验证/测试数据,可用于多类分割、物种识别和冠层面积估计;文中主要贡献是数据集与流程,未报告模型性能增益。

Data-Forcing Distillation: Restoring Diversity and Fidelity in Few-Step Video Generation Figure 1
2026-06-18cs.CV

Data-Forcing Distillation: Restoring Diversity and Fidelity in Few-Step Video Generation

Siyi Chen, Shaowei Liu, Yixuan Jia, Zian Wang, Huan Ling, Qing Qu, Jun Gao

2026-06-18视觉感知

本文针对 DMD/DMD2 将多步视频扩散模型蒸馏为少步模型时的多样性下降与过饱和伪影,指出根源在反向 KL 的 mode-seeking。DFD 的关键是把真实视频直接送入教师分数计算,用 teacher score discrepancy 将学生拉向真实数据分布,只需近似一行代码改动。实验在 Wan2.1-1.3B、Cosmos-Predict2.5-2B 的文生视频、图生视频等任务上,经过约 100–300 步微调即可改善动态、外观和多样性,部分结果甚至超过教师模型。

Reasoning as Intersection: Consensus-Frame Alignment for Visual Focus in Video-MLLMs Figure 1
2026-06-18cs.CV

Reasoning as Intersection: Consensus-Frame Alignment for Visual Focus in Video-MLLMs

Chengwen Liu, Zhe Huang, Jisheng Dang, Hong Peng, Qi Tian, Tat-Seng Chua

School of Information Science and Engineering, Lanzhou University, Lanzhou, China, Beijing University of Posts and Telecommunications, Beijing, China, School of Computing, National University of Singapore, Singapore

2026-06-18视觉感知

针对视频多模态大模型仅用最终答案奖励难以指明应依赖哪些帧证据的问题,本文提出 CF-GRPO:用时间覆盖、场景切换和问题相关性构造无人工时序标注的共识帧先验,并通过 CFR 奖励其与模型帧使用分布对齐。实验显示 VideoCFR 在复杂视频推理基准上具竞争力并提升部分指标,消融表明先验、稀疏聚合和分布锐化均有贡献。

RegimeVGGT: Layer-Wise Spatially Preserving Redundancy Removal for Visual Geometry Grounded Transformer Figure 1
2026-06-18cs.CV

RegimeVGGT: Layer-Wise Spatially Preserving Redundancy Removal for Visual Geometry Grounded Transformer

Jinhao You (1), Shuo Lyu (1), Zhuohang Lyu (1), Tanxuan Li (1), Zibo Zhao (1), Jiaxiang Hu (2), Kai Tang (3), Yichen Guo (3) ((1) University of Pennsylvania, (2) University of California, Irvine, (3) Nanyang Technological University)

University of Pennsylvania, University of California, Irvine, Nanyang Technological University

2026-06-18视觉感知

本文针对 VGGT 多视角三维重建中跨帧注意力随帧数和 patch 数二次增长、长序列推理过慢的问题,指出 24 层聚合器存在浅层缺少跨视图结构、中层负责对齐、深层几何冗余但影响位姿的分区规律,并据此提出无需训练的双轴 U 形压缩:显著性保护 token 合并与保留空间覆盖/相机 token 路径的 K/V 下采样。在多组重建与位姿实验中,RegimeVGGT 基本保持质量,并在 ScanNet-1000 上相对 VGGT* 达到 6.7× 加速。

CAOA -- Completion-Assisted Object-CAD Alignment Figure 1
2026-06-18cs.CV

CAOA -- Completion-Assisted Object-CAD Alignment

Hiranya Garbha Kumar, Minhas Kamal, Balakrishnan Prabhakaran

University at Albany, licly available on GitHub.

2026-06-18视觉感知

面向室内 RGB-D 语义重建中因遮挡、噪声和实例分割误差导致的 CAD 与物体 9DoF 对齐不稳问题,CAOA 的核心思路是先用带场景上下文的点云补全净化目标几何,再结合 CAD 对称性编码与对称感知损失估计位姿;同时构建 S2C-Completion 真实补全基准和更贴近室内扫描的 SN-Indoor 合成数据。文中在 Scan2CAD 上报告较现有方法约 17% 的对齐准确率提升,增益可能主要来自补全数据与对称建模的联合作用。

Budget-Aware Adaptive Adversarial Patches for Black-Box Object Detection Figure 1
2026-06-18cs.CV

Budget-Aware Adaptive Adversarial Patches for Black-Box Object Detection

Pedram MohajerAnsari, Amir Salarpour, David Fernandez, Mert D. Pesé

School of Computing, Clemson University, USA, is available at https://github.com/pedram-mohaj

2026-06-18视觉感知

面向自动驾驶、机器人和监控中常见的黑盒目标检测器,论文指出现有对抗补丁常忽视查询预算、补丁位置/大小联合优化和可见面积评估。PATCHBANDIT用上下文 Thompson 采样选位置、NES更新纹理,并在停滞时增大补丁,同时区分普通视图成功率与EOT鲁棒性。实验在YOLOv5、Faster R-CNN、YOLOS上分别达77.5%、89.7%、59.1%严格抑制,并显示物理打印迁移潜力。

2026-06-17

112 篇
Future Dynamic 3D Reconstruction: A 3D World Model with Disentangled Ego-Motion Figure 1
2026-06-17cs.CV

Future Dynamic 3D Reconstruction: A 3D World Model with Disentangled Ego-Motion

Nils Morbitzer, Jonathan Evers, Artem Savkin, Thomas Stauner, Nassir Navab, Federico Tombari, Stefano Gasperini

2026-06-17强化学习三维

面向自动驾驶/机器人中长期预测,论文指出2D视频式世界模型会把自运动与场景运动混在一起,导致几何漂移和物体消失。FR3D在预训练3D重建模型的潜空间中自回归预测,将相机位姿与3D场景演化解耦,并用教师-学生蒸馏引入基础模型几何先验。实验显示其可从单目历史观测预测多数据集未来动态3D重建,在约2秒预测范围内保持较好几何一致性和零样本泛化。

Unified Multimodal Autoregressive Modeling with Shared Context-Visual Tokenizer is Key to Unification Figure 1
2026-06-17cs.CV

Unified Multimodal Autoregressive Modeling with Shared Context-Visual Tokenizer is Key to Unification

Wujian Peng, Lingchen Meng, Yuxuan Cai, Xianwei Zhuang, Yuhuan Yang, Rongyao Fang, Chenfei Wu, Junyang Lin, Zuxuan Wu, Shuai Bai

Institute of Trustworthy Embodied AI, Fudan University, Shanghai Innovation Institute, Qwen Team, Alibaba Inc., Website: https://sharelab-sii.github.io/uniar-web

2026-06-17视觉语言

针对统一多模态模型中理解与生成常由双视觉 tokenizer 分裂表示空间、生成结果需重编码的问题,UniAR主张用单一离散视觉 tokenizer 作为共享上下文桥梁。其核心是多层视觉特征融合、无查表 bitwise 量化、并行 bitwise 自回归预测与 DiT 解码器,在压缩视觉序列的同时保留语义和细节。实验显示其在图像生成的文本渲染、指令遵循和编辑上达到领先表现,理解基准保持有竞争力;部分收益可能也来自大规模预训练、SFT 与 RL 数据流程。

MOCHI: Motion Enhancement of Collaborative Human-object Interactions Figure 1
2026-06-17cs.CV

MOCHI: Motion Enhancement of Collaborative Human-object Interactions

Jiye Lee, Yonghun Choi, Jungdam Won

MOCHI: Motion Enhancement of Collaborative Human-object, JIYE LEE, Seoul National University, South Korea, YONGHUN CHOI, Seoul National University, South Korea, JUNGDAM WON∗, Seoul National University, South Korea, Collaborative human-object interaction shows dynamic and complex move-, laborative multi-human object interaction (MHOI) scenarios requires high-, Enhancement of Collaborative Human-object Interactions), a two-stage, Authors’ addresses: Jiye Lee, Department of Computer Science and Engineering, Seoul, Yonghun Choi, Department of, Jungdam Won, Department of Computer Science and Engineering, Seoul, ment of Collaborative Human-object Interactions. ACM Trans. Graph. 45, 4, Collaborative human-object interaction scenarios, such as carrying

2026-06-17视觉感知

MOCHI针对多人协作搬运、放置物体等MHOI数据难采集且常有遮挡、手物错位、抖动和手指缺失的问题,提出两阶段增强框架:先从噪声身体姿态优化出物理合理且语义一致的抓握与手物序列,再用单人扩散运动先验结合人-物、人-人约束细化全身动作。实验显示其可提升捕获或生成的多类MHOI序列质量,并支持不同人数、物体几何变化与关键帧创作。

EventDrive: Event Cameras for Vision-Language Driving Intelligence Figure 1
2026-06-17cs.CV

EventDrive: Event Cameras for Vision-Language Driving Intelligence

Dongyue Lu, Rong Li, Ao Liang, Lingdong Kong, Wei Yin, Lai Xing Ng, Benoit R. Cottereau, Camille Simon Chane, Wei Tsang Ooi

University Toulouse, CNRS, CerCo, Toulouse, France, ETIS UMR 8051, CY Cergy Paris University, ENSEA, CNRS, France

2026-06-17视觉语言视觉感知

本文针对事件相机在自动驾驶中多停留于检测、分割等低层任务,缺乏与语言推理和决策闭环结合的问题,提出 EventDrive 基准与 EventDrive-VLM:以47.1万事件-图像-语言样本覆盖感知、理解、预测、规划17个子任务,并用多时间尺度事件金字塔、MoE动态时域选择和Q-Former对齐融合RGB与事件流。实验显示事件流主要提升运动精度、低光/模糊鲁棒性和速度/意图预测,融合模型较单一模态在各任务更稳定。

Adaptive Volumetric Mechanical Property Fields Invariant to Resolution Figure 1
2026-06-17cs.CV

Adaptive Volumetric Mechanical Property Fields Invariant to Resolution

Rishit Dagli, Donglai Xiang, Vismay Modi, Xuning Yang, Gavriel State, David I.W. Levin, Maria Shugrina

2026-06-17视觉感知

面向机器人训练和交互式数字世界,现有3D资产普遍缺少体积内的杨氏模量、泊松比和密度,手工标注难以规模化。AdaVoMP用稀疏自适应体素树表示形状与材料,并以稀疏Transformer自回归生成粗到细的结构和值,把容量集中在边界和复杂部件。实验称其在更低测试计算下较VoMP/Pixie更准确,并将有效分辨率从64³提升到1024³。

Looped World Models Figure 1
2026-06-17cs.LG

Looped World Models

Hongyuan Adam Lu, Z.L. Victor Wei, Qun Zhang, Jinrui Zeng, Bowen Cao, Lingwei Meng, Mocheng Li, Zezhong Wang, Haonan Yin, Naifu Xue, Minyu Chen, Cenyuan Zhang, Zefan Zhang, Hao Wei, Jiawei Zhou, Haoran Xu, Hao Yang, Ronglai Zuo, Tongda Xu, Yonghao Li, Jian Chen, Hebin Wang, Zeyu Gao, Yang Li, Wei Zhao, Qimin Zhong, Siqi Liu, Yumeng Zhang, Leyan Cui, Zhangyu Wang, Wai Lam

2026-06-17强化学习

论文针对世界模型长时域 rollout 中固定深度计算易累积误差、加深又推高部署成本的问题,提出 LoopWM:用参数共享的 Transformer 块对潜在环境状态做循环迭代细化,并通过谱约束保持递归稳定、按转移难度自适应计算。实验中约 1B 参数模型在 AlfWorld 上 BLEU 最优、EM/F1 接近强基线,并宣称最高 100× 参数效率,但该效率增益的具体来源文中未充分说明。

Seeing Is Not Screening: Multimodal Hidden Instruction Attacks on Agent Skill Scanners Figure 1
2026-06-17cs.CR

Seeing Is Not Screening: Multimodal Hidden Instruction Attacks on Agent Skill Scanners

Xiaojun Jia, Jie Liao, Simeng Qin, Ke Ma, Wenbo Guo, Yebo Feng, Aishan Liu, Yang Liu

Nanyang Technological University, Singapore, Chongqing University, China, Northeastern University, China, University of Chinese Academy of Sciences, China, Beihang University, China

2026-06-17视觉语言

这篇论文关注多模态智能体技能审核中的盲区:现有扫描器多看文本、清单和代码,容易漏掉图片中承载的可执行恶意意图。作者提出 SkillCamo,将恶意命令伪装进技能图片并重写文档使其在运行时被联合解释;同时提出 ExecScan,从意图、行为、滥用风险到执行模拟进行多模态审计。实验显示该攻击对六类扫描器最高可达 90% 逃逸率,而 ExecScan 可将成功率降至 8%。

EgoCS-400K: An Egocentric Gameplay Dataset for World Models Figure 1
2026-06-17cs.CV

EgoCS-400K: An Egocentric Gameplay Dataset for World Models

Rongjin Guo, Dong Liang, Yuhao Liu, Fang Liu, Tianyu Huang, Gerhard P. Hancke, Rynson W. H. Lau

City University of Hong Kong

2026-06-17强化学习数据集/基准

面向交互式世界模型,论文指出普通视频缺少可执行动作和状态监督,机器人数据又昂贵且场景有限。EgoCS-400K 的核心洞察是利用 CS/CS2 回放作为可审计轨迹源,同步渲染第一人称视频并解析键鼠、视角、状态、武器和事件,形成多粒度视频-动作-语言数据。结果是构建了超 40 万段、1 万小时、覆盖 13 张地图的数据集,可支持动作条件预测、状态/事件感知 rollout 和自我中心动作理解;其增益可能主要来自 scaling / data。

ReAge3D: Re-Aging 3D Faces with View Consistency Figure 1
2026-06-17cs.CV

ReAge3D: Re-Aging 3D Faces with View Consistency

Libing Zeng, Li Ma, Mingming He, Ning Yu, Paul Debevec, Nima Khademi Kalantari

Texas A&M University

2026-06-17三维

本文针对3D人脸重龄化中细小皱纹、肤质等年龄线索容易因多视角不一致而被抹平的问题,提出ReAge3D:先训练面向身份保持与年龄控制的2D扩散模型DiffReaging,再从正面枢轴视角向外通过光流传播与Masked-DiffReaging补全各视角,用一致的重龄化图像监督3DGS优化。实验显示其在2D年龄误差、身份保持以及3D视觉质量上优于FADING、FRAN和多种3D编辑基线,可实现20到80岁连续可控变化。

Neural Tree Reconstruction for the Open Forest Observatory Figure 1
2026-06-17cs.CV

Neural Tree Reconstruction for the Open Forest Observatory

Marissa Ramirez de Chanlatte, Arjun Rewari, Trevor Darrell, Derek J. N. Young

University of California, Berkeley, Department of Plant Sciences, University of California, Davis

2026-06-17三维

针对 OFO 现有无人机森林三维地图依赖 SfM、在林下和细枝叶结构上易产生伪影且影响火灾/碳汇等下游分析的问题,论文尝试将 NeRF 引入开放森林观测数据流程。核心洞察是用神经辐射场的体渲染和新视角合成能力弥补俯视影像稀疏与遮挡限制。结果主要为概念验证:相比 SfM 点云/网格,NeRF 渲染和提取网格在树干、枝叶等细节上更清晰,但定量评测和科学误差边界文中未充分说明。

Predicting Immune Biomarkers with MultiModal Mixture-of-Expert Pathology Foundation Models Empowers Precision Oncology Figure 1
2026-06-17cs.CV

Predicting Immune Biomarkers with MultiModal Mixture-of-Expert Pathology Foundation Models Empowers Precision Oncology

Tianyu Liu, Ziqing Wang, Zhaokang Liang, Tong Ding, Peter Humphrey, Lorraine Colón-Cartagena, Emily Ling-Lin Pai, Kenneth Tou En Chang, Mohamed Kahila, Jonathan Chong Kai Liew, Tinglin Huang, Rex Ying, Kaize Ding, Faisal Mahmood, Wengong Jin

Program of Computational Biology and Bioinforamtics, Yale University, USA, Broad Institute of MIT and Harvard, USA, Department of Statistics and Data Science, Northwestern University, USA, Department of Computer Science, Northeastern University, USA, Department of Computer Science, Harvard University, USA, Department of Pathology, Yale University, USA, Department of Anatomic Pathology and Laboratory Medicine, Hospital of the University of Pennsylvania, USA, Department of Pathology and Laboratory Medicine, University of California, San Francisco, USA, Department of Pathology and Laboratory Medicine, KK Women’s and Children’s Hospital, SGD, Department of Biostatistics, Epidemiology and Informatics, Perelman School of Medicine, University of Pennsylvania, USA

2026-06-17视觉语言

针对仅用单一病理图像预测肿瘤免疫微环境标志物时分辨率低、临床/生物信息利用不足的问题,论文提出 MixTIME,用 MoE 路由融合图像、图文、图像-转录组等病理基础模型,并以分布与趋势感知损失预测 H&E 到 mIF 蛋白表达。在 HEMIT 与 ORION 上,模型在 17 个标志物相关性指标上总体优于 GigaTIME、HEX、ROSIE 等基线,并提升空间域识别、生存预测和病理报告生成等下游任务。

HLS-GPT: A Generative Pretrained Transformer (GPT) for Continental-Scale NASA Harmonized Landsat and Sentinel-2 (HLS) Reflectance Reconstruction Across All Bands on Arbitrary Dates Figure 1
2026-06-17cs.CV

HLS-GPT: A Generative Pretrained Transformer (GPT) for Continental-Scale NASA Harmonized Landsat and Sentinel-2 (HLS) Reflectance Reconstruction Across All Bands on Arbitrary Dates

Junjie Li, Hankui K. Zhang, David P. Roy

a, Geospatial Sciences Center of Excellence, Department of Geography and Geospatial, Sciences, South Dakota State University, Brookings, SD 57007, USA, b, Department of Geography, Environment, and Spatial Sciences, & Center for Global, Change and Earth Observations, Michigan State University, MI 48824, USA, geographic scalability, and/or are limited by patch-based designs with short temporal coverage that

2026-06-17生成模型三维

针对 Landsat/Sentinel-2 HLS 受云、轨道与传感器差异影响而时间序列稀疏不规则、难以获得任意日期全波段无缝反射率的问题,HLS-GPT 用分层 Transformer 分别建模两类传感器并融合特征,通过九年、25 万余 CONUS 像元的随机裁剪与遮蔽自监督训练重建 12 个月单像元序列。独立测试中各波段 RMSE 低于 0.026,遮蔽 10%–50% 时仍保持接近精度,并在未训练瓦片上优于传统拟合方法和 Prithvi。

Qwen-RobotNav Technical Report: A Scalable Navigation Model Designed for an Agentic Navigation System Figure 1
2026-06-17cs.RO

Qwen-RobotNav Technical Report: A Scalable Navigation Model Designed for an Agentic Navigation System

Jiazhao Zhang, Gengze Zhou, Hale Yin, Yiyang Huang, Zixing Lei, Qihang Peng, Haoqi Yuan, Jie Zhang, Xudong Guo, Xiaoyue Chen, An Yang, Fei Huang, Junyang Lin, Dayiheng Liu, Jingren Zhou, Zhuoyuan Yu, Jingyang Fan, Zhixuan Liang, Pei Lin, Ye Wang, Anzhe Chen, Kun Yan, Xiao Xu, Jiahao Li, Lulu Hu, Minying Zhang, Shurui Li, Wenhu Xiao, Shuai Bai, Xuancheng Ren, Chenxu Lv, Chenfei Wu, Xiong-Hui Chen

Qwen-RobotNav Technical Report: A Scalable Navigation Model, We present Qwen-RobotNav, a scalable navigation model built on Qwen3-VL that, multiple task modes that select the navigation behaviour, and controllable observation, AMAP CV Lab, 2025, multi-task capability, but also a controllable interface whose observation strategy can be reconfigured by, ABot-N0 (AMAP CV Lab, 2025) retains only a sliding, We introduce Qwen-RobotNav, a scalable navigation model built on Qwen3-VL (Yang et al., 2025a) that, behaviour appropriate for each sub-goal. Second, controllable observation parameters, including visual

2026-06-17机器人

面向具身问答等长程任务,固定视觉上下文策略难以同时适配指令跟随、搜索、跟踪和驾驶。Qwen-RobotNav基于Qwen3-VL,将导航统一为航点预测,并用任务模式、token预算、时间衰减和相机权重构成可由上层规划器动态调控的接口;15.6M样本多任务训练后,在VLN-CE RxR达76.5%成功率、EVT-Bench达90.0%跟踪率、NAVSIM达91.4 PDMS,EQA也显著提升且步数更少。

Blended Chart Surfaces: A Seamless Explicit Representation for Smooth Surface Fitting Figure 1
2026-06-17cs.GR

Blended Chart Surfaces: A Seamless Explicit Representation for Smooth Surface Fitting

Romy Williamson, Niloy Mitra

2026-06-17视觉感知

针对隐式场需等值面提取、显式神经曲面受全局参数域或拼接缝限制的问题,本文提出 Blended Chart Surfaces:在用户给定粗代理网格上为每个顶点优化低阶多项式局部映射,并用 one-ring 坐标与单位分解平滑混合,从而将拓扑/粗几何与细节解耦。实验显示其在多拓扑曲面拟合中较插值函数和网格位移 MLP 更好兼顾紧凑性、可微导数访问和跨 patch 光滑性。

When LLMs Analyze Scars: From Images to Clinically-Meaningful Features Figure 1
2026-06-17cs.CV

When LLMs Analyze Scars: From Images to Clinically-Meaningful Features

Ruman Wang, Hangting Ye

Liaoning University of Traditional Chinese Medicine 1, School of Artificial Intelligence, Jilin University 2

2026-06-17视觉感知

针对瘢痕图像标注稀缺、隐私受限且端到端深度模型难以解释的问题,论文提出 ScaFE:不让 LLM 直接诊断图像,而是依据 VSS/POSAS 等临床量表生成本地可执行的特征提取代码,将图像转为低维、可解释特征后用轻量分类器分类。实验称在低数据瘢痕分类中优于端到端深度学习和黑盒 LLM 基线,但具体增益来源仍需结合完整实验细节判断。

PhaseWin: An Efficient Search Algorithm for Faithful Visual Attribution Figure 1
2026-06-17cs.CV

PhaseWin: An Efficient Search Algorithm for Faithful Visual Attribution

Zihan Gu, Ruoyu Chen, Junchi Zhang, Li Liu, Xiaochun Cao, Hua Zhang

2026-06-17视觉感知

这篇论文针对视觉/视觉语言模型归因中“忠实但昂贵”的子集搜索问题,指出常用贪心法不仅需反复重评分导致 O(n²) 前向开销,其子模理论依据也不适用于充分性—必要性代理目标。作者提出 PhaseWin,通过分阶段全局筛选、自适应剪枝与局部窗口精排,在保留近似贪心排序行为的同时将评估复杂度降至线性。实验覆盖分类、检测、指代定位和图像描述,显示其以最少前向次数达到较高归因忠实度。

AIGS-Net: Compact Illumination Field Modeling via 2D Gaussian Splatting for Fast Low-Light Image Enhancement Figure 1
2026-06-17cs.CV

AIGS-Net: Compact Illumination Field Modeling via 2D Gaussian Splatting for Fast Low-Light Image Enhancement

Yuhan Chen, Kunyang Huang, Fuchen Li, Zhuohan Qin, Guofa Li, Wenbo Chu, Keqiang Li

2026-06-17视觉感知三维

针对低光增强中照明场表达能力与边缘端计算开销难兼顾的问题,AIGS-Net用输入相对亮度统计动态调制2D Gaussian Splatting基的透明度,并结合零参数多尺度上下文、噪声掩码和锁定单通道Gamma约束来抑制噪声与偏色。在LOL、LSRW上报告更好的细节和色彩保真,仅约440个可学习参数,显示其增益主要来自自适应照明建模与强约束的轻量设计。

Recover Semantics First, Generate Better: Improved Latent Modeling for 3D MRI Reconstruction and Cross-Contrast Synthesis Figure 1
2026-06-17cs.CV

Recover Semantics First, Generate Better: Improved Latent Modeling for 3D MRI Reconstruction and Cross-Contrast Synthesis

Yonghao Chen, Sicheng Yang, Rui Tang, Lei Zhu

2026-06-17三维

针对3D多对比MRI直接生成成本高、现有VAE/VQ潜空间压缩易破坏长程解剖一致性、混淆对比语义并过度平滑的问题,论文提出“先恢复语义再生成”的潜变量建模框架:用LHE融合卷积与切片ViT捕获全局结构,SRB借助DINO教师恢复对比可分语义,AFL强化关键高频解剖细节。两套公开多对比MRI数据上的实验显示,该方法在体数据重建和跨对比合成质量上均稳定优于基线。

Gaussian Light Field Splatting: A Physical Prior-Driven Vision Transformer for Unsupervised Low-Light Image Enhancement Figure 1
2026-06-17cs.CV

Gaussian Light Field Splatting: A Physical Prior-Driven Vision Transformer for Unsupervised Low-Light Image Enhancement

Yuhan Chen, Wenxuan Yu, Guofa Li, Fuchen Li, Kunyang Huang, Yicui Shi, Ying Fang, Wenbo Chu, Keqiang Li

2026-06-17视觉感知三维

针对无监督低光增强在非均匀照明下易出现局部过曝/欠曝、偏色和细节损失的问题,本文提出 GLFS,将 2D Gaussian Splatting 的连续光场表示作为物理先验嵌入 ViT 自注意力,通过各向异性高斯基函数推断平滑空间增益场,并用颜色向量角损失与亮度边缘损失约束色相和结构。实验与消融显示其在照明校正、细节保持和 SSIM 等指标上优于已有方法。

SegDINO: Introducing Multi-Scale Structure into DINO for Efficient Medical Image Segmentation Figure 1
2026-06-17cs.CV

SegDINO: Introducing Multi-Scale Structure into DINO for Efficient Medical Image Segmentation

Sicheng Yang, Hongqiu Wang, Zhaohu Xing, Sixiang Chen, Qiuxia Yang, Yize Mao, Guang Yang, Lei Zhu

2026-06-17视觉感知

针对 DINO 特征直接用于医学分割时缺少显式多尺度层级、简单解码器难以处理小病灶而重解码器又代价高的问题,SegDINO 冻结 DINOv3 编码器,通过 TPA 将不同深度 token 重组为伪金字塔,并用轻量 SAD 做尺度内细化与自顶向下传播。作者还构建 284 例胰腺肿瘤 CT 数据集 PanCT;在 PanCT 和三个公开基准上报告达到 SOTA 且参数/计算效率更高。

Reload-Mamba: Hierarchical Anti-Dilution State-Space Modeling for Multi-Class Semantic Segmentation Figure 1
2026-06-17cs.CV

Reload-Mamba: Hierarchical Anti-Dilution State-Space Modeling for Multi-Class Semantic Segmentation

Sheng-Wei Chan, Hsin-Jui Pan, Jen-Shiun Chiang

2026-06-17视觉感知

本文针对 Mamba 在高分辨率语义分割中顺序传播会稀释边界、细结构和小目标响应的问题,提出 Reload-Mamba:用边界监督的局部细节先验、基于类别熵的不确定性感知 Reload Gate,以及三层级解码器重载融合来恢复被削弱的特征。实验在 ADE20K 达 47.9/48.9 mIoU、Cityscapes 达 83.2、PASCAL VOC 达 87.8,消融显示相较直接移植反稀释结构提升 2.2 mIoU。

Robustness of Similarity-based Positional Encoding Under Rotations: Theoretical Analysis and Experimental Validation Figure 1
2026-06-17cs.CV

Robustness of Similarity-based Positional Encoding Under Rotations: Theoretical Analysis and Experimental Validation

Andrea Santomauro, Luigi Portinale, Giorgio Leonardi

Computer Science Institute, DiSIT, University of Piemonte Orientale, Alessandria, Italy

2026-06-17安全鲁棒

针对医疗影像等场景中小角度旋转会扰动 Transformer 位置信息的问题,本文把相似度位置编码 simPE 形式化为若干 Lipschitz 组件的组合,指出其一般并非旋转不变,但可在 Frobenius 范数下获得显式稳定性界。合成箭头、形状、数字和 FashionMNIST 实验显示,simPE 在小到中等旋转下较 learned PE 衰减更慢,准确率、F1 等指标更稳。

Beyond Visual Cues: CoT-Enhanced Reasoning for Semi-supervised Medical Image Segmentation Figure 1
2026-06-17cs.CV

Beyond Visual Cues: CoT-Enhanced Reasoning for Semi-supervised Medical Image Segmentation

Yuming Chen, Yuxin Xie, Tao Zhou, Yi Zhou

2026-06-17视觉感知

针对半监督医学图像分割过度依赖像素相似、在视觉相似但病理语义不同或边界模糊病例中易失效的问题,论文提出 CERS:用冻结 LLM 生成分割相关 CoT,构建仅含标注样本的推理知识库,先按形态检索再按 CoT 一致性重排,并通过 MCAM 融入双解码器。文中称在多个公开数据集优于现有方法,尤其改善边界歧义和语义不一致,但具体增益幅度需看实验表。

MLLMs Get It Right, Then Get It Wrong: Tracing and Correcting Late-Layer Textual Bias Figure 1
2026-06-17cs.CV

MLLMs Get It Right, Then Get It Wrong: Tracing and Correcting Late-Layer Textual Bias

Xingming Li, Ao Cheng, Qiyao Sun, Xixiang He, Xuanyu Ji, Runke Huang, Qingyong Hu

National University of Defense Technology, changsha, China, Chinese University of Hong Kong, Shenzhen, China, Intelligent Game and Decision Lab, Beijing, China

2026-06-17视觉感知

针对多模态大模型在图文冲突时盲从文本、削弱视觉 grounding 的风险,论文通过逐层投影输出概率发现“晚层文本覆盖”:模型中间层常已给出正确视觉答案,却在末层转向文本。作者提出 MDR 诊断该方向性偏移,并用免训练的 CALRD 在检测到高置信视觉预测被压制时回灌中间层 logits;在五个 MLLM 和冲突基准上最高带来 9.4% 绝对提升,同时基本保持常规任务性能。

Plug-and-Adapt: Multimodal Coreference Resolution at First Sight with a Pretrained Alignment Model Figure 1
2026-06-17cs.CV

Plug-and-Adapt: Multimodal Coreference Resolution at First Sight with a Pretrained Alignment Model

Jinghan Wu, Jing Li, Ivor W. Tsang, Xuetao Zhang

2026-06-17视觉语言

本文针对多模态共指消解依赖目标数据标注训练或大型VLLM、难以即插即用的问题,提出先在视觉语言对齐数据上预训练细粒度关系式对齐模型,再通过相似度聚合构造提及表示,并用证据理论融合视觉与类别线索。该方法无需CIN共指链训练,在CIN上CoNLL F1较专用SOTA和常用VLLM分别提升5.31%和2.12%,在masked CIN与新建VCR-MCR上也显示鲁棒性和泛化性。

MoonSplat: Monocular Online Gaussian Splatting with Sim(3) Global Optimization Figure 1
2026-06-17cs.CV

MoonSplat: Monocular Online Gaussian Splatting with Sim(3) Global Optimization

Guo Pu, Yixuan Han, Haofeng Li, Yao Zhang, Hui Zhou, Zhouhui Lian

Wangxuan Institute of Computer Technology, Peking University, Beijing Hydrogen Intelligent Tech. Co., Ltd., Wangxuan Institute of Computer Technology, Peking University China, Beijing Hydrogen Intelligent Tech. Co., Ltd. China

2026-06-17优化算法三维

MoonSplat针对单目在线3DGS在长序列中位姿易漂移、缺少回环全局校正且体素化表示优化慢的问题,提出结合预训练多视几何先验、体素化Gaussian表示与Sim(3)因子图全局优化的框架,同步修正相机位姿、尺度漂移和Gaussian锚点,并用颜色残差学习加速收敛。实验显示其在室内外数据上提升位姿精度与渲染质量并保持实时性,还部署到无人机主动重建系统验证实用鲁棒性。

Revisiting Structural Dependency in Autoregressive Multi-Task Table Recognition via Order-Independent Cell-Level Representations Figure 1
2026-06-17cs.CV

Revisiting Structural Dependency in Autoregressive Multi-Task Table Recognition via Order-Independent Cell-Level Representations

Takaya Kawakatsu

2026-06-17视觉感知

本文针对多任务表格识别中自回归结构解码器的隐藏状态被直接复用于定位和内容识别、导致单元格表示受生成顺序影响的问题,提出在结构生成后加入单元格级结构精炼模块,用非因果自注意力并结合视觉特征重对齐,获得顺序无关的全局单元格表示。两套大规模数据集实验显示,该方法将单元格定位 IoU 提升约 3–5 点,改善端到端 TEDS,尤其利于长文本单元格,并通过并行单元格解码将推理时间约降至 MuTabNet 的三分之一。

A Quantitative Analysis of Multimodal Biomarkers in Alzheimer's Disease Figure 1
2026-06-17cs.CV

A Quantitative Analysis of Multimodal Biomarkers in Alzheimer's Disease

Antonio Scardace, Daniele Ravì

2026-06-17视觉语言

针对阿尔茨海默病多模态生物标志物虽被广泛融合、但各模态信息贡献与冗余关系不清的问题,本文在789名ADNI受试者上联合tau-PET、结构MRI、MMSE/CDR和APOE ε4,量化互信息、解释方差、tau-萎缩关系并分解tau-认知关联。主要结果显示,该分析可揭示跨模态冗余、筛选更有预测价值的脑区,并得到与认知下降一致的主导神经退行轨迹;具体数值增益文中片段未充分说明。

Qwen-RobotManip Technical Report: Alignment Unlocks Scale for Robotic Manipulation Foundation Models Figure 1
2026-06-17cs.RO

Qwen-RobotManip Technical Report: Alignment Unlocks Scale for Robotic Manipulation Foundation Models

Haoqi Yuan, Zhixuan Liang, Anzhe Chen, Ye Wang, Haoyang Li, Pei Lin, Yiyang Huang, Zixing Lei, Tong Zhang, Jiazhao Zhang, Jie Zhang, Jingyang Fan, Gengze Zhou, Qihang Peng, Chenxu Lv, Xiaoyue Chen, An Yang, Fei Huang, Junyang Lin, Dayiheng Liu, Jingren Zhou, Chenfei Wu, Xiong-Hui Chen

et al., 2026), and EBench (Laboratory, 2026), alongside two new benchmarks: RoboTwin-IF, an instruction-

2026-06-17机器人

本文针对机器人操作数据异构、昂贵且难以规模化导致 VLA 泛化不足的问题,提出基于 Qwen-VL 的 Qwen-RobotManip,核心是先做跨本体对齐再扩展数据:统一状态动作表示、相机坐标增量位姿和上下文自适应,并用人到机器人合成与多源清洗构建约 3.81 万小时数据。实验在多种 OOD、指令跟随和跨本体基准及真实机器人上超过 π0.5 等模型,RoboChallenge 相对提升 20%,但增益可能主要来自 scaling / data 与对齐共同作用。

High-Fidelity 3D Geometric Reconstruction of Pelvic Organs from MRI: A Hybrid Deep Learning and Iterative Optimization Approach Figure 1
2026-06-17cs.CV

High-Fidelity 3D Geometric Reconstruction of Pelvic Organs from MRI: A Hybrid Deep Learning and Iterative Optimization Approach

Hui Wang, Xiaowei Li, Chenxin Zhang, Yifan Feng, Jianwei Zuo, Yumeng Tang, Xiuli Sun, Jianliu Wang, Bing Xie, Jiajia Luo

Institute of Medical Technology, Peking University Health Science Center, Peking University, Beijing, People’s Republic of China, Biomedical Engineering Department, Institute of Advanced Clinical Medicine, Peking University, Beijing, People’s Republic of China, Department of Obstetrics and Gynecology, Peking University People’s Hospital, People’s Republic of China, fidelity, high-quality geometries remains labor-intensive and poorly standardized., In conventional workflows, constructing these 3D models remains a highly labor-intensive, necessitates labor-intensive and often inconsistent post-processing workflows. This "technical

2026-06-17生成模型优化算法三维

针对盆腔器官 MRI 到高质量三维网格仍依赖人工分割、修补且难以标准化的问题,本文提出深度预测与迭代优化耦合的可变形形状建模框架,用几何感知多层网络、两阶段摊销优化和推理时热启动细化来兼顾拓扑一致性、表面细节与网格质量。实验显示其在膀胱、子宫、直肠重建中降低 Chamfer Distance、提高 Dice,并在 minSICN/minSIGE 等体网格质量指标上优于传统后处理方法。

Human-in-the-Loop Atlas-Based 3D Asset Segmentation for Interactive Content Workflows Figure 1
2026-06-17cs.CV

Human-in-the-Loop Atlas-Based 3D Asset Segmentation for Interactive Content Workflows

Paul Julius Kühn, Saptarshi Neil Sinha, Jakob Hansen, Robin Horst

2026-06-17视觉感知生成模型三维

面向游戏、XR与文化遗产等流程中“分割标准依任务而变、用户需可控”的3D资产编辑需求,本文将多视图2D分割回投到UV图集,并用贪心集合覆盖选择紧凑视角,结合SAM 2与Label Studio进行人在环修正。八个文化遗产物体的演示评估表明可生成可用的分割图集,但细结构、孔洞和弱外观边界仍需较多人工纠正。

Million-scale multimodal pollen microscopy with expert-guided foundation models Figure 1
2026-06-17cs.CV

Million-scale multimodal pollen microscopy with expert-guided foundation models

András Biricz, Björn Gedda, Donát Magyar, Antonio Spanu, János Fillinger, Péter Pollner, István Csabai

Department of Physics of Complex Systems, ELTE Eötvös Loránd University, Budapest, Hungary, The Palynological Laboratory at the Swedish Museum of Natural History, Stockholm, Sweden, National Centre for Public Health and Pharmacy, Budapest, Hungary, National Korányi Institute for Pulmonology, Budapest, Hungary, Health Data Science and AI Knowledge Centre, Health Services Management Training Centre, Faculty of Health and Public Administration, Semmelweis University, Budapest, Hungary, Department of Biological Physics, ELTE Eötvös Loránd University, Budapest, Hungary

2026-06-17视觉语言

针对花粉显微识别依赖专家且跨制片、扫描器和地域泛化困难的问题,本文构建 Pollen AI Atlas:用每张纯种全片一个专家示例在密集特征空间挖掘花粉颗粒,并以专家形态学锚点约束开源 VLM 生成粒级描述。最终发布 151 万个检测、精度 99.6%,冻结视觉特征分类达 88.16%,跨地域检索中文本嵌入明显优于图像相似度。

MaineCoon: Pursuing A Real-Time Audio-Visual Social World Model Figure 1
2026-06-17cs.CV

MaineCoon: Pursuing A Real-Time Audio-Visual Social World Model

Lichen Bai, Tianhao Zhang, Shitong Shao, Dingwei Tan, Qiyu Zhong, Zhengpeng Xie, Haopeng Li, Qinghao Huang, Dandan Shen, Tengjiao Ji, Wei Wang, Peicheng Wu, Yuxuan Zhao, Xiangyu Zhu, Welly Luo, Shurui Yang, Zeke Xie

large-scale social-interactive applications. Consequently, none of them can yet deliver a long-horizon scalable

2026-06-17强化学习

论文针对现有视频/世界模型难以支持社交场景中的实时互动、音画同步和长时稳定生成的问题,提出“社交世界模型”定位,并构建22B参数的MaineCoon:采用流式自回归音视频生成,结合自重采样、跨模态对齐、领域偏好优化、ROPD及智能缓存推理。文中称其可在单张H100上达到最高47.5 FPS、亚秒交互,并支持千秒级生成;具体增益来源可能同时来自模型规模、数据与工程优化。

LiveStarPro: Proactive Streaming Video Understanding with Hierarchical Memory for Long-Horizon Streams Figure 1
2026-06-17cs.CV

LiveStarPro: Proactive Streaming Video Understanding with Hierarchical Memory for Long-Horizon Streams

Zhenyu Yang, Kairui Zhang, Bing Wang, Shengsheng Qian, Changsheng Xu

2026-06-17视觉感知

面向在线机器人/视频助手在长时连续流中难以及时发声且易遗忘历史的问题,LiveStarPro不再学习高频EOS静默,而以SVeD用困惑度单次验证响应时机,配合SCAM做增量视频语言对齐,并用树状层级记忆检索被移出上下文的事件链。其在OmniStarPro等评测中较既有在线Video-LLM语义正确性提升28.9%、时序误差降低18.2%,KV缓存带来1.58倍推理加速。

The Slop Paradox: How Synthetic Standardization Erodes Clinical Uncertainty and Cross-Modal Alignment in AI-Rewritten Radiology Reports Figure 1
2026-06-17cs.CL

The Slop Paradox: How Synthetic Standardization Erodes Clinical Uncertainty and Cross-Modal Alignment in AI-Rewritten Radiology Reports

Samar Ansari

School of Computing and Engineering Sciences, University of Chester

2026-06-17安全鲁棒

针对LLM进入放射报告摘要、标准化与教学改写后可能污染临床文本和多模态训练数据的问题,本文在IU胸片报告上量化实体、模糊/不确定性表达与图文对齐损失,提出“slop paradox”:看似更干净的标准化/教学改写虽少丢实体,却使BiomedCLIP图文对齐下降14.9–16.5%;EHR摘要丢失51.4%实体和43.7%hedging,但对齐仅降2.5%,且罕见病并未更易受损。

BrainWorld: A Structural-Prior-Conditioned Generative Model for Whole-Brain 4D fMRI Dynamics Figure 1
2026-06-17cs.CV

BrainWorld: A Structural-Prior-Conditioned Generative Model for Whole-Brain 4D fMRI Dynamics

Junfeng Xia, Wenhao Ye, Junxiang Zhang, Xuanye Pan, Mo Wang, Quanying Liu

Department of Biomedical Engineering, Southern University of Science and Technology, China, School of Biomedical Engineering, Shenzhen University, China

2026-06-17生成模型强化学习

针对现有 fMRI 基础模型多偏向表征学习、难以进行受结构条件约束的长时程全脑 4D 动态生成,BrainWorld 将 sMRI 作为个体解剖先验注入扩散 Transformer 去噪过程,而非简单并联融合,并用 VAE 潜空间建模体素级 fMRI 轨迹。文中在 22 个数据集上报告可稳定生成最长 400 帧序列,生成样本可提升下游任务,且中间特征具备较好迁移表征能力。

ED3R: Energy-Aware Distributed Disaster Detection Enabled by Cooperative Robotic Agents Figure 1
2026-06-17cs.RO

ED3R: Energy-Aware Distributed Disaster Detection Enabled by Cooperative Robotic Agents

Lina Magoula, Nikolaos Koursioumpas, Nancy Alonistioti, Ramin Khalili

* Dept. of Informatics and Telecommunications, National and Kapodistrian University of Athens, Greece, ** Huawei Heisenberg Research Center (Munich), Germany

2026-06-17机器人视觉感知

面向野火等灾害巡检中检测置信度、响应时间与机器人续航相互制约的问题,ED3R将无人机与远程控制器建模为分层协作智能体,联合决定运动、视觉模型选择及本地/远程推理,并用分布式神经回归做前瞻评估,辅以避障、区域避免和早停机制。仿真显示任务成功率最高97.18%,困难场景下能耗降36.4%、检测提速41%。

ActWorld: From Explorable to Interactive World Model via Action-Aware Memory Figure 1
2026-06-17cs.CV

ActWorld: From Explorable to Interactive World Model via Action-Aware Memory

Zhexiao Xiong, Yizhi Song, Hao Kang, Qing Yan, Liming Jiang, Jenson Yang, Zhoujie Fu, Stathi Fotiadis, Angtian Wang, Zichuan Liu, Bo Liu, Yiding Yang, Xin Lu, Nathan Jacobs

2026-06-17强化学习

ActWorld针对现有交互式世界模型“能逛不能操作”的问题,指出瓶颈在于缺少密集人-物交互数据以及按时间近因压缩历史导致的动作遗忘。论文构建10万交互视频数据,并提出分层动作感知记忆,用本地与持久记忆保留事件更新和物体身份信息。实验显示其在统一实时框架中同时支持导航和中途物体交互,交互保真度优于导航型基线且基本不牺牲视角控制。

GSPan: A Continuous Gaussian Primitive Representation for Arbitrary-Scale Pansharpening Figure 1
2026-06-17cs.CV

GSPan: A Continuous Gaussian Primitive Representation for Arbitrary-Scale Pansharpening

Fangyi Li, Xiaoyuan Yang, Yixiao Li, Zongyang Sui, Kangqing Shen, Gemine Vivone

2026-06-17三维

针对现有深度全色锐化多依赖固定输出网格、难以适配任意尺度且大场景推理开销高的问题,GSPan将高频残差表示为连续可学习的2D高斯基元,并用DSHI与SSIA融合PAN结构和MS光谱信息,再渲染残差注入上采样MS。该表示支持无需重训的任意尺度输出,并通过SDAI低分辨率估计、高分辨率渲染加速大场景处理;在QuickBird、GaoFen-2、WorldView-3及WV3-4K上取得SOTA融合效果与更优效率权衡。

Heterogeneous SAR-optical fusion for near-real-time land use and land cover mapping under cloud contamination: A novel framework and global benchmark dataset Figure 1
2026-06-17cs.CV

Heterogeneous SAR-optical fusion for near-real-time land use and land cover mapping under cloud contamination: A novel framework and global benchmark dataset

Jiangong Xu, Weibao Xue, Xiaoyu Yu, Jun Pan, Xinlian Lianga, Mi Wang

a State Key Laboratory of Information Engineering in Surveying, Mapping and Remote Sensing, Wuhan University, Wuhan 430079, China, b School of Computer Science and Information Engineering, Hefei University of Technology, Hefei 230009, China, c Hangzhou International Innovation Institute, Beihang University, Hangzhou 311100, China, d Oriental Space Port Research Institute, Yantai, 265100, China, e Hubei Luojia Laboratory, Wuhan, 430079, China, benchmark dataset containing 40,223 curated SAR–optical–label triplets with pixel-level LULC, available at: https://github.com/RSIIPAC/CloudLULC, availability of valid optical observations, especially in tropical, effectiveness strongly depends on the availability of sufficient

2026-06-17数据集/基准

针对云/云影使光学影像在近实时土地利用/覆盖制图中不可靠的问题,论文提出 CloudLULC-Net,直接融合受污染 Sentinel-2 与邻近 Sentinel-1 SAR,通过光学可靠性调制、高阶空间-通道交互和语义映射 Transformer 减少云区误导,并构建含 40,223 组三元样本的 CloudLULC-Set。实验达到 OA 86.60%、F1 83.29%、mIoU 73.51%,优于重建优先和端到端基线。

Structured Adversarial Camouflage via Voronoi Diagrams Figure 1
2026-06-17cs.CV

Structured Adversarial Camouflage via Voronoi Diagrams

Jens Bayer, Stefan Becker, David Münch, Michael Arens, Jürgen Beyerer

Fraunhofer IOSB and Fraunhofer Center for Machine Learning, Karlsruhe Institute of Technology

2026-06-17视觉感知

针对像素级对抗贴片计算开销大、外观突兀且难以物理复现的问题,本文用固定可打印调色板下的 Voronoi 图参数化伪装,只优化种子点并通过软分配生成类似碎裂迷彩的结构。实验显示,简单框内贴片迁移效果有限,但在 3DPeople 服装分割区域应用时可显著降低行人检测 AP,并能跨背景和 YOLOv9–12 迁移;换调色板会基本削弱攻击,说明效果依赖结构与颜色耦合,物理验证仍未充分说明。

Vision-language models for chest radiography do not always need the image Figure 1
2026-06-17cs.CV

Vision-language models for chest radiography do not always need the image

Mahshad Lotfinia, Sebastian Ziegelmayer, Lisa Adams, Daniel Truhn, Andreas Maier, Soroosh Tayebi Arasteh

2026-06-17视觉语言视觉感知

针对胸片视觉语言模型高准确率是否真的来自读图这一疑问,论文提出基于图像干预的因果审计:遮挡病灶区/无关区、替换同标签他人胸片,并联合多项行为指标区分图像依赖与语言先验。结果显示,纯文本模型距最佳多模态仅差5.7个百分点,9个系统中3个基本不看图、1个不稳定,其余也只在部分发现上选择性接地图像,说明临床部署不能只看准确率。

SegTME-UNI2: A Foundation Model-Based Framework for Generalisable Multiclass Cell Segmentation and LLM-Driven Tumour Microenvironment Characterisation in Histopathology Figure 1
2026-06-17cs.CV

SegTME-UNI2: A Foundation Model-Based Framework for Generalisable Multiclass Cell Segmentation and LLM-Driven Tumour Microenvironment Characterisation in Histopathology

Wan Siti Halimatul Munirah Wan Ahmad, Faris Syahmi Samidi, Mohammad Badal Ahmmed, Vimal Angela Thiviyanathan, Selvam James Thavaraj, Anwar P.P. Abdul Majeed

2026-06-17视觉感知

针对H&E病理图像中细胞分割、TME特征量化与临床可读报告脱节的问题,SegTME-UNI2将UNI2-h基础模型接入双UperNet头,同时做6类语义分割与HV实例分离,并用三阶段伪标签课程把PanNuke监督扩展到160万TCGA-UT补丁,再由结构化TME特征驱动BioNeMo生成叙述。结果主要是内部验证显示可行和一致性,外部基准、消融与临床获益文中尚未充分说明,增益可能主要来自scaling/data。

See First, Answer Later: Visual Evidence Pre-Alignment via Sufficiency-Driven RL Figure 1
2026-06-17cs.CV

See First, Answer Later: Visual Evidence Pre-Alignment via Sufficiency-Driven RL

Yilian Liu, Sicong Leng, Guoshun Nan, Junyi Zhu, Jiayu Huang, Minghao Sun, Xuancheng Zhu, Yisong Chen, Zexian Wei, Xiaofeng Tao

2026-06-17强化学习

这篇论文针对多模态大模型在答题时依赖语言先验、忽视细粒度图像证据的问题,提出在预训练与指令后训练之间加入 VEPA 阶段:先让模型生成与问题相关的视觉证据,再由冻结的“盲读者”LLM用充分性奖励和 GRPO 训练,避免直接泄露答案。实验显示该方法在多类视觉要求高的 VQA、细粒度感知与综合评测上稳定提升,并且增益主要来自更可迁移的视觉 grounding,而非额外任务监督。

Do We Really Need Diffusion? A Fast U-Net for Paired Medical Image Translation Figure 1
2026-06-17cs.CV

Do We Really Need Diffusion? A Fast U-Net for Paired Medical Image Translation

Alicia Pirwass, Birte Glimm, Michael Munz, Hans-Joachim Wilke

2026-06-17视觉感知生成模型

该文针对临床常规T2加权MRI缺少定量脂肪信息、Dixon/SFF采集不普及的问题,研究用配对图像翻译从T2w估计SFF。核心洞察是,在这种空间对齐、近确定性的医学跨模态任务中,轻量4层U-Net并不逊于扩散模型,反而更合适。基于NAKO 23万余张配对2D图像,U-Net在相关性和误差上优于DDPM(r=0.975、MAE=0.014 vs. r=0.962、MAE=0.019),推理速度快208倍,支持实时临床应用。

MambaCount: Efficient Text-guided Open-vocabulary Object Counting with Spatial Sparse State Space Duality Block Figure 1
2026-06-17cs.CV

MambaCount: Efficient Text-guided Open-vocabulary Object Counting with Spatial Sparse State Space Duality Block

Hao-Yuan Ma, Li Zhang, Minjie Qiang, Jie Gao

School of Computer Science and Technology, Soochow University, School of Computer Science and Technology, Soochow University Suzhou China

2026-06-17视觉感知

本文面向文本引导开放词汇计数中高分辨率、密集目标场景的效率瓶颈,指出Transformer二次复杂度和现有Mamba因因果建模、空间token高熵而不利于视觉计数。MambaCount重构Mamba2的状态空间对偶衰减动态,提出S4D与空间Token选择以保留局部高频细节,并用多粒度原型增强图文对齐和可解释性。在FSC-147上,无二次查询方法中取得Test MAE 12.23,同时保持线性复杂度。

Bounding Box Label Propagation for Re-Annotation of Document Layout Analysis Datasets Figure 1
2026-06-17cs.CV

Bounding Box Label Propagation for Re-Annotation of Document Layout Analysis Datasets

Nick Jochum, Tobias Alt-Veit, Christian Schön, Alexander Lück, René Schuster, Didier Stricker

2026-06-17学习理论数据集/基准

工业文档布局数据集会持续扩展且类别体系反复细化,若边界框仍有效,重新标注全部类别代价很高。本文将问题转化为已有框的传导式分类,提出 BBLP:用视觉、文本和位置特征学习统一布局对象嵌入,再做标签传播,为未重标对象生成伪标签。实验显示,仅用 10% 标注数据时,在 D4LA 上训练检测器可达 54.0% mAP,约为全监督性能的 81.6%,说明该方法能显著降低重标成本。

ERQA-Plus: A Diagnostic Benchmark for Reasoning in Embodied AI Figure 1
2026-06-17cs.RO

ERQA-Plus: A Diagnostic Benchmark for Reasoning in Embodied AI

Hong Yang, Basura Fernando

Centre for Frontier AI Research, College of Computing and Data Science, Nanyang Technological University, Singapore

2026-06-17数据集/基准

针对现有 VQA/EQA 基准难以区分真实具身推理与视觉/语言捷径的问题,ERQA-Plus 构建了含 711 张机器人视角图像、1766 个问答的诊断基准,并用感知、动作、社交、导航环境和常识五类推理 taxonomy 及生成-评审-修订-人工验证流程控制质量。实验显示 Qwen3-VL-32B 最高达 83.4% 准确率,但模型在空间、程序、事件预测和意图推断上仍明显薄弱。

Divide, Deliberate, Decide: A Multi-Agent Framework for Fine-Grained Egocentric Action Recognition Figure 1
2026-06-17cs.CV

Divide, Deliberate, Decide: A Multi-Agent Framework for Fine-Grained Egocentric Action Recognition

Alessandro Sottovia, Alessandro Torcinovich, Oswald Lanz

Faculty of Engineering, Free University of Bozen-Bolzano, Bolzano, Italy

2026-06-17视觉感知

面向工业辅助、AR 训练和人机协作中的第一视角细粒度动作识别,论文针对单一 VLM 容易被显著物体误导、忽略细微时序线索的问题,提出本地零样本的“划分—审议—决策”多智能体流程:由编排模型切片并给出候选标签,异构 VLM 专家通过问答审议修正排序,再用 Borda 计数聚合并重排。实验显示其较单模型基线提升零样本识别效果,且增益主要来自异构模型先验去相关,而非单纯增加计算量。

RAVA: Retrieval-Augmented Viewpoint Alignment for Subject-Driven Image Generation Figure 1
2026-06-17cs.CV

RAVA: Retrieval-Augmented Viewpoint Alignment for Subject-Driven Image Generation

Qiwei Yan, Zhiqiang Yuan, Chongyang Li, Jiapei Zhang, Ying Deng, Jinchao Zhang, Jie Zhou

2026-06-17视觉感知

这篇论文关注参考驱动生成中“换主体但保持同视角”的几何失控问题,指出仅靠多图生成器容易把语义相似误当视角一致。RAVA先学习跨实例视角检索表示,再用LogDet选择视角一致且互补的目标参考图,为生成器提供显式几何证据。实验显示通用语义嵌入近似随机,RAVA在视角检索和下游生成上均优于零样本及同骨干检索替代方案。

SkillMoV: Mixture-of-View Routing with Prototype-Conditioned Gating for Unified Multi-View Proficiency Estimation Figure 1
2026-06-17cs.CV

SkillMoV: Mixture-of-View Routing with Prototype-Conditioned Gating for Unified Multi-View Proficiency Estimation

Edoardo Bianchi, Antonio Liotta

2026-06-17视觉感知

本文面向跨活动、多相机的人类技能熟练度估计,针对现有方法依赖场景专模或简单共享多视角聚合、难以适配不同视角的问题,提出 SkillMoV:用 Mixture-of-View 将每个相机特征软路由到专家 MLP,并结合跨视角注意力、类别原型锚定和原型条件门控。在 EgoExo4D 六类技能上,统一模型在 Exos 设置达 50.17% 准确率,较对比最强 Exos 结果高 3.57 个百分点,且仅训练 23.32% 参数。

Flux-Guard: Facial Identity Protection using diffusion models Figure 1
2026-06-17cs.CV

Flux-Guard: Facial Identity Protection using diffusion models

Jie Wang, Tao Wang, Ru Zhang, Jianyi Liu

2026-06-17生成模型

针对社交平台人脸图像在生成式编辑后仍可被人脸识别系统关联追踪的问题,Flux-Guard将文本驱动人脸编辑与身份对抗保护合并到同一扩散生成流程中,通过流轨迹控制、区域掩码速度场融合和感知损失自适应的潜空间对抗优化,在保持编辑语义与自然外观的同时削弱识别特征。实验在CelebA-HQ、LADN及商业API上显示,其跨模型攻击成功率较现有方法更高,并能保留可用的编辑效果。

Test-Time Training for Robust Text-Guided Open-Vocabulary Object Counting Figure 1
2026-06-17cs.CV

Test-Time Training for Robust Text-Guided Open-Vocabulary Object Counting

Hao-Yuan Ma, Yuda Zou, Li Zhang, Yongchao Xu

School of Computer Science and Technology, Soochow University, Wuhan University, School of Computer Science and Technology, Soochow University Suzhou China, Wuhan University Wuhan China

2026-06-17安全鲁棒

面向真实部署中雨雾、低照和传感器噪声会破坏图文对齐、导致开放词汇计数失效的问题,本文提出 Robust-TOOC 基准,并设计 Dual-TTT:冻结原计数网络,仅在测试时用文本引导的轻量去噪模块恢复受污染特征。多种 TOOC 基线上的实验显示,该方法在不同退化类型和强度下均能稳定提升鲁棒计数表现。

MuseVLA: An Adaptive Multimodal Sensing Vision-Language-Action Model for Robotic Manipulation Figure 1
2026-06-17cs.RO

MuseVLA: An Adaptive Multimodal Sensing Vision-Language-Action Model for Robotic Manipulation

Xingyuming Liu, Ruichun Ma, Heyu Guo, Qixiu Li, Qingwen Yang, Lin Luo, Shiqi Jiang, Chenren Xu, Jiaolong Yang, Baining Guo

School of Computer Science, Peking University, Princeton University, Tsinghua University

2026-06-17机器人视觉语言视觉感知

针对多数 VLA 只依赖 RGB、难以感知温度、声音、雷达响应等物理属性的问题,MuseVLA 将传感器视为按需调用的工具:先生成传感器 token 和目标描述,再把异构读数转成接地传感图像以统一融合,并用合成管线降低多传感数据需求。真实灵巧手任务中平均成功率 80.6%,较 RGB-only 和原始热图基线显著提升,未见任务零样本达 66.7%。

TivTok: Broadcasting Time-Invariant Tokens for Scalable Video Tokenization Figure 1
2026-06-17cs.CV

TivTok: Broadcasting Time-Invariant Tokens for Scalable Video Tokenization

Weiliang Chen, Yuanhui Huang, Xuebo Wang, Yueqi Duan

2026-06-17视觉感知

视频生成的计算成本随帧数和 token 数增长,而现有 tokenizer 往往在每帧重复编码背景、外观等持久信息。TivTok 的核心洞察是将视频表示拆成可跨时间复用的 TIV token 与逐帧残差 TV token,并用不同注意力范围的 SIF 诱导分解,再通过 IB 在帧和 chunk 间广播 TIV。实验中其在 16×256×256 上取得 rFVD 12.65,128 帧场景压缩效率较基线提升 2.91×。

Root-Selecting Fixed-Point Inversion for Rectified Flows via Trajectory Straightness Figure 1
2026-06-17cs.CV

Root-Selecting Fixed-Point Inversion for Rectified Flows via Trajectory Straightness

Semin Kim, Jihwan Yoon, Seunghoon Hong

2026-06-17生成模型规划控制

该文针对 rectified flow 反演中固定点方程可能存在多个近似根、仅最小残差会导致重建和编辑质量波动的问题,提出 SelFix:用轨迹直度作为选根准则,并通过带直度锚点的 Halpern 迭代在保持精确固定点反演收敛性的同时偏向更直的逆轨迹。在 FLUX.1-dev 与 PIE-Bench 上,方法改善真实图像重建,并在提示词编辑中更好保留源图像内容。

Geometric Consistency Protocol for Foundation Model Features in Multi-View Satellite Imagery Figure 1
2026-06-17cs.CV

Geometric Consistency Protocol for Foundation Model Features in Multi-View Satellite Imagery

Qiyan Luo, Jie Yang, Yingdong Pi, Lekang Wen, Mi Wang

2026-06-17视觉感知

针对卫星多视角重建中常用无约束 2D 全局匹配会违背 RPC/RFM 曲面、随高度变化的成像几何,论文提出一套几何一致的评测协议:用 RPC 投影的 3D 特征一致性和受几何约束的稠密匹配代理联合衡量基础模型特征。核心洞察是语义相似不等于几何可匹配;在 Omaha、Jacksonville 百余区域测试中,几何约束显著影响评价结论,且强 2D backbone 在该协议下仍可与 3D-aware 模型竞争。

RT-Counter: Real-Time Text-Guided Open-Vocabulary Object Counting Figure 1
2026-06-17cs.CV

RT-Counter: Real-Time Text-Guided Open-Vocabulary Object Counting

Hao-Yuan Ma, Li Zhang, Zhiwei Zhu, Jie Gao

School of Computer Science and Technology, Soochow University

2026-06-17视觉感知

针对文本引导开放词表计数依赖大型视觉语言模型、难以兼顾细粒度空间理解与实时性的瓶颈,RT-Counter用VPT将视觉原型投射到文本特征空间以融合语义与细节,并用Weaformer低成本编织局部/全局特征。在三个数据集上验证其打破精度—速度权衡,FSC147上MAE 13.30、112.48 FPS,较领先方法快7.4倍且参数效率超4倍。

Universal Image Restoration via Internalized Chain-of-Thought Reasoning Figure 1
2026-06-17cs.CV

Universal Image Restoration via Internalized Chain-of-Thought Reasoning

Yu Guo, Zhengru Fang, Shengfeng He, Senkang Hu, Yihang Tao, Phone Lin, Yuguang Fang

2026-06-17视觉感知

针对真实图像中多种退化耦合导致统一修复模型泛化差、逐步 CoT 修复又计算开销高且难建模退化相互作用的问题,论文提出 CoTIR,将“思考-规划-行动”式推理内化到单个基于 FLUX 编辑模型微调的修复框架中,并用拉格朗日式可微软约束编码推理目标;同时构建含 520 万样本的 CoTIR-Bench,实验显示其在复合退化场景中感知质量更强、保真度具竞争力。

TaFD: Threat-Aware Frequency Decoupling for Adversarial Robustness against Heterogeneous Attacks Figure 1
2026-06-17cs.CV

TaFD: Threat-Aware Frequency Decoupling for Adversarial Robustness against Heterogeneous Attacks

Mengda Xie, Yiling He, Meie Fang

School of Computer Science and Cyber Engineering, Guangzhou University, Information Security Research Group, University College London, School of Computer Science and Cyber Engineering, Guangzhou University Guangzhou Guangdong 510006 China, Information Security Research Group, University College London London NW1 2AE United Kingdom

2026-06-17安全鲁棒

针对多威胁对抗训练中ℓp扰动与语义/颜色等攻击相互拖累的问题,TaFD将负迁移解释为梯度不兼容,并利用不同攻击在频域中的可分谱特征进行解耦:先聚类攻击频谱原型识别潜在威胁域,再用频率条件卷积为不同域分配专家和谱掩码。在CIFAR-10/100、Tiny-ImageNet及ResNet、MobileViT上,平均鲁棒准确率较最强基线提升约11%,同时保持较高干净准确率。

Reinforcing Dual-Path Reasoning in Spatial Vision Language Models Figure 1
2026-06-17cs.CV

Reinforcing Dual-Path Reasoning in Spatial Vision Language Models

Yatai Ji, An-Chieh Cheng, Yang Fu, Yukang Chen, Han Zhang, Zhaojing Yang, Wei Huang, Ka Chun Cheung, Song Han, Vidya Nariyambut Murali, Pavlo Molchanov, Jan Kautz, Simon See, Hongxu Yin, Ping Luo, Sifei Liu

The University of Hong Kong, University of California, San Diego

2026-06-17视觉感知

本文针对空间VLM虽能感知几何却难以完成多步深度、距离与场景关系推理的问题,提出SR-ReaL:在同一模型中联合训练语言链式推理LOR与先3D定位再推理DTR,并通过冷启动混合监督、region-to-3D接口和GRPO奖励优化两条路径。实验显示其在多类空间基准上优于空间VLM基线,DTR更利于区域对象任务,联合训练带来互补增益且无需逐任务调参。

OmniDrive: An LLM-Choreographed Multi-Agent World Model with Unified Latent Co-Compression for Multi-View Driving Video Generation Figure 1
2026-06-17cs.CV

OmniDrive: An LLM-Choreographed Multi-Agent World Model with Unified Latent Co-Compression for Multi-View Driving Video Generation

Zijie Meng, Yufei Liu, Chengqian Ma, Zhiyu Li, Jiyuan Liu, Wenhua Nie, Bingcai Wei, Shuqin Chen, Weichen Xu, Jiquan Yuan, Miao Zhang

Peking University, Xiamen University, Korea Advanced Institute of Science and Technology (KAIST), National Taiwan University, Wuhan University, Wuhan University of Technology, Tsinghua University, Jimei University

2026-06-17视觉感知强化学习

OmniDrive针对自动驾驶视频生成中语义提示、地图/轨迹等几何控制割裂,以及多相机后融合导致的跨视角漂移问题,提出由Qwen2.5-VL多智能体生成WorldScript、布局与审计信号,并通过视角-时间置换把RGB和几何布局在3D VAE中共同压缩到统一位置 token 网格。nuScenes上其跨视角一致性、BEV mAP达SOTA,FVD为45.7,纯合成数据训练检测器在真实验证集提升2.4 NDS。

GASE: Gaussian Splatting-Based Automated System for Reconstructing Embodied-Simulation Environments Figure 1
2026-06-17cs.RO

GASE: Gaussian Splatting-Based Automated System for Reconstructing Embodied-Simulation Environments

Jiawei Zhang, Yiming Yan, Chao Liang, Nuo Xu, Seson Sun, Qichen Zhang, Yuhao Xu, Yantai Yang, Yingqiao Wang, Qin Jin, Zhipeng Zhang

2026-06-17三维

面向具身智能训练中真实数据昂贵、现有重建式仿真场景采集慢且前景物体分离差的问题,GASE用全景相机阵列多视频流快速扫描,并基于相机位姿在2D域结合提示/跟踪完成跨帧物体提取与背景修复,再分别用3DGS和TRELLIS重建背景与物体。实验显示其分割准确率较3D Gaussian方法高10%以上,修复质量领先,真实机器人操纵和导航中与纯真实数据训练的性能差距小于10%。

MagicSim: A Unified Infrastructure for Executable Embodied Interaction Figure 1
2026-06-17cs.RO

MagicSim: A Unified Infrastructure for Executable Embodied Interaction

Haoran Lu, Songling Liu, Yue Chen, Guo Ye, Mutian Shen, Shuyang Yu, Yu Xiao, Jihai Zhao, Shang Wu, Jianshu Zhang, Xiangtian Gui, Chuye Hong, Yuran Wang, Maojiang Su, Jiayi Wang, Ruihai Wu, Zhaoran Wang, Han Liu

2026-06-17视觉感知

MagicSim针对机器人学习中控制、技能与高层规划被割裂,常依赖“魔法动作”且难以复现实验的问题,提出以确定性批量运行时和共享MDP为核心的具身交互基础设施。其创新在于用YAML规格统一构建多物理世界,并通过Command-Skill-Planner-Robot-Record链路把语言命令落到真实机器人动作,同时支持基准/RL评测、自动轨迹采集和VLM交互。结果上展示了多形态、多任务长时序交互与同步多模态记录能力,但定量性能增益文中未充分说明。

Two-Stage Fine-Tuning of ResNet50 for High-Sensitivity Melanoma Detection on Dermoscopic Images Figure 1
2026-06-17eess.IV

Two-Stage Fine-Tuning of ResNet50 for High-Sensitivity Melanoma Detection on Dermoscopic Images

Aryan Bhagat

MS Computer Science, Florida Atlantic University, Boca Raton, FL, publicly available at https://github.com/Aryanbhagat23/melanoma-detection.

2026-06-17视觉感知

针对皮肤镜黑色素瘤筛查中类别不均衡易漏诊、单阶段迁移学习敏感性不足的问题,论文采用ResNet50两阶段微调:先冻结骨干训练分类头,再以低学习率全网微调,并仅在训练集过采样和对齐推理预处理。在HAM10000独立测试集3826图像上,AUC达0.9559,准确率88.34%,敏感性87.56%、特异性89.13%,消融显示敏感性较单阶段提升约4.21%;但外部临床泛化仍文中未充分说明。

No Figure
2026-06-17cs.CV

SPHINX: First Explain, Then Explore

Nguyen Do, Tue M. Cao, Tien Van Do, András Hajdu, Tamás Bérczes, My T. Thai

N. Do, T. Cao, and My T. Thai are with the University of Florida, Gainesville, T. V. Do is with the Budapest University of Technology and Eco-, nomics, Department of Networked Systems and Services, Budapest, Hungary, A. Hajdu and T. Bérczes are with the University of Debrecen, Debrecen

2026-06-17视觉感知

本文针对自动驾驶仿真中对抗场景生成常依赖 LLM/VLM 先验、难以对准特定策略失效机制的问题,提出 SPHINX:先用概念解释、不确定性、时序控制和参与者遥测诊断策略为何失败,再由 VLM/LLM 生成针对性场景用于闭环再训练。文中称其能给出可解释失败归因,并在多种自动驾驶架构和测试集上相比既有场景生成方法带来更稳定的鲁棒性提升。

GeneralVLA-2: Geometry-Aware Reconstruction and Governed Memory for Robot Planning Figure 1
2026-06-17cs.CV

GeneralVLA-2: Geometry-Aware Reconstruction and Governed Memory for Robot Planning

Haoyu Wang, Guoqing Ma, Zeyu Zhang, Yandong Guo, Boxin Shi, Hao Tang

School of Computer Science, Peking University

2026-06-17机器人规划控制三维

论文针对层级式 VLA 机器人规划中两类不可靠输入:单目物体重建易幻觉几何、经验记忆仅按语义检索而缺少质量控制。GeneralVLA-2用 GeoFuse-MV3D 引入经掩码验证的多视角几何先验、软视觉壳与保外观的几何融合,并将 KnowledgeBank 改为带质量、置信度、生命周期和冲突元数据的治理式长期记忆。实验显示其在 GSO-30 上小幅改善 CD、PSNR、SSIM、LPIPS,在 Terminal-Bench 与 SWE-Bench 上优于 ReasoningBank,但重建增益较保守。

Theoretical Grounding of Out-Of-Distribution Detection With Reinforcement Learning Optimizer Figure 1
2026-06-17cs.CV

Theoretical Grounding of Out-Of-Distribution Detection With Reinforcement Learning Optimizer

Salimeh Sekeh, Xin Zhang

San Diego State University

2026-06-17视觉语言视觉感知强化学习

本文针对移动机器人等开放环境中分布持续漂移导致 OOD 检测逐步退化的问题,指出只优化当前损失会破坏未来的 ID/OOD 能量分离。核心做法是在梯度下降中加入由 TD 学习价值函数提供的可微修正项,使更新方向偏向降低长期语义 OOD 误报率。论文主要给出时间误差分解、梯度对齐与能量桥接等理论结果,证明在结构假设下较 GD 可降低未来域泛化误差和 FPR;实证细节在片段中未充分说明。

StereoFactory: A Unified Merging Framework for Robust Stereo Matching Figure 1
2026-06-17cs.CV

StereoFactory: A Unified Merging Framework for Robust Stereo Matching

Xianda Guo, Pinhan Fu, Ruilin Wang, Wenke Huang, Mang Ye, Qin Zou

Xianda Guo is with the School of Computer Science, Wuhan University, Wuhan, China, and also with D-Star Robotics, Beijing, China., Pinhan Fu, Mang Ye, and Qin Zou are with the School of Computer Science, Wuhan University, Wuhan, China., Ruilin Wang is with the Institute of Automation, Chinese Academy of Sciences, Beijing, China, and also with D-Star Robotics, Beijing, China., Wenke Huang is with the College of Computing and Data Science, Nanyang Technological University, Singapore.

2026-06-17安全鲁棒

针对立体匹配基础模型在新增数据时需昂贵联合重训、而简单合并全部专用模型会引入任务向量干扰的问题,StereoFactory将合并拆成遗传算法筛选模型子集与CMA-ES模块级路由/缩放两步,强调不同网络模块偏好的知识源不同。在NMRF和FoundationStereo、四个基准上,其平均误差分别优于最强受控基线,且后处理搜索仅约为联合重训时间的2.7–3.7%。

WeaveLA: Event Driven Cross-Subtask Latent Memory Weaving for Repetitive Robot Manipulation Figure 1
2026-06-17cs.CV

WeaveLA: Event Driven Cross-Subtask Latent Memory Weaving for Repetitive Robot Manipulation

Shoujing Zhu, Zhenyang Liu, Fungmiu Wang, Jiafeng Wang, Bo Yue, Guiliang Liu, Simo Wu, Xiangyang Xue, Taiping Zeng

Fudan University, School of Data Science, The Chinese University of Hong Kong, Shenzhen, Shanghai Innovation Institute, Shenzhen Loop Area Institute

2026-06-17机器人

这篇论文针对短窗口 VLA 在重复操作中缺少跨子任务状态传递、容易忘记已完成步骤的问题,提出 WeaveLA:在子目标完成事件触发时,用查询注意力将刚完成片段压缩为 8 个潜在记忆 token,并直接注入下一子任务的动作专家,且冻结主干。基于 π0.5 在 RoboMME 上,SwingXtimes N=3 成功率从 0% 提升到 47.8%,N=1 基本不变,说明增益主要来自需要跨子任务记忆的场景。

MODE-RAG: Manifold Outlier Diagnosis and Energy-based Retrieval-Augmented Generation Evaluation Figure 1
2026-06-17cs.CL

MODE-RAG: Manifold Outlier Diagnosis and Energy-based Retrieval-Augmented Generation Evaluation

Zehang Wei, Jiaxin Dai, Jiamin Yan, Xiang Xiang

School of Computer Science & Tech, Huazhong University of Science and Technology, School of AI and Automation, Huazhong University of Science and Technology, China

2026-06-17数据集/基准

该文针对多模态 RAG 在视觉问答中易受跨模态冲突、因果编造和迎合式回答影响的问题,提出 MODE-RAG:用 VFE 与内部注意力状态做风险路由,只对高风险样本触发五代理流水线,并结合视觉优先检索、MCTS 因果图、logit 扰动和事后监督校验。作者还从 MultiVent 构造 ModeVent 基准;实验显示总体评分从 4.40 提升到 5.45,外点场景增益更明显。

AnnotateAnything: Automatic Annotation of 3D Assets for Robot Manipulation Figure 1
2026-06-17cs.RO

AnnotateAnything: Automatic Annotation of 3D Assets for Robot Manipulation

Haoran Lu, Mutian Shen, Shuyang Yu, Yu Xiao, Songling Liu, Jianshu Zhang, Shang Wu, Yue Chen, Guo Ye, Jiayi Wang, Zhaoran Wang, Han Liu

Northwestern University, Peking University

2026-06-17机器人三维

该文针对仿真中大量原始3D资产只有几何外观、缺少可执行操作语义这一数据瓶颈,提出 AnnotateAnything:先用VLM抽取人类交互先验并定位 affordance、关键点和部件,再通过大规模并行物理管线进行候选生成、几何优化、轨迹生成与验证,产出抓取、灵巧接触、关节操作、插入、悬挂和导航等标签。实验显示其在标注效率、数据采集效率和任务成功率上优于现有流程,并可支撑 affordance 检测、机器人VQA和视觉指令微调。

Contact-Based Fringe Projection Profilometry for High-Resolution 3-D Surface Measurement of Reflective and Transparent Objects Figure 1
2026-06-17cs.CV

Contact-Based Fringe Projection Profilometry for High-Resolution 3-D Surface Measurement of Reflective and Transparent Objects

Ingu Yeo, Hyung-Gun Chi, Jae-Sang Hyun

2026-06-17视觉感知

针对传统条纹投影难测反光/透明物体、GelSight 依赖法线积分导致绝对深度误差和大面积标定困难的问题,论文把数字条纹投影引入覆灰反射涂层的硅胶接触界面,通过相移、Gray 编码和相机-投影仪三角测量直接恢复每像素 3D 形状。实验与 GelSight Mini、常规 DFP 及球拟合/不确定度分析比较,显示其在金属和透明样件上缺失更少、深度更稳定,尺寸结果接近卡尺测量。

Spatio-Temporal Fusion Model for Standard View Classification of Echocardiographic Videos Figure 1
2026-06-17cs.CV

Spatio-Temporal Fusion Model for Standard View Classification of Echocardiographic Videos

Bo Gou, Jicheng Zhang, Jianlong Xiong, Tao He, Bentian Liu, Hai Wu, Yijiao Wang, Yu Zhang, Yujia Yang, Yun Dai, Jian Liu, Jie Wang

2026-06-17视觉感知

针对超声心动图标准切面自动识别中公开视频数据少、单帧外观相似且视频帧质量不均的问题,论文发布EV9V数据集,并提出双流CNN-LSTM的STFM,用不确定性感知采样和证据融合强化时空信息利用。实验在CNN、RNN、Transformer等架构上建立基准,显示STFM具备有竞争力表现;具体相对增益和主要来源在给定片段中未充分说明。

UoU: A Universal Fingerprint Foundation Model Based on Large-Scale Unsupervised Learning Figure 1
2026-06-17cs.CV

UoU: A Universal Fingerprint Foundation Model Based on Large-Scale Unsupervised Learning

Xiongjun Guan, Jianjiang Feng, Jie Zhou

2026-06-17视觉感知

针对指纹识别仍依赖增强、结构解析、对齐、匹配等割裂流水线、跨传感器与低质样本迁移受限的问题,UoU将指纹特征抽取重构为领域基础模型:用图像、方向场、语义 token、细节点和全局描述的层级表示,结合少量精标冷启动、弱监督扩展与无监督迭代巩固,并利用脊线周期性和空间等变等指纹先验。论文给出一个基于 Transformer 的结构预测原型和开源基线,但下游匹配、增强等统一评测结果文中未充分说明,实际增益可能主要来自 scaling / data。

LADBench: A Benchmark for Logical Fault Detection in Images Figure 1
2026-06-17cs.CV

LADBench: A Benchmark for Logical Fault Detection in Images

Sahasra Kondapalli, Lara Radovanovic, Aadi Palnitkar, Mingyang Mao, Xiaomin Lin

2026-06-17视觉感知数据集/基准

面向家庭摄像头、具身机器人等开放场景,作者指出现有异常检测基准多考察视觉瑕疵或显式规则,难以衡量VLM是否能主动发现违背物理/社会常识的逻辑故障。LADBench构建千余张四类合成异常图像,并用分层提示与衰减加权评分衡量模型需要多少提示才定位问题。实验显示最优模型总体准确率仅70.11%,且深层提示后仍会漏检,说明当前多模态模型的隐式逻辑故障检测仍不可靠。

Edit3DGS: Unified Framework for Dynamic Head Editing via 2D Instruction-Guided Diffusion and 3D Gaussian Splatting Figure 1
2026-06-17cs.GR

Edit3DGS: Unified Framework for Dynamic Head Editing via 2D Instruction-Guided Diffusion and 3D Gaussian Splatting

Duy-Dat Tran, Trung-Nghia Le

2026-06-17生成模型三维

针对动态 3DGS 头部头像难以用文本稳定编辑、易出现跨视角不一致和身份漂移的问题,Edit3DGS 将指令引导的 2D 扩散编辑与高斯拟合闭环结合,并用多视角批量编辑和自动掩码补全约束时序表情。NeRSemble 实验显示其在新视角、重演等任务中能生成较平滑逼真的编辑结果,CLIP 文本对齐相较 GaussianAvatar-Editor 具竞争力或更优。

Visual Retrieval-Augmented Generation for Silhouette-Guided Animal Art Figure 1
2026-06-17cs.CV

Visual Retrieval-Augmented Generation for Silhouette-Guided Animal Art

Quoc-Duy Tran, Anh-Tuan Vo, Trung-Nghia Le

2026-06-17视觉感知

论文针对生成模型难以从云、石头等自然轮廓中自主“看出”动物意象的问题,提出 Visual-RAG:先用形状标准化、Shape Context 与 RANSAC 在 2.86 万动物剪影库中检索结构相近样例,再用 ControlNet 和 IP-Adapter约束轮廓并迁移外观。消融显示几何对齐比速度更关键,去除标准化内点率降至 13.4%;用户研究表明结果具备可解释性和形状一致性,但审美冲击力仍有限。

CIAN: Multi-Stage Framework for Event-Enriched Image Captioning via Retrieval-Augmented Generation Figure 1
2026-06-17cs.CV

CIAN: Multi-Stage Framework for Event-Enriched Image Captioning via Retrieval-Augmented Generation

Trinh Thi Thu Hien, Trung-Nghia Le

2026-06-17视觉语言视觉感知

针对传统图像描述只依赖像素、难以说明事件时间地点、人物身份与背景的问题,CIAN把任务改造成检索增强的事件叙事生成:先用SigLIP检索相关新闻并做数据对齐,再以摘要引导LoRA微调Qwen生成,最后用N-gram润色。OpenEvents-V1上检索mAP达0.979、Recall@1为0.969,CIDEr由0.030升至0.094;但失败分析显示实体落地和图文融合仍弱,部分增益可能来自数据清洗。

Impact of Hand Impairment and Occlusions on Hand Pose Estimation Accuracy in Augmented Reality Applications Figure 1
2026-06-17cs.CV

Impact of Hand Impairment and Occlusions on Hand Pose Estimation Accuracy in Augmented Reality Applications

Damian M. Manzone, Mathew Szymanowski, Olga Taran, Shuo Cai, Melissa Marquez-Chin, Tammy Zeng, Hardeep Singh, Cesar Marquez-Chin, José Zariffa

the Research Ethics Board of the University Health Network under

2026-06-17三维

面向AR手功能康复,论文关注颈髓损伤者异常手姿与真实物体遮挡是否会削弱手部三维姿态估计。研究用HoloLens 2与WiLoR、HaMeR等方法,在清晰/不透明物体交互中以多相机三角化作真值评测。结果显示损伤组与健康组精度无显著差异,透明物体仅带来约0.1 mm小幅优势,WiLoR和HaMeR较HoloLens 2约优2 mm,支持其在康复场景中的可用性。

Enhancing Pathological VLMs with Cross-scale Reasoning Figure 1
2026-06-17cs.CV

Enhancing Pathological VLMs with Cross-scale Reasoning

Chi Phan, Tianyi Zhang, Qiaochu Xue, Yufeng Wu, Dan Hu, Zeyu Liu, Sudong Wang, Yueming Jin

2026-06-17视觉语言

病理诊断需要在低倍组织结构与高倍细胞形态间来回验证,而现有病理 VLM 多按单尺度训练评测,容易缺少跨尺度证据链。本文提出跨尺度 VQA 范式,并用文本泄漏筛查与约束式问题设计构建 Scale-VQA,减少只看题干猜答案的捷径;再以强化学习训练 ScaleReasoner-R1。结果显示其在跨尺度基准和若干单图病理 VQA 上达到 SOTA,说明少量高质量跨尺度监督可提升病理理解,但具体增益中数据质量与 RL 的贡献仍需进一步拆分。

Attention Alignment Between Humans and Vision-Language Models Figure 1
2026-06-17cs.CV

Attention Alignment Between Humans and Vision-Language Models

Isaac R. Christian, Udith Haputhanthrige, Hanna Hornfeld, Declan Campbell, Samuel Nastase, Taylor Webb, Michael Graziano

Princeton Neuroscience Institute, Princeton University, Department of Psychology, Princeton University, Department of Computer Science, Princeton University, Department of Psychology and Center for Computational Language Sciences, University of Southern California, Department of Psychology, Université de Montréal

2026-06-17视觉语言视觉感知

该文关注视觉语言模型的注意力是否能解释人类在不同任务中的注视位置,并通过控制训练分布、交叉比较 CNN/ViT 编码器与 LSTM/Transformer 解码器来拆分自下而上表征和自上而下注意机制的作用。核心发现是解码器比编码器更决定人类对齐:LSTM 注意力虽更弥散、任务适应性弱,却达到人类噪声上限的 80–87%;Transformer 更集中且抗消融,但仅 40–59%。同时,注视对齐与合成神经预测出现分离,说明“像人看哪里”和“像脑表征什么”不可简单等同。

Where Should Action Generation Begin? A Learnable Source Prior for Generative Robot Policies Figure 1
2026-06-17cs.RO

Where Should Action Generation Begin? A Learnable Source Prior for Generative Robot Policies

Meipo Dai, Qiyuan Zhuang, He-Yang Xu, Ying-Jie Shuai, Yijun Wang, Qi Dou, Xiu-Shen Wei

Southeast University, The Chinese University of Hong Kong

2026-06-17机器人生成模型

本文针对生成式机器人策略默认从与观测无关的标准高斯噪声开始、导致生成器需额外“搬运”到可行动作区域的问题,提出可学习源先验 LeaP:用本体状态条件化的轻量 MLP 预测动作块对角高斯的均值与状态自适应方差,在不改生成器和求解器的情况下提供有信息且随机的初始化。实验显示其在 15 个 RoboTwin 操作任务平均成功率达 81.6%,较 A2A、VITA、无先验和 BridgePolicy 高 6.5–25.5 个百分点,并可迁移到 flow matching 与 diffusion-bridge 生成器及真实部署。

Graph Neural Networks for Semi-Supervised Image Classification with Multi-Feature Aggregation Figure 1
2026-06-17cs.CV

Graph Neural Networks for Semi-Supervised Image Classification with Multi-Feature Aggregation

Marina Chagas Bulach Gapski, Vinicius Atsushi Sato Kawai, Gustavo Rosseto Leticio, Lucas Pascotti Valem, Daniel Carlos Guimarães Pedronette, Mohand Said Allili

2026-06-17视觉感知

针对图像半监督分类中标注稀缺且单一特征提取器信息有限的问题,论文利用 GNN/GCN 同时接收特征与图结构的特点,融合来自 CNN、ViT 等多种提取器的特征和样本图,并用流形学习重排序与 rank aggregation 改善图构建。实验显示,多特征/多图组合在多数设置下提升分类精度,且 GCN 对输入图质量比对特征本身更敏感。

Bridging Spatial And Frequency Views For Disaster Assessment: Benefits And Limitations Figure 1
2026-06-17cs.CV

Bridging Spatial And Frequency Views For Disaster Assessment: Benefits And Limitations

Shikha V. Chandel, Yadav Raj Ghimire, Timothy Agboada, Leila Hashemi-Beni

2026-06-17模仿学习

面向灾后卫星图像中建筑损伤快速分级,论文关注仅依赖空间纹理可能漏掉坍塌纹理、碎片等高频线索的问题,在相同 EfficientNet-B0 和训练设置下对比空间域、傅里叶频域及双域融合。结果显示双域空间配置取得最高测试准确率 0.4688,但空间单域的宏 F1 更好为 0.4254;频域单独使用最差且过拟合,说明频率信息有补充价值但不能独立解决类别不均衡和轻微损伤难判问题。

Visuals Lie, Consistency Speaks: Disentangling Spatial Attention from Reliability in Vision-Language Models Figure 1
2026-06-17cs.CV

Visuals Lie, Consistency Speaks: Disentangling Spatial Attention from Reliability in Vision-Language Models

Logan Mann, Yi Xia, Ajit Saravanan, Ishan Dave, Saadullah Ismail, Shikhar Shiromani, Emily Huang, Ruizhe Li, Kevin Zhu

University of California, Santa Barbara, University of California, Berkeley

2026-06-17视觉语言视觉感知

面向高风险场景中视觉语言模型幻觉与可信度评估,本文质疑“注意力越集中越可靠”的常见假设,提出 VRP 跨模型分析框架,将空间注意力结构、生成自一致性与隐藏状态探针分离比较。结果显示注意力聚类/熵与正确性几乎无关(R≈0.001),自一致性更能预测真值(R=0.429),隐藏状态探针 AUROC 可超 0.95;同时揭示 LLaVA 依赖脆弱晚期瓶颈,而 PaliGemma、Qwen2-VL 的可靠性表征更分布式。

TerraTransfer: Learning End-to-End Driving Policies Without Expert Demonstrations Figure 1
2026-06-17cs.CV

TerraTransfer: Learning End-to-End Driving Policies Without Expert Demonstrations

Zikang Xiong, Weixin Li, Zhouchonghao Wu, Akshay Rangesh, Saarth Bonde, Grantland Hall, Chen Tang, Yihan Hu, Wei Zhan

2026-06-17模仿学习

针对端到端自动驾驶依赖大规模专家示范、图像闭环 RL 成本高的问题,TerraTransfer 将“学会驾驶”和“学会看见”解耦:先在向量化仿真中用多智能体自博弈训练教师规划头,再用动作 KL 与低秩批关系结构损失把预训练视觉骨干对齐到教师,仅需成对图像/场景状态而非轨迹标签。在 3D Gaussian splatting 闭环场景中,图像策略接近自博弈教师,并在 aggregate HD-Score 上超过模仿学习基线。

Improving and Evaluating Hand-Object Interaction Detection Figure 1
2026-06-17cs.CV

Improving and Evaluating Hand-Object Interaction Detection

Ahmad Darkhalil, Dima Damen, David Fouhey

2026-06-17视觉感知

手与物体交互检测是动作理解、三维重建和机器人操作的前置能力,但传统检测难以按交互状态区分“直接接触物”“工具作用对象”并建立链接。本文在 Co-DETR 上加入手-物、物-物交互建模,提出 HOI-DETR,并整理 Hands23、HOIST、FineBio、HD-EPIC 等图像/视频评测与新标注。实验显示其在多个基准显著优于既有方法,Hands23 和 FineBio 的 mAP 提升超过 20 个百分点。

MeiBRD: Meta-Learning Intraoperative Biomechanical Residual Deformation Figure 1
2026-06-17cs.CV

MeiBRD: Meta-Learning Intraoperative Biomechanical Residual Deformation

Casey Meisenzahl, Jon Heiselman, Michael Holtz, Yubo Ye, Michael Miga, Linwei Wang

2026-06-17视觉感知

针对腹腔镜肝切除中软组织大形变而术中测量稀疏,传统线性生物力学有偏、纯数据驱动泛化差的问题,MeiBRD不直接学全场形变,而将线性模型残差表示为带几何感知注意力的图神经扩散函数,并把稀疏对应点视作上下文样本进行前馈元学习快速适配。在可变形肝脏模型数据上,相比刚性ICP、生物力学和数据驱动基线取得更低配准误差,尤其在分布外几何和形变上更稳;但验证仍限于phantom数据。

Contactless Respiratory Monitoring on Heterogeneous Mobile Robots: A Multimodal Edge-Computing Framework Figure 1
2026-06-17cs.RO

Contactless Respiratory Monitoring on Heterogeneous Mobile Robots: A Multimodal Edge-Computing Framework

Milind Rampure, Shadman Sakib, Haley Patel, Zahid Hasan, Nirmalya Roy

2026-06-17机器人视觉语言

面向灾害救援、远程分诊等不宜接触伤员的场景,论文提出在异构移动机器人上运行的无接触呼吸率监测框架:按亮度在 RGB、热成像、近红外和低照度相机间自适应选择,用人体关键点定位胸部 ROI,并以 SQI 过滤低质量信号。三类机器人实验显示无需逐平台调参即可迁移;RGB 最远约 8 米,NIR 约 6 米,热成像仅适合近距,低照度相机可在全黑下到 8 米。

DriveJudge: Rethinking Autonomous Driving Evaluation with Vision-Language Models Figure 1
2026-06-17cs.CV

DriveJudge: Rethinking Autonomous Driving Evaluation with Vision-Language Models

Xinglong Sun, Kevin Xie, Jenny Schmalfuss, Despoina Paschalidou, Xiuming Zhang, Sanja Fidler, Kashyap Chitta, Jose M. Alvarez

2026-06-17视觉语言视觉感知数据集/基准

面向端到端自动驾驶在长尾场景中难以被可靠评估的问题,论文指出纯规则指标缺少语境、纯 VLM 评估又缺少物理约束。DriveJudge 让 VLM 先理解场景并选择调用碰撞、车道偏离等确定性规则函数,以兼顾可解释性和上下文感知;作者还构建 33,577 个带人工合理性标注的困难样本,并提出质量分类与轨迹偏好基准。结果显示其相较 EPDMS 提升 21.23 AUC、相较 DriveCritic 提升 6.5% 偏好选择准确率。

Complex Layout Classification in the Wild: A Low-Resource Approach with Layout-Preserving Augmentations Figure 1
2026-06-17cs.CV

Complex Layout Classification in the Wild: A Low-Resource Approach with Layout-Preserving Augmentations

Sharva Gogawale, Iddo Hakim, Gal Grudka, Mohammad Suliman, Omer Ventura, Daria Vasyutinsky-Shapira, Berat Kurar-Barakat, Nachum Dershowitz

2026-06-17视觉感知

面向历史/低资源文献中噪声大、标注少且版式非规则导致OCR与分割易失败的问题,论文构建155页希伯来复杂版式数据集,并将页面按分隔区域划为8类。核心做法是在CNN训练中用窄各向异性高斯遮蔽弱化文字细节、保留分隔几何,再结合镜像引起的标签变换扩充样本。实验显示,这类版式保持增强在极少标注下能明显提升页级版式分类,并包含骨干、消融和外部盲测评估。

MM++: Unsupervised Scale-Invariant Multilayer OOD Detection via Top-K Gated Feature Fusion Figure 1
2026-06-17cs.LG

MM++: Unsupervised Scale-Invariant Multilayer OOD Detection via Top-K Gated Feature Fusion

Rahim Hossain, Md Tawheedul Islam Bhuian, Md Farhan Shadiq, Kyoung-Don Kang

School of Computing, State University of New York at Binghamton

2026-06-17视觉感知

针对深度视觉模型在开放环境中对分布外样本过度自信、且现有多层 Mahalanobis 方法忽略跨层依赖的问题,MM++用熵密度下降选择信息层,将归一化中间层与末层特征联合建模,并用 Ledoit–Wolf 协方差稳定距离估计;无需 OOD 数据或微调,在 ViT、Swin、ConvNeXt及 ImageNet-LT 场景中表现稳健,长尾近 OOD 平均 AUROC 领先。

Bayesian Magnetic Resonance Joint Image Reconstruction and Uncertainty Quantification using Sparsity Prior Models and Markov Chain Monte Carlo Sampling Figure 1
2026-06-17cs.CV

Bayesian Magnetic Resonance Joint Image Reconstruction and Uncertainty Quantification using Sparsity Prior Models and Markov Chain Monte Carlo Sampling

Ahmed Karam Eldaly, Matteo Figini, Daniel C. Alexander

Department of Computer Science, University of Exeter, North Park Road, Exeter EX4 4QF, United Kingdom, UCL Hawkes Institute, Department of Computer Science, University College London, London, United Kingdom

2026-06-17视觉感知强化学习三维安全鲁棒

针对欠采样 MRI 重建虽能加速采集、但缺少可信不确定性评估的问题,论文把压缩感知重建写成贝叶斯线性逆问题,并在任意稀疏基上保留 TV/小波等先验,通过 split-and-augmented Gibbs 与 proximal MCMC 联合采样图像和参数。单线圈、多线圈及多种 k-space 采样实验显示,重建优于对应优化法,且不确定性图与真实误差图相关性更高。

Learning a Maximum Entropy Model for Visual Textures using Diffusion Figure 1
2026-06-17cs.CV

Learning a Maximum Entropy Model for Visual Textures using Diffusion

Xinyuan Zhao, Eero P. Simoncelli

New York University, New York University & Flatiron Institute

2026-06-17生成模型

针对传统视觉纹理模型依赖手工统计量或物体识别预训练特征的问题,本文用扩散去噪训练最大熵纹理模型,无监督学习约束分布的512维统计量,并比较条件扩散采样与统计匹配采样。实验显示其生成质量达到或优于Gatys模型,9类中8类FID更好,且表示空间线性插值能产生更均匀平滑的过渡纹理。

Geometry-Consistent Endoscopic Representations for Image-Guided Navigation via Structured Foundation Model Adaptation Figure 1
2026-06-17cs.CV

Geometry-Consistent Endoscopic Representations for Image-Guided Navigation via Structured Foundation Model Adaptation

Hongchao Shu, Roger D. Soberanis-Mukul, Hao Ding, Morgan Ringel, Mali Shen, Saif Iftekar Sayed, Hedyeh Rafii-Tari, Mathias Unberath

Science, Johns Hopkins University, Baltimore, MD 21211 USA. He is

2026-06-17机器人视觉感知

针对单目内镜导航中深度线索弱、组织纹理少且跨设备/术式域移严重导致位姿和深度估计不稳的问题,论文用合成内镜数据提供几何监督,并提出 HGSA:在 ViT 层级中选择性加入低秩适配器,以中层几何对应和深层语义一致共同约束表示。实验显示其提升几何/语义表征质量,改善位姿优化和单目深度估计,并在支气管镜合成到真实、鼻窦镜和结肠镜少样本迁移中表现较好。

FATE: Pillar Encoding and Frequency-Aware Training for Event-Based Object Detection Figure 1
2026-06-17cs.CV

FATE: Pillar Encoding and Frequency-Aware Training for Event-Based Object Detection

Md Tawheedul Islam Bhuian, Kyoung-Don Kang

School of Computing, State University of New York at Binghamton

2026-06-17视觉感知

本文针对事件相机目标检测中常见的时间分箱会丢失细粒度动态、且低频标注限制高频推理的问题,提出 FATE:用 Pillar Encoding 将空间柱内事件投影到连续时间正交多项式基,避免内部子分箱;再用频率感知训练生成稠密伪标签并做 mean-teacher 课程学习。实验称其在多种架构和基准上优于强基线,可支持最高 200Hz 检测,额外参数少于 0.15M、端到端延迟约增 1%。

ProCUA-SFT Technical Report Figure 1
2026-06-17cs.LG

ProCUA-SFT Technical Report

Jaehun Jung, Ximing Lu, Brandon Cui, Muhammad Khalifa, Shaokun Zhang, Hao Zhang, Jin Xu, Amala Sanjay Deshmukh, Karan Sapra, Andrew Tao, Yejin Choi, Jan Kautz, Mingjie Liu, Yi Dong

2026-06-17视觉感知

针对桌面计算机使用智能体缺少高质量大规模轨迹、AgentNet 微调反而负迁移的问题,ProCUA-SFT 用单一 VLM 在真实内容填充的桌面中生成任务、做二值前置条件校验并执行轨迹,再扩展为 step-prefix SFT 样本。数据含 93K 合成轨迹、3.1M 样本;UI-TARS 7B 训练一轮后 OSWorld 达 45.0%,较基座提升 18.7 个百分点,显著优于 AgentNet 微调。

SierpinskiCam: Camera-Controlled Video Retaking with Sierpinski Triangle Pattern Cues Figure 1
2026-06-17cs.CV

SierpinskiCam: Camera-Controlled Video Retaking with Sierpinski Triangle Pattern Cues

Suttisak Wizadwongsa, Hyelin Nam, Supasorn Suwajanakorn, Jeong Joon Park

University of Michigan, Ann Arbor

2026-06-17视觉感知规划控制

本文面向单目视频重拍中目标相机远离原轨迹时几何引导稀疏、源视频外观难以保持的问题。核心做法是在几何代理的空洞区域加入 Sierpinski 分形纹理穹顶,提供跨尺度可跟踪的运动线索,并用负 RoPE 将源视频 token 与目标 token 位置解耦,无需改模型或逐视频微调。实验显示其在相机可控性、几何一致性和视频质量上优于既有方法,用户偏好提升约 15%。

Reasoning Text-to-Video Retrieval for Operating Room Clips via Action-Driven Digital Twins Figure 1
2026-06-17cs.CV

Reasoning Text-to-Video Retrieval for Operating Room Clips via Action-Driven Digital Twins

Yiqing Shen, Hao Ding, Mathias Unberath

2026-06-17视觉感知

手术室视频检索需要回答“夹闭前一步”等隐式查询,而常规全局文本-视频嵌入难以推理相邻、视觉相似片段的动作差异。论文提出 OR³,将片段转为按时间组织的主语-动作-宾语动作数字孪生,并由 LLM 从查询“想象”目标 ActDT,再做同模态匹配和证据修正。在基于 MM-OR 的 386 个机器人膝关节手术片段、276 个查询上,OR³ 达到 57.6% R@1、77.3% R@5,显著优于 ReasonT2V 等基线。

Pareto LoRA: Mitigating Modality Imbalance in Unified Multimodal Models via Pareto-Optimal Gradient Integration Figure 1
2026-06-17cs.CV

Pareto LoRA: Mitigating Modality Imbalance in Unified Multimodal Models via Pareto-Optimal Gradient Integration

Xiwen Wei, Mark Nutter, Madhusudhanan Srinivasan, Radu Marculescu

The University of Texas at Austin, Advanced Micro Devices, Inc.

2026-06-17视觉语言优化算法

该文针对统一多模态模型在 LoRA 指令微调中“文本梯度压过视觉梯度”、导致图文交错生成里图像质量受损的问题展开分析。核心洞察是将文本与图像损失视为双目标优化,并用 Pareto LoRA 在检测到梯度冲突或失衡时调节更新方向与强度,避免弱视觉模态被淹没。在 Emu2 与 CoMM 基准上,相比普通 LoRA,方法最高提升 44.9% 感知图像质量,同时基本保持文本表现。

Phenotyping TPF via Self-Supervised Learning: A Label-Agnostic Framework with Expert Validation Figure 1
2026-06-17eess.IV

Phenotyping TPF via Self-Supervised Learning: A Label-Agnostic Framework with Expert Validation

Miral Elnakib, Muhammad Saad, Ahmad Al-Kabbany

Alexandria University, Multimedia Interaction and Communication Lab, Wearables, Biosensing, and Biosignal Processing Research Lab, Arab Academy for Science and Technology

2026-06-17视觉感知

针对胫骨平台骨折传统 Schatzker/AO-OTA 标签存在观察者差异、会让监督模型学习标签噪声的问题,本文改用无标签表征学习:以 RadImageNet 预训练 ResNet-50 经 SimCLR 在清洗后的膝关节 X 光上微调,再用 UMAP 与 k-means 发现影像表型。结果得到 4 类表型,轮廓系数 0.511、bootstrap ARI 0.319±0.041,专家盲评均达面效度阈值;与 Schatzker 的 ARI 仅 0.013,说明其捕捉的是互补的形态结构而非既有分类复刻。

Training LLMs with Reinforcement Learning over Digital Twin Representations for Reasoning-Intensive Surgical VideoQA Figure 1
2026-06-17cs.CV

Training LLMs with Reinforcement Learning over Digital Twin Representations for Reasoning-Intensive Surgical VideoQA

Yiqing Shen, Han Zhang, Mathias Unberath

2026-06-17视觉感知强化学习

本文针对手术 VideoQA 难以进行语义、空间和时间多步推理的问题,提出用强化学习训练 LLM 先规划并调用手术基础模型构建数字孪生表示,再在分层、概率化的中间表示上推理,从而解耦视觉感知与推理,并用临床合理性和不确定性校准设计奖励。作者还构建 REAL-Colon-Reason 数据集,在该集及 REAL-Colon-VQA、EndoVis18-VQA 上报告了最优表现。

Pulling The REINS: Training-Free Safety Alignment of Video Diffusion Models via Representation Steering Figure 1
2026-06-17cs.CV

Pulling The REINS: Training-Free Safety Alignment of Video Diffusion Models via Representation Steering

Rohit Kundu, Arindam Dutta, Sarosij Bose, Athula Balachandran, Amit K. Roy-Chowdhury

University of California, Riverside, 2 YouTube (Google)

2026-06-17视觉感知生成模型安全鲁棒

针对开源视频扩散模型易生成暴力、色情和误导内容,而微调成本高、输入/输出过滤易绕过的问题,本文提出 REINS:无需训练地在推理中沿 SPCA 从安全标签激活中发现的单一“安全方向”调控中层隐藏状态,并用逐通道范数保持减少伪影。实验覆盖 9 个 1.3B–5B 文生/图生视频模型,显示可将有害生成转向语义相关的安全结果,且安全可分信息随深度增强、最佳干预约在中层。

Contrastive Action-Image Pre-training for Visuomotor Control Figure 1
2026-06-17cs.RO

Contrastive Action-Image Pre-training for Visuomotor Control

Yuvan Sharma, Dantong Niu, Anirudh Pai, Zekai Wang, Zhuoyang Liu, Baifeng Shi, Stefano Saravalle, Boning Shao, Ruijie Zheng, Jing Wang, Konstantinos Kallidromitis, Yusuke Kato, Fabio Galasso, Yuke Zhu, Danfei Xu, Linxi "Jim" Fan, Jitendra Malik, Trevor Darrell, Roei Herzig

Sapienza University of Rome

2026-06-17视觉感知规划控制

本文针对机器人数据规模不足、通用视觉预训练缺少动作监督而与控制需求错位的问题,提出 CAIP:从大规模第一视角人类视频中提取 3D 手部关键点,将其作为末端执行器动作代理,并用对比学习对齐图像/文本与动作片段。模型用约 3.2 万小时人类视频和少量机器人数据训练,在真实灵巧操作中优于 DINOv2、SigLIP、MVP、R3M 等,平均成功率达 76%,折叠、倒液等任务提升超过 30%。

GeoDisaster: Benchmarking Orchestrated Agents for Operational Disaster Geo-Intelligence Figure 1
2026-06-17cs.CV

GeoDisaster: Benchmarking Orchestrated Agents for Operational Disaster Geo-Intelligence

Maram Hasan, Aman Verma, Savitra Roy, Hariseetharam Gunduboina, Daksh Jain, Muhammad Haris Khan, Subhasis Chaudhuri, Biplab Banerjee

Biplab Banerjee 1, Indian Institute of Technology Bombay, Mohamed bin Zayed University of Artificial Intelligence

2026-06-17数据集/基准

本文针对现有遥感视觉语言模型只擅长静态感知、难以完成灾害响应中多源证据整合与多步工具推理的问题,提出 GeoDisaster 基准:覆盖 2921 个实例、43 类问题和五类灾害任务,并用可执行 GIS 流程生成可验证答案与轨迹。同时提出带执行契约的多智能体框架和 RCEA 对齐方法。实验表明现有 RS-VLM/智能体在该基准上明显不足,RCEA 可提升工具调用、证据 grounding、状态一致性和决策质量。

Landsat-Sentinel-2 Algal Bloom Mapping Using Vision Transformers: Model Description, Implementation, and Examples Figure 1
2026-06-17cs.CV

Landsat-Sentinel-2 Algal Bloom Mapping Using Vision Transformers: Model Description, Implementation, and Examples

Thainara Lima, Vitor Martins

a Department of Agricultural & Biological Engineering, Mississippi State University (MSU), Starkville, MS 39762, the urgent need for a scalable coastal algal bloom monitoring (Anderson et al., 2009, 2012, 2019

2026-06-17视觉感知

针对近岸藻华突发、形态破碎且传统粗分辨率海色产品和光谱指数易受云、耀斑与水体反射误差影响的问题,本文用30米Landsat/Sentinel-2构建全球藻华斑块数据集,并首次系统比较ViT、Swin、SegFormer、MAE与ResUNet用于细粒度藻华分割。结果显示深度模型总体可检测漂浮藻华,漏检和误检约8%–65%;Swin在云和耀斑压力下优于阈值指数,并比MODIS更能刻画碎片化受影响区域。

Beyond Benchmarks: Continuous Edge Inference for Fine-Grained Roadside Perception Figure 1
2026-06-17cs.CV

Beyond Benchmarks: Continuous Edge Inference for Fine-Grained Roadside Perception

Aditya Mishra, Haroon Lone

Indian Institute of Science Education and Research, Indian Institute of Science Education and Research Bhopal India

2026-06-17数据集/基准

论文指出静态图像基准会掩盖车载边缘连续推理中的时间抖动、热降频和负载波动,导致部署性能被系统性高估。作者提出 Edge-TSR,将检测、跟踪、细粒度分类与轨迹感知的置信度平滑/滞回锁定结合,用很低开销提升交通标志视频识别稳定性。实验显示三类基线从图像到真实流式部署下降约20–30%,该方法最高恢复10.16%分类准确率,并在 Jetson Orin Nano 上完成55分钟26公里实测,维持16.18 FPS且温度安全。

Quantum Enchanced Multi-Scale CNN with Bi-directional Mamba for Crop Field Analysis Figure 1
2026-06-17cs.CV

Quantum Enchanced Multi-Scale CNN with Bi-directional Mamba for Crop Field Analysis

Mohammad Salman Khan, Ehsan Atoofian, Saad B. Ahmed

Department of Computer Science, Lakehead University, Department of Electrical and Computer Engineering

2026-06-17视觉感知

面向无人机高光谱农田分类中光谱维度高、标注少、类别不均衡且传统 CNN/Transformer 计算负担大的问题,论文提出融合多尺度 CNN、光谱通道注意力、双向 Mamba 状态空间建模和量子启发特征增强的框架,并用加权损失改善训练稳定性。在 UAV-HSI-Crop 上 OA 为 84.83%,证明组合架构可用,但相对已有更高精度方法的增益来源仍不够清楚。

Revisiting LLM Adaptation for 3D CT Report Generation: A Study of Scaling and Diagnostic Priors Figure 1
2026-06-17cs.CL

Revisiting LLM Adaptation for 3D CT Report Generation: A Study of Scaling and Diagnostic Priors

Vanshali Sharma, Andrea M. Bejar, Halil Ertugrul Aktas, Quoc-Huy Trinh, Debesh Jha, Gorkem Durak, Ulas Bagci

2026-06-17三维

本文针对3D CT报告生成中全量微调易过拟合、产生临床幻觉且计算昂贵的问题,系统比较96M到1.6B LLM的冻结与微调策略,并提出RAD3D-Prefix,将3D图像嵌入与多标签诊断logits作为异常感知前缀注入冻结LLM。结果显示小模型更适合微调,约1B以上模型冻结并仅训练投影层更优;该方法在自动指标、临床读者评估和域外泛化上优于同类参数高效基线。

Not Truly Multilingual: Script Consistency as a Missing Dimension in VLM Evaluation Figure 1
2026-06-17cs.CV

Not Truly Multilingual: Script Consistency as a Missing Dimension in VLM Evaluation

Prabhjot Singh, Bhushan Pawar, Madhu Reddiboina, Rajvee Sheth

∗RediMinds Inc., USA, †The University of Texas at Austin, USA, ∗Data and code is available at https://github.com/

2026-06-17视觉语言数据集/基准

本文针对现有多语种VLM评测默认“一种语言一种文字”、忽视旁遮普等多文字用户的问题,构建PuMVR:1000个在Gurmukhi、Shahmukhi、Roman三种文字间严格平行的视觉推理样本,并提出脚本一致率SCR衡量正交鲁棒性。对10个VLM的评测显示,同一语义与图像仅因文字不同即可产生最高16%的准确率差,视觉输入提升总体表现但不能弥合差距,SCR最低仅24.8%,跨文字few-shot迁移也很脆弱。

HRDX: A Large-Scale Vector HD-Map Dataset Figure 1
2026-06-17cs.RO

HRDX: A Large-Scale Vector HD-Map Dataset

Sahith Reddy Chada, Isht Dwivedi, Nirav Savaliya

Honda Research Institute US, San Jose, CA.

2026-06-17数据集/基准

针对现有公开矢量 HD 地图数据规模小、语义属性稀疏且缺少可复现航拍模态的问题,HRDX 发布约 40 小时/1400 km 湾区驾驶数据,含环视相机、LiDAR、RTK 定位、对齐正射影像及 10 类地图元素和 20+ 属性,并提出同时评估几何与属性的 CS 指标。实验显示更大数据规模提升在线制图表现,航拍图像在训练或推理中能改善几何质量,航拍教师蒸馏也可增强纯相机模型,增益可能主要来自 scaling / data 与额外结构先验。

2026-06-16

291 篇
Context-Aware RL for Agentic and Multimodal LLMs Figure 1
2026-06-16cs.CL

Context-Aware RL for Agentic and Multimodal LLMs

Peiyang Xu, Bangzheng Li, Sijia Liu, Karthik R. Narasimhan, Pramod Viswanath, Prateek Mittal, Xingyu Fu

Princeton University

2026-06-16视觉语言强化学习

论文针对长轨迹智能体和视觉语言模型常见的“看到上下文却未据此作答”问题,提出 ContextRL:在 GRPO 后训练中加入对比式上下文选择目标,让模型在相似轨迹或图像中识别支持给定答案的证据,而非只优化最终答案。作者构造 1k 代码轨迹对和 7k 图像对,在 5 个长程任务与 12 个 VQA 基准上较 GRPO 平均提升约 2.2% 和 1.8%,且同数据的 SFT/RL 增广几乎无效,说明收益主要来自该辅助目标。

BRDFusion: Physics Meets Generation for Urban Scene Inverse Rendering Figure 1
2026-06-16cs.CV

BRDFusion: Physics Meets Generation for Urban Scene Inverse Rendering

Yi-Ruei Liu, Jie-Ying Lee, Zheng-Hui Huang, Yu-Lun Liu, Chih-Hao Lin

National Yang Ming Chiao Tung University, University of Illinois Urbana-Champaign, National Taiwan University, sistency and controllability. We present BRDFusion, a unified framework, controllable rendering from the scene configuration, and the generative, alism and controllability is crucial for several downstream applications, including

2026-06-16视觉感知

面向自动驾驶仿真和内容编辑,城市视频逆渲染需要同时具备物理可控性与视觉真实感。BRDFusion将3D Gaussian场景表示、HDR环境光和PBR渲染与扩散生成先验结合,用生成模型缓解材质/光照分解歧义并修复PBR伪影。文中在真实与合成城市场景上优于物理或纯生成基线,支持可控新视角重光照、夜间仿真和带一致阴影的动态物体插入。

Exact Posterior Score Estimation for Solving Linear Inverse Problems Figure 1
2026-06-16cs.LG

Exact Posterior Score Estimation for Solving Linear Inverse Problems

Abbas Mammadov, Ozgur Kara, Kaan Oktay, Iskander Azangulov, Adil Kaan Akan, Hyungjin Chung, James Matthew Rehg, Yee Whye Teh

University of Oxford

2026-06-16视觉感知

针对扩散/flow 先验在超分、去模糊、修复等线性逆问题中只能提供无条件 score、导致后验采样依赖近似校正的问题,本文推导线性高斯观测下精确后验 score 的闭式形式,指出可等价为在测量诱导 pivot 和各向异性噪声协方差上的去噪,并据此提出 EPS 训练目标。实验在 FFHQ、ImageNet 的五类逆问题上提升保真度、感知质量和分布校准,同时比梯度式后验采样少约一个数量级 denoiser 调用。

Geometric Action Model for Robot Policy Learning Figure 1
2026-06-16cs.RO

Geometric Action Model for Robot Policy Learning

Jisang Han, Seonghu Jeon, Jaewoo Jung, René Zurbrügg, Honggyu An, Tifanny Portela, Marco Hutter, Marc Pollefeys, Seungryong Kim, Sunghwan Hong

ETH AI Center

2026-06-16机器人强化学习

针对VLA/WAM主要依赖2D图像表征、难以显式处理深度、尺度和遮挡的问题,本文提出GAM:将预训练几何基础模型在中间层拆分,插入语言、状态与动作历史条件化的因果未来预测器,在共享几何token空间同时预测未来3D几何和动作。实验显示其在LIBERO-Plus达85.5%成功率,摄像机扰动下优势明显,并以1.4B规模实现较现有大模型更快推理和更强真实机器人鲁棒性。

R2RDreamer: 3D-aware Data Augmentation for Spatially-generalized 2D Manipulation Policies Figure 1
2026-06-16cs.RO

R2RDreamer: 3D-aware Data Augmentation for Spatially-generalized 2D Manipulation Policies

Xiuwei Xu, Haowen Sun, Angyuan Ma, Yiwei Zhang, Zhenyu Wu, Xiaofeng Wang, Bingyao Yu, Zheng Zhu, Jie Zhou, Jiwen Lu

Tsinghua University

2026-06-16机器人三维

为缓解模仿学习在物体位姿、机器人构型和相机视角变化下需要大量示教的问题,R2RDreamer将真实示教中的物体点云与末端轨迹在统一3D坐标系中共同编辑,再通过遮挡感知投影生成2D控制视频,并用图像到视频模型补全RGB观测,从而避免强3D几何补全假设。文中在空间偏移操作任务上显示,该增强能提升2D扩散策略和视觉-语言-动作策略的空间泛化,并验证了3D编辑、遮挡处理与视频补全的贡献。

The Importance of Phase in Neural Representations: An Internal Oppenheim-Lim Test of Image Classifiers Figure 1
2026-06-16cs.CV

The Importance of Phase in Neural Representations: An Internal Oppenheim-Lim Test of Image Classifiers

Alper Yıldırım

2026-06-16视觉感知

本文追问图像分类器内部是否也像经典 Oppenheim–Lim 实验那样更依赖相位而非幅值。作者把相位/符号移植做成逐层因果干预,比较 PRISM2D、GFNet、ViT 与 ResNet。结果显示多数模型预测随相位或符号供体变化,去除图像特异幅值仍接近基线;ResNet 的符号码被 ReLU 隐藏,需在激活前揭示,说明不同架构共享相位/符号身份编码但呈现基不同。

Qwen-RobotWorld Technical Report: Unifying Embodied World Modeling through Language-Conditioned Video Generation Figure 1
2026-06-16cs.CV

Qwen-RobotWorld Technical Report: Unifying Embodied World Modeling through Language-Conditioned Video Generation

Jie Zhang, Xiaoyue Chen, Anzhe Chen, Chenxu Lv, Deqing Li, Gengze Zhou, Hang Yin, Haoqi Yuan, Haoyang Li, Jiahao Li, Jiazhao Zhang, Jingren Zhou, Kaiyuan Gao, Kun Yan, Lihan Jiang, Ningyuan Tang, Pei Lin, Qihang Peng, Shengming Yin, Tianhe Wu, Tianyi Yan, Xiao Xu, Yan Shu, Yanran Zhang, Ye Wang, Yi Wang, Yilei Chen, Yixian Xu, Yiyang Huang, Yuxiang Chen, Zekai Zhang, Zhendong Wang, Zhixing Lei, Zhixuan Liang, Zihao Liu, Zikai Zhou, Xiong-Hui Chen, Chenfei Wu

generation for policy training augmentation, scalable virtual environments for policy, with safety risks. World models offer a scalable alternative: by learning environment dynamics from, generated video to serve as an action label. This flexibility positions language-conditioned world models

2026-06-16机器人视觉感知强化学习

该报告针对真实机器人训练成本高、通用视频模型缺少具身物理而专用模型难跨平台的问题,提出以自然语言统一动作接口的 Qwen-RobotWorld。其核心是双流 MMDiT 结合冻结 Qwen2.5-VL 动作编码、8.6M EWK 视频文本数据和通用到专家的渐进训练。结果在 EWM-Bench、DreamGen Bench 总体第一,并优于开源模型于 WorldModelBench、PBench;具体增益可能主要来自 scaling / data 与架构共同作用。

MeshLoom: Feed-Forward Non-Rigid Registration of Mesh Sequences Figure 1
2026-06-16cs.CV

MeshLoom: Feed-Forward Non-Rigid Registration of Mesh Sequences

Jianqi Chen, Jiraphon Yenphraphai, Xiangjun Tang, Sergey Tulyakov, Chaoyang Wang, Peter Wonka, Rameen Abdal

Snap Inc., Purdue University, Snap Inc. United States of America, Purdue University United States of America

2026-06-16视觉感知

针对动态网格非刚性配准常受逐例优化、类别受限、只能成对处理或需后处理制约的问题,MeshLoom提出前馈式拓扑感知编码—解码框架:用参考网格邻域特征消除欧氏近但测地远的顶点混淆,并将多帧形状/图像线索压缩为全局运动嵌入再按时间查询逐顶点形变。实验显示其在多类别、多运动配准上优于现有方法,且可生成中间时刻形变用于插值和网格变形。

FusionRS: A Large-Scale RGB-Infrared Remote Sensing Dataset for Dual-Modal Vision-Language Foundation Models Figure 1
2026-06-16cs.CV

FusionRS: A Large-Scale RGB-Infrared Remote Sensing Dataset for Dual-Modal Vision-Language Foundation Models

Jiaju Han, Ben Zhang, Xuemeng Sun, Qike Zhang, Yuxian Dong, Chengyin Hu, Fengyu Zhang, Yiwei Wei, Jiujiang Guo

China University of Petroleum-Beijing at Karamay, University of Electronic Science and Technology of China, Tianjin University, most existing work remains centered on RGB, vision for more scalable RGB-infrared remote, data and tasks centered on forest fires rather than

2026-06-16视觉语言视觉感知数据集/基准

针对遥感视觉语言模型长期依赖 RGB、缺少大规模 RGB-红外-文本数据的问题,FusionRS 将公开 RGB 遥感图像翻译为红外风格配对图,并加入普通场景描述与红外感知 caption,形成约 60 万组三元数据,用于训练 CLIP 式对齐模型和生成式 VLM。实验显示其在 RGB-IR 对齐、红外到文本检索、双模态 caption/VQA 上优于 RGB-only 和非红外感知训练;但红外图像为合成风格而非真实传感器采集,真实物理泛化仍需验证。

ActiveSAM: Image-Conditional Class Pruning for Fast and Accurate Open-Vocabulary Segmentation Figure 1
2026-06-16cs.CV

ActiveSAM: Image-Conditional Class Pruning for Fast and Accurate Open-Vocabulary Segmentation

Tran Dinh Tien, Zhiqiang Shen

VILA Lab, Mohamed bin Zayed University of Artificial Intelligence

2026-06-16视觉感知

针对 SAM 3 做开放词汇语义分割时需对整套类别逐一全分辨率解码、而单张图通常只含少量相关类的低效问题,ActiveSAM 将 presence 信号前置为低分辨率预览,按图像裁剪活跃类别,并结合提示扩展、桶化多路解码和边界感知背景校准,在不训练、不更新权重的条件下提升速度与精度;八个 OVSS 基准平均较 SegEarth-OV3 高约 1.4 mIoU,大词表场景最高快 5.5 倍,并在图像退化下更稳健。

DreamX-World 1.0: A General-Purpose Interactive World Model Figure 1
2026-06-16cs.CV

DreamX-World 1.0: A General-Purpose Interactive World Model

DreamX Team, Yancheng Bai, Rui Chen, Xiangxiang Chu, Rujing Dang, Hao Dou, Bingjie Gao, Qiwen Gu, Siyu Hong, Jiachen Lei, Geng Li, Jifan Li, Ruimin Lin, Qingfeng Shi, Bingze Song, Lei Sun, Jing Tang, Ruitian Tian, Jun Wang, Jiahong Wu, Pengfei Zhang, Shen Zhang, Jiashu Zhu

2026-06-16强化学习三维

本文瞄准交互式世界模型在长时生成中难以同时保持相机可控、场景记忆和低延迟的问题。DreamX-World 结合 UE、游戏与真实视频数据,引入降采样几何注意力 E-PRoPE、基于相机几何的记忆检索、事件指令微调,以及 DMD 蒸馏后强化学习对齐。结果在 5 秒评测中总体分 84.76,高于 HY-WorldPlay 1.5 和 LingBot-World,并在 8 张 RTX 5090 上最高达 16 FPS。

A Multi-Center Benchmark for Abdominal Disease Diagnosis and Report Generation from Non-Contrast CT Figure 1
2026-06-16cs.CV

A Multi-Center Benchmark for Abdominal Disease Diagnosis and Report Generation from Non-Contrast CT

Mariam Elbakry, Aliaa Sayed Sheha, Salma Hassan Tantawy, Aya Yassin, Concetto Spampinato, Karim Lekadir, Xiaomeng Li, Marawan Elbatel

A Multi-Center Benchmark for Abdominal, Ain Shams University, Cairo, Egypt, The Hong Kong University of Science and Technology, Hong Kong SAR, China, University of Catania, Catania, Italy, introduce a novel multi-center benchmark for multi-organ abdominal dis-, ology reports from two centers, partitioned into internal sets and an ex-, sible contrast-free abdominal imaging workflows. Code is available at:, strict its availability. Non-contrast CT (NCCT) offers a safer, more globally, licly available data. Consequently, no prior work has introduced a dataset and

2026-06-16数据集/基准

针对增强腹部 CT 存在造影剂风险、采集负担和资源可及性问题,本文构建了一个多中心基准,用单期非增强 CT 学习生成增强 CT 级别的多器官诊断与报告。核心贡献是整理 1254 例配对 NCCT–CECT 及报告,并统一评测 5 类模型;结果显示 NCCT 含有可学习诊断信号,平均多器官 AUC 在内部/外部队列为 69.1%/63.1%,但跨中心性能仍明显下降。

SurroundNEXO: Ego-Centric Metric Bridging for Spatially Consistent Geometry in Autonomous Driving Figure 1
2026-06-16cs.CV

SurroundNEXO: Ego-Centric Metric Bridging for Spatially Consistent Geometry in Autonomous Driving

Shuai Yuan, Runxi Tang, Yuzhou Ji, Fudong Ge, Hanshi Wang, Yifei Wang, Xianming Zeng, Jianyun Xu, Xingliang Liu, Yanfeng Wang, Zhipeng Zhang

School of Artificial Intelligence, Shanghai Jiao Tong University, 2Hello Inc., the extreme sparsity of available LiDAR ground truth and the limited field-of-view (FoV) overlap between adjacent, constructs reliable metric anchors directly from the available sparse LiDAR measurements, effectively propagating

2026-06-16视觉感知

面向自动驾驶环视相机重叠视野很小、单目深度易尺度不一致的问题,SurroundNEXO不再依赖密集跨视图匹配,而用自车坐标系下的Ego-Ray位置编码统一各视角射线,以稀疏LiDAR作度量锚点,并通过渐进式几何Transformer从单视图到时空/全局交互逐步融合。在NuScenes、Waymo、DDAD上,相比SOTA单视图误差降33.2%,跨视图一致性提升10.5%,重建质量提升25.6%。

Simulation-Based Multi-Fillet Evaluation of Woody Breast Poultry Fillets Figure 1
2026-06-16cs.CV

Simulation-Based Multi-Fillet Evaluation of Woody Breast Poultry Fillets

Chirantan Sen Mukherjee, Seung-Chul Yoon, William J. Beksi

bends, providing a robust and scalable alternative to a side-view, The authors are with the Department of Computer Science and, Engineering, The University of Texas at Arlington, Arlington, TX, USA., Unit, U.S. National Poultry Research Center, USDA Agricultural Research, lab.github.io/woody-breast-sim.

2026-06-16数据集/基准

针对现有木质鸡胸肉检测依赖侧视单片下落弯曲、难以满足产线多片吞吐的问题,本文构建工业输送线数字孪生,生成合成3D鸡胸网格并用物理仿真建模黏弹性弯曲,从俯视相机提取2D轮廓形变分数进行多片跟踪与判别。实验显示该分数能区分正常与严重WB,100 FPM下分离度约3.5倍,但真实产线验证仍属未来工作。

Semantic Flip: Synthetic OOD Generation for Robust Refusal in Embodied Question Answering and Spatial Localization Figure 1
2026-06-16cs.CV

Semantic Flip: Synthetic OOD Generation for Robust Refusal in Embodied Question Answering and Spatial Localization

Dongbin Na, Chanwoo Kim, Giyun Choi, Dooyoung Hong

RGA Inc.

2026-06-16安全鲁棒

面向真实具身机器人中“看不见、指代不清或前提错误”的用户请求,论文关注VLM过度自信导致问答幻觉或导航到任意坐标的安全风险。Semantic Flip通过分别扰动查询或视频记忆合成无外部标注的OOD配对,在冻结VLM上训练轻量拒答模块。其在AbstainEQA上以7B模型F1=0.7110超过32B提示基线0.6746,并在新建空间定位拒答集SpaceReject上达到F1=0.9559。

Latent Space Reinforcement Learning for Inverse Material Estimation in Food Fracture Simulation Figure 1
2026-06-16cs.CV

Latent Space Reinforcement Learning for Inverse Material Estimation in Food Fracture Simulation

Adrian Ramlal, Yuhao Chen, John S. Zelek

University of Waterloo

2026-06-16强化学习

针对食物操作仿真中材料参数难测、且断裂模拟器不可微又耗时的问题,论文以橙子剥皮为例,用2000次仿真训练神经代理,并在归一化流潜空间中训练目标条件PPO,学习一次即可对任意行为目标快速反推参数。结果显示该策略约10 ms、8次代理评估完成估计,真实恢复率0.642,比原9维空间高23%;再用CMA-ES热启动细化可达0.828,但泛化仅在单一任务上验证。

Federated Medical Image Segmentation under Real-World Label Noise: A Benchmark Suite for Noisy Label Learning Method Selection Figure 1
2026-06-16cs.CV

Federated Medical Image Segmentation under Real-World Label Noise: A Benchmark Suite for Noisy Label Learning Method Selection

Markus Bujotzek, Dimitrios Bounias, Stefan Denner, Ralf Floca, Maximilian Fischer, Peter Neher, Klaus Maier-Hein

2026-06-16视觉感知强化学习数据集/基准

针对联邦医学图像分割中各机构标注噪声难以集中检查、且既有研究多依赖合成噪声的问题,本文构建了包含真实噪声数据、多种客户端噪声场景和噪声定向评估的基准套件。实验显示真实噪声常以轮廓差异、漏标/多标和类别混淆组合出现;FedSelect整体最强,但FedAvg仍是有竞争力的基线,并给出按噪声类型选择方法的指南。

Redirecting the Flow: Image Customization through Attention Distribution Shift Figure 1
2026-06-16cs.CV

Redirecting the Flow: Image Customization through Attention Distribution Shift

Jie Li, Suorong Yang, Jian Zhao, Furao Shen

2026-06-16视觉感知生成模型

本文针对主体驱动图像定制中参考主体身份难保持、测试时微调低效、外部编码特征与生成过程错位以及共享注意力易引入干扰的问题,将参考图像建模为注意力分布迁移,并以最大熵推导条件注意力分布偏移。基于 SD3 的 CustomShift 采用参考对齐与交叉引导双分支,在训练期用轻量 LoRA 而无需测试时优化;在 DreamBooth 和 Custom101 上相较现有方法更好兼顾文本语义一致性与主体一致性。

An Open-Source Monitoring Framework for Data Exploration and Progress Tracking in Multi-Center Radiology Studies Figure 1
2026-06-16cs.CV

An Open-Source Monitoring Framework for Data Exploration and Progress Tracking in Multi-Center Radiology Studies

Markus Bujotzek, Jonas Scherer, Stefan Denner, Peter Neher, Benjamin Hamm, Lorenz Feineis, Uenal Akuenal, Andreas Bucher, Tobias Penzkofer, Klaus Maier-Hein

2026-06-16视觉感知

多中心放射学研究常依赖邮件和共享表格来寻找数据、协作者并跟踪进度,易过期且难扩展。论文将通用 Grafana–Prometheus 监控栈改造成轻量开源框架,只汇聚各中心的聚合指标并用可配置仪表盘展示,兼顾隐私与平台无关集成。其在 Kaapana 中落地,并部署到德国 RACOON 联盟 38 所大学医院,展示了跨中心数据探索、伙伴发现和研究进度监控的可行性。

Robust Spoofed Speech Detection via Temporal Pyramid Modeling Figure 1
2026-06-16cs.CV

Robust Spoofed Speech Detection via Temporal Pyramid Modeling

Mahtab Masoudi Nezhad, Nima Karimian

Lane Department of Computer Science and, West Virginia University, Bellini College of Artificial Intelligence, University of South Florida

2026-06-16视觉感知安全鲁棒

面向语音认证中合成、转换和重放攻击在跨数据集/跨语言场景下易失效的问题,论文在 XLS-R 自监督表示前加入时间金字塔适配器,用多尺度并行时序卷积同时捕捉局部伪造痕迹与长程韵律异常。实验覆盖 ASVspoof、PartialSpoof、DiffSSD 和 HQ-MPSD;在 PartialSpoof 上取得 99.24% AUC、3.87% EER,优于多种基线,但跨域和跨语言阈值指标仍明显下降,说明校准与适配仍是瓶颈。

Decoupling Semantics from Distortions: Multi-Scale Two-Stream Vision-Language Alignment for AI-Generated Image Quality Assessment Figure 1
2026-06-16cs.CV

Decoupling Semantics from Distortions: Multi-Scale Two-Stream Vision-Language Alignment for AI-Generated Image Quality Assessment

Zijie Meng

generation prompts are available. Extensive experiments, rameters. Our project is available at https://github.com/, generation prompts are available, a lightweight cross-, plates. When generation prompts are available, we denote

2026-06-16视觉语言视觉感知

本文针对 CLIP/VLM 做 AI 生成图像质量评价时“语义判别强、细粒度失真感知弱”的矛盾,提出 MST-CLIPIQA:用不同 patch 粒度的双流 CLIP 分别建模全局语义一致性与局部纹理伪影,并通过信息瓶颈式门控融合去冗余;有提示词时再用跨注意力评估图文对应。五个基准上质量 SRCC 平均提升 1.11%、图文对应提升 2.35%,且仅约 0.8M 可训练参数。

WaveDINO: Learning-Based Atmospheric Correction of Unwrapped InSAR Interferograms Validated by GNSS: Results at Laguna del Maule and Campi Flegrei Volcanoes Figure 1
2026-06-16cs.CV

WaveDINO: Learning-Based Atmospheric Correction of Unwrapped InSAR Interferograms Validated by GNSS: Results at Laguna del Maule and Campi Flegrei Volcanoes

Robert Popescu, Juliet Biggs, Tianyuan Zhu, Nantheera Anantrasirichai

Grant No. 101003173) and the NERC Centre for the Observation, University, Centre for Observation and Modelling of Earthquakes, Vol-, of interest of 50×50 km centred on each volcano, with an

2026-06-16视觉感知

本文针对火山 InSAR 形变监测中大气相位延迟易掩盖真实形变、传统气象模型校正残差和偏差不稳定的问题,提出 WaveDINO:用小波多尺度去噪结合冻结 DINOv3 全局特征、DEM 地形调制和相位斜坡头,并以真实短期干涉图叠加物理合成岩浆形变进行监督训练。在 Laguna del Maule 与 Campi Flegrei 的长期数据上,方法优于对比模型和气象校正,GNSS 平均失配约降 3% 与 19%。

LLM-Based Visual Explanation Evaluation Framework for Assessing the Explainability of Facial Skin Disease Classification Models Figure 1
2026-06-16cs.CV

LLM-Based Visual Explanation Evaluation Framework for Assessing the Explainability of Facial Skin Disease Classification Models

Gyuyeon Na

AI and Business Analytics, Ewha Womans University, Seoul, Republic of Korea, labeled data. In acne detection, Wei et al. (2023)

2026-06-16数据集/基准

针对皮肤病分类研究多关注准确率、缺少对 Grad-CAM 是否落在临床病灶区域的可复现评估,本文提出用 GPT-5.5、Gemini 3.5 Flash、Claude Sonnet 4.6 作为 LLM-as-a-Judge,并通过逐步提示加入量表、临床知识、惩罚规则和结构化输出。实验显示,不同增强策略对 EfficientNet-B0、MobileNetV3、ResNet18 的性能与注意力分布影响不同,最佳增强下模型更集中于病灶区域,细化提示也提升了定位与可信度评分一致性;但验证仍属单图像、小样本试点,结论外推受限。

Gen-VCoT: Generative Visual Chain-of-Thought Reasoning via Diffusion-Based RGB Intermediate Representations Figure 1
2026-06-16cs.CV

Gen-VCoT: Generative Visual Chain-of-Thought Reasoning via Diffusion-Based RGB Intermediate Representations

Zhiqiang Zhou, Junliang Dai, Xu ling

Hunan Chemical Industry Vocational and Technical College, Zhuzhou, Hunan 412000, China

2026-06-16生成模型

针对多模态模型依赖文本 CoT、难以显式表达空间中间过程的问题,Gen-VCoT 用 SAM 分割图和 Marigold 伪彩深度图作为可视化 RGB 推理中间表示,再由 Qwen2-VL 作答,并用路由器按问题复杂度选择步骤。实验显示其在复杂空间/深度问题上优于直接推理(78.9% vs 68.4%,空间+25%、深度+50%),但在简单事实/CLEVR 上反而弱于基线和文本 CoT,说明增益具有任务依赖性。

Text-Vision Co-Instructed Image Editing Figure 1
2026-06-16cs.CV

Text-Vision Co-Instructed Image Editing

Chenxi Xie, Yuhui Wu, Qiaosi Yi, Lei Zhang

2026-06-16视觉感知

本文针对图像编辑中“文字有语义但空间控制粗、拖拽有位置但意图含糊”的矛盾,提出文本-视觉协同指令任务。核心做法是从视频构建2.3万余组源/目标图、点轨迹与文本描述,并用可插拔的TV-Edit将稀疏点提示结合图文语义转为语义感知空间控制。作者还建立TV-Edit-Bench,实验显示其在多种编辑骨干上较文本-only和drag-only方法有更好的语义忠实、空间对齐与视觉一致性。

3D Classification of Paramagnetic Rim Lesions in Multiple Sclerosis via Asymmetric QSM-FLAIR Modeling Figure 1
2026-06-16cs.CV

3D Classification of Paramagnetic Rim Lesions in Multiple Sclerosis via Asymmetric QSM-FLAIR Modeling

Veronica Pignedoli, Giacomo Boffa, Nicoletta Noceti, Matilde Inglese, Francesca Odone, Matteo Moro

MaLGa, DIBRIS, University of Genova, Genova, Italy, DINOGMI, University of Genova, Genova, Italy, pert interpretation remain limited to specialized centers, visual assess-, centered MRI patches extracted from co-registered QSM and FLAIR volumes., of publicly available benchmark datasets., work currently available. However, its reliance on handcrafted radiomic features, Rim−lesion classification operating directly on lesion-centered QSM and FLAIR

2026-06-16三维

这篇工作面向多发性硬化中Rim+病灶稀少、QSM判读依赖专家且耗时的问题,提出端到端3D多模态分类器:以QSM作为主要磁敏感信号,用FLAIR经空间FiLM提供结构上下文,并结合跨模态自监督预训练与监督对比正则缓解小样本和类别不平衡。在88名患者临床队列上,方法相较既有架构表现更好,但具体增益来源在片段中未充分说明。

Structure-aware Knowledge-guided Heterogeneous Mamba for Zygomaticomaxillary Suture Assessment Figure 1
2026-06-16cs.CV

Structure-aware Knowledge-guided Heterogeneous Mamba for Zygomaticomaxillary Suture Assessment

Xiaoqi Guo, Birui Chen, Xinquan Yang, Chaoyun Zhang, Xuefen Liu, Mianjie Zheng, Kun Tang, Xuguang Li, Wen Ma, Yanhua Xu, Linlin Shen

and Linlin Shen1,2 1 College of Computer Science and Software Engineering, Shenzhen University, School of Artificial Intelligence, Shenzhen University, Shenzhen, China, Affiliated Stomatology Hospital of Kunming Medical University, Kunming, China, Shenzhen University General Hospital, Shenzhen, China, formance compared to existing methods. Code is available at https:, this expert-dependent process is inherently subjective and labor-intensive due, often leads to inter-observer inconsistency, further complicating the labeling pro-, To address these challenges, this paper introduces the first publicly available

2026-06-16视觉感知

针对CBCT中颧颌缝成熟分期依赖专家、边界细碎且邻近阶段语义模糊的问题,论文构建了首个公开ZMS数据集,并提出SKMamba:用结构预训练的隐式边缘提取器强化缝隙高频形态,再以LLM解剖描述做跨模态语义对齐。实验显示其在3790张标注ROI上优于既有CNN/Transformer等方法,具备辅助正畸干预时机判断的潜力。

Revealing Artifacts via Noise Amplification: A Novel Perspective for AI-Generated Video Detection Figure 1
2026-06-16cs.CV

Revealing Artifacts via Noise Amplification: A Novel Perspective for AI-Generated Video Detection

Renxi Cheng, Jie Gui, Hongsong Wang

School of Cyber Science and Engineering, Southeast University, Nanjing 210096, China, Purple Mountain Laboratories, Nanjing 210000, China, Engineering Research Center of Blockchain Application, Supervision And Management, (Southeast University), Ministry of Education, China, School of Computer Science and Engineering, Southeast University, Nanjing 210096, China, Key Laboratory of New Generation Artificial Intelligence Technology and Its Interdisciplinary, Applications (Southeast University), Ministry of Education, China

2026-06-16视觉感知

针对文生视频越来越逼真、传统深伪检测对新生成器泛化不足的问题,论文从低位 bit-plane 中更容易暴露细节噪声伪迹这一观察出发,提出 NAMP:提取低位噪声并通过像素强度增强、局部空间放大和跨帧时间聚合后送入3D判别网络。同时构建 HardGVD 难例基准;在 GenVidBench 与 HardGVD 上显著优于既有方法,GenVidBench 平均检测准确率超过90%,但训练稳定性仍受随机区域和帧采样影响。

PATCH: Action-Chunk-Conditioned Latent Patch Innovation Monitoring for Robot Manipulation Figure 1
2026-06-16cs.RO

PATCH: Action-Chunk-Conditioned Latent Patch Innovation Monitoring for Robot Manipulation

Yanan Zhou, Ranpeng Qiu, Yincong Chen, Jiajie Cui, Weiming Zhi

School of Computer Science, The University of Sydney.Australian Centre For Robotics, The University of Sydney.

2026-06-16机器人

面向开放工作空间中移动物体、遮挡等局部扰动会误导学习型操作策略的问题,PATCH不再做全局异常检测,而是利用当前动作块投影短时执行走廊,在其中预测潜在patch演化并过滤机器人自运动,只累积持续的外部残差作为干预信号。真实机器人回放和部署显示,其触发更稳定、更贴近任务风险,可支持暂停、恢复源选择与原策略续执行。

MMDiff: Extending Diffusion Transformers for Multi-Modal Generation Figure 1
2026-06-16cs.CV

MMDiff: Extending Diffusion Transformers for Multi-Modal Generation

Yagmur Akarken, Orest Kupyn, Christian Rupprecht

2026-06-16生成模型

MMDiff针对扩散Transformer生成图像后丢弃中间感知表征、仍需另跑分割/深度模型的问题,冻结FLUX类DiT,仅训练轻量解码头,同时输出语义分割、显著性和深度。核心洞察是感知信息沿去噪时间分布,需用带空间权重的多时间步特征融合,并结合概念注意力;实验中分割较单时间步最高提升28.7% mIoU,且与DINOv3特征互补,可用于大规模合成标注。

Sinkhorn-CPD: Robust point cloud registration via unbalanced entropic optimal transport Figure 1
2026-06-16cs.CV

Sinkhorn-CPD: Robust point cloud registration via unbalanced entropic optimal transport

Jin Zhang, Mingyang Zhao, Bing Liu, Xin Jiang

aLMIB & School of Mathematical Sciences, Beihang University, Beijing, China, bState Key Laboratory of Mathematical Sciences, Academy of Mathematics and Systems Science, Chinese Academy of Sciences, Beijing, China, cBeijing Key Laboratory of Artificial Intelligence Innovation and Application in the Machine Tool Industry, School of Artificial Intelligence, Beihang, University, Beijing, China, dUniversity of Chinese Academy of Sciences, Beijing, China, Data availability. Data and code are publicly available at, showed that entropic regularization makes OT scalable and

2026-06-16三维安全鲁棒

本文针对 CPD 在大量离群点和低重叠点云配准中因目标端硬边缘约束而易被错误点牵引的问题,指出 CPD 的 E 步等价于单边熵正则 OT,且方差可视为温度;据此提出 Sinkhorn-CPD,用双边 KL 松弛构成非平衡熵 OT,并用广义 Sinkhorn 保留闭式 Procrustes 与自适应退火。实验显示其在合成、跨类别和 scan-to-CAD 场景中较 CPD、RPOT 等更稳健,70% 离群下仍保持低旋转误差。

Look Again Before You Abstain:Budgeted Conformal Evidence Acquisition for Reliable Vision-Language Model Figure 1
2026-06-16cs.CV

Look Again Before You Abstain:Budgeted Conformal Evidence Acquisition for Reliable Vision-Language Model

Jian Xu, Delu Zeng, John Paisley, Qibin Zhao

South China University of Technology, Columbia University, evidence is cheaply available, and introduce Budgeted Con-, when more evidence is cheaply available. When a person is, malabstentionforLLMs(Yadkorietal.2024)boundtheerror, fixed, label-independent transformation to both calibration, claim c about image x has an unknown binary label y ∈

2026-06-16视觉语言视觉感知

针对视觉语言模型为保证低幻觉率而过度拒答的问题,论文提出 BCEA:在回答/ abstain 之外加入有预算的再观察,并将裁剪、缩放或关系特定干预纳入打分后重新做 conformal 校准,指出朴素后处理会破坏交换性与风险保证。实验在 POPE、COCO 及多种开源 VLM 上显示,BCEA 能在目标幻觉率下提升覆盖率,水平翻转干预也显著改善空间关系验证。

Vision-Language Models as Zero-Annotation Oracles in Histopathology Figure 1
2026-06-16cs.CV

Vision-Language Models as Zero-Annotation Oracles in Histopathology

Vishal Jain, Giorgio Buzzanca, Sarah Cechnicka, Maarten Naesens, Priyanka Koshy, Tri Nguyen, Jesper Kers, Candice Roufosse, Bernhard Kainz

Imperial College London, London, UK, Leiden University Medical Center, Leiden, The Netherlands, University Hospitals Leuven, Leuven, Belgium, University Medical Center Utrecht, Utrecht, The Netherlands, Dept. AIBE, Friedrich-Alexander University Erlangen-Nürnberg, Germany, pseudo-labels are used to distil lightweight student models that are as, cost. Our framework provides a principled, scalable solution to a per-, sistent infrastructure bottleneck in digital pathology. Code is available, of expensive calls, and we use the resulting pseudo-labels to distil lightweight, mentation, and a distillation pathway that converts VLM pseudo-labels into

2026-06-16视觉语言视觉感知

针对全切片病理前景分割依赖手调阈值或H&E监督模型、在特殊染色和跨站点场景易失效的问题,本文将组织/背景判别重定义为通用视觉感知任务,用通用VLM作零标注oracle,并通过粗到细框定位、颜色聚类、零/少样本Auto-context复核与学生模型蒸馏降低成本。在Leica-75上,方法在Jones和EVG染色取得Dice 0.858/0.853,跨染色方差较最佳监督基线低7倍;难例Dice由0.470升至0.819,VLM质控也接近或超过人工一致性。

MVM-IOD: An Industrial Object-Centric Benchmark Dataset for the Evaluation of 3D Reconstruction Methods Figure 1
2026-06-16cs.CV

MVM-IOD: An Industrial Object-Centric Benchmark Dataset for the Evaluation of 3D Reconstruction Methods

Robert Langendörfer, Markus Hillemann, Markus Ulrich

Machine Vision Metrology, Institute of Photogrammetry and Remote Sensing, Karlsruhe Institute of Technology, Germany -

2026-06-16数据集/基准三维

面向工业机器人视觉中无纹理、反光/透明和复杂几何物体导致三维重建与位姿评估困难的问题,论文发布 MVM-IOD:用机器人臂半球采样采集9类工业物体、2种背景的18个场景,并提供精确相机位姿与线扫点云参考。作者以 COLMAP、VGGT、π³ 和 2DGS 建立基线,发现前馈几何模型在该工业采集分布外场景中位姿和点云质量下降,简单预处理可缓解但工业应用仍需谨慎。

DCP-Prune: Ultra-Low Token Pruning with Distribution Consistency Preservation Figure 1
2026-06-16cs.CV

DCP-Prune: Ultra-Low Token Pruning with Distribution Consistency Preservation

Xifeng Xue, Xiaokang Wang, Zirui Li, Ming-Ming Cheng, Guolei Sun

College of Computer Science, Nankai University, Tianjin, China, Nanjing University of Posts and Telecommunications, Nanjing, China

2026-06-16视觉感知

本文针对视觉语言模型在极低视觉 token 预算下剪枝不稳定的问题,指出性能下降与保留 token 相对全量 token 的特征分布偏移高度相关,并提出分布一致性度量。方法用 ACGR 在删除前把上下文信息转移到锚点 token,再用 TATCS 结合文本重选代表性 token。实验显示,在 LLaVA-1.5-7B 仅保留 16 个视觉 token 时仍达到上界平均性能的 92.1%。

SUP-MCRL: Subject-aware Unified Pseudo-feature Coded Multimodal Contrastive Representation Learning for EEG Visual Decoding Figure 1
2026-06-16cs.CV

SUP-MCRL: Subject-aware Unified Pseudo-feature Coded Multimodal Contrastive Representation Learning for EEG Visual Decoding

Shengyu Gong, Weiming Zeng, Yueyang Li, Zijian Kang, Hongjie Yan, Wai Ting Siok, Nizhuan Wang

Lab of Digital Image and Intelligent Computation, Shanghai Maritime University, Shanghai 201306, China, Department of Language Science and Technology, The Hong Kong Polytechnic University, Hung Hom, Kowloon, Affiliated Lianyungang Hospital of Xuzhou Medical University, Lianyungang 222002, China, unified framework integrating three collaborative mechanisms: (1) Semantic-entity Aware Vi-, subject and 24.0%/52.9% LOSO accuracy, surpassing state-of-the-art methods. Code is available at

2026-06-16视觉语言强化学习

这篇工作针对 EEG 视觉解码在自然图像零样本场景中因模态鸿沟、低信噪比和个体差异导致的伪对齐问题,将 EEG–图像匹配从单纯距离对齐改为带语义与主体约束的对比表示学习。SUP-MCRL 结合可学习语义实体视觉注意力、含多尺度空洞卷积与频带注意力的 EEG 增强器,以及 EMA 原型伪特征池来提高监督密度并抑制塌缩。在 THINGS-EEG 上,文中报告被试内 Top-1/Top-5 为 66.0%/91.9%,LOSO 为 24.0%/52.9%,优于既有方法。

DifferAD-R1: A Difference-Guided IndustrialAnomaly Localization with Multimodal LargeLanguage Models Figure 1
2026-06-16cs.CV

DifferAD-R1: A Difference-Guided IndustrialAnomaly Localization with Multimodal LargeLanguage Models

Dingrong Wang, Xian Tao, Zhen Qu, Hengliang Luo, Xinyi Gong, Fei Shen, Zhengtao Zhang, Guiguang Ding

Qwen3-VL (235B parameters). Our code is publicly available, Academy of Sciences (CAS) under Grant 2023145, and in part by the Beijing, the Institute of Automation, Chinese Academy of Sciences (CAS), Beijing, China, and also with the School of Artificial Intelligence, University, of Chinese Academy of Sciences, Beijing 100049, China., Xian Tao is with the Institute of Automation, CAS, Beijing 100190, China, CASI Vision Technology Co., Ltd., Luoyang 471000, China and also with, the Shandong Laboratory of Aluminum Advanced Manufacturing in Binzhou, (SLAAMB), Binzhou Institute of Technology, Weiqiao-UCAS Science and, Hengliang Luo is with CASI Vision Technology Co., Ltd., Luoyang 471000, Xinyi Gong is with the Space Information Research Institute, Hangzhou, Dianzi University, Hangzhou 310018, China.

2026-06-16视觉语言

本文针对工业缺陷定位中闭集方法跨场景泛化差、MLLM 问答范式难以精确定位且 GRPO 对细微缺陷信号不足的问题,提出 DifferAD-R1:将正常/待检双图输入重构为 one-shot 差异 grounding,并用双一致性定位奖励、难度感知重加权与组内重采样强化困难样本学习。作者还构建 20 类、13K 图像对的 AD-DualDiff,实验显示其优于现有基线,并接近 235B 参数 Qwen3-VL 的表现。

Rotational Symmetry based Object Pose Estimation from Point Clouds in the Absence of Known 3D Models Figure 1
2026-06-16cs.CV

Rotational Symmetry based Object Pose Estimation from Point Clouds in the Absence of Known 3D Models

Weichen Dai, Ruixun Yu, Yangjie Tang, Yifan Du, Yiyang Zhang, Donglei Sun, Hua Zhang

Key Laboratory of Brain Machine Collaborative Intelligence of Zhe-, jiang Province, School of Computer Science, Hangzhou Dianzi University, ufacturing Research Group, the University of Nottingham Ningbo China, using known 3D models. To address the model availability challenge, unlike, the object is available. However, high-quality 3D models of, industrial objects are not commonly available, often due to, a sequence of 3D measurements is available in an unknown, considering the limited availability and inconsistent quality of, industrial objects to address the problem of unavailability of

2026-06-16三维

面向工业喷涂等场景中 CAD/高质量三维模型因保密难以获取的问题,论文利用许多工件固有的旋转对称性作为几何先验,在无已知模型点云上通过旋转后的近邻对应构造对称约束损失,迭代联合优化物体位姿与点云修正。作者在四类合成物体和真实轮毂数据上验证,结果显示其精度可接近依赖已知三维模型的方法,并在噪声、遮挡下仍保持一定鲁棒性。

LOCUS: Local Visual Cue Search for Enhancing Fine-Grained Perception in Multimodal Large Language Models Figure 1
2026-06-16cs.CV

LOCUS: Local Visual Cue Search for Enhancing Fine-Grained Perception in Multimodal Large Language Models

Zhou Tao, Fang Zhang, Zewen Ding, Shida Wang, Xiaokun Sun, YongXiang Hua, Haoyu Cao, Linli Xu

University of Science and Technology of China, State Key Laboratory of Cognitive Intelligence

2026-06-16视觉语言

论文关注多模态大模型在高分辨率图像中仍难以利用小物体、细微属性等局部证据的问题,并将其归因于冗余视觉上下文导致的“visual context rot”。LOCUS 的核心做法是在训练时给出局部裁剪作为视觉线索,让模型在全图中用 IoU 奖励学习定位该线索,从而把局部证据搜索内化到模型中,推理时仍保持普通图像-问题接口。实验显示其在细粒度感知、幻觉鲁棒性等定位敏感任务上有稳定提升,同时基本保留通用理解与推理能力,注意力分析也显示模型更聚焦真实证据区域。

Multi-Modal Spatio-Temporal Graph Neural Network with Mixture of Experts for Soil Organic Carbon Prediction Figure 1
2026-06-16cs.LG

Multi-Modal Spatio-Temporal Graph Neural Network with Mixture of Experts for Soil Organic Carbon Prediction

Daniele Mos, Felipe Drummond, Anton Bossenbroek, Soufiane el Khinifri

information available in current satellite technologies and standard regressors treat each sample in

2026-06-16生成模型

本文针对传统土壤有机碳预测依赖手工协变量、难以利用多时相遥感信息且忽略采样点不规则空间结构的问题,提出 SpTGNN:用 TerraMind 提取 Sentinel/DEM 表征,将影像、环境、位置和时间特征经 MoE 融合,并在含地理邻近、NDVI 相似和高程相似三类边的异构图上做关系注意力传播,同时结合 Moran’s I 正则与集成不确定性估计。在约 4.9 万全球样本上评估,非洲测试集 5 模型集成达到 R²=0.762、RMSE=3.51 g/kg、MAPE=22.9%,显著优于 XGBoost;消融显示异构图、MoE 和微调骨干均有贡献。

Transformation-driven generation of comparable projection images from multimodal anatomical scenes Figure 1
2026-06-16cs.CV

Transformation-driven generation of comparable projection images from multimodal anatomical scenes

Dariusz Pojda, Krzysztof Domino, Michał Tarnawski, Agnieszka Anna Tomaka

2026-06-16视觉语言视觉感知

为减少动态颌面放射成像中的重复曝光,并提升运动场景的可控与可复现性,本文将DRR式投影从单体积渲染改写为“变换驱动”的多模态解剖场景观测:CT/CBCT、分割体、表面模型和治疗器具保持独立对象及显式空间变换。框架分离投影几何、采集、材料解释与显示,在pyDpVision中生成多种下颌运动/复位配置下可直接比较的VirtualRTG图像;物理逼真度并非重点,定量优势文中未充分说明。

PROSE: Training-Free Egocentric Scene Registration with Vision-Language Models Figure 1
2026-06-16cs.CV

PROSE: Training-Free Egocentric Scene Registration with Vision-Language Models

Zhiang Chen, Nahyuk Lee, Boyang Sun, Taein Kwon, Marc Pollefeys, Zuria Bauer, Sunghwan Hong

VGG, University of Oxford, ETH AI Center

2026-06-16视觉语言视觉感知

面向机器人/AR跨时间重访同一室内空间时,头戴RGB视角模糊、重叠少且点云不可靠的问题,PROSE用预训练VLM同时构建开放词汇3D场景图并做跨扫描物体匹配,通过高度分桶、同/不同验证和几何一致性投票估计刚体位姿,无需训练、深度或标注图。在Aria Digital Twin与AEA上,其配准召回、旋转和平移误差均优于几何和学习式场景图基线,并可支持下游路径规划。

Local-GS: Accelerating 3D Gaussian Splatting via Tile-Local Warp Coherence Figure 1
2026-06-16cs.CV

Local-GS: Accelerating 3D Gaussian Splatting via Tile-Local Warp Coherence

Yang Luo, Yan Gong, Yongsheng Gao, Jie Zhao, Xinyu Zhang, Huaping Liu

Blending scenes. Code: https://github.com/tilaba/Local-GS.git., Laboratory of Robotics and Systems, Harbin Institute of Technology, Harbin, Xinyu Zhang is with the State Key Laboratory of Intelligent Green Vehicle, and Mobility, the School of Vehicle and Mobility, Tsinghua University, Beijing, Huaping Liu is with the Department of Computer Science and Technology, memory latency, threads execute collaborative prefetching

2026-06-16三维

本文针对3D Gaussian Splatting在复杂场景中因高斯分布不规则导致的GPU warp分歧、无效访存和重复alpha计算问题,提出Local-GS:不再按几何粗粒度组织渲染,而是围绕SIMT执行边界做tile-local参数提升、warp级剔除和无分支混合。其作为纯kernel级插件不改变场景表示,在多数据集保持画质,Deep Blending上与FlashGS结合相对原始3DGS最高达7.76×加速。

Assessing Reliability of Symbol Detection in Concept Bottleneck Models Figure 1
2026-06-16cs.LG

Assessing Reliability of Symbol Detection in Concept Bottleneck Models

Javier Fumanal-Idocin, Javier Andreu-Perez

University of Essex, Wivenhoe Park, Essex, United Kingdom, concept labels by building post-hoc or label-free bottlenecks from pretrained, code label-relevant signals that are not part of the intended concept semantics

2026-06-16视觉感知

这篇论文针对概念瓶颈模型中“任务准确率高但概念符号不可信”的问题,提出用独立训练的概念检测器与分类头互换来压力测试符号可靠性,并结合概念级指标与不确定性定位伪触发;还引入多头、可靠性感知训练抑制信息泄漏。结果显示,CUB全监督下互换几乎无损,而合成任务在弱概念监督时概念对齐会崩塌,该方法可在泄漏区间约翻倍互换准确率。

Kairos: A Native World Model Stack for Physical AI Figure 1
2026-06-16cs.AI

Kairos: A Native World Model Stack for Physical AI

Kairos Team, Fei Wang, Shan You, Qiming Zhang, Tao Huang, Zuoyi Fu, Zhisheng Zheng, Yunlong Xi, Feng Lv, Xiaoming Wu, Zeyu Liu, Cong Wan, Pu Li, Ruiqing Yang, Xiaoou Li, Wei Wang, Kangkang Zhu, Yuwei Zhang, Shi Fu, Xiaoning Wu, Xuzeng Fan, Dacheng Tao, Xiaogang Wang

2026-06-16强化学习

面向物理智能中世界模型从视频生成走向可部署基础设施的需求,Kairos试图同时解决异构经验学习、长时状态保持与低延迟运行。其核心是跨具身数据课程、统一理解/生成/预测架构和混合线性时序注意力,并配合系统协同设计。文中称在具身世界模型、长时预测和动作策略基准上达到领先表现,但增益可能主要来自大规模数据与工程 scaling。

BadWorld: Adversarial Attacks on World Models Figure 1
2026-06-16cs.CV

BadWorld: Adversarial Attacks on World Models

Linghui Shen, Mingyue Cui, Xingyi Yang

The Hong Kong Polytechnic University

2026-06-16强化学习

面向机器人、自动驾驶等安全场景中越来越常用的交互式视觉世界模型,本文关注单张上下文图像的微小扰动是否会破坏后续动作条件 rollout。作者提出 BadWorld:用自监督速度攻击绕开未来视频标签缺失,并用轨迹自适应双层优化提升对未知控制序列的泛化。实验显示,在连续相机和离散动作控制模型上,几乎不可见的扰动会导致去噪不完整、结构崩塌、语义漂移和控制不一致,暴露出现有世界模型的显著鲁棒性风险。

Active Reference Acquisition in Few-Shot Font Generation Figure 1
2026-06-16cs.CV

Active Reference Acquisition in Few-Shot Font Generation

Shinnosuke Matsuo

NTT, Inc., Japan, code is available at https://github.com/matsuo-shinnosuke/ActiveRef-, Designing a font is a highly time-consuming and labor-intensive process that, ⋆This work was conducted while the author was affiliated with Kyushu University.

2026-06-16视觉感知

本文针对少样本字体生成中“参考字形固定”导致复杂风格覆盖不足的问题,提出设计师在环的主动参考获取框架。核心洞察是字体风格由局部笔画部件表征,方法用 SIFT 等局部特征聚类成部件直方图,并选择能最大化当前参考集部件覆盖、减少冗余的下一个查询字形。在 Google Fonts 上,相比随机查询和不考虑当前参考集的固定/覆盖策略,用更少查询获得更高生成质量。

Lost at the End: Primacy Bias in Multimodal Retrieval-Augmented Question Answering Figure 1
2026-06-16cs.CL

Lost at the End: Primacy Bias in Multimodal Retrieval-Augmented Question Answering

Jieyuan Liu, Jianyang Gu, Shijie Chen, Jefferson Chen, Zhen Wang

University of California, San Diego, The Ohio State University

2026-06-16视觉语言

本文关注多模态知识增强 VQA 中检索证据放在提示不同位置时读者是否同样可用,挑战仅看 recall@k 的假设。作者设计只移动黄金段落槽位的受控协议,在3个7B/8B VLM和两个KB-VQA基准上发现并非文本LLM常见的“中间丢失”U形,而是强首因偏置:首位比末位高16–26个百分点;消融表明多模态会放大文本侧偏置,主要锚定提示slot 0,简单重排、MMR或oracle rerank难以修复。

Unified Multimodal Model for Brain MRI Imputation and Understanding Figure 1
2026-06-16cs.CV

Unified Multimodal Model for Brain MRI Imputation and Understanding

Zhiyun Song, Che Liu, Tian Xia, Avinash Kori, Wenjia Bai

Department of Computing, Imperial College London, London, UK, Department of Brain Sciences, Imperial College London, London, UK, of modality incompleteness. Source code is publicly available at https:, Explicit methods leverage the available modalities to synthesise images of miss-, itly in the model. Some of these methods align the representations of the available, ple generative modules to map representations of available images to those of

2026-06-16视觉语言

针对临床脑 MRI 常缺失 T1/T2/FLAIR 等模态、两阶段补全再诊断易割裂的问题,UniBrain 将缺失模态生成、影像描述与最终诊断统一为自回归交错序列,并用自对齐学习细粒度解剖表征、动态 hidden state 缓解长上下文误差累积。多疾病 MRI 实验显示其在模态补全保真度、报告生成和疾病诊断准确率上均表现较强,但计算开销仍高。

Uncertainty Quality of VGGT: An Analysis on the DTU Benchmark Dataset Figure 1
2026-06-16cs.CV

Uncertainty Quality of VGGT: An Analysis on the DTU Benchmark Dataset

Markus Hillemann, Robert Langendörfer, Steven Landgraf, Markus Ulrich

Institute of Photogrammetry and Remote Sensing, Karlsruhe Institute of Technology, Germany -, optimization. For photogrammetry, this opens new possibilities for real-time, scalable, and accessible 3D reconstruction. In this, photogrammetric use cases requiring scalability and fast pro-

2026-06-16数据集/基准安全鲁棒

本文针对 VGGT 在安全关键三维重建中“置信度是否可信”的问题,系统评估其原生 aleatoric 不确定性在 DTU 基准上的作用,而非只看几何精度。核心洞察是直接分析无后处理的点图与深度图分支,并用 PAvPU、AUSE 等指标检验不确定性质量。结果显示置信阈值 2.0 可作为过滤原始输出的实用起点,点图分支在重建精度和不确定性质量上优于深度图分支,深度图存在过度自信;改进不确定性预测有望进一步提升精度。

AURA: Active-Response Attribution under Treatment Ambiguity in Bacterial Cytological Profiling Figure 1
2026-06-16cs.CV

AURA: Active-Response Attribution under Treatment Ambiguity in Bacterial Cytological Profiling

Kartik Jhawar, Mrunmayee Deshpande, Wilfried Moreira, Guillermo C. Bazan, Lipo Wang

Institute for Digital Molecular Analytics and Science, Nanyang Technological University, Singapore 636921, School of Electrical and Electronic Engineering, Nanyang Technological University, Singapore 639798, Institute for Functional Intelligent Materials, National University of Singapore, Singapore 117544, the lowest reconstruction energy, using no strain label at test, ing where generic multi-label classification fails., or response labels, but they do not explicitly encode the, that always returns a label [47, 48].

2026-06-16视觉感知

论文关注多抗生素处理下“施加药物”与显微形态中真正起效药物不一致的问题。AURA将其建模为带约束的能量式逆归因,利用活性集合必须是施加集合子集的先验,将残差形态分解为药物响应原子并选最低重构能量,AURA-E还能在证据接近时拒答。在E. coli跨重复实验中精确匹配率达95.47%,显著高于朴素规则37.43%,拒答后80%覆盖率下达97.86%。

MVOFormer: Flow-Semantic Transformer for Robust Monocular Visual Odometry Figure 1
2026-06-16cs.CV

MVOFormer: Flow-Semantic Transformer for Robust Monocular Visual Odometry

Jituo Li, Shunwang Sun, Jialu Zhang, Xinqi Liu, Jinyao Hu, Zhicheng Lu, Sajad Saeedi, Guodong Lu

Zhicheng Lu is with the Rural Health Research Institute, Charles Sturt University, Sydney, Australia., Sajad Saeedi is with University College London, U.K.

2026-06-16生成模型安全鲁棒

针对单目视觉里程计在动态物体、低纹理和跨域部署中易失效,以及现有学习式方法要么表征不够可解释、要么流水线复杂的问题,MVOFormer用光流-语义双分支编码器联合建模像素运动与对象级先验,并通过迭代多模态解码器抑制不可靠区域、逐步细化6DoF位姿。在TartanAir、KITTI、TUM-RGBD和ETH3D-SLAM上,无目标域微调时优于已有学习式帧间方法,显示出更强零样本鲁棒性。

Decoupled Object-Centric Video Understanding for Generating Robotic Manipulation Commands Figure 1
2026-06-16cs.CV

Decoupled Object-Centric Video Understanding for Generating Robotic Manipulation Commands

Thanh Nguyen Canh, Thanh-Tuan Tran, Haolan Zhang, Ziyan Gao, Xiem HoangVan, Nak Young Chong

2026-06-16机器人视觉感知

针对机器人从示教视频生成指令时常把动作说对却选错物体的问题,论文将动作识别与物体识别解耦:用 TSM 建模时序动作,再通过轨迹角色、模糊检测和重叠抑制选择任务相关物体,并交给 VLM 做类别识别。改造 Something-Something V2 上动作准确率 86.79%,标准/新物体 BLEU-4 为 0.337/0.261,较最强专用基线提升明显。

ResEdit: Residual embeddings for precise generative image editing Figure 1
2026-06-16cs.CV

ResEdit: Residual embeddings for precise generative image editing

Ahmet Canberk Baykal, Valentin Deschaintre, Yannick Hold-Geoffroy, Michael Fischer, Anna Frühstück, Cengiz Öztireli, Iliyan Georgiev

University of Cambridge

2026-06-16视觉感知生成模型

针对扩散反演编辑中噪声潜变量容易“烘入”身份与条件信息、导致编辑僵硬或身份漂移的问题,ResEdit将图像身份单独编码为可优化的残差嵌入,并用梯度反转抑制其携带待编辑内禀条件,从而把重建负担从噪声转移到旁路条件。实验显示其在内禀空间编辑、重光照及初步文本编辑中提升了身份保持与编辑响应性,甚至可降低对精确反演的依赖。

PermaVid: Consistent Video Generation Across Edits via Disentangled Context Memory Figure 1
2026-06-16cs.CV

PermaVid: Consistent Video Generation Across Edits via Disentangled Context Memory

Shuai Yang, Bingjie Gao, Ziwei Liu, Jiaqi Wang, Dahua Lin, Tong Wu

Shanghai Jiao Tong University, Stanford University, S-Lab, Nanyang Technological University, The Chinese University of Hong Kong, Shanghai Innovation Institute

2026-06-16视觉感知

这篇论文关注视频生成在连续相机运动和编辑后重访场景时容易使用过期记忆、导致语义回退或几何错位的问题。PermaVid的核心洞察是将空间上下文拆成易变的语义外观与相对稳定的几何结构,用RGB记忆和深度记忆分别存储,并通过编辑感知的更新与检索进行多模态融合。实验显示其在全局风格编辑和局部对象编辑后能更好保持长期语义与结构一致性,优于已有方法。

Hierarchical Fine-Grained Aerial Object Detection Figure 1
2026-06-16cs.CV

Hierarchical Fine-Grained Aerial Object Detection

Yan Zhang, Fang Xu, Wen Yang, Gui-Song Xia

detection, relying solely on single-label supervision and thus, levels. The dataset, benchmark, and code are available at, Yan Zhang is with the School of Computer Science, Wuhan University, Fang Xu and Gui-Song Xia are with the School of Artificial Intelligence, Wen Yang is with the School of Electronic Information, Wuhan University, category labels as supervision [14]–[17], with the expectation, specific appearances from category labels and embed struc-, publicly available collection of model-specific categories for, scalability of such methods.

2026-06-16视觉感知

针对遥感细粒度检测中仅靠单标签难以区分舰船、飞机型号细微结构差异的问题,论文提出 ExpertDet,将专家属性与类别层级作为监督信号:用掩码属性重建对齐视觉细节,并以层级原型树和对比约束保持跨层语义连续、强化兄弟类区分。作者还构建含 106 类舰船和 30 类飞机的 PSP 基准;实验显示该方法在多种检测器、PSP 各层级及已有细粒度数据集上均取得稳定提升。

V2P-Manip: Learning Dexterous Manipulation from Monocular Human Videos Figure 1
2026-06-16cs.RO

V2P-Manip: Learning Dexterous Manipulation from Monocular Human Videos

Kaihan Chen, Yanming Shao, Haifeng Ji, Xiaokang Yang, Yao Mu

Zhejiang University, Hangzhou, China, Shanghai Jiao Tong University, Shanghai, China, Shanghai AI Laboratory, Shanghai, China

2026-06-16机器人视觉感知

V2P-Manip针对遥操作/动捕数据昂贵且单目人类视频存在深度歧义、遮挡和物理不一致的问题,提出从非结构化RGB视频到灵巧手策略的完整流程,结合3D资产获取、尺度恢复、轨迹估计与两阶段几何/接触约束优化,并用残差学习缩小策略探索空间。在TACO、OakInk及合成任务中,其位姿精度、训练效率和环境适应性优于基线,多任务平均成功率超过75%,且可迁移到五种不同灵巧手。

Beer-Lambert Guided Representation Learning for Unsupervised Anomaly Detection in Sub-THz Food Inspection Images Figure 1
2026-06-16cs.CV

Beer-Lambert Guided Representation Learning for Unsupervised Anomaly Detection in Sub-THz Food Inspection Images

Gyutae Hwang, Sang Jun Lee

Division of Electronics and Information Engineering, Jeonbuk National University, cues for anomaly detection, the publicly available Inline-

2026-06-16视觉感知

针对食品异物检测中低密度污染物难以用传统成像和RGB预训练特征可靠识别的问题,本文把Sub-THz透射图像的物理衰减机制引入无监督异常检测,用Beer-Lambert定律约束表征学习,并通过吸收/厚度分解重建衰减图作为辅助正则;同时提出LOFO评估跨食品泛化。在Inline-Food-Inspection-THz上,相比基线整体检测性能提升,但具体增益幅度文中片段未充分说明。

Instance-Aware Knowledge Distillation for Semi-Supervised Learning of an On-Board Multi-Task Dense Prediction Model for Collision Avoidance System Figure 1
2026-06-16cs.CV

Instance-Aware Knowledge Distillation for Semi-Supervised Learning of an On-Board Multi-Task Dense Prediction Model for Collision Avoidance System

Gyutae Hwang, Sang Jun Lee

aDivision of Electronics and Information Engineering, Jeonbuk National University, 567 Baekje-daero, Deokjin-gu, Jeonju, 54896, Republic of Korea, supervised learning. Specifically, we generate pseudo labels that mitigate teacher bias by leveraging, curs substantial labeling costs [5]., objects, resulting in a labor-intensive and time-consuming, labeling process. Semi-supervised learning (SSL) is a prac-, tical training approach that uses both labeled and unlabeled, and self-training, among which pseudo labeling is the most, widely used. Pseudo labels are usually generated from the, predictions of a prototype model trained on labeled dataset, teacher model are well suited for pseudo label generation, trained on a small labeled dataset often shows limited gen-, omission or incomplete pseudo masks on unlabeled data. To

2026-06-16视觉感知

面向乡村俱乐部等通信不稳、算力受限且标注昂贵的车载避障场景,论文将实例分割与单目深度整合为轻量多任务模型,并提出实例感知半监督蒸馏:用教师的领域先验结合 SAM、Depth Anything 等基础模型生成伪标签以减轻教师偏差。实测中学生模型实例分割超过大教师、深度退化受控,同时 FLOPs 降低 22.68×、参数降低 14.33×,低成本边缘设备达 6.46 FPS。

RGFVR: Reference-Guided Face Video Restoration with Flow Matching Figure 1
2026-06-16cs.CV

RGFVR: Reference-Guided Face Video Restoration with Flow Matching

Cem Eteke, Batuhan Tosun, Eckehard Steinbach

2026-06-16视觉感知生成模型

该文针对重度退化人脸视频中仅靠退化帧易丢失身份、而现有参考引导视频方法又需逐人优化的问题,提出无需主体特定微调的参考图像引导恢复框架。方法将感知与描述性双模态身份表征注入预训练 flow-based 视频生成器,并用两阶段训练增强身份条件。实验显示其在下采样、模糊、噪声和压缩等退化下提升保真度、时序一致性与身份保持,PSNR、LPIPS、DISTS、IDS、FVD等指标优于多数基线。

SP$^3$: Spherical Priors for Plug-and-Play Restoration Figure 1
2026-06-16cs.CV

SP$^3$: Spherical Priors for Plug-and-Play Restoration

Sean Man, Ron Raphaeli, Matan Kleiner, Or Ronai

Technion – Israel Institute of Technology

2026-06-16视觉感知

针对扩散/flow 等零样本图像复原方法推理需反复求梯度、速度较慢的问题,SP3 将 Plug-and-Play 中的去噪先验替换为 Spherical Encoder 的球面潜空间投影,并用 HQS 在流形投影与闭式数据一致性步骤间交替,无需反传即可收敛且具备 anytime 输出。实验显示其感知质量接近主流扩散/flow 方法,同时快约 3–630 倍,但也更偏向感知真实,失真指标和后验采样能力受限。

Towards UAV Image Dehazing: A UAV Atmospheric Scattering Model, Benchmark, and Geometry-Aware Deep Unfolding Network Figure 1
2026-06-16cs.CV

Towards UAV Image Dehazing: A UAV Atmospheric Scattering Model, Benchmark, and Geometry-Aware Deep Unfolding Network

Wenxuan Fang, Jiangwei Weng, Yu Zheng, Junkai Fan, Guangfa Wang, Xiang Chen, Jian Yang, Jun Li

School of Computer Science and Engineering, Nanjing University of Science and Technology, lable paired synthetic data together with 2,285 real UAV haze, UASM-HazeSet, which consists of a controllable syn-

2026-06-16视觉感知数据集/基准

针对无人机高空、大俯仰成像中雾霾呈现上重下轻且真实成对数据难获取的问题,论文提出显式建模飞行高度、视角与垂直消光的 UASM,并据此构建含 2.2 万合成对和 2285 张真实图的基准;GP-DUN 将该物理模型展开为几何感知去雾网络,实验显示在合成与真实无人机雾图上均优于现有方法。

GraphBEV++: Multi-Modal Feature Alignment for Autonomous Driving Figure 1
2026-06-16cs.CV

GraphBEV++: Multi-Modal Feature Alignment for Autonomous Driving

Ziying Song, Caiyan Jia, Lin Liu, Shaoqing Xu, Lei Yang, Yadan Luo

Beijing Key Laboratory of Traffic Data Mining and Em-, bodied Intelligence, School of Computer Science and Tech-, University, School of Artificial Intelligence (School of Software), Yan-, shan University. 3University of Macau, Nanyang Technological University, The University of Queensland

2026-06-16视觉感知

论文聚焦自动驾驶 BEV 多模态融合中常被忽略的相机-LiDAR 标定误差导致的特征错位问题。GraphBEV++用 LocalAlign-v2 通过邻域深度/图匹配修正局部错位,并用 GlobalAlign-v2 的可变形偏移或扩散去噪处理 LSS 与 Query BEV 的全局错位。实验显示其在 nuScenes、Waymo 噪声设置、Argoverse2 远距检测、3D 占据及端到端驾驶评测中提升鲁棒性和精度。

What Should a Streaming Video Model Remember? Figure 1
2026-06-16cs.CV

What Should a Streaming Video Model Remember?

Haonan Ge, Yiwei Wang, Hang Wu, Yujun Cai

University of California, Santa Barbara, University of California, Merced, The University of Queensland

2026-06-16视觉感知

论文关注流式视频模型在固定记忆与计算预算下如何避免“记得太多反而干扰当前感知”。作者将问题表述为在线潜在证据分配,提出 SelectStream:用惊讶度自适应写入、优先级合并和查询条件图推理,在冻结 VLM 中注入少量校准潜在证据而非回放历史帧。实验在 StreamingBench 达 82.67%、OVO-Bench 达 67.03%,离线视频平均 74.4%,优于近期窗口和既有记忆方法。

When the Past Matters: FlashBack Memory for Precipitation Nowcasting Figure 1
2026-06-16cs.CV

When the Past Matters: FlashBack Memory for Precipitation Nowcasting

Yuhao Du, Boxiao Huang, Chengrong Wu, Jiankai Zhang

2026-06-16视觉感知

针对高分辨率降水临近预报中 RNN 模型易遗忘、长时依赖不足并导致漏报和虚警的问题,论文提出 FlashBack Memory:按当前状态动态检索相关历史隐状态,经轻量动态路由聚合,并用自适应门与当前表示融合。该模块可插入 PredRNN 系列、MIM、MotionRNN 等,在 CIKM2017、Shanghai2020、SEVIR 上改善 MSE、MAE、SSIM、CSI,长序列和强降水场景收益更明显。

Chronological Blindness: Benchmarking Temporal Reasoning in Vision-Language Models with CHRONOSIGHT Figure 1
2026-06-16cs.CV

Chronological Blindness: Benchmarking Temporal Reasoning in Vision-Language Models with CHRONOSIGHT

Parthaw Goswami, Jaynto Goswami Deep

2026-06-16视觉语言视觉感知数据集/基准

论文针对现有 VLM 评测很少衡量静态图像中的“何时”理解,提出 ChronoSight 基准,将时间推理拆成排序、阶段定位、时间间隔估计、反向检测和异常项识别五类任务,覆盖 8 类过程共 1000 项。实验显示开源 VLM 与人类差距显著:人类均分约 0.89,最佳 Qwen2.5-VL-7B 仅 0.40;同时发现结构化输出失败会掩盖能力,少量 LoRA 微调可把 ChronoDelta 从近零提升到 0.43,并迁移到相关任务。

Differentiable Packing of Irregular 3D Objects with Adaptive Container Estimation Figure 1
2026-06-16cs.CV

Differentiable Packing of Irregular 3D Objects with Adaptive Container Estimation

Palak Gupta, Shanmuganathan Raman

Indian Institute of Technology Gandhinagar, India

2026-06-16三维

针对不规则三维物体装箱中容器常被预设、或只优化单一尺寸且依赖复杂物理/FFT管线的问题,论文提出纯 PyTorch 的可微框架,在同一梯度循环中联合优化物体 6N 位姿与三维容器尺寸,并用六类物理启发损失和自适应收缩机制压紧空间。实验显示其张量化 pairwise 计算带来 3.4–54 倍加速,100 个物体约 3–4 分钟完成,容器体积较 DBLF、模拟退火等基线小 11%–32%。

Attention-Based Prototype Calibration for Multi-Rater Few-Shot Medical Image Segmentation Figure 1
2026-06-16cs.CV

Attention-Based Prototype Calibration for Multi-Rater Few-Shot Medical Image Segmentation

Truong Vu, Minh Khoi Ho, Yutong Xie

2026-06-16视觉感知

本文针对少样本医学分割默认单一真值、难以处理多专家标注差异的问题,提出少样本多标注者分割设定,并在原型空间中用注意力校准建模各标注者相对共识原型的系统偏移,配合校准损失、伪风格生成和两阶段训练,无需改动骨干即可接入现有原型方法。CURVAS 与 QUBIQ 实验显示其按标注者 Dice 稳定优于少样本和多标注者基线,但胰腺场景仍落后部分超体素方法。

HAFMat: Hybrid Priors Guided Adaptive Fusion for Single-Image Human Material Estimation Figure 1
2026-06-16cs.CV

HAFMat: Hybrid Priors Guided Adaptive Fusion for Single-Image Human Material Estimation

Yu Jiang, Jiahao Xia, Jiongming Qin, Jianchi Sun, Chunxia Xiao

School of Computer Science, Wuhan University, Wuhan, Jiahao Xia. Faculty of Engineering and IT, University of, lenging because the visual evidence available in a single, graphics and centers on two core tasks: PBR mate-

2026-06-16视觉感知

单张人体图像中光照、几何与反射强耦合,PBR材质估计易产生歧义。HAFMat的核心洞察是不同先验并非同质:SMPL几何、DensePose、RGB表观及HM/AFHR材质预测分别偏向纹理约束或语义结构,因此用多层自适应特征融合在解码不同阶段引入这些引导。实验称其在OpenHumanBRDF和真实数据上优于既有方法,并带来更真实的重光照结果。

Training-free sparse attention based on cumulative energy filtering Figure 1
2026-06-16cs.CV

Training-free sparse attention based on cumulative energy filtering

Chunlu Li, Yixuan Pan, Bai Du, Zhenyuan Chen, Yanzhao Li, Hui Dong, Hui Wang, Zhiqiang Zou

2026-06-16视觉感知

面向视频生成 DiT 中注意力随序列长度二次增长的推理瓶颈,论文将稀疏注意力的 token 过滤表述为“高稀疏、低精度损失”的双目标问题,指出固定 Top-K/Top-P 或固定阈值难以兼顾两者。其核心是利用 Flash Attention 循环中的累计能量动态设阈,无需额外 mask 计算;在 Wan 2.2 上相较 BLASST 将稀疏率由 61.42% 提升到约 82%,VBench 下降小于 5%,计算效率提升约 1.61 倍。

Explainable Flood Segmentation on Sentinel-1 SAR Imagery: A Comparative Study of CNN and Transformer Architectures Figure 1
2026-06-16cs.CV

Explainable Flood Segmentation on Sentinel-1 SAR Imagery: A Comparative Study of CNN and Transformer Architectures

Arundhuti Banerjee, David Daou

United Nations University’s Institute for Environment and Human Security (UNU-EHS)

2026-06-16视觉感知

针对SAR洪水监测中临时淹没区与永久水体易混淆、且模型黑箱难以用于应急决策的问题,本文将Sentinel-1洪水分割设为三类任务,并在场景级划分下比较U-Net、DeepLabV3等CNN与SegFormer系列,同时加入可解释性和不确定性评估。结果显示SegFormer-b2在ETCI各测试场景的洪水IoU均优于U-Net,但在Sen1Floods11微调后优势缩小;其解释更忠实、激活更连贯,而U-Net边界不确定性和校准略好。

DDTNet: Degradation Disentanglement and Transfer Network for Test-Time All-in-One De-weathering Adaptation Figure 1
2026-06-16cs.CV

DDTNet: Degradation Disentanglement and Transfer Network for Test-Time All-in-One De-weathering Adaptation

Kuan-Hung Lin, Fu-Jen Tsai, Yan-Tsung Peng, Min-Hung Chen, Chia-Wen Lin, Yen-Yu Lin

2026-06-16视觉感知

针对统一去雨、去雾、去雪模型在多任务折中和训练/测试域差下表现下降的问题,DDTNet将重点从直接恢复干净内容转向更易建模的退化模式:用双分支编码器和DDM/DCA两阶段注意力从目标域恶劣天气图像中解耦退化,并迁移到源域干净图像上生成成对自适应数据,用于测试时微调任意all-in-one复原模型。实验显示其在真实去雨、去雪、去雾基准上能稳定提升现有模型表现。

VisualClaw: A Real-Time, Personalized Agent for the Physical World Figure 1
2026-06-16cs.CV

VisualClaw: A Real-Time, Personalized Agent for the Physical World

Haoqin Tu, Jianwen Chen, Zijun Wang, Siwei Han, Juncheng Wu, Hardy Chen, Haonian Ji, Kaiwen Xiong, Jiaqi Liu, Peng Xia, Jieru Mei, Hongliang Fei, Jason Eshraghian, Zeyu Zheng, Yuyin Zhou, Huaxiu Yao, Cihang Xie

2026-06-16强化学习

VisualClaw针对实时视频代理在边缘部署中帧上传成本高、技能库提示膨胀且部署后难以个性化的问题,提出级联帧筛选与冷热技能注入,并用失败记忆离线演化技能库。在4个视频问答基准上平均API成本较全帧上传降约98%、多数设置准确率提升;其VisualClawArena也显示工具型代理宏准确率提升约2.9–3.2个百分点。

Sex-based Network-Specific Differences in Connectomes: A Krakencoder-Based Analysis Figure 1
2026-06-16cs.CV

Sex-based Network-Specific Differences in Connectomes: A Krakencoder-Based Analysis

Vibhashree S H, Debanjali Bhattacharya, Vamshi Krishna Kancharla, Neelam Sinha

Centre for Brain Research, Indian Institute of Science, Bengaluru 560012, India, Dept. of Artificial Intelligence, Amrita School of Artificial Intelligence, Amrita Vishwa Vidyapeetham, Bengaluru 560035, India

2026-06-16视觉感知

该文关注结构/功能脑连接组中某一网络缺失会如何影响跨模态预测,以及这种扰动是否保留性别信息。作者用 Krakencoder 做 Yeo-7 网络逐一置零消融,并以谱 KL、Frobenius 范数和 Wasserstein 距离评估扰动。结果显示默认模式网络对 SC↔FC 映射影响最大、躯体运动网络最小;扰动特征的性别分类最高仅 66.09%,而完整预测连接组可达 84.76%,说明性别判别信息主要仍在完整连接模式中。

RealityBridge: Bridging Editable 3D Gaussian Splatting Driving Simulations and Real-World Videos Figure 1
2026-06-16cs.CV

RealityBridge: Bridging Editable 3D Gaussian Splatting Driving Simulations and Real-World Videos

Zhenhua Wu, Yun Pang, Mingkun Chang, Yuwei Ning, Liangzhi Wang, Yi Xiao, Guanbin Li

2026-06-16视觉感知强化学习三维

面向自动驾驶长尾危险场景,论文关注可编辑3DGS仿真虽可控但渲染伪影、光照不一致和时序闪烁导致Sim-to-Real落差的问题。RealityBridge以视频级多模态条件、前景/边缘/语义约束和GateNet自适应分配控制,并结合定向数据、长视频自回归训练与奖励后训练,在内部和公开数据上较现有修复/生成方法提升伪影去除、资产光照融合和长序列一致性。

GraphWorld: Long-Horizon Planning with World Models for End-to-End Autonomous Driving Figure 1
2026-06-16cs.CV

GraphWorld: Long-Horizon Planning with World Models for End-to-End Autonomous Driving

Ziying Song, Caiyan Jia, Lin Liu, Lei Yang, Shengkai Zhang, Feiyang Jia, Fengda Zhao, Peiliang Wu, Shaoqing Xu, Chen Lv, Yadan Luo

Lei Yang and Chen Lv are with School of Mechanical and Aerospace Engineering, Nanyang Technological University, Singapore., Fengda Zhao and Peiliang Wu are with the School of Artificial Intelligence (School of Software), Yanshan University, Qinhuangdao, China., Shaoqing Xu is with University of Macau, China., Yadan Luo is with The University of Queensland, Australia.

2026-06-16强化学习规划控制

这篇论文针对端到端自动驾驶多偏短视规划、难以建模长时交互的问题,提出 GraphWorld:不生成像素级未来场景,而用自车中心交互图筛选关键邻车,并学习潜在世界状态来重加权多模态轨迹查询。实验覆盖 Bench2Drive、NAVSIM 和 nuScenes,显示其在长时规划中降低碰撞率、提升安全性;文中还报告 nuScenes 6 秒任务较 World4Drive 平均碰撞率降 19.5%,NAVSIMv1 较 DiffusionDrive 快 13.3%。

Contrastive Learning for Seismic Horizon Tracking with Domain-Specific Priors Figure 1
2026-06-16cs.CV

Contrastive Learning for Seismic Horizon Tracking with Domain-Specific Priors

Alexandre Thouvenot, Lionel Boillot, Vincent Gripon

Alexandre Thouvenot and Vincent Gripon are with IMT Atlantique, LAB-STICC

2026-06-16视觉感知

针对无监督三维地震层位追踪中“信号传播精确但遇断层易失效、深度纹理模型鲁棒但依赖标注且精度下降”的矛盾,论文用反射层斜率估计的可靠道间对应作为领域先验,构造高置信正样本与道内负样本训练对比式体素嵌入,并通过相似性搜索跨不连续区域传播层位。在 F3 与含断层合成数据上,该方法较无监督基线降低 MAE,并接近使用单张标注切片的半监督方法。

Wavelength-Multiplexed 2D Beam Steering via a Passive Diffractive Network Figure 1
2026-06-16cs.CV

Wavelength-Multiplexed 2D Beam Steering via a Passive Diffractive Network

Che-Yung Shen, Yuhang Li, Cagatay Isil, Tianyi Gan, Mona Jarrahi, Aydogan Ozcan

Electrical and Computer Engineering Department, University of California, Los Angeles, CA, 90095, USA, Bioengineering Department, University of California, Los Angeles, CA, 90095, USA, California NanoSystems Institute (CNSI), University of California, Los Angeles, CA, 90095, USA, addressable diffractive architecture establishes a compact and scalable paradigm for high-speed

2026-06-16视觉感知

针对机械扫描、液晶/相控阵光束 steering 在速度、体积和主动控制上的限制,以及传统光栅只能一维色散路由的问题,本文用深度学习反向设计多层被动衍射网络,把波长作为寻址变量实现任意二维出射角映射。数值上在400–750 nm的625个通道实现25×25光束位置,平均PSNR约33.3 dB、定位误差约0.18λ,并在太赫兹与可见光实验中验证了波长复用转向。

KeepLoRA++: Continual Learning with Layer-Scaled Residual Gradient Adaptation Figure 1
2026-06-16cs.CV

KeepLoRA++: Continual Learning with Layer-Scaled Residual Gradient Adaptation

Mao-Lin Luo, Yi-Lin Zhang, Zi-Hao Zhou, Yankun Hong, Xialiang Tong, Mingxuan Yuan, Tong Wei, Min-Ling Zhang

are with the School of Computer Science and Engineering, Southeast Univer-, sity, Nanjing 210096, China, and the Key Laboratory of Computer Network, and Information Integration, Southeast University, Ministry of Education, Noah’s Ark Lab., frequent unavailability of proprietary training corpora [10]–

2026-06-16优化算法

针对预训练视觉语言模型持续学习中“学新任务、保旧任务、保零样本迁移”难以兼顾的问题,KeepLoRA++指出通用知识更多位于浅层和参数主子空间,任务特化知识位于深层和残差子空间;据此将LoRA梯度投影到避开预训练主子空间与旧任务方向的残差空间,并采用浅层小、深层大的缩放。实验覆盖图像分类、VQA和视频理解,报告相较O-LoRA、InfLoRA、SD-LoRA等基线更稳健。

UniDDT: Unifying Multimodal Understanding and Generation with Decoupled Diffusion Transformer Figure 1
2026-06-16cs.CV

UniDDT: Unifying Multimodal Understanding and Generation with Decoupled Diffusion Transformer

Shuai Wang, Liang Li, Yang Chen, Ruopeng Gao, Yao Teng, Limin Wang

Nanjing University, University of Hong Kong

2026-06-16视觉语言生成模型

针对统一多模态模型中理解与生成目标冲突、视觉空间割裂和训练数据二元性利用不足的问题,UniDDT以Noisy ViT和LLM共享语义编码,在统一潜空间中连接理解与生成,并用独立扩散解码器解耦图像生成;同时从同一图文对构造双向数据。实验显示其在生成侧达到GenEval 0.87、DPG 86.9,在理解侧达到MME 1699.5、SEEDbench 76.5。

Learned Image Compression for Vision-Language-Action Models Figure 1
2026-06-16cs.CV

Learned Image Compression for Vision-Language-Action Models

Hyeonjun Kim, Jegwang Ryu, Sangbeom Ha, Junhyeok Lee, Jun-Hyuk Kim, Hyemin Ahn, Jaeho Lee

Soongsil University, Chung-Ang University

2026-06-16视觉语言视觉感知

面向边缘机器人将多相机视觉流传到远端 VLA 推理时的带宽与时延瓶颈,论文提出 SPARC:不再按图像保真度均匀压缩,而是在神经编码器潜空间中用时序掩码选择器按相机与空间区域的任务相关性分配码率,并用 tilted rate loss 避免压掉罕见但关键细节。在 RoboCasa365、VLABench、LIBERO 及远程真机实验中,相同码率下控制成功率优于 JPEG/H.265 和学习式压缩,且降低端到端延迟。

Structure-Semantic Co-optimized Latent Diffusion Model for Fast Visual Anagram Synthesis Figure 1
2026-06-16cs.CV

Structure-Semantic Co-optimized Latent Diffusion Model for Fast Visual Anagram Synthesis

Xiang Gao, Yunpeng Jia

School of Digital Media and Design Arts, Beijing University of Posts and Telecommunications

2026-06-16生成模型

针对视觉变形图生成中像素扩散方法慢、分辨率受限且语义易混的问题,论文将多视角并行去噪迁移到 SDXL-Turbo 潜空间,并提出 S2CO:用空文本结构对齐约束低频结构一致性,以语义增强和注意力引导噪声融合缓解语义稀释。实验称其在视觉和定量指标上优于相关方法,并显著加快推理。

Propagating Structural Guidance: Synthesizing Fluorescein Angiography from Fundus Images and Sparse OCT Scans Figure 1
2026-06-16cs.CV

Propagating Structural Guidance: Synthesizing Fluorescein Angiography from Fundus Images and Sparse OCT Scans

Tengfei Ma, Ruiqi Wu, Chenran Zhang, Ye Geng, Na Su, Xiangyuan Duanmu, Tao Zhou, Yi Zhou, Wen Fan

School of Computer Science and Engineering, Southeast University, China1, Key Laboratory of New Generation Artificial Intelligence Technology and, Tianyuan Honors School, Nanjing Medical University, China3, Nanjing University of Science and Technology, Nanjing, China4, Department of Ophthalmology, The First Affiliated Hospital of, Nanjing Medical University, Nanjing, China5, invasive decision-support tool in routine workflows. The code is available, narios, only CFP-like views and OCT are typically available, as FFA is inva-

2026-06-16视觉感知

针对FFA需注射造影剂、而仅由CFP合成又缺乏血管渗漏和深层结构线索的问题,本文引入稀疏OCT作为非侵入式结构指导,构建3676眼CFP-FFA-OCT配准数据集,并用SACMF将OCT深度特征投影到眼底平面、以TCMA约束CFP与FFA局部表征对齐。实验显示其合成FFA较现有方法更逼真,并在下游疾病诊断中带来更大性能提升。

LUCID: Learned Undersampling-Adaptive Consistency-Guided Inference with Deterministic Flow Matching for Sparse-View CT Reconstruction Figure 1
2026-06-16cs.CV

LUCID: Learned Undersampling-Adaptive Consistency-Guided Inference with Deterministic Flow Matching for Sparse-View CT Reconstruction

Jigang Duan, Jiayi Wang, Heran Wang, Ping Yang, Genwei Ma, Xing Zhao

School, University, Genwei Ma is with the National Center for Applied Mathematics Beijing, Capital Normal University and Academy for multidisciplinary studies, Capital, trajectory provides a controllable inference process, making it

2026-06-16生成模型三维

针对稀疏视角 CT 中角度欠采样导致的伪影、细节丢失,以及监督模型难跨采样设置、生成模型易幻觉的问题,LUCID 用仅由高质量 CT 训练的确定性 Flow Matching 作为统一先验,在推理时按稀疏度融合 FBP 与噪声初始化、调节更新步长,并逐步加入投影域数据一致性。多种视角数实验显示其在定量指标、结构保真和局部细节上优于多类基线,并降低扩散式重建的幻觉风险。

DynFS-MoE: Dynamic Functional-Structural Mixture-of-Experts for Post-Traumatic Epilepsy Diagnosis Figure 1
2026-06-16cs.CV

DynFS-MoE: Dynamic Functional-Structural Mixture-of-Experts for Post-Traumatic Epilepsy Diagnosis

Jun-En Ding, Spencer Chen, Henry Noren, Daniel Valdivia, Christine Yohn, Suhina Patel, Taylor Zink, Hai Sun, Feng Liu

Department of Systems Engineering, Stevens Institute of Technology, Hoboken, NJ, Department of Neurosurgery, Robert Wood Johnson Medical School, Rutgers, University, New Brunswick, NJ, USA

2026-06-16视觉感知

针对创伤性脑损伤后癫痫早期识别中结构损伤与功能连接异常难以联合建模的问题,DynFS-MoE将fMRI时间片段与sMRI连接特征统一为多模态patch,并通过时间感知功能-结构编码、模态/跨模态专家及类别条件路由动态选择诊断相关信息。三项二分类实验显示其优于静态融合基线,并能揭示有意义的ROI交互,但具体数据规模与增益来源仍需结合全文进一步核验。

EgoPhys: Learning Generalizable Physics Models of Deformable Objects from Egocentric Video Figure 1
2026-06-16cs.CV

EgoPhys: Learning Generalizable Physics Models of Deformable Objects from Egocentric Video

Hyunjin Kim, Ri-Zhao Qiu, Guangqi Jiang, Xiaolong Wang

2026-06-16视觉感知

面向机器人操作中难以从真实交互获得可控仿真的布料、弹性体等可变形物体,EgoPhys尝试仅用单段第一视角RGB人类操作视频构建物理数字孪生。其核心是先重建时序4D点云并拟合粗弹簧质点模型,再把逐物体反演得到的密集刚度场蒸馏为状态条件材料码本,以便对新物体免去测试时逐弹簧优化。实验显示其在重建、未来预测和零样本泛化上优于基线,并在xArm6上验证可辅助可变形物体规划。

GRACE: Boosting Video MLLMs with Grounded Action-Centric Evidence for Viewer Sentiment Prediction Figure 1
2026-06-16cs.CV

GRACE: Boosting Video MLLMs with Grounded Action-Centric Evidence for Viewer Sentiment Prediction

Ruoxuan Yang, Tieyuan Chen, Xiaofeng Huang, Haibing Yin, Jun Wang, Xiping Chen, Jun Yin, Xuesong Gao, Weiyao Lin

Shanghai Jiao Tong University, China, Hangzhou Dianzi University, China, The 52nd Research Institute of China Electronics Technology Group Corporation, Hangzhou Bywin Technology Co., Ltd., China, Zhejiang Dahua Technology Co., Ltd., China, School of Information Science and Engineering, Shandong University, China, Haihe Laboratory of Information Technology Application Innovation, China

2026-06-16视觉感知

这篇论文针对视频广告中“观众情绪”并非画面人物表情可直接读出、稀疏帧 MLLM 又容易漏掉关键叙事事件的问题,提出 GRACE:先抽取时序 SVO 动作三元组和可见文字,再将主客体 grounding 为局部视觉裁剪,与原始帧一起作为结构化证据提示模型推理。Pitts 上相对 Qwen2.5-VL/Qwen3-VL 稳定提升,消融、AdsQA 跨数据集和 TVQA 情绪子集迁移实验也支持动作结构与视觉 grounding 的互补作用。

When Confidence Lacks Concepts: Interpretable OOD Detection via Representation Perturbations Figure 1
2026-06-16cs.LG

When Confidence Lacks Concepts: Interpretable OOD Detection via Representation Perturbations

Anju Chhetri, Pratik Shrestha, Ramesh Rana, Prashnna Gyawali, Binod Bhattarai

NepAl Applied Mathematics and Informatics Institute for research, Nepal, West Virginia University, USA, Kathmandu University, Nepal, University College London, UK, University of Aberdeen, UK

2026-06-16视觉感知

针对医疗视觉模型在分布偏移下过度自信且现有 OOD 分数语义不透明的问题,论文提出 CAPS:用稀疏自编码器从 ViT 中间表示中提取类别概念向量,并沿预测类别概念方向扰动表示,以 logits 稳定性作为 OOD 信号。实验覆盖内镜、病理和眼科影像,显示跨模态有效,且临床专家验证部分 SAE 潜变量对应有意义视觉模式;低数据场景下概念方向可靠性仍受限。

Cascaded Sparse Autoencoders Learn Multi-Level Visual Concepts in Multimodal LLMs Figure 1
2026-06-16cs.CV

Cascaded Sparse Autoencoders Learn Multi-Level Visual Concepts in Multimodal LLMs

Yusong Zhao, Hengyi Wang, Tanuja Ganu, Akshay Nambi, Hao Wang

difficult to interpret. Sparse Autoencoders (SAEs) provide a scalable way to de-, To address these challenges, Sparse Autoencoders (SAEs) [12] have emerged as a scalable, unsu-, Rutgers University.

2026-06-16视觉语言

针对多模态大模型内部视觉表征难解释、现有 SAE 多停留在扁平特征或受嵌套前缀/堆叠瓶颈限制的问题,本文提出级联稀疏自编码器 CSAE:先用一级 SAE 学低层视觉概念,再直接以其解码权重作为二级 SAE 输入,学习“概念的概念”。在 Qwen3-VL、Gemma-3、LLaVA 及多数据集上,CSAE 提升层级概念一致性,并支持有效的概念组级输出干预。

teasr: training-efficient any-step diffusion transformer for real-world image super-resolution Figure 1
2026-06-16cs.CV

teasr: training-efficient any-step diffusion transformer for real-world image super-resolution

Xiang Gao, Chenxin Zhu, Yushun Fang, Qiang Hu, Xiaoyun Zhang

2026-06-16视觉感知生成模型强化学习

针对真实图像超分中扩散模型采样慢、一步蒸馏训练开销大且无法按需求调节速度/质量的问题,TEASR在单一扩散模型内做自对抗蒸馏,并用时间感知校正稳定不同噪声水平的一步生成;同时提出双分支DiT与解耦时间步条件,区分当前噪声状态和去噪目标。实验称其可在无需额外训练下支持1到多步采样,在多个数据集优于现有方法,并可将20B模型蒸馏压到单A100训练。

Learned JPEG Compression for DNN Vision Figure 1
2026-06-16cs.CV

Learned JPEG Compression for DNN Vision

Kaixiang Zheng, Ahmed H. Salamah, Siyu Chen, En-Hui Yang

Department of Electrical and Computer Engineering, University of Waterloo

2026-06-16视觉感知

这篇论文针对“JPEG仍按人眼优化、却越来越多被DNN消费”的错配问题,提出J4D框架:用概率量化构造可微JPEG软量化器,并用DCT系数量化熵解析估计码率,从而端到端学习量化表和α参数,在实际编码时仍接近标准JPEG复杂度。实验覆盖分类与分割、多数据集和多架构,相比默认JPEG最高同码率提升11.60%准确率,或同准确率降码率80.05%,还展示了跨模型通用参数的可行性。

Closed-Loop Triplet Synergistic Generation for Long-Form Video Figure 1
2026-06-16cs.CV

Closed-Loop Triplet Synergistic Generation for Long-Form Video

Xinlei Yin, Xiulian Peng, Xiao Li, Zhiwei Xiong, Yan Lu

University of Science and Technology of China

2026-06-16视觉感知

针对多镜头长视频生成中角色身份漂移、道具/场景状态误差跨镜头累积的问题,论文提出 CoTriSyGen,将故事板生成从一次性前馈流程改为“文本意图—实体记忆—已生成视觉”的闭环协同。其 VLM Analyzer 在镜头内检测语义/构图偏差并触发重生成、修正运动提示,在镜头间把新出现或变化的实体写入动态记忆并改写后续提示。作者在自建 StoryBench 上报告跨镜头一致性、提示遵循和电影连续性均优于代表性方法。

To forget is to preserve: Machine Unlearning for 3D medical image segmentation Figure 1
2026-06-16cs.CV

To forget is to preserve: Machine Unlearning for 3D medical image segmentation

Nitesh Kumar Singh, Akhilesh Singh, Arjun Arora

School of Computer Science, UPES, University of Tomorrow, horizons 20 and 50 epochs. The results show that the Noisy Label, Institute For Advanced Research-10 (CIFAR-10), ImageNet, prediction as opposed to a single class label. Hence the

2026-06-16视觉感知三维

面向GDPR等“被遗忘权”在医疗影像模型中的落地,论文研究如何从3D分割网络中删除特定患者影响而不完全重训。其核心是把机器遗忘从2D分类扩展到MRBrainS18的主体级3D脑分割,基于Med3D预训练3D ResNet-50比较多种近似遗忘策略,并用保留/遗忘集合的Dice与MAE评估权衡。结果显示Noisy Label在50轮后使遗忘集性能下降93%、仍保持保留集约84%精度;其他策略虽遗忘更强但常导致保留性能灾难性退化。

Fi-Gaussian: Frequency-Aware Implicit Gaussian Splatting for Single Image Dehazing Figure 1
2026-06-16cs.CV

Fi-Gaussian: Frequency-Aware Implicit Gaussian Splatting for Single Image Dehazing

Yuhan Chen, Ying Fang, Guofa Li, Wenxuan Yu, Yicui Shi, Kunyang Huang, Wenbo Chu, Keqiang Li

are with the College of Mechanical and Vehicle Engineering, Chongqing, Kunyang Huang is with the Department of Electrical and Computer, Engineering, Carnegie Mellon University, Moffett Field, CA 94035, USA (e-, Wenbo Chu is with the National Innovation Center of Intelligent and, Keqiang Li is with the School of Vehicle and Mobility, Tsinghua University, and geometric cues are unavailable. As a result, the potential

2026-06-16视觉感知三维

针对单幅图像去雾中高频纹理易丢失、散射物理参数难以连续建模的问题,Fi-Gaussian将Gaussian splatting改写为2D特征空间的隐式连续表示,并在频域分离结构与纹理,用复值权重自适应聚合;同时引入物理驱动散射重归一化估计透射图和大气光。文中在多个基准上报告达到SOTA指标和更好的视觉细节、色彩保持效果。

Dehaze-GaussianImage: Zero-Shot Dehazing via Efficient 2D Gaussian Splatting Representation Figure 1
2026-06-16cs.CV

Dehaze-GaussianImage: Zero-Shot Dehazing via Efficient 2D Gaussian Splatting Representation

Yuhan Chen, Wenxuan Yu, Guofa Li, Kunyang Huang, Ying Fang, Yicui Shi, Wenbo Chu, Keqiang Li

are with the College of Mechanical and Vehicle Engineering, Chongqing, Kunyang Huang is with the Department of Electrical and Computer, Engineering, Carnegie Mellon University, Moffett Field, CA 94035, USA (e-, Wenbo Chu is with the National Innovation Center of Intelligent and, Keqiang Li is with the School of Vehicle and Mobility, Tsinghua University

2026-06-16视觉感知三维

针对单图去雾中像素级 CNN/Transformer 计算冗余、隐式映射物理可解释性弱的问题,本文将 2D Gaussian Splatting 引入去雾,把雾图表示为可演化的各向异性高斯场,并在高斯参数空间嵌入大气散射模型,通过重建-解耦优化、自适应分裂/克隆/裁剪和结构保持约束分离透射介质与清晰纹理。实验称其在完全无监督零样本设置下以少量参数达到 SOTA,但具体增益来源仍需结合完整实验细节判断。

Multimodal LLM-Empowered Re-Ranking for Generalizable Person Re-Identification Figure 1
2026-06-16cs.CV

Multimodal LLM-Empowered Re-Ranking for Generalizable Person Re-Identification

Jiachen Li, Xiaojin Gong

College of Information Science and Electronic Engineering, Zhejiang University

2026-06-16视觉语言

针对域泛化行人重识别中,传统重排序依赖源域编码器特征、在未知域邻域关系不可靠的问题,论文把多模态大模型引入推理阶段:用域无关提示和难样本 query-candidate 挖掘对 MLLM 做监督微调,再将其判别得到的距离与欧氏距离融合为 µ-distance,接入现有重排序方法。多组 DG Re-ID 基准显示该后处理能稳定提升重排序效果,但也带来额外推理开销。

Continuous Splatting meets Retinex: Continuous Gaussian Splatting and Implicit Reflectance Modeling for Low-Light Image Enhancement Figure 1
2026-06-16cs.CV

Continuous Splatting meets Retinex: Continuous Gaussian Splatting and Implicit Reflectance Modeling for Low-Light Image Enhancement

Yuhan Chen, Yicui Shi, Guofa Li, Wenxuan Yu, Ying Fang, Guangrui Bai, Wenbo Chu, Keqiang Li

2026-06-16视觉感知三维

针对低照增强中全局照明平滑与局部纹理恢复难兼顾、易出现偏色和结构伪影的问题,论文提出 CGS-Retinex,将连续 Gaussian Splatting 用于显式建模照明场,并用带浅层高频特征引导的隐式表示建模反射率,在 Retinex 约束下解耦曝光与纹理。实验显示其可减少暗区噪声、过曝和网格伪影,同时提升高频结构与颜色恢复;但具体增益相对各模块的来源仍需看消融细节。

Focus When Necessary: Adaptive Routing and Collaborative Grounding for Training-Free Visual Grounding Figure 1
2026-06-16cs.CV

Focus When Necessary: Adaptive Routing and Collaborative Grounding for Training-Free Visual Grounding

Yifan Wang, Peiming Li, Shiyu Li, Zhiyuan Hu, Xiaochen Yang, Wenming Yang, Yang Tang, Zheng Wei

2026-06-16视觉语言

针对训练-free视觉定位方法对所有样本都缩放、裁剪而造成算力浪费并可能破坏全局上下文的问题,论文提出 LazyMCoT:先用单次前向中首个答案 token 的置信统计和保形校准判断样本难度,简单样本直接回答,困难样本再结合 VLM 跨模态注意力与外部视觉专家做两阶段协同定位。实验称其在多基准和开源 VLM 上优于现有训练-free方法,接近或超过部分训练式方法,同时降低平均推理延迟。

A Comprehensive Survey of Medical Image Segmentation: Challenges, Benchmarks, and Beyond Figure 1
2026-06-16cs.CV

A Comprehensive Survey of Medical Image Segmentation: Challenges, Benchmarks, and Beyond

Pengyu Zhu, Xiaojing Zhang, Kunbo Zhang, Chunyan Zhang, Zhenyu Wang

aSchool of Control and Computer Engineering, North China Electric Power University, Beijing, 102206, China, bSPIC Digital Technology Co., Ltd, Beijing, 102209, China, cInstitute of Automation, Chinese Academy of Sciences, Beijing, 100190, China, dDepartment 6 of Health Care, Second Medical Center, People’s Liberation Army General Hospital, Beijing, 100037, China, publicly available in our GitHub repository Awsome_MedSeg., level labels which define anatomical or pathological regions, Zhang et al.[61] center their discussion around the recently

2026-06-16视觉感知数据集/基准

面向医学图像分割在诊断、治疗规划和随访中的落地需求,本文梳理了数据、模型、评价与临床部署之间的断点。其核心洞察是将 U-Net、Transformer 与 SAM 系方法放在统一框架下比较,指出领域适应、标注质量和评价指标比单纯架构更制约泛化。主要结果是整理主流数据集与指标,归纳当前模型已接近实时和专家级表现,但跨机构、稀有病灶及临床验证仍不足。

Shift-and-Sum Quantization for Visual Autoregressive Models Figure 1
2026-06-16cs.CV

Shift-and-Sum Quantization for Visual Autoregressive Models

Jaehyeon Moon, Bumsub Ham

Yonsei University, tablishing a new state of the art in PTQ for VAR. Project page is available at:, available samples in PTQ. This mismatch biases the quantization parameters toward an inaccurate

2026-06-16视觉感知

这篇论文关注视觉自回归模型在实际部署中的后训练量化难题:VAR 多尺度生成虽高效但 Transformer 计算开销大,而常规 PTQ 会在粗尺度注意力-Value 乘积处放大量化误差,并受少量校准样本导致的码本采样偏差影响。作者提出 shift-and-sum 对高注意力 value 做对称平移复制并聚合量化结果,同时重采样校准 token 以匹配预测概率。实验在 ImageNet 条件生成、修复、外扩和编辑中较基线稳定提升,4/6-bit 下取得新的 VAR PTQ 最优结果。

Training-Free Open-Vocabulary Visual Grounding for Remote Sensing Images and Videos Figure 1
2026-06-16cs.CV

Training-Free Open-Vocabulary Visual Grounding for Remote Sensing Images and Videos

Ke Li, Di Wang, Yongshan Zhu, Ting Wang, Weiping Ni, Tao Lei, Quan Wang, Xinbo Gao

2026-06-16视觉语言视觉感知

针对遥感图像/视频视觉指代表达依赖昂贵标注、难覆盖开放词汇目标的问题,论文提出免训练的 RSVG-ZeroOV:不让通用 VLM 直接回归坐标,而是抽取其跨注意力作语义概览,再用扩散模型自注意力补全结构,并通过注意力演化去除噪声;视频版加入查询相关关键帧选择与 SAM3 时序传播。六个图像和视频基准上,该方法优于现有零样本基线,并达到或超过部分弱/全监督方法。

EdgeZSAD: Practical Zero-Shot Anomaly Detection on Edge Devices Figure 1
2026-06-16cs.CV

EdgeZSAD: Practical Zero-Shot Anomaly Detection on Edge Devices

Taewan Cho, Andrew Jaeyong Choi

Gachon University, Plaid Labs Inc., geneous, and rarely available before deployment. Recent, Our study centers on EdgeZSAD, a compact deployed

2026-06-16视觉感知

面向工业零样本异常检测在边缘设备上难以承载 ViT-L/CLIP 等大模型的问题,论文提出 EdgeZSAD:以 TinyViT-21M-512 为骨干,结合全局排序与稀疏局部校正的 EdgeGLR,并用 Real-IAD-DR 改造源域训练难度而不增加部署图。三次运行在 MVTec-AD、VisA 图像 AUROC 达 91.6、88.2,可导出到 Jetson Orin Nano Super 与 RB5 Gen2,设备重评分漂移低于 0.2;但像素级定位仍明显落后强基线,部分增益可能主要来自数据配方。

Variable-Rate Deep Image Compression based on Low-Rank Adaptation by Progressive Learning Figure 1
2026-06-16eess.IV

Variable-Rate Deep Image Compression based on Low-Rank Adaptation by Progressive Learning

Xing-Yu Xu, Chen-Hsiu Huang, Ja-Ling Wu

Communications and Multimedia Lab, National Taiwan University

2026-06-16视觉感知

该文针对深度图像压缩中可变码率通常需训练多模型、存储和训练成本高,或单模型带来额外计算与率失真下降的问题,将 LoRA 引入 WACNN/STF 等压缩骨干,设计可合并的 LoRAM 并用渐进学习适配不同码率,推理阶段不增加延迟。实验显示其率失真性能接近独立训练模型,同时约节省 99% 参数存储、90% 数据和 97% 训练步数,下游 ImageNet 分类基本无退化。

SceneCraft: Interactive System for Image Editing via Scene Graph Figure 1
2026-06-16cs.CV

SceneCraft: Interactive System for Image Editing via Scene Graph

Duc-Manh Phan, Ngoc-Dai Tran, Duy-Khang Do, Tam V. Nguyen, Minh-Triet Tran, Trung-Nghia Le

University of Science, Vietnam National University, University of Dayton, • Human-centered computing →Interactive systems and

2026-06-16视觉感知

针对多对象复杂场景中纯文本提示难以准确表达空间与关系约束的问题,SceneCraft 将输入图像自动解析为可编辑场景图,结合 Detic、Grounding DINO 与 LLM 构建对象和关系,并把用户的图操作转成结构化提示分发给 FLUX、Qwen、Gemini 等模型。用户研究显示其交互更直观,降低提示工程负担,输出在质量与忠实度上更受偏好。

Effective and Low-cost Lane-based Map Localization for Vehicle-Centric Route Generation Figure 1
2026-06-16cs.MM

Effective and Low-cost Lane-based Map Localization for Vehicle-Centric Route Generation

Hong-Shiang Lin, Jung-Hsin Chen, Yu-Luen Tzeng, Wei-Hao Chen, Yi-Chen Lee, Li-Jhe Chen, Peng-Yuan Chen

National Taipei University, globally available, limiting real-world applicability. There is, coverage and is available through commercial navigation ser-

2026-06-16视觉感知

面向 AR-HUD 等车载导航中“地图路线难以对齐驾驶员视角”的问题,论文提出 OLRA:仅用导航路点、前视相机车道线、GPS 与运动传感器,通过车道-路线对齐损失优化地图位姿,再生成车体坐标路线。NuScenes 上其整体欧氏误差低于 OpenPilot,尤其在交叉口、弯道和 20 米以外预测更稳,但近距离略弱且直道纵向 GPS 偏差修正仍有限。

VinQA: Visual Elements Interleaved Long-form Answer Generation for Real-World Multimodal Document QA Figure 1
2026-06-16cs.CV

VinQA: Visual Elements Interleaved Long-form Answer Generation for Real-World Multimodal Document QA

Young Rok Jang, Hyesoo Kong, Kyunghwan An, Jae Sub Huh, Gyeonghun Kim, Stanley Jungkyu Choi

2026-06-16视觉语言强化学习

现有多模态文档问答多生成纯文本,难以利用页面中的图表、照片和示意图。VinQA将真实文档QA改造成长答案中交错引用视觉元素的任务,并比较整页框选引用的Page Encoding与解析后裁剪引用的Modality Encoding,配套M-GroSE、Visual Source F1和Visual G-Eval评测。实验显示闭源模型仍领先,但用VinQA微调Qwen2.5-VL显著提升视觉引用与grounding;Modality初始更稳,训练后Page Encoding可接近其表现。

Tool-IQA: Augmenting Image Quality Assessment with Simple Tools Figure 1
2026-06-16cs.CV

Tool-IQA: Augmenting Image Quality Assessment with Simple Tools

Guanyi Qin, Junjie Zhang, Chunming He, Yibing Fu, Jie Liang, Tianhe Wu, Lei Zhang

National University of Singapore, 2OPPO Research Institute, Nanyang Technical University, 4Duke University, City University of Hong Kong, 6The Hong Kong Polytechnic University, Label restructuring

2026-06-16视觉感知

针对现有 VLM 图像质量评价依赖单次全局观察、易漏检局部伪影或受低照度对比度误导的问题,Tool-IQA 将评分改为“观察—工具检查—量化”的流程,引入放大镜与 Gamma 校正器,并用批感知 BATE 奖励约束有效调用工具。在多个 IQA 基准上超过既有方法,CLIVE 上 PLCC 达 0.854。

AME: A Multi-Type Contributor Attribution Framework in Generative AI Markets Figure 1
2026-06-16cs.LG

AME: A Multi-Type Contributor Attribution Framework in Generative AI Markets

Yang Shi, Songwen Pei, Yang Gao, Bingxue Zhang

2026-06-16生成模型

针对生成式 AI 市场中训练数据、基础模型、微调与提示等多类贡献者共同创造价值却难以公平分账的问题,论文提出 AME 框架,将多阶段贡献归因 MMShapley、链上权利映射与低成本可信执行协议串联起来,处理异构贡献、嵌套授权和收益分配。实验称其分配结果更接近人工参考判断,并能在较低执行成本下保持可信性,但具体增益来源仍需更多细节验证。

Stepwise Token Selection for Efficient Multimodal Large Language Models Figure 1
2026-06-16cs.CV

Stepwise Token Selection for Efficient Multimodal Large Language Models

Landi He, Shawn Young, Lijian Xu

Shenzhen University of Advanced Technology

2026-06-16视觉语言

论文针对 MLLM 推理中视觉 token 前缀过长导致的延迟与显存瓶颈,指出现有 top-K 剪枝忽略 token 间冗余且固定压缩率不适配不同图像复杂度。StepPrune 将剪枝改为指针式逐步选择,并用学习到的停止动作自适应决定保留数量,再通过方差保持噪声门实现端到端训练。在 LLaVA-v1.5-7B 和 Qwen2.5-VL-7B 上,66.7%/77.8%/88.9% 剪枝仍保留 97.9%/96.7%/94.6% 原精度,最高带来 1.88× prefill 加速。

PointDiffusion: Diffusion-Based Scene Completion in the Point Cloud Domain Figure 1
2026-06-16cs.CV

PointDiffusion: Diffusion-Based Scene Completion in the Point Cloud Domain

Chidera Agbasiere, Mikhail Sannikov, Faith Ogunwoye, Erik Shaikhiev, Alex Kozinov, Ilya Mikhalchuk, Iana Zhura, Dzmitry Tsetserukou

Laboratory, Institute, labelling, mean-centred and isotropically rescaled to [−1, 1]

2026-06-16生成模型三维

本文面向自动驾驶中由稀疏 LiDAR 补全密集三维场景的问题,指出现有扩散方法受场景级点云压缩不稳、里程计漂移污染监督和多步推理延迟限制。核心做法是用跨注意力的多 token Gaussian VAE 表示场景,并用锚点 ICP 重建更干净的 SemanticKITTI 真值,再采用单步无 scaffold 扩散补全。结果显示真值精炼带来约 16× Chamfer 改善,方法较 LiDiff、ScoreLiDAR 低 10–19% 误差且延迟低 25–143×;但作者也承认主要增益可能主要来自 data 质量而非架构。

Trusting Right Predictions for Wrong Reasons: A LIME Based Analysis of Deep Learning Interpretability in Lung Cancer Diagnosis Figure 1
2026-06-16cs.CV

Trusting Right Predictions for Wrong Reasons: A LIME Based Analysis of Deep Learning Interpretability in Lung Cancer Diagnosis

Samarpan Poudel, Vladislav D Veksler

Caldwell University, School of Business and Computer Science

2026-06-16视觉感知

这篇论文针对肺癌 CT 深度模型“高准确率是否等于可信诊断”的问题,比较 CNN、预训练 ResNet50 与从零训练 ViT,并用 LIME 同时衡量预测一致性和解释一致性。结果显示三者准确率达 93.75%–98.61%、AUC 均约 0.99,预测相关性超过 0.99,但解释相关性低于 0.26;误判样本常关注肺实质外区域,说明模型可能“答对但理由错误”,临床验证不能只看性能指标。

The Third Challenge on Image Denoising at NTIRE 2026: Methods and Results Figure 1
2026-06-16cs.CV

The Third Challenge on Image Denoising at NTIRE 2026: Methods and Results

Lei Sun, Hang Guo, Bin Ren, Shaolin Su, Xian Wang, Danda Pani Paudel, Luc Van Gool, Radu Timofte, Yawei Li

lable Bokeh rendering [53], rip current detection and seg-, exchange and technical collaboration.

2026-06-16视觉感知

面对高噪声图像恢复中细节保真与公平评测不足的问题,本文汇总 NTIRE 2026 σ=50 AWGN 去噪挑战,采用 DIV2K/LSDIR 与以 PSNR 为核心的无约束赛道,比较各类神经网络方案。主要结果是从116个注册队中验证20支决赛队,给出当前无约束去噪的排行榜和方法谱系;具体增益来源文中未充分说明,可能主要来自 scaling / data 与集成策略。

Stringalign: Moving beyond summary statistics with a transparent Unicode-aware tool for evaluating automatic transcription models Figure 1
2026-06-16cs.CV

Stringalign: Moving beyond summary statistics with a transparent Unicode-aware tool for evaluating automatic transcription models

Yngve Mardal Moe, Marie Roald

2026-06-16视觉感知

针对HTR/OCR/ASR评测中CER、WER受归一化、分词和Unicode字符定义影响而难以复现的问题,本文提出轻量Python库Stringalign,将预处理流程显式化,支持Unicode感知分词、通用TER与按token错误分析及可视化。实验以案例对比现有工具,显示其能解释常见错误并避免不透明结果;文中未充分说明对模型性能的直接提升。

Classifying by Proxy: Explainable and Reproducible Ensemble of Proxy Tasks for Child Sexual Abuse Imagery Classification Figure 1
2026-06-16cs.CY

Classifying by Proxy: Explainable and Reproducible Ensemble of Proxy Tasks for Child Sexual Abuse Imagery Classification

Clara Ernesto, Carlos Caetano, Sandra Avila, João Macedo, Camila Laranjeira, Leo S. F. Ribeiro

should not be publicly available. These restrictions mean that stud-, all changes publicly available as a general-purpose Python library, The source code for our modified implementation of EISP is available at, available at github.com/araceli-project/EISPCSAI., ing on publicly available datasets and testing on LEA apprehen-, domains, and the limited personnel available to curate and annotate

2026-06-16视觉感知

针对CSAI取证分类中数据高度敏感、模型难复现且缺乏可解释性的问题,论文将EISP代理任务集成首次用于真实CSAI数据:用姿态、裸露、年龄、感知性别等7类公开可训练子任务提取特征,再以XGBoost融合,并用SHAP和降维可视化解释贡献。在巴西联邦警察RCPD数据集上最佳组合达到91.9% balanced accuracy,且较DINO特征基线更准、更可解释。

Multi-Task Tennis Stroke Biomechanics Analysis Using MediaPipe Pose Figure 1
2026-06-16cs.CV

Multi-Task Tennis Stroke Biomechanics Analysis Using MediaPipe Pose

Jigyashman Hazarika

Department of Artificial Intelligence and Machine Learning, BMS Institute of, without frame-level labels., depth and visibility scores unavailable in prior frameworks. An ablation study demonstrates a, (cross-court, down-the-line, center) and posture quality (good/bad), plus a deterministic, coaching layer requiring no additional labels., Federer, Djokovic, Nadal, Zverev, Sinner, Wawrinka) was sourced from publicly available YouTube, (2) shot direction (cross-court, down-the-line, or center)

2026-06-16三维

针对网球视频分析多停留在球路或粗动作识别、缺少击球生物力学反馈的问题,本文用 MediaPipe 单目3D姿态、关节速度自动分割和多任务 Transformer,同时预测正反手、方向与姿态质量,并加入规则化建议层。在1281个击球上随机划分正反手准确率83.7%、方向61.9%、姿态62.6%;跨球员正反手仍82.9%,但方向基本退化为多数类,姿态标注也受单一标注者限制。

A Text Recognition Dataset from Sahidic Coptic Ancient Manuscripts Figure 1
2026-06-16cs.CV

A Text Recognition Dataset from Sahidic Coptic Ancient Manuscripts

Fabio Quattrini, Carmine Zaccagnino, Costanza Bianchi, Silvia Cascianelli, Rita Cucchiara

2026-06-16视觉感知数据集/基准

本文面向低资源手写文本识别中罕见文字、灭绝语言和古籍退化图像带来的性能下降问题,构建了萨希德科普特古抄本行级数据集 SCAM,包含来自两个档案、采集条件差异明显的 SCAM-A/B 子集,并保留褪墨、透印、材质损伤及特殊变音符等真实难点。作者还比较了多类主流 HTR 方法,结果表明现有模型在该历史低资源场景下仍明显落后于现代高资源文字识别,为后续方法提供了基准;具体增益来源文中未充分说明。

Mind the Gap: Diagnosing Constraint Discovery Failures in Text-in-Image Editing Figure 1
2026-06-16cs.CV

Mind the Gap: Diagnosing Constraint Discovery Failures in Text-in-Image Editing

Rui Gui

Central South University, labels (0.646), suggesting that edit-specific causal cues ac-, ing label on the other side. These are implicit constraints:, region names (0.610) and type labels (0.646), indicating

2026-06-16视觉感知优化算法

论文关注多模态模型在图中文字编辑中能否主动发现未明说的连带约束,如折扣变化需同步改价格。作者提出隐式约束图 ICG 和受控诊断流程,将“发现”与“验证”分离。461 个案例上,四个 MLLM 无提示仅召回 46%,给出约束后达 94%;因果原因提示最有效,而单纯提高自发现召回会引入误报,未必改善下游编辑计划。

HadBalance: A Plug-and-Play Unified Global Geometric Prior Framework for Generalizable Biomedical Segmentation Figure 1
2026-06-16cs.CV

HadBalance: A Plug-and-Play Unified Global Geometric Prior Framework for Generalizable Biomedical Segmentation

Zhuangzhi Gao, Feixiang Zhou, He Zhao, Wenhan Chen, Ruiyu Luo, Xin Wang, Hongyi Qin, Zhongli Wu, Yanda Meng, Yitian Zhao, Alena Shantsila, Gregory Y. H. Lip, Eduard Shantsila, Yalin Zheng

2026-06-16视觉感知

本文针对医学分割中几何先验常依赖特定器官、难跨模态泛化的问题,观察到许多目标近似全局近凸,提出 HadBalance:用 Hadwiger 定理中的面积、周长和欧拉示性数构成统一形状先验,并通过 CAOB 在梯度层面削弱与分割目标冲突的先验影响。实验在颈动脉超声、息肉和视盘数据上相对强骨干及线性加权均有提升,尤其在更非凸的息肉数据上增益更明显。

CRIS: Cross-Plane Self-Supervised Isotropic Restoration for Anisotropic Volumetric Imaging Across Modalities Figure 1
2026-06-16cs.CV

CRIS: Cross-Plane Self-Supervised Isotropic Restoration for Anisotropic Volumetric Imaging Across Modalities

Adi Ahituv, Anat Ilivitzki, Moti Freiman

aFaculty of Data and Decision Sciences, Technion – Israel Institute of Technology, Haifa, 3200003, Israel, cFaculty of Biomedical Engineering, Technion – Israel Institute of Technology, Haifa, 3200003, Israel, dThe May-Blum-Dahl MRI Research Center, Technion – Israel Institute of Technology, Haifa, 3200003, Israel, retraining. Code is available at https://github.com/adi-hatav/CRIS., available or when priors do not transfer well across datasets

2026-06-16视觉感知

针对 MRI 与体电子显微中层间采样稀疏导致各向异性、影响重建和下游分析的问题,CRIS 将 3D 各向同性恢复转化为正交重切片上的 2D 条纹补全:用高分辨率面内切片自监督训练,推理时插入空白层并多视角融合,无需成对各向同性真值。在脑/腹部 MRI 和 vEM、最高 8× 各向异性实验中,PSNR、SSIM、FID/KID 及分割一致性均优于插值和多种自监督基线。

VEPHand: View-Efficient Photometric Hand Performance Capture at Scale Figure 1
2026-06-16cs.CV

VEPHand: View-Efficient Photometric Hand Performance Capture at Scale

Zhengyang Shen, Kai-Hung Chang, Erroll Wood, Deying Kong, Bo Peng, Timo Bolkart, Jinlong Yang, Bowen Zhao, Danhang Tang, Sasa Petrovic, Emre Aksan, Jérémy Riviere, Vassilis Choutas, Delio Vicini, Jay Busch, Shichen Liu, Zhe Cao, Hugh Liu, JingJing Shen, Jonathan Taylor, Mingsong Dou

the scalability and robustness of our automated pipeline on an extensive dataset of over 12,000 sequences, from which, mm mean surface error), significantly advancing practical, high-quality hand capture. Our project page are available at, data that is the foundation for our scalable pipeline., scalable system for View-Efficient Photometric Hand perfor-, Scalable Non-SDF Neural Reconstruction for View-, Scalable, Automated, and Validated End-to-End Pipeline:

2026-06-16视觉感知

面向低成本、大规模获取高保真手部数据,VEPHand针对约20视角、无遮挡掩码的稀疏多视角采集难题,提出非SDF的mask-free神经密度重建,并用场景化正则抑制漂浮物和背景塌陷;随后以个性化四面体手模上的规范空间体积偏移进行物理启发配准,刻画非线性皮肤形变和自接触。系统在约1.2万序列、800人数据上自动运行,覆盖单手、双手和手物交互,报告约1mm平均表面误差并生成大规模2D/3D合成手部数据。

You Don't Need Strong Assumptions: Visual Representation Learning via Temporal Differences Figure 1
2026-06-16cs.CV

You Don't Need Strong Assumptions: Visual Representation Learning via Temporal Differences

Ninad Daithankar, Alexi Gladstone, Yann LeCun, Heng Ji

New York University

2026-06-16视觉感知

论文针对现有视觉自监督仍依赖增强、遮挡、裁剪等强归纳偏置,指出数据规模增大时最优偏置强度会下降。作者提出 TDV,从视频中利用“过去可预测未来”的弱因果假设,联合训练帧编码器与运动编码器,使当前帧表征加运动表征预测下一帧表征。实验显示其在密集空间任务上可接近 DINO、iBOT 等方法,但语义任务仍不强,扩展到更大视频数据的收益文中未充分说明。

Learning Directional Semantic Transitions for Longitudinal Chest X-ray Analysis Figure 1
2026-06-16cs.CV

Learning Directional Semantic Transitions for Longitudinal Chest X-ray Analysis

Zhangfeng Hu, Zefan Yang, Ge Wang, Tanveer Syeda-Mahmood, Anushree Burade, Mannudeep Kalra, Pingkun Yan

2026-06-16视觉感知

针对纵向胸片中真实病灶变化细微、易被解剖不变性和拍摄差异淹没,且进展具有“好转/恶化”等方向性的难点,本文提出 ProTrans,将前后两次 CXR 的疾病演变建模为语义空间中的可学习有向转移,并用报告对齐状态与转移语义,结合反向时间建模和双向重建一致性约束。实验显示其在疾病进展分类和进展描述生成上优于既有纵向建模方法。

GOOSE-M2F: Adapting Mask2Former for High-Fidelity, Long-Tailed Fine-Grained Semantic Segmentation in Unstructured Outdoor Terrain Figure 1
2026-06-16cs.CV

GOOSE-M2F: Adapting Mask2Former for High-Fidelity, Long-Tailed Fine-Grained Semantic Segmentation in Unstructured Outdoor Terrain

Jyothiraditya Lingam, Nikhileswara Rao Sulake, Sai Manikanta Eswar Machara

Department of Computer Science and Engineering, Rajiv Gandhi University of Knowledge Technologies, Nuzvid, India, models are publicly available at: Github GOOSE-M2F Code, scale H/4 limitation. ASPP-lite, inspired by DeepLabV3+ [5], batch 16 (1 sample × 16 grad-accum), label smoothing 0.10, assigning higher confidence to center predictions (full re-

2026-06-16视觉感知

面向腿式机器人在森林、 gravel、雪地等非结构化户外场景中的细粒度语义分割,GOOSE-M2F针对64类长尾、模糊边界和微小目标改造Mask2Former:扩展到200个查询,引入ASPP-lite+CBAM特征细化和辅助像素监督,并配合长尾重加权、稀有类Copy-Paste与密集滑窗TTA。其在GOOSE 2D FGSS取得70.08% Composite mIoU、榜单第3,但推理增益很大且代价约12倍。

TurboGS: Accelerating 3D Gaussian Splatting via Error-Guided Sparse Pixel Sampling and Optimization Figure 1
2026-06-16cs.CV

TurboGS: Accelerating 3D Gaussian Splatting via Error-Guided Sparse Pixel Sampling and Optimization

Zheng Dong, Daifei Qiu, Pinxuan Dai, Ke Xu, Jiamin Xu, Lili He, Rynson W.H. Lau, Weiwei Xu

2026-06-16优化算法三维

面向消费级/快速周转的新视角合成,TurboGS针对3DGS训练中大量低误差像素重复光栅化、细节又易因剪枝受损的问题,提出按多视角误差图进行tile级稀疏像素采样,并结合稀疏NCC结构损失、误差驱动的高斯增删和混合优化器,把算力集中到边缘、细结构等难区域。标准基准显示其在约100秒内达到相当或更好画质,相比原版3DGS最高约10倍训练加速,但低纹理区域仍可能出现轻微波纹伪影。

OmniOPSD: Rationale-Privileged On-Policy Self-Distillation for Affective Computing Figure 1
2026-06-16cs.CV

OmniOPSD: Rationale-Privileged On-Policy Self-Distillation for Affective Computing

Zebang Cheng, Shuimu Chen, Boxue Yang, Yuanshen Guan, Jingyi Chen, Zheng Lian, Xiaojiang Peng, Fei Ma, LaiZhong Cui, Qi Tian

Shenzhen University 2 Guangdong Laboratory of Artificial Intelligence and Digital Economy (SZ), Tsinghua University 4 Shanghai Jiao Tong University 5 University of Science and Technology of China, Shenzhen Technology University 7 Tongji University 8 Huawei, is particularly pronounced in human-centered scenarios involving states, emo-, expert-annotated ground-truth labels, directly using these labels for supervised, inference requires no labels, rationales, CoT annotations, or closed-source model, Wen et al., 2026b), yet human-centered multimodal reasoning, The available supervision, however, is poorly matched to this goal. Most affective computing datasets, provide reliable expert-annotated or consensus-based labels (Busso et al., 2008, Zhang et al., 2024), but these labels are sparse outcome-level, signals. A label such as happy, angry, or intent to complain does not identify the facial cue, acoustic, and especially hard to scale for subjective human-centered tasks (Lian et al., 2023b

2026-06-16强化学习

面向情感计算中的多模态推理,论文指出仅用类别标签或直接模仿前沿模型生成的理由,容易造成奖励稀疏、捷径学习和虚假解释。OmniOPSD 将前沿模型理由仅作为训练时教师侧特权证据,让学生在自身轨迹上接受本地教师的逐 token 指导,推理时无需理由或闭源模型。MER-UniBench 平均得分 84.19,达到文中报告的 SOTA,消融支持特权理由指导的贡献。

High-Fidelity 4D Hand-Object Capture via Multi-View Spatiotemporal Tracking and Physics-Aware Gaussians Figure 1
2026-06-16cs.CV

High-Fidelity 4D Hand-Object Capture via Multi-View Spatiotemporal Tracking and Physics-Aware Gaussians

Bo Peng, Xu Chen, Yi Gu, Hidenobu Matsuki, Mingsong Dou, Jingjing Shen, Deying Kong, Juyong Zhang, Zhengyang Shen

2026-06-16视觉感知三维

面向具身智能中高保真手-物交互数据难以摆脱模板、标记且遮挡下跟踪易失效的问题,论文提出21相机同步多视角管线:先用HOST时空Transformer融合跨视角与时间线索初始化手/物姿态和稠密几何,再以物理感知高斯优化加入四面体约束、碰撞修正与外观分解。实验在公开与内部数据上显示姿态跟踪、动态新视角合成和几何恢复更稳,77段复杂序列自动成功率超过93%。

SiGnature: Explicit Motion Diffusion for Stylized Semantic Gesture Figure 1
2026-06-16cs.CV

SiGnature: Explicit Motion Diffusion for Stylized Semantic Gesture

Adi Rosenthal, Tomer Koren, Nadav Shaked, Doron Friedman, Ariel Shamir

Reichman University, Israel

2026-06-16生成模型

该文针对共语手势生成中语义手势稀少、易被潜空间模型抹平且难以保持说话人风格的问题,提出在显式关节旋转空间中训练多模态扩散模型,并用无需训练的 JMI 按空间方差识别活跃关节,将外部语义动作局部注入采样过程。实验和用户研究显示,该方法在保持动作平滑自然与个体风格的同时,提升了语义控制能力并优于现有基线。

Text region detection in historical astronomical diagrams Figure 1
2026-06-16cs.CV

Text region detection in historical astronomical diagrams

Zeynep Sonat Baltacı, Raphaël Baena, Fei Meng, Somkéo Norindr, Florence Somer, Matthieu Husson, Mathieu Aubry

2026-06-16视觉感知

历史天文图中的文字常与几何元素交织、方向和语言多样,现有手稿或地图文本检测数据难以覆盖。本文构建948幅、跨8至18世纪七种传统的开放数据集,标注10940个带阅读方向的多边形文本区域,并提出可预测有序顶点的Poly-DETR及合成预训练流程。实验显示Poly-DETR在cBAD2019和MTHv2上达到新SOTA,在该数据集上接近大规模场景文字预训练的TESTR,但部分增益可能主要来自数据与预训练。

Deep Residual Injection for Full-Spectrum Forensic Signal Perception in Multimodal Large Language Models Figure 1
2026-06-16cs.CV

Deep Residual Injection for Full-Spectrum Forensic Signal Perception in Multimodal Large Language Models

Kaiqing Lin, Zhiyuan Yan, Ruoxin Chen, Ke-Yue Zhang, Yue Zhou, Caiyong Piao, Bin Li, Taiping Yao, Bo Wang, Youchang Xiao, Shouhong Ding

2026-06-16视觉语言

针对 MLLM 检测 AI 生成图像时只依赖语义、难以捕捉低层生成器痕迹且直接微调会破坏语义表征的问题,论文通过层级分析指出语义主要在早中层形成,并提出 Deep-VRM:冻结早期语义路径,用带 LoRA 的视觉分支学习伪造残差并注入中间层融合。实验称其无需外部专家检测器,在 GenImage、AIGI-Now、WildRF 等多数基准达到 SOTA,并对压缩、缩放更鲁棒。

Metis: A Generalizable and Efficient World-Action Model for Autonomous Driving and Urban Navigation Figure 1
2026-06-16cs.CV

Metis: A Generalizable and Efficient World-Action Model for Autonomous Driving and Urban Navigation

Jingyu Li, Zhe Liu, Dongnan Hu, Junjie Wu, Zipei Ma, Wenxiao Wu, Chao Han, Zhihui Hao, Zhikang Liu, Kun Zhan, Jiankang Deng, Xiatian Zhu, Li Zhang

Fudan University, Shanghai Innovation Institute, The University of Hong Kong, Tongji University, Li Auto Inc., Huazhong University of Science and Technology, Imperial College London, University of Surrey

2026-06-16机器人强化学习

面向自动驾驶与城市导航中世界动作模型推理慢、视频生成与动作预测强耦合导致泛化受损的问题,Metis 将未来视频建模视为训练辅助而非推理前置步骤,采用 Mixture-of-Transformers 分设视频与动作专家,并用非对称注意力实现联合训练、推理时跳过显式视频生成。实验显示其在 NAVSIM navhard/navtest 与 CityWalker 上达到 SOTA,且真实机器人部署验证了效率与跨场景可行性。

CogCanvas: A Benchmark for Evaluating Multi-Subject Reference-Based Image Generation Figure 1
2026-06-16cs.CV

CogCanvas: A Benchmark for Evaluating Multi-Subject Reference-Based Image Generation

Long-Bao Nguyen, Quang-Khai Tran, Tam V. Nguyen, Minh-Triet Tran, Trung-Nghia Le

University of Science, Ho Chi Minh City, Vietnam, University of Dayton, Ohio, United States, Vietnam National University, Ho Chi Minh City, Vietnam

2026-06-16视觉感知数据集/基准

针对多主体参考图生成缺少联合评测的问题,CogCanvas将多身份保持、人物-物品/服饰绑定、背景约束、空间关系与交互放入同一基准,构建1952张参考图和1361个2–5人组合提示,并用结构化关系图、BG-Sim与Attr-VQA补足背景和属性绑定评估。五个SOTA方法在人数增加时明显退化,超过三人后物品/服饰绑定几乎失效。

Object Tokens as a Bridge Between Segmentation and Visual Question Answering in Robotic Surgery Figure 1
2026-06-16cs.CV

Object Tokens as a Bridge Between Segmentation and Visual Question Answering in Robotic Surgery

Yiping Li, Ronald de Jong, Romy van Jaarsveld, Franco Badaloni, Gino Kuiper, Jelle Ruurda, Josien Pluim, Marcel Breeuwer

2026-06-16机器人视觉感知

针对手术VQA常用框级定位、难以刻画器械与组织细粒度空间关系的问题,论文将VLM生成的对象token作为问答与分割的共享中介,并接入SAM解码器,在联合损失下学习可用于回答也可还原为像素掩码的表示。作者在私有RAMIE和公开EndoVis18上报告优于基线,并用多种SAM变体验证,但具体泛化与数据贡献仍需更多公开评测支撑。

A Dual-Branch Collaborative Framework for Joint Optimization of Underwater Image Enhancement and Object Detection Figure 1
2026-06-16cs.CV

A Dual-Branch Collaborative Framework for Joint Optimization of Underwater Image Enhancement and Object Detection

Liyuan Cao, Zheng Liu, Guanghao Liao, Yonghui Yang, Qi Li

A Dual-Branch Collaborative Framework for Joint Optimization of Underwater Image Enhance-, A Dual-Branch Collaborative Framework for Joint Optimization of, aSchool of Electronic and Information Engineering, University of Science and Technology Liaoning, No.189 Qianshan Middle Road, Lishan

2026-06-16视觉感知优化算法

面向水下机器人感知中颜色偏移、细节模糊会削弱目标检测的问题,论文将退化拆为细节退化与颜色失真,提出无需复杂训练的双分支增强框架:一支做照明/局部对比与纹理增强,另一支做亮度引导的颜色补偿并融合输出。实验显示其在 UIEB、EUVP 上取得 UIQM 2.249/2.576,256×256 单图约 0.009s,并使 YOLOv8 在 URPC 上 mAP50 较基线提升 2.1%。

EmoZone-Talker: Regional Semantic Control of Audio-Driven 3DGS Talking Heads via Facial Action Units Figure 1
2026-06-16cs.CV

EmoZone-Talker: Regional Semantic Control of Audio-Driven 3DGS Talking Heads via Facial Action Units

Tingting Chen, Shaojun Wang, Huaye Zhang, Diqiong Jiang, Chenglizhao Chen

China University of Petroleum (East China), China University of Petroleum (East China) Qingdao China

2026-06-16规划控制三维

针对音频驱动 3DGS 说话头中语音动态与显式表情控制相互纠缠、导致局部编辑不准和时序抖动的问题,EmoZone-Talker 将任务建模为跨模态冲突下的时空协调,引入基于解剖先验的 SZ-PAB 区域优先注意力和 CIT-AE 时序 AU 编码器,把解耦后的语音/表情信号映射到高斯形变。实验显示其提升 AU 控制精度、上半脸自然度与时间一致性,同时基本保持渲染质量和唇同步。

Learning a Sampling-Free Variational DNN Plugin from Tiny Training Sets to Refine OOD Segmentation With Uncertainty Estimation Figure 1
2026-06-16cs.CV

Learning a Sampling-Free Variational DNN Plugin from Tiny Training Sets to Refine OOD Segmentation With Uncertainty Estimation

Jimut B. Pal, Suyash P. Awate

2026-06-16视觉感知安全鲁棒

针对跨医院、跨设备医学图像中 DNN 分割易因 OOD 偏移失效且难以重新标注训练的问题,论文提出轻量插件 VarDeepPCA:只用少量 ID 分割学习解剖几何先验,并通过对 softmax 的变分重释实现免采样建模、推理和不确定性估计。作者在 4 类任务、14 个公开数据集上接入多种分割器,对比 15 种方法显示其能提升几何合理性和临床指标并降低 OOD 分割误差。

SACE: Concept Erasure at the Semantic Singularity in Visual Autoregressive Models Figure 1
2026-06-16cs.CV

SACE: Concept Erasure at the Semantic Singularity in Visual Autoregressive Models

Siya Yang, Nanxiang Jiang, Zhaoxin Fan, Yunfeng Diao

2026-06-16视觉感知

针对视觉自回归(VAR)文生图模型易生成不安全/侵权内容、而扩散模型概念擦除方法直接迁移会造成语义崩塌和伪影的问题,论文提出“语义奇点”洞察:目标概念主要在 Scale-0 被锁定,并用 ISSA 分析验证。基于此,SACE 仅在首尺度干预,结合熵正则擦除与保真保持损失;实验称其在多类概念擦除上达到更好效果,同时训练开销更低。

CPS4: Class Prompt driven Semi-Supervised Spine Segmentation with Class-specific Consistency Constraint Figure 1
2026-06-16cs.CV

CPS4: Class Prompt driven Semi-Supervised Spine Segmentation with Class-specific Consistency Constraint

Qingtao Pan, Hongzan Sun, Bing Ji, Shuo Li

2026-06-16视觉感知优化算法

针对半监督脊柱 MRI 多类别分割中伪标签噪声大、现有 VLM 类提示与具体椎体/椎间盘区域绑定不足的问题,CPS4 先用类特异一致性约束预训练视觉-文本编码器,通过 token 与 pixel 级注意力损失强化提示和目标结构对齐,再用类提示生成的二值图融合改进未标注样本伪标签。在公共脊柱数据集上,仅 5% 标注数据时 Dice 达 80.44%,优于常见半监督和 VLM 基线。

DifFRACT: Diffusion Feature Reconstruction and Attribution for Circuit Tracing Figure 1
2026-06-16cs.CV

DifFRACT: Diffusion Feature Reconstruction and Attribution for Circuit Tracing

Artyom Mazur, Nina Konovalova, Aibek Alanov

HSE University, FusionBrain Lab

2026-06-16生成模型三维

针对文本到图像扩散 Transformer 内部语义如何跨去噪步、跨文本/图像流传播难以追踪的问题,DifFRACT 将 LLM 中的 transcoder 电路追踪引入 FLUX.1 双流 MM-DiT,用时间步条件化 transcoder 近似各 MLP 子层并做特征到特征归因。实验显示其稀疏性—保真度与 SAE 相当或略优,可恢复属性绑定、语义传播和生成错误相关电路,且电路引导干预比 SAE steering 更精确。

Domain-Guided Prompting of the Segment Anything Model for Seismic Interpretation: The Role of Attributes, Visualization, and Hybrid Prompts Figure 1
2026-06-16cs.CV

Domain-Guided Prompting of the Segment Anything Model for Seismic Interpretation: The Role of Attributes, Visualization, and Hybrid Prompts

Aniq Ahmad, Heather Bedle, Ahmad Mustafa

2026-06-16视觉感知

针对地震解释中标注昂贵、微调 SAM 成本高且易削弱泛化的问题,本文探索不重训的零样本适配:按地质目标选择地震属性与配色,并将用户点提示与由 SAM 内部激活生成的稠密 mask 提示结合。多目标、多数据集实验显示,该策略较单纯点提示能提升地质特征可分性、边界刻画和分割精度,使 SAM 在零样本场景下达到有竞争力的表现。

Mitigating Visual Hallucinations in Multimodal Systems through Retrieval-Augmented Reliability-Aware Inference Figure 1
2026-06-16cs.AI

Mitigating Visual Hallucinations in Multimodal Systems through Retrieval-Augmented Reliability-Aware Inference

Pratheswaran Hariharan, Haiping Xu, Donghui Yan

University of Massachusetts, Dartmouth, MA, or falling back when the available evidence does not justify a definitive answer.

2026-06-16视觉语言

针对多模态模型在视觉证据弱或冲突时仍给出自信错误回答的问题,本文提出一种无需重训的检索增强可靠性感知推理层:用外部视觉近邻证据计算相似度、类别支持、证据间隔和熵等信号,并通过门控决定接受、谨慎回答或拒答。在 ImageNet-100 上,接受样本准确率由 85.84% 提升至 88.88%,覆盖率 89.04%,类幻觉的接受错误率由 14.16% 降至 11.12%。

Faithful Action-unit Causal Reasoning for Counterfactually Faithful Emotion Explanations Figure 1
2026-06-16cs.CV

Faithful Action-unit Causal Reasoning for Counterfactually Faithful Emotion Explanations

Van Thong Huynh, Hong Hai Nguyen, Thuy Pham, Trong Nghia Nguyen, Soo-Hyung Kim

2026-06-16视觉感知

论文针对多模态情绪识别中“能说出AU但解释未必真实驱动预测”的问题,提出FACR:用极性化AU→情绪因果图约束推理,并通过AU潜变量上的do干预训练与度量反事实忠实性。UNBC-PAIN上PSPI一致性由0.08升至0.57,AUC小降0.83到0.79;跨数据集七类情绪任务中对图一致性由0.50升至0.84,但真实AU一致性依赖图本身正确性。

Ellipse Meets Bit-Planes: A Novel Approach to RNFL based Glaucoma Detection Using Advanced Image Processing and Deep Learning Figure 1
2026-06-16cs.CV

Ellipse Meets Bit-Planes: A Novel Approach to RNFL based Glaucoma Detection Using Advanced Image Processing and Deep Learning

Snigdha Paul, Sambit Mallick, Anindya Sen

2026-06-16视觉感知

针对青光眼早期常表现为彩色眼底图中细微、弥漫性 RNFL 变薄且 OCT 成本较高的问题,论文提出自适应椭圆极坐标变换,使 RNFL 轨迹在不同视盘/黄斑位置下更易对齐分析,并分别构建深度特征融合与位平面切片的轻量图像处理方案。前者报告 99.3% 检出率,后者以较低计算量达到 92.31% 准确率。

Task-Instructed Causal Routing of Vision Foundation Models for Multi-Task Learning Figure 1
2026-06-16cs.CV

Task-Instructed Causal Routing of Vision Foundation Models for Multi-Task Learning

Donghyun Han, Yuseok Bae, Jung Uk Kim, Hyung-Il Kim

2026-06-16视觉感知

针对单一视觉基础模型难以同时覆盖语义、几何和边界等密集预测需求的问题,论文提出 TIGER:冻结 CLIP、DINOv2、SAM、OWLv2 等异构专家,用自然语言任务指令驱动 token 级路由,并以反事实移除专家造成的性能变化约束路由权重,使融合更贴近因果贡献。在 NYUD-v2 与 Pascal Context 上,TIGER 超过多任务学习基线和单专家模型。

The Circumplex Degeneracy Behind the Rare-Class Limit in Affect Recognition Figure 1
2026-06-16cs.CV

The Circumplex Degeneracy Behind the Rare-Class Limit in Affect Recognition

Van Thong Huynh, Hong Hai Nguyen, Soo-Hyung Kim

2026-06-16视觉感知

本文针对野外表情识别中愤怒、恐惧等稀有类长期低 F1 的问题,质疑“类别不均衡”解释,提出用效价—唤醒环形空间与最优传输代价做受控诊断。结果显示,环形代价虽提升宏 F1,但均匀代价同样甚至更好,说明增益主要来自通用置信惩罚;真正稳定的失败源于类别在情感几何中退化重合,需改进表征而非重定价损失。

OmniTraffic: A Controllable Generation Pipeline and Benchmark for Spatio-Temporal Traffic Reasoning Figure 1
2026-06-16cs.CV

OmniTraffic: A Controllable Generation Pipeline and Benchmark for Spatio-Temporal Traffic Reasoning

Maonan Wang, Zhengyan Huang, Kemou Jiang, Yuhang Fu, Jiayue Zhu, Yuxin Cai, Xingchen Zou, Qiaosheng Zhang, Yi Yu, Ding Wang, Xi Chen, Ben M. Chen, Yuxuan Liang, Zhiyong Cui, Man On Pun, Yirong Chen

The Chinese University of Hong Kong, Shenzhen, Shanghai AI Lab, Beihang University, Nanyang Technological University, The Hong Kong University of Science and Technology (Guangzhou), The Chinese University of Hong Kong

2026-06-16规划控制数据集/基准

现有交通多模态基准多偏向被动识别,难以可控评估车道拓扑、多视角几何、时序演化与信号相位推理。OmniTraffic 将12个真实路口重建为可编辑3D环境,结合真实监控,生成带结构元数据的多视角VQA,并按感知、时空推理、决策支持分层。其8M样本和3K人工测试显示,最佳MLLM仅72.4%准确率,显著低于人类92.9%,弱点集中在拓扑和时空任务;仿真数据微调还能提升真实场景表现。

MAF: Multimodal Adaptive Few-shot Prompting for Sentiment Analysis with MLLMs Figure 1
2026-06-16cs.MM

MAF: Multimodal Adaptive Few-shot Prompting for Sentiment Analysis with MLLMs

Hangling Xie

Nanjing University of Posts and Telecommunications, Wenyuan Road No.9, Xixia, utilization. Despite these advances, large labeled datasets and task-specific re-

2026-06-16视觉语言

针对多模态大模型做情感分析时对提示和示例选择高度敏感、固定融合难以适配不同输入的问题,MAF不微调主模型,而是按查询动态检索少样本示例:联合人脸表情、场景与文本特征,并用唇动定位说话人,再由轻量网络生成样本级模态融合权重,最后用多次输出投票稳定预测。论文在三个公开数据集上显示其相对对应骨干有稳定提升,并与强多模态情感分析基线具备竞争力。

Learning New Tasks via Reusable Skills: Skill-Compositional Experts for Embodied Continual Learning Figure 1
2026-06-16cs.RO

Learning New Tasks via Reusable Skills: Skill-Compositional Experts for Embodied Continual Learning

Shuaike Zhang, Shaokun Wang, Haoyu Tang, Jianlong Wu, Liqiang Nie

Harbin Institute of Technology, Shenzhen, Shandong University, Shenzhen Loop Area Institute

2026-06-16视觉感知

本文针对具身持续学习中闭环控制会放大特征漂移、导致旧操作任务遗忘的问题,提出把新任务视为可复用技能的组合。SCE 通过 CSG 从示范中构建技能库,并用执行/转移双专家分别建模技能执行与技能切换,再自适应融合生成动作。LIBERO 与真实机器人实验显示其在保持旧任务能力和总体成功率上优于基线,并通过消融与漂移分析支持改进来源。

3D Consistency Optimization for Self-Supervised Monocular Video Depth Estimation Figure 1
2026-06-16cs.CV

3D Consistency Optimization for Self-Supervised Monocular Video Depth Estimation

Yuanye Liu, Ke Zhang, Junzhe Jiang, Li Zhang, Vishal Patel, Xiahai Zhuang

Fudan University, Shanghai, China, Johns Hopkins University, Baltimore, USA

2026-06-16视觉感知优化算法三维

该文针对单目内窥视频缺少可靠位姿、逐帧自监督深度易产生跨帧漂移和闪烁的问题,将视频深度估计重写为无位姿多视角三维重建。方法用多视角Transformer与3D Gaussian表示联合预测深度和相机,并通过光度渲染、世界坐标几何对齐和多尺度时序梯度约束训练,推理无需逐场景优化。实验称在自监督和零样本临床场景中优于逐帧、视频深度及多视角重建基线。

CEVAR: Centerline Embedding Extraction for Endovascular Aneurysm Repair Figure 1
2026-06-16cs.CV

CEVAR: Centerline Embedding Extraction for Endovascular Aneurysm Repair

Roman Naeem, Timo Niiniskorpi, Charlotte Sandström, Naman Desai, Anders Jeppsson, Ida Häggström, Fredrik Kahl, Håkan Roos, Jennifer Alvén

CEVAR: Centerline Embedding Extraction for, Chalmers University of Technology, 412 96 Gothenburg, Sweden, The University of Gothenburg, 405 30 Gothenburg, Sweden, Sahlgrenska University Hospital, 413 45 Gothenburg, Sweden, seal in stent graft sealing zones. Structured CT review using centerline, ual centerline editing and expert operators. We propose a transformer, combines 3D centerline tracking with embedding-based geometric pre-, aorto-iliac centerline extraction from follow-up CT and for measure-, cial semi-automatic workflow. Code and pretrained models are available, Keywords: Endovascular aneurysm repair (EVAR) · Vascular center-, The EVAR4C protocol [19] evaluates sealing zones using vessel centerlines, manual centerline editing by highly trained operators [2, 19].

2026-06-16强化学习

EVAR 术后破裂常源于支架密封区丧失,而 EVAR4C 依赖中心线测量但需专家手工修正。CEVAR 将 Transformer 3D 图式中心线跟踪与点级嵌入上的多任务几何预测结合,自动估计支架边缘、血管直径和密封长度。基于 142 名患者 374 次 CT 及 Aorta24 预训练,方法在完整测试集和无增强 CT 子集上均优于商业半自动流程;但密封长度预测仍较困难,增益部分可能来自数据与预训练。

OneFocus: Enabling Real-World X-ray Security Screening with a Unified Vision-Language Model Figure 1
2026-06-16cs.CV

OneFocus: Enabling Real-World X-ray Security Screening with a Unified Vision-Language Model

Jiali Wen, Hongxia Gao, Litao Li, Yixin Chen, Kaijie Zhang, Qianyun Liu, Xiaoqin Wen

2026-06-16视觉语言视觉感知强化学习

面向安检 X 光中违禁品种类变化、遮挡严重且缺少高质量图文数据的问题,论文构建了含 52,124 对图文、28 类违禁品的 MMXray,并用符合 X 光成像物理的 AnyContraSyn、CleanDET 与 OnePipe 补充合成和标注数据;在此基础上训练统一 VLM OneFocus,同时支持问答、定位、分类和图像理解,并在多基准上取得 SOTA 与跨域泛化。

SpatialAvatar-0: High-Quality 4D Head Avatar with Multi-Stage Reconstruction Figure 1
2026-06-16cs.CV

SpatialAvatar-0: High-Quality 4D Head Avatar with Multi-Stage Reconstruction

Yiran Wang, Zeyu Zhang, Yuanming Li, Ziming Wang, Yang Zhao

2026-06-16三维

本文针对4D头部数字人中前馈生成与单人精修难以共享表示、且精修耗时的问题,提出基于FLAME绑定3D Gaussian的SpatialAvatar-0:用可变K源均值池化和单目到多视两阶段训练缓解域偏差,再以冻结布局的1万步精修和抗尖刺正则替代densification。结果显示其在VFHQ/HDTF零样本PSNR较GAGAvatar高1.5dB,在SplattingAvatar上以约60倍更短流程超过GeoAvatar 1.3dB。

Self-Questioning Vision-Language Models: Reinforcement Learning for Compositional Visual Reasoning Figure 1
2026-06-16cs.CV

Self-Questioning Vision-Language Models: Reinforcement Learning for Compositional Visual Reasoning

Saraswathy Amjith

Massachusetts Institute of Technology

2026-06-16视觉语言视觉感知强化学习

论文针对 VLM 在计数、比较等组合视觉推理中缺少显式中间步骤、而人工推理标注难扩展的问题,提出用 GRPO 奖励模型自行生成子问题/子答案再作答,无需示范分解。实验显示 A-OKVQA 上标准 RL 已从 46.8% 提至 51.6%,自提问仅到 52.2%,说明主要增益来自 RL 校准;但在跨域和复杂计数/材质问题上,自提问仍有一定价值,简单问题则可能因格式开销降性能。

Fusing Transferred Priors and Physics-based Decomposition for Underwater Image Enhancement Figure 1
2026-06-16cs.CV

Fusing Transferred Priors and Physics-based Decomposition for Underwater Image Enhancement

Haochen Hu, Yanrui Bin, Zhengyan Zhang, Minchen Wei, Chih-yung Wen, Bing Wang

2026-06-16视觉感知

针对水下图像增强依赖人工筛选伪标签、易被带偏的问题,论文将退化按成像物理拆成全局校色、去雾和背景噪声抑制三步,并分别迁移扩散模型、真实雾图数据和语义分割先验作监督,避免成对真值需求。实验显示该 P2UIE 在多数据集感知质量指标和下游视觉任务上优于基线,消融表明真实雾先验与前景/背景融合是主要增益来源。

Towards Next-Generation Healthcare: A Survey of Medical Embodied AI for Perception, Decision-Making, and Action Figure 1
2026-06-16cs.AI

Towards Next-Generation Healthcare: A Survey of Medical Embodied AI for Perception, Decision-Making, and Action

Cheng Zhang, Qing Cai, Xingzheng Wu, Xun Yang, Xiaojun Chang, Bingkun Bao, Liqiang Nie, Xinwang Liu, Yi Yang

2026-06-16视觉感知

本文针对医疗基础模型难以与真实临床环境物理交互的问题,将医疗具身智能统一到“感知—决策—行动”闭环框架下,系统梳理具身感知、规划导航与动作执行的技术脉络,并覆盖手术机器人、护理陪伴、沉浸式教学和远程诊疗等应用及数据集。主要结果是给出系统级分类与挑战清单,指出数据稀缺、不确定性建模和高精度安全控制仍是落地瓶颈;文中未充分说明定量增益。

Open-World Video Segmentation Figure 1
2026-06-16cs.CV

Open-World Video Segmentation

Qing Su, Kaiyang Li, Yuan Zhuang, Fei Miao, Shihao Ji

University of Connecticut

2026-06-16视觉感知强化学习

本文针对开放世界长视频分割中对象会持续出现、重现且标注粒度不固定的问题,指出现有方法缺少稳健的新对象发现与长期身份维护,传统 1:1 评测也会低估合理的细粒度预测。作者提出 Savvy,通过层级掩码发现、延迟接纳和轨迹合并管理对象生命周期,并提出 OGA 以 n:1 粒度无关匹配评估。实验显示,在 VIPSeg 上 GA 评测显著恢复被压低的性能;在 ScanNet、HM3D 上 Savvy 在 VPQ∞、STQ、身份持续性等指标上优于 DEVA+SAM、EntitySAM。

XPASS-Vis: A Dataset for Cross-Domain Personalized Image Aesthetic Assessment Figure 1
2026-06-16cs.CV

XPASS-Vis: A Dataset for Cross-Domain Personalized Image Aesthetic Assessment

Takato Hayashi, Hiroaki Takahara, Candy Olivia Mawalim, Hiromi Narimatsu, Akisato Kimura, Shiro Kumano, Shogo Okada

Japan Advanced Institute of Science and Technology, Communication Science Laboratories, NTT, Inc.

2026-06-16视觉感知数据集/基准

针对现有个性化图像美学评估多局限单域、难检验个人审美能否跨域迁移的问题,XPASS-Vis构建了艺术、时尚、风景三域共享标注者数据集,含6526个刺激、129人、87836次交互,并记录总体美学分与9类审美情绪。基于无监督域适应的基线显示,最佳方法在目标域无标签时达到监督上界约60%(Spearman ρ=.28),说明偏好有一定可迁移性,但仍存在明显差距。

NeRD: Neuro-Symbolic Rule Distillation for Efficient Ontology-Grounded Chain-of-Thought in Medical Image Diagnosis Figure 1
2026-06-16cs.CV

NeRD: Neuro-Symbolic Rule Distillation for Efficient Ontology-Grounded Chain-of-Thought in Medical Image Diagnosis

Hongxi Yang, Yiwen Jiang, Siyuan Yan, Jamie Chow, Eunis Li, Charlotte Poon, Stephanie Fong, Xiangyu Zhao, Deval Mehta, Yasmeen George, Zongyuan Ge

2026-06-16视觉感知

面向医学影像诊断中可解释性与临床工作量的矛盾,NeRD不再按类别判别性挑概念,而是从临床概念中自动归纳逻辑诊断规则,再经规则激活、逻辑化简和概念 grounding 蒸馏为本体对齐的多模态 CoT。两套皮肤数据实验显示其保持诊断性能并提升解释紧凑性,盲法专家评估认为推理更符合临床,同时支持较高效的概念级人工干预。

MoECa: Aligning Feature Reuse with Expert Decomposition in Diffusion Transformers Figure 1
2026-06-16cs.LG

MoECa: Aligning Feature Reuse with Expert Decomposition in Diffusion Transformers

Maoliang Li, Haojing Chen, Jiayu Chen, Zihao Zheng, Xinhao Sun, Hailong Zou, Xiang Chen

School of Computer Science, Peking University, Beijing, China, School of Software Engineering, University of Electronic Science and Technology of China, Chengdu, China

2026-06-16生成模型

这篇论文关注 DiT-MoE 扩散模型采样时跨时间步计算冗余的问题,指出传统按 token 缓存与 MoE 内部按专家分支演化的结构不匹配:同一 token 的不同专家分支变化速度不同。MoECa 将缓存粒度下探到专家分支,并加入专家感知控制及 MoE/注意力同步更新,在多个 DiT-MoE 上实现最高 2.83× 推理加速且质量损失较小。

Variational Test-time Optimization for Diffusion Synchronization Figure 1
2026-06-16cs.CV

Variational Test-time Optimization for Diffusion Synchronization

Hyunsoo Lee, Farrin Marouf Sofian, Kushagra Pandey, Stephan Mandt

Seoul National University, University of California, Irvine

2026-06-16生成模型优化算法

针对协同生成中多条扩散轨迹需保持一致、但现有同步方法依赖启发式且迁移性有限的问题,本文将扩散同步表述为最优控制/变分推断,在测试时优化控制变量,在一致性约束与预训练先验之间折中,无需再训练。SyncVC在宽图生成、视觉错觉生成和3D网格纹理三类任务上整体优于同步与任务专用基线,并能接入风格等外部约束。

Mutual Distillation of Dual-Foundation Models for Semi-Supervised PET/CT Segmentation Figure 1
2026-06-16cs.CV

Mutual Distillation of Dual-Foundation Models for Semi-Supervised PET/CT Segmentation

Fuyou Mao, Beining Wu, Yanfeng Jiang, Bohan Xu, Lixin Lin, Naye Ji, Hao Zhang, Yan Tang

2026-06-16视觉感知

针对 PET/CT 器官分割标注昂贵且 PET 功能信息与 CT 解剖结构存在错配的问题,MuDuo 将 CT 侧 SAM-Med3D 与 PET 侧 SegAnyPET 作为冻结双基础模型,通过自动提示生成、跨模态伪标签融合和 IoU 共识过滤,把结构与代谢先验蒸馏到轻量学生网络。实验显示其在 AutoPET 上仅用 5 个标注病例即优于 SemiSAM+ 等方法,Dice 更高且 HD95 明显降低。

On the Adversarial Robustness of Multimodal LLM Judges Figure 1
2026-06-16cs.CV

On the Adversarial Robustness of Multimodal LLM Judges

Zihan Wang, Guansong Pang, Zelin Liu, Wenjun Miao, Jin Zheng, Xiao Bai

2026-06-16视觉语言安全鲁棒

针对多模态大模型越来越多被用作图像质量与安全评测裁判、但其可被对抗扰动操纵的问题,论文提出 RobustMLLMJudge 评测框架,将裁判范式归纳为 token 概率、细粒度分解和提示式裁判三类,并进一步设计 MGSIA,通过诱导“Yes”等肯定语义与对齐高分样本表征流形生成可迁移的提分扰动。实验显示,多类先进 MLLM 裁判在质量和安全场景下均易被隐蔽扰动抬高分数,MGSIA 相比已有攻击更有效,凸显自动裁判鲁棒性风险。

Parameter-Efficient Adaptation of SAM 3 for Automated ITV Generation from 4DCT Images Figure 1
2026-06-16cs.CV

Parameter-Efficient Adaptation of SAM 3 for Automated ITV Generation from 4DCT Images

Changwoo Song

2026-06-16视觉感知

本文针对胸部放疗中4DCT各呼吸相独立勾画ITV导致耗时且易受相位伪影影响的问题,将SAM 3通过LoRA以少量3D CT标注做参数高效适配,并结合硬负样本挖掘与基于呼吸周期连续性的时空过滤来抑制假阳性。实验在肺和心脏结构上取得中位Dice 0.968/0.910、HD95 0.998/2.931 mm,仅7例标注可保留超过95%全数据精度,但4DCT定量真值验证仍文中未充分说明。

Fusion-E2Pulse: A Multimodal Event-RGB Fusion Network for Non-contact Pulse Wave Reconstruction Figure 1
2026-06-16cs.CV

Fusion-E2Pulse: A Multimodal Event-RGB Fusion Network for Non-contact Pulse Wave Reconstruction

Qian Feng, Hao Guo, Yan Niu, Zhenhuan Xu, Yidi Li

College of Computer Science and Technology, Taiyuan University of Technology, China, College of Artificial Intelligence

2026-06-16视觉语言三维

本文针对RGB rPPG因曝光积分丢失脉搏细节、事件相机又易受微小运动噪声干扰的问题,提出Fusion-E2Pulse:以滤波后的RGB信号提供稳定结构先验,结合事件流的高时间敏感性,并用双流编码、注意力融合和时频对抗监督重建脉搏波形。在EMPD上心率MAE达0.78 bpm,波形相关0.89,收缩期时长误差16.74 ms,显示其更适合恢复重搏切迹等细粒度形态特征。

Pixels to Proofs: Probabilistically-Safe Latent World Model Control via Parallel Conformal Robust MPC Figure 1
2026-06-16cs.RO

Pixels to Proofs: Probabilistically-Safe Latent World Model Control via Parallel Conformal Robust MPC

Devesh Nath, Anutam Srinivasan, Haoran Yin, Ruitong Jiang, Jeffrey Fang, Glen Chou

Georgia Institute of Technology

2026-06-16强化学习规划控制安全鲁棒

这篇论文针对从像素进行机器人控制时“潜在世界模型好规划但难保证真实安全”的问题,提出 SLS²:学习紧凑马尔可夫潜在动力学,并用保形预测校准动力学误差与安全分类器误差,再结合 GPU 并行 SLS 鲁棒 MPC 做可达集约束规划。实验覆盖 Reacher、Cube、Push-T 和双臂绳操作,名义成功率与安全/鲁棒成功率普遍优于 Le-WM、DINO-WM、PLDM 及潜在安全过滤基线;但 Push-T 等长序列复杂任务仍受潜在距离度量限制。

DenseControl: Instance-Level Controllable Synthesis of Dense Crowd Image Figure 1
2026-06-16cs.CV

DenseControl: Instance-Level Controllable Synthesis of Dense Crowd Image

Juncheng Wang, Lei Shang, Wang Lu, Baigui Sun, Shujun Wang

Lei Shang, and Baigui Sun are with Tongyi lab, Alibaba Group, Hangzhou, China, Wang Lu is with Tsinghua University, Beijing, China, Shujun Wang is with the Department of Biomedical Engineering, the Hong Kong Polytechnic University, Hong Kong SAR, China.

2026-06-16视觉感知规划控制

针对密集人群数据采集标注昂贵、现有扩散/ControlNet难以按实例精确控制位置与尺度的问题,DenseControl将人群实例表示为IOE位置嵌入,并用ISE注入隐式尺度信息,再通过Position Shortcut缓解控制信号到潜空间的投影困难。实验显示其在人群图像合成质量、位置/尺度可控性上优于多种控制方案,并可用于数据稀缺、迁移学习和天气泛化下的人群分析增强。

Unlocking Diffusion Hierarchies: Adaptive Timestep Selection for Zero-Shot Segmentation Figure 1
2026-06-16cs.CV

Unlocking Diffusion Hierarchies: Adaptive Timestep Selection for Zero-Shot Segmentation

Ramin Nakhli, Mahesh Ramachandran, Luca Ballan

2026-06-16视觉感知生成模型

针对扩散模型零样本分割中“高分辨率边界”与“语义上下文”难兼顾、且固定去噪时刻取特征的问题,论文提出融合自注意力与 U-Net 编码特征的上下文相似图,并观察到去噪过程存在从部件到物体的语义层级演化,据此为每个像素自适应选择最佳时刻。实验显示其在多项零样本分割基准上优于 DiffSeg、DiffCut 等方法。

Toward the Whole Picture: Accumulative Fingerprint Mapping and Reconstruction for Small-Area Mobile Sensors Figure 1
2026-06-16cs.CV

Toward the Whole Picture: Accumulative Fingerprint Mapping and Reconstruction for Small-Area Mobile Sensors

Xiongjun Guan, Jianjiang Feng, Jie Zhou

2026-06-16三维

面向手机小面积指纹传感器单次采集覆盖不足、姿态和形变变化大导致多次局部匹配低效且不稳的问题,论文将识别重构为“累积建图—状态更新—一次匹配”,提出以方向场和细节点等结构特征先配准融合、再相位重建脊线的经典基线,并展望结构化 token、两阶段位姿和扩散重建。当前主要结果是给出可解释 MATLAB 原型和评测方案,文中未充分说明完整基准性能增益。

An Extensive Benchmark for Single-round and Multi-round Instruction-based Image Editing Figure 1
2026-06-16cs.CV

An Extensive Benchmark for Single-round and Multi-round Instruction-based Image Editing

Yiwei Ma, Ke Ye, Weihuang Lin, Jiayi Ji, Xiaoshuai Sun, Tat-Seng Chua, Rongrong Ji

2026-06-16视觉感知数据集/基准

针对指令式图像编辑评测难以同时覆盖复杂指令、多样编辑类型与多轮稳定性的问题,论文提出 I2EBench2.0 基准,构建含 2000 余图像和 6700 余指令的数据集,并以单轮 16 个维度、多轮 7 个维度评估高低层编辑能力。作者测试 8 个近期模型,发现基准分数与人工偏好显著相关,并据此分析各模型在不同编辑维度和多轮场景下的优势与短板。

RaLMPH: Reliability-aware Learning for Multi-Pathologist Harmonization in Whole-Slide Image Classification Figure 1
2026-06-16cs.CV

RaLMPH: Reliability-aware Learning for Multi-Pathologist Harmonization in Whole-Slide Image Classification

Sungrae Hong, Jiwon Jeong, Soeun Cheon, Donghee Han, Sol Lee, Jisu Shin, Kyungeun Kim, Mun Yong Yi

2026-06-16视觉感知

针对全切片图像 MIL 训练中默认单一“金标准”标签、却与临床多病理医生分歧不符的问题,RaLMPH 将切片特征局部结构、实例包方差与专家标签熵合成可靠性场,按样本而非全局评估专家可信度,并用门控机制融合局部可靠意见。在六名病理医生标注的临床数据和模拟基准上,该方法相对多数投票、软标签及现有多标注学习方法取得更稳定的分类提升。

EcoBin: A Two-Stage Deep Convolutional Neural Network for Contamination-Aware Waste Classification Figure 1
2026-06-16cs.CV

EcoBin: A Two-Stage Deep Convolutional Neural Network for Contamination-Aware Waste Classification

Raghav Senthil Kumar

2026-06-16视觉感知

针对现有垃圾分类只识别物品类别、难以判断可回收物是否被油污/食物残渣污染的问题,EcoBin将EfficientNetV2-S路径分类器与污染检测器串联,并用U2-Net分割后合成污染数据训练第二阶段。结果显示基础阶段路径准确率96.13%,污染阶段ROC-AUC达0.99,在25张真实污染样本上由1/25提升到24/25正确,但真实污染数据规模仍偏小。

Track2View: 4D-Consistent Camera-Controlled Video Generation via Paired 3D Point Tracks Figure 1
2026-06-16cs.CV

Track2View: 4D-Consistent Camera-Controlled Video Generation via Paired 3D Point Tracks

Feng Qiao, Zhaochong An, Zhexiao Xiong, Serge Belongie, Nathan Jacobs

Washington University in St. Louis, University of Copenhagen

2026-06-16视觉感知规划控制三维

面向视频到视频的新视角重渲染,论文针对现有相机姿态嵌入、点云渲染或隐式对应难以同时保证空间与时间一致的问题,提出用源/目标视角成对3D点轨迹作为扩散视频模型条件,显式描述内容在何时何处出现,并通过双视角轨迹条件器传递上下文。在400段静/动态视频上,相比强基线提升视觉质量、视角同步和相机精度,旋转误差降30–65%、平移误差降61–72%。

Selective Synergistic Learning for Video Object-Centric Learning Figure 1
2026-06-16cs.CV

Selective Synergistic Learning for Video Object-Centric Learning

WonJun Moon, Jae-Pil Heo

2026-06-16视觉感知

论文针对视频对象中心学习中编码器注意力图与解码器对象图的结构性错位:前者边界锐利但噪声多,后者时空一致但边界模糊。SSync的核心洞察是只在各自可靠区域互相蒸馏,用编码器细化边界、用解码器去噪内部,并通过线性复杂度伪标签和传递式合并抑制 slot 冗余。实验显示其在多个 VOCL 基准上提升分解质量、较密集对齐更省内存,且对 slot 配置更稳健。

ST-DiffEye: Diffusion-based Continuous Gaze Generation via Joint Scanpath-Trajectory Modeling Figure 1
2026-06-16cs.CV

ST-DiffEye: Diffusion-based Continuous Gaze Generation via Joint Scanpath-Trajectory Modeling

Brian Nlong Zhao, Ozgur Kara, Junho Kim, James M. Rehg

University of Illinois Urbana-Champaign

2026-06-16生成模型规划控制

针对人类凝视生成中离散扫视路径只保留注视结构、连续眼动轨迹才包含细粒度运动动态的问题,ST-DiffEye 将扫视路径对齐为同长度序列并作为额外通道与轨迹联合扩散去噪,几乎不增加架构复杂度;同时用 CRPS 将常见序列指标改造成兼顾准确性与多样性的分布式评估。在 COCO-Search18、COCO-FreeView 和 MIT1003 上相对轨迹或扫视单模态基线取得整体最优或接近最优表现。

Analyzing Visual Aircraft Representations with Sparse Autoencoders Figure 1
2026-06-16cs.CV

Analyzing Visual Aircraft Representations with Sparse Autoencoders

Deepshik Sharma

Department of Computer Science & Engineering, Jain University, Bangalore, India

2026-06-16视觉感知

针对飞机细粒度分类中模型依赖的机身结构线索难以从热力图解释的问题,论文将稀疏自编码器用于分解 ConvNeXt 在 FGVC-Aircraft 上的中间空间激活,无需预设概念地挖掘可复用特征。结果显示部分稀疏特征对应起落架、舷窗、驾驶舱、发动机/机翼邻域等结构,消融会影响 logits、分类间隔和置信度;但特征仍存在多义性、定位较粗和信息分散等局限。

Lesion-DDPM: Lesion-Enhanced 3D Diffusion for MS MRI Synthesis Figure 1
2026-06-16cs.CV

Lesion-DDPM: Lesion-Enhanced 3D Diffusion for MS MRI Synthesis

Weidong Zhang, Yongchan Jung, Shafayat Mowla Anik, Furen Xiao, Vasudevan Janarthanan, Enkhzaya Chuluunbaatar, Byeong Kil Lee, Jeeho Ryoo

2026-06-16生成模型三维

针对多发性硬化症公开3D FLAIR MRI数据少、病灶小且稀疏导致生成模型易抹平病灶的问题,Lesion-DDPM将解剖/病灶掩码在3D U-Net扩散模型的编码器、瓶颈和解码器多层注入,并用病灶加权L1损失强化病灶体素重建。在MSLesSeg子集上,其病灶区域重建误差最低;仅用合成数据训练3D U-Net在真实MRI上Dice达0.616,优于最佳对照0.569,加入真实训练集后升至0.685。

Post-Launch Capability Expansion of Vision-Language Models via Prompting for On-Orbit Spacecraft Inspection Figure 1
2026-06-16cs.LG

Post-Launch Capability Expansion of Vision-Language Models via Prompting for On-Orbit Spacecraft Inspection

Nicholas A. Welsh, Lennon J. Shikhman, Monty Nehru Attazs, Seemanthini K. Putane, Van Minh Nguyen, Ryan T. White

Florida Institute of Technology, University of Florida, or expanding fixed label sets becomes operationally im-, than expanding a fixed label set through retraining, these

2026-06-16视觉语言视觉感知

面向在轨航天器巡检中发射后难以重训或上传大模型权重的问题,论文检验冻结 SAM3 是否可仅通过自然语言提示扩展部件分割能力。核心洞察是提示驱动的开放词汇分割对大尺度结构可用,但强依赖目标尺度与提示措辞;结构化空间/几何描述较短类名最高提升 82%。在 129 张未见卫星图像上,零样本单次推理达 0.385 mAP@0.5,星体和太阳翼较可靠,天线与推进器仍表现较弱。

From Frames to Temporal Graphs: In-Context Egocentric Action Recognition with Vision-Language Models Figure 1
2026-06-16cs.CV

From Frames to Temporal Graphs: In-Context Egocentric Action Recognition with Vision-Language Models

Bessie Dominguez-Dager, Francisco Gomez-Donoso, Miguel Cazorla, Marc Pollefeys, Daniel Barath, Zuria Bauer

University of Alicante, optionally augmented with labeled graph examples for in-context learning., provide a scalable, fine-tuning-free alternative to end-to-end approaches that better, in its native text domain, to predict the action label. This design exploits a key asymmetry: while, learning (ICL): prepending just one or two labeled graph examples to the prompt significantly boosts

2026-06-16视觉语言视觉感知

面向机器人操作相关的第一视角视频,论文指出通用 VLM 直接看帧难以捕捉抓取、释放、放置等手物交互的细粒度时序变化。其核心做法是用多阶段提示先生成局部交互叙述,再转成可文本序列化的 Temporal Action Graph,让 VLM 在符号图上做闭集动作识别和少样本上下文学习。在 EGTEA、Epic-Kitchens-100 上,11 个开放 VLM 的图推理通常优于同模型帧输入,且 1–2 个标注图示例带来明显增益。

Segmentation-based Detection for Efficient Multi-Task Spacecraft Perception Figure 1
2026-06-16cs.CV

Segmentation-based Detection for Efficient Multi-Task Spacecraft Perception

Sivaperuman Muniyasamy, Surendar Devasundaram

University of Arizona, Tucson, AZ, USA

2026-06-16视觉感知

面向在轨操作中算力、功耗受限且空间图像标注稀缺、光照复杂的航天器感知问题,论文将任务重心放在部件分割:用 MobileNetV3 编码器和轻量 U-Net 解码器预测部件掩码与类别,再由掩码并集解析得到检测框,省去独立检测回归头。在 SPARK 2026 Stream-1 上总分 0.9482,分类 1.0000、检测 0.9788、分割 0.8917,排名第二,模型仅 3.849M 参数、22.575 GFLOPs。

Timestep Rescheduling in Diffusion Inversion Figure 1
2026-06-16cs.CV

Timestep Rescheduling in Diffusion Inversion

Shangquan Sun, Ting Gong, Zhirui Liu, Jiamin Wu, Runkai Zhao, Mianxin Liu, Wenqi Ren, Xiaochun Cao

2026-06-16生成模型

论文关注扩散反演中少步、均匀时间步会累积重建误差的问题,指出误差尺度与 timestep 间隔强相关,并在两端呈抛物线式增大。作者据此提出无需额外参数和计算的非均匀重调度:先全局缩放,再用动态规划局部重排,把细步分配到高误差区。实验显示该调度可作为即插即用模块,稳定提升多种反演方法在图像重建和编辑中的表现。

MNet++: Extended 2D/3D Networks for Anisotropic Medical Image Segmentation Figure 1
2026-06-16cs.CV

MNet++: Extended 2D/3D Networks for Anisotropic Medical Image Segmentation

Kirsten Odendaal, Rade Bajic

School of Computing, Georgia Institute of Technology

2026-06-16视觉感知三维

针对厚层 MRI/CT 中 z 轴采样稀疏导致 2D 缺少体上下文、3D 易受各向异性影响的问题,论文在 nnU-Net 框架内复现混合 2D/3D 的 MNet,并加入可学习的 2D–3D 融合门控与沿深度建模的 VMamba 模块。结果显示复现性能接近原文,PROMISE Dice 为 89.0%,LiTS 肝脏/肿瘤为 94.3%/54.6%;空间门控带来约 0.8% 提升且开销小,VMamba 提高稳定性并使 LiTS 肝脏 Dice 达 95.8%,但结论仍需更多测试支撑。

Sustainable Face Recognition on Low-Power Devices with VQ-VAE Embeddings Figure 1
2026-06-16cs.CV

Sustainable Face Recognition on Low-Power Devices with VQ-VAE Embeddings

Christos Chronis, Georgios Th. Papadopoulos, Iraklis Varlamis

2026-06-16视觉感知生成模型

面向低功耗门禁等边缘人脸识别场景,论文针对云端大模型带来的带宽、能耗与隐私压力,提出在端侧用 VQ-VAE 将人脸压缩为离散潜码,云端再重建并用预训练人脸嵌入检索匹配,同时通过知识蒸馏保留身份判别信息。结果声称在显著降低端侧内存、计算和传输开销的同时接近主流嵌入模型精度,但具体量化增益与数据设置文中片段未充分说明。

Chroma-gated, differentiable OKLCH interpolation: Continuous Oklab fallback for color-cast reduction Figure 1
2026-06-16eess.IV

Chroma-gated, differentiable OKLCH interpolation: Continuous Oklab fallback for color-cast reduction

Naoyuki Uchida

Continuous Oklab fallback for color-cast reduction∗, OKLCH—the cylindrical (lightness, chroma, hue) form of Ottosson’s Oklab color space—is, Continuous Oklab fallback (COFb), a one-parameter, differentiable chroma gate w(C) =, Cn/(Cn + σn) that continuously blends the OKLCH path toward the linear Oklab path as, does not preserve chroma. In deployment, COFb runs entirely in plain Oklab (a, b) →sRGB, interpolation (color-mix(in oklch) and the like) is unavailable—older engines, image and, OKLCH—the cylindrical (lightness, chroma, hue) form of Ottosson’s Oklab [1]—is the interpo-, We close this gap with Continuous Oklab fallback (COFb): a one-parameter, differentiable, chroma gate that continuously blends the raw OKLCH path toward the linear Oklab path as chroma, control) against linear Oklab (w →0 at the neutral axis, no cast), and the blend is taken in the, (σ →0) and linear Oklab (σ →large) as a single family. The gate’s properties are confirmed

2026-06-16视觉感知

论文针对 OKLCH 在中性轴附近插值会产生色偏的问题,指出现有 CSS/ColorAide 式阈值继承只处理无彩端点,无法处理两个有彩端点间的绕行色偏。作者提出 COFb,用可微色度门控在 OKLCH 弧线与线性 Oklab 路径间连续混合,无需端点测试。实验显示默认参数下跨色色偏路径横向偏差约降 49.5%、色相偏移降 35.5%;但无彩端点场景仍不如二值切换,且不保持色度。

Facial Affect Analysis for Service-Oriented Systems: Advances, Challenges, and Future Visions Figure 1
2026-06-16cs.CV

Facial Affect Analysis for Service-Oriented Systems: Advances, Challenges, and Future Visions

Spyridon Georgiou, Aggelos Psiris, Thomas Lagkas, Vasileios Argyriou, Panagiotis Sarigiannidis, Iraklis Varlamis, Georgios Th. Papadopoulos

2026-06-16视觉感知

本文动机是将面部情感分析从单一识别模型转向可部署的服务组件,解决现有研究过度依赖闭集基准、忽视边缘/云端延迟、隐私、公平性和生命周期维护的问题。核心洞察是按任务、架构与部署层重组FAA能力,并用服务契约、置信度输出和运行时监控评估其可组合性。主要结果是给出面向教育、健康、智能环境和交通等场景的部署路线图,指出单纯精度提升不足以支撑SoSE落地。

DYNA-PRUNER: Input-Adaptive Data-Model Co-Pruning for Efficient and Scalable Spatio-Temporal Media Prediction Figure 1
2026-06-16cs.CV

DYNA-PRUNER: Input-Adaptive Data-Model Co-Pruning for Efficient and Scalable Spatio-Temporal Media Prediction

Fuyan Zhang, Yuqi Li, Yingli Tian, Edmond S.L. Ho

2026-06-16视觉感知

该文针对天气、交通等时空预测中大量区域信息冗余但模型仍密集计算的问题,提出 Dyna-Pruner,将输入区域裁剪与模型结构裁剪用共享重要性场同步起来,为每个样本生成稀疏子网络,而非固定压缩。其在 WeatherBench、SEVIR、TaxiBJ 上可接入 CNN/RNN/Transformer,最高减少约 70% FLOPs,并在 Jetson AGX Orin 上实现 2.5 倍加速,精度损失低于 1%。

CausalDrive: Real-time Causal World Models for Autonomous Driving Figure 1
2026-06-16cs.CV

CausalDrive: Real-time Causal World Models for Autonomous Driving

Tianyi Yan, Huan Zheng, Dubing Chen, Meizhi Qu, Yingying Shen, Lijun Zhou, Mingfei Tu, Bing Wang, Guang Chen, Hangjun Ye, Haiyang Sun, Cheng-zhong Xu, Jianbing Shen

2026-06-16强化学习

面向现有驾驶世界模型多停留在离线视频生成、依赖未来布局且难以闭环交互的问题,CausalDrive只用初始前视图、自车轨迹和文本提示生成反应式场景,引入SocioDrive-Bench刻画让行/博弈等“驾驶社会性”,并用因果自回归flow teacher与Self-Corrective Forcing蒸馏实现≤4步、约12 FPS生成。实验展示其可用于闭环评测、Video2Reward强化学习后训练和实时人在环仿真,训练策略在交互能力上更优。

SGFormer++: Semantic Graph Transformer for Incremental 3D Scene Graph Generation Figure 1
2026-06-16cs.CV

SGFormer++: Semantic Graph Transformer for Incremental 3D Scene Graph Generation

Mengshi Qi, Changsheng Lv, Zijian Fu, Xianlin Zhang, Huadong Ma

2026-06-16三维

面向点云三维场景图生成中全局关系难建模、GCN易过平滑,以及真实场景关系类别持续增加导致遗忘的问题,SGFormer++以Transformer做全局消息传递,设计线性复杂度的边感知Graph Embedding、结合LLM/VLM语义注入,并用空间引导适配器与级联二分类头支持增量谓词学习。在3DSSG上达到标准与增量设置SOTA,增量Predicate A@1绝对提升4.49%。

PPDM: Pixel Puzzling Diffusion Model for Speed and Memory Efficient Volumetric Medical Image Translation Figure 1
2026-06-16cs.CV

PPDM: Pixel Puzzling Diffusion Model for Speed and Memory Efficient Volumetric Medical Image Translation

Tianqi Chen, Jun Hou, Yinchi Zhou, James S. Duncan, Chi Liu, Bo Zhou

Department of Radiology, Northwestern University, Chicago, IL, USA, Department of Biomedical Engineering, Yale University, New Haven, CT, USA, Department of Radiology and Biomedical Imaging, Yale School of Medicine, New Haven, CT, USA

2026-06-16视觉感知生成模型

针对高分辨率3D医学图像翻译中扩散模型显存和采样开销过高的问题,PPDM用可逆的pixel puzzle/unpuzzle将空间分辨率换为通道维度,在保留全局体积上下文的同时降低激活内存,并结合从条件输入出发的direct bridge diffusion与puzzle-gradient loss抑制重排伪影。实验覆盖PET去噪、PET衰减校正和MRI跨模态翻译,性能达到或超过完整3D扩散模型,训练显存最多降低一个数量级且推理更快。

Conditional Multi-Event Temporal Grounding in Long-Form Video Figure 1
2026-06-16cs.CV

Conditional Multi-Event Temporal Grounding in Long-Form Video

Yuanhao Zou, Arthad Kulkarni, Lucas Tonanez, Lincoln Spencer, Guangyu Sun, Tianxingjian Ding, Andong Deng, Yi Li, Shuangjun Liu, Yuan Li, Dashan Gao, Ning Bi, Taotao Jing, Shuai Zhang, Chen Chen

University of Central Florida

2026-06-16视觉语言视觉感知

长视频中的真实查询常需在时空条件约束下找全多个事件并给出计数,现有单片段定位或无条件计数基准难以评估这一能力。论文提出 CoMET-Bench,覆盖600个长视频、2789个组合查询和负样本,并用统一协议及 Rejection-F1 同时衡量计数、定位与拒答;还提出免训练的 CoMET-Agent,以视频时序图和全局记忆做结构化搜索聚合。实验显示现有 MLLM 与专用方法均表现不足,CoMET-Agent 相比 GPT-5 的 F1@0.5 提升6.1%,但仍暴露实体跟踪、均匀检索和因果配对瓶颈。

CoMNeT: A MedNeXt-CorrDiff Framework for Volumetric Brain Tumor Segmentation Figure 1
2026-06-16cs.CV

CoMNeT: A MedNeXt-CorrDiff Framework for Volumetric Brain Tumor Segmentation

Michael L. Evans, MD Fayaz Bin Hossen, MD Shibly Sadique, Walia Farzana, Khan M. Iftekharuddin

Department of Electrical and Computer Engineering, Old Dominion University, Norfolk, VA, USA

2026-06-16视觉感知

针对多模态 MRI 胶质瘤中 ET/TC 小目标和跨扫描差异导致的体素级分割不稳,论文提出 CoMNeT:以 3D MedNeXt 为主干,加入 CorrDiff 对概率图做残差式纠错,并进行五折模型概率集成。UTSW-Glioma 五折验证平均 Dice 为 0.7798,高于 SegResNet 的 0.7555 和 MedNeXt 的 0.7697;但 TC 略低于单独 MedNeXt,纠错模块的独立贡献仍不够充分。

HemExp: Clinically-Guided Latent Diffusion for Modeling Hematoma Expansion Figure 1
2026-06-16cs.CV

HemExp: Clinically-Guided Latent Diffusion for Modeling Hematoma Expansion

Orhun Utku Aydin, Satoru Tanioka, Tzu I Chuang, Alexander Koch, Dimitrios Rallios, Marie Gultom, Begum Tahhan, Fujimaro Ishida, Dietmar Frey, Adam Hilbert

2026-06-16生成模型

针对脑出血血肿扩大的预测不能只给二分类风险或单一体积的问题,HemExp 将基线 NCCT、临床变量和指定扩张状态注入潜在扩散模型,并用出血感知多头 VAE 同时生成随访 CT 与 IPH/IVH 分割。模型在多中心 450 例训练、外院 107 例测试,可通过多次采样形成空间扩张概率图;改变发病到成像时间、抗凝状态会移动预测体积分布,并能呈现脑室受累、占位效应等临床终点,但作者也强调其更适合作为条件模拟器而非独立预测器。

G2IA: Geometry-Guided Instance-Aware Retrieval and Refinement for Cross-Modal Place Recognition Figure 1
2026-06-16cs.CV

G2IA: Geometry-Guided Instance-Aware Retrieval and Refinement for Cross-Modal Place Recognition

Xianyun Jiao, Jingyi Xu, Zhongmiao Yan, Xieyuanli Chen, Lin Pei

2026-06-16视觉感知

面向只有单目相机的机器人在预建 LiDAR 地图中定位,G2IA 将跨模态地点识别从单纯全局描述子匹配改为“检索+验证”:利用 VGGT 视觉几何先验和实例特征对齐图像与点云表示,再用局部实例形状和相对布局一致性重排候选。实验在 NCLT、KITTI 等基准上提升不同阈值下的识别性能,并显示较好的跨数据集泛化。

Decoupled Motion Representation Learning for Moving Infrared Small Target Detection Figure 1
2026-06-16cs.CV

Decoupled Motion Representation Learning for Moving Infrared Small Target Detection

Guoyi Zhang, Peiwen Wu, Han Wang, Xiangpeng Xu, Xiaohu Zhang

2026-06-16视觉感知

面向动态场景中平台、背景与红外小目标运动高度耦合导致的误检问题,论文的关键洞察是背景误警多服从全局相干运动,而真实目标表现为稀疏局部异常。方法用显式光流分支建模相干背景运动,并以自监督适配到红外域,再用可变形对齐分支捕获局部异常、抑制相干运动诱发响应。在两个红外小目标检测基准上优于现有方法,尤其改善复杂运动场景且保持较好推理效率。

Enhancing Precision Agriculture with a Hybrid Deep Learning Framework for Multi-Class Plant Disease Classification and Interpretability Figure 1
2026-06-16cs.CV

Enhancing Precision Agriculture with a Hybrid Deep Learning Framework for Multi-Class Plant Disease Classification and Interpretability

Hasibul Islam Sufi, Ridam Roy, Shayla Alam Setu, Mahimul Islam Nadim

¹ Department of Computer Science and Engineering, Daffodil International University, Dhaka 1216, Bangladesh, depended upon the trained man’s eye and hand, often surrounded by laboratory activity., Although effective procedures are laborious, time-consuming, costly, and thus, (Techniques) AI that offers. Inexpensive, scalable, rapid solutions for an auto- mated

2026-06-16视觉感知

面向农业病害早诊断中人工识别慢、成本高且难以规模化的问题,论文比较 ResNet-50、MobileNetV2、EfficientNet-B0 与 ResNet+ViT 混合模型,在覆盖多作物 38 类病害的叶片数据上训练,并加入 Grad-CAM、显著图和分割可视化提升可解释性。结果显示 ResNet-50 验证准确率最高为 98.74%,混合模型为 98.58%;但混合架构相对 CNN 的增益来源不清,可能主要来自数据规模与强基线微调。

MamBOA: State-Space Architecture for Video Recognition Figure 1
2026-06-16cs.CV

MamBOA: State-Space Architecture for Video Recognition

Mustafa Bora Çelik

aAnkara Medipol University, Ankara, 06050, Turkey

2026-06-16视觉感知

针对细粒度视频识别中3D算子代价高、相邻特征硬相减表达力弱的问题,MamBOA将连续帧特征交错成序列,用Mamba的S6状态递推在共享隐状态中“合成”运动差分,并结合空间分支、对齐解码与双路径池化,作为可接入CNN/Transformer/Mamba的轻量时序头。其每对特征约增2.1 GFLOPs,在Diving48上图像预训练达85.02%、视频预训练全视频前向达86.24% Top-1。

Trusted Multi-View Deep Learning Classification of Fetal Congenital Heart Disease with Feature-level and Decision-level Fusion Figure 1
2026-06-16cs.CV

Trusted Multi-View Deep Learning Classification of Fetal Congenital Heart Disease with Feature-level and Decision-level Fusion

Tan Zhou, Shifa Yao, Suncheng Xiang, Dahong Qian, Baoying Ye

2026-06-16视觉感知

胎儿先心病超声诊断受多视角互补信息难融合、图像质量不稳定影响。该文构建含五个标准切面的较大规模CHD数据集,提出MVC-FDF:用共享ResNet50提特征,SE注意力做特征级多视图融合,再以Dempster–Shafer证据理论进行决策融合并输出不确定性,以降低低质量视图干扰。实验在自建数据集上取得较高分类表现,但外部验证与具体增益来源文中未充分说明。

Focus, Align, and Sustain: Counteracting Gradient Dilution in Incremental Object Detection Figure 1
2026-06-16cs.CV

Focus, Align, and Sustain: Counteracting Gradient Dilution in Incremental Object Detection

Aoting Zhang, Dongbao Yang, Chang Liu, Xiaopeng Hong, Yu Zhou

2026-06-16视觉感知优化算法

面向动态环境中目标类别持续增加的问题,论文指出 DETR 式增量目标检测的遗忘根源在于“梯度稀释”:旧知识保持信号被背景噪声、匹配漂移和样本支撑不足逐步削弱。其 FAS 框架通过先验注入查询、确定性锚点蒸馏和流形支撑回放,分别聚焦前景梯度、稳定跨阶段匹配并覆盖旧类边界;实验显示在 40+10×4 等设置中较已有方法提升超过 5 AP。

Landmark-free Assessment of Lower-limb Alignment with Implicit Neural Shape Functions from Knee Radiographs Figure 1
2026-06-16cs.CV

Landmark-free Assessment of Lower-limb Alignment with Implicit Neural Shape Functions from Knee Radiographs

Zhisen Hu, Antti Kemppainen, David Johnson, Egor Panfilov, Huy Hoang Nguyen, Timothy Cootes, Claudia Lindner, Aleksei Tiulpin

2026-06-16视觉感知

针对膝关节置换前后下肢力线评估依赖人工测量或固定解剖标志点、难以适配临床定义变化的问题,本文用隐式神经形状函数将股骨和胫骨轮廓编码为连续潜空间,并从潜码直接回归 aTFA、aMPTA、JLCA 等角度。内部566例训练、50例内部测试和402例MRKR外部测试显示,其精度接近标志点方法与人工一致性,但外部集略有下降,泛化增益来源仍不完全清楚。

SPARK: Spatial Policy-driven Adaptive Reinforcement learning for Knowledge distillation Figure 1
2026-06-16cs.CV

SPARK: Spatial Policy-driven Adaptive Reinforcement learning for Knowledge distillation

Mohamed Jismy Aashik Rasool, Shabir Ahmad, Gisong Oh, Teag Kuen Whangbo

Department of IT Convergence Engi-, neering, Gachon University, Sujeong-

2026-06-16强化学习

低比特量化虽利于在端侧部署图像复原模型,但量化噪声会优先破坏边缘与纹理,而传统蒸馏对所有像素等权监督。SPARK 将蒸馏权重分配视为强化学习策略:用边缘、纹理、学生误差和师生差距生成空间权重图,在 QAT 中强调困难区域且推理无额外开销。实验称其在多任务和多学生架构上优于 PTQ、QAT 与现有 KD,收益主要集中在高频区域。

HairLRM: Strand-based Hair Modeling via Large Reconstruction Models Figure 1
2026-06-16cs.GR

HairLRM: Strand-based Hair Modeling via Large Reconstruction Models

Yuefan Shen, Yican Dong, Xiufeng Huang, Zhongtian Zheng, Youyi Zheng, Kui Wu

State Key Lab of CAD and CG, Zhejiang University, Hong Kong Baptist University, State Key Lab of CAD and CG, Zhejiang University Hangzhou China, Hong Kong Baptist University Hong Kong China

2026-06-16强化学习三维

本文针对从单/多视图图像直接回归三维发丝场易出现遮挡顺序错误、卷发方向过平滑等问题,提出以大重建模型生成的头发网格作为几何支架,再用 Dual Orientation AutoEncoder、潜空间优化、表面引导修正和闭环迭代生成显式发丝。实验显示其在真实与风格化图像、马尾和卷发等复杂拓扑上比现有方法更稳健,轮廓与局部走向更准确。

Show the Signal, Hide the Noise: Spectral Forcing for Pixel-Space Diffusion Figure 1
2026-06-16cs.CV

Show the Signal, Hide the Noise: Spectral Forcing for Pixel-Space Diffusion

Weichen Fan, Haiwen Diao, Penghao Wu, Ziwei Liu

S-Lab, Nanyang Technological University

2026-06-16生成模型

本文针对像素空间扩散在各时间步处理全频噪声图像而浪费容量的问题,指出自然图像频谱下存在随时间移动的信噪频带边界。作者提出无需参数的 Spectral Forcing,在输入端用时间条件 2D-DCT 低通显式隐藏噪声高频;在粗 patch、 高频多为噪声时收益最大。ImageNet-256 上 JiT-700M/32 的 FID 从 24.19 降至 20.68,IS 提升到 93.96,并迁移到 SenseNova-U1 改善 DPG-Bench 与 GenEval。

Comparing Human Gaze and Vision-Language Model Attention in Safety-Relevant Environments Figure 1
2026-06-16cs.CV

Comparing Human Gaze and Vision-Language Model Attention in Safety-Relevant Environments

Marta Vallejo, Siwen Wang

2026-06-16视觉语言视觉感知安全鲁棒

面向自动驾驶、机器人和公共空间监控中的安全感知需求,论文检验视觉语言模型能否预测人类在风险场景中的注视区域。作者用10名被试、33张不同风险图像构建眼动热图,并将GPT-4o等模型的空间风险预测转为显著性图进行对齐评估。结果显示GPT-4o与人类注视有中等相关性(r=0.515、AUC-Judd=0.806),Gemini Pro在多数定位指标上更强,而GPT-4o的分布匹配KL更低,说明VLM可在无眼动训练下近似人类安全注意模式。

Keep It in Mind: User Centric Continual Spatial Intelligence Reasoning in Egocentric Video Streams Figure 1
2026-06-16cs.CV

Keep It in Mind: User Centric Continual Spatial Intelligence Reasoning in Egocentric Video Streams

Yun Wang, Junbin Xiao, Han Lyu, Yifan Wang, Jing Zuo, Zhanjie Zhang, Hong Huang, Dapeng Wu, Angela Yao

2026-06-16视觉感知

面向可穿戴/具身助手,论文指出现有空间理解多停留在短片段或当前可见内容,难以随用户运动持续更新“物体相对我在哪”。作者提出UCS-Bench长时第一视角问答基准,并用DirectMe以相机位姿、深度和物体关系构建动态场景图记忆。实验显示其显著提升Qwen3-VL等MLLM,在长时间间隔问题上优于空间感知和长视频流基线。

City landscape in sight: A crowdsourced framework for unlocking urban-scale window view perceptions from real estate imagery Figure 1
2026-06-16cs.CV

City landscape in sight: A crowdsourced framework for unlocking urban-scale window view perceptions from real estate imagery

Chucai Peng, Sijie Yang, Ang Liu, Yang Xiang, Zhixiang Zhou, Filip Biljecki

2026-06-16视觉感知

针对城市尺度真实住宅窗景感知缺少数据与建模的问题,论文利用武汉房产平台的1.23万张真实窗景图,并通过304人两两比较构建六维感知标签,训练混合神经网络进行全城预测。结果显示窗景感知存在显著空间冷热区和楼层梯度:高层更受偏好且视野开阔,低层更安静鲜活;天空、树木和低层建筑提升偏好,高层建筑增加单调与压迫,且影响呈非线性。

Adaptive Inference-Time Scaling via Early-Step Latent Verification for Image Editing Figure 1
2026-06-16cs.CV

Adaptive Inference-Time Scaling via Early-Step Latent Verification for Image Editing

Yue Yu, Yang Jiao, Jiayu Wang, Qi Dai, Jingjing Chen

Yue Yu, Yang Jiao, and Jiayu Wang are with the College of Computer

2026-06-16视觉感知强化学习

本文针对指令式图像编辑中初始噪声随机性导致复杂编辑不稳定的问题,提出 VeriLatent:在去噪早期直接用潜空间编辑激活图评估候选噪声是否会在正确区域触发有效编辑,避免先解码再验证的成本与噪声预览误判,并按任务难度自适应分配推理预算。多基准和多基础模型实验显示其提升指令跟随与编辑质量,同时相较 Best-of-N 将 NFE 降低约 5.5–6 倍。

Enabling Real-Time Point-of-Care Ultrasound Segmentation: A GPU-Free Deployment in Resource-Limited Settings Figure 1
2026-06-16cs.CV

Enabling Real-Time Point-of-Care Ultrasound Segmentation: A GPU-Free Deployment in Resource-Limited Settings

Weihao Gao

School of Computer Science and Artificial Intelligence, Guangdong University of Education

2026-06-16视觉感知

论文针对POCUS在基层和移动场景中“超声设备便宜、AI分割却依赖昂贵GPU”的部署矛盾,将原用于息肉分割的超轻量UltraSeg系统适配到多部位超声分割。核心洞察是许多单ROI超声任务可由百万参数以下CNN完成,而非依赖大模型。实验覆盖10个公开数据集、6类解剖部位,UltraSeg-130K/500K在CPU和手机端实现实时推理,500K版本Dice可匹敌或超过UNet,并在UDIAT、DDTI零样本跨数据集测试中表现更稳健。

Label Shift Aware Adaptation for Online Zero-shot Learning with Contrastive Language-Image Pre-Training (CLIP) Figure 1
2026-06-16cs.CV

Label Shift Aware Adaptation for Online Zero-shot Learning with Contrastive Language-Image Pre-Training (CLIP)

Pengxiao Han, Changkun Ye, Yanshuo Wang, Jinguang Tong, Miaohua Zhang, Xuesong Li, Jie Hong, Lars Petersson

2026-06-16视觉感知

针对 CLIP 在线零样本识别中测试流类别分布与预训练源分布不一致导致的预测偏置,论文将任务重新表述为标签偏移下的域适应问题,提出 LSA:在不存储历史样本、不更新 CLIP 参数的条件下,用当前无标注预测动态估计目标标签先验,并重加权后验分数。实验覆盖 14 个数据集,显示其相较现有在线零样本 CLIP 方法有稳定提升,适合边缘或机器人等流式部署场景。

Variational Network with Wavelet-based UNET in Accelerated MRI Reconstruction from Under Sampled K-space Data Figure 1
2026-06-16cs.CV

Variational Network with Wavelet-based UNET in Accelerated MRI Reconstruction from Under Sampled K-space Data

Yasir Arafat Prodhan (1), Shaikh Anowarul Fattah (1) ((1) Department of Electrical and Electronic Engineering, Bangladesh University of Engineering and Technology, Dhaka, Bangladesh)

2026-06-16三维

针对欠采样 k-space 加速 MRI 中易产生混叠、噪声放大并丢失细节的问题,论文将变分网络的物理一致性迭代与小波 U-Net 结合,用 DWT/IDWT 替代池化,在重建细化和线圈敏感图估计中保留多尺度高低频信息。实验称在 fastMRI 膝部与 M4Raw 脑数据上达到 SOTA,并通过消融验证小波分解带来更好的伪影抑制和细节保持。

GeoStream: Toward Precise Camera Controlled Streaming Video Generation Figure 1
2026-06-16cs.CV

GeoStream: Toward Precise Camera Controlled Streaming Video Generation

Yizhou Zhao, Yifan Wang, Xiaoyuan Wang, Yushu Wu, Hao Zhang, Moayed Haji-Ali, Rameen Abdal, Ashkan Mirzaei, Yanyu Li, Willi Menapace, Laszlo Jeni, Sergey Tulyakov, Peter Wonka, Chaoyang Wang

δ Northeastern University, ρ Rice University, σ Snap Inc., Work partially done during an internship at Snap Inc. Corresponding author.

2026-06-16视觉感知规划控制

GeoStream针对视频世界模型中相机轨迹控制不准的问题:隐式姿态条件缺少几何约束,固定3D缓存又会在大视角运动后失效。其核心是用生成帧在线估深、反投影并重投影,周期性刷新3D缓存,并以学生自身输出构造条件做on-policy蒸馏,缓解自回归与几何反馈漂移。实验显示其在RealEstate10K上显著降低全局和局部相机误差,同时保持较好视觉质量。

DLWM: Diverse Latent World Models for Efficient Multimodal Reasoning Figure 1
2026-06-16cs.CV

DLWM: Diverse Latent World Models for Efficient Multimodal Reasoning

David Huang, Lianlei Shan

University of Toronto, Tsinghua University

2026-06-16视觉语言强化学习

这篇论文针对多模态场景中遮挡、模糊和语义歧义导致的单一路径推理不稳、且多路径推理开销大的问题,提出 DLWM:在连续潜空间显式构造多个“世界假设”,用正交正则避免假设塌缩,并通过资源感知强化学习动态决定扩展、终止、合并或回答。实验称在多个多模态推理基准上准确率提升 2–5 个点,同时内存降低 24%,但具体增益在多大程度来自假设多样性与 RL 调度的拆分仍需看消融细节。

RefGC-SR$^2$: Reference-guided Generated Content Super-Resolution and Refinement Figure 1
2026-06-16cs.CV

RefGC-SR$^2$: Reference-guided Generated Content Super-Resolution and Refinement

Jeahun Sung, Dahyeon Kye, Soo Ye Kim, Jihyong Oh

CMLab, Chung-Ang University

2026-06-16视觉感知

本文针对参考引导生成中高分辨率参考图被降采样、输出又含身份失真和纹理缺失的问题,提出 RefGC-SR² 这一后处理任务:同时做超分和生成伪影修复。核心创新是构建 LRGI-HRRI-HRGT 三元组数据,并用双图条件生成器合成对齐低质样本,结合频率感知 DiT、LoRA 专家和频域损失注入参考细节。实验显示其较 RefGCR、RefSR 基线能更好保持身份并恢复高频细节。

HiRo: A Compact Four-Directional Hierarchical Reservoir Token-Mixer for Efficient Image Classification Figure 1
2026-06-16cs.CV

HiRo: A Compact Four-Directional Hierarchical Reservoir Token-Mixer for Efficient Image Classification

Md Farhadul Islam, Ishan Thakkar, J. Todd Hastings

University of Kentucky, University of Kentucky Lexington USA

2026-06-16视觉感知

为降低视觉分类中可训练 token-mixer 的参数与计算开销,HiRo 将图像补丁保留为二维网格,在常规/移位窗口内做四方向扫描,并用两级固定 reservoir 加轻量可训练读出混合局部与跨窗口信息。实验称其在少于 100 万可训练参数下,MNIST、CIFAR-10、CIFAR-100 准确率分别达 99.46%、85.57%、59.10%,但更大规模数据上的泛化仍文中未充分说明。

MotionVLA: Vision-Language-Action Model for Humanoid Motion Figure 1
2026-06-16cs.CV

MotionVLA: Vision-Language-Action Model for Humanoid Motion

Nonghai Zhang, Siyu Zhai, Yanjun Li, Zeyu Zhang, Zhihan Yin, Yandong Guo, Boxin Shi, Hao Tang

School of Computer Science, Peking University

2026-06-16机器人视觉语言视觉感知

面向场景图像与文本驱动的人形动作生成,论文指出单一运动码本会让低频姿态主导量化,削弱高频速度/接触动态,导致漂移和脚滑。其核心是 DSFT 双流频域 tokenizer,将 Base 姿态语义与 Phys 物理动态分别经 DCT 截断和 BPE 压缩,再由 Qwen3.5 自回归先生成 Base 后生成 Phys。HumanML3D 上 Diversity 与真实数据差距缩小超 50%,MBench 的条件一致性提升 3.8%,脚滑略降。

Beyond Scalar Distances: Semantic Attribute Gradients from Frozen MLLMs for Visual Embeddings Figure 1
2026-06-16cs.CV

Beyond Scalar Distances: Semantic Attribute Gradients from Frozen MLLMs for Visual Embeddings

Shubhang Bhatnagar, Dheeraj Baiju, Narendra Ahuja

University of Illinois Urbana-Champaign

2026-06-16优化算法

论文针对深度度量学习只用同/异类标量监督、难以捕捉细粒度属性差异的问题,提出 SAGA:用冻结 MLLM 比较图像对并通过 GRPO 将正确判别转化为属性级梯度,同时蒸馏其注意力到池化器,推理时仍只保留视觉编码器。在 CUB、Cars、Aircraft、iNat-Aves 零样本检索上,Recall@1 较最强基线提升约 3–6 个百分点。

DragMesh-2: Physically Plausible Dexterous Hand-Object Interaction with Articulated Objects Figure 1
2026-06-16cs.RO

DragMesh-2: Physically Plausible Dexterous Hand-Object Interaction with Articulated Objects

Tianshan Zhang, Yijia Duan, Yanjun Li, Zeyu Zhang, Hao Tang

School of Computer Science, Peking University

2026-06-16视觉感知

本文针对灵巧手操作抽屉、门把等铰接物体时,仅靠几何轨迹或固定动力学强化学习难以维持真实接触、且负载变化会导致策略失效的问题,提出 DragMesh-2,将目标关节运动限制为只能由手—把手物理接触产生,并用 PICA 注入接触保持、脱离风险、动作饱和、阻尼随机化与时序接触响应等信号。在 7 个 GAPartNet 物体和多种阻尼条件下,该方法相比基线在负载变化下更稳健,同时保持较高任务成功率。

EyeMVP: OCT-Informed Fundus Representation Learning via Paired CFP--OCT Pretraining Figure 1
2026-06-16cs.CV

EyeMVP: OCT-Informed Fundus Representation Learning via Paired CFP--OCT Pretraining

Zhuo Deng, Ruiheng Zhang, Ziheng Zhang, Weihao Gao, Yitong Li, Qian Wang, Lei Shao, Jiaoyue Dong, Zhixi Zeng, Lijian Fang, Haibo Wang, Xiaobin Lin, Tao Liu, Zhicheng Du, Zhengwei Zhang, Lin Yang, Zheng Gong, Xinyu Zhao, Zhenquan Wu, Fang Li, Zhiguang Zhou, Guoming Zhang, Sun Jing, Han Lv, Wenbin We, Lan Ma

2026-06-16视觉感知

EyeMVP针对眼底照相便宜易用但缺少OCT深度结构信息的问题,用同眼同日CFP-OCT大规模配对数据做跨模态掩码重建预训练,并以源约束交叉注意力和CFP结构掩码缓解两种成像几何不对齐;推理时只需CFP。在16项分类、分割、少样本和检索任务上优于多种视网膜基础模型,黄斑水肿AUROC达0.948、近视黄斑劈裂0.825,但部分增益可能来自配对数据规模和数据优势,架构独立贡献仍需数据匹配验证。

Multi-view feature High-order Fusion for Space Weak Object Detection and Segmentation Figure 1
2026-06-16cs.CV

Multi-view feature High-order Fusion for Space Weak Object Detection and Segmentation

Weilong Guo, Yuhan Sun, Shengyang Li

and Key Laboratory of Space Utilization, Chinese Academy of Sciences, Beijing 100094, China.

2026-06-16视觉感知

面向空间科学与遥感图像中尺度小、对比度低、外观信息有限的弱目标,论文将单幅图像的空间、通道、频率注意力视作多视角特征,提出可插拔的高阶融合模块 MHF,并用递归任务贡献门控选择减少冗余、保留互补信息。在两个自建空间科学数据集和一个卫星视频数据集上,MHF 接入 21 种检测/分割模型均带来提升,并报告达到三数据集两类任务的 SOTA。

Teacher-Student Structure for Domain Adaptation in Ensemble Audio-Visual Video Deepfake Detection Figure 1
2026-06-16cs.MM

Teacher-Student Structure for Domain Adaptation in Ensemble Audio-Visual Video Deepfake Detection

Elham Abolhasani, Maryam Ramezani, Hamid R. Rabiee

is available. Furthermore, our model’s architecture and training, Department of Computer Engineering, Sharif University of Technology., Finally, a decision-making module integrates the predictions to determine the final label.

2026-06-16视觉感知

针对音视频 Deepfake 检测在跨数据域时性能明显下降、且现实中可能缺失单一模态的问题,论文提出 EAV-DFD:将音频、视觉和音视频交互子网络集成,并用教师-学生框架以少量新域样本做域适配,同时保留旧域知识和模态级可解释输出。在 FakeAVCeleb 训练、DFDC/Deepfake TIMIT/PolyGlotFake 测试中,AUC 分别提升 4.09%、17.94% 和 0.5%。

Learn Temporal Consistency For Robust Satellite Video Detector Figure 1
2026-06-16cs.CV

Learn Temporal Consistency For Robust Satellite Video Detector

Weilong Guo, Shengyang Li, Yanfeng Gu

and Key Laboratory of Space Utilization, Chinese Academy of Sciences, Beijing 100094, China., Shengyang Li is also with the University of Chinese Academy of Sciences, Beijing 100049, China

2026-06-16视觉感知安全鲁棒

针对卫星视频中现有方法多只检测少数运动粗类别、使用水平框且忽略跨帧一致性的问题,论文提出面向任意方向细粒度目标的TCL框架,通过时序细粒度特征聚合、结构编码和时序一致性约束联合利用邻帧上下文与外观/结构信息。在SAT-MTB上达到47.7% mAP,较基线提升4.8%,并可增强已有图像检测器。

Physics-Driven Zero-Shot MRI Reconstruction with Non-local Image Priors Figure 1
2026-06-16cs.CV

Physics-Driven Zero-Shot MRI Reconstruction with Non-local Image Priors

Lingtong Zhang, Wenlei Li, Mu He, Li Xiao, Yang Ji

2026-06-16视觉感知三维

针对单次欠采样 MRI 零样本自监督重建中监督稀缺、训练易过拟合和伪影不稳定的问题,论文将物理一致性与图像非局部先验结合:用 CSM 引导动态仓库筛选可靠 k 空间点,加入 SPIRiT 自一致正则,并构建 NSS Pixel Bank 挖掘解剖相似性以扩充监督。FastMRI 实验显示其在高加速因子下优于现有零样本方法,并缩小与监督重建的差距。

Text-Driven Fusion for Infrared and Visible Images: Achieving Image Scene Adaptation on Hyperbolic Space Figure 1
2026-06-16cs.CV

Text-Driven Fusion for Infrared and Visible Images: Achieving Image Scene Adaptation on Hyperbolic Space

Huan Kang, Hui Li, Tianyang Xu, Tao Zhou, Xiao-Jun Wu, Josef Kittler

2026-06-16视觉感知

针对红外-可见光融合中欧氏空间难以表达跨模态语义层级、易造成细节失真和场景适应不足的问题,TEDFusion在训练阶段用BLIP生成文本作为双曲空间锚点,引导属性与视觉特征按粗到细语义对齐,并设计双曲损失;推理时无需文本,依靠学到的文本-属性先验自适应融合。文中称其在基准数据集上优于现有方法,但具体增益来源仍需结合消融进一步判断。

Think Less, Act Early: Reinforced Latent Reasoning with Early Exit in Vision-Language-Action Models Figure 1
2026-06-16cs.CV

Think Less, Act Early: Reinforced Latent Reasoning with Early Exit in Vision-Language-Action Models

Dianqiao Lei, Lianlei Shan

2026-06-16视觉语言视觉感知强化学习

针对显式 CoT 推理在 VLA 机器人决策中带来的高延迟和多步误差累积,论文提出 AVA-VLA,将推理改为连续潜变量演化,并用强化学习按任务奖励对潜在轨迹去噪、对齐目标;同时通过置信度门控早退,在简单场景提前行动。实验称其相较显式 CoT 推理提速约 6 倍,并在 LIBERO 上达到 98.3% 平均成功率,但具体增益来源仍需结合完整实验细节判断。

Texture-Shape Bias Balancing for Robust Synthetic-to-Real Semantic Segmentation in Automotive NIR Imagery Figure 1
2026-06-16cs.CV

Texture-Shape Bias Balancing for Robust Synthetic-to-Real Semantic Segmentation in Automotive NIR Imagery

Felix Stillger, Ben Hamscher, Lukas Hahn, Annika Mütze, Tobias Meisen, Kira Maag

2026-06-16视觉感知安全鲁棒

面向车载近红外语义分割中真实标注稀缺、合成到真实域差距大的问题,论文提出生成式增强框架:用少量真实 NIR 图像通过 LoRA 微调潜扩散模型做目标风格适配,并结合保持几何的 Voronoi 风格多样化来平衡纹理/形状偏置。多架构、车内与街景实验显示,该策略提升跨域鲁棒性,外部场景最多缩小 63.6% 域差,车内最多缩小 28.4%。

Bridging Geographic Bias in Urban Streetscape Inference via Lifelong Learning with Visual-Semantic Pivoting Figure 1
2026-06-16cs.CV

Bridging Geographic Bias in Urban Streetscape Inference via Lifelong Learning with Visual-Semantic Pivoting

Xinze Zhang

University of Southern California, Los Angeles, CA 90007, USA

2026-06-16视觉感知

论文关注街景感知模型在少数大城市训练后迁移到欠代表地区时产生的地理偏差。作者提出 HVSP-LL,将宏观结构、中观组成、微观元素的视觉-语义锚点与公平感知的终身学习回放结合,以顺序吸收新城市并约束区域差距。在 12 城市全景数据上,Spearman 达 0.834,较最强持续学习基线提升 6.1 点,城际感知差距降至 0.094。

Gaussian Spatial Priors for Anatomy-Aware Object Detection in Surgical Videos Figure 1
2026-06-16cs.CV

Gaussian Spatial Priors for Anatomy-Aware Object Detection in Surgical Videos

Yunfan Li, Artem Shmelev, Himanshu Gupta

2026-06-16视觉感知三维

面向腹股沟疝修补术中CVMPO安全评估,论文关注小而易遮挡、外观不稳定的解剖结构检测难题。核心做法是在DAB-DETR中加入无需学习参数的高斯空间先验,用训练标注估计锚点结构与依赖结构的相对位置分布,并将其作为解码器自注意力偏置。5折实验显示,依赖类AP50较DAB-DETR提升33.5%,较YOLOv26提升53.9%,锚点类也提升6.0%。

Temporal Difference Learning for Diffusion Models Figure 1
2026-06-16cs.LG

Temporal Difference Learning for Diffusion Models

Qizhen Ying, Yangchen Pan, Victor Adrian Prisacariu, Junfeng Wen

2026-06-16生成模型

本文针对扩散模型常用单时刻去噪损失缺乏跨时间一致性、在少步采样时误差易累积的问题,将反向去噪过程重写为马尔可夫奖励过程,把去噪视作策略评估,并引入TD正则来约束不同噪声层级的后验均值漂移与真实扩散漂移一致,同时用样本级重加权稳定训练。实验显示该方法可作为现有扩散/一致性训练的附加目标降低FID,且在低NFE少步生成场景收益更明显。

ReportQA: QA-Based Radiology Report Evaluation Figure 1
2026-06-16cs.CL

ReportQA: QA-Based Radiology Report Evaluation

Yiming Shi, Shaoshuai Yang, Xi Chen, Haolin Li, Hengyu Zhang, Che Jiang, Kaiwen Wang, Xun Zhu, Dong Xie, Fei Wang, Dejing Dou, Miao Li, Ji Wu

Department of Electronic Engineering, Tsinghua University, College of AI, Tsinghua University, Beijing National Research Center for Information Science and Technology

2026-06-16数据集/基准

针对放射报告生成评估中 BLEU 等文本重合指标临床相关性弱、CE 指标实体覆盖窄且难扩展的问题,ReportQA 将报告视为临床问答上下文:由放射科知识树和 LLM 抽取结构化实体/属性,再生成并过滤 QA,用回答准确率形成 QAScore。实验显示 QAScore 比既有指标更贴近放射科医生判断,并揭示现有报告式推理难捕捉细粒度临床信息且有负例先验偏置,问题驱动推理更有效。

Towards Global AI-Driven Cervical Cancer Screening Figure 1
2026-06-16cs.CV

Towards Global AI-Driven Cervical Cancer Screening

Thuy Nuong Tran, Ömer Sümer, Evangelia Christodoulou, Lennart Nauschütte, Simon Kalteis, Martin Paulikat, Esmira Pashayeva, Klara Steinheuer, Isabella Borges, Piotr Kalinowski, Hermann Bussmann, Sieng Sokmney, Poeung Kuong, Sathiarany Vong, Achim Schneider, Magnus von Knebel-Doeberitz, Patrick Godau, Lena Maier-Hein

2026-06-16视觉感知

针对低中收入地区宫颈癌筛查中专家与活检资源不足、既有AI多局限于单国私有数据的问题,本文将阴道镜醋酸染色图像的CIN1-与CIN2+判别建模为分类与病灶分割联合的多任务学习,并结合强数据增强与跨国验证。模型在同分布测试中平衡准确率高于医生(0.68 vs 0.64),在四国外部数据上优于基线,但AUC仅0.54–0.80且受合并症等因素显著影响,泛化仍是主要瓶颈。

NEXUS: Neural Energy Fields for Physically Consistent Contact-Rich 3D Object Dynamics Figure 1
2026-06-16cs.CV

NEXUS: Neural Energy Fields for Physically Consistent Contact-Rich 3D Object Dynamics

Qizhen Ying, Guangming Wang, Yangchen Pan, Victor Adrian Prisacariu, Yixiong Jing

Department of Engineering Science, University of Oxford, Department of Engineering, University of Cambridge

2026-06-16三维

针对视频生成和机器人规划中接触、形变与外力作用下3D物体轨迹易漂浮、穿透或长期能量漂移的问题,NEXUS将物体表示为结构图并动态构建接触图,用可加能量项和Rayleigh式耗散统一建模保守/非保守效应,通过求导得到力并半隐式积分。实验显示其在不同材料与物理组合的长时预测中优于学习式和物理结构基线,并能提升轨迹引导视频的物理合理性。

Polyp-D2ATL: Deep Domain-Adaptive Transfer Learning for Colorectal Polyp Classification under Label Distribution Shift Figure 1
2026-06-16eess.IV

Polyp-D2ATL: Deep Domain-Adaptive Transfer Learning for Colorectal Polyp Classification under Label Distribution Shift

Sajad Jabarzadeh Ghandilu, Maryam Sadat Hosseini Azad, Shahriar Baradaran Shokouhi, Emad Fatemizadeh

under Label Distribution Shift, School of Electrical Engineering, Sharif University of Technology, Tehran, Iran, School of Electrical Engineering, Iran University of Science and Technology, handle imbalanced data, label distribution shift, and cross-modality gen-, with label distribution shift (i.e., different class distributions between train/val, crimination across visually similar polyp subtypes under label distribution, alpha and label smoothing, combined with MixUp augmentation. Further-

2026-06-16视觉感知

本文针对结直肠息肉 NICE 三分类在真实内镜数据中面临的类别极不均衡、训练/测试标签分布偏移及 NBI/WLI 跨模态差异问题,提出 Polyp-D2ATL:以经息肉分割数据预训练的 Res2Net-50 为骨干,结合注意力多尺度融合、GeM 池化、两阶段微调、Focal Loss、MixUp 与批归一化策略。在 PICCOLO 验证集上达到 82.38% 准确率、77.49% Macro-F1 和 87.47% 特异性,并在保留测试集较现有方法保持提升。

ReGenHuman: Re-Generating Human Appearances for Realistic Full-Body Video Anonymization Figure 1
2026-06-16cs.CV

ReGenHuman: Re-Generating Human Appearances for Realistic Full-Body Video Anonymization

Adam Sun, Eshaan Barkataki, Arnold Milstein, Gordon Wetzstein, Ehsan Adeli

Stanford University, Stanford, CA, USA

2026-06-16视觉感知

面向医院、课堂等难以公开的人体视频数据,论文指出传统打码/编辑会牺牲真实性、时序一致性或隐私覆盖。ReGenHuman改为“重生成而非编辑”:从姿态、分割、单目深度等无身份结构信号构造StructAll/StructHuman,并微调视频到视频扩散模型生成全身外观,避免原始人体像素进入输出。实验按隐私、质量和下游VQA效用评测,显示其相对现有匿名化方法取得更好的三者权衡;但仍有生成较慢、步态/轮廓可能泄露等限制。

Multi-Modal Attention for Automated Disaster Damage Assessment Using Remote Sensing Imagery and Deep Learning Figure 1
2026-06-16cs.CV

Multi-Modal Attention for Automated Disaster Damage Assessment Using Remote Sensing Imagery and Deep Learning

Tewodros Syum Gebre, Jagrati Talreja, Leila Hashemi-Beni

Built Environment Department, College of Science and Technology, North Carolina A&T State University, Greensboro, NC, USA, United Nations University Institute for Water, Environment and Health

2026-06-16视觉感知

针对灾后建筑损毁评估依赖人工或单时相遥感、速度慢且难区分细粒度损伤的问题,论文用灾前/灾后卫星图像构建双时相框架,以ConvNeXT-Tiny提特征并通过跨注意力/变化token融合结构变化信息,进行四级损毁分类。在大规模灾害数据上总体准确率94.90%,无损和毁坏类表现较强,但重大与轻微损伤仍易混淆。

MVEB: Massive Video Embedding Benchmark Figure 1
2026-06-16cs.CV

MVEB: Massive Video Embedding Benchmark

Adnan El Assadi, Roman Solomatin, Isaac Chung, Chenghao Xiao, Deep Shah, Manan Dey, Shriya Sudhakar, Zacharie Bugaud, Wissam Siblini, Ayush Sunil Munot, Yashwanth Devavarapu, Rakshitha Ireddi, Michelle Yang, Márton Kardos, Niklas Muennighoff, Kenneth Enevoldsen

Harvard University, 2SaluteDevices, 3MIRAI, 4Zendesk, 5Shanghai University of Finance and Economics, Google LLC, 7Salesforce, 8Cornell University, 9Astera Institute, 10Independent Contributor, Indian Institute of Technology, Kharagpur, 12Barclays, 13Aarhus University, 14Stanford University, (labels produced from both modalities) and hurts, on V-grounded ones (labels produced from visu-

2026-06-16视觉感知数据集/基准

现有视频表征评测多聚焦单一能力,难以判断通用嵌入质量。MVEB从184个任务中裁剪出23项,覆盖分类、检索、聚类、问答等,并区分视频、文本-视频和音视频输入。评测33个模型显示无模型通吃:适配过的MLLM擅长分类/QA,多模态绑定擅长检索/零样本;未做对比嵌入适配的生成式MLLM跨模态显著失效。音频收益取决于标注来源,视觉标注任务中反而有害。

Learning Sparse Latent Predictive Foundation Model for Multimodal Neuroimaging Figure 1
2026-06-16cs.CV

Learning Sparse Latent Predictive Foundation Model for Multimodal Neuroimaging

Haoxu Huang, Long Chen, Jingyun Chen, Jinu Hyun, James Ryan Loftus, Kara Melmed, Daniel Orringer, Jennifer Frontera, Seena Dehkharghani, Arjun Masurkar, Narges Razavian

New York University, Center for Data Science, New York, NY, 10001, USA, NYU Grossman School of Medicine, Department of Radiology, New York, NY, 10016, USA, State University of New York at Binghamton, School of Computing, Binghamton, NY 13902, USA, NYU Grossman School of Medicine, Department of Neurology, New York, NY, 10016, USA, NYU Grossman School of Medicine, Department of Neurosurgery , New York, NY, 10016, USA, NYU Grossman School of Medicine, Department of Pathology, New York, NY, 10016, USA, School of Medicine, Department of Radiology, Stanford, CA, 94305, USA, NYU Grossman School of Medicine, Department of Neuroscience, New York, NY, 10016, USA, NYU Grossman School of Medicine, Neuroscience Institute, New York, NY, 10016, USA

2026-06-16视觉语言

针对临床脑 MRI 多序列(T1w、T2w、FLAIR)互补但现有模型多按单序列学习、难以统一表征的问题,本文提出 Neuro-JEPA,将 JEPA 潜变量预测目标与 MoE 稀疏 ViT 结合,并系统比较掩码、目标和稀疏化设计。在约155万次扫描预训练后,模型在3个医疗系统和12个公开数据集的47项任务上较现有神经影像基础模型及简单 CNN 基线表现更稳定、更强,但部分增益可能主要来自 scaling / data。

FlexPooling with Simple Auxiliary Classifiers in Deep Networks Figure 1
2026-06-16cs.CV

FlexPooling with Simple Auxiliary Classifiers in Deep Networks

Muhammad Ali, Omar Alsuwaidi, Salman Khan (Department of Computer Vision, Mohamed bin Zayed University of Artificial Intelligence (MBZUAI), Abu Dhabi, UAE)

Department of Computer Vision, Mohamed bin Zayed University of Artificial Intelligence (MBZUAI), Abu Dhabi, UAE

2026-06-16视觉感知

本文针对 CNN 中全局平均/最大池化不可学习、在有损下采样中可能丢失判别信息的问题,提出 FlexPooling:为每个特征图学习可端到端优化的加权平均池化,并结合简单辅助分类器 SAC 强化中间监督。实验在多种图像分类数据集和不同 ResNet 规模上,相比标准池化基线提升约 1–3% 准确率;但文中展示重点偏分类任务,增益来源中 FlexPooling 与 SAC 的相对贡献仍需进一步拆分验证。

Mask Proposal Voting Based on Geodesic Framework for Robust Image Segmentation Figure 1
2026-06-16cs.CV

Mask Proposal Voting Based on Geodesic Framework for Robust Image Segmentation

Li Liu, Mingzhu Wang, Zhenjiang Li, Da Chen, Laurent D. Cohen

2026-06-16视觉感知安全鲁棒

针对最短路径/测地线分割在杂乱背景、强度不均和弱边界下高度依赖初始化的问题,论文提出 Mask Proposal Voting:用受约束自适应域切生成多样的 min-cut Randers 掩码候选,再按先验加权投票形成分割得分图。实验显示该方法较现有测地线路径投票和 min-cut Randers 模型在精度与鲁棒性上更稳定,尤其能减少漏分割和边界偏移。

Deep Learning in Seismic Interpretation: Federated Advances in Salt Dome Segmentation Figure 1
2026-06-16cs.CV

Deep Learning in Seismic Interpretation: Federated Advances in Salt Dome Segmentation

Muhammad Zain Mehdi, Muhammad Zaid, Owais Aleem

2026-06-16视觉感知

面向地震盐丘分割中标注稀缺、企业数据不能集中共享及跨盆地分布差异导致泛化差的问题,论文提出 FedSaltNet:以轻量 Small U-Net 作为联邦骨干,并用按盐体前景像素数加权的 FG-WEIGHTED 聚合缓解类别不平衡和非 IID。四个数据集模拟客户端实验显示,该聚合较最佳常规 FL 的 IoU 相对提升 4.0%,Small U-Net 平均 IoU 还比 ResNet-18 U-Net 高 166%,说明受限联邦场景下模型简化比增大容量更有效。

Improved Knowledge Distillation for Land-Use Image Classification Figure 1
2026-06-16cs.CV

Improved Knowledge Distillation for Land-Use Image Classification

Arundhuti Sur, Abhiroop Chatterjee, Susmita Ghosh, Emmett Ientilucci

Jadavpur University, India, Rochester Institute of Technology, USA, truth labels with a soft supervision strategy that combines, predicted class label but also a confidence distribution, student only on hard labels (ground truth), we also train, labels measuring the discrepancy between, student predictions and ground truth labels., Let y denote the ground truth label, zt and zs represent, with respect to true labels using the categorical cross-, where yc denotes the ground truth label for class c

2026-06-16视觉感知

针对遥感土地利用分类中高精度 CNN/Transformer 计算与存储开销大的问题,本文用 VGG16 教师蒸馏 MobileNetV2 学生,并将真实标签交叉熵、温度化 KL 散度与归一化 logit 的余弦相似损失结合,以同时传递类别概率关系和表示几何。实验在三个土地利用数据集上报告最高 99.04% 准确率,优于直接训练学生和单一蒸馏损失,同时保留轻量化压缩效果。

Understanding Cross-Modal Contributions in Continual Vision-Language Models: A Theoretical Perspective Figure 1
2026-06-16cs.CV

Understanding Cross-Modal Contributions in Continual Vision-Language Models: A Theoretical Perspective

Salimeh Sekeh, Mary Wisell

San Diego State University

2026-06-16视觉语言视觉感知

针对连续微调视觉语言模型时新任务适应与旧知识遗忘的矛盾,本文从理论上刻画跨环境的图像—文本贡献:用冻结前向即可计算的跨/同模态余弦贡献分数解释损失漂移、梯度对齐与遗忘界。实验在 COCO、CUB 和三种 CLIP 骨干上验证,贡献引导的任务排序在 COCO 上最高将遗忘差异拉开 1.74×,并提升 OOD AUROC;但其判别力依赖环境间跨模态差异,CUB 上增益较小。

VANDERER: Map-Free Exploration using Future-Aware and Visual-Curiosity-Guided Diffusion Policy Figure 1
2026-06-16cs.RO

VANDERER: Map-Free Exploration using Future-Aware and Visual-Curiosity-Guided Diffusion Policy

Venkata Naren Devarakonda, Raktim Gautam Goswami, Prashanth Krishnamurthy, Farshad Khorrami

Control/Robotics Research Laboratory (CRRL), Department of Electrical and Computer Engineering, NYU Tandon School of Engineering, Brooklyn, NY, 11201.

2026-06-16生成模型强化学习

针对单目相机等传感受限机器人难以构建可靠占据地图、且探索缺少专家数据的问题,VANDERER在推理阶段用视觉好奇心模块引导预训练扩散策略:先用导航世界模型预测候选动作的未来观测,再以与历史观测的差异度作为好奇心代价推动采样走向新区域。仿真户外环境中,其平均探索面积比NoMaD高13.4%,并显示视觉新颖性与几何探索收益存在相关性。

An Ensemble Deep Learning Approach for Reliable and Scalable Lemon Leaf Disease Classification Figure 1
2026-06-16cs.CV

An Ensemble Deep Learning Approach for Reliable and Scalable Lemon Leaf Disease Classification

Shayan Abrar, Sudeepta Mandal, Abdul Awal Yasir, Sonjoy Bhattacharjee, Sadman Haque Bhuiyan, Samanta Ghosh, Rafi Ahamed

and Scalable Lemon Leaf Disease Classification, American International University-Bangladesh, East West University, North South University, complex. It needs more labor, and the prediction might not be, the real world depends on various things like the availability

2026-06-16视觉感知

针对柠檬叶病害人工识别费时且难以规模化的问题,论文在1354张、9类Kaggle图像上比较InceptionV3与MobileNetV2,并用二者集成、对抗训练和Grad-CAM提升鲁棒性与可解释性。集成模型测试准确率达99.27%,高于单模型和若干既有工作;但数据集较小且类别不均衡,真实田间泛化增益来源仍需进一步验证。

Multi-HMR 2: Multi-Person Camera-Centric Human Detection, Mesh Recovery and Tracking Figure 1
2026-06-16cs.CV

Multi-HMR 2: Multi-Person Camera-Centric Human Detection, Mesh Recovery and Tracking

Guénolé Fiche, Philippe Weinzaepfel, Romain Brégier, Fabien Baradel

2026-06-16视觉感知

这篇论文针对多人 HMR 在真实人机交互/场景理解中常被忽略的相机坐标系检测与度量 3D 定位问题,提出基于 DETR 的 Multi-HMR 2:联合预测人体网格、3D 位置与相机内参,引入覆盖儿童到成人的 Anny 身体模型,并用 2D 位置匹配降低训练成本;同时蒸馏 SAM2 记忆特征实现无需视频监督的在线跟踪。实验显示其在常规 HMR、近距离交互、重投影关键点和 PoseTrack 跟踪上达到或接近 SOTA,尤其提升检测与相机空间定位精度。

Leptomeningeal Collateral Detection on DSA via Vessel-Graph Neural Networks Figure 1
2026-06-16eess.IV

Leptomeningeal Collateral Detection on DSA via Vessel-Graph Neural Networks

Junyong Cao, Hakim Baazaoui, Chinmay Prabhakar, Suprosanna Shit, Lukas Bastian Otto, Susanne Wegener, Bjoern Menze, Ezequiel de la Rosa

University of Zurich, Zurich, Switzerland, University Hospital Zurich, Zurich, Switzerland, Code available at, complexity, limited data availability and the absence of structured vascular rep-

2026-06-16视觉感知

针对急性缺血性卒中侧支循环评估依赖CTA粗粒度评分、DSA人工判读主观性强的问题,论文将DSA血管分割转为血管段图,把软脑膜侧支检测建模为节点分类,并融合拓扑GNN分支与像素分支。在73例、136帧五折验证中,融合模型PR-AUC为0.434,高于图分支0.403和像素分支0.362,但仍受小样本、单中心和预选帧限制。

S23DR 2026: End-to-End 3D Wireframe Prediction via DETR-Style Set Prediction with Contrastive Denoising Figure 1
2026-06-16cs.CV

S23DR 2026: End-to-End 3D Wireframe Prediction via DETR-Style Set Prediction with Contrastive Denoising

Nitiz Khanal

2026-06-16三维

针对 S23DR 2026 中从稀疏多视角 COLMAP 点云恢复建筑屋顶三维线框、传统两阶段顶点再连边易受误差传播和边精度瓶颈影响的问题,论文将线框直接表述为边坐标集合预测。WireframeDETR 用 DETR 式 Hungarian 匹配回归 6D 边端点,并加入对比去噪查询、多尺度编码器记忆和递进辅助损失以稳定早期训练。模型在公开测试集达到 HSS 0.575(F1 0.664、IoU 0.516),清洗验证集最佳 HSS 0.534。

Explainable Task-Oriented Token Communication for AI-Native 6G Networks Figure 1
2026-06-16eess.IV

Explainable Task-Oriented Token Communication for AI-Native 6G Networks

Feibo Jiang, Lei Mao, Li Dong, Kezhi Wang, Cunhua Pan, Jiangzhou Wang

oriented Token representation, inadequate collaboration between, ) Inadequate Collaboration Between Visual Tokens and, be obtained separately, establishing an effective collaborative, paradigm centered on task completion. Its basic idea is not to

2026-06-16视觉感知

面向6G中由保真传图转向任务驱动图像通信的需求,论文指出现有方法难以同时组织任务相关Token、协同视觉证据与任务意图,并解释决策依据。其核心是ET-TokenCom:用视觉Token保留低层证据、用基础模型生成任务Token,再以跨模态注意力引导选择和加权传输,并在接收端用热力图解释关键区域。仿真显示任务有效性和信道鲁棒性提升,但具体增益幅度与来源文中未充分说明。

HSQ-VLM: A Novel Spatially-Constrained Quadrant Segmentation VLM Model for Explainability in Diabetic Retinopathy Figure 1
2026-06-16cs.CV

HSQ-VLM: A Novel Spatially-Constrained Quadrant Segmentation VLM Model for Explainability in Diabetic Retinopathy

Shivum Telang

2026-06-16视觉语言视觉感知

本文针对糖尿病视网膜病变 AI 诊断难以解释、病灶象限计数与解剖位置不一致的问题,提出以黄斑中心坐标系为锚的 HSQ-VLM:结合动态解剖对齐、笛卡尔交叉注意力、软性四象限拓扑划分和一致性损失,将分割结果转为可量化自然语言报告。在 3500 张眼底图上,出血和微动脉瘤敏感性分别达 99.6% 和 96.4%,边界归因错误降至 1.8% 以下;但数据来源与标注细节文中未充分说明。

Position: The Systemic Lack of Agency in Visual Reasoning Figure 1
2026-06-16cs.CV

Position: The Systemic Lack of Agency in Visual Reasoning

Yizhao Huang, Haoyang Chen, Shiqin Wang, Pohsun Huang, Jiayuan Li, Haoyuan Du, Yandong Shi, Zheng Wang, Zhixiang Wang

2026-06-16视觉感知

本文针对现有视觉语言模型在真实场景中依赖显式提示、缺少主动寻找隐含证据的问题,提出“视觉隐式推理缺陷”这一诊断视角,并构建 V-IRD 基准,通过 Target-Exclusive Prompting 强制模型在无语言线索下自主发现参考物和物理线索。实验显示,主流 VLM 虽具备较强识别与检索能力,但在隐式设置下准确率显著下降,说明语义识别并不等同于主动视觉探索。

Efficient Reinforcement for Visual-Textual Thinking with Discrete Diffusion Model Figure 1
2026-06-16cs.CV

Efficient Reinforcement for Visual-Textual Thinking with Discrete Diffusion Model

Yoonjeon Kim, Yuhta Takida, Chieh-Hsin Lai, Eunho Yang, Yuki Mitsufuji

2026-06-16生成模型

论文针对多模态交错推理中,AR 统一模型即使只需局部视觉修改也要重生成整幅图像、导致 RL rollout 成本高的问题,提出 LocFac-RL:用离散扩散模型做局部视觉编辑,并将文本与视觉片段的奖励因子化分配以减少跨模态干扰。实验显示局部编辑可降低 GRPO 视觉 rollout 计算约 26.9%,因子化奖励较联合奖励提升 11.2%,相对基座平均提升 38.04%。

Vision-Encoder Behavioral Fingerprints of Image-to-Image Generative Models: A Training-Paradigm-Driven Taxonomy of Six Commercial APIs Figure 1
2026-06-16cs.CV

Vision-Encoder Behavioral Fingerprints of Image-to-Image Generative Models: A Training-Paradigm-Driven Taxonomy of Six Commercial APIs

Hunter Hill

image is available, while image-to-image attribution requires a different methodology because a clean, center-crop and JPEG robustness via wavelet-perturbation consistency. We use DINOv2 cosine distance, differs in two respects: we attribute image-to-image outputs where a clean reference is available by

2026-06-16视觉感知生成模型

针对商用图像到图像模型黑盒、传统盲检测难以归因近似保真编辑的问题,论文用保留的干净参考图与DINOv2 token距离构建行为指纹。核心洞察是六个API按训练范式而非架构分成“紧贴输入”的编辑训练带与“漂移”的T2I采样适配带。3,588次调用中,AI身份解释69.5%方差,六类归因51.4%显著高于随机和盲基线;扰动在Gemini约98%、Flux约80%保留,在gpt-image-1中被覆盖。

MatchLM2Lite: A Scalable MLLM-to-Lite Framework for Reproduced Content Identification Figure 1
2026-06-16cs.MM

MatchLM2Lite: A Scalable MLLM-to-Lite Framework for Reproduced Content Identification

Xiaotian Fan, Hiok Hian Ong, David Yuchen Wang, Zirui Zhu, Kanchan Sarkar, Kun Xu

MatchLM2Lite: A Scalable MLLM-to-Lite Framework for, National University of Singapore, School of Computing, Scalable Inference, Sarkar, and Kun Xu. 2026. MatchLM2Lite: A Scalable MLLM-to-Lite Frame-, & student trained separately with GT labels. Stage 2 - Freeze teacher, using labeled data. In the second stage, MatchLM is frozen and, based content moderation demands significant human labor [5]

2026-06-16视觉感知

短视频平台需要在推荐链路中低延迟识别搬运、裁剪或轻度编辑的复刻内容,而单纯视觉相似度容易漏掉音频与文本线索。MatchLM2Lite将复刻识别建模为视频对的视觉-音频-文本匹配,用MLLM教师MatchLM学习强跨模态判别,再蒸馏到轻量MatchLite部署。相较旧生产模型,MatchLM F1提升8.57,MatchLite仍提升6.55且计算成本降35倍;线上复刻视频观看率下降2.5%,端到端延迟低于30秒。

The Vision Encoder as a Privacy Boundary: Visual-Token Side Channels in Encoder-Free Vision-Language Models Figure 1
2026-06-16cs.CV

The Vision Encoder as a Privacy Boundary: Visual-Token Side Channels in Encoder-Free Vision-Language Models

Chenyu Zhou, Qiliang Jiang, Shuning Wu, Xu Zhou

School of Engineering, Institute of Science Tokyo, College of Control Science and Engineering, Zhejiang University, Department of Electrical and Computer Engineering, National University of Singapore, School of Engineering, Institute of Science Tokyo Tokyo Japan, College of Control Science and Engineering, Zhejiang University Hangzhou China, Department of Electrical and Computer Engineering, National University of Singapore Singapore Singapore

2026-06-16视觉语言视觉感知学习理论

论文关注 VLM 部署中常被忽视的中间视觉 token 隐私风险:输出过滤前,缓存、日志或分布式推理已可能暴露图像内容。核心洞察是视觉编码器本身构成隐私边界,去编码器架构的高空间采样视觉 token 会形成侧信道。实验显示 Gemma4、Fuyu 可从 token/KV cache 重建结构并读出访问码,而 Qwen3-VL、InternVL、LLaVA 基本无法精确恢复;泄漏由字符方向采样密度而非 token 数决定,噪声和量化难以防御,需降低空间采样或严格保护中间状态。

Last But Not Least: Boundary Attention CalibratiON for Multimodal KV Cache Compression Figure 1
2026-06-16cs.CV

Last But Not Least: Boundary Attention CalibratiON for Multimodal KV Cache Compression

Tianhao Chen, Yuheng Wu, Kelu Yao, Xiaogang Xu, Xiaobin Hu, Dongman Lee

Zhejiang Laboratory, The Chinese University of Hong Kong, National University of Singapore

2026-06-16视觉语言学习理论

针对多模态长视觉上下文导致 KV cache 膨胀、激进压缩易丢失关键视觉证据的问题,论文指出常用观察窗口平均注意力会稀释稀疏证据,而最后一个 prompt query 能补回边界处答案相关信号但噪声较多。BACON 以窗口注意力为稳定基线,用最后查询注意力校准,并通过层内局部一致性和跨层持续性过滤孤立噪声。实验覆盖多任务、模型、预算和压缩方法,在最激进预算下平均提升 7.5%,最高 30.9%,且称不增加额外推理成本。

Variational Deep Unfolding with Mamba-Based Nonlocal Modeling for Underwater Image Enhancement Figure 1
2026-06-16cs.CV

Variational Deep Unfolding with Mamba-Based Nonlocal Modeling for Underwater Image Enhancement

Daniel Torres, Julia Navarro, Catalina Sbert, Joan Duran

2026-06-16视觉感知

面向水下机器人与海洋观测中低能见度、偏色和噪声导致的视觉感知退化,论文将去雾型变分模型展开为可学习网络,引入乘性残差吸收伪影、非局部梯度约束保边,并用 Mamba 建模长程自相似,配合近端轨迹损失约束各展开阶段。作者还证明变分问题解存在;在 UIEB、SUIM-E 上报告视觉质量提升、定量指标相对近期方法具竞争力。

YTClickbait21K: Human-Annotated Multimodal Dataset for YouTube Clickbait Detection Across Diverse Channels and Content Categories Figure 1
2026-06-16cs.CV

YTClickbait21K: Human-Annotated Multimodal Dataset for YouTube Clickbait Detection Across Diverse Channels and Content Categories

Md. Minhazul Islam, Md. Tanbeer Jubaer, Amith Khandakar, Shovon Sarker, Sumaiya Rahman, Md. Masum Mia, Mohamed Arselene Ayari, Hamed Noori

Department of Computer Science and Engineering, Rajshahi University of Engineering & Technology, Rajshahi, Department of Electrical Engineering, Qatar University, Doha, Qatar, Department of Civil and Environmental Engineering, Qatar University, Doha, Qatar, SenseNet Inc., Ontario, Canada, Department of Electrical Engineering, Qatar University, comprehensive multimodal analysis. To ensure annotation quality, every video was independently labeled by three, with final labels determined through majority voting. The dataset exhibits substantial inter-annotator agreement (κ ≈ 0.65), confirming reliable labeling despite the inherent subjectivity of clickbait detection. By combining scale, annotation rigor, 912 non-clickbait) using semi-supervised pseudo-label expansion and demonstrated that user-based features, manually annotated samples using a ternary label scheme of non-clickbait, general-clickbait, and malicious-clickbait. For, However, the study relies on channel-level annotation labels inherited from prior work, Zannettou et al.12 , rather than

2026-06-16视觉语言视觉感知数据集/基准

面向视频平台标题党检测中缺少大规模、可靠多模态标注数据的问题,本文构建 YTClickbait21K:从 40 个 YouTube 频道、29 个国家采集 21,238 个视频,保留标题、描述、互动统计与缩略图,并以三人独立标注、多数投票和质控保证视频级标签。数据集中点击bait/非点击bait为 9,653/11,585,标注一致性 κ≈0.65,主要贡献是提供可训练和评测跨模态不一致性的基准,增益可能主要来自 scaling / data。

FactCheck: Feasibility-aware Long-term Action Anticipation with Multi-agent Collaboration Figure 1
2026-06-16cs.CV

FactCheck: Feasibility-aware Long-term Action Anticipation with Multi-agent Collaboration

Rui Cao, Jiannong Cao, Bo Yuan, Zhiyuan Wen, Mingjin Zhang

\orgdiv Department of Computing, \orgname The Hong Kong Polytechnic University, \orgaddress \state Hong Kong SAR, \country China

2026-06-16视觉感知

面向具身智能中的长时动作预测,论文指出现有开环方法虽能保持语义连贯,却常预测不存在物体、违背物体可供性或忽略状态。FactCheck 将任务拆成 Observer、Planner、Verifier,以结构化历史摘要和动作图支撑“观察-规划-验证”闭环,显式修正不可行动作;在 EPIC-Kitchens-55 与 EGTEA Gaze+ 上持续优于已有方法。

JoyAI-VL-Interaction: Real-Time Vision-Language Interaction Intelligence Figure 1
2026-06-16cs.CV

JoyAI-VL-Interaction: Real-Time Vision-Language Interaction Intelligence

Dingyu Yao, Junhao Zhou, Chenxu Yang, Chuanyu Qin, Haowen Hou, Zheming Liang, Congcong Wang, Yuhang Cao, Shenglong Ye, Shuai Xie, Shuhuan Gu, Haoyang Huang, Qingyi Si, Nan Duan, Jiaqi Wang

2026-06-16视觉语言视觉感知

针对现实事件稍纵即逝而现有大模型多需被动提问的问题,论文提出8B级视觉优先的 JoyAI-VL-Interaction,让模型每秒自行决定沉默、回应或委托后台模型,并配套可部署的实时流式系统、数据与训练流程。六个真实流媒体场景中,人评在质量与时机上相对豆包、Gemini 视频助手胜率分别为77.6%和87.9%,但评测规模仍较小。

Double-Helix Vision (DH-V2): A Geometry-Based Visual Sampler for Bandwidth-Constrained Perception Figure 1
2026-06-16cs.CV

Double-Helix Vision (DH-V2): A Geometry-Based Visual Sampler for Bandwidth-Constrained Perception

Jinwen Wen

2026-06-16视觉感知

面向机器人和嵌入式视觉中带宽、算力受限的问题,DH-V2用两条相差180°的黄金螺旋进行中心密、外围疏的几何采样,将2D图像压成双1D信号,并在其上做运动碰撞、结构差异和空间报告。文中报告4K下约1433×压缩、1080p CPU端到端0.52 ms、CIFAR-10极低采样下较随机采样提升6.03%;但其深度仅是几何假设,外周漏检和过曝失效仍是限制。

ScoutVLA: UAV-Centric Active Perception via a Dual-Expert VLA Model for Open-World Embodied Question Answering Figure 1
2026-06-16cs.CV

ScoutVLA: UAV-Centric Active Perception via a Dual-Expert VLA Model for Open-World Embodied Question Answering

Wenhao Lu, Zhengqiu Zhu, Xiaofeng Wang, Xiaoran Zhang, Yatai Ji, Yong Zhao, Yue Hu, Yingzhen Nie, Jinlong Zhu, Zheng Zhu

National Key Laboratory of Digital Intelligent Modeling and Simulation, National University of Defense Technology

2026-06-16强化学习

本文针对现有无人机室外EQA在目标入镜后即停止、难以获取车牌等细粒度证据的问题,提出FG-EQA基准和ScoutVLA。其关键是将问题语义与缺失证据对齐,并用解耦双专家VLA以5-DoF连续轨迹微调视角,同时通过知识隔离避免动作训练损伤语言推理。仿真与真实外场结果显示,相比基线严格成功率平均提升10.48倍、问答正确率提升7.72倍。

An Empirical Analysis of Optimization Dynamics and Sparsity Boundaries in Large-Scale Pedestrian Attribute Recognition Figure 1
2026-06-16cs.CV

An Empirical Analysis of Optimization Dynamics and Sparsity Boundaries in Large-Scale Pedestrian Attribute Recognition

Houssam El Mir

College of Computer Science and Technology, Zhejiang University of Technology, Hangzhou, 310023, China, This work is an extended version of the author’s graduation thesis at Zhejiang University of Technology.

2026-06-16视觉感知优化算法学习理论

面向监控场景中的行人属性识别,论文关注大规模合并数据下少数属性被 BCE 优化“全判为负”的失衡问题。作者不改网络结构,而是在轻量 ResNet-18 上系统考察多标签 Focal Loss 的 α、γ 对优化动态和稀疏边界的影响,指出存在仅靠全局损失调制难以跨越的 Sparsity Wall。实验在 20 个属性上显示 α=0.50、γ=2.0 的 Macro F1 达 62.32%,接近强 BCE 基线且无额外推理开销。

XMedFusion: A Knowledge-Guided Multimodal Perception and Reasoning Framework for Autonomous Medical Systems Figure 1
2026-06-16cs.CV

XMedFusion: A Knowledge-Guided Multimodal Perception and Reasoning Framework for Autonomous Medical Systems

Hamza Riaz, Arham Haroon, Maha Baig, Muhammad Dawood Rizwan, Muhammad Naseer Bajwa, Muhammad Moazam Fraz

2026-06-16视觉语言

针对放射报告生成中端到端视觉语言模型视觉 grounding 弱、易漏检或幻觉的问题,XMedFusion 将医学影像理解拆成视觉证据提取、知识图谱构建、检索草稿和迭代综合四类代理,以结构化中间表示约束推理。胸片数据集上相较基线 BLEU-1 从 0.0493 提升到 0.3359,ROUGE-L、METEOR 及一致性、准确性评分也明显提高,但具体消融与增益来源仍需进一步核实。

Momentum-Guided Semantic Forecasting (MoFore) for Self-Supervised Video Representation Learning Figure 1
2026-06-16cs.CV

Momentum-Guided Semantic Forecasting (MoFore) for Self-Supervised Video Representation Learning

Qinwu Xu

2026-06-16视觉感知

针对视频自监督学习中过度依赖像素重建、难以捕捉长时语义动态的问题,MoFore改在潜空间中由上下文片段预测时间上相隔较远的未来嵌入,并用动量教师、随机时间间隔和对比正则稳定训练。UCF101实验显示其无需动作标签即可形成较好的时间一致性、类别结构和运动感知检索,但评估规模较小,细粒度时序推理能力仍有限。

Avoiding Exponential Blow-Up in Distributive Lattice Submodular Minimization Figure 1
2026-06-16cs.CV

Avoiding Exponential Blow-Up in Distributive Lattice Submodular Minimization

Ishant Shanu

2026-06-16视觉感知

本文针对计算机视觉等场景中分配格上的子模函数最小化,指出传统先扩展到布尔格再优化会引入随集合规模指数增长的额外状态,导致实际不可扩展。核心做法是在分配格内部构造通用变换与基多面体分解,使既有布尔格 SFM/MNP 等算法可复用而不遍历冗余空间。实验报告相较传统扩展法有显著运行时间提升,但具体任务规模与增益来源文中未充分说明。

Scribby: A Multi-Level LLM Framework for Semantic Video Analysis Figure 1
2026-06-16cs.CV

Scribby: A Multi-Level LLM Framework for Semantic Video Analysis

Julian Abelarde, Hugo Garrido-Lestache Belinchon

2026-06-16视觉感知

针对长视频只给粗粒度摘要、难以定位主题演进的问题,Scribby用LLM先做全局转写理解,再在句子级结合相邻上下文判定语义相似,将内容聚成“verses”,并以交互时间线和向量检索热力图呈现。文中称在结构化与非结构化网络视频上测试了分组准确性和可用性,但缺少明确量化指标,主要结果与增益来源仍未充分说明。

GeoRoPE: Ground-Aware Rotary Adaptation for Remote Sensing Foundation Models Figure 1
2026-06-16cs.CV

GeoRoPE: Ground-Aware Rotary Adaptation for Remote Sensing Foundation Models

Yu Luo, Kun Hu, Mengwei He, Xiaogang Zhu, Shan Zeng, Allen Benter, Wei Xiang, Patrick Filippi, Thomas Francis Bishop, Zhiyong Wang

The University of Sydney, Edith Cowan University, Adelaide University, Wuhan Polytechnic University, Climate, Orange Agricultural Institute, La Trobe University

2026-06-16视觉感知

遥感基础模型在多传感器、多 GSD 迁移时,固定 token 网格偏移对应的真实地面距离不同,导致位置先验尺度错配。GeoRoPE 将 RoPE 改造成地面感知适配器:用 GCC 按单步 token 的地面距离重标定相对坐标,用 GFC 按区域空间粒度调节频率敏感度,并以轻量并行适配注入冻结模型。实验覆盖多种 RSFM、传感器、分辨率和分类/分割任务,显示其提升跨分辨率鲁棒性与尺度敏感表征。

Temporally Consistent and Controllable Video Generation of 2D Cine CMR via Latent Space Motion Modeling Figure 1
2026-06-16cs.CV

Temporally Consistent and Controllable Video Generation of 2D Cine CMR via Latent Space Motion Modeling

Yiheng Cao, Gustavo Andrade-Miranda (SyCoIA - IMT Mines Alès), Jiatian Zhang, Guillaume Sallé, Xin Gao

TEMPORALLY CONSISTENT AND CONTROLLABLE VIDEO GENERATION OF 2D CINE, Suzhou Institute of Biomedical Engineering and Technology, Chinese Academy of Sciences, Suzhou, China, data, offering a scalable solution to data scarcity., Animations and demo will be available on https://github.com/, availability of large, diverse, and annotated datasets. How-, ever, publicly available datasets are often insufficient, being, by a controllable temporal signal to ensure temporal co-, mate motion, which is not available during inference. To ad-

2026-06-16视觉感知规划控制

针对 cine CMR 公开数据少、病理多样性不足且现有扩增缺乏时间可控性的问题,论文将空间结构与心动时序解耦:先用临床文本条件扩散生成舒张末首帧,再以相位嵌入驱动的潜空间 flow/残差扩散扭曲首帧生成序列,从而减少逐帧生成的结构漂移。在 ACDC、DSB 上得到较连贯的合成视频,报告 FID 31.68、CLIP 31.04;但其对下游分割或诊断的实际增益文中未充分说明。

Disentangling Hallucinations: Orthogonal Semantic Projection for Robust Interpretability Figure 1
2026-06-16cs.CV

Disentangling Hallucinations: Orthogonal Semantic Projection for Robust Interpretability

Emirhan Bilgiç, Baptiste Caramiaux, Zhi Yan, Gianni Franchi

2026-06-16安全鲁棒

面向VLM在安全场景中的可解释性失真,论文指出显著图会因文本嵌入非正交产生“语义泄漏”,即错误提示也激活相关物体。作者提出LSA理论框架与OSP方法,用OMP残差将查询向量相对干扰概念正交化,作为免训练插件接入CLIP、SigLIP和扩散模型。实验覆盖3类基础模型、5种归因方法、2个数据集,并含用户研究,显示OSP能降低归因幻觉、提升AUROC且基本保持定位保真度。

Spatial Priors via Space Filling Curves for Small and Limited Data Vision Transformers Figure 1
2026-06-16cs.CV

Spatial Priors via Space Filling Curves for Small and Limited Data Vision Transformers

Leyla Naz Candogan, Arshia Afzal, Pol Puigdemont, Volkan Cevher

2026-06-16视觉感知

针对ViT自注意力缺少显式空间归纳偏置、在小模型或少数据微调时更易退化的问题,论文提出Violin:用多种空间填充曲线扫描图像patch,生成可学习衰减掩码并乘到注意力矩阵中,几乎不改架构且额外参数低于0.0015%。实验显示其在VTAB-1K微调平均最高提升4.7%、单任务最高8.7%,ImageNet-1K小模型预训练提升约0.8–0.9%,像素级CIFAR-100最高提升7.2%。

Divide-and-Denoise: A Game-Theoretic Method for Fairly Composing Diffusion Models Figure 1
2026-06-16cs.CV

Divide-and-Denoise: A Game-Theoretic Method for Fairly Composing Diffusion Models

Abhi Gupta, Polina Barabanshchikova, Vikas Garg, Samuel Kaski, Tommi Jaakkola

2026-06-16生成模型强化学习

针对复用多个预训练扩散模型时常见的模型互相冲突、某一模型主导、目标对象缺失或属性错配问题,本文提出 Divide-and-Denoise,在采样过程中把噪声样本区域视为可分配资源,通过公平分配博弈动态决定各模型负责的软区域,并据此约束去噪更新。实验在条件图像生成上验证,方法在 GenEval、CLIP-Score、VQAScore、ImageReward 等指标上优于组合基线,并能更充分利用单概念模型的专长。

Where Does Texture Evidence Live in SAM? Features, Proposal Masks, and Texture Segmentation Figure 1
2026-06-16cs.CV

Where Does Texture Evidence Live in SAM? Features, Proposal Masks, and Texture Segmentation

Nadav Orenstein, Aviad Cohen Zada, Shai Avidan, Gal Oren

Tel Aviv University, Israel, Stanford University, Technion, USA

2026-06-16视觉感知

这篇论文针对 SAM 在材质、纹理而非物体语义定义的分割中常失效的问题,追问失败是否真因“看不见纹理”。作者不微调 SAM,而是分别探查冻结多尺度特征和自动 proposal mask 库,并用最小聚类/监督整合读出纹理分区。结果显示,SAM 默认并非纹理分割器,但其粗层特征和候选掩码常已保留纹理证据;自然场景更需碎片组装,合成场景多是选中已有候选。

Sub-Semantic Image Segmentation Figure 1
2026-06-16cs.CV

Sub-Semantic Image Segmentation

Aviad Cohen Zada, Nadav Orenstein, Shai Avidan, Gal Oren

Tel Aviv University, Israel, Stanford University, Technion, USA

2026-06-16视觉感知

论文针对传统纹理分割只看低层统计、语义分割又过度依赖物体类别的问题,提出“亚语义”分割:用自由语言描述可稳定识别的材质/外观模式而非对象名。方法 Detecture 将 Qwen3-VL 与 SAM 3 通过专门桥接、隔离注意力和竞争式分区机制结合,并构建 TextureADE。实验显示其在 RWTD、STLD、TextureADE 上 mIoU 均领先,多数 ARI 也优于基线。

Beyond Self-Attention: Sub-Quadratic Vision Transformers for Fast Image Captioning Figure 1
2026-06-16cs.CV

Beyond Self-Attention: Sub-Quadratic Vision Transformers for Fast Image Captioning

Chiradeep Ghosh, Dakshina Ranjan Kisku

Department of Computer Science and Engineering, National Institute of Technology Durgapur, redundancy limits scalability and increases inference cost in, improve scalability. Although REFORMER reduced memory

2026-06-16视觉语言视觉感知

针对图像描述中 ViT 自注意力随 patch 数二次增长、推理成本高的问题,论文用 GMM 软聚类和 EM 将相似图像块归入固定簇,以簇级概率关系替代全量两两注意力,使复杂度由 O(n²) 降至 O(nK),并接入自回归 GPT 解码器生成描述。在 Flickr30K 上作者报告较既有方法有竞争力并取得提升,但具体指标幅度与增益来源在给定片段中未充分说明。

X-Tokenizer: A Multimodal Action Tokenizer for Vision-Language-Action Pretraining Figure 1
2026-06-16cs.CV

X-Tokenizer: A Multimodal Action Tokenizer for Vision-Language-Action Pretraining

Xirui Kang, Yanpei Shi, Lucy Liang, Roy Gan, Dongxiu Liu, Pushi Zhang, Danpeng Chen, Xiaoyi Qin, Yinan Zheng, Jinliang Zheng, Hao Wang, Xianyuan Zhan, Hang Su

2026-06-16视觉语言视觉感知

论文针对 VLA 中视觉语言离散语义与连续机器人控制之间的表征错配,认为动作 tokenizer 不应只做压缩,而应提供语义监督。X-Tokenizer 用 SRQ 将顶层码训练成含粗粒度意图的“动作语言”,底层保留执行细节,并通过与冻结基础模型对齐和预测下一帧特征注入多模态语义。在 2.4M 轨迹预训练后,冻结用于混合离散-连续 VLA,在真实任务、RoboTwin 2.0 和 VQA 上优于 FAST,长程任务提升 8.25, grounding 相对提升 13.5%。

Pixel-TTS: Image based Text Rendering for Robust Text-to-Speech Figure 1
2026-06-16eess.AS

Pixel-TTS: Image based Text Rendering for Robust Text-to-Speech

Adarsh Arigala, Arjun Gangwar, S Umesh, Yova Kementchedjhieva

SPRING Lab, Indian Institute of Technology, Madras, India

2026-06-16视觉感知安全鲁棒

针对传统 TTS 依赖离散 Unicode 字符嵌入、跨语种适配需扩展词表且难处理未见字符的问题,Pixel-TTS 将文本渲染为 16×16 字符图像块,经 2D 卷积生成像素级嵌入,并接入 ADMA/F5-TTS 式流匹配与对齐损失。实验显示其在 LibriTTS 上 WER/CER 低于文本基线、SIM 和 UTMOS 相当,且在德语低资源微调、零样本跨语种和 Unicode/l33tspeak 扰动下收敛更快、鲁棒性更好。

Automated 3D Kinematic Monitoring for Circadian Activity and Anomaly Detection in Juvenile Fish Figure 1
2026-06-16cs.CV

Automated 3D Kinematic Monitoring for Circadian Activity and Anomaly Detection in Juvenile Fish

Chih-Wei Huang, Chang-Wen Huang, Chung-Ping Chiang, Tsung-Wei Pan

AI Research Center, National Taiwan Ocean Univ., Keelung City 20224, Taiwan., Center of Excellence for the Oceans, National Taiwan Ocean University, Keelung City 20224, Taiwan., data expansion far outpaces the availability of high-resolution

2026-06-16视觉感知三维

针对水产育种中幼鱼行为表型难以高频、无接触量化的问题,论文将YOLO类检测、双目立体视觉和轨迹滤波结合,把2D检测框中心映射到绝对3D坐标,并用静止门控抑制深度噪声。实验显示该系统可重建幼年罗非鱼昼夜游动基线,估计3D速度/加速度,并用于生理压力异常预警。

Is My Vision-Language Data in Your AI? Membership Inference Test (MINT) Demo 2 Figure 1
2026-06-16cs.CV

Is My Vision-Language Data in Your AI? Membership Inference Test (MINT) Demo 2

Daniel DeAlcala, Gonzalo Mancera, Julian Fierrez, Aythami Morales, Ruben Tolosana, Ruben Vera-Rodriguez

2026-06-16视觉语言视觉感知

这篇论文面向AI Act等监管下训练数据透明性需求,将传统成员推断从“攻击”改写为授权审计工具MINT,用模型输出、激活等可审计信号判断某条图像或文本是否参与训练,并扩展为支持MINT/aMINT/gMINT的网页平台。实验覆盖人脸识别模型、4个LLM、6个大规模图像库和6个文本库,训练数据检测准确率最高约90%,但不同模型与模态下的稳定性和误报代价仍需进一步说明。

MMLongEmbed: Benchmarking Multimodal Embedding Models in Long-Context Scenarios Figure 1
2026-06-16cs.CV

MMLongEmbed: Benchmarking Multimodal Embedding Models in Long-Context Scenarios

Haitian Wang, Ruoxi Sun, Quantong Qiu, Juntao Li, Junhui Li, Hua Chen, Jinxiong Chang, Min Zhang

Soochow University, Suzhou, China

2026-06-16视觉语言数据集/基准

针对多模态嵌入模型虽宣称支持 32K 长上下文、但缺少系统评测的问题,MMLongEmbed 构建覆盖网页、文档、视频与长文本的长上下文检索基准,并用长度分层和高相似干扰项控制难度。对 11 个模型的评测显示,现有模型随上下文变长在细粒度检索上明显退化,且常依赖表层匹配;模型规模或嵌入维度增大并不稳定带来收益。

Style-CCL: Content-Preserving Style Transfer via Curriculum Continual Learning Figure 1
2026-06-16cs.CV

Style-CCL: Content-Preserving Style Transfer via Curriculum Continual Learning

Shiwen Zhang, Haoyuan Wang, Xianghao Zang, Haibin Huang, Chi Zhang, Xuelong Li

Labs, 2025) with diffusion transformers, (Labs, 2024, Institute of Artificial Intelligence (TeleAI), China Telecom., ence, target] triplets to train SC-DiT on FLUX-dev (Labs, (Esser et al., 2024) and FLUX (Labs, 2024) improves text-, does FLUX-Kontext (Labs et al., 2025). OmniConsistency

2026-06-16视觉感知

本文针对双参考图像风格迁移中 DiT 易混淆内容与风格、语义风格压制纹理风格并损害内容保持的问题,提出 SC-DiT 双分支解耦结构,并用 LID 将风格按难度排序,采用从语义到纹理、从干净到合成数据的课程持续学习与随机记忆回放。实验称其在风格相似度、内容一致性和美学质量上达到 SOTA,但增益可能部分来自百万级三元组数据构建。

HorusEye: Language as Dynamic Attention for Emergency Visual Analysis Figure 1
2026-06-16cs.CV

HorusEye: Language as Dynamic Attention for Emergency Visual Analysis

Armel Yara

2026-06-16视觉感知

面向搜救中雾、烟、热成像等分布偏移导致VLM视觉定位与判断失效的问题,HorusEye构建RefCOCO-Degraded并把语言反馈作为动态注意力来评测多模型。结果显示该机制强依赖模型:Gemini在热成像迭代反馈下提升47.3%,Qwen2-VL反降5.1%;同时发现热成像中裁剪会破坏上下文、使Gemini姿态识别下降26%,BLIP-2在退化下幻觉增加,不宜应急部署。

GridVQA-X: A Framework for Evaluating Multimodal Explainability Methods Figure 1
2026-06-16cs.CV

GridVQA-X: A Framework for Evaluating Multimodal Explainability Methods

Sujay Belsare, Sudarshan Nikhil, Sushant Kumar, Ponnurangam Kumaraguru, Chirag Agarwal

University of Virginia, USA

2026-06-16视觉语言

针对视觉语言模型解释方法缺乏可验证跨模态真值、难以区分真实空间推理与词袋式捷径的问题,论文提出 GridVQA-X:用闭世界合成网格生成唯一因果解释,并训练纯推理与捷径依赖的成对模型作为诊断基准。实验显示,多种现有多模态解释器难以区分两类决策路径,说明其对真实跨模态协同的忠实性评估仍存在明显缺口。

UtVAA: Ultra-tiny Vision Transformer with Affix Attention for Mobile Image Classification Figure 1
2026-06-16cs.CV

UtVAA: Ultra-tiny Vision Transformer with Affix Attention for Mobile Image Classification

Romiyal George, Sathiyamohan Nishankar, Selvarajah Thuseethan, Roshan G. Ragel

2026-06-16视觉感知

面向移动/边缘端部署,论文针对标准 ViT 自注意力开销高、参数量大的问题,提出超小型 UtVAA。其核心是在 Affix Attention 中结合深度/逐点卷积、线性注意力、坐标注意力与三路融合,并用空洞深度可分离瓶颈扩大感受野。最小模型仅 204.67K 参数、53.95M FLOPs,在 CIFAR 与番茄病害数据集上保持有竞争力的分类精度。

Steady-Forcing: Balancing Spatial Persistence and Motion Continuity in Long-Horizon Nature Video Diffusion Figure 1
2026-06-16cs.CV

Steady-Forcing: Balancing Spatial Persistence and Motion Continuity in Long-Horizon Nature Video Diffusion

Matiur Rahman Minar, Seunghun Oh, GangHyeon Jeong, Unsang Park

2026-06-16视觉感知生成模型

本文关注自回归视频扩散在固定机位长时自然场景中易出现的背景漂移与水、火、烟等流体运动停滞问题。Steady-Forcing 的核心是将空间身份锚点 V-Sink 与 EMA 运动记忆分离,并结合块相对时间编码、周期性 KV 缓存清理及 Wan2.1-14B 教师蒸馏,以平衡稳定性和运动连续性。实验相对七个基线提升了长时背景一致性与画质,盲测也显示用户更偏好其稳定视角和持续流动效果。

BBR-Net: Boundary-Balanced Replay for Continual Medical Image Segmentation Figure 1
2026-06-16cs.CV

BBR-Net: Boundary-Balanced Replay for Continual Medical Image Segmentation

Zahid Ullah, Sieun Choi, Jihie Kim

2026-06-16视觉感知学习理论

论文针对医疗分割持续学习中跨域更新易遗忘的问题,指出仅保存外观样本不足以维持解剖结构一致性。BBR-Net用双头U-Net引入边界监督,并按边界信息量与类别均衡选择回放样本。CAMUS到CardiacNet实验中接近联合训练、显著减轻遗忘;反向顺序和边界扰动显示,回放效果受初始结构标注质量强烈制约。

Hierarchical GRU with Input-Conditioned Slot Queries for Ball Action Anticipation Figure 1
2026-06-16cs.CV

Hierarchical GRU with Input-Conditioned Slot Queries for Ball Action Anticipation

Parthsarthi Rawat

2026-06-16视觉感知

本文面向足球转播中的球类动作预判:利用过去30秒视频预测未来5秒内10类动作,动机是处理长时序上下文、类别不均衡和事件时间定位。方法以冻结视频特征为输入,用局部Transformer建模5秒片段内关系、GRU聚合跨窗口上下文,再用由输入条件化的slot查询解码事件,并结合频率重加权匈牙利匹配和高斯时间软标签。SoccerNet BAA测试集mAP为17.91%,接近但略低于FAANTRA基线18.05%,输入条件化查询带来约0.8个百分点验证增益。

FUSE: Quantifying Uncertainty in Vision-Language Models by Bayesian Fusing Epistemic and Aleatoric Uncertainty Figure 1
2026-06-16cs.CV

FUSE: Quantifying Uncertainty in Vision-Language Models by Bayesian Fusing Epistemic and Aleatoric Uncertainty

Harry Zhang, Luca Carlone

2026-06-16视觉语言视觉感知安全鲁棒

面向机器人等高风险场景中 VLM 容易幻觉且置信度失准的问题,FUSE 将输入图文歧义带来的偶然不确定性与多次生成语义分散反映的认知不确定性区分建模,用 GP 将 CLIP 嵌入概率化作为先验,再以响应分散作似然进行闭式贝叶斯融合,得到单一可解释不确定性分数;在多个 VQA 基准上相较 token likelihood 等基线取得更好的校准、选择性准确率和错误相关性。

FairGen: Preference-Aligned Diffusion for Demographically Equitable Medical Image Synthesis Figure 1
2026-06-16cs.CV

FairGen: Preference-Aligned Diffusion for Demographically Equitable Medical Image Synthesis

Zhimin Li, Ruichen Zhang, Zhen Tan, Howard J Aizenstein, Jingtong Hu, Tianlong Chen

University of Pittsburgh, Swanson School of Engineering, Pittsburgh, 15261, USA, The University of North Carolina at Chapel Hill, Department of Computer Science, Chapel Hill, 27599, USA, Arizona State University, School of Computing and Augmented Intelligence, Tempe, 85281, USA, University of Pittsburgh, Department of Psychiatry, Pittsburgh, 15213, USA

2026-06-16视觉感知生成模型

医疗影像数据常因肤色、性别、年龄等人口属性失衡,使诊断模型在少数群体上产生偏差。FairGen 将属性-疾病重采样、多样性正则与医生偏好对齐引入扩散生成,合成更均衡且保留病灶特征的图像;在皮肤、胸片和脑 MRI 任务上分别带来 95.9%、80.0%、35.2% 的公平性提升,并保持接近原始临床数据训练的诊断准确率。

Interpolation between Convolution and Attention via K-Nearest Neighbors Figure 1
2026-06-16cs.CV

Interpolation between Convolution and Attention via K-Nearest Neighbors

Mingi Kang

An Honors Paper for the Department of Computer Science, Bowdoin College, 2026

2026-06-16视觉感知

这篇论文针对视觉模型中卷积的局部归纳偏置与注意力的全局特征匹配长期割裂的问题,提出用 k 近邻选择与加权聚合统一两者:按空间坐标选邻居可退化为卷积,按特征相似度选邻居可退化为自注意力。ConvNN 可替换卷积或注意力层,并在 CIFAR-10/100、ImageNet-1K 的 VGG/ResNet/ViT 实验中相较纯卷积、全注意力和部分稀疏注意力取得更好分类表现,但具体增益来源仍可能受实现与训练设置影响。

VigilFormer: Deformable Attention for Video Anomaly Detection with Causal Risk Inference Figure 1
2026-06-16cs.CV

VigilFormer: Deformable Attention for Video Anomaly Detection with Causal Risk Inference

Xinze Zhang

University of Southern California, Los Angeles, CA 90007, USA

2026-06-16视觉感知安全鲁棒

面向监控视频异常检测中精度与实时性的矛盾,VigilFormer将可变形时空注意力用于稀疏捕捉跨帧异常线索,并结合因果膨胀卷积与对比式MIL在仅视频级标签下建模时序风险;推理端用置信度调度跳过低信息帧。文中报告在UCF-Crime、ShanghaiTech、CUHK Avenue上AUC为87.83%、97.21%、89.74%,单卡41.5 FPS,但仍依赖I3D预提特征。

Disagreement-Based Cross-Model Routing for Implicit Video Question Answering Figure 1
2026-06-16cs.CV

Disagreement-Based Cross-Model Routing for Implicit Video Question Answering

Durga Sandeep Saluru

2026-06-16视觉感知

本文针对 ImplicitQA 中单一视频 LLM 接近上限且自一致投票会放大相关错误的问题,提出无需训练的分歧路由:对 Gemini 零温三次采样,用答案不一致作为不确定性信号,仅将约 20% 难题交给输入模态不同的 Claude 处理。验证集 AvgAcc 提升 1.43,挑战测试集达 82.03 AvgAcc,较最佳单次 Gemini 提升 1.81,增益主要出现在跨镜头空间与运动推理类别。

DC-Motion: Decoupling Semantics and Details via Discrete-Continuous Tokens for Human Motion Generation Figure 1
2026-06-16cs.GR

DC-Motion: Decoupling Semantics and Details via Discrete-Continuous Tokens for Human Motion Generation

Hequan Wang, Jiaxu Zhang, Zhengbo Zhang, Zhigang Tu

Wuhan University, Wuhan University Wuhan China

2026-06-16视觉感知

针对文本到人体动作生成中扩散模型语义组合推理弱、离散 AR 模型又易丢失细节并产生抖动的问题,DC-Motion 将动作表示拆成离散语义 token 与连续残差细节:先用 DC-VAE 分解层级信息,再由 MaskGIT 预测全局动作结构、轻量残差扩散补回物理动态。实验称其在 HumanML3D 与 KIT-ML 上取得最佳 FID 和 R-precision,尤其提升复杂长指令对齐与动作真实感。

AI for Maritime Security: Comparative Evaluation of CNN and Vision Transformer Architectures for Maritime Object Detection Figure 1
2026-06-16cs.CV

AI for Maritime Security: Comparative Evaluation of CNN and Vision Transformer Architectures for Maritime Object Detection

Ismet Gocer, Zakirul Bhuiayn, Shakeel Ahmad, Raza Hasan

Southampton Solent University, School of Technology and Maritime Industries

2026-06-16视觉感知数据集/基准

面向海上安防中复杂天气、实时监控和边缘部署的船舶视觉检测需求,本文用6468张多天气海事图像系统比较基础CNN、Xception/VGG16/MobileNetV2/EfficientNetV2L迁移模型与ViT,并把准确率、I/II类错误、模型大小和视频处理时间纳入同一评估。结果显示模型选择强依赖算力约束:轻量网络更适合受限设备,而ViT在文中实验中达到100%准确率、最低错误率和最快视频处理;但其泛化增益来源仍可能主要来自数据与实验设置,文中未充分说明。

RAMS: Resource-Adaptive and Detection-Conditioned Model Switching for Embedded Edge Perception Figure 1
2026-06-16cs.CV

RAMS: Resource-Adaptive and Detection-Conditioned Model Switching for Embedded Edge Perception

Kushal Khemani, Evan Leri, George Xu, Amit Hod

NEXEDGE Research Lab

2026-06-16视觉感知

RAMS针对嵌入式边缘目标检测中资源波动导致的延迟—精度冲突,提出按空闲状态自校准资源阈值、常驻三档YOLOv8模型并结合VRU检测事件延迟降级的运行时切换器,同时用SWAS评估无标注视频策略效果。跨树莓派、x86与Jetson实验显示,重载下safety2在Jetson TRT上平均3.41 ms、比固定MEDIUM快5.6倍,并在保留约74%代理精度的同时较阈值策略提升25.4% oracle SWAS,但受NANO层VRU召回仅24.2%限制。

From Static Inference to Dynamic Interaction: A Survey of Streaming Large Language Models Figure 1
2026-06-16cs.CL

From Static Inference to Dynamic Interaction: A Survey of Streaming Large Language Models

Junlong Tong, Zilong Wang, YuJie Ren, Peiran Yin, Hao Wu, Wei Zhang, Xiaoyu Shen

Shanghai Jiao Tong University, Institute of Digital Twin, Eastern Institute of Technology, Ningbo

2026-06-16视觉感知

针对传统 LLM 依赖完整静态输入、难以处理实时语音/视频和交互式智能体中持续到来的信息,本文从数据流与交互并发性重新界定 streaming LLM,并将现有工作划分为输出流式、顺序流式和并发流式三类。其主要结果是梳理文本、语音、视频场景下的生成加速、增量编码、上下文管理和全双工交互策略,指出延迟—性能权衡、实时对齐数据不足等仍是关键瓶颈。

2026-06-15

83 篇
Gaze Heads: How VLMs Look at What They Describe Figure 1
2026-06-15cs.CV

Gaze Heads: How VLMs Look at What They Describe

Rohit Gandikota, David Bau

Northeastern University

2026-06-15视觉语言

本文关注视觉语言模型在生成图像描述时,内部如何决定“看哪里再说什么”。作者发现语言骨干中少量中后层注意力头会随当前描述区域移动,并将其称为 gaze heads;用漫画分格的空间叙事顺序可低成本定位这些头。对 Qwen3-VL-8B 仅干预前 100 个头(约 8.7%)即可把回答重定向到指定分格,准确率 83.1%,随机头无效,全头干预会破坏生成;该机制还可中途切换目标,并部分迁移到 COCO 和多种模型规模。

OmniVideo-100K: A Dataset for Audio-Visual Reasoning through Structured Scripts and Evidence Chains Figure 1
2026-06-15cs.CV

OmniVideo-100K: A Dataset for Audio-Visual Reasoning through Structured Scripts and Evidence Chains

Xinyue Cai, Chaoyou Fu, Yi-Fan Zhang, Ran He, Caifeng Shan

Nanjing University

2026-06-15视觉感知数据集/基准

针对现有音视频 QA 数据生成中音画分离、跨片段实体不一致和问题缺少长程推理的问题,OmniVideo-100K 用“实体锚定脚本”统一人物/声源引用,再以“线索引导”先挖掘跨片段多模态证据链后生成问答。该流程构建了 10 万训练样本和 505 条人工测试集,微调 VITA-1.5、Qwen2.5/3-Omni 在 OmniVideo-Test 上最高提升 20.59%,并在 Daily-Omni、JointAVBench 等基准上有一定泛化。

RATS! Patches Talk Through Registers: Emergent Parts in Register Attention Transformers Figure 1
2026-06-15cs.CV

RATS! Patches Talk Through Registers: Emergent Parts in Register Attention Transformers

Timing Yang, Predrag Neskovic, Jansen Seheult, Wenchao Han, Anand Bhattad, Alan Yuille, Feng Wang

Johns Hopkins University, Department of Laboratory Medicine and Pathology, Mayo Clinic, MN, USA

2026-06-15视觉感知

论文针对自监督 ViT 虽含有部件级线索、却缺少显式分组机制的问题,提出 RATS:用多个可学习 register 替代单一 CLS 聚合,在每个块中通过 L→N→N→L 的压缩、通信、广播瓶颈路由 patch 信息,并按注意力头隔离 register 以促成区域专化。无需部件标注或辅助损失,register 可形成类似物体部件的表示;在五个分割基准上平均提升约 12 mIoU,并在 ADE20K、COCO 下游任务上取得小幅增益。

RepFusion: Leveraging Multimodal Priors for Denoising in Representation Space Figure 1
2026-06-15cs.CV

RepFusion: Leveraging Multimodal Priors for Denoising in Representation Space

Xichen Pan, Aashu Singh, Satya Narayan Shukla, Xiangjun Fan, Shlok Kumar Mishra, Saining Xie

2026-06-15视觉语言

针对现代文生图中 LLM 多停留在静态文本编码、去噪仍依赖新训 DiT 的分工,RepFusion 利用 RAE 提供的语义化视觉表征空间,将冻结的预训练 MLLM改作“噪声表征编码器”,反复读取随去噪演化的视觉 latent,并用其输出条件化 DiT。实验显示,在相近推理 FLOPs 下,仅微调 1.3B DiT 和 MLP projector 即优于训练更大去噪器或 Transfusion 基线,说明 MLLM 先验可直接帮助表征空间去噪。

Instruct-Particulate: Scaling Feed-Forward 3D Object Articulation with Kinematic Control Figure 1
2026-06-15cs.CV

Instruct-Particulate: Scaling Feed-Forward 3D Object Articulation with Kinematic Control

Ruining Li, Yuxin Yao, Matt Zhou, Chuanxia Zheng, Christian Rupprecht, Joan Lasenby, Shangzhe Wu, Andrea Vedaldi

University of Oxford, University of Cambridge, Nanyang Technological University

2026-06-15规划控制三维

针对可动三维物体标注稀缺、模型难泛化到新类别的问题,本文将静态网格的关节重建改写为“按运动学指令解析”:输入部件描述、连接关系、关节类型和可选点提示,预测部件分割与运动参数,并用 VLM 伪标注构建超 15 万异构训练集。实验显示其跨类别和 AI 生成网格泛化更好,可结合图像到三维模型生成可导入物理仿真的可动资产;增益可能主要来自 scaling / data 与指令消歧共同作用。

ClinHallu: A Benchmark for Diagnosing Stage-Wise Hallucinations in Medical MLLM Reasoning Figure 1
2026-06-15cs.CV

ClinHallu: A Benchmark for Diagnosing Stage-Wise Hallucinations in Medical MLLM Reasoning

Sicheng Yang, Hangjie Yuan, Wenjun Zhang, Jinwang Wang, Yichen Qian, Weihua Chen, Fan Wang, Lei Zhu

The Hong Kong University of Science and Technology (Guangzhou), DAMO Academy, Alibaba Group, Hupan Lab, Zhejiang University

2026-06-15数据集/基准

针对现有医学多模态幻觉评测只看最终答案、难以定位错误来源的问题,ClinHallu将7,031个医学VQA样本标注为视觉识别、知识回忆和推理整合三阶段轨迹,并用阶段替换干预诊断瓶颈。对11个MLLM的实验显示,不同模型和数据集的幻觉来源差异明显,视觉与知识错误会向后传播;轨迹监督微调还能降低分阶段幻觉率。

CottonLeafVision: An Explainable and Robust Deep Learning Framework for Cotton Leaf Disease Classification Figure 1
2026-06-15cs.CV

CottonLeafVision: An Explainable and Robust Deep Learning Framework for Cotton Leaf Disease Classification

Rafi Ahamed, Md. Abir Rahman, Tasnia Tarannum Roza, Munaia Jannat Easha, Md. Asif Khan, Sudeepta Mandal

East West University, DenseNet201, InceptionV3, and VGG19 on a publicly available, consuming, and require a significant amount of manual labor., severity. The availability of reliable, expertly annotated image, Initially, crop experts and computer scientists will collaborate, images, which are labeled. After that, they applied, model, which is trained on a labeled dataset of healthy and, disease using a publicly available dataset, this study utilizes a, available for Cotton Leaf Disease Detection, shown in Fig. 2.

2026-06-15视觉感知安全鲁棒

面向棉花病害早期诊断中人工巡检成本高、田间图像变化大的问题,论文比较 DenseNet201、InceptionV3、VGG19,并加入过采样、对抗训练、Grad-CAM 与遮挡敏感性分析以提升鲁棒性和可解释性。在7类公开叶片数据上 DenseNet201 达到98%准确率,高于对比模型;但仅单一公开数据集验证,泛化增益来源仍需更多外部测试说明。

HumP-KD: A Hybrid Uncertainty-Aware Multi-Stage Progressive Knowledge Distillation Framework for Efficient Fire Classification Figure 1
2026-06-15cs.CV

HumP-KD: A Hybrid Uncertainty-Aware Multi-Stage Progressive Knowledge Distillation Framework for Efficient Fire Classification

Mohammed Arif Mainuddin, Najifa Tabassum, Omar Ibne Shahid, Riasat Khan

2026-06-15安全鲁棒

面向火灾监控在边缘设备上需兼顾准确率、实时性与退化图像鲁棒性的需求,论文提出 HumP-KD,将 Swin-Tiny、ViT-Base 及 Meta-MLP 集成教师蒸馏到 MobileViT-S,并结合教师不确定性加权、层级注意力掩码和多阶段渐进训练。Dataset-II 上 10 次试验 F1 达 0.9876,显著高于未蒸馏学生模型,同时仅 4.94M 参数、CPU 37.72 FPS;但部分基线接近满分,增益来源仍可能受数据集难度影响。

Memento: Reconstruct to Remember for Consistent Long Video Generation Figure 1
2026-06-15cs.CV

Memento: Reconstruct to Remember for Consistent Long Video Generation

Xuan Wei, Longbin Ji, Guan Wang, Xiangrui Liu, Zhenyu Zhang, Shuohuan Wang, Yu Sun, Qingqi Hong

Xiamen University, ERNIE Team, Baidu Inc.

2026-06-15视觉感知

长视频生成中,分镜式自回归方法虽可扩展,但历史记忆常只服务下一镜头连贯性,导致人物或物体身份随时间漂移。Memento 将一致性转化为“能否仅凭记忆重建主体”的显式监督,并用双查询记忆区分长期身份证据与短期上下文线索,配合无代词主体描述的数据管线。实验显示其在长期主体一致性、跨镜头连贯性和视觉质量上优于对比方法,但误差写入记忆和物理合理性仍是限制。

Giving AI a Headache: Acoustic Adversarial Attacks to Computer Vision Applications Figure 1
2026-06-15cs.CV

Giving AI a Headache: Acoustic Adversarial Attacks to Computer Vision Applications

Nicole Villavicencio-Garduño, Maksim Ekin Eren, Milo Prisbrey, Ben Migliori, Michael Teti

Carnegie Mellon University, Pittsburgh, USA

2026-06-15视觉感知

针对自动驾驶、安防等视觉系统可能被物理传感链路干扰的问题,本文把声学对抗攻击从以往短距离超声扩展到可听低频,利用商品摄像头机械共振在成像阶段引入模糊、抖动和畸变,而非直接改像素。实物实验中,低频声信号可使 Logitech C930e 采集画面扰动并显著降低 YOLOv11 检测表现,出现漏检、误检或幻觉目标;但验证仅覆盖单一相机和固定声源,泛化范围仍文中未充分说明。

HPSv3++: Scaling Reward Models Across the Full Spectrum of Diffusion Model Capabilities Figure 1
2026-06-15cs.CV

HPSv3++: Scaling Reward Models Across the Full Spectrum of Diffusion Model Capabilities

Yijun Liu, Jie Huang, Zeyue Xue, Yuming Li, Ruizhe He, Haoran Li, Shijia Ge, Siming Fu

Tsinghua University, JD Explore Academy, Peking University, Zhejiang University

2026-06-15生成模型强化学习

针对现有 T2I 奖励模型依赖旧模型标注、难以适应生成能力提升和 RL 迭代分布漂移的问题,论文提出 HPSv3++:构建 212K 双维偏好数据 HPDv3++,并用 OGD 保留旧偏好知识,再加入能力—迭代条件化与基于组内分数方差的半监督引导。结果在 HPDv3、GenAI-Bench 分别较 HPSv3 提升 9.8% 和 5.5%,用于多种扩散模型 RL 时也提升 GenEval。

Improving Lunar Topography with Deep Learning Schrödinger Bridges Figure 1
2026-06-15cs.CV

Improving Lunar Topography with Deep Learning Schrödinger Bridges

Matthew Repasky, Erwan Mazarico, Michael K. Barker, Stefano Bertone, Terence J. Sabaka, Yao Xie

H. Milton Stewart School of Industrial and Systems Engineering, Georgia Institute of Technology, USA, NASA Goddard Space Flight Center, USA, Center for Research and Exploration in Space Science and Technology (CRESST II), University of Maryland, College Park, MD, USA, National Institute for Astrophysics (INAF), Astrophysical Observatory of Turin, 10025 Pino Torinese (TO), Italy

2026-06-15视觉感知

针对月球 LOLA 等高程模型分辨率不足、传统明暗恢复形状方法依赖专家调参与大规模计算的问题,本文将地形超分建模为低分辨率 DEM 到高分辨率 DEM 的 Schrödinger Bridge 生成过程,并用模拟 NAC 光学影像作物理条件约束。模型可多次采样给出像素级不确定性,在20 mpp渲染测试集上重建误差约5–6米,并展示了分块拼接扩展到大区域;但真实 NAC 与米级分辨率适配仍未充分验证。

SED:Lightweight Saliency prediction for Event-based data via Distillation Figure 1
2026-06-15cs.CV

SED:Lightweight Saliency prediction for Event-based data via Distillation

Romaric Mazna, Jean Martinet, Michele Magno

2026-06-15视觉感知

面向机器人、无人机等边缘平台,事件相机显著性预测需要兼顾低功耗实时性与跨域鲁棒性,而现有深度模型过重。SED用因子化深度可分离时空卷积DSTconv构建81k参数学生网络,并通过SEST教师蒸馏把压缩同时作为正则化。结果显示模型从180MB降至0.32MB,在N-DHF1K和N-UCF Sports上匹配或超过教师,并能从合成数据迁移到真实事件记录。

StereoGeo: an end-to-end stereo camera calibration method Figure 1
2026-06-15cs.CV

StereoGeo: an end-to-end stereo camera calibration method

Imane Meddour, Andréa Macario Barros, Cédric Gouy-Pailler

2026-06-15视觉感知

StereoGeo针对传统双目标定依赖棋盘格、多视角或假设左右相机内参相同的问题,提出从双目图像端到端估计左右焦距、重力方向及相对位姿的框架。方法将GeoCalib扩展到双目场景,用独立视角特征和透视场预测结合可微LM优化,并构建5万余合成双目对训练。实验显示其内参精度具竞争力,外参估计优于仅面向单目或受限假设的方法。

S$^2$COPE: Self-Supervised Concept Discovery via Preference Learning Figure 1
2026-06-15cs.CV

S$^2$COPE: Self-Supervised Concept Discovery via Preference Learning

Shilong Xiang, Zirui Zhang, Chengzhi Mao

Rutgers University

2026-06-15视觉感知

这篇论文针对自监督视觉表征难解释、概念模型依赖人工标注的问题,提出 S2COPE:让 VLLM 不再只是静态概念生成器,而是在基于视图不变性与跨实例判别性的自监督偏好优化循环中,主动生成、验证并强化视觉属性。实验覆盖自然、医学和物理图像,显示其能发现更贴近领域的可读概念,并在未见数据分类上最高带来 24 个百分点 top-1 提升。

A Qualitative Review of GenAI-Based Methods for Data Generation and Augmentation in Industrial Computer Vision Applications Figure 1
2026-06-15cs.CV

A Qualitative Review of GenAI-Based Methods for Data Generation and Augmentation in Industrial Computer Vision Applications

Paul Koch, Paul Hofmann, Ferdinand Waßelewsky, Adem Karakurt, Andre Sérs, Jörg Krüger

Hamburg University of Applied Sciences (HAW Hamburg), Technical University Berlin (Tu-Berlin), available in industrial applications, and its acquisition is not trivial either., classification of unlabeled objects, which is crucial for tasks such as parts sorting, a promising tool for realistic and controllable data augmentation. Using text

2026-06-15视觉感知

面向工业视觉项目初期缺数据、主动采集又易损害用户信任的困境,本文以 MVIP 工业零件分类为案例,定性比较图像个性化、GenAI 增强与仿真合成三类数据扩增路线。核心洞察是这些方法可辅助自动数据 ramp-up,但对提示词表述、视角一致性和工业语义高度敏感,易出现语义或类别特征偏移。主要结果显示其潜力仍受源域人类中心知识与目标工业对象特征不匹配限制,稳定带来分类增益的证据文中未充分说明。

Trimodal Glioma Representation Alignment via Volumetric Contrastive Learning Figure 1
2026-06-15eess.IV

Trimodal Glioma Representation Alignment via Volumetric Contrastive Learning

Denise Marini, Eleonora Grassucci, Danilo Comminiello

2026-06-15视觉感知

针对胶质瘤分级与生存预测中病理、转录组和MRI信息常被两两融合、难以统一对齐的问题,论文提出GLORIA,用模态专属编码器将WSI、mRNA和3D MRI投到共享空间,并以Gramian体积对比损失约束三模态嵌入,再经跨模态门控融合。在132例匹配队列、29例测试集上,相比WSI-mRNA双模态基线提升Micro/Macro-F1、AUC和综合指标,但样本较小,泛化仍需更大队列验证。

NEST3D: A High-Resolution Multimodal Dataset of Sociable Weaver Tree Nests Figure 1
2026-06-15cs.CV

NEST3D: A High-Resolution Multimodal Dataset of Sociable Weaver Tree Nests

Constanza A. Molina Catricheo, Simon Boeder, Ting-Jia Guo, Giacomo May, Clément Berthelot, Devis Tuia, Friedrich Fedor Reinhard, Fabio Remondino, Benjamin Risse

2026-06-15视觉语言数据集/基准三维

针对织巢鸟巢穴与宿主树冠交织、缺少精细三维标注数据而难以自动测量的问题,NEST3D用无人机采集104棵带巢树,发布1.4TB RGB、多光谱与约7.81亿点的三维点云,并提供树、巢、草三类专家语义标注。论文还以KPConv、RandLA-Net和Point Transformer V3建立基准,其中PT-v3测试mIoU达86.35%,同时显示极端类别不均衡下不同3D架构表现差异明显。

Visual Quality Score Assessment of Large White Goods in Remanufacture with Multi-View Deformable-DETR Figure 1
2026-06-15cs.CV

Visual Quality Score Assessment of Large White Goods in Remanufacture with Multi-View Deformable-DETR

Paul Koch, Vivek Chavan

2026-06-15视觉感知

面向大件白色家电再制造中人工质检耗时、主观且难以支撑定价的问题,论文将 Deformable-DETR 扩展到多视角质量评分,并结合 DINOv2 冻结特征、自监督多视角预训练、少量专家分数微调及热力图解释。工业数据含 2298 台设备、2.33 万图像;实验显示多视角结构与预训练逐步带来改进,可生成质量分和关注区域,但数据规模较小且人工评分不一致,具体增益稳定性仍受限。

Rethinking Global Average Pooling: Your Classifier Is Secretly a Multi-Instance Learner Figure 1
2026-06-15cs.CV

Rethinking Global Average Pooling: Your Classifier Is Secretly a Multi-Instance Learner

Aray Karjauv

2026-06-15视觉感知

针对单标签分类把多物体场景压成单一图像预测、难以判断证据来源的问题,论文指出GAP加线性分类头可等价为对空间网格逐点分类后求平均,因而普通分类器可被解释为多实例学习器。作者用这一结构做无需重训的稠密读出诊断,发现ImageNet、ImageNet-A和COCO设置中,现成CNN/ViT及自监督特征仍能在前景区域恢复真实类别,许多失败更像是均值聚合稀释局部证据所致。

A Lightweight Fiducial-Based Pipeline for 3D Hyperspectral Mapping of ex-vivo Lumpectomy Specimens Figure 1
2026-06-15cs.CV

A Lightweight Fiducial-Based Pipeline for 3D Hyperspectral Mapping of ex-vivo Lumpectomy Specimens

Anna Bicchi, Alberto Rota, Leonardo Passoni, Nicola Ancellotti, Andrea Peroni, Lorenzo Vinco, Dario Polli, Elena De Momi

Authors are with the Department of Electronics, Information and Bioengineering (DEIB), Politecnico di Milano, Milan, Italy, Authors are with the Department of Physics, Politecnico di Milano, Milan, Italy

2026-06-15三维

针对乳腺保乳手术中高光谱图像只能给出二维可疑区域、难以对应到切除标本真实表面的痛点,论文提出用消费级RGB多视角和单次HSI采集、借助四个ArUco标记完成免标定三维重建与2D-3D配准的轻量流程。在两例离体肿块切除标本上,中位三维配准误差低于1毫米、二维重投影误差低于0.02毫米,单例处理少于4分钟。

Scratched Lenses, Shifted Depth: Passive Camera-Side Optical Attacks Figure 1
2026-06-15cs.CV

Scratched Lenses, Shifted Depth: Passive Camera-Side Optical Attacks

Qinlin He, Zeming Zhuang, Yongji Wu, Lan Zhang, Xiaoyong (Brian) Yuan

2026-06-15视觉感知

该文关注视觉/机器人系统中被忽视的相机端被动光学风险:普通镜头划痕在强点光源或高光触发下会生成随场景变化的条纹,从而误导几何感知。核心创新是把划痕建模为光学空间中的触发条件攻击通道,并优化固定物理划痕而非像素扰动。数字与真实实验显示,SLASH可使单目深度产生最高约32%的定向相对误差,并影响单目3D检测;常规去眩光和对抗训练难以完全消除该效应。

Value-order Decomposition for Generalist Anomaly Detection Figure 1
2026-06-15cs.CV

Value-order Decomposition for Generalist Anomaly Detection

Miaoyun Zhao, Jing Chen, Miaoni Zhao, Qiang Zhang

Dalian University of Technology, Xi’an Chang’an Vanke City Primary School, Key Laboratory of Social Computing and Cognitive Intelligence (Dalian University of Technology), Ministry of Education, Dalian, China.

2026-06-15视觉感知

面向工业/医疗视觉异常检测中目标类别、缺陷类型和数据域变化导致的跨域泛化困难,论文提出 Value-Order Decomposition,将残差特征拆为跨差距稳定的 value 分量与携带类别/结构偏差的 order 分量,并仅用少量正常样本加 Cut-and-Paste 合成异常作参考。实验称该简单框架在多类工业与医疗基准上提升三类泛化能力,甚至接近或超过依赖真实异常参考的方法。

MooMIns -- Monocular 3D Reconstruction and Object Pose Estimation from Multiple Instances Figure 1
2026-06-15cs.CV

MooMIns -- Monocular 3D Reconstruction and Object Pose Estimation from Multiple Instances

Robert Langendörfer, Markus Hillemann, Markus Ulrich

2026-06-15三维

面向工业拣选中仅有单张RGB图、却包含同一物体多个姿态实例的场景,MooMIns利用实例间隐含多视角约束,反转高斯泼溅的建模方式:学习一个共享规范物体,并在各实例位姿下渲染优化,结合SAM3掩码与改造SfM初始化,避免单目深度先验幻觉。实验在合成与真实料箱数据上同时改进重建Chamfer距离和6D位姿误差,但金属少纹理场景仍依赖较强初始化。

IndustryBench-MIPU: Benchmarking Multi-Image Attribute Value Extraction for Industrial Products Figure 1
2026-06-15cs.CV

IndustryBench-MIPU: Benchmarking Multi-Image Attribute Value Extraction for Industrial Products

Haonan Qi, Jin Cao, Yongqi Zhang, Xintong Wang, Weidong Tang, Bin Chen, Chengfu Huo, Haojun Pan, Hengyu You, Jing Li, Yingde Wang, Liang Ding

single-image accuracy, is the core bottleneck. Dataset and code are publicly available., tables, nameplates, and labels, requiring reliable text recognition. Beyond surface-level reading, technical, Figure 1 Four Challenges in Multi-Image Industrial Product Understanding: (1) text recognition from labels and, MMMU (Yue et al., 2024) and MMMU-Pro (Yue et al., 2025) measure college-level multimodal reasoning, AVE has evolved from sequence labeling on product titles (Zheng et al., 2018

2026-06-15视觉感知数据集/基准

面向工业品采购与匹配中规格信息分散在表格、铭牌和图纸多张图片上的问题,论文提出 IndustryBench-MIPU,以结构化属性-值抽取评估多模态大模型的 OCR、图纸推理、领域术语理解和跨图整合能力。基准含 4559 个产品、27652 张图和 10.37 万标注;9 个模型虽有 86–94% 精度,但产品级最高召回仅 49.9%,显示瓶颈主要在多图证据整合而非单图识别。

FLaRA: Predicting Future Latent Representations for Accident Anticipation Figure 1
2026-06-15cs.CV

FLaRA: Predicting Future Latent Representations for Accident Anticipation

Lorenzo Caselli, Tomaso Trinci, Tommaso Bianconcini, Simone Magistri, Leonardo Taccari, Francesco Sambo, Andrew D. Bagdanov

2026-06-15视觉感知

面向行车记录仪中事故需提前预警而非事后检测的问题,FLaRA不再把已观测帧直接映射为碰撞概率,而是基于V-JEPA2先预测未来场景的潜在表示,再用这些预测特征分类,并以潜表示重建损失和交叉熵联合约束。作者在Nexar训练,并在DAD、DADA-2000、DoTA跨域验证,AP/AUC达到或超过现有方法且参数更少,但平均提前量与强基线接近,固定预测时域仍是限制。

Point Cloud Upsampling through Patch-based Frequency Superposition Figure 1
2026-06-15cs.CV

Point Cloud Upsampling through Patch-based Frequency Superposition

Marina Ritthaler, Azhar Hussian, Vasileios Belagiannis, André Kaup

2026-06-15三维

针对神经网络点云上采样依赖同分布训练数据、可解释性弱且可能扭曲几何的问题,本文提出无需训练的 PUtPFS:优先在稀疏区域选种子点,生长局部 patch,并用空间频率叠加拟合局部曲面后放置新点。实验称其在 PU-GAN、PU1K 上 P2F 超过现有深度方法,并在优化类方法中取得最佳 CD/HD,但对近距离双曲面和细线结构仍有限。

ForceForget: Reinforcement Concept Removal for Enhancing Safety in Text-to-Image Models Figure 1
2026-06-15cs.CV

ForceForget: Reinforcement Concept Removal for Enhancing Safety in Text-to-Image Models

Dong Han, Yong Li

2026-06-15视觉感知安全鲁棒

该文针对文本到图像模型的安全概念擦除问题:现有监督微调方法常把有害概念与提示中的良性语义一并抹除,导致人物等正常生成能力下降。ForceForget 将概念擦除改写为强化学习中的奖励优化,设计安全与对齐奖励,并在交叉注意力中加入 Safe Adapter 调节部分文本嵌入以减轻过度擦除。实验显示其在多数据集上降低不安全生成,同时更好保留良性图像质量,并在红队攻击和 I2I 场景下较基线更稳健;还扩展到风格和物体擦除。

CausalMotion: Structured Physical Reasoning as Keyframe and Trajectory Guidance for Training-Free Video Generation Figure 1
2026-06-15cs.CV

CausalMotion: Structured Physical Reasoning as Keyframe and Trajectory Guidance for Training-Free Video Generation

Sihan Zhuang, Xinyuan Chen, Tianfan Xue, Yaohui Wang

Shanghai Artificial Intelligence Laboratory, 2 ShanghaiTech University, The Chinese University of Hong Kong

2026-06-15视觉感知规划控制

针对视频扩散模型常出现物理不一致、长时因果转移跳变的问题,CausalMotion 将推理与生成解耦:用视觉语言模型把文本分解为因果关键帧和对象运动轨迹,再作为推理期软约束引导预训练视频模型,无需训练或标注。实验显示其在动态密集场景提升物理合理性与时序连贯性,PhyGenBench 平均分 0.65,较 LTX-Video 基线提升 67%,同时保持较高 VBench 质量分。

Pano3D: Unified 3D Reconstruction and Panoptic Segmentation Figure 1
2026-06-15cs.CV

Pano3D: Unified 3D Reconstruction and Panoptic Segmentation

Victor Barberteguy, Ahmet Iscen, Mathilde Caron, Alireza Fathi, Gül Varol, Cordelia Schmid

2026-06-15视觉感知三维

Pano3D针对无相机参数多视图重建模型缺乏稳健语义理解的问题,将基于查询的集合式全景分割头接到前馈3D重建骨干上,融合单目编码器与跨视图解码器特征,并用几何与语义损失联合微调,避免外部2D模型和聚类后处理。实验显示该框架可适配MUSt3R、Pi3等骨干,在ScanNet、ScanNet200和ScanNet++的3D全景分割上达到SOTA,同时基本保持重建能力。

What Drives Test-Time Adaptation for CLIP? A Controlled Empirical Study from an Update Perspective Figure 1
2026-06-15cs.CV

What Drives Test-Time Adaptation for CLIP? A Controlled Empirical Study from an Update Perspective

Jiazhen Huang, Xiao Chen, Zhiming Liu, Yaru Sun, Jingyan Jiang, Zhi Wang

Tsinghua University, Shenzhen Technology University

2026-06-15规划控制

针对CLIP在部署分布偏移下零样本性能不稳、TTA4CLIP方法增益来源不清的问题,本文构建TTABC统一评测20余种方法,并按测试时更新对象划分为参数、状态、推理三类。核心结论是,收益主要来自测试样本证据和可靠代理,而非复杂参数优化;轻量原型更新或跨/当前样本证据也能取得有竞争力且高效的表现,但不同偏移需匹配不同范式,不存在通用最优方案。

Pix2Pix-Hybrid: Structure-Guided Conditional Synthesis of Hajj Crowd Images with Multi-Channel Conditioning and Weak Attribute Supervision Figure 1
2026-06-15cs.CV

Pix2Pix-Hybrid: Structure-Guided Conditional Synthesis of Hajj Crowd Images with Multi-Channel Conditioning and Weak Attribute Supervision

Amirah F. Alshammari, Bander A. Alzahrani, Nahed A. Alowidi

Information Systems Department, Faculty of Computing and Information Technology, King Abdulaziz University, Jeddah, Saudi Arabia, Department of Information Systems, College of Computer and Information Sciences, Jouf University, Aljouf, Saudi Arabia, Computer Science Department, Faculty of Computing and Information Technology, King Abdulaziz University, Jeddah, Saudi Arabia

2026-06-15视觉感知

针对朝觐场景人群计数缺少标注数据且采集存在隐私风险的问题,论文提出 Pix2Pix-Hybrid,用边缘、灰度、密度和时段等八通道条件约束 U-Net 生成器,并用双尺度 PatchGAN、感知/特征匹配损失和自适应增强稳定训练。模型基于 993 帧生成 1 万张 CrowdH 图像,较 Pix2Pix、StyleGAN2-ADA 保持结构更好;加入筛选合成图后,五种计数模型 MAE 均下降,CSRNet 增益最大。

A Robust Point Cloud Analysis Framework Inspired By Primary Visual Cortex Figure 1
2026-06-15cs.CV

A Robust Point Cloud Analysis Framework Inspired By Primary Visual Cortex

Jisheng Dang, Dengyue Pan, Delin Deng, Yifan Zhang, Bimei Wang, Hong Peng, Bin Hu, Qi Tian, Tat-Seng Chua

2026-06-15三维安全鲁棒

针对点云模型在稀疏、遮挡、噪声和形变下鲁棒性不足且能耗偏高的问题,论文借鉴初级视觉皮层提出 DC-CCNN++:用离散—连续协同编码的脑启发网络替代部分 MLP,并加入全局增益调制、双码读出和渐进扰动训练。实验显示其在分类与部件分割上优于原 DC-CCNN,鲁棒性覆盖多类退化,同时保持接近主流方法的性能与较低能耗。

One Layer's Trash is Another Layer's Treasure: Adaptive Layer-wise Visual Token Selection in LVLMs Figure 1
2026-06-15cs.CV

One Layer's Trash is Another Layer's Treasure: Adaptive Layer-wise Visual Token Selection in LVLMs

Yongru Chen, Kai Zhang, Zeliang Zong, Yuchen Lu, Wenming Tan, Ye Ren, Jilin Hu

Hikvision Research Institute, Peking University, East China Normal University

2026-06-15视觉语言

针对大视觉语言模型中视觉 token 过长导致推理开销高、传统剪枝一旦丢弃 token 便造成后续层信息不可恢复的问题,论文指出不同层关注的视觉区域并不相同,提出 ALVTS 在每层用轻量低秩选择器动态挑选重要 token,低重要 token 跳过当前层后再合并,无需重训。在 LLaVA-1.5、LLaVA-NeXT、Qwen2.5-VL 上,89% 压缩率下保留 96.7% 原性能,并带来约 1.6× 加速。

HiST: A Hierarchical Sparse Transformer for Cross-Modal Spatial Transcriptomics Modeling Figure 1
2026-06-15cs.CV

HiST: A Hierarchical Sparse Transformer for Cross-Modal Spatial Transcriptomics Modeling

Weiyi Wu, Xinwen Xu, Xingjian Diao, Siting Li, Zhi Wei, Alma Andersson, Jiang Gui

2026-06-15视觉感知

空间转录组成本高、通量低,而从常规 H&E 全切片预测基因表达又面临稀疏不规则采样与多尺度上下文建模开销。HiST 将测点组织为稀疏格点场,在有效组织区域上用二分层级编码器-解码器和稀疏窗口注意力建模,并用切片校准 token 处理染色/扫描差异。多器官基准中其精度达到或优于近期方法,同时推理约快一个数量级、峰值显存低一个数量级以上。

Spectrum Aware Illumination Estimation Using Multispectral Image Figure 1
2026-06-15eess.IV

Spectrum Aware Illumination Estimation Using Multispectral Image

Hyejin Oh, Woo-Shik Kim, Sangyoon Lee, YungKyung Park, Je-Won Kang

2026-06-15视觉感知

本文针对多光谱图像中光照谱估计难以充分利用通道相关性、且跨传感器维度迁移需反复训练的问题,提出含3D卷积、光照先验谱注意力和多头谱自注意力的时空/谱特征提取框架,并用线性谱域变换把高维SPD投影到不同相机空间。作者还构建真实多光照MS数据集,实验显示其精度优于既有方法且可零额外训练适配低维传感器。

A Multi-Domain Feature Fusion Framework for Generalizable Deepfake Detection Across Different Generators Figure 1
2026-06-15cs.CV

A Multi-Domain Feature Fusion Framework for Generalizable Deepfake Detection Across Different Generators

Amna Amjid, Sana Qadir, Mehwish Fatima, Raja Khurram Shahzad

School of Electrical Engineering and Computer Science (SEECS), National University of Sciences and Technology (NUST), Islamabad, Pakistan, Department of Communication, Quality Management and Information Systems, Mid Sweden University, Ostersund Campus, Sweden, Department of Computer Science, Electrical and Space Engineering, Lulea University of Technology, Luleå, Sweden.

2026-06-15视觉感知

针对现有深伪检测器依赖单一空间或频域线索、在未见 GAN/扩散生成器上易失效的问题,本文提出 SGFF-Net,在双残差网络中融合空间、梯度与 DWT 小波频域特征,强调跨域互补取证线索。实验显示其同数据集准确率达 98.95%,跨模型/跨范式约 70%,结合多源训练与增强后提升至 79.80%、78.12%,真实场景达 75.80%,但部分增益可能主要来自数据多样性与增强。

Hybrid Classical-Quantum (HCQ) Alzheimer's Classification via Supervised $β$-VAE and Quantum Kernels Figure 1
2026-06-15cs.CV

Hybrid Classical-Quantum (HCQ) Alzheimer's Classification via Supervised $β$-VAE and Quantum Kernels

Tia Tiwari, Vamshi Krishna Kancharla, Neelam Sinha

Centre for Brain Research, Indian Institute of Science, Vision and AI Lab (VAL), Indian Institute of Science

2026-06-15生成模型

针对阿尔茨海默病3D MRI分类中样本少、直接深度模型易过拟合而手工特征又易丢失病灶信号的问题,论文提出先用监督β-VAE学习64维疾病感知表征,再经PLS选6维送入ZZ量子特征图和量子核SVM。ADNI-1的308例上,稳定版由67.2%准确率、0.759 AUC提升到72.1%、0.799,并称跨折方差减半;但样本规模较小,量子核相对经典核的独立增益仍需更多消融说明。

Context-aware Modality-Topology Co-Alignment for Multimodal Attributed Graphs Figure 1
2026-06-15cs.LG

Context-aware Modality-Topology Co-Alignment for Multimodal Attributed Graphs

Sirui Zhang, Xu Wang, Zhengyu Wu, Xunkai Li, Hongchao Qin

2026-06-15视觉语言

这篇 arXiv 预印本关注多模态属性图中固定邻域传播与过度融合导致的任务不适配和模态细节丢失问题。CoMAG 的核心思路是先按跨模态语义一致性评估边可靠性、补全语义邻居,并用任务门控选择上下文,再以模态保留的多跳 token 对齐和共享/私有解耦同时服务图任务与模态任务。在 9 个 OpenMAG 数据集上,其相对特征、图、 multimodal 与统一 MAG 基线取得最佳报告性能,但具体增益对数据与协议的依赖仍需进一步验证。

MUSE: Agentic 3D Scene Authoring via Memory-Grounded Incremental Requirement Satisfaction Figure 1
2026-06-15cs.CV

MUSE: Agentic 3D Scene Authoring via Memory-Grounded Incremental Requirement Satisfaction

Ruijie Xu, Xinnan Zhu, Jiayu Ying, Daoguo Dong, Yuzhou Ji, Xin Tan

East China Normal University, Fudan University, Shanghai Jiao Tong University

2026-06-15三维

本文针对文本驱动3D场景生成难以在多轮编辑中保留非目标内容的问题,将构建与编辑统一为“增量需求满足”。MUSE用Architect/Sculptor/Inspector三代理结合工作、场景、技能记忆,逐步分解、局部执行并验证约束。在AuthorBench上,构建All-Goal成功率由37.9提升到80.7,编辑保持率达99.9%,非预期改动仅0.6%。

VideoWeave: Unlocking Geometric Consistency in Video Generation via Joint Geometry-Video Modeling Figure 1
2026-06-15cs.CV

VideoWeave: Unlocking Geometric Consistency in Video Generation via Joint Geometry-Video Modeling

Xunzhi Xiang, Zixuan Duan, Yabo Chen, Zhengxuan Wei, Guiyu Zhang, Zixiao Gu, Zhe Gao, Haibin Huang, Chi Zhang, Qi Fan, Xuelong Li

Nanjing University, Institute of Artificial Intelligence, China Telecom (TeleAI), Chinese University of Hong Kong, Shenzhen

2026-06-15视觉感知

针对视频扩散模型在视角变化和长时生成中易出现几何漂移的问题,VideoWeave不再依赖深度图、点云等显式重建作为条件或监督,而是在训练期把几何模型的隐式特征适配为几何潜变量,并与视频潜变量联合去噪,再将联合分布蒸馏到学生生成器,推理时无需几何管线。论文还构建GeoVid-80K用于学习几何—外观配对先验,实验显示其在文生视频和图生视频中提升空间一致性与长程几何稳定性,同时基本保持视觉质量和生成效率。

Encoder Winners Do Not Reliably Transfer Across VLA Backbone Scale: A Frozen-Backbone Grafting Diagnostic Figure 1
2026-06-15cs.CV

Encoder Winners Do Not Reliably Transfer Across VLA Backbone Scale: A Frozen-Backbone Grafting Diagnostic

Qingping Zeng, Fei She

Tsinghua University

2026-06-15视觉感知

针对小规模 VLA 上选出的视觉编码器是否能迁移到更大骨干这一问题,论文提出冻结语言模型与动作专家、仅训练线性投影的视觉塔 grafting 诊断。结果显示编码器排名随骨干和任务变化:SmolVLA 上 SigLIP 最优,而 π0.5 的空间任务由 DINOv2-small 领先,物体任务则种子敏感近似持平;因此小骨干赢家不能可靠指导大骨干选型,且结论受固定 grafting 协议和离线 MSE 指标限制。

BoRAD: Bootstrap your Own Representations for Multi-class Anomaly Detection Figure 1
2026-06-15cs.CV

BoRAD: Bootstrap your Own Representations for Multi-class Anomaly Detection

Duy Hoang Khuong, Tri Nguyen Minh, Ngu Huynh Cong Viet

Department of Artificial Intelligence, FPT University, Department of IT, Department of Computing Fundamental

2026-06-15视觉感知

面向工业多类别“一模通用”异常检测,BoRAD指出重建模型同时受异常被原样复制的 identical shortcut 与正常类别混淆的 mis-reconstruction 困扰。其核心是在训练期引入共享可学习原型库,用局部原型对齐压缩同原型变化、用全局相对原型对齐保留类间结构;推理仍为教师-学生特征差异,无需标签、负样本或检索。在 MVTec AD、VisA、Real-IAD 上 mAD 分别为 86.2%、80.7%、73.1%,并显示更少异常泄漏和更好正常类别可分性。

Conditioning Matters: Stabilizing Inversion and Attention in Diffusion Image Editing Figure 1
2026-06-15cs.CV

Conditioning Matters: Stabilizing Inversion and Attention in Diffusion Image Editing

Zheyuan Zhan, Hongchen Li, Can Wang, Yinfei Ma, Mingzhen Huang, Ruoshi Bai, Jiawei Chen, Siwei Lyu, Defang Chen

2026-06-15视觉感知生成模型

针对基于反演的扩散图像编辑中重建误差累积、语义编辑与背景保持难兼顾的问题,论文指出文本条件的精确度会改变扩散速度场几何与跨分支注意力一致性。SimEdit通过细化条件并按token区分编辑相关/结构保持成分进行非对称注意力控制,在无需训练的情况下,于PIE-Bench上提升反演重建质量和编辑保真度;但注意力作用时间段仍需手动选择。

Naive Visual Memory is Not Enough: A Failure-Mode Study of GUI Agents Figure 1
2026-06-15cs.MA

Naive Visual Memory is Not Enough: A Failure-Mode Study of GUI Agents

Seoyoung Choi, Minseok Ko, Hyunseok Lee, Kunwoong Kim, Woomin Song, Chanseok Jeon, Jinwoo Shin

2026-06-15视觉感知

论文针对 GUI 智能体引入视觉记忆后效果不清的问题,先将失败归纳为认知失败、视觉状态误解、隐藏操作盲区和定位错误四类,发现整屏截图记忆虽能缓解状态识别错误,却会加重隐藏操作和坐标定位问题。作者提出 AGMem,只保存与成功动作或恢复相关的局部截图并按状态检索;在 OSWorld 上相对整屏视觉记忆将任务成功率提高 33.3%,GPT-5.4-mini 设置下还带来约 6.8 个百分点增益。

A New Multi-Domain Benchmark for Micro-Action Recognition and Detection Figure 1
2026-06-15cs.CV

A New Multi-Domain Benchmark for Micro-Action Recognition and Detection

Yanbin Hao, Pengyu Liu, Xing Wei, Xun Yang, Dan Gu, Meng Wang

2026-06-15视觉感知数据集/基准

针对既有 MA-52 在受控场景、类别规模和评测协议上的局限,本文构建多域微动作基准 MMA-82,将类别扩展到82类,并覆盖实验室、街访、精神健康访谈和情绪电视视频,支持识别与多标签检测及跨域、少样本、零样本评测。实验显示现有方法在域迁移、长尾类别和时间定位上仍明显不足;情绪分析还表明微动作可补充面部微表情,但提升可能主要来自更大规模与多源数据。

FEMOT: Multi-Object Tracking using Frame and Event Cameras Figure 1
2026-06-15cs.CV

FEMOT: Multi-Object Tracking using Frame and Event Cameras

Shiao Wang, Xiao Wang, Chao Wang, Yitao Li, Menghao Liu, Bo Jiang, Yaowei Wang, Yonghong Tian, Jin Tang

2026-06-15视觉感知

该文针对RGB多目标跟踪在低照、过曝、运动模糊等真实场景中易失效且RGB-事件MOT缺少大规模标注基准的问题,构建FEMOT数据集,含100段序列、20万帧、1.458万轨迹和42万框,并覆盖14类挑战;同时提出FEMOTR,将RGB低频外观语义与事件高频运动轮廓在频域解耦融合。作者在FEMOT和DSEC-MOT上重训评测十余种跟踪器,实验显示该频率感知多模态框架优于强基线,但部分增益可能也来自更匹配的数据与训练设置。

Clay-CNN Hybrids: Leveraging Geo-Foundational Models as Auxiliary Context for Landslide Detection Figure 1
2026-06-15cs.CV

Clay-CNN Hybrids: Leveraging Geo-Foundational Models as Auxiliary Context for Landslide Detection

Huong Binh Vu

B. Vu was with Harvard University, Cambridge, MA 02138 USA

2026-06-15视觉感知

面向灾后滑坡快速制图中标注稀缺、滑坡像素仅约2%且与裸土光谱相近的问题,论文比较将地理基础模型 Clay v1.5 作为主编码器、作为 U-Net 瓶颈辅助语义,以及纯 U-Net 三种方案。核心洞察是 Clay 单独替代 CNN 会因缺少多尺度跳连而变差,但作为上下文注入可补足光谱泛化能力;两阶段 LoRA 的 U-Net+Clay 在 L4S 上取得64.5±1.8% F1,高于 U-Net 59.9% 和 Clay-only 55.2±3.6%。

Diffusion-Refined Segmentation and Vision-Language Interpretation for Pediatric Brain Tumor MRI Figure 1
2026-06-15cs.CV

Diffusion-Refined Segmentation and Vision-Language Interpretation for Pediatric Brain Tumor MRI

Wentao Ke, Jianche Liu

Department of Mechanical Engineering, Stanford University, School of Medicine

2026-06-15视觉语言视觉感知生成模型

针对儿科脑肿瘤 MRI 标注稀缺、亚区类别不平衡和弥散边界难分的问题,论文采用先由 3D Res U-Net/Swin-UNETR 生成粗分割、再以粗掩码条件化 3D DDPM 与 MedSegDiff 进行扩散细化的两阶段框架,并把体积与叠加图交给多模态语言模型生成放射报告。结果显示条件化扩散提升稳定性和边界质量,MedSegDiff 的 HD95 最低,尤其改善增强肿瘤边界分割。

ShearFuse-UNet: Hadamard, DCT, and Shearlet Transform Fusion for Next-Day Wildfire Spread Prediction Figure 1
2026-06-15cs.CV

ShearFuse-UNet: Hadamard, DCT, and Shearlet Transform Fusion for Next-Day Wildfire Spread Prediction

Ene Meco, Yingyi Luo, Emadeldeen Hamdan, Adam Watts, Ahmet Enis Cetin

under Award No. 2531376. 1 E. Meco, Y. Luo, E. Hamdan and A. E. Cetin are with the Department of Electrical, and Computer Engineering, University of Illinois Chicago, Chicago, IL 60607 USA

2026-06-15强化学习

面向多模态卫星数据的次日野火蔓延分割,论文关注现有 U-Net/模拟器在非线性环境因素和计算成本上的不足。ShearFuse-UNet 在轻量 U-Net 编码器中融合 WHT、DCT 与 Shearlet 三类固定变换,用门控融合谱表示并以方向性残差刻画火线边缘。其在 WildfireSpreadTS 上以 26.7 万参数取得 F1=0.596、IoU=0.424,略高于 1400 万参数 ResNet18-U-Net,Google 数据集也显示可迁移性。

FoleyGenEx: Unified Video-to-Audio Generation with Multi-Modal Control, Temporal Alignment, and Semantic Precision Figure 1
2026-06-15cs.SD

FoleyGenEx: Unified Video-to-Audio Generation with Multi-Modal Control, Temporal Alignment, and Semantic Precision

Shiyao Wang, Xijuan Zeng, Hui Wang, Shiwan Zhao, Feng Deng, Chen Zhang, Yong Qin

Academy for Advanced Interdisciplinary Studies, Nankai University, Tianjin, China

2026-06-15视觉感知规划控制

针对现有视频生音频方法在时间同步、多模态控制与细粒度语义之间难以兼顾的问题,FoleyGenEx 基于 MMDiT 引入参考音频条件注入、多模态动态遮蔽和副词增强数据,支持 VTA、文本/音频控制与 Foley 扩展。AudioCaps、VGGSound、Greatest Hits 实验显示其在同步、可控性和语义指标上具竞争力,但具体增益仍可能部分来自数据增强。

WAM4D: Fast 4D World Action Model via Spatial Register Tokens Figure 1
2026-06-15cs.CV

WAM4D: Fast 4D World Action Model via Spatial Register Tokens

Ying Li, Xiaobao Wei, Jiajun Cao, Hao Wang, Xiaowei Chi, Chengyu Bai, Qianpu Sun, Jiajun Li, Xiaojie Zhang, Jian Tang, Sirui Han, Shanghang Zhang

2026-06-15强化学习

WAM4D针对现有世界动作模型停留在2D视频/潜空间、难以刻画操作所需3D约束,而显式预测 dense 4D 又拖慢推理的问题,提出用空间register token在训练期读取未来深度、蒸馏几何基础模型先验,并通过因果混合注意力避免模态间非因果捷径;部署时移除几何分支,保持轻量观测到动作接口。在RoboTwin 2.0和真实长程操作中,模型提升空间一致性和成功率,同时维持较高推理效率。

Rethinking One-Step Image Editing through ChordEdit: Reproduction, Simplification, and New Insights Figure 1
2026-06-15cs.CV

Rethinking One-Step Image Editing through ChordEdit: Reproduction, Simplification, and New Insights

Minghan Li, Jeremy Moebel, Mengyu Wang

Harvard AI and Robotics Lab

2026-06-15视觉感知

本文针对一步文本引导图像编辑虽高效但机制不清的问题,复现并重析 ChordEdit。核心洞察是 chord window δ 很大程度等价于把编辑时刻从 t 移到 t−δ,增益主要来自合适 timestep 而非完整 chord 传输;其过程可分解为高噪声下的低频语义迁移与低噪声近端细化。复现实验显示 chord 传输更稳定提升保真但语义增益不一致,近端细化则稳定增强编辑语义但略损背景保持。

Toward 360-Degree Indoor Panorama Editing via Tuning-Free Diffusion Model with Refocusing Cross-Attention Figure 1
2026-06-15cs.CV

Toward 360-Degree Indoor Panorama Editing via Tuning-Free Diffusion Model with Refocusing Cross-Attention

Dinh-Khoi Vo, Nhut-Thanh Le-Hinh, Viet-Tham Huynh, Tam V. Nguyen, Minh-Triet Tran, Trung-Nghia Le

2026-06-15生成模型

针对零样本文本引导扩散编辑在小目标、多物体室内场景中易受提示影响、编辑外溢且破坏背景的问题,论文提出 FocusDiff:先由分割或手选确定目标区域,再通过对非编辑区选择性模糊来重聚焦交叉注意力,并结合上下文保持模块稳定背景。其扩展到 360 度全景编辑,在 LIMB 基准上相较现有零样本方法取得更好的文本对齐、背景保真和真实感。

GarmentSketch: Large-scale Sketch-to-Fashion Benchmark Figure 1
2026-06-15cs.CV

GarmentSketch: Large-scale Sketch-to-Fashion Benchmark

Duong-Duy-Khang Bui, Minh-Tan Pham, Tam V. Nguyen, Minh-Triet Tran, Trung-Nghia Le

2026-06-15数据集/基准

面向时尚设计中从草图生成成衣图像的需求,论文指出现有模型缺少大规模高质量草图—语义资源,难以保留廓形、垂坠和装饰细节。GarmentSketch构建了26,249个覆盖21类服装的草图—丰富文本描述数据集,并用多MLLM加人工校验生成标注;作者还评测多种扩散和多模态生成模型,给出基线并显示当前方法虽有潜力,但在设计意图与细粒度结构保持上仍明显受限。

ViT-Up: Faithful Feature Upsampling for Vision Transformers Figure 1
2026-06-15cs.CV

ViT-Up: Faithful Feature Upsampling for Vision Transformers

Krispin Wandel, Jingchuan Wang, Hesheng Wang

K. Wandel, J. Wang, and H. Wang are with Shanghai Jiao Tong University, Shanghai, China. Corresponding author: Hesheng Wang.

2026-06-15视觉感知

ViT低分辨率token网格限制分割、深度等密集预测,现有图像引导上采样又易因浅层编码器产生特征泄漏和模糊。ViT-Up将上采样改为坐标条件的隐式特征解码,直接利用ViT中间层逐层构造查询并保持特征空间对齐。实验显示其在Cityscapes、COCO深度和SPair-71k上优于NAF、UPLiFT等方法,DINOv3-B下增益扩大到+3.36 mIoU和+8.09 PCK@0.10。

RT-VLA: Real-Time Vision-Language-Action Models via Knowledge Distillation Figure 1
2026-06-15cs.CV

RT-VLA: Real-Time Vision-Language-Action Models via Knowledge Distillation

Xiangyu Huang, Zhenlin Hua, Han Zhou, Shounak Sural, Ragunathan Rajkumar

Carnegie Mellon University

2026-06-15视觉语言视觉感知

面向端到端自动驾驶中 VLA 模型因大视觉语言骨干和自回归推理导致难以实时部署的问题,RT-VLA 将 SimLingo 教师的驾驶与语言能力蒸馏到轻量学生,通过视觉特征、查询表示、路点预测和语言 logits 的多层监督,并把解释性语言分析后置到离线安全片段。Bench2Drive 上其闭环驾驶和语言推理接近教师,视觉模式推理提速 44.8 倍,视觉+语言模式提速 7.9 倍。

HARBOR: Heading Analysis and Reconstruction from Behavioral Observation and Radar Figure 1
2026-06-15cs.CV

HARBOR: Heading Analysis and Reconstruction from Behavioral Observation and Radar

Joao P. A. Dantas, Paulo F. Silva Filho, Jelton A. Cunha, Gabriel Dietzsch

Joao P. A. Dantas 1 1 1 Researcher, C4ISR Division, Institute for Advanced Studies (IEAv)., Paulo F. Silva Filho 2 2 2 Researcher, C4ISR Division, Institute for Advanced Studies (IEAv)., Jelton A. Cunha 3 3 3 Researcher, C4ISR Division, Institute for Advanced Studies (IEAv)., and Gabriel Dietzsch 4 4 4 Researcher, C4ISR Division, Institute for Advanced Studies (IEAv).

2026-06-15三维

针对AIS缺失、欺骗或卫星重访不足时单幅SAR只能给出静态船位的问题,HARBOR将离线AIS统计与在线SAR图像分析解耦:先做预处理、船舶检测、按尺寸分类,并用骨架几何和局部强度估计艏艉方向,再按船型速度与角度分布生成未来位置概率热图。在巴西南部COSMO-SkyMed实景案例中,该流程能给出船舶运动趋势和候选位置投影,但文中主要是案例展示,定量增益未充分说明。

Context-Guided Semantic Alignment for Feature Fusion Networks Figure 1
2026-06-15cs.CV

Context-Guided Semantic Alignment for Feature Fusion Networks

Hyungseop Lee, Jiho Lee, Woochul Kang

2026-06-15视觉感知

该文针对目标检测特征金字塔中高层语义强、低层定位细但直接融合会产生语义不一致的问题,提出可插拔的 FINE 模块:先用高层上下文通过跨层注意力调制低层特征,并以 Alignment-Aware Token Sampling 对齐跨尺度区域、降低注意力开销。COCO 实验显示其可在多种检测器上以很小推理代价提升精度,主要减少背景误检,并改善小目标检测。

Prompt2Effect: Training-Free Image-to-Video Model Specialization via LoRA Generation Figure 1
2026-06-15cs.CV

Prompt2Effect: Training-Free Image-to-Video Model Specialization via LoRA Generation

Xiaomeng Yang, Yanyu Li, Gordon Guocheng Qian, Ivan Skorokhodov, Viacheslav Ivanov, Avalon Vinella, Xuan Zhang, Yanzhi Wang, Sergey Tulyakov, Anil Kag

Work done during internship at Snap Inc.

2026-06-15视觉感知

面向图像到视频生成中“每个特效都要重新训练 LoRA”的高成本问题,Prompt2Effect把特效描述转化为一次前向生成的LoRA权重。关键在于让超网络同时读取冻结基模型权重,并用SVD规范化LoRA因子消除分解歧义,从而稳定预测大规模I2V适配器。实验称其质量和特效对齐可比或优于常规微调,单特效成本由56 GPU小时降至3.3秒,且可作为初始化带来约10倍加速。

CaricHarmony: Contrastive Diffusion Paths for Identity-Preserving Caricature Synthesis Figure 1
2026-06-15cs.CV

CaricHarmony: Contrastive Diffusion Paths for Identity-Preserving Caricature Synthesis

Dongyu Wang, Dar-Yen Chen, Yi-Zhe Song

SketchX, CVSSP, University of Surrey

2026-06-15生成模型

本文针对草图驱动夸张肖像中“保身份”与“跟形变”相互干扰的问题,指出其根源是扩散去噪中的条件信号污染。CaricHarmony在推理时并行维护纯身份、纯形状与融合三条扩散路径,并用跨注意力特征上的形状与身份能量函数进行梯度引导,无需训练或逐身份微调。实验显示其可接受任意草图格式,约16秒生成,在形状CLIP分数、审美指标和用户偏好上优于DemoCaricature、CaricatureBooth等基线,同时保持相近身份一致性。

High-Fidelity Video Compression based on Invertible Neural Transform and Implicit Conditioning Figure 1
2026-06-15eess.IV

High-Fidelity Video Compression based on Invertible Neural Transform and Implicit Conditioning

Siyue Teng, Ho Man Kwan, Yuxuan Jiang, Fan Zhang, David Bull

Visual Information Lab, University of Bristol, UK

2026-06-15视觉感知

针对现有神经视频编码在高质量区间受非可逆变换近似误差限制、难以覆盖宽码率范围的问题,InnVC在量化前保留可逆主变换路径,并用紧凑隐式条件场注入内容自适应时空上下文,再通过调度式通道掩码提升熵编码效率。UVG和MCL-JCV实验显示其在高保真区间优势明显,相对x265在UVG上PSNR BD-rate降低21.66%、MS-SSIM降低46.06%,且单一架构覆盖超过20 dB PSNR范围。

Self-Evolving Visual Questioner Figure 1
2026-06-15cs.CV

Self-Evolving Visual Questioner

Yijun Liang, Hengguang Zhou, Ming Li, Lichen Li, Cho-Jui Hsieh, Tianyi Zhou

University of Maryland, College Park, University of California, Los Angeles, Peking University

2026-06-15视觉感知

论文针对VLM长期被训练成“被动答题者”、缺乏主动提出视觉扎根且有推理价值问题的能力,提出无需人工标注或外部教师的自进化视觉提问框架:模型在多种视觉意图下生成问题,再经重写、过滤与QA/QG双格式训练迭代提升。实验显示两轮后问题生成评分相对基座提升约82%,问题更具多样性、感知难度和推理性,同时VQA能力基本保持甚至部分提升。

GMN4AD: Graph Matching Network for Alzheimer's Disease Diagnosis with Test-Time Domain Adaptation using Multi-centered Structure Magnetic Resonance Imaging Figure 1
2026-06-15eess.IV

GMN4AD: Graph Matching Network for Alzheimer's Disease Diagnosis with Test-Time Domain Adaptation using Multi-centered Structure Magnetic Resonance Imaging

Chen Zhao, Huan Huang, Yixin Xie, Jiajing Huang, Weihua Zhou, Nandakumar Narayanan

using Multi-centered Structure Magnetic Resonance Imaging, . Department of Computer Science, Kennesaw State University, Marietta, GA, 30060, . Department of Information Technology, Kennesaw State University, Marietta, GA, 30060, . School of Data Science and Analytics, Kennesaw State University, Marietta, GA, 30060, . Department of Applied Computing, Michigan Technological University, Houghton, MI, 49931, USA, . Department of Neurology, University of Iowa, Iowa City, IA, 52242

2026-06-15视觉感知

针对多中心结构 MRI 中扫描协议、站点与个体差异导致脑图异质、传统 GNN 泛化受限的问题,GMN4AD 不再独立编码单个脑图,而是通过图匹配建模患者脑图间关系,并在测试时用对比学习与图重建无标签自适应。ADNI、AIBL、OASIS3 上多项 AD/MCI/CN 分类优于对比方法,AD vs CN 在 ADNI/AIBL 准确率约 0.92,但 OASIS3 指标波动显示跨中心鲁棒性仍有限。

Overhead Wildlife Locator (OWL): Benchmarking Weakly Supervised Learning for Aerial Wildlife Surveys Figure 1
2026-06-15cs.CV

Overhead Wildlife Locator (OWL): Benchmarking Weakly Supervised Learning for Aerial Wildlife Surveys

Isai Daniel Chacón, Zhongqi Miao, Bruno Demuro, Caleb Robinson, Rahul Dodhia, Lasha Otarashvili, Jason Holmberg, Kirk Larsen, Howard Frederick, Nathan J. Pamperin, Pablo Arbeláez, Juan M. Lavista Ferres

2026-06-15数据集/基准

针对航拍野生动物普查中框标注成本高、点标注更易规模化的问题,论文提出弱监督密度估计框架 OWL,并比较 CNN、Swin 混合与冻结 DINOv3 基础模型三种变体。结果显示 OWL-D 在多数公开数据集取得最高 AP,并在 Delplanque 上超过 HerdNet;但极高密度场景由 OWL-T/OWL-C 更稳,说明最佳架构依赖调查密度与场景类型。

PMOF: A Dataset and Benchmark for Passenger Monitoring Using Overhead Fisheye Cameras Figure 1
2026-06-15cs.CV

PMOF: A Dataset and Benchmark for Passenger Monitoring Using Overhead Fisheye Cameras

Stella Katharina Wermuth, Qazi Arbab Ahmed, Klaus Neumann, Thorsten Jungeblut

2026-06-15数据集/基准

面向无人值守公共交通,车厢内监控受运动、光照变化、遮挡和鱼眼畸变影响,而现有公开顶视鱼眼数据多来自静态场景。PMOF首次提供移动车辆内顶置鱼眼数据,含1.97万帧、旋转框、跟踪ID和动作标签,并用YOLO26m-obb建立检测基准;结合静态鱼眼数据与旋转感知增强后,在PMOF上达94.8% AP50,在外部HABBOF上达96.5% AP50,显示其主要价值在于补足动态车厢域差并提升跨域泛化。

HiLo-Token: Input-Adaptive High-Low Frequency Token Compression for Efficient Image Editing Figure 1
2026-06-15cs.CV

HiLo-Token: Input-Adaptive High-Low Frequency Token Compression for Efficient Image Editing

Haoran You, Yotam Nitzan, Lingzhi Zhang, Yifan Gong, Mang-Tik Chiu, Connelly Barnes, Yan Kang, Yuqian Zhou, Eli Shechtman, Sohrab Amirghodsi

Adobe ART AI Lab

2026-06-15视觉感知

面向 Photoshop 等交互式图像编辑中 DiT 推理占主要延迟、服务成本高的问题,HiLo-Token 利用用户掩码与图像频率差异做输入自适应 token 压缩:掩码膨胀区保留完整 token,区外用 Sobel/池化选择高频细节,并以 16× 下采样 token 承载低频全局结构。生产级样本上,在小/中/大掩码比例下分别获得 3.13×、2.59×、1.67× DiT 加速,报告无生成质量回退。

How do Self-Supervised Remote Sensing Vision Models Transfer to Downstream Tasks? Figure 1
2026-06-15cs.CV

How do Self-Supervised Remote Sensing Vision Models Transfer to Downstream Tasks?

Julia Romero, Qin Lv, Morteza Karimzadeh

University of Colorado Boulder, University of Colorado Boulder Boulder CO USA

2026-06-15视觉感知

针对遥感自监督基础模型在不同下游任务中排名不稳定、难以解释的问题,本文系统比较六类 GeoFM 在分类、回归和分割中的迁移,并用逐层探针与 CKA 分析表征组织方式。结果显示,中间层常比最终嵌入更含任务信息,分割性能受解码器和微调策略影响可与模型选择相当,微调变化主要局限于 ViT 块 MLP 首个线性层,提示评测与适配需更关注表征深度结构。

Gefen: Optimized Stochastic Optimizer Figure 1
2026-06-15cs.LG

Gefen: Optimized Stochastic Optimizer

Nadav Benedek, Tomer Koren, Ohad Fried

Reichman University, Tel Aviv University, Google Research

2026-06-15视觉感知

针对 AdamW 在大模型训练中需为一、二阶动量额外保存约两份参数状态、限制显存和吞吐的问题,Gefen 的核心思路是用初始平方梯度自动推断参数块,共享二阶矩,并用动态规划学习码本量化一阶矩;其理论洞察是 Hessian 强耦合参数的平方梯度比例会趋近。实验显示其在多种模型与 FSDP/DDP 设置下保持 AdamW 级性能,同时将优化器内存约降至 1/8,并因可用更大 microbatch 提升吞吐。

PhysVLA: Towards Physically-Grounded VLA for Embodied Robotic Manipulation Figure 1
2026-06-15cs.RO

PhysVLA: Towards Physically-Grounded VLA for Embodied Robotic Manipulation

Namai Chandra, Shriram Damodaran, Lin Wang

EmPACT Lab, Nanyang Technological University

2026-06-15机器人

论文针对VLA只拟合示教、缺少刚体动力学与接触约束导致动作物理不一致的问题,提出无需重训的推理时外接模块PhysVLA:用任务阶段有限状态机划分接近、抓取、搬运、放置,并以选择性Euler-Lagrange门控只在检测到动力学残差时修正动作。在LIBERO-Spatial上跨四类VLA最高提升17个百分点成功率、19个百分点稳定性,轨迹效率提升至15%,并在真实Agilex Piper抓放中显示可迁移增益。

Avatar V: Scaling Video-Reference Avatar Video Generation Figure 1
2026-06-15cs.CV

Avatar V: Scaling Video-Reference Avatar Video Generation

Benjamin Liang, Ce Chen, Desmond Lin, Ivan Somov, Jiajun Zhao, Jiewei Yuan, Jingfeng Zhang, Junhao Huang, Nik Nolte, Pedram Haqiqi, Penghan Wang, Rong Yan, Rui Zhang, Sam Prokopchuk, Sivan Wang, Viktor Goriachko, Yi Ren, Yuanming Li, Yutao Chen, Zhenhui Ye, Zhibin Hong, Zilong Nie, Zujin Guo

2026-06-15视觉感知

本文针对单图驱动数字人难以保持身份细节、说话节奏和微表情的问题,将个性建模改为直接以参考视频 token 条件化。核心做法包括线性复杂度的 Sparse Reference Attention、运动表征闭环建模和身份感知超分,并配合大规模视频数据与多阶段训练。作者称可生成无限时长 1080p 头像视频,在身份保持、唇同步和主观评价上优于 Seedance、Kling、Veo、OmniHuman 等;但增益可能主要来自 scaling / data。

Mirage Probes: How Vision Models Fake Visual Understanding Figure 1
2026-06-15cs.CV

Mirage Probes: How Vision Models Fake Visual Understanding

Daniel Ben-Levi, Judah Goldfeder, Weiliang Zhao, Raz Lapid, Amit LeVi, Allen G. Roush, Ravid Shwartz-Ziv, Hod Lipson

Daniel Ben-Levi 1 Judah Goldfeder 1 Weiliang Zhao 1 Raz Lapid 2 Amit LeVi 3 Allen G Roush 4 Ravid Shwartz-Ziv 5 Hod Lipson 1 1 Columbia University, New York University

2026-06-15视觉感知

针对VLM在无图时仍能自信回答图像问题、导致基准分数虚高的问题,论文提出Mirage Probes,用改写问题构造对比探针并分析内部激活。结果显示“海市蜃楼”行为可在残差流、MLP、注意力等位置被线性解码,且非简单文本表面特征;作者进一步指出其可能包含文本偏置与伪视觉表征两类机制,因而仅清洗文本分布不足以保证视觉扎根。

Temporal Backtracking Search for Test-time Generative Video Reasoning Figure 1
2026-06-15cs.CV

Temporal Backtracking Search for Test-time Generative Video Reasoning

Sejoon Jun, Zheng Ding, Huangyuan Su, Weirui Ye, Yilun Du

Northeastern University, 2 Independent Researcher, 3 Harvard & Kempner, 4 MIT

2026-06-15视觉感知生成模型

这篇论文针对生成视频作为世界模型进行长时序推理时的一次性采样瓶颈:错误常在时间早期出现,而扩散去噪早期已决定轨迹,后续加算力难以纠偏。作者提出 Temporal Backtracking Search,将测试时搜索从去噪轴转到时间轴,通过可变前缀条件生成、过程验证定位失败帧,并从已验证前缀重启。其在算法、导航和机器人任务中以相同预算优于 BoN,OOD 场景从 0.7% 提升到 22.7%。

Multi-Agent Embodied Autonomous Driving: From V2X Information Exchange to Shared World Models Figure 1
2026-06-15cs.RO

Multi-Agent Embodied Autonomous Driving: From V2X Information Exchange to Shared World Models

Senkang Hu, Zhengru Fang, Yihang Tao, Zihan Fang, Sam Tak Wu Kwong, Yuguang Fang

everything (V2X) communication, collaborative perception, inter-, Index Terms—Autonomous driving, collaborative perception, torically centered on robust, self-contained vehicles that, collaborative intent, and react too late in tightly coupled traffic., toward collaborative autonomy., Lab of Smart City funded by The Hong Kong Jockey Club Charities Trust, Department, University, Sam Tak Wu Kwong is with Lingnan University, Hong Kong. (Email:, of sight and led to collaborative perception (CP) methods based, including collaborative perception, shared world modeling, Surveys collaborative machine learning enabled by

2026-06-15强化学习

面向单车智能在遮挡、部分可观测和密集交互中易失效的问题,本文综述多智能体具身自动驾驶从 V2X 信息交换走向共享世界模型的脉络,核心洞察是协作不应止于传感数据融合,而需维护跨车辆、路侧与交通参与者的预测性共享状态,并支撑意图对齐和联合规划。文中梳理 380 余篇工作,指出现有结果多停留在仿真、离线基准和精选场景,基础模型协同仍缺少开放交通中的实时安全验证。

Explaining RhythmFormer: A Systematic XAI Analysis of Periodic Sparse Attention for Remote Photoplethysmography Figure 1
2026-06-15cs.CV

Explaining RhythmFormer: A Systematic XAI Analysis of Periodic Sparse Attention for Remote Photoplethysmography

Louis Chen, Torbjörn E. M. Nordling

Department of Mechanical Engineering, National Cheng Kung University, Tainan, Taiwan.

2026-06-15视觉感知

本文针对 rPPG Transformer 虽能降低心率误差但解释性不足的问题,系统分析 RhythmFormer 的周期稀疏注意力。核心做法是将 raw attention、rollout、flow 与 Beyond Intuition 适配到 top-k 双层路由注意力,并提出皮肤覆盖率与面向回归的 SaCo 忠实度指标。实验显示 rollout/flow 会产生多跳泄漏、几乎恢复被稀疏层置零的连接,而 Beyond Intuition 在 UBFC-rPPG 上取得最高皮肤覆盖率 0.83 和忠实度 F=0.92,但跨数据集与模型验证仍不足。

Compressing Image Style Training into a Single Model Forward Figure 1
2026-06-15cs.CV

Compressing Image Style Training into a Single Model Forward

Zhongjie Duan, Yingda Chen

2026-06-15视觉感知

针对扩散风格迁移中适配器快但风格弱、LoRA保真却需逐风格训练的问题,论文提出 i2L:用图像编码器、可学习 LoRA 查询和压缩解码头,将一张或多张参考图直接预测为文本到图像模型的 LoRA 权重。该方法把风格内化为显式权重更新,在 Z-Image、FLUX.2、Hidream-O1 上提升风格一致性、提示对齐和感知质量,并支持非对称 CFG、多参考融合及与可控生成模块组合。

$μ_0$: A Scalable 3D Interaction-Trace World Model Figure 1
2026-06-15cs.RO

$μ_0$: A Scalable 3D Interaction-Trace World Model

Seungjae Lee, Yoonkyo Jung, Jusuk Lee, Jonghun Shin, Amir Hossein Shahidzadeh, Yao-Chih Lee, H. Jin Kim, Jia-Bin Huang, Furong Huang

University of Maryland, College Park, Seoul National University

2026-06-15强化学习三维

针对机器人学习中视频数据丰富但动作标注稀缺且依赖具体本体的问题,μ0主张用物体、工具、手和接触区域的3D交互轨迹替代像素预测或直接动作建模。其TraceExtract从异构视频自动抽取全局对齐、带事件语言标注的轨迹,并用VLM加Trace Expert预测B样条轨迹。实验显示其2D/3D轨迹预测优于基线,冻结后接动作专家在RoboCasa365和UR3任务上可接近或超过带动作预训练的VLA。

CineOrchestra: Unified Entity-Centric Conditioning for Cinematic Video Generation Figure 1
2026-06-15cs.CV

CineOrchestra: Unified Entity-Centric Conditioning for Cinematic Video Generation

Sharath Girish, Tsai-Shien Chen, Zhikang Dong, Mukesh Singhal, Hao Chen, Sergey Tulyakov, Aliaksandr Siarohin

Snap Inc.

2026-06-15视觉感知

电影级视频生成需要同时控制多主体身份、事件时序、镜头运动与转场,现有方法多按单一轴线处理。CineOrchestra将这些元素统一为带时间区间的“实体”条件,并用区间采样 temporal RoPE 与二维实体-时间 cross-attention RoPE解决长短事件和多实体路由问题。在 CineBench/CineBenchSyn 上,相比六类专项基线,在密集描述遵循和转场时机上更优,用户研究与消融也支持其设计。

Connections Between Pairs of Filters Improve the Accuracy of Convolutional Neural Networks Figure 1
2026-06-15cs.CV

Connections Between Pairs of Filters Improve the Accuracy of Convolutional Neural Networks

Kathleen Anderson, Philipp Grüning, Erhardt Barth

2026-06-15视觉感知

本文针对传统 CNN 依赖逐点非线性、难以表达滤波器间选择性关系的问题,提出在两个并行深度卷积输出之间加入更通用的连接块,并引入可学习参数化 XOR/OR/AND 式连接,使不同层可自适应选择保留或抑制信息。实验显示,在参数量相近下替换部分卷积块可提升小型 SOTA 网络在 CIFAR-10 上的准确率,其中参数化连接优于简单求和和固定 AND 连接。

Morphology-Aware Sample Assignment: Overcoming IoU Insensitivity for Surface Defect Detection Figure 1
2026-06-15cs.CV

Morphology-Aware Sample Assignment: Overcoming IoU Insensitivity for Surface Defect Detection

Pengfei Liu, Yuhan Guo

Key Lab of Ultra-precision Intelligent Instrumentation, (School of Instrumentation, Science and Engineering, Harbin Institute of Technology), Ministry of Industry and, School of Management, Harbin Institute of Technology, Harbin 150001, China, College of Computing and Data Science, Nanyang Technological University

2026-06-15视觉感知

针对工业表面缺陷检测中仅靠 IoU 分配正样本会出现“非敏感区”、难以区分几何差异相近候选框的问题,论文提出 MCC 形态感知样本分配,用面积、形状和长宽比相似度补充匹配分数,使高响应区域更集中且无需推理开销。基于 YOLOv9 在 GC10-DET 与 NEUDET 上均有稳定提升,如 NEUDET 多个 YOLOv9 模型 mAP 约提升 0.9–1.2 个百分点,GC10-DET 横向比较达到 74.2% mAP。

TSA: Temporal Slot Activation for Persistent Object-Centric Video Representation Figure 1
2026-06-15cs.CV

TSA: Temporal Slot Activation for Persistent Object-Centric Video Representation

Duc Nguyen, Sieu Tran, Hao Vo, Khoa Vo, Duy Minh Ho Nguyen, Nghi D. Q. Bui, Anh Nguyen, Long Mai, Ngan Le

University of Arkansas, USA, Max Planck Research School for Intelligent Systems, University of Liverpool, UK

2026-06-15视觉感知

这篇论文针对视频 Slot Attention 在遮挡或目标消失时仍无条件更新、解码所有 slot,导致表示漂移和身份切换的问题,提出 TSA:为每个 slot 学习逐帧激活值,用于门控状态更新和解码注意力,并结合时间记忆判断遮挡与重现。在 MOVi-C/E、YouTube-VIS 和遮挡更重的 OVIS 上,TSA 提升了 FG-ARI、mBO 以及 IDF1、HOTA,尤其改善长视频遮挡场景的身份保持。

Orchestra-o1: Omnimodal Agent Orchestration Figure 1
2026-06-15cs.AI

Orchestra-o1: Omnimodal Agent Orchestration

Fan Zhang, Vireo Zhang, Shengju Qian, Haoxuan Li, Hao Wu, Jinyang Wu, Donghao Zhou, Zhihong Zhu, Zheng Lian, Xin Wang, Pheng-Ann Heng

Tongji University

2026-06-15视觉感知

针对现有多智能体编排多局限于文本或视觉语言、难以处理文本/图像/音频/视频共存任务的问题,Orchestra-o1将高层决策与感知/行动子智能体解耦,通过模态感知任务分解、在线子智能体专长化和并行执行实现全模态协作,并用DA-GRPO对主智能体的逐步委派与工具选择决策进行强化学习对齐。在OmniGAIA上,GPT-5主智能体版本较次优方法高10.3个百分点,开源Orchestra-o1-8B将最佳开源准确率从20.8%提升到30.0%。

C-MambaPose: A Physics-Informed Complex Mamba Framework for Cross-Environment WiFi Human Pose Estimation Figure 1
2026-06-15eess.SP

C-MambaPose: A Physics-Informed Complex Mamba Framework for Cross-Environment WiFi Human Pose Estimation

Phuc Nguyen H

Phuc Nguyen H. is with VinUniversity, Hanoi, Vietnam

2026-06-15三维

该文针对 WiFi 三维人体姿态估计在跨房间场景中易受多径与相位失真影响、泛化差且模型偏大的问题,提出 C-MambaPose:先校正 CSI 相位并保留复值物理关系,再用复值 Mamba 捕获时空相位动态,并以关节查询和 GCN 骨架先验约束输出。MM-Fi 实验显示其在跨环境划分上 MPJPE 降至 298.5 mm,参数量仅 3.78M,较 GraphPose-Fi 和 MetaFi++ 大幅减少且无需预训练。

2026-06-12

99 篇
InterleaveThinker: Reinforcing Agentic Interleaved Generation Figure 1
2026-06-12cs.CV

InterleaveThinker: Reinforcing Agentic Interleaved Generation

Dian Zheng, Harry Lee, Manyuan Zhang, Kaituo Feng, Zoey Guo, Ray Zhang, Hongsheng Li

CUHK MMLab

2026-06-12强化学习

这篇论文针对现有图像生成器只能单图输出、UMM在长序列中易视觉过度依赖和逐步误差累积的问题,提出Planner-Generator-Critic多智能体框架,为冻结生成器赋予文本-图像交错生成能力。其关键在于先全局规划,再由Critic逐步评估并改写提示,并用SFT数据和GRPO的单步双奖励训练降低长轨迹优化成本。实验显示该方法可提升多种生成器,在交错生成上接近Nano Banana和GPT-5,并将FLUX.2-klein的WISE从0.47提升到0.73、RISE从13.3提升到28.9。

Mana: Dexterous Manipulation of Articulated Tools Figure 1
2026-06-12cs.RO

Mana: Dexterous Manipulation of Articulated Tools

Zhao-Heng Yin, Guanya Shi, Pieter Abbeel, C. Karen Liu

Stanford University 3 {}^{\text{3}}

2026-06-12机器人

针对多指手使用钳子、镊子、注射器等铰接工具时需同时稳定抓握与施加精确驱动力、遥操作和端到端 RL 都难以获得数据的问题,Mana 将操作重写为“动画补间”:少量点击标注功能区域后生成抓握关键帧,用运动规划连接几何阶段、用 RL 处理短程接触阶段,并训练点云条件扩散策略。其在 Allegro 手上对四类工具实现仿真数据训练后的零样本实机抓取与在手驱动,报告成功率较高;但完整任务链仍含腕部遥操作,完全自主性文中未充分说明。

Modality Forcing for Scalable Spatial Generation Figure 1
2026-06-12cs.CV

Modality Forcing for Scalable Spatial Generation

Bardienus Pieter Duisterhof, Deva Ramanan, Jeffrey Ichnowski, Justin Johnson, Keunhong Park

Carnegie Mellon University, World Labs

2026-06-12视觉感知

针对3D/深度数据稀缺且现有T2I改造依赖稠密深度、流程复杂的问题,论文提出 Modality Forcing:在单个DiT中为RGB与深度设置独立噪声层级和解码器,用稀疏真实深度进行联合后训练,统一支持图像到深度、深度到图像和文本生成RGB-D。实验显示深度精度随T2I预训练规模提升,最强模型接近专用单目深度方法,并较既有联合RGB-D生成模型降低57% AbsRel,但部分增益可能主要来自scaling/data。

RepWAM: World Action Modeling with Representation Visual-Action Tokenizers Figure 1
2026-06-12cs.CV

RepWAM: World Action Modeling with Representation Visual-Action Tokenizers

Junke Wang, Qihang Zhang, Shuai Yang, Yiming Luo, Yujun Shen, Zuxuan Wu, Yu-Gang Jiang, Yinghao Xu

2026-06-12强化学习

RepWAM针对现有世界动作模型沿用像素重建型视频 tokenizer、语义不足且视觉潜变量与动作割裂的问题,提出将视频自编码潜空间对齐冻结视觉基础模型,并在该语义空间中学习表示状态转移的潜在动作 token,再联合预测未来视觉状态与动作。实机与仿真结果显示其优于或匹配VLA和WAN式WAM基线,在RoboTwin 2.0 Easy/Hard达89.3/88.4,消融支持语义视觉-动作 token 化是主要增益来源。

SpatialClaw: Rethinking Action Interface for Agentic Spatial Reasoning Figure 1
2026-06-12cs.CV

SpatialClaw: Rethinking Action Interface for Agentic Spatial Reasoning

Seokju Cho, Ryo Hachiuma, Abhishek Badki, Hang Su, Byung-Kwan Lee, Chan Hee Song, Sifei Liu, Subhashree Radhakrishnan, Seungryong Kim, Yu-Chiang Frank Wang, Min-Hung Chen

2026-06-12视觉感知

论文指出,VLM 的3D/4D空间推理瓶颈不只在感知工具本身,还在工具调用接口:单次代码执行难以根据中间结果修正,结构化工具调用又限制组合。SpatialClaw 将代码作为可持续交互的动作接口,在持久 Python 内核中逐步调用感知与几何原语、检查可视化结果并迭代推理。其无需训练,在20个空间推理基准上平均准确率达59.9%,较近期空间智能体高11.2个百分点,并在多种VLM骨干上保持增益。

Flex4DHuman: Flexible Multi-view Video Diffusion for 4D Human Reconstruction Figure 1
2026-06-12cs.CV

Flex4DHuman: Flexible Multi-view Video Diffusion for 4D Human Reconstruction

Jen-Hao Cheng, Yipeng Wang, Hao Zhang, Gengshan Yang, Jenq-Neng Hwang

University of Washington, World Labs, scalable 4D content creation from casual monocular videos for simulation, gaming, AR/VR, and video, On zero-shot ActorsHQ, where ground-truth multi-view skeletons are unavailable at inference, our

2026-06-12视觉感知生成模型三维

针对动态人体从单目或稀疏视角重建4D内容时依赖骨架、深度/法线等几何先验且难泛化的问题,Flex4DHuman将Wan 2.1视频扩散改造成多视角生成器,用相对相机位姿的五轴位置编码和三阶段课程学习生成同步密集视角视频,并接入4D Gaussian Splatting。实验在DNA-Rendering和ActorsHQ上超过Diffuman4D、MV-Performer等基线,且可扩展到动物类别。

World Tracing: Generative Pixel-Aligned Geometry Beyond the Visible Figure 1
2026-06-12cs.CV

World Tracing: Generative Pixel-Aligned Geometry Beyond the Visible

Hao Zhang, Mohamed El Banani, Jen-Hao Cheng, Paul Zhang, Yi Hua, Ben Mildenhall, Christoph Lassner, Narendra Ahuja, Gengshan Yang

World Labs, University of Illinois Urbana-Champaign

2026-06-12生成模型强化学习

本文针对单图/视频 3D 方法在“像素对齐但只见表面”和“形状完整但与输入错位”之间的取舍,提出 World Tracing:为每个像素沿相机射线生成多层 3D 点,首层重建可见表面,后续层补全遮挡几何,并用流匹配 DiT、分解/全局注意力和深度填充目标联合训练。实验显示其在物体、场景和动态基准上同时提升可见表面精度与完整几何 Chamfer,并支持文本 3D 编辑、新视角视频和免训练 mesh 集成;部分增益可能来自更大规模训练和 MoGe/DINO 先验。

Surflo: Consistent 3D Surface Flow Model with Global State Figure 1
2026-06-12cs.CV

Surflo: Consistent 3D Surface Flow Model with Global State

Antoine Guédon, Shu Nakamura, Nicolas Dufour, Jiahui Lei, Ko Nishino, Angjoo Kanazawa

Kyoto University

2026-06-12生成模型三维

Surflo针对多视图重建中按视角输出冗余且难融合、全局潜变量又受固定低分辨率限制的问题,主张把无位姿RGB图像压缩为单一全局3D状态。方法用冻结VGGT特征和Perceiver压缩成固定latent,再以flow matching独立生成任意数量带法向表面点,并在ODE推理中加入光度/深度引导抑制局部不一致。实验称其在8个重建基准上达到或超过前馈基线,且较需大量视图的优化法快一个数量级。

Revisiting Vehicle Color Recognition in Long-Tailed Surveillance Scenarios Figure 1
2026-06-12cs.CV

Revisiting Vehicle Color Recognition in Long-Tailed Surveillance Scenarios

Vinícius Orrú, Bruno H. Foggiatto, Gabriel E. Lima, David Menotti, Rayson Laroca

2026-06-12视觉感知

面向监控中车牌不可读且车辆颜色分布长尾的问题,本文强调仅看总体准确率会掩盖稀有颜色失效,并在 UFPR-VeSV 上系统评估少数类合成增强。其核心做法是结合 RunDiffusion 文生图与 Gemini 图像改色,经人工筛选后配合 DINOv3、重加权、颜色安全增强、前景预处理和集成。最佳结果达 94.6% micro、79.7% macro,较既有方法 macro 提升 8.2 个百分点,但错误分析也指出不少剩余样本对人类同样颜色含糊。

Towards Effective Waste Segmentation for Automated Waste Recycling in Cluttered Background Figure 1
2026-06-12cs.CV

Towards Effective Waste Segmentation for Automated Waste Recycling in Cluttered Background

Mamoona Javaid, Mubashir Noman, Abdul Hannan, Shah Nawaz, Mustansar Fiaz, Sajid Ghuffar

2026-06-12视觉感知

面向自动化废品回收中杂乱背景、透明/可变形垃圾难分割且大骨干代价高的问题,论文提出 EWSegNet:先用空间上下文建模局部结构,再在频域用数据相关核捕获全局关系,并以 DoG 与池化注意力的 AFEM 强化边界和块状区域。在 ZeroWaste-aug、ZeroWaste-f、SpectralWaste 上实验表明其在保持较低计算开销的同时提升了分割效果,但具体增益幅度需结合完整表格判断。

EvTexture++: Event-Driven Texture Enhancement for Video Super-Resolution Figure 1
2026-06-12cs.CV

EvTexture++: Event-Driven Texture Enhancement for Video Super-Resolution

Dachun Kai, Jiayao Lu, Yueyi Zhang, Xiaoyan Sun

2026-06-12视觉感知

视频超分在纹理密集区域常因 RGB 帧时间采样不足而过平滑,事件相机虽常被用于运动对齐,但其高频动态细节尚未被充分用于纹理恢复。EvTexture++将事件信号作为显式纹理线索,设计纹理增强分支、迭代纹理增强模块和事件引导的时序纹理对齐,并可作为插件接入现有 VSR 骨干。五个数据集实验显示其达到 SOTA,在 Vid4 上接入 IART 可提升约 1.55 dB PSNR。

Contrast-Informed Augmentation and Domain-Adversarial Training for Adult-to-Neonatal MR Reconstruction Generalization Figure 1
2026-06-12cs.CV

Contrast-Informed Augmentation and Domain-Adversarial Training for Adult-to-Neonatal MR Reconstruction Generalization

Stephen Moore, Lara Leijser, Richard Frayne, Roberto Souza

2026-06-12学习理论三维

针对深度MRI重建从成人数据迁移到新生儿时受对比度、解剖尺度和SNR域移影响的问题,本文在E2E-VarNet中引入面向新生儿特征的对比度增强,并结合域对抗训练以学习更域不变的表示。无需新生儿训练数据,Mixed/Mixed-DAT在R=4、R=8新生儿测试上均优于成人数据基线,R=4下Mixed-DAT达SSIM 0.924、PSNR 33.98 dB,t-SNE也显示潜表示重叠增加。

Edit the Bits, Diff the Codes: Bitwise Residual Editing for Visual Autoregressive Models Figure 1
2026-06-12cs.CV

Edit the Bits, Diff the Codes: Bitwise Residual Editing for Visual Autoregressive Models

Shengqiang Zhang, Ruotong Liao, Volker Tresp, Barbara Plank, Hinrich Schütze

LMU Munich & Munich Center for Machine Learning (MCML)

2026-06-12视觉感知

这篇工作针对 VAR 图像编辑中“改什么”和“写到哪里”难以同时控制的问题,指出 bitwise-residual VAR 的逐比特 Bernoulli 头与多尺度残差码求和结构尚未被利用。BitResEdit 无需训练,用 BitEdit 在逐比特 log-odds 上做带 KL 信任域的源负向引导,再用 ResEdit 将采样变化作为掩码门控残差写回连续码空间。PIE-Bench 上基于 Infinity-2B,相比同骨干既有编辑器在编辑区域 CLIP 提升 1.07,同时背景保持仍具竞争力。

What's Old is New Again: Classical Dimensionality Reduction for Efficient Saliency-Guided Biometric Attack Detection Figure 1
2026-06-12cs.CV

What's Old is New Again: Classical Dimensionality Reduction for Efficient Saliency-Guided Biometric Attack Detection

Samuel Webster, Walter Scheirer

Department of Computer Science and Engineering, University of Notre Dame, IN, USA

2026-06-12视觉感知

针对生物特征呈现攻击检测中显著性引导训练依赖人工标注或领域工具、难以扩展的问题,论文将 PCA/LDA 等经典降维重新用于从原始训练集自动生成逐样本显著图,并接入 CYBORG 类损失训练。实验覆盖虹膜、合成脸、指纹、指静脉和证件 PAD,结果显示该低成本方法普遍优于无显著性基线,在合成脸与指纹任务上还超过既有 SOTA 显著性方案。

MaskWAM: Unifying Mask Prompting and Prediction for World-Action Models Figure 1
2026-06-12cs.CV

MaskWAM: Unifying Mask Prompting and Prediction for World-Action Models

Hanyang Yu, Haitao Lin, Jingbo Zhang, Wenyao Zhang, Chenghao Gu, Heng Li, Ping Tan

2026-06-12强化学习

针对世界-动作模型在杂乱场景中仅靠语言易产生指代歧义、仅预测 RGB 又缺少目标语义约束的问题,MaskWAM 将目标掩码同时作为首帧视觉提示和未来预测目标,用 MoT 统一建模 RGB、掩码与动作,从而把控制关注点锚定到任务物体。实验在 LIBERO、RoboTwin 和真实任务上均优于文本条件 WAM/VLA,报告成功率最高达 98.4%、92.2%,真实歧义任务也有明显提升。

Measurement-Calibrated Multi-Camera Fusion for Vision-Based Indoor Localization Figure 1
2026-06-12cs.CV

Measurement-Calibrated Multi-Camera Fusion for Vision-Based Indoor Localization

Mateo Toro Diz, Jonathan Hoss, Noah Klarmann

Mateo Toro Diz is with Rosenheim Technical University of Applied Sciences

2026-06-12视觉感知

针对室内视觉定位中多相机融合常被当作黑箱、难以判断误差来自检测、单应标定还是融合的问题,论文将流水线拆分评估,并用单相机实测不确定性来标定卡尔曼滤波的测量噪声。实验显示,多相机融合相较单相机能提升定位精度;测量校准对绝对误差增益有限,但明显降低轨迹方差、改善平滑性,更适合需要连续稳定轨迹的实时应用。

Heterogeneous LiDAR Early Fusion and Learned Re-Ranking Strategy for Robust Long-Term Place Recognition in Unstructured Environments Figure 1
2026-06-12cs.CV

Heterogeneous LiDAR Early Fusion and Learned Re-Ranking Strategy for Robust Long-Term Place Recognition in Unstructured Environments

Judith Vilella-Cantos, Juan José Cabrera, Mónica Ballesta, David Valiente, Luis Payá

2026-06-12视觉感知强化学习安全鲁棒

面向葡萄园等非结构化、季节变化和重复纹理强的长期定位场景,论文提出 MinkUNeXt-VINE++:将 Livox Mid-360 与 Velodyne VLP-16 异构 LiDAR 点云做早期融合,并在检索后用轻量学习式重排序修正候选顺序。TEMPO-VINE 实验显示,相比单传感器 Recall@1 有约20%提升,加入重排序后约+30%,并优于多种现有 LPR 方法。

SPARC: Reliable Spatial Annotations from Robot Demonstrations at Scale Figure 1
2026-06-12cs.RO

SPARC: Reliable Spatial Annotations from Robot Demonstrations at Scale

Nils Blank, Paul Mattes, Maximilian Xiling Li, Jakub Suliga, Thomas Roth, Moritz Reuss, Pankhuri Vanjani, Rudolf Lioutikov

Karlsruhe Institute of Technology, Robotics Institute Germany

2026-06-12机器人模仿学习

机器人示教的空间标注常依赖检测器置信度,难判断“是否真被操作”,在杂乱场景会引入高置信错误。SPARC把标注视为可选择预测,利用阶段一致运动、夹爪3D邻近和机器人重叠过滤生成交互感知候选与可靠性分数。IA-Bench上高置信定位准确率80.2%对58.1%,95%精度下保留167k轨迹,并提升物体定位、指向基准和真实杂乱场景策略表现。

Budget-Constrained Step-Level Diffusion Caching Figure 1
2026-06-12cs.CV

Budget-Constrained Step-Level Diffusion Caching

Mingkun Lei, Tong Zhao, Liangyu Yuan, Chi Zhang

2026-06-12生成模型

针对扩散/flow 模型逐步采样开销高、现有缓存方法用阈值在线决策导致延迟不可控且未直接面向最终质量的问题,BudCache 将缓存视为固定 NFE 预算下的离散资源分配,离线用模拟退火结合爬山搜索静态缓存策略,并在低预算下对时间步调度做缓存感知对齐。实验在 FLUX.1-dev 与 Wan2.1 上显示,在相同推理预算下生成质量优于启发式缓存基线,最高报告约 3.73× 加速。

NavWAM: A Navigation World Action Model for Goal-Conditioned Visual Navigation Figure 1
2026-06-12cs.RO

NavWAM: A Navigation World Action Model for Goal-Conditioned Visual Navigation

Daichi Azuma, Taiki Miyanishi, Koya Sakamoto, Shuhei Kurita, Yaonan Zhu, Petr Khrapchenkov, Motoaki Kawanabe, Yusuke Iwasawa, Yutaka Matsuo

The University of Tokyo, National Institute of

2026-06-12机器人强化学习

本文针对目标条件视觉导航中“会预测未来视角但仍需外部规划器选动作”的问题,提出 NavWAM:用扩散 Transformer 将未来观测、目标进展价值和动作片段放入共享潜序列联合去噪,使视觉前瞻直接生成闭环控制。经仿真预训练与真机适配,在离线和真实机器人图像目标导航中优于规划式世界模型基线,且默认模式无需 CEM 搜索,并与更大的直接策略模型保持竞争力。

Point-Wise Geometry-Aware Transformer for Partial-to-Full Point Cloud Registration in Computer-Assisted Surgery Figure 1
2026-06-12cs.CV

Point-Wise Geometry-Aware Transformer for Partial-to-Full Point Cloud Registration in Computer-Assisted Surgery

Siyu Zhou, Zhongliang Jiang

The Chair for Computer Aided Medical Procedures, Technical University of Munich, Munich, Germany., The authors are now affiliated with The University of Hong Kong, Hong Kong SAR, China

2026-06-12三维

面向计算机辅助手术中术中点云只覆盖部分解剖结构、且重叠率/密度/噪声变化导致配准不稳的问题,论文提出 GAPR-Net:在粗到细框架中结合 KPConv 与 Transformer,并用变换不变的点级几何特征作为位置嵌入,通过交叉注意力融合局部与全局信息。四类骨结构实验显示整体配准召回率 94.2%、RMSE 1.992 mm,低重叠和不完整全点云场景下仍较稳健。

Reinforcement Learning for Neural Model Editing Figure 1
2026-06-12cs.LG

Reinforcement Learning for Neural Model Editing

Shaivi Malik

2026-06-12强化学习

针对预训练模型编辑常需为遗忘、去偏等目标手工设计专用算法的问题,论文把权重编辑建模为强化学习:智能体仅根据奖励对单层权重做乘性 MaskWorld 或加性 ShiftWorld 更新,并用类似 LoRA 的低秩动作降低维度。实验覆盖图像分类遗忘和文本分类去偏,遗忘任务将 forget set 准确率降至近 0%、retain set 保持 90% 以上,去偏指标提升超过 5%;但全层扩展性仍文中未充分解决。

VISA: VLM-Guided Instance Semantic Auditing for 3D Occupancy World Models Figure 1
2026-06-12cs.CV

VISA: VLM-Guided Instance Semantic Auditing for 3D Occupancy World Models

Ruiqi Xian, Yuehan Xian, Jing Liang, Xuewei Qi, Dinesh Manocha

University of Maryland College Park, Nanjing University of Posts and Telecommunications, Standford University, Motional AD Inc.

2026-06-12视觉语言强化学习三维

面向自动驾驶/机器人决策中的3D语义占用,论文指出直接用VLM图文嵌入对齐会提升文本相似度却不稳定提升闭集体素mIoU。VISA改将离线VLM作为实例语义审计器,生成类别、混淆、属性与置信度,并沿物体轨迹约束匹配体素,推理无需VLM。nuScenes上OccWorld mIoU从19.06升至20.05,GaussianWorld从21.36升至21.91,物体和稀有类增益更明显。

OmniDirector: General Multi-Shot Camera Cloning without Cross-Paired Data Figure 1
2026-06-12cs.CV

OmniDirector: General Multi-Shot Camera Cloning without Cross-Paired Data

Jiwen Liu, Shujuan Li, Zhixue Fang, Xiaohan Li, Yan Zhou, Zijie Meng, Zhimin Zhang, Yawen Luo, Guoxin Zhang, Yu-Shen Liu, Pengfei Wan

2026-06-12视觉感知

该文针对视频生成中相机运动克隆难以精确控制且多镜头切换支持不足的问题,提出将参考视频相机参数渲染为空场景中的“camera grid”运动视频,以视觉化、解耦的表示替代参数或成对数据依赖,并训练百万级 grid-video 对的 MMDiT 框架 OmniDirector;推理时用分层提示扩展融合镜头、主体与动作。实验显示其在复杂和多镜头相机克隆上优于既有方法,但部分增益可能主要来自 scaling / data。

VietFashion: Benchmarking Sketch-Text Composed Image Retrieval for Cultural Outfits Figure 1
2026-06-12cs.CV

VietFashion: Benchmarking Sketch-Text Composed Image Retrieval for Cultural Outfits

Hoang-Nguyen Cao, Le-Hoang Bui, Dinh-Khoi Vo, Minh-Triet Tran, Trung-Nghia Le

University of Science, Vietnam National University, University of Science Ho Chi Minh City Vietnam, Vietnam National University Ho Chi Minh City Vietnam

2026-06-12视觉感知数据集/基准三维

面向传统服饰数字化与设计检索,现有CIR/SBIR数据多偏西式服装,难表达奥黛的领型、纹样等细粒度文化语义。VietFashion以草图表示结构、文本表示文化属性,结合Qwen-2.5与SANA-ControlNet从650张草图扩展到2.1万余图文样本,并采用每查询多目标标注以贴近设计歧义。基准测试显示现有监督、零样本、草图文本检索方法召回仍低,主要瓶颈在跨草图-照片域对齐和细粒度语义组合,增益可能主要来自数据与评测设定。

Person Identification from Contextual Motion Figure 1
2026-06-12cs.CV

Person Identification from Contextual Motion

Igor Kviatkovsky, Ehud Rivlin, Ilan Shimshoni

I. Kviatkovsky and E. Rivlin are with the Department of Computer Science, Technion – Israel Institute of Technology, Technion City, Haifa 32000, Israel., I. Shimshoni is with the Department of Information Systems, University of Haifa, Carmel Mount, Rabin building, Haifa 31905, Israel.

2026-06-12视觉感知

该文针对人脸不可用、遮挡或隐私受限时的身份识别问题,利用人体运动风格作为生物特征。核心创新是把动作身份识别统一为生成式概率推断,并提出交互式场景:系统按最大互信息主动选择视觉 cue,逐步更新身份后验直到置信度足够。实验在五个公开数据集及含22人、4476段响应的CuedId数据集上报告较高识别率,且多动作组合明显提升精度。

SmartFont: Dynamic Condition Allocation for Few-Shot Font Generation Figure 1
2026-06-12cs.CV

SmartFont: Dynamic Condition Allocation for Few-Shot Font Generation

Zian Yang, Zixin Wang

Fudan University

2026-06-12视觉感知

针对少样本字体生成中全局字形结构与局部笔画风格难以兼顾的问题,SmartFont 将其重新表述为多层条件分配:在扩散骨干上加入弱监督局部专家,通过语义-空间分配定位细节修正,并按去噪时间步与注入模块动态权衡内容、风格和局部特征。实验显示其在复杂字形下提升整体完整性与局部风格保真度,但具体增益幅度需结合完整实验表判断。

MoVerse: Real-Time Video World Modeling with Panoramic Gaussian Scaffold Figure 1
2026-06-12cs.CV

MoVerse: Real-Time Video World Modeling with Panoramic Gaussian Scaffold

Yang Zhou, Ziheng Wang, Yuqin Lu, Haofeng Liu, Jun Liang, Shengfeng He, Jing Li

South China University of Technology 2Columbia University 3Orange Team, Youku Moku-Lab, HUJING, Digital Media & Entertainment Group 4Singapore Management University, world, persistent geometry, controllable camera motion, and temporally coherent high-fidelity observa-, causal autoregressive student for bounded-latency streaming. This design combines the controllability, ∗Work done during an internship at Orange Team, Youku Moku-Lab, HUJING Digital Media & Entertainment Group., complete the missing field of view, convert that completion into a camera-controllable scene representation, a curated set of canonicalized panoramas with yaw-centered perspective-view supervision.

2026-06-12视觉感知强化学习三维

MoVerse面向单张窄视场图像生成可交互漫游世界,解决缺失视野、长期几何一致性与实时渲染难兼得的问题。其关键是将世界构建与观测渲染解耦:先用拓扑感知扩散补全重力对齐360°全景,再提升为全景3D Gaussian scaffold,最后以蒸馏后的因果视频渲染器增强画质。实验以定性结果为主,展示可保持布局并改善观感,在单张RTX 4090上达到8 FPS实时漫游。

IterCAD: An Iterative Multimodal Agent for Visually-Grounded CAD Generation and Editing Figure 1
2026-06-12cs.AI

IterCAD: An Iterative Multimodal Agent for Visually-Grounded CAD Generation and Editing

Tao Hu, Jiaxin Ai, Licheng Wen, Xueheng Li, Shu Zou, Siqi Li, Nianchen Deng, Xinyu Cai, Hongbin Zhou, Pinlong Cai, Daocheng Fu, Yu Yang, Hairong Zhang, Botian Shi, Xuemeng Yang

2026-06-12视觉语言

IterCAD针对现有CAD自动生成多为一次性开环、难以像工程师那样反复验证和修改的问题,将多视图工程图、CadQuery沙盒执行、编译与视觉反馈结合成闭环多轮智能体,覆盖图纸/文本到代码和局部编辑;训练上用渐进SFT加几何感知RL与可行前缀约束,并构建含复杂制造特征的IterCAD-Bench及避免“幸存者偏差”的CD-TR/AUC-TR指标。实验显示其在代码可执行性、几何精度和迭代修复上优于既有方法,但具体增益中数据合成与模型规模贡献仍需进一步拆分。

Dual-Constrained Diffusion Image Compression for Operational Rate-Distortion-Perception Optimization Figure 1
2026-06-12cs.CV

Dual-Constrained Diffusion Image Compression for Operational Rate-Distortion-Perception Optimization

Sanxin Jiang, Jiro Katto, Heming Sun

Department of Information Engineering, Shanghai University of Electric Power, Department of Computer Science, Waseda University, Institute of Science Tokyo

2026-06-12视觉感知生成模型优化算法

针对神经图像压缩中码率、失真与感知真实感难以同时可控,且解码端公共随机性难以实现的问题,论文提出 DCIC:在学习压缩码流上叠加扩散解码,并用失真约束与重编码幂等约束共同引导反向去噪,通过一致噪声注入实现无额外码率的共享随机性;调节参数可从单一码流连续切换保真与真实感。实验在 CelebA-HQ、CLIC2020 和 ImageNet-1K 上显示,其 RDP 设置相较感知 codec 有更好 BD-PSNR,RP 设置的 BD-FID 接近专门感知方法。

VideoMDM: Towards 3D Human Motion Generation From 2D Supervision Figure 1
2026-06-12cs.LG

VideoMDM: Towards 3D Human Motion Generation From 2D Supervision

Amir Mann, Gal Michael Harari, Merav Keidar, Or Litany

2026-06-12视觉感知三维

针对3D人体运动生成依赖昂贵MoCap、难以覆盖真实视频多样性的问题,VideoMDM尝试仅用单目视频提取的2D姿态训练3D扩散先验。其关键做法是用2D到3D lifter作噪声教师,在3D空间去噪并以深度加权重投影损失和2D化运动正则约束训练。实验显示,HumanML3D上FID 0.88接近3D监督MDM的0.54,在Fit3D和NBA中也优于基线并更受人工偏好,但对相机参数和lifter质量仍较敏感。

JointEdit3D: Feed-Forward 3D Scene Editing in a Unified Latent Space Figure 1
2026-06-12cs.CV

JointEdit3D: Feed-Forward 3D Scene Editing in a Unified Latent Space

Xinnan Zhu, Ruijie Xu, Jiayu Ying, Daoguo Dong, Jiachen Xu, Yuan Xie, Xin Tan

East China Normal University, Shanghai Artificial Intelligence Laboratory, Fudan University

2026-06-12三维

针对现有3D场景编辑依赖逐场景优化或先2D编辑再重建、导致开销高和几何不一致的问题,JointEdit3D将编辑放入统一RGB-几何潜空间,用单张编辑参考帧做非对称潜空间补全,并以SceneAnchor和区域感知损失保留源场景结构。作者还构建15K配对数据与基准,实验显示其提升编辑区域质量和3D结构完整性,同时保持较好的背景保真。

Dual-Domain Equivariant Generative Adversarial Network for Multimodal CT-PET Synthesis Figure 1
2026-06-12cs.CV

Dual-Domain Equivariant Generative Adversarial Network for Multimodal CT-PET Synthesis

Gabriel Steele, Alzahra Altalib, Alessandro Perelli

2026-06-12视觉语言生成模型

针对CT-PET双模态采集成本高、缺失模态补全困难且传统GAN易忽略频谱信息和旋转几何一致性的问题,论文提出DDE-GAN,在图像域与傅里叶域联合学习,并把旋转等变约束加入生成器和判别器损失,通过分阶段域内/域间一致性训练提升结构保真度。文中称在HECKTOR 2022等数据上优于基线,用于PET补全和数据增强,但具体增益来源仍需结合消融判断。

OR-Action: Multi-Role Video Understanding with Fine-Grained Actions Figure 1
2026-06-12cs.CV

OR-Action: Multi-Role Video Understanding with Fine-Grained Actions

Felix Tristram, Ege Özsoy, Christian Benz, Marcel Walch, Ghazal Ghazaei, Nassir Navab

2026-06-12视觉感知

面向手术室外部场景中多人协作、遮挡和器械交互导致的细粒度时序理解难题,本文基于 EgoExOR 场景图用规则蒸馏出 OR-Action 基准,包含 78 类、1295 段多角色动作,并比较场景图管线与视觉时序模型。结果显示,预测场景图难以形成稳定动作片段,即使加 GNN 仍较弱;使用多视角自我中心视频的视觉模型显著更好,跨视角特征对齐还能提升部分单视角表现。

Masked and Predictive Self-Supervised Foundation Models for 3D Brain MRI Figure 1
2026-06-12cs.CV

Masked and Predictive Self-Supervised Foundation Models for 3D Brain MRI

Esra Ergün, Hersh Chandarana, Dan Sodickson, Gözde Ünal

2026-06-12三维

针对3D脑MRI基础模型多偏向分割、缺少疾病检测系统评估的问题,本文对比MAE重建式预训练与JEPA预测式表征学习,并分别加入频域重建损失和方差-协方差正则。结果显示自监督目标的收益强依赖任务结构:高频解剖信号任务更受益于频域MAE,分布式特征任务更受益于协方差正则;总体上带频域监督的MAE在五个疾病检测任务中优于JEPA。

MagPlus: Bridging Micro-to-Regular Facial Expressions through Learnable Magnification Figure 1
2026-06-12cs.CV

MagPlus: Bridging Micro-to-Regular Facial Expressions through Learnable Magnification

Sliman Jammal, Andrei Sharf

Ben-Gurion University of the Negev, Ben-Gurion University of the Negev Israel

2026-06-12视觉感知

微表情幅度小且标注数据稀缺,常被宏表情人脸动画模型当作噪声,导致直接生成不稳。MagPlus的关键思路不是重训生成器,而是先学习放大微弱运动,使其落入预训练宏表情模型可处理的运动域,再用DeMagPlus还原到真实微表情强度。作者在FOMM、FSRT、MetaPortrait和EmoPortraits上验证,无需微调骨干即可提升微表情迁移与合成的真实感。

ReFree: Towards Realistic Co-Speech Video Generation via Reward-Free RL and Multilevel Speech Guidance Figure 1
2026-06-12cs.CV

ReFree: Towards Realistic Co-Speech Video Generation via Reward-Free RL and Multilevel Speech Guidance

Salaheldin Mohamed, M. Hamza Mughal, Rishabh Dabral, Christian Theobalt

Max Planck Institute for Informatics

2026-06-12视觉感知强化学习

针对语音驱动头像动画中“口型准但僵硬、表情丰富却不同步”的矛盾,ReFree-S2V在预训练视频生成模型上构建flow-matching框架,用多层级语音表示同时建模局部音素与全局韵律,并通过可学习选择器注入Transformer;同时引入无需人工偏好或奖励模型的RL式微调,以真实样本和课程化负样本约束不自然运动。文中实验显示其在口型同步指标和人评自然度、表现力上优于现有方法。

DuET: Dual Expert Trajectories for Diffusion Image Editing Figure 1
2026-06-12cs.CV

DuET: Dual Expert Trajectories for Diffusion Image Editing

Lidia Troeshestova, Alexander Ustyuzhanin, Sergey Kastryulin

HSE University

2026-06-12视觉感知生成模型

针对扩散图像编辑中全程依赖源图会导致大幅改写时指令执行不足、画面不自然的问题,DuET提出在单次去噪轨迹中短暂从编辑模式切到仅文本生成模式,再回到编辑模式,以临时放松源图锚定且无需训练或额外采样。实验在FLUX2-Klein和BAGEL等模型、多个基准上提升指令相关性、语义一致性和感知质量,但会可预期地牺牲部分源图保真度。

HYDRA-X: Native Unified Multimodal Models with Holistic Visual Tokenizers Figure 1
2026-06-12cs.CV

HYDRA-X: Native Unified Multimodal Models with Holistic Visual Tokenizers

Guozhen Zhang, Xuerui Qiu, Yutao Cui, Tianhui Song, Changlin Li, Junzhe Li, Tao Huang, Xiao Zhang, Yang Li, Jianbing Wu, Miles Yang, Zhao Zhong, Liefeng Bo, Limin Wang

Nanjing University 2 CASIA 3 Tencent Hunyuan, Zhongguancun Academy 5 Shanghai AI Lab

2026-06-12视觉语言

针对统一多模态模型中图像与视频常由不同编码器或逐帧 tokenizer 处理、难以同时保留时序结构与语义的问题,Hydra-X 用单一 ViT 构建 Hydra-XTok,提出帧级因果时序注意力、分层时间压缩和训练期 Decompressor 进行图像/视频教师蒸馏,并把编辑中的源-目标交互前移到 latent 层。7B 实例在图像/视频理解、生成和编辑上均取得较强表现,消融显示全时空注意力和单步压缩反而不优。

Cross-Modal Masked Compositional Concept Modeling for Enhancing Visio-Linguistic Compositionality Figure 1
2026-06-12cs.CV

Cross-Modal Masked Compositional Concept Modeling for Enhancing Visio-Linguistic Compositionality

Wei Li, Zhen Huang, Xinmei Tian

MoE Key Laboratory of Brain-inspired, Intelligent Perception and Cognition, University of Science and Technology of China

2026-06-12视觉感知

针对 CLIP 类视觉语言模型常把文本当“词袋”、难以区分关系、属性绑定和词序的问题,论文提出 MACCO:不依赖显式困难负样本,而是遮蔽一侧模态中的组合概念,并用另一侧完整上下文重建,同时用 MCA/MIR 约束跨模态对齐与模态内稳定性。五个组合性基准和多种骨干上的实验显示其提升 VLM 组合理解,并对文生图和多模态大模型有附带收益。

Zero-Shot Captioning for Cultural Heritage: Automated Image Analysis of Traditional Indonesian Clothing Figure 1
2026-06-12cs.CV

Zero-Shot Captioning for Cultural Heritage: Automated Image Analysis of Traditional Indonesian Clothing

Anugrah Aidin Yotolembah, Novanto Yudistira, Gembong Edhi Setyawan

2026-06-12视觉语言视觉感知

针对通用视觉语言模型难以识别印尼传统服饰细粒度文化术语的问题,论文构建覆盖38省的专家标注数据集,并提出在省级归纳零样本设置下的 Custom ZeroCLIP:冻结 CLIP 编码器,用训练省份 caption 检索增强 BERT-LSTM 生成。其在8个未见省份上取得 CLIPScore 0.8536、BLEU-4 0.3342、METEOR 0.4859,检索带来19.3% METEOR 增益,但术语泛化与检索迁移的边界仍需谨慎解读。

TimeLens: On-Device Artifact Recognition with Retrieval-Augmented Question Answering for the Grand Egyptian Museum Figure 1
2026-06-12cs.CV

TimeLens: On-Device Artifact Recognition with Retrieval-Augmented Question Answering for the Grand Egyptian Museum

Rawan Hesham, Ali Ashraf, Amr Ahmed, Malak Alaa, Omar Ahmed, Omar Wagih

2026-06-12视觉感知

面向大埃及博物馆中相似文物、弱网络与双语讲解易幻觉的问题,TimeLens将手机端YOLOv8n识别与基于ChromaDB的英阿双语RAG问答结合。论文的主要洞察是细粒度文物检测的瓶颈首先在标注质量而非模型或分辨率;手工校验标签后,5.97MB TFLite模型达mAP@0.5 0.995、mAP@0.5:0.95 0.924,RAG端约10秒回答且30题评测未见幻觉。

Towards More General Control of Diffusion Models Using Jeffrey Guidance Figure 1
2026-06-12cs.LG

Towards More General Control of Diffusion Models Using Jeffrey Guidance

Raphaël Razafindralambo, Rémy Sun, Frédéric Precioso, Jes Frellsen, Pierre-Alexandre Mattei

Technical University of Denmark, Denmark

2026-06-12生成模型规划控制

现有扩散 guidance 往往只能做条件采样,或依赖难解释的启发式能量,目标分布不明确。本文把 Jeffrey 条件化规则引入采样过程,通过密度比校正显式匹配指定边缘分布,并把分类 guidance 视为特例。实验显示,在 CIFAR-10、FFHQ 上匹配 Inception 嵌入可显著降低 FID,在 CelebA-HQ 上还能调节属性分布并削弱 Male 与 Young 的相关性。

ComAct: Reframing Professional Software Manipulation via COM-as-Action Paradigm Figure 1
2026-06-12cs.SE

ComAct: Reframing Professional Software Manipulation via COM-as-Action Paradigm

Jiaxin Ai, Tao Hu, Xuemeng Yang, Shu Zou, Hairong Zhang, Daocheng Fu, Yu Yang, Hongbin Zhou, Nianchen Deng, Pinlong Cai, Zhongyuan Wang, Botian Shi, Kaipeng Zhang, Licheng Wen

2026-06-12机器人

论文针对专业软件中 GUI 智能体视觉定位脆弱、长程操作易累积错误,以及 API/MCP 接口碎片化的问题,提出将 Windows COM 作为统一动作空间的 ComAct,把软件操控转化为可执行程序合成。作者以工业 CAD 为验证场景,构建 ComCADBench、ComForge,并训练可自纠错的 ComActor;实验显示 GUI 基线几乎失败,而 COM 执行显著提升,ComActor 在长程 CAD 任务和外部基准上达到 SOTA。

Distributional Loss for Robust Classification Figure 1
2026-06-12cs.LG

Distributional Loss for Robust Classification

Kathleen Anderson, Thomas Martinetz

Institute for Neuro- and Bioinformatics, University of Lübeck, Germany, sample to a single assigned label, we define an optimization objective, all without requiring additional label information. Experimental results, x ∼P(x) are associated with class labels ck ∼P(ck | x), where k = 1, . . . , K, to each input x(n) is assigned a hard class label c(n), Assigning each sample a single definitive label may fail to capture the in-, tics shared across multiple classes. Using softer, more informative labels, ideally, [21], but such high-quality probabilistic annotations are rarely available in prac-, tice. Enforcing a rigid, hard label assignment instead may encourage overfitting, ture. The training labels now indicate only to which mode of the distribution, network output logits and target label is robust to label noise [8], which moti-

2026-06-12安全鲁棒

本文针对交叉熵用 one-hot 目标易导致过度自信、噪声下过拟合的问题,提出直接在 logits 上约束全数据输出服从双峰高斯分布的 distributional loss,并用参数化概率编码器与基于样本距离的非参数 KL 估计联合优化。实验在多种图像分类数据集上显示其鲁棒性和小样本表现通常优于 CE、PolyLoss、T-vMF,BloodMNIST、PathMNIST增益明显,但 Caltech256 并非全程占优,且训练更难、需调参。

Visual Place Recognition in Forests with Depth-Aware Distillation Figure 1
2026-06-12cs.CV

Visual Place Recognition in Forests with Depth-Aware Distillation

Walter Nedov, Saimunur Rahman, Kavindie Katuwandeniya, David Hall, Kaushik Roy, Peyman Moghadam

CSIRO Robotics, Brisbane, Australia 2 University of Queensland, Brisbane, Australia 3 Queensland University of Technology, Brisbane, Australia

2026-06-12视觉感知

本文针对森林场景中植被重复、结构线索弱、跨遍历外观变化大导致 RGB 视觉地点识别不稳的问题,提出 DAD 深度感知蒸馏:冻结 DINOv2/SALAD 外观教师,仅学习深度 patch 嵌入,并用三元组检索损失与描述子对齐损失在保留预训练空间的同时注入几何信息。在 WildCross 零样本评测中,DAD 相比外观基线显著提升,跨序列平均 R@1 从 49.38 提至 62.69,说明预测深度也能补足自然环境 VPR 的外观歧义。

Transformer-Guided Graph Attention for Direct Cardiac Mesh Reconstruction: A Structural Digital Twin Framework Figure 1
2026-06-12cs.CV

Transformer-Guided Graph Attention for Direct Cardiac Mesh Reconstruction: A Structural Digital Twin Framework

Abhishek H S, Akash Ganamukhi, Abhimanyu Suresh, Aditya G Hiremath, Prasad B Honnavalli, Adithya Balasubramanyam

CAVE Labs, C-IoT, Dept. of CSE, PES University, C-IoT, Dept. of CSE, PES University, CAVE Labs, C-IoT, Dept. of CSE, PES University Bengaluru India, C-IoT, Dept. of CSE, PES University Bengaluru India

2026-06-12三维

面向心脏数字孪生,论文针对传统“分割-Marching Cubes-人工修补”流程耗时且网格质量不稳定的问题,提出由3D Swin Transformer提取CT/MRI体特征、GAT变形模板网格的端到端直接重建框架,并联合优化分割与几何目标。在MM-WHS 2017上,CT/MRI Dice为0.84/0.83,平均Chamfer距离1.8 mm,95%表面误差低于5 mm,可单次前向生成无需后处理的心脏表面网格。

Iterative Visual Thinking: Teaching Vision-Language Models Spatial Self-Correction through Visual Feedback Figure 1
2026-06-12cs.CV

Iterative Visual Thinking: Teaching Vision-Language Models Spatial Self-Correction through Visual Feedback

Animesh Tripathy, Aswanth Krishnan

QpiAI India Pvt. Ltd

2026-06-12视觉语言视觉感知

论文针对VLM在指代表达定位中虽能单次预测框、却不会观察并修正自身错误的问题,提出IVT“预测—渲染—再修正”闭环:把上一轮框叠加回图像作为视觉反馈,并用学生错误+教师纠错轨迹做SFT,再以IoU奖励GRPO稳定多步推理。结果显示,朴素迭代会使Acc@0.5从79.6%跌至48.7%,而SFT后升至82.0%,GRPO主要将逐步IoU退化降低约5倍。

An Extensible and Lightweight Unified Architecture for Demosaicing Pixel-bin Image Sensors Figure 1
2026-06-12cs.CV

An Extensible and Lightweight Unified Architecture for Demosaicing Pixel-bin Image Sensors

Saurabh Kumar, Nutan Sairam Yenneti

Samsung Research Institute Bangalore

2026-06-12视觉感知

面向手机像素合并传感器中 Bayer、Tetra、Nona、Hexadeca 等 CFA 需多模型去马赛克、占用端侧资源的问题,论文提出带免学习 CFA 识别的统一轻量架构:按频域签名选择专用编码器,再经共享核心与解码器重建 RGB,并可通过新增签名和编码器扩展。实验在多合成数据和真实 raw 数据上优于 KLAP 及若干单 CFA 模型,端侧参数量约为既有统一模型的 1/6。

Cascade Classification of Dermoscopic Images of Skin Neoplasms with Controllable Sensitivity and External Clinical Validation Figure 1
2026-06-12cs.CV

Cascade Classification of Dermoscopic Images of Skin Neoplasms with Controllable Sensitivity and External Clinical Validation

Elena S. Kozachok, Sergey S. Seregin, Aleksandr V. Kozachok, Ilya P. Latyshev, Oleg I. Samovarov

2026-06-12视觉感知规划控制

针对皮肤镜模型从ISIC等开放数据迁移到真实临床时性能与校准下降的问题,本文比较ViT、Swin、ConvNeXt、EfficientNetV2及二分类、四分类、两阶段级联方案。核心洞察是用可调阈值的恶性初筛再做癌种细分,可显式控制敏感性,更贴近临床流程。内部ROC-AUC达0.952–0.966,但外部临床降至0.797–0.893且校准误差显著上升;级联多数情况下提升macro F1,但显著性主要仅见于ViT。

Fully Distributed Multi-View 3D Tracking in Real-Time Figure 1
2026-06-12cs.CV

Fully Distributed Multi-View 3D Tracking in Real-Time

Byron Hernandez, Fangyu Li, Aotian Wu, Paul J. Shin, Kaustubh Purandare, Henry Medeiros

2026-06-12视觉感知三维

针对重叠视场多摄像头跟踪依赖中心化融合、难以在大规模实时部署中承受带宽与算力瓶颈的问题,论文提出 MV3DT:每个相机节点独立执行单目3D感知、分布式关联、ID传播与卡尔曼多视角融合,并用 MQTT 轻量通信实现无中心协同。在给定标定、无需场景训练的零样本设置下,WILDTRACK 达到 96.5% IDF1、93.1% MOTA,100相机仓库场景可维持30 FPS、约5ms延迟和2.2%通信开销。

PP-OCRv6: From 1.5M to 34.5M Parameters, Surpassing Billion-Scale VLMs on OCR Tasks Figure 1
2026-06-12cs.CV

PP-OCRv6: From 1.5M to 34.5M Parameters, Surpassing Billion-Scale VLMs on OCR Tasks

Yubo Zhang, Xueqing Wang, Manhui Lin, Yue Zhang, Penglongyi Deng, Ting Sun, Tingquan Gao, Zelun Zhang, Jiaxuan Liu, Changda Zhou, Hongen Liu, Suyin Liang, Cheng Cui, Yi Liu, Dianhai Yu, Yanjun Ma

PaddlePaddle Team, Baidu Inc.

2026-06-12视觉语言

本文针对通用VLM在OCR中定位不准、幻觉和计算开销高的问题,提出轻量级PP-OCRv6:用统一的MetaFormer式LCNetV4骨干结合结构重参数化,并重做检测RepLKFPN与识别EncoderWithLightSVTR,覆盖1.5M到34.5M参数。文中在自建基准上报告medium达86.2%检测Hmean、83.2%识别准确率,优于PP-OCRv5且超过多款大规模VLM;tiny在Xeon CPU上较PP-OCRv5_mobile快3.9倍,但增益可能也来自数据优化。

Unified MRI Brain Image Translation via Hierarchical Tumor Structure Comparison Figure 1
2026-06-12cs.CV

Unified MRI Brain Image Translation via Hierarchical Tumor Structure Comparison

Yupeng Cai, Jia Wei, Jianlong Zhou

2026-06-12视觉感知

针对多模态脑 MRI 常缺失且肿瘤区域翻译失真会影响诊断的问题,论文提出统一的 HTSCGAN,将肿瘤分区结构显式纳入生成过程:用多尺度 Patch Contrast Module 保留层级结构差异,并借助预训练 Patch Classifier 与结构感知编码器约束生成图像的肿瘤语义和空间依赖。在 BraTS2020/2021 上,该方法在图像翻译及下游分割任务中均优于对比方法。

LaME: Learning to Think in Latent Space for Multimodal Embedding via Information Bottleneck Figure 1
2026-06-12cs.CV

LaME: Learning to Think in Latent Space for Multimodal Embedding via Information Bottleneck

Peixi Wu, Biao Yang, Feipeng Ma, Bosong Chai, Bo Lin, Wei Yuan, Fan Yang, Tingting Gao, Hebei Li, Xiaoyan Sun

University of Science and Technology of China, Zhejiang University, Tsinghua University

2026-06-12视觉语言

针对显式 CoT 多模态嵌入推理在检索中延迟高、且依赖 CoT 标注质量的问题,LaME 将面向嵌入的推理改写为潜空间信息瓶颈:用少量可学习 reason tokens 在单次前向中完成“思考”,并以重构探针与聚合嵌入头分离生成与对比监督,配合两阶段训练稳定收敛。在 MMEB-v2 和 MRMR 上,其性能接近或超过部分 CoT 方法,推理较显式 CoT 快 60 倍、较迭代潜推理快 2 倍。

Augmentation techniques for video surveillance in the visible and thermal spectral range Figure 1
2026-06-12cs.AI

Augmentation techniques for video surveillance in the visible and thermal spectral range

Vanessa Buhrmester, Ann-Kristin Grosselfinger, David Munch, Michael Arens

2026-06-12视觉感知

面向昼夜视频监控中热红外标注数据稀缺、可见光与红外域差异导致模型泛化不足的问题,论文尝试将易获得的可见光训练图像通过颜色空间、灰度/反相亮度与模糊等增强变得更像红外数据。核心洞察是削弱颜色纹理、突出形状/亮度特征可提升跨谱分类;在 ThermalWorld 上,相比未增强可见光训练,红外分类提升约76%,可见+红外混合测试提升约24%,且可见光性能基本不降。

SeamEdit: A Black-Box VLM-Agnostic Pipeline for Large-Image Semantic Editing Figure 1
2026-06-12cs.CV

SeamEdit: A Black-Box VLM-Agnostic Pipeline for Large-Image Semantic Editing

Xiangyu Lyu, Dan Lei

Fine-Arts Educator, Yuncheng Middle School, Yuncheng, Shanxi, China

2026-06-12视觉语言视觉感知

SeamEdit关注黑盒闭源VLM在大图分块语义编辑中因分辨率限制产生的对齐漂移、语义变形和接缝伪影。其核心是无需训练、无需访问模型内部状态,把带修复能力的VLM当作oracle,并通过重叠切块、Grid-SIFT几何校正、局部色彩一致性、多候选接缝风险排序和动态规划曲线接缝融合来后处理。文中声称可降低接缝可见性并支持任意tile区域编辑,但具体量化增益在给定文本中未充分说明。

TetherCache: Stabilizing Autoregressive Long-Form Video Generation with Gated Recall and Trusted Alignment Figure 1
2026-06-12cs.CV

TetherCache: Stabilizing Autoregressive Long-Form Video Generation with Gated Recall and Trusted Alignment

Yu Meng, Xiangyang Luo, Letian Li, Wenyuan Jiang, Chen Gao, Xinlei Chen, Yong Li, Xiao-Ping Zhang

Tsinghua University, 2 D-INFK, ETH Zürich

2026-06-12视觉感知

本文针对自回归视频扩散在分钟级生成中受 KV-cache 容量限制、且长期自条件导致上下文分布漂移的问题,提出无需训练的 TetherCache。其将缓存划分为 sink、memory、recent,并用 GRAB 兼顾注意力相关性与时间多样性选择历史帧,再用 TAME 以早期可信帧统计校准召回 token。基于 Self-Forcing,在 VBench-Long 的 30/60/240 秒设置均提升质量,240 秒质量漂移由 7.84 降至 1.33。

SAM-Deep-EIoU: Selective Mask Propagation for Multi-Object Tracking Figure 1
2026-06-12cs.CV

SAM-Deep-EIoU: Selective Mask Propagation for Multi-Object Tracking

Alexander Holmberg

KTH Royal Institute of Technology

2026-06-12视觉感知

这篇论文针对多目标跟踪中少数遮挡、近距离交互帧导致身份切换,而全程使用 VOS 又计算昂贵且易漂移的问题,提出按匈牙利匹配代价的 assignment margin 触发“选择性掩码传播”:仅在高风险窗口调用 SAM 3,并且只有当掩码结果高置信反驳基础跟踪器时才改写身份。方法免训练、黑盒兼容,在 DanceTrack 上提升 SORT、ByteTrack、Deep-EIoU,并结合全局轨迹关联在 SportsMOT 达到 86.8 HOTA;代价是仍需额外 VOS 计算,且多数触发窗口未改写输出。

GeoCFNet: Geometry-Aware Confidence Field Network for Robot-Assisted Endoscopic Submucosal Dissection Figure 1
2026-06-12cs.CV

GeoCFNet: Geometry-Aware Confidence Field Network for Robot-Assisted Endoscopic Submucosal Dissection

Rui Tang, Guankun Wang, Long Bai, Haochen Yin, Huxin Gao, Jiewen Lai, Jiazheng Wang, Hongliang Ren

2026-06-12机器人

面向机器人辅助 ESD 中烟雾、反光、组织形变和细长切割区域导致的视觉引导不稳定问题,论文将切割导航表述为连续置信场估计。GeoCFNet 以冻结 DINOv3 提取密集特征,用 TDF 融合 CLS 全局上下文与 patch 表征,并通过 SegFormer 解码和 GASR 平滑/各向异性约束保持线状几何连续性。实验在 ESD 图像上达到 RMSE 0.0480、PSNR 27.1995、SSIM 0.3397、CC 0.2466,显示较稳定的置信场预测。

A Multi-Modal Framework with Cross-Subject Pseudo-Labeling and Semantic Alignment for Micro-Gesture Recognition Figure 1
2026-06-12cs.CV

A Multi-Modal Framework with Cross-Subject Pseudo-Labeling and Semantic Alignment for Micro-Gesture Recognition

Haoran Zhang, Haokun Zhang, Pengyu Liu, Yujia Zhang, Weibao Xue, Yanbin Hao

2026-06-12视觉感知

面向未裁剪视频中的微手势识别,论文针对动作幅度小、背景噪声强、类别长尾和跨被试域偏移等问题,构建融合68点骨架、3D热图与高分辨率RGB的多模态框架,并用显著性裁剪、平方根平滑采样、正交语义嵌入损失及跨模态伪标签适配提升尾类与泛化能力;在第4届MiGA-IJCAI挑战iMiGUE测试集取得68.13% F1/Top-1并排名第4。

Comparing Commercial Depth Sensor Accuracy for Medical Applications Figure 1
2026-06-12cs.RO

Comparing Commercial Depth Sensor Accuracy for Medical Applications

Pit Henrich, Maximilian Weiherer, Franziska Hansen, Bernhard Egger, Franziska Mathis-Ullrich

Department of Artificial Intelligence in Biomedical Engineering, Friedrich-Alexander-Universit¨at Erlangen-N¨urnberg, Erlangen, Germany, Department of Computer Science, Friedrich-Alexander-Universit¨at Erlangen-N¨urnberg, Erlangen, Germany, nologies, Germany), Stereolabs ZED 2i (Stereolabs, France), and, D405 (Intel RealSense, United States), Stereolabs ZED 2i -, .1 mm (Stereolabs, France), Zivid 2M+ 60 (Zivid, Norway), marble-white PLA (Bambu Lab, China) calibration cubes have, Stereolabs ZED 2i (2.1mm)

2026-06-12视觉感知

面向医疗/手术机器人中依赖3D表面感知的需求,本文在约50 cm工作距离下,用触针采样参考点云对四类商用深度传感器在猪骨、猪腹组织和硅胶肾模型上做定量比较,覆盖真实组织的均质、反光和次表面散射挑战。结果显示Zivid 2M+ 60整体最稳且误差最低,ZED 2i在真实组织上接近但在深色均质模型上退化,D405受距离影响明显,Flexx精度落后。

Quality-Preserving Imperceptible Adversarial Attack on Skeleton-based Human Action Recognition Figure 1
2026-06-12cs.CV

Quality-Preserving Imperceptible Adversarial Attack on Skeleton-based Human Action Recognition

Ziyi Chang, Kanglei Zhou, Xiaohui Liang, Hubert P. H. Shum

2026-06-12视觉感知

针对骨架动作识别对抗攻击常因噪声扰动破坏动作自然性、在高质量骨架输入下更易被察觉的问题,论文指出根源在单样本优化的经验风险与真实数据分布风险不匹配,并用预训练扩散模型构建分布式潜空间生成攻击动作,同时提出贴近生理自然性的质量指标。实验在多种S-HAR模型和数据集上显示,该方法在攻击成功率、动作质量和人类不可察觉性上优于现有方法,但也暴露了动作识别器的鲁棒性缺口。

A Machine Learning Framework for Real-Time Personalized Ergonomic Pose Analysis Figure 1
2026-06-12cs.CV

A Machine Learning Framework for Real-Time Personalized Ergonomic Pose Analysis

Manex Atxa, Bruno Simoes, Julen Balzategui

available for a thorough postural evaluation, especially when occlusions occur. The, selected and labeled by the user are used to train the personalized deep learning, labeling. The model was trained on this data and, following the training phase, performs inference on new streaming data in real time. This research offers a scalable, issues, and limited scalability for large workforce populations [1]. Solutions powered, this makes pose interpretation easier, the data available for analysis is limited, in case

2026-06-12三维

针对传统人工工效评估耗时、主观且难以扩展的问题,论文提出用多 RGB-D 相机生成三维点云/体视频,并从可交互视角投影到二维以复用 MMPose 等姿态估计,再用用户手动标注的样本训练个性化工效/非工效分类器。搬运负载案例显示系统可在流式数据上实时骨架标注与推理,缓解固定视角和遮挡限制;但文中未充分说明相对基线的量化增益。

Diffusion Transformer World-Action Model for AV Scene Prediction Figure 1
2026-06-12cs.CV

Diffusion Transformer World-Action Model for AV Scene Prediction

Ruslan Sharifullin, Benjamin Jiang, Kai Xi Chew

Stanford University

2026-06-12生成模型强化学习

本文面向自动驾驶中可由自车动作驱动的紧凑世界模型,解决“预测哪种潜空间”和“生成式 DiT 是否优于回归”的问题。核心洞察是空间 token、x0 目标、残差锚定和不确定性匹配采样决定 DiT 效果,且仅看 L2/SSIM 会偏向模糊均值。nuScenes 上,V-JEPA2 时序表征使转向 RMSE 降低 40%,扩散模型 KID 较回归好 4.8 倍,并表现出明显转向可控性。

Objects Before Words: Object-First Inductive Biases for Grounding Language in Child-View Video Figure 1
2026-06-12cs.CV

Objects Before Words: Object-First Inductive Biases for Grounding Language in Child-View Video

Sathira Silva, Abrham Kahsay Gebreselasie, Muhammad Umer Sheikh, Kartik Kuckreja, Daniel Harari, Muhammad Haris Khan

Mohamed bin Zayed University of Artificial Intelligence, Abu Dhabi, UAE, Weizmann Institute of Science, Rehovot, Israel, face, links candidates across a short utterance-centered window, On SAYCam-S, BabyMind improves Labeled-S 15 forced-, • Improved SAYCam-S grounding on Labeled-S 15 and con-, without labels (Burgess et al., 2019, of candidates rather than a single labeled instance, multiple-

2026-06-12视觉语言视觉感知

论文针对儿童第一视角视频中照护者语音稀疏、与画面弱同步且场景杂乱导致词义 grounding 噪声大的问题,提出 BabyMind 的“先物体后语言”偏置:用离线掩码生成候选区域,在短时间窗内跟踪成 object files,并以原型空间多实例对比学习对齐话语与候选物体,同时用轨迹一致性和全局-物体一致性正则稳定训练。结果在 SAYCam-S 上较 CVCL 的 Labeled-S 15 强制选择准确率提升 2.6 个百分点,并在词表内 OOD 评测有小幅稳定增益。

Camera and LiDAR BEV Fusion for Cooperative 3D Object Detection on TUMTraf V2X Figure 1
2026-06-12cs.CV

Camera and LiDAR BEV Fusion for Cooperative 3D Object Detection on TUMTraf V2X

Muhammad Shahbaz, Shaurya Agarwal

Department of Civil, Environmental and Construction Engineering, University of Central Florida, boxes through a CenterPoint-style head with a generalised IoU regression loss and an IoU quality, test frames are also present in the released train (40) and validation (4) splits with their labels, so, labels, in the released train and validation data, so Section 4 reports two further studies that measure, cloud where the two LiDARs have been aligned by the dataset providers. Labels are released in the, labelling frame is moving per-frame, which complicates the camera-to-BEV projection that we rely on., block, concatenated, and passed to a CenterPoint head. The head predicts a heatmap, box regression, The two BEV maps are gated and concatenated before a CenterPoint head [4] predicts class heatmaps, box centres, sizes, rotations and an IoU score. The full network has 118.7M parameters, projected back to 512 channels. A CenterPoint multi-task head splits the eight classes into four groups, (vehicle, pedestrian, cyclist, trailer) and shares a 256-channel trunk followed by separate heads for centre

2026-06-12视觉感知三维

本文面向 TUMTraf V2X 协同 3D 检测,动机是在路侧多相机与车路融合 LiDAR 间建立统一 BEV 表示。方法采用双分支 BEV 融合、SE 门控、CenterPoint 头,并加入 GIoU 回归与 IoU 质量重排序。标准训练在 Codabench 达 0.85 mAP;但关键洞察是测试集 50 帧中 44 帧与训练/验证重叠,过采样可到 0.89,直接替换真值可到 0.99,说明成绩受数据泄漏显著影响。

Trajectory-Level Redirection Attacks on Vision-Language-Action Models Figure 1
2026-06-12cs.RO

Trajectory-Level Redirection Attacks on Vision-Language-Action Models

Gokul Puthumanaillam, Vardhan Dongre, Pranay Thangeda, Hooshang Nayyeri, Dilek Hakkani-Tür, Melkior Ornik

2026-06-12视觉语言视觉感知规划控制

本文关注 VLA 机器人中语言指令被闭环反复使用带来的安全风险:微小且看似保留原命令的文本扰动,可能改变最终物理结果。作者形式化“命令保持的轨迹重定向”威胁,并提出基于 rollout 的 on-policy 提示搜索。仿真与硬件实验显示,该攻击可跨多类 VLA 生效,9 个架构中 7 个成功率超过 90%,防御需做命令级规范化而非表面清洗。

Efficient, Robust, and Anti-Collusion Fingerprinting of Image Diffusion Models Figure 1
2026-06-12cs.CV

Efficient, Robust, and Anti-Collusion Fingerprinting of Image Diffusion Models

Jianwei Fei, Yunshu Dai, Zhihua Xia, Xiaochun Cao, Jiantao Zhou, Alessandro Piva, Benedetta Tondi

in part by Research Committee at University of Macau under MYRG-CRG2025-00031-FST and MYRG-GRG2025-00086-FST

2026-06-12视觉感知生成模型安全鲁棒

针对文本到图像扩散模型指纹在多用户参数平均等合谋攻击下易被抹除的问题,本文将比特指纹编码进VAE解码器中的个性化归一化模块,并引入保持单模型功能不变、但会破坏合谋模型生成质量的ACT变换。该方法无需为每个用户重训即可生成指纹副本,并通过最坏情况优化增强抗剪枝、微调等鲁棒性;实验中多任务指纹提取准确率超过99.5%,合谋后FID显著升高,模型可用性被主动削弱。

YOLO-AMC: An Improved YOLO Architecture with Attention Mechanisms for Building Crack Detection Figure 1
2026-06-12cs.CV

YOLO-AMC: An Improved YOLO Architecture with Attention Mechanisms for Building Crack Detection

Ching-Yu Tsai, Chia-Min Lin, Chih-Hsiang Yang, Yung-Che Wang, Jen-Shiun Chiang

Department of Electrical and Computer Engineering, Tamkang University, Taiwan, However, traditional manual inspection methods are time-consuming and labor-intensive, making them difficult to, trade-off between accuracy and deployment efficiency. The implementation code for this study is available on, labor-intensive, and susceptible to subjective judgment

2026-06-12视觉感知

面向建筑/基础设施裂缝细长、低对比且易受背景噪声干扰的问题,论文在 YOLOv11 基础上移除 C2PSA,并在 Neck 多尺度融合处比较引入 GAM、Res-CBAM、SA 等注意力以强化细粒度裂缝特征。实验中 GAM 版本最佳,mAP@0.5 达 0.9917、mAP@0.5:0.95 达 0.9506,高于 YOLOv11n/YOLOv8n;同时约 7.6 GFLOPs,在 RTX 4090 上 110.95 FPS、树莓派 5 约 5 FPS。

OpenMedQ: Broad Open Pretraining for Medical Vision-Language Models Figure 1
2026-06-12cs.AI

OpenMedQ: Broad Open Pretraining for Medical Vision-Language Models

Ibrahim Gulluk, Max Van Puyvelde, Olivier Gevaert

Department of Electrical Engineering, Stanford University, Department of Biomedical Data Science, Stanford University School of Medicine, Department of Mathematical Modelling, Statistics and Bioinformatics, Ghent University, our code and an interactive demo is publicly available as a reproducible baseline for the, interactive demo is already available at https://openmedq.streamlit.app/ for qualitative

2026-06-12视觉语言视觉感知

针对医学视觉语言模型常依赖窄数据或不开源权重的问题,OpenMedQ采用LLaVA式ViT-base+LLaMA-7B架构,在14个全开放医学数据集约335万样本上预训练,强调数据广度而非专有规模。结果显示其在PathVQA达75.9 BLEU-1、VQA-MED达64.5,视觉编码器在8个未见分类任务平均macro-F1为0.757,略优于BiomedCLIP等;增益可能主要来自更广数据混合。

ViPER: Vision-based Packing-Aware Encoder for Robust Malware Detection Figure 1
2026-06-12cs.CR

ViPER: Vision-based Packing-Aware Encoder for Robust Malware Detection

Fatima Qaiser, Bisma Tahir, Muhammad Abid Mughal, Nauman Shamim

aDepartment of Computer & Information Sciences, Pakistan Institute of Engineering & Applied Sciences (PIEAS), Islamabad, Pakistan, boundaries for packed and unpacked inputs. To address packing label skew during training, we, rely on become unavailable (Lyda and Hamrock, 2007).

2026-06-12视觉感知安全鲁棒

针对PE二进制可视化检测中“加壳”会制造高熵纹理、且良性软件也常加壳导致单一决策边界失效的问题,ViPER用LoRA适配的DINOv2 ViT-B/14从byteplot联合学习恶意分类与加壳检测,并以残差门控将加壳置信度注入主分类头。其在20万样本上达到BalAcc 0.8521、ROC-AUC 0.9260、AUPR 0.9279,加壳检测AUC 0.9949,优于CNN基线;消融显示主要增益来自LoRA域适配,门控带来较小排序改进。

MAMVI: 3D Test-Time Adaptation via Masked Multi-View Point Clouds Figure 1
2026-06-12cs.CV

MAMVI: 3D Test-Time Adaptation via Masked Multi-View Point Clouds

Inseok Kong, Geunyoung Jung, Jiyoung Jung

Department of Geo Informatics, University of Seoul, Department of Artificial Intelligence, University of Seoul, making it highly suitable for real-time applications. The code is available, Without requiring additional labeled data or full retraining, TTA enables pre-, trained models to adapt on-the-fly using unlabeled test samples, allowing them to

2026-06-12三维

针对3D点云模型在传感器噪声、遮挡和环境变化下测试分布偏移导致性能下降、而现有多视角TTA逐视角顺序优化延迟过高的问题,MAMVI用固定比例与Beta采样结合的掩码生成多视角,通过多视角共识聚合损失并仅一次反传更新归一化层,同时用置信度自适应学习率控制适应强度。在ModelNet-40C、ShapeNet-C和ScanObjectNN-C上,方法在后两者达到SOTA,在ModelNet-40C保持竞争力,并比既有多视角方法快4.9–8.9倍。

Multi-Label Test-Time Adaptation with Bayesian Conditional Priors Figure 1
2026-06-12cs.CV

Multi-Label Test-Time Adaptation with Bayesian Conditional Priors

Qiru Li, Ao Zhou, Zhiwei Jiang, Zifeng Cheng, Cong Wang, Yafeng Yin, Qing Gu

Multi-Label Test-Time Adaptation with Bayesian Conditional Priors, Multi-label recognition with frozen Vision-, labels independently, ignoring co-occurrence, structure and producing incoherent label sets, compatible labels. We introduce Bayesian Con-, test-time adaptation method that injects label de-, mismatched label prior. For each test image, it, selects a high-confidence anchor label and ap-, multi-label benchmarks and multiple CLIP back-, *Equal contribution 1 State Key Laboratory of Novel Software, Technology, Nanjing University, Nanjing 210023, China . Corre-, ever, the exploration of TTA within multi-label recogni-

2026-06-12视觉感知

这篇论文针对冻结 VLM 在分布偏移下做多标签识别时忽略标签共现、易产生不一致预测的问题,提出无需反传的 BCP:把零样本 logits 视作边缘后验,为每张图选高置信锚标签,并用在线估计的条件先验/PMI 闭式校正其他标签。实验在多数据集和 CLIP 骨干上显著提升 mAP,如 RN50 平均 57.31→69.22、ViT-B/16 62.61→71.79,同时延迟低于需迭代优化的基线。

Selecting Samples on Graphs: A Unified Dataset Pruning Framework for Lossless Training Acceleration Figure 1
2026-06-12cs.LG

Selecting Samples on Graphs: A Unified Dataset Pruning Framework for Lossless Training Acceleration

Dongyue Wu, Zilin Guo, Xiaoyu Li, Jiajia Liu, Jingdong Chen, Nong Sang, Changxin Gao

State Key Laboratory of Multispectral Information Intelli-, gent Processing Technology, School of Artificial Intelligence and, Automation, Huazhong University of Science and Technology, sity and coverage via objectives such as K-center (Sener &, scalable pruning algorithm rather than a heuristic rule. We, et al., 2012) and k-center selection (Sener & Savarese, 2018)

2026-06-12数据集/基准

大规模训练数据带来高计算成本,现有数据剪枝往往只看单样本难度或样本间多样性,难以同时控制信息量与冗余。本文提出 UGIES,将数据集建模为带节点/边权图,把内在重要性与外在交互统一为最大权团目标,并用边际增益贪心近似及次模保证指导指标设计。实验显示其优于多种剪枝方法,在 ImageNet-1k/ResNet-50 上可减少超过 40% 训练时间且基本不损失精度。

Bounding Boxes as Goals: Language-Conditioned Grasping via Neuro-Symbolic Planning Figure 1
2026-06-12cs.RO

Bounding Boxes as Goals: Language-Conditioned Grasping via Neuro-Symbolic Planning

Allison Andreyev, Landon Eum, Nestor Tiglao, Romel Gomez

2026-06-12规划控制学习理论

面向家庭、仓储等场景中机器人需实时理解开放自然语言且避免大规模示教训练的问题,论文提出 GRASP:用 LLM 将指令解析为带边界框约束的符号目标,再用 GroundingDINO检测并以 IoU、中心距离反馈驱动闭环抓取与摆放。其核心洞察是把边界框同时作为语义目标和控制信号,从而解耦高层规划与低层控制。实验称在桌面分拣/整理任务上有较高指令遵循和定位精度,但具体指标与对比增益来源文中未充分说明。

Magnifying What Matters: Attention-Guided Adaptive Rendering for Visual Text Comprehension Figure 1
2026-06-12cs.CV

Magnifying What Matters: Attention-Guided Adaptive Rendering for Visual Text Comprehension

Shenglai Zeng, Qirui Wang, Kai Guo, Xinnan Dai, Xianxuan Long, Hui Liu

Michigan State University, Xi’an Jiaotong University

2026-06-12视觉感知

针对视觉文本理解中长文本渲染通常固定、且不清楚 VLM 如何利用可视化证据的问题,本文发现模型在中后层已能定位证据但常未能用好。提出无需训练的 AGAR,用自身注意力选取重要图像 patch 并映射到文本片段放大后重渲染再回答。在 9 个基准、4 个开源 VLM 上均提升准确率,并可与后训练叠加,对视觉和文本扰动保持较稳健。

Bridging Modal Isolation in Interleaved Thinking: Supervising Modality Transitions via Stepwise Reinforcement Figure 1
2026-06-12cs.CV

Bridging Modal Isolation in Interleaved Thinking: Supervising Modality Transitions via Stepwise Reinforcement

Tingyu Li, Le Zhou, Siyuan Li, Yujun Wu, Xinglong Xu, Jingxuan Wei, Conghui He, Cheng Tan

2026-06-12强化学习

本文关注统一多模态模型在长链交错推理中“文本想、图像画、再由文本验证”却彼此脱节的问题,指出关键瓶颈不是最终答案监督不足,而是模态边界的信息损失。作者定义模态转移损失,并提出 MoTiF:用带错误图像的 Reflective SFT 训练文本侧纠错,用 Flow-GRPO 强化图像对文本的忠实生成。四个视觉谜题基准上,该转移级监督提升跨模态一致性和最终准确率。

Learning Task-Aware Sampling with Shared Saliency through Density-Equalizing Mappings Figure 1
2026-06-12cs.CV

Learning Task-Aware Sampling with Shared Saliency through Density-Equalizing Mappings

Tsz Lok Ip, Han Zhang, Lok Ming Lui

*Department of Mathematics, The Chinese University of Hong Kong, Hong Kong, China., Department of Mathematics, City University of Hong Kong, Hong Kong, China.

2026-06-12视觉感知

针对图像和曲面学习中均匀卷积把算力浪费在低信息区域的问题,本文提出 DECNN:用可学习密度函数表示共享任务显著性,并通过密度均衡映射扩展重要区域、压缩无关区域,从而实现非均匀感受野采样。实验在局部信息分类与颅面 3D 曲面分析上显示,其以更少参数达到相当或更好精度,并能给出较可解释的任务相关显著区域。

JSCGC: Joint Source-Channel-Generation Coding for Wireless Generative Communications Figure 1
2026-06-12cs.IT

JSCGC: Joint Source-Channel-Generation Coding for Wireless Generative Communications

Tong Wu, Zhiyong Chen, Guo Lu, Li Song, Feng Yang, Meixia Tao, Wenjun Zhang

Generative Communications, Generation Controllability, Dif-, Center, the School of Information Science and Electronic Engi-, neering, Shanghai Jiao Tong University, Shanghai 200240, China, via a communication-aware adapter, enabling controllable

2026-06-12生成模型

论文针对传统 JSCC 以 MSE/LPIPS 等失真指标训练、易产生模糊或伪影的问题,提出 JSCGC:把接收端解码器替换为生成模型,将信道输出作为条件控制采样,并以感知约束下的互信息最大化取代显式失真最小化。系统结合 Mamba 编码器、潜空间 flow matching 与通信感知适配器端到端训练;图像传输实验显示其在多种信道下提升 LPIPS、FID、CLIP 等感知与语义指标,但错误形态转为语义不一致而非局部失真。

SemanticXR: Low Power and Real-time Queryable Semantic Mapping with an Object-Level Device-Cloud Architecture Figure 1
2026-06-12cs.DC

SemanticXR: Low Power and Real-time Queryable Semantic Mapping with an Object-Level Device-Cloud Architecture

Rahul Singh, Devdeep Ray, Connor Smith, Sarita Adve

University of Illinois Urbana-Champaign

2026-06-12视觉感知

面向移动 XR 中空间搜索和 AI 助手所需的开放词汇语义地图,论文指出纯端侧算力不足、简单云卸载又难以兼顾断网查询、带宽和内存。SemanticXR 将“对象”提升为设备—云之间通信、执行和存储的基本单元,在云端做对象级并行、几何降采样与深度协同,在端侧维护稀疏对象地图并增量优先更新。实验显示其在同等语义质量下服务器映射延迟提升 2.2 倍,上行低于 2.5 Mbps,万级对象查询低于 100 ms,设备功耗仅增加约 2%。

Language-Guided Abstraction for Visual Reasoning Figure 1
2026-06-12cs.CV

Language-Guided Abstraction for Visual Reasoning

Xu-Jing Ye, Yuan-Gen Wang, Ruping Wang

aSchool of Artificial Intelligence, Guangzhou University, Guangzhou, 510006, China, the contribution of the two new designs towards the L-VARC framework. The code is available at, the form of language descriptions is available only during, are available for training tasks (via LARC) but not for unseen

2026-06-12视觉感知

本文针对ARC视觉推理中纯LLM参数庞大、纯视觉VARC易陷入像素相关而缺少抽象语义的问题,提出L-VARC:训练时把LARC语言描述经DeepSeek压缩、CLIP编码,并用跨注意力投影与ViT视觉特征对齐,推理时丢弃语言分支保持约18M参数。实验显示验证准确率由76.7%升至78.1%,ARC-2 pass@1由6.25%升至6.67%,增益较小但集中在变换与填充类任务。

Perceive, Interact, Reason: Building Tool-Augmented Visual Agents for Spatial Reasoning Figure 1
2026-06-12cs.CV

Perceive, Interact, Reason: Building Tool-Augmented Visual Agents for Spatial Reasoning

Changye Li, Meng Lu, Yi Wu, Ligeng Zhu

Tsinghua University, reasoning requires aligning station labels with route topology [Feng et al., 2025c,b], while MapTrace, toward map center, {"label": "library icon", {"label": "park icon", "bbox":, {"label": "cafe icon", "bbox":, • We develop a unified reinforcement training recipe centered on Observation-Relaxed Group-

2026-06-12视觉感知

针对现有 VLM 依赖静态视觉表征、在地图路径等空间任务中难以主动获取细粒度证据的问题,论文提出 PERIA,将感知工具与交互工具纳入“感知—交互—推理”流程,并用轨迹合成、复合奖励和 OR-GIGPO 训练多工具策略。在 8 个数据集 13 个基准上,PERIA-8B 较 Qwen3-8B 分布内提升 10.0%、分布外提升 4.4%,并超过同规模强基线 7.0%–14.8%。

DIMOS: Disentangling Instance-level Moving Object Segmentation Figure 1
2026-06-12cs.CV

DIMOS: Disentangling Instance-level Moving Object Segmentation

Hongxiang Huang, Hongwei Ren, Xiaopeng Lin, Yulong Huang, Zeke Xie, Bojun Cheng

The Hong Kong University of Science and Technology (Guangzhou), sity and enables more effective use of the available pixels

2026-06-12视觉感知

DIMOS面向移动实例分割中事件相机分辨率低、事件特征稀疏且外观与运动线索纠缠的问题,认为两种模态都应同时挖掘外观和运动信息。方法通过双解耦编码器、模态内对比学习与任务监督分离两类特征,并用多粒度跨模态对齐提升融合一致性。实验显示其在多模态MIS上达到SOTA,尤其改善小目标、快速运动和低光场景。

Acquisition state behaves as a structured, measurable variable governing lung-nodule AI: kernel-driven measurement instability and noise-driven detection fragility, invisible to DICOM metadata Figure 1
2026-06-12eess.IV

Acquisition state behaves as a structured, measurable variable governing lung-nodule AI: kernel-driven measurement instability and noise-driven detection fragility, invisible to DICOM metadata

Daniel Soliman

(identical “STANDARD” labels across reconstructions)., that adopt these practices can earn the voluntary ACR Recognized Center for Healthcare-AI, between AI outputs and radiology-report-derived surrogate labels, alongside anonymized patient, image through a physical space and change the information available to a reader or a model [4], throughout. Per-scan outputs: candidate boxes (center, extent) and confidence scores.

2026-06-12视觉感知

这篇论文关注影像 AI 监管中只看输出和 DICOM 元数据、却忽略输入采集漂移的问题。作者将 CT 采集状态视为可测量的结构化变量,用像素级噪声/频率指纹刻画其轴向影响:真实与受控实验显示,重建核主要扰动肺结节尺寸测量并导致 5.2% Fleischner 分级翻转,噪声主要削弱小结节检测置信度;像素指纹可识别重建状态,而 DICOM 标签常失效。

GRIP: Feedback-Guided Prompt Retrieval for Large Multimodal Models Figure 1
2026-06-12cs.CV

GRIP: Feedback-Guided Prompt Retrieval for Large Multimodal Models

Garvita Allabadi, Matteo Sodano, Roberto Estevão, Yuxiong Wang, Vikram Adve, Emre Kiciman, Ranveer Chandra

Garvita Allabadi1, Matteo Sodano2, Roberto Estevão3, University of Illinois Urbana Champaign, University of Bonn, source GPT-4o and Gemini, enabling scalable and cost-efficient deployment of M-ICL. Code, pretable (positive, neutral, or negative contribution), and is readily available whenever we can query the, LMM on labeled training samples., each candidate neighbor and assigning labels according to a task-appropriate score change. Third, train a, that (1) uses the target LMM’s own outputs to generate labeled positives and negatives for candidate, filtering step to limit labeling cost, leverages hard-negative mining, and supports transfer when the target, source API-based systems like GPT-4o and Gemini. This enables scalable, cost-efficient performance

2026-06-12视觉语言

论文针对多模态上下文学习中“视觉相似样本最有用”的常见假设,指出近邻样本未必提升 LMM 预测。GRIP 用目标模型反馈给候选示例打正负标签,并以监督对比学习训练纯视觉检索器,使检索空间对齐实际提示效用而非表面相似。实验覆盖分类、VQA、 captioning,在 Qwen2.5-VL-7B 上六项均优于相似度检索,在 Idefics2-8B 分类增益最明显,并显示可跨模型迁移到 GPT-4o、Gemini。

EquiDexFlow: Contact-Grounded SE(3)-Equivariant Dexterous Grasp Generative Flows Figure 1
2026-06-12cs.RO

EquiDexFlow: Contact-Grounded SE(3)-Equivariant Dexterous Grasp Generative Flows

Clinton Enwerem, John S. Baras, Calin Belta

Institute for Systems Research, University of Maryland, College Park, MD, U.S.A.

2026-06-12生成模型

针对灵巧抓取生成中姿态与接触力分离、易导致力闭合失败或摩擦违规的问题,EquiDexFlow 将腕部 SE(3) 流匹配、关节、指尖接触、法向与接触力联合建模,并用表面投影和摩擦锥投影把部分物理约束做成结构保证。实验在 81 个物体的 8100 个 Allegro 抓取上验证,摩擦违规为零、力矩残差和综合评分优于消融,并能重定向到 LEAP 手完成 6 个实物开环抓取。

VLADriveBench: Evaluating CoT-Action Relationship in VLA for Autonomous Driving Figure 1
2026-06-12cs.CV

VLADriveBench: Evaluating CoT-Action Relationship in VLA for Autonomous Driving

Thach Nguyen, Danhua Guo, Tom Lampo, Fei Wu, Burhan Yaman

Uber AV Labs

2026-06-12视觉感知

本文针对自动驾驶 VLA 只用轨迹指标评测、无法判断 CoT 是否真实影响动作的问题,提出 VLADriveBench,将提及、幻觉、矛盾、动作对齐等观察指标与 CoT 替换干预结合。实验显示两类证据会明显分歧:ORION 观察对齐最高但 CoT 更像事后合理化,Alpamayo v1.5 对齐较低却呈现更强因果作用,且受视觉显著性调节。

SalArt-VQA: Diagnosing Whether VLMs Understand Salient Artifacts in Generated Images Figure 1
2026-06-12cs.CV

SalArt-VQA: Diagnosing Whether VLMs Understand Salient Artifacts in Generated Images

Xiaoxiao Sun, Ruotian Zhang, Junzhe Huang, James Burgess, Serena Yeung-Levy

Stanford University, Zhejiang University, The University of Queensland

2026-06-12视觉语言视觉感知

论文关注 VLM 用于生成图像瑕疵检测时“判对有瑕疵但看错位置或编造原因”的隐患,提出 SALART-VQA,将显著 artifact 理解拆成存在判断、语义定位、空间框选、基于证据的缺陷识别,并加入真实/生成参考图测试校准与拒答。950 图、3681 题评测 20 个 VLM 显示,最强模型虽有 99.37% 检出召回,但四步全对仅 53.26%,且敏感模型易误报、保守模型易漏检。

Amnesia: A Stealthy Replay Attack on Continual Learning Dreams Figure 1
2026-06-12cs.CR

Amnesia: A Stealthy Replay Attack on Continual Learning Dreams

Ahmed Sharshar, Naveen Kumar Kummari, Mohsen Guizani

Department of Computer Vision, Mohamed bin Zayed University of Artificial Intelligence, AbuDhabi, UAE, Department of Machine Learning, verify compliance using sampler-visible telemetry, e.g., logged replay index/label statistics, limited-privilege insider controlling only the replay index selection, not pixels, labels, or, and establish a principled impact-visibility-budget trade-off. Code is available anonymously, label sets, or distribution shift under a fixed label set)., reliability and compliance: it logs replay index sets, per-batch label counts, queue/priority metadata (e.g., fraction stays fixed and that the replay label histogram remains close to a nominal baseline derived from the

2026-06-12视觉感知

论文关注连续学习中经验回放采样器这一低权限但易被忽视的攻击面:攻击者不改图像、标签或参数,只操控回放索引。Amnesia用类别伤害效用偏置采样,并在TV/KL可审计偏差预算和固定回放率下投影、调度以保持隐蔽。实验在Split CIFAR、CORe50、Tiny-ImageNet及ER、DER++等基线上显示其降低最终准确率、加剧遗忘;KL版本更隐蔽,TV版本破坏更强但更易被审计发现。

CD-RCM: Generalizable Continuous-Depth Novel View Synthesis for Reflectance Confocal Microscopy Figure 1
2026-06-12cs.CV

CD-RCM: Generalizable Continuous-Depth Novel View Synthesis for Reflectance Confocal Microscopy

Tooba Imtiaz, Milind Rajadhyaksha, Kivanc Kose, Jennifer Dy

Northeastern University, 2Memorial Sloan Kettering Cancer Center

2026-06-12视觉感知

RCM 皮肤 z-stack 轴向采样稀疏、各向异性,限制了 DEJ 等深度结构的判读。CD-RCM 将中间深度生成表述为面向 RCM 的连续深度新视角合成,利用轴向光学切片与遮挡特性,采用前馈、可按深度查询的 transformer 框架,并加入 RCM 域感知损失以保留细胞纹理。实验显示其可在单次、亚秒级推理中生成较真实的未采样切片,优于传统插值基线。

ECA: Efficient Continual Alignment for Open-Ended Image-to-Text Generation Figure 1
2026-06-12cs.CV

ECA: Efficient Continual Alignment for Open-Ended Image-to-Text Generation

Jiangtao Kong, Peijun Zhao, Chun-Fu Chen, Youngwook Do, Shaohan Hu, Tianyi Zhou, Huajie Shao

Code and benchmarks are available at https:, Department of Computer Science, William & Mary, Vir-, Chase, USA 3Mohamed bin Zayed University of Artificial Intelli-

2026-06-12视觉感知

这篇论文关注开放式图像到文本生成在真实连续视觉流中的遗忘问题:任务不再按互斥类别划分,而按主导语义随时间迁移且可重叠。作者提出只更新预训练 VLM 的跨模态对齐模块的 ECA,用 MoQ 组合任务查询、FeDEx 按 Fisher 冲突动态扩展适配器,并用嵌入字典回放替代原始样本存储。在四个按主题构造的 Caption/VQA 增量基准上,ECA 相比基线更好缓解灾难性遗忘并提升增量性能。

Context-Aware Feature-Fusion for Co-occurring Object Detection in Autonomous Driving Figure 1
2026-06-12cs.CV

Context-Aware Feature-Fusion for Co-occurring Object Detection in Autonomous Driving

Binay Kumar Singh, Niels Da Vitoria Lobo

Department of Computer Science, University of Central Florida, head. The code is available at https://github.com/

2026-06-12视觉感知

面向自动驾驶中拥挤、遮挡场景下小目标与低频共现类别易漏检的问题,本文在两阶段检测器RoI头中加入CCFF:用RoI间自注意力建模局部交互,并将Top-K RoI池化为全局上下文token以编码共现先验。Cityscapes与BDD100K上CCS达0.973/0.969,小目标APS提升至14.1%,还能恢复Train等稀有类,额外开销约0.2 FPS。

Dual-State Slot Attention: Decoupling Appearance and Identity for Video Object-Centric Learning Figure 1
2026-06-12cs.CV

Dual-State Slot Attention: Decoupling Appearance and Identity for Video Object-Centric Learning

Sieu Tran, Duc Nguyen, Hao Vo, Khoa Vo, Ngan Le

University of Arkansas

2026-06-12视觉感知

本文针对视频对象中心学习中槽表示易在快速运动、遮挡时发生身份交换的问题,指出单一 slot 同时承担外观重建与跨帧身份保持会产生目标冲突,且注意力重归一化会放大弱匹配槽。DSSA 将每个槽拆为局部外观状态与稳定身份状态,并用竞争调制聚合抑制伪更新;在 MOVi-C/D 和 YouTube-VIS 上提升分割、时序一致性,并改善对象识别与视频动力学预测。

Emerging Flexible Designs for Geospatial Multimodal Foundation Models Figure 1
2026-06-12cs.LG

Emerging Flexible Designs for Geospatial Multimodal Foundation Models

Philipe Dias, Waqwoya Abebe, Abhishek Potnis, Aristeidis Tsaris, Dan Lu, Xiao Wang, Dalton Lunga

Oak Ridge National Laboratory, abling scalable pretraining across diverse unlabeled geospatial modalities. However, unlabeled data. Such architectures are preliminarily showing the potential to interpret vast amount, volumes of unlabeled imagery data. Presently in Earth observation imagery applications, varying

2026-06-12视觉语言

针对地球观测多模态基础模型在传感器、光谱波段不一致时难以公平比较的问题,本文统一预训练数据、SSL目标、参数规模与GeoBench评测协议,对SatMAE、DOFA和Flex做“同条件”对照。核心洞察是 tokenization 与跨波段融合策略直接影响光谱推理、鲁棒性和泛化:Flex的模块化设计更适合缺失或异构波段,但在光谱同质数据上可能不如标准ViT;文中主要给出架构取舍结论,具体增益来源仍需更多消融说明。

Analyzing and Improving Fine-grained Preference Optimization in Medical LVLMs Figure 1
2026-06-12cs.CV

Analyzing and Improving Fine-grained Preference Optimization in Medical LVLMs

Shayan Mohammadizadehsamakosh, Pritam Sarkar, Leonid Sigal, Ali Etemad, Elham Dolatabadi

York University, University of British Columbia, Vector Institute, Queen’s University, labels are unreliable in medicine [23, 24], prior work substitutes the supervised fine-tuning (SFT)

2026-06-12视觉语言优化算法

本文关注医学大视觉语言模型在临床描述中易幻觉、视觉依据不足,以及 DPO 将关键医学词与套话同等优化导致对齐失真的问题。作者提出 FIRE-MPO:用模型自身输出构造在策略偏好对,仅最小修改错误医学片段,并结合双向 token 级 KL 正则与干净/病灶扰动图像的视觉对比约束。实验显示其在多项医学影像与临床文本生成基准上优于 DPO、RRPO,两个 LVLM 平均相对提升约 10.24%,并减少风格化 reward hacking。

High-Fidelity Two-Step Image Generation via Teacher-Aligned End-to-End Distillation Figure 1
2026-06-12cs.CV

High-Fidelity Two-Step Image Generation via Teacher-Aligned End-to-End Distillation

Dongyang Liu, Ruoyi Du, David Liu, Dengyang Jiang, Liangchen Li, Qilong Wu, Zhen Li, Steven C.H. Hoi, Hongsheng Li, Peng Gao

The Chinese University of Hong Kong

2026-06-12视觉感知

本文针对扩散模型虽已能稳定蒸馏到4–8步、但进一步压到2步会因单步跨度过大和两步职责差异导致质量崩塌的问题,提出Z-Image Turbo++:用8步教师生成图像作为GAN“真实”目标以降低分布对齐难度,解耦两步参数提升专用容量,并进行端到端训练同时保留第一步损失。实验显示其在仅2步采样下显著缩小与8步教师的视觉和指标差距。

HairPort: In-context 3D-aware Hair Import and Transfer for Images Figure 1
2026-06-12cs.CV

HairPort: In-context 3D-aware Hair Import and Transfer for Images

Alireza Heidari, Amirhossein Alimohammadi, Wallace Michel Pinto Lira, Adi Bar-Lev, Ali Mahdavi-Amiri

ALIREZA HEIDARI∗, Simon Fraser University, Canada, AMIRHOSSEIN ALIMOHAMMADI, Simon Fraser University, Canada, ALI MAHDAVI-AMIRI, Simon Fraser University, Canada, Fraser University, Vancouver, Canada., segmentation-guided controllability, trained through in-context, Zhu et al. 2022] that emphasize controllability, fidelity, and, have achieved strong results in image synthesis [Labs 2024

2026-06-12视觉感知三维

本文针对发型迁移在源图与参考图存在大姿态、尺度差异时易错位、遮挡区域难补全且身份易漂移的问题,提出 HairPort:先用基于 FLUX.1 Kontext 的 LoRA 裸头转换器和 6000 对 Baldy 数据去除原发型,再进行三维重建与视角对齐,最后用条件 flow-matching 合成。实验和用户研究显示其在姿态一致性、发型保真与身份/背景保持上优于多种 2D GAN/扩散基线,但速度较慢且受 3D 头发重建误差影响。

AudioX-Turbo: A Unified Framework for Efficient Anything-to-Audio Generation Figure 1
2026-06-12cs.SD

AudioX-Turbo: A Unified Framework for Efficient Anything-to-Audio Generation

Zeyue Tian, Lei Ke, Zhaoyang Liu, Ruibin Yuan, Liumeng Xue, Yujiu Yang, Weijia Chen, Xu Tan, Qifeng Chen, Wei Xue, Yike Guo

The Hong Kong University of Science and Technology, Tsinghua University, following capabilities. The code and datasets will be available at, both critical for controllable audio generation.

2026-06-12视觉感知

面向现有音频/音乐生成模型输入模态单一、数据监督分散且扩散采样开销高的问题,AudioX-Turbo用MMDiT统一文本、视频、音频条件,并通过自适应多模态融合提升对齐;再将多步教师以适配flow matching的分布匹配蒸馏和扩散判别器压缩为4步学生。作者还构建约920万样本IF-caps-Pro。实验显示其在多任务尤其T2A/T2M和指令跟随上优于或接近SOTA,NFE最多降约25倍,但增益可能部分来自大规模数据。

Stereo Vision-Based Fall Prediction and Detection using Human Pose Estimation on the AMD Kria K26 SOM Figure 1
2026-06-12cs.CV

Stereo Vision-Based Fall Prediction and Detection using Human Pose Estimation on the AMD Kria K26 SOM

Shreyas Narasimhiah Ramesh, P. D. Rathika, Mahasweta Sarkar, Kristen Wells, Michel Audette, Christopher Paolini

aElectrical and Computer Engineering, San Diego State University, 5500 Campanile Drive, San, bDepartment of Robotics and Automation Engineering, PSG College of Technology, Peelamedu, Coimbatore, 641004, Tamil, cPsychology, San Diego State University, 5500 Campanile Drive, San Diego, 92182-4611, California, USA, dElectrical and Computer Engineering, Old Dominion University, 5115 Hampton Blvd, Norfolk, 23529, Virginia, USA

2026-06-12视觉感知三维

针对老年人跌倒需及时发现、而穿戴设备依从性和摄像头隐私受限的问题,论文在 AMD Kria K26 边缘 SOM 上构建低功耗双目/深度视觉流程:YOLOX 检人后丢弃 RGB,A2J 从深度估计 15 个三维关节,再由 CNN 判别跌倒。量化后 YOLOX IoU@0.5 为 74%,A2J 10cm mAP 为 84.13%,跌倒分类准确率 75.85%;双 DPU 多线程吞吐提升到 4.5 FPS,证明本地隐私保护方案可行但速度和精度仍有限。

2026-06-11

121 篇
Reroute, Don't Remove: Recoverable Visual Token Routing for Vision-Language Models Figure 1
2026-06-11cs.CV

Reroute, Don't Remove: Recoverable Visual Token Routing for Vision-Language Models

Cheng-Yu Yang, Shao-Yuan Lo, Yu-Lun Liu

National Yang Ming Chiao Tung University, National Taiwan University

2026-06-11视觉语言视觉感知

这篇论文针对 VLM 推理中视觉 token 多、注意力与 KV-cache 开销高的问题,指出现有“打分后永久删除”假设 token 重要性跨层稳定,易在定位任务中过早丢失后层才变重要的证据。Reroute 将删除改为可恢复路由:低分 token 暂时绕过当前层,后续仍可重新参与候选,且复用 FastV、PDrop、Nüwa 的打分与预算。实验显示,在 LLaVA-1.5 与 Qwen 系列上,激进压缩时 grounding 提升明显,同时基本保持通用 VQA 表现。

How Seemingly Inconsequential Design Choices Dictate Performance of LLMs in Pathology Figure 1
2026-06-11cs.CV

How Seemingly Inconsequential Design Choices Dictate Performance of LLMs in Pathology

Kian R. Weihrauch, Thomas A. Buckley, William Lotter, Arjun K. Manrai

Massachusetts Institute of Technology, Cambridge, MA, Harvard Medical School, Boston, MA, Dana-Farber Cancer Institute, Boston, MA

2026-06-11视觉感知

针对全切片病理图像超出通用多模态 LLM 上下文、既有基线常用小块高倍独立投票而可能低估模型能力的问题,本文系统考察推理方式、patch 尺寸、倍率和数量四个输入设计因素。核心洞察是输入配置本身可主导性能:大尺寸、低倍率并联合推理显著优于标准协议。MultiPathQA 上 GPT-5 癌种分类由 15.1% 提至最高 43.9%,器官分类由 38.1% 提至 71.6%,均衡配置还可迁移到 Qwen、Gemini 和 CPTAC,最高带来 23.4 个百分点增益。

DIRECT: When and Where Should You Allocate Test-Time Compute in Embodied Planners? Figure 1
2026-06-11cs.RO

DIRECT: When and Where Should You Allocate Test-Time Compute in Embodied Planners?

Jadelynn Dao, Milan Ganai, Yasmina Abukhadra, Ajay Sridhar, Mozhgan Nasr Azadani, Katie Luo, Clark Barrett, Jiajun Wu, Chelsea Finn, Marco Pavone

Stanford University, 2 University of Waterloo, 3 NVIDIA

2026-06-11视觉感知

这篇论文关注具身规划中一味增加测试时计算带来的高延迟与收益递减问题。作者提出 Direct,将高层 VLM 规划器视为可动态选择的组件,依据视觉场景与指令判断任务需求,在思维链深度、模型规模和记忆历史等计算轴上路由到“足够便宜且能胜任”的配置。实验显示,不同计算形式带来不同能力增益,且大量任务无需最强模型;在 VLABench、RoboMME 和 Franka DROID 实机上,Direct 可接近或达到强模型成功率,同时最高降低 65% 平均延迟。

VLGA: Vision-Language-Geometry-Action Models for Autonomous Driving Figure 1
2026-06-11cs.CV

VLGA: Vision-Language-Geometry-Action Models for Autonomous Driving

Jin Yao, Dhruva Dixith Kurra, Tom Lampo, Zezhou Cheng, Danhua Guo, Burhan Yaman

2026-06-11视觉语言视觉感知

面向自动驾驶VLA模型难以把语言推理落到连续3D空间的问题,VLGA在视觉、语言、动作之外加入参数隔离的几何专家,并用LiDAR监督的逐像素pointmap重建提供稠密空间信号,使策略不仅“看和说”还显式重建场景。在nuScenes开环中其无ego状态VLA规划平均L2降至0.50m、3秒碰撞率0.18%,Bench2Drive闭环驾驶分数达79.08,显示增益主要集中在空间精度和安全相关指标上。

Illumination-Robust Camera-Based Heart-Rate Estimation for Physiological Sensing in Robots Figure 1
2026-06-11cs.CV

Illumination-Robust Camera-Based Heart-Rate Estimation for Physiological Sensing in Robots

Zhi Wei Xu, Torbjörn E. M. Nordling

Department of Mechanical Engineering, National Cheng Kung University, Tainan, Taiwan.

2026-06-11机器人安全鲁棒

面向服务/社交机器人在日常光照变化下的无接触生理感知,论文将RGB视频rPPG心率估计做成时空Transformer框架,结合PRNet三维人脸对齐、片段级光照增强、残差时间标准化模块,并调节时间波形损失与频域KL监督的权重。静态三光照混合协议中,β=5最佳,HR MAE达0.79 bpm、相关系数0.982,相比同数据上的PhysFormer显著降低误差;但尚未验证运动机器人、在线适应和真实HRI场景。

Semantically-Aware Diver Activity Recognition Framework for Effective Underwater Multi-Human-Robot Collaboration Figure 1
2026-06-11cs.RO

Semantically-Aware Diver Activity Recognition Framework for Effective Underwater Multi-Human-Robot Collaboration

Sadman Sakib Enan, Junaed Sattar

2026-06-11机器人视觉感知

面向水下多潜水员—机器人协作中AUV需理解队友行为以保障安全与协同决策的问题,论文提出DAR-Net,用Transformer建模视频时空信息,并以像素级语义掩码通过多损失引导模型关注潜水员、机器人和目标物而非背景;同时构建含2640张标注图像、6类活动的UDA数据集。受控闭水实验显示其优于现有动作识别模型,但开放水域泛化仍文中未充分说明。

A Turbo-Inference Strategy for Object Detection and Instance Segmentation Figure 1
2026-06-11cs.CV

A Turbo-Inference Strategy for Object Detection and Instance Segmentation

Zhen Zhao, Gang Zhang, Xiaolin Hu, Liang Tang

School of Technology, Beijing Forestry University, Beijing 100091, China, Department of Computer Science and Technology, Tsinghua University, Beijing 100084, China, Beijing National Research Center for Information Science and Technology, Tsinghua University, Beijing 100084, China, Chinese Institute for Brain Research (CIBR), Beijing 100010, China

2026-06-11视觉感知

针对顶层实例分割中“检测先行、分割只被动依赖检测”的单向流程,论文提出训练无关的 turbo-inference:用分割得到的粗 mask 反向修正框和分类分数,再基于修正框重做分割,形成可迭代闭环。该策略可接入 Mask R-CNN、HTC、QueryInst 等方法,在 COCO、Cityscapes 和 iFLYTEK 上同时提升检测与分割精度,但代价是推理计算量和时延增加,适用范围也主要限于 top-down 框架。

DepthMaster: Unified Monocular Depth Estimation for Perspective and Panoramic Images Figure 1
2026-06-11cs.CV

DepthMaster: Unified Monocular Depth Estimation for Perspective and Panoramic Images

Pengfei Wang, Shihao Wang, Liyi Chen, Zhiyuan Ma, Guowen Zhang, Lei Zhang

VISUAL COMPUTING LAB, POLYU VCLAB • PREPRINT 2026, The Hong Kong Polytechnic University, Visual Computing Lab · The Hong Kong Polytechnic University, visualizations on our project page: https://polyu-vclab.github.io/DepthMaster-page.

2026-06-11视觉感知

DepthMaster针对单目度量深度在透视图与360°全景间难以统一、且全景标注稀缺的问题,将全景拆成重叠透视patch,并注入虚拟投影相机几何先验;用对应一致性损失约束patch拼接,避免改造标准Transformer,从而继承大规模透视数据先验。文中称在仅含一个全景训练集的混合数据上,于13个数据集零样本评测达到SOTA,并超过多种通用和专用模型。

Atlas H&E-TME: Scalable AI-Based Tissue Profiling at Expert Pathologist-Level Accuracy Figure 1
2026-06-11cs.CV

Atlas H&E-TME: Scalable AI-Based Tissue Profiling at Expert Pathologist-Level Accuracy

Kai Standvoss, Miriam Hägele, Rosemarie Krupar, Julika Ribbat-Idel, Jennifer Altschüler, Gerrit Erdmann, Hans Pinckaers, Evelyn Ramberger, Madleen Drinkwitz, Ádám Nárai, Alexander Möllers, Katja Lingelbach, Sebastian Kons, Lukas Hönig, Recepcan Adigüzel, Joana Baião, Alberto Megina Gonzalo, Marius Teodorescu, Marie-Lisa Eich, Paolo Chetta, Shakil Merchant, Verena Aumiller, Simon Schallenberg, Andrew Norgan, Klaus-Robert Müller, Lukas Ruff, Maximilian Alber, Frederick Klauschen

2026-06-11视觉感知

针对常规 H&E 全切片难以规模化、定量解析肿瘤微环境且 H&E 标注存在形态歧义的问题,本文提出 Atlas H&E-TME,基于病理基础模型联合组织质控、区域分割与细胞分类,生成每张切片 4500 多项细胞级读数;其关键在于用 IHC 辅助多病理专家共识做深度验证,并用 1500 余病例、8 类癌种和 20 万余标注做广度验证。结果显示模型相对 IHC 共识达到或超过 H&E-only 病理专家表现,并在多来源、多扫描仪场景下保持稳健。

Echoes of the Prior: A Computational Phenomenology of Forgetting Figure 1
2026-06-11cs.CV

Echoes of the Prior: A Computational Phenomenology of Forgetting

Gege Gao, Bernhard Schölkopf, Andreas Geiger

GEGE GAO, Eberhard Karl University of Tübingen, Germany, BERNHARD SCHÖLKOPF∗, Max Planck Institute for Intelligent Systems, Germany, ANDREAS GEIGER∗, Eberhard Karl University of Tübingen, Tübingen AI Center, Germany, CCS Concepts: • Human-centered computing →Interaction design theory, concepts and paradigms, gen, Tübingen AI Center, Tübingen, Baden-Württemberg, Germany., philosopher Descartes, we elaborate on the philosophical implications of this choice in Sec. 5.1.

2026-06-11视觉感知

论文动机是把阿尔茨海默等遗忘的主观体验从神经机制解释转化为可感知的视觉现象。其核心做法是将前馈 3D Gaussian Splatting 重建模型视作“硅脑”,分别扰动视觉编码器与 DINOv2 语义先验,模拟感知衰退和记忆衰退,形成可交互的 Deep Glitch 装置。结果展示用户调节衰减因子后场景会实时融化、幽灵化并失去空间结构;但文中未充分说明其对认知现象的定量验证。

Anatomically Conditioned Recurrent Refinement for Topology-Aware Circle of Willis Segmentation Figure 1
2026-06-11cs.CV

Anatomically Conditioned Recurrent Refinement for Topology-Aware Circle of Willis Segmentation

Juraj Perić, Marija Habijan, Dario Mužević, Irena Galić, Danilo Babin, Aleksandra Pižurica

Clinical Medical Center Osijek, Osijek, Croatia, Ghent University, Dept. of Telecommunications and Information Processing, imec-TELIN-IPI, Ghent, Belgium, Ghent University, Dept. of Telecommunications and Information Processing, TELIN-GAIM, Ghent, Belgium, While manual segmentation remains the gold standard, it is labor-intensive and subject to inter-observer variability [4]., introduced the centerline-Dice (clDice) to penalize disconnected skeletons [15]. Similarly, in the recent TopCoW

2026-06-11视觉感知

针对MRA中Willis环血管细、拓扑复杂,常规U-Net/nnU-Net易出现断裂且Dice损失难约束连通性的问题,论文提出AC2RUNet:用静态解剖特征流缓存3D结构信息,轻量动态流按时间步递归修补分割,并配合由高召回几何监督过渡到拓扑约束的课程学习。在TopCoW上,相比nnU-Net保持相近Dice,同时Hausdorff距离从9.17降至4.72 mm,Betti错误从0.40降至0.19,显示主要收益在拓扑连通性改善。

Slots, Transitions, Loops: Learning Composable World Models for ARC Figure 1
2026-06-11cs.CV

Slots, Transitions, Loops: Learning Composable World Models for ARC

Gege Gao, Bernhard Schölkopf, Andreas Geiger

University of Tübingen

2026-06-11强化学习

论文针对 ARC 中仅凭少量示例归纳视觉符号规则的问题,指出直接网格到网格预测会掩盖对象、颜色和空间关系的中间结构。作者提出 Loop-OWM,将网格表示为对象中心的世界状态,用演示条件化任务摘要推断转移规则,并通过循环转移模型迭代执行,结合密集传播与 slot 条件校正。在 ARC-1 和 ARC-2 上,该方法以相当或更少参数优于非循环及循环 ViT 基线,说明把 ARC 视为可组合状态转移能提供有效归纳偏置。

From 2D Grids to 1D Tokens: Reforming Shared Representations for Multimodal Image Fusion Figure 1
2026-06-11cs.CV

From 2D Grids to 1D Tokens: Reforming Shared Representations for Multimodal Image Fusion

Yuchen Xian, Yunqiu Xu, Yang He, Yi Yang

ReLER, The State Key Lab of Brain Machine Intelligence, Zhejiang University 2College of Artificial Intelligence, Zhejiang, University 3National University of Singapore 4CFAR, Agency for, pact and controllable organization to regulate non-local, cess as global guidance. This division of labor allows, lable global interface and preserves the 2D fusion

2026-06-11视觉语言视觉感知

本文针对多模态图像融合中2D共享特征网格难以解耦全局外观与局部细节的问题,提出用冻结的1D图像 tokenizer 作为紧凑的全局“base”载体,并通过选择性 Token 编辑仅调整少量外观敏感位置,再与2D细节通路融合。实验覆盖红外-可见光、医学融合及检测/分割下游任务,在四个常用基准上整体指标最优,显示全局一致性和局部保真度均有提升。

Natural-Language Temporal Grounding in Hour-Long Videos is a Search Problem: A Benchmark and Empirical Decomposition Figure 1
2026-06-11cs.CV

Natural-Language Temporal Grounding in Hour-Long Videos is a Search Problem: A Benchmark and Empirical Decomposition

Sukmin Seo, Geewook Kim

2026-06-11视觉语言视觉感知数据集/基准

面向小时级视频的自然语言时间定位,作者指出瓶颈不再是近邻事件识别而是长时段搜索,并构建开放基准ExtremeWhenBench(194个视频、2273问,均长75.7分钟、开放式查询)。实验将任务拆为search/localize:开放Video-LLM在该基准上显著失效,帧级CLIP检索反而更强;失败分析称85%来自搜索,retrieve-then-ground混合方案较单体Video-LLM提升6.7倍,说明长视频定位需优先改进语言条件检索。

Findings of the MAGMaR 2026 Shared Task Figure 1
2026-06-11cs.CV

Findings of the MAGMaR 2026 Shared Task

Alexander Martin, Dengjia Zhang, Joel Brogan, Francis Ferraro, Jeremy Gwinnup, Reno Kriz, Teng Long, Kenton Murray, Andrew Yates, Xiang Xiang

Johns Hopkins University, University of Maryland, Baltimore County, Air Force Research Laboratory, Human Language Technology Center of Excellence, Johns Hopkins University, University of Amsterdam, Huazhong University of Science and Technology, generated report that was labeled the best by a

2026-06-11视觉感知

针对现实信息检索日益需要跨视频、文本和多语言证据,而现有任务偏文本的问题,MAGMaR 2026 扩展为视频检索与基于检索视频的有据生成两条赛道,使用含 11 万余事件视频的 WIKIVIDEO25/MultiVENT2.0。核心洞察是将视频转为摘要、字幕等文本代理并配合大召回与推理式重排优于单一稠密嵌入;17 个检索系统均超过去年强基线,生成赛道也显示人工偏好与自动指标存在明显脱节。

Bridging the Modality Gap in Forensic Image Retrieval Figure 1
2026-06-11cs.CV

Bridging the Modality Gap in Forensic Image Retrieval

Ricardo González-Gazapo, Annette Morales-González, Yoanna Martínez-Díaz, Heydi Méndez-Vázquez, Milton García-Borroto

2026-06-11视觉感知

针对法证检索中照片、目击描述、手绘纹身/人脸素描等证据形态差异大、纯视觉匹配难以处理语义与噪声的问题,论文提出统一的多模态流程:用 MLLM 为查询和图库生成结构化文本,再以句向量比较,并与任务相关视觉特征分数融合。实验覆盖四类法证场景,结果显示文本表征在视觉信息缺失时仍有效,多模态融合整体提升检索精度和鲁棒性,但具体增益来源与规模化因素文中未充分说明。

CellNet -- Localizing Cells using Sparse and Noisy Point Annotations Figure 1
2026-06-11cs.CV

CellNet -- Localizing Cells using Sparse and Noisy Point Annotations

Benjamin Eckhardt, Dmytro Fishman, Stuart Fawke, Andrew Curtis, Bo Fussing, Constantin Pape

University of G¨ottingen, 2 Wellcome Sanger Institute, 3 University of Tartu, laborators at the Wellcome Sanger Institute study vital genes in humans via large scale, centers, the sum of Gaussian probability distributions centered, our approach to the LivECell dataset (Edlund et al., 2021) by training on the centers of mass

2026-06-11视觉感知

面向高通量基因筛选中反复活细胞计数的标注与人工成本,CellNet用少量稀疏点标注训练U-Net/ResNet回归细胞密度图,并以积分计数、局部极值定位。结果显示其在LiveCell和Sanger23上明显落后于零样本CellposeSAM(如30.5% vs 7.94% sMAPE),但仅用两张部分标注图训练后与Countess 3 FL计数有较强相关性(r=0.83);当前增益主要体现为低数据与轻量化,定位F1很低且评估流程可能有缺陷。

Finding Sparse Subnetworks in One Training Cycle via Progressive Magnitude-Based Pruning Figure 1
2026-06-11cs.CV

Finding Sparse Subnetworks in One Training Cycle via Progressive Magnitude-Based Pruning

Romana Qureshi, Hafida Benhidour, Said Kerrache, Nahlah Aljeraisy

2026-06-11视觉感知

为降低剪枝寻找“彩票票据”所需的多轮完整训练成本,本文将基于权重幅值的剪枝嵌入单次训练:按线性稀疏率日程逐轮更新全局掩码,并禁止已剪连接再生。在 CIFAR-10/MNIST 的 ResNet、VGG、LeNet 上,该方法在 ResNet-18 72.9% 稀疏率达 95.12%,高于文中引用的 LTH 90.5%;在约 97–98% 极高稀疏下也优于 SNIP/GraSP 报告值,但对比主要依赖已发表基线,公平性仍需谨慎判断。

VOID: Defeating Unauthorized Mimicry in Latent Diffusion Models Figure 1
2026-06-11cs.CV

VOID: Defeating Unauthorized Mimicry in Latent Diffusion Models

Chunlin Qiu, Ang Li, Tianxiao Huang, Ruilin Gan, Yunjie Ge, Shenyi Zhang, Huayi Duan, Lingchen Zhao, Chao Shen, Qian Wang

School of Cyber Science and Engineering, Wuhan University, School of Computer Science, Wuhan University, Institute for Math&AI, Wuhan University, The Hong Kong University of Science and Technology (Guangzhou), School of Cyber Science and Engineering, Xi’an Jiaotong University

2026-06-11生成模型

针对潜在扩散模型被用于人脸/风格等未授权模仿的问题,本文指出既有“语义引导”扰动会被 VAE 编码、扩散噪声与模型恢复先验逐步抹除。Void 改为放大模型内部随机编码误差并抵消 CFG 条件引导,使生成轨迹语义崩塌,同时用 JND 约束保持图像可用性。实验覆盖 10 类攻击、24 种防御和 5 个数据集,平均 FID 从 113 提升到 365,并保持 PSNR 34.41 dB、SSIM 0.89。

Bridging Day and Night: Unsupervised Cross-Domain Re-Identification with Synergistic Prompt and Prototype Learning Figure 1
2026-06-11cs.CV

Bridging Day and Night: Unsupervised Cross-Domain Re-Identification with Synergistic Prompt and Prototype Learning

Jiyang Xu, Rui Liu, Hang Dai

School of Computer Science, Wuhan University, Wuhan, China

2026-06-11视觉感知

针对昼夜车辆重识别中光照变化导致的强域偏移和人工标注成本高问题,本文探索无监督设定,将视觉语言模型的实例感知动态提示与日/夜域原型记忆库结合,通过域内身份关联和双向跨域原型匹配建立无标注身份对应。公开基准实验显示,其无监督 Rank-1 精度可接近现有全监督方法。

Damage-TriageFormer: A Foundation-Model Framework for Typology-Based Building Damage Assessment from Mono-Temporal Imagery Figure 1
2026-06-11cs.CV

Damage-TriageFormer: A Foundation-Model Framework for Typology-Based Building Damage Assessment from Mono-Temporal Imagery

Yiming Xiao, Yu-Hsuan Ho, Sanjay Thasma, Junwei Ma, Ali Mostafavi

Texas A&M University, Institute for a Disaster Resilient Texas, major, destroyed) or require paired pre- and post-event imagery that is often unavailable for emerging, remains difficult due to its limited examples and an inherently ambiguous label boundary, our results show, labels do not explicitly encode whether visible damage is confined to the roof, extends into structural, load-bearing elements have partially failed may both be labeled “major,” even though they call for different, imagery is available and well registered, but it is brittle in the conditions where rapid assessment matters most., formulation removes this dependency and matches the data that are often available first, including NOAA, building-footprint layers are increasingly available from local and state GIS programs as well as curated

2026-06-11视觉感知

面向灾后快速分配资源,论文指出传统损伤评估常把屋顶与结构破坏压成单一严重度,且依赖灾前/灾后配准影像。作者构建基于 NOAA 灾后单时相影像和建筑轮廓的 DamageTriage-Bench,并用 DINOv3 ViT-L、特征金字塔、实例池化与两阶段门控头预测五类损伤类型。模型在分层测试集 macro F1 为 0.619,对无损和完全结构坍塌表现较强,但全屋顶损伤因样本稀少和边界模糊仍是主要瓶颈。

DrivingAgent: Design and Scheduling Agents for Autonomous Driving Systems Figure 1
2026-06-11cs.RO

DrivingAgent: Design and Scheduling Agents for Autonomous Driving Systems

Zhongyu Xia, Wenhao Chen, Yongtao Wang, Ming-Hsuan Yang

Wangxuan Institute of Computer Technology, Peking University, University of California, Merced

2026-06-11视觉感知

面向自动驾驶系统引入基础模型后模块集成成本高、实时调度不足的问题,DrivingAgent将“设计”和“调度”拆成两类代理:前者解析网络结构、生成并用超网络训练验证新模块,后者用强化学习训练的轻量LLM结合长短期时间戳记忆动态调用模块。实验在nuScenes和Bench2Drive上显示其取得更好的速度—精度权衡,但具体增益来源仍需看消融细节。

An Electric Potential-Augmented Benchmark Dataset for Physics-Guided Image Reconstruction of Electrical Capacitance Tomography Figure 1
2026-06-11cs.CV

An Electric Potential-Augmented Benchmark Dataset for Physics-Guided Image Reconstruction of Electrical Capacitance Tomography

Xinqi Zhang, Qiming Ma, Lihui Peng

Department of Automation, Tsinghua University, Beijing 100084, China, physics behind ECT into the learning process. Generated via a COMSOL-MATLAB

2026-06-11视觉感知数据集/基准三维

针对ECT深度重建常把电容到介电率视为黑箱、忽略软场物理的问题,论文构建了电势增强基准数据集:以八电极传感器仿真生成2万组三类/四类典型流型样本,同时提供介电率图、28维电容和8个激励下全场电势图,并给出正/反问题评测协议。IID与OOD实验显示,引入电势这一潜在场信息可提升建模精度和鲁棒性,但目前仍限于二维仿真、单一几何和单一介电率对比。

Adapting Prithvi-EO for Fallow Detection for Food-Water Nexus: ViT-Adapter Necks and Parameter-Efficient Backbone tuning of Geospatial Foundation Model Figure 1
2026-06-11cs.CV

Adapting Prithvi-EO for Fallow Detection for Food-Water Nexus: ViT-Adapter Necks and Parameter-Efficient Backbone tuning of Geospatial Foundation Model

Sk Muhammad Asif, Orhun Aydin

Earth, Atmospheric and Geospatial Science Saint Louis University Saint Louis Missouri USA 63103

2026-06-11视觉感知

针对休耕地在食品—水资源管理中重要但光谱模糊、CDL 标注精度低且难以按地块检测的问题,论文将 Prithvi-EO-2.0 用于 HLS 影像休耕目标检测,系统比较 LoRA/混合 PEFT 与伪多尺度、Lite/Full ViT-Adapter 及两类检测头。核心洞察是轻量空间先验融合与选择性解冻更互补;最佳 FCOS+Hybrid PEFT+Lite ViT-Adapter+DIoU 达 mAP@50=0.9479,比无适配器锚框基线提升 25.70%。

Making Foresight Actionable: Repurposing Representation Alignment in World Action Models Figure 1
2026-06-11cs.CV

Making Foresight Actionable: Repurposing Representation Alignment in World Action Models

Lu Qiu, Yizhuo Li, Yi Chen, Yuying Ge, Yixiao Ge, Xihui Liu

The University of Hong Kong

2026-06-11强化学习

本文针对世界动作模型中“能预测合理未来却未必能输出正确动作”的失配问题,指出视频扩散特征偏重重建与外观,易让动作解码器关注无关背景。作者提出 AGRA,将中间视频特征与冻结视觉基础模型的空间语义表示对齐,以正则化世界模型到动作的接口。真实机器人操作中,AGRA使注意力更集中于手-物交互区域,ID成功率由34%提升到80%,并在语义、实例和属性泛化上分别提升27%、32%、32%。

MLT-Dedup: Efficient Large-Scale Online Video Deduplication via Multi-Level Representations and Spatial-Temporal Matching Figure 1
2026-06-11cs.CV

MLT-Dedup: Efficient Large-Scale Online Video Deduplication via Multi-Level Representations and Spatial-Temporal Matching

David Yuchen Wang, Haoying Li, Hailun Xu, Wei Chee Yew, Zirui Zhu, Sanjay Saha, Hao Hei, Kanchan Sarkar, Kun Xu

School of Computing, School of Computing National University of Singapore Singapore Singapore

2026-06-11视觉感知

面向短视频平台中近重复内容带来的推荐质量、版权与存储成本问题,MLT-Dedup用多层视频编码器同时生成稀疏片段级索引用于高覆盖召回、帧级特征按需加载用于精匹配,并以DiF-SiM建模时空重叠以支持按覆盖比例去重。真实大规模平台实验显示,在90%精度下线上重复率降低91%,同等资源下索引容量提升5倍。

SHERPA: Seam-aware Harmonized ERP Adaptation for Open-Domain 360$^\circ$ Panorama Generation Figure 1
2026-06-11cs.CV

SHERPA: Seam-aware Harmonized ERP Adaptation for Open-Domain 360$^\circ$ Panorama Generation

Jungwoon Kang, Jaehun Kim, Yiwon Yu, Hyungyum Jang, Sanghoon Lee, Jongyoo Kim

Yonsei University

2026-06-11视觉感知

针对平面文生图模型直接生成 ERP 360°全景时易出现接缝断裂、极区畸变且风格适配会削弱开放域先验的问题,SHERPA在冻结 FLUX 上引入频率选择性 Circular RoPE、循环潜编码/解码、轻量 FFN 适配器和配对/非配对双路径训练,以几何监督结合 yaw 一致性保留风格能力。实验中其在 Matterport 测试上取得最佳 FID 27.80 和 polar FID 66.29,用户研究总体优于 DiT360。

InternVideo3: Agentify Foundation Models with Multimodal Contextual Reasoning Figure 1
2026-06-11cs.CV

InternVideo3: Agentify Foundation Models with Multimodal Contextual Reasoning

Ziang Yan, Sheng Xia, Jiashuo Yu, Yue Wu, Tianxiang Jiang, Songze Li, Kanghui Tian, Yicheng Xu, Yinan He, Kai Chen, Limin Wang, Yu Qiao, Yi Wang

Shanghai Innovation Institute, Shanghai AI Laboratory, Nanjing University

2026-06-11视觉语言视觉感知

针对开放多模态模型在长视频中难以持续积累证据、调用工具并修正判断的问题,InternVideo3 将视频理解表述为共享上下文中的闭环多模态推理,并用 M²LA 压缩 KV cache 以保留完整 token 流、支撑长程 rollout。配合继续预训练、短到长 SFT、规则 RL 和教师蒸馏后,模型在 Video-MME、MLVU、EgoSchema 等长视频基准上取得开放模型中的较强表现,并展示了带检索与验证工具的视频代理能力。

DynaTok: Token-Based 4D Reconstruction from Partial Point Clouds Figure 1
2026-06-11cs.CV

DynaTok: Token-Based 4D Reconstruction from Partial Point Clouds

Weirong Chen, Keisuke Tateno, Hidenobu Matsuki, Michael Niemeyer, Daniel Cremers, Federico Tombari

2026-06-11三维

本文关注深度传感器常见的部分、无序且跨帧无对应点云序列,动机是仅靠单帧或图像线索难以恢复动态场景的完整4D结构。DynaTok将各帧编码为紧凑潜在token,用Transformer做时空聚合,并以残差token解耦几何与运动,再通过flow-matching解码完整时序点云。实验显示其在物体级和场景级基准上提升了重建质量与时间一致性。

Beyond Dark Knowledge: Mixup-Based Distillation for Reliable Predictions Figure 1
2026-06-11cs.CV

Beyond Dark Knowledge: Mixup-Based Distillation for Reliable Predictions

José Medina, Paul Honeine, Abdelaziz Bensrhair, Amnir Hadachi

2026-06-11视觉感知

本文关注知识蒸馏与 mixup 结合时的可靠性问题:学生在 mixup 样本上查询未见过该分布的教师,传统“暗知识”解释不足。作者指出这种分布错配会让教师信号更多体现混淆而非类间结构,但学生仍能在邻域区域学到更强线性与更好校准。实验在 CIFAR 和 ImageNet 上显示,KD+mixup 提升学生准确率,并将过度自信降低约一个数量级;同时温度 scaling 带来明确的准确率—校准权衡。

OpenMedReason: Scientific Reasoning Supervision for Medical Vision-Language Models Figure 1
2026-06-11cs.CV

OpenMedReason: Scientific Reasoning Supervision for Medical Vision-Language Models

Negin Baghbanzadeh, Pritam Sarkar, Michael Colacci, Abeer Badawi, Adibvafa Fallahpour, Arash Afkanpour, Leonid Sigal, Ali Etemad, Elham Dolatabadi

York University, Vector Institute, University of British Columbia, University of Toronto, University Health Network, Arc Institute, Queen’s University

2026-06-11视觉语言视觉感知

面向高风险临床应用中“答对但不可审计”的问题,OpenMedReason强调视觉证据与医学知识支撑的推理监督,而非仅训练最终答案。论文构建约45万例开放多模态医学图文问答数据,其中核心推理链来自人工撰写科研文献,并提出按感知、知识、理由三轴评测的OpenMedReason-Bench。用于SFT到GRPO后,VQA准确率较基座平均提升20%,接近同规模最强医学LVLM,推理偏好率达86.1%。

TopoCap: Learning Topology-Agnostic Motion Priors for Monocular Video-to-Animation Figure 1
2026-06-11cs.CV

TopoCap: Learning Topology-Agnostic Motion Priors for Monocular Video-to-Animation

Cheng-Feng Pu, Jia-Peng Zhang, Meng-Hao Guo, Yan-Pei Cao, Shi-Min Hu

CHENG-FENG PU, Zhili College, Tsinghua University, China, JIA-PENG ZHANG, BNRist, Department of Computer Science and Technology, Tsinghua University, China, MENG-HAO GUO, BNRist, Department of Computer Science and Technology, Tsinghua University, China, SHI-MIN HU∗, BNRist, Department of Computer Science and Technology, Tsinghua University, China, species-specific templates (e.g., SMPL) or requiring labor-intensive manual, Authors’ Contact Information: Cheng-feng Pu, Zhili College, Tsinghua University, Jia-peng Zhang, BNRist, Department of Computer, Meng-hao Guo, BNRist, Department of Computer Science and Technology, Tsinghua, Shi-Min Hu, BNRist, Department of Computer Science and Technology, retargeting for the long tail of 3D creatures. Dataset is publicly available at, fundamentally non-scalable: they fail catastrophically when applied, limiting scalability. Physics-based methods [Peng et al. 2018, 2021

2026-06-11视觉感知

面向生成式 3D 资产难以自动动画化的问题,TopoCap 试图摆脱 SMPL/SMAL 等物种模板对单目动捕的限制。核心洞察是不同骨架拓扑下的运动动力学可落在共享低维流形中,因此用 Graph/Perceiver CVAE 学习拓扑无关潜码,再由条件 flow matching 从视频特征预测潜码并按目标骨架解码。实验显示其在人类、四足基准上优于专用模型,并可对未见双足、六足、飞行动物等零样本重定向;增益可能部分来自 Mobjaverse 的大规模结构多样数据。

AerialClaw: An Open-Source Framework for LLM-Driven Autonomous Aerial Agents Figure 1
2026-06-11cs.RO

AerialClaw: An Open-Source Framework for LLM-Driven Autonomous Aerial Agents

Ke Li, Jianfei Yang, Luyao Zhang, Guo Yu, Chengwei Yan, Yuan Ding, Di Wang, Nan Luo, Gang Liu, Xiao Gao, Quan Wang

Xidian University, Xi’an University of Architecture and Technology, Xidian University Xi’an China, Xi’an University of Architecture and Technology Xi’an China

2026-06-11视觉感知

针对无人机任务仍依赖预设指令和手工串接感知、规划、控制模块的问题,AerialClaw提出开源的“brain–skill–runtime”框架,让LLM按自然语言任务在闭环中选择硬/软技能、读取反馈并经运行时安全校验执行。其文档化能力边界、记忆反思和平台无关适配器提升可检查性与复用性;系统已提供mock、PX4/Gazebo、AirSim、Web控制台和示例任务,但真实飞行效果与量化增益文中未充分说明。

Time-Conditioned and Multi-Time Survival Prediction from 2D PET/CT Projections in Lung Cancer Figure 1
2026-06-11cs.CV

Time-Conditioned and Multi-Time Survival Prediction from 2D PET/CT Projections in Lung Cancer

Ashish Chauhan, Sambit Tarai, Elin Lundström, Johan Öfverstedt, Håkan Ahlström, Joel Kullberg

Radiology, Department of Surgical Sciences, Uppsala University, Uppsala, Sweden, University, Linköping, Sweden, SciLifeLab, Uppsala University, Uppsala, Sweden

2026-06-11视觉感知

针对非小细胞肺癌中PET/CT影像生存预测对时间建模依赖尚不清楚的问题,论文比较连续时间条件与离散多时间两类策略,提出带注意力的ATCS和MTS,并分析肿瘤/组织通道与时间粒度影响。在848例数据、独立测试292例上,ATCS和MTS平均AUC约0.794/0.793,高于TCS的0.767;前者偏短期、后者偏长期,组合输入优于单一输入。

AGE-MIL: Anchor-Guided Evidence Learning for Patient-Level Prediction Figure 1
2026-06-11cs.CV

AGE-MIL: Anchor-Guided Evidence Learning for Patient-Level Prediction

Jiawei Niu, Jian Chen, Di Zhang, Junbo Lu, Zhangcheng Liao, Xuhao Liu, Honglin Zhong, Mireia Crispin-Ortuzar, Chen Li, Zeyu Gao, Yi Cai

School of Computer Science and Technology, Xi’an Jiaotong University, Xi’an, Department of Oncology, University of Cambridge, Cambridge, UK, Xiangya School of Medicine, Central South University, Changsha, Hunan, China, tently outperforms eight state-of-the-art MIL methods. Code is available

2026-06-11视觉感知

这篇论文针对病理实践中诊断需整合患者多张 WSI、而传统 MIL 多停留在单张切片层面的粒度错配问题,提出 AGE-MIL:先由切片表征构建患者级 anchor,再引导检索关键 patch 并进行证据感知融合,同时将风险建模为证据累积过程。作者在两个前列腺癌队列、约 700 名患者和 1 万张 WSI 的六个患者级任务上验证,较八种 MIL 方法平均提升约 2% AUC/准确率。

Q-Fold: Query-Aware Focus-Context Spatio-Temporal Folding for Long Video Understanding Figure 1
2026-06-11cs.CV

Q-Fold: Query-Aware Focus-Context Spatio-Temporal Folding for Long Video Understanding

Biao Tang, Xu Chen, Shuxiang Gou, Jingyi Yuan, Yuhan Zhang, Chenqiang Gao

Shenzhen Campus of Sun Yat-sen University, Harbin Institute of Technology, Shenzhen, Shenzhen Institute for Advanced Study, University of Electronic Science and Technology of China

2026-06-11视觉感知

长视频理解受视觉预算限制,均匀采样易漏关键事件,检索又可能牺牲时间覆盖。Q-Fold的核心洞察是按查询相关性以“片段”而非单帧组织输入:关键片段保留为高保真Focus Frames,次要片段折叠成保序Context Panels,从而兼顾细节、上下文和局部时序。其无需训练、可插入多种Video-MLLM,在四个长视频基准上稳定提升,超长视频最高增益达9.1个百分点。

MSUE: Multi-Modal Soccer Understanding Expert Figure 1
2026-06-11cs.CV

MSUE: Multi-Modal Soccer Understanding Expert

Litao Li, Yibo Yu, Yufeng Hu, Zhuo Yang, Jiali Wen, Yixin Chen, Yixi Zhou

South China University of Technology, Johns Hopkins University, Peking University, University of Electronic Science and Technology of China

2026-06-11视觉感知

面向足球场景 VQA 中视觉细节、时序推理与领域知识难以统一的问题,MSUE 先用 VLM 将多源足球数据合成为 3.2 万条指令样本,再由 LLM 路由到文本、图像、视频专家,结合微调 Qwen3-VL、Gemini 与 SoccerWiki/Replay 检索,并针对球衣颜色、解说等易错类做规则化细化。其在 SoccerNet VQA 挑战基准达到 0.95 准确率、列第三;但文中关于“超过第二名”的表述与名次不一致。

DAM-VLA: Decoupled Asynchronous Multimodal Vision Language Action model Figure 1
2026-06-11cs.RO

DAM-VLA: Decoupled Asynchronous Multimodal Vision Language Action model

Pankhuri Vanjani, Zhuoyue Li, Jakub Suliga, Moritz Reuss, Gianluca Geraci, Xinkai Jiang, Rudolf Lioutikov

Intuitive Robots Lab, Karlsruhe Institute of Technology (KIT), Germany, Robotics Institute of Germany

2026-06-11视觉语言视觉感知

该文针对现有 VLA 将视觉、语言、力觉等传感器强行同步到同一时钟,导致慢模态重复计算、快模态接触瞬态丢失和动作延迟的问题,提出 DAM-VLA:为各模态维护按自然频率刷新的潜在缓冲,并用门控交叉注意力接入高频力/扭矩而尽量保留预训练骨干。七个真实接触操作任务中,其平均成功率达 95.2%,显著高于最强同步基线 40.95%,并实现 100Hz 平滑控制。

ISAP-3D: Identity-Slot Aligned Part-Aware 3D Generation Figure 1
2026-06-11cs.CV

ISAP-3D: Identity-Slot Aligned Part-Aware 3D Generation

Junlin Hao, Haoshuai Fu, Xibin Song, Wei Li, Ruigang Yang, Xinggong Zhang, Jinchuan Zhang

No Institute Given, uncontrollable, demonstrate improved structural stability, controllability, and robustness, D generative modelling has become a key technology for scalable 3D content

2026-06-11三维

面向可编辑、可组合的部件级3D生成,论文指出现有方法的部件交换、合并源于语义身份与生成slot未显式对齐,提出ISAP-3D:用语义身份token锚定一对一slot,先预测身份条件布局再生成受布局约束的几何,并以局部/全局条件保持跨阶段一致。作者还构建统一语义协议的部件数据集,实验显示其在结构稳定性、可控编辑和鲁棒性上优于现有部件感知生成基线。

Non-frontal face recognition using GANs and memristor-based classifiers Figure 1
2026-06-11cs.CV

Non-frontal face recognition using GANs and memristor-based classifiers

Semih Vazgecen, Cristian Sestito, Spyros Stathopoulos, Themis Prodromakis

\orgdiv Centre for Electronics Frontiers, Institute for Integrated Micro and Nano Systems, \orgname School of Engineering, The University of Edinburgh, \orgaddress \country UK

2026-06-11视觉感知生成模型

面向无人机等低算力边缘平台中非正脸人脸难以识别的问题,论文将轻量GAN姿态正面化与忆阻器交叉阵列/SNN分类器结合,并加入未知身份拒识与在线学习机制。实验在CMU Multi-PIE和DroneFace上分别达到约96.3%和73.4%平均识别率,显示生成式补偿可缓解姿态退化,但硬件实测部署能效与增益来源仍未充分说明。

World Model Self-Distillation: Training World Models to Solve General Tasks Figure 1
2026-06-11cs.CV

World Model Self-Distillation: Training World Models to Solve General Tasks

Sebastian Stapf, Pablo Acuaviva Huertos, Aram Davtyan, Paolo Favaro

Department of Computer Science, u b UNIVERSITY OF BERN

2026-06-11强化学习

论文针对预训练视频世界模型依赖详细文本方案、难以直接用于任务规划的问题,提出 WMSD:由 VLM 从无标注场景生成任务与步骤说明,用其驱动的 Demonstrator 自蒸馏出只需图像和短指令的 Executor,并结合 VLM 反馈强化学习优化。实验显示其在 WorldTasks-Bench 上超过教师模型,并在 DreamGen 机器人任务中具备有竞争力迁移,但机器人特定动力学仍受无数据训练限制。

Tac-DINO: Learning Vision-Tactile Features with Patch Alignment Figure 1
2026-06-11cs.CV

Tac-DINO: Learning Vision-Tactile Features with Patch Alignment

Hong Li, Yankang Dong, Yue Xu, Yihan Tang, Mingzhu Li, Jiamin Qiu, Qihang Yao, Xing Zhu, Yujun Shen, Nan Xue, Yong-Lu Li

Shanghai Jiao Tong University, 2Ant Group, 3Shanghai Innovation Institute, to multiple valid tactiles. To our knowledge, existing works neglect to address tactile labeling at, Orlov et al. (2010). Hence, fine-grained vision-tactile collaborative is indispensable., lack of labeled data, we propose a data collection system to gather the largest 3D-Vision-Tactile

2026-06-11视觉感知

这篇论文针对触觉信号只对应物体局部接触、但现有视觉-触觉学习多做整图级粗对齐的问题,构建了含505个真实物体、2万余次接触的Touch3D数据集,并提出Vis-Tac全息匹配基准与基于DINOv2的VTPA局部patch对齐方法。实验显示,视觉-触觉融合优于单模态,局部对齐也优于整物体图像对齐;但作者同时指出性能仍受数据规模和触觉基础模型不足限制,部分增益可能主要来自数据与对齐标注质量。

Performance Analysis of YOLOv11 and YOLOv8 for Mixed Traffic Object Detection under Adverse Weather Conditions in Developing Countries Figure 1
2026-06-11cs.CV

Performance Analysis of YOLOv11 and YOLOv8 for Mixed Traffic Object Detection under Adverse Weather Conditions in Developing Countries

Quoc Thuan Nguyen, Ha Anh Vu, Ngo Dang Thanh Ngan, Minh Phuc Hoang Ngoc

FPT University, Ho Chi Minh City, Vietnam

2026-06-11视觉感知

面向发展中国家混合、无序交通及雨雾夜间等恶劣天气下的自动驾驶感知难题,本文将 IDD 的本地车辆类别与 BDD100K 的恶劣天气样本融合,统一为 8 类数据,并比较 YOLOv11n 与 YOLOv8n。结果显示 YOLOv11n 在 mAP@50 为 46.6% 时精度提升约 3.2%,FLOPs 从 8.1G 降至 6.3G,Tesla T4 上达 70.9 FPS,但增益可能同时来自数据筛选与架构差异。

MFEN:Multi-Frequency Expert Network for Visible-Infrared Person Re-ID Figure 1
2026-06-11cs.CV

MFEN:Multi-Frequency Expert Network for Visible-Infrared Person Re-ID

Xulin Li, Yan Lu, Bin Liu, Qinhong Yang, Qi Chu, Tao Gong, Nenghai Yu

University of Science and Technology of China, China, Anhui Province Key Laboratory of Digital Security, China, The Chinese University of Hong Kong, China

2026-06-11视觉感知

论文面向可见光-红外行人重识别中的模态差异,指出差异不仅来自波长/颜色,也来自光源导致的过曝、欠曝等照明变化,且相关身份线索分布在不同频段。MFEN用多频段专家和门控按样本自适应融合频域信息,并配合低频交换的RFA与频域辅助优化FAO。三套VI-ReID数据集实验显示该框架优于现有方法。

Metadata-Aware Multi-Prompt Reasoning for Zero-Shot Accident Understanding Figure 1
2026-06-11cs.CV

Metadata-Aware Multi-Prompt Reasoning for Zero-Shot Accident Understanding

Tarandeep Singh, Soumyanetra Pal, Soham Biswas, Nishanth Chandran

2026-06-11视觉感知

面向真实监控视频中事故瞬间短暂、类别相近且零样本缺少标注的问题,论文将事故理解拆成“何时、何类、何处”三步:先用视觉语言相似度定位碰撞窗口,再结合元数据的五视角多提示与熵门控裁决判定类型,最后按预测类型做开放词汇空间定位。方法无需微调、可在单卡运行,在 ACCIDENT@CVPR 2026 上相较中心点基线显著提升调和均值,但具体增益来源仍需更细消融支撑。

Vision Transformers for Face Recognition Need More Registers Figure 1
2026-06-11cs.CV

Vision Transformers for Face Recognition Need More Registers

Tahar Chettaoui, Guray Ozgur, Eduarda Caldeira, Naser Damer, Fadi Boutros

Fraunhofer Institute for Computer Graphics Research IGD, Germany, 2 Department of Computer Science, the Arts within their joint support of the National Research Center for Applied, widespread availability of large-scale annotated datasets [19], in low-data availability scenarios. ARTriViT [27] is a triplet

2026-06-11视觉感知

本文关注人脸识别中 CPE 型 ViT 虽优于 CLS 方案但注意力图在背景区域出现伪影、可解释性差的问题。作者在 patch 序列中加入可学习 register tokens,让模型把内部计算转移到寄存器而非低信息图像块;实验显示伪影在多种规模 ViT 中普遍存在,4/8 个寄存器可明显改善注意力结构,其中 ViT-8R 在 IJB-B/IJB-C 上达到 ViT 人脸识别方法的领先结果。

SpikeTAD: Spiking Neural Networks for End-to-End Temporal Action Detection Figure 1
2026-06-11cs.CV

SpikeTAD: Spiking Neural Networks for End-to-End Temporal Action Detection

Min Yang, Mi Zhou, Limin Wang

aState Key Laboratory for Novel Software Technology, Nanjing University, Nanjing, Jiangsu, China, is available at https://github.com/MCG-NJU/SpikeTAD.

2026-06-11视觉感知

面向移动/神经形态硬件部署,现有端到端时序动作检测模型能耗高且SNN转换常需长时间步、精度下降。SpikeTAD将ViT-S骨干与轻量多尺度检测头先按ANN训练,再分别用多阈值神经元、期望补偿和IF神经元进行ANN-SNN转换,并用量化clip-floor减小转换误差。其在THUMOS14平均mAP达67.2%、ActivityNet-1.3达37.42%,能耗显著低于ANN基线,但仍依赖预训练ANN骨干。

ViT-FREE: Efficient Face Recognition via Early Exiting and Synthetic Adaptation Figure 1
2026-06-11cs.CV

ViT-FREE: Efficient Face Recognition via Early Exiting and Synthetic Adaptation

Tahar Chettaoui, Guray Ozgur, Eduarda Caldeira, Naser Damer, Fadi Boutros

Fraunhofer Institute for Computer Graphics Research IGD, Germany, 2 Department of Computer Science, Center for Applied Cybersecurity ATHENE., information available at intermediate depths and incurring, overlooking informative signals available at intermediate, tations, potentially overlooking informative signals available

2026-06-11视觉感知强化学习

面向ViT人脸识别在移动/边缘设备上推理开销高的问题,ViT-FREE利用各Transformer层特征维度一致、表示逐层收敛的现象,在不改动或重训骨干的情况下从中间层直接早退验证;另用少量合成数据仅微调各出口投影头以补强浅层。多基准实验显示,较深出口能取得较好精度—效率折中,如第10层在IJB-C等上约提速20%,验证性能仅下降约1.5%。

FitVTON: Fit-aware Virtual Try-On via Body-Garment Size Control Figure 1
2026-06-11cs.CV

FitVTON: Fit-aware Virtual Try-On via Body-Garment Size Control

Yiqun Ning, Ao Shen, Chenhang He, Lei Zhang

Department of Computing, The Hong Kong Polytechnic University, Hong Kong, trollable garment–body fit variation. As a result, most VTON approaches formulate the task as, • Controllable Simulation Data Pipeline. We generate large-scale, aligned try-on triplets, mask supervision and texture rectification for controllable and realistic fitting on various

2026-06-11规划控制

本文针对现有扩散式虚拟试衣偏向二维补全、常生成“看起来真实但尺码不对”的中性贴合问题,提出 FitVTON:用结构化文本编码人体与服装尺寸,借助 GarmentCode/SMPL-X 可控仿真三元组学习不同体型下的悬垂、松紧和轮廓,并以双分支掩码监督与真实图像纹理校正缓解几何与域差距。作者还构建 FittingEffect3K 和 VLM/人工评测协议,结果显示其在尺码准确性和体型保持上优于强基线,同时图像质量保持竞争力。

From Nominal Intensity to Equivalent Rainfall: A Path-Based Credibility Evaluation Framework for Simulated Rainfall in Autonomous-Driving Perception Tests Figure 1
2026-06-11cs.CV

From Nominal Intensity to Equivalent Rainfall: A Path-Based Credibility Evaluation Framework for Simulated Rainfall in Autonomous-Driving Perception Tests

Tian Xia, Xin Zhao, Shaolingfeng Ye, Junyi Chen

Tian Xia, Shaolingfeng Ye, and Junyi Chen are with the College of, Automotive and Energy Engineering, Tongji University, Shanghai, China., Xin Zhao is with Tsinghua University, Beijing, China., tions [7], [8]. Virtual testing is efficient, scalable, and control-, lable, but it is still limited by the gap between virtual and real, field simulated-rainfall testing, can generate controllable and, not only for controllability and repeatability, but also for their, a layer-controllable rain simulator with an average rainfall

2026-06-11数据集/基准

针对封闭场自动驾驶感知雨淋测试常用名义雨强或单点测量、难以映射真实降雨的问题,论文提出按测试路径评估可信度:以真实雨滴粒径-速度联合分布为参照,给出路径等效雨强、不确定带和RRD,并用激光雷达点云数与反射率做感知一致性修正。约1万真实雨谱样本、728个RainSense样本和45个模拟雨场点表明,同一名义条件下仍有明显空间不均匀,Path IV与VI在稳定性、雨滴真实性和感知一致性上更均衡。

ParseFixer: An Agentic Framework for Document Parsing via Selective Multimodal Correction Figure 1
2026-06-11cs.CV

ParseFixer: An Agentic Framework for Document Parsing via Selective Multimodal Correction

LeKai Yu, Hao Liu, Kun Wang, Zhiran Li, Ruping Cao, Fan Liu, Yupeng Hu

Shandong University, Southeast University

2026-06-11视觉语言

本文关注文档页面到结构化 Markdown 的解析难题:单一多模态模型容易在版面顺序、表格公式等结构恢复中出错,整页重生成又可能引入改写或幻觉。ParseFixer 的核心思路是保留 MinerU2.5 Pro 的稳定全页解析结果,仅对可疑页面或局部元素进行多模态选择性修正,并用 verify-and-rollback 机制避免破坏可靠预测。在 DataMFM 文档解析赛道测试集上取得 61.78 总分,排名第三。

SpecLoR: Spectral Lookahead Rectification for Motion-Coherent Text-to-Video Generation Figure 1
2026-06-11cs.CV

SpecLoR: Spectral Lookahead Rectification for Motion-Coherent Text-to-Video Generation

Xu Zhang, Yu Lu, Ruijie Quan, Zhaozheng Chen, Bohan Wang, Yi Yang

ReLER, College of Artificial Intelligence, Zhejiang University, Huawei Central Research Institute

2026-06-11视觉感知

针对 Flow Matching 文生视频在 ODE 采样中误差累积导致轨迹漂移、进而出现肢体重复和运动不连贯等问题,SpecLoR 的核心洞察是漂移会表现为早期 clean lookahead latent 的时空频谱幅值异常;方法在频域按自然视频 1/f 先验校正幅值、保留相位并重噪声继续积分。文中在 Wan2.2 上报告仅增加 4 次 NFE 即减少物理伪影、提升多基准运动一致性。

Feature extraction for plant growth estimation Figure 1
2026-06-11cs.CV

Feature extraction for plant growth estimation

Simbarashe Aldrin Ngorima, Albert Helberg, Marelie H. Davel

Faculty of Engineering, North-West University, South Africa, Centre for Artificial Intelligence Research, South Africa, National Institute for Theoretical and Computational Sciences, South Africa, neural networks (CNNs) and transfer learning. We test these methods on a publicly available plant, is available online at: https://doi.org/10.1007/978-3-032-11733-5_5.

2026-06-11视觉感知

面向室内精准农业中需实时判断作物生长阶段以减少水肥浪费的问题,本文比较了两类视觉特征:结合形态学增强的 Gabor 纹理特征,以及预训练 VGG/ResNet 的迁移特征并接传统分类器。实验在油菜和萝卜 bccr-segset 数据集上显示,CNN 特征更快且更准;VGG-19+RBF-SVM 两物种均达 98.4% 准确率,单图约 0.08 秒,而相邻生长阶段仍是主要混淆来源。

Frozen Multimodal Embeddings for Personality and Cognitive Ability Assessment in Asynchronous Video Interviews Figure 1
2026-06-11cs.HC

Frozen Multimodal Embeddings for Personality and Cognitive Ability Assessment in Asynchronous Video Interviews

Kuo-En Hung, Hung-Yue Suen, Shih-Ching Yeh, Hsiang-Wen Wang

Technology Application and Human Resource Development, National Taiwan Normal University, Computer Science and Information Engineering, National Central University, Institute of Photonic System, National Yang Ming Chiao Tung University, Technology Application and Human Resource Development, National Taiwan Normal University Taiwan, Computer Science and Information Engineering, National Central University Taiwan, Institute of Photonic System, National Yang Ming Chiao Tung University Taiwan

2026-06-11视觉语言视觉感知

面向异步视频面试中标注少而视听语言特征维度高的问题,论文将人格与认知能力评估视为小样本表征学习,冻结 CLIP、Whisper 与多种文本编码器,仅训练低容量下游模型,并按人格特质做独立建模与后期融合。结果显示人格预测验证 MSE 从官方 0.3334 降至 0.2696;认知能力任务虽高于基线,但更强的主体属性模型提示存在数据捷径,需谨慎解释。

Corpus Augmentation for Sign Language Translation via LLM-Guided Video Stitching Figure 1
2026-06-11cs.CV

Corpus Augmentation for Sign Language Translation via LLM-Guided Video Stitching

Zsolt Robotka, Ádám Rák, Jalal Al-Afandi, András Horváth, György Cserey

Peter Pazmany Catholic University, (Z. Robotka also with DeepSign Technologies Ltd., Budapest, Hungary)

2026-06-11视觉感知

针对手语翻译中高质量视频—文本微调数据稀缺、长尾词和新句式泛化受限的问题,论文提出无需额外标注、外部视频或生成视频模型的语料增强:用 CTC 强制对齐切出单 gloss RGB 片段,借助受语料约束的 LLM 生成新 gloss—句子对,再随机拼接成合成训练样本。该数据直接用于 GFSLT-VLP 微调,在不改架构和训练协议下 BLEU-4 从 21.38 提升到 24.30;同时发现平滑拼接反而有害,突兀边界可能起正则化作用。

From Content to Knowledge: Lightning Fast Long-Video Understanding with Neural Knowledge Representations Figure 1
2026-06-11cs.CV

From Content to Knowledge: Lightning Fast Long-Video Understanding with Neural Knowledge Representations

Yuchen Guan, Xiao Li, Zongyu Guo, Xiaoyi Zhang, Xiulian Peng, Chun Yuan, Yan Lu

Tsinghua Shenzhen International Graduate School, Tsinghua, University, Shenzhen, China 2Microsoft Research Asia. Corre-

2026-06-11视觉感知

针对长视频在多轮问答中反复编码视觉 token 或检索数据库导致高延迟、高显存的问题,论文提出将单个视频的语义知识蒸馏为可挂载到冻结 VLM 上的神经知识表示 NKR,本质上是一组视频专属 LoRA 参数;AKD 自动生成密集描述与问答来离线优化该表示。实验显示在 LVBench 等长视频基准上精度接近现有强方法,同时端到端延迟降低两个数量级以上,推理时额外视频内存几乎为零。

Wild3R: Feed-Forward 3D Gaussian Splatting from Unconstrained Sparse Photo Collection Figure 1
2026-06-11cs.CV

Wild3R: Feed-Forward 3D Gaussian Splatting from Unconstrained Sparse Photo Collection

Yuto Furutani, Takashi Otonari, Kaede Shiohara, Toshihiko Yamasaki

The University of Tokyo, Project page: https://furuschool.github.io/wild3r-page

2026-06-11三维

Wild3R针对野外稀疏照片集中光照变化、曝光差异和临时遮挡导致前馈3DGS几何重复、外观不一致的问题,核心洞察是瓶颈可能主要来自训练数据而非复杂架构;作者构建含200场景、170种光照和临时物体的WildCity,并微调现有前馈模型,使其按参考视图生成去临时物体、外观一致的高斯。在Photo Tourism等基准上优于既有前馈方法,接近需相机或点云初始化的逐场景优化方法,且推理约1秒。

Task-Aligned Stability Analysis of Vision-Language Models for Autonomous Driving Hazard Detection Figure 1
2026-06-11cs.CV

Task-Aligned Stability Analysis of Vision-Language Models for Autonomous Driving Hazard Detection

Everett Richards

2026-06-11视觉语言视觉感知

本文关注自动驾驶中 VLM 危险检测的鲁棒性:仅看图像嵌入漂移可能无法反映安全相关决策变化。作者用 CLIP 图文相似度构造任务对齐的 hazard margin,并在 BDD100K 上比较七类腐蚀下的嵌入漂移、margin 漂移和判定翻转。结果显示二者关系强烈依赖腐蚀类型,JPEG/下采样较可预测,而运动模糊、遮挡可在嵌入变化不大时诱发高翻转;多数腐蚀导致漏检,遮挡更易误报。

Image Quality Assessment of Identity Cards Using Measures from Open Face Image Quality Figure 1
2026-06-11cs.CV

Image Quality Assessment of Identity Cards Using Measures from Open Face Image Quality

Gregor Grote, Juan E. Tapia, Christian Rathgeb

Darmstadt University of applied science, Darmstadt, Germany, concerns, as there are no public datasets available that contain, Proposed but no algorithm available in OFIQ.

2026-06-11视觉感知

面向远程身份核验中证件图像质量不稳会干扰呈现攻击检测的问题,本文将 OFIQ 的采集相关人脸质量指标迁移到身份证图像,加入角点检测、透视归一化、前景遮罩,并为光照均匀性设计新算法。四个证件数据集和三种 PAD 方法上的误差-丢弃分析显示,锐度与欠曝光筛选能稳定提升 PAD 表现,其他亮度、动态范围和压缩指标仅在部分系统中有中等影响。

SG2Loc: Sequential Visual Localization on 3D Scene Graphs Figure 1
2026-06-11cs.CV

SG2Loc: Sequential Visual Localization on 3D Scene Graphs

Nicole Damblon, Olga Vysotska, Federico Tombari, Marc Pollefeys, Daniel Barath

2026-06-11三维

针对室内机器人/AR定位依赖大规模图像库或带特征点云、存储和传输成本高的问题,SG2Loc用对象级3D场景图替代密集地图,并在粒子滤波中将查询图像patch语义与投影的粗物体网格匹配,随序列逐步收敛位姿。实验显示其在ScanNet、3RScan等真实数据上以显著更低存储开销达到与HLoc、MeshLoc等接近、部分场景更好的精度,但逐帧计算开销仍偏高。

Task-Aware Structured Memory for Dynamic Multi-modal In-Context Learning Figure 1
2026-06-11cs.CV

Task-Aware Structured Memory for Dynamic Multi-modal In-Context Learning

Zhirui Chen, Ziwei Chen, Ling Shao

2026-06-11视觉感知

本文针对多模态 Many-Shot ICL 中长图文序列带来的 KV cache 显存与延迟瓶颈,提出免训练的 TASM,将缓存视为任务结构记忆而非静态 token 缓冲:用任务向量估计跨示例重要性,以二分图语义合并替代硬剪枝,并用 Core Memory/Latent Bank 支持按查询动态取回。实验称在 IllusionVQA、MME-RealWorld、ImageNet-100 等上接近全上下文性能,同时最高减少约 80% 内存占用。

SheafStain: Sheaf-Theoretic Schrödinger Bridge for Spatially and Biologically Coherent Virtual Staining Figure 1
2026-06-11cs.CV

SheafStain: Sheaf-Theoretic Schrödinger Bridge for Spatially and Biologically Coherent Virtual Staining

Hyeongyeol Lim, Hongjun Yoon, Eunjin Jang, Daeky Jeong, Won June Cho, Hwamin Lee

Department of Medical Informatics, College of Medicine, Korea University, DEEPNOID Inc.

2026-06-11视觉感知

针对全切片虚拟染色中小块独立推理导致的边界断裂、色调漂移和同一区域表征不一致,论文将这种“上下文污染”形式化为违反粘合公理的层论问题。SheafStain把病理VFM的CLS与patch token作为薛定谔桥的层式空间条件,并用像素层损失、cocycle粘合损失及FFT自适应覆盖约束训练/推理一致性。在HER2、ER、PR、Ki-67的1024×1024拼接评测中优于六个基线并减轻拼接伪影。

Scene-Adaptive Nonlinear Tone Curves for Pseudo Ground-Truth Generation in Low-Light 3D Gaussian Splatting Figure 1
2026-06-11cs.CV

Scene-Adaptive Nonlinear Tone Curves for Pseudo Ground-Truth Generation in Low-Light 3D Gaussian Splatting

Mingzhe Lyu, Jinqiang Cui, Hong Zhang

Shenzhen Key Laboratory of Robotics and Computer Vision, Southern University of, Pengcheng Laboratory, Shenzhen, 518108, China., targets when paired normal-light references are unavailable. Existing pseudo-GT methods apply a, their different mathematical forms, suggesting the improvement is curve-agnostic. Code is available, normal-light references are unavailable.

2026-06-11三维

本文针对低光照 3DGS 中伪真值常用线性增益会过曝高亮、又难以充分提升暗部的问题,提出仅替换伪 GT 生成的场景自适应非线性 tone curve 框架,通过百分位归一化、黑电平偏移和 ASE/AP3 两类曲线增强监督信号而不改骨干。在 21 个场景上相较线性基线稳定提升,LOM/RealX3D 的 PSNR 最高增益分别达 +4.34/+3.25 dB,且两种曲线表现接近,说明收益主要来自非线性映射本身。

Plan-and-Verify Video Reward Reasoning with Spatio-Temporal Scene Graph Grounding Figure 1
2026-06-11cs.CV

Plan-and-Verify Video Reward Reasoning with Spatio-Temporal Scene Graph Grounding

Hyomin Kim, Junghye Kim, Joanie Hayoun Chung, Yoonjin Oh, Kyungjae Lee, Sungbin Lim, Sungwoong Kim

Department of Artificial Intelligence, Korea University, 2Department of Statistics, Korea University

2026-06-11视觉语言视觉感知强化学习

面向文生视频后训练中“奖励模型漏检细粒度语义违背”的问题,论文提出 SG-PVR:先把提示词拆成带重要性的原子核验项,再从视频抽取时空场景图,将实体、属性和时间关系作为显式证据,与原视频共同逐项验证并汇总评分。实验显示其在语义对齐和细粒度时间语义评测上表现领先,用作测试时重排序器还能提升生成视频的组合对齐。

LASA: A Weak Supervision Method for Open-Vocabulary Scene Sketch Semantic Segmentation Figure 1
2026-06-11cs.CV

LASA: A Weak Supervision Method for Open-Vocabulary Scene Sketch Semantic Segmentation

Liwen Yi, Xianlin Zhang, Yue Zhang, Yue Ming, Xueming Li

Beijing University of Posts and, to assign dense semantic labels to sparse line drawings based, code will be made publicly available., to assign dense semantic labels to sparse line drawings using, ] to sketch parsing and labeling [15], and then to multi-

2026-06-11视觉感知

针对场景草图缺少纹理颜色、弱监督下区域定位约束不足,导致现有开放词汇分割模型在稀疏笔画上不稳定的问题,LASA利用ViT不同层注意力的互补性:浅层表征全局布局、深层捕捉局部笔画部件,并聚合为跨层结构先验,结合层级语义对齐和推理阶段注意力细化。在FS-COCO、SFSD、FrISS上较既有弱监督基线mIoU分别提升3.43、8.01、15.74。

TextHOI-3D: Text-to-3D Hand-Object Interaction via Discrete Multi-View Generation and Joint Mesh Optimization Figure 1
2026-06-11cs.CV

TextHOI-3D: Text-to-3D Hand-Object Interaction via Discrete Multi-View Generation and Joint Mesh Optimization

Zixiong Hao, Zhencun Jiang

Technical University of Munich, School of Computation, Information and Technology, Tongji University, Shanghai Research Institute for Intelligent Autonomous Systems

2026-06-11优化算法三维

针对文本生成手-物交互网格中语义一致、跨视角几何、手部关节形态和接触物理约束难以同时满足的问题,TextHOI-3D将任务拆成“文本到多视图再到网格”:用VQ-VAE学习固定相机多视图离散token,结合CLIP条件VAR生成视图,再通过先验初始化、多视图联合优化和抗穿透细化恢复手物网格。在HO3D衍生评测中,多视图相较单视图将物体CD从17.26mm降至4.92mm,穿透体积从5.3721cm³降至0.2193cm³。

MultiToP: Learning to Patch Visual Tokens to Mitigate Hallucinations in Video Large Multimodal Models Figure 1
2026-06-11cs.CV

MultiToP: Learning to Patch Visual Tokens to Mitigate Hallucinations in Video Large Multimodal Models

Yuansheng Gao, Wenbin Xing, Jiahao Yuan, Kaiwen Zhou, Han Bao, Zonghui Wang, Wenzhi Chen

Zhejiang University, Sun Yat-sen University, East China Normal University

2026-06-11视觉语言视觉感知

针对视频大多模态模型易把语言先验或不可靠视觉证据放大为幻觉的问题,MultiToP把干预粒度下探到视觉token:用轻量Visual Token Patcher预测需替换的token,并以动态全局patch token局部修补,同时用答案条件的帧级信息线索做排序校准训练。实验显示其在几乎不增加推理开销且不改原模型的情况下,降低Vript-HAL幻觉,Qwen3-VL-4B-Instruct F1相对提升50.60%,并在ActivityNet-QA上保持甚至提升通用视频理解能力。

A Comprehensive Ecosystem for Open-Domain Customized Video Generation Figure 1
2026-06-11cs.CV

A Comprehensive Ecosystem for Open-Domain Customized Video Generation

Jingxu Zhang, Yuqian Hong, Daneul Kim, Kai Qiu, Qi Dai, Jianmin Bao, Yifan Yang, Xiaoyan Sun, Chong Luo

University of Science and Technology of China, Seoul National University, this, we introduce PexelsCustom-1M, the first publicly available, • PexelsCustom-1M: The first large-scale, publicly available, • Scalable Data Pipeline: A reproducible framework for har-, Center Frame, the center frame of each video. Since VLMs naturally emphasize, identity. Specifically, the extracted identities and the center frame, original caption,center frame and cropped reference image to GPT-

2026-06-11视觉感知

本文针对开放域定制视频生成中身份保持数据稀缺、类别覆盖窄和逐身份微调成本高的问题,构建 PexelsCustom-1M 百万级身份-文本-视频数据集,并提出用 3DVAE 参考特征、RoPE 偏置与 LoRA 适配的 CustoMDiT,仅增加约 8% 可学习参数。实验在既有基准和含 1000+ 类的 OpenCustom 上优于现有方法及部分商业 API,但增益可能主要来自数据规模与清洗流程。

Seeing What Matters: Perceptual Wrapper with Common Randomness for 3D Gaussian Splatting Figure 1
2026-06-11cs.CV

Seeing What Matters: Perceptual Wrapper with Common Randomness for 3D Gaussian Splatting

He-Bi Yang, Jing-Zhong Chen, Yen-Kuan Ho, Sang NguyenQuang, Fan-Yi Hsu, Yun-Yu Lee, Jui-Chiu Chiang, Wen-Hsiao Peng

2026-06-11三维

该文针对3DGS在高频纹理、低存储和RDO压缩场景中易模糊、且传统L1/SSIM难以对应感知质量的问题,提出一个可插拔的2D感知wrapper:在渲染图像域用轻量合成网络,结合Plücker视线嵌入与共享伪随机噪声,并以Wasserstein Distortion匹配局部特征统计来合成感知可信纹理。实验显示其可接入vanilla、紧凑和RDO 3DGS,在主观/客观感知质量上优于基线,并在相近感知分数下显著降低模型或文件大小,但代价是训练与渲染开销增加。

Battery detection of XRay images using transfer learning Figure 1
2026-06-11cs.CV

Battery detection of XRay images using transfer learning

Nermeen Abou Baker, David Rohrschneider, Uwe Handmann

- Ruhr West University of Applied Sciences - Dept of Computer Science

2026-06-11视觉感知

面向电子废弃物回收、安检等场景中电池难以人工安全识别与分拣的问题,本文用XRay图像和两阶段迁移学习:先在HiXray电子设备数据上微调YOLOv5m,再将权重迁移到手工标注的三类锂电池检测。结果显示电池检测精度约94%,较直接COCO预训练权重高约5个百分点,单张推理22ms;但类别不均衡和遮挡使圆柱电池表现较弱。

AnchorEdit: Maintaining Temporal Consistency in Multi-turn Image Editing via Causal Memory Figure 1
2026-06-11cs.CV

AnchorEdit: Maintaining Temporal Consistency in Multi-turn Image Editing via Causal Memory

Hang Xu, Xiaoxiao Ma, Guohui Zhang, Yu Hu, Siming Fu, Jie Huang, Lin Song, Haoyang Huang, Nan Duan, Feng Zhao

University of Science and Technology of China, JD Explore Academy

2026-06-11视觉感知

多轮图像编辑在迭代创作中易出现身份漂移与误差累积,且现有借用视频先验的方法多为双向上下文,和在线因果编辑不匹配。AnchorEdit将自回归视频扩散改造为高分辨率多轮编辑框架,通过身份保持预训练、自回滚因果微调、4步一致性蒸馏,以及以初始图像为锚的记忆与受限RoPE来稳定长程推理。论文还构建1024p多轮基准,实验显示其在10轮以上编辑中较现有方法更能保持主体一致性、视觉质量和指令遵循。

From Prompts to Tokens: Internalizing Causal Supervision in Vision-Language Model for Multi-Image Causal Reasoning Figure 1
2026-06-11cs.CV

From Prompts to Tokens: Internalizing Causal Supervision in Vision-Language Model for Multi-Image Causal Reasoning

Haoping Yu, Yuanxi Li, Jing Ma

Department of Computer & Data Sciences, Case Western, University, Cleveland, OH, US. Correspondence to: Jing Ma, All Available, include node/edge labels of causal graphs), since construct-

2026-06-11视觉语言视觉感知

针对多图像干预与反事实视觉因果推理中,VLM 仅把因果图或解释作为提示而难以内化执行的问题,论文提出 BridgeVLM:从图像诱导 DAG,将变量关系转成可被解码器持续关注的 Causal Tokens,并用 RAMP 做路由消息传播,M3S 对齐缺失或多粒度因果监督。实验显示其相较提示级监督显著提升,CausalVLBench 干预准确率 33.2%→54.4%,因果结构 F1 33.4%→75.1%,Causal3D 也有提升。

UniReason-Med: A Shared Grounded Reasoning Interface for 2D-to-3D Transfer in Medical VQA Figure 1
2026-06-11cs.CV

UniReason-Med: A Shared Grounded Reasoning Interface for 2D-to-3D Transfer in Medical VQA

Mengzhuo Chen, Yan Shu, Chi Liu, Hongming Piao, Xidong Wang, Derek Li, Bryan Dai

2026-06-11三维

面向医学 VQA 中 2D 影像标注充足而 3D 体数据推理困难的问题,论文提出 UniReason-Med,用统一的框语法、区域 token 注入和 grounded CoT 接口,让单一模型同时处理 2D 图像与切片序列化 3D 体。作者构建 22 万样本 UniMed-CoT,并以 SFT 加 GRPO 训练;消融显示 2D+3D 联合监督较 3D-only 明显提升 3D 推理,grounding 与区域注入对两类任务均有收益。

Multi-View In-Cabin Monitoring System for Public Transport Vehicles Figure 1
2026-06-11cs.CV

Multi-View In-Cabin Monitoring System for Public Transport Vehicles

Evgeny Gorelik, Kenny Dean Karrow, Fikret Sivrikaya, Sahin Albayrak, Christian Baumann

2026-06-11视觉感知

面向公交车厢内乘客计数、定位与安全监测,论文指出单视角数据难以应对拥挤遮挡和有限视角,因而构建了德国城市公交内四路RGB-D相机加旋转LiDAR的同步多模态数据集。其核心在于标定与伪标注流程,可生成3D人体姿态、跨视角轨迹和有向3D框,并转为nuScenes格式;数据含9136帧、13484个标注。基准实验覆盖LSS、BEVFusion等模型,单相机漏检率最高达60.69%,验证多视角设置必要性,但紧阈值性能仍受标签噪声与标定敏感性限制。

Ouroboros-Spatial: Closing the Data-Model Loop for Spatial Reasoning Figure 1
2026-06-11cs.CV

Ouroboros-Spatial: Closing the Data-Model Loop for Spatial Reasoning

Enhan Zhao, Wei Wu, Yuanrui Zhang, Xueliang Zhao, Di He

Peking University, The University of Hong Kong

2026-06-11视觉感知

针对多模态大模型空间推理训练依赖静态大规模数据、样本难度与模型阶段不匹配的问题,Ouroboros-Spatial把模型置于提问者与解题者闭环中:由提问者基于3D元数据和视频生成可执行验证的QA,解题者置信度反哺下一轮难度调节。用仅25.6k样本微调Qwen3-VL-4B/8B,在VSI-Bench达62.7/63.3,并在去偏和其他空间基准上保持迁移增益。

ERN-Net : Evolving Reason Node-Net for Document Binarization Figure 1
2026-06-11cs.CV

ERN-Net : Evolving Reason Node-Net for Document Binarization

Hsin-Jui Pan, Sheng-Wei Chan, Jen-Shiung Chiang

Tamkang University

2026-06-11视觉感知

针对退化文档二值化中淡笔画、断裂字符和噪声背景易出错且统一处理低效的问题,ERN-Net在ConvNeXt-Tiny编码器上引入Top-K演化推理节点、多尺度空洞分支和空间难度门,集中增强困难区域。DIBCO系列实验平均FM达89.35、DRD为2.99;ConvNeXt-Tiny较ResNet-101显著更省显存且更准,预训练在不增推理显存下进一步提升,但部分增益可能来自数据扩充。

MedCTA: A Benchmark for Clinical Tool Agents Figure 1
2026-06-11cs.CV

MedCTA: A Benchmark for Clinical Tool Agents

Tajamul Ashraf, Hyewon Jeong, Fida Mohammad Thoker, Bernard Ghanem

King Abdullah University of Science and Technology (KAUST), Saudi Arabia, Massachusetts Institute of Technology (MIT), USA

2026-06-11数据集/基准

针对现有医学评测多停留在感知或单轮问答、难以暴露临床工具调用中的规划与执行失败,MedCTA构建了含107个真实多模态临床任务、5个可执行工具和医生验证轨迹的过程感知基准。对18个模型的测试显示,最佳自主工具使用准确率仅31.54%,严格轨迹成功率为0;给定金标准路由可提升最多35%,说明瓶颈主要在控制器和工具编排可靠性。

RankVR: Low-Rank Structure Perception and Value Recalibration for Robust Composed Image Retrieval Figure 1
2026-06-11cs.CV

RankVR: Low-Rank Structure Perception and Value Recalibration for Robust Composed Image Retrieval

Jiale Huang, Zixu Li, Zhiheng Fu, Zhiwei Chen, Qinlei Huang, Yupeng Hu

Shandong University, lowering standards risks mislabeling low-value noise as high-value

2026-06-11视觉感知三维安全鲁棒

针对组合图像检索中参考图、修改文本与目标图三元组易含噪、且传统逐样本置信度难区分局部匹配噪声与高价值难样本的问题,RankVR将噪声识别转向批量相关结构:用相关矩阵有效秩感知破坏全局低秩语义一致性的样本,并结合训练潜力与可靠性动态重标定样本价值。文中在 FashionIQ 和 CIRR 上报告其优于现有方法,显示在噪声环境下更稳健。

DroneShield-AI: A Multi-Modal Sensor Fusion Framework for Real-Time Autonomous Drone Threat Detection, Behavioral Intent Classification, and Swarm Intelligence in Contested Airspace Figure 1
2026-06-11cs.CV

DroneShield-AI: A Multi-Modal Sensor Fusion Framework for Real-Time Autonomous Drone Threat Detection, Behavioral Intent Classification, and Swarm Intelligence in Contested Airspace

Marius Bayizere

Code, model weights, and simulation datasets: publicly available at submission (see Section VI.D), Networks. Evaluated on three publicly available real-world datasets (DroneRF, OpenSky Network, a target of 500+ labelled sorties by Q4 2026. All code, model weights, and simulation datasets are, The global proliferation of commercially available unmanned aerial vehicles (UAVs) has created a security

2026-06-11视觉感知

针对小型无人机在低空、静默或集群攻击中绕过单一传感器且预警时间短的问题,DroneShield-AI提出RF、声学、YOLOv8视觉与证据加权融合,并加入BICE意图分类和GAT集群分析。在公开数据与仿真评估中融合检测率96.1%、误报3.2%、延迟142ms;但BICE/GNN-SIM主要基于物理校准仿真,真实外场验证仍在进行。

Reason, Then Re-reason: Cross-view Revisiting Improves Spatial Reasoning Figure 1
2026-06-11cs.CV

Reason, Then Re-reason: Cross-view Revisiting Improves Spatial Reasoning

Chaofan Ma, Zhenjie Mao, Yuhuan Yang, Fanqin Zeng, Yue Shi, Yingjie Zhou, Xiaofeng Cao, Jiangchao Yao

plementary viewpoints become available. Build-, Cooperative Medianet Innovation Center, Shanghai Jiao Tong, University 2Shanghai Jiao Tong University 3Tongji University., available (e.g., a viewpoint revealing an occluded region, or, and task-specific heavy training, limiting scalability. More

2026-06-11视觉感知

本文针对自我中心视频视角受限、单轮空间推理易依赖语义先验而出错的问题,提出训练-free 的 ReRe:先让 MLLM 基于原视频形成空间假设,再利用预测 3D 几何合成的高位斜视新视角视频进行复核与修正。其核心洞察是把空间推理做成可回访过程,并保持原生视频接口无需改模型。VSI-Bench 与 STI-Bench 结果显示,该方法显著提升开源 MLLM,性能接近闭源 SOTA。

Parameter-Efficient Adapter Tuning for Tabular-Image Multimodal Learning Figure 1
2026-06-11cs.CV

Parameter-Efficient Adapter Tuning for Tabular-Image Multimodal Learning

Jiaqi Luo

2026-06-11视觉语言视觉感知

本文针对表格-图像多模态任务中全量微调成本高、完全冻结又适配不足的问题,提出 TI-Adapter:冻结 TabPFN 表格编码器并在表格嵌入后加适配器,同时在 ResNet 图像分支的嵌入层和瓶颈层插入轻量适配器。20 个分类与回归数据集实验显示,其性能可与全量微调相当或更好,且显著减少可训练参数;消融表明适配器插入深度会影响性能与显存开销的权衡。

ARGUS: Stacked Multi-View Identity Mosaic Injection for Subject-Preserving Video Generation Figure 1
2026-06-11cs.CV

ARGUS: Stacked Multi-View Identity Mosaic Injection for Subject-Preserving Video Generation

Zijie Meng, Jiwen Liu, Yufei Liu, Chengzhuo Tong, Xiaoqiang Liu, Yuanxing Zhang, Yulong Xu, Pengfei Wan

Peking University, Xiamen University, We introduce Argus, a Wan-based framework centered on Stacked, A second principle of Argus is that scalable identity supervision need not rely on cross-

2026-06-11视觉感知

这篇论文针对主体保持视频生成中单张参考图易把身份与姿态、遮挡、光照等偶然因素绑定的问题,提出 Argus 将身份视为多视角动态分布。其核心 SMII 把 MLLM 选出的图像/视频证据组织成 3×3 马赛克,并作为 Wan 原生 token 空间中的负时间只读记忆注入,配合反事实训练、TIA 与 ASLG 提升鲁棒性。在 OpenS2V-Eval Human-Domain 上达到 64.38 总分,并在 HardID-Celeb 上显著提升大偏航和遮挡场景指标。

Learning Instance-Adaptive Low-Rank Orthogonal Subspaces for Clothes-Changing Person Re-Identification Figure 1
2026-06-11cs.CV

Learning Instance-Adaptive Low-Rank Orthogonal Subspaces for Clothes-Changing Person Re-Identification

Dong-Woo Kim, Tae-Kyun Kim

School of Computing, KAIST, Daejeon, South Korea. Corre-

2026-06-11视觉感知

针对换衣行人重识别中服装外观易误导身份匹配的问题,Ortho-ReID将服装视为VLM表征中的低秩线性子空间:用服装文本嵌入SVD初始化基,借助图像patch交叉注意力生成实例自适应正交基,并约束身份特征与其正交以去除服装信息。实验在PRCC、Celeb-reID-light和LaST分别取得Top-1约5.9%、3.5%、5.3%的提升,LTCC上也保持竞争力。

Motion Reinforces Appearance: RGB-Skeleton Gated Residual Fusion for Micro-Gesture Online Recognition Figure 1
2026-06-11cs.CV

Motion Reinforces Appearance: RGB-Skeleton Gated Residual Fusion for Micro-Gesture Online Recognition

Jialin Liu, Xinwen He, Pengyu Liu, Jiale Shi, Huaijuan Zang, Yanbin Hao

School of Computer Science and Information Engineering, Hefei University of

2026-06-11视觉感知

本文面向未裁剪视频中的微手势在线识别,针对动作幅度小、边界模糊且单一 RGB 或骨架模态容易丢失关键信息的问题,提出 DyFADet+:将 RGB 与骨架投影到共享多尺度时序表示,并用门控残差融合选择性注入可靠骨架运动,而非直接拼接。模型在 SMG/MiGA 赛道取得 F1=40.88、官方第 2,消融显示优于单模态和朴素融合。

Adapting Vision-Language Models from Iconic to Inclusive for Multi-Label Recognition Without Labels Figure 1
2026-06-11cs.CV

Adapting Vision-Language Models from Iconic to Inclusive for Multi-Label Recognition Without Labels

Cheng Chen, Jingyu Zhou, Yifan Zhao, Jia Li

Multi-Label Recognition Without Labels, Abstract Understanding multi-label images remains, without labeled data. However, due to their intrinsic de-, conflicts with the nature of multi-label learning, thereby, label-free multi-label image recognition. Our approach, State Key Laboratory of Virtual Reality Technology and, Systems, SCSE & QRI, Beihang University, Beijing 100191, to adjust the labels to better conform to the multi-label, notations. Our code is publicly available at https://, Keywords Multi-label Image Recognition · Unsuper-, Multi-label image recognition aims at predicting multi-, in multi-label learning is achieved by the construction

2026-06-11视觉语言视觉感知

这篇论文针对 CLIP 等视觉语言模型在多标签识别中偏向最显著物体、漏掉上下文正类的问题,提出无需人工标签的 TailorCLIP 框架:先通过多采样局部响应“切分”出潜在物体线索,再用多物体混合适配和置信校正“缝合”成更符合多标签分布的训练信号,并以 EM 迭代优化。实验显示其在四个公开数据集上显著优于现有无监督方法,且超过若干弱监督基线。

Precision-Aware Illumination-Disentangled Vision Transformer for Spacecraft 6D Pose Estimation Figure 1
2026-06-11cs.CV

Precision-Aware Illumination-Disentangled Vision Transformer for Spacecraft 6D Pose Estimation

Zongwu Xie, Yifan Yang, Yonglong Zhang, Guanghu Xie, Yang Liu, Shuo Zhang

The authors are with the School of Mechatronics Engineering, Institute, object labels, translation, and rotation from RGB images

2026-06-11视觉感知三维

面向在轨服务中单目航天器 6D 位姿估计易受强光、阴影、反光和弱纹理干扰的问题,PAID-ViT 将 ViT token 分解为结构与光照外观成分,并用patch可靠性加权聚合、前景mask监督和无参数几何恢复来稳定直接回归。SPEED+ V2实验显示其降低平移误差,在sunlamp强光域更稳;消融支持解耦、可靠性聚合和训练正则的互补作用。

Adv-TGD: Adversarial Text-Guided Diffusion for Face Recognition Impersonation Attacks Figure 1
2026-06-11cs.CV

Adv-TGD: Adversarial Text-Guided Diffusion for Face Recognition Impersonation Attacks

Omid Ahmadieh, Nima Karimian

University of South Florida, Bellini College of Artificial Intelligence, Cybersecurity and Computing, University of South Florida, Bellini College of Artificial Intelligence, Cybersecurity and Computing Tampa Florida USA

2026-06-11视觉感知生成模型

针对人脸识别被未授权利用及现有噪声/补丁攻击不自然、扩散攻击效率和可编辑性受限的问题,Adv-TGD在Stable Diffusion 2.1上为每个源-目标身份对微调跨注意力LoRA,并用SGSM面部显著掩码、潜空间融合与复合身份损失实现局部、逼真的冒充式对抗编辑。黑盒评测中其在IR152、IRSE50、MobileFace、FaceNet上的平均ASR达85.90%,较Adv-CPG高6.25点,同时保持PSNR 27.15 dB、SSIM 0.981,并展示到LADN、ImageNet和FLUX.1的可迁移性。

Information-Theoretic Decomposition for Multimodal Interaction Learning Figure 1
2026-06-11cs.LG

Information-Theoretic Decomposition for Multimodal Interaction Learning

Zequn Yang, Yake Wei, Haotian Ni, Zhihao Xu, Di Hu

Gaoling School of Artificial Intelligence, Renmin University of China, Beijing, 2Beijing Key Laboratory of, Research on Large Models and Intelligent Governance, 3Engineering Research Center of Next-Generation, Intelligent Search and Recommendation, MOE, 4Beihang University, Beijing, 5Gaotu Techedu Inc., available at https://github.com/GeWu-Lab/DMIL., Code: https://github.com/GeWu-Lab/DMIL

2026-06-11视觉语言

本文针对多模态样本中冗余、独有与协同信息比例动态变化的问题,指出传统联合学习容易低用冗余信息、模态集成难以捕获协同信息。作者提出 DMIL,用变分分解显式拆出三类交互成分,并在微调中针对性强化。多任务、多架构实验显示其在不同交互组成下较联合与集成范式更稳健、性能更高。

Frozen Foundation-Model Embeddings Discard Small-Lesion Signal in Chest Radiography: Implications for Pre-Deployment Evaluation Figure 1
2026-06-11cs.CV

Frozen Foundation-Model Embeddings Discard Small-Lesion Signal in Chest Radiography: Implications for Pre-Deployment Evaluation

Raajitha Muthyala, Zhenan Yin, Alekhya Jilla, Frank Li, Theo Dapamede, Bardia Khosravi, Mohammadreza Chavoshi, Judy Gichoya, Saptarshi Purkayastha

aDepartment of Biomedical Engineering and Informatics, Indiana University, 535 W Michigan St., IT 475J, Indianapolis, IN, 46202, USA, bDepartment of Radiology and Imaging Sciences, Emory University, 1364 Clifton Rd NE, Atlanta, GA, 30322, USA

2026-06-11数据集/基准

针对胸片基础模型常以冻结全局嵌入服务下游、却可能漏掉早期小结节等低对比局部信号的问题,本文用近49万张胸片的可控扰动和带框小病灶基准,定位信号在CLS/全局池化阶段被抑制而非前向中完全消失。结果显示CLS小尺度扰动AUC接近随机0.500–0.524,但ROI限制的patch-local池化可接近1.0,并在真实小病灶上各类AUC≥0.899,提示部署前不能只看全局疾病AUC。

On Aligning Hierarchical Standardized Embedding for Audio-visual Generalized Zero-shot Learning Figure 1
2026-06-11cs.CV

On Aligning Hierarchical Standardized Embedding for Audio-visual Generalized Zero-shot Learning

Zihan Zhang, Jie Hong, Siyuan Fan, Yanghao Zhou, Pengfei Fang

Zihan Zhang and Siyuan Fan are with School of Software Engineering, Southeast University, Nanjing, 210096, China. Jie Hong is with Faculty of, Engineering, The University of Hong Kong, Pok Fu Lam, 999077, Hong Kong, SAR. Yanghao Zhou is with Beijing Institute of Technology, Beijing, 100811, China. Pengfei Fang is with Key Laboratory of New Generation Artificial, University), Ministry of Education, Nanjing, 210096, China. Pengfei Fang is, also with School of Computer Science and Engineering, Southeast University, i is the ground truth class label, to the ground truth class label. N is the number of samples in, number of classes is denoted as K, and the class label is

2026-06-11视觉感知

本文针对音视频广义零样本学习中音视频表征与文本语义在分布和结构上不匹配的问题,提出 AHSE:先用 Z-score 将融合音视频与文本嵌入标准化到共享空间,再在语义、类别和 batch 三个层级约束局部结构对齐,以缓解 hubness 并保留类间关系。实验在 VGGSound-GZSL、UCF-GZSL 和 ActivityNet-GZSL 上取得稳定且有竞争力的结果,但具体相对增益幅度文中片段未充分说明。

Spatially Coupled Phase-to-Depth Calibration for Fringe Projection Profilometry Figure 1
2026-06-11cs.CV

Spatially Coupled Phase-to-Depth Calibration for Fringe Projection Profilometry

Sehoon Tak, Jae-Sang Hyun

Department of Mechanical Engineering, Yonsei University, Seoul 03722, South Korea., grid as the native grid. By contrast, external depth labels ac-, the rectified depth labels. In this work, we instead map the depth, produce native-grid depth labels zn,uv, avoiding phase rectification. (c) Pixel-wise fitting estimates an independent fuv(Φ) per pixel, whereas the proposed method

2026-06-11视觉感知

针对 FPP 中逐像素相位到深度标定虽局部精确但易产生邻域不一致和结构化伪影的问题,论文提出在未畸变参考相机原生网格上共享低维相位—深度映射,并可加入有界平滑残差场,同时用平面拟合把立体深度监督回采到原生网格以避免相位重采样。牙科目标实验显示其空间一致性优于多项式/有理逐像素标定,点到面 RMSE 约 11.9–12.9 µm,接近主动立体基线。

Contactless 3D Human Body Measurement Using Depth Cameras for Smart Health Monitoring Figure 1
2026-06-11cs.CV

Contactless 3D Human Body Measurement Using Depth Cameras for Smart Health Monitoring

Martha Asare, Xuan Wang, Juan Lopez Alvarenga, Lois Akosua Serwaa, Jinghao Yang

Department of Computer, University of Texas Rio Grande, Department of Information, School of Medicine, Primary &, Department of Human Genetics, Department of Electrical and, scalability in remote healthcare settings. In this study, we, CREST Center for Multidisciplinary Research Excellence in Cyber-Physical, Sensing and Intelligent Quality Assessment for Scalable Additive, camera optical center.

2026-06-11三维

面向远程医疗和连续健康监测中人工接触式人体测量效率低、可扩展性差的问题,本文用 Orbbec Astra 2 深度相机构建 RGB-D/点云流程,通过空间滤波、人体分割与地标选择估计身高和臂展,并用体素占据与网格重建近似体积和可见表面积。单次深度采集实验显示可获得较准确的非接触测量,但样本规模、定量误差和多视角完整性文中未充分说明。

AVIS: Adaptive Test-Time Scaling for Vision-Language Models Figure 1
2026-06-11cs.CV

AVIS: Adaptive Test-Time Scaling for Vision-Language Models

Ahmadreza Jeddi, Minh Ngoc Le, Amirhossein Kazerouni, Hakki Can Karaimer, Hue Nguyen, Iqbal Mohomed, Michael Brudno, Alex Levinshtein, Konstantinos G. Derpanis, Babak Taati, Radek Grzeszczuk

AI Center-Toronto, Samsung Electronics, University of Toronto, Vector Institute, York University

2026-06-11视觉语言视觉感知

论文针对视觉语言模型在高分辨率图像/视频与CoT多次推理下推理成本过高的问题,提出将计算拆成视觉上下文VCS与推理搜索VRS两轴联合分配。AVIS用无需训练的KDV剪除冗余视觉token,并用难度预测器自适应选择自一致rollout数,配合共享prefill复用KV缓存。实验显示其在多类图像和视频推理基准上较仅剪枝或仅增加rollout取得更好的准确率–FLOPs/延迟权衡,并可叠加于RL后训练VLM。

Understanding Cross-Sensor Feature Variations for Generalizable 3D Perception Figure 1
2026-06-11cs.CV

Understanding Cross-Sensor Feature Variations for Generalizable 3D Perception

Xin Qiu, Wenjie Liu, Fuyuan Ai, YuChen Tan, Zhiwei Xu, Chunyi Song

Zhejiang University, of target-domain data is available., labeled target data. Ablation studies and visualization analyses

2026-06-11三维

本文针对雷达-相机 BEV 3D 检测跨数据集性能下降,指出问题不只是图像风格变化,而是视觉场景偏移会经编码、投影和融合传播到 BEV 特征。作者提出 VBS2M,从源域图像频谱统计挖掘场景原型,生成偏移视图,并用 BEV 偏移原型正则化融合空间;在 VoD 与 TJ4DRadSet 双向迁移及少量目标域标注设置下,对多种 BEV 融合骨干均带来稳定 OOD 提升。

FreqKD: Frequency-Decoupled Cross-Modal Knowledge Distillation for Infrared Object Detection Figure 1
2026-06-11cs.CV

FreqKD: Frequency-Decoupled Cross-Modal Knowledge Distillation for Infrared Object Detection

Keval Thaker, Venkatraman Narayanan, Abdalmalek Aburaddaha, Samir A. Rawashdeh

University of Michigan-Dearborn, mAP50). Code is available here., for the thermal domain, where labelled data is one to two orders of magnitude smaller and, normalised, transformed by 2D fast Fourier transform (FFT), and split via a centred radial, sifier or label-space alignment, as it distils from a frozen foundation-model teacher. (3) A, architectures (ResNet-50 via cross-architecture distillation). A frequency-resolved centered

2026-06-11视觉感知

红外检测缺少大规模预训练表征,直接把 RGB 基础模型蒸馏到 IR 会因成像物理差异引入冲突监督。FreqKD 的核心洞察是 RGB–IR 差异集中在高频:低频形状/布局更可迁移,高频纹理更模态特异,因此用 FFT 分频后对低频强 MSE 对齐、对高频弱 log-MSE 约束,并用 LoRA 两阶段训练。结果在 KAIST 达 64.1 mAP50,较 DINOv2 基线提升 2.4 点,并迁移到 FLIR、MFNet 和 ResNet-50。

4DP-QA: Scalable QA for 4D Perception in Vision Language Models Figure 1
2026-06-11cs.CV

4DP-QA: Scalable QA for 4D Perception in Vision Language Models

Seokju Cho, Abhishek Badki, Hang Su, Jindong Jiang, Ziyao Zeng, Seungryong Kim, Sifei Liu, Orazio Gallo

DP-QA: Scalable QA for 4D Perception in Vision Language Models, Yale University, duce a scalable spatio-temporal QA generation pipeline that, • We introduce a scalable spatio-temporal QA generation

2026-06-11视觉感知

论文针对VLM难以从视频中理解真实4D运动的问题,指出关键瓶颈在于2D投影会混淆相机运动与物体运动。作者用多源几何标注构建可扩展时空QA生成管线,并提出固定参考系下的True-Motion Tracking,生成40万训练样本和2.2K基准。实验显示,Qwen与NVILA等模型经4DP-QA训练后在自建基准和外部VLM4D上明显提升,增益可能主要来自高质量运动数据与细粒度跟踪监督。

Cross-Modal Benchmarking for Robotic Perception in Natural Environments Figure 1
2026-06-11cs.CV

Cross-Modal Benchmarking for Robotic Perception in Natural Environments

David Hall, Joshua Knights, Mark Cox, Peyman Moghadam

University of Sydney (USyd), Australia., Queensland University of Technology (QUT), Australia.

2026-06-11机器人数据集/基准

面向农业、监测和搜救等非结构化自然环境,论文指出现有机器人感知基准多偏城市/室内,难以暴露视觉基础模型在植被、遮挡和窄径中的弱点。作者扩展 WildCross,提供47.6万余帧RGB、半稠密深度/法线、6DoF位姿和同步激光子图,并以四折设置评测视觉/跨模态地点识别与单目度量深度。结果主要显示现有VPR、CMPR和DepthAnything系模型存在明显域外泛化缺口,微调与伪真值融合可用于分析和缓解,但具体增益幅度文中未充分说明。

VL-DINO: Leveraging CLIP Vision-Language Knowledge for Open-Vocabulary Object Detectio Figure 1
2026-06-11cs.CV

VL-DINO: Leveraging CLIP Vision-Language Knowledge for Open-Vocabulary Object Detectio

Hao Zhang, Qinran Lin, Linqi Song, Yong Li

Chongqing University, Chongqing, China, City University of Hong Kong, Hong Kong, China, model are available at https://github.com/HaoZ416/VL-DINO., relying on category-specific labels. QPSC introduces no extra learnable parameters, and all positive

2026-06-11视觉语言视觉感知

针对开放词汇检测中 DINO 难以同时吸收 CLIP 文本与视觉知识、且原去噪训练不适配自由短语标注的问题,VL-DINO 用 QPSC 构造无需类别索引的高质量正样本,引入 VSE 将 CLIP 全局视觉语义蒸馏到高层特征,并用 ORSA 对齐目标区域与文本嵌入;训练辅助模块推理时可丢弃。零样本实验中,VL-DINO-T/L 在 LVIS 达到 36.3/38.1 AP,在 COCO 达到 48.5/50.0 AP。

XPR: An Extensible Cross-Platform Point-Based Differentiable Renderer Figure 1
2026-06-11cs.GR

XPR: An Extensible Cross-Platform Point-Based Differentiable Renderer

Steve Rhyner, Sankeerth Durvasula, Aleksandr Kovalev, Hansel Jia, Adrian Zhao, Mrutunjayya Mrutunjayya, Nilesh Ahuja, Selvakumar Panneer, Christina Giannoula, Nandita Vijaykumar

University of Toronto, Vector Institute, Max Planck Institute for Software Systems, improve efficiency and scalability [10, 42]. Point-based renderers, beyond NVIDIA, but are currently incompatible with data center, models, on non-NVIDIA data center GPUs or accelerators like the, blocks available across all accelerators: data parallel element-wise

2026-06-11视觉感知

点基可微渲染常依赖 CUDA/Vulkan 专用内核和手写反传,限制新表示探索及在 TPU、Trainium 等训练平台中的集成。XPR 将方法逻辑拆成 project、tile_cull、pixel_info、evaluate 四个单元素接口,把过滤、分块、排序、混合与自动微分留给共享管线,并用 JAX/XLA 表达静态并行计算。论文用数百行 Python 复现 3DGS、3DGUT、LinPrim,并展示可编译到多类硬件,主要结果指向可扩展性和可移植性提升;性能相对专用内核的取舍需看实验细节。

SceneMiner: Identity-Preserving Multi-Task Fine-Tuning for Unified BEV Scene Mining Figure 1
2026-06-11cs.CV

SceneMiner: Identity-Preserving Multi-Task Fine-Tuning for Unified BEV Scene Mining

Abdalmalek Aburaddaha, Venkatraman Narayanan, Keval Thaker, Samir A. Rawashdeh

University of Michigan-Dearborn, of difficulty labels, and no single proxy, collision risk, trajectory ambiguity, or seman-, trieval embedding for text-prompted scenario search, a multi-label scene-tag distribution, text-prompted retrieval, validated qualitatively. Code is available here., safety-critical situations worth re-simulating, labelling, or training on. This is the problem, without ground-truth difficulty labels, and critically no single proxy can recover them: fore-, text-prompted scenario search, (ii) a multi-label tag distribution over weather, road class

2026-06-11视觉感知

针对自动驾驶日志缺少难例/风险标签、单一代理指标难以挖出长尾安全场景的问题,SceneMiner用冻结SigLIP2+BEVFormer相机BEV骨干一次前向输出检索嵌入、20类场景标签和物理风险分数。核心洞察是多头共享激活会产生“跨任务干扰”,即权重冻结仍会因输入分布漂移损害其他头;其通过零初始化新模块并冻结所有影响共享流的参数实现身份保持微调。模型仅训练约10.2万参数,标签mAP 0.4614、micro-F1 0.5557,风险相关r=0.3925,检索主要为定性验证,跨数据集和独立风险验证仍未充分说明。

On the Study of Biometric Spoofing Detection using Deep Learning Figure 1
2026-06-11cs.CV

On the Study of Biometric Spoofing Detection using Deep Learning

Kumar Kartikey, Nikos Komninos

School of Science and Technology, City St George’s University of London, specialized hardware, limiting their scalability. Machine learning, particularly deep learning, has emerged as a

2026-06-11视觉感知

针对人脸生物识别在打印照片、视频重放和3D面具等欺骗攻击下易失效的问题,本文比较MobileNetV2、DenseNet-121、Inception-v3与STD在CelebA-Spoof上的反欺骗表现,并用MSU-MFSD做跨数据集验证。核心洞察是轻量模型在精度与部署成本间更均衡:MobileNetV2达到约92%准确率且更适合实时应用;Inception-v3鲁棒性中等,而DenseNet-121和STD泛化较弱,提示后续需加强域适应和混合架构。

Towards Fully Automated Exam Grading: Fairness-Aware Recognition of Handwritten Answers with Foundation Models Figure 1
2026-06-11cs.CV

Towards Fully Automated Exam Grading: Fairness-Aware Recognition of Handwritten Answers with Foundation Models

Hartwig Grabowski

Institute for Machine Learning and Analytics (IMLA), Offenburg, University, Offenburg, Germany., previous baseline. Crucially, we centre the evaluation on fairness: we distinguish

2026-06-11视觉感知

针对纸笔考试人工批改耗时、全数字考试又限制题型的问题,论文把答案设计为表格中的单个大写字母,并用通用视觉语言模型直接理解整页而非模板检测,重点区分误判扣分与误给分。61份考试、3141个位置上最佳模型达98.4%准确率,弱提示将不利学生的假阴性降至0.58%,仅3份可能影响成绩且可由学生复核发现。

PT-WNO: Point Transformer with Wavelet Neural Operator for 3D Point Cloud Semantic Segmentation Figure 1
2026-06-11cs.CV

PT-WNO: Point Transformer with Wavelet Neural Operator for 3D Point Cloud Semantic Segmentation

Nhut Le, Maryam Rahnemoonfar

Lehigh University, resentation capacity but still face notable scalability challenges in, former V3 (PTv3) [29] overcame these scalability barriers by se-

2026-06-11视觉感知三维

针对点云 Transformer 主要依赖局部注意力和跳连传递全局信息、长程场景结构建模不足的问题,PT-WNO 在序列化 Point Transformer 骨干的编码器—解码器过渡处加入共享小波神经算子分支,将点特征投影到 3D 网格中学习多尺度全局上下文,再轻量融合回点特征。实验显示其相对 PTv3 在 S3DIS Area 5 提升 1.03 mIoU、DALES 提升 1.47 mIoU,ScanNet v2 基本持平。

Exploring Adaptive Masked Reconstruction for Self-Supervised Skeleton-Based Action Recognition Figure 1
2026-06-11cs.CV

Exploring Adaptive Masked Reconstruction for Self-Supervised Skeleton-Based Action Recognition

Shengkai Sun, Zhiyong Cheng, Zefan Zhang, Jianfeng Dong, Zhihui Li, Meng Wang

Hefei University of Technology, Jilin University, Zhejiang Gongshang University, University of Science and Technology of China, mand large volumes of labor-intensive annotations, which, severely limit their scalability in real-world applications., manual labels, dominantly center on two paradigms: contrastive learning

2026-06-11视觉感知三维

本文针对骨架动作识别中掩码重建预训练需预测大量时空块、训练慢且平均重建会分散到非关键运动区域的问题,提出 AMR:用与编码器解耦的交叉注意力解码器支持更大块预测以降复杂度,并以局部运动能量引导自适应焦点重建。实验在 NTU RGB+D 60/120 和 PKU-MMD 上显示其预训练更快、下游精度超过现有方法。

3D-CBM: A Framework for Concept-Based Interpretability in Generative 3D Modeling Figure 1
2026-06-11cs.CV

3D-CBM: A Framework for Concept-Based Interpretability in Generative 3D Modeling

Ahmad Al-Kabbany

Yubree Labs, Ottawa K2M1T2, Canada, Multimedia Interaction and Communication Lab, Arab Academy for Science and Technology, Alexandria 21937, Egypt

2026-06-11生成模型三维

论文针对3D生成模型难以用“桌腿厚度、结构稳定性”等人类概念解释和纠错的语义鸿沟,将概念瓶颈模型引入点云/网格生成流程,构建分层3D概念 taxonomy,并支持测试时人工干预概念激活来修正结构错误。概念验证的部件操作实验达到88.8%概念预测准确率和0.0115 Chamfer Distance,但效果主要来自小规模验证,泛化与真实复杂场景仍文中未充分说明。

A Scalable PyTorch Abstraction for Multi-GPU Gaussian Splatting Figure 1
2026-06-11cs.CV

A Scalable PyTorch Abstraction for Multi-GPU Gaussian Splatting

Matthew Cong, Francis Williams, Jonathan Swartz, Mark Harris, Sanja Fidler, Ken Museth

University of Toronto, Vector Institute

2026-06-11三维

针对高分辨率、大场景 Gaussian Splatting 受单卡显存与算力限制、现有多卡方案需手写通信的问题,论文提出 torch-dgx:用 CUDA 统一内存与 NVLink 将多 GPU 暴露为聚合 PyTorch 设备,并在算子层按高斯或像素维度自动分布计算,配合异步统一内存分配器降低开销。结果展示可重建含超 10 亿 Gaussian 的城市级街景,规模超过既有约 25 倍。

DeceptionX: Explainable Deception Detection with Multimodal Large Language Models Figure 1
2026-06-11cs.CV

DeceptionX: Explainable Deception Detection with Multimodal Large Language Models

Jiayu Zhang, Shuo Ye, Jiajian Huang, Yawen Cui, Taorui Wang, Wei Xia, Zeheng Wang, Haowen Tang, Hui Ma, Zitong Yu

Great Bay University, Hong Kong Polytechnic University, Great Bay University Dongguan Guangdong China, Hong Kong Polytechnic University HongKong China

2026-06-11视觉语言视觉感知

针对传统测谎模型只给真假标签、缺少可验证推理链的问题,DeceptionX将多模态大模型用于视频欺骗检测,把微表情、视线、声颤等视听线索组织为Observe-Think-Summarize流程;其核心还包括人机协同构建DeceptChain推理数据、三阶段训练和DARE冗余消除。实验称其在多个真实基准和跨域测试中优于现有MLLM与SOTA,并能输出专家式解释。

From Simulation to Real-World: An In-Field 6D Pose Dataset and Baseline for Robotic Strawberry Harvesting Figure 1
2026-06-11cs.CV

From Simulation to Real-World: An In-Field 6D Pose Dataset and Baseline for Robotic Strawberry Harvesting

Woojung Son (1), Won Suk Lee (1), Zijing Huang (1), Daeun Choi (1), Catia Silva (2), Yu She (3), Yan Gu (4) ((1) Department of Agricultural and Biological Engineering, University of Florida, (2) Department of Electrical and Computer Engineering, (3) Edwardson School of Industrial Engineering, Purdue University, (4) School of Mechanical Engineering, Purdue University)

2026-06-11机器人强化学习数据集/基准三维

针对草莓采摘中仅估计果实位置难以支撑无损抓取、真实田间6D位姿真值缺失的问题,论文构建了首个田间草莓6D位姿数据集,并用PnP、COLMAP重建与3D框标注生成真值,同时提供Isaac Sim合成集。基线实验显示,即使加入场景级真实感和域随机化,合成到真实仍存在明显差距,说明真实田间数据对评测和训练不可替代。

NSVQ: Mitigating Codebook Collapse by Stabilizing Encoder Drift in Vector Quantization Figure 1
2026-06-11cs.CV

NSVQ: Mitigating Codebook Collapse by Stabilizing Encoder Drift in Vector Quantization

Hao Lu, Yongxin Guo, Onur Koyun, Zhengjie Zhu, Abbas Alili, Metin N. Gurcan

Wake Forest University School of Medicine / Advocate Health, Wake Forest University School of Medicine

2026-06-11视觉感知

这篇论文针对大码本 VQ 训练中常见的 codebook collapse,指出根因不只是码字利用率不足,而是编码器持续漂移与稀疏码本更新之间的非平稳错配。NSVQ 通过非平稳嵌入损失、码字替换和分阶段冻结编码器,让码本先跟踪漂移、再在固定潜空间中巩固。ImageNet-1k 上 65,536 码本实验中,相比 SimVQ 将 rFID 从 2.39 降至 2.10,并保持 100% 利用率,且改善下游潜扩散生成 FID。

DarkVGGT: Seeing Through Darkness Using Thermal Geometry without Daylight Tax Figure 1
2026-06-11cs.CV

DarkVGGT: Seeing Through Darkness Using Thermal Geometry without Daylight Tax

Minseong Kweon, Wenyuan Zhao, Nuo Chen, Lulin Liu, Huiwen Han, Zihao Zhu, Srinivas Shakkottai, Chao Tian, Zhiwen Fan

University of Minnesota, Texas A&M University, Stanford University

2026-06-11视觉感知

DarkVGGT针对VGGT等前馈3D重建模型在夜间/低可见度下依赖RGB纹理而失效、且低光适配易损害白天性能的问题,提出保守的RGB-T融合框架:通过物理启发的热成像因子分解剔除反射残差,并用几何共享热路由将可靠热结构注入RGB流。实验显示其在ViViD++、STheReO、Dark3R等低光基准上提升深度与相机位姿估计,同时在ETH3D、ScanNet++上基本保留VGGT的明亮场景能力。

Semantic Segmentation of Node and Edge Diagrams for Assistive Technology Figure 1
2026-06-11cs.CV

Semantic Segmentation of Node and Edge Diagrams for Assistive Technology

Michael Cormier, Yichun Zhao, Laura Paul, Cameron Swift, Duc Tri Dang, Miguel Nacenta

Mount Allison University, Department of Computer Science, University of Victoria, diagrams will generally be made available as bitmap images. Our, when studying textbooks for a university course, when brows-, More recently, the availability of large language models, agrams, circumventing most of the human-centered issues, to the network and making the translation unavailable when, becoming more available. A machine learning system that can

2026-06-11视觉感知

面向盲人和低视力用户难以从位图节点—边图中获取结构信息的问题,论文将图解析前端聚焦为本地可运行的语义分割任务,提出紧凑的双分支全卷积网络,同时保留细节与较大感受野,并用合成 Graphviz 数据和 JPEG 退化评估鲁棒性;模型在节点、边、文本等像素分类上达到超过 93% 的逐像素准确率,可作为后续实例分割与辅助交互管线的基础。

TRON: Tracing Rays to Orchestrate a Neural Renderer for 3D Gaussian Reconstructions Figure 1
2026-06-11cs.CV

TRON: Tracing Rays to Orchestrate a Neural Renderer for 3D Gaussian Reconstructions

Or Perel, Hassan Abu Alhaija, Zian Wang, Jacob Munkberg, Matan Atzmon, Sanja Fidler, Masha Shugrina

University of Toronto, Vector Institute

2026-06-11三维

TRON针对3D Gaussian重建中光照与材质被烘焙、难以在动态光照和物体运动下真实编辑的问题,将Gaussian ray tracing改为提供PBR/辐照度等结构化引导,并借助逆渲染先验约束材质,再用单步神经渲染器弥合物理模型与真实图像的差距。论文通过合成到真实的多阶段训练和210万帧数据,报告在重光照真实感、可编辑性与速度上优于Gaussian重光照和既有神经渲染方法。

i1: A Simple and Fully Open Recipe for Strong Text-to-Image Models Figure 1
2026-06-11cs.CV

i1: A Simple and Fully Open Recipe for Strong Text-to-Image Models

Boya Zeng, Tianze Luo, Shu Pu, Jucheng Shen, Taiming Lu, Gabriel Sarch, Zhuang Liu

Princeton University

2026-06-11视觉感知

针对强文本到图像扩散模型训练细节和数据不透明、难以复现实验归因的问题,论文通过300余组受控实验系统梳理建模与数据选择,发现单强文本编码器配大适配器、双流DiT加长跳连、数据集等权混合和长字幕训练等简单策略有效,并据此训练3B参数i1。该模型仅用公开数据,在1024分辨率五个基准上接近领先模型,较最佳全开放模型平均提升29.5个百分点。

Intelligent Skin Cancer Detection Using a Multispectral Metasurface and a Hybrid Figure 1
2026-06-11eess.IV

Intelligent Skin Cancer Detection Using a Multispectral Metasurface and a Hybrid

Afsane Saee Arezoomand

Islamic Azad University, Urmia Branch, Urmia, Iran

2026-06-11视觉感知

针对传统皮肤镜主要依赖可见光、难捕捉早期病灶细微光谱差异的问题,论文提出用多光谱/太赫兹超表面采集非侵入式组织光谱,再由CNN–ViT混合模型融合局部纹理与全局注意力完成分类。仿真评估报告约98%准确率、95%敏感度和99%特异度,并用注意力图展示关注病灶区域;但结果主要来自仿真,真实临床数据与硬件验证文中未充分说明。

EventRadar: Long-Range Visual UAV Discovery through Spatiotemporal Event Sensing Figure 1
2026-06-11cs.CV

EventRadar: Long-Range Visual UAV Discovery through Spatiotemporal Event Sensing

Zhiting Zhou, Xingchen Liu, Xinglin Yu, Jiashen Chen, Haoyang Wang, Jingao Xu, Yunhao Liu, Xinlei Chen

2026-06-11视觉感知

面向机场等敏感空域的远距离反无人机监测,论文指出传统依赖外形、轨迹或事件密度的视觉线索在公里级距离会迅速失效,转而利用螺旋桨诱发的高频时间周期性。EventRadar通过SAGE把扫描事件与IMU/云台姿态融合成方位索引场景记忆以抑制背景,再用CHG-LISTA从候选ROI中恢复相位不敏感的谐波证据。在700–1500米事件相机实测中,其报告0.990 mAP、0.949 F1,并将漏检率降至0.009。

Traits Run Deeper: Trait-Specific Asymmetric Fusion for Personality Assessment Figure 1
2026-06-11cs.CV

Traits Run Deeper: Trait-Specific Asymmetric Fusion for Personality Assessment

Jia Li, Qian Chen, Wei Wang, Xinyu Li, Zhenzhen Hu, Dongsheng Shao, Richang Hong, Meng Wang

Hefei University of Technology, Intelligent Interconnected Systems Laboratory of Anhui Province, Jianghuai Advanced Technology Center, Hefei University of Technology Hefei China, Intelligent Interconnected Systems Laboratory of Anhui Province Hefei University of Technology Hefei China, Jianghuai Advanced Technology Center Anhui Provincial Industry Innovation Center of Humanoid Robots Anhui Provincial Key Laboratory of Humanoid Robots Hefei China

2026-06-11视觉感知

本文针对自动人格评估中各人格维度依赖不同语言、语音与视觉线索,而现有方法常用统一多模态融合导致跨模态干扰的问题,提出 Traits Run Deeper:用心理学语义模板增强基础模型表征,并为每个特质设计非对称的特定模态融合路径,同时通过分布校准回归缓解标签集中偏置。在 AVI Challenge 2026 上,验证集 MSE 较基线约降 25%,官方测试集 MSE 为 0.27767,并获人格评估赛道第一。

A2SG:Adaptive and Asymmetric Surrogate Gradients for Training Deep Spiking Neural Networks Figure 1
2026-06-11cs.NE

A2SG:Adaptive and Asymmetric Surrogate Gradients for Training Deep Spiking Neural Networks

Yechan Kang, Yongjin Kweon, Mingyeong Seo, Sohee Park, Yeonguk Jeon, Jongkil Park, Hyun Jae Jang, Jaewook Kim, YeonJoo Jeong, Suyoun Lee, Seongsik Park

2026-06-11优化算法

针对深度脉冲神经网络用替代梯度训练时易出现尖锐损失景观和跨时间步梯度不一致的问题,论文提出 A2SG:自适应调节有效梯度窗口以降低空间梯度波动并对齐时间方向,同时采用非对称梯度给高膜电位神经元更大权重。作者将局部梯度变异与曲率联系起来,解释其趋向平坦极小值;在 CNN/Transformer SNN、静态与神经形态分类及分割任务上报告了稳定的精度和能效提升。

OSCS-SupCon: Orthogonal Sigmoid-based Common and Style Supervised Contrastive Learning for Robust Feature Disentanglement Figure 1
2026-06-11cs.CV

OSCS-SupCon: Orthogonal Sigmoid-based Common and Style Supervised Contrastive Learning for Robust Feature Disentanglement

Bin Wang, Fadi Dornaika

University of the Basque Country, 2IKERBASQUE

2026-06-11安全鲁棒

论文针对监督对比学习中 InfoNCE 容易稀释关键负样本、且类别相关 common 特征与风格 style 特征纠缠的问题,提出 OSCS-SupCon:用带可学习温度和偏置的 sigmoid 成对对比损失替代传统归一化对比,并结合风格距离约束与显式正交投影来解耦子空间。六个数据集和多种骨干上的实验显示其优于现有 SupCon 方法,CUB200-2011 上较 CS-SupCon 提升 3.4%,消融支持各组件有效。

CFCamo: A Counterfactual Detect-or-Abstain Framework for Camouflaged Object Detection Figure 1
2026-06-11cs.CV

CFCamo: A Counterfactual Detect-or-Abstain Framework for Camouflaged Object Detection

Suhang Li, Osamu Yoshie, Yuya Ieiri

are available at https://github.com/suhang2000/CFCamo., The authors are with the Graduate School of Information, Production and, Systems, Waseda University, Fukuoka, Japan., integrates multi-scale feature interactions in a collaborative

2026-06-11视觉感知

本文指出现有伪装目标检测多只在“目标存在”数据上训练评测,易产生无目标也强行检测的过检幻觉。CFCamo将任务改成成对的“检测或拒答”:用去除目标的反事实图像构建CF-COD,并以CSPO/CPR联合奖励约束原图检测、反事实图拒答。在CAMO-test上Sα较RL基线提升3.7个百分点,CF-COD成对准确率达80.0–90.8%,消融显示无反事实耦合时PA几乎崩溃。

LAST: Bridging Vision-Language and Action Manifolds via Gromov-Wasserstein Alignment Figure 1
2026-06-11cs.CV

LAST: Bridging Vision-Language and Action Manifolds via Gromov-Wasserstein Alignment

Huaihai Lyu, Chaofan Chen, Yuheng Ji, Xiansheng Chen, Pengwei Wang, Shanghang Zhang, Changsheng Xu

MAIS, Institute of Automation, Chinese Academy of Sciences., Beijing Academy of Artificial Intelligence. 3Peking University.., ) typically discretize actions to leverage the scalability

2026-06-11视觉语言视觉感知

论文针对 VLA 中视觉语言语义空间近似线性、各向同性,而机器人 SE(3) 动作流形非欧且各向异性导致直接回归不适定的问题,提出 LAST:先用李代数映射和 B 样条将轨迹线性化为固定长度可加表示,再以层级离散和协方差白化构造与语义度量更兼容的局部动作 token。作者将其接入 AR token 预测与 diffusion 连续控制框架,称在仿真和真实机器人基准上提升收敛、性能与泛化,但具体增益归因仍需看完整实验细节。

Detecting AI-Generated Content on Social Media with Multi-modal Language Models Figure 1
2026-06-11cs.CL

Detecting AI-Generated Content on Social Media with Multi-modal Language Models

Chenyang Yang, Shen Yan, Yibo Yang, Litao Hu, Yuchen Liu, Yuan Zeng, Hanchao Yu, Yinan Zhu, Sumedha Singla, Brian Vanover, Huijun Qian, Zihao Wang, Fujun Liu, Aashu Singh, Jianyu Wang, Xuewen Zhang

Carnegie Mellon University, 2Meta

2026-06-11视觉感知

针对社交媒体中逼真 AIGC 被用于垃圾信息、误导和欺诈,且传统检测器对新生成模型泛化差、单模态且缺少解释的问题,论文提出持续采集多平台图文/视频社交数据,并训练小型 LLaVA 式视觉语言模型 IFM-AIGCSPOTTER-3B,同时输出判定与理由。模型在公开基准达到或接近 SOTA,在内部多平台数据上表现稳健,并已用于推荐系统,带来正向用户参与影响;具体增益可能主要来自持续数据构建与多模态微调。

2026-06-10

122 篇
ARM: An AutoRegressive Large Multimodal Model with Unified Discrete Representations Figure 1
2026-06-10cs.CV

ARM: An AutoRegressive Large Multimodal Model with Unified Discrete Representations

Junke Wang, Xiao Wang, Jiacheng Pan, Xuefeng Hu, Feng Li, Jingxiang Sun, Chaorui Deng, Zilong Chen, Yunpeng Chen, Kaibin Tian, Matthew Gwilliam, Hao Chen, Danhui Guan, Kun Xu, Weilin Huang, Zuxuan Wu, Haoqi Fan, Yu-Gang Jiang, Zhenheng Yang

2026-06-10视觉语言

ARM针对统一多模态模型中理解与生成常依赖不同视觉表征、带来结构割裂和推理开销的问题,提出语义对齐且可重建的离散视觉 tokenizer,并用单一7B自回归模型建模文本与图像 token,再通过偏好强化学习优化生成和编辑。实验显示其在MMMU/POPE、GenEval/WISE和GEdit-Bench上取得竞争或领先结果,且RL带来生成与编辑的跨任务协同。

Next Forcing: Causal World Modeling with Multi-Chunk Prediction Figure 1
2026-06-10cs.CV

Next Forcing: Causal World Modeling with Multi-Chunk Prediction

Gangwei Xu, Qihang Zhang, Jiaming Zhou, Xing Zhu, Yujun Shen, Xin Yang, Yinghao Xu

2026-06-10强化学习

本文针对自回归视频世界模型在高帧率下只预测当前 chunk 易走“外观捷径”、训练慢且推理慢的问题,提出 Next Forcing:借鉴多 token 预测,用轻量 MCP 模块按因果链同时预测多个未来视频 chunk,并融合主模型多层特征提供长时程监督。其在 RoboTwin 达到 94.1/93.5% Clean/Random,50 fps 下收敛加速 2.3 倍,推理可加速 2 倍,并在 PhyWorld 与通用视频预训练上提升明显。

AnyMod-LLVE: Low-Light Video Enhancement with Modality-Agnostic Inference Figure 1
2026-06-10cs.CV

AnyMod-LLVE: Low-Light Video Enhancement with Modality-Agnostic Inference

Hangfeng Liang, Yutao Hu, Yanhan Hu, Xiaohan Wu, Wenqi Shao, Ying Fu

2026-06-10视觉感知

低照度视频中 RGB 细节严重退化,而事件/红外等多模态方法又依赖测试时传感器可用。本文提出 AMNet,将辅助模态视为可选线索,并用空间-频谱双门控 Translator 从低光 RGB 生成隐式辅助表征;同时用合成事件/红外进行大规模预训练以学习跨模态对应。实验显示其可处理任意模态组合,在缺失辅助模态时性能下降较小,并取得优于 RGB-only 基线的增强效果。

Lip Forcing: Few-Step Autoregressive Diffusion for Real-time Lip Synchronization Figure 1
2026-06-10cs.CV

Lip Forcing: Few-Step Autoregressive Diffusion for Real-time Lip Synchronization

Paul Hyunbin Cho (1), Jinhyuk Jang (1), SeokYoung Lee (1), Joungbin Lee (1), Siyoon Jin (1), Heeseong Shin (1), Jung Yi (1), Yunjin Park (2), Chulmin Park (2), Seungryong Kim (1) ((1) KAIST AI, (2) AIPARK)

2026-06-10生成模型

针对扩散式视频口型同步因全序列双向注意力和多步去噪难以实时部署的问题,Lip Forcing 将14B音频条件双向教师蒸馏为因果自回归学生,并基于教师轨迹中“CFG提升同步但损伤参考保真”的观察设计Sync-Window DMD、两步采样和SyncNet奖励。实验显示1.3B学生达31 FPS、较同尺度双向模型快17.6倍,14B学生较教师快39.8倍且保持相近保真度。

Data Journalist Agent: Transforming Data into Verifiable Multimodal Stories Figure 1
2026-06-10cs.CV

Data Journalist Agent: Transforming Data into Verifiable Multimodal Stories

Kevin Qinghong Lin, Batu EI, Yuhong Shi, Pan Lu, Philip Torr, James Zou

2026-06-10视觉语言

面向数据新闻从原始数据到可信多媒体报道耗时且难追溯的问题,Data2Story 将检索、统计、叙事、设计、编程、审稿与溯源 Inspector 组织成虚拟 newsroom,使数字、图表和事实主张可回连到代码、数据或 URL,并按题材生成交互/音视频等呈现。18 篇对照与 53 人评测显示,其在透明度和可审计性上有优势、整体具竞争力,但编辑角度、创意设计和信息呈现仍弱于人类记者。

Mean Flow Distillation: Robust and Stable Distillation for Flow Matching Models Figure 1
2026-06-10cs.CV

Mean Flow Distillation: Robust and Stable Distillation for Flow Matching Models

An Zhao, Shengyuan Zhang, Zhongjian Sun, Yixiang Zhou, Zejian Li, Ling Yang, Tianrun Chen, Lingyun Sun

2026-06-10生成模型安全鲁棒

该文针对 Flow Matching 采样依赖多步 ODE、难以用于实时场景的问题,提出 Mean Flow Distillation:不再匹配瞬时速度或转成 score,而用时间积分后的平均速度约束学生与教师轨迹,并引入辅助流跟踪学生分布以降低梯度方差。理论上给出均值流匹配可实现分布对齐的条件;实验在 4D occupancy 预测和文生图中实现高质量单步生成,nuScenes 上接近 10 步教师且优于多种蒸馏基线。

P3D-Bench: Benchmarking MLLMs for Parametric 3D Generation and Structural Reasoning Figure 1
2026-06-10cs.CV

P3D-Bench: Benchmarking MLLMs for Parametric 3D Generation and Structural Reasoning

Yikang Yang, Zhanpeng Hu, Youtian Lin, Mengqi Zhou, Jingxi Xu, Feihu Zhang, Jiaheng Liu, Yao Yao

Nanjing University

2026-06-10数据集/基准三维

针对现有基准很少评估“用代码生成可编辑参数化3D模型”的缺口,本文提出 P3D-Bench:覆盖 Text-to-3D、Image-to-3D 和 Assembly-3D,支持多种CAD/渲染代码格式,并从可执行性、几何、拓扑、MLLM判别和部件结构打分。实验显示,前沿模型虽能生成语义上相近的整体形状,但精确尺寸与参数几何仍差,装配任务最难,部件数量、几何和空间关系恢复尤其薄弱。

MOFA-VTON: More Fashion Possibilities with Fine-Grained Adaptations in Virtual Try-On Figure 1
2026-06-10cs.CV

MOFA-VTON: More Fashion Possibilities with Fine-Grained Adaptations in Virtual Try-On

Xiaoyu Han, Chenyang Wang, Jing Wang, Shunyuan Zheng, Quanling Meng, Shengping Zhang

Harbin Institute of Technology, 2 HiDream.ai Inc., Harbin Institute of Technology (Weihai) Qingdao Research Institute

2026-06-10视觉感知

这篇论文针对现有虚拟试衣多只做服装替换、难以表达塞衣角/外放等穿法变化的问题,提出 MOFA-VTON:用用户手绘曲线构造上下身双区域 mask,并在扩散式 Adapt-Net 中加入布局调整块,通过跨注意力分别对齐上下区域服装特征。实验在 VITON-HD 和 DressCode 上优于已有方法,同时展示了更细粒度、可交互的试衣布局控制。

UniPET: a universal network for high-quality PET image denoising across varied dose reduction factors Figure 1
2026-06-10cs.CV

UniPET: a universal network for high-quality PET image denoising across varied dose reduction factors

Zhiwen Yang, Yang Zhou, Haowei Chen, Hui Zhang, Dan Zhao, Bingzheng Wei, Yan Xu

2026-06-10视觉感知

针对低剂量 PET 去噪中剂量降低因子(DRF)变化导致专用模型失效、通用模型又易过平滑的问题,UniPET 将不同 DRF 视为域偏移,引入风格对齐网络 SAN 保留纹理细节,并用区域感知学习 RALS 只在风格化区域施加对抗约束。四个数据集及未知 DRF/中心测试显示,其在 PSNR、SSIM、感知质量和临床 ROI/SUV、病灶检出指标上优于现有通用方法,接近单 DRF 专用模型。

WorldOlympiad: Can Your World Model Survive a Triathlon? Figure 1
2026-06-10cs.CV

WorldOlympiad: Can Your World Model Survive a Triathlon?

Yuke Zhao, Wangbo Zhao, Weijie Wang, Zeyu Zhang, Dakai An, Akide Liu, Yinghao Yu, Jiasheng Tang, Fan Wang, Wei Wang, Bohan Zhuang

2026-06-10强化学习

针对现有视频生成评测偏重画质、难以判断世界模型是否真懂物理、三维结构和长期交互的问题,WorldOlympiad提出覆盖游戏、机器人与真实场景的统一长视频基准,将评测拆为物理、几何和交互三项,并结合分割、MLLM裁判与Gaussian splatting等指标。作者构建1000段高质量长视频并测试8个长视频生成流水线,结果显示当前模型在物理推理、3D一致性和长程可控交互上仍有系统性短板。

Monte Carlo Pass Search: Using Trajectory Generation for 3D Counterfactual Pass Evaluation in Football Figure 1
2026-06-10cs.AI

Monte Carlo Pass Search: Using Trajectory Generation for 3D Counterfactual Pass Evaluation in Football

Andrew Kang, Priya Narasimhan

Carnegie Mellon University

2026-06-10强化学习规划控制数据集/基准三维

针对足球传球评价易受执行噪声和后续对抗结果偏置影响的问题,本文将其重构为类似 MCTS 的反事实搜索:从3D球轨迹推断踢球参数,采样局部执行扰动与全局替代选择,用球条件多智能体生成世界模型滚动到下一次触球,再以控球价值给出ΔPV分布。结果显示,改造自SMART的离散token自回归模型在仅7场公开数据上取得较强best-of-20预测精度,并能区分传球的稳健性、机会选择与执行超额,但真实增益仍受数据规模和世界模型误差限制。

Multimodal Brain Tumour Classification Using Feature Fusion Figure 1
2026-06-10eess.IV

Multimodal Brain Tumour Classification Using Feature Fusion

Wajih ul Islam, Muhammad Yaqoob, Javed Ali Khan, Volker Steuber

School of Physics, Engineering, School of Engineering and Computer Science, University of Hertfordshire, UK, symptoms, history, laboratory results, and imaging such as MRI. However, the majority of deep learning models, The publicly available dataset comprises 7,200 brain MRI images distributed across four tumor categories:, available MRI repositories, including the Sartaj dataset, BRaTS MRI images, and other open access sources [2,3], and testing split provided with the dataset was used in this study. Since patient identifiers were not available, label smoothing, gradient clipping, and mixed precision. We performed an experiment grid of 9 runs (3

2026-06-10视觉语言

针对脑肿瘤分类模型多依赖单一 MRI、难以模拟临床多源判断的问题,论文将原始 MRI 的 CNN 表征与同图像提取的 91 个放射组学特征经 MLP 编码后融合,比较拼接、门控和双向跨模态注意力。7200 张四分类数据上,多模态均略优于单模态,ResNet-50/DenseNet-121 加门控融合最高 96.13%;但增益较小,且两路信息同源,真实互补性与患者级泛化仍文中未充分说明。

FADA: Accessible fetal ultrasound interpretation and annotation with a selectively distilled unified vision-language model Figure 1
2026-06-10cs.CV

FADA: Accessible fetal ultrasound interpretation and annotation with a selectively distilled unified vision-language model

Mahmood Alzubaidi, Uzair Shah, Raden Muaz, Ines Abbes, Nader Mohammed, Abdullatif Magram, Khalid Alyafei, Mowafa Househ, Marco Agus

2026-06-10视觉语言视觉感知

针对低资源地区产前超声缺少训练技师、现有模型需按分类/检测/分割分别部署且依赖专家指定标签的问题,FADA基于Qwen3.5-VL构建“先解释后标注”的统一视觉语言流程,并仅在标注任务上从4个超声/胎儿基础模型选择性蒸馏。FADA-SKD达到0.8820 Dice、0.7671 mAP@0.50,结构化解释合规率100%,专家验证显示人机协同时73.5%解释满分,0.8B量化版可在手机离线约60秒完成全流程。

IDEAL: In-DEpth ALignment Makes A Discrete Representation AutoEncoder Figure 1
2026-06-10cs.CV

IDEAL: In-DEpth ALignment Makes A Discrete Representation AutoEncoder

Yitong Chen, Zijie Diao, Junke Wang, Lingyu Kong, Yixuan Ren, Bo He, Yu-Gang Jiang, Zuxuan Wu

2026-06-10视觉感知

IDEAL针对VFM/RAE离散化后深层语义特征缺少颜色、纹理和局部结构,导致重建保真度不足的问题,提出“深度对齐”思路:在量化前融合浅层外观特征与深层语义特征,并监督离散token同时恢复两者。其洞察是VFM层级存在重建—语义权衡。ImageNet上重建rFID达0.61,零样本分类80.89%,用于自回归生成时gFID为1.89。

A History-Aware Visually Grounded Critic for Computer Use Agents Figure 1
2026-06-10cs.AI

A History-Aware Visually Grounded Critic for Computer Use Agents

Jaewoo Lee, Zaid Khan, Archiki Prasad, Justin Chih-Yao Chen, Supriyo Chakraborty, Kartik Balasubramaniam, Sambit Sahu, Elias Stengel-Eskin, Hyunji Lee, Mohit Bansal

University of North Carolina at Chapel Hill 1, University of Texas at Austin 3

2026-06-10视觉感知

针对 GUI 计算机使用智能体在长任务中易遗忘历史、且现有 critic 多依赖文本意图而难发现坐标/视觉错误的问题,论文提出 HiViG:用多模态 critic 将过往交互压缩为宏动作历史,并在执行前基于截图核验原始坐标与预测状态变化。其在 Web、移动和桌面基准上均优于标量奖励和普通语言 critic,相比最强基线使 Qwen3-VL-32B、Gemini-3-Flash 平均成功率分别提升 5.8% 和 9.0%。

U-TTT: Towards Generalizable PET Image Denoising via Test-Time Training Figure 1
2026-06-10cs.CV

U-TTT: Towards Generalizable PET Image Denoising via Test-Time Training

Zhiwen Yang, Jiayin Li, Hao Lu, Hui Zhang, Zihua Wang, Bingzheng Wei, Yan Xu

2026-06-10视觉感知

针对低剂量 PET 去噪模型在剂量、扫描仪变化下易因分布偏移失效的问题,U-TTT 将测试时训练层嵌入 U 形 3D 去噪网络,在推理中按单个测试样本做自监督特征重建适配;其关键设计是同时引入空间 S-TTT 与频率 F-TTT,分别修正结构退化和全局噪声谱。实验称其在 PET 去噪及未见剂量、未见扫描仪泛化上优于现有方法,但具体增益幅度需看正文表格。

An Uncertainty Estimation Framework for Dose Accumulation in Adaptive Radiotherapy: Application to CBCT-Guided Radiotherapy for Cervical Cancer Figure 1
2026-06-10cs.CV

An Uncertainty Estimation Framework for Dose Accumulation in Adaptive Radiotherapy: Application to CBCT-Guided Radiotherapy for Cervical Cancer

Cedric Hemon, Delphine Lebret, Jean-Claude Nunes, Valentin Boussot, Karine Peignaux, Nathalie Mesgouez-Nebout, Chantal Hanzen, Antoine Simon, Anaïs Barateau, Renaud de Crevoisier, Caroline Lafond

Department of Radiation Oncology, Centre Georges-Francois Leclerc, F-21000 Dijon, France

2026-06-10安全鲁棒

针对宫颈癌在线自适应放疗中器官形变导致累积剂量难以可信评估的问题,论文提出 IMPACT-DoseAcc,将分割特征驱动的配准不确定性以贝叶斯和集成两种方式传播到剂量累积与概率 DVH,并加入解剖变异加权。9例回顾实验中,集成不确定性与几何误差相关性较高,CTVt 的 pDVH 覆盖率达 96.3±3.9%,显示可为安全鲁棒的剂量解释提供校准信息。

IPSM-Bench: A New Intermediate Phase Segmentation Benchmark in Microstructure Images of Zinc-Based Absorbable Biomaterials Figure 1
2026-06-10cs.CV

IPSM-Bench: A New Intermediate Phase Segmentation Benchmark in Microstructure Images of Zinc-Based Absorbable Biomaterials

Jinglin Xu, Shangyan Zhao, Jiabo Wang, Xinghong Mu, Yulong Lei, Jiacheng Zhang, Hongbo Sun, Yageng Li

School of Artificial Intelligence, University of Science and Technology Beijing, China, School of Advanced Materials Innovation, University of Science and Technology Beijing, China, China Telecom Artificial Intelligence Technology (Beijing) Co., Ltd, School of Materials Science and Engineering, University of Science and Technology Beijing, China, Institute of Materials Intelligent Technology, Liaoning Academy of Materials, China, School of Big Data and Software Engineering, Chongqing University, China

2026-06-10视觉感知数据集/基准

面向锌基可吸收生物材料,论文针对中间相标注稀缺、低对比、小目标和形态复杂导致的显微图像分割难题,构建含1054张SEM/OM图像、20类合金和22179个专家标注实例的IPSM-Bench,并提出将梯度结构与灰度属性作为空间上下文先验注入SAM编码—解码流程的SCoP-SAM。实验显示其在该基准上达到SOTA,并在两个公开合金数据集上有较好泛化。

AnimaSpark: A Feed-Forward Method for Animating Arbitrary 3D Objects Figure 1
2026-06-10cs.CV

AnimaSpark: A Feed-Forward Method for Animating Arbitrary 3D Objects

Yiming Zhao, Haoyu Sun, Aoyu Wang

2026-06-10三维

本文针对任意类别3D资产动画仍依赖人工、现有网格形变或优化式骨骼方法推理慢且易抖动的问题,提出AnimaSpark。其核心洞察是许多基础运动的关节变换可近似限制在二维子空间:先将带骨骼模型渲染为含网格与骨架的多层图像,经视频生成与关键点跟踪得到2D运动,再提升为3D骨骼动画。实验显示其在文本-运动一致性、运动质量和计算效率上优于已有方法。

Quo Vadis, Visual In-Context Learning? A Unified Benchmark Across Domains and Tasks Figure 1
2026-06-10cs.CV

Quo Vadis, Visual In-Context Learning? A Unified Benchmark Across Domains and Tasks

Pradnya Halady, Jiale Wei, Zdravko Marinov, Alexander Jaus, Simon Reiß

Karlsruhe Institute of Technology

2026-06-10数据集/基准

针对视觉上下文学习评测多局限于预训练相近任务与域、难以检验真实测试时适应的问题,本文构建统一基准 VIBE,覆盖6类成像域、14个数据集、12项任务,并以确定性上下文采样、统一任务编码和后处理评测6个开源模型的106个一样本组合。结果显示现有 VICL 在跨域与新任务下仍存在明显局限和系统性失败模式,哪些增益来自架构、训练数据或策略仍需进一步拆解。

Architect-Ant: Editable Automatic Furnishing of Architectural Floor Plans Figure 1
2026-06-10cs.AI

Architect-Ant: Editable Automatic Furnishing of Architectural Floor Plans

Fedor Rodionov, Aleksandar Cvejic, Michael Birsak, John Femiani, Peter Wonka

King Abdullah University of Science and Technology (KAUST), Miami University, King Abdullah University of Science and Technology (KAUST) Saudi Arabia, Miami University United States of America

2026-06-10视觉感知

针对真实、可编辑家具标注稀缺导致自动户型布置难以兼顾几何合法性与功能性的痛点,Architect-Ant将家具布局建模为坐标化DSL序列,结合AntPlan-270伪标注、程序化空间推理轨迹和规则评分产生的偏好优化,再用Flux LoRA渲染为蓝图图像。实验显示其在CubiCasa等场景中规则分数多数房型优于监督基线,VLM评审在浴室、厨房较强,但卧室有退化,偏好构造仍影响质量。

Democratising Camera Trap AI: An Open-Source Model for Detecting UK Mammals Figure 1
2026-06-10cs.CV

Democratising Camera Trap AI: An Open-Source Model for Detecting UK Mammals

Paul Fergus, Philip Stephens, Russell A. Hill, Lee Oliver, Katie Appleby, Sarah Beatham, Naomi Davies Walsh, Stuart Nixon, Naomi Matthews, Chris Sutherland, Kelly Hitchcock

Liverpool John Moores University, Byrom Street, Liverpool, L3 3AF, UK., Durham University, Stockton Road, Durham, DH1 3LE., University of St Andrews, College Gate, St Andrews, KY16 9AJ., Nottingham Trent University, Southwell, NG25 0QF., and vehicles, drawn from a curated dataset of 48,165 labelled, with small expert teams labelling hundreds of thousands or, sensitive data and ensured consistent, expert labelling, but it is, citizen science is not available to everyone, even where it is available, volunteer effort is a finite resource, labelled dataset, train a deep classifier or detector on it, report, citizen-science labels [10]. Subsequent work refined the, reduce the labels required for new datasets [11]

2026-06-10视觉感知

针对英国相机陷阱图像量大、商业平台门槛高且全球模型不够贴合本地物种的问题,论文发布面向31类英国常见动物及人车等辅助类的开源YOLO26x检测器,并提供ONNX权重和本地/实时使用支持。模型基于十年多站点48,165个标注实例训练,在同源验证集上mAP@0.5达0.984、精确率0.988、召回率0.965;但跨全新站点泛化文中未充分说明。

PENet+: A Lightweight Residual Transformer Framework for Efficient Image Steganalysis Figure 1
2026-06-10cs.CV

PENet+: A Lightweight Residual Transformer Framework for Efficient Image Steganalysis

Jincheol AN, Dongsu Kim, Haneol Jang, YoungJoon Yoo

SNUAILAB, Seoul, Korea

2026-06-10视觉感知生成模型

针对原始 PENet 在 512×512 图像隐写分析中计算和内存开销较高、难以部署到受限设备的问题,PENet+ 保留自注意力拓扑以保证可复现性,重点通过激活感知 HPF 筛选、MobileNetV2 式倒残差骨干、SPP 到 FC1 分类瓶颈瘦身和 PReLU 保留弱负响应来降本。在 ALASKA2 JPEG QF90 协议下,参数最多减少 45.5%、FLOPs 约降 97%,精度损失很小;但文中也承认真实设备延迟和功耗尚未验证。

Beyond Model Size: Probing the Gaps in Visual in-Context Learning by Training a Tiny Model Figure 1
2026-06-10cs.CV

Beyond Model Size: Probing the Gaps in Visual in-Context Learning by Training a Tiny Model

Sunil Khatri, Steven Landgraf, Markus Ulrich, Simon Reiß

2026-06-10视觉感知

论文质疑视觉上下文学习是否必须依赖大模型和大数据,训练仅约100万参数、7万图像的 TinyVICL,并引入 Palette-aware Dice loss 作为极端反例。实验将其与最高大约7000倍参数的 VICL 模型比较,发现 TinyVICL 在训练一致任务的小分布偏移上可超过大模型,但在新任务编码与未见任务下表现暴露出现有评测对任务编码、预训练任务和指标选择过于敏感,真实自适应能力仍需更严格衡量。

Pose-ICL: 3D-Aware In-Context Learning for Pose-Controllable Subject Customization Figure 1
2026-06-10cs.CV

Pose-ICL: 3D-Aware In-Context Learning for Pose-Controllable Subject Customization

Xuan Han, Yihao Zhao, Mingyu You

2026-06-10规划控制三维

针对主体定制生成中换姿态后易出现姿态不准、身份与局部结构不一致的问题,Pose-ICL将多张图像-姿态参考作为上下文,并用SAPE把图像token锚定到体素包围盒表面坐标,引入显式三维几何约束且无需为新主体微调。文中在3D资产和真实主体上评测,显示其相较现有姿态控制与定制方法提升姿态精度和跨姿态一致性。

The 1st PortraitCraft Challenge: A CVPR 2026 Workshop Competition on Portrait Composition Understanding and Generation Figure 1
2026-06-10cs.CV

The 1st PortraitCraft Challenge: A CVPR 2026 Workshop Competition on Portrait Composition Understanding and Generation

Zijie Lou, Youyun Tang, Xiaochao Qu, Haoxiang Li, Ting Liu, Luoqi Liu, Xun Zhu, Zheng Zhang, Xi Chen, Miao Li, Ji Wu, Dizhe Zhang, Xian Ge, Sujia Wang, Ruiyang Zhang, Jiaming Wang, Xianshun Wang, Lu Qi, Boao Kang, Wei Zhou, Jinghui Sun, Zhenyu Yan, Jiliang Zhao, Rui Yang, Yipo Huang, Boyuan Liu, Shanglin Li, Zifan Xie, Yichen Zhang, Anlan Wang, Wenfeng Lin, Mingyu Guo, Dong Li, Xinghao Wang, Yanting Li, Shanzhao Tong, Shuai He, Qiu Zhou, Yongqi Yang, Taoyang Mu, Dianqiao Lei, Anlong Ming, Huadong Ma

2026-06-10视觉感知

针对现有人像美学基准多停留在全局打分、缺少构图结构化监督的问题,本文报告首届 PortraitCraft 挑战赛,将任务拆为构图理解与按结构化描述生成两条赛道,并提供约 5 万张带全局分、13 项属性、解释、VQA 与生成描述的人像数据。比赛吸引 295 支队伍,理解赛道最佳总分 0.8986,生成赛道采用自动与专家评分结合,结果显示细粒度属性推理和构图对齐生成是主要有效方向。

Improving Text-Instance Alignment Of Foreground Conditioned Out-Painting Via Customized Concept Embedding Figure 1
2026-06-10cs.CV

Improving Text-Instance Alignment Of Foreground Conditioned Out-Painting Via Customized Concept Embedding

Yihao Zhao, Xuan Han, Bin He, Mingyu You

2026-06-10视觉感知

该文面向电商产品图等前景条件外扩场景,指出背景中重复生成同类物体或边界溢出的伪影,源于文本中通用概念嵌入与具体前景实例外观不对齐。作者提出 CCE-Diffusion,用实例视觉特征定制概念嵌入,并以实例感知损失和语义保持提示模板约束其不破坏其他词义。实验显示该模块可插入 ControlNet、BrushNet、BLD 等方法,显著减少伪影并提升生成质量。

Listen, Look, and Learn: Learning Without Forgetting through SAM-Audio Figure 1
2026-06-10cs.CV

Listen, Look, and Learn: Learning Without Forgetting through SAM-Audio

Avi Gupta, Nilotpal Sinha, Vishnu Raj, Sambuddha Saha, Pratik Joshi, Koteswar Rao Jerripothula, Tammam Tillo

2026-06-10视觉感知

这篇论文关注音视频类别增量学习中基础模型仍会遗忘的问题:直接使用 SAM-Audio 的单模态特征或朴素融合,在连续任务上表现会明显退化。作者冻结 SAM-Audio 音频和视觉编码器,用音频特征通过交叉/自注意力引导视觉表示,并在特征与 logits 两级做蒸馏以保持旧类对齐关系。实验称在音视频 CIL 基准上持续优于现有方法,但具体增益与数据/模型规模的关系文中未充分说明。

XtrAIn: Training-Guided Occlusion for Feature Attribution Figure 1
2026-06-10cs.LG

XtrAIn: Training-Guided Occlusion for Feature Attribution

Thodoris Lymperopoulos, Ioannis Kakogeorgiou, Denia Kanellopoulou

2026-06-10视觉感知

论文针对传统输入遮挡归因依赖基线、易产生分布外样本且在非线性模型中会引发“归因漂移”的问题,提出 XtrAIn 将遮挡从输入空间转到训练轨迹中的特征相关参数更新,并给出 Xstep 与面向目标类的 XtrAIn+。在受控图像数据和 PAM50 乳腺癌分型实验中,该方法得到更干净、可解释的归因图,但主要验证集中在 FCNN 场景。

Advancing Wood Identification in the Philippines: Utilizing the Xylorix Platform for Efficient AI Model Development and Deployment for Five Key Species Figure 1
2026-06-10cs.CV

Advancing Wood Identification in the Philippines: Utilizing the Xylorix Platform for Efficient AI Model Development and Deployment for Five Key Species

Rosalie C. Mendoza, Vivian C. Daracan, Arlene D. Romano, Ronniel D. Manalo, Xin Jie Tang, Yi Hong Wong, Yong Haur Tay

Rosalie C. Mendoza* (College of Forestry and Natural Resources, University of the Philippines, Los Banos), Vivian C. Daracan (College of Forestry and Natural Resources, University of the, Philippines Los Banos), Arlene D. Romano (College of Forestry and Natural Resources, University of the Philippines Los Banos), Ronniel D. Manalo (College of Forestry and Natural, Resources, University of the Philippines Los Banos), Xin Jie Tang (Agritix), Yi Hong Wong, potential to deliver accurate, rapid, and scalable identification of timber species, thereby, varied lighting rather than preparing perfectly polished laboratory specimens. As a result, the, multiple field captures. Xylorix thus eliminates the need for bulky manuals, lab equipment, or

2026-06-10视觉感知

针对菲律宾非法采伐执法中木材树种鉴定依赖专家和设备、难以现场快速部署的问题,论文评估了无编程经验木材科学家借助 Xylorix 平台构建宏观横切面图像二分类器的可行性。其核心在于用手机 24×微距采集、多图样本级均分和平台化数据验证/部署闭环提升现场鲁棒性;在 260 个样本、10663 张验证图像上,五类硬木 AUC 为 0.969–1.000,四类达 AA 等级,Rain Tree 因阳性测试样本过少导致 AP 偏低。

Schmidt Decomposition-Based Methods for Efficient Quantum Image Encoding Figure 1
2026-06-10cs.CV

Schmidt Decomposition-Based Methods for Efficient Quantum Image Encoding

Ana-Maria Pangeva, Yassine Ferhi, Alexander Geng, Andreas Weinmann, Desislava Ivanova, Ali Moghiseh

Fraunhofer Institute for Industrial Mathematics ITWM, Technical University of Sofia, Institut d’Optique Graduate School - Université Paris-Saclay, Algorithms for Computer Vision, Imaging and Data Analysis Lab, Technical University of Applied Sciences

2026-06-10视觉感知

面向 NISQ 量子硬件上图像编码电路过深、CNOT 多且易受噪声影响的问题,论文将 Schmidt 分解低秩截断作为模型无关压缩手段,用少量主导纠缠成分近似 FRQI、QPIE、NEQR 状态。实验比较重建误差、视觉质量与资源消耗,显示存在精度—效率权衡,其中 FRQI 电路深度可降约 97%,仍保持近乎无损重建(MSE≈0.27)。

LIBERO-Occ: Evaluating and Improving Vision-Language-Action Models under Scene-Induced Occlusion via Viewpoint Imagination Figure 1
2026-06-10cs.CV

LIBERO-Occ: Evaluating and Improving Vision-Language-Action Models under Scene-Induced Occlusion via Viewpoint Imagination

Taishan Li, Jiwen Zhang, Siyuan Wang, Xuanjing Huang, Zhongyu Wei

Fudan University, Shanghai, China, Shanghai Innovation Institute, Shanghai, China, Chinese University of Hong Kong, Hong Kong, China

2026-06-10视觉语言视觉感知

论文针对现有VLA评测默认目标物体可见、难以反映真实操作中场景遮挡的问题,构建了LIBERO-Occ,在LIBERO任务中加入可控的物理遮挡类型和强度。核心方法VIM不增加部署相机,而是从受遮挡主视角生成互补视角,并联合用于动作预测。实验显示强VLA在遮挡下明显退化,VIM在多任务套件、遮挡目标和严重程度上提升鲁棒性;但评测仍限于仿真,真实机器人效果文中未充分说明。

HarmoView: Harmonizing Multi-View Constraints for Identity-Consistent Video Generation Figure 1
2026-06-10cs.CV

HarmoView: Harmonizing Multi-View Constraints for Identity-Consistent Video Generation

Cong Wang, Zhentao Yu, Hongmei Wang, Weicong Liang, Zixiang Zhou, Zilin Yang, Jiarong Ou, Rui Chen, Yuan Zhou, Qinglin Lu

2026-06-10视觉感知优化算法

针对身份一致视频在大视角变化下易出现身份漂移、幻觉和参考视角错配的问题,HarmoView将多视角人像参考引入预训练DiT视频骨干,通过多层特征注入、可学习代理token和Jump-RoPE隔离跨身份干扰,并配合四阶段Progressive View Curriculum及LoRA合成数据管线缓解多视角数据稀缺。其在含100个案例、52个身份的基准上优于开源方法,并接近闭源视频生成引擎。

Earth-OneVision: Extending Remote Sensing Multimodal Large Language Models to More Sensor Modalities and Tasks Figure 1
2026-06-10cs.CV

Earth-OneVision: Extending Remote Sensing Multimodal Large Language Models to More Sensor Modalities and Tasks

Miaoxin Cai, Guanqun Wang, Wei Zhang, Guangyao Zhou, Yin Zhuang, Tong Zhang, Hao Wang, He Chen, Jun Li

2026-06-10视觉语言视觉感知

面向遥感多模态大模型传感器与任务割裂的问题,Earth-OneVision 用 2B 自回归框架统一光学、SAR、红外、多光谱、时序、视频及跨传感器融合,覆盖 9 类任务;其关键在于多层视觉-语言对齐、空间输出序列化和分阶段跨模态适配,并构建约 3400 万 QA 训练集。在 24 个基准上,该模型总体追平或超过 4B–72B RS-MLLM,如光学 grounding P@0.5 达 87.52%、SAR VQA 达 80.68%。

IMPACT: Learning Internal-Model Predictive Control for Forceful Robotic Manipulation Figure 1
2026-06-10cs.RO

IMPACT: Learning Internal-Model Predictive Control for Forceful Robotic Manipulation

Jiawei Gao, Chaoqi Liu, Peilin Wu, Haonan Chen, Yilun Du

Harvard University, Stanford University

2026-06-10机器人规划控制

面向搬运重物、擦桌、书写等需要持续接触力的操作,论文指出仅靠模仿策略输出位姿会把任务规划与物体动力学耦合,难以泛化且显式力控依赖额外传感器。IMPACT 用关节测量和机械臂动力学在线估计外力,学习内部模型并在阻抗控制中前馈补偿,使高层轨迹规划与低层力补偿解耦。仿真和 Franka FR3 实验显示其在未见重量、外扰和混合位置-力任务上成功率、鲁棒性、安全性与能效优于隐式力控和数据增强基线。

Deep learning for echo sounder data Figure 1
2026-06-10cs.CV

Deep learning for echo sounder data

Ketil Malde

2026-06-10视觉感知

本文关注回声测深数据在水下观测与生物量评估中的自动解读需求,指出现有深度学习多直接套用图像领域的 CNN、U-Net、YOLO 等方法。核心洞察是声学回波不满足图像的平移等变、清晰边界和常规增强假设,频率关系、距离衰减与标注不确定性都需专门建模。文中未报告新的实验增益,主要结果是归纳现有方法成效有限,并强调标准格式、高质量数据集和明确评测目标是突破瓶颈。

SCAIL-2: Unifying Controlled Character Animation with End-to-end In-Context Conditioning Figure 1
2026-06-10cs.CV

SCAIL-2: Unifying Controlled Character Animation with End-to-end In-Context Conditioning

Wenhao Yan, Fengjia Guo, Zhuoyi Yang, Jie Tang

2026-06-10规划控制

本文针对角色动画中依赖骨架、掩码背景等中间表示导致遮挡、交互和非人驱动信息丢失的问题,提出 SCAIL-2:直接把驱动视频作为上下文输入,并用 in-context mask、模式化 RoPE 统一动画、替换和多角色任务;同时构建 MotionPair-60K 合成配对数据,并用 Bias-Aware DPO 修正手部等细节偏差。实验显示其在多类角色动画任务上优于现有方法,但部分增益可能主要来自数据合成规模与任务统一训练。

Beyond APIs: Probing the Limits of MLLMs in Physical Tool Use Figure 1
2026-06-10cs.CL

Beyond APIs: Probing the Limits of MLLMs in Physical Tool Use

Zhixin Ma, Yutong Zhou, Yongqi Li, Chong-Wah Ngo, Wenjie Li

Singapore Management University, The Hong Kong Polytechnic University

2026-06-10视觉感知

针对MLLM虽擅长调用数字API、却未被系统检验能否在具身场景中使用真实工具的问题,论文提出PhysTool-Bench,将真实场景图像、任务指令、工具识别与按序选用规划拆开评测,覆盖2510个查询和2678种工具。13个主流模型结果显示,最佳模型工具识别F1仅58.7%,端到端EM仅21.0%,错误多来自功能相近工具混淆,说明瓶颈主要在物理功能常识而非单纯视觉感知。

A Multimodal RGB and Events Dataset for Hand Detection in First-Person View Figure 1
2026-06-10cs.CV

A Multimodal RGB and Events Dataset for Hand Detection in First-Person View

Bharghav Kota (1), Yulia Sandamirskaya (1) ((1) Zurich University of Applied Sciences, Wädenswil, Switzerland)

2026-06-10视觉语言视觉感知数据集/基准

面向移动机器人第一视角手部检测,RGB 相机受帧率、暗光运动模糊限制,而事件相机缺少训练数据。论文从 EgoHands 合成同步 RGB-事件数据 EventEgoHands,用 v2e 构造不同噪声、光照和尺度版本,并以微调 YOLOv8 补全框标注、插值到高时间分辨率事件流。基于 DAGr 训练后,最佳版本在手检测上达到 mAP50 0.931、mAP75 0.817、总体 mAP 0.697,显示多模态事件数据可支持高频手检测,但真实事件相机泛化仍需验证。

From Patches to Patients: A study of the tile-to-slide performance transferability in Digital Pathology Figure 1
2026-06-10cs.CV

From Patches to Patients: A study of the tile-to-slide performance transferability in Digital Pathology

Sofiène Boutaj, Leo Fillioux, Maria Vakalopoulou, Stergios Christodoulidis, Pierre Marza

2026-06-10视觉感知

数字病理中为每个临床队列筛选基础模型通常要完整跑 WSI 预处理、特征提取和 MIL 训练,成本高。本文系统检验 tile 级线性探测能否预测 slide 级表现,在19个病理基础模型、16个tile任务和42个WSI任务上比较排名相关性,并纳入ABMIL与均值池化。结果显示二者整体高度相关,说明编码器表征质量是主要因素;迁移稳定性更受队列规模和每张切片tile数影响,tile基准可用于低成本 shortlist,但最终临床验证仍需slide级评估。

Spatially Selective Self-Training for Unsupervised Building Change Detection Figure 1
2026-06-10cs.CV

Spatially Selective Self-Training for Unsupervised Building Change Detection

Wafaa I. M. Hussin, Zhi Lu, Anas M. I. Mohammed, Xiang Zhou, Ratiba A. H. Abubaker, Zhenming Peng

2026-06-10视觉感知

针对无标注双时相遥感中的建筑变化检测,论文指出直接把时间差异或冻结基础模型响应当作变化图,容易受外观、配准和非建筑变化干扰。SST-CD将这些差异改作候选伪标签,只在局部空间一致的可靠像素上自训练,并用轻量特征适配器和原型解码器稳定变化/未变化表征。在LEVIR-CD、WHU-CD、DSIFN-CD上F1分别达83.08%、91.69%、86.60%,优于既有无监督和免标注基线。

ZODS-RS -- Zero-training Oriented Detection & Segmentation for Remote Sensing Figure 1
2026-06-10cs.CV

ZODS-RS -- Zero-training Oriented Detection & Segmentation for Remote Sensing

Zuan Gu, Tianhan Gao, Langxu Zhao

Northeastern University, China

2026-06-10视觉感知

遥感与无人机图像存在尺度、旋转、密集小目标和跨平台域移,且逐任务训练成本高。ZODS-RS将冻结DINOv3特征、SAM2候选和记忆库组合成零训练闭式流程,用原型净化、旋转尺度等变匹配与不确定性感知像素合并统一输出HBB和实例掩码。其在xView/FAIR1M取得16.69/13.06 mAP,在自建UAV集mAP 47.30、mask mIoU 31.10,并显著提升小目标AP。

DD-INR: Dynamics-Driven Implicit Neural Representation for Accelerated Whole-Brain Functional MRI Reconstruction Figure 1
2026-06-10cs.CV

DD-INR: Dynamics-Driven Implicit Neural Representation for Accelerated Whole-Brain Functional MRI Reconstruction

Qiaoxin Li (MIND), Caini Pan (NEUROSPIN, MIND), Pierre-Antoine Comby (MIND, BAOBAB), Chaithya Giliyar (MIND), Philippe Ciuciu (MIND)

CEA NeuroSpin, Paris-Saclay University, CNRS BAOBAB, Gif-sur-Yvette, France, available at https://github.com/JoosenLi/DD-INR.

2026-06-10三维

针对高速全脑 fMRI 在强 k 空间欠采样下难以恢复仅 2–5% 的 BOLD 动态信号,DD-INR 将 3D+T 数据分解为时间聚合重建的静态背景与由 SIREN-INR 表示的动态残差,并用时间导数的空间 TV 约束强化血流响应的时空一致性。仿真和在体实验显示,其在图像质量、ROI 时间序列保真度和激活图检出上优于传统重建方法,但运动破坏静态背景假设等影响仍需进一步量化。

Patient-Level Diagnosis of Acute Myeloid Leukemia via Deep Learning Analysis of Bone Marrow Smear Figure 1
2026-06-10cs.CV

Patient-Level Diagnosis of Acute Myeloid Leukemia via Deep Learning Analysis of Bone Marrow Smear

Yuqi Ma, Tianyi Wang, Weihua Meng, Hongru Chen, Fajin Tao, Qunxian Lu, Lin An, Xiaodong Mo, Gen Yang

State Key Laboratory of Nuclear Physics and Technology, School of Physics, Peking University, Beijing 100871, China., Peking University People’s Hospital, Peking University Institute of Hematology, National Clinical Research Center for, Hematologic Disease, Beijing Key Laboratory of Hematopoietic Stem Cell Transplantation, Beijing 100044, China., Shanghai Dishuo Beiken Biotechnology Co., Ltd., Building 9-10, No. 3377 Kangxin Highway, Pudong New Area, Shanghai, single-cell interpretation is labor-intensive and patient-level diagnosis requires aggregation of many cellular, marrow smear images. The study included 258 patients from six anonymized centers, including a main cohort, of 169 patients from Centers 1-3 and an external validation cohort of 89 patients from Centers 4-6. A 16-, class-imbalance correction, center-border regularization, and morphology-assisted supervision. Cell-level, of 0.9076, 0.8696, and 0.9124 on Centers 4, 5, and 6, respectively., review of large numbers of cells and is affected by workload, center-specific practice, and observer variability., The study used de-identified bone marrow smear images collected from six centers. As shown in Figure 1, the total cohort contained 258 patients. Centers 1-3 formed the main cohort for training and patient-level five-

2026-06-10视觉感知

针对骨髓涂片人工阅片耗时且细胞级判断难以直接服务患者级 AML 诊断的问题,论文构建了从 YOLO 细胞分割、单细胞分类到患者级 CBLC 比例聚合的流程,并用复合“类原始细胞”替代严格白血病原始细胞定义以提高形态覆盖。该方法在六中心 258 名患者数据上验证,外部中心集成加权 F1 分别为 0.9076、0.8696、0.9124,显示一定跨中心泛化能力。

++nnU-Net: Scaling nnU-Net with Prefix-Based Data Augmentation Figure 1
2026-06-10eess.IV

++nnU-Net: Scaling nnU-Net with Prefix-Based Data Augmentation

Ana Sofia Santos, André Ferreira, Gijs Luijten, Naida Solak, Lisle Faray de Paiva, Behrus Hinrichs-Puladi, Jens Kleesiek, Jan Egger, Victor Alves

Center Algoritmi / LASI, University of Minho, Braga, Portugal, Institute for Artificial Intelligence in Medicine, University Medicine Essen, Essen, Germany, Institute of Medical Informatics / Dept. of Oral and Maxillofacial Surgery, University Hospital RWTH Aachen, Germany, Faculty of Computer Science, University of Duisburg-Essen, Essen, Germany

2026-06-10视觉感知

医学分割常受隐私与标注成本限制,nnU-Net在小样本下依赖数据量。++nnU-Net将基于图像配准的增强模块前置到预处理和训练之前,通过刚性+SyN形变生成配对图像与掩膜,并加入磁盘检查、二值合成掩膜和checkpoint。五个2D超声/X光数据集上Dice均优于基线,最高提升约22%,但HD95略增且过度扩增可能降性能。

Vector Map as Language: Toward Unified Remote Sensing Vector Mapping Figure 1
2026-06-10cs.CV

Vector Map as Language: Toward Unified Remote Sensing Vector Mapping

Yinglong Yan, Yunkai Yang, Haoyi Wang, Wei Fu, Linshan Wu, Honghu Pan, Shaobo Xia, Shanghang Zhang, Hao Chen, Leyuan Fang

2026-06-10视觉感知

针对遥感矢量制图中多类别实体结构异质、现有多边形或图表示难以同时表达实例边界与拓扑关系的问题,论文提出将矢量地图视为结构化语言的 VecLang,用 GeoJSON 式 SVL 统一描述语义、几何和拓扑,并通过先定位矢量化单元再生成文本的视觉语言框架及强化学习优化提升可执行性。作者构建含 5.4 万图像、80 万实例的 VecMap-Bench,实验显示其可统一处理建筑、水体和道路等对象,并具备较强跨数据集与开放词汇泛化能力。

Using the YOLOv12 Model for Verifying the Correct Color Sequence of Wires in Network Cables (Patch Cords) on the Production Line Figure 1
2026-06-10cs.CV

Using the YOLOv12 Model for Verifying the Correct Color Sequence of Wires in Network Cables (Patch Cords) on the Production Line

Amin Doroodchi, Danial Soleimany

Computer Department, Islamic Azad University, Beyza Branch, Beyza, Iran

2026-06-10视觉感知

面向网线生产中人工显微检查线序慢且易疲劳出错的问题,论文将YOLOv12用于RJ45接头内8根线的颜色与位置检测,并按从左到右序列与T568标准比对;核心更像是把单阶段检测器落地到产线质检,具体相对前代的增益来源文中未充分说明。在2500张显微图像上,报告检测精度约98%,整体平均准确率约95%,分类精度99%、召回98%,可实时替代人工判定。

Don't waste SAM Figure 1
2026-06-10cs.CV

Don't waste SAM

Nermeen Abou Baker, Uwe Handmann

- Ruhr West University of Applied Sciences - Dept of Computer Science

2026-06-10视觉感知

面向垃圾分割中遮挡、形变、透明物体和背景混淆导致 SAM 零样泛化不足的问题,论文系统比较 SAM-B/L/H 并仅微调 mask decoder,强调基础模型需结合下游数据而非直接丢弃。结果显示微调 SAM-ViT-H 在 ZeroWaste 与 TACO 上较 DeepLabv3+ 的 IoU 提升约 30 点,在 TrashCan1.0 上接近 SOTA,仅低 1.44 点。

UniDexTok: A Unified Dexterous Hand Tokenizer from Real Data Figure 1
2026-06-10cs.RO

UniDexTok: A Unified Dexterous Hand Tokenizer from Real Data

Dong Fang, Youjun Wu, Yuanxin Zhong, Rui Zhang, Yunlong Wang, Xiaosong Jia, Yu-Gang Jiang

Fudan University, Hefei University of Technology, Beijing University of Posts and Telecommunications

2026-06-10视觉感知

这篇论文针对灵巧手硬件形态、关节定义和数据格式不统一导致真实数据难以联合训练的问题,提出UDHM将人手与机器人手映射到共享22-DoF语义接口,并用UniDexTok在真实标准化关节状态上学习跨本体离散token,避免重定向和仿真依赖。实验中相较UniHM,MPJAE从15.63°降至0.16°、MPJPE从18.51mm降至0.18mm,并显示跨本体数据可提升重建及具备零/少样本适配能力。

FadeMem: Distance-Aware Memory Consolidation for Autoregressive Video Diffusion Figure 1
2026-06-10cs.CV

FadeMem: Distance-Aware Memory Consolidation for Autoregressive Video Diffusion

Yu Lu, Junjie Yang, Piotr Koniusz, YuXin Song, Yi Yang

Zhejiang University, University of New South Wales (UNSW)

2026-06-10视觉感知生成模型

针对自回归长视频扩散中历史 KV cache 随时长线性增长、固定窗口或 sink token 难以兼顾短期细节与长期一致性的问题,FadeMem 基于“高频细节快衰减、低频结构慢衰减”的观察,将缓存组织为近密远疏的时间层级:新片段细粒度保留,旧相邻片段按幂律分配逐步合并为跨度级锚点。该方法无需改模型结构,在固定缓存预算下提升主体一致性、背景稳定性和时间连贯性。

Analyzing Training-Free Corruption Detection for Object Detection Datasets Figure 1
2026-06-10cs.CV

Analyzing Training-Free Corruption Detection for Object Detection Datasets

Christian Sieberichs, Simon Geerkens, Thomas Waschulzik, Viswanathan Ramesh, Alexander Braun

University of Applied Sciences Düsseldorf, Goethe University Frankfurt

2026-06-10视觉感知数据集/基准

针对目标检测数据集中标注错误会同时涉及类别与边框位置、而现有免训练特征空间审计多停留在分类任务的问题,本文将 SimiFeat 式邻域一致性分析改到实例级检测标注,并在 VOC2012、KITTI 上结合多种预训练嵌入、合成与真实噪声评估。结果显示该方法能较稳定发现语义错标,但对位置扰动和边框错误识别能力有限,且受嵌入模型选择与类别不均衡影响明显。

Envision4D: Envisioning Visual Futures via Feed-forward 4D Gaussian Splatting for Autonomous Driving Figure 1
2026-06-10cs.CV

Envision4D: Envisioning Visual Futures via Feed-forward 4D Gaussian Splatting for Autonomous Driving

Qi Song, Yifei He, Chi Zhang, Zheng Fu, Xuhe Zhao, Mengmeng Yang, Kun Jiang, Rui Huang, Diange Yang

Tsinghua University 2 \quad{}^{2} The Chinese University of Hong Kong, Shenzhen

2026-06-10视觉感知三维

面向自动驾驶中动态场景未来演化预测,Envision4D针对现有前馈4DGS偏重插值、依赖未来位姿或线性运动假设的问题,提出自监督、无未来位姿的前馈外推框架;通过迭代去噪预测未来相机位姿,结合层内时间注意力、条件运动提升与渐进训练来建模非线性运动并抑制误差累积。实验显示其在未来视角合成和动态场景外推上达到SOTA,并具备一定开放场景泛化能力。

STEDiff: Strengthening Text Embedding for Text-to-Image Alignment in Diffusion Model Figure 1
2026-06-10cs.CV

STEDiff: Strengthening Text Embedding for Text-to-Image Alignment in Diffusion Model

Hailan Zhang, Haipeng Liu, Bo Fu, Yang Wang

2026-06-10视觉感知生成模型

针对复杂提示下扩散文生图常出现实体遗漏、属性或子对象绑定错误的问题,STEDiff从CLIP文本嵌入入手,利用[EOT]聚合的全局上下文和子句级语义增强,将强化后的token替换回原提示,并在早期去噪中加入语义增强与熵约束以减少语义泄漏。其无需训练或布局先验,在T2I-CompBench上相较多种基线提升了复杂多对象、多属性场景的语义一致性与生成完整性。

Kwai Keye-VL-2.0 Technical Report Figure 1
2026-06-10cs.CV

Kwai Keye-VL-2.0 Technical Report

Kwai Keye Team, Bin Wen, Changyi Liu, Chengru Song, Chongling Rao, Guowang Zhang, Han Li, Haonan Fan, Hengrui Ju, Jiankang Chen, Jiapeng Chen, Jiawei Yuan, Kaixuan Yang, Kaiyu Jiang, Kun Gai, Lingzhi Zhou, Na Nie, Sen Na, Tianke Zhang, Tingting Gao, Xuanyu Zheng, Yulong Chen, Fan Yang, Haixuan Gao, Lele Yang, Mingqiao Liu, Muxi Diao, Qi Zhang, Qile Su, Wei Chen, Wentao Hong, Xingyu Lu, Yancheng Long, Yankai Yang, Yingxin Li, Yiyang Fan, Yu Xia, Yuzhe Chen, Ziliang Lai, Chuan Yi, Haonan Jia, Tianming Liang, Weixin Xu, Xiaoxiao Ma, Yang Tian, Yufei Han, Feng Han, Hang Li, Jing Wang, Jinghui Jia, Junmin Chen, Junyu Shi, Ruilin Zhang

2026-06-10视觉感知

针对小时级视频带来的超长上下文、冗余信息与高算力成本,以及多任务对齐易遗忘基础推理的问题,Keye-VL-2.0 将 DSA 适配到 GQA 多模态 MoE 架构,并结合跨模态多教师 on-policy 蒸馏、Context-RL/Video-RL。模型以 30B 总参数、3B 激活参数支持 256K 上下文,在 TimeLens、Video-MME-v2、LongVideoBench 等长视频理解和时序定位基准上达到同规模领先表现。

ManiSplat: Manipulation Trajectory Synthesis from Monocular Video via Decoupled 3D Gaussian Splatting Figure 1
2026-06-10cs.CV

ManiSplat: Manipulation Trajectory Synthesis from Monocular Video via Decoupled 3D Gaussian Splatting

Wenhao Hu, Haonan Zhou, Liu Liu, Yun Du, Xinjie Wang, Ziang Li, Zhizhong Su, Gaoang Wang

Zhejiang University

2026-06-10机器人视觉感知规划控制三维

针对现有动态 3DGS 难以处理机器人主动操作中接触、突变位姿和对象级可控性的问题,ManiSplat 从单目第一视角操作视频重建可仿真的高斯数字孪生。其核心是用场景图解耦机器人、物体与背景,并按 Motion/Skill 阶段做时空对齐与光度-几何联合优化;实验显示可获得更稳定高保真的交互场景重建,并支持单示教轨迹增广和下游策略学习。

ChartLens: A Dual-Branch Framework for Chart Data Correction and Factual Summary Refinement Figure 1
2026-06-10cs.CV

ChartLens: A Dual-Branch Framework for Chart Data Correction and Factual Summary Refinement

Hao Liu, Ruping Cao, Kun Wang, Zhiran Li, Fan Liu, Yupeng Hu, Liqiang Nie

Shandong University, Southeast University, Harbin Institute of Technology (Shenzhen)

2026-06-10视觉感知

图表理解中,直接由多模态模型生成 CSV 和摘要容易出现数值错位、结构不完整或事实幻觉。ChartLens 的核心思路是把任务改为“先生成、再验证纠错”:用 LoRA 适配的 Granite-Vision 初始化结果,SAVC 检查并修正表格结构与数值一致性,TRSR 结合 OCR 文本保留标题、图例和关键数值证据来精修摘要。在 DataMFM Track 2 测试集上取得 69.10 总分并排名第一,但剩余列对齐错误说明结构推理仍是瓶颈。

Leveraging Metric Depth for Relative Depth Prediction Figure 1
2026-06-10cs.CV

Leveraging Metric Depth for Relative Depth Prediction

Xiaoyang Bi, Shuaikun Liu, Zhaohong Liu, Yuxin Yang, Zhe Zhao, Mengshi Qi, Liang Liu, Huadong Ma

Team BUPT MICLAB, Beijing Key Laboratory of Intelligent Telecommunications Software and Multimedia, Beijing University of Posts and Telecommunications

2026-06-10视觉感知

针对足球视频相对深度标注少、单目深度估计难的问题,论文将视角相近场景中的相对深度近似视为0–256米的度量深度,冻结预训练Depth Anything编码器,仅训练ZoeDepth/LocalBins解码器,并主要依赖水平翻转与学习率、轮数调参。在SoccerNet 2025挑战集上取得RMSE 2.68×10^-3;增益可能主要来自强预训练模型和训练配置,方法新意相对有限。

Can Image Models Imagine Time? ImageTime: A Novel Benchmark for Probing Visual World Modeling Through Spatiotemporal Consistency Figure 1
2026-06-10cs.CV

Can Image Models Imagine Time? ImageTime: A Novel Benchmark for Probing Visual World Modeling Through Spatiotemporal Consistency

Xinrui Wu, Lichen Huang

2026-06-10视觉感知强化学习数据集/基准

现有图像生成评测多看单帧对齐,难发现动作过程中的身份漂移、因果错序和状态跳变。ImageTime将动作拆成四个有序关键帧,构建覆盖22域、375类动作、750案例的时空一致性基准,并用L0–L6能力树与结构化VLM裁判定位失败。多模型测试显示,当前图像模型虽能生成合理静态画面,但在跨帧保持同一世界、交互几何和因果约束上仍频繁失稳。

SSR-Merge: Subspace Signal Routing for Training-Free LoRA Merging in Diffusion Models Figure 1
2026-06-10cs.CV

SSR-Merge: Subspace Signal Routing for Training-Free LoRA Merging in Diffusion Models

Zhengxuan Wei, Yi Dong, Zonghui Li, Xianhui Lin, Xing Liu, Hong Gu, Shaofeng Zhang, Wenbin Li, Qi Fan

2026-06-10生成模型

针对扩散模型中多个 LoRA 直接合并易在共享参数空间产生干扰、导致能力互相破坏的问题,论文提出 SSR-Merge:不做参数算术叠加,而是在拼接后的低秩子空间内用二阶统计构造无训练路由器,先去相关再导向各任务子空间,并可重参数化为标准 LoRA、无额外推理开销。作者给出其等价于 OLS 投影的最优性证明和流式统计实现;实验显示其在多任务 LoRA 合并中优于 TIES、DARE 等方法且效率相近。

Dexterous Point Policy: Learning Point-based Dexterous Hand Policies from Human Demonstrations Figure 1
2026-06-10cs.RO

Dexterous Point Policy: Learning Point-based Dexterous Hand Policies from Human Demonstrations

Beomjun Kim, Seong Hyeon Park, Seunghoon Sim, Seungjun Moon, Sanghyeok Lee, Jinwoo Shin

Recently, robotic foundation models choose to mine the vast pool of human videos available on-, line [11, 12, 13, 14] as a scalable substitute for robot data. They learn visual or reward representations, or pretrain Vision-Language-Action (VLA) models on hand-action labels distilled from egocentric, available at internet scale.

2026-06-10强化学习模仿学习

针对灵巧手机器人示教昂贵、而人类视频到机器人存在 embodiment gap 的问题,论文提出 Dexterous Point Policy:用手腕与五指尖的统一 3D 关键点同时表示观测和动作,并加入指尖接触预测补足力信息,先在约百万自我中心人类视频上预训练再用少量任务人类示教微调。真实双臂灵巧手实验中无需任何机器人示教,8 类抓取、放置与工具使用任务成功率达 75.0%,显著高于 VLA 基线的 1.0%。

GaussTrace: Provenance Analysis of 3D Gaussian Splatting Models with Evidence-based LLM Reasoning Figure 1
2026-06-10cs.CV

GaussTrace: Provenance Analysis of 3D Gaussian Splatting Models with Evidence-based LLM Reasoning

Haoliang Han, Ziyuan Luo, Renjie Wan

2026-06-10三维

针对3D Gaussian Splatting资产在多方传播、反复编辑后难以追溯来源的问题,GaussTrace不再依赖图像取证式痕迹匹配,而是将溯源建模为证据推理:从3DGS参数提取属性统计,并用假设编辑模拟提供可能变换证据,再交给LLM生成有向溯源图和边解释。实验在44个模型构成的数据集上显示,其在边与图重建指标上优于渲染图像、几何距离和规则搜索基线,且无需训练或编辑历史。

Geometry-Aware Reinforcement Learning for 2D Irregular Nesting Figure 1
2026-06-10cs.LG

Geometry-Aware Reinforcement Learning for 2D Irregular Nesting

Auguste Lehuger, Guillaume Henon-Just

2026-06-10强化学习

针对无边界、可连续旋转平移的二维不规则排样中传统启发式难以利用多边形几何、主要靠搜索试探的问题,本文将组合优化强化学习引入该任务,提出可直接编码连续向量多边形并进行跨多边形注意力的 Polygons Transformer,同时发布地理轮廓数据集和评测基准。实验显示,训练出的智能体在面积利用率上可接近当前启发式求解器 Sparrow,说明几何感知策略能为精细空间排样提供有效搜索先验。

Globally Localizing Lunar Rover in Pixels via Graph Alignment Figure 1
2026-06-10cs.CV

Globally Localizing Lunar Rover in Pixels via Graph Alignment

Mao Chen, Xu Yang, Chuankai Liu, Xiangkai Zhang, Xiaoxue Wang, Zheng Bo, Zuoyu Zhang, Zhiyong Liu

2026-06-10视觉感知

针对月球车在无 GNSS 环境中依赖里程计/惯导会长期漂移、跨视角匹配又受月面重复地貌和视角差异干扰的问题,论文提出 WARG,用共享特征的图表示与几何重投影匹配多实体结构,而非逐点找相似外观。在 LuSNAR 上误差 0.32 m,南极仿真零样本 3.63 m,玉兔二号实测结合全景降至 1.68 m,且仅 1.56M 参数、5.49 Hz。

Segment and Select: Vision-Language Segmentation in 3D Scenarios Figure 1
2026-06-10cs.CV

Segment and Select: Vision-Language Segmentation in 3D Scenarios

Yulin Chen, Zhihang Zhong, Yuenan Hou

Shanghai AI Laboratory 2 University of Science and Technology of China, Shanghai Jiaotong University

2026-06-10视觉语言视觉感知三维

本文针对3D视觉语言分割中超点表示边界粗糙、语义混杂的问题,提出SEGA3D“先分割候选、再选择验证”的范式:用细粒度候选掩码构建假设空间,结合LLM生成的语义与空间线索进行候选筛选,并通过Loopback Verification细化和重排掩码。在ScanRefer、ScanNet、Matterport3D上表现有竞争力,相比Reason3D在ScanNet和Matterport3D的mIoU分别提升8.38和5.34点。

Improving Adversarial Transferability on Vision-Language Pre-training Models via Surrogate-Specific Bias Correction Figure 1
2026-06-10cs.CV

Improving Adversarial Transferability on Vision-Language Pre-training Models via Surrogate-Specific Bias Correction

Lijia Yu, Jiuxin Cao, Yuchen Qiang, Changhao Chen, Yifei Huang, Bo Liu

2026-06-10视觉语言视觉感知

针对视觉语言预训练模型黑盒迁移攻击在异构目标上易受替代模型依赖影响的问题,论文提出“替代模型特定偏差”视角:弱语义输入上的梯度可估计这种偏差。DeBias-Attack用原图主分支与均值图加噪参考分支做梯度投影校正,并结合上下文文本替换生成图文对抗样本。实验显示其在多类VLP模型、下游任务及开闭源多模态大模型上提升迁移攻击效果,异构模型场景收益更明显。

PrismAvatar: Pseudo-Multiview Reconstruction and Subpixel Prism Rendering for Real-Time Stereoscopic Communication Figure 1
2026-06-10cs.CV

PrismAvatar: Pseudo-Multiview Reconstruction and Subpixel Prism Rendering for Real-Time Stereoscopic Communication

Chufeng Fang, Dongdong Teng, Lilin Liu

Sun Yat-sen University, Sun Yat-sen University Guangzhou China

2026-06-10三维

面向免眼镜3D远程交流,单目头像虽能正面重建,却在透镜多视区暴露头发、耳朵、下颌和颈部伪影。PrismAvatar的关键洞察是把自然转头当作偏航匹配的伪多视监督,并用头发/头部掩膜、轮廓损失与正则抑制漏透明和鬼影;系统可将32视图编码到4K柱透镜屏,实时跟踪版达10.65 FPS,蒸馏驱动后达38.49 FPS。

GRAR: Glass-induced Reflection Artifact Removal in LiDAR Point Clouds Figure 1
2026-06-10cs.CV

GRAR: Glass-induced Reflection Artifact Removal in LiDAR Point Clouds

Wanpeng Shao, Zeyi Guo, Bo Zhang, Yifei Xue, Tie Ji, Yizhen Lao

2026-06-10三维

面向城市TLS点云中玻璃幕墙引发的虚假反射点,GRAR指出传统方法过度依赖完整玻璃观测和理想镜面对称,难以处理玻璃“空洞”和畸变反射。方法先用多模态视觉基础模型生成玻璃掩码,并结合几何约束细化与补全玻璃区域,再提出基于真实激光反射几何的RE-LGGS描述子,联合局部/全局结构和方向一致性识别虚拟点。多组公共TLS数据集实验显示其较现有方法更稳健。

Audio-Visual Exchange-Aware Token Pruning for Efficient Audio-Visual Captioning Figure 1
2026-06-10cs.CV

Audio-Visual Exchange-Aware Token Pruning for Efficient Audio-Visual Captioning

Zihan Meng, Dexiang Hong, Weidong Chen, Ziyu Zhou, Bo Hu, Zhendong Mao

2026-06-10视觉语言

面向音视频描述中多模态 token 过多、LLM prefill 注意力开销二次增长的问题,论文指出注意力/显著性等代理分数与真实描述贡献相关性弱,且音频与视觉贡献具有非加性。AVEX-Prune 用冻结描述模型的 CIDEr 变化监督强化学习剪枝策略,通过同模态和跨模态 token 交换学习交互价值;在 AVCaps 上仅保留 40% token 时,VILA 1.5-8B 与 VideoLLaMA 2 基本保持全 token CIDEr,并报告 FLOPs 降低超过 55%。

GUI-AC: Enhancing Continual Learning in GUI Agents Figure 1
2026-06-10cs.CV

GUI-AC: Enhancing Continual Learning in GUI Agents

Can Lin, Tao Feng, Hangjie Yuan, Dan Zhang, Yifan Zhu, Zhonghong Ou

Beijing University of Posts and Telecommunications, Tsinghua University, Zhejiang University, National University of Singapore

2026-06-10视觉感知

本文关注 GUI 智能体在持续遇到新域名、分辨率和界面布局时,强化微调容易出现奖励震荡、定位退化与探索坍塌的问题。作者用优势—概率四象限分析指出关键在过度自信旧动作和被裁剪抑制的新探索动作,并提出 GUI-AC,以 grounding certainty 驱动自适应优势降噪和动态裁剪放宽探索。实验称其在 ScreenSpot-V1/V2/Pro 及跨域、跨分辨率持续学习中超过现有基线,并提升训练稳定性。

LAFP: Preserving Latent Action Structure in Latent Policy Learning via Flow Matching Figure 1
2026-06-10cs.CV

LAFP: Preserving Latent Action Structure in Latent Policy Learning via Flow Matching

Jiexi Lyu, Xizhou Bu, Qingqiu Huang, Chufeng Tang, Xiaoshuai Hao, Hongbo Wang, Wei Li

2026-06-10生成模型强化学习

针对潜在动作学习中动作标注稀缺、行为克隆易把多模态潜在动作压成单峰并破坏预训练结构的问题,LAFP将流匹配用于潜在策略蒸馏,并在动作解码器训练时引入推理期插值以缓解随机潜变量与物理动作错位。实验在16个Procgen任务上显示其较既有方法更稳定,成功率最高提升约10–15%,额外训练和推理开销低于1倍。

PathRelax: Parallel-Path Relaxed Speculative Jacobi Decoding for Accelerating Auto-Regressive Text-to-Image Generation Figure 1
2026-06-10cs.CV

PathRelax: Parallel-Path Relaxed Speculative Jacobi Decoding for Accelerating Auto-Regressive Text-to-Image Generation

Haodong Lei, Hongsong Wang, Bingxuan Dai, Pan Zhou

College of Software Engineering, Southeast University, School of Computer Science and Engineering, School of Cyber Science and Engineering, School of Computing and Information Systems, Singapore Management University

2026-06-10视觉感知

本文针对自回归文生图需逐 token 生成、长图像序列导致推理延迟高的问题,提出 PathSpec:用多序列草稿树替代传统链式草稿以并行探索候选路径,并通过跨路径概率聚合与 relaxed verification 利用语义相近分支提升接受率。实验在 Parti-Prompts、MSCOCO2017、T2ICompBench 上分别达到 4.14×、3.95×、4.18× 加速,且声称基本保持图像质量。

5% > 100%: Flatness Preference is All You Need for Multimodal Parameter-Efficient Fine-Tuning Figure 1
2026-06-10cs.CV

5% > 100%: Flatness Preference is All You Need for Multimodal Parameter-Efficient Fine-Tuning

Yifan Zhu, Can Lin, Hangjie Yuan, Zixiang Zhao, Pengfei Zhang, Tao Feng, Zhonghong Ou

2026-06-10视觉语言

论文关注多模态大模型 PEFT 虽省参数但常收敛到尖锐极小值、影响下游泛化的问题。核心洞察是梯度中仅少量“尖锐维度”主导泛化需求,因而提出 FlatPO,按梯度分布识别并优先平滑约 5% 关键维度,而非对全部参数做统一平坦化。实验覆盖 LoRA、Prefix/Prompt 等多种 PEFT,报告其在多模态任务上带来稳定泛化提升,但具体增益幅度需结合各任务表格判断。

3D-CoS: A New 3D Reconstruction Paradigm Based on VLM Code Synthesis Figure 1
2026-06-10cs.CV

3D-CoS: A New 3D Reconstruction Paradigm Based on VLM Code Synthesis

Yuhao Wang, Puyi Wang, Linjie Li, Zhengyuan Yang, Kevin Qinghong Lin, Yu Cheng

Shanghai Jiao Tong University, The Chinese University of Hong Kong, University of Oxford

2026-06-10视觉语言三维

针对 NeRF、点云、网格等三维表示难以程序化控制和局部编辑的问题,3D-CoS 将单图三维重建表述为由 VLM 合成可执行 Blender 代码,并系统比较提示、RAG、few-shot 与部件级 Agent 流程。实验显示该范式可恢复较结构化几何,最佳 Gemini/Agent 配置在部分指标上接近 InstantMesh,但总体仍未替代专用网格重建;其优势主要体现在文本驱动局部编辑中,编辑保真和未编辑区域保持优于点云编辑基线。

Geometric Coastline Localization using Vision-Language Models Figure 1
2026-06-10cs.CV

Geometric Coastline Localization using Vision-Language Models

Rafia Malik, Bernhard Pfahringer, Karin Bryan, Mark Dickson, Eibe Frank

2026-06-10视觉语言视觉感知

论文针对海岸线监测中“像素分割训练、矢量几何使用”的表示错配,主张将海岸线直接建模为几何边界而非后处理轮廓。作者基于 GeoChat/LLaVA 构建 CoastlineVLM-7B,同时判断海岸线存在、代理类型并输出折线边界,并用 Chamfer、Hausdorff、Fréchet、EMD 等距离指标评估。实验显示其相比分割模型提升几何对齐,Hausdorff 从 37.74 m 降至 31.84 m,EMD 从 21.12 m 降至 17.32 m。

Few-step Generative Models as Lossy Compression Figure 1
2026-06-10cs.CV

Few-step Generative Models as Lossy Compression

Fuma Kimishima, Jinjia Zhou

2026-06-10生成模型

本文针对 DiffC 扩散压缩因多步前向/反向过程导致编解码慢的问题,探讨将 Rectified Flow、CTM 与 MeanFlow 等少步生成模型纳入同一 RCC 压缩框架。核心做法是把速度场或 EDM 噪声参数化转成 RCC 所需的后验与共享分布参数,并用局部高斯近似补齐 CTM 的概率形式,无需重训预训练模型。CIFAR10、ImageNet 64×64 上显示其在低码率下编解码更快、重建更真实;高分辨率结论仍较初步。

Vision-Assisted Foundation Model for Solving Multi-Task Vehicle Routing Problems Figure 1
2026-06-10cs.CV

Vision-Assisted Foundation Model for Solving Multi-Task Vehicle Routing Problems

Shuangchun Gui, Zhiguang Cao, Wen Song, Yew-Soon Ong

2026-06-10视觉感知

多任务车辆路径规划中,不同约束组合使单任务神经求解器难以复用,纯图输入也不易显式捕捉空间需求与时间窗等复杂关系。论文提出 VaFM,将为约束定制的视觉图像经 CNN 编码后与图节点表示融合,并用混合交叉注意力自适应整合局部/全局视觉语义,再以约束感知辅助损失缓解像素不均衡。实验覆盖 16 种 VRP 变体,报告相较现有多任务图求解器整体更优,复杂约束场景增益更明显。

Time-frequency localization of bird calls in dense soundscapes Figure 1
2026-06-10cs.SD

Time-frequency localization of bird calls in dense soundscapes

Simen Hexeberg, Fanghui Tong, Hari Vishnu, Mandar Chitre

2026-06-10视觉感知

针对被动声学监测中传统分类器只能判断时间窗内物种存在、难以给出鸟鸣精确时频位置的问题,论文将密集声景中的鸟鸣检测转化为声谱图目标检测,训练 YOLO11,并提出浏览器标注工具与更适合模糊声学边界的 IoMin 指标。实验中最佳模型在新加坡分布内数据上将 IoMin@50 F1 从 42.1% 提升到 81.8%,在夏威夷分布外录音上也优于能量基线 58.6% 对 48.6%。

CoCoSI: Collaborative Cognitive Map Construction for Spatial Intelligence Figure 1
2026-06-10cs.CV

CoCoSI: Collaborative Cognitive Map Construction for Spatial Intelligence

Yiming Zhang, Ruoxuan Cao, Zhihang Zhong

Shanghai Jiao Tong University, Cornell University

2026-06-10视觉感知

针对长视频空间理解中单个 MLLM 受上下文长度限制、易遗漏或错置物体的问题,CoCoSI 将视频切分给多智能体分别构建局部认知地图,再通过局部—全局协同、原子提交和跨智能体验证合并为一致的空间记忆;该方法无需改模型或微调,可直接用于现成 MLLM,并在两个空间理解基准上优于单智能体、通用多智能体和其他免训练方案。

Do Vision-Language Models See or Guess? Measuring and Reducing Textual-Prior Reliance with a Phrasing-Controlled Benchmark Figure 1
2026-06-10cs.CL

Do Vision-Language Models See or Guess? Measuring and Reducing Textual-Prior Reliance with a Phrasing-Controlled Benchmark

Pratham Singla, Shivank Garg, Vihan Singh, Paras Chopra

Indian Institute of Technology Roorkee

2026-06-10视觉语言视觉感知规划控制数据集/基准

论文针对 VLM 在视觉问答中可能“看图”不足、更多依赖问题措辞和常识先验的隐性失效,构建了固定 540 张图像、为每图生成四种措辞变体的受控基准,并用无图消融衡量文本先验依赖。结果显示 11 个模型在最少文本泄漏的 Vision-Grounded 变体上均下降,开源模型跌幅更大;无图时其准确率降至 1–9%。匹配构造方式的示例可恢复部分性能,GRPO+LoRA 微调也带来跨变体和 OOD 增益,说明该依赖可测且可部分缓解。

Efficient RWKV-based Representation Learning for 3D Point Clouds Figure 1
2026-06-10cs.CV

Efficient RWKV-based Representation Learning for 3D Point Clouds

Yun Liu, Xuefeng Yan, Liangliang Nan, Xianzhi Li, Peng Li, Zhe Zhu, Honghua Chen, Mingqiang Wei

2026-06-10三维

面向点云中 Transformer 自注意力开销随点数二次增长、原生 RWKV 又缺乏局部几何与空间关系建模的问题,论文提出 P-RWKV 块,并以 LPE 扩展邻域感知、SCE 用门控融合空间上下文,同时采用双向 WKV 保持线性复杂度。基于该模块的自监督框架 PointER 在补全、分类和细粒度分割等任务上达到与 Transformer/Mamba 方法相近的效果,并报告更低 FLOPs、训练/推理时间和最低推理延迟。

FSS-Net: Frequency-Spatial Synergy Network with Wavelet Attention for Carotid Artery Ultrasound Segmentation Figure 1
2026-06-10cs.CV

FSS-Net: Frequency-Spatial Synergy Network with Wavelet Attention for Carotid Artery Ultrasound Segmentation

Jiawei Liu, Zhijiang Wan, Junhua Hu, Rongli Zhang, Zhongbiao Xu, Yankun Cao, Yuan Chen, Jin Hong

. Ji luan Academy, Nanchang University, Nanchang 330031, China, . School of Information Engineering, Nanchang University, Nanchang 330031, China, . State Key Laboratory of Water Cycle and Water Security, China Institute of Water Resources and Hydropower, . Department of Diagnostic Radiology, Li Ka Shing Faculty of Medicine, The University of Hong Kong, Pok Fu, . Department of Radiotherapy, Guangdong Provincial People's Hospital, Guangdong Academy of Medical Sciences, Southern Medical University, Guangzhou 510080, China, . Joint SDU-NTU Centre for Artificial Intelligence Research (C-FAIR), Shandong University, Jinan 250101, China, . Department of Pediatrics, Shandong Provincial Hospital Affiliated to Shandong First Medical University, Jinan, screening [4-6], manual measurement and delineation are labor-intensive, driving the demand for, motivation, we construct a frequency-spatial collaborative framework consisting of three complementary

2026-06-10视觉感知

针对颈动脉超声在机器人/自动化筛查中受散斑噪声、低对比度和边界模糊影响而难以精确分割的问题,FSS-Net将小波频域分解嵌入U-Net式编码器-解码器,用CSWA联合通道、空间与频率注意抑噪,WEB建模全局上下文,LAEF用拉普拉斯先验补偿边缘。实验报告在颈动脉数据上DSC达96.46%,低SNR下仅下降0.2%,并有乳腺超声迁移验证。

PF-Trans: Physics-Embedded Frequency-Aware Transformer for Spectral Reconstruction Figure 1
2026-06-10cs.CV

PF-Trans: Physics-Embedded Frequency-Aware Transformer for Spectral Reconstruction

Yuzhe Gui, Tianzhu Liu, Yanfeng Gu, Xian Li

2026-06-10三维

面向BFA快照高光谱成像中由周期掩膜引起的严重频谱混叠,PF-Trans不再把重建仅当作空间域去噪,而是将物理成像模型注入输入,并用灰度一致性约束闭环校验;同时在Transformer中加入并行FFT频域分支,以区分掩膜伪影和真实纹理。多数据集实验显示其达到SOTA,GF-5上海数据集PSNR最高48.50 dB。

ClinReadNet: A clinical reading-inspired network for low-dose abdominal CT image quality assessment Figure 1
2026-06-10cs.CV

ClinReadNet: A clinical reading-inspired network for low-dose abdominal CT image quality assessment

Xianye Xiao, Yulong Zou, Yujie Luo, Taihui Yu, Cun-Jing Zheng, Yuan-ming Geng, Shuihua Wang, Yudong Zhang, Jin Hong

. School of Mathematics and Computer Sciences, Nanchang University, Nanchang 330031, China, . School of Information Engineering, Nanchang University, Nanchang 330031, China, . Department of Radiology, Sun Yat-Sen Memorial Hospital, Sun Yat-Sen University, Guangzhou 510120, China, . Department of Stomatology, Zhujiang Hospital, Southern Medical University, Guangzhou 510282, China, . Department of Biological Sciences, School of Science, Xi'an Jiaotong Liverpool University, Suzhou 215123, . School of Computer Science and Engineering, Southeast University, Nanjing 210096, China, grading labels, effectively improving the performance of image quality assessment. Experiments, radiologists: by establishing a collaborative learning mechanism for detailed and global information

2026-06-10视觉感知

低剂量腹部 CT 需要在降辐射与可诊断图像质量间取舍,而人工主观评分成本高且临床难以获得参考图像。ClinReadNet 将无参考 IQA 设计成贴近放射科阅片流程的 Swin Transformer:用 SOQN 强化边缘与有序质量分布,用多温度窗口注意力模拟由整体到局部的关注,并以 HRPS 约束等级距离。文中在 LDCTIQAG2023 上报告 PLCC/SROCC/KROCC 约为 0.95/0.955/0.863,优于已有方法。

Benchmarking stereo reconstruction for 3D printable Martian terrain models Figure 1
2026-06-10cs.CV

Benchmarking stereo reconstruction for 3D printable Martian terrain models

Josephine Wang

al. evaluate on clean, object-centered ShapeNet renderings, Laboratory Curiosity imagery [11].

2026-06-10数据集/基准三维

面向火星车双目图像难以直接转成可触摸/可打印地形模型的问题,本文搭建并评测从视差估计、几何补全到水密 OBJ 导出的基准流程。核心洞察是标准立体匹配榜单性能存在明显域迁移落差:RAFT-Stereo 在 Middlebury 上优于 SGBM(MAE 0.73px vs 3.22px、覆盖率 100%),但在 Curiosity 图像上边缘对齐和重投影误差更差;补全方面 alpha shape 更保真但易碎片化,Poisson 更连通但会引入无支撑表面。

Multi-Angular Reflectance Anisotropy Observed from UAV Multispectral Imagery Figure 1
2026-06-10cs.CV

Multi-Angular Reflectance Anisotropy Observed from UAV Multispectral Imagery

Zhenqiang Qin, Chenguang Dai, Min Wang, Xian Li

College, University, School of Electronics and, Harbin Institute of, The experiments were conducted on the Harbin Institute, of the University of Information Engineering and by Heilongjiang Provincial

2026-06-10视觉感知

针对低空、宽视场无人机多光谱影像中同一地物被多视角观测而引入的辐射不一致问题,论文从 BRDF 角度构建几何感知提取流程:用 SfM 精化相机内外参,将正射影像标注的均质草地 ROI 重投影到多张原始子图,并在 VZA/RAA 极坐标域分析各波段反射率。结果显示十个波段均存在明显各向异性,红边和近红外最大/最小反射率差异达 119–137%,说明观测几何对 UAV 定量反演不可忽略。

Building Change Detection in Earthquake: A Multi-Scale Interaction Network and A Change Detection Dataset Figure 1
2026-06-10cs.CV

Building Change Detection in Earthquake: A Multi-Scale Interaction Network and A Change Detection Dataset

Yunlong Liu, Zekai Zhang

2026-06-10视觉感知数据集/基准

面向震后应急救援中短时相遥感变化检测缺少数据、且近时相成像角差导致建筑侧视错位的问题,论文构建了土耳其地震建筑变化数据集 TUE-CD,并提出 MSI-Net,通过联合跨注意力、多尺度偏移校准和特征融合增强双时相交互与对齐。实验在 WHU-CD、CLCD 和 TUE-CD 上较九种主流方法取得更好的定量与可视化结果。

Content-Induced Spatial-Spectral Aggregation Network for Change Detection in Remote Sensing Images Figure 1
2026-06-10cs.CV

Content-Induced Spatial-Spectral Aggregation Network for Change Detection in Remote Sensing Images

Yunlong Liu, Zekai Zhang

2026-06-10视觉感知

针对多时相遥感变化检测中仅建模空间关系易受季节、光照等光谱伪变化干扰的问题,本文提出 CSI-Net:用级联图卷积做全局空间推理,以特征均值/方差估计光谱差异,并通过高层内容引导的 CGI 模块融合空间—光谱信息。在 LEVIR-CD、WHU-CD、CLCD 上较八种 SOTA 取得更高精度,但模型规模和 FLOPs 较大。

Dissect and Prune: Enhancing Robustness in AI-Generated Image Detection Figure 1
2026-06-10cs.CV

Dissect and Prune: Enhancing Robustness in AI-Generated Image Detection

Dahye Kim, Jaehyun Choi, Hyun Seok Seong, Seongho Kim, Donghun Lee, Sungwon Yi, Jang-Ho Choi

2026-06-10视觉感知安全鲁棒

本文关注 AI 生成图像检测中被总体准确率掩盖的“预测不对称”:模型在压缩、缩放或未见生成器下仍偏向判真,导致假图召回崩塌。作者提出 DEAR,用局部重绘图像及掩码解剖通道与生成/真实区域的对齐关系,并双侧剪除过度依赖两端信号的脆弱特征,仅微调分类头。实验表明该策略可提升跨生成器与后处理鲁棒性,缓解假图检测退化。

What Spatial Memory Must Store: Occlusion as the Test for Language-Agent Memory Figure 1
2026-06-10cs.AI

What Spatial Memory Must Store: Occlusion as the Test for Language-Agent Memory

Doeon Kwon, Junho Bang

Space Zero, Inc.

2026-06-10视觉感知

论文追问语言智能体“记忆宫殿”中,空间坐标究竟提供了文本检索不能提供的能力。其核心洞察是区分按位置回忆与可见性判断:遮挡不是召回过滤器,而是需由存储几何和视线计算回答的感知谓词。实验显示,默认把空间邻近与时效、重要性线性混合会失效,而几何主导排序显著提升;DDA 视线检测在遮挡目标上远超文本与 FoV 基线,并在预注册 live 系统中确认。

Overlapped Wavelet Diffusion for Low-Light Image Enhancement Figure 1
2026-06-10eess.IV

Overlapped Wavelet Diffusion for Low-Light Image Enhancement

Fen Peng, Taizo Suzuki, Seisuke Kyochi

University of, ††Institute of Systems and Information Engineering, University, †††the Department of Digital Media, Hosei University, Koganei-, Copyright © 200x The Institute of Electronics, Information and Communication Engineers

2026-06-10视觉感知生成模型强化学习

本文针对 DiffLL 在低光增强中因非重叠 Haar 小波带来的块效应、以及高频恢复不足导致边缘模糊的问题,提出 OWDiff:用重叠小波变换建模邻域相关性以保持结构连续,并引入低频引导的 HFEBlock 强化纹理与边缘恢复。在 LOLv1 和 LOLv2-real 上,相比 DiffLL 平均提升 0.58 dB PSNR、SSIM 相对提升 1.64%、LPIPS 相对降低 5.9%。

FoA-SR: Faithful or Aesthetic? Profile-Aware Preference Optimization for Real-World Image Super-Resolution Figure 1
2026-06-10cs.CV

FoA-SR: Faithful or Aesthetic? Profile-Aware Preference Optimization for Real-World Image Super-Resolution

Amjad Mahdi Alqarni, Peizhong Ju

Department of Computer Science, University of Kentucky

2026-06-10视觉感知强化学习优化算法

本文针对真实图像超分中“保真”与“美观”目标相互冲突的问题,提出 FoA-SR:先将 FLUX.2 适配为成对 LR-HR 超分基线 Flux2SR,再从同一随机候选池中按不同奖励挖掘偏好对,分别训练 Faithful 与 Aesthetic LoRA。RealSR 和 DIV2K 实验显示,两类适配器可分别提升参考一致性指标与无参考感知质量;78.4% 候选赢家不一致及 Hybrid-LoRA 消融表明单一混合奖励会掩盖可控性。

POPSICLE: Benchmark Datasets for Segmentation and Localization in CryoET Figure 1
2026-06-10eess.IV

POPSICLE: Benchmark Datasets for Segmentation and Localization in CryoET

Jonathan Schwartz, Utz Heinrich Ermel, C. Braxton Owens, Zhuowen Zhao, Ariana Peck, Gus L.W. Hart, Grant J. Jensen, Bridget Carragher, Dari Kimanius

Brigham Young University, Provo, UT, 84602, USA

2026-06-10视觉感知数据集/基准

针对 cryoET 机器学习评测长期受小规模、任务割裂和标注不统一限制的问题,POPSICLE 基于 CryoET Data Portal 构建可扩展基准,统一覆盖 2,993 个带标注断层数据中的密集细胞结构分割与稀疏大分子定位,并通过 copick 标准化访问、划分和评测。基线实验显示卷积、Transformer 与 cryoET 专用模型的排名随任务和数据集显著变化,说明相邻医学影像评测经验难以直接迁移。

Dual-Branch Gated Fusion for Open-Set Audio Deepfake Source Tracing Figure 1
2026-06-10cs.SD

Dual-Branch Gated Fusion for Open-Set Audio Deepfake Source Tracing

Awais Khan, Kutub Uddin, Khalid Malik

College of Innovation and Technology, University of Michigan, Flint, MI, USA, ProbeTruth Inc., MI, USA

2026-06-10视觉感知

针对音频深伪溯源在真实部署中会遇到未见合成器、闭集分类器易过度自信的问题,论文提出双分支门控融合:用 XLSR-53 保持已知源判别力,用 66 维 CORES 手工声学描述符提供分布外稳健线索,并以输入条件门控、能量边界损失和门控多样性避免简单拼接被 SSL 特征主导。在 MLAAD 上取得 97.6% 域内准确率、4.9% EERc,并相对 Interspeech 2025 基线降低 83.5% FPR95。

An Improved Generative Adversarial Network for Micro-Resistivity Imaging Logging Restoration Figure 1
2026-06-10cs.CV

An Improved Generative Adversarial Network for Micro-Resistivity Imaging Logging Restoration

Ahmed Faizul Haque, S.M. Riaz Rahman Antu, Saif Ahmed, Asadullah Hil Galib, Souvik Pramanik, Mohammad Ashrafuzzaman Khan, Mohammad Abdul Qayum, Mohsin Sajjad

North South University

2026-06-10生成模型

微电阻率成像测井常因仪器不稳、井壁坍塌等出现缺失,影响裂缝和岩性解释。本文在GAN修复框架中以FCN生成器结合深度可分离残差、Inception、多尺度特征与通道/空间注意力,并用全局—局部双判别器约束整体语义与局部纹理一致性。实验在不同缺失区域测试集上报告平均SSIM为0.903,较类似方法提升约0.3,但数据规模与消融细节文中未充分说明。

Density Ridge Selective Prediction for LLM and VLM Hallucination Detection under Calibration Label Scarcity Figure 1
2026-06-10cs.LG

Density Ridge Selective Prediction for LLM and VLM Hallucination Detection under Calibration Label Scarcity

Nina I. Shamsi

2026-06-10视觉语言视觉感知

本文针对LLM/VLM幻觉检测在校准标签稀缺时,监督探针易退化、无监督采样方法性能受限的问题,提出用生成期隐藏状态轨迹的六维运动学特征构建正确回答的KDE密度脊,并以测试轨迹到一维脊的距离作为选择性预测置信度。实验覆盖9个文本与视觉语言模型、7个QA基准,在仅200个校准查询和每题5次生成下,相比语义熵、EigenScore、SAPLMA和logP等方法AUROC提升约5–20点,但增益是否来自特征选择或脊几何仍需更细消融确认。

Fisher-Guided Progressive Parameter Selection for Adaptive Fine-Tuning Figure 1
2026-06-10cs.CV

Fisher-Guided Progressive Parameter Selection for Adaptive Fine-Tuning

Ghodsiyeh Rostami, Po-Han Chen, Mahdi S. Hosseini

Concordia University, Mila - Québec AI Institute

2026-06-10视觉感知

针对现有参数高效微调多依赖固定层或模块启发式、难以随任务动态选择参数的问题,论文提出 FisherAdapTune:用相邻训练阶段 Fisher 信息分布的 Jensen-Shannon 距离衡量参数组曲率漂移,已稳定者逐步冻结,仍变化者继续更新,并从 PAC-Bayes 角度解释其泛化收益。实验在裂缝分割等下游密集预测任务上显示,该方法在减少有效可训练参数的同时提升域内表现和多种零样本迁移效果。

Making Time Editable in Video Diffusion Transformers Figure 1
2026-06-10cs.CV

Making Time Editable in Video Diffusion Transformers

Konstantin Kuklev, Viacheslav Vasilev, Alexander Kunitsyn, Andrei Ivaniuta, Denis Dimitrov

2026-06-10视觉感知生成模型

本文针对视频 DiT 中扩散时间与运动演化纠缠、导致 FPS 变化或慢过程生成时节奏不可控的问题,提出 Time Adapter:用全局 FPS 条件控制运动速率、用 latent-time 嵌入对齐局部时间进展,可仅训练轻量时间分支或结合全模型微调。Wan2.2 与 Kandinsky 实验显示其降低 Flow Acceleration/LPIPS-Var,改善速度一致性;TA 更适合人体动作,FTTA 更利于雾、云等自然过程,但部分指标与感知质量仍不完全一致。

A Large Scale Open-Source Image and Video Dataset for Robust Wildfire Detection and Classification Figure 1
2026-06-10cs.CV

A Large Scale Open-Source Image and Video Dataset for Robust Wildfire Detection and Classification

Emadeldeen Hamdan, Yingyi Luo, B. Ugur Toreyin, Erdem Koyuncu, Adam J. Watts, Ugur Gudukbay, Ahmet Enis Cetin

2026-06-10视觉感知数据集/基准安全鲁棒

针对野火早期检测中专用大规模数据不足、模型易过拟合且跨域泛化弱的问题,论文提出开源图像/视频数据集 GWFP,覆盖火焰、烟雾、余烬、近红外和雾/水汽等干扰负样本,并用多种 CNN 与 Transformer 做域内和跨数据集基准;还测试了 Hadamard 跳连的 HTE-ResNet。实验显示该数据集有助于评估真实监控鲁棒性,HTE-ResNet 在域移下有一定改进,但增益可能主要来自数据多样性。

FlexPath: Learned Semantic Path Priors for Image-Based Planning Figure 1
2026-06-10cs.CV

FlexPath: Learned Semantic Path Priors for Image-Based Planning

Taehyoung Kim, Tim Schoenbrod, David Eckel, Henri Meeß

labor-intensive and often struggles to generalize across environments [41].

2026-06-10视觉感知规划控制

针对现有学习式图像规划器把可行性与“最短路”偏好绑定、难以适配避障距离或语义约束的问题,FlexPath先用模仿学习从语义栅格中学习任务无关的软路径先验,再用可微路径形状目标进行目标级微调。实验显示其在TMP上较TransPath减少14.3%搜索扩展且路径成本更低,跨VG/CSM/SC零样本泛化更稳,并在dmin=2避障中达到96.8%完全避障率。

Fusing Satellite Imagery and Planimetric Maps for Cross-View Localization Figure 1
2026-06-10cs.CV

Fusing Satellite Imagery and Planimetric Maps for Cross-View Localization

Quang Long Ho Ngo, Zimin Xia, Alexandre Alahi

modalities are widely available and possess complementary, semantic labels and becomes less informative under strong, are widely available. As shown in Fig. 1, the two modalities, metric maps, since overhead imagery is typically unavailable, the labeled, occlusion-robust structural information provided, requires large-scale training and is not available on the fly, as OSM. Despite the availability of both modalities, current

2026-06-10视觉感知

针对城市 GNSS 误差下跨视角定位过度依赖卫星图、而 OSM 等平面地图虽抗遮挡却单独性能较弱的问题,论文提出可插入现有方法的双模态融合模块:用跨模态条件化让两类 BEV 特征相互感知,并以 patch 级规则自适应选择卫星细节或地图语义。该模块在三种定位方法、两个基准上稳定提升,在 KITTI cross-area 上平均定位误差降至 3.85 m,相比最佳单模态方法降低 30.13%。

From Senses to Decisions: The Information Flow of Auditory and Visual Perception in Multimodal LLMs Figure 1
2026-06-10cs.AI

From Senses to Decisions: The Information Flow of Auditory and Visual Perception in Multimodal LLMs

Wish Suharitdamrong, Muhammad Awais, Xiatian Zhu, Sara Atito

Surrey Institute for People-Centred AI (PAI), University of Surrey, UK, Centre for Vision, Speech and Signal Processing (CVSSP), University of Surrey, UK

2026-06-10视觉语言生成模型

针对音视频大模型中“听觉、视觉信号如何影响最终答案”仍不清楚的问题,本文用注意力 knockout 等机制分析追踪 AVLLM 信息流。核心发现是:单个音视频视频沿类似 VLM/VideoLLM 的顺序路径传递,多交错输入则形成并行路径;模态贡献随任务需求变化,深层视频注意力多为伪迹。实验在 Qwen2.5-Omni、Video-SALMONN2 Plus 的 3B/7B 上表明,信息转移完成后丢弃相应 token 几乎不降精度,甚至略有提升。

DB-3DME: From Dataset to Benchmark for Human-aligned Automatic 3D Mesh Evaluation Figure 1
2026-06-10cs.CV

DB-3DME: From Dataset to Benchmark for Human-aligned Automatic 3D Mesh Evaluation

Nanshan Jia, Zhenyu Zhao, Sui Huang, Jingshen Wang, Zeyu Zheng

University of California, Berkeley, dented improvements in realism, controllability, and effi-, pushing the boundaries of controllability, fidelity, and ef-, proaches enable scalable and fully automatic evaluation, scalable mesh-level evaluation a critical component of 3D, The human labels cover two evaluation di-, human-centered 3D mesh evaluation objectives. The result-

2026-06-10数据集/基准三维

针对3D生成快速发展但网格质量评估仍依赖昂贵人工、CLIP式指标或未对齐VLM的问题,DB-3DME构建了含2619个合成3D网格及人工几何/提示一致性评分的数据集,并系统比较SOTA VLM,指出3D表示的视觉编码能力是关键因素;在此基础上微调Qwen-2.5-VL-7B后,模型在多个评估维度显著超过现有预训练VLM,形成新的自动3D网格评测基准。

iSAGE: A Human-in-the-Loop Framework for Remote Sensing Semantic Segmentation via Sparse Point Supervision Figure 1
2026-06-10cs.CV

iSAGE: A Human-in-the-Loop Framework for Remote Sensing Semantic Segmentation via Sparse Point Supervision

Osmar Luiz Ferreira de Carvalho, Osmar Abilio de Carvalho Junior, Anesmar Olino de Albuquerque, Daniel Guerreiro e Silva

aDepartment of Electrical Engineering, University of Brasília, Brasília, DF, Brazil, bDepartment of Geography, University of Brasília, Brasília, DF, Brazil, iary machinery (pseudo-labels, propagation, CRFs, foundation-model prompts, auxiliary heads), all, Experiments use a minimum-effort regime: at most one labeled pixel per class per frame. On BsB, Aerial (controlled laboratory), iSAGE recovers 97.2% of dense supervision (74.79% mIoU on 0.040%, (oracle entropy across budgets 1–100×, pseudo-labels across thresholds 0.90–0.99, CRF-based prop-, and target-dependent, the prevailing assumption is that extensive labeled data is a prerequisite., However, models in production demand more than benchmark-style labeling: (1) speed: Cityscapes, MS-COCO took over a year and a half of collaborative effort (Lin et al., 2014), to insert the label, prompts but do not assign class labels in specialized taxonomies, and even when used as labeling, ), pseudo-labeling reuses high-confidence predictions (Lee et al., 2013

2026-06-10视觉感知

遥感语义分割常因传感器和地域迁移差而反复需要昂贵密集标注。iSAGE的核心洞察是:模型预测分布无法区分“高置信但错误”和“高置信且正确”像素,因此让专家直接点击可见的高置信错误,并用误差加权Dice损失反复放大这些稀疏点监督,而不做伪标签或传播。在每类每帧最多1点的设置下,BsB Aerial用0.040%像素达到密集监督97.2%,Vaihingen用0.011%像素取得76.78% mIoU,接近/略超密集基线,并显著高于同管线输出读取基线。

BiWM: Advancing Open-Source Interactive Video World Models with Bidirectional Autoregression Figure 1
2026-06-10cs.CV

BiWM: Advancing Open-Source Interactive Video World Models with Bidirectional Autoregression

Shaohao Rui, Xiaofeng Mao, Zhanyu Zhang, Peijia Lin, Yansong Zhu, Yibo Zhang, Haibin Wan, Weijie Ma

2026-06-10视觉感知强化学习

针对因果自回归视频世界模型流程复杂、长时交互中误差累积导致画质和控制漂移的问题,BiWM提出开源的双向自回归框架:在块内保留双向注意力、块间自回归,仅用相机/动作控制微调与少步DMD蒸馏两阶段完成训练,并加入历史压缩、4-bit部署及GAN/forward-KL抗退化项。论文报告其可在数百步、8×H200上收敛,支持多种视频骨干和真实相机控制,相比minWM更稳定但仍需更系统的对照基准。

Improving PET/CT-Based Whole-Body Lesion Segmentation Using Prediction Uncertainty-Augmented Models Figure 1
2026-06-10cs.CV

Improving PET/CT-Based Whole-Body Lesion Segmentation Using Prediction Uncertainty-Augmented Models

Bashirul Azam Biswas, Biratal Raj Wagle, Zhihan Yang, Marc A. Seltzer, Matthew E. Maeder, James B. Yu, Indrani Bhattacharya

Department of Biomedical Data Science, Geisel School of Medicine at Dartmouth, Dartmouth Hitchcock Medical Center, processes by detecting uptake of different radiotracers, such as [68Ga]-PSMA-11 and [18F]-labeled prostate specific, gions, different radiotracers, and the labor- and expertise-intensive task of lesion identification and annotation5. The, growing volume of PET/CT scans, without a corresponding increase in nuclear medicine experts available for inter-

2026-06-10视觉感知安全鲁棒

针对全身 PET/CT 病灶分割在多癌种、多示踪剂场景下易受训练随机性、漏检和缺乏可靠性估计影响的问题,论文在 nnU-Net 上引入贝叶斯集成、体素级认知/偶然不确定性分解,并用不确定性增强训练与病例自适应路由。AutoPET-III 上 Dice 从 60.1 提至 62.0,路由达 63.1;Deep-PSMA 外部分布上最高 Dice 65.3,但召回提升伴随假阳性增加。

Maximum Matching Accuracy: An Instance Segmentation Evaluation Metric Utilizing Globally Optimal Matching Figure 1
2026-06-10cs.CV

Maximum Matching Accuracy: An Instance Segmentation Evaluation Metric Utilizing Globally Optimal Matching

Kaden Stillwagon, Alexandra D. VandeLoo, Craig R. Forest

aCollege of Computing, Georgia Institute of Technology, Atlanta, 30332, Georgia, United States, bSchool of Materials Science and Engineering, Georgia Institute of Technology, Atlanta, 30332, Georgia, United States, cWallace H. Coulter Department of Biomedical Engineering, Georgia Institute of Technology, Atlanta, 30332, Georgia, United States, dGeorge W. Woodruff School of Mechanical Engineering, Georgia Institute of Technology, Atlanta, 30332, Georgia, United States

2026-06-10视觉感知数据集/基准

针对生物细胞实例分割中 AP、PQ、SEG、AJI 等指标受硬 IoU 阈值、逐实例归一化和贪心/一对多匹配影响而导致排名不稳的问题,论文提出 MMA:用全局最优一对一匹配、连续重叠计分和像素级归一化来评估掩膜质量。合成失效、渐进腐蚀和模型排名实验显示,MMA 对分裂、合并和边界误差更敏感稳定,并在最高 50% 情况下给出不同最佳模型。

Interpretable Temporal Facial-Region Motion Analysis for In-the-Wild Parkinson's Disease Video Classification Figure 1
2026-06-10cs.CV

Interpretable Temporal Facial-Region Motion Analysis for In-the-Wild Parkinson's Disease Video Classification

Riyadh Almushrafy (Majmaah University, Saudi Arabia)

Department of Computer Science and Information, College of Science, Majmaah, University, Saudi Arabia, difficult, but it also reflects the conditions under which scalable video-based screening or cue, level annotations, and expert-provided labels. Its public availability makes it valuable for, disease duration, and detailed clinical rating context is not generally available. For this reason

2026-06-10视觉感知

针对野外视频中帕金森低面部表情难以量化且易受姿态、光照、说话和头动干扰的问题,本文在 YouTubePD 的14个面部区域关键点上比较静态几何、归一化几何、速度/相对速度与 GRU,核心洞察是归一化的区域运动速度比复杂序列模型更稳且可解释。随机森林取得测试 balanced accuracy 0.826、AUROC 0.855,10种子下 AUROC 0.855±0.005;区域消融和置换重要性显示信息集中在少数区域及运动变异、峰值变化,但不等同于受控临床严重度评估。

A Controlled Audit of Pretraining Contamination in Public Medical Vision-Language Benchmarks Figure 1
2026-06-10cs.CV

A Controlled Audit of Pretraining Contamination in Public Medical Vision-Language Benchmarks

Bruce Changlong Xu, Lan Wu, Alexander Ryu

Stanford University, University of California, Berkeley, VQA-RAD (Lau et al., 2018): datasets that (a) have been publicly available for 3–7 years

2026-06-10视觉语言视觉感知规划控制数据集/基准

针对医学视觉语言基准长期公开、可能被预训练语料污染而仍被当作独立测试集的问题,本文对多种开放VLM和SLAKE-En、PathVQA、VQA-RAD、OmniMedVQA镜像做受控审计,并同时检验泄漏检测器可靠性。结果显示SLAKE-En存在明显图像源分布重叠、OmniMedVQA有文本侧污染信号,VQA-RAD相对更干净;而Min-K%++尾部富集和top-K重叠在BLIP-2对照下失效,不宜单独作为泄漏证据。

Continuous Neural Reparameterization as a Deep Geometric Prior for Robust Fixed-Chart UV Repair Figure 1
2026-06-10cs.GR

Continuous Neural Reparameterization as a Deep Geometric Prior for Robust Fixed-Chart UV Repair

Mohammad Sadegh Salehi

2026-06-10安全鲁棒

针对传统固定图表 UV 展开在初始化不良、局部极小或折叠时易产生翻面的问题,本文将顶点到 UV 的映射改写为未训练 SIREN 的连续神经重参数化,并结合 LBO 谱特征、Tutte 预热、行列式屏障、无效步拒绝与回退路由来优先保证局部有效性。结果显示紧致图表全零翻面,Thingi10K/xatlas 47 个分层图表中 42 个有效零翻面,Amara 大规模流程经回退后 1000/1000 局部有效;但方法较慢,且允许重切时 BFF/OptCuts 可能更快或低失真。

GHOST: Hierarchical Sub-Goal Policies for Generalizing Robot Manipulation Figure 1
2026-06-10cs.RO

GHOST: Hierarchical Sub-Goal Policies for Generalizing Robot Manipulation

Sriram Krishna, Ben Eisner, Haotian Zhan, Ying Yuan, Haoyu Zhen, Chuang Gan, Shubham Tulsiani, David Held

2026-06-10机器人

针对机器人模仿学习依赖大量遥操作数据且难泛化到新物体/场景的问题,GHOST将操作分解为高层3D末端子目标预测与低层目标条件控制,并用投影热图把3D目标接入图像策略;子目标相对跨本体,使人类视频可训练高层而无需动作重定向。实验显示其在长时程折叠、锤钉等任务上显著优于平坦Diffusion Policy,并能借少量人类示范适应OOD组合与类别,但高层视觉域差仍是瓶颈。

SpineReport: Automated 3D Quantification and Reporting of Lumbar Spine Degeneration on MRI Figure 1
2026-06-10cs.CV

SpineReport: Automated 3D Quantification and Reporting of Lumbar Spine Degeneration on MRI

Nathan Molinier, Adrian A. Marth, Reto Sutter, Christoph Germann, Jacob A. Connolly, Mathieu Guay-Paquet, Nathan D. Schilaty, Kenneth A. Weber II, Julien Cohen-Adad

NeuroPoly, Institute of Biomedical Engineering, Polytechnique Montreal, Montreal, QC, Canada, Mila, Quebec AI Institute, Montreal, QC, Canada, Department of Radiology, Balgrist University Hospital, Zurich, Switzerland, Faculty of Medicine, University of Zurich, Zurich, Switzerland, Department of Neurosurgery, Brain & Spine, University of South Florida, Tampa, FL, USA, Center for Neuromusculoskeletal Research, University of South Florida, Tampa, FL, USA, Department of Medical Engineering, University of South Florida, Tampa, FL, USA, Stanford School of Medicine, Stanford, CA, USA, Centre de recherche du CHU Sainte-Justine, Université de Montréal, Montreal, QC, Canada

2026-06-10三维

腰椎 MRI 退变评估常依赖二维手工测量,易受切面和体位影响且复现性不足。SpineReport 将稳健解剖分割转化为开放的全自动三维形态与信号定量,并生成可与队列分布对照的个体报告。与放射科分级对照显示,其指标能较好识别中央椎管狭窄,T2 脑脊液信号 AUC 达 0.95,椎管前后径和面积比 AUC 超 0.80;侧隐窝狭窄关联中等,椎间孔狭窄未见显著关联。

Generalized-CVO: Fast and Correspondence-Free Local Point Cloud Registration with Second Order Riemannian Optimization Figure 1
2026-06-10cs.CV

Generalized-CVO: Fast and Correspondence-Free Local Point Cloud Registration with Second Order Riemannian Optimization

Ray Zhang, Marcus Greiff, Thomas Lew, John Subosits

when other sensors such as GPS are unavailable or unre-, *1Website: https://github.com/ToyotaResearchInstitute/, †2All authors are with Toyota Research Institute, 4440 El Camino Real, color and pixel labels through the functional representa-, pixel labels. RKHS-BA [66] extends frame-to-frame reg-

2026-06-10优化算法三维

针对点云里程计在特征稀疏、噪声场景中难以建立可靠对应,以及既有 RKHS 无对应配准速度慢、未利用局部几何的问题,论文提出 G-CVO:用逐点各向异性核编码表面结构,在法向更强约束、切向放松,并以 SE(3) 上的黎曼 Gauss-Newton 近似二阶求解。实验在 KITTI、室内 RGB-D 和自采稀疏赛车场景提升跟踪鲁棒性,较一阶 CVO 最多快 10 倍,困难驾驶任务平移和旋转漂移均降逾 55%。

ABot-Earth 0.5: Generative 3D Earth Model Figure 1
2026-06-10cs.CV

ABot-Earth 0.5: Generative 3D Earth Model

Ming Qian, Tianjian Ouyang, Mingchao Sun, Zijian Wang, Jincheng Xiong, Jiarong Han, Yongchang Zhang, Jiawei Zhang, Xu Wang, Yu Liu, Luyang Tang, Fei Yu, Zengye Ge, Mengmeng Du, Yuan Liu, Nianfei Fan, Song Wang, Yingliang Peng, Chunxue Jia, Yang Liu, Shiying Zeng, Haozhe Shi, Junnan Lai, Hongyu Pan, Zheng Wu, Ning Guo, Mu Xu, Hang Zhang

AMAP CV Lab

2026-06-10生成模型三维

针对传统大规模三维地球重建依赖航拍/LiDAR、成本高且难以按需扩展的问题,ABot-Earth 0.5 将生成模型直接建在 3D Gaussian Splatting 表示上,以卫星图像为条件,并用真实城市级 3DGS 重建数据训练,避免纯合成场景的 sim-to-real 偏差。论文报告其可在每平方公里 10 分钟内生成具多级 LOD 的可交互场景,在真实感和几何保真度上优于基线,并支持 UAV 导航等闭环仿真;具体增益可能主要来自 scaling / data。

SPARX: Secure and Privacy-Aware Approximate CNN Acceleration with Edge RISC-V SoC Figure 1
2026-06-10cs.AR

SPARX: Secure and Privacy-Aware Approximate CNN Acceleration with Edge RISC-V SoC

Sonu Kumar, Akash Sankhe, Mukul Lokhande, Santosh Kumar Vishvakarma

Centre for Advanced Electronics, Indian Institute of Technology Indore, accelerators while preserving programmability, scalability, and

2026-06-10视觉感知

面向边缘设备上视觉 CNN 推理的能耗、实时性与隐私安全约束,SPARX 将近似对数 MAC 加速器、RISC-V 自定义指令、差分噪声隐私保护和挑战响应认证集成到 RV32IMC SoC,并用 ASI/AFOM/HAE 等指标选择算术单元。实验选出 ILM,相比精确 Booth MAC 面积降 51.7%、功耗降 81.5%、吞吐提升 2.13×,ResNet-20/CIFAR-10 精度仅降 2.82 个百分点,FPGA 达 58.4 GOPS/W。

Bypassing Copyright Protection in Diffusion-based Customization via Two-Stage Latent Feature Optimization Figure 1
2026-06-10cs.CR

Bypassing Copyright Protection in Diffusion-based Customization via Two-Stage Latent Feature Optimization

Ziang Xu, Wenbo Yu, Hongyao Yu, Hao Fang, Jiawei Kong, Bin Chen, Hao Wu, Shu-Tao Xia, Zhiyong Wu

Harbin Institute of Technology, Graduate School, Resource Availability:, The source code of this paper has been made publicly available at https:

2026-06-10生成模型优化算法

针对扩散模型个性化生成中以对抗扰动保护版权图像但可能被自适应绕过的问题,论文指出现有防御主要破坏图像到 LDM 潜空间的语义映射,并提出 TS-LFO 通过潜变量去噪与像素约束重建两阶段恢复该映射。实验显示其可持续绕过多种 SOTA 版权防御,并优于 DiffPure、GrIDPure、IMPRESS 等攻击基线。

On the Controllability-Fidelity Frontier in Diffusion Editing Figure 1
2026-06-10cs.GR

On the Controllability-Fidelity Frontier in Diffusion Editing

Yi Hu, Leying Yi, Emily Davis, Finn Carter

On the Controllability-Fidelity Frontier in Diffusion Editing, Xidian University, lable diffusion-based image editing, analyzing the trade-offs, In particular, users seek controllability (precision in fol-

2026-06-10生成模型规划控制

本文关注扩散图像编辑中“按意图可控”与“保留原图保真”的内在冲突。作者将文本、掩码、拖拽和反演式编辑统一为带保真正则的优化框架,并分析噪声注入、引导采样与反演误差,给出重建误差、重复编辑稳定性和局部性界。实验比较 TF-ICON、DragFlow、InstructPix2Pix、UltraEdit 等方法,显示强提示对齐常伴随身份漂移、背景破坏、提示敏感和组合失败,同时讨论概念擦除等安全防护。

WHU-Infra3D: A Full-stack Multi-modal Dataset and Benchmark for 3D Roadside Infrastructure Inventory Figure 1
2026-06-10cs.CV

WHU-Infra3D: A Full-stack Multi-modal Dataset and Benchmark for 3D Roadside Infrastructure Inventory

Chong Liu, Luxuan Fu, Xuyu Feng, Zhen Dong, Bisheng Yang

aState Key Laboratory of Information Engineering in Surveying, Mapping and Remote Sensing (LIESMARS), Wuhan University, Wuhan 430079, China, scalable, AI-driven urban infrastructure inventory and lifecycle management. The WHU-Infra3D dataset is available at https:, boxes, semantic masks, and instance masks). (Center) The core feature is Instance Association, which establishes consistent cross-frame tracking

2026-06-10数据集/基准三维

面向数字孪生城市中路侧设施从“看见”到“可维护”的需求,论文指出现有数据集缺少严格2D-3D对齐、跨帧去重和缺陷状态标注。WHU-Infra3D采集三城53.8 km全景图与激光点云,提供2D框、3D实例、跟踪ID及18万余属性/状态标签,并建立检测、匹配、定位、分割和属性识别五类基准。实验显示跨城市域偏移明显,现有模型对长尾损坏/遮挡状态仍较脆弱。

Toward Calibrated, Fair, and accurate Deepfake Detection Figure 1
2026-06-10cs.LG

Toward Calibrated, Fair, and accurate Deepfake Detection

Ryan Brown, Chris Russell

University of Oxford, ing fairness approaches require demographic labels, retraining, or sacrifice accuracy., label-free fairness method demonstrated for deepfake detection: a lightweight cali-, racy when demographics are available, and FF-Discover, which does the same with, Post-processing methods that adjust decision thresholds often need group labels at inference time, challenge: it achieves fairness without demographic labels, without retraining, and without sacrificing, a barrier. FF-Max directly optimizes thresholds using known group labels, while FF-Discover does, graphic labels. Our evaluation demonstrates the effectiveness of FF. FFT reduces performance gaps, decision thresholds to maximize worst-group accuracy when demographic labels are available at, thresholds to maximize minimum group accuracy without demographic labels at any stage and, is group-label-free, retraining-free, and improves both worst-group and overall accuracy.

2026-06-10视觉感知

针对深伪检测器在性别、族裔等群体间误报率和召回率差异大的部署问题,论文提出即插即用的 Face-Fairness 后处理框架。核心洞察是冻结人脸嵌入已包含与失效相关的连续线索,可用轻量 MLP 对检测 logit 做条件重映射;另给出基于显式或聚类群体的阈值版本。实验显示在域内与跨数据集测试中,该方法降低 FPR/TPR 差距、提升最差群体准确率,并基本保持或提高总体准确率。

SD-GRPO: Verifiable Segment Decomposition for Long-Form Vision-Language Generation Figure 1
2026-06-10cs.CV

SD-GRPO: Verifiable Segment Decomposition for Long-Form Vision-Language Generation

Hyunwoong Kim, Seongeun Lee, Hannah Yun, Junhyun Park, Jonggwon Park

DEEPNOID Inc., Seoul, South Korea

2026-06-10视觉语言视觉感知

本文针对长篇视觉语言生成中 GRPO 只用单一整体奖励导致细粒度信用分配错误的问题,提出 SD-GRPO:将输出按可验证语义段切分,并在 rollout 组内对分段奖励做 z 归一化,得到分段优势。实验覆盖多面板描述、多图表 VQA 和科学图注,显示其较 GRPO/Dr. GRPO 稳定提升;当分段语义耦合较强时,分段奖励与整体奖励混合效果最好。

MinhwaNet: Faithful but Insufficient Object Grounding in Korean Folk Painting Figure 1
2026-06-10cs.MM

MinhwaNet: Faithful but Insufficient Object Grounding in Korean Folk Painting

Joonhyung Bae

JOONHYUNG BAE, Korea Advanced Institute of Science and Technology (KAIST), South Korea, yet the genre target turns on how symbols are arranged rather than on which ones appear. The same lens separates a content label, that survives transfer to held-out source institutions, genre, from a style label that does not, era, a prediction we confirm on two, further labels in the corpus. We release the multimodal system, a worked-example reading of one painting’s evidence map against its, The public corpus we use is well suited to the question we pose. Each whole painting carries a curatorial genre label, Author’s Contact Information: Joonhyung Bae, Korea Advanced Institute of Science and Technology (KAIST), Daejeon, South Korea, value interpretive. Two of the answers are about what one would expect. Fusion reliably helps a content label like genre, The same lens organizes a second observation. Fusing image and text helps a content label whose attributes the, captions describe, like genre, and does not help a style label that the captions ignore, like era. The same separation, labels in the corpus, theme and drawing technique, and find that it holds., of labeled Western paintings and the OmniArt benchmark adding artist, type, and timeframe annotations at scale [23, 24]., themes rather than the movements and schools that label Western art, so the categories overlap in their visual content.

2026-06-10视觉语言

论文探讨韩国民画中“吉祥符号清单”能否决定题材类别。作者构建 MinhwaNet,将整画图像、双语策展文本与专家对象裁剪结合,提出“忠实但不足”的对象 grounding 诊断:证据图能定位策展对象并解释模型关注处,但题材更多取决于符号的组合、布局与画法。结果显示图文融合显著优于仅用对象清单,强制对象化表示反而降低题材分类;同时,年代预测主要受馆藏来源混杂影响,跨机构泛化不足。

Sketch-to-Layout: A Human-Centric Computational Agent for Constraint-Aware Synthesis of Modular Photobioreactors Figure 1
2026-06-10cs.HC

Sketch-to-Layout: A Human-Centric Computational Agent for Constraint-Aware Synthesis of Modular Photobioreactors

Xiujin Liu, Shuqi Li, Yuxin Lin

Qrafty Technology Inc. 2University of Michigan, vitality from ordinary photographs without requiring absolute ground-truth labels., scalable carbon capture systems., widespread adoption due to the transition from bespoke engineering to scalable, user-deployed

2026-06-10优化算法

面向建筑集成微藻光生物反应器难以由非专家扩展部署、管路拓扑易失效且维护成本高的问题,论文将14类模块化“碳中和砖”的布局生成建模为CSP,用CP-SAT把用户草图作为软偏好、端口对齐和全局连通等作为硬约束,并加入弱监督视觉健康监测。实验显示15×15网格内求解成功率达95.5%,监测轨迹与14天生物周期基本一致。

Integrated Real-Time Motion Tracking and AI Analysis for Athletic Performance Optimization Figure 1
2026-06-10cs.HC

Integrated Real-Time Motion Tracking and AI Analysis for Athletic Performance Optimization

Parth Agrawal, Ronit, Sagar Kumar, Aashish Bhambri

and labour-intensive method often missed the subtle, expensive, controlled, lengthy and intrusive lab setups, which, cameras [8]. Advanced analysis tools available only to well-, Department of Computer Science, Chandigarh University

2026-06-10视觉感知优化算法

针对传统人工观察和昂贵标记式动捕难以在真实训练中提供低延迟反馈的问题,本文梳理HPE架构取舍,并提出基于MediaPipe的轻量模块化原型,结合运动专项逻辑、有限状态机计次、关节角峰值跟踪和赛后LLM反馈。四段视频测试显示MPJPE约0.0147–0.0316、23–25 FPS、95分位端到端延迟低于45ms,计次较稳定;但样本规模较小,泛化能力文中未充分说明。

2026-06-09

276 篇
Latent Spatial Memory for Video World Models Figure 1
2026-06-09cs.CV

Latent Spatial Memory for Video World Models

Weijie Wang, Haoyu Zhao, Yifan Yang, Feng Chen, Zeyu Zhang, Yefei He, Zicheng Duan, Donny Y. Chen, Yuqing Yang, Bohan Zhuang

2026-06-09视觉感知强化学习

视频世界模型在长轨迹生成中容易因缺少持久三维记忆而产生几何漂移,而既有 RGB 点云缓存又有渲染、重编码开销和潜在表征损失。本文提出 Mirage,将 VAE 潜变量通过深度反投影存入三维 latent spatial memory,并在目标视角以潜空间投影直接读出,再结合分块更新维持一致性。实验显示其在 WorldScore 达到 SOTA、RealEstate10K 重建质量较强,同时端到端生成最高加速 10.57 倍、3D 缓存显存降低 55 倍。

MemoryVLA++: Temporal Modeling via Memory and Imagination in Vision-Language-Action Models Figure 1
2026-06-09cs.RO

MemoryVLA++: Temporal Modeling via Memory and Imagination in Vision-Language-Action Models

Hao Shi, Weiye Li, Bin Xie, Yulin Wang, Renping Zhou, Tiancai Wang, Xiangyu Zhang, Ping Luo, Gao Huang

2026-06-09视觉语言视觉感知

本文针对现有 VLA 多依赖当前观测、难以处理长程时序操作的问题,提出 MemoryVLA++:用感知/认知记忆库存储并检索历史上下文,同时借助世界模型在潜空间“想象”未来状态,再由扩散动作专家生成动作。实验覆盖 5 个仿真基准和 3 类真机任务,报告在 Libero、SimplerEnv、Calvin 等及真机长程记忆/想象任务上均有提升,真机分别带来约 +9%、+26%、+28% 增益。

OmniGameArena: A Unified UE5 Benchmark for VLM Game Agents with Improvement Dynamics Figure 1
2026-06-09cs.CV

OmniGameArena: A Unified UE5 Benchmark for VLM Game Agents with Improvement Dynamics

Mingxian Lin, Shengju Qian, Yuqi Liu, Yi-Hua Huang, Yiyu Wang, Wei Huang, Yitang Li, Fan Zhang, Zeyu Hu, Lingting Zhu, Xin Wang, Xiaojuan Qi

The University of Hong Kong, The Chinese University of Hong Kong, Tsinghua University

2026-06-09视觉语言数据集/基准

针对现有 VLM 游戏基准多只给单次冷启动分数、偏重 Solo 且难以公平比较异构智能体的问题,OmniGameArena 构建了 12 个全新 UE5 实时游戏,覆盖 Solo/PvP/Coop,并提出 IDC 多轮反思评测来观察分数演化与泛化到留出变体的能力。实验显示 12 个智能体中无模型全面领先,商业 VLM 明显强于开源与专用策略;4 个强模型经反思均有提升,但峰值常出现在中途,原任务增益与迁移表现可能分离。

PTL-Diffusion: Manifold-Aware Diffusion with Periodic Terminal Laws Figure 1
2026-06-09cs.CV

PTL-Diffusion: Manifold-Aware Diffusion with Periodic Terminal Laws

Danqi Zhuang, Jisui Huang, Xiaoyue Xi, Andrew Kiggins, Xiaojie Wang, Ke Chen, Yue Wu

2026-06-09生成模型

针对标准扩散模型以单一高斯终端分布生成、难以显式保留低维流形几何的问题,PTL-Diffusion 将周期相位结构嵌入前向加噪过程,使其收敛到相位索引的周期高斯终端族,并保持闭式边缘分布、反向后验和常规噪声预测训练。在环面、圆柱点云和 Olivetti 人脸上,相比 DDPM 降低了相位误差、协方差误差和流形近邻距离,但仍属小规模概念验证。

iMaC: Translating Actions into Motion and Contact Images for Embodied World Models Figure 1
2026-06-09cs.RO

iMaC: Translating Actions into Motion and Contact Images for Embodied World Models

Zhenyu Wu, Xiuwei Xu, Yukun Zhou, Yifan Li, Qiuping Deng, Xiaofeng Wang, Zheng Zhu, Bingyao Yu, Ziwei Wang, Jiwen Lu, Haibin Yan

Beijing University of Posts and Telecommunications, Tsinghua University, Nanyang Technological University

2026-06-09视觉感知强化学习

面向机器人策略评估,论文指出动作条件视频模型若只用紧凑动作向量,难以捕捉厘米级接触差异。iMaC 将未来关节动作经 URDF/正运动学渲染为运动图像,并结合深度点云生成双流接触图像,显式约束机器人外观与场景几何关系,同时用训练期滚动缓解长时闭环误差。在 8 个真实长程操作任务中,其世界模型成功率估计与真实策略表现强正相关,可用于比较不同 checkpoint。

AHA-WAM:Asynchronous Horizon-Adaptive World-Action Modeling with Observation-Guided Context Routing Figure 1
2026-06-09cs.RO

AHA-WAM:Asynchronous Horizon-Adaptive World-Action Modeling with Observation-Guided Context Routing

Jisong Cai, Long Ling, Shiwei Chu, Zhongshan Liu, Jiayue Kang, Zhixuan Liang, Wenjie Xu, Yinan Mao, Weinan Zhang, Xiaokang Yang, Ru Ying, Ran Zheng, Yao Mu

Shanghai Jiao Tong University, Shanghai AI Laboratory, The University of Hong Kong

2026-06-09强化学习

本文针对现有世界-动作模型将视频预测与动作执行绑定在同一短时频率、导致视频分支浪费在低信息量近邻帧的问题,提出AHA-WAM:用低频视频DiT做长时世界规划并复用KV上下文,用高频动作DiT闭环执行,并通过OVCR和offset训练缓解异步错位。实验显示其在RoboTwin达92.80%成功率、4个真实任务达78.3%,闭环控制24.17Hz并较Fast-WAM加速4.59倍。

Echo-Memory: A Controlled Study of Memory in Action World Models Figure 1
2026-06-09cs.CV

Echo-Memory: A Controlled Study of Memory in Action World Models

Wayne King, Zeyue Xue, Yuxuan Bian, Jie Huang, Haoran Li, Yaowei Li, Yaofeng Su, Yuming Li, Haoyu Wang, Shiyi Zhang, Songchun Zhang, Yuwei Niu, Sihan Xu, Junhao Zhuang, Haoyang Huang, Nan Duan

2026-06-09强化学习规划控制

本文针对动作条件世界模型在视角离开后再返回时场景和物体身份易漂移的问题,固定视频扩散骨干、动作接口和评测流程,仅改变记忆的存储与读取方式,拆分容量、压缩、读出和递归四个因素。结果显示,回放指标不能代表真实记忆;增加原始上下文显著提升开放域返回,一些紧凑空间/混合压缩会丢失关键证据,而分块状态空间递归在开放域返回上最强。

Beyond Spherical Harmonics: Rethinking Appearance Models for Radiance Reconstruction Figure 1
2026-06-09cs.CV

Beyond Spherical Harmonics: Rethinking Appearance Models for Radiance Reconstruction

Ewa Miazga, Jorge Condor, Piotr Didyk

2026-06-09三维

本文针对新视角合成/辐射场重建中低阶球谐难以表达高频视角相关外观、而高阶球谐又带来显存和计算开销的问题,系统比较多类球面函数,并归纳出多模态、闭式积分和各向异性是关键属性;据此提出归一化各向异性球面 Gabor(NASGabor)核。实验显示其能更准确重建高光、glints 等视角效应,相比常用 SH 最高约节省 5 倍内存且评估更快,可集成到 3DGS 管线。

End-to-End Optimization of Incoherent Imaging for Classification Under Detector-Limited Readout Figure 1
2026-06-09cs.CV

End-to-End Optimization of Incoherent Imaging for Classification Under Detector-Limited Readout

Archer Wang, Joshua Chen, Sachin Vaidya, Marin Soljačić

are with the Research Laboratory of Electronics, Massachusetts Institute of, Massachusetts Institute of Technology, Cambridge, MA 02139 USA.

2026-06-09优化算法

本文关注光学前端与神经分类器端到端协同设计在何种成像约束下真正优于传统透镜,动机是高速度、低功耗场景中全像素读出成本高。核心洞察是:非相干被动相位掩模在全探测器读出时不能超过理想通道互信息上限,优势主要来自受限读出下的任务感知测量形成。实验与理论表明,在低探测噪声、稀疏或掩膜读出且类别信息偏低频时增益最大;读出充分、块求和或噪声升高时收益明显缩小。

POTATR: A Lightweight Image-to-Graph Model for Page-Level Table Extraction Figure 1
2026-06-09cs.CV

POTATR: A Lightweight Image-to-Graph Model for Page-Level Table Extraction

Brandon Smock, Libin Liang, Max Sokolov, Amrit Ramesh, Valerie Faucon-Morin, Tayyibah Khanam, Maury Courtland

2026-06-09视觉感知

面向大规模文档处理中页级表格抽取依赖自回归VLM、成本高且缺少空间定位的问题,POTATR将TATR扩展为2900万参数的图预测模型,并行检测表格、行列、表头、标题和脚注及其父子关系,每个元素都有框。借助预训练TSR权重,它在PubTables-v2 Single Pages上达到GriTSCon 0.964、标题文本F1 0.979,较前沿MLLM快130倍、成本低约300倍。

SemDINO: A DINOv3-Driven Network for Cross-Temporal Semantic Alignment in Change Detection Figure 1
2026-06-09cs.CV

SemDINO: A DINOv3-Driven Network for Cross-Temporal Semantic Alignment in Change Detection

Xinyu Tong, Meihua Zhou, Jinxiao Sun, Yingjie Tang, Lei Wang

and multi-scale change enhancement (MCE) modules collabora-, Xinyu Tong and Lei Wang are with the Xinjiang Institute of Ecology and, Geography, Chinese Academy of Sciences, Urumqi 830011, China, and also, with the University of Chinese Academy of Sciences, Beijing 100049, China., Meihua Zhou is with the University of Chinese Academy of Sciences, Jinxiao Sun is with the School of Computer Science, Xiangtan University, Yingjie Tang is with the College of Information and Communication, Engineering, Harbin Engineering University, Harbin 150001, China.

2026-06-09视觉感知

针对遥感语义变化检测中跨时相语义对齐不足、易受光照季节和配准噪声诱发伪变化的问题,SemDINO将冻结DINOv3语义先验与CNN金字塔门控融合,并用多尺度双向时序Transformer校准两期特征,再结合语义净化、变化增强和解耦多任务头输出变化掩码、双时相语义图及边缘约束。公开SCD实验显示其优于现有方法,且仅替换预测头即可在WHU-CD、LEVIR-CD等二值变化检测上保持竞争性能。

Hybrid Robustness Verification for Spatio-Temporal Neural Networks Figure 1
2026-06-09cs.CV

Hybrid Robustness Verification for Spatio-Temporal Neural Networks

Sherwin Varghese, Matthew Wicker, Alessio Lomuscio

2026-06-09安全鲁棒

面向自动驾驶、视频识别和医学体数据等高维时空输入,论文指出传统 ℓp 扰动验证过于保守或计算昂贵。其核心是将更现实的连续帧/局部 patch 攻击建模为时空共享约束,提出 STBP:首个卷积层用闭式精确可达集,后续层用可扩展界传播。实验在 UCF-101、Udacity、MedMNIST 和 ST-Bench 上显示,相同扰动预算下认证鲁棒准确率最高提升约 1.7 倍。

HDSL: A Hierarchical Domain-Specific Language for Structured 3D Indoor Scene Generation and Localized Editing with LLM Agents Figure 1
2026-06-09cs.CV

HDSL: A Hierarchical Domain-Specific Language for Structured 3D Indoor Scene Generation and Localized Editing with LLM Agents

Letian Li, Chao Shen, Shuzhao Xie, Chenghao Gu, ZhengXiao He, Yu Meng, Xin Yang, Wenyuan Jiang, Zhi Wang

SIGS, Tsinghua University, Nankai University, University of Arizona, Zhejiang University

2026-06-09三维

论文针对文本驱动室内 3D 场景生成与后续编辑中,场景图/全局约束难以表达局部几何、编辑成本高且易影响无关物体的问题,提出 XML/CSS 风格的层次化 DSL(HDSL),用可寻址树节点表示房间、区域、物体和支撑面,并结合递归 LLM 生成、验证、资产检索、力导向布局修复及 HRAG 局部重写。实验显示其提升物体覆盖、文本对齐和生成速度;编辑时 token 减少 5.22 倍、运行时间减少 6.19 倍,并更好保留非目标对象。

Evaluating the Representation Space of Diffusion Models via Self-Supervised Principles Figure 1
2026-06-09cs.LG

Evaluating the Representation Space of Diffusion Models via Self-Supervised Principles

Xiao Li, Yixuan Jia, Zekai Zhang, Xiang Li, Lianghe Shi, Jinxin Zhou, Zhihui Zhu, Liyue Shen, Qing Qu

University of Michigan, Ohio State University

2026-06-09生成模型

论文关注扩散模型既能生成又能表征但二者关系不清的问题,借鉴自监督学习将特征分解为不变成分与残差成分,并提出基于 Fisher 信噪比的 ICR 指标衡量残差对语义不变性的污染。实验显示,中等噪声层的 ICR 对应最佳分类表征;在生成侧,ICR 可在无需采样、验证集或外部评估器的情况下跟踪 FID,并在小数据训练中提前提示从泛化转向记忆的拐点。

Cranio-Diff: Diffusion-based Cross-domain Craniofacial Reconstruction with 2D X-ray Skull Guidance and Structural Identity Constraints Figure 1
2026-06-09cs.CV

Cranio-Diff: Diffusion-based Cross-domain Craniofacial Reconstruction with 2D X-ray Skull Guidance and Structural Identity Constraints

Ravi Shankar Prasad, Naresh Gurjar, Shashank Baghel, Chirag, Dinesh Singh

School of Computing and Electrical, Indian Institute of Technology Mandi, University, Department, flexible and controllable image synthesis by incorporating semantic guidance through textual, anatomy. Also, few studies were conducted on 3D skull and 3D face due unavailability of

2026-06-09生成模型优化算法三维

面向法医颅面重建中2D X光颅骨到人脸跨模态语义与结构身份难对齐的问题,Cranio-Diff以Stable Diffusion/Realistic Vision为骨干,引入ControlNet颅骨结构引导和生物特征文本条件,生成可控且更符合解剖约束的人脸。作者在120人多视角X光-人脸数据及年龄、BMI变体上评测,报告在FID、SSIM、ArcFace及检索Recall/mAP/MRR上优于GAN和已有方法,但增益可能部分来自数据扩展与合成设置。

GenEyePose: Patient-Free, Knowledge-Based Saccadic Eye Movement Modeling for Digital Neurophysiologic Biomarker Development Figure 1
2026-06-09cs.CV

GenEyePose: Patient-Free, Knowledge-Based Saccadic Eye Movement Modeling for Digital Neurophysiologic Biomarker Development

Tianyu Lin, Jooyoung Ryu, Puvada Sreevarsha, Rahul Srinivasaragavan, Riya Satavlekar, Susan Kim, Nidhi Soley, Yujie Yan, Ishan Vatsaraj, Carl Harris, Aimon Rahman, Vishal Patel, Joseph Greenstein, Casey Taylor, Kemar E. Green

2026-06-09三维

针对真实眼动视频受隐私、标注稀缺和噪声限制而难以训练神经疾病筛查模型的问题,GenEyePose用临床参数生成生理合理的扫视波形,并反向映射为瞳孔掩码,再通过条件视频生成得到无需患者数据的合成眼动视频。仅用合成数据训练的MViT-V2在真实临床集上达到AUROC 0.76、敏感度0.71,但合成到真实的性能差距仍显示复杂伪影建模不足。

SoccerNet 2026 Player-Centric Ball-Action Spotting:Retraining and Post-Processing Extensions to the FOOTPASS Baselines Figure 1
2026-06-09cs.CV

SoccerNet 2026 Player-Centric Ball-Action Spotting:Retraining and Post-Processing Extensions to the FOOTPASS Baselines

Parthsarthi Rawat

entropy loss and label smoothing 0.05. At a 15% global, to fall back to a centred crop that cannot identify the correct

2026-06-09视觉感知

本文面向足球转播中的球员中心动作定位,核心难点是同时判断“谁、何时、做了什么”且类别极度不均衡。作者在 FOOTPASS/TAAD+DST 基线 上加入梯度检查点全骨干微调、GNN logits 融合、平方根类权重和针对稀有类的后处理/集成,使测试集 Macro F1 从 0.493 提升到 0.548,挑战集为 0.446;但 tackle、block 在挑战集显著退化,说明阈值后处理泛化仍不足。

Visual Prompting Meets Feature Reconstruction-Based Anomaly Detection with Dual-Teacher Supervision Figure 1
2026-06-09cs.CV

Visual Prompting Meets Feature Reconstruction-Based Anomaly Detection with Dual-Teacher Supervision

Mateo Diaz-Bone, Daniel Caraballo, Florian Scheidegger, Thomas Frick, Mattia Rigotti, Andrea Bartezzaghi, Roy Assaf, Niccolo Avogaro, Yagmur G. Cinar, Brown Ebouky, Filip M. Janicki, Piotr S. Kluska, Cezary Skura, Cristiano Malossi

2026-06-09视觉感知三维

本文针对工业异常检测在真实场景中因物体尺度、视角、背景和光照变化而失效的问题,指出 MVTec 等基准的高分很大程度依赖受控采集条件。方法在 MMR 特征重建框架上加入视觉提示生成的前景/背景掩码以抑制背景干扰,并通过双教师监督解冻教师网络以提升域适应性,同时用扩散模型生成正常样本做数据增强。实验显示,在更具域偏移的 AeBAD 上较已有最佳结果提升 3.5 个百分点。

Do Video Foundation Models Understand Intuitive Physics? A Layerwise Probing Analysis Figure 1
2026-06-09cs.CV

Do Video Foundation Models Understand Intuitive Physics? A Layerwise Probing Analysis

Samuele Punzo, Niccolò Caselli, Ippokratis Pantelidis, Francesco Massafra, Salvatore Lo Sardo, Mohammadreza Salehi

2026-06-09视觉感知

论文关注视频基础模型的高分是否真的对应直觉物理表征,而非视觉捷径或通用运动线索。作者用冻结特征、分层探针和时间扰动控制,在 IntPhys2 与 MVP 上比较 V-JEPA、VideoMAE 和 LTX-Video,洞察是物理信息并非均匀存在,而随预训练目标、层深和读出器能力变化。结果显示 V-JEPA 最强,VideoMAE 接近,LTX-Video 较弱但有信号;中后层更可解码,打乱时序会明显降分。

Where Does the Answer Come From? Benchmarking View-Level Visual Evidence Identification in Multi-View MLLMs for Autonomous Driving Figure 1
2026-06-09cs.CL

Where Does the Answer Come From? Benchmarking View-Level Visual Evidence Identification in Multi-View MLLMs for Autonomous Driving

Yimu Wang, Yee Man Choi, Barry Zhang, Mozhgan Nasr Azadani, Sean Sedwards, Krzysztof Czarnecki

University of Waterloo

2026-06-09数据集/基准

本文针对自动驾驶多视角 MLLM 评测只看答案、难以判断模型是否依据正确摄像头证据的问题,提出基于 NuScenes 的视角级证据识别基准:122 个冲突场景问答要求模型在六路相机中选择黄金视角并作答,并区分视角选择、给定黄金视角问答和联合预测。实验表明,该设置能暴露“答对但看错视角”的 grounding 失败;具体性能增益不构成重点,数据规模较小,定位更偏诊断探针。

MAVIS: Multi-Agent Video Retrieval via Structured Video Understanding Figure 1
2026-06-09cs.CV

MAVIS: Multi-Agent Video Retrieval via Structured Video Understanding

Jie Zhang, Qilang Ye, Hao Zhou, Haochen Liang, Fei Luo

School of Computing and Information Technology, Great Bay University, College of Computer Science, Nankai University, Tsinghua Shenzhen International Graduate School, Tsinghua University, Graduate School of Information Science and Technology, The University of Tokyo

2026-06-09视觉感知

针对文本到视频检索中全库 embedding 扫描计算冗余、短查询与高密度视频语义粒度不匹配的问题,MAVIS 将视频预解析为场景、对象、动作等结构化语义库,再由规划器拆解查询并调度专门代理提名候选,通过带否决规则的逻辑辩论剪枝,最后只对争议样本做细粒度匹配。在 MSR-VTT、MSVD 和 ActivityNet 上,文中报告其无需任务微调即可取得有竞争力的性能,并改善效率—精度权衡。

CineDance: Towards Next-Generation Multi-Shot Long-Form Cinematic Audio-Video Generation Figure 1
2026-06-09cs.CV

CineDance: Towards Next-Generation Multi-Shot Long-Form Cinematic Audio-Video Generation

Yuheng Chen, Teng Hu, Yuji Wang, Qingdong He, Zhucun Xue, Qianyu Zhou, Xiangtai Li, Lizhuang Ma, Jiangning Zhang, Dacheng Tao

2026-06-09视觉感知

针对开源模型在多镜头长视频音画生成中缺少高质量数据、长程稳定性和跨镜头一致性不足的问题,CineDance提出百万级1080p CineDance-1M数据集,通过影视叙事解析、分层双模态标注与音画绑定构建训练监督,并给出CineBench六维评测。基于LTX-2.3微调的模型在音画对齐、主体与环境一致性及单模态质量上优于现有基线;增益可能主要来自高质量数据与规模化标注。

ATN3D: Density-Aware LiDAR-Radar Early 3D Object Detection Under Extreme Sparsity Figure 1
2026-06-09cs.CV

ATN3D: Density-Aware LiDAR-Radar Early 3D Object Detection Under Extreme Sparsity

Debojyoti Biswas, Xianbiao Hu

2026-06-09视觉感知强化学习三维

本文针对自动驾驶中30米外目标仅有极稀疏激光点、雾天进一步削弱感知的问题,提出ATN3D以雷达补充LiDAR,并用密度感知早期融合、占据门控邻域聚合、证据条件通道注意力和距离感知损失抑制空体素噪声、强化远距监督。在VoD清晰/重雾场景中,整体mAP分别提升3.55%和8.41%,30米外目标也有2%—3%左右增益。

DexPIE: Stable Dexterous Policy Improvement from Real-World Experience Figure 1
2026-06-09cs.RO

DexPIE: Stable Dexterous Policy Improvement from Real-World Experience

Ruizhe Liao, Wenrui Chen, Liangji Zeng, Haoran Lin, Fan Yang, Kailun Yang, Yaonan Wang

Hunan University

2026-06-09强化学习

DexPIE针对灵巧手模仿学习在真实部署中易累积误差、长时序稀疏奖励下探索和价值评估困难的问题,提出从真实交互经验进行后训练的框架:用适配灵巧手的人类介入与多阶段DAgger扩展覆盖,用相对动作空间异步推理减小示教—部署时序噪声,并以连续最优性指标做细粒度策略改进。在三个真实灵巧操作任务上,相比示教策略成功率提升37%,且优于基线。

TUDSR: Twice Upsampling-Diffusion for Higher Super-Resolution Figure 1
2026-06-09cs.CV

TUDSR: Twice Upsampling-Diffusion for Higher Super-Resolution

Zhiqiang Wu, Yitong Dong, Xian Wei

East China Normal University, Zhejiang University

2026-06-09生成模型

TUDSR针对现有扩散超分在×8、2048²等高倍率高分辨率场景中受原生分辨率和放大倍率限制、直接训练大模型成本高的问题,将一次高倍率超分拆成两次上采样-扩散:在同一SD2.1-base骨干上训练两个LoRA,并用循环分块降低第二阶段显存。其实例TUDSR-S在×4/×8多数据集指标上达到SOTA,并能生成1024²乃至2048²高质量结果。

Efficient Minimal Solvers for Relative Pose Estimation in Autonomous Driving Applications Figure 1
2026-06-09cs.RO

Efficient Minimal Solvers for Relative Pose Estimation in Autonomous Driving Applications

Tao Li, Liang Liu, Jianli Han, Weimin Lv

\authormark 1College of Aerospace Science and Engineering, Naval Aviation University, Yantai 264000, China

2026-06-09优化算法三维

面向自动驾驶多相机相对位姿估计,论文针对传统 6 点/17 点方法在 RANSAC 中计算慢、匹配需求高的问题,利用车辆常见先验提出基于深度平移参数化和一阶旋转近似的统一框架,并给出已知竖直方向、已知转轴方向和平面运动三类 4/4/3 点最小求解器。合成数据与 KITTI 实验显示,其在速度上更适合实时假设生成,同时保持与现有方法相近的精度与鲁棒性。

Streaming Interventions: Can Video Large Language Models Correct Mistakes as They Occur? Figure 1
2026-06-09cs.CV

Streaming Interventions: Can Video Large Language Models Correct Mistakes as They Occur?

Apratim Bhattacharyya, Shweta Mahajan, Sanjay Haresh, Rajeev Yasarla, Reza Pourreza, Litian Liu, Risheek Garrepalli, Roland Memisevic

York University, Vector Institute for AI, Work done while employed at Qualcomm AI Research.Qualcomm AI Research is an initiative of Qualcomm Technologies, Inc.

2026-06-09视觉感知

这篇论文关注视频大模型在真实操作指导中能否“边看边纠错”:用户做菜步骤出错时,模型需及时发现、判断何时介入并给出可执行反馈。作者提出反应式评测基准 Ego-MC-Bench,并用非交互烹饪视频构造反事实合成训练集 Ego-CoMist。实验显示现有视频 LLM 在错误检测和介入时机上仍很困难,而用 Ego-CoMist 微调可稳定提升纠错、时序和步骤完成判断,尤其利于较小的边缘部署模型。

A VideoMAE-v2 Approach to Zero-Shot Traffic Accident Anticipation Figure 1
2026-06-09cs.CV

A VideoMAE-v2 Approach to Zero-Shot Traffic Accident Anticipation

Siyuan Li, Xiaoyang Bi, Mengshi Qi

Team BUPT MIC Lab, State Key Laboratory of Networking and Switching Technology, Beijing University of Posts and Telecommunications, ing data is available: the model must learn exclusively, from a publicly available binary-labelled driving-accident, ticipation competition [1]. Code is available at https:, however, collecting and labelling dashcam, in which the model is trained solely on publicly available, licly available accident datasets provide only coarse binary, labels (accident vs. normal). Bridging this granularity gap, available binary-labelled accident dataset into temporally, to recalibrate the output without any target-domain labels

2026-06-09视觉感知

面向行车记录仪事故预判,论文关注目标域事故标注昂贵导致的零样本泛化问题。方法将二分类 Nexar 数据重切为平衡的 5 秒片段,用 VideoMAE-v2 16 帧滑窗加逐帧预测头生成风险序列,并通过重叠平均、插值和免训练测试时校准缓解短窗口与后验压缩。系统获 2026 CVPR@AUTOPILOT 零样本事故预判竞赛第 2 名,消融显示类别平衡和全上下文逐帧建模很关键。

Adversarial Attack and Disturbance Detection by Hadamard-Coded Output Representations for Object Detection and Semantic Segmentation Figure 1
2026-06-09cs.CV

Adversarial Attack and Disturbance Detection by Hadamard-Coded Output Representations for Object Detection and Semantic Segmentation

Lucas Görnhardt, Timo Bartels, Niklas Schwarz, Tim Fingscheidt

2026-06-09视觉感知

面向自动驾驶等安全关键感知中攻击或自然扰动会使 one-hot 模型过度自信、熵检测失效的问题,论文将 Hadamard 编码输出扩展到语义分割和目标检测,并提出基于概率单纯形投影的解码,把码字冗余转化为不一致性检测信号。实验显示在单次前向、几乎无额外开销下达到或接近多次前向检测的 AuROC,同时干净数据性能基本保持参考水平。

SwiftVR: Real-Time One-Step Generative Video Restoration Figure 1
2026-06-09cs.CV

SwiftVR: Real-Time One-Step Generative Video Restoration

Jiaqi Yan, Xiangyu Chen, Xinlin Zhong, Haibin Huang, Chi Zhang, Jie Liu, Jiantao Zhou, Xuelong Li

State Key Laboratory of Internet of Things for Smart City, Department of Computer and Information Science, University of Macau, Institute of Artificial Intelligence (TeleAI), China Telecom, State Key Laboratory for Novel Software Technology, Nanjing University, Project is available at https://h-oliday.github.

2026-06-09视觉感知生成模型

SwiftVR面向直播等低时延场景中高分辨率视频修复难以落地的问题,指出一阶扩散模型的主要瓶颈已转向高分辨率空间注意力和视频自编码器开销。其核心是因果分块流式处理、无mask移位窗口注意力保持标准稠密SDPA路径,以及轻量修复感知自编码器。实验显示单H100可达1440p 31 FPS、4K 14 FPS,RTX 5090上1080p 26 FPS,并在无参考感知质量和成本上优于对比的一阶VR方法。

Securing Self-supervised Data Curation for Foundation Models Robustness Figure 1
2026-06-09cs.CV

Securing Self-supervised Data Curation for Foundation Models Robustness

Sandeep Gupta, Roberto Passerone

2026-06-09安全鲁棒

针对视觉基础模型依赖自监督网页数据筛选、易引入投毒样本的问题,论文将数据完整性检查前置到训练前,提出以预训练 ImageBind 表征结合 RF/KNN/NB/SVM 的 PDD 主动检测器,并支持集成扩展新攻击检测器。作者在 3 个数据集、176,200 张图像和 3 类攻击上评估 20 个变体,结果显示 SVM-PDD 在同分布与跨分布场景均表现最好,但对真实超大规模流水线的部署开销与误报影响文中未充分说明。

Prisma-World: Camera-Controllable Multi-Agent Video World Model Figure 1
2026-06-09cs.CV

Prisma-World: Camera-Controllable Multi-Agent Video World Model

Huiqiang Sun, Zhan Peng, Size Wu, Kun Wang, Kang Liao, Dianyi Wang, Xingyu Zeng, Sheng Jin, Yangguang Li, Zhiguo Cao, Ziwei Liu, Wei Li

School of AIA, HUST, S-Lab, NTU

2026-06-09视觉感知强化学习规划控制

本文针对现有视频世界模型多为单观察者、独立生成多智能体视角会导致重叠区域物体与布局不一致的问题,提出 Prisma-World,将所有智能体视频放入同一全注意力序列联合去噪,并用多智能体 RoPE、相对相机几何注入、重叠递减课程和小地图条件来耦合共享场景。作者还构建 UE5 PrismaDataset 与一致性评测,实验显示单模型可支持可变智能体数量和相机控制,生成质量、跨视角一致性与空间 grounding 优于基线。

ContextShift: A Controlled Benchmark for Context Dependence in Object Detection Figure 1
2026-06-09cs.CV

ContextShift: A Controlled Benchmark for Context Dependence in Object Detection

Dan Zlotnikov, Alex Lazarovich, Ohad Ben-Shahar

Ben-Gurion University of the Negev, Israel

2026-06-09视觉感知规划控制数据集/基准

针对目标检测在真实部署中可能过度依赖背景共现、而现有鲁棒性评测难以隔离上下文因素的问题,ContextShift在COCO上通过几何变换、合成/自然背景替换保持目标外观不变,并用NPMI构造连续的目标—背景兼容性轴。实验显示多类检测器在上下文变化下主要表现为预测抑制:漏检最高增加227%、预测数最多下降44%,AP会掩盖这一召回损失;兼容性与性能呈非单调关系,训练时加入上下文解耦增强可部分恢复性能。

Optical Music Recognition for Real-World Manuscripts with Synthetic Data Figure 1
2026-06-09cs.CV

Optical Music Recognition for Real-World Manuscripts with Synthetic Data

Jiří Mayer, Martina Dvořáková, Vojtěch Dvořák, Markéta Herzánová Vlková, Filip Bím, Pavel Pecina, Samuel Šomorjai, Petr Žabička, Jan Hajič jr

2026-06-09视觉感知强化学习

本文针对音乐图书馆真实手稿乐谱与现有 OMR 训练数据多为数字排版稿之间的域差问题,构建复杂钢琴手稿的低资源基线,并用 MuNG 标注与 Smashcima 从 MusicXML 合成手稿图像进行域适配。实验表明,少量真实域转写仍不可替代,但加入逼真的合成手稿能显著提升真实多样手稿识别;且符号库不必来自目标域,降低了细粒度标注成本。

Efficient Minimal Solvers for Visual-Inertial Relative Pose Estimation in Multi-Camera Systems Figure 1
2026-06-09cs.CV

Efficient Minimal Solvers for Visual-Inertial Relative Pose Estimation in Multi-Camera Systems

Tao Li, Zhenbao Yu, Banglei Guan, Jianli Han, Weimin Lv

Tao Li, Jianli Han, and Weimin Lv are with the College, Zhenbao Yu, and Banglei Guan is with the College of Aerospace, Science and Engineering, National University of Defense Technol-, single center of projection, multi-camera configurations, their multiple projection centers [15], see Fig. 1. This, center components [25]. Chen et al. further demon-

2026-06-09优化算法三维

多相机相对位姿估计虽能扩大视野并恢复尺度,但广义相机几何使传统方法需要较多匹配点且在 RANSAC 中代价高。论文以深度参数化重写广义极几何约束,结合 IMU 提供的竖直方向或旋转轴先验,构造两个仅需 4 点的最小求解器,将求解降为一元 6 次多项式而非常见 8 次。合成数据与 KITTI 实验显示,其计算效率更高,精度与现有方法相当,适合视觉里程计场景。

Training-Free Generalized Few-Shot Segmentation through Open-Vocabulary Semantic Arbitration Figure 1
2026-06-09cs.CV

Training-Free Generalized Few-Shot Segmentation through Open-Vocabulary Semantic Arbitration

Silas Kwabla Gah, Ebenezer Owusu

Department of Computer Science, University of Ghana, text priors weaken on label-disjoint vocabularies., Semantic segmentation, the task of assigning a class label to, classes described only by K labelled support images, a, any training, while LPOSS [24] demonstrates that label, foundation text prior weakens: on a label-disjoint vocab-, label-disjoint open-vocabulary settings without task-, into the final label map.

2026-06-09视觉感知

这篇论文针对 GFSS 依赖训练适配、词表固定的问题,提出 Open-V:冻结 SAM3-PCS 与 CLIP,用 K-shot 支持样本形成 CLIP 类中心,只在推理时对像素级开放词表候选做校准仲裁和边界细化。核心洞察是少样本信息可作为语义 grounding 而非参数更新,且在文本先验较弱的标签不重合场景更有价值。实验覆盖 PASCAL-5i、COCO-20i、ADE-OW;PASCAL-5i 1-shot 达到 78.4/77.5/77.9 base/novel/HM mIoU,较最强训练式基线 HM 高 17.7,同时指出预处理与评测空间错位会显著干扰复现。

GD-MIL: Grade-Disentangled Multiple Instance Learning for Multimodal Biochemical Recurrence Prediction in Prostate Cancer Figure 1
2026-06-09cs.CV

GD-MIL: Grade-Disentangled Multiple Instance Learning for Multimodal Biochemical Recurrence Prediction in Prostate Cancer

Dasari Naga Raju

2026-06-09视觉语言

这篇论文针对前列腺癌根治术后生化复发预测中影像信号常被 Gleason 分级替代、且评估易泄漏的问题,构建严格 TCGA-PRAD 基准,并提出 GD-MIL:用梯度反转对抗去除病理切片表征中的分级信息,再与临床变量后融合。结果显示特征提取器比 MIL 聚合器更关键;GD-MIL 的 C-index 达 0.704,显著优于临床 Cox 基线 0.687 和最佳纯影像模型,但仍需外部验证。

Dense Force Estimation with an Event-based Optical Tactile Sensor Figure 1
2026-06-09cs.RO

Dense Force Estimation with an Event-based Optical Tactile Sensor

Agis Politis, René Zurbrügg, Valentina Cavinato

2026-06-09视觉感知

为突破传统视觉触觉在帧率、运动模糊和带宽上的限制,论文将事件相机用于光学触觉的密集三维力场估计。其关键做法是用事件驱动的标记点跟踪恢复剪切位移,用 U-Net 从稀疏事件推断法向形变,再通过逆有限元映射为物理一致的力。在四类压头、最高约(4N,4N,20N)范围内,剪切/法向力 MAE 为(0.14N,0.10N,0.93N),平均约100Hz。

Leveraging Morphology for Historical Script Metrological Analysis Figure 1
2026-06-09cs.CV

Leveraging Morphology for Historical Script Metrological Analysis

Malamatenia Vlachou Efstathiou, Raphaël Baena, Dominique Stutzmann, Mathieu Aubry

2026-06-09视觉感知

本文针对历史手稿古文字分析依赖专家主观比较、难以规模化和复现的问题,提出用字符形态原型来定义稳定的度量特征。方法将基于 Transformer 的检测式行识别与原型重建结合,仅需行级转写监督即可学习字符原型、位置和形变,并据此测量字符、双字母和词间空间。在 BnF fr.2813 的 160 页案例中,相比 Learnable Handwriter 提升了原型质量与训练稳定性,并能区分不同书手及发现细微书写差异。

vesselFM-CT: Segmenting All Blood Vessels in CT Images for System-Level Cardiovascular Analysis Figure 1
2026-06-09cs.CV

vesselFM-CT: Segmenting All Blood Vessels in CT Images for System-Level Cardiovascular Analysis

Bastian Wittmann, Chinmay Prabhakar, Suprosanna Shit, Bjoern Menze

Department of Quantitative Biomedicine, University of Zurich, Zurich, Switzerland

2026-06-09视觉感知

针对既有CT血管分割多聚焦单一部位、难以支撑全身心血管系统级分析的问题,本文提出“分割所有可见血管”的任务与vesselFM-CT,通过迭代训练、人工校正、合成数据和面向管状结构半径不均衡的TubeLoss/TubeDice处理大血管到细小肠系膜血管的尺度差异。实验显示其较基线获得更完整细致的血管提取,并可用于疾病分类与合成CT生成等下游任务。

CapRL++: Unified Reinforcement Learning with Verifiable Rewards for Dense Image and Video Captioning Figure 1
2026-06-09cs.CV

CapRL++: Unified Reinforcement Learning with Verifiable Rewards for Dense Image and Video Captioning

Penghui Yang, Long Xing, Xiaoyi Dong, Yuhang Zang, Yuhang Cao, Yibin Wang, Yujie Zhou, Jiazi Bu, Jianze Liang, Qidong Huang, Jiaqi Wang, Feng Wu, Dahua Lin

Tsinghua University, University of Science and Technology of China, Shanghai AI Laboratory, Shanghai Innovation Institute, The Chinese University of Hong Kong

2026-06-09视觉语言视觉感知强化学习

针对视觉描述依赖昂贵 SFT 标注、易记忆单一参考且难以客观奖励的问题,CapRL++把“描述是否有用”转化为可验证信号:让无视觉 LLM仅凭生成 caption 回答图像/视频 MCQ,并以正确率及视频时空约束作为 RL 奖励。实验覆盖 20 多个图像与视频基准,显示其提升密集描述质量和基于 caption 的预训练效果,小模型在 Prism 评测中可接近或超过更大 LVLM。

Real-time body pose non-verbal communication with a consistency-based reliability measure Figure 1
2026-06-09cs.CV

Real-time body pose non-verbal communication with a consistency-based reliability measure

Alina Marcu, Dragos Costea, Cristina Lazar, Marius Leordeanu

2026-06-09三维

论文面向远距离、嘈杂或隐私受限的人机交互场景,研究仅凭2D全身姿态实时识别非语言意图。核心贡献是发布含10类意图、15.7万真实帧的数据集,并在Orin Nano上比较12种骨架识别/预测模型,同时提出无需标签的自回归自一致性可靠性度量。结果显示真实数据可达较高可识别性但预测更难,合成集更易因动作模板化;一致性通常能提升可信度判断,但在类间混淆严重时仍会自信出错。

An Opticalmechanics Framework for Dynamic Estimation of Multibody Systems Figure 1
2026-06-09cs.CV

An Opticalmechanics Framework for Dynamic Estimation of Multibody Systems

Banglei Guan, Xuanyu Bai, Qingquan Chen, Zibin Liu, Dongcai Tan, Zhenbao Yu, Yang Shang, Qifeng Yu

National University of Defense Technology

2026-06-09视觉感知

针对人体/多体系统动力学估计依赖接触式力矩传感器和实验室环境的问题,论文将图像测得的运动学量引入受约束多体动力学模型,并用遗传算法最小化预测与观测角速度差来反求关节力矩。气浮平台验证中,腕关节力矩相对传感器平均绝对误差为0.46 N·m,前向预测角速度误差为0.006 rad/s,显示非接触动力估计的可行性。

Echo-DM: Ultrasound Marker Removal via Conditional Latent Diffusion and Region-Aware Fusion Figure 1
2026-06-09cs.CV

Echo-DM: Ultrasound Marker Removal via Conditional Latent Diffusion and Region-Aware Fusion

Zhiwei Wang, Tao Huang, Wentao Jiang, Muyi Li, Jianxin Liu, Jian Chen, Jie Zou, Yong Luo, Bo Du, Jing Zhang

School of Computer Science, Wuhan University, China, School of Computer Science, Hubei University of Technology, China

2026-06-09生成模型

本文针对临床超声图像中测量尺、文字等人工标记会诱导下游模型学习捷径、削弱 clean 输入泛化的问题,提出 Echo-DM:以 DiT 条件潜空间扩散做全局去标记恢复,再用区域感知融合在像素域尽量保留未受影响组织,并支持 VAE/RAE 两种潜表示实现。作者构建 Echo-PAIR 配对数据集,实验显示其相较两阶段基线在标记区域恢复和全图解剖保真上更优,且 Echo-DM-V 偏保真、Echo-DM-R 偏速度与 ROI-PSNR。

PhysScene: A Scene Graph Dataset for Scientific Visual Reasoning in Physics Experiments Figure 1
2026-06-09cs.CV

PhysScene: A Scene Graph Dataset for Scientific Visual Reasoning in Physics Experiments

Minghao Zou, Qingtian Zeng, Shangkun Liu, Yanda Meng, Guanghui Yue, Baoquan Zhao, Abdulmotaleb El Saddik, Wei Zhou

Cardiff University, Shandong University of Science and Technology, University of Exeter, Shenzhen University, Sun Yat-sen University, University of Ottawa, Cardiff University Cardiff UK, Shandong University of Science and Technology Qingdao China, University of Exeter Exeter UK, Shenzhen University Shenzhen China, Sun Yat-sen University Zhuhai China, University of Ottawa Ottawa Canada

2026-06-09数据集/基准

现有场景图基准多面向自然图像,难以评估物理实验中由仪器功能和操作流程决定的关系推理。PhysScene构建了首个物理实验场景图数据集,含4.5K高清图、45.9K物体、34类对象、39类关系和130.4K三元组,强调高关系密度与强语义约束。作者在PredCls、SGDet及零样本设置下测试多种模型,结果显示该数据集能暴露现有SGG方法在实验语义建模和泛化上的不足。

RT-SDGOD: Real-Time Single-Domain Generalized Object Detection Figure 1
2026-06-09cs.CV

RT-SDGOD: Real-Time Single-Domain Generalized Object Detection

Yupeng Zhang, Fangzhuo Gao, Ruize Han, Wei Feng, Liang Wan

2026-06-09视觉感知

面向自动驾驶、监控等实时场景中天气和成像变化导致的单源域检测失效,论文提出RT-SDGOD设定,要求测试时零额外开销。作者洞察到DETR式实时检测器主要因漏检上升而退化,根源是判别证据局部且不稳定;据此提出RT-SDGDet,用O2M查询组、证据多样性和双视图一致性在训练期扩展并稳定目标证据。多未见域实验显示其较现有方法有更好泛化且不增加推理成本。

Zero-Shot Semantic Re-Identification for Autonomous Driving: A VLM Baseline Study Figure 1
2026-06-09cs.CV

Zero-Shot Semantic Re-Identification for Autonomous Driving: A VLM Baseline Study

Eduardo Borges, Manuel Abreu, Luís Garrote, Urbano J. Nunes

2026-06-09视觉语言

自动驾驶中的 ReID 常依赖视觉外观嵌入,易受视角、遮挡、光照和传感器域变化影响且可解释性有限。本文将 VLM 生成的车辆/行人等结构化语义描述作为零样本中间表示,再编码文本并用余弦相似度检索身份,探索语言属性能否支撑匹配。结果显示其检索性能可接近监督 CNN 基线,并提供显式身份线索,但跨视角属性不一致和相似实例细粒度区分不足仍是主要限制。

ExDet: Open-Domain Open-Vocabulary Detection with Cross-modal Extrapolation and Rectification Figure 1
2026-06-09cs.CV

ExDet: Open-Domain Open-Vocabulary Detection with Cross-modal Extrapolation and Rectification

Yupeng Zhang, Yuzhong Feng, Ruize Han, Zhiwei Chen, Wei Feng, Liang Wan

College of Intelligence and Computing, Tianjin University, Faculty of Computer Science and Artificial Intelligence, Shenzhen University of Advanced Technology, School of Artificial Intelligence, Nanchang University, College of Intelligence and Computing, Tianjin University Tianjin China, Faculty of Computer Science and Artificial Intelligence, Shenzhen University of Advanced Technology Shenzhen China, School of Artificial Intelligence, Nanchang University Jiangxi China

2026-06-09视觉感知

针对开放域开放词表检测同时面临新类别与未见域、且现有方法需重训检测器成本高的问题,ExDet利用VLM文本/视觉空间的DeltaSpace结构,从文本外推出类别-域代理视觉原型,并以训练无关、无真实数据的DCR在推理时校正分类表示;同时ExRPN融合语义相似度与RPN置信度提升候选召回。文中在OD-LVIS、OV-LVIS、Objects365和MSOSB上报告SOTA,且单卡约30分钟训练。

Beyond Humans: Multispecies Animal Face Recognition Using Transfer Learning Figure 1
2026-06-09cs.CV

Beyond Humans: Multispecies Animal Face Recognition Using Transfer Learning

Maria De Marsico, Anil K. Jain, Annalaura Miglino

2026-06-09视觉感知

针对宠物找回、濒危物种跟踪和农场个体识别中芯片、耳标等接触式方案侵入性强且动物身份标注数据不足的问题,论文考察将人脸预训练的 FaceNet 与 ImageNet 预训练的 ViT 作为迁移学习骨干用于多物种动物脸识别,而非设计专用网络。实验覆盖犬、灵长类和牛:ViT 在犬脸上达到 96.85% 验证准确率和 84.34% Rank-1,在牛脸上优于既有方法,灵长类结果受图像质量和类别差异影响,未稳定超过 SOTA。

Taming Perception Jitter: Uncertainty-Aware LiDAR Object Detection for Reliable Motion Classification Figure 1
2026-06-09cs.RO

Taming Perception Jitter: Uncertainty-Aware LiDAR Object Detection for Reliable Motion Classification

Cornelius Schröder, Žygimantas Marcinkus, Markus Lienkamp

This research was funded by the Bavarian Research Foundation. 1 Institute for Automotive Engineering, Munich Institute of Robotics and Machine Intelligence, School of Engineering and Design

2026-06-09视觉感知安全鲁棒

本文针对自动驾驶中 LiDAR 3D 检测框跨帧抖动会被跟踪器误估为速度、进而把静态障碍误判为动态并触发不必要停车的问题,给 CenterPoint 增加偶然不确定性方差头,并在短时间窗内用两样本 z 检验区分真实运动与感知抖动。方法可复用 Autoware 的关联与协方差字段,部署改动小;在 nuScenes 上与速度阈值相当,但实车中显著减少虚假动态轨迹和无谓停车,关键洞察是实车数据存在速度规则易误判的“抖动带”。

IB-HFN: Information Bottleneck-Driven SAR-Optical Fusion Network for High-Fidelity Cloud Removal Figure 1
2026-06-09cs.CV

IB-HFN: Information Bottleneck-Driven SAR-Optical Fusion Network for High-Fidelity Cloud Removal

Haojun Guo, Fan Feng, Ziquan Wang

2026-06-09视觉感知

针对SAR辅助光学遥感去云中,早期拼接易把SAR斑点噪声传入重建、像素损失又导致纹理过平滑的问题,IB-HFN用双流骨干延后跨模态融合,并在融合处以通道变分信息瓶颈压缩SAR特征、用局部-全局门控保留可信光学细节,再配合结构、光谱和锐度等联合损失动态训练。在SEN12MS-CR的时空划分实验中,方法相较现有模型表现出更好的结构保持和光谱保真。

Reason Twice: Segmentation via Candidate Discovery and Comparative Reasoning Figure 1
2026-06-09cs.CV

Reason Twice: Segmentation via Candidate Discovery and Comparative Reasoning

Xinyan Gao, Haoran Hao, Xiangyu Yue

2026-06-09视觉感知

针对现有MLLM分割方法在复杂推理查询中难以把语言推理可靠传递给掩码解码器、且评测偏常识的问题,论文提出Rea2Seg:先利用分割MLLM注意力发现候选掩码,再让MLLM比较候选并打分重排,将分割转为判别式选择;同时构建ReasonSeg-SGDR与训练数据。实验显示其在新基准和ReasonSeg上相较既有推理分割模型取得一致提升。

Virtual-point-based Solutions to Handle Generalized Absolute Pose Problem Figure 1
2026-06-09cs.CV

Virtual-point-based Solutions to Handle Generalized Absolute Pose Problem

Bin Li, Banglei Guan, Shunkun Liang, Yang Shang

projection centers. This paper introduces a virtual point, will be made publicly available upon acceptance., Bin Li is with the Hunan Institute of Advanced Technology, Changsha, China, and also with the College of Aerospace Science and, Engineering, National University of Defense Technology, Changsha, Banglei Guan, Shunkun Liang, and Yang Shang are with the College, of Aerospace Science and Engineering, National University of Defense, Provincial Key Laboratory of Image Measurement and Vision Navigation, one projection center. Among them, multi-camera systems can, centers, traditional PnP algorithms designed for a single camera, which assume a single optical center, cannot be directly applied, projection centers into the virtual point coordinates and

2026-06-09三维

面向多相机机器人/导航中多投影中心使传统 PnP 难以直接适用的问题,论文用“虚拟点”把广义绝对位姿转化到标准 PnP 框架,进而派生 Cayley、四元数和旋转矩阵三类 VGP 求解器。实验显示其基本继承原 PnP 的精度与效率:VGPc 在异方差噪声下更准,VGPq 保持全局最优性,VGPr 速度最快且无明显精度损失。

Visual Para-Thinker++: A Single-Policy Multi-Agent Framework for Visual Reasoning Figure 1
2026-06-09cs.CV

Visual Para-Thinker++: A Single-Policy Multi-Agent Framework for Visual Reasoning

Haoran Xu, Hongyu Wang, Yifei Gao, Jiaze Li, Zizhao Tong, Xiaofeng Zhang, Xiaosong Yuan

Zhejiang University 2Hunan University 3Tianjin University, University of Chinese Academy of Sciences, Shanghai Jiao Tong University 6Jilin University, on final labels. The shared policy is trained, ent conflict among collaborative roles. A native, organize visual reasoning as multi-role collabora-, role collaboration framework, termed Visual Para-, kens, our approach enables subagents to collabo-, To realize this multi-agent collaboration within, der a fixed four-path collaboration protocol (Fig. 1).

2026-06-09强化学习

针对视觉推理中证据分散、单条 CoT 容易过早锁定感知并产生幻觉的问题,本文提出 Visual Para-Thinker++:用同一个 MLLM 策略通过角色条件化扮演 Main、Worker、Summary,多 Worker 隔离并行取证,Summary 按完整推理轨迹融合;训练上用角色化 SFT 与分角色奖励/优势缓解梯度冲突,并用 KV cache 复用降成本。实验称其在 V*、CountBench、MMVP、RefCOCO、HallusionBench 等上优于长 CoT、自一致性和多智能体辩论,幻觉敏感任务增益更明显。

EditSSC: Toward Editable Semantic Occupancy Scenes with Unconditional Diffusion Models Figure 1
2026-06-09cs.CV

EditSSC: Toward Editable Semantic Occupancy Scenes with Unconditional Diffusion Models

Fatima Balde, Raoul de Charette, Alexandre Boulch

2026-06-09生成模型

面向自动驾驶中3D语义占据场景数据稀缺且需可控编辑的问题,EditSSC的关键洞察是将体素占据重排为多通道BEV图像,用近乎标准的VQ自编码器和Stable Diffusion式潜空间UNet替代复杂三平面3D架构,并利用码本中的类别-编码对应实现无需重训的草图引导、补全和外扩。在SemanticKITTI上,其无条件生成优于现有3D专用基线,LiDAR条件设置也保持竞争力。

See More, Match Better: Multi-Source Feature Fusion for Two-View Correspondence Learning Figure 1
2026-06-09cs.CV

See More, Match Better: Multi-Source Feature Fusion for Two-View Correspondence Learning

Xiaojie Li, Xin Jiang, Luanyuan Dai, Jinnan Yang, Yongdong Zhang, Zechao Li

2026-06-09视觉感知

该文针对两视图匹配中过度依赖坐标几何一致性、难以排除重复纹理和弱纹理场景中的“伪一致”外点的问题,提出 TriMatch:将几何特征与 CNN 纹理语义、DINOv2 结构语义对齐融合,并用语义调制和层级细化建模对应关系依赖。实验显示其在多基准、不同描述子下达到或超过现有方法,鲁棒性和泛化性更好。

Self-supervised Learning Matters: A Simple Ensemble Solution for Micro-Gesture Recognition Figure 1
2026-06-09cs.CV

Self-supervised Learning Matters: A Simple Ensemble Solution for Micro-Gesture Recognition

Tingyi Liu, Kun Li, Fei Wang, Junjie Chen, Zhiliang Wu, Jihao Gu, Haixu Liu, Dan Guo

Hefei University of Technology, Hefei, China, United Arab Emirates University, Al Ain, United Arab Emirates, Institute of Artificial Intelligence, Hefei Comprehensive National Science Center, Anhui Evolution Technology Co., Ltd., Hefei, China, Nanyang Technological University, Singapore, University College London, United Kingdom, The University of Sydney, Sydney, New South Wales, Australia, Beijing QBoson Quantum Technology Co., Ltd., China, Abstract. In this paper, we present XInsight Lab’s solution to the, on 120K unlabeled clips via masked video modeling and then fine-tuned, learning transferable representations from unlabeled in-domain videos., unlabeled data, making it well-suited to scarce and imbalanced micro-gesture an-

2026-06-09视觉感知

微手势短暂且幅度小,标注稀缺、类别不均衡,使纯监督骨架或多模态方法容易受噪声与长尾影响。本文的关键做法不是设计复杂新结构,而是将基于 SMILE 掩码视频建模的自监督 RGB 分支先在 12 万无标注域内片段预训练,再与 Video Swin、PoseConv3D 等监督多流模型做加权融合;单个自监督 RGB 分支在 iMiGUE 达到 69.224% top-1,最终集成达到 74.419%,较此前 SOTA 提升 1.206 个百分点并获 MiGA 2026 Track 1 第一。

A practical probabilistic framework for deformable image registration uncertainty in radiotherapy dose propagation Figure 1
2026-06-09cs.CV

A practical probabilistic framework for deformable image registration uncertainty in radiotherapy dose propagation

Stefan Heldmann, Sven Kuckertz, Nasim Givehchi, Thomas Coradi, Mikel Byrne, Ben Archibald-Heeren, Nils Papenberg

Fraunhofer Institute for Digital Medicine MEVIS, L¨ubeck, Germany

2026-06-09视觉感知安全鲁棒

针对放疗中可变形配准缺乏稠密真值、误差会传递到剂量累积和 DVH 评估的问题,论文提出轻量概率框架:用可解释的局部 certainty map 将每个体素映射建模为随机变量,并输出期望剂量、置信界和 DVH 包络。前列腺案例显示,不确定性边界主要受 certainty map 设计影响,核函数选择影响较小,结构引导 in/out 策略收益有限且具病例依赖性。

LiteVSR: Lightweight Adaptation of Frozen Diffusion Transformers for Video Super-Resolution Figure 1
2026-06-09cs.CV

LiteVSR: Lightweight Adaptation of Frozen Diffusion Transformers for Video Super-Resolution

Yu Cao, Ziquan Liu, Zhensong Zhang, Jiankang Deng, Shaogang Gong, Jifei Song

2026-06-09视觉感知生成模型

LiteVSR针对生成式视频超分在新域适配中全量微调成本高、ControlNet式DiT适配需复制骨干的问题,利用flow matching恒定速度场的洞察,将条件注入简化为固定模式学习,并冻结全部Diffusion Transformer,仅训练双流State-Aware Adapter,以低质结构和中间去噪状态经时序交叉注意力动态引导。文中报告仅11.25%可训练参数、单A100约12 GPU小时训练,在多个真实/合成基准上取得有竞争力的感知质量,并支持最快单步采样。

MAGIS: Evidence-Based Multi-Agent Reasoning for Interpretable Strabismus Clinical Decision-Making Figure 1
2026-06-09cs.CV

MAGIS: Evidence-Based Multi-Agent Reasoning for Interpretable Strabismus Clinical Decision-Making

Xikai Tang, Yifan Wang, Jiafan Zhuang, Li Luo, Jinming Guo, Xiaoling Xie, Jiacheng Liu, Peiwei Wei, Lihao Zhong, Xiaoli Kang, Jie Cen, Guangqiang Yin, Kunliang Qiu, Ce Zheng, Zhun Fan

2026-06-09视觉感知

针对斜视细分类诊断中黑箱模型缺少可验证推理、LVLM易产生与图像或临床规则不一致幻觉的问题,MAGIS将诊断拆为候选假设、双证据约束上下文、证据校验纠错和报告生成,并用九方位眼位图像、热图线索与医生规则共同约束多智能体推理。在细粒度斜视基准上,weighted F1由72.0%提升至91.3%,报告一致性、对齐性和完整性也更好。

Temporal-Aware Reasoning Optimization for Video Temporal Grounding Figure 1
2026-06-09cs.CV

Temporal-Aware Reasoning Optimization for Video Temporal Grounding

Minghang Zheng, Zihao Yin, Yi Yang, Yuxin Peng, Yang Liu

2026-06-09视觉语言视觉感知优化算法

针对视频时序定位中强化学习推理常停留在表面、随机探索低效且奖励只看答案 IoU 的问题,TaRO 将“带时间思考”显式纳入优化:用带时间戳的密集字幕构造高质量推理轨迹,并通过扰动关键边界后推理置信度下降来奖励时序敏感性,再以课程式训练过渡到自由探索。实验显示其在多个 VTG 基准上达到 SOTA。

SOMA: From Surface Observations to Muscle Anatomy Figure 1
2026-06-09cs.CV

SOMA: From Surface Observations to Muscle Anatomy

Eduardo Alvarado, Emily Kim, Gerrit Nolte, Friedemann Runte, Mario Botsch, Marc Habermann, Christian Theobalt

2026-06-09视觉感知

现有人体模型多停留在皮肤表面,FEM 或医学影像又难以规模化捕获动态肌肉。SOMA 将问题反向设定为由多视角 RGB/姿态和皮肤时空形变推断个体肌肉形变,并发布 SKIM 数据集;其用解耦 blendshape 与物理几何先验把表面变化传播到个体肌肉网格,实现可交互、解剖一致的内部动画,但定量增益幅度文中片段未充分说明。

Proposal Refinement for Few-Shot Object Detection Figure 1
2026-06-09cs.CV

Proposal Refinement for Few-Shot Object Detection

Yuan Zeng, Bin Song, Jie Guo, Yuwen Chen

2026-06-09视觉感知

本文针对少样本目标检测中基础类与新类候选框数量严重失衡的问题,指出两阶段检测器的新类精度受 RPN proposal 分布限制。方法在基类训练阶段引入 refinement loss,减弱基类样本对新类参数的抑制梯度;微调阶段为 RPN 增加 refinement branch 以提升新类候选框比例。实验称在 VOC/COCO 等基准较基线提升约 1%–6%,且不增加推理时间。

EgoTactile: Learning Grasp Pressure for Everyday Objects from Egocentric Video Figure 1
2026-06-09cs.CV

EgoTactile: Learning Grasp Pressure for Everyday Objects from Egocentric Video

Yuan Zeng, Yujia Shi, Tiao Tan, Xingting Li, Yaqi Qin, Zongqing Lu, Wenming Yang, Jing-Hao Xue, Qingmin Liao

2026-06-09视觉感知

针对机器人操作和VR中全手抓握压力难以用侵入式触觉硬件大规模获取的问题,EgoTactile将自我中心视频与63类日常3D物体的全手压力监督配对,并加入裸手迁移子集。方法上用条件视频扩散模型EgoPressureDiff结合预训练视频先验与物理属性特征校正,处理遮挡和重量、材质等视觉歧义。实验显示其在该基准上优于判别式基线,并具备一定野外迁移能力。

Semi-supervised Source Detection in Astronomical Images: New Benchmark and Strong Baseline Figure 1
2026-06-09cs.CV

Semi-supervised Source Detection in Astronomical Images: New Benchmark and Strong Baseline

Longhan Feng, Zihuang Cao, Ali Luo, Yuanhao Guo, Shuilian Yao, Yixin Guo, Qi Jia, Yu Liu

School of Software, Dalian University of Technology, Chinese Academy of Sciences, Research Institute of Highway, code is available at https://github.com/AcWiz/NovaTeacher., semi-supervised object detection, pseudo-labeling., available during training. However, astronomical sources are small, such methods still assume the availability of a substantial amount of, fully-labeled images, and tend to struggle in astronomical domains, In this work, we propose a new dataset benchmark and label-, a dual-teacher paradigm and pseudo-label guidance to enhance, ploiting confidence scores to stratify pseudo-labels, as a result of

2026-06-09视觉感知数据集/基准

这篇论文针对天文图像中星源密集、PSF 扩散和低信噪比导致检测召回下降,以及完整标注成本过高的问题,构建了 LAMOST-DET 基准,含 18,400 张图像和 728,898 个星源实例;并提出 Nova Teacher,在双教师半监督框架中结合光源增强、置信度引导伪监督和跨视角互补挖掘。实验显示其在两种稀疏标注设置下较已有方法提升 4.04% 和 5.22% mAP,并在自然图像数据上具备一定泛化性。

Minimal Solvers for Full-DoF Motion Estimation from Asynchronous Differential SfM Figure 1
2026-06-09cs.CV

Minimal Solvers for Full-DoF Motion Estimation from Asynchronous Differential SfM

Shuo Pan, Banglei Guan, Bin Li, Zhenbao Yu, Zibin Liu, Zi Wang, Yang Shang, Qifeng Yu

College of Aerospace Science and Engineering, National University of Defense Technology, Changsha 410073, China, The Hunan Provincial Key Laboratory of Image Measurement and Vision Navigation, Changsha 410073, China

2026-06-09优化算法

针对事件相机数据异步、传统帧式自运动估计易产生延迟和时间离散误差的问题,论文从异步光流出发重写微分对极约束,并将角速度与线速度解耦,提出可用最少5个点估计全自由度运动的特征值迭代求解器,以及基于一阶旋转近似和Gröbner基的代数最小求解器及加速版本。合成与真实数据实验显示,相比同步方法在精度和抗时空噪声鲁棒性上更好,加速版以小幅精度损失换取近一数量级速度提升。

Event-driven dynamic trajectories reconstruction and measurement of mechanical parameters for fragments Figure 1
2026-06-09cs.CV

Event-driven dynamic trajectories reconstruction and measurement of mechanical parameters for fragments

Haoyang Li, Banglei Guan, Muxi Zha, Yifei Bian, Minzu Liang, Yang Shang, Qifeng Yu

a School of Aeronautics, Northwestern Polytechnical University, Xi’an, Shaanxi 710072, China, b College of Aerospace Science and Engineering, National University of Defense Technology, c College of Science, National University of Defense Technology, Changsha, Hunan 410073, China

2026-06-09三维

针对爆炸碎片高速、高密度且受强闪光烟尘遮挡导致传统高速相机难以同时获得高动态范围与高时间分辨率的问题,论文构建多事件相机系统,用时间相关极线、三焦张量线和局部单应约束结合熵权概率模型筛除误匹配,并通过空间线交会与非线性优化重建三维轨迹、估计速度和动能。仿真中标定板重建误差为0.041%/0.128%、速度误差1.0%,真实无人机验证轨迹平均相对误差0.51%。

Trajectory Optimization in Single and Dual-UAV Bearing-Only Target Localization Figure 1
2026-06-09cs.RO

Trajectory Optimization in Single and Dual-UAV Bearing-Only Target Localization

Zhijian Xiao, Huayu Huang, Bin Li, Yang Shang, Banglei Guan

College of Aerospace Science and Engineering, National University of Defense Technology, Changsha 410073, China, Hunan Key Laboratory of Image Measurement and Visual Navigation, Changsha 410073, China

2026-06-09规划控制优化算法

面向单/双无人机仅方位目标定位中观测几何退化、传统 FIM 目标易陷入奇异构型的问题,论文将主动轨迹规划与机动约束结合,提出谱加权 FIM 目标、双机视线交角正弦项及带粒子归一化的约束 PSO,以改善可观测性并避免双机聚集。仿真显示,相比常规 FIM 方法,单机中位定位误差降低 99.21%,双机提升 69.70%,但结果主要来自仿真验证。

CP4D: Compositional Physics-aware 4D Scene Generation Figure 1
2026-06-09cs.CV

CP4D: Compositional Physics-aware 4D Scene Generation

Hanxin Zhu, Cong Wang, Tianyu He, Long Chen, Xin Jin, Chen Gao, Zhibo Chen

2026-06-09视觉感知

本文针对现有4D生成常忽略物理规律、导致动态场景不一致的问题,提出CP4D:将场景拆为静态3D背景与受物理约束的动态前景,先生成并重建各组件,再结合物理仿真与视频扩散先验合成运动,最后用深度启发和优化自动组合。实验显示其在视觉真实感、物理合理性和可控交互上优于已有方法。

Counterfactual Reasoning for Fine-Grained Evidence Disentanglement in VideoQA Figure 1
2026-06-09cs.CV

Counterfactual Reasoning for Fine-Grained Evidence Disentanglement in VideoQA

Zhou Du, Hamid Krim, Xiao Wu, Zhaoquan Yuan, Liangwei Li, Keisuke Fujii

School, University, Hamid Krim is with the Department of Electrical and Computer Engi-, neering, North Carolina State University, Raleigh, NC 27695, USA (e-mail:, Xiao Wu and Zhaoquan Yuan are with the School of Computing and, Artificial Intelligence, Southwest Jiaotong University, Chengdu 611730, China, Liangwei Li is with School of OptoElectonic Science and Engineering, University of Electronic Science and Technology of China, Chengdu 610031, are rarely available for most VideoQA datasets. (3) A few

2026-06-09视觉感知

这篇论文针对 VideoQA 模型“答对但未基于真实视觉证据”的问题,认为根源在于 ERM 易学习伪相关。作者提出 CREDiT,用结构因果模型刻画问答过程,将跨模态特征拆为因果与非因果部分,并通过独立性、最小性约束及特征级反事实干预抑制混杂。实验在 NExT-GQA、SportsQA、SPORTU-video 上取得 70.4%、60.4%、71.9% Acc@QA,并提升 grounded QA,显示其更能定位因果证据。

Claude Code-Driving Scenario Mining for the Argoverse 2 Challenge Figure 1
2026-06-09cs.CV

Claude Code-Driving Scenario Mining for the Argoverse 2 Challenge

Wei Deng, Caoshengzhe Xue, Shuaikun Liu, Zhaohong Liu, Mengshi Qi, Huadong Ma

State Key Laboratory of Networking and Switching Technology, Beijing University of Posts and Telecommunications, China

2026-06-09视觉感知

面向 Argoverse 2 中按自然语言描述定位自动驾驶场景的挑战,论文提出将场景挖掘转化为可组合原子函数代码生成:用 Claude Code/GLM 5.1 代理检索函数并生成代码,经训练集 Timestamp BA>0.8 筛选少样例、独立语义审查,再用 Qwen3-VL 做场景级验证以压低误报。测试集 HOTA-Temporal 为 27.91、Timestamp BA 为 69.65,优于官方 RefProg 和 SM-Agent 基线,但排名中游,增益来源仍部分不清。

IMUG-Bench: Benchmarking Unified Multimodal Models on Interleaved Understanding and Generation Figure 1
2026-06-09cs.AI

IMUG-Bench: Benchmarking Unified Multimodal Models on Interleaved Understanding and Generation

Lingyi Meng, Zecong Tang, Haoran Li, Tengju Ru, Zhejun Cui, Weitong Lian, Qi Kang, Hangshuo Cao, Yichen Zhu, Yechi Liu, Kaixuan Wang, Yu-Jie Yuan, Chunwei Wang, Yu Zhang, Bo Dai

Zhejiang University, The University of Hong Kong, Institute of Automation, Chinese Academy of Sciences

2026-06-09视觉语言强化学习数据集/基准

现有统一多模态模型评测多停留在单轮或静态问答,难以反映真实交错图文多轮交互中的理解—生成耦合与误差累积。IMUG-Bench构建静态空间、时序因果、混合三类任务,含3113样本、12034轮,并引入动态理解问题。实验显示主流开闭源模型在长上下文多轮生成中明显暴露偏差;CoT、自验证和Best-of-N等测试时scaling可提升生成准确率并缓解退化。

Vision-Language Guided Hyperspectral Object Tracking via Semantics Fusion and Contextual Template Updating Figure 1
2026-06-09cs.CV

Vision-Language Guided Hyperspectral Object Tracking via Semantics Fusion and Contextual Template Updating

Rui Yao, Yuhong Zhang, Kunyang Sun, Hancheng Zhu, Jiaqi Zhao, Zhiwen Shao, Abdulmotaleb El Saddik

is available at https://github.com/rayyao/VLHTrack., wen Shao are with the School of Computer Science and Technology / School, of Artificial Intelligence, and Mine Digitization Engineering Research Center, gineering Center for Intelligent Sensing and Emergency IoT in Underground, Space, China University of Mining and Technology, Xuzhou 221116, China, Abdulmotaleb El Saddik is with the School of Electrical Engineering and, Computer Science, University of Ottawa, Ottawa, ON K1N 6N5, Canada (E-

2026-06-09视觉语言视觉感知

该文针对高光谱目标跟踪中谱段冗余、固定/启发式选带难适应场景,以及遮挡和光照变化导致模板失效的问题,提出 VLHTrack:用 LLM 生成的目标语义指导谱段选择,建立语义到光谱映射,并融合视觉语言特征;同时用 Mamba 式 DTUM 动态更新模板。HOT2023/2024 实验显示其总体 AUC、DP 优于多种 SOTA,消融表明 LBSM 与 DTUM 均带来稳定增益。

Zero-Parameter Geometric Gating for Temporally Stable Low-Altitude UAV Video Semantic Segmentation Figure 1
2026-06-09cs.CV

Zero-Parameter Geometric Gating for Temporally Stable Low-Altitude UAV Video Semantic Segmentation

Jingpu Yang, Fengxian Ji, Zhengzhao Lai, Juanfan Wu, Mingxuan Cui, Yufeng Wang

Beihang University, Northeastern University, The Chinese University of Hong Kong, Shenzhen, Beijing Institute of Technology, Beihang University China, Northeastern University China, The Chinese University of Hong Kong, Shenzhen China, Beijing Institute of Technology China

2026-06-09视觉感知

低空无人机视频分割常受边界闪烁影响,而大面积道路、建筑等平面区域中稠密光流会引入结构化噪声。论文提出无需学习参数的几何门控:用RANSAC单应性内点率在16×16网格上选择单应或光流 warp,再经SSP融合。合成UAVid上两类骨干mIoU提升约4.24–4.91%,平面区域时间一致性由62%升至92%,但真实数据验证仍文中未充分说明。

OmniGen-AR: AutoRegressive Any-to-Image Generation Figure 1
2026-06-09cs.CV

OmniGen-AR: AutoRegressive Any-to-Image Generation

Junke Wang, Xun Wang, Qiushan Guo, Peize Sun, Weilin Huang, Zuxuan Wu, Yu-Gang Jiang

Institute of Trustworthy Embodied AI, Fudan University, Shanghai Collaborative Innovation Center of Intelligent Visual Computing, Bytedance Seed, 4 The University of Hong Kong

2026-06-09视觉感知

现有自回归视觉生成多依赖单一文本或类别条件,难以覆盖真实应用中的空间控制、参考图和历史帧等多源输入。OmniGen-AR将文本与各类视觉条件统一离散成token,并提出DCA在训练中解耦条件/内容注意力以抑制信息泄漏。其在文生图、编辑、帧预测、深度/分割条件生成和文生视频等六类任务上达到SOTA或竞争结果,如GenEval 0.63、VBench 80.02。

Ultra Flash: Scaling Real-Time Streaming Video Generation to High Resolutions Figure 1
2026-06-09cs.CV

Ultra Flash: Scaling Real-Time Streaming Video Generation to High Resolutions

Luxury, Jie Huang, Zihao Fan, Xiaoxiao Ma, Yuming Li, Jun-hao Zhuang, Zeyue Xue, Siming Fu, Haoran Li, Mingchen Zhong, Guohui Zhang, Shichen Ma, Yijun Liu, Jiaqi Shi, Yanwen Ma, Yaofeng Su, Haoyu Wang, Yaowei Li, Songchun Zhang, Weiyang Jin, Yuxuan Bian, Shiyi Zhang, Haojun Xu, Shuai Lu, Xin Han, Wei Tang, Haoyang Huang, Nan Duan

JD Explore Academy, 2USTC, 3PKU, 4THU, 5BUAA, 6FDU, 7HKUST, 8HKU, 9CUHK, Low latency, scalable, scalable, real-time high-resolution video generation a fundamental open challenge., sparse causal attention MIT HAN Lab (2025) replaces dense attention for streaming-compatible

2026-06-09视觉感知

面向实时预览、交互式内容生成等需要高分辨率低延迟视频的场景,Ultra Flash 采用级联式流式生成:先由低分辨率自回归模型生成语义与运动,再通过保持架构的 T2V-to-TV2V 超分训练、因果潜空间上采样与高分辨率解码、稀疏因果化和单步蒸馏实现高效放大。实验显示其在单 GPU 上达到约 30FPS@1K、18FPS@2K,并在人类偏好和视觉质量上优于对比方法。

CAMF-Det: Closure-Aware Multimodal Fusion for LiDAR-Camera 3D Object Detection on UAV Platforms Figure 1
2026-06-09cs.CV

CAMF-Det: Closure-Aware Multimodal Fusion for LiDAR-Camera 3D Object Detection on UAV Platforms

Yanze Jiang, Yanfeng Gu, Xian Li

aSchool of Electronics and Information Engineering, Harbin Institute of Technology, Harbin 150001, China

2026-06-09视觉语言视觉感知三维

本文针对无人机俯视场景中树冠遮挡导致 LiDAR 与相机退化程度不同、传统车载多模态融合难以适配的问题,提出 CAMF-Det:用类 Beer–Lambert 物理模型离线构建双模态遮挡强度,并训练网络在线预测,将遮挡先验注入增强、编码、融合和检测头。在两个自建 UAV 多模态数据集上,其困难级 mAPBEV 较最强基线分别提升 9.43% 和 4.88%。

Decoding Pedestrian Crossing Intention from Egocentric Vision via Vision Language Models Figure 1
2026-06-09cs.CV

Decoding Pedestrian Crossing Intention from Egocentric Vision via Vision Language Models

Danya Li, Xiang Su, Yan Feng, Rico Krueger

Danya Li and Rico Krueger are with Department of Technology, Management, and Economics, Technical University of Denmark, Denmark

2026-06-09视觉感知

本文关注车载/路侧视角难以捕捉行人第一人称感知的问题,将短时自我中心视频中的过街意图预测改写为封闭式 VQA,用通用 VLM 评估并经参数高效微调适配交通场景。零样本模型仅略优于随机且高层交通推理不足;微调后显著提升,较专用 Transformer 基线准确率高 9%,加入自运动、车辆运动与眼动线索后,Qwen3-VL-2B 最高提升 14.5%。

DiffSight-Former: Modeling Structural Differences and Temporal Dynamics for Glaucoma Progression Prediction Figure 1
2026-06-09cs.CV

DiffSight-Former: Modeling Structural Differences and Temporal Dynamics for Glaucoma Progression Prediction

Yi Huang, Lei Bi, Jinman Kim

2026-06-09视觉感知

针对单时点眼底图像难以捕捉青光眼早期进展、常规序列模型又易依赖固定长度或已患病外观线索的问题,DiffSight-Former利用眼底基础模型提取时变解剖特征,显式建模视盘/视杯与血管的访视间结构差异,并结合时间间隔嵌入的Transformer预测未来发病风险。在SIGF上AUC达91.54%、敏感度92.16%,在GRAPE三种视野进展标准下平均准确率87.48%。

A Geometric Framework for Absolute Pose and Velocity Estimation with Event Cameras Figure 1
2026-06-09cs.CV

A Geometric Framework for Absolute Pose and Velocity Estimation with Event Cameras

Zibin Liu, Shunkun Liang, Banglei Guan, Yang Shang, Qifeng Yu, Ji Zhao

2026-06-09三维

针对事件相机几何方法多聚焦速度、难以将稀疏异步事件锚定到3D地图以估计绝对位姿的问题,论文利用场景3D线与触发事件建立正交与共线约束,提出线性/多项式位姿求解器及线性/优化速度求解器,最少三组事件-线对应即可独立恢复6DoF位姿或速度;仿真和真实数据表明其精度与效率优于现有方法。

From USD Scenes to Knowledge Graphs: Zero-Shot Ontology Grounding with LLMs Figure 1
2026-06-09cs.RO

From USD Scenes to Knowledge Graphs: Zero-Shot Ontology Grounding with LLMs

Jiangtao Shuai, Zongxiong Chen, Manfred Hauswirth, Sonja Schimmler

Technical University of Berlin, Germany and 2 Fraunhofer FOKUS, Germany.

2026-06-09视觉语言

本文针对机器人数字孪生中 USD 场景对象难以自动映射到本体类别、手工词典脆弱的问题,提出用 LLM 将 USD 属性与线性化 TBox 结合做零样本 grounding。核心洞察是性能主要来自场景图中的语义线索而非几何:厨房 125 物体上,描述性命名达 90–96%,缩写命名 49–89%,不透明命名靠上下文最高恢复到 48%,但匿名化父路径和兄弟名后仅 0–6%。

Late-Layer Fusion is Enough: Dual-Path Vision Token Routing for Multimodal Large Language Models under Visual Saturation Figure 1
2026-06-09cs.AI

Late-Layer Fusion is Enough: Dual-Path Vision Token Routing for Multimodal Large Language Models under Visual Saturation

Siyuan Liu, Jinyang Wu

2026-06-09视觉语言视觉感知

本文针对多模态大模型将图像与文本 token 等深处理导致视觉计算冗余的问题,指出 LLaVA 中视觉 token 在中层已趋于饱和,而文本仍需深层语义推理。作者提出 DPVR-LF:在饱和层后将视觉 token 路由到一层可训练侧枝,深层主干只处理文本,并在最后一层再融合。实验显示其仅训练约 3% 参数,在 7B/13B 多个基准上接近或超过全量微调,同时降低约 25–30% 前向计算、A800 延迟下降 28%。

An Enhanced Geometric-Spectral Feature Learning Framework for Airborne Multispectral Point Cloud Classification Figure 1
2026-06-09cs.CV

An Enhanced Geometric-Spectral Feature Learning Framework for Airborne Multispectral Point Cloud Classification

Xian Li, Yanfeng Gu, Aleksandra Pižurica

codes and datasets used in this paper will be made available, Xian Li and Yanfeng Gu are with the School of Electronics and, Information Engineering, Harbin Institute of Technology, Harbin 150001, Aleksandra Pižurica is with the Department of Telecommunications and, Information Processing, UGent-GAIM, Ghent University, 9000 Ghent, Especially when the number of labeled training data is limited, incorporates a long-tail center loss and a minimum margin loss, classification, which will be openly available after a possible, labeled and denote the labeled set by, nr denotes the class label from the set, predict the labels of unlabeled points., joint loss that incorporates long-tail center loss and minimum

2026-06-09三维

本文针对机载多光谱点云分类中空间—光谱异构、高维、长尾类别和类间光谱相似导致的小类识别困难,提出轻量级几何—光谱双流框架:一支用位置编码自注意力建模全局光谱,另一支以光谱引导多核点卷积提取局部几何,并用残差注意力融合;同时设计长尾中心损失与最小间隔损失。作者构建两个机载MPC数据集,实验显示相较多种点云分类方法更有效,但具体增益幅度需依赖正文表格核验。

Illumination-Invariant Anomaly Detection for Sub-Canopy UAV Multispectral Point Clouds Figure 1
2026-06-09cs.CV

Illumination-Invariant Anomaly Detection for Sub-Canopy UAV Multispectral Point Clouds

Likun Chen, Yanfeng Gu, Xian Li

School of Electronics and Information, Harbin Institute of Technology, with center wavelengths of 444, 475, 531, 560, 650, 668, 705, Final Label ( k ), same illumination label as the center point:

2026-06-09视觉感知三维

面向林下无人机多光谱点云异常检测,论文针对植被阴影导致的光照异质性和暗物体误判问题,提出无需飞行元数据的框架:用NSVDI粗分阴影并通过光线追踪反演太阳角校正,再仅以同光照状态邻域构建稀疏表示背景字典。实验显示该方法在复杂森林中提升异常与背景可分性,并优于若干基线。

HDRAgent: An Agentic Framework for Multi-Exposure HDR Imaging Figure 1
2026-06-09cs.CV

HDRAgent: An Agentic Framework for Multi-Exposure HDR Imaging

Weiyu Zhou, Tao Hu, Yijian Wang, Xiaogang Xu, Ruixing Wang, Qingsen Yan

Weiyu Zhou, Tao Hu, Yijian Wang and Qingsen Yan are with the School, of Computer Science, Northwestern Polytechnical University, Xi’an 710129, Qingsen Yan is also with the Shenzhen Research Institute, Northwestern, Polytechnical University, Shenzhen, China., Xiaogang Xu is with Zhejiang University, Hangzhou, China.

2026-06-09视觉感知

多曝光 HDR 在动态场景中常因大运动、遮挡和饱和产生鬼影,固定前向管线难以按区域退化差异调整。HDRAgent 将重建改写为 MLLM 驱动的感知、规划、执行与反馈流程,通过细粒度知识匹配选择对齐/融合工具,并用感知-失真反馈和生成式对齐修复极端运动区域。实验显示其能减少鬼影和局部融合伪影,客观指标与视觉质量达到竞争或更优水平。

Driving Video Retrieval for Complex Queries with Structured Grounding Figure 1
2026-06-09cs.CV

Driving Video Retrieval for Complex Queries with Structured Grounding

Manyi Yao, Sparsh Garg, Christian Shelton, Amit Roy-Chowdhury, Abhishek Aich

‡NEC Laboratories, America, †University of California, Riverside, labeled in-domain videos to estimate when a query rule is reliable, adapt rules that, and sensor logs at the center of safety engineering, with a single instrumented vehicle generating tens, (using weak supervision from auto-generated captions of unlabeled auxiliary videos), with an LLM, no labels are required in the target benchmark.

2026-06-09视觉语言视觉感知

面向自动驾驶海量行车视频检索,论文指出密集视觉语言嵌入会稀释变道、急刹等细粒度运动,而LLM生成规则又存在数值阈值失准和规则库覆盖不足。STRIVE-D用弱标注域内视频进行学习排序式阈值校准,并结合置信度自适应规则生成与视觉语言/关键词融合检索。三项驾驶基准上相较强基线一致提升,DrivingDojo Acc@1相对增益最高约84%,且发布了人工标注事件集。

Stabilizing On-Policy Distillation for MLLM Reasoning with Global Normalization Figure 1
2026-06-09cs.LG

Stabilizing On-Policy Distillation for MLLM Reasoning with Global Normalization

Dongze Hao, Zhiwei Jin, Chen Chen, Haonan Lu

OPPO AI Center

2026-06-09强化学习

本文针对多模态大模型后训练中 on-policy 蒸馏的梯度不稳定问题:原始 token 级 KL 反馈在 OOD 状态或教师低概率 token 上会产生异常大更新。作者提出 GNDPO,将原始蒸馏奖励在 batch 内归一化为相对优势,保留密集监督同时抑制梯度尖峰。实验显示其在多种多模态推理基准上较标准 OPD 和 RLVR 提升平均准确率与训练鲁棒性。

Edge-Constrained UAV Small-Object Detection with P2 Enhancement and Quantum-Inspired Lightweight Structure Search Figure 1
2026-06-09cs.CV

Edge-Constrained UAV Small-Object Detection with P2 Enhancement and Quantum-Inspired Lightweight Structure Search

Wuming Lei, Yanbin Gao, Mingyan Sun, Xiaobin Li, Xuechen Liang

East China Jiaotong University, Nanchang, China.

2026-06-09视觉感知

面向无人机边缘端小目标检测,论文指出轻量化网络反复下采样会损失浅层空间细节,且手工堆叠注意力/融合模块收益不稳。作者以 YOLOX-Nano 为基线,引入 stride-4 的 P2 高分辨率检测分支,并用量子启发进化算法在精度、FLOPs、延迟、内存和召回间筛选轻量结构。VisDrone 上 P2 使小目标 AP 较基线提升 31.10%,相近模型规模下较 NanoDet-Plus 的 AP50:95 和小目标 AP 分别提升 17.5% 与 44.9%;QIEA 候选召回最高,但完整训练后 AP 最强仍是 +P2,说明搜索更适合作为成本分析与候选筛查工具。

Beyond Scalar Rewards by Internalizing Reasoning into Score Distributions Figure 1
2026-06-09cs.CV

Beyond Scalar Rewards by Internalizing Reasoning into Score Distributions

Xin Jin, Huanqia Cai, Zhen Li, Zechao Zhan, Dengyang Jiang, Aiming Hao, Yuming Jiang, Chunle Guo, Peng Gao, Ming-Ming Cheng, Steven C.H. Hoi

VCIP, CS, Nankai University

2026-06-09强化学习

本文针对文生图后训练中奖励模型把主观视觉偏好压成单一标量、难表达不确定性的问题,提出 Z-Reward:大 VLM 教师通过推理学习评分分布,紧凑学生则蒸馏这种“推理后的判断”以便高效、可微打分。实验中 27B 教师达人类偏好准确率 89.6%,9B 学生 88.6%,并在文生图优化中相对 SFT 带来 41.3% 净偏好提升;但评测主要依赖内部标注集,泛化性仍需外部验证。

REFINE: Super-efficient 3D Gaussian Splatting Pruning via Rendering-Free Primitive Importance Figure 1
2026-06-09cs.CV

REFINE: Super-efficient 3D Gaussian Splatting Pruning via Rendering-Free Primitive Importance

Zhang Chen, Shuai Wan, Mengting Yu, Fuzheng Yang, Junhui Hou

School of Electronics and Information, Northwestern Polytechnical University, School of Telecommunication Engineering, Xidian University, Department of Computer Science, City University of Hong Kong, ated 3DGS pruning framework centered on a novel rendering-free primi-, ally fall into two categories, both of which face an irreconcilable contradiction

2026-06-09三维

针对3D Gaussian Splatting模型高存储、现有剪枝要么依赖参数启发式导致画质下降、要么需渲染评估开销过大的问题,REFINE用解析近似的渲染感知Hessian场估计删除单个高斯带来的感知误差,并显式建模可见性、投影几何与内容自适应权重,从而无需前向渲染即可排序剪枝。多基准实验显示其在接近渲染感知方法画质的同时,将剪枝相关计算复杂度降低约3000倍。

See More, Think Deeper: Query-Expanded Visual Evidence and Answer-Clue Guided Reflection for Long Video Understanding Figure 1
2026-06-09cs.CV

See More, Think Deeper: Query-Expanded Visual Evidence and Answer-Clue Guided Reflection for Long Video Understanding

Shuning Wang, Zhiheng Wu, YiNuo Lu, Naiming Liu, Chen Jia, Bowen Liu, Shuo Nie, Weijie Zhu, Yumeng Zhang

Baidu Inc., Harbin Institute of Technology, Hong Kong University of Science and Technology

2026-06-09视觉感知

长视频问答常因关键证据稀疏而依赖单一检索意图或语言先验,导致答案正确但视觉依据不完整。论文提出 CoVER:先用伪查询将问题拆成多种可观察线索,检索并放大相关视频证据;再从初始答案生成可验证线索,进行视觉反馈式反思与修正。实验中 CoVER-7B 相比 Qwen2.5-VL-7B 在 MLVU、LVBench 分别提升约 3.9% 和 4.6%,并在部分指标超过闭源模型。

Stage-1 Controls the Entropy Regime, Not the Outcome Figure 1
2026-06-09cs.LG

Stage-1 Controls the Entropy Regime, Not the Outcome

Jianxiong Shen

2026-06-09规划控制

本文追问小数据 VLM 两阶段后训练中,SFT 与同模态教师 OPD 作为 Stage-1 热启动究竟影响什么。核心洞察是 Stage-1 更稳定地改变策略熵与探索状态,而非最终任务效果:OPD 进入 RL 时熵更高、初始 Geometry3K pass@16 和答案多样性略优,但经 GRPO 后三种热启动在域内仅约 53–54%,MathVista 上也无明显优势;SFT 的遗忘则强依赖训练配方。

MilliVid: Hierarchical Latents for Long-Range Consistency in Video Generation Figure 1
2026-06-09cs.CV

MilliVid: Hierarchical Latents for Long-Range Consistency in Video Generation

Ishaan Preetam Chandratreya, David Charatan, Basile Van Hoorick, Sergey Zakharov, Vitor Guizilini, Phillip Isola, Vincent Sitzmann

Massachusetts Institute of Technology, Toyota Research Institute

2026-06-09视觉感知

长视频生成受限于 Transformer 上下文长度,常在分块自回归中遗忘离帧物体与场景结构。MilliVid 的关键是学习分层帧 tokenizer,并在扩散模型中按粗到细 rollout:用少量粗粒度 token 覆盖更长历史,细粒度只补近期纹理。在自建 20 万条 1024 帧 Minecraft 数据集上,相比 FramePack 和全分辨率 rollout,长程 PSNR、LPIPS、DINOv2、FVD/FID 等均明显更优,但需更多 rollout 步且尚未验证可直接迁移到大规模预训练视频模型。

Leveraging NeRF-Rendered Images for 3D Gaussian Splatting Figure 1
2026-06-09cs.CV

Leveraging NeRF-Rendered Images for 3D Gaussian Splatting

Mizuki Morikawa, Yuta Shimizu, Chunyu Li, Yusuke Monno, Masatoshi Okutomi

Institute of Science Tokyo, Tokyo, Japan

2026-06-09视觉感知三维

论文针对街景新视角合成中3DGS速度快但质量常不及NeRF的问题,提出用预训练StreetNeRF渲染图像来“教”目标3DGS:以合成输入视图去除动态物体,并生成俯视额外视图,必要时再用扩散模型增强。实验在一个合成和两个真实数据集、三类3DGS方法上显示,该策略提升街景尤其俯视视角质量,同时基本保留3DGS实时渲染速度。

CRANE: Knowledge Editing for Reasoning MLLMs Figure 1
2026-06-09cs.CV

CRANE: Knowledge Editing for Reasoning MLLMs

Han Huang, Hao Wang, Mengqi Zhang, Shu Wu, Qiang Liu, Liang Wang

2026-06-09视觉感知

本文针对具备显式思维链的多模态推理模型,指出传统知识编辑在教师强制或精确匹配下会产生“虚假成功”,实际存在格式崩塌、视觉证据抵触编辑事实、仅记住原问法等问题。作者提出检查推理链的 ReasonEdit-Bench 与 CRANE:不逐条改权重,而用双库检索结合 SFT 和 GRPO 认知路由奖励来调解视觉先验与注入知识。实验中 CRANE 在冲突场景 Grounded Success 达 96.9%,多跳中间实体使用率 96.9%,但 OOD 表现仍受检索精度限制。

Frequency Decoupled Framework for Screen Content Image Super-Resolution Figure 1
2026-06-09cs.CV

Frequency Decoupled Framework for Screen Content Image Super-Resolution

Xufei Wang, Qicheng Zhang, Qi Wu, Ziyang Gu, Shizhuang Weng

are with the School of Electronic and Information Engineering, Anhui

2026-06-09视觉感知

本文针对屏幕内容图像超分中现有隐式表示方法忽视频域特性的不足,指出SCI的幅度承载稀疏高能周期纹理、相位保留连续结构配置,因而应解耦建模。方法提出FDF:用APFN分别通过幅度聚类提取周期模式、相位一致性注意力强化全局上下文,再由OAIF-Net联合隐式拟合。实验称其在四个公开SCI数据集、多尺度设置下达到SOTA,消融支持各模块有效。

ATM: Action-Consistency Transfer Matrix for Diagnosing and Improving Latent World Models Figure 1
2026-06-09cs.CV

ATM: Action-Consistency Transfer Matrix for Diagnosing and Improving Latent World Models

Jiaheng Chen

School of Software, Northeastern University

2026-06-09强化学习

针对潜在世界模型评估依赖 CEM/仿真 rollout、耗时且难区分表示与规划器问题,论文提出 ATM,用真实编码转移与模型预测转移之间的动作一致性迁移矩阵诊断动作语义是否可解码、可迁移并揭示域不一致;同时提出 AITS 将动作可识别性作为训练信号。实验称 ATM 可将评估降至秒级、加速超 100 倍,在 OGBench-Cube 上 5% 间隔排序准确率达 98.8%,AITS 使 LeWM 成功率提升约 10 个点。

Scaling by Diversified Experience for Vision-Language-Action Models Figure 1
2026-06-09cs.CV

Scaling by Diversified Experience for Vision-Language-Action Models

Leiyu Wang, Zhaofengnian Wang, Xueqi Li, Luoyi Fan, Cewu Lu, Nanyang Ye

2026-06-09视觉语言视觉感知

本文针对 VLA 在真实机器人中高层推理与低层控制纠缠、以及大模型强化学习易漂移的问题,提出 SyVLA:以 VLM 生成控制意图、Flow Matching 动作专家执行,并用 Feature Query Token 的梯度掩码做意图解耦,再以相似示例引导 RL 稳定更新。实验显示其在真实任务和多模态基准上提升成功率与 OoD 泛化,长程稀疏奖励任务最高较模仿初始化提升 15%,同时较好保留视觉语言能力。

SpaceVLN: A Zero-Shot Vision-and-Language Navigation Agent with Online Spatial Cognitive Memory and Reasoning Figure 1
2026-06-09cs.RO

SpaceVLN: A Zero-Shot Vision-and-Language Navigation Agent with Online Spatial Cognitive Memory and Reasoning

Yucheng Deng, Pingrui Lai, Xinhai Li, Chenjia Bai, Xiaoheng Deng, Chengnuo Sun, Xuelong Li, Hua Yang

School of Information Science and Electronic Engineering & School of Integrated Circuits, Shanghai Jiao Tong University, Institute of Artificial Intelligence, China Telecom, Central South University, Jiangsu University

2026-06-09机器人视觉感知

该文针对连续环境中零样本视觉语言导航易依赖局部观察和线性历史、缺乏全局空间认知的问题,提出 SpaceVLN:用在线空间认知记忆抽象已探索区域、路径与地标证据,并以可验证的“空间—地标”阶段进行闭环规划执行,结合 Spatial-CoT 做进度定位和空间关系推理。其在 R2R-CE、RxR-CE、GN-Bench、HM3D-OVON 上取得零样本 SOTA,并完成真实机器人验证,但效率受多次基础模型调用限制。

EPS3D: End-to-End Feed-Forward 3D Panoptic Segmentation Figure 1
2026-06-09cs.CV

EPS3D: End-to-End Feed-Forward 3D Panoptic Segmentation

Runsong Zhu, Jiaxin Guo, Xiaoyang Guo, Zhengzhe Liu, Ka-Hei Hui, Wei Yin, Kai Chen, Wei Chen, Weiqiang Ren, Yunhui Liu, Pheng-Ann Heng, Chi-Wing Fu

2026-06-09视觉感知三维

针对开放词汇三维全景分割中多视角2D特征不一致、逐场景优化耗时且易累积误差的问题,EPS3D从未标定多视图图像端到端前馈预测含几何、外观、语义和实例的3D Gaussian,并用2D基础模型作蒸馏教师;其语义-实例互增强模块通过Ins2Sem与Sem2Ins约束对象内语义一致和实例边界。文中称在ScanNet、Replica优于基线,Replica语义mIoU提升约13%,推理约1秒/场景。

C$^3$ache: Accelerating World Action Models with Cross Inference Chunk Cache Figure 1
2026-06-09cs.LG

C$^3$ache: Accelerating World Action Models with Cross Inference Chunk Cache

Weisen Zhao, Lam Nguyen, Zhicong Lu, Yuzhang Shang

George Mason University, University of Central Florida

2026-06-09强化学习

这篇论文针对世界动作模型在机器人闭环控制中需对连续动作块反复执行昂贵去噪、导致推理延迟高的问题,指出现有缓存只利用单个 chunk 内冗余,忽略相邻 chunk 在同一去噪步的残差高度相关。C3ache 无需训练,跨推理 chunk 缓存并复用残差以跳过部分 DiT 计算,并可与步内缓存结合;在 Fast-WAM 上于 LIBERO 和 RoboTwin 实验中最高获得 2.5× 墙钟推理加速,任务成功率几乎不降。

ChinaHeritaQA: A Culturally-Grounded Visual Question Answering Dataset for World Heritage Sites in China Figure 1
2026-06-09cs.CV

ChinaHeritaQA: A Culturally-Grounded Visual Question Answering Dataset for World Heritage Sites in China

Yi Zhang, Bolei Ma, Yong Cao, Chengyan Wu, Daniel Hershcovich, Anna-Carolina Haensch

LMU Munich 2 FAU Erlangen-Nuremberg 3 Munich Center for Machine Learning, University of Tübingen & Tübingen AI Center, Sun Yat-sen University, University of Copenhagen 7 University of Maryland, College Park

2026-06-09强化学习数据集/基准

针对现有视觉语言评测偏西方、难衡量中国文化遗产图像中历史与建筑知识的问题,论文提出 ChinaHeritaQA:覆盖中国 UNESCO 世遗的中英双语 VQA 基准,含 2,279 张野外图片和 14,133 个多选问答,并用遗产本体与人工校验构建。实验显示,强 VLM 平均可超过非专家人类,尤其擅长地点识别和视觉定位,但在断代、功能与建筑推理上明显下滑,且受朝代和地域分布影响。

Rethinking 3D Shape Generation: Diffusion over Superquadrics Figure 1
2026-06-09cs.CV

Rethinking 3D Shape Generation: Diffusion over Superquadrics

Zhiyang Liu, Wanze Li, Yuwei Wu, Chengran Yuan, Jiawei Sun, Rui Zheng, Marcelo H Ang Jr

2026-06-09生成模型三维

针对现有3D扩散在体素、点云或网格等高维表示上去噪导致计算/显存开销大且难以显式控制的问题,论文提出DoSs:将形状表示为少量超二次曲面primitive,并直接扩散其位姿、尺度、形状与存在分数参数。该紧凑可解释表示将状态压到约7KB,可任意分辨率解码点云并支持部件编辑、约束生成;在ShapeNet等基准上达到有竞争力的保真度和分布质量,多数条件下单形状生成约0.6秒。

NutriMLLM: Multimodal Large Language Models for Dietary Micronutrient Analysis Figure 1
2026-06-09cs.CV

NutriMLLM: Multimodal Large Language Models for Dietary Micronutrient Analysis

Runze Yan, Minxiao Wang, Jiaying Lu, Darren Liu, Xiao Hu, Hanqi Luo

2026-06-09视觉语言

针对临床营养中微量营养素难以从饮食照片可靠估计的问题,论文指出通用 MLLM 常拒答或给出不合理数值,并用 NHANES 24 小时膳食回忆生成约 110 万图像-描述-65 营养素三元组来微调 Qwen3-VL/GLM。NutriMLLM 在真实食物图像上实现近完整覆盖,最大模型多数营养素准确性匹敌或超过 GPT-5、Gemini 3、Claude 等闭源基线。

PolyBuild: An End-to-End Method for Polygonal Building Contour Extraction from High-Resolution Remote Sensing Images Figure 1
2026-06-09cs.CV

PolyBuild: An End-to-End Method for Polygonal Building Contour Extraction from High-Resolution Remote Sensing Images

Yaoteng Zhang, Julin Zhang, Guangshuai Wang, Jiwei Deng, Hui Sheng, Yasir Muhammad, Shiqing Wei

This work was supported in part by the Tianjin Key Laboratory of Rail Transit Navigation Positioning and Spatio-temporal Big Data Technology (Grant No. TKL2024A11)

2026-06-09视觉感知

面向遥感制图中建筑轮廓需从像素分割再后处理、易产生锯齿和误差的问题,PolyBuild将检测与矢量多边形回归端到端结合:先用建筑框内四个子区域中心特征生成更接近真实边界的初始轮廓,再用融合CNN局部特征与Transformer全局顶点关系的优化模块迭代修正。论文在三个建筑数据集上报告其优于现有mask-based和contour-based方法。

When Vision Misleads, Let Location Speak: A Worldwide Image Geo-Localization Method via Location Attention Mechanism and Large Multimodal Models Figure 1
2026-06-09cs.CV

When Vision Misleads, Let Location Speak: A Worldwide Image Geo-Localization Method via Location Attention Mechanism and Large Multimodal Models

Junchao Cui, Wenqi Shi, Xuanzi Ma, Nan Wu, Shaoyong Du, Xiangyang Luo

2026-06-09视觉语言视觉感知强化学习

该文针对全球图像定位中过度依赖视觉相似性、易把外观相近但地理相距很远的场景误匹配的问题,提出 TransGeoCLIP:用带位置注意力的 Transformer 编码 GPS 语义,并与 CLIP 图文表征及大多模态模型的检索增强推理结合。实验在 IM2GPS、IM2GPS3k、YFCC4k、YFCC26k 上提升 1 km 内街景级定位准确率,较 SOTA 分别高 1.5%、1.07%、7.18%、9.75%。

Failure-Aware Refinement of Vision-Language Model for Lithography Defect Detection Figure 1
2026-06-09cs.CV

Failure-Aware Refinement of Vision-Language Model for Lithography Defect Detection

Pangyun Jeong, Jiyeong Kong, Yuehua Hu, Dohee Jeong, Kyung-Tae Kang

HYU-KITECH Joint Department, Hanyang University, Ansan, 15588, Korea, Micro/Nano System Department, Korea University, Seoul 02841, Korea, Department of Photonics and Nanoelectronics, Hanyang University, Ansan, 15588, Korea, Korea Institute of Industrial Technology, Ansan, 15588, Korea

2026-06-09视觉语言视觉感知

光刻缺陷小且易与正常图形混淆,单阶段检测容易漏检、误报或分错类。本文将检测改写为视觉语言结构化生成任务,用 LoRA 微调 Qwen3-VL 输出数量、类别和归一化框,再用首阶段失败案例训练二阶段修正模块。简单图形数据上 mAP@0.5 从 0.554 提升到 0.597,并在 ICCAD 复杂显微图上给出定性可用性,但泛化证据仍有限。

DifferSeg: Towards Diverse Multimodal Binary Segmentation via Differential Perception and Frequency Guidance Figure 1
2026-06-09cs.CV

DifferSeg: Towards Diverse Multimodal Binary Segmentation via Differential Perception and Frequency Guidance

Qiangqiang Zhou, Jiawei Xu, Yong Chen, Dandan Zhu, Yugen Yi, Xiaoqi Zhao

pretrained models will be available at the link ., Qiangqiang Zhou, Jiawei Xu, Yong Chen, and Yugen Yi are with the School, of Artificial Intelligence, Jiangxi Normal University, Nanchang, China (e-mail:, Dandan Zhu is with the Institute of AI Education, East China Normal, Xiaoqi Zhao is with the Yale School of Medicine, Yale University, New

2026-06-09视觉语言视觉感知

针对二值分割中现有通用模型难以同时跨任务、跨 RGB+X 多模态泛化的问题,DifferSeg 将重点放在两处瓶颈:模态差异导致的固定融合失效,以及解码中高低频信息失衡。方法用可学习差分算子做自适应模态对齐与残差互补融合,并以频率引导解码显式建模跨频交互和多路径上采样。论文在29个数据集、18类任务上报告超过67种SOTA方法,显示较强泛化性。

A multi-agent system for spine MRI report generation from multi-sequence imaging Figure 1
2026-06-09cs.CV

A multi-agent system for spine MRI report generation from multi-sequence imaging

Zhiping Xiao, Junwei Yang, Gongbo Sun, Han Zhang, Hanwen Xu, Yi Yao, Zachary D. Miller, William E. King III, Mohammed M. Kanani, Jalal B. Andre, Sammy Chu, Ming Zhang, Paul E. Kinahan, Nathan M. Cross, Sheng Wang

Paul G. Allen School of Computer Science & Engineering, University of Washington, Seattle, WA, USA, School of Computer Science, Peking University, Beijing, China, Department of Computer Sciences, University of Wisconsin–Madison, Madison, WI, USA, Department of Arts and Sciences, New York University, New York City, NY, USA, Department of Radiology, University of Washington Medical Center, Seattle, WA, USA, School of Medicine, University of Washington, Seattle, WA, USA

2026-06-09视觉感知

针对脊柱 MRI 报告需跨多序列、解剖区域整合且人工判读耗时的问题,论文提出 SpineAgent:先分别预训练 T1/T2 的 DINOv3 编码器,再用持续训练合成其他序列嵌入,并将诊断、定位、相似病例检索等 37 个专门代理输出结构化供报告代理生成文本。在 5 万余扫描上,17 项病变预测平均 AUROC 较最强基线提升 10.8%,并在跨厂商/队列、病灶定位、检索和放射科医师评估中表现领先。

Are Reasoning Vision-Language Models Robust to Semantic Visual Distractions? Figure 1
2026-06-09cs.CV

Are Reasoning Vision-Language Models Robust to Semantic Visual Distractions?

Yizheng Sun, Mochuan Zhan, Yanan Ma, Jia Tong See, Yifan Wang, Ziyi Wang, Hao Li, Yang Cui, Wenhao Cai, Jingyu Sun, Chenghua Lin, Riza Batista-Navarro, Jingyuan Sun

University of Manchester, Imperial College London

2026-06-09视觉语言视觉感知安全鲁棒

针对现有 VLM 鲁棒性评测多关注噪声、模糊等感知退化而忽视“看得见但选错证据”的问题,论文提出人工验证的 Distract-Bench,在不改变答案的前提下加入语义相关但任务无关的视觉干扰。对 8 个开源和 2 个闭源模型的比较显示,推理型 VLM 在传统视觉腐蚀下大体继承基座模型表现,却对语义干扰更脆弱,错误案例中干扰常进入推理链并被当作证据。

Generalizing Geometry-Guided Mamba as a Plug-and-Play Context Module for CNN-based Semantic Segmentation Figure 1
2026-06-09cs.CV

Generalizing Geometry-Guided Mamba as a Plug-and-Play Context Module for CNN-based Semantic Segmentation

Sheng-Wei Chan, Hsin-Jui Pan, Chun-Po Shen, Chia-Min Lin, Yung-Che Wang, Jen-Shiun Chiang

Department of Electrical and Computer Engineering, Tamkang University, New Taipei City, Taiwan, replace the original context heads of six representative CNN segmentation models, including DeepLabV3+, DANet, CCNet, PSP-, DeepLabV3+, and PSPNet provide strong local feature extrac-, scribes the tendency toward object centers, while the bound-, DeepLabV3+ replaces ASPP, PSPNet replaces, DeepLabV3+

2026-06-09视觉感知

针对 CNN 语义分割中 ASPP、PPM 与注意力上下文头在高分辨率下计算/显存开销大且易跨边界扩散的问题,论文将 DGM-Net 的 G-Mamba 解耦为可插拔模块,用边界、向心势与方向流引导 Mamba 选择性扫描,使长程传播随几何结构变化。在 Cityscapes 上替换六种 ResNet-101 分割模型的上下文头均提升 mIoU,Cascade 版本最高约提升 0.44–2.84 点,1024² 下额外开销约 33–51 GFLOPs。

CHROMA: Detecting AI-Generated Images through Inter-Channel Color-Space Correlations Figure 1
2026-06-09cs.CV

CHROMA: Detecting AI-Generated Images through Inter-Channel Color-Space Correlations

Juan Pablo Sotelo, Marina Gardella, Pablo Musé

Université Paris-Saclay, ENS Paris-Saclay, CNRS, Centre Borelli, Gif-sur-Yvette, and Lab color spaces providing the most apparent separation between, available. Across a standard benchmark protocol, correlation-augmented, Code is available at https://github.com/JPSoteloSilva/CHROMA., (b) Lab correlation (real/gen.), the split Lab correlation map exposes structured chro-, tually meaningful color spaces. Fig. 1 illustrates how Lab inter-channel correla-

2026-06-09视觉感知

针对AI生成图像检测在未见生成器上泛化脆弱的问题,本文将相机成像管线导致的跨颜色通道相关性作为轻量取证线索,发现LPIPS对不同色彩空间的通道耦合扰动约束不一致,且RGB/Lab相关特征能区分真伪。基于此提出CHROMA,在RGB外加入通道相关图并用固定ResNet-50训练,在单生成器和少量多生成器监督下提升鲁棒性,性能接近近期检测器。

Vision-Language Work Zone Intelligence for Safety-Critical Speed Regulation of Mixed-Autonomy Vehicles in Dynamic Environments Figure 1
2026-06-09cs.CV

Vision-Language Work Zone Intelligence for Safety-Critical Speed Regulation of Mixed-Autonomy Vehicles in Dynamic Environments

Angel Martinez-Sanchez, Kianna Ng, Wesley Maia, Laura Fleig, Maitrayee Keskar, Erika Maquiling, Yash Tandon, Parthib Roy, Mohan Trivedi, Ross Greer

positive. These results demonstrate a practical, scalable approach, repository: https://github.com/Mi3-Lab/workzone, the-shelf cameras and embedded computing already available, representations, offering a scalable pathway to improving

2026-06-09视觉语言视觉感知安全鲁棒

针对施工区临时限速标志样式不一且常缺失于地图、给混合自动驾驶带来超速风险的问题,本文提出车载实时视觉/视觉语言管线,将目标检测、语义校验与带滞回的时序状态机结合,输出可用于提醒或控制的施工区状态和限速值,并可在低成本嵌入式硬件运行。ROADWork 490 段序列上施工区事件召回率 96.5%、精度 68.7%;35 分钟自采数据中限速识别精度 95.45%、召回率 53.85%,无错误限速分类。

Intelligent Character Recognition of Handwritten Forms with Deep Neural Networks Figure 1
2026-06-09cs.CV

Intelligent Character Recognition of Handwritten Forms with Deep Neural Networks

Hartwig Grabowski

2026-06-09视觉感知

论文面向纸质考试等手写表单仍需人工录入的问题,研究在固定表格中识别手写拉丁大写字母。其核心思路是用深度网络把字符检测与分类合并为单一任务,并用表单模板和 EMNIST 人工合成训练数据,减少手工标注与传统分割流程依赖。相比初始两阶段方案在真实考试数据上仅约 44.46% 准确率,定制数据后整体识别率达到 88.28%,但对 EMNIST 分布差异的处理细节仍是性能关键。

Hybrid E-Assessment in Higher Education: Semi-Automated Grading of Paper-Based Written Examinations Figure 1
2026-06-09cs.AI

Hybrid E-Assessment in Higher Education: Semi-Automated Grading of Paper-Based Written Examinations

Hartwig Grabowski, Michael Canz

2026-06-09视觉感知

针对高校总结性考试中全数字化评测常被选择题化、难以承载推理和问题求解的动机,论文提出保留纸笔作答、将关键中间结果写入结构化表格,再用视觉大模型进行手写识别、双通道校验并与答案键比对的混合评测流程。主要结论是该方案有望降低批改负担并改善规模化考试的公平性与有效性,但文中未充分说明真实考试中的量化增益。

BLM-SGAN: Bidirectional Language Modeling for Semantic-Spatial Text-to-Image Generation Figure 1
2026-06-09cs.CV

BLM-SGAN: Bidirectional Language Modeling for Semantic-Spatial Text-to-Image Generation

Ahmed Abdelmoneim Mazrou, Haidy Maher El-Amir, Ali Hamdi

2026-06-09视觉感知生成模型

本文针对GAN式文本生成图像中长程语义建模不足、文本与空间区域融合不充分及多阶段训练不稳定的问题,提出BLM-SGAN:以BERT双向语言模型提取上下文文本特征,并在单阶段生成器的SSACN模块中进行语义-空间注入。实验主要在鸟类描述生成上验证,报告IS为5.45±0.08,优于SSA-GAN、DF-GAN等基线;但泛化到更复杂多物体场景的证据文中未充分说明。

Geometry-Aware Fisheye-LiDAR Fusion for Robust 3D Object Detection in Low-Overlap Setups Figure 1
2026-06-09cs.CV

Geometry-Aware Fisheye-LiDAR Fusion for Robust 3D Object Detection in Low-Overlap Setups

Xiangzhong Liu, Xihao Wang, Hao Shen

Technical University of Munich, 80333 Munich, Germany

2026-06-09视觉感知强化学习三维安全鲁棒

面向低成本自动驾驶/物流平台中双鱼眼相机与车顶 LiDAR 重叠少、畸变强导致常规 BEV 融合失真的问题,论文提出 GA-HF:鱼眼特征用畸变感知 Polar LSS 保留角向密度,LiDAR 与检测回归保持笛卡尔度量一致,并用双注意力校正低质量区域。实验在 KITTI-360 上较笛卡尔基线 NDS 提升 4.2%,在 Dur360BEV 超过 LiDAR-only 与 BEVFusion,在 Fisheye3DOD 取得融合方法最高检测分。

ZIPP:Zero-shot Image Personalization from Personas Figure 1
2026-06-09cs.AI

ZIPP:Zero-shot Image Personalization from Personas

Harini SI, Somesh Singh, Yaman Kumar Singla, David Doermann, Rajiv Ratn Shah

2026-06-09视觉感知

论文针对文生图模型偏向“平均审美”、冷启动用户缺少偏好数据的问题,提出用自然语言 persona 作为零样本个性化条件:从 Reddit 大规模交互图中用 GAT 挖掘用户画像,再让 LLM 角色扮演改写提示词以驱动扩散模型。实验在 ZIP-Bench 等基准上显示,persona 条件在零/少样本均提升,前沿模型增益约 13–20%,人工评测相对通用生成胜率 79%,且比微调基线更能保留用户内偏好多样性。

CSFlow: Aligning Flow Matching with Human Contrast Sensitivity Figure 1
2026-06-09cs.CV

CSFlow: Aligning Flow Matching with Human Contrast Sensitivity

Malgorzata Galinska, Bart Pogodzinski, Jan Eric Lenssen

Max Planck Institute for Informatics, Saarland Informatics Campus

2026-06-09生成模型

论文针对扩散/flow matching各去噪阶段生成不同空间频率,而人眼对中频更敏感这一错配,提出CSFlow:先估计反向流区间带来的频率信息增益,再用人类对比敏感函数为训练损失或推理步长加权,把算力更多分配给可感知频段。在PixelGen、JiT上,FID降低4.7%、IS提升2.2%、GenEval提升2.5%,视觉上更真实且少些卡通感。

Classifying galaxies in the Galaxy10 DECals dataset using Inception and Residual CNNs Figure 1
2026-06-09cs.CV

Classifying galaxies in the Galaxy10 DECals dataset using Inception and Residual CNNs

Lanz Anthonee A. Lagman, Prospero C. Naval Jr, Reinabelle C. Reyes

Data Science Program, College of Science, University of the Philippines - Diliman, Philippines, Department of Computer Science, College of Engineering, University of the Philippines - Diliman, Philippines, National Institute of Physics, College of Science, University of the Philippines - Diliman, Philippines, Batangas State University, Batangas City, 3–6 July 2024, need a large, labeled dataset for this study. We use the Galaxy10 DECals dataset [2], which is composed, z-band Legacy Survey. Meanwhile, the labels were sourced from the Galaxy Zoo project [4].

2026-06-09数据集/基准

面对未来天文巡天带来的海量星系图像,论文将ResNet101与InceptionV4用于经空间增强和平衡处理的Galaxy10 DECals十分类任务,核心洞察是评估两类高效CNN作为星系形态分类基线的成本与效果。两者测试准确率约89%,ResNet101在准确率、精确率、召回率和F1上略优于InceptionV4,但差异统计显著性文中未充分说明。

PairWise Image Finder: An Open-source Tool for Finding Visually Aligned Street-Level Image Pairs for Urban Perception Studies Figure 1
2026-06-09cs.CV

PairWise Image Finder: An Open-source Tool for Finding Visually Aligned Street-Level Image Pairs for Urban Perception Studies

Jussi Torkko

aDigital Geography Lab, Department of Geosciences and Geography, University of Helsinki, PO Box 64 (Gustaf Hällströmin katu 2), 00014, Helsinki, Finland, provides a scalable and open tool for researchers and stakeholders to find high-quality image pairs for urban analysis, perception, ments.txt. Firstly, the tool uses the publicly available meta-, compared. All models used at this step are publicly available as, Face, Inc., 2026), enabling easy usage. The amount of matched, the other hand, the center of panoramic images often faces the, Sánchez and Labib (2024)).

2026-06-09视觉感知

论文针对街景时序变化研究中仅靠 GPS、朝向等元数据难以保证视角一致的问题,提出开源 PairWise Image Finder,将 SuperPoint/LightGlue 特征匹配与语义分割掩码结合,输出匹配比例、距离、覆盖和语义 mIoU 供用户筛选图像对。示例比较显示,视角对齐会显著影响纵向变化量化结果,可减少人工配对并提升城市感知研究的可比性。

MaskAlign: Token-Subset Representation Alignment for Efficient Diffusion Training Figure 1
2026-06-09cs.CV

MaskAlign: Token-Subset Representation Alignment for Efficient Diffusion Training

Lianyu Pang, Tianlin Pan, Cheng Da, Changqian Yu, Huan Yang, Kun Gai, Song Guo, Wenhan Luo

2026-06-09生成模型

针对扩散模型用干净图像表征对齐 noisy 特征时存在 token 级不匹配的问题,论文发现全 token 对齐的高梯度位置有稳定空间偏置,可能诱导依赖完整干净 token 的捷径。MaskAlign 随机只对齐 token 子集,并在掩码前加入轻量 token mixing 以缓解信息损失。ImageNet 256×256 上,SiT-XL/2 达到同等 FID 所需迭代显著减少,相比 vanilla SiT-XL/2 在 FID 8.3 约快 77×,相对 REG 还降低单步时间并改善 FID。

DeepMine-Mamba: Mitigating Information Dilution in Mamba-Based State Space Models for Document Image Binarization Figure 1
2026-06-09cs.CV

DeepMine-Mamba: Mitigating Information Dilution in Mamba-Based State Space Models for Document Image Binarization

Sheng-Wei Chan, Yung-Che Wang, Hsin-Jui Pan, Chia-Min Lin, Jen-Shiun Chiang

2026-06-09视觉感知

本文针对退化文档二值化中细弱、断裂笔画易在长程建模中丢失的问题,指出直接使用 Mamba 状态传播会产生笔画级信息稀释。DeepMine-Mamba 结合 ConvNeXt、Sobel 边缘先验与四向 Mamba,并引入 Anti-Dilution Gate 按传播变化恢复局部笔画响应。DIBCO/H-DIBCO 留一年测试显示其整体 FM、Fps 具竞争力,DIBCO 2019 上 FM、Fps、PSNR 最优,但 DRD 并非始终最低。

Beyond Consistency: Preserving Temporal Structure in Zero-Shot Video Editing Figure 1
2026-06-09cs.CV

Beyond Consistency: Preserving Temporal Structure in Zero-Shot Video Editing

Deyin Liu, Yisheng Ding, Zhe Jin, Xiatian Zhu, Anjan Dutta, Lin Wu

aAnhui University, No 111, Jiulong Road, Hefei, 230601, Anhui Province, China, bSurrey Institute for People-Centred Artificial Intelligence, University of, cUniversity of Warwick, Gibbet Hill Road, Coventry, CV4 7AL, UK

2026-06-09视觉感知

这篇论文指出,现有零样本视频编辑多追求帧间平滑,却会抹掉长视频中的场景切换、身份变化等时间语义结构。作者提出 TSPVE:用扩散特征自适应分段并选锚帧,在片段内做自适应 token 合并,后期交替联合相邻片段注意力,以兼顾语义差异和过渡连续。实验显示其在时间一致性、结构保持指标 TSPR、用户偏好和推理效率上优于多种一/零样本基线。

TeamHerald@CHIPSAL 2026: Hate Speech Detection and Sentiment Analysis of Nepali Memes using Transformer-based Architectures and Ensemble Learning Figure 1
2026-06-09cs.CL

TeamHerald@CHIPSAL 2026: Hate Speech Detection and Sentiment Analysis of Nepali Memes using Transformer-based Architectures and Ensemble Learning

Ashish Acharya, Anish Khatiwada, Rohit Khadka, Pragya Aryal

Herald College Kathmandu, Kathmandu, Nepal, is unavailable. We then benchmark six Transformer-, availability and model development (Parihar et al., sive labeled datasets (Ranasinghe et al., 2021)., jective labels such as hate and sarcasm (Ranas-, need for clearer annotation protocols and scalable

2026-06-09视觉感知

针对尼泊尔语 meme 中低资源、混合书写与缺少基线导致的仇恨言论和情感识别困难,论文采用 OCR 提取图中文字后比较六种 Transformer,并系统评估硬/软投票集成。结果显示,二分类仇恨检测中单一 decoder-only 模型最佳,而三分类情感任务中软投票 Macro F1 较最强单模型相对提升 15.8%,说明集成收益与任务类型相关。

RGB-S: Image-Aligned Tactile Saliency for Robust Dexterous Manipulation Figure 1
2026-06-09cs.RO

RGB-S: Image-Aligned Tactile Saliency for Robust Dexterous Manipulation

Shengcheng Luo, Kefei Wu, Xiaoying Zhou, Wanlin Li, Ziyuan Jiao, Chenxi Xiao

ShanghaiTech University, Beijing Institute for General Artificial Intelligence

2026-06-09机器人视觉感知安全鲁棒

这篇论文针对灵巧操作中视觉遮挡时触觉与图像难以对齐、隐式融合样本效率低的问题,提出 RGB-S:用机器人正运动学和相机标定把触觉传感器接触位置投影到 RGB 平面,并生成力调制高斯显著图,再以零初始化条件模块接入预训练视觉骨干。六个仿真与真实任务显示,该显式空间锚定在遮挡场景更稳健,真实遮挡成功率较最强隐式视触觉基线提升 26.7 个百分点。

Less Is More: Training-Free Acceleration Framework of 3D Diffusion Models for Low-Count PET Denoising via Global-Local Trajectory Reduction Figure 1
2026-06-09cs.CV

Less Is More: Training-Free Acceleration Framework of 3D Diffusion Models for Low-Count PET Denoising via Global-Local Trajectory Reduction

Yuhan Liu, Scott M. Leonard, Marlee Crews, Muhannad Fadhel, Jinkui Hao, Tianqi Chen, Ryan J. Avery, Bo Zhou

Department of Radiology, Northwestern University, Chicago, IL, USA, Department of Biomedical Engineering, Hefei University of Technology, Hefei, Anhui, China

2026-06-09生成模型规划控制三维

低剂量/低计数 PET 可降低辐射和采集时间,但 3D 扩散去噪推理过慢。本文的核心洞察是条件恢复任务中低计数图像已含结构信息,完整反向轨迹和相邻步 U-Net 特征存在冗余;因此提出免训练 LIM,通过中间噪声初始化跳过全局步数,并复用局部高层特征。多示踪剂公开与院内数据上实现超过一个数量级加速,重建质量与盲读临床评分保持或优于全步基线。

Stain-Aware Wavelet Regularization for Instant Adversarial Purification in Histopathology Figure 1
2026-06-09cs.CV

Stain-Aware Wavelet Regularization for Instant Adversarial Purification in Histopathology

Zhe Li, Bernhard Kainz

Department AIBE

2026-06-09视觉感知

病理图像中对抗噪声与具有诊断意义的中高频纹理高度重叠,通用即时净化易损伤组织结构。SAWR将Haar多级小波正则嵌入一致性蒸馏,并按苏木精/伊红染色通道分别约束频谱,另加语义一致性以保留病理特征。在PathMNIST上,相比OSCP等基线,对PGD、定向PGD和AutoAttack均更稳健,鲁棒性最高提升10.69%,同时改善干净精度和频谱保真度。

MB-Loc: Multi-planar Bird's-eye-view Localization in outdoor LiDAR scenes Figure 1
2026-06-09cs.CV

MB-Loc: Multi-planar Bird's-eye-view Localization in outdoor LiDAR scenes

Ayaan Choudhury, Preet Savalia, Anirudh Pydah, Avinash Sharma

Indian Institute of Technology Jodhpur, invariant features. We perform extensive experiments on the publicly available

2026-06-09视觉感知

针对户外 LiDAR 全局定位中 SCR 方法精度高但依赖重型 3D 计算、且视角变化下易退化的问题,MB-Loc 将点云按高度切片为 2.5D 多平面 BEV,用 2D CNN 保留部分垂直几何并降低计算量,同时加入 KL 正则化确定性瓶颈和投影前 3D 增广以处理稀疏与旋转鲁棒性。在 NCLT 上,文中报告其精度优于现有方法,并以实时推理速度显著提升相对传统 3D-SCR 的效率。

AUCp: Pseudo-AUC for Inference Model Selection with Unlabeled Validation Data in Abnormality Detection Figure 1
2026-06-09cs.CV

AUCp: Pseudo-AUC for Inference Model Selection with Unlabeled Validation Data in Abnormality Detection

Md Mahfuzur Rahman Siddiquee, Fazle Rafsani, Jay Shah, Teresa Wu, Catherine D Chong, Todd J Schwedt, Baoxin Li

2026-06-09视觉感知

针对无监督/自监督医学异常检测常依赖带标注验证集或FID、重建误差选checkpoint而难以落地的问题,论文提出AUCp:将未标注测试样本暂视为异常、与正常训练集一起计算伪AUC来做推理模型选择。作者给出其在正常训练集充分且有代表性时接近真实AUC的分析,并在HealthyGAN、Brainomaly及多种自监督方法和数据集上显示,相比FID等准则通常能选出检测AUC更高的模型;但异常占比过低或正常集偏小时可靠性会下降。

Artificial Intelligence for Mathematical Reasoning: An Integrated Survey of Language Models, Neuro-symbolic Systems, and Verified Discovery Figure 1
2026-06-09cs.AI

Artificial Intelligence for Mathematical Reasoning: An Integrated Survey of Language Models, Neuro-symbolic Systems, and Verified Discovery

Syed Rifat Raiyan, Mohsinul Kabir, Hasan Mahmud, Md Kamrul Hasan

2026-06-09视觉感知

本文关注数学推理为何成为检验 AI 的关键场景:答案可验证、推理需组合且能连接语言、视觉与形式证明。其主要洞察是把数学题求解、几何多模态、Lean 等证明助手中的形式化,以及开放式数学发现统一到“生成—验证”框架下,并梳理 CoT、工具调用、RLVR、测试时扩展等机制。作为综述,文中主要结果是给出238篇工作的系统分类、基准与失效模式分析;性能增益多被归因于 scaling、数据和验证器辅助,独立复现实验有限。

Thinking Without Images: Internalizing Visual Manipulation with On-Policy Self-Distillation Figure 1
2026-06-09cs.CV

Thinking Without Images: Internalizing Visual Manipulation with On-Policy Self-Distillation

Yishuo Cai, Jiahui Liu, Yuanxin Liu, Haobo Deng, Linli Yao, Yuhao Zheng, Kun Ouyang, Zhimo Li, Ziyue Wang, Xu Sun, Haoli Bai, Xiaohui Li

State Key Laboratory of Multimedia Information Processing, School of Computer Science, Peking University, Central South University, University of Science and Technology of China, Peking University, code is publicly available at https://github., the local evidence available to the teacher, while

2026-06-09机器人视觉感知强化学习

论文针对多模态模型细粒度视觉推理中依赖裁剪/放大工具导致推理慢且中间证据不稳定的问题,提出 Thinking with Imagination 与 Imagine-OPD:训练时用带标注区域放大视图的同源教师,对学生自身生成的“看哪里、想象看到什么”轨迹做 on-policy 自蒸馏,推理时不再调用工具。实验显示其在4个视觉中心基准上提升4B/8B骨干并取得最佳平均表现,同时比显式工具方法快约1.5–2.7倍;但训练仍依赖区域标注。

SNR-ST-Mix: Sample-specific Neighborhood Regression Mixup for Augmented Spatial Transcriptomics Imputation with Deep Neural Network Figure 1
2026-06-09cs.LG

SNR-ST-Mix: Sample-specific Neighborhood Regression Mixup for Augmented Spatial Transcriptomics Imputation with Deep Neural Network

Hongyi Yu, Yaoyu Fang, Jiahe Qian, Xinkun Wang, Lee A. Cooper, Bo Zhou

Northwestern University, Department of Radiology, Chicago, IL, USA, Yale University, Department of Biostatistics, New Haven, CT, USA, Northwestern University, Department of Cell and Developmental Biology, Chicago, IL, USA, Northwestern University, Department of Pathology, Chicago, IL, USA

2026-06-09视觉感知

空间转录组数据常受噪声、低分辨率和样本稀缺限制,影响基于病理图像的基因表达插补。SNR-ST-Mix将 mixup 限定在每个 spot 的空间近邻内,并按表达相似性自适应插值,以生成更符合局部生物结构的回归增强样本。多组织实验显示其优于常规增强方法,且无需改动模型结构或增加额外计算。

PRPO: Perception-Reinforced Policy Optimization via Token-Level Dynamic Advantage Reshaping Figure 1
2026-06-09cs.CV

PRPO: Perception-Reinforced Policy Optimization via Token-Level Dynamic Advantage Reshaping

Qiming Li, Tianlun Li, Xiaolong Cheng, Hangyu Li, Ruiyan Gong, Kangning Niu, Kaitao Jiang, Mu Xu

Amap CV Lab, Alibaba Group, 2 Peking University

2026-06-09强化学习优化算法

本文针对多模态 RLVR 将轨迹级奖励平均分配给所有 token、导致稀疏关键视觉感知 token 被语言模板淹没的问题,提出 PRPO:用 RVD 识别既依赖视觉又对扰动稳定的 token,再用 PAR 在 token 级重塑优势以强化感知信用分配。七个多模态推理基准上,3B/7B 模型平均提升 23.3%/21.1%,并报告更好训练效率与跨任务泛化。

PhysAgent: Automating Physics-Based 4D Synthesis via Trajectory-Grounded Multi-Agent Feedback Figure 1
2026-06-09cs.RO

PhysAgent: Automating Physics-Based 4D Synthesis via Trajectory-Grounded Multi-Agent Feedback

Chunji Lv, Jiaxi Ye, Yuchen Jiang, Rexar Lin, Changsheng Li

Beijing Institute of Technology

2026-06-09规划控制

针对物理 4D 合成中环境力场仍需专家手调、SDS 优化慢且难处理离散力场切换、开放式 LLM 又缺少物理反馈的问题,PhysAgent 将 MPM 仿真器置于多智能体闭环中:语义智能体借助外置力场技能库生成初始配置,Refine Agents 从渲染视频中提取轨迹并转成文本反馈,用 LLM 推理迭代修正力场。实验显示其在多模态提示下可更快生成稳定、多样的物理场景,物理准确性和多样性优于基线。

Shift-Dependent Asymmetry: Orthogonal Inverse Low-Rank Adaptation for Federated Medical Segmentation Figure 1
2026-06-09cs.CV

Shift-Dependent Asymmetry: Orthogonal Inverse Low-Rank Adaptation for Federated Medical Segmentation

Xingyue Zhao, Wenke Huang, Linghao Zhuang, Haoran Wu, Anwen Jiang, Zhifeng Wang, Wenwen He, Ming Feng, Mang Ye, Bo Xu

Department of Neurosurgery, Peking, Union Medical College Hospital, Chinese Academy of Medical, Sciences and Peking Union Medical College 2The Key Laboratory, stitute of Automation, Chinese Academy of Sciences 3College of, Computing and Data Science, Nanyang Technological University, Singapore 4Institute of Basic Medical Sciences, Chinese Academy, of Medical Sciences and Peking Union Medical College, Beijing, China 5Xinjiang University 6Ant Group, China 7Wuhan Univer-, requires diverse data from multiple centers (Hu et al., 2025a, this challenge by enabling collaborative training across insti-, burdens on local computing resources. To make collabo-, Accordingly, we center our investigation on the Federated

2026-06-09视觉感知

针对多中心医学分割中联邦 LoRA 统一聚合忽视编码器/解码器异质性的问题,论文指出编码器更受外观协变量偏移影响、解码器更受标注/目标概念偏移影响,并提出 IAT:在编码器个性化 A、解码器个性化 B,同时用子空间正交正则抑制共享与本地更新泄漏。多站点细胞核与眼底分割实验显示,其相较强联邦 LoRA 和参数高效 FL 基线取得更好精度及通信/参数效率。

BLUE: Toward Better Language Use in Efficient Vision-Language-Action Models for Autonomous Driving Figure 1
2026-06-09cs.CV

BLUE: Toward Better Language Use in Efficient Vision-Language-Action Models for Autonomous Driving

George Ling, Lijin Yang, Hao Yang, Zhongzhan Huang

2026-06-09视觉语言视觉感知

论文针对自动驾驶 VLA 模型每帧生成语言推理成本高且未必有益的问题,先通过闭环分析发现语言只在少数路线显著影响表现,且可能有害;据此提出 BLUE,在冻结 VLA 隐状态上训练 0.11M 参数门控,按帧决定是否生成语言。该方法无需改 backbone 或人工标注,在 Bench2Drive 达 76.2% 成功率、Longest6 v2 得分 36,并相对骨干提升 8.9% 成功率、加速 2.54 倍。

Distortion-Aware PETR for BEV Object Detection with Mixed Pinhole-Fisheye Cameras Figure 1
2026-06-09cs.CV

Distortion-Aware PETR for BEV Object Detection with Mixed Pinhole-Fisheye Cameras

Xiangzhong Liu

2026-06-09视觉感知

针对自动驾驶中针孔与鱼眼混合相机的 BEV 3D 检测,论文指出鱼眼径向畸变会破坏 PETR 等方法的均匀采样与2D-3D对应。DAPETR 不做图像矫正,而用 MEI 统一畸变感知位置编码,并通过双向特征-几何调制对齐外观与空间信息。在转换的 KITTI-360 上,它优于 PETR、PolarPETR 及多种投影式基线;同时发现极坐标重参数化与学习式调制叠加会相互冲突。

BioVid: Autoregressive Video Generation with Biological Behavior Semantic Comprehension Figure 1
2026-06-09cs.CV

BioVid: Autoregressive Video Generation with Biological Behavior Semantic Comprehension

Tsung-Wei Pan, Jung-Hua Wang

aDepartment of Electrical Engineering, National Taiwan Ocean University, Keelung, Taiwan, bAI research center, National Taiwan Ocean University, Keelung, Taiwan

2026-06-09视觉感知

BioVid针对现有视频生成把时长固定为外部参数、难以反映生物行为自然持续时间的问题,提出两阶段自回归框架:用FSQ-R3GAN离散化帧以缓解码本坍塌,再由因果Transformer学习EOS停止信号,使动作长度从数据中涌现。在NTU RGB+D饮水动作上,其生成长度分布Wasserstein-1为1.24,优于固定长度基线6.05和VideoGPT的15.48,同时保持相近空间质量。

Learning to Solve Generative ODEs Beyond the Linear Span Figure 1
2026-06-09cs.CV

Learning to Solve Generative ODEs Beyond the Linear Span

Sihyeon Kim, Seunghun Lee, Vikas Singh, Hyunwoo J. Kim

Korea University, University of Wisconsin–Madison, they learn, existing methods still execute each step by scalar-recombining the available velocity

2026-06-09生成模型

针对扩散/flow 生成模型少步采样中仍需多次 ODE 评估的问题,论文指出现有学习求解器只重组历史速度,更新被限制在线性张成空间内,无法修正正交残差。SpanLift 在固定基求解器上加入轻量空间残差算子,并用教师端点匹配训练,不改 backbone 且不增加模型 NFE。实验覆盖像素扩散、潜空间 flow matching 和降水临近预报,3 NFE 下将 CIFAR-10 FID 从 8.16 降至 5.69、ImageNet 从 17.37 降至 11.83。

WaveDiT: Distribution-Aware Wavelet Flow Matching for Efficient 3D Brain MRI Synthesis Figure 1
2026-06-09cs.CV

WaveDiT: Distribution-Aware Wavelet Flow Matching for Efficient 3D Brain MRI Synthesis

Danilo Danese, Angela Lombardi, Giuseppe Fasano, Matteo Attimonelli, Tommaso Di Noia

Sapienza University of Rome, Italy, baselines. Code is available at https://github.com/sisinflab/WaveDiT.

2026-06-09生成模型三维

针对全分辨率3D脑MRI生成中像素扩散开销大、潜空间压缩易损失解剖细节的问题,WaveDiT在可逆3D Haar小波系数空间做条件流匹配,并用分解的空-深注意力降低体数据计算量;其关键洞察是不同小波子带呈现重尾、异方差且随生成轨迹变化,因此引入Morpheus按高阶统计预测子带不确定性,进入损失和条件。多站点实验显示其相较扩散、潜空间和小波基线更贴近真实分布,并改善脑龄预测与ROI解剖一致性。

PhysGraph: A Physics-aware 3D Scene Graph for Perception and Reasoning Figure 1
2026-06-09cs.RO

PhysGraph: A Physics-aware 3D Scene Graph for Perception and Reasoning

Haoyu Li, Aaron Thomas, Shuyan Zhou, Xianyi Cheng

Department of Mechanical Engineering and Materials Science, Duke University, Durham, NC 27708, USA. 2 Department of Computer Science, Duke University, Durham, NC 27708, USA.

2026-06-09三维

该文针对现有开放词汇3D场景表示偏重语义、缺少材料与运动学约束而难以支撑安全操作的问题,提出PhysGraph:从RGB-D多视角重建对象级几何、关联实例,并借助视觉/语言模型进行功能部件分解、材料和关节推理,形成含空间关系与物理属性的层次3D场景图。实验显示其在语义分割、多物体质量估计和关节预测上达到SOTA,并可用于约束感知3D可供性预测与real-to-sim迁移。

FiberTune: Preserving Action-Fiber Visual Residuals in Vision-Language-Action Fine-Tuning Figure 1
2026-06-09cs.CV

FiberTune: Preserving Action-Fiber Visual Residuals in Vision-Language-Action Fine-Tuning

Haihao Lin, Xiangsheng Huang, Xiao Yang, Weibang Zhou, Yiqi Zhang, Bo Yang, Simin Zeng, Jiawei Yang, Zhengyang Wang, Jiahui Du

University of Chinese Academy of Sciences, Hebei Key Laboratory of Cognitive Intelligence, Xiong’an Institute of Innovation, Hebei University of Technology, Beijing Information Science and Technology University

2026-06-09视觉语言视觉感知

论文指出,VLA 行动监督微调只约束会改变动作预测的特征方向,易压缩颜色、类别、干扰物等“动作等价”视觉残差信息。FiberTune 用在线动作探针滤除动作预测方向,再将残差视觉 token 对齐冻结视觉教师并维持有效秩,且不增加推理开销。在 CALVIN、LIBERO、π0.5/OpenVLA-OFT 及真实 SO-101 上均优于仅任务损失微调,如 CALVIN SR(5) 提升 10.7 个百分点,真实成功率 72.7% 升至 78.1%。

Reconstructing Synthetic SDO/AIA 193 A EUV Images from He I 10830 A Observations with Diffusion Model Translator Figure 1
2026-06-09astro-ph.SR

Reconstructing Synthetic SDO/AIA 193 A EUV Images from He I 10830 A Observations with Diffusion Model Translator

Marco Marena, Qin Li, Haimin Wang, Haodi Jiang, Prajwal Shah, Bo Shen

Department of Mechanical and Industrial Engineering, New Jersey Institute of Technology, Department of Physics, New Jersey Institute of Technology, Department of Computer Science, Sam Houston State University, Department of Computer Science, New Jersey Institute of Technology, Department of Data Science, New Jersey Institute of Technology

2026-06-09视觉感知生成模型

为弥补SDO前缺乏常规EUV全日面成像的历史空档,论文利用长期He I 10830 Å观测作为日冕结构代理,提出面向日冕洞的条件扩散图像翻译模型,将其重建为合成AIA 193 Å图像。模型在2011–2015配准数据上训练,测试中全盘形态相关达0.92、低强度日冕洞结构相关达0.84,并与EIT、SXT及太阳活动指标的跨年代比较显示其可作为历史日冕演化研究的物理合理代理;但绝对辐射定标和日冕洞边界仍需谨慎解释。

Learnable Token Sparsification for Efficient Gigapixel Whole Slide Image Reasoning Figure 1
2026-06-09cs.CV

Learnable Token Sparsification for Efficient Gigapixel Whole Slide Image Reasoning

Jingzhi Chen, Landi He, Zhuo Chen, Shawn Young, Lijian Xu

Shenzhen University of Advanced Technology

2026-06-09视觉感知

针对千兆像素病理全切片在视觉语言模型中产生海量视觉 token、易淹没稀疏诊断证据的问题,论文将 token 压缩改为可学习稀疏化:训练时用 SparseLearn 的 Soft Top-K、方差保持噪声门和去噪器传递梯度,推理时移除该模块,仅用 scorer 选取 32 个 token。该方法在 SlideBench TCGA 上达 73.32% 准确率,并在 BCNB 与 WSI-VQA* 上显示零样本泛化。

SSAFE: Simple and Strong AI-Generated Image Detection via Frozen Vision Encoders Figure 1
2026-06-09cs.CV

SSAFE: Simple and Strong AI-Generated Image Detection via Frozen Vision Encoders

Seunghyun Lee, Byoungkwon Kim, Jaehyun Nam, Kyungmin Lee, Jinwoo Shin

2026-06-09视觉感知安全鲁棒

针对现有 AI 图像检测依赖海量真伪数据且难以适应新生成器的问题,SSAFE 指出冻结的多模态视觉编码器已在嵌入空间中自然区分真实与合成图像,并据此用 PE-Core 特征加线性分类器及表示感知数据筛选。仅用 10K 样本、8 个代表生成器,模型在 AIGI-Holmes、OpenFake 和 RealWorldBench 上达到或接近最优,RealWorldBench 上较随机筛选提升 96.4% vs. 94.9%,显示鲁棒性更多来自表示与数据策划而非单纯扩数据。

Harnessing Streaming Video in the Wild Figure 1
2026-06-09cs.CV

Harnessing Streaming Video in the Wild

Dingyu Yao, Shuhuan Gu, Qingyi Si, Junhao Zhou, Chenxu Yang, Chuanyu Qin, Naibin Gu, Zheng Lin, Weiping Wang, Nan Duan, Jiaqi Wang

2026-06-09视觉感知

针对视频通话、直播解说和具身机器人中视频无限流入、需因果低延迟响应的问题,论文提出从数据、系统和评测三端重构流式 VLM:用 Streaming-Train-248K 和响应/沉默训练目标学习何时开口,用 StreamingHarness 提供每秒决策、12 小时记忆与 vLLM 友好的亚秒推理,并以 Streaming-Eval 衡量时机与正确性。实验称 8B 流式模型结合 Harness 超过多种闭源 VLM,并可在数小时直播中保持稳定亚秒延迟。

Facial Expression Recognition in the Deep Learning Era: A Systematic Multi-Criteria Review of Methods, Models, Datasets, Performance, Challenges, and Future Research Directions Figure 1
2026-06-09cs.CV

Facial Expression Recognition in the Deep Learning Era: A Systematic Multi-Criteria Review of Methods, Models, Datasets, Performance, Challenges, and Future Research Directions

Spyridon Georgiou, Aggelos Psiris, Spyridon Evangelatos, Thomas Lagkas, Vasileios Argyriou, Panagiotis Sarigiannidis, Iraklis Varlamis, Georgios Th. Papadopoulos

2026-06-09视觉感知数据集/基准

面向野外表情识别在姿态、遮挡、标注噪声、跨人群泛化与边缘部署中的困难,本文系统梳理深度学习时代 FER 研究。其核心是按任务、模态、预处理、架构、学习策略、采集场景和应用七维建立分类,并串联 CNN、Transformer、视觉语言与基础模型演进。主要结果是汇总数据集、评测指标和代表方法性能,指出未来瓶颈集中在数据标注、鲁棒泛化、时序建模、可信公平与伦理部署。

OrderDP: A Theoretically Guaranteed Lossless Dynamic Data Pruning Framework Figure 1
2026-06-09cs.LG

OrderDP: A Theoretically Guaranteed Lossless Dynamic Data Pruning Framework

Chenhan Jin, Shengze Xu, Qingsong Wang, Fan Jia, Dingshuo Chen, Tieyong Zeng

The Chinese University of Hong Kong, Beijing Normal-Hong Kong Baptist University, Guangzhou Nanfang College, Institute of Automation, Chinese Academy of Sciences, Xiangtan University, University of Utah, publicly available at https://github.com/shengze-xu/OrderDP.

2026-06-09视觉感知

针对动态数据剪枝中仅保留高信息样本易造成梯度偏差、训练不稳定且“近无损”机制缺乏解释的问题,OrderDP先随机生成候选池,再按损失选择Top-q样本,并以替代损失建立无偏梯度、收敛和泛化分析。实验在CIFAR-10/100与ImageNet-1K上显示,其在中等剪枝率下接近全量精度,ImageNet 40%剪枝仍保持精度并降低40%以上训练成本。

OmniCap-IF: Benchmarking and Improving Instruction Following Abilities for Omni-Video Captioning Figure 1
2026-06-09cs.CV

OmniCap-IF: Benchmarking and Improving Instruction Following Abilities for Omni-Video Captioning

Jiahao Wang, An Ping, Yanghai Wang, Yuanxing Zhang, Shihao Li, Hanyan Bian, Yichi Ren, Yize Zhang, Han Wang, Haowen Chen, Junze Li, Jiaqi Wang, Yiyang Hu, Zhuze Xu, Zijie Zhang, Jiaheng Liu

NJU-LINK Team, Nanjing University, Despite their proficiency in general video description, high-quality, controllable outputs are crucial for, drastically degrades. Finally, to advance controllable generation, we construct OmniCap-IF-54K, a large-, path toward highly controllable omni-modal assistants., • A high-quality training dataset and a strong baseline for controllable generation. We release

2026-06-09视觉语言视觉感知数据集/基准

现有全模态视频描述评测多看语义丰富度,难以衡量模型在音视频联合理解下是否严格服从复杂格式与内容约束。OmniCap-IF提出含50类约束、1920样本的基准,将格式、视觉、音频、跨模态与时间定位分开评估,并揭示严格格式会削弱内容推理的“format-content tradeoff”。作者还构建54K指令微调数据和OmniCaptioner-IF,在复杂约束遵循和通用全模态描述上均优于基线。

Towards Accurate Emotion-Attributed Video Captioning via Fine-grained Emotion-Cause Pair Extraction Figure 1
2026-06-09cs.CV

Towards Accurate Emotion-Attributed Video Captioning via Fine-grained Emotion-Cause Pair Extraction

Weidong Chen, Cheng Ye, Zhendong Mao, Liping Wang, Xinyan Liu, Yongdong Zhang

2026-06-09视觉语言视觉感知

论文针对情感视频描述中仅用全局视觉特征易引入冗余、导致情感归因错误的问题,提出 MM-ECPE++,把情感视为由特定视觉原因触发,通过概念级场景/物体/运动分解、视觉引导的情感可解释学习及跨注意力对比对齐,抽取细粒度情感-原因对。三组数据集实验显示方法优于基线,在 EVC-MSVD 上 BLEU-2 和 ROUGE-L 分别提升 4.4% 与 5.4%。

When Video Misreads: Closed-Loop Distillation of Reading Heuristics for Exploratory Manipulation Trace QA Figure 1
2026-06-09cs.RO

When Video Misreads: Closed-Loop Distillation of Reading Heuristics for Exploratory Manipulation Trace QA

Haizhou Ge, Yufei Jia, Yue Li, Zhixing Chen, Lu Shi, Lei Han, Guyue Zhou, Ruqi Huang

Tsinghua University

2026-06-09机器人视觉感知

论文关注探索式操作中“失败尝试”所揭示的隐藏前提:现有 VLM/具身多模态模型难以仅凭视频或本体轨迹判断最短成功动作链。作者提出 EMT-QA 任务,并用闭环代码代理从标注轨迹中蒸馏一行可读启发式 DRH,推理时只作为冻结 VLM 的提示。三项仿真和两项真机任务中,链预测准确率较最佳原始模态基线提升 0.38–0.47,且同一 DRH 可生成匹配 VLM 的程序分类器。

NGram-MoSE: Efficient Remote Sensing Super-Resolution via N-Gram Context and Mixture-of-Experts Figure 1
2026-06-09cs.CV

NGram-MoSE: Efficient Remote Sensing Super-Resolution via N-Gram Context and Mixture-of-Experts

Yun-Hsuan Huang, Trong-An Bui, Chih-Hung Chuang

Institute of Aerospace and Systems Engineering, National Taipei University of Technology, Taipei City, Taiwan., available observations are typically coarser. Single-image super-, whereas observations with higher temporal availability are

2026-06-09视觉感知

针对遥感中高时效影像分辨率低、现有 Transformer 超分模型计算重且跨地域泛化不稳的问题,NGram-MoSE 将跨窗口 N-Gram 上下文注入与稀疏 MoE 前馈结合,以减少窗口边界纹理断裂并在不等比例增加推理成本下扩展容量。地理隔离 OOD 测试中达到 31.68 dB PSNR,较重型基线 FLOPs 降低 14 倍;用于滑坡分割时相对双三次上采样提升 mAP@50 4.47%。

DriveReward: A Comprehensive Dataset and Generative Vision-Language Reward Model for Autonomous Driving Figure 1
2026-06-09cs.CV

DriveReward: A Comprehensive Dataset and Generative Vision-Language Reward Model for Autonomous Driving

Qimao Chen, Fang Li, Yuechen Luo, Zehan Zhang, Haiyang Sun, Fangzhen Li, Bing Wang, Guang Chen, Yang Ji, Jiong Deng, Hongwei Xie, Hangjun Ye, Long Chen, Yi Zhang

Hangjun Ye2, , Long Chen2, Yi Zhang1, 1Tsinghua University, rigorously labeled via temporally-grounded visual guidance, and augmented with, severely bottlenecks data scalability. In contrast, model-based methods are typically trained jointly

2026-06-09视觉语言视觉感知生成模型强化学习数据集/基准

论文针对自动驾驶中多模态轨迹选择和RL微调依赖手工规则、感知真值且难覆盖长尾失败的问题,构建DriveReward数据集:用时序视觉提示、反事实驾驶行为和多维QA标注训练/评测VLM奖励模型。结果显示通用VLM在该基准上并不稳健,而定制的1B DriveReward在任务奖励对齐上超过更大模型,并在RL微调与测试时轨迹打分中达到接近规则奖励的开闭环表现。

OmniTryOn: Video Try-On Anything at Once! Figure 1
2026-06-09cs.CV

OmniTryOn: Video Try-On Anything at Once!

Changliang Xia, Chengyou Jia, Minnan Luo, Zhuohang Dang, Xin Shen, Bowen Ping

Xi’an Jiaotong University, Xi’an Jiaotong University Xi’an China

2026-06-09视觉感知

针对现有视频虚拟试衣多限于单件服饰且依赖掩码、姿态等外部先验导致动态破坏的问题,论文提出 Try-On Anything 任务与 TryAny-Bench,并设计无需外部先验的 OmniTryOn:用首帧作为可穿戴对象缓存注入多物体细节,结合 STC-RoPE 保持时空锚点和 GTO 渐进训练。实验显示其在多物体试穿、画质与运动/背景一致性上优于专用试衣和通用视频编辑基线。

Look Less, Reason More: Block-wise Attention Skipping for Efficient Multimodal LLMs Figure 1
2026-06-09cs.CV

Look Less, Reason More: Block-wise Attention Skipping for Efficient Multimodal LLMs

Jie Ma, Zhike Qiu, Jiayi Ji, Xiaoshuai Sun, Rongrong Ji

Xiamen University

2026-06-09视觉语言

针对高分辨率视觉 token 使多模态 LLM 自注意力预填充开销激增的问题,本文指出深层视觉-视觉注意力会“饱和”,空间关系已稳定而 FFN 仍负责语义对齐。基于此提出免训练 V-Skip:不删 token、不跳整层,而在校准选择的层中绕过冗余视觉自注意力并保留 FFN。实验显示其可跳过约 60% 饱和注意力模块,在 LLaVA 系列保持 98.42%–100.31% 性能、Qwen 上保持 94.16%,并降低幻觉风险。

EgoPriMo: Egocentric Motion Generation for Interactive Humanoid Control Figure 1
2026-06-09cs.RO

EgoPriMo: Egocentric Motion Generation for Interactive Humanoid Control

Haoyang Ge, Peng Ren, Yukun Shi, Cong Huang, Kun Li, Kai Chen

Tianjin University, Tianjin, China, Zhongguancun Academy, Beijing, China, Beihang University, Beijing, China, Zhongguancun Institute of Artificial Intelligence, Beijing, China

2026-06-09机器人规划控制

论文针对人形机器人依赖既定轨迹回放、缺少可交互全身运动先验的问题,提出从第一视角人类示范中学习 EgoPriMo:用三流 DiT 联合建模身体运动、视觉上下文和文本,并以任务掩码在同一 checkpoint 中支持重建、生成与预测。Nymeria 与 EgoExo4D 实验显示其优于 UniEgoMotion,生成的 SMPL 运动可接入 Unitree 控制器,但足滑和真实闭环评估仍有限。

Seeing is Believing: Aligning Prompt Rewriting with Visual Anchors for Text-to-Image Generation Figure 1
2026-06-09cs.CV

Seeing is Believing: Aligning Prompt Rewriting with Visual Anchors for Text-to-Image Generation

Xuanyi Liu, Deyi Ji, Junyu Lu, Jing Wang, Qianxiong Xu, Xuhang Chen, Tianrun Chen, Siwei Ma

Peking University, Dalian University of Technology, Nanyang Technological University, University of Cambridge, Zhejiang University

2026-06-09视觉感知

本文针对文本到图像生成中短提示词含糊、传统 LLM 改写只追求流畅而易引入视觉/物理幻觉的问题,提出 FaithRewriter:先把改写提示渲染成“视觉锚点”,用多模态模型诊断并修正不合理之处,再通过 SFT+DPO 蒸馏到小型纯文本改写器。实验在 FaithT2I 等基准上显示其生成的提示更忠实用户意图、视觉可行性优于强基线,但离线构造数据的计算开销较高。

OctaOctree Neural Radiosity for Real-time Glossy Material Rendering Figure 1
2026-06-09cs.GR

OctaOctree Neural Radiosity for Real-time Glossy Material Rendering

Jierui Ren, Haojie Jin, Bo Pang, Meng Gai, Fei Zhu, Yisong Chen, Sheng Li (Peking University)

JIERUI REN, Peking University, China, HAOJIE JIN, Peking University, China, BO PANG, Peking University, China, MENG GAI, Peking University, China, FEI ZHU, Peking University, China, YISONG CHEN, Peking University, China, SHENG LI∗, Peking University, China, cn, Peking University, Beijing, China

2026-06-09视觉感知

该文针对实时全局光照中光泽/镜面材质出射辐射方向变化尖锐、传统神经辐射缓存易模糊或需多次采样的问题,提出 OctaOctree:用自适应空间八叉树结合每节点八面体方向图,在表示层分配互补的空间与角分辨率。实验显示其可在主交点单次网络查询下更好保留视角相关反射,较神经 radiosity/缓存基线提升保真度并达到实时渲染性能。

TVI-CoT: Text-Visual Interleaved Chain-of-Thought Reasoning for Multimodal Understanding Figure 1
2026-06-09cs.CV

TVI-CoT: Text-Visual Interleaved Chain-of-Thought Reasoning for Multimodal Understanding

Lianyu Hu, Xiaoyu Ma, Zeqin Liao, Yang Liu

2026-06-09视觉语言强化学习

该文针对多模态 CoT 在初次视觉编码后只能“盲目”用文本推理、难以回看图像细节的问题,提出 TVI-CoT:用可学习的 Think、Look、Answer 控制符在推理中交替生成文本思路与重新访问相关视觉区域。八个基准上相对基线提升明显,如 MMMU +6.1%、MathVerse +3.8%、MathVista 和 ScienceQA 各 +3.4%。

GraspFoM: Towards Reconstruction-Driven Robotic Grasping with 3D Foundation Priors Figure 1
2026-06-09cs.RO

GraspFoM: Towards Reconstruction-Driven Robotic Grasping with 3D Foundation Priors

Dongli Wu, Xiaobao Wei, Hao Wang, Qiaochu Dong, Ying Li, Qingpo Wuwu, Ming Lu, Wufan Zhao

2026-06-09机器人三维

针对遮挡和部分观测下抓取既需局部接触又需完整三维结构的问题,GraspFoM将SAM3D三维基础先验转化为重建与抓取共享的对象潜变量,并用锚点初始化的截断扩散器直接生成连续多模态抓取姿态,再通过重建感知评分器和残差更新器让几何与可抓取性相互反馈。在GraspNet-1B上,文中报告其抓取和网格/3DGS重建均达到SOTA,且额外可训练参数较少。

X-Palm: Paired Multispectral-to-Smartphone Dataset for Cross-Domain Palmprint Authentication Figure 1
2026-06-09eess.IV

X-Palm: Paired Multispectral-to-Smartphone Dataset for Cross-Domain Palmprint Authentication

Jamal Seyedmohammadi, Pai Chet Ng, Angelo Genovese, Zhixiang Chi, Jeannie Lee, Konstantinos N. Plataniotis

Singapore Institute of Technology, University of Toronto, available at: https://github.com/X-Palm/X-Palm-2026

2026-06-09数据集/基准

针对掌纹认证中“受控注册、手机端随意验证”的域差,X-Palm构建了同一身份的多光谱扫描仪与非受控智能手机成对数据,覆盖设备、光照、姿态、距离、遮挡和手掌表面状态等复合变化。数据含103人206只手共6006张图像,并给出12种模型的跨数据集、闭集/开集跨域基准;结果显示既有方法在X-Palm上明显崩塌,而用X-Palm训练的模型跨域鲁棒性更稳定,增益可能主要来自数据覆盖与成对设计。

Reinforcing Temporal Answer Grounding in Instructional Video via Candidate-Aware Causal Reasoning Figure 1
2026-06-09cs.CV

Reinforcing Temporal Answer Grounding in Instructional Video via Candidate-Aware Causal Reasoning

Muge Qi, Rong Fu, Pengbin Feng, Xianda Li, Yu Cai, Yifu Guo, Shizhe Zhang, Simon James Fong, Lei Ma, Bin Li

Center, Peking University, Beijing, China 2University of Macau, Macau, China 3University of Southern California, Los Ange-, les, USA 4University of Bologna, Bologna, Italy 5Sun Yat-sen, University, Guangzhou, China 6Shenzhen Institute of Advanced, away from label fitting, and promotes cross-scene

2026-06-09视觉语言视觉感知

这篇论文针对教学视频问答定位中“长视频里找极短答案片段”的难题,指出全视频推理易受冗余内容和弱视觉推理干扰。方法先用视觉语言预训练模型筛出Top-K候选片段,再在候选集上进行带拒绝奖励的时序因果/逻辑推理,并用GRPO优化以提升抗干扰能力。实验在六个基准上取得mIoU最优,说明候选感知缩小搜索空间对长视频精确定位有效。

Segmentation-Assisted Brain MRI Synthesis with Cross-Image Multi-Contrast Feature Memory Bank Retrieval Augmentation Figure 1
2026-06-09cs.CV

Segmentation-Assisted Brain MRI Synthesis with Cross-Image Multi-Contrast Feature Memory Bank Retrieval Augmentation

Wenwei Huang, Jia Wei, Jianlong Zhou

2026-06-09视觉感知

针对临床多对比脑 MRI 常因扫描时间、伪影或协议差异而缺失,且现有合成方法在肿瘤区域易模糊的问题,论文提出 SSCF:用分割分支预测肿瘤掩膜并回馈合成分支,同时通过肿瘤掩膜库与跨图像多对比特征库检索外部先验。其在 BraTS2020 和 UCSF-BMSR 上优于既有方法,尤其改善多对比缺失时的肿瘤结构与纹理恢复。

CheXanatomy: Anatomy-Aware Vision-Language Modeling for Chest Radiographs Figure 1
2026-06-09cs.CV

CheXanatomy: Anatomy-Aware Vision-Language Modeling for Chest Radiographs

Sergios Gatidis, Curtis Langlotz, Christian Bluethgen

2026-06-09视觉语言视觉感知

胸片解剖分割受投影重叠、标注稀缺和域偏移限制,普通VLM又偏全局图文对齐。CheXanatomy用CT分割经DRR投影生成合成胸片监督,将框和掩码编码为token,让PaliGemma以自回归方式学习解剖结构而非加专用解码头。结果显示其在合成数据上接近U-Net,在真实胸片域移下几何鲁棒性更好,少样本定位更省标注;但增益可能部分来自模型规模和输入分辨率。

CoVEBench: Can Video Editing Models Handle Complex Instructions? Figure 1
2026-06-09cs.CV

CoVEBench: Can Video Editing Models Handle Complex Instructions?

Jiangtao Wu, Jiaming Wang, Yiwen He, Yuanxing Zhang, Shihao Li, Dunyuan Liu, Xuedong Zhao, Jialu Chen, Zekun Moore Wang, Jiaheng Liu

NJU-LINK Team, Nanjing University

2026-06-09视觉感知

这篇论文针对现有视频编辑评测多停留在单一简单编辑、难以反映真实多约束指令的问题,提出 CoVEBench:包含416个源视频、626条多点编辑指令和9990个细粒度检查项,覆盖主体、背景、镜头、运动、特效等维度,并用多模态大模型评估指令遵循、保真度和质量。实验显示,当前开源与闭源模型在组合编辑中仍常漏改、破坏应保留内容或产生伪影。

Geometry-Driven Flow Analysis of Brain Sulcal Pattern Figure 1
2026-06-09cs.CV

Geometry-Driven Flow Analysis of Brain Sulcal Pattern

Moo K. Chung, Luigi Maccotta, Aaron Struck

University of Wisconsin, Madison, USA, Washington University, St. Louis, USA, at the University of Wisconsin Hospital and Clinics [7]. De-

2026-06-09生成模型

针对 JME 中传统厚度、脑回化指数等标量指标难以刻画分布式皮层折叠组织的问题,论文将平均曲率视为沟/回源汇,在皮层流形上求解正则化 Poisson 方程,得到折叠势及其梯度流。结果显示该求解器在仿真中较稳健,并在 JME 相比对照中发现不对称的额中央、运动区及外侧裂周围折叠势改变,且与皮层厚度仅部分重叠,提示其捕捉到互补的几何重组信息。

SceneConductor: 3D Scene Generation from Single Image with Multi-Agent Orchestration Figure 1
2026-06-09cs.CV

SceneConductor: 3D Scene Generation from Single Image with Multi-Agent Orchestration

Jeonghwan Kim, Yushi Lan, Yongwei Chen, Hieu Trung Nguyen, Chuanyu Pan, Xingang Pan

Nanyang Technological University, 2 University of Oxford, 3 Meshy AI

2026-06-09视觉感知三维

针对单图生成完整三维场景时几何、物体关系与环境上下文难以一致且依赖场景级标注的问题,SceneConductor将流程拆为场景初始化、环境构建和多智能体局部细化,并用点图稀疏几何先验训练布局预测器以降低监督需求。实验显示其在基准和真实图像上提升几何精度、空间一致性与感知真实感,但多基础模型串行带来的时延和误差传播仍是限制。

Programmable Silicon Retina on Pixel Processor Array Figure 1
2026-06-09eess.IV

Programmable Silicon Retina on Pixel Processor Array

Maciej Lewandowski, Prince Philip, Alexandre Marcireau, Chetan Singh Thakur, André van Schaik, Piotr Dudek

Department of Electrical and Electronic Engineering, University of Manchester, UK, Department of Electronic Systems Engineering, Indian Institute of Science, Bangalore, India, Department of Computer Science, Most commercially available event cameras [18, 19, 20] implement a relatively simplified model of retinal processing., arithmetic noise. Given these constraints and the limited commercial availability of PPA hardware, we also provide a, rating biologically motivated functions such as center-surround filtering and spike-based encoding. To the best, of our knowledge, this is the first implementation of a multi-stage silicon retina model with center-surround, currently being prepared for release and will be made available in a cleaned and documented repository here

2026-06-09视觉感知

针对传统帧相机带宽/功耗高、标准DVS仅做时间对比而缺少更完整视网膜处理的问题,本文在SCAMP-5像素处理阵列上实现含中心-周边滤波、增益控制与ON/OFF脉冲输出的多阶段硅视网膜,并提供CUDA仿真框架。实验显示其不利于绝对强度重建,但在相同轻量网络下使视频显著性预测损失较DVS降低13%,事件率约降47%,说明其过滤可能对边缘语义任务起到信息蒸馏作用。

Self-Supervised Vision Transformers for CBCT-Based Detection of Temporomandibular Joint Osteoarthritis Figure 1
2026-06-09cs.CV

Self-Supervised Vision Transformers for CBCT-Based Detection of Temporomandibular Joint Osteoarthritis

Shradhdha Trivedi, Vrundan Sojitra, Mariela Padilla

∗Herman Ostrow School of Dentistry, University of Southern California, †Viterbi School of Engineering, University of Southern California, without labels, making them attractive for low-data medical, than 200 annotated cases are available—directly relevant to, bag-level classification without patch labels. Its combina-, orientation, centred on the TMJ region of each volume, as-, positive-class weighting addresses label imbalance, label, Review Board (IRB) at the University of Southern Califor-, the public University of Michigan Deep Blue TMJ OA repos-, data leakage (Table 1). Labels are binary: OA-positive (any

2026-06-09视觉感知

针对颞下颌关节骨关节炎在 CBCT 中骨性改变细微、标注数据少且跨站点泛化困难的问题,本文将 3D CBCT 转为轴向切片,用 DINO 系列自监督 ViT 提取切片特征,并以注意力 MIL 做患者级分类。核心洞察是适配策略比骨干选择更关键:仅解冻最后两个 Transformer block 即可显著提升性能,DINOv2 AUC 从冻结的 0.671 升至 0.902,优于 DINOv1、DINOv2+reg 和监督 ImageNet ViT 基线。

Beyond Raw Signals: Undecoded Generative Latents as Privileged Synthetic Data Figure 1
2026-06-09cs.CV

Beyond Raw Signals: Undecoded Generative Latents as Privileged Synthetic Data

Cristian Sbrolli, Nicolas Michel, Matteo Matteucci, Toshihiko Yamasaki

The University of Tokyo, and auxiliary modalities are rarely available in the wild., class label, Inequality, mutual information I with the label Y cannot in-

2026-06-09生成模型

本文针对多模态训练依赖成对数据、推理成本高,以及生成补全模态需“解码再编码”造成噪声和浪费的问题,提出直接使用3D/音频生成模型未解码潜变量作为特权信息的DLA,并用MESSy预测式多层蒸馏让纯视觉学生吸收几何与声学先验而不强制特征对齐。实验称其优于原始数据增强和传统蒸馏,但具体增益幅度与来源文中片段未充分说明。

SMI: Efficient Self-Supervised Learning via Mutual-Information-Inspired Dependency Optimization Figure 1
2026-06-09cs.CV

SMI: Efficient Self-Supervised Learning via Mutual-Information-Inspired Dependency Optimization

Pritam Mishra, Coloma Ballester, Dimosthenis Karatzas

representations from large-scale unlabeled data. Recent contrastive approaches achieve remarkable, conceptual appeal, developing scalable and computationally efficient MI-inspired objectives for SSL

2026-06-09优化算法

针对现有自监督方法依赖大 batch、动量编码器、内存库或全局同步导致训练复杂的问题,SMI 将样本间相关性经高斯互信息启发的非线性变换后,在样本级依赖矩阵上做对齐与去冗余,而非优化高维特征相关矩阵。ResNet-50/ImageNet 上线性评估接近主流 SSL,同时降低计算与同步需求;在低资源和细粒度迁移任务上优于 Barlow Twins。

Set-Based Transformer for Atmospheric Compensation in Standoff LWIR Hyperspectral Imaging Figure 1
2026-06-09cs.CV

Set-Based Transformer for Atmospheric Compensation in Standoff LWIR Hyperspectral Imaging

Fabian Perez, Nicolas Quintero, Jeferson Acevedo, Hoover Rueda-Chacon

Department of Computer Science, Universidad Industrial de Santander, code is publicly available at: https://factral.co/SAE-LWIR/, • The first publicly available MODTRAN-generated dataset

2026-06-09视觉感知

本文针对近水平远距离 LWIR 高光谱成像中大气透过率、上行辐射和下行辐射随距离强烈变化、传统星载/机载补偿方法难以适用的问题,提出用 Set Transformer 无序联合处理多距离辐射观测,并分别输出逐距离 T/La 与共享 Ld;同时用稀疏自编码器分析潜变量。基于 MODTRAN 生成数据的实验显示三类大气产物光谱失真较低,但真实场景泛化仍文中未充分说明。

Where the Score Lives: A Wavelet View of Diffusion Figure 1
2026-06-09cs.LG

Where the Score Lives: A Wavelet View of Diffusion

Emma Finn, Binxu Wang, T. Anderson Keller, Demba E. Ba

2026-06-09生成模型

论文针对扩散模型中“架构选择如何影响生成/去噪行为”仍不清楚的问题,用二维正交小波基参数化 score,并将最优 score 写成数据分布矩的闭式形式,从而把 U-Net/CNN 等归纳偏置转化为可分析的局部、多尺度耦合。MNIST 实验显示,高阶矩特征提升重建,局部邻域耦合稳定降低 MSE;跨方向 band-tying 可让边缘更锐但高噪声下可能损害 MSE,增益更像来自局部相关与多尺度结构。

HACK++: Towards More Effective Head-Aware Key-Value Compression for Efficient Visual Autoregressive Modeling Figure 1
2026-06-09cs.CV

HACK++: Towards More Effective Head-Aware Key-Value Compression for Efficient Visual Autoregressive Modeling

Ziran Qin, Yuchen Jiang, Mingbao Lin, Youru Lv, Hang Guo, Wen Fei, Weiyao Lin

Ziran Qin, Yuchen Jiang, Youru Lv, Fei Wen, and Weiyao Lin are with Shanghai Jiao Tong University, Shanghai, China

2026-06-09视觉感知

VAR 视觉自回归模型按尺度生成虽减少解码步数,但历史尺度 KV cache 持续累积,带来注意力计算和显存瓶颈。HACK++ 的关键洞察是注意力头可分为维持语义的 contextual heads 与保持空间结构的 structural heads,且二者对历史尺度依赖随层和生成步变化;方法通过离线校准、头感知 token 选择、注意力与 cache 解耦预算及自适应分配实现训练-free 压缩。实验显示其在多类 VAR 任务中可在较低注意力和 cache 预算下保持近无损质量,并降低显存与推理开销。

G2G: Exploiting Intra-Group Geometry for Inter-Group Pose Estimation Figure 1
2026-06-09cs.CV

G2G: Exploiting Intra-Group Geometry for Inter-Group Pose Estimation

Yufei Wei, Shuhao Ye, Chenxiao Hu, Yiyuan Pan, Dongyu Feng, Rong Xiong, Yue Wang, Yanmei Jiao

State Key Laboratory of Industrial Control and Technology, Zhejiang University, Hangzhou, China, Zhejiang Humanoid Robot Innovation Center Co., Ltd., Ningbo, China, School of Information Science and Engineering, Hangzhou Normal University, Hangzhou, China

2026-06-09三维

论文针对跨序列重定位与多相机 rig 里程计都需估计两组图像间 6DoF 位姿、但现有多视图模型忽略组内几何的问题,提出 G2G:冻结多视图基础模型,用重采样器、跨组自注意力桥和多帧位姿头补足跨组推理,仅以相对位姿监督训练约 32M 参数。在四个仿真、真实跨季节和 sim-to-real 数据集上取得最佳非 oracle 精度,优势在外观变化和真实 rig 场景更明显。

Remember with Confidence: Uncertainty Quantification for Spatio-temporal Memory with Probabilistic Guarantees Figure 1
2026-06-09cs.CV

Remember with Confidence: Uncertainty Quantification for Spatio-temporal Memory with Probabilistic Guarantees

Harry Zhang, Nicolas Gorlo, Luca Carlone

2026-06-09安全鲁棒

面向长时程机器人操作,论文指出现有4D场景图/检索记忆常把VLM描述当作可靠事实,难以发现视角差异导致的错误语义。作者提出UQ-DAAAM,用跨视角caption嵌入散布量化对象级语义不确定性,并在固定查询预算下优先补采高质量视角、融合多视角描述,同时给出视角质量降低不确定性的概率保证。OC-NaVQA实验显示其相比基线获得更大不确定性下降,并提升时空问答表现。

TIDE: Task-Isolated Diffusion for Unified Video Editing and Generation Figure 1
2026-06-09cs.CV

TIDE: Task-Isolated Diffusion for Unified Video Editing and Generation

Qi Liu, Gang Yue, Mingyu Yin, Lisai Zhang, Yidi Wu, Yaole Wang, Yaohui Wang, Chang Yao, Jingyuan Chen, Lin Ma

Zhejiang University, Bilibili Inc., is available at https://LittleWork123.github.io/tide.

2026-06-09视觉感知生成模型

视频生成、指令编辑和参考驱动编辑长期依赖不同专用模型,统一建模时又容易混淆目标、源视频与多参考图像的角色。TIDE将这些任务归为条件去噪问题,用逐 token 任务嵌入显式隔离不同条件,并结合 VLM 语义路径与 VAE latent 细节路径,再以渐进多任务训练缓解任务冲突。实验显示其在 OpenVE-Bench、OpenS2V 及新建 TIDE-Bench 上达到或超过现有方法。

MS-COOT: Comparing Morse-Smale Complexes with Co-Optimal Transport Figure 1
2026-06-09cs.GR

MS-COOT: Comparing Morse-Smale Complexes with Co-Optimal Transport

Guangyu Meng, Mingzhe Li, Erin Wolf Chambers

revealing all regions individually, labeled S1–S9 and T1–T5. (c) Row-normalized region coupling ξ for t=51→52: each bar shows how a, • All authors are with the Department of Computer Science and Engineering, University of Notre Dame, Notre Dame, Indiana, United States. E-mail:

2026-06-09视觉感知

针对现有 Morse-Smale 复形比较多只匹配临界点、忽略区域结构的问题,论文将临界点与区域分别建模为超图节点和超边,提出 MS-COOT 用协同最优传输同时求临界点耦合与区域耦合,从而识别区域合并、分裂等事件。五类 2D/3D 标量场实验显示,它比 WD/GWD/FGW 更能区分结构变化、仿真分辨率与形状类别,但全局最优性、计算开销和简化阈值稳定性仍未充分解决。

Light-WAM: Efficient World Action Models with State-Fusion Action Decoding Figure 1
2026-06-09cs.CV

Light-WAM: Efficient World Action Models with State-Fusion Action Decoding

Ziang Li, Dongzhou Cheng, Yibin Wang, Shiyue Wang, Xiaoyang Xu, Lingxuan Weng, Juan Wang, Jiaqi Wang

Wuhan University, Shanghai Innovation Institute, Southeast University, Fudan University, East China Normal University

2026-06-09强化学习

针对现有世界动作模型依赖大规模生成式视频/动作架构、训练和闭环推理开销高的问题,Light-WAM将未来视频预测保留为训练期表征监督,但在下采样潜空间中执行,并用冻结紧凑视频骨干加轻量适配;其StateFusionActionExpert从多层状态做学习查询池化,单次前向直接预测动作块。实验中以0.44B可训练参数在LIBERO达97.2%成功率、RoboTwin 2.0达76.4%,相较Fast-WAM吞吐提升4.25倍,推理72.03ms/4.1GiB。

When No Answer Is Correct: Diagnosing Absent Answer Detection for MLLMs in Video Understanding Figure 1
2026-06-09cs.AI

When No Answer Is Correct: Diagnosing Absent Answer Detection for MLLMs in Video Understanding

Yiheng Wang, Yueqian Lin, Lichen Zhu, Yudong Liu, Hai "Helen" Li, Yiran Chen

Duke University, Durham, North Carolina, USA

2026-06-09视觉感知

本文关注视频理解 MLLM 在“正确答案不在候选项中”时是否仍会被迫选择的问题,以移除真值答案构造 absent answer detection,并在带 NOTA、多轮开放生成和无提示三种设置下诊断模型可靠性。结果显示,多数模型即使基准准确率较高,也倾向选择看似合理的干扰项;时间推理任务更差,增加帧采样反而降低检测率。CoT 可部分改善逐项核验,但仍不足,说明仅靠提示难以解决该失效模式。

Test-Time Scaling in Multimodal Foundation Models: A Comprehensive Survey of Generation and Reasoning Figure 1
2026-06-09cs.CV

Test-Time Scaling in Multimodal Foundation Models: A Comprehensive Survey of Generation and Reasoning

Cong Wan, Ying He, Zhongzhan Huang, Hefeng Wu

Sun Yat-sen University

2026-06-09视觉语言

针对多模态基础模型继续依赖预训练扩展收益递减、推理阶段算力如何有效利用缺少统一框架的问题,本文系统梳理测试时扩展(TTS)在视觉语言生成与推理中的进展,将方法归纳为采样、反馈和搜索三类,并对应MLLM与扩散模型场景整理应用与基准。主要结果是给出领域首个较完整分类图谱和未来问题清单;作为综述,文中未报告统一实验增益。

SegmentAnyTreeV2: Scaling Transformer-Based Tree Instance Segmentation Across Sensors, Platforms, and Forests Figure 1
2026-06-09cs.CV

SegmentAnyTreeV2: Scaling Transformer-Based Tree Instance Segmentation Across Sensors, Platforms, and Forests

Maciej Wielgosz, Stefano Puliti, Rasmus Astrup

aNorwegian Institute of Bioeconomy Research (NIBIO), Høgskoleveien 7, 1433 Ås, Norway, available benchmark datasets (Puliti et al., 2023, Nevertheless, most publicly available datasets remain biased, • Scalable plot-level inference.

2026-06-09视觉感知

针对现有森林点云分割在复杂阔叶/热带林、密集冠层和跨传感器场景中泛化不足的问题,论文提出 SegmentAnyTreeV2:用 PTv3 序列化 Transformer 骨干替代稀疏卷积,并将语义头与树实例解码解耦,只在树类体素上做交叉注意力,结合实例感知查询初始化和非对称掩码评分;同时扩展 FOR-instanceV3 数据集。实验在 FOR-instanceV2 上达到 85.0% F1、90.7% coverage 和 87.6% mIoU,优于既有学习方法,并展示一定零样本跨域能力。

Empowering Feed-Forward Reconstruction Models with Metric Scale via Satellite Images Figure 1
2026-06-09cs.CV

Empowering Feed-Forward Reconstruction Models with Metric Scale via Satellite Images

Xianghui Ze, Yongjian Luo, Mengjun Chao, Zhenbo Song, Jianfeng Lu, Yujiao Shi

Nanjing University of Science and Technology, 2ShanghaiTech University, feed-forward 3D reconstruction. The key idea is to use readily available satellite imagery as, controlled settings, accurate camera parameters are often unavailable or unreliable in practice., leveraging satellite imagery as an external reference. Satellite images are widely available and, GPS measurements are not always available or reliable in real-world scenarios [14]. We relax

2026-06-09视觉感知三维

前馈三维重建虽泛化强,但通常只有相对尺度,难以用于自动驾驶等需要米制几何的场景。本文的关键洞察是把粗 GPS 检索到的卫星图作为全局尺度参照,通过地面视角与卫星视角的双向交互和场景到卫星对齐损失,同时恢复绝对尺度、优化几何并估计相机位姿。在 KITTI、nuScenes 和 Oxford RobotCar 上,方法在米制深度、多视角点云重建和跨视角定位上均取得一致提升。

Neural Field Tokenizations with Hierarchy and Spatial Locality Priors Figure 1
2026-06-09cs.LG

Neural Field Tokenizations with Hierarchy and Spatial Locality Priors

Alonso Urbano, David W. Romero, Max Zimmer, Sebastian Pokutta

Department for AI in Society, Science, and Technology, Zuse Institute Berlin (ZIB), Germany, Institute of Mathematics, Technische Universität Berlin, Germany, scalability bottleneck of training with per-sample optimization., limits the scalability of existing modality-agnostic neural field methods., • We identify a tradeoff between scalability, structural priors and modality-agnosticism in neural

2026-06-09视觉感知

论文针对通用神经场表示依赖逐样本元学习、显存高且难以扩展,而前馈编码又常引入模态假设的问题,提出 LH-NeF:用保持空间局部性的层级分组注意力将坐标-取值观测编码为结构化 token,并通过高斯软路由与跨注意力渲染任意坐标。实验显示其在图像、3D 形状和气候场的重建及生成、分类、预测任务上达到或接近最优,同时较 ENF 显存降约 42×、批量增 133×。

How Much MRI Preprocessing Is Enough? A Cost-Utility Study for Brain MRI Foundation Models Figure 1
2026-06-09cs.CV

How Much MRI Preprocessing Is Enough? A Cost-Utility Study for Brain MRI Foundation Models

Jiangshuan Pang, Wangyang Tang, Jing Yan, Zhixuan Cheng, Youzhe He, Zhenkun Zhuang, Tao Zhou, Shiping Liu

School of Artificial Intelligence, University of the Chinese Academy of Sciences, Beijing 101408, China, Key Laboratory of Spatial Omics of Zhejiang Province, BGI Research, Hangzhou 310030, China, Key Laboratory of Brain Cell Mapping of Zhejiang Province, BGI Research, Hangzhou 310030, China, escalation pipeline. Code is available at https://github.com/PangJiangShuan/PreBrain., Multi-center, multi-modal MRI data

2026-06-09视觉感知

这篇论文针对脑 MRI 基础模型中“预处理是否越多越好”的常见假设,将预处理从例行清洗重新定义为带计算成本的建模选择。作者在同一 2 万例 3D MRI、3D ViT、MAE/JEPA 和下游任务设置下系统比较 P0–P7 流水线,发现 P0/P1 不稳定,P2 是最低可行基线;继续加强预处理的总体收益很小,MAE 仅增 3.4 个百分点、JEPA 仅增 1.8 个百分点,且收益主要依赖任务,MCI 最明显,而 AGE、肿瘤分割常接近或优于 P2。

RAPID: Layer-Wise Redundancy-Aware Pruning and Importance-Driven Token Merging for Efficient ViT Figure 1
2026-06-09cs.CV

RAPID: Layer-Wise Redundancy-Aware Pruning and Importance-Driven Token Merging for Efficient ViT

Kyumin Choi, Ikbeom Jang

Hankuk University of Foreign Studies, evolution. Code is available at https://github.com/labhai/RAPID.

2026-06-09视觉感知

ViT 自注意力计算随 token 数二次增长,现有剪枝/合并常忽略不同深度表征差异。RAPID 的核心洞察是浅中层更适合按冗余与相似性剪掉重复局部模式,深层则用 CLS 注意力保护重要语义 token,并合并低重要但相似的邻居。ImageNet-1K 上在 ViT/DeiT 中相较 ToMe、ToFu 保持更好精度-压缩折中,极端压缩下最高比 ToMe 高 4.29% 准确率。

Property-Informed Diffusion-Based Text-to-Microstructure Generation Figure 1
2026-06-09cs.CV

Property-Informed Diffusion-Based Text-to-Microstructure Generation

Bingxuan Dai, Hongsong Wang, Jie Gui

School of Cyber Science and Engineering, Southeast University, Nanjing 210096, China, School of Computer Science and Engineering, Southeast University, Nanjing 210096, China, Key Laboratory of New Generation Artificial Intelligence Technology and Its Interdisciplinary, Applications (Southeast University), Ministry of Education, China, Purple Mountain Laboratories, Nanjing 210000, China, Engineering Research Center of Blockchain Application, Supervision And Management, (Southeast University), Ministry of Education, China

2026-06-09生成模型

面向超材料 3D 微结构逆向设计中依赖专家条件、迭代仿真且生成多样性和物理可行性不足的问题,本文提出 PropDiff-TMG,用自条件扩散模型从文本生成体素微结构,并通过物性随机注入、FiLM 调制、文本-结构对比对齐及测试时奖励引导局部编辑增强语义与力学一致性。实验表明其能在多类材料上生成语义相关且物理上较合理的结构,但具体相对增益幅度文中片段未充分说明。

IMAGINE: Adaptive Schema-Imagery Enhanced Composition for Composed Video Retrieval Figure 1
2026-06-09cs.CV

IMAGINE: Adaptive Schema-Imagery Enhanced Composition for Composed Video Retrieval

Jiale Huang, Zixu Li, Zhiwei Chen, Zhiheng Fu, Chunxiao Wang, Yupeng Hu

Shandong University, Qilu University of Technology, (Shandong Academy of Sciences), construct a scalable semantic memory to materialize the im-, et al. [65] introduced a multi-expert collaborative network. Simi-, multi-agent collaboration mechanisms [82–87], aiming to achieve

2026-06-09视觉感知三维

论文针对组合视频检索中“修改文本所指语义未必直接出现在画面里”的问题,指出仅做显式对象对齐会漏掉如蛋糕到生日派对这类隐含联想。IMAGINE用动态多模态原型构建“图式意象”语义记忆,并通过置信度调制把隐式语义自适应注入视频-文本组合与双空间对齐。实验称其在三个CVR/CIR基准上达到SOTA,但具体增益来源与数据/模型规模关系仍需进一步核查。

Gravity-guided Contact Dynamics Estimation from 3D Human Motions Figure 1
2026-06-09cs.CV

Gravity-guided Contact Dynamics Estimation from 3D Human Motions

Cuong Le, Urs Waldmann, Bastian Wandt, Mårten Wadenbäck

Linköping University, scalable solution is to estimate the dynamics directly from motion cap-, gravity. We use the human’s center of gravity to estimate the ground con-, abilities and the total exterior force computed from the center of mass, contact dynamics are collected from sensor devices in laboratory environments, i.e. force plates for ground reaction force and center of pressure measurements., This laboratory setting restricts biomechanics research to simple motions per-, on the root or the center of mass of the human body [2,23]. The total exterior, arrow). The gravity-guided model imposes the influence of the center of gravity (CoG), total contact reaction force that could reconstruct the center of mass (CoM), based on the center of gravity (CoG) for more accurate dynamics estimation

2026-06-09三维

本文针对力板/压力垫采集接触动力学受限、仅按离地高度估计又难区分多接触受力的问题,提出 GraCE:利用人体质心/重心相对各 SMPL+H 顶点的距离来调制接触概率,并用由质心轨迹和牛顿力学估计的总外力分配到全身顶点。实验在 GroundLink 的地面反作用力和 MOYO 的压力预测上优于重实现基线,文中报告接触估计精度约提升 36%。

Phase Marginalization for Patch-Grid Instability in Vision Transformers Figure 1
2026-06-09cs.CV

Phase Marginalization for Patch-Grid Instability in Vision Transformers

Oğuzhan Ercan

patch partition can change the token evidence available to a pixel, es-, Dense prediction tasks require coordinate-stable outputs: a pixel-level label should, evidence available to the dense prediction head.

2026-06-09视觉感知

论文针对 ViT 固定非重叠 patch 网格在密集预测中引入的相位不稳定:网格起点微移会改变边界像素可见的 token 证据。作者将 patch-grid phase 形式化为 nuisance variable,提出无需训练的 Phase Marginalization,在多个结构化相位下前向、反向对齐并平均 logits。实验显示 K=4 在分割、深度和局部匹配上优于 K=1,并在 Cityscapes 同等四次前向预算下较 shift-TTA 提升约 0.31 mIoU;K=8/16 收益趋缓,代价上升。

One Stone, Three Birds: Self-adaptive Optimal Transport for Multi-VLM Selection, Adaptation, and Ensembling Figure 1
2026-06-09cs.CV

One Stone, Three Birds: Self-adaptive Optimal Transport for Multi-VLM Selection, Adaptation, and Ensembling

Qiyu Xu, Zhanxuan Hu, Yu Duan, Yonghang Tai, Huafeng Li, Quanxue Gao, Xiangyong Cao

attractive when target annotations are scarce or unavailable., and then adapt that model to the unlabeled target set. This single-, labels are available to identify the reliable ones. Deployment, are available at https://github.com/Afleve/OSTB., specified without training a supervised classifier for each label, Qiyu Xu and Xiangyong Cao are with the School of Computer Science and, Technology and the Ministry of Education Key Lab for Intelligent Networks, and Network Security, Xi’an Jiaotong University, Xi’an, Shaanxi 710049, Zhanxuan Hu and Yonghang Tai are with the School of Information Science, and Technology, Yunnan Normal University, Chenggong, Kunming, Yunnan, Yu Duan and Quanxue Gao are with the School of Telecommunica-, tions Engineering, Xidian University, Xi’an 710071, China (e-mail: du-

2026-06-09视觉语言

论文针对多种通用与领域 VLM 在无标注目标集上可靠性差异大、先选单模型再适配易失效的问题,提出训练自由的 OSTB:用自适应最优传输估计共享样本-类别结构,并同时服务于模型排序、传输条件视觉分类器适配和可靠性加权集成。实验覆盖自然图像、遥感和病理数据集,显示其提升模型排名准确性、适配稳定性与集成鲁棒性。

Human-Centered Benchmarking of Driver Monitoring Models Figure 1
2026-06-09cs.CV

Human-Centered Benchmarking of Driver Monitoring Models

Ruben Dario Florez-Zela

2026-06-09数据集/基准

针对驾驶员监控模型常以干净集准确率作比较、难以反映车载安全部署需求的问题,论文提出 HCBF,从准确性、可解释性、效率和鲁棒性联合评测轻量 CNN 与 DeiT-Tiny。实验显示四类模型准确率接近且各占一维优势,均在 Pareto 前沿;ShuffleNetV2 在综合 HCS 中持续第一,但在传感器噪声下性能跌至不足一半并易把闭眼判为睁眼,而 DeiT-Tiny 更稳健,说明单一或加权总分会掩盖关键失效风险。

Trustworthy Visual Predicates for Robust Manipulation Understanding under Degradation Figure 1
2026-06-09cs.CV

Trustworthy Visual Predicates for Robust Manipulation Understanding under Degradation

Fatemeh Ziaeetabar

Department of Computer Science, School of Mathematics, Statistics, and Computer Science, College of Science, University of Tehran, vision. In applications such as assistive robotics, human–robot collaboration, indus-, therefore requires more than assigning a single label to a video clip. It requires infer-, labels, but they provide the perceptual evidence from which actions are interpreted.

2026-06-09机器人安全鲁棒

机器人操作理解常只看最终动作准确率,难以定位模糊、遮挡、掉帧等退化下的关系证据失效。本文提出谓词级可靠性框架,围绕接触、支撑、包含、抓取/释放等视觉谓词建模置信度、时序一致性和下游影响。实验显示失效并非均匀:静态空间谓词较稳,接触和动态派生谓词更脆弱;严重退化下检测噪声、遮挡和掉帧损失最大,动作理解准确率由0.89降至0.58,置信度加权也带来明显缓解。

Revisiting Articulated Parts Perception in Robot Manipulation Figure 1
2026-06-09cs.RO

Revisiting Articulated Parts Perception in Robot Manipulation

Xiaoqian Wu, Yejie Guo, Xiaoyang Chen, Lixin Yang, Cewu Lu, Yong-Lu Li

Shanghai Jiao Tong University

2026-06-09机器人

针对铰接物体在机器人操作中难以从单帧 RGB-D 稳健感知的问题,论文提出 GPS 几何主结构,用显式运动轴与手部代理点替代高成本位姿标注和噪声较大的点流监督,并配合 VR 在约一分钟内标注序列。作者据此采集 234 个物体、41K 帧数据训练通用预测模型;真实机器人无需域内微调,在 9 个物体 270 个初始状态上达到 73% 成功率。

VideoWeaver: Evaluating and Evolving Skills for Agentic Long Video Generation Figure 1
2026-06-09cs.CV

VideoWeaver: Evaluating and Evolving Skills for Agentic Long Video Generation

Jianhui Wei, Jie Tan, Hengchuan Zhu, Xiaotian Zhang, Yan Zhang, Ziyi Chen, Daoan Zhang, Wei Xu, Zuozhu Liu

Zhejiang University, rics. Code and dataset is available at https:, models themselves as callable tools. Such agentic

2026-06-09视觉感知

论文关注通用智能体框架能否胜任长视频生成这一长程多模态编排任务,而非依赖人工固定流水线。VideoWeaver将其定义为技能组合与演化问题,构建16类285例基准,并用可检查执行轨迹、中间文件和最终视频的agent-as-judge给出过程与结果评分,再以反馈优化组合/创作技能。实验显示显式组合技能优于仅调用基础技能,技能演化进一步提升质量且可泛化,自动评审尤其在过程指标上与人工较一致。

Robust-U1: Can MLLMs Self-Recover Corrupted Visual Content for Robust Understanding? Figure 1
2026-06-09cs.CV

Robust-U1: Can MLLMs Self-Recover Corrupted Visual Content for Robust Understanding?

Jiaqi Tang, Jianmin Chen, Youyang Zhai, Wei Wei, Runtao Liu, Mengjie Zhao, Xiangyu Wu, Qingfa Xiao, Qifeng Chen

2026-06-09安全鲁棒

该文针对多模态大模型在噪声、压缩、恶劣天气等真实视觉损坏下理解能力显著下降的问题,提出 Robust-U1:不再只做特征对齐或文本解释,而是让模型先自恢复受损图像,再结合原图与恢复图进行推理。方法用监督微调获得重建能力,并以 SSIM 与 CLIP 相似度双奖励强化像素和语义保真。实验称其在 R-Bench 及多种 VQA 对抗损坏设置下达到更强鲁棒性,且恢复质量与推理增益相关。

OSMGraphCLIP: Learning Global Location Representations from OpenStreetMap Graphs Figure 1
2026-06-09cs.AI

OSMGraphCLIP: Learning Global Location Representations from OpenStreetMap Graphs

Dimitrios Michail, Eleni Saka, Ioannis Giannopoulos, Ioannis Papoutsis

National Technical University of Athens, Athens, Greece., Vienna University of Technology, Vienna, Austria., learns global location embeddings from freely available OpenStreetMap (OSM) data., Satellite imagery is a natural context modality: it is globally available and densely en-, Geographic Information (VGI), OSM is a freely available, collaboratively curated global

2026-06-09视觉感知

论文针对全球位置表征过度依赖卫星/街景影像、较少利用 OSM 结构化语义的问题,提出 OSMGraphCLIP:将道路、建筑、用地和 POI 构成异构图,用空间拓扑关系与多尺度图编码器监督坐标位置编码器。实验在 24 个地理下游任务上显示,仅用 OSM 图即可多数情况下匹配或超过卫星基线,尤其在社会经济与公共健康预测中更强,说明显式人类活动语义是关键增益来源。

OmniFaceRig: Fully Automatic Inner-Mouth-Aware Face Rigging Across Diverse 3D Character Topologies Figure 1
2026-06-09cs.GR

OmniFaceRig: Fully Automatic Inner-Mouth-Aware Face Rigging Across Diverse 3D Character Topologies

Chao Wang, Guangyao Ma, John Doublestein, Junming Chen, Yiming Lin, Zhaoen Su, Xiaomin Luo, Shiyang Cheng, Jie Shen, Doug Roble, Dilin Wang, Yilei Li, Rakesh Ranjan

Reality Labs, Meta, category-specific tuning. We also publicly release Omni-Bench, a freely available benchmark dataset, D character animation—remains one of the most labor-intensive steps in the character production pipeline., (e.g., cats, bears, rabbits, tigers). These animal labels describe coarse facial topology for template selec-

2026-06-09三维

面部绑定仍依赖人工标注、模板调参和口腔建模,尤其难覆盖动物等非人拓扑。OmniFaceRig提出从仅有表面网格到动画就绪FACS绑定的全自动流程,结合VLM/CV可绑定性检测、多模型人脸解析、关键点模板配准、程序化牙龈舌生成与碰撞感知变形迁移,并按拓扑选择模板。实验在筛选后的Omni-Bench上显示较高绑定成功率、近完整人脸检测召回、低口腔穿透,单A100约20–30秒处理一个资产。

Wispy to Voluminous: Prior-free Multi-view Capture of Strand-level Facial Hair Figure 1
2026-06-09cs.GR

Wispy to Voluminous: Prior-free Multi-view Capture of Strand-level Facial Hair

Jaeseong Lee, Giljoo Nam, Adrian Jarabo, Carlos Aliaga

2026-06-09视觉感知

该文针对数字人中胡须、眉毛、睫毛等面部毛发常被体积场烘焙进人脸、难以编辑且稀疏结构难恢复的问题,提出无先验多视角流程:先用头部几何约束3DGS抑制皮下噪声,再进行跨交叉的欧拉追踪、根部落到面部网格与光度细化。结果生成显式曲线级毛发资产,能保留方向与稀疏分布,并可直接用于动画、修剪、迁移、编辑和物理渲染;局限是浓密胡须内部受可见性与光度歧义影响仍可能缺失。

DyCo-RL: Dynamic Cross-Modal Coordination for Visual Reasoning Figure 1
2026-06-09cs.CV

DyCo-RL: Dynamic Cross-Modal Coordination for Visual Reasoning

Hangui Lin, Yan Shu, Zhengyang Liang, Chi Liu, Xiangrui Liu, Minghao Qin, Teng Long, Zheng Liu, Nicu Sebe

University of Trento, Singapore Management University, spanning visual-centric and mathematical reasoning. Our repository is available at

2026-06-09强化学习

本文针对多模态大模型在视觉 CoT 推理中只优化最终可验证奖励、忽视生成过程中视觉证据提取与文本逻辑锚定动态切换的问题,指出错误常与 token 级跨模态注意力失配相关。DyCo-RL 用 Fisher–Rao 注意力距离判定 token 的视觉/文本功能角色,并按角色—注意力对齐度重加权优势信号。实验在 Qwen2.5-VL-3B/7B 上为 GRPO、DAPO、SAPO、GSPO 在七个视觉与数学推理基准带来一致提升。

Sci-Rho: A Multilingual Visually-Grounded Symbolic Benchmark for STEM Problems Figure 1
2026-06-09cs.CV

Sci-Rho: A Multilingual Visually-Grounded Symbolic Benchmark for STEM Problems

Muhammad Falensi Azmi, Ikhlasul Akmal Hanif, Vallerie Alexandra Putra, Adi Yeltay, Abdullah Mubarak, Fajri Koto

§Binus University, ¶Bandung Institute of Technology, and Computer Science at the high school and pre-university level, with each problem implemented as

2026-06-09数据集/基准

现有视觉 STEM 评测多为英文静态题,难以区分模型是真正视觉推理还是记住表面模式。Sci-ρ 用专家编写的 Python 符号模板,在五个学科、七种语言中生成含图像扰动、推理步骤和答案的 42,420 个实例。对 17 个 VLM 的测试显示,平均准确率与最坏情形准确率差距明显,小模型跨语言退化更显著,步骤级 F1 和注意力分析也表明静态基准会高估鲁棒性。

Balancing Real and Synthetic Data for CNN-based Masonry Crack Detection Figure 1
2026-06-09cs.CV

Balancing Real and Synthetic Data for CNN-based Masonry Crack Detection

Mattia Forlesi, Alfonso Esposito, Ivan Zyrianoff, Alessandro Marzani, Marco Di Felice

Department of Computer Science and Engineering, University of Bologna, Bologna, Department of Civil, Chemical, Environmental, and Materials Engineering, University of Bologna, Bologna, Italy, (CNNs), have enabled scalable solutions for automated crack detection., However, CNN performance strongly depends on the availability of large, while publicly available datasets may not be adequate. To address this, The overall diffusion of DL techniques has led to feasible and scalable solu-, ten time-consuming, while the datasets available online could be unsatisfactory, for data collection and labeling, while overall enhancing the performance metrics, – The real dataset was totally collected and labeled by our team. In particular

2026-06-09视觉感知

面向砌体表面裂缝检测中真实数据采集与标注成本高、公开数据适配性差的问题,本文用可控裂缝叠加工具在真实墙面背景上生成合成样本,并系统考察真实/合成数据配比对 U-Net/CNN 分割的影响。实验在真实测试集上表明,合成数据加入少量真实数据即可接近纯真实训练;最佳配比报告达到 F1 76%、mIoU 80%,且优于纯真实基线,但具体增益来源可能主要来自数据规模与分布互补。

Vision-Language Asymmetry in Bistable Image Captioning Figure 1
2026-06-09cs.CV

Vision-Language Asymmetry in Bistable Image Captioning

Arohan Agate

uli with both per-aspect feature pools available, University of Washington. Correspondence to: Arohan Agate, per stimulus per α. Success is the fraction Qwen3 labels as

2026-06-09视觉语言视觉感知

本文追问视觉语言模型在描述鸭兔、奈克方块等双稳态图像时,究竟在哪一层从“看到”转为“看作某物”。作者在 LLaVA 上结合提示行为测试、CLIP 消费层 TopK SAE 特征池与因果 steering,发现 72% 图像在视觉塔同时激活两种解释,但语言输出会单边承诺;部分默认主导样本可被翻转,年轻/老妇等平衡样本却不能,说明主导瓶颈主要位于视觉塔之后的语言侧。

IEA: Amateur-Friendly Conversational Image Editing Agent via Three Stages of Multitask Alignment Figure 1
2026-06-09cs.CV

IEA: Amateur-Friendly Conversational Image Editing Agent via Three Stages of Multitask Alignment

Zichen Zhu, Yuheng Sun, Mingxuan Zhu, Wenjie Ma, Situo Zhang, Zhexiang Wang, Ziyue Yang, Danyang Zhang, Kunyao Lan, Zihan Zhao, Dingye Liu, Siqi Xiang, Lu Chen, Kai Yu

X-LANCE Lab, School of Computer Science, Shanghai Jiao Tong University, Huawei Technologies Ltd., Nanyang Technological University, Jiangsu Key Lab of Language Computing

2026-06-09视觉感知

针对业余用户难以用专业软件表达细粒度修图意图、生成式编辑又易引入伪影且缺乏可解释性的痛点,IEA 将 VLM 约束在 16 个参数化工具的显式动作空间中,并通过专家编辑蒸馏 SFT、带工具有效性与相似度奖励的 GRPO、以及大规模合成数据对编辑、意图总结和反馈细化进行三阶段多任务对齐。实验中其在参考编辑像素距离和意图总结 ROUGE-L 上优于基线,用户研究也显示其在工具调用方法中指令跟随最好,并在整体感知质量上超过生成式方法。

GVC-Seg: Training-Free 3D Instance Segmentation via Geometric Visual Correspondence Figure 1
2026-06-09cs.CV

GVC-Seg: Training-Free 3D Instance Segmentation via Geometric Visual Correspondence

Liang Xu, Fangjing Wang, Jinyu Yang, Feng Zheng

2026-06-09视觉感知三维

针对训练-free 3D实例分割在融合多种2D/3D预训练模型提案时容易偏向高置信但低质量掩码的问题,GVC-Seg利用3D几何线索与2D视觉先验的一致性重新评估提案置信度,并结合3D提案生成与mask-aware CLIP语义推理实现无训练集成。实验在ScanNet200、ScanNet++和Replica上达到SOTA,且开放词汇场景提升明显。

Aqua Boundary-Saliency Attention Module for Lightweight Underwater Salient Instance Segmentation Detection Transformer Figure 1
2026-06-09cs.CV

Aqua Boundary-Saliency Attention Module for Lightweight Underwater Salient Instance Segmentation Detection Transformer

M. Fazri Nizar, Julian Supardi, Muhammad Naufal Rachmatullah

Department of Informatics Engineering, Universitas Sriwijaya, Indonesia, ary, contrast, attenuation, chroma, dark-channel, and center-, chroma, dark-channel, and center cues while preserving, provides foreground salient instance labels and therefore, center prior. A shallow convolutional cue encoder ϕ maps C

2026-06-09视觉感知学习理论

面向水下机器人感知中实例分割既要高质量掩码又要低延迟部署的矛盾,论文提出轻量级 LUSIS-DETR,在 DINOv2 初始化的 DETR 掩码预测器中加入 AquaBSAM,用边界、对比度、衰减、色度、暗通道与中心先验对多尺度特征做有界残差调制,且训练辅助项不进入推理。四个水下数据集上其精度接近或超过重型 SAM/伪深度方法,USIS10K、USIS16K 增益较明显,T4 TensorRT FP16 延迟约 4.31–6.34 ms。

Learning a Semantic Calibration Network for Open-Vocabulary Semantic Segmentation Figure 1
2026-06-09cs.CV

Learning a Semantic Calibration Network for Open-Vocabulary Semantic Segmentation

Yang Sun, Tao Wang, Anastasia Ioannou, Ge Xu

2026-06-09视觉感知

这篇工作针对开放词汇语义分割中 CLIP 偏全局语义、掩码分类阶段易出现类别混淆的问题,提出 Semantic Calibration Network,将文本嵌入经跨注意力转为视觉感知伪文本,并用类别消歧模块建模类间依赖、Logits Fusion 动态融合原始与校准相似度。实验称在 ADE20K 和 PASCAL-Context 等基准上超过现有方法,主要增益来自对 mask-text 分类语义的显式校准。

FMRFusion: Frequency-Aware Multi-View Representation Learning for Heterogeneous Image Fusion Figure 1
2026-06-09cs.CV

FMRFusion: Frequency-Aware Multi-View Representation Learning for Heterogeneous Image Fusion

Tao Zhoua, Yunlong Liu, Qinghui Chen, Zekai Zhang, Minlong Sun, Changlin Biana, Dagang Li, Wenmin Wang, Jinglin Zhang

aControl Science and Engineering, Shandong University, Jinan, 250061, China, bKey Laboratory of Machine Intelligence and System Control, Ministry of Education, Jinan, 250061, China, cSchool of Computer Science and Engineering, Macau University of Science and Technology, Macau, 999078, China, dKey Laboratory of Industrial Intelligent Systems, Jinan, 250061, China

2026-06-09视觉感知

针对红外-可见光融合中单路径编码易丢失模态特性、CNN/Transformer难兼顾细节与全局上下文的问题,FMRFusion采用双分支CNN-Transformer结构,并以频率解耦区分低频共享结构和高频模态细节,再通过跨视图互补交互与Flow Matching逐步精炼融合特征。多基准实验显示其在红外-可见光、医学和多焦点融合上表现更稳定,夜间场景优势更明显。

DisCo: World Models with Discrete Camera Motion Control Figure 1
2026-06-09cs.CV

DisCo: World Models with Discrete Camera Motion Control

Hongrui Huang, Junke Wang, Quanhao Li, Yu-Gang Jiang, Zuxuan Wu

2026-06-09强化学习规划控制

DisCo针对可控视频世界模型在复杂相机动作下跟随不稳的问题,指出连续相机轨迹会造成不同运动模式的条件特征纠缠,进而削弱控制性。方法将相机运动量化为紧凑的离散动作原语,并在Wan 2.2上微调、蒸馏为支持长时生成的因果模型。其提出DisCoBench评测短期、长程和动态场景,动作跟随分数达0.633,高于Matrix-Game2的0.588,同时保持视觉质量。

ChronoPhyBench: Do MLLMs Truly Understand the World or Merely Exploit Language Priors? Figure 1
2026-06-09cs.CV

ChronoPhyBench: Do MLLMs Truly Understand the World or Merely Exploit Language Priors?

Bin Zhu, Yanhao Jia, Kexin Zhao, Jie Wang, Munan Ning, Hao Li, Yuwei Niu, Tanqing Sun, Huangchong Yan, Mingjun Pan, Xinyi Wu, Qishen Yin, Yunyang Ge, Shuai Zhao, Li Yuan

Peking University, Shenzhen Graduate School, 2Peng Cheng Laboratory 3 Rabbitpre Intelligence, Nanyang Technological University 5Tsinghua University

2026-06-09强化学习

这篇论文针对多模态大模型在物理推理中可能依赖语言先验而非视觉证据的问题,提出 ChronoPhyBench,用历史视频与文本条件下的下一状态帧选择和多帧时序排序来压制捷径推断,并构建万级长视频标注数据。实验显示,开源模型的视觉物理推理仍很弱,部分闭源强模型在视觉缺失或受扰时仍能凭语言猜中答案,暴露明显模态偏置与幻觉风险。

Feasibility to detect rapid change and disappearance of seagrass: Lessons from nearly 80 years of vegetation change in the Ako, Seto Inland Sea, Japan Figure 1
2026-06-09q-bio.PE

Feasibility to detect rapid change and disappearance of seagrass: Lessons from nearly 80 years of vegetation change in the Ako, Seto Inland Sea, Japan

Takehisa Yamakita, Yoji Igarashi, Akira Eto, Ken Ishida, Masaaki Iiyama

Japan Agency for Marine-Earth Science and Technology (JAMSTEC), Application Laboratory (APL), 3173-25, Showa-machi, The University of Tokyo, Graduate School of Agricultural and Life Sciences, 1-1-1 Yayoi, Bunkyo City, Tokyo, Japan, Tokyo University of Marine Science and Technology, 4-5-7 Kohnan, Minato-ku, Tokyo, Japan, Shiga University, Faculty of Data Science, 1-1-1 Banba, Hikone City, Shiga, Japan, highlighting the need for practical workflows that integrate historical aerial photographs with low-cost or freely available satellite, classification accuracy, we recommend that (1) baselines be defined over the longest available record and justified ecologically, (2), recently available low-cost or free satellite data with open-, freely available satellite data, processed primarily using free and, Co., Ltd.), seagrass polygons were extracted from historical, information from labels created for the entire extent of two, images taken in 2010 and 1999. Additionally, label information, available open missions. Images were acquired more than twice

2026-06-09强化学习

海草床监测受商业卫星和野外调查成本限制,难以及时发现长期退化与突发崩塌。本文将1940年代以来航片、WorldView/GRUS与免费Sentinel‑2月合成影像结合,用YOLOv8分割重建日本赤穗近80年海草变化。模型总体精度≥0.9,显示2025年优势大叶藻并非季节波动而是快速崩塌,面积降至约0.2公顷,可能与夏季水温异常升高有关。

DAL-PCQA: Enabling Distortion-Level and Language-Driven Reasoning for Point Cloud Quality Assessment Figure 1
2026-06-09cs.CV

DAL-PCQA: Enabling Distortion-Level and Language-Driven Reasoning for Point Cloud Quality Assessment

Swarna Chakraborty, Gabriel De Castro Araújo, Syeda Tasmi Faria, Marcelo M. Carvalho, Mylene C.Q. Farias

2026-06-09三维

点云质量评估常只给 MOS 分数,难解释压缩、采集或渲染造成的具体感知退化。DAL-PCQA 的核心是把 SJTU-PCQA、WPC 扩展为带三维失真分类、五级严重度、离散质量标签和自然语言描述的数据集,覆盖颜色、亮度、密度、缺失与几何变形等线索。实验用零样本与微调多模态模型对比,显示失真感知监督能提升生成描述与人工标注的词汇和语义一致性,但主要贡献偏数据与标注框架。

REACT 2026: The Fourth Multiple Appropriate Facial Reaction Generation Challenge: Personalised MAFRG and Appropriate EEG Reaction Prediction Figure 1
2026-06-09cs.CV

REACT 2026: The Fourth Multiple Appropriate Facial Reaction Generation Challenge: Personalised MAFRG and Appropriate EEG Reaction Prediction

Siyang Song, Micol Spitale, Zijian Wu, Xiangyu Kong, Cheng Luo, Cristina Palmero, German Barquero, Sergio Escalera, Michel Valstar, Mohamed Daoudi, Fabien Ringeval, Andrew Howes, Elisabeth Andre, Hatice Gunes

University of Exeter, Nanjing University of Science and, King Abdullah University of Science, King’s College London, University of Nottingham, University of Augsburg, University of Cambridge, alised MAFRG, respectively, which are publicly available at https:, • Human-centered computing →HCI theory, concepts and, personality labels and EEG signals along with multi-modal human, duced Big-Five personality labels and EEG signals, together

2026-06-09视觉感知

本文针对现有面部反应生成多为通用、忽略个体差异与神经生理状态的问题,提出 REACT 2026 挑战。核心创新是在 MARS 数据集中加入 Big-Five 人格标签和 EEG,设置离线/在线、通用/个性化四类 MAFRG 任务,并要求生成合适、多样、真实且同步的反应。主要结果是给出公开基线、提交规范与 FRCorr/FRRea 等评测框架;实际性能增益文中未充分说明。

LEGS: Laplacian-Enhanced Gaussian Splatting with a Nonlinear Weighted Loss Figure 1
2026-06-09cs.CV

LEGS: Laplacian-Enhanced Gaussian Splatting with a Nonlinear Weighted Loss

Yongfei Guo, Qizhou Huo, Xuan Sun, Yuanhao Gong

Changchun Institute of Optics, Fine Mechanics and Physics, Chinese Academy of Sciences, Changchun, China, University of Chinese Academy of Sciences, Beijing, China

2026-06-09三维

针对3D Gaussian Splatting的光度损失对平坦区与结构丰富区域一视同仁、易削弱轮廓和细节的问题,LEGS不改动渲染与表示管线,而是在损失层用二阶Laplacian响应替代一阶梯度,并通过非线性映射生成像素权重以强化结构监督。在Tanks&Temples和Mip-NeRF360上,PSNR相对3DGS最高提升1.68 dB、相对EGGS最高提升0.52 dB,迁移到FastGS/FasterGS也有最高1.69 dB增益。

Decoupling Semantics and Logic: A Training-Free Coarse-to-Fine Pipeline for Video Retrieval-Augmented Generation Figure 1
2026-06-09cs.CV

Decoupling Semantics and Logic: A Training-Free Coarse-to-Fine Pipeline for Video Retrieval-Augmented Generation

Jiaxin Dai, Zehang Wei, Jiamin Yan, Xiang Xiang

School of Computer Science & Tech, Huazhong University of Science and Technology, School of AI and Automation, Huazhong University of Science and Technology, China, through a modality-aware division of labor., a balance between computational scalability and, recall and computational scalability while maintain-

2026-06-09视觉感知

针对大规模跨语种长视频 RAG 中语义相似但逻辑无关的“硬负例”易导致人格约束失效和幻觉的问题,论文提出无需训练的 C2F-RAG:先用 BGE-M3 基于全局视觉/文本摘要高召回预取,再由引入 OCR/ASR 的 A.I.R. LLM 代理做逻辑重排,并用提示约束 JSON 与时间引用。在约 11 万视频检索中 nDCG@10 达 0.848、R@100 达 0.837,优于 Mixedbread 等基线;生成评测平均分 0.437 高于 CAG 的 0.378,但部分增益可能来自强商业 LLM 重排。

3D Oral Modelling with Improved Vertex Distribution Using Matching-Based Learning Figure 1
2026-06-09cs.CV

3D Oral Modelling with Improved Vertex Distribution Using Matching-Based Learning

Jihun Cho, Soo-Yeon Jeong, Eun-Jeong Bae, Sun-Young Ihm

2026-06-09三维

本文针对多视角口内图像直接重建3D牙颌点云时,Chamfer Distance易使预测顶点聚集在真值高密度区域、覆盖不足的问题,改用匈牙利一对一匹配、困难匹配过滤与Repulsion Loss组合约束顶点分布。结果显示常规准确率由77.49%降至68.02%,但聚集现象明显缓解;在一对一匹配指标上由8.61%提升到35.71%,代价是仅能采样5000点匹配,效果仍受算力限制。

Beyond the Thin-Layer Limit: Differentiable Volumetric Training for Visible-Range Diffractive Neural Networks Figure 1
2026-06-09cs.CV

Beyond the Thin-Layer Limit: Differentiable Volumetric Training for Visible-Range Diffractive Neural Networks

Dineth Jayakody, Dushan N. Wadduwage

\authormark 1Department of Computer Science, Old Dominion University, Norfolk, VA 23529, USA, \authormark 2School of Data Science, Old Dominion University, Norfolk, VA 23529, USA, \authormark 3Department of Physics, Old Dominion University, Norfolk, VA 23529, USA

2026-06-09视觉感知

面向可见光机器视觉中的衍射神经网络,论文指出性能落后并非主要因纳米加工,而是低折射率材料下“薄层掩膜”训练与真实厚结构产生失配。作者提出可微BPM体积层,将高度图作为可制造三维结构端到端优化,显式建模层内传播与相位累积;在MNIST、Fashion-MNIST、CIFAR-100及成像任务中降低仿真到器件差距,FDTD验证分类准确率由约50%提升至90%。

TBD-VLA: Temporal Block Diffusion Vision Language Action Model Figure 1
2026-06-09cs.CV

TBD-VLA: Temporal Block Diffusion Vision Language Action Model

Sung-Wook Lee, Xuhui Kang, Yen-Ling Kuo

University of Virginia

2026-06-09视觉感知生成模型

TBD-VLA针对离散VLA逐token自回归延迟高、并行解码又缺少显式时序依赖的问题,将动作序列划分为时间块:块内用掩码离散扩散并行生成,块间保持自回归,同时支持通过时序补全做Real-Time Chunking异步执行。论文称其在仿真和真实操作、含扰动场景中优于既有VLA,并在LIBERO上以2B模型达到0.117秒延迟,兼顾速度与时序一致性。

C3VD-DEFCOL: A Deformable Colonoscopy Dataset with Time-Resolved 3D Ground Truth and Realistic Appearance Figure 1
2026-06-09cs.CV

C3VD-DEFCOL: A Deformable Colonoscopy Dataset with Time-Resolved 3D Ground Truth and Realistic Appearance

Ethan Luk, Mayank V. Golhar, Anthony Song, Raúl Iranzo, Víctor M. Batlle, Lalithkumar Seenivasan, José M.M. Montiel, Nicholas J. Durr

Department of Biomedical Engineering, Johns Hopkins University, Baltimore, MD, USA, Department of Computer Science, Johns Hopkins University, Baltimore, MD, USA, deformations of the colon surface, including peristaltic waves and centerline mo-, ground truth is typically unavailable or limited. Consequently, algorithms are often evaluated either

2026-06-09数据集/基准三维

针对结肠镜三维重建缺少兼具真实外观与时序稠密3D真值、难以评估非刚性形变鲁棒性的问题,C3VD-DEFCOL基于C3VD网格生成受控蠕动/中心线形变,并用深度条件LTX sim-to-real生成逼真RGB,提供110段视频及深度、法线、光流、位姿和逐时刻网格。实验从真实感、几何/时间一致性验证数据,并显示位姿估计误差随形变强度增加而上升。

The Cross-Architecture Substrate: A Domain-Transcendent, Calibration-Surviving Geometric Invariant of Modern Vision Encoders Figure 1
2026-06-09cs.CV

The Cross-Architecture Substrate: A Domain-Transcendent, Calibration-Surviving Geometric Invariant of Modern Vision Encoders

Yousef Radwan

2026-06-09视觉感知

这篇论文追问不同架构、损失和数据训练的视觉编码器是否真的学到不可比较的表征。作者提出“跨架构基底”:13个现代视觉编码器倒数层特征的前16个主成分会收敛到相近几何子空间,并用PCA、CKA及Pang校准检验。结果显示该基底可跨8类视觉域保持中等对齐,排除像素/Gabor/随机切片解释,并带来无标签迁移筛选、域检测、低样本特征和免教师蒸馏等收益;但其不跨视觉-音频,也不能预测迁移性能。

VisualFLIP: Do Predictions Depend on Task-Critical Visual Evidence in Multimodal Reasoning? Figure 1
2026-06-09cs.CV

VisualFLIP: Do Predictions Depend on Task-Critical Visual Evidence in Multimodal Reasoning?

Didi Zhu, Changrui Chen, Stefanos Zafeiriou, Jiankang Deng

Imperial College London, are available on our Project page.

2026-06-09视觉语言

这篇论文关注多模态模型“答对”是否真的依赖关键视觉证据,而非语言先验或表面推理。作者提出 VisualFLIP,将同一问题配对到最小视觉扰动前后,使正确答案确定翻转,并用成对准确率与 Collapse Rate 衡量是否随证据更新。对 24 个 MLLM 的评测显示,高准确率和工具调用仍不能避免答案固化,顺序暴露会加剧旧答案 persistence,空间与计数任务尤其容易暴露视觉 grounding 失败。

The Last Visible Pixel: Probing Fine-Scale Perception in Vision-Language Models Figure 1
2026-06-09cs.CV

The Last Visible Pixel: Probing Fine-Scale Perception in Vision-Language Models

Lujun Li, Lama Sleem, Niccolo Gentile, Yangjie Xu, Yewei Song, Wenbo Wu, Radu State

University of Luxembourg

2026-06-09视觉语言视觉感知

本文关注现有视觉语言模型在标准评测之外的细粒度视觉极限:小到多少像素的字母、形状或物体仍能被可靠看见并用于推理。作者提出 FineSightBench,将像素级感知与空间、计数、排序等推理任务分离,在 4–48px 尺度上系统测试。结果显示模型感知能力约在 12px 后趋于饱和,但即使目标更大,计数和序列推理仍频繁出错,说明“看见”并不等于能稳定推理。

MinNav: Minimalist Navigation Using Optical Flow For Active Tiny Aerial Robots Figure 1
2026-06-09cs.RO

MinNav: Minimalist Navigation Using Optical Flow For Active Tiny Aerial Robots

Aniket Patil, Mandeep Singh, Uday Girish Maradana, Nitin J. Sanket

Perception and Autonomous Robotics (PeAR) Group, Robotics Engineering Department, Worcester Polytechnic Institute.

2026-06-09机器人生成模型

微型无人机受载荷与算力限制,难以依赖激光雷达或高开销深度估计实现避障。MinNav 用单目相机预测多尺度光流及不确定性,并通过主动探索运动区分静态障碍、动态障碍和未知形状缝隙,统一生成朝向自由空间的控制。实机与仿真显示其可在机载计算上运行,真实场景总体成功率约 70%,性能接近深度方法但计算量低得多;动态障碍延迟与非全向感知仍是主要失败来源。

Frequency-Scale Saliency for Spectral Descriptor Analysis in 3D Shape Retrieval Figure 1
2026-06-09cs.GR

Frequency-Scale Saliency for Spectral Descriptor Analysis in 3D Shape Retrieval

Jianru Shen

University of Montana, Missoula, MT 59812, USA

2026-06-09三维

这篇论文针对 HKS/WKS 等谱描述子在非刚性三维形状检索中只看整体 mAP、难以解释失败尺度来源的问题,提出基于尺度遮蔽消融的频率-尺度显著性分析,并用类别谱指纹诊断类间混淆。SHREC’11 实验显示短尺度贡献最大、长尺度可能有害,类间描述子相似度与检索失败相关(Spearman 0.479),显著性加权在困难类别上提升 mAP 0.156。

Land cover and flood type govern the detection limits of satellite-based flood mapping across diverse global flood events Figure 1
2026-06-09cs.AI

Land cover and flood type govern the detection limits of satellite-based flood mapping across diverse global flood events

Venkatesh Kolluru, Rajat Shinde, Abdelhak Marouane, Caden Helbling, Deepak Shah, Othneil Drew, Iksha Gurung, Manil Maskey, Rahul Ramachandran

Earth System Science Center, University of Alabama in Huntsville, Huntsville, AL 35805, USA, NASA Marshall Space Flight Center, Huntsville, AL, 35808 USA.

2026-06-09视觉感知

针对地理基础模型在真实洪水业务制图中可靠性缺乏系统评估的问题,本文将 Prithvi-EO-2.0 部署到 19 个全球分布的 OOD 洪水事件,并用双参考产品与红队式流水线排查分析失效。核心洞察是检测上限主要受土地覆盖与洪水类型共同约束,而非单纯地域迁移:农田和河流型洪水表现较好,树木覆盖与建成区几乎失效;平均 IoU 约 0.46/0.49,且发现 23 类失败模式,早期误差更多来自工程流水线和参考定义差异。

DALE-CT: Depth-Aware Foundation Models for Computed Tomography Figure 1
2026-06-09cs.CV

DALE-CT: Depth-Aware Foundation Models for Computed Tomography

Evan W. Damron, Mahmut S. Gokmen, Mitchell A. Klusty, Caroline N. Leach, Emily B. Collier, V. K. Cody Bumgardner

College of Medicine Office of Research, University of Kentucky, Lexington, KY 40506 USA

2026-06-09视觉感知

针对3D CT基础模型常依赖文本监督、固定体素输入且计算开销高的问题,DALE-CT探索用2D切片ViT学习体数据表征。核心做法是在LeJEPA自监督中加入深度感知多裁剪,并用解剖与病灶掩码提供稠密辅助监督。在线性探针+MIL多异常检测中,DALE-CT-2S的冻结骨干达到Macro AUROC 0.833,接近3D视觉语言模型COLIPRI且无需文本监督。

Quantum-Enhanced Similarity Measures for Polarimetric Materials Classification Figure 1
2026-06-09cs.CV

Quantum-Enhanced Similarity Measures for Polarimetric Materials Classification

Sara Shojaei, Seyed Mohamad Ali Tousi, Emma Bennett, Param Sangani, Ali Shiri Sichani, Ilker Ersoy, Hadi Ali-Akbarpour, Filiz Bunyak, G. N. DeSouza

†University of Missouri–Columbia, MO, USA, ‡Saint Louis University, MO, USA, available, and Basheer et al. apply SWAP-test fidelity scoring, light sources are sampled uniformly from the 147 available

2026-06-09视觉感知

针对RGB材质识别易受光照、视角影响的问题,论文把偏振Mueller矩阵材料分类改写为嵌入点集匹配:用OctGPT/GNN学习64×32体素嵌入,推理时以量子幅度编码并用SWAP test聚合保真度检索锚样本。在23类KAIST偏振数据上,理想仿真达72.7% Top-1、90.9% Top-3,低于最优传输/匈牙利匹配的87.9% Top-1;效果说明量子保真度可作为相似性信号,但真实NISQ噪声与状态制备开销仍未验证。

DroneDAR: Long-Range Drone Distance Estimation Using Monocular Vision and Bounding-Box Features Figure 1
2026-06-09cs.CV

DroneDAR: Long-Range Drone Distance Estimation Using Monocular Vision and Bounding-Box Features

Knut Peterson, Zaid Mayers, David Han

2026-06-09视觉感知学习理论

面向远距离小型无人机在单目图像中仅占少量像素、外观与尺度线索易受噪声干扰的问题,本文提出 DroneDAR,在 DroneRanger 基线上用 ResNet 替换自定义 CNN,并通过轻量边界框特征门控自适应融合裁剪外观与几何线索。LRDDv3 实验显示其在各距离段优于基线,ResNet-18、220×220 裁剪和 Huber 损失表现最佳;但极远距离仍受边界框误差限制。

A case study of evaluating AI agents on a neuroscience data-to-discovery pipeline Figure 1
2026-06-09cs.AI

A case study of evaluating AI agents on a neuroscience data-to-discovery pipeline

Kai A. Horstmann, Ethan Lin, Alice A. Robie, Jennifer J. Sun, Kristin Branson

Cornell University, Allen Institute, 2021, The International Brain Laboratory, 2022) rely on tools and, fully automated “AI scientist” or self-driving lab approaches (Lu et al., 2026, Code available at: https://github.com/kaihorstmann/neuro-d2d-eval

2026-06-09视觉感知

这篇论文关注科学研究流水线中耗时的软件构建瓶颈,而非直接追求全自动“AI 科学家”。作者以果蝇光遗传学数据到发现流程为案例,设计7个大规模、专家标准驱动的阶段任务及端到端评测。结果显示,通用编码智能体能完成若干单阶段任务,但在缺少明确可迭代指标、需要科学判断和视觉自检时明显失效,端到端串联仍超出现有能力。

Multi-planar 2D-U-Net Segmentation of 3D-CT Abdominal Organs augmented by Spatial Occurrence Maps Figure 1
2026-06-09eess.IV

Multi-planar 2D-U-Net Segmentation of 3D-CT Abdominal Organs augmented by Spatial Occurrence Maps

Daria Kern, Negar Chabi, Souraj Adhikary, Andre Mastmeyer

Glasgow Caledonian University, School of Science, Jade University of Applied Sciences, Department of Engineering, training set labels. This probability map serves as a sec-, axial, coronal and sagittal sections. A maximum label, label data from various public sources2. All scans are, tion labels undergo morphological closing, and extrac-

2026-06-09视觉感知生成模型三维

腹部大视野 3D CT 中多器官分割受视野差异、低软组织对比和器官邻近影响,轻量 2D 方法仍需利用解剖先验。本文在粗到细 VOI 定位后,将训练标签生成的模糊三维空间出现图作为额外通道,结合轴/冠/矢多平面 2D-U-Net 融合。80 例公开 CT 五折实验显示,相比无 SOM,五个器官 Dice 均提升,最大约 4%,胰腺由 0.67 提至 0.70。

Cross-View Urban Traffic Dataset: Drone-Supervised Ground Truth for Monocular Bird's-Eye View Localization Figure 1
2026-06-09cs.CV

Cross-View Urban Traffic Dataset: Drone-Supervised Ground Truth for Monocular Bird's-Eye View Localization

Prakhar Bhardwaj, Simone Weikl, Kilian Mang, Elia Jonas Sandtner

cessing pipeline, and evaluation code will be made publicly available at https://huggingface., co/datasets/prakharbh/CrossViewUrbanTrafficDataset and the codebase is available at

2026-06-09数据集/基准

针对现有交通/V2X数据集缺少街景自车视角与无人机俯视视角之间“身份级”对齐的问题,论文提出CVUTD:在真实城市路口同步采集自行车单目视频与无人机视频,支持跨视角轨迹身份匹配和由自车视角预测BEV两项任务,并提供标注、评测与基线工具链。实验显示该基准可运行但未被现有方法解决:匹配召回较高但受过度分配、时间不稳定和视角歧义限制,单目BEV预测虽受益于空中监督仍明显未饱和。

Struct-Searcher: Agentic Structural Thinking Advances Multimodal Deep Information Seeking Figure 1
2026-06-09cs.CV

Struct-Searcher: Agentic Structural Thinking Advances Multimodal Deep Information Seeking

Fan Zhang, Vireo Zhang, Shengju Qian, Haoxuan Li, Zheng Lian, Hao Wu, Yuan Gao, Xinyu Geng, Xin Wang, Pheng-Ann Heng

CUHK 2LIGHTSPEED 3PKU 4Tongji University 5THU 6HKUST

2026-06-09视觉语言

论文针对多模态深度检索中图文等异构证据相互矛盾、传统智能体只线性累积证据而难以修正错误信念的问题,提出 Struct-Searcher:以信念修正理论维护多模态结构图,显式建模查询、假设、证据及支持/冲突关系,并从最大无冲突子图生成答案。实验显示其可插拔且模型无关,在 BrowseComp-VL 五个骨干上平均相对提升 17.2%,并在三项基准上超过现有 VLM 与深度研究智能体。

What Makes Video World Model Latents Action-Relevant: Prediction over Reconstruction Figure 1
2026-06-09cs.CV

What Makes Video World Model Latents Action-Relevant: Prediction over Reconstruction

Jewon Yeom, Hanseul Kim, Jeongjae Park, Sungmok Jung, Jaejin Lee, Taesup Kim

Graduate School of Data Science, Seoul National University

2026-06-09视觉感知强化学习三维

这篇论文针对机器人 VLA/世界模型常用像素指标难以反映控制可用性的问题,统一用逆动力学探针比较八类冻结视频编码器。核心发现是动作相关潜空间主要来自自然视频的时间预测预训练,而非重建清晰度;高 PSNR 的自编码器/扩散模型可几乎无法恢复动作。V-JEPA、VideoMAE 对比显示时间上下文贡献最大,潜变量预测有额外收益;逆动力学微调还能显著提升视觉扰动鲁棒性。

The Need for Neural ISP in the Small-Pixel Era: How Shrinking Pixels Push Optics to the Limit and Neural Restoration Pushes Back Figure 1
2026-06-09eess.IV

The Need for Neural ISP in the Small-Pixel Era: How Shrinking Pixels Push Optics to the Limit and Neural Restoration Pushes Back

Jingxi Li, Neerja Aggarwal, Laurent Gudemann, Shivansh Rao, Vishal Vinod, Tom E. Bishop, Ziv Attar

2026-06-09视觉感知

论文针对手机长焦小像素化带来的“物理墙”:像素降至亚 0.5µm 时,为抑制衍射需放大光圈,却加重几何像差,传统分阶段 ISP 难以恢复。作者用受控仿真固定 SNR 与衍射因素,比较 0.35–0.75µm 配置,指出相机特定 Neural ISP 可联合建模 PSF、去马赛克与去噪。在 0.35µm 下其 MTF50 约为传统 ISP 的 2.5–3 倍,LPIPS 从 0.244 降至 0.151;低照多帧实验也显示传统瓶颈主要是未校正 PSF 模糊而非噪声。

Simultaneous hyperkinetic movement disorders phenotyping: a cross-cohort pediatric transfer study using routine videos, markerless pose estimation and a tabular foundation model Figure 1
2026-06-09cs.CV

Simultaneous hyperkinetic movement disorders phenotyping: a cross-cohort pediatric transfer study using routine videos, markerless pose estimation and a tabular foundation model

Laura Cif, Diane Demailly, Zohra Souei, Muhammad Mushhood Ur Rehman, Juan Dario Ortigoza Escobar, Mayté Castro Jiménez, Cécile A. Hubsch, Sophie Huby, Morgan Dornadic, Gun-Marie Hariz, Eduardo M. Moraud, Jocelyne Bloch, Gabriella A. Horvath, Xavier Vasques

2026-06-09视觉感知强化学习三维

针对儿童混合性多动运动障碍依赖专家看视频、跨年龄泛化工具不足的问题,本文将常规临床视频经无标记姿态估计转为运动学特征,并用表格基础模型构建成人训练的共享骨干,只在儿童队列做轻量决策层校准。外部儿科留出集上,Hamming accuracy 由0.804升至0.839,Jaccard由0.548升至0.633;在临床一致性更高的表型上达0.900/0.786,但样本很小,临床级可靠性仍待验证。

Liquid Neural Networks as a Drop-in Continuous-Time Deformation Field for Dynamic 3D Gaussian Splatting Figure 1
2026-06-09cs.CV

Liquid Neural Networks as a Drop-in Continuous-Time Deformation Field for Dynamic 3D Gaussian Splatting

Mingzhao Li, Arghya Pal, Guan Yuan Tan

∗School of Information Technology, Monash University, Selangor, Malaysia, (xi, ri, si, αi, ci)}, where xi ∈R3 is the centre, ri a unit

2026-06-09三维

该文针对 D-3DGS 的 MLP 变形场虽输入连续时间、结构上却近似逐帧独立预测的问题,将其替换为由 CfC 液态神经元堆叠的连续时间变形场,用 sigmoid 时间门在候选隐状态间插值,无需 ODE 求解器且基本保留原管线。实验在 D-NeRF 与 NeRF-DS 上总体持平或略优于 MLP,收益主要出现在高频关节运动场景,但部分场景退化且同宽 CfC 计算量更高。

MemoVAD: Resource-Efficient Video Anomaly Detection via Dynamic Semantic Memory in Edge Computing Scenarios Figure 1
2026-06-09cs.CV

MemoVAD: Resource-Efficient Video Anomaly Detection via Dynamic Semantic Memory in Edge Computing Scenarios

Guo Li, Jiandian Zeng, Yang Li, Zihao Peng, Ke Chen, Tian Wang

Institute of Artificial Intelligence and Future Networks, Beijing Normal University, Zhuhai, China, School of Computing and Artificial Intelligence, Southwest Jiaotong University, Chengdu, China, Engineering Research Center of Cloud-Edge Intelligent Collaboration on Big Data, Ministry of, Education, Beijing Normal University, Zhuhai, Guangdong, China, laborative framework that selectively incorporates, available at: https://memovad2026.github.io/., computational resources available on edge devices [Ghasemi, whelming edge resources, edge-cloud collaboration offers a, Instead, we introduce a novel collabora-, • We propose MemoVAD, a resource-efficient collabora-, bels are available [Mishra et al., 2024, Efficient Edge-Cloud Collaboration

2026-06-09视觉感知

面向边缘监控中的视频异常检测,论文针对VLM语义能力强但端侧算力、带宽和时延受限的问题,提出MemoVAD边云协同框架:端侧轻量检测器结合因果时序编码,只有在主观逻辑不确定性高且语义新颖时查询云端VLM,并用动态语义记忆缓存已验证原型以复用语义知识。UCF-Crime和XD-Violence实机实验显示,其在显著降低通信率的同时接近全量云查询性能并超过已有方法。

PereStruct: Multimodal Semantic Assembly for Robust Historical Document Parsing Figure 1
2026-06-09cs.CV

PereStruct: Multimodal Semantic Assembly for Robust Historical Document Parsing

Maksim Shandybo, Ivan Bespalov, Daniil Yefimov, Marina Kosheleva, Alexander Loukianov

National University of Science and Technology MISIS, Moscow, Russian Federation

2026-06-09视觉语言安全鲁棒

针对历史报纸因退化扫描、多栏非规则排版导致通用视觉语言模型难以恢复文章结构的问题,PereStruct采用模块化流程:微调YOLO做版面块检测,结合OCR/LLM校正,并用TF-IDF语义、YOLO视觉嵌入和几何约束进行块到文章的语义组装。实验显示其块映射F1达0.904,端到端BLEU约0.96,显著高于Qwen VLM约0.34,并发布标注语料与基准。

Need We Teach Foundation Models What is a Generative Image? Gradient-Free Generative Artifact Detection via Analytic Spectral Adaptation Figure 1
2026-06-09cs.CV

Need We Teach Foundation Models What is a Generative Image? Gradient-Free Generative Artifact Detection via Analytic Spectral Adaptation

Qiaoyu Chen, Bing Zhang

Harbin University of Commerce, and inherently enables privacy preserving federated collaboration via covariance

2026-06-09视觉感知生成模型优化算法

论文针对生成图像检测中微调基础模型易在少量伪造样本上过拟合、产生“anchor drift”并削弱跨域零样本能力的问题,提出 Lightning:冻结 CLIP,把检测改写为相对真实图像自然锚点的 OOD 异常度量,通过注意力加权统计/语义解耦、SVD 降维和层选择完成无梯度谱适配。在 FF++ 校准、OpenFake T2I 零样本测试中,平均 AUC 达 0.820,高于最佳梯度基线 GenD 的 0.618。

Real-Time Industrial Defect Detection on Edge Hardware Using Fine-Tuned YOLOv8: A Systematic Benchmark on the NEU Surface Defect Database and MVTec AD with Automotive & Battery Manufacturing Extensions Figure 1
2026-06-09cs.CV

Real-Time Industrial Defect Detection on Edge Hardware Using Fine-Tuned YOLOv8: A Systematic Benchmark on the NEU Surface Defect Database and MVTec AD with Automotive & Battery Manufacturing Extensions

Emmanuel Ezeji Somtochukwu, Nitesh Rijal

labeled industrial data and the computational, First, labeled industrial defect data is scarce —

2026-06-09视觉感知数据集/基准

面向工厂端侧无云、低时延且缺陷标注稀缺的质检场景,本文系统比较 YOLOv8 n/s/m/l 在 NEU-DET 与经 mask 转 bbox 的 MVTec AD 上的检测表现,并提出汽车/电池缺陷迁移路径。结果显示 NEU-DET 上 YOLOv8l 最高 74.1% mAP@0.5,但 YOLOv8n 仅低 0.5pp 且 2.1ms;MVTec AD 上排名反转,YOLOv8m 最优 72.4%,说明最优模型大小可能主要来自任务复杂度与每类数据量,而非单纯 scaling。

What neurosurgeons need to see: synthetic intra-operative MRI from ultrasound for brain-shift compensation in brain tumour surgery Figure 1
2026-06-09cs.CV

What neurosurgeons need to see: synthetic intra-operative MRI from ultrasound for brain-shift compensation in brain tumour surgery

Santiago Cepeda, Olga Esteban-Sinovas, Ignacio Arrese, Rosario Sarabia

Department of Neurosurgery, Neurovascular Unit, Río Hortega University Hospital, Valladolid, Spain, requires dedicated infrastructure and is not widely available, whereas intraoperative ultrasound (ioUS), informative update, but it requires dedicated infrastructure, prolongs the operation, and is available in only a small, number of centres. Intraoperative ultrasound (ioUS) is the practical alternative: it is fast, inexpensive, repeatable, available signal and must be reconciled with the deformed intraoperative anatomy at the field-of-view boundary.

2026-06-09视觉感知

针对胶质瘤术中开颅后脑移位导致术前 MRI 导航失准、而术中 MRI 难普及的问题,论文提出用术中超声合成 MRI,并与形变配准融合成术前空间下的全脑 siMRI:超声视野内显示术后腔和残余等术中状态,视野外保留配准后的术前 MRI。ReMIND 评估中,ResViT-2.5D 合成质量较好;配准 TRE 从 6.27 降至 5.86 mm,与 NiftyReg 基线 5.85 mm 基本持平,因此主要贡献不是精度提升,而是生成可导航的 MRI 风格术中更新体积。

FADRW: A Feature-Aware Modulated and Dynamically Reweighted Loss for Few-Shot Linguistic Steganalysis Figure 1
2026-06-09eess.SP

FADRW: A Feature-Aware Modulated and Dynamically Reweighted Loss for Few-Shot Linguistic Steganalysis

Shuo Liu, Xianghong Lin, Yukun Wei, Zhongliang Yang

S. Liu is with the International School, Beijing University of Posts and, are with the School of Cyberspace Security, Beijing University of Posts and, with a binary label yi ∈{0, 1}, where yi = 1 denotes, text. The goal is to predict the label of each node by jointly

2026-06-09生成模型

本文面向社交媒体中隐写文本占比低于 1% 时的少样本检测难题,指出现有模型同时受多数类决策偏置和隐写弱特征被淹没影响。作者提出 FADRW 损失,通过动态重加权逐步校正类别偏置,并用特征感知的 logit 缩放与偏移增强隐写特征可分性。Reddit、X 和微博实验显示其在多数设置下优于基线,低载荷场景提升更明显,但个别消融结果提示重加权可能存在过校正。

MM-Matryoshka: Towards Budget-Elastic Visual Document Retrieval via a 2D Multimodal Matryoshka Training Framework Figure 1
2026-06-09cs.CV

MM-Matryoshka: Towards Budget-Elastic Visual Document Retrieval via a 2D Multimodal Matryoshka Training Framework

Haowen Xiang, Yibo Yan, Jiahao Huo, Yu Huang, Yi Cao, Mingdong Ou, Xuming Hu

Hong Kong University of Science and Technology (Guangzhou), Alibaba Cloud Computing, 3Hong Kong University of Science and Technology, Dimension-Level Scalability, Token-Level Scalability, Layer-Level Scalability, full-budget accuracy, but also a controllable budget

2026-06-09视觉语言

多向量视觉文档检索虽能细粒度匹配文本、版面和图像区域,但存储与深层 VLM 编码开销高。MM-Matryoshka 将 Matryoshka 训练扩展为二维预算:用维度前缀监督压缩向量宽度,并用层级蒸馏让中间层保留最终层检索行为,使单一 ColPali 式模型可在推理时选择层数与维度。文中在 14 个 VDR 数据集和多种骨干上显示,其低预算质量明显优于直接截断,同时降低存储和计算开销。

A Dataset for Dynamic Human Preferences for Vision Language Models Figure 1
2026-06-09cs.CV

A Dataset for Dynamic Human Preferences for Vision Language Models

Hannah Gao (Massachusetts Institute of Technology), Dylan Hadfield-Menell (Massachusetts Institute of Technology), Rachel Ma (Massachusetts Institute of Technology)

2026-06-09视觉感知数据集/基准

面向聊天助手和VLM驱动机器人等交互场景,论文指出现有多模态基准多评估静态知识,难以衡量模型是否能在推理时遵循用户即时偏好。作者构建含图像、偏好、问题和可执行选项的动态人类偏好基准,并用生成—审查—修订流水线及边界框版本增强视觉依赖。实验显示闭源VLM整体优于开源模型,几乎所有模型在含边界框提示上明显更困难;数据集仍属早期且规模有限。

KITE: A Tri-Modal Transformer Integrating Text, Images, and Knowledge Graphs for Fake News Detection Figure 1
2026-06-09cs.LG

KITE: A Tri-Modal Transformer Integrating Text, Images, and Knowledge Graphs for Fake News Detection

Kevin Patel, Shashi Bhushan Jha

Department of Computer Science, University of West Florida, Pensacola, FL, USA, Code and dataset availability: https://github.com/KaiDMML/FakeNewsNet/

2026-06-09视觉感知

针对假新闻中误导文本、篡改图像与事实错误交织,传统单模态或文本图像融合难以发现深层语义矛盾的问题,KITE将RoBERTa文本、CLIP视觉特征与来自Wikidata的实体事实小图统一送入多模态Transformer,并用GAT学习知识关系、三模态交叉注意力和模态置信度提升可解释性。实验称其在基准数据上优于单模态和双模态基线,尤其擅长识别图文不一致及外部知识冲突,但具体增益幅度需看完整实验表。

Detecting Aimbot Cheaters in MOGs Figure 1
2026-06-09cs.CR

Detecting Aimbot Cheaters in MOGs

Salman Shaikh, Tao Ni, Marc Dacier

2026-06-09视觉感知

针对视觉自瞄不读游戏内存、可绕过内核级反作弊的问题,论文提出 PATCH:把对抗补丁作为游戏 HUD 蜜标,诱导作弊者的目标检测模型瞄准假目标,从而检测或干扰其游戏。作者在 Unreal Engine 自制游戏中测试不同补丁尺寸、分辨率、同机/外机配置和 YOLO 模型,白盒多数尺寸检测率超过 90%,较大补丁跨模型迁移约 60%–90%,并在 Fortnite 上做了可行性验证。

ViMax: Agentic Video Generation Figure 1
2026-06-09cs.CV

ViMax: Agentic Video Generation

Lingxuan Huang, Sizhe He, Hengji Zhou, Liqiang Nie, Lianghao Xia, Chao Huang

The University of Hong Kong, 2South China University of Technology, Harbin Institute of Technology, Shenzhen, dinated multi-agent collaboration where spe-, agent collaboration to generate extended narra-, timelines. The code for ViMax is available at:, This section elaborates technical details of ViMax.

2026-06-09视觉感知

本文针对长视频生成中短片模型缺乏叙事规划、跨镜头角色与场景易漂移的问题,提出 ViMax 多智能体框架,将编剧、分镜、角色造型、视频生成与 VLM 质检协同起来,并用层级叙事 RAG 与图依赖跟踪维持全局剧情和视觉连续性。实验在 ViMax-Bench 与小说改编任务上优于 Veo 3.1、HoloCine、Animaker 等基线,整体一致性和人工偏好均有提升。

AQIFormer: A Transformer-Based Multi-View Architecture for Cross-City Air Quality Classification Figure 1
2026-06-09cs.CV

AQIFormer: A Transformer-Based Multi-View Architecture for Cross-City Air Quality Classification

Om Kathalkar, Nitin Nilesh, Sachin Chaudhari, Anoop Namboodiri

monitoring systems facing significant scalability and economic, cant scalability constraints that limit comprehensive urban cover-, strain scalability for large-scale implementation. Popular devices, As sensor-based methods face significant scalability issues, research, lishes practical viability for scalable deployment across diverse

2026-06-09视觉感知

针对传统空气质量监测站成本高、覆盖稀疏,以及图像式 AQI 估计跨城市泛化差的问题,AQIFormer 采用 Transformer 集成框架融合车辆前后视角交通图像与气象参数,并引入天气感知注意力和多任务学习。论文在 26,678 对同步图像上达到 89.96% 分类准确率,较既有方法提升 14.96%;在 Nagpur 独立数据上经少样本适配达 81.67%,性能下降 8.29%。

Steer Where It Matters: Token-Level Visual-Sensitivity Steering for LVLMs Hallucination Mitigation Figure 1
2026-06-09cs.CV

Steer Where It Matters: Token-Level Visual-Sensitivity Steering for LVLMs Hallucination Mitigation

Ruipeng Zhang, Zhihao Li, C. L. Philip Chen, Tong Zhang

2026-06-09视觉语言

针对LVLM生成中易受语言先验驱动而产生视觉幻觉的问题,论文指出图像条件对自回归解码的影响并非均匀分布,而是集中在少量视觉敏感token上,传统全序列平均与固定强度activation steering会稀释信号并扰动无关token。作者提出TLVS,按token提取/细化转向方向,并依据在线视觉敏感度逐步调节干预强度。实验在LLaVA-1.5-7B、Qwen2.5-VL-7B及POPE、AMBER、CHAIR、MMHal、HallusionBench上显示,相比既有steering方法更稳定地降低幻觉并尽量保持生成质量。

DOME: Learning Transferable Domain Variables from Sparse Supervision for Test-Time Adaptation Figure 1
2026-06-09cs.CV

DOME: Learning Transferable Domain Variables from Sparse Supervision for Test-Time Adaptation

Xiaoran Xu, Yifan Xu, Yupeng Wu, Xiaoshan Yang, Changsheng Xu

mains using only unlabeled streaming data. Most existing methods, unlabeled test data. This direction is gaining increasing attention, to utilize the predictions of the model itself as pseudo-labels and, typically provide only discrete, single-domain labels. This mismatch, Label Domain Disentanglement, constructing explicit su-, labels [44], making it well-suited for dynamic or unseen domains.

2026-06-09视觉感知

本文针对测试时自适应中常把目标域压成单一全局分布、难以处理多维且逐样本变化的域偏移问题,提出 DOME 显式为每个样本编码域变量。方法借助 CLIP 视觉语言预训练学习连续域表示,并用动量更新的稀疏域库作为监督以削弱语义纠缠,再将域线索注入下游 ViT。实验显示,在 ImageNet-C/R/Sketch 等基准上,仅配合简单熵最小化即可达到或超过更复杂 TTA 方法。

FineGen: A VLM-based Multi-Agent Framework for Fine-Grained Image-Text Dataset Construction Figure 1
2026-06-09cs.CV

FineGen: A VLM-based Multi-Agent Framework for Fine-Grained Image-Text Dataset Construction

Chang Kong, Yuebing Li, Peng Mo, Haigang Zhang, Qiuming Luo

Shenzhen Polytechnic University, Shenzhen, China, Institute of Applied Artificial Intelligence of the Guangdong-Hong Kong Macao, Shenzhen University, China, tomated dataset construction. By employing a collaborative “Generation-, Collaboration · Automated Dataset Construction · Hard Negative Mining., leverages VLM-based Multi-Agent Collaboration to automate the construction, of fine-grained image-text datasets. Inspired by human collaborative work-

2026-06-09视觉语言视觉感知数据集/基准

本文针对现有图文数据集缺少细粒度属性硬负样本、导致 VLP 模型依赖粗语义匹配的问题,提出 FineGen:用生成、验证、纠错三个 VLM agent 闭环构造最小属性扰动样本,以降低幻觉和无效负例。基于 ImageNet 得到 FineGen-100K,含 14.7 万余属性硬负例,属性有效率 96.7%;在 FG-OVD hard split 上微调带来 +14.4% 准确率提升,效果可能主要来自更密集且经验证的 hard negative 数据。

AVI-Bench: Toward Human-like Audio-Visual Intelligence of Omni-MLLMs Figure 1
2026-06-09cs.CV

AVI-Bench: Toward Human-like Audio-Visual Intelligence of Omni-MLLMs

Yaoting Wang, Ziyi Zhang, Wenming Tu, Shaoxuan Xu, Wenjie Du, Cheng Liang, Weijun Wang, Yuanchao Li, Guangyao Li, Hao Fei, Yuanchun Li, Henghui Ding, Yunxin Liu

2026-06-09视觉感知

现有音视觉评测多按单模态或零散任务设计,难以判断 Omni-MLLM 是否具备接近人类的跨模态感知、理解与推理能力。AVI-Bench 以认知阶段划分任务,并加入 PriSe 用低语义陌生刺激测试原始音视觉泛化,同时提出四级 AVI 分类。实验覆盖开闭源模型,显示当前模型在联合音视觉解释与域外鲁棒性上仍有明显短板。

Do VLMs See What Sensors Feel? A Scalable Expert-Guided Design for Wheelchair Accessibility Assessment from Street View Figure 1
2026-06-09cs.CV

Do VLMs See What Sensors Feel? A Scalable Expert-Guided Design for Wheelchair Accessibility Assessment from Street View

Dongdong Wang, Alina Hagen, Isabelle Gatmaitan, Hao Zhou, Yiwen Dong, Shabboo Valipoor, Vivian W.H. Wong, Lingyao Li

Do VLMs See What Sensors Feel? A Scalable Expert-Guided Design for, University of Florida, University of South Florida, University of Illinois Urbana-Champaign, at the University of Florida, linking 407 unique, of expert-guided VLMs for scalable accessi-, baseline accessibility (U.S. Department of Justice, manual site visits. For instance, university acces-, a labor-intensive and unscalable process. To ad-, as a scalable visual source for auditing outdoor en-, the University of Florida campus. Our study makes, pipeline as a scalable screening layer for accessi-

2026-06-09视觉语言

针对轮椅可达性障碍分散、临时且人工巡检难以规模化的问题,论文用谷歌街景结合ADA/专家规则的RAG式VLM流程评估校园环境,并与轮椅GPS停留时间对齐验证。UF校园407个街景点结果显示,VLM评分与停留时间呈负相关且分布相近;RAG、多问题提示和透视街景优于基线,但对细微路面、临时遮挡和视角相关障碍仍有限。

Readable Yet Unpredictable: Rotated-Outcome Prediction in Vision-Language Models Figure 1
2026-06-09cs.CV

Readable Yet Unpredictable: Rotated-Outcome Prediction in Vision-Language Models

Lexin Wang, Shenghua Liu, Yiwei Wang, Jiafeng Guo, Xueqi Cheng

Institute of Computing Technology, Chinese Academy of Sciences, University of California, Merced

2026-06-09视觉语言视觉感知

这篇论文关注视觉语言模型在非标准朝向输入中的“预判”能力:模型是否能仅凭当前图像推断其旋转 180° 后会看到或读到什么。作者提出 Rotated-Outcome Prediction 与成对诊断集 RotOutBench,区分“看到后识别”和“未看到时推断”。实验显示,多数 VLM 能直接读出原图或旋转图内容,但在从原图预测旋转结果时准确率接近崩溃,揭示其旋转表征与最终文本读出之间存在断裂。

No Free Lunch for Synthetic Images under Data Scarcity Conditions Figure 1
2026-06-09cs.CV

No Free Lunch for Synthetic Images under Data Scarcity Conditions

Borja Arroyo Galende, Alejandro Almodóvar, Patricia A. Apellániz, Juan Parras, Silvia Uribe, Santiago Zazo

2026-06-09视觉感知

针对医疗等隐私敏感场景中真实图像稀缺、合成数据又需兼顾可用性与隐私的问题,本文提出同时评估保真度、隐私和下游效用的统一框架,比较 VAE、GAN 与 DDPM 在 MNIST、OCTMNIST、OrganAMNIST 上的表现。结果显示不存在“免费午餐”:增强差分隐私会牺牲至少一项指标,其中 GAN 和 DDPM 在噪声下更稳健,VAE 退化更快。

MOSS-Video-Preview: Toward Real-Time Video Understanding via Cross-Attention Figure 1
2026-06-09cs.CV

MOSS-Video-Preview: Toward Real-Time Video Understanding via Cross-Attention

Pengyu Wang, Chenkun Tan, Shaojun Zhou, Wei Huang, Qirui Zhou, Zhan Huang, Zhen Ye, Jijun Cheng, Xiaomeng Qian, Yanxin Chen, Xingyang He, Huazheng Zeng, Chenghao Wang, Pengfei Wang, Hongkai Wang, Shanqing Gao, Yixian Tian, Chenghao Liu, Xinghao Wang, Botian Jiang, Xipeng Qiu

Fudan University, Shanghai Innovation Institute, fully recorded and is available before generation begins: the model watches the clip through, then answers.

2026-06-09视觉感知

这篇论文针对智能眼镜、机器人等场景中视频仍在流入而模型已在回答的问题,强调“实时”关键在于生成不能阻塞感知。作者提出 MOSS-Video-Preview,用交叉注意力双通道让视觉特征走旁路,并合成带答案修订与静默监督的数据进行 SFT。结果显示其离线能力接近但总体仍落后 Qwen2.5-VL,可能主要来自 data / scaling;在单 H200、256 帧下 TTFT 约快 5 倍、解码吞吐高 2.7 倍,实时能力目前主要为定性验证。

Anchor-Conditioned Compositional Control for Landscape Image Generation Figure 1
2026-06-09cs.CV

Anchor-Conditioned Compositional Control for Landscape Image Generation

Gadha Lekshmi P, Govind Arun, Rohith Syam, Ahmed Elgammal

Rutgers University–New Brunswick, USA, University of Maryland–College Park, USA, University of Technology Sydney, Australia, lack controllability over composition, a capability that is, rated from multiple publicly available sources, including a, Experiments were conducted on Google Colab using an, available

2026-06-09视觉感知规划控制

本文针对扩散模型生成风景图时难以显式控制地平线、前景占比和视觉重心的问题,提出从训练图像自动提取4维构图锚点,并经傅里叶编码与独立交叉注意力通路注入微调模型,避免与文本 token 竞争。实验显示该方法在地平线检测率0.850、三分法对齐0.817上优于基线和消融;类别消融还表明同质场景训练可将地平线偏差最多降低40%,说明构图控制精度受数据类别影响。

Crayotter: Traceable Multi-Agent Workflows for Long-Form Video Editing Figure 1
2026-06-09cs.CV

Crayotter: Traceable Multi-Agent Workflows for Long-Form Video Editing

Lecheng Yan, Yichong Zhang, Ben Pan, Xiaoyu Zheng, Jiawei Qian, Anqi Wu, Wenxi Li, Chenyang Lyu

traces, and examples are publicly available at, role-based collaboration (Yao et al., 2022, also on controllable production workflows.

2026-06-09视觉感知生成模型

长视频剪辑需要在异构素材、叙事、时间线和后期工具间保持可追踪状态,避免小错误导致整体重做。Crayotter将流程拆为覆盖感知素材准备、基于产物的剪辑研究和工具落地执行,并把检索报告、分析、蓝图、工具调用和中间渲染显式化以支持诊断与局部修复。在23个主题上,人评均分3.40/5,高于CapCut-Mate的2.44和CutClaw的1.70。

NeuroAlign: Hierarchical Multimodal Fusion of Dynamic and Structural Neuroimaging for MCI Analysis Figure 1
2026-06-09cs.CV

NeuroAlign: Hierarchical Multimodal Fusion of Dynamic and Structural Neuroimaging for MCI Analysis

Xiongri Shen, Zhenxi Song, Jiaqi wang, Yi Zhong, Leilei Zhao, Chenqi Xu, Linling Li, Yichen Wei, Lingyan Liang, Demao Deng, Luping Song, Ping Luan, Ahmed M. Anter, Shuqiang Wang, Baiying Lei, Zhiguo Zhang

aDepartment of Computer Science and Technology, Harbin Institute of Technology (Shenzhen), Shenzhen, 518055, China, bSchool of Intelligence Science and Engineering, College of Artificial Intelligence, Harbin Institute of Technology, Shenzhen, 518055, China, c School of Artificial Intelligence, Beijing University of Posts and Telecommunications, Beijing, China, dGuangdong Key Laboratory of Biomedical Measurements and Ultrasound Imaging, School of Biomedical Engineering, Shenzhen University, Medical School, Shenzhen University, Shenzhen, 518055, China, eDepartment of Radiology, The People’s Hospital of Guangxi Zhuang Autonomous Region, Guangxi Academy of Medical Sciences, Guangxi, fShenzhen Sxith People’s Hospital (Nanshan Hospital), Huazhong University of Science and Technology Union Shenzhen Hospital, Shenzhen, gSchool of Basic Medical Sciences, Shenzhen University, Shenzhen, 518055, China, hthe Egypt-Japan University of Science and Technology (E-JUST), Alexandria, 21934, Egypt, iSchool of Biomedical Engineering, National-Regional Key Technology Engineering Laboratory for Medical Ultrasound, Guangdong Key, Laboratory for Biomedical, Measurements and Ultrasound Imaging, Shenzhen University Medical School, Shenzhen University, Shenzhen, j the Shenzhen Institutes of Advanced Technology, Chinese Academy of Sciences, Shenzhen, 518055, China

2026-06-09视觉语言

该文针对 fMRI/DTI 多模态认知障碍分析中功能—结构表征错位、动态/静态连接割裂和可解释性不足的问题,提出 NeuroAlign:用 DMHA 对齐多尺度 DFC、SFC 与结构特征,用 DDHI 在区域与连接域做细粒度到全局交互,并以 SAM 给出 DFC/SFC/ALFF/FA 归因图。在 GUTCM、ADNI、OASIS 五折验证中表现具竞争力,ADNI/OASIS 准确率约 0.825/0.735,跨站点迁移仍存在域差距。

AMN: An Adaptive Multi-Scale Fusion Network with Boundary and Uncertainty Modeling for Nuclei Segmentation Figure 1
2026-06-09cs.CV

AMN: An Adaptive Multi-Scale Fusion Network with Boundary and Uncertainty Modeling for Nuclei Segmentation

Spoorthi M, Suja Palaniswamy

2026-06-09视觉感知学习理论安全鲁棒

针对病理图像中细胞核类别形态尺度差异大、类别极不均衡且边界拥挤,单纯 CNN 或 Transformer 难以兼顾局部纹理与全局上下文的问题,AMN 采用 Swin Transformer 与 ResNet-50 双编码器,并以逐通道自适应门控在多尺度融合,同时加入边界头和不确定性调制损失以抑制过度自信错误。文中在 CoNIC 七类核分割上取得 mean Dice 0.82、mean F1 0.68,优于八个基线,并在 MoNuSeg 零重训练测试中显示一定跨域泛化。

Frankenstein in the Pipeline: Computational Epistemicide in Facial Recognition Figure 1
2026-06-09cs.CY

Frankenstein in the Pipeline: Computational Epistemicide in Facial Recognition

Nina da Hora

2026-06-09视觉感知

针对人脸识别批评常停留在数据偏差和误差率的问题,本文把检测、对齐、嵌入、阈值判定等流水线步骤作为认识论操作来分析,提出“计算性认识灭绝”:活的、关系性的面孔被压缩为可治理的向量代理。论文的主要结论是,伤害并非只来自实现不佳,而是来自以距离和“足够接近”来授权身份的结构,因此单纯提升公平性、校准或准确率不足,作者主张拒绝将向量化身份作为权利和准入依据。

Eyes All Around: Design and Analysis of 360-Degree LiDAR Perception Using Equivariant Feature Learning in Unstructured Traffic Figure 1
2026-06-09cs.CV

Eyes All Around: Design and Analysis of 360-Degree LiDAR Perception Using Equivariant Feature Learning in Unstructured Traffic

Pranav Darshan, Raghuveer Narayanan Rajesh, M Uttara Kumari

Department of Computer Science and Engineering, RV College of Engineering, Bengaluru 560059, India, Department of Electronics and Communication Engineering, Among the available sensing modalities, LiDAR, methods such as Complete & Label (Yi et al., 2021), (Shi et al., 2020) and CenterPoint (Yin et al., 2021), tions (Zhu et al., 2022) further improve scalability

2026-06-09视觉感知

面向印度等密集无序交通中遮挡多、参与者类型杂且360°视角下方位变化和扇区边界易破坏一致性的问题,论文构建了Ouster OS0全景LiDAR检测流程,将方位扇区划分、重叠处理与旋转等变稀疏卷积结合,用于分析全周感知中的鲁棒性。自采数据上汽车表现最好(92.02/90.51),公交和卡车次之,小目标行人与骑行者仍明显较难。

SENTRY: Statistical Reliability Analysis of Vision Transformers Under Soft Errors Figure 1
2026-06-09cs.CV

SENTRY: Statistical Reliability Analysis of Vision Transformers Under Soft Errors

Pramit Kumar Bhaduri, Mahdi Taheri, Samira Nazari, Maksim Jenihhin, Christian Herglotz, Michael Hubner

Brandenburg University of Technology Cottbus-Senftenberg, Germany, Tallinn University of Technology, Tallinn, Estonia, Zanjan University, Iran

2026-06-09视觉感知

面向自动驾驶、医疗等安全场景中 ViT 参数规模过大、穷举软错误注入不可行的问题,SENTRY 提出基于有限总体抽样的多粒度统计故障注入框架,在网络、层、组件和比特位置间逐步细化失效率估计。实验在 ViT-Tiny/Small 上约 5.1 万次注入即可给出 99% 置信、1% 误差界,较穷举最高降本 10700 倍;结果显示约 3% FP32 单比特翻转会失效且多为灾难性,风险集中在 LayerNorm 和指数位 Bit 30。

ScaleSweep: Accurate NVFP4 Post-Training Quantization of LLMs via Block Scale Initialization Figure 1
2026-06-09cs.LG

ScaleSweep: Accurate NVFP4 Post-Training Quantization of LLMs via Block Scale Initialization

Li Lin, Xiaojun Wan

Wangxuan Institute of Computer Technology, Peking University

2026-06-09视觉感知

针对 NVFP4 量化仍依赖 AbsMax/4⁄6 等启发式尺度初始化、与最优 FP8 block scale 存在差距的问题,本文提出 ScaleSweep:在理论推导的 MSE/WMSE 上下界内枚举可行块尺度,从而以很小搜索空间选择最小误差尺度,并可接入 RTN/GPTQ。Llama、Qwen 实验显示其在权重-激活、KV cache 与 query state 激进量化下优于现有初始化,最强设置仍保留超过 93% 全精度性能,推理开销接近默认算子。

Can You Trust What You See? Human and AI Detection of Synthetic Legal Evidence Figure 1
2026-06-09cs.CV

Can You Trust What You See? Human and AI Detection of Synthetic Legal Evidence

Jinzhe Tan, Ali Ekber Cinar, Karim Benyekhlef

Cyberjustice Laboratory, Faculty of Law, Universit´e de Montr´eal, Faculty of Law, McGill University, goods to obtain refunds, while platforms and service centers indicated that they

2026-06-09视觉感知

针对生成式 AI 使照片类法律证据不再天然可信的问题,论文构建 SLED-1400:200 张真实证据图与 1200 张由 6 个图像生成器产生的合成图,覆盖民事纠纷中常见的物体中心证据场景,并统一测试 136 名普通人和 4 个前沿多模态模型。结果显示,人类总体准确率仅 64.8%,面对最强生成器接近随机;MLLM 虽不误判真实图,却大量漏检高质量合成图,说明单靠人或模型都不足以完成证据认证。

DiffoR: A Unified Continuous Generative Framework for Universal Ordinal Regression Figure 1
2026-06-09cs.LG

DiffoR: A Unified Continuous Generative Framework for Universal Ordinal Regression

Hongxu Ma, Lin Wang, Chenghou Jin, Han Zhou, Jie Zhang, Xiaoyu Yang, Chunjie Chen, Jihong Guan, Shuigeng Zhou

Fudan University, Shanghai University of Finance and, Tongji University

2026-06-09生成模型

本文针对有序回归中离散化带来的量化误差、刚性边界和全局序关系建模不足,提出将任务改写为连续生成式有序回归。DiffoR用扩散模型迭代恢复连续目标,并通过多尺度增量聚合与动态去噪感知分别建模层级有序结构和粗到细语义频率。论文在12个跨四领域基准上报告稳定优于现有方法,但具体增益在多大程度来自框架设计仍需结合消融细看。

VisualLeakBench: Reproducible Action-Boundary Propagation Failures in Vision-Language Agents Figure 1
2026-06-09cs.CV

VisualLeakBench: Reproducible Action-Boundary Propagation Failures in Vision-Language Agents

Youting Wang, Yuan Tang, Yitian Qian, Chen Zhao

2026-06-09视觉语言视觉感知学习理论

本文关注视觉语言代理在截图、文档和界面中读取敏感或危险文本后,将其复制进工具参数的“动作边界传播”风险。作者提出 VisualLeakBench,用500张合成图和轨迹级诊断评估保存笔记、外部转发等流程。结果显示,基线下 PII 与不安全文本传播率分别达78.8%和85.5%;防御提示虽将 PII 降至2.0%,但多依赖抑制工具调用,且不安全文本仍有52.6%越过工具边界。

A Mechanistic Analysis of Adversarial Fine-tuning of Vision Transformers Figure 1
2026-06-09cs.CV

A Mechanistic Analysis of Adversarial Fine-tuning of Vision Transformers

Hannah Gao (Massachusetts Institute of Technology), Isha Agarwal (Massachusetts Institute of Technology), Dylan Hadfield-Menell (Massachusetts Institute of Technology), Rachel Ma (Massachusetts Institute of Technology)

2026-06-09视觉感知

面向VLM/VLA等系统中ViT感知模块在真实模糊、噪声下的可靠性,本文不只看鲁棒精调后的准确率,而是结合logit lens、注意力差异和SAE稀疏表征做机制分析。结果显示,在同类扰动上精调可提升性能与置信度,并让正确类别更早在层间出现,但低频到高频等跨扰动泛化有限;注意力和知识演化会变,稀疏表征未发生根本改变。

SlideCheck: Guiding Self-Supervised Pretraining of Pathology Foundation Models via Dataset Distributions Figure 1
2026-06-09cs.CV

SlideCheck: Guiding Self-Supervised Pretraining of Pathology Foundation Models via Dataset Distributions

Mingyi He, Xinyi Guo, Xitong Ling, Weiming Chen, Jiawen Li, Lianghui Zhu, Minxi Ouyang, Mingxi Fu, Yizhi Wang, Tian Guan

Beijing University of Chemical Technology, South China Normal University, Tsinghua University

2026-06-09数据集/基准

病理基础模型常以WSI切片级弱标签构建patch预训练集,难以知道哪些异常或癌变形态真正进入数据。SlideCheck在冻结病理特征上用双头MLP分别评分异常与恶性,并结合MIL注意力挖掘伪标签,用于筛选和审计ViT自监督预训练子集。实验显示其定义的数据分布会影响下游AUC,25%精选子集接近全量表现;但文中也指出模型尺度影响更大,增益可能主要来自scaling / data composition而非单一采样比例。

Multimodal Group Emotion Recognition In-the-Wild Towards a Privacy-Safe Non-Individual Approach Figure 1
2026-06-09cs.CV

Multimodal Group Emotion Recognition In-the-Wild Towards a Privacy-Safe Non-Individual Approach

Anderson Augusma

2026-06-09视觉语言视觉感知安全鲁棒

针对野外群体情绪识别依赖人脸、凝视或声纹带来的隐私与监控风险,论文转向仅使用群体级音视频信号。核心创新是交叉注意力音视频融合与帧注意力池化,并提出VE-MD共享潜空间联合学习情绪分类和身体/面部结构表征,比较DETR与热图解码。实验称在真实场景具备鲁棒性并达到竞争性或SOTA表现,但具体指标与增益来源在给定片段中未充分说明。

OmniMem: Perturbation-aware Memory Compression for Streaming Audio-Visual LLMs Figure 1
2026-06-09cs.AI

OmniMem: Perturbation-aware Memory Compression for Streaming Audio-Visual LLMs

Guangzhi Sun, Yixuan Li, Yudong Yang, Chao Zhang

Tsinghua University, Department of Engineering, University of Cambridge, signals are available. The second is token selection

2026-06-09视觉感知

长视频音视LLM在流式推理中KV缓存随时长线性膨胀,且音频/视觉token严重不均衡,使统一压缩容易丢失音频线索。OmniMem提出按层、按模态分配预算的AVBA,并用注意力重要性结合value余弦冗余来选择对输出扰动最小的KV状态,还加入预算感知微调。其在VideoMME Long、LVBench、LVOmniBench上相同内存预算较强无训练基线提升约2–4个百分点,微调后再增1–2个百分点。

A Systematic Study of Behavioral Cloning for Scientific Data Annotation Figure 1
2026-06-09cs.HC

A Systematic Study of Behavioral Cloning for Scientific Data Annotation

Ishaan Singh Chandok, Core Francisco Park

Department of Physics, Harvard University, Cambridge, MA, cess as a direct mapping from data to labels, optimizing, quality annotations are produced, not just the final labels.

2026-06-09视觉感知

论文针对科学数据标注中自动化后仍需人工验证纠错的“最后一公里”问题,提出用行为克隆学习专家在 GUI 中的导航、点击与修正过程,并构建9个合成标注任务作为可控基准。实验显示模型先学会界面操作再学关键决策,大模型在多任务训练中更省数据,预训练可迁移到新任务;线性探针还发现跨任务共享的错误表征,但结论主要限于合成任务与25M–320M规模。

Page image classifier fine-tuned on century-spanning archives of scanned documents for further content-specific processing Figure 1
2026-06-09cs.CV

Page image classifier fine-tuned on century-spanning archives of scanned documents for further content-specific processing

Kateryna Lutsai, Pavel Straňák, David Novák, Dana Křivánková

2Institute of Formal and Applied Linguistics, Charles University MFF, Malostransk´e, Institute of Archaeology, Czech Academy of Sciences, Letensk´a, Prague, 11800, Czech, Document Image Transformers (ViT, DiT), and multimodal CLIP models. An 11-category label, scheme was designed collaboratively with domain experts and evaluated via five-fold cross-validation., racy and produce consistent labels across 649,508 unlabeled archival pages with over 90% inter-model, with image-only models on unlabeled data, making it less suitable for deployment. The final models, annotated dataset, and software are publicly available under open-source licenses., resources available for curation., is available in the accompanying thesis [4].

2026-06-09视觉感知

面向人文档案数字化中扫描页类型混杂、缺少元数据且难以人工分拣的问题,本文构建经专家多轮校订的4.8万页捷克考古档案数据集和11类视觉标签,系统比较手工特征、CNN、ViT/DiT与CLIP微调。结果显示传统随机森林约75%准确率,而RegNetY-16GF、ViT-large等图像模型在测试集达约99.1%,并在64.9万未标注页上保持较高一致性;CLIP虽测试分高但部署一致性不足。

Multimodal Large Language Models as Synthetic Participants in Video-Based Studies: An Evaluation Figure 1
2026-06-09cs.HC

Multimodal Large Language Models as Synthetic Participants in Video-Based Studies: An Evaluation

Prabal Shrestha, Bohan Jiang, Haoning Xue, Huan Liu, Xinyi Zhou

2026-06-09视觉语言视觉感知数据集/基准

本文针对视频人群研究中真人受试者成本高、MLLM能否替代主观反馈仍不清的问题,以短视频感知感官参与度为任务,基于PMSV量表比较673名真人与按个人画像条件化的Gemini 3 Flash、Qwen 3 Omni模拟评分。结果显示,两者与人类一致性显著低于人—人基线,并存在均值下移、中心化和群体差异扭曲;提示策略仅带来混合影响,说明视频理解能力并不等同于可靠模拟主观人类反应。

CAPruner: Conceptual-Adjacent Scene Graph Pruner for Enhancing 3D Spatial Reasoning of Large Language Models Figure 1
2026-06-09cs.CL

CAPruner: Conceptual-Adjacent Scene Graph Pruner for Enhancing 3D Spatial Reasoning of Large Language Models

Shengli Zhou, Xiangchen Wang, Guanhua Chen, Feng Zheng

Southern University of Science and Technology

2026-06-09三维

该文针对3D-VL中完整场景图关系数随物体数平方增长、而KNN近邻剪枝易删掉任务关键长程关系的问题,提出CAPruner:结合查询相关的模糊语义匹配与空间距离为边打分,并用目标节点邻边聚合分数进行弱监督,避免逐关系标注。实验显示其能更好保留空间推理所需关系,提升LLM在3D-VL任务上的表现。

2026-06-08

113 篇
UniSHARP: Universal Sharp Monocular View Synthesis Figure 1
2026-06-08cs.CV

UniSHARP: Universal Sharp Monocular View Synthesis

Meixi Song, Dizhe Zhang, Hao Ren, Ruiyang Zhang, Bo Du, Ming-Hsuan Yang, Lu Qi

Sun Yat-sen University, Beihang University, Wuhan University, University of California, Merced

2026-06-08视觉感知

针对现有单目3DGS(如SHARP)依赖针孔相机、难以泛化到广角/鱼眼/全景输入的问题,UniSHARP将高斯预测改到统一的射线-距离空间,并融合2D语义与3D空间特征,在潜空间而非图像空间对齐不同相机;还支持无内参的射线场推断。作者构建按FoV分层的多相机基准,结果显示其在透视、广角、鱼眼和全景新视角合成上均显著优于PanoDreamer、Matrix3D等基线。

MemDreamer: Decoupling Perception and Reasoning for Long Video Understanding via Hierarchical Graph Memory and Agentic Retrieval Mechanism Figure 1
2026-06-08cs.CV

MemDreamer: Decoupling Perception and Reasoning for Long Video Understanding via Hierarchical Graph Memory and Agentic Retrieval Mechanism

Cong Chen, Guo Gan, Kaixiang Ji, ChaoYang Zhang, Zhen Yang, Guangming Yao, Hao Chen, Jingdong Chen, Yi Yuan, Chunhua Shen

Ant Group, 2Zhejiang University, 3Central South University

2026-06-08视觉感知

针对小时级视频中全量帧输入导致 token 爆炸、注意力稀释和长程因果线索丢失的问题,MemDreamer 将感知与推理解耦:先流式构建包含 Video Root、Super/Macro Event 与实体事件关系的层级图记忆,再由推理模型通过工具化 Observation-Reason-Action 检索导航。实验在四个长视频基准达 SOTA,LVBench 较端到端提升 12.5 点且仅用约 2% 上下文,并观察到 agentic 推理能力与长视频表现强相关。

Streaming Video Generation with Streaming Force Control Figure 1
2026-06-08cs.CV

Streaming Video Generation with Streaming Force Control

Hanhui Wang, Yiming Xie, Haiwen Feng, Zhaoyang Lv, Shenlong Wang, Huaizu Jiang

Northeastern University, University of California, Berkeley, University of Illinois Urbana-Champaign

2026-06-08视觉感知规划控制

论文针对现有视频生成难以在生成过程中接受可变物理力并实时反馈的问题,提出 StreamForce:用像素对齐的掩码力图统一表示局部推力与全局环境力,并将力条件双向教师蒸馏为因果自回归学生,配合时变力数据保持力-运动对应。结果显示其在单 H200 上以 832×480 达到 16.6 FPS、约 0.6 秒延迟,并在力遵循与运动真实感上优于已有方法。

Differences in Detection: Explainability Where it Matters Figure 1
2026-06-08cs.CV

Differences in Detection: Explainability Where it Matters

Johannes Theodoridis, Johannes Maucher, Andreas Schilling

University of Tübingen, Institute for Applied AI

2026-06-08视觉感知

目标检测常用 mAP/TIDE 只能分别评估模型,难回答两个检测器是否识别同一批目标、错误是否重合。论文提出 DnD,沿用 mAP 匹配,将真值划分为两者都检出、仅一方检出、都漏检等集合,并结合 TIDE 错误形成直观混淆分析。主要结果是提供实例级、与指标相关的对比子集,可指导 ODAM 等解释方法聚焦关键样本;文中未充分说明显著量化性能增益。

Implicit Data Synthesis for Contrastive Unsupervised Data Augmentation Figure 1
2026-06-08cs.CV

Implicit Data Synthesis for Contrastive Unsupervised Data Augmentation

Patrick Kage, Trevor Hedges, N. Siddharth, Pavlos Andreadis

School of Informatics, The University of Edinburgh, Massachusetts Institute of Technology Lincoln Laboratory

2026-06-08视觉感知

针对科学观测数据标注昂贵且常规图像增强会破坏物理含义的问题,论文将 SimCLR 的正样本生成从数据空间移到权重空间:在编码器单个全连接层加入有界随机扰动,形成隐式数据合成。合成流星雷达数据和 CIFAR-10 实验显示,浅层 CNN 上 IDS 可匹配或优于翻转旋转基线;但在流星数据的深层 ResNet 上单点扰动不足,增益并不稳定。

Planning-aligned Token Compression for Long-Context Autonomous Driving Figure 1
2026-06-08cs.RO

Planning-aligned Token Compression for Long-Context Autonomous Driving

Zhixuan Liang, Yuxiao Chen, Yurong You, Peter Karkus, Wenhao Ding, Boyi Li, Alexander Popov, Yan Wang, Maximilian Igl, Yiming Li, Danfei Xu, Nikolai Smolyanskiy, Boris Ivanovic, Ping Luo, Marco Pavone

2026-06-08规划控制

本文针对端到端 VA/VLA 自动驾驶在长时序上下文下 token 过多、而简单时间衰减压缩会丢失让行/停车等关键历史线索的问题,提出 COMPACT-VA:用条件 VQ-VAE 与 Q-former 将压缩记忆和轨迹规划意图耦合,并以分层 FIFO 保留近远期信息。在四向停车、遮挡、无保护转弯等高信号场景中,其成功率达 68.3%,较基线提升约 6.3%,roll-through 降低 22%,同时闭环评测实现 3.3× 加速和 2.7× 显存/内存降低。

TEVI: Text-Conditioned Editing of Visual Representations via Sparse Autoencoders for Improved Vision-Language Alignment Figure 1
2026-06-08cs.CV

TEVI: Text-Conditioned Editing of Visual Representations via Sparse Autoencoders for Improved Vision-Language Alignment

Sweta Mahajan, Sukrut Rao, Jiahao Xie, Alexander Koller, Bernt Schiele

Max Planck Institute for Informatics, Saarland Informatics Campus, Saarbrücken, Germany, Department of Language Science and Technology, Saarland University, Saarbrücken, Germany

2026-06-08视觉语言视觉感知

论文针对 CLIP 类视觉语言模型中图像信息多于文本描述导致的模态间隙,提出 TEVI:先用稀疏自编码器将图像嵌入分解为概念潜变量,再由文本条件掩码选择性重构,只保留 caption 涉及的信息。合成实验验证其能保留目标属性、丢弃无关属性;在 COCO、Flickr、DOCCI、IIW 和 RoCOCO 上提升检索、对齐与语言扰动鲁棒性,长描述场景收益更明显,但推理需逐图文条件化,计算成本较高。

Skill-3D: Evolving Scene-Aware Skills for Agentic 3D Spatial Reasoning Figure 1
2026-06-08cs.CV

Skill-3D: Evolving Scene-Aware Skills for Agentic 3D Spatial Reasoning

Haoyuan Li, Zhengdong Hu, Jun Wang, Hehe Fan, Yi Yang

Zhejiang University, Hangzhou, China, University of Technology Sydney, Sydney, Australia, OPPO Research Institute, Shenzhen, China

2026-06-08三维

本文针对现有 MLLM 3D 空间推理代理在不同室内场景中套用统一工具流程、导致工具误用和收益有限的问题,提出 Skill-3D:用场景记忆记录成功/失败工具轨迹,并蒸馏为可演化的场景感知技能,在推理和后训练中指导工具选择。实验显示其将 VSI-Bench 有效工具使用率从 39% 提升到 78%,Gemini-3-Flash 在 MMSI-Bench 提升 67%,Qwen3-VL-8B 后训练在 VSI-Bench 提升 43%。

The Lipreading Gap: Do VSR Models Perceive Visual Speech Like Human Lipreaders? Figure 1
2026-06-08cs.CV

The Lipreading Gap: Do VSR Models Perceive Visual Speech Like Human Lipreaders?

Rishabh Jain, Naomi Harte

Sigmedia Group, School of Engineering, Trinity College Dublin, Ireland

2026-06-08视觉感知

本文质疑VSR低WER是否等同于类人唇读感知,利用MaFI人类唇读数据,将Auto-AVSR、AV-HuBERT和VSP-LLM在词、字符、音素、视素层面与人类对齐比较。核心发现是模型总体准确率虽高,但成败词和混淆模式不同于人类;仅给初始音素的文本n-gram已接近人类,模型错误更受训练词频而非视觉清晰度解释,说明当前VSR主要依赖语言捷径而非稳健视觉发音理解。

Watch, Remember, Reason: Human-View Video Understanding with MLLMs Figure 1
2026-06-08cs.CV

Watch, Remember, Reason: Human-View Video Understanding with MLLMs

Jiahao Meng, Yue Tan, Qi Xu, Kuan Gao, Weisong Liu, Yanwei Li, Jason Li, Lingdong Kong, Haochen Wang, Qianyu Zhou, Jiangning Zhang, Guangliang Cheng, Yunhai Tong, Lu Qi, Minghsuan Yang

J. Meng, Y. Tan, and Y. Tong are with School of Intelligence Science and Technology, Peking University., Q. Xu and L. Qi are with Wuhan University., K. Gao and Y. Li are with Shanghai Jiao Tong University., J. Li is with Nanyang Technological University., Q. Zhou is with the University of Tokyo., G. Cheng is with the University of Liverpool., J. Zhang is with Zhejiang University., L. Kong is with the National University of Singapore.

2026-06-08视觉感知

长视频 MLLM 面临证据稀疏、长程依赖和算力受限,单纯按任务梳理难以解释系统瓶颈。本文提出“观看-记忆-推理”的人类视角综述框架,把感知表示、记忆状态、推理轨迹和预测统一起来,覆盖细粒度定位、多模态感知、长视频压缩、离线/流式记忆与基于证据的推理,并系统整理应用、训练数据和评测基准;文中主要结果是方法学版图与开放问题总结,而非新的实验增益。

OpenGlass: Open-Source Smart Glasses for On-Device Event-Based Gesture Recognition Figure 1
2026-06-08cs.CV

OpenGlass: Open-Source Smart Glasses for On-Device Event-Based Gesture Recognition

Pietro Bonazzi, Julian Moosmann, Ahmet Celik, Philipp Mayer, Michele Magno

2026-06-08视觉感知

面向智能眼镜在隐私、低时延与续航约束下难以承载本地视觉智能的问题,OpenGlass提供开源模块化硬件:以FPC转接同时支持事件相机与RGB相机,并用nRF5340事件唤醒和PMIC管理使GAP9推理间休眠。原型200 mAh电池可连续本地ML约11.8小时;在LynX手势识别中,R(2+1)D跨被试准确率83.94%、宏F1为0.781,端到端延迟33.9 ms。

DisPOSE: Projected Polystochastic Diffusion for Self-Supervised Multi-View 3D Human Pose Estimation Figure 1
2026-06-08cs.CV

DisPOSE: Projected Polystochastic Diffusion for Self-Supervised Multi-View 3D Human Pose Estimation

Tony Danjun Wang, Tolga Birdal, Nassir Navab

2026-06-08生成模型三维

针对多视角多人 3D 姿态中视角间人员匹配离散、遮挡严重且自监督方法受合成姿态域偏移影响的问题,DisPOSE 将匹配建模为多随机张量空间上的投影扩散,并用可微 Sinkhorn 约束可行分配,再以超图卷积解码完整骨架。实验称其在 CMU Panoptic 的 AP25 较自监督 SOTA 提升 19%,新相机布局 mAP 达 75% 对 59%,且 10% 伪标签保留 99% 性能。

RealDocBench: A Benchmark for Field-Level QA and Layout Understanding on Real-World Regulated Documents Figure 1
2026-06-08cs.CV

RealDocBench: A Benchmark for Field-Level QA and Layout Understanding on Real-World Regulated Documents

Ameya Joshi, Joon Kim, Gus Eggert, Joseph Bajor, Cindy Hao, Jing Reyhan, Kushal Byatnal, Eli Badgio

2026-06-08强化学习数据集/基准

面向抵押、金融、物流和医疗等受监管流程,现有文档解析基准多用干净版面和整页相似度,难反映代理真正需要的字段值正确性。RealDocBench用581份真实文档构建字段级QA,并配套1500页九类布局标注,以类型容忍评分和邻接感知匹配统一评测18个系统。结果显示系统差距被单一指标掩盖,医疗子域持续困难,且准确率需与单页成本和冷缓存延迟一起权衡。

Mind the Gap: Disentangling Performance Bottlenecks in Video Instance Segmentation Figure 1
2026-06-08cs.CV

Mind the Gap: Disentangling Performance Bottlenecks in Video Instance Segmentation

Danial Hamdi, Fardin Ayar, Mahdi Javanmardi

2026-06-08视觉感知

针对视频实例分割中分类、分割与跟踪误差被统一指标混在一起、难以定位瓶颈的问题,论文提出基于整数线性规划的模型无关 oracle,分层隔离身份关联、语义分类和掩码质量误差,并配套 TrackLens 可视化查询级失败模式。对 7 种在线/离线方法在 YTVIS 与 OVIS 上分析发现,在线方法的核心瓶颈是长期跟踪不稳定,遮挡下跟踪缺口可超过 20 AP,且随视频长度和实例密度显著增大;更强 backbone 提升默认 AP,却基本不消除跟踪缺口。

Impact of Synthetic Lesional MR Images in Automated Focal Cortical Dysplasia Detection in Low-Data Scenarios Figure 1
2026-06-08eess.IV

Impact of Synthetic Lesional MR Images in Automated Focal Cortical Dysplasia Detection in Low-Data Scenarios

Prabhjot Kaur, Hakim Ouaalam, Sedat Kandemirli, Sanjay P. Prabhu, Simon K. Warfield

Computational Radiology Laboratory, Boston Children’s Hospital, Harvard Medical School, Computational Radiology Laboratory​, Boston Children’s Hospital, Harvard Medical School​, reducing labeled data needs by ~20% while maintaining equivalent sensitivity. Equivalent, amounts of real data, when available, remain more effective than synthetic augmentation.

2026-06-08视觉感知

针对FCD自动检测依赖昂贵体素级病灶标注、低数据场景难训练的问题,论文将GMM生成的类FCD掩膜嵌入健康脑MRI,并用条件生成网络合成带标签T1/FLAIR数据,而非从零生成整脑。合成图像较难被专家区分;加入合成数据使nnU-Net敏感性提升8.14%、病灶置信度显著提高,但同等规模真实数据效果更强,说明收益可能主要缓解标注不足而不能替代真实数据。

Beyond Backscatter: InSAR coherence from detected SAR images Figure 1
2026-06-08eess.SP

Beyond Backscatter: InSAR coherence from detected SAR images

Francescopaolo Sica, Andrea Pulella, Michael Schmitt

Department of Aerospace Engineering, University of the Bundeswehr Munich, Neubiberg, Germany, Microwaves and Radar Institute, German Aerospace Center (DLR), Weßling, Germany

2026-06-08视觉感知

干涉相干性对形变监测、变化检测和任务设计很有用,但传统估计依赖精确配准的 SLC,计算和数据门槛高。本文用由 SLC 生成的相干图监督 Residual U-Net,仅输入两期检测 SAR 后向散射,在无需亚像素配准的情况下回归高分辨率相干性。实验显示其优于既有强度代理方法,并能跨地区、极化、频率及未见过的时间基线泛化,还可用于 GEE 等 GRD 分析就绪数据。

Mitosis Detection in the Wild: Multi-Tumor and Context-Aware Generalization in the MIDOG 2025 Challenge Figure 1
2026-06-08cs.CV

Mitosis Detection in the Wild: Multi-Tumor and Context-Aware Generalization in the MIDOG 2025 Challenge

Marc Aubreville, Jonas Ammeling, Sweta Banerjee, Viktoria Weiss, Taryn A. Donovan, Robert Klopfleisch, Jiaqi Lv, Shan E Ahmed Raza, Raphaël Bourgade, Thomas Walter, Yasemin Topuz, Songül Varlı, Charles-Antoine Collins-Fekete, Zhuoyan Shen, Navya Sri Kelam, Nitin Singhal, Christian Marzahl, Brian Napora, Tengyou Xu, Hongyan Gu, Mario Vento, Gennaro Percannella, Norbert Ropiak, Izabela Wasiak, Jie Xiao, Shaojun Liu, Seungho Choe, April Khademi, Vidushi Walia, Sujatha Kotte, Andrew Broad, Alex Wright, Guillaume Balezo, Esha Sadia Nasir, Mostafa Jahanifar, Yosuke Yamagishi, Shouhei Hanaoka, Mattia Sarno, Francesco Tortorella, Biwen Meng, Jingxin Liu, Sara Krauss, Daniel Hieber, Lavish Ramchandani, Dev Kumar Das, Mieko Ochi, Yuan Bae, Piotr Giedziun, Mateusz Maniewski, Vangala Govindakrishnan Saipradeep, Naveen Sivadasan, Leire Benito-Del-Valle, Adrian Galdran, Kaustubh Atey, Sameer Anand Jha, Adinath Dukre, Imran Razzak, Maxime W. Lafarge, Viktor H. Koelzer, Nils Porsche, Nikolas Stathonikos, Mitko Veta, Dominik Hirling, Zsanett Zsófia Iván, Peter Horvath, Katharina Breininger, Christof A. Bertram

2026-06-08视觉感知学习理论

为推动有丝分裂检测从精选热点区走向真实病理全切片应用,MIDOG 2025在365例、12类人/犬/猫肿瘤及多扫描平台上,同时评估热点、随机和“伪阳性丰富”困难区域,并加入非典型有丝分裂分类。结果显示检测最高F1为0.740、分类平衡准确率0.908;离开热点区后误报率上升208%,罕见或高度多形性肿瘤暴露明显盲点。集成平均带来约1.5/1.3个百分点增益,TTA基本无效。

Dash2Sim: Closed-Loop Driving Simulation from in-the-wild Dashcam Videos Figure 1
2026-06-08cs.CV

Dash2Sim: Closed-Loop Driving Simulation from in-the-wild Dashcam Videos

Anurag Ghosh, Francesco Pittaluga, Khiem Vuong, Angela Chen, Juan Alvarez-Padilla, Manmohan Chandraker, Srinivasa Narasimhan

Carnegie Mellon University, NEC Labs America, referenced 3D reconstruction at metric scale (center). Long-tailed objects such as cones, barrels, and barricades, ∗Work done at Carnegie Mellon University, platforms, spans more cities and unusual situations than any publicly available autonomous vehicle, maintained map, yields a scalable, annotation-free signal of data quality (Fig. A.1). This allows us to

2026-06-08视觉感知

针对车队数据城市覆盖窄、合成长尾场景真实感不足的问题,Dash2Sim 将野外单目行车记录仪视频恢复为具备尺度和地理参考的 4D 驾驶日志,并用独立地图进行免标注闭环可用性验证。作者构建 ROADWork4D,覆盖 17 城 4,244 个施工场景和 270 万 3D 对象;在 2,201 个验证场景上,规则/混合规划器明显优于学习式方法但仍难处理施工导流换道,恢复深度还使新视角合成感知指标最高提升 19%。

Spatial-Temporal Decoupled Adapter for Micro-gesture Online Recognition Figure 1
2026-06-08cs.CV

Spatial-Temporal Decoupled Adapter for Micro-gesture Online Recognition

Xucheng Shen, Kun Li, Fei Wang, Wei Qian, Jin Jiang, Dan Guo

2026-06-08视觉感知

本文针对未裁剪视频中微手势持续时间短、动作幅度小且类别长尾导致在线定位与分类困难的问题,提出在冻结视频骨干中插入时空解耦 Adapter,用轻量深度卷积分支分别建模时间动态与局部空间线索,并以自适应软均衡增强按类别稀缺性和学习难度调节增广强度。方法在 SMG 数据集/第4届 EI-MiGA-IJCAI Track 2 上取得 F1=0.43808、排名第一,但边界定位精度仍被作者认为有限。

VeriDrive: Verifiable Counterfactual Supervision for Cost-Efficient Vision-Language Planning Figure 1
2026-06-08cs.CV

VeriDrive: Verifiable Counterfactual Supervision for Cost-Efficient Vision-Language Planning

Zikai Zhang, Hubert P. H. Shum, Toby P. Breckon

2026-06-08视觉语言视觉感知规划控制

针对自动驾驶视觉语言规划中自由文本推理难验证、依赖前沿模型生成而成本高的问题,VeriDrive将监督改写为“感知—评估—修正”结构,用未来运动证据、规则检查的反事实轨迹评估和专家意图修正生成可审计QA,并通过本地生成加验证器选择性纠错降本。在nuScenes/Omni-Q开环实验中,相比OmniDrive改善L2、碰撞和路口指标,同时减少token、生成时间和估算GPT费用,但结论仍限于开环安全代理指标。

Varifold Moment Invariants for Sustainable and Explainable Contour Feature Extraction Figure 1
2026-06-08cs.CV

Varifold Moment Invariants for Sustainable and Explainable Contour Feature Extraction

G. Longari, J.-C. Alvarez Paiva, A.B. Tumpach

triangles or distances from random tangent and normal lines to the center of mass), yielding, triangles or signed distances from tangent lines to the center of mass, can be expressed in terms of Varifold

2026-06-08视觉感知

针对轮廓分类中平移、旋转/尺度不变特征常依赖重模型且解释性弱的问题,论文提出 Varifold Moment Invariants,将区域、边界及切线几何统一到 varifold 矩积分框架,并覆盖 Hu/复矩、EGI 等经典描述子。配合 RF/MLP,在物体、叶片、细胞数据集上以少量可解释特征取得接近或优于多种基线的 F1,同时显著降低特征提取计算成本;但特征仍偏手工设计。

AnchorWorld: Embodied Egocentric World Simulation with View-based Evolution Customization Figure 1
2026-06-08cs.CV

AnchorWorld: Embodied Egocentric World Simulation with View-based Evolution Customization

Yu Li, Menghan Xia, Gongye Liu, Xintao Wang, Conglang Zhang, Lei Ke, Yuxuan Lin, Ruihang Chu, Pengfei Wan, Kun Gai, Yujiu Yang

Tsinghua University

2026-06-08强化学习

本文针对第一人称交互世界模型难以同时表达真实身体动作控制与局部场景可定制演化的问题,提出 AnchorWorld:用3D全身运动驱动自我视角视频,并引入外部视角辅助监督弥补自我视角中身体缺失;同时以带位姿的 anchor view 结合文本演化提示,在统一世界坐标中约束局部外观、位置和动态变化。实验显示其在动作准确性、场景一致性和可控演化上优于改造基线,并在大视角变化、初始视角与锚点重叠较少时仍有较好泛化。

CULTURESCORE: Evaluating Cultural Faithfulness in Video Generation Models Figure 1
2026-06-08cs.CV

CULTURESCORE: Evaluating Cultural Faithfulness in Video Generation Models

Anku Rani, Wei Dai, Shravan Nayak, Pattie Maes, Mahdi M. Kalayeh, Paul Pu Liang

Massachusetts Institute of Technology, Mila – Quebec AI Institute

2026-06-08视觉感知

视频生成模型已具备较强视觉质量,但现有评测偏重清晰度、时序一致性,难以发现把 Namaste 误生成握手等文化失真。论文提出 CultureScore,将文化忠实度拆为身份、场景语境与行为三维,并用覆盖10国、5类社会文化场景的提示与QA评测三种模型。结果显示最佳总体仅56.8%,行为维度均低于52%,且人类偏好与VideoScore相反,说明视觉质量指标会掩盖文化失败。

Closed-Form Spectral Regularization for Multi-Task Model Merging Figure 1
2026-06-08cs.LG

Closed-Form Spectral Regularization for Multi-Task Model Merging

Yongxian Wei, Runxi Cheng, Xingxuan Zhang, Li Shen, Chun Yuan, Peng Cui, Dacheng Tao

2026-06-08视觉感知

针对多任务模型合并中 WUDI/OptMerge 需数百步优化且闭式伪逆反而效果差的问题,论文指出迭代下降的关键作用是对病态正规方程做隐式谱正则,抑制小特征值方向的代理噪声放大。基于此提出 SWUDI/SWUDI-A,用单次逐层特征分解实现软指数滤波与自适应截断,无需数据和优化器状态;在视觉、语言及多模态合并基准上达到或超过现有方法,并将耗时降低 28–72 倍、显存最高降 50%。

ExMesh: EXplicit Mesh Reconstruction with Topology Adaptation Figure 1
2026-06-08cs.CV

ExMesh: EXplicit Mesh Reconstruction with Topology Adaptation

Chuanjin Fan, Lifan Wu, Wenjie Chang, Hanzhi Chang, Wenfei Yang, Tianzhu Zhang

University of Science and Technology of China, National Key Laboratory of Deep Space Exploration, Deep Space Exploration Laboratory

2026-06-08三维

多视图重建若依赖 NeRF/SDF、Gaussian 到网格的后处理,容易带来碎片、锐边丢失和面数冗余;ExMesh 选择直接优化显式网格,在可微渲染的连续优化中插入离散顶点分裂/合并,并同步维护 UV,使复杂区域细化、退化或冗余面被合并,纹理与几何解耦。实验表明其在重建精度、计算效率和网格简洁性之间取得较好折中,但自适应策略的更自动化调参仍是未来工作。

Geometric-Aware Hypergraph Reasoning for Novel Class Discovery in Point Cloud Segmentation Figure 1
2026-06-08cs.CV

Geometric-Aware Hypergraph Reasoning for Novel Class Discovery in Point Cloud Segmentation

Zihao Zhang, Aming Wu, Yang Li, Yahong Han, Jialie Shen

School of Artificial Intelligence, College of Intelligence and Computing, Tianjin University, China, School of Computer Science and Information Engineering, Hefei University of Technology, China, Department of Computer Science, City St George’s, University of London, UK

2026-06-08视觉感知三维

面向开放世界点云分割中训练类不完备的问题,论文关注如何利用已知类推断未标注新类。其核心是把类别原型组织为超图,用超边建模多类之间的高阶几何与语义关联,并引入几何感知原型及动态超边更新,缓解仅靠两两关系和语义特征带来的歧义。实验在 SemanticKITTI 与 SemanticPOSS 上较既有 NCD 方法取得明显提升,但具体增益来源仍需结合消融进一步判断。

Reconstructing Multi-Decadal Forest Disturbances: A Spatio-Temporal Transformer Approach Figure 1
2026-06-08cs.CV

Reconstructing Multi-Decadal Forest Disturbances: A Spatio-Temporal Transformer Approach

Linus Scheibenreif, Anton Raichuk, Maxim Neumann

2026-06-08视觉感知

针对传统森林扰动监测按像素分析、缺乏空间上下文而易产生噪声和碎片化结果的问题,本文用时空 Transformer 同时建模 Landsat 等卫星时间轨迹与邻域结构,并以弱标签训练、人工标注集和火灾边界数据验证。模型能生成更连贯的扰动图,在 MTBS ±1 年检测精度最高 98.2%、F1 75.8%,但在不同扰动类型上相对像素基线仍有取舍。

Beyond Waypoints: A Trajectory-Centric Waypointing Paradigm for Vision-Language Navigation Figure 1
2026-06-08cs.RO

Beyond Waypoints: A Trajectory-Centric Waypointing Paradigm for Vision-Language Navigation

Haoxiang Shi, Xiang Deng, Haoyu Zhang, Qiaohui Chu, Yaowei Wang, Liqiang Nie

Harbin Institute of Technology (Shenzhen), Pengcheng Laboratory, Harbin Institute of Technology (Shenzhen) Shenzhen China, Pengcheng Laboratory Shenzhen China

2026-06-08机器人视觉语言视觉感知规划控制

这篇论文针对 VLN-CE 中传统“预测离散路标—选择—控制执行”流程容易产生不可达目标和规划/控制不一致的问题,提出 Trajectory Waypoint 范式:用 TSDF 代价引导的扩散策略生成多条可执行、避障轨迹,并让导航器直接基于轨迹几何和时序信息做语言条件选择。实验在 VLN-CE 基准上显示,其路标可达性(%Open)和下游导航性能均优于现有基线。

Does Appearance Help? A Systematic Study of Image-Based Re-Identification in Online 3D Multi-Pedestrian Tracking Figure 1
2026-06-08cs.CV

Does Appearance Help? A Systematic Study of Image-Based Re-Identification in Online 3D Multi-Pedestrian Tracking

Eduardo Borges, Luís Garrote, Urbano J. Nunes

Authors are with the Institute of Systems and Robotics, Department of Electrical and Computer Engineering, University of Coimbra, Portugal.

2026-06-08视觉感知三维

面向移动机器人在人群中因遮挡、拥挤导致仅靠 LiDAR 几何关联易丢失行人身份的问题,论文系统评估将 RGB ReID 接入在线 3D 多行人跟踪的作用。其核心洞察是外观信息不能简单与运动代价线性融合,而应作为级联的二阶段恢复机制;在 KITTI 行人实验中,线性融合因视觉噪声反而降级,级联匹配能减少 ID 切换并恢复遮挡轨迹,轻量 CNN/MGN 比重型 Transformer 更适合实时延迟约束。

DualGate-Net: A Prior-Gated Dual-Encoder Framework for Histopathology Cell Detection Figure 1
2026-06-08cs.CV

DualGate-Net: A Prior-Gated Dual-Encoder Framework for Histopathology Cell Detection

Bahman Jafari Tabaghsar, Son Tran, K. Devaraja, Atul Sajjanhar

2026-06-08视觉感知

病理细胞检测中,相似细胞会因组织微环境不同而类别不同,但现有组织先验常以静态拼接融合,易把噪声传入模型。DualGate-Net用ConvNeXtV2局部编码器和SegFormer全局编码器建模细胞形态与组织上下文,并通过可学习先验门控按空间位置调节组织先验影响,辅以前景重建和cellness提示增强定位。在OCELOT上验证/测试macro F1达0.7722/0.7345,并报告BRCA跨数据集分析,显示自适应先验融合有效。

Robotic Policy Adaptation via Weight-Space Meta-Learning Figure 1
2026-06-08cs.RO

Robotic Policy Adaptation via Weight-Space Meta-Learning

Christian Bianchi, Siamak Yousefi, Alessio Sampieri, Andrea Roberti, Luca Rigazio, Fabio Galasso, Luca Franco

University of Verona, ItalAI and Sapeinza University of Rome

2026-06-08机器人强化学习

针对VLA机器人策略迁移到新任务时仍需带动作标注示范和逐任务微调的问题,论文提出WIZARD,将适应视为权重空间推断:由语言指令和短示范视频生成冻结VLA的任务LoRA适配器,无需测试时优化。LIBERO上未见数据集最高约2倍、未见任务最高约14倍提升,真实Franka实验也优于实域适配基线;但对示范质量敏感,长时序组合任务仍受限。

AdaTok: Self-Budgeting Image Tokenization with Quality-Preserving Dynamic Tokens Figure 1
2026-06-08cs.CV

AdaTok: Self-Budgeting Image Tokenization with Quality-Preserving Dynamic Tokens

Xiaocheng Lu, Yuxi Chen, Jie Zhang, Jian Liu, Jingcai Guo, Fangqi Zhu, Tao Han, Song Guo

The Hong Kong University of Science and Technology, The Hong Kong Polytechnic University

2026-06-08视觉感知

针对固定图像 token 预算在简单样本上浪费、复杂样本上不足的问题,AdaTok 将 token 数作为内容条件输出而非手工超参。其关键是把有序前缀表示与分配策略联合设计:用嵌套尾部遮蔽和预算专属 MH-LoRA 保持不同长度可解码,再用确定性组 GRPO 与动态 Pareto 权重一趟选择预算。在 ImageNet-1K 上,自适应版平均约 118 tokens 达到 rFID 1.50,并使自回归生成吞吐较 256-token 固定解码提升约 2.1 倍。

OPTIMUS-Prime: Minimal and Sufficient Concept Explanations for Deep Vision Models Figure 1
2026-06-08cs.CV

OPTIMUS-Prime: Minimal and Sufficient Concept Explanations for Deep Vision Models

Arthur Hoarau, Chenrui Zhu, Vu Linh Nguyen

2026-06-08视觉感知

本文针对视觉模型解释中热力图易懂但缺少形式保证的问题,提出 OPTIMUS-Prime:先在中间层概念空间中用 prime implicant 搜索最小且充分的概念子集,再用 Integrated Gradients 或 DeepLIFT 回传到像素空间生成热图。实验在猫狗鸟分类基准上显示,该方法能更集中呈现与预测相关的概念;但验证场景较窄,跨架构与复杂数据集效果文中未充分说明。

EvoGS: Constructing Continuous-Layered Gaussian Splatting with Evolution Tree for Scalable 3D Streaming Figure 1
2026-06-08cs.CV

EvoGS: Constructing Continuous-Layered Gaussian Splatting with Evolution Tree for Scalable 3D Streaming

Yuang Shi, Simone Gasparini, Géraldine Morin, Wei Tsang Ooi

National University of Singapore, IRIT - University of Toulouse

2026-06-08三维

面向 XR/6DoF 场景中 3D Gaussian Splatting 的渐进传输,论文指出现有离散 LOD 分层因层间无结构关联,会累积几何误差、产生冗余 splat 并导致质量跳变。EvoGS 将 splat 组织为带父子谱系的 Evolution Tree,用类小波的连续细化让子节点修正祖先误差并形成可压缩层间信号。实验称冗余率由超过 65% 降至低于 25%,传输负载和 GPU 显存最高分别降至约 1/2.4 和 1/5.5,同时质量过渡更平滑。

Seeing Without Exposing: Adaptive Privacy Control for Open-World, Context-Hungry MLLMs Figure 1
2026-06-08cs.CV

Seeing Without Exposing: Adaptive Privacy Control for Open-World, Context-Hungry MLLMs

Siyuan Xu, Yibing Liu, Peilin Chen, Yung-Hui Li, Shiqi Wang, Sam Kwong

City University of, Research Institute, University

2026-06-08强化学习规划控制

针对 MLLM 输入中敏感信息类型开放、用户意图个性化,而简单打码又会破坏下游视觉推理语境的问题,论文提出免训练的 APD,在多模态潜空间中让隐私区域漂移到语义等价但不泄露的替代内容,同时锚定原图结构与上下文;并构建含 22 类隐私的 AdaptShield 评测。实验在 Qwen 与 InternVL 系列上显示,文本隐私类别平均提升 10.4%,MLLM 评估平均提升 8.5%。

Textual Supervision Enhances Geospatial Representations in Vision-Language Models Figure 1
2026-06-08cs.CV

Textual Supervision Enhances Geospatial Representations in Vision-Language Models

Marcelo Sartori Locatelli, Fernando Tonucci, Jea Kwon, Luiz Felipe Vecchietti, Bryan Nathanael Wijaya, Cheng Yaw Low, Virgilio Almeida, Meeyoung Cha

2026-06-08视觉语言视觉感知

本文关注视觉模型是否在无显式地理监督下内化地球位置知识,以解释图像定位与空间推理中的区域偏差。作者用逐层线性探针从 ViT、CLIP 与 LLaVA/Qwen/Gemma 等表征中回归经纬度,并按可定位性类别分析。结果显示,文本监督和多模态训练显著增强地理结构:纯视觉模型主要在末层较强,VLM 的地理信息集中于语言模块早层;提示可将其传播到后层,且约 40% 维度已接近最佳预测表现。

When Recovery Matters: The Blind Spot of Surrogate Privacy in MLLM Editing Figure 1
2026-06-08cs.CV

When Recovery Matters: The Blind Spot of Surrogate Privacy in MLLM Editing

Siyuan Xu, Yibing Liu, Peilin Chen, Yung-Hui LI, Shiqi Wang, Sam Kwong

2026-06-08视觉感知

本文关注云端 MLLM 图像编辑中的隐私盲点:替换敏感区域生成 surrogate 虽能保护输入,却常只得到“被编辑的替身”,难以还原到原图。作者提出面向恢复的 SPPE 基准,覆盖36类隐私与65种指令,并拆分为编辑可行性评估和 surrogate-to-source 恢复两任务;相应提出 ERMA 与 C2E-S2SER。实验显示 ERMA 在 SRCC/PLCC 上较最佳基线提升13.9%/12.3%,恢复模型在 SPPE 的8项完整性与编辑一致性指标上均优于 SOER。

TraRA: Trajectory-level Recognition Aggregation for Video Text Spotting in Urban Surveillance Figure 1
2026-06-08cs.CV

TraRA: Trajectory-level Recognition Aggregation for Video Text Spotting in Urban Surveillance

Duc Tri Tran, Trung Thanh Nguyen, Vijay John, Phi Le Nguyen, Yasutomo Kawanishi

Hanoi University of Science and Technology, Vietnam, Nagoya University, Japan, Lawrence Technological University, USA, Ritsumeikan University, Japan

2026-06-08视觉感知规划控制

针对城市场景视频文本识别中运动模糊、遮挡和尺度变化导致逐帧结果不稳定的问题,TraRA将识别从单帧提升到文本轨迹层面:先用时序聚类修复噪声轨迹,再用LoRA增强的视觉语言模型聚合多帧视觉线索与语言上下文。作者在RoadText、BOVText、ArTVideo和ICDAR15上验证,其可作为即插即用模块提升现有VTS方法的跟踪与识别表现。

Consistent-Inversion: Reverse Consistency Guidance for Structure-Preserving Visual Editing Figure 1
2026-06-08cs.CV

Consistent-Inversion: Reverse Consistency Guidance for Structure-Preserving Visual Editing

Xiaocheng Lu, Jingcai Guo, Song Guo

2026-06-08视觉感知

本文针对反演式扩散编辑中“源图重建轨迹”和“目标编辑轨迹”共用噪声潜变量导致的结构漂移或过度保真问题,提出 Consistent-Inversion:在早期去噪步将目标中间状态按源提示反向检查其能否回到源反演轨迹,并用差异作为一致性校正信号。该方法无需训练、可接入现有编辑器;PIE-Bench 与 SD/SD3.5 实验显示其提升背景和结构保真,同时基本保持文本编辑对齐,代价较小。

Native3D: End-to-End 3D Scene Generation via Unified Mesh-Texture Modeling and Semantic Alignment Figure 1
2026-06-08cs.CV

Native3D: End-to-End 3D Scene Generation via Unified Mesh-Texture Modeling and Semantic Alignment

Yibo Liu, Ziwei Zhang, Haozhou Pang, Menghao Li, Lanshan He, Gan Qi

Kuaishou GameMind Lab

2026-06-08三维

面向室内三维场景生成中由2D中间表示带来的几何畸变、纹理退化和多视角不一致问题,Native3D直接在3D网格与纹理上端到端建模,用Transformer场景编码器和DiT学习联合潜空间,并以3D REPA Loss对齐场景级与对象级语义特征。实验称其在生成质量、几何/纹理保真度和文本驱动编辑灵活性上优于现有方法。

3DMorph: Single-Image-Guided Local 3D Shape Editing and Morphing Figure 1
2026-06-08cs.CV

3DMorph: Single-Image-Guided Local 3D Shape Editing and Morphing

Tobias Preintner, Yunfei Deng, Phillip Müller, Sebastian Illing, Adrian König, Thomas Bäck, Elena Raponi, Niki van Stein

2026-06-08视觉感知三维

针对工程/设计中静态网格缺少参数化结构、局部几何修改常需重建全流程的问题,3DMorph提出免训练的单图引导编辑框架:用户只需编辑一个渲染视图,系统自动估计3D编辑区域,将2D形状变化映射回网格,并保持未编辑部分,还可生成局部形变中间态。论文同时构建含真值编辑的Delta3D基准,实验显示其在几何局部编辑质量上优于现有生成与编辑方法。

GP-Adapter: Gaussian Process CLIP-Adapter for Few-Shot Out-of-Distribution Detection Figure 1
2026-06-08cs.CV

GP-Adapter: Gaussian Process CLIP-Adapter for Few-Shot Out-of-Distribution Detection

Taisei Saito, Koretaka Ogata, Takafumi Hiroi

2026-06-08视觉感知三维

这篇论文关注少样本和分布偏移下 CLIP 置信度过于确定、难以可靠拒识的问题。GP-Adapter 在冻结 CLIP 图像与文本嵌入上为每类构建单类高斯过程,用预测均值和方差形成不确定性感知的 OOD 分数,避免反向微调且缓存开销随类别和 shot 数可控。ImageNet 与多组 OOD 实验显示其少样本分类具竞争力,并能与 CoOp/LoCoOp 等提示学习方法互补提升 OOD 检测。

LARA: Latent Action Representation Alignment for Vision-Language-Action Models Figure 1
2026-06-08cs.CV

LARA: Latent Action Representation Alignment for Vision-Language-Action Models

Mengya Liu, Baoxiong Jia, Jiangyong Huang, Jingze Zhang, Siyuan Huang

2026-06-08视觉语言视觉感知

机器人 VLA 受限于昂贵稀缺的带动作标注数据,而人类视频虽丰富却缺少可直接迁移的动作标签。LARA 的核心是让潜在动作模型 LAM 与扩散式 VLA 不再分阶段冻结使用,而通过潜在动作表示对齐共同优化:真实动作轨迹约束 LAM,LAM 的前向动力学又正则化 VLA。实验覆盖 3 个仿真和 1 个真实操作基准,作为完整训练、后训练增强和 LAM 精炼分别带来约 10%、5%、15% 平均提升。

Detecting Temporally Localized Manipulations in Authentic Video Streams Figure 1
2026-06-08cs.CV

Detecting Temporally Localized Manipulations in Authentic Video Streams

Okan Umur, Ali Emre Güşlü, Ibrahim Delibasoglu

2026-06-08机器人视觉感知

现有视频伪造数据多聚焦整段篡改、换脸或目标移除,难覆盖真实视频中仅插入短时高逼真片段的场景。本文据此整理相关数据集缺口,构建部分篡改测试集,并以 DINOv3 特征上的线性探针和相邻帧余弦相似度异常检测建立基线;无监督方法报告 83% precision、真实流视频级准确率 95%,但阈值依赖明显,需内容自适应机制。

An Adaptive Data cleaning Framework for Noisy Label Detection Figure 1
2026-06-08cs.CV

An Adaptive Data cleaning Framework for Noisy Label Detection

Chen-Hsuan Fang, Wei-Hsinag Chen, Pin-Hsuan Yu, Jung-Hua Wang, Tsung-Wei Pan

Noisy-Label Detection, Department of Electrical Eng. National Taiwan Ocean University, Keelung City 20224, Taiwan, AI Research Center, National Taiwan Ocean University, Keelung City 20224, Taiwan, Industrial Technology Research Institute (ITRI), Hsinchu, 310401, Taiwan, vision tasks owing to large-scale annotated datasets. In real-world applications, however, labels are corrupted, memorize these noisy labels during training, resulting in degradation of model accuracy and generalization., data-cleaning framework that integrates local, global, and learning dynamics cues for robust noisy-label, ImageNet-100 with 5% to 40% symmetric label noise show high recall in most settings, including near-, label detection, INDEX TERMS: Noisy-label detection, Label noise, machine learning tasks, largely owing to the availability of

2026-06-08视觉感知

针对真实视觉数据中人工标注错误会被过参数化模型记忆、且现有清洗方法依赖阈值或噪声率先验的问题,本文提出自适应多指标标签噪声检测框架,将KNN局部不一致、k-means全局中心距离与EL2N学习动态拼接后用多维GMM自动划分干净/噪声样本。在CIFAR-10、MNIST和ImageNet-100的5%–40%对称噪声实验中,多数设置取得高召回,ImageNet-100 40%噪声下召回≥98%,并在多项重训练中提升精度。

AsyncPatch Diffusion: spatially-flexible image generation Figure 1
2026-06-08cs.CV

AsyncPatch Diffusion: spatially-flexible image generation

Samuele Papa, Valentin De Bortoli, Guillaume Couairon, Daniel Sýkora, Romuald Elie, Klaus Greff

2026-06-08视觉感知生成模型

标准扩散把整幅图绑定到同一噪声时间,限制了局部区域按需生成。AsyncPatch 将联合扩散推进到像素/潜变量 token 级异步噪声,给出该过程的有效 ELBO,并用受控时间采样缓解训练与推理路径不匹配;模型在 ImageNet 256、LSUN 上保持接近常规扩散的生成质量,同时无需专项微调即可做修复,并在纹理合成、输入引导、自适应加速和自回归采样中展示优势。

Beyond Universality: The GCC-FER Dataset and Culture-Aware Adaptation for Dynamic Facial Expression Recognition Figure 1
2026-06-08eess.IV

Beyond Universality: The GCC-FER Dataset and Culture-Aware Adaptation for Dynamic Facial Expression Recognition

Sonalika Singh, Jyotirindra Dandapat, Avishi Razdan, Kshipra V. Moghe, Puneet Gupta, Lalan Kumar

Sonalika Singh, Jyotirindra Dandapat, and Lalan Kumar are with the Department of Electrical Engineering, Indian Institute of Technology Delhi, India., Puneet Gupta is with the Department of Computer Science and Engineering, Indian Institute of Technology Indore, India., Avishi Razdan and Kshipra V. Moghe are with the Department of Psychology, COEP Technological University, India.

2026-06-08视觉感知数据集/基准

针对现有动态表情识别默认“表情跨文化通用”、在欠代表人群上易失效的问题,论文构建含非洲、白人、东亚、南亚四类文化群体的 GCC-FER 视频基准,并提出利用文化先验重校准潜在表征的 CA-FER。实验显示该数据集更能暴露跨文化性能差异,CA-FER 在 GCC-FER 与 DFEW 的多文化设置中稳定提升识别表现。

Constructing VAE Latent Spaces with Prescribed Topology Figure 1
2026-06-08cs.LG

Constructing VAE Latent Spaces with Prescribed Topology

Jilles S. van Hulst, Jakub M. Tomczak, W.P.M.H. Heemels, Duarte J. Antunes

2026-06-08生成模型

本文针对标准 VAE 高斯潜变量与周期、边界或商空间等非欧拓扑数据不匹配的问题,提出按圆、区间、直线等因子及有限群商空间构造潜空间的框架,并给出可重参数化分布、闭式解耦 KL、群不变解码特征与锚点约束。实验在圆柱、环面、莫比乌斯带及旋转/平移 MNIST 上显示,拓扑匹配先验在实用正则强度下优于高斯基线。

TrioPose: Native Triple-Stream Diffusion Transformers for Pose-Guided Text-to-Image Generation Figure 1
2026-06-08cs.CV

TrioPose: Native Triple-Stream Diffusion Transformers for Pose-Guided Text-to-Image Generation

Dian Gu, Zhengyi Yang

Institute of Automation, Chinese Academy of Sciences

2026-06-08视觉感知生成模型三维

TrioPose针对多人姿态引导文生图中肢体畸变、遮挡下特征串扰,以及传统UNet适配器难以迁移到MM-DiT的问题,基于SD3.5M将姿态作为独立模态引入三流TSPA-DiT,并用零初始化双残差注入、可学习关系偏置掩码和姿态加权损失稳定约束几何结构。实验在Human-Art、CrowdPose、OCHuman上达到SOTA,其中Human-Art AP为64.33,较前作提升约30%。

STREAM: Stochastic Riemannian Flow Matching with Anisotropic Decoder for Digital Histopathology Image Generation Figure 1
2026-06-08cs.CV

STREAM: Stochastic Riemannian Flow Matching with Anisotropic Decoder for Digital Histopathology Image Generation

Won June Cho, Daeky Jeong, Hyeongyeol Lim, Hongjun Yoon

DEEPNOID Inc.

2026-06-08视觉感知生成模型

本文针对病理图像生成中 VAE 潜空间语义不足、依赖 VFM 条件导致“条件坍缩”和无条件生成受限的问题,提出将病理 VFM 的球面 patch-token 特征直接作为潜空间,并用随机黎曼流匹配与各向异性解码器适配其几何结构。在乳腺癌和结直肠癌数据上,STREAM 在生成 FID、病理感知分布指标及部分重建指标上优于 ZoomLDM、PixCell 等基线,但训练规模较大,部分增益可能来自 scaling / data。

ForensicConcept: Transferable Forensic Concepts for AIGI Detection Figure 1
2026-06-08cs.CV

ForensicConcept: Transferable Forensic Concepts for AIGI Detection

Menyanshu Zhou, Ziyin Zhou, Ke Sun, Yunpeng Luo, Jiayi Ji, Xiaoshuai Sun, Rongrong Ji

2026-06-08视觉感知

针对现有 AIGI 检测器在未见生成器上泛化差且证据黑箱的问题,论文提出 ForensicConcept:用 Transformer 归因定位关键图像块,聚类成可审计的“取证概念”码本,并借助 CleanDIFT 扩散特征与 CKNNA 衡量其是否对齐生成痕迹,再将扩散概念注入目标骨干。实验在 GenImage、GAN-family、Chameleon 上分别达到 92.0%、90.1%、84.4% 准确率,并显示 CKNNA 可预测概念迁移效果。

Hierarchical Semantic-Constrained Heterogeneous Graph for Audio-Visual Event Localization Figure 1
2026-06-08cs.AI

Hierarchical Semantic-Constrained Heterogeneous Graph for Audio-Visual Event Localization

Zhe Yang, Ruyi Zhang, Hongtao Chen, Wenrui Li, Hengyu Man, Wangmeng Zuo, Xiaopeng Fan

2026-06-08视觉感知

本文针对开放词汇音视频事件定位中未见类别缺少监督、音画不同步以及片段级与视频级语义不一致的问题,提出 HSCHG:先在欧氏空间构建含音频/视觉片段节点和视频节点的层次异构图,用多向时序边、跨模态边和双阈值门控融合抑制错误对齐;再将多层表示与文本原型映射到双曲空间,通过层次蕴含正则刻画视频—片段关系。实验显示其在 OV-AVEBench 上的识别与定位均优于已有方法,消融验证了各模块作用。

Never Seen Before: Benchmarking Genuine Zero-Shot Composed Image Retrieval with Consistent Video-Sourced Datasets Figure 1
2026-06-08cs.CV

Never Seen Before: Benchmarking Genuine Zero-Shot Composed Image Retrieval with Consistent Video-Sourced Datasets

Zhenyu Yang, Zemin Du, Shengsheng Qian, Changsheng Xu

2026-06-08视觉感知数据集/基准三维

本文针对零样本组合图像检索中测试集被 CLIP 预训练见过、参考/目标图像语义不一致导致评估虚高的问题,提出 ZeroSight:用 2022 年后公开视频抽帧构造一致图像对,并以 LLM 生成相对描述,含多正例与硬负例评测;同时给出免训练的 SC4CIR 一致性筛选方法。对 27 种方法的实验显示,既有基准显著高估能力,SC4CIR 可作为插件提升检索表现,LLM 类方法平均提升约 9.12%。

GuideCAD: A Lightweight Multimodal Framework for 3D CAD Model Generation via Prefix Embedding Figure 1
2026-06-08cs.CV

GuideCAD: A Lightweight Multimodal Framework for 3D CAD Model Generation via Prefix Embedding

Minseong Kim, Jinyeong Park, Sungho Park, Jibum Kim

Convergence Research Center for Insect Vectors, Department of Computer Science and Engineering, Incheon National University, Center for Brain-Machine Interface

2026-06-08视觉语言三维

针对多模态 3D CAD 生成依赖全量微调、训练成本高的问题,GuideCAD 将图像编码经映射网络转为 prefix embedding,冻结预训练视觉模型与语言模型,仅训练少量参数并由 Transformer 解码施工序列。作者还构建图文配对的 GuideCAD 数据集;实验显示其质量接近微调方法,参数约少 4 倍、训练效率约提升 2 倍。

An Integrated Roadside Sensing and Communication Framework for Vulnerable Road User Safety at Signalized Intersections Figure 1
2026-06-08stat.AP

An Integrated Roadside Sensing and Communication Framework for Vulnerable Road User Safety at Signalized Intersections

Parvez Anowar

PhD Student, Department of Civil, Environmental and Construction Engineering, University of Central

2026-06-08安全鲁棒

针对信号交叉口中行人、骑行者等弱势道路使用者易受遮挡且单车/单传感器预警不足的问题,论文提出把路侧 LiDAR、雷达、RGB/热成像、边缘近失分析、V2X/P2X 通信和自适应信号控制集成到同一路口框架。基于 R-LiViT 的 5.3 万标注分析显示,VRU 占约 49%,夜间密度下降但近距离风险占比更高,地点间冲突密度差异近 10 倍,支持多模态与场景化部署。

Don't Pause: Streaming Video-Language Synchrony for Online Video Understanding Figure 1
2026-06-08cs.CV

Don't Pause: Streaming Video-Language Synchrony for Online Video Understanding

Zhenyu Yang, Kairui Zhang, Shengsheng Qian, Weiming Dong, Changsheng Xu

2026-06-08视觉感知

论文针对在线 Video-LLM 生成回答时暂停视频感知、导致直播理解卡顿的问题,提出 SVLS 范式与 LyraV 控制层:用 FDTC 在逐帧输入下判定继续说、重启回答或静默,用 SToP 按视觉节奏和时延预算调节每帧输出 token 数。实验覆盖 5 个在线和 3 个离线基准,显示其基本保留骨干理解能力,并将视频同步率提升到 98.29%、实时速度达 3.89 FPS。

DaX: Learning General Pathology Representations Across Scales Figure 1
2026-06-08eess.IV

DaX: Learning General Pathology Representations Across Scales

Bokai Zhao, Yiyang Zhang, Long Bai, Tai Ma, Hanqing Chao, Minfeng Xu

DAMO Academy, Alibaba Group, Institute of Automation, Chinese Academy of Sciences 3Hupan Lab, page can be accessed at https://alibaba-damo-academy.github.io/DaX/benchboard/.

2026-06-08视觉感知

病理全切片理解需要同时建模细胞细节与组织结构,并应对倍率、染色、扫描和输入尺寸差异;DaX以DINOv3初始化的ViT-L为骨干,通过连续倍率训练、跨尺度自监督、多输入尺寸与Gram一致性学习统一这些需求。在44个公开数据集161项任务的患者级交叉验证中,DaX在诊断、分子、预后和样本来源任务上表现稳定,但具体增益中数据规模与训练策略的相对贡献仍需进一步拆分。

CL-CLIP: CLIP-Based Continual Learning Framework with Cost-Volume Category Decoupling for Object Detection Figure 1
2026-06-08cs.CV

CL-CLIP: CLIP-Based Continual Learning Framework with Cost-Volume Category Decoupling for Object Detection

Zihan Liu, Yuguang Yang, Shengjie Su, Jianing Pang, Linlin Yang, Chunyu Xie, Nikolai Yu. Zolotykh, Baochang Zhang

National College for Excellent Engineers, Beihang University, School of Electronic Information Engineering, Beihang University, School of Cyber Science and Technology, Beihang University, School of Computer Science and Engineering, Beihang University, State Key Laboratory of Media Convergence and Communication, Communication University of China, Institute of Information Technology, Mathematics and Mechanics, Lobachebsky University, School of Artificial Intelligence, Beihang University

2026-06-08视觉感知

该文关注 CLIP 开放词汇检测器在持续学习中一经微调新类就遗忘旧类的问题。CL-CLIP 的关键思路是用冻结 CLIP 的图文相似度 cost volume 作为类别级空间先验,将共享 RoI 特征路由到按类解耦的多专家检测头,并配合漂移正则降低新旧类干扰。作者在 PASCAL VOC 与 MS-COCO 上显示其相对 F-ViT 持续微调显著提升,并与现有持续目标检测方法具有竞争力,但专家数随类别线性增长。

From Vision to Text: A Compact Multimodal Approach for Robust, Cross-Domain Presentation Attack Detection on ID Cards Figure 1
2026-06-08cs.CV

From Vision to Text: A Compact Multimodal Approach for Robust, Cross-Domain Presentation Attack Detection on ID Cards

Qingwen Zeng, Juan E. Tapia, Sneha Das, Christoph Busch

2026-06-08视觉语言视觉感知安全鲁棒

该文针对远程开户中 ID 卡 PAD 受隐私与国家域偏移限制、难以跨数据集泛化的问题,改造紧凑 SmolVLM2 多模态框架,将图像与文本线索结合,并加入生成式与判别式结构,对真实身份证和合成护照的五国数据做交叉评测。结果显示,多模态模型经监督微调后泛化较好,但零样本表现失败;可靠性可能主要来自模型容量与真实数据,现有合成数据作为基准的代表性不足。

MVSegNet: A Lightweight Boundary-Aware Network for Fetal Lateral Ventricle Segmentation and Atrial Width Estimation in Prenatal Ultrasound Figure 1
2026-06-08cs.CV

MVSegNet: A Lightweight Boundary-Aware Network for Fetal Lateral Ventricle Segmentation and Atrial Width Estimation in Prenatal Ultrasound

Arafat Hossain Sayem

Department of Computer Science & Engineering, Stamford University Bangladesh, Dhaka 1217, Bangladesh

2026-06-08视觉感知学习理论

针对产前超声中胎儿侧脑室边界受散斑、阴影和低对比度影响而导致房宽测量不稳定的问题,论文提出轻量级 MVSegNet:以 MobileNetV3-Small 编码器结合多尺度注意、跳连注意、孕周 FiLM 条件化和边界细化模块来强化轮廓。其在 584 帧专家标注数据上优于 6 个基线,Dice 80.79%、IoU 68.47%、Hausdorff 4.07 mm、房宽 MAE 3.40 mm,且仅 2.31M 参数、T4 上 165.6 FPS。

When is 3D Worth It? A Resource-Performance Frontier for CNNs and Transformers in Lung CT Figure 1
2026-06-08cs.CV

When is 3D Worth It? A Resource-Performance Frontier for CNNs and Transformers in Lung CT

Md Enamul Hoq, Sharafat Hossain, Imraul Emmaka, Linda Larson-Prior, Lawrence Tarbox, Jonathan Bona, Donald Johann Jr.and Fred Prior

Department of Biomedical Informatics, University of Arkansas for Medical Sciences, Department of Information Science, University of Arkansas at Little Rock, Department of Neuroscience

2026-06-08三维

这篇论文针对肺部 CT 中“3D 是否值得额外算力”的常见假设,在固定训练协议下比较 2D、2.5D、3D 输入对 CNN 与 ViT 的影响,并把重点放在资源—性能边界和失败模式而非新架构。结果显示,2.5D CNN 在 NLST 上取得最高 ROC-AUC 0.682、PR-AUC 0.158,且稳定性较好;3D CNN 阈值不稳,ViT 常出现全阳性或零敏感度等退化预测,说明在类别不平衡的小规模筛查任务中,完整 3D 的收益并不明确。

SS-TPT: Stability and Suitability-Guided Test-Time Prompt Tuning for Adversarially Robust Vision-Language Models Figure 1
2026-06-08cs.CV

SS-TPT: Stability and Suitability-Guided Test-Time Prompt Tuning for Adversarially Robust Vision-Language Models

Sunoh Kim, Daeho Um

code is available at https://github.com/, Dankook University, Yongin, South Korea 2University of, ence without labeled data (Zhang et al., 2022

2026-06-08视觉语言视觉感知安全鲁棒

针对 CLIP 等视觉语言模型在对抗扰动下脆弱、现有测试时自适应依赖大量增强视图而推理过慢的问题,SS-TPT 的核心洞察是少量视图场景下应评估“视图质量”而非默认等权使用。方法用预测稳定性和特征空间密度衡量可信视图,并据此设计一致性损失与加权预测,抑制异常视图。实验显示其在多数据集、攻击和视图数量下取得更好的鲁棒性—吞吐折中,如 15 视图下较 R-TPT 更快且鲁棒性更高。

When CLIP Sees More, It Fights Back Harder: Multi-View Guided Adaptive Counterattacks for Test-Time Adversarial Robustness Figure 1
2026-06-08cs.CV

When CLIP Sees More, It Fights Back Harder: Multi-View Guided Adaptive Counterattacks for Test-Time Adversarial Robustness

Sunoh Kim, Daeho Um

Dankook University, University of Seoul, sign. Our code is available at https://github.com/, hance robustness, they rely on task-specific labeled data, limiting their scalability. To preserve the zero-shot flexi-, requiring labels or retraining.

2026-06-08安全鲁棒

针对 CLIP 零样本识别在测试时易受强对抗扰动影响、现有 TTC 依赖已污染原视图且硬门控难以按攻击强度自适应的问题,论文提出 MAC:用多视图增强提供更稳健的反向扰动引导,并以估计的 corruption degree 对各视图软加权调节反击强度。20 个数据集和多种攻击下,MAC 相比 TTC 显著提升鲁棒性,同时保持免调参、约 0.08 秒/图和较低显存开销。

SVHighlights: Towards Extremely Long Sport Video Highlight Detection Figure 1
2026-06-08cs.CV

SVHighlights: Towards Extremely Long Sport Video Highlight Detection

Donggyu Lee, Youngbin Ki, Jeonghun Kang, Taehwan Kim

Ulsan National Institute of Science and Technology, Ulsan National Institute of Science and Technology Ulsan Republic of Korea

2026-06-08视觉感知

针对现有高光检测多限于几分钟短视频、缺少小时级评测的问题,论文构建 SVHighlights:用完整体育赛事与官方高光视频自动对齐生成标签,覆盖 320 个视频、总计 640 小时。其无训练基线 TF-SELECTOR 按语义合并镜头成片段,并结合字幕、视觉描述和音量由 LLM 打分;相比 VTG 微调基线在 HIT@1、HIT@K、IoU 上分别提升 3.12、4.06、2.95。

DRIFT: From Robustness Gaps to Invariance Manifolds for AI-Generated Image Detection Figure 1
2026-06-08cs.CV

DRIFT: From Robustness Gaps to Invariance Manifolds for AI-Generated Image Detection

Abhishek Ameta, Sayan Banerjee, Shreyas Pandith, Harshit, Ankita Chatterjee, Akshay Janardan Bankar, Amit Satish Unde

2026-06-08视觉感知安全鲁棒

针对现有 AI 生成图像检测在未知生成器和扰动选择下鲁棒性不足的问题,DRIFT 将检测重写为仅用真实图像学习“不变性流形”:在冻结视觉基础模型上用轻量投影头分解鲁棒/脆弱子空间,并以排序间隔约束区分物理成像扰动与编辑式变化。推理时通过多尺度 patch 漂移做违例检测和热图定位;实验显示其在开放世界、跨生成器与分辨率场景下优于训练-free 鲁棒性基线。

polyDAG: Polynomial Acyclicity Constraints for Efficient Continuous Causal Discovery in Visual Semantic Graphs Figure 1
2026-06-08cs.CV

polyDAG: Polynomial Acyclicity Constraints for Efficient Continuous Causal Discovery in Visual Semantic Graphs

Wenhao Zhang, Ramin Ramezani, Tao Han, Kai Hwang, Minyi Guo

2026-06-08优化算法

论文关注视觉语义变量因果图学习中,无环约束在连续优化里反复计算、成为 NOTEARS 类方法瓶颈的问题。核心做法是用有限多项式迹约束替代矩阵指数,并给出与无环性等价的证明,再用几何级数形式减少显式求和。实验在合成图和 CelebA 属性上显示,polyDAG-Geo 相比指数基线降低平均 SHD、提升 F1,并带来约 14–33% 运行时间节省;但结构增益更多来自优化动态,因果语义解释仍需谨慎。

ActionMap: Robot Policy Learning via Voxel Action Heatmap Figure 1
2026-06-08cs.RO

ActionMap: Robot Policy Learning via Voxel Action Heatmap

Pei Yang, Hai Ci, Yanzhe Chen, Qi Lv, Han Cai, Mike Zheng Shou

Show Lab, National University of Singapore

2026-06-08机器人强化学习

论文指出当前 VLA 多把动作解码成单点连续值,忽略相邻动作的几何结构,影响数据效率与精度。ActionMap 将动作头替换为平移、旋转和夹爪的体素概率热图,用高斯软标签训练并从分布解码连续动作。实验显示其可直接接入 OpenVLA-OFT 与 π0.5,在 LIBERO 平均成功率分别提升 8.2% 和 1.6%,低数据下更稳,并在 Franka 实机任务中优于 L1 回归头。

Beyond Skeletons: Learning Animation Directly from Driving Videos with Same2X Training Strategy Figure 1
2026-06-08cs.CV

Beyond Skeletons: Learning Animation Directly from Driving Videos with Same2X Training Strategy

Yuan Zeng, Yujia Shi, Yuhao Yang, Dongxia Liu, Zongqing Lu, Wenming Yang, Qingmin Liao

Tsinghua University, Harbin Institute of Technology, Pengcheng Laboratory

2026-06-08视觉感知

针对人体图像动画中骨架、DensePose 等中间姿态在遮挡和复杂动作下易出错、且表情表达不足的问题,DirectAnimator改为从驱动视频原始像素学习,并将其整理为姿态、脸部、位置三类驱动线索,通过CueFusion DiT注入去噪过程;Same2X先学同身份再对齐跨身份特征,缓解身份保持与动作跟随的优化冲突。实验显示其在视觉质量、身份一致性和复杂遮挡鲁棒性上达到SOTA,跨身份训练收敛可快6.7倍。

LUCID: Learning Unified Control for Image Deflaring and Exposure Mastery in Nighttime Photography Figure 1
2026-06-08cs.CV

LUCID: Learning Unified Control for Image Deflaring and Exposure Mastery in Nighttime Photography

Tingyu Yang, Yuan Cheng, Xiaoyun Yuan

MoE Key Lab of Artificial Intelligence, AI Institute, School of Computer Science, School of Biomedical Engineering, School of Artificial Intelligence, School of Biomedical Engineering Shanghai Jiao Tong University Shanghai China, School of Artificial Intelligence Shanghai Jiao Tong University Shanghai China, MoE Key Lab of Artificial Intelligence, AI Institute, School of Computer Science Shanghai Jiao Tong University Shanghai China

2026-06-08视觉感知规划控制

夜景成像中眩光遮挡结构、欠曝光放大噪声,串联去眩光与低光增强易累积伪影。LUCID将问题建模为可连续控制的统一恢复流程:先分离眩光成分提供结构引导,再用扩散先验重建,并通过四模式训练与CFG调节光源、鬼影和曝光。实验显示其在多种真实夜景中优于现有方法,并可由单张图生成伪曝光序列用于HDR重建。

Lighting-Aware Representation Learning under Controllable Lighting Variation Figure 1
2026-06-08cs.CV

Lighting-Aware Representation Learning under Controllable Lighting Variation

Lizhen Zhu, Charantej Reddy Pochimireddy, James Z Wang, Brad Wyble

\addr Department of Informatics and Intelligent Systems, College of Information Sciences and Technology, The Pennsylvania State University, University Park, PA, 16802, USA, \addr Department of Psychology, College of the Liberal Arts

2026-06-08规划控制

论文针对光照变化导致视觉表征分布偏移、传统增强只追求不变性而忽略光照因素的问题,提出受人类视觉启发的 lighting-aware 对比学习:在语义一致性目标外加入光照相关辅助目标,利用可控渲染数据显式学习光照结构。实验在 ImageNet、ExDark 与 PASCAL VOC 分类/检测上优于标准对比学习,架构和训练预算相同,但内部表征如何分离内容与光照文中未充分说明。

Stream3D-VLM: Online 3D Spatial Understanding with Incremental Geometry Priors Figure 1
2026-06-08cs.CV

Stream3D-VLM: Online 3D Spatial Understanding with Incremental Geometry Priors

Hanxun Yu, Xuan Qu, Lei Ke, Boqiang Zhang, Yuxin Wang, Jianke Zhu, Dong Yu

2026-06-08视觉语言三维

面向机器人、AR 等需要边看边交互的场景,现有 3D 多模态模型多依赖完整场景或离线视频,难以实时回答。Stream3D-VLM 将“何时回答”建模为自回归 next-token 控制,并用 VSFI 增量注入流式重建的几何先验,配合 GAVC 按 3D 结构压缩视觉 token;同时构建百万级带时间戳 3D QA 和 29 任务基准。实验显示其在在线 3D 理解、推理、定位及部分离线任务上优于开源和闭源基线。

Diagnosing Visual Ignorance in Vision-Language Models Figure 1
2026-06-08cs.CV

Diagnosing Visual Ignorance in Vision-Language Models

Runyu Zhou, Qi Zhang, Qixun Wang, Yisen Wang

Peking University

2026-06-08视觉语言视觉感知

本文关注VLM在视觉问答中“看图不看图”、依赖语言先验仍自信作答的问题。作者从内部机制与外部评测两侧诊断:用反事实层替换和逐层监督MLP探针追踪视觉语义与文本先验竞争,并用逐步高斯模糊衡量答案对视觉破坏的不变性。结果显示,中层常未能有效取回视觉信息,后层还会压制残留视觉信号;在12个基准和3个模型上,约20%–40%样本在严重甚至完全遮蔽后仍可被答对,说明现有评测可能奖励视觉无视。

ARAPDiffusion: ARAP Regularization for Diffusion-Based Deformable Shape Space Learning Figure 1
2026-06-08cs.CV

ARAPDiffusion: ARAP Regularization for Diffusion-Based Deformable Shape Space Learning

Haibo Liu, Jinghan Ke, Haitao Yang, Xiangru Huang, Georgios Pavlakos, Qixing Huang

University of Texas at Austin, Westlake University

2026-06-08生成模型

本文针对可变形三维形状生成在小规模数据下难以学习连续形状空间的问题,提出在潜在扩散训练中交替注入 ARAP 近刚性形变正则:一方面用扩散模型采样分布约束解码器,另一方面用解码器评估的形变质量反过来正则扩散模型。实验在人体、动物等网格与无序点云设置中,显示其在无条件和条件生成、插值质量及分布指标上优于 ARAPReg、GenCorres 等基线。

FreeAnimate: Training-Free Human Image Animation with Preview-Guided Denoising Figure 1
2026-06-08cs.CV

FreeAnimate: Training-Free Human Image Animation with Preview-Guided Denoising

Yuan Zeng, Yujia Shi, Zongqing Lu, QingMin Liao

2026-06-08视觉感知

针对人体图像动画依赖大规模训练、资源成本高且泛化受数据偏置限制的问题,FreeAnimate尝试只利用预训练图像扩散模型完成姿态驱动生成。其关键做法是先生成与目标帧对齐的预览帧作为时序和结构先验,再用DDIM反演注意力进行去噪引导,并通过参考锚定自注意力保持身份。实验显示其优于已有免训练方法,部分指标和视觉质量接近训练式SOTA,但复杂背景和手脸细节仍是后续问题。

A Cross-view Fusion Framework for Robust 6-DoF Grasp Pose Estimation Figure 1
2026-06-08cs.RO

A Cross-view Fusion Framework for Robust 6-DoF Grasp Pose Estimation

Kangjian Zhu, Haobo Jiang, Jianjun Qian, Jin Xie

Nanjing University of Science and Technology, Nanyang Technological University, Nanjing University

2026-06-08三维安全鲁棒

针对单视角 RGB-D 在角落视角下易受遮挡、而传统多视角先重建再抓取耗时且可能损失几何细节的问题,论文提出仅引入一个辅助视角的后融合框架;其关键在于用跨视角自监督对比学习约束点特征的空间一致性与抓取方向可分性,并通过对齐的圆柱局部积分模块融合抓取相关几何。在 GraspNet-1Billion 及真实场景中,该方法相对已有 SOTA 在 Seen/Similar/Novel 划分上均取得 AP 提升。

Unified Safe In-context Image Generation in Multimodal Diffusion Transformers via Restricting Unsafe Information Flows Figure 1
2026-06-08cs.CV

Unified Safe In-context Image Generation in Multimodal Diffusion Transformers via Restricting Unsafe Information Flows

Xiang Yang, Feifei Li, Mi Zhang, Geng Hong, Xiaoyu You, Mi Wen, Min Yang

2026-06-08视觉语言视觉感知生成模型安全鲁棒

针对多模态扩散 Transformer 在文生图与图像编辑中仍可由文本或参考图注入 NSFW 等不安全语义的问题,论文从 MM-Attn 信息流分析发现早期通用“语义启动”阶段可定位危险输出 patch,并提出无需训练的 UVR,通过定向注意力调制限制后续有害信息传播。在 FLUX 系列实验中,图像生成和编辑擦除率分别达 91% 与 77%,且画质和编辑保真度下降较小。

EgoPressDiff: Multimodal Video Diffusion for Egocentric UV-Domain Hand-Pressure Estimation Figure 1
2026-06-08cs.CV

EgoPressDiff: Multimodal Video Diffusion for Egocentric UV-Domain Hand-Pressure Estimation

Yuan Zeng, Zilue Gao, Yujia Shi, Zongqing Lu, Wenming Yang, QingMin Liao

2026-06-08视觉语言视觉感知生成模型

这篇论文针对第一视角手部接触压力估计中离散分箱带来的量化误差、逐帧预测导致的时序不稳,以及几何先验利用不足等问题,将任务改写为连续UV压力图的视频扩散生成。EgoPressDiff用PoseNet、MANO顶点编码器、深度与RGB特征共同条件化去噪,并通过分布校准空间层对齐多模态特征。在EgoPressure设置上,其Volumetric IoU相对基线提升超过34%,同时降低MAE并保持较高时序一致性。

Multi-FRuGaL: Multimodal Flexible Redundancy-aware Decomposed Gated Learning for Cancer Diagnosis and Prognosis Figure 1
2026-06-08cs.CV

Multi-FRuGaL: Multimodal Flexible Redundancy-aware Decomposed Gated Learning for Cancer Diagnosis and Prognosis

Sanket Kachole, Siddhesh Thakur, Shubham Innani, Sanyukta Adap, Suhang You, Carla Pitarch-Abaigar, Spyridon Bakas

2026-06-08视觉语言三维

临床多模态肿瘤数据常因影像、病理、文本或表格缺失而使常规融合失效。Multi-FRuGaL通过模态编码、共享/特异信号分解、输入条件门控和信息预算正则,动态抑制冗余或噪声模态并利用可用信息。在HANCOCK与HECKTOR头颈癌任务上,生存AUC提升至0.8496、复发AUC至0.8102,HPV预测AUC达0.975,但跨队列泛化与增益来源仍需更多验证。

LRMIL: Efficient Low-Resolution Multiple Instance Learning via High-Resolution Knowledge Distillation for Whole Slide Image Classification Figure 1
2026-06-08cs.CV

LRMIL: Efficient Low-Resolution Multiple Instance Learning via High-Resolution Knowledge Distillation for Whole Slide Image Classification

Yonghan Shin, Won-Ki Jeong

2026-06-08视觉感知

针对全切片病理图像 MIL 依赖大量高分辨率 patch、推理成本高且难以兼顾低倍全局结构的问题,LRMIL 将训练与推理分辨率解耦:先做跨分辨率 patch 表征蒸馏,再用高分辨率 MIL 教师进行切片级蒸馏,使学生仅用低分辨率 patch 推理。多数据集实验显示其优于现有 MIL 方法并显著降低预处理和特征提取开销。

FS-DVS: A Frequency-Selective Dynamic Visual Sensing Paradigm for Enhancing Information Completeness Figure 1
2026-06-08cs.CV

FS-DVS: A Frequency-Selective Dynamic Visual Sensing Paradigm for Enhancing Information Completeness

Feiyu Ji, Xiaokang Yang, Xiaoyun Yuan

2026-06-08视觉感知

针对传统 DVS 逐像素独立触发导致弱结构边缘低于阈值而丢失、事件表示不完整的问题,FS-DVS 在触发前加入可学习空间滤波器,并用可微事件仿真与下游任务端到端优化。论文的关键洞察是滤波器会自发收敛到类似视网膜中心-周边、强调中频的 CSF 形态;在检测、动作识别和分割迁移中提升表现,检测 mAP 最高报告增益 12.3%,且互信息分析显示保留更多有效信息。

MotionEnhancer: Leveraging Video Diffusion for Motion-Enhanced Vision-Language Models Figure 1
2026-06-08cs.CV

MotionEnhancer: Leveraging Video Diffusion for Motion-Enhanced Vision-Language Models

Yifan Xu, Chao Zhang, Ruifei Ma, Fei Gao, Zhifei Yang, Jiaxing Qi, Zhipeng Chen

School of Computer Science and Engineering, Beihang University, Beijing Digital Native Digital City Research Center, School of Computer Science, Peking University, School of Artificial Intelligence, Beijing University of Posts and Telecommunications

2026-06-08视觉语言视觉感知生成模型

这篇论文针对视频 VLM 擅长宏观事件理解、却容易忽略细粒度运动变化的问题,提出用视频扩散模型中蕴含的运动先验来监督 VLM 注意力。其核心是无参数的 MHS 与 MTTI,从扩散模型注意力头和文本 token 中筛出运动相关信号,再在 SFT 中做文本到视觉注意力对齐。实验在 MotionBench 与 FAVOR-Bench 上对多种 Qwen2.5-VL、InternVL3 模型带来稳定提升,尤其改善运动类指标。

CFRNet: Cycle-Consistent Fixed-Point Training for Real-Time Blind Face Restoration on Consumer Embedded NPUs Figure 1
2026-06-08cs.CV

CFRNet: Cycle-Consistent Fixed-Point Training for Real-Time Blind Face Restoration on Consumer Embedded NPUs

Fuchen Li, Xinyang Wang, Yahui Zhang, Yuhan Chen, Jiahong Guo, Zhuohan Qin, Wenbo Ma

2026-06-08视觉感知

面向手机、车载等消费级 NPU 上的盲人脸复原,论文针对大模型难量化部署、小 CNN 易过平滑的问题,提出 2.0M 参数 CFRNet,并用循环一致固定点训练让多次迭代成为受约束的粗到细复原而非启发式重复。其在 300 张 FFHQ-256 测试中 k=3 取得 LPIPS 0.250,k=2 的 PSNR/SSIM 最优,INT8 在 Hi3402 上约 23ms/次,可用循环次数调节质量与延迟。

Physics-Driven Semantic Scattering Structure Understanding of Aircraft Target in SAR Images Figure 1
2026-06-08eess.IV

Physics-Driven Semantic Scattering Structure Understanding of Aircraft Target in SAR Images

Yifei Yin, Xiaogang Yu, Hao Shi, Liang Chen, Wei Li

(Corresponding author: Hao Shi, Xiaogang Yu).X. Yu is with the Beijing Institute of Remote Sensing Information, Beijing, China.

2026-06-08视觉感知

针对SAR飞机解译中传统散射中心无序、缺少部件语义且易漏掉弱散射结构的问题,论文提出“语义散射结构理解”范式,并设计S³U-SAR,用语义关键点、可见性属性和刚体拓扑等物理先验构建完整结构表示;同时发布KP-SAR-Aircraft-1.0基准。实验显示其在多基线、跨类别/跨数据集上更稳健,并在航向估计P1°、P5°上较最强基线提升17.07%和19.31%。

Think Like a Pilot: Fine-Grained Long-Horizon UAV Navigation Figure 1
2026-06-08cs.RO

Think Like a Pilot: Fine-Grained Long-Horizon UAV Navigation

Xiangyi Zheng, Xiangyu Wang, Qinan Liao, Zimu Tang, Yue Liao, Dongyue Lyu, Guodong Wang, Junjie Liu, Si Liu

Colab, Colab, Beihang University, National University of Singapore

2026-06-08机器人

该文针对现有 UAV VLN 多为离散/粗动作、VLA 又偏短程原子任务的问题,提出 FLIGHT 长程细粒度导航基准,并用“Pilot Reasoning”显式记录飞行状态与下一子目标;方法上采用低频流式 VLM 负责任务推理、高频扩散动作模型负责连续 6-DoF 控制的异步架构。闭环评测中,FLIGHT VLA 在多阶段完成、子目标遵循和终端控制上优于代表性 VLN/VLA 基线,且其推理 VLM 提升了 UAV 视频推理能力。

AdaGRPO: A Capability-Aware Adaptive Enhancement for Flow-based GRPO Figure 1
2026-06-08cs.CV

AdaGRPO: A Capability-Aware Adaptive Enhancement for Flow-based GRPO

Jiazi Bu, Pengyang Ling, Yujie Zhou, Yibin Wang, Yuhang Zang, Tianyi Wei, Xiaohang Zhan, Jiaqi Wang, Tong Wu, Xingang Pan, Dahua Lin

Shanghai Jiao Tong University, S-Lab, Nanyang Technological University, Shanghai AI Laboratory, University of Science and Technology of China, Stanford University, Shanghai Innovation Institute, The Chinese University of Hong Kong, Fudan University

2026-06-08生成模型

本文针对文本到图像 flow 模型中 GRPO 对齐训练与模型当前能力脱节的问题,指出随机选 prompt 和仅用组内相对奖励会带来无效课程与优势估计偏差。AdaGRPO 用历史奖励 EMA 追踪全局能力,在线筛选处于学习边界的中等难度 prompt,并融合组内优势与全局基线优势。实验显示其可插入 Flow-GRPO、DanceGRPO、Flow-CPS 等框架,提升生成质量并稳定训练。

VideoSEG-O3: A Multi-turn Reinforcement Learning Framework for Reasoning Video Object Segmentation Figure 1
2026-06-08cs.CV

VideoSEG-O3: A Multi-turn Reinforcement Learning Framework for Reasoning Video Object Segmentation

Ming Dai, Sen Yang, Boqiang Duan, Boyuan Tong, Jiedong Zhuang, Wankou Yang, Jingdong Wang

2026-06-08视觉感知强化学习

面向长视频和复杂指代表达中的推理式视频目标分割,本文指出固定采样与一次性推理容易遗漏关键证据,且隐式 [SEG] token 难被强化学习直接按掩码质量优化。VideoSEG-O3 通过多轮时空 CoT 主动选择关键区间/帧,引入 SEG-aware logit calibration 将像素级反馈注入 token 策略,并用解耦思维轨迹与 VTS-CoT 冷启动数据训练;4B 模型在 8 个 RVOS 基准取得领先,LongRVOS、MeViS、ReVOS 分别提升约 6.1%、4.2%、4.0%。

Breaking the Lock-in: Diversifying Text-to-Image Generation via Representation Modulation Figure 1
2026-06-08cs.CV

Breaking the Lock-in: Diversifying Text-to-Image Generation via Representation Modulation

Dahee Kwon, Haeun Lee, Jaesik Choi

2026-06-08视觉感知

本文针对固定提示下文本到图像模型输出趋同、候选探索受限的问题,指出多样性塌缩并非只来自采样策略,而与 Transformer 中间特征的早期轨迹锁定有关。核心洞察是跨随机种子的零频空间均值(DC)分量会快速收敛,进而限制布局和风格变化;作者提出免训练的 DAVE,在早期推理中轻量衰减该分量。实验显示其在保持提示一致性和图像质量的同时提升多样性,且计算与显存开销显著低于需批量优化或额外采样的方法。

MedSIGHT: Towards Grounded Visual Comprehension in Medical Large Vision-Language Models Figure 1
2026-06-08cs.CV

MedSIGHT: Towards Grounded Visual Comprehension in Medical Large Vision-Language Models

Aofei Chang, Le Huang, Alex James Boyd, Parminder Bhatia, Taha Kass-Hout, Fenglong Ma, Cao Xiao

2026-06-08视觉语言视觉感知

针对医学大视觉语言模型难以把诊断语义与像素级证据统一起来的问题,MedSIGHT在输入端引入Region Perceiver提取区域级细粒度表征,在输出端把模态感知区域码本并入LLM词表,使模型可生成可解码为分割掩码的区域 token,并用渐进式训练稳定对齐。文中称其仅用72K多模态指令样本,在多模态医学理解、分割及新DiagSeg grounded诊断分割基准上达到SOTA。

Compute-Optimal Network Design for Echocardiography Myocardial Segmentation and Perfusion Quantification using Neural Scaling Laws Figure 1
2026-06-08eess.IV

Compute-Optimal Network Design for Echocardiography Myocardial Segmentation and Perfusion Quantification using Neural Scaling Laws

Clara Rodrigo González, Matthieu Toulemonde, Lasha Gvinianidze, Cameron A. B. Smith, Oscar Bates, Roxy Senior, Fu Siong Ng, Meng-Xing Tang

Department of Bioengineering, Imperial College London, National Heart and Lung Institute

2026-06-08视觉感知

针对CEUS心肌灌注量化依赖耗时手工分割、且小样本下模型规模难选的问题,论文将神经缩放律用于超声心肌分割,用小数据子集外推不同U-Net规模的全量测试损失,并考察从CAMUS到25例CEUS数据的迁移。结果显示缩放律可指导算力最优选型,CAMUS上以少240倍参数达到SOTA,CEUS灌注参数与资深心脏科医生标注相当,但跨域绝对损失存在偏差。

Anchored, Not Graded: Vision-Language Models Fail at Slant-from-Texture Perception Figure 1
2026-06-08cs.CV

Anchored, Not Graded: Vision-Language Models Fail at Slant-from-Texture Perception

Qian Zhang, Michal Golovanevsky, Fulvio Domini, James Tompkin

2026-06-08视觉语言视觉感知

论文以纹理推断表面倾斜这一经典心理物理任务检验VLM是否具备低层几何感知,而非只看高层视觉语言基准。其核心洞察是:模型可能编码了几何信息,却在语言输出端把连续倾斜压成少数锚点。多模型实验显示,零样本和上下文学习几乎不随视场、光学倾斜或曲率变化;监督微调能改善单调性和曲率判断,但离散锚定仍存在。

USU-Corn-WeedDB: A UAV RGB Image Dataset for Multi-Species Weed Detection in Forage Corn Figure 1
2026-06-08cs.CV

USU-Corn-WeedDB: A UAV RGB Image Dataset for Multi-Species Weed Detection in Forage Corn

Utsav Bhandari, Saroj Burlakoti, Rhonda Miller, Sierra Young, Eric Westra, Aaron Etienne

Department of Applied Sciences, Technology, and Education, Utah State University, Logan, UT, USA, Department of Plants, Soils & Climate, Utah State University, Logan, UT, USA, Department of Civil and Environmental Engineering, Utah State University, Logan, UT, USA, scarcity of field-representative training datasets. We present USU-Corn-WeedDB, a publicly available, instances, with the remaining 8,000 tiles retained as an unlabeled pool for semi-supervised experiments., performance relevant to edge-deployed UAV systems. USU-Corn-WeedDB is publicly available at, significant time and expert labor for accurate data annotation. This is especially prevalent in corn fields., consistent labeling standards across thousands of image tiles captured under varying flight altitudes, illumination, and growth stages. Thus, a single field may require months of expert labor to achieve, iteratively generates pseudo-labels for unannotated images using various SSL frameworks. This process, can substantially reduce the annotation burden while still retaining the benefits of label-guided, supervision. The effectiveness of this approach, however, depends on the availability of a paired

2026-06-08视觉感知数据集/基准

面向玉米田杂草检测中真实田间数据和标注稀缺的问题,论文发布 USU-Corn-WeedDB:来自犹他商业饲用玉米田的无人机 RGB 数据集,含 800 张三类杂草框标注图像与 8000 张未标注图像,保留自然类别不均衡以支持监督和半监督研究。作者用多代 YOLO 与 RT-DETR 等 28 个检测器验证,mAP@0.5 为 0.773–0.840,轻量模型也具备边缘部署潜力;但数据仅来自单地单日,跨地域和生长期泛化仍需验证。

MMBU: A Massive Multi-modal Biomedical Understanding Benchmark to Probe the Perception Capabilities of Vision-Language Models Figure 1
2026-06-08cs.CV

MMBU: A Massive Multi-modal Biomedical Understanding Benchmark to Probe the Perception Capabilities of Vision-Language Models

Ryan D'Cunha, Alejandro Lozano, Xiaoxiao Sun, Daniel Vela Jarquin, Min Woo Sun, Josiah Aklilu, James Burgess, Yuhui Zhang, Ryan Nayebi, Paola Avila, Robayo, Jin Ye, Ming Hu, Zhongying Deng, Junjun He, Xin Chen, Yue Yao, Robert Tibshirani, Jeffrey J. Nirschl, Serena Yeung-Levy

2026-06-08视觉语言视觉感知数据集/基准

针对现有生物医学 VLM 评测数据集覆盖窄、元数据不足且可能与训练数据重叠导致能力被高估的问题,MMBU 构建了覆盖 11 类模态、35 个子模态、410 个数据集和丰富结构化元数据的大规模基准,统一评测开放/封闭分类、定位分类与检测等感知任务。对 15 个开源权重模型和 2 个前沿 VLM 的实验显示,医学适配虽带来有限可测增益,但各模型错误率仍高,尤其在空间定位与跨域泛化上存在明显短板。

S23DR 2026 Winning Solution Figure 1
2026-06-08cs.CV

S23DR 2026 Winning Solution

Jan Skvrna, Miroslav Purkrabek, Lukas Neumann

Visual Recognition Group, Czech Technical University in Prague

2026-06-08三维

本文针对无 RGB、仅有稀疏 SfM 点云、拟合深度和语义分割的建筑三维线框重建难题,将顶点预测建模为条件集合生成:用 Perceiver 风格场景编码器汇聚语义点云,再以 flow-matching DiT 去噪 64 个顶点槽,并通过全局预测、凸包裁剪细化和多样本共识稳定推理。该方案在 S23DR 2026 私榜获第一,HSS 达 0.654,顶点 F1 为 0.791。

RPC-GS: Gaussian Splatting with native RPC Rendering for Satellite Imagery Figure 1
2026-06-08cs.CV

RPC-GS: Gaussian Splatting with native RPC Rendering for Satellite Imagery

Valentin Wagner, Sebastian Bullinger, Christoph Bodensteiner, Michael Arens

Fraunhofer Institute of Optronics, System Technologies and Image Exploitation

2026-06-08视觉感知三维

卫星影像的推扫传感器通常用非线性 RPC 描述,既有 3D Gaussian Splatting 为适配透视/仿射渲染而近似相机,易引入系统几何误差。RPC-GS 将高斯均值与协方差直接经地理坐标变换链和 RPC 投影,并用雅可比协方差传播与基于度量射线的深度排序实现原生渲染。在 DFC2019 和 IARPA2016 上,其平均高程误差较透视/仿射近似分别降低 29.6%/63.8% 与 9.9%/37.9%。

RigPAPR: Rig-Based Animation of Static Neural Point Clouds from a Fixed-Viewpoint Video Figure 1
2026-06-08cs.CV

RigPAPR: Rig-Based Animation of Static Neural Point Clouds from a Fixed-Viewpoint Video

Shichong Peng, Yanshu Zhang, Ke Li

APEX Lab, School of Computing Science, Simon Fraser University

2026-06-08视觉感知三维

该文面向从静态神经点云和单目固定视角驱动视频生成可重摆姿三维资产的问题,动机是现有高斯点在骨骼 LBS 关节处易因固定协方差形状产生裂缝和尖刺。核心洞察是改用无单点形状参数的 PAPR,让像素由变形后邻近点实时插值重组,并结合自动绑定与两阶段优化恢复骨骼、权重和动作。实验显示其在监督视角与强基线接近,在合成新视角较网格和高斯方案提升约 3dB PSNR,并呈现更干净的关节区域。

Adaptive Band Selection for Hyperspectral Classification with Spatially Disjoint Evaluation Figure 1
2026-06-08cs.CV

Adaptive Band Selection for Hyperspectral Classification with Spatially Disjoint Evaluation

Ikram El-Hajri (1), Ouassim Karrakchou (1), Alejandro Mousist (2) ((1) International University of Rabat, Rabat, Morocco, (2) Thales Alenia Space, Spain)

2026-06-08数据集/基准

针对高光谱分类中可微选带对初始化、硬子集提取和预设波段数敏感的问题,论文提出 SGBR-HC:先用训练像素的类别可分性与谱间多样性生成监督谱组排序,再初始化 Hard-Concrete 稀疏门并与分类器联合优化,由正则强度自适应决定约 20 个波段。在 Pavia University 与 Houston 2013 的空间不相交评测中取得最高平均 OA/κ;去掉排序先验显著降点,并显示随机像素划分会把 PU 的 OA 虚高 30.56 个百分点。

JA-SIREN: Deterministic Initialization for Sinusoidal Networks via Spectral Matching Figure 1
2026-06-08cs.CV

JA-SIREN: Deterministic Initialization for Sinusoidal Networks via Spectral Matching

Mohammed Alsakabi, Kejia Hu, John M. Dolan, Ozan K. Tonguz

Department of Electrical and Computer Engineering, College of Engineering, The Robotics Institute, School of Computer Science, Carnegie Mellon University, Pittsburgh, PA, USA

2026-06-08视觉感知

本文针对 SIREN 等正弦隐式神经表示随机初始化导致重建质量和复现实验波动的问题,提出 JA-SIREN:先对目标信号做 DST,再用 Jacobi-Anger 展开和贝塞尔函数为两层正弦 MLP 解析设定权重,使初始频谱匹配信号且无需随机种子。在 Kodak 图像拟合上平均 PSNR 达 67.18 dB,比最佳基线高 21.30 dB,并实现零 run-to-run 方差。

Architecture-Adaptive Uncertainty Fusion for Deepfake Detection Figure 1
2026-06-08cs.CV

Architecture-Adaptive Uncertainty Fusion for Deepfake Detection

Ritesh Sharma, Mohammad Ghasemigol, Yuichi Motai

2026-06-08视觉感知安全鲁棒

论文关注深伪检测在高准确率下仍缺乏可靠“不确定性”这一取证部署痛点,提出后处理的 COF:按架构自适应地融合认知、偶然、校准、保形和分布不确定性,并直接优化其与预测错误的相关性。实验显示 COF 无需改模型、优化约 42 秒,域内略逊于随机森林等非线性方法,但跨 CelebDF 更稳;同时跨数据集相关性普遍崩塌,指出域自适应 UQ 才是关键瓶颈。

Inside the Visual Mind: Neuroscience-Motivated Concept Circuits for Interpreting and Steering Vision Transformers Figure 1
2026-06-08cs.CV

Inside the Visual Mind: Neuroscience-Motivated Concept Circuits for Interpreting and Steering Vision Transformers

Tang Li, Yanlin Chen, Mengmeng Ma, Xi Peng

2026-06-08视觉感知

论文针对 ViT 高准确率背后可能依赖伪相关线索、内部机制难诊断的问题,提出受视觉神经层级启发的 ViSAE 工具箱:用 64K 探针图像和 16K 分层概念训练/解释 SAE,并结合自上而下概念读取与自下而上因果电路追踪。结果显示其概念覆盖效率较 ImageNet 高 20 倍,解释准确率提升 28.7%,在 WaterBirds 上通过概念编辑将最差组准确率提升 48.2%。

From Pixels to Newtons: Predicting In Vivo Joint Contact Forces from Monocular Video Figure 1
2026-06-08cs.CV

From Pixels to Newtons: Predicting In Vivo Joint Contact Forces from Monocular Video

Jessy Lauer

2026-06-08视觉感知

关节接触力对植入物寿命、骨关节炎和康复评估关键,但通常只能靠有创植入物或复杂肌骨模型间接获得。本文用未标定单目视频恢复SMPL运动特征,并以融合体型、关节、活动文本和V-JEPA视频表征的Transformer直接预测髋/膝3D接触力及不确定性。基于OrthoLoad 26名患者、25类活动的留一受试者验证,髋/膝RMSE达0.32/0.23 BW,接近实验室级肌骨仿真,并在独立植入物队列零样本测试中可媲美既有方法。

What Matters When Cotraining Robot Manipulation Policies on Everyday Human Videos? Figure 1
2026-06-08cs.RO

What Matters When Cotraining Robot Manipulation Policies on Everyday Human Videos?

Richard Li, Aditya Prakash, Andrew Wen, Saurabh Gupta, Yilun Du, Pulkit Agrawal

Massachusetts Institute of Technology, University of Illinois Urbana-Champaign, Harvard University

2026-06-08机器人视觉感知

为缓解机器人操作示教数据稀缺,论文系统考察日常人类视频能否与机器人数据共同训练。作者构建含532段、28小时高质量三角化3D手部标注的TriHands,指出关键瓶颈不仅是手姿质量,还包括自然人类动作与机器人动作的 embodiment gap,并通过图像尺度对齐、token级融合及按具身分离的动作编解码器缓解。六个真实操作任务、3480次rollout显示,低机器人数据下成功率绝对提升约29.7%,且高质量手标注明显优于单目估计。

Direct 3D-Aware Object Insertion via Decomposed Visual Proxies Figure 1
2026-06-08cs.CV

Direct 3D-Aware Object Insertion via Decomposed Visual Proxies

Jingbo Gong, Yikai Wang, Yushi Lan, Yuhao Wan, Ziheng Ouyang, Rui Zhao, Ming-Ming Cheng, Qibin Hou, Chen Change Loy

2026-06-08三维

本文针对现有物体插入方法多停留在二维修补、难以精确指定三维姿态的问题,提出 DIRECT:先由参考图生成粗三维代理并按用户 6-DoF 姿态渲染为稠密几何条件,再将外观、几何与背景上下文拆分到独立通路注入,以减少条件纠缠;同时构建约 16 万对混合训练数据。实验显示其在姿态可控性、重建质量和身份保持上优于基线。

ErA: Error-Aware Deep Unrolling Network for Single Image Defocus Deblurring Figure 1
2026-06-08eess.IV

ErA: Error-Aware Deep Unrolling Network for Single Image Defocus Deblurring

Tu Vo, Chan Y. Park

KC Machine Learning Lab

2026-06-08视觉感知

针对单幅离焦去模糊中 PSF 空间变化强、传统两阶段估计误差易累积且高斯/圆盘核假设过强的问题,ErA 将紧凑核基与逐像素权重学习结合,并在增广拉格朗日深度展开中加入稀疏误差项,通过闭式更新与 ResUNet 去噪交替校正核估计偏差。实验报告其在 DPDD、RealDOF、RTF 上取得领先 PSNR/SSIM,并在无真值 CUHK 上表现出较好泛化。

Synthetic Benchmarks Overstate Forward-Forward Scaling: Real-Data Limits of Layer-Local Training Figure 1
2026-06-08cs.CV

Synthetic Benchmarks Overstate Forward-Forward Scaling: Real-Data Limits of Layer-Local Training

Yucheng Chen

2026-06-08数据集/基准

本文针对 Forward-Forward 层局部训练是否能在真实视觉规模替代反向传播的问题,提出 DTG-FF,结合动态温度 goodness、解耦归一化与多层特征融合,用作强基线审计。结果显示其虽刷新多项 FF 基准,但在 CIFAR-10/100 仍落后匹配 BP 2.40/5.93 个百分点,ImageNet-100 仅 49.4%;合成任务随类别数增长的优势不能迁移到真实细粒度分类,且内存/吞吐也未优于公平 BP 基线。

WorldBench: A Challenging and Visually Diverse Multimodal Reasoning Benchmark Figure 1
2026-06-08cs.CV

WorldBench: A Challenging and Visually Diverse Multimodal Reasoning Benchmark

Yida Yin, Harish Krishnakumar, Chung Peng Lee, Boya Zeng, Wenhao Chai, Shengbang Tong, Wenhu Chen, Hu Xu, Xingyu Fu, Gabriel Sarch, Aleksandra Korolova, Zhuang Liu

Princeton University, University of Waterloo 4Meta, FAIR

2026-06-08视觉语言强化学习数据集/基准

WorldBench针对现有多模态评测偏重任务类型、忽视开放世界视觉多样性的问题,改以“视觉概念覆盖”构建基准:用LLM辅助 taxonomy 覆盖7类、2000个概念,采集非典型场景图并人工设计前沿模型会出错的问题。定量嵌入指标和人评均显示其视觉多样性领先;15个MLLM测试中最强仅64.0%,开源最佳56.6%,暴露细粒度感知和无依据推断等短板。

DSU-Net: An Attention-Enhanced Dense Skip U-Net for Breast Lesion Segmentation in Mammographic Images Figure 1
2026-06-08q-bio.QM

DSU-Net: An Attention-Enhanced Dense Skip U-Net for Breast Lesion Segmentation in Mammographic Images

Reza Bozorgpour, Mohammadreza Soltany Sadrabadi

Department of Biomedical Engineering, University of Wisconsin-Milwaukee, Milwaukee, WI, USA, Department of Mechanical Engineering, Northern Arizona University, Flagstaff, AZ, USA, making the process labor-intensive and time-consuming for radiologists. These challenges have motivated

2026-06-08视觉感知

针对乳腺钼靶病灶形态差异大、边界低对比且前景/背景严重不平衡的问题,论文提出 DSU-Net,在 U-Net 中加入瓶颈处密集特征传播与注意力引导跳连,并用 Dice、Focal、BCE 组合损失训练,以减少信息丢失和无关背景传递。在 CBIS-DDSM 验证集上取得 Dice 0.9421、IoU 0.8905、AUC 0.9878,但跨数据集泛化与各模块独立增益仍文中未充分说明。

Attention-Guided Autoencoder Fusion for Insulator Defect Detection Using UAV Transmission-Line Imaging Figure 1
2026-06-08cs.CV

Attention-Guided Autoencoder Fusion for Insulator Defect Detection Using UAV Transmission-Line Imaging

Malak Allam, Khaled Shaban, Ali Hamdi

2026-06-08视觉感知

面向无人机巡检中绝缘子缺陷小、尺度变化大且类别不均衡的问题,论文提出 AE-YOLO:在 FPN-PAN 融合中嵌入轻量自编码器,并结合 CBAM、方差最大化正则、WBF 与置信度增强以保留异常特征。Insulator-Defect 数据集上 EfficientNetV2 版本达 95.10% mAP@0.5、96.40% 精度和 93.80% 召回,较最强 YOLO 基线 mAP 提升 5.0 点。

GOPAgen: Motion-Aware and Efficient Agentic Long-Video Understanding with Structural Memory and Hierarchical Reasoning Figure 1
2026-06-08cs.CV

GOPAgen: Motion-Aware and Efficient Agentic Long-Video Understanding with Structural Memory and Hierarchical Reasoning

Haozhe Chi, Yang Jin, Yadong Mu

Peking University

2026-06-08视觉感知

针对长视频智能体常因稀疏采样丢失细粒度运动、且记忆检索低效的问题,GOPAgen 将视频编码中的 GOP 与运动向量引入理解流程,训练专门的运动 agent,并用结构化局部记忆、运动向量库和 GOP 树式粗到细推理来定位证据。实验显示其在 MotionBench、Egoschema 等 VQA 基准上优于既有方法,同时降低 token 与推理开销。

Advanced Flood Prediction with Physics-Guided Deep Learning: Combining UNet, FNO, and SAR/Optical Imagery Figure 1
2026-06-08eess.IV

Advanced Flood Prediction with Physics-Guided Deep Learning: Combining UNet, FNO, and SAR/Optical Imagery

Tewodros Syum Gebre, Jagrati Talreja, Leila Hashemi-Beni

2026-06-08视觉感知

针对卫星影像难以直接给出应急所需水深、流速且纯数据驱动模型缺乏水动力一致性的问题,本文融合Sentinel-1 SAR、Sentinel-2光学与DEM特征,提出UNet捕捉局部淹没边界、FNO建模流域尺度相互作用,并用浅水方程残差约束质量和动量守恒。实验中洪水范围IoU达0.82、F1为0.90,水深和流速RMSE分别为0.21 m与0.15 m/s,质量不平衡低于2.1%,消融显示物理正则缺失会明显退化。

Applying Deep Learning for cockpit segmentation in the context of mixed reality Figure 1
2026-06-08cs.CV

Applying Deep Learning for cockpit segmentation in the context of mixed reality

Alexandre Leles Sousa, Pedro de Oliveira Nielson, Erick Oliveira Rodrigues, Rafael Francisco dos Santos, Giovani Bernardes Vitor

* Laboratdrio de Robética, sistemas inteligentes e Complezos - RobSIC, “U-net” and “DeepLabV3+" are applied to perform image segmentation. As a result, metrics, The COCO dataset, which is a dataset available for, is “DeepLabV3+”. Finally, all the good results generated, these studies, namely “U-net” and “DeepLabV3+”, in order

2026-06-08视觉感知

为提升矿用 CAT793F 卡车模拟器混合现实训练的沉浸感,论文将座舱与用户手臂等真实前景从第一视角相机画面中分割,以便叠加到虚拟环境。核心工作是面向特定座舱场景实现并比较 U-net 与 DeepLabV3+ 两类语义分割网络,而非通用数据集评测。文中报告分割指标约 90% 准确率并据此选择较优模型,但具体增益来源和实时性细节未充分说明。

A Geometric Gaussian Mixture Representation of Plane Curves Figure 1
2026-06-08cs.CG

A Geometric Gaussian Mixture Representation of Plane Curves

Ali Darijani, Benedikt Stratmann, Jürgen Beyerer

2026-06-08三维

本文针对传统平面曲线表示只给出确定几何、难以直接表达法向不确定性的问题,提出先将曲线离散为带法向标准差的概率多边形段,再用一阶和二阶矩闭式转换为高斯分量并按段长混合成 GMM。该方法避免从点云迭代拟合,保留局部切向、法向和弧长尺度;在多类典型曲线实验中可较好重建全局形状,但结果主要是表示能力展示,实际下游增益文中未充分说明。

Semantic-Structural Alignment for Generative Pictorial Charts Figure 1
2026-06-08cs.GR

Semantic-Structural Alignment for Generative Pictorial Charts

Zhida Sun, Yulin Zhang, Zheng Gu, Min Lu, Bongshin Lee, Daniel Cohen-Or, Hui Huang

ZHIDA SUN, Shenzhen University, China, YULIN ZHANG, Shenzhen University, China, ZHENG GU, Shenzhen University, China, MIN LU, Shenzhen University, China, BONGSHIN LEE, Yonsei University, South Korea, DANIEL COHEN-OR, Shenzhen University, China, HUI HUANG∗, Shenzhen University, China, traditional controllable generation and image editing baselines, providing a, • Human-centered computing →Visualization., Research Center (VCC), College of Computer Science and Software Engineering (CSSE), Shenzhen University, China, Yulin Zhang, VCC, CSSE, Shenzhen University, China

2026-06-08生成模型

论文针对传统图表精确但缺少吸引力、现有图像编辑又难保持数据结构的问题,提出双条件的图形图表生成框架:用文本控制语义对象,用原始统计图作为结构约束,并在多模态 DiT 中加入 Structural/Semantic DIFT 做特征级对齐与外观迁移。实验和用户研究显示,该方法在柱形等多类视觉通道上比 ControlNet、SDEdit 等基线更能兼顾可读的结构一致性与图像表现力。

Real-Time AttentionBender: Granular Interactive Network Bending of Video Diffusion Transformers Figure 1
2026-06-08cs.GR

Real-Time AttentionBender: Granular Interactive Network Bending of Video Diffusion Transformers

Adam Cole, Mick Grierson

University of the Arts London, as independently manipulable surfaces, with targeting down to, this approach by presenting an expressive and controllable inter-

2026-06-08视觉感知生成模型

该文针对视频生成模型仅靠提示词、艺术家难以理解和干预内部过程的问题,提出 Real-Time AttentionBender:在实时 Wan/DayDream Scope 管线中对 DiT 的自注意力、交叉注意力和 FFN 进行逐层、逐扩散步、逐 token/神经元的网络弯折。系统在单张 RTX A6000 Pro 上约 15 FPS,并展示不同层与神经元调制会改变结构和纹理,但正式用户研究和定量可解释性评估文中未充分说明。

2026-06-05

124 篇
PAR3D: A Unified 3D-MLLM with Part-Aware Representation for Scene Understanding Figure 1
2026-06-05cs.CV

PAR3D: A Unified 3D-MLLM with Part-Aware Representation for Scene Understanding

Shaohui Dai, Yansong Qu, You Shen, Shengchuan Zhang, Liujuan Cao

Key Laboratory of Multimedia Trusted Perception and Efficient Computing, Ministry of Education of China, Xiamen University

2026-06-05三维

面向机器人等具身交互,现有3D-MLLM偏重物体级理解,难以定位把手、抽屉等功能部件。PAR3D的核心是把部件建模为依附于宿主物体的层级语义单元,并引入ScenePart合成场景数据、部件感知3D表征学习和层级分割查询生成。实验显示其显著提升部件级问答与指代表达分割,同时保持较强物体级任务表现,但真实扫描域差距仍需验证。

Complexity-Balanced Diffusion Splitting Figure 1
2026-06-05cs.CV

Complexity-Balanced Diffusion Splitting

Noam Issachar, Dani Lischinski, Raanan Fattal

The Hebrew University of Jerusalem

2026-06-05生成模型

论文针对扩散/流匹配模型用单一大网络覆盖全时间轴导致容量分配低效的问题,提出 CBS:用 de Boor 等分复杂度原则按近似负担切分时间,并以 Dirichlet 能量和采样轨迹加速度估计局部复杂度,从而训练多个专门子网络。实验在 SiT、JiT、UNet 等架构上提升生成质量且不增加单步推理开销,SiT-XL 相比朴素切分 FID 最高改善约 35%。

Thinking with Imagination: Agentic Visual Spatial Reasoning with World Simulators Figure 1
2026-06-05cs.CV

Thinking with Imagination: Agentic Visual Spatial Reasoning with World Simulators

Chenming Zhu, Jingli Lin, Yilin Long, Peizhou Cao, Tai Wang, Jiangmiao Pang, Xihui Liu

2026-06-05强化学习

这篇论文针对VLM在少量第一视角图像下难以推断未观察布局、保持跨视角一致的问题,提出Astra:让RL训练的Astra-VL主动向经视角一致性调优的Astra-WM世界模拟器请求新视角“想象”证据,并学习何时、向哪里、如何使用。实验显示,Astra-WM使Gemini-3-Flash在MMSI-Bench由45.1升至49.5,完整框架使Qwen3-VL在MMSI-Bench由29.8升至38.8、MindCube由36.8升至42.7。

In-Context Multiple Instance Learning Figure 1
2026-06-05cs.LG

In-Context Multiple Instance Learning

Alexander Möllers, Marvin Sextro, Julius Hense, Gabriel Dernbach, Klaus-Robert Müller

Berlin Institute for the Foundations of Learning and Data, Berlin, Germany, Institute of Pathology, Charité – Universitätsmedizin Berlin, Berlin, Germany, Max-Planck Institute for Informatics, Saarbrücken, Germany, Department of Artificial Intelligence, Korea University, Seoul, Korea

2026-06-05视觉感知

本文针对多实例学习中只有少量袋级标签时,监督聚合器易过拟合或偏置不匹配的问题,提出 ICMIL:用合成袋结构任务预训练 Perceiver 风格的上下文学习器,并混合因子化与联合先验以覆盖不同 MIL 归纳偏置。推理时无需梯度更新即可用少量标注袋预测;在 12 个基准低标签设置下取得最佳平均 AUROC 和排名,但向更大袋、高维特征与多分类扩展仍需验证。

A Vision-language Framework for Comparative Reasoning in Radiology Figure 1
2026-06-05cs.CV

A Vision-language Framework for Comparative Reasoning in Radiology

Tengfei Zhang, Ziheng Zhao, Lisong Dai, Xiaoman Zhang, Pengcheng Qiu, Ya Zhang, Yanfeng Wang, Weidi Xie

University of Science and Technology of China, Shanghai Artificial Intelligence Laboratory, School of Artificial Intelligence, Shanghai Jiao Tong University, Department of Radiology, Renmin Hospital of Wuhan University, Shanghai Sixth People’s Hospital Affiliated to Shanghai Jiao Tong University, Department of Biomedical Informatics, Harvard Medical School

2026-06-05视觉语言视觉感知

针对医学影像AI多按单图解读、难以支持放射科常见的随访比较和相似病例参照问题,本文将比较诊断建模为实体感知的跨图像推理,构建MedReCo-DB,并提出用于可控检索的MedReCo和生成变化描述的MedReCo-VLM。结果显示其在12个内部检索设置Recall@1均最佳,外部检索平均提升6.0个百分点,纵向随访准确率在胸片和CT上分别提升14.5–46.5和13.0–27.9个百分点。

HomeWorld: A Unified Floorplan-to-Furnished Framework for Generating Controllable, Densely Interactive Whole-Home Scenes Figure 1
2026-06-05cs.CV

HomeWorld: A Unified Floorplan-to-Furnished Framework for Generating Controllable, Densely Interactive Whole-Home Scenes

Wenbo Li, Xiaoliang Ju, Zipeng Qin, Rongyao Fang, Hongsheng Li

2026-06-05强化学习规划控制

面向具身智能仿真中缺少真实、多房间、可交互家庭场景的问题,HomeWorld将整屋生成拆成可控层级流程:先用30万真实户型和K-D树表示训练LLM生成平面图,再结合图像生成、多视角漫游、VLM递归修正与3D资产替换布置家具和可操作小物体,并补充物理属性。实验和用户研究显示其在布局多样性、3D设计吸引力及定量/定性指标上优于既有方法,但增益可能主要来自scaling / data。

EasyLens: A Training-Free Plug-and-Play Subtle-Lesion Representation Amplifier for Medical Vision-Language Models Figure 1
2026-06-05cs.CV

EasyLens: A Training-Free Plug-and-Play Subtle-Lesion Representation Amplifier for Medical Vision-Language Models

Qiwei Zeng, Hao Wang, Jinghao Lin, Shuchang Ye, Yuezhe Yang, Yige Peng, Haoyuan Che, Jinman Kim, Lei Bi

Jilin University, Changchun, China, School of Computer Science, The University of Sydney, Sydney, NSW, Australia, Institute of Translational Medicine, Shanghai Jiao Tong University, Shanghai, China

2026-06-05视觉语言视觉感知

医学视觉语言模型在全局聚合时容易稀释低对比、稀疏的微小病灶线索,导致漏检。EasyLens的核心思路是不训练原模型,而用病灶—解剖原型库EasyBank对局部patch做病理与正常参照比较,再由EasyTag筛选疑似病灶区域,EasyAmplifier以形态引导残差增强其表示。多数据集和冻结VLM实验显示,该方法提升微小病灶检测与报告生成,并优于需训练的编码器增强基线。

Visual Commonsense Driven Knowledge Refinements for Scene Graph Generation Figure 1
2026-06-05cs.CV

Visual Commonsense Driven Knowledge Refinements for Scene Graph Generation

Maëlic Neau, Salim Baloch, Jakob Suchan, Zoe Falomir, Mehul Bhatt

2026-06-05视觉感知

针对场景图生成在长尾关系和稀疏标注下容易产生违背视觉常识的关系预测,本文提出无需重训、模型无关的后处理框架:从训练数据自动挖掘空间可行性、角色基数和逻辑蕴含等约束,并用声明式常识推理修正排序结果、补全缺失关系。在 PSG、VG150、IndoorVG 及 Motifs、Transformer、REACT++ 上均带来 F1@K 提升,并用约束违反率显示一致性改善。

GMBFormer: An NDVI-Guided Global Memory Bank Transformer for Urban Green-Space Extraction from Ultra-High-Resolution Imagery Figure 1
2026-06-05cs.CV

GMBFormer: An NDVI-Guided Global Memory Bank Transformer for Urban Green-Space Extraction from Ultra-High-Resolution Imagery

Hao Lei, Xi Cheng, Chenlu Shu, Zhiheng Chen, Zhengjie Duan, Haoyu Wang, Zhanfeng Shen

College of Geophysics, Chengdu University of Technology, Chengdu 610059, China

2026-06-05视觉感知

面向超高分辨率城市绿地分割中按块处理导致跨区域相似植被证据难复用、NDVI直接拼接又易扰乱RGB表征的问题,GMBFormer将NDVI解耦为高置信植被原型的写入门控,并用全局记忆库与跨注意力按语义相似性检索原型增强当前块。其在成都自建数据集和两个Potsdam弱标注设置上均优于受控SegFormer-B4,mIoU/mDice分别达到89.25/94.31%、92.17/95.92%和83.72/90.86%。

Physics in 2-Steps: Locking Motion Priors Before Visual Refinement Erases Them Figure 1
2026-06-05cs.CV

Physics in 2-Steps: Locking Motion Priors Before Visual Refinement Erases Them

Woojung Han, Seil Kang, Youngjun Jun, Min-Hung Chen, Fu-En Yang, Seong Jae Hwang

2026-06-05视觉感知

本文针对图生视频扩散模型视觉质量提升时常产生违背物理的运动这一问题,指出物理先验并非完全缺失,而是在多步去噪中因相位谱侵蚀被抹除:2步结果反而更保留正确运动。作者提出免训练的 PhaseLock,从少步 latent 提取帧间运动增量并在后续去噪中锁定相位结构,在 CogVideoX、Wan 2.1、LTX-Video 等模型上平均提升 Physics-IQ 6.2 分,同时仅带来约 1.06× 时间和 1.02× 显存开销。

Comparison of Deep Learning Frameworks For Rice Disease Mapping From UAV Multispectral Imaging Figure 1
2026-06-05cs.CV

Comparison of Deep Learning Frameworks For Rice Disease Mapping From UAV Multispectral Imaging

Yadav Raj Ghimire, Jagrati Talreja, Tewodros Syum Gebre, Timothy Agboada, Shikha V. Chandel, Leila Hashemi Beni

2026-06-05视觉感知

面向水稻白叶枯病的田间快速制图需求,论文在同一公开 UAV 多光谱 BLB 数据集和统一训练流程下,对 U-Net、U-Net++、DeepLabV3+ 与 SegFormer及 NDVI/NDRE 输入进行受控比较。核心洞察是轻量 CNN 编码器比小数据上的 Transformer 更稳,植被指数只带来小幅稳定增益;U-Net++-EfficientNet-B3 最高 mIoU 达 97.62%,速度与精度最适合部署。

StoryVideoQA: Scaling Deep Video Understanding with a Large-Scale, Multi-Genre and Auto-Generated Dataset Figure 1
2026-06-05cs.CV

StoryVideoQA: Scaling Deep Video Understanding with a Large-Scale, Multi-Genre and Auto-Generated Dataset

Zhengqian Wu, Zhixian Liu, Aodong Chen, Jingyang Zhang, Ruizhe Li, Hanlin Ge, Zhongyuan Wang, Chunxia Xiao, Chao Liang

2026-06-05视觉感知数据集/基准

论文针对现有 VideoQA 在长剧情、多角色关系和因果推理上的退化,提出 StoryMindv2 自动生成深度视频理解数据,并用监督引导与多评审投票提升电影/剧集问答质量;构建 393.2 小时、36.3 万问答的 StoryVideoQA。对 20 个方法评测显示其仍难维持长程角色关联,作者另以 PlotTree 层级剧情结构改进推理。

Efficient Mean Curvature Computation on High-Dimensional Data Manifolds Figure 1
2026-06-05cs.LG

Efficient Mean Curvature Computation on High-Dimensional Data Manifolds

Alexandre L. M. Levada

Federal University of São Carlos

2026-06-05视觉感知

本文针对高维数据流形上逐点平均曲率估计代价过高、难以用于几何感知学习的问题,利用协方差特征向量正交性与迹运算重写原估计式,避免显式构造高维特征矩阵,并结合局部协方差低秩性用截断 SVD 与 Haar 零空间近似替代完整特征分解。实验显示相较原实现约有 50–300 倍加速,精度损失很小,使曲率特征更适合作为机器学习预处理。

RhymeFlow: Training-Free Acceleration for Video Generation with Asynchronous Denoising Flow Scheduling Figure 1
2026-06-05cs.CV

RhymeFlow: Training-Free Acceleration for Video Generation with Asynchronous Denoising Flow Scheduling

Chensheng Dai, Shengjun Zhang, Yifan Li, Zhang Zhang, Zheng Zhu, Yueqi Duan

2026-06-05视觉感知生成模型

RhymeFlow针对DiT视频生成中每帧都完整经历全部去噪步导致的高延迟,提出免训练的异步去噪流调度:先按潜在语义变化选关键帧,仅关键帧密集去噪,非关键帧逐步跳步,并用潜在轨迹投影补齐被跳过状态以维持时序一致。实验称在现有DiT视频模型上相较缓存、稀疏注意等基线同时提升推理速度与视觉质量。

Towards One-to-Many Temporal Grounding Figure 1
2026-06-05cs.CV

Towards One-to-Many Temporal Grounding

Qi Xu, Yue Tan, Shihao Chen, Jiahao Meng, Anna Wang, Shunping Ji, Hao Fei, Jason Li

2026-06-05视觉语言

本文针对传统视频时序定位只找单个片段、难处理同一事件多次出现的问题,提出 One-to-Many Temporal Grounding,并将其建模为多区间生成任务。核心贡献是构建 OMTG Bench 与 5.6 万训练样本,引入 C-Acc、EtF1 等计数敏感指标,并用 SFT+RL 结合时间边界奖励和基于密集字幕 CoT 的完整性奖励优化模型。实验显示其在 OMTG Bench 上 EtF1 达 43.65%,较 Gemini 2.5 Pro 和 Seed-1.8 分别高 15.85% 和 15.61%。

Synthetic Data Generation and Vision-based Wrinkle and Keypoint Detection for Bimanual Cloth Manipulation Figure 1
2026-06-05cs.CV

Synthetic Data Generation and Vision-based Wrinkle and Keypoint Detection for Bimanual Cloth Manipulation

Ariel Herrera, Xueyang Kang, Atal Anil Kumar

Ariel Herrera is with the Department of Engineering, University of Luxembourg, Esch-sur-Alzette, Luxembourg.

2026-06-05机器人视觉感知

面向双臂布料操作中完全折叠、角点被遮挡导致难以选取抓取点的问题,论文构建域随机化 Blender 合成数据管线自动标注关键点,并结合 CNN 角点热图与 YOLOv8-OpenCV 褶皱检测,先沿结构褶皱拉伸、再转入基于角点的熨平。关键点检测在合成测试集上 MPE 为 1.7615±0.7461 像素,且无需微调可迁移到真实织物,较仅依赖角点或轮廓的方法更能处理高遮挡折叠状态。

Geodesic Flow Matching on a Riemannian Degradation Manifold for Blind Image Restoration Figure 1
2026-06-05cs.CV

Geodesic Flow Matching on a Riemannian Degradation Manifold for Blind Image Restoration

Akshay Janardan Bankar, Ankita Chatterjee, Sayan Banerjee, Shreyas Pandith, Kalakonda Sai Shashank, Amit Satish Unde

2026-06-05视觉感知生成模型

针对盲图像复原中退化类型未知、混合退化非线性而传统流匹配常假设欧氏线性插值的问题,本文将退化显式建模为低维黎曼流形上的状态,在Stable Diffusion潜空间与退化流形的乘积空间中做测地流匹配,并用两阶段训练约束切空间动力学。实验称在去模糊和恶劣天气复原等任务上,非欧几何可提升退化表示稳定性与轨迹结构性,双曲几何在严重退化下更有效,同时保持有竞争力的复原质量。

RadiusFPS: Efficient Farthest Point Sampling on CPUs and GPUs via Spherical Voxel Pruning Figure 1
2026-06-05cs.RO

RadiusFPS: Efficient Farthest Point Sampling on CPUs and GPUs via Spherical Voxel Pruning

Ziyang Yu, Xiang Li, Qiong Chang, Jun Miyazaki

School of Computing, Institute of Science Tokyo

2026-06-05视觉感知

论文针对机器人点云管线中 FPS 在大规模 LiDAR/RGB-D 输入下成为主要延迟与显存瓶颈的问题,提出 RadiusFPS:用球形体素建立保守半径界,先剪枝整块无关体素,再用坐标级跳过测试减少残余距离更新,并给出融合体素选择、剪枝和更新的 warp 级 GPU 版本。实验显示 CPU 最高较原始 FPS 加速 186×,GPU 最高降采样延迟较 GPU-FPS 降低 52×,端到端分割最高加速 2.5×,且精度基本相当、显存约为 QuickFPS 一半。

GRAMformer: Any-Order Modality Interactions via Volumetric Multimodal Cross-Attention Figure 1
2026-06-05cs.CV

GRAMformer: Any-Order Modality Interactions via Volumetric Multimodal Cross-Attention

Giordano Cicchetti, Eleonora Grassucci, Danilo Comminiello

Dept. of Information Engineering, Electronics, and Telecommunications, Sapienza University of Rome, Italy

2026-06-05视觉语言

本文针对多模态 Transformer 中跨注意力多依赖两两点积或拼接、难以显式建模高阶模态关系且随模态数开销上升的问题,提出 VMA:用查询与多模态 key 张成的平行多面体体积来定义注意力分数,并集成到 GRAMformer 以支持任意数量模态交互。实验显示其在多模态任务上较基线更准确且更轻量,但具体增益的任务分布与来源仍需结合完整实验细节判断。

Benchmarking Open-Source Layout Detection Models for Data Snapshot Extraction from Institutional Documents Figure 1
2026-06-05cs.CL

Benchmarking Open-Source Layout Detection Models for Data Snapshot Extraction from Institutional Documents

AJ Carl P. Dy, Aivin V. Solatorio

2026-06-05视觉感知数据集/基准

针对机构报告中大量可复用信息藏在图表而非正文、通用版面分析难以区分“有分析价值”与装饰性元素的问题,论文定义并基准化“数据快照抽取”任务,发布覆盖人道报告、世行论文和项目文件的数据集与评测框架。实验显示,多种开源布局检测模型虽在传统学术基准表现强,但在运营文档上泛化不足,常混淆非分析内容、切碎复合图表并漏掉标题图例等上下文。

SAM-Flow: Source-Anchored Masked Flow for Training-Free Image Editing Figure 1
2026-06-05cs.CV

SAM-Flow: Source-Anchored Masked Flow for Training-Free Image Editing

Haowang Cui, Rui Chen, Tao Luo, Tao Guo, Zheng Qin, Jiaze Wang

2026-06-05视觉感知生成模型

这篇论文针对免训练图像编辑中全局潜变量传输容易把目标语义泄漏到背景的问题,提出 SAM-Flow:先用 scout 图像与词元注意力联合定位可编辑区域,再仅在该区域施加差分 flow,并用动态软掩码把背景锚定回源图轨迹。实验显示其在 FLUX、SD3 等骨干上无需微调即可提升语义编辑准确性和背景保持性。

Symb-xMIL: Symbolic Explanations for Multiple Instance Learning in Digital Pathology Figure 1
2026-06-05cs.CV

Symb-xMIL: Symbolic Explanations for Multiple Instance Learning in Digital Pathology

Yanqing Luo (1 and 2), Julius Hense (1 and 2), Niklas Prenißl (3 and 4), Andreas Mock (5 and 6 and 7), Klaus-Robert Müller (1 and 2 and 8 and 9), Thomas Schnake (10 and 11 and 12), Mina Jamshidi Idaji (1 and 2) ((1) Berlin Institute for the Foundations of Learning and Data, Berlin, Germany, (2) Machine Learning Group, Technische Universität Berlin, (3) Institute of Pathology, Charité Universitätsmedizin, (4) Berlin Institute of Health at Charité -- Universitätsmedizin Berlin, BIH Biomedical Innovation Academy, BIH Charité Digital Clinician Scientist Program, (5) Institute of Pathology, Ludwig Maximilian University of Munich, Munich, (6) Division of Translational Medical Oncology, DKFZ, Heidelberg, NCT Heidelberg, (7) German Cancer Consortium (DKTK), partner site Munich, a partnership between DKFZ and Ludwig-Maximilians-Universität München (LMU), (8) Department of Artificial Intelligence, Korea University, Seoul, Korea, (9) Max-Planck Institute for Informatics, Saarbrücken, (10) Department of Chemistry, Chemical Physics Theory Group, University of Toronto, Canada, (11) Vector Institute for Artificial Intelligence, Toronto, (12) Acceleration Consortium, Canada)

Berlin Institute for the Foundations of Learning and Data, Berlin, Germany, Institute of Pathology, Charité Universitätsmedizin, Berlin, Germany, Berlin Institute of Health at Charité – Universitätsmedizin Berlin, BIH Biomedical Innovation Academy, BIH Charité Digital Clinician Scientist Program, Berlin, Germany, Institute of Pathology, Ludwig Maximilian University of Munich, Munich, Germany, Department of Artificial Intelligence, Korea University, Seoul, Korea, Max-Planck Institute for Informatics, Saarbrücken, Germany, Department of Chemistry, Chemical Physics Theory Group, University of Toronto, Canada, Vector Institute for Artificial Intelligence, Toronto, Canada, Acceleration Consortium, University of Toronto, Canada

2026-06-05视觉感知

针对数字病理中 MIL 模型解释多依赖热图、难以说明不同组织区域证据如何组合的问题,本文提出 Symb-xMIL,将模型行为与 AND/OR/NOT 等人可读逻辑规则对齐,并构建可跨样本比较的符号表示空间。实验显示其在合成 MIL 上能恢复真实规则,在肿瘤检测中暴露隐藏错误,并在 TCGA-HNSCC 的 HPV 预测中进一步细分与生存相关的患者亚群。

DisasterBench: A Multimodal Benchmark for UAV-Based Disaster Response in Complex Environments Figure 1
2026-06-05cs.CV

DisasterBench: A Multimodal Benchmark for UAV-Based Disaster Response in Complex Environments

Tan Zhang, Quanyou Li, Lu Zhang, Jun Liu, Xiaofeng Zhu, Ping Hu

2026-06-05视觉语言数据集/基准

论文针对灾害响应中无人机低空图像噪声大、遮挡多且现场算力受限的问题,指出现有基准偏重识别/描述,难以评估跨灾前、灾中、灾后的因果、演化和决策推理。作者构建DisasterBench,含5330张真实UAV图像、29300个样本、14类场景和9类任务,并提出2B轻量模型DisasterVL,通过领域指令、CoT对齐和强化学习优化;在21个MLLM对比中优于开源模型,并接近GPT-4o精度且更高效。

SC-MFJ: A Simple Haptic Quality Metric for Medical Image Segmentation Figure 1
2026-06-05cs.CV

SC-MFJ: A Simple Haptic Quality Metric for Medical Image Segmentation

Souraj Adhikary, Negar Chabi, Andre Mastmeyer

Jade University of Applied Sciences

2026-06-05视觉感知

面向手术触觉仿真,论文指出 Dice、HD95 只衡量几何重叠,难以发现分割表面阶梯伪影导致的力反馈突变。作者提出 SC-MFJ,通过在器官表面采样短虚拟触笔轨迹并计算接触力 jerk,低成本评估触觉可用性。胰腺和肝脏实验显示,高斯平滑相对二值输出将 SC-MFJ 分别改善 147 倍和 189 倍,而这些差异在 Dice/HD95 中基本不可见;SDF 回归均值接近但稳定性明显差于高斯平滑。

ActiveMimic: Egocentric Video Pretraining with Active Perception Figure 1
2026-06-05cs.RO

ActiveMimic: Egocentric Video Pretraining with Active Perception

Xingyao Lin, Guojin Zhong, Tianyi Lu, Ziyi Ye, Yichen Zhu, Zuxuan Wu, Yu-Gang Jiang

Fudan University, Shanghai Innovation Institute

2026-06-05视觉感知

该文针对第一视角人类视频预训练虽易扩展却弱于机器人数据的问题,指出关键缺口不是手部伪标签,而是被当作噪声的主动视角移动。ActiveMimic从单目穿戴RGB视频中恢复同步相机与双腕轨迹,构成统一27维动作并联合预训练感知与操作。真实机器人实验显示其优于人类视频基线,接近机器人数据预训练模型,且主动感知能力主要来自预训练。

Adversarial Attacks Already Tell the Answer: Directional Bias-Guided Test-time Defense for Vision-Language Models Figure 1
2026-06-05cs.CV

Adversarial Attacks Already Tell the Answer: Directional Bias-Guided Test-time Defense for Vision-Language Models

Liangsheng Liu, Si Chen, Jiamin Wu, Weiwei Feng, Zhixin Cheng, Xiaotian Yin, Wenfei Yang, Tianzhu Zhang

University of Science and Technology of China, National Key Laboratory of Deep Space Exploration, Deep Space Exploration Laboratory, The Chinese University of Hong Kong, Zhejiang University

2026-06-05视觉语言视觉感知

针对 CLIP 等视觉语言模型易受对抗扰动、而训练式防御成本高且可能损害零样本能力的问题,论文发现多种输入变换下,对抗样本特征会沿稳定主方向偏移,且该方向可反向指向正确类中心;据此提出 DBD,在测试时估计 Defense Direction,并用 DB-score 区分样本后进行双流特征重构。15 个细粒度与 ImageNet-OOD 数据集上,DBD 在保持干净精度的同时取得更强鲁棒性,部分对抗精度甚至高于干净精度。

RQUL-UIE: Revitalizing Quality-Unstable Labels for Underwater Image Enhancement via In-Dataset Self-Supervision Figure 1
2026-06-05cs.CV

RQUL-UIE: Revitalizing Quality-Unstable Labels for Underwater Image Enhancement via In-Dataset Self-Supervision

Haochen Hu, Yanrui Bin, Chih-yung Wen, Bing Wang

The Hong Kong Polytechnic University

2026-06-05视觉感知数据集/基准

本文针对水下图像增强中成对训练标签质量不稳定的问题:低质量“增强结果”若直接监督会拖累模型,删除又会损失有限数据。RQUL-UIE用预训练扩散模型的语义嵌入估计标签质量,并将其映射为不同去噪步数进行分级监督,同时加入傅里叶细节修复网络补偿高频纹理。实验在LSUI、EUVP、UIEB及多种无参考指标上显示其平均表现优于现有方法。

Adaptive Tokenisation Via Temporal Redundancy Masking And Latent Inpainting Figure 1
2026-06-05cs.CV

Adaptive Tokenisation Via Temporal Redundancy Masking And Latent Inpainting

Kevin Dave, Sai Aditya Patkuri, Chhaya Kumar Das, Gouranga Bala, R. Venkatesh Babu, Rajeshkumar SA

2026-06-05视觉感知

本文针对视频 tokeniser 固定预算或现有自适应方法推理开销大的问题,指出冻结连续潜空间中的相邻帧 L1 差异已能反映时间冗余;据此用固定阈值丢弃低变化 latent,并用轻量 LIT 做潜变量补全。TokenBench 与 DAVIS 上在重建质量接近基线的同时,实现内容驱动的 token 分配,相比 ElasticTok-CV 推理快 31×、相比 InfoTok 快约 2×,但无法保证目标码率。

AffordanceVLA: A Vision-Language-Action Model Empowering Action Generation through Affordance-Aware Understanding Figure 1
2026-06-05cs.RO

AffordanceVLA: A Vision-Language-Action Model Empowering Action Generation through Affordance-Aware Understanding

Qize Yu, Jiadi You, Yuran Wang, Jiaqi Liang, Bowen Ping, Yang Tian, Yue Chen, Minghong Cai, Zeying Gong, Ruihai Wu, Yinchuan Li, Junwei Liang, Yingcong Chen

2026-06-05视觉语言视觉感知

论文针对 VLA 中 VLM 语义空间与机器人 3D 控制动作之间的结构错配,提出以 affordance 作为任务导向中间表征,而非直接端到端映射。方法将操作先验拆为 Which2Act 目标物体定位、Where2Act 2D 交互区域预测和 How2Act 3D 几何推理,并结合 MoT 多专家架构、三阶段课程训练及自动标注增强。实验显示其在 LIBERO、CALVIN 和真实场景中取得有竞争力的成功率,并提升泛化、空间鲁棒性与指令对齐。

Computation-Aware Event-to-Frame Reconstruction via Selective Attention Figure 1
2026-06-05cs.CV

Computation-Aware Event-to-Frame Reconstruction via Selective Attention

Jingqian Wu, Yunbo Jia, Edmund Y. Lam

2026-06-05三维

面向事件相机在快速运动、强光照变化和嵌入式部署中的帧重建需求,论文针对现有 E2F 方法质量与计算量难兼顾的问题,提出计算感知的循环编码器—解码器,用 ConvLSTM 做因果时序聚合,并用上一帧强度先验的选择性上下文融合与轻量混合注意力替代重型 Transformer 注意力。实验称在 ECD 等基准上以更小参数量取得有竞争力甚至更优的 SSIM/MSE,但具体增益来源仍需结合完整消融判断。

Diff-CA: Separating Common and Salient Factors with Diffusion Models Figure 1
2026-06-05cs.CV

Diff-CA: Separating Common and Salient Factors with Diffusion Models

Michaël Soumm, Alexandre Fournier Montgieux, Yunlong He, Pietro Gori, Alasdair Newson

2026-06-05生成模型

这篇论文针对传统对比分析依赖 VAE/GAN、重建质量不足导致公共/显著因素难分离的问题,将 CA 引入无文本图像条件扩散模型,在条件 token 上学习公共与显著的加性分解,并给出弱监督下可辨识性论证。实验涵盖人脸、动物和脑 MRI,Diff-CA 在重建质量、显著属性交换成功率及身份/姿态等公共因素保持上明显优于 MM-cVAE、SepVAE 和 DoubleInfoGAN。

Where, What, Why, and Importance: Structured Defect Grounding for Text-to-Image Feedback Figure 1
2026-06-05cs.CV

Where, What, Why, and Importance: Structured Defect Grounding for Text-to-Image Feedback

Huaisong Zhang, Hao Yu, Yuxuan Zhang, Jiahe Wang, Xinrui Chen, Haoxiang Cao, Feng Lu, Wendong Zhang, Changqian Yu, Chun Yuan

Tsinghua University, University of British Columbia, Vector Institute, South China Normal University

2026-06-05视觉语言视觉感知

针对文生图模型常出现局部、细微且类型复杂的缺陷,而标量评分或热力图难以绑定位置、类别、原因和重要性的不足,论文提出结构化缺陷定位 SDG,将每个缺陷表示为框、类型、解释与重要性元组,并构建 SDG-30K 与 SDG-Eval;基于 VLM 检测器和 BoxFlow-GRPO,把缺陷转为空间加权奖励。实验显示其结构化定位优于主流闭源 VLM,并能提升扩散模型对齐和局部修复效果。

MS-DKC: A Dataset Knowledge Card Framework for Designing and Adapting Medical Image Segmentation Models Figure 1
2026-06-05cs.CV

MS-DKC: A Dataset Knowledge Card Framework for Designing and Adapting Medical Image Segmentation Models

Tariq M. Khan, Syed Saud Naqvi, Thantrira Porntaveetus, Hamid Alinejad-Rokny, Shahzaib Iqbal, Imran Razzak, Mohammad AU Khan

Center of Excellence in Precision Medicine and Digital Health, Faculty of Dentistry, Chulalongkorn University, Bangkok, Thailand, Department of Computer Engineering, COMSATS University Islamabad, Islamabad, Pakistan, School of Biomedical Engineering, UNSW, Sydney, NSW, Australia, Visiting Scholar (Collaborative Projects), Center of Excellence in Precision Medicine and Digital Health, Chulalongkorn University, Bangkok, Thailand, Department of Computing, Abasyn University Islamabad Campus (AUIC), Islamabad, Pakistan, Mohamed bin Zayed University of Artificial Intelligence, Abu Dhabi, United Arab Emirates, College of Computer and Information Sciences, prince Sultan University, Riyadh, SAudi Arabia

2026-06-05视觉感知数据集/基准

本文针对医学分割研究常以“更强架构”替代数据需求分析的问题,提出 MS-DKC 数据集知识卡,将成像、形态、标注、上下文和部署风险等描述子映射到失效模式、设计先验与评估指标。实验覆盖 DRIVE、ISIC2018、ACDC:在 DRIVE 上轻量 DKC-TNet-v2 仅 3.5 万参数达 Dice 0.8044,SA-UNetv2-DKC-AmbRef 达 Dice 0.8141;ISIC2018 上经验证约束选择的模型达 Dice 0.8872,显示不同数据集需不同先验和操作点。

HyperVis: Continuous Latent Visual Relational Graphs on the Lorentz Hyperboloid for Compositional Reasoning Figure 1
2026-06-05cs.CV

HyperVis: Continuous Latent Visual Relational Graphs on the Lorentz Hyperboloid for Compositional Reasoning

Moshiur Farazi, Sameera Ramasinghe, Mahbub Ahmed Turza, Shafin Rahman

Data Science and AI, University of Doha for Science and Technology, Qatar, Department of Electrical and Computer Engineering, North South University, Bangladesh

2026-06-05视觉感知

针对 VLM 在物体关系与组合推理上的短板,论文指出直接注入离散场景图文本三元组会与连续视觉特征冲突并降低 GQA。HyperVis 改为从无类别区域提案构造连续视觉关系图,投影到 Lorentz 双曲空间,用 IoA 蕴含锥和角度排斥约束层级关系。实验中其关系损失将 GQA 提升至 61.03%,推理前缀使 SugarCrepe 达 79.94%,且双曲性相对欧氏消融带来主要组合增益。

Knowledge Distillation for Visual Autoregressive Models Figure 1
2026-06-05cs.CV

Knowledge Distillation for Visual Autoregressive Models

Elia Peruzzo, Aritra Bhowmik, Guillaume Sautiere, Yuki M Asano, Amirhossein Habibian

University of Technology Nuremberg, Qualcomm AI Research is an initiative of Qualcomm Technologies, Inc.

2026-06-05视觉感知

本文关注视觉自回归图像生成中小模型压缩难题:长序列解码、空间误差累积和视觉 token 歧义使语言模型中的蒸馏策略难以直接迁移。作者系统比较多种 KD,并提出 VarKD,在带真实前缀的学生 rollout 上蒸馏,用教师置信度重加权/过滤低可靠监督,并在压缩 token 空间降低歧义。ImageNet 上跨 LlamaGen、ARPG 等骨干实验显示其优于标准 KD、SeqKD 和 GKD,且不改变推理解码。

Learning Visual Spatial Planning from Symbolic State via Modality-Gap-Aware Self-Distillation Figure 1
2026-06-05cs.AI

Learning Visual Spatial Planning from Symbolic State via Modality-Gap-Aware Self-Distillation

Haocheng Luo, Jiahui Liu, Ruicheng Zhang, Zhizhou Zhong, Jiaqi Huang, Zunnan Xu, Quan Shi, Jun Zhou, Xiu Li

Tsinghua University, The Hong Kong University of Science and Technology

2026-06-05规划控制

论文针对 VLM 在视觉空间规划中需先从像素恢复状态、再进行多步推理而产生的感知—推理模态鸿沟,提出 MGSD:先用 SFT 冷启动对齐视觉状态表征,再用仅训练期可见的符号状态教师对学生自生成轨迹做 on-policy 蒸馏,推理时仍纯视觉。实验在 FrozenLake、Maze、MiniBehaviour 等任务上使 4B/8B 模型宏平均分别提升 19.3%/18.4%,并缩小与符号输入上界的差距。

VZCrash: A Large-Scale IMU Dataset of Ego-Vehicle Crashes Figure 1
2026-06-05cs.CV

VZCrash: A Large-Scale IMU Dataset of Ego-Vehicle Crashes

Tommaso Bianconcini, Henrique Piñeiro Monteagudo, Aurel Pjetri, Tomaso Trinci, Leonardo Taccari

2026-06-05数据集/基准

针对真实碰撞稀缺、现有视觉或低频 IMU 数据难以支持车载实时碰撞检测的问题,本文发布 VZCrash:覆盖 7.3 万辆商用车、近 19 万事件、3.1 万经人工共识验证碰撞的高频 IMU 数据集,并包含近失、坑洼、挂车对接等难负例。实验比较阈值到深度模型,主要结果显示模型泛化和鲁棒性随训练数据规模显著提升,增益可能主要来自 scaling / data。

FontFusion: Enhancing Generative Text in Diffusion Models with Typographic Conditioning Figure 1
2026-06-05cs.CV

FontFusion: Enhancing Generative Text in Diffusion Models with Typographic Conditioning

Marian Lupascu, Nipun Jindal, Ionut Mironica, Zhaowen Wang

2026-06-05生成模型

该文针对扩散模型生成文字时“字体可控性”和可读性相互牵制的问题,提出可插拔的 FontFusion,为 DiT 注入字体条件而无需重训基座模型。核心是用 DeepFont+DINOv2 双编码器表征字体,并通过字符/词/段落层级 token、位置感知嵌入和多级 token drop 绑定文本、字体与空间区域。实验称其在装饰字体上较单编码器提升 76%,相对无条件模型字体一致性提升约 68–76%。

ReCache: Learning Budget-Aware Caching Schedules for Diffusion Models via REINFORCE Figure 1
2026-06-05cs.CV

ReCache: Learning Budget-Aware Caching Schedules for Diffusion Models via REINFORCE

Mishan Aliev, Eva Neudachina, Ilya Bykov, Aleksandr Oganov, Kirill Struminsky, Aibek Alanov, Denis Rakitin

HSE University, Russia

2026-06-05生成模型

扩散模型采样需多步去噪,特征缓存虽能加速,但现有重算时刻多靠均匀或误差阈值,算力预算难直接控制。ReCache将缓存调度建模为预算条件下的强化学习策略,用REINFORCE在不反传完整生成过程、无需标注的情况下选择最关键重算步,并兼容复用与预测式缓存。实验在FLUX、Wan2.1等模型上显示,同等FLOPs下优于手工调度,如FLUX约5.04倍降算时LPIPS较DiCache降31%,Wan2.1约2.6倍加速时LPIPS降65%、VBench升5.6分。

LLM-Conditioned Synthesis of Pathological Gaits via Structured Gait-Language Representations Figure 1
2026-06-05cs.CV

LLM-Conditioned Synthesis of Pathological Gaits via Structured Gait-Language Representations

Mritula Chandrasekaran, Sanket Kachole, Jarik Francik, Dimitrios Makris

2026-06-05视觉感知

针对病理步态数据因隐私、招募和成本而稀缺、通用文本到动作方法又难保留临床判别线索的问题,论文提出LLM条件的3D骨架步态合成框架,引入病理tokeniser并用ROM、站立、步幅、不对称等统计先验约束语言到步态生成。在Jun等数据集上,真实+合成数据使GRU在LOSO下由91.08%升至92.77%,优于MotionGPT和Qwen-5B,但CNN加合成后下降,增益主要限于循环模型。

LoomVideo: Unifying Multimodal Inputs into Video Generation and Editing Figure 1
2026-06-05cs.CV

LoomVideo: Unifying Multimodal Inputs into Video Generation and Editing

Jianzong Wu, Hao Lian, Jiongfan Yang, Dachao Hao, Ye Tian, Yunhai Tong, Jingyuan Zhu, Biaolong Chen, Qiaosong Qi, Aixi Zhang, Wanggui He, Mushui Liu, Jinlong Liu, Hao Jiang

Peking University, Alibaba Group, Project Page: https://msalab-pku.github.io/projects/LoomVideo/index.html, Github: https://github.com/MSALab-PKU/LoomVideo, Model: https://huggingface.co/MSALab/LoomVideo, The demand for versatile and highly controllable video generation and editing is rapidly increasing across diverse

2026-06-05视觉语言视觉感知

针对现有统一视频生成/编辑模型依赖13B级大模型、编辑时拼接源视频token导致注意力开销激增的问题,LoomVideo以5B Wan为底座,引入Qwen3-VL与Deepstack多层注入对齐多模态指令,并用Scale-and-Add将源视频latent直接加到带噪目标latent,实现零额外token编辑;多参考图像通过负时间RoPE区分。实验显示其在多项基准达到SOTA或接近SOTA,电商与服饰场景表现突出,推理相较同类拼接式模型至少快5.41倍。

Texture-preserving implicit neural representation for Cone beam CT truncated reconstruction Figure 1
2026-06-05cs.CV

Texture-preserving implicit neural representation for Cone beam CT truncated reconstruction

Genyuan Zhang, Junyao Wang, Haoran Lan, Chuandong Tan, Songtao Zhu, Fenglin Liu

2026-06-05三维

针对锥束 CT 截断投影会产生环状伪影、限制视野且监督式深度方法依赖完整真值的问题,论文提出自监督的三维隐式神经表示:用坐标网络在投影监督下重建并外推体数据,以避开传统滤波反投影;再以该无伪影结果初始化物理迭代重建,补回坐标网络因谱偏置丢失的高频纹理。仿真与真实数据表明,该方法兼顾截断伪影抑制、视野外外推和细节保真。

ReSAGE-PAR: Representational Similarity Assessment for Generative Expansion in Pedestrian Attribute Recognition Figure 1
2026-06-05cs.CV

ReSAGE-PAR: Representational Similarity Assessment for Generative Expansion in Pedestrian Attribute Recognition

Pablo Ayuso-Albizu, Pablo Carballeira, Juan C. SanMiguel, Paula Moral

2026-06-05视觉感知生成模型

针对行人属性识别中监控图像低分辨率、长尾属性和标注稀缺导致扩散生成难以直接用于训练的问题,ReSAGE-PAR将LoRA式img2img域适配与视觉-语言相似度评分、贝叶斯伪标签转换结合,生成并筛选更可靠的合成样本。实验显示其可作为模型无关的数据扩展模块,在多种PAR骨干和SOTA框架上稳定提升,标准骨干最高增益达8.7%,但部分收益可能主要来自经验证的synthetic data scaling。

Global-Local Monte Carlo Tree Search in Vision-Language Models for Text-to-3D Indoor Scene Generation Figure 1
2026-06-05cs.CV

Global-Local Monte Carlo Tree Search in Vision-Language Models for Text-to-3D Indoor Scene Generation

Mengshi Qi, Wei Deng, Xianlin Zhang, Huadong Ma

2026-06-05视觉语言视觉感知强化学习三维

针对LVLM用链式CoT生成3D室内布局时无法回改早期决策、易导致空间错误累积的问题,论文将文本到3D室内场景视为受常识与物理约束的规划搜索,引入房间—区域—物体层级表示,并用PRM引导的全局/局部MCTS剪枝和权衡探索利用,另用扩散模型统一纹理;在新建3DTindo-bench上平均分较最佳基线提升约14%。

ATT-CR: Adaptive Triangular Transformer for Cloud Removal Figure 1
2026-06-05cs.CV

ATT-CR: Adaptive Triangular Transformer for Cloud Removal

Yang Wu, Ye Deng, Pengna Li, Wenli Huang, Kangyi Wu, Xiaomeng Xin, Jinjun Wang

Wenli Huang is with the Ningbo University of Technology, Ningbo, Zhejiang 315211, China.

2026-06-05视觉感知

针对遥感云去除中标准自注意力计算量高、且云区与干净像素混合参与注意力会引入伪影的问题,ATT-CR提出三角注意力用上下三角矩阵在线性复杂度下近似并保留注意力秩,同时用特征选择门控按空间和通道抑制云污染信息。作者在RICE1、RICE2、T-CLOUD和SEN12MS-CR上报告优于现有云去除方法的结果。

Deep Learning-based 3D Oral Cavity Reconstruction Using 2D Intraoral Images Figure 1
2026-06-05cs.CV

Deep Learning-based 3D Oral Cavity Reconstruction Using 2D Intraoral Images

Jihun Cho, Soo-Yeon Jeong, Eun-Jeong Bae, Sun-Young Ihm

2026-06-05视觉感知三维

针对传统牙模取模不适、口内扫描仪和 CBCT 成本高的问题,论文提出仅用 10 张固定视角二维口内图像重建上颌三维模型:以 MobileNetV2 提取多视角特征,并用多头注意力融合后直接预测 5 万个点云坐标。在 Dental3DS 的 950 个上颌样本上,按 0.035 距离阈值的最近邻匹配准确率为 77.49%,但预测点易集中在高密度区域,重建分布仍不均匀。

Multimodal Sexism Identification and Characterization using Large Language Models and Gradient Boosting Figure 1
2026-06-05cs.CV

Multimodal Sexism Identification and Characterization using Large Language Models and Gradient Boosting

Kyriakos Chaviaras, Maria Lymperaiou, Athanasios Voulodimos

Artificial Intelligence and Learning Systems Laboratory, School of Electrical and Computer Engineering, National Technical University of Athens

2026-06-05视觉语言优化算法

针对社交媒体中表情包和短视频常以讽刺、图文/音画互补方式呈现性别歧视、单模态检测易漏判的问题,本文采用晚期特征融合而非端到端大模型,结合CLIP、OCR文本、音频、人口/生理元数据与LLM抽取的刻板印象、物化等语义指标,并用层级XGBoost回归适配软标签。结果显示,定向LLM语义特征能提升表情包识别;视频任务对特征维度和跨模态噪声很敏感,开发集上的特征筛选结论未能稳定迁移到测试集,提示需更强时序建模。

Video-Rate Streaming Stylization on a Vision-Aware MLLM-Conditioned Edit Diffusion: Asymmetric Batched Inference on a Distilled UNet + MLLM Text Encoder Figure 1
2026-06-05cs.CV

Video-Rate Streaming Stylization on a Vision-Aware MLLM-Conditioned Edit Diffusion: Asymmetric Batched Inference on a Distilled UNet + MLLM Text Encoder

Yoshiyuki Ootani

2026-06-05视觉感知生成模型

论文关注蒸馏扩散视频编辑中瓶颈从 U-Net 转向重型 MLLM 文本编码器后的实时化问题,提出侧/主 CUDA 流异步流水、可编译的 LLLite 重写及周期条件刷新来摊薄编码与适配器成本。在 512×512 单卡流式风格化中,RTX 3090 Ti 达 27.4–29.6 fps,4090/5090 分别达 54.9/74.1 fps,但定位为高吞吐而非低延迟交互。

T-FunS3D: Task-Driven Hierarchical Open-Vocabulary 3D Functionality Segmentation Figure 1
2026-06-05cs.CV

T-FunS3D: Task-Driven Hierarchical Open-Vocabulary 3D Functionality Segmentation

Jingkun Feng, Reza Sabzevari

Jingkun Feng and Reza Sabzevari are with the P4MARS Lab at the Faculty of Aerospace Engineering, Delft University of Technology.

2026-06-05视觉感知三维

面向机器人交互,现有开放词汇3D方法多停留在物体级,或对全场景做细粒度过分割,计算和内存开销高。T-FunS3D的核心思路是先构建含实例与关系视觉嵌入的开放词汇场景图,再按自由文本任务只检索相关物体并用VLM定位其功能部件。SceneFun3D实验显示其精度接近现有最优,同时运行更快、内存占用更低。

Faithful, Enriched, and Precise: Benchmarking Natural-Science Illustration Generation by T2I models Figure 1
2026-06-05cs.CV

Faithful, Enriched, and Precise: Benchmarking Natural-Science Illustration Generation by T2I models

Yifan Chang, Jiaxin Ai, Jianwen Sun, Yuandong Pu, Siqi Luo, Liangliang Zhao, Yuchen Ren, Minghao Liu, Yunfei Yu, Yu Qiao, Kaipeng Zhang, Yihao Liu

Shanghai Innovation Institute, Shanghai AI Laboratory, University of Science and Technology of China, Wuhan University, Nankai University, Shanghai Jiao Tong University, Fudan University

2026-06-05数据集/基准

针对自然科学论文插图生成中现有评测过于整体、难以区分遵循提示、合理补充与幻觉添加的问题,本文提出 FEPBench:用文本、视觉、关系、布局“语义原子”标注 1300 张高质量插图,并从指令忠实度、推理丰富度、语义精确度细粒度评估 T2I 模型。实验显示闭源模型总体领先,但 GPT Image 2、Nano Banana Pro 等仍受文字渲染、科学推理不足及丰富性与精确性权衡困扰。

To Be Multimodal or Not to Be: Query-Adaptive Audio-Visual Person Retrieval via Active Modality Detection Figure 1
2026-06-05cs.CL

To Be Multimodal or Not to Be: Query-Adaptive Audio-Visual Person Retrieval via Active Modality Detection

Erfan Loweimi, Mengjie Qian, Kate Knill, Guanfeng Wu, Chi-Ho Chan, Abbas Haider, Muhammad Awan, Josef Kittler, Hui Wang, Mark Gales

University of Cambridge, UK, Queen's University Belfast, UK, University of Surrey, UK, ‡ Southwest Jiaotong University, China, ◆ Teesside University, UK

2026-06-05视觉语言视觉感知

面向真实广播档案中目标人物可能只出现声音、只出现人脸或二者皆有的情况,论文指出固定音视频融合会把缺失模态当噪声引入排序。其核心做法是用跨模态检索分数一致性判断查询的活跃模态,并自适应选择单模态或融合权重。在 BBC Rewind 1.2万余视频上,模态检测约89%,P@1 达94.2%,优于说话人、人脸和固定融合基线,并接近使用真实模态标签的 oracle。

MemoryCard: Topic-Aware Multi-Modal Clue Compression for Long-Video Question Answering Figure 1
2026-06-05cs.CV

MemoryCard: Topic-Aware Multi-Modal Clue Compression for Long-Video Question Answering

Qing Yang, Pengcheng Huang, Xinze Li, Zhenghao Liu, Yukun Yan, Yu Gu, Ge Yu, Gang Li, Maosong Sun

School of Computer Science and Engineering, Northeastern University, Shenyang, China, Department of Computer Science and Technology, Tsinghua University, Beijing, China

2026-06-05视觉感知

长视频问答中关键信息常短暂且分散,传统按帧采样或检索容易得到碎片化证据,难以支撑事件级推理。MemoryCard 的核心思路是让 VLM 先结合视频与语音自读分段,将每个主题/事件压缩为含摘要、话语和代表画面的多模态记忆卡,再按问题检索并自适应分辨率输入。三项长视频 QA 基准显示,在相近视觉 token 预算下准确率稳定提升,最高相对增益达 21.8%。

Unveiling the Unknown: Open Vocabulary Object Detection with Scene Graphs Figure 1
2026-06-05cs.CV

Unveiling the Unknown: Open Vocabulary Object Detection with Scene Graphs

Yi Chen, Yinghao Lu, Zhehao Li, Chenchen Yan, Jiafei Wu, Chong Wang, Jiangbo Qian

2026-06-05视觉感知

针对开放词汇检测只做区域-文本对齐、忽略物体间交互导致新类泛化受限的问题,论文提出SRM框架:用场景图显式建模候选框邻域关系,并以关系注意力和基于caption的文本对齐强化视觉-语义关联。实验称在COCO与LVIS上较现有OVOD方法提升新类别AP,但具体增益拆分需结合完整表格判断。

CamFlow+: Hybrid Motion Bases for 2D Camera Motion Estimation with Stabilization Applications Figure 1
2026-06-05cs.CV

CamFlow+: Hybrid Motion Bases for 2D Camera Motion Estimation with Stabilization Applications

Haipeng Li, Zhen Liu, Zhanglei Yang, Hai Jiang, Tianhao Zhou, Zhengzhe Liu, Ping Tan, Bing Zeng, Shuaicheng Liu

Hai Jiang is with the School of Aeronautics and Astronautics, Sichuan University, Chengdu, Sichuan, China., Tianhao Zhou is with the YingCai Honors College, University of Electronic Science and Technology of China, Chengdu, Sichuan, China., Zhengzhe Liu is with Lingnan University, Hong Kong, China., Ping Tan is with the Hong Kong University of Science and Technology and Shenzhen Loop Area Institute.

2026-06-05生成模型

本文针对单应性在相机平移、深度变化和局部视差下失效,而网格/局部平面模型又易受动态物体与深度边界干扰的问题,提出在稠密光流空间建模2D相机运动的CamFlow+。其核心是混合运动基:结合单应物理基、随机单应流基,以及由深度和内参解析得到的平移视差基,并加入深度感知平滑约束。在GHOF/GHOF-Cam上提升稀疏与稠密估计,视频防抖中也改善全局和局部稳定性,盲测top-1偏好率达43.30%。

Self-Learning Expression Deformations for Data-Efficient Gaussian Avatars Figure 1
2026-06-05cs.CV

Self-Learning Expression Deformations for Data-Efficient Gaussian Avatars

Jiahao Yang, Xiaohang Yang, Qing Wang, Yilan Dong, Gregory Slabaugh, Shanxin Yuan

Gregory Slabaugh, Queen Mary University of London

2026-06-05三维

针对3D Gaussian头像在表情形变中易失真且依赖大量多视角/连续表情数据的问题,SAGE用SDF联合2D Gaussian surfel约束高斯贴合表面,并通过无真实图像的自监督深度、法线与外观一致性学习表情形变。实验显示其在多视角单帧、单目转头和单图设置下可接近现有方法的重建与动画质量,同时将数据需求降低数个数量级。

Resonant Minds: Closed-Loop Social Avatars with Theory of Mind Figure 1
2026-06-05cs.CV

Resonant Minds: Closed-Loop Social Avatars with Theory of Mind

Jianxu Shangguan, Jing Xu, Hang Ye, Xiaoxuan Ma, Yizhou Wang, Wentao Zhu

2026-06-05学习理论

针对现有 LLM 社交仿真缺少具身表达、说话人视频生成缺少社会认知的问题,论文提出闭环双智能体框架,将多模态感知、基于心智理论的隐含状态推断与情绪可控双人视频生成串联,并构建含人格与私有目标的 Persona-Scenario 数据集。在该设定下,方法在对话质量和视频生成指标上达到竞争或更优表现,部分对话维度甚至超过全信息 Script 模式。

Geometry-Aware Dataset Condensation for Diffusion Model Training Figure 1
2026-06-05cs.CV

Geometry-Aware Dataset Condensation for Diffusion Model Training

Xiao Cui, Yulei Qin, Mo Zhu, Wengang Zhou, Hongsheng Li, Houqiang Li

2026-06-05生成模型数据集/基准

这篇论文针对扩散模型训练中数据集压缩不匹配的问题:合成样本保真度不足,而常规真实子集选择又难以保留分布几何。作者将子集选择重写为几何感知的分布对齐,用单边部分最优传输聚焦高密度结构,并结合特征统计与语义正则,再用贪心构建加交换细化求解。实验显示其在不同扩散模型、子集规模、分辨率和训练轮次下优于既有选择/压缩方法,提升生成保真度与覆盖度。

LadderMan: Learning Humanoid Perceptive Ladder Climbing Figure 1
2026-06-05cs.RO

LadderMan: Learning Humanoid Perceptive Ladder Climbing

Siheng Zhao, Yuanhang Zhang, Ziqi Lu, Pieter Abbeel, Rocky Duan, Koushil Sreenath, Yue Wang, C. Karen Liu, Guanya Shi

Amazon FAR, 2 USC, 3 UC Berkeley, 4 Stanford University, 5 CMU, † Amazon FAR Co-Lead

2026-06-05机器人

针对人形机器人在梯子上因踏点/抓点稀疏、全身多接触协调和感知误差而难以稳定攀爬与作业的问题,LadderMan用单条参考动作经混合运动跟踪生成多专家,再以模仿学习+强化学习蒸馏为深度视觉策略,并借助视觉基础模型缩小深度仿真到现实差距;另用双智能体解耦下肢稳态和上肢操作。实验显示其可在多种梯子几何上零样本迁移到Unitree G1,并支持换灯泡、递箱等梯上遥操作。

Entropy-Based Evaluation of AI Agents: A Lightweight Framework for Measuring Behavioral Patterns Figure 1
2026-06-05cs.AI

Entropy-Based Evaluation of AI Agents: A Lightweight Framework for Measuring Behavioral Patterns

Olasimbo Ayodeji Arigbabu

2026-06-05数据集/基准

这篇论文针对只看成功率、成本和延迟难以刻画智能体行为的问题,提出 EEA:把运行轨迹标准化为事件序列,用动作熵、轨迹熵、工具熵、信息增益、探索效率和鲁棒性熵评估探索、僵化、工具使用与不确定性下降。作者实现了可接入 LangChain、Google ADK 和日志的 Python 工具,并在受控模式与学习路线图智能体上展示指标能区分框架间行为差异;但实验规模很小,效果结论需谨慎解读。

Inverse Design of Realizable Metasurface based Absorbers using Improved Conditioning and Diversity Enhanced Progressively Growing GANs Figure 1
2026-06-05cs.CV

Inverse Design of Realizable Metasurface based Absorbers using Improved Conditioning and Diversity Enhanced Progressively Growing GANs

Vineetha Joy, Mohammad Abdullah, Pramit Pal, Anshuman Kumar, Amit Sethi, Hema Singh

Centre for Electromagnetics, CSIR-National Aerospace Laboratories, Kodihalli, Bangalore 560017, Birla Institute of Technology and Science, Pilani, Rajasthan 333031, Indian Institute of Technology, Bombay, Maharashtra 400076, a generative inverse design framework for controllable and, labelled datasets and suffer from generalization limitations, inverse design framework for controllable and physically, available substrate materials and feasible thickness

2026-06-05生成模型

针对超表面吸波器逆向设计依赖昂贵全波仿真、现有生成模型难以连续谱条件控制且易缺乏多样性的问题,论文提出逐步增长 WGAN-GP,结合 FiLM 连续条件、代理谱对齐损失和 DPP 多样性正则,将电磁一致性与可制造约束纳入训练。在 2–18GHz 任务中,生成设计经仿真验证,MSE 为 0.0052,有效电磁设计率 89.57%。

Learning Geometric Representations from Videos for Spatial Intelligent Multimodal Large Language Models Figure 1
2026-06-05cs.CV

Learning Geometric Representations from Videos for Spatial Intelligent Multimodal Large Language Models

Haibo Wang, Lifu Huang

University of California, Davis

2026-06-05视觉语言视觉感知

针对现有多模态大模型仅靠2D语义监督、在视角变化和物理空间推理中缺乏深度、位姿与尺度一致性的问题,GeoVR利用纯2D视频在训练阶段引入相机位姿、深度、度量尺度和3D教师特征对齐等几何目标,重塑模型内部表征而非推理时外挂3D分支。论文称其在空间推理与3D场景理解基准上达到SOTA,且不增加推理开销。

Gender Artifacts from Art History to Text-to-Image Generation Figure 1
2026-06-05cs.CV

Gender Artifacts from Art History to Text-to-Image Generation

Piera Riccio, Miriam Doh, Benedikt Höltgen, Noa Garcia, Nanne van Noord

University of Amsterdam, University of Potsdam, The University of Osaka

2026-06-05视觉感知

本文针对AI中常把艺术风格视为中性色彩/纹理滤镜的问题,研究历史艺术风格如何携带性别化社会结构并被文生图模型继承。作者构建含约7.4万张图、19种风格的StyleGender数据集,并提出PixelSGA与MaskSGA衡量像素和构图层面的性别伪迹。结果显示历史图像中已存在显著风格相关性别差异,新古典主义和新艺术较突出,而Stable Diffusion与FLUX在风格提示下往往进一步放大这些伪迹。

Emotion-Aware Image Generation from Korean Diary Text via LLM-based Prompt Translation and LoRA Fine-Tuning Figure 1
2026-06-05cs.CV

Emotion-Aware Image Generation from Korean Diary Text via LLM-based Prompt Translation and LoRA Fine-Tuning

Jihun Cho, Soo-Yeon Jeong, Sun-Young Ihm

Pai Chai University, Resources Development Center, machine learning approaches that learn patterns from labelled, primarily rely on explicit emotional labels and English-

2026-06-05视觉感知

针对通用文生图模型难以从短韩语日记中把握隐含情绪的问题,论文提出先用 Qwen3-8B 识别情感并翻译成带情绪触发词的英文提示,再用基于儿童画情绪数据 LoRA 微调的 SD 3.5 生成图像。实验显示情绪触发词会明显改变生成图的情感表达,较高学习率提升儿童画风格迁移率,但 CLIP Score 与风格质量并不一致。

Next-Generation Parallel Decoder for LPDR: Architectural Optimization and Class-Balanced GAN-Augmentation Figure 1
2026-06-05cs.CV

Next-Generation Parallel Decoder for LPDR: Architectural Optimization and Class-Balanced GAN-Augmentation

Shawaiz Obaid, Nida Chandio, Neha Jamil, Muhammad Khuram Shahzad

2026-06-05生成模型优化算法

该文针对车牌检测识别中并行解码器对字符空间位置不敏感、训练集省份字符长尾失衡的问题,提出带二维位置嵌入的CSHA并行混合注意力、保留细粒度空间信息的IGFE,以及用CycleGAN生成少数类车牌的CBSA扩增。实验在CCPD、CLPD、PKU等基准上使用7.5万合成样本,将少数省份识别率由78.2%提升到91.5%,速度约152 FPS;但增益可能部分来自数据扩增规模。

Beyond Absolute Scores: Relative Edit-induced Difference for Generalizable Image Aesthetic Assessment Figure 1
2026-06-05cs.CV

Beyond Absolute Scores: Relative Edit-induced Difference for Generalizable Image Aesthetic Assessment

Qifei Jia, Xintong Yao, Minghao Li, Yajie Chai, Qiming Lu, Baoyue Shen, Yasen Zhang, Runyu Shi, Ying Huang, Yue Zhang

2026-06-05视觉感知

针对图像美学评估长期依赖单图绝对 MOS 回归、跨域泛化弱的问题,论文提出将审美判断建模为“编辑前后”的相对差异学习:用可控图像编辑构造 RED-20k 源图-编辑图对,配合差值评分与 CoT 因果解释,并通过 SFT、轻量校准和带相对排序一致性奖励的 GRPO 训练 RED-Aes。实验称其在五个公开基准的零样本跨域评测中达到 SOTA,轻量 2B 版本也超过既有基线。

LiAuto-GeoX: Efficient Grounded Driving Transformer Figure 1
2026-06-05cs.CV

LiAuto-GeoX: Efficient Grounded Driving Transformer

Jiawei Lian, Haoyi Sun, Yang Wu, Lifu Mu, Siyuan Wang, Le Hui, Ning Mao, Tao Wei, Pan Zhou, Kun Zhan, Jian Yang

Nanjing University of Science and Technology 2 Li Auto Inc., Northwestern Polytechnical University, Department of Computing, The Hong Kong Polytechnic University

2026-06-05视觉感知

面向自动驾驶中稠密3D重建难以实时上车、远距几何和环视一致性不足的问题,LiAuto-GeoX先用大规模环视数据和稀疏LiDAR先验训练高容量几何教师,再通过掩码引导的深度感知蒸馏与相对位姿关系蒸馏压缩为155M车载模型,保留局部度量结构和跨视角一致性。实验显示其在KITTI达220 FPS,并在轨迹预测、占据预测和未来帧预测上分别取得90.6 PDMS、24.63 mIoU和47.67 IoU。

Imagine Before You Predict: Interleaved Latent Visual Reasoning for Video Event Prediction Figure 1
2026-06-05cs.CV

Imagine Before You Predict: Interleaved Latent Visual Reasoning for Video Event Prediction

Tianxiang Jiang, Linquan Wu, Sheng Xia, Songze Li, Ziang Yan, Haoyu Yang, Yu Qiao, Yi Wang

University of Science and Technology of China, Shanghai AI Laboratory, City University of Hong Kong, Nanjing University, Fudan University, Zhejiang University, University of Electronic Science and Technology of China

2026-06-05视觉感知强化学习

这篇论文针对视频事件预测中“把未来视觉推理先翻成文字”会丢失运动、几何和交互细节的问题,提出 Future-L1:在自回归解码中交替生成文本与连续潜在视觉片段,并用 Future-L1-50K 对齐未来帧嵌入、再以 LA-DAPO 强化学习优化潜在轨迹。实验中 FutureBench 从 Qwen3-VL-8B 的 61.0 提升到 85.4,TwiFF-Bench 均分从 2.44 到 3.04,说明增益主要来自保留潜在视觉语义而非纯文本 CoT。

ExpSpeech-Net: Multimodal Fusion of Expression and Speech for Deepfake Detection Figure 1
2026-06-05cs.CV

ExpSpeech-Net: Multimodal Fusion of Expression and Speech for Deepfake Detection

Ruchika Sharma, Rudresh Dwivedi

2026-06-05视觉语言视觉感知

针对现有深伪检测模型计算开销大、单模态线索难以捕捉音视频不一致的问题,ExpSpeech-Net融合面部表情与语音特征:图像侧提取ISLBT等局部/全局/深度特征,语音侧提取MPNCC、MFCC和chroma,并用SASMA进行特征选择,最后以SqueezeNet和RNN分类。文中报告准确率94.5%、精确率99.3%、F-measure 96.8%,但跨数据集泛化与增益来源仍未充分说明。

Physics-Guided Deep Unfolding for Blind Cross-Sensor Spectral Super-Resolution via Learning the Spectral Transformation Function Figure 1
2026-06-05cs.CV

Physics-Guided Deep Unfolding for Blind Cross-Sensor Spectral Super-Resolution via Learning the Spectral Transformation Function

Zhaolin Li, Jinsong Chen, Shanxin Guo, Tuo Zhang, Xinglong Zhang, Pan Chen

sensors remain costly and thus unavailable in many UAV, The authors are with a Center for Geo-Spatial Information, Shenzhen, Institutes of Advanced Technology, Chinese Academy of Sciences, Shenzhen, b University of Chinese Academy of Sciences, Beijing, c Shenzhen Engineering Laboratory of Ocean Environmental, no explicit degradation matrix is available to guide the process

2026-06-05视觉感知

针对无人机等跨传感器场景中多光谱到高光谱重建依赖已知固定SRF、真实退化未知的问题,论文提出PGU-Net,将交替优化展开为可训练网络,联合估计高光谱图像与可学习光谱变换函数,并结合闭式求解与近端网络保持物理约束。CAVE、NTIRE及真实Headwall–DJI数据实验显示其能恢复退化算子并优于多种SSR方法,且STF可能随地物类别变化。

DRIFT: A Residual Flow Adapter for Decoding Continuous Outputs in Vision-Language Models Figure 1
2026-06-05cs.CV

DRIFT: A Residual Flow Adapter for Decoding Continuous Outputs in Vision-Language Models

Zhuoming Liu, Jinhong Lin, Kwan Man Cheng, Lin Zhang, Shayok Bagchi, Yin Li

University of Wisconsin–Madison, West Lafayette Jr./Sr. High School, of discrete tokens. While text-based output interfaces enable scalable pretraining, discrete text tokens as their primary output interface. This design enables scalable pretraining via, interface entirely is undesirable, as it would sacrifice the scalability of language-style pretraining and, Figure 1: (1): DRIFT learns a velocity field that transports a starting distribution centered at an

2026-06-05视觉语言视觉感知生成模型

这篇论文关注 VLM/MLLM/VLA 以离散 token 解码时难以精确输出时间边界、坐标和机器人连续动作的问题。DRIFT 的核心是先用基础预测器给出粗估计,再用 flow matching 只建模其附近的残差分布,从而降低生成式连续解码的优化难度和方差。实验覆盖视觉定位、视频时序定位和机器人控制,在 MLLM、VLA、WAM 上均优于回归头和直接 flow,TVG 提升约 2%,Libero 平均达 97.9%。

Cosine Misleads: Auxiliary Losses Reshape Vision Language Models, Not Their Latents Figure 1
2026-06-05cs.CV

Cosine Misleads: Auxiliary Losses Reshape Vision Language Models, Not Their Latents

XiuYu Zhang, Junfeng Fang, Zhenkai Liang

National University of Singapore

2026-06-05视觉感知

这篇论文针对潜在视觉推理中“潜变量与视觉目标越对齐,答案越好”的常用假设展开检验。作者构造五种 LVR 变体,并提出 PRISM:用线性探针定位答案可解码位置、用潜变量扰动测试其因果作用。结果显示余弦对齐与任务准确率反而强负相关(r=-0.94),扰动潜变量最多只影响 4 个百分点,说明辅助损失主要通过共享参数重塑 VLM,而非让被监督潜变量真正承载答案信息。

Let It Be Simple: One-Step Action Generation for Vision-Language-Action Models Figure 1
2026-06-05cs.CV

Let It Be Simple: One-Step Action Generation for Vision-Language-Action Models

Yitong Chen, Shiduo Zhang, Jingjing Gong, Xipeng Qiu

University of Science and Technology of China, Shanghai Innovation Institute, Fudan University

2026-06-05视觉语言视觉感知

论文针对扩散式 VLA 仍沿用多步图像生成范式导致推理慢的问题,指出机器人策略的条件很丰富而动作块低维,单步生成可能本就更容易。其核心做法是不引入教师、蒸馏或额外损失,仅在标准 flow matching 中将训练时间分布偏向高噪声端。MNIST 探针、LIBERO 系列和少量真实双臂实验显示,单步策略通常可接近十步解码,在 LIBERO-Long 上达到 95.6%,但最优噪声偏移如何选择仍未充分说明。

VTI-CoT: Visual-Textual Interleaved Chain of Thought for Video Reasoning Figure 1
2026-06-05cs.CV

VTI-CoT: Visual-Textual Interleaved Chain of Thought for Video Reasoning

Shufan Zhang, Ziyue Lin, Bairun Wang, Lei Jin, Xuanding Ding, Xinzhu Ma, Kunlin Yang

2026-06-05视觉感知强化学习

本文针对视频推理中现有 CoT 多为纯文本、难以在推理时回看关键视觉证据的问题,提出 VTI-CoT:将每个推理步骤与对应视频片段/帧交织,并用自动标注流水线生成多模态 CoT 数据;同时把长链路文本图像渲染到画布,用 OCR 式视觉表示压缩监督信号。实验显示同规模模型达到 SOTA,并提升训练效率,但具体增益中数据构造与压缩机制的贡献仍需细看消融。

TextWand: A Unified Framework for Scene Text Editing Figure 1
2026-06-05cs.CV

TextWand: A Unified Framework for Scene Text Editing

Shuyu Wang, Zhile Guan, Hongxiu Chen, Yule Duan, Weiqi Li, Xin Shan, Ronggang Wang, Jian Zhang

School of Electronic and Computer Engineering, Peking University, Shenzhen, China., and tedious manual labor. Such workflows are, available, where text remains a separate vector, unavailable, the text layer cannot be extracted

2026-06-05视觉感知

针对扁平化图片中文字难以像图层文件那样分离、替换时易出现残影且难同时保持字形、排版和背景的问题,TextWand将场景文字编辑统一为“渲染”和“擦除”两个原语,并用ORPE约束像素级布局与参考样式、RAS抑制原文字痕迹。作者还构建TextWand-Bench,在删除、生成、替换三类任务上报告优于开源和闭源基线的文字准确性、风格一致性与图像质量。

ViCuR: Visual Cues as Recoverable Privilege for Multimodal On-Policy Distillation Figure 1
2026-06-05cs.CV

ViCuR: Visual Cues as Recoverable Privilege for Multimodal On-Policy Distillation

Kanghui Tian, Siyuan Liu, Ziang Yan, Sheng Xia, Shuai Dong, Yi Wang

Shanghai AI Laboratory, Fudan University, Nanjing University

2026-06-05视觉语言强化学习

这篇论文针对多模态 on-policy 自蒸馏中用答案/推理作为教师特权会造成训练-测试不匹配、诱导捷径模仿的问题,提出 ViCuR:把特权改为来自图像/视频的可恢复视觉线索,并用 sink-token 交叉注意力在学生内部聚合证据。实验在 7 个基准和 Qwen3-VL 2B/8B 上较答案式 OPSD 平均提升约 1.2 分,强教师 OPD 中也有 0.64/1.08 分增益。

Real-Time Threat Detection from Surveillance Cameras using Machine Learning Figure 1
2026-06-05cs.CV

Real-Time Threat Detection from Surveillance Cameras using Machine Learning

Gajendra Mandal, J. P. Patra, Priyansh Mahant

2026-06-05视觉感知

针对传统监控依赖人工且现有武器数据集少覆盖印度场景中常见棍棒、铁杆等钝器的问题,论文构建336张本地钝器图像并与枪、刀公开数据合并,训练YOLOv8三类实时检测器;还描述了帧缓冲与VLM行为分析告警流程,但实验支撑主要集中在检测模型。结果显示延长训练可提升钝器类召回率和AP且未见明显过拟合,实时部署可行性有所验证,增益可能主要来自data与training scaling。

Parallel Jacobi Decoding for Fast Autoregressive Image Generation Figure 1
2026-06-05cs.CV

Parallel Jacobi Decoding for Fast Autoregressive Image Generation

Boya Liao, Ying Li, Siyong Jian, Huan Wang

Westlake University

2026-06-05视觉感知

自回归图像生成逐 token 解码导致延迟高,而传统 Jacobi 解码沿一维序列扩展会因候选 token 误差传播而加速饱和。本文利用图像注意力的局部空间相关性,提出无需训练的 Parallel Jacobi Decoding,在二维空间中为下一行初始化并并行细化草稿 token,同时调整注意力掩码稳定收敛。在 Lumina-mGPT 与 LlamaGen 等模型上实现约 4.8×–6.4×加速,并基本保持生成质量。

Seeing Time: Benchmarking Chronological Reasoning and Shortcut Biases in Vision-Language Models Figure 1
2026-06-05cs.AI

Seeing Time: Benchmarking Chronological Reasoning and Shortcut Biases in Vision-Language Models

Haoyu Zhou, Qing Qing, Caichong Li, Qixin Zhang, Yongcheng Jing, Ziqi Xu, Juncheng Hu, Xikun Zhang, Renqiang Luo

2026-06-05视觉语言视觉感知数据集/基准

本文关注现有 VLM 时间推理评测多停留在视频帧排序、难以判断模型是否真正理解年代线索的问题,提出 ChronoVision 基准,包含长跨度相似物体演化、分类事件/物体以及新闻图文对齐三类数据。实验显示,不同类别上模型表现差异明显,且常依赖黑白/彩色等表面捷径而非真实年代特征,暴露了当前多模态时间对齐与因果式时间判断的不足。

T-SAR-JEPA: Self-Supervised Temporal Anomaly Detection in SAR Amplitude Stacks via Latent Prediction Figure 1
2026-06-05cs.CV

T-SAR-JEPA: Self-Supervised Temporal Anomaly Detection in SAR Amplitude Stacks via Latent Prediction

Kerod Woldesenbet, Abem Woldesenbet

2026-06-05视觉感知

针对传统 InSAR 时序变化检测流程复杂、难以扩展到密集商业 SAR 栈的问题,本文提出 T-SAR-JEPA:仅用幅度图自监督学习潜表示,并用带连续正弦时间编码的 Transformer 预测未来 latent,异常由预测误差给出;InSAR 相干性只作独立伪标注验证。在 DFC 2026 三个区域上,夏威夷火山窗口 ROC-AUC 达 77.0%,明显高于约 50% 的 RX、PaDiM、线性 AR 和 LSTM 基线,但更强时序基线和跨区域泛化仍文中未充分说明。

LongSpace: Exploring Long-Horizon Spatial Memory from Perception to Recall in Video Figure 1
2026-06-05cs.CV

LongSpace: Exploring Long-Horizon Spatial Memory from Perception to Recall in Video

Shiqiang Lang, Jing Liu, Haoyang He, Peiwen Sun, Yuanteng Chen, Tao Liu, Lan Yang, Longteng Guo, Honggang Zhang

Beijing University of Posts and Telecommunications, Zhongguancun Academy, Institute of Automation, Chinese Academy of Sciences, The Chinese University of Hong Kong, Xi’an Jiaotong University

2026-06-05视觉感知

面向机器人导航、自动驾驶等长时程任务,论文指出视频 MLLM 不能只看当前帧,而需跨远距离片段记住布局、路线、视角变化和物体状态。作者提出 LongSpace-Bench,用真实室内漫游视频评测感知、空间关系与空间记忆,并设计 LongSpace:按 chunk 处理长视频,引入 3D 结构线索和层感知可检索记忆。实验显示其在多项空间推理基准、尤其记忆密集任务上提升长视频空间理解,但具体增益幅度需看完整表格。

Two-Way Is Better Than One: Bidirectional Alignment with Cycle Consistency for Exemplar-Free Class-Incremental Learning Figure 1
2026-06-05cs.LG

Two-Way Is Better Than One: Bidirectional Alignment with Cycle Consistency for Exemplar-Free Class-Incremental Learning

Hongye Xu, Bartosz Krawczyk

Chester F. Carlson Center for Imaging Science, Rochester Institute of Technology, available at https://github.com/HXuSz11/BiCyc_ICLR2026., widely used protocol is class-incremental learning (CIL), where tasks introduce disjoint labels and

2026-06-05视觉感知

本文针对无样本类增量学习中旧类原型随特征空间更新而漂移、单向投影补偿易产生几何偏置的问题,提出 BiCyc:在新任务训练中同时学习 old→new 与 new→old 两个映射,并用停止梯度和循环一致性约束使表示与传输共同演化。理论上将循环损失与奇异值收缩、分类 log-odds 稳定性联系起来;实验在 CIFAR-100、TinyImageNet、ImageNet-100、CUB-200 等基准上降低遗忘并提升从零训练准确率,预训练细粒度场景保持竞争力。

V2V-Bench: A Comprehensive Benchmark for Video-to-Video Generation Evaluation Figure 1
2026-06-05cs.CV

V2V-Bench: A Comprehensive Benchmark for Video-to-Video Generation Evaluation

Tao Liu, Leela Krishna, Gouti Pavan Kumar, Sreeja K, Vishav Garg

2026-06-05视觉感知数据集/基准

针对视频到视频编辑既要执行指令又要保持源视频逐帧对应、现有 T2V/I2V 指标难以衡量的问题,V2V-Bench 构建含 81 个源视频和 11 维指标的分层基准,突出时间对齐、结构保真和编辑忠实度等 V2V 专属诊断。实验显示 Grok 在编辑与源结构保持上更强,Veo3.1 视觉质量更好;6 个核心维度与人工判断 Spearman 相关达 0.905。

CoFi-UCGen: Coarse-to-Fine Unsupervised Conditional Generation without Label Priors Figure 1
2026-06-05cs.CV

CoFi-UCGen: Coarse-to-Fine Unsupervised Conditional Generation without Label Priors

Shengxi Li, Zhaokun Hu, Ce Zheng, Mai Xu, Jingyuan Xia, Si Liu

C. Zheng is with the School of Cyber Science and Technology, Beihang University, Beijing 100191, China.

2026-06-05视觉感知

针对无标注条件生成难以同时获得全局可控性与细粒度变化的问题,CoFi-UCGen将GAN的紧凑潜空间与扩散模型细节生成结合:用对抗语义互学习从零学习bit-codes以组织粗粒度语义,并在HM-UNet中层级注入条件形成细粒度语义基。实验称其在无需标签先验或预训练特征的情况下,图像质量、语义一致性和控制精度均优于现有UCGen方法。

GS-NFS: Bandwidth-adaptive Streaming of Dynamic Gaussian Splats and Point Clouds Figure 1
2026-06-05cs.MM

GS-NFS: Bandwidth-adaptive Streaming of Dynamic Gaussian Splats and Point Clouds

Rajrup Ghosh, Haodong Wang, Haoran Hong, Eduardo Pavez, Amartya Chaudhuri, Weiwu Pang, Harsha V. Madhyastha, Antonio Ortega, Ramesh Govindan

University of Southern California, space (i.e., the center of the ellipsoid).

2026-06-05三维

动态 3D Gaussian Splatting 适合自由视角 3D 视频,但单帧体积远大于 2D 视频,现有后训练压缩难以实时编解码。GS-NFS 将点云式八叉树位置编码、RAHT 属性变换、ANS/RLGR 熵编码及 SH 的 YUV/KLT 去相关系统性 GPU 并行化,支持按带宽调节码率。实验显示其帧级编码/解码速度比现有方法快 1–2 个数量级,可达约 30 fps,移动 GPU 上部分序列约 25 fps,同时保持有竞争力的压缩率和渲染质量。

Multi-Task Crack Foundation Model for Engineering-Reliable Crack Representation and Topology Preservation in Civil Infrastructure Figure 1
2026-06-05cs.CV

Multi-Task Crack Foundation Model for Engineering-Reliable Crack Representation and Topology Preservation in Civil Infrastructure

Blessing Agyei Kyem, Joshua Kofi Asamoah, Eugene Denteh, Armstrong Aboah

2026-06-05视觉感知

面向土木基础设施巡检中裂缝细长、易断裂且跨场景泛化差的问题,论文将裂缝分割从单一掩码预测扩展为结构与置信度联合表征。CrackGeoFM冻结视觉基础模型,并加入频域增强、裂缝域适配和多任务解码,同时预测掩码、骨架和不确定性;骨架监督由已有二值标注自动生成。作者在20个裂缝数据集上报告了更好的分割、拓扑保持、校准不确定性和5张标注图像下的少样本适配效果。

ShotCrop$^3$: Cropping Human-Centric Images into Cinematic Triple-Shot Compositions Figure 1
2026-06-05cs.CV

ShotCrop$^3$: Cropping Human-Centric Images into Cinematic Triple-Shot Compositions

Dehong Kong, Lina Lei, Lingtao Zheng, Chenyang Wu, Ailing Zhang, Xinran Qin, Teng Ma, Jiaqi Xu, Zhixin Wang, Zhikai Chen, Xuecheng Qi, Renjing Pei, Fan Li

Huawei Noah’s Ark Lab, Sun Yat-sen University

2026-06-05视觉感知

针对传统美学裁剪只给单一画幅、难以同时保留人物场景、主体姿态与情绪细节的问题,本文提出三镜头构图任务TSC,从单张人像中心图像生成远景/中景/特写裁剪及描述。ShotCrop³结合专家标注、MLLM伪标签筛选、CoT-SFT、半监督微调和GRPO-S奖励优化,在1.2K专家标注TSC-Bench上显著优于通用MLLM,镜头定位准确性较GPT-5平均提升2.82倍。

KV-Control: Parameter-Efficient K/V Injection for Trajectory-Controlled Text-to-Motion Figure 1
2026-06-05cs.CV

KV-Control: Parameter-Efficient K/V Injection for Trajectory-Controlled Text-to-Motion

Tengjiao Sun, Pengcheng Fang, Xiaoyu Zhan, Yanwen Guo, Dongjie Fu, Xiaohao Cai, Hansung Kim

2026-06-05规划控制

面向动画与具身智能中仅靠文本难以精确跟踪根轨迹、末端目标或多关节约束的问题,KV-Control 将轨迹条件改写为自注意力中的 K/V 记忆检索,并结合 PartVQ 与 T-Concat 让每个帧-部位 token 可寻址,在冻结文本到动作 Transformer 上只训练约 1.5M 注入参数。HumanML3D/MaskControl 协议下,方法达到 0.40cm 骨盆误差和 0.71cm 多关节误差,较同骨干复制分支以约 26 倍更少机制参数取得更低误差。

What's Under the Skin? Estimating Swine Body Condition Figure 1
2026-06-05cs.CV

What's Under the Skin? Estimating Swine Body Condition

Mk Bashar, Kuljit Bhatti, Gary Rohrer, Madonna Benjamin, Tami Brown-Brandl, Daniel Morris

2026-06-05视觉感知

针对母猪体况评估中目测和卡尺与真实脂肪/肌肉组成相关性弱、超声又难以规模化的问题,论文提出 PigFormer:先将顶置 RGB-D 深度帧经分割蒸馏、地面去除和朝向归一化转为标准高度图,再用切片注意力编码背部截面序列联合回归背膘、腰肌和总组织厚度。在两场站 319 个实例上,背膘 MAE 为 2.43mm、总体 MAE 为 3.87mm,较 ResNet-18 和 ViT-small 基线分别降低约 22% 和 39%。

HDST-GNN: Heterogeneous Dynamic Spatiotemporal Graph Neural Networks for Multi-Object Tracking in UAV Aerial Imagery Figure 1
2026-06-05cs.CV

HDST-GNN: Heterogeneous Dynamic Spatiotemporal Graph Neural Networks for Multi-Object Tracking in UAV Aerial Imagery

Phillip Jiang

2026-06-05视觉感知

面向无人机航拍多目标跟踪中高度变化、小目标密集和遮挡导致的误匹配,HDST-GNN将检测、活跃轨迹和丢失轨迹建成异构动态时空图,并用基于目标面积的高度自适应连边、类型化关系和遮挡门控注意力改进关联。VisDrone2019-MOT上,oracle检测下达94.51% MOTA、97.24% IDF1,较SORT少81%身份切换;噪声检测下身份切换也降低49%。

BMCR: Adaptive Backbone Module Composition via Reinforcement Learning for Remote Sensing Object Detection Figure 1
2026-06-05cs.CV

BMCR: Adaptive Backbone Module Composition via Reinforcement Learning for Remote Sensing Object Detection

Wenlin Liu, Xikun Hu, Ping Zhong

Wenlin Liu, Xikun Hu, and Ping Zhong are with the College of Elec-, tronic Science and Technology, National University of Defense Technology

2026-06-05视觉感知强化学习

面向遥感目标检测中场景复杂度差异大、固定 CNN/ViT 主干难以同时兼顾局部细节与全局上下文的问题,BMCR 将现成 CNN 和 ViT 拆成带元数据的可复用模块,用强化学习按输入动态组合推理路径,并用 OT 接口对齐网格特征与 token 表示、AMCO 稳定训练。在 DOTA-v1.0、DOTA-v1.5 和 DIOR-R 上分别达到 79.31%、73.41%、71.86% mAP,较强静态和动态基线最高提升约 2.5 点且效率保持竞争力。

Monte Carlo Steklov Operators for Large-Scale Geometry Processing in the Wild Figure 1
2026-06-05cs.GR

Monte Carlo Steklov Operators for Large-Scale Geometry Processing in the Wild

Arman Maesumi, Tanish Makadia, Aruna Anderson, Oras Phongpanangam, Justin Solomon, Daniel Ritchie

ARMAN MAESUMI∗, Brown University, USA, TANISH MAKADIA∗, Brown University, USA, ARUNA ANDERSON†, Loyola Marymount University, USA, ORAS PHONGPANANGAM†, Brown University, USA, JUSTIN SOLOMON, Massachusetts Institute of Technology, USA, DANIEL RITCHIE, Brown University, USA, of this operator is visualized on the moose, which contains 2 million faces. Center: Our method applies to both interior and exterior operators—the latter, this scalability, we compute interior and exterior Steklov eigenspectra for, Scalability and robustness are key obstacles for volumetric meth-

2026-06-05强化学习

面向 Objaverse 这类网格质量差、组件众多的大规模“野外”几何,论文指出传统内蕴 Laplacian 与 BEM/FEM 体算子在鲁棒性和规模上受限;其核心是用布朗运动/Walk-on-Spheres 与 Beurling-Deny 公式直接蒙特卡洛估计内外 Dirichlet-to-Neumann 算子及 Steklov 谱,避免四面体化和大稠密矩阵,并可通过外域耦合断开部件。结果显示方法比既有边界元计算快数个数量级,能处理百万面片和约45万 Objaverse 形状,并支撑 Steklov-CLIP 学到可文本查询的全局与稠密3D表示。

UltraVR: A Diagnostic Ultra-Resolution Image-VQA Benchmark for Evidence-Grounded Reasoning Figure 1
2026-06-05cs.CV

UltraVR: A Diagnostic Ultra-Resolution Image-VQA Benchmark for Evidence-Grounded Reasoning

Gexin Huang, Yanting Yang, Myeongkyun Kang, Beidi Zhao, Jun Zhou, Chen Zhou, Gang Wang, Zu-hua Gao, Xiaoxiao Li

University of British Columbia, Vancouver, BC, Canada, Vector Institute, Toronto, ON, Canada, The Hong Kong Polytechnic University, Hong Kong SAR, China

2026-06-05视觉感知数据集/基准

本文针对超高分辨率图像中证据细小、分散且跨区域的问题,指出仅看最终 VQA 准确率难以定位 VLM 失败原因。UltraVR 的核心是覆盖 CCTV、遥感、病理切片和工业异常的诊断基准,并为每题标注分步 GT-CoT 与证据定位、局部感知、量化、整合、推断等操作标签。实验显示最强模型宏平均准确率仅 44.9%,主要瓶颈集中在早期证据定位和局部感知。

Dual Feature Decoupling for Fine-Grained OOD Detection Figure 1
2026-06-05cs.CV

Dual Feature Decoupling for Fine-Grained OOD Detection

Xiaokun Li, Yaping Huang, Qingji Guan

nition system is commonly trained in a controlled labora-, Xiaokun Li, Yaping Huang and Qingji Guan are from School of Computer, Science and Technology, Beijing Jiaotong University, No. 3 Shangyuan

2026-06-05视觉感知

论文关注细粒度场景下的 OOD 检测:ID/OOD 同属大类、外观与背景高度相似,传统依赖粗粒度语义差异的方法容易失效。作者提出 DFDNet,从特征解耦角度同时在空间/频率域抑制风格信息,并用像素级对抗重建去除背景和低层细节、强化类别特异语义。四个细粒度数据集实验显示其相较 MSP、ODIN、Energy 等基线取得更好检测效果,但具体增益幅度在给定片段中未充分说明。

Noise-Aware Visual Representation Learning for Medical Visual Question Answering Figure 1
2026-06-05cs.CV

Noise-Aware Visual Representation Learning for Medical Visual Question Answering

I Putu Adi Pratama, Bahadorreza Ofoghi, Atul Sajjanhar, Shang Gao

2026-06-05视觉感知

针对医疗 VQA 中视觉编码器输出易受采集/传输噪声和无关扰动影响、直接投影会把噪声传给 LLM 的问题,论文在 CLIP 特征到 MLP 视觉前缀映射前加入去噪自编码器,两阶段先重建干净嵌入再用 LoRA 做生成对齐。SLAKE 和 PathVQA 上干净性能基本保持竞争力,噪声嵌入下平均准确率显著优于直接投影和普通 AE,说明增益主要来自嵌入级去噪带来的鲁棒性。

What Objects Enable, Not What They Are: Functional Latent Spaces for Affordance Reasoning Figure 1
2026-06-05cs.LG

What Objects Enable, Not What They Are: Functional Latent Spaces for Affordance Reasoning

Rohan Siva, Neel P. Bhatt, Yunhao Yang, Seoyoung Lee, Nishant Gadde, Christian Ellis, Alvaro Velasquez, Zhangyang Wang, Ufuk Topcu

The University of Texas at Austin, University of Colorado Boulder

2026-06-05视觉感知

这篇论文针对机器人规划中过度依赖外观类别、难以判断物体“能做什么”的问题,提出 A4D:用 CLIP 图文嵌入构造由 affordance 及其反义词定义的功能潜空间,并以投影距离进行功能判别、不确定性估计和新 affordance 发现。实验显示其在已知 affordance 上约 94% 准确率,较 VLM 基线高 15 个百分点以上,新增 affordance 少样本后可超 90%,单次推理约 22ms、快约 100 倍。

Almieyar-Oryx-BloomBench: A Bilingual Multimodal Benchmark for Cognitively Informed Evaluation of Vision-Language Models Figure 1
2026-06-05cs.CV

Almieyar-Oryx-BloomBench: A Bilingual Multimodal Benchmark for Cognitively Informed Evaluation of Vision-Language Models

Mohammad Mahdi Abootorabi, Omid Ghahroodi, Anas Madkoor, Marzia Nouri, Doratossadat Dastgheib, Mohamed Hefeeda, Ehsaneddin Asgari

‡ University of British Columbia, § Zuse School ELIZA, † Qatar Computing Research Institute (QCRI), Hamad Bin Khalifa University

2026-06-05视觉语言视觉感知数据集/基准

针对现有 VLM 基准多为零散任务、难以定位真实认知短板的问题,论文提出英阿双语多模态 BloomBench,将图像问答按布鲁姆六层认知组织,并用半自动生成与人机混合质检保证规模和语言一致性。对多种 SOTA VLM 的评测显示,模型在语义理解上表现较强,但在事实回忆和创造性综合上明显薄弱,且阿拉伯语相对英语存在显著性能差距,暴露跨语言多模态推理不足。

BRepCLIP: Contrastive Multimodal Pretraining on BRep Primitives for CAD Understanding Figure 1
2026-06-05cs.CV

BRepCLIP: Contrastive Multimodal Pretraining on BRep Primitives for CAD Understanding

Muhammad Usama, Didier Stricker, Mohammad Sadil Khan, Muhammad Zeshan Afzal

aware pretraining for multimodal CAD understanding. Project page is available at

2026-06-05视觉语言

该文针对点云/网格预训练会丢失CAD原生BRep中的精确曲面、曲线和拓扑信息,导致细粒度检索与生成评估不足的问题,提出BRepCLIP:将面和边分别经双dVAE离散化,并加入几何类型语义描述,再用Transformer对齐CLIP文本/图像空间。实验显示其在ABC、CADParser、Automate文本到CAD检索上较OpenShape显著提升Top-1,FabWave零样本分类提升15%,BRepCLIP-Score也更贴近人工评估。

Robust Scene Transfer for PointGoal Navigation via Privileged Sensor Guided Contrastive Learning Figure 1
2026-06-05cs.CV

Robust Scene Transfer for PointGoal Navigation via Privileged Sensor Guided Contrastive Learning

Amirhossein Zhalehmehrabi, Tiziano Tezze, Alberto Castelini, Alessandro Farinelli

2026-06-05机器人安全鲁棒

针对视觉 PointGoal 导航在跨场景外观和语义变化下易过拟合的问题,论文用训练期特权 LiDAR 以几何相似度和自适应温度引导 RGB 对比预训练,并冻结编码器再做强化学习,促使策略依赖可迁移几何结构而非纹理捷径。仿真实验显示其在室内外场景迁移中优于大型视觉预训练模型和常规对比基线,部署时仅需单目 RGB 与任务状态输入。

Unpaired RGB-Thermal Gaussian-Splatting Using Visual Geometric Transformers Figure 1
2026-06-05cs.CV

Unpaired RGB-Thermal Gaussian-Splatting Using Visual Geometric Transformers

Jean Cordonnier, Chenghao Xu, Olga Fink, Malcolm Mielle

2026-06-05三维

针对RGB-热成像三维重建依赖精确配对/标定、难以用于独立采集或多机器人异构传感的痛点,论文用VGGT分别估计两模态相机位姿,再借助跨模态匹配与Procrustes对齐,训练未配对RGB-T 3D Gaussian Splatting,并提出同时评估单模态合成与跨模态一致性的基准。九个场景中热视图合成具竞争力且RGB质量基本保持,但位姿对齐仍有误差,部分增益与VGGT位姿质量相关。

LLM-Guided ANN Index Optimization for Human-Object Interaction Retrieval Figure 1
2026-06-05cs.CV

LLM-Guided ANN Index Optimization for Human-Object Interaction Retrieval

Shahrzad Esmat, Chaunte W. Lacewell, Sameh Gobriel, Nilesh Jain, Ali Jannesari

Iowa State University, retrieval ground truth without additional labeling.

2026-06-05优化算法

论文关注多阶段向量检索中 ANN 索引与重排参数强耦合、传统 HPO 独立建模易失效的问题,提出读取完整试验历史的分阶段 LLM 代理,并以 SIEVE 约束质量后优化吞吐。在 HICO-DET 文本到 HOI 图像检索上较 Optuna TPE 提升 33.3%、较 VDTuner 提升 34.2%,对 UniIR 吞吐提升 15.3×;在耦合较弱的 GLDv2、SIFT1M 上优势收敛,并可无改动迁移到 Milvus。

Can We Predict The Human Preference For Text-to-Image Content Prior To Generation And Is It Even Useful To Do So? Figure 1
2026-06-05cs.CV

Can We Predict The Human Preference For Text-to-Image Content Prior To Generation And Is It Even Useful To Do So?

Joong Ho Kim, Keith G. Mills

2026-06-05视觉感知

论文关注扩散模型中随机初始噪声会显著影响文本生成图像的人类偏好评分,而直接多次生成再筛选计算昂贵。作者提出在生成前用提示词与候选噪声预测 HPM 分数,并以 Best-of-N 选择更优噪声,同时比较不同偏好指标和预测器。实验覆盖 SDXL、DreamShaper、Hunyuan-DiT、PixArt-Σ 等,显示该策略可提升端到端偏好分数;但指标选择很关键,且简单的不依赖扩散模型内部计算的预测器反而平均增益更好、硬件开销更低。

Formal Concept Lattices are Good Semantic Scaffolds for Concept-Based Learning Figure 1
2026-06-05cs.CV

Formal Concept Lattices are Good Semantic Scaffolds for Concept-Based Learning

Deepika SN Vemuri, Sayanta Adhikari, Ankit Saha, Krishn Vishwas Kher, Vineeth N Balasubramanian

ful and hierarchically structured. Code available, (often hierarchical) in the label space. Our approach, on

2026-06-05视觉感知

针对现有概念瓶颈模型常把语义概念平铺在单一层、难以对应人类从泛到细的层级理解,本文用形式概念分析从类别—属性关系构建概念格,并将不同粒度概念分配到网络不同深度作为语义脚手架。实验显示该设计在保持/提升分类表现的同时,得到更有层级结构和可解释性的嵌入,并支持比单层概念模型更有效的多层干预。

ORACLE-CT: Anatomy-Aware Support Pooling for CT Classification Figure 1
2026-06-05cs.CV

ORACLE-CT: Anatomy-Aware Support Pooling for CT Classification

Lavsen Dahal, Yubraj Bhandari, Geoffrey Rubin, Joseph Y. Lo

2026-06-05视觉感知

腹部 CT 多标签分类中,病灶证据常局限于特定器官,而常规全局池化/无约束注意力会混入无关解剖区域。ORACLE-CT 的关键是利用多器官分割为每个标签限定解剖支持域,只在相应区域内做注意力汇聚。实验显示该策略在 DINOv3、I3D-ResNet 上提升 MERLIN 内部 AUROC/AUPRC,并改善 Duke-Abdomen、AMOS 外部迁移;Pillar-0 的主要增益更多来自学习式注意力,掩膜增益较小。

Horse Eye Blink Detection and Classification for Equine Affective State Assessment Figure 1
2026-06-05cs.CV

Horse Eye Blink Detection and Classification for Equine Affective State Assessment

João Alves, Signe Møller-Skuldbøl, Pia Haubro Andersen, Rikke Gade

Visual Analysis and Perception Lab, Aalborg University, Department of Animal Biosciences, Swedish University of Agricultural Sciences, publicly available dataset. We achieve a macro-F1 score, not available. Observational scales such as the Horse Gri-, the human centered FACS [3]. EquiFACS describes facial, multiple methodologies on a publicly available dataset [6]., • Evaluation of our methods on the publicly available set [6, of available training data [5]. A key contributing factor to, For frame-based methods, individual frames were labelled, visible was labelled as half-blink. For video-based meth-, level labels and individually classified short video clips. In, gle label to all consecutive blink frames within an episode

2026-06-05视觉感知

论文面向马匹疼痛与情绪评估中 EquiFACS 标注成本高、半眨眼/全眨眼微表情难以人工稳定识别的问题,比较了光流阈值、逐帧 YOLOv12 与微调 VideoMAE 三类视频眨眼检测/分类方法,并加入人类基线说明半眨眼标注本身困难。公开测试集上,三分类宏 F1 达 0.898,二值眨眼检测宏 F1 达 0.926,显示其可用于缩小人工检索范围,但细粒度 AU 识别仍受数据稀缺与类别细微差异限制。

Disentangled Fine-Grained Prototype Learning for Incomplete Image-Tabular Classification Figure 1
2026-06-05cs.CV

Disentangled Fine-Grained Prototype Learning for Incomplete Image-Tabular Classification

Feixiang Zhou, Jianyang Xie, Zhuangzhi Gao, Qinkai Yu, Fu Wang, Yuheng Fan, Jing Li, Zheheng Jiang, Yitian Zhao, Yanda Meng, He Zhao, Gregory Y.H. Lip, Yalin Zheng

Code will be made publicly available., with the School of Eye and Vision Sciences, University of Liverpool, U.K., G. Y.H. Lip is with the Department of Cardiovascular and Metabolic, Medicine, University of Liverpool, U.K., Q. Yu is with the School of Computer Science, University of Exeter, U.K., J. Li is with the School of Computer Science and Engineering, South China, University of Technology, China., Z. Jiang is with the School of Computing and Mathematical Sciences, University of Leicester, U.K., Y. Zhao is with Ningbo Institute of Industrial Technology, Chinese, Academy of Sciences, China., Science and Engineering Division (BESE), King Abdullah University of

2026-06-05视觉感知

针对图像—表格多模态分类中常见的模态缺失问题,论文指出仅在全局平均特征上做共享/特异解耦会忽略细粒度语义与分布错位。DFPL通过共享-特异原型建模、原型级分布与类别语义对齐,以及类别感知多尺度聚合来增强缺失模态下的表示利用。三个图像—表格基准上的实验显示其在多种缺失设置下优于已有方法,但对未配对样本的利用仍未充分解决。

Uncertainty-Aware Adaptive Sensor Fusion for Autonomous Navigation Figure 1
2026-06-05cs.RO

Uncertainty-Aware Adaptive Sensor Fusion for Autonomous Navigation

Simegnew Yihunie Alaba, Yuichi Motai

Simegnew Yihunie Alaba

2026-06-05机器人安全鲁棒

针对自动导航中 IMU 易漂移、视觉在遮挡/光照变化下不可靠的问题,论文将深度特征学习与 UKF 结合:用 ViT 建模 IMU 时序、MCNN 提取光流运动线索,并通过不确定性估计自适应调节传感器权重和噪声协方差,训练中加入不确定性感知损失。在 KITTI 上报告 ATE/RPE 优于基线,并在 A100 上达到 155 FPS;但真实资源受限平台上的部署效果文中未充分说明。

Would you still call this Dax? Novel Visual References in VLMs and Humans Figure 1
2026-06-05cs.CV

Would you still call this Dax? Novel Visual References in VLMs and Humans

Ada Defne Tür, Gaurav Kamath, Joyce Chai, Siva Reddy, Benno Krojer

♡McGill University, ♣Mila Quebec AI Institute, ♠University of Michigan - Ann Arbor, ♢Canada CIFAR AI Chair, learned labels to stimuli that humans reject. We, label, and thus assign novel words to unfamiliar

2026-06-05视觉语言

本文关注 VLM 在只见过少量样例后如何把新视觉对象映射到新词,尤其当新命名与预训练常识冲突时的泛化边界。作者构建 NVRD,含 90 类从熟悉到完全新颖的对象及 1.9 万张受控扰动图,并与 2400 个人类判断对比。结果显示,模型能一定程度上下文学习新指称,但对已有常识标签的对象更抗拒;其对形状扰动最敏感、与人类趋势相关,却明显过度泛化,把人类拒绝的变体仍归为同一新词。

UniPixie: Unified and Probabilistic 3D Physics Learning via Flow Matching Figure 1
2026-06-05cs.CV

UniPixie: Unified and Probabilistic 3D Physics Learning via Flow Matching

Qilin Huang, Quynh Anh Huynh, Long Le, Chen Wang, Chuhao Chen, Ryan Lucas, Eric Eaton, Lingjie Liu

University of Pennsylvania, Southern University of Science and Technology

2026-06-05生成模型三维

针对从单幅视觉输入预测物体物理属性时,传统前馈模型只能给出确定性点估计、难以表达材料歧义的问题,UniPixie将任务改写为可控的连续物理谱学习。它基于带属性范围标注的PixieMultiVerse,用统一编码器和条件Flow Matching解码器生成从最软到最硬的材料场,并适配MPM、LBS和弹簧质点等多种求解器。实验显示其可产生多样且物理可行的动态效果,杨氏模量误差较最强确定性基线降低超过50%。

Deep Learning-assisted AMD Staging based on OCT and OCT Angiography Figure 1
2026-06-05cs.CV

Deep Learning-assisted AMD Staging based on OCT and OCT Angiography

Yukun Guo, Tristan T. Hormel, An-Lun Wu, Liqin Gao, Min Gao, Steven T. Bailey, Yali Jia

Casey Eye Institute, Oregon Health & Science University, Portland, OR 97239, USA, Department of Biomedical Engineering, Oregon Health & Science University, Portland, OR 97239, USA, Department of Ophthalmology, Mackay Memorial Hospital, Hsinchu 300044, Taiwan, Visionix/Optovue Inc., CA). Each, labor burden that is associated with manual AMD staging an increasing number of studies have proposed

2026-06-05视觉感知

针对AMD分期依赖专家、CFP与既有OCT方法难充分利用三维结构和血流信息的问题,本文用OCT/OCTA构建自动四级分期框架,对比病灶生物标志物图、2D en face投影和3D体数据三类EfficientNet模型。351眼2030个体数据五折验证显示各模型QWK均≥0.83,生物标志物模型最佳(0.85±0.03)且早期AMD F1最高,提示显式病灶表示可能更具临床实用性。

Three-Dimensional Retinal Microvasculature Restoration in OCT Angiography Figure 1
2026-06-05cs.CV

Three-Dimensional Retinal Microvasculature Restoration in OCT Angiography

Yukun Guo, Min Gao, Tristan T. Hormel, Steven T. Bailey, Thomas S. Hwang, Yali Jia

Casey Eye Institute, Oregon Health & Science University, Portland, OR 97239, USA, Department of Biomedical Engineering, Oregon Health & Science University, Portland, OR 97239, USA, truth, in both 2D and 3D by at least 3.8/51.2% (2D/3D) in several different vascular slabs., introduced a slab-based subtraction strategy to suppress projection artifacts to improve the accuracy of, CNV visualization[18]. However, because the method relies on slab-based subtraction, it may, attenuation with slab subtraction methods, our group developed projection-resolution OCTA (PR-OCTA), diverse imaging conditions. Projection artifact removal techniques, including slab-based subtraction and, Optovue/Visionix, Inc.). Two consecutive B-scans were acquired, by the Institutional Review Board of Oregon Health & Science University (Portland, OR) and was

2026-06-05视觉感知

针对OCTA中散斑、投影、衰减和运动伪影影响视网膜血流与无灌注区量化的问题,论文提出从单次OCTA体数据恢复三维微血管的深度模型:以相邻3张B帧预测中间帧,采用EfficientNet-B5编码器、scSE解码器和跳连,利用多次扫描平均构造真值。实验显示相较原始单次扫描,PSNR由22.23升至26.16,SSIM由0.72升至0.91,2D/3D血管Dice也显著提升。

Biomazon: A Multimodal Dataset for 3D Forest Structure and Biomass Modeling in the Amazon Basin Figure 1
2026-06-05cs.CV

Biomazon: A Multimodal Dataset for 3D Forest Structure and Biomass Modeling in the Amazon Basin

Sayan Mandal, Rocco Sedona, Simon Besnard, Mikhail Urbazaev, Morris Riedel, Ehsan Zandi, Gabriele Cavallaro

2026-06-05视觉语言数据集/基准三维

针对热带森林结构建模常把 GEDI 信息压成冠层高度或单一生物量标量、难以评估垂直结构一致性的问题,Biomazon 提供亚马孙 20m 多模态基准,将 Sentinel、PALSAR、DEM、LULC 与 AlphaEarth 嵌入对齐到完整 RH 剖面和 AGBD,并用锚定累积参数化强制 RH 单调。文中给出统一空间划分、共享编码器基线、尺度/模态/联合训练消融及与现有产品的对齐比较,但具体性能增益幅度和来源在给定片段中未充分说明。

Recovering Physically Plausible Human-Object Interactions from Monocular Videos Figure 1
2026-06-05cs.CV

Recovering Physically Plausible Human-Object Interactions from Monocular Videos

Dingbang Huang, Etienne Vouga, Qixing Huang, Georgios Pavlakos

University of Texas at Austin, Shanghai Jiao Tong University, control framework [9, 31, 37]. Meanwhile, scalable train-

2026-06-05视觉感知

该文针对单目视频人-物交互重建虽外观合理、却常有穿模、悬浮和抖动等物理违背的问题,提出 RePHO:先用运动学方法得到初值,再在物理仿真中通过强化学习训练策略复现交互;核心在于自适应采样与双自更新机制,从噪声重建中挑出可靠帧并逐步传播物理一致性。实验显示其在两个 HOI 基准上相较运动学和物理基线提升了物理合理性及部分 3D 精度指标。

LightVesselNet: An Ultra-Lightweight Sub-100K Parameter Network for Retinal Blood Vessel Segmentation Figure 1
2026-06-05cs.CV

LightVesselNet: An Ultra-Lightweight Sub-100K Parameter Network for Retinal Blood Vessel Segmentation

Shadman Sobhan, Farhana Jalil

2026-06-05视觉感知

针对视网膜血管分割模型精度高但参数量和算力需求阻碍边缘筛查部署的问题,LightVesselNet以约75K参数的紧凑编码器—解码器为核心,结合深度可分离卷积SE微块、多尺度空洞卷积聚合、空间/通道注意力、亚像素上采样和边缘残差来保留细小血管。其在DRIVE、STARE、CHASE_DB1、FIVES、HRF上取得0.7686–0.8649 Dice,并在参数/算力效率和跨数据集泛化上优于多种更大模型。

TopoPult-SSL: Gland-Mask-Free Cross-Device Meibomian Gland Segmentation via Self-Distilled Weak Clinical Priors Figure 1
2026-06-05cs.CV

TopoPult-SSL: Gland-Mask-Free Cross-Device Meibomian Gland Segmentation via Self-Distilled Weak Clinical Priors

Nicolò Savioli, Luca Del Tongo

2026-06-05视觉感知

针对睑板腺分割在新成像设备上因域偏移而需重新标注密集腺体掩码的问题,TopoPult-SSL利用眼睑轮廓、Pult分级和形态比例等弱临床先验进行无目标腺体掩码适配,并在有少量目标标注时把互补教师自蒸馏为单模型。在MGD-1k到CAMG跨设备基准上,蒸馏模型Dice达0.716±0.006,优于UA-MT的0.710;无腺体掩码阶段Precision为0.694,明显高于SAM/MedSAM的0.30–0.34。

The Invisible Hand of Physics: When Video Diffusion Models Know More Than They Show Figure 1
2026-06-05cs.GR

The Invisible Hand of Physics: When Video Diffusion Models Know More Than They Show

Parsa Esmati, Somjit Nath, Katja Hofmann, Derek Nowrouzezahrai, Samira Ebrahimi Kahou, Majid Mirmehdi

University of Bristol, McGill University, Mila–Quebec AI Institute, University of Calgary, can arise as a byproduct of generative denoising. Code is available here.

2026-06-05视觉感知生成模型

面向将视频扩散模型用作机器人世界模拟器的需求,论文追问其逼真视频背后是否真的含有物理结构。作者通过反向积分采样轨迹,从真实视频恢复扩散过程中的内部状态并做线性探测与干预,发现物理合理性不在 VAE 输入中,却在去噪 Transformer 中涌现;在 IntPhys、InfLevel 上平均约 81.27% 准确率,并优于 V-JEPA、VideoMAE 等表征基线。

Do Models Share Safety Representations? Cross-Model Steering for Safe Visual Generation Figure 1
2026-06-05cs.CV

Do Models Share Safety Representations? Cross-Model Steering for Safe Visual Generation

Tobia Poppi, Silvia Cappelletti, Sara Sarto, Florian Schiffers, Garin Kessler, Marcella Cornia, Lorenzo Baraldi, Rita Cucchiara

University of Modena and Reggio Emilia, University of Pisa, aimagelab.github.io/cross-model-safety-representations

2026-06-05安全鲁棒

针对生成式图像/视频模型安全控制常需为每个目标模型重训或接触不安全数据的问题,本文提出跨模型安全转向:在源 LLM 中由安全/不安全提示估计安全方向,再用仅含良性提示的轻量对齐映射到目标生成器,并支持类别化多向量控制。实验覆盖多种文生图与文生视频模型,显示转移方向可显著降低攻击成功率,CLIP/FID 质量权衡接近甚至超过使用目标端不安全数据学习的本地基线。

Personal AI Agent for Camera Roll VQA Figure 1
2026-06-05cs.CV

Personal AI Agent for Camera Roll VQA

Thao Nguyen, Krishna Kumar Singh, Donghyun Kim, Yong Jae Lee, Yuheng Li

University of Wisconsin-Madison, Korea University

2026-06-05视觉感知

论文关注个人相册问答中“照片多、时间跨度长、语境强”的检索与推理难题,指出直接长上下文或普通RAG难以保留身份、关系和事件线索。作者构建含50名用户、31476张照片、2500个问答的camroll,并提出带层次化记忆和少量导航工具的camroll-agent。实验显示其优于多种基线,凸显个性化视觉记忆不同于文本长上下文,需要专门的数据与代理机制。

NIV: Neural Axis Variations for Variable Font Generation Figure 1
2026-06-05cs.CV

NIV: Neural Axis Variations for Variable Font Generation

Nadav Benedek, Ariel Shamir, Ohad Fried

Reichman University, variable font from a static font remains a labor-intensive process requiring expert, flexibility in responsive design and typography. However, creating a variable font is a labor-intensive

2026-06-05视觉感知

针对静态字体转可调变量字体仍依赖人工设计多套母版与 gvar 位移的问题,NIV 直接在矢量字形控制点上学习轴条件形变,并用 Property Embedding 建模粗细、宽度、倾斜、光学尺寸等多轴交互,再分层写入 OpenType fvar/gvar 元组。基于 Google Fonts 百万级变体元组训练后,模型可为未见字体、Unicode 字符、复杂 CJK 甚至手写输入生成可连续插值的标准 TTF;但字距、hinting 等字体级排版能力仍未充分覆盖。

VideoKR: Towards Knowledge- and Reasoning-Intensive Video Understanding Figure 1
2026-06-05cs.CV

VideoKR: Towards Knowledge- and Reasoning-Intensive Video Understanding

Lin Fu, Zheyuan Yang, Yang Wang, Tingyu Song, Arman Cohan, Yilun Zhao

2026-06-05视觉感知

论文指出现有视频训练集偏日常感知,难支撑需要领域知识和多步推理的理解任务。VideoKR的核心是重新做数据:收集145K个CC授权专家域视频,生成315K个按基础推理、知识增强感知、知识密集推理划分的QA/CoT,并配套更难由单帧或文本捷径解答的VideoKR-Eval。实验在标准SFT→GRPO下显示,后训练模型在知识密集视频推理上优于既有后训练方案,通用视频推理仍保持竞争力,增益可能主要来自数据设计。

Oklch+: A Three-Parameter Extension of Oklab for Improved Color Difference Prediction Figure 1
2026-06-05eess.IV

Oklch+: A Three-Parameter Extension of Oklab for Improved Color Difference Prediction

Naoyuki Uchida

2026-06-05视觉感知

论文针对 Oklab/Oklch 适合设计插值但颜色差异预测弱于 CIEDE2000 的问题,提出 Oklch+:仅用 3 个参数对亮度轴做幂变换、对彩度轴做 Naka-Rushton 饱和压缩,再在变换坐标中计算欧氏距离。其核心洞察是区分外观均匀性与辨别均匀性,并直接用超阈值色差数据优化。COMBVD 上 STRESS 为 29.09,接近 CIEDE2000 的 29.13,显著优于 Oklab,但验证仍主要限于 sRGB 中心数据。

Flash-WAM: Modality-Aware Distillation for World Action Models Figure 1
2026-06-05cs.LG

Flash-WAM: Modality-Aware Distillation for World Action Models

Arman Akbari, Ci Zhang, Arash Akbari, Lin Zhao, Yixiao Chen, Weiwei Chen, Xuan Zhang, Geng Yuan, Yanzhi Wang

Northeastern University, University of Georgia, EmbodyX Inc.

2026-06-05强化学习

Flash-WAM针对世界-动作模型虽能联合预测未来视频与机器人动作、但扩散去噪步数过多而难以实时控制的问题,指出视频与动作因SNR噪声日程不同导致普通一致性蒸馏在低噪声动作流中梯度衰减。其按模态选择一致性函数:视频用方差保持参数化,动作用线性梯度缩放。基于LingBot-VA,单步推理将RoboTwin延迟从8.1秒降至348毫秒,成功率保持在85.5%,LIBERO为95.7%,真机平均60%。

Drishti AI-Event Guardian: An Intelligent Real-Time Crowd Monitoring and Emergency Response System for Mass Gathering Events Figure 1
2026-06-05cs.CY

Drishti AI-Event Guardian: An Intelligent Real-Time Crowd Monitoring and Emergency Response System for Mass Gathering Events

Ritabrata Roy Choudhury, Arkajyoti Karmakar, Rudra Pratap Mitra

School of Computer Engineering, Kalinga Institute of Industrial Technology, School of Electronics Engineering, processing and elastic scalability., provide a scalable, replicable foundation for deployment across event contexts ranging from localized

2026-06-05视觉感知

面向大型集会中人工监控滞后、拥挤踩踏和应急调度低效的问题,论文提出 Drishti,将 CCTV/UAV 视觉、YOLOv8 密度估计、多相机融合、异常检测、5 分钟拥堵预测与失踪人员识别、医疗上报、聊天机器人和保安重分配整合为云端系统。在 Kumbh Mela 与 RCB 游行案例中,密度 MAE 为 3.2 人/m²,异常检测 F1=0.91,告警中位延迟 111 ms,调度延迟较人工降低 34%。

Is This Edit Correct? A Multi-Dimensional Benchmark for Reasoning-Aware Image Editing Figure 1
2026-06-05cs.HC

Is This Edit Correct? A Multi-Dimensional Benchmark for Reasoning-Aware Image Editing

Yixuan Ding, Wei Huang, Ruijie Quan, Xiaojuan Qi, Yi Yang

♠Zhejiang University, ♢The University of Hong Kong, lability driven by diffusion-based frameworks [28, 31], it

2026-06-05视觉感知数据集/基准

本文关注图像编辑中“看起来合理但逻辑不对”的问题,指出现有模型多停留在表层指令匹配,难处理隐含的物理、环境、文化、因果和指代约束。作者提出 RE-Edit 基准,含 1000 个样本和分维度评测,并评测 12 个开源/商业编辑模型,发现先进模型仍频繁违反隐含逻辑;其轻量后处理 EditRefine 通过显式推理改写指令,在不改底座模型的情况下稳定提升推理正确性。

Ask-to-Clarify: Resolving Instruction Ambiguity through Multi-turn Dialogue Figure 1
2026-06-05cs.RO

Ask-to-Clarify: Resolving Instruction Ambiguity through Multi-turn Dialogue

Xingyao Lin, Xinghao Zhu, Tianyi Lu, Sicheng Xie, Hui Zhang, Xipeng Qiu, Zuxuan Wu, Yu-Gang Jiang

† denotes the corresponding author 1 College of Computer Science and Artificial Intelligence, Fudan University, Shanghai, China., Shanghai Innovation Institute, Shanghai, China., Mechanical Systems Control Lab, UC Berkeley, California, USA.

2026-06-05视觉感知

本文针对现实机器人指令常含歧义、现有 VLA 多被动执行且缺少澄清机制的问题,提出 Ask-to-Clarify:先用 VLM 进行多轮追问消解歧义,再通过连接模块把澄清后的语义转为扩散动作模型条件,并以两阶段“知识隔离”训练保留对话能力。真实世界 8 个操作任务中,该方法较 π0、π0-FAST、OpenVLA-OFT 等 VLA 表现更好,显示主动澄清可提升协作式具身操作可靠性。

2026-06-04

118 篇
Controllable Dynamic 3D Shape Generation via 3D Trajectories and Text Figure 1
2026-06-04cs.CV

Controllable Dynamic 3D Shape Generation via 3D Trajectories and Text

Jaeyeong Kim, Ines Kim, Jahyeok Koo, Seungryong Kim

Project Page : https://cvlab-kaist.github.io/T2Mo

2026-06-04规划控制三维

针对仅靠文本难以精确控制动态三维物体运动的问题,T2Mo将用户在网格点上指定的3D轨迹作为空间约束,并与文本语义共同条件化扩散式前馈生成器;其关键在于形状锚定的轨迹嵌入,把稀疏、密集或不均匀轨迹统一映射为覆盖全物体的形状感知token。实验与用户研究显示,相比文本基线和视频级联方案,它在轨迹对齐、运动表达性和主观偏好上更好,同时基本保持运动质量。

An Open-Source Two-Stage Computer Vision Pipeline for Fine-Grained Vehicle Classification using Vision Transformers Figure 1
2026-06-04cs.CV

An Open-Source Two-Stage Computer Vision Pipeline for Fine-Grained Vehicle Classification using Vision Transformers

Gandhimathi Padmanaban, Fred Feng

2026-06-04视觉感知

面向骑行者超车安全分析中缺少可扩展、细粒度车型标注工具的问题,本文将预训练 RT-DETR 粗检测与微调 ViT-Base/16 车型分类串联,并用置信度拒判减少低置信误报,区分轿车、SUV、皮卡等六类。系统在 Ann Arbor 3805 个事件上准确率 0.94,跨域开放骑行数据无需重训达 0.89,主要退化集中在面包车类且更多表现为拒判而非错判。

GeM-NR: Geometry-Aware Multi-View Editing for Nonrigid Scene Changes Figure 1
2026-06-04cs.CV

GeM-NR: Geometry-Aware Multi-View Editing for Nonrigid Scene Changes

Josef Bengtson, Yaroslava Lochman, Fredrik Kahl

2026-06-04视觉感知

多视角编辑在非刚性场景变化中常因原始几何失效而难以保持一致。GeM-NR的关键洞察是从已编辑锚视图重建编辑后几何,并将其投影到查询视角,再结合未编辑查询图作为条件交给多参考编辑模型细化,无需训练或逐场景优化。实验显示其在大幅几何与外观修改、编辑3D Gaussian生成中提升了几何和光度一致性,单图约数秒。

Geometry Gaussians: Decoupling Appearance and Geometry in Gaussian Splatting Figure 1
2026-06-04cs.GR

Geometry Gaussians: Decoupling Appearance and Geometry in Gaussian Splatting

Hongyu Zhou, Zorah Lähner

2026-06-04三维

本文针对 3D Gaussian Splatting 中外观渲染与几何重建共用同一 opacity 导致的冲突,尤其是透明/半透明物体颜色来自后方而几何位于表面的情况,提出为每个 Gaussian 额外加入 geometry opacity,仅用于深度、法线和几何正则,从而轻量解耦颜色贡献与几何占据。作者还结合视觉基础模型几何输入设计透明感知优化流程;在 NeRF Synthetic、DTU、TransLab 和 Mip-NeRF 等数据集上,方法在不降低常规场景渲染的同时提升几何与渲染质量,透明物体收益最明显。

Continual Visual and Verbal Learning Through a Child's Egocentric Input Figure 1
2026-06-04cs.CV

Continual Visual and Verbal Learning Through a Child's Egocentric Input

Xiaoyang Jiang, Yanlai Yang, Kenneth A. Norman, Brenden Lake, Mengye Ren

Agentic Learning AI Lab, New York University, Department of Psychology, Princeton University

2026-06-04视觉感知

这篇论文针对以往儿童视角词义学习模型依赖离线打乱、多轮遍历数据而缺乏认知真实性的问题,提出 BabyCL:按时间顺序单遍处理 SAYCam,用多阶段时间分段、视觉/多模态双重回放缓冲和共享骨干上的三种对比损失联合学习视觉表征与图文对齐。在相同优化预算下,它在 SAYCam Labeled-S 4AFC 上优于流式基线,接近离线训练上界,且对分段窗口和缓冲淘汰策略较稳健。

Who Needs Labels? Adapting Vision Foundation Models With the Metadata You Already Have Figure 1
2026-06-04cs.CV

Who Needs Labels? Adapting Vision Foundation Models With the Metadata You Already Have

Elouan Gardès, Seung Eun Yi, Kartik Ahuja, Théo Moutakanni, Huy V. Vo, Piotr Bojanowski, Wolfgang M. Pernice, Loïc Landrieu, Camille Couprie

Who Needs Labels? Adapting Vision Foundation, Meta FAIR, Paris, 2LIGM, CNRS, Gustave Eiffel, ENPC, IP Paris, 3Columbia University, New York, We propose a label-free approach to adapt powerful but generic vision foundation models to specialized, scientific domains. Standard supervised fine-tuning is often ill-suited to these settings: labels are scarce, domain-specific state of the art, while using no task labels for backbone adaptation and only lightweight, correlated to these variations, and which are available at virtually no extra cost., In scientific settings, however, labels are often scarce or expensive [16], and fine-tuning can overfit task-, Unsupervised domain adaptation instead leverages unlabelled data from the target distribution [18, 19], but, application domain without task labels, then evaluating the frozen adapted representation with lightweight, We propose FINO (FIne tuning with NO labels), a unified framework for metadata-driven representation, labels, adapt a generic foundation model to a new application domain without task labels (b). The resulting representations

2026-06-04视觉感知

科学影像中标签稀缺且分布偏移明显,直接监督微调容易过拟合任务并损害基础模型泛化。本文提出 FINO,把已有采集元数据作为弱监督,与自监督目标结合,既支持高基数离散元数据也支持连续元数据,用于保留有用因素、抑制批次等伪相关。实验覆盖显微、遥感、野生动物与胸片,冻结骨干加轻量探针即可优于无监督域适应和监督微调,并达到或超过部分领域专用 SOTA。

Identifying Gems from Roman RAPIDly Figure 1
2026-06-04cs.LG

Identifying Gems from Roman RAPIDly

Karan Gandhi, Ashish A. Mahabal, Jacob E. Jencson, Russ R. Laher, Ben Rusholme, Lin Yan, Ryan M. Lau, Schuyler D. Van Dyk, Mansi M. Kasliwal

Department of Computer Science and Engineering, Indian Institute of Technology, Gandhinagar, India, Division of Physics, Mathematics, and Astronomy, California Institute of Technology, Pasadena, CA 91125, USA, Center for Data Driven Discovery, California Institute of Technology, Pasadena, CA 91125, USA, IPAC, California Institute of Technology, 1200 E. California Blvd, Pasadena, CA 91125, USA, Caltech Optical Observatories, California Institute of Technology, Pasadena, CA 91125, USA

2026-06-04视觉感知

Roman 望远镜将产生海量时域红外告警,但发射前缺乏真实数据训练去伪存真模型。本文面向 RAPID 差分流水线提出 RuBR:结合图像与特征编码、旋转不变嵌入,并用本地注入与 OpenUniverse2024 模拟数据及域自适应方案应对仿真到真实的落差。在 OU24 上报告精度 90.10%、召回 71.68%,显示可用于早期告警过滤,但召回受 PSF、星系核残差和数据不平衡限制。

ZipSplat: Fewer Gaussians, Better Splats Figure 1
2026-06-04cs.CV

ZipSplat: Fewer Gaussians, Better Splats

Alexander Veicht, Sunghwan Hong, Dániel Baráth, Marc Pollefeys

2026-06-04三维

现有前馈 3D Gaussian Splatting 通常按输入像素生成高斯,预算随分辨率和视角数增长,导致平面/重叠区域冗余。ZipSplat 将场景表示为可聚类压缩的 scene tokens,经注意力融合后解码为自由 3D 位置的高斯,并用几何监督稳定训练;推理时调压缩率即可权衡质量与效率。在无真实位姿/内参设置下,它在 DL3DV、RealEstate10K 达到 SOTA,约少用 6 倍高斯并较最佳 pose-free 基线提升 2.1/1.2 dB PSNR,且可零样本泛化到 Mip-NeRF360 和 ScanNet++。

InstantRetouch: Efficient and High-Fidelity Instruction-Guided Image Retouching with Bilateral Space Figure 1
2026-06-04cs.CV

InstantRetouch: Efficient and High-Fidelity Instruction-Guided Image Retouching with Bilateral Space

Jiarui Wu, Yujin Wang, Ruikang Li, Fan Zhang, Mingde Yao, Tianfan Xue

Shanghai AI Laboratory, 2 CUHK MMLab, 3 CPII under InnoHK

2026-06-04视觉感知

本文针对扩散式指令修图易改动内容且推理慢的问题,主张将修图限制在与内容解耦的双边空间中:模型一次预测低分辨率仿射双边网格,经引导图切片后作用于原图,并用VSD、提示对齐和渐进蒸馏吸收扩散先验。在新建 iRetouch 基准上,方法相较 FLUX、Qwen、Gemini 等减少内容漂移,保持相近指令跟随能力,同时延迟提升约 70–800 倍。

MaCo-GAN: Manifold-Contrastive Adversarial Learning for Single Image Super-Resolution Figure 1
2026-06-04cs.CV

MaCo-GAN: Manifold-Contrastive Adversarial Learning for Single Image Super-Resolution

Daeyoung Han, Seongmin Hwang, Moongu Jeon

Department of Electrical Engineering and Computer Science, Gwangju Institute of Science and Technology, Gwangju, Republic of Korea

2026-06-04视觉感知生成模型

针对感知型单图超分中传统 GAN 判别器只看整体自然度、易产生幻觉伪影和训练不稳的问题,MaCo-GAN 将对抗损失改为监督式流形对比目标,并用可控假样本合成器生成保持低分辨率对应的正负样本,引导生成器靠近低失真解、远离高失真解。实验显示,在多个基准上替换基线对抗项即可改善感知—失真权衡,消融也支持合成样本与对比博弈的作用。

UniCAD: A Unified Benchmark and Universal Model for Multi-Modal Multi-Task CAD Figure 1
2026-06-04cs.CV

UniCAD: A Unified Benchmark and Universal Model for Multi-Modal Multi-Task CAD

Jingyuan Chen, Sheng Jin, Haopeng Sun, Wentao Liu, Chen Qian

2026-06-04数据集/基准

针对CAD研究长期按单一模态或单一任务割裂、缺少统一评测的问题,UniCAD构建覆盖文本、图像/草图、点云到CAD及CAD问答的多模态多任务基准,并提出UniCAD-MLLM,用模态专属编码器映射到共享几何-语义空间,生成可执行可编辑的Python/CadQuery脚本。实验称其在UniCAD和Fusion360上全面优于任务专用与多任务基线,但具体增益可能同时来自统一数据与模型规模。

Anchor3R: Streaming 3D Reconstruction with Transient Anchors for Long-Horizon Visual Mapping Figure 1
2026-06-04cs.CV

Anchor3R: Streaming 3D Reconstruction with Transient Anchors for Long-Horizon Visual Mapping

Peilin Tao, Chong Cheng, Yuansen Du, Caiwei Song, Zhengqing Chen, Xiaoyang Guo, Wei Yin, Weiqiang Ren, Qian Zhang, Hainan Cui, Shuhan Shen

2026-06-04三维

面向长时程在线视觉建图,现有前馈式流式重建常被首帧或持久记忆的固定坐标系束缚,导致注意力偏置与漂移累积。Anchor3R 的核心是把当前帧作为临时锚点,预测窗口相对位姿和局部点图,并用仅缓存图像状态的 pose-query Transformer 生成相对测量,再通过运动图、回环重插入与运动平均做全局对齐。实验覆盖室内、室外、驾驶和 RGB-D 场景,报告其在长序列位姿精度和稠密重建质量上优于流式基线,并可在有界显存下运行。

MetaPoint: Unlocking Precise Spatial Control in Agentic Visual Generation Figure 1
2026-06-04cs.CV

MetaPoint: Unlocking Precise Spatial Control in Agentic Visual Generation

Dewei Zhou, Xinyu Huang, Xun Wang, Ji Xie, Yabo Zhang, Liang Li, Kunchang Li, Zongxin Yang, Yi Yang

2026-06-04规划控制

本文针对统一多模态生成模型难以把文本中的数值坐标精确映射到图像画布的问题,提出 MetaPoint:用一个带连续二维位置编码的特殊 <mp> token 复用模型原生位置编码,实现无需改架构的像素级点/框/布局控制,并由 VLM 规划器把高层需求转为组合式空间指令。实验在 COCO-MIG、T2I-CoReBench、ImgEdit 上显著优于既有方法,mIoU 从 59.23% 提升到 77.29%,且可扩展到 30 个物体和多对象编辑。

Handwriting Extraction and Analysis of Signature Lists in Swiss Popular Initiatives Figure 1
2026-06-04cs.CV

Handwriting Extraction and Analysis of Signature Lists in Swiss Popular Initiatives

Marco Peer, Thomas Gorges, Mathias Seuret, Vincent Christlein, Andreas Fischer

AIBEX Group, University of Fribourg, Pattern Recognition Lab, FAU Erlangen-Nürnberg

2026-06-04视觉感知

针对瑞士公民倡议签名表仍依赖人工核验、重复签名排查成本高的问题,论文构建了从模板匹配/行分割到OCR与书写者检索的文档分析流程。核心洞察是短姓名、地址等离词表手写内容使通用OCR不可靠,最佳名字识别CER仍为29.6%;相比之下,基于笔迹相似性的书写者检索更适合作为辅助筛查工具,mAP达50.6%、Top-10准确率86.6%。

CIPER: A Unified Framework for Cross-view Image-retrieval and Pose-estimation Figure 1
2026-06-04cs.CV

CIPER: A Unified Framework for Cross-view Image-retrieval and Pose-estimation

Yurim Jeon, Dongseong Seo, Seung-Woo Seo

2026-06-04视觉感知三维

CIPER针对跨视角地理定位中“检索范围大但精度受限、位姿估计精但搜索窄”的割裂问题,将城市级航拍图检索与3-DoF位姿回归统一到同一Transformer框架;通过共享编码器中的任务 token 分离全局检索与空间线索,并用双向交叉注意力解码器缓解地面/空中视角域差异。其在VIGOR、KITTI和Ford Multi-AV上表现出有竞争力的检索与定位精度,尤其在视野受限和任意朝向场景更稳健。

M$^3$Eval: Multi-Modal Memory Evaluation through Cognitively-Grounded Video Tasks Figure 1
2026-06-04cs.CV

M$^3$Eval: Multi-Modal Memory Evaluation through Cognitively-Grounded Video Tasks

Jie Huang, Ruixun Liu, Sirui Sun, Xinyi Yang, Yin Li, Yixin Zhu, Yiwu Zhong

School of Intelligence Science and Technology, Peking University, State Key Laboratory of General Artificial Intelligence, Peking University, Yuanpei College, Peking University, Institute for Artificial Intelligence, Peking University, School of Psychological and Cognitive Sciences, Peking University, University of Wisconsin-Madison

2026-06-04视觉感知数据集/基准

长视频多模态模型虽有更长上下文,但现有基准多测感知/推理,难以隔离“记住什么、保真度和抗干扰”。M³Eval借鉴认知心理学,把分心注意、记忆干扰、交错事件组织和N-Back符号记忆设计成受控视频问答。实验显示,多种模型在并行视频中表征混淆,时间来源定位弱于空间,干扰模式不同于人类,符号记忆和过滤无关信息能力仍明显不足。

Multi-Camera AR Guidance System for Surgical Instrument Handling and Assembly: Investigating Workload and Efficiency Figure 1
2026-06-04cs.CV

Multi-Camera AR Guidance System for Surgical Instrument Handling and Assembly: Investigating Workload and Efficiency

Shiyu Li, Julian Kreimeier, Hannah Schieber, Dirk Müller, Bernhard Kainz, Rüdiger von Eisenhart-Rothe, Daniel Roth

2026-06-04视觉感知

针对手术中巡回/器械护士面对陌生、复杂器械时认知负荷高、纸质说明易造成中断的问题,论文提出无需标记的多相机6D位姿估计驱动AR头显指导系统,用合成数据训练并通过已知器械实现动态标定,叠加取放提示与装配动画。技术评估优于CosyPose;29名护士模拟膝关节置换实验中,相比纸质手册任务时间减少21.3%(4.76分钟)、主观负荷降低,错误率相近,收益主要体现在经验较少者。

Food-R1: A Unified Multi-Task Food Vision-Language Model with Reinforcement Learning Figure 1
2026-06-04cs.CV

Food-R1: A Unified Multi-Task Food Vision-Language Model with Reinforcement Learning

Yu Zhu, Yongkang Li, Wenjie Zhu, Haoyi Jiang, Wenyu Liu, Wei Yang, Bin Li, Xinggang Wang

2026-06-04视觉语言视觉感知强化学习

针对食物图像中食材遮挡、烹饪差异导致的营养推理不稳定,以及高质量热量标注稀缺问题,Food-R1构建了含热量、饮食建议和CoT推理标注的CalorieBench-80K,并以多任务VLM结合CoT冷启动蒸馏与GRPO强化微调,支持热量估计、食材识别、食谱生成等任务。实验显示其在CalorieBench-80K及代表性食物基准上稳定优于强基线,但具体增益中数据扩充与强化学习的相对贡献仍需结合消融判断。

Plan, Watch, Recover: A Benchmark and Architectures for Proactive Procedural Assistance Figure 1
2026-06-04cs.CV

Plan, Watch, Recover: A Benchmark and Architectures for Proactive Procedural Assistance

Kaustav Kundu, Ritvik Shrivastava, Maxim Arap, Nanshu Wang, Xianhui Zhu, Quintin Fettes, Gautam Tiwari, Parth Suresh, Théo Moutakanni, Alejandro Castillejo Munoz, Allen Bolourchi, Pascale Fung, Pinar Donmez, Babak Damavandi, Anuj Kumar, Seungwhan Moon

2026-06-04数据集/基准

论文针对程序性任务中用户常偏离标准步骤、现有具身视频基准缺少偏离与恢复标注的问题,提出 PWR:发布含 OOP 恢复指导的 EgoProactive,并将五个数据集统一重标为 Pro²Bench,同时采用规划器与实时交互模型解耦的架构。实验显示,经后训练的 Llama-4 在六个数据集上显著优于多种闭源和开源 VLM,Oracle 计划下 G-Mean F1 可达 0.84,偏离恢复收益明显。

Scene-Centric Unsupervised Video Panoptic Segmentation Figure 1
2026-06-04cs.CV

Scene-Centric Unsupervised Video Panoptic Segmentation

Christoph Reich, Oliver Hahn, Nikita Araslanov, Laura Leal-Taixé, Christian Rupprecht, Daniel Cremers, Stefan Roth

University of Oxford, Instance Labeling, Semantic Labeling, Pseudo-Labels, to generate scene-centric panoptic video pseudo-labels and train a video panoptic segmentation model using a novel Video DropLoss., temporally consistent panoptic video pseudo-labels from, tion, and visual cues. Training on these pseudo-labels us-, strong label-efficient learning. With VideoCUPS, our eval-, source intensive [23]. Extending labeling efforts to the tem-, ited scalability and label quality [21, 114, 117]. Despite the, scalable annotation-free alternatives [41, 48, 93, 111]., bining semantic pseudo-labels from STEGO [42] and in-

2026-06-04视觉感知

针对视频全景分割依赖昂贵逐帧像素与实例标注的问题,论文提出无监督 VPS 设定和 VideoCUPS:仅用单目场景视频中的自监督视觉特征、深度与运动线索生成时序一致的全景伪标签,并用 Video DropLoss 训练模型。在 Cityscapes-VPS 上 STQ 达 22.2%,优于多种由无监督图像/视频方法组合的基线,并在 KITTI-STEP、Waymo、MOTS 上展示跨域与少标注学习潜力。

Geometry-Aware Distillation for Prompt Tuning Biomedical Vision-Language Models Figure 1
2026-06-04cs.CV

Geometry-Aware Distillation for Prompt Tuning Biomedical Vision-Language Models

Tran Dinh Tien, Zhiqiang Shen

Department of Machine Learning, Mohamed bin Zayed University of Artificial Intelligence

2026-06-04视觉语言视觉感知

针对生物医学 VLM 少样本提示调优中只强化真类、忽略疾病类别语义关系而导致边界不稳和过度自信的问题,论文提出 OGKD:用冻结文本原型构建类别相似图,重塑教师分布,并在全局图像 token 与标签引导的局部 patch token 上蒸馏几何信息。11 个医学数据集上,在 base-to-novel 与 few-shot 设置中较既有适配方法平均提升 1.7%–2.8%,同时降低风险覆盖曲线面积,显示更可靠的选择性预测。

Toward Multi-Domain and Long-Tailed Quantization via Feature Alignment and Scaling Figure 1
2026-06-04cs.LG

Toward Multi-Domain and Long-Tailed Quantization via Feature Alignment and Scaling

Chin-Yuan Yeh, Ting-An Chen, De-Nian Yang, Ming-Syan Chen

C. Y. Yeh is with the Graduate Institute of Communication Engineering, National Taiwan University, Taiwan, and with the Institute of Information Science, Academia Sinica, Taiwan., T. A. Chen is with the Graduate Institute of Electrical Engineering, National Taiwan University, Taiwan, and with the Institute of Information Science, Academia Sinica, Taiwan., D. N. Yang is with the Institute of Information Science and the Research Center for Information Technology Innovation, Academia Sinica, Taiwan.

2026-06-04视觉感知

这篇论文关注低比特量化在真实视觉感知数据中的两类失效:多域分布偏移和长尾类别会放大量化误差、损害少数类。作者提出 EmaQ,用 CDF 特征对齐、近似量化梯度和敏感度加权聚合稳定多域训练,并扩展 EmaQ-LT,通过类别方差缩放、均衡损失和置信度 logit 调整抑制多数类过度自信。实验覆盖 Office-31、Digits、CIFAR-LT 等,显示在低比特设置下较现有方法更稳健,但具体增益可能主要来自 scaling 与重加权机制。

BreastGPT: A Multimodal Large Language Model for the Full Spectrum of Breast Cancer Clinical Routine Figure 1
2026-06-04cs.CV

BreastGPT: A Multimodal Large Language Model for the Full Spectrum of Breast Cancer Clinical Routine

Yang Liu, Jiajin Zhang, Danyang Tu, Yaojun Hu, Jiao Qu, Jiuyu Zhang, Yu Shi, Wei Fang, Shi Gu, Ling Zhang, Yingda Xia

2026-06-04视觉语言

该文针对乳腺癌临床流程中筛查、诊断、治疗规划依赖不同影像且现有医疗 MLLM 多停留在单模态/单任务的问题,构建了覆盖 5 种模态、17 个子数据集和 136 类任务的 BreastStage,并提出带双分支视觉编码器与概念保留 token 压缩的 BreastGPT,以统一处理常规放射影像和千兆像素病理切片;在 BreastStage-Bench 上取得 75.66% 闭集准确率和 89.92% 开放题得分,显著超过通用及医疗 MLLM,但部分收益可能主要来自 workflow-aligned 数据规模。

CDPM-Align: Multi-Scale Guidance-Aligned Diffusion Pretraining for Robust Few-Shot Anatomical Landmark Detection Figure 1
2026-06-04cs.CV

CDPM-Align: Multi-Scale Guidance-Aligned Diffusion Pretraining for Robust Few-Shot Anatomical Landmark Detection

Roberto Di Via, Irina Voiculescu, Francesca Odone, Vito Paolo Pastore

2026-06-04视觉感知生成模型安全鲁棒

面向医学 X 光少样本解剖标志点检测,论文关注临床部署中仅有坐标精度不足、还需热图不确定性集中和鲁棒性的问题。CDPM-Align 用数据集索引条件化扩散预训练,并将 classifier-free guidance 的条件/无条件特征差作为结构信号,在多尺度、跨噪声步对齐其方向一致性,再用 10/25 张标注图微调。三项公开小规模基准上,相比监督、SSL 和既有方法在定位精度、ERE 不确定性与鲁棒性上均有一致改进。

Hierarchical Space Partition for Surface Reconstruction Figure 1
2026-06-04cs.CV

Hierarchical Space Partition for Surface Reconstruction

Minjie Tang, Xiangfei Li

Huazhong University of Science and Technology

2026-06-04三维

面向 LiDAR/MVS 点云中遮挡和视距限制导致的缺失区域,本文改进平面组装式表面重建:按可见性将平面分为高可见、弱可见和由结构分析恢复的不可见平面,并赋予不同层级与生长速度进行层次空间划分,再用 min-cut 判定内外生成水密网格。实验在多类公开数据上显示其能减少冗余划分、保持模型紧凑,并更好补全局部缺失细节。

HD-DinoMoE: A Class-Aware Hierarchical Dual Mixture-of-Experts Network for Scleral Anomaly Segmentation in Complex Acquisition Scenarios Figure 1
2026-06-04cs.CV

HD-DinoMoE: A Class-Aware Hierarchical Dual Mixture-of-Experts Network for Scleral Anomaly Segmentation in Complex Acquisition Scenarios

Yinxiang Yu, Maoxiang Chu, Qi Niu, Guanghu Liu, Wei Xu, Haotian Wang, Zhi Chen, Yutian Zhu, Yuelong Fan, Guanghao Liao

2026-06-04视觉感知

针对中医目诊中巩膜血管、色斑与血斑等异常依赖主观判断、且临床/移动采集存在域差异和高光干扰的问题,论文提出HD-DinoMoE:用双流DINOv3特征融合、类别感知MoE解码、冻结路由训练及PCP/CA-ASW损失提升多标签像素分割,并构建ML-SASD数据集。在Mix设置下取得72.11% mean Dice、58.44% mean IoU,并在SBVPI血管子集上表现出一定泛化能力。

DiverAge: Reliable Pluralistic Face Aging with Cross-Age Identity Relation Guidance Figure 1
2026-06-04cs.CV

DiverAge: Reliable Pluralistic Face Aging with Cross-Age Identity Relation Guidance

Yueying Zou, Peipei Li, Qianrui Teng, Dianyan Xu, Zekun Li

Zou, Peipei Li, Qianrui Teng, and Dianyan Xu are with the School of Artificial Intelligence, Beijing University of Posts

2026-06-04视觉感知

本文针对人脸老化生成中“多样但不成序”或“成序但单一”的矛盾,提出 DiverAge 将老化建模为兼顾同龄候选多样性与跨年龄序列可靠性的轨迹生成问题。其核心是在扩散自编码框架中用随机解码保留外观变化,并以真实同身份跨龄相似度构建 CIS 先验,通过无需训练参数的 CARR 在采样时约束身份漂移。实验显示该方法提升序列级年龄顺序一致性,同时基本维持身份、年龄准确性、图像质量和多样性。

MAOAM: Unified Object and Material Selection with Vision-Language Models Figure 1
2026-06-04cs.CV

MAOAM: Unified Object and Material Selection with Vision-Language Models

Jaden Park, Valentin Deschaintre, Jason Kuen, Kangning Liu, Iliyan Georgiev, Krishna Kumar Singh, Yong Jae Lee, Michael Fischer

University of Wisconsin-Madison, University of Wisconsin-Madison USA

2026-06-04视觉语言视觉感知

MAOAM针对交互式编辑中对象选择与材质选择割裂、且文本/点击模态难以统一的问题,提出用VLM理解选择意图并由分割头输出像素级掩码的统一框架。其关键在于构建真实与合成材质掩码,并用VLM生成细粒度材质描述与VQA辅助训练。实验显示其在对象、材质及多种交互场景下获得更连贯准确的选择,且文本+点击在推理时出现额外增益。

Recent Advances and Trends in Learning-based 3D Representations Figure 1
2026-06-04cs.CV

Recent Advances and Trends in Learning-based 3D Representations

Adrien Schockaert, Hamid Laga, Hazem Wannous, Vincent Magnier, Guillaume Dufaye, Jean-françois Witz

2026-06-04三维

本文动机是三维重建、渲染与机器人/自动驾驶等应用中,表示形式直接决定效率、可微性、可编辑性和下游兼容性。核心洞察是把点云、网格、体素、SDF/NeRF与3D Gaussian Splatting等统一为可查询函数框架,按显式/隐式、表面/体积、离散/连续梳理取舍。主要结果是给出面向学习式3D表示的分类图谱、应用关联与开放挑战;文中未充分说明新的实证增益。

IRIS-GAN: Staged Specialist Detection of Deepfake Faces Figure 1
2026-06-04cs.CV

IRIS-GAN: Staged Specialist Detection of Deepfake Faces

Jaume M. Trenchs, Veronica Sanz

2026-06-04视觉感知生成模型

针对深伪人脸检测在未见生成器上易失效的问题,本文将任务限定为GAN人脸取证,而非通用合成图检测,并提出按ProGAN到StyleGAN/EG3D等逐步引入、同时保留旧生成器的阶段式专家训练。结果显示,相比一次性二分类训练,该策略改善跨GAN迁移,最终在所测GAN家族上伪造检出率超过99%,外部真实人脸准确率98.9%;Grad-CAM还表明响应模式具有生成器相关性,但扩散模型测试显示其适用域仍有限。

MusaCoder: Native GPU Kernel Generation with Full-Stack Training on Moore Threads GPU Figure 1
2026-06-04cs.CV

MusaCoder: Native GPU Kernel Generation with Full-Stack Training on Moore Threads GPU

Kun Cheng, Songshuo Lu, Sicong Liao, Tankun Li, Yafei Zhang, Dong Yang, Qiheng Lv, Hua Wang, Zhi Chen, Yaohua Tang

2026-06-04视觉感知

面向新模型中大量长尾算子融合带来的手写 GPU kernel 成本,MusaCoder 将原生 CUDA/MUSA kernel 生成视为可执行验证的代码对齐问题。其核心在于渐进式内核数据合成、保留多样性的 RFT,以及 MooreEval 驱动的多轮 RL,并用 PrimeEcho、BDR、MirrorPop 缓解稀疏奖励、作弊和离策略漂移。在 KernelBench 与 MUSA 迁移版上,9B 已接近或超过闭源前沿模型,27B 刷新正确率与速度表现,但增益中数据与 scaling 占比仍未充分说明。

Drift-Augmented Scoring: Text-Derived Noise Robustness for Zero-Shot Audio-Language Classification Figure 1
2026-06-04cs.SD

Drift-Augmented Scoring: Text-Derived Noise Robustness for Zero-Shot Audio-Language Classification

Tu Vo, Sheir Zaheer, Chan Y. Park

2026-06-04安全鲁棒

针对 CLAP 等音频-语言模型在噪声下零样本分类显著退化的问题,论文提出 DAS:用噪声短语在文本编码空间中为每个类别预先估计“漂移方向”,推理时在原余弦分数上加入类条件漂移奖励,不改音频嵌入、无需梯度或测试批。基于 LAION CLAP,在 UrbanSound8K 和 FSD50K 多个 SNR 设置下均优于并行方法,分别提升约 2.60–5.75 个准确率点和 1.50–1.74 mAP。

3D Temporal Analysis for Autism Spectrum Disorder Screening During Attention Tasks Figure 1
2026-06-04cs.CV

3D Temporal Analysis for Autism Spectrum Disorder Screening During Attention Tasks

Inam Qadir, Elizabeth B Varghese, Dena Al-Thani, Marwa Qaraqe

College of Science and Engineering, Hamad Bin Khalifa University, Qatar Foundation, Doha, Qatar

2026-06-04三维

针对学龄儿童 ASD 筛查依赖主观量表且 2D 视频难以刻画空间位移的问题,论文用 DECA 提取含 Tx/Ty/Tz 的 3D 头姿与姿态解耦的面部表情,并用 LSTM/GRU建模 VR-CPT 注意任务中的时序行为。在 39 名儿童数据上,GRU 的 3D 头姿达 83.9%、3D 表情达 81.4%,PCA 后多模态融合最高 84.6%,较 2D 基线有约 7.5–10.7 个百分点提升。

OA-CutMix: Correcting the Label Bias of CutMix Figure 1
2026-06-04cs.CV

OA-CutMix: Correcting the Label Bias of CutMix

Tobias Christian Nauen, Stanislav Frolov, Federico Raue, Brian B. Moser, Andreas Dengel

2026-06-04视觉感知

论文指出 CutMix 用裁剪面积分配软标签会把背景也当作语义贡献,导致约 21.5% 的标签偏差和“幽灵标签”,小目标尤甚。OA-CutMix 保持图像混合不变,利用离线 SAM3 分割掩码按可见物体像素重算标签权重。实验覆盖 4 种架构、6 个数据集和 10 余种混合增强,显示其精度稳定优于 CutMix,并以较低训练开销达到或超过动态混合方法。

Dream.exe: Can Video Generation Models Dream Executable Robot Manipulation? Figure 1
2026-06-04cs.CV

Dream.exe: Can Video Generation Models Dream Executable Robot Manipulation?

Rui Zhao, Kaiming Yang, Jifeng Zhu, Siyang Chen, Ziqi Wang, Weijia Wu, Kevin Qinghong Lin, Heng Wang, Mike Zheng Shou

2026-06-04机器人视觉感知

本文针对“视频生成模型是否真的学到物理世界模型”缺乏直接检验的问题,提出 Dream.exe:把给定场景和任务生成的操作视频,经深度估计、末端轨迹与夹爪时序恢复,转成机器人动作并在仿真中执行。其核心洞察是用任务成功率而非视觉分数衡量可执行性。对 8 个模型、101 个 RoboCasa365 任务的评测显示,部分通用视频模型已有可测成功率,但视觉质量与可执行性相关性弱,长程任务仍明显受限。

NoRA: Evaluating Grounded Reasonableness in Visual First-person Normative Action Reasoning Figure 1
2026-06-04cs.CV

NoRA: Evaluating Grounded Reasonableness in Visual First-person Normative Action Reasoning

Sichao Li, Sai Ma, Daniel Kilov, Secil Yanik Guyot, Zhuang Li, Seth Lazar

The University of Sydney, Australian National University, RMIT University, Johns Hopkins University

2026-06-04视觉感知

论文关注具身/社会场景中智能体不仅要“选对动作”,还要基于可见事实给出合乎规范的理由。NoRA 将第一人称视频规范行动推理改造成开放式候选动作生成,并用事实–理由–动作支持图评估 grounded reasonableness。基于 1420 段视频和 12 个多模态系统实验,模型虽能提出可行行动和部分场景事实,但难以覆盖完整合理行动空间并把动作与正确局部依据绑定。

Fast Cubical Persistent Homology on 2D and 3D Images via Union-Find, Pruning, and Lookup Tables Figure 1
2026-06-04cs.CV

Fast Cubical Persistent Homology on 2D and 3D Images via Union-Find, Pruning, and Lookup Tables

Titouan Le Breton, Karol Szustakowski, Marie Piraud

Institute of AI for Health, Helmholtz Munich, Neuherberg, Germany

2026-06-04视觉感知三维

针对2D图像和3D体数据中立方复形持久同调计算耗时、占内存的问题,论文提出 Flash Cubical:利用对偶图上的并查集计算最高维持久性,先局部剪枝零持久与已分类单元,再用查表预计算局部信息。单线程基准显示其在V-filtration上相较 GUDHI 和 CubicalRipser 通常更快且更省内存,优势在3D真实体数据上最明显。

Crafting Your Evolving Dreams: Concept-Incremental Versatile Customization Figure 1
2026-06-04cs.CV

Crafting Your Evolving Dreams: Concept-Incremental Versatile Customization

Jiahua Dong, Wenqi Liang, Hongliu Li, Yang Cong, Duzhen Zhang, Hanbin Zhao, Henghui Ding, Yulun Zhang, Salman Khan, Fahad Shahbaz Khan

Hanbin Zhao is with the College of Computer Science and Technology, Zhejiang University, Hangzhou, China.

2026-06-04视觉感知

这篇论文针对个性化扩散模型默认概念集合静态的问题,提出概念增量的多用途定制设定 CIVC,并给出 CCDM:用属性解耦 LoRA 与相关性引导聚合保留旧概念特征、缓解灾难性遗忘,再用可控区域上下文合成减少多概念生成中的概念遗漏。实验显示其在文生图、文生视频、文生 3D 的单/多概念合成、编辑和风格迁移任务上优于现有基线。

A Pathology Foundation Model for Gastric Cancer with Real-World Validation Figure 1
2026-06-04cs.CV

A Pathology Foundation Model for Gastric Cancer with Real-World Validation

Ling Liang, Jiabo Ma, Zhengyu Zhang, Fengtao Zhou, Yingxue Xu, Yihui Wang, Cheng Jin, Zhengrui Guo, On Ki Tang, Zhijian Cen, Zhen Wang, Qi Xie, Chengyu Lu, Chenglong Zhao, Feifei Wang, Yu Cai, Hongyi Wang, Jing Zhang, Yaping Ye, Shijun Sun, Shenglei Li, Yu Wang, Zhenhui Li, Ronald Cheong Kin Chan, Xiuming Zhang, Zhe Wang, Hao Chen, Li Liang

Department of Computer Science and Engineering, The Hong Kong University of Science and Technology, Hong Kong SAR, China, Department of Pathology, Nanfang Hospital, Southern Medical University, Guangzhou, China, Department of Pathology, School of Basic Medical Sciences, Southern Medical University, Guangzhou, China, Guangdong Province Key Laboratory of Molecular Tumor Pathology, Guangzhou, China, Department of Anatomical and Cellular Pathology, The Chinese University of Hong Kong, Hong Kong SAR, China, Pathology Artificial Intelligence Development and Assessment Laboratory, State Key Laboratory of Translational Oncology, The Chinese University of Hong Kong, Hong Kong SAR, China, Department of Pathology, Shandong Provincial Qianfoshan Hospital, Jinan, China, Department of Electronic and Computer Engineering, The Hong Kong University of Science and Technology, Hong Kong SAR, China, Department of Pathology, The First Affiliated Hospital, School of Medicine, Zhejiang University, Hangzhou, China, Department of Pathology, Zhongshan People’s Hospital, Zhongshan, China, Department of Pathology, The First Affiliated Hospital of Zhengzhou University, Zhengzhou, China, Department of Pathology, School of Basic Medicine, Zhengzhou University, Zhengzhou, China

2026-06-04强化学习

针对泛癌病理基础模型在胃癌细粒度诊断、分子预测及真实临床验证上不足的问题,本文提出胃癌专用模型 GRACE:在大规模多中心 H&E 全切片数据上对 Virchow2 进行 LoRA 持续预训练,并用 ABMIL 做下游预测。其在 28 项任务和前瞻队列中优于多种泛癌 PFM,macro-AUC 达 0.9188;读片研究显示 AI 辅助将准确率由 82.0% 提升至 89.9%,并缩短诊断时间。

Z-FLoc: Zero-Shot Floorplan Localization via Geometric Primitives Figure 1
2026-06-04cs.CV

Z-FLoc: Zero-Shot Floorplan Localization via Geometric Primitives

Ayumi Umemura, Toshinori Kuwahara, Marc Pollefeys, Daniel Barath

2026-06-04视觉感知

本文针对室内相机定位中图像与平面图模态差大、学习方法需环境级重训的问题,提出零样本 floorplan localization。核心洞察是人造环境中的线与圆等几何基元可提供外观无关约束:从单目重建生成 BEV,提取基元并用最小求解器与鲁棒估计匹配平面图。实验显示其在模拟和真实未见环境中优于需目标域训练的学习式方法,并使用固定超参数。

Activation Steering of Video Generation Models via Reduced-Order Linear Optimal Control Figure 1
2026-06-04cs.LG

Activation Steering of Video Generation Models via Reduced-Order Linear Optimal Control

Jihoon Hong, Alice Chan, Qiyue Dai, Julian Skifstad, Glen Chou

Georgia Institute of Technology

2026-06-04视觉感知规划控制

针对文本到视频模型易生成裸露、暴力等不安全内容且传统微调/过滤易降质或被绕过的问题,论文将生成过程建模为动态系统,提出 LA-LQR:在由对比提示构造的低维激活子空间中估计局部线性动力学,并用 LQR 进行按层、按时间步的闭环最小扰动 steering。实验显示其在概念控制和视频安全基准上比基线更能降低不安全生成,同时较好保持提示一致性与视觉质量。

NextMotionQA: Benchmarking and Judging Human Motion Understanding with Vision-Language Models Figure 1
2026-06-04cs.CV

NextMotionQA: Benchmarking and Judging Human Motion Understanding with Vision-Language Models

Yong Cao, Chuqiao Li, Xianghui Xie, Gerard Pons-Moll, Andreas Geiger

University of Tübingen, Tübingen AI Center, Germany, Max Planck Institute for Informatics, Saarland Informatics Campus, Germany, When domain experts cannot agree on the labels, diversity, controllability, and sampling efficiency., target controllability at the body-part level via

2026-06-04视觉语言视觉感知数据集/基准

针对现有人体运动理解基准语义粗、难度不分层且标注歧义大的问题,本文提出 NextMotionQA:以多选问答、视频描述和细粒度纠错三类任务,交叉身体部位、方向、动作三条语义轴与三档难度,构建 1307 个专家验证样本。对 12 个 VLM 的评测显示,模型没有在所有任务上通吃,位移方向普遍最弱,难度升高会显著降分;将 VLM 用作 T2M 评审时,粗粒度与专家一致性较高 κ=0.70,但部位级细评几乎失效 κ=0.10。

Coarse-to-fine Hierarchical Architecture with Sequential Mamba for Brain Reconstruction Figure 1
2026-06-04cs.CV

Coarse-to-fine Hierarchical Architecture with Sequential Mamba for Brain Reconstruction

Hoang-Son Vo, Van-Hung Bui, Minh-Huy Mai-Duc, Tien-Dung Mai, Soo-Hyung Kim

2026-06-04三维

针对深度视觉表征与人类视觉皮层层级对应关系仍不清晰的问题,论文提出 CHASMBrain:先用双流 Mamba 分离 CLS 全局语义与 patch 局部空间信息预测去噪 ROI 活动,再以 Mamba-VAE 细化到体素级 fMRI。NSD 上 Pearson 达 0.429、MSE 0.261,优于 ridge、DINOv2 探针等基线;消融显示局部流更对应早期视觉区,全局流服务高阶语义,并具备一定跨被试迁移性。

Measuring Model Robustness via Fisher Information: Spectral Bounds, Theoretical Guarantees, and Practical Algorithms Figure 1
2026-06-04cs.LG

Measuring Model Robustness via Fisher Information: Spectral Bounds, Theoretical Guarantees, and Practical Algorithms

Chong Zhang, Xiang Li, Jia Wang, Qiufeng Wang, Xiaobo Jin

2026-06-04学习理论安全鲁棒

针对对抗鲁棒评测依赖具体攻击、成本高且解释性不足的问题,本文把输入空间 Fisher 信息矩阵的谱范数作为攻击无关的敏感度指标,并将其与输入 Jacobian 方差及 KL 局部几何联系起来。作者给出 VGG、ResNet、DenseNet、Transformer 等架构的谱界和理论排序,设计幂迭代与 Hutchinson 估计以支持白盒/黑盒计算;在 CIFAR、ImageNet 和医学图像实验中,该指标与对抗脆弱性呈强相关,但更适合作为诊断工具而非替代攻击评测。

Do Foundation Models See Biology? Evaluating Attention Coherence with Spatial Transcriptomics in Glioblastoma Figure 1
2026-06-04cs.CV

Do Foundation Models See Biology? Evaluating Attention Coherence with Spatial Transcriptomics in Glioblastoma

Dilakshan Srikanthan, Amoon Jamzad, Paul Wilson, Nooshin Maghsoodi, Robert Policelli, Gabor Fichtinger, John F. Rudan, Parvin Mousavi

2026-06-04视觉感知

本文关注病理基础模型的注意力图是否真能对应胶质母细胞瘤生物学,而不只是视觉上平滑或可解释。作者用空间转录组作为独立参照,评估5个病理基础模型和ResNet在abMIL分子预测中的高注意区域与87类转录特征的共定位。结果显示内部交叉验证与TCGA外部验证排名会反转,注意力更富集于通路级多基因程序而非单基因事件,且不同编码器关注的生物区室不同。

Physics-Informed Video Generation via Mixture-of-Experts Latent Alignment Figure 1
2026-06-04cs.CV

Physics-Informed Video Generation via Mixture-of-Experts Latent Alignment

Cong Wang, Hanxin Zhu, Jiayi Luo, Yonglin Tian, Xiaoqian Cheng, Peiyan Tu, Xin Jin, Long Chen, Zhibo Chen

2026-06-04视觉感知

针对现有视频生成模型画面逼真但运动与交互常违背物理规律的问题,PILA在冻结的flow-matching视频模型中加入轻量物理潜空间适配器:以可观测运动锚定物理属性代理场,并用提示标签路由到不同物理类别专家,通过残差约束修正向量场。作者在Wan 2.1训练并迁移到Wan 2.2,报告在VBench-2.0、VideoPhy-2和PhyGenBench上兼顾视觉质量与物理合理性达到SOTA。

StrokeTimer: Robust Representation Learning for Ischemic Stroke Onset-Time Estimation from Non-contrast CT Figure 1
2026-06-04cs.CV

StrokeTimer: Robust Representation Learning for Ischemic Stroke Onset-Time Estimation from Non-contrast CT

Weiru Wang, Susanne G.H. Olthuis, Elizaveta Lavrova, Robert J. van Oostenbrugge, Charles B.L.M. Majoie, Wim H. van Zwam, Ruisheng Su

2026-06-04安全鲁棒

针对急性缺血性卒中发病时间常不明确、NCCT早期征象细微且多中心数据存在扫描风格差异和长尾类别的问题,StrokeTimer用自监督语义-风格解耦学习获得较稳健的病灶相关表征,再以能量引导的原型对比均值漂移处理类不平衡。其在MR CLEAN两队列上将发病时间分为<4.5h、4.5–6h、>6h,取得macro AUC 0.69、macro F1 0.57,较最强基线提升近50%,解释图也指向灰白质模糊和低密度区等临床征象。

Data Efficient Complex Feature Fusion Network For Hyperspectral Image Classification Figure 1
2026-06-04cs.CV

Data Efficient Complex Feature Fusion Network For Hyperspectral Image Classification

Maitreya Shelare, Atharva Satam, Poonam Sonar, Sneha Burnase

2026-06-04视觉感知

针对高光谱分类中高维谱段带来的计算负担与实时部署困难,论文提出 DE-CFFN:用因子分析替代 PCA 做降维,并在实值/复值双分支 3D 卷积中逐层减半滤波器,再以复值 SE 融合空间、光谱与频域特征。在 Pavia University 和 Salinas 上精度基本接近原 CFFN,同时参数量最多降 72%、显存降 75%、推理延迟降 14%。

ReConFuse: Reconstruction-Error Guided Semantic Fusion for AI-Generated Video Detection Figure 1
2026-06-04cs.CV

ReConFuse: Reconstruction-Error Guided Semantic Fusion for AI-Generated Video Detection

Xiaojing Chen (1), Xinyu Lu (1), Changtao Miao (2), Yunfeng Diao (3) ((1) Anhui University, (2) Ant Group, (3) Hefei University of Technology)

2026-06-04视觉感知三维

针对 AI 生成视频日益逼真、传统检测难以同时兼顾空间伪迹、时间动态与跨生成器泛化的问题,ReConFuse 将预训练 WF-VAE 的逐帧重建误差作为取证线索,洞察真实与生成视频在重建先验下呈现不同误差模式,并与 XCLIP 语义 token 对齐融合,再用 Mamba 建模时间演化。文中称在多生成器和多评测设置下取得有效检测与较强泛化,但具体增益来源仍需结合消融细节判断。

Enhancing MedSAM with a Lightweight Box Predictor for Medical Image Segmentation Figure 1
2026-06-04cs.CV

Enhancing MedSAM with a Lightweight Box Predictor for Medical Image Segmentation

Amirhossein Movahedisefat, Amirreza Fateh, Mohammad Reza Mohammadi

School of Computer Engineering, Iran University of Science

2026-06-04视觉感知

针对 MedSAM 在医学图像中依赖精确提示、单点提示空间信息不足的问题,论文在其框架中加入仅约 1.6M 参数的轻量 Box Predictor,由一次点击结合局部图像嵌入预测粗边界框,再与点提示共同引导分割,并采用先独立训练再接入 MedSAM 的两阶段流程。其在 CT、MRI、超声等四个数据集上验证,Dice 达到 BUSI 0.89、FLARE22 0.93、BRISC 0.88、LungSegDB 0.98,显示提示鲁棒性和跨模态泛化有所提升。

Benchmarking Living-Screen-Native GUI Agents on Short-Video Platforms Figure 1
2026-06-04cs.CV

Benchmarking Living-Screen-Native GUI Agents on Short-Video Platforms

Jiashu Yao, Heyan Huang, Daiqing Wu, Wangke Chen, Huaxi Ai, Haoyu Wen, Zeming Liu, Yuhang Guo

Beijing Institute of Technology 2 Tsinghua University 3 Beihang University

2026-06-04视觉感知数据集/基准

现有 GUI Agent 基准多默认屏幕在动作间静止,难以评估短视频这类持续播放界面中的“看什么、看多久”。论文提出 Living-Screen-Native GUI Agent 设定与 LivingScreen 基准,用浏览器复刻短视频平台、三级任务和兼顾准确率/信息效率的指标评测。实验显示前沿 MLLM 均未达到人类成本—准确率权衡,主要失败来自过度或不足观察,提示观察控制是当前 GUI Agent 的关键短板。

A New Angle on Bones: Robust Pose Estimation in X-Ray and Ultrasound Figure 1
2026-06-04cs.CV

A New Angle on Bones: Robust Pose Estimation in X-Ray and Ultrasound

Ron Keuth, Christoph Großbröhmer, Franziska Halm, Miriam Johann, Anne-Nele Schröder, Ludger Tüshaus, Mattias P. Heinrich, Lasse Hansen

2026-06-04三维安全鲁棒

本文面向儿科骨折与髋关节发育不良中依赖人工量角、受超声噪声和离群点影响大的骨姿态估计问题,提出先由深度模型生成骨轴点候选,再用带假阳性抑制的鲁棒直线拟合(如 RANSAC、Hough)恢复轴线角度。其洞察是密集点候选比两点地标对局部误差更不敏感;在 X 光和超声三项任务上平均误差为 4.1°、5.4°、5.51°,处于临床观察者差异范围内并优于地标基线。

Graph-Guided Universum Learning in Generalized Eigenvalue Proximal SVMs for Alzheimer's Disease Classification Figure 1
2026-06-04cs.LG

Graph-Guided Universum Learning in Generalized Eigenvalue Proximal SVMs for Alzheimer's Disease Classification

Yogesh Kumar, Vrushank Ahire, Mudasir Ganaie

2026-06-04视觉感知

针对阿尔茨海默病结构 MRI 中标注少、MCI 作为 Universum 样本却被既有 GEPSVM 方法当作独立点处理的问题,论文将 MCI 样本用高斯相似度、最小生成树和多跳传播构图,并以图拉普拉斯正则替代独立 Universum 惩罚,形成 UG-GEPSVM 与更稳定的 IUG-GEPSVM。ADNI 上 ICA/PCA 特征和多噪声实验显示其优于 GEPSVM 及 Universum 基线,UG-GEPSVM 平均 AUC 达 88.07%,且抗噪声较稳。

MeshWeaver: Sparse-Voxel-Guided Surface Weaving for Autoregressive Mesh Generation Figure 1
2026-06-04cs.CV

MeshWeaver: Sparse-Voxel-Guided Surface Weaving for Autoregressive Mesh Generation

Jiale Xu, Wang Zhao, Ying Shan

ARC Lab, Tencent PCG

2026-06-04视觉感知

针对自回归网格生成中坐标级 token 序列过长、缺少局部几何引导而难以扩展到高面数并保持细节的问题,MeshWeaver 将生成视为已知表面上的“编织/重拓扑”,改为逐顶点预测,并用多层稀疏体素编码器在表示、交叉注意力和结构约束三处注入几何上下文。实验显示其 token 压缩率达 18%,可生成最高 16K 面网格,并提升几何保真度。

Real-Time Automatic License Plate Recognition Using YOLOv8, SORT Tracking, and Temporal Data Interpolation Figure 1
2026-06-04cs.CV

Real-Time Automatic License Plate Recognition Using YOLOv8, SORT Tracking, and Temporal Data Interpolation

Mirza Muhammad Mobeen

2026-06-04视觉感知

面向真实交通监控中光照、遮挡、高速运动导致的车牌检测断轨和 OCR 不稳,本文构建 YOLOv8 车辆/车牌检测、SORT 跟踪、EasyOCR 与车牌语法校正的端到端 ALPR 流水线,并加入离线线性时序框插值补全缺失轨迹。在 3599 帧视频上跟踪 45 辆车,原始检测 2247 个,经插值补入 2289 个位置、坐标数提升 101.9%;但平均 OCR 置信度仅 0.414,识别鲁棒性仍有限。

Instance-Level Post Hoc Uncertainty Quantification in Object Detection Figure 1
2026-06-04cs.CV

Instance-Level Post Hoc Uncertainty Quantification in Object Detection

Chongzhe Zhang, Zifan Zeng, Qunli Zhang, Feng Liu, Zheng Hu

2026-06-04视觉感知安全鲁棒

面向自动驾驶目标检测中已部署模型难以重训、却需要逐框量化边界框认知不确定性的场景,论文提出 MC-GLM:在 Laplace 后验下用固定次数的 Monte Carlo 权重扰动和有限差分方向导数近似 GLM 的雅可比协方差,避免按输出实例多次反传,样本数与检测框数量无关且可并行。在 nuScenes 上结合 CenterPoint 的实验显示,该方法能生成质量较好的实例级不确定性估计。

MeshFlow: Efficient Artistic Mesh Generation via MeshVAE and Flow-based Diffusion Transformer Figure 1
2026-06-04cs.CV

MeshFlow: Efficient Artistic Mesh Generation via MeshVAE and Flow-based Diffusion Transformer

Weiyu Li, Antoine Toisoul, Tom Monnier, Roman Shapovalov, Rakesh Ranjan, Ping Tan, Andrea Vedaldi

Hong Kong University of Science and Technology

2026-06-04生成模型

面向游戏/VFX 等场景中可编辑、高质量网格生成,论文针对自回归网格模型推理随规模二次增长、坐标量化带来塌点和重叠的问题,提出 MeshVAE 将顶点位置、法向与连接关系统一压缩到连续潜空间,并用对比学习表示边连接,再以 Rectified Flow Transformer 并行生成。实验称潜表示较朴素 tokenizer 少 72×、较高效方案少 16×,生成速度比最快 AR 方法快 18×且指标保持领先。

Beyond Symmetric Alignment: Spectral Diagnostics of Modality Imbalance in Vision-Language Models in the Medical Domain Figure 1
2026-06-04cs.CV

Beyond Symmetric Alignment: Spectral Diagnostics of Modality Imbalance in Vision-Language Models in the Medical Domain

Alessandro Gambetti, Qiwei Han, Cláudia Soares, Hong Shen

NOVA School of Science and Technology, Nova School of Business and Economics, Carnegie Mellon University, NOVA School of Science and Technology Lisbon Portugal, Nova School of Business and Economics Lisbon Portugal, Carnegie Mellon University Pittsburgh Pennsylvania USA

2026-06-04视觉语言视觉感知

针对医学图文中 VLM 对齐失效却难以判断“哪一模态拖后腿”的问题,论文提出非对称的 Spectral Alignment Score,将两模态投影到锚模态主特征谱并比较方向性可恢复性。对 15 个 VLM、自然与医学数据集的评测显示,医学图像保留的结构信息明显多于临床报告,传统对称指标无法揭示该不平衡;SAS 在医学域与零标签检索表现相关性最强,可作为部署前诊断工具。

COMBINER: Composed Image Retrieval Guided by Attribute-based Neighbor Relations Figure 1
2026-06-04cs.CV

COMBINER: Composed Image Retrieval Guided by Attribute-based Neighbor Relations

Zixu Li, Yupeng Hu, Zhiwei Chen, Haokun Wen, Xuemeng Song, Liqiang Nie

2026-06-04视觉感知三维

针对组合图像检索中“视觉相似但属性无关”样本会被传统邻域关系误拉近的问题,COMBINER用属性原型来度量跨模态相似性:先自适应解耦图文属性语义,再构建统一跨模态原型并进行组合,最后联合建模成对关系与基于属性的邻域关系。三项CIR基准实验显示其在各指标上优于已有方法,消融验证了各模块有效性。

4D Reconstruction from Sparse Dynamic Cameras Figure 1
2026-06-04cs.CV

4D Reconstruction from Sparse Dynamic Cameras

Kazuki Ozeki, Shun Kenney, Yuto Shibata, Eisuke Takeuchi, Takuya Narihira, Kazumi Fukuda, Ryosuke Sawata, Yuki Mitsufuji, Yoshimitsu Aoki

Keio University

2026-06-04三维

针对单目动态相机4D重建存在深度歧义、密集固定相机成本高的问题,本文研究少量独立运动相机的实用采集设置。核心做法是将跨相机特征匹配与单相机点跟踪结合,初始化时空一致的3D轨迹,并加入抗噪深度顺序约束和时空多样采样;同时发布LetCamsGo基准。实验显示其在动态区域重建质量和时间一致性上优于朴素MoSca扩展及部分固定多相机基线。

Fine-grained Fragment Retrieval in Multi-modal Long-form Dialogues Figure 1
2026-06-04cs.CL

Fine-grained Fragment Retrieval in Multi-modal Long-form Dialogues

Hanbo Bi, Zhiqiang Yuan, Chongyang Li, Qiwei Yan, Zexi Jia, Jiapei Zhang, Xiaoyue Duan, Yingchao Feng, Jinchao Zhang, Jie Zhou

2026-06-04视觉感知

针对长篇图文交织对话中用户往往需要找回完整话题片段而非单条消息的问题,论文提出细粒度片段检索任务,并区分单对话与语料库两种场景;方法上用强化学习训练的F²RVLM提升片段一致性,再以FEM离线建索引、F²RVLM在线精排组成FFRS。作者构建MLDR和微信真实测试集,实验显示在两类设置下均优于现有嵌入模型与多模态大模型基线。

Impostor: An Agent-Curated Benchmark for Realistic AIGC Manipulation Localization Figure 1
2026-06-04cs.CV

Impostor: An Agent-Curated Benchmark for Realistic AIGC Manipulation Localization

Zhenliang Li (1), Yutao Hu (1), Qixiong Wang (2), Wenpeng Du (1), Hongxiang Jiang (2), Jiasong Wu (1), Xiaolong Jiang (2), Jungong Han (3) ((1) Southeast University, (2) Xiaohongshu Inc., (3) Tsinghua University)

Southeast University, Xiaohongshu Inc., Tsinghua University, trollability of localized image manipulation, raising new challenges for image, Recent advances in generative image editing models (Labs et al., 2025, localized manipulations increasingly controllable and semantically consistent with the surrounding

2026-06-04机器人数据集/基准

现代生成式局部编辑让篡改区域在语义上更自然,削弱了现有取证定位基准的区分度。本文用闭环 CraftAgent 构建 10 万张 Impostor 数据集,覆盖 7 个 AIGC 编辑器、三类及多区域篡改,并提出结合局部相位线索与语义—取证一致性监督的 PANet。实验显示该基准显著压低 LVLM 和专用 IMDL 方法表现,而 PANet 在 Impostor 及多个公开集上取得更好定位与泛化结果。

Optical-Guided Neural Collapse for SAR Few-Shot Class Incremental Learning Figure 1
2026-06-04cs.CV

Optical-Guided Neural Collapse for SAR Few-Shot Class Incremental Learning

Fan Zhang, Sijin Zheng, Fei Ma, Qiang Yin, Yongsheng Zhou, Fei Gao, Xian Sun

Sijin Zheng, Fei Ma, Qiang Yin, Yongsheng Zhou are with the School of, Information Science and Technology, Beijing University of Chemical, using only small amounts of labeled data. This gives rise to the, Fan Zhang is with the School of Information Science and Technology and, the Interdisciplinary Research Center for Artificial Intelligence, Beijing, University of Chemical Technology, Beijing 100029, China (e-mail:, Fei Gao is with the Beihang University, Beijing 100191, China (e-mail:, Xian Sun is with the Aerospace Information Research Institute, Chinese, converge to their respective class centers, which in turn collapse, subspace centers.

2026-06-04视觉感知

本文针对SAR目标少样本类增量学习中方位敏感导致类内变化大、类间混淆和灾难性遗忘的问题,提出用数据更充足的光学ATR模型构造正交特征子空间,并通过主角约束、固定simplex-ETF分类器和中心对齐将其几何结构迁移到SAR特征,诱导神经坍缩。24类光学/SAR基准的基类加7次增量实验显示,方法较NC-FSCIL、PriViLege、WaRP、FACT取得最高最终精度,且类内紧凑性和类间分离性指标更接近ETF结构。

Echo-Infinity: Learning Evolving Memory for Real-Time Infinite Video Generation Figure 1
2026-06-04cs.MM

Echo-Infinity: Learning Evolving Memory for Real-Time Infinite Video Generation

Yuxuan Bian, Zeyue Xue, Songchun Zhang, Shiyi Zhang, Weiyang Jin, Yaowei Li, Junhao Zhuang, Haoran Li, Jie Huang, Haoyang Huang, Nan Duan, Qiang Xu

The Chinese University of Hong Kong, 2Joy Future Academy, JD, 3The Hong Kong University of, Science and Technology, 4Tsinghua University, 5The University of Hong Kong, Peking University, 7University of Science and Technology of China, Project Page: https://echo-team-joy-future-academy-jd.github.io/Echo-Infinity/, Code: https://github.com/Echo-Team-Joy-Future-Academy-JD/Echo-Infinity

2026-06-04视觉感知

面向自回归视频生成在长时滚动中 KV 缓存无限增长、RoPE 位置越界导致质量崩溃的问题,Echo-Infinity 将被移出局部窗口的历史用可学习 Memory Queries 通过注意力与门控持续压缩,并在训练/推理统一使用有界相对 RoPE。实验显示其在长短视频与交互生成上达到 SOTA,并在单 H100 上实现 24 小时、超 130 万帧实时生成,开销约 10.6%。

SFMambaNet: Spectral-Frequency Enhanced Selective State Space Model for Correspondence Pruning Figure 1
2026-06-04cs.CV

SFMambaNet: Spectral-Frequency Enhanced Selective State Space Model for Correspondence Pruning

Zhihua Wang, Yanping Li, Yizhang Liu

pruning network. Our method is collaboratively composed of, ods on several challenging tasks. The code is available at, Zhihua Wang is with the School of Optical-Electrical and Computer, Engineering, University of Shanghai for Science and Technology, Shanghai, Yanping Li is with the Institute of Artificial Intelligence, Shanghai Jiao, College, ence/College of Software, Fuzhou University, Fuzhou 350108, China (e-mail:

2026-06-04视觉感知

针对两视图匹配中外点多、GNN难捕捉细微几何一致性且Mamba隐状态易累积不一致特征的问题,SFMambaNet将内点视为低频几何信号、外点视为高频噪声,引入局部谱几何注意力LSGA和带频率门控的全局SIGM,在局部增强细粒度一致性、在全局抑制高频噪声传播;实验显示其在多项对应剪枝任务上超过现有方法。

IMPose: Interactive Multi-person Pose Estimation with Dynamic Correction Propagation Figure 1
2026-06-04cs.CV

IMPose: Interactive Multi-person Pose Estimation with Dynamic Correction Propagation

Haoyang Ge, Jian Ma, Ziwen Wang, Qihe Wang, Jianqi Fan, Hongzhi Yu, Xingyu Chen, Kun Li

2026-06-04三维

视频多人姿态标注成本高,现有工具难把少量人工修正稳定传播到遮挡、运动模糊和身份交错的长序列中。IMPose将问题建模为交互式校正传播,结合关键点级时序跟踪、实例级关键点感知嵌入与轨迹库,联合维护关键点连续性和跨帧身份一致性。实验显示其在低点击预算下仍保持精度效率权衡:3DPW约每1050帧27次点击,PoseTrack21约每轨迹3次点击,并用10名标注员10小时扩展出约18.8万人体实例和355万关键点。

Evaluating Reasoning Fidelity in Visual Text Generation Figure 1
2026-06-04cs.CV

Evaluating Reasoning Fidelity in Visual Text Generation

Jiajun Hong, Jiawei Zhou

Stony Brook University

2026-06-04视觉感知

这篇论文关注一个被现有视觉文本生成评测忽略的问题:T2I 模型生成的文字即使清晰可读,是否仍能忠实承载推理过程。作者设计分层评测,将长文本渲染、事实知识、长上下文理解和多步数学推理中的渲染错误、最终答案错误与中间步骤错误区分开,并辅以人工验证。结果显示,当前前沿与开源 T2I 模型常出现语义错误、逻辑不一致和错误中间步骤,显著弱于同任务文本 LLM,说明渲染质量提升并不等同于推理保真。

Adaptive Calibration for Fair and Performant Facial Recognition Figure 1
2026-06-04cs.CV

Adaptive Calibration for Fair and Performant Facial Recognition

Ryan Brown, Chris Russell

University of Oxford

2026-06-04视觉感知

针对人脸验证中“同一余弦相似度在不同嵌入区域对应不同匹配概率”导致全局阈值放大群体误差的问题,论文提出后处理式 Adaptive Calibration,将相似度与成对样本的局部嵌入位置一起映射为校准概率,可用逻辑/MLP/局部残差模型实现且不需人口属性标签。实验称其在多种预训练骨干和基准上同时提升准确性、公平校准与最差群体指标,避免以牺牲优势群体性能来换公平。

ChannelTok: Efficient Flexible-Length Vision Tokenization Figure 1
2026-06-04cs.CV

ChannelTok: Efficient Flexible-Length Vision Tokenization

Sukriti Paul, Arpit Bansal, Tom Goldstein

University of Maryland, College Park

2026-06-04视觉感知

本文针对现有可变长度视觉 tokenizer 依赖大模型骨干和多步生成式解码、推理成本高的问题,提出将潜变量的通道而非空间位置视为 token,并通过训练时随机保留前 k 个通道的 tail-dropping 促使通道形成由粗到细的语义排序。这样推理时只需改变保留通道数即可调节压缩率。在 ImageNet 上,ChannelTok 以 159M 参数取得 rFID 2.92,解码比次优方法快 8.6 倍、规模小 2.1 倍,并展示了可变 token 预算下的自回归生成能力。

Imagine Before You Draw: Visual Prompt Engineering for Image Generation Figure 1
2026-06-04cs.CV

Imagine Before You Draw: Visual Prompt Engineering for Image Generation

Liyu Jia, Fengda Zhang, Jiachun Pan, Kesen Zhao, Saining Zhang, Wang Lin, Weijia Wu, Yue Liao, Aojun Zhou, Hanwang Zhang

Nanyang Technological University, National University of Singapore, Zhejiang University, The Chinese University of Hong Kong

2026-06-04视觉感知

论文针对文本/类别到像素生成中语义条件与细节合成跨度过大的问题,提出 VPE:先自回归生成 SigLIP 2 视觉语义 token 作为“画前构图”,再据此生成图像 token,并用渐进训练缓解训练—推理不一致和损失尺度失衡。实验覆盖类别生成、文生图和编辑,显示其可加速收敛、提高质量上限;内置式 VPE 在编辑细节保持上明显优于外部两阶段方案,PSNR 26.76 对 19.92。

Radiomic Feature Selection Using Gradient Loss of Deep Neural Network for Lung Cancer Stage Detection Figure 1
2026-06-04cs.CV

Radiomic Feature Selection Using Gradient Loss of Deep Neural Network for Lung Cancer Stage Detection

Hina Shakir, Mohammad Mohatram, Javeed Hussain, Syed Rizwan Ali, Muhammad Irfan Memon

Department of Software Engineering, Bahria University, Karachi, Pakistan, Global College of Engineering and Technology, Muscat, Oman, Software Engineering & Business Incubation Center, Bahria University Karachi, Pakistan

2026-06-04视觉感知优化算法

针对放射组学特征高维、小样本且冗余易影响肺癌分期模型的问题,论文提出 GL-RFE:用神经网络损失对输入特征的梯度敏感度递归剔除低贡献特征,并以选出的 15 个 CT 放射组学特征训练 DNN 区分早期与晚期。NSCLC Radiomics 数据上测试准确率 90.22%、F1 为 90.16%,优于若干传统筛选和基线模型;但外部数据集验证文中未充分说明。

INTACT: Ego-Guided Typed Sparse Evidence Retrieval for Heterogeneous Collaborative Perception Figure 1
2026-06-04cs.CV

INTACT: Ego-Guided Typed Sparse Evidence Retrieval for Heterogeneous Collaborative Perception

Chen Li, Shengrong Yuan, Jialong Zuo, Xinzhong Zhu, Nong Sang, Changxin Gao

National Key Laboratory of Multispectral Information Intelligent Processing Technology, School of Artificial Intelligence and Automation, Huazhong University of Science and Technology, Zhejiang Normal University.

2026-06-04视觉感知

本文针对异构车端传感器、骨干和训练目标导致中间特征难以直接融合、且新增协作者需重新适配的问题,提出 INTACT:由自车发起带类型的稀疏证据查询,只在可疑目标或证据不足区域向协作者索取局部响应,并经稀疏路由与门控残差写回注入自车 BEV。实验显示其在 OPV2V-H 达到 80.1 AP70,仅增 0.52M 参数并约 16 倍压缩通信量,在 DAIR-V2X 达到 43.8 AP50。

3DThinkVLA: Endowing Vision-Language-Action Models with Latent 3D Priors via 3D-Thinking-Guided Co-training Figure 1
2026-06-04cs.CV

3DThinkVLA: Endowing Vision-Language-Action Models with Latent 3D Priors via 3D-Thinking-Guided Co-training

Jiaxin Shi, Xidong Zhang, Fucai Zhu, Zhe Li, Siyu Zhu, Weihao Yuan

Shanghai Jiao Tong University, Harbin Institute of Technology, Nanyang Technological University, Fudan University, Nanjing University, Great Bay University

2026-06-04视觉语言视觉感知三维

针对2D输入VLA在真实三维操作中缺乏空间推理、且共训练时动作提示会绕过已学3D先验的问题,3DThinkVLA将几何感知与空间推理解耦:用潜空间3D特征对齐获取低层几何,用共享推理锚点做在线蒸馏,再把两类空间条件注入动作头。推理时仅需2D图像和轻量适配器,在LIBERO、LIBERO-PLUS、SimplerEnv及真实机器人任务上报告达到SOTA。

Hyper-ICL: Attention Calibration with Hyperbolic Anchor Distillation for Multimodal In-Context Learning Figure 1
2026-06-04cs.CV

Hyper-ICL: Attention Calibration with Hyperbolic Anchor Distillation for Multimodal In-Context Learning

Niloufar Alipour Talemi, Hossein Kashiani, Fatemeh Afghah

2026-06-04视觉语言

针对多模态 ICL 需要插入图文示例而带来的高延迟、且对示例格式和顺序敏感的问题,Hyper-ICL 试图在推理时去掉示例:用低秩 logit 级适配器校准注意力,并按查询动态调节各层各头干预强度,再以双曲锚点蒸馏对齐有示例教师的中间表征。文中在 VQAv2、OK-VQA、COCO Caption 等六个基准和两个 MLLM 上报告了优于直接 ICD、ICV 与 LIVE 的准确率和稳定性。

Stateful Visual Encoders for Vision-Language Models Figure 1
2026-06-04cs.CV

Stateful Visual Encoders for Vision-Language Models

Zirui Wang, Junwei Yu, Adam Yala, David M. Chan, Joseph E. Gonzalez, Trevor Darrell

2026-06-04视觉语言视觉感知

现有开源 VLM 在多图/多轮任务中通常逐图独立编码,细微但关键的视觉变化可能在进入语言模型前被弱化。本文提出 Stateful Visual Encoder,在视觉骨干内让当前图像特征因果地关注历史图像特征,并配套跨注意力、初始化、零初始化与停梯度微调策略。实验显示其在空间聚合、多目标差异、轨迹模仿及放射影像、图像编辑、遥感变化检测中稳定优于无状态微调基线,并可跨分辨率、模型规模和骨干泛化。

DSA: Dynamic Step Allocation for Fast Autoregressive Video Generation Figure 1
2026-06-04cs.CV

DSA: Dynamic Step Allocation for Fast Autoregressive Video Generation

Thanh-Tung Le, Yunhan Zhao, Menglei Chai, Zhengyang Shen, Zhe Cao, Danhang Tang, Xiaohui Xie, Deying Kong

University of California, Irvine

2026-06-04视觉感知

该文针对自回归视频扩散在每帧使用固定去噪步数导致简单帧浪费算力、复杂帧欠优化的问题,提出 DSA:在分布匹配蒸馏中联合训练轻量置信度头,按帧/片段估计去噪可靠性并动态分配采样步数。实验显示其在 H100 上达到 22.63 FPS、亚秒级延迟,VBench 质量与近期 AR 和双向扩散模型相当或更优;但长时序生成仍有漂移与误差累积。

Implicit Fuzzification via Bounded Noise Injection for Robust Medical Image Segmentation Figure 1
2026-06-04cs.CV

Implicit Fuzzification via Bounded Noise Injection for Robust Medical Image Segmentation

Bisheng Tang, Zhangfeng Ma, Chuchu Zhai, Feng Dong, Yaoqun Wu, Ammar Oad, Yifei Peng

mation loss and inherent uncertainty in pixel-wise labeling., vision, aiming to assign a semantic label to each pixel and, School, Laboratory, University, Oad Ammar and Yifei Peng are with with the School of Information, uncertainty in pixel-to-label mapping rather than purely archi-

2026-06-04视觉感知学习理论安全鲁棒

本文针对医学图像分割中由下采样信息丢失、噪声与标注不确定性导致的边界模糊问题,提出 NoiseUNet:在 U-Net 跳连处注入有界扰动,以正则化跨尺度特征融合,并从理论上解释为隐式模糊化,使边界区域形成软隶属表示。作者还构建甲状腺超声 ThyR 数据集,实验显示该方法在分割精度和边界一致性上均有稳定提升。

L-TGVN: Leveraging Longitudinal Priors for Personalized Rapid MRI Figure 1
2026-06-04eess.IV

L-TGVN: Leveraging Longitudinal Priors for Personalized Rapid MRI

Arda Atalık, Sumit Chopra, Daniel K. Sodickson

¹ NYU Center for Data Science, NY, USA, ² Center for Advanced Imaging Innovation and Research (CAI²R), Department of Radiology, NYU, Grossman School of Medicine, NY, USA, ³ Courant Institute of Mathematical Sciences, NY, USA, Source code is available at github.com/sodicksonlab/L-TGVN.

2026-06-04视觉感知

为缩短 MRI 扫描而重度欠采样会使重建问题高度不适定,单靠群体先验在高加速下易丢细节。L-TGVN 将患者最近一次纵向扫描作为个体化先验,但通过信任引导/数据一致性约束限制其只影响测量难以确定的部分,且不需显式配准、可容忍协议差异。脑部多线圈 T2 数据上,在 10×–20× 加速下相较无先验和已有侧信息方法均提升 SSIM、PSNR、NRMSE,并更好保留细小结构和病灶。

Motion-Guided Causal Disentanglement for Robust Multi-View Cine Cardiac MRI Diagnosis Figure 1
2026-06-04cs.CV

Motion-Guided Causal Disentanglement for Robust Multi-View Cine Cardiac MRI Diagnosis

Chuankai Xu, Cristiane De Carvalho Singulane, Mohammad Abuannadi, Stephen Chandler, Jeremy Slivnick, Karolina Zareba, Jane Cao, Vidya Nadig, Fabio Fernandes, Seth Uretsky, Diego Perez de Arenaza, Amit Patel, Jianxin Xie

2026-06-04安全鲁棒

多视角电影心脏 MRI 中,模型易把视角解剖差异与疾病线索混在一起,低样本和罕见病场景下会放大捷径学习。论文提出 MoViD,在 ViT-MAE 上用疾病/视角双分支对比学习、梯度反转去相关和无标注帧间运动 ROI 裁剪分离表征,并用 focal 重加权缓解类别不均衡。在私有 VTE 与 M&Ms/M&Ms2 上分类和分割均优于常规 Transformer/CineMA,UVA-Cardiac AUROC 从 0.538 提升到 0.749,消融显示运动定位贡献最大。

Ultra-Fast Neural Video Compression Figure 1
2026-06-04cs.CV

Ultra-Fast Neural Video Compression

Jiahao Li, Wenxuan Xie, Zhaoyang Jia, Bin Li, Zongyu Guo, Xiaoyi Zhang, Yan Lu

Microsoft Research Asia, 2 University of Science and Technology of China

2026-06-04视觉感知

针对神经视频编码虽压缩率高但编解码复杂度阻碍部署的问题,论文提出 DCVC-UF:将多帧 chunk 编成单一紧凑 latent 并并行解码,用跨帧交互替代显式运动建模,配合帧特定解码器和单步比特流交互的熵编码以降低开销。实验显示其在 1080p、RTX 4090 上可达数百 FPS,HT-L 相比 VTM-LD 平均省码率 42.2%,显著改善率失真复杂度权衡。

An Empirical Study of Data Scale, Model Complexity, and Input Modalities in Visual Generalization Figure 1
2026-06-04cs.CV

An Empirical Study of Data Scale, Model Complexity, and Input Modalities in Visual Generalization

Luoyidi Zhou

School of Medical Information and Artificial Intelligence, Shandong First Medical University

2026-06-04学习理论

论文针对传统复杂度理论难以解释深度视觉模型泛化的问题,用一维函数拟合与 CIFAR-10/100 控制实验拆解数据规模、模型复杂度和输入模态的作用。核心洞察是:泛化提升更稳定地来自训练数据增加,而非单纯加大模型;去除颜色会明显损害性能,边缘、梯度、小波等显式先验在不同架构上效果不一致,增益来源不清。

Geometry-Preserving Unsupervised Alignment for Heterogeneous Foundation Models Figure 1
2026-06-04cs.CV

Geometry-Preserving Unsupervised Alignment for Heterogeneous Foundation Models

Shuwen Yu, Zhanxuan Hu, Yi Zhao, Yonghang Tai, Huafeng Li

modality gap without labels and model parame-, code is available at: https://github.com/, Yunnan Normal University, Kunming, China 2Kunming Uni-, space of VLMs, without requiring labels or model parame-

2026-06-04视觉感知

针对 VLM 语义强但视觉粗、VFM 结构判别强但缺少语言锚定的问题,论文提出 GPUA:把 VFM 特征视作“视觉语言”,在不使用标签、不更新模型参数的条件下学习正交映射,将其对齐到 VLM 语义空间并尽量保持原有几何结构。该方法只需特征级访问、任务无关,可融合多个视觉编码器;实验显示其在零样本识别和开放词汇分割等基准上提升跨模型兼容性,并带来较小额外开销。

Selective Coupling of Decoupled Informative Regions: Masked Attention Alignment for Data-Free Quantization of Vision Transformers Figure 1
2026-06-04cs.CV

Selective Coupling of Decoupled Informative Regions: Masked Attention Alignment for Data-Free Quantization of Vision Transformers

Biao Qian, Yang Wang, Yong Wu, Jungong Han

2026-06-04视觉感知

ViT 无数据量化缺少 BN 统计先验,合成样本易出现语义分散和全精度/量化模型注意力不一致,影响低比特校准。MaskAQ 的关键洞察是语义集中在少量 informative patches,并通过 patch 相似性熵最大化分离前景、掩码注意力对齐耦合量化模型及周期刷新样本来保持校准信息。实验在多种 ViT/DeiT/Swin 和分类、检测、分割任务上优于现有 DFQ,3-bit ImageNet 上最高提升约 3.1% Top-1。

VT-3DAD: Cross-Category 3D Anomaly Detection via Visual-Text Normal Space Alignment Figure 1
2026-06-04cs.CV

VT-3DAD: Cross-Category 3D Anomaly Detection via Visual-Text Normal Space Alignment

Zi Wang, Katsuya Hotta, Yawen Zou, Koichiro Kamide, Yijin Wei, Chao Zhang, Jun Yu

\skiplinehalf \supit 1Niigata University, \supit 2University of Toyama, \supit 3Iwate University

2026-06-04视觉感知三维

针对少样本跨类别 3D 点云异常检测中视觉相似类别易混淆、按类别训练不够灵活的问题,VT-3DAD 将点云投影为多视角深度图,用冻结 CLIP 视觉特征度量与正常参考的偏离,同时用深度/3D 感知文本提示构建正常语义锚点,融合视觉与文本正常空间得分。ShapeNetPart 上 1/3/5-shot 均达 SOTA,1-shot AUC-ROC 从 DMP-3DAD 的 92.49% 提升到 94.80%,标准差也降低。

Multi-Granularity 3D Kidney Lesion Characterization from CT Volumes Figure 1
2026-06-04cs.CV

Multi-Granularity 3D Kidney Lesion Characterization from CT Volumes

Renjie Liang, Zhengkang Fan, Jinqian Pan, Chenkun Sun, Jiang Bian, Russell Terry, Jie Xu

aDepartment of Health Outcomes and Biomedical Informatics, University of, bDepartment of Urology, University of Florida, 1600 SW Archer, cDepartment of Biostatistics and Health Data Science, Indiana University School of, dCenter of Biomedical Informatics, 1101 W 10th St, at one academic medical center, with multi-granularity side- and per-lesion, labels, and used KiTS23 (489 cases) for zero-shot external validation. We

2026-06-04三维

针对放射报告按单个肾脏病灶描述类型、大小、强化和密度,而现有3D CT方法多停留在患者或器官级预测的问题,论文将肾病灶表征重构为可变数量的病灶集合预测,提出LesionDETR、尺寸距离匈牙利匹配和层级监督,并构建多粒度标注数据。实验显示分割掩膜通道与腹部CT预训练是主要增益来源,侧别异常AUC约0.80且可零样本迁移到KiTS23,但病灶级mAP仍低、罕见实体病灶受数据规模限制明显。

Spatially Grounded Concept Bottleneck Models via Part-Factorized Attention Figure 1
2026-06-04cs.CV

Spatially Grounded Concept Bottleneck Models via Part-Factorized Attention

Dhanesh Ramachandram

such as CUB-200-2011 [Wah et al., 2011] encode this knowledge as binary part-attribute labels, weakens the labeling requirement: post-hoc CBMs [Yuksekgonul et al., 2022] retrofit a concept layer, onto a pretrained backbone using textual concept embeddings, and label-free CBMs [Oikarinen et al., tion. LaBo [Yang et al., 2023] uses a language model to propose a large candidate concept space and, CLIP. Label-free CBMs [Oikarinen et al., 2023] similarly remove manual concept annotation. These, iterations and uses a saliency map together with concept-label statistics as transportation priors, with

2026-06-04视觉感知

本文针对细粒度识别中 CBM 概念头“名为某部位却看向其他区域”的空间失真问题,提出 PF-CBM:在冻结 DINOv3 特征上用前景门抑制背景,以部位查询和固定概念-部位路由强制属性只读对应解剖部位,并用可学习二维高斯先验打破部位槽置换。CUB 上其 top-1 接近全监督基线,同时显著提升 pointing accuracy;用 PCA 前景目标可去除逐图监督仍保持约 88.6% 准确率和约 70% 定位准确率。

Video2LoRA: Parametric Video Internalization for Vision-Language Models Figure 1
2026-06-04cs.CV

Video2LoRA: Parametric Video Internalization for Vision-Language Models

Manan Suri, Sarvesh Baskar, Dinesh Manocha

† University of Maryland, College Park

2026-06-04视觉语言视觉感知

针对视频 VLM 每次查询都需携带大量视觉 token、长视频易超上下文并退化的问题,Video2LoRA 将视频先由冻结 VLM 编码,再用 Perceiver 超网络一次性生成视频专属 LoRA,把视觉上下文内化到参数中,查询时无需视觉 token。实验显示其在多项字幕任务和多数视频 QA 设定上与直接视频上下文推理统计等价或非劣,并在长帧数/高分辨率下更稳定,查询 TTFT 降低约 6–80 倍。

MorphoQuant: Modality-Aware Quantization for Omni-modal Large Language Models Figure 1
2026-06-04cs.CV

MorphoQuant: Modality-Aware Quantization for Omni-modal Large Language Models

Yue Wu, Changyuan Wang, Zixuan Wang, Shilin Ma, Yansong Tang

2026-06-04视觉感知

该文针对全模态大模型在音频、视频、图像、文本混合输入下激活分布差异大、4-bit PTQ易截断离群值的问题,提出 MorphoQuant:用 DABC 将长尾通道残差吸收到通道偏置中,并用 MDQFO 联合优化量化网格与偏置掩码,以兼顾离群值保真和主体分布精度。在 Qwen2.5-Omni 上,W4A4 在 MMMU、Video-MME 等任务优于现有 W4A4,ScienceQA 达 76.63%,还超过部分 W4A16 基线。

HYolo: An Intelligent IoT-Based Object Detection System Using Hypergraph Learning Figure 1
2026-06-04cs.CV

HYolo: An Intelligent IoT-Based Object Detection System Using Hypergraph Learning

Isha Abid, Fawad Khan, Muhammad Khuram Shahzad

2026-06-04视觉感知

本文针对 IoT 场景下 YOLO 检测器难以建模跨层、跨位置高阶特征关系的问题,提出 HYolo:在 YOLO 流水线中加入基于距离阈值构图的超图表示、HyperC2Net 跨层交互模块和 HyperConv 信息传播,以增强上下文建模。文中称在 COCO 上 mAP@50 提升约 12%,但实验细节与消融支撑有限,增益来源仍不够清楚。

Robust Multi-view Clustering against Imperfect Information Figure 1
2026-06-04cs.CV

Robust Multi-view Clustering against Imperfect Information

Zhichao Huang, Haochen Zhou, Hao Wang, Mouxing Yang, Xi Peng

College of Computer Science, Sichuan University, China., School of Artificial Intelligence, Sichuan University, China., Tianfu Jincheng Laboratory, Chengdu, China., be either unavailable or unreliable. Based on the observation, we propose a novel, partition unlabeled instances into semantic groups by exploiting complementary information within, No caption available., information. Specifically, IV makes the counterpart unavailable, whereas NC renders the observed, solutions of IV and NC. To be more specific, one could first recover the unavailable counterparts

2026-06-04安全鲁棒

论文关注多视图聚类中更现实的“不完美信息”场景:视图缺失与跨视图对应噪声同时存在,使只面向 IV 或 NC 的方法依赖条件失效。核心洞察是二者都源于跨视图 counterpart 不可用或不可靠,因而提出 PLCI,将 counterpart 建模为潜变量,结合实例级可靠性估计与原型级语义最优传输推断其后验。六个数据集上对比 10 种方法显示其在该混合扰动下更稳健。

Answer Self-Consistency with Margin-Triggered Question Re-Arbitration for the CVPR 2026 VidLLMs Challenge Figure 1
2026-06-04cs.CV

Answer Self-Consistency with Margin-Triggered Question Re-Arbitration for the CVPR 2026 VidLLMs Challenge

Tomoya Miyazawa, Hiroyasu Okuno

Data Analytics Labo Co.

2026-06-04视觉感知

针对 VRR-QA 中关系线索常跨镜头、隐含且单次 Video LLM 推理不稳定的问题,论文提出无需训练的测试时框架 ASC-MQRA:多次随机问答后按答案自一致性投票,并尝试在低票差样本上缩小候选重看视频再仲裁。结果显示 ASC 相比单次推理显著更稳,最终验证集 AvgAcc 72.73、测试集 81.16;MQRA 验证集有增益但测试集略降,说明收益依赖触发样本分布,主要来自 test-time scaling。

PureLight: Learning Complex Luminaires with Light Tracing Figure 1
2026-06-04cs.GR

PureLight: Learning Complex Luminaires with Light Tracing

Pedro Figueiredo, Zixuan Li, Beibei Wang, Miloš Hašan, Nima Khademi Kalantari

Texas A&M University, Nankai University, Nanjing University of Science and Technology, Texas A&M University USA, Nankai University China, Nanjing University of Science and Technology China

2026-06-04视觉感知

针对含微小 LED、玻璃/镜面层等复杂灯具在路径追踪和双向路径追踪中难以低方差估计外观的问题,PureLight 将灯具出射辐射建模为由光线追踪样本学习的概率分布,并用 normalizing flow、蒸馏 MLP、采样网络和混合网络支持外观查询与直接光照。实验显示其可在任意场景中以低采样数渲染复杂灯具,64 spp 即比百万 spp 路径追踪更低噪,并提供更快但带轻微偏差的离散版本。

XSSR: Cross-Domain Self-Supervised Representative Selection for Efficient Annotation in Medical Image Segmentation Figure 1
2026-06-04cs.CV

XSSR: Cross-Domain Self-Supervised Representative Selection for Efficient Annotation in Medical Image Segmentation

Byunghyun Ko, Aleksei Anisimov, Kobe Ke, Suhas Bharthepude, Jeongkyu Lee

2026-06-04视觉感知

针对跨医院/设备医学图像分割中目标域标注昂贵且域偏移降低性能的问题,XSSR先用源域无标注数据训练轻量MAE获得嵌入,再按密度、新颖性与多样性贪心挑选少量目标样本,并自动校准权衡参数。在5%标注预算下,Chest X-ray仅22例达到全量性能99.3%,Prostate MRI较随机最高提升2.5 Dice,并整体优于CoreSet 0.4–1.2 Dice。

Efficient and Training-Free Single-Image Diffusion Models Figure 1
2026-06-04cs.CV

Efficient and Training-Free Single-Image Diffusion Models

Haojun Qiu, Kiriakos N. Kutulakos, David B. Lindell

Department of Computer Science, University of Toronto, Vector Institute

2026-06-04视觉感知生成模型

针对单图像生成中传统单图扩散需数小时内部训练的问题,本文将单张参考图像视为多尺度 patch 数据集,利用有限低维 patch 分布可闭式计算 score 的洞察,构造无需神经网络训练的最优去噪器并嵌入粗到细反向扩散。实验显示其在单图 FID、质量与多样性上达到或优于已训练的单图扩散模型,并支持文本风格化、对称化、重定向等应用;结合 latent diffusion、近邻检索和加速 kernel,可实现秒级百万像素和分钟级十亿像素生成。

A Cookbook of 3D Vision: Data, Learning Paradigms, and Application Figure 1
2026-06-04cs.CV

A Cookbook of 3D Vision: Data, Learning Paradigms, and Application

Hongyang Du, Zongxia Li, Dawei Liu, Runhao Li, Haoyuan Song, Qingyu Zhang, Yubo Wang, Jingcheng Ni, Shihang Gui, Congchao Dong, Tao Hu

2026-06-04视觉感知三维

三维视觉因表示形式、数据集和学习范式分散,研究者难以统一比较效率、保真度与可扩展性。本文不是提出新模型,而是以数据为中心梳理 RGB-D、点云、网格、体素、隐式场与 3D Gaussian 等表示,并把基准设计、监督方式与重建、生成、4D 世界建模等任务联系起来。主要结果是一套综述性分类框架与趋势判断,指出统一评测、跨模态/2D 监督和实时高保真表示是后续关键方向。

FindIt: A Format-Informed Visual Detection Benchmark for Generalist Multimodal LLMs Figure 1
2026-06-04cs.CV

FindIt: A Format-Informed Visual Detection Benchmark for Generalist Multimodal LLMs

Eshika Khandelwal, Jingjing Pan, Mingfang Zhang, Quan Kong, Lorenzo Garattoni, Hilde Kuehne

Tuebingen AI Center, University of Tuebingen, Woven by Toyota, Inc., Tokyo, Japan

2026-06-04视觉语言视觉感知数据集/基准

针对通用多模态 LLM 已被用于输出框定位、但现有评测多停留在 VQA/描述等自由文本任务的问题,FindIt 构建了覆盖目标检测、指代表达、实例级与视频检测的统一基准,并强制可解析框格式、比较文本/JSON及不同坐标定义。实验显示模型对输出格式高度敏感,开源模型定位有时优于闭源模型但格式迁移差,闭源模型更稳健;实例检测仍是主要短板。

StandardE2E: A Unified Framework for End-to-End Autonomous Driving Datasets Figure 1
2026-06-04cs.CV

StandardE2E: A Unified Framework for End-to-End Autonomous Driving Datasets

Stepan Konev

2026-06-04数据集/基准

面向端到端自动驾驶研究中各数据集格式、坐标系、模态与 API 割裂导致的重复预处理和跨数据集训练困难,StandardE2E 提出以 StandardFrameData 为核心的统一模式,将每个数据集仅映射一次,后续适配器链、缓存索引、场景过滤与 PyTorch 多数据集 DataLoader 复用。框架已支持 Waymo、Argoverse 2、NAVSIM、WayveScenes101 等六类数据集并开源,但文中主要是扩展摘要,缺少系统实验,跨数据集收益仍未充分说明。

Instant-Fold: In-Context Imitation Learning for Deformable Object Manipulation Figure 1
2026-06-04cs.RO

Instant-Fold: In-Context Imitation Learning for Deformable Object Manipulation

Yilong Wang, Cheng Qian, Edward Johns

The Robot Learning Lab, Imperial College London

2026-06-04机器人模仿学习

针对柔性物体状态高维、遮挡多且同一任务存在多种有效操作流程的问题,Instant-Fold将服装折叠建模为单示范提示下的上下文模仿学习:先用时间对比预训练获得形变一致的视觉 token,再以示范条件化的 flow-matching Transformer生成双臂动作。实验显示,示范条件比语言条件更能保留几何与时序意图,模型可泛化到未见折叠模式和衣物,并在无真实数据微调下实现零样本 sim-to-real;但仍依赖分割、手工上下文库和较规整初始状态。

UniCanvas: A Diffusion-base Unified Model for Text-in-Image Joint Generation Figure 1
2026-06-04cs.CV

UniCanvas: A Diffusion-base Unified Model for Text-in-Image Joint Generation

Zeyuan Yang, Hao-Wei Chen, Xueyang Yu, Yuncong Yang, Haoyu Zhen, Ziqiao Ma, Maohao Shen, Chuang Gan

2026-06-04视觉感知生成模型

针对自回归 VLM 会推理但图像质量弱、扩散模型能生成图像却难生成连贯文字的问题,UniCanvas 将文字也视为可绘制的像素模式,在共享画布上用单一扩散骨干和统一去噪目标联合生成图文,并通过两阶段生成与 CLIP 对齐增强可读性。实验显示其在 Recipe、FrozenLake、RLBench 等多步任务中较分离式基线有更好的文字一致性、视觉保真度和长程状态更新稳定性。

Can Generalist Agents Automate Data Curation? Figure 1
2026-06-04cs.AI

Can Generalist Agents Automate Data Curation?

Feiyang Kang, Hanze Li, Adam Nguyen, Mahavir Dabas, Jiaqi W. Ma, Frederic Sala, Dawn Song, Ruoxi Jia

Virginia Tech, 2University of Illinois Urbana-Champaign, University of Wisconsin-Madison, 4University of California, Berkeley, sequential yet labor-intensive parts of modern, Code and benchmark available at: https://github., when additional raw data is unavailable or increas-, adapt, and validate the data already available.

2026-06-04视觉感知

论文关注训练数据整理仍依赖人工反复试错的问题,提出 CURATION-BENCH,将模型、训练流程和评测固定,让通用代码智能体通过命令行迭代提出、执行并修订数据策略。结果显示,开放提示的智能体能在少量迭代内接近强人工基线,但多停留在局部启发式调参;要求引用、实例化并改造既有方法的脚手架可促成更有效的策略探索,并在十分之一数据预算下超过已发表基线。

SBP-Net: Learning Thin Structure Reconstruction with Sliding-Box Projections Figure 1
2026-06-04cs.CV

SBP-Net: Learning Thin Structure Reconstruction with Sliding-Box Projections

Ofir Gilad, Andrei Sharf

2026-06-04三维

针对血管、管线等稀疏细长三维结构在缺失、噪声和低采样下易断裂、过平滑的问题,SBP-Net将全局3D补全拆成重叠滑动盒的六向正交深度投影,用带注意力的U-Net在2D中补洞,再反投影融合回体素模型。实验覆盖肺动脉CT、合成与真实工业管线,显示相比现有方法更能保留细节和拓扑连续性。

Prospective Dynamic 3D MRI Reconstruction via Latent-Space Motion Tracking from Single Measurement Figure 1
2026-06-04cs.CV

Prospective Dynamic 3D MRI Reconstruction via Latent-Space Motion Tracking from Single Measurement

Lixuan Chen, Zhongnan Liu, Jesse Hamilton, James M. Balter, Jeong Joon Park, Liyue Shen

University of Michigan

2026-06-04视觉感知三维

面向 MRI 引导放疗等需要低延迟 3D 解剖可视化的场景,论文针对单次超稀疏 k-space 采样下前瞻重建病态的问题,提出 PDMR:先离线学习患者特异的非线性运动潜空间,并用 tri-plane 映射生成 3D 形变场,在线只优化低维 latent 以快速跟踪运动。XCAT 与腹部 MRI 实验显示其在 Immediate/After-2min 设置下重建更稳定,较 MR-MOTUS 等基线取得更高 PSNR/SSIM,院内数据约有 2dB 以上增益。

VAMPS: Visual-Assisted Mathematical Problem Solving Benchmark Figure 1
2026-06-04cs.AI

VAMPS: Visual-Assisted Mathematical Problem Solving Benchmark

Amirhossein Dabiriaghdam, Shayan Vassef, Mohammadreza Bakhtiari, Yasamin Medghalchi, Ilker Hacihaliloglu, Mesrob Ohannessian, Lele Wang, Giuseppe Carenini

2026-06-04数据集/基准

本文关注多模态模型在数学解题中“把问题转成图、再从图中推理”的薄弱环节,提出 VAMPS:基于伊朗高考代数/微积分题的波斯语-英语双语基准,含 1,168 道需借助绘图发现交点、极值、渐近线等线索的选择题,并评估文本解析、Desmos 工具绘图与给定可视化等模式。主要结果显示,多数模型即使在适合画图的题上,直接符号/文本求解仍优于工具辅助视觉求解,说明瓶颈在工具调用、图像生成质量和视觉解释的衔接。

Overview of the EReL@MIR 2025 Multimodal Document Retrieval Challenge (Track 1) Figure 1
2026-06-04cs.CV

Overview of the EReL@MIR 2025 Multimodal Document Retrieval Challenge (Track 1)

Jingbiao Mei

University of Cambridge, University of Cambridge Cambridge United Kingdom

2026-06-04视觉语言

面向图文混排文档的 RAG 需要同时利用视觉、文本与版面信号,而传统 OCR/文本检索容易丢失关键信息。本文总结 EReL@MIR 2025 多模态文档检索挑战,首次用统一系统同时评测长文档页内检索 MMDocIR 与开放域图像/图文到段落检索 M2KR。结果显示,优胜方案均转向 Qwen2-VL 系多模态 LLM 表征而非 CLIP,任务感知管线更有效;无训练的多路融合加重排方法仅落后微调集成约 0.1 分。

DetectZoo: A Unified Toolkit for AI-Generated Content Detection Across Text, Audio, and Image Modalities Figure 1
2026-06-04cs.MM

DetectZoo: A Unified Toolkit for AI-Generated Content Detection Across Text, Audio, and Image Modalities

Sajad Ebrahimi, Nima Jamali, Bardia Shirsalimian, Kelly McConvey, Wentao Zhang, Jalehsadat Mahdavimoghaddam, Maksym Taranukhin, Maura Grossman, Vered Shwartz, Yuntian Deng, Ebrahim Bagheri

University of Toronto, University of Waterloo, Toronto Metropolitan University, University of British Columbia, Vector Institute, body of work on detection across text, images, and audio. Most available detectors, are publicly available at https://github.com/sadjadeb/DetectZoo, and the, Label

2026-06-04视觉感知

生成式模型让文本、图像、音频中的人机内容边界变模糊,但现有检测器代码、预处理和指标割裂,难以公平比较和复现。DetectZoo的核心贡献不是新检测算法,而是将三种模态的61个检测器、22个基准数据集和统一评测API整合到同一工具链,覆盖数据加载、预处理、权重缓存、打分与多指标报告。文中结果表明该框架可复现原方法并支持系统化跨模态基准分析,但训练流水线、视频支持和部分外部模型依赖仍未解决。

Spatial Artifact Coherence Determines Codec Robustness in Patch-Based rPPG Figure 1
2026-06-04cs.CV

Spatial Artifact Coherence Determines Codec Robustness in Patch-Based rPPG

Achraf Ben Ahmed

2026-06-04安全鲁棒

面向远程医疗等压缩视频场景,论文指出基于分块 PCA 的 rPPG 在不同编码器下表现差异并非只由码率决定,而由跨面部块伪影的空间相干性主导。作者提出 SAC 指标和 PatchPCA 系列,用 280 名受试者、3 个数据集、11 种退化和 13 个算法验证:SAC 解释 93.8% 的变体间 PCA 优势方差,MPEG-4 呈高 SAC 且显著削弱 PCA 增益;低 SAC、低到中等运动时 P-Hybrid 更稳健。

GroupToM-Bench: Benchmarking Group Theory of Mind and Nonlinear Social Emergence in MLLMs Figure 1
2026-06-04cs.CV

GroupToM-Bench: Benchmarking Group Theory of Mind and Nonlinear Social Emergence in MLLMs

Weidong Tang, Jierui Li, Yueling Hou, Zihan Mei, Can Zhang, Xinyan Wan, Zhiyuan Liang, Pengfei Zhou, Yang You, Wangbo Zhao

Xidian University, National University of Singapore, University of Electronic Science and Technology of China, University of Science and Technology of China

2026-06-04学习理论数据集/基准

论文针对现有 MLLM 心智理论评测多停留在个体意图推断、难以刻画群体中从众、权力结构和信息不对称导致的非线性涌现,提出 GroupToM-Bench:包含 8 类社会域、240 个专家场景和 3000+ 推理任务,并用微观 BDI—中观张力/约束—宏观结果的七级审计框架诊断模型。实验显示当前强模型与人类仍有明显差距,常把群体结果线性化为理性共识,难以识别群体迷思、阿比林悖论等结构性陷阱。

End-to-End Text Line Detection and Ordering Figure 1
2026-06-04cs.CV

End-to-End Text Line Detection and Ordering

Benjamin Kiessling (ALMAnaCH)

2026-06-04视觉感知

历史文档OCR常把行检测与阅读顺序排序拆开,后者依赖几何启发式,难处理边注、多栏、表格和不同转写规范。Orli将页面布局建模为图像到序列任务,自回归输出按阅读顺序排列的文本基线,并用弦坐标参数化与局部细化恢复曲线。在19.7万页、多书写系统数据上训练后,无需特定微调即在cBAD略超既有最佳,并在OHG、FCR近乎完美;ABP需少量微调提升排序,说明专门版式仍依赖适配。

Pinpoint: Grounded Worldwide Image Geolocation via Cross-Source Retrieval and Reranking Figure 1
2026-06-04cs.CV

Pinpoint: Grounded Worldwide Image Geolocation via Cross-Source Retrieval and Reranking

Nika Chuzhoy, Brian Hu, Amit A. Arora, Jae Ro, Sarthak S. Sahu

2026-06-04视觉感知强化学习

Pinpoint针对全球图像定位中视觉线索歧义、互联网照片与街景数据长期割裂的问题,提出不依赖多模态大模型的检索—重排序框架:先用Flickr与OSV-5M联合训练图像-GPS对比嵌入检索候选,再用注意力重排序融合候选视觉/GPS特征及邻近跨源证据。其在IM2GPS3k、YFCC4k和OSV-5M各距离阈值均达到SOTA,同时强调更低延迟与可复现性。

SymTRELLIS: Symmetry-Enforced Voxel Latents for 3D Generation Figure 1
2026-06-04cs.GR

SymTRELLIS: Symmetry-Enforced Voxel Latents for 3D Generation

Guangda Ji, Qimin Chen, Qinchan Li, Mingrui Zhao, Kai Wang, Hao Zhang

Simon Fraser University, Simon Fraser University Burnaby BC Canada

2026-06-04三维

单视图3D生成虽外观逼真,却常破坏齿轮、陀螺等物体赖以工作的对称性。SymTRELLIS不重训TRELLIS.2,而学习空间变换在体素潜变量中的线性作用,并在ODE采样每步对对称等价的流速度求平均,从生成过程中强制旋转、反射及多面体点群对称。266个严格对称物体上,它较TRELLIS.2、Hunyuan3D-2.1和TripoSG显著降低对称误差,同时基本保持重建精度。

Reflection Separation from a Single Image via Joint Latent Diffusion Figure 1
2026-06-04cs.CV

Reflection Separation from a Single Image via Joint Latent Diffusion

Zheng-Hui Huang, Zhixiang Wang, Yu-Lun Liu, Yung-Yu Chuang

National Taiwan University, National Yang Ming Chiao Tung University

2026-06-04视觉感知生成模型

本文针对单张图像反射分离在强眩光、弱反射等信息不足场景下易残留或失真的问题,提出联合潜空间扩散框架,同时生成透射层与反射层。核心在于利用预训练扩散先验,并通过跨层自注意力、互相约束的 disjoint sampling 及带学习组合函数的潜变量优化来减少层间干扰。实验显示其在多个真实基准上超过现有方法,尤其改善强反射细节补全和弱反射提取。

When Seeing Is Not Believing -- A Benchmark for Search-Grounded Video Misinformation Detection Figure 1
2026-06-04cs.CV

When Seeing Is Not Believing -- A Benchmark for Search-Grounded Video Misinformation Detection

Tao Yu, Yujia Yang, Shenghua Chai, Zhang Jinshuai, Haopeng Jin, Hao Wang, Minghui Zhang, Zhongtian Luo, Yuchen Long, Xinlong Chen, Jiabing Yang, Zhaolu Kang, Yuxuan Zhou, Zhengyu Man, Xinming Wang, Hongzhu Yi, Zheqi He, Xi Yang, Yan Huang, Liang Wang

1 CASIA 2 2 UCAS 3 3 BAAI 4 4 Tsinghua University 5 5 Peking University

2026-06-04视觉感知数据集/基准

针对视频谣言常通过剪辑、重排、拼接或局部生成来扭曲事件语义、仅看输入视频难以判真这一问题,论文提出搜索 grounded 的 EVID-Bench,要求模型检索开放网络相关视频并做跨视频证据对比,覆盖222个样本、9类操纵和6个主题。九个前沿多模态模型在检索增强基线下仍表现有限,最佳仅达61.43%点级准确率和43.24%视频级准确率,显示主要瓶颈在检索锚点选择、差异推理和证据充分性判断。

Optimal Transport Flow Matching by Design Figure 1
2026-06-04cs.CV

Optimal Transport Flow Matching by Design

Shimon Malnick, Matan Rusanovsky, Ohad Fried, Shai Avidan

Tel Aviv University, Reichman University

2026-06-04生成模型

论文针对流匹配中高维最优传输耦合难算、随机噪声-数据配对导致轨迹弯曲和少步生成低效的问题,提出不再求解固定高斯先验的 OT,而是把先验作为设计变量:用自然图像低频投影构造可采样的结构化先验,使其与原图的恒等耦合经验上满足 OT,并让模型主要补全高频细节。实验显示该设计无需改动流模型,可结合潜空间、CFG 和一步框架,轨迹曲率较现有方法降低超过 2 倍,少步/一步生成质量更好,但低频先验生成器仍是主要瓶颈。

Intra-Modal Neighbors Never Lie: Rectifying Inter-Modal Noisy Correspondence via Graph-Based Intra-Modal Reasoning Figure 1
2026-06-04cs.CV

Intra-Modal Neighbors Never Lie: Rectifying Inter-Modal Noisy Correspondence via Graph-Based Intra-Modal Reasoning

Yang Liu, Wentao Feng, Shu-Dong Huang, Yalan Ye, Jiancheng Lv

2026-06-04视觉感知

针对网络图文数据中图像与文本错配会破坏跨模态检索训练的问题,论文指出现有替换单一样本标签的离散选择易受噪声邻居和离散化误差影响,提出 IN2R 利用模态内邻域结构更稳定的洞察,通过跨模型记忆检索高置信邻居,并用图精炼器聚合成连续软原型来校正监督信号。在 Flickr30K、MS-COCO 和 CC152K 上,该方法相较已有抗噪图文匹配方法取得更优结果,尤其面向高噪声场景。

Weakly Supervised Incremental Segmentation via Semantic Anchors and Spatial Arbitration Figure 1
2026-06-04cs.CV

Weakly Supervised Incremental Segmentation via Semantic Anchors and Spatial Arbitration

Zhonggai Wang, Kai Fang, Guangyu Gao

2026-06-04视觉感知

这篇论文关注弱监督增量语义分割中,CAM 伪标签稀疏与旧模型补全会在同一物体内产生新旧类矛盾,长期累积导致特征漂移和遗忘。作者提出 SASA:用可学习语义锚点稳定类别身份,并以弹性残差吸收实例变化;同时通过空间标签仲裁利用物体掩码执行“一物一类”过滤噪声。实验在 Pascal VOC 与 MS COCO 上优于现有方法,尤其多步增量场景更明显。

Dive into the Scene: Breaking the Perceptual Bottleneck in Vision-Language Decision Making via Focus Plan Generation Figure 1
2026-06-04cs.CV

Dive into the Scene: Breaking the Perceptual Bottleneck in Vision-Language Decision Making via Focus Plan Generation

Boyuan Xiao, Bohong Chen, Yumeng Li, Ji Feng, Yao-Xiang Ding, Kun Zhou

2026-06-04视觉语言视觉感知

本文针对机器人操作与导航中 VLM/VLA 难以从干扰物中识别任务相关目标、导致幻觉和误定位的问题,提出 SceneDiver:先构建场景图形成全局理解,再将任务分解到局部子场景中逐步生成聚焦计划,并用轻量适配器蒸馏到 VLA。实验显示其在操作任务提升约10%–15%,导航最高提升16%,LIBERO-plus 成功率最高提升9.6%,额外开销约2.64%。

TGSD: Topology-Guided State-Space Diffusion for EEG Spatial Super-Resolution Figure 1
2026-06-04eess.SP

TGSD: Topology-Guided State-Space Diffusion for EEG Spatial Super-Resolution

Zijian Kang, Weiming Zeng, Yueyang Li, Shengyu Gong, Hongjie Yan, Wai Ting Siok, Nizhuan Wang

2026-06-04生成模型

面向可穿戴/IoT低密度 EEG 难以保留跨脑区空间信息的问题,TGSD 将完整电极拓扑先验与条件扩散结合:用层次空间先验编码器建模局部几何和脑区上下文,再以交替时序/通道状态空间去噪生成缺失通道。SEED 与 PhysioNet MM/I 实验显示,其在不同超分辨率倍率下的重建误差和下游分类表现均优于代表性基线。

PointAction: 3D Points as Universal Action Representations for Robot Control Figure 1
2026-06-04cs.RO

PointAction: 3D Points as Universal Action Representations for Robot Control

Mutian Tong, Han Jiang, Qiao Feng, Lingjie Liu, Jiatao Gu

University of Pennsylvania

2026-06-04机器人规划控制三维

针对视频动作模型只用 RGB rollout 难以确定三维运动、接触几何与精细空间约束,且跨任务/本体动作标注昂贵的问题,PointAction 将动态 3D pointmap 作为视频预测到控制的通用接口:先联合生成未来 RGB 与 XYZ 点图,再由扩散式动作解码器映射为机器人控制。实验显示其在机器人场景 4D 生成质量上达到 SOTA,在仿真中优于 VLA/VAM 基线,并能迁移到预训练未见的两种真实机械臂。

2026-06-03

147 篇
SimuScene: Simulation-Ready Compositional 3D Scene Reconstruction from a Single Image Figure 1
2026-06-03cs.CV

SimuScene: Simulation-Ready Compositional 3D Scene Reconstruction from a Single Image

Inhee Lee, Sangwon Baik, Sungjoo Kim, Hyeonwoo Kim, Hyunsoo Cha, Hanbyul Joo

Seoul National University

2026-06-03视觉感知三维

这篇论文针对单图重建的多物体场景在机器人仿真中常因穿模、悬空或下沉而失效的问题,提出 SimuScene:把物理引擎从事后修布局变成重建过程中的诊断信号,用重力下接触位移、穿透等反馈驱动竖直拉伸和遮挡形状重采样,从而同时修正形状与位姿。实验显示其在物理稳定性和几何对齐指标上达到领先,并可用于类人控制和机械臂操作场景。

Exploring Easy Boosts for Lidar Semantic Scene Completion Figure 1
2026-06-03cs.CV

Exploring Easy Boosts for Lidar Semantic Scene Completion

Tetiana Martyniuk, Jonathan Seele, Alexandre Boulch, Gilles Puy, Renaud Marlet, Raoul de Charette

2026-06-03视觉感知

本文针对激光雷达语义场景补全中复杂架构不断堆叠、但输入先验贡献不清的问题,系统考察两种“低成本”增强:用现成点云分割器为输入点云提供语义伪标签,并用射线可见性区分空闲与未知体素。结果显示语义先验是 mIoU 提升主因,可见性带来次级增益;二者结合使4个既有模型平均提升约5.2 mIoU,SSA-SC 达到28.8 mIoU,旧模型也可接近或超过可复现SOTA。

Neuron Populations Exhibit Divergent Selectivity with Scale Figure 1
2026-06-03cs.LG

Neuron Populations Exhibit Divergent Selectivity with Scale

Amil Dravid, Yasaman Bahri, Alexei A. Efros, Yossi Gandelsman

2026-06-03视觉感知

这篇论文关注 scaling laws 之外的内部表征如何随模型规模变化,试图解释大模型中哪些单神经元结构会跨训练重复出现。作者以 Rosetta Neurons 作为可测对象,在语言与视觉模型中发现其数量随规模按次线性幂律增长、占比下降;同时提出容量受限下的特征竞争解释,并观察到“神经元极化”:这些共享神经元更选择性、更单义且更领域专化,而非 Rosetta 神经元更多保持多义叠加。

PixVOD: Pixel-Distributed Direct Visual Odometry and Depth Estimation Figure 1
2026-06-03cs.CV

PixVOD: Pixel-Distributed Direct Visual Odometry and Depth Estimation

Shinjeong Kim, Ignacio Alzugaray, Callum Rhodes, Paul H. J. Kelly, Andrew J. Davison

Department of Computing, Imperial College London

2026-06-03视觉感知

PixVOD面向机器人/可穿戴等低功耗边缘视觉,试图避免把整帧像素传出传感器再集中计算。其核心是把单目6DoF视觉里程计和稠密深度估计写成分布在像素阵列上的高斯因子图,用GBP在像素间同步位姿,并结合光度观测、表面法线先验与关键帧式锚定稳定基线。实验在真实感数据上验证了片上分布式VO/深度估计的可行性,但文中结果更像近未来PPA设计探索,尚非真实传感器芯片完整实现。

NewtPhys: Do Foundation Models Understand Newtonian Physics? Figure 1
2026-06-03cs.CV

NewtPhys: Do Foundation Models Understand Newtonian Physics?

Sebastian Cavada, Soumava Paul, Tuan-Hung Vu, Andrei Bursuc, Raoul de Charette

aware evaluations. Code and datasets are available at:, rely on human judgments or high-level proxy labels and, therefore do not provide physics labels, while bench-, real-world dynamics in lab conditions [64]., is impractical outside lab conditions, NewtPhys uses 3D, physical labels and events over time, including forces

2026-06-03视觉感知

针对现有物理推理评测要么过于合成、要么缺少牛顿量真值的问题,NewtPhys用真实多视角场景的3D Gaussian Splatting结合点式牛顿仿真,生成含力、碰撞、形变、材质、场景流等像素对齐标注的4D基准,并构建141K物理VQA与730K帧数据。对56个VLM和10个VFM的评测显示,模型虽能处理部分常识或材质识别,但在质量、密度、力学因果等低层物理量上明显不足,且常依赖语言先验而非视觉线索。

Humanoid-GPT: Scaling Data and Structure for Zero-Shot Motion Tracking Figure 1
2026-06-03cs.RO

Humanoid-GPT: Scaling Data and Structure for Zero-Shot Motion Tracking

Zekun Qi, Xuchuan Chen, Dairu Liu, Chenghuai Lin, Yunrui Lian, Sikai Liang, Zhikai Zhang, Yu Guan, Jilong Wang, Wenyao Zhang, Xinqiang Yu, He Wang, Li Yi

2026-06-03机器人视觉感知

论文针对人形机器人运动跟踪中“敏捷性与零样本泛化难兼得”的问题,认为瓶颈主要来自数据规模不足和模型结构不匹配。Humanoid-GPT用2B帧重定向运动语料、因果GPT式Transformer、专家蒸馏与HME平衡采样来学习在线全身控制。实验显示其在未见动作、遥操作和Unitree G1实机动态舞蹈等任务上保持实时稳定跟踪,并给出数据/模型scaling趋势。

Formalizing the Binding Problem Figure 1
2026-06-03cs.CV

Formalizing the Binding Problem

Lianghuan Huang, Yihao Li, Saeed Salehi, Yingshan Chang, Ansh Soni, Konrad P. Kording

Department of Physics and Astronomy, University of Pennsylvania, Philadelphia, PA, USA 2Department, of Computer and Information Science, University of Pennsylva-, nia 3Machine Learning Group, Technical University of Berlin, Berlin, Germany 4Language Technology Institute, Carnegie Mel-, lon University, Pittsburgh, PA, USA 5Department of Psychology, University of Pennsylvania 6Department of Neuroscience, Univer-, available, KordingLab/formalizing-the-binding-problem., X inside,” combining elements from the middle-center and the

2026-06-03视觉感知

这篇论文针对多物体场景中模型常把颜色、形状等特征归错对象的绑定问题,提出用信息论把“对象是否存在”的可解码信息形式化为绑定信息,并用探针估计 ViT 表征中的该信息。实验显示,[CLS] token 只保留不到一半绑定信息且呈二次结构,而完整空间 token 几乎可完美解码;结果说明强视觉识别与推理依赖细粒度空间表征中的绑定能力。

AAD-1: Asymmetric Adversarial Distillation for One-Step Autoregressive Video Generation Figure 1
2026-06-03cs.CV

AAD-1: Asymmetric Adversarial Distillation for One-Step Autoregressive Video Generation

Haobo Li, Yanhong Zeng, Yunhong Lu, Jiapeng Zhu, Hao Ouyang, Qiuyu Wang, Ka Leong Cheng, Yujun Shen, Zhipeng Zhang

AutoLab, Department, University

2026-06-03视觉感知

面向实时流式视频/世界模型中的一阶段自回归图像到视频生成,AAD-1针对现有对抗蒸馏易运动坍塌、训练不稳的问题,提出生成器保持因果、判别器改为全时空双向注意力并输出视频级整体真实性评分的非对称设计,同时用分布匹配先热启动再对抗蒸馏。VBench实验显示其在一步自回归生成中达到SOTA,视觉质量和运动保真度更好,但快速运动、复杂结构和长程外推仍有限。

Video-Mirai: Autoregressive Video Diffusion Models Need Foresight Figure 1
2026-06-03cs.CV

Video-Mirai: Autoregressive Video Diffusion Models Need Foresight

Yonghao Yu, Lang Huang, Runyi Li, Zerun Wang, Toshihiko Yamasaki

The University of Tokyo, National Institute of Informatics, Peking University

2026-06-03视觉感知生成模型

这篇论文关注自回归视频扩散在流式生成中“只学当前、不规划未来”导致的身份、布局和运动漂移。Video-Mirai 的核心洞察是让未来帧只作为训练期表征监督:用冻结的非因果前瞻编码器读取完整 rollout,并将目标蒸馏到因果隐状态,推理时不增加架构、FLOPs 或 KV-cache 成本。结果上,5 秒 VBench 总分由 83.8 提升到 84.6,30 秒长 rollout 的主体一致性和背景一致性也明显提高。

VLESA: Vision-Language Embodied Safety Agent for Human Activity Monitoring Figure 1
2026-06-03cs.CV

VLESA: Vision-Language Embodied Safety Agent for Human Activity Monitoring

Hanjiang Hu, Yiyuan Pan, Jiaxing Li, Xusheng Luo, Alexander Robey, Na Li, Yebin Wang, Changliu Liu

Carnegie Mellon University, Mitsubishi Electric Research Laboratories, Harvard University

2026-06-03视觉语言视觉感知安全鲁棒

面向智能眼镜、协作机器人等物理场景中错误后果不可逆的问题,VLESA强调安全判断必须同时预测未来动作并依赖人的意图:同一动作在不同目标下可安全或危险。其核心是从第一视角视频联合推断目标与候选动作,再用基于机器人宪法标注的 EgoSafety 数据和 GRPO 训练目标条件 Q-filter 做约束解码。实验称在 ASIMOV-2.0 上干预时机与准确率优于基线,Q-filter 使动作安全性提升超过 41 个百分点,但真实长尾视频鲁棒性仍文中未充分说明。

Demo2Tutorial: From Human Experience to Multimodal Software Tutorials Figure 1
2026-06-03cs.CV

Demo2Tutorial: From Human Experience to Multimodal Software Tutorials

Zechen Bai, Zhiheng Chen, Yiqi Lin, Kevin Qinghong Lin, Difei Gao, Xiangwu Guo, Xin Wang, Mike Zheng Shou

Show Lab, National University of Singapore, be available at https://github.com/showlab/, often a labor-intensive process. For instance, in a desktop

2026-06-03视觉语言

论文针对原始屏幕演示冗长、缺少语言说明和视觉指引,难以复用为人类或 GUI 代理学习知识的问题,提出 Demo2Tutorial:同步记录屏幕与交互日志,经 VLM 动作解析、层级步骤规划和图文教程生成,将操作经验压缩为可执行多模态教程。在 TutorialBench 上总体分数 86.2,高于人工教程 79.1;用于 OSWorld 可将 Chrome 中 GPT-5 代理成功率从 52.9% 提升到 70.6%,用户完成任务也快 10.5% 且 80% 更偏好教程。

SEAOTTER: Sensor Embedded Autoencoding with One-Time Transcode for Efficient Reconstruction Figure 1
2026-06-03eess.IV

SEAOTTER: Sensor Embedded Autoencoding with One-Time Transcode for Efficient Reconstruction

Dan Jacobellis, Neeraja J. Yadwadkar

Department of Electrical and Computer Engineering, The University of Texas at Austin

2026-06-03三维

面向云机器人中高分辨率视觉数据受限于端侧算力、功耗与上行带宽的问题,SEAOTTER将轻量传感器端自编码潜表示与云端一次性转码结合,并学习JPEG颜色变换和量化矩阵,使后续数据以标准JPEG被反复解码使用。文中报告在200:1压缩率下,相比AVIF编码快7倍、解码快3.5倍,ImageNet top-1提升8%,同时保持JPEG基础设施兼容。

Adaptive Causal Alignment for High-Confidence Adversarial Training Figure 1
2026-06-03cs.CV

Adaptive Causal Alignment for High-Confidence Adversarial Training

Zhiming Luo, Kejia Zhang, Yingxin Lai, Junwei Wu, Juanjuan Weng, Shaozi Li

Department of Artificial Intelligence, Xiamen University, Xia-, Department of Computer Science, Emory University, GA, College of Information Science and Technology, Jinan Univer-

2026-06-03视觉感知

论文关注逆对抗训练中“高置信度”并不一定来自目标语义的问题,指出背景上下文既可能是有用先验,也可能形成伪相关,盲目抑制会造成特征损失。为此提出 HICAT,通过可学习背景偏差估计、 自适应 logit 去偏和 FLOE 正交约束实现因果对齐。在 CIFAR-10/100 与 ImageNet-1K、CNN 和 ViT 上,相比匹配基线提升鲁棒性并缩小鲁棒泛化差距。

GARDEN: Gravity-Aligned Reconstruction of Disentangled ENvironments from RGB images Figure 1
2026-06-03cs.CV

GARDEN: Gravity-Aligned Reconstruction of Disentangled ENvironments from RGB images

Jiahao Sun, Dingkun Wei, Zehong Shen, Hongyu Zhou, Yujun Shen, Liang Li

Zhejiang University

2026-06-03视觉感知三维

GARDEN针对RGB多视角重建虽逼真但缺少物理坐标、前景物体与背景纠缠,难以用于机器人交互和仿真的问题,提出以重力作为通用先验,将场景对齐到Gravity-View坐标系,并重建带6-DoF位姿的独立刚体网格,再用条件3D点分类清除背景中的重复物体几何。实验显示其较CAD检索式流程提升物体放置与解耦质量,并将LiteReality等流程耗时从约4330秒降至560秒。

Benchmarking Visual State Tracking in Multimodal Video Understanding Figure 1
2026-06-03cs.CV

Benchmarking Visual State Tracking in Multimodal Video Understanding

Sihyun Yu, Nanye Ma, Pinzhi Huang, Hyunseok Lee, Shusheng Yang, June Suk Choi, Ellis Brown, Oscar Michel, Boyang Zheng, Jinwoo Shin, Saining Xie

New York University

2026-06-03视觉语言视觉感知数据集/基准

现有视频理解评测常可依赖关键帧或终态作答,难以检验机器人等场景所需的连续状态跟踪。本文提出 VSTAT 基准,含 834 段合成与真实过程视频、1500 个必须跨全视频整合事件的问题。实验显示,先进 MLLM 远低于人类且仅略高于答案先验;诊断表明主要瓶颈不是文本推理,而是事件识别、实体关联和状态更新等视觉感知失败,视频/代码智能体也未能明显缓解。

PatchScene: Patch-based Voxel Diffusion for Large-Scale Scene Completion Figure 1
2026-06-03cs.CV

PatchScene: Patch-based Voxel Diffusion for Large-Scale Scene Completion

Qingdong Xu, Jiajun Zhu, Shilin Zhu, Xinjing He, Chao Lu, Huanran Wang, Jiyao Zhang

Peking University, Northeastern University, China, Northwest Polytechnical University, Xi’an, retraining, highlighting its strong scalability and general-, ther validates its flexible spatial scalability. Finally, the in-, pancy state (occupied / free) and semantic labels of each

2026-06-03生成模型

面向自动驾驶中稀疏、远距且有遮挡的 LiDAR 场景补全,PatchScene 将大场景拆为局部体素 patch,直接在显式体素空间做扩散生成,并用置信度引导的时空融合连接重叠区域与相邻帧;其 Annular-Flow 策略按 LiDAR 径向密度由近到远传播信息。SemanticKITTI 上报告达到 SOTA,且 20m 训练可泛化到 50m,显示较强尺度扩展与时序一致性。

Bootstrap Your Generator: Unpaired Visual Editing with Flow Matching Figure 1
2026-06-03cs.CV

Bootstrap Your Generator: Unpaired Visual Editing with Flow Matching

Yoad Tewel, Yuval Atzmon, Gal Chechik, Lior Wolf

2026-06-03生成模型

针对图像/视频编辑依赖海量成对样本、长尾创意编辑难以采集监督的问题,ByG提出无配对训练的flow matching编辑框架:用冻结生成基模型提取指令语义信号,以循环一致性保持源结构,并通过类似STE的梯度路由把干净输出损失传回噪声训练状态。实验显示其在数据稀缺图像与视频编辑中优于多种零样本和监督基线,用户偏好率超过训练于百万级配对数据的模型。

SparseStreet: Sparse Gaussian Splatting for Real-Time Street Scene Simulation Figure 1
2026-06-03cs.CV

SparseStreet: Sparse Gaussian Splatting for Real-Time Street Scene Simulation

Qingpo Wuwu, Xiaobao Wei, Peng Chen, Nan Huang, Zhongyu Zhao, Hao Wang, Ming Lu, Ningning Ma, Shanghang Zhang

Peking University, Chinese Academy of Sciences, University of Illinois, environments, which limit realism and scalability. To address these, scalability. To better model dynamic environments, several meth-, to address these scalability issues. One prominent line of work

2026-06-03三维

SparseStreet针对自动驾驶街景3D Gaussian Splatting中高斯数量过多、存储和渲染开销大的问题,利用“动态目标需高保真、静态背景冗余更多”的洞察,提出可插拔压缩框架:按场景图节点学习剪枝强度,并在表示稳定后用融合权重与投影面积评估背景重要性再压缩。在Waymo和nuScenes上接入StreetGS、OmniRe,可减少最高约80%高斯基元,动态物体质量基本保持,渲染FPS约提升2倍。

MAdam: Metric-Aware Multi-Objective Adam Figure 1
2026-06-03cs.LG

MAdam: Metric-Aware Multi-Objective Adam

Fengbei Liu, Rachit Saluja, Sunwoo Kwak, Ruibo Wang, Ruining Deng, Heejong Kim, Johannes C. Paetzold, Mert R. Sabuncu

Delft University of Technology

2026-06-03视觉感知

本文关注多目标学习中常见的“先由 MOO 求解器合成方向、再交给 Adam 更新”流程,指出 Adam 二阶矩会稀释动态偏好并改变求解器假设的欧氏几何。MAdam 以偏好条件化的对角 Fisher 对合成梯度做预条件,作为不改求解器和 Adam 的包装器。实验覆盖多任务、Pareto 前沿、PINN 与医学影像,整体上相对 Adam 稳定提升各类基线。

An Attention-Based Denoising Model for Diffusion Weighted Imaging Figure 1
2026-06-03cs.CV

An Attention-Based Denoising Model for Diffusion Weighted Imaging

Prithviraj Verma, Pawan Kumar, Chandan Deshani, Prasun Chandra Tripathi

2026-06-03生成模型

针对缩短 DWI 扫描时间后信噪比下降、幅值重建带来信号相关 Rician 噪声且 CNN 难以建模长程结构的问题,论文提出噪声级条件化的 Swin Transformer–Restormer 去噪框架,用窗口自注意力、通道门控细化和残差重建适配 1%–15% 噪声。实验在合成污染 DWI 上取得平均 PSNR 33.69 dB、SSIM 0.8539,但真实临床泛化与相对增益来源文中仍需更充分说明。

Electromagnetic Navigation for Femoral Osteotomy Using High-Accuracy X-ray-to-CT Registration Figure 1
2026-06-03cs.CV

Electromagnetic Navigation for Femoral Osteotomy Using High-Accuracy X-ray-to-CT Registration

Roman Flepp, Arend Nieuwland, Bastian Sigrist, Philipp Fürnstahl, Lilian Calvet, Thomas Dreher

Department of Pediatric Orthopedics and Traumatology, University, Research in Orthopedic Computer Science, University Hospital, Balgrist, University of Zurich, Switzerland., Department of Orthopedic Surgery, University Hospital Balgrist, University of Zurich, Switzerland.

2026-06-03机器人

股骨截骨中,术前 CT 计划难以准确、低创且低辐射地转移到术中,徒手依赖多次透视,PSI 又有暴露和制造成本。本文将两张术中透视的 C 臂校准/X-ray-to-CT 配准与电磁跟踪结合,实现锯片和骨片相对术前计划的实时无透视导航。在 18 根合成股骨实验中,角度误差较徒手从 6.32°降至 3.05°,无病例超过 5°阈值,并在角度和平移精度上与 PSI 统计等效,但仍需尸体和临床验证。

OVO-S-Bench: A Hierarchical Benchmark for Streaming Spatial Intelligence in Multimodal LLMs Figure 1
2026-06-03cs.CV

OVO-S-Bench: A Hierarchical Benchmark for Streaming Spatial Intelligence in Multimodal LLMs

Yifei Li, Pengyiang Liu, Yuhang Zang, Zhongyue Shi, Qi Fu, Hongye Hao, Jiwen Lu

Tsinghua University, Shanghai AI Laboratory, Beihang University

2026-06-03视觉语言数据集/基准

面向机器人、AR 和自动驾驶中的在线空间理解,本文指出现有视频/空间基准多给完整视频或偏事件记忆,难以检验因果视角流中的空间建图。OVO-S-Bench 以查询时间戳+证据区间限制模型只看前缀,人工构建 348 段视频 1680 题,覆盖从当前感知到自中心/他中心建图的四层能力。38 个 MLLM 测试显示最强 Gemini-3.1-Pro 仍落后人类 27 分,L4 拓扑建图是主要瓶颈,专门流式/空间微调模型常低于原 backbone,未落地的 CoT 还会放大空间错误。

CoralBay: A Self-Supervised CT Foundation Model Figure 1
2026-06-03cs.CV

CoralBay: A Self-Supervised CT Foundation Model

Ioannis Gatopoulos, Nicolas Känzig, Sebastian Otálora, Fei Tang

2026-06-03视觉感知

针对2D自然图像预训练难以刻画CT体数据的三维连续性、HU强度语义和各向异性问题,CoralBay将DINO自蒸馏扩展到层次化3D Swin,并对多尺度特征拼接监督,结合3D裁剪与随机HU窗等放射学增强。文中报告其在多类放射分类与分割任务上稳定迁移,两个规模模型用更少数据取得较强表现,并通过eva提供可复现3D榜单。

Beyond Encoder Accumulation: Measuring Encoder Roles in Multi-Encoder VLMs Figure 1
2026-06-03cs.CV

Beyond Encoder Accumulation: Measuring Encoder Roles in Multi-Encoder VLMs

Wei Ding, Yudong Zhang, Ruobing Xie, Xingwu Sun, Jiansheng Chen, Yu Wang

Tsinghua University, Tsinghua University, Tencent, University of Macau, University of Science and Technology Beijing

2026-06-03视觉语言

多视觉编码器VLM常靠堆叠异构编码器提分,但推理时遮蔽难以反映联合训练中的真实作用。本文在Cambrian-1套件上重训五个编码器的31个非空子集,提出Capacity–Necessity分解并用预投影有效秩解释组合差异。结果显示重训排名与遮蔽法不一致,ConvNeXt+CLIP两编码器已接近五编码器性能,新增编码器收益迅速递减。

MLP Splatting: Object-Centric Neural Fields Figure 1
2026-06-03cs.CV

MLP Splatting: Object-Centric Neural Fields

Shinjeong Kim, Yuzhou Cheng, Xin Kong, Paul H. J. Kelly, Andrew J. Davison

Department of Computing, Imperial College London

2026-06-03视觉感知

针对 NeRF/3DGS 难以天然按物体分解、需额外分割才能编辑的问题,MLP-Splatting 将场景表示为少量具局部支撑的独立小 MLP primitive,用稀疏体渲染组合,并让物体/部件级结构在 RGB 监督下自然涌现,可选蒸馏语义特征支持开放词汇交互。实验在 Replica/ScanNet 上保持相近或更好新视角质量,较语义 3DGS 约 1/15 显存、3× 渲染速度,同时给出内存-误差理论解释。

Seg2Track++: Probabilistic Track Validation and Data Association for Multi-Object Tracking and Segmentation Figure 1
2026-06-03cs.CV

Seg2Track++: Probabilistic Track Validation and Data Association for Multi-Object Tracking and Segmentation

Diogo Mendonça, Tiago Barros, Cristiano Premebida, Urbano J. Nunes

2026-06-03视觉感知

面向自动驾驶等动态场景中的多目标跟踪分割,论文指出直接用 SAM2 容易因关联不稳和误检持续传播形成幽灵轨迹。Seg2Track++在实例分割与 SAM2 外加入轨迹管理,用掩膜质心距离、置信度调制关联和基于 Bernoulli 滤波的概率轨迹验证来抑制假轨迹。在 KITTI MOTS 上,相比原 Seg2Track-SAM2 提升身份保持与鲁棒性,并减少误检传播,且无需微调。

DyaPlex: Full-Duplex Speech-Motion Model for Dyadic Interaction Figure 1
2026-06-03cs.CV

DyaPlex: Full-Duplex Speech-Motion Model for Dyadic Interaction

Koki Nagano, Hongyu Liu, Seonwook Park, Tianye Li, Amrita Mazumdar, Christian Jacobsen, Shengze Wang, Michael Stengel, Rajarshi Roy, Ka Chun Cheung, Simon See, Shalini De Mello

2026-06-03视觉感知

DyaPlex针对双人交流中语音与肢体动作同时感知、同时回应的需求,解决以往方法离线生成或只看语音/粗略位置而缺乏闭环互动的问题。它冻结全双工语音模型,新增可流式运动塔,通过双人动作token交错与时间对齐RoPE跨注意力耦合语音隐状态和动作序列。在4000小时Seamless Interaction训练后,文中报告其在单人和双人交互基准上达到SOTA,但部分增益可能主要来自scaling / data。

Visual Instruction Tuning Aligns Modalities through Abstraction Figure 1
2026-06-03cs.CV

Visual Instruction Tuning Aligns Modalities through Abstraction

Luis Palacios, Lorenzo Basile, Diego Doimo, Alberto Cazzaniga

2026-06-03视觉感知

论文关注视觉指令微调如何把图像特征接入预训练 LLM 的层级表征,而不只是经验提升 VLM 性能。作者在多种开放 VLM 上用因果干预、语义探针和表示几何比较发现,跨模态整合主要发生在中间语义抽象层,早期层更偏单模态处理;消融这些层性能下降最大。进一步只微调中间层即可接近全量微调,尤其在视觉中心任务上保持效果并降低训练时间。

Unified Video-Action Joint Denoising for Dexterous Action and Data Generation Figure 1
2026-06-03cs.CV

Unified Video-Action Joint Denoising for Dexterous Action and Data Generation

Dingrui Wang, YuAn Wang, Jinkun Liu, Yue Zhang, Mattia Piccinini, Yu Sun, Johannes Betz

Technical University of Munich, Tsinghua University

2026-06-03视觉感知

论文针对灵巧操作中纯动作预测缺少对接触后视觉演化建模、且成对视频-动作数据昂贵的问题,提出 Donk:在视频扩散 Transformer 上联合去噪视频 latent 与双手 MANO 动作 token,把带初始图像的 TI2VA 策略和纯文本 T2VA 数据生成统一为同一条件生成模型。实验显示其在 OakInk 上提升手部 RMSE 与腕部轨迹误差,同时保持较好视频质量(LPIPS 0.2992),并能从文本生成较平滑的对齐视频-动作 rollout。

Where Do We (Not) Need Temporal Context in Low-Resource Video Task Adaptation? Figure 1
2026-06-03cs.CV

Where Do We (Not) Need Temporal Context in Low-Resource Video Task Adaptation?

Luc P.J. Sträter, Hazel Doughty

Leiden University, these models still require adaptation to task-specific objectives, label spaces or domains. This is, and removes the need for elaborate task-specific decoders. (4) Temporal modeling is driven by the

2026-06-03视觉感知

本文关注低资源视频任务中,PEFT 与探测头应把时间上下文放在骨干、适配模块还是预测头的问题。作者系统比较图像/视频预训练骨干、LoRA/AdaptFormer/ST-Adapter 等方法及不同探测头,提出“时间上下文分配”视角。结果显示,视频预训练骨干配合标准 PEFT 通常优于图像到视频适配;运动任务偏好注意力式适配,空间密集预测更适合 MLP 式适配;简单 attentive probe 与 PEFT 结合后已足够,骨干仍是时间建模和吞吐瓶颈。

Conditional Latent Diffusion Model with Fourier-based Motion Modelling for Virtual Population Synthesis Figure 1
2026-06-03cs.CV

Conditional Latent Diffusion Model with Fourier-based Motion Modelling for Virtual Population Synthesis

Shaokun Lan, Haoran Dou, Jinghan Huang, Arezoo Zakeri, Fengming Lin, Zherui Zhou, Jinming Duan, Alejandro F. Frangi

2026-06-03生成模型

面向心血管器械 in-silico 试验所需的动态虚拟人群,本文针对现有网格生成多偏静态、序列模型心动周期闭合不稳的问题,提出 4D F-MeshLDM:先用 Mesh VAE 表示解剖,再在潜空间用截断傅里叶系数显式建模周期运动,并以条件扩散生成系数 token。基于 5000 名 UK Biobank 数据,模型在解剖保真度上优于多种基线,周期闭合误差接近零,且较好保持临床功能指标。

TeX-1500: A Paired Real-World LWIR Hyperspectral Dataset and Benchmark for Temperature-Emissivity-Texture Decomposition Figure 1
2026-06-03cs.CV

TeX-1500: A Paired Real-World LWIR Hyperspectral Dataset and Benchmark for Temperature-Emissivity-Texture Decomposition

Cheng Dai, Jiale Lin, Hongyi Xu, Bingxuan Song, Ziyang Xie, Fanglin Bao

2026-06-03强化学习数据集/基准

针对现有长波红外高光谱 TeX 分解多依赖逐场景逆优化、缺少跨真实场景配对监督的问题,论文构建 TeX-1500:包含 1,522 组校准 LWIR HSI 与温度、发射率、纹理标签,并统一恢复与标定流程;同时给出波长感知 TeX-UNet 基线。实验在 DARPA 留出场景及 FTIR 零/少样本迁移上验证该数据可用于监督学习和可量化评测,但性能增益可能主要来自数据与协议规模化。

Template Collapse and Information-Theoretic Limits in Camera rPPG Pulse Morphology Restoration Figure 1
2026-06-03cs.CV

Template Collapse and Information-Theoretic Limits in Camera rPPG Pulse Morphology Restoration

Achraf Ben Ahmed

2026-06-03视觉感知

本文针对消费级人脸摄像头 rPPG 能否恢复用于动脉僵硬评估的单周期脉搏形态这一问题,系统测试 3 个数据集 153 名受试者上的 16 类架构,并提出 cross-subject Pearson r 识别“模板坍缩”。结果显示所有模型均未恢复个体特异形态,SupCon 收敛到信息论空值;VAE 只补回群体平均谐波内容,抗坍缩目标在输入缺乏可辨别结构时也失效。

Beyond Compression: Quantifying Spectral Accessibility in Vision Representations Figure 1
2026-06-03cs.CV

Beyond Compression: Quantifying Spectral Accessibility in Vision Representations

Akayou A. Kitessa, Yijun Zhao

Fordham University

2026-06-03视觉感知

这篇论文关注视觉/视觉语言模型把图像特征压缩到共享嵌入时,是否只是降维,还是会选择性改变空间频率信息。作者用线性探针衡量各频段傅里叶能量的可恢复性,并提出相对随机投影基线的残差谱损失 RSL。结果显示 CLIP 与 DINOv2 的频谱可访问性随深度非单调变化,中间层最高、输出前下降;CLIP 投影基本谱中性,而 DINOv2 的 [CLS] 池化带来结构化频谱损失。

No Figure
2026-06-03cs.CL

Exploring Adversarial Robustness and Safety Alignment in Multilingual Multi-Modal Large Language Models

Hashmat Shadab Malik, Muzammal Naseer, Salman Khan

2026-06-03安全鲁棒

针对多模态大模型鲁棒与安全评测长期偏英语的问题,本文将多项基准翻译校验到12种语言,系统考察对抗图像与文本/图像越狱。核心发现是,对抗扰动可跨语言迁移;低资源语言看似更安全,往往源于模型读不懂指令或图中文字的“失败式安全”,而非真实对齐。相比仅做多语指令微调的 Palo、Parrot,训练全流程融入多语能力的 Qwen3-VL 表现出更稳定的跨语拒答。

Training-Free Multi-Concept LoRA Composition with Prompt-Aware Weighting Figure 1
2026-06-03cs.CV

Training-Free Multi-Concept LoRA Composition with Prompt-Aware Weighting

Georgios Tsoumplekas, Stella Bounareli, Vasileios Argyriou

Department of Networks and Digital Media, Kingston University London, UK

2026-06-03视觉感知

多概念文本到图像定制中,直接合并多个 LoRA 容易产生概念干扰并损害身份保真。论文的核心思路是在无训练解码阶段利用提示词中触发词的语义影响,为各 LoRA 输出自适应赋权,提出 W-Switch 与 W-Composite,并补充基于分割区域与参考图的 CLIP、DINO、ArcFace 评估。实验在 ComposLoRA 上显示视觉质量、身份保持和组合性均优于既有方法,用户与 LLM 评测也支持该结论。

SLU-2K: A Question-Based Benchmark for Semantic Evaluation of Sign Language Translation Figure 1
2026-06-03cs.CV

SLU-2K: A Question-Based Benchmark for Semantic Evaluation of Sign Language Translation

Zeno Testa, Antonino Furnari, Lorenzo Baraldi, Natalia Díaz-Rodríguez

University of Modena and Reggio Emilia, University of Catania, University of Granada, CITIC & DaSCI Institute, Spain, ness. Code, prompts, and benchmark files are available at

2026-06-03数据集/基准

本文针对手语翻译仍主要依赖 BLEU/ROUGE 等表层重合指标、难以衡量语义忠实的问题,提出从手语理解角度评测的 SLU-2K 基准:基于 PHOENIX-2014T 和 CSL-Daily 自动生成并过滤 2350 个封闭式视频问答,覆盖动作、地点、数字、时间等语义类别。实验显示通用 MLLM 接近随机,微调 SLT 系统也仅达 56.7%–75.2%,暴露出现有评测高估真实理解,尤其数字等精确信息仍是短板。

AmbientEye: A Dataset for Pupil Segmentation under Natural Ambient Infrared Illumination Figure 1
2026-06-03cs.CV

AmbientEye: A Dataset for Pupil Segmentation under Natural Ambient Infrared Illumination

Mingyu Han, Hyunyoung Han, Nitheekulawatn Thommakoon, Gangtae Park, Jieun Han, Xucong Zhang, Ian Oakley

Electrical Engineering, Korea Advanced Institute of Science and Technology, KR, Intelligent Systems Department, Delft University of Technology, NL

2026-06-03视觉感知数据集/基准

论文针对智能眼镜全天候眼动追踪中主动红外补光耗电高、户外自然红外未被现有数据集覆盖的问题,提出 AmbientEye 数据集:在无主动红外、自然阳光下采集35名受试者、双离轴视角和两种朝阳条件的约260万张眼图,并用 SAM2 加人工修订标注瞳孔。基准结果显示,现有分割模型性能从受控红外数据的0.928降至0.767,揭示户外被动红外下的几何畸变与光照饱和是关键难点。

Ultralytics YOLO26: Unified Real-Time End-to-End Vision Models Figure 1
2026-06-03cs.CV

Ultralytics YOLO26: Unified Real-Time End-to-End Vision Models

Glenn Jocher, Jing Qiu, Mengyu Liu, Shuai Lyu, Fatih Cagatay Akyon, Muhammet Esat Kalfaoglu

2026-06-03视觉感知

面向机器人等边缘场景中实时视觉既要低延迟又要易部署的问题,YOLO26在YOLO11基础上采用去DFL的双头结构,实现原生NMS-free推理,并用MuSGD、Progressive Loss和STAL分别改善收敛、推理头监督与小目标正样本覆盖;同时扩展分割、姿态、OBB和开放词汇YOLOE-26。其在COCO达40.9–57.5 mAP、T4 TensorRT延迟1.7–11.8 ms,较YOLO11提升1.6–2.8 AP并推进精度-延迟前沿。

Qwen-Image-Flash: Beyond Objective Design Figure 1
2026-06-03cs.CV

Qwen-Image-Flash: Beyond Objective Design

Tianhe Wu, Kun Yan, Zikai Zhou, Lihan Jiang, Jiahao Li, Jie Zhang, Kaiyuan Gao, Ningyuan Tang, Shengming Yin, Xiaoyue Chen, Xiao Xu, Yilei Chen, Yuxiang Chen, Yan Shu, Yixian Xu, Yanran Zhang, Zihao Liu, Zhendong Wang, Zekai Zhang, Deqing Li, Liang Peng, Yi Wang, Jingren Zhou, Chenfei Wu

2026-06-03视觉感知

该文针对扩散/流式视觉生成推理步数高、难以交互部署的问题,指出少步蒸馏不能只依赖目标函数设计,而要系统组织训练配方。作者以 Qwen-Image-2.0 为例分析数据组成、教师引导和文生图/编辑任务混合,发现多样数据未必更好,单类一致数据可跨域迁移,并提出逐步多教师引导。最终 Qwen-Image-Flash 在仅 4 次 NFE 下统一支持文生图与指令编辑,保持较强质量。

Beyond False Stability: High-Noise Drift Gating for Test-Time Adversarial Defenses in Vision-Language Models Figure 1
2026-06-03cs.CV

Beyond False Stability: High-Noise Drift Gating for Test-Time Adversarial Defenses in Vision-Language Models

Hashmat Shadab Malik, Muzammal Naseer, Salman Khan

2026-06-03视觉语言视觉感知

本文针对 CLIP 等视觉语言模型测试时防御常牺牲干净精度的问题,指出既有方法过度关注弱噪声下的“伪稳定”:噪声增强后,对抗样本反而比干净样本产生更大特征漂移。基于此,作者提出无需训练的高噪声漂移门控,只在检测到对抗式不稳定时触发 TTC、AOM 等防御。13 个数据集上,该门控提升干净—鲁棒折中,细粒度数据平均指标如 TTC 从 65.7% 升至 71.4%,AOM 从 68.4% 升至 73.2%。

Text-to-Image Models Need Less from Text Encoders Than You Think Figure 1
2026-06-03cs.CV

Text-to-Image Models Need Less from Text Encoders Than You Think

Nurit Spingarn, Noa Cohen, Tamar Rott Shaham, Tomer Michaeli

Technion – Israel Institute of Technology

2026-06-03视觉感知

本文质疑文生图模型是否真的依赖大型文本编码器中的复杂上下文信息。作者构造可直接替换原嵌入的无上下文表示 BoT、BoW 与带位置词袋 BoPTW,隔离词义、词合并和词序作用。在 SD3、FLUX.1/2 上,BoPTW 在计数、空间关系、属性绑定等任务中与完整嵌入视觉质量和文本一致性相近,说明许多语言结构可能由图像生成器内部解析,而非文本编码器提供。

Investigating Adversarial Robustness of Multi-modal Large Language Models Figure 1
2026-06-03cs.CV

Investigating Adversarial Robustness of Multi-modal Large Language Models

Hashmat Shadab Malik, Muzammal Naseer, Salman Khan

2026-06-03安全鲁棒

本文针对MLLM因引入CLIP等视觉编码器而暴露于图像对抗扰动的问题,系统比较鲁棒视觉骨干、端到端对抗训练与测试时防御。核心洞察是鲁棒性迁移依赖大规模多模态对抗预训练而非单纯模型规模,并提出CLIP对齐诊断来预判可迁移性;非鲁棒骨干上直接对抗训练反而伤害性能。实验中相对受限即插即用基线,图像描述提升28 CIDEr、VQA提升11.7%,鲁棒骨干上再训练还有小幅增益,并降低视觉越狱毒性输出。

Face versus Body Tracking for Human-Robot Interaction: An Egocentric Dataset Figure 1
2026-06-03cs.RO

Face versus Body Tracking for Human-Robot Interaction: An Egocentric Dataset

Jessica Wenninger, Gabriel Skantze

2026-06-03机器人视觉感知数据集/基准

面向社交机器人近距离、第一视角交互中行人遮挡、出画和非线性运动导致的身份切换问题,本文用 Furhat 采集并标注了自我中心 HRI 跟踪数据集,系统比较人脸/身体跟踪、长时记忆与 ReID 的作用。核心发现是瓶颈更多在时序关联而非检测:长记忆可缓解遮挡,ReID显著稳定身体轨迹却会因侧脸敏感恶化人脸ID切换;优化管线较基线减少49% IDSW。

Does Language Shift Break Medical Vision-Language Models? Indonesian Radiology Visual Question Answering Case Study Figure 1
2026-06-03cs.CL

Does Language Shift Break Medical Vision-Language Models? Indonesian Radiology Visual Question Answering Case Study

Pieter Christy Yan Yudhistira, Dzaki Rafif Malik, Novanto Yudistira

Intelligent System Laboratory, Faculty of Computer Science, Brawijaya University, Malang, Indonesia

2026-06-03视觉语言视觉感知

本文关注医学视觉语言模型在非英语临床语境下是否失效:作者将 VQA-RAD 翻译为印尼语构建 IndoRad-VQA,并在固定影像、切换问题语言的设置下评估语言鲁棒性,引入双语归一化与 LRG 指标。七个开源通用、多语和医学 VLM 的实验显示,印尼语输入相较英语普遍下降约 8–25%,且医学预训练并不自动带来语言鲁棒性,常见错误包括 yes/no 翻转、术语理解和左右侧混淆。

A Fast Methane Detection Pipeline on Board Satellites Based on Mag1c-SAS and LinkNet Figure 1
2026-06-03cs.CV

A Fast Methane Detection Pipeline on Board Satellites Based on Mag1c-SAS and LinkNet

Jonáš Herec, Vít Růžička, Rado Pitoňák, Jan Sedmidubsky

2026-06-03视觉感知

面向高光谱卫星下行带宽受限、人工选区易漏检甲烷泄漏的问题,论文将传统甲烷增强产品改造成可在低功耗星载 CPU 上运行的检测流水线,提出 Mag1c-SAS 并结合轻量 LinkNet 去噪分割,同时评估波段选择与跨传感器泛化。结果显示 Mag1c-SAS 约比原 Mag1c 快 80 倍,配合 LinkNet 在 EMIT-MSeg 上 AUPRC 提升超 30 个百分点、在 STARCOP 上 F1 约高 4 个百分点,并通过硬件 profiling 证明资源占用较低。

Beyond Single Solution: Multi-Hypothesis Collaborative Deep Unfolding Network for Image Compressive Sensing Figure 1
2026-06-03cs.CV

Beyond Single Solution: Multi-Hypothesis Collaborative Deep Unfolding Network for Image Compressive Sensing

Wenxue Cui, Hualin Li, Yuhang Qin, Yifu Xu, Xiaopeng Fan, Debin Zhao

Harbin Institute of Technology, Harbin, China, Harbin Institute of Technology Suzhou Research Institute, Suzhou, China

2026-06-03视觉感知

本文针对图像压缩感知中深度展开网络通常只在单一解空间回归、难以处理病态逆问题多解性的局限,提出 MHC-DUN:在近端梯度展开框架内并行维护多假设,由 AlphaNet 预测空间可变步长,并用跨假设协同近端模块融合各候选解的内部结构与相互相关性;复合损失同时约束测量一致性、多样性和重建质量。实验显示其在 Set11、Urban100 等基准上较多种现有 CS 网络提升约 0.4–1.4 dB PSNR。

Graph Regularized Non-negative Reduced Biquaternion Matrix Factorization for Color Image Recognition Figure 1
2026-06-03cs.CV

Graph Regularized Non-negative Reduced Biquaternion Matrix Factorization for Color Image Recognition

Hailang Wu, Yonghe Liu, Bingxuan Yu, Chaoqian Li

School of Mathematics and Statistics, Yunnan University, Kunming

2026-06-03视觉感知

针对 NRBMF 虽能在约化双四元数域保持彩色像素非负性、但忽略样本局部几何结构的问题,本文将图拉普拉斯正则加入系数矩阵,促使相近图像获得相近低维表示,并给出交替投影梯度求解及收敛分析。在 CASIA-FaceV5、KDEF、Asirra 上,相比实值、四元数和 NRBMF 类方法多数设置下表现更优或相当。

A Benchmark for Semi-supervised Multi-modal Crowd Counting Figure 1
2026-06-03cs.CV

A Benchmark for Semi-supervised Multi-modal Crowd Counting

Haoliang Meng, Xiaopeng Hong, Yabin Wang, Wangmeng Zuo

Harbin Institute of Technology, Pengcheng Laboratory, standardized protocol that specifies the labeled-unlabeled data partition, across different labeled ratios. Next, to establish solid reference points, the generated pseudo-labels or predictions are often extremely noisy, leading to, standardized protocol that specifies the labeled-unlabeled data partition across, different labeled-unlabeled ratios. Next, to establish solid reference points, we, from two source modals through gated modal collaborative [14], auxiliary bro-, ing their prediction consistency to make efficient use of unlabeled data. For

2026-06-03数据集/基准

针对多模态人群计数依赖密集标注、而单模态半监督在弱光和遮挡下伪标签易失真的问题,本文首次定义半监督 RGB-T 人群计数基准,固定 5%/10%/40% 标注划分,并在 RGBT-CC、DroneRGBT 上统一评测。其核心贡献是将全监督多模态方法接入 Mean Teacher、将 RGB 半监督方法改造成门控双分支,以形成可复现实验参照;主要结果是给出现有方法在该设置下的系统性能表明该任务仍有明显改进空间,但具体最优增益来源文中未充分说明。

VidMsg: A Benchmark for Implicit Message Inference in Short Videos Figure 1
2026-06-03cs.CV

VidMsg: A Benchmark for Implicit Message Inference in Short Videos

Issar Tzachor, Michael Green, Rami Ben-Ari

2026-06-03视觉感知数据集/基准

短视频理解常停留在物体、动作或字幕层面,难以捕捉创作者隐含的劝告、态度或社会含义。VidMsg 将问题定义为“消息—视频”双向检索与诊断式多选 QA,采用先设定目标消息、再生成间接检索场景并经人工过滤显性表达的流程,构建 400 个 YouTube 短片、9 个主题和 52 类细粒度消息。实验显示现有强视频语言模型在该任务上仍不可靠;VidVec-Msg 通过文本侧适配提升检索,但仍留下明显空间。

TurtleAI: Benchmarking Multimodal Models for Visual Programming in Turtle Graphics Figure 1
2026-06-03cs.CV

TurtleAI: Benchmarking Multimodal Models for Visual Programming in Turtle Graphics

Chao Wen, Jacqueline Staub, Adish Singla

University of Trier

2026-06-03视觉语言数据集/基准

该文关注教育场景中的视觉编程评测缺口:现有VLM多在生产力导向任务上验证,难以说明其能否支持K-12 Turtle Graphics 学习。作者构建TurtleAI,含823个来自XLogoOnline真实任务的图像到Python代码复现基准,并提出少量种子驱动的合成数据生成方法。实验显示20多个VLM在真实任务上普遍低于30%成功率,Qwen2-VL-72B微调后约提升20%;错误分析指出瓶颈主要在空间推理、精确复现及视觉推理到代码实现的对齐。

SkelHCC: A Hyperbolic CLIP-Driven Cache Adaptation Framework for Skeleton-based One-Shot Action Recognition Figure 1
2026-06-03cs.CV

SkelHCC: A Hyperbolic CLIP-Driven Cache Adaptation Framework for Skeleton-based One-Shot Action Recognition

Yanan Liu, Anqi Zhu, Jingmin Zhu, Jun Liu, Hossein Rahmani, Mohammed Bennamoun, Farid Boussaid, Dan Xu, Qiuhong Ke

2026-06-03视觉感知

针对单样本骨架动作识别中标注稀缺、人体运动层级结构难以与动作语义对齐的问题,SkelHCC 将骨架序列与语言嵌入共享双曲 CLIP 空间,用负曲率建模关节—部位—全身的树状关系,并引入无需训练的 LLM 引导多粒度投票缓存进行测试时适配。其在 NTU RGB+D 60/120 和 PKU-MMD II 上超过现有方法,NTU120 两种基类设置较 SOTA 提升 6.7% 和 9.0%。

World Models Meet Language Models: On the Complementarity of Concrete and Abstract Reasoning Figure 1
2026-06-03cs.CV

World Models Meet Language Models: On the Complementarity of Concrete and Abstract Reasoning

Yucheng Zhou, Wei Tao, Yiwen Guo, Jianbing Shen

University of Macau

2026-06-03强化学习

这篇论文关注静态视觉输入下预测未来结果时,世界模型生成的视觉 rollout 与 MLLM 抽象推理如何互补但不可盲信的问题。核心洞察是将其表述为“受控具体推理”:模型需学习何时调用仿真、如何验证并决定依赖程度;PF-OPSD 用真实未来仅作训练期特权教师信号蒸馏这些决策。实验在 VRQABench 和 OpenWorldQA 上较基线提升 10.6% 与 10.9%,并增强对噪声或冲突 rollout 的鲁棒性。

PHASER: Phase-Aware and Semantic Experience Replay for Vision-Language-Action Models Figure 1
2026-06-03cs.RO

PHASER: Phase-Aware and Semantic Experience Replay for Vision-Language-Action Models

Ziyang Chen, Shaoguang Wang, Weiyu Guo, Qianyi Cai, He Zhang, Pengteng Li, Yiren Zhao, Yandong Guo

2026-06-03视觉语言视觉感知

这篇论文针对 VLA 机器人连续学习中新任务会遗忘旧技能的问题,指出传统经验回放按帧均匀采样会饿死短但关键的操作阶段,并忽略不同历史任务的干扰风险。PHASER 将缓存分配改为按子技能阶段均衡,并用语言、视觉、动作原型路由高风险历史阶段,另以 Auto-PC 自动找阶段边界。在 LIBERO 上跨三种 VLA 骨干,相比同预算 ER 最高提升 31% ASR,Goal 设置最终 ASR 达 87.8%。

UnsOcc: 3D Semantic Occupancy Prediction in Unstructured Scene via Rendering Fusion Figure 1
2026-06-03cs.CV

UnsOcc: 3D Semantic Occupancy Prediction in Unstructured Scene via Rendering Fusion

Ye Wu, Ruiqi Song, Baiyong Ding, Nanxin Zeng, Junjie Cheng, Yunfeng Ai

2026-06-03三维

面向露天矿等非结构化自动驾驶场景,论文指出稀疏布局、异形障碍和长尾类别会削弱传统检测与常规占用预测的融合效果。UnsOcc以图像-LiDAR多模态为基础,通过RenderFusion用深度与语义的双向渲染监督对齐跨模态特征,并用基于3D Gaussian Splatting的GSRefinement把稀疏3D占用投影到2D语义图以强化长尾监督。作者构建露天矿占用数据集,并在该数据集和nuScenes上报告优于现有方法的结果。

Diffusing in the Right Space: A Systematic Study of Latent Diffusability Figure 1
2026-06-03cs.CV

Diffusing in the Right Space: A Systematic Study of Latent Diffusability

Tianxiong Zhong, Xingye Tian, Xuebo Wang, Xin Tao, Pengfei Wan

2026-06-03视觉感知

本文针对潜扩散中“重建更好未必生成更好”的问题,系统比较不同 tokenizer 正则、架构和潜空间配置下的可扩散性指标。核心创新是提出 VIV,用 Flow Matching 中同一中间状态的速度歧义衡量潜空间难学程度。实验显示,VIV、语义可分性和空间结构与生成质量在多种扩散骨干上稳定相关,且语义与空间结构的联合指标比单一因素更能解释 gFID。

Eliciting Complex Spatial Reasoning in MLLMs through Wide-Baseline Matching Figure 1
2026-06-03cs.CV

Eliciting Complex Spatial Reasoning in MLLMs through Wide-Baseline Matching

Hao Zhong, Muzhi Zhu, Shenyan Zeng, Anzhou Li, Cong Chen, Hua Geng, Duochao Shi, Wentao Ye, Tao Lin, Hao Chen, Chunhua Shen

State Key Laboratory of CAD & CG, Zhejiang University, Westlake University

2026-06-03视觉感知

面向物理环境中的多模态模型,论文认为宽基线视图匹配能同时考察几何、遮挡、视角变化和细粒度感知,是空间推理的有效压力测试。作者构建 ReasonMatch-Bench,并从 RGB-D/SfM 视频3D数据自动生成可验证监督,提出带图像级视角递进和点级对应课程的 DCRL 强化学习。结果显示现有模型与人类差距明显,DCRL 将 ReasonMatch 表现提升到约70.5 F1,并迁移提升 OmniSpatial、MindCube 等空间基准。

When Attention Collapses: Stage-Aware Visual Token Pruning from Structure to Semantics Figure 1
2026-06-03cs.CV

When Attention Collapses: Stage-Aware Visual Token Pruning from Structure to Semantics

Jiahui Wang, Kai Zhang, Mai Han, Huanghe Zhang

Shandong University, National University of Singapore (Suzhou) Research Institute

2026-06-03视觉感知

这篇论文针对 VLM 推理中视觉 token 过多导致的延迟和显存开销,指出单纯按注意力剪枝会在深层视觉编码器中塌缩到语义相近区域,损失结构多样性。作者提出免训练的 STS:先用特征空间“排斥”采样保留全局结构覆盖,再在 LLM 中用指令感知交叉注意力过滤无关 token。多模型多基准实验显示其在激进压缩下仍能较好保持任务性能并提升推理效率。

Learned Non-Maximum Suppression for 3D Object Detection Figure 1
2026-06-03cs.CV

Learned Non-Maximum Suppression for 3D Object Detection

Timo Osterburg, Stefan Schütte, Torsten Bertram

Institute of Control Theory and Systems Engineering, TU Dortmund University, Germany.

2026-06-03视觉感知三维

针对LiDAR三维检测中NMS依赖手工阈值、难以利用候选框间关系的问题,本文把后处理改为检测级可学习重打分,提出基于自注意力的D2D-Rescore和BEV局部消息传递的GossipNet3D,并用贴合nuScenes指标的匹配监督训练。实验显示二者在不改动基础检测器、计算开销较小的情况下,相比CircleNMS提升mAP、NDS和真阳性质量,尤其利好小类与低频类别。

Efficient Transformer-Based Localized Patch Sampling for Choroid Plexus Segmentation in Multiple Sclerosis Figure 1
2026-06-03cs.CV

Efficient Transformer-Based Localized Patch Sampling for Choroid Plexus Segmentation in Multiple Sclerosis

Po-Jui Lu, Alessandro Cagol, Mario Ocampo-Pineda, Federico Spagnolo, Marina Mastantuono, Andreea-Alexandra Aldea, Jannis Müller, Özgür Yaldizli, Matthias Weigel, Lester Melie-Garcia, Roberta Magliozzi, Maria Pia Sormani, Ludwig Kappos, Jens Kuhle, Cristina Granziera

. TranslaƟonal Imaging in Neurology (ThINk) Basel, Department of Biomedical, Engineering, Faculty of Medicine, University Hospital Basel and University of Basel, . Department of Neurology, University Hospital Basel, Basel, Switzerland, . Research Center for Clinical Neuroimmunology and Neuroscience Basel (RC2NB), University Hospital Basel and University of Basel, Basel, Switzerland, . Neurology SecƟon of Department of Neurological and Movement Sciences, University, . Division of Radiological Physics, Department of Radiology, University Hospital Basel, . Department of Brain Sciences, Faculty of Medicine, Imperial College London, United

2026-06-03视觉感知

针对多发性硬化中侧脑室脉络丛可作为炎症和残疾相关影像标志物、但人工分割耗时的问题,论文提出在脑室内及周边区域做32³小块局部采样,并以SwinUNETR完成单模态或多模态MRI自动分割。其关键在于用解剖先验缩小搜索空间而非处理整脑大块;在388例独立测试中,MPRAGE+FLAIR的DSC达0.868,显著优于UXNET的0.858,同时计算量从22080降至91.8 GFLOPs,参数也少得多。

\textsc{CR-Seg}: Attention-Guided and CoT-Enhanced Coarse-to-Refined Reasoning Segmentation Figure 1
2026-06-03cs.CV

\textsc{CR-Seg}: Attention-Guided and CoT-Enhanced Coarse-to-Refined Reasoning Segmentation

Yifan Cao, Xiaocui Yang, Faxian Wan, Shi Feng, Daling Wang, Yifei Zhang

School of Computer Science and Engineering, Northeastern University Shenyang 110819, China

2026-06-03视觉感知

CR-Seg面向复杂语言描述下的推理分割,针对现有IRS跨模态对齐困难、ERS将推理压缩为框/点而易出现推理与答案不一致的问题,提出用MLLM注意力图作为可监督的空间-语义桥梁:EAP抽取注意力图和信息点交给SAM细化,GLCoT按全局到局部排除干扰物。实验显示其在ReasonSeg和新构建的FReasonSeg上优于LISA、LENS等,并以更少对齐训练数据取得更好表现。

Attend to Anything: Foundation Model for Unified Human Attention Modeling Figure 1
2026-06-03cs.CV

Attend to Anything: Foundation Model for Unified Human Attention Modeling

Wenzhuo Zhao, Ronghao Xian, Keren Fu, Qijun Zhao

code will be available at https://github., College of Computer Science, Sichuan University, Chengdu, China 2National Key Laboratory of Fundamental Science, on Synthetic Vision, Sichuan University, Chengdu, 610065, China.

2026-06-03视觉感知

针对现有人类注意力/显著性模型按图像、视频、音视场景和数据集割裂建模、跨场景泛化差的问题,AAM将注意力重写为由语言提示驱动的从一般到具体的认知蕴含层级,并用双曲空间表示;同时用Fokker–Planck动力学把视频注意力视为静态注意力的扩散演化。基于1.75M注视数据训练后,其在16个基准上平均较SOTA提升约6%,视频推理约快4倍。

Knowledge-Preserved Model Tuning in Null-Space for Robust Spatio-Temporal Video Grounding Figure 1
2026-06-03cs.CV

Knowledge-Preserved Model Tuning in Null-Space for Robust Spatio-Temporal Video Grounding

Haoxuan Chen, Xianqin Liu, Jian-Fang Hu

School of Computer Science and Engineering, Sun Yat-sen University, China, National Information Center of GACC (Guangdong), GuangZhou, China, Guangdong Province Key Laboratory of Information Security Technology, China, Key Laboratory of Machine Intelligence and Advanced Computing, Ministry of Education, China

2026-06-03视觉语言视觉感知安全鲁棒

针对时空视频定位在真实低质视频中因模糊、压缩等退化导致视觉语言对齐失效,且 LoRA 等统一微调会破坏高质样本预训练知识的问题,论文提出 Null-Space Tuning:冻结骨干,用质量自适应单元估计语义缺口,并基于冻结权重 SVD 将高质残差约束到零空间、低质修复导向非零空间。作者构建混合质量 STVG 基准,实验显示其较现有 PEFT 方法在低质恢复和高质知识保持上更稳健。

EvoMemNav: Efficient Self-Evolving Fine-Grained Memory for Zero-Shot Embodied Navigation Figure 1
2026-06-03cs.CV

EvoMemNav: Efficient Self-Evolving Fine-Grained Memory for Zero-Shot Embodied Navigation

Zuhao Ge, Xiaosong Jia, Chao Wu, Yuchen Zhou, Zuxuan Wu, Yu-Gang Jiang

Institute of Trustworthy Embodied AI (TEAI), Fudan University, Shanghai Key Laboratory of Multimodal Embodied AI

2026-06-03机器人

针对零样本具身导航中传统目标场景图丢失细粒度视觉证据、3D重建代价高且记忆难以复用的问题,EvoMemNav将原始视图作为核心记忆,构建房间-视图-物体层级的VSMGraph,并用预算化粗到细策略只在候选短名单上调用VLM;同时通过子任务后的反思写回更新节点先验。文中在GOAT-Bench和HM3D的物体、文本描述、图像目标任务上提升SR/SPL,减少同类目标误停并改善零样本泛化。

Structure-Guided Mixed Masked Pretraining and Spatial Continuity Regularization for Printed Circuit Board Defect Detection Figure 1
2026-06-03cs.CV

Structure-Guided Mixed Masked Pretraining and Spatial Continuity Regularization for Printed Circuit Board Defect Detection

Peitong Wang, Nuo Wang, Enxin Qin, Chengjin Yu, Hanyu Xuan, Yuanting Yan

2026-06-03视觉感知

面向AOI中PCB缺陷小、低对比且易被密集走线背景淹没,以及细长缺陷预测碎片化的问题,论文在YOLOv8s上引入结构引导混合掩码自监督预训练与稀疏卷积重建,学习PCB结构先验,并在微调时加入空间连续性正则约束同一缺陷的分散响应。在DsPCBSD+上达到85.5% mAP@0.5、52.3% mAP@0.5:0.95,较YOLOv8s分别提升1.4和1.6点。

AvatarMix: Identity-Preserving Cross-Avatar Composition for Outfit Personalization Figure 1
2026-06-03cs.CV

AvatarMix: Identity-Preserving Cross-Avatar Composition for Outfit Personalization

Zhaorong Wang, Yoshihiro Kanamori, Yuki Endo

University of Tsukuba

2026-06-03视觉感知

针对3D虚拟试衣中2D提升易损失服装/身份细节、分层服装建模易产生穿插的问题,AvatarMix改为在3DGS中直接组合用户头部与模特着装身体,并用SeamFix修补发颈接缝、可选FullbodyFix恢复重塑后的服装外观,结合GSReshape按用户体型重定向身体。实验显示其在服装保真和身份保持上达到SOTA,但具体增益在多大程度来自各模块仍需看消融细节。

Characterizing Detectability in 3DGS Poisoning: A Stage-wise Benchmark Figure 1
2026-06-03cs.CV

Characterizing Detectability in 3DGS Poisoning: A Stage-wise Benchmark

Quoc-Anh Bui-Huynh, Thanh Duc Ngo, Xue Geng, Kaixin Xu, Wang Zhe, Xulei Yang, Ngai-Man Cheung

Temasek Laboratories, Singapore University of Technology and Design, Vietnam National University, Ho Chi Minh City, University of Information Technology, VNU-HCM

2026-06-03数据集/基准三维

针对3DGS投毒研究多关注攻击成功、缺少防守侧可检测性评估的问题,本文提出Poison-3DGS基准,将多视图图像、SfM几何、训练动态和高斯参数按流水线阶段暴露出来。核心洞察是取证信号具有阶段依赖性:攻击注入点与最易检测阶段常不一致。实验显示不同攻击的最佳检测阶段差异明显,后期训练轨迹和模型参数往往提供早期不可见的强线索,说明3DGS安全应做流水线级检测。

Low-Frequency Shortcuts in Texture-Driven Visual Learning Figure 1
2026-06-03cs.CV

Low-Frequency Shortcuts in Texture-Driven Visual Learning

Utku Şirin, Cathy Hou, David Alvarez-Melis, Stratos Idreos

Harvard University, Kempner Institute

2026-06-03视觉感知

本文针对既有捷径学习研究多集中于形状主导基准、难解释纹理型视觉任务的问题,用 DCT 频率剪枝分析病理、织物、地形等领域,发现模型虽应依赖高频细粒度纹理,却常借少数低频成分决策。剪除低频成分可使谱行为更均衡,ID 准确率最高提升 8%,低频扰动下 OOD 鲁棒性最高提升 40%,但对高频扰动存在依赖增强的权衡。

TrAction: Action Recognition with Sparse Trajectories Figure 1
2026-06-03cs.CV

TrAction: Action Recognition with Sparse Trajectories

Jan F. Meier, Felix B. Mueller, Alexander Ecker, Timo Lüddecke

Institute of Computer Science and Campus Institute Data Science, University Göttingen, Germany, Max Planck Institute for Dynamics and Self-Organization, Göttingen, Germany

2026-06-03视觉感知

针对RGB视频动作识别计算开销大且易依赖物体/背景捷径的问题,TrAction将CoTracker3稀疏点轨迹与单目深度组成2.5D运动输入,并用轨迹Transformer及遮蔽轨迹预训练学习动作动态。该方法在SSv2、EPIC-Kitchens-100上达45%/54% top-1,预训练约提升5点;与DINOv2、V-JEPA 2融合在SSv2分别再增8.7和1.6点,说明轨迹特征与外观表征互补。

PersistGS: Differentiable Physics for Object Permanence in 4D Gaussian Splatting Figure 1
2026-06-03cs.CV

PersistGS: Differentiable Physics for Object Permanence in 4D Gaussian Splatting

Adrian Ramlal, John S. Zelek

University of Waterloo

2026-06-03三维

该文针对动态3DGS中物体被所有训练相机完全遮挡后缺少光度梯度、导致高斯退化和“物体恒存”失败的问题,引入可微刚体物理作为位置先验:按物体分解高斯与碰撞网格,从遮挡前轨迹估计摩擦和速度,并用物理模拟得到的SE(3)轨迹维持遮挡期物体。其质心轮廓损失降低约40%轨迹误差;合成实验较恒速外推提升2.46 dB PSNR,距真值轨迹上界仅0.19 dB。

Mixed-Modality Dual Face-Hair Retrieval Figure 1
2026-06-03cs.CV

Mixed-Modality Dual Face-Hair Retrieval

Quoc-Anh Bui-Huynh, Mai-Tuyen Lam, Dai-Anh-Tuan Nguyen, Thanh Duc Ngo

Vietnam National University, Ho Chi Minh City, Vietnam, University of Information Technology, VNU-HCM, Ho Chi Minh City, Vietnam, controllable visual retrieval across modalities., text can specify abstract semantic attributes or styles visually unavailable. The, reasoning, identity preservation, and controllable appearance variation within a

2026-06-03视觉感知

针对现有检索难以同时约束人脸身份与发型、且发型可由图像或文本表达的问题,论文提出 DFHR 混合模态双参考任务,并构建含超 18 万标注三元组的 DFHR-Bench;方法 MFHC 通过身份/发型解耦、伪 token 注入与多视图监督统一图文发型线索。主要结果是给出首个标准化评测与基线框架,但具体性能增益幅度在给定片段中未充分说明。

From 3D Perception to Safety Reasoning: A Graph-Based Framework for Real-Time Underground Mine Monitoring Figure 1
2026-06-03cs.CV

From 3D Perception to Safety Reasoning: A Graph-Based Framework for Real-Time Underground Mine Monitoring

Pasindu Ranasinghe, Simit Raval, Dibyayan Patra, Bikram Banerjee, Ismet Canbulat

aSchool of Minerals and Energy Resources Engineering, University of New South Wales, Sydney, bSchool of Science, Engineering and Digital Technologies, University of Southern Queensland, structure, linking perception outputs across reasoning stages. To overcome the scarcity of labelled

2026-06-03三维安全鲁棒

面向井下煤矿狭窄、低照和人机混行导致的近距碰撞、盲区与结构风险,论文把彩色三维点云从感知结果进一步组织为场景/时序图,串联语义分割、不确定性异常、规则检查、本地 LLM 与 GraphRAG 记忆推理。实验中感知模型达 92.7% 准确率、30 FPS;115 个危险场景中覆盖率由规则的 57% 提升到含上下文推理的 76%、含历史记忆的 93%。

PRISM: Synergizing Vision Foundation Models via Self-organized Expert Specialization Figure 1
2026-06-03cs.CV

PRISM: Synergizing Vision Foundation Models via Self-organized Expert Specialization

Ying Tang, Dong Li, Youjia Zhang, Zikai Song, Junqing Yu, Wei Yang

2026-06-03视觉感知生成模型

多种视觉基础模型各擅长语义、结构与纹理,但直接蒸馏到单一学生模型会产生梯度冲突和负迁移。PRISM将多教师蒸馏重构为“共识—冲突”动态权衡,采用双流MoE:共享锚点保留通用表征,条件路由专家分解并重组冲突知识,并用浅层去相关促进专门化。在PASCAL-Context和NYUD-v2上取得新的SOTA,表明稀疏自组织专家可更有效整合异构视觉知识。

PHAF-Personalized Hand Avatars in a Flash Figure 1
2026-06-03cs.CV

PHAF-Personalized Hand Avatars in a Flash

Meghana Shankar, Akanxit Upadhyay, Anmol Namdev, Green Rosh KS, Pawan Prasad BH

2026-06-03视觉感知

PHAF面向AR/VR中个性化手部化身难以兼顾真实纹理、可驱动网格和快速生成的问题,只需手心/手背两张图,通过语义引导的网格对齐、稠密纹理提取与视角引导修补,将高频外观直接映射到参数化手模型,避免逐实例优化。实验显示其视觉保真度接近或优于UHM、HARP、OHTA等方法,同时纹理生成约在2分钟内完成,速度提升约30倍,更适合端侧部署。

IDO: Incongruity-aware Distribution Optimization for Multimodal Fake News Detection Figure 1
2026-06-03cs.CV

IDO: Incongruity-aware Distribution Optimization for Multimodal Fake News Detection

Hengyang Zhou, Rongman Hong, Yuxuan Zhou, Jing Wang, Zhaoyan Pan

*Equal contribution 1Nanjing University 2University of Birm-, ingham 3East China Normal University 4Zhejiang University. Cor-, with news labels. The incongruity of fake news is signif-

2026-06-03视觉语言视觉感知优化算法

针对多模态假新闻中图文并非简单“不一致”、而常表现为事实语义与模态预测层面的隐性冲突,本文提出 IDO 框架,从不协调性而非跨模态一致性入手建模。方法用通道重加权提取与真伪判别相关的语义表示,并以真假样本的高斯相似度分布刻画事实不协调,同时通过不协调对比学习捕捉跨模态语义差异。实验显示其在多个公开 MFND 基准上超过现有方法,达到新的最佳表现。

A unified multi-task framework enables interpretable chest radiograph analysis Figure 1
2026-06-03cs.CV

A unified multi-task framework enables interpretable chest radiograph analysis

Lijian Xu, Ziyu Ni, Xinglong Liu, Xiaosong Wang, Hongsheng Li, Shaoting Zhang

Shenzhen University of Advanced Technology, Centre for Perceptual and Interactive Intelligence, the Chinese University of Hong Kong, Hong Kong, Shanghai Artificial Intelligence Laboratory, Shanghai, Department of Electronic Engineering, the Chinese University of Hong Kong, Hong Kong

2026-06-03视觉感知

胸片诊断需求大但现有AI多为黑箱且割裂分类、定位、分割与报告生成,难以支撑临床信任。论文提出IMT-CXR,用统一Transformer和医学指令微调模拟放射科流程,先识别疾病、刻画位置/大小/严重度等证据,再生成可追溯报告。其在10个CXR基准上表现有竞争力,四中心160份盲评中66% AI报告被认为诊断清晰度不低于原报告。

Enginuity: A Dataset and Benchmark for Vision-Language Understanding of Engineering Diagrams Figure 1
2026-06-03cs.CV

Enginuity: A Dataset and Benchmark for Vision-Language Understanding of Engineering Diagrams

Abhishek Kumar, Isha Motiyani, Tilak Kasturi, Ethan Seefried, Prahitha Movva, Tirthankar Ghosal

Oak Ridge National Laboratory

2026-06-03视觉语言视觉感知数据集/基准

工程维修图纸包含密集标注、专业符号及零件表交叉引用,现有VLM基准难以衡量这类能力。Enginuity构建首个开放工程图理解数据集,含2056对图纸-零件表、494个结构化抽取样本和60个专家VQA。四个前沿VLM虽能较好找出零件(Recall@all 0.61–0.87),但描述保真度很低(Token F1 0.03–0.18),自由问答推理也仅2.6–3.2/5,显示当前模型离可靠工程应用仍有明显差距。

SAMatcher: Co-Visibility Modeling with Segment Anything for Robust Feature Matching Figure 1
2026-06-03cs.CV

SAMatcher: Co-Visibility Modeling with Segment Anything for Robust Feature Matching

Xu Pan, Qiyuan Ma, Mingyue Dong, He Chen, Wei Ji, Xianwei Zheng

page are available at https://xupan.top/Projects/samatcher., the State Key Laboratory of Information Engineering in Surveying, Mapping, and Remote Sensing (LIESMARS), Wuhan University, Wuhan, P. R. China, Wei Ji is with the National Key Laboratory of Space Target Awareness, Space Engineering University, Beijing, P. R. China., scalable and generalizable region-level representations.

2026-06-03安全鲁棒

本文针对大视角、尺度变化和遮挡下局部/patch 级匹配易产生像素混淆的问题,提出先显式预测跨视图共可见区域再做匹配的 SAMatcher。其核心是将 SAM 扩展到双视图场景,通过对称跨视图交互、共享提示查询以及联合 mask-box 监督,把共可见掩码和框作为结构化先验约束对应搜索。实验显示其在挑战性匹配基准上提升了几何与视角变化下的鲁棒性,但具体增益相对不同组件和数据规模的来源仍需看消融细节。

Mamba-Enhanced Implicit Motion Learning for Audio-Driven Portrait Animation Figure 1
2026-06-03cs.CV

Mamba-Enhanced Implicit Motion Learning for Audio-Driven Portrait Animation

Xuan Wei, Jiahui Chen, Kaiheng Li, Mingyu Shao, Qingqi Hong

Department of Digital Media Technology, School of Film, Xiamen University, Xiamen, China, National Institute for Data Science in Health and Medicine, Xiamen University, Xiamen, China, Institute of Artificial Intelligence, Xiamen University, Xiamen, China, and the Giant Interactive Group Inc., driven frameworks, using the scalable motion transformation.

2026-06-03视觉感知

针对音频驱动肖像动画中关键点方法易产生形变、抖动且长时一致性不足的问题,论文提出两阶段隐式运动学习框架:先用DIT与深度分层/区域注意学习运动偏移和渲染,再用Mamba增强扩散模型由音频预测潜在运动特征。在MEAD、DiverseHeads和PATS上多数指标优于多种基线,推理也较快;但部分增益可能主要来自380小时自建数据与模型规模。

Towards Characterizing Scientific Image Utility and Upgradability Figure 1
2026-06-03cs.CV

Towards Characterizing Scientific Image Utility and Upgradability

WenZhe Li, Qihang Yan, Liang Chen, Junying Wang, Farong Wen, Yijin Guo, Chunyi Li, Zicheng Zhang, Guangtao Zhai

TongJi University, Shanghai Artificial Intelligence Laboratory, Shanghai Jiao Tong University, than plausible appearance. Even subtle defects, such as missing scale bars, mislabeled axes, or

2026-06-03视觉感知

论文针对科研图像“看起来真实但科学上错误”的问题,指出传统感知质量指标和通用多模态模型难以验证其证据有效性。作者提出 SIU2A 框架,将评价拆为错误可诊断与可修复的 Utility、以及修复后是否保持科学一致性的 Upgradability,并构建含四类受控错误和专家标注的基准。实验显示现有多模态理解与图像编辑模型在定位科学错误、生成可靠修复指令和忠实恢复方面均明显不足。

P\textsuperscript{2}-DPO: Grounding Hallucination in Perceptual Processing via Calibration Direct Preference Optimization Figure 1
2026-06-03cs.CV

P\textsuperscript{2}-DPO: Grounding Hallucination in Perceptual Processing via Calibration Direct Preference Optimization

Ruipeng Zhang, Zhihao Li, Haozhang Yuan, C. L. Philip Chen, Tong Zhang

Guangdong Provincial Key Laboratory of Computational AI Models and Cognitive Intelligence, School of Computer Science & Engineering, South China University of Technology, Pazhou Lab, Guangzhou, China, Engineering Research Center of the Ministry of Education on Health Intelligent Perception and, The code for model training and testing is available at:

2026-06-03视觉语言优化算法

本文针对 LVLM 幻觉中“已关注到关键区域却仍答错”及图像退化下鲁棒性不足的问题,指出传统 DPO 偏好对多为离线且偏文本语义,难以校正视觉处理瓶颈。P²-DPO 让模型基于增强/退化细节、干净/噪声图像自生成在线视觉偏好对,并加入动态缺陷加权与 Calibration Loss 对齐视觉证据和文本生成。实验显示其在幻觉基准、注意区域保真度和退化场景中优于若干依赖人工反馈的强基线。

SynCred-Bench: Benchmarking Synthetic Credibility in AI-Generated Visual Misinformation Figure 1
2026-06-03cs.CV

SynCred-Bench: Benchmarking Synthetic Credibility in AI-Generated Visual Misinformation

Junxiao Yang, Minghao Zhang, Xiaoce Wang, Haoran Liu, Shiyao Cui, Hongning Wang, Minlie Huang

The Conversational AI (CoAI) group, DCST, Tsinghua University

2026-06-03数据集/基准

生成模型已能伪造带有真实文字、版式和传播痕迹的截图、通知、票据等,使虚假信息获得“合成可信度”。论文提出 SynCred-Bench,将可信形式与可信流通两维系统化,构建600张中英伪造图及450张真实负样本。结果显示现有15个MLLM在5%误报率下平均TPR仅10.5%,开源检测器低于5%,人类也只有63%TPR,说明模型常把官方版式、截图噪声等表面可信线索误当真实性证据。

Beyond Semantics: Modeling Factual and Affective Perceptual Experiences from Vision-Language Data Figure 1
2026-06-03cs.CV

Beyond Semantics: Modeling Factual and Affective Perceptual Experiences from Vision-Language Data

Youssef Mohamed, Kenneth Ward Church, Mohamed Elhoseiny

genre and the pair’s emotion as proxy labels for the, emotion labels), learns effective mapping functions, severe context-length scalability issues on large

2026-06-03视觉语言视觉感知

该文针对同一图像在不同文化与情绪背景下会产生多重感知这一问题,提出超越语义标签的 P-Topics 建模,将视觉语言样本分解为客观事实与主观情感两类体验。PercepT 先用融合的 CLIP/情感嵌入做无监督 DEC 聚类并动态确定主题数,再用注意力池化把新图像映射到相关感知主题。在 ArtELingo/Affection 上,聚类分离度显著提升(SI 0.97 vs 0.37),映射 AUC 达 0.94 vs 0.77,人工评测也更偏好其主题。

Cross-Modality Feature Fusion Based on Structured State Space Duality for Multimodal Image Registration Network Figure 1
2026-06-03cs.CV

Cross-Modality Feature Fusion Based on Structured State Space Duality for Multimodal Image Registration Network

Zhikang Li, Yan Wu, Xin Hu, Yi Dai, Ming Li

Ming Li is with the National Key Laboratory of Radar Signal Processing, Xidian University, Xi’an 710071, China.

2026-06-03视觉语言视觉感知

针对多模态图像配准中模态差异、噪声和Transformer代价高导致共享结构特征难提取的问题,论文提出RegNetMamba-2,将SSD/Mamba-2引入粗到细无检测匹配,并设计跨模态交互CMI、多尺度融合MSF及特征scaling以强化边缘和结构信息。在VIS-SAR、VIS-IR、VIS-NIR数据集上,相比多种深度匹配方法取得更好的精度与效率,但具体增益可能主要来自SSD结构与scaling的共同作用。

IdEst: Assessing Self-Supervised Learning Representations via Intrinsic Dimension Figure 1
2026-06-03cs.LG

IdEst: Assessing Self-Supervised Learning Representations via Intrinsic Dimension

Julie Mordacq, Vicky Kalogeiton, Steve Oudot

sentations from unlabeled data. However, the stan-, able, label-free insights into their quality for downstream, selection without labels at a fraction of the computational, erties of deep neural networks (DNNs) in a label-free setting

2026-06-03视觉感知

本文针对自监督视觉表征评估依赖线性探测、成本高且需标签的问题,提出 IDEST:用最小生成树维度估计表征的内在维度,作为无监督几何代理。作者强调相比 TwoNN/MLE 等近邻估计,MST 在高维、样本稀疏和 SSL 依赖结构下更稳健;在 ImageNet、iNat、SUN397 等数据集和多类 SSL/视觉语言模型上,IDEST 与线性探测准确率呈显著负相关,并可用于无标签超参选择以降低计算开销。

TASE: Truncation-Aware Semantic Embeddings for 3D Scene Understanding and Editing Figure 1
2026-06-03cs.CV

TASE: Truncation-Aware Semantic Embeddings for 3D Scene Understanding and Editing

Tim-Felix Faasch, Jochen Kall, Lucas Nunes, Jens Behley, Cyrill Stachniss

University of Bonn, Bonn, Germany, narios. Current approaches provide limited support for controllable edit-, for structured, controllable editing. We argue that a semantic scene represen-, powerful interface for controllable scene manipulation., Controllable semantic abstraction is beneficial for scene editing since it al-, or autoencoding [31] address memory, but do not directly allow for controllable, ture, TASE enable controllable semantic abstraction: retaining more channels

2026-06-03三维

面向机器人、自动驾驶和仿真中对可控三维场景编辑的需求,TASE针对现有3DGS语义特征维度高、跨视角不一致且难以控制抽象层级的问题,将预训练2D特征投影为按通道截断可调的语义嵌入,并用尺度/平移等变损失去除位置偏置,配合ControlNet和扩散模型微调支持文本编辑。实验显示其在大几何变化编辑上明显优于既有方法,同时可用于3D语义分割。

SagaQA: A Multi-hop Reasoning Benchmark for Long-form Narrative Understanding in TV Series Figure 1
2026-06-03cs.CL

SagaQA: A Multi-hop Reasoning Benchmark for Long-form Narrative Understanding in TV Series

Galann Pennec, Zhengyuan Liu, Nicholas Asher, Philippe Muller, Nancy F. Chen

∞ \infty IRIT, University of Toulouse, France

2026-06-03数据集/基准

现有视频推理评测多停留在短片段或相邻事件,难以衡量模型对电视剧长程叙事的理解。SagaQA构建面向20集、约20小时内容的多视频、多模态、多跳抽象问答基准,平均需连接4个跨集事件。论文还比较并行、顺序与混合规划策略,结果显示混合规划在推理计划完整性和剧集定位上更稳定优于其他方法。

BA-T: An Iterative Transformer for Two-View Bundle Adjustment Figure 1
2026-06-03cs.CV

BA-T: An Iterative Transformer for Two-View Bundle Adjustment

Ganlin Zhang, Weirong Chen, Daniel Cremers, Xi Wang

2026-06-03视觉感知

论文针对前馈式两视图重建依赖深层跨视图注意力、缺少类似 BA 的自校正机制而一致性不足的问题,提出 BA-T:将位姿与局部几何的迭代信息传播做成可复用 Transformer 层,在隐式 token 空间按残差逐步细化,而非外接显式求解器。实验显示其随 3–4 次迭代提升位姿和几何精度,在仅约 38M、约为 DUSt3R 解码器 16% 参数下,达到或超过更大模型并优于同规模 ViSTA 变体。

VistaHop: Benchmarking Multi-hop Visual Reasoning for Visual DeepSearch Figure 1
2026-06-03cs.CV

VistaHop: Benchmarking Multi-hop Visual Reasoning for Visual DeepSearch

Hang He, Chuhuai Yue, Chengqi Dong, Chengcheng Wan, Ting Su, Haiying Sun, Jiajun Chai, Xiaohan Wang, Guojun Yin

East China Normal University, Shanghai Innovation Institute

2026-06-03数据集/基准

现有多模态视觉问答基准多停留在一次性看图或浅层推理,难以检验模型是否会反复定位证据并串联多区域线索。VistaHop构建300张图、25类场景和350个多跳任务,并配套VistaArena评测检索、局部查看与证据化推理。实验显示当前MLRM差距明显,最佳SenseNova-MARS-32B仅24.31% Pass@1,说明瓶颈在深层视觉搜索与证据融合。

PaddleOCR-VL-1.6: Expanding the Frontier of Document Parsing with Under-Optimized Region Refinement and Progressive Post-Training Figure 1
2026-06-03cs.CV

PaddleOCR-VL-1.6: Expanding the Frontier of Document Parsing with Under-Optimized Region Refinement and Progressive Post-Training

Zelun Zhang, Hongen Liu, Suyin Liang, Yubo Zhang, Yiqing Xiang, Jiaxuan Liu, Ting Sun, Manhui Lin, Yue Zhang, Changda Zhou, Tingquan Gao, Cheng Cui, Yi Liu, Dianhai Yu, Yanjun Ma

PaddlePaddle Team, Baidu Inc.

2026-06-03视觉感知

该文针对PaddleOCR-VL-1.5在高性能阶段残余错误集中于边界不稳、覆盖稀疏和监督不可靠区域的问题,提出面向欠优化区域的数据挖掘与修正框架,并结合专家共识、迭代Judge-and-Refine标注以及CPT-SFT-RL渐进后训练。模型保持0.9B规模,在OmniDocBench v1.6达到96.33% SOTA,并在真实文档与表格、图表、文本定位、印章等子任务上取得稳定增益。

FreeStreamGS: Online Feed-forward 3D Gaussian Splatting from Unposed Streaming Inputs Figure 1
2026-06-03cs.CV

FreeStreamGS: Online Feed-forward 3D Gaussian Splatting from Unposed Streaming Inputs

Ruiyang Chen, Feiran Li, Chu Zhou, Zonglin Li, Zhanyu Ma, Heng Guo

Beijing University of Posts and Telecommunications, China, National Institute of Informatics, Japan, sistency, as future observations are unavailable during inference. As a result

2026-06-03三维

FreeStreamGS面向无位姿视频流的在线3D Gaussian Splatting,动机是离线前馈方法依赖未来帧,而在线几何误差会累积并造成新视角渲染伪影。论文的核心洞察是内参逐帧漂移会引发尺度抖动,刚性反投影会放大位姿—深度耦合误差,因此提出DIR-Head统一锚定内参,并用DPR-Offsets修正高斯位置。实验显示其在无需未来帧和迭代优化的情况下,渲染质量接近离线前馈3DGS,并优于或竞争于在线方法。

Do Real-World Datasets Contain Natural Experiments? An Empirical Study Using Causal Feature Selection Figure 1
2026-06-03cs.AI

Do Real-World Datasets Contain Natural Experiments? An Empirical Study Using Causal Feature Selection

Gautam Gare, John Galeotti, Michael Mozer, Deva Ramanan, Nan Rosemary Ke

Carnegie Mellon University, the effects of an intervention or event, and may be more generalizable than findings from a laboratory, classification tasks. Specifically, we treat a sub-portion of the data (based on the classification label)

2026-06-03强化学习数据集/基准

这篇论文关注真实机器学习数据集中是否隐含“自然实验”,即部分样本受到非人为干预而导致分布变化。作者用 DCDI 做因果发现,并仅保留目标变量 Markov blanket 特征来训练分类器,以性能提升作为存在自然实验的证据。合成实验先验证该判据,随后在 11 个公开数据集上发现约 3 个可被此框架解释,并带来优于非因果特征选择的下游表现。

MariData: One-Step Unpaired Image Translation for Maritime Environments Figure 1
2026-06-03cs.CV

MariData: One-Step Unpaired Image Translation for Maritime Environments

Santeri Henriksson, Mehdi Asadi, Amin Majd, Juha Kalliovaara

* AIS Lab, Turku University of Applied Sciences, Turku, Finland

2026-06-03视觉感知

面向海上自主船在雾、黄昏和夜间数据稀缺且难以采集成对样本的问题,论文将 CycleGAN-turbo 用于一 步非配对海事图像翻译,并通过零卷积跳连绕过 VAE 压缩瓶颈以保留远处船只、航标等小目标结构。基于 7000 张图像的定性与可调强度实验显示,雾天和黄昏转换能较好保持语义结构,夜间模型则因数据分布不均出现人工岸灯等语义幻觉。

MemoGen: Can Past Experience Improve Future Text-to-Image Generation? Figure 1
2026-06-03cs.CV

MemoGen: Can Past Experience Improve Future Text-to-Image Generation?

Wenshuo Chen, Kuimou Yu, Bowen Tian, Jianfei Song, Shaofeng Liang, Haozhe Jia, Kan Cheng, Haosen Li, Kaishen Yuan, Lei Wang, Jiemin Wu, Songning Lai, Yutao Yue

The Hong Kong University of Science and Technology (Guangzhou), Scholarly, Guangzhou Ziyan Technology Co., Ltd., LimX Dynamics Technology Co., Ltd., Shandong University, Griffith University, Institute of Deep Perception Technology, Jiangsu Industrial Technology Research Institute (JITRI)

2026-06-03视觉感知

本文针对文本生成图像在隐含视觉约束、关系推理和外部知识场景中不稳定的问题,提出无需更新底层生成器的 MemoGen:在智能体层记录任务理解、检索证据、视觉反馈、成功策略与失败教训,并在后续相似任务中复用。基于 Qwen-Image,两轮演化后在 WISE 和 Mind-Bench 上超过 Nano Banana Pro、GPT-Image-1,表明经验记忆可作为测试时持续改进信号。

Follow-Your-Preference++: Rethinking Preference Alignment for Image Inpainting Figure 1
2026-06-03cs.CV

Follow-Your-Preference++: Rethinking Preference Alignment for Image Inpainting

Junkun Yuan, Yutao Shen, Toru Aonishi, Hideki Nakayama, Yue Ma

Zhejiang University, The University of Tokyo, Tsinghua University

2026-06-03视觉感知

本文关注图像修复中较少被系统研究的偏好对齐问题,动机是现有方法依赖单一奖励模型时易受评估偏差影响。作者用DPO和公开奖励模型重审偏好数据构造,发现奖励模型普遍可提供训练信号,但在亮度、构图、色彩上存在偏好并会导致reward hacking;简单及校准后的奖励集成可缓解偏差,并在BrushBench、EditBench及物体移除任务上超过既有方法。

Effect of Demographic Bias on Skin Lesion Classification Figure 1
2026-06-03cs.AI

Effect of Demographic Bias on Skin Lesion Classification

Ralf Raumanns, Gerard Schouten, Veronika Cheplygina, Josien P.W. Pluim

2026-06-03视觉感知

这篇论文关注皮肤病灶分类中训练集性别、年龄分布不均带来的公平性风险。作者用线性规划构造受控人口统计偏置数据集,并比较单任务、强化多任务与对抗学习三种 ResNet 策略。结果显示,性别偏差主要随数据不平衡传播,多任务/对抗在均衡或女性占优时可缩小差距,但男性占优时效果有限;年龄偏差则持续偏向年轻组,外部验证还表明域迁移会改变性能与偏置模式。

Reinforcement Learning from Cross-domain Videos with Video Prediction Model Figure 1
2026-06-03cs.CV

Reinforcement Learning from Cross-domain Videos with Video Prediction Model

Zhao Yang, Xinrui Zu, Jacob E. Kooi, Thomas Delliaux, He Liu, Shujian Yu, Kevin Sebastian Luck, Vincent François-Lavet

2026-06-03视觉感知强化学习

论文关注跨视觉域专家视频中无奖励、无动作标签导致机器人难以模仿的问题。作者提出 XIPER:先将智能体像素观测翻译到专家域,再用视频预测模型的下一帧似然作为密集奖励,从而避开域不变判别器和对抗训练。在 DMC 颜色与形态变化任务上优于三类基线,并在仿真到真实机器人数据中显示奖励与真实任务回报相关。

Inference-Time Scaling for Joint Audio-Video Generation Figure 1
2026-06-03cs.MM

Inference-Time Scaling for Joint Audio-Video Generation

Jaemin Jung, Kyeongha Rho, Inkyu Shin, Joon Son Chung

Korea Advanced Institute of Science and Technology, available on the project page: https://jung-jaemin.github.io/ITS-AVGen-Proj., The video samples are available at the following link.

2026-06-03视觉感知

针对联合音视频生成中单纯扩大训练成本高、且文本对齐、感知质量与音画同步目标彼此牵制的问题,本文首次系统研究推理时扩展(ITS)在该任务中的作用,指出单 verifier 易产生指标投机和性能 trade-off,并提出多 verifier 组合与自适应奖励加权(ARW)来在线校准异构奖励。实验在 VGGSound 与 JavisBench-mini 上显示,该框架可同时提升语义对齐、感知质量和音画同步。

GLINT: Sparsely Gated Vision-Language Alignment for Fine-Grained Radiology Representations Figure 1
2026-06-03cs.CV

GLINT: Sparsely Gated Vision-Language Alignment for Fine-Grained Radiology Representations

Jonggwon Park, Seongeun Lee, Junhyun Park, Hannah Yun, Hyunwoong Kim, Sohyun Jeong, Hyewon Kang, Byungmu Yoon, Kyoyun Choi

DEEPNOID Inc., Seoul, South Korea, Department of Artificial Intelligence and Data Science, Sejong University, Seoul, South Korea, Vision-language models (VLMs) for radiology have emerged as a scalable paradigm, Vision-language models (VLMs) have emerged as a scalable paradigm for medical image analysis [57, from a long tail findings beyond fixed label set [32]. It also mitigates the inter-annotator disagreement

2026-06-03视觉语言视觉感知

放射影像报告只给全局监督,而病灶常对应少量局部区域,导致现有VLM难学细粒度对齐。GLINT用独立门控嵌入中的sigmoid稀疏门选择与文本查询相关的patch,并以冻结SSL教师做密集特征正则以保留局部表征,统一支持2D胸片和3D胸CT。实验显示其在零样本定位、分割上增益最明显,并在分类、报告生成和监督分割中优于SSL编码器与医学VLM;文中还声称首次实现无掩码监督的3D CT零样本分割。

Ask When It Pays: Cost-Aware Open-Ended Interaction for Instance Goal Navigation Figure 1
2026-06-03cs.CV

Ask When It Pays: Cost-Aware Open-Ended Interaction for Instance Goal Navigation

Xunyi Zhao, Sihao Lin, Gengze Zhou, Zerui Li, Shijie Li, Wei Tao, Jiajun Liu, Qi Wu

Adelaide University, Responsible AI Research Centre, Australian Institute for Machine Learning, Institute for Infocomm Research (I2R), A*STAR

2026-06-03机器人

论文针对实例目标导航中“找哪个具体物体”常因描述粗略和干扰物而需询问的问题,指出以往把澄清与路线指导等价计费会鼓励过度求助。作者将交互建模为带成本的不确定性削减,基于语料挖掘得到外观、区域、路线、确认四类问题及权重,构建 Isaac Sim 基准和加权成功率,并提出零样本 MLLM 导航器 TANDEM。实验显示其在加权成功率上优于无交互和统一成本交互,困难场景收益最大。

JAVEDIT: Joint Audio-Visual Instruction-Guided Video Editing with Agentic Data Curation Figure 1
2026-06-03cs.CV

JAVEDIT: Joint Audio-Visual Instruction-Guided Video Editing with Agentic Data Curation

Yinan Chen, Chuming Lin, Zhennan Chen, Yuxiang Zeng, Junwei Zhu, Yali Bi, Xijie Huang, Chengming Xu, Donghao Luo, Zhucun Xue, Xiaobin Hu, Chengjie Wang, Yong Liu, Jiangning Zhang, Shuicheng Yan

Zhejiang University, Tencent Youtu Lab, Nanjing University, University of Auckland, Fudan University, National University of Singapore

2026-06-03视觉感知

针对现有指令式视频编辑多只改视觉、缺少音画同步数据与评测的问题,JAVEdit提出面向人物视频的JAVEdit-100k,覆盖主体/背景编辑、增删人和语音编辑,并用Agent-in-the-loop流水线替代人工筛选以控制跨模态对齐;同时给出JAVEditBench和基于LTX-2.3 LoRA微调的基线。实验中其在6项指标中5项优于对比方法,音画同步相对最强串联方案提升26%,但能力可能主要受数据规模与底座模型限制。

SRENet: Spectral Re-Entry Network for Point Cloud Action Recognition Figure 1
2026-06-03cs.CV

SRENet: Spectral Re-Entry Network for Point Cloud Action Recognition

Qiuxia Wu, Jiarui Lan, Wenxiong Kang, Zhiyong Wang, Kun Hu

2026-06-03视觉感知三维

本文针对点云动作序列的无序结构、帧间错位以及 Transformer 偏低频导致细粒度动作线索易丢失的问题,提出 SRENet 从频域建模运动:用 SDeBlock 沿时空轴小波分解高低频并分别注意,用 SReBlock 二次分解以恢复融合后被削弱的时频结构,并配合频谱对比学习与由低到高频的课程训练。实验在 MSR-Action3D、NTU-RGBD 和 NTU-RGBD120 上达到 SOTA,说明频率建模对点云动作识别有效。

NVIDIA OmniDreams: Real-Time Generative World Model for Closed-Loop Autonomous Vehicle Simulation Figure 1
2026-06-03cs.CV

NVIDIA OmniDreams: Real-Time Generative World Model for Closed-Loop Autonomous Vehicle Simulation

NVIDIA : Aarti Basant, Amlan Kar, Despoina Paschalidou, Fangyin Wei, Francesco Ferroni, Guillermo Garcia Cobo, Haithem Turki, Huan Ling, Jaewoo Seo, James Lucas, Jay Zhangjie Wu, Jialiang Wang, Jonathan Lorraine, Jun Gao, Kai He, Katarina Tothova, Kevin Xie, Michał Tyszkiewicz, Qi Wu, Riccardo de Lutio, Ruilong Li, Sanja Fidler, Seung Wook Kim, Tianchang Shen, Tianshi Cao, Tobias Pfaff, William Lew, Xindi Wu, Xuanchi Ren, Yifan Lu, Yuxuan Zhang, Zan Gojcic, Zian Wang

OmniDreams acts as a highly responsive, reactive environment, providing a scalable and comprehensive, Controllable Scenario Editing . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .

2026-06-03生成模型强化学习

面向自动驾驶长尾场景的安全闭环评测,OmniDreams试图突破重建式神经仿真受限于采集数据、难生成新天气和动态行为的问题。它从Cosmos扩散模型经21k小时驾驶数据中训练/后训练而来,以历史帧、仿真状态和车辆动作自回归生成实时多视角传感器视频,并接入AlpaSim/Alpamayo闭环。实验展示了较好的仿真质量、长时滚动和反事实编辑能力;其后训练为WAM后在NuRec上以约1/5参数超过Alpamayo 1.5,但具体增益可能主要来自数据与模型规模。

$A^2$: Smaller Self-Supervised ViTs Localize Better than Larger Ones Figure 1
2026-06-03cs.CV

$A^2$: Smaller Self-Supervised ViTs Localize Better than Larger Ones

Sreehari Rammohan, Huy Ha, Carl Vondrick

Columbia University, Stanford University

2026-06-03视觉感知

论文针对视觉分类在背景、共现物等空间伪相关下易被误导的问题,发现自监督 ViT 存在反常 scaling:小模型注意力更能定位前景,而大模型 patch 表征更强。A² 将“看哪里”和“提取什么”解耦,用小 ViT 注意力裁剪前景、再用大模型嵌入,无需组标签或端到端训练;在 5 个分布偏移基准上提升最差组准确率,强偏移下优于注意力重训练,并可与 DFR 互补。

Disentangling Visual and Factual Correctness in LVLMs' Visualization Literacy Figure 1
2026-06-03cs.CV

Disentangling Visual and Factual Correctness in LVLMs' Visualization Literacy

Soohyun Lee, Jaeyoung Kim, Seokhyeon Park, Sihyeon Lee, Jiwon Song, Bohyoung Kim, Hyunjoo Song, Jinwook Seo

capability does not predict prompt-controllability, indicating that, are available at https://github.com/JaeyoungKim-HCIL/CVLAT., Seo are with Seoul National University. E-mail: {shlee, shpark, sihyeon, Bohyoung Kim is with Hankuk University of Foreign Studies. E-mail:

2026-06-03视觉语言

论文关注 LVLM 图表理解评测中“看懂可视化”与“调用事实记忆”被混在一起的问题,提出区分视觉正确性和事实正确性的框架,并构造反事实 CVLAT 测试视觉—事实冲突下的仲裁。对 15 个模型的实验显示,标准 VLAT 高分不一定代表忠实视觉推理,多数模型偏向图表证据,少数会被先验事实覆盖;提示词可改变偏好但强烈依赖模型且方向不对称。

KC-3DGS: Kurtosis-Constrained Gaussian Splatting for High-Fidelity View Synthesis Figure 1
2026-06-03cs.CV

KC-3DGS: Kurtosis-Constrained Gaussian Splatting for High-Fidelity View Synthesis

Vivekjyoti Banerjee, Abhay Yadav, Rama Chellappa, Aniket Roy

Johns Hopkins University, NEC Labs America

2026-06-03三维

针对3DGS在稀疏视角下仅依赖L1/SSIM等像素损失易把误差转移到不同频段、导致过平滑和漂浮物的问题,KC-3DGS在训练中加入可微的小波域自然图像统计约束,包括多尺度系数对齐、峰度集中和跨频带协方差惩罚。该正则无需改网络,可插入现有3DGS;在多数据集上提升感知质量,WRIVA-ULTRRA的DreamSim改善9.48%,12视角MipNeRF360上PSNR最高增0.5 dB,但密集视角可能过正则并增加开销。

GuidedBridge: Training-freely Improving Bridge Models with Prior Guidance Figure 1
2026-06-03cs.CV

GuidedBridge: Training-freely Improving Bridge Models with Prior Guidance

Zehua Chen, Yucheng Yang, Binjie Yuan, Kaiwen Zheng, Jun S. Liu, Jun Zhu

2026-06-03视觉感知

桥模型适合图像到图像等已有干净先验的生成任务,但现有 CFG/AG 主要面向扩散噪声到数据过程,未充分利用桥过程的先验结构。本文提出无需训练的 Prior Guidance,通过构造弱先验与原先验的去噪差异来放大先验利用,并进一步按桥模型 U 形 SNR 动态对高低频 guidance scale 做 FMPG 调制;对修复任务还级联 CFG-FMPG。实验显示该方法可在 DDBM、DBIM 等预训练桥模型和多类图像翻译任务上提升生成质量且不降低采样效率。

Learning to See via Epiretinal Implant Stimulation in silico with Model-Based Deep Reinforcement Learning Figure 1
2026-06-03cs.LG

Learning to See via Epiretinal Implant Stimulation in silico with Model-Based Deep Reinforcement Learning

Jacob Lavoie, Marwan Besrour, William Lemaire, Jean Rouat, Réjean Fontaine, Eric Plourde

Department of Electrical Engineering and Computer Engineering, Universit´e de

2026-06-03强化学习

针对视网膜假体中上视网膜刺激常产生沿神经轴突延展的各向异性光幻视、传统方法试图抑制而导致可用形状受限的问题,本文将刺激选择建模为基于笔触渲染的强化学习任务,在 rlretina 中用经心理物理验证的轴突图模型生成虚拟患者感知,并训练模型式深度RL智能体组合各向同性与各向异性光幻视。结果显示,相比朴素下采样刺激策略,该方法在不同虚拟患者设置下生成的感知图像更可辨识。

FAF-CD: Frequency-Aware Fusion for Change Detection under Imperfect Multimodal Remote Sensing Figure 1
2026-06-03cs.CV

FAF-CD: Frequency-Aware Fusion for Change Detection under Imperfect Multimodal Remote Sensing

Yufan Wang, Sokratis Makrogiannis, Chandra Kambhamettu

University of South Florida, Delaware State University

2026-06-03视觉语言视觉感知

针对灾害监测中前后时相遥感影像常跨传感器、错时相并受光照季节干扰,伪变化易被误判为结构损伤的问题,FAF-CD在DINOv3预训练ConvNeXt与VMamba解码器之间加入校正感知三分支融合,同时做可变形空间对齐、FFT全局频域差异和Haar小波边界比较,并用门控融合。实验显示其在BRIGHT异构EO-SAR上优于NeXt2Former-CD,在LEVIR-CD/WHU-CD达0.924/0.955 cF1,且较NeXt2Former-CD少约24 GFLOPs。

No Figure
2026-06-03cs.CV

Inverting the Generation Process of Denoising Diffusion Implicit Models: Empirical Evaluation and a Novel Method

Yan Zeng, Masanori Suganuma, Takayuki Okatani

Graduate School of Information Sciences, Tohoku University, RIKEN Center for AIP

2026-06-03生成模型数据集/基准

本文关注确定性 DDIM 生成过程的反演:从生成图像恢复中间潜变量,尤其初始噪声,以支撑图像编辑和理解扩散模型。核心做法是在首个反演步用梯度下降直接求逆,后续步采用固定点迭代,并提出同一图像真/估计噪声间插值的 self-interpolation 测试。三数据集结果显示,既有方法虽可重建图像但常估不准初始噪声,而该混合方法在潜变量预测、重建和插值质量上均更好。

Zero-Shot 3D Question Answering via Hierarchical View-to-Token Transportation Figure 1
2026-06-03cs.CV

Zero-Shot 3D Question Answering via Hierarchical View-to-Token Transportation

Dongsheng Wang, Dawei Su, Hui Huang

2026-06-03三维

针对3D问答中将点云采样为多视图再交给2D VLM时,输入预算有限且视图/patch冗余会丢失关键空间证据的问题,论文提出KeyVT:先结合图像语义与相机位姿选择空间一致、任务相关的关键视图,再用最优传输在特征分布中压缩代表性token。实验称其在三个常用3D-QA基准上显著优于免训练方法,并接近部分需训练模型。

Hierarchical Federated Learning with Dynamic Clustering and Adaptive Regularization for Robust Infrastructure Inspection Figure 1
2026-06-03cs.CV

Hierarchical Federated Learning with Dynamic Clustering and Adaptive Regularization for Robust Infrastructure Inspection

Yuhu Feng, Keisuke Maeda, Takahiro Ogawa, Miki Haseyama

• Dynamic adaptive regularization mitigates client drift from imbalanced labels.

2026-06-03安全鲁棒

面向桥梁、隧道等基础设施巡检中数据因隐私难以集中、且跨结构类型与本地标签分布同时非 IID 的问题,论文提出 Clustered-DRAPR 分层联邦学习:用梯度动态聚类形成结构退化模式相近的专家组,并在组内按标签偏斜和梯度差异自适应近端正则以抑制客户端漂移。真实大规模道路巡检数据实验显示,其较 FedAvg、FedProx 等基线收敛更快、分类更稳健,尤其在极端异质场景下表现更好。

TGV-KV: Text-Grounded KV Eviction for Vision-Language Models Figure 1
2026-06-03cs.CV

TGV-KV: Text-Grounded KV Eviction for Vision-Language Models

Jizhihui Liu, Ruizi Han, Miao Zhang, Rui Shao, Xuebo Liu, Weili Guan, Yaowei Wang

2026-06-03视觉语言视觉感知

该文针对视觉语言模型推理中视觉 token 冗余导致 KV cache 显存随上下文线性增长、而直接套用 LLM 驱逐策略会因文视模态差异损伤性能的问题,提出以文本为锚的 TGV-KV:用文视注意分配层预算、用文本加权排序视觉 KV 重要性,并优先保留文本 KV。跨 LLaVA、Qwen 等模型实验显示,在仅保留 5% KV 时可大幅降显存,VizWiz-VQA 保持 99.2% 全 KV 精度,端到端吞吐提升 52.6%。

ROBUST-WT: Robust Uncertainty-aware Segmentation Transform via Whitening and Training Enhancements Figure 1
2026-06-03cs.CV

ROBUST-WT: Robust Uncertainty-aware Segmentation Transform via Whitening and Training Enhancements

Aqsa Naseer, Maryam Bibi, Syeda Samiya Urooj, Muhammad Khurram Shahzad

aSchool of Electrical Engineering and Computer Science (SEECS), National University of Sciences and Technology (NUST), Islamabad, Pakistan, source code and implementation details for the proposed improvements and baseline replication are publicly available, susceptible to inaccurate edge labels.

2026-06-03视觉感知安全鲁棒

本文针对跨设备、跨协议医学图像分割中的域偏移问题,认为原 WT-PSE 的训练流程在增强、损失和训练稳定性上限制了鲁棒性。作者不改动 whitening 与形状蒸馏架构,而加入域自适应增强、BCE+Dice 混合损失、Dice 权重课程调度及消融开关。眼底视盘分割实验中 OD Dice 从基线 0.939 提升到 0.956,ASD OD 为 13.31,说明增益主要来自训练层面的改进。

FCUS-rPPG: A Fast-Converging Unsupervised Framework for Remote Photoplethysmography via Gradient Oscillation Suppression Figure 1
2026-06-03cs.CV

FCUS-rPPG: A Fast-Converging Unsupervised Framework for Remote Photoplethysmography via Gradient Oscillation Suppression

Jiajie Li, Yu Liu, Rencheng Song, Xun Chen, Juan Cheng

2026-06-03优化算法

针对无监督 rPPG 依赖频域先验时梯度噪声大、收敛慢且跨域泛化差的问题,FCUS-rPPG 将 BVP 的多光谱协同与低维生理流形作为建模依据,设计光谱共享轻量骨干,并在梯度、损失地形和特征层引入后验证梯度掩蔽、扰动平滑与噪声零空间正则。五个数据集实验显示其从零训练仅需 1 个 epoch,并在跨数据集评测中达到 SOTA。

MUSE: A Unified Agentic Harness for MLLMs Figure 1
2026-06-03cs.CV

MUSE: A Unified Agentic Harness for MLLMs

Jianglin Lu, Hailing Wang, Xu Ma, Qihua Dong, Mingyuan Zhang, Yizhou Wang, Yun Fu

2026-06-03视觉感知

本文针对冻结多模态大模型在网格规划、拼图、密集字符识别等视觉任务中常因执行框架而非模型本身失误的问题,提出 MUSE:在黑盒 MLLM 外加入任务表示、视觉预处理、工具调用、结构化解析、确定性验证与迭代修复的统一 agentic harness。实验覆盖 VSP-Grid、BLINK-Jigsaw、CoMT、TIR-Bench 等任务和多种前沿模型,均较裸模型取得稳定提升,困难样例增益更明显,如 GPT-4o 在 Word Search 从 3% 提至 21%。

MARIO: Motion-Augmented Real-Time Multi-Sensor Inertial Odometry Figure 1
2026-06-03cs.RO

MARIO: Motion-Augmented Real-Time Multi-Sensor Inertial Odometry

Yiquan Li, Taeyoung Yeon, Chenfeng Gao, Vasco Xu, Xuanyou Liu, Karan Ahuja

Northwestern University, University of Chicago

2026-06-03视觉感知

针对单 IMU 惯性里程计在 AR/可穿戴人体跟踪中易因噪声积分和缺乏运动动力学约束而漂移的问题,MARIO 将头戴 IMU 推断的 SMPL 人体姿态作为运动学先验注入现有 IO 模型,并融合第二 IMU、气压计和磁力计以补充航向与高度信息。在 Nymeria、Aria Everyday 和 TLIO 等数据集上接入 TLIO、AirIO、RoNIN、EQNIO 均有改进,Nymeria 位置漂移最高降低 36%,多传感器融合进一步提升长期鲁棒性。

Towards Compact Autonomous Driving Perception with Balanced Learning and Multi-sensor Fusion Figure 1
2026-06-03cs.CV

Towards Compact Autonomous Driving Perception with Balanced Learning and Multi-sensor Fusion

Oskar Natan, Jun Miura

2026-06-03视觉感知

自动驾驶感知需在多天气、多视角下融合互补传感器,但为每个任务部署独立模型开销大,多任务训练又易失衡。本文提出紧凑多任务网络,在一次前向中融合4路RGB、DVS与LiDAR,联合输出多视角语义分割、深度、LiDAR分割和BEV,并用改造GradNorm自适应调权。实验在3个CARLA和nuScenes-lidarseg上显示其以更少参数、显存和更快推理取得相对组合基线更稳的性能。

Hand Trajectory Fusion for Egocentric Natural Language Query Grounding Figure 1
2026-06-03cs.CV

Hand Trajectory Fusion for Egocentric Natural Language Query Grounding

Enmin Zhong, Carlos R. del-Blanco, Fernando Jaureguizar, Narciso García

Grupo de Tratamiento de Im´agenes (GTI), Information Processing and Telecommunications Center

2026-06-03视觉语言规划控制

这篇论文针对第一人称 NLQ 定位中大量问题发生在手—物交互时、但现有视频语言模型忽略手部运动的缺口,引入手轨迹分支:用时空 Transformer 将稀疏手骨架编码为运动学特征,并通过交叉注意力与自适应门控融合到冻结的视频文本特征中。在 Ego4D NLQ v2 上总体小幅提升,HOI 的 R1@0.3 提升 2.54,Quantity/State 提升 4.32,说明手轨迹主要帮助操控相关查询的时间定位。

The Road Ahead in Autonomous Driving: The KITScenes Multimodal Dataset Figure 1
2026-06-03cs.CV

The Road Ahead in Autonomous Driving: The KITScenes Multimodal Dataset

Richard Schwarzkopf, Fabian Immel, Alexander Blumberg, Jonas Merkert, Nils Rack, Kaiwen Wang, Fabian Konstantinidis, Julian Truetsch, Carlos Fernandez, Annika Bätz, Kevin Rösch, Marlon Steiner, Willi Poh, Yinzhe Shen, Royden Wagner, Felix Hauser, Dominik Strutz, Jaime Villa, Gleb Stepanov, Holger Caesar, Ömer Şahin Taş, Frank Bieder, Jan-Hendrik Pauls, Christoph Stiller

FZI Research Center for Information Technology, Karlsruhe Institute of Technology, University Charles III of Madrid, Delft University of Technology

2026-06-03视觉语言数据集/基准

面向现有自动驾驶数据集在传感器精度、HD地图完整性和欧洲复杂城市覆盖上的不足,论文提出 KITScenes Multimodal:同步高分辨率全局快门相机、400m+ 激光雷达、4D雷达与冗余定位,并提供含3D交通灯/标志及拓扑关系的 Lanelet2 地图。四个基准显示,现有HD地图构建方法在完整任务上AP很低,深度模型在200m外普遍失效,暴露出现有方法的长距空间理解短板。

SCOPE: Real-Time Natural Language Camera Agent at the Edge Figure 1
2026-06-03cs.RO

SCOPE: Real-Time Natural Language Camera Agent at the Edge

Nikolaj Hindsbo, Sina Ehsani, Pragyana Mishra

2026-06-03视觉感知

这篇论文针对自然语言控制 PTZ 摄像机在真实部署中难评测、难闭环、受边缘算力限制的问题,提出 SCOPE:用解耦的 SLM 规划器调用 PTZ 控制与轻量 VLM 感知工具,并在 Blender 仿真和实体相机中共享动作/观测接口。作者构建 536 个任务基准,评测 19 组模型,发现更强 SLM 可降低幻觉和工具路由错误;当规划足够可靠后,感知成为瓶颈,MoE 与量化在延迟、内存和精度间更适合边缘实时部署。

BYORn: Bootstrap Your Own Responses to Defend Large Vision-Language Models Against Backdoor Attacks Figure 1
2026-06-03cs.LG

BYORn: Bootstrap Your Own Responses to Defend Large Vision-Language Models Against Backdoor Attacks

Ivan Sabolić, Marin Oršić, Josip Šarić, Sven Lončarić

gers into training inputs and label the response to a desired, learning with labeled responses (Li et al., 2023, partially labeled datasets (Kim et al., 2024

2026-06-03视觉语言视觉感知

这篇论文针对视觉语言模型指令微调易被后门样本诱导、且开放式生成中现有防御依赖特定触发模式的问题,提出 BYORn:利用预训练模型认为投毒回答与图文语义不匹配、似然较低的洞察,训练中检测可疑回答并用模型自生成响应动态替换,从而切断触发器与目标输出的关联。实验覆盖图像描述、差异识别和 VQA,平均较现有防御降低约 40 个百分点攻击成功率,同时保持干净任务性能,并在自适应攻击下仍有效。

BEAST3D: Animal behavioral analysis and neural encoding from multi-view video via Gaussian splatting Figure 1
2026-06-03q-bio.NC

BEAST3D: Animal behavioral analysis and neural encoding from multi-view video via Gaussian splatting

Yanchen Wang, Lenny Aharon, Wangshu Zhu, Kyle Daruwalla, Linghua Zhang, Jiaru Zou, Selmaan Chettih, Helen Hou, Liam Paninski, Matthew R Whiteway

Columbia University, Stanford University, ting of laboratory experiments. We address these limitations with BEAST3D, a, unlabeled, calibrated multi-view video. BEAST3D uses a vision transformer to, available in lab settings. Through comprehensive evaluation across four species, we, sis that leverages 3D structure in modern multi-view laboratory recordings. Our, growing number of laboratories address these limitations by recording with multiple synchronized, of keypoints, which is labor-intensive and must be repeated for each new experimental setup or, require a species-specific template mesh and costly per-frame optimization, limiting their scalability, specialized imagery of laboratory recordings: close-up views of animals under controlled lighting, process that can fail with limited view overlap (Fig. 6). Neither assumption holds in typical laboratory, features from calibrated multi-view animal behavior videos. Given only unlabeled, synchronized

2026-06-03视觉感知三维

针对实验室多视角动物视频中3D行为表征难以获取、监督姿态标注成本高且通用3D重建模型不适配稀疏标定相机的问题,BEAST3D用自监督ViT直接结合相机参数预测3D Gaussian splats,并通过可微渲染重建留出视角、同时分割前景动物。在小鼠、大鼠、山雀和人体数据上,模型仅用4到6视角即可获得更稳定的3D特征,并在新视角合成、多视角姿态估计和神经编码任务中优于或接近VGGT、E-RayZer、DINOv3等基线。

CAD-to-CT Registration of Cylindrical Objects via Ellipse-Based Axis Estimation Figure 1
2026-06-03cs.CV

CAD-to-CT Registration of Cylindrical Objects via Ellipse-Based Axis Estimation

Aleksander Ogonowski, Mikołaj Mrozowski, Daniel Więcek, Arkadiusz Ćwiek, Konrad Klimaszewski, Rafał Możdżonek, Adam Padee, Lech Raczyński, Piotr Wasiuk, Wojciech Wiślicki, Michał Matusiak, Sławomir Wronka

Department of Complex Systems, National Centre for Nuclear Research, ImagineRT sp. z o.o., National Centre for Nuclear Research

2026-06-03视觉感知

该文针对工业 CT 中灰度未标定、边界模糊导致 CAD 模型难以为圆柱类电离室生成可靠真值掩膜的问题,利用倾斜圆柱在切片中呈椭圆且椭圆中心随层线性移动的几何约束,先经边缘椭圆拟合、RANSAC 与 PCA 估计三维轴向,再体素化 CAD 并优化平移重叠。仿真与真实 CT/CMM 验证显示,旋转与倾角误差低于 0.1°,无需强度标定或特征匹配。

SaluNet: Enabling Total Plasticity in Normalization-Free Deep Networks Figure 1
2026-06-03cs.CV

SaluNet: Enabling Total Plasticity in Normalization-Free Deep Networks

Mourad Zaied (University of Gabes, Tuisia)

Department of electrical engineering, National Engineering School of Gabes (ENIG), University of Gabes

2026-06-03视觉感知

论文针对 BatchNorm/LayerNorm 虽稳定训练却会压制可学习激活参数适应性的现象,提出以有界可学习激活 SALU 内生完成信号稳定,并扩展 SWALU/GALU 形成无归一化的 SaluNet。其核心洞察是用“几何可塑性”替代外部统计约束。在 CIFAR、ViT 与 ImageNet 实验中,SaluNet 在无归一化甚至 batch size 1 下保持较高精度,部分设置优于标准归一化基线。

ATLAS: A Large-Scale Evaluation Benchmark for Adversarial LiDAR Perception Figure 1
2026-06-03cs.CV

ATLAS: A Large-Scale Evaluation Benchmark for Adversarial LiDAR Perception

Mellon M. Zhang, Siddhant Panse, Zimo Fan, Akshal Dhal, Rishit Sarkar, Glen Chou

Georgia Institute of Technology, have largely centered on attack hardware, geometric and algorithmic defenses, and

2026-06-03数据集/基准

针对现有自动驾驶 LiDAR 基准主要评测干净数据、缺少黑盒传感器级对抗操纵评估的问题,ATLAS 基于 Waymo 构建大规模物理约束的点注入与点移除攻击套件,覆盖真实时序场景和多类现代检测器。实验发现干净性能并不等于鲁棒性:强模型通常更能抵抗点移除,却更易受点注入诱导,脆弱性可能与常用目标数据库采样增强有关。

Pixel Cube: Diffusion-based Portrait Video Relighting Through Realistic Lighting Reproduction Figure 1
2026-06-03cs.CV

Pixel Cube: Diffusion-based Portrait Video Relighting Through Realistic Lighting Reproduction

Yufan Zhang, Yu Ji, Ayo Ajiboye, Rundi Wu, Yu Guo, Changxi Zheng, Jinwei Ye

George Mason University, Columbia University, George Mason University Fairfax USA, Columbia University New York USA

2026-06-03视觉感知生成模型

针对日常人像视频拍摄后难以获得理想且时序一致光照的问题,论文提出 Pixel Cube:用经辐射校准的立方 LED 舞台复现实景 HDR 环境光,采集带真实光照/反照率标注的动态数据,并结合 MetaHuman 渲染数据微调视频扩散模型,以环境图和合成背景控制重打光。实验显示其在野外视频上提升真实感、光照协调性和时间稳定性,但部分收益可能主要来自高质量数据与预训练模型。

Any2Poster: Any-Source Poster Generation Across Modalities and Domains Figure 1
2026-06-03cs.CV

Any2Poster: Any-Source Poster Generation Across Modalities and Domains

Amogh Vinaykumar, Aiden Li, Suozhi Huang, Shilong Liu

Flower Mound High School, University College London, Princeton University

2026-06-03视觉感知

现有海报生成评测多局限于论文输入和表层视觉相似,难以衡量跨来源的信息保真与表达质量。本文提出覆盖 PDF、网页、PPT、视频等 8 类输入和 5 个领域的 Any2Poster Bench,并给出含统一解析、自适应规划、HTML/CSS 渲染与 VLM 修复的 Agent。实验中其跨模态/跨领域准确率约 87%,在 PaperQuiz 设置下较 PosterAgent-4o 将总体准确率提升至 72.58%。

Depth from Dual Differential Defocus and Stereo Consensus Figure 1
2026-06-03eess.IV

Depth from Dual Differential Defocus and Stereo Consensus

Junjie Luo, Wei Xu, Dylan Chu, Emma Alexander, Qi Guo

Purdue University, West Lafayette, IN, USA, Northwestern University, Evanston, IL, USA, commercially available stereo cameras with much larger form factors., directly compare with commercially available stereo cameras. We estimate the working, a ^\top I_{\vx }(\x ) + b~\lVert I_{\vx \vx }(\x ) \rVert }{\dot {I}(\x ) + c ~\lVert I_{\vx \vx }(\x ) \rVert }, \label {eq:d3_intro}

2026-06-03视觉感知

针对传统被动三角测距在小基线/短焦距下精度和工作距离受限的问题,本文提出 D3S Consensus,将双差分离焦的闭式物理深度关系与标准双目立体约束耦合,并用两类独立线索的一致性筛掉不可靠估计。原型仅 4 mm 基线、12 mm EFL,单次拍摄生成最高 900×1800 稀疏深度图,在 0.3–1.64 m 范围达到约 1 cm MAE,较多种 DfD/双目基线更紧凑且精度更高。

Tiny Collaborative Inference for Occlusion-Robust Object Detection Figure 1
2026-06-03cs.CV

Tiny Collaborative Inference for Occlusion-Robust Object Detection

Chieh-Tung Cheng, Mustafa Aslanov, Eiman Kanjo

Tiny Collaborative Inference for Occlusion-Robust Object Detection, CHIEH-TUNG CHENG, Imperial College London, United Kingdom, MUSTAFA ASLANOV, Nottingham Trent University, United Kingdom, EIMAN KANJO, Nottingham Trent University, United Kingdom and Imperial College London, United Kingdom, collaborative inference strategies are evaluated: feature-level fusion, concatenating intermediate feature maps, and decision-level, Additional Key Words and Phrases: edge AI, tinyML, collaborative inference, object detection, occlusion robustness, Chieh-Tung Cheng, Mustafa Aslanov, and Eiman Kanjo. 2026. Tiny Collaborative Inference for Occlusion-Robust Object Detection., Authors’ Contact Information: Chieh-Tung Cheng, Imperial College London, London, United Kingdom, Mustafa Aslanov, Nottingham Trent University, Eiman Kanjo, Nottingham Trent University, Nottingham, United Kingdom and, design keeps the model small enough for constrained hardware, uses collaborative inference to recover detections that, • A collaborative inference setup that compares feature-level and decision-level fusion under controlled occlusion.

2026-06-03视觉感知安全鲁棒

面向搜救等多机器人边缘视觉场景,论文关注低于 1MB SRAM 的超低端设备在遮挡下难以可靠检测的问题。方法将 MCUNet、YOLOv2 头和 TFLite 量化结合,并比较特征级融合与基于 WBF 的决策级多视角协同推理。结果显示 WBF 在各类遮挡下优于特征融合,非对称遮挡最高提升 0.2736 mAP,三视角最高提升 0.3827 mAP;两块 Coral Micro 的自主实验中融合帧覆盖率较单板提升 29.8%。

Pathway-Structured Privileged Distillation for Deployable Computational Pathology Figure 1
2026-06-03cs.CV

Pathway-Structured Privileged Distillation for Deployable Computational Pathology

Yongxin Guo, Hao Lu, Onur Koyun, Zhengjie Zhu, Muhammet Demir, Metin Gurcan

*School of Medicine, Wake Forest University, Winston-Salem, NC, USA., elling, yet practical use is constrained by the limited availability of RNA profiling, provide a scalable record of tumour morphology, tissue architecture and microenviron-, are not consistently available in routine care because they require sufficient tissue, validated laboratory workflows, additional cost and turnaround times [6, 7]. This cre-

2026-06-03视觉感知

针对临床中RNA测序常缺失、而训练数据可含WSI-RNA配对的部署不对称,论文将问题视为H&E对分子状态的“部分可观测”而非简单缺模态。其MoPE用通路级RNA token和通路专家,通过共享记忆使用方式对齐来蒸馏分子监督,推理时仅需病理切片。TCGA多项 biomarker/生存任务及两个乳腺癌外部队列显示WSI-only性能优于MIL和蒸馏基线,并提供可审计但非因果证明的通路读出。

Principled Reflection Separation via Nonlinear Superposition and Feature Interaction Figure 1
2026-06-03cs.CV

Principled Reflection Separation via Nonlinear Superposition and Feature Interaction

Qiming Hu, Mingjia Li, Yuntong Li, Xiaojie Guo

design of principled image decomposition models. Code and models are publicly available at https://mingcv.github.io/DIRS-Page., All the authors are from College of Intelligence and Computing, Tianjin, University, Tianjin 300350, China.

2026-06-03视觉感知

该文针对单张图像反射分离中 sRGB 成像并非线性叠加、透射层与反射层相互纠缠的问题,指出传统线性混合假设与真实 ISP 非线性不匹配。方法上引入可学习非线性叠加项,并设计双流交互框架,在 CNN/Transformer 中通过激活、门控或注意力交换两层特征。实验显示其在多个真实反射分离基准上优于现有方法且泛化较强。

Automated Report-Derived Oncology VQA Benchmark for Evaluating Vision-Language Models on 3D Medical Imaging Figure 1
2026-06-03cs.CV

Automated Report-Derived Oncology VQA Benchmark for Evaluating Vision-Language Models on 3D Medical Imaging

Bo Liu, Hanxue Gu, Xiangru Li, Zheren Zhu, Jacob Ellison, Kang Wang, Janine M. Lupo, Yang Yang, Hui Lin

Department of Radiology, UCSF, Department of Radiation Oncology, UCSF

2026-06-03视觉语言视觉感知数据集/基准三维

针对医学VQA基准规模小、人工标注重且易被预训练数据污染的问题,本文提出从私有放射报告与3D肿瘤影像自动生成多选题的双路径流程,结合RADS式结构化问题和报告派生问题。四个院内队列上零样本评测六个VLM显示无模型接近饱和,最佳约0.70;盲测还揭示视觉依赖强烈受数据集影响,肺CT甚至可主要靠语言先验作答。

Cosmos 3: Omnimodal World Models for Physical AI Figure 1
2026-06-03cs.CV

Cosmos 3: Omnimodal World Models for Physical AI

Aditi, Niket Agarwal, Arslan Ali, Jon Allen, Martin Antolini, Adeline Aubame, Alisson Azzolini, Junjie Bai, Maciej Bala, Yogesh Balaji, Josh Bapst, Aarti Basant, Mukesh Beladiya, Mohammad Qazim Bhat, Zaid Pervaiz Bhat, Dan Blick, Vanni Brighella, Han Cai, Tiffany Cai, Eric Cameracci, Jiaxin Cao, Yulong Cao, Mark Carlson, Carlos Casanova, Ting-Yun Chang, Yan Chang, Yu-Wei Chao, Prithvijit Chattopadhyay, Roshan Chaudhari, Chieh-Yun Chen, Junyu Chen, Ke Chen, Qizhi Chen, Wenkai Chen, Xiaotong Chen, Yu Chen, An-Chieh Cheng, Click Cheng, Xiu Chia, Jeana Choi, Chaeyeon Chung, Wenyan Cong, Yin Cui, Magdalena Dadela, Nalin Dadhich, Wenliang Dai, Joyjit Daw, Alperen Degirmenci, Rodrigo Vieira Del Monte, Robert Denomme, Sameer Dharur, Marco Di Lucca, Ke Ding, Wenhao Ding, Yifan Ding, Yuzhu Dong, Nicole Drumheller, Yilun Du, Aigul Dzhumamuratova, Aleksandr Efitorov, Hamid Eghbalzadeh, Naomi Eigbe, Imad El Hanafi, Hassan Eslami, Benedikt Falk, Jiaojiao Fan, Jim Fan, Amol Fasale, Sergiy Fefilatyev, Liang Feng, Francesco Ferroni, Sanja Fidler, Xiao Fu, Vikram Fugro, Prashant Gaikwad, TJ Galda, Katelyn Gao, Yihuai Gao, Wenhang Ge, Sreyan Ghosh, Arushi Goel, Vivek Goel, Akash Gokul, Rama Govindaraju, Jinwei Gu, Miguel Guerrero, Elfie Guo, Aryaman Gupta, Siddharth Gururani, Hugo Hadfield, Song Han, Ankur Handa, Zekun Hao, Mohammad Harrim, Ali Hassani, Nathan Hayes-Roth, Yufan He, Chris Helvig, Cyrus Hogg, Madison Huang

omnimodal world models as scalable, general-purpose backbones for embodied agents. Our post-trained, synthetic datasets, and evaluation benchmark available under the Linux Foundation’s OpenMDW-1.1, website is available at research.nvidia.com/labs/cosmos-lab/cosmos3 .

2026-06-03强化学习

论文针对物理 AI 训练依赖真实世界而成本高、风险大,以及感知、世界模拟、动作策略模型割裂的问题,提出 Cosmos 3:用统一的 Mixture-of-Transformers 处理并生成语言、图像、视频、音频和动作序列,将 VLM、视频生成、世界模型和策略模型收敛到同一骨干。实验显示其在多类理解与生成任务达到 SOTA,后训练模型在开源文生图、图生视频和 RoboArena 策略评测中领先,并开放代码、权重、合成数据与基准。

Diagnosis of Human Object Interaction Detectors for Real World Educational Applications Figure 1
2026-06-03cs.CV

Diagnosis of Human Object Interaction Detectors for Real World Educational Applications

Divya Mereddy, Ashwin Tudur Sadashiva, Marcos Quinones-Grueiro, Gautam Biswas

Vanderbilt University, itors, labeling equipment engagement as “valid-interaction”, operational intent—is explicitly labeled as no-interaction.

2026-06-03强化学习

论文关注HOI检测器在真实教育/医疗训练场景中因遮挡、低照度、域特定设备和“近接触但无交互”而失效的问题。作者将三元组级错误分类与错误因素归因结合,用诊断结果指导数据增强、框标注/伪标注和人工纠错式微调;在CCATT数据上,预训练CDN的macro-F1由48.6提升到90.2,但具体各 refinement 的独立增益来源仍未充分说明。

GeoDrive-Bench: Benchmarking Region-Specific Multimodal Reasoning in Autonomous Driving Figure 1
2026-06-03cs.CV

GeoDrive-Bench: Benchmarking Region-Specific Multimodal Reasoning in Autonomous Driving

Yingzi Ma, Chaowei Xiao, Ming Jiang

University of Wisconsin-Madison, Johns Hopkins University

2026-06-03视觉语言数据集/基准

现有自动驾驶 VLM 评测多默认交通规则通用,难以暴露跨国家部署中的本地规则与驾驶文化差异。GeoDrive-Bench 构建覆盖中、日、新、英、印、美的 5,053 条人工验证多选 QA,要求模型在无国家标签下结合视觉线索与区域规则完成感知、预测、规划和区域推理,并提出 DriveOPD 将规则知识蒸馏进模型。九个 VLM 实验显示各国性能差异显著,主要瓶颈来自文化规则缺口;DriveOPD 可降低跨国方差并提升区域感知推理。

From Local Training to Large-Scale Mapping: A Comparative Assessment of Machine Learning and Deep Learning for Transferable Satellite-Derived Bathymetry Figure 1
2026-06-03cs.CV

From Local Training to Large-Scale Mapping: A Comparative Assessment of Machine Learning and Deep Learning for Transferable Satellite-Derived Bathymetry

Hsiao-Jou Hsu, Joachim Moortgat

School of Earth Sciences, The Ohio State University, Mendenhall Laboratory, 125 South Oval Mall, Columbus, OH 43210, USA, water depths, yet its scalability and cross-regional generalizability remain challenging in optically, Finally, we release optimized network architectures and pretrained weights to facilitate scalable, pretrained weights released openly to enable scalable, transferable mapping of shallow coastal, about 7% of the seafloor, they demand roughly 64% of total survey effort [2], motivating scalable

2026-06-03视觉感知

面向浅水测深中现场测量昂贵、传统卫星反演跨区域泛化差的问题,本文用 Sentinel-2 多光谱数据系统比较随机森林与 ResNet、EfficientNet、ConvNeXt 等深度模型。核心洞察是训练样本保持空间连续性比随机切块更关键,并结合浅水加权 SWF 损失与多时相中位聚合提升稳定性。结果显示随机森林跨区 RMSE 升至 2.99–3.78 m,而深度模型约 2.46–2.98 m,浅水段最低可到 0.26 m,但文中也承认浑浊近岸与全球可迁移性仍未充分说明。

MetaWorld: Scaling Multi-Agent Video World Model from Single-view Video Data Figure 1
2026-06-03cs.CV

MetaWorld: Scaling Multi-Agent Video World Model from Single-view Video Data

Teng Hu, Mingchun Lu, Yating Wang, Jiangning Zhang, Jinkun Hao, Ye Pan, Ran Yi, Lizhuang Ma, Dacheng Tao

Shanghai Jiao Tong University, Zhejiang University, Nanyang Technological University

2026-06-03视觉感知强化学习

该文针对现有视频世界模型难以从单视角扩展到开放域多智能体场景的问题,提出 MetaWorld:用 MWSU 将单目视频分解为拍摄者自运动与被摄主体轨迹,构造共享 3D 空间中的多智能体监督,并以身份条件生成器和跨分支注意力对齐双视角去噪过程。实验显示其在跨视角一致性、物理同步和身份保持上优于基线,但具体增益可能部分来自数据与模型 scaling。

Plan2Map: A Multimodal Benchmark for Document-Grounded Geospatial Boundary Reconstruction from Planning Records Figure 1
2026-06-03cs.CV

Plan2Map: A Multimodal Benchmark for Document-Grounded Geospatial Boundary Reconstruction from Planning Records

Fabian Degen, Oishi Deb, Jindong Gu, Junchi Yu, Samuele Marro, Philip Torr, Jialin Yu

University of Oxford 2Google DeepMind, ules, map plates, map labels, and boundary, answers, tables, or labels, Plan2Map requires a

2026-06-03视觉语言规划控制学习理论数据集/基准三维

这篇论文面向规划档案数字化中的实际痛点:许多英国 Article 4 规划记录只有法律文本和扫描地图,缺少可机器读取的边界。作者提出 Plan2Map,收集208个PDF—GeoJSON案例,并给出工具增强的 GeoPlanAgent,将证据抽取、定位、地图配准、边界分割和投影拆解处理。结果显示其平均 IoU 约0.74、中位 IoU 约0.91,显著优于直接 VLM 生成 GeoJSON;误差主要来自定位和配准。

Consistent Yet Wrong: Evidence Insensitivity in Spatial Vision-Language Models Figure 1
2026-06-03cs.CV

Consistent Yet Wrong: Evidence Insensitivity in Spatial Vision-Language Models

S Divakar Bhat, Toshihiko Yamasaki

The University of Tokyo, Japan, are highly consistent but inaccurate. [Centre] Same-pair traces show predictions that remain fixed across views despite changing evidence.

2026-06-03视觉语言视觉感知

论文质疑“跨视角一致=几何理解”的常见假设:在机器人/自动驾驶所需的米制距离估计中,VLM 可能稳定但错误。作者提出 ViewDiag,多数据集、多视角跟踪同一物体对,并结合误差、输出集中度和隐状态探针诊断证据敏感性。结果显示多种通用/空间 VLM 落入高一致低准确的塌缩区,ZoeDepth 等几何基线误差更低且更随视角证据变化。

AVTrack: Audio-Visual Tracking in Human-centric Complex Scenes Figure 1
2026-06-03cs.CV

AVTrack: Audio-Visual Tracking in Human-centric Complex Scenes

Yaoting Wang, Yun Zhou, Zipei Zhang, Henghui Ding

Institute of Big Data, College of Computer Science and Artifi-, cial Intelligence, Fudan University, Shanghai, China. Correspon-, laboratory settings, with few speakers and largely static, labels in in-the-wild scenarios, but are dominated by short, scenarios beyond laboratory conditions.

2026-06-03视觉感知

现有音视频说话人跟踪/分割基准多为静态、短片段或粗标注,难以检验复杂人本场景中的跨模态时空推理。AVTrack提出面向音视频实例分割的动态基准,含871段视频和3120条密集实例轨迹,覆盖遮挡、相机运动、多实例、位置/尺度变化等8类挑战。对现有VIS与AVIS方法的评测显示性能明显下降,并给出一个简单可扩展基线,说明该数据集更能暴露鲁棒人本音视频理解的瓶颈。

SVHalluc: Benchmarking Speech-Vision Hallucination in Audio-Visual Large Language Models Figure 1
2026-06-03eess.AS

SVHalluc: Benchmarking Speech-Vision Hallucination in Audio-Visual Large Language Models

Chenshuang Zhang, Kyeong Seon Kim, Chengxin Liu, Tae-Hyun Oh

2026-06-03视觉感知数据集/基准

现有音视频幻觉评测多把狗叫、警笛等环境声当作事件提示,难以检验语音内容与画面的真实对齐。SVHalluc提出首个面向语音-视觉幻觉的综合基准,从语义对应与时间关系两方面设计6个由粗到细的诊断任务。实验显示,多种开源音视频LLM在多项任务上接近随机,虽单模态感知尚可但跨模态整合不足;Gemini 2.5 Pro明显更强,凸显开源与商业模型差距。

Sparse-View Lung Nodule Volumetry from Digitally Reconstructed Radiographs via AReT: Anatomy-Regularized TensoRF Figure 1
2026-06-03eess.IV

Sparse-View Lung Nodule Volumetry from Digitally Reconstructed Radiographs via AReT: Anatomy-Regularized TensoRF

Spoorthi M, Suja Palaniswamy

2026-06-03视觉感知

本文针对肺结节体积评估依赖高剂量密集 CT 的问题,探索仅用冠状、矢状、轴向三张 DRR 重建 3D 结节。核心洞察是 TensoRF 默认 density shift 会在 X 射线衰减场中抑制梯度,改为 0 后结合胸腔空气占优先验的 L1+TV 正则形成 AReT。19 例 LIDC-IDRI 上,对 ≥10mm 结节体积相关 r=0.983、中位误差 11.4%,但评估基于模拟 DRR 且样本较小,临床泛化仍需验证。

Wavelet as Tokenizer: Preliminary Results on a Shared Wavelet Token Schema for Natural Signals Figure 1
2026-06-03eess.AS

Wavelet as Tokenizer: Preliminary Results on a Shared Wavelet Token Schema for Natural Signals

Shenghao Ding

2026-06-03视觉感知

论文关注自然信号 tokenizer 过度依赖模态专用网格的问题,提出用一层 Haar 小波把音频、图像、视频统一成带有尺度、子带、位置等元信息的连续系数 token,并由共享 trunk 重建。实验在 Speech Commands、EuroSAT、DAVIS 上验证小规模自编码可行,密集模型分别达 39.92/29.37/23.93 dB PSNR;能量选 token 显著优于均匀选择,50% video token 仍达 34.45 dB。但尚未证明离散通用词表,元信息增益也并非稳定。

COD10K-C: Benchmarking Robustness of Camouflaged Object Detection Under Natural Image Corruptions Figure 1
2026-06-03cs.CV

COD10K-C: Benchmarking Robustness of Camouflaged Object Detection Under Natural Image Corruptions

Arafat Hossain Sayem

2026-06-03视觉感知数据集/基准安全鲁棒

本文针对伪装目标检测只在干净图像上评测、难反映真实相机模糊噪声和天气退化的问题,构建 COD10K-C:在 COD10K 测试集上加入 8 类扰动、5 个强度共 81,040 对样本,并评测多种 COD 模型。核心洞察是几何退化尤其运动/高斯模糊远比亮度、雾等光度退化更伤害模型;轻量 RobustCODLite 结合扰动增强、高频先验和不确定性一致性,在腐蚀下保留 92.3% 干净 Dice,且在最难扰动上可超过更大的模型。

Graph Mamba Survival Analysis Based on Topology-Aware ordering Figure 1
2026-06-03cs.LG

Graph Mamba Survival Analysis Based on Topology-Aware ordering

Yuanfang Chen, Peiqiang Yan, Yuntao Shou, Qian Zhao, Xiangyong Cao

aSchool of Mathematics and Statistics, Xi’an Jiaotong University, West China Science and Technology Innovation Harbor, Xi’an, bSchool of Computer Science and Technology, Xi’an Jiaotong University, West China Science and Technology Innovation Harbor, the instances sharing the same label of this WSI, and uses

2026-06-03视觉感知

针对WSI生存分析中GNN难建模全局依赖、Transformer代价高且Graph Mamba对节点顺序敏感的问题,本文提出TopoMamSurv:用基于最短路径的拓扑感知排序生成更符合图连通性的扫描序列,并结合双向Mamba与GCN形成“局部聚合—全局捕获”的层次特征学习。实验在五个TCGA数据集上显示相对现有方法有综合优势,且可视化支持TAO得到的节点更相似。

PaintBench: Deterministic Evaluation of Precise Visual Editing Figure 1
2026-06-03cs.GR

PaintBench: Deterministic Evaluation of Precise Visual Editing

Kai Xu, Ellis Brown, Shrikar Madhu, Rob Fergus, He He, Saining Xie

New York University

2026-06-03数据集/基准

针对现有图像编辑评测依赖人工或模型裁判、难以衡量“唯一正确答案”的精确编辑,PaintBench 用程序化生成构造20类基础操作,并以像素级确定性指标评估编辑区与保留区。实验覆盖11个编辑模型,最佳仅17.1% mIoU,几何变换、结构操作和公式化改色尤其困难;场景复杂度、小编辑区域等会显著降分,且与数据可视化编辑基准 TinyGrafixBench 分数高度相关。

2026-06-02

363 篇
Thinking in Blender: Staged Executable Inverse Graphics with Vision-Language Models Figure 1
2026-06-02cs.CV

Thinking in Blender: Staged Executable Inverse Graphics with Vision-Language Models

Guangzhao He, Rundong Luo, Wei-Chiu Ma, Hadar Averbuch-Elor

Cornell University, Cornell University USA

2026-06-02视觉语言视觉感知

本文关注单张图像到可编辑 3D 场景的逆图形问题,动机是避免 NeRF/3DGS 等隐式表示难以编辑,以及端到端让 VLM 同时推断几何、材质、布局和光照过于困难。作者提出 SEIG,将重建拆成初始化、几何、材质、组合与光照等可执行 Blender 代码阶段,并用生成器—验证器循环逐步渲染比较和修正。实验在合成与真实场景上显示,分阶段策略相较整体式 VLM 重建显著提升像素、感知和语义一致性,并支持重打光、编辑和物理仿真。

Mitigating Perceptual Judgment Bias in Multimodal LLM-as-a-Judge via Perceptual Perturbation and Reward Modeling Figure 1
2026-06-02cs.CV

Mitigating Perceptual Judgment Bias in Multimodal LLM-as-a-Judge via Perceptual Perturbation and Reward Modeling

Seojeong Park, Jiho Choi, Junyong Kang, Seonho Lee, Jaeyo Shin, Hyunjung Shim

2026-06-02视觉语言强化学习

针对多模态 LLM 评审在图文冲突时偏向“说得通”的文本而忽视视觉证据的问题,论文将其定义为感知判断偏差,并区分感知能力不足与响应锚定两类失败。作者构造含最小反事实视觉扰动的 PPJD 数据集,用可验证批排序奖励结合 GRPO 训练 Perception-Judge。实验显示其在多种 MLLM-as-a-Judge 基准上提升感知一致性与排序连贯性,批级指标最高提升 11%,单分数预测准确率提升 15%。

RoboDream: Compositional World Models for Scalable Robot Data Synthesis Figure 1
2026-06-02cs.RO

RoboDream: Compositional World Models for Scalable Robot Data Synthesis

Junjie Ye, Rong Xue, Basile Van Hoorick, Runhao Li, Harshitha Rajaprakash, Pavel Tokmakov, Muhammad Zubair Irshad, Vitor Guizilini, Yue Wang

1 USC Physical Superintelligence (PSI) Lab, 2 Toyota Research Institute

2026-06-02机器人强化学习

RoboDream针对机器人模仿学习中真实遥操作数据昂贵且难以覆盖多物体、多场景的问题,提出以“机器人运动、物体、场景可组合”为核心的具身视频世界模型:用渲染的机器人轨迹固定运动学,再显式注入物体与场景先验生成示教视频,从而支持轨迹“重生”和无道具遥操作。实验显示,合成数据可在多种真实操作任务中提升下游策略表现并减少真实数据需求,但部分增益可能主要来自更大规模数据合成。

ProtoAda: Prototype-Guided Adaptive Adapter Expansion and Geometric Consolidation for Multimodal Continual Instruction Tuning Figure 1
2026-06-02cs.CV

ProtoAda: Prototype-Guided Adaptive Adapter Expansion and Geometric Consolidation for Multimodal Continual Instruction Tuning

Yu-Cheng Shi, Zhen-Hao Xie, Jun-Tao Tang, Da-Wei Zhou

School of Artificial Intelligence, Nanjing University, China, State Key Laboratory of Novel Software Technology, Nanjing University, China

2026-06-02视觉语言

这篇论文关注多模态大模型在连续指令调优中因任务陆续到来而遗忘、尤其是输出格式被新任务破坏的问题。作者指出仅按图文语义相似度路由 LoRA 专家会把语义相近但答案协议不同的任务混在一起,并提出 ProtoAda:用视觉、语言及回答长度、熵等格式统计构建任务原型,自适应扩展/分组适配器,再用几何感知方式合并兼容更新。实验称其在多个 MCIT 基准上优于现有方法,对易受格式干扰的任务提升更明显。

From Zero to Hero: Training-Free Custom Concept Spawning in World Models Figure 1
2026-06-02cs.CV

From Zero to Hero: Training-Free Custom Concept Spawning in World Models

Kiymet Akdemir, Pinar Yanardag

2026-06-02强化学习

该文针对交互式世界模型在视野外只能按模型先验补全、难以按用户意图放置特定物体或场景元素的问题,提出训练自由的 SPAWN。核心洞察是图像到视频自回归模型的首个上下文记忆槽长期锚定参考帧,可短时替换为概念潜变量并再恢复,使概念经模型记忆自然传播。WorldPlay 上 200 条 rollout 显示其可用图像或文本注入角色、道具、建筑等,并保持光照、尺度、透视、身份与时序一致性。

HumanNOVA: Photorealistic, Universal and Rapid 3D Human Avatar Modeling from a Single Image Figure 1
2026-06-02cs.CV

HumanNOVA: Photorealistic, Universal and Rapid 3D Human Avatar Modeling from a Single Image

Hezhen Hu, Wangbo Zhao, Lanqing Guo, Hanwen Jiang, Jonathan C. Liu, Zhiwen Fan, Kai Wang, Zhangyang Wang, Georgios Pavlakos

University of Texas at Austin, National University of Singapore, Texas A&M University

2026-06-02视觉感知三维

单图真人三维重建常因遮挡视角歧义和高质量人体数据稀缺而依赖逐实例优化或扩散补全,速度与泛化受限。HumanNOVA的主要洞察是可能主要来自scaling / data:用绑定资产动画化与多相机真人拟合扩展到10万训练资产,并在前馈LRM中引入SMPL粗人体先验,经token交叉注意力生成triplane头像。实验称在三项基准上实现亚秒推理,LPIPS相对提升超40%、F-Score相对提升超90%。

VISReg: Variance-Invariance-Sketching Regularization for JEPA training Figure 1
2026-06-02cs.CV

VISReg: Variance-Invariance-Sketching Regularization for JEPA training

Haiyu Wu, Randall Balestriero, Morgan Levine

2026-06-02视觉感知

这篇论文针对 JEPA/自监督视觉表征训练中“防塌缩”依赖启发式或仅用协方差约束不足的问题,提出 VISReg:保留 VICReg 的方差与不变性项,用基于 Sliced-Wasserstein 的 sketching 约束替代协方差,以分离尺度和分布形状并在塌缩时保持梯度。实验显示其在低质量、长尾、低秩数据上更稳定,ImageNet-1K 预训练后 OOD 表现领先,ImageNet-22K 上可接近使用更多数据的 DINOv2。

AdaCodec: A Predictive Visual Code for Video MLLMs Figure 1
2026-06-02cs.CV

AdaCodec: A Predictive Visual Code for Video MLLMs

Haowen Hou, Zhen Huang, Zheming Liang, Qingyi Si, Chenglin Li, Shuai Dong, Kele Shao, Ruilin Li, Dianyi Wang, Nan Duan, Jiaqi Wang

Shanghai Jiao Tong University, Shanghai Innovation Institute

2026-06-02视觉感知

视频 MLLM 将每帧当独立图像编码,导致相邻帧内容重复、长视频 token 与延迟快速上升。AdaCodec 将输入接口改为面向 MLLM 的预测视觉码:仅在预测代价高时放置完整 I 帧,其余帧用运动与残差 P-token 表示,并用两阶段对齐接入现有模型。实验显示其在 11 个基准上优于 Qwen3-VL-8B 逐帧 RGB 基线,32k token 仍超过 224k 长视频基线,通用视频 TTFT 从 9.26s 降至 1.62s。

Policy-based Foveated Imaging and Perception Figure 1
2026-06-02cs.CV

Policy-based Foveated Imaging and Perception

Howard Xiao, Jan Ackermann, Boyang Deng, Gordon Wetzstein

Stanford University, Stanford University USA

2026-06-02强化学习

超高分辨率传感器虽能保留跟踪、文字识别和机器人操作所需细节,但全帧读出/处理受带宽、延迟和功耗限制。论文将成像时的“看哪里”建模为基于历史观测的传感器注意力策略,在低清全局上下文上动态选择全清 ROI,闭合采集—感知循环。仿真中在相同像素预算下优于空间/时间降采样,并在 200MP 双流传感器上验证了实时可行性。

VLMs are Good Teachers for Video Reasoning via Adaptive Test-Time Optimization Figure 1
2026-06-02cs.CV

VLMs are Good Teachers for Video Reasoning via Adaptive Test-Time Optimization

Junhao Cheng, Liang Hou, Tianxiong Zhong, Xin Tao, Pengfei Wan, Kun Gai, Jing Liao

City University of Hong Kong

2026-06-02视觉语言视觉感知优化算法

该文针对视频生成模型在“用视频推理”中画面连贯但难遵守任务规则的问题,提出把VLM从文本规划器改为测试时教师:自动提取过程约束与目标条件,构造成可微奖励,并在线优化轻量LoRA来引导VGM生成推理轨迹。在VBVR-Bench与RULER-Bench上平均提升16.7分,显著高于VLM-as-Solver和Best-of-N,说明收益主要来自反馈优化而非单纯采样扩展。

LongLive-RAG: A General Retrieval-Augmented Framework for Long Video Generation Figure 1
2026-06-02cs.CV

LongLive-RAG: A General Retrieval-Augmented Framework for Long Video Generation

Qixin Hu, Shuai Yang, Wei Huang, Song Han, Yukang Chen

2026-06-02视觉感知

针对自回归视频扩散在长时生成中因滑动窗口只依赖近期上下文而导致误差累积、身份和背景漂移的问题,LongLive-RAG将已生成latent视为可检索记忆,在每个新片段生成前检索相关历史latent并作为额外注意力上下文,同时用Window Temporal Delta Loss提升检索区分性。实验在多个AR骨干和30/60/120秒长度上取得最佳平均VBench-Long排名,并改善主体一致性、背景一致性、运动平滑和成像质量。

Modeling Depth Ambiguity: A Mixture-Density Representation for Flying-Point-Free Depth Estimation Figure 1
2026-06-02cs.CV

Modeling Depth Ambiguity: A Mixture-Density Representation for Flying-Point-Free Depth Estimation

Siyuan Bian, Congrong Xu, Jun Gao

University of Michigan

2026-06-02视觉感知

这篇论文针对深度估计在物体边界产生“飞点”的问题,指出根源在于单像素单深度假设会把前景与背景的歧义平均到空空间。作者提出 MDA 混合密度表示,让每个像素预测多个深度假设及概率,并从假设中解码深度。该方法仅改预测头、开销很小,在 DA3 和 VGGT 等骨干上显著改善边界重建,模糊输入下也能减少飞点,并可扩展到透明物体多层深度和天空区域处理。

AFUN: Towards an Affordance Foundation Model for Functionality Understanding Figure 1
2026-06-02cs.RO

AFUN: Towards an Affordance Foundation Model for Functionality Understanding

Zhaoning Wang, Yi Zhong, Jiawei Fu, Henrik I. Christensen, Jun Gao

University of Michigan, University of California, San Diego

2026-06-02视觉感知

机器人可供性研究常只回答“在哪交互”,缺少可执行的“如何运动”且数据域窄。AFUN 将异构机器人、人类、仿真和扫描数据统一为语言、功能掩码与物体中心 3D 运动标注,并用 RGB-D 与任务文本联合预测交互区域和 Bézier 运动曲线。其在 8 个分割测试集上平均 gIoU/cIoU 较最强基线提升 23.9/26.3,接触点与 3D 运动评测也领先,并展示了无需微调的真实机器人部署。

LL-Bench: Rethinking Low-Level Vision Evaluation in the Era of Large-Scale Generative Models Figure 1
2026-06-02cs.CV

LL-Bench: Rethinking Low-Level Vision Evaluation in the Era of Large-Scale Generative Models

Lu Liu, Huiyu Duan, Chenxin Zhu, Jintong Lu, Haoyun Jiang, Liu Yang, Qiang Hu, Guangtao Zhai, Xiaoyun Zhang

Shanghai Jiao Tong University, Shanghai, China

2026-06-02视觉感知生成模型数据集/基准

低层视觉任务要求像素级保真,而大生成模型在修复/增强中的能力与幻觉风险缺少系统评测。本文构建 LL-Bench,覆盖16类真实退化、31类模型输出及专家偏好标注,并据此比较生成式与传统修复方法,揭示其任务边界和失败模式;同时提出基于多模态大模型的 LL-Score,用输入与结果联合判断质量和幻觉,实验显示其与人类偏好相关性优于现有 IQA 指标,并可作为生成式修复的奖励信号。

Improving Combined Detection and Classification of TEM Defects via Mask-Conditioned Latent Diffusion Augmentation Figure 1
2026-06-02cs.CV

Improving Combined Detection and Classification of TEM Defects via Mask-Conditioned Latent Diffusion Augmentation

Ni Li, Nuohao Liu, Ryan Jacobs, Ajay Annamareddy, Maciej P. Polak, Kevin Field, Izabela Szlufarska, Dane Morgan

. University of Wisconsin-Madison, Madison, WI, . University of Michigan-Ann Arbor, Ann Arbor, MI

2026-06-02视觉感知生成模型

针对辐照金属 TEM/STEM 缺陷检测中标注稀缺、人工成本高的问题,论文用从真实缺陷掩码统计中采样的多类掩码条件化潜扩散模型,生成带自动标签的图像-掩码对来增强 Mask R-CNN 训练。结果显示在 10/50/100 张小训练集上总体仅有小幅提升,检测与分类 F1 调和均值最高增益约 0.02,且检测或分类受益取决于数据划分,增益来源不完全稳定。

Why Not Hyperparameter-Friendly Optimisation? A Monotonic Adaptive Norm Rescaling Approach For Long-Tailed Recognition Figure 1
2026-06-02cs.CV

Why Not Hyperparameter-Friendly Optimisation? A Monotonic Adaptive Norm Rescaling Approach For Long-Tailed Recognition

Shuo Zhang, Chenqi Li, Tingting Zhu

University of Oxford

2026-06-02视觉感知

针对长尾识别中两阶段解耦的分类器重训依赖敏感超参数来调节类别权重范数的问题,论文从类条件分布角度支持“尾类主要是表征欠拟合”这一解释,并提出 SAMN:用 PAVA 直接约束按类别频次排序的权重范数单调变化,避免正则项调参。实验显示其可作为通用重缩放模块提升多个基准上的长尾识别精度,并多次达到或接近 SOTA。

FigSIM: A Dataset for Fine-grained Suicide Severity and Figurative Language in Suicide Memes Figure 1
2026-06-02cs.CL

FigSIM: A Dataset for Fine-grained Suicide Severity and Figurative Language in Suicide Memes

Liuliu Chen, Elise R. Carrotte, Brian E. Chapman, Jo Robinson, Mike Conway

School of Computing and Information Systems, University of Melbourne, Australia, Orygen, The National Centre of Excellence in Youth Mental Health, Australia, Centre for Youth Mental Health, University of Melbourne, Australia, O’Donnell School of Public Health, UT Southwestern Medical Center, United States

2026-06-02数据集/基准

针对社交平台上自杀相关 meme 难以用文本式、二分类审核方法理解的问题,论文构建 FigSIM:含 1049 张 Reddit meme,标注细粒度自杀严重度、隐喻/反讽等修辞现象及具体自杀相关内容,并评测 16 类单模态/多模态模型。结果显示最佳多模态模型在三项任务 macro-F1 约为 70.21%、71.60%、58.51%,但高严重度尤其是修辞化表达常被低估,说明当前模型和审核策略仍缺乏情境化理解。

Moment-Video: Diagnosing Temporal Fidelity of Video MLLMs on Momentary Visual Events Figure 1
2026-06-02cs.CV

Moment-Video: Diagnosing Temporal Fidelity of Video MLLMs on Momentary Visual Events

Xiaolin Liu, Yilun Zhu, Xiangyu Zhao, Xuehui Wang, Yan Li, Xin Li, Haoyu Cao, Xing Sun, Shaofeng Zhang, Xu Yang, Zhihang Zhong, Xue Yang

2026-06-02视觉感知

针对视频 MLLM 在稀疏采样、视觉 token 压缩和粗粒度聚合下容易错过短暂关键事件的问题,论文提出 Moment-Video 基准,以 1000 个跨 7 类场景的人审视频问答,专门评测事件发生、计数、动作描述和时序推理。33 个模型测试显示最佳 Seed-2.0-Pro 仅 39.6%,多数开源模型低于 25%,加密采样虽有帮助但不能解决短暂事件的时序保真瓶颈。

Drifting Preference Optimization for One-Step Generative Models Figure 1
2026-06-02cs.LG

Drifting Preference Optimization for One-Step Generative Models

Zhou Jiang, Yandong Wen, Zhen Liu

Westlake University, The Chinese University of Hong Kong, Shenzhen

2026-06-02生成模型优化算法

针对一步文本到图像模型难以用传统 RLHF/DPO 对齐(缺少似然、去噪轨迹,且奖励反传昂贵或不可用)的问题,论文提出 DrPO:用当前模型样本的奖励排序构造特征空间“偶极”偏好漂移,并结合冻结基模型的参考漂移,以脱梯度回归目标微调。实验在 SD-Turbo/SDXL-Turbo、HPSv3 与 GenEval 等设置中优于无奖励梯度基线,并在匹配有效 batch 下将 HPSv3 训练计算降至约 1/3.51,但离线扩展仍较初步。

ToolFG: Towards Well-Grounded Fine-Grained Image Classification Figure 1
2026-06-02cs.CV

ToolFG: Towards Well-Grounded Fine-Grained Image Classification

Yu Xue, Haoxuan Qu, Zhuoling Li, Yihang Lou, Yan Bai, Hossein Rahmani, Jun Liu

Lancaster University, Peking University

2026-06-02视觉感知

针对现有多模态大模型做细粒度分类时常依赖“尾巴不长”等模糊描述、缺少可验证视觉证据的问题,ToolFG将图像处理与测量工具封装为可调用API,让模型在推理中主动放大、取色、测量部件比例等;并用MCTS引导从强教师模型蒸馏工具使用轨迹,再通过模型—工具共进化优化工具集和调用策略。实验显示该框架在多种设置下提升细粒度识别效果,但具体增益与工具、蒸馏数据各自贡献需看消融细节。

Not All Points Are Equal: Uncertainty-Aware 4D LiDAR Scene Synthesis Figure 1
2026-06-02cs.CV

Not All Points Are Equal: Uncertainty-Aware 4D LiDAR Scene Synthesis

Xiang Xu, Alan Liang, Youquan Liu, Xian Sun, Linfeng Li, Lingdong Kong, Ziwei Liu, Qingshan Liu

2026-06-02安全鲁棒

这篇论文针对现有4D LiDAR生成模型对所有空间区域平均分配建模能力的问题,指出远距、遮挡边界和小目标更不确定也更易失真。U4D用预训练分割器的香农熵估计逐点不确定性,先用无条件扩散生成高熵困难区域,再条件补全全场景,并以MoST门控融合时空特征。nuScenes和SemanticKITTI实验显示其FRD/FPD降低约6%–11%,时间一致性和下游分割表现也优于基线。

Question-Aware Evidence Ledgers for Video Relational Reasoning Figure 1
2026-06-02cs.CV

Question-Aware Evidence Ledgers for Video Relational Reasoning

Yilin Ou, Mengshi Qi, Huadong Ma

State Key Laboratory of Networking and Switching Technology, Beijing University of Posts and Telecommunications, China

2026-06-02视觉感知

该文针对 VRR-QA 中计数、左右/前后参照系、终点状态和对话指代容易被视频问答模型误判的问题,不再训练新模型,而是在 GPT-5.5 初答后按问题类型路由到“证据账本”,显式记录目标、计数单位、时空范围和参照系,并用检测、深度、ASR 等外部证据配合保守门控决定是否改答。消融显示从 71.89% 提升到 92.95% 总准确率、93.79% 宏准确率,但结果依赖强闭源模型,增益中 scaling 成分需谨慎解读。

GloResNet: A lightweight 3D CNN with global topological features for preterm brain injury prediction Figure 1
2026-06-02cs.CV

GloResNet: A lightweight 3D CNN with global topological features for preterm brain injury prediction

Boyu Yuan, Jiamiao Lu, Weichuan Zhang, Benqing Wu, Tuo Wang, Changshan Wang, Changming Sun, Liang Guo

2026-06-02三维

针对早产儿脑损伤 MRI 判读依赖专家且小样本 3D 数据易过拟合的问题,论文提出 GloResNet:将整脑 T2 MRI 统一重采样到 128³ 并做个体 z-score,以保留全局拓扑,再用 MedicalNet 初始化的轻量 ResNet-10、mixup、类别加权和 TTA 训练。dHCP 五折交叉验证平均准确率 75.18%、最高 81.82%,敏感性 0.76、特异性 0.81;但细小白质损伤可能因降采样被平滑,增益也部分依赖预训练和正则化。

MORPHOS: Autoregressive 4D Generation with Temporal Structured Latents Figure 1
2026-06-02cs.CV

MORPHOS: Autoregressive 4D Generation with Temporal Structured Latents

Minkyung Kwon, Jinhyeok Choi, Youngjin Shin, Jaeyeong Kim, JongMin Lee, Seungryong Kim

2026-06-02视觉感知

现有视频到4D资产方法常绑定单一表示,且依赖形变导致拓扑变化和长序列一致性不足。MORPHOS将结构化潜变量扩展为时间结构潜变量T-SLat,用两阶段自回归流先生成稀疏体素再生成统一4D表示,并以因果注意力和时序-结构增强降低误差累积。实验显示其可同时输出网格、3D Gaussian和辐射场,在外观指标达SOTA、几何结果具竞争力,长时生成更稳。

X-Stream: Exploring MLLMs as Multiplexers for Multi-Stream Understanding Figure 1
2026-06-02cs.CV

X-Stream: Exploring MLLMs as Multiplexers for Multi-Stream Understanding

Peiwen Sun, Xudong Lu, Huadai Liu, Yang Bo, Dongming Wu, Huankang Guan, Minghong Cai, Jinpeng Chen, Xintong Guo, Shuhan Li, Rui Liu, Xiangyu Yue

2026-06-02视觉感知

现实机器人多相机、自动驾驶和直播等场景需要在线跨视频流理解,而现有评测多停留在单流。X-Stream构建932段视频、4220个问答的多流流式基准,并用双重验证抑制单流捷径,还把MLLM视作受带宽约束的“复用器”,比较空分、时分、语义复用策略。实验显示当前强模型综合得分约50%,主动性和因果等跨流推理仍明显不足。

Places in the Wild: A Large, High-Resolution RAW Photograph Dataset for Ecologically Valid Vision Research Figure 1
2026-06-02cs.CV

Places in the Wild: A Large, High-Resolution RAW Photograph Dataset for Ecologically Valid Vision Research

Michelle R. Greene

Barnard College, Columbia University

2026-06-02视觉感知数据集/基准

针对常用视觉数据集多为低分辨率、网络 JPEG 且缺少真实采集条件与连续视角的问题,本文构建 Places in the Wild:在 810 个真实地点按标准协议采集 67,574 张 45MP RAW/JPEG 图像,覆盖 260 类场景,并以 5° 间隔提供近 360° 稠密视角及 EXIF、质量指标。主要结果是形成约 3 万亿像素、可用于自然场景统计、视角依赖识别和真实条件下场景理解评测的大规模开放数据集;文中未充分说明其对具体模型性能的增益。

Retrieve What's Missing: Coverage-Maximizing Retrieval for Consistent Long Video Generation Figure 1
2026-06-02cs.CV

Retrieve What's Missing: Coverage-Maximizing Retrieval for Consistent Long Video Generation

Minseok Joo, Dogyun Park, Taehoon Lee, Kyujin Lee, Hyunwoo J. Kim

Korea University

2026-06-02视觉感知

长视频自回归生成常因上下文有限,在相机重访场景时出现几何漂移,影响机器人仿真等世界模型应用。本文提出 CovRAG,用预训练 3D 先验的深度与位姿构建目标视角覆盖图,并按残余覆盖增益迭代检索互补历史帧,避免 FoV 检索过粗和显式重建过贵。RealEstate10K 与 DL3DV10K 上,MEt3R 几何一致性误差最高降 29%,相较 3D 记忆方法延迟最高低 5 倍。

MASER: Modality-Adaptive Specialist Routing for Embodied 3D Spatial Intelligence Figure 1
2026-06-02cs.CV

MASER: Modality-Adaptive Specialist Routing for Embodied 3D Spatial Intelligence

Hilton Raj, Vishnuram AV

Boston University

2026-06-02三维

MASER针对具身3D VQA中问题语义会偏好不同传感模态、但逐一调用多模态适配器代价高的问题,提出在共享Qwen2-VL骨干上训练图像、深度、点云、位姿、文本五个DoRA专家,并用仅看问题文本的SBERT+MLP路由器选择适配器。Open3D-VQA显示不存在单一最优模态,点云占51.5%最优;路由与oracle一致率51.3%,高于随机森林43.5%,延迟最低,但整体准确率未超过图像单模态,增益主要体现为成本权衡。

Active Exploring like a Pigeon: Reinforcing Spatial Reasoning via Agentic Vision-Language Models Figure 1
2026-06-02cs.CV

Active Exploring like a Pigeon: Reinforcing Spatial Reasoning via Agentic Vision-Language Models

Wei Deng, Xianlin Zhang, Mengshi Qi

2026-06-02视觉语言视觉感知

针对 VLM 空间推理常被动接收全景信息、且强化学习只依赖最终答案导致奖励稀疏的问题,论文把模型设计成主动探索者:选择性检索视角,持续更新以物体位置和朝向表示的动态认知地图,并用可执行的 Spatial Assertion Codes 校验中间空间关系以提供密集奖励。经监督微调和强化微调后,在 MindCube 上达到 80.5% 准确率,尤其 Rotation 子集较最佳基线提升 29.5 个百分点。

Initialization is Half the Battle: Generating Diverse Images from a Guidance Potential Posterior Figure 1
2026-06-02cs.CV

Initialization is Half the Battle: Generating Diverse Images from a Guidance Potential Posterior

Xiang Li, Dianbo Liu, Kenji Kawaguchi

2026-06-02视觉感知

论文针对扩散/流匹配生成中随机种子虽不同却易收敛到少数模式的问题,指出标准高斯初始化忽略条件引导势能地形,高势能区域会放大轨迹收缩。作者提出 DivIn,将初始噪声改为从引导势能后验采样,并用 Langevin 动力学在保持高斯先验约束的同时避开塌缩区域。实验显示其在 ImageNet 类条件和文本到图像任务中提升多样性指标,且可与轨迹干预方法叠加拓展质量-多样性折中。

Reason-Then-Retrieve for CoVR-R with Structured Edit Prompts and Dense-Sparse Fusion Figure 1
2026-06-02cs.CV

Reason-Then-Retrieve for CoVR-R with Structured Edit Prompts and Dense-Sparse Fusion

DongQing Liu, MengShi Qi, HongWei Ji

Beijing University of Posts and Telecommunications

2026-06-02视觉感知

本文面向 CoVR-R 中“目标视频需由参考视频+编辑指令推断”的难点,指出普通字幕会丢失动作顺序、终态和交互细节。方法以 Qwen3.5-27B 先推理编辑再检索,生成结构化目标/库视频描述,用加权生成 token 隐状态做稠密表示,并融合 TF-IDF 精确词匹配。零样本设置下验证集 R@1 达 80.81,盲测 R@1 达 89.73。

HLL: Can Agents Cross Humanity's Last Line of Verification? Figure 1
2026-06-02cs.AI

HLL: Can Agents Cross Humanity's Last Line of Verification?

Xinhao Song, Su Su, Sirui Song, Hongliang Wu, Wen Shen, Zhihua Wei, Gongshen Liu, Linfeng Zhang, Dongrui Liu

Shanghai Jiao Tong University, Shandong University, Tongji University

2026-06-02视觉感知

论文关注多模态 GUI 代理在真实网页流程中能否跨过 CAPTCHA 这类“人类验证”边界,而非只做静态识别。作者提出 HLL 基准,将十类交互式 CAPTCHA 按难度、页面干扰和基于动作轨迹的动态验证拆解评测,并可接入网页/移动代理环境。对八个前沿代理的闭环实验显示,当前系统在不同验证类型上表现波动大,遇到杂乱界面和轨迹一致性约束时明显退化,暴露出定位、动作校准、状态跟踪与过程一致性的短板。

PaSBench-Video: A Streaming Video Benchmark for Proactive Safety Warning Figure 1
2026-06-02cs.CL

PaSBench-Video: A Streaming Video Benchmark for Proactive Safety Warning

Yusong Zhao, Yuejin Xie, Youliang Yuan, Junjie Hu, Jitian Guo, Yujiu Yang, Pinjia He

The Chinese University of Hong Kong, Shenzhen, 2 Tsinghua University

2026-06-02视觉感知数据集/基准安全鲁棒

论文针对现有安全基准多为静态输入、缺少预警时机与误报评估的问题,提出 PaSBench-Video:740 段跨驾驶、医疗、日常和工业的视频,标注风险出现与事故边界,并以因果流式协议评估模型是否在正确时间、以正确内容报警。对 13 个视频 MLLM 的测试显示,最严格指标最高仅 20.0%,召回提升伴随高误报,说明当前模型更多依赖场景活动线索而非真正推理风险如何演化为伤害。

Spatial-Temporal Decoupled Reference Conditioning for Identity-Preserving Text-to-Video Generation Figure 1
2026-06-02cs.CV

Spatial-Temporal Decoupled Reference Conditioning for Identity-Preserving Text-to-Video Generation

Yuheng Chen, Teng Hu, Yuji Wang, Qingdong He, Lizhuang Ma, Jiangning Zhang

Shanghai Jiao Tong University, University of Electronic Science and Technology of China, Zhejiang University, Shanghai Jiao Tong University Shanghai Shanghai China, University of Electronic Science and Technology of China Chengdu Sichuan China, Zhejiang University Hangzhou Zhejiang China

2026-06-02视觉感知

该文针对身份保持文生视频中“文本可控性”和“人脸细节保真”难以兼顾的问题,提出 ST-DRC:将参考图经视频 VAE 编码为潜空间身份记忆,并用时间邻近、空间错位的 TASS-RoPE 让模型检索身份而减少像素级照搬;训练中加入外观扰动和人脸身份监督,推理时用三路 CFG 分离文本与参考强度。基于 LTX-2.3 的实验显示其在身份一致性、提示对齐、时序稳定和视频质量上表现较强,并在相关赛道中排名靠前。

Geometry-Aware Implicit Memory for Video World Models Figure 1
2026-06-02cs.CV

Geometry-Aware Implicit Memory for Video World Models

Zhengxuan Wei, Xu Guo, Xinghui Li, Xunzhi Xiang, Min Wei, Yiran Zhu, Qiulin Wang, Xintao Wang, Pengfei Wan, Xiangwang Hou, Qi Fan

School of Intelligence Science and Technology, Nanjing University, Tsinghua University

2026-06-02视觉感知强化学习

论文关注视频世界模型长时滚动中历史信息离开上下文后导致的外观漂移与几何不一致问题。GIM-World 的关键思路是把几何视为“记忆状态”的属性:用轻量 Transformer 将变长历史压成固定记忆 token,并在训练期通过可相机查询的几何头从冻结 3D 基础模型蒸馏跨视角结构,同时用信息量准则裁剪历史以控成本。MIND 实验显示其在长程视觉一致性、动作控制和 3D 几何一致性上优于显式与隐式记忆基线。

GC-MoE: Genomics-Guided Cell-Type-Specific Mixture of Experts for Histology-Based Single-Cell Spatial Transcriptomics Figure 1
2026-06-02cs.CV

GC-MoE: Genomics-Guided Cell-Type-Specific Mixture of Experts for Histology-Based Single-Cell Spatial Transcriptomics

Kaito Shiku, Ahtisham Fazeel Abbasi, Ryoma Bise, Yuichiro Iwashita, Kazuya Nishimura, Andreas Dengel, Muhammad Nabeel Asim

Kyushu University, Japan, German Research Center for Artificial Intelligence (DFKI GmbH), Germany, RPTU University Kaiserslautern-Landau, Germany, The University of Osaka, Japan, Osaka Metropolitan University, Japan

2026-06-02视觉感知

本文针对从 H&E 病理图像和细胞位置估计单细胞空间转录组的难题:单细胞表达差异强、且受细胞类型结构约束,普通共享回归易得到折中表达。GC-MoE用路由网络软选择细胞类型专家,并以CAP引入细胞类型特异共表达先验、C2CA利用邻近细胞上下文。多组公开单细胞ST实验和消融显示其优于现有单细胞方法及改造的spot级基线。

Edge Prediction for Roof Wireframe Reconstruction with Transformers Figure 1
2026-06-02cs.CV

Edge Prediction for Roof Wireframe Reconstruction with Transformers

Gustav Hanning, Ludvig Dillén, Jonathan Astermark, Johanna Lidholm, Viktor Larsson

Centre for Mathematical Sciences, Lund University

2026-06-02三维

面向从稀疏 SfM 点云与地面语义/深度线索重建屋顶三维线框的挑战,论文将任务改写为端到端边预测:按语义优先级采样点云,融合 Gestalt/ADE20k 及冻结自编码器提供的多视角局部语义特征,再用 DETR 式 Transformer 查询直接解码边端点。方法在 HoHo 22k 私榜取得 HSS 0.6476,排名第二,并优于手工与学习基线。

Explainable Forensics of Manipulated Segments in Untrimmed Long Videos Figure 1
2026-06-02cs.CV

Explainable Forensics of Manipulated Segments in Untrimmed Long Videos

Yue Feng, Jingjing Li, Qijia Lu, Wei Ji, Jingrou Zhang, Fei Shen, Xiao Li, Yizhen Jia, Qiang Chen, Limin Wang, Wentong Li, Jie Qin

2026-06-02视觉感知

这篇论文针对现有伪造视频检测多停留在短片二分类、难以处理长视频中局部嵌入 AIGC 片段的问题,提出“长视频 AI 生成片段定位与解释”任务,并构建含 12,472 个未裁剪视频的 TASLE 基准,提供边界、真伪与解释标注。方法上给出粗到细的 MSLoc:先用边界敏感提议筛查长视频,再借助 MLLM 精修边界并生成取证理由。实验表明该基线在长视频混合真伪场景中有效,但最终性能受首阶段召回限制。

Honey, I Shrunk the Arc de Triomphe! Figure 1
2026-06-02cs.CV

Honey, I Shrunk the Arc de Triomphe!

Yuanbo Xiangli, Hanyu Chen, Xueqing Tsang, Noah Snavely

2026-06-02视觉感知

论文指出单目度量几何模型在野外场景存在“尺度坍缩”,远处地标被系统性缩小,根因可能主要来自缺少真实且尺度多样的训练数据。作者构建 MetricScenes,从互联网照片与立体影像中借助地理标签、已知基线恢复绝对尺度,并用两阶段边缘感知 Poisson 补全提升深度标签质量。基于该数据微调 MoGe-2 得到 WildMoGe,显著缓解远景尺度低估,在开放场景度量精度更好,同时保持标准基准表现。

PRIMA: Boosting Animal Mesh Recovery with Biological Priors and Test-Time Adaptation Figure 1
2026-06-02cs.CV

PRIMA: Boosting Animal Mesh Recovery with Biological Priors and Test-Time Adaptation

Xiaohang Yu, Ti Wang, Mackenzie Weygandt Mathis

2026-06-02视觉感知

针对单目四足动物三维网格恢复中3D监督稀缺、物种长尾和姿态不均衡导致的均值形状/姿态回归,PRIMA将BioCLIP生物语义与形态先验注入SMAL预测,并用2D重投影和关键点引导做测试时自适应,进而生成Quadruped3D伪3D数据。实验在Animal3D、CtrlAni3D等基准达到SOTA,尤其改善欠代表物种和复杂姿态。

Do Multimodal Agents Really Benefit from Tool Use? A Systematic Study of Capability Gains Figure 1
2026-06-02cs.CV

Do Multimodal Agents Really Benefit from Tool Use? A Systematic Study of Capability Gains

Garvin Guo, Donglei Yu, Yu Chen, Xiang Wang, Shuai Li, Xinpei Zhao, Huaxing Liu, Qinghao Wang, Minpeng Liao

University of Chinese Academy of Sciences, Tongyi Lab, Alibaba Group, Peking University, ation should distinguish tool availability from, ‡ Intern at Tongyi Lab, Alibaba Group., that the tool mattered. Distinguishing tool availabil-

2026-06-02视觉语言

论文质疑多模态智能体的工具调用轨迹是否真的带来能力增益,而非只是学会调用流程。作者以 Thyme、DeepEyesV2 为例,对比禁用工具版本和无工具训练的 Pure-Text Reasoner,并用解题集合、过程归因、format-only/result-only 消融分析工具贡献。结果显示工具访问未稳定提升准确率或降低 token 成本,93.2%/96.0% 的工具解题也可被非工具设置解决,增益来源不清。

Multi-modal Video Representation Alignment for Robust Self-supervised Driver Distraction Detection Figure 1
2026-06-02cs.CV

Multi-modal Video Representation Alignment for Robust Self-supervised Driver Distraction Detection

David J. Lerch, Livien Majer, Zeyun Zhong, Manuel Martin, Frederik Diederichs, Rainer Stiefelhagen

2026-06-02视觉感知安全鲁棒

面向真实驾驶监控中多传感器信号受遮挡、视角变化和语义重叠影响的问题,本文提出自监督的全局多模态视频对齐框架:用循环一致性生成软目标,缓解“所有负样本都应推远”的假设,并按相似度分布降低噪声正样本权重。在 Drive&Act 上,方法在 RGB、红外、深度和骨架模态间优于成对及已有全局对齐基线,跨视角实验也显示对未见摄像机视角有更好泛化。

TROPHIES: Temporal Reconstruction of Places, Humans, and Cameras from Multi-view Videos Figure 1
2026-06-02cs.CV

TROPHIES: Temporal Reconstruction of Places, Humans, and Cameras from Multi-view Videos

Jinpeng Liu, Yukang Xu, Yutong Li, Xingyu Liu

National University of Singapore

2026-06-02视觉感知三维

这篇论文针对人体运动、场景几何与相机轨迹长期被分开重建而导致尺度漂移、交互不物理的问题,提出多视角视频中的统一人-场景-相机4D重建任务。TROPHIES用多视角时空人体分支、人感知静态场景分支,以及结合尺度、接触、重力和跨视角时序一致性的全局优化来对齐坐标系。文中在EgoHuman和EgoExo4D上显示,其全局保真度和人景一致性优于既有范式。

VEDAL: Variational Error-Driven Asynchronous Learning for 3D Gaussian Splatting Pruning Figure 1
2026-06-02cs.CV

VEDAL: Variational Error-Driven Asynchronous Learning for 3D Gaussian Splatting Pruning

Aoduo Li, Jiancheng Li, Huan Ye, Hongjian Xu, Shiting Wu, Xiujun Zhang, Zimeng Li, Xuhang Chen

2026-06-02三维

针对3D Gaussian Splatting因数百万高斯导致显存占用高、现有剪枝易用固定时刻或启发式分数误删未收敛区域的问题,VEDAL将剪枝写成变分自由能最小化,并用逐高斯预测误差门控在重要性稳定后才异步施加稀疏先验,再由伯努利变分头学习保留概率。实验在三类基准上实现约5.2×压缩、PSNR仅降0.31 dB,并保持约185 FPS;相对基线提升较稳定但幅度不大。

Detecting Pen-In-Air States from Video: A Proof-of-Concept Toward Complementary Handwriting Analysis Figure 1
2026-06-02cs.CV

Detecting Pen-In-Air States from Video: A Proof-of-Concept Toward Complementary Handwriting Analysis

Lauren Sismeiro, Remy Plastre, Binbin Xu, Frederic Puyjarinet, Gerard Dray

2026-06-02视觉感知

本文针对数位板只能感知贴近纸面的笔尖、可能漏掉高抬笔空中运动的问题,探索用俯视普通视频补充书写动力学分析。方法将 YOLO 笔尖跟踪、运动学特征提取与传统分类器解耦组合,比端到端 CNN 更适合小数据且可解释。在 5 段公开视频、逐帧人工标注和 LOVO 评估下,Pen-Up 事件级 F2 最高 0.805;但样本规模很小,泛化性文中未充分说明。

Entropy Minimization without Model Collapse: Mitigating Prediction Bias in Medical Imaging Figure 1
2026-06-02cs.LG

Entropy Minimization without Model Collapse: Mitigating Prediction Bias in Medical Imaging

Tim Nielen, Sameer Ambekar, Johannes Kiechle, Daniel M. Lang, Julia A. Schnabel

School of Computation, Information and Technology, Technical University of Munich, Germany, Institute of Machine Learning in Biomedical Imaging, Helmholtz Munich, Germany, School of Biomedical Engineering and Imaging Sciences, King’s College London, UK, Munich Center for Machine Learning (MCML), relAI – Konrad Zuse School of Excellence in Reliable AI, TUM University Hospital Rechts der Isar

2026-06-02视觉感知

医学影像部署中常见扫描仪、染色或人群差异带来的细微分布偏移,现有测试时熵最小化易出现单类预测崩塌。论文的核心洞察是:偏移会先让特征空间中不同类别簇合并,造成预测类别分布偏置,而熵最小化会继续压紧这些错误簇。作者提出DSBR,在测试时按预测类别分布重加权熵损失,平衡各类贡献;在四个医学影像数据集及ImageNet-C上能稳定适应、避免崩塌,并达到或超过多种现有方法。

Hallucination-Aware Diffusion Sampling for Inverse Problems via Robust Prior Updates Figure 1
2026-06-02cs.CV

Hallucination-Aware Diffusion Sampling for Inverse Problems via Robust Prior Updates

Pengfei Jin, Yiqi Tian, Kailong Fan, Bingjie Qi, Quanzheng Li

Center for Advanced Medical Computing and Analysis, Massachusetts General Hospital and Harvard Medical School, Boston, MA 02114, Department of Industrial Engineering, University of Pittsburgh, Pittsburgh, PA 15261

2026-06-02生成模型安全鲁棒

本文关注扩散模型求解逆问题时“看起来真实但不受观测支持”的幻觉风险,指出贝叶斯式求解器中幻觉可在先验提议阶段进入,再由测量校正难以完全消除。作者提出 RPU,在不改变 DPS 测量更新的情况下探测并重锚先验位移,以提升局部稳定性。FFHQ 的修补和去模糊任务中 PSNR、LPIPS 均优于 DPS,人评也明显偏好 RPU;ImageNet 结果平局较多但非平局样本仍倾向 RPU。

Training-Free Composed Video Retrieval via Visual Representation-Guided Video-LLM Reasoning Figure 1
2026-06-02cs.CV

Training-Free Composed Video Retrieval via Visual Representation-Guided Video-LLM Reasoning

Yang Liu, Qianqian Xu, Peisong Wen, Siran Dai, Qingming Huang

School of Computer Science and Technology, University of Chinese Academy of Sciences, State Key Laboratory of AI Safety, Institute of Computing Technology, Chinese Academy of Sciences, Beijing Academy of Artificial Intelligence, Institute of Information Engineering, Chinese Academy of Sciences, School of Cyber Security, University of Chinese Academy of Sciences

2026-06-02视觉感知三维

针对“参考视频+文本修改”检索目标视频时,全库逐一用视频大模型推理成本高且仅靠视觉相似难满足编辑语义的问题,论文提出免训练粗到细流程:先用冻结 DINOv3 帧特征与 Chamfer 相似度筛候选,再由 Qwen3-VL 按修改指令重排并对前列候选深度推理细化。在 CoVR-R 测试集上,R@1 从 DINOv3 的 25.34 提升到最终 48.78,R@5 为 51.48。

Deep Learning for Remote Sensing to Improve Flood Inundation Mapping Figure 1
2026-06-02cs.CV

Deep Learning for Remote Sensing to Improve Flood Inundation Mapping

Yogesh Bhattarai, Vijay Chaudhary, Wai Lim Kim, Sanjib Sharma

2026-06-02视觉感知

洪水期间光学卫星常被云遮挡,传统时序合成难以跟上淹没范围的快速变化。本文将去噪扩散模型与Masked Diffusion Transformer用于Sentinel-2B多光谱洪水影像去云,结合自注意力、掩码重建和DEM地形信息推断被遮挡水体。实验显示其在图像质量及水体连续性、光谱水指数保持等水文指标上更稳健,但数据规模仅62幅,泛化增益仍需更多验证。

Measurement Geometry and Design for Trustworthy Generative Inverse Problems Figure 1
2026-06-02cs.LG

Measurement Geometry and Design for Trustworthy Generative Inverse Problems

Pengfei Jin, Na Li, Quanzheng Li

Center for Advanced Medical Computing and Analysis, Massachusetts General Hospital and Harvard Medical School, Boston, MA 02114, School of Engineering and Applied Sciences, Harvard University, Boston, MA 02138

2026-06-02生成模型

针对扩散等生成先验在欠定反问题中可能“补全”未观测方向、产生可信度风险的问题,本文从测量几何刻画算子能否区分局部数据流形上的合理替代解,提出局部测量-流形兼容性指标及基于后验云的固定/序贯采样设计。实验覆盖行采样、层析角度选择和 fastMRI 笛卡尔采样,显示几何分数能预测幻觉与失败模式,并在固定预算下优于强非学习 ACS 保留基线。

Cross-Domain Dead Tree Detection via Knowledge Distillation in Aerial Imagery Figure 1
2026-06-02cs.CV

Cross-Domain Dead Tree Detection via Knowledge Distillation in Aerial Imagery

Anis Ur Rahman, Mete Ahishali, Einari Heinaro, Samuli Junttila

CSC – IT Center for Science Ltd., Espoo, Finland, Department of Forest Sciences, University of Helsinki, KOKO Forest Ltd., School of Forest Sciences, University of Eastern Finland

2026-06-02视觉感知

针对航拍死树检测在不同森林区域间因树种、冠层密度、成像条件差异和标注稀缺而泛化困难的问题,论文将芬兰数据训练的 TreeMort-1T-UNet 作为教师,比较基础、自蒸馏、特征级和集成蒸馏以适配波兰、德国、爱沙尼亚等目标域。结果显示特征级蒸馏最稳,在波兰集上 F1 达 0.63、精度 0.55,并在低数据场景减少误检;表征分析也支持其更强域不变性。

Quantitative Movement Testing: Measuring Patient Movements from a Single Smartphone Video Figure 1
2026-06-02cs.HC

Quantitative Movement Testing: Measuring Patient Movements from a Single Smartphone Video

Pranav Mahajan, Amanda Wall, Eleonora Maria Camerone, Julie Stebbins, Eoin Kelleher, Shuangyi Tong, Annina Schmid, Katja Wiech, Anushka Irani, Ben Seymour

Nuffield Department of Clinical Neurosciences, University of Oxford, Oxford, UK., Max Planck Institute of Biological Cybernetics, Tuebingen, Germany., Oxford Gait Laboratory, University of Oxford, UK., Harvard Medical School, Boston, Massachusetts, USA., Institute of Biomedical Engineering, University of Oxford, Oxford, UK.

2026-06-02视觉感知

针对慢性疼痛患者功能受损难以在真实环境中客观量化、光学动捕昂贵且受限于实验室的问题,论文提出 QMT:用单部智能手机视频结合深度学习 3D 姿态估计提取运动学 biomarker。其在前屈、原地踏步和小深蹲任务上与动捕高度一致,多数指标相关性 r>0.85,并在纤维肌痛和坐骨神经痛队列中显示较高重测可靠性与居家纵向监测可行性,但家庭场景方差更高。

Neural Acquisition & Representation of Subsurface Scattering Figure 1
2026-06-02cs.CV

Neural Acquisition & Representation of Subsurface Scattering

Arjun Majumdar, Raphael Braun, Hendrik Lensch

University of Tübingen

2026-06-02视觉感知

针对半透明材料次表面散射难以用解析 BSSRDF 或少量采样准确建模、完整光传输采集又代价高的问题,论文用3D扫描中常见的高频相移条纹作为少量输入,训练 U-Net 预测每个表面像素的各向异性散射 footprint,并据此进行图像域重光照。实验将预测重光照与真实投影拍摄对比,显示在多视角、多物体上能较好泛化;但方法不恢复物理材质参数,角度依赖和大范围散射仍未充分处理。

Cross-modal linkage risk in clinical vision-language models Figure 1
2026-06-02cs.CV

Cross-modal linkage risk in clinical vision-language models

Soroosh Tayebi Arasteh, Mahshad Lotfinia, Sven Nebelung, Daniel Truhn

2026-06-02视觉语言视觉感知安全鲁棒

本文关注临床视觉语言模型在“影像与报告应被隔离”场景下的跨模态重关联隐私风险,将其形式化为胸片到报告检索问题。核心洞察是,越医学专用的共享嵌入越可能保留实例级配对信息,且不只是疾病标签相似。实验显示 BioViL-T 等模型在 MIMIC-CXR、CheXpert Plus 上显著高于随机命中;仅对投影头做差分隐私微调可将 N=10000 的 Recall@1 降低 61.8%,同时 14 类影像分类 AUROC 基本不变。

Vision-language Models for Driver Monitoring Systems: A Driver Activity Description Dataset Figure 1
2026-06-02cs.CV

Vision-language Models for Driver Monitoring Systems: A Driver Activity Description Dataset

David J. Lerch, Sarath Mulugurthi, Manuel Martin, Frederik Diederichs, Rainer Stiefelhagen

2026-06-02视觉语言视觉感知数据集/基准

面向车内驾驶员监控,通用VLM难以区分开关瓶盖等细粒度驾驶动作,限制安全告警与可解释性。论文将Drive&Act原子动作转成自然语言描述,构建描述数据集,并用LLM评分评测/微调VLM。结果显示现有三种VLM零样本表现不可靠;在该数据上微调后跨DMD评测ACCR由66提升到76,但更广泛场景的泛化仍需更多数据验证。

From Extrinsic to Intrinsic: Geodesic-Guided Representation Learning for 3D Geometric Data Figure 1
2026-06-02cs.CV

From Extrinsic to Intrinsic: Geodesic-Guided Representation Learning for 3D Geometric Data

Yuming Zhao, Junhui Hou, Qijian Zhang, Jia Qin, Ying He

2026-06-02三维

本文针对现有3D预训练多依赖外在坐标结构或语义、难以刻画形状内在拓扑与抗形变细节的问题,提出PRISM:以测地距离预测为自监督任务,借鉴等距嵌入思想约束潜空间,并用两阶段训练和重要采样缓解测地距离样本不均衡。实验显示,该方法可仅从点云高效预测测地距离,并在形状识别、表面参数化和非刚性对应等任务上取得更强或有竞争力的表现。

A combination of noise and bilateral filters achieve supralinear and scalable adversarial robustness in CNNs Figure 1
2026-06-02cs.LG

A combination of noise and bilateral filters achieve supralinear and scalable adversarial robustness in CNNs

Nicolas Stalder, Benjamin F. Grewe, Matteo Saponati, Pau Vilimelis Aceituno

Institute of Neuroinformatics, ETH Zürich, University of Zürich

2026-06-02安全鲁棒

针对对抗训练计算开销大、且常针对特定攻击的问题,本文提出在训练和推理前端组合像素级高斯噪声与多次双边滤波,并从理论上解释二者通过互补机制带来超线性鲁棒性增益。实验显示该简单预处理可与对抗训练叠加,在 RobustBench/AutoAttack 上接近或超过既有强防御,同时仅用约35%训练 FLOPs,并在不同模型规模下以约2–8倍更少总计算匹配竞争方法。

Ego-METAS: Egocentric online Multimodal Energy-efficient Temporal Action Segmentation benchmark Figure 1
2026-06-02cs.CV

Ego-METAS: Egocentric online Multimodal Energy-efficient Temporal Action Segmentation benchmark

Maria Santos-Villafranca, Jesus Bermudez-cameo, Alejandro Perez-Yus, Giovanni Maria Farinella, Antonino Furnari

University of Zaragoza - I3A, Department of Mathematics and Computer Science, University of Catania

2026-06-02视觉语言视觉感知数据集/基准

面向机器人/可穿戴设备的持续感知,论文指出现有动作分割多默认算力与能耗充足,难以支持 always-on 部署。Ego-METAS 将 EgoExo4D、CMU-MMAC、CaptainCook4D 统一为超 100 小时、5 模态的在线节能时序动作分割基准,要求逐时刻动态选择传感器并满足硬件能耗预算。实验显示最优路由强依赖场景,现有面向裁剪片段的策略学习方法在未裁剪连续环境中适应不佳,而简单动态多模态融合也能改善精度-能耗权衡。

Towards Resolving Optimization Conflicts Between Image- and Text-Based Person Re-Identification Figure 1
2026-06-02cs.CV

Towards Resolving Optimization Conflicts Between Image- and Text-Based Person Re-Identification

Karina Kvanchiani, Timur Mamedov

Lomonosov Moscow State University, Russia

2026-06-02视觉感知优化算法

本文关注统一行人重识别中图像检索与文本检索的训练目标冲突:前者需要身份级不变性,后者常受实例级文本属性驱动。作者的核心洞察是不要用同一阶段强行联合优化,而是先训练共享视觉编码器,再冻结其语义空间并对齐文本编码器;实验显示 I2I 预训练可提升 T2I 泛化,在视觉预训练中加入文本监督还能同时改善两类检索,且无需增加架构复杂度。

Bayesian meta-learning for modeling Alzheimer's disease progression Figure 1
2026-06-02stat.ML

Bayesian meta-learning for modeling Alzheimer's disease progression

Clara Hoffmann, Nadja Klein

Scientific Computing Center, Karlsruhe Institute of Technology, Germany

2026-06-02视觉感知

本文关注阿尔茨海默病个体随访稀疏、MRI 高维且长期预测易过度自信的问题,提出结合元学习与贝叶斯最后一层的模型,用超网络根据患者历史轨迹动态调整预测分布,无需为新个体重训。理论与仿真说明确定性 ReLU 分类器在长期外推时会过度自信,贝叶斯化可缓解;在 ADNI 数据上总体性能接近单任务和确定性元学习方法,并在长期疾病进展预测上有明显改进。

Chroma Clues: Leveraging Color Statistics to Detect Synthetic Images Figure 1
2026-06-02cs.CV

Chroma Clues: Leveraging Color Statistics to Detect Synthetic Images

Lea Uhlenbrock, Davide Cozzolino, Christian Riess

2026-06-02视觉感知

针对生成图像越来越逼真、传统黑盒检测难解释的问题,本文从颜色统计入手,指出常用于生成器训练的 LPIPS 损失对色度不如亮度敏感,可能留下系统性色彩痕迹。作者设计六种手工颜色变换,并学习任务优化变换,用像素/块级颜色特征进行检测、修复区域可视化和模型归因;简单可解释分类器跨生成器平均准确率达 93.27%,且对六类后处理保持较强鲁棒性。

CORE-MTL: Rethinking Gradient Balancing via Causal Orthogonal Representations Figure 1
2026-06-02cs.CV

CORE-MTL: Rethinking Gradient Balancing via Causal Orthogonal Representations

Chengfeng Wu, Tao Zou, Yanru Wu, Jingge Wang

2026-06-02优化算法

本文针对多任务学习中负迁移与 OOD 退化,指出梯度平衡只处理冲突表象,未约束共享表征中语义与伪相关因素的纠缠。CORE-MTL 将表征分为语义流和残差流,并用重建、解耦、反事实不变性及物理/统计先验约束任务头只依赖稳定语义。理论上给出更紧的 OOD 泛化界并诱导梯度正交,实验在多个视觉多任务 ID/OOD 基准上优于十个基线。

Symmetry-Aware 9D Pose Estimation with Sim(3)-Consistent Feature and Spherical Inception Convolution Figure 1
2026-06-02cs.CV

Symmetry-Aware 9D Pose Estimation with Sim(3)-Consistent Feature and Spherical Inception Convolution

Panfei Cheng, Hongshan Yu, Wenrui Chen, Xiaojun Tang, Jian Liu, Naveed Akhtar

2026-06-02三维

面向无 CAD 模型的类别级机器人操作,论文针对 9D 位姿在非线性 Sim(3) 空间难学、类内形变大的问题提出 SSH-Pose:用 DINOv2 引导的对称感知模块先估计平移与尺寸,将旋转学习化简到 SO(3),再以 Sim(3) 一致的层次点对几何特征和球面大核 inception 卷积融合语义/几何信息。文中报告在基准与真实场景达到 SOTA,并搭建了可抓取多样未知物体的机器人系统。

Order within Chaos: Capturing Intrinsic Energy Anomalies for AI-Manipulated Image Forgery Localization Figure 1
2026-06-02cs.CV

Order within Chaos: Capturing Intrinsic Energy Anomalies for AI-Manipulated Image Forgery Localization

Yiming Wang, Baiqi Wu, Qingming Li, Jiahao Chen, Tong Zhang, Shouling Ji

2026-06-02视觉感知

针对扩散编辑图像缺少传统传感器噪声、语义又趋于自洽导致伪造定位失效的问题,论文从能量建模解释生成区域会抑制局部高频方差并形成能量异常,提出以 LAD 图捕获邻域统计差异,再结合轻量 LAD-Net 与 SAM adapter 细化像素级边界,并用 EditStream 持续合成训练数据;实验称在多个人工智能伪造定位数据集上达到新 SOTA,且能泛化到未见生成架构。

Closing the Alignment-Maturity Gap in Federated Prototype Learning Figure 1
2026-06-02cs.LG

Closing the Alignment-Maturity Gap in Federated Prototype Learning

Mario Casado-Diez, Alejandro Dopico-Castro, Verónica Bolón-Canedo, Bertha Guijarro-Berdiñas

2026-06-02视觉感知

本文针对联邦原型学习在非 IID 视觉数据上早期“原型尚不成熟却被强制对齐”的问题,指出距离相关梯度会压制本地判别表征形成。FedSAP 通过线性预热延迟原型对齐,并复用全局原型在超球面上做类别分离,无额外通信开销。三项基准实验显示其较原型基线最高提升约 4 个百分点,异质性越强收益越明显,并可较自然扩展到半监督场景。

InsightVQA: High-Dimensional Emotion-Cognitive Visual Question Answering Benchmark Figure 1
2026-06-02cs.CV

InsightVQA: High-Dimensional Emotion-Cognitive Visual Question Answering Benchmark

Shiyu Wang, Ziyu Liu, Chaoyi Yu, Yujie Yin, Zhongqian Mao, Jing Chen, Jiaqi Song, Yunshi Lan, Yan Wang (East China Normal University, Shanghai, China)

East China Normal University, East China Normal University Shanghai China

2026-06-02数据集/基准

现有视觉情感基准多停留在情绪分类,难评估模型对触发因素、语境因果和回应意图的理解。InsightVQA 将情感理解组织为感知、具身/证据化理解与认知推理三层 VQA,从 351K 图像筛得 138K 图像并构建 725K 问答,另设 30K 评测集和 InsightNet 基线。实验显示现有多模态模型在低层感知较强,但在高层情感归因与认知推理上仍明显受限。

Disentanglement-Based Equivariant Learning for Compositional VQA Figure 1
2026-06-02cs.CV

Disentanglement-Based Equivariant Learning for Compositional VQA

Zhou Du, Zhaoquan Yuan, Xiao Wu, Changsheng Xu

Zhou Du, Zhaoquan Yuan, and Xiao Wu are with the School, of Computing and Artificial Intelligence, Southwest Jiaotong University, Changsheng Xu is with the State Key Laboratory of Multimodal Artificial, Intelligence Systems (MAIS), Institute of Automation, Chinese Academy of, Sciences, Beijing 100190, China, and with the School of Artificial Intelligence, University of Chinese Academy of Sciences, Beijing 101408, China, and also with Peng Cheng Laboratory, ShenZhen 518055, China (e-mail:

2026-06-02视觉感知

针对组合式 VQA 中模型易学习概念共现偏差、难以泛化到未见视觉/语言组合的问题,论文提出 DEAL:用因果干预和重编码解耦视觉与文本概念,再在特征层构造组合变换,并约束答案随输入等变变化。方法仅依赖真实答案监督,在 CLEVR-CoGenT 和 GQA-SGL 上相较现有方法取得更好的组合泛化表现。

Multimodal Approaches for Visually-Rich Document Type Classification: A Comparative Analysis Figure 1
2026-06-02cs.CV

Multimodal Approaches for Visually-Rich Document Type Classification: A Comparative Analysis

Catyana Heyne, Jürgen Frikel, Filippo Riccio

2026-06-02视觉语言

面向企业/政务中版式复杂的视觉富文档分类,论文指出现有多模态模型因OCR依赖、布局建模与评测设置不一而难以比较。作者在统一RVL-CDIP流程下对LayoutLMv3、Donut、Qwen3-VL与Qwen3文本LLM做受控对比,核心洞察是图像与布局信号对分类最关键,OCR文本只是辅助;结果显示专用多模态Transformer整体优于通用LLM,尤其在布局密集文档上更可靠。

InfoMerge: Information-aware Token Compression for Efficient Video Large Language Models Figure 1
2026-06-02cs.CV

InfoMerge: Information-aware Token Compression for Efficient Video Large Language Models

Xinxin Liu, Shiwei Gan, Xiao Liu, Yafeng Yin, Lei Xie, Sanglu Lu

State Key Laboratory of Novel Software Technology, Nanjing University

2026-06-02视觉感知

针对 Video-LLM 视觉 token 过多导致推理开销高、现有免训练压缩依赖相邻帧局部相似且预算分配粗糙的问题,InfoMerge 将压缩重写为段级二阶时序冗余估计与信息感知预算分配:用 Temporal Fingerprint Difference 捕捉同一空间位置的段内相似结构变化,并用 CABA 按片段独特性和谱熵丰富度分配 token。实验显示其在多基准和骨干上取得更好效率–精度折中,在 LLaVA-OneVision-7B 上减少 85% 视觉 token 仍保留 98.8% 平均性能,prefill 加速 4.24 倍。

Predicting the risk of colorectal anastomotic leak based on preoperative mapping of the blood supply of the bowel Figure 1
2026-06-02eess.IV

Predicting the risk of colorectal anastomotic leak based on preoperative mapping of the blood supply of the bowel

Zahra Tabatabaei, Jon Sporring, Mark Bremholm Ellebæk, Alaa El-Hussuna

2026-06-02安全鲁棒

结直肠吻合口漏术前缺乏可靠预测,现有评估依赖医生目测血供,主观且难以预防干预。本文提出基于术前平扫/增强 CT 的 AI 流程,以肠系膜血管树、组织灌注等特征生成漏风险评分,并结合 CBMIR 检索相似历史病例提升可解释性。主要结果是给出从数据合规处理、分割配准到风险估计和临床部署的协议框架,文中未充分说明真实验证集上的预测增益。

Ultra Diffusion Poser: Diffusion-Based Human Motion Tracking From Sparse Inertial Sensors and Ranging-Based Between-Sensor Distances Figure 1
2026-06-02cs.CV

Ultra Diffusion Poser: Diffusion-Based Human Motion Tracking From Sparse Inertial Sensors and Ranging-Based Between-Sensor Distances

Dominik Hollidt, Tommaso Bendinelli, Christian Holz

Department of Computer Science, ETH Zurich, Switzerland

2026-06-02视觉感知生成模型三维

针对稀疏 IMU 人体动捕易受惯性漂移影响、既有 IMU+UWB 方法仅把测距当作特征而未利用几何约束的问题,UDP 用扩散式自回归补全预测 SMPL 动作,并通过 MDS 空间布局模块从 UWB 距离解析重建传感器 3D 位置,再在采样中以前向运动学的 UWB-Diffusion Guidance 约束预测距离一致性。实验在 AMASS、DIP-IMU、TotalCapture 等设置下达到 SOTA,关节位置误差相较先前方法最高降低 22%。

Rethinking Evaluation Paradigms in IBP-based Certified Training Figure 1
2026-06-02cs.LG

Rethinking Evaluation Paradigms in IBP-based Certified Training

Konstantin Kaulen, Hadar Shavit, Holger H. Hoos

2026-06-02数据集/基准

针对IBP认证训练中自然准确率与认证准确率相互冲突、单一配置报告易造成不公平比较的问题,本文主张用完整Pareto前沿评估方法,并以自动多目标超参数优化在相近预算下搜索各方法的最优权衡。实验发现既有结果普遍存在欠调优,部分新前沿支配原报告;同时近年进展幅度被高估,SABR偏高自然准确率、MTL-IBP偏强认证保证,方法间呈互补关系。

Equilibrated Diffusion: Frequency-aware Textual Embedding for Equilibrated Image Customization Figure 1
2026-06-02cs.CV

Equilibrated Diffusion: Frequency-aware Textual Embedding for Equilibrated Image Customization

Liyuan Ma, Xueji Fang, Guo-Jun Qi

Westlake University, Zhejiang University, Westlake University Hangzhou China

2026-06-02视觉感知生成模型

本文关注文本到图像个性化中主体身份、原图风格与背景容易纠缠,导致新提示尤其风格化提示下主体一致性和文本对齐难兼顾。方法以高低频分别关联风格与内容为核心洞察,提出频率感知解耦文本嵌入,并用主体掩码扩散削弱背景干扰、残差参考注意力保留结构细节。实验显示其在主体一致性和提示遵循上优于多种定制扩散方法。

Understanding-Enhanced Model Collaboration for Long-Tailed Egocentric Mistake Detection Figure 1
2026-06-02cs.CV

Understanding-Enhanced Model Collaboration for Long-Tailed Egocentric Mistake Detection

Boyu Han, Qianqian Xu, Shilong Bao, Zhiyong Yang, Ruochen Cui, Qingming Huang

State Key Laboratory of AI Safety, Institute of Computing Technology, CAS, School of Computer Science and Tech., University of Chinese Academy of Sciences, Beijing Academy of Artificial Intelligence, Institute of Information Engineering, CAS, School of Cyber Security, University of Chinese Academy of Sciences

2026-06-02视觉感知

本文面向第一视角教学视频中的操作失误检测,动机在于错误样本稀少且既可能是局部执行错误,也可能是流程阶段不匹配。作者提出 UE-MCM,用 Qwen3-VL 处理细粒度片段、DCR 增强的 CLIP4CLIP 建模粗细上下文,并以协作门融合,配合长尾损失优化。HoloAssist 测试集上仅用 RGB 达到 F-score 0.60,高于 2025 Top1 的 0.57,但消融不足,增益来源仍不完全清楚。

Jailbreaking Multimodal Large Language Models using Multi-Clip Video Figure 1
2026-06-02cs.CV

Jailbreaking Multimodal Large Language Models using Multi-Clip Video

Choongwon Kang, Seungjong Sun, Hyunmin Jun, Jang Hyun Kim

Department of Applied Artificial Intelligence, Sungkyunkwan University, Department of Human-Artificial Intelligence Interaction, Sungkyunkwan University

2026-06-02视觉语言视觉感知

本文关注视频输入下多模态大模型安全对齐为何更易失效的问题,构建含2920个多片段视频的 MCV SafetyBench,用不同数量、动态性和上下文多样性的短片段系统测试越狱风险。实验覆盖8个视频 MLLM,发现攻击成功率随片段数和语义多样性上升,视频比图像、动态视频比静态视频更脆弱;作者还提出基于抽帧图像安全过滤的简单防御,可一定程度缓解该漏洞。

Multimodal Action Diffusion for Robust End-to-End Autonomous Driving Figure 1
2026-06-02cs.CV

Multimodal Action Diffusion for Robust End-to-End Autonomous Driving

Jorge Daniel Rodríguez-Vidal, Diego Porres, Gabriel Villalonga Pineda, Antonio M. López Peña

2026-06-02视觉语言生成模型安全鲁棒

针对端到端自动驾驶多依赖轨迹中间表示、最终仍由确定性控制或带 GPS 的手工控制器执行的问题,本文主张应直接在油门、转向、刹车动作空间建模多模态不确定性。其 ADT 用无锚扩散 Transformer 生成多个动作候选,并以最近邻匹配选择执行命令,从而避免轨迹锚点和定位依赖。实验显示其在 Bench2Drive 闭环基准超过既有 SOTA,延迟低约 10 倍,并带来更稳定的表征与行为一致性。

WebSpline: Structure-Informed Splines for Real-Time 3D Gaussians from Monocular Videos Figure 1
2026-06-02cs.CV

WebSpline: Structure-Informed Splines for Real-Time 3D Gaussians from Monocular Videos

Jongmin Park, Jeonghwan Yun, Minh-Quan Viet Bui, Munchurl Kim

2026-06-02视觉感知三维

本文针对单目动态场景中多视角约束不足导致的结构不稳定与细节过平滑问题,提出 WebSpline:先用 2D 点轨构建并正则化结构代理图,再以结构引导的三次 Hermite 样条为每个 3D Gaussian 建模运动,并在空间/结构邻域上施加时序刚性约束。实验在 iPhone、NVIDIA 基准上取得 SOTA 渲染质量,PSNR 分别较次优提升 0.36/0.61 dB,且在 iPhone 上比 WorldTree 渲染快 10 倍以上。

LALE: Lightweight-Transformer Architecture for Land-Cover Estimation Figure 1
2026-06-02eess.IV

LALE: Lightweight-Transformer Architecture for Land-Cover Estimation

Ümit Mert Çağlar, Alptekin Temizel

2026-06-02视觉感知

面向高分辨率遥感地物分割中全局上下文、局部细节与算力预算难兼顾的问题,LALE按分辨率拆分编码器:高分辨率用轻量ConvMixer提取局部特征,低分辨率再用Transformer建模全局,并配合全MLP多尺度解码器、RMSNorm和StarReLU降本。在ARAS400k上,小模型仅1.6M参数,F1距UPerNet约2.6点,但参数少4.5倍、GMAC少17倍、吞吐高1.8倍。

FocusDiT: Masking Queries in Diffusion Transformers for Fine-grained Image Generation Figure 1
2026-06-02cs.CV

FocusDiT: Masking Queries in Diffusion Transformers for Fine-grained Image Generation

Xueji Fang, Liyuan Ma, Jianhao Zeng, Jinjin Cao, Mingyuan Zhou, Guo-Jun Qi

Zhejiang University, Westlake University, Westlake University Hangzhou China

2026-06-02视觉感知生成模型

本文关注 DiT 中较少被系统优化的 FFN,指出其类似存储视觉语义的键值词表,而细节区域的关键 query token 容易被背景、低频 token 干扰。FocusDiT 通过随时间步和层动态预测 Query Mask,只让关键 token 更充分调用 FFN,并重分配各层 FFN“词表”容量。文本到图像实验显示其在细粒度质量、定量指标和部分推理效率上优于对比方法。

Agentic-J: An AI Agent for Biological Microscopy Image Analysis Figure 1
2026-06-02cs.MA

Agentic-J: An AI Agent for Biological Microscopy Image Analysis

Lukas Johanns, Marilin Moor, Davide Panzeri, Yu Zhou, Xinyi Chen, Nora F. K. Pauly, Zixuan Pan, Matthias Gunzer, Andreas Müller, Yiyu Shi, Hedi Peterson, Jianxu Chen

Institute of Computer Science, University of Tartu, Tartu, Estonia., Faculty of Computer Science, Ruhr University Bochum, Bochum, Germany., Informatics Institute, University of Amsterdam, Amsterdam, Netherlands., Department of Computer Science and Engineering, University of Notre Dame, Notre, Institute for Experimental Immunology and Imaging, University of Duisburg-Essen, Institute of Molecular and Clinical Immunology, Faculty of Medicine, Magdeburg, project is available at https://mmv-lab.github.io/Agentic-J/., The open-source code is available at https://github.com/MMV-Lab/Agentic-J. In general, the main

2026-06-02视觉感知

生物显微图像分析常受 Fiji/ImageJ 插件依赖、参数选择和手工流程不可复现困扰。Agentic-J 将 Fiji、兼容插件和多智能体助手封装进沙箱容器,用自然语言生成或引导执行分割、跟踪、统计与质控脚本,并把数据、代码、图表和记录组织为可追溯项目。案例中复现小鼠干细胞跟踪得到原论文一致的 29 条轨迹和 2001 个 spots,但系统性基准和相对增益文中未充分说明。

FACT: A Simple and Efficient Framework for Active Finetuning Figure 1
2026-06-02cs.CV

FACT: A Simple and Efficient Framework for Active Finetuning

Wenshuai Xu, You Song, Yuzhuo Cui, Minjie Ren, Qingjie Liu, Zhenghui Hu

2026-06-02视觉感知

本文关注主动微调中“选少量样本后如何微调”被忽视的问题:全量微调在标注稀缺和分布偏移下会扭曲预训练特征并加剧过拟合。作者提出 FiAF 视角与 FACT 三阶段框架,先线性探测、再全量微调,最后用冻结特征增强和轻量模型降低参数风险。实验覆盖多类分类数据集和 ConvNeXt、ViT、ViL,在低采样率下 ViT 于 CIFAR/ImageNet 等任务报告超过 20% 增益,并提升效率与鲁棒性。

Fast and Lightweight Novel View Synthesis with Differentiable Multiplane Image Figure 1
2026-06-02cs.CV

Fast and Lightweight Novel View Synthesis with Differentiable Multiplane Image

Kaidi Zhang, Guanxu Zhu

2026-06-02视觉感知

面向机器人与移动端等稀疏视角场景,论文针对 NeRF/3DGS 训练慢、模型大及前馈高斯冗余的问题,重新采用紧凑的 MPI 表示;其核心是用视觉基础模型预测点图初始化可学习多平面,并通过可微体渲染多视图优化,同时引入一步扩散参与蒸馏和后处理以修复孔洞伪影。实验称相较代表性 GS 方法渲染快 30.7%、模型仅为 14.8%,在前视场景保持有竞争力质量。

TIDES: Time-Derivative Event Simulation via Deformable Reconstruction Figure 1
2026-06-02cs.CV

TIDES: Time-Derivative Event Simulation via Deformable Reconstruction

Christopher Thirgood, Dipon Kumar Ghosh, Simon Hadfield

2026-06-02三维

针对事件相机仿真常由离散帧差分推断时间戳、在高速运动和遮挡下产生“时间戳批处理”的问题,TIDES基于动态4D Gaussian Splatting直接对渲染过程做时间导数计算,获得可见性一致的亮度及其变化率,并用遮挡风险自适应步进和tile级读出仲裁模拟带宽限制。文中在四个配对RGB-事件基准上报告事件流保真度达到SOTA,且合成事件在真实下游任务迁移上优于现有帧式模拟器。

Topological texture analysis of microscopy images of dynamic casein gelation and its relation to rheological properties Figure 1
2026-06-02cs.AI

Topological texture analysis of microscopy images of dynamic casein gelation and its relation to rheological properties

Zahra Tabatabaei, Diana Soto Aguilar, Jose C. Bonilla, Mathias P. Clausen, Jon Sporring

Department of Computer Science, University of Copenhagen, Denmark., Department of Green Technology, University of Southern Denmark, Denmark., Department of Food Science, University of Copenhagen, Denmark.

2026-06-02视觉感知

针对酪蛋白凝胶化微结构长期缺少可量化、可与流变性质对应的动态图像分析工具,本文将TDA、差分盒计数、多重分形和LBP结合用于STED时间序列。核心洞察是用Betti-1环结构刻画网络连通性,弱化强度漂移影响。结果显示拓扑曲线可识别聚集滞后、溶胶-凝胶转变及后期重排,并与储能模量变化相互印证。

Attention mechanisms and transfer learning for robust peach leaf damage classification under domain shift Figure 1
2026-06-02cs.CV

Attention mechanisms and transfer learning for robust peach leaf damage classification under domain shift

Adrián Cánovas-Rodriguez, Miguel A. González-Illán, Maria Fernanda García-Cruz, Pedro Nortes Tortosa, José Salvador Rubio-Asensio, Miguel A. Zamora Izquierdo, Juan Antonio Martínez Navarro, Antonio F. Skarmeta

synergy with scalable backbone families such as EfficientNetB5, where, aDepartment of Information and Communication Engineering, University of, bDepartment of Irrigation, Centro de Edafología y Biología Aplicada del Segura, through manual annotation of publicly available images, comprising 1,366

2026-06-02安全鲁棒

针对桃园中病虫害与非生物胁迫叶片症状相似、公开数据到真实田间存在域偏移的问题,论文构建1366张六类桃叶损伤基准,并比较多种CNN、CBAM注意力与迁移微调策略。结果显示CBAM增益强依赖骨干,EfficientNetB5+CBAM在基准上达93.3%准确率/93.6% F1;本地180图四类数据迁移后,EfficientNetB3+CBAM宏F1约93%、准确率94.6%,但部分提升可能也来自scaling与数据适配。

Normality-Preserving Continual Industrial Anomaly Detection via Orthogonal LoRA Banks Figure 1
2026-06-02cs.CV

Normality-Preserving Continual Industrial Anomaly Detection via Orthogonal LoRA Banks

Weibai Fang, Haijun Che, Feiyang Ren, Qiancheng Lao

2026-06-02视觉感知

面向产线中新品类持续加入时扩散式工业异常检测容易遗忘旧类正常先验的问题,论文将 LoRA 视为低秩正常性记忆,提出冻结历史 LoRA 并把新适配器约束到其正交补空间的 HF-OLB,同时用 HNABG 按层级新颖度选择性扩展容量。MVTec 与 VisA 连续设置中,VisA 2×6 达到 83.6/91.8 图像/像素 A-AUROC,像素级较 SOTA 提升 3.2 点且遗忘指标降低 1.3。

OpenWebRL: Demystifying Online Multi-turn Reinforcement Learning for Visual Web Agents Figure 1
2026-06-02cs.LG

OpenWebRL: Demystifying Online Multi-turn Reinforcement Learning for Visual Web Agents

Rui Yang, Qianhui Wu, Yuxi Chen, Hao Bai, Wenlin Yao, Hao Cheng, Baolin Peng, Huan Zhang, Tong Zhang, Jianfeng Gao

2026-06-02强化学习

论文针对开放视觉网页智能体依赖大量人工轨迹、难以适应动态真实网站的问题,提出 OpenWebRL:在真实网页上进行在线多轮强化学习,结合少量 SFT 热启动、并行浏览器 rollout、多模态上下文管理、轨迹级 VLM judge 与多轮 GRPO。其 4B 模型仅用 0.4K 初始化轨迹和 2.2K RL 任务,在 WebVoyager、Online-Mind2Web、DeepShop 达到 74.1%、67.0%、64.0%,超过多种开放基线并接近部分闭源系统。

Ranking vs. Assignment: The Metric Mismatch in Multi-View Object Association Figure 1
2026-06-02cs.CV

Ranking vs. Assignment: The Metric Mismatch in Multi-View Object Association

Matvei Shelukhan, Timur Mamedov, Aleksandr Chukhrov, Karina Kvanchiani

2026-06-02视觉感知

多视角目标关联最终要解一对一匹配,但许多论文用 AP、FPR-95 等成对排序指标评价,可能与真实任务目标不一致。本文的核心洞察是这种错配可被理论构造和 Sinkhorn 后处理“放大”:正确匹配时排序指标仍可能不完美,排序最优也可能匹配错误。实验中仅调少量后处理参数即可显著提升 AP/FPR-95,而 ACC、IPAA 基本不同步提升,提示应更重视分配级乃至全局一致性指标。

PerBite: A Curated Diagnostic Workflow for Bite-Aware Food Volume Estimation Figure 1
2026-06-02cs.CV

PerBite: A Curated Diagnostic Workflow for Bite-Aware Food Volume Estimation

Ahmad AlMughrabi, Farid Al-Areqi, David Fernández Gómez, Umair Haroon, Marc Bolaños, Ricardo Marques, Petia Radeva

2026-06-02生成模型

本文针对连续进食场景中“看起来合理”的食物网格未必能可靠估计摄入量的问题,提出 PerBite,将前后状态视为成对的度量体积推理:用 SAM 3 定位食物/盘子、Hunyuan3D/SAM 3D 生成网格,再以盘径定标、去除盘面并修补为 watertight 网格后积分。其核心洞察是表面重建、尺度、清理和消耗量差分需分开评估。方法在 MetaFood CVPR 2026 挑战中排名第一,34 个网格 Chamfer 为 8.31,17 对状态体积 MAPE 为 33.87%、无单调性违例,但消耗体积 MAPE 仍达 53.74%,且流程依赖已选帧和人工清理。

Distortion-Aware Fusion of Statistical and Vision-Language Features for Blind Image Quality Assessment Figure 1
2026-06-02cs.CV

Distortion-Aware Fusion of Statistical and Vision-Language Features for Blind Image Quality Assessment

Bishr Omer Abdelrahman Adam, Xu Li

2026-06-02视觉语言视觉感知

针对无参考图像质量评估中传统自然场景统计特征可解释但表达有限、视觉语言特征语义强却易忽略低层失真的问题,本文将138维NSS与冻结的SigLIP、CLIP-H嵌入融合,并用按输入自适应的乘性门控学习各流权重。结果在KADID-10k达SROCC 0.9715、PLCC 0.9733,在KonIQ-10k和LIVE-itW也保持竞争力;失真级分析显示NSS对噪声和色偏更关键,门控权重与该贡献趋势相关。

Towards 3D-Aware Video Diffusion Models: Render-Free Human Motion Control with Mesh Tokenization Figure 1
2026-06-02cs.CV

Towards 3D-Aware Video Diffusion Models: Render-Free Human Motion Control with Mesh Tokenization

Jingyun Liang, Min Wei, Shikai Li, Yizeng Han, Hangjie Yuan, Lei Sun, Weihua Chen, Fan Wang

DAMO Academy, Alibaba Group, Hupan Lab, Zhejiang University

2026-06-02视觉感知生成模型规划控制三维

本文以人体运动控制检验视频扩散模型是否真正具备三维理解,而非依赖2D投影捷径。核心做法是绕过渲染,将SMPL运动分解为轨迹与身体姿态网格,并用VQ-VAE压缩成3D mesh tokens,通过交叉注意力接入DiT视频生成器。实验显示其在人类运动控制、视角变化和运动编辑中更稳健,可减少浮脚、穿插等由2D引导和轨迹姿态不匹配带来的伪影。

A Structured Benchmark for Text-Guided Anomaly Detection: When Language Stops Conditioning the Decision Figure 1
2026-06-02cs.CV

A Structured Benchmark for Text-Guided Anomaly Detection: When Language Stops Conditioning the Decision

Stefano Samele, Eugenio Lomurno, Teodora Jovanovic, Sanjay Shivakumar Manohar, Alberto Crivellaro, Matteo Matteucci

Politecnico di Milano, AIRLab, Milan, Italy

2026-06-02视觉感知数据集/基准

这篇论文针对多模态工业异常检测“看似可由文本指导、实则标准评测未检验文本是否影响决策”的问题,提出 TGAD 基准:从提示敏感性、指定部件检测到真实装配面板 APD,逐步提高语言约束作用。实验覆盖三类代表模型,发现文本多只提供弱类别先验;去掉物体名、要求忽略非指定部件缺陷或同时指定缺陷类型与位置时,图像级 AUROC 明显下滑,APD 上甚至接近或低于随机,说明现有基准可能高估了语言可控性。

MT-EditFlow: Reinforcement Learning for Multi-Turn Image Editing with Flow Matching Figure 1
2026-06-02cs.CV

MT-EditFlow: Reinforcement Learning for Multi-Turn Image Editing with Flow Matching

Jiahui Huang, Yasi Zhang, Tianyu Chen, Shu Wang, Jianwen Xie, Oscar Leong, Mingyuan Zhou, Nanzhu Wang, Ying Nian Wu

2026-06-02视觉感知生成模型强化学习

针对单轮训练的图像编辑模型在多轮交互中易因“一步失败全局失败”和曝光偏差导致错误累积的问题,本文提出 MT-EditFlow,将流匹配生成模型的强化学习扩展到多轮编辑,并设计多奖励、跨轮聚合的优势广播机制,兼容 GRPO 与 NFT。实验显示其在多种基座上提升连续编辑稳定性,FLUX.1-Kontext-dev 第三轮总体性能提升 6.85 分并超过 Qwen-Image-Edit。

Generalization Limits in Vehicle Re-Identification Figure 1
2026-06-02cs.CV

Generalization Limits in Vehicle Re-Identification

Anis Yassine Ben Mabrouk (CB), Antoine Tadros (CB), Rafael Grompone von Gioi (CB), Gabriele Facciolo (CMLA, LIGM), Axel Davy (CB), Rodrigo Verschae

Universit´e Paris-Saclay, ENS Paris-Saclay, CNRS, Centre Borelli, limited available samples., was mainly used for predicting known class labels. However

2026-06-02学习理论

本文关注车辆重识别基准的泛化评估偏差:训练集与测试集中常出现同品牌、型号、颜色的高度相似车辆,使模型可能靠记忆而非真正细粒度判别取得高分。作者提出按车辆类型划分 seen/unseen 的新评测,并进一步区分同视角与跨视角检索。结果显示,在 VeRi776 与 VeRI-Wild 上,多数现有方法对已见类型可接近饱和,但面对未见车型时显著退化,视角鲁棒性与细节关注也主要局限于训练中出现过的类型。

A Closer Look at In-Distribution vs. Out-of-Distribution Accuracy for Open-Set Test-time Adaptation Figure 1
2026-06-02cs.LG

A Closer Look at In-Distribution vs. Out-of-Distribution Accuracy for Open-Set Test-time Adaptation

Zefeng Li, Evan Shelhamer

University of British Columbia and Vector Institute

2026-06-02视觉感知

针对开放集测试时自适应中只重视已知类精度、忽视未知类拒识的问题,本文系统评测 SAR、OSTTA、UniEnt、SoTTA 在 CIFAR-10-C/ImageNet-C 及多种 OOD 数据上的 InD/OOD 表现,并引入可变 OOD 比例与 sigmoid 输出基线。结果显示现有方法常以牺牲 OOD 准确率换取 InD 提升,OOD 过滤并不可靠,BN 对批内混合更敏感,GN 更稳定。

Contrastive Augmented Transformer with Domain-specific Enhancement for Robust Multi-scenario Metal Surface Defect Detection Figure 1
2026-06-02cs.CV

Contrastive Augmented Transformer with Domain-specific Enhancement for Robust Multi-scenario Metal Surface Defect Detection

Yiyao Liua, Wenxiao He, Liyuan Ren, Huan Wang

2026-06-02视觉感知安全鲁棒

针对金属表面缺陷样本稀缺、微小多尺度缺陷难分辨以及跨产线光照/噪声导致泛化差的问题,论文提出 CAT:以可训练 Swin Transformer 结合冻结 ResNet-50 形成双分支参考,并用改进 FPN、液滴式领域增强和带难负样本挖掘的多尺度对比损失提升判别性。在 KolektorSDD2 上像素 AUROC 达 99.54%,并在 KSDD1、MTD、RSDD 等未见数据上显示较好鲁棒性。

WALL-WM: Carving World Action Modeling at the Event Joints Figure 1
2026-06-02cs.RO

WALL-WM: Carving World Action Modeling at the Event Joints

Shalfun Li, Victor Yao, Charles Yang, Truth Qu, Regis Cheng, Ryan Yu, Howard Lu, Newton Von, Vincent Chen, Yohann Tang, Maeve Zhang, Ellie Ma, Gody Li, Sage Yang, Lorien Shu, J.W. Gao, Ethan Chen, Colin Ye, Yu Sun, Elise Mon, PS Zhang, Neo Li, Lily Li, James Wang, Ping Yang, Chris Pan, Lucy Liang, Hang Su, Roy Gan, Hao Wang, Qian Wang

2026-06-02强化学习

论文针对现有VLA/WAM用固定长度动作块训练导致语言、视觉与控制粒度错配、削弱长程泛化的问题,提出以可命名、可观察、可执行的语义事件作为视频-动作学习原子,结合事件级标注、聚类均衡采样和两种推理模式保留视频先验并支持变长执行。实验称在大规模真实机器人泛化评测中达到SOTA,但具体增益中有多少来自事件建模、数据规模或预训练基础设施,文中片段仍未充分说明。

Learning Action-Conditional and Object-Centric Gaussian Splatting World Models for Rigid Objects Figure 1
2026-06-02cs.RO

Learning Action-Conditional and Object-Centric Gaussian Splatting World Models for Rigid Objects

Jens U. Kreber, Lukas Mack, Joerg Stueckler

University of Augsburg

2026-06-02强化学习三维

针对多物体桌面场景中形状多样、遮挡和接触传播使机器人难以预判动作后果的问题,论文提出 MRO-GWM:用物体中心的 Gaussian/anchor 表示刚体形状,并以时空 Transformer 在历史物体与末端执行器位姿及未来动作条件下预测多步刚体运动。实验在合成家居物体场景中比较变体与消融,并将模型用于 MPC,能在仿真中完成两类非抓取操作;但仍依赖已知分割与物体位姿。

Parameter-Efficient Fine-Tuning of Large Pretrained Models for Instance Segmentation Tasks Figure 1
2026-06-02cs.CV

Parameter-Efficient Fine-Tuning of Large Pretrained Models for Instance Segmentation Tasks

Nermeen Abou Baker, David Rohrschneider, Uwe Handmann

2026-06-02视觉感知

本文针对大规模预训练分割模型全量微调成本高、易过拟合且在实例分割中PEFT研究不足的问题,系统考察Adapter与LoRA在SEEM、Mask DINO等模型上的适配。核心创新是将LoRA用于多尺度可变形注意力,并设计顺序堆叠Adapter。实验显示仅训练约1–6%参数即可接近传统40–55%参数微调的性能,2–3个Adapter较均衡,LoRA在部分场景还能优于Adapter。

Beyond Low-Rank: Low-Rank Sparse Prompting via Spiking Neural Network and Prompt Factorization Figure 1
2026-06-02cs.CV

Beyond Low-Rank: Low-Rank Sparse Prompting via Spiking Neural Network and Prompt Factorization

Yumiao Zhao, Bo Jiang, Beibei Wang, Xixi Wan, Xiao Wang, Jin Tang

Sensing Laboratory of Anhui Province, Anhui Provincial Key Laboratory of, Multimodal Cognitive Computation, School of Computer Science and Technology, Anhui University

2026-06-02视觉感知

本文针对视觉提示中密集像素扰动冗余、泛化受限和能耗偏高的问题,提出 LoRSP:先用低秩分解构造多个提示因子,再借助脉冲神经网络的积分-发放机制生成面向单样本的稀疏像素提示,在保持低秩约束的同时自适应选择提示位置与强度。实验覆盖五类视觉骨干和多个基准,显示其以更少可调参数取得与现有 VP 方法相当或更好的性能。

SCAPO: Self-Supervised Category-Level Articulated Pose Estimation from a Single 3D Observation Figure 1
2026-06-02cs.CV

SCAPO: Self-Supervised Category-Level Articulated Pose Estimation from a Single 3D Observation

Can Zhang, Gim Hee Lee

Department of Computer Science, National University of Singapore

2026-06-02三维

面向机器人在单帧 RGB-D 中理解门、抽屉等未知铰接物体,SCAPO试图摆脱部件/关节标注、多帧运动和CAD模板依赖。其核心是用 SE(3) 等变自编码器建立类别规范空间,再以关节感知 blend-skinning、可学习规范模板和残差形状解耦几何与关节运动,直接估计部件分割、枢轴、轴向和状态。合成与真实数据实验显示其在分割和关节参数上优于自监督基线,消融表明形状方差与关节正则对稳定性关键。

SAVMap: Structure-Aided Visual Mapping of Large-Scale 2.5D Manhattan Wireframes from Panoramic Video Figure 1
2026-06-02cs.CV

SAVMap: Structure-Aided Visual Mapping of Large-Scale 2.5D Manhattan Wireframes from Panoramic Video

Howard Huang, Bharath Surianarayanan, Keifer Lee, Chenyu Wang, Chen Feng

2026-06-02视觉感知

面向仓库/工厂中机器人定位与数字孪生对低成本语义3D地图的需求,SAVMap不追求稠密点云,而是从全景视频渲染货架和天花板视图,用轻量分割提取货架角点、灯具中心等语义结构点,并在SfM中加入曼哈顿网格等几何约束,生成2.5D语义线框。实仓46排、约1小时视频实验中,重建5000余个货架元素,相对真值平均绝对误差4.8厘米。

Unified Driving Tokens: Representation- and Geometry-Guided Discrete Tokenizer for Driving World Models and Planning Figure 1
2026-06-02cs.CV

Unified Driving Tokens: Representation- and Geometry-Guided Discrete Tokenizer for Driving World Models and Planning

Ziyang Yao, Zeyu Zhu, YunCheng Jiang, Zibin Guo, Huijing Zhao

2026-06-02强化学习规划控制

这篇论文针对自动驾驶离散视觉 token 仍偏向像素重建、与规划可用性脱节的问题,提出以 VQ-VAE 为基础的统一驾驶 tokenizer:用冻结 DINO 特征引导语义表示,结合 RGB 重建、细节分支、相邻帧深度与相对位姿监督,并用多码本缓解量化瓶颈。NAVSIM 实验显示,其 token 在重建保真度和 DINO 一致性上更好,在固定轻量规划器下规划表现有竞争力,并提升自回归世界模型的生成质量。

3rd Place at CVPR 2026 CASTLE Challenge: Agentic Multi-View Long-Context Video Understanding via Hierarchical Knowledge Graph Retrieval Figure 1
2026-06-02cs.CV

3rd Place at CVPR 2026 CASTLE Challenge: Agentic Multi-View Long-Context Video Understanding via Hierarchical Knowledge Graph Retrieval

Raghad Albusayes, Munirah Alyahya

2026-06-02视觉感知

针对 CASTLE 中 600 小时多视角音视频带来的长上下文检索与时空/语义推理难题,论文提出免训练的 agentic 框架:先把 30 秒片段抽取为音视觉描述并构建含实体、时间关系和“提及”关系的视频知识图谱,再由规划、图检索、片段复核与 VQA 代理分层求解。方法在挑战中获第三名,准确率 55%,较基线 43% 提升 12 个百分点;消融显示适量 KG 检索和保留 Mention 关系较关键。

Pool-Select-Refine: Allocation-Aware Generative Dataset Distillation with Soft-Label-Guided Latent Refinement Figure 1
2026-06-02cs.CV

Pool-Select-Refine: Allocation-Aware Generative Dataset Distillation with Soft-Label-Guided Latent Refinement

Wenmin Li, Shunsuke Sakai, Zhongkai Zhao, Tatsuhito Hasegawa

with Soft-Label-Guided Latent Refinement, aGraduate School of Engineering, University of Fukui, 3-9-1 Bunkyo, Fukui, 910-8507, Fukui, Japan, bCollege of Computer Science and Artificial Intelligence, Southwest Minzu University, No.168, Wenxing Section, Dajian Road, Konggang Development, Soft Labels, budget. Second, we refine the selected samples in latent space using soft-label supervision derived, teacher-derived soft-label supervision while preserving the, more controllable and better aligned with the goal of dataset

2026-06-02生成模型数据集/基准

论文针对扩散式数据集蒸馏中“生成即使用”把随机样本直接占满固定 IPC 预算、易造成冗余和低信息量样本的问题,提出 Pool-Select-Refine:先生成过完备候选池,再按教师模型给出的语义可靠性、特征多样性和不确定性筛选,随后用软标签指导潜空间细化。实验显示其在 ImageNet 子集和细粒度分类基准上相对扩散基线有稳定提升,低预算场景收益更明显。

Mechanistic Diagnostics of Spatial Lexical Bias in Multimodal Large Language Model Spatial Reasoning Figure 1
2026-06-02cs.CL

Mechanistic Diagnostics of Spatial Lexical Bias in Multimodal Large Language Model Spatial Reasoning

Chuang Ma, Qianying Liu, Tomoyuki Obuchi, Fei Cheng, Wang Yang, Sudong Cai, Shuyuan Zheng, Akiko Aizawa, Sadao Kurohashi

Kyoto University, Case Western Reserve University, The Hong Kong Polytechnic University, The University of Osaka, University of Tokyo

2026-06-02视觉语言

本文针对多模态大模型在空间选择题中“看得见却答错”的问题,指出错误不只来自视觉 grounding,而是加入 left/right/front/behind 等空间词后触发语言侧词汇偏置。作者用 BSTF 案例、注意力/残差探针、activation patching 和稀疏干预定位到 LLM 侧通道与神经元;仅用小规模合成偏好数据做 LLM-only DPO,即在合成四选任务最高提升 100 点,并迁移提升 WhatsUp、SpatialMQA-Direct、VSR。

Residual Decoder Adapter: ID-Preserving Tokenizer Adaption for Autoregressive Text Rendering Figure 1
2026-06-02cs.CV

Residual Decoder Adapter: ID-Preserving Tokenizer Adaption for Autoregressive Text Rendering

Dongxing Mao, Jinpeng Wang, Jiahao Tang, Kevin Qinghong Lin, Linjie Li, Zhengyuan Yang, Lijuan Wang, Min Li, Jingru Tan

Central South University, University of Oxford

2026-06-02视觉感知

这篇论文关注自回归图像生成中文字渲染模糊、字形破坏的问题,指出瓶颈主要在离散视觉 tokenizer 的细节重建能力,而重训 tokenizer 会破坏原有 token ID 并迫使 AR 模型重训。作者提出 RDA,在冻结原 tokenizer 和 AR 模型的前提下,用共享 ID 的 Hint Codebook 与像素残差解码分支后处理重建结果。实验显示其在 Janus-Pro、TAR、Lumina-mGPT 等模型上提升文本可读性,如 Janus-Pro 在 TextVisionBlend OCR 准确率由 24.52% 提至 58.26%。

Single-Line Drawing Generation via Semantics-Driven Optimization Figure 1
2026-06-02cs.GR

Single-Line Drawing Generation via Semantics-Driven Optimization

Tanguy Magne, Alexandre Binninger, Ruben Wiersma, Olga Sorkine-Hornung

as embroidery, laser engraving and wire bending. Our code and results are available at https://github.com/tanguymagne/SLDgen., Association for Computer Graphics and John Wiley & Sons Ltd., fusion models with the controllability of classic parameterizations., Computer Graphics Forum published by Eurographics and John Wiley & Sons Ltd.

2026-06-02优化算法

本文针对扩散模型虽能生成“像单线画”的图像、却难以严格保证一笔连续且不利于制造的问题,提出直接优化单条 URBS 曲线的语义驱动框架,用 SDS、可微光栅化、LoRA 风格适配和正则项共同约束语义、简洁度与线条风格。实验显示其在文本/图像条件下相较文生图和现有草图优化管线更符合单线画美学,并输出可用于刺绣、激光雕刻等的矢量结果。

Private and Stable Test-Time Adaptation with Differential Privacy Figure 1
2026-06-02cs.LG

Private and Stable Test-Time Adaptation with Differential Privacy

Zefeng Li, Qiaoyue Tang, Mathias Lecuyer, Evan Shelhamer

2026-06-02视觉感知

本文关注测试时自适应在部署中会把未标注测试样本写入模型更新、从而泄露隐私的问题。作者将 Tent、EATA、SAR、DeYO、COME 等 TTA 方法改造成差分隐私版本,引入逐样本梯度裁剪、加高斯噪声及相应隐私会计,并处理选择性更新和流式评估。ImageNet-C 结果显示,DP-TTA 以较小精度代价提供隐私保证;低隐私或无隐私噪声下,逐样本裁剪还可提升连续适应的准确率与稳定性,开销适中。

The Image Reconstruction Game: Drawing Common Ground Through Iterative Multimodal Dialogue Figure 1
2026-06-02cs.CV

The Image Reconstruction Game: Drawing Common Ground Through Iterative Multimodal Dialogue

Sherzod Hakimov, Mattia D'Agostini, Ivan Samodelkin, David Schlangen

Computational Linguistics, Department of Linguistics, University of Potsdam, Germany, German Research Center for Artificial Intelligence (DFKI), Berlin, Germany

2026-06-02视觉语言视觉感知三维

针对现有视觉语言评测多停留在静态 caption/VQA、难以考察多轮纠错中“共同基础”形成的问题,本文提出全自动 Image Reconstruction Game:VLM 描述者仅用自然语言迭代指导图像生成器重建目标图。实验显示,重建质量主要由描述者决定,生成器影响迭代是增益还是退化;数学与几何图最难,token 预算会改变收敛形态,而自动评审与人类偏好一致性仍较弱,需人工校准。

Auteur: Language-Driven Cinematographic Framing for Human-Centric Video Generation Figure 1
2026-06-02cs.CV

Auteur: Language-Driven Cinematographic Framing for Human-Centric Video Generation

Muhammed Burak Kizil, Enes Sanli, Niloy J. Mitra, Xuelin Chen, Erkut Erdem, Aykut Erdem, Duygu Ceylan

Koç University, University College London, Adobe, Hacettepe University

2026-06-02视觉感知

现有视频生成的相机控制多依赖世界坐标轨迹,难以随人物动作保持有叙事意义的构图。Auteur 的核心洞察是把镜头表示为相对演员的景别、角度与画面位置,并用可转为 6-DoF 的 DSL 由微调多模态 LLM 生成关键帧,再插值成连续机位。论文构建 34K 文本-人体运动-相机数据,并在新构图指标上优于既有可控相机方法。

Train, Test, Re-evaluate: Schedule-Sensitive Evaluation of Generative Data for Hand Detection Figure 1
2026-06-02cs.CV

Train, Test, Re-evaluate: Schedule-Sensitive Evaluation of Generative Data for Hand Detection

Atmika Bhardwaj, Silvia Vock, Nico Steckhan

2026-06-02视觉感知生成模型数据集/基准

面向工业安全中的手部检测,论文关注公开数据多为裸手、难覆盖手套/饰品等部署外观偏移的问题。作者用生成式局部修补只改真实图像的手部区域,构造成对合成数据,并系统比较不同训练日程而非只看图像逼真度。结果显示,合成数据是否有用强依赖训练流程:先用真实+合成训练再低学习率真实微调可提升真实测试 mAP@0.5 并缩小手套子集差距,三阶段课程则在更严格 mAP@0.5:0.95 上最好。

Collaborative Space Object Detection with Multi-Satellite Viewpoints in LEO Constellations Figure 1
2026-06-02cs.CV

Collaborative Space Object Detection with Multi-Satellite Viewpoints in LEO Constellations

Xingyu Qu, Wenxuan Zhang, Peng Hu

2026-06-02视觉感知

面向低轨星座日益拥挤带来的空间目标快速、低功耗检测需求,论文把多颗卫星的不同视角以早期融合方式组织成 YOLO 可直接处理的输入,避免复杂多分支结构。实验显示多视角在 RGB 和灰度下通常提升 mAP 与定位质量,如 YOLOv9-m 三视角 RGB 的 mAP50 从 0.638 升至 0.732,最佳三视角灰度 mAP50-95 提升 46.5%。

Adversarial Attacks on Robot Localization Systems via Deep Feature Perturbation Figure 1
2026-06-02cs.CV

Adversarial Attacks on Robot Localization Systems via Deep Feature Perturbation

Zhenyu Li, Tianyi Shang

2026-06-02机器人

论文关注机器人视觉定位中基于产品量化(PQ)的检索管线易被对抗扰动误导的问题。作者提出轻量级 LPQN,直接扰动查询特征的质心分配概率,并用前向扰动与反向优化两阶段绕过量化不可微性。实验称在受控和真实机器人环境中可显著降低 PQN 定位性能,暴露部署安全风险,但具体数值增益在给定片段中未充分说明。

Divide and Conquer: Reliable Multi-View Evidential Learning for Deepfake Detection Figure 1
2026-06-02cs.CV

Divide and Conquer: Reliable Multi-View Evidential Learning for Deepfake Detection

Xiaolu Kang, Zhongyuan Wang, Jikang Cheng, Baojin Huang, Zhanhe Lei, Gang Wu, Qin Zou, Qian Wang

2026-06-02视觉感知

本文针对深伪检测在未知伪造与跨域场景中易被强语义特征掩盖细微伪造痕迹、产生过度自信的问题,提出 DiCoME:用几何正交投影将伪造痕迹视为语义空间的补空间,构建语义视图与 artifact 视图,再以证据学习和 Dempster-Shafer 融合建模视图冲突与不确定性。多基准实验显示其泛化性能优于现有方法,并能给出更可靠的不确定性估计。

Beyond the Simplex: Balanced Prototype Geometry for Scorer-Agnostic Open-Set Recognition Figure 1
2026-06-02cs.LG

Beyond the Simplex: Balanced Prototype Geometry for Scorer-Agnostic Open-Set Recognition

Mayank Sharma, Rohit Kumar Mourya

Indian Institute of Technology Jodhpur

2026-06-02视觉感知

面向医疗和机器人视觉中需拒识未知类别的安全需求,本文补上 simplex-ratio 开集识别在低维嵌入下的理论缺口。核心是用等范数零和的 balanced codes 替代只在 d≥C−1 存在的正单纯形,证明接受域可由欧氏球并刻画、U 分数 Lipschitz 且紧,并给出缺陷参数和指数型 FAR 界。实验显示该几何有助于表征先验,但原始 ratio 分数常弱于 KNN 或 logit 类后处理,性能仍强依赖 scoring rule。

Deep Learning for Generating Computational PIN-4 Immunohistochemistry Staining from Prostate Biopsy H&E Images Figure 1
2026-06-02cs.CV

Deep Learning for Generating Computational PIN-4 Immunohistochemistry Staining from Prostate Biopsy H&E Images

Vietbao Tran, Pratik Shah

University of California, Irvine, Pathology and Laboratory Medicine, biopsy and resection WSIs collected at the University of, California, Irvine Medical Center (UCI Health) in Orange, excluding unavailable or unpaired images and applying prepro-

2026-06-02视觉感知

针对前列腺活检中 PIN-4 免疫组化需在相邻切片完成、难与触发检查的 H&E 形态逐细胞对齐的问题,论文构建配准的临床 H&E/PIN-4 WSI 数据集,并用监督式 cGAN 从常规明场 H&E 直接合成 PIN-4 染色。最终含 93 名患者、172 对 WSI、27298 个配准 patch;独立测试集上 PSNR 21.88 dB、SSIM 0.667、PCC 0.684,病理医师认为可捕捉 AMACR 与基底细胞相关信号,但复杂高级别癌区域质量仍不稳定。

Polaris: Scaling Up Instruction-Guided Image Generation Towards Millions of Personalized Style Needs Figure 1
2026-06-02cs.CV

Polaris: Scaling Up Instruction-Guided Image Generation Towards Millions of Personalized Style Needs

Zhi-Kai Chen, Jun-Peng Jiang, Jun-Jie Tao, De-Chuan Zhan, Han-Jia Ye

2026-06-02视觉感知

针对单一图像生成模型难覆盖长尾个性化风格、逐需求微调又成本高的问题,Polaris 将社区已有 Stable Diffusion 检查点与 LoRA 适配器视为可检索模型库,通过文本/图像联合查询、指令解析与重排序,在 6500 余个 checkpoint 和 7.5 万个 adapter 中选择并组合合适组件。文中称该方法无需额外训练即可实现风格感知的生成与编辑,并在交互延迟下提升多样化需求的对齐和质量,但具体增益可能主要来自大规模模型库覆盖。

RescueBench: Can Embodied Agents Save Lives in the Wild ? Figure 1
2026-06-02cs.CV

RescueBench: Can Embodied Agents Save Lives in the Wild ?

Kui Wu, Beiyu Guo, Hao Chen, ShuHang Xu, Yuling Li, Yongdan Zeng, Zhoujun Li, Yizhou Wang, Fangwei Zhong

Beihang University 2 Beijing Normal University 3 Peking University, City University of Macau 5 ATEC2025 Challenge Committee

2026-06-02视觉感知

面向真实搜救中开放探索、连续交互与长程空间记忆相互耦合而现有基准多孤立评测的问题,RescueBench构建了照片级四阶段搜救流程,并用五级难度和阶段级指标诊断级联失败。对七类基线、oracle和人类的评测显示,最高难度下无基线完成全任务,主要瓶颈是自主探索,空间记忆也是独立短板,现有拓扑VLN和地图方法仍难覆盖。

Suppressing Forgery-Specific Shortcuts for Generalizable Deepfake Detection Figure 1
2026-06-02cs.CV

Suppressing Forgery-Specific Shortcuts for Generalizable Deepfake Detection

Yihui Wang, Yonghui Yang, Jilong Liu, Fengbin Zhu, Le Wu, Tat-Seng Chua

Hefei University of Technology, National University of Singapore, Hefei University of Technology China, National University of Singapore Singapore

2026-06-02视觉感知

本文针对 Deepfake 检测跨伪造方法泛化差的问题,指出模型常依赖特定伪造算法的纹理/伪影捷径。核心洞察是用伪造方法分类线性探针与 SVD 显式提取“方法敏感子空间”,并在训练中抑制该子空间梯度、推理时削弱相关神经元激活。多基准实验显示 S3 能提升未知伪造方法上的检测性能,同时基本保持域内表现。

Physics-Guided Attention in a Lightweight TCN for Efficient WiFi CSI-Based Human Activity Recognition Figure 1
2026-06-02cs.CV

Physics-Guided Attention in a Lightweight TCN for Efficient WiFi CSI-Based Human Activity Recognition

Chinthaka Ranasingha, Tharindu Fernando, Sridha Sridharan, Clinton Fookes, Harshala Gammulle

and Vision Technologies (SAIVT) Research Group, School of Electrical, Engineering and Robotics, Queensland University of Technology (QUT)

2026-06-02视觉感知

这篇论文针对 WiFi CSI 人体活动识别中过度依赖深层模型、难以在边缘设备实时部署的问题,提出在轻量 TCN 中显式注入物理先验:用多普勒能量引导时间注意力突出运动片段,并用时序方差驱动通道注意力选择敏感子载波。实验显示其在多个基准上优于更深、更重的基线,同时显著降低参数量和 FLOPs。

ROGLE: Robust Global-Local Alignment with Automated Region Supervision for Text-Based Person Search Figure 1
2026-06-02cs.CV

ROGLE: Robust Global-Local Alignment with Automated Region Supervision for Text-Based Person Search

Zequn Xie, Xibei Jia, Sihang Cai, Shulei Wang, Tao Jin

Zhejiang University

2026-06-02视觉感知安全鲁棒

该文针对文本行人搜索中 CLIP 类模型偏向全局语义、难以利用服饰/发型等局部细节的问题,提出 ROGLE:用 SAM 分割与 CLIP 相似度自动挖掘区域—句子伪配对,并结合全局对比学习、局部对齐和可靠性校准。作者还构建含长描述和 10 万级区域标注的 P-VLG,实验显示在长文本、组合查询上优于现有方法,但增益可能部分来自数据扩充。

Hierarchically Decoupled Mixture-of-Experts for Robust Traffic Sign Recognition in Complex Driving Scenarios Figure 1
2026-06-02cs.CV

Hierarchically Decoupled Mixture-of-Experts for Robust Traffic Sign Recognition in Complex Driving Scenarios

Mingxiao Wang, Xiaozhen Qu, Bolin Gao, Tong Wang, Lei He

2026-06-02视觉感知安全鲁棒

针对交通标志检测中静态 YOLO 难以同时适应近距清晰样本、远距离小目标和恶劣天气的问题,论文提出 CBDES MoE TSR:用轻量门控按图像语义进行 Top-1 路由,在异构 YOLO 专家池中动态选择模型,将难度评估与特征提取解耦。其在复合数据集上 mAP50-95 达 76.8%,较 YOLOv9c 提升 2.3%,计算开销降低约 39.4%。

Hist2Style: Histogram-Guided Stylization with Bilateral Grids Figure 1
2026-06-02cs.CV

Hist2Style: Histogram-Guided Stylization with Bilateral Grids

Dekel Galor, Adam Pikielny, Zhoutong Zhang, Ke Wang, Laura Waller, Jiawen Chen, Ilya Chugunov

University of California, Berkeley

2026-06-02视觉感知

针对大图像编辑模型在照片级调色中计算重、易幻觉且难精细控制的问题,Hist2Style将其能力选择性蒸馏到轻量网络,用目标图像颜色直方图作为可编辑风格条件,并以双边网格中的局部仿射变换限制输出,从结构上保留边缘与内容。方法支持高分辨率实时色调迁移和交互式直方图控制;文中还提出与人类偏好相关的风格化质量指标,但具体相对增益在片段中未充分说明。

Unsupervised Collaborative Domain Adaptation for Driving Scene Parsing Figure 1
2026-06-02cs.CV

Unsupervised Collaborative Domain Adaptation for Driving Scene Parsing

Jiahe Fan, Shaolong Shu, Mingjian Sun, Tiehua Zhang, Bohong Xiao, Hanli Wang, Rui Fan

2026-06-02视觉感知

面向自动驾驶场景解析,论文针对新域无标注、源数据因隐私/产权不可用且单一源模型易带偏的问题,提出源自由的 UCDA:用类级原型记忆库以原型相似度统一评估多源模型预测可靠性,再通过正负一致性协同细化源模型,并蒸馏为单一目标模型。实验覆盖公开驾驶数据和真实车载数据,显示其能整合多源互补知识,提升目标域分割可靠性与跨环境泛化。

Personalized 3D Myocardial Infarct Geometry Reconstruction from Cine MRI for Cardiac Digital Twins Figure 1
2026-06-02cs.CV

Personalized 3D Myocardial Infarct Geometry Reconstruction from Cine MRI for Cardiac Digital Twins

Yilin Lyu, Mark YY Chan, Ching-Hui Sia, Lei Li

Department of Biomedical Engineering, National University of Singapore, Singapore, Department of Medicine, National University of Singapore, Singapore, Department of Cardiology, National University Heart Centre Singapore, Singapore

2026-06-02三维

为避免LGE MRI造影剂限制与稀疏切片插值带来的心梗瘢痕建模误差,论文提出GeoMo-Net,从常规多视角cine MRI构建4D双心室网格,解耦并融合几何与运动特征,并用AHA-17分段先验做多尺度监督,直接重建可用于心脏数字孪生仿真的3D梗死区域。在225例扫描上Dice为0.678±0.011,电生理仿真与LGE真值较一致,但透壁性和跨域鲁棒性仍未充分解决。

STaR-KV: Spatio-Temporal Adaptive Re-weighting for KV Cache Compression in GUI Vision-Language Models Figure 1
2026-06-02cs.CV

STaR-KV: Spatio-Temporal Adaptive Re-weighting for KV Cache Compression in GUI Vision-Language Models

Yuhang Han, Wenzheng Yang, Yujie Chen, Xiangqi Jin, Yaojie Zhang, Siteng Huang, Linfeng Zhang

EPIC Lab, SJTU, The University of Sydney

2026-06-02视觉语言视觉感知

该文面向GUI视觉语言智能体多轮截图导致KV cache线性膨胀、显存难以部署的问题,指出既有方法把视觉重要性压成统一显著图且固定top-B截断,忽略注意力子空间的空间专化与轨迹中的分布漂移。STaR-KV无需训练,通过在线空间互信息做子空间评分、用时间稳定性折扣压制持久UI冗余,并以熵自适应调温选择缓存。在四个GUI基准上,其在同等预算下优于GUIKV、SnapKV等,20%缓存预算时峰值显存约降40%,压缩阶段几乎无额外FLOPs。

PlatonicNav: Unveiling Semantic Correspondence in Navigation with Platonic Topological Maps Figure 1
2026-06-02cs.CV

PlatonicNav: Unveiling Semantic Correspondence in Navigation with Platonic Topological Maps

Junlin Long, Zeyu Zhang, Xu Deng, Yiran Wang, Yue Yang, Luke Borgnolo, Maxwell Twelftree, Yang Zhao

2026-06-02机器人

论文针对 VLN 与 ObjNav 仍依赖架构融合、混合训练或 CLIP/VLM 跨模态监督的问题,提出将二者视为同一对象语义流形上的不同接口。PlatonicNav 用自监督视觉编码器构建融合几何与语义距离的拓扑图,并通过盲匹配把语言目标对齐到纯视觉地图,无需成对图文数据。实验覆盖 HM3D-IIN、OVON、R2R-CE 及 Unitree Go2 实机,显示其可在任务、模态和载体间泛化。

PillarDETR: YOLO-Backbone and RT-DETR Head for Real-Time 3D Object Detection Figure 1
2026-06-02cs.CV

PillarDETR: YOLO-Backbone and RT-DETR Head for Real-Time 3D Object Detection

Smit Kadvani, Shriya Gumber, Kriti Faujdar, Harsh Dave

2026-06-02视觉感知三维

面向自动驾驶与机器人中 LiDAR 3D 检测的实时性瓶颈,PillarDETR沿用 PointPillars 的柱状编码生成 BEV 伪图像,但将后端替换为 YOLOv8 风格 CSP 骨干与适配 3D 框回归的 RT-DETR 解码头,以减少锚框和 NMS 依赖并建模全局关系。实验称其在 KITTI moderate mAP 从 62.78% 提升到 66.57%,nuScenes mAP 达 46.8%,A100 上 41.2 FPS;但增益可能部分来自更大模型容量。

EvoCut: Multi-Layer Evolution-Aware Visual Token Compression for Efficient Large Vision-Language Models Figure 1
2026-06-02cs.CV

EvoCut: Multi-Layer Evolution-Aware Visual Token Compression for Efficient Large Vision-Language Models

Hongyu Lu, Feng Zhang, Wenwei Jin, Huanling Hu, Pengfei Zhang, Yao Hu, Jiawei Li, Shikai Jiang

Harbin Institute of Technology, Fudan University

2026-06-02视觉语言视觉感知

面向高分辨率图像和视频中视觉 token 过多导致 LVLM 推理慢、显存高的问题,EvoCut 不再依赖注意力或单层特征,而是利用视觉编码器跨层演化:信息 token 往往持续偏离群体演化方向。据此进行免训练、无注意力的多层重要性评分与裁剪。在 LLaVA-1.5-7B 上仅保留 64 个视觉 token(约 11.1%)仍保持 94.4% 平均性能,并获得约 1.44× 总时延加速。

Quality-Guided Semi-Supervised Learning for Medical Image Segmentation Figure 1
2026-06-02cs.CV

Quality-Guided Semi-Supervised Learning for Medical Image Segmentation

Kumar Abhishek, Ghassan Hamarneh

2026-06-02视觉感知

医学分割的半监督学习常用模型置信度筛伪标签,但置信度自指且难反映真实分割质量。本文训练独立质量预测器,从图像-掩码对估计 Dice,并用合成扰动与弱模型输出覆盖真实错误,再作为质量正则和伪标签重加权模块插入现有 SSL。五个皮肤/肠镜数据集、多架构和多种 SSL 范式实验显示其稳定提升,质量预测也与真实 Dice 高相关。

Sensitivity as a Double-Edged Sword: A Trade-off Between Discriminability and Adversarial Robustness Figure 1
2026-06-02cs.CV

Sensitivity as a Double-Edged Sword: A Trade-off Between Discriminability and Adversarial Robustness

Kai Wang

2026-06-02安全鲁棒

论文从分类头视角解释对抗脆弱性:FC 分类器对特征扰动更敏感,带来判别力也放大攻击,而 ℓ2 距离分类器更稳但精度受限。作者提出 HPM 重分类器,用 EMA 全局原型与由 FC 预测生成的批原型融合,再以 ℓ2 距离决策,并设计 MSA 避免梯度遮蔽误评。在 CIFAR-10/100 与 ImageNet 上,该插件经少量分类头微调可提升已有对抗训练模型鲁棒性。

FlatVPR: Plug-and-play Geo-linear Residual Adapter for Geometric Rectification of Foundation Model Feature Manifolds Figure 1
2026-06-02cs.CV

FlatVPR: Plug-and-play Geo-linear Residual Adapter for Geometric Rectification of Foundation Model Feature Manifolds

Rai Hisada, Kanji Tanaka

2026-06-02视觉感知

面向机器人长期视觉地点识别,FlatVPR试图缓解大规模地图中密集存储特征与定位精度的矛盾:它在DINOv2等基础模型特征上加入即插即用残差适配器,并用Pullback Flatness Loss压平特征流形,使稀疏锚点间可线性插值重构。在NCLT跨季节、100m稀疏锚点实验中,平均MRR由0.697提升到0.872;但EM中的锚点选择部分更偏概念化,实际增益归因仍需更多消融支撑。

Improving Visual Token Reduction via Rectifying Distortions for Efficient Multimodal LLM Inference Figure 1
2026-06-02cs.CV

Improving Visual Token Reduction via Rectifying Distortions for Efficient Multimodal LLM Inference

Hyeonwoo Cho, DongHyeon Baek, Yewon Kim, Bumsub Ham

2026-06-02视觉语言

为降低多模态大模型中大量视觉 token 带来的显存与时延开销,本文指出现有视觉 token 削减会破坏原序列的位置关系并削弱视觉注意力,导致视觉 grounding 变差。RESTORE 保留原位置索引,并按相对距离校准注意力,同时用兼顾代表性与区分性的锚点选择改进 token 合并。多基准实验显示,该方法可稳定提升多种 VTR 策略精度,在保持推理效率的同时达到更好的平均表现。

Density-Aware Translation of Spurious Correlations in Zero-Shot VLMs Figure 1
2026-06-02cs.CV

Density-Aware Translation of Spurious Correlations in Zero-Shot VLMs

Afsaneh Hasanebrahimi, Hanxun Huang, Christopher Leckie, Sarah Erfani

School of Computing and Information Systems, The Uni-, rely on bias-aware objectives but require labelled supervi-, sampling to capture variations across both labels and spu-, no access to spurious attribute labels at test time., augmenting text prompts with hierarchical label information, ture. In TIE, it is assumed that the spurious labels of the, test images are available. To relax this assumption, TIE*, labels.

2026-06-02视觉语言

本文针对零样本 CLIP/VLM 容易把背景、医院标记等高频上下文当作类别依据的问题,指出其根源与嵌入空间的各向异性和局部密度不均有关。方法 DAT 用小规模均衡参考集估计组级相对密度,并据此重标定图文相似度,无需微调、提示改写或测试时伪属性标签。理论上用 Kent 分布解释其接近贝叶斯判别;实验显示在多个虚假相关基准和 VLM 上提升最差组与平均准确率。

JenBridge: Adaptive Long-Form Video Soundtracking across Scene Transitions Figure 1
2026-06-02cs.SD

JenBridge: Adaptive Long-Form Video Soundtracking across Scene Transitions

Jiashuo Yu, Yao Yao, Boyu Chen, Alex Wang

2026-06-02视觉感知

针对现有视频配乐模型多面向短片、难以在多场景长视频中保持叙事连续的问题,JenBridge将长视频切分为语义片段,用基于MMDiT与flow matching的文本-视觉双条件模型生成分段音乐,并由LLM代理在多种转场工具中选择衔接方式。论文还提出LVS长视频配乐基准,实验显示其在音乐质量、视听对齐、转场自然度和整体连贯性上优于既有方法。

Spatio-Temporal Correlation Guided Geometric Partitioning for Versatile Video Coding Figure 1
2026-06-02cs.CV

Spatio-Temporal Correlation Guided Geometric Partitioning for Versatile Video Coding

Xuewei Meng, Chuanmin Jia, Xinfeng Zhang, Shanshe Wang, Siwei Ma

2026-06-02视觉感知

本文针对 VVC 几何划分虽能刻画运动边界、但需传输划分模式和两路运动候选索引导致开销偏高的问题,提出 STGEO:利用相邻块边缘与历史划分模式预测高概率几何模式,并按离线统计的候选选择概率自适应组织 merge 列表,使常用模式/运动信息用更少比特表示。实验显示,相比不含 GEO 的 VTM-8.0,在 RA 与 LDB 配置下平均码率分别降低 0.95% 和 1.98%。

MixerSENet: A Lightweight Framework for Efficient Hyperspectral Image Classification Figure 1
2026-06-02cs.CV

MixerSENet: A Lightweight Framework for Efficient Hyperspectral Image Classification

Mohammed Q. Alkhatib, Swalpa Kumar Roy, Ali Jamali

2026-06-02视觉感知

针对高光谱分类中标注有限、Transformer/3D-CNN计算开销大的问题,MixerSENet用PCA降维后对图像块进行轻量混合:以多尺度深度卷积解耦空间与通道特征,并加入SE重标定光谱通道。模型仅约5.3万参数,在Houston13和Qingyun上OA达82.47%和96.70%,超过多种CNN、Transformer与Mamba基线,但具体消融增益仍需看全文细节。

Learning Label-Efficient Interpretable Medical Image Diagnosis via Semi-supervised Hypergraph Concept Bottleneck Model Figure 1
2026-06-02cs.CV

Learning Label-Efficient Interpretable Medical Image Diagnosis via Semi-supervised Hypergraph Concept Bottleneck Model

Yijun Yang, Ruiqiang Xiao, Lijie Hu, Angelica I Aviles-Rivero, Yunzhu Wu, Jing Qin, Lei Zhu

Joy Future Academy, Tsinghua University, Sichuan University

2026-06-02视觉感知

面向医学影像中黑箱诊断难以被临床信任、概念标注昂贵且传统 CBM 忽略概念依赖的问题,论文提出半监督 HyperCBM:用概念级超图建模高阶临床概念关系,并用图像级超图生成更贴近医学域的动态伪标签。在新建 PAS 超声、公开乳腺超声和 SkinCon 皮肤镜数据上的实验显示,其在少量概念标签下提升概念识别与分类性能,并保持可解释推理。

Understanding Identity Continuity in Thermal Video through Scene-Level Consistency Figure 1
2026-06-02cs.CV

Understanding Identity Continuity in Thermal Video through Scene-Level Consistency

Wei-Chieh Sun, Gyungmin Ko, Heejae Kwon, Hsiang-Wei Huang, Jenq-Neng Hwang

Department of Electrical and Computer Engineering, Information Processing Lab, University of Washington, USA

2026-06-02视觉感知

热红外行人多目标跟踪中,外观线索弱、漏检和遮挡易造成轨迹碎片与身份切换。本文不追求更复杂的跟踪器,而是在 YOLOv8+SORT 基线上加入轻量身份修复,将身份连续性视为场景级时空一致性问题,通过短间隔重映射和保守的离线轨迹重连恢复 ID。消融显示主要收益来自长程重连,PBVS 评测中 IDF1 从 82.25 提升到 84.93 且基本保持 MOTA,阈值敏感性也较稳定。

RPCASSM: Robust PCA State Space Model For Infrared Small Target Detection Figure 1
2026-06-02cs.CV

RPCASSM: Robust PCA State Space Model For Infrared Small Target Detection

Pingping Liu, Aohua Li, Yubing Lu, Jin Kuang, Tongshun Zhang, Qiuzhan Zhou

2026-06-02视觉感知安全鲁棒

本文针对红外小目标在下采样和序列扫描中易丢失像素级边缘、主流视觉 SSM 难以兼顾精细定位与效率的问题,提出以 RPCA 低秩背景/稀疏目标先验引导的双分支 RPCASSM:BSSM 用空间探针扫描建模背景,TSSM 用可变形提示扫描聚焦目标区域,并通过协同反馈缓解前景背景失衡。实验在 NUDT-SIRST 与 IRSTD-1K 上显示其优于现有方法,说明结构性先验对边缘保持和鲁棒检测有效。

Physics-Aware Linearized ADMM and Its Unrolling Figure 1
2026-06-02eess.SP

Physics-Aware Linearized ADMM and Its Unrolling

Satoshi Takabe, Shunta Arai, Tadashi Wadayama

2026-06-02视觉感知

针对由 PDE 描述测量过程的逆问题,标准 ADMM 需反复调用可微 PDE 求解器导致开销高。论文将含 PDE 的子问题线性化,提出 PA-LADMM,使每轮仅需一次求解和梯度评估,并给出条件收敛保证;进一步用深度展开学习内部参数。在光纤压缩感知和各向异性扩散图像复原中,方法优于梯度类基线,展开训练带来额外提升。

Restoring Initial Noise Sensitivity in Text-to-Image Distillation via Geometric Alignment Figure 1
2026-06-02cs.CV

Restoring Initial Noise Sensitivity in Text-to-Image Distillation via Geometric Alignment

Huayang Huang, Ruoyu Wang, Jinhui Zhao, Wei Deng, Daiguo Zhou, Jian Luan, Yu Wu, Ye Zhu

2026-06-02视觉感知

论文指出,文本到图像蒸馏虽能加速采样,但点对点对齐会平滑教师映射,削弱初始噪声敏感性,进而损害基于噪声的控制与多样性。作者提出 GAD,通过匹配相对输入噪声的 Jacobian-vector product 来对齐师生局部几何响应。实验覆盖 SD2、PixArt-α、SANA 及三类蒸馏范式,显示其在布局控制、噪声检索和多样性上优于多种基线,同时基本保持图像保真度。

PhyScene3D: Physically Consistent Interactive 3D Tabletop Scene Generation Figure 1
2026-06-02cs.CV

PhyScene3D: Physically Consistent Interactive 3D Tabletop Scene Generation

Weixing Chen, Zhuoqian Feng, Yang Liu, Yexin Zhang, Yifan Wen, Yinghong Liao, Weichao Qiu, Guanbin Li, Liang Lin

2026-06-02三维

面向机器人操作仿真中桌面场景密集、层级关系复杂且训练数据常含碰撞的问题,PhyScene3D将生成改写为类人逐步搭建过程:用CTRC按锚点和3D AABB顺序化拓扑放置,再用PADA结合可微SDF与测试时优化把结果投影到物理可行流形。实验显示其语义准确性和物理有效性优于现有方法,场景级碰撞率较人工标注训练数据降低40%。

Conditional Collapse in Sign Language Production: A Diagnostic and a Scaling Argument Figure 1
2026-06-02cs.CV

Conditional Collapse in Sign Language Production: A Diagnostic and a Scaling Argument

Rui Hong, Jana Košecká

George Mason University

2026-06-02视觉感知

本文针对手语生成中 FID 与回译 BLEU 可能“变好但不忠实”的评估失真,提出用冻结运动自编码器潜空间的三类距离比诊断条件坍塌:初始姿态依赖、输出多样性与目标忠实度。作者在 How2Sign 的 14 个模型检查点上发现 τ3 忠实度始终未达成,且 FID 与忠实度无关;而同一扩散骨干在孤立词 ASL3DWord 上可取得较好 τ3,说明瓶颈可能主要来自句级配对数据规模。

Edge-directed geometric partitioning for versatile video coding Figure 1
2026-06-02cs.CV

Edge-directed geometric partitioning for versatile video coding

Xuewei Meng, Xinfeng Zhang, Chuanmin Jia, Xia Li, Shanshe Wang, Siwei Ma

2026-06-02视觉感知

针对 VVC 几何划分(GEO)虽能改善非矩形运动补偿、但 140 个候选模式需显式传索引导致码率开销的问题,论文提出在编解码端构建最可能模式(MPM)列表,并利用相邻空间块与时域共位块的边缘信息预测当前 CU 的物体边界,从而优先编码更可能的划分角度和距离。实验相对 VTM-6.0 在 RA、LDB 配置下平均获得 0.58% 和 1.00% BD-rate 降低,并改善边界视觉质量。

CanonCGT: Reference-Based Color Grading via Canonical Pivot Representation Figure 1
2026-06-02cs.CV

CanonCGT: Reference-Based Color Grading via Canonical Pivot Representation

Jinwon Ko, Keunsoo Ko, Chang-Su Kim

Korea University, The Catholic University of Korea

2026-06-02视觉感知

针对参考图调色中,风格迁移易过度偏色、滤镜方法又会保留或叠加输入原有色调的问题,CanonCGT将调色拆为“去风格化到中性 canonical pivot”和“按参考再调色”两步,并用3D LUT与双阶段训练结合预设监督和无配对自监督细化。实验显示其在多数据集上比现有写实风格迁移和滤镜迁移方法更稳定,结构保真与色调一致性更好。

Pave-GRPO: Beyond Instantaneous Guidance through Principled Average Velocity Decomposition Figure 1
2026-06-02cs.CV

Pave-GRPO: Beyond Instantaneous Guidance through Principled Average Velocity Decomposition

Pengyang Ling, Jiazi Bu, Yujie Zhou, Yibin Wang, Zhenyu Hu, Zihan Zhang, Yi Jin, Huaian Chen, Yuhang Zang

University of Science and Technology of China, Shanghai Jiao Tong University, Fudan University, Harbin Institute of Technology, Beihang University, Shanghai AI Laboratory, University of Science and Technology of China China, Shanghai Jiao Tong University China, Fudan University China, Harbin Institute of Technology China, Beihang University China, Shanghai AI Laboratory China

2026-06-02视觉感知

本文针对 flow 文生图模型用 GRPO 做偏好后训练时,为降低 rollout 成本只能用少量去噪步、导致奖励监督过于稀疏的问题,提出 Pave-GRPO:在保持少步 group sampling 的同时,将粗粒度状态转移按平均速度分解为等价的多段子轨迹,复用同一奖励向更密集时间步传播监督。实验在 FLUX.1-dev 上显示其在不同奖励设置下优于现有 GRPO 变体,改善全局布局与细节对齐,且不增加采样成本。

What to Test Next: Interpretable Coverage Gap Discovery in Driving VLMs Figure 1
2026-06-02cs.CV

What to Test Next: Interpretable Coverage Gap Discovery in Driving VLMs

Abhishek Aich, Sparsh Garg, Vijay Kumar BG, Turgun Yusuf Kashgari, Manmohan Chandraker

† NEC Laboratories, America, USA, ‡ University of California, San Diego, USA

2026-06-02视觉语言

这篇论文针对驾驶 VLM 验证中大量 ODD 场景未被测试、失败率估计不可靠的问题,提出 SliceScorer 用“低覆盖稀有性”和“邻近已测失败风险”确定性排序待测切片,并由 SliceNav 用 LLM 编排查询、扩展 ODD 与评测流程但保持打分可审计。在 WiseAD、DriveMM、Cosmos 上,方法比 SliceFinder/SliceLine 更能发现高风险缺口且推荐更分散;K=5000 时相对 SliceFinder 在 DriveMM/Cosmos 上分别降低平均漏失失败风险 65%/71%。

Goal2Pixel: Grounding Goals to Pixels for Vision-Language Navigation Figure 1
2026-06-02cs.CV

Goal2Pixel: Grounding Goals to Pixels for Vision-Language Navigation

Muyi Bao, Yuxin Cai, Hang Xu, Zongtai Li, Jinxi He, Jingfan Tang, Chen Lv, Ji Zhang, Yaqi Xie, Wenshan Wang

Carnegie Mellon University, Nanyang Technological University

2026-06-02机器人视觉语言视觉感知

本文针对VLN-CE中VLM反复预测低层动作带来的监督歧义、短视决策和高推理成本,将导航统一改写为图像平面上的可通行像素 grounding:前进像素反投影为3D路标,转向/停止由图像外辅助区域表示,并配合可见性关键帧记忆、语义嵌入和坐标感知损失。在R2R-CE上达54.1% SR/52.5% SPL,平均每轮仅7.75次VLM调用,较直接动作预测约少6倍;RxR-CE也达到竞争性SOTA并展示实机可行性。

Real-Time Generation of Streamable Talking Portrait Video with Reference-Guided Deep Compression VAEs Figure 1
2026-06-02cs.CV

Real-Time Generation of Streamable Talking Portrait Video with Reference-Guided Deep Compression VAEs

Sicheng Xu, Yu Deng, Shoukang Hu, Yichuan Wang, Yizhong Zhang, Zhan Chen, Jiaolong Yang, Baining Guo

2026-06-02视觉感知生成模型

针对扩散式说话人像生成难以实时交互、且常局限离线生成的问题,论文提出面向流式场景的音频驱动框架:用参考图引导的因果视频 VAE 将静态外观从动态信息中“剥离”以深度压缩,再用块级自回归 Rectified Flow Transformer 生成潜变量。实验显示其可生成任意长度视频,压缩率达 768,速度约 42 FPS,较现有扩散人像模型快 25 倍以上,画质与真实感相当或更优。

Turing Patterns for Multimedia: Reaction-Diffusion Multi-Modal Fusion for Language-Guided Video Moment Retrieval Figure 1
2026-06-02cs.CV

Turing Patterns for Multimedia: Reaction-Diffusion Multi-Modal Fusion for Language-Guided Video Moment Retrieval

Xiang Fang, Wanlong Fang, Wei Ji, Tat-Seng Chua

Nanyang Technological University, Nanjing University, National University of Singapore, Nanyang Technological University Singapore Singapore, Nanjing University Suzhou China, National University of Singapore Singapore Singapore

2026-06-02视觉感知生成模型

针对语言引导视频时刻检索中,静态跨注意力难以刻画视频时间演化与文本语义的非线性对齐问题,论文将多模态融合类比为图灵反应-扩散过程,提出 RDMF:视频特征沿时间扩散以建模上下文,文本-视频反应放大相关片段并抑制噪声,并结合 Gray-Scott 模型与 DETR 式预测头。文中称初步实验在显著时刻定位上优于既有方法,但具体数据与增益来源在给定片段中未充分说明。

Self-Improving Small Object Grounding in LVLMs Figure 1
2026-06-02cs.CV

Self-Improving Small Object Grounding in LVLMs

Tianze Yang, Yucheng Shi, Ruitong Sun, Ninghao Liu, Jin Sun

University of Georgia

2026-06-02视觉语言

针对 LVLM 直接输出框时小目标定位明显弱于大目标的问题,论文提出利用模型内部注意力进行自改进:先多次采样候选框,再用仅基于注意力图的轻量 IoU 回归器筛选,进一步从关键层头的熵规律蒸馏出无需训练的 ACS-Free。COCO 和 Objects365 上,小目标定位最高提升约 19%,且无需微调或外部检测器,但需要白盒注意力访问并增加少量采样开销。

Exploiting Semantic and Pixel Representations for Ultra-Low Bitrate Image Compression Figure 1
2026-06-02cs.CV

Exploiting Semantic and Pixel Representations for Ultra-Low Bitrate Image Compression

Hao Wei, Yanhui Zhou, Chenyang Ge, Saeed Anwar, Ajmal Mian

2026-06-02视觉感知

面向带宽/存储极受限场景,论文指出现有极低码率压缩常在感知真实感与像素保真间失衡,易产生结构漂移。SPDiff采用一步扩散编解码器,引入VAE、失真导向与语义导向三编码器,并用失真感知粗重建提取像素和语义条件来约束扩散生成。实验显示其在低于0.03 bpp时优于多种SOTA,能同时提升感知质量和像素级 fidelity。

Paving the Way for Point Cloud Video Representation Learning Using A PDE Model Figure 1
2026-06-02cs.CV

Paving the Way for Point Cloud Video Representation Learning Using A PDE Model

Zhuoxu Huang, Zhenkun Fan, Jungong Han, Josef Kittler

2026-06-02视觉感知三维

点云视频的空间无序性使逐点跟踪和光流式时空建模不可靠,限制了动作理解等任务。论文提出 MotionPDE,将空间点随时间变化抽象为可求解的 PDE,并用时间/空间嵌入的对比学习约束求解过程,作为低开销即插即用模块增强现有骨干。实验显示其在端到端与自监督预训练中均提升 PSTNet、PST-Transformer 等模型,MSRAction-3D 上最高达 97.3%,跨到 UTD-MHAD 也有约 4.84% 增益。

EIVE: End-to-End Instance-Specific Visual Explanations for Detection Transformers Figure 1
2026-06-02cs.CV

EIVE: End-to-End Instance-Specific Visual Explanations for Detection Transformers

Jianlin Xiang, Yanshan Li, Linhui Dai

the Guangdong Provincial Key Laboratory of Intelligent Information Processing, Shenzhen University, and the Shenzhen Key Laboratory of Modern Communications and Information Processing, Shenzhen University, Shenzhen, China

2026-06-02视觉感知

针对目标检测中多实例解释依赖梯度或反复扰动、开销高且与模型内部推理不一致的问题,EIVE将DETR解码器交叉注意力视为实例级特征归因通路,并用跨层混合共识融合生成稳定紧凑的显著图;同时通过注意力感知联合训练约束注意力分布。COCO、ExDark和Cityscapes实验显示其解释质量接近或优于后验方法,并显著提升解释效率,且适用于多种DETR式检测器。

RoboTrustBench: Benchmarking the Trustworthiness of Video World Models for Robotic Manipulation Figure 1
2026-06-02cs.CV

RoboTrustBench: Benchmarking the Trustworthiness of Video World Models for Robotic Manipulation

Huiqiong Li, Jiayu Wang, Zhiting Mei, Anirudha Majumdar, Jingjing Chen, Bin Zhu

Singapore Management University, Fudan University, Princeton University

2026-06-02机器人视觉感知强化学习数据集/基准

这篇论文关注机器人视频世界模型从“看起来真实”走向可用于决策时的可信性缺口:现有评测多默认指令可行且安全。作者基于 DROID 构建 RoboTrustBench,覆盖正常、约束敏感、反事实和对抗四类场景,含 1207 个专家验证图像-指令对,并用六维十三项准则评估。对七个模型的人工与 MLLM 评测显示,模型虽常能生成连贯视频,但在约束推理、反事实 grounding、物理交互和拒绝不安全指令上明显不足。

TLG: Temporal-Logic Grounding for Video Question Answering via Source-Annotation Reconstruction and Category-Targeted Reasoning Figure 1
2026-06-02cs.CV

TLG: Temporal-Logic Grounding for Video Question Answering via Source-Annotation Reconstruction and Category-Targeted Reasoning

Ali Alavi

The Ohio State University

2026-06-02视觉语言视觉感知三维

本文针对 TimeLogic 视频问答中 VLM 近似把视频当帧集合、难以定位动作时间轴的问题,提出 TLG 三层方案:优先从生成基准的公开数据集标注重建动作时间线并符号执行时序逻辑,缺标注时用开源 VLM,并将其薄弱的选择题路由到 Gemini。结果显示测试准确率由 46.9% 提升到 71.37%,消融表明主要增益来自真实时序标注而非模型规模。

Effective Multi-sensor Conditioning for Street-view Novel-view Synthesis Figure 1
2026-06-02cs.CV

Effective Multi-sensor Conditioning for Street-view Novel-view Synthesis

Zhengfei Kuang, Adam Sun, Liyuan Zhu, Tong Wu, Shengqu Cai, Jonathan Tremblay, Iro Armeni, Ehsan Adeli, Lior Yariv, Gordon Wetzstein

2026-06-02视觉感知

本文针对车载街景新视角合成中目标轨迹远离原始行驶路径时,单靠重投影 LiDAR 易变稀疏、导致扩散模型退化的问题,提出 StreetNVS,将稀疏 LiDAR、环视参考图像与相机位姿作为互补多传感器条件,并用基于相对射线位置编码的 Reference-Enhanced Camera Attention 融合外观与几何,再通过两阶段课程训练适应 LiDAR 稀疏性。在 Waymo Open Dataset 上,其在稀疏点云条件下超过现有方法,并可匹配依赖 10–100 倍更密点云的基线,支持抬升、换道、后撤和旋转等极端轨迹视频合成。

FLAME: Physics-Guided Neural Operators for Onboard Satellite Methane Detection in Hyperspectral Imagery Figure 1
2026-06-02cs.CV

FLAME: Physics-Guided Neural Operators for Onboard Satellite Methane Detection in Hyperspectral Imagery

Junhyuk Heo, Junhwan Park, Sancheol Sim, Beomkyu Choi, Woojin Cho

2026-06-02视觉感知

面向卫星高光谱甲烷监测的数据下传与星上算力瓶颈,FLAME把Beer–Lambert吸收与对数域匹配滤波的内积结构嵌入网络,用傅里叶神经算子逐像素估计背景和白化目标谱,避免全局协方差迭代。在STARCOP上其F1领先各类方法,小羽流优势明显,较最强神经基线像素级误报降近3倍,并以较少参数满足Jetson类星载硬件时延预算。

Deformable Wiener Filter for Future Video Coding Figure 1
2026-06-02cs.CV

Deformable Wiener Filter for Future Video Coding

Xuewei Meng, Chuanmin Jia, Xinfeng Zhang, Shanshe Wang, Siwei Ma

2026-06-02视觉感知

该文针对 VVC 环路滤波主要依赖局部相似性、非局部滤波又常因无监督估计与复杂度受限的问题,提出可变形 Wiener 滤波器,将局部邻域与非局部相似样本按噪声和样本特征分组后自适应融合,并用 Wiener 理论监督求解系数及约束异常值。相较 VTM-11.0,AI、RA、LDB 平均节码率分别为 1.16%、1.92%、2.67%,但快速实现仍带来千级解码时间增量。

$\text{VG}^2$GT: Voxel-Gaussian Splatting Visual Geometry Grounded Transformer Figure 1
2026-06-02cs.CV

$\text{VG}^2$GT: Voxel-Gaussian Splatting Visual Geometry Grounded Transformer

Yibin Zhao, Yihan Pan, Jun Nan, Wenli Yang, Liwei Chen, Jianjun Yi

East China University of Science and Technology, Shanghai, Shanghai Open University, Shanghai, Shanghai Xiaoyuan Innovation Center, Shanghai

2026-06-02三维

针对现有 3DGS 重建依赖相机位姿、逐场景优化,以及免位姿前馈方法中像素对齐高斯易产生分布不均和跨视角伪影的问题,VG²GT 将冻结的视觉基础模型与可微多尺度体素模块结合,从体素特征而非像素直接拆分回归高斯,并用随机实体体渲染监督深度。实验称其在 DTU、Replica、TAT、ScanNet 上提升几何重建和新视角合成质量,同时显著降低训练成本。

PINNOCHIO: Physics-Informed Neural Network for Coupled Hyperelastic Interface-Volume Simulation in Orthognathic Surgery Figure 1
2026-06-02eess.IV

PINNOCHIO: Physics-Informed Neural Network for Coupled Hyperelastic Interface-Volume Simulation in Orthognathic Surgery

Jungwook Lee, Daeseung Kim, Kevin Gu, Zhangfeng Hu, Tianshu Kuang, Finn Hopeman, Michael A.K. Liebschner, Jaime Gateno, Pingkun Yan

2026-06-02视觉感知

该文面向正颌手术中软组织响应仿真,针对 FEM 过慢、纯深度模型缺少生物力学一致性的问题,提出 PINNOCHIO:将骨—软组织界面的不连续位移预测与体积内超弹性传播顺序解耦,并用物理约束支持仅外表面监督的 sim-to-real 适配。40 例临床数据上,其表面精度和物理有效性优于基线,并相对 FEM 显著提速。

Hierarchical Semantic-Augmented Navigation: Optimal Transport and Graph-Driven Reasoning for Vision-Language Navigation Figure 1
2026-06-02cs.RO

Hierarchical Semantic-Augmented Navigation: Optimal Transport and Graph-Driven Reasoning for Vision-Language Navigation

Xiang Fang, Wanlong Fang, Changshuo Wang

School of Software Engineering, Huazhong University of Science and Technology, Nanyang Technological University, Singapore, University College London

2026-06-02机器人视觉语言视觉感知

针对连续环境视觉语言导航中长程任务易受场景理解不足、静态地图依赖和低层控制不稳影响的问题,论文提出 HSAN:用 VLM 动态构建对象—区域—分区的层次语义场景图,以最优传输进行兼顾语义相关性与可达性的拓扑目标选择,并用图感知强化学习执行子目标。文中声称在多个 VLN-CE 数据集上达到 SOTA、提升成功率和未见环境泛化,但关键片段未给出具体指标,增益幅度需看完整实验表。

Attention-guided Fine-tuning of Multimodal Large Language Models Improves Chain-of-Thought Reasoning Figure 1
2026-06-02cs.CV

Attention-guided Fine-tuning of Multimodal Large Language Models Improves Chain-of-Thought Reasoning

Sanchit Sinha, Guangzhi Xiong, Bohan Liu, Zhenghao He, Aidong Zhang

University of Virginia

2026-06-02视觉语言

这篇论文针对多模态大模型中 CoT 提示常不如直接回答的问题,指出关键失败来自过早锁定答案和推理阶段对视觉 token 访问不足。作者提出无需改架构的 Attentive-CoT 微调目标,同时惩罚早承诺并鼓励持续视觉注意。六个 MLLM、三个视觉推理基准上,相比常规 CoT-SFT 提升 CoT 准确率,并改善反事实视觉依赖与 OOD 表现。

ForestMamba: Sparse Mamba with Geometry-guided Queries for 3D Forest Point Cloud Segmentation Figure 1
2026-06-02cs.CV

ForestMamba: Sparse Mamba with Geometry-guided Queries for 3D Forest Point Cloud Segmentation

Trung Thanh Nguyen, Tuan-Anh Vu, Duc Viet Le, Yasutomo Kawanishi, Takahiro Komamizu, Ichiro Ide, Teja Kattenborn

2026-06-02视觉感知三维

面向森林激光雷达点云规模大、采样不均、树冠重叠且 Transformer 注意力难扩展的问题,ForestMamba 将森林垂直结构先验融入稀疏编码、CHM 几何引导查询初始化与 Mamba 查询解码,用线性状态空间建模替代二次注意力。在七个地区实验中,其语义与实例分割均优于基线,推理约快 3 倍、显存约降 2.3 倍。

PathAR: Structure-First Autoregressive Synthesis of Multimodal Pathology Images Figure 1
2026-06-02cs.CV

PathAR: Structure-First Autoregressive Synthesis of Multimodal Pathology Images

Yuan Zhang, Jiahao Xia, Junzhang Huang, Meng Wang, Feng Chen, Guanyu Yang, Huazhu Fu

2026-06-02视觉语言视觉感知

针对多模态病理图像中外观差异大、但细胞拓扑和组织边界等结构需保持一致的问题,PathAR 将结构与外观显式拆成双 VQ token,并用非对称可见性的交错自回归 Transformer 强制先生成结构、再渲染外观。实验显示其在结构一致性、模态保真度和多样性上优于基线,生成的对齐图像—掩码还能提升低数据分割表现。

MPMWorlds: Material-Point-Method Simulations for Inferring and Extrapolating Physical Dynamics Figure 1
2026-06-02cs.GR

MPMWorlds: Material-Point-Method Simulations for Inferring and Extrapolating Physical Dynamics

Žiga Kovačič, Kevin Ellis

Cornell University

2026-06-02强化学习

本文关注从短视频推断物理规律并外推未来这一世界模型难题,构建含流体、沙雪、可变形体、发射器等2D MPM仿真数据集,配套代码、配置和视频,用于对比生成仿真代码的VLM与直接续帧的VDM。结果显示二者互补:代码生成长时域更稳定但难从视觉恢复几何和参数,视频扩散更擅长外观/布局却易产生不合物理的长期动态,指向视觉状态估计与显式动力学结合的混合方案。

PaCX-MAE: Physiology-Augmented Chest X-Ray Masked Autoencoder Figure 1
2026-06-02cs.CV

PaCX-MAE: Physiology-Augmented Chest X-Ray Masked Autoencoder

Yancheng Liu, Kenichi Maeda, Manan Pancholy

2026-06-02视觉感知

临床中胸片常是唯一可即时获得的模态,而单模态视觉预训练难捕捉心电、化验等生理状态。PaCX-MAE在MAE胸片编码器上,用配对ECG与实验室数据的冻结表征进行对比-预测式跨模态蒸馏,推理时仍只需胸片。九个基准显示其较领域MAE稳定提升,尤其在MedMod、VinDr等生理相关任务上增益明显,1%标注场景更省样本,同时分割性能基本不降。

MotionDreamer: Universal Skeletal Motion Generation for 3D Rigged Shapes Figure 1
2026-06-02cs.CV

MotionDreamer: Universal Skeletal Motion Generation for 3D Rigged Shapes

Ye Tao, Yuxin Yao, Kendong Liu, Dapeng Wu, Junhui Hou

2026-06-02三维

面向游戏、VR与4D资产生产中任意绑定模型难以自动生成动作的问题,MotionDreamer用视频条件扩散直接预测骨骼关节序列,并通过约2万带纹理、骨骼和动画的3D模型数据集,以及纹理/语义注入和双向视频-骨架融合来适配异构拓扑。实验称其在未见类别和复杂动作上优于现有方法;但部分增益可能主要来自 scaling / data。

On the Limits of Token Reduction for Efficient Unified Vision Language Training Figure 1
2026-06-02cs.CV

On the Limits of Token Reduction for Efficient Unified Vision Language Training

Siyi Chen, Weiming Zhuang, Jingtao Li, Lingjuan Lv

University of Michigan

2026-06-02视觉感知

本文关注统一视觉语言模型同时做理解与生成时训练成本过高的问题,系统分析自回归 VLM 的逐层注意力后指出二者的视觉 token 冗余并不对称:理解任务在深层大量依赖文本而视觉 token 可裁剪,生成任务则始终依赖图像 token。作者据此设计任务特定加速器,单任务可显著省算,但联合训练中出现 synergy loss,破坏理解与生成的互利优化,说明高效统一训练需保留跨任务共享结构。

Splatshot: 3D Face Avatar Generation from a Single Unconstrained Photo Figure 1
2026-06-02cs.CV

Splatshot: 3D Face Avatar Generation from a Single Unconstrained Photo

Hao Liang, Zhixuan Ge, Soumendu Majee, Joanna Li, Ashok Veeraraghavan, Guha Balakrishnan

Rice University

2026-06-02三维

本文针对单张野外照片生成逼真且多视角一致的3D人脸头像难题,指出3DGS的几何一致性与2D扩散模型的真实感先验互补。SplatShot在无需训练的去噪过程中引入逐步3D反馈:用多视角预测重拟合3DGS,再将重渲染误差回传修正采样,并用噪声混合稳定早期引导。实验显示其在身份保持、真实感和视角一致性上优于多类基线,但速度较慢且发型、帽子和后视角仍受限。

Perception First: A Frontier Native-Video Model with Self-Consistency for Implicit Video Question Answering Figure 1
2026-06-02cs.CV

Perception First: A Frontier Native-Video Model with Self-Consistency for Implicit Video Question Answering

Ali Alavi

The Ohio State University

2026-06-02视觉感知

本文面向 ImplicitQA/VRR-QA 中单帧不可见、需跨帧推断的隐式视频问答,系统比较开源 Video-LMM 与多种推理时策略。核心洞察是该任务主要受限于低层视觉感知而非推理流程,复杂分解、布局提示和音频常无益甚至有害;原生视频输入加 5 次自一致投票最有效。最终 Gemini 3.1 Pro 达到 81.18% 测试准确率,超过此前最好 80.85%,接近非专家人类水平。

SafeGen-Bench: Benchmarking Safety in Image-Conditioned Text-to-Video Generation Figure 1
2026-06-02cs.CV

SafeGen-Bench: Benchmarking Safety in Image-Conditioned Text-to-Video Generation

Yingzi Ma, Xiaogeng Liu, Yawen Zheng, Chaowei Xiao

University of Wisconsin-Madison, Madison, Tsinghua University, 3 Johns Hopkins University

2026-06-02视觉感知数据集/基准安全鲁棒

本文关注图像条件文本到视频生成中的安全盲区:单独看似安全的起始图像与文本组合后可能诱导有害视频。作者提出 SafeGen-Bench,覆盖10类恶意风险,构建392组起始帧-提示对,并用GPT-4o与视频质量指标联合评估五个条件T2V模型及护栏。结果显示现有模型在高质量生成时仍会产生较高不安全分数,最高达44.5,且单模态文本或图像护栏在七类风险上失败率约80%。

UR-JEPA: Uniform Rectifiability as a Regularizer for Joint-Embedding Predictive Architectures Figure 1
2026-06-02cs.LG

UR-JEPA: Uniform Rectifiability as a Regularizer for Joint-Embedding Predictive Architectures

Triet M. Le

2026-06-02视觉感知

本文针对 JEPA/LeJEPA 用各向同性高斯正则防塌缩却违背流形假设的问题,提出以一致可整性约束嵌入分布:用高斯核平滑的 Carleson 损失和 Jones β 数刻画局部 n 维切空间,从而让表示保持低维几何结构。在 Inet10 上较 LeJEPA 提升 0.83 个百分点且种子方差约降 30%,在 Galaxy10、ImageNet-100、EuroSAT 精度相近但表示谱呈明显低秩;不过其理论最优性与增益来源仍未充分说明。

DENSER: Depth-Guided Ensemble with Staged EFA-GS Reconstruction for Soccer Novel View Synthesis Figure 1
2026-06-02cs.CV

DENSER: Depth-Guided Ensemble with Staged EFA-GS Reconstruction for Soccer Novel View Synthesis

Parthsarthi Rawat

2026-06-02三维

面向足球场景新视角合成中地面转播机位样本少、草地/看台等弱纹理区域几何不稳的问题,DENSER在EFA-GS上引入按相机高度加权的光度损失、Depth-Anything-V2伪深度约束,并通过分阶段训练后分叉出不同训练时长和尺度钳制策略的三模型像素平均集成。在SoccerNet-NVS五个测试场景上达到29.89 dB PSNR、0.791 SSIM、0.366 LPIPS,PSNR较3DGS和Triangle Splat分别提升约3.15/3.46 dB;但文中未充分说明各组件的独立增益。

Agent Skills Should Go Beyond Text: The Case for Visual Skills Figure 1
2026-06-02cs.CV

Agent Skills Should Go Beyond Text: The Case for Visual Skills

Binxiao Xu, Ruichuan An, Bocheng Zou, Hang Hua

Peking University, University of Wisconsin, MIT-IBM Watson AI Lab

2026-06-02视觉感知

论文指出,现有智能体技能库多把经验压缩成文本,在 GUI 操作、计数等视觉任务中会丢失空间边界、目标区域和中间状态。作者提出 Visual Skill,将文本逻辑与静态视觉先验、动态视觉工作记忆和图文交织证据绑定,并用 AutoVisualSkill 从轨迹自动生成。实验显示其在 GUI grounding 和视觉密集任务上稳定优于纯文本技能,尤其适合需要空间对应和状态跟踪的场景。

PAI-Studio: Cinematic Video Background Replacement with Camera-Aware Motion Figure 1
2026-06-02cs.CV

PAI-Studio: Cinematic Video Background Replacement with Camera-Aware Motion

Heyuan Gao, Bangxun Tang, Yiren Song, Guian Fang, Zijian He, Jie Yang, Mike Zheng Shou

Nanyang Technological University, University of California, Irvine, Show Lab, National University of Singapore, showlab/PAI-Studio, 60] have demonstrated exceptional scalability and high-

2026-06-02视觉感知

论文针对电影级视频换背景中前景有推、摇、跟拍等镜头运动时,现有方法易产生静态背景、边界闪烁、光照不一致和身份漂移的问题。PAI-Studio将任务建模为参考图条件的视频生成,用双向注意力的 in-context Diffusion Transformer 统一融合前景视频与1至3张背景参考,并通过时序位置编码克隆实现多帧背景控制;同时构建30K电影/在线视频数据集强化运动与重光照监督。实验显示其在1080P背景运动一致性、前景保持、光照和边界和谐上优于开源方法及商业API,但部分增益可能主要来自数据规模与筛选。

Dr. DocBench: A Comprehensive Benchmark for Expert-Level and Difficult Document Parsing Figure 1
2026-06-02cs.CL

Dr. DocBench: A Comprehensive Benchmark for Expert-Level and Difficult Document Parsing

Minglai Yang, Xinyan Velocity Yu, Pengyuan Li, Xinyu Guo, Zhenting Qi, Konwoo Kim, Longtian Ye, Xiaolong Luo, Jinhe Bi, Henry Zhang, Haris Riaz, Xuan Zhang, Yunze Xiao, Bangya Liu, Tom Tang, Yunfei Zhao, Qunshu Lin, Zihan Wang, Minghao Liu, Michael Lingzhi Li, Yilun Du, Jesse Thomason, Rogerio Feris, Alex Pentland, Zexue He

Stanford University, Carnegie Mellon University, University of Southern California, Harvard University, University of Arizona, Duke University

2026-06-02数据集/基准

现有 OCR/文档解析基准多集中在常见版式,难以暴露 VLM 在专业长文档中的真实缺陷。Dr.DocBench 从多语种图书中按 52 个 BISAC 领域构建,并用多解析器失败/分歧采样挑选难页,提供 4,514 页、约 7 万个页面与块级标注,覆盖阅读顺序、层级关系、化学式、乐谱、复杂表格等结构。实验显示,管线解析器和通用 VLM 在既有基准上的强表现不能迁移到该设置,技术/符号类、Reference 与 Music 等领域及密集公式、颜色依赖表格仍明显失效。

Training-free image inversion for one-step diffusion models Figure 1
2026-06-02cs.CV

Training-free image inversion for one-step diffusion models

Tao Wu, Senmao Li, Yaxing Wang, Shiqi Yang, Kai Wang, Joost van de Weijer

2026-06-02视觉感知生成模型

针对一步扩散模型在真实图像反演中难以兼顾重建与可编辑性、且多步编辑反馈慢的问题,论文指出初始噪声是否接近高斯分布和文本-图像 caption gap 是关键瓶颈,提出无需训练的 TFinv,通过迭代噪声对齐、后缀提示学习和基于 mask 的局部编辑提升反演与背景保持。PIE-Bench 实验显示其一步编辑质量达到同类 SOTA,并在多轮编辑时显著快于多步方法。

BRo-JEPA: Learning Modular Arithmetic in Latent Space Figure 1
2026-06-02cs.LG

BRo-JEPA: Learning Modular Arithmetic in Latent Space

Divyansh Jha, Yuanfang Xie, Varan Mehra, Brennen Yu

Georgia Institute of Technology

2026-06-02视觉感知

本文用MNIST视觉数字的模10加法检验神经网络是在记忆训练操作还是学习抽象规则。核心做法是在JEPA潜在世界模型中引入块旋转预测器,把模运算的循环群结构直接约束为潜空间旋转,而非仅靠加性操作嵌入或MLP拟合。实验显示常规监督模型和普通JEPA难以严格零样本外推,BRo-JEPA在未见操作上达到约99.46%的零样本与rollout准确率,但结论仍局限于结构已知的受控任务。

ActMVS: Active Scene Reconstruction with Monocular Multi-View Stereo Figure 1
2026-06-02cs.RO

ActMVS: Active Scene Reconstruction with Monocular Multi-View Stereo

Guo Pu, Yixuan Han, Zhouhui Lian

2026-06-02三维

ActMVS瞄准机器人/UAV主动重建对低成本、轻量化感知的需求,试图摆脱深度相机依赖。其核心是在单目在线流程中用体素-帧可见性的视图因子图选择MVS参考帧,并通过全局深度优化约束跨视角一致性,从而生成可用于占据图和路径规划的稠密度量深度。Replica实验显示其重建质量可接近RGB-D主动重建基线,但运行开销仍高,实时机载部署仍是后续问题。

AlbedoEdit: Unified Instance-Level Video Editing with Albedo Guidance Figure 1
2026-06-02cs.GR

AlbedoEdit: Unified Instance-Level Video Editing with Albedo Guidance

Xilong Zhou, Bao-Huy Nguyen, Zheng Zeng, Jacob Munkberg, Jon Hasselgren, Thomas Leimkühler, Nima Kalantari, Miloš Hašan, Christian Theobalt

Max Planck Institute for Informatics, University of California Santa Barbara, Texas A & \& M University

2026-06-02视觉感知

面向实例级视频编辑中插入、移除、改纹理难以兼顾精细控制与光照一致性的问题,AlbedoEdit 将用户编辑的首帧反照率作为条件,驱动 DiT 扩散模型把源 RGB 视频生成目标视频,并用覆盖三类任务的合成配对数据训练。其洞察是反照率剥离高光、阴影等光照效应,更适合作为外观编辑接口;实验显示模型能补全高光、软阴影和镜面反射等效果,在定性和定量上优于对比视频编辑方法。

Diamonds in the Sky: Pareidolic Animals in Clouds Figure 1
2026-06-02cs.CV

Diamonds in the Sky: Pareidolic Animals in Clouds

Miriam Horovicz, Yacov Hel-Or, Yael Moses

Reichman University, Israel

2026-06-02视觉感知

本文关注人能在云中看见动物而现有检测器难以识别的视觉错觉问题。核心思路不是训练新检测器,而是用 SAM 分割云块,并以 MDDS 扩散在局部将云形轻微推向候选动物,再用可识别性与相似性筛选,同时通过从生成图回到原云的 morphing 视频引导人类感知。用户研究显示预测与人类选择相关,增强后召回率由 0.28 升至 0.55,F1 由 0.16 升至 0.39,接近其定义的最优基线 0.45。

ChartArena: Benchmarking Chart Parsing across Languages, Scenarios, and Formats Figure 1
2026-06-02cs.CV

ChartArena: Benchmarking Chart Parsing across Languages, Scenarios, and Formats

Shangpin Peng, Gengluo Li, Xingyu Wan, Chengquan Zhang, Hao Feng, Binghong Wu, Huawen Shen, Weinong Wang, Ziyi Cai, Zhuotao Tian, Han Hu, Can Ma, Yu Zhou

LLM Department, Tencent, Shenzhen Loop Area Institute, Institute of Information Engineering, Chinese Academy of Sciences, Nankai University

2026-06-02数据集/基准

针对图表解析评测长期受限于类型覆盖窄、输出格式不统一且缺少打印/手绘真实场景的问题,本文提出双语基准 ChartArena,覆盖8类数值与图示图表、3种视觉场景,并用三元组/有向图语义空间实现格式无关评测。对26个MLLM的实验显示,闭源前沿模型总体领先,开源模型差距缩小;文档解析模型在数值图尚可但图示结构明显掉队,雷达图和手绘场景仍最难。

FreqLite: A Lightweight Frequency-Decomposed Linear Model with Adaptive Reversible Normalization for Robust Long-Term Time-Series Forecasting Figure 1
2026-06-02cs.LG

FreqLite: A Lightweight Frequency-Decomposed Linear Model with Adaptive Reversible Normalization for Robust Long-Term Time-Series Forecasting

Mirza Samad Ahmed Baiga, Syeda Anshrah Gillani

2026-06-02三维安全鲁棒

针对长时序预测中线性模型虽高效但 RevIN 难适应非平稳、固定时域分解不够自适应的问题,FreqLite 用可学习、无损的频域分带与逐带线性头保留高频信息,并提出带门控的 A-RevIN 按非平稳程度调整反归一化。实验显示其在标准 LTSF 基准上优于轻量模型,长 lookback 下以更少参数、显存和训练时间超过 PatchTST;但相对 RLinear 的常规增益较小,非平稳 ILI 上提升更明显。

HOLA: Holistic Multi-Modal Alignment for Open-Set 3D Recognition Figure 1
2026-06-02cs.CV

HOLA: Holistic Multi-Modal Alignment for Open-Set 3D Recognition

Koby Aharonov, Oren Shrout, Ayellet Tal

Technion – Israel Institute of Technology, Technion - Israel Institute of Technology

2026-06-02视觉感知三维

面向机器人等场景中稀有/未知物体的开放集3D识别,HOLA指出以单张图或单句文本对齐点云会限制整体形状理解。其核心是将点云同时对齐多视图图像和多文本,并用解耦多正样本对比损失分开正样本聚合与负样本竞争,另以轻量文本适配器缓解网页 caption 域差。实验在长尾 Objaverse-LVIS 等基准取得更高零样本性能和帧率,且参数量显著低于重型2D-ViT方案。

DeblurNVS: Geometric Latent Diffusion for Novel View Synthesis from Sparse Motion-Blurred Images Figure 1
2026-06-02cs.CV

DeblurNVS: Geometric Latent Diffusion for Novel View Synthesis from Sparse Motion-Blurred Images

Changyue Shi, Wangbo Yu, Chaoran Feng, Li Yuan

2026-06-02视觉感知生成模型

针对实际采集中运动模糊会破坏稀疏视图的纹理细节与跨视角几何对应、而现有去模糊 NVS 多需逐场景优化的问题,DeblurNVS 将去模糊放到几何感知潜空间:先恢复上下文几何 latent,再结合目标相机用扩散生成目标视图 latent 并解码清晰图像。作者还构建 DL3DV-10K-Blur 大规模训练集;实验显示其在合成模糊与真实模糊场景中较基线更锐利、结构更稳定,但推理较慢且可能产生幻觉细节。

ResNet-34 with Lightweight Decoder for Accurate and Efficient Segmentation of Fetal Brain MRI Figure 1
2026-06-02eess.IV

ResNet-34 with Lightweight Decoder for Accurate and Efficient Segmentation of Fetal Brain MRI

Ashiqur Rahman, Muhammad E. H. Chowdhury, Md. Abu Sayed, Md. Sharjis Ibne Wadud, Abu Naser Md. Arafat, Mehedi Hasan Prince

Department of Electrical Engineering, College of Engineering, Qatar University, Doha, Qatar. Email:, Department of Biomedical Engineering, Jashore University of Science and Technology, Jashore, Bangladesh. Email:, baseline architectures such as UNet, UNet++, DeepLabV3, and DeepLabV3+, achieving an average Accuracy of

2026-06-02视觉感知

针对胎儿脑 MRI 中运动伪影、低组织对比度和孕周解剖差异导致的多组织分割不稳定问题,论文提出以 ResNet-34 做层级特征编码、MLP 轻量解码并用双线性上采样降低计算量的模型。其核心取舍是用较浅残差骨干和精简解码器兼顾边界保真与临床实时性。在 FeTA 2021 五折验证中,模型优于 UNet、UNet++、DeepLabV3/+,达到 97.37% Accuracy、90.33% Dice、86.93% IoU 和 90.83% Precision。

Beyond Visual Memory: Mechanistic Diagnostics of Latent Visual Reasoning Figure 1
2026-06-02cs.CV

Beyond Visual Memory: Mechanistic Diagnostics of Latent Visual Reasoning

Garvin Guo, Yu Chen, Xiang Wang, Shuai Li, Xinpei Zhao, Huaxing Liu, Shuai Dong

Shanghai Innovation Institute

2026-06-02视觉感知

针对“连续潜在视觉 token 是否真的存储视觉证据”的疑问,论文将其拆成潜在槽、边界标记和格式三部分,并设计 MVH 作为有利于槽内容的诊断探针。结果显示,在多设置和感知基准上,槽内容对答案弱因果、难以恢复缺失图像信息;仅保留边界标记即可保留 78–100% 增益,说明收益主要来自标记、格式和更聚焦的图像注意力,而非可读视觉记忆。

Knowledge-Intensive Video Generation Figure 1
2026-06-02cs.CV

Knowledge-Intensive Video Generation

Chenxu Wang, Mingda Chen

Fudan University, Shanghai Jiao Tong University, The code and supplementary materials are available at

2026-06-02视觉感知

论文指出现有文生视频评测过度关注画质,难以衡量教学、解释类信息检索场景中的事实正确性与实用性。作者提出知识密集视频生成 KIVI,构建含1080个短提示的 KIVI-Bench,并设计事实性与有用性自动指标。人评显示这些指标更贴近人工判断;七个先进模型测试表明,闭源模型最好但仍显著落后人类,主要短板在视觉属性、流程操作和信息呈现清晰度。

KG-FairDiff: Knowledge Graph-Guided Prompt Refinement for Demographically Fair Text-to-Image Generation Figure 1
2026-06-02cs.CV

KG-FairDiff: Knowledge Graph-Guided Prompt Refinement for Demographically Fair Text-to-Image Generation

Farbod Davoodi, Seyed Reza Tavakoli Shiyadeh, Pooria Safaei, Sana Harighi, Parsa Gholami, Amirali Amini, Kimia Vanaei, Emad Firoozi, Parham Abed Azad, Babak Khalaj, Siavash Ahmadi, Amir Hossein Payberah, Mohammad Hossein Rohban, Soheil Kolouri, Ali Diba

2026-06-02视觉感知

该文关注文本到图像模型在职业与文化场景中放大性别、种族、年龄和非西方文化刻板印象的问题。KG-FairDiff将去偏置放在推理期提示词改写:用约1200条文化/偏见知识图谱三元组检索上下文,LLM生成改写,并由验证器只接受降低公平性散度且保持语义相似的提示。实验审计8个生成器,报告在多维与交叉人口属性上显著降低Bias-W、提升ENS,同时基本保持CLIP语义一致性;但验证器校准、分类器偏差和知识图谱覆盖仍文中承认不足。

Event-Based Vision in Space: Applications, Trends, and Future Directions Figure 1
2026-06-02cs.CV

Event-Based Vision in Space: Applications, Trends, and Future Directions

Luigi Capogrosso, Pietro Bonazzi, Michele Magno

2026-06-02视觉感知

针对事件相机在空间/对地观测中的研究分散、传统帧相机又受运动模糊、功耗和冗余数据限制的问题,本文用 PRISMA-light 从 90 篇筛到 18 篇核心文献,提出四类应用 taxonomy:高速大气观测、环境变化检测、星上处理与任务支持、地理建模预测。主要结论是事件视觉结合脉冲网络可降低带宽与能耗、支持微秒级感知和边缘自治,但大规模在轨验证与工程化挑战仍未充分解决。

DeepIPCv3: Event-Aware Multi-Modal Sensor Fusion for Sudden Pedestrian Crossing Avoidance Figure 1
2026-06-02cs.RO

DeepIPCv3: Event-Aware Multi-Modal Sensor Fusion for Sudden Pedestrian Crossing Avoidance

Oskar Natan, Andi Dharmawan, Aufaclav Zatu Kusuma Frisky, Jazi Eko Istiyanto, Jun Miura

2026-06-02视觉感知

针对突发横穿行人中帧式视觉易受延迟、运动模糊和光照影响的问题,DeepIPCv3将LiDAR的3D几何与DVS事件流融合,并用类Transformer跨模态注意力动态权衡高速变化与场景结构,再输出局部航点和控制指令。论文在自采昼夜多模态数据上离线评估,报告其轨迹与控制误差低于对比方法,能更稳定触发避让或刹停;但安全性仍主要由离线模仿结果支撑,在线实车验证文中未充分说明。

Exploiting In-Sensor Computing for Energy-Efficient Earth Observation Figure 1
2026-06-02cs.CV

Exploiting In-Sensor Computing for Energy-Efficient Earth Observation

Luigi Capogrosso, Pietro Bonazzi, Loris Hoxhaj, Michele Magno

2026-06-02视觉感知

针对立方星地球观测中原始影像下传带宽有限、OBC 资源和能耗受限的问题,论文将 TinyML 推理前移到 Sony IMX500 智能视觉传感器内,结合静态图追踪与 INT8 量化部署 SqueezeNet、ShuffleNetV2、MCUNetV1 等模型,在 EuroSAT 上平均精度达 96.68%,满足 8MB 约束,并实现约 17.40 FPS、27.43 ms 延迟和 14.19 mJ/次推理,显示传感器内早期筛选可降低无效数据传输与主板负载。

Where to Look: Can Foundation Models Reach a Target Viewpoint Through Active Exploration? Figure 1
2026-06-02cs.CV

Where to Look: Can Foundation Models Reach a Target Viewpoint Through Active Exploration?

Liyang Li, Muzhi Zhu, Zhiyue Zhao, Hengyu Zhao, Ke Liu, Linhao Zhong, Hao Chen, Chunhua Shen

Zhejiang University

2026-06-02视觉感知

论文关注基础模型能否像人一样通过移动身体和转动视角主动复现目标图像,而非只做静态空间理解。作者提出TVR任务与TVRBench,要求智能体闭环比较当前视角和目标视角并执行动作,揭示现有开闭源模型成功率仅7.8%/12.0%,主要卡在多轮视觉历史利用和将视角差异转成平移。后训练中视觉-动作SFT把9B模型提升到50.8%,多轮GRPO小幅到51.4%,但CoT和单轮GRPO反而损害闭环表现。

Differing Roles of Leisure and Productivity in GDP - A Machine Learning based comparative analysis of Germany and USA Figure 1
2026-06-02econ.GN

Differing Roles of Leisure and Productivity in GDP - A Machine Learning based comparative analysis of Germany and USA

Achintya Ranjan, Uma Ranjan

2026-06-02视觉感知

本文关注在工作时长下降、生产率提升背景下,德国与美国 GDP 增长机制是否不同。作者用总工作时长和全要素生产率替代传统资本—劳动设定,训练随机森林并结合 Gini、SHAP 和偏依赖解释特征作用。结果显示两国关系高度非线性:德国 GDP 仍受劳动时长影响,美国几乎主要由生产率驱动;地缘事件等会降低预测可靠性。

Analysis of Ethnic Disparities in Autism Spectrum Disorder among Toddlers Figure 1
2026-06-02cs.CV

Analysis of Ethnic Disparities in Autism Spectrum Disorder among Toddlers

Aadithya Prabha Ramaharsha, Deevna Reddy, Uma Ranjan

2026-06-02视觉感知

论文关注幼儿 ASD 筛查中不同族群表现和诊断差异,动机是现有 Q-CHAT 等行为量表可能受文化、人口学和健康因素影响。其核心洞察是用多变量逻辑回归同时控制行为题项、性别和新生儿黄疸后,族裔差异才显现。结果显示相较亚洲儿童,白人欧洲儿童 ASD 风险约升高 81%,中东儿童约降低 79%,男性和新生儿黄疸也是显著风险因素。

Distilling Neuro-Symbolic Programs into 3D Multi-modal LLMs Figure 1
2026-06-02cs.CV

Distilling Neuro-Symbolic Programs into 3D Multi-modal LLMs

Wentao Mo, Yang Liu

2026-06-02三维

论文针对3D空间推理中“神经符号方法可解释但封闭、3D MLLM开放但黑箱”的矛盾,提出APEIRIA:将符号程序的执行轨迹蒸馏为自然语言CoT,并通过感知对齐、CoT-SFT和基于结果监督的CoT-RL,把推理模式扩展到开放词汇和复杂嵌套指令。实验显示其在grounding、问答和描述任务上超过既有NS3D方法,并接近或匹配主流3D MLLM,同时保留可追踪推理过程。

TECCI: Tricky Edits of Collected and Curated Images Figure 1
2026-06-02cs.CV

TECCI: Tricky Edits of Collected and Curated Images

Aishwarya Agrawal, Roy Hirsch, Yasumasa Onoe, Sherry Ben, Jason Baldridge

2026-06-02视觉感知

现有文本引导图像编辑在复杂指令、最小改动和画质保持上仍不稳定,TECCI因此构建了由作者新采集、覆盖7类场景和5类编辑的7550个高难样本,并结合人工与Gemini自动评分评测5个主流模型。结果显示所有模型总体成功率均低于22%,Nano Banana Pro最佳;模型更会“听指令”,但在不破坏原图和保持质量上明显不足,建筑、自然、推理和创意编辑尤为困难。

Feature Alignment Determines Fusion Strategy: A Comparative Study of Cross-Attention and Concatenation in Multimodal Learning Figure 1
2026-06-02cs.CV

Feature Alignment Determines Fusion Strategy: A Comparative Study of Cross-Attention and Concatenation in Multimodal Learning

Zhiqiang Zhou, Xuezhen Xie

[Hunan Chemical Industry Vocational and Technical College]

2026-06-02视觉语言

本文针对多模态系统中交叉注意力与特征拼接常凭经验选择的问题,提出“特征对齐质量决定融合策略”的观点,并用样本复杂度解释两者差异:已由 CLIP 对齐的视觉语言特征更适合低参数、低样本需求的拼接。Flickr8k 实验显示,在 2048–16384 样本下拼接较交叉注意力高 4.1–5.1 个百分点;未对齐 ResNet18 特征下则交叉注意力占优,但结论仍主要受限于单一数据集和二分类设置。

PairedGTA: Generating Driving Datasets for Controlled Photometric Shift Analysis Figure 1
2026-06-02cs.CV

PairedGTA: Generating Driving Datasets for Controlled Photometric Shift Analysis

Andrea Chianese, Giulio Rossolini, Alessandro Biondi, Marco Cococcioni, Giorgio Buttazzo

University of Pisa, DII, Pisa, Italy

2026-06-02规划控制数据集/基准

自动驾驶感知在夜间、雨雾等光照/天气变化下会退化,但真实“同场景不同条件”数据常混入视角、交通参与者和遮挡变化,难以归因。PairedGTA 利用 GTA V 引擎固定几何、相机位姿及动态目标身份与位置,仅改变光照和天气,生成像素对齐的反事实驾驶图像。实验以语义分割模型的跨条件自一致性为例,显示该受控数据比真实恶劣天气数据更能隔离光度偏移带来的性能变化。

Reusing Fusion-Time Spectral Reliability for Adaptive Fusion and Expert Routing in RGB-Infrared Object Detection Figure 1
2026-06-02cs.CV

Reusing Fusion-Time Spectral Reliability for Adaptive Fusion and Expert Routing in RGB-Infrared Object Detection

Yefeng Wu

2026-06-02视觉感知

这篇论文针对 RGB-红外检测中“融合结果被保留、融合是否可靠却被丢弃”的问题,提出将傅里叶交互中得到的能量、幅值、相位一致性和跨模态相关性压缩为无参数 7 维谱可靠性描述子,并复用于融合门控与 MoE 专家路由。实验显示,相比内容驱动门控/路由,该可靠性信号带来更大边际收益;在 DroneVehicle 六类退化下平均保持率达 95.0%,自然昼夜划分上 mAP50 提升约 +5.2/+5.3。

Towards Interactive Video World Modeling: Frontiers, Challenges, Benchmarks, and Future Trends Figure 1
2026-06-02cs.CV

Towards Interactive Video World Modeling: Frontiers, Challenges, Benchmarks, and Future Trends

Jiuming Liu, Chaojun Ni, Mengmeng Liu, Chensheng Peng, Fangjinhua Wang, Sitian Shen, Marc Pollefeys, Masayoshi Tomizuka, Ayush Tewari, Per Ola Kristensson

2026-06-02视觉感知强化学习数据集/基准

本文动机是交互式世界模型快速进入游戏、自动驾驶和机器人等场景,但缺少统一梳理。核心洞察是把动作条件视频/3D生成视为世界状态转移问题,并围绕动作可控性、长程一致性与记忆、实时响应三类瓶颈建立分类。主要结果是汇总趋势、基准与指标,覆盖开放世界探索、游戏引擎、自动驾驶和具身AI;作为综述无新模型实验,性能增益来源不涉及。

HiTokSR: A Coarse-to-Fine Tokenizer with Hierarchical Codebooks for High-Fidelity Real-World Image Super-Resolution Figure 1
2026-06-02cs.CV

HiTokSR: A Coarse-to-Fine Tokenizer with Hierarchical Codebooks for High-Fidelity Real-World Image Super-Resolution

Mingxi Li

2026-06-02视觉感知强化学习

现有 VQ 超分方法用单一码本同时编码结构与纹理,导致容量利用低且高维检索不稳定。HiTokSR 将潜空间按通道划分为频率感知的层级子码本,粗到细分离全局结构和细节纹理,并结合视觉基础模型语义调制、对齐损失及索引扰动微调提升鲁棒性。真实超分基准上,文中报告其在感知质量和重建保真度达到 SOTA,同时保持单次前向推理效率。

CoSTL: Comprehensive Spatial-Temporal Representation Learning for Moment Retrieval and Highlight Detection Figure 1
2026-06-02cs.CV

CoSTL: Comprehensive Spatial-Temporal Representation Learning for Moment Retrieval and Highlight Detection

Xin Dong, Wenjia Geng, Wenfeng Deng, Yansong Tang

Shenzhen International Graduate School, Tsinghua University Pengcheng Laboratory

2026-06-02视觉感知

这篇论文针对视频片段检索与高光检测中仅依赖帧级特征、忽视查询相关的帧内细节和跨帧动态的问题,提出 CoSTL:先用文本驱动的渐进式细粒度图像编码器从空间 patch 中抽取相关视觉信息,再通过多尺度时间感知模块建模粗细粒度动作变化。实验在 QVHighlights、Charades-STA、TACoS 和 TVSum 上超过已有方法,但具体增益与模型规模、特征预训练的关系文中仍需进一步拆解。

HakushoBench: A Japanese Chart and Table VQA Benchmark from Governmental White Papers Figure 1
2026-06-02cs.CV

HakushoBench: A Japanese Chart and Table VQA Benchmark from Governmental White Papers

Issa Sugiura, Shuhei Kurita, Yusuke Oda, Naoaki Okazaki

♡ \heartsuit Institute of Science Tokyo

2026-06-02数据集/基准

针对图表/表格 VQA 基准长期偏英语、日语 JGraphQA 规模小且趋于饱和的问题,论文提出从日本政府白皮书规模化构建 HakushoBench:覆盖 33 份白皮书、2053 张真实图表/表格、10 余类图像,并人工设计需整体理解和多跳推理的问答。实验显示其显著更难,最佳开源模型仅 58.6%,与最佳闭源模型相差 34.9 个百分点,暴露开源 VLM 在复杂日语图表理解上的短板。

STARFISH: faST Accuracy Recovery in pruned networks From Internal State Healing Figure 1
2026-06-02cs.LG

STARFISH: faST Accuracy Recovery in pruned networks From Internal State Healing

Shir Maon, Odelia Melamed, Adi Shamir

2026-06-02视觉感知

大模型剪枝虽能降低视觉模型的推理成本,但高稀疏度后精度恢复通常依赖昂贵微调或训练数据。STARFISH将剪枝后修复视为“内部状态愈合”,只用少量无标注校准样本,让稀疏模型各层中间表征与原密集模型方向对齐,并且不绑定特定剪枝方式或结构。实验显示其在ViT、MobileNet等图像分类模型上优于CORP等方法,50%剪枝时最高接近99.8%密集精度保留,75% DeiT-B剪枝可恢复82%原精度,高稀疏度优势更明显。

Rank-Aware Quantile Activation for Motion-Robust Crop Segmentation in UAV Imagery Figure 1
2026-06-02cs.CV

Rank-Aware Quantile Activation for Motion-Robust Crop Segmentation in UAV Imagery

Abinav Kiran, Sravan Danda, Aditya Challa, Sougata Sen, Daya Sagar B S

2026-06-02视觉感知安全鲁棒

本文针对高速无人机农田成像中的 6-DOF 运动模糊会抹除杂草簇、端行等稀有纹理类信号的问题,将分割网络的 ReLU 替换为带实例级秩归一化的 Dual QAct 残差激活,以保留模糊后特征的相对排序。基于 Agriculture-Vision 2021 和物理模糊模拟,QAct 在零样本与模糊蒸馏训练下均提升 mIoU,零样本相对增益约 37%–66%,且与蒸馏互补,但部分类别表现仍有波动。

R^3: Composed Video Retrieval via Reasoning-Guided Recalling and Re-ranking Figure 1
2026-06-02cs.CV

R^3: Composed Video Retrieval via Reasoning-Guided Recalling and Re-ranking

Zixu Li, Yupeng Hu, Zhiheng Fu, Zhiwei Chen, Weili Guan, Liqiang Nie

Shandong University, Harbin Institute of Technology (Shenzhen)

2026-06-02视觉感知三维

论文针对组合视频检索中“参考视频+文本修改”难以同时保持原上下文并捕捉隐含变化的问题,提出零样本 R³ 流程:先用 Qwen3-VL 生成目标侧推理轨迹,再将基础查询与推理增强查询做一致性门控残差融合召回,最后仅对候选池成对重排。实验称在 CoVR-R 挑战中有效,但具体指标与消融增益在给定片段中未充分说明。

Temporal Evidence Routing with Structured Visual Evidence for TimeLogicQA Figure 1
2026-06-02cs.CV

Temporal Evidence Routing with Structured Visual Evidence for TimeLogicQA

Yuyang Sun, Yongliang Wu, Xingyu Zhu, Yuxia Chen, Zhenxiang Jiang, Yangguang Ji, Wenbo Zhu, Yanxi Shi, Jay Wu, Shuo Wang, Xu Yang

Southeast University, National University of Singapore, University of Science and Technology of China‌

2026-06-02视觉感知

本文针对 TimeLogicQA 中视频问答容易把时序关系交给端到端直觉判断、从而混淆事件顺序与状态持续的问题,提出 Temporal Evidence Routing:先解析问题与时序算子,再按视频长短构造全帧或候选窗口证据,由 VLM 生成结构化事件区间,最后用确定性规则和保守融合给出答案。官方测试 AvgAcc 达到 81.8,但文中对各模块相对增益说明有限。

Adaptive Dense Evidence Refinement for Video Relational Reasoning for VRR-QA Challenge Figure 1
2026-06-02cs.CV

Adaptive Dense Evidence Refinement for Video Relational Reasoning for VRR-QA Challenge

Yuyang Sun, Yongliang Wu, Xingyu Zhu, Yuxia Chen, Zhenxiang Jiang, Yangguang Ji, Wenbo Zhu, Yanxi Shi, Jay Wu, Shuo Wang, Xu Yang

Southeast University, National University of Singapore, University of Science and Technology of China‌

2026-06-02视觉感知

VRR-QA要求模型在视频中判断空间、时间、深度、视角与遮挡等跨帧关系,单次视频问答容易压缩或误判关键证据。本文提出无需训练的自适应测试时推理:先直接作答,再用多视角找不稳定题,只对难例构建带时间戳的密集证据、关系探针和成对验证,并用风险门控决定是否改答案。最终测试AvgAcc达90.07、MacroAvgAcc达87.81,较直接Gemini提示的70.47有明显提升。

Dual-Route Top-K Retrieval with 1v1 VLM Reranking for the CoVR-R Figure 1
2026-06-02cs.CV

Dual-Route Top-K Retrieval with 1v1 VLM Reranking for the CoVR-R

Yuyang Sun, Yongliang Wu, Xingyu Zhu, Yuxia Chen, Zhenxiang Jiang, Yangguang Ji, Wenbo Zhu, Yanxi Shi, Jay Wu, Shuo Wang, Xu Yang

Southeast University, National University of Singapore, University of Science and Technology of China‌

2026-06-02视觉语言

面向 CoVR-R 中仅靠文本相似度难以处理状态变化、时序与禁忌内容的问题,论文将组合视频检索拆成“高召回候选构造”和“谨慎替换 top-1”两步:先用 VLM 推理/槽位选择稳住文本种子,再用 DFN 接触表视觉检索补足 top-10,最后以 1v1 VLM 复核和致命错误共识控制晋升。隐藏测试报告最高 95.28 R@1、99.66 R@50,但结论处数值与摘要不一致。

Chameleon: Style-Content Disentangled Framework for Cross-Domain Object Compositing Figure 1
2026-06-02cs.CV

Chameleon: Style-Content Disentangled Framework for Cross-Domain Object Compositing

Sukhun Ko, Soo Ye Kim, Jihyong Oh

2026-06-02视觉感知

跨域图像合成需要在保留前景物体身份的同时匹配背景风格,现有免训练混合方法常停留在色调对齐并导致身份漂移、过度风格化或缺少阴影。Chameleon 构建大规模真实监督数据集,并用 JHCL 解耦风格/内容、以 STAG 在 DiT 中调控风格注入。实验称其优于同域、跨域方法及商业模型,在构图合理性和风格一致性上均有提升。

Expanding Spatial and Temporal Context for Robotic Imitation Learning With Scene Graphs Figure 1
2026-06-02cs.RO

Expanding Spatial and Temporal Context for Robotic Imitation Learning With Scene Graphs

Jianing Qian, Qinhe Peng, Emmanuel Panov, Leonor Fermoselle, Dinesh Jayaraman, Bernadette Bucher, Tarik Kelestemur

University of Pennsylvania, RAI Institute, University of Michigan

2026-06-02机器人模仿学习

这篇论文针对家庭/办公室等大尺度、长时序任务中机器人视野受限导致模仿学习策略遗忘历史信息的问题,提出把任务相关物体及其关系维护为动态场景图,并作为结构化显式记忆输入扩散策略等模型。该表示只保留关键对象的视觉嵌入、2D框和3D位置,可随交互增量更新。仿真移动操作和真实桌面实验显示,在需长期推理和部分可观测泛化的场景中成功率显著提升,但方法依赖准确物体识别,拥挤或强动态环境仍可能受限。

A Multiscale Network with Supervised Contrastive Learning for Real-Time Facial Emotion Recognition Figure 1
2026-06-02cs.CV

A Multiscale Network with Supervised Contrastive Learning for Real-Time Facial Emotion Recognition

Rejoy Chakraborty, Archisman Adhikary, Chayan Halder, Payel Rakshit, Sanchita Ghosh, Kaushik Roy

2026-06-02视觉感知

该文面向视频/咨询场景中表情随时间连续变化、单帧识别难以反映心理状态的问题,提出 MSFERNet:以 EfficientNet-B0 早期层为骨干,结合残差、多尺度卷积、CBAM 注意力和监督对比学习,并开发 RT-FER 实时监测界面。实验在重构的 FER13 三类情绪与 CK+ 等数据上报告优于对比方法,但具体增益来源可能同时受类别合并与数据处理影响。

3DCodeBench: Benchmarking Agentic Procedural 3D Modeling Via Code Figure 1
2026-06-02cs.CV

3DCodeBench: Benchmarking Agentic Procedural 3D Modeling Via Code

Yipeng Gao, Lei Shu, Genzhi Ye, Xi Xiong, Ameesh Makadia, Meiqi Guo, Laurent Itti, Jindong Chen

University of Southern California

2026-06-02数据集/基准三维

面向用代码生成可编辑、可执行三维资产的需求,3DCodeBench试图弥补现有3D基准缺少程序代码、复杂几何与迭代评测的问题。其核心是从Infinigen整理26K文本/图像—代码—3D对象三元组、覆盖212类,并结合自动指标与3DCodeArena人类偏好Elo评测12个VLM。结果显示失败多来自API不匹配,即便可渲染也常有悬浮或断裂部件;更高思考预算和多轮反馈能提升表现,增益可能主要来自scaling和执行环境反馈。

TextFake: Benchmarking AI-Generated Image Detection on Text-Rich Images Figure 1
2026-06-02cs.CV

TextFake: Benchmarking AI-Generated Image Detection on Text-Rich Images

Yuning Zhang, Changtao Miao, Mingyu Liao, Tingyu Liu, Xinghao Wang, Tao Gong, Qi Chu, Nenghai Yu

School of Cyber Science and Technology, University of Science and Technology of China, Anhui Province Key Laboratory of Digital Security

2026-06-02视觉感知数据集/基准

针对伪造截图、文档和新闻页等文本密集图像在现有 AIGI 检测基准中缺位的问题,本文构建 TextFake:含 2 万张、28 种语言、两类场景和四类主题,并通过分布对齐的四阶段生成流程减少捷径。对 14 个检测器和 3 个前沿 VLM 零样本评测显示,最高准确率仍低于 80%,平均性能较自然图像基准大幅下降,失败主要来自高文本密度、渲染保真度提升和常见扰动导致的阈值崩塌。

Decoupled Residual Denoising Diffusion Models for Unified and Data Efficient Image-to-Image Translation Figure 1
2026-06-02cs.CV

Decoupled Residual Denoising Diffusion Models for Unified and Data Efficient Image-to-Image Translation

Ziyue Lin, Jiahe Hou, Hongyu Xia, Xinrui Xie, Feifei Wang, Yuyin Zhou, Wei Wang, Jiawei Liu, Liangqiong Qu

The University of Hong Kong, Shenyang Institute of Automation, Chinese Academy of Sciences, The Chinese University of Hong Kong, University of California, Santa Cruz

2026-06-02视觉感知生成模型

面向多任务图像到图像翻译中域差大、配对数据少的问题,论文指出扩散噪声除流形提升外还能缩小跨域特征差距,但传统反向过程会同时去噪和去残差而提前削弱这一作用。DRDD将过程拆成目标域无配对数据训练的噪声扩散与固定噪声域内的确定性残差扩散,使语义映射始终受域协调保护;理论和实验表明其可兼容DDPM、DDIM和SDE框架,在有限配对数据下仍能实现较稳健的统一I2I翻译。

Ask4VG: Risk-Aware Question Selection for Reducing Prior-Driven Answers in Medical VQA Figure 1
2026-06-02cs.CV

Ask4VG: Risk-Aware Question Selection for Reducing Prior-Driven Answers in Medical VQA

Xiaorong Zhu, Qiang Li, Zibo Xu, Weijie Wang, Weizhi Nie

2026-06-02安全鲁棒

医学VQA中大量模板化问题容易让模型依赖语言先验而非影像证据,带来临床幻觉风险。Ask4VG将问题表述视为可控因素,通过原图、扰动图、空白图和错配图的反事实探测估计问题诱发风险,并用该风险重排保意图的改写问题。VQA-RAD上风险由0.658降至0.623,准确率由0.337升至0.356,PMC-VQA小样本外部检查也显示同向小幅增益。

Temporally-Aligned Evaluation for Audio-Driven Talking Head Generation Figure 1
2026-06-02cs.GR

Temporally-Aligned Evaluation for Audio-Driven Talking Head Generation

Zhicheng Zhang, Lei Wang, Yu Zhang, Yongsheng Gao

2026-06-02数据集/基准

针对音频驱动说话头评测过度依赖逐帧对齐、易把可接受的语速和相位差误判为质量问题,论文将评测重构为序列轨迹对齐问题,把 Soft-DTW 接入感知、身份、同步等既有指标。在20种方法、7个数据集上的统一基准显示,时序对齐指标对时间偏移更稳健,跨数据集结果更一致,也更清楚揭示同步与真实感、表现力与稳定性之间的范式差异。

Data Collection for Training Quality-Control AI in Carpet Manufacturing Figure 1
2026-06-02cs.CV

Data Collection for Training Quality-Control AI in Carpet Manufacturing

Akbar Erkinov

2026-06-02规划控制

针对地毯产线扩产后人工质检速度慢、主观且漏检会放大瓶颈的问题,论文提出一套在线机器视觉与数据采集一体化方案:用同步线扫相机和复合照明覆盖多米幅宽,并把缺陷采集、人工标注飞轮、从无监督异常检测到监督分类/检测/分割的模型演进纳入系统设计。主要结果是给出可部署蓝图和六西格玛口径下的DPMO/过程sigma收益映射,但文中未充分说明真实产线实测精度与经济增益。

ProductWebGen: Benchmarking Multimodal Product Webpage Generation Figure 1
2026-06-02cs.CV

ProductWebGen: Benchmarking Multimodal Product Webpage Generation

Zhihong Liu, Siqi Kou, Zheng Li, Ye Ma, Quan Chen, Peng Jiang, Kai Yu, Zhijie Deng

School of Computer Science, Shanghai Jiao Tong University, School of Computer Science &, Zhiyuan College Shanghai Jiao Tong University Shanghai China, Shanghai Jiao Tong University Shanghai China

2026-06-02视觉语言数据集/基准

面向电商营销中由单张商品图和布局/视觉指令生成可渲染展示网页的需求,ProductWebGen提出含500个测试样本、13类商品的多模态网页生成基准,并比较LLM+图像编辑与统一多模态模型两类流程。结果显示,编辑式方法更擅长网页指令遵循、内容吸引力和图像感知质量,统一模型在跨图视觉一致性上更有优势;Gemini-2.5-Flash-Image总体最佳,开源统一模型仍有明显差距,1k SFT数据可显著提升BAGEL。

Learning Neural Deformation Representation for 4D Dynamic Shape Generation Figure 1
2026-06-02cs.CV

Learning Neural Deformation Representation for 4D Dynamic Shape Generation

Gyojin Han, Jiwan Hur, Jaehyun Choi, Junmo Kim

2026-06-02视觉感知

针对现有4D动态形状生成将形状与运动混在占据场中、导致逐帧网格提取慢且时序不一致的问题,本文提出分离形状与运动潜空间的神经变形表示:用条件SDF建模形状,并通过多部件蒙皮权重与刚体变换连续表示运动,再在编码潜向量上训练扩散模型。实验显示其在无条件生成的多样性、时序一致性和渲染效率上优于HyperDiffusion,并支持点云条件生成与运动迁移,但数据规模较小仍限制潜空间学习。

Cross-Axis Feature Fusion with Joint-Wise Motion Difference Prediction for Text-Based 3D Human Motion Editing Figure 1
2026-06-02cs.CV

Cross-Axis Feature Fusion with Joint-Wise Motion Difference Prediction for Text-Based 3D Human Motion Editing

Gyojin Han, Junmo Kim

School of Electrical Engineering, KAIST

2026-06-02三维

本文针对文本驱动三维人体动作编辑中“何时改”之外缺少“改哪些关节”的问题,提出关节轴与时间轴两个锚定 Transformer,并用跨轴融合为扩散编辑模型提供条件;同时以源/目标关节旋转轨迹的 Soft-DTW 距离做关节级差异预测辅助监督。MotionFix 实验和消融显示,该设计提升了文本语义对齐、源动作保留与生成质量,达到文中报告的 SOTA。

Automated Erythrocyte Detection and Tracking for Retinal Blood Flow Quantification in Erythrocyte-Mediated Angiography Figure 1
2026-06-02cs.CV

Automated Erythrocyte Detection and Tracking for Retinal Blood Flow Quantification in Erythrocyte-Mediated Angiography

Chiao-Yi Wang, Havish S Gadde, Yi-Ting Shen, Saige M. Oechsli, Osamah Saeedi, Yang Tao

2026-06-02视觉感知生成模型

论文关注 EMA 视网膜成像中红细胞需人工识别与跟踪、难以规模化量化毛细血管血流的问题。作者提出 EMTrack:用结合连续帧运动上下文的 FlowContext-DINO 区分运动与暂停红细胞,并重建血管拓扑以约束 Dijkstra 式关联,处理大帧间位移和速度突变;同时发布带检测/跟踪标注的 RBF-EMA 数据集。实验显示其在该数据集上的检测与跟踪均优于基线,并可用于自动化 RBF 定量。

SWARD: Stochastic Window-Attention-Based Relational Distillation for Cross-Architectural Semantic Segmentation Figure 1
2026-06-02cs.CV

SWARD: Stochastic Window-Attention-Based Relational Distillation for Cross-Architectural Semantic Segmentation

Aditya Makineni, Qing Tian

2026-06-02视觉感知

SWARD针对语义分割中Transformer基础模型教师与轻量CNN学生的结构错配,避免直接特征模仿失效。其核心是用随机偏移的多尺度窗口注意力蒸馏对齐局部与长程关系,并加入原型判别正则提升类内紧凑和类间分离。论文在城市场景解析和医学分割实验中报告达到SOTA,显示学生能更完整定位目标。

An Open-Source Benchmark and Baseline for Multi-temporal Referring Segmentation Figure 1
2026-06-02cs.CV

An Open-Source Benchmark and Baseline for Multi-temporal Referring Segmentation

Bingyu Li, Da Zhang, Tao Huo, Zhiyuan Zhao, Junyu Gao, Xuelong Li

2026-06-02视觉感知数据集/基准

现有指代表达分割多处理单时刻图像,难以满足监控、遥感等场景中“按语言找到某个变化区域”的需求。本文提出多时相指代分割 MTRS,构建含 2.1 万图文掩码三元组的 MTRefSeg-21K,并用 CRAFT-Agent 自动生成加人工审核;同时设计两阶段训练的变化感知 LVLM MTRefSeg-R1,先学双时相变化感知再做语言引导掩码微调。实验显示通用 VLM/LVLM 直接推理表现较差,而该方法在多设置下优于现有基线。

Flexible Control of 3D CT Generation via Text and Semantically-Defined Segmentation Prompts Figure 1
2026-06-02cs.CV

Flexible Control of 3D CT Generation via Text and Semantically-Defined Segmentation Prompts

Weicheng Dai, Chenyu Wang, Andy Li, Shantanu Ghosh, Kayhan Batmanghelich

2026-06-02视觉感知规划控制三维

本文针对高分辨率3D CT生成中“文本提示灵活但空间控制弱、分割提示精确但需全器官标注”的矛盾,提出可同时或单独使用放射报告与语义定义分割掩码的多模态DiT框架,通过统一图像/掩码token化与门控注意力处理长报告。实验显示其在感知和语义指标上达到SOTA,平均FID相对提升约24%,生成体数据解剖一致,并可用于数据增强;但部分增益可能来自架构与数据规模共同作用。

Reasmory: 3D Reconstruction as Explicit Memory for VLMs Spatial Reasoning Figure 1
2026-06-02cs.CV

Reasmory: 3D Reconstruction as Explicit Memory for VLMs Spatial Reasoning

Jixuan He, Xueting Li, Chieh Hubert Lin, Ming-Hsuan Yang

2026-06-02视觉语言三维

针对多视角图像和单目视频中空间线索稀疏、冗余且难以被 VLM 稳定组织的问题,Reasmory 将三维重建结果作为显式空间记忆,并用语义化 3D 对象实例与轻量 DSL 约束查询、视角变换和渲染,避免自由工具调用中的漏用和误用。实验显示其在多视角图像与视频空间推理基准上较 GPT-5-mini、Gemini-3-flash 等强基线提升约 6–18%。

Boundary-Protection W8A8 HiFloat8 Quantization for Large-Scale Text-to-Video Diffusion Transformers Figure 1
2026-06-02cs.CV

Boundary-Protection W8A8 HiFloat8 Quantization for Large-Scale Text-to-Video Diffusion Transformers

Yiming Zhao

2026-06-02视觉感知生成模型学习理论

为降低大规模文生视频 DiT(Wan2.1-T2V-14B)在昇腾 910B 上的显存与推理成本,论文指出各 Transformer 块激活分布高度异质,首尾边界块对量化误差最敏感。方法保留第 0、1、37、38、39 块为 BF16,其余 35 块采用 W8A8 HiFloat8 后训练量化。5 个提示词上的 VBench 结果显示其在五项指标上匹配或略超 BF16,消融支持完整边界保护;但评测规模较小,统计结论仍需更大测试验证。

COLLAR: Cascaded Object-Level Latent Refinement for High-Fidelity Conditional Generation Figure 1
2026-06-02cs.CV

COLLAR: Cascaded Object-Level Latent Refinement for High-Fidelity Conditional Generation

Xinlong Zhang, Jia Wei, Xiaoyu Zhang, Teng Zhou, Chengyu Lin, Yongchuan Tang

College of Computer Science, Zhejiang University

2026-06-02视觉感知

针对扩散 Transformer 在多物体、局部小区域条件生成中易出现属性泄漏、伪影和空间控制不稳的问题,COLLAR提出无需训练的级联潜变量细化框架:通过扩展视野分支承接局部目标特征,结合跨尺度语义对齐与循环特征注入,将背景上下文和目标语义自适应融合到全局生成过程。在 COCO-MIG 与 COCO-POS 上,方法在语义对齐、图像质量和空间保真度上均优于现有基线。

One Channel to Rule Them All: Rethinking Input Representation for Visual Place Recognition Figure 1
2026-06-02cs.CV

One Channel to Rule Them All: Rethinking Input Representation for Visual Place Recognition

Timur Ismagilov, Shakaiba Majeed, Michael Milford, Tan Viet Tuyen Nguyen, Sarvapali D. Ramchurn, Shoaib Ehsan

School, Computer Science, University of Southampton, SO17 1BJ Southamp-, Department, University, Michael Milford is with the QUT Centre for Robotics, School of, Shoaib Ehsan is also with the School of Computer Science and, Electronic Engineering, University of Essex, Colchester, CO4 3SQ, U.K.

2026-06-02视觉感知

论文质疑视觉地点识别长期默认使用 RGB 的必要性,系统比较多种 VPR 模型、预训练方式与 RGB/灰度训练设置。核心洞察是全局地点检索主要依赖结构与亮度,颜色只在稳定且有辨识度的色彩线索存在时有用,外观剧烈变化下反而可能干扰。实验中灰度训练的 MixVPR 平均 Recall@1 达 82.4%,高于 RGB 的 81.2%,且部分轻量灰度模型可胜过更大的 RGB 模型,同时降低存储、带宽与部署成本。

CV-Arena: An Open Benchmark for Instructional Computer Vision Problem Solving with Human-AI Collaborative Preferences Figure 1
2026-06-02cs.CV

CV-Arena: An Open Benchmark for Instructional Computer Vision Problem Solving with Human-AI Collaborative Preferences

Fangzhou Lin, Peiran Li, Lingyu Xu, Wenjing Chen, Qianwen Ge, Shuo Xing, Mingyang Wu, Xiangbo Gao, Siyuan Yang, Kazunori Yamada, Ziming Zhang, Haichong Zhang, Zhen Dong, Ming-Hsuan Yang, Zhengzhong Tu

Texas A&M University, Worcester Polytechnic Institute, Tohoku University, Georgia Institute of Technology

2026-06-02视觉感知数据集/基准

现有指令式图像编辑基准多停留在外观/风格修改,难以覆盖真实专业流程中的高分辨率修复、几何、物理一致性与文字恢复等约束。CV-Arena 将问题扩展为 iCVPS,构建 12K 真实高分辨率、16 类任务数据,并用 Active Elo 结合 VLM 评审与专家偏好评估。对 21 个系统的测试显示,当前模型在指令遵循、物理推理、结构控制和细节保真上仍有明显缺口;其 CV-Agent 结果表明闭环规划与验证有助于提升约束满足。

Single-Channel Tissue Segmentation via Cross-Modal Distillation from Foundation Models Figure 1
2026-06-02cs.CV

Single-Channel Tissue Segmentation via Cross-Modal Distillation from Foundation Models

Sakib Mohammad, Jarin Ritu, Md Sakhawat Hossain

Department of Engineering Technology, Fairmont State University, Department of Electrical and Computer Engineering, Texas A&M University, College Station, TX, USA, Department of Mechanical Engineering, Auburn University

2026-06-02视觉感知

针对多通道荧光显微分割依赖核与膜等全部通道、难以在缺失通道或低资源场景部署的问题,论文用冻结的 SAM/CellSAM 多通道教师向仅看核通道的轻量 U-Net 学生做跨模态蒸馏,并结合概率匹配、边界监督与不确定性加权。在 TissueNet 上,SAM 蒸馏的 Swin-Tiny Dice 达 78.36,比无蒸馏高 13.05 点,约恢复教师性能的 87.9%;四种学生均提升约 12 点,BBBC038 跨数据集也有增益。

Bridging Topology and Deep Representation Learning: A TDA-ViT Fusion Model for Four-Class Brain Tumor Classification Figure 1
2026-06-02cs.CV

Bridging Topology and Deep Representation Learning: A TDA-ViT Fusion Model for Four-Class Brain Tumor Classification

Faisal Ahmed

2026-06-02视觉感知

针对ViT在脑肿瘤MRI分类中偏重语义与全局上下文、可能忽略肿瘤形状连通性等拓扑结构的问题,论文提出将TDA持久同调等拓扑描述子与预训练ViT特征融合,用于胶质瘤、脑膜瘤、垂体瘤和无肿瘤四分类。在BRISC2025上报告99.10%准确率、99.98%AUC,优于ResNet、EfficientNet和单独ViT;但具体增益来源与泛化验证仍需更多说明。

Reason, Retrieve, Re-rank: A Zero-Shot Reasoning-Aware Framework for Composed Video Retrieval Figure 1
2026-06-02cs.CV

Reason, Retrieve, Re-rank: A Zero-Shot Reasoning-Aware Framework for Composed Video Retrieval

Ali Alavi

The Ohio State University

2026-06-02视觉感知三维

该文针对零样本、推理感知的组合视频检索:给定参考视频和隐含编辑指令,需找出符合后效变化的目标视频。核心做法是R3-CoVR,用冻结Qwen3-VL先推理状态、动作、镜头等后效并生成短描述,再由SigLIP-2召回,最后让多模态模型作约束裁判重排候选;关键洞察是描述长度需匹配文本窗口,且重排贡献最大。挑战测试集上达到91.9% R@1、98.2% R@10。

hZACH-ViT: Curved Latent Geometry for Compact Vision Transformers in Low-Data Medical Imaging Figure 1
2026-06-02cs.CV

hZACH-ViT: Curved Latent Geometry for Compact Vision Transformers in Low-Data Medical Imaging

Athanasios Angelakis

2026-06-02视觉感知

针对低数据、资源受限医学影像中紧凑 ViT 默认欧氏潜空间可能不合适的问题,论文在保持 ZACH-ViT 主干不变的前提下,仅替换最终表示空间与原型分类头,比较 Poincaré、Klein 与球面几何及曲率。7 个 MedMNIST 少样本任务、770 次训练显示,最佳非欧配置均优于欧氏基线,平均提升 0.021;但最优几何和曲率随数据集变化,低曲率较常胜出。

MMDG-Bench: A Benchmark for Multimodal Domain Generalization Figure 1
2026-06-02cs.CV

MMDG-Bench: A Benchmark for Multimodal Domain Generalization

Qianshan Zhan, Qian Wang, Da Li, Xiao-Jun Zeng, Xiatian Zhu

2026-06-02视觉语言学习理论数据集/基准

针对多模态学习与域泛化长期割裂、现有多模态域泛化评测集中在动作识别且协议不统一的问题,MMDG-Bench提出D2M与M2D两种组合框架,并在视频-音频-光流动作识别及RGB-Depth-IR人脸反欺骗上统一评测。实验显示,将五类DG方法与统一MML配置组合的十个基线常超过既有方法;关键洞察是DG带来更稳定增益,D2M/M2D优劣取决于跨域模态关系是否稳定,强骨干会放大收益。

Cohort-Scale Neural Atlases of Ultrasound Video Figure 1
2026-06-02cs.CV

Cohort-Scale Neural Atlases of Ultrasound Video

Zhuorui Zhang, Roger Pallarès-López, Xuan Wu, Praneeth Namburi, Brian W. Anthony

Department of Mechanical Engineering, MIT, Institute for Medical Engineering and Science, MIT, MIT.nano Immersion Lab, MIT

2026-06-02视觉感知

超声视频的逐帧专家标注昂贵,且斑点噪声、阴影和探头姿态差异使跨帧跨个体对应困难。本文将群体图谱思想扩展到超声视频,在 DINOv3 特征空间联合学习共享规范坐标图和每视频 GLO 嵌入,以分离解剖结构与采集外观变化。实验覆盖心脏与肌骨五个数据集,在 EchoNet-Dynamic 和 MSK-Bone 上实现有竞争力的单/少样本标注迁移,并可在单张消费级 GPU 上数分钟训练,潜空间也显示一定可解释性。

GABI: Geometry-Aware Boundary Integration for Spacecraft Segmentation Figure 1
2026-06-02cs.CV

GABI: Geometry-Aware Boundary Integration for Spacecraft Segmentation

Iason Georgios Velentzas, Dhruv Ahuja, Panagiotis Tsiotras

Georgia Institute of Technology

2026-06-02视觉感知学习理论

空间强光照、阴影和背景变化使航天器分割难以跨目标泛化,而机载感知又要求模型轻量。GABI的核心是在卷积分割骨干上加入距离场预测头,用由掩码生成的连续边界几何监督约束特征,并以边界权重调制分割。实验显示其在SPARK上较基线AP提升最高约5%,泛化实验AP提升超过50%;轻量版接近重型Transformer且参数约小10倍,重型版性能超过Transformer且更轻。

Images as Tables: In-Context Learning with TabPFN for Low-Data Detection of AI-Generated Images Figure 1
2026-06-02cs.CV

Images as Tables: In-Context Learning with TabPFN for Low-Data Detection of AI-Generated Images

Jan Philip Walter, Shashank Agnihotri, Margret Keuper

2026-06-02视觉感知

针对AI生成图像检测中新生成器不断出现、标注样本稀缺且跨生成器易失效的问题,论文把图像先经冻结DINOv3提取CLS特征、PCA降到500维,再交给TabPFN做上下文表格推理,将适配从微调分类器转为更换少量标注上下文。在GenImage上,LATTE在大规模混合训练时仍领先7.4%,但该方法在低数据和跨生成器迁移场景最高超过LATTE 8.2%。

Benchmarks for Vision-Language Models in Urban Perception Should Be Reliability-Aware and Negotiated Figure 1
2026-06-02cs.CV

Benchmarks for Vision-Language Models in Urban Perception Should Be Reliability-Aware and Negotiated

Rashid Mushkani

2026-06-02视觉语言视觉感知数据集/基准

论文关注VLM用于街景审计、制图和公众咨询时,传统基准把主观城市感知压成单一真值会掩盖分歧与弃答。作者提出可靠性感知、可协商的评测框架,将标注者一致性、弃答率和标签/打分政策一并报告,并用100张蒙特利尔街景、30个维度、12名社区参与者评测7个零样本VLM。结果显示模型与人类共识的对齐度随维度级人类可靠性共同变化,在“总体印象”等评价维度存在分布错配和Not applicable比例差异。

RefDiffNet: Learning to Expose Subtle PCB Defects Before Detection Figure 1
2026-06-02cs.CV

RefDiffNet: Learning to Expose Subtle PCB Defects Before Detection

Vinay Edula, Nilesh Badwe, Priyanka Bagade

2026-06-02视觉感知三维

针对微小 PCB 缺陷易被复杂走线背景淹没、现有检测器常忽略无缺陷参考图的问题,RefDiffNet 将经典模板比对思想做成检测器前的轻量增强模块:对齐缺陷图与 golden template,经局部对比归一化、Haar/残差/形态学线索和门控编码生成突出缺陷的 RGB 修正图。HRIPCB 与 DeepPCB 上,该模块可插接 YOLO、RT-DETR、Faster R-CNN 等,最高带来 18% 相对 mAP50:95 增益,额外参数仅约 0.004–0.005M。

MoEIoU: Rethinking Bounding-Box Regression as a Mixture of Experts Figure 1
2026-06-02cs.CV

MoEIoU: Rethinking Bounding-Box Regression as a Mixture of Experts

Vinay Edula, Priyanka Bagade

Department of Computer Science and, Indian Institute of Technology Kanpur, center-distance and aspect-ratio mismatch, to improve bounding-box regression. How-, optimization dynamics in which predicted boxes initially exhibit large center-distance, loss that jointly models overlap, center alignment, and aspect-ratio mismatch. MoEIoU, DIoU resolved this by introducing a normalized center-distance penalty that directly guides, from geometric cues such as center distance and aspect-ratio mismatch, while later stages, its mixture-of-experts [9] design, where each component —log-IoU, center distance, and

2026-06-02学习理论

本文针对边界框回归中 IoU 类损失常以固定加和方式处理重叠、中心距离和形状误差、难以匹配训练阶段变化的问题,提出 MoEIoU:将三类定位误差视作专家,用加权 log-sum-exp 自适应突出当前主导误差,并通过课程权重从早期几何校正逐步转向后期重叠精修。作者在 PASCAL VOC、HRIPCB、MS COCO 子集及多种 YOLO 上报告了更快收敛和更高定位精度,可作为无需改结构的替换损失。

The Right Inference Strategy Is All You Need: Nearly Training-Free Domain-Wise Inference for EgoCross Challenge Figure 1
2026-06-02cs.CV

The Right Inference Strategy Is All You Need: Nearly Training-Free Domain-Wise Inference for EgoCross Challenge

Leyi Wu, Yifan Zhao, Jinjie Zhang, Yinchuan Li, Ying-Cong Chen

2026-06-02强化学习

该文面向 EgoCross 源受限赛道中手术、工业、极限运动和动物视角视频带来的强域移问题,指出瓶颈不一定是 Qwen3-VL-4B 缺乏能力,而是推理接口与任务格式错配。方法几乎不训练模型,而是按领域设计帧组织、提示、问题路由和答案归一化;手术与动物用冻结基座,工业和 XSports 仅用官方 20 样本两轮 SFT。最终总准确率达 66.98%,显示领域感知推理可在有限数据下显著释放基座模型已有能力。

RoboStressBench: Benchmarking VLM Robustness to Physical Visual Stress in Embodied Scenes Figure 1
2026-06-02cs.CV

RoboStressBench: Benchmarking VLM Robustness to Physical Visual Stress in Embodied Scenes

Leyi Wu, Yifan Zhao, Jinjie Zhang, Suzeyu Chen, Wosong Chen, Zhifei Chen, Tianshuo Xu, Qingchun He, Hongxin Hu, Haojian Huang, Yangkai Wei, Wenqian Li, Yinchuan Li, Ying-Cong Chen

2026-06-02视觉语言数据集/基准安全鲁棒

面向具身机器人在透明材质、遮挡、低照度和异常视角等真实场景中的感知失效,本文提出 RoboStressBench,用逆图形/成像因素将物理视觉压力划分为材质、视角、光照、几何四类,并通过筛选、合成与实拍构建约 7.2K 样本评测 VLM。对 16 个模型的结果显示,物理压力会显著拉低性能且失效具有任务相关性:几何更伤定位和空间推理,材质与光照更影响识别和状态理解;StressDART 通过压力检测与视觉校正带来一定测试时鲁棒性增益。

SuperMemory-VQA: An Egocentric Visual Question-Answering Benchmark for Long-Horizon Memory Figure 1
2026-06-02cs.CV

SuperMemory-VQA: An Egocentric Visual Question-Answering Benchmark for Long-Horizon Memory

Samiul Alam, Shakhrul Iman Siam, Michael J. Proulx, James Fort, Richard Newcombe, Hyo Jin Kim, Mi Zhang

The Ohio State University

2026-06-02数据集/基准

面向 AI 眼镜作为个人记忆助手时需跨天、跨场景回答真实记忆问题的需求,SuperMemory-VQA 提供 52.9 小时多模态第一视角数据和 4,853 个经人工验证的多选问答,覆盖物体位置、意图、时间线、对话等长期记忆任务,并加入不可回答选项检验幻觉。对 Video-RAG、EgoButler 等系统的评测显示,现有模型在可答性判断、长时检索和多证据整合上仍明显不可靠。

Directed Distance Fields for Constant-Time Ray Queries on Gaussian Splatting Figure 1
2026-06-02cs.GR

Directed Distance Fields for Constant-Time Ray Queries on Gaussian Splatting

Subhankar MIshra

S. Mishra is with the School of Computer Sciences, National Institute of

2026-06-02三维

3D Gaussian Splatting 只能高效回答相机主光线,难以支持阴影、环境光遮蔽和全局光照所需的任意二次光线。本文将训练好的 3DGS 蒸馏为 Directed Distance Function,用一次小网络前向直接预测光线首个交点距离与可见性,避免 BVH 随高斯数量增长或 SDF 球追踪多步查询。实验显示其固定约 52MB,查询比等价 SDF 球追踪快 26–72 倍,并在 142 个物体上复现阴影 30.3dB、AO 21.3dB;但质量依赖干净距离监督,mesh-free 场景的薄结构仍受神经表面误差限制。

Generative Diffusion Priors for 3D Mapping of the Dark Universe Figure 1
2026-06-02astro-ph.CO

Generative Diffusion Priors for 3D Mapping of the Dark Universe

Brandon Zhao, Diana Scognamiglio, Olivier Doré, Katherine L. Bouman

Department of Computing and Mathematical Sciences, California Institute of Technology, Jet Propulsion Laboratory, California Institute of Technology, Department of Physics, Duke University, Cahill Center for Astronomy and Astrophysics, California Institute of Technology

2026-06-02生成模型三维

本文针对弱引力透镜下从单一视线、带噪星系形变中恢复三维暗物质分布的病态问题,利用高分辨率 N-body 模拟构建 Conicus3D 光锥数据集,并训练红移条件扩散先验,与可微物理前向模型结合进行后验采样。实验在类 COSMOS-Web 模拟上显示,其二维/三维重建相关性和小尺度结构保真度优于 Wiener 滤波与神经集成基线,样本统计更接近真实模拟,且对中等宇宙学偏移仍较稳健。

DASH: Dual-Branch Score Distillation for Guidance-Calibrated Compact Diffusion Models Figure 1
2026-06-02cs.CV

DASH: Dual-Branch Score Distillation for Guidance-Calibrated Compact Diffusion Models

Abdullah Al Shafi, Kazi Saeed Alam, Sk Imran Hossain, Engelbert Mephu Nguifo

Khulna University of Engineering & Technology, Bangladesh, University Clermont Auvergne, France

2026-06-02生成模型

DASH关注CFG条件扩散模型做参数压缩时的结构性失效:只蒸馏条件或合成引导输出会让无条件分支欠约束,学生的guidance gap可能塌缩。其核心是分别监督条件/无条件score,并加入条件噪声锚定与教师TIRT时间步课程迁移。CIFAR-10/100上约5.9倍压缩后50步DDIM FID距教师小于4,无条件监督贡献超过60%增益,但实验仍限于32×32分类生成。

MBench: A Comprehensive Benchmark on Memory Capability for Video World Models Figure 1
2026-06-02cs.CV

MBench: A Comprehensive Benchmark on Memory Capability for Video World Models

Shengjun Zhang, Zhang Zhang, Simin Huang, Zhenyu Tang, Hanyang Wang, Chensheng Dai, Min Chen, Yifan Li, Yuxin Li, Yingjie Chen, Hao Liu, Chen Li, Yueqi Duan

2026-06-02视觉感知强化学习数据集/基准

现有视频世界模型评测多关注画质、运动和文本对齐,难以衡量机器人交互所需的长期状态记忆。MBench将记忆拆为实体、环境、因果一致性三层共12个可量化维度,基于真实长视频并结合规则指标与VLM评估。对8个文本条件和6个动作条件模型的测试显示,主流方法在长期状态保持上存在系统性短板。

DINO-GFSA: Geo-Localization via Semantic Gated Fusion and Mamba-based Sequential Aggregation Figure 1
2026-06-02cs.CV

DINO-GFSA: Geo-Localization via Semantic Gated Fusion and Mamba-based Sequential Aggregation

Beier Hu, Yuanshen Guo, Jialu Cai, Chengwei Li, Yong Wang, Shunan Wu, Zhigang Wu

School of Aeronautics and Astronautics, Sun Yat-sen University, Shenzhen, China

2026-06-02视觉感知

本文面向 GNSS 受限场景下无人机跨视角地理定位,针对 UAV 与卫星图像视角差异大、语义与细粒度空间信息难兼顾的问题,提出 DINO-GFSA:用 LoRA 高效适配 DINOv3 ViT-L,借语义门控残差融合筛选低层几何线索,并以 Mamba 顺序聚合建模长程空间依赖。实验在 University-1652 与 DenseUAV 达到 SOTA,DenseUAV Recall@1 较此前最佳提升 3.48%。

FlowOVD: Learning Generative Latent Flows for Zero-shot Open-vocabulary Detection Figure 1
2026-06-02cs.CV

FlowOVD: Learning Generative Latent Flows for Zero-shot Open-vocabulary Detection

Yao Wei, Andrea Cavallaro, Changjae Oh

Queen Mary University of London 2 EPFL

2026-06-02视觉感知生成模型

FlowOVD针对开放词汇检测中解码查询依赖静态嵌入或Top-K启发式选择、语义多样性不足的问题,将查询初始化改写为潜空间中的文本条件连续输运过程,并用rectified flow把文本无关查询逐步生成语义对齐查询。无需额外数据,在COCO达49.5 AP、LVIS达31.5 AP,较GroundingDINO分别提升1.2和4.1 AP,长尾LVIS收益更明显。

GIRL-DETR: Gradient-Isolated Reinforcement Learning for Video Moment Retrieval Figure 1
2026-06-02cs.CV

GIRL-DETR: Gradient-Isolated Reinforcement Learning for Video Moment Retrieval

Shihang Zhang, Mingjin Kuai, Ye Wei, Zhen Zhang, Wei Ji

2026-06-02视觉感知强化学习优化算法

本文针对视频时刻检索中监督代理损失与 tIoU 等不可微指标不一致导致的后期停滞和排序退化问题,提出 GIRL-DETR:先用 CMI/TGG 建立跨模态对齐,再冻结骨干、仅让检测头通过三阶段梯度隔离强化学习直接优化 tIoU。实验在 Charades-STA、QVHighlights、TACoS 上显示,该策略以较少参数更新提升定位精度,并可迁移到多种 VMR 基线。

Head-Pose-Aware Visual Speech Recognition with FiLM Modulation Figure 1
2026-06-02cs.CV

Head-Pose-Aware Visual Speech Recognition with FiLM Modulation

Matthew Kit Khinn Teng, Haibo Zhang, Takeshi Saitoh

2026-06-02视觉感知三维

该文针对视觉语音识别中非正脸姿态造成的唇部几何畸变、遮挡及视素歧义,提出将头部姿态作为显式条件信号而非仅靠归一化或语言上下文弥补。方法在2D CNN前端后加入姿态条件残差FiLM调制,并用预训练NLLB完成音素到文本重建。LRS2/LRS3上WER为25.0%/33.2%,消融显示单个FiLM块可稳定降低错误率,深层调制对偏航角大于30°样本更有效。

SkyShield: Occupancy as a Safety Interface for Low-Altitude UAV Autonomy Figure 1
2026-06-02cs.CV

SkyShield: Occupancy as a Safety Interface for Low-Altitude UAV Autonomy

Jie Gao, Jie Ma, Kaihui Lin, Kai Ye, Miaohui Zhang, Pingyang Dai, Liujuan Cao

Xiamen University, Jiangxi Academy of Sciences

2026-06-02安全鲁棒

论文针对20米以下城市低空无人机中细小障碍、遮挡和动态姿态使传统2D/框标注及车载占用基准难以支撑安全飞行的问题,提出CARLA仿真的SkyShield数据集,含3.6万前视单目样本、逐帧6-DoF位姿/相机几何和前视体素语义占用;同时给出按可达性与碰撞时间加权的KAR-mIoU及几何优先基线SkyOcc。主要结果是建立了新的安全评测与基线框架,具体性能增益文中未充分说明。

Scaling Parallel Sequence Models to Foundation-Scale Vision Encoders Figure 1
2026-06-02cs.CV

Scaling Parallel Sequence Models to Foundation-Scale Vision Encoders

Yitong Jiang, Hongjun Wang, Collin McCarthy, Hanrong Ye, David Wehr, Xinhao Li, Qi Dou, Tianfan Xue, Ka Chun Cheung, Simon See, Wonmin Byeon, Ke Chen, Kai Han, Jinwei Gu, Hongxu Yin, Pavlo Molchanov, Jan Kautz, Sifei Liu

The Chinese University of Hong Kong, The University of Hong Kong, University of California, San Diego

2026-06-02视觉感知

本文针对视觉基础模型中自注意力随分辨率二次增长、限制高分辨率预训练与推理的问题,将保留二维空间结构的 GSPN 扩展为 C-GSPN。核心在于同时优化系统、结构和训练:用融合 CUDA 线扫描核提升硬件效率,在压缩潜空间中传播以降低块开销,并通过两阶段跨算子蒸馏从注意力教师迁移。结果显示其较原 GSPN 核快 40–52 倍,600M 图文对蒸馏后以少 15% 参数匹配 ViT,ADE20K 提升 2.1%,2K 下块级推理约 4 倍加速。

SORA: Free Second-Order Attacks in Fast Adversarial Training Figure 1
2026-06-02cs.LG

SORA: Free Second-Order Attacks in Fast Adversarial Training

Mazdak Teymourian, Ramtin Moslemi, Farzan Rahmani, Mohammad Hossein Rohban

2026-06-02视觉感知

该文针对单步快速对抗训练中常见的灾难性过拟合问题:模型对FGSM表现良好却在PGD等多步攻击下鲁棒性崩塌。作者提出“Epsilon Overfitting”解释固定扰动幅度/方向的风险,并用PertAlign低成本预测过拟合,再以SORA按损失几何自适应调整步长。实验称其在多数据集和架构上用固定超参数避免CO,兼顾更高干净精度、鲁棒性与训练效率。

CASTLE2026 Team WDL Technical Report Figure 1
2026-06-02cs.CV

CASTLE2026 Team WDL Technical Report

Zhengyang Li, Zhenglin Du, Yi Wen, Fang Liu, Shuo Li, Xu Liu

Key Laboratory of Intelligent Perception and Image Understanding

2026-06-02视觉感知

这篇技术报告面向 CASTLE 长时长第一视角多模态问答,动机在于关键证据可能散落在数百小时视频、ASR、照片和时空上下文中,单纯抽帧难以命中。方法将问题线索解析为人、日期、房间和类型,结合转写检索、辅助图像、视频帧采样、类型化提示、LoRA 与置信加权投票。消融显示 LoRA 将分数从 0.21 提升到 0.50,增加采样帧到 0.58,并获挑战第一,但各模块独立贡献仍未充分说明。

CR-JEPA: Cross-Modal Joint-Embedding Predictive Learning for Remote Sensing Image Retrieval Figure 1
2026-06-02cs.CV

CR-JEPA: Cross-Modal Joint-Embedding Predictive Learning for Remote Sensing Image Retrieval

Md Aminur Hossain, Ayush V. Patel, Nitant Dube, Biplab Banerjee

2026-06-02视觉感知

跨模态遥感检索需在光学、SAR、全色/多光谱等成像差异下对齐语义,同时保留同模态邻域结构。CR-JEPA用模态专属stem、共享Transformer、同/跨模态JEPA潜表示预测、SIGReg正则和解耦检索头来分离传感器适配与检索空间学习。在BEN-14K、CBRSIR_VS、DSRSID上均优于近期基线,BEN-14K相对X-JEPA的S1→S2和S2→S1 F1@5分别提升14.59和11.67点,且参数更少。

VICR: Visual In-Context Restoration for Real-World Image Super-Resolution Figure 1
2026-06-02cs.CV

VICR: Visual In-Context Restoration for Real-World Image Super-Resolution

Qichang Zhang, Hailong Wang, Baiang Li, Linhao Wang, Rong Fu, Erkang Cheng, Simon James Fong

Faculty of Science and Technology, University of Macau, Hefei University of Technology, Shandong Normal University

2026-06-02视觉感知强化学习

面向真实图像超分中生成先验易导致结构漂移、语义幻觉的问题,VICR将Real-ISR改写为DiT上的视觉上下文补全:把低质图像提供的局部结构证据、CLIP全局上下文和推理时代理动态修正的语义提示解耦注入。实验称其在多个Real-ISR基准达到SOTA,且仅需127M可训练参数。

FROST-STA: Frozen Dense Features for the Ego4D Short-Term Object Interaction Anticipation Figure 1
2026-06-02cs.CV

FROST-STA: Frozen Dense Features for the Ego4D Short-Term Object Interaction Anticipation

Chaoyang Wang, Lexuan Xu

Beihang University

2026-06-02视觉感知

面向第一视角视频中机器人/助手需在接触前预判“将拿什么、做什么、何时接触”的需求,FROST-STA冻结V-JEPA 2.1密集图像-视频特征,用短时视频提供运动线索、末帧提供高分辨率定位,并通过注意探针、帧引导时序池化与Faster R-CNN式多头解码融合预测。其八头与多checkpoint集成在Ego4D STA 2026测试集取得5.13 Overall Top-5 mAP、挑战第二,但具体消融增益来源文中仍不够充分。

Wavelet-Fusion Diffusion Model for Multimodal Brain MRI Synthesis with Modality and Metadata Conditioning Figure 1
2026-06-02cs.CV

Wavelet-Fusion Diffusion Model for Multimodal Brain MRI Synthesis with Modality and Metadata Conditioning

Muhammad Nabi Yasinzai, Remika Mito, Mangor Pedersen

Department of Psychology & Neuroscience, Auckland University of Technology, Department of Psychiatry, University of Melbourne, Melbourne, Victoria 3053, Australia.

2026-06-02视觉语言生成模型

针对大型脑 MRI 数据集中 T2w、FLAIR 尤其 T1Gd 覆盖不足且站点/元数据异质的问题,论文提出 WFDM:用小波融合 VAE 保留空间频率信息,并在 3D 潜空间扩散中显式条件化模态与人口/临床元数据。在 BrainScape 45,880 扫描上,相比 MAISI 将 pooled FID 从 0.00550 降至 0.00404、MMD 从 0.1918 降至 0.1471,T1w/T2w 改善明显;T1Gd 仍较弱,RFlow 50 步可显著降低采样成本。

Shape-Prior-Based Point Cloud Completion for Single-Stage Fully Sparse 3D Object Detection Figure 1
2026-06-02cs.CV

Shape-Prior-Based Point Cloud Completion for Single-Stage Fully Sparse 3D Object Detection

Kaizheng Wang, Mingqian Ji, Jian Yang, Shanshan Zhang

2026-06-02视觉感知三维

本文针对单阶段全稀疏3D检测器易受激光点云稀疏、遮挡不完整影响的问题,提出基于形状先验的点云补全框架SPPCC。其关键在于不依赖proposal box,而用实例选择模块从前景点中聚类目标,再将实例与类别原型在中心和朝向上对齐,并选取原型点补全缺失区域。方法接入FSDV2和VoxelNeXt后在KITTI验证/测试集上提升检测性能,说明该补全思路对点式和体素式稀疏检测器具有一定泛化性。

A Modelling and Evaluation Framework for EuroCrops-Driven Sentinel-2 Crop Segmentation Figure 1
2026-06-02cs.CV

A Modelling and Evaluation Framework for EuroCrops-Driven Sentinel-2 Crop Segmentation

Alexandra Nicoleta Scarlat, Ioana Cristina Plajer, Alexandra Baicoianu

Transilvania University of Braşov, Faculty of Mathematics and Computer Science

2026-06-02视觉感知数据集/基准

面向大尺度作物监测中像素级标注难、作物类别异构和跨区域泛化弱的问题,论文提出将 EuroCrops 地块标注与 Sentinel-2 多光谱影像自动对齐、栅格化、筛选并采样的可配置数据生成与评测框架,构建 5 国 67,337 个补丁。基于 10 波段四层 U-Net 的内部测试 mIoU 达 0.7665,优于随机森林基线;但在比利时子集、DACIA5 和 PASTIS 上性能明显下降,说明收益主要依赖同域数据与类别对齐。

T-CLIP: Enabling Thermal Perception for Contrastive Language-Image Pretraining Figure 1
2026-06-02cs.CV

T-CLIP: Enabling Thermal Perception for Contrastive Language-Image Pretraining

Tayeba Qazi, Ayush Maheshwari, Prerana Mukherjee, Brejesh Lall

Indian Institute of Technology Delhi, India, NVIDIA AI Technology Center, India, Jawaharlal Nehru University, India

2026-06-02视觉感知

这篇论文针对CLIP在热成像中无法按温度、发射率和热特征对齐文本的问题,指出全局场景语义与物体级热签名在同一嵌入空间联合学习会相互干扰。作者构建IR-Cap物理感知热图字幕,并用双LoRA分别适配场景与细粒度热属性后融合。T-CLIP在KAIST、FLIR、FMB的跨模态检索上均优于基线,KAIST上R@1由0.003提升到0.078,并展示了用于热图生成的可行性。

SKIP: Sparse Keyframe Interpolation Paradigm for Efficient Embodied World Models Figure 1
2026-06-02cs.RO

SKIP: Sparse Keyframe Interpolation Paradigm for Efficient Embodied World Models

Ziheng He, Yixiang Chen, Ning Yang, Zhanqian Wu, Qisen Ma, Yuan Xu, Jiabing Yang, Peiyan Li, Xiangnan Wu, Xiaofeng Wang, Zheng Zhu, Jing Liu, Nianfeng Liu, Yan Huang

2026-06-02强化学习

针对像素级具身世界模型长时域逐帧生成开销高、但简单丢帧又会漏掉接触/抓取/释放等关键事件的问题,SKIP提出“事件保留的稀疏到稠密”范式:用机器人感知多模态特征选关键帧,仅扩散生成这些帧,再由间隔预测与动作条件插值恢复完整视频。在LIBERO上其稠密rollout较Wan 2.2快4.16倍、FVD降89%,合成数据完全替代真示教时π0.5成功率仅小幅下降,优于逐帧生成。

TAP-JEPA: Frozen Future-Latent Probing and Two-Stage Score Fusion for EPIC-KITCHENS-100 Action Anticipation Figure 1
2026-06-02cs.CV

TAP-JEPA: Frozen Future-Latent Probing and Two-Stage Score Fusion for EPIC-KITCHENS-100 Action Anticipation

Chaoyang Wang, Lexuan Xu

Beihang University

2026-06-02视觉感知

该文针对第一视角厨房视频中目标动作尚未发生、只能依赖手-物距离和场景状态等弱线索进行预测的问题,提出冻结 V-JEPA 2.1 编码器与潜变量预测器,仅训练轻量任务查询探针来融合可见上下文与近未来 latent,并用8个副本及12–20轮检查点做两阶段分数字段加权融合。方法在 EK-100 Action Anticipation 隐藏测试集取得27.91% action MT5R,开放榜第二,但最终增益中融合与扩大训练数据的贡献占比未充分说明。

Collaborative Few-Step Distillation and Low-Bit Quantization for Wan2.2 Dual-Expert Video Diffusion Models Figure 1
2026-06-02cs.CV

Collaborative Few-Step Distillation and Low-Bit Quantization for Wan2.2 Dual-Expert Video Diffusion Models

Jinyang Du, Shenghao Jin, Ziqian Xu, Ruihao Gong, Shiqiao Gu, Yang Yong, Jinyang Guo, Xianglong Liu

2026-06-02视觉感知生成模型

针对 Wan2.2-T2V-A14B 视频扩散模型采样步数多、显存占用高的问题,本文将少步分布匹配蒸馏与 W4A4/HiF4 低比特量化协同设计:先学习短轨迹,再在该轨迹上按高噪声/低噪声双专家分别校准,并保护敏感入口层以减少激活失配。VBench 结果显示量化模型接近同少步全精度学生,并在 8、20 步平均分超过原全精度基线,其中 20 步为较优质量—效率折中。

An Attribute-Based Measure of Video Complexity Figure 1
2026-06-02cs.CV

An Attribute-Based Measure of Video Complexity

Aditya Sarkar, Yi Li, Zihao Wang, Jiacheng Cheng, Sai Vidyaranya Nuthalapati, Aashu Singh, Shlok Kumar Mishra, David Jacobs, Nuno Vasconcelos

UMIACS-University of Maryland College Park, 2 University of California San Diego, Yale University, 4 Meta AI

2026-06-02视觉感知

针对视频 LLM 评测成本高、现有难度估计依赖大模型且缺乏可解释性的问题,论文提出 VideoABC:把视频-问题复杂度定义为模型失败概率,并用视频长度、事件速度、位置、场景复杂度等属性空间的非参数量化来估计。方法结合 k-means 与通用格量化,并用合成视频补足小参考集的覆盖。实验显示其在低维属性下仍优于 LLM-as-judge,且能解释不同基准的难度来源。

A Systematic Benchmark of Intraoperative Ultrasound-to-MR Synthesis for Brain Tumour Surgery Figure 1
2026-06-02cs.CV

A Systematic Benchmark of Intraoperative Ultrasound-to-MR Synthesis for Brain Tumour Surgery

Olga Esteban-Sinovas, Santiago Cepeda, Ignacio Arrese, Rosario Sarabia

Department of Neurosurgery, Neurovascular Unit, Río Hortega University Hospital, Valladolid, Spain

2026-06-02数据集/基准

脑肿瘤手术中 ioUS 便宜且可重复采集,但与术前 MRI 外观差异大,限制导航和分割模型复用。本文在 ReMIND 上统一比较 6 类生成器、4 种推理形态和单/多任务目标共 48 组 ioUS→MRI 合成实验,并加入 nnU-Net 下游评估。结果显示无单一架构全胜,LPIPS 比 SSIM 更贴近分割效用,SynDiff-2.5D 保留下游分割最好(U Dice=0.55)。

MM-Snowball: Evaluating and Mitigating Hallucination Snowballing in Multimodal Multi-Turn Dialogue Figure 1
2026-06-02cs.CV

MM-Snowball: Evaluating and Mitigating Hallucination Snowballing in Multimodal Multi-Turn Dialogue

Yue Jiang, Xue Jiang, Lihua Zhang, Zhiqiang Wang, Yuhang Lu, Peng Wang, Bo Han, Feng Zheng, Dingkang Yang

2026-06-02视觉语言

论文关注多模态多轮对话中早期视觉幻觉会被历史文本不断放大的“雪球效应”,指出现有单轮或两轮基准难以诊断长期误差传播。作者构建含4992条六轮轨迹的MM-Snowball,并提出AHTS刻画从视觉锚定到推理升级的阶段;实验发现模型在第3–5轮明显崩塌、重新看图后恢复,揭示关键在视觉证据被污染文本压制。其训练-free的CAVR通过表示层刷新视觉锚定和logit层冲突校正,在该基准上优于现有缓解方法。

FlowNar: Scalable Streaming Narration for Long-Form Videos Figure 1
2026-06-02cs.CV

FlowNar: Scalable Streaming Narration for Long-Form Videos

Zeyun Zhong, Manuel Martin, Chengzhi Wu, David Schneider, Frederik Diederichs, Juergen Gall, Juergen Beyerer

2026-06-02视觉感知生成模型

针对现有在线视频 LMM 在长视频流中视觉上下文不断累积、显存和计算随时长线性增长的问题,FlowNar 通过动态删除已完成片段的视觉 KV cache,并用 CLAM 线性注意力记忆以固定 token 压缩历史视觉信息,同时采用自条件评测以暴露误差累积。实验在 Ego4D、EgoExo4D、EK100 上显示其叙述质量优于强基线,可处理约 10 倍更长视频并达到约 3 倍 FPS。

Pause and Think: A Dataset and Benchmark for Video-Grounded Assistive Action Suggestion Figure 1
2026-06-02cs.CV

Pause and Think: A Dataset and Benchmark for Video-Grounded Assistive Action Suggestion

Shivam Singh, Saptarshi Majumdar, Pratik Prabhanjan, Zicheng Liu, Emad Barsoum

Inc.), Advanced Micro Devices, Inc. (AMD)

2026-06-02视觉感知数据集/基准

本文针对现有视频 VLM 在真实辅助场景中易脱离视觉证据、回答冗长且难做下一步规划的问题,提出 Pause-and-think-T 训练集和 Pause-and-think-B 基准,用显式结构化推理监督促使模型先依据时序视觉证据“想一想”再给出简洁行动建议。实验显示,仅微调约 4B 模型即可在基准上达 58.0% 准确率,接近 235B Qwen3-VL,并在场景理解、简洁性及部分 OOD 基准上优于多种前沿模型。

FiSeR: Fine-Grained Source Representations for Cross-Domain AI Image Detection Figure 1
2026-06-02cs.CV

FiSeR: Fine-Grained Source Representations for Cross-Domain AI Image Detection

Shan Zhang, Yongxin He, Mingming Zhang, Huiwen Tian, Lei Ma

2026-06-02视觉感知

该文针对AI生成图像检测在跨域时因分类头过拟合源域伪迹而失效的问题,指出中间特征在新域中仍保留可分结构。FiSeR通过层次化监督对比学习同时拉开真/假图像并保留生成器身份细粒度结构,并用kNN图同质性评估表征。训练于WildFake后,在Chameleon、AIGIBench等跨域基准相对DIRE平均AUROC提升10.22,10-shot轻量SVM适配还带来显著增益。

ASAP: Advancing Medical Volumetric Representation Learning with Anatomy-aware Semantically-adaptive Pre-training Figure 1
2026-06-02cs.CV

ASAP: Advancing Medical Volumetric Representation Learning with Anatomy-aware Semantically-adaptive Pre-training

Rongsheng Wang, Fenghe Tang, Zihang Jiang, Yingtai Li, Xu Zhang, Haoran Lai, Wenxin Ma, Wei Wei, Zhiyang He, Xiaodong Tao, Rui Yan, Qingsong Yao, Shaohua Kevin Zhou

Medical Imaging, Robotics, Analytic Computing & Learning (MIRACLE) Lab, YRD-RIGHT, USTC Suzhou Institute for Advanced Research, Suzhou, Jiangsu, China 215123, Jiangsu Provincial Key Laboratory of Multimodal Digital Twin Technology, Suzhou, Jiangsu, China 215123, and also with Biomedical Basic Research Center (BBRC) of Jiangsu Province, Suzhou, Jiangsu, China 215123., Wei Wei is with Department of Radiology, The First Affiliated Hospital of USTC, Division of Life, Zhiyang He and Xiaodong Tao are with Anhui IFLYTEK CO., Ltd., Qingsong Yao is with the School of Medicine, Stanford University., Shaohua Kevin Zhou is also with State Key Laboratory of Precision and Intelligent Chemistry, Hefei, Anhui, China 230026.

2026-06-02视觉感知

针对3D胸部CT中病灶空间稀疏、报告语义开放且难以定位,导致传统全局视觉语言对齐易被背景噪声稀释的问题,ASAP将器官分割先验注入体素补丁表示,并按句子语义自适应选择相关局部区域,再在双模态掩码建模中融合图文信息。论文还构建15个数据集、22项任务的评测基准,实验显示其在分类、分割、预后、报告生成等任务上优于既有方法,低标注和分布偏移场景收益更明显。

Through the PRISM: Principle-Aware, Interpretable, and Multi-Scale Evaluation of Visual Designs Figure 1
2026-06-02cs.CV

Through the PRISM: Principle-Aware, Interpretable, and Multi-Scale Evaluation of Visual Designs

Mona Gandhi, KJ Joseph, Srinivasan Parthasarathy, Sayan Nag

Ohio State University, 2 Adobe Research

2026-06-02数据集/基准

现有视觉设计评估常压缩为单一美学分数,难以指出具体原则错误并给出可操作反馈。本文构建 PRISM,通过对 Crello 专业版式按连贯性、可读性、对比、对齐和重叠做受控扰动,形成 100K/10K 训练验证样本,并提出结合 SigLIP 轻量评分器、指令微调 VLM 定位器与提示式全局判断的多尺度框架。实验显示 Qwen-2.5-VL、GPT-4o-mini 对定向退化不敏感,GPT-4o 有全局感知但原则解耦不足,而专用评分器和定位器更能区分并解释局部设计缺陷。

Response-Aware Multimodal Learning for Post-Treatment Visual Acuity Forecasting Figure 1
2026-06-02cs.CV

Response-Aware Multimodal Learning for Post-Treatment Visual Acuity Forecasting

Phuoc-Nguyen Bui, Van-Vi Vo, Duc-Tai Le, Van-Nguyen Pham, Ki-Young Kim, Seung-Young Yu, Hyunseung Choo

2026-06-02视觉语言

针对DME患者抗VEGF治疗后长期视力难以仅凭早期随访判断的问题,本文把基线与1个月OCT及临床表格数据建模为3至24个月多时点预测任务。核心在于显式利用早期治疗反应:LoRA适配RETFound提取局部OCT特征,结合依赖感知表格编码和跨模态融合生成轨迹预测;在188例真实队列上,24个月预测达到MAE 0.1246、RMSE 0.1621、R² 0.6064。

Improving Visual Representation Alignment Generation with GRPO Figure 1
2026-06-02cs.CV

Improving Visual Representation Alignment Generation with GRPO

Shentong Mo, Sukmin Yun

2026-06-02视觉感知

该文针对扩散 Transformer 训练中生成特征与判别视觉表征对齐弱、REPA 等静态余弦/对比损失难以随训练状态调节的问题,提出 VRPO,将表征对齐改写为奖励驱动的策略优化,并用保真度、语义一致性和去噪稳定性奖励动态权衡生成质量与对齐强度。方法无需额外网络,兼容 SiT/DiT;在 ImageNet-256 上相较 REPA 报告 FID 提升约 1.8、训练加速 2.3 倍,并提升跨域对齐保持率。

Sandboxed Coding Agents are Competitive Omni-modal Task Solvers Figure 1
2026-06-02cs.CL

Sandboxed Coding Agents are Competitive Omni-modal Task Solvers

Dongping Chen, Xuanao Huang, Zhihan Hu, Qingyuan Shi, Dianqi Li, Tianyi Zhou

University of Maryland

2026-06-02优化算法

本文质疑视频/音频任务必须依赖原生全模态模型的假设,提出把沙盒编码代理作为“多模态处理器”:通过终端调用 ffmpeg、ASR、OCR 并编写脚本,将媒体流转为转写、帧、元数据等可检索证据。实验显示 GPT-5.4 Codex 在 OmniGAIA 达 75.0%,超过 Gemini 3.1 Pro;技能注入可将平均准确率由 61.4% 提升到 76.7%。论文还给出 Code-X 训练方案与 TerminalBench-O,用于开放模型和真实多模态处理评测。

On the Difficulty of Learning a Meta-network for Training Data Selection Figure 1
2026-06-02cs.LG

On the Difficulty of Learning a Meta-network for Training Data Selection

Zilin Du, Junqi Zhao, Boyang Albert Li

2026-06-02视觉感知

针对合成数据与真实数据分布不匹配时,元学习式训练数据选择(MTS)常低于预期的问题,本文指出关键瓶颈不是框架本身,而是选择网络梯度信噪比过低以及输入特征缺乏数据质量信息;通过理论分析解释权重归一化导致的高方差,并用增大 batch 与分布/训练动态特征改进选择器。在4个基准、15种设置中,相比不选择数据平均提升5.49%,较最强基线提升2.89%。

Decomposed On-Policy Distillation for Vision-Language Reasoning: Steering Gradients for Visual Grounding Figure 1
2026-06-02cs.CV

Decomposed On-Policy Distillation for Vision-Language Reasoning: Steering Gradients for Visual Grounding

Hee Suk Yoon, Eunseop Yoon, Jaehyun Jang, SooHwan Eom, Ji Woo Hong, Mark Hasegawa-Johnson, Qi Dai, Chong Luo, Chang D. Yoo

2026-06-02视觉语言视觉感知强化学习优化算法三维

面向小型视觉语言推理模型,多模态 on-policy 蒸馏若沿用单一 KL 目标,容易把语言先验对齐与视觉 grounding 混在一起。论文将损失分解为语言先验和视觉感知两部分,发现二者梯度近似正交,并提出 Visual Gradient Steering 将更新方向显式偏向视觉子空间。实验显示,在 8B 教师蒸馏 2B/4B 学生及多种复杂多模态基准上,VGS 优于标准蒸馏且训练开销较小。

DeepLatent: Think with Images via Parallel Latent Visual Reasoning Figure 1
2026-06-02cs.CV

DeepLatent: Think with Images via Parallel Latent Visual Reasoning

Dongchen Lu, Zhimo Li, Mao Shu, Huo Cao

Baidu Inc., Peking University

2026-06-02视觉感知

论文针对VLM推理中视觉表征一次编码后难以随思考动态更新、而工具调用延迟高且自回归潜变量视觉信息不足的问题,提出DeepLatent:用LatentFormer以可学习2D查询并行生成、且始终锚定原图特征的上下文潜在视觉状态,并用连续空间RL优化调制参数。文中称其在多项视觉推理基准上达到SOTA,同时发布DeepLatent-180K数据集。

Improving Visual Grounding in Remote Sensing via Cluster-Guided Refinement and Model Ensemble Voting Figure 1
2026-06-02cs.CV

Improving Visual Grounding in Remote Sensing via Cluster-Guided Refinement and Model Ensemble Voting

Panav Shah, Geet Sethi, Ashutosh Gandhe

Indian Institute of Technology Bombay

2026-06-02视觉语言

遥感图像中目标小、尺度变化大且背景复杂,单一视觉 grounding 模型往往定位粗糙或分割不稳。论文将 RemoteSAM 的初始定位与 SAM3 的精细分割串联,进一步用聚类合并碎片候选,并对六条管线做多数投票集成。VRS Bench 和 NWPU-VHR-10 实验显示,CGR 与集成方案的 mIoU 优于各单模型,提升了定位一致性与鲁棒性。

CAFOSat: A Strongly Annotated Dataset for Infrastructure-Aware CAFO Mapping Using High-Resolution Imagery Figure 1
2026-06-02cs.CV

CAFOSat: A Strongly Annotated Dataset for Infrastructure-Aware CAFO Mapping Using High-Resolution Imagery

Oishee Bintey Hoque, Nibir Chandra Mandal, Mandy L Wilson, Samarth Swarup, Madhav Marathe, Abhijin Adiga

University of Virginia, Biocomplexity Institute, University of Virginia

2026-06-02视觉感知数据集/基准

针对美国 CAFO 位置记录噪声大、漏报多且缺少设施级标注,CAFOSat 将 NAIP 高分辨率影像与多源清单结合,用 AI 预筛、GradCAM 定位、几何聚类和人工验证把弱地理点精炼为强标注,并加入硬负样本与合成增强。数据集覆盖 20 州、超 4.5 万图块,实验显示更准标注和负样本能提升 CNN、Transformer 与视觉语言模型的泛化,合成数据进一步改善分布偏移鲁棒性。

ETC: Extreme Token Compression via Task-aware Visual Information Distillation in VLMs Figure 1
2026-06-02cs.CV

ETC: Extreme Token Compression via Task-aware Visual Information Distillation in VLMs

Yiling Gao, Hongchen Wei, Zhenzhong Chen

School of Remote Sensing and Information Engineering, Wuhan University

2026-06-02视觉语言

高分辨率 VLM 会产生大量视觉 token,带来注意力计算与 KV-cache 开销,极端压缩下现有选择式方法易性能崩塌。ETC 从任务损失最小化出发,提出应保留“指令感知”的任务相关充分统计量,并用文本到图像交叉注意力近似该统计量,再通过变分信息蒸馏约束少量压缩 token 保持可恢复信息。在 LLaVA-1.5-7B 与 Qwen3-VL-2B 上,即使压到单 token 仍能保留较强性能并显著降低缓存开销。

An Effective Solution for the CVPR 2026 8th UG2+ Challenge Track 3: Dynamic Object Segmentation in Turbulence Figure 1
2026-06-02cs.CV

An Effective Solution for the CVPR 2026 8th UG2+ Challenge Track 3: Dynamic Object Segmentation in Turbulence

Hongzhen Li, Miao Yu, Leilei Cao, Youwei Pan, Yingfang Zhu, Fengjie Zhu

2026-06-02视觉感知

本文面向大气湍流下动态目标分割,动机是传统光流和短时匹配在几何畸变、时间抖动中易失效。方法不重做端到端网络,而以 SegAnyMo 的长程点轨迹提示 SAM2 为基础,加入基于 DAVIS/DOST 的湍流仿真域适配,并用时空后处理去除边界伪前景和短暂碎片噪声。DOST 测试上 mIoU 从 0.6392 提升到 0.7249,mDice 从 0.6953 到 0.7783,挑战排名第二。

Generate in Reconstruction Space, Match in Semantic Space: Transport Geometry for One-Step Generation Figure 1
2026-06-02cs.LG

Generate in Reconstruction Space, Match in Semantic Space: Transport Geometry for One-Step Generation

Hugues Van Assel, Edward De Brouwer, Saeed Saremi, Gabriele Scalia, Aviv Regev

2026-06-02三维

本文关注自监督语义特征为何能提升一步生成中的分布匹配。作者将生成放在 VAE 重构潜空间中进行,而把 Sinkhorn 最优传输损失定义在冻结 SSL 语义空间,并指出语义特征通过压缩无关重构细节、提高传输估计稳定性来改善训练。ImageNet 实验显示该策略可使 FID 下降约 39 倍,同时揭示用 Inception 对齐 FID 可能造成指标投机、样本质量反而变差。

Saliency-Aware Model Merging Figure 1
2026-06-02cs.LG

Saliency-Aware Model Merging

Jungin Park, Jiyoung Lee, Kwanghoon Sohn

2026-06-02视觉感知

论文针对无数据模型合并中仅按参数幅值/符号筛选、忽略层间依赖而易产生专家冲突的问题,提出 SA-Merging:借鉴 SynFlow 的连通性显著性,为相对基座的任务向量估计端到端影响,并用专家一致性调制显著性,迭代剪除低价值更新;还扩展到 LoRA 的秩级分解。实验覆盖 ViT 视觉任务、T5 语言任务与 Flan-T5 LoRA,结果显示其优于现有无数据合并方法,缩小与测试时适配/多任务微调的差距。

Structure-Aware Consistency Priors for Shape from Polarization in Complex Media Figure 1
2026-06-02cs.CV

Structure-Aware Consistency Priors for Shape from Polarization in Complex Media

Kaimin Yu, Puyun Wang, Huayang He, Xianyu Wu

2026-06-02视觉感知

论文针对冰等复杂介质中双折射、多次散射导致偏振观测与表面法线关系失稳的问题,提出用 AoLP 自相关构造结构感知一致性先验,并通过 IceSfP 双分支网络、跨模态可靠性注意力和多尺度融合结合原始偏振特征与物理先验。作者还建立首个真实冰物体 SfP 数据集,实验 MAE 达 16.01°,较次优方法降低 2.74°。

V-LynX: Token Interface Alignment for Video+X LLMs Figure 1
2026-06-02cs.CV

V-LynX: Token Interface Alignment for Video+X LLMs

Jungin Park, Jiyoung Lee, Kwanghoon Sohn

2026-06-02视觉感知

针对现有 Video LLM 扩展到音频、3D 等新模态时依赖重型专用编码器和成对数据的问题,V-LynX 提出“token interface”洞察:视频通路已形成可复用的连续感知 token 流形。方法冻结原视觉骨干,仅用轻量 LoRA 辅助路径,并以非成对单模态数据对齐注意力响应和投影 token 统计分布。实验显示其在视听问答、3D 推理、高帧率与多视角视频理解等任务达到 SOTA,且新增参数显著少于 PAVE。

OptiWorld: Optimal Control for Video World Generation under Physical Constraints Figure 1
2026-06-02cs.CV

OptiWorld: Optimal Control for Video World Generation under Physical Constraints

Yu Yuan, Jianhao Yuan, Xijun Wang, Daiqing Li, Liu He, Lu Ling, Stanley H. Chan

Purdue University, University of Oxford, SixteenMiles Labs

2026-06-02视觉感知强化学习规划控制优化算法

针对视频世界模型只生成“看起来合理”的运动、却难以保证安全平滑和物理一致的问题,OptiWorld在推理阶段加入最优控制层:先用视觉基础模型/VLM抽取任务相关3D状态,再把安全、目标、效率等约束统一为黎曼流形上的几何最短路规划,最后用轨迹条件渲染视频。实验在I2V和视频动力学编辑中显示,其目标误差、安全违规率、加速度/jerk和能量均优于HunyuanVideo、Wan、Cosmos与VLIPP等基线。

Pre-Deployment Robustness Stress Testing for CT Segmentation Systems Using Clinically Motivated Multi-Corruption Augmentation Figure 1
2026-06-02cs.CV

Pre-Deployment Robustness Stress Testing for CT Segmentation Systems Using Clinically Motivated Multi-Corruption Augmentation

CholMin Kang, Jonghyun Chung, Amanpreet Kaurb, Nagesh Gulkotwarb, Arthi Sivasankaranb

2026-06-02视觉感知安全鲁棒

论文关注 CT 分割模型在真实临床部署前可能遭遇噪声、低分辨率、对比度变化和伪影等复合退化时的失效风险,提出 RAMP:将解剖约束空间扰动、CT 强度变换与随机多腐蚀组合用于鲁棒训练。实验显示其牺牲部分干净图像 Dice,但显著提升退化图像表现:五器官基准 corrupted Dice 从 0.610 升至 0.753,Abdomen1K 从 0.633 升至 0.789,并大幅缩小鲁棒性缺口。

3D Segment Anything Model with Visual Mamba for Diagnosing Placenta Accreta Spectrum Figure 1
2026-06-02cs.CV

3D Segment Anything Model with Visual Mamba for Diagnosing Placenta Accreta Spectrum

Yuliang Zhang, Fang He, Lulu Peng, Tianyu Yan, Pingping Zhang, Ting Song, Lili Du, Dunjin Chen

Fang He is also with the Department of Obstetrics, Guangzhou Women and Children’s Medical Center, Guangzhou Medical University, Guangzhou 510180, China.

2026-06-02三维

针对胎盘植入谱系疾病依赖资深医生解读MRI、基层医院诊断能力不足且缺少公开数据的问题,论文构建首个带细粒度分割与分类标注的MRI-PAS数据集,并提出3DSAMba:将SAM扩展到3D医学影像,用适配器注入医学先验,结合MLAM与FSSM的Mamba结构聚合多层多尺度特征,再以病灶掩膜辅助分类。实验显示该框架能提升病灶分割和PAS诊断表现。

Do Text Edits Generalize to Visual Generation? Benchmarking Cross-Modal Knowledge Editing in UMMs Figure 1
2026-06-02cs.CL

Do Text Edits Generalize to Visual Generation? Benchmarking Cross-Modal Knowledge Editing in UMMs

Xin Gao, Cheng Yang, Chufan Shi, Taylor Berg-Kirkpatrick

2026-06-02数据集/基准

论文关注统一多模态模型中“文本侧知识编辑能否迁移到图像生成”的问题,提出 UniKE 基准,以属性和关系编辑配合 VQA 验证生成图像是否体现新知识。结果显示明显模态鸿沟:文本编辑成功率约 92%,直接生成的最佳 VQA 准确率仅 18.5%;作者进一步用推理增强先显式激活编辑知识,最高提升 18.6 个百分点,并指出瓶颈可能在文本表示到视觉生成条件通路的信号衰减与错配。

CodeCytos: AI-assisted spatial molecular imaging analysis via code-augmented agent action space Figure 1
2026-06-02cs.CV

CodeCytos: AI-assisted spatial molecular imaging analysis via code-augmented agent action space

Hung Q. Vo, Huy Q. Vo, Son T. Ly, Zhihao Wan, Anh-Vu Nguyen, Hong Zhao, Jianting Sheng, Stephen T. C. Wong, Hien V. Nguyen

University of Houston, Department of Electrical and Computer Engineering, Houston, Texas, 77004, USA, Houston Methodist Hospital, Department of Systems Medicine and Biomedical Engineering, Houston, Texas, 77030, USA

2026-06-02视觉感知

空间分子影像分析常受限于传统软件的固定功能和人工干预,难以快速验证自定义细胞空间特征。CodeCytos将LLM代理的动作空间扩展为可执行代码,通过“思考-代码-观察”循环按自然语言请求完成特征提取;在额叶皮层、NSCLC、胰腺和扁桃体数据上,相比工具增强LLM和零样本CodeAct表现更好,且领域外少样本代码推理示例也能显著提升成功率与Pass@k。

MUSCLE-NET: Predicted-Multiscale-Aware Network for Pedestrian Trajectory Forecasting Figure 1
2026-06-02cs.CV

MUSCLE-NET: Predicted-Multiscale-Aware Network for Pedestrian Trajectory Forecasting

Yu Liu, Ming Huang, Xiao Ren, Zhijie Liu, Youfu Li, He Kong

2026-06-02规划控制

本文面向自动驾驶中的行人轨迹预测,指出现有多模态方法常忽略不同观测源可靠性变化,以及未来运动对特征尺度的依赖。MUSCLE-NET通过MMFE重标定框、速度、姿态等线索并建模非对称跨模态交互,再用MEHP先粗估不确定未来、按预测尺度融合并逐步修正轨迹漂移。在JAAD和PIE上相对现有方法取得稳定增益,但摘要未给出具体幅度。

An explainable hierarchical self attention-based approach for tremor detection in the time domain Figure 1
2026-06-02cs.CV

An explainable hierarchical self attention-based approach for tremor detection in the time domain

Timothy Odonga, Jeanne M. Powell, Mark Saad, Richa Tripathi, Christine D. Esper, Stewart A. Factor, Hyeokhyen Kwon, J. Lucas Mckay

Department of Biomedical Informatics, School of Medicine, Emory University, Atlanta, Department of Neurology, School of Medicine, Emory University, Atlanta, GA, USA, Wallace H. Coulter Department of Biomedical Engineering, Georgia Institute of, ¤Current Address: Department of Biomedical Informatics, School of Medicine, Emory, University, Atlanta, GA, USA, neurologists, creating a bottleneck in access and scalability. Consequently, there is

2026-06-02视觉感知

针对临床震颤评估依赖专家、现有自动方法多依赖频域手工特征且易弱化间歇性变化的问题,本文提出两级时域层次模型:用 DeepConvLSTM 从3D运动学短窗学习表示,再由 ViT 汇聚整段试验并用注意力和 Grad-CAM解释时间窗与标记点贡献。九个身体部位平均 F1 为0.765,头部和手部较好但低于频域SOTA 0.909,显示可行但性能增益有限。

Beyond Static Gaussians: An Empirical Investigation of Architectural Paradigms for Dynamic 3D Scene Reconstruction Figure 1
2026-06-02cs.CV

Beyond Static Gaussians: An Empirical Investigation of Architectural Paradigms for Dynamic 3D Scene Reconstruction

Adrian Ramlal, John S. Zelek

University of Waterloo

2026-06-02三维

针对动态 3DGS 方法快速增多但取舍不清的问题,论文将其归纳为结构引导与高斯中心两类,并在 D-NeRF 上统一比较质量、速度、训练与存储。结果显示,结构引导方法重建精度和模型紧凑性更好,如 SC-GS 达 43.31dB;高斯中心方法渲染显著更快,4D Rotor GS 达 1257 FPS,但质量波动和存储开销更大,核心结论是保真/紧凑与实时速度之间存在明确权衡。

Optimizing 3D Gaussian Splatting via Point Cloud Upsampling Figure 1
2026-06-02cs.CV

Optimizing 3D Gaussian Splatting via Point Cloud Upsampling

Adrian Ramlal, Yan Song Hu, John S. Zelek

Vision and Image Processing Group, Systems Design Engineering, University of Waterloo

2026-06-02三维

这篇论文关注 3DGS 对初始 SfM 稀疏点云高度敏感、低纹理区域种子不足的问题,系统比较线性/三角插值、样条、MLS、Voronoi 等点云上采样,并提出利用深度图约束的 point lifting。Mip-NeRF360 与 Replica 实验显示,上采样通常小幅提升重建质量,平均约 0.258 dB;MLS 在多类细节或有机场景更稳,简单插值适合分段平滑结构,Voronoi/深度引导对平坦或低纹理区域更有价值。

GeoSAM-3D: Geodesic Prompt Propagation for Open-Vocabulary 3D Scene Segmentation from Monocular Video Figure 1
2026-06-02cs.CV

GeoSAM-3D: Geodesic Prompt Propagation for Open-Vocabulary 3D Scene Segmentation from Monocular Video

Arun Sharma

University of Minnesota, Twin Cities

2026-06-02视觉感知三维

GeoSAM-3D面向机器人/AR中“单目视频点击一次却需得到持久3D物体掩码”的需求,将SAM/SAM2的2D提示监督提升到3D Gaussian场,并用基于kNN图拉普拉斯的热核测地传播替代欧氏近邻,以减少相近但不连通表面的标签泄漏。文中主要结果偏实现与验证:给出特征头、传播核、单元测试、Space smoke test和评测协议;尚未充分说明其达到SOTA或具备完整开放词汇识别能力。

DarkVesselNet: Multi-Modal Remote Sensing and Trajectory Reasoning for Dark Vessel Detection Figure 1
2026-06-02cs.CV

DarkVesselNet: Multi-Modal Remote Sensing and Trajectory Reasoning for Dark Vessel Detection

Arun Sharma

University of Minnesota, Twin Cities

2026-06-02视觉感知规划控制

面向船舶关闭或伪造 AIS、单一遥感证据易误判的海上监管场景,DarkVesselNet 将 Sentinel-1 SAR、Sentinel-2 光学、AIS 轨迹与地理基础模型 token 统一到可替换骨干和缺失感知注意力融合框架,并用 TGARD 间隙检测与 Pi-DPM 异常头生成可追溯告警。当前结果主要是软件层验证,覆盖滤波、配准、轨迹距离、token 形状和可微异常评分;外部 xView3 式基准效果文中未充分说明。

Real-Time Physics Simulation with Dynamic Mesh-Gaussian Reconstructions Figure 1
2026-06-02cs.CV

Real-Time Physics Simulation with Dynamic Mesh-Gaussian Reconstructions

Adrian Ramlal, John S. Zelek

University of Waterloo

2026-06-02三维

这篇论文关注动态三维重建接入机器人/交互仿真时的拓扑一致性瓶颈:高保真 DG-Mesh 拓扑随帧变化,物理引擎却需要固定网格。作者提出物理固定网格与高斯渲染解耦的双表示框架,并比较时序跟踪、模板投影两种后处理拓扑转换。结果显示固定拓扑更新可达 147.8 FPS、较变拓扑快 4.65 倍,但转换会带来 65–80% 几何退化,甚至不如原生固定拓扑 MaGS,说明物理兼容性应在重建训练中直接优化。

Physical Object Understanding with a Physically Controllable World Model Figure 1
2026-06-02cs.CV

Physical Object Understanding with a Physically Controllable World Model

Rahul Venkatesh, Klemen Kotar, Lilian Naing Chen, Wanhee Lee, Gia Ancone, Seungwoo Kim, Luca Thomas Wheeler, Jared Watrous, Honglin Chen, Daniel Bear, Stefan Stojanov, Daniel LK Yamins

Stanford University, 2 OpenAI, 3 Noetik Inc., 4 Google

2026-06-02强化学习规划控制

论文针对从原始视频中理解物体边界、运动规律和支撑/铰接等物理关系的难题,提出 PSI:把 RGB、光流、相机等局部视觉变量表示为可查询的概率结构,并用自回归序列建模训练,使模型能在任意条件下推断未观测变量。通过生成多种物理一致的未来并分析运动相关性,PSI 可零样本发现物体和关节子部件、进行 3D 操控,并在 SpelkeBench、DragAMove、3DEditBench 及 Visual Jenga 类任务上优于相关基线。

Detect Before You Leap: Mirage Detection in Vision-Language Models Figure 1
2026-06-02cs.CV

Detect Before You Leap: Mirage Detection in Vision-Language Models

Sayeed Shafayet Chowdhury, Md. Shaown Miah

Indiana University Indianapolis, Bangladesh University of Engineering and Technology

2026-06-02视觉语言视觉感知

论文关注VLM在图像缺失、空白或与问题不匹配时仍给出自信答案的“海市蜃楼”风险,主张在生成前判断是否应回答。核心方法TC-LIA不只看最终CLIP相似度,而是追踪ViT各层patch与问题文本的对齐轨迹,并结合空白检测、域路由和VLM自评做集成。跨5类VQA和12个模型,三分类准确率最高94.7%,将基线21.7–66.6%的mirage率降至约2.7–3.3%。

4D Radar Meets LiDAR and Camera: Cooperative Perception under Adverse Weather Figure 1
2026-06-02cs.CV

4D Radar Meets LiDAR and Camera: Cooperative Perception under Adverse Weather

Melih Yazgan, Iramm Hamdard, Qiyuan Wu, J.Marius Zoellner

FZI Research Center for Information Technology, Karlsruhe Institute of Technology

2026-06-02视觉感知

面向雨雾中相机和 LiDAR 易退化导致协同感知不可靠的问题,本文将 4D 成像雷达引入多车融合:一方面用雷达替代或补充 LiDAR,另一方面利用 Doppler 速度生成 BEV 动态注意力以突出运动目标。作者构建含物理 LiDAR 退化的 OPV2V-R、Adver-City-R,并在仿真雨雾及 MAN TruckScenes 上验证,显示雷达增强方案在恶劣天气、时延和位姿误差下更稳健。

Rethinking Amortized Neural Representations for High-Resolution Terrain Elevation Data Figure 1
2026-06-02cs.CV

Rethinking Amortized Neural Representations for High-Resolution Terrain Elevation Data

Haoan Feng, Xin Xu, Leila De Floriani

University of Maryland, College Park, University of Maryland, College Park MD USA

2026-06-02视觉感知

高分辨率DEM若为每个地形块单独拟合INR,虽可连续查询并求解析导数,但难以扩展到大规模数据。论文首次在1 m/pixel swisstopo地形上统一评测TransINR、Functa、HUVR,指出自然图像摊销INR存在跨域落差,并提出将HUVR解码器替换为更平滑可微的SIREN。HUVR+SIREN在相同逐块存储下PSNR提升2.83 dB,导数保真度更好,int8量化仍基本无损;残余差距被定位到共享超网络后端而非token容量。

AutoIQ: An Ensemble Framework for Automatic Assessment of Geometric Distortion in Prostate Diffusion-Weighted Imaging Figure 1
2026-06-02eess.IV

AutoIQ: An Ensemble Framework for Automatic Assessment of Geometric Distortion in Prostate Diffusion-Weighted Imaging

Haoran Sun, Lixia Wang, Yin-Chen Hsu, Hsu-Lei Lee, Chang Gao, Fei Han, Robert Grimm, Vibhas Deshpande, Ziyang Long, Hsin-Jung Yang, Rola Saouaf, Alessandro D'Agnolo, Timothy Daskivich, Hyung Kim, Debiao Li, Yibin Xie

Biomedical Imaging Research Institute, Cedars-Sinai Medical Center, Los Angeles, CA, USA, Department of Bioengineering, University of California, Los Angeles, CA, USA, Siemens Medical Solutions USA Inc., Los Angeles, CA, USA, Siemens Medical Solutions USA Inc., Austin, TX, USA, Department of Imaging, Cedars-Sinai Medical Center, Los Angeles, CA, USA, Department of Nuclear Medicine, Cedars-Sinai Medical Center, Los Angeles, CA, USA, Department of Urology, Cedars-Sinai Medical Center, Los Angeles, CA, USA

2026-06-02生成模型

前列腺 DWI 易受几何畸变影响,导致病灶定位和是否需重扫仍依赖主观目测。AutoIQ 将 T2WI-DWI 前列腺边界错配与配准形变幅度两类可解释畸变指标集成,并用放射科医师判定训练逻辑回归集成分类器。在 140 例回顾性数据中,两类指标均能显著区分严重与可接受畸变,独立测试集准确率 0.95、F1 0.93、AUC 0.98,但单中心小样本限制了泛化判断。

Zamba2-VL Technical Report Figure 1
2026-06-02cs.CV

Zamba2-VL Technical Report

Hassan Shapourian, Kasra Hejazi, Olabode M. Sule, Beren Millidge

Olabode M. Sule

2026-06-02视觉感知

本文针对高分辨率图像/多模态长上下文使 Transformer VLM 预填充和 KV 缓存成本急剧上升的问题,提出基于 Zamba2 的混合 Mamba2 状态空间与少量共享注意力块的 Zamba2-VL,并系统消融视觉编码器与数据配比。结果显示其在图像理解、OCR、grounding、计数和推理上接近同规模 Molmo2、Qwen3-VL、InternVL3.5,显著优于既有 SSM VLM,且 TTFT 约低一个数量级,小模型更适合端侧部署。

αDepth: Learning Single-Pass Soft Boundary Decomposition for Stereo Conversion Figure 1
2026-06-02cs.CV

αDepth: Learning Single-Pass Soft Boundary Decomposition for Stereo Conversion

Xiang Zhang, Yang Zhang, Lukas Mehl, Karlis Martins Briedis, Markus Gross, Christopher Schroers

2026-06-02学习理论

这篇论文针对单目转立体中头发、虚化等软边界处前景/背景混色导致的深度歧义与渗色伪影,提出 αDepth 分层表示,同时估计局部边界的 alpha、前后景颜色和深度;其 CAR 将任务从全局抠图改为局部边界分解,可在复杂多目标场景中单次前向、无需人工提示。实验称其在立体转换上达到 SOTA,并减少背景 bleeding 与结构扭曲。

VESTA: Visual Exploration with Statistical Tool Agents Figure 1
2026-06-02cs.AI

VESTA: Visual Exploration with Statistical Tool Agents

William Rudman, Abhishek Divekar, Kanishk Jain, Sebastian Joseph, Stella S. R. Offner, Matthew Lease, Kyle Mahowald, Greg Durrett, Junyi Jessy Li

The University of Texas at Austin, New York University

2026-06-02视觉感知

论文针对科学流程中定量模型拟合难以自动化、现有 LLM/VLM 代理在复杂分布和领域任务上迭代改进不足的问题,提出 VESTA:让 VLM 在 PyMC 建模循环中动态选择或生成可复用的统计与可视化诊断工具,用图形反馈驱动假设修正。作者还构建 Dawn 基准,覆盖分布拟合、时间序列和天文任务;实验显示动态工具版在复杂与领域特定任务上优于既有代理流程,但仍未超过专家手写工具。

SUPREME: A Multi-GPU Framework for Reproducible Image Unlearning Method Evaluation Figure 1
2026-06-02cs.CV

SUPREME: A Multi-GPU Framework for Reproducible Image Unlearning Method Evaluation

Petros Andreou, Jamie Lanyon, Axel Finke, Georgina Cosma

2026-06-02视觉感知数据集/基准

图像分类机器遗忘评测需要在多随机种子下反复训练、遗忘和评估,单 GPU 框架难以支撑且单种子结论可能偏差。SUPREME 将数据集、模型、方法、指标和场景做成注册式组件,并用 Lightning Fabric 支持 DDP/FSDP/ZeRO,把三阶段分布到多 GPU。作者在 Pins Face Recognition 上用 ResNet18 与 ViT、全类和随机样本遗忘做十种子演示,显示不同种子下遗忘精度可相差数十个百分点,但实验仍局限于单数据集和单设备,方法排名结论有限。

Non-Learning Low-Light Stereo Vision Figure 1
2026-06-02cs.CV

Non-Learning Low-Light Stereo Vision

Jason Wang, Lucas Nguyen, Hyunseung Eom, Wei Xu, Qi Guo

2026-06-02视觉感知

本文针对低光/光子受限双目图像中噪声破坏纹理与匹配线索的问题,提出不依赖学习的稀疏视差框架:用 FoJ 保留长边缘、大块区域等粗结构并构建双向代价体,再以边界感知 SGM 动态调节平滑惩罚以避免跨真实深度边界过度平滑。实验显示其在严重噪声下的未遮罩像素精度优于近期双目和去噪后匹配方法,但输出主要是稀疏视差,FoJ 计算开销较高。

Score-Control for Hallucination Reduction in Diffusion Models Figure 1
2026-06-02cs.CV

Score-Control for Hallucination Reduction in Diffusion Models

Mahesh Bhosale, Naresh Kumar Devulapally, Abdul Wasi, Chau Pham, Vishnu Suresh Lokhande, David Doermann

University at Buffalo, University at Buffalo Buffalo NY USA

2026-06-02生成模型规划控制

本文关注扩散模型生成落在真实数据支持集外的“幻觉”样本,动机是提升图像生成可靠性。核心洞察是过度平滑的 score 场会让概率质量泄漏到低密度区域,并用 Lipschitz 常数给出形式化解释;据此提出 VSM,在训练中通过方差引导调制 score Jacobian,尤其约束后期去噪。实验在合成、真实及新建 ChessImages/Cards 基准上显示幻觉率最高降低约25%–26%,同时基本保持保真度和多样性。

LFA: Layer Feature Attention for Run-Time Introspection of 2D Object Detectors in Automated Driving Figure 1
2026-06-02cs.CV

LFA: Layer Feature Attention for Run-Time Introspection of 2D Object Detectors in Automated Driving

Mert Keser, Alois Knoll

2026-06-02视觉感知

面向自动驾驶中2D检测器难免失效且置信度/单层特征难以可靠预警的问题,论文提出LFA,将冻结检测器的多层骨干特征经GAP与投影后视作token,用轻量Transformer注意力自适应聚合,利用低层细节与高层语义对不同错误的互补性。在KITTI和BDD100K、多种检测架构上,LFA优于单层内省基线,并可通过层权重分析失效线索。

HiGS: A Hierarchical Rendering Architecture for Real-Time 3D Gaussian Splatting Figure 1
2026-06-02cs.CV

HiGS: A Hierarchical Rendering Architecture for Real-Time 3D Gaussian Splatting

Dawid Pająk, Martin Bisson, Rodolfo Lima

2026-06-02三维

本文针对 3D Gaussian Splatting 中分区偏好大 tile、光栅化偏好小 tile 的粒度冲突,提出 HiGS:用粗宏 tile 做分桶与分段深度排序,在其内部用细 render tile 光栅化,并按每个宏 tile 的高斯数量动态拆分批次以缓解密集区域尾部瓶颈。实验覆盖 Mip-NeRF 360 与大型 nvcampus 场景,在保持精确前向 alpha 合成的同时,相比原始 3DGS 最高提速约 15.8 倍,并优于评测中的其他光栅器。

UniVerse: A Unified Modulation Framework for Segmentation-Free,Disentangled Multi-Concept Personalization Figure 1
2026-06-02cs.CV

UniVerse: A Unified Modulation Framework for Segmentation-Free,Disentangled Multi-Concept Personalization

Quynh Phung, Sandesh Ghimire, Minsi Hu, Chung-Chi Tsai, Jia-Bin Huang

University of Maryland, College Park, Qualcomm Technologies, Inc.

2026-06-02视觉感知

UniVerse针对真实参考图常含多目标、遮挡或抽象风格而现有多概念个性化依赖分割掩码、易特征串扰的问题,提出统一参考条件提取器,用提示词同时抽取语义对齐的视觉条件与文本调制偏移,并经分割预训练到生成联合训练实现无分割的概念拆解与组合。实验在多个基准和新UniVerseBench上显示,其定位精度、身份保持和视觉质量优于现有方法,但仍存在概念泄漏和对模糊提示敏感的问题。

Training-Free Object-Agnostic Jam Detection in Fulfillment Centers Figure 1
2026-06-02cs.CV

Training-Free Object-Agnostic Jam Detection in Fulfillment Centers

Ruiliang Liu, Tina Dongxu Li, Joshua Migdal, Fernando Ruch, Kenneth Meszaros, Moses Trevor Dardik

2026-06-02视觉感知

面向履约中心传送带堵塞检测,论文针对传统“检测再跟踪”依赖大量标注且只能识别已知类别的问题,提出无需训练的物体无关方案:在空场景 AOI 内均匀布参考点,把持续遮挡而非点位移作为堵塞信号,并用时间与比例阈值判定。作者在 1,069 段内部视频上评估,AllTracker 版本达到 100.00% 精度和 93.33% F1,但数据集非公开,泛化边界仍需进一步验证。

Belief Consistency Between Foundation-Model Evidence and Geometric Perception in Persistent Robotic Maps Figure 1
2026-06-02cs.RO

Belief Consistency Between Foundation-Model Evidence and Geometric Perception in Persistent Robotic Maps

Christoffer Heckman, Harel Biggie, Brendan Crowe, Nicholas Roy

2026-06-02机器人

论文针对机器人持久语义地图中,基础模型语义证据未校准且可能与几何感知当场矛盾的问题,提出在贝叶斯更新前加入按类别校准的提交门和逐事件冲突丢弃窗口。该机制用几何通道作为在线验证源,拒绝不一致断言并保留可追溯更新;在 KITTI-360、ScanNet 上显著提升地图精度,KITTI 平均 IoU 从 0.180 提至 0.522,is_car 提交精度达 99.7%。

Where to Refine, When to Stop: Rethinking Redundancy via Latent Discrepancy for Efficient Visual Autoregressive Generation Figure 1
2026-06-02cs.CV

Where to Refine, When to Stop: Rethinking Redundancy via Latent Discrepancy for Efficient Visual Autoregressive Generation

Changwang Mei, Peisong Wang, Zekun Li, Changsheng Li, Shuang Qiu, Qinghao Hu, Gang Li, Yifan Zhang, Zhihui Wei, Jian Cheng

2026-06-02视觉感知

高分辨率 VAR 图像生成虽质量高但推理延迟大,现有基于层特征的 token 剪枝和固定 CFG 跳过难以适应语义差异。论文提出以对图像/潜空间输出影响来定义 Latent Discrepancy,并据此设计免训练的 LD-Pruning:用潜空间高频能量做无需解码的区域选择,用分支差异动态停止无条件分支。实验在 Infinity-2B/8B、HART 上保持质量的同时降延迟,Infinity-8B 最高加速 2.35×。

Real2SAM2Real: Generative 3D Caches as Complementary Context for Video Diffusion Figure 1
2026-06-02cs.CV

Real2SAM2Real: Generative 3D Caches as Complementary Context for Video Diffusion

Jiayi Wu, Haoming Cai, Cornelia Fermuller, Christopher Metzler, Yiannis Aloimonos

University of Maryland

2026-06-02视觉感知生成模型三维

这篇论文针对视频扩散模型在大视角运动、遮挡和非朗伯材质下只能依赖先验补全、易结构崩塌的问题,提出从单张图像生成可编辑、实例完整的3D几何缓存,并以实例掩码法线图和Soft Spatial-Aligned Injection注入VDM,在尽量保留预训练能力的同时提供显式3D约束。实验显示其可解耦控制相机轨迹与多物体运动,较传统warp-and-inpaint在遮挡、反射折射和大视角变化中保持更好的时空一致性。

Hyperbolic and Evidence-Prioritized Experts for Large Vision-Language Models Figure 1
2026-06-02cs.CV

Hyperbolic and Evidence-Prioritized Experts for Large Vision-Language Models

Zijie Zhou, Dandan Zhu, Hangxiangpan Wang, Heng Zhang, Huishen Jiao, Yi Zhao

China University of Petroleum (Beijing), Hainan Institute of China University of Petroleum (Beijing), South China Normal University, China University of Petroleum (Beijing) Beijing China, Hainan Institute of China University of Petroleum (Beijing) Sanya Hainan China, South China Normal University Foshan Guangdong China

2026-06-02视觉语言视觉感知

本文针对 LVLM 中 MoE 往往对视觉与语言采用对称专家、难以建模“文本描述包含于完整视觉场景”的层级关系,以及深层语言专家转向参数记忆而弱化输入证据的问题,提出 AsyMoE:保留模态内专家,引入双曲跨模态专家和证据优先语言专家。实验称其在 18 个基准上较 MoE 平均提升 1.5%,幻觉敏感任务最高提升 3.8%,且比稠密模型少激活 25.45% 参数。

StressDream: Steering Video World Models for Robust Policy Evaluation and Improvement Figure 1
2026-06-02cs.CV

StressDream: Steering Video World Models for Robust Policy Evaluation and Improvement

Junwon Seo, Sushant Veer, Ran Tian, Wenhao Ding, Apoorva Sharma, Karen Leung, Edward Schmerling, Marco Pavone, Andrea Bajcsy

Carnegie Mellon University, University of Washington, Stanford University, Video results are available at the project website: https://junwon.me/StressDream/.

2026-06-02视觉感知强化学习数据集/基准安全鲁棒

该文针对视频世界模型用于策略评估时只看“名义想象”会漏掉低概率但高影响失败的问题,提出 StressDream:在推理时优化扩散模型初始噪声,用 VLM 语义梯度把生成视频引向文本指定的碰撞、洒落等事件,同时用典型集约束保持可 plausibly。实验覆盖自动驾驶和机械臂,失败检出召回率由 54% 提升到 94%,并使 VLA 策略成功率由 39% 提升到 71%。

The Harsh Truth: Segment-Level Analysis of Harsh Driving Events in Milan Using Large-Scale Telematics, Street Networks, and Google Street View Figure 1
2026-06-02cs.CV

The Harsh Truth: Segment-Level Analysis of Harsh Driving Events in Milan Using Large-Scale Telematics, Street Networks, and Google Street View

Andrea La Grotteria, Paolo Santi, Titus Venverloo, Umberto Fugiglando, Carlo Ratti

2026-06-02视觉感知

针对警方事故记录滞后且不完整的问题,本文用米兰420万辆车载终端的急加速/急刹数据,融合TomTom流量、OSM路网与OneFormer分割的街景视觉特征做路段级安全分析。结果显示控制暴露后,宽车道、路口/公交站和更开阔视野对应更高风险,建筑界面更密集则较低;仅划线自行车道和混行路段的严苛事件强度分别高于物理隔离车道19.5%和11.5%。

LastAct: Trajectory-Guided Latest-Activity Localization for Real-Time Smart-Home Activity Recognition Figure 1
2026-06-02cs.CV

LastAct: Trajectory-Guided Latest-Activity Localization for Real-Time Smart-Home Activity Recognition

Zishuai Liu, Ruili Fang, Jin Lu, Fei Dou

School of Computing, University of Georgia, School of Computing, University of Georgia USA

2026-06-02视觉感知规划控制

针对智能家居连续传感流中滑窗常跨越活动边界、导致“最新活动”被旧上下文污染的问题,LastAct 将事件投影到户型图生成布局对齐轨迹序列,并用轻量门控与边界定位进行后边界掩蔽,同时缓存轨迹模板以降低在线开销。在四个公开数据集的近真实混合窗口协议下,其在纯窗口保持竞争力,并显著提升跨活动窗口的 Macro-F1。

APE: Agentic Prompt Enhancer for Image Generation and Editing Figure 1
2026-06-02cs.CV

APE: Agentic Prompt Enhancer for Image Generation and Editing

Zijian Huang, Jay Zhangjie Wu, Zian Wang, Tianshi Cao, Jiasi Chen, Sanja Fidler, Huan Ling, Xuanchi Ren

University of Michigan

2026-06-02视觉感知

论文关注文本到图像生成/编辑对提示词措辞高度敏感的问题,认为提示增强应作为可训练模块而非用户技巧。APE通过后训练小语言模型实现单代理SAPE和路由-重写-组合式多代理MAPE,在不改动下游视觉模型的情况下补全对象、属性、空间关系和编辑约束。实验显示,小模型增强器优于基座模型并缩小与闭源LLM增强器差距,MAPE在复杂组合任务上更突出。

Safe2Drive: Evaluating Safe Driving Behaviors of E2E Autonomous Driving Models Figure 1
2026-06-02cs.RO

Safe2Drive: Evaluating Safe Driving Behaviors of E2E Autonomous Driving Models

Nishad Sahu, Kalpana Panda, Congyuan Yu, Changzhong Qian, Shounak Sural, Ragunathan Rajkumar

Carnegie Mellon University, Birla Institute of Technology and Science Pilani

2026-06-02安全鲁棒

本文针对端到端自动驾驶在闭环基准高分但安全语义能力不明的问题,提出 Safe2Drive,在 Bench2Drive 上扩展施工区、行人横穿和遮挡 VRU 等 100 个高风险场景,并引入含预碰撞制动、施工物体接触、车道居中与平顺性的 SDS 指标。实验显示 LEAD、SimLingo 的驾驶分从原基准 94.7/85.07 降至 39.95/41.00,SDS 仅 11.85/15.27,暴露施工区理解、红灯遵守和行人制动的脆弱性。

MyoSem: Aligning Electromyography to Natural-Language Action Semantics for Hand Action Understanding Figure 1
2026-06-02cs.CV

MyoSem: Aligning Electromyography to Natural-Language Action Semantics for Hand Action Understanding

Chiyue Wang, Dong She, Yang Gao, Zhanpeng Jin

South China University of Technology

2026-06-02视觉感知

本文针对传统肌电手势识别依赖固定类别、难以按自然语言动作描述查询与泛化的问题,提出 MyoSem,将 EMG 信号与多视角动作文本构成的语义空间对齐。其核心在于用过程/规范/改写描述丰富标签,结合激活感知 EMG 编码器与语义查询机制保留局部肌肉证据并缩小模态差异。在 EMG2Pose、NinaPro 及截肢者迁移设置中,方法在 EMG-文本双向检索、未见用户和留出类别上优于多数基线。

UF-AMA: A unified framework for cross-domain emotion recognition via adaptive multimodal alignment Figure 1
2026-06-02cs.HC

UF-AMA: A unified framework for cross-domain emotion recognition via adaptive multimodal alignment

Zheng Wang, Shuo Wang, Junhong Wang

2026-06-02视觉语言视觉感知

该文针对生理信号情绪识别在跨被试、跨会话场景中因个体差异、情境变化和模态质量不均导致泛化不足的问题,提出 UF-AMA:用 Transformer 与跨注意力融合 EEG 和眼动,并通过置信度筛选、自适应一致性对齐、跨模态蒸馏及多层域适配同时校正模态局部与融合全局分布。实验在 SEED 和 SEED-IV 上报告跨被试、跨会话均达到 SOTA,但具体增益中各模块贡献仍需结合消融进一步判断。

Modeling Robotics Dataset Construction as an Artifact-Based Build Process Figure 1
2026-06-02cs.RO

Modeling Robotics Dataset Construction as an Artifact-Based Build Process

Leon Pohl, Lukas Beer, George Sebastian, Mirko Maehlisch

2026-06-02机器人数据集/基准

论文针对 ROS bag 到机器学习数据集转换常依赖顺序脚本、迭代慢且难复现的问题,将机器人数据集构建建模为带显式依赖和缓存工件的 Bazel 构建过程,并实现 Bagzel/Bagzel-xattr 支持 nuScenes 导出与服务端摘要管理。实验显示在 5.1–20.4GB 数据上较 rosbag2nuscenes 扩展性更好,20.4GB 暖启动最高加速 386.26 倍、增量构建 7.21 倍,但验证仍限于单机和中等规模数据。

Digital-to-Physical Transfer of Adversarial Patches for Aerial Vehicle Detection Figure 1
2026-06-02cs.CV

Digital-to-Physical Transfer of Adversarial Patches for Aerial Vehicle Detection

Jung Heum Woo, Eun-Kyu Lee

School of Information Technology, Incheon National University

2026-06-02视觉感知

论文关注航拍/卫星车辆检测在现实物理对抗贴片下的安全性,针对以往多停留在地面场景的问题,构建从数字优化到打印部署的评测流程,并比较车顶 ON、车旁 OFF、双侧 OFF-Side 等布置。结果显示数字域中 OFF 最高可达 85.51% AORR,但真实环境里 ON 因可见性更稳定,OSR 为 0.197–0.343;天气增强未必带来收益,TV 正则需适中。

Training-Free Continuous Bitrate Control for Scalable Image Coding for Humans and Machines Figure 1
2026-06-02eess.IV

Training-Free Continuous Bitrate Control for Scalable Image Coding for Humans and Machines

Yui Tatsumi, Hiroshi Watanabe

2026-06-02视觉感知规划控制

面向交通监控等“机器常看、人偶尔看”的场景,现有可伸缩图像编码难以连续调码率。本文将基于超先验尺度的自适应量化无训练地扩展到机器层与增强层,用参数独立控制两层码率并保护高重要性潜变量。在 COCO 上,码率下降时检测/分割精度平滑退化,重建 RD 优于均匀量化;同时显示最优两层码率分配取决于识别与人眼重建目标。

DiffCrossGait: Trajectory-Level Alignment for 2D-3D Cross-Modal Gait Recognition via Latent Diffusion Figure 1
2026-06-02cs.CV

DiffCrossGait: Trajectory-Level Alignment for 2D-3D Cross-Modal Gait Recognition via Latent Diffusion

Zhiyang Lu, Ming Cheng

2026-06-02视觉感知生成模型规划控制三维

该文针对2D轮廓与3D LiDAR range-view步态在结构与域分布上难以直接对齐的问题,提出将跨模态匹配从最终嵌入约束改为潜在扩散轨迹对齐:两模态共享高斯噪声,并按三阶段噪声强度分别约束身份锚定、去噪动态一致和跨模态可恢复性。扩散分支仅用于训练,推理仍走判别骨干;在SUSTech1K与FreeGait上报告达到SOTA。

StemBind: When MLLMs Get Lost Between Rules and Instances in Abstract Visual Reasoning Figure 1
2026-06-02cs.CV

StemBind: When MLLMs Get Lost Between Rules and Instances in Abstract Visual Reasoning

Xixiang He, Baiqi Wu, Xingming Li, Ao Cheng, Qiyao Sun, Xuanyu Ji, Qingyong Hu

National University of Defense Technology, Zhejiang University, Intelligent Game and Decision Lab

2026-06-02视觉感知

本文针对现有抽象视觉推理评测只看最终答案、无法区分“看不见、不会归纳规则、不会把规则对应到选项”的问题,提出共享题干诊断基准 StemBind,用同一视觉证据设计感知、规则和完整作答三类问题,并标注四阶段推理过程。对24种MLLM评测发现,多数模型规则识别显著好于最终作答;即使感知和规则都正确,仍有51.2%答错,主要瓶颈定位在规则到实例的绑定阶段,且模型变大或开启思考模式并未稳定修复。

Multi-Contrast MRI Motion Correction via Parameter-Informed Disentanglement and Adaptive Experts Figure 1
2026-06-02eess.IV

Multi-Contrast MRI Motion Correction via Parameter-Informed Disentanglement and Adaptive Experts

Honglin Xiong, Yuxian Tang, Feng Li, Yulin Wang, Lei Xiang, Dinggang Shen, Qian Wang

2026-06-02视觉感知

针对现有MRI运动校正模型常绑定特定对比度、难适应不同伪影强度的问题,论文用扫描参数驱动的ScanCLIP分离对比度与解剖/运动信息,再由ViT估计严重度并通过MoE自适应选择校正专家,双路径同时重建净图和残差伪影。在IXI、HCP上较SOTA提升约0.75 dB PSNR、SSIM最高提升2.79%,且在未见真实临床扫描参数上表现出较好的零样本泛化。

Geodesics with Unified Tangent-constrained Priors and Curvature Regularization Figure 1
2026-06-02cs.CV

Geodesics with Unified Tangent-constrained Priors and Curvature Regularization

Chong Di, Li Liu, Jinglin Zhang, Zhenjiang Li, Da Chen, Laurent D. Cohen

Shandong Artificial Intelligence Institute, Qilu University of Technology (Shandong Academy of Sciences), Jinan, Shandong, China, Yuanshen Rehabilitation Institute, Shanghai Jiao Tong University School of Medicine, Shanghai 200025, China, School of Control Science and Engineering, Shandong University, Jinan, Shandong, China, Department of Radiation Oncology, Shandong Cancer Hospital and Institute, Shandong First Medical University, Shandong Academy of Medical Sciences, Jinan, Shandong, China

2026-06-02视觉感知

针对曲率惩罚测地线在弱边界、复杂形状中易走“捷径”的问题,论文把由骨架或内部标记等内在形状代表生成的切向可行扇区嵌入方向提升空间,形成带硬切向约束的 Finsler 度量,并与 RS、Dubins、Euler–Mumford 等曲率正则统一到 HJB/快速行进求解框架中。合成、自然和医学图像实验显示,该方法能减少拓扑捷径、提升形状一致性,优于若干经典测地线及部分图模型/学习基线。

Advances in Neural 3D Mesh Texturing: A Survey Figure 1
2026-06-02cs.CV

Advances in Neural 3D Mesh Texturing: A Survey

Sai Raj Kishore Perla, Hao Zhang, Ali Mahdavi-Amiri

Simon Fraser University

2026-06-02三维

本文关注网格仍是游戏、动画和建模流水线核心表示下,神经方法如何降低人工 UV 展开与贴图制作成本。其主要贡献不是新模型,而是把神经 3D 网格纹理化按 GAN/前馈生成、CLIP 优化、SDS/扩散管线、人像与 PBR 材质等脉络统一梳理,并比较架构、监督、数据集和评测。主要结果是给出领域版图与开放问题:效率、多视角一致性、光照下物理真实性和标准基准仍未充分解决。

Positional Encodings Anchor Spatial Structure in Vision Transformers: A Geometric Perspective on Robustness Figure 1
2026-06-02cs.CV

Positional Encodings Anchor Spatial Structure in Vision Transformers: A Geometric Perspective on Robustness

Mahmoud Mannes

2026-06-02视觉感知安全鲁棒

本文关注 ViT 中位置编码为何影响鲁棒性,而不只比较精度。作者提出 SSDC 表征几何指标,并结合推理/训练时随机 token 置换,区分空间结构来自内容还是锚定索引。结果显示,无位置编码的 ViT 也会形成空间结构但置换后崩塌;APE、正弦和 RoPE 都提供稳定位置参考框架,使内容破坏型分布偏移下更稳健,编码形式差异相对次要。

CardioLens: Revealing the Clinical Reality Gap of MLLMs via Multi-Sequence Cardiac MRI Evaluations Figure 1
2026-06-02cs.CV

CardioLens: Revealing the Clinical Reality Gap of MLLMs via Multi-Sequence Cardiac MRI Evaluations

Zixian Su, Hongkai Zhang, Fan Gao, Encheng Su, Taiping Qu, Jingwei Guo, Nan Zhang, Hui Wang, Zhen Zhou, Kairui Bo, Yan Chen, Yue Ren, Shuai Li, Lei Xu, Henggui Zhang

Beijing Academy of Artificial Intelligence, Beihang University, King Abdullah University of Science and Technology

2026-06-02数据集/基准

现有医学 MLLM 评测多依赖公开、孤立图像和简化 VQA,难以反映真实诊断流程。CardioLens 用私有医院多序列心脏 MRI 构建抗泄漏基准,覆盖 Cine、LGE、灌注和 T2,并按图像理解、报告生成、疾病诊断三级评估。对 24 个模型测试显示性能整体较差且随流程加深下降,存在类别塌缩;换切片策略仅约 1% 影响,显式推理提示也未能改善。

Versatile Framework with Semantic and Structural guidance for Image Reconstruction from Brain Activity Figure 1
2026-06-02cs.CV

Versatile Framework with Semantic and Structural guidance for Image Reconstruction from Brain Activity

Yizhuo Lu, Changde Du, Qiongyi Zhou, Liuyun Jiang, Huiguang He

2026-06-02视觉感知三维

针对脑活动重建图像中语义可辨但位置、方向、大小等结构不稳定的问题,本文提出 MindDiffuser:先用解码的 CLIP 文本嵌入驱动 Stable Diffusion 生成语义初稿,再以浅层 CLIP 视觉特征反向优化结构,对应腹侧/背侧视觉通路。实验覆盖 fMRI、EEG、MEG 和多类生成模型,普遍提升低层结构指标,但高层语义增益有限,EEG 上改善较弱。

Physics from Video: Identifiability of Time-Invariant Second-Order ODEs under Minimal Trajectory Conditions Figure 1
2026-06-02cs.CV

Physics from Video: Identifiability of Time-Invariant Second-Order ODEs under Minimal Trajectory Conditions

Yuanyuan Wang, Wenjie Wang, Kun Zhang, Mingming Gong

2026-06-02视觉感知规划控制

论文针对视频世界模型“像素逼真但物理不可靠”的问题,研究无解码器、仅编码器从原始视频识别二阶线性常微分方程参数的可辨识性。核心洞察是提出 level-set slope coverage 条件,使潜变量只能与真实物理状态局部仿射,从而保证参数唯一恢复;结果表明欠阻尼系统单条足够长视频即可识别,临界/过阻尼等情形需三条多样轨迹,并用 variance-floor 正则缓解潜变量坍塌。

Recursive Vision Transformer with Dynamic Depth and Width Adjustment for Resource-Efficient Image Semantic Communication Figure 1
2026-06-02cs.CV

Recursive Vision Transformer with Dynamic Depth and Width Adjustment for Resource-Efficient Image Semantic Communication

Zhilong Zhang, Xinhui Zhang, Gongyu Jin, Sihua Wang, Danpu Liu, Changchuan Yin

with Beijing Laboratory of Advanced Information Network, and the Beijing, Key Laboratory of Network System Architecture and Convergence, Beijing, University of Posts and Telecommunications, Beijing 100876, China

2026-06-02视觉感知

面向图像语义通信在端侧部署时参数量和计算量过高的问题,本文将 ViT 编码器做成递归共享模块,并在推理阶段按图像内容与信道状态动态调节深度、按重要性裁剪神经元和注意力头,进一步联合宽深配置。实验显示该方案参数量减少 48.7%,在相近计算复杂度下重建质量优于对比方法。

Evolving to the Aesthetics of a Vision-Language Model Figure 1
2026-06-02cs.NE

Evolving to the Aesthetics of a Vision-Language Model

Stephen James Krol, Jon McCormack

SensiLab, Monash University

2026-06-02视觉语言视觉感知

面向抽象/非具象参数化生成设计中难以手工定义审美适应度的问题,论文比较了两种借助预训练视觉语言模型的进化评价方式:CLIP-IQA 单图打分,以及用 Qwen3-VL 按用户提示做成对偏好比较并以 Glicko 汇总排名。实验与艺术家研究显示,两者与人工审美排序相关性相近;CLIP-IQA 计算更便宜,但可控性弱,成对 VLM 更符合创作者意图却代价高且仍需个性化。

ChWDTA: Channel-wise Wavelet-Domain Transformer Attention and Entropy Modeling for Learned Image Compression Figure 1
2026-06-02eess.IV

ChWDTA: Channel-wise Wavelet-Domain Transformer Attention and Entropy Modeling for Learned Image Compression

Haisheng Fu, Runyu Yang, Feng Ding, Siyu Zhu, Jie Liang, Xiaoxiao Li, Zhenman Fang, Jingning Han

Haisheng Fu and Xiaoxiao Li are with the Electrical and Computer Engineering Department, The University of British Columbia, Vancouver, BC, Canada

2026-06-02视觉感知

针对混合 CNN–Transformer 学习式图像压缩中通道相关性仍较强、切片熵模型难以匹配潜变量协方差的问题,论文将可逆的通道小波变换嵌入窗口空间注意力的 Q/K/V 投影,并用通道小波包生成均衡子带以适配 ChARM 熵编码。8-slice 模型在 Kodak、CLIC Pro、Tecnick 上相对 VTM 9.1 分别取得 −17.82%、−19.15%、−22.56% BD-rate,4-slice 则以较低复杂度保留大部分增益。

General Covariant Action Modeling: Constructing Generalized Manifolds via Spatio-Temporal Decoupling Figure 1
2026-06-02cs.CV

General Covariant Action Modeling: Constructing Generalized Manifolds via Spatio-Temporal Decoupling

Huaihai Lyu, Chaofan Chen, Mingyu Cao, Yuheng Ji, Changsheng Xu

2026-06-02视觉感知

本文针对 VLA/机器人模仿学习中直接回归绝对动作坐标导致的坐标系依赖、速度绑定和多模态平均问题,提出 Generalized Action Manifold:用弧长参数化解耦轨迹形状与执行速度,并通过 Schema-Affine-Factorization 将轨迹规范化为世界线,分离不变动作 schema 与位姿/尺度调制。实验显示该结构先验在空间与时间分布偏移下优于不含几何约束的基线,但具体增益的任务覆盖与规模依赖仍需进一步核实。

VDSB-GWSyn: Diffusion Schrödinger Bridge for Controllable and Anatomically Feasible Guidewire Synthesis in Coronary Angiography Figure 1
2026-06-02cs.CV

VDSB-GWSyn: Diffusion Schrödinger Bridge for Controllable and Anatomically Feasible Guidewire Synthesis in Coronary Angiography

Haoyuan Tang, Zhuo Zhang, Jialin Li, Shuai Xiao, Jiachen Yang

2026-06-02生成模型规划控制

针对冠脉造影中导丝标注稀缺、端点弱可见导致机器人 PCI 感知难训练的问题,VDSB-GWSyn先学习导丝形状先验,并在血管分割约束下生成解剖可行的掩码和端点,再用带 SPADE 条件的扩散 Schrödinger Bridge 只在掩码区域修补,尽量保持真实背景不变。合成数据用于预训练后再真实微调,使端点定位 MPE 从16.01px降至7.71px,3px PCK 从52.63%升至86.27%;但质量仍依赖血管分割,复杂重叠血管下可能需人工剔除。

Visual-Noise Guided In-Context Distillation for Multimodal Large Language Model Unlearning Figure 1
2026-06-02cs.CV

Visual-Noise Guided In-Context Distillation for Multimodal Large Language Model Unlearning

Junkai Chen, Yuhao He, Junxiang You, Ruiqi Liu, Chenyu Wang, Shu Wu

Institute of Automation, Chinese Academy of Sciences, School of Advanced Interdisciplinary Sciences, UCAS

2026-06-02视觉语言

针对多模态大模型可能通过图像与文本触发隐私/受限知识、而现有训练式遗忘损害能力、纯上下文遗忘又不改参数且易被反向攻击的问题,论文提出 Vgid:用视觉噪声加文本遗忘指令从冻结基模型构造教师分布,再蒸馏到学生模型实现参数级遗忘。MLLMU-Bench 上其在多模型和任务中降低遗忘集泄露,例如代表设置下 forget ROUGE-L 降 0.371,retain ROUGE-L 仅降 0.055。

CoCoVideo: The High-Quality Commercial-Model-Based Contrastive Benchmark for AI-Generated Video Detection Figure 1
2026-06-02cs.CV

CoCoVideo: The High-Quality Commercial-Model-Based Contrastive Benchmark for AI-Generated Video Detection

Huidong Feng, Wentao Chen, Jie Chen, Xinqi Cai, Ruolong Ma, Yinglin Zheng, Yuxin Lin, Ming Zeng

School of Informatics, Xiamen University, China Academy of Information and Communications Technology, AI Transcend Pte. Ltd.

2026-06-02视觉感知数据集/基准

现有 AIGC 视频检测数据多来自开源生成器,质量与商业模型差距大,易导致检测器过拟合低质伪造痕迹。本文构建 CoCoVideo-26K,用 13 个商业视频模型生成与真实视频语义对齐的真假配对,并提出结合时空对比学习与置信度门控 MLLM 推理的 CoCoDetect。实验显示其在自建和公开基准上达到 SOTA,并具备较好的跨数据集泛化,但部分增益可能主要来自更高质量数据。

CoilDrop-MRI: Self-supervised physics-guided MRI reconstruction with coil dropout Figure 1
2026-06-02cs.CV

CoilDrop-MRI: Self-supervised physics-guided MRI reconstruction with coil dropout

Tongxi Song, Ziyu Li, Zihan Li, Wen Zhong, Congyu Liao, Yang Yang, Hua Guo, Wenchuan Wu, Qiyuan Tian

School of Biomedical Engineering, Tsinghua Medicine, Tsinghua University, Beijing, China, Oxford Centre for Integrative Neuroimaging, FMRIB, Nuffield Department of Clinical Neurosciences, University of Oxford, Oxford, UK, Department of Radiology & Biomedical Imaging, University of California San Francisco, San Francisco, *Correspondence to: Qiyuan Tian, Center for Biomedical Imaging Research, Tsinghua University, 30

2026-06-02三维

针对监督式 MRI 重建依赖全采样参考、现有自监督方法只在 k-space 划分数据而忽略线圈间冗余的问题,CoilDrop-MRI 通过随机丢弃部分接收线圈、用被丢弃线圈作为训练目标,在 SENSE 与 SPIRiT 展开框架中学习重建。实验覆盖 0.3T/0.55T/3T、多对比度和多发射 dMRI,结果显示其优于 SSDU 等自监督基线,接近监督方法,并具备少样本与跨域泛化能力。

Segmentation-Guided Spatial Indexing for Generalizable and Explainable Deepfake Detection Figure 1
2026-06-02cs.CV

Segmentation-Guided Spatial Indexing for Generalizable and Explainable Deepfake Detection

Izaldein Al-Zyoud, Abdulmotaleb El Saddik

2026-06-02视觉感知

针对跨数据集 Deepfake 检测易被全脸压缩痕迹、背景等捷径干扰且事后热力图难以解释的问题,论文提出“先分割、再筛选、后池化”的空间索引:用冻结 FaRL 为 DINOv3 patch 标注语义区域,仅保留如嘴部 token 训练线性探针。结果显示无需微调和目标域数据,在 Celeb-DF v2/DFD 上 AUC 达 0.905/0.930;去掉区域索引或换用 FaRL 特征均显著下降,说明增益主要来自冻结 DINOv3 表征与预池化语义筛选的组合。

Diversity Over Frequency: Rethinking Tool Use in Visual Chain-of-Thought Agents Figure 1
2026-06-02cs.CV

Diversity Over Frequency: Rethinking Tool Use in Visual Chain-of-Thought Agents

Dong-Hee Kim, Reuben Tan, Donghyun Kim

2026-06-02视觉感知

针对视觉链式思维代理在复杂视觉推理中是否应频繁调用外部工具的问题,论文从3D空间推理与医学VQA出发,发现强化微调会出现“工具使用坍缩”:准确率上升但工具调用趋近消失;单纯奖励用工具也只带来有限增益。其核心洞察是性能关键不在调用频率,而在训练早期的文本与视觉探索多样性;加入自适应熵正则后,即便后期工具使用下降,仍取得最佳表现,支持“工具作为训练脚手架”的观点。

Bridging the 2D-3D Gap: A Hierarchical Semantic-Geometric Map for Vision Language Navigation Figure 1
2026-06-02cs.CV

Bridging the 2D-3D Gap: A Hierarchical Semantic-Geometric Map for Vision Language Navigation

Kailing Li, Tianwen Qian, Lijin Yang, Yuqian Fu, Jingyu Gong, Xiaoling Wang, Liang He

School of Computer Science and Technology, East China Normal University, King Abdullah University of Science and Technology

2026-06-02机器人视觉感知三维

论文针对 VLM 在视觉语言导航中擅长语义与 2D 感知、却缺乏 3D 空间推理和低层运动控制的问题,提出无需训练的 HSGM:用几何、语义、决策三层语义几何地图把 3D 环境转成 VLM 可读的 BEV 表示,并让 VLM 只选有效航点、A* 负责避障执行,同时用子任务管理缓解长程遗忘。在 R2R-CE 和 RxR-CE 上零样本成功率达 47.9% 和 41.8%,超过现有零样本方法及部分监督方法。

Diffusion Image Generation with Explicit Modeling of Data Manifold Geometry Figure 1
2026-06-02cs.CV

Diffusion Image Generation with Explicit Modeling of Data Manifold Geometry

Duoduo Xue, Zhiyu Zhu, Junhui Hou

2026-06-02视觉感知生成模型

论文针对连续扩散虽依赖低维数据流形假设、却通常在无界欧氏空间建模的问题,提出 MIND:先用离散 patch token 保留结构信息,再将 token 映射到低维超球面,在连续扩散中显式建模流形几何,并用 soft top-k、双分支高频嵌入和分阶段采样连接训练与推理。在 ImageNet-256 上,MIND-B 80 epoch 无引导 FID 为 22.73,显著优于 DiT-B/2 的 43.47;有引导时 130M 参数达 FID 2.06,MIND-XL 达 1.95。

Aligning Cellular Sheaves with Classifier Attention for Interpretable Weakly-Supervised Pathology Localization Figure 1
2026-06-02cs.CV

Aligning Cellular Sheaves with Classifier Attention for Interpretable Weakly-Supervised Pathology Localization

Devansh Lalwani, Swapnil Bhat, Maulik Shah

2026-06-02视觉感知

针对弱监督病理全切片中 ABMIL 分类已强但注意力定位不可靠的问题,论文把切片 patch 构成图,引入 cellular sheaf 的局部不一致场,并提出用分类器注意力差异而非特征相似度来监督邻域一致性。联合训练后,Camelyon16 patch 定位中 sheaf AUC 达 0.940,注意力 AUC 从 0.717 提升到 0.953;冻结分类器消融仅到 0.727,显示增益来自表示与 sheaf 目标的协同适配,并可零微调迁移到 Camelyon17。

Structured Visual Evidence Decomposition for Evidence-Grounded Multimodal Screening of Obstructive Sleep Apnea-Hypopnea Syndrome Figure 1
2026-06-02cs.CV

Structured Visual Evidence Decomposition for Evidence-Grounded Multimodal Screening of Obstructive Sleep Apnea-Hypopnea Syndrome

Chen Zhan, Yingchen Wei, Xiaoyu Tan, Jingjing Huang, Xihe Qiu

School of Electronic and Electrical Engineering, Shanghai University of Engineering Science, Shanghai 200438, China, Tencent Youtu Lab, Shanghai 200233, China, ENT Institute and Department of Otorhinolaryngology, Eye & ENT Hospital of Fudan University, Shanghai 200031, China, National University of Singapore, 9 Engineering Drive 1, Singapore 117575, Singapore

2026-06-02视觉语言

针对 PSG 前 OSAHS 筛查成本高且直接多模态提示易失准的问题,论文提出 EviOSAHS:先用七个解剖部位问题从正面人脸提取可审计视觉证据卡,再与结构化临床资料交由 LLM 做二分类裁决。在 642 人队列上达到 88.47% 准确率、94.86% 敏感度和 5.14% 假阴性率,优于临床-only、直接多模态和朴素两阶段基线,但仍需外部验证与校准。

Planktonzilla: Multimodal dataset and models for understanding plankton ecosystems Figure 1
2026-06-02cs.CV

Planktonzilla: Multimodal dataset and models for understanding plankton ecosystems

Alan Gerson Contreras Montanares, Luis Valenzuela, Luis Martí, Nayat Sanchez-Pi

Inria Chile Research Center, to isolated training datasets and inconsistent labels. To address this, we introduce, Planktonzilla-17M, a unified dataset consolidating publicly available plankton, existing studies still rely on isolated datasets with limited taxonomic breadth [4]. Moreover, labels, ∗Dataset and models are publicly available at https://huggingface.co/datasets/project-oceania/. Code use to, train and evaluate the models and generate the Planktonzilla-17M is available at https://github.com/Inria-Chile/, available georeferenced environmental metadata, we provide, to our knowledge, the most comprehen-, datasets using the World Register of Marine Species (WoRMS), retaining each label at its deepest, reproducible training, validation, and test splits stratified by source dataset and taxonomic labels, taxonomic classes, paired with available geo-environmental metadata—to our knowledge

2026-06-02视觉语言数据集/基准

针对浮游生物图像数据分散、跨设备/海域分布偏移和分类标签层级不一致导致模型难泛化的问题,本文构建 Planktonzilla-17M,将13种成像系统的1740万图像按 WoRMS 统一分类,并加入地理环境元数据与可复现实验划分。实验显示,在共享 ViT 骨干上,监督分类器可匹配或超过基于分类谱系文本的 CLIP 式训练,BioCLIP/BioCLIP2 在该领域零样本和少样本表现较弱,性能提升可能主要来自更大且更一致的领域数据。

Flow-Based Generative Modeling for Optimizing Sampling Policies in Compressed Sensing Applications Figure 1
2026-06-02cs.CV

Flow-Based Generative Modeling for Optimizing Sampling Policies in Compressed Sensing Applications

Roman Pavelkin, Luis A. Zavala-Mondragon, Christiaan G. A. Viviers, Fons van der Sommen

Eindhoven University of Technology

2026-06-02生成模型

压缩感知中采样掩码离散、组合空间大,传统或启发式采样难以适配具体重建/分类任务。本文将 Flow Matching 从信号生成改为在采样空间生成任务条件化的子采样策略,并与下游模型联合优化。实验显示其在低采样率图像重建和 8× fastMRI 加速中优势明显,CelebA 5% 采样达 25.17 dB,fastMRI 8× 重建达 29.24 dB/SSIM 0.7163;MNIST 分类提升随机掩码但弱于 A-DPS。

Improved Belief-Attention in Vision Task Figure 1
2026-06-02cs.CV

Improved Belief-Attention in Vision Task

Guoqiang Zhang

University of Exeter

2026-06-02视觉感知

针对 Belief-Attention 只保留正交投影后的垂直分量、可能丢弃有用 token 相关信息的问题,论文通过消融指出投影分量同样有价值,并提出 Belief2-Attention:用激活和线性映射处理投影分量,同时可在 QK 相似度外加入 ZZᵀ 捕获更丰富相关性。图像分类与分割实验显示其优于标准 Attention,但增益伴随额外参数,部分来源仍需更细致拆解。

DefocusTrackerAI -- A Generalized Framework for the Automatic Detection of Defocused Particle Images Figure 1
2026-06-02cs.CV

DefocusTrackerAI -- A Generalized Framework for the Automatic Detection of Defocused Particle Images

Gonçalo Coutinho, Ana S. Moita, António L. N. Moreira, Massimiliano Rossi

IN+ Center for Innovation, Technology and Policy Research, Instituto Superior Técnico, University of Lisbon, Lisbon, Portugal, CINAMIL - Military Academy Research Center, Militart Academy, Portugal, IN+ Center for Innovation, Technology and Policy Research, Instituto Superior Técnico, University of Lisbon, Lisbon,Portugal, Department of Industrial Engineering, Alma Mater Studiorum University of Bologna, Bologna, Italy

2026-06-02视觉感知

针对散焦粒子跟踪中高密度场景检测率与定位不确定性难以兼顾、且模型常需按光学系统重训的问题,本文用 MicroSIG 合成多种散光/非散光粒子图像训练通用检测器,并比较 Faster R-CNN 与 YOLOv9。结果显示 YOLOv9 在高粒子密度下召回更高、不确定性更低,Ns≤0.5 时约 0.1–0.4 像素,并能迁移到荧光、阴影法等真实 DPT/喷雾液滴实验;但泛化增益可能主要来自合成数据覆盖与模型 scaling。

From Human Videos to Robot Manipulation: A Survey on Scalable Vision-Language-Action Learning with Human-Centric Data Figure 1
2026-06-02cs.RO

From Human Videos to Robot Manipulation: A Survey on Scalable Vision-Language-Action Learning with Human-Centric Data

Zhiyuan Feng, Qixiu Li, Huizhi Liang, Rushuai Yang, Yichao Shen, Zhiying Du, Zhaowei Zhang, Yu Deng, Li Zhao, Hao Zhao, Zongqing Lu, Oier Mees, Marc Pollefeys, Jiaolong Yang, Baining Guo

Tsinghua University, Xi’an Jiaotong University, Fudan University, Peking University

2026-06-02机器人视觉语言视觉感知

这篇综述针对 VLA 机器人操作受限于昂贵、具身绑定的机器人示教数据这一瓶颈,讨论如何把海量人类视频转化为可用于策略学习的动作相关信号。核心洞察是按信号形态而非模型架构划分四条桥接路径:潜在动作、预测世界模型、显式 2D 线索和显式 3D 结构。主要结果是给出数据集与监督信号地图,并总结视频分段、具身/视角对齐和更能预测真实部署的评测三类关键挑战。

When Jokes Cross the Line: Analyzing Regular Humor and Dark Humor in YouTube Shorts Figure 1
2026-06-02cs.MM

When Jokes Cross the Line: Analyzing Regular Humor and Dark Humor in YouTube Shorts

Sydney Johns, Sanjeev Parthasarathy, Shantnu Bhalla, Vaibhav Garg

Virginia Polytechnic Institute and State University, Virginia Polytechnic Institute and State University Alexandria Virginia USA

2026-06-02视觉感知

短视频平台上黑色幽默常处于“允许但可能伤害”的审核灰区,论文为此构建 TwistedHumor:含 1,211 个 YouTube Shorts 与 33,041 条评论,并标注幽默类型、伤害、主题和修辞。分析显示黑色幽默并非单一类别,常围绕批判、应对、尴尬和身份表达;普通幽默评论更正向,黑色幽默反应更混合且有时更具毒性,LLM 在单口喜剧上优于短笑话。

Shu Dao: A Calligraphy Score Framework Linking Calligraphy, Music, and Performance Figure 1
2026-06-02cs.HC

Shu Dao: A Calligraphy Score Framework Linking Calligraphy, Music, and Performance

Lican Huang

2026-06-02视觉感知

针对传统书法数字表示只保留静态字形、难以表达笔顺、节奏、力度与身体现象的问题,本文提出 CWSR 与“Shu Dao”框架,将书法建模为类似乐谱的可执行动作序列,编码笔画、结构、章法和动态属性。文中展示 AI agent 可从 Score JSON 生成不同风格的 SVG 书法,并具备可复现、可解释和生成性;但实验主要是概念与示例验证,量化效果和真实笔触增益文中未充分说明。

2026-06-01

147 篇
Representation Forcing for Bottleneck-Free Unified Multimodal Models Figure 1
2026-06-01cs.CV

Representation Forcing for Bottleneck-Free Unified Multimodal Models

Yuqing Wang, Zhijie Lin, Ceyuan Yang, Yang Zhao, Fei Xiao, Hao He, Qi Zhao, Zihan Ding, Fuyun Wang, Shuai Wang, Youliang Zhang, Haoqi Fan, Xihui Liu

2026-06-01视觉语言

本文针对统一多模态模型生成端依赖冻结 VAE 导致的结构瓶颈,提出 Representation Forcing:让解码器先自回归预测来自自身理解编码器的视觉表征,再以这些中间 token 在同一骨干中引导像素空间扩散。结果显示,去掉外部 VAE 后的像素模型在图像生成上可匹配 VAE 基线,并在理解任务上通常更优;但从头多模态预训练与视频扩展仍未充分验证。

Lumos-Nexus: Efficient Frequency Bridging with Homogeneous Latent Space for Video Unified Models Figure 1
2026-06-01cs.CV

Lumos-Nexus: Efficient Frequency Bridging with Homogeneous Latent Space for Video Unified Models

Jiazheng Xing, Hangjie Yuan, Lingling Cai, Xinyu Liu, Yujie Wei, Fei Du, Hai Ci, Tao Feng, Jiasheng Tang, Weihua Chen, Fan Wang, Yong Liu

Zhejiang University, DAMO Academy, Alibaba Group, Hupan Lab, National University of Singapore, Hong Kong University of Science and Technology, Fudan University, Tsinghua University

2026-06-01视觉感知

针对连接式视频统一模型难以在训练中接入大规模高保真扩散生成器、导致语义推理与画质难兼得的问题,Lumos-Nexus 训练时仅对齐同潜空间的小生成器,推理时用 UPFB 将生成过程逐步交给大生成器做由粗到细细化。实验显示其在 VBench 的真实感与时序一致性提升,并在新提出的 VR-Bench 上保持较强推理驱动生成能力。

Linear Scaling Video VLMs for Long Video Understanding Figure 1
2026-06-01cs.CV

Linear Scaling Video VLMs for Long Video Understanding

Cristobal Eyzaguirre, Jiajun Wu, Juan Carlos Niebles

2026-06-01视觉语言视觉感知

长视频 VLM 在自动驾驶、具身机器人等流式场景中受限于时空自注意力的二次预填充开销。论文提出 StateKV:在不改架构、不微调的推理阶段,用固定容量、重要性驱动的跨帧循环状态保留时间 sink,同时保留完整逐帧缓存供解码,从而把视频预填充降为线性复杂度。实验覆盖 3 个长视频基准、7 个模型和多种规模,性能更接近全注意力并优于滑窗/近因式 ReKV,在相同 FLOPs 预算下可运行更大模型取得更好精度。

SOCO: Benchmarking Semantic Object Correspondence in Vision Foundation Models Figure 1
2026-06-01cs.CV

SOCO: Benchmarking Semantic Object Correspondence in Vision Foundation Models

Olaf Dünkel, Basavaraj Sunagad, Haoran Wang, David T. Hoffmann, Christian Theobalt, Adam Kortylewski

Max Planck Institute for Informatics, Saarland Informatics Campus, CISPA Helmholtz Center for Information Security, University of Freiburg, within-category score—recognizing the same local concept (e.g. a wheel center), center on a car, bus, or tractor) at all. This ambiguity limits current evaluations

2026-06-01视觉感知数据集/基准

现有语义对应基准难以区分局部部件识别、重复部件定位和跨类别迁移,限制了对机器人所需结构化物体理解的评估。SOCO提出基于分类体系的语义物体对应定义,覆盖100类、超100万对应对,并加入关键点语言描述以测试VFM/LVLM。实验显示强视觉骨干仍易混淆重复部件、跨类泛化弱,LVLM更擅长文本提示定位而非跨图匹配,且SOCO成绩比ImageNet分类更能预测分割、跟踪和3D任务表现。

KLIP: localized distribution shift detection via KL-divergence with diffusion priors in Inverse Problems Figure 1
2026-06-01cs.CV

KLIP: localized distribution shift detection via KL-divergence with diffusion priors in Inverse Problems

Alireza Kheirandish, Jihoon Hong, Sara Fridovich-Keil

Georgia Institute of Technology, School of Electrical and Computer Engineering, are available at inference time in an inverse problem, and, well when both ID and OOD data is available, they are not

2026-06-01视觉感知生成模型

该文针对逆问题成像中只能观察间接测量、且异常常以小病灶等局部形式出现的分布偏移检测难题,提出 KLIP:用扩散先验与测量后验之间的 KL 散度,并在采样时间窗和图像块上局部化估计,无需 OOD 校准数据。实验显示其可在稀疏视角 CT 与高斯去模糊中检测并定位肝肿瘤、合成伪影和人脸局部异常,且跨整图/patch 扩散模型有效;但对块大小和时间窗超参数较敏感。

Learning Global Motion with Compact Gaussians for Feed-Forward 4D Reconstruction Figure 1
2026-06-01cs.CV

Learning Global Motion with Compact Gaussians for Feed-Forward 4D Reconstruction

Mungyeom Kim, Minkyeong Jeon, Honggyu An, Jaewoo Jung, Hyuna Ko, Jisang Han, Hyeonseo Yu, Donghwan Shin, Sunghwan Hong, Takuya Narihira, Kazumi Fukuda, Yuki Mitsufuji, Seungryong Kim

ETH Zürich, ETH AI Center, video and fundamentally limiting their scalability to general-purpose video inputs., to leverage globally available information and leaving occluded regions poorly reconstructed.

2026-06-01三维

本文针对单目视频前馈4D重建中逐像素高斯带来的重复、鬼影和视角偏置问题,提出C4G:用少量时间条件化可学习高斯查询在全时序上下文中聚合特征,并随目标时间解码运动高斯;再以视频扩散模型增强渲染细节,并扩展到4D特征场。实验显示其用不超过逐像素方法0.007倍的高斯数,在多动态基准上取得SOTA或相当的新视角合成表现,并在大时间间隔、点跟踪和动态理解上更稳健。

CoFiDA-M: Concept-Aware Feature Modulation for Cross-Domain Adaptation with Image-Only Inference Figure 1
2026-06-01cs.CV

CoFiDA-M: Concept-Aware Feature Modulation for Cross-Domain Adaptation with Image-Only Inference

Nurjahan Sultana, Moi Hoon Yap, Xinqi Fan, Wenqi Lu

Department of Computing and Mathematics, Manchester Metropolitan University, probabilistic scores, this metadata is unavailable at test, available at GitHub ., Rich metadata available, NO metadata available, are available at training but absent in the real world. A concept-, tation (UDA) methods aim to adapt a model from a labeled, source domain to an unlabeled target domain. Many classi-, captions available for the target domain during adaptation, its prior unavailability. The availability of such rich meta-, key challenges are: (1) the concepts are available only dur-, unlabeled target domain.

2026-06-01视觉感知

针对皮肤癌模型从皮镜图像迁移到手机临床照片时性能骤降、且推理阶段无法获得医学概念元数据的问题,CoFiDA-M把 MONET 产生的病灶概念概率作为训练期特权信息,用 FiLM 调制教师网络特征,再让纯图像学生同时蒸馏预测和“语义编辑”后的特征。六个未见数据集评测显示,该学生在 AUROC 和黑色素瘤召回率上优于现有域适应方法,并保持无需概念输入的部署形态。

TunerDiT: Training-free Progressive Steering of Diffusion Transformer for Multi-Event Video Generation Figure 1
2026-06-01cs.CV

TunerDiT: Training-free Progressive Steering of Diffusion Transformer for Multi-Event Video Generation

Ruotong Liao, Guowen Huang, Qing Cheng, Guangyao Zhai, Lei Zhang, Xun Xiao, Thomas Seidl, Daniel Cremers, Volker Tresp

Ludwig Maximilian University of Munich, Technical University of Munich, University of Hamburg, Huawei European Research Institute

2026-06-01视觉感知生成模型

面向长时程机器人规划、自动驾驶等需要多事件视频的场景,现有 DiT 文生视频易把事件混合、顺序错乱或转场崩塌。TunerDiT 的关键洞察是去噪过程中存在文本作用从全局布局转向细节/运动的稳定拐点,并据此在推理时用事件分区注意力掩码与跨事件提示融合进行渐进控制,无需训练。在 Meve 基准上,该方法在最多四事件生成中于 8 项指标达到最佳,提升文本对齐、一致性和转场平滑性。

Recognizing Co-Speech Gestures in-the-Wild Figure 1
2026-06-01cs.CV

Recognizing Co-Speech Gestures in-the-Wild

Sindhu B Hegde, K R Prajwal, Andrew Zisserman

Visual Geometry Group, Dept. of Engineering Science, University of Oxford, instances, we provide precise word labels and frame-accurate temporal bound-

2026-06-01视觉感知

针对真实演讲中语义性伴随手势稀疏、形态多变且缺少精确标注,现有多模态模型难以把手势对应到具体词的问题,本文构建 GRW:15.7 万手工标注片段、150 类词汇,并给出词标签与帧级手势边界。基于该数据,作者分析了语音与手势的时间错位及不同词的可手势化倾向,训练语义判别、词级识别和时序定位模型,结果超过现有视觉语言模型;增益可能主要来自高质量数据规模与更长时序上下文建模。

SurGe: Improved Surface Geometry in Point Maps Figure 1
2026-06-01cs.CV

SurGe: Improved Surface Geometry in Point Maps

Karim Knaebel, Gonzalo Martin Garcia, Christian Schmidt, Ilya Fradlin, Lucas Nunes, Daan de Geus, Bastian Leibe

RWTH Aachen University, Eindhoven University of Technology

2026-06-01视觉感知

这篇论文关注单目点图重建中被平均位置误差掩盖的局部表面伪影,尤其是细杆、椅腿等薄结构的弯曲和振荡。作者提出点图法向指标来显式评估邻域诱导的表面朝向,并用尺度不变的点梯度匹配损失与基于 Neighborhood Attention 的渐进解码器改善局部几何。八个零样本基准上,SurGe 在全局 AbsRel 平均排名最佳,同时稳定提升局部点图与法向误差表现。

Joint Multi-Camera LiDAR Extrinsic Calibration via Learned Pairwise Initialization and Geometric Refinement Figure 1
2026-06-01cs.CV

Joint Multi-Camera LiDAR Extrinsic Calibration via Learned Pairwise Initialization and Geometric Refinement

Aziz Al-Najjar, Marzieh Amini, James R. Green, Felix Kwamena

Department of System and Computer Engineering, Carleton University, Ottawa, Canada, trajectories [20]. Multi-Calib [21] further studies scalable

2026-06-01视觉感知

针对多相机平台中逐对相机-LiDAR标定会忽略刚性耦合、导致系统级不一致的问题,本文用CMRNext先产生单相机外参和2D-3D匹配,再通过多帧BA联合优化,并加入重投影、单相机先验和相对位姿先验。在KITTI上达到0.89 cm、0.038°误差;在跨域Walkley上将平移误差由108.6 cm降至3.1 cm,说明收益主要来自显式多相机几何约束。

nuReasoning: A Reasoning-Centric Dataset and Benchmark for Long-Tail Autonomous Driving Figure 1
2026-06-01cs.CV

nuReasoning: A Reasoning-Centric Dataset and Benchmark for Long-Tail Autonomous Driving

Zhiyu Huang, Johnson Liu, Rui Song, Zewei Zhou, Ruining Yang, Yun Zhang, Tianhui Cai, Hanyin Zhang, Mingxuan Gao, Valeria Xu, Jiali Chen, Yishan Shen, Yiluan Guo, Tony (Xuewei)Qi, Jiaqi Ma

University of California, Los Angeles

2026-06-01数据集/基准

针对现有自动驾驶数据集偏重感知、预测或规划、难以监督长尾场景推理的问题,nuReasoning构建了2万段真实多城市场景,配套多相机、LiDAR、地图与目标标注,并加入空间、决策和反事实三类人工验证推理标注,同时用统一基准同时评估VLM推理与VLA规划。实验显示,在该数据上微调可提升驾驶问答能力,推理监督还能在推理文本不输出时改善规划表现。

EGOSTREAM: A Diagnostic Benchmark for Streaming Episodic Memory in Egocentric Vision Figure 1
2026-06-01cs.CV

EGOSTREAM: A Diagnostic Benchmark for Streaming Episodic Memory in Egocentric Vision

Rosario Forte, Giuseppe Lando, Antonino Furnari

Department of Mathematics and Computer Science, University of Catania

2026-06-01视觉感知数据集/基准

面向具身/可穿戴智能体在连续第一视角视频中“记住什么、记多久”的评估缺口,EGOSTREAM将2250个问题按细节、空间、时间等7类记忆组织,并提出答案有效窗口区分遗忘与场景变化,扩展为8528个带回忆间隔的测试。统一Qwen3-VL基线显示,平均准确率会掩盖不同记忆机制的弱点;剪枝优于合并保留细节与时序,量化卸载改善超长程回忆,但最佳约45%且速度低于实时。

Vision-Language Models Suppress Female Representations Under Ambiguous Input Figure 1
2026-06-01cs.CV

Vision-Language Models Suppress Female Representations Under Ambiguous Input

Arnau Marin-Llobet, Simon Henniger, Mahzarin R. Banaji

School of Engineering and Applied Sciences, 2Department of Psychology, Harvard University

2026-06-01视觉语言视觉感知

本文关注VLM在性别不可见或模糊图像中的隐藏偏见:输出层面看似中性,并不代表内部表征无偏。作者提出零样本LALS,将视觉token激活投到文本嵌入空间,逐层逐块度量男女概念倾向。对15类职业、800余张模糊图和4个VLM的实验显示,模型在强制选择时普遍默认男性,甚至对护士、保姆等女性刻板职业也如此;内部常已编码女性关联,但后层会放大男性信号、抑制女性信号,衣物颜色等文化线索还会调制这种关联。

SMART: SMPLest-X Mesh Adaptation and RAFT Tracking for Soccer Pose Estimation Figure 1
2026-06-01cs.CV

SMART: SMPLest-X Mesh Adaptation and RAFT Tracking for Soccer Pose Estimation

Parthsarthi Rawat

bounding-box centre, then 50 steps aligning projected joints

2026-06-01视觉感知三维

针对足球转播视频中球员尺度小、视角远且相机持续变焦导致的三维世界坐标姿态估计困难,SMART将SMPLest-X做领域微调,引入骨盆深度监督与转播增强,并用RAFT密集光流跟踪相机、脚底平面锚定和两阶段时序平滑来降低漂移与抖动。在FIFA验证集上得分由基线1.053降至0.647,提升38.6%,测试集得分0.593。

Automated Prediction of Postoperative Pancreatic Fistula Using Preoperative Computed Tomography Figure 1
2026-06-01cs.CV

Automated Prediction of Postoperative Pancreatic Fistula Using Preoperative Computed Tomography

Ashok Choudhary, Chris Varghese, Leo Y. Li-Han, Frank G. Lee, Ellen L. Larson, Elizabeth B. Habermann, Cornelius A. Thiels, Hojjat Salehinejad

2026-06-01视觉感知

胰腺术后胰瘘风险高且传统评分依赖主观/术中因素,本文尝试仅用术前CT做可提前介入的风险分层。核心做法是自动胰腺分割后进行HU窗宽标准化、胰腺中心ROI裁剪,再用多种3D CNN/时空ResNet分类。5折验证中ResNet-(2+1)D-18和MC3-18优于轻量CNN3D,平衡划分AUC约0.73、自然患病率下约0.70–0.72,但仍需外部验证。

RayDer: Scalable Self-Supervised Novel View Synthesis from Real-World Video Figure 1
2026-06-01cs.CV

RayDer: Scalable Self-Supervised Novel View Synthesis from Real-World Video

Ulrich Prestel, Stefan Andreas Baumann, Nick Stracke, Björn Ommer

RayDer: Scalable Self-Supervised Novel View, keeps static-scene NVS as its target task: dynamic content is leveraged purely as scalable supervision, not, Data Availability, Novel view synthesis (NVS) should, in principle, be a highly scalable learning problem: given a set of posed views, pretext task for learning transferable features: camera-pose labels are noisy and expensive to obtain on real video at, scale, so removing them is precisely what makes abundant, unlabeled video usable for training the synthesis model, itself. Despite this, and large amounts of video being available on the internet [cf. 1], these methods rely on restrictive, the main obstacle to scalable self-supervised NVS is not data availability, but rather how current systems are designed to, compute is available, scaling remains brittle and inconsistent., A related challenge is robustness to the videos that are available at scale: unconstrained videos often contain dynamic, scene content, which exposes instabilities in existing methods and prevents direct training on such scalable data sources., We introduce RayDer, a unified, feed-forward transformer that enables scalable self-supervised novel view synthesis.

2026-06-01视觉感知强化学习

论文针对自监督新视角合成难以利用海量真实视频的问题:现有方法依赖静态场景或多网络管线,扩展时不稳定。RayDer将相机估计、场景重建与渲染统一到单个前馈Transformer,并用最小动态状态吸收视频中的运动干扰,使动态内容只作为监督噪声而非4D重建目标。实验显示其在数据、模型和算力上呈较干净的幂律扩展,优于静态数据混合,并在多基准零样本表现接近有监督方法。

Feature-Optimized Vision for Adaptive 3D Scene Reconstruction Figure 1
2026-06-01cs.CV

Feature-Optimized Vision for Adaptive 3D Scene Reconstruction

Eric Liang

2026-06-01视觉感知三维

论文针对三维重建中特征预算常被固定阈值或均匀分配浪费在重复纹理、低视差和不稳定点上的问题,将特征选择建模为几何感知的预算分配:按纹理、可重复性、区分性、预期三角化角和覆盖度打分并自适应选点。在四类合成多视图场景中,该策略相较随机、仅纹理和均匀网格基线取得最低总体 RMSE 与最高质量感知完整度;但实验仅为小规模合成原型,真实系统增益仍需验证。

SVI-Bench: A Dynamic Microworld for Strategic Video Intelligence Figure 1
2026-06-01cs.CV

SVI-Bench: A Dynamic Microworld for Strategic Video Intelligence

Yulu Pan, Han Yi, Seongsu Ha, Md Mohaiminul Islam, Benjamin Zhang, Lorenzo Torresani, Gedas Bertasius

2026-06-01视觉感知强化学习

论文针对现有视频基准难以同时评估真实多智能体场景中的感知、因果推理、反事实模拟与策略决策这一缺口,提出以篮球、足球、冰球等团队运动为“动态微世界”的 SVI-Bench,并通过多模态数据引擎对视频、动作标注、解说、战报和统计记录进行对齐,构建9项分层任务。实验显示,强模型在细粒度动作问答等感知任务约达73%,但随任务进入推理、模拟和自主证据整合性能显著下滑,最难的 agentic 任务最高仅5%,表明瓶颈不只是视觉识别,而在长期因果、规划与跨语料综合。

Personalize Your Large Vision-language Models With In-context Prompt Tuning Figure 1
2026-06-01cs.CV

Personalize Your Large Vision-language Models With In-context Prompt Tuning

Yanshu Li, Jiaqian Li, Kuai Yu, Xi Xiao, Dongfang Liu, Tianyang Wang, Ruixiang Tang

Brown University, Columbia University, University of Alabama at Birmingham, Purdue University, Rutgers University, transforming these features alongside identity-label mappings into con-, Label embedddings, ing the conceptual mapping between a personalized label <sks1> and the visual, they reduce practical scalability, as each new concept requires vocabulary ex-, age and trains a cross-attention module to combine them with the concept label

2026-06-01视觉语言视觉感知

面向私有化视觉语言应用中快速学习用户特定人物、物体等新概念的需求,论文指出现有个性化方法依赖推理时训练,且在多图、多概念场景易混淆。ICPT 用轻量自适应概念投影器把参考图像和标签映射为连续提示,并以动态 token 分配和几何正则抑制环境偏差与概念干扰。在多任务、多 LVLM 骨干实验中,其个性化准确率优于 ICL 和既有方法。

Internalizing Temporal Consistency in Video Object-Centric Learning without Explicit Regularization Figure 1
2026-06-01cs.CV

Internalizing Temporal Consistency in Video Object-Centric Learning without Explicit Regularization

Rongzhen Zhao, Zhiyuan Li, Juho Kannala, Joni Pajarinen

Department of Electrical Engineering and Automation, Aalto University, Finland, Department of Computer Science, Aalto University, Finland, Center for Machine Vision and Signal Analysis, University of Oulu, Finland

2026-06-01视觉感知

针对视频对象中心学习中 SSC 对比损失依赖跨帧一一匹配、在遮挡和消失重现时脆弱且带来额外开销的问题,论文提出 xSSC:把 slot 通道拆成静态语义与动态运动子空间,并用跨时刻重建仅靠标准重建误差内化时间一致性。实验显示其接入 RandSF.Q、SmoothSA 等基线后提升训练效率,并在视频对象发现与识别任务上取得新的 SOTA;PCA 和梯度分析支持了静动态解耦的解释性,但长时遮挡和相同实例区分仍是局限。

How can embedding models bind concepts? Figure 1
2026-06-01cs.CV

How can embedding models bind concepts?

Arnas Uselis, Darina Koishigarina, Seong Joon Oh

available at GitHub., University of T¨ubingen, T¨ubingen, Center

2026-06-01视觉感知

本文针对 CLIP 等视觉语言嵌入模型能识别颜色、形状等概念却难以判断“哪个属性属于哪个物体”的绑定失败,分析多物体场景嵌入的几何结构。核心洞察是:场景表示可加性地分解为物体表示,因此单模态探针能读出物体信息;但 CLIP 的概念到物体映射复杂、近似记忆化,难以跨模态泛化。受控实验表明,足够数据覆盖下从零训练的双编码 Transformer 可学习低复杂度、含乘性交互的绑定函数,并泛化到未见组合。

Enhancing Computer Vision Model Generalization in Warehouse Facilities: A Case Study on Anomaly Detection in Vertical Material Handling Systems Figure 1
2026-06-01cs.CV

Enhancing Computer Vision Model Generalization in Warehouse Facilities: A Case Study on Anomaly Detection in Vertical Material Handling Systems

Ruiliang Liu, Tina Dongxu Li, Joshua Migdal, Ken Meszaros, Trevor Dardik

by conducting the standard procedure solely in a laboratory setting, enables effective generalization from laboratory conditions to, examines computer vision model generalization from laboratory, (Fig 2). Our study encompasses three facilities: laboratory, While lab provides controlled conditions for camera mounting, The key to successful model generalization from laboratory to, effective generalization from laboratory conditions to diverse, computational resources and labeled data at each new site. Our, MODEL GENERALIZATION FROM LABORATORY TO, To enhance model generalization from laboratory environ-, laboratory settings) and test data (from operational warehouse, angle. Four distinct camera views were tested in the laboratory

2026-06-01视觉感知学习理论

论文针对仓库视觉模型每到新场地都需重新采集、标注和训练的高成本问题,以垂直物料搬运系统叉齿异常检测为例,主张通过前置工程化降低域偏移:选择单叉正视相机位、基于 AOI 的动态触发、比较 Mask R-CNN/RTMDet/Grounding DINO 并加入时间集成。实验显示实验室训练模型可迁移到不同仓库,Grounding DINO 实验室 mAP 约 96.1%,集成在理论上可将误报率由 6.61% 降低;但部分增益依赖相机安装条件,受场地约束时仍不稳定。

VolFill: Single-View Amodal 3D Scene Reconstruction with Volumetric Flow Matching Figure 1
2026-06-01cs.CV

VolFill: Single-View Amodal 3D Scene Reconstruction with Volumetric Flow Matching

Tuan Duc Ngo, Chuang Gan, Evangelos Kalogerakis

2026-06-01生成模型三维

单张 RGB 图像的三维重建通常只能恢复可见表面,难以为机器人交互和导航提供遮挡后的完整场景几何。VolFill 将问题转为生成完整 TUDF 体素场,用混合 3D VAE 压缩稀疏体表示,并以流匹配训练的 DiT 结合图像 token 与 MoGe2 可见几何先验进行补全。实验在 SCRREAM 和 NRGB-D 上优于 LaRI、NOVA3R 等基线,输出更连续、锐利的点云和网格。

VisionPulse: Dynamic Visual Sparsity for Efficient Multimodal Reasoning Figure 1
2026-06-01cs.CV

VisionPulse: Dynamic Visual Sparsity for Efficient Multimodal Reasoning

Hengbo Xu, Shengjie Jin, Yanbiao Ma, Zhiwu Lu

2026-06-01视觉语言视觉感知

针对大多模态模型推理时视觉 token 多、CoT 变长导致的高开销,论文指出视觉证据需求随解码步骤变化,静态预剪枝会错过后续关键区域且保留冗余上下文。VisionPulse 在每步用轻量视觉注意力质量估计保留预算,并选择当前最关键视觉 token。七个基准上每步仅保留 5% 视觉 token,推理轨迹缩短 11.2%,准确率基本不变。

Astra: a generalizable report generation foundation model for 3D computed tomography Figure 1
2026-06-01cs.CV

Astra: a generalizable report generation foundation model for 3D computed tomography

Zhuhao Wang, Fang Chen, Chaohui Yu, Zihan Li, Yuchao Zheng, Jing Wang, Xuan Yang, Jia Guo, Zhenlu Yang, Xingju Zheng, Yihua Sun, Haojie Han, Xiaoxiao Qin, Zhan Feng, Wenbo Xiao, Chao Zhu, Yuehua Li, Shipeng Zhang, Hao Luo, Yunsong Peng, Fan Wang, Hongen Liao

School of Biomedical Engineering, Tsinghua University., School of Biomedical Engineering, Shanghai Jiao Tong University., DAMO Academy, Alibaba Group., Hupan Laboratory., Department of Radiology, Guizhou Provincial People’s Hospital., Department of Radiology, The First Affiliated Hospital, Zhejiang University School, Department of Radiology, Shanghai Sixth People’s Hospital Affiliated to Shanghai, Jiao Tong University School of Medicine., Department of Biomedical Engineering, National University of Singapore., College of Computer Science and Technology, Zhejiang University., interpretable narratives, while requiring only readily available radiology reports for supervision

2026-06-01三维

面向CT阅片需浏览大量三维切片、报告撰写耗时且现有模型多局限单区域/单机构的问题,Astra用9万余胸腹部CT-报告对构建CTRgDB,通过报告风格统一、监督微调与强化学习提升术语一致性和细粒度诊断能力。在库内及6个外部队列上细粒度指标平均提升44.1%,临床协作中胸部报告起草提速29.6%、腹部报告完整性提升11.3%。

YARD: Y-Architecture Register Decoding for Efficient Hallucination Mitigation in Large Vision-Language Models Figure 1
2026-06-01cs.CV

YARD: Y-Architecture Register Decoding for Efficient Hallucination Mitigation in Large Vision-Language Models

Ting Chen, Geng Li, Guohao Chen, Yu Hu, Guan Huang, Mai Chen, Langsheng Lei, Jun Du

Guangdong University of Technology, Nanyang Technological University, Shenzhen TENCLASS Technology Co., Ltd.

2026-06-01视觉语言视觉感知

针对大视觉语言模型在生成中易受语言先验或粗糙视觉退化影响而产生幻觉的问题,YARD 将对比解码的退化分支移入解码器中层:浅层共享计算,在视觉 grounding 形成的关键层分叉,并用保留全局语义但缺少局部证据的 register tokens 替换 patch 视觉特征。实验显示,该免训练方法在多种 LVLM、生成式与判别式幻觉评测上优于现有对比解码,并显著降低两次完整前向带来的推理延迟。

Self-Tuning Regularization for Image Scanning Microscopy Figure 1
2026-06-01eess.IV

Self-Tuning Regularization for Image Scanning Microscopy

Sofia Agostoni, Lisa Cuneo, Christian Daniele, Giacomo Garré, Laurent Le, Alessandro Zunino, Giuseppe Vicidomini, Luca Calatroni

MaLGa Center, DIBRIS, University of Genoa

2026-06-01视觉感知

该文针对图像扫描显微 ISM 中 MID/s2ISM 依赖 Richardson–Lucy 迭代、需经验早停且易放大噪声的问题,提出基于 MAP 的自调显式正则化框架,将多帧 Poisson 保真项与 ℓ1/平滑 TV 先验结合,并用残差白化与高通谱扩展自动选参。仿真与真实荧光数据表明,该方法可稳定重建、减少伪影,在低光子条件下保持超分辨与光学切片能力。

Triangle Splatting SLAM Figure 1
2026-06-01cs.CV

Triangle Splatting SLAM

Nicholas Fry (1 and 2), Eric Dexheimer (2), Kirill Mazur (2), Paul H. J. Kelly (1 and 2), Andrew J. Davison (2) ((1) Software Performance Optimisation Group, Imperial College London, (2) Department of Computing, Imperial College London)

2026-06-01视觉感知

面向机器人等具身应用中对可渲染、可规划、可编辑显式几何的需求,本文用可微三角形“triangle soup”统一替代高斯/体素等地图表示,在在线渲染中同时做位姿跟踪与建图,并通过受限 Delaunay 实时生成连通网格,配合等边正则、窗口增密和剪枝保持几何稳定。Replica 与 TUM-RGBD 上其轨迹精度接近现有方法,3D 几何质量优于多种可微渲染 SLAM,并展示了在线网格编辑与碰撞检查等能力。

FSM-Net: An Efficient Frequency-Spatial Network for Real-World Deblurring Figure 1
2026-06-01cs.CV

FSM-Net: An Efficient Frequency-Spatial Network for Real-World Deblurring

Vinh-Thuan Ly

University of Science, VNU-HCM, Ho Chi Minh City, Vietnam, Vietnam National University, Ho Chi Minh City, Vietnam

2026-06-01强化学习

面向真实高分辨率去模糊中质量与算力难兼顾的问题,FSM-Net在轻量NAFNet框架上显式拆分频域与空域:用FFT频率注意力补回运动模糊削弱的高频结构,并在瓶颈加入线性复杂度的Cross-Gated Vision E-Branchformer建模全局上下文。配合多阶段课程训练和复合损失,在RSBlur/NTIRE 2026公开测试中以4.94M参数、159.35GMAC达到33.144dB PSNR并获第2名。

LiftNav: Path Planning via Semantic Lifting in TSDF-Guided Gaussian Splatting Figure 1
2026-06-01cs.RO

LiftNav: Path Planning via Semantic Lifting in TSDF-Guided Gaussian Splatting

Hannah Schieber, Dominik Frischmann, Victor Schaack, Angela P. Schoellig, Daniel Roth

* equal contribution 1 Hannah Schieber, Dominik Frischmann, Victor Schaack, and Daniel Roth are with the Technical University of Munich, Human-Centered Computing and Extended Reality Lab, TUM University Hospital, Clinic for Orthopedics and Sports Orthopedics, Munich Institute of Robotics and Machine Intelligence (MIRMI), Learning Systems and Robotics Lab

2026-06-01规划控制三维

面向未知室内导航中“TSDF几何安全但缺语义、GS外观丰富但几何偏软”的矛盾,LiftNav在GSFusion的TSDF+Gaussian Splatting双地图上,将YOLO检测结果经TSDF深度实时提升到3D语义目标,并用带hinge-loss碰撞项的连续B样条优化轨迹。Replica仿真中相较SplatNav语义目标可行率达100%,路径更短、jerk更低,但严格GT成功率受目标质心落入物体边界影响降至79%。

A Unifying View of Variational Generative Wasserstein Flows Figure 1
2026-06-01cs.LG

A Unifying View of Variational Generative Wasserstein Flows

Paul Caucheteux, Clément Bonet, Anna Korba

have demonstrated very good results and scalability, recent

2026-06-01生成模型

本文针对生成模型中扩散、GAN、流模型等目标和几何解释割裂的问题,将其统一到 Wasserstein 梯度流与 JKO 近端离散框架下。核心洞察是多类 f-散度、IPM 与 MMD 训练可写成参数化 JKO 方案,并证明 VWGF、S-JKO 等近期方法在理论和实践上等价。实验主要考察 JKO 正则对多种目标训练的影响,同时给出参数化流的投影梯度流解释。

A Visually Impaired Assistance Benchmark for VLM-as-a-Judge Evaluation Figure 1
2026-06-01cs.CL

A Visually Impaired Assistance Benchmark for VLM-as-a-Judge Evaluation

Yi Zhao, Siqi Wang, Zhe Hu, Yushi Li, Jing Li

Department of Computing, The Hong Kong Polytechnic University, BLV users. Data and code are available at:, quate for this human-centered setting with open-, Follower reward for human-centered post-training

2026-06-01视觉语言数据集/基准

论文针对视障辅助任务中人工评测昂贵、VLM-as-a-Judge 是否可信缺乏检验的问题,提出 VIABLE 基准,覆盖导航、场景/物体描述和第一视角操作三类场景,以有效性—公正性—稳定性框架和 12 类失败 taxonomy 构造 30 万+评判样本。实验发现现有 7 个评判模型整体不可靠,GPT-5.4 单失败诊断仅 52.6% 且自偏好达 94.2%,开源模型偏置和对抗脆弱性更明显;其 VIA-Judge-Agent 通过视觉证据抽取与流程化诊断带来约 +4.6 点诊断提升,并改善下游回答偏好。

FBHM: Functional Benchmarking and Steering of VLMs for Hateful Meme Detection Figure 1
2026-06-01cs.CL

FBHM: Functional Benchmarking and Steering of VLMs for Hateful Meme Detection

Paramananda Bhaskar, Naquee Rizwan, Daksh Jogchand, Saurabh Kumar Pandey, Animesh Mukherjee

Indian Institute of Technology (IIT), Kharagpur

2026-06-01视觉语言视觉感知数据集/基准

现有仇恨 meme 基准将修辞机制与目标群体混杂,难以诊断 VLM 是否真正做多模态推理。本文构建 FBHM:按25类功能机制与10个目标群体控制生成5000例,并提出冻结模型的可学习 steering vectors。实验显示,多种开源/闭源 VLM 在 FHM/MAMI 上表现较好但在 FBHM 近随机;LSV 仅用500个 steering 样本将 Macro-F1 提升约30点至约74–75,且基本不损伤源域性能。

DecMem: Towards Minute-Long Consistent World Generation with Decoupled Memory Figure 1
2026-06-01cs.CV

DecMem: Towards Minute-Long Consistent World Generation with Decoupled Memory

Zhenhao Yang, Xiaoshi Wu, Zhengyao Lv, Xiaoyu Shi, Xintao Wang, Pengfei Wan, Kun Gai, Kwan-Yee K. Wong

The University of Hong Kong, 2Kling Team, Kuaishou Technology, controllable world models. However, maintaining fine-grained spatio-temporal, ing, and propose a fine-grained, learnable, and scalable memory for consistent, superior extrapolation capabilities, DecMem enables minute-level controllable long, video generation with high fidelity and consistency. Project page is available at, recent works have successfully achieved controllable generation through injecting action informa-, Such a computational inefficiency severely constrains the scalability towards minute-long video, To address the aforementioned limitations, we propose a fine-grained, learnable, and scalable, in preserving long-range memory. We then propose a fine-grained, learnable, and scalable

2026-06-01强化学习

面向可控世界模型的长视频生成,论文聚焦重访场景中历史场景难以被稳定记忆、导致时空不一致的问题。作者指出朴素全历史稠密注意力会带来计算低效与注意力分散,并提出 DecMem:用稀疏全局记忆做块级细粒度检索,用锚定局部记忆稳定近期上下文。实验显示其相较现有显式/隐式记忆方法在分钟级生成中同时提升一致性、画质与推理效率。

Learning from Fine-Grained Visual Discrepancies: Mitigating Multimodal Hallucinations via In-Context Visual Contrastive Optimization Figure 1
2026-06-01cs.CV

Learning from Fine-Grained Visual Discrepancies: Mitigating Multimodal Hallucinations via In-Context Visual Contrastive Optimization

Haolin Deng, Xin Zou, Zhiwei Jin, Chen Chen, Haonan Lu, Xuming Hu

data are available at https://github.com/, OPPO-Mente-Lab/IC-VCO., The Hong Kong University of Science and Technology, (Guangzhou) 2OPPO AI Center 3The Hong Kong University, context [m, m′] and applies an anchor prompt extension step to specify the target image for preference labels. This design ensures a

2026-06-01视觉语言优化算法

针对多模态模型在DPO后训练中仍易忽视图像、产生幻觉的问题,论文指出现有视觉偏好DPO因切换图像上下文导致配分函数不匹配,且负样本过粗会诱发捷径学习。其IC-VCO把原图与对比图放入同一多图上下文,并用VCDist对齐单图推理,同时通过局部语义编辑构造硬负样本;五个基准上取得总体最佳表现,说明细粒度视觉对比监督有助于缓解幻觉。

Interpretability Without Tradeoffs: Disentangling Polysemanticity At Equal Predictive Performance Figure 1
2026-06-01cs.LG

Interpretability Without Tradeoffs: Disentangling Polysemanticity At Equal Predictive Performance

Doğukan Bağcı, Bernt Schiele, Simone Schaub-Meyer, Jonas Fischer, Robin Hesse

Max Planck Institute for Informatics, SIC, Department of Computer Science, TU Darmstadt, the same. It requires no explicit training, no labels, and can be applied to pretrained, In short, ELUDe offers interpretability (almost) without a tradeoff: clearer, scalable, fine-grained manipulation [17, 45], or require supervised training [29], limiting their scalability., manipulable units (explicit), exact preservation of the original model’s behavior (lossless), and scala-

2026-06-01视觉感知

针对神经元常混合响应多个无关概念、导致可解释分解与预测保真度相互牺牲的问题,论文提出 ELUDe:通过重组相邻层权重,把多义单元拆成可检查、可干预的子单元,并保证子单元求和精确恢复原计算,无需训练或标签。在 DINOv2、监督 ViT 等视觉模型上,ELUDe 在 ImageNet 准确率与 R² 保持原模型水平的同时提升单义性评分,并展示了更稳定的分解和视觉语言模型 steering 的可用性。

MoE-dqINR: A Unified Mixture-of-Experts Implicit Neural Representation Framework for Scan-Specific Dynamic and Quantitative MRI Reconstruction Figure 1
2026-06-01eess.IV

MoE-dqINR: A Unified Mixture-of-Experts Implicit Neural Representation Framework for Scan-Specific Dynamic and Quantitative MRI Reconstruction

Yinzhe Wu, Fanwen Wang, Zhenxuan Zhang, Zi Wang, Chengyan Wang, Guang Yang

Department of Bioengineering and I-X, Imperial College London, London, SW7 2AZ, United Kingdom, Cardiovascular Research Centre, Royal Brompton Hospital, London, SW3 6NP, United Kingdom, National Heart and Lung Institute, Imperial College London, London, SW7 2AZ, United Kingdom, School of Biomedical Engineering & Imaging Sciences, King’s College London, London, WC2R 2LS, Shanghai Pudong Hospital and Human Phenome Institute, Fudan University, Shanghai, China, International Human Phenome Institute (Shanghai), Shanghai, China

2026-06-01三维

该文针对动态与定量 MRI 中欠采样多线圈重建既需共享空间结构又需适配不同时间/对比状态、且现有 scan-specific INR 优化耗时高的问题,提出 MoE-dqINR:用共享空间专家表示可复用图像内容,并由状态条件路由组合生成各帧或对比图像。实验称其在 cine 与 T1 mapping 上保持更好重建质量,同时将单次扫描优化降至约 30 秒。

TokTalk: Expressive Real-time Facial Animation from Audio-LLM Tokens Figure 1
2026-06-01cs.CV

TokTalk: Expressive Real-time Facial Animation from Audio-LLM Tokens

Qingcheng Zhao, Yifang Pan, Karan Singh

University of Toronto

2026-06-01视觉感知

TokTalk针对现有对话头像需经历语音识别、文本生成、语音合成再驱动表情而带来的延迟与情感信息丢失,提出直接利用Audio-LLM流式音频token生成3D面部运动的并行架构。其核心洞察是这些token比ASR特征保留更多情绪和副语言信息,并用chunk式条件流匹配与轻量适配层实现跨模型接入。实验显示其延迟接近实时方法,感知质量、表现力和可控性优于对比方案。

Authentication of Copy Detection Patterns via Cross-Camera Dual-Synthetic Referencing Figure 1
2026-06-01cs.CV

Authentication of Copy Detection Patterns via Cross-Camera Dual-Synthetic Referencing

Ivan Oleksiyuk, Roman Chaban, Slava Voloshynovskiy

Department of Computer Science, University of Geneva, Switzerland, strength lies in combining low cost, scalability, and strong, available

2026-06-01视觉感知

针对CDP防伪中数字模板无法反映打印随机性、手机成像差异又削弱比对可靠性的问题,论文加入生产端注册拍摄,用数字模板与注册图像共同生成面向验证相机的双合成参考,并以互信息解释其信息增益。实验显示该方法在高低端手机、小区域CDP和机器学习复制攻击下均提升认证准确率,使iPhone XS等低端设备也能达到可靠验证。

SAM for Robust Mitochondria Instance Segmentation in Fluorescence Microscopy Figure 1
2026-06-01cs.CV

SAM for Robust Mitochondria Instance Segmentation in Fluorescence Microscopy

Suyog Jadhav, Dilip K. Prasad, Krishna Agarwal

UiT The Arctic University of Norway

2026-06-01视觉感知安全鲁棒

论文针对荧光显微线粒体实例分割中低对比、衍射模糊、密集重叠及人工标注稀缺的问题,提出用物理仿真的合成线粒体图像和实例掩码微调 SAM,并在推理时聚焦前景提示以更好处理重叠实例。实验在真实手工标注数据上显示,相比 Nellie 和 μSAM,方法提升了精度与平均 Dice、减少碎片化;但召回仍不足,部分线粒体会漏检。

Topologically Consistent Multi-view 3D Head Reconstruction via Coarse-Guided Layered Surface Sampling Figure 1
2026-06-01cs.CV

Topologically Consistent Multi-view 3D Head Reconstruction via Coarse-Guided Layered Surface Sampling

Timo Bolkart, Daoye Wang, Prashanth Chandran

scalability for dense topologies (≥10𝑘vertices) and introduces surface noise., produces noise and holes in specular regions, necessitating labor-, per frame, and labor-intense as it requires manual clean up and hy-, scale datasets. However, while these methods offer superior scalabil-, lacking semantic labels or consistent topology. While VGGT and

2026-06-01三维

面向数字人数据的大规模注册,传统 MVS+非刚性配准耗时且需清理,现有前馈方法又受体素特征内存限制、难扩展到高密网格。SHELLS 用 DINOv2+LoRA 提取多视图特征,先估计粗网格,再沿表面法线构建分层采样壳,由 Transformer 整体预测 18k 顶点拓扑一致头模。仅用合成数据训练即可泛化到真实采集,推理显存约降 88%,速度 0.08s,注册中位误差降低 21%–29%。

DriveMA: Driving Vision-Language-Action Models with verifiable Meta-Actions Figure 1
2026-06-01cs.CV

DriveMA: Driving Vision-Language-Action Models with verifiable Meta-Actions

Weicheng Zheng, Yixin Huang, Qiao Sun, Derun Li, Hang Zhao

Shanghai Qi Zhi Institute, Tsinghua University, Tongji University

2026-06-01视觉语言视觉感知

本文针对驾驶 VLA 中“语言决策说得对但轨迹不执行”的语言-动作鸿沟,提出 DriveMA:把加速、减速、转向、变道等元动作作为可验证中间接口,由专家轨迹自动标注,并通过规则投影检查生成轨迹一致性,再结合动作中心训练与按生成轮次分配信用的强化学习显式对齐决策和规划。结果显示,2B/4B 模型在 WOD-E2E 上 RFS 达 8.060/8.079 刷新 SOTA,并在 NAVSIM 获得有竞争力的闭环表现。

Envisioning Beyond the Few: Disentangled Semantics and Primitives for Few-Shot Atypical Layout-to-Image Generation Figure 1
2026-06-01cs.CV

Envisioning Beyond the Few: Disentangled Semantics and Primitives for Few-Shot Atypical Layout-to-Image Generation

Nan Bao, Yifan Zhao, Wenzhuang Wang, Jia Li

mains. The source code is publicly available at, for controllable generation (e.g., Liu et al., 2022, Mou et al., 2024). Among various controllable paradigms, State Key Laboratory of Virtual Reality Technology and Sys-, tems, School of Computer Science and Engineering and Qingdao, Research Institute, Beihang University, China. Correspondence to:, alization, allowing for controllable generation of complex, layout-image pairs in atypical conditions is labor-intensive., of training samples (e.g., a few shots) are available. This

2026-06-01视觉感知

本文关注少样本非典型场景下布局到图像生成的失效:现有 L2I 方法在水下、航拍等域中因语义身份与局部纹理细节纠缠,容易产生结构破碎和几何畸变。作者将其概括为“表示碎片化”,并提出将语义锚点与可重组视觉原语解耦,再用显著性约束保持前景一致。实验显示在 5-shot 设置、多个非典型域上,相比 MIGC、CC-Diff 等方法提升了图像保真度和布局对齐,但仍受小目标分辨率、外部 DINOv2/Grad-CAM 先验和 SD1.5 骨干限制。

ERGeoBench:A Comprehensive Benchmark for Embodied Reasoning and Geo-localization in Multimodal Large Language Models Figure 1
2026-06-01cs.CV

ERGeoBench:A Comprehensive Benchmark for Embodied Reasoning and Geo-localization in Multimodal Large Language Models

Kaiwen Xue, Tao Wei, Guoxin Zhang, Zhonghong Ou, Kaoyan Lu, Yu Feng, Yifan Zhu, Haoran Luo

Beijing University of Posts and Telecommunications, Bei-, jing, China 2State Key Laboratory of Networking and Switching, Technology, Beijing University of Posts and Telecommunications, Beijing, China 3School of Materials Science and Engineering, Shanghai Jiao Tong University, Shanghai, China 4China Mobile, Research Institute, Beijing, China 5College of Computing and, Data Science, Nanyang Technological University, Singapore. Cor-, tions assume that sufficient localization cues are available in, tion setting via a controllable camera model, enabling agents

2026-06-01视觉语言数据集/基准

现有图像地理定位多依赖单张或全景静态输入,难以评估模型像人一样主动取证和整合视角的能力。ERGeoBench用2207个全球街景全景构建单视角、全景和具身视角三类任务,允许通过偏航、俯仰、缩放逐步观察,并从感知、空间、常识和定位推理四维诊断MLLM。实验显示模型能把握国家/城市等高层语义,但在细粒度度量定位、跨视角空间一致性和低层几何推理上仍明显不足。

BadBone: Backdoor Attacks Against Backbone Models in Visual Prompt Learning Figure 1
2026-06-01cs.CR

BadBone: Backdoor Attacks Against Backbone Models in Visual Prompt Learning

Ziqing Yang, Rui Wen, Xinlei He, Yun Shen, Michael Backes, Yang Zhang

CISPA Helmholtz Center for Information Security, Institute of Science Tokyo, Wuhan University, code is available at https://github.com/TrustAIRLab/B, Correct Labels, Target Labels, ters and X denotes the input space. Given a labeled down-, fθ : Xpre →RM, and a pre-defined label mapping function, labels in T and Tpre, the mapping function h is designed to, likelihood of the correct label y

2026-06-01视觉感知

视觉提示学习复用冻结骨干模型,带来供应链式后门风险,但以往多攻击提示本身。BadBone 将后门植入骨干,并用双层优化模拟下游提示学习,形成“干净提示+触发器”共同激活的隐蔽机制。实验覆盖3种模型和3个数据集,定向/非定向攻击均保持预训练与下游效用,CIFAR-10上ResNet50定向成功率达98.66%,且多数现有模型级防御难以拦截。

Beyond Classification: Dynamic Adapter Routing for Continual Multimodal Retrieval Figure 1
2026-06-01cs.CV

Beyond Classification: Dynamic Adapter Routing for Continual Multimodal Retrieval

Alicja Dobrzeniecka, Filip Szatkowski, Sebastian Cygert, Szymon Lukasik, Bartlomiej Twardowski

NASK National Research Institute, IDEAS Research Institute, Warsaw University of Technology

2026-06-01视觉语言

本文指出视觉语言模型的持续学习长期套用分类增量范式,但检索更依赖全局一致的跨模态嵌入,小漂移也会破坏排序。作者构建覆盖多视觉域、含 OOD 评测的持续多模态检索框架,并发现常见 CIL/检索方法收益有限;进一步提出 DAR,用原型路由选择任务适配器,并在不确定样本上动态合并适配器。实验显示 DAR 在异构检索基准和 OOD 场景中均优于既有基线。

HiERO-StepG @ Ego4D Step Grounding Challenge: hierarchical activity understanding enables zero-shot step grounding Figure 1
2026-06-01cs.CV

HiERO-StepG @ Ego4D Step Grounding Challenge: hierarchical activity understanding enables zero-shot step grounding

Andrea Zenotto, Simone Alberto Peirone, Francesca Pistilli, Giuseppe Averta

chical taxonomy of goal-oriented activity labels. Here, we

2026-06-01视觉语言

本文针对步骤定位依赖大量过程边界标注、难以泛化到新任务的问题,提出零样本 HiERO-StepG:利用 HiERO 从无脚本第一视角视频叙述中学习功能相似动作的层级表征,并在推理时融合细粒度节点与粗粒度簇相似度,用 Viterbi 强制步骤时间单调,再通过边界扩展和 NMS 抑制噪声。其在 Ego4D Step Grounding 2026 测试榜 R1@IoU0.3 达 56.27%,排名第二,且无需步骤级监督。

Latent Geometric Chords for Query-Efficient Decision-Based Adversarial Attacks Figure 1
2026-06-01cs.CV

Latent Geometric Chords for Query-Efficient Decision-Based Adversarial Attacks

Ei Hmue Khine, Yao Li, Jiebao Sun, Shengzhu Shi, Zhichang Guo, Boying Wu

versarially trained robust models. The source code is available, The authors are with the School of Mathematics, Harbin Institute of, labels. Therefore, decision-based (hard-label) attacks, which, Without gradients or continuous scores, hard-label attackers, to estimate the available path. To mitigate this excessive, drastically limits the available directions for adversarial move-, perturbations relying exclusively on top-1 predicted labels. Ex-

2026-06-01视觉感知

本文针对决策式黑盒攻击中像素扰动易产生高频伪影、潜空间攻击又受低维流形和重建误差限制的问题,提出 LGC/LGC-H:在压缩语义流形中做曲率感知几何搜索,并用 RAG 将潜在“几何弦”残差叠加回原图以扩大搜索空间、保留细节。实验显示其在 5000 次查询下可达 SSIM>0.99、LPIPS<0.01,扰动更小,并能跨数据集攻击及突破对抗训练模型。

TALON: Token-Aligned Lightweight Adapters for 6-DoF Spacecraft Pose Estimation Figure 1
2026-06-01cs.CV

TALON: Token-Aligned Lightweight Adapters for 6-DoF Spacecraft Pose Estimation

Abid Ali, Arunkumar Rathinam, Djamila Aouada

2026-06-01三维

本文针对单目航天器6DoF位姿估计常逐帧处理、缺少时序信息,而全量微调或光流模块又成本高且易遗忘的问题,提出在冻结ViT自注意力前插入轻量3D时空适配器,并用patch-token对齐损失把特征锚定到关键点几何。该设计以少于5%额外参数联合建模时序与关键点结构,在SPADES上位姿误差较前SOTA降约50%,SwissCube ADD-0.1d提升21.8%,SPADES到SPARK真实域零样本误差降低4.7倍。

Fixed-Point Masked Generative Modeling Figure 1
2026-06-01cs.LG

Fixed-Point Masked Generative Modeling

Andrea Miele, Yiming Qin, Alba Carballo-Castro, Justin Deschenaux, Pascal Frossard

Controllable-depth / looped / DEQ-style models, transformers, and DEQ-style models provide controllable effective depth by repeatedly applying

2026-06-01生成模型

这篇论文针对掩码生成模型每个去噪步都运行完整双向 Transformer、训练贵且低采样预算质量差的问题,提出 FP-MGMs/CoFRe:用共享注意力层的定点求解器替代部分去噪器,并加入跨步一致性损失和区分未变、仍掩码、新揭示 token 的三状态复用。结果显示在 OpenWebText 上参数降 38.8%、训练时间降 11.5%、显存降 16.9%,96 次前向预算下困惑度从 830.8 降至 101.8;ImageNette 上训练时间和显存也约减半且 FID 全预算提升。

Benchmarking and Enhancing Text-to-Image Models for Generating Visual Representations in Early Arithmetic Education Figure 1
2026-06-01cs.CV

Benchmarking and Enhancing Text-to-Image Models for Generating Visual Representations in Early Arithmetic Education

Junling Wang, Boqi Chen, Heejin Do, Mubashara Akhtar, April Yi Wang, Mrinmaya Sachan

Department of Computer Science, ETH Zurich, ETH AI Center, In this work, we focus on primary school level, terviewed ten primary-school mathematics teachers, Visuals in Teaching Primary-School Arithmetic

2026-06-01视觉感知强化学习数据集/基准

面向低年级算术教学中按需生成配图的需求,论文提出 equation-to-visual 任务与 E2V-Bench,基于教材分析和教师访谈定义颜色、物体、空间、容器四类视觉表示及自动正确性指标。对9个T2I模型的评测显示,即使最强模型也常因数量不准和关系结构破坏而失败,DSL参考法达98.3%准确率;提示改写、重生成和拒绝采样微调可带来改进,但仍暴露出现有模型数值与关系 grounding 不足。

Probabilistic Precipitation Nowcasting with Rectified Flow Transformers Figure 1
2026-06-01cs.CV

Probabilistic Precipitation Nowcasting with Rectified Flow Transformers

Johannes Schusterbauer, Jannik Wiese, Nick Stracke, Timy Phan, Björn Ommer

Munich Center for Machine Learning (MCML), scaling. Code available here: https://github.com/, probabilistic, fast, and scalable., (1) easy to train, (2) scalable, and (3) able to quantify un-, FREUD provides a fast, scalable first stage for, • A simple, scalable first stage tailored for weather now-, • Scalable and robust latent-space nowcasting.

2026-06-01生成模型

短临降水预报需要快速且能表达不确定性的高分辨率生成模型,但现有潜空间方法常用确定性压缩,极端降水下会丢失解码不确定性。论文提出 FREUD:逐帧 Transformer 编码避免未来泄漏并支持连续更新,统一的 rectified-flow 视频解码器保持时序一致性,并用随机 tanh 正则构造有界潜空间。结合 masking-based rectified-flow 预测后,在 SEVIR 上取得 CRPS 和感知指标的 SOTA,且模型规模、集成数和采样步数 scaling 还能继续带来增益。

Probing Collision Grounding in Vision-Language Models for Safe Human-Robot Collaboration Figure 1
2026-06-01cs.CV

Probing Collision Grounding in Vision-Language Models for Safe Human-Robot Collaboration

Jun Wang, Xiaohao Xu, Xiaonan Huang

University of Michigan, Ann Arbor

2026-06-01机器人视觉语言视觉感知安全鲁棒

面向人机共处场景,论文指出VLM仅会描述画面不足以承担安全监控,关键在于将视觉证据与机器人形体、视角、深度和运动绑定以判断当前或即将碰撞。作者提出Habitat 3.0中的TouchSafeBench,含多视角RGB-D、轨迹和仿真接触标签,评测状态分类与提前预警。结果显示先进/机器人VLM最佳Macro-F1仍低于50%,深度输入不自动转化为碰撞依据,机器人—场景接触尤为薄弱。

The Regularizing Power of Language-Training Deepfake Detectors Figure 1
2026-06-01cs.CV

The Regularizing Power of Language-Training Deepfake Detectors

Benedikt Hopf, Zongwei Wu, Radu Timofte

Computer Vision Lab, CAIDAS, University of Würzburg, Germany, labels. By rewarding this “explain-then-classify” behavior, we explicitly, which limits scalability and cross-dataset adaptability

2026-06-01视觉感知

针对深伪检测易过拟合数据集特定低层伪影、且解释通常依赖人工文本标注的问题,本文将语言视为正则化信号:用冻结专用检测器与LoRA调优的MLLM组成双编码器,先做二分类对齐,再用仅基于真假标签的GRPO鼓励“先描述伪影再分类”。结果显示,该训练促使模型偏向可描述、跨域更稳健的高层线索,在跨数据集AUC上优于现有方法,最佳约93.95%,且推理时可省略推理链仍保留增益。

Student Capacity Moderates Knowledge Distillation Effectiveness: A Systematic Study Across ResNet Teacher-Student Pairs on CIFAR-10 Figure 1
2026-06-01cs.LG

Student Capacity Moderates Knowledge Distillation Effectiveness: A Systematic Study Across ResNet Teacher-Student Pairs on CIFAR-10

Umut Onur Yasar

pp — an order of magnitude larger than any KD gain. All code and results are available at, training a small student model on hard one-hot labels alone, the student also learns from the soft

2026-06-01视觉感知

本文关注知识蒸馏中“更强教师是否总能带来更好学生”的实际条件,系统比较 CIFAR-10 上 ResNet R50/R34/R18 组合的 Logit-KD 与 Feature-KD。核心洞察是学生容量会调节蒸馏收益,R34 学生明显比 R18 更能吸收教师信息;同时指出 CIFAR 输入 stem 修正和 Feature-KD 投影层梯度裁剪会显著影响结论。实验中最佳 R50→R34 Feature-KD 从 95.25% 提升到 95.55%,但 KD 增益远小于架构修正带来的 5 个百分点以上提升。

From Local Geometry to Global Pseudo Labeling for Robust Positive Unlabeled Learning under Covariate Shift Figure 1
2026-06-01cs.CV

From Local Geometry to Global Pseudo Labeling for Robust Positive Unlabeled Learning under Covariate Shift

Firas Gabetni, Alexandre Rocchi Henry, Nacim Belkhir, Ziyi Liu, Gianni Franchi

From Local Geometry to Global Pseudo-Labeling, for Robust Positive–Unlabeled Learning under, approaches typically rely on fully supervised training, requiring labeled, effectively addressed with weaker supervision using Positive–Unlabeled, Keywords: Covariate shift · Positive Unlabeled Learning · Pseudo la-, and synthetic images. While effective, such methods require labeled examples, unavailable or expensive to curate. This raises a fundamental question:, tive–Unlabeled (PU) learning. This field studies binary classification when only, labeled positive examples and unlabeled data are available. This paradigm natu-, detection [28], where negative labels are scarce or unreliable. Surprisingly, to the, treat the unlabeled dataset as a mixture of low-dimensional submanifolds cor-, notation (S-PUNA), a geometry-aware pseudo-labeling framework for covari-

2026-06-01安全鲁棒

本文关注少被单独处理的协变量偏移检测:实际部署中往往只有源域正样本和未标注混合数据,难以获得完整负样本监督。作者将问题建模为PU学习,提出S-PUNA,利用特征空间局部流形和双向kNN伪标注逐步发现偏移样本,并用负集协方差谱熵稳定作为停止准则以抑制漂移。实验显示其在PU设置下达到SOTA,性能接近全监督方法,并能跨多类偏移迁移。

Vanilla ViT for Automotive Point Cloud Semantic Segmentation Figure 1
2026-06-01cs.CV

Vanilla ViT for Automotive Point Cloud Semantic Segmentation

Gilles Puy, Nermin Samet, Alexandre Boulch, Spyros Gidaris, Tuan-Hung VU, Renaud Marlet

ficiency of our method. Code and models are available at, mantic labeling while keeping the overall architecture sim-

2026-06-01视觉感知三维

本文针对车载激光点云语义分割长期依赖稀疏卷积、U-Net层级结构或2D投影而难以与通用Transformer统一的问题,验证非层级 vanilla ViT 可直接处理3D点云。核心在于3D点嵌入到粗BEV网格的tokenizer、融合高分辨率点特征的轻量解码头,以及PillarMix+几何增强。实验在nuScenes、SemanticKITTI和Waymo上达到或超过现有方法,说明专用混合架构并非必要。

Detect in Any Scene: An Agentic Framework for Object Detection with Experience-Aware Reasoning Figure 1
2026-06-01cs.CV

Detect in Any Scene: An Agentic Framework for Object Detection with Experience-Aware Reasoning

Wenlun Zhang, Jun Yin, Kentaro Yoshioka

Keio University, Tsinghua University, while MED integrates multiple specialized detectors to collaboratively handle diverse detection

2026-06-01视觉感知

面向真实场景中低光、雨雾、水下失真及目标分布变化导致固定检测器/固定恢复流水线泛化差的问题,论文将检测建模为由 MLLM 代理动态决策的流程:DetAS 自适应选择图像恢复工具与多专长检测器,DetAS-X 进一步从少量标注数据收集节点级经验以指导推理。六个基准上其相对 MLLM 检测基线平均 F1 提升 28.36%,DarkFace 最高提升 37.01%。

Guidance for Low-Level Perceptual Editing in Unconditional Diffusion Models Figure 1
2026-06-01cs.CV

Guidance for Low-Level Perceptual Editing in Unconditional Diffusion Models

Shreyansh Modi, Akshat Tomar, Aarush Aggarwal

†Indian Institute of Technology Roorkee.

2026-06-01生成模型

这篇论文关注无条件扩散模型难以直接控制锐度、对比度、饱和度等低层感知属性的问题,并指出传统 h-space activation patching 在全局低层编辑中会因 U-Net 解码器干扰而失效。作者用成对退化/干净图像提取“退化概念向量”,再将瓶颈 patching 与负向 classifier-free guidance 结合,使采样远离退化流形且无需重训练。在 CelebA-HQ 上,该方法相对基线降低 FID,并在锐化、饱和、对比增强指标及人工偏好中优于标准 patching。

Light Interaction: Training-Free Inference Acceleration for Interactive Video World Models Figure 1
2026-06-01cs.CV

Light Interaction: Training-Free Inference Acceleration for Interactive Video World Models

Jiacheng Lu, Haoyi Zhu, Sipei Yi, Enze Xie, Yu Li, Cheng Zhuo

Zhejiang University

2026-06-01视觉感知强化学习

交互式视频世界模型在长轨迹生成中受上下文增长、二次注意力和多步去噪拖累,10 秒视频可需数百秒。Light Interaction 的关键洞察是交互轨迹本身可指示计算是否必要:按相机位姿相似度裁剪空间记忆、按局部潜变量动态调节时间窗口,并在重访场景复用早期去噪输出,同时用 Triton 融合的 AR 友好块稀疏注意力落实加速。在 HY-WorldPlay 与 Matrix-Game-3.0 上无需重训最高加速 2.59×,HY-WorldPlay 相对原模型 PSNR 为 24.81。

BIAS-ID: A Framework for Analyzing Transformation Biases in AI-Generated Image Detectors Figure 1
2026-06-01cs.CV

BIAS-ID: A Framework for Analyzing Transformation Biases in AI-Generated Image Detectors

Jonas Ricker, Asja Fischer, Erwin Quiring

Ruhr University Bochum

2026-06-01视觉感知

针对AI生成图像检测器在真实场景中性能骤降、可能依赖压缩/缩放/方向等训练集伪相关的问题,论文提出BIAS-ID,不只看AUC等性能变化,而是用变换前后预测分数偏移及聚合变换敏感度ATS量化偏向真实或伪造类别的程度。作者在两个数据集、六个检测器和五类变换上验证,发现多种SOTA检测器存在系统性变换偏置,且部分偏置难以从常规性能指标中看出。

SpatialAct: Probing Spatial Reasoning-to-Action Capabilities of VLM Agents in 3D Scenes Figure 1
2026-06-01cs.CV

SpatialAct: Probing Spatial Reasoning-to-Action Capabilities of VLM Agents in 3D Scenes

Tianhui Liu, Jie Feng, Zhiheng Zheng, Shengyuan Wang, Yiming Guo, Yanxin Xi, Hangyu Fan, Yong Li, Pan Hui

The Hong Kong University of Science and Technology (Guangzhou), Zhongguancun Academy, Tsinghua University, Helsinki University

2026-06-01视觉语言三维

这篇论文针对现有空间推理评测多停留在“观察后答题”、难以检验行动后状态跟踪的问题,提出 SpatialAct:在3D模拟器中让VLM执行移动、旋转、缩放等高层语义动作,并通过多视角反馈做单步修复与多轮布局 refinement。结果显示,模型在基础空间题上可达约80%,但多轮修复最优仅0.411 Repair Rate、0.206 Scene Success Rate,显著低于人类,暴露出推理到行动的断层。

FOCUS: Forcing In-Context Object Localization through Visual Support Constraints and Policy Optimization Figure 1
2026-06-01cs.CV

FOCUS: Forcing In-Context Object Localization through Visual Support Constraints and Policy Optimization

Mohammed Asad Karim, Vinay Kumar Verma

ples available at inference time. In contrast to traditional, labels during training to reduce reliance on true category, ence continues to rely on original category labels, creating, even with pseudo-label training, models frequently underuti-, and query prompts. Instead of relying on true labels or, pseudo-labels, our method optimizes in-context attention us-, localization without relying on category labels or prior, of pseudo-label and visual grounding, however pseudo label, model have not learned the pseudo label., canonical labels, motivating methods that relax or adapt

2026-06-01强化学习优化算法

本文针对VLM在上下文目标定位中依赖类别名和语义先验、难以处理无名或实例级目标的问题,提出FOCUS:训练时完全移除类别文本,用支持框到查询图的注意力约束强化纯视觉对应,并通过GRPO直接优化边界框误差。实验显示,7B模型在该目标下可超过最高72B的基线,消融也支持注意力优化与奖励优化的贡献。

PolSAR Image Classification using a Hybrid Complex-Valued Network (HybridCVNet) Figure 1
2026-06-01cs.CV

PolSAR Image Classification using a Hybrid Complex-Valued Network (HybridCVNet)

Mohammed Q. Alkhatib

2026-06-01视觉感知

针对 PolSAR 分类中实值 CNN/ViT 容易丢失复数相位信息、CNN 又偏局部而 ViT 需建模全局依赖的问题,HybridCVNet 将复值 3D/2D CNN 作为极化-空间特征提取器,并把 ViT 层复值化以处理相干矩阵序列,从而同时利用局部散射特征与长程关系。在 Flevoland 上总体精度达 97.39%,San Francisco 仅 1% 采样时 Kappa 为 0.972,优于多种实值 CNN/Transformer 基线。

QVGGT: Post-Training Quantized Visual Geometry Grounded Transformer Figure 1
2026-06-01cs.CV

QVGGT: Post-Training Quantized Visual Geometry Grounded Transformer

Zhizhen Pan, Hesong Wang, Huan Wang

Westlake University, Beijing University of Posts and Telecommunications, †Work done as a visiting research intern at ENCODE Lab, Westlake, University.

2026-06-01视觉感知

QVGGT针对VGGT 1.26B参数导致机器人、UAV和AR等端侧3D感知难部署的问题,提出后训练量化方案:按块敏感度做选择性混合精度,过滤高方差相机/寄存器token并用PCA补偿几何信息,再以多头监督和几何一致性搜索量化尺度。实验显示其在W4A16下接近无损,模型/显存约降3–4.9倍,并在硬件上最高加速2.8倍。

NTR: Neural Token Reconstruction for Scene Token Bottleneck in End-to-End Driving Figure 1
2026-06-01cs.CV

NTR: Neural Token Reconstruction for Scene Token Bottleneck in End-to-End Driving

Jiahui Li, Jiawei Sun, Zixiang Ren, Ming Liu, Jiamin Shi, Ruiteng Zhao, Zhiyang Liu, Liying Liu, Zuoguan Wang, Kaidi Yang

National University of Singapore

2026-06-01三维

这篇论文针对感知自由端到端驾驶中,密集图像 token 被压缩为少量 scene tokens 后仅受规划损失监督、易冗余且丢失细粒度信息的问题,提出 NTR:训练时用自蒸馏的 masked latent reconstruction 直接约束 scene-token 瓶颈,并用基础模型语义先验强调车辆、可行驶区域和交通控制等结构,推理时不增加开销。在 Waymo E2E 与 NavSim1/2 上取得 SOTA,并显示 token 冗余降低、有效秩提升;但语义先验质量和额外训练成本仍是限制。

Polyphony: Diffusion-based Dual-Hand Action Segmentation with Alternating Vision Transformer and Semantic Conditioning Figure 1
2026-06-01cs.CV

Polyphony: Diffusion-based Dual-Hand Action Segmentation with Alternating Vision Transformer and Semantic Conditioning

Hao Zheng, Hu Wang, Tiantian Zheng, Prajjwal Bhattarai, Tuka Alhanai

New York University Abu Dhabi, Abu Dhabi, United Arab Emirates, Mohamed bin Zayed University of Artificial Intelligence, Abu Dhabi, United Arab Emirates, x-labs-xyz/Polyphony-Dual-hand-Action-, frame-wise action labels, to construct action-level tokens, cross-attention. However, relying on simple action labels, wise action labels into verb, object, and tool components, to predict frame-wise action label sequences Y h = {yh

2026-06-01视觉感知生成模型

面向装配、烹饪等双手任务,论文指出逐帧分割同时受左右手依赖、视觉不对称、主导手梯度压制和细粒度语义歧义影响。Polyphony用交替训练的共享ADH-ViT平衡双手表征,引入动词-物体-工具语义条件,并用扩散分割结合跨手特征融合。其在HA-ViD、ATTACH上刷新结果,最高提升16.8点,在Breakfast达82.5%,但语义描述仍需人工构造。

Remembering by Reconstructing: Domain Incremental Learning With Test-Time Training on Video Streams Figure 1
2026-06-01cs.CV

Remembering by Reconstructing: Domain Incremental Learning With Test-Time Training on Video Streams

Jonathan Swinnen, Tinne Tuytelaars

2026-06-01视觉感知

面向视频等连续流中域分布随时间变化、传统域增量学习难以在未知域身份下兼顾旧域的问题,论文反其道而行接受“临时遗忘”:为各域训练 LoRA,并在测试时仅用 MAE 重建损失在线优化 LoRA 权重来找回当前域。实验覆盖动作识别和语义分割,显示相比多种基线性能更稳;但推理需额外训练,域数增多时开销与可扩展性仍是限制。

iVGR: Internalizing Visually Grounded Reasoning for MLLMs with Reinforcement Learning Figure 1
2026-06-01cs.CV

iVGR: Internalizing Visually Grounded Reasoning for MLLMs with Reinforcement Learning

Chang-Bin Zhang, Yujie Zhong, Qiang Zhang, Kai Han

Visual AI Lab, The University of Hong Kong 2Independent, Researcher 3University of Science and Technology of China. Cor-, the grounded CoT. Specifically, we manually label target

2026-06-01强化学习

论文动机是细粒度视觉问答中显式框/裁剪式视觉 CoT 在推理时未必可靠,错误定位还会干扰答案生成。作者的关键洞察是定位能力可被内化到文本 CoT,提出 iVGR:用强化学习双流训练,让文本推理通过一致性奖励对齐高质量带框推理。实验在 Qwen2.5-VL、Qwen3-VL 及多项高分辨率/细粒度基准上优于现有方法,并仍可结合测试时裁剪工具;局限是依赖框标注和外部 LLM 打分。

Redefining Instance Matching: A Unified Framework for Part-Aware Matching in Panoptic Segmentation Evaluation Figure 1
2026-06-01cs.CV

Redefining Instance Matching: A Unified Framework for Part-Aware Matching in Panoptic Segmentation Evaluation

Erik Großkopf, Soumya Snigdha Kundu, Hendrik Möller, Nicolas Münster, Mehdi Astaraki, Paula Tamara Buzduga, Kerstin Ritter, Benedikt Wiestler, Jan Kirschke, Jonathan Shapey, Tom Vercauteren, Florian Kofler

Hertie Institute for AI in Brain Health, University of Tübingen, Germany, King’s College London, UK, Technical University of Munich, Germany, Stockholm University, Sweden, Semantic segmentation assigns every pixel/voxel i a single class label li ∈L [19]. Pixels/voxels, typically accompanied by a class label and a confidence score [9, 8]. Unlike PS, it considers only, pixel/voxel receives exactly one label pair (see visual comparison of segmentation tasks in section C).

2026-06-01视觉感知数据集/基准

针对传统 Panoptic Quality 在 IoU≤0.5 时匹配规则不明确、且难处理实例碎片化/合并和部件层级标注的问题,论文将预测与真值段匹配重写为受约束二分图分配,并用顶点而非边统计 TP/FP/FN,统一刻画一对一、多对一、一对多等策略,指出多对多不再符合 PQ 不变量。结果显示该框架可扩展到 PartPQ、AUTC 和 Voronoi 区域分析,并以 Panoptica 开源实现支持生物医学等密集实例评测。

Cross-Modal Clinical Knowledge Integration for Mammography Report Generation Figure 1
2026-06-01cs.CV

Cross-Modal Clinical Knowledge Integration for Mammography Report Generation

Jiayi Zhu, Fuxiang Huang, Yu Xie, Xi Wang, Zhixuan Chen, Yuan Guo, Qingcong Kong, Zhenhui Li, Qiong Luo, Hao Chen

aThe Hong Kong University of Science and Technology (Guangzhou), Guangzhou, Guangdong, China, bLingnan University, Hong Kong, China, cThe Third Affiliated Hospital of Kunming Medical University, Yunnan Cancer Hospital, Peking University Cancer Hospital, dThe Hong Kong University of Science and Technology, Hong Kong, China, eGuangzhou First People’s Hospital, South China University of Technology, Guangzhou, Guangdong, China, fThe Third Affiliated Hospital, Sun Yat-Sen University, Guangzhou, Guangdong, China, gHKUST Shenzhen-Hong Kong Collaborative Innovation Research Institute, Shenzhen, Guangdong, China, on an internal test set, two independent external test sets, and a publicly available external dataset demonstrate that

2026-06-01视觉感知

针对乳腺X线报告生成中通用视觉到文本模型难以处理四视图联合推理、BI-RADS评估和专业术语一致性的问题,本文提出MammoRG:先通过分类监督整合报告库与乳腺知识图谱中的临床先验,再用术语感知微调将乳腺词表作为语义单元,并配套MammoRGTool解析报告用于临床效能评估。在内部、两个外部及VinDr-Mammo数据集上,模型在NLG和临床指标均达SOTA,BI-RADS F1较次优提升约1.90%–3.27%。

On Revisiting Entropy for Identifying Mislabeled Images Figure 1
2026-06-01cs.CV

On Revisiting Entropy for Identifying Mislabeled Images

Chunlei Li, Zixuan Zheng, Yilei Shi, Guanglu Dong, Pengfei Li, Jingliang Hu, Xiao Xiang Zhu, Lichao Mou

On Revisiting Entropy for Identifying Mislabeled Images, Mislabeled samples in training datasets severely, roneous labels., proposing a novel approach for mislabeled data, correctly labeled samples exhibit consistent en-, tropy decrease during training, while mislabeled, labeling errors due to diagnostic complexity—, performance in mislabeled data identification, Our code is available at https:, MedAI Technology (Wuxi) Co. Ltd., Wuxi, China 2Sichuan, University, Chengdu, China 3University of Basel, Allschwil, Switzerland 4Technical University of Munich, Munich, Germany.

2026-06-01视觉感知

针对医学影像等数据中误标样本会被过参数化模型记忆、进而损害分类性能的问题,论文重新审视训练过程中的预测熵:干净样本熵通常下降,而误标样本长期高熵且与给定标签不一致。作者提出带符号熵及其时间积分 SEI,将不确定性大小、变化趋势和标签-预测一致性合成单一统计量,并可接入 CLIP 分类训练。实验显示其在四个医学影像数据集上识别误标样本达到或超过现有方法,同时实现较简单、计算开销较低。

A Pilot Study on Curator-Guided Multilingual Art Description for Blind and Low-Vision Audiences with Small Vision-Language Models Figure 1
2026-06-01cs.MM

A Pilot Study on Curator-Guided Multilingual Art Description for Blind and Low-Vision Audiences with Small Vision-Language Models

Iosif Tsangko, Andreas Triantafyllopoulos, George Margetis, Ioana Crihana, Björn W. Schuller

Technical University of Munich, National University of Science and Technology Politehnica Bucharest, Technical University of Munich Munich Germany, National University of Science and Technology Politehnica Bucharest Bucharest Romania

2026-06-01视觉语言视觉感知

面向博物馆需本地部署、保护隐私且支持低资源语言的无障碍艺术导览,本文用 Qwen2.5-VL-3B 构建德/罗/塞三语 BLV 艺术描述语料,并比较固定预算下单语 LoRA 与共享多语适配器,同时用罗马尼亚 BLV 小规模用户研究校准 LLM-as-Judge。结果显示,单语适配器在罗马尼亚语和塞尔维亚语上更稳定、视觉依据更好,多语方案在德语仍具竞争力。

Task-Focused Memorization for Multimodal Agents Figure 1
2026-06-01cs.CV

Task-Focused Memorization for Multimodal Agents

Tao Zou, Yichen He, Tian Qiu, Yuan Lin, Hang Li

ByteDance Seed, 2Fudan University

2026-06-01视觉语言

这篇论文关注多模态/具身智能体面对连续视频与任务流时“该记什么”的问题,而不只是如何存储记忆。作者将记忆生成建模为可学习策略,提出 TaskMem:先用强化学习优化忠实、非冗余等基础记忆质量,再在部署后用近期任务反馈微调轻量适配器,使记忆偏向任务相关内容。基于 Qwen3-VL-30B-A3B,在流式改造的 VideoMME、EgoLife、EgoTempo 上仅凭记忆回答问题,准确率分别提升 6.3%、7.0%、5.3%。

Towards Effective Long-Video Event Prediction via Multi-Level Event Semantics Mining Figure 1
2026-06-01cs.CV

Towards Effective Long-Video Event Prediction via Multi-Level Event Semantics Mining

Bo Peng, YuanJie Lyu, PengGang Qin, Tong Xu

University of Science and Technology of China

2026-06-01视觉感知

面向电影、剧集等长视频的未来事件预测,现有LVLM虽能问答和总结,却常遗漏人物身份、动作等关键细节,且对事件演化建模过粗。论文提出VISTA,通过角色中心视觉提示抽取事件相关细节,再用知识增强迭代检索构建因果连贯事件链,最后以“先提出候选、再检索线索”融合多层语义预测未来。实验在CMD和MILES上较各类LVLM与短视频方法显著领先,准确率稳定超过60%,消融也显示视觉细节、事件链和三项组件均关键。

HQ-JEPA: Hybrid Quantum Joint-Embedding Predictive Architecture for Cross-Modal Remote Sensing Representation Learning Figure 1
2026-06-01cs.CV

HQ-JEPA: Hybrid Quantum Joint-Embedding Predictive Architecture for Cross-Modal Remote Sensing Representation Learning

Md Aminur Hossain, Ayush V. Patel, Sanjay K. Singh, Biplab Banerjee

Biplab Banerjee2, Space Applications Centre, Centre of Studies in Resources, Indian Institute of Technology Bombay, images, SSL enables scalable pretraining and improves downstream performance in tasks

2026-06-01视觉感知

针对光学 Sentinel-2 与 SAR Sentinel-1 在成像机理、噪声和纹理上差异大、跨模态自监督易出现嵌入空间不稳定的问题,HQ-JEPA 将 JEPA 的掩码潜表示预测扩展到双模态遥感,并联合跨模态对齐、SIGReg 分布正则与基于可微 SWAP-test 的量子保真相似度损失。GeoBench 分类和分割实验显示其在线性探测和微调中较多基线有竞争力或更优,但量子模块仍依赖经典仿真,计算开销与规模化效果仍需进一步验证。

LVSA: Training-Free Sparse Attention for Long Video Diffusion Figure 1
2026-06-01cs.CV

LVSA: Training-Free Sparse Attention for Long Video Diffusion

Gael Glorian, Ioannis Lamprou, Zhen Zhang, Yujie Yuan, Hongsheng Liu

Distributed Parallel Technology Laboratory, Paris Research Center, Huawei Technologies France, AI Framework and Data Technology Lab, Huawei Technologies Co., Ltd.

2026-06-01视觉感知生成模型

长视频扩散推理受密集自注意力二次复杂度和训练长度外“冻结/循环”退化限制。LVSA提出无需训练、模型无关的块稀疏注意力,以局部时间窗口结合旋转全局锚点,缓解固定网格偏置并降低计算。实验在Wan与HunyuanVideo等模型上相对密集注意力最高约3.33倍加速,还使单卡生成更长视频成为可能,并用VQeval评估循环失败,扩展长度下质量优于密集基线。

Rethinking Efficient Crack Segmentation with Task-Aligned Structural-Directional Modeling Figure 1
2026-06-01cs.CV

Rethinking Efficient Crack Segmentation with Task-Aligned Structural-Directional Modeling

Shipeng Liu, Liang Zhao, Dengfeng Chen, Weihua Zhang

2026-06-01视觉感知

本文针对裂缝分割中盲目加深通用 CNN/Transformer/Mamba 特征混合导致复杂且未必匹配任务的问题,将其重定义为稀疏结构恢复。RIFT 以局部结构保真、水平/垂直/斜向协同连续性建模和轻量多尺度解码为核心,显式服务于细长、断裂、低对比裂缝的拓扑恢复。在 DeepCrack、CamCrack789、CrackMap、Crack500 上,RIFT 在 16 项主指标中取得最佳或并列最佳;RIFT-B 精度最高,RIFT-T 仅 0.47M 参数且部署效率突出。

Does Visual Information Play a Decisive Role in Vision-Language-Action Model Driving Behavior? Figure 1
2026-06-01cs.CV

Does Visual Information Play a Decisive Role in Vision-Language-Action Model Driving Behavior?

Jingtao He, Hongliang Lu, Xiaoyun Qiu, Yixuan Wang, Xinhu Zheng

2026-06-01视觉语言视觉感知

这篇论文针对 VLA 自动驾驶模型“行为是否真正依赖视觉信息”这一诊断缺口,提出按通道退化、语义信息扰动和空间结构修改组织的多层视觉扰动框架,并同时考察开环轨迹预测与闭环安全表现。结果显示视觉依赖并不均匀:低层像素退化影响有限,语义与空间结构破坏更容易暴露闭环安全退化,说明常规开环指标可能低估交互场景中的视觉 grounding 问题。

GGT-100K: Generative Ground Truth for Generalizable Real-World Image Restoration Figure 1
2026-06-01cs.CV

GGT-100K: Generative Ground Truth for Generalizable Real-World Image Restoration

Xiangtao Kong, Jixin Zhao, Lingchen Sun, Rongyuan Wu, Lei Zhang

2026-06-01视觉感知生成模型强化学习

真实图像复原受限于缺少大规模、高质量的真实退化配对数据,合成退化与实拍配对都难以泛化。本文提出用多模态生成基础模型从真实低质图生成“生成式真值”,评测9个MFM后选用Nano-Banana-2结合VLM自适应提示,并通过自动指标、VLM筛选和人工核验构建GGT-100K。实验显示,该10.3万对数据能稳定提升CNN、Transformer、all-in-one及生成式复原模型的真实场景泛化,收益对生成模型微调尤其明显。

SlotMemory: Object-Centric KV Memory for Streaming Long-Video Generation Figure 1
2026-06-01cs.CV

SlotMemory: Object-Centric KV Memory for Streaming Long-Video Generation

Weijia Dou, Hui Li, Jiahao Cui, Lei Zhou, Jingdong Wang, Siyu Zhu

Fudan University, Meta Superintelligence Labs

2026-06-01视觉感知

长视频流式生成常用按时间窗口保存帧或token,角色离开视野、提示词切换后易身份漂移。SlotMemory把扩散Transformer的KV历史按对象语义分解为可复用slot,并以slot作为高保真KV的索引,结合提示感知检索实现实体级持久记忆。在Wan2.1-T2V-1.3B上,60秒交互叙事质量分81.61,30秒动态一致性较最强基线相对提升22.8%。

PEEK: Picking Essential frames via Efficient Knowledge distillation Figure 1
2026-06-01cs.CV

PEEK: Picking Essential frames via Efficient Knowledge distillation

Killian Steunou, Anas Filali Razzouki, Khalil Guetari, Mounîm A. El-Yacoubi, Yannis Tevissen

2026-06-01视觉感知

视频字幕生成受限于可输入帧数,均匀采样虽便宜但忽略内容,现有自适应选帧又常依赖文本查询或计算开销大。PEEK用SigLIP 2离线根据真值字幕产生帧相关性排序,再蒸馏到仅看MobileCLIP2视觉特征的轻量时序Transformer,推理时按时间窗口选最高分帧。其在ActivityNet Captions和MSR-VTT低帧预算下优于多种基线,尤其1–2帧时CIDEr更高,且仅增加约5.2%字幕时间。

Iterative Framework For Data Augmentation Of Segmented Fingerprints Figure 1
2026-06-01cs.CV

Iterative Framework For Data Augmentation Of Segmented Fingerprints

João Leonardo H. D. Agnol, Wesley Augusto de Bona, Erick Oliveira Rodrigues, Luiz Fernando Puttow Southier, Jefferson Oliva, Marcelo Filipak, Dalcimar Casanova

*Federal University of Technology (UTFPR), compounded by the scarcity of available data for rescarch that, of availability of large and representative infant datasets [1]., mains, its efficacy is fundamentally reliant on the availability, cumventing the issue of data availability, this study introduces

2026-06-01视觉感知

针对婴幼儿指纹采集困难、脊谷细且公开数据稀缺导致匹配模型难训练的问题,论文提出不合成原始纹理,而在已分割指纹上迭代叠加CNN分割结果,利用可控的分割误差生成变体。实验在5枚高分辨率新生儿指纹上显示,不同透明度和迭代次数能显著改变细节点数量与结构,同时保持与原图的视觉相似性;但尚未验证其对实际匹配或分割模型训练的性能增益。

Parallel Tempering Initial Sampling in Inference-Time Reward Alignment Figure 1
2026-06-01cs.LG

Parallel Tempering Initial Sampling in Inference-Time Reward Alignment

Myeongjun Oh, Gwangho Kim, Sungyoon Lee

Department of Artificial Intelligence, Department of Computer Science, Hanyang University, Seoul, Korea

2026-06-01强化学习

本文关注扩散/流模型推理时奖励对齐中的初始化瓶颈:标准 SMC 从先验采样难以命中稀有高奖励区域,已有奖励感知 pCNL 又易陷入多模态局部峰。作者提出 PATHS,在初始噪声后验上运行带温度梯度的并行回火链,并用 Metropolis 交换把热链探索到的高奖励状态传给冷链。布局生成和数量控制实验显示其相对 TDS、DAS 与 Ψ-Sampler 稳定提升,复杂提示下收益更明显。

Benchmarking Single-Step Inpainting Methods for Multi-Object 3D Gaussian Splatting Scenes Figure 1
2026-06-01cs.CV

Benchmarking Single-Step Inpainting Methods for Multi-Object 3D Gaussian Splatting Scenes

Finn Dröge, Cecilia Curreli, Abhishek Saroha, Daniel Cremers

Technical University of Munich, Munich Center for Machine Learning

2026-06-01数据集/基准三维

针对3D Gaussian Splatting场景物体移除后补全容易出现跨视角不一致的问题,论文系统比较单步2D修复器与3DGS补全流程,并引入带真实无目标GT的多物体360°客厅遮挡场景。核心洞察是2D视觉质量更高的生成式修复在3D一致性上反而不如LaMa等重建式方法,且用修复后视图从零初始化场景优于在原场景上微调;直接在原图中修掉物体的Nano Banana基线也显示先做3D物体移除很关键。

Generating Reports or Repeating Templates? Measuring and Mitigating Template Collapse in 3D CT Report Generation Figure 1
2026-06-01cs.CV

Generating Reports or Repeating Templates? Measuring and Mitigating Template Collapse in 3D CT Report Generation

Tom Maye-Lasserre, Yitong Li, Bailiang Jian, Morteza Ghahremani, Benedikt Wiestler, Christian Wachinger

Technical University of Munich (TUM), Munich Center for Machine Learning (MCML)

2026-06-01三维

论文指出3D CT报告生成中,现有VLM常以流畅文本掩盖低病灶检出与低多样性,坍缩为少量正常模板并漏报罕见关键异常。作者将其定义为Template Collapse,并用临床一致性、多样性、正常模板偏置和罕见病灶保留率进行诊断;提出CLarGen,把病理多标签检测、病理引导检索和医学语言合成解耦。实验显示其相较基线显著提升临床准确性,macro-F1由0.189升至0.487,CRG由0.368升至0.472,同时保持报告流畅性。

Can BEV Perception Gracefully Degrade under Sensor Failures? Figure 1
2026-06-01cs.CV

Can BEV Perception Gracefully Degrade under Sensor Failures?

Haifa Zhang, Yijing Wang, Haoyu Wang, Zheng Li, Zhiqiang Zuo

Tianjin Key Laboratory of Intelligent Unmanned Swarm Technology and System, School of Electrical and Information Engineering, Tianjin University, Key Laboratory of System Control and Information Processing, Ministry of Education of China, Tianjin Key Laboratory of Intelligent Unmanned Swarm Technology and System, School of Electrical and Information Engineering, Tianjin University Tianjin China, Key Laboratory of System Control and Information Processing, Ministry of Education of China Shanghai China

2026-06-01视觉感知

这篇论文关注自动驾驶多模态 BEV 感知在相机或 LiDAR 失效时容易因静态融合和“模态懒惰”而崩溃的问题。作者提出 Grace-BEV,在对齐 BEV 空间中用 TrustGate Router 评估模态可信度,并通过 FailSafe Fusion Block 动态抑制坏特征,配合三阶段训练和模态 dropout 促使均衡学习。nuScenes-R/C 实验显示,在严重 LiDAR 故障下可将基线 0.0% mAP 恢复到最高 34.7%,干净场景精度也提升最多 1.4%。

BiSegMamba: Efficient Bidirectional Tri-Oriented Mamba for 3D Medical Image Segmentation Figure 1
2026-06-01cs.CV

BiSegMamba: Efficient Bidirectional Tri-Oriented Mamba for 3D Medical Image Segmentation

Bakht Zada, Chao Tong, Qile Su, Shuai Zhang

2026-06-01视觉感知三维

针对3D医学分割中CNN难建模长程依赖、Transformer开销高,以及现有Mamba体数据扫描存在高FLOPs、单向顺序偏置和固定方向融合的问题,BiSegMamba采用紧凑到细节结构、早期多尺度空间混合、深层双向三正交Mamba与自适应方向融合。在颈动脉CTA、BraTS2023、ACDC和AMOS-CT上表现出较好泛化,相比SegMamba-V2在部分任务精度更高,并最多减少77.9% FLOPs。

Omni-Supervised Motion Editing: Balancing Change and Invariance through Positive-Negative Learning Figure 1
2026-06-01cs.CV

Omni-Supervised Motion Editing: Balancing Change and Invariance through Positive-Negative Learning

Zhenwu Shi, Jingyu Gong, Peiwei Wang, Xingzan Wang, Tianwen Qian, Wenxi Li, Yuan Fang, Jiao Xie, Lizhuang Ma, Shaohui Lin

Shanghai Institute of Artificial Intelligence for Education, East China Normal University, China, School of Computer Science and Technology, East China, Normal University, China, School of Statistics, East China Normal University, China, The 27th Research Institute of CETC, Zhengzhou, China, Key Laboratory of Advanced Theory and Application in Statistics and Data Science, MOE, China, Shanghai Key Laboratory of Computer Software Evaluating and Testing, China, School of Computer Science, Shanghai Jiao Tong University, China

2026-06-01视觉感知

本文关注文本驱动人体动作编辑中“该改的要改准、未编辑部分要保持”的矛盾,指出现有扩散方法易因全局条件或启发式相似度导致语义偏差和动作失真。OmniME将监督拆成正负两支:多层回溯特征约束、基于源目标相似度的动作保持,以及三元组语义对齐。在 MotionFix 与 STANCE Adjustment 上取得 SOTA,AvgR(1 at best) 分别由 20.88 降至 13.06、29.05 降至 22.77。

Variational Adapter for Cross-modal Similarity Representation Figure 1
2026-06-01cs.CV

Variational Adapter for Cross-modal Similarity Representation

WenZhang Wei, Zhipeng Gui, Dehua Peng, Tiandi Ye, Huayi Wu

2026-06-01视觉感知

论文针对图文匹配中二值稀疏标注把连续相似度硬切分、产生假负样本并削弱泛化的问题,提出 VACSR,将跨模态相似度而非单模态特征的不确定性建模为变分潜空间,通过 VAE 式适配器与正则化缓解对二值标签的过拟合。实验显示其在图文检索、噪声对应、域泛化和 base-to-novel 泛化上均有提升,但具体增益来源仍可能受适配器结构与超参数影响。

PRISM: Progressive Reasoning through Iterative Slot Memory for Vision Figure 1
2026-06-01cs.CV

PRISM: Progressive Reasoning through Iterative Slot Memory for Vision

Ziyu Wang, Shuangpeng Han, Mengmi Zhang

Deep NeuroCognition Lab, Nanyang Technological University, Singapore

2026-06-01视觉感知

针对前馈视觉模型在遮挡或证据缺失时难以修正中间表征的问题,PRISM 将图像特征先聚合为对象中心 slot,再用向量量化原型记忆检索可能的完整模式,并在金字塔各阶段自适应迭代执行“组织—回忆—精炼”。文中称其在分类、检测和语义分割上达到有竞争力的表现,并在不完整观测下更稳健,但具体增益幅度和来源需结合完整实验表进一步判断。

IAF-Net: Illumination-Adaptive Fusion for Low-Light Urban Road Segmentation Figure 1
2026-06-01cs.CV

IAF-Net: Illumination-Adaptive Fusion for Low-Light Urban Road Segmentation

Bingtao Wang, Daojie Peng, Fulong Ma, Jun Ma, Liang Zhang

2026-06-01视觉感知

面向自动驾驶夜间/低照城市道路分割,本文指出固定 RGB-几何融合会把退化的 RGB 噪声带入特征。IAF-Net 以全局亮度估计 RGB 可靠性,动态调节 RGB 与深度法向几何特征权重,并用亮度调制注意力增强暗光特征选择。作者构建 nuScenes-NRS 与 CARLA-MWRS,报告在真实夜间集上达到对比方法中最佳整体表现,合成多天气集验证鲁棒性;消融中 IAF 模块带来最大单项 MaxF 增益 0.70%。

MultiAct: Text-to-Motion Generation from Composite Text via Tailored Attention Guidance Figure 1
2026-06-01cs.CV

MultiAct: Text-to-Motion Generation from Composite Text via Tailored Attention Guidance

Nathan Sala, Ofir Abramovich, Ariel Shamir, Daniel Cohen-Or, Andreas Aristidou, Sigal Raab

Tel Aviv University, Reichman University, CYENS Centre of Excellence, University of Cyprus, Tel Aviv University Tel Aviv 4610101 Israel, Reichman University Herzliya 4610101 Israel, CYENS Centre of Excellence Nicosia 1016 Cyprus, Reichman University Herzliya Israel, Tel Aviv University Tel Aviv Israel, University of Cyprus Nicosia 1678 Cyprus

2026-06-01视觉感知

现有文本到动作模型在“边跑边挥手”等同时复合动作提示下易出现语义塌缩,只生成主导动作。MultiAct不重训骨干模型,而是在推理时按提示自适应选择需增强的词、层和扩散步,通过放大弱语义的交叉注意力提升组合可控性。实验和用户研究显示其较MoMask、STMC及改造版Attend-and-Excite在语义覆盖和偏好上更优,同时基本保持动作真实感。

Inference-Free Multimodal Learned Sparse Retrieval for Production-Scale Visual Document Search Figure 1
2026-06-01cs.IR

Inference-Free Multimodal Learned Sparse Retrieval for Production-Scale Visual Document Search

Gyu-Hwung Cho (1 and 2), Youngjune Lee (1), Kiyoon Jeong (1), Siyoung Lee (1), Sanggyu Han (1), Hervé Dejean (3), Stéphane Clinchant (3), Seung-won Hwang (2) ((1) NAVER Corp., Republic of Korea, (2) Seoul National University, (3) Naver Labs Europe, France)

NAVER Corp., Seoul National University, Naver Labs Europe, NAVER Corp. Gyeonggi-do Republic of Korea, Seoul National University Seoul Republic of Korea, Naver Labs Europe Meylan France

2026-06-01视觉语言

面向 arXiv/PDF 等大规模视觉文档检索,论文指出现有 VLM 稠密/多向量方法在线需神经查询编码,而 OCR/Caption+BM25 索引成本高。其核心洞察是视觉稀疏表示存在“词汇落地”问题,并提出 V-SPLADE,用训练期 caption-gated token supervision 引导页面图像激活词表维度,推理时直接倒排检索。六个基准平均 NDCG@5 较同规模稠密基线提升 13.8pp,在 18.7M 文档上 R@5 翻倍以上,并可与稠密检索融合增益。

DiTTo: Scalable Order-aware All-in-One Image Restoration Agent Figure 1
2026-06-01cs.CV

DiTTo: Scalable Order-aware All-in-One Image Restoration Agent

Seungho Choi, Jihyong Oh

Department of Computer Science, Cranberry-Lemon University

2026-06-01视觉感知

真实图像常同时含雾、雨、噪声、模糊等多重退化,且去除顺序会影响最终质量。DiTTo将全能图像复原建模为顺序感知的专家调用问题,用模拟器结合单步复原模拟与IQA评分,以线性成本构造轨迹数据,再经SFT和轻量ORA对齐,新增专家只需更新ORA阶段。在MiO-100最多五种退化评测中,其多退化复原质量超过既有智能体方法,并展示约40倍更快适配。

Attend to Evidence: Evidence-Anchored Spatial Attention Supervision for Multimodal RLVR Figure 1
2026-06-01cs.CV

Attend to Evidence: Evidence-Anchored Spatial Attention Supervision for Multimodal RLVR

Ruina Hu, Chen Wang, Lai Wei, Jionghao Bai, Bin Yu, Weiran Huang, Kai Wang, Yue Wang

Harbin Institute of Technology, Zhongguancun Academy, Zhongguancun Institute of Artificial Intelligence, Nankai University, Shanghai Jiaotong University, Zhejiang University

2026-06-01视觉语言视觉感知强化学习

这篇论文针对多模态 RLVR 只按最终答案给奖励、难以判断模型是否真正看到了关键图像证据的问题,提出 EASE:把训练集中的证据框转成平滑视觉 token 目标,并仅在高奖励轨迹上约束回答 token 对图像区域的注意力,推理时不需额外标注。在 Qwen2.5/3-VL 多个骨干上,相比 DAPO 平均提升 2.5–3.1 分,且诊断显示注意力更贴近标注证据区域。

What Makes LVLMs Hallucinate Less? Unveiling the Architectural Factors Behind Hallucination Robustness Figure 1
2026-06-01cs.CV

What Makes LVLMs Hallucinate Less? Unveiling the Architectural Factors Behind Hallucination Robustness

Yusheng He, Jizhe Zhou, Xia Du, Zheng Lin, Jun Luo, Jiancheng Lv

2026-06-01视觉语言安全鲁棒

针对LVLM幻觉难以从零散组件改动中解释的问题,论文把架构因素拆为语言基础、视觉表征与语义对齐三维七项,并提出CoSimUE统一评测共现、相似性和不确定性幻觉。实验显示,单纯扩大参数作用有限;更强语言模型主要缓解共现偏置,更强视觉编码器和高分辨率降低相似性错误,而对齐质量对不确定场景更关键,视觉保真与对齐联合提升最全面。

MergeTok: Unified Continuous and Discrete Visual Tokenization via Token Merging Figure 1
2026-06-01cs.CV

MergeTok: Unified Continuous and Discrete Visual Tokenization via Token Merging

Luyuan Zhang, Siyuan Li, Zedong Wang, Qingsong Xie, Cheng Tan, Anna Wang, Yanhao Zhang, Chen Chen, Haonan Lu, Haoqian Wang

Tsinghua University, Westlake University, Zhejiang University, Hong Kong University of Science and Technology, Shanghai AI Lab

2026-06-01视觉感知

针对连续 VAE 重建好但语义纠缠、离散 VQ 适合自回归却易梯度稀疏和码本塌缩的问题,MergeTok 将二者放入共享编码器—解码器中联合训练,并用 token merging 产生的分组作为语义桥梁:约束 VAE 的合并 token 对齐,同时引导 VQ 的组内多样、组间排斥量化。ImageNet-256 上在相同 token 预算下 rFID 低于强 VAE/VQ 基线,并兼容自回归与扩散生成器。

SteerFace: Debiasing Synthetic Face Generation via Adaptive Residue Perturbation Figure 1
2026-06-01cs.CV

SteerFace: Debiasing Synthetic Face Generation via Adaptive Residue Perturbation

Yuxi Mi, Qiuyang Yuan, Jianqing Xu, Yichun Zhou, Xuan Zhao, Jun Wang, Rizen Guo, Shuigeng Zhou

Fudan University, Youtu Lab, Tencent, WeChat Pay Lab33, Tencent, Fudan University Shanghai China, Youtu Lab, Tencent Shanghai China, WeChat Pay Lab33, Tencent Shenzhen China

2026-06-01视觉感知

针对合规人脸数据稀缺下合成数据训练识别模型仍存在 synthetic-real gap 的问题,论文指出扩散生成虽具身份一致性和多样性,却会因身份嵌入夹带非身份视觉线索而形成数据集级“视觉倾向”。SteerFace在训练中将身份嵌入沿超球面正交方向自适应扰动,抑制生成器依赖残余视觉偏差,同时尽量保留身份信息;实验显示其能减轻视觉倾向,并在多数据集和生成管线中提升下游人脸识别表现。

Foundation VAEs for 3D CT Reconstruction, Augmentation, and Generation Figure 1
2026-06-01cs.CV

Foundation VAEs for 3D CT Reconstruction, Augmentation, and Generation

Qi Chen, Shuhan Ding, Yu Gu, Nan Liu, Jiang Bian, Alan Yuille, Zongwei Zhou, Jingjing Fu

2026-06-01生成模型三维

针对CT专用VAE训练成本高且跨扫描仪、协议和疾病泛化不稳的问题,论文提出直接冻结自然图像/视频预训练的Foundation VAE,作为3D CT重建、增强与生成的统一潜空间接口。其洞察是重建误差主要表现为噪声和轻微伪影而非边界偏移,可用于边界增强训练;实验显示肿瘤分割NSD平均提升3.9%,潜空间条件扩散生成的FVD降低3.9%、CT-CLIP提升36.2%,18类疾病忠实度AUC提升2.76%。

GUI-C$^2$: Coarse-to-Fine GUI Grounding via Difficulty-Aware Reinforcement Learning Figure 1
2026-06-01cs.CV

GUI-C$^2$: Coarse-to-Fine GUI Grounding via Difficulty-Aware Reinforcement Learning

Junlong Li, Chao Hao, Lap-Pui Chau, Yi Wang

The Hong Kong Polytechnic University

2026-06-01视觉语言强化学习

GUI 定位在密集界面、小图标和相似控件上仍易失败,且现有 RL 方法既把样本等权处理,又难在裁剪时兼顾上下文与冗余。本文提出 GUI-D 按难度筛选并加权训练样本,GUI-C² 则用面积门控的粗到细裁剪和改进感知奖励,把决策简化为目标框预测。实验称其在仅 4,624 个样本、3B 模型设置下于三个常用基准达到 SOTA。

DSD-GS: Dynamic-Static Decomposition of Gaussian Splatting for Efficient and High-Fidelity Dynamic Scene Reconstruction Figure 1
2026-06-01cs.CV

DSD-GS: Dynamic-Static Decomposition of Gaussian Splatting for Efficient and High-Fidelity Dynamic Scene Reconstruction

Youngtae Han, Sung-hwan Han, Youngmin Yi

Department of Artificial Intelligence Engineering, Sogang University

2026-06-01三维

面向动态场景重建中现有动态 3DGS 将静态背景也按帧变形、导致计算浪费和背景不稳定的问题,DSD-GS 用前馈 Gaussian Splatting 编码器结合光流进行动静分解,只对动态前景建模,并缓存静态背景渲染,同时绕过 COLMAP 实现确定性初始化。文中报告在 Neural 3D 上训练约 10 分钟、1352×1014 分辨率超过 700 FPS,并在质量、速度和存储上优于基线。

Robust Dreamer: Deviation-Aware Latent Gaussian Memory for Action-Controlled AR Video Generation Figure 1
2026-06-01cs.CV

Robust Dreamer: Deviation-Aware Latent Gaussian Memory for Action-Controlled AR Video Generation

Hanlin Chen, Jiaxin Wei, Xibin Song, Yifu Wang, Steve Wang, Hongdong Li, Pan Ji, Gim Hee Lee

School of Computing, National University of Singapore, Vertex Lab, Australian National University

2026-06-01视觉感知规划控制三维安全鲁棒

本文面向逐帧动作控制的交互式世界模拟,针对长时自回归生成中视觉质量和3D一致性易漂移的问题,指出反复 latent-RGB 转换和训练时干净记忆与推理时污染记忆不匹配是关键原因。方法以 Latent Gaussian Memory 将扩散 latent 绑定到高斯基元并在 latent 空间 splatting 召回,同时用动态偏差档案在训练中注入 rollout 误差。ScanNet、DL3DV 和 OmniWorldGame 实验显示其长时保真度、3D一致性和鲁棒性优于现有方法。

Count Anything Figure 1
2026-06-01cs.CV

Count Anything

Mengqi Lei, Shuokun Cheng, Wei Bao, Shaoyi Du, Jun-Hai Yong, Siqi Li, Yue Gao

{BNRist, THUIBCS, BLBCI, School of Software}, Tsinghua University, School of Computer Science and Technology, China University of Geosciences, Wuhan, State Key Laboratory of Human-Machine Hybrid Augmented Intelligence, National Engineering Research Center for Visual Information and Applications, and Institute of Artificial Intelligence and Robotics, Xi’an Jiaotong University, outperforming existing open-world counting methods. The code is available at:, and others describe instances with masks, polygons, or label maps [20, 21, 22]. Some datasets, further use crowd or group labels for targets that are difficult to separate instance by instance, and

2026-06-01视觉感知

面向跨场景计数任务长期被人群、遥感、细胞等专用数据集割裂的问题,论文将计数重定义为文本引导的实例点预测,并构建含六类视觉域、约22万图像和1500万实例的 CLOC。方法上用区域级稀疏计数器补强大而稀疏目标,用像素级密集计数器覆盖小而拥挤目标,再通过点中心监督和无参融合处理异构标注。实验显示其在多域泛化和计数精度上优于现有开放世界计数方法,但增益可能部分来自大规模数据。

LegSegNet: A Public Deep Learning System for Lower Extremity CT Tissue Segmentation and Quantification Figure 1
2026-06-01cs.CV

LegSegNet: A Public Deep Learning System for Lower Extremity CT Tissue Segmentation and Quantification

Yuwen Chen, Yaqian Chen, Roy Colglazier, Haoyu Dong, Hanxue Gu, Maciej A. Mazurowski, Kevin W. Southerland

Department of Electrical and Computer Engineering, Duke University, Durham, NC 27708, Department of Biostatistics & Bioinformatics, Duke University, Durham, NC 27708, Department of Radiology, Duke University, Durham, NC 27708, Department of Computer Science, Duke University, Durham, NC 27708, Department of Surgery, Duke University, Durham, NC 27708

2026-06-01视觉感知

面向下肢 CT 体成分分析中人工标注昂贵、现有公开工具难以覆盖肌间/肌内脂肪且缺少端到端量化流程的问题,LegSegNet基于 nnUNet 构建公开系统,可分割骨、骨骼肌、皮下脂肪和肌间/肌内脂肪并输出定量指标。模型用1302张放射科审核切片训练、900张测试,并对比CNN、Transformer和微调基础模型,平均Dice达89.31且整体最佳,但增益可能主要来自任务定制与数据标注。

Function2Scene: 3D Indoor Scene Layout from Functional Specifications Figure 1
2026-06-01cs.CV

Function2Scene: 3D Indoor Scene Layout from Functional Specifications

Ruiqi Wang, Qimin Chen, Daniel Ritchie, Angel X. Chang, Manolis Savva, Kai Wang, Hao Zhang

Simon Fraser University, Brown University, ShanghaiTech University, Simon Fraser University Burnaby BC Canada, Simon Fraser University Burnaby Canada, Brown University Providence Rhode Island USA, ShanghaiTech University China

2026-06-01三维

本文针对现有文本到室内场景方法偏向“放什么家具”、难以保证真实使用功能的问题,提出 Function2Scene:先从功能性设计 brief 中解析住户画像与活动需求,再映射到空间、人体工学、活动和环境等17类约束,并用几何工具、LLM 推理与 VLM 评估组成检查—修复循环迭代优化布局。在30个专业室内设计案例上,其生成结果相比近期 LLM 场景合成基线更符合功能需求,成对比较中获94.3%偏好。

MechVQA: Benchmarking and Enhancing Multimodal LLMs on Comprehensive Mechanical Drawing Understanding Figure 1
2026-06-01cs.CV

MechVQA: Benchmarking and Enhancing Multimodal LLMs on Comprehensive Mechanical Drawing Understanding

Qian Kou, Xiaofeng Shi, Yulin Li, Xiaosong Qiu, Xinyang Wang, Hua Zhou, Cao Dongxing

2026-06-01视觉语言数据集/基准

针对通用多模态大模型在高密度标注、正投影约束和工程符号并存的机械图纸上易漏读、空间推理不稳的问题,论文构建了 MechVQA:含 3.3K 图纸、约 21K 问答,覆盖识别、推理、判断三类 10 个子任务,并基于 SFT 与 DAPO 强化学习训练领域模型 MechVL。实验显示 MechVL 在总分上较最强闭源基线提升 7.57 个百分点,主要增强跨视图推理和标准敏感判断。

Text-guided Feature Disentanglement for Cross-modal Gait Recognition Figure 1
2026-06-01cs.CV

Text-guided Feature Disentanglement for Cross-modal Gait Recognition

Zhiyang Lu, Ming Cheng

Fujian Key Laboratory of Urban Intelligent Sensing and Computing, Xiamen University., Key Laboratory of Multimedia Trusted Perception and Efficient Computing, Ministry of Education of China, Xiamen University, 361005, P.R. China.

2026-06-01视觉感知

针对RGB视频与LiDAR点云步态识别中2D/3D模态差距大、共享特征难以稳定提取的问题,论文提出TCFDNet:用LLM构建跨视角步态文本字典,并借助CLIP将文本先验作为语义锚点,引导模态特定/共享特征解耦;同时加入残差正交约束、特征稳定增强和跨模态patch交换。实验在SUSTech1K与FreeGait上取得新的最优结果,消融显示各模块均有贡献。

CameraNoise: Enabling Faithful Camera Control in Video Diffusion through Geometry-Flow-Guided Noise Warping Figure 1
2026-06-01cs.CV

CameraNoise: Enabling Faithful Camera Control in Video Diffusion through Geometry-Flow-Guided Noise Warping

Haoyu Zhao, Jiaxi Gu, Haoran Chen, Qingping Zheng, Yeying Jin, Hongyi Yang, Junqi Cheng, Yuang Zhang, Zenghui Lu, Huan Yu, Jie Jiang, Peng Shu, Zuxuan Wu, Yu-Gang Jiang

2026-06-01视觉感知生成模型规划控制

本文针对视频扩散中相机位姿控制不准、几何一致性差的问题,提出 CameraNoise:不再把相机参数作为特征条件注入,而是用仅由相机参数构造的 GRFlow 将位姿运动扭曲到高斯噪声空间,尽量解耦外观与运动。实验在 RealEstate10K、MultiCamVideo、DrivingDoJo 上显示,其在轨迹误差、FVD 和视觉质量上普遍优于 MotionCtrl、CameraCtrl、AC3D 等基线。

DisPlace: Discriminative Place Projections for Multi-Reference Visual Place Recognition Figure 1
2026-06-01cs.CV

DisPlace: Discriminative Place Projections for Multi-Reference Visual Place Recognition

Dhyey Manish Rajani, Michael Milford, Tobias Fischer

2026-06-01视觉感知

针对多次巡航参考图像在天气、季节和视角变化下难以高效融合的问题,DisPlace把多参考VPR描述子融合转化为广义特征值问题,学习最大化地点间可分性、抑制同地点跨参考变化的投影,再聚合为紧凑地点表示。其无需重训现有描述子,在4个数据集、6类描述子上评测,49/54种外观变化条件优于7个多参考基线,并降低推理存储开销。

SLAP: The Semantic Least Action Principle for Variational Video-Language Modeling Figure 1
2026-06-01cs.CV

SLAP: The Semantic Least Action Principle for Variational Video-Language Modeling

Xiang Fang, Wanlong Fang

2026-06-01视觉感知

该文针对LVLM因稀疏采样产生“时间盲区”、导致遮挡场景中物体消失和因果不一致的问题,提出将视频潜变量视为语义流形上的动力学轨迹,用语义最小作用量和拉格朗日桥把插值转化为边值问题,而非像素级生成。实验声称在MSR-VTT、ActivityNet等基准上将物体消失率降低68%,推理加速177倍;但具体实验细节与增益来源仍需核查。

Immuno-VLM: Immunizing Large Vision-Language Models via Generative Semantic Antibodies for Open-World Trustworthiness Figure 1
2026-06-01cs.CV

Immuno-VLM: Immunizing Large Vision-Language Models via Generative Semantic Antibodies for Open-World Trustworthiness

Xiang Fang, Wanlong Fang, Wei Ji

2026-06-01视觉语言视觉感知生成模型强化学习

本文针对大视觉语言模型在开放世界中容易把未知异常高置信归入已知类的“语义自负”问题,提出 Immuno-VLM:借鉴免疫负选择,让 LLM 生成近分布异常和上下文异常的“语义抗体”,在共享语义嵌入空间主动刻画已知类边界,而非依赖事后阈值或像素级异常生成。实验称其在 ImageNet-1K 与四个 OOD 基准上达到新 SOTA,并在语义扰动检测上较零样本基线提升超过 16%。

Annotations Are Not All You Need: A Cross-modal Knowledge Transfer Network for Unsupervised Temporal Sentence Grounding Figure 1
2026-06-01cs.CV

Annotations Are Not All You Need: A Cross-modal Knowledge Transfer Network for Unsupervised Temporal Sentence Grounding

Xiang Fang, Daizong Liu, Wanlong Fang, Pan Zhou, Yu Cheng, Keke Tang, Kai Zou

Hubei Key Laboratory of Distributed System Security, Hubei Engineering Research Center on Big Data Security, School of Cyber Science and Engineering, Huazhong University of Science and Technology, Peking University, Henan University, The Chinese University of Hong Kong, Guangzhou University, Protagolabs Inc.

2026-06-01视觉语言

针对时序句子定位依赖昂贵视频-文本与边界标注的问题,本文提出无监督 CMKT,将廉价跨模态任务中的图像-名词外观知识和视频-动词动作知识迁移到 TSG,并用 clip 级 copy-paste 构造多动作场景以增强泛化。模型无需 TSG 标注或额外 grounding 训练即可检索片段,在 ActivityNet Captions 和 Charades-STA 上超过现有无监督方法,并接近或优于部分监督方法。

Beyond Accuracy: Evaluating Efficiency, Robustness and Explainability in Deep Learning for Malaria Diagnosis Figure 1
2026-06-01cs.LG

Beyond Accuracy: Evaluating Efficiency, Robustness and Explainability in Deep Learning for Malaria Diagnosis

Olivier Kanamugire, Kerol Djoumessi

African Institute for Mathematical Sciences, Kigali, Rwanda, Hertie Institute for AI in Brain Health, University of Tübingen, Germany

2026-06-01安全鲁棒

针对疟疾显微图像自动诊断在低资源临床中受算力成本、模型不透明与图像扰动影响的问题,本文在 NLM-Malaria 上比较 ResNet-18、EfficientNet-B0、MobileNetV3 和 ViT,并同时评估准确性、效率、鲁棒性与事后解释。结果显示轻量模型性能不显著弱于大模型;CAM 类解释更能定位相关区域,但所有 XAI 在临床可见噪声下均不稳,且置信度比准确率更早退化,可作为人工复核信号。

Simple Token-Efficient Vision-Language Model for Case-level Pathology Synoptic Report Generation Figure 1
2026-06-01cs.CV

Simple Token-Efficient Vision-Language Model for Case-level Pathology Synoptic Report Generation

Zhiyuan Yang, Jiahao Cheng, Vincent Quoc-Huy Trinh, Mahdi S. Hosseini

2026-06-01视觉语言视觉感知

面向多张全切片病理图像生成病例级结构化报告时,主要瓶颈是视觉 token 过长和显存成本过高。论文用冻结病理 patch 编码器、两层 MLP 对齐器和 Qwen2.5-3B 解码器组成简化 VLM,并以 5×低倍 512×512 patch 与 WSI 分隔 token 降低序列长度,再经两阶段监督训练完成对齐和报告生成。实验显示其在 ROUGE、METEOR、BLEU-4 与 AI 评审中优于强基线,同时可在半张 H100 上训练;但临床有效性仍主要由自动指标和模型评审支撑。

Vision-Based Localization in Dense Urban Environments: A Case Study of an Urban Village in China Figure 1
2026-06-01cs.CV

Vision-Based Localization in Dense Urban Environments: A Case Study of an Urban Village in China

Menglin Wu, Rui Cao

2026-06-01视觉感知

针对城中村建筑密集导致 GPS 失效、地图不完整而影响导航、配送和应急的问题,本文以广州石牌村为案例,提出低成本双相机采集流程,同步获取全景库图与手机查询图,构建面向城中村的视觉地理定位数据集,并系统评测检索式定位模型。结果显示视觉定位在此类遮挡、弱光、重复外观场景中有应用潜力,但现有方法仍存在明显鲁棒性限制,具体增益来源文中未充分说明。

Diversity Matters: Revisiting Test-Time Compute in Vision-Language Models Figure 1
2026-06-01cs.LG

Diversity Matters: Revisiting Test-Time Compute in Vision-Language Models

Yijie Tong, Yifan Hou, Shaobo Cui, Antoine Bosselut, Mrinmaya Sachan

Tong University, Our code is publicly available here: https://github.c

2026-06-01视觉语言视觉感知

本文关注LLM中常用的测试时计算能否迁移到视觉语言模型:视觉感知误差和跨模态对齐使文本启发式不再可靠。作者指出单模型多采样收益受预测相关性限制,并提出基于预测熵的ETTC,在多模型集成中优先选择更自信的输出。7个VLM、6个基准上,特征打分基本失效,多数投票仅在CoT下小幅提升,而ETTC稳定优于投票并常超过最佳单模型。

Equivariant Latent Alignment via Flow Matching under Group Symmetries Figure 1
2026-06-01cs.CV

Equivariant Latent Alignment via Flow Matching under Group Symmetries

Sunghyun Kim, Jaehoon Hahm, Jeongwoo Shin, Joonseok Lee

*Equal contribution 1Seoul National University, Seoul, Korea, University of Illinois Urbana-Champaign, Illinois, USA. Corre-

2026-06-01生成模型

论文关注等变表示用于新视角合成时的“潜变量错位”:解析群作用后的潜码与变换图像重新编码的潜码并不一致,削弱几何一致性。作者将已知 SO(2)/SO(3) 群作用视为一阶近似,提出 Residual Latent Flow,用 flow matching 在成对潜码间学习残差传输而非替代群先验。实验显示该方法能降低潜空间错位,并提升旋转对称数据上的新视角合成质量。

Mathematical Morphology in Machine Learning Figure 1
2026-06-01cs.CV

Mathematical Morphology in Machine Learning

Erick Oliveira Rodrigues, Aura Conci

Department of Computer Science, the center belong to the same cluster and the remaining, labels are known and growing them, filling the space around, these instances in order to cover a wider range of unlabelled, responsible for choosing the correct label when intersections

2026-06-01视觉感知

针对常规机器学习聚类/分类较少显式利用形状、密度与分形结构的问题,本文把数学形态学引入学习流程,提出基于形态重建的 k-MS 聚类、可由结构元素控制的形态学分类器,并给出结合 Minkowski 与 Chebyshev 的新距离以加速离散膨胀。实验显示 k-MS 在形状/密度敏感聚类中速度优于对比方法;新距离在邻域迭代中约比 Manhattan 快 1.3 倍、比 Euclidean 快 329.5 倍,k-NN 在 33 个 UCI 数据集上 26 次高于平均、9 次最佳。

A Context-Aware Middleware for Medical Image Based Reports: An approach based on image feature extraction and association rules Figure 1
2026-06-01cs.LG

A Context-Aware Middleware for Medical Image Based Reports: An approach based on image feature extraction and association rules

Erick O. Rodrigues, Jose Viterbo, Aura Conci, Trueman Mac Henry

Department of Computer Science, laboratories, would be the best physician, whether he is available at a certain, as information of which nurse is available at the moment for a, hospitals, laboratories and teleradiology companies, some, the medical context, checking whether someone is available and, York University, the hospital (e.g., best available physicians related to the medical, image, where they are and whether they are available) and sends, be employed in medical laboratories, teleradiology companies, member is available at the requested moment. The authors built

2026-06-01视觉感知

面向医院、实验室和远程放射场景中医学图像转交依赖人工沟通、耗时且受医生专长与可用性影响的问题,本文提出一种上下文感知中间件:从医护处理过的图像中提取特征,结合临床上下文与关联规则学习,将新图像自动分派给合适人员。论文主要给出架构与方法设想,尚未在真实场景验证;文中称单图处理约7分钟,并预期可减少沟通时间,但实际效率增益仍未充分说明。

Seeing Before Agreeing: Aligning Multi-Agent Consensus with Visual Evidence Figure 1
2026-06-01cs.CV

Seeing Before Agreeing: Aligning Multi-Agent Consensus with Visual Evidence

Yuhan Wang, Shuochen Chang, Yalin Feng, Dongsheng Ma, Yuanzi Li, Zhengren Wang, Yinglong Yang, Yufei Chen, Yikang Wang, Shaoxu Sun, Wentao Zhang

Peking University, Shanghai Jiao Tong University, Nanyang Technological University, Renmin University of China, Shandong University

2026-06-01视觉感知

针对多智能体 VQA 仅靠文本讨论易形成“表面一致”、却未必真正看对图像证据的问题,论文提出关键洞察:可靠共识需要答案一致与视觉证据对齐。其 EAGLE 框架无需训练,显式要求各 VLM 给出 grounding 区域,并据此进行证据诊断、修正和仲裁。六个 VQA 基准上取得最佳平均表现,同时提升可解释性与部署实用性。

ConTrans: Learning Text-enhanced Local-global Temporal Representations for Zero-shot Temporal Action Localization Figure 1
2026-06-01cs.CV

ConTrans: Learning Text-enhanced Local-global Temporal Representations for Zero-shot Temporal Action Localization

Kanchan Keisham, Thenukan Pathmanathan, Thangarajah Akilan

2026-06-01视觉感知

这篇论文面向零样本时序动作定位,针对现有方法偏重长程上下文、忽视帧间局部相对时序关联而导致边界不准的问题,提出 ConTrans:在多尺度编码器中结合卷积归纳偏置与 Transformer 自注意力,并引入文本增强的视觉—语义融合,以同时建模局部运动细节和全局上下文。实验在 ActivityNet-1.3 与 THUMOS14 上报告优于已有方法,但具体增益来源仍需结合消融进一步判断。

WristCompass: Kinematic Coupling as a Learnable Visual Concept for Ego-Camera Orientation Figure 1
2026-06-01cs.CV

WristCompass: Kinematic Coupling as a Learnable Visual Concept for Ego-Camera Orientation

Varun Nair, Vidyut Baradwaj, Jiahang He, Anya Singh, Jai Relan, Cabrel Happi

2026-06-01视觉感知

该文针对第一视角操作视频中手部遮挡导致基于场景几何的相机朝向估计失效的问题,提出利用手腕—肩—头运动链产生的“运动学耦合”作为可学习视觉概念。WristCompass 仅用双腕相对距离与方向的 4D 特征和短窗 GRU,从单目 RGB 恢复相机旋转;在 TACO 上达 13.8°,优于常量和 VGGT,并能零样本迁移到 Epic Kitchens 达 14.3°,但依赖双手可见且仅评估相对朝向。

PInVerify: An Offline Embodied Benchmark for Active Instance Verification Figure 1
2026-06-01cs.CV

PInVerify: An Offline Embodied Benchmark for Active Instance Verification

Yuhang Jiang

University of Trento, Italy

2026-06-01数据集/基准

论文针对具身导航“到达目标附近却未确认是否为正确实例”的语义缺口,提出主动实例验证 AIV,并构建离线基准 PInVerify:3000 个多视角 episode、6 扇区拓扑及陷阱/不可达视角标注,用于考察细粒度语言描述下的验证决策。实验显示最佳 MLLM 基线较嵌入基线高 4.9pp,检测仍带来约 3.1pp 瓶颈,所测 NBV 主动选视角未带来稳定增益;LoRA 微调代理达到 85.6%。

Controllable Lung Nodule Synthesis via Histogram-Regularized Latent Diffusion Models Figure 1
2026-06-01cs.CV

Controllable Lung Nodule Synthesis via Histogram-Regularized Latent Diffusion Models

Arunkumar Kannan, Yanbo Zhang, Han Liu, Michael Baumgartner, Jianing Wang, Alexander Hertel, Bogdan Georgescu, Sasa Grbic

Controllable Lung Nodule Synthesis via Histogram-Regularized Latent Diffusion Models, bJohns Hopkins University, Baltimore, MD, USA, dDepartment of Radiology and Nuclear Medicine, University Medical Center Mannheim, Heidelberg University, Mannheim, Germany, different nodule subtypes, including solid, part-solid, and ground-glass nodules. To address this challenge, we propose a controllable, scalability of LDMs with the fine-grained textural fidelity of, ing, addressing the limited availability of pathological training

2026-06-01生成模型规划控制

针对肺结节 CT 数据稀缺且亚型长尾导致诊断模型偏向常见实性结节的问题,本文提出 HR-LDM,在潜空间扩散中同时条件化亚型、空间掩码和 HU 直方图,并加入可微直方图正则以约束病灶强度分布。实验显示其可在完整 3D CT 中合成更符合亚型纹理的结节,定量指标和视觉图灵测试支持真实性;作为数据增强还提升结节亚型分类,并对恶性分类有潜在帮助。

Crafter: A Multi-Agent Harness for Editable Scientific Figure Generation from Diverse Inputs Figure 1
2026-06-01cs.CV

Crafter: A Multi-Agent Harness for Editable Scientific Figure Generation from Diverse Inputs

Haozhe Zhao, Shuzheng Si, Zhenhailong Wang, Zheng Wang, Liang Chen, Xiaotong Li, Zhixiang Liang, Maosong Sun, Minjia Zhang

University of Illinois at Urbana-Champaign, Tsinghua University, Peking University, most labor-intensive parts of paper preparation. Existing automated systems each, and benchmark are available at https://github.com/HaozheZhao/Crafter., Black Forest Labs, 2024]. One area where this progress has yet to translate into practical, labor-intensive parts of paper preparation. Recent work has begun to tackle this from two directions:, problematic when researchers need to adjust or revise individual labels, swap color schemes, or, recent raster-to-vector attempts [Lin et al., 2026, bit-datalab Contributors, unlike natural images, are structured compositions of discrete semantic components: labeled boxes, localized errors such as garbled labels and misaligned connectors that prompt rephrasing alone cannot

2026-06-01视觉感知

论文针对科研插图生成难以覆盖多图型、多输入条件且栅格结果不可局部编辑的问题,提出以结构化规格为共享记忆的多智能体“harness”:CRAFTER通过意图推理、方案探索、批评与规格修正闭环生成图,CRAFTEDITOR将栅格转为可编辑SVG,并构建CRAFTBENCH评测。实验显示其在PaperBanana-Bench和CRAFTBENCH上优于独立生成器与agent基线,消融表明各模块均有贡献。

ReGuLaR: Relation-Grounded Latent Reasoning for Large Vision-Language Models Figure 1
2026-06-01cs.CV

ReGuLaR: Relation-Grounded Latent Reasoning for Large Vision-Language Models

Zihu Wang, Karthik Somayaji N.S, Peng Li

University of California, Santa Barbara

2026-06-01视觉语言视觉感知

针对视觉语言模型中自然语言 CoT 难以承载连续视觉证据、现有潜空间推理又缺少对象关系 grounding 的问题,ReGuLaR 用训练期 ReGFormer 将每个潜在推理状态对齐到问题相关的主体、客体及关系,并构建 RGrounding-351K 提供框和关系监督;推理时不需外部场景图。实验显示其在多类视觉推理基准上优于通用 LVLM、文本 CoT 和已有潜推理方法,消融表明增益主要来自关系级潜状态监督而非单纯数据微调。

Prior Availability in Industrial Visual Sim-to-Real: A Review of CAD-Guided and CAD-Unavailable Regimes Figure 1
2026-06-01cs.CV

Prior Availability in Industrial Visual Sim-to-Real: A Review of CAD-Guided and CAD-Unavailable Regimes

Chenxi Tao, Seung-Kyum Choi

George W. Woodruff School of Mechanical Engineering, Georgia Institute of Technology

2026-06-01视觉感知

工业视觉 sim-to-real 常被简化为合成到真实图像迁移,但真实产线还受传感器、光照、材料、标定和稀有缺陷影响。本文的核心洞察是按“先验可用性”重组问题:有 CAD 时可用几何进行渲染、位姿和测试时验证;无 CAD 时只能依赖正常性、特征残差或语言/基础模型先验。基于 T-LESS/BOP、MVTec AD、VisA 的综述锚点显示,CAD 渲染数量本身不足以闭合域差,源分布设计、模型容量和少量真实标定往往更关键。

AdvScene: Rethinking Adversarial Patch Evaluation Through Scene Robustness Figure 1
2026-06-01cs.CR

AdvScene: Rethinking Adversarial Patch Evaluation Through Scene Robustness

Xiaoyong (Brian) Yuan, Lan (Emily) Zhang

Clemson University, are controllable but not grounded in a specific real scene., scenes with controllable rendering and calibrated using matched, A gap between realism and controllability. Existing evalua-, tion sweeps [1], is scalable because a patch can be rotated, scaled, camera trajectories is labor-intensive, difficult to reproduce, and, grounded, controllable, and faithful to the behavior of the same, ingly practical to build controllable scene representations from, real capture with the controllability of simulation. However, adver-

2026-06-01数据集/基准安全鲁棒

本文针对物理对抗贴片评估中过于依赖单视角成功率的问题,指出真实风险应由视角、距离和场景上下文下的“场景鲁棒性”决定。AdvScene借助真实场景重建与3DGS渲染,并用APSE将单锚点视图贴片约束嵌入目标表面,测量攻击的有效操作包络。实验在CO3D、Waymo及物理采集中显示,其与真实攻击行为一致性达99.30%,并揭示图像平面或仿真评估会遗漏显著的场景依赖失效。

VLM3: Vision Language Models Are Native 3D Learners Figure 1
2026-06-01cs.CV

VLM3: Vision Language Models Are Native 3D Learners

Zhipeng Cai, Zhuang Liu, Yunyang Xiong, Zechun Liu, Vikas Chandra, Yangyang Shi

2026-06-01视觉语言视觉感知三维

论文针对现有三维理解仍依赖专用架构、复杂损失和增强的问题,提出 VLM3,核心洞察是标准 VLM 通过焦距统一、文本化像素/区域引用以及混合数据 scaling 即可学习细粒度 3D。结果显示其在深度估计上将 VLM 准确率从 0.84 提至 0.90,并在像素对应、相机位姿和物体级 3D 理解上接近或超过专家模型;增益可能主要来自数据混合与 scaling。

Seeing Isn't Knowing: Do VLMs Know When Not to Answer Spatial Questions (and Why)? Figure 1
2026-06-01cs.CV

Seeing Isn't Knowing: Do VLMs Know When Not to Answer Spatial Questions (and Why)?

Yue Zhang, Zun Wang, Han Lin, Yonatan Bitton, Idan Szpektor, Mohit Bansal

2026-06-01视觉语言

这篇论文关注具身/机器人场景中视觉观察并不总可靠的问题:遮挡会让关键信息缺失,视角会制造误导。作者构建 SpatialUncertain,在3D仿真中把同一空间问题从可答变为应拒答,并加入视角选择评测。结果显示多种前沿VLM在遮挡和视角歧义下仍过度自信,遮挡平均约30%、视角歧义低于10%,且常难以选出可靠新视角;提示可部分缓解但有准确率代价,微调需覆盖多类不确定性。

On-Device Generative AI for GDPR-Compliant Visual Monitoring: Natural Language Alerts from Local Object Detection Figure 1
2026-06-01cs.CV

On-Device Generative AI for GDPR-Compliant Visual Monitoring: Natural Language Alerts from Local Object Detection

Gudrun Schappacher-Tilp, Nicoletta Kaehling, Jan Kornberger, Egon Teiniker

2026-06-01视觉感知生成模型

针对云端视觉监控需上传原始图像、与 GDPR 数据最小化原则冲突的问题,论文实现了树莓派 5 上的端侧闭环:Hailo-8L 加速 YOLOv5n-seg 检测后立即丢弃像素,仅把类别与事件 JSON 交给本地 Phi-3 Mini 生成告警文本。实验报告了延迟、资源占用和示例告警,表明单板机上结合视觉加速器与本地 LLM 可生成可用的自然语言监控输出,但仅为概念验证。

OmniMem: Scalable and Adaptive Memory Retrieval for Long Video Generation Figure 1
2026-06-01cs.CV

OmniMem: Scalable and Adaptive Memory Retrieval for Long Video Generation

Lin Zhao, Yushu Wu, Yifan Gong, Yanzhi Wang, Pu Zhao

Northeastern University

2026-06-01视觉感知

长视频自回归生成中,历史 KV cache 随片段增长而带来显存和注意力开销,截断或隐式压缩又易丢失远程细节并导致身份漂移。OmniMem 的核心洞察是做显式全范围稀疏检索,同时用自适应窗口排除缓解近邻偏置,并通过查询共享选择与逐头离散访问抑制 Union Explosion。实验显示其在 VBench-Long 上 Dynamic Degree 较最强基线提升 52.3%,一致性保持较好,且相对 LongLive 仅增加 1.7% 显存。

PhyDrawGen: Physically Grounded Diagram Generation from Natural Language Figure 1
2026-06-01cs.AI

PhyDrawGen: Physically Grounded Diagram Generation from Natural Language

Nafiul Haque, Syed Nazmus Sakib, Shifat E Arman

Department of Robotics and Mechatronics Engineering, University of Dhaka

2026-06-01视觉感知

论文针对现有图像生成模型在物理示意图中常出现力箭头幻觉、守恒律和几何约束错误的问题,提出将文本理解与物理约束求解解耦的 PhyDrawGen:先由 LLM 抽取类型化场景图,再用确定性 PSLG 求解器编码力平衡、光路和场线,最后由微调 Qwen-VL 迭代纠错。在含 1449 道力学、光学和电磁学题目的基准上,其物理约束满足率和标签正确性显著优于 GPT-5-image 与 Gemini 系列,但仍受限于二维经典场景和初始 LLM 抽取质量。

A Novel Global Context-aware Deep Neural Network for Enhanced Brain Tumor Segmentation using Magnetic Resonance Images Figure 1
2026-06-01cs.CV

A Novel Global Context-aware Deep Neural Network for Enhanced Brain Tumor Segmentation using Magnetic Resonance Images

Sourjya Mukherjee, Ananya Bhattacharjee, R. Murugan

2026-06-01视觉感知

针对脑肿瘤 MRI 手工分割成本高、误差大且肿瘤形态差异显著的问题,论文提出 GCSER-UNet:在 U-Net/残差框架中引入以通道均值和标准差加权的全局上下文 SE,并融合空间注意力与 ASPP 多尺度特征,另用三个轻量二分类模型分别处理 W/T/E 区域。结果在 TCGA LGG 上 Dice 达 94%,在 BraTS 2020 上 W/T/E 分别为 95%、92%、90%,整体优于多项对比,但 T 类较既有最佳略低。

VLM-GLoc: Vision-Language Model Enhanced Monte Carlo Localization for Robust Semantic Global Localization in Cluttered Quasi-Static Environments Figure 1
2026-06-01cs.RO

VLM-GLoc: Vision-Language Model Enhanced Monte Carlo Localization for Robust Semantic Global Localization in Cluttered Quasi-Static Environments

Shivendra Agrawal, Bradley Hayes

University of Colorado Boulder

2026-06-01视觉语言视觉感知强化学习安全鲁棒

针对商店、办公室等几何重复且物体半静态变化导致 AMCL 和固定类别语义定位易混淆的问题,VLM-GLoc 将视觉语言模型作为开放词表语义观测前端,把图像转为细粒度文本嵌入,并用反向语义提议初始化粒子、再分层融合几何约束。真实杂货店和实验室实验中,全局定位成功率分别达 70% 和 74%,显著高于几何或固定类别基线。

3DAE: Binaural Quality Assessment for Audio Novel View Synthesis with Spatial Maps and Benchmark Figure 1
2026-06-01cs.SD

3DAE: Binaural Quality Assessment for Audio Novel View Synthesis with Spatial Maps and Benchmark

Jialu Xu, Yifan Zhou

University of Waterloo

2026-06-01数据集/基准三维

这篇论文针对音频新视角合成中全局误差指标难以定位双耳失败原因的问题,提出全参考的 3DAE Map 与 3DAE Bench,将幅度、ILD/IPD、时间对齐、响度和高频损失转为可视化误差图和失效模式评分。实验用 ViGAS 在 Replay-NVAS 与 SoundSpaces 上验证,同一模型分别主要表现为时间错位和 ILD 不匹配,说明该基准能揭示单一标量指标掩盖的数据集相关问题。

Clustering Guided Domain-Specific Pretrained Foundation Model Very High-Resolution Arctic Remote Sensing Figure 1
2026-06-01cs.CV

Clustering Guided Domain-Specific Pretrained Foundation Model Very High-Resolution Arctic Remote Sensing

Amal S. Perera, Chandi Witharana, Elias Manos, Michael Pimenta, Anna K. Liljedahl

with limited labeled data. In this study, spectral and acquisition-, metadata descriptors were used within a scalable affinity-, hand-labeled Arctic feature-mapping datasets: human-built, Advanced Computing Center Award #: DPP20001). Authors would like to, thank Polar Geospatial Center, University of Minnesota for imagery support, Department of Natural Resources and the Environment, University of, Woodwell Climate Research Center, Falmouth, MA., availability from ground-based sensing, conventional aerial, However, despite the scale and diversity of available data, much, representations directly from raw, unlabeled data by, and suggest a pathway toward scalable and transferable, freely access Vantor images via the Polar Geospatial Center.

2026-06-01视觉感知

针对北极甚高分辨率遥感中标注稀缺、通用地球基础模型难以刻画冻土景观细粒度结构的问题,论文用光谱与成像元数据聚类从267TB影像中筛选约300万代表性patch,并以MAE预训练ViT-Large形成北极专用编码器。在基础设施、冰楔多边形、融冻滑塌和苔原网络任务上,F1较ImageNet初始化提升约5–8个百分点,并显著优于Prithvi-EO-2.0,增益可能主要来自领域数据筛选与预训练。

Dex2HOI: Dexterous Bimanual Two-Object Interaction Generation Figure 1
2026-06-01cs.CV

Dex2HOI: Dexterous Bimanual Two-Object Interaction Generation

Chrysa Pratikaki, Pablo Ruiz-Ponce, Jiankang Deng, Stefanos Zafeiriou, Rolandos Alexandros Potamias

Imperial College London, UK, University of Alicante, Spain

2026-06-01视觉感知

针对现有 HOI 生成多局限于单物体、缺少精细双手协同且常依赖测试时优化的问题,Dex2HOI提出文本条件的统一扩散框架,用双流解码与双向交叉注意力分别建模两个物体交互,并以手相对物体表示、运动融合网络和接触感知监督生成全身动作。其在 GRAB、HIMO、HUMOTO 上取得单/双物体设定的 SOTA,并通过前缀窗口自回归实现长序列实时生成,最高较优化式方法快 540 倍。

Mitigating Content Shift and Hallucination in GenAI Image Editing via Structural Refinement Figure 1
2026-06-01cs.CV

Mitigating Content Shift and Hallucination in GenAI Image Editing via Structural Refinement

Luxi Zhao, Michael S. Brown

Department of Electrical Engineering, York University, AI Center-Toronto

2026-06-01视觉感知

针对黑盒生成式图像编辑虽能提升观感却常引入位移、纹理失真、幻觉内容和分辨率不一致的问题,论文提出“结构保持 GenAI 融合”设定,并以光流对齐、全局色调迁移和可解释的多尺度共同/独有分解融合输入图与 GenAI 输出。实验在色调调整和低光增强中显示,相比写实风格迁移与图像融合基线,该方法在保留原图像素结构和分辨率的同时更好继承感知增强。

DTG-Restore: Training-Free Diffusion Refinement for Generative Video Super-Resolution Figure 1
2026-06-01cs.CV

DTG-Restore: Training-Free Diffusion Refinement for Generative Video Super-Resolution

Hidir Yesiltepe, Koutilya PNVR, Gaurav Pathak, Navaneeth Bodla, Bharat Singh, Pinar Yanardag, Jinrong Xie

2026-06-01视觉感知生成模型

针对扩散式视频超分在低质或 AI 生成视频上容易照搬扭曲几何、导致时序不稳的问题,论文提出无需训练的 Decoupled Time Guidance:在采样中让无条件分支提前到更干净的时间步提供 lookahead 先验,并逐步退火,再接任意修复模块补细节。实验及新建 GenWarp480 表明其可提升结构保真、时序一致性和感知真实感,但摘要外的具体量化增益需结合全文核查。

SANA-Streaming: Real-time Streaming Video Editing with Hybrid Diffusion Transformer Figure 1
2026-06-01cs.CV

SANA-Streaming: Real-time Streaming Video Editing with Hybrid Diffusion Transformer

Yuyang Zhao, Yicheng Pan, Qiyuan He, Jincheng Yu, Junsong Chen, Tian Ye, Haozhe Liu, Enze Xie, Song Han

Project Page: https://nvlabs.github.io/Sana/Streaming

2026-06-01视觉感知生成模型

面向直播、游戏等需要低延迟且长时一致的视频到视频编辑,SANA-Streaming将GDN线性记忆与局部softmax注意力交错,配合Cycle-Reverse反向重建正则、因果VAE及针对RTX 5090的融合GDN核和混合精度量化,在单卡实现1280×704端到端24 FPS、DiT 58 FPS,并报告较现有方法在时序一致性和吞吐上更优。

Functional MRI Time Series Generation via Wavelet-Based Image Transform and Spectral Flow Matching for Brain Disorder Identification Figure 1
2026-06-01cs.LG

Functional MRI Time Series Generation via Wavelet-Based Image Transform and Spectral Flow Matching for Brain Disorder Identification

Hwa Hui Tew, Junn Yong Loo, Fang Yu Leong, Julia K. Lau, Ding Fan, Hernando Ombao, Raphaël C.-W. Phan, Chee Pin Tan, Chee-Ming Ting

School of Information Technology, Monash University Malaysia, School of Engineering, Monash University Malaysia, Statistics Program, King Abdullah University of Science and Technology

2026-06-01视觉感知生成模型

针对 fMRI 采集昂贵、样本少且传统 FC 或原始时序生成难以保留 BOLD 的非平稳与多尺度动态,论文提出 DSFM:先用 DWT 将时序转为多分辨率时尺度图,再在 DCT 域用谱流匹配进行类别条件生成,并经逆变换还原信号。实验显示其在无/有条件谱图合成上更贴近真实分布,并提升脑障碍分类表现,但具体增益与数据规模、预处理的关系仍需进一步澄清。

Lightweight SAR Ship Detection via Contrastive Distillation Figure 1
2026-06-01cs.CV

Lightweight SAR Ship Detection via Contrastive Distillation

Surendar Devasundaram, Saber Latibari Banafsheh, Abhijit Mahalanobis

University of Arizona, University of Arizona Department of Electrical and Computer Engineering Tucson Arizona USA

2026-06-01视觉感知

面向实时/星载 SAR 船舶检测中大模型精度高但计算开销大的问题,论文提出 SURGE:将不同检测器的预测统一为候选区域,在共享嵌入空间用 InfoNCE 蒸馏教师的目标级关系几何,而非仅匹配特征或 logits。SSDD、HRSID 实验显示其对两阶段轻量学生最有效,最高提升 6.2 mAP、8.0 AP75,参数减少超过 50%,部分学生可超过教师。

Updating the standard neuron model in artificial neural networks Figure 1
2026-06-01cs.NE

Updating the standard neuron model in artificial neural networks

Raul Mohedano, Thomas Batard, Erik Velasco-Salido, Ramsses De Los Santos Mendoza, Jorge H. Martínez, Stacey Levine, Marcelo Bertalmío

2026-06-01视觉感知

这篇论文针对现有 ANN 仍沿用“点神经元”而忽略树突非线性与反向动作电位交互的问题,提出隐式偏置神经元模型,在不增加可训练参数的情况下把同层单元间的耦合非线性写入神经元计算。作者给出解存在唯一性等理论分析,并在实验中报告更强表达性、鲁棒性、更快学习、较少记忆以及更低训练数据需求;但具体增益在多大程度来自该生物启发结构而非任务设置仍需更多验证。

XOResNet: Exclusive-OR Meta-Residuals Facilitate Deep Spiking Neural Networks Learning Figure 1
2026-06-01cs.NE

XOResNet: Exclusive-OR Meta-Residuals Facilitate Deep Spiking Neural Networks Learning

Jianfang Wu, Junsong Wang

School of Artificial Intelligence, Shenzhen Technology University, Shenzhen 518118, China, Faculty of Data Science, City University of Macau, Macau 999078, China

2026-06-01视觉感知

该文针对深层脉冲神经网络直接套用 ResNet 时的脉冲冗余、非恒等捷径信息丢失和残差分支重复学习问题,提出 OR-ADD 捷径:恒等映射用 OR 保持二值脉冲,尺度变换时改加电流;并用 XOR 预筛“元残差”指导主干学习。基于此构建的 XOResNet 在 Fashion-MNIST、CIFAR-10/100 和 miniImageNet 上优于多种梯度训练深层 SNN,并可扩展到 110 层未见退化。

2026-05-29

170 篇
GMOS: Grounding Moving Object Segmentation in 3D Space and Time Figure 1
2026-05-29cs.CV

GMOS: Grounding Moving Object Segmentation in 3D Space and Time

Junyu Xie, Tengda Han, Weidi Xie, Andrew Zisserman

Visual Geometry Group, Department of Engineering Science, University of Oxford, UK, SAI, Shanghai Jiao Tong University, China

2026-05-29视觉语言视觉感知三维

这篇论文针对现有运动物体分割依赖光流/轨迹等2D预处理、缺少3D几何且只按整段视频判断“是否运动”的问题,提出从RGB视频直接工作的Gmos:用π³几何特征与SAM2分割特征生成逐帧物体候选和瞬时运动状态,再传播成多目标轨迹,并提供更快的Gmos-S。作者还构建含逐物体时序运动标注的Gmos-2K与MOS-I评测;结果显示其在MOS、MOS-I和UVOS上达到SOTA,并显著快于既有多目标MOS方法。

VideoMLA: Low-Rank Latent KV Cache for Minute-Scale Autoregressive Video Diffusion Figure 1
2026-05-29cs.CV

VideoMLA: Low-Rank Latent KV Cache for Minute-Scale Autoregressive Video Diffusion

Hidir Yesiltepe, Jiazhen Hu, Tuna Han Salih Meral, Adil Kaan Akan, Kaan Oktay, Hoda Eldardiry, Pinar Yanardag

2026-05-29视觉感知生成模型

面向分钟级自回归视频扩散,论文指出瓶颈不只在滑动窗口长度,而在每个 token 的密集多头 KV 缓存。VideoMLA 将每层 per-head K/V 替换为共享低秩内容 latent 和解耦 3D-RoPE 位置键,使单 token 缓存减少 92.7%;同时发现效果并非来自预训练注意力天然低秩,而是模型在给定秩预算内重新适配。基于 Wan-2.1 1.3B 的实验显示,其在 60 秒 VBench 上取得最佳总体分数,并在单 B200 上提升 1.23× 吞吐。

AdaState: Self-Evolving Anchors for Streaming Video Generation Figure 1
2026-05-29cs.CV

AdaState: Self-Evolving Anchors for Streaming Video Generation

Yusuf Dalva, Pinar Yanardag

2026-05-29视觉感知

本文针对自回归视频扩散在流式生成中“首帧锚点”过强的问题:KV 缓存中最干净的初始位置吸走注意力,带来一致性却压制运动和场景推进。AdaState 将固定锚点替换为不渲染的自适应隐状态,随每个 chunk 与内容共同去噪并写回缓存,使去噪过程本身形成递归状态转移;再用 horizon-weighted DMD 强化远期帧训练。实验显示其在更长 rollout 中提升动态性、场景演化和用户偏好。

NeuROK: Generative 4D Neural Object Kinematics Figure 1
2026-05-29cs.CV

NeuROK: Generative 4D Neural Object Kinematics

Chen Geng, Guangzhao He, Yue Gao, Yunzhi Zhang, Shangzhe Wu, Jiajun Wu

Stanford University, University of Cambridge, Cornell University

2026-05-29生成模型

面向具身智能/机器人所需的3D世界模型,NeuROK针对现有4D动态生成依赖类别物理模型、难扩展的问题,学习对象的低维运动学状态空间及解码器,把复杂形变转化为潜空间中的拉格朗日动力学建模。模型仅用大规模4D几何轨迹训练,无需物理或动作标注;在逆运动学与4D仿真评测中优于多类基线,并能覆盖弹性体、布料、连续体和多刚体等对象。

YoCausal: How Far is Video Generation from World Model? A Causality Perspective Figure 1
2026-05-29cs.CV

YoCausal: How Far is Video Generation from World Model? A Causality Perspective

You-Zhe Xie, Yu-Hsuan Li, Jie-Ying Lee, Kaipeng Zhang, Yu-Lun Liu, Zhixiang Wang

2026-05-29视觉感知强化学习

本文关注视频扩散模型能否从逼真生成走向真正世界模型,尤其是否理解因果而非只拟合时间统计。YoCausal借鉴认知科学VoE范式,用真实视频倒放构造可扩展反事实,并以RSI衡量时间箭头感知、CCI区分因果认知与时间偏置。对13个开源VDM的评测显示,部分模型有初步因果信号,但与人类仍有明显差距;高RSI不等于高CCI,性能提升可能主要来自scaling和架构/数据差异。

Uncertainty-driven 3D Gaussian Splatting Active Mapping via Anisotropic Visibility Field Figure 1
2026-05-29cs.CV

Uncertainty-driven 3D Gaussian Splatting Active Mapping via Anisotropic Visibility Field

Shangjie Xue, Jesse Dill, Dhruv Ahuja, Frank Dellaert, Panagiotis Tsiotras, Danfei Xu

Georgia Institute of Technology

2026-05-29三维安全鲁棒

面向机器人主动建图,论文指出3DGS现有不确定性估计常低估训练视角未覆盖区域,影响下一视角选择。GAVIS以每个高斯粒子相对训练视角的各向异性可见性为核心,用球谐表示并接入贝叶斯不确定性光栅化器,在最大信息增益框架下规划视角。多类合成、室内与空间机器人场景中,其重建指标和不确定性质量优于FisherRF、VIMC、NVF,且约200 FPS、预处理开销更低,并可作为后处理增强既有方法。

GPIC: A Giant Permissive Image Corpus for Visual Generation Figure 1
2026-05-29cs.CV

GPIC: A Giant Permissive Image Corpus for Visual Generation

Keshigeyan Chandrasegaran, Kyle Sargent, Suchir Agarwal, Michael Jang, Michael Poli, Juan Carlos Niebles, Justin Johnson, Jiajun Wu, Li Fei-Fei

Stanford University, University of Michigan

2026-05-29视觉感知

针对视觉生成研究缺少大规模、稳定、可复现且商业可用数据集的问题,GPIC构建了约280万亿像素、1亿训练图像的宽许可图像语料,并用VLM完成过滤、去重与多粒度字幕标注;论文还提出基于百万留出集和FD-DINOv2的评测协议,并给出像素空间flow matching基线,主要贡献可能来自数据规模与许可/托管规范化。

Benchmarking Single-Factor Physical Video-to-Audio Generation Figure 1
2026-05-29cs.CV

Benchmarking Single-Factor Physical Video-to-Audio Generation

Tingle Li, Siddharth Gururani, Kevin J. Shih, Gantavya Bhatt, Sang-gil Lee, Zhifeng Kong, Arushi Goel, Gopala Anumanchipalli, Ming-Yu Liu

University of Washington

2026-05-29视觉感知数据集/基准

现有视频生音频评测多看感知真实感,难判断模型是否理解碰撞、材质、液体多少等物理成因。本文提出 FlatSounds,用单因素反事实视频对和单视频模式测试,配合时间对齐与物理特征指标审计因果响应。实验显示,主流 V2A 模型更依赖文本提示获得语义和物理正确性,但会牺牲音画同步;去掉文本后时间指标反而常改善,暴露视觉编码器尚未从像素中学到可靠物理过程。

REST3D: Reconstructing Physically Stable 3D Scenes from a Single Image Figure 1
2026-05-29cs.CV

REST3D: Reconstructing Physically Stable 3D Scenes from a Single Image

Xiaoxuan Ma, Jiashun Wang, Nicolas Ugrinovic, Yehonathan Litman, Kris Kitani

Carnegie Mellon University

2026-05-29视觉感知三维

REST3D针对单图像3D重建常见的物体悬浮、穿模导致仿真不稳定问题,不只追求视觉相似,而是用VLM推断重力支撑关系的场景树,再结合图像到3D初始化、树引导对齐与物理约束优化修正布局。实验在合成和真实数据上同时提升重建质量与物理稳定性,相比SAM3D稳定性提高83个百分点,并展示可用于VR交互的仿真就绪场景。

Colored Noise Diffusion Sampling Figure 1
2026-05-29cs.CV

Colored Noise Diffusion Sampling

Hadar Davidson, Noam Issachar, Sagie Benaim

The Hebrew University of Jerusalem

2026-05-29生成模型

本文针对扩散模型采样中 SDE 求解器始终注入白噪声、忽略“先生成低频结构、后补高频细节”的谱偏置问题,提出无需训练的 Colored Noise Sampling:在保持每步总方差不变的前提下,按时间步和频段把噪声能量分配给尚未解析的频率。该方法可直接替换采样器,在 SiT、JiT、FLUX 上验证;ImageNet-256 无引导 FID 如 SiT-XL/2 从 8.26 降至 6.27,JiT-B/16 从 32.39 降至 26.69,并在 CFG 下也有稳定改进。

Supercharging Thermal Gaussian Splatting with Depth Estimation Figure 1
2026-05-29cs.CV

Supercharging Thermal Gaussian Splatting with Depth Estimation

Manoj Biswanath, Chenxin Cai, Hannah Schieber, Daniel Roth, Benjamin Busam

Photogrammetry and Remote Sensing, Munich Center for Machine Learning (MCML), Human-Centered Computing and Extended Reality Lab, TUM University Hospital, Clinic for Orthopedics and Sports Orthopedics, Munich Institute of Robotics and Machine Intelligence (MIRMI)

2026-05-29三维

面向低光、烟雾等RGB失效场景下的三维热辐射场重建,论文提出TDg:用热红外图像生成深度先验,并在Gaussian Splatting中联合热图与深度渲染损失,减少多模态配准和冗余优化。其在RGBT-Scenes与ThermalMix上多数指标略优于MSMG,LPIPS/SSIM/PSNR平均小幅提升,同时训练时间减少约55%;但初始化仍依赖RGB-SfM点云,纯热端到端能力尚未充分解决。

Veda: Scalable Video Diffusion via Distilled Sparse Attention Figure 1
2026-05-29cs.CV

Veda: Scalable Video Diffusion via Distilled Sparse Attention

Shihao Han, Hao Yang, Xinting Hu, Xiaofeng Mei, Yi Jiang, Xiaojuan Qi

2026-05-29视觉感知生成模型

本文针对视频 DiT 在高分辨率、长时长生成中自注意力二次复杂度过高的问题,指出质量下降关键不在稀疏率本身,而在稀疏 tile mask 是否对齐全注意力的 tile 结构。Veda 通过全注意力蒸馏显式学习 tile 选择,结合统计感知打分、按 head 的 tiling 与 tile-skipping kernel,在 Waver/Wan2.1 上实现无明显质量损失的加速;720P 10 秒 Waver-T2V-12B 达到 5.1× 端到端和 10.5× 注意力加速。

MonoPhysics: Estimating Geometry, Appearance, and Physical Parameters from Monocular Videos Figure 1
2026-05-29cs.CV

MonoPhysics: Estimating Geometry, Appearance, and Physical Parameters from Monocular Videos

Daniel Rho, Jun Myeong Choi, Matthew Thornton, Biswadip Dey, Roni Sengupta

University of North Carolina at Chapel Hill

2026-05-29视觉感知

MonoPhysics瞄准单目视频中可变形物体反演物理参数的难题:缺少多视角约束会导致尺度、几何和材料估计相互混淆。论文将3D Gaussian同时作为渲染单元和MPM粒子,并通过全局尺度对齐、物理感知几何细化和可微位置图加强视觉—物理梯度耦合。实验显示其在Vid2Sim单目设置和新弹性/塑性数据集上优于PAC-NeRF、GIC等基线,部分参数精度接近多视角Vid2Sim。

Before the Shutter: Aesthetic and Actionable Portrait Photography Planning in 3D Scenes Figure 1
2026-05-29cs.GR

Before the Shutter: Aesthetic and Actionable Portrait Photography Planning in 3D Scenes

Ruixiang Jiang, Chang Wen Chen

The Hong Kong Polytechnic University, The Hong Kong Polytechnic University Hong Kong SAR China

2026-05-29规划控制三维

本文针对现有人像计算多停留在拍后2D修图、难以给出可执行拍摄方案的问题,提出“3D审美人像规划”:在三维场景中联合规划人物姿态、相机、灯光与曝光。核心是用摄影场景图编码可供性、人物-场景关系和光照结构,并通过审美引导的成对比较迭代优化候选方案。实验显示其在人类与多模态大模型评审中较基线更受偏好,同时保持较高物理可行性。

VPG: Visual Prefix Guidance for Autoregressive Image and Video Generation Figure 1
2026-05-29cs.CV

VPG: Visual Prefix Guidance for Autoregressive Image and Video Generation

Xinyao Liao, Qiyuan He, Yicong Li, Jiayin Zhu, Xiaoye Qu, Wei Wei, Angela Yao

National University of Singapore, Huazhong University of Science & Technology

2026-05-29视觉感知

论文针对视觉自回归生成中 teacher forcing 训练与自生成前缀推理不一致导致的 exposure bias 和前缀漂移,提出无需训练的 Visual Prefix Guidance:用真实前缀与同尺度 embedding 置换后的损坏前缀做 logit 对比,偏向更支持已有前缀的下一步预测。该方法可与 CFG 组合,在 VAR 上平均降低 FID 0.36,并提升 Infinity 文生图与 InfinityStar 文生视频基准表现。

Archon: A Unified Multimodal Model for Holistic Digital Human Generation Figure 1
2026-05-29cs.CV

Archon: A Unified Multimodal Model for Holistic Digital Human Generation

Chong Bao, Shichen Liu, Lijun Yu, David Futschik, Stylianos Moschoglou, Shefali Srivastava, Ziqian Bai, Feitong Tan, Guofeng Zhang, Zhaopeng Cui, Sean Fanello, Yinda Zhang

State Key Lab of CAD&CG, Zhejiang University

2026-05-29视觉语言

面向数字人生成中多模态专家模型割裂、跨模态任务难扩展的问题,Archon 将描述、脚本、语音、动画、语义视频、图像和视频用专用 tokenizer 统一到自回归模型中,并以同步数据和 72 类任务预训练;其语义视频重参数化缓解长视频 token 爆炸,再用扩散解码恢复高保真画面,“Thinking in Modality”则把含糊跨模态生成拆成中间模态链。实验显示其在多种数字人生成任务上达到优于或接近专用模型的表现,但具体增益中可能包含 data / scaling 贡献。

City-Mesh3R: Simulation-Ready City-Scale 3D Mesh Reconstruction from Multi-View Images Figure 1
2026-05-29cs.CV

City-Mesh3R: Simulation-Ready City-Scale 3D Mesh Reconstruction from Multi-View Images

Sayan Paul, Sourav Ghosh, Siddharth Katageri, Soumyadip Maity, Sanjana Sinha, Brojeshwar Bhowmick

Visual Computing & Embodied AI Lab, TCS Research, India

2026-05-29视觉感知三维

面向城市数字孪生、规划与灾害仿真,论文指出 NeRF/高斯表示难以直接产出可仿真的水密网格且大规模 SfM 代价高。City-Mesh3R 采用端到端分布式图像到网格流程:拓扑图像聚类做稀疏 SfM 与合并,再几何感知分区、密集重建和曲率自适应重网格化后拼接全城网格。实验称在城市级数据上提升处理时间与表面质量,增益主要来自分治式 scaling 与自适应网格优化。

Grounded 3D-Aware Spatial Vision-Language Modeling Figure 1
2026-05-29cs.CV

Grounded 3D-Aware Spatial Vision-Language Modeling

An-Chieh Cheng, Yang Fu, Yatai Ji, Ligeng Zhu, Guanqi Zhan, Zhuoyang Zhang, Zhaojing Yang, Song Han, Yao Lu, Pavlo Molchanov, Vidya Nariyambut Murali, Jan Kautz, Xiaolong Wang, Hongxu Yin, Sifei Liu

2026-05-29视觉语言视觉感知三维

面向具身智能中语言指令难以可靠落到物体位置与三维结构的问题,本文提出 GR3D,将显式2D grounding、生成过程中的隐式区域 token 插入,以及区域提示的单目3D框预测统一到空间 VLM 中,用“先定位2D证据、再推断3D几何”的分解增强推理。实验显示其在 CVBench、ERQA、SAT 等空间任务上提升一致性,并在 Omni3D 上取得领先的3D grounding/检测结果。

Boosting Image Quality Assessment Performance: Unsupervised Score Fusion by Deep Maximum a Posteriori Estimation Figure 1
2026-05-29cs.CV

Boosting Image Quality Assessment Performance: Unsupervised Score Fusion by Deep Maximum a Posteriori Estimation

Zhongling Wang, Raymond Zhou, Shahrukh Athar, Wenbo Yang, Zhou Wang

2026-05-29视觉感知

针对单个图像质量评估模型常因内容或失真类型产生偏置的问题,本文将多模型分数融合表述为无 MOS 监督的后验估计任务,核心是用编码器、解码器与逐分数不确定性模块建模各 IQA 分数可信度,并可兼容排序融合。实验在十个 IQA 数据集上显示,该方法优于单模型及现有无监督融合方法,还能在融合中降低“坏模型”影响。

PhyGenHOI: Physically-Aware 4D Generation of Dynamic Human-Object Interactions Figure 1
2026-05-29cs.CV

PhyGenHOI: Physically-Aware 4D Generation of Dynamic Human-Object Interactions

Omer Benishu, Gal Fiebelman, Sagie Benaim

Hebrew University of Jerusalem

2026-05-29视觉感知

针对文本到4D人-物交互中语义生成易出现穿模、幽灵效应而物理响应不足的问题,PhyGenHOI将3DGS作为统一表示,把MDM驱动的人体语义运动与MPM物体仿真耦合,并用窗口吸引损失、接触触发重仿真和掩码Video-SDS对齐接触过程。实验在10类交互上优于4DFY和AnimateAnyMesh,提升物理合理性、文本对齐和用户评分。

LoMo: Local Modality Substitution for Deeper Vision-Language Fusion Figure 1
2026-05-29cs.CV

LoMo: Local Modality Substitution for Deeper Vision-Language Fusion

Feng Han, Zhixiong Zhang, Zheming Liang, Yibin Wang, Jiaqi Wang

Fudan University, Shanghai Innovation Institute, Shanghai Jiao Tong University, University of Science and Technology of China

2026-05-29视觉语言视觉感知

论文指出现有视觉语言模型对“语义载体”敏感:同一问题从文本改为渲染图像后性能显著下降,且与跨载体表征距离相关。LoMo通过在SFT数据中局部选择文本片段并渲染成图像,构造“文本-视觉-文本”序列,隐式强化等价语义的跨模态对齐且无需改模型。实验在13个多模态基准上提升推理表现,相比标准SFT在LLaVA-OneVision-1.5-8B和Qwen3.5-9B上分别增益2.67和2.82分,并降低跨模态距离14.2%。

minWM: A Full-Stack Open-Source Framework for Real-Time Interactive Video World Models Figure 1
2026-05-29cs.CV

minWM: A Full-Stack Open-Source Framework for Real-Time Interactive Video World Models

Min Zhao, Hongzhou Zhu, Bokai Yan, Zihan Zhou, Yimin Chen, Wenqiang Sun, Kaiwen Zheng, Guande He, Xiao Yang, Chongxuan Li, Fan Bao, Jun Zhu

2026-05-29视觉感知强化学习

现有视频扩散模型虽能离线生成高质量视频,但缺少交互式世界模型所需的因果、可控与低延迟推演。minWM 的核心是把 T2V/TI2V 双向视频基座通过相机可控微调、AR 扩散训练、Causal Forcing/++ 少步蒸馏和非对称 DMD,转为相机轨迹可控的自回归生成器。论文在 Wan2.1 与 HY1.5 等开源骨干上给出可复现流水线、脚本、检查点和消融,展示其可适配 HY-WorldPlay 等模型;具体量化增益文中未充分说明。

How LoRA Remembers? A Parametric Memory Law for LLM Finetuning Figure 1
2026-05-29cs.CL

How LoRA Remembers? A Parametric Memory Law for LLM Finetuning

Ziwen Xu, Haiwen Hong, Linsong Yu, Benglei Cui, Longtao Huang, Hui Xue, Ningyu Zhang

Zhejiang University

2026-05-29视觉感知

论文关注 LoRA 微调中“参数记忆”到底能存多少、如何失效的问题,避免仅用问答等下游任务混淆记忆与理解。作者把 LoRA 作为可控探针,提出损失下降与有效参数、序列长度相关的 Parametric Memory Law,并发现贪心解码下 token 概率超过 0.5 可触发稳定逐字召回。基于此设计 MemFT,将训练预算转向低于阈值的难记 token,实验显示可提升精确记忆保真度与参数效率;但结论主要验证于 8B 规模,跨规模与随机解码适用性文中未充分说明。

Stable-Layers: Fine-Tuning Image Layer Decomposition Models with VLM-Scored Reinforcement Learning Figure 1
2026-05-29cs.CV

Stable-Layers: Fine-Tuning Image Layer Decomposition Models with VLM-Scored Reinforcement Learning

Ciara Rowles, Reshinth Adithyan, Nikhil Pinnaparaju, Vikram Voleti, Mark Boss

2026-05-29视觉语言视觉感知强化学习

本文针对图像分层分解缺少唯一标注、监督学习易惩罚合理替代分解的问题,提出用VLM打分作为奖励来微调Qwen-Image-Layered。核心在于两阶段奖励:先按编辑相关维度结构化评分,再用候选网格做相对校准,以缓解VLM分数压缩;同时调整RatioNorm稳定Flow-GRPO训练。无需层标注训练后,在Crello等评测中获得更清晰的语义分离、更少空白/伪影层和更低逐层重建误差。

VideoFDB: Evaluating Full-Duplex Vision-Speech Capabilities in Conversational Agents Figure 1
2026-05-29cs.CV

VideoFDB: Evaluating Full-Duplex Vision-Speech Capabilities in Conversational Agents

Amrita Mazumdar, Seonwook Park, Rajarshi Roy, Nikhil Srihari, Shengze Wang, Yuhao Zhou, Julia Wang, Koki Nagano, Shalini De Mello

2026-05-29视觉感知

面向机器人、XR 等场景中的自然人机对话,论文指出现有全双工评测多只看语音,难以衡量点头、凝视、表情等非语言互动。VideoFDB 构建237段真实双人视频、11类非语言动态,并用感知/生成分离的量表式 LM-as-judge 评估框架。实验显示当前开闭源视觉语音代理普遍出现“字幕化回答”和忽视视觉流,级联语音到虚拟人系统也难以实时生成全双工非语言线索。

Ambient-robust Inverse Rendering using Active RGB-NIR Imaging Figure 1
2026-05-29cs.CV

Ambient-robust Inverse Rendering using Active RGB-NIR Imaging

Hoon-Gyu Chung, Jinnyeong Kim, Hyunwoo Kang, Seung-Hwan Baek

2026-05-29安全鲁棒

针对传统逆渲染在非受控环境光下易混淆光照与材质、几何重建不稳定的问题,本文引入主动 RGB–NIR 成像:用人眼不可见的 NIR 闪光提供近似不受环境光影响的点光源阴影,同时保留 RGB 自然外观,并设计三阶段联合估计几何、粗糙度/金属度与可见光反照率。作者还构建移动机械臂采集系统和多光照 RGB–NIR 数据集;真实与合成实验显示其在多种环境光下较已有方法获得更准确的几何和反射率估计。

GenClaw: Code-Driven Agentic Image Generation Figure 1
2026-05-29cs.CV

GenClaw: Code-Driven Agentic Image Generation

Junyan Ye, Jun He, Zilong Huang, Dongzhi Jiang, Xuan Yang, Rui Chen, Weijia Li

2026-05-29视觉感知

针对现有图像生成代理只能反复改提示、难以直接控制空间布局和文字等问题,GenClaw提出“构思—草图—上色”的代码驱动流程:先检索推理补全语义,再用SVG/HTML/Three.js生成可执行草图,最后交给图像模型补纹理与真实感。文中展示其在复杂构图、文字排版、物理场景和分层编辑上更可控,但多为定性案例,量化增益和失败边界文中未充分说明。

Reinforcement Learning with Robust Rubric Rewards Figure 1
2026-05-29cs.CV

Reinforcement Learning with Robust Rubric Rewards

Ya-Qi Yu, Hao Wang, Fangyu Hong, Xiangyang Qu, Gaojie Wu, Qiaoyu Luo, Nuo Xu, Huixin Wang, Wuheng Xu, Yongxin Liao, Zihao Chen, Haonan Li, Ziming Li, Dezhi Peng, Minghui Liao, Jihao Wu, Haoyu Ren, Dandan Tu

Huawei Technologies Co., Ltd.

2026-05-29强化学习安全鲁棒

针对视觉语言任务中许多监督信号只能“部分可验证”、传统 RLVR 奖励过粗且易被在线策略利用的问题,本文提出 RLR³,将实例化 rubric 拆到准则级:可验证项由抽取器加确定性校验,模糊项由文本 Judge 评分,并用最小暴露、分层聚合和分数重映射提升鲁棒性。在 Qwen3-VL-30B-A3B 的 15 个基准上,相比基座平均提升 4.7 分,并在三类训练混合上稳定优于 RLVR,审计显示可降低可利用的假阳性。

SAM3D-Phys: Towards Multi-Object Interactive Simulation in Real World Figure 1
2026-05-29cs.CV

SAM3D-Phys: Towards Multi-Object Interactive Simulation in Real World

Xin Dong, Weijian Deng, Lihan Zhang, Tianru Dai, Wenfeng Deng, Yansong Tang

2026-05-29强化学习三维

该文针对真实多视角重建场景中物体因遮挡和视角不足而几何残缺、难以用于物理交互的问题,提出免训练的 SAM3D-Phys:用 SAM3D 的生成式三维先验补全物体,再通过物理约束位姿对齐和掩码引导外观蒸馏恢复其在场景中的位置与纹理,并接入 MPM 做多物体仿真。实验构建真实多物体基准,显示其能得到更完整的可仿真物体并支持更稳定、场景一致的交互,但外观光照变化仍是限制。

BullingerDB: A Dataset for Handwritten Text Recognition and Writer Retrieval Figure 1
2026-05-29cs.CV

BullingerDB: A Dataset for Handwritten Text Recognition and Writer Retrieval

Marco Peer, Anna-Scius Bertrand, Patricia Scheurer, Andreas Fischer

2026-05-29视觉感知数据集/基准

面向历史手稿分析中缺少大规模、多语种且带时间元数据基准的问题,BullingerDB整理布林格16世纪通信,提供20,898页、499,222行、796名书写者的行切分、转写、作者与日期信息。其核心价值可能主要来自数据规模与时间跨度,并为HTR和书写者检索建立协议,引入时间nDCG衡量检索的时间一致性。基线中TrOCR达到9.1% CER;书写者检索mAP为78.3%,显示长期书写风格变化仍会削弱排序质量。

Beyond 3D VQAs: Injecting 3D Spatial Priors into Vision-Language Models for Enhanced Geometric Reasoning Figure 1
2026-05-29cs.CV

Beyond 3D VQAs: Injecting 3D Spatial Priors into Vision-Language Models for Enhanced Geometric Reasoning

Chun-Hsiao Yeh, Shengyi Qian, Manchen Wang, Yi Ma, Joseph Tighe, Fanyi Xiao

2026-05-29视觉语言视觉感知三维

针对VLM三维空间推理依赖3D VQA微调易过拟合、外接3D编码器又笨重的问题,本文提出GASP:在LLM各层训练期插入轻量对应头,用跨帧点对应的对比损失和深度一致性监督注入几何先验,推理时移除该头且无需3D输入。实验显示内部对应匹配从低于5%提升到70%以上,并在All-Angles、VSI-Bench、BLINK等空间基准上分别取得显著增益。

IP-Adapter Is All You Need: Towards Fine-Tuning-Free Diffusion-Based Talking Face Generation Figure 1
2026-05-29cs.CV

IP-Adapter Is All You Need: Towards Fine-Tuning-Free Diffusion-Based Talking Face Generation

Hao Wu, Xiangyang Luo, Hao Wang, Jiawei Zhang, Yi Zhang, Jinwei Wang

Information Engineering University, Huai’an University, Chongqing University of Post and Telecommunications, Nankai University

2026-05-29生成模型

针对扩散式说话人脸生成依赖大规模音视频数据和高成本微调的问题,FreeTalkDiff尝试直接冻结使用 Stable Diffusion 与 IP-Adapter,并利用后者对人脸口部语义的天然关注;再通过无训练参数的 Structurist、Structure Controller 和 Noise Sensor 分别缓解身份漂移、唇形不同步与时序闪烁。在 CREMA、HDTF 上,文中报告相较现有方法 PCLD 至少提升 0.16、FID 至少改善 0.7。

Déjà View: Looping Transformers for Multi-View 3D Reconstruction Figure 1
2026-05-29cs.CV

Déjà View: Looping Transformers for Multi-View 3D Reconstruction

Alessandro Burzio, Tobias Fischer, Sven Elflein, Qunjie Zhou, Riccardo de Lutio, Jiawei Ren, Jiahui Huang, Shengyu Huang, Marc Pollefeys, Laura Leal-Taixé, Zan Gojcic, Haithem Turki

University of Modena and Reggio Emilia, AImageLab, University of Toronto, Vector Institute

2026-05-29三维

针对多视角三维重建 Transformer 依赖加深加宽、参数冗余地“隐式迭代”的问题,DéjàView 将迭代显式化:用同一个共享 Transformer 块在 DINOv2 视图特征上循环细化,并通过可变 K 训练把推理步数变成算力旋钮。实验显示其在室内、室外、物体和驾驶等五类基准上达到或超过更大前馈模型,参数更少且计算相当或更低;共享循环还优于同预算的非共享逐步参数版本。

Cycle Consistency in Video Object-Centric Learning Figure 1
2026-05-29cs.CV

Cycle Consistency in Video Object-Centric Learning

Rongzhen Zhao, Zhiyuan Li, Ruonan Wei, Juho Kannala, Joni Pajarinen

2026-05-29视觉感知

这篇论文关注视频对象中心学习中如何利用多目标跟踪里的循环一致性:作者指出,直接在 slot 潜空间做前后向硬对齐会忽视自监督场景分解的多解性,导致特征塌缩。其核心做法是提出隐式循环一致性 ICC,把约束移到重建/观测流形上,让前后向表示在解释画面上达成软共识而非逐点匹配。实验显示 ICC 在复杂视频 OCL 基准上优于显式一致性基线,并能缓解对象发现中的退化问题。

LiveSVG: Zero-Shot SVG Animation via Video Generation Figure 1
2026-05-29cs.CV

LiveSVG: Zero-Shot SVG Animation via Video Generation

Matan Levy, Ran Margolin, Bar Cavia, Dvir Samuel, Yael Pritch, Shmuel Peleg, Alex Rav Acha, Ariel Shamir, Dani Lischinski

The Hebrew University of Jerusalem, Bar-Ilan University, Reichman University, The Hebrew University of Jerusalem Israel, Bar-Ilan University Israel, Reichman University Israel

2026-05-29视觉感知

针对现有 SVG 动画方法难以表达复杂非刚性运动、SDS 优化噪声大且常依赖骨架的问题,LiveSVG 将运动生成与矢量拟合解耦:先用图生视频模型生成可预览目标视频,再通过可微渲染拟合原始 SVG,并结合组级单应变换、路径级 Bézier 控制点偏移和球堆积重着色减少对应歧义。在 AniClipart 与新提出的复杂多物体 ChallengeSVG 上,人评显示其优于代码生成和 SDS 基线,同时保持可编辑矢量输出。

Unveiling the Visual Counting Bottleneck in Vision-Language Models Figure 1
2026-05-29cs.MM

Unveiling the Visual Counting Bottleneck in Vision-Language Models

Xingzhou Pang, Yifan Hou, Junling Wang, Mrinmaya Sachan

*Equal contribution 1Department of Computer Science, ETH, Our code is publicly available here: https://github.c, a label?, in real-world datasets, we construct a synthetic laboratory, (50 −99), where the model possesses the linguistic labels, a synthetic laboratory using a custom VLM trained from, .1. Study 1: The Synthetic Laboratory, model possesses the labels (from Phase 1) but has never ob-

2026-05-29视觉语言视觉感知

本文关注视觉语言模型在视觉计数中训练分布外骤降的问题,将计数拆成视觉个体化、数量感知与符号映射三阶段,并用合成围棋盘、线性探针及 Qwen3-VL 验证机制。结果显示模型在外推区仍能线性表征数量、完成比较推理,失败主要发生在把潜在数量映射为数字 token,支持“断裂数量空间”假说,说明单纯数据 scaling 不足以解决跨模态数值泛化。

OmniCD: A Foundational Framework for Remote Sensing Image Change Detection Guided by Multimodal Semantics Figure 1
2026-05-29cs.CV

OmniCD: A Foundational Framework for Remote Sensing Image Change Detection Guided by Multimodal Semantics

Chenhao Sun

2026-05-29视觉语言视觉感知

针对遥感变化检测在跨场景、开放类别和少标注条件下泛化不足的问题,OmniCD将多时相图像与文本描述、语义图、地理元数据等提示统一建模,并结合层级场景检索、guider–detector检测结构和风格解耦以增强跨域鲁棒性。论文还构建30万级图文对RSITCD数据集,实验称在多基准取得SOTA并支持零样本语义变化理解,但增益可能部分来自大规模数据。

Visual Spatial Learning: Single-Field Spatial Interpolation Using Convolutional Neural Networks Figure 1
2026-05-29stat.ML

Visual Spatial Learning: Single-Field Spatial Interpolation Using Convolutional Neural Networks

Daniel Tinoco, Raquel Menezes, Carlos Baquero, Alexandra Silva

2026-05-29视觉感知

本文针对稀疏观测下重建完整空间场的问题,指出 Kriging 依赖平稳性、协方差/变差函数建模且在异质场景中成本高。核心做法是把插值视为类似图像修复的单场学习任务,用带掩码/部分卷积的编码器—解码器 CNN 仅在当前观测点监督训练,无需外部数据或先验场。实验在合成与真实空间场上显示,其效果可与普通 Kriging 相当,调参后在局部结构和非平稳性明显的场景中可更优。

Why Far Looks Up: Probing Spatial Representation in Vision-Language Models Figure 1
2026-05-29cs.CV

Why Far Looks Up: Probing Spatial Representation in Vision-Language Models

Cheolhong Min, Jaeyun Jung, Daeun Lee, Hyeonseong Jeon, Yu Su, Jonathan Tremblay, Chan Hee Song, Jaesik Park

2026-05-29视觉语言视觉感知

针对VLM空间推理高分可能只是利用自然图像透视捷径的问题,论文从表示层构造最小对比样本,分析左右、上下、远近轴是否解耦,并提出去除“越高越远”相关性的SpatialTunnel基准。实验发现多类模型普遍把垂直位置与距离纠缠,数据规模提升会提高总体分数但加重该偏差;空间轴更分离的模型在常规与反启发样本上更稳健。

AnomalyAgent: Training-Free Agentic Models for Zero-/Few-Shot Anomaly Detection Figure 1
2026-05-29cs.CV

AnomalyAgent: Training-Free Agentic Models for Zero-/Few-Shot Anomaly Detection

Yi Zhang, Jiawen Zhu, Lele Fu, Guansong Pang

Singapore Management University, Singapore, Sun Yat-sen University, China

2026-05-29视觉感知

针对现有零/少样本异常检测依赖VLM相似度打分、需辅助训练且难处理逻辑/上下文异常的问题,本文提出无需训练的AnomalyAgent,将MLLM的规划、工具调用、反思推理直接纳入检测,并用异常中心工具集与少样本记忆校准正常性先验。实验覆盖工业、医疗、物流等场景,显示其优于训练-free VLM和通用Agent,消融表明AD专用工具与记忆校准是主要增益来源。

CCS: Clinical Consensus Selection for Radiology Report Generation Figure 1
2026-05-29cs.CL

CCS: Clinical Consensus Selection for Radiology Report Generation

Xi Zhang, Yingshu Li, Zaiqiao Meng, Jake Lever, Edmond S. L. Ho

♠ School of Computing Science, University of Glasgow, ♣ School of Electrical and Computer Engineering, University of Sydney, ♢ Language Technology Lab, University of Cambridge

2026-05-29视觉感知

本文针对放射报告生成中常见的单路径解码脆弱性:固定 MLLM 往往已在候选池中生成更可靠报告,却默认选错。CCS 不重训模型,而是在推理时采样多份报告,用文本相似度和影像-报告多模态嵌入计算候选间临床共识,选择共识最高者。三组数据集和多种放射 MLLM 上,CCS 相比单路径解码与通用 Best-of-N 更稳定提升,尤其体现在临床指标上。

PARCEL: Pool-Anchored Resampling with Conditioned Elastic Queries for Efficient Vision-Language Understanding Figure 1
2026-05-29cs.CV

PARCEL: Pool-Anchored Resampling with Conditioned Elastic Queries for Efficient Vision-Language Understanding

Selim Kuzucu, Alessio Tonioni, Vasile Lup, Bernt Schiele, Federico Tombari, Muhammad Ferjad Naeem

Max Planck Institute for Informatics, SIC, Technical University of Munich

2026-05-29视觉语言视觉感知

针对大视觉语言模型中视觉 token 过多导致推理成本高、固定压缩又难兼顾细节的问题,PARCEL指出纯空间池化会混叠细节、纯查询重采样会削弱空间定位,并用空间池化 token 作低频锚点、条件化弹性查询补充语义细节,实现一次训练多预算部署。在27个图像、视频与密集理解基准上,它在16到256 token预算下均优于M3和MQT,提升性能—效率帕累托前沿。

SGMD: Score Gradient Matching Distillation for Few-Step Video Diffusion Distillation Figure 1
2026-05-29cs.CV

SGMD: Score Gradient Matching Distillation for Few-Step Video Diffusion Distillation

Zhuguanyu Wu, Ruihao Gong, Yang Yong, Yushi Huang, Xiangyu Fan, Lei Yang, Dahua Lin, Xianglong Liu

2026-05-29视觉感知生成模型优化算法

针对少步视频扩散蒸馏中 DMD 需频繁更新 fake score、训练开销高,且反向 KL 易保守抑制运动的问题,SGMD 以 teacher stop-gradient Fisher 构造稳定匹配目标,并用 NR/RC 双势函数分别修正生成器外循环和收缩 fake-score 跟踪残差。在 Wan2.1-T2V-14B 的 4 步蒸馏上,相比 DMD2 将 fake-score 更新从 5 次降至 1 次,约 3 倍提速,同时提升运动强度与动态一致性,人评运动质量和总体偏好更高。

Large Depth Completion Model from Sparse Observations Figure 1
2026-05-29cs.CV

Large Depth Completion Model from Sparse Observations

Zhu Yu, Zhengyi Zhao, Runmin Zhang, Lingteng Qiu, Kejie Qiu, Yisheng He, Siyu Zhu, Zilong Dong, Si-Yuan Cao, Hui-Liang Shen

Zhejiang University, Tongyi Lab, Alibaba Group, Fudan University, Ningbo Innovation Center, Zhejiang University, NingboTech University, Jinhua Institute of Zhejiang University, Internship at Tongyi Lab Corresponding author

2026-05-29视觉感知

针对稀疏、分布不规则深度观测在跨域场景中难以补全且缺乏显式3D几何的问题,LDCM先用单目深度基础模型与稀疏点构造泊松粗深度,再将深度回归改为逐像素相机坐标点图预测,以强化度量一致性且减少对内参依赖;六个基准和多种稀疏度实验显示其在深度补全与点图估计上均优于现有方法。

xModel-KD: Cross-modal Knowledge Distillation for 3D Scene Perception using LiDAR Figure 1
2026-05-29cs.CV

xModel-KD: Cross-modal Knowledge Distillation for 3D Scene Perception using LiDAR

Thenukan Pathmanathan, Kanchan Keisham, Thangarajah Akilan

2026-05-29三维

针对3D点云分割标注昂贵、LiDAR缺少纹理语义且相机-LiDAR融合存在视场不匹配和推理开销的问题,xModel-KD将冻结2D视觉教师的语义知识仅在训练阶段蒸馏到3D网络。其核心是用点-像素投影和多尺度对比损失对齐2D/3D层级特征,测试时移除图像分支实现零额外开销;实验显示相对LiDAR-only基线mIoU绝对提升约2%。

Evaluation of Conversational Agents: Understanding Culture, Context and Environment in Emotion Detection Figure 1
2026-05-29cs.CV

Evaluation of Conversational Agents: Understanding Culture, Context and Environment in Emotion Detection

Martha Teiko Teye, Yaw Marfo Missah, Emmanuel Ahene, Twum Frimpong, Auxane Boch

Cluster of Excellence, University of Stuttgart, 70174 Stuttgart, German, Department of Computer Science, Kwame Nkrumah University of Science and Technology, Kumasi, Ghana, Institute for Ethics in Artificial Intelligence, Technical University of Munich, 80333 Münich, Germany, Large image and text-based datasets made available from

2026-05-29视觉感知数据集/基准

论文关注会话式 AI 情绪识别在跨文化部署中的偏差问题,尤其是黑人非洲社会中地理、文化语境被通用模型忽视而带来的伦理与可靠性风险。作者将语音与人脸图像融合,用三层 CNN 结合 Audio-Frame Mean Expression,并在数据平衡、预处理和后处理阶段减轻偏差,识别七类基本情绪及讽刺。报告准确率为 85%–96%,但具体基准设置与增益来源文中未充分说明。

Geometry Matters: 3D Foundation Priors for Learning Semantic Correspondence Figure 1
2026-05-29cs.CV

Geometry Matters: 3D Foundation Priors for Learning Semantic Correspondence

Artur Jesslen, Olaf Dünkel, Adam Kortylewski

University of Freiburg, Germany, Max Planck Institute for Informatics, Saarland Informatics Campus, Germany, CISPA Helmholtz Center for Information Security, Germany

2026-05-29三维

针对 DINO/Stable Diffusion 等二维基础特征在语义对应中易混淆左右、重复部件和三维上不同结构的问题,本文引入无需人工姿态标注的 3D 后训练框架:用 SAM3D 估计实例几何与姿态,经渲染对比细化后投影 PartField 特征,并以重建形状上的测地距离过滤伪匹配来训练轻量适配器。实验显示其在标准语义对应基准上优于既有基于球面先验的方法,同时减少人工几何监督。

DirectorBench: Diagnosing Long-Form Video Generation with Personalized Multi-Agent Evaluation Figure 1
2026-05-29cs.CL

DirectorBench: Diagnosing Long-Form Video Generation with Personalized Multi-Agent Evaluation

Jiamin Chen, Qianben Chen, Jiawen Zhang, Yidi Wu, Yuchen Li, Xiaokun Zhang, Wangchunshu Zhou, Chen Ma

2026-05-29视觉感知数据集/基准

长视频生成已从单镜头扩展到多镜头叙事,但现有评测偏重局部画质和提示对齐,难以定位跨镜头、音画同步及用户偏好相关失败。DirectorBench用结构化元数据、7类用户画像和40个检查点,结合多智能体与置信聚合给出个性化诊断。评测4种流程、6个LLM后发现主要瓶颈在单元间过渡,平均仅0.256,且人评支持其能揭示聚合分数掩盖的失败模式。

Future Forcing: Future-aware Training-free KV Cache Policy for Autoregressive Video Generation Figure 1
2026-05-29cs.CV

Future Forcing: Future-aware Training-free KV Cache Policy for Autoregressive Video Generation

Jiayi Luo, Qiyan Liu, Tengyang Wang, JunHao Liu, Jiayu Chen, Cong Wang, Hanxin Zhu, Chen Gao, Xiaobin Hu, Qingyun Sun, Zhibo Chen

2026-05-29视觉感知强化学习

长时自回归视频生成受限于KV cache随长度增长带来的显存压力和误差累积,现有压缩策略偏重当前/历史重要性,易丢弃未来关键token。Future Forcing观察到RoPE前query分布在固定提示下近似稳定,据此无训练构造未来query代理来评分、淘汰并合并缓存token。在有限缓存下,60秒生成的VBench-Long主体一致性较已有策略最高提升1.49,同时保持生成质量。

Native Audio-Visual Alignment for Generation Figure 1
2026-05-29cs.CV

Native Audio-Visual Alignment for Generation

Longbin Ji, Guan Wang, Xuan Wei, Chenye Yang, Xiangrui Liu, Zhenyu Zhang, Shuohuan Wang, Yu Sun, Jingzhou He

ERNIE Team, Baidu Inc.

2026-05-29视觉感知

针对联合音视频生成中双塔后验对齐难以细粒度同步、全统一三模态又混淆语义控制与底层同步的问题,NAVA将音视频先在专用空间原生对齐,再由外部上下文条件化,并用Align-then-Fuse MMDiT与Timbre-in-Context实现协同去噪和音色绑定。在Verse-Bench、Seed-TTS及用户研究中,6.3B参数模型取得更好的视频质量、音画同步和音色可控性,音频质量保持竞争力。

Boosting Zero-Shot 3D Style Transfer with 2D Pre-trained Priors Figure 1
2026-05-29cs.CV

Boosting Zero-Shot 3D Style Transfer with 2D Pre-trained Priors

Xin Dong, Yunzhi Teng, Wenfeng Deng, Yansong Tang

Shenzhen International Graduate School, Tsinghua University 2 Pengcheng Laboratory

2026-05-29三维

针对零样本三维风格迁移中每个场景训练样本少、导致风格监督不足的问题,论文提出 DS-StyleGaussian:把在大规模二维内容-风格对上预训练的 VGG/AdaIN 解码器接入 3D Gaussian Splatting,并用特征高斯与延迟着色把视角相关归一化改为视角无关过程以保持多视图一致。实验显示其在多个数据集上的视觉质量优于现有零样本三维风格迁移方法,但增益可能主要来自二维预训练数据与解码器先验。

FakeVLM-R1: Internalizing Physical Laws via CoT for Synthetic Image Detection Figure 1
2026-05-29cs.CV

FakeVLM-R1: Internalizing Physical Laws via CoT for Synthetic Image Detection

Leqi Zhu, Junyan Ye, Kaiqing Lin, Zhiyuan Yan, Conghui He, Weijia Li

Shanghai AI Lab, Nanjing University, Sun Yat-Sen University, Shenzhen University, Peking University, Tsinghua University

2026-05-29视觉语言视觉感知

针对现有多模态伪图检测多依赖SFT模仿伪造痕迹、缺少因果推理并易把真实图像噪声误判为伪造的问题,FakeVLM-R1在SFT上引入GRPO与批判式CoT,要求模型同时提出伪造假设和基于物理常识的真实性反证;配套FakeClue++用真实图像物理规律作“真实性锚点”。实验称其在多基准达到SOTA,并降低真实图像过拒与解释幻觉。

Towards Consistent Video Geometry Estimation Figure 1
2026-05-29cs.CV

Towards Consistent Video Geometry Estimation

Zhu Yu, Jingnan Gao, Runmin Zhang, Lingteng Qiu, Zhengyi Zhao, Rui Peng, Yichao Yan, Kejie Qiu, Siyu Zhu, Si-Yuan Cao, Hui-Liang Shen

Zhejiang University, Tongyi Lab, Alibaba Group, Shanghai Jiao Tong University, Fudan University, Internship at Tongyi Lab Equal Contribution

2026-05-29视觉感知

面向机器人感知、导航等对长视频空间精度与时间一致性的需求,论文指出现有视频几何模型常被固定的离线/在线时序访问模式和稀疏噪声标注限制。ViGeo以普通Transformer结合动态分块注意力,在同一模型中切换全序列、流式和长视频推理,并用视频深度补全教师细化LiDAR/SfM监督,同时预测深度、法线和点图。仅用公开数据训练后,在多类视频深度、法线和点图基准上达到或接近SOTA。

GenEraser: Generalizable Video Object Removal via Balanced Text-Mask Guidance and Decoupled Locator-Preserver Figure 1
2026-05-29cs.CV

GenEraser: Generalizable Video Object Removal via Balanced Text-Mask Guidance and Decoupled Locator-Preserver

Yuqing Chen, Lin Liu, Haisu Wu, Xiaopeng Zhang, Yaowei Wang, Yujiu Yang, Qi Tian

Tsinghua University, Pengcheng National Laboratory, Southeast University, Harbin Institute of Technology, Tsinghua University China, Pengcheng National Laboratory China, Southeast University China, Harbin Institute of Technology China

2026-05-29视觉感知

针对视频物体移除在开放场景中难以同时擦除目标及烟雾、反射、光照等伴随物理效应的问题,GenEraser引入双分文本与掩码的多条件专家,并用可学习LD-CFG自适应平衡语义与空间约束;同时将定位与背景保持解耦,缓解泛化和像素对齐冲突。实验在ROSE与VOR-Eval上分别提升约2.16dB和1.44dB,并展示更强开放世界泛化。

Alignment-Guided Score Matching for Text-to-Image Alignment in Diffusion Models Figure 1
2026-05-29cs.LG

Alignment-Guided Score Matching for Text-to-Image Alignment in Diffusion Models

Jaa-Yeon Lee, Yeobin Hong, Taesung Kwon, Jong Chul Ye

2026-05-29视觉感知生成模型

针对扩散文生图在计数、重复和语义一致性上的对齐问题,论文认为 SoftREPA 的对比式负样本惩罚会把软提示推向流形外。其提出 AGSM,将 Plackett-Luce 偏好建模嵌入 score matching,用正负软 token 提供有界的分数级引导且无需外部奖励。实验显示该方法在 SD1.5、SDXL、SD3 上可用,并在 GenEval 计数准确率上较相关失败案例提升超过 35%。

DocRetriever: A Plug-and-Play Framework for Multimodal Document Retrieval with Comprehensive Benchmark Figure 1
2026-05-29cs.CV

DocRetriever: A Plug-and-Play Framework for Multimodal Document Retrieval with Comprehensive Benchmark

Ruofan Hu, Menghui Zhu, Jieming Zhu, Bo Chen, Shengyang Xu, Minjie Hong, Xiaoda Yang, Sashuai Zhou, Li Tang, Tao Jin, Zhou Zhao

Zhejiang University, Huawei Technologies Co., Ltd, Zhejiang University Hangzhou Zhejiang China, Huawei Technologies Co., Ltd Shanghai Shanghai China, Huawei Technologies Co., Ltd Shenzhen Guangdong China

2026-05-29视觉语言数据集/基准

论文针对多模态文档检索中密集视觉嵌入语义过粗、OCR/结构化抽取代价高以及监督重排泛化弱的问题,提出可插拔的 DocRetriever:利用 VLM 语言头 logits 构造布局感知稀疏表示,与密集向量混合编码,并用自动合成的推理示例做少样本 ICL 重排;同时发布 MultiDocR 基准。实验显示其在多项文档检索基准上优于现有方法,稀疏混合编码相对密集基线约提升 3% NDCG@10。

VisualThink-VLA: Visual Intermediate Reasoning for Effective and Low-Latency Vision-Language-Action Policies Figure 1
2026-05-29cs.CV

VisualThink-VLA: Visual Intermediate Reasoning for Effective and Low-Latency Vision-Language-Action Policies

Mingjian Gao, Wenqiao Zhang, Yuqian Yuan, Yang Dai, Binhe Yu, Zheqi Lv, Haoyu Zheng, Jiaqi Zhu, Zhiqi Ge, Zixuan Wan, Siliang Tang, Yueting Zhuang

2026-05-29视觉语言视觉感知

这篇论文针对VLA机器人策略中“文本思维链有延迟、密集视觉提示又易干扰动作预测”的矛盾,提出VisualThink-VLA:在冻结VLA骨干前接入稀疏的视觉证据接口,并用任务自适应路由选择位置、边界、运动、关系等通道,再通过软硬掩码和密集教师蒸馏稳定训练。作者还构建VisualEvidence-Set用于路由监督与忠实性审计。实验显示其在多项仿真和真机任务上保持或提升成功率,并将BridgeData V2单步延迟由ECoT的8.377秒降至0.367秒。

EarlyTom: Early Token Compression Completes Fast Video Understanding Figure 1
2026-05-29cs.CV

EarlyTom: Early Token Compression Completes Fast Video Understanding

Hesong Wang, Xin Jin, Lu Lu, Chenhaowen Li, Jian Chen, Qiang Liu, Huan Wang

Zhejiang University, Westlake University

2026-05-29视觉感知强化学习

EarlyTom针对Video-LLM推理中视觉token过多导致首token延迟高的问题,指出瓶颈相当一部分来自视觉编码器而非仅LLM预填充。其核心是在编码器内部进行早期帧/视觉token合并,并结合解耦的空间token选择,训练无关且额外开销小。在LLaVA-OneVision-7B上可将TTFT最高降低2.65倍、FLOPs减少61%,同时保持接近全token基线的准确率。

FRUC: Feedforward Dynamic Scene Reconstruction from Uncalibrated Collaborative Driving Views Figure 1
2026-05-29cs.CV

FRUC: Feedforward Dynamic Scene Reconstruction from Uncalibrated Collaborative Driving Views

Yihang Tao, Yu Guo, Zhengru Fang, Haonan An, Yuguang Fang

Hong Kong JC STEM Lab of Smart City, City University of Hong Kong

2026-05-29三维

FRUC针对自动驾驶中单车视角受遮挡导致动态3D重建不完整、现有协同方法依赖标定和逐场景优化的问题,提出从未标定多车视角进行前馈3DGS重建。其核心是将跨车融合视为有界残差学习,利用自车因果遮挡场引导潜空间残差去噪,在补全盲区的同时避免外部视角破坏自车几何先验。文中在V2XReal和UrbanIng-V2X上报告其渲染质量与效率均优于优化式和单车前馈基线。

Improving Adversarial Robustness of Attribution via Implicit Regularization Figure 1
2026-05-29cs.LG

Improving Adversarial Robustness of Attribution via Implicit Regularization

Amir Mehrpanah, Matteo Gamba, Hossein Azizpour

2026-05-29安全鲁棒

本文针对梯度和注意力归因易受微小扰动影响、而显式曲率正则成本高的问题,提出从 SGD 学习动力学解释归因鲁棒性:参数空间更平坦可隐式降低输入曲率,从而提升梯度归因稳定性。实验显示 ICR 在多架构和数据集上以很小开销取得接近昂贵正则方法的鲁棒性;但软max注意力因熵约束难以继承该增益,改用核化注意力后可恢复部分鲁棒提升。

Genetically Aligned Patient Representations Improve Hematological Diagnosis Figure 1
2026-05-29cs.CV

Genetically Aligned Patient Representations Improve Hematological Diagnosis

Muhammed Furkan Dasdelen, Fatih Ozlugedik, Ilaria Looser, Rao Muhammad Umer, Christian Pohlkamp, Carsten Marr

2026-05-29视觉感知

血液肿瘤诊断依赖形态学与遗传检测联合判断,单看血涂片图像难以刻画分子异质性。本文提出 GenBloom,将白细胞单细胞图像先经自监督患者级聚合预训练,再用核型异常和体细胞突变进行监督对比对齐,学习遗传感知的患者表征。结果显示其在 AML 分型、跨域诊断和图像—基因检索上优于通用病理基础模型,但增益仍可能部分来自领域数据与任务匹配。

EVL-ECG: Efficient ECG Interpretation With Multi-Aspect Heterogeneous Knowledge Distillation Figure 1
2026-05-29cs.CV

EVL-ECG: Efficient ECG Interpretation With Multi-Aspect Heterogeneous Knowledge Distillation

Dang Hong Nguyen, Nhi Ngoc-Yen Nguyen, Huy-Hieu Pham

2026-05-29视觉感知

针对大型视觉语言模型在心电图解读中计算开销高、难以落地边缘临床场景的问题,EVL-ECG提出面向异构师生架构的知识蒸馏:用多头交叉注意力缓解 tokenizer/序列不匹配,用最优传输保持12导联视觉拓扑,并以几何关系匹配迁移诊断逻辑。多基准结果显示其相对现有蒸馏方法最高提升2.4% AUC和1.1%准确率,形成约2B参数的高效ECG模型。

SwInception -- Local Attention Meets Convolutions Figure 1
2026-05-29cs.CV

SwInception -- Local Attention Meets Convolutions

David Hagerman, Roman Naeem, Jakob Lindqvist, Carl Lindström, Fredrik Kahl, Lennart Svensson

2026-05-29视觉感知

针对Swin在小规模医学体数据分割中局部归纳偏置不足、易过拟合且窗口受显存限制的问题,SwInception把多分支Inception卷积嵌入Transformer前馈层,在块内引入多尺度局部特征,并改造解码器以更少参数保留细节。论文在11个医学数据集及MSD、BTCV基准上报告优于既有Swin系骨干的分割性能。

Mesh-Aware Epipolar Matching for Multi-View Multi-Person 3D Pose Estimation in Basketball Figure 1
2026-05-29cs.CV

Mesh-Aware Epipolar Matching for Multi-View Multi-Person 3D Pose Estimation in Basketball

Li Yin, Qin Haobin, Tomohiro Suzuki, Calvin Yeung, Mariko Isogawa, Keisuke Fujii

2026-05-29三维

篮球等团队运动中多人遮挡、队服相似且多视角标注稀缺,使跨视角身份关联成为3D姿态估计瓶颈。MAEM不依赖目标域训练,而是将单目人体网格恢复得到的密集网格顶点投影为极线验证线索,并结合框中心粗筛、网格极线细筛、匈牙利匹配与并查集聚类来替代脆弱的关键点/外观匹配。实验在SportCenter EPFL和Human-M3 Basketball上达到59.8/40.7 mm与74.0/51.8 mm的MPJPE/PA-MPJPE,优于训练自由基线。

CityGen: Structure-Guided City-Style Synthesis for Cross-City Autonomous Driving Figure 1
2026-05-29cs.CV

CityGen: Structure-Guided City-Style Synthesis for Cross-City Autonomous Driving

Zezhong Qian, Zhao Yang, Lu Tan, Zhihao Yan, Weiyi Hong, Haizhuang Liu, Yawei Jueluo

2026-05-29视觉感知

该文针对自动驾驶模型在新城市部署时因道路拓扑、外观和交通模式差异导致性能下降的问题,构建了地理隔离的 CityTransfer-Bench,并提出 CityGen:利用 HD 地图结构约束和目标城市视觉提示的扩散生成,零标签合成目标城市风格数据。实验显示其在感知、分割和规划上均提升跨城鲁棒性,但具体增益中生成数据规模与结构控制的相对贡献仍需进一步拆解。

Treatment-Conditioned Diffusion for Forecasting Neurodegenerative Disease Progression Figure 1
2026-05-29cs.LG

Treatment-Conditioned Diffusion for Forecasting Neurodegenerative Disease Progression

Danylo Boiko, Viktoriia Mishkurova

Innoloft Inc., Bogomolets National Medical University

2026-05-29生成模型

针对帕金森等神经退行性疾病预测常停留在量表分数、难保留影像细节的问题,论文将进展建模为治疗条件扩散生成:以筛查期 DaTscan 和一年 LEDD 用药序列为条件,结合 Transformer 药物编码与多权重 ROI 约束生成未来脑影像。PPMI 实验显示,相比无进展基线,14 个切片上 MSE 降低 14.0%、MAE 降低 7.2%、SSIM 提升 4.9%。

Reducing Experimental Testing in Space Propulsion Film Cooling Analyses by Pixelwise Generative Image Interpolation Figure 1
2026-05-29cs.LG

Reducing Experimental Testing in Space Propulsion Film Cooling Analyses by Pixelwise Generative Image Interpolation

Adam T. Müller, Philipp J. Teuffel, Konstantin Manassis, Nicolaj C. Stache

⋆ Heilbronn University of Applied Sciences, Center for Machine Learning, ‡ German Aerospace Center (DLR), Institute of Space Propulsion

2026-05-29视觉感知生成模型

针对航天推进膜冷却实验成本高、参数空间难以密集采样的问题,论文将冷却膜图像生成表述为物理参数与像素坐标联合空间上的回归,提出带位置编码的轻量前馈网络 PixCOIN,并加入专家知识引导的局部修正。其在合成与真实冷流数据上取得 RMSE<8%、SSIM>93%,且在减少约30%测量时仍保持精度。

Train the Agent, Not the Expert: Learning to Harness Heterogeneous Experts for Multi-Turn Visual Reasoning Figure 1
2026-05-29cs.CV

Train the Agent, Not the Expert: Learning to Harness Heterogeneous Experts for Multi-Turn Visual Reasoning

Yaowu Fan, Tao Han, Dazhao Du, Andy J. Ma, Jia Wan

Sun Yat-sen University, Harbin Institute of Technology

2026-05-29视觉感知

针对专用视觉模型各自孤立、MLLM又难以精确执行分割/检测/计数的问题,本文提出VisHarness:不再训练单一专家,而训练一个可多轮调用异构视觉专家的高层代理,并用动态视觉记忆归档降低交互中的视觉token开销以支持在线强化学习。实验覆盖推理分割、广义指代表达分割、密集小目标检测与指代计数,结果显示其优于通用模型,并达到或超过部分任务专用模型。

DVSM: Decoder-only View Synthesis Model Done Right Figure 1
2026-05-29cs.CV

DVSM: Decoder-only View Synthesis Model Done Right

Cheng Sun, Jaesung Choe, Min-Hung Chen, Ryo Hachiuma, Yu-Chiang Frank Wang

2026-05-29视觉感知

本文针对LVSM中重建与渲染网络解耦、decoder-only按目标视角重复建场景而低效的问题,重新审视新视角合成架构。核心洞察是用严格共享权重的decoder-only Transformer,将场景隐式存为KV-cache,使重建与渲染特征在同视角更一致,并结合基础模型先验与分阶段patch大小。实验显示其在多基准达到SOTA,参数少于encoder-decoder,部分密集视角设置下甚至超过逐场景优化的3DGS。

Mitigating Hallucination in Vision-Language Models through Barrier-Regulated Adaptive Closed-form Steering Figure 1
2026-05-29cs.CV

Mitigating Hallucination in Vision-Language Models through Barrier-Regulated Adaptive Closed-form Steering

Soumyadeep Jana, Pulkit Mittal, Sanasam Ranbir Singh

Indian Institute of Technology Guwahati, India

2026-05-29视觉语言视觉感知

论文针对LVLM解码中视觉注意力逐步减弱、导致物体幻觉的问题,提出无需训练的BRACS:用预softmax图像注意力作为显式 grounding 屏障,只在低于阈值时对隐藏状态做闭式最小校正,并自适应调节强度。LLaVA-1.5-7B和Qwen-VL-Chat实验显示,CHAIRs下降9.4点、POPE F1提升2.7点,同时基本保持通用多模态能力与较高吞吐。

DGSG-Mind: Dynamic 3D Gaussian Scene Graphs for Long-Term Scene Understanding and Grounding Figure 1
2026-05-29cs.CV

DGSG-Mind: Dynamic 3D Gaussian Scene Graphs for Long-Term Scene Understanding and Grounding

Luzhou Ge, Xiangyu Zhu, Jinyan Liu, Xuesong Li

2026-05-29视觉语言三维

面向长期机器人任务中动态环境、跨视角实例关联脆弱和缺少显式空间推理的问题,DGSG-Mind将概率体素网格与3D Gaussian实例地图结合,支持开放词汇语义融合,并用几何-语义一致性的局部更新处理物体变化;其上构建层次场景图和3D Gaussian Mind进行多模态目标定位。实验显示,在自重建地图上取得最佳零样本3D视觉定位表现,并兼顾开放词汇分割、重建和真实机器人动态更新。

Ciphera: A Decentralised Biometric Identity Framework Figure 1
2026-05-29cs.CR

Ciphera: A Decentralised Biometric Identity Framework

Ankit Kanaiyalal Prajapati, Shahzad Memon, Mohammed Mahir Rahman, Ameer Al-Nemrat

Department of Computer Science and Digital Technologies, University of East London, template hashing, cancellable biometrics, and on-device, workflow. Microsoft ION supports scalable DID anchoring

2026-05-29视觉感知

针对集中式生物身份系统存在单点失效、验证不透明和生物特征泄露不可撤销的问题,Ciphera将本地人脸验证、DID/VC、零知识证明、IPFS元数据与区块链吊销及多节点验证整合到统一框架。实验显示注册和认证较稳定,功能成功率81%,并发多节点下p95验证约820ms;但吊销传播延迟、审计日志不一致仍存在,活体检测不足使其仍易受deepfake和重放攻击。

Masked Diffusion Vision-Language Models for Temporal Action Localization Figure 1
2026-05-29cs.CV

Masked Diffusion Vision-Language Models for Temporal Action Localization

Fengshun Wang, Zhengbo Zhang, Zhigang Tu

Wuhan University, Singapore University of Technology and Design

2026-05-29视觉语言视觉感知生成模型

这篇论文针对生成式视觉语言模型做时间动作定位时,自回归解码一旦先生成时间戳就难以后续修正的问题,将任务改为掩码扩散序列生成,使语义与边界时间 token 在双向去噪中共同迭代更新。其关键在于边界感知的 Planned Training Objective 延后时间 token 恢复,并用逐步 IoU 奖励弥补交叉熵与 tIoU 目标不一致。实验在 ActivityNet-RTL、ActivityNet-1.3 和 THUMOS-14 上优于自回归 VLM 基线,严格 tIoU 阈值下收益更明显。

Building and Road Recognition in Dense Urban Informal Settlements: A Dataset and Benchmark Figure 1
2026-05-29cs.CV

Building and Road Recognition in Dense Urban Informal Settlements: A Dataset and Benchmark

Hongyu Long, Jiaxuan Liu, Rui Cao

2026-05-29视觉感知数据集/基准

针对城中村建筑密集、道路狭窄且主流地图与既有遥感数据缺少精细标注的问题,论文构建 DenseUIS:覆盖深圳、广州 126 个城中村的高分辨率建筑与道路提取数据集,并作为专门面向非正式聚落内部结构的基准。作者评测多类深度模型,结果显示现有方法在这类高密度、不规则形态下表现受限,提示后续需要更针对性的建模而非直接沿用常规城市提取方案。

Parameter-Efficient Subspace Decoupling ViT for Mitigating Multi-Task Negative Transfer in Histological Scoring Figure 1
2026-05-29cs.CV

Parameter-Efficient Subspace Decoupling ViT for Mitigating Multi-Task Negative Transfer in Histological Scoring

Youhan Huang, Jiajun Li, Yilin Fang, Shuai Wang, Chuheng Li

2026-05-29视觉感知

针对NAFLD组织学NAS评分中多任务标签相关性强、共享ViT易产生负迁移且全量微调成本高的问题,论文在冻结Swin-T上为脂肪变、气球样变和炎症加入任务专属Adapter/LoRA,并用正交子空间约束与不确定性加权解耦任务表示。实验称在内部鼠NAFLD数据和公开基准上,相比单任务或全量微调获得更稳定泛化,并显著减少可训练参数;具体增益与数据集规模细节仍需看完整结果验证。

Fairness Beyond Demographics: Optimizing Performance Across Appearance-Based Hidden Cohorts in Medical Imaging Figure 1
2026-05-29cs.CV

Fairness Beyond Demographics: Optimizing Performance Across Appearance-Based Hidden Cohorts in Medical Imaging

Milad Masroor, Cuong Nguyen, Kevin Wells, Gustavo Carneiro

2026-05-29视觉感知

医学影像公平性方法常依赖性别、年龄等显式人口属性,但交叉分组会造成样本稀疏,也可能漏掉真正导致误差的外观隐含队列。本文提出无人口标签的 LHCF:先用预训练图像嵌入经 GMM/BIC 聚类发现外观队列,再把队列作为敏感属性做公平优化,并构建 HIDFairBench 压测多属性公平性。实验显示其在单属性和交叉人口分组上同时改善 AUC 与公平指标,优于传统人口属性训练。

Not All Inputs Are Valid: Towards Open-Set Video Moment Retrieval Using Language Figure 1
2026-05-29cs.CV

Not All Inputs Are Valid: Towards Open-Set Video Moment Retrieval Using Language

Xiang Fang, Wanlong Fang, Daizong Liu, Xiaoye Qu, Jianfeng Dong, Pan Zhou, Renfu Li, Zichuan Xu, Lixing Chen, Panpan Zheng, Yu Cheng

Huazhong University of Science and Technology, Peking University, Zhejiang Gongshang University, Dalian University of Technology, Shanghai Jiao Tong University, Xinjiang University, The Chinese University of Hong Kong, Huazhong University of Science and Technology Wuhan China, Peking University Beijing China, Zhejiang Gongshang University Guangzhou China, Dalian University of Technology Dalian China, Shanghai Jiao Tong University Shanghai China

2026-05-29视觉感知

这篇论文针对现有视频片段检索默认“所有文本查询都与视频相关”的闭集假设,指出在安防等场景中无关查询会被强行匹配并造成风险。作者提出开放集视频片段检索 OS-VMR,并设计 OpenVMR:用归一化流建模 ID 查询分布,通过不确定性与似然确定 ID/OOD 边界,再结合粗细粒度跨模态匹配和正-未标注学习完成定位。三 个 VMR 数据集实验显示其能在拒绝 OOD 查询的同时保持有效检索。

Cert-LAS: Toward Certified Model Ownership Verification for Text-to-Image Diffusion Models via Layer-Adaptive Smoothing Figure 1
2026-05-29cs.CR

Cert-LAS: Toward Certified Model Ownership Verification for Text-to-Image Diffusion Models via Layer-Adaptive Smoothing

Leyi Qi, Yiming Li, Siyuan Liang, Zhengzhong Tu, Dacheng Tao

2026-05-29视觉感知生成模型

针对文生图扩散模型易被盗用而现有后门水印依赖“忠实”查询、在随机或对抗扰动下易失效的问题,Cert-LAS将扩散分类器作为隐式水印载体,并按UNet层微调敏感度分配自适应平滑噪声,再用WR/RP统计和配对t检验做所有权验证。论文给出有界参数扰动下的可认证鲁棒性条件,实验显示其在保持生成质量与隐蔽性的同时,对恶意移除和自适应攻击更稳定。

AgentDoG 1.5: A Lightweight and Scalable Alignment Framework for AI Agent Safety and Security Figure 1
2026-05-29cs.AI

AgentDoG 1.5: A Lightweight and Scalable Alignment Framework for AI Agent Safety and Security

Dongrui Liu, Yu Li, Zhonghao Yang, Peng Wang, Guanxu Chen, Yuejin Xie, Qinghua Mao, Wanying Qu, Yanxu Zhu, Tianyi Zhou, Leitao Yuan, Zhijie Zheng, Qihao Lin, Yimin Wang, Haoyu Luo, Shuai Shao, Chen Qian, Qingyu Liu, Ling Tang, Ruiyang Qin, Qihan Ren, Junxiao Yang, Kun Wang, Zhiheng Xi, Linfeng Zhang, Ranjie Duan, Bo Zhang, Wenjie Wang, Wen Shen, Qiaosheng Zhang, Yan Teng, Chaochao Lu, Rui Mei, Man Li, Jialing Tao, Xi Lin, Tianhang Zheng, Yong Liu, Quanshi Zhang, Lei Zhu, Xingjun Ma, Junhua Liu, Hui Xue, Xiaoxiang Zuo, Xiangnan He, Chao Shen, Xianglong Liu, Minlie Huang, Jing Shao, Xia Hu

Shanghai Artificial Intelligence Laboratory

2026-05-29安全鲁棒

面向 OpenClaw/Codex 等开放式智能体带来的跨环境执行风险,本文提出 AgentDoG 1.5 安全对齐框架:扩展风险分类与 ATBench,借助分类引导数据引擎和影响函数筛选,用约 1k 样本训练 0.8B–8B 轻量守卫模型,并构建有限状态仿真的 SFT/RL 环境及在线护栏。实验显示其在多类安全评测上达到或超过现有模型,且训练环境开销较 Docker 级方案降低约两个数量级。

Low-Magnification SEM May Suffice: Interpretable Deep Learning for Multi-Scale Fracture-Cause Classification in Zirconia-Toughened Alumina Figure 1
2026-05-29cs.CV

Low-Magnification SEM May Suffice: Interpretable Deep Learning for Multi-Scale Fracture-Cause Classification in Zirconia-Toughened Alumina

Julian Schmid, Pawel Astankow, Tom Vater, Julius Beck, Robert Cichon, Danny Krautz

2026-05-29视觉感知

面向陶瓷髋/膝关节植入物质检中耗时且依赖专家的断口溯因问题,论文用多倍率 SEM 历史图像训练可解释 ViT,将缺陷归为生坯、硬加工和材料三类。关键洞察是 50×低倍率下的断口镜面与羽纹等宏观形貌已含足够诊断信号,性能接近高倍率。模型在五折验证中达 0.907 准确率、0.888 macro-F1,Grad-CAM 关注区域与断口学线索一致,但仍受类别不均衡和历史标签噪声影响。

Fewer Steps, Better Performance: Efficient Cross-Modal Clip Trimming for Video Moment Retrieval Using Language Figure 1
2026-05-29cs.CV

Fewer Steps, Better Performance: Efficient Cross-Modal Clip Trimming for Video Moment Retrieval Using Language

Xiang Fang, Daizong Liu, Wanlong Fang, Pan Zhou, Zichuan Xu, Wenzheng Xu, Junyang Chen, Renfu Li

2026-05-29视觉感知

这篇论文针对语言引导视频片段检索在长视频中需处理大量无关固定 clips、计算开销高且易造成边界偏差的问题,提出 SpotVMR:先用低成本语义索引特征预览视频,再由查询条件化的跨模态 clip 搜索器选择少量相关区域,并用蒸馏缓解选择器与检索模型联合训练困难。该模块可插入现有 VMR 方法,在三个数据集上显示能减少处理步骤并保持或提升检索性能。

Improving CLIP Adaptation by Breaking Tail Alignment for Source-Free Cross-Domain Few-Shot Learning Figure 1
2026-05-29cs.CV

Improving CLIP Adaptation by Breaking Tail Alignment for Source-Free Cross-Domain Few-Shot Learning

Shuai Yi, Yixiong Zou, Yuhua Li, Ruixuan Li

2026-05-29视觉感知

针对无源跨域少样本中 CLIP 在大域移、少标注下易因“所有 patch 都对齐文本”而过拟合的问题,论文提出尾部对齐应被打破的洞察:高相似 head token 继续拉近文本,低相似 tail token 反向推离。其 ATHA 在 ViT 各层动态选择 token,并用可学习强度加减文本嵌入;四个 CDFSL 基准上报告达到 SOTA。

Energy-Aware NECO for Single-Pass Pixel-wise Out-of-Distribution Detection in Semantic Segmentation Figure 1
2026-05-29cs.CV

Energy-Aware NECO for Single-Pass Pixel-wise Out-of-Distribution Detection in Semantic Segmentation

Boyuan Zhang, Huanshan Huang, Yifei Cao

2026-05-29视觉感知

面向移动机器人语义分割中的像素级 OOD 检测,论文针对 MC Dropout/集成等不确定性方法推理代价高、纯 NECO 几何分数易漏检嵌入主 ID 子空间的异常,提出单次前向的 Energy-Aware NECO,将解码器特征的中心化 NECO 几何比与 logit Energy 标准化后凸融合。在 miniMUAD 上 AUROC 达 0.8539,优于 NECO-only、Energy-only 和集成熵基线,但极高召回尾部集成方法仍更稳。

GeoMag: Geometric-Aware Video Motion Magnification via State Space Model Figure 1
2026-05-29cs.CV

GeoMag: Geometric-Aware Video Motion Magnification via State Space Model

Kecheng Han, Yuchen Zhang, Bingqing Liu, Boqiang Guo, Wenbin Zheng, Shiyuan Pei

2026-05-29视觉感知

这篇论文针对视频运动放大在旋转、复合运动和传感器噪声下易出现结构不一致、CNN缺全局上下文而Transformer代价高的问题,提出基于状态空间模型的GeoMag,以线性复杂度建模全局几何一致性;同时构建含复杂几何变换与真实退化的Geo-200K合成数据。实验显示其在合成和真实基准上提升视觉保真度、效率并减少伪影,但部分增益可能主要来自更强数据合成。

S2MDF: A Plug-And-Play Layer for Intersection-Free Multi-Object Signed Distance Fields Figure 1
2026-05-29cs.CV

S2MDF: A Plug-And-Play Layer for Intersection-Free Multi-Object Signed Distance Fields

Deniz Sayin Mercadier, Federico Stella, Aurel Bizeau, Nicolas Talabot, Pascal Fua

Nicolas Talabot, CVLab, Ecole Polytechnique Fédérale de Lausanne (EPFL)

2026-05-29视觉感知

多物体组合式 SDF 常会生成相互穿透的几何,软碰撞损失既不能保证消除交叠又需调权。S2MDF 将向量值 SDF 投影到满足硬约束的多物体距离场,并利用与线性插值兼容的约束形式,可作为训练层或后处理接入现有方法。实验显示其将交叠降至数值精度,同时基本保持重建质量。

SLAD : Shared LoRA Adapters for Task Specific Distillation Figure 1
2026-05-29cs.CV

SLAD : Shared LoRA Adapters for Task Specific Distillation

Reda Bensaid, Yassir Bendou, Vincent Gripon, François Leduc-Primeau

2026-05-29视觉感知

面向嵌入式等受限场景,论文关注小型视觉基础模型的任务特定蒸馏:作者指出全量微调教师虽提升教师精度,却会拉大教师与学生的特征错位,反而削弱蒸馏。SLAD用LoRA保持表示对齐,并在教师、学生编码器间共享部分适配器联合训练。分类和语义分割实验显示其提升学生也提升教师,平均较既有分类基线高2.16%准确率,训练约比全量微调快2倍。

Efficient, Validation-Free Intrinsic Quality Estimation for Large-Scale Face Recognition Datasets Figure 1
2026-05-29cs.CV

Efficient, Validation-Free Intrinsic Quality Estimation for Large-Scale Face Recognition Datasets

Zhichao Chen, Yongle Zhao, Kaicheng Yang, Meng Yang, Yin Xie, Ziyong Feng

2026-05-29视觉感知数据集/基准

面向大规模人脸识别数据集,论文关注在无干净验证集、无需完整训练时如何预判数据“可训练性”。核心做法是用代理嵌入结合近邻标签一致性与有效秩,区分有益的数据多样性扩展和噪声导致的复杂度膨胀。实验显示,WebFace 清洁扩展时 IQ 随验证准确率从90.36%升至96.26%同步提高,而注入噪声时能比单看有效秩更好保持下游性能排序。

Subcortical Shape Variations and Their Associations with Cognition Across the 8th Decade of Life. A Study in the Lothian Birth Cohort 1936 Figure 1
2026-05-29q-bio.NC

Subcortical Shape Variations and Their Associations with Cognition Across the 8th Decade of Life. A Study in the Lothian Birth Cohort 1936

Maria del C. Valdes-Hernandez, Wonjung Park, Joanna Moodie, Susana Muñoz Maniega, Janie Corley, Fraser N. Sneden, Mark E. Bastin, Joanna M. Wardlaw, Simon R. Cox, Jinah Park

2026-05-29视觉感知

针对单纯体积难以刻画功能相关脑老化的问题,本文利用 LBC1936 纵向 MRI 与认知数据,按顶点建模第八个十年中皮层下结构形态轨迹及其与一般认知变化的关系。结果显示形变高度异质:海马和腹侧间脑左右差异明显,丘脑与苍白球更接近对称收缩;认知下降主要关联不同时点的局部内外向位移。

Unsupervised Semantic Segmentation Facilitates Model Understanding Figure 1
2026-05-29cs.CV

Unsupervised Semantic Segmentation Facilitates Model Understanding

Xiaoyan Yu, Lisa Mais, Jannik Franzen, Peter Hirsch, Nick Lechtenbörger, Andreas Mardt, Dagmar Kainmüller

2026-05-29视觉感知

针对自监督 ViT 研究中常把对比学习结论泛化到 MIM、且位置效应缺少直观诊断的问题,论文将无监督语义分割的 k-means 可视化改作模型理解工具,跨层比较 token、key、query、value。结果显示中间层常最具语义结构,MIM 的 key/query 存在强位置效应并可解释局部性偏置,且 DINOv3-Large token 的边界伪影可能关联其密集预测退化。

A Geometric View of SRC: Learning Representations for Stable Residual Inference Figure 1
2026-05-29cs.LG

A Geometric View of SRC: Learning Representations for Stable Residual Inference

Vangelis P. Oikonomou

2026-05-29视觉感知

本文针对 SRC 等重构式分类在表示空间几何不佳时残差排序不稳定的问题,主张训练与推理严格分离:不把 SRC 纳入训练,而从类子空间张成、主角度和残差间隔分析稳定性。核心洞察是重叠、包含或近重叠会导致间隔坍塌;在覆盖与分离假设下给出间隔下界,并设计类内自表达、跨类抑制和子空间排斥损失。实验在图像、文本和 EEG 上用固定 SRC/OMP 评估几何诊断,但实际增益与求解器近似的关系仍属条件性解释。

SAFE-Pruner: Semantic Attention-Guided Future-Aware Token Pruning for Efficient Vision-Language-Action Manipulation Figure 1
2026-05-29cs.CV

SAFE-Pruner: Semantic Attention-Guided Future-Aware Token Pruning for Efficient Vision-Language-Action Manipulation

Shilin Ma, Chubin Zhang, Changyuan Wang, Yuji Wang, Yue Wu, Zixuan Wang, Jingqi Tian, Zheng Zhu, Yansong Tang

2026-05-29机器人视觉语言视觉感知安全鲁棒

面向VLA机器人策略的实时闭环控制,论文针对现有视觉token剪枝只看浅层注意力、易误删深层推理所需信息的问题,提出SAFE-Pruner。其核心洞察是连续操作中存在“语义注意力一致性”,据此用历史帧深层注意力预测当前帧未来token重要性,并通过自适应子任务划分处理注意力突变。仿真与真实实验显示最高1.89倍加速,成功率下降低于1.7%,较已有方法最多提升1.9%。

Geometry-Guided Modeling of Foundation Features Enables Generalizable Object Shape Deformation Learning Figure 1
2026-05-29cs.CV

Geometry-Guided Modeling of Foundation Features Enables Generalizable Object Shape Deformation Learning

Yiyao Ma, Kai Chen, Zhongxiang Zhou, Zhuheng Song, Dongsheng Xie, Zelong Tan, Rong Xiong, Qi Dou

2026-05-29视觉感知

单目3D重建在遮挡、视角变化和未见类别下易产生不可靠形状,限制机器人操作。本文将类别模板作为可变形几何起点,引入2D基础模型特征,并用模板拓扑进行几何引导传播与点级对齐;同时通过多视角模板特征和位姿感知注意力缓解视角错配。实验显示其在大形变、多视角和新类别上优于现有方法,并可支持真实灵巧操作任务。

OccamToken: Efficient VLM Inference with Training-Free and Budget-Adaptive Token Pruning Figure 1
2026-05-29cs.CV

OccamToken: Efficient VLM Inference with Training-Free and Budget-Adaptive Token Pruning

Geng Li, Guohao Chen, Ting Chen, Shilin Shan, Kuangji Zuo, Bofan Lyu, Tuo An, Gen Li, Jianfei Yang

2026-05-29视觉语言

这篇论文针对 VLM 推理中视觉 token 过长导致 prefill 计算和 KV 缓存开销高的问题,指出固定 top-K 剪枝易受 attention sink 和样本差异影响。OccamToken 的核心是把测试时 register token 作为相对证据锚点,用其注意力分数动态设阈,分两阶段做图像冗余剪枝和查询相关性剪枝且无需训练。实验覆盖 LLaVA-NeXT、LLaVA-v1.5 和 Qwen3-VL,在匹配预算下优于多种剪枝基线;其中 LLaVA-NeXT 可将 2880 个视觉 token 压到约 40 个,仍保留超过 93% 原始精度。

SuperVoxelGPT: Adaptive and Ordered 3D Tokenization for Autoregressive Shape Generation Figure 1
2026-05-29cs.CV

SuperVoxelGPT: Adaptive and Ordered 3D Tokenization for Autoregressive Shape Generation

Yuan Li, Congyi Zhang, Xifeng Gao, Xiaohu Guo

2026-05-29三维

本文针对自回归 MLLM 做高分辨率 3D 生成时,现有 tokenization 要么无序难建模、要么体素序列冗长的问题,提出先预测几何显著性,再用显著性引导的 3D CVT 构造自适应且确定排序的 supervoxel,并通过 SuperVoxelVAE 与微调 MLLM 生成形状。Trellis-500K 实验显示序列长度降至均匀体素的 12.8%,质量达到 SOTA,平均加速约 10 倍。

MARTIAN: A Rendering Framework for Aerial Mars Imagery from HiRISE Orbital Data Figure 1
2026-05-29cs.CV

MARTIAN: A Rendering Framework for Aerial Mars Imagery from HiRISE Orbital Data

Dario Pisanti, Georgios Georgakis

2026-05-29视觉感知

针对火星无人机/着陆器视觉导航缺少大规模带位姿标注航拍数据的问题,MARTIAN用Blender导入真实HiRISE地形模型与正射影像,在可控太阳光照、相机位姿和高度下渲染火星航拍图并输出精确位姿标注。该框架已用于Ingenuity及未来旋翼机地图定位研究,合成数据训练的深度匹配器在真实火星图像上得到验证;但纹理自带原始阴影,跨地点泛化仍需进一步说明。

AgentCVR: Active Multi-Agent Cross-Video Reasoning via Script-Simulated Reinforcement Learning Figure 1
2026-05-29cs.CV

AgentCVR: Active Multi-Agent Cross-Video Reasoning via Script-Simulated Reinforcement Learning

Yilun Qiu, Jiahe Wang, Cilin Yan, Jiayin Cai, Xiaolong Jiang, Yao Hu, Chun Yuan

Xiaohongshu Inc., Tsinghua Shenzhen International Graduate School, Tsinghua University

2026-05-29视觉感知强化学习

针对跨视频推理中证据稀疏、时序错位且单次压缩上下文易丢失关键线索的问题,AgentCVR将任务改写为主动取证:由Master Agent多轮调度视觉与音频Agent,并用LLM生成脚本和轻量文本模拟器进行强化学习以降低训练成本。在CrossVid上,其优于单次推理基线,并在复杂对齐与定位任务上接近闭源SOTA。

DiffSpot: Can VLMs Spot Fine-Grained Visual Differences in Web Interfaces? Figure 1
2026-05-29cs.CV

DiffSpot: Can VLMs Spot Fine-Grained Visual Differences in Web Interfaces?

Linhao Zhang, Aiwei Liu, Yuan Liu, Xiao Zhou

2026-05-29视觉语言

本文关注 VLM 在网页界面中识别细粒度视觉差异的薄弱能力,这对 GUI 代理和设计工具的状态验证很关键。DiffSpot 的核心做法是从代码空间构造差异:对自包含 HTML 的单个元素修改单一 CSS 属性,并用渲染后的边界框门控保证差异局限于目标元素。基准含 4400 对样本;13 个前沿 VLM 零样本测试中,最佳模型真实变化召回仅 40.7%,Hard 档均低于 23%,且失败主要随 CSS 属性而非网页域变化。

Learning Context-Conditioned Predicate Semantics via Prototype Feedback Figure 1
2026-05-29cs.CV

Learning Context-Conditioned Predicate Semantics via Prototype Feedback

NamGyu Jung, Chang Choi

2026-05-29视觉感知

本文针对场景图生成中谓词多义且随图像上下文变化的问题,指出固定或多原型表示难以区分如“standing on”和“riding”等关系。AlignG通过原型反馈先由图内关系候选调整谓词语义,再反向校准关系特征,并用全局语义中心约束漂移。在VG-150和GQA-200上取得稳定提升,SGDet下F@100分别提高1.4和2.7。

CogniVerse: Revolutionizing Multi-Modal Retrieval-Augmented Generation with Cognitive Reflection and Geometric Reasoning Figure 1
2026-05-29cs.CV

CogniVerse: Revolutionizing Multi-Modal Retrieval-Augmented Generation with Cognitive Reflection and Geometric Reasoning

Xiang Fang, Wanlong Fang, Changshuo Wang

School of Software Engineering, Huazhong University of Science and Technology, Nanyang Technological University, Singapore, University College London

2026-05-29视觉感知

针对多模态 RAG 在知识密集问答中常见的噪声检索、跨模态对齐不足和生成不连贯问题,CogniVerse 引入认知反思来判断是否需要检索并过滤内容,用黎曼/双曲几何与谱图方法对齐文本、图像和知识图谱,再以最优传输约束层次化生成。文中称其在多模态问答基准上提升准确率与连贯性并降低检索延迟,但具体增益来源仍需结合实验细节判断。

How to Relieve Distribution Shifts in Semantic Segmentation for Off-Road Environments Figure 1
2026-05-29cs.RO

How to Relieve Distribution Shifts in Semantic Segmentation for Off-Road Environments

Ji-Hoon Hwang, Daeyoung Kim, Hyung-Suk Yoon, Dong-Wook Kim, Seung-Woo Seo

All authors are with Department of Electrical and Communication Engineering, Seoul National University, Korea

2026-05-29视觉感知

越野导航中的语义分割易受场景差异和颠簸导致的传感器噪声、模糊影响,训练域与部署域出现外部/内部分布偏移。论文提出 ST-Seg,不再只在固定源域内做泛化,而是用 ImageNet 学到的真实风格分布进行风格扩展,并以深度纹理流形约束局部纹理。实验显示其在多种偏移目标域上较已有方法有明显提升,但具体增益幅度需看正文表格。

Non-Forgetting Knowledge Allocation with Bi-level Competition for Class-Incremental Learning Figure 1
2026-05-29cs.CV

Non-Forgetting Knowledge Allocation with Bi-level Competition for Class-Incremental Learning

Xiang Tan, Run He, Yawen Cui, Mengchen Zhao, Yan Wu, Tianyi Chen, Huiping Zhuang, Xiaonan Luo, Guanbin Li

2026-05-29视觉感知

针对预训练视觉模型在类增量学习中多适配器被平均使用、既稀释相关任务知识又易让分配器遗忘的问题,论文提出 NoFA-BC:用递归最小二乘构建等价于联合训练的非遗忘分配器,并以任务内 WTA、任务间 LOF 动态抑制无关适配器,再加入稳定性增强。实验在多数据集上优于现有方法,ImageNet-R 长序列和 ImageNet-A 复杂场景分别较次优提升 4.09% 和 7.87%。

Brain-IT-VQA: From Brain Signals to Answers Figure 1
2026-05-29cs.CV

Brain-IT-VQA: From Brain Signals to Answers

Roman Beliy, Matias Cosarinsky, Oliver Heinimann, Navve Wasserman, Michal Irani

Weizmann Institute of Science

2026-05-29视觉感知

针对从观看图像时的 fMRI 信号中回答视觉问题仍性能有限、且难以解释脑区表征的问题,本文提出 Brain-IT-VQA:将 Brain Interaction Transformer 解码出的语言条件 token 接入冻结语言模型,绕过显式图像重建直接做问答;同时构建含 20 类问题、每图约 20 个问答的 NSD-VQA 基准。结果显示其在 fMRI captioning/VQA 上超过既有方法,并可分析不同视觉语义信息与脑区贡献。

BitC-3DGS: High-Capacity 3D Gaussian Splatting Watermarking via Bit Compression Figure 1
2026-05-29cs.CV

BitC-3DGS: High-Capacity 3D Gaussian Splatting Watermarking via Bit Compression

Yuquan Bi, Baosheng Yu, Yingke Lei, Jianwei Yang, Hongsong Wang, Jie Gui, Yuan Yan Tang, James Tin-Yau Kwok

2026-05-29三维

面向3DGS资产在大规模分发中的版权、溯源与完整性验证,论文针对CLIP语义水印受77-token/77-bit容量限制的问题,提出BitC-3DGS:将多比特压缩映射为单个语义token,并用块级/比特级双分支解码和难消息采样提升高容量恢复。Blender与LLFF实验显示,其可支持超过77位水印,128-bit恢复精度接近以往64-bit设置,同时保持较好渲染质量。

ReactBench: A Cause-Driven Benchmark for Multimodal Hallucination via Systematic Evaluation Figure 1
2026-05-29cs.CV

ReactBench: A Cause-Driven Benchmark for Multimodal Hallucination via Systematic Evaluation

Shizhe Zhou, Bohan Jia, Kai Wu, Yan Shen, Tongyun Li, Yuyang Wu, Shaohui Lin

East China Normal University

2026-05-29视觉语言数据集/基准

ReactBench针对现有多模态幻觉评测只看结果、场景简单且缺少成因诊断的问题,构建以成因为中心的基准:用真实图像编辑和考试式问题覆盖关系抹除、反事实属性、变化追踪与密集计数,并结合CoT追踪细粒度子原因。实验显示当前MLLM在共现偏置、语言先验、跨图比较和细粒度感知触发下仍明显脆弱,说明该基准更适合定位鲁棒性短板。

Mitigating State Aliasing in Vision-Language-Action Models via Inverse Dynamics Learning Figure 1
2026-05-29cs.CV

Mitigating State Aliasing in Vision-Language-Action Models via Inverse Dynamics Learning

Kyujin Lee, Injae Kim, Jihwan Park, Yejun Ju, Minseok Joo, Hyunwoo J. Kim

Korea University

2026-05-29视觉语言视觉感知

论文针对VLA模型继承VLM表征后对末端位姿、物体关系等细微状态不敏感,易把需不同动作的相似画面混淆的问题,引入逆动力学辅助任务,直接让视觉编码器从当前与未来观测预测中间动作,并用伪时间反转扩充动作方向。该方法训练后移除辅助头,不改推理流程,在CALVIN与SimplerEnv上提升多种VLA基线,并通过冻结探测和状态-特征对齐分析显示其表征更能区分机器人状态。

Optimizing Latent Representations for Robust Building Damage Assessment Onboard Earth Observation Satellites Figure 1
2026-05-29cs.CV

Optimizing Latent Representations for Robust Building Damage Assessment Onboard Earth Observation Satellites

Thomas Goudemant, Benjamin Francesconi

resolution optical imagery. Available pre-disaster images

2026-05-29安全鲁棒

面向灾后建筑损伤评估中全图下传、地面处理带来的高时延,本文提出地面/星上解耦的双时相检测框架:灾前影像先在地面编码为紧凑潜表示并上注卫星,灾后影像在轨与其比较,输出建筑框和损伤等级。作者系统比较早期融合、孪生分支、交叉注意力、潜空间压缩与鲁棒增强;在 xBD 上显示强压缩下性能下降较小,并能在预/后影像错配时保持较稳健。

DefSynUS: Real-time Patient-specific Intrahepatic Vessel Identification via Deformation-Aware CT-US Domain Adaptation Figure 1
2026-05-29cs.CV

DefSynUS: Real-time Patient-specific Intrahepatic Vessel Identification via Deformation-Aware CT-US Domain Adaptation

Karl-Philippe Beaudet (MIMESIS, UNISTRA), Yordanka Velikova (TUM), Sidaty El Hadramy (MIMESIS, Unibas), Nassir Navab (TUM), Philippe Cattin (Unibas), Juan Verde (MIMESIS, UNISTRA, IHU Strasbourg), Stéphane Cotin (MIMESIS

University of Strasbourg, Strasbourg, France., Technical University of Munich, Germany., University of Basel, Switzerland., Institute of Image-Guided Surgery, France., because vascular topology varies across patients and per-branch labeled ultrasound

2026-05-29视觉感知

面向腹腔镜肝切除中探头受限、血管拓扑复杂和软组织形变导致的肝内血管分支难识别问题,DefSynUS用术前CT血管标注经物理超声渲染生成患者特异训练数据,并在渲染环节加入形变感知增强与CT-US域适配,避免术前超声采集。腹部体模和单病例临床可行性实验显示可实时识别MPV/LPV/RPV等分支并对新姿态保持性能,但多患者泛化和临床有效性仍未充分验证。

From General Vision to Reliable Traversability Estimation: Adapting Vision Foundation Models for Unstructured Outdoor Environments Figure 1
2026-05-29cs.CV

From General Vision to Reliable Traversability Estimation: Adapting Vision Foundation Models for Unstructured Outdoor Environments

Ji-Hoon Hwang, Jisung Bae, Dong-Wook Kim, Yeonkyu Lee, Seung-Woo Seo

2026-05-29视觉感知

面向越野等非结构化场景中“语义可通行”与真实安全不一致、标注边界含糊导致误检的问题,论文提出 ViTA,在 SAM2 上用可学习通行提示注入任务先验,并通过多视角训练估计不确定性、蒸馏单目深度模型的坡度/高程风险,融合为连续通行分数。实验显示其在多域城市与越野数据上提升 IoU 和 Precision,并显著降低 false positive,跨域泛化更稳。

Planning with the Views via Scene Self-Exploration Figure 1
2026-05-29cs.AI

Planning with the Views via Scene Self-Exploration

Kangrui Wang, Linjie Li, Zhengyuan Yang, Shiqi Chen, Zihan Wang, Li Fei-Fei, Jiajun Wu, Leonidas Guibas, Lijuan Wang, Manling Li

Northwestern University, University of Washington, University of Oxford, Stanford University

2026-05-29规划控制

论文关注 VLM 是否能在真实 3D 场景中理解相机动作并组合成多步视角规划,指出现有模型虽具备局部视角变化知识,却难以长程组合。作者构建基于 ScanNet 的 ViewSuite,并提出自探索与视图图蒸馏交替训练,将失败轨迹也转化为视角连接监督。该方法使 Qwen2.5-VL-7B 在交互式视角规划上由 2.5% 提升到 47.8%,超过 GPT-5.4 Pro 与 Gemini 3.1 Pro。

VLA-Pro: Cross-Task Procedural Memory Transfer for Vision-Language-Action Models Figure 1
2026-05-29cs.RO

VLA-Pro: Cross-Task Procedural Memory Transfer for Vision-Language-Action Models

Shengyu Si, Yuanzhuo Lu, Ruimeng Yang, Ziyi Ye, Zuxuan Wu, Yu-Gang Jiang

Institute of Trustworthy Embodied AI, Fudan University, Shanghai Key Laboratory of Multimodal Embodied AI, Shanghai Xinzhi Embodied Intelligence Technology Co., Ltd.

2026-05-29视觉语言视觉感知

这篇论文针对 VLA 在未见任务中难以迁移相似物体、场景和动作经验的问题,提出 VLA-Pro:将每个训练任务的 LoRA 适配器作为可检索的程序性记忆,推理时依据视觉与语言形成的过程状态检索 top-k 记忆并动态融合参数。其在 RoboTwin、RLBench 和真实操作中跨骨干提升泛化,仿真最高相对提升 207%,真实成功率由 5.8% 提至 65.0%。

TAE: Target-aware enhancer for nighttime UAV tracking Figure 1
2026-05-29cs.CV

TAE: Target-aware enhancer for nighttime UAV tracking

Yanyan Chen, Ruigang Fu, Yu Song, Ping Zhong

2026-05-29视觉感知

面向夜间低照度下无人机单目标跟踪易因图像退化、背景噪声增强而失效的问题,TAE用跟踪框弱监督生成目标感知增强掩码,并融合Gamma、对数、Sigmoid三类RGB曲线做区域自适应增强,使增强更集中于目标而非全图提亮。论文还构建含268段、9类目标的DarkSOT基准;在DarkSOT和UAVDark135上报告了明显跟踪性能提升,但具体增益中数据集与模块贡献的可分性仍需看消融细节。

Learning Representations from 3D Gaussian Splats Figure 1
2026-05-29cs.CV

Learning Representations from 3D Gaussian Splats

Julia Farganus, Krzysztof Żurawicki, Arkadiusz Gaweł, Weronika Jakubowska, Halina Kwaśnicka

2026-05-29三维

本文针对3D Gaussian Splatting长期偏重渲染、其场景理解表征能力缺乏系统评估的问题,将3DGS视为带位置、尺度、旋转、透明度和颜色等异质属性的几何输入,比较PointNet系、DGCNN、GAT、SplineCNN等点/图模型,并用分类、线性探测和聚类检验嵌入质量。结果显示PointNet家族更稳健,SplineCNN端到端分类可接近其表现,但GNN在线性探测和聚类上明显退化,提示标准k-NN消息传递与采样机制不适配非均匀Gaussian splats。

GiPL: Generative augmented iterative Pseudo-Labeling for Cross-Domain Few-Shot Object Detection Figure 1
2026-05-29cs.CV

GiPL: Generative augmented iterative Pseudo-Labeling for Cross-Domain Few-Shot Object Detection

Jiacong Liu, Shu Luo, Yikai Qin, Yaze Zhao, Yongwei Jiang, Yixiong Zou

Huazhong University of Science and Technology

2026-05-29视觉感知生成模型

GiPL面向跨域少样本目标检测中两类实际瓶颈:支持集常只有单实例标注,导致密集场景的正确检测被当作负例,以及极少样本微调易过拟合。其核心是按数据集问题选择两分支:迭代伪标签自训练补全支持集监督,或借助Qwen等生成域一致、多目标带标注图像扩充数据。文中在RUOD、CARPK、CarDD的1/5/10-shot设置下平均提升7.63%、9.97%、10.03%,但部分增益可能主要来自生成数据与伪标签规模扩充。

RadioFormer3D: Weakly Supervised 3D Radio Map Estimation in Low-Altitude Airspace via Generative Modeling Figure 1
2026-05-29cs.CV

RadioFormer3D: Weakly Supervised 3D Radio Map Estimation in Low-Altitude Airspace via Generative Modeling

Zheng Fang, Junjie Liu, Kangjun Liu, Jianguo Zhang, Yaowei Wang, Ke Chen

2026-05-29生成模型三维

面向低空无人机与三维异构网络,论文指出二维无线电地图难以刻画随高度变化的遮挡、多径与近自由空间传播。RadioFormer3D在RadioFormer双流融合基础上加入傅里叶采样编码器和体素/多高度解码器,并用联合频谱完整性损失结合体级伪标签、几何感知渲染和像素约束缓解垂直标注稀缺。实验称其在多个数据集上优于代表方法,尤其改善未标注高度重建,同时保持较好精度—效率权衡。

Audio Deepfake Detection with Half-Truth Localisation Using Cross-Attentive Feature Fusion Figure 1
2026-05-29cs.SD

Audio Deepfake Detection with Half-Truth Localisation Using Cross-Attentive Feature Fusion

S. Sutharya, Remya K. Sasi

Department of Computer Science, Cochin University of Science and Technology (CUSAT)

2026-05-29视觉感知

针对传统音频深伪检测只做真假二分类、难以处理“真话中插入一小段合成语音”的取证需求,论文提出轻量级 CAFNet,将 MFCC、LFCC 与 Chroma-STFT 经深度可分离卷积和交叉注意力融合,并在一次前向中同时完成真/假/半真三分类与篡改边界回归。在 MLADDC T2+T3 上达到 92.71% 准确率、0.9910 macro AUC,边界 MAE 为 0.075 秒;二分类也以 57.6 万参数超过微调 XLS-R 和 AST,但跨数据集微调仍出现表征遗忘。

KGEdit: Ambiguity-Aware Knowledge Graphs for Training-Free Precise Video Generation and Editing Figure 1
2026-05-29cs.CV

KGEdit: Ambiguity-Aware Knowledge Graphs for Training-Free Precise Video Generation and Editing

Mingshu Cai, Miao Zhang, Chenghe Yang, Yixuan Li, Osamu Yoshie, Yuya Ieiri

2026-05-29视觉感知

针对复杂文本驱动视频生成/编辑中语义歧义、概念绑定错误和跨帧漂移的问题,KGEdit不再依赖反复改提示或额外训练,而是将提示解析为含身份、关系、属性和负约束的歧义感知知识图,并通过SSIM注入扩散Transformer、用TASC按去噪阶段调度语义控制。实验称其在编辑精度、语义对齐和时间一致性上优于代表性训练自由方法及统一框架。

ESAM++: Efficient Online 3D Perception on the Edge Figure 1
2026-05-29cs.CV

ESAM++: Efficient Online 3D Perception on the Edge

Qin Liu, Lavisha Aggarwal, Saptarashmi Bandyopadhyay, Vikas Bahirwani, Marc Niethammer, Ehsan Adeli, Andrea Colaco

Stanford University

2026-05-29三维

面向机器人、AR/VR 等边缘端在线 3D 感知,ESAM++针对 ESAM 中 3D sparse UNet 占用主要 CPU 推理时间的问题,提出稀疏 3D 特征金字塔 SFPN,通过限制高分辨率通道、利用多尺度层级预测与聚合来降低点云特征提取开销。在 ScanNet、ScanNet200、SceneNN、3RScan 上,其大模型精度接近或略优 ESAM-E,同时 CPU 3D 部分延迟由约 934ms 降至 326ms,模型约缩小到 41.2M,较基线最高约 3 倍加速、2 倍更小。

Mask the Target: A Plug-and-Play Regularizer Against LoRA Forgetting Figure 1
2026-05-29cs.CL

Mask the Target: A Plug-and-Play Regularizer Against LoRA Forgetting

Runze Xu, Arpit Garg, Hemanth Saratchandran, Simon Lucey

Australian Institute for Machine Learning, Adelaide University

2026-05-29视觉感知

论文关注无回放场景下 LoRA 适配新领域时的遗忘问题:目标分布越偏离预训练/对齐分布,旧能力越易下降。核心方法 TMKL 在损失层屏蔽真实目标 token,仅对非目标词表做重归一化 KL,避免对抗交叉熵且不改适配器、无推理开销。实验显示在多种 LoRA 变体和 Qwen/Llama/Mistral 等骨干上显著降低 WikiText、LAMBADA 等保留集漂移,7B PubMed 适配中保留性能接近基座,目标 PPL 基本不损失。

On Asymmetric Optimization of Reasoning and Perception in Vision-Language Model Post-Training Figure 1
2026-05-29cs.CL

On Asymmetric Optimization of Reasoning and Perception in Vision-Language Model Post-Training

Xueqing Wu, Yu-Chi Lin, Kai-Wei Chang, Nanyun Peng

University of California, Los Angeles

2026-05-29视觉语言视觉感知优化算法

本文关注 VLM 后训练中“推理变强但感知仍弱”的瓶颈,构造图着色和数独等可控任务,将感知与推理输出、评测解耦。核心洞察是 SFT 的不对称主要来自 CoT 中感知 token 和梯度信号过少,RL 则来自结果奖励与推理更强耦合。通过感知损失动态重加权和感知奖励,端到端准确率分别最高提升 18.2 和 6.0 个点。

AnyMo: Scaling Any-Modality Conditional Motion Generation with Masked Modeling Figure 1
2026-05-29cs.CV

AnyMo: Scaling Any-Modality Conditional Motion Generation with Masked Modeling

Yiheng Li, Zhuo Li, Ruibing Hou, Yingjie Chen, Hong Chang, Hao Liu, Shiguang Shan

Key Laboratory of Intelligent Information Processing of Chinese Academy of Sciences (CAS), Institute of Computing Technology, CAS, China, University of Chinese Academy of Sciences, China

2026-05-29视觉感知

论文针对条件人体运动生成中多模态对齐数据稀缺、模型常被固定输入模态绑定的问题,构建了约5000小时、320万序列的OmniHuMo,并提出AnyMo:用残差FSQ离散运动、结合可扩展双向掩码Transformer和模态专属编码器,以支持文本、语音、音乐、轨迹等任意组合控制。实验显示其在多任务上生成质量较高,并能同时调节空间轨迹与风格属性,但部分增益可能主要来自数据规模与scaling。

V2XCrafter: Learning to Generate Driving Scene Across Agents Figure 1
2026-05-29cs.CV

V2XCrafter: Learning to Generate Driving Scene Across Agents

Yihang Tao, Yu Guo, Senkang Hu, Yanan Ma, Zihan Fang, Sam Kwong, Yuguang Fang

Hong Kong JC STEM Lab of Smart City, City University of Hong Kong, Lingnan University

2026-05-29视觉感知

针对真实 V2X 协同驾驶数据稀缺、仿真增强存在域差且单车多视角生成难以扩展到动态多车视角的问题,V2XCrafter以单车扩散骨干为基础,采用两阶段渐进式多智能体生成,并通过协作视图图与共享目标表示的跨车注意力约束一致性。实验显示其可生成更高保真、可控且跨视角一致的街景,并提升下游协同 3D 目标检测表现。

Benchmarking Large Vision-Language Models on CFMME: A Comprehensive Chinese Financial Multimodal Evaluation Dataset Figure 1
2026-05-29cs.CV

Benchmarking Large Vision-Language Models on CFMME: A Comprehensive Chinese Financial Multimodal Evaluation Dataset

Qian Chen, Xianyin Zhang, Yanzhi Liu, Lifan Guo, Feng Chen, Chi Zhang

2026-05-29视觉语言视觉感知数据集/基准

针对中文金融场景中图表、印章、票据等视觉信息难以被现有金融多模态基准全面评估的问题,论文提出 CFMME,覆盖6052个样本、8类金融图像和问答、检测、识别、信息抽取4类任务,并纳入教材、资格考试与真实业务文档。对14个LVLM零样本评测显示,最佳模型问答准确率仅66.11%,其他任务平均77.18,说明当前模型在金融跨模态理解与细粒度识别上仍有明显短板。

FlowSeg: Dynamic Semantic Guidance for LLM-Conditioned Segmentation Figure 1
2026-05-29cs.CV

FlowSeg: Dynamic Semantic Guidance for LLM-Conditioned Segmentation

Zekang Zhang, Guangyu Gao, Youyun Tang, ChengJing Wu, Xiaochao Qu, Chi Harold Liu, Jianbo Jiao, Yunchao Wei, Luoqi Liu, Ting Liu

2026-05-29视觉感知生成模型

论文针对LLM条件分割中“候选掩码已较好但最终选错”的语义错配问题,指出瓶颈常在语言与掩码生成过程脱节而非掩码质量不足。FlowSeg通过解码层间的双向语义流,让语言条件持续指导查询/掩码细化,同时由视觉证据更新条件嵌入,并加入轻量边界感知修正。实验在RefCOCO系列和ReasonSeg上取得SOTA,消融与oracle分析表明增益主要来自更可靠的语言-掩码对齐。

FedSmoothLoRA: Toward Smoother and Faster Convergence in Federated Low-Rank Adaptation Figure 1
2026-05-29cs.CV

FedSmoothLoRA: Toward Smoother and Faster Convergence in Federated Low-Rank Adaptation

Zehao Wang, Guanglei Yang, Yihan Zeng, Hang Xu, Hongzhi Zhang, Wangmeng Zuo, Chun-Mei Feng

Harbin Institute of Technology, Huawei Noah’s Ark Lab, University College Dublin

2026-05-29学习理论

本文针对联邦场景下直接使用 FedAvg+LoRA 时更新空间受限、跨轮本地状态被覆盖以及初始化不考虑客户端异质性的收敛问题,提出 FedSmoothLoRA:在跨轮合并 LoRA 到主干以扩大更新空间的同时,用 Round-Matching 保持客户端上一轮有效状态连续性,并用 Gradient-Aligned 利用本地梯度构造客户端感知初始化。实验覆盖图像分类和自然语言生成,显示其相比 FedAvgLoRA、FRLoRA 等方法收敛更平滑、更快且性能更高。

Uni-RCM: Unified Reference-guided Cross-modal Mapping for Multi-Class Anomaly Detection Figure 1
2026-05-29cs.CV

Uni-RCM: Unified Reference-guided Cross-modal Mapping for Multi-Class Anomaly Detection

Yangchen Wu, Huiqiang Xie

2026-05-29视觉感知

面向工业产线多类别、多模态异常检测中单类建模难扩展、统一建模又易受类间干扰和特征流形混淆的问题,Uni-RCM用冻结的DINO与PointMAE提取2D/3D特征,引入可学习参考特征进行跨模态引导映射,并用离线残差量化器刻画正常模式分布以补充异常评分。在MVTec-3D AD多类别设置下,文中报告其在图像级I-AUROC和像素级AUPRO@1%上达到SOTA。

Comparative evaluation of photogrammetric reconstruction methods and 3D Gaussian Splatting for road surface roughness analysis Figure 1
2026-05-29cs.CV

Comparative evaluation of photogrammetric reconstruction methods and 3D Gaussian Splatting for road surface roughness analysis

Marouane Elmegdar, Teng Xiao

a School of International Education, Hubei University of Technology, Wuhan, China 430068, b School of Computer Science, Hubei University of Technology, Wuhan, China 430068, Image-based 3D reconstruction offers a low-cost and scalable alternative by enabling geometric surface evaluation from

2026-05-29数据集/基准三维

针对传统路面粗糙度检测设备昂贵、部署复杂的问题,本文用同一组手机影像和 CloudCompare 流程比较 COLMAP、Meshroom、Metashape 与 3DGS 的粗糙度估计差异。核心洞察是重建算法的匹配密度、滤波和表示形式会直接改变 Rp 指标:COLMAP 对微纹理最敏感但噪声较高,Meshroom 在细节与稳定性间较均衡,Metashape 过于平滑,3DGS 可捕捉缺陷但点密度不均,当前更适合相对分析而非精确计量。

How Much Is a Dataset Worth? Scaling Laws, the Vendi Score, and Matrix Spectral Functions Figure 1
2026-05-29cs.LG

How Much Is a Dataset Worth? Scaling Laws, the Vendi Score, and Matrix Spectral Functions

Jeff A. Bilmes, Gantavya Bhatt, Arnav M. Das

Department of Electrical & Computer Engineering, Paul G. Allen School of Computer Science & Engineering, University of Washington, Seattle

2026-05-29数据集/基准

本文针对训练数据价值难以低成本评估的问题,指出常见神经 scaling law 与 Vendi Score 都可纳入次模视角,并将 Vendi 推广为更大的矩阵谱函数族,同时用 secular equation 更新避免反复特征分解,使 ImageNet 规模上直接优化 Vendi 成为可能。实验发现,数据价值并非由规模、类别均衡或训练预算决定;Vendi 在中等区间有预测性但极高分数会失真,整体上 facility location 对下游性能的相关性最好。

Recovering Policy-Induced Errors: Benchmarking and Trajectory Synthesis for Robust GUI Agents Figure 1
2026-05-29cs.CV

Recovering Policy-Induced Errors: Benchmarking and Trajectory Synthesis for Robust GUI Agents

Tianpeng Bu, Xin Liu, Qihua Chen, Hao Jiang, Shurui Li, Hongtao Duan, Lu Jiang, Lulu Hu, Bin Yang, Minying Zhang

2026-05-29强化学习规划控制数据集/基准安全鲁棒

该文针对GUI智能体在真实执行中难以识别并纠正自身策略诱发错误的问题,指出现有评测和训练数据在错误类型覆盖与长程恢复上错配;提出GUI-RobustEval基准和树式RoTS轨迹合成,生成80万条失败—恢复数据。微调后的RoTS-7B/32B在鲁棒评测和传统GUI任务上均提升,RoTS-32B在OSWorld达47.4%成功率与33.8% All-Pass@4。

One Click per Cell Type Suffices: Training-free Group Interaction for Cell Instance Segmentation Figure 1
2026-05-29cs.CV

One Click per Cell Type Suffices: Training-free Group Interaction for Cell Instance Segmentation

Sanghyun Jo, Seo Jin Lee, Seohyung Hong, Yoorim Gang, Hyeongsub Kim, Hyungseok Seo, Kyungsu Kim

2026-05-29视觉感知

针对病理图像中成百上千细胞逐实例点击成本过高、监督细胞分割又易在未见细胞类型上失效的问题,本文提出无需训练的 Group Prompting/CoP:利用冻结 SAM 编码器中同类细胞已自然聚类的特性,通过多尺度相似性门控和最远点递归扩展,把一次按类型点击传播为同类实例提示。七个基准上仅每类一次点击即可保留逐实例 SAM 超过90%的性能,同质数据集超过99%,并优于若干全监督方法。

ParCo-SDF: Learning Prior-Free Partial-to-Complete Signed Distance Fields of Deformable Objects Figure 1
2026-05-29cs.CV

ParCo-SDF: Learning Prior-Free Partial-to-Complete Signed Distance Fields of Deformable Objects

Deokmin Hwang, Minseok Song, Daehyung Park

All authors are with the School of Computing, Korea Advanced Institute of Science and Technology, Korea

2026-05-29视觉感知

面向机器人操作中可变形物体因自遮挡、机械臂遮挡导致的部分点云难以恢复完整状态,ParCo-SDF提出无需显式形状先验的partial-to-complete SDF框架:用滑动时间窗口、DGCNN与注意力聚合历史几何,再以FiLM调制共享隐式网络预测完整SDF。在橡皮筋操控数据上,相比现有DO重建基线提升几何保真度与拓扑一致性,尤其在严重遮挡和未见形变下更稳健;但实验仍限于仿真和单一物体类别。

3DVLA: Enhancing Vision-Language-Action Models via 3D Spatial and Instance Understanding Figure 1
2026-05-29cs.RO

3DVLA: Enhancing Vision-Language-Action Models via 3D Spatial and Instance Understanding

Zhongyu Xia, Yousen Tang, Bingqing Wei, Yongtao Wang

Wangxuan Institute of Computer Technology, Peking University

2026-05-29视觉语言视觉感知三维

这篇论文针对现有 VLA 主要依赖 2D 视觉、难以处理精确 3D 位姿、实例边界和遮挡的问题,提出可插拔的 3DVLA:在不额外标注且保留 VLM 先验的前提下,引入多视角一致的 3D 特征编码、对象中心实例 token,以及保留预测器的 masked 自监督分支来补全被遮挡视觉 token。作者将其接入多个 VLA 基线,在 LIBERO-Plus 和 RoboTwin 2.0 上报告了稳定且显著的操作成功率提升。

Constructing efficient channels for ideal observers using the conjugate gradient method Figure 1
2026-05-29eess.IV

Constructing efficient channels for ideal observers using the conjugate gradient method

Weimin Zhou

University of Arizona, Wyant College of Optical Sciences, Tucson, AZ 85721, USA, University of Arizona, Department of Radiology & Imaging Sciences, Tucson, AZ 85721, USA

2026-05-29优化算法

高维医学图像中直接计算贝叶斯理想观察者和 Hotelling 观察者代价高、协方差求逆也不稳。论文将线性判别优化中的共轭梯度残差构造成正交高效通道,并可注入成像对象先验,无需矩阵求逆。在 lumpy 背景二分类实验中,该方法较 PLS 更能保留任务相关信息,尤其在训练数据有限时通道更干净、CHO/CIO 对 HO/IO 性能估计更准确。

Semantic and Visual Evidence for Efficient Long-Video Reasoning: A Solution for the HD-EPIC VQA Challenge Figure 1
2026-05-29cs.CV

Semantic and Visual Evidence for Efficient Long-Video Reasoning: A Solution for the HD-EPIC VQA Challenge

Yinsong Xu, Wei Jing, Liuxin Zhang, Wanjun Lv, Hui Li

2026-05-29视觉感知

针对长时第一视角视频问答中 MLLM 上下文受限、稀疏采样丢细节而分块又削弱全局连贯性的问题,论文将推理拆成离线证据构建与在线检索整合:用粗到细摘要形成语义证据,用检测框和视觉嵌入保留对象级证据,再按问题选择相关证据与帧输入模型。该方法在 HD-EPIC VQA 挑战多类任务上取得有竞争力表现,但文中对相对增益幅度与消融贡献说明有限。

Orthogonal Negative Guidance in Attention Feature Space for Text-to-Image Generation Figure 1
2026-05-29cs.CV

Orthogonal Negative Guidance in Attention Feature Space for Text-to-Image Generation

Jungmin Ko, Jungwon Park, Jimyeong Kim, Changin Choi, Wonseok Lee, Wonjong Rhee

2026-05-29视觉感知

针对文本生成图像中“明确不要某物/属性”常导致目标仍出现或画质、语义对齐下降的问题,论文提出在 MM-DiT 的图文注意力输出空间做正交负向引导:将负提示特征相对正提示正交化,仅减去不与正语义重合的分量,无需训练或新增参数。在 FLUX-dev/schnell 与 DCS-Bench 上,该方法在概念抑制、提示对齐和图像质量间取得更好折中,人工偏好较次优基线高 18.78%,并支持多概念与可调强度抑制。

TRACER: Persistent Regularization for Robust Multimodal Finetuning Figure 1
2026-05-29cs.LG

TRACER: Persistent Regularization for Robust Multimodal Finetuning

Hesam Asadollahzadeh, Feng Liu, Christopher Leckie, Sarah M. Erfani

2026-05-29视觉语言安全鲁棒

针对 CLIP 等多模态模型微调常提升 ID 却损害 OOD 鲁棒性的灾难性遗忘问题,论文从线性化对比学习推导闭式解与几何分解,指出常用 EMA 教师会因师生差距塌缩而失去正则作用,并提出 WMA 轨迹锚定的 TRACER 自蒸馏。实验显示其在三类 CLIP 骨干上稳定改善 OOD 准确率与校准,消融支持其对超参数较鲁棒。

DeepFake Forensics AI: A Multi-Modal Detection and Blockchain-Anchored Evidence Management Platform Figure 1
2026-05-29cs.CR

DeepFake Forensics AI: A Multi-Modal Detection and Blockchain-Anchored Evidence Management Platform

Naisha Minnah

2026-05-29视觉感知

面向深度伪造进入司法证据链后“检测与取证保存脱节”的问题,论文提出一个多模态取证平台:用 EfficientNet-B4、BiLSTM 和 ECAPA-TDNN 分别处理图像、视频、音频,并加入 GAN 架构指纹识别与潜变量反演,再用 SHA-256、IPFS 和以太坊合约固化证据流。报告结果为图像 AUC 0.9868、视频 AUC 0.9628、音频 EER 18.63%、GAN 指纹准确率 99.88%,但跨数据集泛化和链上部署真实性仍需进一步说明。

WorldMemArena: Evaluating Multimodal Agent Memory Through Action-World Interaction Figure 1
2026-05-29cs.CV

WorldMemArena: Evaluating Multimodal Agent Memory Through Action-World Interaction

Chengzhi Liu, Yuzhe Yang, Sophia Xiao Pu, Yepeng Liu, Lin Long, Yichen Guo, Nuo Chen, Zhaotian Weng, Elena Kochkina, Simerjot Kaur, Charese Smiley, Xiaomo Liu, James Zou, Sheng Liu, Yuheng Bu, Songyou Peng, Xin Eric Wang

2026-05-29视觉语言强化学习

针对现有多模态智能体记忆评测偏重静态回忆、难定位写入/更新/检索/使用故障的问题,本文提出 Action–World Interaction Loop,并构建含 400 个多会话任务的 WorldMemArena,覆盖长期状态演化与真实行动轨迹。实验显示,记得更多不等于用得更好,视觉证据利用仍弱,系统跨域不稳且在真实轨迹上退化,harness 记忆更灵活但成本高、可靠性不足。

DMC-CF: Dynamic Multimodal CounterFactual QA benchmark for Causal Reasoning Figure 1
2026-05-29cs.CV

DMC-CF: Dynamic Multimodal CounterFactual QA benchmark for Causal Reasoning

Junzhe Zhang, Huixuan Zhang, Guirong Wang, Xingyao Zhang, Pei Liu, Lin Qu, Hu Wei, Xiaojun Wan

Wangxuan Institute of Computer Technology, Peking University

2026-05-29视觉语言数据集/基准

为检验多模态大模型是否真正理解真实世界因果关系,论文针对现有基准依赖合成/卡通数据或规模偏小、静态评测易污染的问题,构建了基于1614个真实视频的DMC-CF-Static(约5k反事实QA),并用因果图表示事件关系,提出动态图干预DGI生成约10k动态QA。实验显示主流MLLM能处理部分简单反事实问题,但在复杂动态因果推理上准确率仍普遍较低。

Rethinking FID Through the Geometry of the Reference Dataset Figure 1
2026-05-29cs.CV

Rethinking FID Through the Geometry of the Reference Dataset

Yunghee Lee, Byeonghyun Pak

2026-05-29数据集/基准

这篇论文针对“FID 越低是否真代表生成质量越好”的评测疑问,把注意力从生成器和特征提取器转向参考数据集几何。作者用分布密度和有效秩刻画六个数据集,发现密集数据集上 FID 更符合质量提升趋势,而分散数据集上样本变好反而可能使 FID 变差;精确率/召回率分解及 DINOv2、KID 消融支持这一结论。

EarthShift: a benchmark for measuring robustness to real-world distribution shifts in Earth observation Figure 1
2026-05-29cs.CV

EarthShift: a benchmark for measuring robustness to real-world distribution shifts in Earth observation

Kelsey Doerksen, Hannah Kerner

School of Computing and Augmented Intelligence, Arizona State University

2026-05-29强化学习数据集/基准安全鲁棒

面向遥感模型部署中常见的时间、地域、尺度、传感器和数据源变化,EarthShift构建了首个覆盖多类真实分布偏移的公开鲁棒性基准,用ID/OOD成对数据衡量有效鲁棒性。对13个模型、11项任务的大规模实验显示,现有地理基础模型在OOD下平均掉点约15–25%,除时间偏移外对地域、尺度、传感器和来源偏移均不稳,且并未比通用视觉预训练或全监督基线更鲁棒,提示领域预训练的鲁棒增益来源不清。

Multi-Stage VLM Pipeline for Zero-Shot Traffic Accident Understanding Figure 1
2026-05-29cs.CV

Multi-Stage VLM Pipeline for Zero-Shot Traffic Accident Understanding

Fumiya Tatematsu, Fumihiko Takahashi

2026-05-29视觉语言

针对交通监控视频中事故发生时间、碰撞位置与类型需在无真实标注训练下同时判断的问题,论文将大VLM从一次性回答拆成全视频粗预测、局部时间细化、单帧空间定位三阶段,并加入235B模型低权重融合和车辆框吸附后处理。该训练自由方案在ACCIDENT挑战私榜达0.57080,较最强主办方基线约提升0.21并获第一。

STAMP: Training Explicit Memory for Mobile GUI Agents in Controllable and Scalable Virtual Environments Figure 1
2026-05-29cs.CL

STAMP: Training Explicit Memory for Mobile GUI Agents in Controllable and Scalable Virtual Environments

Junyang Wang, Haiyang Xu, Xi Zhang, Zhaoqing Zhu, Ming Yan, Jieping Ye, Jitao Sang

Tongyi AI Lab, Alibaba Group, Beijing Jiaotong University, Work done during internship at Tongyi AI Lab. Corresponding author

2026-05-29规划控制

针对移动 GUI 智能体在长程任务中因截图占用上下文而丢失验证码、价格等瞬时信息的问题,STAMP 将“何时记、记什么、何时取用”作为可控变量注入虚拟环境,自动生成可验证的显式记忆监督,并结合 SFT 与在线强化学习训练 Stamp-GUI。实验在新建 Memory-World 上显示其记忆准确率和任务鲁棒性优于现有 GUI 专用模型,同时保持较强通用导航能力。

FreeForm: Reduced-Order Deformable Simulation from Particle-Based Skinning Eigenmodes Figure 1
2026-05-29cs.GR

FreeForm: Reduced-Order Deformable Simulation from Particle-Based Skinning Eigenmodes

Donglai Xiang, Vismay Modi, Rishit Dagli, Ty Trusty, Gilles Daviet, Anka He Chen, Nicholas Sharp, David I.W. Levin

University of Toronto

2026-05-29视觉感知

针对FEM依赖高质量体网格且高自由度计算昂贵、粒子法在大形变下易受离散化影响的问题,FreeForm用RKPM粒子表示构造无网格降阶弹性模拟,并通过弹性能量Hessian的广义特征分析直接得到skinning特征模态,避免逐物体训练神经场。实验显示其相对Simplicits训练约快40倍,且相对收敛FEM误差更低,可用于网格、3D Gaussian Splat及机器人交互仿真。

CapTalk: Text-Guided Stylization and Speech-Driven 3D Head Animation Figure 1
2026-05-29cs.CV

CapTalk: Text-Guided Stylization and Speech-Driven 3D Head Animation

Xuangeng Chu, Yuan Gan, Ziteng Cui, Shuhong Liu, Jian Wang, Bing Zhou, Tatsuya Harada

The University of Tokyo, Snap Research, Snap Inc.

2026-05-29三维

针对现有语音驱动3D头部动画依赖固定身份/风格潜变量、难以随语音情绪动态变化的问题,CapTalk将说话风格拆解为口型幅度、头动幅度和情绪,并构建带文本风格/情绪标注与FLAME参数的大规模数据集;模型用时间窗口自回归结构融合音频与文本,实现推理时可变的风格和情绪控制,实验显示在表现力与可控性上优于既有方法。

ViASNet: A Video Ad Saliency Network for Predicting Dynamic Saliency and Viewer Engagement Figure 1
2026-05-29cs.CV

ViASNet: A Video Ad Saliency Network for Predicting Dynamic Saliency and Viewer Engagement

Jianping Ye, Michel Wedel

2026-05-29视觉感知

短视频广告需要低成本判断观众注意是否被有效引导,但人工眼动测试昂贵且动态显著性受剪辑、语义和音频影响。ViASNet基于3D U-Net,融合视频帧、原始音频与由视觉语言模型生成的场景语义,并以逐帧显著图熵诊断低参与片段。作者在151条真实广告眼动数据上训练评估,并在15条未见广告上展示诊断用途;具体相对增益幅度文中片段未充分说明。

Pocket-Dentist: On-Device Dental Image Understanding via Efficient Multimodal Large Language Models Figure 1
2026-05-29cs.CV

Pocket-Dentist: On-Device Dental Image Understanding via Efficient Multimodal Large Language Models

Kai Bian, Xucheng Guo, Bin Chen, Lingyan Ruan, Yiran Shen, Ting Dang, Hong Jia

2026-05-29视觉语言视觉感知

面向基层/离线牙科筛查中网络、隐私与手机算力受限的问题,本文将全景片和口内照片等三类数据统一为多模态牙科问答基准,覆盖五类任务,并把答案质量、结构化可靠性、LoRA适配成本、内存和延迟纳入同一评估。对14个VLM的结果显示,小模型经牙科LoRA后并不劣于大模型,InternVL3.5-2B表现最佳;其手机端版本在iPhone 17 Pro上单样本4.31秒,相比7B基线延迟降4.9倍、内存降2.3倍。

Turbulence-Robust Dynamic Object Segmentation with Multi-Signal Priors and SAM2 Refinement Figure 1
2026-05-29cs.CV

Turbulence-Robust Dynamic Object Segmentation with Multi-Signal Priors and SAM2 Refinement

Bolian Peng, Ying Tang, Xu Liu, Long Sun, Xiaoqiang Lu

Xidian University

2026-05-29视觉感知安全鲁棒

面向大气湍流视频中背景伪运动、模糊和小目标间歇可见导致的动态目标分割失效,本文提出无需训练的多信号流水线,将 RAFT/跳帧光流、DINOv2 语义先验、ViBe 背景异常与 SAM2 框提示细化融合,以降低对单一运动线索的依赖。官方 DOST 验证集结果为 0.425041 mIoU、0.457206 mDice;由于采用手工阈值且缺少任务微调,增益来源仍有一定不清晰。

UniNote: A Unified Embedding Model for Multimodal Representation and Ranking Figure 1
2026-05-29cs.IR

UniNote: A Unified Embedding Model for Multimodal Representation and Ranking

Jinghan Zhao, Wenwei Jin, Anqi Li, Jintao Tong, Luya Mo, Jiawei Li, Bin Li, Yao Hu

Xiaohongshu Inc., Shanghai Jiao Tong University, Huazhong University of Science and Technology, Beijing Institute of Technology, Xiaohongshu Inc. Beijing China, Shanghai Jiao Tong University Shanghai China, Huazhong University of Science and Technology Wuhan China, Beijing Institute of Technology Beijing China

2026-05-29视觉语言

针对小红书等内容平台的 I2I 检索中,多模态笔记既要全局表征又要支持局部到整体检索,且传统“召回+重排”延迟高的问题,UniNote 将多模态 LLM 改造成统一嵌入模型,先用对比式 SFT 学基础表示,再用 GRPO 强化学习按相关性优化排序,并设计十类检索任务与难负例。实验称其在各类 I2I 任务达到 SOTA,结合 MRL 部署后提升检索质量并降低成本。

Deep Psychovisual Image Representations Figure 1
2026-05-29cs.CV

Deep Psychovisual Image Representations

Wendi Ma, Aryaman Sharma, Wei Dai, Shekhar S. Chandra

School of EECS, The University of Queensland

2026-05-29视觉感知

针对常规 CNN/视觉模型依赖深层空间堆叠、内部表征缺少结构且难解释的问题,论文提出受心理视觉编码启发的 Deep Visual Coding,并用 Phasor Block 生成复值特征,在傅里叶子带中学习稀疏、任务相关的频率选择。实验显示 PsychoNet 在多个分类基准上可匹配或优于 ResNet,且用更少层数获得更清晰的物体部件显著性;但其语义抽象与更广义推理的关系仍文中未充分说明。

No Figure
2026-05-29cs.CV

Toward Ethical Facial Age Estimation: A Generalized Zero-Shot Benchmark Without Training on Children's Data

Caio Petrucci, Leo Sampaio Ferraz Ribeiro, Sandra Avila

2026-05-29数据集/基准

针对人脸年龄估计常用未成年人图像训练带来的伦理、隐私与合规风险,论文将“不用儿童数据训练”形式化为广义零样本基准:在六个数据集上统一划分18–59岁训练/测试、60岁以上作未见验证、18岁以下仅作零样本评估,并尽量避免身份泄漏。九种方法实验显示,对未见儿童年龄段泛化显著失败,整体较监督基线平均下降46.4%,且预测会偏向已见成年年龄段。

An Approach for Thyroid Nodule Analysis Using Thermographic Images Figure 1
2026-05-29cs.CV

An Approach for Thyroid Nodule Analysis Using Thermographic Images

J. R. González, É. O. Rodrigues, C. P. Damião, C. A. P. Fontes, A. C. Silva, A. C. Paiva, H. Li, C. Du, A. Conci

Computer Science Department, Universidade Federal Fluminense, Radiology Department, Hospital Universitário Antônio Pedro (HUAP), this work presents a pilot project for detection of tumors in our university hospital, endocrinology department. Under some future adjustments, this project will be, School of Mathematical Sciences, Shandong Normal University, School of Mathematical Sciences, University of Jinan, 336 West Road

2026-05-29视觉感知

针对甲状腺结节早筛中医生难以快速解读热成像信息的问题,论文梳理红外热成像用于甲状腺分析的流程,并提出较规范的采集协议、动态序列自主配准与基于简单视觉方法的甲状腺 ROI 提取,再用 ROI 的均值、方差、最高温和对称性等特征结合 k-NN 区分健康/异常。结果显示这些特征在小规模试点中有一定判别迹象,但数据量不足,临床增益与泛化能力文中未充分说明。

Motion-guided sparse correction enables expert-quality point tracking across diverse microscopy regimes Figure 1
2026-05-29cs.CV

Motion-guided sparse correction enables expert-quality point tracking across diverse microscopy regimes

Leonidas Zimianitis, Pasindu Thenahandi, Kai Buckhalter, Dineth Jayakody, Julian O. Kimura, Xinyue Liang, Karen Cunningham, Azeem Ahmad, Balpreet S. Ahluwalia, Sampath Jayarathna, Nikos Chrisochoides, Brandon Weissbourd, Dushan N. Wadduwage

\authormark 1Department of Computer Science, Old Dominion University, Norfolk, VA 23529, USA, \authormark 2Department of Biology, Massachusetts Institute of Technology, Cambridge, MA 02139, USA, \authormark 3The Picower Institute for Learning and Memory, Massachusetts Institute of Technology, Cambridge, MA 02139, USA, \authormark 4Department of Physics and Technology, UiT–The Arctic University of Norway, Tromsø 9037, Norway, \authormark 5Department of Physics, University of Oslo, Oslo 0316, Norway, \authormark 6School of Data Science, Old Dominion University, Norfolk, VA 23529, USA, \authormark 7Department of Physics, Old Dominion University, Norfolk, VA 23529, USA

2026-05-29视觉感知

显微视频中点轨迹常因低信噪、形变、遮挡和离焦而难以自动跟踪,逐帧专家标注又成本过高。论文提出 RIPPLE,将标注改为“运动引导的稀疏纠正”:先由光流式运动插值生成整条轨迹,专家只在漂移处点击校正,并双向传播更新。五个水母与精子数据集上,其轨迹质量接近逐帧人工标注,人工点击量减少约 3–25 倍,且交互更新显著快于 TAP-Vid。

SalsaAgent: A multimodal embodied language model for interactive dance generation Figure 1
2026-05-29cs.CV

SalsaAgent: A multimodal embodied language model for interactive dance generation

Payam Jome Yazdian, Zoe Stanley, Angelica Lim

2026-05-29视觉语言

面向机器人/虚拟人需要理解非语言互动的场景,本文以萨尔萨领舞-跟舞为测试床,提出 SalsaAgent:把领导者动作、双人相对关系与音乐编码为可供 LLM 处理的离散 token,并用自动生成的细粒度身体部位描述进行运动 grounding,再经扩散模型细化关节轨迹。实验显示其在动作真实感、舞伴空间协调和节拍对齐上优于既有跟舞生成基线。

Towards the automated segmentation of epicardial and mediastinal fats: A multi-manufacturer approach using intersubject registration and random forest Figure 1
2026-05-29cs.CV

Towards the automated segmentation of epicardial and mediastinal fats: A multi-manufacturer approach using intersubject registration and random forest

É. O. Rodrigues, A. Conci, F. F. C. Morais, M. G. Pérez

Institute of Computing, Institute of Medicine / Pró-Laudo, The core of their method consists of a voxel labeling procedure:, evaluates the class or label attribute of a training set as the, predictive label desired to attach to an incoming unlabeled

2026-05-29视觉感知

心外膜与纵隔脂肪体积和多类心血管风险相关,人工在CT上勾画易受观察者差异影响。本文面向冠脉钙化评分CT,提出跨西门子/飞利浦数据的全自动流程:先做受试者间配准到标准空间,再提取像素及邻域特征,用随机森林区分两类脂肪。实验报告平均准确率98.4%、真阳性率96.2%、Dice 96.8%,但处理单例仍需数小时,实时临床部署受限。

MetaRanker: Human-in-the-loop Active Ranking for Metalens Image Quality Figure 1
2026-05-29cs.CV

MetaRanker: Human-in-the-loop Active Ranking for Metalens Image Quality

Yujin Park, Haejun Chung, Ikbeom Jang

Hanyang University, Hankuk University of Foreign Studies, Hanyang University Seoul Republic of Korea, Hanyang University Yongin Republic of Korea, Hankuk University of Foreign Studies Seoul Republic of Korea

2026-05-29视觉感知

金属透镜成像中,PSNR/SSIM等保真指标常与人类可识别性脱节,导致重建看似更准却更难理解。MetaRanker把图像质量定义为语义可解释性,用人类成对偏好作主监督,结合概率排序、不确定性主动选样和仅作采样引导的VLM先验。作者在DRMI与Metaformer等数据上报告,相比穷举比较可减少约80%标注成本,并提升标注者间一致性。

Guidance Contrastive Token Credit Assignment for Discrete Policy Optimization Figure 1
2026-05-29cs.CV

Guidance Contrastive Token Credit Assignment for Discrete Policy Optimization

Shufan Li, Konstantinos Kallidromitis, Akash Gokul Yusuke Kato, Kazuki Kozuka, Aditya Grover

2026-05-29强化学习优化算法

这篇论文针对 GRPO/DAPO 将样本级奖励均匀分配给所有 token、忽略细粒度贡献的问题,提出 GCPO:用正/负提示下同一策略预测的差异(KL)为 token 分配信用,并用排序归一化稳定权重。实验显示其在 Janus-Pro 文生图 GenEval 上达 0.89,优于 GRPO,并在多模态推理基准上整体超过 DAPO/VPPO;但具体增益与训练数据、基座差异的关系仍需进一步拆解。

Eulerian Gaussian Splatting using Hashed Probability Pyramids Figure 1
2026-05-29cs.CV

Eulerian Gaussian Splatting using Hashed Probability Pyramids

Mia Gaia Polansky, George Kopanas, Stephan Garbin, Todd Zickler, Dor Verbin

Harvard University

2026-05-29三维

针对 3D Gaussian Splatting 训练中依赖手工 densification、分裂和剪枝规则且易脆弱的问题,论文提出 Eulerian Gaussian Splatting:不直接搬移高斯,而是学习场景中的体概率密度,并用 hashed probability pyramid 高效表示和采样高斯位置,配合控制变量构造低方差无偏梯度。实验显示,在均匀初始化、相同 primitive 数量下优于基线,在 mip-NeRF 360 上达到接近或达到 SOTA 的重建质量,同时保持 3DGS 级渲染速度;但训练仍更慢且更耗显存。

Robust Cross-Domain Generalization Using Unlabeled Target Data with Source-Domain Supervision Figure 1
2026-05-29cs.CV

Robust Cross-Domain Generalization Using Unlabeled Target Data with Source-Domain Supervision

Yuyue Zhou, Shrimanti Ghosh, Michael (Kai Yue)Xie, Justin JY Kim, Jessica Knight, Steel McDonald, Vincent Man, Jacob L. Jaremko, Abhilash Hareendranathan

2026-05-29视觉感知学习理论安全鲁棒

针对儿科腕部 POCUS 在不同探头/中心间存在显著域偏移、目标域标注昂贵且受隐私限制的问题,论文提出利用未标注目标域进行自监督预训练的跨域分割框架,结合 MIM 与对比学习提取目标结构表征,并用置信度感知融合头集成预测。在 Philips 有标注源域到 TeleMED 无标注目标域的实验中,318 张图像上目标域 Dice 较基线提升超过 6%,显示出较省标注的跨设备鲁棒性。

Seeing through boxes: Non-Line-of-Sight 3D Reconstruction from Radar Signals Figure 1
2026-05-29cs.CV

Seeing through boxes: Non-Line-of-Sight 3D Reconstruction from Radar Signals

Jiachen Lu, Hailan Shanbhag, Haitham Al Hassanieh

2026-05-29三维

针对毫米波雷达虽能穿透遮挡却因无透镜成像、噪声和低分辨率导致箱内物体三维重建不稳定的问题,本文提出 GeRaF 2.0,将可见区域的视觉几何先验与雷达神经隐式场统一建模,通过 ULoS SDF、渲染和两阶段对齐约束显式利用遮挡外表面对信号传播的影响。真实 Franka 机械臂与 77GHz 雷达实验显示,其较既有 RF/NLoS 方法重建更稳定、表面更干净并达到新的最佳结果。

GeRaF: Neural Geometry Reconstruction from Radio Frequency Signals Figure 1
2026-05-29cs.CV

GeRaF: Neural Geometry Reconstruction from Radio Frequency Signals

Jiachen Lu, Hailan Shanbhag, Haitham Al Hassanieh

2026-05-29三维

GeRaF面向视觉/LiDAR在遮挡、恶劣可见条件下失效而毫米波RF又低分辨率、高噪声的问题,尝试用神经隐式表示做近距离三维几何重建。其核心是把RF无透镜、全空间传播和镜面反射纳入可微渲染:用匹配滤波抑制无关回波,构建物理感知RF体渲染,并设计无透镜采样与alpha融合降低三维采样开销。真实77GHz雷达机械臂扫描实验显示,其重建质量和抗实验噪声优于现有方法,可恢复更细的毫米级几何。

Lightweight Complementary-Cue Fusion for Robust Video Face Forgery Detection Figure 1
2026-05-29cs.CV

Lightweight Complementary-Cue Fusion for Robust Video Face Forgery Detection

Sunghwan Baek, Tariq Anwaar, Karanveer Singh, Rita Singh

Carnegie Mellon University

2026-05-29视觉感知安全鲁棒

针对现有视频换脸检测器依赖宽/双流骨干、单一频域线索易跨域失效的问题,论文提出用极轻量1×1卷积将小波低频结构特征WDF与相位线索SPSL或纹理线索LBP融合成单通道再接入Xception。该设计只增加292个参数,却在八个公开基准上优于Xception、F3Net、SRM等;平均AUC在FF++由74.8%升至78.6%,在DFDC-Preview由70.5%升至74.9%,但结果为单随机种子,统计稳健性文中未充分说明。

OISD: On-Policy Internal Self-Distillation of Language Models Figure 1
2026-05-29cs.LG

OISD: On-Policy Internal Self-Distillation of Language Models

Xinyu Liu, Darryl Cherian Jacob, Yang Zhou, Jindong Wang, Pan He

Auburn University

2026-05-29强化学习

本文针对GRPO等推理强化学习只用稀疏结果奖励、忽视中间层预测信号的问题,提出OISD:在同一on-policy rollout中让最终层作为冻结内部教师,通过logit对齐传递“如何思考”、attention对齐传递“看哪里”,用带符号优势加权JS目标监督中间层而不引入外部教师或特权信息。实验在Qwen3-4B和四个数学推理任务上相对强RL基线取得稳定提升,但层选择与跨任务泛化仍未充分说明。

A Deep Learning Iterative Framework for Sentinel-1 Stripmap Enhancement Based on Azimuth Doppler Decomposition Figure 1
2026-05-29cs.CV

A Deep Learning Iterative Framework for Sentinel-1 Stripmap Enhancement Based on Azimuth Doppler Decomposition

Juan Francisco Amieva, Christian Ayala, Roberto Del Prete, Mikel Galar

Public University of Navarre

2026-05-29视觉感知

针对 Sentinel-1 Stripmap SAR 图像受斑点噪声和空间细节不足限制、且监督增强依赖外部高分辨率传感器或多时相数据的问题,本文利用方位 Doppler 子孔径分解构造与全孔径图像物理一致的自监督训练对,并结合单/多帧学习与迭代推理来同时做去斑和细节恢复。真实 S1 SM 实验中,该方法在 PSNR、SSIM 上优于 MERLIN,但 ENL 低于 MERLIN,说明其更偏向结构保真而非最强平滑。

Embodied3DBench: Benchmarking Low-Level Embodied Spatial Intelligence of Vision Language Models Figure 1
2026-05-29cs.CV

Embodied3DBench: Benchmarking Low-Level Embodied Spatial Intelligence of Vision Language Models

Jiyao Zhang, Mingxu Zhang, Yitong Peng, Haoxuan Liu, Chenshuo Wang, Yuxing Long, Haoyang Huang, Dongjiang Li, Nan Duan, Hui Shen, Hao Dong

CFCS, School of CS, PKU, Technology Co., Ltd, both a systematic evaluation framework and a scalable data solu-, surements are available [4]. These constraints have long hindered

2026-05-29视觉感知数据集/基准三维

论文针对现有 VLM 擅长粗粒度空间关系、却难以支撑机器人真实交互前感知的问题,提出 Embodied3DBench:用高保真仿真生成多视角、细粒度 3D 标注,覆盖定位、空间关系、对应、可供性、抓取点和轨迹等 6 类低层任务,并额外合成 130 万 QA 训练集。对 13 个模型的评测显示,即使 GPT-5、Gemini 等在关系判断上较强,仍在度量定位、抓取和轨迹预测上明显脆弱;用合成数据微调可显著提升低层具身空间能力。

Analyzing Persona Effects in Generated Explanations from Multimodal LLM Agents in Urban Perception Figure 1
2026-05-29cs.CL

Analyzing Persona Effects in Generated Explanations from Multimodal LLM Agents in Urban Perception

Neemias da Silva, Myriam Delgado, Rodrigo Minetto, Daniel Silver, Thiago H Silva

University of Toronto, Toronto, Canada

2026-05-29视觉语言

论文关注多模态 LLM 作为“社会模拟器”时,人设提示究竟改变城市图像理解的哪一部分。作者将输出区分为客观描述的 descriptive grounding 与带价值判断的 interpretive framing,并分析 1,200 个代理的 59,808 条标注。结果显示,不同人设的图像 caption 高度趋同,感知标签差异未达显著,而解释文本会随经济地位和政治倾向系统变化,说明人设主要影响解释框架而非视觉事实描述。

Accelerating HEVC Intra Partitioning via a CNN-Hierarchical Attention Transformer Hybrid Figure 1
2026-05-29eess.IV

Accelerating HEVC Intra Partitioning via a CNN-Hierarchical Attention Transformer Hybrid

Krishna Kumar Sharma, Somdyuti Paul

Krishna Kumar Sharma and Somdyuti Paul are with the Department of Artificial Intelligence, Indian Institute of Technology Kharagpur, Kharagpur, West Bengal 721302, India

2026-05-29视觉感知

针对 HEVC 帧内编码中 CTU 四叉树划分需大量 RDO 搜索、CNN 难建模全局上下文而 Transformer CPU 延迟过高的问题,论文提出 HFViT,将轻量深度可分离卷积与层次注意力、carrier token 和 QP 条件调制结合,并做 BN 融合降延迟。在 JCT-VC 序列上,相比 ETH-CNN 降低 VMAF BD-rate 惩罚 2.4/2.6/7.9 个百分点,CPU 延迟仅高约 8%,GPU 快约 40%。

Trajectory Constraints for Imaging Inverse Problems Figure 1
2026-05-29cs.CV

Trajectory Constraints for Imaging Inverse Problems

Chaoyan Huang, Haijie Yuan, Saiprasad Ravishankar

Department of Computational Mathematics, Science, & Engineering, Michigan State University, Department of Electrical Engineering and Computer Science, University of Michigan, Department of Biomedical Engineering, Michigan State University

2026-05-29规划控制优化算法

本文针对扩散式和迭代式成像逆问题求解器只约束终点、缺少对中间重建轨迹显式控制的问题,提出训练自由的 TRACE 框架,在相邻状态间加入时间耦合,并将其解释为近端更新、用未训练神经映射近似实现。理论分析表明耦合可限制轨迹波动;实验在自然图像恢复和 CT 等线性/非线性任务中提升重建质量,并显示增益与更稳定的状态转移相关。

Auditing Training-Free 3D Shape Retrieval with Diffused Geodesic Moments Figure 1
2026-05-29cs.CV

Auditing Training-Free 3D Shape Retrieval with Diffused Geodesic Moments

Zhicheng Du, Changyue Liu, Wenji Xi, Zhaotian Xie, Zhuo Deng, Ziheng Zhang, Yang Liu, Lan Ma

Tsinghua Shenzhen International Graduate School, Tsinghua University, Guangzhou International Economics College, School of Electrical and Electronic Engineering, The University of Sheffield

2026-05-29三维

本文针对无训练三维形状检索中分数混杂局部信号、归一化、聚合和度量选择的问题,将评测重构为“协议审计”。作者提出非谱的 DGM,用种子条件热响应及低阶矩作为诊断工具。结果显示在匹配聚合协议下,GMSD-HKS 和 WKS 明显强于 DGM,说明输入场与聚合层往往比矩公式本身更决定最终排名。

GAP3D: Generative Alignment of VLM Latents to Patch-Level Embeddings for 3D Generation Figure 1
2026-05-29cs.CV

GAP3D: Generative Alignment of VLM Latents to Patch-Level Embeddings for 3D Generation

Polytimi Anna Gkotsi, Andrii Zadaianchuk, Mohammad Mahdi Derakhshani

2026-05-29视觉语言生成模型三维

针对将 VLM 接入生成模型时常需端到端重训或只对齐压缩语义特征、丢失3D几何所需空间结构的问题,GAP3D 用流匹配扩散 Transformer 将冻结 VLM 的潜变量生成式对齐到 DINOv2 完整 patch 级嵌入,再驱动冻结 TRELLIS 生成3D资产。实验显示该高维对齐可行,主要用通用图文数据即可支持文本到3D,并出现零样本多模态提示能力;但细粒度细节仍弱,且需领域微调缓解自然图像到合成3D渲染的分布偏移。

Resolving Endpoint Underfitting in Diffusion Bridges via Noise Alignment Figure 1
2026-05-29cs.CV

Resolving Endpoint Underfitting in Diffusion Bridges via Noise Alignment

Yurong Gao, Zicheng Zhang, Congying Han, Tiande Guo, Xinmin Qiu

University of Chinese Academy of Sciences

2026-05-29生成模型

论文针对扩散桥在图像复原/翻译中直接套用标准 score matching 时,接近目标端点会因输入与回归目标噪声水平不一致而欠拟合的问题。作者将其分解为幅值与方向误差,提出 NADB:用均值网络构造更干净的条件目标,并设计噪声对齐的随机插值/映射。实验显示其在多类复原任务上优于 I2SB 等扩散桥基线,兼顾感知质量与重建保真度。

2026-05-28

133 篇
From Pixels to Words -- Towards Native One-Vision Models at Scale Figure 1
2026-05-28cs.CV

From Pixels to Words -- Towards Native One-Vision Models at Scale

Haiwen Diao, Jiahao Wang, Penghao Wu, Yuhao Dong, Yuwei Niu, Yue Zhu, Zhongang Cai, Weichen Fan, Linjun Dai, Silei Wu, Xuanyu Zheng, Mingxuan Li, Yuanhan Zhang, Bo Li, Hanming Deng, Huchuan Lu, Quan Wang, Lei Yang, Lewei Lu, Dahua Lin, Ziwei Liu

2026-05-28视觉感知

针对模块化 VLM 依赖视觉编码器与后期对齐、难以保留像素级跨帧关系的问题,论文提出 NEO-ov:用单一 decoder-only 骨干直接串联图像/视频 patch 与文本,并结合统一序列化和时空注意力端到端学习像素—词、帧间对应。实验显示其在单图、多图、视频和空间智能任务上接近同等 LLM 的编码器式模型,细粒度感知与空间推理更突出;但与 Qwen3-VL 等顶级系统仍有差距,增益可能部分来自 scaling / data。

Gamma-World: Generative Multi-Agent World Modeling Beyond Two Players Figure 1
2026-05-28cs.CV

Gamma-World: Generative Multi-Agent World Modeling Beyond Two Players

Fangfu Liu, Kai He, Tianchang Shen, Tianshi Cao, Sanja Fidler, Yueqi Duan, Jun Gao, Igor Gilitschenski, Zian Wang, Xuanchi Ren

2026-05-28生成模型强化学习

为解决现有视频世界模型多停留在单智能体、多人场景中跨视角一致性与计算开销难兼顾的问题,Gamma-World 将智能体作为旋转角空间中正单纯形顶点编码,保持身份可区分且置换对称,并用稀疏 Hub Attention 以线性代价传递跨智能体信息;再通过教师-学生蒸馏和 KV 缓存实现 24 FPS 交互式 rollout。实验显示其在多人虚拟环境中提升视频质量、动作可控性和智能体间一致性,并可从两人泛化到四人。

HarmoVid: Relightful Video Portrait Harmonization Figure 1
2026-05-28cs.CV

HarmoVid: Relightful Video Portrait Harmonization

Jun Myeong Choi, Jae Shin Yoon, Luchao Qi, Roni Sengupta, Joon-Young Lee

2026-05-28视觉感知

HarmoVid针对视频前景合成中逐帧图像和谐化易产生光照闪烁、真实成对视频数据难获取的问题,提出先用图像模型构造伪配对数据、再以光照去闪烁网络净化,并结合真实/合成视频训练视频扩散模型;其非对称alpha mask条件还用于改善边界。实验显示该方法在时间一致性、自然度、身份保持和边界融合上优于既有图像/视频和谐化方法。

AREA: Attribute Extraction and Aggregation for CLIP-Based Class-Incremental Learning Figure 1
2026-05-28cs.CV

AREA: Attribute Extraction and Aggregation for CLIP-Based Class-Incremental Learning

Zhen-Hao Xie, Yu-Cheng Shi, Da-Wei Zhou

2026-05-28视觉感知

面向无旧数据的CLIP类增量学习,论文指出遗忘不仅来自特征漂移,也来自属性证据的聚合偏向新类。AREA将分类拆为属性提取与聚合:用超球面PGA固定视觉/文本类属性锚点,再以轻量任务专家、残差修正和变分信息瓶颈稳定聚合,推理时用最优传输路由专家。多基准实验报告其持续优于现有SOTA。

Personal Visual Memory from Explicit and Implicit Evidence Figure 1
2026-05-28cs.CV

Personal Visual Memory from Explicit and Implicit Evidence

Viet Nguyen, Thao Nguyen, Vishal M. Patel, Yuheng Li

2026-05-28视觉感知

本文针对长期记忆代理过度依赖文本、将图像粗略转成 caption 而丢失个人化视觉证据的问题,构建了需从历史图像中记住显式实体和推断隐式事实的 VisualMem 基准,并提出结合文本记忆后端与结构化视觉记忆的 VISUALMEM,可暂存并随新证据更新身份、归属等信息。实验显示其在新视觉记忆基准上明显优于 caption-only 和既有记忆系统,同时在文本记忆基准上保持竞争力。

OmniVerifier-M1: Multimodal Meta-Verifier with Explicit Structured Recalibration Figure 1
2026-05-28cs.CL

OmniVerifier-M1: Multimodal Meta-Verifier with Explicit Structured Recalibration

Xinchen Zhang, Bowei Liu, Jiale Liu, Chufan Shi, Yizhen Zhang, Junhong Liu, Youliang Zhang, Zhiheng Li, Yujiu Yang, Ling Yang

2026-05-28视觉语言

针对多模态模型生成结果仅靠 True/False 评判过于粗糙、难以定位视觉错误的问题,本文提出 OmniVerifier-M1:用框/点等符号化理由替代文本解释做元验证,并将二元判断奖励与元验证奖励解耦训练。实验显示,符号反馈可用规则奖励减少对额外裁判模型的依赖,解耦策略优于联合奖励;其驱动的 M1-TTS 在区域级自纠错中优于全局多轮编辑。

Ω-QVLA: Robust Quantization for Vision-Language-Action Models via Composite Rotation and Per-step Scaling Figure 1
2026-05-28cs.CV

Ω-QVLA: Robust Quantization for Vision-Language-Action Models via Composite Rotation and Per-step Scaling

Xinyu Wang, Mingze Li, Sicheng Lyu, Dongxiu Liu, Kaicheng Yang, Ziyu Zhao, Yufei Cui, Xiao-Wen Chang, Peng Lu

2026-05-28视觉语言视觉感知安全鲁棒

面向VLA上机部署中语言骨干与扩散动作头同时带来的显存、延迟压力,Ω-QVLA质疑“动作头不能统一低比特量化”的经验判断,提出免训练PTQ:用SVD-Hadamard复合旋转均衡通道能量并扩散异常值,再按DiT去噪步校准激活尺度以处理动态范围漂移。在LIBERO上将Pi 0.5和GR00T N1.5统一压到W4A4仍达98.0%和87.8%成功率,接近或超过FP16,并节省约71%静态内存;真实双臂实验也显示控制未明显崩坏。

Bias Leaves a Gradient Trail: Label-Free Bias Identification via Gradient Probes on Concept Decompositions Figure 1
2026-05-28cs.CV

Bias Leaves a Gradient Trail: Label-Free Bias Identification via Gradient Probes on Concept Decompositions

Thomas Vitry, Kieran Edgeworth, Stefan Wermter, Jae Hee Lee

2026-05-28优化算法

针对已部署视觉分类器常在未知伪相关上“走捷径”、而偏置标签和重训练不可得的问题,论文提出用 NMF 分解中间激活得到类条件概念,再用误分类样本的反向梯度变化给概念打偏置分数:纠正假阴性会增强、纠正假阳性会压制的概念更可能是偏置。该方法在 Colored MNIST、Waterbirds 找回已知偏置,在 CelebA 发现与性别标签不完全一致但影响决策的方向;推理时抑制高分概念使 Waterbirds、CelebA 最差组准确率最高提升 17.9 和 10.4 个百分点。

The Abstraction Gap in Vision-Language Causal Reasoning Figure 1
2026-05-28cs.CL

The Abstraction Gap in Vision-Language Causal Reasoning

Chinh Hoang, Mohammad Rashedul Hasan

2026-05-28视觉语言视觉感知

本文针对VLM在视觉场景中“说得像因果推理”却未必具备结构性理解的问题,提出Text-Only与Chain-Text双探针及Abstraction Gap指标,并构建CAGE覆盖Pearl三层因果层级。结果显示8个开源VLM中7个文本回答流畅但因果链生成很弱,微调4.5万链标注样本仍难弥合差距;少数模型近零差距,说明能力并非架构必然缺失,可能受预训练与对齐方式影响。

Self-Prophetic Decoding to Unlock Visual Search in LVLMs Figure 1
2026-05-28cs.CV

Self-Prophetic Decoding to Unlock Visual Search in LVLMs

Zhendong He, Qiyuan Dai, Guanbin Li, Liang Lin, Sibei Yang

2026-05-28视觉语言

本文关注 LVLM 在高分辨率视觉搜索中的多步推理失稳:视觉搜索后训练会削弱 grounding、OCR、计数等单步能力,长上下文还会累积干扰。作者提出 SeProD,让后训练搜索模型与其后训练前版本自调节,并用基于概率的“预言”采样选择性接收 token,而非简单提示注入。实验显示其在 4 个视觉搜索基准 12 个划分及通用 VQA 上稳定提升,且声称并行接受机制不增加额外计算开销。

SeeGroup: Multi-Layer Depth Estimation of Transparent Surfaces via Self-Determined Grouping Figure 1
2026-05-28cs.CV

SeeGroup: Multi-Layer Depth Estimation of Transparent Surfaces via Self-Determined Grouping

Hongyu Wen, Jia Deng

2026-05-28视觉感知

透明物体会让同一像素同时对应前表面与背后物体,机器人避障、抓取和导航需要多层深度而非只看单层。SeeGroup的关键是放弃预设的前后排序分组,将每条视线上的深度层建模为无序点过程,并用置换不变似然与循环分解模块让模型自定深度图分组。在LayeredDepth上,四元组相对深度准确率由61.34%提升到70.09%,显示其对复杂透明层关系更有效。

Deep Learning Strain Estimation: Is Physics-Based Simulation the Solution? Figure 1
2026-05-28eess.IV

Deep Learning Strain Estimation: Is Physics-Based Simulation the Solution?

Thierry Judge, Nicolas Duchateau, Andreas Østvik, Khuram Faraz, Anders Austlid Taskén, Sigve Karlsen, Thor Edvardsen, Harald Brunvand, Md Abulkalam Azad, Havard Dalen, Bjørnar Grenne, Gabriel Kiss, Pierre-Yves Courand, Lasse Lovstakken, Pierre-Marc Jodoin, Olivier Bernard

2026-05-28视觉感知

论文针对超声心动图中区域心肌应变估计不稳的问题,指出深度学习受限于真实运动标注缺失,而传统物理仿真又与临床视频存在域差。作者将真实视频中的散斑去相关显式注入仿真,并用迭代细化生成1478段带参考运动的光真实数据,训练面向心肌散斑跟踪的TAS-Net。多队列验证显示其在全局与区域应变上优于STE和既有深度方法,GLS专家间变异降至1.42%,低于临床参考的1.78%。

OSP-Next: Efficient High-Quality Video Generation with Sparse Sequence Parallelism, HiF8 Quantization, and Reinforcement Learning Figure 1
2026-05-28cs.CV

OSP-Next: Efficient High-Quality Video Generation with Sparse Sequence Parallelism, HiF8 Quantization, and Reinforcement Learning

Yunyang Ge, Xianyi He, Zezhong Zhang, Bin Lin, Bin Zhu, Xinhua Cheng, Li Yuan

2026-05-28视觉感知强化学习

针对视频 Diffusion Transformer 全注意力在长序列下计算和通信成本过高的问题,OSP-Next 将固定模式的 Skiparse-2D 稀疏注意力、面向稀疏模式切换的 SSP 并行、HiF8 量化联合微调与 Mix-GRPO 后训练结合,强调兼容 FlashAttention 且减少通信。实验中 VBench 达 83.73%,超过 Wan2.1;在 H200 上最高约 1.64× 单卡、1.52× 八卡加速,HiF8 版本在 Ascend 上最高 2.27×,质量仅小幅下降。

EntroAD: Structural Entropy-Guided Prompt Adaptation for Zero-Shot Anomaly Detection Figure 1
2026-05-28cs.CV

EntroAD: Structural Entropy-Guided Prompt Adaptation for Zero-Shot Anomaly Detection

Xinyu Zhao, Qingyun Sun, Jiayi Luo, Jianxin Li

2026-05-28视觉感知

针对CLIP零样本异常检测常用单一路径适配、难以同时处理局部结构缺陷与弥散异常的问题,EntroAD用ViT自注意力计算patch级结构熵,将关系不确定性作为路由信号生成异常感知token,并通过置信度感知的双分支提示适配稳定图文对齐。论文在10个工业与医学基准的跨数据集设置中报告达到SOTA,但具体增益来源仍需结合消融进一步判断。

A Multiscale Kinetic Framework for Image Segmentation: From Particle Systems to Continuum Models Figure 1
2026-05-28cs.CV

A Multiscale Kinetic Framework for Image Segmentation: From Particle Systems to Continuum Models

Horacio Tettamanti, Giulia Guicciardi, Mattia Zanella

2026-05-28视觉感知

针对医学等场景标注稀缺、监督分割依赖数据的问题,本文把像素视为带空间位置与颜色特征的相互作用粒子,构建从微观粒子到Fokker–Planck再到一阶宏观方程的多尺度动力学框架,并用共识型粒子优化选择参数。实验显示该降复杂模型在不同噪声类型和强度下能恢复较准确分割掩膜;实际增益可能主要来自scaling与data-oriented优化。

Compositional Text-to-Image Generation Via Region-aware Bimodal Direct Preference Optimization Figure 1
2026-05-28cs.CV

Compositional Text-to-Image Generation Via Region-aware Bimodal Direct Preference Optimization

Zhuohan Liu, Wujian Peng, Yitong Chen, Zuxuan Wu

2026-05-28视觉感知优化算法

针对扩散式文生图在多物体属性绑定、关系与计数等组合提示上易失配的问题,论文提出 BiDPO:先自动构建含文本/图像偏好对的 BiComp 数据集,再将 Diffusion DPO 扩展为同时优化图像与文本偏好的双模态目标,并用区域级损失聚焦组合概念相关区域。实验显示其在多个组合生成基准上优于既有后训练方法,T2I-CompBench 属性绑定平均提升约 17%、总体较基模提升约 10%,但增益可能部分来自数据构造与筛选规模。

JECA^2: Judgment-Explanation Consistent Adversarial Attack against Forensic Vision-Language Models Figure 1
2026-05-28cs.CV

JECA^2: Judgment-Explanation Consistent Adversarial Attack against Forensic Vision-Language Models

Jiachen Qian

2026-05-28视觉语言视觉感知

针对取证视觉语言模型不仅会被误判、还可能生成与误判一致解释的部署风险,论文提出 JECA²:通过视觉侧 Grad-CAM 注意力转移与文本侧提示嵌入优化,诱导模型输出“错误但自洽”的真实判断。实验在白盒诊断设置达 87.2% ASR,图像-only 和预测掩码仍有 80.3%/78.6%,但闭源迁移有限,说明结论更偏红队上界压力测试。

Internally Referenced Low-Light Enhancement Figure 1
2026-05-28cs.CV

Internally Referenced Low-Light Enhancement

Peiyuan He, Hainuo Wang, Hengxing Liu, Mingjia Li, Xiaojie Guo

2026-05-28视觉感知

针对零参考低光增强缺少正常光参照、难以分离照明、纹理与放大噪声的问题,IRLE从退化图像内部构造物理与结构参照:用局部曝光模拟伪GT校正亮度和色偏,以感知损失和移位不变频谱相关保持结构,并用照明增益调制盲点去噪。实验显示其在噪声抑制、纹理保真和自然亮度分布上优于现有方法。

Mining Multi-Modality Spatio-Temporal Cues for Video Important Person Identification Figure 1
2026-05-28cs.CV

Mining Multi-Modality Spatio-Temporal Cues for Video Important Person Identification

Xiao Wang, Minglei Yang, Bin Yang, Wenke Huang, Zheng Wang, Xin Xu, Mang Ye

2026-05-28视觉感知

这篇论文针对视频中“重要人物”会随事件推进而变化、静态显著性易误判的问题,提出 VIP 识别任务与带理由标注的 Temporal-VIP 数据集,并设计 VIP-Net 融合社交、时空与多模态线索来校正时间重要性偏移。实验中 VIP-Net 准确率达 67.3%,明显高于 37.5%–53.9% 的对比方法,理由生成相似度为 0.63。

Deformable Gaussian Occupancy: Decoupling Rigid and Nonrigid Motion with Factorized Distillation Figure 1
2026-05-28cs.CV

Deformable Gaussian Occupancy: Decoupling Rigid and Nonrigid Motion with Factorized Distillation

Yang Gao, Wuyang Li, Po-Chien Luan, Alexandre Alahi

2026-05-28三维

面向自动驾驶动态占据预测,论文指出弱监督高斯方法多假设刚体运动,难以刻画行人等非刚体目标并保持时序一致。DeGO 用软刚性掩码解耦刚体偏移与非刚体形变,并将 VGGT 的跨相机、跨帧4D特征因子化蒸馏到高斯场中。在 Occ3D-NuScenes 上,其弱监督设置取得 SOTA,整体 mIoU 提升 10.9%,人本实例指标提升 13.5%。

Resolution-free neural surrogates for geometric parameterization and mapping with spatially varying fields Figure 1
2026-05-28cs.CV

Resolution-free neural surrogates for geometric parameterization and mapping with spatially varying fields

Yanwen Huang, Lok Ming Lui, Gary P. T. Choi

2026-05-28视觉感知

针对参数场频繁变化时,传统几何映射需反复求解高分辨率PDE/变分系统而代价高的问题,论文提出无分辨率神经替代模型:用坐标增强的多尺度几何编码,在任意结构或非结构点集上预测映射,并以拟共形、密度均衡等几何约束进行无标签训练。实验覆盖拟共形映射和密度均衡映射,显示可生成相应变形,但量化增益和速度优势文中未充分说明。

GEM: Generative Supervision Helps Embodied Intelligence Figure 1
2026-05-28cs.CV

GEM: Generative Supervision Helps Embodied Intelligence

Ruowen Zhao, Bangguo Li, Zuyan Liu, Yinan Liang, Junliang Ye, Fangfu Liu, Diankun Wu, Zhengyi Wang, Xumin Yu, Yongming Rao, Han Hu, Jun Zhu

2026-05-28视觉感知生成模型

GEM针对具身VLM预训练偏重语义问答、缺少执行所需几何与物理 grounding 的问题,把深度图生成作为预训练中的生成式监督,并用自回归理解模型结合扩散生成模块联合学习,同时发布含深度监督的GEM-4M数据。实验显示其在空间与具身推理基准上取得SOTA,VSI-Bench显著提升;扩展的GEM-VLA在LIBERO达96.1%成功率,真实机器人平均成功率43%。

DriveWAM: Video Generative Priors Enable Scalable World-Action Modeling for Autonomous Driving Figure 1
2026-05-28cs.CV

DriveWAM: Video Generative Priors Enable Scalable World-Action Modeling for Autonomous Driving

Chen Shi, Jinrui Xu, Shaoshuai Shi, Kehua Sheng, Bo Zhang, Li Jiang

2026-05-28视觉感知生成模型强化学习

针对VLM驾驶策略缺少视频动态先验、长时推理缓存代价高的问题,DriveWAM将预训练视频扩散Transformer改造成自回归世界-动作模型,用统一视频/动作时序token和联合flow matching生成未来场景并反推动作,同时以冻结VLM提供分段语义引导、选择性KV记忆支撑长时展开。在NAVSIM和PhysicalAI-AV上取得较强规划表现,4k到100k clips的实验显示性能随数据规模提升,增益可能也主要来自scaling/data。

Janus-LoRA: A Balanced Low-Rank Adaptation for Continual Learning Figure 1
2026-05-28cs.CV

Janus-LoRA: A Balanced Low-Rank Adaptation for Continual Learning

Cheng Chen, Pengpeng Zeng, Yuyu Guo, Lianli Gao, Hengtao Shen, Jingkuan Song

2026-05-28视觉感知

本文针对 LoRA 持续学习中独立更新低秩因子会破坏历史知识子空间正交性、而硬性正交又削弱新任务可塑性的问题,提出 Janus-LoRA:用闭式梯度校正和在线子空间估计约束参数更新,同时以解耦间隔损失拉开新旧特征。实验在 ImageNet-R、CIFAR-100、DomainNet 等基准上报告达到新的 SOTA,说明参数级稳定与特征级分离的联合建模能缓解遗忘。

DiscoForcing: A Unified Framework for Real-Time Audio-Driven Character Control with Diffusion Forcing Figure 1
2026-05-28cs.CV

DiscoForcing: A Unified Framework for Real-Time Audio-Driven Character Control with Diffusion Forcing

Kaiyang Ji, Bingsheng Qian, Binghuan Wu, Kangyi Chen, Ye Shi, Jingya Wang

2026-05-28生成模型规划控制

面向实时交互中的音频驱动角色/类人控制,论文指出离线音乐到动作模型依赖未来上下文,在线部署时易延迟、失拍并累积误差。DiscoForcing将因果音乐编码器与扩散forcing序列模型结合,并用混合时间调度和历史引导采样在响应性与长程稳定间折中。实验称其在同等因果与低延迟约束下,相比自回归和扩散基线有更稳的长时滚动、更准的音动对齐,并可实时用于头像与类人平台。

SSR3D-LLM: Structured Spatial Reasoning via Latent Steps for Fine-Grained Grounding in Unified 3D-LLMs Figure 1
2026-05-28cs.CV

SSR3D-LLM: Structured Spatial Reasoning via Latent Steps for Fine-Grained Grounding in Unified 3D-LLMs

Jiawei Li, Ziyi Liu, Weijie Shi, Long Chen, Jiajie Xu, Xiaofang Zhou

2026-05-28视觉语言三维

针对统一3D-LLM常用单指针读出难以处理同类物体干扰和复杂空间关系的问题,论文提出SSR3D-LLM/S3G:让LLM生成非文本的潜在空间推理步骤与记忆 token,再由几何感知评分器逐步重排Mask3D候选,并用训练期指称线索监督这些步骤。实验在ReferIt3D、ScanRefer、Multi3DRef上优于Grounded 3D-LLM、Chat-Scene及QPG基线,同时保留语言任务通路;但仍依赖上游proposal质量和固定步数预算。

SA4Depth: Consistent Pose-Depth Scale Alignment for Self-Supervised Monocular Depth Estimation Figure 1
2026-05-28cs.CV

SA4Depth: Consistent Pose-Depth Scale Alignment for Self-Supervised Monocular Depth Estimation

Changxuan Li, Nadine Berner, Nassir Navab, Federico Tombari, Stefano Gasperini

2026-05-28三维

本文针对自监督单目深度中姿态网络常被忽视、深度与位姿尺度不一致会破坏光度监督的问题,提出 SA4Depth:训练时用预测深度重投影可学习特征,并通过 LM 优化特征对齐残差来细化相对位姿,使 pose-depth 尺度更一致;推理阶段不增加开销。实验在 KITTI、Cityscapes、NYUv2 上提升多种基线的深度精度,并在 KITTI Odometry 上验证位姿改进。

REVEAL: Reference-Grounded Reasoning for Multimodal Manipulation Detection Figure 1
2026-05-28cs.CV

REVEAL: Reference-Grounded Reasoning for Multimodal Manipulation Detection

Jun Zhou, Bingwen Hu, Yaxiong Wang, Zhedong Zheng, Yongzhen Wang, Yuchen Zhang, Ping Liu

2026-05-28机器人视觉语言视觉感知

针对生成式伪造使传统伪迹检测失效、跨域泛化差的问题,REVEAL把图文篡改检测改写为“检索真实参考再对比验证”:构建17万真实新闻图文库,用差异感知融合与任务解耦MoE同时做真伪判断和篡改定位。实验称其在检测与定位上优于现有方法,并可通过更新参考库实现免训练域适应,但部分增益可能来自参考库规模与数据覆盖。

Diffusion Large Language Models for Visual Speech Recognition Figure 1
2026-05-28cs.AI

Diffusion Large Language Models for Visual Speech Recognition

Jeong Hun Yeo, Chae Won Kim, Hyeongseop Rha, Yong Man Ro

2026-05-28视觉感知生成模型

论文针对唇读中视觉线索歧义强、传统自回归解码过早按从左到右提交不确定 token 的问题,提出 DLLM-VSR:用扩散大语言模型把转写建模为迭代掩码去噪,先解出高置信位置并作为双向上下文;同时设计两阶段训练分离内容对齐与长度建模,并用视频时长引导候选长度解码。该方法仅用 LRS3 标注数据取得 19.5% WER,达到该设置下新 SOTA。

BiasEdit: A Training-Free Bias-Detect-and-Edit Framework for Learning Fair Visual Classifiers Figure 1
2026-05-28cs.CV

BiasEdit: A Training-Free Bias-Detect-and-Edit Framework for Learning Fair Visual Classifiers

Jungwook Seo, Yoonsik Park, Changmin Lee, Sungyong Baik

2026-05-28视觉感知

针对 Web 图像数据中目标类别与背景、性别等偏置属性的虚假相关,BiasEdit提出无需训练和人工偏置标注的“检测—编辑”流程:先用视觉语言表示的统计依赖与互信息自动找出未知偏置,再用文本引导图像编辑生成更真实的 bias-conflict 样本以重构训练集。实验称其优于现有去偏基线,并在训练集最高 100% bias-aligned 的极端设置下仍保持鲁棒表现。

Self-Supervised Online Robot-Agnostic Traversability Estimation for Open-World Environments Figure 1
2026-05-28cs.RO

Self-Supervised Online Robot-Agnostic Traversability Estimation for Open-World Environments

Julia Hindel, Simon Bultmann, Houman Masnavi, Daniele Cattaneo, Abhinav Valada

2026-05-28机器人强化学习

面向越野开放环境中地形未知、平台差异和在线适应受限的问题,论文提出 COTRATE:用本体/惯性信号在线学习与机器人形态相对无关的连续可通行性分数,再通过视觉特征对齐损失监督单目模型,并以多样性特征回放缓解遗忘。作者在两类机器人、11种户外地形约5万图像及三类导航场景上验证,结果显示其优于已有自监督可通行性和开放词汇分割基线,同时保持较低存储开销并支持跨平台迁移。

Bayesian Gated Non-Negative Contrastive Learning Figure 1
2026-05-28cs.CV

Bayesian Gated Non-Negative Contrastive Learning

Peng Cui, Jiahao Zhang, Lijie Hu

2026-05-28视觉感知

这篇论文针对对比学习表示维度语义纠缠、难解释的问题,指出非负对比学习在组合场景中会因共享背景特征同时被正样本拉近、负样本推远而产生优化冲突。BayesNCL的核心是在非负表示上加入贝叶斯门控头,以稀疏Bernoulli先验和变分推断动态屏蔽高频无关特征、保留判别语义。实验称其在ImageNet-100上语义一致性较NCL提升142.1%,线性探测精度也略高于SimCLR和NCL。

Anomaly as Non-Conformity via Training-Free Graph Laplacian Energy Minimization Figure 1
2026-05-28cs.CV

Anomaly as Non-Conformity via Training-Free Graph Laplacian Energy Minimization

Jungwook Seo, Minjeong Kim, Younkwan Lee, Seungho Shin, Sungyong Baik

2026-05-28视觉感知

本文针对少样本工业异常检测中过度依赖近邻相似度、容易把局部相似但整体不一致的缺陷判为正常的问题,提出训练自由的 ANoCo:构建查询补丁到正常参考补丁的二部图,锚定正常节点并最小化图拉普拉斯能量,用特征为符合正常流形所需的“漂移量”作为异常分数。实验在 MVTec-AD 与 VisA 少样本设置中提升图像级检测与像素级定位,且无需额外训练。

VITAL: Visual-Semantic Dual Supervision for Enhanced and Interpretable Latent Reasoning in Medical MLLMs Figure 1
2026-05-28cs.CV

VITAL: Visual-Semantic Dual Supervision for Enhanced and Interpretable Latent Reasoning in Medical MLLMs

Qiaoru Li, Shaotian Liang, Jintao Chen, Haoran Sun, Yuxiang Cai, Jianwei Yin, Yankai Jiang

2026-05-28视觉感知

针对医学多模态问答中显式 CoT 易丢失细粒度视觉证据且推理开销高、潜在推理又缺乏视觉约束和可解释性的问题,VITAL 在连续隐状态上引入文本链重构与独立医学视觉编码器 ROI 特征回归的双监督,训练时约束语义与视觉证据、推理时移除辅助模块以保持零额外开销,并可事后恢复解释。作者构建 61K、9 模态数据集,在 7 个基准上优于骨干、潜在推理基线和更大数据训练的医学 MLLM,视觉 grounding 也显著提升。

EgoRelight: Egocentric Human Capture and Illumination Recovery for Relightable and Photoreal Avatar Rendering Figure 1
2026-05-28cs.CV

EgoRelight: Egocentric Human Capture and Illumination Recovery for Relightable and Photoreal Avatar Rendering

Jianchun Chen, Yinda Zhang, Rohit Pandey, Thabo Beeler, Marc Habermann, Christian Theobalt

2026-05-28视觉感知

面向MR远程临场中虚拟人难以随真实环境光照融合的问题,EgoRelight用头显自我中心双目深度驱动全身网格,并以光场训练的个体化神经外观模型分离漫反射与高光传输,测试时再由头显观测反演HDR环境光。实验显示其在几何跟踪、渲染与重光照保真度上优于多种SOTA组合,但训练仍依赖多视角光场采集。

Adaptive Temporal Gating of Longitudinal Magnetic Resonance Imaging for Alzheimer's Prediction Figure 1
2026-05-28cs.CV

Adaptive Temporal Gating of Longitudinal Magnetic Resonance Imaging for Alzheimer's Prediction

Alireza Moayedikia, Sara Fin, Alicia Troncoso Lora, Uffe Kock Wiil

2026-05-28视觉感知

针对单次结构 MRI 难以捕捉阿尔茨海默病进展轨迹的问题,论文提出 TAF-Net,用自适应时间门控融合形变、跨时点注意力与双时点特征来预测 MCI 三年内转 AD。在 ADNI 严格受试者级交叉验证中,仅用 MRI 即优于基线并接近多模态方法,且在少量数据下保持较好表现;消融显示纵向门控降低预测方差,注意区域与内侧颞叶和脑室等病理区域一致。

Sketch2Motion: Text-driven 2D Sketch to 3D Animation via Diffusion-guided Skeleton Optimization Figure 1
2026-05-28cs.CV

Sketch2Motion: Text-driven 2D Sketch to 3D Animation via Diffusion-guided Skeleton Optimization

Gaurav Rai, Ojaswa Sharma

2026-05-28生成模型优化算法三维

针对手绘2D草图缺少深度、拓扑不稳定且遮挡导致难以生成可信3D运动的问题,Sketch2Motion将草图膨胀为3D网格后,以骨骼变换和线性蒙皮表示动画,并用文本到视频扩散模型的运动感知SDS直接优化骨骼参数;同时加入平滑、关节范围、接触等物理约束和弹簧-质点二级运动。实验称其在多类角色上生成更连贯、文本对齐的动画,优于缺少生成先验或物理约束的基线。

Bound-Constrained Sparse Representation for Electrical Impedance Tomography Figure 1
2026-05-28cs.CV

Bound-Constrained Sparse Representation for Electrical Impedance Tomography

Chun Zhang, Dong Liu

2026-05-28学习理论

针对 EIT 反问题高度非线性、病态且传统显式正则需调参的问题,论文提出 BC-SR,将电导率由低维潜变量生成,用截断图拉普拉斯基嵌入结构先验,并通过保界非线性映射保证物理可行性,再以阻尼 Gauss-Newton 优化。2D/3D 仿真、水槽实验和在体肺数据表明,该方法在绝对与时差成像中提升结构保真、物理一致性和抗噪鲁棒性,尤其改善 3D 肺部重建的空间连贯性。

Toward Semantic-Agnostic and Shape-Aware Vision-Language Segmentation Models Figure 1
2026-05-28cs.CV

Toward Semantic-Agnostic and Shape-Aware Vision-Language Segmentation Models

Corentin Seutin, Mohamed Amine Ettaki, Michaël Clément, Pierrick Coupé, Rémi Giraud

2026-05-28视觉语言视觉感知

现有视觉语言分割多依赖类别词,遇到“红色八边形物体”等非语义描述时暴露出形状、纹理等低中层视觉推理不足。论文提出 SANSA 任务,并用词典约束与示例引导自动生成去语义提示来微调 LISA。实验显示在该新任务上 mIoU 最高提升约 20%,同时基本保持常规语义提示性能。

Transfer learning RGB models to hyperspectral images with trainable tensor decompositions Figure 1
2026-05-28cs.CV

Transfer learning RGB models to hyperspectral images with trainable tensor decompositions

Mariette Schönfeld, Laurens Devos, Wannes Meert, Hendrik Blockeel

2026-05-28视觉感知

高光谱数据通道数多且样本少,难以直接利用只接受 RGB 输入的 ImageNet 骨干;现有降维或重训首层会分别损失图像信息或预训练滤波器。本文将首层卷积做可训练张量分解,保留空间成分并用高维光谱成分替换 RGB 成分,以少量参数适配不同波段。多种遥感与园艺数据实验显示,该方法较降维和首层重训更准确,并对过拟合更稳健。

Inpainting-Style Conditional Diffusion for Multivariable Time Series Forecasting Figure 1
2026-05-28cs.CV

Inpainting-Style Conditional Diffusion for Multivariable Time Series Forecasting

Kourosh Kiani, S.M. Muyeen

2026-05-28生成模型

面向高渗透光伏并网中太阳能出力受天气扰动、非线性和随机性影响而难以准确预测的问题,论文将多变量时间序列滑窗重排为二维补丁,把未来片段视为待修复区域,利用带掩码条件的 DDPM 在保留历史观测的同时生成未来序列,并用零填充适配 U-Net。GEFCom2014 等实验显示其短期预测精度较好,但相对增益的具体来源仍需更多消融支撑。

EventShiftFlow: Towards Hardware-efficient FPGA-based Flow Estimation Figure 1
2026-05-28cs.RO

EventShiftFlow: Towards Hardware-efficient FPGA-based Flow Estimation

Arianna Alonso Bizzi, Fernando Cladera, C. J. Taylor

2026-05-28生成模型

面向事件相机在微型机器人上低时延、低功耗运动感知的硬件瓶颈,EventShiftFlow放弃高精度稠密光流,采用时间分箱、1-bit占据网格和离散速度假设并行计数匹配,只用移位寄存器、计数器和比较器实现流式估计。实验显示其在合成数据上可恢复方向和幅值,在真实序列四段运动中方向准确率达99.5%,两轴状态存储低于13 kbit,但多物体交叉和速度量化仍限制幅值精度。

EchoAvatar: Real-time Generative Avatar Animation from Audio Streams Figure 1
2026-05-28cs.CV

EchoAvatar: Real-time Generative Avatar Animation from Audio Streams

Bohong Chen, Yumeng Li, Yinglin Xu, Youyi Zheng, Yanlin Weng, Kun Zhou

2026-05-28生成模型

面向语音助手/虚拟人实时交互中离线生成延迟高、语音与音乐需分域建模的问题,EchoAvatar提出统一流式音频驱动全身动画框架:用注意力式因果运动 tokenizer 支持自回归低延迟生成,并通过分层 token corruption 强化音频依赖,另探索 GRPO/DPO 与工具调用控制。实验显示其在运动质量和音画同步上优于实时基线,适合接入在线语音代理。

LV-OSD: Language-Vision-Complementary Open-Set Object Detection Figure 1
2026-05-28cs.CV

LV-OSD: Language-Vision-Complementary Open-Set Object Detection

Yupeng Zhang, Ruize Han, Wei Feng, Song Wang, Liang Wan

2026-05-28视觉感知

针对开放集检测过度依赖统一文本提示、难处理同名歧义与缺少类别名/样例等真实场景问题,论文提出LV-OSD任务与LVDor框架,允许类别以文本、图像或混合提示任意指定;通过LLM生成多文本、CLIP提取图像提示,并用目标引导动态加权与随机提示遮蔽适配异构提示。实验称验证了设定合理性和方法有效性,但具体增益幅度在片段中未充分说明。

Every9D-21M: Large-Scale Real-World 9D Canonicalization of Everyday Objects Figure 1
2026-05-28cs.CV

Every9D-21M: Large-Scale Real-World 9D Canonicalization of Everyday Objects

Leonhard Sommer, Emil Akopyan, Adam Kortylewski

2026-05-28强化学习

针对单图估计日常物体9D姿态缺少大规模真实监督、合成数据难泛化的问题,论文提出Every9D-21M:用物体中心视频做多视角重建,将少量人工标注的参考物体通过跨实例几何/外观对齐传播到700类、2180万张真实图像,并加入跨类别对称规则评测。实验显示,用该数据训练可提升ImageNet3D、PASCAL3D+表现,并比仅用ImageNet3D更好泛化到HANDAL,增益可能主要来自scaling/data。

MORI-Seg: Learning Morphological Geometry for Instance Segmentation without Instance Annotations Figure 1
2026-05-28cs.CV

MORI-Seg: Learning Morphological Geometry for Instance Segmentation without Instance Annotations

Leiyue Zhao, Tianyu Shi, Daniel Reisenbuchler, Xinzi He, Junchao Zhu, Tianyuan Yao, Yuechen Yang, Yanfan Zhu, Junlin Guo, Gelei Xu, Haichun Yang, Yuankai Huo, Mert R. Sabuncu, Yihe Yang, Ruining Deng

2026-05-28视觉感知

肾脏病理数据多只有语义掩码,粘连结构被合并,难以做实例级形态计量;MORI-Seg在无需实例标注的条件下,从语义掩码学习面向形态的几何先验,联合对象中心距离场、边界带表示和类别条件特征解耦来拆分连通区域。实验显示其相较传统后处理和已有语义到实例方法提升实例分离精度,并带来更可靠的形态定量。

GUI Agents for Continual Game Generation Figure 1
2026-05-28cs.SE

GUI Agents for Continual Game Generation

Yixu Huang, Bo Li, Na Li, Zhe Wang, Kaijie Chen, Haonan Ge, Qingyi Si, Yuanzhe Shen, Ruihan Yang, Guangjing Wang, Hongcheng Guo

2026-05-28视觉感知

论文指出,游戏生成的质量不在代码是否可运行,而在真实交互中是否可玩,静态检查和一次性生成会漏掉输入、渲染与胜负条件等问题。作者引入 PlaytestArena,用 GUI Agent 通过浏览器游玩并按行为 rubric 评估 200 个网页游戏任务;同时提出 Play2Code,让生成代理与游玩代理在共享记忆中循环改进。实验中 Play2Code 达到 66.8% rubric 通过率,较单次生成和代理式编码基线分别提升 37.1 和 14.6 个百分点。

Category-Level 3D Correspondence in Camera Space via Morphable Object Priors Figure 1
2026-05-28cs.CV

Category-Level 3D Correspondence in Camera Space via Morphable Object Priors

Leonhard Sommer, Artur Jesslen, Basavaraj Sunagad, Adam Kortylewski

2026-05-28三维

针对现有类别级位姿/重建表示难以表达物体部件功能语义、且2D匹配受视角和遮挡影响的问题,论文提出相机坐标系中的单目类别级3D对应任务,并构建含遮挡非模态标注与对称性的HouseCorr3D基准。其Morpheus通过共享可变形类别形状先验,解耦规范形状、形变与位姿,在无显式对应监督下产生语义一致3D关键点,并在该基准上显著优于已有基线、达到新SOTA。

PointQ-Bench: Benchmarking Diagnostic and Interpretable Point Cloud Quality Assessment Figure 1
2026-05-28cs.CV

PointQ-Bench: Benchmarking Diagnostic and Interpretable Point Cloud Quality Assessment

Duanchu Wang, Cheng Li, Junjie Yang, Jing Huang, Zihang Cheng, Zhi Gao, ZhuBohong, Di Wang

2026-05-28数据集/基准三维

现有点云质量评估多停留在 MOS 分数,难以回答缺陷类型、可用性和证据解释。PointQ-Bench 将真实扫描、模拟失真与 AI 生成点云统一到 3083 样本、8 类问题和问答/描述标注中,并提出 SSFRQ-5D 评估开放报告。实验显示,14 类模型普遍能粗略感知异常,但在有依据的诊断与质量校准上明显不足,强 2D MLLM 反而常优于现有 3D VLM。

Learning to Label: A Reinforced Self-Evolving Framework for Semi-supervised Referring Expression Segmentation Figure 1
2026-05-28cs.CV

Learning to Label: A Reinforced Self-Evolving Framework for Semi-supervised Referring Expression Segmentation

Runlong Cao, Ying Zang, Chuanwei Zhou, Tianrun Chen, Tong Zhang, Zhen Cui, Chunyan Xu

2026-05-28视觉感知

针对半监督指代表达分割中像素标注昂贵、未标注图文对伪标签易受歧义和遮挡污染的问题,L2L 将伪标签构造建模为可学习决策过程:用冻结 MLLM 提供语义-空间先验并结合 SAM2 生成软掩码,再通过强化式样本自适应选择平衡精度与覆盖率。实验显示其在 RefCOCO/+/g、0.1% 到 10% 标注率下均优于既有半监督方法,低标注场景仍保持较强鲁棒性。

POINav: Benchmarking and Enhancing Final-Meters Arrival in Real-World Vision-Language Navigation Figure 1
2026-05-28cs.RO

POINav: Benchmarking and Enhancing Final-Meters Arrival in Real-World Vision-Language Navigation

Ruiyan Gong, Meisheng Zhang, Yuxiang Zhao, Mingchao Sun, Yanfen Shen, Zedong Chu, Zhining Gu, Wei Guo, Xiaolong Cheng, Qiming Li, Kangning Niu, Yanqing Zhu, Xiaolong Wu, Tianlun Li, Mu Xu

2026-05-28机器人视觉语言视觉感知强化学习数据集/基准

本文关注真实视觉语言导航中到达 POI 入口的“最后几米”难题,指出现有基准粒度粗或依赖合成场景,难以闭环评估。作者构建了基于真实商业街区 3DGS 重建并接入 Isaac Sim 的 POINav-Bench,覆盖 11 个区域、163 个 POI,并提出将 POI 标识定位与入口回归解耦的 Brain-Action 框架及 70K 标识-入口数据集。实验表明该框架能改善精细 POI 到达评估与执行,但具体性能增益幅度文中片段未充分说明。

Bridging the Sampling Distribution Shift in Radio Map Estimation: A Trajectory-Aware Paradigm Figure 1
2026-05-28cs.CV

Bridging the Sampling Distribution Shift in Radio Map Estimation: A Trajectory-Aware Paradigm

Feng Qiu, Zheng Fang, Shuhang Zhang, Kangjun Liu, Longkun Zou, Jing Liu, Ke Chen

2026-05-28规划控制

论文关注无线电地图估计中训练随机采样与真实 UAV/车辆沿轨迹采样不一致的问题,指出轨迹采样会带来空间相关和信息冗余,削弱模型泛化。作者提出 ST-TBS 训练范式,在保持轨迹连续性的同时引入随机触发变化以对齐部署分布;在 RadioMapSeer 与 SpectrumNet 上验证,随机采样训练在轨迹观测下 RMSE 可由 0.0391 升至 0.2632,而 ST-TBS 降至 0.0571。

Proprio: Latent Self-Scoring and Inference-Time Refinement for Physically Plausible Video Generation Figure 1
2026-05-28cs.CV

Proprio: Latent Self-Scoring and Inference-Time Refinement for Physically Plausible Video Generation

Mariam Hassan, Kaouther Messaoud, Wuyang Li, Alexandre Alahi

2026-05-28视觉感知

视频生成模型虽画质强,却常违背物理常识,影响其作为机器人规划与仿真的世界模型。Proprio 的核心洞察是冻结生成器自身的去噪残差可作为“本体感受式”物理自评分数,并在推理时用于 best-of-N 选择或仅优化初始噪声的自我细化。实验在 T2V/I2V 物理基准上优于 VLM 打分和部分外部世界模型,TurboWan2.2 的 Physics-IQ 从 32.2 提至 37.5,VideoPhy2-hard 从 45.6 提至 55.0。

VidPrism: Heterogeneous Mixture of Experts for Image-to-Video Transfer Figure 1
2026-05-28cs.CV

VidPrism: Heterogeneous Mixture of Experts for Image-to-Video Transfer

Rui Lin, Chuanming Wang, Huadong Ma

2026-05-28视觉感知

这篇工作针对图像预训练 VLM 迁移到视频时缺乏时间建模、传统 MoE 专家同质化的问题,提出 VidPrism:用内容感知多速率采样为不同专家提供偏语义或偏运动的输入,并通过双向融合协调空间与时间路径。实验称其在多项视频识别基准达到 SOTA,消融显示四专家、多速率输入、双向交互和全局注意力融合带来主要增益。

A Patient-Specific Pulmonary Arterial Tree Digital Twin to Extract Pulmonary Embolism Biomarkers Figure 1
2026-05-28cs.CV

A Patient-Specific Pulmonary Arterial Tree Digital Twin to Extract Pulmonary Embolism Biomarkers

Morgane des Ligneris, Nathan Painchaud, Allan Serva, Laurent Bertoletti, Pierre Croisille, Carole Frindel, Odyssée Merveille

2026-05-28视觉感知

面向急诊肺栓塞风险分层中血液指标缺失、Qanadli/Mastora 等负荷评分人工计算耗时的问题,论文从 CTPA 分割结果构建患者特异的肺动脉树有向图数字孪生,自动标注层级、肺叶与血栓位置,并提取局部阻塞和全局评分/体积分布等影像生物标志物。验证显示其解剖结构与人工严重度评分具有较强一致性,可快速量化血栓负荷与空间分布。

From Kellgren-Lawrence to Calcium Pyrophosphate Crystal Deposition: A Soft-Labelling Framework for Knee Osteoarthritis Assessmen Figure 1
2026-05-28cs.CV

From Kellgren-Lawrence to Calcium Pyrophosphate Crystal Deposition: A Soft-Labelling Framework for Knee Osteoarthritis Assessmen

Francisco Bérchez-Moreno, Riccardo Rosati, Maria Chiara Fiorentino, Víctor M. Vargas, Edoardo Cipolletta, Emilio Filippucci, Luca Romeo, Pedro A. Gutiérrez, César Hervás-Martínez

2026-05-28视觉感知

针对膝骨关节炎X光分级中KL与CPPD评分具有有序性、邻近等级不确定性且二者关系不对称的问题,论文用单峰软标签替代one-hot,并比较二项、Beta、三角和指数分布来监督两个任务。在2172张膝X光(968张双标注)上,所有软标签均优于名义基线;CPPD以三角分布QWK/MAE最佳,KL以Beta分布最佳,且相对one-hot改进显著(p<0.001)。

No Figure
2026-05-28cs.CV

FLORO: A Multimodal Geospatial Foundation Model for Ecological Remote Sensing Across Sensors and Scales

Jorge L. Rodriguez, Victor Angulo Morales, Areej Alwahas, Mariana Elias Lara, Fida Mohammad Thoker, Kasper Johansen, Bernard Ghanem, Fernando T. Maestre, Matthew F. McCabe

2026-05-28视觉语言

生态遥感常面临传感器、尺度和模态不一致,且标注稀缺,现有基础模型多依赖超大数据和固定输入。FLORO用较小但异质的Sentinel、SkySAT、高程与UAV数据做掩码自编码预训练,并通过可用性感知输入兼容缺失模态。PANGAEA冻结评测显示其在分类、分割和回归上迁移稳定,分割平均第二,说明数据多样性可部分替代单纯scaling。

MangaFlow: An End-to-End Agentic Framework for Controllable Story to Manga Generation Figure 1
2026-05-28cs.CV

MangaFlow: An End-to-End Agentic Framework for Controllable Story to Manga Generation

Muyao Wang, Zeke Xie, Yanhao Chen, Lixin Xiu, Hideki Nakayama

2026-05-28生成模型规划控制

针对长篇漫画生成中直接整页合成难以控制分镜布局、角色/场景跨格一致性和文字放置的问题,MangaFlow将故事到漫画拆成规划、角色场景 grounding、显式布局、参考条件渲染、合成与 lettering 等可编辑中间步骤,并用 story section memory 复用人物、场景和物体参考。文中还提出 MangaGen-MetaBench;实验显示其相比直接生成基线在布局遵循和跨面板一致性上更好,同时支持人工精细控制。

DebFilter: Eradicating Biases Stashed in Value Figure 1
2026-05-28cs.CV

DebFilter: Eradicating Biases Stashed in Value

Seung Hyuk Lee, Songkuk Kim

2026-05-28视觉感知

本文关注文本到图像扩散模型中由 CLIP 文本嵌入和不均衡训练数据带来的性别、年龄等社会偏见,尤其是中性职业提示会被引向刻板输出。DebFilter 的核心洞察是去噪误差受跨注意力 value 语义引导影响,可在推理时对指导嵌入切片加入固定偏移来重定向得分景观,无需微调或额外数据。实验显示其能降低多类偏见并保持语义一致性和图像质量,还支持多对象场景中的局部控制。

MeniOmni: A Structured Multimodal Benchmark for Holistic Meniscus Injury Assessment Figure 1
2026-05-28cs.CV

MeniOmni: A Structured Multimodal Benchmark for Holistic Meniscus Injury Assessment

Shurui Xu, Siqi Yang, Weiping Ding, Hui Wang, Mengzhen Fan, Yuyu Sun, Shuyan Li

2026-05-28视觉语言数据集/基准

针对膝关节 MRI 基准多为单模态、粗标签且难评估临床推理的问题,MeniOmni 构建了 746 例多中心半月板数据,联合三平面体数据、年龄/性别/BMI 等临床先验与专家报告,支持 Stoller 细粒度分级和报告生成,并引入风险感知序数评价与 Meni-Score。基线显示加入临床先验可提升分级表现并减少严重误判,说明多模态上下文对更安全的半月板损伤评估有实际价值。

Intra-YOLO: A Small Object Detection Model for Caries and Molar-Incisor Hypomineralization in Intraoral Photography Based on Transfer Learning with Reinforcement Learning Figure 1
2026-05-28cs.CV

Intra-YOLO: A Small Object Detection Model for Caries and Molar-Incisor Hypomineralization in Intraoral Photography Based on Transfer Learning with Reinforcement Learning

Po-Lun Chwang, Po-Yu Chang, Wen-Liang Lin, Tung-Sheng Wu, Min-Ching Wang, Yun-Chien Cheng

2026-05-28视觉感知强化学习

针对口内照片中龋齿与磨牙-切牙低矿化外观相似、病灶极小且受光照/唾液干扰导致诊断不一致的问题,论文提出基于 YOLOX 的 Intra-YOLO,通过增强特征金字塔、注意力、切片推理,以及裁剪图教师到全图学生的蒸馏,并用强化学习选择更有价值的伪框。临床数据上达到 mAP 23.1、mAP50 47.8,优于对比检测器,但总体精度仍偏低。

A novel ordinal multi-view aggregation scheme for oak defoliation Figure 1
2026-05-28cs.CV

A novel ordinal multi-view aggregation scheme for oak defoliation

Francisco Bérchez-Moreno, Ricardo Enrique Hernández-Lambraño, David Guijo-Rubio, Víctor Manuel Vargas, Francisco José Ruiz-Gómez, Juan Carlos Fernández, Pablo González-Moreno

2026-05-28视觉感知

针对传统橡树失叶率人工评估耗时、主观且难以规模化的问题,论文将地面图像的失叶等级建模为有序分类,并提出由北向、南向和树冠视角 CNN 预测组成的同质多视角聚合框架。实验表明,有序方法在 QWK、AMAE 等顺序敏感指标上优于普通名义分类,三视角集成相比单视角和双视角更稳健、整体表现最佳。

No Safe Dose: How Training Data Drives Unsafe Image Generation Figure 1
2026-05-28cs.CV

No Safe Dose: How Training Data Drives Unsafe Image Generation

Felix Friedrich, Lukas Helff, Niharika Hegde, Patrick Schramowski, Kristian Kersting

2026-05-28视觉感知安全鲁棒

针对文生图模型训练语料中不可避免的有害内容,本文用固定架构在不同污染比例与数据规模上做受控训练,隔离数据成分对安全性的影响。结果显示,不安全输出随有害样本比例单调上升,关键变量是比例而非绝对数量;即使零污染仍有16.6%安全下限,SafeCLIP可降至9.6%。过滤几乎不损害FID、CLIPscore和ImageReward,说明数据清洗与文本编码器安全化需配合使用。

SAM-Enhanced Segmentation on Road Datasets: Balancing Critical Classes in Autonomous Driving Figure 1
2026-05-28cs.CV

SAM-Enhanced Segmentation on Road Datasets: Balancing Critical Classes in Autonomous Driving

Toomas Tahves, Mauro Bellone, Junyi Gu, Raivo Sell

2026-05-28视觉感知数据集/基准

针对自动驾驶多模态数据集常缺少像素级标注、且行人/骑行者/标志等关键类别极度稀缺的问题,本文将 ZOD 的检测框经筛选、去重后输入 SAM 生成稠密掩码,并人工整理 2300 帧基准,比较 CLFT 与 DeepLabV3+及稀有类专用模型。结果显示 CLFT-Hybrid 在 ZOD 上最高达 48.1% mIoU,在 Iseauto 上达 77.5% mIoU;但小目标和恶劣天气下的 SAM 标注误差仍是限制。

Which Pretraining Paradigm Better Serves Spatial Intelligence? An Empirical Comparison of Vision-Language and Video Generation Models Figure 1
2026-05-28cs.CV

Which Pretraining Paradigm Better Serves Spatial Intelligence? An Empirical Comparison of Vision-Language and Video Generation Models

Haozhan Shen, Tiancheng Zhao, Kangjia Zhao, Jianwei Yin

2026-05-28视觉语言视觉感知

面向机器人与具身智能中的空间理解需求,论文追问 VLM 与视频生成模型哪类预训练更适合作为空间表征骨干。作者冻结模型、用统一轻量探针比较语义标注、实例分组和 3D 几何预测,尽量隔离下游策略与微调干扰。结果显示 VLM 更擅长语义和实例,VGM 更利于深度、点图和相机运动,简单特征融合即可兼顾两者优势。

CLEAR-NeRF: Collinearity and Local-region Enhanced Accurate 3D Reconstruction in Unbounded Scenes Figure 1
2026-05-28cs.CV

CLEAR-NeRF: Collinearity and Local-region Enhanced Accurate 3D Reconstruction in Unbounded Scenes

Vladislav Polianskii, Elijs Dima, Isabel Salmerón Marazuela, Gergő László Nagy, Sigurdur Sverrisson, Volodya Grancharov

2026-05-28学习理论三维

CLEAR-NeRF针对无人机图像在无界复杂场景中做高精度三维重建时,NeRF易受光照、位姿误差和关注区域不均影响的问题,提出自动局部ROI重建、共线性约束射线采样、深度局部邻域点云提取及几何相关颜色聚合,以提升表面平滑度、抑制伪影并稳定着色。作者在城市场景中以地面LiDAR作真值评测,报告其相较基线NeRF和传统SfM-MVS取得更好的度量精度与重建质量。

ST-ColoNet: Spatio-Temporal Colon Segment Recognition via Hybrid Attention and Edge-Guided Feature Learning Figure 1
2026-05-28cs.CV

ST-ColoNet: Spatio-Temporal Colon Segment Recognition via Hybrid Attention and Edge-Guided Feature Learning

Ziyi Wang, Zhengjie Zhang, Jingsheng Gao, Dahong Qian, Suncheng Xiang

2026-05-28视觉感知

针对结肠镜视频中相邻肠段外观相似、既有方法多按单帧分类且缺少公开视频数据的问题,ST-ColoNet同时利用微观皱襞边缘与宏观时序顺序:ColoHaus以边缘分支和度量学习强化空间特征,Full-Temp用三种注意力模式近似长序列全注意力,并发布ColoSeg数据集。实验在肠段识别上达到81.0%准确率和70.7% F1,优于对比方法,但边缘误检和计算冗余仍被指出。

Revisiting Change Detection Methods for their Application to Serac Fall Time-Lapse Monitoring Figure 1
2026-05-28cs.CV

Revisiting Change Detection Methods for their Application to Serac Fall Time-Lapse Monitoring

Arthur Dérédel, Carlos Crispim-Junior, Pierre Lemaire, Johan Berthet, Laure Tougne Rodet

2026-05-28视觉感知

面向冰塔崩塌等斜坡灾害的低成本时序相机监测,论文指出传统图像相关受雾、光照和形变影响明显,深度监督方法又受稀有事件与标注不均衡限制。作者定义“体积变化检测”子任务,并发布含多站点冰川时序与崩塌标注的 SeracFallDet 基准。实验显示,未专门训练的稠密/半稠密特征匹配泛化更稳,而监督变化检测表现受数据稀缺制约,提示未来更可能依赖匹配与学习结合的混合方案。

Qwen-Image-Bench: From Generation to Creation in Text-to-Image Evaluation Figure 1
2026-05-28cs.CV

Qwen-Image-Bench: From Generation to Creation in Text-to-Image Evaluation

Niantong Li, Guangzheng Hu, Weixu Qiao, Ying Ba, Qichen Hong, Shijun Shen, Jinlin Wang, Fan Zhou, Jianye Kang, Xin Shang, Ziyi He, Wei Wang, Dalin Li, Jiahao Li, Jie Zhang, Kaiyuan Gao, Kun Yan, Lihan Jiang, Ningyuan Tang, Shengming Yin, Tianhe Wu, Xiao Xu, Xiaoyue Chen, Yuxiang Chen, Yan Shu, Yanran Zhang, Yilei Chen, Yixian Xu, Zekai Zhang, Zhendong Wang, Zihao Liu, Zikai Zhou, Hongzhu Shi, Yi Wang, Bing Zhao, Hu Wei, Lin Qu, Chenfei Wu

2026-05-28视觉感知数据集/基准

这篇论文针对现有文生图评测在基础对齐指标上趋于饱和、难以反映专业创作需求的问题,提出 Qwen-Image-Bench:以创作者工作流构建质量、美学、图文对齐、真实世界忠实度和创意生成五层面 taxonomy,配套 1000 个双语提示与由艺术专业标注监督的 Q-Judger。实验称其能更清晰地区分前沿模型,尤其在真实世界忠实度和创意生成维度上提供更有诊断性的优化信号。

VLA-Hijack: A Transferable Patch Attack against Vision-Language-Action Models via Visual Proprioception Hijacking Figure 1
2026-05-28cs.CV

VLA-Hijack: A Transferable Patch Attack against Vision-Language-Action Models via Visual Proprioception Hijacking

Jiyuan Fu, Kaixun Jiang, Jingkai Jia, Zhaoyu Chen, Xueyao Chen, Lingyi Hong, Shuyong Gao, Chenzhi Tan, Dingkang Yang, Wenqiang Zhang

2026-05-28视觉语言视觉感知

针对现有 VLA 对抗贴片易过拟合特定动作头、跨架构迁移差的问题,论文提出从“视觉本体感知”入手:VLA 规划前需先在图像中定位自身机械臂。VLA-Hijack 通过抑制真实机械臂特征并注入贴片作为“幻影身体”,劫持自定位过程。在 OpenVLA、UniVLA、CronusVLA 等 12 个受害模型上,平均失败率达 63.68%,较既有 SOTA 绝对提升约 42.66–45.41 个百分点。

CogPortrait: Fine-Grained Eye-Region Control in Portrait Animation via Hierarchical Agent Planning Figure 1
2026-05-28cs.CV

CogPortrait: Fine-Grained Eye-Region Control in Portrait Animation via Hierarchical Agent Planning

He Feng, Yongjia Ma, Donglin Di, Lei Fan, Tonghua Su

2026-05-28规划控制

本文针对肖像动画中眼部细微动作难以由高层语义直接控制的问题,提出 CogPortrait:先用三个 CoT MLLM 代理将情绪/认知状态规划、检索并约束为面部关键点,再由 DiT 视频扩散模型结合动态 CFG 与 KTO 处理眼区和长尾姿态。作者还构建 EMH 基准及 AU 级指标,实验显示其在眼区控制精度、视觉质量和身份一致性上优于多类基线。

Beyond Surrogate Gradients: Fully Differentiable Token Pruning for Vision-Language Models Figure 1
2026-05-28cs.CV

Beyond Surrogate Gradients: Fully Differentiable Token Pruning for Vision-Language Models

Landi He, Mingde Yao, Shawn Young, Lijian Xu

2026-05-28视觉语言视觉感知优化算法

针对视觉语言模型中大量视觉 token 导致预填充开销高、而现有 Gumbel-Softmax/STE 剪枝存在前向离散选择与反向替代梯度不一致的问题,论文提出 DiffPrune:训练时用 Soft Top-K 与方差保持噪声“信息节流”连续调制 token,推理时再硬阈值删除。实验显示其梯度方向一致性最高提升 28.4 倍,在 10 个 VLM 基准保留 96.5% 精度,同时 LLM prefill 加速 2.85 倍、额外开销 0.69ms。

Stay Fair! Ensuring Group Fairness in Diffusion Models Across Guidance Scales Figure 1
2026-05-28cs.CV

Stay Fair! Ensuring Group Fairness in Diffusion Models Across Guidance Scales

Myeongsoo Kim, Eunji Kim, Minwoo Chae, Sangwoo Mo

2026-05-28生成模型

本文关注扩散模型中被忽视的公平性问题:用户调节 guidance scale 以权衡对齐与多样性时,既有去偏方法常在非固定尺度下失效。作者将总偏差分解为静态模型偏差与随尺度增长的 guidance 偏差,并提出 StayFair:在分类器指导中约束各群体输出分布,在无分类器指导中自适应平移 null embedding。实验显示其在 CelebA、职业提示的 SD1.5/SD3 及已有去偏模型上均能稳定群体比例,同时基本保持图像质量。

VCap: Hypergeometric Rewards for Weak-to-Strong Visual Captioning Figure 1
2026-05-28cs.CV

VCap: Hypergeometric Rewards for Weak-to-Strong Visual Captioning

Xingyu Lu, Jinpeng Wang, Yi-Fan Zhang, Yankai Yang, Yancheng Long, Yiyang Fan, Xuanyu Zheng, Haonan Fan, Kaiyu Jiang, Tianke Zhang, Changyi Liu, Bin Wen, Fan Yang, Tingting Gao, Han Li, Chun Yuan

2026-05-28视觉语言强化学习

这篇论文针对视觉描述中遗漏与幻觉难以被现有RL奖励细粒度约束的问题,提出VCap奖励:把参考描述视为随机“见证者”、视觉输入作为“裁判”,用超几何形式同时刻画完整性与正确性,从而允许弱参考引导更强模型。实验中,VCap训练的8B模型在多项图像和视频描述基准上超过多个开闭源SOTA,人评也显示其事实一致性更好。

Dual-branch Distilled Transformer for Efficient Asymmetric UAV Tracking Figure 1
2026-05-28cs.CV

Dual-branch Distilled Transformer for Efficient Asymmetric UAV Tracking

Hongtao Yang, Bineng Zhong, Qihua Liang, Yaozong Zheng, Xiantao Hu, Yuanliang Xue, Shuxiang Song

2026-05-28视觉感知

面向无人机实时跟踪中轻量化 Transformer 容易削弱目标表征、在遮挡和快速运动下漂移的问题,EATrack 用非对称学生骨干配合教师引导的双分支蒸馏:特征层聚焦目标区域,预测层对齐定位分布,并加入细粒度目标感知与时序适应模块。实验覆盖五个 UAV 基准,显示其在保持较高推理速度的同时取得有竞争力的精度。

Enhancing Ultra-low-field MRI with Segmentation-guided Adversarial Learning Figure 1
2026-05-28cs.CV

Enhancing Ultra-low-field MRI with Segmentation-guided Adversarial Learning

James Grover, Andrew Phair, Michael Ferraro, David E.J. Waddington

2026-05-28视觉感知

针对64 mT便携超低场MRI信噪比低、对比度差而限制诊断的问题,论文将脑组织分割作为解剖先验:用仅由挑战数据生成标签训练的Swin UNETR输出组织logits,再条件化CycleGAN与T-REX两个增强模型并加权融合,合成接近3T风格的多对比度脑MRI。实验称结果在定量和视觉上可与高场扫描接近,但具体增益与各模块贡献文中未充分说明。

Automated Estimation of Impact Time, Impact Location, and Shuttlecock Speed in Badminton Smashes Using Event Cameras Figure 1
2026-05-28cs.CV

Automated Estimation of Impact Time, Impact Location, and Shuttlecock Speed in Badminton Smashes Using Event Cameras

Yudai Washida, Yuto Kase, Kai Ishibe, Ryoma Yasuda, Sakiko Hashimoto

2026-05-28视觉感知

针对羽毛球杀球触拍持续仅约毫秒、传统高速相机/动捕在数据量、时序分辨率和准备成本间取舍的问题,论文用两台同步事件相机在同一试次内自动联估触拍时刻、拍面落点和出球速度:由事件率定位挥拍区间、侧视轨迹拐点定时、后视椭圆拟合定落点。125次试验中可分析124次,时间和速度全估计,落点成功率93.5%,相对高速相机偏差约1.84 ms、数毫米和−1.00 m/s,未见比例偏差。

Geometry-Correct Diffusion Posterior Sampling with Denoiser-Pullback Curvature Guidance and Manifold-Aligned Damping Figure 1
2026-05-28cs.LG

Geometry-Correct Diffusion Posterior Sampling with Denoiser-Pullback Curvature Guidance and Manifold-Aligned Damping

Seunghyeok Shin, Minwoo Kim, Dabin Kim, Hongki Lim

2026-05-28生成模型

本文针对扩散后验采样中数据一致性更新依赖手调标量 guidance、在各向异性曲率和噪声坐标错配下易失稳的问题,提出 CLAMP:在扩散状态坐标中通过去噪器 pullback 构造阻尼 Gauss–Newton 校正,并用与去噪残差对齐的秩一阻尼和保方差 Langevin 传播控制步长。实验显示其在 FFHQ/ImageNet 多类逆问题上保持有竞争力的 PSNR/SSIM/LPIPS 且通常更快,在加速 MRI 上取得对比方法中最佳 PSNR/SSIM。

ABot-OCR Technical Report Figure 1
2026-05-28cs.CV

ABot-OCR Technical Report

Kaitao Jiang, Ruiyan Gong, Xiaolong Cheng, Kangning Niu, Tianlun Li, Mu Xu

2026-05-28视觉感知

面向复杂版面、表格和公式使传统流水线 OCR 易碎的问题,ABot-OCR 将整页图像一次性转为规范 Markdown。其核心在于数据引擎筛查/伪标注高一致性样本,并用三阶段训练与 DHDO 结构约束强化学习同时优化识别准确性和标记合法性。实验显示其在 OmniDocBench v1.5/v1.6 端到端系统中达到 92.81/93.30,并在十种语言上验证泛化能力。

Bridging the Generalization Gap in Adverse Weather Segmentation: A Training Recipe Perspective Figure 1
2026-05-28cs.CV

Bridging the Generalization Gap in Adverse Weather Segmentation: A Training Recipe Perspective

Cong Xu, Pu Luo, Yumei Li, Boyou Xue

2026-05-28视觉感知学习理论

面向自动驾驶等机器人视觉在雨污模糊、黑暗、雪、雾和眩光下语义分割易失效的问题,论文指出瓶颈不是验证集精度而是验证到测试的泛化落差。作者基于 SegMAN-S 设计训练配方:领域自适应初始化、轻量特征重校准、场景均衡采样和按测试分布合成退化增强。最终在 UG2+ 官方测试集达 59.9% mIoU,验证-测试差距降至 6.5 点,优于更大模型的稳定性。

Mags-RL: Wearing Multimodal LLMs a Magnifying Glass via Agentic Reinforcement Learning For Complex Scene Reasoning Figure 1
2026-05-28cs.CV

Mags-RL: Wearing Multimodal LLMs a Magnifying Glass via Agentic Reinforcement Learning For Complex Scene Reasoning

Xuanzhao Dong, Wenhui Zhu, Peijie Qiu, Xiwen Chen, Xiaobing Yu, Xin Li, Zhipeng Wang, Shao Tang, Gen Li, Yujian Xiong, Hao Wang, Yanxi Chen, Prayag Tiwari, Yalin Wang

2026-05-28视觉语言强化学习

针对多模态大模型在目标密集、背景杂乱场景中易漏看细节且依赖人工框提示的问题,Mags-RL把视觉推理改成两轮“先看全局、再放大核查”:模型自主选取关注区域,调用超分辨率裁剪放大,再修正答案,并用GRPO、格式与准确性奖励及课程学习以少量样本训练。实验在VSR、TallyQA、GQA子集上优于近期基线,显示细粒度视觉接地和复杂场景推理有所提升。

ROVER: Routing Object-Centric Visual Evidence for Grounded Multi-Image Reasoning Figure 1
2026-05-28cs.CV

ROVER: Routing Object-Centric Visual Evidence for Grounded Multi-Image Reasoning

Guannan Lv, Ren Nie, Hongjian Dou

2026-05-28视觉感知

针对多图具身/视觉推理中RoI裁剪式证据注入容易丢失全局场景与物体关系、且解码成本随区域增长的问题,ROVER在每次目标定位后插入固定长度的Link/Sift/Weave三元令牌,用对象中心差分注意力和视觉工作空间路由跨物体、跨图像证据。接入Qwen2.5-VL-7B并经SFT到GRPO训练后,在MM-GCoT和VideoEspresso上分别取得答案/定位精度显著提升,并在多类基准上平均优于基座模型4.7%。

Con-DSO: Learning Short-Horizon Consistency Priors for RGB-D Direct Sparse Odometry Figure 1
2026-05-28cs.CV

Con-DSO: Learning Short-Horizon Consistency Priors for RGB-D Direct Sparse Odometry

Haolan Zhang, Thanh Nguyen Canh, Chenghao Li, Ziyan Gao, Xiongwen Jiang, Nak Young Chong

2026-05-28视觉感知

针对 RGB-D 直接视觉里程计在动态物体、遮挡、光照变化和深度噪声下短时光度/几何一致性失效的问题,Con-DSO 学习相邻帧的像素级光度与深度几何不确定性,并转化为关键帧质量先验,用于可靠像素选择和解耦残差加权。其网络仅用 TartanAir 训练,在五个 RGB-D 基准上相对直接法显著降低 ATE,部分动态与真实场景序列降幅达 50%–80%。

Evaluating the Feasibility of Inferring Dietary Behavior Change Receptivity from Egocentric Images of Eating Environment Figure 1
2026-05-28cs.CV

Evaluating the Feasibility of Inferring Dietary Behavior Change Receptivity from Egocentric Images of Eating Environment

Long Li, Yuning Huang, Heather A. Eicher-Miller, J.Graham Thomas, Fengqing Zhu, Edward Sazonov

2026-05-28视觉感知

针对饮食干预中“何时用户愿意改变行为”仍依赖稀疏自报的问题,本文用AIM-2可穿戴第一视角进食图像探索被动推断饮食行为改变接受度。核心思路是将进食片段建模为事件级序列,用预训练CLIP提取语义视觉特征,再由轻量Transformer捕捉时序线索,预测注意、交互能力和动机等自报指标。初步实验相较简单基线有改善,说明进食环境图像可能含有相关信号,但仍属小规模试点,泛化性和增益来源有待更大数据验证。

SEMAGIC: Learning Semantically Consistent Deformable 3D Representations from In-the-Wild Images Figure 1
2026-05-28cs.CV

SEMAGIC: Learning Semantically Consistent Deformable 3D Representations from In-the-Wild Images

Sky Cen, Wufei Ma, Guofeng Zhang, Alan Yuille, Adam Kortylewski

2026-05-28视觉感知三维

SEMAGIC针对现有单视角野外图像可变形3D重建虽几何逼真、但同一模板顶点跨实例语义漂移的问题,将重建视为发现类别级对应关系。方法用类别规范网格和图像条件形变场,并通过顶点索引条件形变与特征一致性损失约束语义对齐,辅以深度和姿态监督稳定几何。在SPair-71k上相较MagicPony的PCK@0.1从37.4提升到52.1,增益14.7,表明其更适合语义对应而非仅做重建。

When Think-with-Image Meets Safety: What Determines Multimodal Jailbreak Robustness? Figure 1
2026-05-28cs.CV

When Think-with-Image Meets Safety: What Determines Multimodal Jailbreak Robustness?

Yuan Tian, Bing Hu, Fang Wu, Xiaomin Li, Binghang Lu, Neil Zhenqiang Gong

2026-05-28视觉语言视觉感知安全鲁棒

本文关注视觉语言模型从直接回答转向“边看图边思考”后,推理流程本身如何影响多模态越狱鲁棒性。作者比较直接回答、文本预填、视觉状态操控与显式图像工具调用,提出“图像工具安全向量”解释工具调用会把隐藏表征推向更易分离、可干预的安全方向。实验显示显式图像工具交互在多模型上使攻击成功率平均相对下降约30%,且增益并非简单来自返回图像内容。

Structure-Guided Visual Perturbation Neutralization for LVLMs Figure 1
2026-05-28cs.CV

Structure-Guided Visual Perturbation Neutralization for LVLMs

Yuanhe Zhang, Xueting Wang, YanBin Ren, Haoran Gao, Xinhan Zheng, Zhenhong Zhou, Fanyu Meng, Li Sun, Sen Su

2026-05-28视觉语言

针对 LVLM 易受像素级对抗扰动诱发越狱、DoS 或误判,而传统去噪/重建防御不匹配跨模态编码且开销较大的问题,论文提出 SIGN:从视觉编码器提取稳定的结构响应先验,并结合局部统计做动态稀疏像素中和。实验覆盖 6 个 LVLM 和 4 类攻击,平均防御成功率超过 87%,仅修改约 0.5% 像素、每图约 0.16 秒,同时基本保持良性任务表现和编码表征相似度。

SIGMA: Semantic-Difference Instruction-Grounding Mask Annotator for Text-Driven Image Manipulation Localization Figure 1
2026-05-28cs.CV

SIGMA: Semantic-Difference Instruction-Grounding Mask Annotator for Text-Driven Image Manipulation Localization

Peiyu Zhuang, Jianquan Yang, Haodong Li, Zhuoying Cai, Ruitao Xie, Jishen Zeng, Baoying Chen, Jiwu Huang, Xiaochun Cao

2026-05-28机器人视觉语言视觉感知

针对文本驱动扩散编辑产生大量伪造、但图像篡改定位缺少像素级训练标注的问题,SIGMA将现有原图—编辑图数据视作潜在监督,核心是把DINOv2语义特征差分与解析后的编辑指令定位先验双向融合,并用修复掩码预训练、VAE噪声校准和EMA自训练适配扩散噪声。在五个基准上较自动掩码生成器平均提升12.20% F1,并从公开编辑语料生成约110万训练样本,使六类检测器跨数据集F1提升18.34%。

Do We Really Need Quantum Machine Learning?: A Multidimensional Empirical Study Figure 1
2026-05-28cs.CV

Do We Really Need Quantum Machine Learning?: A Multidimensional Empirical Study

Sudip Vhaduri, Ryan Gammon, Sayanton Dibbo

2026-05-28视觉感知

本文针对视觉识别中经典 SVM/CNN 在大规模数据和高维特征下的计算瓶颈,系统比较 MNIST 上 CSVM、QSVM、CCNN、QCNN 在准确率、运行时间、参数量和内存上的权衡。结果显示 QSVM 在 1000 样本时约 0.90 对 0.85,但更慢;QCNN 与 CCNN 均超 0.96,却少约 94% 参数、75% 内存,运行开销更高,量子增益机制文中未充分说明。

Rethinking Video-Language Model from the Language Input Perspective Figure 1
2026-05-28cs.CV

Rethinking Video-Language Model from the Language Input Perspective

Xiang Fang, Wanlong Fang, Changshuo Wang, Xiaoye Qu, Daizong Liu

2026-05-28视觉感知

论文指出现有视频语言模型过度依赖预定义文本模板,面对真实用户的同义改写会出现性能波动。作者从语言输入侧重构训练流程,用 LLM 生成词级与结构级正负文本,结合属性化文本推理,并以视频引导的自加权跨模态损失筛选和对齐细粒度语义。方法作为即插即用模块,在视频定位、问答和检索等任务上提升多种 SOTA VLM,但具体增益中 LLM 生成数据与损失设计的贡献边界仍需更多消融说明。

OphIn-500K: Curating Web-Scale Visual Instructions for Scaling Ophthalmic Multimodal Large Language Models Figure 1
2026-05-28cs.CV

OphIn-500K: Curating Web-Scale Visual Instructions for Scaling Ophthalmic Multimodal Large Language Models

Xuanzhao Dong, Wenhui Zhu, Xiwen Chen, Hao Wang, Xin Li, Yujian Xiong, Jiajun Cheng, Jingjing Wang, Xiaobing Yu, Haiyu Wu, Shao Tang, Zhipeng Wang, Langechuan Liu, Shan Lin, Oana Dumitrascu, Yalin Wang

2026-05-28视觉语言

本文针对眼科多模态大模型缺少大规模领域指令数据的问题,提出 OphIn-Engine,从开放眼科视频中抽取图像-转录对,经过视觉线索筛选、指令合成与质控,构建 53.6 万条 OphIn-500K,并训练 OphIn-VL。实验显示其在眼科视觉理解和多轮临床对话上优于现有通用医学及眼科模型,增益可能主要来自 scaling / data。

Decoupled Training with Local Reinforcement Fine-Tuning in Federated Learning Figure 1
2026-05-28cs.CV

Decoupled Training with Local Reinforcement Fine-Tuning in Federated Learning

Yuting Ma, Lechao Cheng, Xiaohua Xu

2026-05-28视觉感知

本文针对联邦视觉语言模型在 Non-IID 与全数据训练中易出现跨客户端优化不一致和客户端内过度专化的问题,提出 FedDTL:将图像编码器留在本地训练、文本编码器放在服务器形成全局语义锚,并用 SFT 预热后接 GRPO 风格强化学习微调以提升泛化。实验覆盖标签偏斜和特征偏移、few-shot 与 full-data 场景,显示其较基线更能兼顾全局适应与泛化。

Towards Unified Vision-Language Models with Incomplete Multi-Modal Inputs Figure 1
2026-05-28cs.CV

Towards Unified Vision-Language Models with Incomplete Multi-Modal Inputs

Xiang Fang, Wanlong Fang, Changshuo Wang, Keke Tang, Daizong Liu, Siyi Wang, Wei Ji

2026-05-28视觉语言视觉感知

论文关注真实应用中视频帧或文本词缺失且两种模态缺失率不一致的问题,指出现有VLM依赖完整视频-文本对,易在检索、问答和时序定位中失效。作者提出统一的完整性网络,通过特征近似、知识蒸馏和多粒度融合补偿不完整输入,并作为即插即用模块接入任务模型;实验称在多种缺失率和基准上均提升性能,但具体增益来源文中未充分说明。

SIGMA: Bridging Structural and Distributional Gaps for Vision Foundation Model Adaptation Figure 1
2026-05-28cs.CV

SIGMA: Bridging Structural and Distributional Gaps for Vision Foundation Model Adaptation

Lingyu Xiong, Jinjin Shi, Xuran Xu, Cong Luo, Runyu Shi, Ying Huang

2026-05-28视觉感知

针对视觉基础模型全量微调成本高、通用 PEFT 难以适配检测/分割/深度等密集预测的问题,SIGMA 将瓶颈从“参数少”推进到“结构与分布是否匹配”:用多尺度深度卷积融合补足空间归纳偏置,并以语义调制对齐下游特征统计。在 DINOv2、SAM、SigLIP2 等骨干上,文中报告其仅训练约 1.72% 骨干参数即可在多项密集任务上优于现有 PEFT 方法。

SmartDirector: Keyframe-Conditioned Cinematic Video Generation with Narrative Pacing Control Figure 1
2026-05-28cs.CV

SmartDirector: Keyframe-Conditioned Cinematic Video Generation with Narrative Pacing Control

Zhida Zhang, Jie Ma, Zhan Peng, Haoxue Wu, Yang Han, Jun Liang, Jie Cao, Jing Li

2026-05-28视觉感知规划控制

现有视频生成多依赖文本或首尾帧,难以像分镜一样精确控制多镜头叙事节奏与时序一致性。SmartDirector以任意关键帧作为叙事锚点,提出两阶段Director-Gen/Director-SR,并用Multi-Chunk VAE规避时序VAE因果约束、配合全时空注意力和关键帧超分恢复细节。实验显示其在单镜头、多镜头和视频延展任务上优于现有方法。

Reflective Dialogue between Teacher and Solver Agents for Video Question Answering Figure 1
2026-05-28cs.CV

Reflective Dialogue between Teacher and Solver Agents for Video Question Answering

Takuya Murakawa, Toru Tamaki

2026-05-28视觉感知优化算法

面向手术、工业等专域第一视角视频问答,论文关注小规模支持集下无法微调时的适应问题。核心做法是先按领域和题型构造教师—求解器反思对话,把正确性反馈与视觉证据作为静态上下文注入推理,而非直接拼接 QA。EgoCross 实验显示其优于零样本和标准 ICL,并在 CVPR 2026 EgoVis 挑战开源赛道获第 3 名。

A Road-Conditioned Traffic Movie Prediction Network with Spatiotemporal and Structure-Consistent Learning Figure 1
2026-05-28cs.CV

A Road-Conditioned Traffic Movie Prediction Network with Spatiotemporal and Structure-Consistent Learning

Joshua Kofi Asamoah, Blessing Agyei Kyem, Armstrong Aboah

2026-05-28视觉感知

针对城市级交通电影预测常被当作图像重建、难以遵守道路拓扑并在跨城场景失效的问题,论文提出 RCSNet,将静态道路占用、方向、连通和交叉口信息作为结构先验,结合多尺度时序编码、方向感知路网-交通融合与逐步生成,并用结构一致性损失约束预测。实验显示,同城在 Berlin、Antwerp、Moscow 上较最强基线平均降低 MAE/MSE/RMSE 11.5%/10.0%/5.1%,跨城到 Chicago、Bangkok 无微调时 RMSE 约降 10.6%/10.5%。

ClothTransformer: Unified Latent-Space Transformers for Scalable Cloth Simulation Figure 1
2026-05-28cs.GR

ClothTransformer: Unified Latent-Space Transformers for Scalable Cloth Simulation

Yu Zhang, Yidi Shao, Wenqi Ouyang, Yushi Lan, Zhexin Liang, Chengrui Wu, Xudong Xu, Xingang Pan

2026-05-28视觉感知

针对神经布料模拟常局限单一场景、计算随网格分辨率增长且碰撞穿透明显的问题,ClothTransformer将布料动力学改写为潜空间自回归序列建模,用跨注意力把任意分辨率网格压缩为固定数量latent token,并结合无穿透多场景数据与可微CCD处理碰撞。文中称单模型覆盖人体服装、机器人抓取和自由落体碰撞,在各场景较既有方法误差降低约4–9倍。

A self-supervised learning approach to deep filter banks for texture recognition Figure 1
2026-05-28cs.CV

A self-supervised learning approach to deep filter banks for texture recognition

Joao B. Florindo, Lucas O.Lyra, Antonio E. Fabris

2026-05-28视觉感知

针对真实纹理识别中标注样本少、类间相似且用 ViT/MAE 预训练开销较大的问题,论文认为纹理判别信息主要是局部的,因而用卷积自编码器做自监督重建/去噪预训练,并将多层深度滤波响应用 Fisher Vector 汇聚成分类特征。实验报告在 FMD、DTD、KTH-TIPS2-b 及巴西植物识别任务上超过多种现有方法,同时保持较低计算复杂度。

Disentangling Adversarial Prompts: A Semantic-Graph Defense for Robust LLM Security Figure 1
2026-05-28cs.CR

Disentangling Adversarial Prompts: A Semantic-Graph Defense for Robust LLM Security

Xiang Fang, Wanlong Fang

2026-05-28安全鲁棒

针对越狱与提示注入利用语义歧义绕过 LLM 安全机制的问题,论文提出 APD:先用互信息约束的语义分解隔离良性/恶意成分,再构建语义图并以谱特征识别意图,最后由轻量 Transformer 分类与净化输入。实验称平均对抗检测准确率达 92.3%、误报约 3.7%,有害输出减少约 85% 以上,延迟约 12 ms;但具体数据构造与真实部署泛化仍需进一步核验。

Turning Video Models into Generalist Robot Policies Figure 1
2026-05-28cs.RO

Turning Video Models into Generalist Robot Policies

Sizhe Lester Li, Evan Kim, Xingjian Bai, Tong Zhao, Tao Pang, Max Simchowitz, Vincent Sitzmann

2026-05-28机器人视觉感知

针对机器人缺少大规模带动作数据、VLA 难以跨任务和跨本体泛化的问题,本文将视频生成模型保留为无动作视觉规划器,另训本体特定的 Jacobian-IDM,把预测视频中的像素运动反演为动作。该解耦设计提升数据效率并便于更换视频骨干或机器人本体;在仿真和真实 Panda、16-DoF Allegro 手任务中表现强于常规 IDM,并展示零样本语言操控和灵巧重定向能力。

Pattern Recognition Tasks with Personalized Federated Learning Figure 1
2026-05-28cs.CV

Pattern Recognition Tasks with Personalized Federated Learning

Md. Arifur Rahman, Isha Das, Mushfiqur Rahman Abir, B. M. Taslimul Haque, Abdullah Al Noman, Abir Ahmed, Md. Jakir Hossen

2026-05-28视觉感知

针对集中式模式识别在隐私、带宽与异构数据上的局限,本文系统比较7种个性化联邦学习算法在MNIST、SignMNIST和Digit5上的表现,并从准确率、精确率、召回率和F1评估其适用性。结果显示APPLE、FedGC和FedProto整体更稳健,但不同算法优势依赖数据场景,具体增益来源仍需更细粒度消融说明。

Residualized Temporal Sparse Autoencoders for Interpreting Diffusion Models Figure 1
2026-05-28cs.CV

Residualized Temporal Sparse Autoencoders for Interpreting Diffusion Models

Calvin Yeung, Prathyush Poduval, Ali Zakeri, Zhuowen Zou, Mohsen Imani

2026-05-28生成模型

本文针对扩散模型内部表示随去噪时间形成轨迹、相邻时刻高度冗余而传统 SAE 多按单时刻分析的问题,提出残差化时间 SAE:先用相邻 timestep 的线性预测分离可预测动态,再让稀疏潜变量建模残差,并可映射回激活空间解释为特征轨迹。作者在 Stable Diffusion 1.5 上通过重建、消融、时空特征分析和定性 steering 显示其能捕捉具时序与空间局部性的语义方向,但实验主要限于单一 U-Net 激活源。

CuriosAI Submission to the CASTLE Challenge at EgoVis 2026 Figure 1
2026-05-28cs.CV

CuriosAI Submission to the CASTLE Challenge at EgoVis 2026

Yuto Kanda, Hayato Tanoue, Takayuki Hori

2026-05-28视觉感知

论文面向 CASTLE 2026 中 600 多小时多视角第一/第三人称视频问答,动机是长程检索与细粒度验证难以由单个 VLM 可靠完成,且易产生幻觉。作者比较 SVA 与时序多模态知识图 TMKG,核心洞察是检索后加入带拒答、定位、证据约束的片段级验证与 LLM 判决,比单纯改检索结构更关键。SVA 准确率 0.50,高于 TMKG 的 0.35,但代价是每题约 28 次模型调用;反幻觉规则未做消融,增益来源仍不完全清楚。

Benchmarking Ultrasound Foundation Models for Fetal Plane Classification Figure 1
2026-05-28eess.IV

Benchmarking Ultrasound Foundation Models for Fetal Plane Classification

Leya Barrientos, Yuexi Du, Nicha C. Dvornek

2026-05-28数据集/基准

针对产科超声胎儿标准切面识别依赖操作者、标注数据难获取且跨人群泛化不稳的问题,本文系统比较4个超声基础模型与自然图像预训练CNN/ViT,并区分全量微调和冻结编码器线性探测。结果显示,FetalCLIP在线性探测最优(域内F1 0.9261、非域F1 0.9731),USFM在全量微调最优(0.9476、0.9515);MOFO和UltraSAM退化明显,说明预训练目标与可迁移性差异比“是否为超声模型”本身更关键。

Can Segmentation Models Understand the World? Towards Proactive Affordance Reasoning via Visual Chain-of-Thought Figure 1
2026-05-28cs.CV

Can Segmentation Models Understand the World? Towards Proactive Affordance Reasoning via Visual Chain-of-Thought

Yuchen Guo, Junli Gong, Hongmin Cai, Yiu-ming Cheung, Weifeng Su

2026-05-28视觉感知强化学习

论文针对现有语言驱动分割过度依赖“目标已被指明”的设定,指出机器人场景中指令常只是高层意图。作者提出 SegWorld,先主动观察场景并形成语言化上下文,再用多级视觉 CoT 从意图推到对象、动作、可交互部件和掩码,并构建 Intent2Part 评测。实验显示其在直接指代指令上接近强基线,在意图级部件分割上有明显提升。

AndroidDaily: A Verifiable Benchmark for Mobile GUI Agents on Real-World Closed-Source Applications Figure 1
2026-05-28cs.CV

AndroidDaily: A Verifiable Benchmark for Mobile GUI Agents on Real-World Closed-Source Applications

Yifan Sui, Xin Huang, Hongbing Li, Fang Xu, Jiahe Lv, Haolong Yan, Yeqing Shen, Litao Liu, Zhimin Fan, Ziyang Meng, Jia Wang, Junbo Qi, Kaijun Tan, Zheng Ge, Xiangyu Zhang, Daxin Jiang, Osamu Yoshie

2026-05-28强化学习数据集/基准

针对现有移动 GUI Agent 评测多依赖模拟或开源应用、难覆盖真实闭源日常场景的问题,论文提出 AndroidDaily:在 94 个高频安卓应用上构建 350 个真实任务,并用 GRADE 以操作义务、输出质量和负面约束三类可观察准则进行过程级自动验证。实验中 GRADE 与人工一致率为 87.37%,最强模型成功率仅 62.0%,暴露出跨应用、多约束任务中的时延错位、记忆循环和协议退化等瓶颈。

Reading or Guessing? Visual Grounding Failures of Vision-Language Models for OCR in Ancient Greek Editions Figure 1
2026-05-28cs.CL

Reading or Guessing? Visual Grounding Failures of Vision-Language Models for OCR in Ancient Greek Editions

Antonia Karamolegkou, Nicolas Angleraud, Benoît Sagot, Thibault Clérice

2026-05-28视觉语言视觉感知

本文关注VLM用于低资源古希腊校勘本OCR时是否真在“看字”而非凭语言先验补全。作者比较5个开源VLM与传统OCR,并用受控字符扰动、条件/无图解码分布的token级grounding分析错误来源。结果显示,VLM错误常保持流畅希腊词形,扰动后更偏离真实图像;但先验依赖具模型差异,OlmOCR最明显,通用VLM即使出错仍较依赖图像,解码期约束难以稳定修复。

Mahalanobis PatchCore: Covariance-Aware and Streaming-Compatible Industrial Anomaly Detection Figure 1
2026-05-28cs.CV

Mahalanobis PatchCore: Covariance-Aware and Streaming-Compatible Industrial Anomaly Detection

Niccolò Ferrari, Oligert Osmani, Evelina Lamma

2026-05-28视觉感知

针对工业异常检测中缺陷样本稀少、PatchCore 欧氏检索忽略特征相关性且离线构建内存占用高的问题,论文提出 MH-PatchCore:在降维空间估计正则化协方差并白化嵌入,用等价欧氏近邻实现 Mahalanobis 检索,同时以可重迭代的流式流程构建记忆库。结果显示其在 MVTec AD 上基本保持离线 PatchCore 图像级性能,峰值内存由 5.41GB 降至 2.78GB,并将三类工业数据平均 image AUROC 从 0.981 提升到 0.986。

Bounded-Compute Multimodal Regression for Product-Rating Prediction Figure 1
2026-05-28cs.CV

Bounded-Compute Multimodal Regression for Product-Rating Prediction

William Leach, Ru He, Sizhuo Ma, Yizhen Jia, Min Cao, Jian Wang, Rick Cao

2026-05-28视觉语言学习理论

论文针对商品评分这类低延迟标量预测,指出生成式 VLM 的自回归解码和动态视觉处理会带来不稳定计算开销。方法将 SmolVLM2 改为固定 384×384 输入、截断元数据,并用池化 decoder 状态接两层 MLP 回归头。实验显示静态全局图像略优于动态 tiling,16M 数据显著提升相关性;官方评测达 0.39 PLCC、0.40 CES,增益可能主要来自 scaling / data。

Explicit Critic Guidance for Aligning Diffusion Models Figure 1
2026-05-28cs.LG

Explicit Critic Guidance for Aligning Diffusion Models

Zhengyang Liang, Qihang Zhang, Ceyuan Yang

2026-05-28生成模型

论文针对扩散模型后训练中奖励只在最终图像上给出、难以沿去噪轨迹细粒度归因,以及像素空间 critic 不稳定且开销高的问题,提出在噪声潜变量上学习状态对齐的 actor-critic:让扩散骨干兼作按时间步条件化的价值函数,并用价值预训练和多奖励价值头提升稳定性、缓解 reward hacking。实验显示该方法在 UNet 与 DiT 骨干、单奖励和多奖励设置下均优于 group-relative RL 与既有 actor-critic 基线,推理时利用 critic 梯度 steering 还能进一步提升生成质量。

Asynchronous Remote Sensing Time-Series Fusion for Cloud Removal and Anytime Reconstruction Figure 1
2026-05-28cs.CV

Asynchronous Remote Sensing Time-Series Fusion for Cloud Removal and Anytime Reconstruction

Forouzan Fallah, Chia Yu Hsu, Wenwen Li, Anna Liljedahl, Yezhou Yang

2026-05-28三维

针对云遮挡导致 Sentinel-2 光学时序缺失、且 Sentinel-1/2 采集时间不对齐的问题,论文提出 AGFlow:用时间戳条件的内部对齐和时空生成式 flow matching 融合 SAR 与带云光学序列,并支持任意时间查询生成无云 S2。RESTORE-DiT 协议下,完整缺帧重建的 MAE/RMSE 较基线降低约 16–19%,消融显示时间对齐对光谱一致性贡献明显。

Structure over Pixels: Learning Variable-Length Visual Programs Figure 1
2026-05-28cs.CV

Structure over Pixels: Learning Variable-Length Visual Programs

Piotr Wyrwiński, Kacper Dobek, Krzysztof Krawiec

2026-05-28视觉感知

针对离散视觉 tokenizer 常用固定码长、且像素重建易把预算耗在纹理而非结构上的问题,论文提出 STROP:用生成器/解释器 Transformer 与 VQ 码本把图像编码为可变长度“视觉程序”,并通过 DINOv3 特征蒸馏和局部率失真探针训练长度头,单次前向即可按场景复杂度选择前缀。实验显示码长随复杂度增长,在率质权衡、密集预测迁移以及码本复用/空间归因中呈现一定组合结构迹象。

Tensor Memory: Fixed-Size Recurrent State for Long-Horizon Transformers Figure 1
2026-05-28cs.CV

Tensor Memory: Fixed-Size Recurrent State for Long-Horizon Transformers

Kabir Swain, Sijie Han, Daniel Karl I. Weidele, Mauro Martino, Antonio Torralba

2026-05-28视觉感知

针对长视频/长序列中 KV 缓存随长度增长、且 Transformer 缺少可持续空间状态的问题,论文提出 Tensor Memory:在模块内维护固定大小 3D 体素记忆,令 token 以连续坐标高斯写入,经轻量 ConvLSTM 式局部更新,再连续采样读回并门控融合。实验覆盖语言、图像重建、UCF-101 视频和诊断任务,显示长上下文语言增益最大,图像与视频有较小但一致提升;但规模化时密集体素更新成本仍是限制。

On the Equivariant Learning of the $Q$-tensor Order Parameter Figure 1
2026-05-28cs.CV

On the Equivariant Learning of the $Q$-tensor Order Parameter

Julia Navarro, Mark Wilkinson

2026-05-28视觉感知

该文针对从微观纹理预测二维向列液晶 Q-tensor 时旋转对称性难以靠普通网络稳定学习的问题,构造了对循环群 Ck 等变的神经网络,用近似旋转的置换表示、权重共享和等变激活硬编码物理约束。实验显示模型在单精度误差内满足 Q-tensor 等变性,相比参数近似匹配的非等变模型及数据增强基线 RMSE 更低,并对未见缺陷构型更稳健;但数据为合成纹理,真实场景适用性文中仍有限。

Not All NVFP4 QAT Recipes Are Equal: How Architecture and Scale Shape Model Quality for Anomaly Segmentation Figure 1
2026-05-28cs.CV

Not All NVFP4 QAT Recipes Are Equal: How Architecture and Scale Shape Model Quality for Anomaly Segmentation

Zijian Du, Oleg Rybakov

2026-05-28视觉感知

面向高召回、低延迟的异常分割,论文系统考察脑肿瘤 MRI 任务中架构、模型规模与 NVFP4 QAT 配方的耦合影响。核心洞察是量化鲁棒性主要由架构决定:Swin Transformer 在各尺度 AUPRC 最高且对配方不敏感;高级配方可缓解小模型注意力离散化和大 CNN 梯度量化噪声,5 折患者级交叉验证支持该排序。

Hallucination Behavior in Multimodal LLMs Across Agricultural Image Interpretation and Generation Tasks Figure 1
2026-05-28cs.CV

Hallucination Behavior in Multimodal LLMs Across Agricultural Image Interpretation and Generation Tasks

Partho Ghose, Al Bashir, Prem Raj, Azlan Zahid

2026-05-28视觉语言视觉感知

面向农业影像中LLM可能误导病虫害诊断和管理决策的问题,论文把幻觉同时放到图像解读与文本生成图像两条链路中评估,按生物一致性、情境准确性和农艺可行性归类错误。结果显示多模态模型零样本识别仅约63–75%,少样本最高86.8%但仍有漏检误检;生成端在宽松提示下最高91%场景不符合生物常识,说明当前模型缺少可靠的领域 grounding。

ForestHG-Trace: Traceable Long-Horizon Ecological Reasoning over Large-Scale Forest Scenes Figure 1
2026-05-28cs.CV

ForestHG-Trace: Traceable Long-Horizon Ecological Reasoning over Large-Scale Forest Scenes

Zihang Cheng, Duanchu Wang, Cheng Li, Jing Huang, Huanzhao Fu, Di Wang

2026-05-28视觉感知

论文针对现有遥感问答多依赖视觉嵌入直接生成、难以支撑森林生态中多步计算与可追溯验证的问题,提出 ForestHG-Trace:用多模态场景超图表示树木、空间单元和高阶生态关系,并由工具增强 LLM 生成可执行程序完成过滤、邻域扩展、聚合与比较。作者同时构建 ForestTraceQA,实验显示超图建模结合确定性执行较单步和传统场景图代理更适合长程生态推理,且结构超边是主要性能支撑。

What-If World: A Causal Benchmark for General World Models in Embodied Scenarios Figure 1
2026-05-28cs.CV

What-If World: A Causal Benchmark for General World Models in Embodied Scenarios

Kunlin Cai, Rui Song, Jinghuai Zhang, Kaiyuan Zhang, Pranav Bodapati, Alicia Yu, Fnu Suya, Mohammad Rostami, Jiaqi Ma, Yuan Tian

2026-05-28强化学习数据集/基准

面向自动驾驶和机器人操作中的视频世界模型,论文指出单段视频逼真并不能证明模型会随动作或物理条件变化而正确改变输出。What-If World用nuScenes/DROID真实帧构造319组只改一个物理变量的对比提示,并以APEO评估遵循、物理、环境保持和结果差异。九个先进模型成对得分均低于52%,开源约28%,暴露出现有逐视频评测难发现的“对比瓶颈”。

Uni-LaViRA: Language-Vision-Robot Actions Translation for Unified Embodied Navigation Figure 1
2026-05-28cs.RO

Uni-LaViRA: Language-Vision-Robot Actions Translation for Unified Embodied Navigation

Hongyu Ding, Sizhuo Zhang, Ziming Xu, Jinwen Guo, Hongxiu Liu, Xingzhi Cheng, Zixuan Chen, Haifei Qi, Duo Wang, Hao Xu, Jieqi Shi, Yifan Zhang, Jing Huo, Jian Cheng, Yang Gao, Jiebo Luo

2026-05-28机器人视觉感知

针对具身导航依赖大规模机器人轨迹训练、跨任务跨本体泛化成本高的问题,Uni-LaViRA将导航动作结构化为语言方向指令与像素级视觉目标,认为其落在MLLM自然输出流形内,可零训练推理;并加入TODO List Memory缓解长程遗忘、Second Chance Backtrack利用失败轨迹重规划。实验在VLN-CE、ObjectNav、EQA、Aerial-VLN及四类真实机器人上零样本运行,R2R成功率60.7%、RxR 51.3%、HM3D-v2 77.7%、OpenUAV 40.0%,接近或超过部分训练型导航基础模型。

Clinical Validation of the Melanoscope AI Mobile Dermoscopy Clinical Decision Support System Figure 1
2026-05-28cs.CV

Clinical Validation of the Melanoscope AI Mobile Dermoscopy Clinical Decision Support System

Elena Sergeevna Kozachok, Sergey Sergeevich Seregin

2026-05-28视觉感知

针对俄罗斯地区皮肤科资源不足、皮肤病变 AI 筛查缺乏可解释性与标准化转诊的问题,本文验证 Melanoscope AI 移动皮肤镜 CDSS:采用两阶段级联分类,结合注意力/Grad-CAM 热图并用 IoU 量化与专家标注一致性,同时给出三档风险分流阈值。在 176 例前瞻性单中心筛查中,系统与专家一致率 88.6%,5 例恶性病变无漏诊、特异性 88.3%;但恶性样本很少,结论仍属初步验证。

Representation-Conditioned Diffusion Models for Guided Training Data Generation Figure 1
2026-05-28cs.CV

Representation-Conditioned Diffusion Models for Guided Training Data Generation

Nithesh Chandher Karthikeyan, Jonas Unger, Gabriel Eilertsen

2026-05-28生成模型

针对真实图像数据获取、标注与共享成本高的问题,本文用DINOv2/DINOv3/CLIP表征作为条件来训练潜扩散模型,替代仅按类别条件生成训练集,并用下游ResNet-50分类验证数据价值。在ImageNet100上,表征条件生成较类别条件Top-1提升10.76个百分点;扩大合成集规模后还比真实数据训练高2.0个百分点,同时可用于增强和基于表征空间过滤样本。

Diffusion-Based Ukrainian Handwritten Text Generation with Cross-Domain Style Transfer Figure 1
2026-05-28cs.CV

Diffusion-Based Ukrainian Handwritten Text Generation with Cross-Domain Style Transfer

Andrii Ahitoliev, Pavlo Berezin

2026-05-28生成模型

针对乌克兰西里尔手写生成缺少作者标注数据与跨文字迁移证据的问题,论文构建了12.6万词、308名作者的数据集,并在不改结构下重训DiffusionPen,检验拉丁到西里尔的少样式扩散迁移。结果显示生成词可读且风格一致,FID 23.09、CER 16.0%,OOV与稀有字母表现说明并非简单记忆;消融表明主要增益很大程度来自更大数据量与更准的连通域分词。

Comparative Analysis of Liquid Neural Networks and LSTM for Sequential Pattern Recognition: Robustness, Efficiency, and Clinical Utility Figure 1
2026-05-28cs.LG

Comparative Analysis of Liquid Neural Networks and LSTM for Sequential Pattern Recognition: Robustness, Efficiency, and Clinical Utility

Ye Kyaw Thu, Thazin Myint Oo, Thepchai Supnithi

2026-05-28视觉感知安全鲁棒

针对 LSTM 将时间离散化、难处理异步传感和临床缺失数据的问题,论文用闭式连续时间 LNN/CfC 与 LSTM 在 N-MNIST、QuickDraw、IAM 和 PhysioNet Sepsis 上做同条件对比,并加入 temporal dropout 压力测试。结果显示 LNN 在稀疏/不规则序列中更稳健且参数更省,如 N-MNIST 丢 30% 事件仍领先约 14%,败血症预测假阳性显著更少;但高风险临床结论仍需更多数据集和重复实验验证。

AdaMerge: Salience-Aware Adaptive Token Merging for Training-Free Acceleration of Vision Transformers Figure 1
2026-05-28cs.CV

AdaMerge: Salience-Aware Adaptive Token Merging for Training-Free Acceleration of Vision Transformers

Semi Lee, Hyejin Go, Hyesong Choi

2026-05-28视觉感知

本文针对 ViT 自注意力计算随 token 数二次增长、现有 ToMe 类无训练合并默认“token 等价”而易损失高显著区域的问题,提出 AdaMerge:用特征亲和中心性估计 token 显著性并加权匹配/聚合,同时依据预统计的层级相似度与输入冗余自适应决定各层合并强度。在 ImageNet-1k 的 ViT-B/16 上,AdaMerge 在相同 FLOPs 下优于 ToMe、PiToMe 和 DSM,极端约 13.4G FLOPs 时 Top-1 仅降 1.06%。

Beyond Motion Primitives: Behavioral Activity Recognition from Head-Mounted IMU Figure 1
2026-05-28cs.CV

Beyond Motion Primitives: Behavioral Activity Recognition from Head-Mounted IMU

Chung-Ta Huang, Leopold Das, Jeffrey Zhou, Faizaan Siddique, Julia Seungjoo Baek, Serena Liu, Andrew Rusli, Todd Y. Zhou, Freddy Yu, Sinclair Hansen, Ziling Hu, Arnav Sharma, Mengyu Wang

2026-05-28视觉感知

本文面向AR眼镜的持续情境感知,指出头戴IMU若只识别走/站等运动基元难以支持主动辅助。作者在Ego4D上构建16万样本、含人工质检的行为级标签,并提出结合局部CNN-GRU、时序Transformer和场景门控的HiT-HAR。结果显示其在五类行为与八类场景识别上优于IMU2CLIP和微调Mantis;分析还表明可观测性存在边界:行走最稳,物体转移和任务操作依赖时间上下文,搜索仍与静止等类别重叠。

D$^2$Turb: Depth-Aware Simulation and Decoupled Learning for Single-Frame Atmospheric Turbulence Mitigation Figure 1
2026-05-28cs.CV

D$^2$Turb: Depth-Aware Simulation and Decoupled Learning for Single-Frame Atmospheric Turbulence Mitigation

Zixiao Hu, Tianyu Li, Guoqing Wang, Wei Li, Guoguo Xin, Xun Liu, Peng Wang

2026-05-28视觉感知

该文面向单帧远距离成像中的大气湍流退化,指出现有端到端方法常把空间变化模糊与非刚性形变混在一起学习,导致清晰度与几何校正难兼顾。D²Turb用深度感知湍流合成引入物理一致的深度相关退化和tilt监督,并将恢复解耦为纹理去模糊与几何矫正,再通过ASPI注入结构先验引导稠密反扭曲。实验显示其在合成和真实数据上均优于既有方法,合成基准PSNR达25.72 dB且LPIPS相对降低19%。

Generic Interpretation Approach for Transformer Models Incorporating Heterogenous Attention Structures Figure 1
2026-05-28cs.CV

Generic Interpretation Approach for Transformer Models Incorporating Heterogenous Attention Structures

Yongjin Cui, Xiaohui Fan, Huajun Chen

2026-05-28视觉感知

面向多模态与检测 Transformer 中跨注意力等异构注意力难以解释的问题,论文将注意力按信息来源划分为同源与异构,并提出结合梯度校正、多头聚合和信息流传播的通用解释框架。方法在 DETR、LXMERT 等图像/图文模型上与 GAE、ODAM 对比,据称取得最佳解释效果,并能支持语义与逻辑层面的机制分析,但具体增益来源文中未充分说明。

NL-MambaXCT: Self-Supervised Nested-Learning Mamba for Nomex Honeycomb X-ray CT Defect Classification Figure 1
2026-05-28eess.IV

NL-MambaXCT: Self-Supervised Nested-Learning Mamba for Nomex Honeycomb X-ray CT Defect Classification

Ghaleb Aldoboni, Lobna Nassar, Fakhri Karray, Reem Alshamsi

2026-05-28视觉感知

面向航空 Nomex 蜂窝结构 XCT 检测中人工判读重、标注少且噪声大的问题,论文提出 NL-MambaXCT:先用近 2 万张未标注切片做掩码自监督预训练,再以 RegNet+Mamba 编码器和嵌套学习的快/慢参数动态提升小样本鲁棒性。其在 2000 张重标注切片上达到 96.91% 准确率、96.8% macro-F1,较 CNN、注意力和单时间尺度 Mamba 基线提升 3.11–10.31 个百分点。

Fine-Tuning Vision-Language Models for Understanding Current Damage and Scoring Priority with Quality Guard Agent Figure 1
2026-05-28cs.CV

Fine-Tuning Vision-Language Models for Understanding Current Damage and Scoring Priority with Quality Guard Agent

Takato Yasuno

2026-05-28视觉语言视觉感知

针对日本桥梁定期目视检查中评级主观差异大、资深工程师减少的问题,论文将 LLaVA-1.5-7B 以 QLoRA 适配到日文桥梁损伤图文记录,并用规则引擎给出五级维修优先级,再由 Swallow-8B 质量守卫拦截低质描述。实验显示 2k 样本已接近最优验证损失,语义相似度在 3k 达峰,4k 反降;批处理与编译后推理约 10.06 秒/图。

From Affect to Complex Behavior: Advancing Multimodal Human-Centered AI at the 10th ABAW Workshop & Competition Figure 1
2026-05-28cs.CV

From Affect to Complex Behavior: Advancing Multimodal Human-Centered AI at the 10th ABAW Workshop & Competition

Dimitrios Kollias, Panagiotis Tzirakis, Alan Cowen, Stefanos Zafeiriou, Irene Kotsia, Eric Granger, Marco Pedersoli, Simon Bacon, Jens Madsen, Soufiane Belharbi, Muhammad Haseeb Aslam, Chunchang Shao, Guanyu Hu

2026-05-28视觉语言

本文动机是推动真实开放环境中的人类情感与复杂行为理解,服务医疗、人机交互、机器人等多模态人本AI。核心洞察是ABAW已从表情、效价-唤醒、AU等孤立情感识别,扩展到情绪模仿、犹豫/矛盾和细粒度暴力等时序社会行为任务,并以竞赛加论文轨道组织基准。主要结果是给出CVPR 2026第10届ABAW的六项挑战、数据与评测框架;文中未充分说明单一方法的量化增益。

RE-TRIANGLE: Does TRIANGLE Enable Multimodal Alignment Beyond Cosine Similarity in Retrieval? Figure 1
2026-05-28cs.IR

RE-TRIANGLE: Does TRIANGLE Enable Multimodal Alignment Beyond Cosine Similarity in Retrieval?

Arijit Ghosh, Aritra Bandyopadhyay, Chiranjeev Bindra, Jingfen Qiao

2026-05-28视觉语言

本文动机是检验多模态检索中传统以文本为锚的两两余弦对齐是否忽略音频—视频等外围模态一致性。作者复现实验评估 TRIANGLE 的三模态几何目标,即最小化单位超球面上文本、视频、音频嵌入形成的三角形面积。结果显示其在多数据集零样本检索中相对 VAST 有最高约 8.7 点 R@1 增益,但收益强依赖领域;从零训练未能复现,且与 DTM 联合优化存在不稳定性。

OralAgent: Integrating Reasoning, Tools, and Knowledge for Interactive Dental Image Analysis Figure 1
2026-05-28cs.CL

OralAgent: Integrating Reasoning, Tools, and Knowledge for Interactive Dental Image Analysis

Jing Hao, Siyuan Dai, Yongxin Zhang, Yuci Liang, Jiamin Wu, Jiahao Bao, Yuxuan Fan, Zanting Ye, Yanpeng Sun, Xinyu Zhang, Ming Hu, Liang Zhan, James Kit Hon Tsoi, Linlin Shen, Junjun He, Kuo Feng Hung

2026-05-28视觉感知

针对牙科 AI 多为单模态、单任务工具且临床流程中缺乏透明推理的问题,OralAgent 将 ReAct 式规划、多模态理解、22 个牙科视觉工具与基于 368 本教材的 RAG 结合,并构建 OralCorpus 与 OralQA-ZH。实验显示其在 MMOral-Uni、MMOral-OPG 分别达 57.70、61.00,较 OralGPT-Omni 提升 5.86 和 15.69 分,RAG 在中文口腔知识问答中也带来稳定增益。

2026-05-27

141 篇
G3T Up! Gravity Aligned Coordinate Frames Simplify Pointmap Processing Figure 1
2026-05-27cs.CV

G3T Up! Gravity Aligned Coordinate Frames Simplify Pointmap Processing

Bharath Raj Nagoor Kani, Noah Snavely

Cornell University

2026-05-27强化学习三维

论文指出,VGGT 等前馈三维重建把点图放在首帧相机坐标系中,会引入任意俯仰/滚转并增加多视图对齐难度。G3T 的核心洞察是改用重力对齐的直立坐标系,使不同视角共享竖直轴,将子图间旋转约束到绕竖直轴的 1 自由度;在此基础上微调 VGGT,并构建 G3T-Long 增量重建流程。实验显示其相机到重力姿态、直立点图和长序列重建精度优于基线、漂移更低,但模糊结构场景仍可能失败。

SpatialBench: Is Your Spatial Foundation Model an All-Round Player? Figure 1
2026-05-27cs.CV

SpatialBench: Is Your Spatial Foundation Model an All-Round Player?

Haosong Peng, Hao Li, Jiaqi Chen, Yuhao Pan, Runmao Yao, Yalun Dai, Fushuo Huo, Fangzhou Hong, Zhaoxi Chen, Haozhao Wang, Dingwen Zhang, Ziwei Liu, Wenchao Xu

Hong Kong University of Science and Technology, Nanyang Technological University, Northwestern Polytechnical University, Southeast University, Huazhong University of Science and Technology

2026-05-27优化算法学习理论数据集/基准安全鲁棒

针对空间基础模型常在窄数据、非统一采样下评测而难以判断真实泛化的问题,SpatialBench构建了覆盖19个数据集、546个场景、6类范式和4种输入密度的确定性基准,并评测41个模型。结果显示现有模型尚非“全能”:全局上下文注意力精度最高,有限记忆方法更能扩展长序列;具身、第一视角和腕视角仍是主要失效域,数据质量与域对齐比单纯扩大数据更关键,并据此提出DA-Next-5M与DA-Next基线。

LocateAnything: Fast and High-Quality Vision-Language Grounding with Parallel Box Decoding Figure 1
2026-05-27cs.CV

LocateAnything: Fast and High-Quality Vision-Language Grounding with Parallel Box Decoding

Shihao Wang, Shilong Liu, Yuanguo Kuang, Xinyu Wei, Yangzhou Liu, Zhiqi Li, Yunze Man, Guo Chen, Andrew Tao, Guilin Liu, Jan Kautz, Lei Zhang, Zhiding Yu

2026-05-27视觉语言视觉感知生成模型学习理论数据集/基准

该文针对VLM将检测/指代表达成逐token坐标生成所带来的几何不一致与推理瓶颈,提出LocateAnything的并行框解码:把框或点作为原子结构一次预测,并配合快、慢、混合三种解码策略。作者还构建含1.38亿查询的大规模数据集;实验显示在布局、长尾检测、GUI等基准上提升高IoU定位质量,解码吞吐最高约2.5倍,但部分增益可能主要来自scaling/data。

Feedforward 3D Editing Learns from Semantic-Part Transformation Figure 1
2026-05-27cs.CV

Feedforward 3D Editing Learns from Semantic-Part Transformation

Jiawei Weng, Saining Zhang, Zhenxin Diao, Peishuo Li, Henghaofan Zhang, Junhao Chen, Hao Zhao

Nanyang Technological University, Tsinghua University, Nanyang Technological University Singapore, Tsinghua University China

2026-05-27视觉感知生成模型规划控制学习理论数据集/基准

针对前馈式 3D 编辑缺少高质量成对监督、难以同时保证局部可控和未编辑区域保持的问题,本文提出从语义部件变换中学习的思路,构建含 10 万余对、覆盖七类编辑的 Pxform,并训练注入源潜变量控制的 PartFlow。实验显示,语义部件级数据显著改善几何与外观编辑,在 Uni3DEdit-Bench 等基准达到 SOTA;但增益可能主要来自高质量数据与规模化监督。

When Eyes Betray AI: Social Gaze Consistency as a Semantic Cue for AI-Generated Image Detection Figure 1
2026-05-27cs.CV

When Eyes Betray AI: Social Gaze Consistency as a Semantic Cue for AI-Generated Image Detection

Kim Jihyeon, Sohee Kim, Soosan Lee, Souhwan Jung, James Matthew Rehg, Hyesong Choi

School of Computer Engineering, Hoseo University, School of Electronic Engineering, Soongsil University, School of Computer Science, University of Illinois at Urbana-Champaign

2026-05-27视觉语言视觉感知生成模型强化学习规划控制

针对新版生成/局部编辑图像已削弱像素、频域等低层伪造痕迹的问题,论文提出把多人互动中的视线方向、头眼对齐和瞳孔位置一致性作为高层语义检测线索,并用成对眼区编辑数据与固定五段推理骨架的组合 caption 监督训练检测器。结果显示该线索可跨视觉语言与纯视觉骨干生效,FakeVLM 在 COCOAI Interaction/Person 上平衡准确率分别提升 3.7/1.3 个百分点,且真假召回同时上升。

Towards Controllable Image Generation through Representation-Conditioned Diffusion Models Figure 1
2026-05-27cs.CV

Towards Controllable Image Generation through Representation-Conditioned Diffusion Models

Nithesh Chandher Karthikeyan, Jonas Unger, Gabriel Eilertsen

2026-05-27视觉感知生成模型规划控制数据集/基准

本文针对扩散模型缺少类似 GAN 的可编辑潜空间、依赖文本或语义标注难以精细控制的问题,尝试用预训练自监督 DINO 表征来条件化 LDM,将图像表征空间作为控制空间。作者在 LSUN Churches 与 CelebA 上做扰动、插值和语义方向实验,显示该空间在较大扰动下仍保持生成质量,插值更平滑,并具一定解耦性;但工作偏初步,定量指标与增益来源文中未充分说明。

PARE: Pruning and Adaptive Routing for Efficient Video Generation Figure 1
2026-05-27cs.CV

PARE: Pruning and Adaptive Routing for Efficient Video Generation

Yutong Wang, Yunke Wang, Tianfan Xue, Yu Qiao, Yaohui Wang, Xinyuan Chen, Chang Xu

The University of Sydney 2 Shanghai AI Laboratory 3 The Chinese University of Hong Kong

2026-05-27视觉感知生成模型三维

视频 DiT 推理成本高,静态剪枝难以随输入与去噪阶段调整计算。PARE 的关键洞察是注意力头存在空间/时间分工且时间头易被幅值剪枝误删,因此采用时空感知宽度剪枝,并用轻量路由器按 timestep 与视觉内容动态选择执行块。文中在 Wan2.1-14B 的图生视频和文生视频上显示,PARE 可约减半单步计算且基本保持 VBench 质量,并可与步数蒸馏叠加加速。

EdgeFlow: Edge-Map Augmented VLM-Based Flowchart Processing for Industrial Requirements Engineering Figure 1
2026-05-27cs.SE

EdgeFlow: Edge-Map Augmented VLM-Based Flowchart Processing for Industrial Requirements Engineering

Zhifei Dou, Shabnam Hassani, Ou Wei

2026-05-27视觉语言生成模型

工业需求文档中的流程图常以静态图片存在,阻碍可追踪性、影响分析和基于模型的测试,且现有 VLM 容易漏掉连线方向等拓扑细节。EdgeFlow 的核心做法是在原图外加入确定性 Canny 边缘图作为结构先验,无需标注训练或微调,将流程图转为 Mermaid。在 52 个工业流程图上,节点、边和路径 F1 分别提升 17.39、16.94 和 11.06 个百分点;但在合成公开集上无显著增益,说明泛化与基准多样性仍需进一步验证。

Q-GeoMem: Question-Guided Geometric Memory for Video Spatial Reasoning Figure 1
2026-05-27cs.CV

Q-GeoMem: Question-Guided Geometric Memory for Video Spatial Reasoning

Xianqiang Gao, Qizhi Chen, Delin Qu, Haoming Song, Zhigang Wang, Bin Zhao, Dong Wang, Xuelong Li

University of Science and Technology of China, Shanghai AI Lab, Northwestern Polytechnical University

2026-05-27视觉感知三维

这篇论文针对长视频空间推理中“记住更多帧”反而引入冗余和无关几何的问题,提出 Q-GeoMem 将记忆视为面向问题的证据管理:用相机条件几何增强视觉 token,并以近期细粒度记忆和长期语义几何证据库分别保存局部与跨时段信息;写入时结合问题相关性和新颖性打分。实验在 VSI-Bench、VSTI-Bench 上达到所评模型中的 SOTA,消融显示该打分机制是主要增益来源之一。

Chartographer: Counterfactual Chart Generation for Evaluating Vision-Language Models Figure 1
2026-05-27cs.CL

Chartographer: Counterfactual Chart Generation for Evaluating Vision-Language Models

Yifan Jiang, Dae Yon Hwang, Jesse C. Cresswell, Freda Shi

University of Waterloo, Vector Institute

2026-05-27视觉语言视觉感知

现有图表问答常用固定三元组,难以区分模型是真正读图推理还是依赖题目规律、记忆或参数知识。Chartographer 将原图反向工程为可执行绘图代码,人工验证重建后生成受控反事实图表,并用可执行 QA 逻辑重算答案。实验显示,许多 VLM 即使答对原图,也在数据变化后显著失效,CharXiv 与 ChartMuseum 尤其明显,错误多来自未能重新视觉落地或更新推理。

How and What to Imagine? Visual Thinking in Unified Multimodal Models for Cross-View Spatial Reasoning Figure 1
2026-05-27cs.CV

How and What to Imagine? Visual Thinking in Unified Multimodal Models for Cross-View Spatial Reasoning

Qian Yang, Ankur Sikarwar, Huy Le, Le Zhang, Zhuan Shi, Perouz Taslakian, Aishwarya Agrawal

Mila - Québec AI Institute, Université de Montréal 3 McGill University

2026-05-27视觉语言

论文针对VLM跨视角空间推理中“语言化推理丢失几何细节、生成的思考图像又常被模型忽略”的问题,提出训练时的View Dropout,让答案阶段看不到部分输入视图、必须依赖中间图像,并用可学习性—信息量框架比较全景、俯视和点匹配三类视觉思考。基于BAGEL仅用8K合成样本训练,在一个域内和五个真实OOD基准上,全景+VDrop取得最佳泛化,较原模型提升6.7点并超过更多数据训练的同骨干方法。

PlayClass: Automated Play Behaviour Classification in Poultry Figure 1
2026-05-27cs.CV

PlayClass: Automated Play Behaviour Classification in Poultry

Prince Ravi Leow (1), Neil Scheidwasser (1 and 3), Rebecca Oscarsson (2), Per Jensen (2), Samir Bhatt (1 and 3), David Alejandro Duchêne (1) ((1) Section for Health Data Science & AI, University of Copenhagen, (2) AVIAN Behaviour Genomics and Physiology Group, Linköping University (3) Department of Infectious Disease Epidemiology, Imperial College London)

Section for Health Data Science & AI, University of Copenhagen, AVIAN Behaviour Genomics and Physiology Group, Linköping University, Department of Infectious Disease Epidemiology, Imperial College London

2026-05-27视觉感知

这篇论文针对禽类福利监测长期偏重疾病、疼痛等负面指标而忽视“玩耍”行为的问题,提出 PlayClass:用 YOLO 辅助 SAM 3 分段跟踪长时俯视视频,并结合手工运动特征与冻结视觉/视频基础模型做个体级分类。实验显示 V-JEPA 2.1 最强,融合运动特征后宏平均 F1 达 77.0,但遮挡和玩耍/非玩耍运动模式相似仍是主要误差来源。

Gemini Embedding 2: A Native Multimodal Embedding Model from Gemini Figure 1
2026-05-27cs.CV

Gemini Embedding 2: A Native Multimodal Embedding Model from Gemini

Madhuri Shanbhogue, Zhe Li, Shanfeng Zhang, Gustavo Hernández Ábrego, Shih-Cheng Huang, Aashi Jain, Daniel Salz, Sonam Goenka, Chaitra Hegde, Ji Ma, Feiyang Chen, Jiaxing Wu, Tanmaya Dabral, Babak Samari, Kevin Poulet, Daniel Cer, Kaifeng Chen, Paul Suganathan, Hui Hui, Jovan Andonov, Philippe Schlattner, Jay Han, Iftekhar Naim, Wing Lowe, Vladimir Pchelin, Albert Yang, Yi-Ting Chen, Zhongli Ding, Grace Zhang, Georg Heigold, Yichang Chen, Antoine Reveillon, Brendan Mccloskey, Wenlei Zhou, Dahun Kim, Rui Meng, Emma Wang, Jack Zheng, Halley Fede, Zhen Yang, Keegan Mosley, Brian Potetz, Sahil Dua, Henrique Schechter Vera, Shen Gao, Hesen Zhang, Andreas Hess, Hengxuan Ying, Alberto Montes, Karan Gill, Min Choi, Sebastian Russo, Anja Hauth, Jinhyuk Lee, Michael Boratko, Megan Barnes, Vikram Rao, Claudiu Musat, Cyril Allauzen, Ehsan Variani, Shankar Kumar, Tom Bagby, Junyi Jiao, Yang Gu, Tengxin Li, Ayush Agrawal, Roberto Santana, Dev Nath, Stephen Karukas, Shuoxuan Han, Lucia Loher, Alice Twu, Nidhi Vyas, Siddharth Bhai, Frank Palma Gomez, Wangyuan Zhang, Chaoren Liu, Jizheng Yang, Steve Qiu, Shijie Zhang, Sujay Kulkarni, Sascha Rothe, Sean Nakamoto, Raphael Hoffmann, Zach Gleicher, Yunhsuan Sung, Qin Yin, Tom Duerig, Mojtaba Seyedhosseini

2026-05-27视觉语言

现有多模态嵌入多依赖双塔或后融合,难以处理图文音视频交错输入及跨模态细粒度语义。Gemini Embedding 2借助Gemini原生多模态能力,将文本、图像、音频、视频及其任意组合映射到统一空间,并通过大规模对比学习和多任务多阶段训练提升通用检索能力。其在MSCOCO、Vatex、MTEB多语与代码等指标上超过专用模型,但具体增益来源可能主要来自scaling / data。

A Dynamic Programming Framework for Discovering Count and Values of Multilevel Image Thresholding Figure 1
2026-05-27cs.CV

A Dynamic Programming Framework for Discovering Count and Values of Multilevel Image Thresholding

Eslam Hegazy, Mohamed Gabr

aComputer Science and Engineering Department German University in Cairo, New

2026-05-27视觉感知

针对多级图像阈值分割通常需要人工指定阈值数量、且精确动态规划在高阈值数下耗时的问题,本文系统分析基于改造 Kittler/MET 准则的 MET-DP 框架,用一次动态规划同时估计阈值个数和值。实验覆盖自然、卫星和医学图像,显示其在高阈值场景显著更快,并常能给出合理阈值数;但相较需预设阈值数的 Otsu、Kapur 等方法,SSIM/PSNR 往往不占优,且会受直方图细小波动影响出现过分割或欠分割。

Can Retrieval Heads See Images? Multimodal Retrieval Heads in Long-Context Vision-Language Models Figure 1
2026-05-27cs.CV

Can Retrieval Heads See Images? Multimodal Retrieval Heads in Long-Context Vision-Language Models

Aaron Branson Cigres Li, Zhaowei Wang, Yu Zhao, Yiming Du, Haobo Li, Xiyu Ren, Ginny Wong, Simon See, Lishu Luo, Haodong Duan, Pasquale Minervini, Yangqiu Song

University of Edinburgh, Tsinghua University, Code and data are available at https://github.com/, this division of labor dynamically

2026-05-27视觉语言视觉感知

长上下文视觉语言模型需要在图文交错输入中定位证据,但以往基于文本复制的 retrieval head 判据难以处理图像证据。本文用问题 token 到标注文本/视觉证据的注意力质量定义多模态检索头,发现其稀疏、部分跨模态共享且会随上下文和模态动态变化;遮蔽前 5% 头使 MMLongBench-Doc 从 48.2% 降至 5.7%、SlideVQA 从 71.2% 降至 8.9%,并可无训练提升 MMDocIR 页/布局检索 Recall@1。

MRT: Masked Region Transformer for Layered Image Generation and Editing at Scale Figure 1
2026-05-27cs.CV

MRT: Masked Region Transformer for Layered Image Generation and Editing at Scale

Zhicong Tang, Zhao Zhang, Jingye Chen, Mohan Zhou, Yifan Pu, Yuchi Liu, Yalong Bai, Ethan Smith, Yuhui Yuan

2026-05-27视觉感知

针对分层透明图像生成与编辑缺少大规模数据和统一建模的问题,MRT在约200亿参数Qwen-Image基础上,用遮蔽区域扩散统一文本到层、图像到层和层到层编辑,并引入支持越界元素的canvas层与扩散蒸馏。实验显示其在三类任务和用户研究中优于现有及商业系统,图像拆层较Qwen-Image-Layered推理快约10–100倍、显存省50%–90%,但部分增益可能主要来自scaling/data。

Generative Animations: A Multi-Model Pipeline for Prompt-Driven Motion Synthesis Figure 1
2026-05-27cs.CV

Generative Animations: A Multi-Model Pipeline for Prompt-Driven Motion Synthesis

Mannat Khurana, Sanyam Jain, Rishav Agarwal

thinning algorithm [ZS84, AB99] extracts the medial axis (center-, perfectly centered during movement. This geometric abstraction al-

2026-05-27生成模型

这篇短文针对设计工具中自定义动画路径需手工描点、调缓动且门槛高的问题,提出将 LLM 意图解析、SAM 视觉定位、轮廓向量化与 Bézier 路径装配串联的多模型流水线,使文本提示可生成贴合场景几何的动画,并处理遮挡层级和 3D 透视。系统在 InDesign/Express 场景展示了沿轮廓、绕行和透视对齐三类用例,声称可节省约 90% 时间,但除案例外定量评测仍不充分。

Not All Tokens Matter Equally: Dynamic In-context Vector Distillation with Decisive-Token Supervision for Long-form Medical Report Generation Figure 1
2026-05-27cs.CL

Not All Tokens Matter Equally: Dynamic In-context Vector Distillation with Decisive-Token Supervision for Long-form Medical Report Generation

Ning Wu, Rui Liu, Xinkun Lin, Weixing Chen, Jinxi Xiang, Tao Wei, Lina Yao, Mingjie Li

University of Technology Sydney, Sydney, Australia, School of Computer Science and Engineering, Sun Yat-sen University, China, Stanford University, Palo Alto, United States, Shanghai Jiao Tong University, Shanghai, China

2026-05-27视觉感知

这篇论文关注将隐空间示例蒸馏从短回答任务迁移到长篇医学报告时的失效:模板词过多会淹没病灶词和EOS等关键监督。作者提出DIVE,在冻结医学VLM上结合关键token加权监督与状态条件动态steering,以缓解内容遗漏和过度生成。MIMIC-CXR、CheXpert Plus实验显示其在BLEU-4、ROUGE-L和RadGraph F1上均优于对比方法,CheXbert表现保持竞争力。

FoundObj: Self-supervised Foundation Models as Rewards for Label-free 3D Object Segmentation Figure 1
2026-05-27cs.CV

FoundObj: Self-supervised Foundation Models as Rewards for Label-free 3D Object Segmentation

Zihui Zhang, Zhixuan Sun, Yafei Yang, Jinxi Li, Jiahao Chen, Bo Yang

2026-05-27视觉感知强化学习三维

针对无场景级人工标注下复杂点云中“什么算一个物体”难定义、仅语义或仅几何先验易失效的问题,FoundObj用超点级发现智能体逐步合并邻域超点,并把自监督2D基础模型的语义一致性与3D物体中心几何一致性作为强化学习奖励。实验显示其在多个3D场景基准上超过现有无标签/弱先验方法,并在零样本和长尾场景中保持较好泛化。

Model discovery for dynamical systems with complex-valued product units Figure 1
2026-05-27cs.CV

Model discovery for dynamical systems with complex-valued product units

Martin Brückmann, Babette Dellen, Uwe Jaekel

Department of Mathematics, Informatics, and Technology, RheinAhrCampus Remagen, University of Applied Sciences Koblenz

2026-05-27视觉感知

这篇论文针对从轨迹数据中恢复动力系统方程时,候选单项式库随维度爆炸且难覆盖分数/负指数项的问题,提出用复值 product-unit 网络直接学习稀疏单项式组合,而非预设函数库。在 Lorenz63、Lorenz84、Four-Wing 等混沌系统上,3000 点以上训练时多数试验可精确恢复方程;在人类步态加速度数据上也能生成有界预测,RMSE 约为信号幅值范围的 12–14%。

Semantic Robustness Probing via Inpainting: An Interactive Tool for Safety-Critical Object Detection Figure 1
2026-05-27cs.CV

Semantic Robustness Probing via Inpainting: An Interactive Tool for Safety-Critical Object Detection

Nico Steckhan, Krutarth Prajapati, Weija Shao, Silvia Vock

2026-05-27视觉感知安全鲁棒

面向锯床手部检测等安全关键视觉系统,论文指出传统噪声/模糊鲁棒性测试难覆盖手套、锯屑、眩光等真实语义风险。作者提出本地化工具 SemProbe,将 ODD 因子目录、掩码扩散修补与 YOLO 前后对比和结构化日志串联,用于生成可追溯鲁棒性证据。示例中防切割手套使召回率从 0.91 降至 0.64,重锯屑降至 0.52,显示可定位高风险失效因子。

Touch-R1: Reinforcing Touch Reasoning in MLLMs Figure 1
2026-05-27cs.CV

Touch-R1: Reinforcing Touch Reasoning in MLLMs

Yingxin Lai, Yafei Zhou, Fucai Zhu, Siyu Zhu, Weihao Yuan

Xiamen University, Great Bay University, Fudan University, Nanjing University

2026-05-27视觉感知

这篇论文针对现有多模态/触觉语言模型在视觉与触觉冲突时容易依赖视觉先验、缺少“用触觉证据修正判断”的问题,提出 Touch-R1:用四类光学触觉传感器构建 TouchReason-1M 与评测集,并通过触觉动态预训练、QA 微调和触觉 grounded GRPO,将序数属性奖励、跨传感器一致性和反事实触觉扰动纳入训练。实验中 Touch-R1-7B 在 TouchReason-Bench 上平均超过 Octopi-13B 18.4%、GPT-4o 24.7%,并能生成感知—比较—修正式推理轨迹。

Chaos-SSL: An Attention-Based Self-Supervised Learning Framework with Chaotic Transformation for Medical Image Classification Figure 1
2026-05-27cs.CV

Chaos-SSL: An Attention-Based Self-Supervised Learning Framework with Chaotic Transformation for Medical Image Classification

Joao Batista Florindo

Institute of Mathematics, Statistics and Scientific Computing, University of Campinas, Rua Sergio Buarque de Holanda, 651, Campinas, Brazil

2026-05-27视觉感知

针对医学图像标注稀缺且病灶差异常体现为细粒度纹理的问题,Chaos-SSL用Logistic、Tent、Sine等一维混沌映射构造更难的对比学习视图,并通过注意力融合混沌预训练ConvNeXt-Tiny与ImageNet预训练ConvNeXt-Large特征。实验显示Tent映射预训练30轮后,在ISIC 2018和APTOS 2019上准确率分别达0.9261、0.8726,优于多种SSL基线。

Is an Image Also Worth 16x16=256 Superpixels? A Framework for Attentional Image Classification Figure 1
2026-05-27cs.CV

Is an Image Also Worth 16x16=256 Superpixels? A Framework for Attentional Image Classification

Pedro Henrique da Costa Avelar, Anderson R. Tavares, Luís C. Lamb

Institute of Informatics, Federal University of Rio Grande do Sul (UFRGS), 91501-970, Porto Alegre, Rio Grande do Sul, Brazil

2026-05-27视觉感知

本文针对超像素图分类与ViT自注意力模型长期割裂的问题,提出Superpixel Transformers,将SICGAT与ViT统一为可配置的注意力图像分类框架,支持任意图像分块、连接图和位置编码,并用保留形状与颜色的超像素patch减少聚合信息损失。实验在CIFAR10、FashionMNIST、Imagenette上显示,其优于既有超像素GNN且接近ViT,同时提示受约束的patch连接可能提升ViT表现。

Unsupervised Deep Image Prior for Sparse-View and Limited-Angle Electron Tomography Figure 1
2026-05-27eess.IV

Unsupervised Deep Image Prior for Sparse-View and Limited-Angle Electron Tomography

Serge Brosset, Daniel del Pozo Bueno, Thomas David, Laure Guetaz, Philippe Ciuciu, Zineb Saghi

In practice, most TEM samples are prepared on grids or as thin lamellae. Due to this slab-like

2026-05-27视觉感知

针对电子断层成像在稀疏视角和有限倾角下易产生 missing-wedge 伪影、影响纳米材料三维定量的问题,论文将无需训练数据的 Deep Image Prior 用于同步重建与恢复,以未训练 CNN 作为隐式先验直接拟合退化投影。模拟与铂纳米颗粒实验表明,DIP 在 ±60°、10°步进甚至 ±30°场景下优于传统方法,效果接近监督 U-Net,并能支持较可靠的形貌与尺寸量化。

Leveraging Visual Signals for Robust Token-Level Uncertainty in Vision-Language Generation Figure 1
2026-05-27cs.CV

Leveraging Visual Signals for Robust Token-Level Uncertainty in Vision-Language Generation

Joseph Hoche, David Brellmann, Gianni Franchi

2026-05-27视觉语言视觉感知安全鲁棒

面向机器人、自动驾驶等安全场景中 LVLM 幻觉难以察觉的问题,论文指出仅沿用语言模型不确定性会忽略视觉证据;其核心洞察是高置信预测更依赖图像信息,并提出免训练的 VIG-TUQ,用有无图像的分布差异和视觉注意力为 token 级语言不确定性加权。多数据集和早/晚/原生融合架构实验显示,该方法通常优于现有 token 级不确定性估计,但仍受限于需白盒访问内部表示。

Do Modern Post-Hoc Watermarking Methods Beat Broken-Arrows? Figure 1
2026-05-27cs.CR

Do Modern Post-Hoc Watermarking Methods Beat Broken-Arrows?

Enoal Gesny, Eva Giboulot

2026-05-27视觉感知

针对生成式图像溯源中现代后处理神经水印被默认优于经典方法的假设,论文把多比特方法转成零比特检测框架,与 Broken-Arrows 等经典水印在统一误警率、常见增强和新型攻击下比较。核心洞察是神经检测器缺少密钥并扩大攻击面;实验显示经典方法在现实安全性上更强且鲁棒性不逊色,但几何失真场景文中未充分覆盖。

Image Thresholding: Understanding Bias of Evaluation Metrics towards Specific Evaluation Functions Figure 1
2026-05-27cs.CV

Image Thresholding: Understanding Bias of Evaluation Metrics towards Specific Evaluation Functions

Eslam Hegazy, Mohamed Gabr

2026-05-27视觉感知数据集/基准

本文针对多级图像阈值分割中常用 SSIM、PSNR 是否“公平”评估不同目标函数这一隐含前提展开分析。作者不比较优化器,而是在 BSDS500 上遍历所有阈值,考察 Otsu 与 Kapur 目标函数同质量指标的相关性,指出评测指标本身会偏向特定目标函数。结果显示 Otsu 与 PSNR 在全部图像上相关性更高,与 SSIM 在超过 91% 图像上也优于 Kapur,提示既有算法增益可能部分来自指标偏置。

YOLO26-RipeLoc Lite: A lightweight architecture for tomato ripeness detection and picking point localization in greenhouse robotic harvesting Figure 1
2026-05-27cs.CV

YOLO26-RipeLoc Lite: A lightweight architecture for tomato ripeness detection and picking point localization in greenhouse robotic harvesting

Rajmeet Singh, Manveen Kaur, Shahpour Alirezaee, Irfan Hussain

Department of Mechanical Engineering, Khalifa University, University of Windsor

2026-05-27机器人视觉感知

面向温室采摘机器人在遮挡、光照变化下需同时识别成熟度并给出可抓取点的问题,论文在 YOLO26 上引入轻量特征金字塔、成熟度感知注意力和带中心点回归的紧凑检测头。自采 1500 张番茄图像实验显示,模型总体 mAP@0.5 为 92.9%,成熟番茄为 95.2%,仅 2.38M 参数,剪枝后约 1.8M 且精度损失很小。

PILOT: A Data-Free Continual Learning Approach for Real-Time Semantic Segmentation via Boundary Guidance Figure 1
2026-05-27cs.CV

PILOT: A Data-Free Continual Learning Approach for Real-Time Semantic Segmentation via Boundary Guidance

Yujing Zhou, Prashant Shekhar, Thomas Yang, Yongxin Liu

Department of Mathematics, College of Arts and Sciences, Embry-Riddle Aeronautical University, Daytona, Department of Electrical Engineering and Computer Science, College of Engineering, Embry-Riddle, Aeronautical University, Daytona Beach, FL 32114, USA, divides an image into regions, where each pixel is assigned a semantic label (like "road,"

2026-05-27视觉感知学习理论

面向自动驾驶和机器人中类别持续变化的实时语义分割,PILOT针对PIDNet提出无回放增量学习:冻结原P/I/D主干与旧类别头,仅新增并训练并行边界分支和新类别头,利用高频边界信息学习新类以避免参数干扰。Cityscapes类增量实验显示其能分割新增类别,同时保持旧类mIoU并维持低延迟,优于若干持续学习基线。

COVD: Continual Open-Vocabulary Object Detection with Novel Concept Injection Figure 1
2026-05-27cs.CV

COVD: Continual Open-Vocabulary Object Detection with Novel Concept Injection

Yupeng Zhang, Ruize Han, Yuzhong Feng, Zixin Ren, Yuntong Tian, Liang Wan

Tianjin University., Shenzhen University of Advanced Technology.

2026-05-27视觉感知

面向开放词汇检测部署后类别持续变化、全量重训成本高且易遗忘的问题,论文提出 COVD 任务与 Novel-114 基准。核心洞察是预训练视觉编码器往往已能“看见”新物体,瓶颈在文本语义对齐;NoIn-Det 冻结视觉分支,仅更新少量文本分支参数,并用 RSSD 与 KPD 稳定旧概念空间。实验显示其在新概念学习、旧知识保持上优于现有 VLM 持续学习方法且不增参。

JLT: Clean-Latent Prediction in Latent Diffusion Transformers Figure 1
2026-05-27cs.CV

JLT: Clean-Latent Prediction in Latent Diffusion Transformers

Funing Fu, Tenghui Wang, Junyong Cen, Qichao Zhu, Guanyu Zhou

Wuhan University of Technology, Hangzhou Jiyi Artificial Intelligence Co., Ltd.

2026-05-27生成模型

本文追问在已压缩的 VAE 潜空间中,扩散/flow 模型的预测目标是否仍会影响学习难度。作者在固定 FLUX.2 VAE、同一 130M DiT 骨干和训练设置下提出 JLT,直接预测 clean latent,并指出速度预测会引入各向同性协方差底噪、放大低方差方向。ImageNet 256×256 上,JLT-B/1 的 FID-50K 从匹配速度基线的 6.56 降至 2.56,带 CFG 为 2.50。

Pop-Up Distractions Reveal Bag-of-Events Behavior in Video Large Language Models Figure 1
2026-05-27cs.CV

Pop-Up Distractions Reveal Bag-of-Events Behavior in Video Large Language Models

Oscar Chew, Serhii Honcharenko, Qian-Hui Chen, Patricia Lu, Dishant Zaveri, Khoa D. Doan, Kuan-Hao Huang

Texas A&M University 2 \quad{}^{2} National Taiwan University, Stanford University 4 \quad{}^{4} VinUniversity

2026-05-27视觉感知

这篇论文关注视频大模型是否真正保持时间顺序中的主体—事件绑定,而非把长视频当作事件集合。作者提出 DistractionBench,通过插入广告、拼接动作片段和真实赞助段构造干扰,并用 BoE、Yes-bias、No-bias 问题区分跨片段误关联与一般幻觉。对 11 个 VideoLLM 的评测显示,所有模型都存在明显 bag-of-events 行为,且 BoE 错误率通常高于简单肯定偏置,说明当前模型的时间 grounding 仍不可靠。

Semi-Supervised Gaze Estimation via Disentangled Subspace Contrastive Learning Figure 1
2026-05-27cs.CV

Semi-Supervised Gaze Estimation via Disentangled Subspace Contrastive Learning

Qida Tan, Hongyu Yang, Wenchao Du

2026-05-27视觉感知

针对外观式凝视估计依赖大量标注且跨域泛化差的问题,论文提出半监督 DSCL 框架:用 Jacobian 正则将特征解耦到俯仰、偏航等子空间,再利用子空间内由相似度诱导的序关系进行对比学习,从少量标注和大量无标注样本中学习稳健表示。多基准实验显示,该方法在域内和跨域设置下仅用 20%、10% 甚至 5% 标注数据即可接近全监督竞争性能,且可作为即插即用模块。

SoftCap: Soft-Budget Control for Diffusion Transformer Acceleration Figure 1
2026-05-27cs.CV

SoftCap: Soft-Budget Control for Diffusion Transformer Acceleration

Yuhang Zhang, Junxiang Qiu, Huixia Ben, Zhenhua Tang, Shuo Wang, Yanbin Hao

Hefei University of Technology, University of Science and Technology of China, Anhui University of Science and Technology, University of Macau.

2026-05-27生成模型规划控制

DiT 生成质量高但逐步去噪需大量 Transformer 计算,现有缓存加速多靠固定调度或手调阈值,难按单次轨迹风险与已用算力动态取舍。SoftCap 将 Full/Cache 选择建模为软预算反馈控制,用轨迹漂移观测器估计缓存风险,并由 PI 控制器按实际算力调整触发阈值;在 FLUX.1-dev 上相近 FLOPs 下较 SpeCa 提升 ImageReward、降低 LPIPS-Full,且预算表现为软上限而非强制消耗。

IPIBench: Evaluating Interactive Proactive Intelligence of MLLMs under Continuous Streams Figure 1
2026-05-27cs.CV

IPIBench: Evaluating Interactive Proactive Intelligence of MLLMs under Continuous Streams

Jinzhao Li, Yinuo Chen, Wenxuan Song, Yijia Lei, Yichi Zhang, Honglei Yan, Panwang Pan, Miao Liu

College of AI, Tsinghua University

2026-05-27视觉感知

面向可穿戴与家庭机器人等持续视频场景,论文指出现有 MLLM 评测多停留在单轮被动问答,难以衡量用户动态增删改主动请求时的交互能力。作者提出 IPIBench,覆盖主动监控、任务管理与被动—主动交织请求,并发现现有模型存在触发不稳定和协调弱的问题;进一步给出免训练的 IPI-Agent,通过交互控制策略与时间门控,在各项设置中稳定提升基座模型表现。

BEAT: Rhythm-Elastic Alignment for Agentic Music-guided Movie Trailer Generation Figure 1
2026-05-27cs.CV

BEAT: Rhythm-Elastic Alignment for Agentic Music-guided Movie Trailer Generation

Yutong Wang, Yunke Wang, Xinyuan Chen, Chang Xu

The University of Sydney 2 Shanghai AI Laboratory

2026-05-27视觉感知

本文针对自动电影预告片中镜头选择与配乐同步常被后处理化或限制为刚性一一匹配的问题,提出 BEAT:用可微调的 MuVA 学习音乐小节与镜头的跨模态兼容性,并以能量自适应 Bar-DP 实现多小节共享镜头的弹性剪辑节奏,再嵌入五阶段 agentic 流水线完成成片。作者还构建 TrailerArena,报告在镜头选择、排序和感知质量等 20 多项指标上优于现有方法。

SCKAN: Structural Consensus-based KAN Prototype Learning for Semi-Supervised Pancreas Segmentation Figure 1
2026-05-27cs.CV

SCKAN: Structural Consensus-based KAN Prototype Learning for Semi-Supervised Pancreas Segmentation

Yuqi Liu, Yufei Chen, Wei Fu, Xiaodong Yue, Shuo Li

2026-05-27视觉感知

针对半监督胰腺分割中标注稀缺与胰腺形态差异导致的监督偏置,SCKAN将胰腺按解剖位置分解为结构原型,通过位置加权对比学习建立跨样本一致性,并用KAN的自适应B样条融合稳定结构共识、过滤样本噪声。作者在两个公开胰腺数据集上验证了有效性,但具体增益幅度在给定片段中未充分说明。

NeR-SC: Adapting Neural Video Representation to Screen Content Figure 1
2026-05-27cs.CV

NeR-SC: Adapting Neural Video Representation to Screen Content

Ruohan Shi, Jiaoyan Zhao, Haogang Feng

2026-05-27视觉感知

本文针对远程桌面、网课和云游戏中的屏幕内容视频,指出其离散色彩、锐利边缘和高时间冗余与自然视频不同。NeR-SC在SNeRV上加入低频子带可学习调色板、多门控密集跨层融合,以及基于嵌入的静帧跳解码。实验在DSCVC/VCD上达40.32/41.73 dB,优于多种神经表示方法,低码率下超过H.264/H.265,并实现无质量损失的实时解码。

Black-box Membership Inference Attacks on the Pre-training Data of Image-generation Models Figure 1
2026-05-27cs.CV

Black-box Membership Inference Attacks on the Pre-training Data of Image-generation Models

Tao Qi, Huili Wang, Yuanhong Huang, Wendan Wang, Lianchao Zhao, Jinrui Wang, Zichen Qin, Shangguang Wang, Yongfeng Huang

Beijing University of Posts and Telecommunications, Tsinghua University

2026-05-27视觉感知

针对扩散图像生成模型预训练数据是否被未经授权使用,论文指出传统基于图像扰动/去噪的成员推断在预训练场景信号很弱,且灰盒内部特征难用于商业黑盒系统。作者提出 SD-MIA,通过多视角文本扰动触发文本-视觉映射稳定性差异,并用跨模态相关性估计与最大相关池化形成判别信号。在 LAION-mi 和扩展闭源/开源模型评测中,SD-MIA 优于现有黑盒及部分可访问内部特征的基线。

Timestep-Aware SVDQuant-GPTQ for W4A4 Quantization of Wan2.2-I2V Figure 1
2026-05-27cs.CV

Timestep-Aware SVDQuant-GPTQ for W4A4 Quantization of Wan2.2-I2V

Junhao Wu, Dezhong Yao, Hai Jin

2026-05-27视觉感知

该文针对 Wan2.2-I2V 这类 MoE 视频 DiT 在 W4A4 量化中受激活离群值与去噪时间步分布漂移影响、统一校准易损画质的问题,提出结合 SVDQuant 低秩补偿、GPTQ 残差权重量化,以及按专家和时间步分箱的逐层激活裁剪搜索。OpenS2V-Eval 上峰值显存较 BF16 降低 59.3%,VBench 平均分仅降 0.9%,说明专家与时间步感知校准对低比特视频生成较关键。

ChartAct: A Benchmark for Dynamic Chart Understanding Figure 1
2026-05-27cs.CV

ChartAct: A Benchmark for Dynamic Chart Understanding

Muye Huang, Wu Lin, Lingling Zhang, Hang Yan, Zhiyuan Wang, Yumeng Fu, Zesheng Yang, Jun Liu

School of Computer Science and Technology, Xi’an Jiaotong University, MOE KLNN Lab, Xi’an Jiaotong University

2026-05-27数据集/基准

现有图表理解评测多假设信息静态可见,难以覆盖网页/仪表盘中需悬停、点击、缩放、拖拽才能获得证据的真实场景。ChartAct 将 8 个真实网站的 673 个动态图表嵌入可控交互环境,构建 1440 个问答样本,并设置动态图表与仪表盘两类上下文,考察模型的动作选择、状态观察与跨状态推理。对 11 个多模态模型和 GUI agent 的评测显示,Claude-Opus-4.7 平均成功率 84.5%,但多数模型低于 60%,主要瓶颈在元素定位、交互决策和证据整合。

On the Robustness of Machine Unlearning for Vision-Language Models Figure 1
2026-05-27cs.CV

On the Robustness of Machine Unlearning for Vision-Language Models

Yujie Lin, Kaidi Jia, Jiayao Ma, Chengyi Yang, Jinsong Su

Xiamen University

2026-05-27视觉语言视觉感知安全鲁棒

针对视觉语言模型可能记忆隐私、版权或有害训练信息,而现有遗忘评测容易只验证“表面不回答”的问题,本文系统梳理VLM机器遗忘方法,并按被修改组件建立分类,在多种提示下统一评测。核心洞察是提出上下文、同分布再训练和分布外再训练三类攻击来检验被遗忘多模态知识能否被重新激活。实验显示多种现有方法在这些攻击下仍可恢复目标知识,说明它们往往是隐藏而非真正移除信息。

CodecCap: High-Fidelity Codec-Inspired Residual Modeling for Dense Video Captioning Figure 1
2026-05-27cs.CV

CodecCap: High-Fidelity Codec-Inspired Residual Modeling for Dense Video Captioning

Zihan Lin, Songhe Deng, Shuwei He, Danxiang Zhu, Dan Zhang, Yishu Lei, Xianlong Luo, Shikun Feng, Rui Liu

College of Artificial Intelligence, Inner Mongolia University

2026-05-27视觉语言视觉感知

论文针对视频字幕在“整体描述丢细节、分段描述又冗余”之间的矛盾,提出受视频编码启发的 CodecCap:用关键帧字幕记录稳定场景语义,用残差字幕只描述局部动作、运动和状态变化。作者还设计 VidCapQA 以问答方式衡量字幕可恢复的视觉证据,并构建 CodecVDC-100K 数据集;实验显示在相同 VLM 下,CodecCap 相比直接生成字幕在 VidCapQA 上更能保留细粒度信息。

DinoComplete: 3D Shape Completion with Distilled Semantic Priors and State Space Models Figure 1
2026-05-27cs.CV

DinoComplete: 3D Shape Completion with Distilled Semantic Priors and State Space Models

Furkan Mert Algan, Eckehard Steinbach

Munich Institute of Robotics and Machine Intelligence, School of Computation Information and Technology, Technical University of Munich

2026-05-27三维

针对部分扫描在遮挡、噪声和未知类别下仅靠TSDF几何难以补全缺失结构的问题,DinoComplete将多视角DINO语义蒸馏为体素对齐特征,并用多尺度Voxel Mamba融合几何与语义以建模长程依赖;在ShapeNet未知类和ScanNet实扫物体上,相比PatchComplete、DiffComplete等取得更低CD/更高IoU,同时参数、显存和推理时间更少。

Object Pose and Shape Estimation for Grasping: Does it Work? Figure 1
2026-05-27cs.RO

Object Pose and Shape Estimation for Grasping: Does it Work?

Pavan Karke, Kushal Shah, Gaurav Singh, Md Faizal Karim, K Madhava Krishna, Rajat Talak

∗ Equal Contributions, 1 Robotics Research Center, IIIT Hyderabad, 2 National University of Singapore

2026-05-27三维

本文针对“单视角物体姿态与形状估计是否已足以支撑抓取”这一问题,比较端到端 AnyGrasp 与先重建物体再做 antipodal 采样的模块化方案。核心洞察是,开放集三维估计模型已能为小物体生成更充分的候选抓取;在仿真、数据集和真实 Xarm7 实验中模块化方法整体优于端到端,但性能依赖重建精度,在杂乱遮挡场景会退化,并可结合视觉语言模型实现单视角语言条件抓取。

Leveraging Text-to-Image Diffusion Models for Unsupervised Visual Object Tracking Figure 1
2026-05-27cs.CV

Leveraging Text-to-Image Diffusion Models for Unsupervised Visual Object Tracking

Zhengbo Zhang, Zhigang Tu, Junsong Yuan, De Wen Soh, Bo Du

2026-05-27视觉感知生成模型

针对无监督视觉跟踪难以利用细粒度语义、结构和视频上下文的问题,本文提出 Diff-Tracking,将预训练文生图扩散模型重新解释为文本提示与图像区域的跨注意力桥梁,通过首帧框学习目标 prompt,并用运动信息在线更新;在六个跟踪基准上超过现有无监督方法,消融显示收益主要来自跟踪专用设计而非直接使用 Stable Diffusion 特征。

Revealing the core dimensions underlying representations in brains, behavior and AI Figure 1
2026-05-27cs.CV

Revealing the core dimensions underlying representations in brains, behavior and AI

Florian P. Mahner, Ka Chun Lam, Francisco Pereira, Martin N. Hebart

Max Planck Institute for Human Cognitive and Brain Sciences, National Institute of Mental Health, Justus Liebig University Giessen, Center for Mind, Brain and Behavior

2026-05-27强化学习

针对神经科学、行为与 AI 中相似性矩阵只能比较表征、难以解释其潜在维度的问题,论文提出 SRF:基于对称非负矩阵分解,从完整或稀疏相似性数据中恢复低维、非负且可解释的维度,并用交叉验证选择秩。仿真及行为、脑成像、语义和深度网络数据表明,SRF 在缺失数据下仍能提取有意义维度,可预测独立行为属性,并在确认性检验中较 RSA 有更高统计功效。

I2PRef: Image-Driven Point Completion with Iterative Refinement Figure 1
2026-05-27cs.CV

I2PRef: Image-Driven Point Completion with Iterative Refinement

Azhar Hussian, Marina Ritthaler, André Kaup, Vasileios Belagiannis

Distance improvement over prior methods. Code is available at:, gional Development and Energy (project BAVAR-RADAR, label DIK0622)

2026-05-27视觉感知

针对遮挡、噪声导致的点云缺失,以及既有多模态方法仅把图像当辅助提示的问题,I2PRef将单张RGB图像作为主要几何来源,先用轻量I2P模块直接生成完整粗点云,再用带点自注意力与图像交叉注意力的P2P Transformer迭代修正坐标细节。在ShapeNet-ViPC上相对既有方法降低Chamfer Distance 12.3%,并报告更好的完整性与细节保留。

SIMPC: Learning Self-Induced Mirror-Point Consistency for Unsupervised Point Cloud Denoising Figure 1
2026-05-27cs.CV

SIMPC: Learning Self-Induced Mirror-Point Consistency for Unsupervised Point Cloud Denoising

Chengwei Zhang, Xueyi Zhang, Tao Jiang, Xinhao Xu, Wenjie Li, Fubo Zhang, Longyong Chen

National Key Laboratory of Microwave Imaging, Aerospace, Information Research Institute, Chinese Academy of Sciences, Beijing, China 2School of Computing, National University of, a distribution centered at a clean pixel value. In contrast

2026-05-27规划控制三维

点云噪声直接扰动坐标,导致无监督去噪难以像图像那样建立稳定对应,现有加噪或 EMD 映射存在点级对应歧义。SIMPC 的核心是从单个噪声点出发,利用去噪过程中的几何先验生成位于潜在表面另一侧的镜像点,并用镜像点一致性约束两者收敛到同一表面位置。实验显示其在合成与真实噪声数据上优于现有无监督方法,并超过部分强监督基线。

Small Object Detection in Industrial Recycling: A New Dataset and YOLO Performance Evaluation Figure 1
2026-05-27cs.CV

Small Object Detection in Industrial Recycling: A New Dataset and YOLO Performance Evaluation

Oussama Messai, Abbass Zein-Eddine, Abdelouahid Bentamou, Mickael Picq, Nicolas Duquesne, Stéphane Puydarrieux, Yann Gavet

2026-05-27视觉感知数据集/基准

面向工业回收中金属碎片等小、密集、重叠目标难以实时可靠检测的问题,论文发布含1万余图像、12万实例的SDOOD数据集,并系统评测多种YOLO/深度监督检测方案,进一步考察预处理、数据增强、合成数据、基于框的长度测量与分辨率/缩放鲁棒的异常检测。主要结果表明该基准可揭示检测精度、速度和工业可部署性的权衡,但具体最佳模型与增益数值在给定片段中未充分说明。

No Figure
2026-05-27cs.CV

Natural Human Motion Recovery by Aligning High-Order Temporal Dynamics from Monocular Videos

Dingkun Wei, Zehong Shen, Yan Xia, Georgios Pavlakos, Yujun Shen, Xiaowei Zhou

Zhejiang University, The University of Texas at Austin

2026-05-27视觉感知

该文针对单目人体运动恢复虽位置误差低、但常抖动或过度平滑的问题,指出关键缺口在于缺少可靠的速度、加速度等高阶时序约束。作者提出可接入现有 HMR 的 HTD-Refine,并用 PVA-Net 从视频估计2D关键点、3D速度和加速度,再在全局优化中作为软约束细化轨迹。实验显示其能稳定提升多种基线的全局轨迹精度与运动自然度,尤其改善高频动态和时序一致性。

RoadGIE: Towards A Global-Scale Aerial Benchmark for Generalizable Interactive Road Extraction Figure 1
2026-05-27cs.CV

RoadGIE: Towards A Global-Scale Aerial Benchmark for Generalizable Interactive Road Extraction

Chenxu Peng, Chenxu Wang, Yimian Dai, Yongxiang Liu, Ming-Ming Cheng, Xiang Li

VCIP, CS, Nankai University, AAIS, Nankai University, College of Electronic Engineering, National University of Defense Technology, Changsha, China

2026-05-27数据集/基准

针对现有航拍道路数据集地域单一、标注粒度和连通性不足导致模型泛化差的问题,论文构建了覆盖38国223城的WorldRoadSeg-360K,并提出RoadGIE交互式道路提取框架,用点击与涂鸦提示显式编码道路拓扑,结合专家引导提示、拓扑语义实例化和骨架召回损失提升迭代稳定性。实验显示其在分割精度和连通性上优于现有方法,且仅3.7M参数,适合高效标注与跨域应用。

REVERSE: Reinforcing Evidence Verification and Search for Agentic Image geo-localization Figure 1
2026-05-27cs.CV

REVERSE: Reinforcing Evidence Verification and Search for Agentic Image geo-localization

Yong Li, Furong Jia, Dacheng Yin, Kang Rong, Fengyun Rao, Jing Lyu, Fan Zhang

Peking University, The Hong Kong University of Science and Technology

2026-05-27视觉感知

针对图像地理定位中仅靠单次视觉预测或简单检索易被陌生地标、错误裁剪和噪声结果误导的问题,REVERSE将任务改写为多轮“看哪里、搜什么、信什么”的代理推理,并用区域标注、检索证据标签与过程奖励训练工具使用和证据筛选。实验中4B模型在Im2GPS3k的25km准确率达48.3%,优于检索增强基线,并接近更大模型表现。

Receipt Replay OOD: A Small Benchmark for Screen Replay Detection Under Domain Shift Figure 1
2026-05-27cs.CV

Receipt Replay OOD: A Small Benchmark for Screen Replay Detection Under Domain Shift

Alexander Vinogradov

IU International University of Applied Science, publicly available., samples available in public datasets. In practice, identity, conditions rather than artificially prepared in laboratory

2026-05-27视觉感知数据集/基准

针对证件屏幕重放检测在真实域移下缺少 OOD 评测的问题,论文提出 Receipt Replay OOD:用收据这类与证件相似但无隐私约束的平面纸质物构建小型公开基准,含真实拍摄、重放样本、元数据和框标注。实验显示,DLC-2021 上表现相近的 CNN、EfficientNet 与 DINOv2 模型迁移到该基准后鲁棒性差异显著,前两者退化明显,DINOv2 最稳健,说明常规域内评测会掩盖跨域泛化问题。

OSMa-Bench++: Toward Open-Ended Benchmarking of Semantic Mapping for Manipulation with Prompt-Generated Synthetic Scenes Figure 1
2026-05-27cs.CV

OSMa-Bench++: Toward Open-Ended Benchmarking of Semantic Mapping for Manipulation with Prompt-Generated Synthetic Scenes

Regina Kurkova, Maxim Popov, Sergey Kolyubin

2026-05-27机器人数据集/基准

面向机器人操作的语义地图评测仍依赖固定场景,难覆盖小物体、遮挡、杂乱和光照等关键失败例。OSMa-Bench++用LLM提示生成并筛选SceneSmith室内场景,转换到Habitat/OSMa-Bench流程,并利用原始提示生成面向计数与关系的PromptGT VQA。40个合成场景中提示匹配率约90%、对象保真下界98%;对ConceptGraphs和BBQ的评测显示相机光照显著拉低分割,提示约束问答总体低于30%,暴露出现有语义地图在操作相关关系与小物体表示上的明显短板。

The Kalman Evolve: Closing the Gap in Kalman Filtering via Interpretable Algorithm Discovery Figure 1
2026-05-27cs.LG

The Kalman Evolve: Closing the Gap in Kalman Filtering via Interpretable Algorithm Discovery

Vasileios Saketos, Ming Xiao

KTH Royal Institute of Technology

2026-05-27视觉感知

针对多普勒雷达、LiDAR 等真实感知中观测非线性导致传统卡尔曼滤波仿射更新失配的问题,本文提出 Kalman Evolve:先学习噪声协方差,再借助 LLM 引导的进化搜索发现可解释的非仿射更新结构,同时保留递归滤波形式。作者还分析说明仿射估计在常见非线性传感模型下存在结构性次优;在合成与真实跟踪任务上,相比 OKF 等强基线最高降低约 12% RMSE,计算成本相近。

Cesarean Scar Defect Segmentation in Transvaginal Ultrasound Images: a Dataset and Benchmark Figure 1
2026-05-27cs.CV

Cesarean Scar Defect Segmentation in Transvaginal Ultrasound Images: a Dataset and Benchmark

Yuan Tian, Yue Li, Wei Xia, Tianyu Xu, Jian Zhang, Liye Shi, Jing Liu, Yang Wang, Ming Liu, Qing Xu, Yixuan Zhang, Maggie M. He, Xiangjian He

2026-05-27视觉感知数据集/基准

剖宫产瘢痕憩室在经阴道超声中常因病灶小、形态不规则和操作者依赖而漏诊,且此前缺少公开分割数据。论文构建首个CSD超声分割数据集与基准:来自临床的1111张图像和16段视频,经匿名化筛选得到501个确诊阳性样本,并由超声医师与博士生按指南完成像素级标注。其主要结果是补齐该任务的数据与评测资源;具体算法增益在给定文本中未充分说明。

Once-For-All: A Train-Once and Select-Anytime Framework for Multimodal Instruction Tuning Figure 1
2026-05-27cs.CV

Once-For-All: A Train-Once and Select-Anytime Framework for Multimodal Instruction Tuning

Mingkang Dong, Hongyi Cai, Xiwen Lei, Jie Li, Tao Zhang, Muxin Pu

2026-05-27视觉语言

针对多模态指令数据冗余且现有选择信号随模型或数据集变化需重算的问题,OFA在冻结CLIP空间聚类生成伪标签,只训练一次轻量选择器,并用低置信度作为可迁移的信息量信号。实验显示仅用15% LLaVA-665K可达全量98.3%,迁移到未见Vision-Flan-186K还超过全量10.6%,并可跨Qwen2.5-VL与LLaVA模型复用。

No Figure
2026-05-27cs.CV

Self-Intersection-Aware 3D Human Motion Generation Using an Efficient Human Sphere Proxy

Pascal Herrmann, Maarten Bieshaar, Dennis Mack, Robert Herzog, Juergen Gall

2026-05-27三维

本文针对三维人体动作生成中常被常规指标掩盖的肢体自穿插问题,提出用少量球体近似人体网格,并在训练中加入与模型无关的自穿插惩罚。相比三角网格检测,该代理将损失计算提速约98%、显存降低83%,可接入 MDM 与 MoMask;实验显示生成动作自穿插最多减少49%,同时多数评测指标也有所改善。

CIRCLED: A Multi-turn CIR Dataset with Consistent Dialogues across Domains Figure 1
2026-05-27cs.CV

CIRCLED: A Multi-turn CIR Dataset with Consistent Dialogues across Domains

Tomohisa Takeda, Yu-Chieh Lin, Yuji Nozawa, Youyang Ng, Osamu Torii, Yusuke Matsui

\addr 1 Graduate School of Information Science and Technology, The University of Tokyo, Tokyo, Japan

2026-05-27数据集/基准

针对现有多轮组合图像检索数据集对话历史不一致且局限于时尚域的问题,CIRCLED 将每轮图文查询设计为持续逼近同一目标图像,并由 CIReVL 检索流程结合成功率、轮数、一致性和冗余过滤构建。数据扩展自 FashionIQ、CIRR、CIRCO,覆盖9个子集、22,608个2–6轮会话和202,845张图像;论文还给出多种基线及 Hits@10、Final Recall@10、AUC 评测,用于分析逐轮与最终检索表现。

Learning Reference-Guided Exposure Correction with Hybrid Illumination Characteristics Figure 1
2026-05-27cs.CV

Learning Reference-Guided Exposure Correction with Hybrid Illumination Characteristics

Hao Ren, Zetong Bi, Zhaoliang Wan, Hui Cheng

2026-05-27视觉感知

针对无配对监督下曝光校正难以在参考图像与源图像语义差异中分离“光照风格”的问题,HICNet用内容无关曝光编码器提取区域亮度、边缘对比和亮度高阶统计,并以源/参考嵌入差驱动FiLM调制与通道重平衡。实验称其在公开基准上优于或接近现有方法,并能泛化到未见场景。

Measuring Prediction Uncertainty in Neural Cellular Automata Figure 1
2026-05-27eess.IV

Measuring Prediction Uncertainty in Neural Cellular Automata

Ario Sadafi, Michael Deutges, Nassir Navab, Carsten Marr

2026-05-27安全鲁棒

针对NCA医学图像分割虽轻量但难判断预测是否可信的问题,论文把NCA视为动力系统,提出无需改结构或重训的resilience:扰动最终隐状态并继续迭代,若掩码能恢复则置信更高。五个生物医学分割基准上,该指标在选择性预测和失效检测中整体比多种基线更稳定,能更好标记低质分割案例。

Joint 2D-3D Segmentation and Association in Street-level Imaging Figure 1
2026-05-27cs.CV

Joint 2D-3D Segmentation and Association in Street-level Imaging

Amir Melnikov, Masayuki Tanaka, Yusuke Monno, Masatoshi Okutomi

2026-05-27视觉感知三维

面向街景影像构建空间数字孪生时,2D语义纹理与3D几何之间难以保持跨视角一致,且传统MOT依赖连续帧。论文将Grounded-SAM零样本分割与COLMAP SfM点轨结合,用共享3D点替代2D时序跟踪来关联同一建筑实例,并输出2D轨迹与3D分割点云;实验显示相较2D跟踪方法覆盖率和身份保持更稳,在复杂城市场景取得约22%性能提升。

METATR: A Multilingual, Evolving Benchmark for Automatic Text Recognition Figure 1
2026-05-27cs.CV

METATR: A Multilingual, Evolving Benchmark for Automatic Text Recognition

Mélodie Boillet, Solène Tarride, Christopher Kermorvant

2026-05-27视觉感知数据集/基准

针对现有ATR/OCR评测偏向现代英文或中文干净文本、难以指导真实档案场景选型的问题,METATR v1.0构建了覆盖29种语言、手写与印刷、复杂版面和历史文档的动态基准,并统一提示、归一化与评测协议。实验比较开源专用系统和Gemini、Claude等闭源模型,结果显示商用模型整体更稳定,但在不同文字、版式和手写场景仍差异明显,尚不能说明文本识别已被彻底解决。

Rotation-Invariant Spherical Watermarking via Third-Order SO(3) Representation Coupling Figure 1
2026-05-27cs.CV

Rotation-Invariant Spherical Watermarking via Third-Order SO(3) Representation Coupling

Pengzhen Chen, Yanwei Liu, Xiaoyan Gu, Antonios Argyriou, Wu Liu, Weiping Wang

2026-05-27视觉感知

针对全景图像水印在任意三维旋转下难以可靠提取的问题,论文将全景建模为球面信号,提出 TRIAD:把水印嵌入高阶球谐系数,并通过三阶 SO(3) 表示耦合投影到平凡表示,构造保相位的球面双谱不变量。实验显示其在连续旋转攻击下接近完美鲁棒,同时保持较高视觉保真度。

PinPoint: Prompting with Informative Interior Points Figure 1
2026-05-27cs.CV

PinPoint: Prompting with Informative Interior Points

Pouya Sadeghi, Shawn He, Pedro Pablo Guerrero Vela, C. Thomas, Alex Wong, Sirisha Rambhatla

University of Waterloo, Critical ML, University of Waterloo

2026-05-27视觉感知

针对VLM+SAM指代表达分割中训练自由方法落后于微调/RL方法的问题,论文指出主要瓶颈不是骨干能力,而是VLM框提示的歧义。PinPoint无需训练,融合显著性、边缘、熵和空间先验选取稳定且分散的内部点,并由冻结VLM标注正负后提示SAM。结果显示在RefCOCO/+/g上相对朴素采样提升12–18 cIoU,并以每次查询两次VLM调用接近监督和RL专门方法。

SteelDS: A High-Resolution Video Dataset of E40 Steel Scrap for Object Detection and Instance Segmentation Figure 1
2026-05-27cs.RO

SteelDS: A High-Resolution Video Dataset of E40 Steel Scrap for Object Detection and Instance Segmentation

Melanie Neubauer, Christian Rauch, Gerald Koinig, Alexia Tischberger-Aldrian, Roland Pomberger, Elmar Rueckert

2026-05-27视觉感知数据集/基准

面向钢铁回收中磁选后仍需人工剔除铜杂质的环节,SteelDS补足了工业破碎金属缺少公开实例级标注数据的空白。其核心贡献是采集传送带上高分辨率视频,并为E40钢/铜碎片提供像素级实例掩码、类别和尺寸分组,覆盖不同密度、间距与遮挡条件。数据集包含5个子集、24297帧、396个钢件和101个铜件,可作为目标检测、实例分割和多目标跟踪的基准;文中主要给出数据资源与任务支撑,未充分说明模型性能增益。

DynFrame: Adaptive Reasoning-Driven Multimodal Framework with Dynamic Frame Augmentation for Complex Video Understanding Figure 1
2026-05-27cs.CV

DynFrame: Adaptive Reasoning-Driven Multimodal Framework with Dynamic Frame Augmentation for Complex Video Understanding

Peng Zhang, Guanghao Zhang, Wanggui He, Longxiang Zhang, Mushui Liu, Yan Xia, Zhenhao Peng, Weilong Dai, Jinlong Liu, Haobing Tang, Le Zhang, Hao Jiang, Pipei Huang

Zhejiang University

2026-05-27视觉语言视觉感知

针对长视频推理中固定稀疏采样易漏掉短时细节、反复检索又拉长上下文且信用分配混乱的问题,DynFrame让模型在自回归推理中直接生成时间片段和采样密度token,并用动态帧注入获取多粒度证据;SD-GRPO按检索边界分别奖励采样决策与答案生成。文中在六个视频理解/时序定位基准上显示,4B模型可接近强7B–8B基线,8B在多数指标达到新SOTA。

Memory-Distilled Selection for Noise-Robust Anomaly Detection Figure 1
2026-05-27cs.CV

Memory-Distilled Selection for Noise-Robust Anomaly Detection

Sirojbek Safarov, Jaewoo Park, Yoon Gyo Jung, Kuan-Chuan Peng, Wonchul Kim, Seongdeok Bang, Octavia Camps

2026-05-27视觉感知安全鲁棒

工业视觉异常检测常假设训练集全为正常样本,但实际产线标注筛查难免混入缺陷,导致模型随噪声比例升高明显退化。MeDS用随机子采样构建稀疏记忆库集成,将其近邻距离视作低通式噪声过滤信号,再蒸馏到重建评分网络,并通过自筛选干净样本迭代微调以兼顾图像级鲁棒性和像素级定位。实验显示其无需按噪声率调参,在MVTecAD 40%噪声下图像AUROC达99.16%,并在VisA、Real-IAD噪声设置取得SOTA。

Respecting Modality Gap in Post-hoc Out-of-distribution Detection with Pre-trained Vision-Language Models Figure 1
2026-05-27cs.CV

Respecting Modality Gap in Post-hoc Out-of-distribution Detection with Pre-trained Vision-Language Models

Yuanwei Hu, Bo Peng, Yadan Luo, Zhen Fang, Ling Chen, Jie Lu

2026-05-27视觉语言视觉感知

面向CLIP等视觉语言模型的零样本后验OOD检测,论文指出常用“类别文本嵌入即视觉原型”的假设存在结构性模态鸿沟,难靠提示词消除;据此提出利用测试时无标注数据流和VLM软预测在线学习视觉空间类别原型,并给出收敛分析。实验在多种OOD设置达SOTA,ImageNet-1K上FPR95为12.79%、AUROC为97.75%,较AdaNeg进一步提升。

DV-SFT: Direct Vision Supervision for Fine-Grained Visual Understanding Figure 1
2026-05-27cs.CV

DV-SFT: Direct Vision Supervision for Fine-Grained Visual Understanding

Jianfei Zhao, Feng Zhang, Xin Sun, Chong Feng, Bing Wang, Zhixing Tan

School of Computer Science and Technology, Beijing Institute of Technology, Zhongguancun Academy, Beihang University, Zhongguancun Laboratory, Southeast Academy of Information Technology, Beijing Institute of Technology

2026-05-27视觉感知

本文针对多模态大模型训练中视觉 token 只通过文本答案间接受监督、易丢失细粒度信息的问题,提出 DV-SFT:利用 OCR 场景中图像 patch 与文字的直接对应,为视觉 token 自动构造词级标签,并用与文本相同的 next-token loss 训练,无需改结构或额外前向。实验显示其在多个文档理解、OCR、图表和泛化 VQA 基准上稳定优于标准 SFT,分析表明收益主要来自更精细的视觉表征与更高效的跨模态对齐。

Adaptation-Free Heterogeneous Collaborative Perception with Unseen Agent Configurations Figure 1
2026-05-27cs.CV

Adaptation-Free Heterogeneous Collaborative Perception with Unseen Agent Configurations

Hyunchul Bae, Heejin Ahn

School of Electrical Engineering, Korea Advanced Institute of Science and Technology (KAIST)

2026-05-27视觉感知

面向开放世界协同3D感知中新增车辆/路侧端传感器规格、编码器结构未知的问题,论文提出ALF:不再传输配置相关的中间特征,而用紧凑3D框消息生成伪BEV,并结合自车特征合成兼容的辅助特征,实现免适配的晚到中间融合。在V2X-Real的64个零样本配置案例中,ALF相对最强基线mAP@0.7提升35.91%,每智能体每帧仅需120字节通信。

OmniRetriever: Any-to-Any Audio-Video-Text Retrieval via Fusion-as-Teacher Distillation Figure 1
2026-05-27cs.CV

OmniRetriever: Any-to-Any Audio-Video-Text Retrieval via Fusion-as-Teacher Distillation

Yunze Liu, Chi-Hao Wu, Enmin Zhou, Junxiao Shen

2026-05-27视觉感知

现有统一音频-视频-文本检索模型虽能生成三模态联合嵌入,但训练多只做两两 InfoNCE,导致联合表示及音频相关方向监督不足。OmniRetriever 将停止梯度的联合嵌入作为教师蒸馏到单模态嵌入,并用 Tuple-InfoNCE 直接约束联合表示。7B 模型在 Clotho、SoundDescs 上较 Gemini Embedding 2 提升 13.3–18.0 R@1,在自建 12 方向 OmniRetriever-Bench 上 AVG-all 达 34.84。

JetViT: Efficient High-Resolution Vision Transformer with Post-Training Attention Search Figure 1
2026-05-27cs.CV

JetViT: Efficient High-Resolution Vision Transformer with Post-Training Attention Search

Dongyun Zou, Zhuoyang Zhang, Junyu Chen, Wenkun He, Qinhe Peng, Hanrong Ye, Yao Lu, Hongxu Yin, Yu Wang, Song Han, Han Cai

University of Pennsylvania

2026-05-27视觉感知

高分辨率 ViT 的全注意力在视觉基础模型中精度强但推理开销随序列长度二次增长,限制部署。JetViT 的关键思路不是从头训练高效架构,而是在预训练模型后进行注意力搜索,用线性、窗口注意力替换冗余全注意力,并保留少量关键全注意力块。在 DINOv3 与 DepthAnythingV2 上,H100 实测最高吞吐提升 1.79×、延迟降低 44.81%,且基本不损失精度。

Attenuation-Resilient Alternating Optimization for Laparoscopic Liver Landmark Detection Figure 1
2026-05-27cs.CV

Attenuation-Resilient Alternating Optimization for Laparoscopic Liver Landmark Detection

Lanqing Liu, Ruize Cui, Jialun Pei, Diandian Guo, Tiffany Y. So, Pheng-Ann Heng, Jing Qin

2026-05-27视觉感知优化算法

面向腹腔镜肝脏 AR 导航中地标受暗区光照衰减、纹理干扰和像素分割与连续曲线几何不匹配影响的问题,论文提出 A2ONet:用 IFC 做照明场补偿,FOSF 强化方向/频率选择的曲线线索,并以 ASCO 在分割与显式曲线建模间交替优化,兼顾连续性和端点定位。在 L3D-2K、L3D、P2ILF 上均优于对比方法,L3D-2K 达到 53.51% DSC、38.32% IoU。

DelowlightSplat: Feed-Forward Gaussian Splatting for Lowlight 3D Scene Reconstruction Figure 1
2026-05-27cs.CV

DelowlightSplat: Feed-Forward Gaussian Splatting for Lowlight 3D Scene Reconstruction

Fuzhen Jiang, Zengtian Xie, Zhuoran Li

2026-05-27三维

论文针对低照度下稀疏位姿图像的前馈3D Gaussian重建容易受噪声、偏色和匹配失效影响的问题,提出DelowlightSplat:先构造仅退化输入视图、保持目标视图干净的可控低光多视图基准,再用轻量Lowlight Adapter提升跨视图可匹配性,并结合代价体多视图推理直接预测正常照明的3D高斯。实验显示其在低光新视角合成中优于直接MVSplat和先增强再重建流程。

MSCGC-KAN: Multi-scale Causal Graph Convolution and Kolmogorov-Arnold Feature Mapping for EEG Emotion Recognition Figure 1
2026-05-27cs.CV

MSCGC-KAN: Multi-scale Causal Graph Convolution and Kolmogorov-Arnold Feature Mapping for EEG Emotion Recognition

Haoliang Gong, Qingshan She, Jiale Xua, Yunyan Gao, Xugang Xi

School of Automation, Hangzhou Dianzi University, Hangzhou 310018, China, Zhejiang Provincial Key Laboratory of Brain Computer Collaborative Intelligence Technology and Applications

2026-05-27视觉感知

针对预训练 EEG 模型微调时线性头难以捕捉多尺度情绪动态与通道功能连接的问题,MSCGC-KAN在 CBraMod 后加入多尺度因果图卷积和 Kolmogorov-Arnold 非线性映射,强化时空判别特征。FACED 上平衡准确率达60.66%,较线性头提升5.91个百分点;SEED-VII 达33.27%,提升2.03个百分点。

MedVol-R1: Reward-Driven Evidence Grounding for Volumetric Reasoning Segmentation Figure 1
2026-05-27cs.CV

MedVol-R1: Reward-Driven Evidence Grounding for Volumetric Reasoning Segmentation

Zichun Wang, Hairong Shi, Bingzheng Wei, Yan Xu, Zihua Wang

2026-05-27视觉语言视觉感知强化学习

针对3D医学扫描中自由文本查询往往隐含目标、现有分割token难以解释且泛化受限的问题,MedVol-R1将临床推理先落到可验证的关键轴向切片和2D框,再由冻结MedSAM2传播成3D掩码;训练上用冷启动SFT接GRPO,并以证据选择、定位和跨切片一致性奖励替代人工CoT。其在CT-ORG、AbdomenCT-1K、KiTS23上优于强基线,RL相较纯SFT带来明确增益。

Gaussian-Voxel Duet: A Dual-Scaffolding Hybrid Representation for Fast and Accurate Monocular Surface Reconstruction Figure 1
2026-05-27cs.CV

Gaussian-Voxel Duet: A Dual-Scaffolding Hybrid Representation for Fast and Accurate Monocular Surface Reconstruction

Zhenhua Du, Zhen Tan, Haoyu Zhang, Dewen Hu, Shuaifeng Zhi, Peidong Liu

2026-05-27三维

该文针对单目多视图重建中 3DGS 几何不准、神经 SDF 又训练昂贵的矛盾,提出 Gaussian-anchor 与稀疏体素 SDF 的双脚手架表示,通过显式锚点约束和隐式表面牵引把高斯限制在表面窄带内,减少 floaters 并保留渲染灵活性。在 ScanNet++、ScanNetv2 和 DeepBlending 上,方法取得领先的表面重建与新视角合成效果,同时保持快速收敛和实时渲染。

FTibSuite: A Comprehensive Resource Suite for Tibetan Vision-Language Modeling Figure 1
2026-05-27cs.CV

FTibSuite: A Comprehensive Resource Suite for Tibetan Vision-Language Modeling

Guixian Xu, Yide Liang, Zeli Su, Xuexian Song, Ziyin Zhang, Yushuang Dong, Ting Zhang, Xu Han

Hainan International College, Minzu University of China, School of Information Engineering, Minzu University of China, Shanghai Jiao Tong University, Institute of Automation, Chinese Academy of Sciences

2026-05-27视觉语言视觉感知

针对藏语视觉语言研究缺少训练数据、对齐语料与可复现实验基准的问题,FTibSuite同时发布FTibData、FTibBench和基于Qwen3-VL-8B-Instruct的FTibVLM,采用藏语继续预训练、图文对齐、 multimodal 指令微调三阶段流程,并用机器筛查加人工校验控制基准翻译噪声。实验显示该流程显著提升藏语多模态能力,MMBench由42.97升至67.78,POPE-random由47.53升至80.56,BinaryVQA达76.01;但增益可能主要来自数据与适配流程,单独创新来源仍需更多消融说明。

O-MARC: Omni Memory-Augmented Compression Distillation for Efficient Video Understanding Figure 1
2026-05-27cs.CV

O-MARC: Omni Memory-Augmented Compression Distillation for Efficient Video Understanding

Peiran Wu, Yunze Liu, Chi-Hao Wu, Chen Chen, Junxiao Shen

University of Bristol, University of Central Florida

2026-05-27视觉感知

面向全模态视频理解中音视频联合 token 过长、现有评测难以隔离真实音画关联的问题,论文构建经“去音频”筛选的 UGC-AVQA,并提出免训练 OMAC 用视觉记忆分布保留关键画面与音频锚点,再以 O-MARC 做压缩感知蒸馏。结果显示在 Qwen2.5-Omni-3B 上四项平均分 45.8,高于全 token 44.1 与 OmniZip 41.0,同时 OMAC 降低约 34.6% 延迟和 34.7% 显存。

TrackRef3D: Multi-View Consistent Track-then-Label for Open-World Referring Segmentation in 3D Gaussian Splatting Figure 1
2026-05-27cs.CV

TrackRef3D: Multi-View Consistent Track-then-Label for Open-World Referring Segmentation in 3D Gaussian Splatting

Yuyang Tan, Renhe Zhang, Hang Zhang, Ao Li, Xin Tan

2026-05-27视觉感知强化学习三维

针对现有 R3DGS 依赖逐场景人工标注、逐视角伪掩码易产生多视角不一致且对短/长查询泛化不足的问题,TrackRef3D 将对象发现与语义落地解耦为“先跟踪后标注”:用视频轨迹聚合同一物体的跨视角预测,经同义聚类与轨迹投票确定统一语义,并结合可见性描述生成和多正样本对比训练同时学习类别与细粒度指代表达。文中在 Ref-LERF、LERF-OVS、3D-OVS 等基准及室内场景上报告达到 SOTA。

Scheduled Style Injection: Expanding the Style-Content Pareto Frontier in Training-Free Diffusion-based Style Transfer Figure 1
2026-05-27cs.CV

Scheduled Style Injection: Expanding the Style-Content Pareto Frontier in Training-Free Diffusion-based Style Transfer

Amey Sunil Kulkarni

2026-05-27生成模型

本文针对 StyleID 在所有层和去噪步使用统一 γ 导致风格强度与内容保持被固定绑定的问题,系统研究按解码层、时间步调度风格注入及 ControlNet 几何条件。核心洞察是浅层和早期步应更强保护结构、后期再释放风格,且 γ 调度与 ControlNet 近似正交。35 组、2.8 万余图实验显示最佳配置 ArtFID 从 28.801 降至 27.036,并在多个 SD 版本上保持排序一致。

Recursive Flow Matching Figure 1
2026-05-27cs.LG

Recursive Flow Matching

Jiahe Huang, Sihan Xu, Sharvaree Vadgama, Rose Yu

University of California, San Diego, University of Michigan

2026-05-27生成模型

面向物理时空动力学预测,论文针对扩散/流匹配在少步采样下速度与保真度难兼顾的问题,提出 Recursive Flow Matching:递归构造不同离散尺度的轨迹族,并在共享状态处施加跨尺度自一致约束,以降低离散误差和滚动累积误差。实验称在科学仿真基准上可用 1–4 步达到接近多步求解器的精度,相比扩散模拟器最高加速 20 倍,并较普通流匹配降低 15% 以上 MSE。

A Hybrid Vision-Language Architecture for Automated Defect Reasoning and Report Generation in Industrial Inspection Figure 1
2026-05-27cs.CV

A Hybrid Vision-Language Architecture for Automated Defect Reasoning and Report Generation in Industrial Inspection

Malikussaid, Imad Gohar

2026-05-27视觉语言视觉感知

针对风机叶片巡检中“检测有框、报告靠人”以及通用VLM易丢失小缺陷、产生维护幻觉的问题,论文提出解耦的 Eyes-Bridge-Brain 架构:用YOLO26-OBB保留原分辨率定位,确定性网格 token 连接空间证据,再以QLoRA微调的4-bit Qwen生成JSON报告并用RAFT对齐42条规程。实验显示完整系统BLEU-4达0.41、幻觉率4%、专家分8.6/10,明显优于零样本VLM基线。

ReCA: Multi-Shot Long Video Extrapolation via Recursive Context Allocation Figure 1
2026-05-27cs.CV

ReCA: Multi-Shot Long Video Extrapolation via Recursive Context Allocation

Akide Liu, Jinbo Xing, Chaojie Mao, Ye Li, Zeyu Zhang, Yefei He, Weijie Wang, Zihan Wang, Yu Liu, Gholamreza Haffari, Bohan Zhuang

2026-05-27视觉感知

本文针对分钟级电影化视频生成中“保留初始画面状态”和“多镜头叙事结构”难以兼得的问题,提出 MSVE 任务,并指出瓶颈不只是上下文长度,而是上下文分配失当。ReCA 在推理阶段对冻结短视频生成器做递归上下文分配,分层规划、选择当前镜头相关状态并持续刷新结构化记忆。在 MSVE-Bench 等评测中,其平均归一化得分较最强基线提升 8–16%,多镜头一致性指标提升 28–43%。

CmIVTP: Cross-modal Interaction-based Vessel Trajectory Prediction for Maritime Intelligence Figure 1
2026-05-27cs.CV

CmIVTP: Cross-modal Interaction-based Vessel Trajectory Prediction for Maritime Intelligence

Yuxu Lu, Dong Yang, Xiaoyu Li, Mengwei Bao, Congcong Zhao

2026-05-27规划控制

面向繁忙水域中 AIS 稀疏、延迟或缺失以及单纯 CCTV 难以刻画船舶动力学的问题,CmIVTP 将 AIS 运动信息、CCTV 环境语义和目标感知场景特征通过跨模态注意力融合,并用不确定性变分解码器与历史轨迹聚类库生成可行候选轨迹;论文还构建同步 AIS-CCTV 的 Maritime-MmD+ 数据集,实验显示其在多模态船舶轨迹预测基准上优于对比方法。

InterSketch: An Interleaved Reasoning Model with Self-correcting Visual Sketch and Stepwise Reward Figure 1
2026-05-27cs.CV

InterSketch: An Interleaved Reasoning Model with Self-correcting Visual Sketch and Stepwise Reward

Zhiwei Ning, Wenwen Tong, Xiangli Kong, Shengnan Ma, Ziyi Shang, Jingcheng Ni, Tao Hu, Yong Xien Chng, Jixuan Ying, Zehuan Wu, Hanming Deng, Jie Yang, Yuanjie Zheng, Wei Liu, Lewei Lu

Shanghai Jiao Tong University, Shandong Normal University

2026-05-27强化学习

论文针对现有 VLM 视觉推理过度依赖文本 CoT、工具使用浅且长程任务奖励稀疏的问题,提出 InterSketch:在推理中交替生成文本理由并调用裁剪、旋转、几何标注等确定性工具形成可校正视觉草图;训练上先用含错误恢复轨迹的合成 VT-CoT 数据冷启动,再用按工具类型设计的逐步奖励做强化学习。实验称其在多项复杂视觉推理基准达到 SOTA,并超过 Gemini-3-Pro,同时保持通用理解能力。

$R^3$: 3D Reconstruction via Relative Regression Figure 1
2026-05-27cs.CV

$R^3$: 3D Reconstruction via Relative Regression

Congrong Xu, Huachen Gao, Xingyu Chen, Yuliang Xiu, Jun Gao, Anpei Chen

University of Michigan, Westlake University, Research done during an internship at Westlake University.Corresponding author.

2026-05-27三维

针对前馈三维重建在长序列/流式场景中依赖全局坐标、平移尺度随时间增大而难以回归的问题,R³将位姿学习改为成对相对位姿回归,并用轻量 MLP 预测旋转/平移置信度,统一用于训练加权、推理聚合和关键帧管理。该方法同一模型支持离线全上下文与因果有界内存流式重建,372M 参数下在位姿估计和稠密重建上达到或超过多种基线,并可处理千帧级视频。

CSV-ViT: A Vision Transformer with the Variable-sized Cortical Supervertices for Detection of Alzheimer's Disease Pathologies Figure 1
2026-05-27cs.CV

CSV-ViT: A Vision Transformer with the Variable-sized Cortical Supervertices for Detection of Alzheimer's Disease Pathologies

Geonwoo Baek, Ikbeom Jang

2026-05-27视觉感知

针对 PET/CSF 确诊阿尔茨海默病成本高、侵入性强,而皮层表面 ViT 固定分块易混合 ROI、重复边界顶点并纳入内侧壁等非皮层区域的问题,论文提出 ROI 保持的可变大小 cortical supervertices,并用 padding 与 mask-aware embedding 构建 CSV-ViT。基于 T1 MRI 的皮层厚度和曲率,在 AD 诊断、淀粉样蛋白阳性、tau 阳性三项二分类中,CSV-ViT 相比 SiT、MS-SiT、DiffusionNet、SurfGNN 表现更高,但具体增益幅度需结合表格细读。

Re-M3Dr: Rebalanced MultiModal Mean Deviation Regression Figure 1
2026-05-27cs.CV

Re-M3Dr: Rebalanced MultiModal Mean Deviation Regression

Haojie Yin, Chengcheng Feng, Tianyi Liu, Tianqi Zhang, Kaizhu Huang

2026-05-27视觉语言三维

该文关注OCT与眼底照相融合预测青光眼视野平均偏差时,常规多模态反而弱于单模态的现象,指出根因是长尾数据分布与模态学习冲突耦合,导致梯度各向异性和尖锐极小值。Re-M3Dr先用自适应边界监督对比学习稳固单模态表征,再以感知尖锐度的梯度调制做联合优化;在公私有临床数据上较SOTA多模态方法平均降低29% MSE。

Uncertainty-Aware Gaussian Map for Vision-Language Navigation Figure 1
2026-05-27cs.CV

Uncertainty-Aware Gaussian Map for Vision-Language Navigation

Jianzhe Gao, Rui Liu, Yuxuan Xu, Tongtong Cao, Yingxue Zhang, Zhanguang Zhang, Sida Peng, Yi Yang, Wenguan Wang

The State Key Lab of Brain-Machine Intelligence, Zhejiang University, Department of Foundation model, 2012 Labs, Huawei, Noah’s Ark Lab, 2012 Labs, Huawei, School of Software Technology, Zhejiang University

2026-05-27机器人视觉语言视觉感知三维安全鲁棒

针对VLN智能体在相似目标、遮挡和可通行性判断中常忽略感知不确定性的问题,本文用3D高斯构建语义地图,并显式估计几何、语义与外观三类不确定性,将其转化为3D Value Map中的约束与可供性来辅助决策。在R2R、RxR、REVERIE上分别带来SR/SPL、SR/nDTW及RGS/RGSPL的小幅提升,说明收益存在但幅度有限。

Unveiling the Fragility of Vision-Language Models: Multi-Modal Adversarial Synergy via Texture-Constrained Perturbations and Cross-Modal Optimization Figure 1
2026-05-27cs.CV

Unveiling the Fragility of Vision-Language Models: Multi-Modal Adversarial Synergy via Texture-Constrained Perturbations and Cross-Modal Optimization

Xiang Fang, Wanlong Fang, Changshuo Wang

2026-05-27视觉语言视觉感知优化算法

面向LVLM在自动驾驶、内容审核等场景中可能遭遇的图文协同攻击,论文提出MMAS:在仅查询模型的黑盒条件下,联合优化纹理尺度约束的图像通用扰动与嵌入空间文本提示扰动,并用跨模态正则对齐两类扰动方向。实验称其在CLIP、Flamingo等模型及图像描述、VQA、文本引导分类任务上,相比单模态或简单组合攻击具有更高成功率和迁移性。

3D Gaussian Map with Open-Set Semantic Grouping for Vision-Language Navigation Figure 1
2026-05-27cs.CV

3D Gaussian Map with Open-Set Semantic Grouping for Vision-Language Navigation

Jianzhe Gao, Rui Liu, Wenguan Wang

The State Key Lab of Brain-Machine Intelligence, Zhejiang University

2026-05-27机器人视觉语言视觉感知三维

针对VLN中现有拓扑/语义/隐式地图难以同时刻画精细3D几何、开放词汇语义且计算冗余的问题,论文用稀疏伪激光点云在线初始化自中心3D Gaussian Map,并通过开放集语义分组把高斯基元关联到物体实例或stuff类别,再以场景、视角、实例三级动作预测辅助决策。在R2R、R4R、REVERIE的未见验证集上分别带来约2% SR/SPL、3% SDTW及约2.0% RGS、2.3% RGSPL提升。

Beyond Pairwise Preferences: Listwise Reward-Aware Alignment for Diffusion Models Figure 1
2026-05-27cs.LG

Beyond Pairwise Preferences: Listwise Reward-Aware Alignment for Diffusion Models

Austin Wang, Jiaqi Han, Stefano Ermon, Yisong Yue

Stanford University

2026-05-27生成模型强化学习

本文针对扩散模型偏好对齐中过度依赖二元胜负对、浪费同一提示下多候选图像及连续奖励信息的问题,提出 Diffusion LAIR:将候选组奖励转为中心化优势权重,并用带二次正则的隐式奖励回归同时更新全列表样本,从而控制偏好更新幅度。实验显示其在 SD1.5/SDXL 的文生图、组合生成和图像编辑任务上优于多种偏好优化基线。

LongCat-Video-Avatar 1.5 Technical Report Figure 1
2026-05-27cs.CV

LongCat-Video-Avatar 1.5 Technical Report

Meituan LongCat Team : Xunliang Cai, Meng Cheng, Feng Gao, Zhe Kong, Jiamu Li, Le Li, Weiheng Li, Hongyu Liu, Shuai Tan, Xiaoming Wei, Tianyu Yang, Yong Zhang

2026-05-27视觉感知

面向数字人落地中长视频身份漂移、口型不同步、全身时序不稳和推理成本高的问题,LongCat-Video-Avatar 1.5强调系统工程而非新结构:以Whisper-large替换音频编码器,配合严格数据清洗、规模化训练、GRPO偏好优化和DMD步数蒸馏至8 NFE,增益可能主要来自scaling/data与训练配方。500余例评测显示其在人像真实感、稳定性和专家质量指标上达到或超过HeyGen、OmniHuman 1.5等闭源系统。

OmniInteract: Benchmarking Real-World Streaming Interaction for Real-Time Omnimodal Assistants Figure 1
2026-05-27cs.CV

OmniInteract: Benchmarking Real-World Streaming Interaction for Real-Time Omnimodal Assistants

Xudong Lu, Xueying Li, Annan Wang, Yang Bo, Jinpeng Chen, Zengliang Li, Nianzu Yang, Rui Liu, Xue Yang, Jingwen Hou, Hongsheng Li

CUHK MMLab

2026-05-27强化学习数据集/基准

现有视频问答/流式评测多依赖离线片段或文本提示,难以衡量实时助手在原始音视频中何时听懂、何时回答以及如何处理中断。OmniInteract以“触发—响应窗口—目标答案”的时序交互槽构建250段视频、1430个槽,覆盖实时、主动、嵌套与连续任务监控,并用IA-QTF1等指标联合评估质量和时机。实验显示当前模型差距明显,最佳总体IA-QTF1仅0.368,1QnA仅0.052,离线能力难以直接迁移到在线全双工交互。

Clinically-Grounded Counterfactual Reasoning for Medical Video Diagnosis Figure 1
2026-05-27cs.CV

Clinically-Grounded Counterfactual Reasoning for Medical Video Diagnosis

Jianzhe Gao, Churan Wang, Weiyi Zhang, Jianghua Li, Li-An Li, Wenguan Wang, Yixin Zhu, Yizhou Wang

Center for Data Science in Clinical Medicine, Peking University Third Hospital, The State Key Lab of Brain-Machine Intelligence, Zhejiang University, Department of Gynecology and Obstetrics, 7th Medical Center of Chinese PLA General Hospital, School of Computer Science, Peking University, School of Psychological and Cognitive Sciences, Peking University, State Key Lab of General AI, Peking University, Nat’l Eng. Research Center of Visual Technology, Beijing Key Laboratory of Behavior and Mental Health, Peking University, Embodied Intelligence Lab, PKU-Wuhan Institute for Artificial Intelligence

2026-05-27视觉感知

针对医学视频诊断中模型容易把光照、试剂反应或相机运动误当病理线索的问题,论文提出 MEDVCR,将临床规则约束与反事实推理结合:用扩散生成不同病理状态下的组织演化,并通过时序一致性、病理可分性和事实/反事实对比学习诊断表示。在阴道镜活检点定位上 Recall@1 达 93.0%(+10.2%),结肠镜息肉帧检测 AP 达 94.8%(+2.6%)。

Efficient On-policy Visual-RL via Stochastic Decoupled Policy Gradient Figure 1
2026-05-27cs.RO

Efficient On-policy Visual-RL via Stochastic Decoupled Policy Gradient

Haoxiang You, Yilang Liu, Davis Zong, Qian Wang, Teeratham Vitchutripop, Qi Wang, Daniel Rakita, Ian Abraham

2026-05-27强化学习优化算法

面向视觉输入的端到端机器人强化学习通常受渲染并行数、显存和可微仿真限制。本文提出 SDPG,用少量批量渲染环境评估回报、用物理环境随机扰动轨迹来估计解耦策略梯度,并配合自适应探索和奖励归一化稳定训练。实验显示其在视觉 MuJoCo 上较基线提升奖励、训练时间和显存效率,并在灵巧操作、运动任务及 Unitree Go2 上展示仿真到现实迁移。

Comparative Study of Vision-Based Metric Measurement for Large-Scale Planar Scenes Figure 1
2026-05-27cs.CV

Comparative Study of Vision-Based Metric Measurement for Large-Scale Planar Scenes

ZhiXin Sun

2026-05-27视觉感知

面向水库结冰面积等百米级平面场景测量,论文比较了PTZ相机下单目几何测距、鸟瞰拼接和双单目标定类立体测距三种方案。核心洞察是误差主因并非模型复杂度,而是俯仰角、标定与大范围拼接累积误差;实验显示单目在足够俯角下可达米级,拼接小场景稳但规模化变慢且不稳,类立体方案达分米级且对俯仰角更鲁棒。

Triadic Dynamics Aware Diffusion Posterior Sampling for Inverse Problems: Optimizing Guidance and Stochasticity Schedules Figure 1
2026-05-27cs.CV

Triadic Dynamics Aware Diffusion Posterior Sampling for Inverse Problems: Optimizing Guidance and Stochasticity Schedules

Junseo Bang, Dong Ju Mun, Hoigi Seo, Seongmin Hong, Se Young Chun

2026-05-27生成模型

针对扩散/流匹配后验采样在成像逆问题中常把数据一致性、CFG 与随机性设为固定或局部调度而次优的问题,论文指出早期过强 CFG 会与数据一致性冲突,而适度随机性可把轨迹拉回高概率区域;提出 TriPS,将三者视为时变控制,采用 DC 与随机性递减、CFG 递增的三元调度,并用模板搜索和 GRPO 优化曲线。实验显示其在多类逆问题上较现有方法提升数据保真与感知真实度。

AnchorDiff: Training-Free Concept Grounding for MM-DiTs via Anchor-Based Graph Propagation Figure 1
2026-05-27cs.CV

AnchorDiff: Training-Free Concept Grounding for MM-DiTs via Anchor-Based Graph Propagation

Jian Zhang, Zhijun Zhang

School of Automation Science and Engineering, South China University of Technology

2026-05-27视觉语言

针对MM-DiT中基于注意力的概念定位在相似物体间易“概念泄漏”的问题,AnchorDiff将语义定位与结构细化解耦:先用概念到图像注意力选取高置信锚点,再在由图像自注意力构建的混合图上传播单点种子,以行注意力门控抑制跨物体扩散、用输出空间相似性保持物体内连通。实验显示其在ImageNet-Segmentation和PascalVOC上保持较强无训练定位性能,并在新建混淆数据集上显著降低非目标激活。

Sparse-LiDAR Prompting of Monocular Geometry Foundations: An Empirical Study Toward Long-Range Driving Depth Figure 1
2026-05-27cs.CV

Sparse-LiDAR Prompting of Monocular Geometry Foundations: An Empirical Study Toward Long-Range Driving Depth

Kai Zheng, Qiang Feng, Xingjian Liu, Wenquan Tan, Yuan Li

Benewake (Beijing) Co., Ltd.

2026-05-27视觉感知

面向自动驾驶中50–150米远距深度估计缺少分段评测、且既有稀疏LiDAR提示多依赖预插值稠密先验的问题,论文提出SLIM,将MoGe-2改造成可直接接收真实稀疏LiDAR的点图基础模型,通过PartialConv稀疏编码器与五尺度融合颈注入几何信息,并用随机注入率训练适配不同密度。在Virtual KITTI和CARLA上,100–150米AbsRel较MoGe-2降低约39–51%,消融也显示PartialConv在多数稀疏率下优于预插值。

Design First, Code Later: Aesthetically Pleasing Template-Free Slides Generation Figure 1
2026-05-27cs.HC

Design First, Code Later: Aesthetically Pleasing Template-Free Slides Generation

Zhiyao Cui, Chenxu Wang, Shuyue Hu, Yiqun Zhang, Wenqi Shao, Qiaosheng Zhang, Zhen Wang

School of Cybersecurity, Northwestern Polytechnical University, Shanghai Artificial Intelligence Laboratory, Fudan University

2026-05-27视觉感知

针对现有自动生成幻灯片依赖固定模板或直接产出代码、导致版式创造力和视觉一致性不足的问题,论文提出 DeepSlides:先在高层语义空间完成页面风格、布局层级与视觉元素设计,再由 coder 转为 PPTX/图像实现,并构建 SlideDesign 数据集与多智能体强化学习训练的 SlideQwens。实验和 20 人偏好评测显示,其在布局、层级、配色和整体美观上优于开源及部分商业基线。

Cross-scale Aligned Supervision for Training GANs Figure 1
2026-05-27cs.CV

Cross-scale Aligned Supervision for Training GANs

Sangeek Hyun, MinKyu Lee, Jae-Pil Heo

Sungkyunkwan University

2026-05-27视觉感知生成模型

本文针对多阶段 GAN 中“逐尺度对抗监督即粗到细生成”的常见假设提出质疑,指出各尺度虽可各自逼真,却可能不对应同一生成样本,形成跨尺度轨迹错位。作者提出 CAT,在保留逐尺度判别器反馈的同时加入生成器侧一致性正则,使中间输出对齐最终图像。ImageNet-256 上 CAT-H/2 仅训练 60 个 epoch、单步推理即达 FID-50K 1.56,优于多种单步 GAN 与扩散/flow 基线。

Underwater360: Reconstructing Underwater Scenes from Panoramic Images with Omnidirectional Gaussian Splatting Figure 1
2026-05-27cs.CV

Underwater360: Reconstructing Underwater Scenes from Panoramic Images with Omnidirectional Gaussian Splatting

Jiangbei Hu, Weichao Song, Shibo Yu, Mohan Wang, Zihan Yi, Rui Wu, Mingkang Xiang, Na Lei, Shengfa Wang, Zhongxuan Luo, Ying He

School of Software, Dalian University of Technology, College of Computing and Data Science, Nanyang Technological University

2026-05-27视觉感知三维

水下三维重建受窄视角采集、散射与吸收影响,易出现几何缺失和跨视角外观不一致。Underwater360将全景图像与3D Gaussian Splatting结合,在球面相机空间直接做全向ray casting,并用物理成像模型和位姿条件外观嵌入分离本征辐射、衰减与后向散射。论文还构建合成与真实水下360°基准,实验显示其在新视角合成、外观恢复和一致性上优于对比方法。

Rethinking Weakly-supervised Video Temporal Grounding From a Game Perspective Figure 1
2026-05-27cs.CV

Rethinking Weakly-supervised Video Temporal Grounding From a Game Perspective

Xiang Fang, Zeyu Xiong, Wanlong Fang, Xiaoye Qu, Chen Chen, Jianfeng Dong, Keke Tang, Pan Zhou, Yu Cheng, Daizong Liu

2026-05-27视觉语言视觉感知

针对弱监督视频时序定位依赖滑窗候选片段、跨模态对齐过粗且受候选质量限制的问题,论文将视频帧与查询词建模为合作博弈中的玩家,用博弈交互度量不同帧词联盟对相似度的贡献,并转化为查询引导的逐帧得分以直接定位边界;在 Charades-STA 和 ActivityNet Caption 上优于既有方法,代表性设置下 Charades-STA 提升 4.53%。

HydraPrompt: An Adaptive and Asymmetric Framework of Vision-Language Models for Synthetic Image Detection Figure 1
2026-05-27cs.CV

HydraPrompt: An Adaptive and Asymmetric Framework of Vision-Language Models for Synthetic Image Detection

Senyuan Shi, Hao Tan, Zichang Tan, Shuhan Feng, Ajian Liu, Sergio Escalera, Jun Wan

Beijing University of Posts and Telecommunications, School of Advanced Interdisciplinary Sciences (SAIS), University of Chinese Academy of Sciences, Shenzhen Institute of Advanced Technology (SIAT), Chinese Academy of Sciences, MAIS, Institute of Automation, Chinese Academy of Sciences, University of Barcelona

2026-05-27视觉语言视觉感知

针对现有基于 CLIP 的合成图像检测方法用静态、对称提示划分真假类别,难以适应不同生成模型带来的细粒度伪造痕迹,HydraPrompt 提出真假非对称建模:真实类使用统一提示锚点,伪造类由浅层视觉线索生成样本自适应提示,并配合条件监督对比损失压紧真实分布、分散伪造特征。实验显示其在常用 SID 基准上达到最优表现,尤其提升未见伪造的鲁棒性。

The Rescue Effect: Spatio-Semantic Early Exit Bypasses Quantization Collapse in CLIP Figure 1
2026-05-27cs.CV

The Rescue Effect: Spatio-Semantic Early Exit Bypasses Quantization Collapse in CLIP

Kahyeon Nam, Hyesong Choi

Soongsil University

2026-05-27强化学习

论文关注 INT8 量化后 CLIP 在边缘部署中的特殊失效:量化噪声随 Transformer 深度累积,破坏图文嵌入的余弦方向,形成 QIRC。作者提出 LRA-EE,用 patch 全局平均替代浅层 [CLS],结合多特征门控和按层噪声校准阈值,主动绕过高噪声深层。在 ImageNet-1K 零样本上,相比 INT8 全深度基线 FLOPs 降低 13.38%,Top-1 从 58.72% 提升到 61.16%,增益主要归因于自适应深度路由的“Rescue Effect”。

OmniGF: A Dual-Branch Vision-Language Framework for Unified Gaze Following Figure 1
2026-05-27cs.CV

OmniGF: A Dual-Branch Vision-Language Framework for Unified Gaze Following

Qiaomu Miao, Haoyu Wu, Jingyi Xu, Minh Hoai, Dimitris Samaras

Stony Brook University, The University of Adelaide

2026-05-27视觉语言视觉感知

针对传统 gaze following 只做空间定位、多人场景需重复推理且难以处理语义/社交关系的问题,OmniGF 将 VLM 改造成统一多人框架:用头部特征注入锁定个体,并以语言分支输出离散推理状态、连续空间分支从隐藏状态解码高分辨率凝视热图。实验称其在五个基准上达到 SOTA,同时支持目标位置、语义类别与社交凝视推理。

Garment Particles: A 2D--3D Symmetric Garment Representation for Generation and Editing Figure 1
2026-05-27cs.GR

Garment Particles: A 2D--3D Symmetric Garment Representation for Generation and Editing

Kiyohiro Nakayama, I-chao Shen, Ruofan Liu, Yiming Wang, Gordon Wetzstein, Takeo Igarashi

Stanford University, The University of Tokyo, Institute of Science Tokyo, Stanford University USA, The University of Tokyo Japan, Institute of Science Tokyo Japan

2026-05-27三维

服装设计同时需要从文本/图像等高层意图生成款式,又要在2D纸样与3D垂坠几何间做专业级编辑,现有方法难以统一。本文提出Garment Particles,以5D点云对称编码2D纸样和3D形态,并结合整流流GPF、DPS引导编辑及PPF还原可仿真的曲线纸样。实验显示其在多模态服装生成上优于竞争基线,并支持插值、纸样编辑、点云和轮廓条件生成等任务。

Zero-Shot Object Re-Identification in Egocentric Kitchen Videos via Multi-Stage SAM3 Feature Fusion Figure 1
2026-05-27cs.CV

Zero-Shot Object Re-Identification in Egocentric Kitchen Videos via Multi-Stage SAM3 Feature Fusion

Dmytro Klepachevskyi, Alexander Wong, Sirisha Rambhatla, Yuhao Chen

2026-05-27视觉语言视觉感知数据集/基准三维

针对第一视角厨房视频中物体频繁遮挡、离开视野后再出现且身份标注稀缺的问题,论文将 EPIC-Kitchens 上的厨房物体 ReID 系统化为零样本检索任务。其核心做法不是训练新模型,而是以 SAM3 分割去背景为入口,融合 SAM3、DINOv2、CLIP 特征,并加入掩码形状 IoU 与 k-reciprocal 重排序。结果显示单一预训练特征最高仅约 45.3% mAP,完整流程提升到 52.8% mAP。

Detail Consistent Stage-Wise Distillation for Efficient 3D MRI Segmentation Figure 1
2026-05-27cs.CV

Detail Consistent Stage-Wise Distillation for Efficient 3D MRI Segmentation

Mengchen Fan, Baocheng Geng, Xi Xiao, Tianyang Wang, Siyuan Mei, Pulin Che, Xiaoqian Jiang, Qizhen Lan

2026-05-27视觉感知学习理论数据集/基准三维

针对3D MRI分割模型在压缩后虽能保留粗定位、却容易丢失小病灶和清晰边界的问题,论文提出DCD阶段式蒸馏:在各编码层用3D小波分解对齐师生特征的方向细节子带,并相对放开低频语义以避免过约束和噪声放大。该方法仅用于训练、推理无额外开销,在BraTS 2024和ISLES 2022上提升了压缩nnU-Net的分割精度与边界质量。

Multi-Modal Building Inspection via Perceiver IO Fusion of Satellite and Street-Level Imagery Figure 1
2026-05-27cs.CV

Multi-Modal Building Inspection via Perceiver IO Fusion of Satellite and Street-Level Imagery

Niels Sombekke, Rob G.J. Wijnhoven, Martin R. Oswald

2026-05-27视觉感知数据集/基准三维

面向大规模建筑巡检中屋顶材料与构件难以仅靠人工或单一视角判断的问题,论文用共享 DINOv2 提取卫星与街景的空间 patch token,并以 Perceiver IO 融合可变数量街景视图,同时提出 RGB-M 足迹掩码作为软空间先验。其十国 3.2 万建筑数据表明,该融合优于常见融合策略,显著提升街景可见类别如 slate,但俯视可见类别上卫星单模态仍略占优。

VisualNeedle: Benchmarking Active Visual Search in Information-Dense Scenes Figure 1
2026-05-27cs.CV

VisualNeedle: Benchmarking Active Visual Search in Information-Dense Scenes

Jingru Chen, Yiming Liu, Mingtao Chen, Sijie Chen, Richeng Xuan, Liang Yang, Zhichao Hu, Fanyang Lu

2026-05-27视觉语言视觉感知模仿学习数据集/基准三维

论文针对现有细粒度视觉基准可能被语言先验、全局语义和“假工具使用”捷径抬高分数的问题,提出 VisualNeedle:在街景、文档、货架、地图等高信息密度场景中设置300个需主动定位微小证据的问题,并用 crop-black 反事实裁剪检验模型是否真正利用中间视觉证据。9个MLLM评测显示,无工具准确率低于20%,最佳工具模型仅56.01%,仍低于63.00%的人类多数投票,说明当前模型的主动视觉搜索能力仍明显不足。

BioFact-MoE: Biologically Factorized Mixture of Experts for Vision-Language Prognostic Modeling in Hepatocellular Carcinoma Figure 1
2026-05-27cs.CV

BioFact-MoE: Biologically Factorized Mixture of Experts for Vision-Language Prognostic Modeling in Hepatocellular Carcinoma

Junlin Yang, Tian Yu, Nicha C. Dvornek, Yuexi Du, Peiyu Duan, Annabella Shewarega, Lawrence H. Staib, James S. Duncan, Julius Chapiro

2026-05-27视觉语言视觉感知强化学习三维安全鲁棒

针对肝癌预后中肝功能储备与肿瘤进展信号易被普通视觉语言模型混在同一表征里的问题,BioFact-MoE用LLM拆分报告、解剖掩码和路径专属LoRA预训练,将肝脏与肿瘤因素显式分解,再用残差MoE按患者动态门控融合。其在588例HCC上较多类基线提升,12/18/24个月AUC达75.33%、75.85%、73.96%,且门控权重可解释治疗相关异质性。

Joint Instance Segmentation and Geometric Attribute Regression for Roof Structures in Aerial Imagery Figure 1
2026-05-27cs.CV

Joint Instance Segmentation and Geometric Attribute Regression for Roof Structures in Aerial Imagery

Luuk Versteeg, Rob G.J. Wijnhoven, Martin R. Oswald

2026-05-27视觉感知数据集/基准三维

面向建筑节能、保险估值和太阳能评估中缺少大规模三维屋顶属性的问题,本文将昂贵的 LiDAR/3DBAG 三维数据仅用于训练,推理时从单张正射航片预测屋顶实例掩码及高度、坡度、方位角。方法在 Mask R-CNN 上加入属性回归分支,并用平屋顶条件方位角损失和对数高度归一化处理噪声与长尾分布。在荷兰 1.7 万张航片、超 200 万实例上,坡度约 4°、方位角约 7°、高度约 1 m MAE,AP50 为 0.566,可支持简化 LoD2 重建。

Unified Panoramic Geometry Estimation via Multi-View Foundation Models Figure 1
2026-05-27cs.CV

Unified Panoramic Geometry Estimation via Multi-View Foundation Models

Vukasin Bozic, Isidora Slavkovic, Dominik Narnhofer, Nando Metzger, Denis Rozumny, Konrad Schindler, Nikolai Kalischek

2026-05-27视觉感知强化学习三维

针对单张全景图三维几何估计受ERP畸变、全景标注稀缺和透视基础模型难迁移限制的问题,PaGeR将360°图像重参数化为六面体多视图,并在DA3式多视图Transformer上加入相机条件、边界一致解码与透视/合成全景混合训练,一次预测尺度不变深度、米制深度、法线和天空掩码。实验显示其在室内外多基准达到或超过现有方法,并在未见场景上具备较强零样本泛化,另提供ZüriPano LiDAR全景评测集。

Personalized Generative Models for Contextual Debiasing Figure 1
2026-05-27cs.CV

Personalized Generative Models for Contextual Debiasing

Xinran Liang, Esin Tureci, Prachi Sinha, Ye Zhu, Vikram V. Ramaswamy, Olga Russakovsky

2026-05-27视觉感知生成模型强化学习优化算法数据集/基准

本文针对视觉数据中“物体—场景/共现对象”频率不均导致小型识别模型依赖上下文、在罕见组合上失效的问题,提出 DecoupleGen:对文本到图像扩散模型做个性化微调,学习原图组件的词嵌入,再合成去除常见上下文但保持数据集风格与视觉细节的样本,并用检测器筛选。其在 NICO 与 COCO 上较标准训练分别提升 14.2% 和 5.4%,较既有去偏或生成增强方法也有约 1.5% 增益。

Erased but Exploitable: Black-box Embedding-Aware Prompting Against Unlearned Text-to-Image Diffusion Models Figure 1
2026-05-27cs.CV

Erased but Exploitable: Black-box Embedding-Aware Prompting Against Unlearned Text-to-Image Diffusion Models

Arian Komaei Koma, Seyed Amir Kasaei, AmirMahdi Sadeghzadeh, Mohammad Hossein Rohban

2026-05-27视觉感知生成模型强化学习安全鲁棒

针对扩散模型“机器遗忘”后仍可能残留被删除概念的问题,论文提出 BEAP:在完全黑盒条件下用 LLM 在自然语言空间迭代生成提示,并结合概念出现、图文一致性、图像质量及嵌入相近替代词进行奖励搜索。结果显示其攻击成功率较既有方法提升超过 60%,平均约 15 次查询即可成功,同时提示更可读、较难被简单安全过滤器发现,说明当前遗忘机制仍不可靠。

RadarSim: Simulating Single-Chip Radar via Multimodal Neural Fields Figure 1
2026-05-27cs.CV

RadarSim: Simulating Single-Chip Radar via Multimodal Neural Fields

Chuhan Chen, Tianshu Huang, Akarsh Prabhakara, Chaithanya Kumar Mummadi, Zhongxiao Cong, Anthony Rowe, Matthew O'Toole, Deva Ramanan

2026-05-27视觉语言视觉感知强化学习三维安全鲁棒

针对低成本毫米波雷达角分辨率低、数据难解释且强依赖传感器,论文提出 RadarSim:用 RGB-NeRF 初始化并正则化雷达神经场,同时保留雷达特有穿透/遮挡差异,并用基于 BRDF 的编码建模后向镜面反射;还用雷达量测校正 COLMAP 尺度。作者采集手持雷达-相机数据集,结果显示其在新视角 range-Doppler 合成、反射率几何清晰度和遮挡表面密度估计上优于雷达-only 基线。

E$^3$C: Video Generation with 3D Environmental Memory and Ego-Exo Human Pose Control Figure 1
2026-05-27cs.CV

E$^3$C: Video Generation with 3D Environmental Memory and Ego-Exo Human Pose Control

Qiao Gu, Lingni Ma, Adam W Harley, Richard Newcombe, Florian Shkurti, Julian Straub

2026-05-27视觉感知生成模型强化学习规划控制三维

E³C面向具身智能中“预演”第一人称未来观测的需求,解决自我运动导致的剧烈视角变化、自遮挡以及人与场景需同步一致的问题。其核心是将静态环境与人体动态解耦:用带VAE外观特征的半稠密点云作为3D记忆,并结合外部人物骨架、佩戴者3D关节与6DoF腕部运动及持久姿态token控制生成。在Nymeria上,方法相较基线提升了画质、相机运动跟随、物体一致性和ego/exo姿态控制,并支持显式场景编辑。

Sleep-stage efficient classification using a lightweight self-supervised model Figure 1
2026-05-27cs.CV

Sleep-stage efficient classification using a lightweight self-supervised model

Eldiane Borges dos Santos Durães, João Batista Florindo

2026-05-27数据集/基准安全鲁棒

本文针对睡眠分期中标注数据和算力有限的问题,改造自监督 EEG 表征模型 mulEEG:用 ResNet-18 替代较重的 ResNet-50,并将时序特征、谱图特征及其拼接输入线性 SVM。实验显示,减少预训练数据量的性价比高于单纯缩小模型,而 ResNet-18 的拼接特征配置超过原 mulEEG 线性评估结果,但具体增益可能同时来自特征融合与分类器设置。

CNNs, Transformers, Hybrid, and Vision Language Models for Skin Cancer Detection Figure 1
2026-05-27cs.CV

CNNs, Transformers, Hybrid, and Vision Language Models for Skin Cancer Detection

Durjoy Dey, Yuhong Yan, Hassan Hajjdiab

2026-05-27视觉语言视觉感知强化学习数据集/基准

针对皮肤癌筛查中不同视觉架构难以公平比较的问题,本文在PAD-UFES-20上用统一患者级划分、训练流程和临床导向指标评测12个CNN、ViT、混合模型与VLM。结果显示,调优后的CNN已是强基线,但Transformer类整体判别更好;MaxViT Tiny、CoAtNet0和SigLIP取得较均衡表现,CLIP偏向高精度,为实际筛查模型选择提供可复现实证参考。

Evi-Steer: Learning to Steer Biomedical Vision-Language Models through Efficient and Generalizable Evidential Tuning Figure 1
2026-05-27cs.CV

Evi-Steer: Learning to Steer Biomedical Vision-Language Models through Efficient and Generalizable Evidential Tuning

Taha Koleilat, Hassan Rivaz, Yiming Xiao

2026-05-27视觉语言视觉感知生成模型强化学习模仿学习

针对生物医学视觉语言模型在少样本、域偏移和图文对齐含糊时的脆弱性,Evi-Steer在冻结BiomedCLIP主干的前提下,用低维跨模态表示 steering 更新视觉与文本 token,并引入证据不确定性门控与Dempster-Shafer置信融合,弱证据时抑制残差更新。实验覆盖15个数据集、8类器官和8种模态,仅更新0.11%参数,在少样本和域泛化设置下持续优于现有PEFT方法。

A multifractal-based masked auto-encoder: an application to medical images Figure 1
2026-05-27cs.CV

A multifractal-based masked auto-encoder: an application to medical images

Joao Batista Florindo, Viviane de Moura

2026-05-27视觉感知强化学习模仿学习数据集/基准三维

针对传统 MAE 随机遮挡可能避开医学图像中细微但关键病灶区域的问题,论文提出 MO-MAE,用 Rényi 熵刻画图像块的多重分形复杂度,并据此优先遮挡高信息区域,迫使模型学习重建更具诊断价值的结构。该策略不引入额外可学习模块,计算开销较小;在 MedMNIST 与 COVID-CT 等分类任务上,多数场景优于对比基线和近期方法。

Benchmarking Convolutional, Transformer, Hybrid, and Vision Language Models for Multi Disease Retinal Screening Figure 1
2026-05-27cs.CV

Benchmarking Convolutional, Transformer, Hybrid, and Vision Language Models for Multi Disease Retinal Screening

Durjoy Dey, Aymane Ajbar, Yuhong Yan

2026-05-27视觉语言视觉感知数据集/基准

针对多病种视网膜筛查中不同视觉架构在真实多标签与域迁移场景下缺乏可比结论的问题,本文用统一训练、校准和评估协议在 RFMiD 上横向比较 CNN、ViT、CNN-Transformer 混合模型与 VLM。结果显示二分类筛查均达 84% 以上 AUC,但 SwinTiny、CoAtNet0、MaxViTTiny 在二分类和多标签 F1 上更优;CLIP、SigLIP 接近 CNN 基线但未超过最佳注意力/混合骨干,Messidor-2 外部验证也呈相似趋势。

VesselSim: learning 3D blood vessel segmentation without expert annotations Figure 1
2026-05-27cs.CV

VesselSim: learning 3D blood vessel segmentation without expert annotations

Erin Rainville, Melissa Ananian, Tristan Mirolla, Hassan Rivax, Yiming Xiao

2026-05-27视觉感知强化学习规划控制学习理论数据集/基准

针对3D血管标注昂贵且跨模态域移明显的问题,VesselSim用随机几何规则生成具备分叉、曲率和碰撞约束的合成血管,再做强度域随机化训练3D U-Net,并在测试时用自监督掩码重建适配真实扫描。零样本在脑部CTA/MRA和HiP-CT上接近或超过多种医学分割基础模型,说明主要血管几何可由合成管状结构学到,但部分增益可能来自数据规模与域随机化。

Frequency-Guided Fusion For RGB-Thermal Semantic Segmentation Figure 1
2026-05-27cs.CV

Frequency-Guided Fusion For RGB-Thermal Semantic Segmentation

İsmail Emre Canıtez, Özgür Erkent

2026-05-27视觉感知强化学习学习理论三维

针对夜间、阴影等场景中 RGB 语义分割不可靠的问题,论文提出双 ConvNeXt V2 的 RGB-热红外分割框架:浅层只对红外特征做高低频分解,用注意力和置信门控补强 RGB,深层再做跨模态语义注意力,并用 PANet 解码。MFNet 上最小模型以 35.43M 参数达 61.73% mIoU,PST900 最高约 88.48%,效率优于多种更大模型。

Quantized Keys Steal Attention: Bias Correction for KV-Cache Compression in Video Diffusion Figure 1
2026-05-27cs.LG

Quantized Keys Steal Attention: Bias Correction for KV-Cache Compression in Video Diffusion

Tuna Tuncer, Felix Becker, Thomas Pfeil

Technical University of Munich

2026-05-27视觉感知生成模型

面向分块自回归视频扩散中 KV cache 随时长增长造成的显存瓶颈,论文指出低比特量化退化并非仅来自误差大小,而是 softmax 指数凸性放大零均值 key 噪声,形成“Jensen bias”,使缓存 token 抢占当前块注意力。作者据量化步长和 query 范数在线校正每个注意力分数,无需额外缓存;在 MAGI-1、SkyReels-V2、HY-WorldPlay 的 INT2 设置下恢复多数画质损失,接近 BF16,并可用比 INT4 少 50% 内存取得更好效果。

Dimensional Distribution Emotion State: Leveraging Valence and Arousal as a Common Embedding Space for Visual Emotion Analysis Figure 1
2026-05-27cs.CV

Dimensional Distribution Emotion State: Leveraging Valence and Arousal as a Common Embedding Space for Visual Emotion Analysis

Émile Bergeron, Tadagbé Dhossou, Sébastien Tremblay, Jean-François Lalonde

2026-05-27数据集/基准安全鲁棒

面向博物馆情绪化策展中人工标注昂贵且主观的问题,论文提出 DDES:把情绪表示为效价–唤醒二维空间上的概率分布,并定义与类别分布、单点维度表示的转换,以统一多种标注和多数据集训练。实验显示其在单数据集上与常用表示性能相近,但零样本泛化更好;具体增益来源仍可能与数据融合方式相关。

LongAV-Compass: Towards Unified Evaluation of Minute-Scale Audio-Visual Generation Across T2AV, I2AV, and V2AV Figure 1
2026-05-27cs.CV

LongAV-Compass: Towards Unified Evaluation of Minute-Scale Audio-Visual Generation Across T2AV, I2AV, and V2AV

Tengfei Liu, Yang Shi, Xuanyu Zhu, Jiafu Tang, Liu Yang, Qixun Wang, Zhuoran Zhang, Yuqi Tang, Fengxiang Wang, Yuhao Dong, Xinlong Chen, Bozhou Li, Bohan Zeng, Yue Ding, Xiaohan Zhang, Jialu Chen, Haotian Wang, Yuanxing Zhang, Pengfei Wan, Leye Wang

2026-05-27视觉语言视觉感知生成模型模仿学习数据集/基准

针对现有音视频生成评测仍停留在短片、且难以统一比较文本/图像/视频条件的问题,LongAV-Compass构建了284个分钟级T2AV、I2AV、V2AV测试用例,并用事件级标注、MLLM评审结合DINO-v2、ArcFace、CLIP、ImageBind等指标评估20余个维度。对11个模型的实验与人工一致性验证显示,该基准能揭示长程身份漂移、叙事断裂和音画同步衰减等当前系统瓶颈。

RoMo: A Large-Scale, Richly Organized Dataset and Semantic Taxonomy for Human Motion Generation Figure 1
2026-05-27cs.CV

RoMo: A Large-Scale, Richly Organized Dataset and Semantic Taxonomy for Human Motion Generation

Jiahao Zhang, Joseph Liu, Young-Yoon Lee, Seonghyeon Moon, Victor Zordan, Guy Tevet, Karen Liu, Stephen Gould, Oren Jacob, Haomiao Jiang, Mubbasir Kapadia, Yizhak Ben-Shabat

2026-05-27视觉语言视觉感知生成模型数据集/基准三维

针对3D人体动作生成在“小而干净的动捕数据”和“大但噪声多的野外视频数据”之间的取舍,RoMo构建了820K核心片段、1237小时的野外动作数据集,并用三层语义分类体系与按类别自适应过滤去除静态和伪影样本,每段配多条文本描述。实验显示,基于RoMo训练的模型在保真度、多样性和复杂文本理解上优于既有数据训练结果,同时分类评测暴露了模型在细粒度交互动作上的短板;增益可能主要来自数据规模、清洗和语义组织的共同作用。

Sentinel: Embodied Cooperative Spatial Reasoning and Planning Figure 1
2026-05-27cs.CV

Sentinel: Embodied Cooperative Spatial Reasoning and Planning

Xiangye Lin, Hongxin Zhang, Ruxi Deng, Qinhong Zhou, Chuang Gan

2026-05-27机器人规划控制优化算法数据集/基准三维

这篇论文针对现有具身多智能体多局限于静态室内、难以处理城市尺度动态约束的问题,提出 Sentinel Challenge 和 CoSaR 框架:用结构化空间记忆结合自然语言通信、地图查询、VLM 路径修正与 A* 导航,使分散机器人协商会合点并避开巡逻哨兵。在 14 个城市场景、3–5 个智能体实验中,CoSaR 相比 CoELA、RoCo 实现更快会合、更短路径和更高安全性。

DuoGesture: Neuro-Inspired and Biomechanically Informed Dual-Stream Co-Speech Gesture Generation Figure 1
2026-05-27cs.CV

DuoGesture: Neuro-Inspired and Biomechanically Informed Dual-Stream Co-Speech Gesture Generation

Ferdinand Paar, Lanmiao Liu, Aslı Özyürek, Serge Thill, Esam Ghaleb

2026-05-27视觉语言规划控制数据集/基准三维

论文针对现有共语手势模型把语义手势与节拍手势混为单一运动流,导致语义弱、语音对齐差和抖动的问题,提出 DuoGesture 双流框架:用运动语言表征增强长尾词触发的语义手势,以随机帧级门控决定语义流何时覆盖节拍流,并用人体测量加权惯性先验约束节拍平滑性。在 BEAT2 单/多说话人实验和主观评测中,其 FGD 等分布真实度优于强整体式基线,消融支持三项模块的互补作用。

Not All Modalities Are Equal: Instruction-Aware Gating for Multimodal Videos Figure 1
2026-05-27cs.CV

Not All Modalities Are Equal: Instruction-Aware Gating for Multimodal Videos

Bonan Ding, Umair Nawaz, Ufaq Khan, Abdelrahman M. Shaker, Muhammad Haris Khan, Jiale Cao, Jin Xie, Fahad Shahbaz Khan

2026-05-27视觉语言视觉感知规划控制数据集/基准三维

这篇论文针对视频大模型在接入音频、深度或密集时序流时容易被无关模态干扰的问题,提出 UniMVU:依据文本指令在模态内部选择关键 token,并在模态级动态重加权,另用快慢融合减少对齐流冗余。在 AVQA、AVSD、Music-AVQA、ScanQA、SQA3D、MVBench 六个基准上相对静态融合稳定提升,CIDEr 最高增益 13.5,门控权重也与可解释的模态相关性较一致。

Geometry-Aware Representation Denoising for Robust Multi-view 3D Reconstruction Figure 1
2026-05-27cs.CV

Geometry-Aware Representation Denoising for Robust Multi-view 3D Reconstruction

Jin Hyeon Kim, Jaeeun Lee, Claire Kim, Kyoungjin Oh, Paul Hyunbin Cho, Jaewon Min, Yeji Choi, Jihye Park, Hyunhee Park, Minkyu Park, Seungryong Kim

2026-05-27视觉感知生成模型强化学习数据集/基准三维

该文针对真实多视角采集中运动模糊等退化会破坏跨视图匹配、使前馈式3D重建误差累积的问题,提出GARD:不先在像素或VAE潜空间修图,而是在冻结重建器的几何感知特征空间中用扩散模型去噪,并接RGB解码器同时恢复图像与几何。在DA3退化基准上,相比先复原再重建及VAE潜空间方案,姿态、深度/重建和图像质量指标均更好。

AnySurf: Any Surface Generation with Directed Edge Figure 1
2026-05-27cs.GR

AnySurf: Any Surface Generation with Directed Edge

Wenda Shi, Chenyuan Pan, Dengming Zhang, Yiren Song, Biao Zhang, Xingxing Zou

WENDA SHI, The Hong Kong Polytechnic University, Hong Kong SAR, DENGMING ZHANG, Zhejiang University, China, YIREN SONG, National University of Singapore, Singapore, BIAO ZHANG, Xi’an Jiaotong University, China, XINGXING ZOU∗, The Hong Kong Polytechnic University, Hong Kong SAR, Hong Kong Polytechnic University, Hong Kong SAR, Zhejiang University, Hangzhou, China, University of Singapore, Singapore, University, Xi’an, China, Polytechnic University, Hong Kong SAR., sentation limits scalability and generalization beyond garments, making it, our datasets, code, and models publicly available.

2026-05-27视觉感知

面向服装、鞋帽配饰等同时包含开放面与封闭面的工业级 3D 资产,现有通用生成器偏向水密网格,服装专用方法又难泛化且易出法线/面朝向错误。AnySurf 将 FDG 扩展为带方向边的 FDG-D,并用 ROS-FT 与仅约 1% 参数的 DE-Adapter 学习面朝向线索,配合 Outfit3D 数据集实现统一生成。实验显示其在开放、封闭和混合表面上较 Trellis2 等基线得到更一致朝向和更适合下游使用的网格。

VISTA: An End-to-End Benchmark for Visual Spec-to-Web-App Coding Agents Figure 1
2026-05-27cs.SE

VISTA: An End-to-End Benchmark for Visual Spec-to-Web-App Coding Agents

JunJia Guo, Yuhang Yao, Jiawei (Joe) Zhou, Jingdi Chen

University of Arizona, Stony Brook University

2026-05-27数据集/基准

现有代码基准难以衡量真实前端开发中“看起来像、能交互、可运行”的综合能力,VISTA因此把视觉规格到 Web 应用生成作为端到端任务。其创新在于同时操控输入粒度与技术栈约束,并用人工标注交互组件/视觉锚点结合 DOM、浏览器测试和 CLIP 评估。对四类代理的实验显示,视觉还原与功能正确性并不总是同步,代理编辑风格差异明显但与任务质量关联较弱。

AssetGen: Deployable 3D Asset Generation at Interactive Speed Figure 1
2026-05-27cs.GR

AssetGen: Deployable 3D Asset Generation at Interactive Speed

Dilin Wang, Xiaoyu Xiang, Kihyuk Sohn, Tom Monnier, Yu-Ying Yeh, Thu Nguyen-Phuoc, Jiawen Zhang, Yuchen Fan, Antoine Toisoul, Hyunyoung Jung, Prithviraj Dhar, Michael Bunnell, Nikolaos Sarafianos, Chuhang Zou, Roman Shapovalov, Andrea Vedaldi, Rakesh Ranjan

2026-05-27三维

针对现有图像到3D方法重画质、轻可部署性与交互延迟的问题,AssetGen把目标定义为直接可用于实时渲染的资产生成:用粗到细VecSet几何扩散、GPU网格清理/简化/UV展开/法线烘焙,以及多视图纹理回投和3D修补,并通过蒸馏、内核优化和流水并行做端到端加速。实验含自动与盲测评估,显示其约30秒生成可部署高质量网格,Flash约14秒给出预览质量,视觉效果可与商业系统竞争。

2026-05-26

292 篇
TriSplat: Simulation-Ready Feed-Forward 3D Scene Reconstruction Figure 1
2026-05-26cs.CV

TriSplat: Simulation-Ready Feed-Forward 3D Scene Reconstruction

Weijie Wang, Zimu Li, Jinchuan Shi, Zeyu Zhang, Botao Ye, Marc Pollefeys, Donny Y. Chen, Bohan Zhuang

2026-05-26视觉感知强化学习模仿学习三维

面向机器人仿真、碰撞检测和具身交互,现有前馈高斯重建虽适合新视角合成,却需额外网格提取。TriSplat将表示直接换成有向三角面片,从稀疏无位姿图像联合预测点图、相机和三角属性,并用几何法线锚定方向与渐进锐化稳定训练。在RealEstate10K、DL3DV及ScanNet零样本中,其表面精度和网格渲染优于高斯基线,且可直接导入物理引擎。

AnyScene: Towards Highly Controllable Driving Scene Generation at Anywhere and Beyond Figure 1
2026-05-26cs.RO

AnyScene: Towards Highly Controllable Driving Scene Generation at Anywhere and Beyond

Haiming Zhang, Junfei Zhou, Feng Jiang, Jingzhong Li, Zhenglong Guo, Penglin Dai, Jifeng Dai, Yan Xie, Benjin Zhu

Southwest Jiaotong University, Tsinghua University

2026-05-26规划控制

面向自动驾驶长尾安全场景中可控合成数据不足的问题,AnyScene以语义占据作为几何中枢:用BEV占据VAE和时空占据扩散Transformer从任意BEV自回归生成高频占据序列,再通过GGVE无参考帧扩展为多视角视频并支持灵活相机配置。实验显示其在占据与视频生成上达到SOTA,可泛化到未见和自定义布局,并提升稀疏视角3D重建等下游任务。

Squeezing Capacity from Multimodal Large Language Models for Subject-driven Generation Figure 1
2026-05-26cs.CV

Squeezing Capacity from Multimodal Large Language Models for Subject-driven Generation

Shuhong Zheng, Aashish Kumar Misraa, Yu-Teng Li, Yu-Jhe Li, Igor Gilitschenski

2026-05-26视觉语言视觉感知生成模型强化学习模仿学习

本文针对主体驱动生成中文本与参考图分开编码导致的跨模态理解弱、身份漂移和复制粘贴伪影问题,将MLLM作为扩散模型的联合图文条件,并用VAE补充细粒度身份信息;核心在于DLA跨层分别聚合文本/视觉特征,以及分阶段训练和去噪来缓解两类条件冲突。实验显示其在人类偏好、指令遵循和身份保持上优于既有方法,但具体增益中模型规模与数据贡献仍需进一步拆解。

Prism: A Plug-in Reproducible Infrastructure for Scalable Multimodal Continual Instruction Tuning Figure 1
2026-05-26cs.LG

Prism: A Plug-in Reproducible Infrastructure for Scalable Multimodal Continual Instruction Tuning

Jun-Tao Tang, Yu-Cheng Shi, Zhen-Hao Xie, Da-Wei Zhou

School of Artificial Intelligence, Nanjing University, China, National Key Laboratory for Novel Software Technology, Nanjing University, China

2026-05-26视觉语言

针对多模态大模型持续指令调优中方法需反复改动底座代码、难复用且难公平比较的问题,Prism 将算法、底座、基准和评测解耦为插件注册式组件,并原生支持 DeepSpeed 等大规模训练流程。文中主要结果是提供统一基础设施,覆盖 9 类方法和 3 个 MCIT 基准,相比 CoIN、MCITlib 增加统一骨干与可复现实验支持;具体性能增益并非重点,增益来源不清。

Helix4D: Complex 4D Mesh Generation Figure 1
2026-05-26cs.CV

Helix4D: Complex 4D Mesh Generation

Jiraphon Yenphraphai, Jianqi Chen, Jian Wang, Gordon Qian, Sergey Tulyakov, Rameen Abdal, Raymond A. Yeh, Peter Wonka, Chaoyang Wang

2026-05-26视觉感知三维

Helix4D针对现有视频到4D网格在拓扑变化、透明材质、细结构和内部表面上失效的问题,将Trellis2的强3D先验扩展到视频条件生成;关键做法是首帧锚定的滑窗跨帧注意力,以及把低频空间RoPE频段重用于时间编码以尽量不破坏预训练能力。实验显示其在ActionBench上CD-3D较ActionMesh提升3.8%,在自建52视频复杂动态集上各指标优于基线,用户偏好率达67.9%。

Reinforcing Few-step Generators via Reward-Tilted Distribution Matching Figure 1
2026-05-26cs.CV

Reinforcing Few-step Generators via Reward-Tilted Distribution Matching

Yushi Huang, Xiangxin Zhou, Ruoyu Wang, Chi Zhang, Jun Zhang, Tianyu Pang

2026-05-26视觉感知生成模型强化学习优化算法三维

针对少步扩散/flow 蒸馏虽能加速但难以兼顾教师分布与人类偏好的问题,论文提出 RTDMD:把对“奖励倾斜教师分布”的 KL 最小化分解为分布匹配与奖励最大化,并用 AC-DMD 稳定冷启动、混合策略梯度与 SubGRPO 处理随机中间步和确定性末步。在 SD3、SD3.5、FLUX.2 上仅 4 步采样即在偏好、美学和组合指标上超过既有少步方法,部分结果甚至优于 50 步大模型。

On-Policy Adversarial Flow Distillation for Autoregressive Video Generation Figure 1
2026-05-26cs.CV

On-Policy Adversarial Flow Distillation for Autoregressive Video Generation

Yang Luo, Shengju Qian, Xiaohang Tang, Zirui Zhu, Yong Liu, Xin Wang, Yang You

2026-05-26视觉感知生成模型强化学习模仿学习三维

面向只能返回成片的黑盒视频教师,论文指出自回归学生用SFT会因离策略前缀产生误差累积,传统DMD又依赖不可见分数。AFD用同提示下教师样本与学生rollout训练Bradley–Terry判别器,将样本级优势经学生前向加噪转成稠密flow matching监督。两类因果AR学生上,方法提升运动与物理敏感指标且基本保持通用视频质量。

EVIDENT: Routing MLLM Adaptation through Entity-Grounded Visual Evidence for Cross-Domain Video Temporal Grounding Figure 1
2026-05-26cs.CV

EVIDENT: Routing MLLM Adaptation through Entity-Grounded Visual Evidence for Cross-Domain Video Temporal Grounding

Geo Ahn, Jiwook Han, Youngrae Kim, Joonseok Lee, Jinwoo Choi

2026-05-26视觉语言视觉感知数据集/基准安全鲁棒

这篇论文针对多模态大模型做视频时序定位时“域内提升、跨域崩溃”的问题,指出主要瓶颈不是新概念,而是视觉域偏移导致实体注意力与定位能力脱耦。EVIDENT通过实体瓶颈适配器、实体绑定蒸馏和实体证据门控,把微调约束到查询相关实体证据上。跨域VTG实验显示其提升OOD鲁棒性,同时基本保持域内性能且参数开销较小。

Global Structure-from-Motion Meets Feedforward Reconstruction Figure 1
2026-05-26cs.CV

Global Structure-from-Motion Meets Feedforward Reconstruction

Linfei Pan, Johannes Schönberger, Marc Pollefeys

2026-05-26视觉感知强化学习模仿学习数据集/基准三维

这篇工作针对经典 SfM 在低纹理、低重叠、对称场景中易失败,而前馈三维重建又受限于规模、精度和鲁棒性的矛盾,系统分析两类方法的失效模式,并提出结合全局 SfM 优化与前馈重建先验的新管线。实验覆盖 5 个具不同挑战的数据集,显示该方法在多种场景下平均排名领先并达到当前最佳结果,系统已开源。

InstructSAM: Segment Any Instance with Any Instructions Figure 1
2026-05-26cs.CV

InstructSAM: Segment Any Instance with Any Instructions

Yuqian Yuan, Wentong Li, Zhaocheng Li, Yutong Lin, Juncheng Li, Siliang Tang, Jun Xiao, Yueting Zhuang, Wenqiao Zhang

2026-05-26视觉语言视觉感知生成模型数据集/基准三维

InstructSAM针对SAM3只能处理短语概念、难以理解属性/关系/排除/计数等复杂指令的问题,把指令驱动实例分割建模为集合式查询预测:在VLM中注入可学习实例查询并用混合注意力与文本、图像交互,再投影到SAM3查询空间单次输出多实例掩码。作者还构建Inst2Seg数据集,实验显示2B模型在复杂指令与短语指代分割上优于既有端到端方法和SAM3多轮代理流程。

Pixel-Level Pavement Distress Assessment Using Instance Segmentation Figure 1
2026-05-26cs.CV

Pixel-Level Pavement Distress Assessment Using Instance Segmentation

Logan Dewick (University of Wisconsin - Green Bay), Bibesh Pyakurel (University of Wisconsin - Green Bay), Kong Pheng Yang (University of Wisconsin - Green Bay), Nazim Choudhury (University of Wisconsin - Green Bay), M. G. Sarwar Murshed (University of Wisconsin - Green Bay)

2026-05-26视觉感知学习理论数据集/基准

针对路面裂缝细长、分叉且难以用框精确量化的问题,本文将 Detectron2 Mask R-CNN 用于 UWGB-StreetCrack 手机采集数据的实例分割,核心价值在于用多边形标注和掩码估计裂缝面积而非仅检测框。最佳 ResNet-101 FPN 取得 84.23% 精度、90.04% 召回和 87.04% F1,预测裂缝面积占比 2.164% 接近真值 2.170%;但其贡献主要是实证基准,类别不均衡和缺少标准 mask AP 仍限制结论。

Channel-wise Vector Quantization Figure 1
2026-05-26cs.CV

Channel-wise Vector Quantization

Wei Song, Tianhang Wang, Yitong Chen, Tong Zhang, Zuxuan Wu, Ming Li, Jiaqi Wang, Kaicheng Yu

2026-05-26视觉感知生成模型三维

论文针对传统 VQ 以空间 patch 量化导致码本利用率低、且需将二维图像生硬展平成自回归序列的问题,提出按特征通道量化的 CVQ,将图像表示为逐步增加视觉细节的一维通道序列,并据此设计 next-channel prediction 的 CAR 生成框架。实验显示,CVQ 在 16K+ 码本下达到 100% 利用率并提升重建质量,CAR 在文生图上取得 DPG 86.7、GenEval 0.79。

Paris 2.0: A Decentralized Diffusion Model for Video Generation Figure 1
2026-05-26cs.CV

Paris 2.0: A Decentralized Diffusion Model for Video Generation

Ali Rouzbayani, Bidhan Roy, Marcos Villagra, Zhiying Jiang

2026-05-26视觉感知生成模型

论文针对视频扩散/世界模型训练依赖集中式高带宽 GPU 集群的问题,提出将 Paris 1.0 的去中心化扩散扩展到视频:多个 11B 专家在不同数据簇上独立训练、无梯度同步,推理时由轻量路由器在去噪步骤选择专家。低分辨率等数据等算力对比中,三专家 DDM 将 FVD 从 561.04 降至 279.01,并提升 CLIP 文本-视频相似度和美学分;消融显示专家有簇内专化和切换收益,但仍是 Stage 1 低分辨率验证。

Look Both Ways Before You Cross: Lifting Cross Fields From 2D Visual Priors Figure 1
2026-05-26cs.GR

Look Both Ways Before You Cross: Lifting Cross Fields From 2D Visual Priors

Dale Decatur, Jacob Serfaty, Oded Stein, Amir Vaxman, Rana Hanocka

University of Chicago, University of Southern California, University of Edinburgh, University of Chicago USA, University of Southern California USA, University of Edinburgh United Kingdom

2026-05-26视觉感知

针对传统四边形重网格多依赖局部几何、难以捕捉语义特征且人工设计成本高的问题,CrossLift利用文本到图像模型生成多视角特征对齐网格图像,从2D梯度提取方向并回投到3D表面,再通过两阶段带置信权重的平滑插值形成交叉场。实验显示其在有机与机械模型上比几何或数据驱动基线获得更符合语义的四边形走向,并支持纹理对齐和2D手绘交互引导。

DRScaffold: Boosting Dense-Scene Reasoning in Lightweight Vision Language Models Figure 1
2026-05-26cs.CV

DRScaffold: Boosting Dense-Scene Reasoning in Lightweight Vision Language Models

Xinrui Shi, Kai Liu, Ziqing Zhang, Jianze Li, Anqi Li, Yulun Zhang

2026-05-26视觉语言视觉感知生成模型强化学习数据集/基准

这篇论文针对轻量级视觉语言模型在机器人操作、自动驾驶等拥挤场景中容易把物体、属性和关系“说顺但看错”的问题,提出 DRBench 密集场景推理基准,并用 DRScaffold 将监督拆成实体定位、关系图、逐步推理和答案生成四阶段,配合分阶段梯度掩码训练。实验显示,2–6B 模型在 DRBench 上显著提升且不损害通用基准,其中 Qwen2.5-VL-3B 甚至超过冻结的 32B 模型。

Everything at Every Scale: Scale-Invariant Diffusion with Continuous Super-Resolution Figure 1
2026-05-26cs.CV

Everything at Every Scale: Scale-Invariant Diffusion with Continuous Super-Resolution

Zixin Jessie Chen, Zhuo Chen, Archer Wang, Jeff Gore, William T. Freeman, Congyue Deng, Marin Soljačić

2026-05-26视觉感知生成模型三维

论文把图像生成与超分辨率都视为跨尺度信息损失的反演,动机是利用自然图像和临界物理系统的尺度不变性。其核心是 SKILD:在频域按从细到粗衰减内容,并注入匹配数据谱的高斯噪声,使同一无条件反向扩散仅通过起始时间步即可做生成或连续超分。结果显示其在 CIFAR-10 上达 FID 2.65、IS 9.63,单个 ImageNet checkpoint 支持 2×–8× 超分并在感知指标上优于条件基线,还能较好重建 Ising 模型高阶相关。

A Multimodal 3D Foundation Model for Light Sheet Fluorescence Microscopy Enables Few-Shot Segmentation, Classification, and Deblurring Figure 1
2026-05-26cs.CV

A Multimodal 3D Foundation Model for Light Sheet Fluorescence Microscopy Enables Few-Shot Segmentation, Classification, and Deblurring

Adina Scheinfeld, Haotan Zhang, Shang Mu, Rudolf L. M. van Herten, Lucas Stoffl, Ali Erturk, Zhuhao Wu, Johannes C. Paetzold

2026-05-26视觉语言视觉感知生成模型数据集/基准三维

针对光片荧光显微三维体数据标注昂贵、现有监督模型难跨染色和生物结构泛化的问题,论文构建跨物种/染色/协议的LSM体数据与专家文本描述,采用3D骨干结合掩码重建、EMA蒸馏和CLIP式图文对齐预训练。少量标注微调后,在分割、分类和去模糊任务上均优于从零训练及基线,并经专家评估验证,但具体增益中图文对齐相对数据规模的贡献仍需进一步拆解。

STORM: Internalized Modeling for Spatial-Temporal Reasoning in Video-Language Models Figure 1
2026-05-26cs.CV

STORM: Internalized Modeling for Spatial-Temporal Reasoning in Video-Language Models

Yiming Liang, Yixiao Chen, Yiyang Zhou, Yixuan Wang, Shoubin Yu, Andong Deng, Fuxiao Liu, Qin Zhang, Chen Chen, Mohit Bansal, Huaxiu Yao

2026-05-26视觉语言视觉感知规划控制学习理论三维

视频问答需要跟踪运动、时序和状态变化,显式 CoT、重插帧或工具调用虽能补证据但推理开销高。TORM/STORM 的核心是用训练期生成的“思考视频”监督少量连续潜变量,两阶段先对齐动态表征、再仅用答案强化内化推理,测试时只做固定长度 latent rollout。文中在 VideoMME、MVBench、TempCompass、MMVU 上报告精度提升且显著降低推理开销,但具体增益中数据与生成监督贡献仍需进一步拆解。

AdvantageFlow: Advantage-Weighted Least Squares for RL in Flow Models Figure 1
2026-05-26cs.LG

AdvantageFlow: Advantage-Weighted Least Squares for RL in Flow Models

Branislav Kveton, Anup Rao, Subhojyoti Mukherjee, Krishna Kumar Singh, Viet Dac Lai

2026-05-26生成模型强化学习

针对流/扩散模型强化学习常把反向去噪当序列决策、需额外随机性且奖励归因困难的问题,本文提出 AdvantageFlow:直接在前向预测损失上按同一提示内样本优势加权,并用 rollout 与参考策略正则化处理负优势导致的非凸和能力遗忘。基于 Stable Diffusion 3.5 Medium 的图像生成实验显示,它在多种奖励和 GenEval 评测中优于 Flow-GRPO 与 DiffusionNFT,但结果仍依赖奖励模型质量。

MIND: Multi-Scale Intent Diffusion for Text-Driven Physics-Based Humanoid Control Figure 1
2026-05-26cs.CV

MIND: Multi-Scale Intent Diffusion for Text-Driven Physics-Based Humanoid Control

Bin Li, Ruichi Zhang, Han Liang, Jingyan Zhang, Juze Zhang, Xin Chen, Jingya Wang

2026-05-26机器人视觉感知生成模型模仿学习规划控制

MIND针对文本驱动物理人形控制中文本到低层动作语义鸿沟、以及生成-跟踪范式存在动力学域偏移的问题,提出把人形状态中的运动动态视为“意图”中介,并在扩散策略中用全局意图预测和逐步即时意图预测共同引导动作生成。实验显示其在语义对齐、物理合理性和动作自然度上优于现有基线。

MAGIC: Multimodal Alignment & Grounding-aware Instruction Coreset for Vision-Language Models Figure 1
2026-05-26cs.CV

MAGIC: Multimodal Alignment & Grounding-aware Instruction Coreset for Vision-Language Models

Shristi Das Biswas, Kaushik Roy

2026-05-26视觉语言视觉感知数据集/基准

针对视觉指令数据冗余、弱视觉依赖和多模态能力覆盖不均导致全量微调低效的问题,MAGIC用预训练VLM前向提取多模态增益、视觉 grounding 相关性和技能神经元签名,先过滤再排序并按签名分桶配额,以保留有用且多样的样本。在20%数据预算下,其在LLaVA-665K与Vision-Flan上达到或略超全量微调表现,并将端到端耗时降低73.7%。

Towards 3D heart mesh generation using contactless radar imaging and physics-informed neural network Figure 1
2026-05-26cs.CV

Towards 3D heart mesh generation using contactless radar imaging and physics-informed neural network

Jinye Li, Chenxi Fu, Minghang Zheng, Yang Liu, Xiahai Zhuang, Qingchao Chen

2026-05-26视觉感知强化学习学习理论数据集/基准三维

本文面向 MRI 难以连续、便携监测心脏功能的问题,探索用非接触毫米波 SAR 从噪声强、边界模糊的雷达回波中重建三维心脏网格。核心做法是 SAR2Mesh:以拓扑模板为先验,通过粗到细图卷积变形、多视角几何感知特征投影和物理一致的可微雷达损失约束重建,并构建配对 Cardiac Mesh-SAR 数据集。实验显示其相较图像回归等基线能得到更连续、物理一致的心脏表面。

LLaVA-OneVision-2: Towards Next-Generation Perceptual Intelligence Figure 1
2026-05-26cs.CV

LLaVA-OneVision-2: Towards Next-Generation Perceptual Intelligence

Xiang An, Yin Xie, Feilong Tang, Yunyao Yan, Huajie Tan, Didi Zhu, Changrui Chen, Xiuwei Zhao, Bin Qin, Kaicheng Yang, Yifei Shen, Yuanhan Zhang, Kaichen Zhang, Wenkang Zhang, Zheng Cheng, Nansen Zhang, Chunsheng Wu, Chunjiang Ge, Zimin Ran, Dehua Song, Chunyuan Li, Shikun Feng, Ming Hu, Zhangquan Chen, Junbo Niu, Bo Li, Ziyong Feng, Ziwei Liu, Zongyuan Ge, Jiankang Deng

2026-05-26机器人视觉语言视觉感知数据集/基准三维

针对现有视觉语言模型把视频简化为均匀抽帧、难以保留长时序运动证据的问题,LLaVA-OneVision-2将压缩视频视为bit-cost连续流,用码率变化自适应分组、以运动残差选择关键空间证据,并用3D RoPE统一图像、帧与codec画布。结合大规模视频重标注与2D/3D空间数据训练后,8B模型在JumpScore达74.9 mAP,较Qwen3-VL-8B高44.8点,视频、空间和跟踪基准也有稳定提升,但部分收益可能来自数据与训练规模。

F-RNG: Feed-Forward Relightable Neural Gaussians Figure 1
2026-05-26cs.GR

F-RNG: Feed-Forward Relightable Neural Gaussians

Guangming Fu, Jiahui Fan, Jian Yang, Miloš Hašan, Beibei Wang

Nankai University, Nanjing University, Nankai University China, Nanjing University China

2026-05-26三维

F-RNG瞄准稀疏视角下可重光照3D资产生成:优化式3DGS依赖密集视角且逐场景耗时,前馈LRM又常把光照烘焙进外观。论文将RelitLRM与内禀分解模型先验作为冻结骨干,通过潜空间插值细化几何、MaterialFormer和光照无关正则蒸馏可重光照神经高斯,再用通用神经渲染器支持任意光照。实验中仅用6视图,在多数据集较RelitLRM约提升2 dB,并将重光照时间从约6.8秒降至246毫秒,约25倍加速。

PathWISE: Multi-Agent Cancer Pathway Triaging Ontology Learning from Clinical Flowcharts Figure 1
2026-05-26cs.CV

PathWISE: Multi-Agent Cancer Pathway Triaging Ontology Learning from Clinical Flowcharts

Sofiat Abioye, Ufaq Khan, Shazad Ashraf, Mohammed Adil Butt, Andrew D. Beggs, Adam Byfield, Anusha Jose, William Poulett, Ben Wallace, Junaid Qadir, Muhammad Bilal

2026-05-26生成模型三维

临床癌症分诊路径常以流程图表达,拓扑、箭头和颜色等信息难以直接进入电子病历决策支持。PathWISE的核心是把LLM限制在图结构与CQL草稿抽取,再用确定性DFS枚举、节点可计算性审计和Java CQL编译器校验,生成可部署的FHIR CDS Hooks逻辑。其在5个NHS癌症路径上实现15个库100%语法编译,枚举363条旅程并发现544项治理问题;但语义通过率最高仅48.9%,不可计算节点以false占位保留,临床完整性仍需人工审查。

Context-driven Missing-Modality Learning for Robust Medical Diagnosis with Image-Tabular Data Figure 1
2026-05-26cs.CV

Context-driven Missing-Modality Learning for Robust Medical Diagnosis with Image-Tabular Data

Tianling Liu, Lequan Yu, Tong Han, Liang Wan

2026-05-26视觉语言视觉感知模仿学习数据集/基准三维

临床图像与表格数据常因成本或流程缺失部分模态,导致多模态诊断模型退化。本文提出 CMML:用带可学习上下文 token 的级联残差 Transformer 自编码器建模跨模态依赖并补全缺失表征,再借助记忆库、实例自适应语义参考和类别感知对比学习对齐原始与合成特征。在 Derm7pt、ODIR、MEN 上平均 AUC 分别较 SOTA 提升 1.26%、0.97%、1.32%。

RAPTOR+: A Visually Grounded Vision-Language Framework to Improve Clinical Trust and Auditability in Automated Cancer Referral Processing Figure 1
2026-05-26cs.CV

RAPTOR+: A Visually Grounded Vision-Language Framework to Improve Clinical Trust and Auditability in Automated Cancer Referral Processing

Sofiat Abioye, Ufaq Khan, Shazad Ashraf, Anusha Jose, Benjamin Wallace, William Poulett, Adam Byfield, Lukman Akanbi, Muhammad Bilal

2026-05-26视觉语言视觉感知数据集/基准安全鲁棒

针对结直肠癌紧急转诊表单中手写、版式变化和OCR断链导致的人工审核负担,RAPTOR+用视觉语言模型直接从文档图像抽取结构化字段并给出证据框,同时提出兼顾准确率与定位的评估。实验显示零样本大模型虽能读文本但几乎不能严格溯源;微调Qwen3-VL-8B达到96.1%读取准确率和60.6%严格安全性,说明任务微调是可审计临床抽取的关键。

VEN-VL: A Visual Ensemble MoE Framework for Effective and Efficient Multi-Modal Understanding Figure 1
2026-05-26cs.CV

VEN-VL: A Visual Ensemble MoE Framework for Effective and Efficient Multi-Modal Understanding

Yinghao Wu, Zhuoyan Luo, Yiyao Yu, Zhaojian Yu, Yujiu Yang, Xiao-Ping Zhang

2026-05-26视觉语言视觉感知模仿学习三维

针对高压缩率单一路径视觉 token 或基于粗注意力剪枝导致信息容量、密度不足的问题,VEN-VL提出“先丰富再压缩”的视觉集成 MoE:用 MKE 融合多视角视觉表征,用 HTE 自适应路由到专家逐层压缩,并以 SIP 重建监督保留结构信息。在仅保留约7.5%~10%视觉 token 时,TextVQA 提升8.1%、MMBench 提升5.2%,显示效率与复杂多模态理解性能的折中改善。

A Pedestrian-Vehicle Interaction Benchmark and Annotation Framework for Unstructured Scenes via Uncalibrated Cameras Figure 1
2026-05-26cs.CV

A Pedestrian-Vehicle Interaction Benchmark and Annotation Framework for Unstructured Scenes via Uncalibrated Cameras

Haoyang Peng, Qian Hu, Songan Zhang, Ming Yang

2026-05-26视觉感知生成模型规划控制数据集/基准三维

针对自动驾驶在非结构化共享空间中缺少密集人车交互数据、现有数据偏结构化道路或特定场景的问题,论文提出利用未标定监控视频构建与标注轨迹数据的框架,并发布PINNS,覆盖多地区、季节、光照和天气,提供轨迹与场景级信息。主要结果是形成可扩展基准并用于评估轨迹预测方法,但具体性能增益与基线结果文中片段未充分说明,贡献可能主要来自数据规模与场景多样性。

EchoPilot: Training-Free Ultrasound Video Segmentation via Scale-Space Semantic Prompting and Reliability-Gated Memory Figure 1
2026-05-26cs.CV

EchoPilot: Training-Free Ultrasound Video Segmentation via Scale-Space Semantic Prompting and Reliability-Gated Memory

Ruiqiang Xiao, Zhaohu Xing, Yijun Yang, Zhenyan Han, Weiming Wang, Kaishun Wu, Lei Zhu

2026-05-26视觉语言视觉感知强化学习学习理论数据集/基准

针对超声视频中噪声强、边界弱且单点提示易导致尺度歧义和时序漂移的问题,EchoPilot在不训练的条件下组合冻结的医学VLM、视觉基础模型和视频分割器:用S.E.E.D.选择首帧最佳语义尺度并生成辅助点,再以可靠性门控限制不确定帧写入记忆。其在CAMUS、乳腺病灶和新建胎盘数据集上优于训练免费基线及微调医学模型,胎盘场景提升尤为明显。

LRDDv3: High-Resolution Long-Range Drone Detection Dataset with Range Information and Thermal Data Figure 1
2026-05-26cs.CV

LRDDv3: High-Resolution Long-Range Drone Detection Dataset with Range Information and Thermal Data

Knut Peterson, Zaid Mayers, Azmain Yousuf, Priontu Chowdhury, Asher Zaczepinski, Solmaz Arezoomandan, Reihaneh Maarefdoust, David Han

2026-05-26视觉感知数据集/基准安全鲁棒

针对无人机与载人/无人平台共域飞行时远距离感知数据不足的问题,LRDDv3主要贡献是把4K机载RGB、配对640×512热红外、0–200米距离标注和多天气/光照/遮挡场景整合到同一数据集中。论文结果是发布102,532张RGB图像与29,630张配对IR图像,较既有数据集更适合评估小目标远距检测;性能增益可能主要来自更大规模和更高质量数据。

Where Concept Erasure Should Occur: Concept-Layer Alignment in Text-to-Video Diffusion Models Figure 1
2026-05-26cs.CV

Where Concept Erasure Should Occur: Concept-Layer Alignment in Text-to-Video Diffusion Models

Yiwei Xie, Ping Liu, Zheng Zhang

2026-05-26视觉感知生成模型优化算法

这篇论文针对文本到视频扩散模型中概念擦除常因固定层干预而出现语义泄漏或画质退化的问题,指出不同概念只在特定深度形成较好可分的“概念-层拓扑对齐”。作者提出 CLEAR,将干预层选择建模为基于目标/非目标可分性的优化,并结合稀疏特征操作,在不更新扩散模型权重的情况下自动找层。Wan2.2-5B、CogVideoX-2B 实验显示其能更强抑制物体、身份和敏感概念,同时基本保持生成质量。

How Accurate are Video Quality Models for Diffusion-Based Video Super-Resolution? Figure 1
2026-05-26eess.IV

How Accurate are Video Quality Models for Diffusion-Based Video Super-Resolution?

Benjamin Herb, Steve Göring, Alexander Raake, Rakesh Rao Ramachandra Rao

2026-05-26视觉感知生成模型

扩散式视频超分常用客观质量模型自评,但其生成细节、过锐化和时空不一致可能偏离人眼感知。本文以4K播放场景构建主观测试,比较6种上采样方法及AV1、DCVC-RT等退化,并系统检验全参考/无参考指标。结果显示LPIPS、DISTS、CVQA-FR等CNN全参考模型在序列内相关性较高,但多数指标会高估SCST的过锐化,VMAF也受Starlight Mini空间不一致影响;现有模型仍不足以替代主观评价。

Closed-Loop Bidirectional Prompting for Adversarial Robustness of Vision Language Models Figure 1
2026-05-26cs.CV

Closed-Loop Bidirectional Prompting for Adversarial Robustness of Vision Language Models

Xiao Liu, Jiaxiang Liu, Boci Peng, Boren Hu, Yusong Wang, Xiwen Chen, Prayag Tiwari, Liming Zhang, Mingkun Xu

2026-05-26视觉感知模仿学习学习理论数据集/基准三维

论文针对 CLIP 等视觉语言模型在白盒对抗扰动下跨模态语义对齐易被破坏的问题,指出现有防御多为单向或静态提示,难以按样本恢复一致性。其核心是冻结编码器,引入文本到视觉去噪与视觉到文本提示更新的闭环双向提示,并用语义锚约束迭代避免漂移。实验覆盖 11 个数据集,显示鲁棒性、base-to-new 泛化和计算开销之间优于多类基线。

Curve Skeletonization in Continuous domain for Meshes and Point Clouds Figure 1
2026-05-26cs.GR

Curve Skeletonization in Continuous domain for Meshes and Point Clouds

Jai Bardhan, Ramya Hebbalaguppe, Aravind Udupa

2026-05-26三维

针对局部分隔符(LS)骨架化依赖离散图、易受网格质量和点云噪声影响的问题,本文将其推广到连续流形框架 CSCD,并分别实现面向网格的 CSCD-M 与点云的 CSCD-PC;前者利用内蕴三角化保持拓扑,后者结合 tufted Laplacian 提升鲁棒性。实验显示,CSCD-M 在多类网格和 Thingi10k 上达到或优于 LS、平均更快约 60%,CSCD-PC 在定性比较中优于 CA++ 与 EPCS,并可用于分类、分割及孔洞/收缩结构识别。

R5DGS: Semantic-Aware 4D Gaussian Splatting with Rigid Body Constraints for Efficient Dynamic Scene Reconstruction Figure 1
2026-05-26cs.CV

R5DGS: Semantic-Aware 4D Gaussian Splatting with Rigid Body Constraints for Efficient Dynamic Scene Reconstruction

Denis Gridusov, Maxim Popov, Sergey Kolyubin

2026-05-26机器人视觉感知优化算法三维

面向机器人等需要预测动态三维场景的应用,R5DGS针对物理4D Gaussian逐粒子推理开销大且缺少对象语义的问题,引入Identity Encoding做高斯到物体分组,并用CLIP离线表支持文本检索;外推时仅积分物体代表/质心并刚体传播到组内高斯。实验在动态室内场景上约从62.1提升到73.6 FPS、mIoU基本不变,但PSNR明显下降,且依赖SAM2+DEVA离线掩码,遮挡快速运动下会受影响。

AgentGrounder: Zero-Shot 3D Visual Pointcloud Grounding using Multimodal Language Models Figure 1
2026-05-26cs.CV

AgentGrounder: Zero-Shot 3D Visual Pointcloud Grounding using Multimodal Language Models

Cuong Huynh, Maxim Popov, Denis Gridusov, Sergey Kolyubin

2026-05-26视觉语言视觉感知强化学习学习理论三维

针对零样本3D视觉定位依赖多视图图像、候选过多且空间推理易级联出错的问题,AgentGrounder直接面向彩色点云,先离线构建含实例、语义和3D框的对象表,再由多模态代理按查询选择候选、做确定性几何评分,并在需要颜色/材质等证据时按需渲染。ScanRefer和Nr3D上相对SeeGround取得稳定提升,但文中不同位置对Nr3D增益表述不一。

SP-MoMamba: Superpixel-driven Mixture of State Space Experts for Efficient Image Super-Resolution Figure 1
2026-05-26cs.CV

SP-MoMamba: Superpixel-driven Mixture of State Space Experts for Efficient Image Super-Resolution

Wenbin Zou, Yawen Cui, Yi Wang, Lap-Pui Chau, Liang Chen, Jinshan Pan, Huiping Zhuang, Guanbin Li

2026-05-26视觉感知学习理论数据集/基准三维

针对 Mamba 类超分方法将图像刚性展平成序列、破坏空间语义拓扑且难适配多尺度纹理的问题,SP-MoMamba把超像素作为状态空间建模单元,用SP-SSM压缩同质区域,并通过多尺度专家路由与局部空间调制兼顾全局一致性和边缘细节。实验称其在标准SR基准上取得更好的重建质量与效率折中,但具体增益归因仍需看消融细节。

A Clinically Validated Foundation Model for Comprehensive Lung Pathology Interpretation Figure 1
2026-05-26eess.IV

A Clinically Validated Foundation Model for Comprehensive Lung Pathology Interpretation

Zhengrui Guo, Zhengyu Zhang, Jiabo Ma, Yihui Wang, Fengtao Zhou, Yingxue Xu, Ling Liang, Chenglong Zhao, Qi Xie, Jinbang Li, Shujing Guo, Fangyi Han, Zhijian Cen, Ziyi Liu, Cheng Jin, Junlin Hou, Zhixuan Chen, Yu Cai, Lijuan Qu, Shifu Chen, Yueping Liu, Zhe Wang, Xiuming Zhang, Muyan Cai, Li Liang, Hao Chen

Department of Pathology, Nanfang Hospital, Southern Medical University, Guangzhou, China., Department of Pathology, School of Basic Medical Sciences, Southern Medical University, Guangzhou, China., Department of Computer Science and Engineering, Hong Kong University of Science and Technology, Hong Kong, China, Guangdong Provincial Key Laboratory of Molecular Tumor Pathology, Guangzhou, China., Department of Pathology, Shandong Provincial Qianfoshan Hospital, Jinan, Shandong, China, Department of Pathology, The Affiliated Qingyuan Hospital (Qingyuan People’s Hospital), Guangzhou Medical University, Qingyuan, China, Department of Pathology, 900th Hospital of PLA Joint Logistic Support Force, Fuzhou, China, Department of Pathology, the Fourth Hospital of Hebei Medical University, Shijiazhuang, Hebei, China, Department of Pathology, The First Affiliated Hospital of USTC, Division of Life Sciences and Medicine, University of Science and Technology of China, Hefei, China, Department of Pathology, The First Affiliated Hospital, School of Medicine, Zhejiang University, Hangzhou, China, Department of Chemical and Biological Engineering, Hong Kong University of Science and Technology, Hong Kong SAR, China, Division of Life Science, Hong Kong University of Science and Technology, Hong Kong SAR, China

2026-05-26视觉感知

针对肺癌病理在活检、冰冻切片和术后评估中任务割裂、泛癌基础模型缺少专科深度与前瞻验证的问题,本文提出 PulmoFoundation,在 Virchow2 上用约 40000 张肺部 H&E 全切片、8800 万图块持续预训练,并覆盖诊断、分期、分子和预后任务。模型在 26k+ WSI、32 项任务及多中心外部队列中优于多种泛癌模型;前瞻 1357 例平均 AUC 92.3%,RCT 中辅助病理医生将准确率从 83.8% 提至 91.7%,并缩短诊断时间。

DyCoRM: Dynamic Criterion-Aware Reward Modeling for Text-to-Image Generation Figure 1
2026-05-26cs.CV

DyCoRM: Dynamic Criterion-Aware Reward Modeling for Text-to-Image Generation

Jiaying Qian, Ziheng Jia, Qian Zhang, Zicheng Zhang, Jiayi Guo, Junqi Zhang, Guangtao Zhai, Xiongkuo Min

2026-05-26视觉感知强化学习数据集/基准三维

本文针对文生图奖励模型常把偏好压成静态总分、难以适配不同用户任务的问题,提出 DyCoRM:先从提示词与图像对中定位当前相关评价准则,再按准则进行偏好比较;同时构建 DyCoDataset-20K 与 DyCoBench-1K,并用 DyCoPick做选图。实验显示其在动态准则评测、跨域总体偏好和人工选图中优于 HPSv3、ImageReward 等基线。

WBench: A Comprehensive Multi-turn Benchmark for Interactive Video World Model Evaluation Figure 1
2026-05-26cs.CV

WBench: A Comprehensive Multi-turn Benchmark for Interactive Video World Model Evaluation

Kaining Ying, Hengrui Hu, Siyu Ren, Jiamu Li, Fengjiao Chen, Ziwen Wang, Xuezhi Cao, Xunliang Cai, Henghui Ding

2026-05-26机器人视觉语言视觉感知强化学习规划控制

针对交互式视频世界模型评测碎片化、难以同时诊断画质、可控性、记忆与物理的问题,WBench构建289个多轮案例和1058次交互,覆盖开放场景、双视角及导航/动作/事件编辑/视角切换,并用文本、6-DoF位姿、离散动作统一导航接口和22项自动指标评测。对20个模型的结果显示暂无模型在五维都强,导航最脆弱,物理正确性更随渲染质量而非控制能力变化。

MuNet: A Mutualistic Network for Joint 3D Human Mesh Recovery and 3D Clothed Human Reconstruction from Single Images Figure 1
2026-05-26cs.CV

MuNet: A Mutualistic Network for Joint 3D Human Mesh Recovery and 3D Clothed Human Reconstruction from Single Images

Yunqi Gao, Leyuan Liu, Yuhan Li, Changxin Gao, Jingying Chen

2026-05-26视觉感知强化学习模仿学习优化算法数据集/基准

针对单图像中人体网格恢复与穿衣人体重建长期分开处理、衣物尤其宽松服装会干扰体型估计的问题,MuNet 将两者统一为 2-流形图表示,并用端到端图卷积逐步从初始图变形到裸人体网格和带衣表面;其关键洞察是让人体网格为重建提供拓扑与定位先验,同时用表面误差反向修正网格估计。在 Human3.6M、3DPW、THuman2.0 等六个基准上,文中报告两项任务均达到 SOTA。

SAM3-Assisted Training of Lightweight YOLO Models for Precision Pig Farming Figure 1
2026-05-26cs.CV

SAM3-Assisted Training of Lightweight YOLO Models for Precision Pig Farming

Marcos Vinicius Mendes Faria, Thiago Borges Pereira, Isabella C.F.S. Condotta, Thiago Meireles Paixão, Francisco de Assis Boldt

2026-05-26视觉感知数据集/基准三维

面向精准养猪中“基础模型太重、轻量检测器又依赖人工标注”的矛盾,论文将 SAM 3 作为离线零样本自动标注器,用文本提示生成猪只伪框来训练 YOLOv8,并在部署时仅运行轻量学生模型。PigLife 实验显示,SAM 3 监督的 YOLOv8m 在零人工标注下达到 79.4% mAP,较教师推理约快 200 倍;低遮挡场景 AP50 超过 99%,但总体仍低于人工标注基线约 91.7%。

When Search Becomes Memory: Turning Robot Design Trials into Transferable Skills Figure 1
2026-05-26cs.RO

When Search Becomes Memory: Turning Robot Design Trials into Transferable Skills

Yunfei Wang, Xiaohao Xu, Yang Li, Xiaonan Huang

University of Michigan, Ann Arbor

2026-05-26机器人

这篇论文针对机器人形态搜索“只保留最优个体、丢弃试验经验”的问题,提出 AUTO-ROBOTIST:用固定 LLM 将 EVOGYM 中的评估轨迹提炼为可审计的自然语言技能库,包含结构原型、正负规则和证据,并在后续搜索中检索这些技能指导精英体编辑,同时保留 GA 变异探索。实验显示其在 7 个任务的 5×5 冷启动搜索中优于或不逊于 GA,并在 5×5 到 10×10 迁移中全部任务超过 GA,尤其适合接触、支撑和承载结构关键的场景。

[CLS] is Not Enough: Multi-Label Recognition via Patch-Level Inference and Adaptive Aggregation Figure 1
2026-05-26cs.CV

[CLS] is Not Enough: Multi-Label Recognition via Patch-Level Inference and Adaptive Aggregation

Akang Wang, Xili Deng, Zhanxuan Hu, Yi Zhao, Yonghang Tai, Huafeng Li

2026-05-26视觉语言视觉感知模仿学习优化算法数据集/基准

这篇论文针对 CLIP 等视觉语言模型在多标签识别中依赖单一 [CLS] 全局表征、易漏检小目标和共现目标的问题,提出训练自由的 PIAA:将识别转为 patch 级推理,并通过语义解耦、无监督视觉分类器缓解图文模态差,再自适应聚合局部与全局分数。实验显示其在多个多标签基准上优于代表性方法,NUS-WIDE 上 mAP 提升超过 6%,且额外计算较少。

Data-driven Head Motion Generation through Natural Gaze-Head Coordination Figure 1
2026-05-26cs.CV

Data-driven Head Motion Generation through Natural Gaze-Head Coordination

Xiaohan Liu, Yilin Wen, Yusuke Sugano

2026-05-26视觉感知生成模型规划控制数据集/基准三维

针对凝视控制人脸/数字人中常把视线与头姿独立建模、导致动态转头僵硬的问题,本文从野外大规模人脸视频自动抽取视线与头部运动,并用带 GRU 上下文的 cVAE 学习二者的概率与时序耦合,生成随输入视线变化的多样头动。实验在 CelebV-Text 抽取数据和视频生成应用上验证,人评与定量比较均显示其自然性和视线协调性优于基线。

An Analysis Focused on Womens Safety: Can VAD Models Be Enhanced by a Multi-modal Dataset? Figure 1
2026-05-26cs.CV

An Analysis Focused on Womens Safety: Can VAD Models Be Enhanced by a Multi-modal Dataset?

Sangeeta, Maddikuntla Sai Prajwal, Debi Prosad Dogra, Kamalakar Vijay Thakare, Hyungjoo Jung, Ig-Jae Kim, Heeseung Choi

2026-05-26视觉语言视觉感知强化学习数据集/基准三维

针对现有视频异常检测数据集偏向高质量、近景、通用暴力场景,难以识别跟踪、抢链、骚扰等女性安全相关细粒度异常,论文构建了含1001段真实监控视频与多源文本描述的ExtrAnom多模态基准。实验显示,在UCF-Crime等数据上训练的视觉/VLM方法在该场景中频繁误描述、误分类,说明瓶颈可能主要来自数据覆盖不足。

Event-to-Video Reconstruction using Spatio-Temporal and Frequency-Enhanced Deep Neural Networks Figure 1
2026-05-26cs.CV

Event-to-Video Reconstruction using Spatio-Temporal and Frequency-Enhanced Deep Neural Networks

Ramna Maqsood, Paulo Nunes, Luís Ducla Soares, Caroline Conti

2026-05-26视觉感知强化学习数据集/基准三维安全鲁棒

针对事件相机缺少稠密帧、现有 CNN/Transformer 在长程建模、细节恢复与计算开销间难兼顾的问题,论文提出 MSFET-E2V,将 CRNN 时空特征与 DWT 小波低/高频表示通过跨域注意力融合,并用小波增强跳连抑制伪影。实验称其在多个真实事件数据集上优于现有方法,同时较已有 Transformer 降低参数量、显存和推理时间。

ATV-Net: Adaptive Triple-View Network with Dynamic Feature Fusion Figure 1
2026-05-26cs.CV

ATV-Net: Adaptive Triple-View Network with Dynamic Feature Fusion

Hsin-Jui Pan, Sheng-Wei Chan, Meng-Qian Li, Chun-Po Shen

2026-05-26视觉感知强化学习学习理论三维

论文针对语义分割中 Transformer/复杂上下文模块成本较高、而传统 CNN 融合多尺度感受野多为固定权重的问题,提出在 ResNet-101 分割头中引入 micro/local/scout 三视图,并用 Adaptive Decision Gate 按场景动态融合点语义、边界结构与扩大上下文。Cityscapes 验证集达到 80.31% mIoU,说明简单 CNN 头部经自适应感受野选择仍具竞争力。

Rethinking VLM Representation for VLA Initialization Figure 1
2026-05-26cs.CV

Rethinking VLM Representation for VLA Initialization

Weifeng Lin, Siyuan Huang, Hao Li, Tingwei Chen, Ruichuan An, Xinyu Wei, Jianbo Liu, Hongsheng Li

2026-05-26机器人视觉语言视觉感知强化学习规划控制

这篇论文针对 VLA 常把预训练 VLM 当策略骨干、但初始化该保留或改造哪些表征不清的问题,把初始化拆成具身 VQA 能力域、更新方式和机器人数据预训练三轴来做受控分析。核心洞察是:原始 VLM 表征本身对动作学习很关键,具身 VQA 只有匹配下游瓶颈才有效且能力组合不简单相加;LoRA 比全量微调更稳,分阶段 LoRA 结合 Grounding、第一视角理解与机器人轨迹预训练取得最好初始化。

PixelWizard: Towards Efficient High-Fidelity Video Generation at Ultra-Large Spatial Resolution Figure 1
2026-05-26cs.CV

PixelWizard: Towards Efficient High-Fidelity Video Generation at Ultra-Large Spatial Resolution

Wenxue Li, Jingjing Ren, Peng Zhang, Tian Ye, Daiguo Zhou, Jian Luan, Lei Zhu

2026-05-26视觉感知生成模型规划控制优化算法三维

PixelWizard针对2K/4K视频生成中长token序列导致的全局结构失稳、训练与推理成本过高问题,将全局时空结构规划与高分辨率纹理合成解耦:先在紧凑潜空间生成时空锚点,再用锚点引导DiT细节生成,并通过噪声跨度对齐的shortcut训练支持少步采样。实验显示其在原生2K/4K生成中保持结构与细节质量,同时采样加速超过10倍。

Addressing Exacerbated Attention Sink for Source-Free Cross-Domain Few-Shot Learning Figure 1
2026-05-26cs.CV

Addressing Exacerbated Attention Sink for Source-Free Cross-Domain Few-Shot Learning

Shuai Yi, Yixiong Zou, Yuhua Li, Ruixuan Li

2026-05-26视觉语言视觉感知强化学习学习理论数据集/基准

面向无源跨域少样本学习,论文指出 CLIP 在目标域少样本微调时会放大 attention sink,使不同类别依赖相同“简单 token”而削弱可分性。作者将其解释为跨域适配的捷径学习,并提出 TIR 按视觉 token 与类别文本的相关性动态重加权,抑制 sink token、强化更具判别性的 hard token;在四个 CDFSL 基准上报告达到新的 SOTA。

VertiCue-Bench: Diagnosing Whether MLLMs Use Height Cues to Resolve 2D Ambiguity in Remote Sensing Natural Scenes Figure 1
2026-05-26cs.CV

VertiCue-Bench: Diagnosing Whether MLLMs Use Height Cues to Resolve 2D Ambiguity in Remote Sensing Natural Scenes

Jing Huang, Duanchu Wang, Junjie Yang, Zihang Cheng, Cheng Li, Lin Cui, Zhouyi Wu, Di Wang

2026-05-26视觉语言优化算法数据集/基准三维

针对遥感自然场景中仅凭RGB易因光谱混淆而误判的问题,本文提出VertiCue-Bench,用显式冠层高度模型(CHM)诊断MLLM是否能把垂直几何线索转化为语义判别依据。基准含1534个样本、17类任务,并分离高度感知、跨模态对齐与语义-几何推理。对14个通用和遥感MLLM的评测显示,模型虽能初步读取高度信息,但在需要联合约束的歧义推理中常无法受益,甚至弱于RGB-only基线,暴露出明显的几何到语义鸿沟。

OMGTex: One-stage Multi-style Facial Texture Reconstruction without Geometry Guidance Figure 1
2026-05-26cs.CV

OMGTex: One-stage Multi-style Facial Texture Reconstruction without Geometry Guidance

Zitong Xiao, Yuda Qiu, Zisheng Ye, Xiaoguang Han

2026-05-26视觉感知生成模型模仿学习优化算法数据集/基准

面向游戏、VR 等场景中遮挡人脸和多种风格化头像难以获得可靠 3D 几何、且纹理缺少可编辑语义分解的问题,OMGTex 用扩散模型直接从单张 2D 人脸生成 UV 纹理,并通过推理时梯度引导修正 UV 对齐、训练中强化语义分布以支持局部编辑;同时构建 CANVAS 配对数据集。实验显示其在多个人脸纹理基准上达到 SOTA,并具备较好的风格一致性、鲁棒性和编辑能力。

DRFusion: Drift-Resilient Temporally Consistent Infrared-Visible Video Fusion Figure 1
2026-05-26cs.CV

DRFusion: Drift-Resilient Temporally Consistent Infrared-Visible Video Fusion

Xingyuan Li, Haoyuan Xu, Shulin Li, Xiang Chen, Zhiying Jiang, Jinyuan Liu

2026-05-26视觉感知生成模型模仿学习优化算法三维

针对红外-可见光视频融合中逐帧扩散易闪烁、光流约束易产生鬼影且自回归会漂移的问题,DRFusion将融合改写为基于历史条件的运动生成,引入稳定历史引导与软时间锚定,把时序一致性视为频谱滤波,并用两阶段结构-运动解耦适配预训练3D-DiT先验。实验显示其在融合质量和时间稳定性上达到当前最优。

SAFE-Diff: Scale-Aware Attention and Feature-Dispersive Diffusion with Uncertainty Estimation for Contrast-Enhanced Breast MRI Synthesis Figure 1
2026-05-26cs.CV

SAFE-Diff: Scale-Aware Attention and Feature-Dispersive Diffusion with Uncertainty Estimation for Contrast-Enhanced Breast MRI Synthesis

Tianyu Zhang, Xinglong Liang, Jarek van Dijk, Luyi Han, Chunyao Lu, Antonio Portaluri, Xinghe Xie, Yaofei Duan, Nika Rasoolzadeh, Xin Wang, Yuan Gao, Muzhen He, Yue Sun, Jonas Teuwen, Tao Tan, Ritse Mann

2026-05-26生成模型安全鲁棒

针对乳腺 DCE-MRI 依赖钆对比剂带来的安全、成本与筛查效率问题,SAFE-Diff 用非增强 T1 与多 b 值 DWI 合成虚拟增强 MRI。其核心是在直接 x0 预测扩散框架中结合多尺度/窗口注意力、像素级不确定性重加权和特征分散正则,以兼顾长程解剖上下文与细粒度病灶纹理。实验显示其在增强特征重建上优于既有方法,但摘要未给出具体数据规模与临床读片验证细节。

Concept Unlearning via Cross-Attention Activation Projection for Diffusion Models Figure 1
2026-05-26cs.CV

Concept Unlearning via Cross-Attention Activation Projection for Diffusion Models

Saemi Moon, Suhyeon Jun, Seoyeon Lee, Dongwoo Kim

2026-05-26视觉感知生成模型规划控制数据集/基准三维

本文针对扩散模型概念遗忘在改写、对抗提示下易泄漏的问题,指出文本嵌入只描述提示词,而交叉注意力激活更接近模型将要生成的内容。PURE从短去噪轨迹中按层收集激活,构造遗忘/保留子空间并一次性投影编辑K/V权重,无需推理开销。在HUB十类概念上,它降低目标泄漏并保持非目标概念,取得更好的遗忘-保留折中。

Benchmarking Pathology Foundation Models for Spatial Domain Understanding Figure 1
2026-05-26cs.CV

Benchmarking Pathology Foundation Models for Spatial Domain Understanding

Bokai Zhao, Yiyang Zhang, Yuanchi Zhu, Hanqing Chao, Long Bai, Tai Ma, Minfeng Xu, Ming Song, Tianzi Jiang

2026-05-26视觉感知强化学习数据集/基准

现有病理基础模型多用临床下游任务评测,难以判断其表征是否真正编码组织区域及空间关系。本文提出 SpaPath-Bench,把配对 WSI–空间转录组数据上的空间域识别作为表征级诊断,比较 19 个编码器与 7 类 SDI 方法,并用空间连续性、转录组参照和专家标注三类指标评估。83K 次实验显示,不同预训练范式捕获的组织空间结构侧重点不同,为构建空间感知病理模型提供了更细粒度基准。

AI-T2I: Aggregating-and-Isolating Cross-Attention to Diffusion Models for Text-to-Image Synthesis Figure 1
2026-05-26cs.CV

AI-T2I: Aggregating-and-Isolating Cross-Attention to Diffusion Models for Text-to-Image Synthesis

Shipeng Cao, Biao Qian, Haipeng Liu, Yang Wang, Meng Wang

2026-05-26视觉感知生成模型强化学习规划控制学习理论

该文针对扩散文生图中多主体提示常见的注意力错位问题:同一主体的 cross-attention 激活会空间散裂,不同主体又容易重叠混合。AI-T2I 的核心是在去噪过程中同时施加聚合损失与隔离损失,先把同一 token 的高响应区域收拢,再拉开不同主体 token 的响应分布,并分析欧氏距离等度量选择。实验称在 AnE、T2I-CompBench++ 等基准优于现有方法,且可插入布局可控生成和个性化生成任务。

Towards Anatomically Plausible Human Image Generation via Synthetic Localized Preferences Figure 1
2026-05-26cs.CV

Towards Anatomically Plausible Human Image Generation via Synthetic Localized Preferences

Bao Li, Yuliang Xiu, Zhen Liu

2026-05-26视觉感知生成模型规划控制优化算法学习理论

针对文生图模型在人像生成中常出现手指、面部等局部解剖错误的问题,论文提出 ASAP:先在高质量人像的特定部位合成可控解剖退化,构建 1 万余对 HAP 偏好数据,再用局部加权且有边界的 DPO 对齐,避免只优化全图或局部过拟合。实验在 FLUX、SDXL 上降低解剖错误率约 18.4% 和 11.8%,同时基本保持整体视觉质量。

Broadband Hyperspectral 3D Imaging using Dispersed Structured Light Figure 1
2026-05-26cs.CV

Broadband Hyperspectral 3D Imaging using Dispersed Structured Light

Suhyun Shin, Yunseong Moon, Ryota Maeda, David Lindell, Kyros Kutulacos, Seung-Hwan Baek

2026-05-26视觉感知强化学习优化算法三维

现有高光谱3D多局限于可见光或需双光谱仪,难以同时获取宽谱材料线索与几何。本文用卤素光、棱镜-振镜色散结构光和VNIR/SWIR双目相机,以单光谱仪建模并联合重建450–1500 nm反射率与深度。实测在多场景达到SAM 0.13 rad、RMSE 0.03、深度误差4.5 mm,并展示同色异谱识别、穿透成像、钞票隐藏特征和血管显现。

SplitAvatar: One-shot Head Avatar with Autoregressive Gaussian Splitting Figure 1
2026-05-26cs.CV

SplitAvatar: One-shot Head Avatar with Autoregressive Gaussian Splitting

Hongzhe Liao, Chuhua Xian, Hongmin Cai, Haiyang Liu, Fa-Ting Hong

2026-05-26视觉感知规划控制三维

针对单图可驱动头部头像中,3DMM 表情先验产生的稀疏高斯与图像重建所需稠密高斯数量不匹配、细节不足的问题,SplitAvatar 将身份与表情高斯分支建模,并用自回归 GNN 逐层拆分表情高斯,配合网格拓扑扩展、软门控密度控制和延迟过滤抑制冗余。实验显示该设计能提升表情细节与重建质量,但具体增益幅度需结合完整量化结果判断。

SFR-Net: Learning Scale-Frustum Representations for Ultra-Wide Area Remote Sensing Image Segmentation Figure 1
2026-05-26cs.CV

SFR-Net: Learning Scale-Frustum Representations for Ultra-Wide Area Remote Sensing Image Segmentation

Chuyu Zhong, Keyan Chen, Qinzhe Yang, Bowen Chen, Zhengxia Zou, Zhenwei Shi

2026-05-26视觉感知学习理论三维

这篇论文针对超广域遥感图像同时具备超大像素数和广覆盖范围时,裁块方法丢失长程语义、UHR方法难保细节的问题,提出SFR-Net:以同一参考点构建局部、短程、长程的尺度视锥表示,并用级联跨尺度融合逐步注入上下文。在GID和FBPS上较最强基线mIoU分别提升1.72%和4.29%,且SFR可作为通用分割网络插件提升精度与收敛速度。

DeCoDrift: Stabilizing Decoder Coupling in Closed-Loop Foundation Segmentation Figure 1
2026-05-26cs.CV

DeCoDrift: Stabilizing Decoder Coupling in Closed-Loop Foundation Segmentation

H. M. Shadman Tabib, Md. Shamsuzzoha Bayzid, M Sohel Rahman

2026-05-26视觉感知强化学习

这篇论文关注 SAM 等基础分割模型在闭环迭代提示中把上一轮掩码反馈为下一轮提示时产生的误差累积问题,提出“解码器耦合漂移”这一内部注意力失配视角,并用无需真值的耦合、稳定性与时序指标监测解码器动态。DeCoDrift 通过推理时近端锚定约束提示更新,无需训练或监督,在电镜体数据上提升注意力稳定性与时序一致性,IoU 相对提高 37.7%。

TriDP-PTM: a three-stage distortion-perception tradeoff guides the pre-training model for radar cardiac sensing Figure 1
2026-05-26cs.CV

TriDP-PTM: a three-stage distortion-perception tradeoff guides the pre-training model for radar cardiac sensing

Jinye Li (1, 2, 3), Aidong Men (4), Yang Liu (5), Qingchao Chen (1, 6) ((1) National Institute of Health Data Science, Peking University, Beijing, China, (2) Institute of Medical Technology, (3) Beijing University of Posts and Telecommunications, (4) School of Artificial Intelligence, Beijing University of Posts and Telecommunications, (5) Wangxuan Institute of Computer Technology, (6) State Key Laboratory of General Artificial Intelligence, China)

2026-05-26视觉感知数据集/基准三维

针对雷达无接触心脏监测中“波形低失真”与“任务感知强”难兼得的问题,TriDP-PTM引入雷达到ECG再到任务的间接路径,并用ECG生成器与特征判别器平衡失真/感知损失,提出正和、竞合、负和三阶段洞察。30名受试者、5种状态实验显示,间接路径优于直接预测,分割mIoU达0.80,四类任务平均准确率98.3%,血压回归MAE较最强基线降约56%。

CMAP: Cross-Modal Adaptive Prompting for Multi-Domain Task-Incremental Learning Figure 1
2026-05-26cs.CV

CMAP: Cross-Modal Adaptive Prompting for Multi-Domain Task-Incremental Learning

Sriram Mandalika

2026-05-26视觉语言视觉感知数据集/基准三维安全鲁棒

该文针对多域任务增量学习中CLIP被当作纯视觉模型使用的问题,认为只靠视觉特征做任务路由和置信估计会浪费文本空间的稳定语义。CMAP用冻结文本原型路由、视觉多原型与图文对齐联合置信、并将Gumbel门控扩展到文本编码器。在MTIL 11数据集上以约2.5M可训练参数、无外部数据取得约74% Transfer、80% Average和89% Last,较IAP有数个百分点提升,但文中不同处结果数值略不一致。

Towards Open-World Referring Expression Comprehension: A Benchmark with Training-free Multi-task Consistency Checker Figure 1
2026-05-26cs.CV

Towards Open-World Referring Expression Comprehension: A Benchmark with Training-free Multi-task Consistency Checker

Zongjian Wu, Lei Zhang

2026-05-26视觉语言视觉感知强化学习模仿学习数据集/基准

现有指代表达理解基准多为单目标、简单场景,难以反映开放世界中目标缺失、多目标、恶劣天气和复杂词汇带来的失败。本文提出 OpenRef 基准,引入多视觉域、可变目标数量和专名/多义/序数表达,并用 F1 与 N3R 评估定位和负样本拒识;同时给出无需训练的 MCC,通过计数与定位一致性自检修正输出。实验显示该设置显著拉低现有模型表现,MCC 可提升多种 REC 模型在复杂场景下的性能。

Opportunistic Target Selection: Early Directional Commitment for Query-Efficient Black-Box Adversarial Attacks Figure 1
2026-05-26cs.LG

Opportunistic Target Selection: Early Directional Commitment for Query-Efficient Black-Box Adversarial Attacks

Florent Tariolle, Florian Yger

2026-05-26强化学习

论文针对无目标黑盒攻击只压低真类置信度而导致“类别漂移”、浪费查询的问题,提出 OTS:先短暂无目标探索,再锁定当前领先的非真类转为目标攻击,作为轻量的 margin-loss 替代。ImageNet 上 5 个模型、3 类攻击的 4500 次实验显示,OTS 对 SimBA 和交叉熵 Square Attack 接近 oracle,成功率最高提升 27 个百分点、迭代数显著下降;但对 Bandits、margin loss 和对抗训练模型基本无益。

DRM: Diffusion-based Reward Model With Step-wise Guidance Figure 1
2026-05-26cs.CV

DRM: Diffusion-based Reward Model With Step-wise Guidance

Jaxon Zhang, Binxin Yang, Hubery Yin, Chen Li, Jing Lyu

2026-05-26视觉语言视觉感知生成模型强化学习三维

针对VLM/CLIP式奖励模型偏重语义、难以评价审美构图等感知质量的问题,论文提出用预训练扩散模型本身作为奖励模型DRM,并利用其可评估去噪中间latent的特性,设计逐步奖励的Step-wise GRPO和逐步采样引导。实验显示该密集反馈可提升对齐稳定性与效率,Step-GRPO约快2.5倍收敛,并改善最终生成图像质量。

StreamChar: Long-Horizon Streaming Character Audio-Video Generation with Decoupled Orchestration Figure 1
2026-05-26cs.CV

StreamChar: Long-Horizon Streaming Character Audio-Video Generation with Decoupled Orchestration

Linrui Tian, Qi Wang, Bang Zhang

2026-05-26视觉感知

面向文本驱动的长时角色音视频流生成,论文针对分块自回归易出现台词错位、身份漂移与扩散低步数失真的问题,提出将长程脚本编排交给 LLM、短窗联合去噪交给 DiT 的解耦框架,并用两阶段蒸馏、进度指针和 sink-chunk 记忆稳定在线 rollout。实验显示其可在单张 H100 上实时运行,在台词一致性、唇音同步、画质和长程稳定性间优于多种联合或音频驱动基线。

ARMA-C3: A Contrastive ARMA Convolutional Framework for Unsupervised and Semi-supervised Classification Figure 1
2026-05-26cs.CV

ARMA-C3: A Contrastive ARMA Convolutional Framework for Unsupervised and Semi-supervised Classification

VSS Tejaswi Abburi, Saurabh J. Shigwan, Nitin Kumar

2026-05-26视觉感知生成模型强化学习学习理论数据集/基准

针对医学影像中标注稀缺、类别不均衡且样本间关系常被忽略的问题,ARMA-C3将受试者/图像建成图节点,用ARMA谱图卷积捕获多尺度关系,并联合对比一致性与图割/模块度正则学习表示。在ADNI、NIFD及乳腺、肺炎、肝脏影像五个二分类任务上,文中报告其在少监督和不均衡场景下相对聚类、传统机器学习和图学习基线更稳健,但具体增益来源仍需更多消融支撑。

Event-based Batting Impact Estimation Figure 1
2026-05-26cs.CV

Event-based Batting Impact Estimation

Ryotaro Ishida, Wataru Ikeda, Ryosei Hara, Akemi Kobayashi, Toshitaka Kimura, Mariko Isogawa

2026-05-26视觉感知强化学习模仿学习规划控制数据集/基准

本文针对棒球击球瞬间难以用普通 RGB 相机或 IMU 精确定位的问题,引入事件相机的微秒级时间分辨率,通过构造高密度事件帧、双向传播粗掩码并用掩码细化网络校正球与球棒边界,再以二者加权质心距离最小点估计撞击时刻。作者还构建了面向高速棒球分析的事件数据集;在低照度和遮挡场景中,方法相对基线将平均绝对误差降低约 63%。

Hierarchical Consistency Learning for Test-time Adaptation in Camouflage Perception Figure 1
2026-05-26cs.CV

Hierarchical Consistency Learning for Test-time Adaptation in Camouflage Perception

Mingfeng Zha, Tianyu Li, Guoqing Wang, Yunqiang Pei, Chaofan Qiao, Jiening Zhang, Yang Yang, Heng Tao Shen

2026-05-26视觉感知优化算法学习理论数据集/基准三维

针对伪装目标检测在测试场景退化、光照变化和未知伪装模式下固定模型易失效的问题,本文将测试时自适应引入伪装感知,并用空间重建结合频域分解提取自监督信号,再通过任务亲和引导和原型一致性约束抑制语义漂移。实验覆盖4个伪装与4个水下基准及3类退化设置,结果显示其较现有方法更稳健,但具体计算开销文中未充分说明。

StreamOV: Streaming Omni-Video Understanding via Evidence-Guided Memory and Response Triggering Figure 1
2026-05-26cs.CV

StreamOV: Streaming Omni-Video Understanding via Evidence-Guided Memory and Response Triggering

Ming Xie, Zizheng Huang, Xudong Tan, Chao Wang, Xiangyu Zeng, Wenxiao Wu, Tao Chen, Limin Wang, Yanwei Fu

2026-05-26视觉语言视觉感知学习理论数据集/基准三维

面向长时连续音视频流,现有离线多模态模型难以在固定计算预算下保存历史证据,也缺少自主判断何时回答的机制。StreamOV的关键做法是用证据引导的长短期记忆压缩视觉、音频及跨模态线索,并以早期解码隐状态作为响应触发器,避免沉默 token 或外部路由器。作者还构建SOVBench评测在线多轮理解与触发能力,实验显示其在SOVBench及多项流式/离线视频基准上达到或接近最佳表现。

UAV-OVO: Out-of-Viewpoint Generalization in UAV Action Recognition Figure 1
2026-05-26cs.CV

UAV-OVO: Out-of-Viewpoint Generalization in UAV Action Recognition

Yu Xia, Zhengbo Zhang, Shuaihu Zhang, Zhigang Tu

2026-05-26视觉感知规划控制学习理论数据集/基准三维

这篇论文针对无人机动作识别中训练于低俯视角、部署到高俯视角时性能骤降的问题,构建了 UAV-OVO 基准:用几何估计视角分数划分低/高俯视角,并匹配 ID/OOD 类别分布以隔离视角偏移影响。实验显示强视频模型存在明显 ID/OOD 落差,如 MViTv2-B 从 66.45% 降至 33.94%;作者提出的 LATER 利用 LoRA 子空间作语义锚进行无梯度测试时重定心,以缓解视角漂移。

Generalized Evidential Deep Learning: From a Bayesian Perspective Figure 1
2026-05-26cs.LG

Generalized Evidential Deep Learning: From a Bayesian Perspective

Yuanye Liu, Yibo Gao, Yuanyang Chen, Xiahai Zhuang

2026-05-26视觉感知

针对现有 Evidential Deep Learning 变体各自修补、缺少统一贝叶斯解释而导致设计敏感和不稳定的问题,论文将 EDL 重写为包含先验、后验更新与训练目标的广义贝叶斯推断,指出网络证据可视为输入相关伪计数,常见损失对应温度化贝叶斯更新下的变分目标,并提出可配置的 GEDL 统一框架。实验显示其在分类、不确定性估计和 OOD 检测上与现有方法相当或更好,但主要价值在理论归并而非显著性能跃升。

SurfSurg6D: Geometry Consistent Dense Correspondence for Textureless Surgical Instrument Pose Estimation Figure 1
2026-05-26cs.CV

SurfSurg6D: Geometry Consistent Dense Correspondence for Textureless Surgical Instrument Pose Estimation

Daiyun Shen, Shuojue Yang, Chang Han Low, Qian Li, Mengya Xu, Qi Dou, Yueming Jin

2026-05-26机器人生成模型优化算法数据集/基准三维

面向微创机器人中器械纹理少、遮挡多且6D标注稀缺的问题,论文构建含6类器械、约6万合成图像及RGB-D/分割/法线/位姿标注的SynSurg6D,并提出SurfSurg6D密集2D-3D对应框架,通过几何距离驱动的困难负样本挖掘和嵌入一致性约束区分相似表面片段。实验在SurgRIPE、EndoVis2018和SurgPose上显示,合成数据能提升多种方法,SurfSurg6D在RGB-only位姿估计中优于已有方法且保持实用速度。

How Far Has AI Come in Liver Fibrosis Staging? A Large-Scale Real-World Dataset and Benchmark Figure 1
2026-05-26cs.CV

How Far Has AI Come in Liver Fibrosis Staging? A Large-Scale Real-World Dataset and Benchmark

Yuanye Liu, Nannan Shi, Zhejia Zhang, Hanxiao Zhang, Boya Wang, Derong Yu, Nao Wang, Yuxin Jin, Yang Zhou, Kunhao Yuan, Siqi Wang, Lida Yang, Xu Qiao, Wentao Liu, Xuelei He, Xin Hong, Guoyan Zheng, Xin Chen, Guang-Zhong Yang, Le Zhang, Lei Li, Yuxin Shi, Xiahai Zhuang

2026-05-26强化学习数据集/基准安全鲁棒

针对肝纤维化 MRI 分期缺乏真实多中心系统评测的问题,论文提出 LiFS 基准:610 例、多扫描仪、多序列且含完整钆塞酸增强与病理标签,并评估 MICCAI 挑战中 9 类方法。结果显示最佳 AI 在部分设置可接近资深放射科医生、超过低年资医生,但中位水平仍约为低年资;跨中心差异、标签不均衡和增强序列波动是主要瓶颈,架构或融合策略只能部分改善鲁棒性。

Artifact Correction for Echo-Planar Imaging at Low-Field and Ultra-Low-Field MRI Figure 1
2026-05-26cs.CV

Artifact Correction for Echo-Planar Imaging at Low-Field and Ultra-Low-Field MRI

Sisi Qiao, Yilin Yu, Tiecheng Lin, Yuhao Liu, Jiajia Sun, Xiaoling Li

2026-05-26生成模型三维

低场/超低场 MRI 虽具低成本和便携优势,但 EPI/DWI 易因奇偶 k 空间线错位产生严重 Nyquist ghost,限制脑结构显示。论文提出无需参考扫描的峰值对齐校正,并叠加插值重采样提升局部一致性,在 LF/ULF EPI 与扩散 EPI 上达到接近参考扫描法的伪影抑制,且进一步改善结构连续性和信号均匀性。

Mosaic: Compositional Multi-Concept Erasure via Vector Field Blending Figure 1
2026-05-26cs.CV

Mosaic: Compositional Multi-Concept Erasure via Vector Field Blending

Junseok Ko, Jungwoo Kim, Jong-Seok Lee

2026-05-26视觉感知生成模型模仿学习优化算法数据集/基准

针对现有概念擦除多在单图单目标上评估、难以覆盖流式 T2I 模型生成的多概念复杂场景,论文提出组合式多概念擦除任务与 CoME-Bench。核心洞察是被擦除概念在基模型与单概念擦除模型的向量场差异中呈空间局部性,Mosaic 据此动态生成概念掩码并混合向量场,无需额外优化。基于 FLUX.1-dev 的实验显示,其能更稳定地同时抑制多个目标概念,并较好保留非目标上下文。

AnE: Pushing the Reasoning Frontier of Multimodal LLMs via Anchor Evolution Figure 1
2026-05-26cs.CV

AnE: Pushing the Reasoning Frontier of Multimodal LLMs via Anchor Evolution

Zehao Wang, Yihan Zeng, Zidong Gong, Yuanfan Guo, Feng Zhu, Hongzhi Zhang, Wei Zhang, Wangmeng Zuo

2026-05-26视觉语言视觉感知强化学习模仿学习规划控制

该文针对多模态大模型后训练中静态数据难以覆盖能力短板、自演化合成数据易引入幻觉推理和认知漂移的问题,提出 Anchor Evolution:先通过轨迹 rollout 定位失败前沿,再从真实标注库检索“真值锚点”构造训练数据,并用带脚手架的 SFT 加 RL 去脚手架来内化推理。以 Qwen2.5-VL-7B 为基座,在八个多模态推理基准平均提升 10.3%,并在 MathVision、EMMA 等任务达到或接近 SOTA。

From Contrast to Consistency: Rethinking Event-based Continuous-Time Optical Flow Estimation Figure 1
2026-05-26cs.CV

From Contrast to Consistency: Rethinking Event-based Continuous-Time Optical Flow Estimation

Rui Hu, Song Wu, Wen Yang, Jinjian Wu

2026-05-26视觉感知生成模型规划控制优化算法数据集/基准

针对事件相机连续时间光流缺少高频真值、传统对比最大化易牺牲轨迹连续性的问题,本文将事件视为具有时空结构一致性的运动流形样本,提出STSC混合监督框架,并结合双向多尺度网络与课程式训练,从点监督逐步过渡到自监督流形约束;多基准实验显示其在连续时间与标准光流估计上均达到SOTA,非线性运动场景中轨迹更物理一致。

ControlLight: Towards Controllable, Consistent, and Generalizable Low-Light Enhancement Figure 1
2026-05-26cs.CV

ControlLight: Towards Controllable, Consistent, and Generalizable Low-Light Enhancement

Yufeng Yang, Jianzhuang Liu, Jisheng Chu, Yuqi Peng, Xianfang Zeng, Jiancheng Huang, Shifeng Chen

2026-05-26视觉感知生成模型强化学习模仿学习规划控制

针对低光增强模型通常只学习单一目标、难以按用户偏好连续调节且生成式编辑易产生结构偏移的问题,ControlLight 构建含连续光照强度监督的 Light100K,并在 FLUX.2-klein 上用 LoRA 训练,引入错位感知加权 flow matching 以抑制伪标签边缘不对齐。实验显示其在低光增强基准上达到 SOTA,并具备更平滑的强度控制和真实场景泛化能力。

Rethinking Scribble-Guided Image Editing: Generalization, Instruction Adherence, and Multi-Tasking Figure 1
2026-05-26cs.CV

Rethinking Scribble-Guided Image Editing: Generalization, Instruction Adherence, and Multi-Tasking

Mingyi Xu, Jinpeng Lin, Min Zhou, Tiezheng Ge, Ming Zeng

2026-05-26视觉感知强化学习规划控制学习理论数据集/基准

针对涂鸦+文本图像编辑在多任务场景中不稳定的问题,论文指出瓶颈主要不是合成到真实等图像域差异,而是编辑指令层面的泛化不足。为此提出先覆盖后真实的课程数据构建、多任务拼接造样本和编辑区域加权损失,在Qwen-Image-Edit-2511上显著提升VIBE单任务与多任务表现,并达到SOTA。

CodecSplat: Ultra-Compact Latent Coding for Feed-Forward 3D Gaussian Splatting Figure 1
2026-05-26cs.CV

CodecSplat: Ultra-Compact Latent Coding for Feed-Forward 3D Gaussian Splatting

Pengpeng Yu, Runqing Jiang, Qi Zhang, Dingquan Li, Jing Wang, Yulan Guo

2026-05-26规划控制优化算法数据集/基准三维

针对前馈 3D Gaussian Splatting 虽能快速重建但缺少便于存储/传输的紧凑场景表示的问题,CodecSplat 将压缩瓶颈前移到生成流程内部,熵编码规则的 2D 高斯生成潜特征,再解码预测深度和高斯参数,避免直接压缩不规则 3D primitives。其在 DL3DV、RealEstate10K 上以每场景约 3.37–107.77 KiB 达到 23.56–27.05 dB PSNR,相比压缩前馈生成高斯约小一个数量级。

Are We Overconfident in Models and Results for Semi-Supervised 3D Medical Image Segmentation? Figure 1
2026-05-26cs.CV

Are We Overconfident in Models and Results for Semi-Supervised 3D Medical Image Segmentation?

Jun Li, Ziwei Qin

2026-05-26视觉感知数据集/基准三维安全鲁棒

本文质疑半监督3D医学分割中“高置信即可靠”和用测试集选模型带来的双重过度自信:前者放大伪标签确认偏差,后者推高SOTA。作者提出TCSeg,以置信度与不确定性双轴评估可靠性,并在概率、特征、图像三空间协同校准伪标签。三套基准上在既有协议下表现稳定,同时强调多次运行与最终检查点评估以减少过拟合式增益。

ComPose: A Unified Completion-Pose Framework for Robust Category-Level Object Pose Estimation Figure 1
2026-05-26cs.CV

ComPose: A Unified Completion-Pose Framework for Robust Category-Level Object Pose Estimation

Huan Ren, Yihan Chen, Chuxin Wang, Nailong Liu, Wenfei Yang, Tianzhu Zhang

2026-05-26数据集/基准三维安全鲁棒

针对类别级物体位姿估计中深度点云因自遮挡而不完整、直接级联补全又带来误差累积和开销的问题,ComPose 将点云补全作为任务驱动的内部表示,与位姿估计统一建模;其核心是逐步预测完整关键点及邻域稠密点,并用几何关系编码与一致性损失约束 NOCS 变换结构。实验显示其在标准基准上超过现有方法,深度版在 REAL275 的 10°2cm 指标提升 9.1%,且不依赖类别形状先验。

TapSampling: Inference-Time Sampling with a Task-Progress-Understanding Verifier for Robotic Manipulation Figure 1
2026-05-26cs.RO

TapSampling: Inference-Time Sampling with a Task-Progress-Understanding Verifier for Robotic Manipulation

Sizhe Zhao, Shengping Zhang, Shuo Yang, Weiyu Zhao, Shuigen Wang, Xiangyang Ji

2026-05-26机器人

论文针对扩散/自回归机器人策略在单次随机推理下不稳定的问题,提出推理时采样框架 TapSampling:用 Action-VAE 在低维后验中高效生成接近真实动作分布的候选动作,再用基于任务进展预测训练的验证器选择动作。实验称其在仿真和真实环境中无需微调即可提升多种通用操作策略表现。

Tetris: Tile-level Sampling for Efficient and High-Fidelity Video Object Tracking Figure 1
2026-05-26cs.CV

Tetris: Tile-level Sampling for Efficient and High-Fidelity Video Object Tracking

Chanwut Kittivorawong, Alena Chao, Charlie Si, Alvin Cheung

2026-05-26视觉感知优化算法学习理论数据集/基准三维

面向固定摄像头视频的轨迹物化,论文指出检测器调用占主要成本,而整帧时间采样会损失细粒度运动信息。Tetris 将帧切成 tile,并用多连块表示非矩形相关区域,通过相关性分类、受精度约束的 ILP 剪枝和打包减少检测调用。7 个固定视频数据集上,在 HOTA 损失不超过 5% 时,相比既有系统最高吞吐提升 17.4 倍,相比逐帧全图基线最高提升 68.8 倍。

Location Prior Generation via Multi-Source Urban Data Fusion for Low-Altitude Air Mobility Figure 1
2026-05-26cs.CV

Location Prior Generation via Multi-Source Urban Data Fusion for Low-Altitude Air Mobility

Xiang Xie, Xiaonan Liu

2026-05-26视觉感知学习理论数据集/基准三维安全鲁棒

面向无人机配送、空中出租车等低空城市运行,论文针对开放地图中建筑高度缺失导致机载实时感知负担过重的问题,提出 LPGF:融合 OSM、卫星影像、UAV 遥测和车辆 GPS,并以高度标签、楼层数、建筑类型默认值构成三级回退,再用质量门控决定是否启用阴影测高。在 MiTra A50 Milan 上,门控识别两类影像失效并稳定生成 27 栋建筑先验,默认高度 MAE 为 3.07 m。

ProSR: Process-Shaped Spatial Reasoning for Reliable Chain-of-Thought in VLMs Figure 1
2026-05-26cs.CV

ProSR: Process-Shaped Spatial Reasoning for Reliable Chain-of-Thought in VLMs

Jiangyang Li, Cong Wan, Changjie Wu, Songlin Dong, Lingjun Zhang, Linzhe Shi, Xu Wang, Zhiheng Ma, Hang Zhang, Mu Xu, Yihong Gong

2026-05-26视觉语言视觉感知强化学习模仿学习规划控制

面向具身智能、导航等场景中 VLM 空间推理不可靠的问题,ProSR 的关键洞察是仅优化答案会诱发“伪视觉依据”和推理尾部不稳定。论文用空间 CoT 数据诊断这些退化,并在 GRPO 中加入反事实空图像不变性惩罚与尾部漂移惩罚,把目标从答对扩展到视觉依赖和轨迹稳定。多项复杂及 OOD 空间推理基准上,方法平均较 SOTA 提升 3.7%,诊断指标也显示更少捷径依赖和更稳定的推理过程。

Cross-Stage Attention Multi-Expert Network for Radiologist-Inspired Breast Ultrasound Diagnosis Figure 1
2026-05-26cs.CV

Cross-Stage Attention Multi-Expert Network for Radiologist-Inspired Breast Ultrasound Diagnosis

Xinyang Zhai, Chong Yang, Ruizhi Zhang

2026-05-26视觉感知强化学习学习理论数据集/基准三维

针对乳腺超声中肿瘤异质性、边界模糊和类别不平衡导致的良恶性分类困难,论文提出 CSA-MoE-Net:用跨阶段注意力增强 ResNet-18 的多层特征重标定,并按放射科医生的全图、肿瘤核心、边界三种观察视角构建 MoE 专家,由门控网络自适应融合。其在 2129 张平衡数据、20 次运行上达到 96.33% 准确率和 99.50% AUC,较 ResNet-18 明显提升,但外部多中心验证文中未充分说明。

Metric--Phase Fields: Decoupling Distance and Sign for Thin-Structure Reconstruction from Unoriented Point Clouds Figure 1
2026-05-26cs.CV

Metric--Phase Fields: Decoupling Distance and Sign for Thin-Structure Reconstruction from Unoriented Point Clouds

Jiayi Kong, Xuhui Chen, Chen Zong, Fei Hou, Junhui Hou, Wenping Wang, Ying He

2026-05-26强化学习规划控制优化算法学习理论三维

针对无定向点云中薄壳、薄板和开边界难以用全局内外符号描述的问题,论文提出 Metric–Phase Fields,将无符号距离度量与平滑相位/软符号解耦,并通过可学习 β、门控度量和残差相位注入合成可提取的有符号场。实验显示其比 SDF 方法更少合并或增厚薄层,也比 UDF 方法训练与零等值面提取更稳定。

Full-4D: Generating Full-Scope 4D Scenes from a Single-View Video Figure 1
2026-05-26cs.CV

Full-4D: Generating Full-Scope 4D Scenes from a Single-View Video

Tingxi Chen, Ke Hao, Yabo Chen, Zhengxue Cheng, Rong Xie, Li Song, Haibin Huang, Chi Zhang, Xuelong Li

2026-05-26视觉感知生成模型强化学习优化算法数据集/基准

单目视频难以补全大范围动态场景,瓶颈在于时间与视角一致性及缺少真实多视角监督。Full-4D用Real-MV-4D数据集训练带几何重投影与相机条件的时空-视角融合扩散模型,先生成同步T×V视频网格,再以FMD正则优化为4DGS。实验显示其在视觉质量和几何一致性上优于现有方法,但增益可能部分来自大规模数据。

RepSAM: Bridging Foundation Models to Robotic Vision via Representation-Guided Adaptation Figure 1
2026-05-26cs.RO

RepSAM: Bridging Foundation Models to Robotic Vision via Representation-Guided Adaptation

Wenhui Chu

Department of Computer Science and Engineering, Texas A&M University, College Station, TX, USA

2026-05-26机器人视觉感知

RepSAM针对SAM等基础视觉模型在机器人场景中因透明物体、杂乱和噪声导致分割退化的问题,指出域偏移在Transformer层间并不均匀:浅层漂移大、深层可迁移。它据此用CKA预先分配LoRA秩,并结合深度融合与边缘损失。六个基准上以4.0M可训练参数达到89.0% mIoU,接近全量微调且训练成本大幅降低,PyBullet抓取成功率较LoRA RGB基线提升12.0%。

Test-Time Self-Adaptive Conditioning for Stable Audio-Driven Talking-Head Generation Figure 1
2026-05-26cs.CV

Test-Time Self-Adaptive Conditioning for Stable Audio-Driven Talking-Head Generation

Zhicheng Zhang, Lei Wang, Yu Zhang, Yongsheng Gao

2026-05-26视觉感知生成模型优化算法数据集/基准三维

这篇论文针对音频驱动说话人生成中“单张参考图一次编码”导致的身份漂移、时序不稳和局部伪影,提出测试时自适应条件 TT-SAC:先生成初稿,再将早期生成帧重新编码并聚合为新的身份条件,进行第二次生成,无需训练或梯度更新。实验在 FLOAT、Sonic、SadTalker、AniTalker 等模型和多个基准上显示,唇同步、身份保持、时序一致性与感知质量普遍提升;但效果依赖初始帧质量,过多聚合可能带来过平滑。

MAIL++: Multi-Modal Bi-directional Agent Layer for Vision-Language Models Figure 1
2026-05-26cs.CV

MAIL++: Multi-Modal Bi-directional Agent Layer for Vision-Language Models

Kaixiang Chen, Pengfei Fang, Hui Xue

2026-05-26视觉语言视觉感知三维

本文针对 CLIP 等视觉语言模型在少样本下全量微调成本高且易过拟合、现有跨模态 PEFT 耦合多停留在外部 prompt/adapter 的问题,提出在 LayerNorm 等内部计算模块后插入可重参数化的 agent layer,并用 MAIL++ 的元代理与双向桥接学习视觉—文本更新耦合。实验显示其在少样本分类和跨域检索上优于多种 PEFT 基线,同时推理阶段保持原骨干效率。

MetaphorVU: Towards Metaphorical Video Understanding Figure 1
2026-05-26cs.CV

MetaphorVU: Towards Metaphorical Video Understanding

Zhuoqun Li, Boxi Cao, Guiping Jiang, Fangrui Lv, Ruotong Pan, Jianan Wang, Xiangyu Wu, Hongyu Lin, Yaojie Lu, Yong Du, Ruyin Jia, Liyan, Tingting Gao, Han Li, Xianpei Han, Le Sun

2026-05-26视觉感知强化学习数据集/基准三维

论文关注现有视频理解评测偏重字面感知、难以衡量多模态大模型对隐喻视频深层语义的理解。作者构建含8类隐喻、860个真实视频的 MetaphorVU-Bench,并指出模型失败主要不是识别错误,而是跨域映射缺陷;据此提出基于隐喻知识图谱的推理时增强 MetaphorBoost。实验中11个MLLM均明显落后人类,最强闭源模型约低20分,MetaphorBoost带来一致提升。

Pantheon360: Taming Digital Twin Generation via 3D-Aware 360° Video Diffusion Figure 1
2026-05-26cs.CV

Pantheon360: Taming Digital Twin Generation via 3D-Aware 360° Video Diffusion

Ting-Hsuan Chen, Ying-Huan Chen, Tao Tu, Jie-Ying Lee, Cho-Ying Wu, Fangzhou Lin, Hengyuan Zhang, David Paz, Xinyu Huang, Yuliang Guo, Yu-Lun Liu, Yue Wang, Liu Ren

2026-05-26视觉感知生成模型规划控制优化算法三维

面向机器人仿真和数字孪生,透视视频生成因视场窄易在长轨迹中累积跨视角不一致。Pantheon360的关键洞察是用360°输入提供全局上下文,并从稀疏全景重建显式3D Cache,沿用户轨迹渲染几何脚手架,再由扩散模型补全真实纹理。实验显示其在真实360°视频合成中提升视觉质量和几何一致性,并支持插帧、稳像等应用。

Enhancing Single-Image Facial Demorphing using Multimodal Large Language Models Figure 1
2026-05-26cs.CV

Enhancing Single-Image Facial Demorphing using Multimodal Large Language Models

Nitish Shukla, Arun Ross

2026-05-26视觉语言视觉感知生成模型强化学习三维

针对人脸识别中 morphing 攻击只能被检测、难以还原涉事身份的问题,本文将单图无参考 demorphing 改写为语义引导的联合扩散生成:直接利用 MLLM 中间层隐藏状态作为身份与属性条件,并在 RGB 域同时重建两张原始人脸。实验显示其在地标 morph 上 0.1% FMR 下恢复准确率超过 96%,在 StyleGAN 等生成式 morph 上较既有方法取得更高识别与 6–9 dB PSNR 增益。

Does Seeing More Mean Knowing More? Mono-Anchored Advantage Normalization for Multi-Source Visual Reasoning Figure 1
2026-05-26cs.CV

Does Seeing More Mean Knowing More? Mono-Anchored Advantage Normalization for Multi-Source Visual Reasoning

Fanhu Zeng, Zhicong Luo, Zefan Wang, You Li, Chi Chen, Maosong Sun

2026-05-26强化学习优化算法数据集/基准三维

这篇论文针对多源视觉推理中“看得更多未必知道更多”的问题:不同传感器或视角可能带来互补信息,也可能引入噪声并拖累强单源信号。作者提出 MARS,将单源奖励作为动态锚点,把多源相对单源的信息增益纳入 RLVR 的优势归一化,从优化层面调节模态贡献。实验覆盖深度、红外、多视角和富文本任务,在 GRPO、DAPO 上分别带来约 3.2% 和 4.9% 提升。

Binding Visual Features Point by Point Figure 1
2026-05-26cs.CV

Binding Visual Features Point by Point

Udith Haputhanthri, Declan Campbell, Rim Assouel, Jonathan D. Cohen, Taylor W. Webb

2026-05-26视觉感知学习理论数据集/基准三维

论文针对VLM在多物体场景中常把颜色、形状等特征绑定错的问题,借鉴人类逐物体串行注意,分析“用文本输出坐标指向目标”为何有效。作者发现指向训练会诱发内部视觉搜索流程,并定位到承担搜索的注意力头;在Molmo、Qwen2.5-VL、Gemma和LLaVA实验中,微调后的指向行为可减少绑定错误,并提升计数、视觉搜索等任务的组合与分布外泛化能力。

Learning View-Dependent Splatting Kernels Figure 1
2026-05-26cs.GR

Learning View-Dependent Splatting Kernels

Huakeng Ding, Zhanpeng Liu, Fan Pei, Kun Zhou, Hongzhi Wu

State Key Lab of CAD and CG, Zhejiang University, Hangzhou Research Institute of Holographic and AI Technology, State Key Lab of CAD and CG, Zhejiang University Hangzhou Zhejiang China, State Key Lab of CAD and CG, Zhejiang University China, Hangzhou Research Institute of Holographic and AI Technology China

2026-05-26视觉感知

3DGS 的重建质量和表示效率很大程度受 splatting 核形状限制,而手工解析核难以适配场景,直接学习 3D 体核又受线积分制约。本文改为学习视角相关的 2D 投影核:用包围椭球与 3D latent 经 MLP 生成 2D latent,再解码为 Mahalanobis 距离上的径向核,并端到端优化。四个标准新视角合成基准上,该方法在 2D/3D splatting 多数指标达到最佳或次优,同时显示更好的 primitive 利用效率。

Generating 3D models from sketches of human faces using a combined approach of Convolutional Neural Networks, Procedural Modeling, and Contour Mapping Figure 1
2026-05-26cs.CV

Generating 3D models from sketches of human faces using a combined approach of Convolutional Neural Networks, Procedural Modeling, and Contour Mapping

Nancy Iskander

2026-05-26视觉感知强化学习数据集/基准三维

该工作面向从人脸线稿快速生成可编辑3D头像,动机是表情会显著改变面部轮廓,单靠空白模板匹配难以对齐。其核心做法是用自生成数据训练CNN识别草图中的FACS动作单元,将表情参数复制到Valley Girl参数化脸模,再用主动轮廓估计线稿与模型间的形变。文中展示了可生成带相似表情的3D脸并能标出未匹配轮廓,但定量增益和泛化能力文中未充分说明。

MTLLFM: Multimodal-Temporal Laughter Localization: UR-FUNNY-Temporal and SMILE-Temporal Benchmarks with an Adaptive Multimodal Fusion Model Figure 1
2026-05-26cs.CV

MTLLFM: Multimodal-Temporal Laughter Localization: UR-FUNNY-Temporal and SMILE-Temporal Benchmarks with an Adaptive Multimodal Fusion Model

Eyal Hanania, Nadav Kirsch, Daniel Arkushin, Jonathan Benvenisti, Amos Bercovich, Elie Zemmour, Sahar Froim

2026-05-26视觉语言视觉感知学习理论数据集/基准三维

论文针对现有笑声检测多停留在片段级、难以定位短暂笑声起止的问题,构建 UR-FUNNY-Temporal 与 SMILE-Temporal 两个带精确边界和模态/来源/强度元数据的基准,并提出用固定 HuBERT、MAE 特征结合时序 softmax pooling 与自适应模态门控的弱监督定位模型。实验显示其在三数据集上优于多模态基础模型,SportsPress 上达 99% F1 和 68.1% 定位精度,时序标签还使下游笑声推理 CIDEr 提升 227%。

Towards Active Real-to-Twin Inspection: A New Paradigm for Zero-Shot Anomaly Detection Figure 1
2026-05-26cs.CV

Towards Active Real-to-Twin Inspection: A New Paradigm for Zero-Shot Anomaly Detection

Jiaxuan Liu, Yunkang Cao, Yufeng Chen, Chunyang Li, Yuhuan Du, Hui Zhang

2026-05-26视觉感知生成模型强化学习模仿学习数据集/基准

本文针对工业零样本异常检测依赖固定视角2D图像、难以适应机器人主动巡检的问题,提出Real-to-Twin任务:让机器人按CAD几何先验对齐视角,并将实拍图与同姿态数字孪生渲染直接比对。AVATAR只用无缺陷真实-渲染配对学习类别无关的Sim2Real语义对齐,把CAD转化为动态正常参照;实验显示其较改造基线在多视角变化下显著更稳健,但具体增益来源仍需公开数据进一步验证。

Anatomy-Anchored Self-Supervision: Distilling Vision Foundation Models for Invariant Ultrasound Representation Figure 1
2026-05-26cs.CV

Anatomy-Anchored Self-Supervision: Distilling Vision Foundation Models for Invariant Ultrasound Representation

Chunzheng Zhu, Yijun Wang, Jianxin Lin, Feng Wang, Hongwei Wang, Lei Zhao, Shengli Li, Kenli Li

2026-05-26视觉语言视觉感知强化学习数据集/基准三维

针对超声自监督常以整帧或通用区域为学习单元、容易偏向噪声与背景而缺少临床解剖语义的问题,AnaUS用经轻量域适配和潜提示驱动的LP-SAM自动生成解剖掩码,并在解剖层面做跨视角对齐与核心区域上下文预测,使同一结构表征稳定、不同结构可分。六个肺、乳腺、甲状腺和心脏超声公开数据集上优于通用及超声专用SSL基线,同时保持部署效率。

Subspace-Guided Semantic and Topological Invariant Registration for Annotation-Free Ultrasound Plane Quality Control Figure 1
2026-05-26cs.CV

Subspace-Guided Semantic and Topological Invariant Registration for Annotation-Free Ultrasound Plane Quality Control

Chunzheng Zhu, Jianxin Lin, Feng Wang, Cheng Jiang, Guanghua Tan, Zhenyu Zhou, Shengli Li, Kenli Li

2026-05-26视觉感知规划控制数据集/基准三维

针对超声平面质控依赖逐平面标注、伪标签又易受临床采集形变影响的问题,STRIQ把无标注质控转化为与高质量锚点的子空间一致性度量:用LRA在层级潜特征中做配准对齐,用OKS将不同解剖平面拆到正交子空间以减少负迁移。在自建US4QA和公开CAMUS上,其与临床质量评分的相关性优于对比方法,并达到约5.6 ms/帧的实时推理。

Weakly Supervised Camouflaged Object Detection Based on the SAM Model and Mask Guidance Figure 1
2026-05-26cs.CV

Weakly Supervised Camouflaged Object Detection Based on the SAM Model and Mask Guidance

Xia Li, Xinran Liu, Lin Qi, Junyu Dong

2026-05-26视觉感知模仿学习学习理论三维

针对伪装目标与背景高度相似导致边界模糊、漏检,以及像素级标注成本高的问题,本文用框标注驱动 SAM 生成伪标签,并通过冗余处理过滤 SAM 在复杂背景中的多余分割;同时提出 MGNet,以级联掩码解码、上下文增强和掩码引导特征聚合逐步定位并细化边界。在三个常用 COD 数据集上,方法相较现有弱监督/全监督基线表现具有竞争力并达到或接近 SOTA。

CollectionLoRA: Collecting 50 Effects in 1 LoRA via Multi-Teacher On-Policy Distillation Figure 1
2026-05-26cs.CV

CollectionLoRA: Collecting 50 Effects in 1 LoRA via Multi-Teacher On-Policy Distillation

Fangtai Wu, Hailong Guo, Shijie Huang, Jiayi Song, Yubo Huang, Mushui Liu, Zhao Wang, Yunlong Yu, Jiaming Liu, Ruihua Huang

2026-05-26视觉感知生成模型强化学习学习理论数据集/基准

针对多效果图像编辑中需存储、路由并叠加大量效果 LoRA 与加速 LoRA,导致部署开销和概念串扰的问题,CollectionLoRA 将多个单效果 LoRA 视作教师,通过多教师 on-policy 蒸馏把效果与少步生成能力压入一个 LoRA;其关键在于双流路由保泛化、正交触发词隔离概念,以及粗到细目标缓解师生分布差。实验称可整合 50 种效果,概念保真接近或优于单独教师,并可扩展到 180 种、显著降低部署开销。

Adversarial Orthogonal Disentanglement for LVLM Hallucination Mitigation Figure 1
2026-05-26cs.CV

Adversarial Orthogonal Disentanglement for LVLM Hallucination Mitigation

Ruoxi Cheng, Haoxuan Ma, Zhengfei Hai, Yiyan Huang, Ranjie Duan, Tianle Zhang, Xu Yang, Ziyi Ye, Xingjun Ma

2026-05-26视觉语言视觉感知优化算法数据集/基准三维

针对LVLM生成内容与图像事实不一致的幻觉问题,论文认为现有外部检索/微调成本高,内部干预又难分离语义与幻觉特征。AOD将其建模为隐空间几何解耦,通过对抗正交目标学习“幻觉方向”,并在推理时用双前向对比解码抑制相关logits。三类模型、八个基准上,POPE平均提升超6%,AMBER提升约6%,且基本保持MMMU等通用能力。

Physics-Aware 3D Gaussian Editing for Driving Scene Generation Figure 1
2026-05-26cs.CV

Physics-Aware 3D Gaussian Editing for Driving Scene Generation

Feng Zhou, Jian Zhang, Yuhang Sun, He Wang, Qiong Wen, Debao Kong, Tieru Wu, Rui Ma

2026-05-26机器人视觉感知模仿学习优化算法数据集/基准

面向自动驾驶中减速带、坑洼等长尾路况难以真实采集且普通 3DGS 编辑缺少车辆动力学响应的问题,RoVES 将单图/文本驱动的道路几何插入与 4 自由度半车模型耦合,对车辆垂向位移和俯仰逐帧校正,并采用免优化的静态道路与动态车辆解耦编辑。Waymo 实验显示其道路插入约 1.84 秒、完整流程约 6.24 秒,在效率和视觉一致性上具备实用性。

Can MLLMs Reason Beyond Language? VisReason: A Comprehensive Benchmark for Vision-Centric Reasoning Figure 1
2026-05-26cs.CV

Can MLLMs Reason Beyond Language? VisReason: A Comprehensive Benchmark for Vision-Centric Reasoning

Longteng Guo, Yifan Wang, Pengkang Huo, Tailai Chen, Yuze Wu, Jing Liu, Xinxin Zhu

2026-05-26视觉语言视觉感知数据集/基准三维

针对现有视觉推理评测可被图像描述和语言先验“绕过”的问题,VisReason构建了1505道日常场景题,覆盖感知、结构和概念等10类视觉中心推理,用于检验模型是否真正依赖视觉证据。实验显示,将图像替换为文字描述在该基准上导致48.12%性能下降,且当前MLLM与人类差距显著;增加思考预算或CoT仅带来有限、趋于饱和的收益,模型变大虽有帮助但不足以弥合差距。

MARVEL: Universal Murray's Law-informed Vessel Tree Segmentation and Topology Estimation Figure 1
2026-05-26cs.CV

MARVEL: Universal Murray's Law-informed Vessel Tree Segmentation and Topology Estimation

Yi Zhou, Thiara Sana Ahmed, Jacqueline Chua, Meng Wang, Qinrong Zhang, Alejandro F. Frangi, Huazhu Fu, Jun Cheng, Leopold Schmetterer, Bingyao Tan

2026-05-26视觉感知生成模型优化算法数据集/基准三维

针对现有血管分割模型只做像素识别、易产生不符合生理规律的分叉和断裂,MARVEL将 Murray 定律作为可微正则引入任意分割骨干,并显式预测血管半径以约束局部分叉拓扑。作者在8个公开多模态血管数据集和多种骨干上验证,报告其在分割精度、拓扑一致性和生理合理性上优于基线;进一步用于眼底血流图仿真时,可更好区分高血压与正常眼,压力差分类显著提升。

Towards Reliable Fetal Ultrasound Interpretation with Multi-Agent Collaboration Figure 1
2026-05-26cs.CV

Towards Reliable Fetal Ultrasound Interpretation with Multi-Agent Collaboration

Xiaotian Hu, Mingxuan Liu, Junwei Huang, Kasidit Anmahapong, Yifei Chen, Yiming Huang, Xuguang Bai, Zihan Li, Hongjia Yang, Yingqi Hao, Hong Xu, Yu Jiang, Tian Tian, Yi Liao, Haibo Qu, Qiyuan Tian

2026-05-26视觉语言视觉感知生成模型模仿学习数据集/基准

胎儿超声解读需要把切面识别、分割、测量和报告串成可追溯流程,而单任务模型割裂、通用MLLM又易缺乏领域证据并产生幻觉。本文提出FetUSAgents,用多智能体调度专用视觉工具,并通过双路径证据仲裁和检索式证据库融合推理与结构化结果;同时构建FetUS-VQA基准。OoD实验中,其VQA准确率较最强通用/医学MLLM基线高出25%以上。

PDEInvBench: A Comprehensive Dataset and Design Space Exploration of Neural Networks for PDE Inverse Problems Figure 1
2026-05-26cs.LG

PDEInvBench: A Comprehensive Dataset and Design Space Exploration of Neural Networks for PDE Inverse Problems

Divyam Goel, Nithin Chalapathi, Sanjeev Raja, Aditi S. Krishnapriyan

Department of Computer Science, UC Berkeley, Departments of Computer Science and Chemical Engineering

2026-05-26数据集/基准

针对现有 PDE 机器学习基准多聚焦正问题、缺少从观测场反推物理参数的系统评测,本文提出 PDEInvBench,覆盖 5 类 PDE、多分辨率、ID/OOD 划分,并从优化、表示和 scaling 三轴比较神经网络。结果显示,先监督训练再用 PDE 残差做测试时微调最稳健,显式输入偏导特征通常提升精度;在固定预算下,增加初始条件多样性比扩展参数范围更有效。

Parameter-Efficient CT Reconstruction via Deep Graph Laplacian Regularization Figure 1
2026-05-26eess.IV

Parameter-Efficient CT Reconstruction via Deep Graph Laplacian Regularization

Veera Varuni Radhakrishnan, Chinthaka Dinesh, Qurat-ul-Ain Azim

2026-05-26三维

针对低剂量 CT 中深度重建模型依赖大数据和大量参数、临床部署成本高的问题,论文将二次图拉普拉斯正则嵌入 PFBS 优化框架,并用三个轻量 CNN 学习图先验与参数,以保留一定可解释性。LoDoPaB-CT 上报告仅用 91,848 参数和 1000 样本达到 30.70 dB PSNR,较 FBP 提升 6.33 dB,但仍落后最强方法约 13 dB,说明其价值主要在资源受限场景的效率—质量折中。

ERNIE-Image Technical Report Figure 1
2026-05-26cs.CV

ERNIE-Image Technical Report

Jiaxiang Liu, Zhida Feng, Pengyu Zou, Zhenyu Qian, Tianrui Zhu, Jun Xia, Yuehu Dong, Yanzheng Lin, Honglin Xiong, Anqi Chen, Yunpeng Ding, Jinghui Duan, Lin Gao, Chao Han, Tiechao He, Jiakang Hu, Ranjun Hua, Xueming Jiang, Qingli Kong, Yuting Lei, Tianyu Li, Yunlin Liu, Changling Liu, Yaxin Liu, Yi Liu, Xuguang Liu, Xiaolong Ma, Yan Pan, Yiran Ren, Nan Sheng, Yu Sun, Siyang Sun, Yixiang Tu, Yang Wan, Huanai Wang, Siqi Wang, Yang Wu, Youzhi Yang, Xiaowen Yang, Jianwen Yang, Yehua Yang, Quanwen Zhang, Xinmin Zhang, Haoxin Zhang, Xiang Zhang, Jun Zhang, Qian Zhang, Qiao Zhao, Qi Zhou

2026-05-26视觉语言视觉感知强化学习数据集/基准三维

针对开源文生图模型在复杂指令、中文/长文本渲染和审美质量上落后闭源系统的问题,ERNIE-Image采用8B单流DiT,并把重点放在数据与监督:预训练用细粒度分类、富字幕和审美评分做分层采样,后训练用多样化SFT、稳定DPO、Prompt Enhancer及8步Turbo蒸馏。实验显示其在开源模型中领先,并在指令遵循、文字生成和审美上接近顶级商业模型,但具体增益可能主要来自data。

Depth Peeling for High-Fidelity Gaussian-Enhanced Surfel Rendering Figure 1
2026-05-26cs.GR

Depth Peeling for High-Fidelity Gaussian-Enhanced Surfel Rendering

Keyang Ye, Hongzhi Wu, Kun Zhou

State Key Lab of CAD&CG, Zhejiang University, Hangzhou Research Institute of Holographic and AI Technology

2026-05-26三维

针对 GES 在物体边界仍有混叠、硬深度测试导致高斯贡献截断,以及不透明 surfel 难以与高斯端到端联合优化的问题,论文提出 DP-GES:为 2D surfel 引入半透明边界,并用 Depth Peeling 获取逐像素层次顺序,再以透射率调制免排序高斯 splatting。实验称仅剥离约三层即可提升重建质量、减少 popping/aliasing,在 Mip-NeRF360 上 RTX 4090 渲染超过 470fps,并优于或持平多种 3DGS 变体。

Toward Native Multimodal Modeling: A Roadmap Figure 1
2026-05-26cs.CV

Toward Native Multimodal Modeling: A Roadmap

Siyu An, Junru Lu, Junnan Dong, Qiufeng Wang, Yinghui Li, Weizhi Fei, Zichao Yu, Zheng Yuan, Biao Liu, Haopeng Wang, Renzhao Liang, Yixuan Yang, Yunhang Shen, Bo Ke, Keyu Chen, Linhao Luo, Difan Zou, Xiao Huang, Di Yin, Ruizhi Qiao, Xing Sun

2026-05-26视觉语言视觉感知生成模型强化学习数据集/基准

本文针对多模态模型从后期拼接走向“原生”融合时概念混乱、架构边界不清的问题,提出以融合深度和输入输出对偶为核心的路线图:区分 mid/early-fusion,并将模型归为 Multi-to-Text、Multi-to-Target、Multi-to-Multi。主要结果是梳理了代表模型、数据训练、部署与评测全流程;非新模型实证论文,性能增益来源文中未充分说明,可能主要来自 scaling / data。

Dual-Pathway Geometry-Aware MLLM for Spatial Intelligence Figure 1
2026-05-26cs.CV

Dual-Pathway Geometry-Aware MLLM for Spatial Intelligence

Yufei Zheng, Xuhan Zhu, Zide Liu, Chunpeng Zhou, Chenfeng Wang, Yongchao Xu, Yunnan Wang, Jiawei Liu, Pengfei Yu, Wei Zhai, Yang Cao, Zheng-Jun Zha

2026-05-26视觉语言视觉感知强化学习模仿学习学习理论

针对现有 MLLM 在空间理解中往往只利用深度或 3D 结构、且推理依赖外部深度图/点云的问题,GAMSI 将度量尺度与三维结构拆成双路径可学习查询,并用训练期视觉专家监督对齐,使模型仅凭 RGB 输入调用几何先验。作者还构建 15.3 万样本 MTS 数据集,经两阶段训练后在七个空间智能基准上达到 SOTA;但具体增益中架构与数据扩充的相对贡献仍需进一步拆解。

Teaching Video Generators to Remember: Eliciting Dynamic Memory for Out-of-Sight State Evolution Figure 1
2026-05-26cs.CV

Teaching Video Generators to Remember: Eliciting Dynamic Memory for Out-of-Sight State Evolution

Tianshuo Xu, Yichen Xie, Depu Meng, Chensheng Peng, Quentin Herau, Bo Jiang, Yihan Hu, Wei Zhan

2026-05-26视觉语言视觉感知生成模型强化学习数据集/基准

论文针对视频世界模型在遮挡、关灯或视角移开后常把隐状态冻结的问题,提出 ReMind:把视频组织成带可靠锚点、退化区间和时间缺口的帧图,并通过节点丢弃、噪声记忆、前沿续写等训练让原生 KV cache 学会检索旧状态;PM-RoPE 则以单注意力代价加入相机相位地址。实验显示其在 STEVO-Bench 和恢复任务上总体最优,同时 VBench 表明常规图生视频能力未明显遗忘。

DIVA: Harnessing the Representation Divergence in Unified Multimodal Models for Mutual Reinforcement Figure 1
2026-05-26cs.CV

DIVA: Harnessing the Representation Divergence in Unified Multimodal Models for Mutual Reinforcement

Renjie Lu, Xulong Zhang, Xiaoyang Qu, Shangfei Wang, Jianzong Wang

2026-05-26视觉语言视觉感知生成模型三维

这篇论文针对统一多模态模型中理解与生成目标相互干扰的问题,指出二者的表征偏好虽不同但共享同一样本语义锚点,可转化为互补信号。DIVA通过后训练将视觉表征分解为共享与任务特有成分,并用互信息约束促进共享信息对齐、隔离特有信息。实验报告在视觉理解和生成上分别提升7.82%与8.46%,但更大规模模型上的可扩展性仍未充分说明。

Perceive-then-Plan: Layout-as-Policy for Monocular 3D Scene Layout Estimation Figure 1
2026-05-26cs.CV

Perceive-then-Plan: Layout-as-Policy for Monocular 3D Scene Layout Estimation

Junwei Zhou, Yu-Wing Tai

2026-05-26机器人视觉语言视觉感知强化学习规划控制

单目图像恢复室内 3D 布局常因深度歧义、碰撞/支撑关系和全局一致性约束而让一次性回归失效。本文将任务拆成“感知后规划”:几何增强 Perceiver 先给出观测对齐的初始布局,LaP Planner 再把平移、旋转、缩放等离散修正视为策略动作,并用监督轨迹加 DPO 学习迭代纠错。实验显示其相较强 VLM 基线提升 3D grounding 精度与物理合理性,并可支持场景编辑和具身操作;但仍依赖 2D 检测,漏检误差会传播。

Stabilizing Streaming Video Geometry via Dynamic Feature Normalization Figure 1
2026-05-26cs.CV

Stabilizing Streaming Video Geometry via Dynamic Feature Normalization

Xiaoyang Lyu, Muxin Liu, Xiaoshan Wu, Ruicheng Wang, Yi-Hua Huang, Yang-Tian Sun, Shaoshuai Shi, Xiaojuan Qi

2026-05-26视觉感知强化学习数据集/基准三维安全鲁棒

面向自动驾驶、具身智能等连续 RGB 流中的三维几何估计,论文指出预训练单目几何模型的视频抖动主要来自深度尺度与偏移随帧漂移,而根因是潜特征均值、方差波动。作者提出轻量因果循环模块 DyFN,仅微调约 2% 额外参数来动态归一化特征统计、冻结主干。四个基准上其减少分层断裂和位置抖动,时间稳定性较既有流式方法最高提升 14%,且基本保持单帧精度。

Recursive Class Connectivity Classification (R3C) Applied to Binary Image Segmentation for Improved Infant Fingerprint Enhancement Figure 1
2026-05-26cs.CV

Recursive Class Connectivity Classification (R3C) Applied to Binary Image Segmentation for Improved Infant Fingerprint Enhancement

Joao Leonardo Harres Dall Agnol, Luiz Fernando Puttow Southier, Jefferson Tales 0liva, Marcelo Teixeira, Rodrigo Mineto, Marcelo Filipa, Dalcimar Casanova, Erick Oliveira Rodrigues

2026-05-26视觉感知强化学习模仿学习数据集/基准

婴幼儿指纹因脊线更细、皮肤易变形且采集噪声高,即使用高分辨率扫描也难以获得稳定二值分割,导致识别率偏低。论文提出无需训练数据、也不改动原增强器的 R3C,通过把中间分割结果递归回馈并与原图结合来延展断裂脊线。三组数据、四类增强器实验显示,TAR 在儿童上最高提升约 4%,新生儿上可超过 40%,但绝对识别率仍有限且可能传播伪脊线。

When Interpretability Becomes a Liability: Adversarial Attacks on CBM Concept Layers Figure 1
2026-05-26cs.LG

When Interpretability Becomes a Liability: Adversarial Attacks on CBM Concept Layers

Aditya Sridhar

2026-05-26视觉感知

论文指出,CBM把决策显式分解到人类概念层虽提升可解释性,却也暴露了可被语义操控的新攻击面。作者形式化概念空间攻击与鲁棒性指标,并提出稳定正则防御 SPECTRA。CUB-200-2011 实验显示标准 CBM 攻击性很高,而合适正则可将攻击性从 3.8054 降至 0.0005、所需扰动范数大幅提高,精度仅下降约 2.2%。

A Principled Self-Referenced Early Stopping Approach for Deep Image Prior Figure 1
2026-05-26cs.CV

A Principled Self-Referenced Early Stopping Approach for Deep Image Prior

Chaoyan Huang, Cheng-Han Huang, Ismail R. Alkhouri, Rongrong Wang

Department of Computational Mathematics, Science, & Engineering, Michigan State University, Department of Electrical & Computer Engineering, University of Michigan, X Computational Physics Division, Los Alamos National Laboratory, Michigan Institute for Computational Discovery & Engineering, University of Michigan, Mathematical Sciences, Michigan State University

2026-05-26视觉感知强化学习

本文针对 Deep Image Prior 在单幅退化图像重建中容易继续拟合噪声、而现有方差或 SURE 早停信号不稳的问题,将早停重新表述为带参考的验证问题;核心洞察是独立噪声副本可给出近似最优停止点,并据此构造伪自参考,提出面向 RGB、灰度医学图像和不同噪声类型的 CSR-ES、MR-ES、ACR-ES。实验覆盖自然图像恢复与 CT/MRI 等任务,显示其比现有早停更接近 oracle 且无需准确噪声水平。

Geometry-Aware Image Flow Matching Figure 1
2026-05-26cs.CV

Geometry-Aware Image Flow Matching

Junho Lee, Kwanseok Kim, Joonseok Lee

2026-05-26视觉感知生成模型

论文针对图像生成中流匹配等方法默认欧氏空间、难以利用自然图像内在几何的问题,提出图像语义主要编码在方向而非范数中,RGB 与潜空间样本可近似投影到平均半径超球面。基于此设计用角距离做耦合的 SOT-CFM 和沿球面测地线建模的 SFM,在 CIFAR-10 与 ImageNet-256 上相较 I-CFM、OT-CFM 等欧氏基线取得更好生成质量。

Neuromorphic LiDAR-based Bird's Eye View Object Detection using Energy-efficient Spiking Neural Networks Figure 1
2026-05-26cs.CV

Neuromorphic LiDAR-based Bird's Eye View Object Detection using Energy-efficient Spiking Neural Networks

Sambit Mohapatra, Senthil Yogamani, Heinrich Gotzig, Patrick Mader

2026-05-26视觉感知

面向自动驾驶中稀疏 LiDAR BEV 感知的算力与能耗瓶颈,本文将脉冲神经网络用于端到端鸟瞰目标检测,设计带 LIF 动态的编码器-解码器、替代梯度训练及面向关键点和框回归的脉冲域损失,并比较多种输入编码。KITTI 上膜电位输出版本在 IoU=0.5 达到 92.05/87.04/86.51 AP,完全二值脉冲版本也可部署;能耗分析显示相对等价 CNN 突触操作能耗降低 3.33×,但实验主要基于静态帧重复模拟时序。

No Figure
2026-05-26cs.CV

DeltaCam: Differential Intrinsic Camera Modeling for Video Generation

Debabrata Mandal, Zhihan Peng, Yujie Wang, Praneeth Chakravarthula

2026-05-26视觉感知

这篇论文针对现有视频生成主要控制相机外参、难以稳定表达焦距、光圈、曝光、色温和畸变等内参变化的问题,提出 DeltaCam:用相对变化而非绝对状态来参数化神经相机适配器,并将场景内容、外参和内参解耦。文中展示其可生成更时间一致的景深、变焦、Dolly zoom 等效果,并支持视频到视频摄影风格迁移和基于 EXIF 的相机风格匹配。

Semantics-Guided Multimodal Masked Autoencoder Pretraining for 3D BEV Object Detection Figure 1
2026-05-26cs.CV

Semantics-Guided Multimodal Masked Autoencoder Pretraining for 3D BEV Object Detection

Prabuddhi Wariyapperuma, Rajitha de Silva, Marc Hanheide, Thomas Bohné, Leonardo Guevara

2026-05-26视觉语言视觉感知三维

针对相机-LiDAR 多模态 MAE 预训练中随机遮蔽把所有区域等同处理、且仅靠重建学习的问题,本文在 UniM2AE/BEVFusion 框架中引入语义引导的 LiDAR 体素遮蔽和解码端逐点语义监督,只在预训练阶段使用语义信息。nuScenes mini 验证集上,语义遮蔽较基线提升 +1.49% mAP、+1.66% NDS,逐点语义监督提升 +1.39% mAP、+3.22% NDS,但实验规模较小。

No Figure
2026-05-26cs.CV

Guess the Unified Model: How Much Can We Recover from Generated Images?

Jasin Cekinmez, Ryo Mitsuhashi, Addison J. Wu, Yida Yin

Princeton University

2026-05-26视觉感知

针对统一多模态模型生成图像已广泛传播但来源难追踪的问题,本文把模型归因建模为多类视觉分类,并系统考察跨扰动、跨语义域和跨提示语言的可分性。核心洞察是统一模型会留下稳定的视觉“指纹”,且不主要由语义内容驱动;ConvNeXT 分类器在每模型 500 张图像时达 59.8%,约 25K 张时接近 99.9%,多数模型的提示语言归因则接近随机水平。

Multi-view Consistent 3D Gaussian Head Avatars 'without' Multi-view Generation Figure 1
2026-05-26cs.CV

Multi-view Consistent 3D Gaussian Head Avatars 'without' Multi-view Generation

Aviral Chharia, Fernando De la Torre

Carnegie Mellon University

2026-05-26三维

针对3D高斯头部头像依赖多视图采集、3D监督或中间视图扩散而难以规模化的问题,论文提出MVCHead:用单次前向的状态空间模型直接回归3D高斯,并通过HiSS/HiBiSS层级双向扫描与SE(3)多视图判别器在无真实多视图对的情况下约束一致性。实验称其在感知质量、纹理和几何一致性上优于既有方法,并发布FaceGS-10K;但模型仅覆盖前/侧视,尚非完整360°头像。

Baton: Explicit Semantic Blueprints for Joint Video-Audio Generation Figure 1
2026-05-26cs.CV

Baton: Explicit Semantic Blueprints for Joint Video-Audio Generation

Shuyuan Tu, Qi Tian, Zihan Yang, Yue Wu, Xintong Han, Weijie Kong, Jiangfeng Xiong, Jian-Wei Zhang, Zhao Zhong, Liefeng Bo, Zuxuan Wu, Yu-Gang Jiang

Fudan University 2 Tencent Hunyuan

2026-05-26视觉感知

现有开源音视频联合生成多依赖粗粒度文本嵌入,面对多阶段动作和人机/物体交互时缺少跨模态长程语义计划,易导致画面与声音去噪轨迹失配。Baton 将语义推理与扩散合成解耦,用 VA-Planner 生成对齐的视频/音频 planned tokens 作为关键帧蓝图,并用 RS-RoPE 对齐蓝图与潜变量的时空坐标。实验显示其在复杂提示下较现有 SOTA 提升同步性与稳定性,但具体增益规模需看完整基准细节。

SpongeBob: Sync-Aware Harmonious Audio-Visual Generative Editing Figure 1
2026-05-26cs.CV

SpongeBob: Sync-Aware Harmonious Audio-Visual Generative Editing

Sen Liang, Cong Wang, Fengbin Guan, Zhentao Yu, Yiting Lu, Yuanzhi Wang, Yuan Zhou, Xin Li, Zhibo Chen

2026-05-26生成模型

针对现有音视频编辑多采用先改画面再补音频的解耦流程,易造成口型/事件与声音不同步、且新音频破坏原有语境,SpongeBob 将主体级音视频编辑重构为自监督补全任务,并用双流 DiT、双向跨模态注意、时空约束与上下文注意在同一去噪过程中联合生成。作者还构建数据管线与 SpongeBob-Bench,报告 Sync-C 提升 30%、Ctx-F1 提升 12.5%。

Injecting Image Guidance into Text-Conditioned Diffusion Models at Inference Figure 1
2026-05-26cs.CV

Injecting Image Guidance into Text-Conditioned Diffusion Models at Inference

Agata Żywot, Iason Skylitsis, Thijmen Nijdam, Zoe Tzifa-Kratira, Derck Prinzhorn, Konrad Szewczyk, Aritra Bhowmik

University of Amsterdam, Netherlands

2026-05-26视觉感知生成模型

针对 Stable Diffusion 等文本生图模型难以在不重训时利用参考图的问题,论文提出 VCF:用轻量对齐器将 CLIP 图像 token 映射到文本嵌入流形,再通过文本-图像融合和可选的推理时 Prompt-Noise Optimization 注入风格、构图与色彩线索。实验显示其相较基线提升参考图保真度,并能保持一定文本一致性,但 CLIP 文本对齐与 LPIPS 视觉对应之间存在权衡。

Discrepancy Minimization Improves Cross-Hospital Robustness in Digital Pathology Figure 1
2026-05-26cs.CV

Discrepancy Minimization Improves Cross-Hospital Robustness in Digital Pathology

Ben Vardi, Dana Schonberger, Yuval Friedmann, Zohar Yakhini, Iris Barshack, Alexander Loebel, Ariel Shamir

2026-05-26安全鲁棒

论文关注数字病理基础模型在跨医院部署时因染色、制片和扫描差异导致性能下降的问题。作者提出在patch级用LMMD对齐类别相关分布,并结合LoRA轻量微调PFM,既支持有未标注目标医院数据的域适应,也支持无目标数据的域泛化;实验显示在两类任务、两种PFM上,patch级增益可传导到slide级,并优于原始PFM和若干既有方法。

Methodology for Creating a Clinically Verified Dermoscopic Image Dataset Figure 1
2026-05-26eess.IV

Methodology for Creating a Clinically Verified Dermoscopic Image Dataset

Kozachok Elena Sergeevna

2026-05-26视觉感知数据集/基准

针对皮肤镜AI在本地门诊和移动采集场景中易受采集流程、元数据缺失与标签可靠性影响的问题,论文提出将移动皮肤镜SOP、16字段ISIC兼容元数据模型和多阶段专家/病理验证统一的数据集构建方法。按此流程形成443名患者的1026张图像,覆盖9类病变,39例恶性样本均经病理确认,可用于外部评测、域偏移与可解释性研究。

No Figure
2026-05-26cs.CV

K-U-KAN: Koopman-Enhanced U-KAN for 3D Dental Reconstruction from a Single Panoramic X-ray Radiograph

Bikram Keshari Parida, Abhijit Sen, Wonsang You

2026-05-26三维

单张全景牙片到 CBCT 的三维重建因深度塌缩、牙弓几何畸变和临床成本限制而困难。K-U-KAN 将 KAN 的深度可观测量、Koopman 潜空间线性演化、焦槽射线几何与轻量 3D U-KAN 结合,以网格卷积替代昂贵隐式渲染。文中报告其在 PSNR/SSIM 上接近 Transformer/INR 基线,LPIPS 更低,训练时间约减半。

SpikeReg: Energy-Efficient 3D Deformable Medical Image Registration with Spiking Neural Networks Figure 1
2026-05-26cs.CV

SpikeReg: Energy-Efficient 3D Deformable Medical Image Registration with Spiking Neural Networks

Ali Mikaeili Barzili, Behzad Moshiri, Hamid Azadegan, Mohammad-Reza A. Dehaqani

University of Tehran, School of Electrical and Computer Engineering, Tehran, 1439957131, Iran, Max Planck Institute for Brain Research, Frankfurt am Main, 60438, Germany, School of Computer Engineering, Iran University of Science and Technology (IUST), Tehran, 16846-13114, Iran, Department of Electrical and Computer Engineering, University of Waterloo, Waterloo, Ontario, N2L 3G1, Canada

2026-05-26视觉感知三维

三维医学图像形变配准计算量高,现有 CNN/Transformer 方法难以体现稀疏低功耗优势。SpikeReg 将 ANN 配准教师迁移为脉冲 U-Net,通过逐层权重转换、阈值校准和代理梯度微调,在隐藏层利用事件驱动稀疏计算预测 dense 位移场。OASIS Learn2Reg 上 Dice 0.7474,与 ANN 教师无显著差异,同时平均放电率 12.8%,按 SynOps/MAC 代理估计能耗降低 55.5×;但蒸馏和 label-Dice 教师迁移均表现不佳,且能耗仍非硬件实测。

PQDT: Pseudo-Query Dual Transformer for Robust Point Cloud Restoration Figure 1
2026-05-26cs.CV

PQDT: Pseudo-Query Dual Transformer for Robust Point Cloud Restoration

Haoqing Wu, Alexa Nawotki, Jochen Garcke

University of Bonn, Germany

2026-05-26三维安全鲁棒

面向真实传感器点云常见的缺失、噪声、离群点和密度不均,PQDT试图用单一模型统一完成补全、去噪与形变恢复。其核心是将Transformer解码拆成观测引导与先验引导两阶段,用几何嵌入和动态伪查询在输入证据与形状先验间自适应平衡,减少全局瓶颈造成的细节丢失。实验称其在既有与新构建退化基准上超过多种SOTA,尤其对复合退化更稳健。

Inference-Time Alignment of Diffusion Models via Trust-Region Iterative Twisted Sequential Monte Carlo Figure 1
2026-05-26cs.LG

Inference-Time Alignment of Diffusion Models via Trust-Region Iterative Twisted Sequential Monte Carlo

Weixin Wang, Yu Yang, Wei Deng, Pan Xu

∗Duke University, †Duke University, ¶Duke University

2026-05-26生成模型强化学习

论文针对扩散模型推理时对齐中,SMC 方法依赖基采样器、奖励反馈滞后而导致粒子退化和高方差的问题,提出 TRI-TSMC:用信任域的路径空间 KL 约束更新学习前瞻 twisting 函数,并以加权极大似然投影回参数化族。理论上解释其零方差最优形式并证明可降低残余权重方差;实验在离散扩散文本生成和 Stable Diffusion 图像生成中,在匹配预算下提升 PPL/CoLA 与 ImageReward,但存在一定多样性下降。

Trust-Aware Joint Feature-Prediction Discrepancy for Robust Domain Adaptation Figure 1
2026-05-26cs.CV

Trust-Aware Joint Feature-Prediction Discrepancy for Robust Domain Adaptation

Xi Ding, Lei Wang, Syuan-Hao Li, Yongsheng Gao

2026-05-26安全鲁棒

针对域适应中仅对齐特征或预测、且默认目标样本同等可靠的问题,论文提出信任感知的联合特征-预测差异 JFPD,用预测熵估计不确定性信任、用类别原型相似度估计语义对齐信任,从而降低噪声或歧义样本的对齐权重。该目标被用于无监督域适应训练,在数字与物体识别基准上优于常见方法,且差异估计与目标域误差相关。

Uncertainty-DTW for Sequences and Visual Tokens Figure 1
2026-05-26cs.CV

Uncertainty-DTW for Sequences and Visual Tokens

Lei Wang, Syuan-Hao Li, Yongsheng Gao, Piotr Koniusz

2026-05-26安全鲁棒

针对传统 DTW/soft-DTW 依赖确定性距离、易被异质噪声特征主导的问题,论文将成对匹配建模为带异方差不确定性的高斯似然,用精度加权匹配和对数方差正则形成 uDTW,并扩展到 ViT 视觉 token;低不确定性区域呈“反注意力”地支配对齐。实验覆盖时间序列、Fréchet 均值、少样本动作与图像分类,报告相对 SOTA 的稳定提升,且不确定性与语义重要性相关。

WorldCraft: From Camera Navigation to Object Manipulation in Interactive Video World Models Figure 1
2026-05-26cs.CV

WorldCraft: From Camera Navigation to Object Manipulation in Interactive Video World Models

Bohai Gu, Taiyi Wu, Yueyang Yuan, Jian Liu, Xiaocheng Lu, Dazhao Du, Jie Zhang, Jinxiang Lai, Shuai Yang, Xiaotong Zhao, Alan Zhao, Song Guo

The Hong Kong University of Science and Technology, AI Technology Center, Tencent Video, Tencent, Wuhan University, Peking University, Work done as an intern at Tencent AI Technology Center, Tencent Video. Corresponding author.

2026-05-26机器人视觉感知强化学习

现有视频世界模型多只能控制相机视角,难以表达机器人等场景中对具体物体的操作。WorldCraft 将点击选物与手绘轨迹引入自回归视频世界模型,用归一化世界轨迹解耦相机运动与物体运动,并通过 SP-LoRA 与 TASP 在保留相机控制的同时维持离屏物体状态。实验显示其能较准确跟随物体轨迹、保持相机生成质量,并在长时 rollout 中让离屏移动物体回到更新后位置。

VEOcc: Voxel-Centric Online Semantic Occupancy Prediction For Embodied Scene Understanding Figure 1
2026-05-26cs.CV

VEOcc: Voxel-Centric Online Semantic Occupancy Prediction For Embodied Scene Understanding

Ruoyu Wang, Yong Liu, Sheng Tao, Yuhang Lin, Yukai Ma

Institute of Cyber-Systems and Control, Zhejiang University, Hangzhou, China. † These authors contributed equally to this work. ∗ Yong Liu is the corresponding author.

2026-05-26视觉感知

VEOcc针对具身在线占据建图中高斯表示边界不准、弱纹理覆盖不足且依赖预设场景尺度的问题,改用体素中心的递归“感知—同化”框架,实现无需初始尺度估计的开放式增量扩展;其时空在线更新策略结合跨时序logit聚合、可靠性感知置信调制和置信驱动状态更新来抑制多视角噪声。实验显示其在Occ-ScanNet与EmbodiedOcc-ScanNet的局部和具身设置均超过SplatSSC、RoboOcc等基线,并在自采视频零样本测试中表现出一定真实场景泛化能力。

TinyFormer: Preserving Tiny Objects in YOLO-DETRHybridReal-time Detectors Figure 1
2026-05-26cs.CV

TinyFormer: Preserving Tiny Objects in YOLO-DETRHybridReal-time Detectors

Jun-Wei Hsieh, Meng-Yu Kao, Ghufron Wahyu Kurniawan, Kuan-Chuan Peng

College of Artificial Intelligence, National Yang Ming Chiao Tung University, Taiwan, Mitsubishi Electric Research Laboratories

2026-05-26视觉感知

论文针对实时检测器在自动驾驶、监控等场景中易漏检微小目标的问题,指出YOLO与DETR共同瓶颈是早期大步幅下采样导致空间细节不可逆丢失。TinyFormer将ViT语义、DETR式无NMS预测与YOLO颈部结合,并用PBM高分辨率捷径和SSA注入浅层空间线索。COCO上TinyFormer-X-PBM达58.5% AP,小目标AP提升1.6;Objects365预训练后达60.2% AP。

Unbiased Diffusion Variational Inversion via Principled Posterior Matching Figure 1
2026-05-26cs.CV

Unbiased Diffusion Variational Inversion via Principled Posterior Matching

Weimin Bai, Yuxuan Gu, Yifei Wang, Weijian Luo, He Sun

2026-05-26生成模型

这篇论文针对扩散先验求解逆问题中 KL 近似带来的后验偏差、模态塌缩和不可靠不确定性,提出 PPM:用扩散过程上的 Fisher divergence 积分等价优化精确 KL,并推导可训练梯度,兼容粒子式变分推断与摊销重建网络。实验覆盖修复、超分、去模糊、荧光显微和黑洞成像,报告相比 DPS、RED-Diff、RLSD、DAVI 获得更高重建质量、更完整多模态后验和更校准的不确定性。

AstroRAG -- A Pagerank-Based Retrieval-Augmented Generation Pipeline for Question Answering in Astronomy Figure 1
2026-05-26cs.CV

AstroRAG -- A Pagerank-Based Retrieval-Augmented Generation Pipeline for Question Answering in Astronomy

Zhifeng Wang, Jason Jingshi Li, Kaihao Zhang, Ramesh Sankaranarayana

*This work was supported by Learning Machines Pty Ltd during the internship* 1 Zhifeng Wang and Ramesh Sankaranarayana are with, Australian National University, Canberra, ACT, Australia

2026-05-26视觉感知

针对天文学问答中通用 LLM 依赖参数知识易出错、朴素 RAG 又会引入无关上下文的问题,AstroRAG 将文档按 token 切块并为每个实例建立临时 Elasticsearch 索引,先用 MMR 取多样候选,再在相似图上用 PageRank 选择紧凑且相互支持的证据,强调本地化、可追溯与防泄漏。文中在 AstroQA 上报告 RAG 版 Mistral-7B 达到 79.49% 准确率和 F1,接近非 RAG 基线的两倍。

DA-UCT: Self-Supervised Domain-Adaptive Ultrasound Computed Tomography for Rapid Musculoskeletal Sound Speed Reconstruction Figure 1
2026-05-26cs.CV

DA-UCT: Self-Supervised Domain-Adaptive Ultrasound Computed Tomography for Rapid Musculoskeletal Sound Speed Reconstruction

Tianyu Liu, Heyu Ma, Aiduo Wang, Peiwen Li, Boyi Li, Ying Li, Dan Li, Chengcheng Liu, Dean Ta

but the supervised training requires large-scale labeled, research were performed using the CFFF platform of Fudan University., the College of Biomedical Engineering, Fudan University, Shanghai, Dan Li is with the College of Future Information Technology, Fudan, Chengcheng Liu and Dean Ta are with the College of Biomedical, Engineering, Fudan University, Shanghai 200433, China, and also with, State Key Laboratory of Integrated Chips and Systems, Fudan, University, without the need for in-vivo ground-truth SOS labels

2026-05-26三维

针对肌骨UCT中FWI计算耗时、易陷局部最优且体内SOS标注难获取的问题,论文提出SDA-UCT:先用仿真数据监督预训练注意力网络AttUCT,再以波动方程约束在体数据自监督域适配,并用LoRA提升少参数微调能力。仿真前臂重建达PSNR 29.23 dB、SSIM 0.928;体内前臂结构与MRI较一致,LoRA仅调3%参数接近全量微调,单帧约5 ms可支持三维实时显示。

No Figure
2026-05-26cs.CV

D3S2: Diffusion-Guided Dataset Distillation for Semantic Segmentation

Wenjie Zheng, Haoji Hu, Jiali Lu, Xingze Zou, Jing Wang

Zhejiang University, China

2026-05-26视觉感知生成模型数据集/基准

本文针对数据集蒸馏长期偏重分类、难以处理语义分割中的长尾类别、像素级对齐和高分辨率优化成本问题,提出 D3S2:先用类别均衡贪心策略选择代表性 mask,再借助布局到图像扩散模型生成对齐图像,并在采样中加入分割一致性与按类特征匹配。实验显示在 1% 压缩率下,Mask2Former 在 ADE20K/COCO-Stuff 达到 24.99%/35.49% mIoU,较随机选择提升 9.34/5.70 点。

Stop Denoising Your Blurs Figure 1
2026-05-26cs.CV

Stop Denoising Your Blurs

Sasidhar Parvathireddy, Vamsidhar Saraswathula, Rama Krishna Gorthi

2026-05-26视觉感知

本文针对扩散模型用加性噪声刻画去模糊、与真实卷积退化不匹配的问题,提出 ConvDiff:在频域将模糊核分解为连续的卷积退化轨迹,并用网络学习从任意中间模糊状态恢复清晰图像。实验显示其在锐度和结构上优于常规扩散与线性插值方案,但尚未达到最强端到端方法;当前主要验证于空间不变高斯模糊,泛化到运动或空间变化模糊仍需进一步说明。

No Figure
2026-05-26cs.CV

Learning from Semantic Dictionaries: Discriminative Codebook Contrastive Learning for Unified Visual Representation and Generation

Imanol G. Estepa, Jesús M Rodríguez-de-Vera, Bhalaji Nagarajan, Petia Radeva

Barcelona Supercomputing Center (BSC), Barcelona, Spain

2026-05-26视觉感知

本文针对判别式视觉表征擅长语义理解、生成式表征擅长细节合成但二者语义空间错位的问题,提出 LEASE:用成对的生成/判别离散码本作为“语义字典”,在预计算 token 空间中同时做遮蔽 token 重建和基于判别质心的码本对比学习,从而无需数据增强、教师模型或在线 tokenizer。ImageNet-1K 等实验显示,其在线性探测、无条件生成、少样本、迁移与鲁棒性上超过 MAGE、Sorcen 等统一 SSL 方法,并带来训练加速。

No Figure
2026-05-26cs.CV

ClueAegis: Heuristic-to-Reasoning Cognitive-skill Learning for Unified Evidence-based Synthetic Image Detection

Huangsen Cao, Hongkang Chu, Yuxi Li, Ying Zhang, Chen Li, Jing Lyu, Yongwei Wang, Yu Zhao, Fei Wu

Zhejiang University, University of the Chinese Academy of Sciences

2026-05-26视觉感知

针对生成图像越来越逼真、传统端到端检测难以区分异质取证线索的问题,论文将合成图像检测重构为“感知线索→技能选择→证据推理”的认知流程,提出含12类取证技能标注的ClueAegis-Bench及两阶段ClueAegis代理框架。实验称其在多基准上达到SOTA,并提升跨域泛化、鲁棒性与推理可解释性。

NeurIPS: Neuro-anatomical Inductive Priors for Sphere-based Brain Decoding Figure 1
2026-05-26cs.AI

NeurIPS: Neuro-anatomical Inductive Priors for Sphere-based Brain Decoding

Sijin Yu, Zijiao Chen, Zhenyu Yang, Zihao Tan, Jiakun Xu, Zhongliang Liu, Shengxian Chen, Wenxuan Wu, Xiangmin Xu, Xin Zhang

2026-05-26视觉感知

这篇论文针对 fMRI 图像重建中 1D 编码器高效但丢失皮层几何、表面模型保真却训练低效的问题,提出将个体脑解剖差异视为归纳先验而非噪声。方法用 SRST 只在视觉 ROI 上做球面 token 化,并用 SG-MoE 根据皮层厚度、曲率和脑沟深度路由专家。NSD 实验显示其在表面解码器中达到 SOTA,性能接近强 1D 基线,且约 10 个 epoch 收敛、20% 新被试数据即可快速适配;消融表明增益主要来自解剖特征而非被试 ID 记忆。

Universal Boosts, Specific Suppressors: Sparse Autoencoder Steering of Medical Vision-Language Models Figure 1
2026-05-26cs.CV

Universal Boosts, Specific Suppressors: Sparse Autoencoder Steering of Medical Vision-Language Models

Farhad Nooralahzadeh, Benjamin Gundersen, Nicolas Deperrois, Hidetoshi Matsuom, Mizuho Nishio, Thomas Frauenfelder, Ahmed Allam, Christian Blüthgen, Michael Moor, Michael Krauthammer

University of Zurich and University Hospital of Zurich, Switzerland, Kobe University, Japan, ETH AI Center, Switzerland, Stanford University, USA, Zurich University of Applied Sciences, Switzerland

2026-05-26视觉语言视觉感知

针对医学视觉语言模型生成胸片报告时易产生虚假发现、漏报或定位错误的问题,本文不更新权重,而是在解码时用逐 token Top-K 稀疏自编码器分解残差流,经因果筛选后抑制有害特征、放大有益特征。结果显示该方法在 RadVLM、LLaVA-Rad、CheXOne 上提升临床综合指标,并可零样本迁移到 IU-Xray;同时揭示“boost”方向跨模型共享,而 hallucination 的“suppress”方向更依赖具体骨干。

MinerU-Popo: Universal Post-Processing Model for Structured Document Parsing Figure 1
2026-05-26cs.CV

MinerU-Popo: Universal Post-Processing Model for Structured Document Parsing

Bangrui Xu, Ziyang Miao, Xuanhe Zhou, Yiming Lin, Zirui Tang, Xiaomeng Zhao, Fan Wu, Cheng Tan, Bin Wang, Conghui He

2026-05-26视觉感知

面向RAG等下游应用,现有VLM-OCR虽能做页级解析,却常丢失跨页段落、表格、标题层级和图文关系。MinerU-Popo将OCR后处理拆成四个结构恢复子任务,用3万任务数据微调4B轻量模型,并通过任务过滤、动态分块与重叠同步生成文档级树结构。实验显示其在5种OCR上标题层级TEDS至少提升20%,多数RAG子集准确率提高,单查询延迟最高降低70%。

Cross-Domain Generalization Limits of Vision Foundation Models in Facial Deepfake Detection Figure 1
2026-05-26cs.CV

Cross-Domain Generalization Limits of Vision Foundation Models in Facial Deepfake Detection

Ibrahim Delibasoglu

2026-05-26视觉感知学习理论

针对深伪检测在跨生成器、跨篡改方式下容易过拟合特定伪影的问题,本文把 RoPE-ViT、DINOv3 与 C-RADIOv4-H 作为冻结视觉基础模型,用线性探针在 DF40 上评估其表征泛化边界。核心洞察是预训练范式与模型规模决定了对全脸合成的宏观结构异常和局部编辑微弱伪影的敏感性取舍;结果显示基础模型仍能较好区分整脸合成,但面对局部换脸/编辑时性能明显受限,说明简单冻结特征加线性分类难以覆盖细粒度取证域移。

ConFi-GS Confidence-Guided High-Frequency Injection for 3D Gaussian Splatting Super-Resolution Figure 1
2026-05-26cs.CV

ConFi-GS Confidence-Guided High-Frequency Injection for 3D Gaussian Splatting Super-Resolution

Jiaxiang Li, Zongtan Zhou, Zhen Tan, Yadong Liu, Dewen Hu

2026-05-26三维

低分辨率多视角输入会让 3DGS 纹理发糊、边界变弱,而直接引入超分先验又可能把幻觉细节写入三维表示。ConFi-GS 的核心在于区分“哪里需要细节”和“哪些高频细节可信”,结合几何细节需求、频率可靠性与跨视角稳定性生成注入图,并据此做选择性监督、渐进频率正则和高斯致密化。实验称其在多个基准上提升保真度与感知质量,同时减少视角不一致细节。

Tempered Self-Similarity Alignment for Physically Plausible Video Generation Figure 1
2026-05-26cs.CV

Tempered Self-Similarity Alignment for Physically Plausible Video Generation

Manjin Kim, Suha Kwak, Minsu Cho

Pohang University of Science and Technology (POSTECH)

2026-05-26视觉感知

针对视频生成中常见的外观漂移、运动不合理和时序不一致问题,本文将视觉基础模型中的时空自相似关系转化为温度锐化的对应概率分布,并仅在动态区域对齐,以提供长程、关系式运动监督。基于 CogVideoX-2B 微调后,TSA/M-TSA 在 VideoPhy 与 VideoPhy2 上提升物理常识、语义和联合指标,优于 REPA、TRD 等对齐基线。

Three-Step Conditional Diffusion 3D Reconstruction for Light-Field Microscopy Figure 1
2026-05-26cs.CV

Three-Step Conditional Diffusion 3D Reconstruction for Light-Field Microscopy

Qihong Zhao, Shaokang Yan, Zhimin Qiao, Jinjia Wang, Bo Xiong

Yanshan University, Peking University

2026-05-26生成模型三维

针对光场显微三维重建中物理迭代方法慢、伪影重,以及现有学习方法跨样本泛化不足的问题,论文将扩散模型改造成三步确定性条件采样,并用注入光场/物理先验的轻量 U-Net 直接预测体数据,同时加入 ICD 检测分布外输入以触发适配。多数据集与跨数据集实验显示,该方法在重建保真度、速度和泛化稳定性上优于已有物理和学习式基线。

Mitigating Object Hallucinations in Vision-Language Models through Region-Aware Attention Recalibration Figure 1
2026-05-26cs.AI

Mitigating Object Hallucinations in Vision-Language Models through Region-Aware Attention Recalibration

Yuanzhi Xu, Qian Gao, Jun Fan, Guohui Ding, Zhenyu Yang, Sixue Lin, Yuteng Xiao

Qilu University of Technology (Shandong Academy of Sciences), China Telecom Digital Intelligence Technology Co, Ltd, Shenyang Aerospace University, Qilu Institute of Technology, Qilu University of Technology (Shandong Academy of Sciences) Jinan China, China Telecom Digital Intelligence Technology Co, Ltd Jinan China, Shenyang Aerospace University Shenyang China, Qilu Institute of Technology Jinan China

2026-05-26视觉语言视觉感知

论文针对大视觉语言模型在图像描述/VQA中凭语言先验“编造”不存在物体的问题,提出无需训练的 SADI 推理干预:以多注意力头的中位共识作为稳健视觉锚点,并按区域间分歧分配软惩罚,避免硬截断带来的特征不连续和额外解码延迟。在 CHAIR、POPE、MME 上报告同时降低实例级与句子级幻觉,并优于同期基线。

No Figure
2026-05-26cs.CV

Interpretability Transfer from Language to Vision via Sparse Autoencoders

Alexey Kravets, Da Li, Chuan Li, Da Chen, Vinay P. Namboodiri

2026-05-26视觉感知

视觉概念难以标注,使语言模型中成熟的 SAE 可解释性难以迁移到多模态视觉表征。本文提出 VISTA,在 LLaVA 式模型中用文本 SAE 重构损失约束视觉投影器,让视觉 token 落入已标注的语言 SAE 流形,无需训练视觉 SAE。实验显示概念匹配率平均提升三倍,并发现 DINOv2 比 CLIP 具备更稳定的局部定位;基于文本 SAE 方向的局部干预在目标移除和替换上较视觉基线提升 35% 和 47%。

Your Embedding Model is SMARTer Than You Think Figure 1
2026-05-26cs.IR

Your Embedding Model is SMARTer Than You Think

Jianrui Zhang, Hyun Jung Lee, Sukanta Ganguly, Tae-Eui Kam, Donghyun Kim, Yong Jae Lee

Korea University, NetApp, Inc.

2026-05-26视觉感知

针对单向量多模态检索将序列压缩为全局向量、易丢失局部视觉/文本证据的问题,SMART的核心洞察是池化对比学习的梯度已让非池化隐藏状态具备可用于局部匹配的几何结构。方法在推理时直接对冻结隐藏状态做MaxSim晚交互,并与全局分数混合,也可轻量后训练;实验称其在MMEB-V2等任务上稳定提升Qwen3-VL-Embedding等模型,视觉文档检索中还能以更少训练成本超过部分多向量方法。

HumanEgo: Zero-Shot Robot Learning from Minutes of Human Egocentric Videos Figure 1
2026-05-26cs.RO

HumanEgo: Zero-Shot Robot Learning from Minutes of Human Egocentric Videos

Zhi (Leo) Wang, Botao He, Kelin Yu, Seungjae Lee, Ruohan Gao, Furong Huang, Yiannis Aloimonos

University of Maryland

2026-05-26机器人视觉感知

针对机器人操作依赖大量机器人示教、而人类第一视角视频难以跨具身迁移的问题,HumanEgo将手—物交互提升为实体级Interaction-Centric Tokens,并通过手臂修复、虚拟夹爪渲染、flow matching策略及2D轨迹/物体运动/潜变量一致性等密集辅助监督,从分钟级人类视频中学习策略。实验显示每任务30分钟人类视频在4个真实任务达92.5%成功率,15分钟达75%,较同等采集时间机器人遥操作高41%,并可零样本迁移到新机器人、相机和环境。

X-Edit: Exact, Explicit, and Explainable Null-Space Editing for Medical Vision Transformers Figure 1
2026-05-26cs.CV

X-Edit: Exact, Explicit, and Explainable Null-Space Editing for Medical Vision Transformers

Yuanye Liu, Siyuan Zhou, Ke Zhang, Lei Li, Wei Chen, Xiahai Zhuang

2026-05-26视觉感知

这篇工作针对医疗 ViT 部署后遇到长尾病例或域偏移时,常规微调会修正少数错误却引发灾难性遗忘的问题,提出 X-Edit:先用因果追踪定位影响错误预测的层,再由锚点样本构造正交零空间,将闭式参数更新限制其中,以尽量不扰动既有诊断表征。六个医学影像基准显示其在编辑成功率和测试稳定性之间优于微调及已有编辑方法。

MambaDSF: Multi-Scale SSM with Dilated Feature Fusion for Sonar Small Target Detection Figure 1
2026-05-26cs.CV

MambaDSF: Multi-Scale SSM with Dilated Feature Fusion for Sonar Small Target Detection

Hui Lin, Jiayi Li, Jing Wang, Shenghui Rong

School of Information Science and Engineering, Ocean University of China, Qingdao 266100, China, School of Information and Communication Technology, Griffith University, Nathan, QLD 4111, Australia

2026-05-26视觉感知

面向AUV等水下感知中小型声呐目标像素少、对比度低且尺度变化大的难题,MambaDSF将线性复杂度SSM引入检测框架:用MambaEFP兼顾局部回波与全局杂波上下文,DFMamba做空洞多感受野与跨尺度融合,并以SA-WIoU、CSC稳定小目标监督。在UATD上以28.7M参数达到91.5% mAP50,小目标子集提升2.2个百分点,跨FLS/MD-FLS验证了泛化性。

No Figure
2026-05-26cs.GR

Snapshot Polarimetric Display Inverse Rendering

Seokjun Choi, Yunseong Moon, Kaizhang Kang, Hoon-Gyu Chung, Jin-Nyeong Kim, Giljoo Nam, Seung-Hwan Baek

2026-05-26视觉感知

面向桌面级轻量采集中的单帧逆渲染信息不足问题,论文把LCD线偏振RGB二值照明、带四分之一波片的RGB偏振相机和前馈Transformer结合,将一次拍摄分解为RGB方向×非偏振/线偏振/圆偏振九路观测,以缓解漫反射、镜面与金属材质混淆;同时用生成流形扩增实测pBRDF训练数据。真实装置实验显示其法线、反照率、粗糙度和金属度估计及重光照效果优于对比方法。

Where Detectors Fail: Probing Generative Space for Generalizable AI-Generated Image Detection Figure 1
2026-05-26cs.CV

Where Detectors Fail: Probing Generative Space for Generalizable AI-Generated Image Detection

Zijie Cao, Weijie Tu, Yao Xiao, Weijian Deng, Liang Lin, Pengxu Wei

2026-05-26视觉感知生成模型

针对 AI 生成图像检测器在未见生成器上易失效的问题,论文指出瓶颈不只是数据规模,而是训练样本未覆盖生成空间中的边界区域。PROBE 将检测器作为 critic,引导扩散生成器在保持感知真实的约束下产生难分类的边界诱导假样本,再用其微调检测器。多基准实验显示该方法提升跨生成器泛化,平均较近期 SOTA 高约 4.6%。

BFS: Back-to-Front Layered Image Synthesis via Knowledge Transfer Figure 1
2026-05-26cs.CV

BFS: Back-to-Front Layered Image Synthesis via Knowledge Transfer

Kyoungkook Kang, Gyujin Sim, Sunghyun Cho

2026-05-26视觉感知

针对分层图像生成中前景/阴影/反射难以干净分离、且高质量分层训练数据稀缺的问题,BFS选择从背景到前景的合成流程,用双分支扩散模型同时生成合成图与RGBA前景层,并通过未分层高质量图像向前景分支迁移知识。两阶段训练使模型在有限分层监督下生成更协调的前景层,实验和用户研究显示其视觉质量与泛化性优于既有方法。

BED-SAM2: Boundary-Enhanced-Depth SAM2 via Monocular Geometric Priors Figure 1
2026-05-26cs.CV

BED-SAM2: Boundary-Enhanced-Depth SAM2 via Monocular Geometric Priors

Tyler Rust, Dara McNally, Kyle O'Donnell, Colin Kelly, Chandra Kambhamettu

University of Delaware, University of South Florida, DEVCOM Army Research Laboratory

2026-05-26学习理论

针对 SAM2 在显著/伪装目标分割中易受纹理、阴影干扰且边界不准的问题,BED-SAM2 将单目深度估计转化为由原深度、反深度、中心化深度等边缘累加的结构图,作为第四通道早期融合进 Hiera 编码器,并用 LoRA 轻量微调。文中报告其在 13 个基准上达到或接近 SOTA,且仅需约 5 个训练 epoch。

X-Foresight: A Joint Vision-Action Causal Forecasting Network via Predictive World Modeling Figure 1
2026-05-26cs.CV

X-Foresight: A Joint Vision-Action Causal Forecasting Network via Predictive World Modeling

Baolu Li, Jingyu Qian, Rui Guo, Yilun Chen, Hanpeng Liu, Yuan Lin, Junhong Zhou, Ruixin Liu, Willow Yang, Yutong Zheng, Zhenli Zhang, Tenglong (Victor)Gu, Zhuangzhuang Ding, Pengkun Zheng, Yu Zhang, Xianming Liu

PWM Team, XPeng Inc.

2026-05-26视觉感知强化学习

该文针对现有 VLA 自动驾驶/机器人策略偏反应式、难以预演未来风险的问题,提出 X-Foresight,将预测式世界模型嵌入视觉-语言-动作架构。关键洞察是不用逐帧预测,而以长时域 chunk 自回归联合预测视觉与动作,配合课程学习、关键时刻重要性采样和扩散式多视角渲染,同时学习短期动态与长期因果。实验显示其规划表现优于 VLA 基线并保持较好生成保真度,但具体增益幅度需看正文表格。

QuoVLA: Quotient Space for Vision-Language-Action Models Figure 1
2026-05-26cs.CV

QuoVLA: Quotient Space for Vision-Language-Action Models

Xuan Wang, Yinan Wu, Haoran Duan, Jungong Han

Department of Automatio, Tsinghua University

2026-05-26视觉语言视觉感知

该文针对VLA适配中普遍认为预训练VLM表征“缺少动作信息”或需隔离动作梯度的假设,提出相反洞察:VLM潜变量可能已动作充分但过完备,冗余的提示差异会伤害泛化。QuoVLA用商空间思想,通过量化压缩、可控直通梯度、双分支动作生成和相对时序复杂度正则,保留动作相关信息并折叠动作等价变化。多基准实验显示其在整体性能上有竞争力,尤其在视觉、语言和环境分布偏移下泛化提升明显。

Trajectory-Consistent Calibration for Cache-Accelerated Diffusion Models Figure 1
2026-05-26cs.CV

Trajectory-Consistent Calibration for Cache-Accelerated Diffusion Models

Mingyu Liang, Dingkun Xu, Jingwei Xu

Laboratory for Novel Software Technology, Nanjing University, China

2026-05-26生成模型规划控制

针对 DiT 采样中缓存复用虽能加速但会引入表示偏差、并沿去噪轨迹累积导致质量下降的问题,论文提出训练-free 的 TCC:将校准视为轨迹的一部分,离线迭代估计与已校正历史一致的误差先验,同时处理局部复用错配和后续轨迹漂移。在不改模型和缓存策略下,TCC 在 PixArt-α、DiT-XL/2 及 FORA/ToCa/L2C 等设置中稳定降低 FID,如 PixArt-α 上由 29.83 降至 27.35。

Adversarial Error Correction for Visual Autoregressive Generation Figure 1
2026-05-26cs.CV

Adversarial Error Correction for Visual Autoregressive Generation

Ligong Bi, Tao Huang, Jianyuan Guo, Chang Xu

Shanghai Jiao Tong University, City University of Hong Kong, The University of Sydney

2026-05-26视觉感知

本文针对视觉自回归生成中粗到细预测的误差级联问题:早期小偏差会在后续尺度被放大,导致纹理漂移和结构失真。核心做法是在冻结的 VAR 主干上加入轻量 guidance injector,并用 RGB 空间判别器、软 VQ-VAE 解码和动态刷新训练提供可传回的对抗纠错信号,同时提出 ISCS 衡量跨尺度一致性。ImageNet 实验显示其在多个 VAR 骨干上提升细节与结构稳定性,AID-VAR-d20 以约 3% 参数增量带来 16% FID 改善。

Multiscale Real-Time Object Detection in the NMS-Free Era: A Comparative Performance Evaluation of YOLOv8 and YOLO26 Figure 1
2026-05-26cs.CV

Multiscale Real-Time Object Detection in the NMS-Free Era: A Comparative Performance Evaluation of YOLOv8 and YOLO26

Chidera G. Oguine, Kanyifeechukwu J. Oguine, Obiozor M. Oguine, Ozioma C. Oguine

University of Abuja, Nigeria, Vanderbilt University, USA, University of Notre Dame, USA

2026-05-26视觉感知数据集/基准

针对实时目标检测中 NMS 带来的延迟波动和边缘部署复杂性,本文系统比较 NMS 型 YOLOv8 与端到端 NMS-free 的 YOLO26,在 Pascal VOC 与密集小目标 VisDrone 上跨五种尺度评测精度、定位、复杂度和 CPU/GPU 延迟。核心洞察是去除 NMS 并不必然带来全场景部署优势:YOLO26 在 VOC 多数尺度上精度更高且模型更轻,但在 VisDrone 小目标场景优势收窄,YOLOv8 的 GPU 延迟仍有竞争力。

AOEPT: Breaking the Implicit Modality-Reduction Bottleneck in Modality-Missing Prompt Tuning Figure 1
2026-05-26cs.CV

AOEPT: Breaking the Implicit Modality-Reduction Bottleneck in Modality-Missing Prompt Tuning

Jian Lang, Rongpei Hong, Ting Zhong, Fan Zhou

2026-05-26视觉感知

面向真实部署中传感器失效、传输错误导致的模态缺失,本文指出现有缺失模态提示调优会把多模态 Transformer 隐式压缩到仅观测模态子空间,形成 IMR 瓶颈。AOEPT 用训练数据蒸馏轻量级模态上下文提示作为缺失模态的全局先验库,并按当前样本观测模态实例化补偿信息。多基准和多骨干实验显示其在较小计算开销下优于既有方法,并提出 NM²I 诊断该瓶颈。

CLIP-Guided SAM: Parameter-Efficient Semantic Conditioning for Promptable Segmentation Figure 1
2026-05-26cs.CV

CLIP-Guided SAM: Parameter-Efficient Semantic Conditioning for Promptable Segmentation

Shayan Jalilian, Abdul Bais

2026-05-26视觉感知

针对 SAM 分割精细但缺乏类别语义、VLM+SAM 外部生成提示又难以让语义进入特征的问题,本文提出 CLIP-Guided SAM:用轻量多模态适配器把 CLIP 的文本、视觉和相似度特征注入 SAM 图像编码器,并强调 SAM 与 CLIP 端到端协同适配及训练/推理提示一致性。实验在 COCO、ADE20K、VOC 和伪装目标等低标注场景中优于 SAM-PEFT 与 VLM+SAM 管线,并在较少参数和算力下接近或竞争于更大模型。

Fishbone: From One 3D Asset to a Million Controllable Edits Figure 1
2026-05-26cs.CV

Fishbone: From One 3D Asset to a Million Controllable Edits

Yumeng He, Xiaoying Wang, Peihao Li, Yanjia Huang, Joe Masterjohn, Jiajun Wu, Leonidas Guibas, Yin Yang, Ying Jiang, Chenfanfu Jiang

2026-05-26规划控制三维

为缓解三维资产建模/绑定成本高、机器人学习与生成模型缺少可控形变数据的问题,Fishbone从任意网格自动抽取“脊柱-肋骨”控制结构:用测地标量场生成截面肋骨、几何中心线生成脊柱,并以高斯蒙皮关联表面,实现局部厚度/截面编辑与全局弯曲、扭转、拉伸。论文还构建Fishbone-136K并展示实时编辑、降维仿真、动画、可控生成和机器人数据增强效果,但具体下游增益来源可能部分来自数据扩增规模。

Divide-and-Conquer Inference for Large-Scale Visual Recognition with Multimodal Large Language Models Figure 1
2026-05-26cs.CV

Divide-and-Conquer Inference for Large-Scale Visual Recognition with Multimodal Large Language Models

Zhipeng Ye, Jiaqi Huang, Feng Jiang, Qiufeng Wang, Yikang Duan, Dawei Wang, Xihang Zhou, Qian Qiao

2026-05-26视觉语言视觉感知

论文关注多模态大模型在大规模闭集识别中随候选类别增多而准确率崩塌的问题,认为根因是标签熵上升与长提示中的注意力稀释降低信噪比。作者提出无需训练的 Divide-and-Conquer Inference,将大类别表递归拆成局部子问题并动态剪枝。ImageNet-1K/21K 等实验显示,DCI可提升准确率并降低推理开销,使较小开源模型接近甚至超过部分闭源强模型。

HCL-FF: Hierarchical and Contrastive Learning for Forward-Forward Algorithm Figure 1
2026-05-26cs.CV

HCL-FF: Hierarchical and Contrastive Learning for Forward-Forward Algorithm

Jie-En Yao, Hong-En Chen, C.-C. Jay Kuo

University of Southern California

2026-05-26视觉感知

本文针对 Forward-Forward 算法在逐层局部训练中缺少跨层层级协调、且 goodness 归一化后特征语义不稳定的问题,提出 HCL-FF:用由粗到细的标签监督引导浅层到深层表征演化,并在去 goodness 后的特征上加入监督对比约束。其在 CIFAR-10、CIFAR-100 与 Tiny-ImageNet 上相较既有 FF 方法分别提升 5.46%、17.00% 和 12.51%,显示层级课程与对比对齐能缓解 FF 的解耦困境。

DUEL: Adversarial Self-Play for Multimodal Reasoning Figure 1
2026-05-26cs.CV

DUEL: Adversarial Self-Play for Multimodal Reasoning

Lin Qiu, Hanqing Zeng, Yao Liu, Bingjun Sun, Guangdeng Liao, Ji Liu

2026-05-26视觉语言

DUEL针对VLM强化学习后训练依赖高质量标注、无监督自演化又容易缺乏视觉 grounding 的问题,提出由同一预训练模型分化出的Challenger–Solver对抗自博弈:前者生成图像真实陈述及最小扰动硬负例,后者用长度归一化似然奖励验证真伪。实验显示其在数学推理、图表文档理解和通用视觉推理上较同基座后训练方法有更稳定增益,且无需人工标注、外部奖励模型或图像编辑工具。

Parameter-Efficient VLMs for Gastrointestinal Endoscopy: Medical Image Generation and Clinical Visual Question Answering Figure 1
2026-05-26cs.CV

Parameter-Efficient VLMs for Gastrointestinal Endoscopy: Medical Image Generation and Clinical Visual Question Answering

Ojonugwa Oluwafemi Ejiga Peter, Frederick Akor Ejiga, Fahmi Khalifa, Md Mahmudur Rahman

2026-05-26视觉语言视觉感知

针对胃肠内镜 AI 受标注稀缺、隐私限制和全量微调成本制约的问题,论文提出双管线参数高效框架:用 PEFT 适配 Florence-2 做临床 VQA,并以 LoRA 微调 Stable Diffusion 2.1 生成隐私友好的合成内镜图像。实验在 Kvasir-VQA 上报告 ROUGE-1 0.92、ROUGE-L 0.91,BLEU 有提升;rank-4 LoRA 在图文一致性 FBD 上优于若干生成基线,并称计算成本降低近 90%。

Self-Supervised Contrastive Learning for Cardiac MR Sequence Classification Figure 1
2026-05-26cs.CV

Self-Supervised Contrastive Learning for Cardiac MR Sequence Classification

Yuli Wang, Hyewon Jung, Dongshen Peng, Yuwei Dai, Jing Wu, Haoyue Guan, Yoko Kato, Zhicheng Jiao, Yu Sun, Ihab Kamel, Joao Lima, Cheng Ting Lin, Harrison Bai

2026-05-26视觉感知

针对通用 ImageNet 预训练 ViT 难以迁移到心脏 MR 序列分类的问题,论文用院内心脏 MR 数据进行自监督对比预训练,再少量监督微调,以学习领域表征。结果显示该策略优于直接监督训练,在 T1、T2、Cine、LGE 四类常见序列上 AUC 均超过 0.75,并能迁移到 BraTS、ADNI;消融还指出中等 batch 更优,约 1200 张图像即可超过监督微调。

How Noisy Poses Break Inverse Dynamics: Analysis and Mitigation for Video-Based Joint Torque Estimation Figure 1
2026-05-26cs.CV

How Noisy Poses Break Inverse Dynamics: Analysis and Mitigation for Video-Based Joint Torque Estimation

Donghyun Kim, Chanyoung Kim, Eunseo Jeong, Youngjoong Kwon, Seong Jae Hwang

Emory University, Yonsei University

2026-05-26视觉感知三维

面向视频三维人体姿态到关节力矩估计的物理落地问题,论文指出逆动力学中的数值微分会把微小姿态噪声急剧放大。作者构建无需外部仿真的可微 SMPL-Dynamics,并系统分析噪声传播:姿态误差约放大 1000 倍,躯干和髋等近端关节比远端敏感最高 10 倍;微分前低通滤波可缓解,可微姿态优化在几乎不改姿态下将力矩误差降低约 92%–93%。

From Theory to Decision Rule: Calibrating the Noisy-Label Crossover for Vision-Language Model Weak Supervision Across Three Medical-Imaging Benchmarks Figure 1
2026-05-26cs.CV

From Theory to Decision Rule: Calibrating the Noisy-Label Crossover for Vision-Language Model Weak Supervision Across Three Medical-Imaging Benchmarks

Bruce Changlong Xu, Jose James, Alexander Ryu

2026-05-26视觉语言视觉感知学习理论数据集/基准

针对“用VLM伪标签是否越多越好”的弱监督假设,本文把经典噪声标签上界校准到BiomedCLIP医学影像标注场景,提出用少量金标比较gold-only AUC与VLM准确率的决策规则。三数据集显示交叉点分别约为PCAM 100、ISIC 20–50、NIH-CXR 250–500个金标;超过后弱标签最高使AUC下降约0.10,且多数预训练架构下交叉点基本不变,说明瓶颈主要在标注器而非学生模型。

Muon in Vision Transformers: Optimizer-Recipe Interactions and Gradient Spectra Figure 1
2026-05-26cs.LG

Muon in Vision Transformers: Optimizer-Recipe Interactions and Gradient Spectra

Ben S. Southworth, Shuai Jiang, Daniel McBride, Eric C. Cyr, Stephen Thomas

Los Alamos National Laboratories, Sandia National Laboratories, Lehigh University

2026-05-26视觉感知优化算法

本文针对ViT大量参数是矩阵而AdamW仍逐坐标更新的错配,系统考察矩阵感知优化器Muon。核心洞察是其优势并非单纯优化器替换,而是与强视觉训练配方耦合:全量增强可维持更丰富的梯度谱,避免Muon在深层MLP出现后期模态坍缩;同配方下Muon在QKV梯度上比AdamW覆盖更多奇异方向。实验显示其在ImageNet-100、长尾Pl@ntNet分类以及分割、MAE训练中均优于AdamW。

Leveraging pretrained RGB denoisers for hyperspectral image restoration Figure 1
2026-05-26cs.CV

Leveraging pretrained RGB denoisers for hyperspectral image restoration

Daniele Picone, Mohamad Jouni, Mauro Dalla-Mura

2026-05-26视觉感知

高光谱恢复受训练数据稀缺、传感器差异和高维谱带限制,专用先验往往泛化不足。本文的关键思路是冻结大规模 RGB/灰度去噪器,仅用轻量线性适配器把高光谱立方体投影到低维谱子空间去噪,再受约束聚合回原谱域,同时保持 PnP 稳定性。实验覆盖去噪、去模糊和超分辨率,在多个数据集上相较高光谱专用基线取得一致提升,说明 RGB 先验可迁移到高光谱恢复。

4KLSDB: A Large-Scale Dataset for 4K Image Restoration and Generation Figure 1
2026-05-26cs.CV

4KLSDB: A Large-Scale Dataset for 4K Image Restoration and Generation

Zihao Zhu, Kuan-Ru Huang, Zhaoming Xu, Renjie Li, Bo Wu, Ruizheng Bai, Mingyang Wu, Sayak Paul, Zhengzhong Tu

Texas A&M University

2026-05-26视觉感知数据集/基准

针对公开数据缺少大规模原生 4K 图像、限制超分辨率与文生图模型训练和公平评测的问题,本文构建 4KLSDB:从 LAION-2B、Photo Concept Bucket、PD12M 等筛选 12.9 万张训练图,并结合规则过滤、LMM 评分与人工核验,提供验证/测试集、LR/HR 基准和图文对。实验显示,用真实 4K 数据微调可提升多类超分与扩散生成的细节保真、泛化和人类偏好,但增益可能主要来自 scaling / data。

Drift-Resistant Navigation World Model with Anchored Epipolar Guidance Figure 1
2026-05-26cs.CV

Drift-Resistant Navigation World Model with Anchored Epipolar Guidance

Po-Chien Luan, Zimin Xia, Wuyang Li, Yang Gao, Alexandre Alahi

2026-05-26机器人强化学习

面向导航世界模型长时域滚动中视觉误差累积和与自运动不一致的几何漂移,论文提出 DR-NWM:先预测稀疏未来锚点,再在锚点间分块生成中间帧,并用双向极线约束为扩散 Transformer 提供几何定位,无需显式 3D 监督。四个导航基准上,其在长时域画质、几何一致性、多视角连贯性及同规划器下的下游规划表现均优于强基线。

No Figure
2026-05-26cs.CV

Motion-Compensated Weight Compression

Ismail Lamaakal

Mohammed Premier University

2026-05-26视觉感知

面向大模型部署中检查点存储、传输与冷启动成本上升的问题,MCWC不再逐层独立压缩权重,而是利用隐藏单元、注意力头等置换对称性做功能保持的跨层对齐,将网络深度视作类似视频的可预测序列,再用关键帧、层序预测、残差量化和学习熵模型编码。文中称其在Transformer语言建模和视觉分类上优于强量化与学习式权重编码基线的率—精度折中,消融显示对齐、预测、熵建模和关键帧均贡献必要。

Ghosts in the Point Clouds: De-glaring LiDAR in the Transient Domain Figure 1
2026-05-26cs.CV

Ghosts in the Point Clouds: De-glaring LiDAR in the Transient Domain

Avery Gump, Connor Henley, Sungjin Cheong, Akarsh Prabhakara, Mohit Gupta

University of Wisconsin–Madison, Madison, WI, USA

2026-05-26三维

面向固态/单光子阵列 LiDAR 在逆反射物等强回波下产生内部多径眩光、点云鬼影并遮挡真实目标的问题,论文把眩光建模为作用于瞬态直方图的场景无关线性 TGSF,并在点云生成前结合 pileup 校正与回波置信度进行无训练抑制。真实商业 SP-LiDAR 实验显示,该方法能显著减少严重眩光伪影,同时较好保留真实场景结构。

From Full Boards to Tiny Defects: Scale-Aware Tile Inference with Topology-Aware Merging for High-Resolution PCB Defect Detection Figure 1
2026-05-26cs.CV

From Full Boards to Tiny Defects: Scale-Aware Tile Inference with Topology-Aware Merging for High-Resolution PCB Defect Detection

Mohammad Alijanpour Shalmani, Alale Rezvani Boroujeni, Ali Amini, Jiann Shiun Yuan

cCentre of Real Time Computer Systems, Faculty of Informatics, Kaunas University of Technology, defect detection, further showing that the field is rapidly moving toward architecture-centered improvements [9], [10]., standard detection metrics together with small-defect recall and boundary-zone recall. The codes are available at

2026-05-26视觉感知

本文针对高分辨率 PCB 全图缩放导致微小缺陷“分辨率崩塌”的问题,指出训练与推理尺度一致性比改网络更关键,并提出无需重训的拓扑感知瓦片合并 TA-TM,通过邻接瓦片一致性修正边界框分数。两数据集上,瓦片训练显著优于全图训练,128px 重叠将边界召回提升至约70–100%,TA-TM取得最佳 mAP@50。

Calibrating Probabilistic Object Detectors with Annotator Disagreement Figure 1
2026-05-26cs.CV

Calibrating Probabilistic Object Detectors with Annotator Disagreement

Zhi Qin Tan, Owen Addison, Yunpeng Li

2026-05-26视觉感知

论文针对医学等场景中目标本身含糊、标注者分歧大而难以获得客观真值的问题,主张不再把分歧简单聚合掉,而是用多标注分布来校准概率目标检测器的类别置信度与框方差。方法提出无需真值的四类分类/定位校准误差、训练期损失与等渗回归后校准,可适配 YOLO 和两阶段检测器;在真实与合成的医学、自然图像实验中,平均校准指标提升约 4.0–11.5,且基本保持检测精度。

Physics-Guided Self-Supervised Statistical Residual Learning for Sonar Despeckling with Improved Generalization Figure 1
2026-05-26cs.CV

Physics-Guided Self-Supervised Statistical Residual Learning for Sonar Despeckling with Improved Generalization

Swapna Pillai, Siddharth Singh Savner, Sujit Kumar Sahoo

2026-05-26学习理论

针对真实声呐图像缺少无斑点真值、合成监督易失配且自监督方法可能退化为恒等映射的问题,论文把乘性斑点转到对数域学习残差,并用目标方差统计约束、边缘感知结构正则和中值引导课程训练限制残差符合物理噪声。实验称轻量网络在多个真实声呐数据集上取得最佳 M-score,并表现出较强跨数据集鲁棒性和实时部署潜力。

Do Image-Text Metrics Respect Semantic Invariances? Figure 1
2026-05-26cs.CV

Do Image-Text Metrics Respect Semantic Invariances?

Amit Agarwal, Hitesh Laxmichand Patel, Meizhu Liu, Jyotika Singh, Karan Dua, Hansa Meghwani, Matthew Rowe, Michael Avendi, Yassi Abbasi, Tao Sheng, Sujith Ravi, Dan Roth

2026-05-26视觉感知

本文关注无参考图文评测指标是否会被“语义不变”的扰动误导,因为这些分数常用于模型选择、排序和奖励。作者提出面向指标的 invariance audit,在空间、物体和社会语言表述三类扰动上测试 CLIPScore、PAC-S、UMIC、FLEUR 与 LLM judge。结果显示无害翻转、重定位或措辞变化可带来约 6–9% 分数漂移,0.7% 的系统差距下最高约 37% 排名翻转;其后处理校准可约减半中位敏感度。

No Figure
2026-05-26cs.CV

SRUG: Shadow-Guided Relightable Urban Scene with Generation Model

Yonghao Zhao, Zexin Yin, Jian Yang, Beibei Wang, Jin Xie

College of Computer Science, Nankai University, Nankai University and Nanjing University, School of Intelligence Science and Technology, Nanjing University, College of Computer Science, Nankai University China, Nankai University and Nanjing University China, School of Intelligence Science and Technology, Nanjing University China

2026-05-26视觉感知

本文面向多视图/视频重建可重光照城市场景,针对城市无界导致不可见区域仍会投影、稀疏视角与复杂日照/天光/间接光使材质-光照分解不稳的问题,提出 SRUG:用阴影引导 3D 补全恢复不可见几何,并结合可微 Gaussian 阴影映射、LMM 监督的迭代材质分解和物理光照模型。实验显示其在新视角合成、材质分解与重光照上优于既有方法,但长序列材质一致性仍有限。

AdaFuse-Det: Adaptive Cross-Modal Fusion of Event Cameras for Robust Object Detection in Low-Light RGB Imagery Figure 1
2026-05-26cs.CV

AdaFuse-Det: Adaptive Cross-Modal Fusion of Event Cameras for Robust Object Detection in Low-Light RGB Imagery

Raju Imandi, Chethana B, Bharatesh Chakravarthi, Yong-Guk Kim, Manipriya S, Pavan Kumar B N

2026-05-26视觉感知安全鲁棒

面向夜间监控、搜救等低照度场景中 RGB 相机信噪比骤降、检测易失效的问题,AdaFuse-Det 将 CLAHE 增强图像与体素化事件流双分支编码,并用基于最小方差估计的 ACMF 自适应分配两种模态权重。其在 LLE-VOS 极暗条件下达到 65.54% 召回率、53.85% 精度和 59.12% F1,优于 RGB-only、event-only 和简单拼接基线。

HoloFair: Unified T2I Fairness Evaluation and Fair-GRPO Debiasing Figure 1
2026-05-26cs.CV

HoloFair: Unified T2I Fairness Evaluation and Fair-GRPO Debiasing

Ruyi Chen, Lu Zhou, Xiaogang Xu, Chiyu Zhang, Jiafei Wu, Liming Fang

2026-05-26数据集/基准

针对文生图模型在中性或带社会语义提示下仍会放大性别、年龄、种族偏差的问题,HoloFair将公平性评估从单一属性扩展到多属性、语义条件分布,提出MGBI指标、SpaFreq属性分类器和配套提示/图像基准,并用Fair-GRPO以多目标奖励调节生成分布。文中评测8个主流T2I模型,发现默认看似公平的模型在具体语义下仍暴露偏见;在SD3.5-Medium等实验中,该方法提升MGBI且基本保持图像质量。

No Figure
2026-05-26cs.CV

MindAdapter: Few-Shot Parameter-Efficient Residual Calibration of Cross-Subject Brain-to-Visual Decoding Models

Jiaxiang Liu, Jiawei Du, Xupeng Chen, Guoqi Li, Jiang Cai, Simon Fong, Mingkun Xu

Guangdong Institute of Intelligence Science and Technology, New York University, Institute of Automation, Chinese Academy of Sciences, Department of, Computer and Information Science, University of Macau, Guangdong Institute of Intelligence Science and Technology Hengqin China, New York University Brooklyn US, Institute of Automation, Chinese Academy of Sciences Beijing China, Computer and Information Science, University of Macau Macau China

2026-05-26视觉感知

针对跨被试脑到视觉解码中个体功能错位导致迁移性能下降、重新采集大量 fMRI 代价高的问题,MindAdapter 冻结预训练 BTM 粗对齐骨干,仅学习轻量非线性残差适配器,并用少量共享刺激作拓扑锚点、结合冻结视觉语言解码器的语义约束稳定校准。NSD 实验显示,其在极少共享样本下提升跨被试图像重建与检索准确率,但细粒度结构仍有限,通常需至少 16 个锚点。

VaaWIT: Visual-Aware Adaptation of Large Language Models for Multilingual Web Image Translation Figure 1
2026-05-26cs.CV

VaaWIT: Visual-Aware Adaptation of Large Language Models for Multilingual Web Image Translation

Bo Li, Ronghao Chen, Ningyuan Deng, Huacan Wang, Shaolin Zhu, Lijie Wen

Tsinghua University, Baidu Inc., The Hong Kong University of Science and Technology, Tianjin University, Baidu Inc. Beijing China, The Hong Kong University of Science and Technology Hong Kong China, Tianjin University Tianjin China, Tsinghua University Beijing China

2026-05-26视觉感知

网页图片中的文字翻译同时依赖细粒度字符识别与跨语言语义推理,通用 LVLM 的视觉编码器偏向全局语义,易丢失字形细节。VaaWIT 用语义/细节双流编码与双向注意力融合,并通过轻量 Visual-Aware Adapter 将视觉线索注入冻结 LLM。三套公开基准八项任务上,其超过开源 SOTA,并接近或部分超过 GPT-4.1、Gemini 2.5 Pro。

Reasoning to Align: Implicit Reasoning in Diffusion Transformers for Video Editing Figure 1
2026-05-26cs.CV

Reasoning to Align: Implicit Reasoning in Diffusion Transformers for Video Editing

Yan Li, Lin Liu, Xiaopeng Zhang, Qi Tian

† The Hongkong University of Science and Technology, & ‡ Huawei Inc.

2026-05-26视觉感知生成模型

本文关注指令式视频编辑中 DiT 难以同时理解编辑意图、定位修改区域并保持时序一致的问题,指出根因在于条件 token 不分层、注意力推理只受像素损失间接约束。RVEDiT 通过 MLLM 蒸馏的可学习编辑 token 做浅层粗粒度引导,并在深层接入原生图文 token;训练时再用共享参数参考分支对齐注意力互信息。实验显示其在标准基准上优于现有方法,尤其提升局部与组合编辑效果,且推理无额外开销。

AVBench: Human-Aligned and Automated Evaluation Benchmark for Audio-Video Generative Models Figure 1
2026-05-26cs.AI

AVBench: Human-Aligned and Automated Evaluation Benchmark for Audio-Video Generative Models

Jialiang Yang, Bin Xia, Ruihang Chu, Dingdong Wang, Wanke Xia, Zhun Mou, Tianyang Zhong, Yiting Zhao, Wenming Yang

2026-05-26视觉感知生成模型数据集/基准

针对音视频生成评测仍依赖粗粒度指标和通用 MLLM、难以发现人类场景中口型、情绪、声画一致性等细微错误的问题,AVBench提出面向人类中心场景的十维自动评测,并用真实视频构造含硬负样本的约30万偏好数据微调专用AV/AT/VT评估器,以Yes/No置信度给出连续分数。实验表明其较现有VQA式或零样本基准更贴近人类判断,并可用于数据过滤和潜在RLHF奖励信号。

Understanding the Impact of Geometric Foundation Models on Vision-Language-Action Models Figure 1
2026-05-26cs.CV

Understanding the Impact of Geometric Foundation Models on Vision-Language-Action Models

Yurou Yang, Muyuan Lin, Roberto Martin-Martin, Martin Labrie, Shreekant Gayaka, Cheng-Hao Kuo, Luca Carlone

Martin Labrie

2026-05-26视觉语言视觉感知

本文针对VLA是否真正缺乏几何理解、GFM应如何注入VLA这一问题,以GR00T-N1.5和VGGT为例做系统实验。核心在于用线性探针量化VLA与GFM的“几何差距”,并公平比较Early Fusion、Late Fusion、Spatial Forcing等注入策略。结果显示,简单微调几何VLA在RoboCasa/LIBERO上相对基线增益不显著,真实G1上仅早期融合在接近阶段明显更好;整体收益可能主要受数据规模、相机数量和重建质量影响。

DisDop: Distillation with Domain Priors for Open-Vocabulary Aerial Object Detection Figure 1
2026-05-26cs.CV

DisDop: Distillation with Domain Priors for Open-Vocabulary Aerial Object Detection

Ruihao Xu, Yong Liu, Yansong Tang, Sule Bai, Xubing Ye, Bingyao Yu, Yutao Guo, Jiwen Lu, Jie Zhou

Tsinghua Shenzhen International Graduate School, Tsinghua University, Tsinghua University

2026-05-26视觉感知

针对无人机航拍与自然图像差异大、标注稀缺导致通用开放词汇检测器迁移效果差的问题,DisDop将RemoteCLIP与DINOv3中的遥感领域先验蒸馏到轻量检测器:融合视觉教师特征,约束视觉特征保持文本类别语义拓扑,并引入全局上下文改善小目标识别。文中称其在DIOR、DOTAv2.0和LAE-80C等开放词汇航拍检测基准上超过既有方法,消融支持各模块有效。

Resolving Ambiguity in Composed Image Retrieval via Calibrated Interaction Figure 1
2026-05-26cs.CV

Resolving Ambiguity in Composed Image Retrieval via Calibrated Interaction

Amsisan Tran, Baogh Le, Tuan Kiet Pham, Sui Yang Guang

2026-05-26视觉感知三维

本文针对组合图像检索中“一条查询只对应一个目标”的不合理假设,指出模糊修改语句会导致有效答案被当作假负例且模型过度自信。核心做法是将检索器外接保形预测层,用候选集覆盖率和集合大小刻画不确定性,并在歧义大时通过信息增益选择澄清问题;同时提出 AmbiCIR 基准和用户模拟器。实验称其单轮性能接近 SOTA,在交互预算内更快命中目标,并首次报告该任务的覆盖与校准结果。

Beyond Generative Priors: Minority Sampling with JEPA-Guided Diffusion Figure 1
2026-05-26cs.LG

Beyond Generative Priors: Minority Sampling with JEPA-Guided Diffusion

Sol Park, Soobin Um

2026-05-26生成模型

论文针对现有少数样本生成只依赖生成模型自身密度、难以反映真实语义稀有性的问题,提出用预训练 JEPA/DINOv2 表征诱导的“世界先验”来引导扩散采样,并用随机化 SVD 等近似降低逐步计算 JEPA 密度梯度的开销。实验覆盖无条件、类别条件、文生图和少步模型,显示其生成的少数样本在保真度与语义有效性上优于生成器中心基线。

DexSIM: Real-time Dexterous Simulation with Unified Causal Video Diffusion Figure 1
2026-05-26cs.CV

DexSIM: Real-time Dexterous Simulation with Unified Causal Video Diffusion

Adam Lee

2026-05-26视觉感知生成模型

DexSIM瞄准现有视频世界模型在灵巧手-物交互中缺少实时性、长期空间一致性和记忆的问题。方法先训练双向视频扩散模型,将手部轨迹、视频与初始3D点统一嵌入,并用高斯热图表征手;再通过自回滚/DMD蒸馏转为因果自回归模型,引入可更新空间缓存作为记忆。实验称其在外观相似度、运动保真和手投影精度上优于基线,并以15.24 FPS支持实时交互,但总体真实感仍受数据和模型规模限制。

ULF-Synth: Physics-Guided Ultra-Low-Field MRI Enhancement for Pediatric Neuroimaging Figure 1
2026-05-26cs.CV

ULF-Synth: Physics-Guided Ultra-Low-Field MRI Enhancement for Pediatric Neuroimaging

Toufiq Musah, Salvatore Calcagno, Federica Proietto Salanitri, Xiaomeng Li, Maruf Adewole, Marawan Elbatel

2026-05-26视觉感知

针对超低场 MRI 便携但信噪比和分辨率低、真实 ULF-HF 配对数据稀缺的问题,ULF-Synth 用 MRI 物理退化过程从高场儿科脑 MRI 合成低场配对样本,并以空间 L1、加权 k-space 一致性和梯度正则联合监督,适配多类生成架构。仅用合成数据训练后,模型在真实 64mT 扫描上仍提升结构相似度、感知质量、下游脑结构分割,并获得盲评放射科医生更高偏好。

Vision-Language Binding in In-Context Image Generation Figure 1
2026-05-26cs.CV

Vision-Language Binding in In-Context Image Generation

Chris Ge, Rohit Gandikota, Antonio Torralba, Tamar Rott Shaham

Northeastern University

2026-05-26视觉语言视觉感知

本文关注 FLUX.2 这类统一注意力的上下文图像生成模型中,参考图像信息究竟如何流向输出。作者通过 T2I Lens、Attention Knockout 和 I2I-to-I2I Patching 做因果干预,发现文本 token 并非只承载提示词,而会吸收参考图的颜色、风格、场景等可语言化属性并影响生成;具体身份、人脸等像素精确信息则主要经图像到图像注意力直达输出,且跨模态绑定集中在文本 padding token。

PoseRefer: Pathway-Local Parameters for Semantically Grounded Reference Resolution Figure 1
2026-05-26cs.RO

PoseRefer: Pathway-Local Parameters for Semantically Grounded Reference Resolution

Anna Deichler

KTH Royal Institute of Technology, Stockholm, Sweden

2026-05-26三维

该文面向服务机器人在第三人称视角下理解“把杯子放到那个上面”等指代表达,指出现有3D grounding基准缺少自然共语手势。PoseRefer用MM-Conv数据构建姿态与文本无共享参数的后期融合,并将类别嵌入局部化以隔离消融;结果显示姿态更利于指向样本、文本更利于非指向样本,冻结MiniLM类别嵌入的融合Top-1达31.9%,较姿态单路提升13.1点。

Phase-Aware Wavelet-Based-Scattering Encoder-Decoder for Dense Predictions Figure 1
2026-05-26cs.CV

Phase-Aware Wavelet-Based-Scattering Encoder-Decoder for Dense Predictions

Ghassen Marrakchi, Basarab Matei

2026-05-26视觉感知

论文针对散射变换在分类中有稳定性但因全局平均/下采样丢失像素位置、难用于去噪和分割的问题,提出 stride-1 的相位感知散射编码器-解码器,用局部平滑保留平移等变性,并在跳连中显式传递幅值与相位。BSD68 去噪中,去除不变性带来 +2.17 dB,加入相位再增 +1.03 dB;相位空间打乱导致 −1.26 dB,支持相位携带位置结构信息,但 ISIC 分割仍属初步验证。

Catching MRI outliers: unsupervised detection and localization of MRI artefacts and clinical anomalies using deep learning Figure 1
2026-05-26cs.AI

Catching MRI outliers: unsupervised detection and localization of MRI artefacts and clinical anomalies using deep learning

Mustafa Kadhim, Viktor Rogowski, Emilia Persson, Camila Gonzalez, André Haraldsson, Sofie Ceberg, Mikael Nilsson, Malin Kügele, Sven Bäck, Christian Jamtheim Gustafsson

Medical Radiation Physics, Lund University, Lund, Sweden., Radiation Physics, Department of Hematology, Oncology, and Radiation Physics, Skåne University, Medical Radiation Physics, Department of Translational Medicine, Lund University, Malmö, Sweden, Medical University of Vienna Department of Anesthesia, Intensive Care Medicine, and Pain Therapy, Comprehensive Center for Artificial Intelligence in Medicine (CAIM), Centre for Mathematical Sciences, Lund University, Lund, Sweden, Department of Radiooncology, Rostock University Medical Center, Rostock, Germany

2026-05-26视觉感知

放疗流程中的自动分割、计划等模型容易被采集伪影、协议差异或临床异常等 MRI 分布外输入误导,本文将无异常 MRI 切片先离散化为 token,再学习正常 token 分布,并结合感知重建差异与 token 惊讶度生成异常热图。该无监督框架在盆腔与脑 MRI 上分别取得 AUC 0.97 和 0.81,热图与标注异常位置较一致,显示其可作为放疗 MRI 质控安全层。

Lattice theory and algebraic models for deep convolutional learning based on mathematical morphology Figure 1
2026-05-26cs.AI

Lattice theory and algebraic models for deep convolutional learning based on mathematical morphology

Gustavo (Jesus) Angulo

Mines Paris, PSL University, CMA-Center for Applied Mathematics, Sophia-Antipolis, France

2026-05-26学习理论

论文动机是为经验驱动的 CNN、ResNet 与 UNet 提供可检验的代数解释。核心创新是用格论、数学形态学和 MMBB 表示逐层重写卷积、ReLU、池化与跳连,指出标准卷积+ReLU+最大池化跨越不同格,既非形态学开运算也非幂等,从而解释深度带来的表示力。主要结果包括刻画三类真正幂等层,给出形态学 ResNet 收敛/发散结论,并提出以开运算残差重构尺度的 UResNet;经验增益文中未充分说明。

LC-Flow: Learning Local Continuous Optical Flow and Confidence from events Figure 1
2026-05-26cs.CV

LC-Flow: Learning Local Continuous Optical Flow and Confidence from events

Gunwoo Jeon, Chaesong Park, Jongwoo Lim

2026-05-26生成模型

针对事件相机光流中帧式累积带来延迟和域过拟合、局部方法又缺少时间记忆的问题,LC-Flow在每个局部网格维护连续更新的循环隐状态,可在任意时刻输出稀疏光流,并联合学习置信度以处理稀疏事件和孔径问题;置信度还用于多尺度聚合恢复全局光流。实验显示其在MVSEC、DSEC上达到局部方法SOTA,MVSEC聚合结果超过若干重型帧式密集网络,但DSEC上仍落后于强监督帧式方法。

Correcting Visual Blur Induced by Attention Distraction to Reduce Hallucinations: Algorithm and Theory Figure 1
2026-05-26cs.CV

Correcting Visual Blur Induced by Attention Distraction to Reduce Hallucinations: Algorithm and Theory

Quanjiang Li, Zhiming Liu, Wei Luo, Tingjin Luo, Chenping Hou

2026-05-26学习理论

本文针对多模态大模型在图像描述中产生物体幻觉的问题,指出其不只源于语言偏置,还与类似人类注意分散导致的视觉模糊有关,具体表现为多头注意的空间不一致和解码中视觉注意衰减。作者提出免训练的 AFIP,通过跨头注意增强、历史视觉注意动态融合和门控抑制无关区域,并给出注意分散削弱泛化的理论分析;多模型多基准实验显示其可降低幻觉且无需额外训练。

Self-supervised Dynamic Heterogeneous Degradation Modeling for Unified Zero-Shot Image Restoration Figure 1
2026-05-26cs.CV

Self-supervised Dynamic Heterogeneous Degradation Modeling for Unified Zero-Shot Image Restoration

XiaoWan Hu, Jing Yang, HeNan Liu, HuaQiu Li, Mai Xu

Beihang University, Tsinghua University

2026-05-26视觉感知

该文针对零样本图像复原在未知、混合退化下依赖隐式特征、采样成本高且固定扩散轨迹易陷入次优的问题,提出 UP-ZeroIR:将噪声、模糊、雾、低光等异质退化重参数化为少量物理一致的分布参数,并在潜空间做分布对齐,同时用质量反馈动态调整采样轨迹。实验显示其在单一与混合退化上优于现有方法,但具体增益对扩散先验与参数化设计的拆分仍需看消融细节。

Physen-Noise2Noise: Physics-Guided Self-Supervised Defocus Deblurring with Bias Correction under Low-Light Conditions Figure 1
2026-05-26cs.CV

Physen-Noise2Noise: Physics-Guided Self-Supervised Defocus Deblurring with Bias Correction under Low-Light Conditions

Ziyan Huang, Lang Wu, Hongji Wang, Yifei Liu, Dongliang Tang, Hongqiao Wang

2026-05-26视觉感知

针对低照度长曝光下离焦模糊与有偏、相关噪声共存,常规自监督去模糊的零均值噪声假设易失效。论文提出 Physen-Noise2Noise,将离焦成像的频域高频衰减约束嵌入 Noise2Noise,并用可学习噪声偏置与多帧噪声初始化联合校正偏差、恢复细节;还给出预训练—微调变体。仿真和真实数据实验显示,其在复杂有偏噪声场景下优于现有自监督方法。

World Models as Group Actions Figure 1
2026-05-26cs.CV

World Models as Group Actions

Zijie Wang, Wei Zhang, Weiming Zhang, Fanqi Zhang, Xiao Tan, Yipeng Qin, Guanbin Li

Sun Yat-sen University, Shenzhen Loop Area Institute, Baidu Inc., Cardiff University, Guangdong Key Laboratory of Big Data Analysis and Processing

2026-05-26强化学习

本文针对视频世界模型“画面真实但未必按动作演化”的问题,提出用动作的群结构刻画动作忠实性:在导航中将动作视为 SE(2) 群作用,并用潜空间正则约束恒等、逆元与组合一致性,同时构造 GAC/GAR 指标评估。实验显示该方法在多个视频世界模型上降低结构不一致和随机 rollout 不稳定性,且基本不损害感知质量。

PILOT: Policy-Informed Learned Optimization for Adaptive Deep Network Training Figure 1
2026-05-26cs.LG

PILOT: Policy-Informed Learned Optimization for Adaptive Deep Network Training

Sattam Altuuaim, Lama Ayash, Muhammad Mubashar, Naeemullah Khan

King Abdullah University of Science and Technology (KAUST), Thuwal, Saudi Arabia, University of Strathclyde, Glasgow, Scotland

2026-05-26强化学习优化算法

针对 Adam、Lion 等优化器更新结构在训练前固定、难以响应梯度稳定性变化的问题,PILOT 用相邻梯度方向一致性作为在线信号,通过小型多项式策略动态调节动量、方差归一化和符号更新比例,在 Adam 式、原始梯度和 sign 更新间插值。FashionMNIST/CIFAR-10 上的 CNN 与 ResNet-18 实验报告其准确率最高,但验证仍限于较小视觉分类任务,大规模与非卷积场景效果文中未充分说明。

EMA: Effort Metric Attention for Anatomical Effort-Guided Human Motion Diffusion Figure 1
2026-05-26cs.CV

EMA: Effort Metric Attention for Anatomical Effort-Guided Human Motion Diffusion

Joshua Siy, Huakun Liu, Yutaro Hirao, Monica Perusquia-Hernandez, Hideaki Uchiyama, Kiyoshi Kiyokawa

Nara Institute of Science and Technology, Ikoma, Nara, Japan

2026-05-26生成模型

本文针对文本到人体动作扩散模型难以精确控制速度、力度且常生成单调动作的问题,引入受 Laban 动作分析启发的 EMA 机制,用峰值关节位移和整体关节位移作为数值化努力信号,通过交叉注意力注入骨架感知潜空间扩散模型,并支持身体部位级调节。实验与用户研究显示,设定的努力强度与生成动作动力学及感知 LMA 描述基本呈单调一致。

PEDESTRIANQA: A Benchmark for Vision-Language Models on Pedestrian Intention and Trajectory Prediction Figure 1
2026-05-26cs.CV

PEDESTRIANQA: A Benchmark for Vision-Language Models on Pedestrian Intention and Trajectory Prediction

Naman Mishra, Shankar Gangisetty, C. V. Jawahar

2026-05-26视觉语言视觉感知规划控制数据集/基准

面向自动驾驶中行人意图与轨迹预测缺乏统一多模态推理和可解释性的痛点,PedestrianQA将PIE、JAAD、TITAN、IDD-PeD等行人视频序列改写为带结构化理由的问答任务,覆盖空间、时间、场景和自车交互线索,使VLM同时预测与解释。实验显示,在该数据上微调的VLM可提升过街意图分类、轨迹预测精度和理由质量,但具体增益中数据规模与模型能力的贡献仍需进一步区分。

IQA-Spider: Unifying Multi-Granularity Image Quality Assessment with Reasoning, Grounding and Referring Figure 1
2026-05-26cs.CV

IQA-Spider: Unifying Multi-Granularity Image Quality Assessment with Reasoning, Grounding and Referring

Xinge Peng, Yiting Lu, Xin Li, Zhibo Chen

2026-05-26视觉语言视觉感知

现有基于 LMM 的图像质量评估多停留在全局描述或单一 grounding,难以定位局部失真并保持推理能力。IQA-Spider 将全局/局部描述、像素级 grounding 与区域 referring 统一为四类任务,构建 IQA-Spider-33K,并用两阶段训练加无需额外监督的 text-to-point grounding 连接文本 logits 与 SAM 点提示。实验称在自建基准、Q-Bench-A1 和 Q-Ground-Test 上表现更强,但具体增益中数据构造与框架设计的相对贡献仍需进一步拆分。

No Figure
2026-05-26cs.CV

Learnable Shape Prototypes with Occlusion-Geometry-Guided Injection for Amodal Instance Segmentation

Fufan Zhang, Jingxiang Wang, Xiangjie Ye

2026-05-26视觉感知

针对无模态实例分割中遮挡区域缺少像素证据、现有形状先验要么受离散码本容量限制要么依赖昂贵生成模型且空间注入一刀切的问题,论文提出 GRASP:用可学习形状原型经交叉注意力组合成实例自适应先验,并用可见掩码 SDF 按遮挡深度门控注入。两项基准上其在多设置超过既有方法,其中一项遮挡区 mIoU 提升超过 11 个百分点,同时参数约为对比方法三分之一。

Image-Conditioned Instance Prompt Network for Referring Remote Sensing Image Segmentation Figure 1
2026-05-26cs.CV

Image-Conditioned Instance Prompt Network for Referring Remote Sensing Image Segmentation

Biaoyu Ren (1), Qingsheng Wang (1), Cun Xu (1), Dingkang Yang (2), Wenxuan Wang (1 and 3) ((1) School of Computer Science, Northwestern Polytechnical University, Xi'an, China, (2) College of Intelligent Robotics and Advanced Manufacturing, Fudan University, Shanghai, (3) Shenzhen Research Institute of Northwestern Polytechnical University, Shenzhen, China)

† Equal contribution. ∗ Corresponding authors.Code available at: https://github.com/Ren-by/ICIPNet .

2026-05-26视觉感知

本文针对遥感指代表达分割中语言描述粒度不足、语义漂移和常规跨注意力易引入背景/高频词噪声的问题,提出 ICIPNet:由图像上下文动态生成实例提示,使语义提示随不同影像和层级自适应调整,并用 BIF 在 token 与通道维度进行双向融合和重建以抑制噪声。实验在 RefSegRS 与 RRSIS-D 上优于已有 RRSIS 方法,达到 SOTA。

NudgeVAD: Language-Nudged End-to-End Driving via FiLM Residuals Figure 1
2026-05-26cs.CV

NudgeVAD: Language-Nudged End-to-End Driving via FiLM Residuals

Chieh-Chi Yang, Yu-Hsiang Chen, Yi-Ting Chen

National Yang Ming Chiao Tung University

2026-05-26视觉感知

论文关注端到端驾驶中“语言指令为何有时无效”:强 VAD 规划器已有可靠高层命令时,语言与命令存在冗余。NudgeVAD 冻结 VAD,仅用 LLaMA/LoRA 语言分支经 FiLM 预测轨迹残差,并用恒等初始化避免扰动原规划器。实验显示可靠命令下语言相对无条件微调几乎只带来 0.003m ADE 增益;随机命令下文本可将 ADE 从 3.166m 降至 2.806m,并优于无语言微调 0.312m。

Unveil: Unified Visual-Textual Integration and Distillation for Multi-modal Document Retrieval Figure 1
2026-05-26cs.CL

Unveil: Unified Visual-Textual Integration and Distillation for Multi-modal Document Retrieval

Hao Sun, Yingyan Hou, Jiayan Guo, Bo Wang, Chunyu Yang, Jinsong Ni, Yan Zhang

State Key Laboratory of General Artificial Intelligence, Peking University, Beijing, China, School of Intelligence Science and Technology, Peking University, Aerospace Information Research Institute, Chinese Academy of Sciences, Key Laboratory of Target Cognition and Application Technology, Beijing Institute of Technology, 6Ucap Cloud, ument representations. (2) Soft Label Distillation: We, utilize the teacher model to provide a fine-grained label

2026-05-26视觉感知

面向真实文档检索中 OCR 文本管线丢布局、纯视觉方法又难捕捉细粒度语义的问题,Unveil 先训练融合页面截图与 OCR 文本的视觉-文本嵌入模型,再通过表示对齐、软标签蒸馏和自适应重加权把语义能力迁移到仅视觉模型。12 个文本密集与视觉密集数据集实验显示,融合模型优于既有文本或视觉方法,蒸馏后在免解析推理下缩小性能差距并提升效率。

Φ-Noise: Training-Free Temporal Video Conditioning via Phase-Based Noise Manipulation Figure 1
2026-05-26cs.CV

Φ-Noise: Training-Free Temporal Video Conditioning via Phase-Based Noise Manipulation

Ofir Abramovich, Nadav Z. Cohen, Adi Rosenthal, Ariel Shamir

Canvas-Lab, Department of Computer Science, Reichman University

2026-05-26机器人视觉感知

针对视频扩散模型用文本难以精确控制运动、现有视觉/时序条件方法常需额外训练或推理开销的问题,本文提出 Φ-Noise:在扩散前对噪声做傅里叶分解,将参考视频的低频相位注入噪声并保持能量归一,从而把粗结构和时序动态作为先验传递。实验展示其可用于运动条件、空间条件和 cut-and-drag 生成,在不改模型与流程的情况下达到与复杂方法相当或更好的控制效果;但对真实机器人任务的直接收益文中未充分说明。

FDDet: Achieving Data-Efficient Food Defect Detection Under Real-World Scenarios Figure 1
2026-05-26cs.CV

FDDet: Achieving Data-Efficient Food Defect Detection Under Real-World Scenarios

Ruihao Xu, Yong Liu, Yansong Tang

2026-05-26视觉感知强化学习

面向真实食品质检中缺陷类别细、标注稀缺且场景复杂的问题,本文构建了含13类食品、48类缺陷和实例框标注的FDD-48基准,并提出半监督FDDet:用BBoxMixUp在同类缺陷框内混合以削弱背景/外观伪相关,用CGPC从上下文、视觉和空间一致性校准伪标签。实验显示通用检测器在该数据上易过拟合,而FDDet在有限标注与未标注数据下取得明显优于主流检测器的表现。

FoodMonitor: Benchmarking MLLMs for Explainable Compliance Analysis Figure 1
2026-05-26cs.CV

FoodMonitor: Benchmarking MLLMs for Explainable Compliance Analysis

Ruihao Xu, Xingming Shui, Jingxuan Niu, Yiqin Wang, Jilin Yu, Haoji Zhang, Yansong Tang

2026-05-26数据集/基准

针对现有视频异常检测多停留在“正常/异常”分类、难以支撑食品安全合规追责的问题,FoodMonitor提出商用厨房可解释合规分析基准,包含477段视频和3307个违规标注,区分人员与环境两类,并要求规则映射、行为解释和框级责任人定位。论文还设计结构化JSON输出、两阶段匹配与综合C_score评估。多种MLLM测试显示最佳仅0.360,瓶颈主要在空间定位和细粒度规则理解。

EgoAdapt: A Multi-Scene Egocentric Adaptation Method for CVPR 2026 HD-EPIC VQA Challenge Figure 1
2026-05-26cs.CV

EgoAdapt: A Multi-Scene Egocentric Adaptation Method for CVPR 2026 HD-EPIC VQA Challenge

Zhiwei Chen, Yupeng Hu, Zixu Li, Zhiheng Fu, Guozhi Qiu, Weili Guan, Liqiang Nie

Shandong University, Harbin Institute of Technology (Shenzhen)

2026-05-26视觉感知

针对 HD-EPIC 第一视角厨房 VQA 中不同问题对时间跨度、空间线索和语义推理需求差异很大的问题,EgoAdapt 将难点归因于通用推理配置与异质任务不匹配。方法在推理时按类别选择提示、帧预算和采样率,并结合候选项似然校准、生成一致性及选项置换/验证式 TTA 消歧。在 Qwen3-VL-8B 权重固定下,整体准确率达 67.22%,较 DeepFrames 提升 23.01 个百分点,TTA 消融显示其贡献约 10 个百分点。

EgoAction: Egocentric Action Composition with Reliability-Aware Temporal Fusion for the EPIC-KITCHENS Action Detection Challenge at CVPR 2026 Figure 1
2026-05-26cs.CV

EgoAction: Egocentric Action Composition with Reliability-Aware Temporal Fusion for the EPIC-KITCHENS Action Detection Challenge at CVPR 2026

Zhiheng Fu, Zixu Li, Zhiwei Chen, Fangxu Liu, Yupeng Hu, Weili Guan, Liqiang Nie

Shandong University, Harbin Institute of Technology (Shenzhen)

2026-05-26视觉感知

面向 EPIC-KITCHENS 长时第一视角视频中动作边界易偏移、动词与名词线索失效模式不同的问题,EgoAction 将动作检测拆成动词/名词两路因果时序检测,再用 top-K 组合生成动作,并以分类置信度动态加权融合两路边界,避免固定平均放大定位误差。官方 2026 榜单上取得 25.94 action mAP,verb/noun mAP 分别为 28.66/28.61。

Med-R2: An Adversarial Benchmark for Evidence-Grounded Reasoning in Medical VLMs Figure 1
2026-05-26cs.CV

Med-R2: An Adversarial Benchmark for Evidence-Grounded Reasoning in Medical VLMs

Wen Ma, Fucheng Niu, Zhiting Fan, Zikai Xiao, Jiaxiang Liu, Zuozhu Liu

Zhejiang University, Zhejiang, China, Guangdong Institute of Intelligence Science and Technology

2026-05-26视觉语言数据集/基准

针对医学 VLM 只看最终答题准确率、难以判断是否依据影像证据推理的问题,Med-R2 构建了按临床流程分层的对抗基准,覆盖图像质量、解剖、病灶到报告生成,并用正/中/负干扰检验鲁棒性。对 14 个模型的评测显示,性能随推理层级递减,病灶级是主要瓶颈;模型易受提示偏置影响,即使有显式视觉线索也常难以精确对齐文本。分步微调能提升鲁棒性,但真实临床场景和 3D 数据适用性仍有限。

Appearance-Invariant Detection of Suggestive Motion via Laban Movement Descriptors on SMPL Skeletons Figure 1
2026-05-26cs.CV

Appearance-Invariant Detection of Suggestive Motion via Laban Movement Descriptors on SMPL Skeletons

Jaehoon Ahn, Jeonghan Kong, Moon-Ryul Jung

Sogang University, Sogang University Seoul South Korea

2026-05-26视觉感知

针对3D社交/虚拟环境中传统NSFW检测过度依赖外观、难以识别“动作本身”挑逗性的盲点,论文将视频重建为SMPL骨架,用Laban运动分析的可解释描述子表征动作质感,并在无像素、服装和体型信息下分类日常、艺术、挑逗、露骨四级动作。逻辑回归在20,514段运动上取得57.3%四分类、72.1%三分类和78.7% SFW/NSFW二分类准确率,主要混淆集中在艺术与挑逗相邻层级。

OmniEgo-R$^2$: A Routed Reasoning Framework for the 1st Cross-Domain EgoCross Challenge at CVPR 2026 Figure 1
2026-05-26cs.CV

OmniEgo-R$^2$: A Routed Reasoning Framework for the 1st Cross-Domain EgoCross Challenge at CVPR 2026

Zixu Li, Zhiwei Chen, Zhiheng Fu, Wenbo Wang, Yupeng Hu, Weili Guan, Liqiang Nie

Shandong University, Harbin Institute of Technology (Shenzhen)

2026-05-26视觉感知

论文针对 EgoCross 中第一视角视频跨手术、工业、极限运动和动物视角时出现的时间边界模糊、语义粒度不一致与近似选项不稳定问题,提出 OmniEgo-R²:在 Qwen3-VL-4B-SFT 上叠加测试时路由推理,包括时间证据归一化、能力路由、结构化推理、选项验证和答案校准;在 Source-Limited 与 Open-Source 赛道分别达到 66.35% 和 66.77% 总准确率,均获第二名。

Robust Fuzzy Multi-view Learning under View Conflict Figure 1
2026-05-26cs.CV

Robust Fuzzy Multi-view Learning under View Conflict

Siyuan Duan, Yuan Sun, Dezhong Peng, Yingke Chen, Xi Peng, Peng Hu

Siyuan Duan, Yuan Sun, and Peng Hu are with the College of Computer, Science, Sichuan University, Chengdu 610065, China., Dezhong Peng is with the College of Computer Science, Sichuan University, Chengdu 610065, China, and also with the Tianfu Jincheng Laboratory, Yingke Chen is with the Department of Computer and Information Sciences, Northumbria University, Newcastle upon Tyne NE1 8ST, UK, Xi Peng is with the School of Artificial Intelligence, Sichuan University, views [14], label noise [15], and view adversarial attacks [16]., methods generally assume that the available views of an

2026-05-26安全鲁棒

针对多视图分类在传感器故障、恶劣天气等场景中出现视图冲突,既误导融合又低估不确定性的问题,论文提出基于模糊集的 R-FUML:用类别隶属度与可信度估计不确定性,并通过 RMF 降权高不确定/冲突视图、RLVC 利用记忆效应识别并惩罚冲突样本。八个公开数据集上相较 15 个基线提升了鲁棒性和不确定性估计。

TempRet: Temporal Enhancement and Two-Stage Reranking for CVPR 2026 EPIC-KITCHENS-100 Multi-Instance Retrieval Challenge Figure 1
2026-05-26cs.CV

TempRet: Temporal Enhancement and Two-Stage Reranking for CVPR 2026 EPIC-KITCHENS-100 Multi-Instance Retrieval Challenge

Zixu Li, Yupeng Hu, Zhiwei Chen, Zhiheng Fu, Xiaowei Zhu, Weili Guan, Liqiang Nie

Shandong University, Harbin Institute of Technology (Shenzhen)

2026-05-26视觉感知

针对第一视角厨房视频检索中仅逐帧使用 CLIP 难以刻画动作时序、且 EK-100 MIR 采用软相关标签的问题,TempRet 在 CLIP 双编码器上加入视频侧轻量时序 Transformer,并用 SMS Loss 学习分级相关性,推理时再以 cross-encoder ITM 对 Top-K 候选重排。其在官方榜单达到 67.97% 平均 mAP、82.92% 平均 nDCG;消融显示主要增益来自时序建模,重排带来较小但稳定提升。

Coarse-to-Fine Domain Incremental Learning with Attentive Distillation for Mining Footprint Segmentation in Multispectral Imagery Figure 1
2026-05-26cs.CV

Coarse-to-Fine Domain Incremental Learning with Attentive Distillation for Mining Footprint Segmentation in Multispectral Imagery

Alif Tri Handoyo, Vincent C.S. Lee, Rizka Widyarini Purwanto, Alex M. Lechner, Deanna Kemp, Muhamad Risqi U. Saputra

Monash University, Indonesia, Monash University, Australia, Northeastern University, China, The University of Queensland, Australia

2026-05-26视觉感知

针对矿区足迹精细分割中高质量边界标注稀缺、粗标注与精标注存在域偏移的问题,论文提出 MineC2FNet,以教师-学生框架在特征和预测层做注意力蒸馏,只选择性继承粗域中可靠知识并用少量精标注细化边界。作者还构建了219张专家验证多光谱数据集;实验显示其在精细域达到92.33% Accuracy、73.64% mIoU,优于多类域适应和增量学习基线。

EgoProx: Evaluating MLLMs on Egocentric 3D Proximity Reasoning Across a Cognitive Hierarchy Figure 1
2026-05-26cs.CV

EgoProx: Evaluating MLLMs on Egocentric 3D Proximity Reasoning Across a Cognitive Hierarchy

Jinzhao Li, Yinuo Chen, Dongxu Piao, Panwang Pan, Yifan Yu, Dong Wang, Honglei Yan, Liang Yue, Shaofei Wang, Yixin Chen, Siyuan Huang, Miao Liu

College of AI, Tsinghua University, State Key Laboratory of General Artificial Intelligence, BIGAI

2026-05-26三维

面向智能眼镜、AR与机器人中的第一人称感知行动耦合,本文指出现有VQA很少检验身体与物体的三维邻近推理,提出EgoProx基准,按意图、探索、利用和动作链组织任务,并用代理式数据引擎生成QA。实验显示主流MLLM经跨域或任务指令微调有明显增益,说明预训练含潜在空间知识,但仍难稳定用于空间推理VQA。

SILSM: A Sustainable Interactive Level Set Method for Progressive Refinement Figure 1
2026-05-26cs.CV

SILSM: A Sustainable Interactive Level Set Method for Progressive Refinement

Jiachen Song, Dazhi Zhang, Fanghui Song, Zhichang Guo, Shengzhu Shi

2026-05-26视觉感知

针对传统交互式水平集方法对标注位置和参数敏感、难以连续修正,以及深度交互分割依赖数据且多轮结果不稳定的问题,SILSM 将用户引导从分割能量中解耦为独立交互项,并引入四阶正则化稳定演化,配合多轮更新算法实现渐进细化。实验显示其首轮交互已有竞争力,对输入扰动较鲁棒,多轮交互下分割质量可稳定提升。

Benchmarking Composed Image Retrieval for Applied Earth Observation Figure 1
2026-05-26cs.CV

Benchmarking Composed Image Retrieval for Applied Earth Observation

Bill Psomas, Dionysis Christopoulos, Thanasis Petropoulos, Nikos Efthymiadis, Ioannis Kakogeorgiou, Ondřej Chum, Yannis Avrithis, Giorgos Tolias, Konstantinos Karantzalos

2026-05-26视觉感知数据集/基准三维

面向卫星档案检索中“参考图像+文字修改”比单模态查询更贴近灾害、设施和城市变化监测需求的问题,论文统一评测多种组合图像检索方法与六类视觉语言骨干,并提出面向灾损变化的 xView2-CIR。结果显示免训练组合方法已是强基线,但变化检索难点从属性匹配转向保持同一地点身份,易出现“灾害状态对、位置错”的失败。

No Figure
2026-05-26cs.CV

Artiverse: A Diverse and Physically Grounded Dataset for Articulated Objects

Denys Iliash, Jiayi Liu, Egor Fokin, Qirui Wu, Ali Mahdavi-Amiri, Manolis Savva, Angel X. Chang

Simon Fraser University

2026-05-26数据集/基准

现有关节物体数据集多停留在静态几何或单自由度运动,缺少可用于真实交互仿真的功能部件、运动依赖和物理属性。Artiverse从多源3D库构建5402个、88类人工物体,补全内部结构并标注多自由度关节、材料、尺度和质量,配合少样本分割、几何推理与人工复核将标注时间降低约三成。实验显示,用其训练可提升部件运动分析和关节物体生成的泛化,同时其复杂结构也暴露现有方法不足。

Dual Prototype-Conditioned Diffusion Model for Scalable Multi-Class Unsupervised Anomaly Detection in Large Category Spaces Figure 1
2026-05-26cs.CV

Dual Prototype-Conditioned Diffusion Model for Scalable Multi-Class Unsupervised Anomaly Detection in Large Category Spaces

Yaoxuan Feng, Yuxin Li, Weijiang Lv, Zixuan Zhao, Yubiao Wang, Wenchao Chen, Bo Chen, Hongwei Liu

2026-05-26视觉感知生成模型

面向类别数从十余类扩展到上百类时,多类无监督异常检测中正常分布异质化、表示混叠和重建“捷径”导致性能下降的问题,论文提出 DPDiff-AD,用局部原型聚合细粒度结构、全局原型经最优传输约束整体几何,并将双原型通过注意力条件化到扩散重建中。在五个基准验证,160 类 Real-IAD Variety 上较 Dinomaly+ 图像级和像素级 AUROC 分别提升 5.3、2.9 点,且推理约 101 FPS。

VectorArk: Learning Practical Image Vectorization with Rounded Polygon Representation Figure 1
2026-05-26cs.CV

VectorArk: Learning Practical Image Vectorization with Rounded Polygon Representation

Tarun Gehlaut, Difan Liu, Charu Bansal, Krutik Malani, Souymodip Chakraborty, Ankit Phogat, Matthew Fisher, Vineet Batra

2026-05-26视觉感知

论文针对现有 VLM 图像矢量化在干净合成渲染上表现好、遇到不同光栅化后端或文生图退化输入就失稳的问题,提出 VectorArk:用带顶点圆角半径的多边形表示替代冗长 SVG 命令,并采用轮廓优先、颜色后处理、退化合成训练和测试时多候选 DINO 排序。实验显示其在多数据集上几何完整性更好、伪影更少,但能力主要面向中等复杂图形。

SliceWorld: A Predictive and Controllable World-State Model for CT Report Generation Figure 1
2026-05-26cs.CV

SliceWorld: A Predictive and Controllable World-State Model for CT Report Generation

Yuanhe Tian, Yan Song

Zhongguancun Academy, University of Science and Technology of China

2026-05-26强化学习规划控制

针对CT报告生成常把三维体数据直接映射为文本、难以刻画轴向切片证据演化和病灶因素可控性的不足,SliceWorld将CT视为z轴有序序列,学习含解剖、病灶与不确定性的可预测世界状态,并通过未来切片特征预测、反事实病灶干预和LLM世界token生成报告。在M3D-Cap与CT-RATE上,方法提升NLG和临床自动评估指标,并显示多步预测、因素对齐、少切片鲁棒性与病灶敏感调制能力。

Gaussian Rank-Based Neighborhood Degree for Graph Neural Networks in Image Classification Figure 1
2026-05-26cs.CV

Gaussian Rank-Based Neighborhood Degree for Graph Neural Networks in Image Classification

Rafael Mendonça Duarte, Jean Roberto Ponciano, Lucas Pascotti Valem

2026-05-26视觉感知三维

针对图像半监督分类中由特征相似性构图的 GNN 仍用普通度归一化、默认邻居同等重要的问题,论文提出 GRaNDe:按邻居距离排序并用高斯核加权,将邻域质量纳入节点度,且可随训练中的表示更新自适应调整。该度量可直接替换 SGC、APPNP 等模型的标准度归一化;在五个公开图像分类数据集上,多数设置下带来稳定精度提升,并取得与近期方法相当或更好的结果。

SparseWorld: Enhancing End-to-End Autonomous Driving via World Models with Sparse Scene Representation Figure 1
2026-05-26cs.CV

SparseWorld: Enhancing End-to-End Autonomous Driving via World Models with Sparse Scene Representation

Ruoyu Wang, Jingke Wang, Yukai Ma, Yuehao Huang, Shuangming Lei, Guanglin Xu, Aixue Ye, Yong Liu

2026-05-26强化学习

针对现有自动驾驶世界模型依赖 dense BEV/视觉预测、计算开销大且信息冗余的问题,SparseWorld 将未来建模限制在关键交通参与者与地图元素等稀疏实例上,通过 Sparse Dreamer 自回归预测未来实例,并用其细化运动预测与规划、再自适应选择轨迹。实验显示其在 nuScenes 开环碰撞率降至 0.05%,相对 SparseDrive 降低 37.5%,在 Bench2Drive 闭环驾驶分数提升 9.9%。

ViViD-5K: Vineyard vision dataset for field-based berry detection and segmentation and grape cluster closure estimation Figure 1
2026-05-26cs.CV

ViViD-5K: Vineyard vision dataset for field-based berry detection and segmentation and grape cluster closure estimation

Xiangzhi Tong, Chengrui Zhang, Mac Flaherty, Andre Matteo Garcia, Dominic Gorman, Jonathan Jaramillo, Justine E. Vanden Heuvel, Yu Jiang

Horticulture Section, School of Integrative Plant Science, Cornell University, Ithaca, NY, USA., School of Electrical and Computer Engineering, Cornell University, NY, USA.

2026-05-26视觉感知数据集/基准

针对田间葡萄果串闭合度评估依赖人工打分、主观且缺少浆果级数据的问题,本文发布 ViViD-5K:含 5000 张田间图像、13 个品种、约64.8万浆果点和果串掩码,并提出结合点定位、SAM 提示分割与 Mask2Former 的 GrapeSAM 流水线。实验显示其在多条件下可较准确完成计数、果串/浆果分割和闭合度时序估计,但小目标和高密度遮挡仍是主要误差来源。

Causal Physics Steering in Video World Models via Concept Activation Vectors Figure 1
2026-05-26cs.CV

Causal Physics Steering in Video World Models via Concept Activation Vectors

Nahid Alam

Oreon Labs, Cohere Labs Community

2026-05-26视觉感知强化学习

面向世界模型在强化学习、自动驾驶等场景中需要可控物理预期的问题,本文提出无需训练的 physics steering:将 VideoMAE 物理涌现层中线性探针权重作为 CAV,在推理时注入隐藏状态。IntPhys 上可双向改变物理可行性判断,效果集中在 PEZ,且物理与运动方向近正交,物理子空间约由 2–3 个方向主导。

Unified 3D Scene Understanding Through Physical World Modeling Figure 1
2026-05-26cs.CV

Unified 3D Scene Understanding Through Physical World Modeling

Wanhee Lee, Klemen Kotar, Rahul Mysore Venkatesh, Jared Watrous, Honglin Chen, Khai Loong Aw, Daniel L. K. Yamins

Stanford University, without the need for finetuning by offering precise controllability, strong geomet-, real-world scenarios is difficult because it requires both flexibility and controllability. Most previous, Additionally, achieving strong controllability in generative models has been challenging, motivating, fied framework supporting diverse inference pathways while remaining precisely controllable. We, make this PGM practical and scalable, we formulate it as an autoregressive next token predictor, controllability, strong geometric consistency, and robustness in real-world scenarios, outperforming

2026-05-26强化学习三维

论文针对深度估计、新视角合成和物体操作长期割裂、难以共享物理一致三维表示的问题,提出 3WM:把 RGB、光流和相机位姿作为概率图节点,并用 GPT 式自回归与局部随机访问序列实现统一物理提示。不同任务由不同推理路径零样本产生;实验显示其在真实场景 NVS 和 3D 物体操作上优于专用基线,并支持相机/物体运动组合、遮挡补全和深度不确定性推理。

CoDA: Color Distribution Probing for Efficient and Generalizable AI-Generated Image Detection Figure 1
2026-05-26cs.CV

CoDA: Color Distribution Probing for Efficient and Generalizable AI-Generated Image Detection

Zexi Jia, Zhiqiang Yuan, Xiaoyue Duan, Jinchao Zhang, Jie Zhou, Anil K. Jain

Michigan State University, East Lansing, MI 48824, USA.

2026-05-26视觉感知

针对AI生成图像检测中轻量方法泛化差、VLM方法代价高且跨域评测不足的问题,本文构建含约37万张、62域的FakeForm基准,并提出利用生成图像颜色分布更不均匀这一线索的CoDA。其噪声-量化探针将颜色稳定性转为残差信号,1.48M参数即可检测;实验中跨模型摄影内容平均准确率91.0%,跨域平均77.7%,在效率与泛化间取得较好平衡。

ArtSplat: Feed-Forward Articulated 3D Gaussian Splatting from Sparse Multi-State Uncalibrated Views Figure 1
2026-05-26cs.CV

ArtSplat: Feed-Forward Articulated 3D Gaussian Splatting from Sparse Multi-State Uncalibrated Views

Inseo Lee, Yoonji Kim, Eugene Sohn, Jiwoong Lee, Jungmin You, Joonseok Lee, Jin-Hwa Kim

Seoul National University, Sogang University, NAVER AI Lab

2026-05-26三维

ArtSplat针对关节物体重建依赖密集多视角、相机标定和逐物体优化而难以扩展的问题,提出从稀疏多状态未标定RGB图像一次前向预测3D Gaussian与关节参数。其关键是按像素关节图表示,并用带状态token的跨状态注意力捕捉离散姿态差异。PartNet-Mobility上覆盖68个单双关节物体,几何与关节估计接近或优于基线,速度提升超过400倍。

Cross-Modal Action Recognition in Egocentric Video Using Mamba: Integrating RGB and Hand Skeleton Streams via CLS Token Fusion Strategies Figure 1
2026-05-26cs.CV

Cross-Modal Action Recognition in Egocentric Video Using Mamba: Integrating RGB and Hand Skeleton Streams via CLS Token Fusion Strategies

Juan Ignacio Bustos Gorostegui, Maria Elena Buemi

Faculty of Exact and Natural Sciences of the University of Buenos Aires

2026-05-26视觉感知

针对第一视角动作识别中相机抖动、手部遮挡和长序列建模成本高的问题,论文将 RGB 视频与手部骨架时序统一到线性复杂度的 Mamba 框架,重点比较四种利用预训练单模态 CLS token 的融合初始化策略。H2O 实验显示,多模态融合优于 VideoMamba 仅视频基线,其中简单平均策略最好,Tiny/Small 配置 Top-1 分别提升超过 10% 和 25%;更复杂的上下文加权未带来额外收益。

Plume Segmentation from MethaneSAT with Cross-Sensor Transfer Learning and Physics-Informed Postprocessing Figure 1
2026-05-26cs.CV

Plume Segmentation from MethaneSAT with Cross-Sensor Transfer Learning and Physics-Informed Postprocessing

Manuel Pérez-Carrasco, Maya Nasr, Zhan Zhang, Apisada Chulakadabba, Javier Roger, Raia Ottenheimer, Sébastien Roche, Maryann Sargent, Chris Chan Miller, Daniel Varon, Jack Warren, Luis Guanter, Kang Sun, Jonathan Franklin, Jia Chen, Cecilia Garraffo, Xiong Liu, Ritesh Gautam, Steven Wofsy

(XCH4). We address two core challenges: the scarcity of labeled, as false positives against our wavelet-based ground truth labels, methane enhancements excluded by conservative labeling crite-, Center for Astrophysics | Harvard & Smithsonian, Cambridge, MA, Department of Earth and Planetary Sciences, Harvard University, Cam-, Research Institute of Water and Environmental Engineering (IIAMA), Institute of Environmental Physics (IUP), University of Bremen, Bremen, John A. Paulson School of Engineering and Applied Sciences, Harvard, University, Cambridge, MA, USA, Department of Aeronautics and Astronautics, Massachusetts Institute of, Institute for Data, Systems, and Society, Massachusetts Institute of Tech-, Department of Civil, Structural and Environmental Engineering, Univer-

2026-05-26视觉感知

面向 MethaneSAT 标注稀缺且需可靠定位单个甲烷羽流的监测需求,论文将问题从像素语义分割转为实例分割,采用 MethaneAIR 跨传感器预训练微调,并加入物理启发后处理形成高召回与高精度两种模式。结果显示 Mask R-CNN/ResNet-50 优于 U-Net,微调策略实例召回达 0.98;后处理后高敏模式精度/召回为 0.71/0.94,高精模式为 0.92/0.70。

CRISP -- Clustering-Based Redundancy-Reduced Instance Sampling for Pathology Case Representation and Retrieval Figure 1
2026-05-26cs.CV

CRISP -- Clustering-Based Redundancy-Reduced Instance Sampling for Pathology Case Representation and Retrieval

Zahra Rahimi Afzal, Wataru Uegami, Saghir Alfasly, Saba Yasir, Judy C. Boughey, Matthew P. Goetz, Krishna R. Kalari, H.R. Tizhoosh

Kimia Lab, Department of Artificial Intelligence & Informatics, Mayo Clinic, Rochester, MN, USA, DICE Lab, Department of Electrical and Computer Engineering, University of Illinois Chicago, IL, USA, Department of Laboratory Medicine and Pathology, Mayo Clinic, Rochester, MN, USA, Department of Breast and Melanoma Surgical Oncology, Comprehensive Cancer Center, Mayo Clinic, Rochester, MN, USA, Department of Oncology, Comprehensive Cancer Center, Mayo Clinic, Rochester, MN, USA, Department of Quantitative Health Sciences, Mayo Clinic, Rochester, MN, USA

2026-05-26视觉感知

针对病理检索中常以单张病理医生选定 WSI 代表病例、易丢失多切片异质信息的问题,CRISP 提出无监督两阶段采样:先用 SPLICE 在单张 WSI 内去冗余,再跨全病例切片聚类选取紧凑代表 patch,直接构建病例级索引。在 Mayo 乳腺癌诊断与治疗队列上,其 Top-1/Top-3 检索通常达到或超过 Yottixel+病理医生选片,治疗反应预测也优于多种单 WSI 方法,但 Top-5 仍未完全超过最佳人工选片基线。

Rethinking Continual Anomaly Detection on the Edge: Benchmarking Under Realistic Industrial Conditions Figure 1
2026-05-26cs.LG

Rethinking Continual Anomaly Detection on the Edge: Benchmarking Under Realistic Industrial Conditions

Chad Weatherly, Sen Lin

2026-05-26视觉感知数据集/基准

本文针对工业边缘端持续异常检测评测不真实、缺少横向比较且忽视部署成本的问题,构建统一基准,加入结构/逻辑异常、连续漂移协议和Jetson端效率测试。核心洞察是现有CAD方法并不稳定优于带简单回放的传统AD;作者据此提出免训练DINOSaur,用冻结DINOv3、空间索引coreset和局部近邻评分实现零遗忘。结果显示其在五类协议中整体最优,Jetson Orin Nano推理低于100ms,新任务适配低于30秒。

GIBLy: Improving 3D Semantic Segmentation through an Architecture-Agnostic Lightweight Geometric Inductive Bias Layer Figure 1
2026-05-26cs.CV

GIBLy: Improving 3D Semantic Segmentation through an Architecture-Agnostic Lightweight Geometric Inductive Bias Layer

Diogo Lavado, Alessandra Micheletti, Clàudia Soares

NOVA School of Science and Technology, Portugal and, NOVA School of Science and Technology, Portugal

2026-05-26视觉感知三维

针对3D点云分割模型通常需依赖大模型和大量训练来隐式学习平面、圆柱等基础几何结构的问题,GIBLy提出一种可插拔、架构无关的轻量几何归纳偏置层,用可学习参数化几何先验生成可解释的形状对齐特征。实验覆盖MLP、卷积和Transformer骨干及多个基准,显示稳定提升;在TS40K上结合PTV3最高提升11.5% mIoU,仅增加约58K参数。

Radiuma: A Unified Zero-Code Executable Graphical Workflow Generator for Reproducible and Shareable Medical Image Analysis and Machine Learning Figure 1
2026-05-26cs.CV

Radiuma: A Unified Zero-Code Executable Graphical Workflow Generator for Reproducible and Shareable Medical Image Analysis and Machine Learning

Mohammad Salmanpour, Mehrdad Oveisi, Isaac Shiri, Arman Rahmim

Department of Basic and Translational Research, BC Cancer Research Institute, Vancouver, BC, Canada, Department of Radiology, University of British Columbia, Vancouver, BC, Canada, Technological Virtual Collaboration (TECVICO Corp.), Vancouver, BC, Canada, Department of Computer Science, University of British Columbia, Vancouver, BC, Canada, Department of Cardiology, Inselspital, Bern University Hospital, University of Bern, Bern, Switzerland, Department of Digital Medicine, University of Bern, Bern, Switzerland, Departments of Physics & Biomedical Engineering, University of British Columbia, Vancouver, BC, Canada, Department of Basic and Translational Research, BC Cancer Research Institute, available to the community, design provides a flexible platform for reliable, user-friendly image reading across, in medical image and machine learning analysis. This feature is particularly useful for collaborative research

2026-05-26视觉感知生成模型

针对医学影像组学/机器学习研究需串联多软件、流程难复现且不易共享的问题,Radiuma提出零代码的图形化可执行工作流生成器,将多模态读写、可视化、分割、配准融合、预处理、放射组学特征和分类/回归/聚类建模整合为可连接模块。主要结果是支持保存、运行与共享端到端流程并即时可视化中间输出,但文中未充分说明其相对现有工具的定量性能增益。

Single View Seafloor Recovery from Imaging Sonar via Differentiable Rendering Figure 1
2026-05-26cs.CV

Single View Seafloor Recovery from Imaging Sonar via Differentiable Rendering

Sevan Brodjian, Michael Hobley, Pietro Perona

California Institute of Technology

2026-05-26视觉感知

本文针对前视成像声纳将垂直结构压扁、单视角海底地形恢复高度歧义且多视角/传感器融合成本高的问题,提出无需训练的可微声纳渲染框架,在已知海底基准倾角下直接优化显式高度场匹配观测图像。实验显示其在分布外和传感器/地形变化下优于或接近监督 CNN,分布内则 CNN 更强;方法可在数十秒内重建,但遮挡与单视角歧义仍会导致高度低估。

Filtered Posterior Mean Collections: A Unified Framework for Analytical Models of Diffusion Generalization Figure 1
2026-05-26cs.LG

Filtered Posterior Mean Collections: A Unified Framework for Analytical Models of Diffusion Generalization

Matthew Niedoba, Berend Zwartsenberg, Frank Wood

\AFFS 1 University of British Columbia, Alberta Machine Intelligence Institute

2026-05-26生成模型学习理论

论文针对扩散模型神经去噪器在不同架构下呈现相似泛化偏置、但现有解析近似设计空间零散的问题,提出 FPMC 统一框架,用查询精度、响应权重和源分布三轴刻画基于后验均值聚合的去噪器。作者指出以往二值 patch 假设过硬,改用可学习软权重并增强源分布;在 CIFAR-10、FFHQ 和 AFHQ 64×64 上,相比既有 FPMC 更接近扩散模型样本。

Loki: Representation over Architecture for Diffusion-Based Portrait Animation Figure 1
2026-05-26cs.CV

Loki: Representation over Architecture for Diffusion-Based Portrait Animation

Pouyan Navard, Sernam Lim

The Ohio State University, University of Central Florida

2026-05-26生成模型

针对肖像动画中RGB条件把身份、表情和头姿纠缠在一起、需堆叠多种解耦模块的问题,Loki改用FLAME参数人脸模型生成身份无关的空间驱动图,将表情与姿态送入扩散骨干,并通过预训练特征注入参考身份。其关键洞察是用表示替代复杂架构,使跨身份重演在推理时成为参数替换,无需跨身份训练对;文中报告推理参数减少约43%、训练视频少1496倍,并在头姿轨迹和表情跟随指标上领先或并列领先。

EchoVQA: Enabling Conversational Assistance for Point-of-Care Cardiac Ultrasound Figure 1
2026-05-26cs.CV

EchoVQA: Enabling Conversational Assistance for Point-of-Care Cardiac Ultrasound

Filippos Bellos, Yutong Li, Jessie N Dong, Zaiyang Guo, Emily Mackay, Yayuan Li, Yannis Avrithis, Alison Pouch, Jason J. Corso

2026-05-26视觉感知

面向床旁心超中非专家难以采集和解读标准视图的问题,本文构建 EchoVQA:融合公开与手持探头数据,覆盖不同质量、视图分类、腔室可见性、LVEF 可测性及探头调整建议的多轮问答。作者还用多模态可学习提示做参数高效适配,在 EchoVQA 和多项医学 VQA 基准上达到或接近 SOTA,且可训练参数显著少于全量微调模型。

ImPartial: Multi-channel Whole-Cell Segmentation using Partial Annotations Figure 1
2026-05-26cs.CV

ImPartial: Multi-channel Whole-Cell Segmentation using Partial Annotations

Gunjan Shrivastava, Saad Nadeem

2026-05-26视觉感知

针对多通道病理/显微图像中密集像素标注昂贵、通道配置多变且噪声强的问题,ImPartial用少量前景/背景涂鸦训练U-Net,并将盲点自监督改为多通道量化插补/高斯混合分类损失,使重建目标更服务于前景背景分离和实例分割。在TissueNet、CPDMFCI与IHC实验中,10%–50%涂鸦即可接近或超过多种全监督基线;消融显示涂鸦损失与重建损失均必要。

COSY: Compositional 3DGS Synthesis for Disentangled Human Head Editing Figure 1
2026-05-26cs.CV

COSY: Compositional 3DGS Synthesis for Disentangled Human Head Editing

Florian Barthel, Shalini De Mello, Koki Nagano, Wieland Morgenstern, Anna Hilsmann, Peter Eisert

2026-05-26三维

针对3DGS头部GAN在发色、眼镜等属性编辑时易牵连身份和外观的问题,COSY将生成器拆成头发、皮肤/脸、眼镜、躯干等独立子分支,仅用稀疏颜色信息学习组件分离,并通过少量共享上下文token维持整体形状与光照一致。实验显示其在实时高分辨率头部合成中比既有GAN编辑方法解耦更好、控制更精确,同时保持有竞争力的视觉质量。

D2-V2X: Depth-Driven Cooperative V2X Reasoning for Autonomous Driving Figure 1
2026-05-26cs.CV

D2-V2X: Depth-Driven Cooperative V2X Reasoning for Autonomous Driving

Kevin Richard, Alphin Varghese, Colin Pham, David Oh, Srijan Das

University of North Carolina at Charlotte

2026-05-26视觉感知

论文针对单车 VLM 受遮挡和视角限制、现有 V2X 问答缺少协同三维推理的问题,提出 D2-V2X:基于车端与路侧相机/融合 LiDAR 的 8,500 条 QRA 数据,并用 CoT 理由约束模型先解释空间关系再输出结构化决策。其基线将 CenterPoint 3D 特征对齐到 Qwen3-VL,遮挡危险召回达 24.4%、可见物距离误差降 77%、决策 F1 为 53.5,同时指出 3D 到 2D 投影仍是主要瓶颈。

WideDepth: Millimeter-Accurate Benchmark for Fisheye Depth Estimation Figure 1
2026-05-26cs.CV

WideDepth: Millimeter-Accurate Benchmark for Fisheye Depth Estimation

Ilia Indyk, Ignat Penshin, Ivan Sosin, Maxim Monastyrny, Aleksei Valenkov, Ilya Makarov

AXXX, Moscow, Russia 3 Trusted AI Research Center, RAS, Moscow, Russia

2026-05-26数据集/基准

面向机器人近场操作与室内导航中鱼眼相机缺少高精度深度基准的问题,WideDepth构建了101个室内场景、5K高分辨率双目样本,提供毫米级稠密深度/视差,并覆盖不同FOV、基线、水平与垂直双目及针孔配对。论文还用高精度LiDAR扫描和Double Sphere模型生成鱼眼立体数据,支持针孔模型适配;在多类深度模型评测中,18K稀疏LiDAR训练样本微调使鱼眼性能最高提升62%。

Distance-Aware Joint Spatio-Temporal Graph Contrastive Learning for Major Depressive Disorder Diagnosis Figure 1
2026-05-26cs.CV

Distance-Aware Joint Spatio-Temporal Graph Contrastive Learning for Major Depressive Disorder Diagnosis

Muhammad Asif Hasan, Yanming Zhu, Xuefei Yin, Alan Wee-Chung Liew

2026-05-26视觉感知

本文针对 rs-fMRI 动态功能连接在抑郁症诊断中易受滑窗相关噪声、节点特征单一和时空建模割裂影响的问题,提出 HWSTCL:用频谱 ROI 描述符、距离衰减边可靠性修正和 Hawkes 式跨窗连接构建联合时空图,并以匹配的核加权对比学习强化区域时间一致性。实验显示其优于近期基线,但具体增益在多大程度来自各组件仍需消融支撑。

fMRI-Diffusion: Generating fMRI Time Series Via a Temporal Transformer Diffusion Model for Major Depressive Disorder Diagnosis Figure 1
2026-05-26cs.CV

fMRI-Diffusion: Generating fMRI Time Series Via a Temporal Transformer Diffusion Model for Major Depressive Disorder Diagnosis

Muhammad Asif Hasan, Yanming Zhu, Xuefei Yin, Alan Wee-Chung Liew

2026-05-26生成模型

针对 MDD 诊断中标注 fMRI 稀缺、传统增强只生成 FC 矩阵而丢失时序结构的问题,论文提出 fMRI-Diffusion:先用带监督预训练的 Temporal Transformer 作为 DDPM 去噪器合成 ROI 级 fMRI 时间序列,再计算 FC 用于分类。在 REST-meta-MDD 上,该增强在 10 个分类器、6 种脑图谱和 3 个站点均提升诊断表现,较最强 FC 合成基线最高提升 3.7 个百分点,分布差异指标低于 0.06。

EMMA: Extracting Multiple physical parameters from Multimodal Data Figure 1
2026-05-26cs.CV

EMMA: Extracting Multiple physical parameters from Multimodal Data

Farhat Shaikh, Ayan Banerjee, Sandeep Gupta

IMPACT Lab, School of Computing, Arizona State University

2026-05-26视觉语言

针对仅靠视频难以观测受遮挡状态、隐藏驱动和未知坐标/初值而导致物理参数反演不适定的问题,EMMA将视频、音频与图表时序统一到物理约束的连续时间模型中,用LTC学习潜在动力学并联合估计显式参数、隐式动力项和校准不变量。在100多个场景、75个Delfys视频及真实 rover/四旋翼等实验中,文中报告其多参数恢复优于单模态和方程发现基线。

Learning to See Like Humans: Gaze-Aligned Cycling Safety Prediction Figure 1
2026-05-26cs.CV

Learning to See Like Humans: Gaze-Aligned Cycling Safety Prediction

Luís Maria Perdigão, Miguel Costa, Carlos Santiago, Manuel Marques

comparisons of street-view images provide a scalable way to, Institute, Technical University of Denmark, Kongens Lyngby, Denmark., enable scalable ranking of environments, they do not explicitly, • We make available a dataset of 13,623 labeled pairwise, level imagery, with near-global coverage becoming available, further improve scalability by letting models learn relevant, localizing safer/unsafe areas [11], [24], [22] through scalable

2026-05-26安全鲁棒

城市骑行推广受“看起来是否安全”的主观感知限制,而仅用街景成对比较训练的模型难解释其关注区域。论文提出 EG-PCS-Net,在孪生 ViT 的成对安全排序中加入眼动监督,使自注意力与人类注视对齐。结果显示其分类/排序性能与强基线相当或略有稳定提升,但在 AUC、NSS、CC、EMD 等显著改善注意力— gaze 一致性,主要贡献在可解释性而非大幅精度跃升。

Mode-as-Sequence: Translating Multimodal Motion Prediction into Unified Sequential Mode Modeling Figure 1
2026-05-26cs.CV

Mode-as-Sequence: Translating Multimodal Motion Prediction into Unified Sequential Mode Modeling

Zikang Zhou, Haibo Hu, Xinhong Chen, Yifan Zhang, Nan Guan, Yung-Hui Li, Chun Jason Xue, Jianping Wang

City University of Hong Kong, City University of Hong Kong (Dongguan), Hon Hai Research Institute, Mohamed bin Zayed University of Artificial Intelligence

2026-05-26视觉语言

针对自动驾驶多模态轨迹预测中单一真实未来导致的模式坍缩、候选重复和置信度排序不稳,论文将无序轨迹模式改写为有序“模式序列”,用 ModeSeq 建模模式间依赖,并以 Parallel ModeSeq 通过因果掩码注意力并行解码;配合 EMTA/MA-EMTA 和排序正则提升覆盖与校准。实验显示其在多数据集、预测时域和目标类型上改进 best-of-K 与排序指标,并分别获得 Waymo 2024 LiDAR-free 运动预测和 2025 交互预测挑战第一。

Towards Large Model Feature Coding Figure 1
2026-05-26cs.CV

Towards Large Model Feature Coding

Youwei Pang, Changsheng Gao, Dong Liu, Huchuan Lu, Weisi Lin

2026-05-26视觉感知

论文针对大模型分布式/拆分执行中间特征传输与存储成本高、且特征形态远比传统 CNN 激活更异构的问题,提出将大模型特征编码(LaMoFC)作为独立基础问题,并构建覆盖4类16场景的 LaMoFCBench,统一拆分点、码率、失真与下游任务评测。基准结果显示,现有通用特征编码器与多模态、多层级、KV/缓存等大模型特征分布明显不匹配,说明该方向需要新的编码范式。

No Figure
2026-05-26cs.CV

Mitigating Hallucinations in Large Vision-Language Models via Causal Route Gating

Zhe Cheng, Wenyu Chen, Fode Zhang, Dehuan Shen

2026-05-26视觉语言视觉感知

针对大视觉语言模型即使关注图像仍会被文本先验主导、产生不受图像支持的幻觉这一问题,论文提出无需训练的 Causal Route Gating:在注意力头内拆分视觉/文本路由,用一次前向加一次梯度估计当前 token 的因果效应,识别冲突且文本主导的头,只抑制文本路由而保留视觉证据。五个判别与生成基准上,该方法降低多模型幻觉相关错误,对整体多模态性能影响有限,但需白盒梯度且有解码开销。

Soft Tuy-Completeness for Robust Projection Selection in Cone-Beam CT Figure 1
2026-05-26cs.CV

Soft Tuy-Completeness for Robust Projection Selection in Cone-Beam CT

Linda-Sophie Schneider, Andreas Maier

Pattern Recognition Lab, Friedrich-Alexander-Universität Erlangen-Nürnberg, Germany

2026-05-26安全鲁棒

针对ROI锥束CT中传统Tuy完备性过于二值、难以在遮挡和投影预算约束下指导选角的问题,论文提出连续的软近正交评分与分辨率感知饱和覆盖目标,并用子模贪心和MILP给出近似与最优性证书。实验覆盖6个目标区和多种遮挡条件,贪心/MILP目标中位比达0.998,ESR指标也与重建质量稳定相关。

Machine Intelligence that Understands Visual and Linguistic Information and Interacts with Humans and Environments Figure 1
2026-05-26cs.CV

Machine Intelligence that Understands Visual and Linguistic Information and Interacts with Humans and Environments

Van Quang Nguyen

2026-05-26视觉感知

本文面向让智能体同时理解视觉与语言并与环境交互的目标,围绕图像描述、视觉对话和交互式指令执行三类任务展开。核心做法包括用GRIT融合网格与区域特征并以DETR替代Faster R-CNN、用轻量LTMI建模多输入交互,以及在ALFRED中采用两阶段指令解析、多视角和层级注意力。结果显示图像描述在精度和速度上优于既有方法,VisDial验证有效,ALFRED未见场景成功率达8.37%。

MGVQ: Synergizing Multi-dimensional Sensitivity-Aware and Gradient-Hessian Fusion for Vector Quantization Figure 1
2026-05-26cs.CV

MGVQ: Synergizing Multi-dimensional Sensitivity-Aware and Gradient-Hessian Fusion for Vector Quantization

Zhong Wang, Zukang Xu, Xing Hu, Dawei Yang

2026-05-26优化算法

面向大规模视觉语言模型在边缘设备上难以部署的问题,MGVQ关注超低比特向量量化中的两类误差来源:图文模态导致的权重异质性,以及仅用 Hessian 补偿时忽略一阶梯度漂移。方法通过全局/局部敏感度做结构化混合精度分配,并融合梯度与 Hessian 进行误差补偿。实验在 LLaVA-OneVision、InternVL2、Qwen2-VL 等模型上验证,2-bit 下相对现有 PTQ 方法最高提升约 4.9 个点。

SkySeg: Collaborative Onboard Semantic Segmentation with Heterogeneous UAVs in the Wild Figure 1
2026-05-26cs.CV

SkySeg: Collaborative Onboard Semantic Segmentation with Heterogeneous UAVs in the Wild

Anqi Lu, Yun Cheng, Youbing Hu, Zhiqiang Cao, Jie Liu, Zhijun Li

2026-05-26视觉感知

面向灾害监测等需机载实时语义分割的无人机场景,SkySeg针对单机算力受限和野外分布漂移问题,提出异构多无人机空空协同框架:高空领机获取低清广域图像,低空从机采集高清局部图像,并通过信息融合推理与跨设备测试时自适应联合提升效率和鲁棒性。实验显示其推理延迟约加速3.6倍,机载分割精度提升5.91%,野外平均精度增益10.91%。

Deep Learning-Based Automated Quantification of TIMI Myocardial Perfusion Frame Count (DL-TMPFC) from Coronary Angiography: A Novel Framework for Rapid Assessment of Microvascular Dysfunction Figure 1
2026-05-26cs.CV

Deep Learning-Based Automated Quantification of TIMI Myocardial Perfusion Frame Count (DL-TMPFC) from Coronary Angiography: A Novel Framework for Rapid Assessment of Microvascular Dysfunction

Si Li, Yuanqing He, Chenkai Hu, Xiaogang Guo, Huay-Cheem Tan, Chieh Yang Koo, Xuan Zhang, Lei He, Jingyuan Zeng, Shan Xiao

School of Artificial Intelligence and Digital Economy Industry, Guangzhou Institute of Science and Technology, Guangzhou, China, Department of Cardiology, Second Affiliated Hospital, Jiangxi Medical College, Nanchang University, Nanchang, China., Department of Cardiology, First Affiliated Hospital of Zhejiang University School of Medicine, Hangzhou, China., Department of Cardiology, National University Heart Centre, Singapore., reference standards but are constrained by complexity, cost, and limited availability2. The TIMI Myocardial, calculation requires frame-by-frame identification of contrast entry and clearance. It is a labor-intensive, observer-, intervention (PCI) at the Second Affiliated Hospital of Nanchang University (Nanchang, China), the First Affiliated, Hospital of Zhejiang University School of Medicine (Hangzhou, China) and the National University Heart Centre

2026-05-26视觉感知

针对冠脉微血管功能障碍诊断依赖侵入式检查或主观 TIMI 分级、手工 TMPFC 费时且观察者相关的问题,论文提出 DL-TMPFC:先用狭窄检测排除阻塞性 CAD,再以冠脉供血区域分割和帧选择模块自动计算造影剂灌注帧数。在三中心 655 例数据上,其与专家手工测量高度一致(偏差 -0.93 帧,r=0.98),并可用于 CMVD 识别和连续严重度量化。

ActQuant: Sub-4-bit Action-Guided Quantization for Vision-Language-Action Models Figure 1
2026-05-26cs.CV

ActQuant: Sub-4-bit Action-Guided Quantization for Vision-Language-Action Models

Arash Akbari, Arman Akbari, Masih Eskandar, Qitao Tan, Yixiao Chen, Jingwu Luo, Bertha Pangaribuan, Liyun Zhang, Jennifer Dy, Geng Yuan, Xue Lin, Gaowen Liu, Stratis Ioannidis, Yanzhi Wang

2026-05-26视觉语言视觉感知

面向VLA机器人模型难以在边缘设备部署的问题,论文指出普通LLM量化指标无法反映动作闭环敏感性,提出ActQuant:按权重矩阵的动作相关性分配混合比特,并用动作感知曲率优化块尺度,同时配套OmniModel.cpp低比特C/C++运行时。LIBERO上可在≤3 bpw保持约95%成功率,OpenVLA-OFT压到2.5 bpw仍有90.1%,骨干从14.3GB降至2.7GB;UR3实机上π0.5内存降2.5倍且成功率基本不降。

CAFD: Concept-Aware DNN Fault Detection using VLMs Figure 1
2026-05-26cs.LG

CAFD: Concept-Aware DNN Fault Detection using VLMs

Amin Abbasishahkoo, Mahboubeh Dadkhah, Lionel Briand

Amin Abbasishahkoo is with the School of EECS, University of Ottawa

2026-05-26视觉语言视觉感知

论文针对 DNN 测试中标注预算有限、现有混合故障检测方法计算开销大的问题,提出 CAFD:用模型输出、 uncertainty/距离特征,并借助 VLM 提取图像文本概念,构造概念失败率 CFR 来补充语义线索。实验在 CIFAR-10/100 与 ImageNet 的三个模型上优于五个基线,平均 FDR 提升 18.3%,低预算下优势更明显,且 ImageNet 排序约 840 秒。

Reason--Imagine--Act: Closed-Loop LLM Decision Making with World Models for Autonomous Driving Figure 1
2026-05-26cs.AI

Reason--Imagine--Act: Closed-Loop LLM Decision Making with World Models for Autonomous Driving

Zhengqi Sun, Yiwen Sun, Boxuan Liu, Tailai Chen, Tianxu Guo, Jiabin Liu

2026-05-26强化学习

论文针对自动驾驶中 LLM 只做语义推理、缺乏车辆动力学约束而可能产生不安全决策的问题,提出 Reason–Imagine–Act:让 LLM 生成意图和候选子动作,再由动作条件世界模型短时滚动预测,并用安全评分选择可执行动作、反馈给下一轮推理。在 CARLA 1000 回合点目标导航中,RIA 达到 80.05% 路线完成率、51.10% 到达率和 0.20% 碰撞率,较无世界模型验证的 LLM 及 CARLA TM、MADA 等训练免费基线更稳。

Remote sensing data imputation using deep learning for multispectral imagery Figure 1
2026-05-26cs.CV

Remote sensing data imputation using deep learning for multispectral imagery

Shuang Liua, Fiona Johnson, Rohitash Chandra

2026-05-26视觉感知

针对光学卫星在湖泊水质监测中因云遮挡产生缺测、可能漏检藻华的问题,本文在PlanetScope SuperDove八波段影像上比较线性插值与多种CNN及CNN-LSTM类深度模型,并用人工云掩膜评估补全效果。结果显示深度学习整体显著优于线性插值,多数湖泊中简单CNN平均RMSE最低,补全后Green/Red和NDCI等藻华指数也更接近观测值;但高波长尤其NIR误差更大,增益主要来自空间光谱模式学习。

Diff-Instruct with Diffused Reward: Towards Principled One-step Generator RL Figure 1
2026-05-26cs.CV

Diff-Instruct with Diffused Reward: Towards Principled One-step Generator RL

Junyi Wu, Weijian Luo, Haoyang Zheng, Ruizhe Zhang, Guang Lin

Purdue University, hi-lab, Xiaohongshu Inc.

2026-05-26强化学习

针对一阶段文生图生成器中“只在终图加奖励、却在扩散轨迹上做匹配”导致的奖励过拟合与保真下降,论文提出 Didr:把 KL-RLHF 得到的奖励倾斜干净图分布沿噪声轨迹扩散,并用 DRS/DRP在各噪声层传播奖励梯度。实验显示其在一阶段 SDXL 上取得更优 PickScore–FID 权衡,长训版将 PickScore 提至 23.9、ImageReward 提至 1.10,并在 6B Z-Image 上单步超过 50 步教师的偏好指标。

IVR-R1: Refining Trajectories through Iterative Visual-Grounded Reasoning in Reinforcement Learning Figure 1
2026-05-26cs.CV

IVR-R1: Refining Trajectories through Iterative Visual-Grounded Reasoning in Reinforcement Learning

Chenghao Li, Fusheng Hao, Xikai Zhang, Likang Xiao, Yanwei Ren, Fuxiang Wu, Quan Chen, Liu Liu

Hangzhou International Innovation Institute, Beihang University, School of Artificial Intelligence, Beihang University, Shenzhen Institute of Advanced Integration Technology, Shenzhen

2026-05-26强化学习

该文针对多模态大模型在长链视觉推理中因文本化代理与原始图像信息不对称而产生的视觉 grounding 侵蚀、幻觉和逻辑漂移,提出 IVR-R1 强化学习框架:先用奖励筛出错误 rollout 并定位逐步视觉偏离,再通过 Re-Reasoning Loop 重新对齐原图并修正轨迹,生成高质量示范用于策略优化。实验称在 MMMU、MathVista、MathVerse 等六个基准上优于现有多模态 RL 方法,说明直接视觉重锚定比纯文本抽象更有效。

Brain-to-Image Retrieval and Reconstruction via Multimodal EEG Alignment Figure 1
2026-05-26cs.CV

Brain-to-Image Retrieval and Reconstruction via Multimodal EEG Alignment

Chi Kit Wong, Yan Liu, Haowen Yan

2026-05-26视觉语言视觉感知三维

本文面向脑机接口中的视觉解码难题,尝试从自然图像观看时的 EEG 同时完成检索与重建。核心做法是把 EEG 与更接近人类早期视觉的多尺度模糊、EVNet 图像特征对齐,并在重建中对齐图像、文本、深度、边缘等 CLIP 表征以驱动 SDXL-Turbo。单被试 THINGS-EEG2 上,200 选 1 检索 Top-1 达 86.30%、Top-5 达 98.55%,重建 CLIP Score 最高 0.903、SSIM 0.409,但泛化到多被试的效果文中未充分说明。

Task-Aligned Self-Supervised Learning for Medical Image Analysis: A Systematic Review and Practical Design Guidelines Figure 1
2026-05-26cs.CV

Task-Aligned Self-Supervised Learning for Medical Image Analysis: A Systematic Review and Practical Design Guidelines

Chathura Wimalasiri

2026-05-26视觉感知

针对医学影像标注昂贵且 ImageNet 迁移易失配的问题,本文系统综述2017–2025年75项SSL研究,核心不是按架构罗列,而是提出“前置任务—模态—下游临床目标”对齐视角。结论显示不存在通用最优SSL:对比学习更适合分类的全局判别特征,生成/空间预测更利于分割等密集任务,混合方法较均衡,SSL收益主要在低标注与少样本场景。

RAW: Robust Avatar Watermarking -- Benchmarking and Baseline Figure 1
2026-05-26cs.CV

RAW: Robust Avatar Watermarking -- Benchmarking and Baseline

Jack Parry, Jack Saunders, Vinay Namboodiri

University of Bath, UK

2026-05-26数据集/基准安全鲁棒

针对数字人视频上线前常见的换背景、裁剪/缩放和转码会破坏通用水印的问题,论文提出 RAW 基准:含 5 家商业平台的 50 段合成头像视频与 6 类真实工作流攻击,并比较 7 种水印方法。其洞察是头像水印应绑定人脸几何而非整帧像素,基线 WALT 通过 3D 人脸重建在 UV 纹理空间嵌入水印,在缩放攻击上达 92.4% 最高鲁棒性,背景移除为 95.6%,但压缩鲁棒性仍低于部分低容量方法。

Nano World Models: A Minimalist Implementation of Future Video Prediction Figure 1
2026-05-26cs.CV

Nano World Models: A Minimalist Implementation of Future Video Prediction

Siqiao Huang, Partha Kaushik, Michael Chen, Hengkai Pan, Omar Chehab, Fernando Moreno-Pino, Max Simchowitz

a Tsinghua University b Carnegie Mellon University, c University of Bristol d University of Oxford e Amazon FAR

2026-05-26视觉感知强化学习

这篇论文针对世界模型研究难以复现、组件分散且不便做受控比较的问题,提出 Nano World Models:以 diffusion forcing 为核心的轻量模块化未来视频预测框架,统一支持不同生成目标、模型规模、动作注入、潜空间、数据集和长时域 rollout。实验覆盖控制环境、CS:GO 与 RT-1 机器人数据,显示其可生成较可信长序列,但误差会自回归累积;采样步数、模型规模和任务复杂度显著影响质量,语义潜空间未必有利于可控规划。

A World Model of Radiologist Reading for Medical Image Representation Learning Figure 1
2026-05-26cs.CV

A World Model of Radiologist Reading for Medical Image Representation Learning

Yiwei Li, Zihao Wu, Huaqin Zhao, Yifan Zhou, Chao Cao, Dajiang Zhu, Tianming Liu, Lin Zhao

University of Georgia, University of Texas at Arlington, New Jersey Institute of Technology

2026-05-26视觉感知强化学习

针对医学影像标注稀缺和模型缺乏可解释证据链的问题,论文提出 GazeWorld:把胸片视为“世界”、放射科医生注视序列视为其中的轨迹,用按凝视顺序的潜表示自回归预测和未访问区域补全来预训练表征。冻结特征在 CheXpert、RSNA、SIIM-ACR 的九种监督设置及三项零样本评测中取得最佳结果,并在 GazeSearch 上显著优于专用扫视路径模型。

Parameter Efficient Multi-Class Intelligent Scheduling for Multimodal Online Distributed Industrial Anomaly Detection Figure 1
2026-05-26cs.LG

Parameter Efficient Multi-Class Intelligent Scheduling for Multimodal Online Distributed Industrial Anomaly Detection

Heqiang Wang, Weihong Yang, Zheyuan Yang, Jia Zhou, Xiaoxiong Zhong, Fangming Liu, Weizhe Zhang

2026-05-26视觉语言视觉感知

针对工业异常检测中多模态数据由边缘设备持续产生、集中离线训练难以扩展的问题,论文提出 MODIAD 在线分布式框架,将跨类别模型更新建模为多类智能调度问题,并用 SMG 贪心算法选择客户端-类别对;同时引入 REC-LoRA 降低每类训练的计算与通信开销。在 MVTec 3D-AD 与 Eyecandies 上,相比基线取得更好的检测性能和资源效率。

In Search of the Ingredients of Open-Endedness: Replicating Picbreeder with Large Vision-Language Models Figure 1
2026-05-26cs.AI

In Search of the Ingredients of Open-Endedness: Replicating Picbreeder with Large Vision-Language Models

Sam Earle, Kay Arulkumaran, Andrew Dai, Akarsh Kumar, Julian Togelius, Sebastian Risi

New York University, New York University Brooklyn New York USA, New York University New York New York USA

2026-05-26视觉语言视觉感知

为检验AI能否进行无目标的开放式发现,论文用前沿视觉语言模型替代人类用户复现 Picbreeder,把其作为研究开放性要素的“模型生物”。核心洞察是系统性操控探索噪声、历史记忆和多代理人格,并用谱系复杂度、视觉/语义新颖性评估。结果显示少量噪声提升多样性但损害图像质量,过长历史会诱发病态行为,多代理扩大探索却可能传播噪声或对抗性图像,整体仍弱于人类基线。

2026-05-25

109 篇
Geo-Align: Video Generation Alignment via Metric Geometry Reward Figure 1
2026-05-25cs.CV

Geo-Align: Video Generation Alignment via Metric Geometry Reward

Zizun Li, Haoyu Guo, Runzhe Teng, Chunhua Shen, Tong He

Shanghai AI Lab

2026-05-25视觉感知强化学习

针对视频重拍中真实同步多视角数据稀缺、监督微调易产生域偏移和尺度漂移的问题,Geo-Align 将相机控制视频生成改为后训练强化学习:用度量3D估计器从生成视频反推相机轨迹,按旋转和平移误差给几何奖励,并结合真实条件视频与缩放后的合成轨迹及审美奖励。实验在 DAVIS 的 10 类轨迹上显示,其相机跟随精度和视觉质量均优于现有监督基线。

PiD: Fast and High-Resolution Latent Decoding with Pixel Diffusion Figure 1
2026-05-25cs.CV

PiD: Fast and High-Resolution Latent Decoding with Pixel Diffusion

Yifan Lu, Qi Wu, Jay Zhangjie Wu, Zian Wang, Huan Ling, Sanja Fidler, Xuanchi Ren

in the audience, conductor’s stand labeled

2026-05-25生成模型

针对高分辨率生成中传统 VAE 解码器偏重重建、细节合成弱且常需“低清解码+超分”级联导致慢和耗显存的问题,PiD 将潜变量到像素的解码改写为条件像素扩散,把解码与上采样合并;其 sigma 感知适配器可接入带噪潜变量并支持提前终止 latent diffusion,DMD2 蒸馏后仅 4 步推理。实验显示可将 512×512 潜表示解码到 2048×2048,RTX 5090 上低于 1 秒、13GB 峰值显存,GB200 上 210ms,约比级联超分管线快 6 倍且视觉细节更好。

ETCHR: Editing To Clarify and Harness Reasoning Figure 1
2026-05-25cs.CV

ETCHR: Editing To Clarify and Harness Reasoning

Beichen Zhang, Yuhong Liu, Jinsong Li, Yuhang Zang, Jiaqi Wang, Dahua Lin

The Chinese University of Hong Kong, Shanghai AI Laboratory, Shanghai Jiao Tong University, Shanghai Innovation Institute

2026-05-25视觉感知

针对多模态模型仅用文本思维链难以处理细粒度关注、视角变换等视觉推理的问题,ETCHR将专用图像编辑器与理解模型解耦,让编辑器根据问题生成有助推理的中间图像,并通过监督模仿、基于VLM奖励的强化优化和推理时验证来减少错误编辑传播。实验覆盖感知、图表、逻辑、拼图和3D任务,分别使Qwen3-VL-8B、Gemini-3.1-Flash-Lite和Kimi K2.5平均Pass@1提升4.82、5.47和4.61点。

From Activation to Causality: Discovery of Causal Visual Representations in the Human Brain Figure 1
2026-05-25cs.CV

From Activation to Causality: Discovery of Causal Visual Representations in the Human Brain

Yuval Golbari, Navve Wasserman, Matias Cosarinsky, Roman Beliy, Aude Oliva, Antonio Torralba, Michal Irani, Tamar Rott Shaham

Weizmann Institute of Science, Massachusetts Institute of Technology

2026-05-25视觉感知

针对仅凭 fMRI 激活强度难以区分真实概念表征与共现线索的问题,论文提出 BrainCause,用生成/检索图像、语义负例和反事实编辑构造受控刺激,并结合 image-to-fMRI 编码模型做因果特异性检验。其在 260 个视觉概念上恢复人脸、身体、场景、文字等已知功能区,并发现手、腿、标志、工具等候选表征;同时显示超过 70% 高激活定位在因果评估下可能是假阳性。

Good Token Hunting: A Hitchhiker's Guide to Token Selection for Visual Geometry Transformers Figure 1
2026-05-25cs.CV

Good Token Hunting: A Hitchhiker's Guide to Token Selection for Visual Geometry Transformers

Shuhong Zheng, Michael Oechsle, Erik Sandström, Marie-Julie Rakotosaona, Federico Tombari, Igor Gilitschenski

University of Toronto & Vector Institute, Technical University of Munich

2026-05-25视觉感知

针对视觉几何 Transformer 在多视图 3D 重建中因全局注意力随帧数和 token 数二次增长而难以扩展的问题,GoToHunt 将加速表述为限制每个 query 可访问的 key/value token,并提出训练无关的两阶段选择:先用多样性准则保留覆盖场景的帧,再按注意力熵进行层自适应帧内剪枝。实验显示在 500 张图像场景中可将 VGGT 推理时间降低超过 85%,同时基本保持甚至偶尔提升重建性能。

Smart-Insertion-V: Photorealistic Video Insertion via a Closed-Loop Feedback Dual-Stream Framework Figure 1
2026-05-25cs.CV

Smart-Insertion-V: Photorealistic Video Insertion via a Closed-Loop Feedback Dual-Stream Framework

Xiao Cao, Yansong Qu, Xiangzhen, Chang, Wen Xiao, Jiakui Hu, Heyuan Li, Jialun Liu, Zhiyong Huang, Xuelong Li

2026-05-25视觉感知

该文面向免掩码视频物体插入中参考图与场景风格差异大、位置推理和时序一致性难兼顾的问题,提出 Smart-Insertion-V:用图像风格迁移流同步引导视频插入流,并以闭环反馈细化生成;DGM 结合 VLM 做空间/风格推理、T5 保留运动先验,Dual-RoPE 用时空偏移隔离条件以减轻风格泄漏。实验称可更合理放置物体并获得更协调的视觉效果,但具体增益与数据规模贡献仍需看完整评测。

HorizonStream: Long-Horizon Attention for Streaming 3D Reconstruction Figure 1
2026-05-25cs.CV

HorizonStream: Long-Horizon Attention for Streaming 3D Reconstruction

Chong Cheng, Peilin Tao, Nanjie Yao, Guanzhi Ding, Xianda Chen, Yuansen Du, Xiaoyang Guo, Wei Yin, Weiqiang Ren, Qian Zhang, Zhengqing Chen, Hao Wang

2026-05-25三维

面向机器人/自动驾驶中的因果在线三维重建,论文指出长序列漂移、抖动和尺度崩溃源于现有记忆机制按“新近性”统一传播几何证据。HorizonStream 将其形式化为证据影响核,结合带通道衰减的几何线性注意力、局部3D匹配与度量读出 token,在常内存、线性时间下处理超万帧序列;实验称仅用48帧训练即可在多数据集达到流式重建SOTA。

GenRecon: Bridging Generative Priors for Multi-View 3D Scene Reconstruction Figure 1
2026-05-25cs.CV

GenRecon: Bridging Generative Priors for Multi-View 3D Scene Reconstruction

Katharina Schmid, Nicolas von Lützow, Jozef Hladký, Angela Dai, Matthias Nießner

Technical University of Munich, Computing Systems Lab, Huawei Technologies, Switzerland

2026-05-25生成模型三维

针对多视角 RGB 场景重建在遮挡、弱纹理和稀疏观测下易产生噪声、缺失且难以用于内容创作的问题,GenRecon 将重建改写为带条件的 3D 生成:把室内场景切成重叠空间块,并用基于投影的多视角特征提升机制把带位姿图像对齐到 Trellis.2 生成先验中,从而生成带 PBR 材质的可编辑网格。实验称相较前沿重建方法高保真指标提升约 16%。

PGT: Procedurally Generated Tasks for improving visual grounding in MLLMs Figure 1
2026-05-25cs.CV

PGT: Procedurally Generated Tasks for improving visual grounding in MLLMs

Rim Assouel, Amir Bar, Michal Drozdzal, Adriana Romero-Soriano

2026-05-25视觉语言

针对 MLLM 在左右、计数、相对深度等细粒度视觉 grounding 上易依赖语言先验的问题,PGT 在真实训练图像上程序化叠加彩色框、点和计数标记,生成低成本且无歧义的几何监督,用抽象任务迫使模型学习空间关系。实验显示该数据增强可跨多种骨干提升关系、数量和 3D/深度基准,LLaVA 指令调优最高在 What’sUp 提升约 20%、CV-Bench-2D 提升 13.3%,说明瓶颈更可能来自监督信号不足而非单纯架构或分辨率限制。

LaMo: Self-Supervised Latent Motion Priors for Physical Realism in Video Generation Figure 1
2026-05-25cs.CV

LaMo: Self-Supervised Latent Motion Priors for Physical Realism in Video Generation

Bo Jiang, Depu Meng, Yihan Hu, Yichen Xie, Tianshuo Xu, Wei Zhan

University of California, Berkeley

2026-05-25视觉感知

针对视频生成虽画面逼真却常违背重力、接触和形变等物理规律的问题,LaMo主张从原始无标注视频中自监督提取帧间潜变量差分,形成潜在运动先验,并以训练时的Motion Drift Loss和采样时的Motion Prior Guidance接入现有扩散骨干。实验显示其在VideoPhy/VideoPhy2上提升CogVideoX并超过部分外部监督物理方法,在VBench上基本保持总体质量且改善运动相关指标。

Vision Transformers Need Better Token Interaction Figure 1
2026-05-25cs.CV

Vision Transformers Need Better Token Interaction

Linxiang Su

University of Szeged

2026-05-25视觉感知

本文针对 ViT 长训练中图像级表征变强、patch 表征却不利于分割等密集任务的退化现象,指出问题不只是高范数异常 token,而是全局语义过度扩散到局部 token 的优化捷径。作者以 entmax-1.5 替代 softmax,在保留全局连接的同时让注意力更稀疏选择;在 DINOv1 ViT-S/16 上基本保持 ImageNet 线性探测精度,并将 VOC mIoU 从 42.80 提升到 48.78,ADE20K 和 Cityscapes 也有提升。

Leveraging Foundation Models for Causal Generative Modeling Figure 1
2026-05-25cs.LG

Leveraging Foundation Models for Causal Generative Modeling

Aneesh Komanduri, Xintao Wu

University of Arkansas, University of Arkansas Fayetteville Arkansas USA

2026-05-25生成模型

针对因果生成建模依赖专门训练、难以统一完成概念发现—干预—反事实生成的问题,本文提出 FM-CGM,将推理型 VLM 用作概念提取与因果操纵器、SDXL 用作生成器,并用基于交叉注意力的 CSG 让干预影响后代概念同时约束不变区域。实验在 CelebA-HQ 与 MS-COCO 上显示,CSG 相比 DDIM/DDPM 反演取得更高 VLM 有效性和更低 LPIPS,但评估规模较小,因果结构真实性仍主要依赖 VLM 判断。

Learning a Particle Dynamics Model with Real-world Videos Figure 1
2026-05-25cs.CV

Learning a Particle Dynamics Model with Real-world Videos

Chanho Kim, Suhas V. Sumukh, Li Fuxin

Oregon State University

2026-05-25视觉感知强化学习

针对粒子动力学模型依赖仿真和真实3D状态标注、难以跨越 sim-to-real 的问题,论文将高斯泼溅中的稠密 Gaussian 直接作为带尺度和旋转的粒子,用多视角可微渲染损失和2D分割掩码从未标注真实视频学习多物体碰撞动力学。主要结果是发布约500段四视角方块倒塌与保龄球交互数据,并展示模型可生成对应3D Gaussian rollout;具体定量增益文中未充分说明。

MuellerPT: Decomposition Driven Pretraining for Dense Learning in Mueller Polarimetry Figure 1
2026-05-25cs.CV

MuellerPT: Decomposition Driven Pretraining for Dense Learning in Mueller Polarimetry

Adam Tlemsani, Yingdian Li, Maxime Giot, Naim Slim, Christopher J. Peters, Abhijeet Ghosh, Daniel S. Elson

2026-05-25视觉感知

针对 Mueller 矩阵偏振成像在医学组织分析中标注稀缺、跨样本和采集条件域移明显的问题,MuellerPT 将 Lu-Chipman 物理分解参数预测作为预训练任务,并构建 MAP-Org 多光谱动物器官数据集学习可迁移的稠密表征。少样本实验显示,其在羊脑灰白质分割中用 5% 数据较从零训练 DICE 绝对提升超 20%,结直肠癌分类中用 1% 数据准确率提升 8%,但部分增益可能也来自新增预训练数据规模。

Decomposing Queries into Tool Calls for Long-Video Keyframe Retrieval Figure 1
2026-05-25cs.CV

Decomposing Queries into Tool Calls for Long-Video Keyframe Retrieval

Michal Shlapentokh-Rothman, Prachi Garg, Yu-Xiong Wang, Derek Hoiem

University of Illinois at Urbana-Champaign

2026-05-25视觉感知

针对长视频问答中证据帧难以验证且逐帧描述成本高的问题,论文提出 ToolMerge:由 LLM 规划器把查询拆成多个轻量视觉工具调用,并用布尔逻辑合并各工具排序来检索关键帧;同时构建按时间片段锚定的 M2M 基准以隔离评测检索能力。实验显示其在长视频 QA、问题检索和字幕检索上与既有方法相当,其中字幕检索约提升 5%,RL 后训练还能进一步改善检索,但强 SigLIP 单工具基线也很有竞争力。

Not Too Generative, Not Too Discriminative: The Human Alignment Sweet Spot Figure 1
2026-05-25cs.CV

Not Too Generative, Not Too Discriminative: The Human Alignment Sweet Spot

Jorge Chang Ortega, Bastien Le Lan, Thomas Serre, Victor Boutin

Brown University, ANITI

2026-05-25生成模型

论文针对生成式与判别式视觉模型谁更符合人类感知的争论,指出既有比较常混入架构、规模和数据差异。作者用同一架构下的联合能量模型,通过单一系数连续调节生成/判别目标,在六类人类对齐基准上隔离训练目标影响。结果显示最佳对齐普遍出现在混合区间而非两端,兼顾类别结构与输入分布敏感性,并提升光泽判断、人类不确定性、形状偏置和分布外一致性。

Debiased Negative Mining Improves Out-of-distribution Detection with Pre-trained Vision-Language Models Figure 1
2026-05-25cs.LG

Debiased Negative Mining Improves Out-of-distribution Detection with Pre-trained Vision-Language Models

Bo Peng, Jie Lu, Guangquan Zhang, Zhen Fang

University of Technology Sydney

2026-05-25视觉语言视觉感知

本文针对基于 CLIP 等预训练视觉语言模型的事后 OOD 检测中“负标签挖掘”易混入伪负类的问题:现有方法用启发式相似度从野外词库选负标签,可能造成打分偏置。作者借鉴正-未标注学习,构建校正负标签采样偏差的理论框架,并将其实现为仅依赖 ID 标签和未标注语料的蒙特卡洛/重要性采样策略。多组 OOD 基准实验显示该方法达到新的 SOTA。

No Figure
2026-05-25cs.CV

Exploring deep learning for Event-Based Saliency Prediction with a Transformer-based model

Romaric Mazna, Jean Martinet, Sai Deepesh Pokala

2026-05-25视觉感知

事件相机具备低延迟、高动态范围和稀疏时序感知优势,但显著性预测长期缺少大规模标注与强基线。论文提出 SEST,用事件预训练 Swin Transformer 加 CNN 解码器生成动态显著图,并用 ESIM 从 DHF1K、UCF Sports 构造 N-DHF1K 与 N-UCF Sports。实验显示其优于既有事件显著性方法,并在真实事件数据零样本测试中具备一定迁移性;但性能提升可能部分来自合成数据规模扩展。

Machine learning applied to emerald gemstone grading: framework proposal and creation of a public dataset Figure 1
2026-05-25cs.CV

Machine learning applied to emerald gemstone grading: framework proposal and creation of a public dataset

FB Pena, D Crabi, Sandro C Izidoro, Érick O Rodrigues, G Bernardes

stones, where those are visually inspected by specialists that decide which one of the available reference stone is the most, Laboratory of Robotics, Intelligent and Complex, Department of Academic Informatics (DAINF), Universidade, Supervised learning consists of analyzing labeled, capable of producing labels for unlabeled instances [22, ald stones after training with previously labeled emerald, have access to the label or class information. Clustering, k-Means starts off with randomized cluster centers, asso-, centers. This process is repeated several times until conver-

2026-05-25数据集/基准

针对祖母绿分级依赖宝石学家比对参考石、易受光照和主观判断影响的问题,论文提出从封闭采集箱成像、背景分割、纹理/边缘统计特征到机器学习分类的自动化框架,并发布含192张图像及特征的公开数据集。实验中多层感知机最高达98%准确率,优于所测深度学习方案,K-means约91%;但数据仅覆盖8类而非完整15类,泛化仍受限。

A Novel Approach for the Counting of Wood Logs Using cGANs and Image Processing Techniques Figure 1
2026-05-25cs.CV

A Novel Approach for the Counting of Wood Logs Using cGANs and Image Processing Techniques

João VC Mazzochin, Giovani Bernardes Vitor, Gustavo Tiecker, Elioenai MF Diniz, Gilson A Oliveira, Marcelo Trentin, Érick O Rodrigues

Institute of Technological Sciences, Universidade Federal de Itajubá (UNIFEI), Itabira 35903-087, MG, Brazil, Business School, Universidade Federal do Paraná (UFPR), Curitiba 80060-000, PR, Brazil, created and made publicly available a comprehensive database of 466 images containing, scalable, addressing key limitations of existing automated systems.

2026-05-25视觉感知生成模型

针对木材堆场仍依赖人工计数、易低效且不安全的问题,本文用Pix2Pix/cGAN将桉木端面分割为“年轮/非年轮”,再结合数学形态学去噪与连通域计数,并发布466张、约1.3万根原木数据集。实验报告平均计数准确率约96.4%/92.3%,F1为0.879–0.933,单图处理0.713秒,显示其可用于较实时的林业库存场景。

No Figure
2026-05-25cs.CV

PhotoFlow: Agentic 3D Virtual Photography Missions

Jiarui Guo, Haojia Wei, Yiming Zhang, Yifei Liu, Yuning Gong, Hongjie Zhang, Xue Yang, Zhihang Zhong

Shanghai Jiao Tong University, Northeastern University, University of California, Los Angeles, Cornell University, Shanghai AI Laboratory, Sichuan University

2026-05-25生成模型三维

本文关注语言条件下的虚拟摄影:智能体需在任意 Blender 3D 场景中选择可执行相机位姿,同时满足空间约束与审美意图。核心创新是将拍摄建模为闭环搜索,提出 Director-Reviewer-Reflector 架构,并构建含 47 场景、141 任务的 VPhotoBench。实验显示在六轮渲染预算下,PhotoFlow 相比一次预测、反思链、锚点选择和随机搜索取得更高外部质量对齐与成功率。

No Figure
2026-05-25cs.CV

Revitalizing Dense Material Segmentation: Stabilized Vision Transformers and the Generalization Paradox

Allan Kazakov, Duygu Cakir, Hilal Kurt İrfanoğlu, Yavuz İrfanoğlu

2026-05-25视觉感知学习理论

论文针对 Apple-DMS 材质分割长期停滞、通用分割模型偏几何而不懂材质的问题,重新恢复数据索引并评估 SegFormer/Mask2Former。核心洞察是密集纹理场会导致 ViT 训练不稳,需用高保真 logit 投影、查询熵正则和物理一致增强;SegFormer-B5 在原始划分达 0.4572 mIoU,同时指出 80/10/10 划分虽升至 0.5276,却可能因分布同质化削弱真实泛化。

No Figure
2026-05-25cs.CV

Weierstrass Positional Encoding for Vision Transformers

Zhihang Xin, Rui Wang, Xitong Hu, Xiaojun Wu

Zhihang Xin and Xitong Hu are with the School of Mathematics and Data Science, Jiangnan University, Wuxi 214122, China, e-mail: {1131230221

2026-05-25视觉感知

论文针对 ViT 将二维图像 patch 展平成一维序列后,位置编码缺乏几何约束、难以保持空间距离关系的问题,提出 Weierstrass 椭圆位置编码 WePE:把归一化二维坐标映射到复平面,并用 Weierstrass ℘ 函数及其导数构造紧凑四维特征。其双周期与格点结构提供分辨率无关、可推导相对位置且具距离衰减的几何归纳偏置;实验称在预训练和微调场景中多数情况下带来一致提升,并可用查表实现,额外开销不明显。

CRONOS: Benchmarking Counterfactual Physical Consistency in Video Models Figure 1
2026-05-25cs.CV

CRONOS: Benchmarking Counterfactual Physical Consistency in Video Models

León Begiristain, Olaf Dünkel, Adam Kortylewski

University of Freiburg, Max Planck Institute for Informatics, CISPA Helmholtz Center for Information Security

2026-05-25视觉感知数据集/基准

该文针对视频生成模型是否真正学到物理因果结构而非表面视觉相关性的问题,提出 CRONOS 反事实物理一致性基准,在 Unreal Engine 中固定碰撞、下落、遮挡等事件类型,系统干预视角、场景、物体类别和外观,并用对象稳定性与物理合理性指标诊断模型。实验显示,当前开源视频模型在简单物理事件上仍频繁失效,且对视角、物体类型等变化高度敏感;V2V 通常优于 I2V,但模型规模增大并不必然带来一致性提升。

No Figure
2026-05-25cs.CV

RiGS: Rigid-aware 4D Gaussian Splatting from a Single Monocular Video

Chenyu Wu, Wanhua Li, Zhu-Tian Chen, Hanspeter Pfister

Harvard University, Zhejiang University, Nanyang Technological University, University of Minnesota - Twin Cities, Work done during a research internship at Harvard University.Corresponding author.

2026-05-25视觉感知三维

针对单目动态三维重建中刚性模型时序稳定但难捕捉短时非刚性细节、逐帧方法又易不一致的问题,RiGS将4D高斯分解为静态、刚性与瞬态三类,并用对象级动态掩码、刚性到瞬态的时长驱动转换及场景流监督联合优化多尺度运动。实验显示其在多个动态新视角合成基准上取得SOTA,兼顾重建质量与时间一致性。

Recursive Block-Diagonal Coupling for Resource-Efficient Training of Vision Models Figure 1
2026-05-25cs.CV

Recursive Block-Diagonal Coupling for Resource-Efficient Training of Vision Models

Maxim Henry, Adrien Deliège, Sébastien Piérard, Marc Van Droogenbroeck

2026-05-25视觉感知

针对从头训练大容量视觉模型计算开销高、以往模型增长方法常忽略窄模型预训练成本的问题,论文提出 RBDC:递归地独立训练窄模型,并用无参数的块对角耦合与零填充交互项初始化更宽模型,从而在总训练预算内分配 FLOPs。ImageNet 上对 DeiT 与 ResNet 可在相近精度下降低最高约 30% 训练 FLOPs,并优于若干增长式训练协议;作为 COCO 检测与分割骨干也达到持平或更好表现。

CVSearch: Empowering Multimodal LLMs with Cognitive Visual Search for High-Resolution Image Perception Figure 1
2026-05-25cs.CV

CVSearch: Empowering Multimodal LLMs with Cognitive Visual Search for High-Resolution Image Perception

Liupeng Li, Haoqian Kang, Zhenyu Lu, Jinpeng Wang, Bin Chen, Ke Chen, Yaowei Wang

2026-05-25视觉语言视觉感知

针对多模态大模型处理高分辨率图像时易丢失小目标细节的问题,CVSearch提出无需训练的认知式“先评估再搜索”框架:先用视觉专家快速定位,失败后切换到语义感知扫描,并用SGAP生成语义一致patch、结合视觉复杂度和自底向上搜索减少冗余与碎片化。实验显示其在高分辨率基准上取得SOTA精度,同时较扫描式方法提升搜索效率。

ExpOS: Explainable Open-Surgery Skills Assessment Using 3D Hand Reconstruction Figure 1
2026-05-25cs.CV

ExpOS: Explainable Open-Surgery Skills Assessment Using 3D Hand Reconstruction

Roi Papo, Idan Smoller, Shlomi Laufer

2026-05-25三维

针对开放手术训练中专家评分成本高、反馈不透明的问题,ExpOS从RGB视频重建3D双手姿态并检测器械,用MS-TCN++建模手—器械时序动态,结合注意力定位关键片段和SHAP解释全局运动特征。其在221段三类任务视频上与专家评分相关性较强,筋膜闭合任务最佳达到r=0.778、R²=0.74,但对手部可见性和重建质量较依赖。

DualMem: Bypassing the Objectness Bottleneck for Calibrated Unknown-Stream Filtering in Open-World Object Detection Figure 1
2026-05-25cs.CV

DualMem: Bypassing the Objectness Bottleneck for Calibrated Unknown-Stream Filtering in Open-World Object Detection

Yingjun Xiao (a), Xi Chen (b), Gang Fang (c), Siyuan Chen (b) ((a) School of Artificial Intelligence, Guangzhou University, Guangzhou, China, (b) School of Computer Science and Cyber Engineering, (c) Institute of Computing Science and Technology, China)

2026-05-25视觉感知强化学习

论文指出开放世界检测器的未知预测流被背景和已知类误报严重污染,根因不是缺少信息,而是物体性标量头压缩掉了可分辨的提案特征。DualMem以冻结SigLIP特征构建正/负kNN记忆,用Neyman–Pearson校准做后处理过滤,无需重训检测器。它在PROB、OW-DETR、HypOW上将背景型假未知每图减少44.9%–66.3%,未知召回仅小幅下降且已知类mAP不变。

DDX-TRACE: A Benchmark for Medical Diagnostic Trajectories in VLMs Figure 1
2026-05-25cs.CV

DDX-TRACE: A Benchmark for Medical Diagnostic Trajectories in VLMs

Jiazhen Pan, Weixiang Shen, Jun Li, Julian Canisius, Felix Bitzer, Paula Roßmüller, Jiancheng Yang, Virginie Kreutzinger, Daniel Rueckert, Benedikt Wiestler

Technical University of Munich (TUM), TUM University Hospital, Munich Center for Machine Learning (MCML), Aalto University, Imperial College London

2026-05-25视觉语言数据集/基准

针对现有医疗 VLM 基准只给定完整证据并评分最终诊断、难以发现“猜对但证据不足”和低效检查的问题,DDx-TRACE 将神经放射诊断建模为隐藏证据下的逐轮工作流:模型需自由请求影像、更新概率性鉴别诊断并决定何时停止。基于 211 个医师标注病例的评测显示,当前 VLM 的最终诊断分数常高估真实工作流质量,主要短板在证据获取、图像解读和不确定性更新。

No Figure
2026-05-25cs.CV

EM-Vid: Training-Free Entity-Centric Memory for Efficient and Consistent Multi-Shot Video Generation

Jente Vandersanden, Matheus Gadelha, Chun-Hao P. Huang, Hyeonho Jeong, Yulia Gryaditskaya

Max Planck Institute for Informatics, Max Planck Institute for Informatics Saarbrücken Germany and Adobe Research London UK

2026-05-25视觉感知

多镜头视频生成需要长期保持角色/场景一致,但用整帧记忆会把临时背景与实体外观纠缠,导致无关元素泄漏且注意力开销高。EM-Vid的核心是训练-free地把记忆改为按实体索引的稀疏潜变量patch库,并用结构化脚本检索相关实体、预算化更新记忆及边界噪声抑制干扰。在20个多镜头脚本评测中,文中显示其提升文本遵循和推理效率,同时维持跨镜头主体与场景一致性。

GlowGS: Generative Semantic Feature Learning for 3D Gaussian Splatting in Nighttime Glow Scenes Figure 1
2026-05-25cs.CV

GlowGS: Generative Semantic Feature Learning for 3D Gaussian Splatting in Nighttime Glow Scenes

Beibei Lin, Xiao Cao, Jingyuan Guo, Robby T. Tan

National University of Singapore

2026-05-25生成模型三维

GlowGS针对夜间强光晕区域缺少纹理和边缘、导致3DGS新视角出现重影和亮斑的问题,引入扩散模型生成候选新视角,并用DINO/CLIP等视觉基础模型筛选与提取语义特征库,再以最近语义特征约束无真值的新视角渲染训练。在新建NightGlow数据集上,方法可接入多种3DGS基线,相比MGS报告PSNR提升1.78,并减轻光晕伪影。

No Figure
2026-05-25cs.LG

Cost-Effective Model Evaluation with Meta-Learning

Trinh Pham, Viet Huynh, Hongzhi Yin, Quoc Viet Hung Nguyen, Thanh Tam Nguyen

2026-05-25数据集/基准

面对新模型不断涌现而目标数据常无标签的问题,论文将“评估模型”改写为跨模型的元学习任务:用已评测参考模型构建 MetaDataset,学习可迁移的性能估计器 MetaEvaluator,并在 Text2SQL 与图像分类中适配未见架构。实验显示其在无需逐模型标注或反复微调的情况下,能给出更稳定的准确率估计并显著降低评测成本。

Calibration-Informative Region Selection for Online LiDAR--Camera Calibration in Agricultural Environments Figure 1
2026-05-25cs.CV

Calibration-Informative Region Selection for Online LiDAR--Camera Calibration in Agricultural Environments

Rajitha de Silva, Grzegorz Cielniak

under Grant 10041179. All authors are with Lincoln Institute for Agri-Food, Technology, University of Lincoln, UK. Corresponding Author: Rajitha de

2026-05-25视觉感知

面向农业机器人长期部署中振动、温漂等导致的 LiDAR–相机外参漂移,本文指出并非所有跨模态对应都同样有用,提出基于密集校准支持图的在线标定框架,将初始估计、残差提取、支持估计与加权细化解耦。BLT 与 KITTI 实验显示支持具有明显空间和语义非均匀性,刚性结构更可靠;在 KITTI 上可提升平移精度与稳定性,但旋转增益有限。

No Figure
2026-05-25cs.CV

PathNavigate: A Training-Free Pathology Agent with Surprise-Guided Scan and Shared Slide Memory for Whole-Slide Image VQA

Chunze Yang, Qidong Liu, Wenjie Zhao, Yue Tang, Jiusong Ge, Di Zhang, Jiashuai Liu, Lei Wu, Junbo Lu, Ni Zhang, Xian Wu, Zeyu Gao, Chen Li

School of Comp. Science & Technology, Xi’an Jiaotong University, Tencent Jarvis Lab, University of Cambridge

2026-05-25视觉感知

本文针对全切片病理 VQA 中“先按问题检索”容易漏掉未被问题显式命名的关键形态、且推理开销大的问题,提出无需训练的 PathNavigate。其核心是先低倍扫描并用在线共享记忆构建切片特异的 surprise 异常区域先验,再在候选池内按 PLIP 问题相关性选高倍证据,最后复用同一记忆辅助回答。在 WSI-VQA 与 SlideBench-BCNB 上,方法提升了回答准确率、证据轨迹可解释性,并相对 PathAgent 降低存储与 token 预算。

Generator-Refiner-Examiner: A Tri-Module Data Augmentation Framework for 3D Human Avatar Learning from Monocular Videos Figure 1
2026-05-25cs.CV

Generator-Refiner-Examiner: A Tri-Module Data Augmentation Framework for 3D Human Avatar Learning from Monocular Videos

Gangjian Zhang, Jian Shu, Sicheng Yu, Wenhao Shen, Yu Feng, Hao Wang

Nanyang Technological University, Nanyang Technological University Singapore

2026-05-25视觉感知三维

针对单目视频帧数少、姿态和视角覆盖不足导致3D人体头像细节与泛化受限的问题,论文提出TrioMan:先用高斯扰动生成新姿态/相机样本,再以纹理和几何条件的一步扩散细化伪图像,并用双分支注意力Examiner筛除不一致样本。基于3DGS与SMPL-X,在X-Humans和NeuMan上优于现有方法,尤其改善衣纹、服装连接和伪影。

No Figure
2026-05-25cs.CV

PixIE: Prompted Pixel-Space Low-Light Image Enhancement

Ruirui Lin, Guoxi Huang, David Bull, Nantheera Anantrasirichai

2026-05-25视觉感知

低光图像增强难点在于噪声、对比度缺失与语义歧义耦合,直接影响检测、跟踪等下游视觉任务。PixIE的核心思路是在像素空间引入DINOv3语义先验:先做跨尺度去噪,再用DPPB将多层DINO特征转为连续的逐像素调制,并用MRPE与SCC兼顾局部上下文和计算成本。实验显示其在LLIE基准上相较近期方法平均PSNR提升1.9%–15.0%,LPIPS降低8.5%–44.4%,细节与纹理恢复更稳定。

ComPose: When to Trust Hands for Object Pose Tracking Figure 1
2026-05-25cs.CV

ComPose: When to Trust Hands for Object Pose Tracking

Jisu Shin, Junoh Lee, JunGyu Lee, Inhwan Bae, Dohyeon Lee, Hokyun Im, Youngwoon Lee, Hae-Gon Jeon

2026-05-25视觉感知三维

针对单目 RGB 中手持物体 6DoF 跟踪易受手部遮挡、且依赖深度或 CAD 模板的问题,ComPose 将手从“遮挡物”转为互补运动线索:自适应选择有信息量的手关节,用门控融合手/物体相对旋转,并用可见几何修正平移、约束时序一致性。实验显示其在重遮挡和几何歧义下更稳健,生成轨迹还能直接迁移到真实机器人操作。

Precise: SDE-Consistent Stochastic Sampling for RL Post-Training of Flow-Matching Models Figure 1
2026-05-25cs.LG

Precise: SDE-Consistent Stochastic Sampling for RL Post-Training of Flow-Matching Models

Jade Zou, Tao Huang, Weijie Kong, Junzhe Li, Yue Wu, Qi Tian, Jiangfeng Xiong, Jianwei Zhang, Liefeng Bo, Zhao Zhong

Peking University

2026-05-25生成模型强化学习

本文关注流匹配生成模型在线强化学习后训练中,随机采样器既决定策略探索又影响去噪轨迹的问题。作者指出少步数下已有 Euler/CPS 采样会带来过量噪声或边缘分布偏差,提出 Precise:用 logSNR 设计探索日程,并通过冻结干净潜变量后验均值获得 SDE 一致的闭式转移。实验在 SD3.5-M、FLUX.2 上显示其 PickScore、HPSv2.1 等对齐指标达到或优于基线,并以少 13.1–53.2% 训练时间匹配既有最佳域内表现。

VINS-120K: Ultra High-Resolution Image Editing with A Large-Scale Dataset Figure 1
2026-05-25cs.CV

VINS-120K: Ultra High-Resolution Image Editing with A Large-Scale Dataset

Zhizhou Chen, Shanyan Guan, Zhanxin Gao, En Ci, Yanhao Ge, Wei Li, Zhenyu Zhang, Jian Yang, Ying Tai

Nanjing University, China

2026-05-25视觉感知数据集/基准

现有指令图像编辑多面向1K以下分辨率,直接处理4K会出现噪声、模糊和高频纹理丢失。VINS-120K从真实超高清视频构造12万组4K编辑三元组,并用多阶段质量、指令一致性和美学过滤保留高质量样本,同时提出高频感知后适配与VINS-4KEval评测。基于FLUX.1-Kontext-dev适配后,4K细节真实性和指令遵循提升,相比Seedream4.0的pFID降低28%,但收益可能主要来自数据规模与高频监督共同作用。

No Figure
2026-05-25cs.GR

DrawVideo: Generating Long Video from Storyboard Keyframe Sketches

Chuanzhi Xu, Huiqi Liang, Bang Shi, Huiming Zhang, Yifan Xiao, Guangcheng Lin, Haodong Chen, Qiang Qu, Zhicheng Lu, Weidong Cai

The University of Sydney, NSW 2006, Australia, Charles Sturt University, NSW 2800, Australia

2026-05-25视觉感知

针对长视频生成中单一文本提示难以精确控制分镜构图、角色姿态与局部运动的问题,DrawVideo将创作拆成由黑白草图、外观提示和运动提示共同约束的可控分镜,并以参考关键帧、派生动作关键帧和相邻关键帧视频合成逐步生成长视频;同时构建SketchLongVideo数据集。实验显示其在结构可控性、外观一致性、镜头内稳定性和长视频连贯性上优于现有方案。

MDS-DETR: DETR with Masked Duplicate Suppressor Figure 1
2026-05-25cs.CV

MDS-DETR: DETR with Masked Duplicate Suppressor

Chanho Lee, Seunghee Koh, Yunho Jeon, Junmo Kim

Korea Advanced Institute of Science and Technology (KAIST), Daejeon 34141, South Korea, Department of Artificial Intelligence Software, Hanbat National University, Daejeon 34158, South Korea

2026-05-25视觉感知

针对 DETR 一对一匹配正样本少、收敛慢,而现有一对多辅助解码器训练开销高且推理丢弃的问题,MDS-DETR 将一对多与一对一监督合入单解码器,并用基于置信度排序的因果遮罩自注意力注入非对称性,学习抑制重复候选。COCO 12 epoch、R50 下较 Deformable-DETR 提升 2.8 mAP且训练仅增 5%,较 MR.DETR 高 0.3 mAP并快约 20%。

No Figure
2026-05-25cs.CV

B-GRTO: Bootstrapped Group Relative Tool Optimization for Referring Segmentation

Mario Markov, Stefan Maria Ailuro, Mohammad Mahdi, Luc Van Gool, Danda Pani Paudel (INSAIT, Sofia University "St. Kliment Ohridski")

INSAIT, Sofia University “St. Kliment Ohridski”

2026-05-25视觉感知优化算法

本文针对指代表达分割中“语言推理难、分割工具也需适配”的耦合问题,指出仅用 GRPO 更新多模态策略而冻结解码器会浪费可微工具信号。作者提出 GRTO 复用策略 rollout 同时优化工具损失,并用 BTO 先低成本预对齐解码器形成 B-GRTO。实验覆盖遥感、伪装目标和推理分割,较纯 GRPO 明显提升,并可匹配或超过部分领域 SoTA。

Multimodal Distribution Matching for Vision-Language Dataset Distillation Figure 1
2026-05-25cs.CV

Multimodal Distribution Matching for Vision-Language Dataset Distillation

Jongoh Jeong, Hoyong Kwon, Minseok Kim, Kuk-Jin Yoon

Visual Intelligence Lab., KAIST

2026-05-25视觉语言视觉感知数据集/基准

针对大规模图文数据训练成本高、现有多模态数据集蒸馏依赖轨迹匹配且易受架构偏置影响的问题,论文提出 MDM:在联合嵌入空间聚类初始化合成图文对,用多微调专家的权重插值构造教师,并在单位超球面上匹配图文一致与差异方向的分布,同时保持对比对齐。图文检索实验显示,其能以更低蒸馏开销生成紧凑数据集,并在跨架构评测中保持较稳健性能。

PhenoYieldNet: Learning Crop-Aware Phenological Responses for Multi-Crop Yield Prediction Figure 1
2026-05-25cs.CV

PhenoYieldNet: Learning Crop-Aware Phenological Responses for Multi-Crop Yield Prediction

Yu Luo, Xiaogang Zhu, Shan Zeng, Wei Xiang, Thomas Francis Bishop, Zhiyong Wang, Kun Hu

School of Computer Science, The University of Sydney, NSW 2006, Australia, School of Computer Science and Information Technology, Adelaide University, SA 5005, Australia, College of Mathematics and Computer Science, Wuhan Polytechnic University, Wuhan, China, School of Computing, La Trobe University, NSW 2000, Australia, School of Science, Edith Cowan University, WA 6027, Australia

2026-05-25视觉感知

面向现有作物产量预测多为单作物、跨作物和跨区域泛化弱的问题,PhenoYieldNet将遥感与气象时序纳入统一多作物框架,通过作物物候库和物候注意力显式建模不同作物对长期趋势与短期波动的响应,并用时序对比适配遥感基础模型。实验显示其在多作物数据上优于单作物和多作物基线,尤其在天气波动区域更稳健。

Rethinking Transfer Learning for Industrial Inspection: DINOv3 vs. ImageNet Pretraining Across RGB and X-ray Tasks Figure 1
2026-05-25cs.CV

Rethinking Transfer Learning for Industrial Inspection: DINOv3 vs. ImageNet Pretraining Across RGB and X-ray Tasks

Mehdi Gharbage, Céline Teulière, Pierre Bouges, Thierry Chateau

2026-05-25视觉感知

针对工业检测中自然图像预训练是否仍适用、DINOv3等视觉基础模型能否改进密集缺陷识别的问题,本文在RGB表面缺陷与X-ray检测的分割/检测任务上,系统比较ConvNeXt的DINOv3蒸馏预训练、监督ImageNet预训练及ResNet-50,并区分冻结与全量微调。结果显示DINOv3并非通用即插即用特征:冻结时优势不稳定,但在RGB任务充分微调后收敛更快、性能更好;遇到X-ray模态偏移时,ImageNet预训练仍更可靠。

One-Forcing: Towards Stable One-Step Autoregressive Video Generation Figure 1
2026-05-25cs.CV

One-Forcing: Towards Stable One-Step Autoregressive Video Generation

Jiaqi Feng, Justin Cui, Yuanhao Ban, Cho-Jui Hsieh

Tsinghua University

2026-05-25视觉感知

本文针对自回归视频生成在每块仍需多步去噪、压到一步后易出现运动变弱和画面模糊的问题,指出视频教师轨迹在高噪声端存在曲率集中,使纯一致性蒸馏难以单步近似。One-Forcing 将 DMD 分布匹配与基于真实视频潜变量的 GAN 判别信号结合,并复用 fake-score Transformer 作为判别器,抑制自回归误差累积。其在 VBench 得分 83.76,达到一步因果视频生成 SOTA,并以约三分之一训练成本稳定实现逐帧一步自回归。

Efficient One-Step Diffusion Restoration Model with Compact Token Compression and Linear Attention Figure 1
2026-05-25cs.CV

Efficient One-Step Diffusion Restoration Model with Compact Token Compression and Linear Attention

Bingtian Qiao, Yue Shi, Yingjie Zhou, Yong Guo, Guangtao Zhai, Jiezhang Cao

Shanghai Jiao Tong University, Fuzhou University, Shanghai AI Laboratory

2026-05-25生成模型

本文针对真实图像超分中生成式方法因密集潜变量和二次注意力导致高分辨率推理昂贵的问题,指出瓶颈主要在 token 冗余与交互成本。提出 SANA-SR:用 32×深压缩自编码器减少 latent token,在线性注意力 DiT 上以 LoRA 做一步恢复,并加入先验对齐与结构化剪枝。实验称其在多基准上质量具竞争力、纹理更清晰,剪枝后 344M 参数、407.95G MACs、0.019s 推理,面向移动部署更可行。

Commutator-Induced Uncertainty in VAEs Figure 1
2026-05-25cs.LG

Commutator-Induced Uncertainty in VAEs

Tahereh Dehdarirad, Michael Felsberg, Gabriel Eilertsen, Ziliang Xiong

Computer Vision and Learning Systems (CVL), Linköping University, Sweden, Department of Science and Technology, Linköping University, Sweden

2026-05-25生成模型安全鲁棒

本文针对 VAE 与对称感知 VAE 常把潜在变换强行交换化、从而低估非交换生成因素带来的重建不确定性的问题,提出两阶段 Lie Group VAE:先用 BCH 偏差和顺序交换重建测试诊断潜在非交换性,再以数据校准的变形稳定约束对齐解码器敏感度,并分离离散与连续因素。在 dSprites、3DShapes、3DCars 和 CelebA 上,方法改善重建质量,使顺序依赖行为更符合潜在代数结构。

No Figure
2026-05-25cs.CV

DFSAttn: Dynamic Fine-grained Sparse Attention for Efficient Video Generation

Jie Hu, Zixiang Gao, Yutong He, Kun Yuan

2026-05-25视觉感知

面向视频 DiT 中 3D 全注意力计算量过高、现有块稀疏在高稀疏率下易损画质的问题,论文指出注意力具有动态且细粒度的稀疏结构,并用注意力召回下界分析关键因素。DFSAttn 通过 3D Hilbert 重排、层级块评分与自适应掩码缓存,在免训练条件下更准确选择稀疏块;在 HunyuanVideo、Wan2.1 上高稀疏场景优于既有方法,最高实现约 2.1× 端到端加速并保持生成质量。

No Figure
2026-05-25cs.CV

FAST-ME: Foundation-aware Adaptive Stopping for Motion Estimation for Efficient IoT Video Analysis

Kakia Panagidi, Stathes Hadjieftymiadis

2026-05-25视觉感知

面向 IoT 摄像网络等算力/能耗受限场景,论文针对块运动估计计算开销大的瓶颈,提出 FAST-ME:用最优停止理论根据时空差异提前终止冗余搜索,并引入 ViT、SAM 等基础模型的语义注意力,与 SAD 等失真指标融合,使重要区域继续精搜、背景区域早停。实验称在基准和多模态视频上最高减少 99% 计算量,精度损失较小且语义覆盖更好,但具体增益来源仍需结合实现细节判断。

Sample-wise Targeted Adversarial Attacks on Test-time Adaptation Figure 1
2026-05-25cs.LG

Sample-wise Targeted Adversarial Attacks on Test-time Adaptation

Phuc Duc Nguyen, Quang Duc Nguyen

College of Computing and Data Science, Nanyang Technological University

2026-05-25视觉感知

本文关注测试时自适应在无人标注测试流中被操纵的风险:传统按类别定向攻击会显著改变预测分布,容易暴露。作者提出按样本触发的定向攻击,并用元学习模拟适应过程,通过优先级感知梯度对齐把攻击成功置于隐蔽性约束之上。实验在 CIFAR-10-C、CIFAR-100-C、ImageNet-C 等 TTA 协议上显示,攻击成功率约 90%,同时预测标签分布接近无攻击基线且能抵抗现有防御。

What Linear Probes Miss: Multi-View Probing for Weight-Space Learning Figure 1
2026-05-25cs.LG

What Linear Probes Miss: Multi-View Probing for Weight-Space Learning

Eunwoo Heo, Kyeongkook Seo, Jaejun Yoo

2026-05-25视觉感知

针对开源模型仓库中 checkpoint 缺少元数据、直接评估成本高的问题,本文研究如何仅从权重识别模型属性。作者指出现有单视角线性 probing 会遗漏行列交互并产生不可区分权重,提出 MVProbe:同时从行/列一阶投影和 Gram 二阶相关视角提取特征,并用缩放分析指导标准化融合。在 Model Jungle 上,其在 ResNet、ViT、DINO 及 Stable Diffusion LoRA 等设置中超过 ProbeX,且层选择更稳健。

Online Hand Gesture Recognition Using 3D Convolutional Neural Networks Figure 1
2026-05-25cs.CV

Online Hand Gesture Recognition Using 3D Convolutional Neural Networks

Yinghao Qin, Tijana Timotijevic

2026-05-25视觉感知三维

面向真实人机交互中动态手势需在线定位、低延迟识别且个体差异大的问题,论文构建了由检测器与分类器组成的3D CNN在线识别框架,并用滑动窗口融合多段结果以提升鲁棒性。模型在Jester上训练,检测器准确率超过98%、分类器超过90%;端到端系统在自采数据上可在3秒内响应,但Levenshtein准确率仅37.5%,实际可用性仍受限。

RS2AD-LiDAR: End-to-End Autonomous Driving LiDAR Data Generation from Roadside Sensor Observations Figure 1
2026-05-25cs.CV

RS2AD-LiDAR: End-to-End Autonomous Driving LiDAR Data Generation from Roadside Sensor Observations

Runyi Huang, Ni Ding, Ruidan Xing, Yuheng Shi, Lei He, Keqiang Li

2026-05-25视觉感知

针对端到端自动驾驶依赖车端采集导致成本高、长尾场景稀缺和数据孤岛的问题,RS2AD-LiDAR提出从路侧激光雷达观测重建车载LiDAR数据:通过相对位姿变换、虚拟LiDAR建模与点云重采样,生成可适配不同车辆和传感器配置的点云。作者自建R2V-LiDAR评测集,结果显示生成数据与真实车载数据在语义上相近,并在与真实数据混合训练时提升BEV和3D目标检测精度。

Joint Target-Less Intrinsic and Extrinsic Camera-LiDAR Calibration using Deep Point Correspondences Figure 1
2026-05-25cs.CV

Joint Target-Less Intrinsic and Extrinsic Camera-LiDAR Calibration using Deep Point Correspondences

Simon Bultmann, Daniele Cattaneo, Abhinav Valada

Department of Computer Science, University of Freiburg, GermanyThis work was funded by the German Research Foundation (DFG) Emmy Noether Program under grant 468878300.

2026-05-25视觉感知

针对现有学习式无靶标相机-LiDAR标定多假设图像已校正且内参已知的问题,本文提出联合估计针孔内参与径向-切向畸变、以及外参的完整流程:用SfM初始化内参、运动对齐初始化外参,并将CMRNext式深度像素-点对应扩展到未知内参和畸变,再与鲁棒非线性重投影优化迭代耦合。论文在KITTI未见相机设置下做系统评估,表明无需标定板也可联合恢复参数;具体量化增益在给定片段中未充分说明。

VDE: Training-Free Accelerating Rectified Flow Model via Velocity Decomposition and Estimation Figure 1
2026-05-25cs.CV

VDE: Training-Free Accelerating Rectified Flow Model via Velocity Decomposition and Estimation

Junwen Tan, Jinglin Liang, Hongyuan Chen, Shuangping Huang

South China University of Technology

2026-05-25生成模型

整流流模型在图像、视频等生成中推理步数多,现有训练免费加速多依赖缓存复用,易因缓存与当前输入不匹配损失保真度。VDE将速度分解为与输入平行和正交的分量,利用系数的局部线性和正交方向短期稳定性在线估计,并周期性全前向锚定以抑制误差累积。实验显示其在Flux、Qwen-Image、Wan2.1上获得约2.04–3.22倍加速,Qwen-Image的LPIPS较最佳基线降低52.2%。

Decoupling Spatio-Temporal Adapter for Fine-Grained Badminton Action Localization Figure 1
2026-05-25cs.CV

Decoupling Spatio-Temporal Adapter for Fine-Grained Badminton Action Localization

Tianyu Wang (1), Junjie Wu (1 and 2), Jingquan Gao (1), Shishuo Li (1) ((1) School of Economics and Management, Beihang University, Beijing 100191, China (2) Key Laboratory of Data Intelligence and Management, Ministry of Industry and Information Technology, China)

2026-05-25视觉感知

论文针对专业羽毛球中动作短促、速度快且类别差异细微,现有数据集缺少细粒度时间边界标注的问题,构建 Fine-Badminton 数据集,并提出 DSTA 适配器,将运动表示解耦为时间、垂直和水平三路卷积分支,以低参数开销增强局部时空建模。在 ShuttleSet 和 Fine-Badminton 上分别取得 74.67% 与 66.23% mAP,优于已有适配器方法。

SCOPE: Simulating Cross-game Operations in Playable Environments for FPS World Models Figure 1
2026-05-25cs.CV

SCOPE: Simulating Cross-game Operations in Playable Environments for FPS World Models

Zizhao Tong, Hongfeng Lai, Zeqing Wang, Zhaohu Xing, Kexu Cheng, Haoran Xu, Zhao Pu, Shangwen Zhu, Ruili Feng, Jian Zhao, Yan Zhang, Hao Tang, Yeying Jin, Ling Shao

UCAS-Terminus AI Lab, University of Chinese Academy of Sciences, National University of Singapore, Zhejiang University, Shanghai Jiaotong University, The Hong Kong University of Science and Technology (Guangzhou), University of Waterloo, Zhongguancun Institute of Artificial Intelligence, State Key Laboratory of Multimedia Information Processing, School of Computer Science, Peking University

2026-05-25强化学习

论文针对 FPS 世界模型中高频、重叠操作用全局动作条件会扰动整帧、难以跨游戏泛化的问题,提出按像素的 SCOPE 条件模块:依据局部视觉内容区分武器附近的离散动作作用域与背景中的连续运动生成,并构建含 7 款游戏、6.9 万片段和 10-DoF 遥测的 CrossFPS。实验显示其动作响应、作用域分离和未见场景零样本迁移更稳,但复杂多步交互仍受数据多样性限制,部分收益可能来自 scaling / data。

No Figure
2026-05-25cs.CV

CHASD: Language Increment-Calibrated Contrastive Decoding against Hallucination in LVLMs

Xiaoyi Huang, Kejia Zhang, Zhiming Luo

Institute of Artificial Intelligence, Xiamen University, Department of Artificial Intelligence, Xiamen University

2026-05-25视觉语言

针对LVLM在视觉证据不足或注意力错位时受语言先验驱动产生物体幻觉的问题,CHASD指出幻觉风险并非全序列均匀存在,而是随token和注意区域动态变化。方法在推理时用置信度门控只对低置信步骤启用对比解码,并基于跨模态注意力局部扰动当前显著视觉token构造负分支。实验在POPE、AMBER、MME、MMHal-Bench和CHAIR上优于多种免训练基线,同时减少不必要的负分支前向计算。

GFSR: Geometric Fidelity and Spatial Refinement for Reliable Lane Detection Figure 1
2026-05-25cs.CV

GFSR: Geometric Fidelity and Spatial Refinement for Reliable Lane Detection

Tiancheng Wang, Zhaolu Ding, Richeng Xu, Tianhui Zheng, Hui Liu, Hanyu Xuan, Zhiliang Wu, Guanghui Yue

in part by the Natural Science Research Project of Anhui Educational Committee (No.2024AH040012). 1 the School of Big Data and Statistics, Anhui University, Hefei 230039, China., the School of Artificial Intelligence and Data Science, University of Science and Technology of China, Hefei 230026, China., Institute of Dataspace, Hefei Comprehensive National Science Center, Hefei 230088, China., the College of Computing and Data Science, Nanyang Technological University, Singapore 639798, Singapore., the School of Biomedical Engineering, Shenzhen University Medical School, Shenzhen University, Shenzhen 518060, China.

2026-05-25视觉感知

针对基于线锚的车道检测中过度依赖分类置信度、易保留几何质量差候选,以及采样点回归相关性弱导致远距/大曲率车道欠拟合的问题,GFSR用LaneIoU监督校准几何可信度并与分类分数形成CRI筛选候选,同时以自适应门控细化采样点偏移。实验在CULane达F1@50 81.46%、F1@75 65.01%,CurveLanes达F1@50 87.35%。

Enhancing Blood Cells Classification using Hybrid Quantum Neural Networks Figure 1
2026-05-25cs.CV

Enhancing Blood Cells Classification using Hybrid Quantum Neural Networks

Guilherme Cruz, Nouhaila Innan, Alberto Marchisio, Gabriel Falcao, Muhammad Shafique

∗Instituto de Telecomunicac¸˜oes, University of Coimbra, Portugal, † eBrain Lab, Division of Engineering, New York University Abu Dhabi, PO Box 129188, Abu Dhabi, UAE, ‡ Center for Quantum and Topological Systems, NYUAD Research Institute, New York University Abu Dhabi, UAE, § Science Division, New York University Abu Dhabi, UAE, conducted on two publicly available blood cell datasets, namely, laboratory environments, their reliability degraded sharply when, the growing availability of large, expertly annotated medical, continue to limit scalability. Since most contemporary research

2026-05-25视觉感知

针对显微血细胞细粒度分类中形态差异微小、数据有限导致 CNN 表征易混淆的问题,本文将预训练 ResNet-50、低维瓶颈与变分量子线路结合,并用容量匹配的经典非线性层作受控对比,以隔离量子特征变换作用。在两个公开数据集上,HQNN 的指标更均衡,4 类任务 macro F1 最高提升 3.7%,8 类近饱和场景 F1 从 98.54% 提至 98.69%;IBM 真机推理仅小幅退化,但量子增益的普适性仍需更多任务验证。

No Figure
2026-05-25eess.IV

Efficient Learned Image Compression without Entropy Coding

Hao Cao, Wenqi Guo, Zhijin Qin, Jungong Han

2026-05-25视觉感知

针对学习式图像压缩中熵编码难以并行、成为端到端延迟瓶颈的问题,论文提出无熵编码的多码率 EF-LIC:用无约束向量量化使索引接近最大熵以减少统计冗余,并用上下文条件自回归变换在表征域去相关。实验在 Kodak/LPIPS 上相对 MS-ILLM 最高降码率 67.86%,且在同架构下接近熵编码版本性能,同时编码超 3 倍、解码超 5 倍加速。

General Hazard Detection Figure 1
2026-05-25cs.CV

General Hazard Detection

Stephanie Ng, CP Lim, SueJen Looi, Hendrik Zurlinden, David Nguyen, Lei Wei, Saeid Nahavandi, Hailing Zhou

2026-05-25视觉感知

本文针对传统危险检测依赖固定类别、难以处理安全规则抽象性和场景变化的问题,将危险识别重构为基于法规文本的视觉合规判断。其核心是 CompliVision 数据集和结合 LLaVA 推理、主动学习与人工反馈的框架,在交通、施工、仓储场景中用规则约束视觉证据。实验显示该方法可减少超过 65% 人工标注量,并接近全监督微调性能。

No Figure
2026-05-25cs.CV

Spatio-Temporal Similarity Volume Aggregation for Open-Vocabulary Action Recognition

Yerim So, Jiyeong Kim, Jiwon Yoon, Dongbo Min

Ewha Womans University, South Korea

2026-05-25视觉感知

针对开放词表动作识别中先汇聚视频特征再与文本对齐会丢失局部运动线索的问题,SimVA将CLIP的patch级视觉-文本相似度组织成时空4D相似度体,并在相似度空间用类别采样、Swin空间聚合、运动调制和Mamba时序聚合建模动作演化。实验在K400预训练后,于HMDB-51、UCF-101、K600等零样本,以及少样本和base-to-novel设置中均优于或接近现有方法。

LangFlash: Feed-forward 3D Language Gaussian Splatting from Sparse Unposed Images Figure 1
2026-05-25cs.CV

LangFlash: Feed-forward 3D Language Gaussian Splatting from Sparse Unposed Images

Yilong Liu, Wanhua Li, Chen Zhu-Tian, Hanspeter Pfister

Harvard University, Nanyang Technological University, Tsinghua University, University of Minnesota - Twin Cities

2026-05-25视觉感知三维

针对现有3D重建多只建模几何/外观、语义方法依赖逐场景优化或高维特征回归而难以实时泛化的问题,LangFlash从稀疏且无位姿多视图图像前馈预测带语言语义的3D高斯场,并用全局语义字典加每高斯稀疏权重降低表示成本,同时扩展RE10k语义监督。实验显示其在新视角合成和开放词汇3D分割语义一致性上优于已有方法,单场景推理约180 ms,但部分增益可能来自数据规模。

No Figure
2026-05-25eess.IV

Discontinuous Galerkin Neural Operator for Pathology Defocus Deblurring

Shaoqing Duan, Haofei Song, Xintian Mao, Qingli Li, Yan Wang

2026-05-25视觉感知

病理显微图像离焦模糊具有空间变化和局部不连续特性,传统卷积、Transformer或全局神经算子难以对应其物理成像过程。论文将去模糊视为变系数积分算子的逆问题,提出DGNO,用不连续Galerkin思想把核分解为单元局部算子与界面数值通量,以兼顾局部异质性和全局一致性。实验显示其在BBBC006等数据上优于NAFNet、Restormer、MPT、MambaIRv2及SRNO,重建更锐利且高分辨率扩展性更好。

DepthAgent: Towards Better Universal Depth Estimation via Sample-wise Expert Selection Figure 1
2026-05-25cs.CV

DepthAgent: Towards Better Universal Depth Estimation via Sample-wise Expert Selection

Jie Zhu, Girish Chandar Ganesan, Xiaoming Liu

Michigan State University, University of North Carolina at Chapel Hill

2026-05-25视觉感知

论文针对单目度量深度在透视、鱼眼、全景等相机域中单一模型难以稳定泛化的问题,指出不同深度专家具有随样本和相机几何变化的互补性。DepthAgent 将冻结深度模型作为工具,由 VLM 通过多轮调用按样本选择或融合专家,并用多奖励强化微调约束工具执行、场景/相机推理、质量与效率。实验显示其在多类基准上优于单模型、固定融合和其他选择策略,困难样本增益更明显。

U-CESE: Unified Clip-based Event Search Engine for AI Challenge HCMC 2025 Figure 1
2026-05-25cs.CV

U-CESE: Unified Clip-based Event Search Engine for AI Challenge HCMC 2025

Duc-Nhuan Le, Hoang-Phuc Nguyen, Thanh-Duy Lam, Minh-Nhut Dang, Minh-Hoang Le

2026-05-25视觉感知

面向 AIC HCMC 2025 中大规模、多源视频的事件检索需求,U-CESE 将原 CESE 分散的视觉、文本与关键词检索统一为剪辑级框架,并提出统一剪辑算法、基于 JPEG 文件大小变化的免训练 DAKE 关键帧抽取,以及具时序一致性的 ReCap 描述生成。实验称系统在多模态检索中更稳健高效,但具体增益幅度文中片段未充分说明。

EvalVerse: Pipeline-Aware and Expert-Calibrated Benchmarking for Professional Cinematic Video Generation Figure 1
2026-05-25cs.CV

EvalVerse: Pipeline-Aware and Expert-Calibrated Benchmarking for Professional Cinematic Video Generation

Songlin Yang, Haobin Zhong, Ruilin Zhang, Xiaotong Zhao, Shuai Li, Kai Zheng, Xuyi Yang, Zhe Wang, Zhenchen Tang, Yang Li, Bohai Gu, Zhengwei Peng, Yidan Huang, Mengzhou Luo, Yihang Bo, Dalu Feng, Yujia Zhang, Juntao Ma, Ruiqi Wang, Lvmin Zhang, Yuwei Guo, Frank Guan, Maneesh Agrawala, Hongbo Fu, Alan Zhao, Anyi Rao

The Hong Kong University of Science and Technology, 2 Tencent, 3 Tsinghua University, Institute of Automation, Chinese Academy of Sciences, 5 Beijing Film Academy, Stanford University, 7 The Chinese University of Hong Kong, 8 Singapore Institute of Technology

2026-05-25视觉感知数据集/基准

EvalVerse针对专业级视频生成评测只看提示对齐、难以衡量电影“好不好”的瓶颈,提出按前期、拍摄、后期流程组织的评测分类体系,并用34名专家标注校准VLM的CoT评分器,覆盖文本/参考生成、多镜头和音视频任务。文中称其在人机一致性、细粒度诊断和RL奖励/评测代理潜力上优于既有基准,但具体增益来源可能部分来自专家数据与校准流程。

ChainFlow-VLA: Causal Flow Planning with Vision-Language Models Figure 1
2026-05-25cs.CV

ChainFlow-VLA: Causal Flow Planning with Vision-Language Models

Xiyang Wang, Xinlin Wang, Tingguang Zhou, Gong Chen, Xingtai Gui, Zhi Xu, Xiaolei Wu, Feiyang Tan, Hangning Zhou, Mu Yang

Tianjin University, University of Macau

2026-05-25视觉语言视觉感知生成模型规划控制

该文针对端到端自动驾驶中自回归规划易累积误差、扩散规划缺少显式时序因果约束的问题,提出 ChainFlow-VLA:先用 AR“Chain”生成具因果一致性的多模态轨迹候选,再以 VLM 隐状态作为语义先验驱动残差扩散“Flow”做细粒度修正,把语义理解放到规划纠错阶段。实验在 NAVSIM v1 得到 94.85,达到或略超人类水平 94.8,但具体增益中 VLM、两阶段结构与训练规模的相对贡献仍需看消融。

Coloring the Noise: Adversarial Sobolev Alignment for Faithful Image Super Resolution Figure 1
2026-05-25cs.CV

Coloring the Noise: Adversarial Sobolev Alignment for Faithful Image Super Resolution

Hongbo Wang, Huaibo Huang, Pin Wang, Jinhua Hao, Chao Zhou, Ran He

2026-05-25视觉感知

本文针对生成式超分辨率中真实纹理与幻觉细节难区分的问题,指出根源在各向同性高斯噪声目标与自然图像频谱衰减不匹配。ASASR通过彩色噪声与Sobolev几何重塑优化度量,并用Riesz理论驱动的对抗器在线生成困难负样本。实验显示其在扩散/GAN基线中更好兼顾真实感与结构保真,尤其提升频谱一致性并减少伪影。

Turning Adaptation into Assets: Cross-Domain Bridging for Online Vision-Language Navigation Figure 1
2026-05-25cs.RO

Turning Adaptation into Assets: Cross-Domain Bridging for Online Vision-Language Navigation

Zixuan Hu, Xuantuo Huang, Yancheng Li, Yichun Hu, Shengyong Xu, Ling-Yu Duan

2026-05-25机器人视觉语言视觉感知

该文针对视觉语言导航在真实部署中遭遇连续环境分布变化时,传统测试时自适应易遗忘历史经验并产生负迁移的问题,提出 IDEA:将软提示及其域坐标保存为可复用“资产库”,并用 Fisher 引导筛选可迁移知识,再通过历史资产凸包投影构造免训练跨域桥接初始化。实验在 REVERIE、R2R 与 R2R-CE 上验证了稳定增益,离散基准平均提升约 +2.5% SR、+1.9% SPL。

No Figure
2026-05-25cs.CV

CARE: Class-Adaptive Expert Consensus for Reliable Learning with Long-Tailed Noisy Labels

Mengke Li, Haiquan Ling, Lihao Chen, Yang Lu, Yiqun Zhang, Hui Huang

2026-05-25视觉感知

该文关注真实视觉数据中长尾类别与标注噪声叠加的问题,指出仅降低总体噪声率会忽视尾类更高噪声并可能使头类过度校准。CARE利用观测标签、VLM文本嵌入和图像特征三类“专家”,按类别频次自适应调整Top-K共识,尾类要求更严格一致、头类更宽松,并据此修正标签分布和类先验。在合成与真实LTNL基准上优于现有方法,最高带来约3.0%性能增益。

SimInsert: Seamless Video Object Insertion via Regional Sparse Attention Fusion Figure 1
2026-05-25cs.CV

SimInsert: Seamless Video Object Insertion via Regional Sparse Attention Fusion

Xinyu Chen, Yuyi Qian, Jiang Lin, Shenyi Wang, Gao Wang, Zhiqiu Zhang, Jizhi Zhang, Mingjie Wang, Qiang Tang, Qian Wang, Song Wu, Zili Yi

2026-05-25视觉感知

针对视频插入新物体常需手工轨迹、重训练且易破坏背景的问题,SimInsert将任务拆为首帧编辑与文本驱动的I2V时序传播,并用区域注意力克隆保背景、稀疏注意力融合处理边界交互、Latent Refresh抑制去噪漂移。实验显示其相对现有方法PSNR提升18.8%、SSIM提升20.1%、LPIPS降低44.1%。

No Figure
2026-05-25cs.CV

StereoGenBench: A Synthetic Multi-Camera Benchmark for Stereo Generation under Controlled Baseline Regimes

Yangzhi Cui, Feng Qiao, Nathan Jacobs

Washington University in St. Louis

2026-05-25规划控制数据集/基准

现有立体生成评测多固定基线和内参,难以区分模型的场景能力与几何尺度偏置。StereoGenBench用Unreal构建六相机横向阵列,同一场景最多提供15个标定视对,并释放RGB、米制深度、内参、基线和逐帧位姿,覆盖窄/宽基线划分。文中参考评测按oracle几何、标定目标相机和单目无对齐三类报告,显示该基准能暴露不同基线下的右视图生成漂移,但真实世界相关性仍需另证。

Beyond Normal References: Discriminative Few-Shot Anomaly Detection Figure 1
2026-05-25cs.CV

Beyond Normal References: Discriminative Few-Shot Anomaly Detection

Huan Wang, Jun Shen, Jun Yan, Guansong Pang

University of Wollongong, Australia, Singapore Management University, Singapore

2026-05-25视觉感知

这篇论文针对少样本异常检测中只用正常参考会缺少判别线索、直接用异常参考又易过拟合已见缺陷的问题,提出“判别式 FSAD”设定和 IDEAL 框架。其核心是把异常理解为相对正常样本的可泛化偏离,通过正常变化擦除器去除光照、纹理等无关扰动,再用内在偏离编码器学习正交偏离方向。八个真实数据集实验显示,IDEAL在已见与未见异常上均优于现有FSAD方法。

No Figure
2026-05-25cs.CV

CaST-Bench: Benchmarking Causal Chain-Grounded Spatio-Temporal Reasoning for Video Question Answering

Mingfang Zhang, Jingjing Pan, Ashutosh Kumar, Rajat Saini, Mustafa Erdogan, Hsuan-Kung Yang, Caixin Kang, Yifei Huang, Yoichi Sato, Quan Kong

The University of Tokyo

2026-05-25视觉感知数据集/基准

针对现有视频问答基准多停留在描述性理解、缺少因果证据定位的问题,CaST-Bench提出因果链约束的时空推理评测:在1015个开放域视频上构建2066个问题,并标注时间片段与目标框轨迹,以同时考察答案正确性和证据 grounding。实验显示当前VLM与人类差距明显,人类准确率91.89%,最佳闭源/开源模型仅50.34%/45.30%,说明瓶颈主要在精确构建因果链。

Lipschitz Optimization for Formal Verification of Homographies Figure 1
2026-05-25cs.CV

Lipschitz Optimization for Formal Verification of Homographies

Jean-Guillaume Durand, Panagiotis Kouvaros, Maxime Gariel, Alessio Lomuscio

2026-05-25优化算法

面向自动驾驶、航空等安全关键视觉系统,论文指出现有形式化验证多限于像素范数或2D仿射扰动,难以刻画相机3D运动。其核心是把平面场景中的相机位姿扰动写成闭式单应变换,并结合 Lipschitz 优化与分段线性连续性,为变换后像素值构造可验证的紧线性界。实验显示实现相较既有PWL方法最高提速89%、界限最多收紧7%,并在VNN-COMP与跑道分类案例中暴露了网络对透视扰动的系统脆弱性。

Occlusion-Aware Physics-Semantic Keyframe Selection for Robust Video Editing Figure 1
2026-05-25cs.CV

Occlusion-Aware Physics-Semantic Keyframe Selection for Robust Video Editing

Lin Liu, Zhihan Xiao, Haohang Xu, Rong Cong, Zhibo Zhang, Xiaopeng Zhang, Qi Tian

Tsinghua University, East China Normal University, Tsinghua University China, East China Normal University China

2026-05-25视觉感知安全鲁棒

该文针对遮挡、视角变化和快速运动下视频编辑易定位错误、闪烁的问题,提出 ORVE:不直接重建遮挡内容,而是从结构完整性、循环一致跟踪稳定性和视觉语言属性可见性三方面自动选择可靠关键帧,再双向传播生成时空掩码以约束扩散编辑。实验称在复杂遮挡基准上提升空间精度和时间一致性,但具体量化增益在给定片段中未充分说明。

No Figure
2026-05-25cs.CV

IntentionNav: A Benchmark for Intent-Driven Object Navigation from Implicit Human Instruction

Lin Qian, Shijie Li, Sihao Lin, Xuan Zhang, Bangya Liu, Yanran Li, Hujun Yin

The University of Manchester, Responsible AI Research Centre, Adelaide University, University of Bedfordshire

2026-05-25机器人数据集/基准

针对现有 ObjectNav 多假设目标类别已给定、难以评估机器人从“我想热饭”“房间闷”等隐式需求中推断目标的问题,论文提出 IntentionNav 基准:在 176 个 Isaac Sim 场景中构建 500 个意图、64 类目标,并用四种话语风格和四类语义线索做成配对诊断集。实验显示三种 VLM 虽能在 48.3% 情况下猜中目标、68.7% 到达 2 米邻域,但成功停止仅 24.9%,1 米 grounded success 只有 5.5%,瓶颈主要在意图到目标推断、视觉确认和终止定位。

GMENet: Generative Mixture of Experts Network for Multi-Center Glioma Diagnosis with Incomplete Imaging Sequences Figure 1
2026-05-25eess.IV

GMENet: Generative Mixture of Experts Network for Multi-Center Glioma Diagnosis with Incomplete Imaging Sequences

Pengfei Song, Fangjin Liu, Wenwen Zeng, Yonghuang Wu, Chengqian Zhao, Feiyu Yin, Xuan Xie, Jinhua Yu

School of Biomedical Engineering and Technology Innovation, Fudan University, Institute of Science and Technology for Brain-Inspired Intelligence, Fudan University

2026-05-25生成模型

临床多中心胶质瘤 MRI 常因协议差异缺失 T1c/FLAIR 等序列,现有模型只能丢弃样本,影响泛化。GMENet 用交叉注意力与门控生成缺失序列特征,并以动态加权专家融合原始/合成特征,联合预测 IDH、1p/19q 和病理类型。在 1241 例六中心数据上,可用训练数据增加 97%,且优于完整序列训练的 SOTA,跨中心鲁棒性更好。

No Figure
2026-05-25cs.CV

Composing People Together: Iterative Pose-Image Generation for Multi-Person Interaction Scenes

Wenxuan Peng, Bharath Hariharan, Hadar Averbuch-Elor

Cornell University, Cornell University Ithaca USA, Cornell University New York New York USA

2026-05-25视觉感知三维

论文针对现有文生图模型在多人互动场景中易漏人、角色关系错位、姿态和构图趋同的问题,提出 PeopleComposer:在扩散 Transformer 中联合生成二维姿态图与 RGB 图像,并用跨模态对齐和逐人迭代构建把复杂互动拆解为更简单的生成步骤。作者还构建 DrawWaldoWorlds 评测集,实验显示相较 SDXL、FLUX 等方法在提示语对齐和场景多样性上均有明显提升。

No Figure
2026-05-25cs.CV

DRIVESPATIAL: A Benchmark for Spatiotemporal Intelligence in VLMs for Autonomous Driving

Hao Vo, Khoa Vo, Phu Loc Nguyen, Sieu Tran, Duc Minh Nguyen, Ngo Xuan Cuong, Gladys Gawugah, Sreevenkata Anjani Tishita Godavarthi, Chase Rainwater, Nghi D. Q. Bui, Anh Nguyen, Duy Minh Ho Nguyen, Ngan Le

University of Arkansas, USA, University of Liverpool, UK, Max Planck Research School for Intelligent Systems

2026-05-25视觉语言数据集/基准

针对现有自动驾驶 VLM 基准偏单视角、静态和自车中心,难以检验真实多视角时空场景理解的问题,DriveSpatial 从五个 AD 数据集构建 1.56 万个人工校验 QA,并以动态多关系场景图强制跨视角、时间和泛化推理。对 15 个 VLM 的评测显示最强模型仍落后人类 28.4 分,认知场景构建是主要瓶颈;仅语言提示无效,而显式 BEV grounding 能稳定改善表现。

LQ-rPPG: A Label-Quantized Coarse-to-Fine Learning Framework for Remote Physiological Measurement Figure 1
2026-05-25cs.CV

LQ-rPPG: A Label-Quantized Coarse-to-Fine Learning Framework for Remote Physiological Measurement

Jun Seong Lee, Samyeul Noh, Changki Sung, Hyun Myung

2026-05-25视觉感知

针对rPPG训练中接触式PPG标签易受运动伪影、接触不稳和波形差异影响,导致模型过拟合标签噪声的问题,本文提出LQ-rPPG:先将连续PPG量化为多比特伪标签,再用由粗到细的层级监督逐步恢复信号。多数据集实验显示其在域内与跨数据集评测中表现稳健,同时参数量降88%、MACs降29%、吞吐提升191%。

No Figure
2026-05-25cs.RO

Semantic-Aware Guided Drone Exploration for Language-Conditioned 3D Indoor Mapping

Nitin Vegesna, Avideh Zakhor

Department of Electrical Engineering and Computer Sciences, University of California, Berkeley

2026-05-25三维

面向室内无人机三维建图,论文关注如何在保持前沿式覆盖探索的同时按开放词汇语言查询更快发现目标物体。SAGE在FALCON上引入CLIP对象级记忆、短时语义缓存、对象前沿和受限语义-几何代价,使语义只重排而不破坏覆盖。仿真中其目标发现优于FALCON和语义消融,相比FTU在9组共享任务上探索快9.0–25.9倍;真实飞行也显示发现能力提升但轨迹与速度不如纯FALCON。

SLIP-RS: Structured-Attribute Language-Image Pre-Training for Remote Sensing Object Detection Figure 1
2026-05-25cs.CV

SLIP-RS: Structured-Attribute Language-Image Pre-Training for Remote Sensing Object Detection

Chenxu Wang, Yuxuan Li, Yunheng Li, Xiang Li, Jingyuan Xia, Qibin Hou

2026-05-25视觉感知

针对遥感目标检测中细粒度标注稀缺、开放类别难以穷举的问题,SLIP-RS将类别拆解为有限且具物理意义的结构属性,用SACL通过属性组合增强学习解耦表征,并用CARE基于保形预测过滤噪声、构建1500万级属性标注。实验显示其在细粒度检测、跨域泛化和下游微调上优于现有方法,但部分增益可能主要来自更大规模属性数据。

VisAnalog: A Diagnostic Suite for Visual Concept Transfer on Natural Images Figure 1
2026-05-25cs.CV

VisAnalog: A Diagnostic Suite for Visual Concept Transfer on Natural Images

Zhaonan Li, Kyle R. Chickering, Bangzheng Li, Jacob Dineen, Xiao Ye, Zhikun Xu, Shijie Lu, Yuxi Huang, Ming Shen, Bach Nguyen, Jaya Adithya Pavuluri, Mau Son Nguyen, Sanika Chavan, Ngoc Minh Thu Le, Muhao Chen, Ben Zhou

Arizona State University

2026-05-25视觉感知

这篇论文关注 VLM 是否真正学会可迁移的视觉概念,而不只是识别单张图像。作者提出 VisAnalog,用自然图像构造 A:B::C:? 类视觉类比,要求模型从 A→B 推断缩放、旋转、翻转、色相等确定性变换并应用到隐藏目标 D。实验显示,强开闭源 VLM 在直接看到 D 时表现高得多,但端到端推理随多步组合急剧下降;诊断表明主要瓶颈是关系推断,复杂情况下还叠加变换执行错误。

No Figure
2026-05-25eess.IV

STAMBRIDGE: Spectral-Temporal Amplitude-aware Mid-Feature Bridge for EEG Visual Decoding

Jiahe Meng, Weiming Zeng, Yueyang Li, Bo Chai, Hongjie Yan, Zhiguo Zhang, Wai Ting Siok, Nizhuan Wang

Lab of Digital Image and Intelligent Computation, Shanghai Maritime University, Shanghai 201306, China, Department of Language Science and Technology, The Hong Kong Polytechnic University, Hung Hom, Kowloon, Hong Kong SAR, China, Department of Neurology, Affiliated Lianyungang Hospital of Xuzhou Medical University, Lianyungang 222002, China, Institute of Computing and Intelligence, Harbin Institute of Technology Shenzhen, Shenzhen 518000, China

2026-05-25视觉感知

针对低信噪比 EEG 与 CLIP 等视觉语义空间直接对齐不稳定的问题,STAMBRIDGE 将任务拆成特征调理与跨模态对齐两阶段:用幅度驱动的软频谱通道加权和多尺度时域卷积保留瞬态、减轻硬频域掩蔽振铃,再以中间语义桥做分阶段蒸馏。在 THINGS-EEG 上取得 200 类零样本检索 Top-1 34.50%、Top-5 65.95%,并能驱动扩散模型生成语义一致重建。

Exploiting Longitudinal Context in Clinician-Verified Interactive Lesion Tracking Figure 1
2026-05-25cs.CV

Exploiting Longitudinal Context in Clinician-Verified Interactive Lesion Tracking

Yannick Kirchhoff, Maximilian Rokuss, Daniel Philipp Mertens, David Füller, Benjamin Hamm, Andreas Schreyer, Oliver Ritter, Klaus Maier-Hein

2026-05-25视觉感知

针对肿瘤在连续 CT 中需同时找回同一病灶并精确勾画、而全自动跟踪难纠错且注册后分割又丢失基线外观的问题,论文提出“Verified Tracking”:由注册给出随访点、医生确认或修正,再用结合基线与随访提示的网络分割;模型采用早期点提示融合、潜空间时序差异加权,并以合成纵向数据预训练。结果在 MICCAI autoPET IV 获第一,较从零训练最高提升 4.5 Dice,并发布 PanTrack 验证跨域泛化。

CoReVAD: A Contextual Reasoning Framework for Training-Free Video Anomaly Detection Figure 1
2026-05-25cs.CV

CoReVAD: A Contextual Reasoning Framework for Training-Free Video Anomaly Detection

Hyeongmuk Lim, Youngbum Hur

2026-05-25视觉感知

针对视频异常检测依赖任务训练、域迁移成本高且只给分数缺少解释的问题,CoReVAD尝试用单个冻结VLM完成免训练检测与时序描述生成;其关键在于用局部视觉-文本对齐清洗VLM噪声,再结合全局相似度softmax、 Gaussian平滑和位置加权细化帧级分数。在UCF-Crime和XD-Violence上,方法相对免训练基线表现有竞争力,并能输出可读解释。

Inconsistency-aware Multimodal Schrödinger Bridge for Deepfake Localization Figure 1
2026-05-25cs.CV

Inconsistency-aware Multimodal Schrödinger Bridge for Deepfake Localization

Jiayu Xiong, Jing Wang, Qi Zhang, Wanlong Wang, Jun Xue

Department of Computer Science and Techonology, Huaqiao University, Xiamen Key Laboratory of Computer Vision and Pattern Recognition, Huaqiao University, Tongji University, School of Cyber Science and Engineering, Wuhan University

2026-05-25视觉语言

针对音视频 Deepfake 定位中单模态篡改或异步篡改会让对称融合传播噪声、损害高 IoU 边界精度的问题,论文提出 IaMSB,将跨模态一致性估计表述为 Schrödinger Bridge 传输,并用粗到细桥、证据筛选和非对称步数分配来抑制负迁移。实验在 LAV-DF、AV-Deepfake1M、TVIL 上显示严格定位更稳,AP@0.95 提升约 3%–10%,单侧篡改场景收益更明显。

No Figure
2026-05-25eess.IV

Do Synthetic Brain MRIs Reliably Improve Tumour Classification? A StyleGAN2-ADA Class-Plane Augmentation Study on BRISC 2025

José Rafael Noriega Cedeño

2026-05-25生成模型

针对小规模医学影像中“GAN 合成图像是否真正提升下游诊断”这一问题,论文在 BRISC 2025 上训练 12 个按肿瘤类别与切面划分的 StyleGAN2-ADA,并比较过滤、配比和三类分类器。结果显示收益并不由视觉逼真保证:RF 无益,CNN 增益未过校正,MobileViTV2 在过滤 1:1 下显著提升约 1.02%,且减少真实数据训练轮次。

No Figure
2026-05-25cs.CV

Flow Mismatching: Unsupervised Anomaly Detection via Velocity Discrepancies in Flow Matching Models

Shengzhe Chen, Mehrdad Moradi, Kamran Paynabar, Hao Yan

Arizona State University, Georgia Institute of Technology

2026-05-25视觉感知生成模型

面向仅有正常样本的工业视觉异常检测,论文指出重建式方法可能把缺陷也重建掉,削弱残差信号。其核心洞察是:正常数据训练的 flow matching 速度场应与通向正常图像的几何速度一致,而异常区域会产生局部速度不匹配;据此只用前向传播聚合多时间步、多路径差异,生成热图和图像级分数。实验在 MVTec-AD 与 VisA 上优于多种重建式和 flow matching 基线。

RoboSurg-VQA: A Multimodal Benchmark for Surgical Segmentation-Aware Visual Question Answering Figure 1
2026-05-25cs.CV

RoboSurg-VQA: A Multimodal Benchmark for Surgical Segmentation-Aware Visual Question Answering

Chengyi Zhang, Zi Ye, Ziyang Wang

2026-05-25视觉语言视觉感知数据集/基准

针对手术机器人/微创场景中分割指标难以回答临床关于上下文、可见性与伪影问题的不足,RoboSurg-VQA将多套公开手术分割数据统一为带掩码支撑的闭集VQA基准,设计9类固定问题,并用受约束模型标注、自动一致性检查和人工审核控质。结果显示发布标注无解析和词表违规,15%抽检中4.8%被修正;多数类先验会显著抬高准确率而Macro-F1偏低,说明需按不平衡和退化视野评测。

No Figure
2026-05-25cs.CV

Dithering Defense: Adversarial Robustness of Vision Foundation Models via Multi-Level Floyd-Steinberg Dithering

Yury Belousov, Brian Pulfer, Vitaliy Kinakh, Slava Voloshynovskiy

2026-05-25视觉感知安全鲁棒

针对视觉基础模型常作为冻结骨干、一次被对抗扰动击穿就会影响多类下游任务的问题,论文把多级 Floyd–Steinberg 误差扩散抖动作为无需重训、模型无关的输入防御,并指出量化级数存在折中:过低损伤语义,过高保留攻击,中间级别更有效。在 DINOv2、PaliGemma 的分类、分割、深度、检索、VQA、 captioning 及 PGD/MI-FGSM/SIA、自适应攻击下,中间 K 配合模糊整体匹配或优于 JPEG、扩散去噪等基线,且干净样本退化较小。

Millimeter-wave Imaging for Anthropometric Body Measurement Figure 1
2026-05-25cs.CV

Millimeter-wave Imaging for Anthropometric Body Measurement

Miriam Senne, Benjamin D. Killeen, Christoph Baur, Nassir Navab, Azade Farshad

2026-05-25视觉感知

针对皮尺和光学人体测量需脱衣、依赖操作者且不适合行动受限人群的问题,论文用可穿透日常衣物的毫米波体数据进行接触式替代。核心是将前后毫米波扫描转为点云,并用带可见性顶点权重的 Chamfer 配准、地面脚底约束和姿态先验拟合 SMPL,从闭合网格提取胸围、腰围、臀围和身高。27名受试者与假人实验显示,该方法在有外衣和稀疏覆盖下较单目 RGB 与手工测量更稳健,假人结果接近商用3D扫描。

The TIME Machine: On The Power of Motion for Efficient Perception Figure 1
2026-05-25cs.CV

The TIME Machine: On The Power of Motion for Efficient Perception

Mantas Skackauskas, Xinyue Hao, Laura Sevilla-Lara

School of Informatics, University of Edinburgh

2026-05-25视觉感知

针对视频模型依赖海量真实视频和语言监督、却仍弱于细粒度时序理解的问题,论文提出以稀疏点轨迹运动作为核心模态,用掩码自编码器重建缺失轨迹,并仅在 Kubric 合成物理运动上训练 TIME 表征。结果显示其在 CLEVRER、SSv2 等时序任务上可接近或超过强视频模型,且训练数据少至约 4 个数量级;与 V-JEPA2、DINOv3 等外观特征结合时,在 Ego-Exo4D 等细粒度任务上进一步提升,最高约 18%。

No Figure
2026-05-25cs.LG

RADAR: Relative Angular Divergence Across Representations

Xavier Cadet, Mateusz Nowak, Peter Chin

Dartmouth College

2026-05-25视觉感知

针对跨域扩充数据可能导致负迁移、逐一微调评估代价高的问题,RADAR用冻结基础模型的多层表征轨迹来估计可迁移性:比较域内与跨域样本在层间位移中的角度对齐和相对距离变化,并以GMM与对称KL刻画分布差异。在视觉与文本基准上,它在10种配置中7次进入前三、6次最佳,尤其适合域过渡平滑或分离清晰的场景。

Scene Reconstruction as Mapping Priors for 3D Detection Figure 1
2026-05-25cs.CV

Scene Reconstruction as Mapping Priors for 3D Detection

Yang Fu, Yuliang Zou, Hao Xiang, Xin Huang, Yijing Bai, Chen Song, Weijing Shi, Govind Thattai, Dragomir Anguelov, Mingxing Tan, Yingwei Li

2026-05-25视觉感知三维

面向自动驾驶三维检测中远距离稀疏、遮挡和恶劣感知条件下的歧义问题,论文不依赖昂贵人工 HD 地图,而是从聚合相机/LiDAR数据自动重建 surfel 与 3DGS 作为场景先验,并提出 MPA3D 以门控融合和混合模态训练整合地图、LiDAR与图像特征。在 Waymo Open Dataset 上报告达到新的 SOTA,说明可扩展重建先验能有效提升3D检测。

CoMoGen: COntrollable MOtion Dynamics and Interactions with Mask-Guided Video GENeration Figure 1
2026-05-25cs.CV

CoMoGen: COntrollable MOtion Dynamics and Interactions with Mask-Guided Video GENeration

Adil Meric, Lin Geng Foo, Mert Kiray, Benjamin Busam, Rishabh Dabral, Christian Theobalt

2026-05-25视觉感知规划控制

针对可控视频生成中运动与交互难以用光流、轨迹等密集信号高效建模的问题,CoMoGen仅用输入图像和二值掩码序列驱动主体运动。其核心是轻量MaskAdapter将掩码转为潜空间残差,并通过注意力对齐识别MMDiT中的“运动层”,只在这些层注入控制并做LoRA微调,配合余弦衰减调度降低成本。实验显示其在BEHAVE、CLEVRER等数据集上优于InterDyn、GoFlow、MagicMotion等方法,提升运动保真度和感知真实感。

GazeBehavior Annotation Toolkit (GBAT): AI-powered toolkit for automatic annotation of egocentric eye-tracking and video data of child-caregiver interaction Figure 1
2026-05-25cs.CV

GazeBehavior Annotation Toolkit (GBAT): AI-powered toolkit for automatic annotation of egocentric eye-tracking and video data of child-caregiver interaction

Iba Baig, Kevin Li, Yanbin Xu, Seiji Cattelain, Marie Hallo, Hayato Ono, Sho Tsuji, Ming Bo Cai

2026-05-25视觉感知

针对儿童—照护者自然互动中第一视角眼动、多机位视频难以同步且人工标注成本高的问题,GBAT把音频谱相关同步、SAM2提示式凝视目标分割与Tarsier 2时序行为标注整合为本地可部署工具链。文中在3–4岁亲子互动数据上展示其可生成对齐时间戳、凝视目标序列及姿态/手部动作标签,显著提升标注效率;但手部动作精度低于姿态,跨视角融合增益仍未充分说明。

Improved Vision-to-Chart Buoy Association with Learned World-to-Image Projection Figure 1
2026-05-25cs.CV

Improved Vision-to-Chart Buoy Association with Learned World-to-Image Projection

Borja Carrillo-Perez (Arquimea Research Center)

2026-05-25视觉感知强化学习

针对海事图像中浮标检测需与海图条目匹配、而DETR基线只能从距离和方位隐式学习世界到图像投影的问题,论文加入冻结的QueryMLP,利用距离、逆距离、方位及IMU姿态预测浮标水线接触点,并作为像素空间先验拼接到查询向量中。该轻量改动在MaCVi 2026私有测试集取得Overall 0.7386(F1 0.8055、mIoU 0.6718),排名第二;但端到端联合训练的收益文中未充分说明。

VideoOdyssey: A Benchmark for Ultra-Long-Context and Omni-Modal Video Understanding Figure 1
2026-05-25cs.CV

VideoOdyssey: A Benchmark for Ultra-Long-Context and Omni-Modal Video Understanding

Haichen He, Jiayi Zhou, Sifeng Shang, Yihan Hu, Yuanhan Zhang, Kaiyang Zhou

Hong Kong Baptist University, S-Lab, Nanyang Technological University, GVC Lab, Great Bay University

2026-05-25视觉感知数据集/基准

针对现有长视频基准虽时长变长、但问题证据常局限于短片段,难以评估持续跟踪与记忆的缺口,VideoOdyssey提出“连续证据长度”衡量认知负载,构建平均109分钟、覆盖视觉与音视频两子集的多级基准。实验显示当前MLLM性能随连续上下文显著退化,RAG式检索也难弥补,且非语言音频理解仍薄弱。

Suicide Risk Assessment from AI-powered Video Surveillance: An Interpretable Framework for Prevention in Metro Stations Figure 1
2026-05-25cs.CV

Suicide Risk Assessment from AI-powered Video Surveillance: An Interpretable Framework for Prevention in Metro Stations

Safwen Naimi, Wassim Bouachir, Guillaume-Alexandre Bilodeau, Brian Mishara

2026-05-25视觉感知安全鲁棒

面向地铁站自杀预防,论文指出仅靠人工值守或越线告警往往过晚,需结合乘客行为、空间位置与时间累积证据进行早期风险评估。其核心是将 SRA 形式化为可解释任务,串联行人跟踪、动作识别、站台语义分割、轨迹风险热图与 XGBoost 指标聚合,避免直接推断意图。真实监控数据上自动流程达到 83.2% ROC-AUC,黄线相关行为贡献最大,但检测跟踪误差仍是主要瓶颈。

No Figure
2026-05-25cs.CV

Seeing without Looking: Do Vision-Language Benchmarks Really Test Vision?

Zixuan Lan, Luzhe Sun, Matthew R. Walter, Jiawei Zhou

University of Chicago, Equal contribution.Work done as a research intern at Stony Brook University., Toyota Technological Institute at Chicago, Stony Brook University

2026-05-25视觉语言视觉感知数据集/基准

本文质疑视觉语言基准准确率是否真的衡量视觉 grounding:作者从 POPE 上大量移除图像 token 几乎不降分的现象出发,设计全局退化、局部遮挡、实体替换、问题改写与答案空间扩展等诊断。结果显示,VLM 虽会利用图像,但标准准确率对细粒度视觉证据丢失不敏感,内部置信已减弱而答案仍不变;深层视觉 token 趋同也解释了基准可能高估真实视觉依赖。

Extending Deep Event Visual Odometry with Sparse Point-Cloud Export Figure 1
2026-05-25cs.RO

Extending Deep Event Visual Odometry with Sparse Point-Cloud Export

Alireza Safdari, Sajad Ashraf

2026-05-25视觉感知

针对事件相机视觉里程计虽能在高速和强光照变化下估计轨迹、但缺少可导出三维结构的问题,本文在不改动 DEVO 核心优化框架的前提下,暴露其内部稀疏深度与轨迹估计,加入点云导出、格式转换和清理流程。BOARD SLOW 实验显示,导出点云与 EMVS 局部一致,在 5 cm 阈值下精度较高,但密度、完整性和累计里程计漂移仍是主要限制。

GEM-4D: Geometry-Enhanced Video World Models for Robot Manipulation Figure 1
2026-05-25cs.CV

GEM-4D: Geometry-Enhanced Video World Models for Robot Manipulation

Kaichen Zhou, Yuzhen Chen, Fangneng Zhan, Hang Hua, Grace Chen, Xinhai Chang, Ao Qu, Yilun Du, Zhuang Liu, Paul Pu Liang, Mengyu Wang

Harvard AI and Robotics Lab, Harvard University, Media Lab and EECS, Princeton University, MIT-IBM Watson AI Lab

2026-05-25机器人视觉感知强化学习

GEM-4D针对视频世界模型虽逼真却缺乏跨帧点级几何一致性、难以可靠转成机器人动作的问题,提出将预训练4D几何基础模型的稠密对应特征蒸馏到视频扩散骨干中,训练时强化深度、相机运动与物体运动表征,推理仍为单流且无额外成本;再用逆动力学模块把一致的视频 rollout 转为6-DoF末端轨迹。实验显示其在视频预测和几何一致性上达到SOTA,真实操作成功率由61%提升到81%。

MedExpMem: Adapting Experience Memory for Differential Diagnosis Figure 1
2026-05-25cs.LG

MedExpMem: Adapting Experience Memory for Differential Diagnosis

Qianhan Feng, Zhongzhen Huang, Yakun Zhu, Yannian Gu, Winnie Chiu Wing Chu, Xiaofan Zhang, Qi Dou

2026-05-25视觉感知

针对医学视觉语言模型在放射诊断中“无记忆”、难以从既往误诊中积累鉴别经验的问题,MedExpMem不更新参数,而把模型自身失败提炼为成对疾病的经验笔记,记录关键区分点、决策规则和推理错误,并通过零样本暴露盲点与反思再诊断两阶段构建记忆。基于Eurorad的11个亚专科评测显示,该方法在多种VLM和规模上稳定提升诊断准确率,最高增益7.0%。